-- Logs begin at Tue 2022-11-01 18:12:36 UTC, end at Tue 2022-11-01 19:21:11 UTC. -- Nov 01 18:43:59.018683 n-d-863052-2 systemd[1]: Starting Devstack devstack@n-api.service... Nov 01 18:43:59.027423 n-d-863052-2 devstack@n-api.service[105553]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Nov 01 18:43:59.029409 n-d-863052-2 devstack@n-api.service[105553]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Nov 1 18:43:59 2022] *** Nov 01 18:43:59.029409 n-d-863052-2 devstack@n-api.service[105553]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Nov 01 18:43:59.029409 n-d-863052-2 devstack@n-api.service[105553]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Nov 01 18:43:59.029409 n-d-863052-2 devstack@n-api.service[105553]: nodename: n-d-863052-2 Nov 01 18:43:59.029409 n-d-863052-2 devstack@n-api.service[105553]: machine: x86_64 Nov 01 18:43:59.029409 n-d-863052-2 devstack@n-api.service[105553]: clock source: unix Nov 01 18:43:59.029409 n-d-863052-2 devstack@n-api.service[105553]: pcre jit disabled Nov 01 18:43:59.029409 n-d-863052-2 devstack@n-api.service[105553]: detected number of CPU cores: 4 Nov 01 18:43:59.029409 n-d-863052-2 devstack@n-api.service[105553]: current working directory: / Nov 01 18:43:59.029409 n-d-863052-2 devstack@n-api.service[105553]: detected binary path: /usr/bin/uwsgi-core Nov 01 18:43:59.030194 n-d-863052-2 devstack@n-api.service[105553]: your processes number limit is 47680 Nov 01 18:43:59.030194 n-d-863052-2 devstack@n-api.service[105553]: your memory page size is 4096 bytes Nov 01 18:43:59.030194 n-d-863052-2 devstack@n-api.service[105553]: detected max file descriptor number: 2048 Nov 01 18:43:59.030194 n-d-863052-2 devstack@n-api.service[105553]: lock engine: pthread robust mutexes Nov 01 18:43:59.030194 n-d-863052-2 devstack@n-api.service[105553]: thunder lock: enabled Nov 01 18:43:59.030194 n-d-863052-2 devstack@n-api.service[105553]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Nov 01 18:43:59.030194 n-d-863052-2 devstack@n-api.service[105553]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Nov 01 18:43:59.069350 n-d-863052-2 devstack@n-api.service[105553]: Python main interpreter initialized at 0x557c12b439c0 Nov 01 18:43:59.069350 n-d-863052-2 devstack@n-api.service[105553]: python threads support enabled Nov 01 18:43:59.069350 n-d-863052-2 devstack@n-api.service[105553]: your server socket listen backlog is limited to 100 connections Nov 01 18:43:59.069350 n-d-863052-2 devstack@n-api.service[105553]: your mercy for graceful operations on workers is 90 seconds Nov 01 18:43:59.069661 n-d-863052-2 devstack@n-api.service[105553]: mapped 403077 bytes (393 KB) for 2 cores Nov 01 18:43:59.069765 n-d-863052-2 devstack@n-api.service[105553]: *** Operational MODE: preforking *** Nov 01 18:43:59.070034 n-d-863052-2 devstack@n-api.service[105553]: *** uWSGI is running in multiple interpreter mode *** Nov 01 18:43:59.070034 n-d-863052-2 devstack@n-api.service[105553]: spawned uWSGI master process (pid: 105553) Nov 01 18:43:59.070209 n-d-863052-2 systemd[1]: Started Devstack devstack@n-api.service. Nov 01 18:43:59.071383 n-d-863052-2 devstack@n-api.service[105553]: spawned uWSGI worker 1 (pid: 105554, cores: 1) Nov 01 18:43:59.071383 n-d-863052-2 devstack@n-api.service[105553]: spawned uWSGI worker 2 (pid: 105555, cores: 1) Nov 01 18:43:59.071383 n-d-863052-2 devstack@n-api.service[105553]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Nov 01 18:43:59.726095 n-d-863052-2 devstack@n-api.service[105555]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Nov 01 18:43:59.727925 n-d-863052-2 devstack@n-api.service[105554]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Nov 01 18:44:00.797395 n-d-863052-2 devstack@n-api.service[105555]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 01 18:44:00.797395 n-d-863052-2 devstack@n-api.service[105555]: from cryptography.utils import int_from_bytes Nov 01 18:44:00.797994 n-d-863052-2 devstack@n-api.service[105555]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 01 18:44:00.797994 n-d-863052-2 devstack@n-api.service[105555]: from cryptography.utils import int_from_bytes Nov 01 18:44:00.799001 n-d-863052-2 devstack@n-api.service[105554]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 01 18:44:00.799001 n-d-863052-2 devstack@n-api.service[105554]: from cryptography.utils import int_from_bytes Nov 01 18:44:00.799438 n-d-863052-2 devstack@n-api.service[105554]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 01 18:44:00.799438 n-d-863052-2 devstack@n-api.service[105554]: from cryptography.utils import int_from_bytes Nov 01 18:44:03.304519 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Nov 01 18:44:03.305108 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Nov 01 18:44:03.305260 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Nov 01 18:44:03.305634 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Nov 01 18:44:03.305732 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Nov 01 18:44:03.305814 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Nov 01 18:44:03.305909 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Nov 01 18:44:03.306029 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Nov 01 18:44:03.306253 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:44:03.306387 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Nov 01 18:44:03.306571 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:44:03.306666 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Nov 01 18:44:03.306886 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:44:03.307007 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:44:03.307196 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:44:03.307327 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:44:03.307513 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:44:03.307649 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:44:03.307814 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:44:03.307962 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:44:03.308126 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:44:03.308285 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:44:03.308452 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:44:03.308607 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:44:03.308773 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:44:03.308931 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:44:03.309019 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:44:03.309245 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:44:03.309350 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:44:03.309566 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:44:03.309660 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-863052-2 {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:44:03.309823 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:44:03.309926 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:44:03.310138 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:44:03.310271 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:44:03.310459 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-863052-2 {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:44:03.310569 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:44:03.310774 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:44:03.310861 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:44:03.311073 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:44:03.311165 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:44:03.311378 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:44:03.311461 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:44:03.311672 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:44:03.311755 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:44:03.311982 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:44:03.312163 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:44:03.312300 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:44:03.312665 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:44:03.312768 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:44:03.312886 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:44:03.313193 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:44:03.313300 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:44:03.313502 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:44:03.313597 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:44:03.313804 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:44:03.313894 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:44:03.314105 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:44:03.314200 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:44:03.314419 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:44:03.314506 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:44:03.314719 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:44:03.314808 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:44:03.315023 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:44:03.315158 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:44:03.315322 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:44:03.315457 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:44:03.315630 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:44:03.315755 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-863052-2 {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:44:03.315949 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:44:03.316076 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:44:03.316257 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:44:03.316385 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:44:03.316606 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:44:03.316736 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-863052-2 {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:44:03.316971 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:44:03.317098 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:44:03.317279 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:44:03.317405 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:44:03.317583 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:44:03.317721 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:44:03.317893 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:44:03.318028 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:44:03.318197 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:44:03.318334 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:44:03.318493 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:44:03.318633 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:44:03.318810 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:44:03.318938 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:44:03.319123 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:44:03.319267 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:44:03.319434 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:44:03.319562 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:44:03.320274 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:44:03.320422 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:44:03.320547 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:44:03.320707 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:44:03.320875 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:44:03.321002 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:44:03.321175 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:44:03.321311 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:44:03.321485 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:44:03.321626 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:44:03.321782 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:44:03.321910 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:44:03.322077 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:44:03.322221 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:44:03.322420 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:44:03.322550 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:44:03.322673 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:44:03.322796 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:44:03.322918 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:44:03.323040 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:44:03.323214 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:44:03.323350 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:44:03.323519 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:44:03.323655 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:44:03.323790 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:44:03.323913 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:44:03.324044 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:44:03.324170 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:44:03.324292 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:44:03.324447 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:44:03.324605 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:44:03.324747 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:44:03.324916 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:44:03.325045 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:44:03.325218 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:44:03.325359 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:44:03.325567 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:44:03.325700 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:44:03.325826 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:44:03.325948 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:44:03.326097 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:44:03.326224 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:44:03.326399 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:44:03.326534 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:44:03.326700 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:44:03.326827 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:44:03.326999 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:44:03.327145 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:44:03.327309 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:44:03.327438 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:44:03.327613 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:44:03.327740 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:44:03.327920 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:44:03.328053 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:44:03.328219 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:44:03.328385 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:44:03.328530 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:44:03.328685 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:44:03.328882 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:44:03.329021 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.13 {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:44:03.329177 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.13 {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:44:03.329304 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:44:03.329476 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:44:03.329603 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:44:03.329806 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:44:03.329945 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.13 {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:44:03.330103 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.13 {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:44:03.330229 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:44:03.330434 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:44:03.330575 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:44:03.330701 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:44:03.330833 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:44:03.331009 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:44:03.331146 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:44:03.331308 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:44:03.331442 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:44:03.331605 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:44:03.331746 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:44:03.331904 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:44:03.332038 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:44:03.332213 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:44:03.332339 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:44:03.332549 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:44:03.332704 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:44:03.332845 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:44:03.332970 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:44:03.333106 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:44:03.333230 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:44:03.333362 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:44:03.333486 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:44:03.333639 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:44:03.333767 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:44:03.333949 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:44:03.334076 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:44:03.334247 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:44:03.334374 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:44:03.334545 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:44:03.334672 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:44:03.334844 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:44:03.334986 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:44:03.335140 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:44:03.335268 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:44:03.335989 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:44:03.336126 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:44:03.336314 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:44:03.336451 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:44:03.336636 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:44:03.336780 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:44:03.336947 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:44:03.337075 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:44:03.337250 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:44:03.337385 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:44:03.337552 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:44:03.337687 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:44:03.337851 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:44:03.337980 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:44:03.338150 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:44:03.338287 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:44:03.338461 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:44:03.338586 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:44:03.338734 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:44:03.338861 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:44:03.339037 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:44:03.339176 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:44:03.339341 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:44:03.339477 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:44:03.339639 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:44:03.339766 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:44:03.339939 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:44:03.340076 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:44:03.340237 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:44:03.340367 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:44:03.340601 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:44:03.340739 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:44:03.340863 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:44:03.341006 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:44:03.341145 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:44:03.341277 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:44:03.341439 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:44:03.341573 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:44:03.341753 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:44:03.341887 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:44:03.342052 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:44:03.342180 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:44:03.342351 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:44:03.342480 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:44:03.342681 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:44:03.342818 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:44:03.342943 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:44:03.343066 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:44:03.343241 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:44:03.343377 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:44:03.343552 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:44:03.343687 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:44:03.343844 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:44:03.343972 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:44:03.344144 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:44:03.344271 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:44:03.344455 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:44:03.344607 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:44:03.344781 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:44:03.344907 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:44:03.345080 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:44:03.345208 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:44:03.345378 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:44:03.345507 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:44:03.345674 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:44:03.345801 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:44:03.345972 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:44:03.346100 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:44:03.346262 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:44:03.346392 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:44:03.346553 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:44:03.346681 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:44:03.346848 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:44:03.346977 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:44:03.347142 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:44:03.347278 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:44:03.347448 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:44:03.347575 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:44:03.347748 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:44:03.347883 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:44:03.348045 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:44:03.348180 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:44:03.348343 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:44:03.348505 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:44:03.348680 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:44:03.348818 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:44:03.348972 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:44:03.349107 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:44:03.349279 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:44:03.349412 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.349582 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:44:03.349722 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.349897 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:44:03.350025 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.350228 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.350347 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.350551 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.350763 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.350892 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.351016 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.351195 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.351323 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.351501 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.351630 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.351808 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.351949 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.352126 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.352254 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.352450 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.352602 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.352804 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.352950 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.353076 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.353210 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.353344 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.353469 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.353635 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.353770 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.353957 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.354098 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.354266 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.354396 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.354575 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.354704 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.354886 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.355022 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.355189 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.355318 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.355499 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.355633 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.355815 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.355953 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.356122 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.356258 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.356424 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.356550 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.356772 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.356910 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.357089 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.357217 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.357395 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.357523 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.357707 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.357842 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.358019 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.358146 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.358324 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.358451 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.358610 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.358748 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.358916 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.359043 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.359246 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.359381 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.359551 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.359678 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.359855 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.359983 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.360168 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.360302 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.360472 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.360637 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.360843 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.360978 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.361103 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.361216 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.361398 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.361534 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.361700 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.361827 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.362002 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.362129 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.362305 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.362433 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.362611 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.362735 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.362946 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.363075 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.363208 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.363345 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.363522 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.363656 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.363828 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.363969 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.364137 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.364267 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.364443 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.364600 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.364775 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.364914 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.365076 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.365202 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.365374 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.365503 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.365671 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.365808 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.365968 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.366104 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.366266 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.366393 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.366560 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.366699 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.366882 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.367009 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.367188 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.367316 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.367484 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.367611 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.367795 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.367928 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.368090 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.368216 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.368394 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.368515 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.368708 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.368850 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.369011 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.369131 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.369310 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.369446 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.369614 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.369752 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.369918 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.370044 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.370213 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.370348 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.370517 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.370644 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.370818 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.371037 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.371158 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.371268 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.371419 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.371549 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.371715 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.371855 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.372014 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.372147 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.372317 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.372450 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.372642 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.372784 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.372996 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.373129 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.373253 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.373384 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.373547 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.373685 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.373853 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.373979 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.374156 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.374316 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.374525 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.374652 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.374777 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.374898 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.375062 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.375191 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.375365 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.375492 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.375678 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.375807 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.375995 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.376154 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.376298 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.376425 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.376674 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.376806 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.376930 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.377052 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.377188 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.377314 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.377479 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.377607 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.377774 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.377917 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.378075 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.378203 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.378370 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.378503 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.378665 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.378837 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.378964 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.379087 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.379241 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.379387 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.379520 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.379652 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.379831 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.379957 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.380130 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.380258 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.380423 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.380558 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.380741 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.380870 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.381073 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.381210 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.381355 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.381479 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.381613 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.381737 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.381909 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.382037 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.382753 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.382885 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.383063 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.383184 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.383396 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.383504 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.383701 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.383797 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.384011 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.384106 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.384316 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.384415 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.384643 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.384740 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.384949 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.385035 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.385254 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.385352 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.385563 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.385648 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.385866 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.385949 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.386171 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.386266 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.386473 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.386558 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.386781 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.386865 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.387083 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.387176 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.387390 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.387473 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.387684 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.387768 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.387991 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.388093 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.388311 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.388395 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.388632 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.388815 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.388967 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.389108 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.389240 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.389353 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.389548 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.389677 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.389855 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.389984 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.390157 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.390285 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.390461 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.390589 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.390763 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.390900 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.391064 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.391269 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.391397 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.391521 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.391653 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.391777 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.391955 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.392085 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.392253 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.392380 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.392563 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.392713 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.392884 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.393010 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.393194 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.393295 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.393487 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.393581 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.393793 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.393887 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.394105 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.394207 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.394405 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.394499 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.394732 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.394822 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.395017 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.395120 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.395330 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.395415 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.395631 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.395716 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.395933 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.396026 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.396236 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.396320 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.396533 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.396630 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.396853 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.396951 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.397155 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.397240 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.397454 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.397545 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.397755 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.397871 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.398648 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.398750 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.398950 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.399055 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.399254 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.399340 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.399554 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.399647 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.399848 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.399935 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.400143 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.400229 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.400442 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.400527 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.400767 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.400854 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.401068 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.401154 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.401377 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.401468 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.401687 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.401780 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.401983 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.402075 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.402278 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.402363 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.402591 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.402697 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.402892 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.402983 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.403189 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.403281 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.403488 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.403661 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.403779 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.403864 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.404084 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.404168 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.404384 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.404481 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.404705 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.404793 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.405013 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.405100 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.405326 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.405419 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.405623 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.405707 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.405927 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.406010 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.406231 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.406324 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.406532 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.406625 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.406843 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.406936 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.407145 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.407231 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.407446 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.407532 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.407750 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.407835 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.408054 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.408140 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.408358 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.408449 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.408684 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.408783 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.409005 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.409121 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.409309 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.409456 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.409633 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.409790 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.409931 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.410080 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.410218 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.410356 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.410495 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.410651 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.410790 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.410929 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.411067 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.411315 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.411545 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.411699 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.411846 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.411986 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.412220 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.412368 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.412555 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.412751 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.412909 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.413058 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.413196 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.413334 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.413566 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.413714 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.413872 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.414023 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.414181 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.414327 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.414467 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.414607 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.414744 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.414896 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.415035 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.415173 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.415311 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.415450 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.415601 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.415742 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.415888 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.416043 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.416182 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.416328 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.416474 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.416640 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.416799 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.416940 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.417078 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.417217 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.417363 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.417502 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.417652 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.417791 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.417939 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.418078 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.418223 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.418362 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.418500 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.418637 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.418776 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.418922 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.419109 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.419253 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.419391 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.419530 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.419668 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.419831 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.419974 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.420113 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.420259 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.420398 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.420536 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.420713 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.420855 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.420995 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.421133 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.421272 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.421409 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.421574 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.421800 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.421954 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.422100 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.422240 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.422387 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.422526 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.422663 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.422802 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.422939 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.423078 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.423224 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.423363 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.423511 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.423745 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.423890 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.424030 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.424181 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.424320 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.424457 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.424883 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.425041 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.425182 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.425329 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.425475 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.425614 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.425765 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.425904 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.426050 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.426202 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.426342 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.426480 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.426617 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.426755 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.426968 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.427110 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.427250 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.427388 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.427533 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.427681 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.427828 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.427969 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.428106 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.428246 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.428383 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.428522 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.428688 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.428788 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.428907 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.428995 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.429246 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.429360 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.429555 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.429642 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.429854 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.429950 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.430144 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.430240 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.430440 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.430526 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.430741 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.430826 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.431041 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.431134 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.431333 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.431418 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.431632 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.431715 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.431936 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.432027 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.432232 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.432317 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.432527 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.432630 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.432870 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.432965 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.433169 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.433253 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.433464 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.433549 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.433763 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.433848 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.434070 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.434154 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.434370 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.434454 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.434663 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.434748 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.434963 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.435049 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.435256 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.435341 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.435552 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.435639 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.435845 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.435930 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.436144 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.436237 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.436434 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.436526 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.436750 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.436838 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.437043 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.437144 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.437335 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.437427 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.437629 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.437723 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.437925 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.438017 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.438224 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.438309 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.438515 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.438600 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.438808 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.438906 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.439099 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.439184 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.439414 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.439511 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.439713 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.439799 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.440012 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.440112 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.440307 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.440392 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.440664 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.440752 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.440964 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.441059 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.441264 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.441349 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.441567 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.441654 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.441873 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.441955 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.442170 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.442254 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.442475 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.442561 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.442776 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.442868 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.443081 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.443177 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.443374 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.443458 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.443668 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.443756 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.443976 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.444068 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.444277 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.444361 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.444575 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.444675 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.445417 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.445563 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.445731 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.445891 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.446045 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.446203 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.446343 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.446512 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.446644 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.446830 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.446949 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.447149 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.447253 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.447468 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.447555 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.447771 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.447856 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.448080 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.448172 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.448389 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.448473 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.448718 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.448821 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.449027 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.449120 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.449332 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.449430 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.449631 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.449728 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.449930 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.450038 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.450231 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.450329 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.450525 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.450611 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.450831 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.450923 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.451129 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.451221 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.451423 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.451517 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.451723 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.451809 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.452017 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.452149 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.452318 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.452412 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.452629 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.452720 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.452937 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.453050 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.453243 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.453357 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.453544 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.453660 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.453851 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.453943 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.454152 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.454241 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.454533 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.454620 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.454854 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.454976 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.455145 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.455309 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.455441 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.455526 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.455744 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.455847 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.456052 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.456146 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.456364 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.456450 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.456696 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.456785 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.456999 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.457093 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.457319 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.457402 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.457623 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.457707 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.457937 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.458029 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.458234 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.458319 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.458529 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.458626 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.458823 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.458918 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.459135 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.459220 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.459431 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.459517 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.459736 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.459821 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.460038 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.460124 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.460382 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.461037 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.461243 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.461332 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.461535 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.461735 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.461853 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.462042 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.462267 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.462352 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.462577 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.462661 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.462882 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.462974 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.463261 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.463355 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.463561 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.463654 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.463869 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.463955 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.464171 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.464264 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.464487 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.464572 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.464826 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.464913 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.465129 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.465225 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.465434 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.465518 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.465730 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.465814 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.466044 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.466206 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.466357 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.466443 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.466664 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.466748 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.466974 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.467067 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.467277 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.467369 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.467595 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.467688 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.467913 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.468008 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.468222 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.468312 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.468540 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.468641 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.468875 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.468990 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.469174 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.469315 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.469478 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.469626 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.469772 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.469947 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.470066 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.470270 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.470382 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.470573 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.470666 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.470876 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.470966 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.471185 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.471270 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.471487 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.471573 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.471787 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.471872 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.472107 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.472192 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.472410 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.472507 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.472782 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.472873 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.473095 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.473180 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.473398 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.473492 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.473700 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.473784 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.473999 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.474084 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.474299 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.474385 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.474606 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.474690 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.474904 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.474997 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.475199 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.475284 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.475495 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.475580 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.475789 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.475886 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.476165 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.476258 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.476464 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.476548 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.476801 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.476900 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.477102 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.477186 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.477404 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.477499 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.477706 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.477804 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.478028 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.478113 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.478333 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.478417 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.478644 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.478730 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.478946 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.479032 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.479256 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.479347 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.479572 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.479659 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.479870 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.479954 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.480166 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.480250 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.480467 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.480554 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.480788 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.480875 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.481086 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.481179 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.481384 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.481471 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.481686 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.481771 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.481982 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.482075 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.482277 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.482363 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.482572 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.482668 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.482869 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.483000 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.483170 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.483255 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.483473 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.483566 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.483772 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.483866 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.484065 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.484163 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.484363 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.484448 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.484682 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.484772 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.484992 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.485076 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.485298 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.485393 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.485604 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.485689 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.485903 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.485988 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.486205 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.486291 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.486503 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.486590 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.486807 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.486891 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.487116 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.487202 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.487425 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.487518 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.487728 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.487812 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.488035 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.488131 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.488344 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.488429 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.488672 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.488759 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.488983 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.489080 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.489291 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.489375 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.489601 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.489684 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.489912 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.490110 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.490213 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.490433 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.490526 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.490740 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.490832 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.491047 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.491134 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.491352 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.491446 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.491684 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.491943 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.492038 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.492261 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.492355 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.492574 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.492682 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.492897 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.492984 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.493205 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.493298 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.493516 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.493600 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.493827 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.493921 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.494137 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.494222 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.494444 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.494608 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.494751 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.494837 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.495056 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.495143 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.495364 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.495501 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.495670 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.495756 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.495988 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.496072 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.496312 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.496406 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.496634 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.496738 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.496941 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.497027 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.497249 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.497336 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.497553 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.497638 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.497859 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.497952 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.498163 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.498250 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.498468 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.498553 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.498773 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.498866 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.499076 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.499168 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.499376 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.499462 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.499680 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.499776 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.499982 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.500067 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.500289 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.500383 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.500611 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.500711 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.500923 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.501009 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.501228 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.501312 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.501530 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.501616 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.501835 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.501918 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.502154 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.502545 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.502682 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.502790 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.502883 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.502963 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.503076 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.503256 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.503383 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.503573 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.503695 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.503880 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.504187 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.504272 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.504504 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.504651 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.504828 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.504926 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.505125 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.505224 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.505470 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.505568 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.505725 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.505812 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.506020 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.506122 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.506333 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.506419 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.506633 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.506718 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.506929 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.507023 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.507758 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.507856 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.508060 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.508146 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.508357 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.508621 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.508711 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.508937 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.509023 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.509246 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.509342 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.509564 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.509651 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.509873 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.509956 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.510180 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.510403 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.510493 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.510746 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.510831 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.511062 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.511147 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.511357 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.511443 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.511666 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.511758 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.511968 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.512062 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.512266 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.512352 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.512563 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.512668 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.512886 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.512987 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.513188 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.513274 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.513487 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.513572 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.513790 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.513892 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.514086 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.514172 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.514384 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.514468 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.514689 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.514780 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.514985 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.515070 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.515279 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.515366 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.515587 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.515705 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.515881 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.515989 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.516176 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.516284 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.516471 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.516569 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.516788 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.516885 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.517089 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.517186 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.517383 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.517482 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.517680 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.517777 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.517974 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.518071 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.518271 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.518367 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.518570 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.518667 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.518877 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.518982 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.519178 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.519276 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.519482 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.519579 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.519777 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.519893 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.520072 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.520180 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.520376 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.520474 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.520699 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.520809 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.521012 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.521111 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.521311 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.521408 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.521612 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.521717 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.521906 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.522002 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.522215 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.522318 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.522522 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.522750 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.522859 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.523631 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.523735 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.523944 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.524117 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.524271 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.524368 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.524609 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.524723 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.524917 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.525143 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.525248 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.525473 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.525570 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.525792 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.525890 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.526094 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.526198 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.526398 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.526495 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.526700 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.526811 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.527002 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.527098 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.527302 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.527398 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.527603 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.527710 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.527905 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.528002 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.528206 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.528302 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.528505 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.528630 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.528828 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.528926 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.529130 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.529227 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.529430 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.529528 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.529733 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.529831 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.530032 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.530171 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.530336 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.530431 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.530639 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.530736 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.530945 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.531042 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.531250 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.531354 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.531555 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.531660 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.531857 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.531963 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.532158 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.532254 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.532457 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.532563 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.532780 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.532889 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.533082 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.533180 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.533389 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.533498 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.533710 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.533828 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.534011 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.534097 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.534308 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.534394 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.534610 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.534915 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.535045 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.535225 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.535311 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.535541 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.535638 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.535848 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.535944 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.536148 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.536233 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.536459 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.536795 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.536886 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.537100 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.537187 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.537414 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.537500 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.537718 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.537805 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.538035 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.538119 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.538357 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.538472 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.538697 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.538782 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.539008 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.539092 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.539303 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.539397 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.539600 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.539686 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.539896 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.539981 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.540198 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.540291 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.540529 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.540671 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.540829 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.540914 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.541124 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.541219 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.541418 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.541504 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.541718 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.541803 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.542013 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.542107 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.542306 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.542392 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.542599 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.542684 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.542892 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.542979 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.543187 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.543280 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.543481 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.543558 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.543774 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.543851 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.544623 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.544751 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.544843 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.544947 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.545030 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.545030 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.545242 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.545400 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.545533 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.545747 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.546016 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.546121 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.546311 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.546426 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.546668 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.546854 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.546977 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.547153 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.547267 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.547480 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.547593 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.547803 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.547919 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.548110 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.548222 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.548423 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.548547 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.548752 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.548879 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.549066 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.549162 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.549366 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.549460 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.549943 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.550036 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.550253 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.550340 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.550558 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.550652 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.550861 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.550950 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.551183 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.551268 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.551485 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.551572 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.551788 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.551873 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.552090 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.552187 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.552391 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.552479 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.552723 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.552814 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.553028 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.553114 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.553348 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.553437 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.553654 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.553739 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.554782 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.554924 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.554924 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.555140 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.555244 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.555346 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.555448 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.555560 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.555666 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.555768 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.555966 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.556078 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.556287 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.556420 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.556613 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.556811 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.556922 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.557037 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.557201 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.557324 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.557504 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.557618 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.557807 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.557926 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.558115 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.558238 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.558416 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.558530 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.558718 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.558838 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.559465 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.559551 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.559630 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.559707 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.559707 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.559858 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.559938 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.560004 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.560204 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.560291 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.560515 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.560639 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.560850 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.560937 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.561162 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.561248 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.561474 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.561561 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.561794 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.561880 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.562109 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.562194 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.562412 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.562499 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.562713 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.562798 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.563011 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.563096 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.563247 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Nov 01 18:44:03.563365 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.563673 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.564011 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.564331 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.564665 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.564976 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.565276 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:44:03.565518 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Nov 01 18:44:03.715988 n-d-863052-2 devstack@n-api.service[105555]: INFO dbcounter [None req-52d2925c-2736-4033-950d-97dc03ca27d0 None None] Registered counter for database nova_api Nov 01 18:44:03.717824 n-d-863052-2 devstack@n-api.service[105554]: INFO dbcounter [None req-e102d76c-5085-43ce-aee3-531b9b1dbbf2 None None] Registered counter for database nova_api Nov 01 18:44:03.736449 n-d-863052-2 devstack@n-api.service[105555]: DEBUG oslo_db.sqlalchemy.engines [None req-52d2925c-2736-4033-950d-97dc03ca27d0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105555) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Nov 01 18:44:03.738154 n-d-863052-2 devstack@n-api.service[105554]: DEBUG oslo_db.sqlalchemy.engines [None req-e102d76c-5085-43ce-aee3-531b9b1dbbf2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105554) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Nov 01 18:44:03.743604 n-d-863052-2 devstack@n-api.service[105555]: DEBUG dbcounter [-] [105555] Writer thread running {{(pid=105555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Nov 01 18:44:03.745208 n-d-863052-2 devstack@n-api.service[105554]: DEBUG dbcounter [-] [105554] Writer thread running {{(pid=105554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Nov 01 18:44:03.799237 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.context [None req-52d2925c-2736-4033-950d-97dc03ca27d0 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),389766af-efe4-4d8b-b2de-e920ed3438ee(cell1) {{(pid=105555) load_cells /opt/stack/nova/nova/context.py:464}} Nov 01 18:44:03.801170 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.context [None req-e102d76c-5085-43ce-aee3-531b9b1dbbf2 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),389766af-efe4-4d8b-b2de-e920ed3438ee(cell1) {{(pid=105554) load_cells /opt/stack/nova/nova/context.py:464}} Nov 01 18:44:03.803324 n-d-863052-2 devstack@n-api.service[105555]: DEBUG oslo_concurrency.lockutils [None req-52d2925c-2736-4033-950d-97dc03ca27d0 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105555) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:44:03.803789 n-d-863052-2 devstack@n-api.service[105555]: DEBUG oslo_concurrency.lockutils [None req-52d2925c-2736-4033-950d-97dc03ca27d0 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105555) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:44:03.805560 n-d-863052-2 devstack@n-api.service[105554]: DEBUG oslo_concurrency.lockutils [None req-e102d76c-5085-43ce-aee3-531b9b1dbbf2 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:44:03.805883 n-d-863052-2 devstack@n-api.service[105555]: DEBUG oslo_concurrency.lockutils [None req-52d2925c-2736-4033-950d-97dc03ca27d0 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105555) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:44:03.805989 n-d-863052-2 devstack@n-api.service[105554]: DEBUG oslo_concurrency.lockutils [None req-e102d76c-5085-43ce-aee3-531b9b1dbbf2 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:44:03.806595 n-d-863052-2 devstack@n-api.service[105555]: DEBUG oslo_concurrency.lockutils [None req-52d2925c-2736-4033-950d-97dc03ca27d0 None None] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105555) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:44:03.807030 n-d-863052-2 devstack@n-api.service[105555]: DEBUG oslo_concurrency.lockutils [None req-52d2925c-2736-4033-950d-97dc03ca27d0 None None] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105555) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:44:03.807519 n-d-863052-2 devstack@n-api.service[105554]: DEBUG oslo_concurrency.lockutils [None req-e102d76c-5085-43ce-aee3-531b9b1dbbf2 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:44:03.808225 n-d-863052-2 devstack@n-api.service[105554]: DEBUG oslo_concurrency.lockutils [None req-e102d76c-5085-43ce-aee3-531b9b1dbbf2 None None] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:44:03.808687 n-d-863052-2 devstack@n-api.service[105554]: DEBUG oslo_concurrency.lockutils [None req-e102d76c-5085-43ce-aee3-531b9b1dbbf2 None None] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:44:03.809037 n-d-863052-2 devstack@n-api.service[105555]: DEBUG oslo_concurrency.lockutils [None req-52d2925c-2736-4033-950d-97dc03ca27d0 None None] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105555) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:44:03.810653 n-d-863052-2 devstack@n-api.service[105554]: DEBUG oslo_concurrency.lockutils [None req-e102d76c-5085-43ce-aee3-531b9b1dbbf2 None None] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:44:03.810971 n-d-863052-2 devstack@n-api.service[105555]: INFO dbcounter [None req-52d2925c-2736-4033-950d-97dc03ca27d0 None None] Registered counter for database nova_cell0 Nov 01 18:44:03.812611 n-d-863052-2 devstack@n-api.service[105554]: INFO dbcounter [None req-e102d76c-5085-43ce-aee3-531b9b1dbbf2 None None] Registered counter for database nova_cell0 Nov 01 18:44:03.814922 n-d-863052-2 devstack@n-api.service[105555]: INFO dbcounter [None req-52d2925c-2736-4033-950d-97dc03ca27d0 None None] Registered counter for database nova_cell1 Nov 01 18:44:03.816693 n-d-863052-2 devstack@n-api.service[105554]: INFO dbcounter [None req-e102d76c-5085-43ce-aee3-531b9b1dbbf2 None None] Registered counter for database nova_cell1 Nov 01 18:44:03.822829 n-d-863052-2 devstack@n-api.service[105555]: DEBUG oslo_db.sqlalchemy.engines [None req-52d2925c-2736-4033-950d-97dc03ca27d0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105555) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Nov 01 18:44:03.824470 n-d-863052-2 devstack@n-api.service[105554]: DEBUG oslo_db.sqlalchemy.engines [None req-e102d76c-5085-43ce-aee3-531b9b1dbbf2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105554) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Nov 01 18:44:03.826868 n-d-863052-2 devstack@n-api.service[105555]: DEBUG oslo_db.sqlalchemy.engines [None req-52d2925c-2736-4033-950d-97dc03ca27d0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105555) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Nov 01 18:44:03.828872 n-d-863052-2 devstack@n-api.service[105555]: DEBUG dbcounter [-] [105555] Writer thread running {{(pid=105555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Nov 01 18:44:03.829052 n-d-863052-2 devstack@n-api.service[105554]: DEBUG dbcounter [-] [105554] Writer thread running {{(pid=105554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Nov 01 18:44:03.829676 n-d-863052-2 devstack@n-api.service[105554]: DEBUG oslo_db.sqlalchemy.engines [None req-e102d76c-5085-43ce-aee3-531b9b1dbbf2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105554) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Nov 01 18:44:03.968856 n-d-863052-2 devstack@n-api.service[105555]: DEBUG dbcounter [-] [105555] Writer thread running {{(pid=105555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Nov 01 18:44:03.970828 n-d-863052-2 devstack@n-api.service[105554]: DEBUG dbcounter [-] [105554] Writer thread running {{(pid=105554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Nov 01 18:44:03.977460 n-d-863052-2 devstack@n-api.service[105555]: INFO dbcounter [None req-52d2925c-2736-4033-950d-97dc03ca27d0 None None] Registered counter for database nova_cell0 Nov 01 18:44:03.979307 n-d-863052-2 devstack@n-api.service[105554]: INFO dbcounter [None req-e102d76c-5085-43ce-aee3-531b9b1dbbf2 None None] Registered counter for database nova_cell0 Nov 01 18:44:03.986413 n-d-863052-2 devstack@n-api.service[105555]: DEBUG oslo_db.sqlalchemy.engines [None req-52d2925c-2736-4033-950d-97dc03ca27d0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105555) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Nov 01 18:44:03.989920 n-d-863052-2 devstack@n-api.service[105554]: DEBUG oslo_db.sqlalchemy.engines [None req-e102d76c-5085-43ce-aee3-531b9b1dbbf2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105554) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Nov 01 18:44:03.991111 n-d-863052-2 devstack@n-api.service[105555]: DEBUG dbcounter [-] [105555] Writer thread running {{(pid=105555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Nov 01 18:44:03.994572 n-d-863052-2 devstack@n-api.service[105554]: DEBUG dbcounter [-] [105554] Writer thread running {{(pid=105554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Nov 01 18:44:04.328653 n-d-863052-2 devstack@n-api.service[105554]: WARNING keystonemiddleware.auth_token [None req-e102d76c-5085-43ce-aee3-531b9b1dbbf2 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 01 18:44:04.331913 n-d-863052-2 devstack@n-api.service[105555]: WARNING keystonemiddleware.auth_token [None req-52d2925c-2736-4033-950d-97dc03ca27d0 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 01 18:44:04.335875 n-d-863052-2 devstack@n-api.service[105554]: WARNING keystonemiddleware.auth_token [None req-e102d76c-5085-43ce-aee3-531b9b1dbbf2 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 01 18:44:04.339139 n-d-863052-2 devstack@n-api.service[105555]: WARNING keystonemiddleware.auth_token [None req-52d2925c-2736-4033-950d-97dc03ca27d0 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 01 18:44:04.677100 n-d-863052-2 devstack@n-api.service[105554]: WARNING keystonemiddleware.auth_token [None req-e102d76c-5085-43ce-aee3-531b9b1dbbf2 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 01 18:44:04.681559 n-d-863052-2 devstack@n-api.service[105555]: WARNING keystonemiddleware.auth_token [None req-52d2925c-2736-4033-950d-97dc03ca27d0 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 01 18:44:04.683751 n-d-863052-2 devstack@n-api.service[105554]: WARNING keystonemiddleware.auth_token [None req-e102d76c-5085-43ce-aee3-531b9b1dbbf2 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 01 18:44:04.687447 n-d-863052-2 devstack@n-api.service[105555]: WARNING keystonemiddleware.auth_token [None req-52d2925c-2736-4033-950d-97dc03ca27d0 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 01 18:44:04.689090 n-d-863052-2 devstack@n-api.service[105554]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x557c12b439c0 pid: 105554 (default app) Nov 01 18:44:04.691137 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi [None req-e102d76c-5085-43ce-aee3-531b9b1dbbf2 None None] Calling method '>' {{(pid=105554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:44:04.692315 n-d-863052-2 devstack@n-api.service[105554]: INFO nova.api.openstack.requestlog [None req-e102d76c-5085-43ce-aee3-531b9b1dbbf2 None None] 10.222.0.13 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001713 Nov 01 18:44:04.692730 n-d-863052-2 devstack@n-api.service[105555]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x557c12b439c0 pid: 105555 (default app) Nov 01 18:44:04.692866 n-d-863052-2 devstack@n-api.service[105554]: [pid: 105554|app: 0|req: 1/1] 10.222.0.13 () {50 vars in 788 bytes} [Tue Nov 1 18:44:04 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 18:45:25.799819 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi [None req-e102d76c-5085-43ce-aee3-531b9b1dbbf2 None None] Calling method '>' {{(pid=105554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:45:25.801595 n-d-863052-2 devstack@n-api.service[105554]: INFO nova.api.openstack.requestlog [None req-e102d76c-5085-43ce-aee3-531b9b1dbbf2 None None] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002292 Nov 01 18:45:25.802608 n-d-863052-2 devstack@n-api.service[105554]: [pid: 105554|app: 0|req: 2/2] 10.222.0.13 () {54 vars in 931 bytes} [Tue Nov 1 18:45:25 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 18:45:25.824114 n-d-863052-2 devstack@n-api.service[105555]: DEBUG dbcounter [-] [105555] Writing DB stats nova_api:SELECT=3 {{(pid=105555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 18:45:25.825558 n-d-863052-2 devstack@n-api.service[105555]: DEBUG dbcounter [-] [105555] Writing DB stats nova_cell1:SELECT=3 {{(pid=105555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 18:45:25.826616 n-d-863052-2 devstack@n-api.service[105555]: DEBUG dbcounter [-] [105555] Writing DB stats nova_cell0:SELECT=3 {{(pid=105555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 18:45:25.828197 n-d-863052-2 devstack@n-api.service[105555]: DEBUG dbcounter [-] [105555] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=105555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 18:45:26.722988 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi [None req-58db6460-f5f1-435d-8e59-6ab130a96e72 admin admin] Calling method '>' {{(pid=105555) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:45:26.755685 n-d-863052-2 devstack@n-api.service[105555]: INFO nova.api.openstack.requestlog [None req-58db6460-f5f1-435d-8e59-6ab130a96e72 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.943319 Nov 01 18:45:26.756428 n-d-863052-2 devstack@n-api.service[105555]: [pid: 105555|app: 0|req: 1/3] 10.222.0.13 () {60 vars in 1292 bytes} [Tue Nov 1 18:45:25 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 945 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:45:29.377621 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi [None req-e102d76c-5085-43ce-aee3-531b9b1dbbf2 None None] Calling method '>' {{(pid=105554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:45:29.379221 n-d-863052-2 devstack@n-api.service[105554]: INFO nova.api.openstack.requestlog [None req-e102d76c-5085-43ce-aee3-531b9b1dbbf2 None None] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001394 Nov 01 18:45:29.379801 n-d-863052-2 devstack@n-api.service[105554]: [pid: 105554|app: 0|req: 3/4] 10.222.0.13 () {54 vars in 931 bytes} [Tue Nov 1 18:45:29 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 18:45:29.828802 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi [None req-828b26ab-de7c-4dc2-8a75-ddd742a91ca0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 1, "ram": 256, "os-flavor-access:is_public": true, "swap": 0, "rxtx_factor": 1.0, "id": "c1", "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "cirros256"}} {{(pid=105555) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 18:45:29.876279 n-d-863052-2 devstack@n-api.service[105555]: INFO nova.api.openstack.requestlog [None req-828b26ab-de7c-4dc2-8a75-ddd742a91ca0 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.490641 Nov 01 18:45:29.876875 n-d-863052-2 devstack@n-api.service[105555]: [pid: 105555|app: 0|req: 2/5] 10.222.0.13 () {64 vars in 1283 bytes} [Tue Nov 1 18:45:29 2022] POST /compute/v2.1/flavors => generated 407 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 01 18:45:29.890532 n-d-863052-2 devstack@n-api.service[105554]: DEBUG dbcounter [-] [105554] Writing DB stats nova_api:SELECT=3 {{(pid=105554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 18:45:29.892523 n-d-863052-2 devstack@n-api.service[105554]: DEBUG dbcounter [-] [105554] Writing DB stats nova_cell0:SELECT=3 {{(pid=105554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 18:45:29.895571 n-d-863052-2 devstack@n-api.service[105554]: DEBUG dbcounter [-] [105554] Writing DB stats nova_cell1:SELECT=3 {{(pid=105554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 18:45:29.896302 n-d-863052-2 devstack@n-api.service[105554]: DEBUG dbcounter [-] [105554] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=105554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 18:45:30.100156 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi [None req-2a344db2-61a6-4eda-a5ea-81f797cb605b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 18:45:30.169141 n-d-863052-2 devstack@n-api.service[105554]: INFO nova.api.openstack.requestlog [None req-2a344db2-61a6-4eda-a5ea-81f797cb605b admin admin] 10.222.0.13 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.283657 Nov 01 18:45:30.169798 n-d-863052-2 devstack@n-api.service[105554]: [pid: 105554|app: 0|req: 4/6] 10.222.0.13 () {64 vars in 1336 bytes} [Tue Nov 1 18:45:29 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:45:32.818495 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi [None req-828b26ab-de7c-4dc2-8a75-ddd742a91ca0 admin admin] Calling method '>' {{(pid=105555) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:45:32.820235 n-d-863052-2 devstack@n-api.service[105555]: INFO nova.api.openstack.requestlog [None req-828b26ab-de7c-4dc2-8a75-ddd742a91ca0 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002233 Nov 01 18:45:32.821058 n-d-863052-2 devstack@n-api.service[105555]: [pid: 105555|app: 0|req: 3/7] 10.222.0.13 () {54 vars in 931 bytes} [Tue Nov 1 18:45:32 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 18:45:33.630127 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi [None req-e8227256-6f16-4db7-ae3f-febe5a310a05 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "disk": 5, "vcpus": 1, "name": "ds512M", "rxtx_factor": 1.0, "id": "d1", "swap": 0}} {{(pid=105554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 18:45:33.682020 n-d-863052-2 devstack@n-api.service[105554]: INFO nova.api.openstack.requestlog [None req-e8227256-6f16-4db7-ae3f-febe5a310a05 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.853925 Nov 01 18:45:33.683269 n-d-863052-2 devstack@n-api.service[105554]: [pid: 105554|app: 0|req: 5/8] 10.222.0.13 () {64 vars in 1283 bytes} [Tue Nov 1 18:45:32 2022] POST /compute/v2.1/flavors => generated 404 bytes in 856 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 01 18:45:33.696865 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi [None req-c289cfd7-41fb-44df-8f67-3c0bcf84026a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105555) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 18:45:33.754634 n-d-863052-2 devstack@n-api.service[105555]: INFO nova.api.openstack.requestlog [None req-c289cfd7-41fb-44df-8f67-3c0bcf84026a admin admin] 10.222.0.13 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.062611 Nov 01 18:45:33.756105 n-d-863052-2 devstack@n-api.service[105555]: [pid: 105555|app: 0|req: 4/9] 10.222.0.13 () {64 vars in 1336 bytes} [Tue Nov 1 18:45:33 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 18:45:36.658482 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi [None req-e8227256-6f16-4db7-ae3f-febe5a310a05 admin admin] Calling method '>' {{(pid=105554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:45:36.660043 n-d-863052-2 devstack@n-api.service[105554]: INFO nova.api.openstack.requestlog [None req-e8227256-6f16-4db7-ae3f-febe5a310a05 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001458 Nov 01 18:45:36.660788 n-d-863052-2 devstack@n-api.service[105554]: [pid: 105554|app: 0|req: 6/10] 10.222.0.13 () {54 vars in 931 bytes} [Tue Nov 1 18:45:36 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 18:45:37.218538 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi [None req-e9464baa-9233-4068-9a93-0013cb316233 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds1G", "disk": 10, "rxtx_factor": 1.0, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d2", "swap": 0, "ram": 1024, "os-flavor-access:is_public": true}} {{(pid=105555) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 18:45:37.243139 n-d-863052-2 devstack@n-api.service[105555]: INFO nova.api.openstack.requestlog [None req-e9464baa-9233-4068-9a93-0013cb316233 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.573540 Nov 01 18:45:37.249263 n-d-863052-2 devstack@n-api.service[105555]: [pid: 105555|app: 0|req: 5/11] 10.222.0.13 () {64 vars in 1283 bytes} [Tue Nov 1 18:45:36 2022] POST /compute/v2.1/flavors => generated 404 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 01 18:45:37.256606 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi [None req-bc39f3f0-d2c4-4e44-895b-4468bd5c3b05 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 18:45:37.287488 n-d-863052-2 devstack@n-api.service[105554]: INFO nova.api.openstack.requestlog [None req-bc39f3f0-d2c4-4e44-895b-4468bd5c3b05 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.034503 Nov 01 18:45:37.288085 n-d-863052-2 devstack@n-api.service[105554]: [pid: 105554|app: 0|req: 7/12] 10.222.0.13 () {64 vars in 1336 bytes} [Tue Nov 1 18:45:37 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 18:45:39.920294 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi [None req-e9464baa-9233-4068-9a93-0013cb316233 admin admin] Calling method '>' {{(pid=105555) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:45:39.921388 n-d-863052-2 devstack@n-api.service[105555]: INFO nova.api.openstack.requestlog [None req-e9464baa-9233-4068-9a93-0013cb316233 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001590 Nov 01 18:45:39.922091 n-d-863052-2 devstack@n-api.service[105555]: [pid: 105555|app: 0|req: 6/13] 10.222.0.13 () {54 vars in 931 bytes} [Tue Nov 1 18:45:39 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 18:45:40.379301 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi [None req-1cc37927-5a0e-494f-a426-5dc57a1cee0d admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 2048, "vcpus": 2, "disk": 10, "name": "ds2G", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "id": "d3", "swap": 0, "rxtx_factor": 1.0}} {{(pid=105554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 18:45:40.401886 n-d-863052-2 devstack@n-api.service[105554]: INFO nova.api.openstack.requestlog [None req-1cc37927-5a0e-494f-a426-5dc57a1cee0d admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.472681 Nov 01 18:45:40.402442 n-d-863052-2 devstack@n-api.service[105554]: [pid: 105554|app: 0|req: 8/14] 10.222.0.13 () {64 vars in 1283 bytes} [Tue Nov 1 18:45:39 2022] POST /compute/v2.1/flavors => generated 404 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 01 18:45:40.418553 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi [None req-a3411daf-c1df-42b5-87d6-e1a0fc66a663 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105555) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 18:45:40.448614 n-d-863052-2 devstack@n-api.service[105555]: INFO nova.api.openstack.requestlog [None req-a3411daf-c1df-42b5-87d6-e1a0fc66a663 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.036761 Nov 01 18:45:40.449457 n-d-863052-2 devstack@n-api.service[105555]: [pid: 105555|app: 0|req: 7/15] 10.222.0.13 () {64 vars in 1336 bytes} [Tue Nov 1 18:45:40 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (3 switches on core 0) Nov 01 18:45:43.182348 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi [None req-1cc37927-5a0e-494f-a426-5dc57a1cee0d admin admin] Calling method '>' {{(pid=105554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:45:43.184051 n-d-863052-2 devstack@n-api.service[105554]: INFO nova.api.openstack.requestlog [None req-1cc37927-5a0e-494f-a426-5dc57a1cee0d admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002141 Nov 01 18:45:43.188935 n-d-863052-2 devstack@n-api.service[105554]: [pid: 105554|app: 0|req: 9/16] 10.222.0.13 () {54 vars in 931 bytes} [Tue Nov 1 18:45:43 2022] GET /compute/v2.1 => generated 388 bytes in 7 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 18:45:43.614845 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi [None req-6e080185-9670-417f-abc6-8963f8e1b8e6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds4G", "id": "d4", "ram": 4096, "vcpus": 4, "disk": 20, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "os-flavor-access:is_public": true, "rxtx_factor": 1.0}} {{(pid=105555) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 18:45:43.633850 n-d-863052-2 devstack@n-api.service[105555]: INFO nova.api.openstack.requestlog [None req-6e080185-9670-417f-abc6-8963f8e1b8e6 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.443213 Nov 01 18:45:43.634916 n-d-863052-2 devstack@n-api.service[105555]: [pid: 105555|app: 0|req: 8/17] 10.222.0.13 () {64 vars in 1283 bytes} [Tue Nov 1 18:45:43 2022] POST /compute/v2.1/flavors => generated 404 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 01 18:45:43.647494 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi [None req-bb74bdbd-95f0-478a-9eb6-b073514a3f84 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 18:45:43.682488 n-d-863052-2 devstack@n-api.service[105554]: INFO nova.api.openstack.requestlog [None req-bb74bdbd-95f0-478a-9eb6-b073514a3f84 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.039044 Nov 01 18:45:43.700469 n-d-863052-2 devstack@n-api.service[105554]: [pid: 105554|app: 0|req: 10/18] 10.222.0.13 () {64 vars in 1336 bytes} [Tue Nov 1 18:45:43 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 18:45:46.335825 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi [None req-6e080185-9670-417f-abc6-8963f8e1b8e6 admin admin] Calling method '>' {{(pid=105555) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:45:46.336861 n-d-863052-2 devstack@n-api.service[105555]: INFO nova.api.openstack.requestlog [None req-6e080185-9670-417f-abc6-8963f8e1b8e6 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001449 Nov 01 18:45:46.337262 n-d-863052-2 devstack@n-api.service[105555]: [pid: 105555|app: 0|req: 9/19] 10.222.0.13 () {54 vars in 931 bytes} [Tue Nov 1 18:45:46 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 18:45:46.764097 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi [None req-bd4fe6b5-f31f-4fc7-a774-c749a0bbce03 admin admin] Calling method '>' {{(pid=105554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:45:46.789515 n-d-863052-2 devstack@n-api.service[105554]: INFO nova.api.openstack.requestlog [None req-bd4fe6b5-f31f-4fc7-a774-c749a0bbce03 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.446280 Nov 01 18:45:46.790084 n-d-863052-2 devstack@n-api.service[105554]: [pid: 105554|app: 0|req: 11/20] 10.222.0.13 () {60 vars in 1292 bytes} [Tue Nov 1 18:45:46 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 18:45:49.465986 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi [None req-6e080185-9670-417f-abc6-8963f8e1b8e6 admin admin] Calling method '>' {{(pid=105555) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:45:49.467221 n-d-863052-2 devstack@n-api.service[105555]: INFO nova.api.openstack.requestlog [None req-6e080185-9670-417f-abc6-8963f8e1b8e6 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001914 Nov 01 18:45:49.467786 n-d-863052-2 devstack@n-api.service[105555]: [pid: 105555|app: 0|req: 10/21] 10.222.0.13 () {54 vars in 931 bytes} [Tue Nov 1 18:45:49 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 18:45:49.892722 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi [None req-960a2c55-52f7-44b6-b7d6-6f059a19f0b5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "ram": 512, "swap": 0, "rxtx_factor": 1.0, "id": "1", "disk": 1, "os-flavor-access:is_public": true, "name": "m1.tiny", "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=105554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 18:45:49.915518 n-d-863052-2 devstack@n-api.service[105554]: INFO nova.api.openstack.requestlog [None req-960a2c55-52f7-44b6-b7d6-6f059a19f0b5 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.441006 Nov 01 18:45:49.916202 n-d-863052-2 devstack@n-api.service[105554]: [pid: 105554|app: 0|req: 12/22] 10.222.0.13 () {64 vars in 1283 bytes} [Tue Nov 1 18:45:49 2022] POST /compute/v2.1/flavors => generated 402 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 01 18:45:49.929771 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi [None req-7a50ba97-03ba-49e4-939b-a270eb248a7f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105555) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 18:45:49.973980 n-d-863052-2 devstack@n-api.service[105555]: INFO nova.api.openstack.requestlog [None req-7a50ba97-03ba-49e4-939b-a270eb248a7f admin admin] 10.222.0.13 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.048851 Nov 01 18:45:49.974572 n-d-863052-2 devstack@n-api.service[105555]: [pid: 105555|app: 0|req: 11/23] 10.222.0.13 () {64 vars in 1333 bytes} [Tue Nov 1 18:45:49 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:45:52.701635 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi [None req-960a2c55-52f7-44b6-b7d6-6f059a19f0b5 admin admin] Calling method '>' {{(pid=105554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:45:52.702562 n-d-863052-2 devstack@n-api.service[105554]: INFO nova.api.openstack.requestlog [None req-960a2c55-52f7-44b6-b7d6-6f059a19f0b5 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001451 Nov 01 18:45:52.702956 n-d-863052-2 devstack@n-api.service[105554]: [pid: 105554|app: 0|req: 13/24] 10.222.0.13 () {54 vars in 931 bytes} [Tue Nov 1 18:45:52 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 18:45:53.103351 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi [None req-12dd396a-4f07-4e84-ae1b-79502e1c112f admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "vcpus": 1, "name": "m1.small", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "disk": 20, "swap": 0, "id": "2", "ram": 2048}} {{(pid=105555) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 18:45:53.122776 n-d-863052-2 devstack@n-api.service[105555]: INFO nova.api.openstack.requestlog [None req-12dd396a-4f07-4e84-ae1b-79502e1c112f admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.413921 Nov 01 18:45:53.123363 n-d-863052-2 devstack@n-api.service[105555]: [pid: 105555|app: 0|req: 12/25] 10.222.0.13 () {64 vars in 1283 bytes} [Tue Nov 1 18:45:52 2022] POST /compute/v2.1/flavors => generated 405 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 01 18:45:53.135795 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi [None req-6b331b37-422b-4671-bce4-e3a45b3733f4 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 18:45:53.160725 n-d-863052-2 devstack@n-api.service[105554]: INFO nova.api.openstack.requestlog [None req-6b331b37-422b-4671-bce4-e3a45b3733f4 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028427 Nov 01 18:45:53.161294 n-d-863052-2 devstack@n-api.service[105554]: [pid: 105554|app: 0|req: 14/26] 10.222.0.13 () {64 vars in 1333 bytes} [Tue Nov 1 18:45:53 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:45:55.754351 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi [None req-12dd396a-4f07-4e84-ae1b-79502e1c112f admin admin] Calling method '>' {{(pid=105555) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:45:55.755712 n-d-863052-2 devstack@n-api.service[105555]: INFO nova.api.openstack.requestlog [None req-12dd396a-4f07-4e84-ae1b-79502e1c112f admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001514 Nov 01 18:45:55.756075 n-d-863052-2 devstack@n-api.service[105555]: [pid: 105555|app: 0|req: 13/27] 10.222.0.13 () {54 vars in 931 bytes} [Tue Nov 1 18:45:55 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 18:45:56.128755 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi [None req-f9a99d0e-0fdf-4d98-b7c8-563f5607c0ba admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.medium", "vcpus": 2, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "ram": 4096, "swap": 0, "rxtx_factor": 1.0, "id": "3", "disk": 40}} {{(pid=105554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 18:45:56.148007 n-d-863052-2 devstack@n-api.service[105554]: INFO nova.api.openstack.requestlog [None req-f9a99d0e-0fdf-4d98-b7c8-563f5607c0ba admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.384391 Nov 01 18:45:56.148248 n-d-863052-2 devstack@n-api.service[105554]: [pid: 105554|app: 0|req: 15/28] 10.222.0.13 () {64 vars in 1283 bytes} [Tue Nov 1 18:45:55 2022] POST /compute/v2.1/flavors => generated 406 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 01 18:45:56.160852 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi [None req-b49d279d-58fb-4ea3-9a3d-da3c74b9efa9 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105555) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 18:45:56.165824 n-d-863052-2 devstack@n-api.service[105555]: DEBUG dbcounter [-] [105555] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=7,nova_api:SAVEPOINT=3,nova_api:RELEASE=3 {{(pid=105555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 18:45:56.191520 n-d-863052-2 devstack@n-api.service[105555]: INFO nova.api.openstack.requestlog [None req-b49d279d-58fb-4ea3-9a3d-da3c74b9efa9 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.035271 Nov 01 18:45:56.192102 n-d-863052-2 devstack@n-api.service[105555]: [pid: 105555|app: 0|req: 14/29] 10.222.0.13 () {64 vars in 1333 bytes} [Tue Nov 1 18:45:56 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 18:45:58.911131 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi [None req-f9a99d0e-0fdf-4d98-b7c8-563f5607c0ba admin admin] Calling method '>' {{(pid=105554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:45:58.912802 n-d-863052-2 devstack@n-api.service[105554]: INFO nova.api.openstack.requestlog [None req-f9a99d0e-0fdf-4d98-b7c8-563f5607c0ba admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002057 Nov 01 18:45:58.918462 n-d-863052-2 devstack@n-api.service[105554]: [pid: 105554|app: 0|req: 16/30] 10.222.0.13 () {54 vars in 931 bytes} [Tue Nov 1 18:45:58 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 18:45:59.344552 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi [None req-fde6f4d9-5685-45d5-a043-28d686865304 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "vcpus": 4, "ram": 8192, "id": "4", "disk": 80, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.large", "os-flavor-access:is_public": true}} {{(pid=105555) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 18:45:59.364168 n-d-863052-2 devstack@n-api.service[105555]: INFO nova.api.openstack.requestlog [None req-fde6f4d9-5685-45d5-a043-28d686865304 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.444311 Nov 01 18:45:59.365383 n-d-863052-2 devstack@n-api.service[105555]: [pid: 105555|app: 0|req: 15/31] 10.222.0.13 () {64 vars in 1283 bytes} [Tue Nov 1 18:45:58 2022] POST /compute/v2.1/flavors => generated 405 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 01 18:45:59.378018 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi [None req-1346b9b0-5926-498d-9416-378dacb64fe0 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 18:45:59.404538 n-d-863052-2 devstack@n-api.service[105554]: INFO nova.api.openstack.requestlog [None req-1346b9b0-5926-498d-9416-378dacb64fe0 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030753 Nov 01 18:45:59.405829 n-d-863052-2 devstack@n-api.service[105554]: [pid: 105554|app: 0|req: 17/32] 10.222.0.13 () {64 vars in 1333 bytes} [Tue Nov 1 18:45:59 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:46:02.079983 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi [None req-fde6f4d9-5685-45d5-a043-28d686865304 admin admin] Calling method '>' {{(pid=105555) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:46:02.081068 n-d-863052-2 devstack@n-api.service[105555]: INFO nova.api.openstack.requestlog [None req-fde6f4d9-5685-45d5-a043-28d686865304 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001544 Nov 01 18:46:02.081731 n-d-863052-2 devstack@n-api.service[105555]: [pid: 105555|app: 0|req: 16/33] 10.222.0.13 () {54 vars in 931 bytes} [Tue Nov 1 18:46:02 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 18:46:02.519277 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi [None req-1ae3bd6c-8fad-4ae2-8000-fbd772dbf667 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 160, "id": "5", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "ram": 16384, "name": "m1.xlarge", "rxtx_factor": 1.0, "vcpus": 8, "os-flavor-access:is_public": true}} {{(pid=105554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 18:46:02.528943 n-d-863052-2 devstack@n-api.service[105554]: DEBUG dbcounter [-] [105554] Writing DB stats nova_api:SELECT=45,nova_api:SAVEPOINT=5,nova_api:INSERT=9,nova_api:RELEASE=5 {{(pid=105554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 18:46:02.542608 n-d-863052-2 devstack@n-api.service[105554]: INFO nova.api.openstack.requestlog [None req-1ae3bd6c-8fad-4ae2-8000-fbd772dbf667 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.454650 Nov 01 18:46:02.543386 n-d-863052-2 devstack@n-api.service[105554]: [pid: 105554|app: 0|req: 18/34] 10.222.0.13 () {64 vars in 1283 bytes} [Tue Nov 1 18:46:02 2022] POST /compute/v2.1/flavors => generated 408 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 01 18:46:02.557114 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi [None req-61492539-eab7-4c10-a703-30407d75fa93 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105555) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 18:46:02.585043 n-d-863052-2 devstack@n-api.service[105555]: INFO nova.api.openstack.requestlog [None req-61492539-eab7-4c10-a703-30407d75fa93 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032222 Nov 01 18:46:02.596657 n-d-863052-2 devstack@n-api.service[105555]: [pid: 105555|app: 0|req: 17/35] 10.222.0.13 () {64 vars in 1333 bytes} [Tue Nov 1 18:46:02 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:46:23.193137 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi [None req-1ae3bd6c-8fad-4ae2-8000-fbd772dbf667 admin admin] Calling method '>' {{(pid=105554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:46:23.194178 n-d-863052-2 devstack@n-api.service[105554]: INFO nova.api.openstack.requestlog [None req-1ae3bd6c-8fad-4ae2-8000-fbd772dbf667 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001529 Nov 01 18:46:23.194577 n-d-863052-2 devstack@n-api.service[105554]: [pid: 105554|app: 0|req: 19/36] 10.222.0.13 () {54 vars in 931 bytes} [Tue Nov 1 18:46:23 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 18:46:23.205669 n-d-863052-2 devstack@n-api.service[105555]: DEBUG dbcounter [-] [105555] Writing DB stats nova_api:SELECT=14,nova_api:SAVEPOINT=2,nova_api:INSERT=3,nova_api:RELEASE=2 {{(pid=105555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 18:46:23.584785 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi [None req-e1f170d0-95a9-4cc5-a3bb-534823e60ae6 admin admin] Calling method '>' {{(pid=105555) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:46:23.602807 n-d-863052-2 devstack@n-api.service[105555]: INFO nova.api.openstack.requestlog [None req-e1f170d0-95a9-4cc5-a3bb-534823e60ae6 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.402125 Nov 01 18:46:23.603341 n-d-863052-2 devstack@n-api.service[105555]: [pid: 105555|app: 0|req: 18/37] 10.222.0.13 () {60 vars in 1292 bytes} [Tue Nov 1 18:46:23 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 01 18:46:24.897159 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi [None req-1ae3bd6c-8fad-4ae2-8000-fbd772dbf667 admin admin] Calling method '>' {{(pid=105554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:46:24.898168 n-d-863052-2 devstack@n-api.service[105554]: INFO nova.api.openstack.requestlog [None req-1ae3bd6c-8fad-4ae2-8000-fbd772dbf667 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001473 Nov 01 18:46:24.898570 n-d-863052-2 devstack@n-api.service[105554]: [pid: 105554|app: 0|req: 20/38] 10.222.0.13 () {56 vars in 1074 bytes} [Tue Nov 1 18:46:24 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 18:46:25.435867 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi [None req-eacad263-57ed-4e7b-bbfc-fb777f0c3145 admin admin] Calling method '>' {{(pid=105555) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:46:25.441717 n-d-863052-2 devstack@n-api.service[105555]: INFO nova.api.openstack.wsgi [None req-eacad263-57ed-4e7b-bbfc-fb777f0c3145 admin admin] HTTP exception thrown: Flavor 42 could not be found. Nov 01 18:46:25.444953 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi [None req-eacad263-57ed-4e7b-bbfc-fb777f0c3145 admin admin] Request method failure captured: Nov 01 18:46:25.444953 n-d-863052-2 devstack@n-api.service[105555]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Nov 01 18:46:25.444953 n-d-863052-2 devstack@n-api.service[105555]: Accept: application/json Nov 01 18:46:25.444953 n-d-863052-2 devstack@n-api.service[105555]: Accept-Encoding: gzip, deflate Nov 01 18:46:25.444953 n-d-863052-2 devstack@n-api.service[105555]: Connection: keep-alive Nov 01 18:46:25.444953 n-d-863052-2 devstack@n-api.service[105555]: Content-Length: 0 Nov 01 18:46:25.444953 n-d-863052-2 devstack@n-api.service[105555]: Host: 10.222.0.13 Nov 01 18:46:25.444953 n-d-863052-2 devstack@n-api.service[105555]: Openstack-Api-Version: compute 2.92 Nov 01 18:46:25.444953 n-d-863052-2 devstack@n-api.service[105555]: Openstack-System-Scope: None Nov 01 18:46:25.444953 n-d-863052-2 devstack@n-api.service[105555]: User-Agent: python-novaclient Nov 01 18:46:25.444953 n-d-863052-2 devstack@n-api.service[105555]: X-Auth-Token: gAAAAABjYWmAu_KFEWT0WmsGqB57tHty2Cv1SbPqtEx342s2wdvTiUa7SziVpDesQMAtaocuQFQiRLpBZsPS9cSO-b5m60k40gyj3uuRAVjJTj3sHARrx5QiRKcO-XkSfnjQ9YC4arfpGIqy_rMQ9MI1PQWVJNFt077o99_vuLglqz55-iUlx3E Nov 01 18:46:25.444953 n-d-863052-2 devstack@n-api.service[105555]: X-Domain-Id: None Nov 01 18:46:25.444953 n-d-863052-2 devstack@n-api.service[105555]: X-Domain-Name: None Nov 01 18:46:25.444953 n-d-863052-2 devstack@n-api.service[105555]: X-Identity-Status: Confirmed Nov 01 18:46:25.444953 n-d-863052-2 devstack@n-api.service[105555]: X-Is-Admin-Project: True Nov 01 18:46:25.444953 n-d-863052-2 devstack@n-api.service[105555]: X-Openstack-Nova-Api-Version: 2.92 Nov 01 18:46:25.444953 n-d-863052-2 devstack@n-api.service[105555]: X-Project-Domain-Id: default Nov 01 18:46:25.444953 n-d-863052-2 devstack@n-api.service[105555]: X-Project-Domain-Name: Default Nov 01 18:46:25.444953 n-d-863052-2 devstack@n-api.service[105555]: X-Project-Id: 5fcfcdc5c75c4fcb816b0820e369209b Nov 01 18:46:25.444953 n-d-863052-2 devstack@n-api.service[105555]: X-Project-Name: admin Nov 01 18:46:25.444953 n-d-863052-2 devstack@n-api.service[105555]: X-Role: admin,member,reader Nov 01 18:46:25.444953 n-d-863052-2 devstack@n-api.service[105555]: X-Roles: admin,member,reader Nov 01 18:46:25.446590 n-d-863052-2 devstack@n-api.service[105555]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/5fcfcdc5c75c4fcb816b0820e369209b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/5fcfcdc5c75c4fcb816b0820e369209b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_5fcfcdc5c75c4fcb816b0820e369209b", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/5fcfcdc5c75c4fcb816b0820e369209b"}]}] Nov 01 18:46:25.446590 n-d-863052-2 devstack@n-api.service[105555]: X-Tenant: admin Nov 01 18:46:25.446590 n-d-863052-2 devstack@n-api.service[105555]: X-Tenant-Id: 5fcfcdc5c75c4fcb816b0820e369209b Nov 01 18:46:25.446590 n-d-863052-2 devstack@n-api.service[105555]: X-Tenant-Name: admin Nov 01 18:46:25.446590 n-d-863052-2 devstack@n-api.service[105555]: X-User: admin Nov 01 18:46:25.446590 n-d-863052-2 devstack@n-api.service[105555]: X-User-Domain-Id: default Nov 01 18:46:25.446590 n-d-863052-2 devstack@n-api.service[105555]: X-User-Domain-Name: Default Nov 01 18:46:25.446590 n-d-863052-2 devstack@n-api.service[105555]: X-User-Id: 5387378bd5b54729aa7e5a2286cd9a63 Nov 01 18:46:25.446590 n-d-863052-2 devstack@n-api.service[105555]: X-User-Name: admin Nov 01 18:46:25.446590 n-d-863052-2 devstack@n-api.service[105555]: method: > Nov 01 18:46:25.446590 n-d-863052-2 devstack@n-api.service[105555]: exception: Flavor 42 could not be found. Nov 01 18:46:25.446590 n-d-863052-2 devstack@n-api.service[105555]: action_args: {'id': '42'} Nov 01 18:46:25.446590 n-d-863052-2 devstack@n-api.service[105555]: {{(pid=105555) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 01 18:46:25.446590 n-d-863052-2 devstack@n-api.service[105555]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:46:25.447523 n-d-863052-2 devstack@n-api.service[105555]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Nov 01 18:46:25.447523 n-d-863052-2 devstack@n-api.service[105555]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Nov 01 18:46:25.447523 n-d-863052-2 devstack@n-api.service[105555]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Nov 01 18:46:25.447523 n-d-863052-2 devstack@n-api.service[105555]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Nov 01 18:46:25.447523 n-d-863052-2 devstack@n-api.service[105555]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 01 18:46:25.447523 n-d-863052-2 devstack@n-api.service[105555]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 01 18:46:25.447523 n-d-863052-2 devstack@n-api.service[105555]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Nov 01 18:46:25.447523 n-d-863052-2 devstack@n-api.service[105555]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Nov 01 18:46:25.447523 n-d-863052-2 devstack@n-api.service[105555]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Nov 01 18:46:25.447523 n-d-863052-2 devstack@n-api.service[105555]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 01 18:46:25.447523 n-d-863052-2 devstack@n-api.service[105555]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Nov 01 18:46:25.447523 n-d-863052-2 devstack@n-api.service[105555]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Nov 01 18:46:25.447523 n-d-863052-2 devstack@n-api.service[105555]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Nov 01 18:46:25.447523 n-d-863052-2 devstack@n-api.service[105555]: ERROR nova.api.openstack.wsgi Nov 01 18:46:25.447523 n-d-863052-2 devstack@n-api.service[105555]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 18:46:25.447523 n-d-863052-2 devstack@n-api.service[105555]: ERROR nova.api.openstack.wsgi Nov 01 18:46:25.447523 n-d-863052-2 devstack@n-api.service[105555]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:46:25.447523 n-d-863052-2 devstack@n-api.service[105555]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 18:46:25.447523 n-d-863052-2 devstack@n-api.service[105555]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 18:46:25.448773 n-d-863052-2 devstack@n-api.service[105555]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 01 18:46:25.448773 n-d-863052-2 devstack@n-api.service[105555]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 01 18:46:25.448773 n-d-863052-2 devstack@n-api.service[105555]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 01 18:46:25.448773 n-d-863052-2 devstack@n-api.service[105555]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 01 18:46:25.448773 n-d-863052-2 devstack@n-api.service[105555]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Nov 01 18:46:25.448773 n-d-863052-2 devstack@n-api.service[105555]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Nov 01 18:46:25.448773 n-d-863052-2 devstack@n-api.service[105555]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Nov 01 18:46:25.448773 n-d-863052-2 devstack@n-api.service[105555]: ERROR nova.api.openstack.wsgi Nov 01 18:46:25.448773 n-d-863052-2 devstack@n-api.service[105555]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 18:46:25.448773 n-d-863052-2 devstack@n-api.service[105555]: ERROR nova.api.openstack.wsgi Nov 01 18:46:25.448773 n-d-863052-2 devstack@n-api.service[105555]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:46:25.448773 n-d-863052-2 devstack@n-api.service[105555]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 18:46:25.448773 n-d-863052-2 devstack@n-api.service[105555]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 18:46:25.448773 n-d-863052-2 devstack@n-api.service[105555]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 01 18:46:25.448773 n-d-863052-2 devstack@n-api.service[105555]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 01 18:46:25.448773 n-d-863052-2 devstack@n-api.service[105555]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Nov 01 18:46:25.448773 n-d-863052-2 devstack@n-api.service[105555]: ERROR nova.api.openstack.wsgi Nov 01 18:46:25.448773 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi [None req-eacad263-57ed-4e7b-bbfc-fb777f0c3145 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=105555) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 01 18:46:25.449817 n-d-863052-2 devstack@n-api.service[105555]: INFO nova.api.openstack.requestlog [None req-eacad263-57ed-4e7b-bbfc-fb777f0c3145 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.391688 Nov 01 18:46:25.449817 n-d-863052-2 devstack@n-api.service[105555]: [pid: 105555|app: 0|req: 19/39] 10.222.0.13 () {60 vars in 1190 bytes} [Tue Nov 1 18:46:25 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 393 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Nov 01 18:46:25.456449 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi [None req-ffed8601-e59b-4ce8-8f0e-38a030488902 admin admin] Calling method '>' {{(pid=105554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:46:25.480536 n-d-863052-2 devstack@n-api.service[105554]: INFO nova.api.openstack.requestlog [None req-ffed8601-e59b-4ce8-8f0e-38a030488902 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.028188 Nov 01 18:46:25.481094 n-d-863052-2 devstack@n-api.service[105554]: [pid: 105554|app: 0|req: 21/40] 10.222.0.13 () {60 vars in 1210 bytes} [Tue Nov 1 18:46:25 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 18:46:25.497865 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi [None req-bc29d63f-b5ae-4294-aca4-87138fec0186 admin admin] Calling method '>' {{(pid=105555) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:46:25.519859 n-d-863052-2 devstack@n-api.service[105555]: INFO nova.api.openstack.requestlog [None req-bc29d63f-b5ae-4294-aca4-87138fec0186 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.026450 Nov 01 18:46:25.520393 n-d-863052-2 devstack@n-api.service[105555]: [pid: 105555|app: 0|req: 20/41] 10.222.0.13 () {60 vars in 1210 bytes} [Tue Nov 1 18:46:25 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 18:46:25.529622 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi [None req-0c2a0c02-9fd9-4e7b-95ca-1e368de28ceb admin admin] Calling method '>' {{(pid=105554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:46:25.535612 n-d-863052-2 devstack@n-api.service[105554]: INFO nova.api.openstack.wsgi [None req-0c2a0c02-9fd9-4e7b-95ca-1e368de28ceb admin admin] HTTP exception thrown: Flavor 42 could not be found. Nov 01 18:46:25.538855 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi [None req-0c2a0c02-9fd9-4e7b-95ca-1e368de28ceb admin admin] Request method failure captured: Nov 01 18:46:25.538855 n-d-863052-2 devstack@n-api.service[105554]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Nov 01 18:46:25.538855 n-d-863052-2 devstack@n-api.service[105554]: Accept: application/json Nov 01 18:46:25.538855 n-d-863052-2 devstack@n-api.service[105554]: Accept-Encoding: gzip, deflate Nov 01 18:46:25.538855 n-d-863052-2 devstack@n-api.service[105554]: Connection: keep-alive Nov 01 18:46:25.538855 n-d-863052-2 devstack@n-api.service[105554]: Content-Length: 0 Nov 01 18:46:25.538855 n-d-863052-2 devstack@n-api.service[105554]: Host: 10.222.0.13 Nov 01 18:46:25.538855 n-d-863052-2 devstack@n-api.service[105554]: Openstack-Api-Version: compute 2.92 Nov 01 18:46:25.538855 n-d-863052-2 devstack@n-api.service[105554]: Openstack-System-Scope: None Nov 01 18:46:25.538855 n-d-863052-2 devstack@n-api.service[105554]: User-Agent: python-novaclient Nov 01 18:46:25.538855 n-d-863052-2 devstack@n-api.service[105554]: X-Auth-Token: gAAAAABjYWmAu_KFEWT0WmsGqB57tHty2Cv1SbPqtEx342s2wdvTiUa7SziVpDesQMAtaocuQFQiRLpBZsPS9cSO-b5m60k40gyj3uuRAVjJTj3sHARrx5QiRKcO-XkSfnjQ9YC4arfpGIqy_rMQ9MI1PQWVJNFt077o99_vuLglqz55-iUlx3E Nov 01 18:46:25.538855 n-d-863052-2 devstack@n-api.service[105554]: X-Domain-Id: None Nov 01 18:46:25.538855 n-d-863052-2 devstack@n-api.service[105554]: X-Domain-Name: None Nov 01 18:46:25.538855 n-d-863052-2 devstack@n-api.service[105554]: X-Identity-Status: Confirmed Nov 01 18:46:25.538855 n-d-863052-2 devstack@n-api.service[105554]: X-Is-Admin-Project: True Nov 01 18:46:25.538855 n-d-863052-2 devstack@n-api.service[105554]: X-Openstack-Nova-Api-Version: 2.92 Nov 01 18:46:25.538855 n-d-863052-2 devstack@n-api.service[105554]: X-Project-Domain-Id: default Nov 01 18:46:25.538855 n-d-863052-2 devstack@n-api.service[105554]: X-Project-Domain-Name: Default Nov 01 18:46:25.538855 n-d-863052-2 devstack@n-api.service[105554]: X-Project-Id: 5fcfcdc5c75c4fcb816b0820e369209b Nov 01 18:46:25.538855 n-d-863052-2 devstack@n-api.service[105554]: X-Project-Name: admin Nov 01 18:46:25.538855 n-d-863052-2 devstack@n-api.service[105554]: X-Role: admin,member,reader Nov 01 18:46:25.538855 n-d-863052-2 devstack@n-api.service[105554]: X-Roles: admin,member,reader Nov 01 18:46:25.540375 n-d-863052-2 devstack@n-api.service[105554]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/5fcfcdc5c75c4fcb816b0820e369209b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/5fcfcdc5c75c4fcb816b0820e369209b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_5fcfcdc5c75c4fcb816b0820e369209b", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/5fcfcdc5c75c4fcb816b0820e369209b"}]}] Nov 01 18:46:25.540375 n-d-863052-2 devstack@n-api.service[105554]: X-Tenant: admin Nov 01 18:46:25.540375 n-d-863052-2 devstack@n-api.service[105554]: X-Tenant-Id: 5fcfcdc5c75c4fcb816b0820e369209b Nov 01 18:46:25.540375 n-d-863052-2 devstack@n-api.service[105554]: X-Tenant-Name: admin Nov 01 18:46:25.540375 n-d-863052-2 devstack@n-api.service[105554]: X-User: admin Nov 01 18:46:25.540375 n-d-863052-2 devstack@n-api.service[105554]: X-User-Domain-Id: default Nov 01 18:46:25.540375 n-d-863052-2 devstack@n-api.service[105554]: X-User-Domain-Name: Default Nov 01 18:46:25.540375 n-d-863052-2 devstack@n-api.service[105554]: X-User-Id: 5387378bd5b54729aa7e5a2286cd9a63 Nov 01 18:46:25.540375 n-d-863052-2 devstack@n-api.service[105554]: X-User-Name: admin Nov 01 18:46:25.540375 n-d-863052-2 devstack@n-api.service[105554]: method: > Nov 01 18:46:25.540375 n-d-863052-2 devstack@n-api.service[105554]: exception: Flavor 42 could not be found. Nov 01 18:46:25.540375 n-d-863052-2 devstack@n-api.service[105554]: action_args: {'id': '42'} Nov 01 18:46:25.540375 n-d-863052-2 devstack@n-api.service[105554]: {{(pid=105554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 01 18:46:25.540375 n-d-863052-2 devstack@n-api.service[105554]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:46:25.541358 n-d-863052-2 devstack@n-api.service[105554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Nov 01 18:46:25.541358 n-d-863052-2 devstack@n-api.service[105554]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Nov 01 18:46:25.541358 n-d-863052-2 devstack@n-api.service[105554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Nov 01 18:46:25.541358 n-d-863052-2 devstack@n-api.service[105554]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Nov 01 18:46:25.541358 n-d-863052-2 devstack@n-api.service[105554]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 01 18:46:25.541358 n-d-863052-2 devstack@n-api.service[105554]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 01 18:46:25.541358 n-d-863052-2 devstack@n-api.service[105554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Nov 01 18:46:25.541358 n-d-863052-2 devstack@n-api.service[105554]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Nov 01 18:46:25.541358 n-d-863052-2 devstack@n-api.service[105554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Nov 01 18:46:25.541358 n-d-863052-2 devstack@n-api.service[105554]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 01 18:46:25.541358 n-d-863052-2 devstack@n-api.service[105554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Nov 01 18:46:25.541358 n-d-863052-2 devstack@n-api.service[105554]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Nov 01 18:46:25.541358 n-d-863052-2 devstack@n-api.service[105554]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Nov 01 18:46:25.541358 n-d-863052-2 devstack@n-api.service[105554]: ERROR nova.api.openstack.wsgi Nov 01 18:46:25.541358 n-d-863052-2 devstack@n-api.service[105554]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 18:46:25.541358 n-d-863052-2 devstack@n-api.service[105554]: ERROR nova.api.openstack.wsgi Nov 01 18:46:25.541358 n-d-863052-2 devstack@n-api.service[105554]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:46:25.541358 n-d-863052-2 devstack@n-api.service[105554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 18:46:25.541358 n-d-863052-2 devstack@n-api.service[105554]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 18:46:25.542731 n-d-863052-2 devstack@n-api.service[105554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 01 18:46:25.542731 n-d-863052-2 devstack@n-api.service[105554]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 01 18:46:25.542731 n-d-863052-2 devstack@n-api.service[105554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 01 18:46:25.542731 n-d-863052-2 devstack@n-api.service[105554]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 01 18:46:25.542731 n-d-863052-2 devstack@n-api.service[105554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Nov 01 18:46:25.542731 n-d-863052-2 devstack@n-api.service[105554]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Nov 01 18:46:25.542731 n-d-863052-2 devstack@n-api.service[105554]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Nov 01 18:46:25.542731 n-d-863052-2 devstack@n-api.service[105554]: ERROR nova.api.openstack.wsgi Nov 01 18:46:25.542731 n-d-863052-2 devstack@n-api.service[105554]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 18:46:25.542731 n-d-863052-2 devstack@n-api.service[105554]: ERROR nova.api.openstack.wsgi Nov 01 18:46:25.542731 n-d-863052-2 devstack@n-api.service[105554]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:46:25.542731 n-d-863052-2 devstack@n-api.service[105554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 18:46:25.542731 n-d-863052-2 devstack@n-api.service[105554]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 18:46:25.542731 n-d-863052-2 devstack@n-api.service[105554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 01 18:46:25.542731 n-d-863052-2 devstack@n-api.service[105554]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 01 18:46:25.542731 n-d-863052-2 devstack@n-api.service[105554]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Nov 01 18:46:25.542731 n-d-863052-2 devstack@n-api.service[105554]: ERROR nova.api.openstack.wsgi Nov 01 18:46:25.542731 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi [None req-0c2a0c02-9fd9-4e7b-95ca-1e368de28ceb admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=105554) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 01 18:46:25.543981 n-d-863052-2 devstack@n-api.service[105554]: INFO nova.api.openstack.requestlog [None req-0c2a0c02-9fd9-4e7b-95ca-1e368de28ceb admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.014126 Nov 01 18:46:25.543981 n-d-863052-2 devstack@n-api.service[105554]: [pid: 105554|app: 0|req: 22/42] 10.222.0.13 () {60 vars in 1190 bytes} [Tue Nov 1 18:46:25 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Nov 01 18:46:26.741703 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi [None req-bc29d63f-b5ae-4294-aca4-87138fec0186 admin admin] Calling method '>' {{(pid=105555) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:46:26.743117 n-d-863052-2 devstack@n-api.service[105555]: INFO nova.api.openstack.requestlog [None req-bc29d63f-b5ae-4294-aca4-87138fec0186 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001702 Nov 01 18:46:26.743799 n-d-863052-2 devstack@n-api.service[105555]: [pid: 105555|app: 0|req: 21/43] 10.222.0.13 () {56 vars in 1074 bytes} [Tue Nov 1 18:46:26 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 18:46:27.271121 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi [None req-9feeca45-b340-43a5-a2d8-9849b5ce1550 admin admin] Calling method '>' {{(pid=105554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:46:27.276132 n-d-863052-2 devstack@n-api.service[105554]: INFO nova.api.openstack.wsgi [None req-9feeca45-b340-43a5-a2d8-9849b5ce1550 admin admin] HTTP exception thrown: Flavor 84 could not be found. Nov 01 18:46:27.277641 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi [None req-9feeca45-b340-43a5-a2d8-9849b5ce1550 admin admin] Request method failure captured: Nov 01 18:46:27.277641 n-d-863052-2 devstack@n-api.service[105554]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Nov 01 18:46:27.277641 n-d-863052-2 devstack@n-api.service[105554]: Accept: application/json Nov 01 18:46:27.277641 n-d-863052-2 devstack@n-api.service[105554]: Accept-Encoding: gzip, deflate Nov 01 18:46:27.277641 n-d-863052-2 devstack@n-api.service[105554]: Connection: keep-alive Nov 01 18:46:27.277641 n-d-863052-2 devstack@n-api.service[105554]: Content-Length: 0 Nov 01 18:46:27.277641 n-d-863052-2 devstack@n-api.service[105554]: Host: 10.222.0.13 Nov 01 18:46:27.277641 n-d-863052-2 devstack@n-api.service[105554]: Openstack-Api-Version: compute 2.92 Nov 01 18:46:27.277641 n-d-863052-2 devstack@n-api.service[105554]: Openstack-System-Scope: None Nov 01 18:46:27.277641 n-d-863052-2 devstack@n-api.service[105554]: User-Agent: python-novaclient Nov 01 18:46:27.277641 n-d-863052-2 devstack@n-api.service[105554]: X-Auth-Token: gAAAAABjYWmC-beguRXRiLm4BN3gURC20iXI7tKt8hHEGfNTMCM8BgBUGSZLjGSM_keg67KQNMXJKXpPVxK2u8e4oK_U34y6RmItduxG2vD9Lb8Ozbu8gSBbzeJ6MRQP2BhnTsJfNu9YFnlYf9eYNRD9am-i-2sk5ckEdmTJiwx2KOUVOfY9ZOs Nov 01 18:46:27.277641 n-d-863052-2 devstack@n-api.service[105554]: X-Domain-Id: None Nov 01 18:46:27.277641 n-d-863052-2 devstack@n-api.service[105554]: X-Domain-Name: None Nov 01 18:46:27.277641 n-d-863052-2 devstack@n-api.service[105554]: X-Identity-Status: Confirmed Nov 01 18:46:27.277641 n-d-863052-2 devstack@n-api.service[105554]: X-Is-Admin-Project: True Nov 01 18:46:27.277641 n-d-863052-2 devstack@n-api.service[105554]: X-Openstack-Nova-Api-Version: 2.92 Nov 01 18:46:27.277641 n-d-863052-2 devstack@n-api.service[105554]: X-Project-Domain-Id: default Nov 01 18:46:27.277641 n-d-863052-2 devstack@n-api.service[105554]: X-Project-Domain-Name: Default Nov 01 18:46:27.277641 n-d-863052-2 devstack@n-api.service[105554]: X-Project-Id: 5fcfcdc5c75c4fcb816b0820e369209b Nov 01 18:46:27.277641 n-d-863052-2 devstack@n-api.service[105554]: X-Project-Name: admin Nov 01 18:46:27.277641 n-d-863052-2 devstack@n-api.service[105554]: X-Role: admin,member,reader Nov 01 18:46:27.277641 n-d-863052-2 devstack@n-api.service[105554]: X-Roles: admin,member,reader Nov 01 18:46:27.278998 n-d-863052-2 devstack@n-api.service[105554]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/5fcfcdc5c75c4fcb816b0820e369209b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/5fcfcdc5c75c4fcb816b0820e369209b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_5fcfcdc5c75c4fcb816b0820e369209b", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/5fcfcdc5c75c4fcb816b0820e369209b"}]}] Nov 01 18:46:27.278998 n-d-863052-2 devstack@n-api.service[105554]: X-Tenant: admin Nov 01 18:46:27.278998 n-d-863052-2 devstack@n-api.service[105554]: X-Tenant-Id: 5fcfcdc5c75c4fcb816b0820e369209b Nov 01 18:46:27.278998 n-d-863052-2 devstack@n-api.service[105554]: X-Tenant-Name: admin Nov 01 18:46:27.278998 n-d-863052-2 devstack@n-api.service[105554]: X-User: admin Nov 01 18:46:27.278998 n-d-863052-2 devstack@n-api.service[105554]: X-User-Domain-Id: default Nov 01 18:46:27.278998 n-d-863052-2 devstack@n-api.service[105554]: X-User-Domain-Name: Default Nov 01 18:46:27.278998 n-d-863052-2 devstack@n-api.service[105554]: X-User-Id: 5387378bd5b54729aa7e5a2286cd9a63 Nov 01 18:46:27.278998 n-d-863052-2 devstack@n-api.service[105554]: X-User-Name: admin Nov 01 18:46:27.278998 n-d-863052-2 devstack@n-api.service[105554]: method: > Nov 01 18:46:27.278998 n-d-863052-2 devstack@n-api.service[105554]: exception: Flavor 84 could not be found. Nov 01 18:46:27.278998 n-d-863052-2 devstack@n-api.service[105554]: action_args: {'id': '84'} Nov 01 18:46:27.278998 n-d-863052-2 devstack@n-api.service[105554]: {{(pid=105554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 01 18:46:27.278998 n-d-863052-2 devstack@n-api.service[105554]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:46:27.279875 n-d-863052-2 devstack@n-api.service[105554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Nov 01 18:46:27.279875 n-d-863052-2 devstack@n-api.service[105554]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Nov 01 18:46:27.279875 n-d-863052-2 devstack@n-api.service[105554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Nov 01 18:46:27.279875 n-d-863052-2 devstack@n-api.service[105554]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Nov 01 18:46:27.279875 n-d-863052-2 devstack@n-api.service[105554]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 01 18:46:27.279875 n-d-863052-2 devstack@n-api.service[105554]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 01 18:46:27.279875 n-d-863052-2 devstack@n-api.service[105554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Nov 01 18:46:27.279875 n-d-863052-2 devstack@n-api.service[105554]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Nov 01 18:46:27.279875 n-d-863052-2 devstack@n-api.service[105554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Nov 01 18:46:27.279875 n-d-863052-2 devstack@n-api.service[105554]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 01 18:46:27.279875 n-d-863052-2 devstack@n-api.service[105554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Nov 01 18:46:27.279875 n-d-863052-2 devstack@n-api.service[105554]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Nov 01 18:46:27.279875 n-d-863052-2 devstack@n-api.service[105554]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Nov 01 18:46:27.279875 n-d-863052-2 devstack@n-api.service[105554]: ERROR nova.api.openstack.wsgi Nov 01 18:46:27.279875 n-d-863052-2 devstack@n-api.service[105554]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 18:46:27.279875 n-d-863052-2 devstack@n-api.service[105554]: ERROR nova.api.openstack.wsgi Nov 01 18:46:27.279875 n-d-863052-2 devstack@n-api.service[105554]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:46:27.279875 n-d-863052-2 devstack@n-api.service[105554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 18:46:27.279875 n-d-863052-2 devstack@n-api.service[105554]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 18:46:27.281331 n-d-863052-2 devstack@n-api.service[105554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 01 18:46:27.281331 n-d-863052-2 devstack@n-api.service[105554]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 01 18:46:27.281331 n-d-863052-2 devstack@n-api.service[105554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 01 18:46:27.281331 n-d-863052-2 devstack@n-api.service[105554]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 01 18:46:27.281331 n-d-863052-2 devstack@n-api.service[105554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Nov 01 18:46:27.281331 n-d-863052-2 devstack@n-api.service[105554]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Nov 01 18:46:27.281331 n-d-863052-2 devstack@n-api.service[105554]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Nov 01 18:46:27.281331 n-d-863052-2 devstack@n-api.service[105554]: ERROR nova.api.openstack.wsgi Nov 01 18:46:27.281331 n-d-863052-2 devstack@n-api.service[105554]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 18:46:27.281331 n-d-863052-2 devstack@n-api.service[105554]: ERROR nova.api.openstack.wsgi Nov 01 18:46:27.281331 n-d-863052-2 devstack@n-api.service[105554]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:46:27.281331 n-d-863052-2 devstack@n-api.service[105554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 18:46:27.281331 n-d-863052-2 devstack@n-api.service[105554]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 18:46:27.281331 n-d-863052-2 devstack@n-api.service[105554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 01 18:46:27.281331 n-d-863052-2 devstack@n-api.service[105554]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 01 18:46:27.281331 n-d-863052-2 devstack@n-api.service[105554]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Nov 01 18:46:27.281331 n-d-863052-2 devstack@n-api.service[105554]: ERROR nova.api.openstack.wsgi Nov 01 18:46:27.281331 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi [None req-9feeca45-b340-43a5-a2d8-9849b5ce1550 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=105554) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 01 18:46:27.282575 n-d-863052-2 devstack@n-api.service[105554]: INFO nova.api.openstack.requestlog [None req-9feeca45-b340-43a5-a2d8-9849b5ce1550 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.395755 Nov 01 18:46:27.282575 n-d-863052-2 devstack@n-api.service[105554]: [pid: 105554|app: 0|req: 23/44] 10.222.0.13 () {60 vars in 1190 bytes} [Tue Nov 1 18:46:26 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 397 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Nov 01 18:46:27.288970 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi [None req-0bfdfadd-d3f2-4613-a8b9-9bcbb29e68d3 admin admin] Calling method '>' {{(pid=105555) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:46:27.304002 n-d-863052-2 devstack@n-api.service[105555]: INFO nova.api.openstack.requestlog [None req-0bfdfadd-d3f2-4613-a8b9-9bcbb29e68d3 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018889 Nov 01 18:46:27.304553 n-d-863052-2 devstack@n-api.service[105555]: [pid: 105555|app: 0|req: 22/45] 10.222.0.13 () {60 vars in 1210 bytes} [Tue Nov 1 18:46:27 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 18:46:27.313616 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi [None req-23d7b396-42ed-44a8-a12e-09c1d5d367fd admin admin] Calling method '>' {{(pid=105554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:46:27.329123 n-d-863052-2 devstack@n-api.service[105554]: INFO nova.api.openstack.requestlog [None req-23d7b396-42ed-44a8-a12e-09c1d5d367fd admin admin] 10.222.0.13 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018964 Nov 01 18:46:27.329630 n-d-863052-2 devstack@n-api.service[105554]: [pid: 105554|app: 0|req: 24/46] 10.222.0.13 () {60 vars in 1210 bytes} [Tue Nov 1 18:46:27 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 18:46:27.339041 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi [None req-e2e5d622-0cdb-4db2-987f-dfb02758f6c9 admin admin] Calling method '>' {{(pid=105555) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:46:27.343856 n-d-863052-2 devstack@n-api.service[105555]: INFO nova.api.openstack.wsgi [None req-e2e5d622-0cdb-4db2-987f-dfb02758f6c9 admin admin] HTTP exception thrown: Flavor 84 could not be found. Nov 01 18:46:27.345445 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi [None req-e2e5d622-0cdb-4db2-987f-dfb02758f6c9 admin admin] Request method failure captured: Nov 01 18:46:27.345445 n-d-863052-2 devstack@n-api.service[105555]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Nov 01 18:46:27.345445 n-d-863052-2 devstack@n-api.service[105555]: Accept: application/json Nov 01 18:46:27.345445 n-d-863052-2 devstack@n-api.service[105555]: Accept-Encoding: gzip, deflate Nov 01 18:46:27.345445 n-d-863052-2 devstack@n-api.service[105555]: Connection: keep-alive Nov 01 18:46:27.345445 n-d-863052-2 devstack@n-api.service[105555]: Content-Length: 0 Nov 01 18:46:27.345445 n-d-863052-2 devstack@n-api.service[105555]: Host: 10.222.0.13 Nov 01 18:46:27.345445 n-d-863052-2 devstack@n-api.service[105555]: Openstack-Api-Version: compute 2.92 Nov 01 18:46:27.345445 n-d-863052-2 devstack@n-api.service[105555]: Openstack-System-Scope: None Nov 01 18:46:27.345445 n-d-863052-2 devstack@n-api.service[105555]: User-Agent: python-novaclient Nov 01 18:46:27.345445 n-d-863052-2 devstack@n-api.service[105555]: X-Auth-Token: gAAAAABjYWmC-beguRXRiLm4BN3gURC20iXI7tKt8hHEGfNTMCM8BgBUGSZLjGSM_keg67KQNMXJKXpPVxK2u8e4oK_U34y6RmItduxG2vD9Lb8Ozbu8gSBbzeJ6MRQP2BhnTsJfNu9YFnlYf9eYNRD9am-i-2sk5ckEdmTJiwx2KOUVOfY9ZOs Nov 01 18:46:27.345445 n-d-863052-2 devstack@n-api.service[105555]: X-Domain-Id: None Nov 01 18:46:27.345445 n-d-863052-2 devstack@n-api.service[105555]: X-Domain-Name: None Nov 01 18:46:27.345445 n-d-863052-2 devstack@n-api.service[105555]: X-Identity-Status: Confirmed Nov 01 18:46:27.345445 n-d-863052-2 devstack@n-api.service[105555]: X-Is-Admin-Project: True Nov 01 18:46:27.345445 n-d-863052-2 devstack@n-api.service[105555]: X-Openstack-Nova-Api-Version: 2.92 Nov 01 18:46:27.345445 n-d-863052-2 devstack@n-api.service[105555]: X-Project-Domain-Id: default Nov 01 18:46:27.345445 n-d-863052-2 devstack@n-api.service[105555]: X-Project-Domain-Name: Default Nov 01 18:46:27.345445 n-d-863052-2 devstack@n-api.service[105555]: X-Project-Id: 5fcfcdc5c75c4fcb816b0820e369209b Nov 01 18:46:27.345445 n-d-863052-2 devstack@n-api.service[105555]: X-Project-Name: admin Nov 01 18:46:27.345445 n-d-863052-2 devstack@n-api.service[105555]: X-Role: admin,member,reader Nov 01 18:46:27.345445 n-d-863052-2 devstack@n-api.service[105555]: X-Roles: admin,member,reader Nov 01 18:46:27.347001 n-d-863052-2 devstack@n-api.service[105555]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/5fcfcdc5c75c4fcb816b0820e369209b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/5fcfcdc5c75c4fcb816b0820e369209b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_5fcfcdc5c75c4fcb816b0820e369209b", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/5fcfcdc5c75c4fcb816b0820e369209b"}]}] Nov 01 18:46:27.347001 n-d-863052-2 devstack@n-api.service[105555]: X-Tenant: admin Nov 01 18:46:27.347001 n-d-863052-2 devstack@n-api.service[105555]: X-Tenant-Id: 5fcfcdc5c75c4fcb816b0820e369209b Nov 01 18:46:27.347001 n-d-863052-2 devstack@n-api.service[105555]: X-Tenant-Name: admin Nov 01 18:46:27.347001 n-d-863052-2 devstack@n-api.service[105555]: X-User: admin Nov 01 18:46:27.347001 n-d-863052-2 devstack@n-api.service[105555]: X-User-Domain-Id: default Nov 01 18:46:27.347001 n-d-863052-2 devstack@n-api.service[105555]: X-User-Domain-Name: Default Nov 01 18:46:27.347001 n-d-863052-2 devstack@n-api.service[105555]: X-User-Id: 5387378bd5b54729aa7e5a2286cd9a63 Nov 01 18:46:27.347001 n-d-863052-2 devstack@n-api.service[105555]: X-User-Name: admin Nov 01 18:46:27.347001 n-d-863052-2 devstack@n-api.service[105555]: method: > Nov 01 18:46:27.347001 n-d-863052-2 devstack@n-api.service[105555]: exception: Flavor 84 could not be found. Nov 01 18:46:27.347001 n-d-863052-2 devstack@n-api.service[105555]: action_args: {'id': '84'} Nov 01 18:46:27.347001 n-d-863052-2 devstack@n-api.service[105555]: {{(pid=105555) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 01 18:46:27.347001 n-d-863052-2 devstack@n-api.service[105555]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:46:27.347913 n-d-863052-2 devstack@n-api.service[105555]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Nov 01 18:46:27.347913 n-d-863052-2 devstack@n-api.service[105555]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Nov 01 18:46:27.347913 n-d-863052-2 devstack@n-api.service[105555]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Nov 01 18:46:27.347913 n-d-863052-2 devstack@n-api.service[105555]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Nov 01 18:46:27.347913 n-d-863052-2 devstack@n-api.service[105555]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 01 18:46:27.347913 n-d-863052-2 devstack@n-api.service[105555]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 01 18:46:27.347913 n-d-863052-2 devstack@n-api.service[105555]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Nov 01 18:46:27.347913 n-d-863052-2 devstack@n-api.service[105555]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Nov 01 18:46:27.347913 n-d-863052-2 devstack@n-api.service[105555]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Nov 01 18:46:27.347913 n-d-863052-2 devstack@n-api.service[105555]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 01 18:46:27.347913 n-d-863052-2 devstack@n-api.service[105555]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Nov 01 18:46:27.347913 n-d-863052-2 devstack@n-api.service[105555]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Nov 01 18:46:27.347913 n-d-863052-2 devstack@n-api.service[105555]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Nov 01 18:46:27.347913 n-d-863052-2 devstack@n-api.service[105555]: ERROR nova.api.openstack.wsgi Nov 01 18:46:27.347913 n-d-863052-2 devstack@n-api.service[105555]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 18:46:27.347913 n-d-863052-2 devstack@n-api.service[105555]: ERROR nova.api.openstack.wsgi Nov 01 18:46:27.347913 n-d-863052-2 devstack@n-api.service[105555]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:46:27.347913 n-d-863052-2 devstack@n-api.service[105555]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 18:46:27.347913 n-d-863052-2 devstack@n-api.service[105555]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 18:46:27.349037 n-d-863052-2 devstack@n-api.service[105555]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 01 18:46:27.349037 n-d-863052-2 devstack@n-api.service[105555]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 01 18:46:27.349037 n-d-863052-2 devstack@n-api.service[105555]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 01 18:46:27.349037 n-d-863052-2 devstack@n-api.service[105555]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 01 18:46:27.349037 n-d-863052-2 devstack@n-api.service[105555]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Nov 01 18:46:27.349037 n-d-863052-2 devstack@n-api.service[105555]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Nov 01 18:46:27.349037 n-d-863052-2 devstack@n-api.service[105555]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Nov 01 18:46:27.349037 n-d-863052-2 devstack@n-api.service[105555]: ERROR nova.api.openstack.wsgi Nov 01 18:46:27.349037 n-d-863052-2 devstack@n-api.service[105555]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 18:46:27.349037 n-d-863052-2 devstack@n-api.service[105555]: ERROR nova.api.openstack.wsgi Nov 01 18:46:27.349037 n-d-863052-2 devstack@n-api.service[105555]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:46:27.349037 n-d-863052-2 devstack@n-api.service[105555]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 18:46:27.349037 n-d-863052-2 devstack@n-api.service[105555]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 18:46:27.349037 n-d-863052-2 devstack@n-api.service[105555]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 01 18:46:27.349037 n-d-863052-2 devstack@n-api.service[105555]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 01 18:46:27.349037 n-d-863052-2 devstack@n-api.service[105555]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Nov 01 18:46:27.349037 n-d-863052-2 devstack@n-api.service[105555]: ERROR nova.api.openstack.wsgi Nov 01 18:46:27.349037 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi [None req-e2e5d622-0cdb-4db2-987f-dfb02758f6c9 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=105555) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 01 18:46:27.350036 n-d-863052-2 devstack@n-api.service[105555]: INFO nova.api.openstack.requestlog [None req-e2e5d622-0cdb-4db2-987f-dfb02758f6c9 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.011177 Nov 01 18:46:27.350036 n-d-863052-2 devstack@n-api.service[105555]: [pid: 105555|app: 0|req: 23/47] 10.222.0.13 () {60 vars in 1190 bytes} [Tue Nov 1 18:46:27 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Nov 01 18:46:28.546688 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi [None req-23d7b396-42ed-44a8-a12e-09c1d5d367fd admin admin] Calling method '>' {{(pid=105554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:46:28.547698 n-d-863052-2 devstack@n-api.service[105554]: INFO nova.api.openstack.requestlog [None req-23d7b396-42ed-44a8-a12e-09c1d5d367fd admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001438 Nov 01 18:46:28.548100 n-d-863052-2 devstack@n-api.service[105554]: [pid: 105554|app: 0|req: 25/48] 10.222.0.13 () {56 vars in 1074 bytes} [Tue Nov 1 18:46:28 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 18:46:29.067737 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi [None req-78e24bdf-d92c-4c44-90f6-145fcab1aff7 admin admin] Calling method '>' {{(pid=105555) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:46:29.073504 n-d-863052-2 devstack@n-api.service[105555]: INFO nova.api.openstack.wsgi [None req-78e24bdf-d92c-4c44-90f6-145fcab1aff7 admin admin] HTTP exception thrown: Flavor 451 could not be found. Nov 01 18:46:29.074976 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi [None req-78e24bdf-d92c-4c44-90f6-145fcab1aff7 admin admin] Request method failure captured: Nov 01 18:46:29.074976 n-d-863052-2 devstack@n-api.service[105555]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Nov 01 18:46:29.074976 n-d-863052-2 devstack@n-api.service[105555]: Accept: application/json Nov 01 18:46:29.074976 n-d-863052-2 devstack@n-api.service[105555]: Accept-Encoding: gzip, deflate Nov 01 18:46:29.074976 n-d-863052-2 devstack@n-api.service[105555]: Connection: keep-alive Nov 01 18:46:29.074976 n-d-863052-2 devstack@n-api.service[105555]: Content-Length: 0 Nov 01 18:46:29.074976 n-d-863052-2 devstack@n-api.service[105555]: Host: 10.222.0.13 Nov 01 18:46:29.074976 n-d-863052-2 devstack@n-api.service[105555]: Openstack-Api-Version: compute 2.92 Nov 01 18:46:29.074976 n-d-863052-2 devstack@n-api.service[105555]: Openstack-System-Scope: None Nov 01 18:46:29.074976 n-d-863052-2 devstack@n-api.service[105555]: User-Agent: python-novaclient Nov 01 18:46:29.074976 n-d-863052-2 devstack@n-api.service[105555]: X-Auth-Token: gAAAAABjYWmE-kPQ5YSXiqNYSKNp8roZK9mwyP-Umoqr7H98jvf5BbONZQMpVAgk8iRkFAEFFYZbOGhSxlh7cnOk2cOQCluCMrNapWVGYGNQtvqbC2r9Jr6zCiiCsQvCIwW8Vz1PUyk6iCEQrmMBNoIe4y4Lpexzu2n3IZvOu6C8DLUoDgacYBc Nov 01 18:46:29.074976 n-d-863052-2 devstack@n-api.service[105555]: X-Domain-Id: None Nov 01 18:46:29.074976 n-d-863052-2 devstack@n-api.service[105555]: X-Domain-Name: None Nov 01 18:46:29.074976 n-d-863052-2 devstack@n-api.service[105555]: X-Identity-Status: Confirmed Nov 01 18:46:29.074976 n-d-863052-2 devstack@n-api.service[105555]: X-Is-Admin-Project: True Nov 01 18:46:29.074976 n-d-863052-2 devstack@n-api.service[105555]: X-Openstack-Nova-Api-Version: 2.92 Nov 01 18:46:29.074976 n-d-863052-2 devstack@n-api.service[105555]: X-Project-Domain-Id: default Nov 01 18:46:29.074976 n-d-863052-2 devstack@n-api.service[105555]: X-Project-Domain-Name: Default Nov 01 18:46:29.074976 n-d-863052-2 devstack@n-api.service[105555]: X-Project-Id: 5fcfcdc5c75c4fcb816b0820e369209b Nov 01 18:46:29.074976 n-d-863052-2 devstack@n-api.service[105555]: X-Project-Name: admin Nov 01 18:46:29.074976 n-d-863052-2 devstack@n-api.service[105555]: X-Role: admin,member,reader Nov 01 18:46:29.074976 n-d-863052-2 devstack@n-api.service[105555]: X-Roles: admin,member,reader Nov 01 18:46:29.076488 n-d-863052-2 devstack@n-api.service[105555]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/5fcfcdc5c75c4fcb816b0820e369209b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/5fcfcdc5c75c4fcb816b0820e369209b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_5fcfcdc5c75c4fcb816b0820e369209b", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/5fcfcdc5c75c4fcb816b0820e369209b"}]}] Nov 01 18:46:29.076488 n-d-863052-2 devstack@n-api.service[105555]: X-Tenant: admin Nov 01 18:46:29.076488 n-d-863052-2 devstack@n-api.service[105555]: X-Tenant-Id: 5fcfcdc5c75c4fcb816b0820e369209b Nov 01 18:46:29.076488 n-d-863052-2 devstack@n-api.service[105555]: X-Tenant-Name: admin Nov 01 18:46:29.076488 n-d-863052-2 devstack@n-api.service[105555]: X-User: admin Nov 01 18:46:29.076488 n-d-863052-2 devstack@n-api.service[105555]: X-User-Domain-Id: default Nov 01 18:46:29.076488 n-d-863052-2 devstack@n-api.service[105555]: X-User-Domain-Name: Default Nov 01 18:46:29.076488 n-d-863052-2 devstack@n-api.service[105555]: X-User-Id: 5387378bd5b54729aa7e5a2286cd9a63 Nov 01 18:46:29.076488 n-d-863052-2 devstack@n-api.service[105555]: X-User-Name: admin Nov 01 18:46:29.076488 n-d-863052-2 devstack@n-api.service[105555]: method: > Nov 01 18:46:29.076488 n-d-863052-2 devstack@n-api.service[105555]: exception: Flavor 451 could not be found. Nov 01 18:46:29.076488 n-d-863052-2 devstack@n-api.service[105555]: action_args: {'id': '451'} Nov 01 18:46:29.076488 n-d-863052-2 devstack@n-api.service[105555]: {{(pid=105555) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 01 18:46:29.076488 n-d-863052-2 devstack@n-api.service[105555]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:46:29.077577 n-d-863052-2 devstack@n-api.service[105555]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Nov 01 18:46:29.077577 n-d-863052-2 devstack@n-api.service[105555]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Nov 01 18:46:29.077577 n-d-863052-2 devstack@n-api.service[105555]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Nov 01 18:46:29.077577 n-d-863052-2 devstack@n-api.service[105555]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Nov 01 18:46:29.077577 n-d-863052-2 devstack@n-api.service[105555]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 01 18:46:29.077577 n-d-863052-2 devstack@n-api.service[105555]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 01 18:46:29.077577 n-d-863052-2 devstack@n-api.service[105555]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Nov 01 18:46:29.077577 n-d-863052-2 devstack@n-api.service[105555]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Nov 01 18:46:29.077577 n-d-863052-2 devstack@n-api.service[105555]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Nov 01 18:46:29.077577 n-d-863052-2 devstack@n-api.service[105555]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 01 18:46:29.077577 n-d-863052-2 devstack@n-api.service[105555]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Nov 01 18:46:29.077577 n-d-863052-2 devstack@n-api.service[105555]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Nov 01 18:46:29.077577 n-d-863052-2 devstack@n-api.service[105555]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Nov 01 18:46:29.077577 n-d-863052-2 devstack@n-api.service[105555]: ERROR nova.api.openstack.wsgi Nov 01 18:46:29.077577 n-d-863052-2 devstack@n-api.service[105555]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 18:46:29.077577 n-d-863052-2 devstack@n-api.service[105555]: ERROR nova.api.openstack.wsgi Nov 01 18:46:29.077577 n-d-863052-2 devstack@n-api.service[105555]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:46:29.077577 n-d-863052-2 devstack@n-api.service[105555]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 18:46:29.077577 n-d-863052-2 devstack@n-api.service[105555]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 18:46:29.078931 n-d-863052-2 devstack@n-api.service[105555]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 01 18:46:29.078931 n-d-863052-2 devstack@n-api.service[105555]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 01 18:46:29.078931 n-d-863052-2 devstack@n-api.service[105555]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 01 18:46:29.078931 n-d-863052-2 devstack@n-api.service[105555]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 01 18:46:29.078931 n-d-863052-2 devstack@n-api.service[105555]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Nov 01 18:46:29.078931 n-d-863052-2 devstack@n-api.service[105555]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Nov 01 18:46:29.078931 n-d-863052-2 devstack@n-api.service[105555]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Nov 01 18:46:29.078931 n-d-863052-2 devstack@n-api.service[105555]: ERROR nova.api.openstack.wsgi Nov 01 18:46:29.078931 n-d-863052-2 devstack@n-api.service[105555]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 18:46:29.078931 n-d-863052-2 devstack@n-api.service[105555]: ERROR nova.api.openstack.wsgi Nov 01 18:46:29.078931 n-d-863052-2 devstack@n-api.service[105555]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:46:29.078931 n-d-863052-2 devstack@n-api.service[105555]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 18:46:29.078931 n-d-863052-2 devstack@n-api.service[105555]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 18:46:29.078931 n-d-863052-2 devstack@n-api.service[105555]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 01 18:46:29.078931 n-d-863052-2 devstack@n-api.service[105555]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 01 18:46:29.078931 n-d-863052-2 devstack@n-api.service[105555]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Nov 01 18:46:29.078931 n-d-863052-2 devstack@n-api.service[105555]: ERROR nova.api.openstack.wsgi Nov 01 18:46:29.078931 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi [None req-78e24bdf-d92c-4c44-90f6-145fcab1aff7 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=105555) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 01 18:46:29.080124 n-d-863052-2 devstack@n-api.service[105555]: INFO nova.api.openstack.requestlog [None req-78e24bdf-d92c-4c44-90f6-145fcab1aff7 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.390457 Nov 01 18:46:29.080124 n-d-863052-2 devstack@n-api.service[105555]: [pid: 105555|app: 0|req: 24/49] 10.222.0.13 () {60 vars in 1193 bytes} [Tue Nov 1 18:46:28 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 391 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Nov 01 18:46:29.085903 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi [None req-f2c4ce20-d2f4-4858-b577-d779417d34d9 admin admin] Calling method '>' {{(pid=105554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:46:29.100545 n-d-863052-2 devstack@n-api.service[105554]: INFO nova.api.openstack.requestlog [None req-f2c4ce20-d2f4-4858-b577-d779417d34d9 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018242 Nov 01 18:46:29.101112 n-d-863052-2 devstack@n-api.service[105554]: [pid: 105554|app: 0|req: 26/50] 10.222.0.13 () {60 vars in 1210 bytes} [Tue Nov 1 18:46:29 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 18:46:29.110374 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi [None req-678b61e8-7d0b-44cd-8bdc-2fcf283a50f6 admin admin] Calling method '>' {{(pid=105555) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:46:29.125341 n-d-863052-2 devstack@n-api.service[105555]: INFO nova.api.openstack.requestlog [None req-678b61e8-7d0b-44cd-8bdc-2fcf283a50f6 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018465 Nov 01 18:46:29.125891 n-d-863052-2 devstack@n-api.service[105555]: [pid: 105555|app: 0|req: 25/51] 10.222.0.13 () {60 vars in 1210 bytes} [Tue Nov 1 18:46:29 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 18:46:29.135217 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi [None req-c792ae75-0d8d-4886-b387-b3a81827514b admin admin] Calling method '>' {{(pid=105554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:46:29.140036 n-d-863052-2 devstack@n-api.service[105554]: INFO nova.api.openstack.wsgi [None req-c792ae75-0d8d-4886-b387-b3a81827514b admin admin] HTTP exception thrown: Flavor 451 could not be found. Nov 01 18:46:29.141538 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi [None req-c792ae75-0d8d-4886-b387-b3a81827514b admin admin] Request method failure captured: Nov 01 18:46:29.141538 n-d-863052-2 devstack@n-api.service[105554]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Nov 01 18:46:29.141538 n-d-863052-2 devstack@n-api.service[105554]: Accept: application/json Nov 01 18:46:29.141538 n-d-863052-2 devstack@n-api.service[105554]: Accept-Encoding: gzip, deflate Nov 01 18:46:29.141538 n-d-863052-2 devstack@n-api.service[105554]: Connection: keep-alive Nov 01 18:46:29.141538 n-d-863052-2 devstack@n-api.service[105554]: Content-Length: 0 Nov 01 18:46:29.141538 n-d-863052-2 devstack@n-api.service[105554]: Host: 10.222.0.13 Nov 01 18:46:29.141538 n-d-863052-2 devstack@n-api.service[105554]: Openstack-Api-Version: compute 2.92 Nov 01 18:46:29.141538 n-d-863052-2 devstack@n-api.service[105554]: Openstack-System-Scope: None Nov 01 18:46:29.141538 n-d-863052-2 devstack@n-api.service[105554]: User-Agent: python-novaclient Nov 01 18:46:29.141538 n-d-863052-2 devstack@n-api.service[105554]: X-Auth-Token: gAAAAABjYWmE-kPQ5YSXiqNYSKNp8roZK9mwyP-Umoqr7H98jvf5BbONZQMpVAgk8iRkFAEFFYZbOGhSxlh7cnOk2cOQCluCMrNapWVGYGNQtvqbC2r9Jr6zCiiCsQvCIwW8Vz1PUyk6iCEQrmMBNoIe4y4Lpexzu2n3IZvOu6C8DLUoDgacYBc Nov 01 18:46:29.141538 n-d-863052-2 devstack@n-api.service[105554]: X-Domain-Id: None Nov 01 18:46:29.141538 n-d-863052-2 devstack@n-api.service[105554]: X-Domain-Name: None Nov 01 18:46:29.141538 n-d-863052-2 devstack@n-api.service[105554]: X-Identity-Status: Confirmed Nov 01 18:46:29.141538 n-d-863052-2 devstack@n-api.service[105554]: X-Is-Admin-Project: True Nov 01 18:46:29.141538 n-d-863052-2 devstack@n-api.service[105554]: X-Openstack-Nova-Api-Version: 2.92 Nov 01 18:46:29.141538 n-d-863052-2 devstack@n-api.service[105554]: X-Project-Domain-Id: default Nov 01 18:46:29.141538 n-d-863052-2 devstack@n-api.service[105554]: X-Project-Domain-Name: Default Nov 01 18:46:29.141538 n-d-863052-2 devstack@n-api.service[105554]: X-Project-Id: 5fcfcdc5c75c4fcb816b0820e369209b Nov 01 18:46:29.141538 n-d-863052-2 devstack@n-api.service[105554]: X-Project-Name: admin Nov 01 18:46:29.141538 n-d-863052-2 devstack@n-api.service[105554]: X-Role: admin,member,reader Nov 01 18:46:29.141538 n-d-863052-2 devstack@n-api.service[105554]: X-Roles: admin,member,reader Nov 01 18:46:29.143147 n-d-863052-2 devstack@n-api.service[105554]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/5fcfcdc5c75c4fcb816b0820e369209b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/5fcfcdc5c75c4fcb816b0820e369209b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_5fcfcdc5c75c4fcb816b0820e369209b", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/5fcfcdc5c75c4fcb816b0820e369209b"}]}] Nov 01 18:46:29.143147 n-d-863052-2 devstack@n-api.service[105554]: X-Tenant: admin Nov 01 18:46:29.143147 n-d-863052-2 devstack@n-api.service[105554]: X-Tenant-Id: 5fcfcdc5c75c4fcb816b0820e369209b Nov 01 18:46:29.143147 n-d-863052-2 devstack@n-api.service[105554]: X-Tenant-Name: admin Nov 01 18:46:29.143147 n-d-863052-2 devstack@n-api.service[105554]: X-User: admin Nov 01 18:46:29.143147 n-d-863052-2 devstack@n-api.service[105554]: X-User-Domain-Id: default Nov 01 18:46:29.143147 n-d-863052-2 devstack@n-api.service[105554]: X-User-Domain-Name: Default Nov 01 18:46:29.143147 n-d-863052-2 devstack@n-api.service[105554]: X-User-Id: 5387378bd5b54729aa7e5a2286cd9a63 Nov 01 18:46:29.143147 n-d-863052-2 devstack@n-api.service[105554]: X-User-Name: admin Nov 01 18:46:29.143147 n-d-863052-2 devstack@n-api.service[105554]: method: > Nov 01 18:46:29.143147 n-d-863052-2 devstack@n-api.service[105554]: exception: Flavor 451 could not be found. Nov 01 18:46:29.143147 n-d-863052-2 devstack@n-api.service[105554]: action_args: {'id': '451'} Nov 01 18:46:29.143147 n-d-863052-2 devstack@n-api.service[105554]: {{(pid=105554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 01 18:46:29.143147 n-d-863052-2 devstack@n-api.service[105554]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:46:29.144353 n-d-863052-2 devstack@n-api.service[105554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Nov 01 18:46:29.144353 n-d-863052-2 devstack@n-api.service[105554]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Nov 01 18:46:29.144353 n-d-863052-2 devstack@n-api.service[105554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Nov 01 18:46:29.144353 n-d-863052-2 devstack@n-api.service[105554]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Nov 01 18:46:29.144353 n-d-863052-2 devstack@n-api.service[105554]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 01 18:46:29.144353 n-d-863052-2 devstack@n-api.service[105554]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 01 18:46:29.144353 n-d-863052-2 devstack@n-api.service[105554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Nov 01 18:46:29.144353 n-d-863052-2 devstack@n-api.service[105554]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Nov 01 18:46:29.144353 n-d-863052-2 devstack@n-api.service[105554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Nov 01 18:46:29.144353 n-d-863052-2 devstack@n-api.service[105554]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 01 18:46:29.144353 n-d-863052-2 devstack@n-api.service[105554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Nov 01 18:46:29.144353 n-d-863052-2 devstack@n-api.service[105554]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Nov 01 18:46:29.144353 n-d-863052-2 devstack@n-api.service[105554]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Nov 01 18:46:29.144353 n-d-863052-2 devstack@n-api.service[105554]: ERROR nova.api.openstack.wsgi Nov 01 18:46:29.144353 n-d-863052-2 devstack@n-api.service[105554]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 18:46:29.144353 n-d-863052-2 devstack@n-api.service[105554]: ERROR nova.api.openstack.wsgi Nov 01 18:46:29.144353 n-d-863052-2 devstack@n-api.service[105554]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:46:29.144353 n-d-863052-2 devstack@n-api.service[105554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 18:46:29.144353 n-d-863052-2 devstack@n-api.service[105554]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 18:46:29.145658 n-d-863052-2 devstack@n-api.service[105554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 01 18:46:29.145658 n-d-863052-2 devstack@n-api.service[105554]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 01 18:46:29.145658 n-d-863052-2 devstack@n-api.service[105554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 01 18:46:29.145658 n-d-863052-2 devstack@n-api.service[105554]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 01 18:46:29.145658 n-d-863052-2 devstack@n-api.service[105554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Nov 01 18:46:29.145658 n-d-863052-2 devstack@n-api.service[105554]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Nov 01 18:46:29.145658 n-d-863052-2 devstack@n-api.service[105554]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Nov 01 18:46:29.145658 n-d-863052-2 devstack@n-api.service[105554]: ERROR nova.api.openstack.wsgi Nov 01 18:46:29.145658 n-d-863052-2 devstack@n-api.service[105554]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 18:46:29.145658 n-d-863052-2 devstack@n-api.service[105554]: ERROR nova.api.openstack.wsgi Nov 01 18:46:29.145658 n-d-863052-2 devstack@n-api.service[105554]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:46:29.145658 n-d-863052-2 devstack@n-api.service[105554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 18:46:29.145658 n-d-863052-2 devstack@n-api.service[105554]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 18:46:29.145658 n-d-863052-2 devstack@n-api.service[105554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 01 18:46:29.145658 n-d-863052-2 devstack@n-api.service[105554]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 01 18:46:29.145658 n-d-863052-2 devstack@n-api.service[105554]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Nov 01 18:46:29.145658 n-d-863052-2 devstack@n-api.service[105554]: ERROR nova.api.openstack.wsgi Nov 01 18:46:29.145658 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi [None req-c792ae75-0d8d-4886-b387-b3a81827514b admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=105554) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 01 18:46:29.146886 n-d-863052-2 devstack@n-api.service[105554]: INFO nova.api.openstack.requestlog [None req-c792ae75-0d8d-4886-b387-b3a81827514b admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.011121 Nov 01 18:46:29.146886 n-d-863052-2 devstack@n-api.service[105554]: [pid: 105554|app: 0|req: 27/52] 10.222.0.13 () {60 vars in 1193 bytes} [Tue Nov 1 18:46:29 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Nov 01 18:46:30.327743 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi [None req-678b61e8-7d0b-44cd-8bdc-2fcf283a50f6 admin admin] Calling method '>' {{(pid=105555) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:46:30.328901 n-d-863052-2 devstack@n-api.service[105555]: INFO nova.api.openstack.requestlog [None req-678b61e8-7d0b-44cd-8bdc-2fcf283a50f6 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001444 Nov 01 18:46:30.329295 n-d-863052-2 devstack@n-api.service[105555]: [pid: 105555|app: 0|req: 26/53] 10.222.0.13 () {56 vars in 1074 bytes} [Tue Nov 1 18:46:30 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 18:46:30.846265 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi [None req-a322dad3-c495-48c6-a2a8-d9f81f4dc191 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 18:46:30.865106 n-d-863052-2 devstack@n-api.service[105554]: INFO nova.api.openstack.requestlog [None req-a322dad3-c495-48c6-a2a8-d9f81f4dc191 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.92 time: 0.401616 Nov 01 18:46:30.865639 n-d-863052-2 devstack@n-api.service[105554]: [pid: 105554|app: 0|req: 28/54] 10.222.0.13 () {64 vars in 1235 bytes} [Tue Nov 1 18:46:30 2022] POST /compute/v2.1/flavors => generated 404 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 01 18:46:32.057831 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi [None req-678b61e8-7d0b-44cd-8bdc-2fcf283a50f6 admin admin] Calling method '>' {{(pid=105555) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:46:32.058831 n-d-863052-2 devstack@n-api.service[105555]: INFO nova.api.openstack.requestlog [None req-678b61e8-7d0b-44cd-8bdc-2fcf283a50f6 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001412 Nov 01 18:46:32.059226 n-d-863052-2 devstack@n-api.service[105555]: [pid: 105555|app: 0|req: 27/55] 10.222.0.13 () {56 vars in 1074 bytes} [Tue Nov 1 18:46:32 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 18:46:32.572872 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi [None req-9a875f4c-cdf6-4f83-ab2e-3a5846bdae2c admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 18:46:32.591392 n-d-863052-2 devstack@n-api.service[105554]: INFO nova.api.openstack.requestlog [None req-9a875f4c-cdf6-4f83-ab2e-3a5846bdae2c admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.92 time: 0.396639 Nov 01 18:46:32.591928 n-d-863052-2 devstack@n-api.service[105554]: [pid: 105554|app: 0|req: 29/56] 10.222.0.13 () {64 vars in 1235 bytes} [Tue Nov 1 18:46:32 2022] POST /compute/v2.1/flavors => generated 405 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 01 18:46:33.791513 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi [None req-678b61e8-7d0b-44cd-8bdc-2fcf283a50f6 admin admin] Calling method '>' {{(pid=105555) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:46:33.792512 n-d-863052-2 devstack@n-api.service[105555]: INFO nova.api.openstack.requestlog [None req-678b61e8-7d0b-44cd-8bdc-2fcf283a50f6 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001446 Nov 01 18:46:33.792966 n-d-863052-2 devstack@n-api.service[105555]: [pid: 105555|app: 0|req: 28/57] 10.222.0.13 () {56 vars in 1074 bytes} [Tue Nov 1 18:46:33 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 18:46:34.307097 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi [None req-29034f21-8019-4c5d-8f6e-e363c63c0022 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 18:46:34.325705 n-d-863052-2 devstack@n-api.service[105554]: INFO nova.api.openstack.requestlog [None req-29034f21-8019-4c5d-8f6e-e363c63c0022 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.92 time: 0.397646 Nov 01 18:46:34.326237 n-d-863052-2 devstack@n-api.service[105554]: [pid: 105554|app: 0|req: 30/58] 10.222.0.13 () {64 vars in 1235 bytes} [Tue Nov 1 18:46:33 2022] POST /compute/v2.1/flavors => generated 407 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 01 18:46:35.524372 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi [None req-678b61e8-7d0b-44cd-8bdc-2fcf283a50f6 admin admin] Calling method '>' {{(pid=105555) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:46:35.525396 n-d-863052-2 devstack@n-api.service[105555]: INFO nova.api.openstack.requestlog [None req-678b61e8-7d0b-44cd-8bdc-2fcf283a50f6 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001484 Nov 01 18:46:35.525811 n-d-863052-2 devstack@n-api.service[105555]: [pid: 105555|app: 0|req: 29/59] 10.222.0.13 () {56 vars in 1074 bytes} [Tue Nov 1 18:46:35 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 18:46:36.037085 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi [None req-e794fe07-4a00-4413-a4fb-7f7d66ba2a80 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 18:46:36.055472 n-d-863052-2 devstack@n-api.service[105554]: INFO nova.api.openstack.requestlog [None req-e794fe07-4a00-4413-a4fb-7f7d66ba2a80 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.92 time: 0.394078 Nov 01 18:46:36.056047 n-d-863052-2 devstack@n-api.service[105554]: [pid: 105554|app: 0|req: 31/60] 10.222.0.13 () {64 vars in 1235 bytes} [Tue Nov 1 18:46:35 2022] POST /compute/v2.1/flavors => generated 409 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 01 18:46:37.259077 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi [None req-678b61e8-7d0b-44cd-8bdc-2fcf283a50f6 admin admin] Calling method '>' {{(pid=105555) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:46:37.260075 n-d-863052-2 devstack@n-api.service[105555]: INFO nova.api.openstack.requestlog [None req-678b61e8-7d0b-44cd-8bdc-2fcf283a50f6 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001417 Nov 01 18:46:37.260476 n-d-863052-2 devstack@n-api.service[105555]: [pid: 105555|app: 0|req: 30/61] 10.222.0.13 () {56 vars in 1074 bytes} [Tue Nov 1 18:46:37 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 18:46:37.775416 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi [None req-c539f24e-4a78-4186-b2d9-e3e0708867c6 admin admin] Calling method '>' {{(pid=105554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:46:37.795745 n-d-863052-2 devstack@n-api.service[105554]: INFO nova.api.openstack.requestlog [None req-c539f24e-4a78-4186-b2d9-e3e0708867c6 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.92 time: 0.397732 Nov 01 18:46:37.796274 n-d-863052-2 devstack@n-api.service[105554]: [pid: 105554|app: 0|req: 32/62] 10.222.0.13 () {60 vars in 1202 bytes} [Tue Nov 1 18:46:37 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 18:47:33.970308 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi [None req-678b61e8-7d0b-44cd-8bdc-2fcf283a50f6 admin admin] Calling method '>' {{(pid=105555) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:47:33.971308 n-d-863052-2 devstack@n-api.service[105555]: INFO nova.api.openstack.requestlog [None req-678b61e8-7d0b-44cd-8bdc-2fcf283a50f6 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001425 Nov 01 18:47:33.971710 n-d-863052-2 devstack@n-api.service[105555]: [pid: 105555|app: 0|req: 31/63] 10.222.0.13 () {54 vars in 931 bytes} [Tue Nov 1 18:47:33 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 18:47:33.981978 n-d-863052-2 devstack@n-api.service[105554]: DEBUG dbcounter [-] [105554] Writing DB stats nova_api:INSERT=5,nova_api:SELECT=28 {{(pid=105554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 18:47:34.355134 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi [None req-7a56dece-bd06-4ced-b1d9-805f901d61d0 admin admin] Calling method '>' {{(pid=105554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:47:34.375679 n-d-863052-2 devstack@n-api.service[105554]: INFO nova.api.openstack.requestlog [None req-7a56dece-bd06-4ced-b1d9-805f901d61d0 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.398108 Nov 01 18:47:34.376203 n-d-863052-2 devstack@n-api.service[105554]: [pid: 105554|app: 0|req: 33/64] 10.222.0.13 () {60 vars in 1292 bytes} [Tue Nov 1 18:47:33 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 01 18:47:34.397880 n-d-863052-2 devstack@n-api.service[105555]: DEBUG dbcounter [-] [105555] Writing DB stats nova_api:SELECT=14 {{(pid=105555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 18:47:34.401573 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi [None req-3cdbc885-6daa-4e20-82aa-a2a982772fd9 admin admin] Calling method '>' {{(pid=105555) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:47:34.408716 n-d-863052-2 devstack@n-api.service[105555]: INFO nova.api.openstack.requestlog [None req-3cdbc885-6daa-4e20-82aa-a2a982772fd9 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012222 Nov 01 18:47:34.409225 n-d-863052-2 devstack@n-api.service[105555]: [pid: 105555|app: 0|req: 32/65] 10.222.0.13 () {60 vars in 1283 bytes} [Tue Nov 1 18:47:34 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:47:34.420493 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi [None req-ad883faa-2d37-4f1d-b995-621329d74395 admin admin] Calling method '>' {{(pid=105554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:47:34.428444 n-d-863052-2 devstack@n-api.service[105554]: INFO nova.api.openstack.requestlog [None req-ad883faa-2d37-4f1d-b995-621329d74395 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011259 Nov 01 18:47:34.428970 n-d-863052-2 devstack@n-api.service[105554]: [pid: 105554|app: 0|req: 34/66] 10.222.0.13 () {60 vars in 1286 bytes} [Tue Nov 1 18:47:34 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:47:34.439806 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi [None req-9bd20452-0ba8-478f-b081-5e41ca6d19c8 admin admin] Calling method '>' {{(pid=105555) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:47:34.447301 n-d-863052-2 devstack@n-api.service[105555]: INFO nova.api.openstack.requestlog [None req-9bd20452-0ba8-478f-b081-5e41ca6d19c8 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010973 Nov 01 18:47:34.447807 n-d-863052-2 devstack@n-api.service[105555]: [pid: 105555|app: 0|req: 33/67] 10.222.0.13 () {60 vars in 1286 bytes} [Tue Nov 1 18:47:34 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:47:34.459036 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi [None req-ca63076e-cf13-425f-8b78-2b61de06481b admin admin] Calling method '>' {{(pid=105554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:47:34.465901 n-d-863052-2 devstack@n-api.service[105554]: INFO nova.api.openstack.requestlog [None req-ca63076e-cf13-425f-8b78-2b61de06481b admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010493 Nov 01 18:47:34.466394 n-d-863052-2 devstack@n-api.service[105554]: [pid: 105554|app: 0|req: 35/68] 10.222.0.13 () {60 vars in 1283 bytes} [Tue Nov 1 18:47:34 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 11 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:52:42.671317 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi [None req-9bd20452-0ba8-478f-b081-5e41ca6d19c8 admin admin] Calling method '>' {{(pid=105555) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:52:42.672329 n-d-863052-2 devstack@n-api.service[105555]: INFO nova.api.openstack.requestlog [None req-9bd20452-0ba8-478f-b081-5e41ca6d19c8 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001428 Nov 01 18:52:42.672763 n-d-863052-2 devstack@n-api.service[105555]: [pid: 105555|app: 0|req: 34/69] 10.222.0.13 () {56 vars in 1074 bytes} [Tue Nov 1 18:52:42 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 18:52:42.812926 n-d-863052-2 devstack@n-api.service[105554]: DEBUG dbcounter [-] [105554] Writing DB stats nova_api:SELECT=6 {{(pid=105554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 18:52:42.952330 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi [None req-4de773db-e671-4314-84a5-cdb2aba336d3 admin admin] Calling method '>' {{(pid=105554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:52:42.957061 n-d-863052-2 devstack@n-api.service[105554]: DEBUG oslo_concurrency.lockutils [None req-4de773db-e671-4314-84a5-cdb2aba336d3 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:52:42.957532 n-d-863052-2 devstack@n-api.service[105554]: DEBUG oslo_concurrency.lockutils [None req-4de773db-e671-4314-84a5-cdb2aba336d3 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:52:42.957950 n-d-863052-2 devstack@n-api.service[105554]: DEBUG oslo_concurrency.lockutils [None req-4de773db-e671-4314-84a5-cdb2aba336d3 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:52:42.958655 n-d-863052-2 devstack@n-api.service[105554]: DEBUG oslo_concurrency.lockutils [None req-4de773db-e671-4314-84a5-cdb2aba336d3 admin admin] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:52:42.959094 n-d-863052-2 devstack@n-api.service[105554]: DEBUG oslo_concurrency.lockutils [None req-4de773db-e671-4314-84a5-cdb2aba336d3 admin admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:52:42.959504 n-d-863052-2 devstack@n-api.service[105554]: DEBUG oslo_concurrency.lockutils [None req-4de773db-e671-4314-84a5-cdb2aba336d3 admin admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:52:42.997847 n-d-863052-2 devstack@n-api.service[105554]: INFO nova.api.openstack.requestlog [None req-4de773db-e671-4314-84a5-cdb2aba336d3 admin admin] 10.222.0.13 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.92 time: 0.186325 Nov 01 18:52:42.998390 n-d-863052-2 devstack@n-api.service[105554]: [pid: 105554|app: 0|req: 36/70] 10.222.0.13 () {60 vars in 1193 bytes} [Tue Nov 1 18:52:42 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 18:52:44.050048 n-d-863052-2 devstack@n-api.service[105555]: DEBUG nova.api.openstack.wsgi [None req-9bd20452-0ba8-478f-b081-5e41ca6d19c8 admin admin] Calling method '>' {{(pid=105555) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:52:44.051043 n-d-863052-2 devstack@n-api.service[105555]: INFO nova.api.openstack.requestlog [None req-9bd20452-0ba8-478f-b081-5e41ca6d19c8 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001408 Nov 01 18:52:44.051477 n-d-863052-2 devstack@n-api.service[105555]: [pid: 105555|app: 0|req: 35/71] 10.222.0.13 () {56 vars in 1074 bytes} [Tue Nov 1 18:52:44 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 18:52:44.238780 n-d-863052-2 devstack@n-api.service[105554]: DEBUG nova.api.openstack.wsgi [None req-f888cac9-ccb5-4801-a160-a00f0d589150 admin admin] Calling method '>' {{(pid=105554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:52:44.242243 n-d-863052-2 devstack@n-api.service[105554]: DEBUG oslo_concurrency.lockutils [None req-f888cac9-ccb5-4801-a160-a00f0d589150 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:52:44.242704 n-d-863052-2 devstack@n-api.service[105554]: DEBUG oslo_concurrency.lockutils [None req-f888cac9-ccb5-4801-a160-a00f0d589150 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:52:44.243121 n-d-863052-2 devstack@n-api.service[105554]: DEBUG oslo_concurrency.lockutils [None req-f888cac9-ccb5-4801-a160-a00f0d589150 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:52:44.243934 n-d-863052-2 devstack@n-api.service[105554]: DEBUG oslo_concurrency.lockutils [None req-f888cac9-ccb5-4801-a160-a00f0d589150 admin admin] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:52:44.244384 n-d-863052-2 devstack@n-api.service[105554]: DEBUG oslo_concurrency.lockutils [None req-f888cac9-ccb5-4801-a160-a00f0d589150 admin admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:52:44.245400 n-d-863052-2 devstack@n-api.service[105554]: DEBUG oslo_concurrency.lockutils [None req-f888cac9-ccb5-4801-a160-a00f0d589150 admin admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:52:44.267646 n-d-863052-2 devstack@n-api.service[105554]: INFO nova.api.openstack.requestlog [None req-f888cac9-ccb5-4801-a160-a00f0d589150 admin admin] 10.222.0.13 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.92 time: 0.078811 Nov 01 18:52:44.268117 n-d-863052-2 devstack@n-api.service[105554]: [pid: 105554|app: 0|req: 37/72] 10.222.0.13 () {60 vars in 1193 bytes} [Tue Nov 1 18:52:44 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 18:53:31.187105 n-d-863052-2 systemd[1]: Stopping Devstack devstack@n-api.service... Nov 01 18:53:31.189865 n-d-863052-2 devstack@n-api.service[105553]: Tue Nov 1 18:53:31 2022 - graceful shutdown triggered... Nov 01 18:53:31.190353 n-d-863052-2 devstack@n-api.service[105554]: Gracefully killing worker 1 (pid: 105554)... Nov 01 18:53:31.190748 n-d-863052-2 devstack@n-api.service[105555]: Gracefully killing worker 2 (pid: 105555)... Nov 01 18:53:31.315832 n-d-863052-2 devstack@n-api.service[105555]: DEBUG dbcounter [-] [105555] Writing DB stats nova_api:SELECT=4 {{(pid=105555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 18:53:32.190486 n-d-863052-2 devstack@n-api.service[105553]: worker 1 buried after 1 seconds Nov 01 18:53:32.190486 n-d-863052-2 devstack@n-api.service[105553]: worker 2 buried after 1 seconds Nov 01 18:53:32.190486 n-d-863052-2 devstack@n-api.service[105553]: goodbye to uWSGI. Nov 01 18:53:32.192054 n-d-863052-2 systemd[1]: devstack@n-api.service: Succeeded. Nov 01 18:53:32.192654 n-d-863052-2 systemd[1]: Stopped Devstack devstack@n-api.service. Nov 01 18:53:32.195339 n-d-863052-2 systemd[1]: Starting Devstack devstack@n-api.service... Nov 01 18:53:32.210572 n-d-863052-2 devstack@n-api.service[121383]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Nov 01 18:53:32.227422 n-d-863052-2 devstack@n-api.service[121383]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Nov 1 18:53:32 2022] *** Nov 01 18:53:32.227422 n-d-863052-2 devstack@n-api.service[121383]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Nov 01 18:53:32.227422 n-d-863052-2 devstack@n-api.service[121383]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Nov 01 18:53:32.227422 n-d-863052-2 devstack@n-api.service[121383]: nodename: n-d-863052-2 Nov 01 18:53:32.227422 n-d-863052-2 devstack@n-api.service[121383]: machine: x86_64 Nov 01 18:53:32.227422 n-d-863052-2 devstack@n-api.service[121383]: clock source: unix Nov 01 18:53:32.227422 n-d-863052-2 devstack@n-api.service[121383]: pcre jit disabled Nov 01 18:53:32.227422 n-d-863052-2 devstack@n-api.service[121383]: detected number of CPU cores: 4 Nov 01 18:53:32.227422 n-d-863052-2 devstack@n-api.service[121383]: current working directory: / Nov 01 18:53:32.227422 n-d-863052-2 devstack@n-api.service[121383]: detected binary path: /usr/bin/uwsgi-core Nov 01 18:53:32.227422 n-d-863052-2 devstack@n-api.service[121383]: your processes number limit is 47680 Nov 01 18:53:32.227422 n-d-863052-2 devstack@n-api.service[121383]: your memory page size is 4096 bytes Nov 01 18:53:32.228377 n-d-863052-2 devstack@n-api.service[121383]: detected max file descriptor number: 2048 Nov 01 18:53:32.228377 n-d-863052-2 devstack@n-api.service[121383]: lock engine: pthread robust mutexes Nov 01 18:53:32.228377 n-d-863052-2 devstack@n-api.service[121383]: thunder lock: enabled Nov 01 18:53:32.228377 n-d-863052-2 devstack@n-api.service[121383]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Nov 01 18:53:32.228377 n-d-863052-2 devstack@n-api.service[121383]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Nov 01 18:53:32.267302 n-d-863052-2 devstack@n-api.service[121383]: Python main interpreter initialized at 0x555e5bed29c0 Nov 01 18:53:32.267302 n-d-863052-2 devstack@n-api.service[121383]: python threads support enabled Nov 01 18:53:32.267302 n-d-863052-2 devstack@n-api.service[121383]: your server socket listen backlog is limited to 100 connections Nov 01 18:53:32.267302 n-d-863052-2 devstack@n-api.service[121383]: your mercy for graceful operations on workers is 90 seconds Nov 01 18:53:32.267743 n-d-863052-2 devstack@n-api.service[121383]: mapped 403077 bytes (393 KB) for 2 cores Nov 01 18:53:32.267743 n-d-863052-2 devstack@n-api.service[121383]: *** Operational MODE: preforking *** Nov 01 18:53:32.267988 n-d-863052-2 devstack@n-api.service[121383]: *** uWSGI is running in multiple interpreter mode *** Nov 01 18:53:32.267988 n-d-863052-2 devstack@n-api.service[121383]: spawned uWSGI master process (pid: 121383) Nov 01 18:53:32.268193 n-d-863052-2 systemd[1]: Started Devstack devstack@n-api.service. Nov 01 18:53:32.268783 n-d-863052-2 devstack@n-api.service[121383]: spawned uWSGI worker 1 (pid: 121402, cores: 1) Nov 01 18:53:32.269135 n-d-863052-2 devstack@n-api.service[121383]: spawned uWSGI worker 2 (pid: 121403, cores: 1) Nov 01 18:53:32.269305 n-d-863052-2 devstack@n-api.service[121383]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Nov 01 18:53:32.924174 n-d-863052-2 devstack@n-api.service[121402]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Nov 01 18:53:32.927947 n-d-863052-2 devstack@n-api.service[121403]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Nov 01 18:53:34.147798 n-d-863052-2 devstack@n-api.service[121402]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 01 18:53:34.147798 n-d-863052-2 devstack@n-api.service[121402]: from cryptography.utils import int_from_bytes Nov 01 18:53:34.148458 n-d-863052-2 devstack@n-api.service[121402]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 01 18:53:34.148458 n-d-863052-2 devstack@n-api.service[121402]: from cryptography.utils import int_from_bytes Nov 01 18:53:34.151959 n-d-863052-2 devstack@n-api.service[121403]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 01 18:53:34.151959 n-d-863052-2 devstack@n-api.service[121403]: from cryptography.utils import int_from_bytes Nov 01 18:53:34.152425 n-d-863052-2 devstack@n-api.service[121403]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 01 18:53:34.152425 n-d-863052-2 devstack@n-api.service[121403]: from cryptography.utils import int_from_bytes Nov 01 18:53:36.584397 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Nov 01 18:53:36.585033 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Nov 01 18:53:36.585210 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Nov 01 18:53:36.585562 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Nov 01 18:53:36.585813 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Nov 01 18:53:36.586197 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:53:36.586523 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:53:36.586839 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:53:36.587154 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:53:36.587477 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:53:36.587784 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:53:36.588101 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:53:36.588417 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:53:36.588763 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:53:36.589020 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:53:36.589331 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:53:36.590313 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-863052-2 {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:53:36.590425 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Nov 01 18:53:36.590804 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Nov 01 18:53:36.590889 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:53:36.590973 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:53:36.591100 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Nov 01 18:53:36.591210 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:53:36.591466 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Nov 01 18:53:36.591564 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:53:36.591731 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Nov 01 18:53:36.591828 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:53:36.592110 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:53:36.592214 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:53:36.592411 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:53:36.592509 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:53:36.592767 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:53:36.592931 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:53:36.593095 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:53:36.593374 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:53:36.593481 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:53:36.593678 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:53:36.593782 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:53:36.594117 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:53:36.594277 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:53:36.594415 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:53:36.594534 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:53:36.594676 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:53:36.594805 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:53:36.594965 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:53:36.595101 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:53:36.595228 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:53:36.595353 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:53:36.595479 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-863052-2 {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:53:36.595616 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:53:36.595781 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:53:36.595916 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:53:36.596089 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:53:36.596225 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:53:36.596401 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:53:36.596550 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-863052-2 {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:53:36.596789 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:53:36.596932 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:53:36.597072 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:53:36.597206 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:53:36.597334 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:53:36.597471 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:53:36.597604 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:53:36.597786 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:53:36.598085 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:53:36.598275 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:53:36.598428 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:53:36.598567 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:53:36.598704 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:53:36.598832 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:53:36.598988 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:53:36.599131 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:53:36.599287 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:53:36.599431 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:53:36.599608 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:53:36.599747 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:53:36.599913 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:53:36.600050 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:53:36.600238 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:53:36.600370 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:53:36.600527 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:53:36.600720 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:53:36.600862 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:53:36.601002 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:53:36.601138 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:53:36.601274 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:53:36.601431 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:53:36.601573 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-863052-2 {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:53:36.601813 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:53:36.601960 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:53:36.602095 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:53:36.602233 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:53:36.602458 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:53:36.602579 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:53:36.606204 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:53:36.606370 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:53:36.606630 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:53:36.606804 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:53:36.606962 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:53:36.607124 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:53:36.607280 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:53:36.607449 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:53:36.607601 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:53:36.607762 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:53:36.607915 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:53:36.607915 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:53:36.608229 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:53:36.608379 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:53:36.608522 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:53:36.608719 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:53:36.608880 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:53:36.609023 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:53:36.609174 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:53:36.609324 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:53:36.609473 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:53:36.609614 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:53:36.609762 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:53:36.609911 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:53:36.610052 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:53:36.610193 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:53:36.610335 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:53:36.610484 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:53:36.610653 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:53:36.610805 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:53:36.610953 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:53:36.611111 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:53:36.611252 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:53:36.611405 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:53:36.611560 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:53:36.611709 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:53:36.611858 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:53:36.612000 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:53:36.612148 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:53:36.612299 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:53:36.612456 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:53:36.612624 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:53:36.612773 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:53:36.612927 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.13 {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:53:36.613068 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:53:36.613221 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.13 {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:53:36.613363 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:53:36.613518 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:53:36.613659 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:53:36.613813 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:53:36.613965 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:53:36.614108 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:53:36.614434 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:53:36.614583 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:53:36.614733 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:53:36.614894 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:53:36.615050 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:53:36.615204 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:53:36.615351 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:53:36.615647 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:53:36.615792 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:53:36.615944 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:53:36.616100 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:53:36.616243 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:53:36.616395 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:53:36.616539 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:53:36.616756 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:53:36.616908 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:53:36.617069 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:53:36.617211 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:53:36.617359 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:53:36.617501 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:53:36.617643 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:53:36.617803 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:53:36.617957 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:53:36.618111 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:53:36.618253 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:53:36.618394 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:53:36.618534 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.13 {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:53:36.618741 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:53:36.618893 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.13 {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:53:36.619053 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:53:36.619203 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:53:36.619345 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:53:36.619485 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:53:36.619637 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:53:36.619780 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:53:36.619921 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:53:36.620077 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:53:36.620230 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:53:36.620372 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:53:36.620522 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:53:36.620708 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:53:36.620862 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:53:36.621019 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:53:36.621167 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:53:36.621315 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:53:36.621474 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:53:36.621623 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:53:36.621764 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:53:36.621906 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:53:36.622047 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:53:36.622047 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:53:36.622336 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:53:36.622477 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:53:36.622626 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:53:36.622626 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:53:36.622927 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:53:36.623083 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:53:36.623232 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:53:36.623383 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:53:36.623525 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:53:36.623675 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:53:36.623817 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:53:36.623968 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:53:36.624117 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:53:36.624266 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:53:36.624416 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:53:36.624557 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:53:36.624772 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:53:36.624916 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:53:36.625066 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:53:36.625214 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:53:36.625364 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:53:36.625513 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:53:36.625661 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:53:36.625802 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:53:36.625943 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:53:36.626100 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:53:36.626243 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:53:36.626383 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:53:36.626532 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:53:36.626693 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:53:36.626843 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:53:36.626997 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:53:36.627149 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:53:36.627290 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:53:36.627431 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:53:36.627571 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:53:36.627722 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:53:36.627871 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:53:36.628029 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:53:36.628172 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:53:36.628323 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:53:36.628475 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:53:36.628653 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:53:36.628811 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:53:36.628960 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:53:36.629101 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:53:36.629244 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:53:36.629398 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:53:36.629546 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:53:36.629688 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:53:36.629830 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:53:36.629971 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:53:36.630120 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:53:36.630274 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:53:36.630417 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:53:36.630573 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:53:36.630722 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:53:36.630722 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:53:36.631000 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:53:36.631140 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:53:36.631289 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:53:36.631289 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:53:36.631567 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:53:36.631567 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:53:36.631862 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:53:36.632004 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:53:36.632146 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:53:36.632298 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:53:36.632448 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:53:36.632670 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:53:36.632829 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:53:36.632981 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.633137 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:53:36.633137 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:53:36.633420 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.633575 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:53:36.633717 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.633866 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:53:36.634014 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.634162 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:53:36.634325 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.634476 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:53:36.634625 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.634775 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:53:36.634924 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.635071 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:53:36.635221 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.635369 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:53:36.635519 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.635668 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:53:36.635816 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.635957 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:53:36.636118 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.636277 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:53:36.636913 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.637070 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:53:36.637213 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.637369 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:53:36.637526 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.637676 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:53:36.637824 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.637979 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:53:36.638124 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.638274 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:53:36.638415 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.638635 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 18:53:36.638782 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.638942 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.639092 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.639248 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.639398 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.639540 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.639689 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.639837 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.639979 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.640128 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.640284 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.640438 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.640630 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.640789 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.640938 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.641081 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.641230 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.641372 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.641522 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.641671 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.641823 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.641971 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.642121 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.642263 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.642421 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.642563 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.642711 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.642868 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.643017 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.643165 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.643314 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.643461 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.643604 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.643823 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.643969 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.644110 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.644251 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.644402 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.644553 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.644735 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.644891 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.645033 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.645174 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.645323 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.645472 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.645623 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.645775 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.645918 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.646066 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.646066 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.646357 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.646357 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.646634 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.646783 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.646932 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.647075 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.647233 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.647387 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.647529 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.647677 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.647818 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.647973 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.648129 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.648281 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.648423 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.648563 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.648739 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.648889 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.649039 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.649190 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.649332 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.649479 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.649621 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.649776 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.649918 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.650068 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.650220 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.650368 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.650517 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.650667 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.650817 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.650958 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.651106 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.651249 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.651390 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.651544 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.651693 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.651844 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.651997 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.652787 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.652941 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.653103 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.653247 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.653396 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.653537 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.653677 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.653818 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.653972 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.654121 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.654269 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.654418 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.654418 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.654711 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.654711 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.654978 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.655126 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.655267 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.655436 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.655587 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.655729 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.655878 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.655878 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.656153 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.656295 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.656455 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.656691 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.656849 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.656992 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.657133 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.657280 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.657431 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.657583 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.657731 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.657881 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.658030 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.658183 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.658341 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.658484 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.658626 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.658774 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.658915 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.658915 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.659191 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.659331 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.659480 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.659622 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.659770 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.659925 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.660067 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.660224 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.660372 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.660520 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.660714 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.660868 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.661010 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.661157 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.661298 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.661438 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.661587 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.661729 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.661869 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.662009 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.662171 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.662313 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.662463 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.662604 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.662753 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.662902 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.663043 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.663183 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.663341 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.663482 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.663623 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.663772 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.663913 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.664079 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.664230 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.664379 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.664379 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.664679 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.664826 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.664980 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.665122 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.665270 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.665412 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.665560 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.665708 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.665874 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.666016 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.666166 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.666318 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.666459 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.666598 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.666747 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.666897 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.666897 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.667179 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.667320 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.667461 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.667636 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.667801 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.667944 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.668110 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.668252 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.668405 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.668554 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.668735 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.668892 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.669226 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.669389 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.669549 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.669703 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.669854 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.670015 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.670166 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.670308 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.670462 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.670611 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.670753 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.670901 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.671050 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.671207 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.671361 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.671511 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.671660 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.671660 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.671951 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.672169 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.672321 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.672471 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.672633 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.672780 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.672923 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.673080 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.673231 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.673231 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.673511 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.673511 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.673777 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.673777 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.674071 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.674213 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.674354 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.674354 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.674632 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.674782 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.674923 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.675071 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.675218 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.675372 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.675521 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.675671 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.675822 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.675963 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.676113 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.676255 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.676411 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.676560 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.676757 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.676901 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.677041 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.677182 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.677332 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.677476 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.677634 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.677782 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.677924 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.678075 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.678229 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.678378 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.678531 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.678683 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.678825 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.678973 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.679125 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.679274 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.679423 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.679576 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.679717 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.679869 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.680018 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.680168 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.680317 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.680458 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.680617 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.680777 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.680927 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.681078 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.681230 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.681379 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.681530 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.681686 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.681837 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.681979 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.682119 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.682267 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.682416 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.682566 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.682716 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.682864 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.683017 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.683158 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.683337 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.683498 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.683648 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.683798 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.683939 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.684080 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.684230 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.684371 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.684512 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.684674 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.684828 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.684979 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.685135 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.685276 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.685426 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.685574 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.685716 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.685857 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.686023 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.686172 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.686327 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.686482 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.686900 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.687066 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.687221 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.687376 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.687540 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.687689 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.687846 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.688013 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.688169 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.688325 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.688482 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.688677 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.688842 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.689007 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.689156 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.689304 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.689451 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.689619 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.689774 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.689936 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.690094 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.690242 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.690389 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.690536 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.690683 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.690844 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.690994 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.691141 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.691289 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.691450 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.691617 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.691789 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.691946 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.692102 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.692250 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.692398 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.692559 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.692741 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.692899 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.693047 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.693195 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.693342 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.693503 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.693669 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.693817 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.693971 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.694126 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.694274 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.694431 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.694586 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.694745 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.695231 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.695401 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.695562 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.695711 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.695868 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.696015 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.696162 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.696317 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.696473 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.696661 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.696829 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.696994 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.697152 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.697302 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.697456 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.697612 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.697761 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.697940 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.698093 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.698263 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.698463 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.698613 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.698760 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.699431 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.699595 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.699744 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.699899 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.700055 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.700204 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.700365 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.700532 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.700715 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.700865 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.700865 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.701159 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.701308 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.701456 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.701611 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.701759 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.701913 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.702069 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.702225 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.702379 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.702547 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.702717 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.702866 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.703012 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.703165 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.703322 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.703484 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.703633 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.703788 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.703937 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.704084 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.704238 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.704470 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.704683 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.704838 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.704987 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.705136 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.705291 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.705449 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.705598 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.705753 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.705901 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.706058 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.706214 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.706371 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.706531 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.706678 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.706835 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.706990 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.707148 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.707304 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.707453 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.707600 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.707747 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.707895 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.708056 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.708212 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.708375 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.708541 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.708726 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.708886 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.709046 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.709202 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.709357 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.709506 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.709661 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.709809 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.709970 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.710127 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.710283 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.710440 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.710600 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.710757 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.710757 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.711039 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.711187 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.711333 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.711488 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.711711 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.711861 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.712009 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.712164 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.712319 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.712478 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.712660 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.712815 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.712963 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.713121 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.713277 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.713433 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.713590 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.713738 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.713894 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.714042 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.714198 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.714361 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.714593 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.715243 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.715400 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.715555 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.715703 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.715865 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.716020 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.716398 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.716556 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.716728 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.716877 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.717043 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.717201 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.717361 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.717517 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.717666 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.717814 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.717970 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.718119 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.718268 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.718422 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.718574 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.718731 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.718886 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.719041 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.719199 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.719349 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.719497 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.719663 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.719820 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.719977 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.720138 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.720288 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.720440 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.720706 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.720863 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.721021 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.721170 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.721336 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.721486 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.721642 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.721798 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.721947 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.722094 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.722241 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.722403 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.722562 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.722721 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.722869 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.723017 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.723172 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.723344 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.723493 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.723642 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.723788 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.723943 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.724098 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.724266 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.724423 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.724602 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.724757 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.724905 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.725052 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.725211 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.725211 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.725511 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.725659 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.725815 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.725977 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.726126 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.726281 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.726430 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.726584 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.726734 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.726890 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.727039 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.727185 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.727341 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.727489 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.727636 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.727792 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.727947 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.728103 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.728250 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.728406 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.728562 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.728761 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.728911 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.729066 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.729230 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.729387 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.729548 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.729696 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.729845 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.729999 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.730181 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.730336 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.730498 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.730738 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.730964 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.731122 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.731272 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.731441 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.731598 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.731747 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.731904 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.732060 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.732209 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.732366 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.732528 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.732713 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.732864 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.733019 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.733167 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.733324 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.733483 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.733632 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.733779 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.733928 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.734086 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.734242 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.734399 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.734548 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.734696 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.734857 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.735021 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.735171 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.735374 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.735537 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.735686 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.735842 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.735999 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.736150 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.736298 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.736453 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.736628 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.736783 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.736943 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.737092 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.737240 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.737389 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.737389 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.737685 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.737915 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.738074 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.738232 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.738395 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.738554 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.738713 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.738868 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.739017 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.739017 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.739017 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.739466 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.739624 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.739780 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.739930 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.740077 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.740224 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.740372 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.740532 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.740762 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.740913 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.741068 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.741217 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.741366 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.741537 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.741693 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.741842 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.741990 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.742137 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.742294 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.742443 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.742592 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.742738 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.742886 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.743034 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.743190 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.743347 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.743514 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.743671 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.743820 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.743976 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.744138 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.744295 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.744443 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.744622 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.744806 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.744965 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.745190 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.745190 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.745190 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.745635 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.745807 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.745974 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.746124 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.746272 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.746272 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.746560 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.746716 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.746872 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.747021 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.747175 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.747330 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.747492 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.747650 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.747809 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.747957 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.748105 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.748259 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.748425 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.748635 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.748804 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.748953 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.749101 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.749258 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.749406 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.749578 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.749737 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.749892 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.750040 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.750195 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.750343 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.750499 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.750647 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.750795 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.750951 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.751099 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.751256 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.751413 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.751583 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.751732 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.751881 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.752039 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.752187 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.752335 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.752490 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.752490 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.752813 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.752813 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.753112 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.753260 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.753423 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.753423 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.753704 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.753870 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.754021 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.754176 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.754325 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.754472 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.754628 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.754776 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.754932 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.755082 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.755237 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.755397 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.755558 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.756553 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.756764 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.756929 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.757081 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.757230 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.757390 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.757547 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.757696 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.757852 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.758008 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.758158 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.758340 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.758494 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.758643 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.758791 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.758948 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.759113 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.759270 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.759419 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.759568 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.759723 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.759872 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.760032 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.760032 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.760326 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.760474 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.760641 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.760797 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.760961 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.761112 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.761261 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.761916 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.762070 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.762219 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.762380 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.762539 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.762705 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.762854 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.763011 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.763168 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.763318 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.763467 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.763615 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.763764 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.763912 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.764068 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.764225 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.764384 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.764548 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.764754 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.764915 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.765074 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.765223 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.765379 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.765529 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.765676 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.765831 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.765988 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.766143 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.766291 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.766439 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.766595 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.766766 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.766922 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.767077 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.767226 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.767382 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.767532 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.767757 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.767914 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.768063 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.768211 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.768367 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.768522 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.768721 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.768877 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.769025 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.769180 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.769337 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.769486 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.769648 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.769807 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.769963 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.770121 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.770477 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.770645 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.770796 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.770955 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.771112 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.771268 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.771417 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.771580 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.771731 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.771879 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.772027 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.772176 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.772324 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.772485 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.772669 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.772826 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.772988 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.773137 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.773295 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.773501 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.773659 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.773808 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.773957 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.774105 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.774263 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.774412 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.774568 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.774724 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.774874 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.775040 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.775204 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.775353 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.775516 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.775666 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.775821 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.775971 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.775971 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.776270 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.776426 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.776576 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.776749 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.776918 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.777141 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.777794 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.777794 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.778097 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.778248 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.778406 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.778556 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.778712 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.778879 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.779030 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.779186 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.779344 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.779511 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.779661 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.779810 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.779966 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.780116 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.780273 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.780273 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.780557 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.780757 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.780919 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.781081 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.781232 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.781391 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.781546 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.781702 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.781851 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.782008 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.782166 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.782166 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.782450 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.782605 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.782753 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.782916 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.783066 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.783213 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.783381 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.783530 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.783677 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.783834 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.783982 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.784133 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.784288 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.784437 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.784617 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.784617 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.784918 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.785068 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.785226 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.785226 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.785526 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.785675 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.785825 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.785982 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.786139 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.786297 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.786447 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.786604 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.786759 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.786908 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.787074 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.787237 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.787386 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.787535 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.787683 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.787831 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.787978 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.788138 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.788294 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.788443 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.788609 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.788770 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.788949 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.789107 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.789256 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.789404 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.789561 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.789710 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.789866 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.790014 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.790014 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.790304 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.790304 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.790583 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.790583 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.790893 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.791042 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.791189 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.791343 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.791505 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.791663 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.791810 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.791810 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.792197 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.792197 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.792510 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.792510 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.793455 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.793605 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.793756 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.793905 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.794071 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.794221 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.794378 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.794528 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.794692 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.794856 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.795004 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.795153 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.795311 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.795467 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.795616 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.795774 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.795925 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.796082 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.796239 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.796239 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.796539 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.796731 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.796892 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.797049 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.797206 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.797206 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.797507 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.797736 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.797896 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.798045 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.798194 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.798342 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.798501 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.798661 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.798821 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.798971 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.799127 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.799284 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.799456 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.799613 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.799770 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.799926 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.800076 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.800225 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.800381 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.800531 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.800712 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.800871 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.801027 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.801185 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.801351 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.801501 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.801657 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.801806 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.801955 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.802112 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.802270 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.802425 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.802574 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.802730 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.802880 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.803036 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.803036 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.803336 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.803487 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.803642 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.803798 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.803956 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.804105 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.804268 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.804418 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.804565 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.804772 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.804929 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.805078 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.805233 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.805393 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.805556 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.805720 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.805877 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.806033 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.806188 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.806338 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.806495 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.806660 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.806816 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.806965 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.807121 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.807277 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.807436 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.807593 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.807750 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.807898 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.808046 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.808202 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.808394 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.808546 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.808729 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.808896 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.809047 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.809195 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.809364 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.809521 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.809670 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.809819 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.809967 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.810123 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.810287 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.810436 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.810586 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.810586 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.810867 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.811016 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.811179 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.811347 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.811505 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.811948 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.812109 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.812268 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.812417 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.812565 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.812749 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.812907 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.813063 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.813225 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.813376 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.813525 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.813684 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.813833 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.813981 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.814145 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.814304 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.814461 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.814610 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.814768 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.814930 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.815088 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.815237 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.815385 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.815534 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.815691 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.815854 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.816003 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.816160 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.816308 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.816456 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.816627 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.816795 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.816947 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.817102 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.817102 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.817392 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.817558 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.817723 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.817872 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.818028 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.818178 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.818334 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.818492 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.818649 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.818803 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.818957 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.819113 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.819113 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.819419 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.819578 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.819734 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.819883 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.820032 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.820180 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.820337 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.820494 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.820697 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.820853 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.821001 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.821161 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.821319 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.821486 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.821646 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.821803 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.821959 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.822118 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.822267 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.822267 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.822556 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.822706 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.822854 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.822854 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.823152 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.823310 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.823460 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.823616 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.823765 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.823765 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.824575 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.824759 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.824916 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.825073 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.825237 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.825389 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.825545 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.825545 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.825837 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.825986 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.826143 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.826300 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.826458 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.826607 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.826761 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.826910 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.827136 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.827287 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.827436 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.827591 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.827750 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.827907 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.828057 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.828204 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.828361 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.828522 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.828694 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.828856 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.829015 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.829172 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.829331 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.829483 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.829631 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.829799 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.829956 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.830105 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.830261 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.830410 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.830567 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.830724 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.830873 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.831030 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.831179 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.831327 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.831493 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.831668 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.831668 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.831959 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.832109 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.832263 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.832426 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.832594 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.832768 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.832927 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.833078 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.833226 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.833396 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.833555 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.833724 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.833881 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.834037 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.834203 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.834353 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.834509 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.834661 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.834818 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.834968 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.835126 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.835275 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.835425 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.835573 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.835739 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.835889 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.836047 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.836202 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.836351 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.836509 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.836739 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.836890 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.837055 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.837205 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.837353 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.837509 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.837675 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.837840 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.837998 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.838148 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.838296 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.838443 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.838600 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.838758 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.838909 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.839057 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.839212 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.839372 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.839566 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.840232 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.840384 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.840533 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.840713 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.840872 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.841031 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.841189 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.841339 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.841488 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.841636 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.841636 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.841934 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.842085 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.842253 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.842403 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.842558 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.842708 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.842870 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.843022 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.843172 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.843327 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.843484 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.843484 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.843774 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.843924 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.844091 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.844240 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.844395 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.844557 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.844750 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.844908 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.845065 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.845223 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.845381 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.845539 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.845689 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.845845 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.845994 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.846152 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.846309 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.846468 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.846618 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.846767 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.846915 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.847063 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.847224 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.847389 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.847547 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.847696 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.847852 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.848019 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.848182 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.848332 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.848481 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.848708 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.848872 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.849031 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.849195 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.849358 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.849515 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.849672 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.849823 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.849971 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.850138 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.850288 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.850445 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.850602 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.850751 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.850913 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.851063 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.851211 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=121402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Nov 01 18:53:36.851368 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.851368 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.851368 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.851368 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.851368 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.851368 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.851368 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.851368 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.852501 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.852501 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.852501 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.852501 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.852501 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.852501 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.852501 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.852501 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.853675 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.853675 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.853675 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.853675 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.853675 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.853675 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.853675 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.853675 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 18:53:36.854782 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=121403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Nov 01 18:53:36.905267 n-d-863052-2 devstack@n-api.service[121402]: INFO dbcounter [None req-1f5ff6c9-56c8-4707-bc20-f294a2587e21 None None] Registered counter for database nova_api Nov 01 18:53:36.911949 n-d-863052-2 devstack@n-api.service[121403]: INFO dbcounter [None req-d2396b93-e4af-45e9-8487-daedc5a530e8 None None] Registered counter for database nova_api Nov 01 18:53:36.926119 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_db.sqlalchemy.engines [None req-1f5ff6c9-56c8-4707-bc20-f294a2587e21 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121402) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Nov 01 18:53:36.932133 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_db.sqlalchemy.engines [None req-d2396b93-e4af-45e9-8487-daedc5a530e8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121403) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Nov 01 18:53:36.934012 n-d-863052-2 devstack@n-api.service[121402]: DEBUG dbcounter [-] [121402] Writer thread running {{(pid=121402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Nov 01 18:53:36.939944 n-d-863052-2 devstack@n-api.service[121403]: DEBUG dbcounter [-] [121403] Writer thread running {{(pid=121403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Nov 01 18:53:36.991432 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.context [None req-1f5ff6c9-56c8-4707-bc20-f294a2587e21 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),389766af-efe4-4d8b-b2de-e920ed3438ee(cell1) {{(pid=121402) load_cells /opt/stack/nova/nova/context.py:464}} Nov 01 18:53:36.995462 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-1f5ff6c9-56c8-4707-bc20-f294a2587e21 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:53:36.996459 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-1f5ff6c9-56c8-4707-bc20-f294a2587e21 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:53:36.997303 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.context [None req-d2396b93-e4af-45e9-8487-daedc5a530e8 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),389766af-efe4-4d8b-b2de-e920ed3438ee(cell1) {{(pid=121403) load_cells /opt/stack/nova/nova/context.py:464}} Nov 01 18:53:36.998097 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-1f5ff6c9-56c8-4707-bc20-f294a2587e21 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:53:36.998833 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-1f5ff6c9-56c8-4707-bc20-f294a2587e21 None None] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:53:36.999840 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-1f5ff6c9-56c8-4707-bc20-f294a2587e21 None None] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:53:37.001306 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d2396b93-e4af-45e9-8487-daedc5a530e8 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:53:37.001452 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-1f5ff6c9-56c8-4707-bc20-f294a2587e21 None None] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:53:37.001784 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d2396b93-e4af-45e9-8487-daedc5a530e8 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:53:37.003358 n-d-863052-2 devstack@n-api.service[121402]: INFO dbcounter [None req-1f5ff6c9-56c8-4707-bc20-f294a2587e21 None None] Registered counter for database nova_cell0 Nov 01 18:53:37.003518 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d2396b93-e4af-45e9-8487-daedc5a530e8 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:53:37.004079 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d2396b93-e4af-45e9-8487-daedc5a530e8 None None] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:53:37.004531 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d2396b93-e4af-45e9-8487-daedc5a530e8 None None] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:53:37.006570 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d2396b93-e4af-45e9-8487-daedc5a530e8 None None] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:53:37.007518 n-d-863052-2 devstack@n-api.service[121402]: INFO dbcounter [None req-1f5ff6c9-56c8-4707-bc20-f294a2587e21 None None] Registered counter for database nova_cell1 Nov 01 18:53:37.008613 n-d-863052-2 devstack@n-api.service[121403]: INFO dbcounter [None req-d2396b93-e4af-45e9-8487-daedc5a530e8 None None] Registered counter for database nova_cell0 Nov 01 18:53:37.013431 n-d-863052-2 devstack@n-api.service[121403]: INFO dbcounter [None req-d2396b93-e4af-45e9-8487-daedc5a530e8 None None] Registered counter for database nova_cell1 Nov 01 18:53:37.015316 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_db.sqlalchemy.engines [None req-1f5ff6c9-56c8-4707-bc20-f294a2587e21 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121402) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Nov 01 18:53:37.017120 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_db.sqlalchemy.engines [None req-1f5ff6c9-56c8-4707-bc20-f294a2587e21 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121402) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Nov 01 18:53:37.020788 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_db.sqlalchemy.engines [None req-d2396b93-e4af-45e9-8487-daedc5a530e8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121403) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Nov 01 18:53:37.022272 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_db.sqlalchemy.engines [None req-d2396b93-e4af-45e9-8487-daedc5a530e8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121403) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Nov 01 18:53:37.023631 n-d-863052-2 devstack@n-api.service[121402]: DEBUG dbcounter [-] [121402] Writer thread running {{(pid=121402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Nov 01 18:53:37.024959 n-d-863052-2 devstack@n-api.service[121402]: DEBUG dbcounter [-] [121402] Writer thread running {{(pid=121402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Nov 01 18:53:37.030057 n-d-863052-2 devstack@n-api.service[121403]: DEBUG dbcounter [-] [121403] Writer thread running {{(pid=121403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Nov 01 18:53:37.175616 n-d-863052-2 devstack@n-api.service[121403]: DEBUG dbcounter [-] [121403] Writer thread running {{(pid=121403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Nov 01 18:53:37.182352 n-d-863052-2 devstack@n-api.service[121402]: INFO dbcounter [None req-1f5ff6c9-56c8-4707-bc20-f294a2587e21 None None] Registered counter for database nova_cell0 Nov 01 18:53:37.187404 n-d-863052-2 devstack@n-api.service[121403]: INFO dbcounter [None req-d2396b93-e4af-45e9-8487-daedc5a530e8 None None] Registered counter for database nova_cell0 Nov 01 18:53:37.190395 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_db.sqlalchemy.engines [None req-1f5ff6c9-56c8-4707-bc20-f294a2587e21 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121402) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Nov 01 18:53:37.194751 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_db.sqlalchemy.engines [None req-d2396b93-e4af-45e9-8487-daedc5a530e8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121403) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Nov 01 18:53:37.197875 n-d-863052-2 devstack@n-api.service[121402]: DEBUG dbcounter [-] [121402] Writer thread running {{(pid=121402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Nov 01 18:53:37.200148 n-d-863052-2 devstack@n-api.service[121403]: DEBUG dbcounter [-] [121403] Writer thread running {{(pid=121403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Nov 01 18:53:37.520873 n-d-863052-2 devstack@n-api.service[121402]: WARNING keystonemiddleware.auth_token [None req-1f5ff6c9-56c8-4707-bc20-f294a2587e21 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 01 18:53:37.521093 n-d-863052-2 devstack@n-api.service[121403]: WARNING keystonemiddleware.auth_token [None req-d2396b93-e4af-45e9-8487-daedc5a530e8 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 01 18:53:37.528011 n-d-863052-2 devstack@n-api.service[121402]: WARNING keystonemiddleware.auth_token [None req-1f5ff6c9-56c8-4707-bc20-f294a2587e21 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 01 18:53:37.528286 n-d-863052-2 devstack@n-api.service[121403]: WARNING keystonemiddleware.auth_token [None req-d2396b93-e4af-45e9-8487-daedc5a530e8 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 01 18:53:37.869072 n-d-863052-2 devstack@n-api.service[121402]: WARNING keystonemiddleware.auth_token [None req-1f5ff6c9-56c8-4707-bc20-f294a2587e21 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 01 18:53:37.871673 n-d-863052-2 devstack@n-api.service[121403]: WARNING keystonemiddleware.auth_token [None req-d2396b93-e4af-45e9-8487-daedc5a530e8 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 01 18:53:37.875013 n-d-863052-2 devstack@n-api.service[121402]: WARNING keystonemiddleware.auth_token [None req-1f5ff6c9-56c8-4707-bc20-f294a2587e21 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 01 18:53:37.877716 n-d-863052-2 devstack@n-api.service[121403]: WARNING keystonemiddleware.auth_token [None req-d2396b93-e4af-45e9-8487-daedc5a530e8 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 01 18:53:37.880393 n-d-863052-2 devstack@n-api.service[121402]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x555e5bed29c0 pid: 121402 (default app) Nov 01 18:53:37.883037 n-d-863052-2 devstack@n-api.service[121403]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x555e5bed29c0 pid: 121403 (default app) Nov 01 18:54:16.347666 n-d-863052-2 devstack@n-api.service[121402]: DEBUG dbcounter [-] [121402] Writing DB stats nova_api:SELECT=3 {{(pid=121402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 18:54:16.348933 n-d-863052-2 devstack@n-api.service[121402]: DEBUG dbcounter [-] [121402] Writing DB stats nova_cell1:SELECT=3 {{(pid=121402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 18:54:16.349785 n-d-863052-2 devstack@n-api.service[121402]: DEBUG dbcounter [-] [121402] Writing DB stats nova_cell0:SELECT=3 {{(pid=121402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 18:54:16.350862 n-d-863052-2 devstack@n-api.service[121402]: DEBUG dbcounter [-] [121402] Writing DB stats nova_cell0:SELECT=3 {{(pid=121402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 18:54:17.835708 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-7a19bfdd-9274-4a23-bcec-41f5125cd542 tempest-AggregatesAdminTestV241-306352719 tempest-AggregatesAdminTestV241-306352719-project-admin] Calling method '.version_select at 0x7f0ae3ff50d0>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:54:17.846212 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-7a19bfdd-9274-4a23-bcec-41f5125cd542 tempest-AggregatesAdminTestV241-306352719 tempest-AggregatesAdminTestV241-306352719-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),389766af-efe4-4d8b-b2de-e920ed3438ee(cell1) {{(pid=121402) load_cells /opt/stack/nova/nova/compute/api.py:319}} Nov 01 18:54:17.846943 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-7a19bfdd-9274-4a23-bcec-41f5125cd542 tempest-AggregatesAdminTestV241-306352719 tempest-AggregatesAdminTestV241-306352719-project-admin] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:54:17.847425 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-7a19bfdd-9274-4a23-bcec-41f5125cd542 tempest-AggregatesAdminTestV241-306352719 tempest-AggregatesAdminTestV241-306352719-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:54:17.847861 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-7a19bfdd-9274-4a23-bcec-41f5125cd542 tempest-AggregatesAdminTestV241-306352719 tempest-AggregatesAdminTestV241-306352719-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:54:17.874358 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-7a19bfdd-9274-4a23-bcec-41f5125cd542 tempest-AggregatesAdminTestV241-306352719 tempest-AggregatesAdminTestV241-306352719-project-admin] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:54:17.874845 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-7a19bfdd-9274-4a23-bcec-41f5125cd542 tempest-AggregatesAdminTestV241-306352719 tempest-AggregatesAdminTestV241-306352719-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:54:17.875279 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-7a19bfdd-9274-4a23-bcec-41f5125cd542 tempest-AggregatesAdminTestV241-306352719 tempest-AggregatesAdminTestV241-306352719-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:54:17.888068 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-7a19bfdd-9274-4a23-bcec-41f5125cd542 tempest-AggregatesAdminTestV241-306352719 tempest-AggregatesAdminTestV241-306352719-project-admin] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:54:17.888475 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-7a19bfdd-9274-4a23-bcec-41f5125cd542 tempest-AggregatesAdminTestV241-306352719 tempest-AggregatesAdminTestV241-306352719-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:54:17.889122 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-7a19bfdd-9274-4a23-bcec-41f5125cd542 tempest-AggregatesAdminTestV241-306352719 tempest-AggregatesAdminTestV241-306352719-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:54:17.895415 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-7a19bfdd-9274-4a23-bcec-41f5125cd542 tempest-AggregatesAdminTestV241-306352719 tempest-AggregatesAdminTestV241-306352719-project-admin] 10.222.0.13 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1423 microversion: 2.41 time: 1.553169 Nov 01 18:54:17.895987 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1/1] 10.222.0.13 () {60 vars in 1208 bytes} [Tue Nov 1 18:54:16 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1423 bytes in 1555 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 18:54:18.128718 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-3a20266e-3668-466f-a1a7-5ec7a2433c02 tempest-AggregatesAdminTestV241-306352719 tempest-AggregatesAdminTestV241-306352719-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1825756310"}} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 18:54:18.148290 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.objects.aggregate [None req-3a20266e-3668-466f-a1a7-5ec7a2433c02 tempest-AggregatesAdminTestV241-306352719 tempest-AggregatesAdminTestV241-306352719-project-admin] Generated uuid cb1c5efb-38b3-4320-b5c7-da622217f9ca for aggregate {{(pid=121403) create /opt/stack/nova/nova/objects/aggregate.py:298}} Nov 01 18:54:18.157173 n-d-863052-2 devstack@n-api.service[121403]: DEBUG dbcounter [-] [121403] Writing DB stats nova_api:SELECT=3 {{(pid=121403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 18:54:18.157173 n-d-863052-2 devstack@n-api.service[121403]: DEBUG dbcounter [-] [121403] Writing DB stats nova_cell1:SELECT=3 {{(pid=121403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 18:54:18.157941 n-d-863052-2 devstack@n-api.service[121403]: DEBUG dbcounter [-] [121403] Writing DB stats nova_cell0:SELECT=3 {{(pid=121403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 18:54:18.158679 n-d-863052-2 devstack@n-api.service[121403]: DEBUG dbcounter [-] [121403] Writing DB stats nova_cell0:SELECT=3 {{(pid=121403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 18:54:18.230800 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-3a20266e-3668-466f-a1a7-5ec7a2433c02 tempest-AggregatesAdminTestV241-306352719 tempest-AggregatesAdminTestV241-306352719-project-admin] 10.222.0.13 "POST /compute/v2.1/os-aggregates" status: 200 len: 246 microversion: 2.41 time: 0.316931 Nov 01 18:54:18.231979 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1/2] 10.222.0.13 () {62 vars in 1205 bytes} [Tue Nov 1 18:54:17 2022] POST /compute/v2.1/os-aggregates => generated 246 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 01 18:54:18.244016 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-5377da7f-e961-4860-a9f9-b7e8764602f4 tempest-AggregatesAdminTestV241-306352719 tempest-AggregatesAdminTestV241-306352719-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-385676343"}} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 18:54:18.420888 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-5377da7f-e961-4860-a9f9-b7e8764602f4 tempest-AggregatesAdminTestV241-306352719 tempest-AggregatesAdminTestV241-306352719-project-admin] 10.222.0.13 "PUT /compute/v2.1/os-aggregates/1" status: 200 len: 298 microversion: 2.41 time: 0.180580 Nov 01 18:54:18.421865 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 2/3] 10.222.0.13 () {62 vars in 1210 bytes} [Tue Nov 1 18:54:18 2022] PUT /compute/v2.1/os-aggregates/1 => generated 298 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 01 18:54:18.434582 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-8b021a49-cfd8-4eb2-adae-ff676d822b28 tempest-AggregatesAdminTestV241-306352719 tempest-AggregatesAdminTestV241-306352719-project-admin] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:54:18.443522 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-8b021a49-cfd8-4eb2-adae-ff676d822b28 tempest-AggregatesAdminTestV241-306352719 tempest-AggregatesAdminTestV241-306352719-project-admin] 10.222.0.13 "GET /compute/v2.1/os-aggregates/1" status: 200 len: 298 microversion: 2.41 time: 0.012521 Nov 01 18:54:18.450928 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 3/4] 10.222.0.13 () {60 vars in 1190 bytes} [Tue Nov 1 18:54:18 2022] GET /compute/v2.1/os-aggregates/1 => generated 298 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 01 18:54:18.455947 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-fcf87dac-44d8-4eb7-b87f-8d4f9f28259c tempest-AggregatesAdminTestV241-306352719 tempest-AggregatesAdminTestV241-306352719-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-863052-2"}} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 18:54:18.468568 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-fcf87dac-44d8-4eb7-b87f-8d4f9f28259c tempest-AggregatesAdminTestV241-306352719 tempest-AggregatesAdminTestV241-306352719-project-admin] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:54:18.469278 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-fcf87dac-44d8-4eb7-b87f-8d4f9f28259c tempest-AggregatesAdminTestV241-306352719 tempest-AggregatesAdminTestV241-306352719-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:54:18.470119 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-fcf87dac-44d8-4eb7-b87f-8d4f9f28259c tempest-AggregatesAdminTestV241-306352719 tempest-AggregatesAdminTestV241-306352719-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:54:19.077559 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-5b777a92-7b56-425f-8243-09a06be4b0bb tempest-AZAdminNegativeTestJSON-2121267005 tempest-AZAdminNegativeTestJSON-2121267005-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:54:19.081076 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-5b777a92-7b56-425f-8243-09a06be4b0bb tempest-AZAdminNegativeTestJSON-2121267005 tempest-AZAdminNegativeTestJSON-2121267005-project] Policy check for os_compute_api:os-availability-zone:detail failed with credentials {'is_admin': False, 'user_id': '1bd250a42f7e4b82bedafbff0ff9dbee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa41cff559924606a0200dacfb1519af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:54:19.086330 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-5b777a92-7b56-425f-8243-09a06be4b0bb tempest-AZAdminNegativeTestJSON-2121267005 tempest-AZAdminNegativeTestJSON-2121267005-project] Request method failure captured: Nov 01 18:54:19.086330 n-d-863052-2 devstack@n-api.service[121403]: request: GET /compute/v2.1/os-availability-zone/detail HTTP/1.1 Nov 01 18:54:19.086330 n-d-863052-2 devstack@n-api.service[121403]: Accept: application/json Nov 01 18:54:19.086330 n-d-863052-2 devstack@n-api.service[121403]: Accept-Encoding: identity Nov 01 18:54:19.086330 n-d-863052-2 devstack@n-api.service[121403]: Connection: close Nov 01 18:54:19.086330 n-d-863052-2 devstack@n-api.service[121403]: Content-Length: 0 Nov 01 18:54:19.086330 n-d-863052-2 devstack@n-api.service[121403]: Content-Type: application/json Nov 01 18:54:19.086330 n-d-863052-2 devstack@n-api.service[121403]: Host: 10.222.0.13 Nov 01 18:54:19.086330 n-d-863052-2 devstack@n-api.service[121403]: Openstack-System-Scope: None Nov 01 18:54:19.086330 n-d-863052-2 devstack@n-api.service[121403]: User-Agent: python-urllib3/1.26.12 Nov 01 18:54:19.086330 n-d-863052-2 devstack@n-api.service[121403]: X-Auth-Token: gAAAAABjYWtXoTNfNM_oM1WFQ4as0OSkEgjlwwPlFILlqqfJC5jYG_tx2SgQbn0Kkmb6ggYm8aBPgd5_CAmGdFlAIYCfTMmTCxwvmjJnKwFVz1qEJeKSGPpKqLGgbt8M3zz3OHFuG5N0CkLiL1WUGVwgeHKAIFSaUaIbNiSM3nFQL3YjzpxrhwM Nov 01 18:54:19.086330 n-d-863052-2 devstack@n-api.service[121403]: X-Domain-Id: None Nov 01 18:54:19.086330 n-d-863052-2 devstack@n-api.service[121403]: X-Domain-Name: None Nov 01 18:54:19.086330 n-d-863052-2 devstack@n-api.service[121403]: X-Identity-Status: Confirmed Nov 01 18:54:19.086330 n-d-863052-2 devstack@n-api.service[121403]: X-Is-Admin-Project: True Nov 01 18:54:19.086330 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Domain-Id: default Nov 01 18:54:19.086330 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Domain-Name: Default Nov 01 18:54:19.086330 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Id: aa41cff559924606a0200dacfb1519af Nov 01 18:54:19.086330 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Name: tempest-AZAdminNegativeTestJSON-2121267005 Nov 01 18:54:19.086330 n-d-863052-2 devstack@n-api.service[121403]: X-Role: member,reader Nov 01 18:54:19.086330 n-d-863052-2 devstack@n-api.service[121403]: X-Roles: member,reader Nov 01 18:54:19.087916 n-d-863052-2 devstack@n-api.service[121403]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/aa41cff559924606a0200dacfb1519af"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/aa41cff559924606a0200dacfb1519af"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_aa41cff559924606a0200dacfb1519af", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/aa41cff559924606a0200dacfb1519af"}]}] Nov 01 18:54:19.087916 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant: tempest-AZAdminNegativeTestJSON-2121267005 Nov 01 18:54:19.087916 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant-Id: aa41cff559924606a0200dacfb1519af Nov 01 18:54:19.087916 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant-Name: tempest-AZAdminNegativeTestJSON-2121267005 Nov 01 18:54:19.087916 n-d-863052-2 devstack@n-api.service[121403]: X-User: tempest-AZAdminNegativeTestJSON-2121267005-project Nov 01 18:54:19.087916 n-d-863052-2 devstack@n-api.service[121403]: X-User-Domain-Id: default Nov 01 18:54:19.087916 n-d-863052-2 devstack@n-api.service[121403]: X-User-Domain-Name: Default Nov 01 18:54:19.087916 n-d-863052-2 devstack@n-api.service[121403]: X-User-Id: 1bd250a42f7e4b82bedafbff0ff9dbee Nov 01 18:54:19.087916 n-d-863052-2 devstack@n-api.service[121403]: X-User-Name: tempest-AZAdminNegativeTestJSON-2121267005-project Nov 01 18:54:19.087916 n-d-863052-2 devstack@n-api.service[121403]: method: > Nov 01 18:54:19.087916 n-d-863052-2 devstack@n-api.service[121403]: exception: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Nov 01 18:54:19.087916 n-d-863052-2 devstack@n-api.service[121403]: action_args: {} Nov 01 18:54:19.088825 n-d-863052-2 devstack@n-api.service[121403]: {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 01 18:54:19.088825 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:54:19.088825 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 18:54:19.088825 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 18:54:19.088825 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 01 18:54:19.088825 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 01 18:54:19.088825 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 01 18:54:19.088825 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 01 18:54:19.088825 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/availability_zone.py", line 117, in detail Nov 01 18:54:19.088825 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi context.can(az_policies.POLICY_ROOT % 'detail', target={}) Nov 01 18:54:19.088825 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Nov 01 18:54:19.088825 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Nov 01 18:54:19.088825 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Nov 01 18:54:19.088825 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Nov 01 18:54:19.088825 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 01 18:54:19.088825 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 01 18:54:19.088825 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 01 18:54:19.088825 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise self.value Nov 01 18:54:19.088825 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Nov 01 18:54:19.090057 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Nov 01 18:54:19.090057 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Nov 01 18:54:19.090057 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return self.enforce( Nov 01 18:54:19.090057 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Nov 01 18:54:19.090057 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Nov 01 18:54:19.090057 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Nov 01 18:54:19.090057 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 18:54:19.090057 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 18:54:19.090057 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 18:54:19.090057 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:54:19.090057 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 18:54:19.090057 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 18:54:19.090057 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Nov 01 18:54:19.090057 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Nov 01 18:54:19.090057 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Nov 01 18:54:19.090057 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 18:54:19.093660 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-5b777a92-7b56-425f-8243-09a06be4b0bb tempest-AZAdminNegativeTestJSON-2121267005 tempest-AZAdminNegativeTestJSON-2121267005-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. {{(pid=121403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 01 18:54:19.095558 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-5b777a92-7b56-425f-8243-09a06be4b0bb tempest-AZAdminNegativeTestJSON-2121267005 tempest-AZAdminNegativeTestJSON-2121267005-project] 10.222.0.13 "GET /compute/v2.1/os-availability-zone/detail" status: 403 len: 123 microversion: 2.1 time: 0.813526 Nov 01 18:54:19.096270 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 2/5] 10.222.0.13 () {58 vars in 1185 bytes} [Tue Nov 1 18:54:18 2022] GET /compute/v2.1/os-availability-zone/detail => generated 123 bytes in 816 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Nov 01 18:54:19.508234 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-9dcb7b43-c2f9-417e-9249-ee28ad5004be tempest-AggregatesAdminNegativeTestJSON-1815627383 tempest-AggregatesAdminNegativeTestJSON-1815627383-project-admin] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:54:19.512620 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-9dcb7b43-c2f9-417e-9249-ee28ad5004be tempest-AggregatesAdminNegativeTestJSON-1815627383 tempest-AggregatesAdminNegativeTestJSON-1815627383-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:54:19.513101 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-9dcb7b43-c2f9-417e-9249-ee28ad5004be tempest-AggregatesAdminNegativeTestJSON-1815627383 tempest-AggregatesAdminNegativeTestJSON-1815627383-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:54:19.513530 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-9dcb7b43-c2f9-417e-9249-ee28ad5004be tempest-AggregatesAdminNegativeTestJSON-1815627383 tempest-AggregatesAdminNegativeTestJSON-1815627383-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:54:19.514427 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-9dcb7b43-c2f9-417e-9249-ee28ad5004be tempest-AggregatesAdminNegativeTestJSON-1815627383 tempest-AggregatesAdminNegativeTestJSON-1815627383-project-admin] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:54:19.514875 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-9dcb7b43-c2f9-417e-9249-ee28ad5004be tempest-AggregatesAdminNegativeTestJSON-1815627383 tempest-AggregatesAdminNegativeTestJSON-1815627383-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:54:19.515732 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-9dcb7b43-c2f9-417e-9249-ee28ad5004be tempest-AggregatesAdminNegativeTestJSON-1815627383 tempest-AggregatesAdminNegativeTestJSON-1815627383-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:54:19.561322 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-9dcb7b43-c2f9-417e-9249-ee28ad5004be tempest-AggregatesAdminNegativeTestJSON-1815627383 tempest-AggregatesAdminNegativeTestJSON-1815627383-project-admin] 10.222.0.13 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.463802 Nov 01 18:54:19.562137 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 3/6] 10.222.0.13 () {58 vars in 1176 bytes} [Tue Nov 1 18:54:19 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 18:54:19.805113 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-fcf87dac-44d8-4eb7-b87f-8d4f9f28259c tempest-AggregatesAdminTestV241-306352719 tempest-AggregatesAdminTestV241-306352719-project-admin] 10.222.0.13 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 313 microversion: 2.41 time: 1.352695 Nov 01 18:54:19.805851 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 4/7] 10.222.0.13 () {62 vars in 1232 bytes} [Tue Nov 1 18:54:18 2022] POST /compute/v2.1/os-aggregates/1/action => generated 313 bytes in 1354 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 01 18:54:19.917125 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-d810ffe3-11c1-4123-862f-b7561ec443c4 tempest-FlavorMetadataValidation-1850801997 tempest-FlavorMetadataValidation-1850801997-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_validate_metadata_-1302757940", "id": 1936653683, "os-flavor-access:is_public": "True"}} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 18:54:19.961931 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-d810ffe3-11c1-4123-862f-b7561ec443c4 tempest-FlavorMetadataValidation-1850801997 tempest-FlavorMetadataValidation-1850801997-project-admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 471 microversion: 2.86 time: 0.398743 Nov 01 18:54:19.963606 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 4/8] 10.222.0.13 () {62 vars in 1188 bytes} [Tue Nov 1 18:54:19 2022] POST /compute/v2.1/flavors => generated 471 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 01 18:54:20.048294 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-9be3b367-b247-4717-906a-220565d67b4d tempest-AggregatesAdminTestJSON-1442378289 tempest-AggregatesAdminTestJSON-1442378289-project-admin] Calling method '.version_select at 0x7f0ae3e3edc0>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:54:20.050363 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-9be3b367-b247-4717-906a-220565d67b4d tempest-AggregatesAdminTestJSON-1442378289 tempest-AggregatesAdminTestJSON-1442378289-project-admin] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:54:20.050684 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-9be3b367-b247-4717-906a-220565d67b4d tempest-AggregatesAdminTestJSON-1442378289 tempest-AggregatesAdminTestJSON-1442378289-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:54:20.051303 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-9be3b367-b247-4717-906a-220565d67b4d tempest-AggregatesAdminTestJSON-1442378289 tempest-AggregatesAdminTestJSON-1442378289-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:54:20.069677 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-9be3b367-b247-4717-906a-220565d67b4d tempest-AggregatesAdminTestJSON-1442378289 tempest-AggregatesAdminTestJSON-1442378289-project-admin] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:54:20.070357 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-9be3b367-b247-4717-906a-220565d67b4d tempest-AggregatesAdminTestJSON-1442378289 tempest-AggregatesAdminTestJSON-1442378289-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:54:20.070922 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-9be3b367-b247-4717-906a-220565d67b4d tempest-AggregatesAdminTestJSON-1442378289 tempest-AggregatesAdminTestJSON-1442378289-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:54:20.081921 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-9be3b367-b247-4717-906a-220565d67b4d tempest-AggregatesAdminTestJSON-1442378289 tempest-AggregatesAdminTestJSON-1442378289-project-admin] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:54:20.082584 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-9be3b367-b247-4717-906a-220565d67b4d tempest-AggregatesAdminTestJSON-1442378289 tempest-AggregatesAdminTestJSON-1442378289-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:54:20.083173 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-9be3b367-b247-4717-906a-220565d67b4d tempest-AggregatesAdminTestJSON-1442378289 tempest-AggregatesAdminTestJSON-1442378289-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:54:20.090487 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-9be3b367-b247-4717-906a-220565d67b4d tempest-AggregatesAdminTestJSON-1442378289 tempest-AggregatesAdminTestJSON-1442378289-project-admin] 10.222.0.13 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1503 microversion: 2.1 time: 0.275866 Nov 01 18:54:20.091532 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 5/9] 10.222.0.13 () {58 vars in 1167 bytes} [Tue Nov 1 18:54:19 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1503 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:54:20.098140 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-391d5c9d-73b6-49e4-a378-6438fbcafea1 tempest-AggregatesAdminTestV241-306352719 tempest-AggregatesAdminTestV241-306352719-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-863052-2"}} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 18:54:20.111040 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-391d5c9d-73b6-49e4-a378-6438fbcafea1 tempest-AggregatesAdminTestV241-306352719 tempest-AggregatesAdminTestV241-306352719-project-admin] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:54:20.111693 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-391d5c9d-73b6-49e4-a378-6438fbcafea1 tempest-AggregatesAdminTestV241-306352719 tempest-AggregatesAdminTestV241-306352719-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:54:20.112459 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-391d5c9d-73b6-49e4-a378-6438fbcafea1 tempest-AggregatesAdminTestV241-306352719 tempest-AggregatesAdminTestV241-306352719-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:54:20.260941 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-391d5c9d-73b6-49e4-a378-6438fbcafea1 tempest-AggregatesAdminTestV241-306352719 tempest-AggregatesAdminTestV241-306352719-project-admin] 10.222.0.13 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 298 microversion: 2.41 time: 0.167871 Nov 01 18:54:20.268825 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-d59d7f12-f374-4f41-99bf-8452db2e19c9 tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-900121501", "imageRef": "2d4a0047-1b9e-445f-8af8-1b5c9d93e881", "flavorRef": "452"}} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 18:54:20.269641 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 6/10] 10.222.0.13 () {62 vars in 1232 bytes} [Tue Nov 1 18:54:20 2022] POST /compute/v2.1/os-aggregates/1/action => generated 298 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 01 18:54:20.281719 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-3ac12bb6-803f-48dc-8eaf-46c3c4da7b65 tempest-FlavorMetadataValidation-1850801997 tempest-FlavorMetadataValidation-1850801997-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:cpu_policy": "shared", "foo:bar": "baz"}} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 18:54:20.530367 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-3ac12bb6-803f-48dc-8eaf-46c3c4da7b65 tempest-FlavorMetadataValidation-1850801997 tempest-FlavorMetadataValidation-1850801997-project-admin] 10.222.0.13 "POST /compute/v2.1/flavors/1936653683/os-extra_specs" status: 200 len: 62 microversion: 2.86 time: 0.257766 Nov 01 18:54:20.531135 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 7/11] 10.222.0.13 () {62 vars in 1265 bytes} [Tue Nov 1 18:54:20 2022] POST /compute/v2.1/flavors/1936653683/os-extra_specs => generated 62 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:54:20.536936 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-3993bbb4-db70-4e38-8b2d-018404f45cb8 tempest-AggregatesAdminTestV241-306352719 tempest-AggregatesAdminTestV241-306352719-project-admin] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:54:20.563643 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-3993bbb4-db70-4e38-8b2d-018404f45cb8 tempest-AggregatesAdminTestV241-306352719 tempest-AggregatesAdminTestV241-306352719-project-admin] 10.222.0.13 "DELETE /compute/v2.1/os-aggregates/1" status: 200 len: 0 microversion: 2.41 time: 0.030848 Nov 01 18:54:20.564366 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 8/12] 10.222.0.13 () {60 vars in 1193 bytes} [Tue Nov 1 18:54:20 2022] DELETE /compute/v2.1/os-aggregates/1 => generated 0 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 18:54:20.816014 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.network.neutron [None req-d59d7f12-f374-4f41-99bf-8452db2e19c9 tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] validate_networks() for None {{(pid=121403) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 01 18:54:20.900160 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-21b00f6f-bc8e-4894-9a33-ae9902989146 tempest-FlavorsAccessNegativeTestJSON-1324123958 tempest-FlavorsAccessNegativeTestJSON-1324123958-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-962097592", "id": 1885222344, "os-flavor-access:is_public": "False"}} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 18:54:20.957821 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-21b00f6f-bc8e-4894-9a33-ae9902989146 tempest-FlavorsAccessNegativeTestJSON-1324123958 tempest-FlavorsAccessNegativeTestJSON-1324123958-project-admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 438 microversion: 2.1 time: 0.387606 Nov 01 18:54:20.959337 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 9/13] 10.222.0.13 () {60 vars in 1147 bytes} [Tue Nov 1 18:54:20 2022] POST /compute/v2.1/flavors => generated 438 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 18:54:20.966958 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-a1a446f9-7212-4db1-bb6c-8887a35a667f tempest-FlavorMetadataValidation-1850801997 tempest-FlavorMetadataValidation-1850801997-project-admin] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:54:21.005580 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-a1a446f9-7212-4db1-bb6c-8887a35a667f tempest-FlavorMetadataValidation-1850801997 tempest-FlavorMetadataValidation-1850801997-project-admin] 10.222.0.13 "DELETE /compute/v2.1/flavors/1936653683" status: 202 len: 0 microversion: 2.86 time: 0.043224 Nov 01 18:54:21.007086 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 10/14] 10.222.0.13 () {60 vars in 1202 bytes} [Tue Nov 1 18:54:20 2022] DELETE /compute/v2.1/flavors/1936653683 => generated 0 bytes in 47 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 01 18:54:21.013734 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-0339452e-bc50-4416-adfd-68c7025e36c3 tempest-AggregatesAdminNegativeTestJSON-1815627383 tempest-AggregatesAdminNegativeTestJSON-1815627383-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-904365121"}} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 18:54:21.017942 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.objects.aggregate [None req-0339452e-bc50-4416-adfd-68c7025e36c3 tempest-AggregatesAdminNegativeTestJSON-1815627383 tempest-AggregatesAdminNegativeTestJSON-1815627383-project-admin] Generated uuid df1d0c23-70d4-4a17-b14b-68e79a2b2ba4 for aggregate {{(pid=121402) create /opt/stack/nova/nova/objects/aggregate.py:298}} Nov 01 18:54:21.051759 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-0339452e-bc50-4416-adfd-68c7025e36c3 tempest-AggregatesAdminNegativeTestJSON-1815627383 tempest-AggregatesAdminNegativeTestJSON-1815627383-project-admin] 10.222.0.13 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.042888 Nov 01 18:54:21.053325 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 11/15] 10.222.0.13 () {60 vars in 1164 bytes} [Tue Nov 1 18:54:21 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 18:54:21.064551 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-e3378728-0ffc-43de-9603-199813168951 tempest-FlavorsAccessNegativeTestJSON-1324123958 tempest-FlavorsAccessNegativeTestJSON-1324123958-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "2ab59873a8224b47ba0d6ca3ee7e021b"}} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 18:54:21.266371 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.virt.hardware [None req-d59d7f12-f374-4f41-99bf-8452db2e19c9 tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Flavor limits 0:0:0 {{(pid=121403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 01 18:54:21.266712 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.virt.hardware [None req-d59d7f12-f374-4f41-99bf-8452db2e19c9 tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Image limits 0:0:0 {{(pid=121403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 01 18:54:21.267190 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.virt.hardware [None req-d59d7f12-f374-4f41-99bf-8452db2e19c9 tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Flavor pref 0:0:0 {{(pid=121403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 01 18:54:21.267600 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.virt.hardware [None req-d59d7f12-f374-4f41-99bf-8452db2e19c9 tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Image pref 0:0:0 {{(pid=121403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 01 18:54:21.268010 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.virt.hardware [None req-d59d7f12-f374-4f41-99bf-8452db2e19c9 tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 01 18:54:21.284364 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d59d7f12-f374-4f41-99bf-8452db2e19c9 tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:54:21.284883 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d59d7f12-f374-4f41-99bf-8452db2e19c9 tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:54:21.285323 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d59d7f12-f374-4f41-99bf-8452db2e19c9 tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:54:21.286042 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d59d7f12-f374-4f41-99bf-8452db2e19c9 tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:54:21.286488 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d59d7f12-f374-4f41-99bf-8452db2e19c9 tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:54:21.287067 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d59d7f12-f374-4f41-99bf-8452db2e19c9 tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:54:21.320482 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.quota [None req-d59d7f12-f374-4f41-99bf-8452db2e19c9 tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Getting quotas for project c8e1248497284006a7acbb8169627ea5. Resources: {'cores', 'ram', 'instances'} {{(pid=121403) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 01 18:54:21.329665 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.quota [None req-d59d7f12-f374-4f41-99bf-8452db2e19c9 tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Getting quotas for user ce2e0d1828674809a3344a7a68f375c5 and project c8e1248497284006a7acbb8169627ea5. Resources: {'cores', 'ram', 'instances'} {{(pid=121403) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 01 18:54:21.344599 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-d59d7f12-f374-4f41-99bf-8452db2e19c9 tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Going to run 1 instances... {{(pid=121403) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 01 18:54:21.348207 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-d59d7f12-f374-4f41-99bf-8452db2e19c9 tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] [instance: 4ebac531-6f77-4108-afc9-0eccb86dee8b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2d4a0047-1b9e-445f-8af8-1b5c9d93e881',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121403) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 01 18:54:21.433591 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-d59d7f12-f374-4f41-99bf-8452db2e19c9 tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.466695 Nov 01 18:54:21.434479 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 5/16] 10.222.0.13 () {60 vars in 1147 bytes} [Tue Nov 1 18:54:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 1470 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 01 18:54:21.441560 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-e3378728-0ffc-43de-9603-199813168951 tempest-FlavorsAccessNegativeTestJSON-1324123958 tempest-FlavorsAccessNegativeTestJSON-1324123958-project-admin] 10.222.0.13 "POST /compute/v2.1/flavors/1885222344/action" status: 200 len: 97 microversion: 2.1 time: 0.386830 Nov 01 18:54:21.442657 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 12/17] 10.222.0.13 () {60 vars in 1200 bytes} [Tue Nov 1 18:54:21 2022] POST /compute/v2.1/flavors/1885222344/action => generated 97 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 01 18:54:21.454839 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-db190892-9ecf-4ac3-925f-303368843a9e tempest-FlavorMetadataValidation-1850801997 tempest-FlavorMetadataValidation-1850801997-project-admin] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:54:21.464555 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-b391153f-fe2f-4cfd-b376-510e01c73db3 tempest-AggregatesAdminNegativeTestJSON-1815627383 tempest-AggregatesAdminNegativeTestJSON-1815627383-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-863052-2"}} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 18:54:21.498559 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b391153f-fe2f-4cfd-b376-510e01c73db3 tempest-AggregatesAdminNegativeTestJSON-1815627383 tempest-AggregatesAdminNegativeTestJSON-1815627383-project-admin] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:54:21.505442 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b391153f-fe2f-4cfd-b376-510e01c73db3 tempest-AggregatesAdminNegativeTestJSON-1815627383 tempest-AggregatesAdminNegativeTestJSON-1815627383-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:54:21.506167 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b391153f-fe2f-4cfd-b376-510e01c73db3 tempest-AggregatesAdminNegativeTestJSON-1815627383 tempest-AggregatesAdminNegativeTestJSON-1815627383-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:54:21.515224 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-db190892-9ecf-4ac3-925f-303368843a9e tempest-FlavorMetadataValidation-1850801997 tempest-FlavorMetadataValidation-1850801997-project-admin] 10.222.0.13 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.86 time: 0.078138 Nov 01 18:54:21.516984 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 6/18] 10.222.0.13 () {60 vars in 1187 bytes} [Tue Nov 1 18:54:21 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 18:54:21.524532 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-9cd1f28d-8c15-4783-a7f5-9b91a1a3af87 tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:54:21.525234 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-9cd1f28d-8c15-4783-a7f5-9b91a1a3af87 tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] [instance: 4ebac531-6f77-4108-afc9-0eccb86dee8b] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:54:21.687973 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-9cd1f28d-8c15-4783-a7f5-9b91a1a3af87 tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce2e0d1828674809a3344a7a68f375c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8e1248497284006a7acbb8169627ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:54:21.713815 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-9cd1f28d-8c15-4783-a7f5-9b91a1a3af87 tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] 10.222.0.13 "GET /compute/v2.1/servers/4ebac531-6f77-4108-afc9-0eccb86dee8b" status: 200 len: 1219 microversion: 2.1 time: 0.195199 Nov 01 18:54:21.714104 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-b391153f-fe2f-4cfd-b376-510e01c73db3 tempest-AggregatesAdminNegativeTestJSON-1815627383 tempest-AggregatesAdminNegativeTestJSON-1815627383-project-admin] 10.222.0.13 "POST /compute/v2.1/os-aggregates/2/action" status: 200 len: 241 microversion: 2.1 time: 0.260466 Nov 01 18:54:21.715975 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 7/19] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:54:21 2022] GET /compute/v2.1/servers/4ebac531-6f77-4108-afc9-0eccb86dee8b => generated 1219 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:54:21.721439 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-47602621-6597-4bb6-9213-b5f33d36790f tempest-FlavorsAccessNegativeTestJSON-1324123958 tempest-FlavorsAccessNegativeTestJSON-1324123958-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "2ab59873a8224b47ba0d6ca3ee7e021b"}} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 18:54:21.725263 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 13/20] 10.222.0.13 () {60 vars in 1191 bytes} [Tue Nov 1 18:54:21 2022] POST /compute/v2.1/os-aggregates/2/action => generated 241 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 18:54:21.737457 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-cecc9842-a01f-4a4b-9d5c-f26e788e541a tempest-AggregatesAdminNegativeTestJSON-1815627383 tempest-AggregatesAdminNegativeTestJSON-1815627383-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-863052-2"}} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 18:54:21.749191 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-cecc9842-a01f-4a4b-9d5c-f26e788e541a tempest-AggregatesAdminNegativeTestJSON-1815627383 tempest-AggregatesAdminNegativeTestJSON-1815627383-project-admin] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:54:21.749674 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-cecc9842-a01f-4a4b-9d5c-f26e788e541a tempest-AggregatesAdminNegativeTestJSON-1815627383 tempest-AggregatesAdminNegativeTestJSON-1815627383-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:54:21.750122 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-cecc9842-a01f-4a4b-9d5c-f26e788e541a tempest-AggregatesAdminNegativeTestJSON-1815627383 tempest-AggregatesAdminNegativeTestJSON-1815627383-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:54:21.782246 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.wsgi [None req-cecc9842-a01f-4a4b-9d5c-f26e788e541a tempest-AggregatesAdminNegativeTestJSON-1815627383 tempest-AggregatesAdminNegativeTestJSON-1815627383-project-admin] HTTP exception thrown: Aggregate 2 already has host n-h1-863052-2. Nov 01 18:54:21.798088 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-cecc9842-a01f-4a4b-9d5c-f26e788e541a tempest-AggregatesAdminNegativeTestJSON-1815627383 tempest-AggregatesAdminNegativeTestJSON-1815627383-project-admin] Request method failure captured: Nov 01 18:54:21.798088 n-d-863052-2 devstack@n-api.service[121402]: request: POST /compute/v2.1/os-aggregates/2/action HTTP/1.1 Nov 01 18:54:21.798088 n-d-863052-2 devstack@n-api.service[121402]: Accept: application/json Nov 01 18:54:21.798088 n-d-863052-2 devstack@n-api.service[121402]: Accept-Encoding: identity Nov 01 18:54:21.798088 n-d-863052-2 devstack@n-api.service[121402]: Connection: close Nov 01 18:54:21.798088 n-d-863052-2 devstack@n-api.service[121402]: Content-Length: 39 Nov 01 18:54:21.798088 n-d-863052-2 devstack@n-api.service[121402]: Content-Type: application/json Nov 01 18:54:21.798088 n-d-863052-2 devstack@n-api.service[121402]: Host: 10.222.0.13 Nov 01 18:54:21.798088 n-d-863052-2 devstack@n-api.service[121402]: Openstack-System-Scope: None Nov 01 18:54:21.798088 n-d-863052-2 devstack@n-api.service[121402]: User-Agent: python-urllib3/1.26.12 Nov 01 18:54:21.798088 n-d-863052-2 devstack@n-api.service[121402]: X-Auth-Token: gAAAAABjYWtaOKWCV3M4Q9P_m1t8bGgxDQkcvYwf_Ps7PzARRUub1dlRxoN3WEeASuv14dc3CyCQ8TmOXer2bxb0hUPpMshCv0Cmn5BRA-Qnk1qDPphkl5oircZzNZGMuZgA5lMqzCR8y9Yywlv7fSmfpCEiAjI39vME7oMbjgkHjO3679hxVVg Nov 01 18:54:21.798088 n-d-863052-2 devstack@n-api.service[121402]: X-Domain-Id: None Nov 01 18:54:21.798088 n-d-863052-2 devstack@n-api.service[121402]: X-Domain-Name: None Nov 01 18:54:21.798088 n-d-863052-2 devstack@n-api.service[121402]: X-Identity-Status: Confirmed Nov 01 18:54:21.798088 n-d-863052-2 devstack@n-api.service[121402]: X-Is-Admin-Project: True Nov 01 18:54:21.798088 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Domain-Id: default Nov 01 18:54:21.798088 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Domain-Name: Default Nov 01 18:54:21.798088 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Id: 1000a18d48e74513aa3f04bb3f4446ff Nov 01 18:54:21.798088 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1815627383 Nov 01 18:54:21.798088 n-d-863052-2 devstack@n-api.service[121402]: X-Role: admin,member,reader Nov 01 18:54:21.798088 n-d-863052-2 devstack@n-api.service[121402]: X-Roles: admin,member,reader Nov 01 18:54:21.799420 n-d-863052-2 devstack@n-api.service[121402]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/1000a18d48e74513aa3f04bb3f4446ff"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/1000a18d48e74513aa3f04bb3f4446ff"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_1000a18d48e74513aa3f04bb3f4446ff", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/1000a18d48e74513aa3f04bb3f4446ff"}]}] Nov 01 18:54:21.799420 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1815627383 Nov 01 18:54:21.799420 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant-Id: 1000a18d48e74513aa3f04bb3f4446ff Nov 01 18:54:21.799420 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1815627383 Nov 01 18:54:21.799420 n-d-863052-2 devstack@n-api.service[121402]: X-User: tempest-AggregatesAdminNegativeTestJSON-1815627383-project-admin Nov 01 18:54:21.799420 n-d-863052-2 devstack@n-api.service[121402]: X-User-Domain-Id: default Nov 01 18:54:21.799420 n-d-863052-2 devstack@n-api.service[121402]: X-User-Domain-Name: Default Nov 01 18:54:21.799420 n-d-863052-2 devstack@n-api.service[121402]: X-User-Id: c9f24a2ce22a47d28828869433d41de9 Nov 01 18:54:21.799420 n-d-863052-2 devstack@n-api.service[121402]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1815627383-project-admin Nov 01 18:54:21.799420 n-d-863052-2 devstack@n-api.service[121402]: Nov 01 18:54:21.799420 n-d-863052-2 devstack@n-api.service[121402]: {"add_host": {"host": "n-h1-863052-2"}} Nov 01 18:54:21.799420 n-d-863052-2 devstack@n-api.service[121402]: method: > Nov 01 18:54:21.799420 n-d-863052-2 devstack@n-api.service[121402]: exception: Aggregate 2 already has host n-h1-863052-2. Nov 01 18:54:21.800161 n-d-863052-2 devstack@n-api.service[121402]: action_args: {'id': '2', 'body': {'add_host': {'host': 'n-h1-863052-2'}}} Nov 01 18:54:21.800161 n-d-863052-2 devstack@n-api.service[121402]: {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 01 18:54:21.800161 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:54:21.800161 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Nov 01 18:54:21.800161 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Nov 01 18:54:21.800161 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Nov 01 18:54:21.800161 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Nov 01 18:54:21.800161 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Nov 01 18:54:21.800161 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi result = self._query(query) Nov 01 18:54:21.800161 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Nov 01 18:54:21.800161 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi conn.query(q) Nov 01 18:54:21.800161 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Nov 01 18:54:21.800161 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Nov 01 18:54:21.800161 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Nov 01 18:54:21.800161 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi result.read() Nov 01 18:54:21.800161 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Nov 01 18:54:21.800161 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Nov 01 18:54:21.800161 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Nov 01 18:54:21.800161 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Nov 01 18:54:21.801969 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Nov 01 18:54:21.801969 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Nov 01 18:54:21.801969 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Nov 01 18:54:21.801969 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Nov 01 18:54:21.801969 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry 'n-h1-863052-2-2' for key 'aggregate_hosts.uniq_aggregate_hosts0host0aggregate_id'") Nov 01 18:54:21.801969 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 18:54:21.801969 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Nov 01 18:54:21.801969 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 18:54:21.801969 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:54:21.801969 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 73, in _host_add_to_db Nov 01 18:54:21.801969 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi host_ref.save(context.session) Nov 01 18:54:21.801969 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Nov 01 18:54:21.801969 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi session.flush() Nov 01 18:54:21.801969 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Nov 01 18:54:21.801969 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi self._flush(objects) Nov 01 18:54:21.801969 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Nov 01 18:54:21.801969 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Nov 01 18:54:21.801969 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Nov 01 18:54:21.801969 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi compat.raise_( Nov 01 18:54:21.802838 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Nov 01 18:54:21.802838 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise exception Nov 01 18:54:21.802838 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Nov 01 18:54:21.802838 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi flush_context.execute() Nov 01 18:54:21.802838 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Nov 01 18:54:21.802838 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi rec.execute(self) Nov 01 18:54:21.802838 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Nov 01 18:54:21.802838 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Nov 01 18:54:21.802838 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Nov 01 18:54:21.802838 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Nov 01 18:54:21.802838 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Nov 01 18:54:21.802838 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Nov 01 18:54:21.802838 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Nov 01 18:54:21.802838 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Nov 01 18:54:21.802838 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Nov 01 18:54:21.802838 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Nov 01 18:54:21.802838 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Nov 01 18:54:21.802838 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Nov 01 18:54:21.803910 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Nov 01 18:54:21.803910 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Nov 01 18:54:21.803910 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Nov 01 18:54:21.803910 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Nov 01 18:54:21.803910 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Nov 01 18:54:21.803910 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise exception Nov 01 18:54:21.803910 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Nov 01 18:54:21.803910 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Nov 01 18:54:21.803910 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Nov 01 18:54:21.803910 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Nov 01 18:54:21.803910 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Nov 01 18:54:21.803910 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi result = self._query(query) Nov 01 18:54:21.803910 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Nov 01 18:54:21.803910 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi conn.query(q) Nov 01 18:54:21.803910 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Nov 01 18:54:21.803910 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Nov 01 18:54:21.803910 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Nov 01 18:54:21.803910 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi result.read() Nov 01 18:54:21.804848 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Nov 01 18:54:21.804848 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Nov 01 18:54:21.804848 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Nov 01 18:54:21.804848 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Nov 01 18:54:21.804848 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Nov 01 18:54:21.804848 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Nov 01 18:54:21.804848 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Nov 01 18:54:21.804848 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Nov 01 18:54:21.804848 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'n-h1-863052-2-2' for key 'aggregate_hosts.uniq_aggregate_hosts0host0aggregate_id'") Nov 01 18:54:21.804848 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO aggregate_hosts (created_at, updated_at, host, aggregate_id) VALUES (%(created_at)s, %(updated_at)s, %(host)s, %(aggregate_id)s)] Nov 01 18:54:21.804848 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 11, 1, 18, 54, 21, 767720), 'updated_at': None, 'host': 'n-h1-863052-2', 'aggregate_id': 2}] Nov 01 18:54:21.804848 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Nov 01 18:54:21.804848 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 18:54:21.804848 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 18:54:21.804848 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 18:54:21.804848 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:54:21.804848 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 180, in _add_host Nov 01 18:54:21.805792 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi aggregate = self.api.add_host_to_aggregate(context, id, host) Nov 01 18:54:21.805792 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Nov 01 18:54:21.805792 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Nov 01 18:54:21.805792 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 01 18:54:21.805792 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 01 18:54:21.805792 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 01 18:54:21.805792 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise self.value Nov 01 18:54:21.805792 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Nov 01 18:54:21.805792 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Nov 01 18:54:21.805792 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6641, in add_host_to_aggregate Nov 01 18:54:21.805792 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi aggregate.add_host(host_name) Nov 01 18:54:21.805792 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Nov 01 18:54:21.805792 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Nov 01 18:54:21.805792 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 395, in add_host Nov 01 18:54:21.805792 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi _host_add_to_db(self._context, self.id, host) Nov 01 18:54:21.805792 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 76, in _host_add_to_db Nov 01 18:54:21.805792 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise exception.AggregateHostExists(host=host, Nov 01 18:54:21.805792 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi nova.exception.AggregateHostExists: Aggregate 2 already has host n-h1-863052-2. Nov 01 18:54:21.805792 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 18:54:21.805792 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 18:54:21.807539 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 18:54:21.807539 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:54:21.807539 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 18:54:21.807539 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 18:54:21.807539 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 01 18:54:21.807539 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 01 18:54:21.807539 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 01 18:54:21.807539 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 01 18:54:21.807539 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 01 18:54:21.807539 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 01 18:54:21.807539 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 187, in _add_host Nov 01 18:54:21.807539 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise exc.HTTPConflict(explanation=e.format_message()) Nov 01 18:54:21.807539 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Aggregate 2 already has host n-h1-863052-2. Nov 01 18:54:21.807539 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 18:54:21.807539 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 18:54:21.807539 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 18:54:21.807539 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:54:21.807539 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 18:54:21.807539 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 18:54:21.807539 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 01 18:54:21.807539 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 01 18:54:21.809829 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 2 already has host n-h1-863052-2. Nov 01 18:54:21.809829 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 18:54:21.809829 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-cecc9842-a01f-4a4b-9d5c-f26e788e541a tempest-AggregatesAdminNegativeTestJSON-1815627383 tempest-AggregatesAdminNegativeTestJSON-1815627383-project-admin] Returning 409 to user: Aggregate 2 already has host n-h1-863052-2. {{(pid=121402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 01 18:54:21.809829 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-cecc9842-a01f-4a4b-9d5c-f26e788e541a tempest-AggregatesAdminNegativeTestJSON-1815627383 tempest-AggregatesAdminNegativeTestJSON-1815627383-project-admin] 10.222.0.13 "POST /compute/v2.1/os-aggregates/2/action" status: 409 len: 95 microversion: 2.1 time: 0.066227 Nov 01 18:54:21.809829 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 14/21] 10.222.0.13 () {60 vars in 1191 bytes} [Tue Nov 1 18:54:21 2022] POST /compute/v2.1/os-aggregates/2/action => generated 95 bytes in 68 msecs (HTTP/1.1 409) 9 headers in 377 bytes (2 switches on core 0) Nov 01 18:54:21.814001 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-4ed0089f-bb9e-4fe0-9488-9202d9a875b7 tempest-AggregatesAdminNegativeTestJSON-1815627383 tempest-AggregatesAdminNegativeTestJSON-1815627383-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-863052-2"}} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 18:54:21.826500 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-4ed0089f-bb9e-4fe0-9488-9202d9a875b7 tempest-AggregatesAdminNegativeTestJSON-1815627383 tempest-AggregatesAdminNegativeTestJSON-1815627383-project-admin] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:54:21.827104 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-4ed0089f-bb9e-4fe0-9488-9202d9a875b7 tempest-AggregatesAdminNegativeTestJSON-1815627383 tempest-AggregatesAdminNegativeTestJSON-1815627383-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:54:21.827784 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-4ed0089f-bb9e-4fe0-9488-9202d9a875b7 tempest-AggregatesAdminNegativeTestJSON-1815627383 tempest-AggregatesAdminNegativeTestJSON-1815627383-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:54:21.974709 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-4ed0089f-bb9e-4fe0-9488-9202d9a875b7 tempest-AggregatesAdminNegativeTestJSON-1815627383 tempest-AggregatesAdminNegativeTestJSON-1815627383-project-admin] 10.222.0.13 "POST /compute/v2.1/os-aggregates/2/action" status: 200 len: 226 microversion: 2.1 time: 0.164568 Nov 01 18:54:21.976475 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 15/22] 10.222.0.13 () {60 vars in 1191 bytes} [Tue Nov 1 18:54:21 2022] POST /compute/v2.1/os-aggregates/2/action => generated 226 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 18:54:21.991452 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-de4a22a9-7b95-4ab9-a17e-20aacab55d73 tempest-AggregatesAdminNegativeTestJSON-1815627383 tempest-AggregatesAdminNegativeTestJSON-1815627383-project-admin] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:54:22.037203 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-de4a22a9-7b95-4ab9-a17e-20aacab55d73 tempest-AggregatesAdminNegativeTestJSON-1815627383 tempest-AggregatesAdminNegativeTestJSON-1815627383-project-admin] 10.222.0.13 "DELETE /compute/v2.1/os-aggregates/2" status: 200 len: 0 microversion: 2.1 time: 0.050819 Nov 01 18:54:22.038868 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 16/23] 10.222.0.13 () {58 vars in 1152 bytes} [Tue Nov 1 18:54:21 2022] DELETE /compute/v2.1/os-aggregates/2 => generated 0 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Nov 01 18:54:22.054986 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-e383430c-61de-4e01-8e00-dbaa7658bf31 tempest-AggregatesAdminNegativeTestJSON-1815627383 tempest-AggregatesAdminNegativeTestJSON-1815627383-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-284862502"}} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 18:54:22.062569 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.objects.aggregate [None req-e383430c-61de-4e01-8e00-dbaa7658bf31 tempest-AggregatesAdminNegativeTestJSON-1815627383 tempest-AggregatesAdminNegativeTestJSON-1815627383-project-admin] Generated uuid 7cf3cd36-e234-4db6-a50a-49248719899f for aggregate {{(pid=121402) create /opt/stack/nova/nova/objects/aggregate.py:298}} Nov 01 18:54:22.080240 n-d-863052-2 devstack@n-api.service[121402]: DEBUG dbcounter [-] [121402] Writing DB stats nova_api:SELECT=77,nova_api:UPDATE=1,nova_api:INSERT=9,nova_api:DELETE=9,nova_api:SAVEPOINT=2,nova_api:RELEASE=2 {{(pid=121402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 18:54:22.098404 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-e383430c-61de-4e01-8e00-dbaa7658bf31 tempest-AggregatesAdminNegativeTestJSON-1815627383 tempest-AggregatesAdminNegativeTestJSON-1815627383-project-admin] 10.222.0.13 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.047470 Nov 01 18:54:22.099774 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 17/24] 10.222.0.13 () {60 vars in 1164 bytes} [Tue Nov 1 18:54:22 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 18:54:22.106178 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-713e2d99-0070-4646-a162-4180a294614e tempest-AggregatesAdminTestJSON-1442378289 tempest-AggregatesAdminTestJSON-1442378289-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-2016780767", "name": "tempest-test_aggregate-1179721575"}} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 18:54:22.127419 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.objects.aggregate [None req-713e2d99-0070-4646-a162-4180a294614e tempest-AggregatesAdminTestJSON-1442378289 tempest-AggregatesAdminTestJSON-1442378289-project-admin] Generated uuid f0ff97ea-5979-4ec5-94b9-ee7ab468db1f for aggregate {{(pid=121402) create /opt/stack/nova/nova/objects/aggregate.py:298}} Nov 01 18:54:22.211121 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-713e2d99-0070-4646-a162-4180a294614e tempest-AggregatesAdminTestJSON-1442378289 tempest-AggregatesAdminTestJSON-1442378289-project-admin] 10.222.0.13 "POST /compute/v2.1/os-aggregates" status: 200 len: 222 microversion: 2.1 time: 0.109906 Nov 01 18:54:22.211695 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 18/25] 10.222.0.13 () {60 vars in 1165 bytes} [Tue Nov 1 18:54:22 2022] POST /compute/v2.1/os-aggregates => generated 222 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 18:54:22.416897 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.wsgi [None req-47602621-6597-4bb6-9213-b5f33d36790f tempest-FlavorsAccessNegativeTestJSON-1324123958 tempest-FlavorsAccessNegativeTestJSON-1324123958-project-admin] HTTP exception thrown: Flavor access already exists for flavor 16 and project 2ab59873a8224b47ba0d6ca3ee7e021b combination. Nov 01 18:54:22.452631 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-47602621-6597-4bb6-9213-b5f33d36790f tempest-FlavorsAccessNegativeTestJSON-1324123958 tempest-FlavorsAccessNegativeTestJSON-1324123958-project-admin] Request method failure captured: Nov 01 18:54:22.452631 n-d-863052-2 devstack@n-api.service[121403]: request: POST /compute/v2.1/flavors/1885222344/action HTTP/1.1 Nov 01 18:54:22.452631 n-d-863052-2 devstack@n-api.service[121403]: Accept: application/json Nov 01 18:54:22.452631 n-d-863052-2 devstack@n-api.service[121403]: Accept-Encoding: identity Nov 01 18:54:22.452631 n-d-863052-2 devstack@n-api.service[121403]: Connection: close Nov 01 18:54:22.452631 n-d-863052-2 devstack@n-api.service[121403]: Content-Length: 67 Nov 01 18:54:22.452631 n-d-863052-2 devstack@n-api.service[121403]: Content-Type: application/json Nov 01 18:54:22.452631 n-d-863052-2 devstack@n-api.service[121403]: Host: 10.222.0.13 Nov 01 18:54:22.452631 n-d-863052-2 devstack@n-api.service[121403]: Openstack-System-Scope: None Nov 01 18:54:22.452631 n-d-863052-2 devstack@n-api.service[121403]: User-Agent: python-urllib3/1.26.12 Nov 01 18:54:22.452631 n-d-863052-2 devstack@n-api.service[121403]: X-Auth-Token: gAAAAABjYWtaKDQxU1HAN-hE8muWbrn8LFATSrLppCxxaHhX1W3GPdjcJz-HNjcSHGtohMgWFTY1vb-P8ceC9A1AJ6rdpZpDgg90gSK5oiXVWFCK5BToKuloW0fFWUz2FatmiKzGgTb1cjaDcwFblLF7bl0QIErdL-JSmnWQMFz6HH7eRbFS_Y8 Nov 01 18:54:22.452631 n-d-863052-2 devstack@n-api.service[121403]: X-Domain-Id: None Nov 01 18:54:22.452631 n-d-863052-2 devstack@n-api.service[121403]: X-Domain-Name: None Nov 01 18:54:22.452631 n-d-863052-2 devstack@n-api.service[121403]: X-Identity-Status: Confirmed Nov 01 18:54:22.452631 n-d-863052-2 devstack@n-api.service[121403]: X-Is-Admin-Project: True Nov 01 18:54:22.452631 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Domain-Id: default Nov 01 18:54:22.452631 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Domain-Name: Default Nov 01 18:54:22.452631 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Id: 68a228081a16469ca92f0f8a56dd05e9 Nov 01 18:54:22.452631 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-1324123958 Nov 01 18:54:22.452631 n-d-863052-2 devstack@n-api.service[121403]: X-Role: admin,member,reader Nov 01 18:54:22.452631 n-d-863052-2 devstack@n-api.service[121403]: X-Roles: admin,member,reader Nov 01 18:54:22.453728 n-d-863052-2 devstack@n-api.service[121403]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/68a228081a16469ca92f0f8a56dd05e9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/68a228081a16469ca92f0f8a56dd05e9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_68a228081a16469ca92f0f8a56dd05e9", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/68a228081a16469ca92f0f8a56dd05e9"}]}] Nov 01 18:54:22.453728 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-1324123958 Nov 01 18:54:22.453728 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant-Id: 68a228081a16469ca92f0f8a56dd05e9 Nov 01 18:54:22.453728 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-1324123958 Nov 01 18:54:22.453728 n-d-863052-2 devstack@n-api.service[121403]: X-User: tempest-FlavorsAccessNegativeTestJSON-1324123958-project-admin Nov 01 18:54:22.453728 n-d-863052-2 devstack@n-api.service[121403]: X-User-Domain-Id: default Nov 01 18:54:22.453728 n-d-863052-2 devstack@n-api.service[121403]: X-User-Domain-Name: Default Nov 01 18:54:22.453728 n-d-863052-2 devstack@n-api.service[121403]: X-User-Id: ea9642617d114bc3ac329691a82bd5d0 Nov 01 18:54:22.453728 n-d-863052-2 devstack@n-api.service[121403]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-1324123958-project-admin Nov 01 18:54:22.453728 n-d-863052-2 devstack@n-api.service[121403]: Nov 01 18:54:22.453728 n-d-863052-2 devstack@n-api.service[121403]: {"addTenantAccess": {"tenant": "2ab59873a8224b47ba0d6ca3ee7e021b"}} Nov 01 18:54:22.453728 n-d-863052-2 devstack@n-api.service[121403]: method: > Nov 01 18:54:22.454299 n-d-863052-2 devstack@n-api.service[121403]: exception: Flavor access already exists for flavor 16 and project 2ab59873a8224b47ba0d6ca3ee7e021b combination. Nov 01 18:54:22.454299 n-d-863052-2 devstack@n-api.service[121403]: action_args: {'id': '1885222344', 'body': {'addTenantAccess': {'tenant': '2ab59873a8224b47ba0d6ca3ee7e021b'}}} Nov 01 18:54:22.454299 n-d-863052-2 devstack@n-api.service[121403]: {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 01 18:54:22.454299 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:54:22.454299 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Nov 01 18:54:22.454299 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Nov 01 18:54:22.454299 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Nov 01 18:54:22.454299 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Nov 01 18:54:22.454299 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Nov 01 18:54:22.454299 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi result = self._query(query) Nov 01 18:54:22.454299 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Nov 01 18:54:22.454299 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi conn.query(q) Nov 01 18:54:22.454299 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Nov 01 18:54:22.454299 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Nov 01 18:54:22.454299 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Nov 01 18:54:22.454299 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi result.read() Nov 01 18:54:22.454299 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Nov 01 18:54:22.454299 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Nov 01 18:54:22.455217 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Nov 01 18:54:22.455217 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Nov 01 18:54:22.455217 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Nov 01 18:54:22.455217 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Nov 01 18:54:22.455217 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Nov 01 18:54:22.455217 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Nov 01 18:54:22.455217 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry '16-2ab59873a8224b47ba0d6ca3ee7e021b' for key 'flavor_projects.uniq_flavor_projects0flavor_id0project_id'") Nov 01 18:54:22.455217 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 18:54:22.455217 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Nov 01 18:54:22.455217 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 18:54:22.455217 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:54:22.455217 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 73, in _flavor_add_project Nov 01 18:54:22.455217 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi project.save(context.session) Nov 01 18:54:22.455217 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Nov 01 18:54:22.455217 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi session.flush() Nov 01 18:54:22.455217 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Nov 01 18:54:22.455217 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi self._flush(objects) Nov 01 18:54:22.455217 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Nov 01 18:54:22.455217 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Nov 01 18:54:22.456096 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Nov 01 18:54:22.456096 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi compat.raise_( Nov 01 18:54:22.456096 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Nov 01 18:54:22.456096 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise exception Nov 01 18:54:22.456096 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Nov 01 18:54:22.456096 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi flush_context.execute() Nov 01 18:54:22.456096 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Nov 01 18:54:22.456096 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi rec.execute(self) Nov 01 18:54:22.456096 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Nov 01 18:54:22.456096 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Nov 01 18:54:22.456096 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Nov 01 18:54:22.456096 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Nov 01 18:54:22.456096 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Nov 01 18:54:22.456096 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Nov 01 18:54:22.456096 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Nov 01 18:54:22.456096 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Nov 01 18:54:22.456096 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Nov 01 18:54:22.456096 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Nov 01 18:54:22.457172 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Nov 01 18:54:22.457172 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Nov 01 18:54:22.457172 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Nov 01 18:54:22.457172 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Nov 01 18:54:22.457172 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Nov 01 18:54:22.457172 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Nov 01 18:54:22.457172 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Nov 01 18:54:22.457172 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise exception Nov 01 18:54:22.457172 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Nov 01 18:54:22.457172 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Nov 01 18:54:22.457172 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Nov 01 18:54:22.457172 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Nov 01 18:54:22.457172 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Nov 01 18:54:22.457172 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi result = self._query(query) Nov 01 18:54:22.457172 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Nov 01 18:54:22.457172 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi conn.query(q) Nov 01 18:54:22.457172 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Nov 01 18:54:22.457172 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Nov 01 18:54:22.457998 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Nov 01 18:54:22.457998 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi result.read() Nov 01 18:54:22.457998 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Nov 01 18:54:22.457998 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Nov 01 18:54:22.457998 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Nov 01 18:54:22.457998 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Nov 01 18:54:22.457998 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Nov 01 18:54:22.457998 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Nov 01 18:54:22.457998 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Nov 01 18:54:22.457998 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Nov 01 18:54:22.457998 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '16-2ab59873a8224b47ba0d6ca3ee7e021b' for key 'flavor_projects.uniq_flavor_projects0flavor_id0project_id'") Nov 01 18:54:22.457998 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO flavor_projects (created_at, updated_at, flavor_id, project_id) VALUES (%(created_at)s, %(updated_at)s, %(flavor_id)s, %(project_id)s)] Nov 01 18:54:22.457998 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 11, 1, 18, 54, 22, 407774), 'updated_at': None, 'flavor_id': 16, 'project_id': '2ab59873a8224b47ba0d6ca3ee7e021b'}] Nov 01 18:54:22.457998 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Nov 01 18:54:22.457998 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 18:54:22.457998 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 18:54:22.457998 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 18:54:22.458911 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:54:22.458911 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 79, in _add_tenant_access Nov 01 18:54:22.458911 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi flavor.add_access(tenant) Nov 01 18:54:22.458911 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Nov 01 18:54:22.458911 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Nov 01 18:54:22.458911 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 411, in add_access Nov 01 18:54:22.458911 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi self._add_access(project_id) Nov 01 18:54:22.458911 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 404, in _add_access Nov 01 18:54:22.458911 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi self._flavor_add_project(self._context, self.id, project_id) Nov 01 18:54:22.458911 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 397, in _flavor_add_project Nov 01 18:54:22.458911 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return _flavor_add_project(context, flavor_id, project_id) Nov 01 18:54:22.458911 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Nov 01 18:54:22.458911 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Nov 01 18:54:22.458911 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 75, in _flavor_add_project Nov 01 18:54:22.458911 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise exception.FlavorAccessExists(flavor_id=flavor_id, Nov 01 18:54:22.458911 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi nova.exception.FlavorAccessExists: Flavor access already exists for flavor 16 and project 2ab59873a8224b47ba0d6ca3ee7e021b combination. Nov 01 18:54:22.458911 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 18:54:22.458911 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 18:54:22.458911 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 18:54:22.459808 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:54:22.459808 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 18:54:22.459808 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 18:54:22.459808 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 01 18:54:22.459808 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 01 18:54:22.459808 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 01 18:54:22.459808 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 01 18:54:22.459808 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 01 18:54:22.459808 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 01 18:54:22.459808 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 83, in _add_tenant_access Nov 01 18:54:22.459808 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=err.format_message()) Nov 01 18:54:22.459808 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Flavor access already exists for flavor 16 and project 2ab59873a8224b47ba0d6ca3ee7e021b combination. Nov 01 18:54:22.459808 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 18:54:22.459808 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 18:54:22.459808 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 18:54:22.459808 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:54:22.459808 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 18:54:22.459808 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 18:54:22.459808 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 01 18:54:22.459808 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 01 18:54:22.465091 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor access already exists for flavor 16 and project 2ab59873a8224b47ba0d6ca3ee7e021b combination. Nov 01 18:54:22.465091 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 18:54:22.465091 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-47602621-6597-4bb6-9213-b5f33d36790f tempest-FlavorsAccessNegativeTestJSON-1324123958 tempest-FlavorsAccessNegativeTestJSON-1324123958-project-admin] Returning 409 to user: Flavor access already exists for flavor 16 and project 2ab59873a8224b47ba0d6ca3ee7e021b combination. {{(pid=121403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 01 18:54:22.465091 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-47602621-6597-4bb6-9213-b5f33d36790f tempest-FlavorsAccessNegativeTestJSON-1324123958 tempest-FlavorsAccessNegativeTestJSON-1324123958-project-admin] 10.222.0.13 "POST /compute/v2.1/flavors/1885222344/action" status: 409 len: 152 microversion: 2.1 time: 0.736975 Nov 01 18:54:22.465091 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 8/26] 10.222.0.13 () {60 vars in 1200 bytes} [Tue Nov 1 18:54:21 2022] POST /compute/v2.1/flavors/1885222344/action => generated 152 bytes in 741 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Nov 01 18:54:22.486520 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-aa0706c2-65e4-4608-ac60-ffc4f6561621 tempest-AggregatesAdminTestJSON-1442378289 tempest-AggregatesAdminTestJSON-1442378289-project-admin] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:54:22.519874 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-aa0706c2-65e4-4608-ac60-ffc4f6561621 tempest-AggregatesAdminTestJSON-1442378289 tempest-AggregatesAdminTestJSON-1442378289-project-admin] 10.222.0.13 "GET /compute/v2.1/os-aggregates" status: 200 len: 516 microversion: 2.1 time: 0.060451 Nov 01 18:54:22.521821 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 9/27] 10.222.0.13 () {58 vars in 1143 bytes} [Tue Nov 1 18:54:22 2022] GET /compute/v2.1/os-aggregates => generated 516 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 18:54:22.528459 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-8cdf379f-4533-49ee-a09f-6dff122d39c5 tempest-FlavorsAccessNegativeTestJSON-1324123958 tempest-FlavorsAccessNegativeTestJSON-1324123958-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "2ab59873a8224b47ba0d6ca3ee7e021b"}} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 18:54:22.592243 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-8c3d8856-fd50-4cc2-bc9c-ae8d3b4d1010 tempest-AggregatesAdminNegativeTestJSON-701968823 tempest-AggregatesAdminNegativeTestJSON-701968823-project] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-863052-2"}} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 18:54:22.599743 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-8c3d8856-fd50-4cc2-bc9c-ae8d3b4d1010 tempest-AggregatesAdminNegativeTestJSON-701968823 tempest-AggregatesAdminNegativeTestJSON-701968823-project] Policy check for os_compute_api:os-aggregates:add_host failed with credentials {'is_admin': False, 'user_id': '050138637ab247cabfa21c187e4463dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440456c174424b5c8a796711a95a8b69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:54:22.607221 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-8c3d8856-fd50-4cc2-bc9c-ae8d3b4d1010 tempest-AggregatesAdminNegativeTestJSON-701968823 tempest-AggregatesAdminNegativeTestJSON-701968823-project] Request method failure captured: Nov 01 18:54:22.607221 n-d-863052-2 devstack@n-api.service[121402]: request: POST /compute/v2.1/os-aggregates/3/action HTTP/1.1 Nov 01 18:54:22.607221 n-d-863052-2 devstack@n-api.service[121402]: Accept: application/json Nov 01 18:54:22.607221 n-d-863052-2 devstack@n-api.service[121402]: Accept-Encoding: identity Nov 01 18:54:22.607221 n-d-863052-2 devstack@n-api.service[121402]: Connection: close Nov 01 18:54:22.607221 n-d-863052-2 devstack@n-api.service[121402]: Content-Length: 39 Nov 01 18:54:22.607221 n-d-863052-2 devstack@n-api.service[121402]: Content-Type: application/json Nov 01 18:54:22.607221 n-d-863052-2 devstack@n-api.service[121402]: Host: 10.222.0.13 Nov 01 18:54:22.607221 n-d-863052-2 devstack@n-api.service[121402]: Openstack-System-Scope: None Nov 01 18:54:22.607221 n-d-863052-2 devstack@n-api.service[121402]: User-Agent: python-urllib3/1.26.12 Nov 01 18:54:22.607221 n-d-863052-2 devstack@n-api.service[121402]: X-Auth-Token: gAAAAABjYWtYF75HWf8dApD_m447tyf_mGJPzf8sow1wwvz71bWsgfnuNEDZD8kc7FNf8UQaBOnL1PRXNN_SusWujUfI-Zl9-t1OxUPEVGqV5sgKS3MOb-9Fl7jDxrPPOZQJ67Sffw3RwRGNWR2S2MXGQmO3tiflrv5n_iOXTXf2esQHwC8DD0E Nov 01 18:54:22.607221 n-d-863052-2 devstack@n-api.service[121402]: X-Domain-Id: None Nov 01 18:54:22.607221 n-d-863052-2 devstack@n-api.service[121402]: X-Domain-Name: None Nov 01 18:54:22.607221 n-d-863052-2 devstack@n-api.service[121402]: X-Identity-Status: Confirmed Nov 01 18:54:22.607221 n-d-863052-2 devstack@n-api.service[121402]: X-Is-Admin-Project: True Nov 01 18:54:22.607221 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Domain-Id: default Nov 01 18:54:22.607221 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Domain-Name: Default Nov 01 18:54:22.607221 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Id: 440456c174424b5c8a796711a95a8b69 Nov 01 18:54:22.607221 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-701968823 Nov 01 18:54:22.607221 n-d-863052-2 devstack@n-api.service[121402]: X-Role: member,reader Nov 01 18:54:22.607221 n-d-863052-2 devstack@n-api.service[121402]: X-Roles: member,reader Nov 01 18:54:22.608200 n-d-863052-2 devstack@n-api.service[121402]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/440456c174424b5c8a796711a95a8b69"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/440456c174424b5c8a796711a95a8b69"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_440456c174424b5c8a796711a95a8b69", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/440456c174424b5c8a796711a95a8b69"}]}] Nov 01 18:54:22.608200 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-701968823 Nov 01 18:54:22.608200 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant-Id: 440456c174424b5c8a796711a95a8b69 Nov 01 18:54:22.608200 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-701968823 Nov 01 18:54:22.608200 n-d-863052-2 devstack@n-api.service[121402]: X-User: tempest-AggregatesAdminNegativeTestJSON-701968823-project Nov 01 18:54:22.608200 n-d-863052-2 devstack@n-api.service[121402]: X-User-Domain-Id: default Nov 01 18:54:22.608200 n-d-863052-2 devstack@n-api.service[121402]: X-User-Domain-Name: Default Nov 01 18:54:22.608200 n-d-863052-2 devstack@n-api.service[121402]: X-User-Id: 050138637ab247cabfa21c187e4463dc Nov 01 18:54:22.608200 n-d-863052-2 devstack@n-api.service[121402]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-701968823-project Nov 01 18:54:22.608200 n-d-863052-2 devstack@n-api.service[121402]: Nov 01 18:54:22.608200 n-d-863052-2 devstack@n-api.service[121402]: {"add_host": {"host": "n-h1-863052-2"}} Nov 01 18:54:22.608200 n-d-863052-2 devstack@n-api.service[121402]: method: > Nov 01 18:54:22.608200 n-d-863052-2 devstack@n-api.service[121402]: exception: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Nov 01 18:54:22.608979 n-d-863052-2 devstack@n-api.service[121402]: action_args: {'id': '3', 'body': {'add_host': {'host': 'n-h1-863052-2'}}} Nov 01 18:54:22.608979 n-d-863052-2 devstack@n-api.service[121402]: {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 01 18:54:22.608979 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:54:22.608979 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 18:54:22.608979 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 18:54:22.608979 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 01 18:54:22.608979 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 01 18:54:22.608979 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 01 18:54:22.608979 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 01 18:54:22.608979 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 01 18:54:22.608979 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 01 18:54:22.608979 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 172, in _add_host Nov 01 18:54:22.608979 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'add_host', target={}) Nov 01 18:54:22.608979 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Nov 01 18:54:22.608979 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Nov 01 18:54:22.608979 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Nov 01 18:54:22.608979 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Nov 01 18:54:22.608979 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 01 18:54:22.608979 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 01 18:54:22.609859 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 01 18:54:22.609859 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise self.value Nov 01 18:54:22.609859 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Nov 01 18:54:22.609859 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Nov 01 18:54:22.609859 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Nov 01 18:54:22.609859 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return self.enforce( Nov 01 18:54:22.609859 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Nov 01 18:54:22.609859 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Nov 01 18:54:22.609859 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Nov 01 18:54:22.609859 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 18:54:22.609859 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 18:54:22.609859 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 18:54:22.609859 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:54:22.609859 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 18:54:22.609859 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 18:54:22.609859 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Nov 01 18:54:22.609859 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Nov 01 18:54:22.609859 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Nov 01 18:54:22.609859 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 18:54:22.610812 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-8c3d8856-fd50-4cc2-bc9c-ae8d3b4d1010 tempest-AggregatesAdminNegativeTestJSON-701968823 tempest-AggregatesAdminNegativeTestJSON-701968823-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. {{(pid=121402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 01 18:54:22.610812 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-8c3d8856-fd50-4cc2-bc9c-ae8d3b4d1010 tempest-AggregatesAdminNegativeTestJSON-701968823 tempest-AggregatesAdminNegativeTestJSON-701968823-project] 10.222.0.13 "POST /compute/v2.1/os-aggregates/3/action" status: 403 len: 118 microversion: 2.1 time: 0.397894 Nov 01 18:54:22.611252 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 19/28] 10.222.0.13 () {60 vars in 1191 bytes} [Tue Nov 1 18:54:22 2022] POST /compute/v2.1/os-aggregates/3/action => generated 118 bytes in 399 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Nov 01 18:54:22.618115 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-5b1a0ff1-11ed-4b02-b644-3e069a4a7edf tempest-AggregatesAdminTestJSON-1442378289 tempest-AggregatesAdminTestJSON-1442378289-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-863052-2"}} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 18:54:22.636381 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-5b1a0ff1-11ed-4b02-b644-3e069a4a7edf tempest-AggregatesAdminTestJSON-1442378289 tempest-AggregatesAdminTestJSON-1442378289-project-admin] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:54:22.637249 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-5b1a0ff1-11ed-4b02-b644-3e069a4a7edf tempest-AggregatesAdminTestJSON-1442378289 tempest-AggregatesAdminTestJSON-1442378289-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:54:22.637928 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-5b1a0ff1-11ed-4b02-b644-3e069a4a7edf tempest-AggregatesAdminTestJSON-1442378289 tempest-AggregatesAdminTestJSON-1442378289-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:54:22.909228 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-5b1a0ff1-11ed-4b02-b644-3e069a4a7edf tempest-AggregatesAdminTestJSON-1442378289 tempest-AggregatesAdminTestJSON-1442378289-project-admin] 10.222.0.13 "POST /compute/v2.1/os-aggregates/4/action" status: 200 len: 315 microversion: 2.1 time: 0.296669 Nov 01 18:54:22.912970 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 20/29] 10.222.0.13 () {60 vars in 1191 bytes} [Tue Nov 1 18:54:22 2022] POST /compute/v2.1/os-aggregates/4/action => generated 315 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 18:54:22.926846 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-fd943d80-7ccf-47f4-b86e-2b33d796dc36 tempest-AggregatesAdminNegativeTestJSON-1815627383 tempest-AggregatesAdminNegativeTestJSON-1815627383-project-admin] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:54:23.004622 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-fd943d80-7ccf-47f4-b86e-2b33d796dc36 tempest-AggregatesAdminNegativeTestJSON-1815627383 tempest-AggregatesAdminNegativeTestJSON-1815627383-project-admin] 10.222.0.13 "DELETE /compute/v2.1/os-aggregates/3" status: 200 len: 0 microversion: 2.1 time: 0.091701 Nov 01 18:54:23.011085 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 21/30] 10.222.0.13 () {58 vars in 1152 bytes} [Tue Nov 1 18:54:22 2022] DELETE /compute/v2.1/os-aggregates/3 => generated 0 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Nov 01 18:54:23.015811 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-d8f4404d-297d-4e4b-8740-7dd6ad43d3c1 tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:54:23.016536 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-d8f4404d-297d-4e4b-8740-7dd6ad43d3c1 tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] [instance: 4ebac531-6f77-4108-afc9-0eccb86dee8b] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:54:23.234791 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-8cdf379f-4533-49ee-a09f-6dff122d39c5 tempest-FlavorsAccessNegativeTestJSON-1324123958 tempest-FlavorsAccessNegativeTestJSON-1324123958-project-admin] 10.222.0.13 "POST /compute/v2.1/flavors/1885222344/action" status: 200 len: 21 microversion: 2.1 time: 0.711864 Nov 01 18:54:23.235390 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 10/31] 10.222.0.13 () {60 vars in 1200 bytes} [Tue Nov 1 18:54:22 2022] POST /compute/v2.1/flavors/1885222344/action => generated 21 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 01 18:54:23.248747 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-a719a9ac-063a-4a28-9748-538a16089e05 tempest-AggregatesAdminNegativeTestJSON-1815627383 tempest-AggregatesAdminNegativeTestJSON-1815627383-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1383339660"}} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 18:54:23.259470 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.objects.aggregate [None req-a719a9ac-063a-4a28-9748-538a16089e05 tempest-AggregatesAdminNegativeTestJSON-1815627383 tempest-AggregatesAdminNegativeTestJSON-1815627383-project-admin] Generated uuid 85dcb686-033f-4950-bf93-f2f627a4990e for aggregate {{(pid=121403) create /opt/stack/nova/nova/objects/aggregate.py:298}} Nov 01 18:54:23.317827 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-a719a9ac-063a-4a28-9748-538a16089e05 tempest-AggregatesAdminNegativeTestJSON-1815627383 tempest-AggregatesAdminNegativeTestJSON-1815627383-project-admin] 10.222.0.13 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.078573 Nov 01 18:54:23.328041 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 11/32] 10.222.0.13 () {60 vars in 1164 bytes} [Tue Nov 1 18:54:23 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 18:54:23.333055 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-f838c6ab-3ada-4c18-ac27-bbed463508cb tempest-FlavorsAccessNegativeTestJSON-1324123958 tempest-FlavorsAccessNegativeTestJSON-1324123958-project-admin] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:54:23.371584 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-f838c6ab-3ada-4c18-ac27-bbed463508cb tempest-FlavorsAccessNegativeTestJSON-1324123958 tempest-FlavorsAccessNegativeTestJSON-1324123958-project-admin] 10.222.0.13 "DELETE /compute/v2.1/flavors/1885222344" status: 202 len: 0 microversion: 2.1 time: 0.042245 Nov 01 18:54:23.372977 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 12/33] 10.222.0.13 () {58 vars in 1161 bytes} [Tue Nov 1 18:54:23 2022] DELETE /compute/v2.1/flavors/1885222344 => generated 0 bytes in 44 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 01 18:54:23.381404 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-a15b7028-5cb7-4022-9cb3-ab414f09f1a3 tempest-AggregatesAdminNegativeTestJSON-1815627383 tempest-AggregatesAdminNegativeTestJSON-1815627383-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "tempest-nonexist_host-1757491928"}} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 18:54:23.418275 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-a15b7028-5cb7-4022-9cb3-ab414f09f1a3 tempest-AggregatesAdminNegativeTestJSON-1815627383 tempest-AggregatesAdminNegativeTestJSON-1815627383-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),389766af-efe4-4d8b-b2de-e920ed3438ee(cell1) {{(pid=121403) load_cells /opt/stack/nova/nova/compute/api.py:319}} Nov 01 18:54:23.422230 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-a15b7028-5cb7-4022-9cb3-ab414f09f1a3 tempest-AggregatesAdminNegativeTestJSON-1815627383 tempest-AggregatesAdminNegativeTestJSON-1815627383-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:54:23.422964 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-a15b7028-5cb7-4022-9cb3-ab414f09f1a3 tempest-AggregatesAdminNegativeTestJSON-1815627383 tempest-AggregatesAdminNegativeTestJSON-1815627383-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:54:23.423866 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-a15b7028-5cb7-4022-9cb3-ab414f09f1a3 tempest-AggregatesAdminNegativeTestJSON-1815627383 tempest-AggregatesAdminNegativeTestJSON-1815627383-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:54:23.442803 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-a15b7028-5cb7-4022-9cb3-ab414f09f1a3 tempest-AggregatesAdminNegativeTestJSON-1815627383 tempest-AggregatesAdminNegativeTestJSON-1815627383-project-admin] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:54:23.445785 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-a15b7028-5cb7-4022-9cb3-ab414f09f1a3 tempest-AggregatesAdminNegativeTestJSON-1815627383 tempest-AggregatesAdminNegativeTestJSON-1815627383-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:54:23.446564 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-a15b7028-5cb7-4022-9cb3-ab414f09f1a3 tempest-AggregatesAdminNegativeTestJSON-1815627383 tempest-AggregatesAdminNegativeTestJSON-1815627383-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:54:23.481571 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.wsgi [None req-a15b7028-5cb7-4022-9cb3-ab414f09f1a3 tempest-AggregatesAdminNegativeTestJSON-1815627383 tempest-AggregatesAdminNegativeTestJSON-1815627383-project-admin] HTTP exception thrown: Compute host tempest-nonexist_host-1757491928 could not be found. Nov 01 18:54:23.497877 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-a15b7028-5cb7-4022-9cb3-ab414f09f1a3 tempest-AggregatesAdminNegativeTestJSON-1815627383 tempest-AggregatesAdminNegativeTestJSON-1815627383-project-admin] Request method failure captured: Nov 01 18:54:23.497877 n-d-863052-2 devstack@n-api.service[121403]: request: POST /compute/v2.1/os-aggregates/5/action HTTP/1.1 Nov 01 18:54:23.497877 n-d-863052-2 devstack@n-api.service[121403]: Accept: application/json Nov 01 18:54:23.497877 n-d-863052-2 devstack@n-api.service[121403]: Accept-Encoding: identity Nov 01 18:54:23.497877 n-d-863052-2 devstack@n-api.service[121403]: Connection: close Nov 01 18:54:23.497877 n-d-863052-2 devstack@n-api.service[121403]: Content-Length: 58 Nov 01 18:54:23.497877 n-d-863052-2 devstack@n-api.service[121403]: Content-Type: application/json Nov 01 18:54:23.497877 n-d-863052-2 devstack@n-api.service[121403]: Host: 10.222.0.13 Nov 01 18:54:23.497877 n-d-863052-2 devstack@n-api.service[121403]: Openstack-System-Scope: None Nov 01 18:54:23.497877 n-d-863052-2 devstack@n-api.service[121403]: User-Agent: python-urllib3/1.26.12 Nov 01 18:54:23.497877 n-d-863052-2 devstack@n-api.service[121403]: X-Auth-Token: gAAAAABjYWtaOKWCV3M4Q9P_m1t8bGgxDQkcvYwf_Ps7PzARRUub1dlRxoN3WEeASuv14dc3CyCQ8TmOXer2bxb0hUPpMshCv0Cmn5BRA-Qnk1qDPphkl5oircZzNZGMuZgA5lMqzCR8y9Yywlv7fSmfpCEiAjI39vME7oMbjgkHjO3679hxVVg Nov 01 18:54:23.497877 n-d-863052-2 devstack@n-api.service[121403]: X-Domain-Id: None Nov 01 18:54:23.497877 n-d-863052-2 devstack@n-api.service[121403]: X-Domain-Name: None Nov 01 18:54:23.497877 n-d-863052-2 devstack@n-api.service[121403]: X-Identity-Status: Confirmed Nov 01 18:54:23.497877 n-d-863052-2 devstack@n-api.service[121403]: X-Is-Admin-Project: True Nov 01 18:54:23.497877 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Domain-Id: default Nov 01 18:54:23.497877 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Domain-Name: Default Nov 01 18:54:23.497877 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Id: 1000a18d48e74513aa3f04bb3f4446ff Nov 01 18:54:23.497877 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1815627383 Nov 01 18:54:23.497877 n-d-863052-2 devstack@n-api.service[121403]: X-Role: admin,member,reader Nov 01 18:54:23.497877 n-d-863052-2 devstack@n-api.service[121403]: X-Roles: admin,member,reader Nov 01 18:54:23.499211 n-d-863052-2 devstack@n-api.service[121403]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/1000a18d48e74513aa3f04bb3f4446ff"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/1000a18d48e74513aa3f04bb3f4446ff"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_1000a18d48e74513aa3f04bb3f4446ff", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/1000a18d48e74513aa3f04bb3f4446ff"}]}] Nov 01 18:54:23.499211 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1815627383 Nov 01 18:54:23.499211 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant-Id: 1000a18d48e74513aa3f04bb3f4446ff Nov 01 18:54:23.499211 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1815627383 Nov 01 18:54:23.499211 n-d-863052-2 devstack@n-api.service[121403]: X-User: tempest-AggregatesAdminNegativeTestJSON-1815627383-project-admin Nov 01 18:54:23.499211 n-d-863052-2 devstack@n-api.service[121403]: X-User-Domain-Id: default Nov 01 18:54:23.499211 n-d-863052-2 devstack@n-api.service[121403]: X-User-Domain-Name: Default Nov 01 18:54:23.499211 n-d-863052-2 devstack@n-api.service[121403]: X-User-Id: c9f24a2ce22a47d28828869433d41de9 Nov 01 18:54:23.499211 n-d-863052-2 devstack@n-api.service[121403]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1815627383-project-admin Nov 01 18:54:23.499211 n-d-863052-2 devstack@n-api.service[121403]: Nov 01 18:54:23.499211 n-d-863052-2 devstack@n-api.service[121403]: {"add_host": {"host": "tempest-nonexist_host-1757491928"}} Nov 01 18:54:23.499211 n-d-863052-2 devstack@n-api.service[121403]: method: > Nov 01 18:54:23.499848 n-d-863052-2 devstack@n-api.service[121403]: exception: Compute host tempest-nonexist_host-1757491928 could not be found. Nov 01 18:54:23.499848 n-d-863052-2 devstack@n-api.service[121403]: action_args: {'id': '5', 'body': {'add_host': {'host': 'tempest-nonexist_host-1757491928'}}} Nov 01 18:54:23.499848 n-d-863052-2 devstack@n-api.service[121403]: {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 01 18:54:23.499848 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:54:23.499848 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5999, in _get_service_in_cell_by_host Nov 01 18:54:23.499848 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Nov 01 18:54:23.499848 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 01 18:54:23.499848 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 01 18:54:23.499848 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Nov 01 18:54:23.499848 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Nov 01 18:54:23.499848 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Nov 01 18:54:23.499848 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Nov 01 18:54:23.499848 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Nov 01 18:54:23.499848 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Nov 01 18:54:23.499848 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'tempest-nonexist_host-1757491928' is not mapped to any cell Nov 01 18:54:23.499848 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 18:54:23.499848 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 18:54:23.499848 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 18:54:23.499848 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:54:23.499848 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6005, in _get_service_in_cell_by_host Nov 01 18:54:23.500941 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi service = _find_service_in_cell(context, service_host=host_name) Nov 01 18:54:23.500941 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Nov 01 18:54:23.500941 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Nov 01 18:54:23.500941 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Nov 01 18:54:23.500941 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 18:54:23.500941 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 18:54:23.500941 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 18:54:23.500941 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:54:23.500941 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 180, in _add_host Nov 01 18:54:23.500941 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi aggregate = self.api.add_host_to_aggregate(context, id, host) Nov 01 18:54:23.500941 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Nov 01 18:54:23.500941 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Nov 01 18:54:23.500941 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 01 18:54:23.500941 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 01 18:54:23.500941 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 01 18:54:23.500941 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise self.value Nov 01 18:54:23.500941 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Nov 01 18:54:23.500941 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Nov 01 18:54:23.500941 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6621, in add_host_to_aggregate Nov 01 18:54:23.500941 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi service = _get_service_in_cell_by_host(context, host_name) Nov 01 18:54:23.501957 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6007, in _get_service_in_cell_by_host Nov 01 18:54:23.501957 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host_name) Nov 01 18:54:23.501957 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host tempest-nonexist_host-1757491928 could not be found. Nov 01 18:54:23.501957 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 18:54:23.501957 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 18:54:23.501957 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 18:54:23.501957 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:54:23.501957 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 18:54:23.501957 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 18:54:23.501957 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 01 18:54:23.501957 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 01 18:54:23.501957 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 01 18:54:23.501957 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 01 18:54:23.501957 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 01 18:54:23.501957 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 01 18:54:23.501957 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 184, in _add_host Nov 01 18:54:23.501957 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 01 18:54:23.501957 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Compute host tempest-nonexist_host-1757491928 could not be found. Nov 01 18:54:23.501957 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 18:54:23.501957 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 18:54:23.501957 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 18:54:23.503070 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:54:23.503070 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 18:54:23.503070 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 18:54:23.503070 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 01 18:54:23.503070 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 01 18:54:23.503070 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Compute host tempest-nonexist_host-1757491928 could not be found. Nov 01 18:54:23.503070 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 18:54:23.506427 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-a15b7028-5cb7-4022-9cb3-ab414f09f1a3 tempest-AggregatesAdminNegativeTestJSON-1815627383 tempest-AggregatesAdminNegativeTestJSON-1815627383-project-admin] Returning 404 to user: Compute host tempest-nonexist_host-1757491928 could not be found. {{(pid=121403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 01 18:54:23.507477 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-a15b7028-5cb7-4022-9cb3-ab414f09f1a3 tempest-AggregatesAdminNegativeTestJSON-1815627383 tempest-AggregatesAdminNegativeTestJSON-1815627383-project-admin] 10.222.0.13 "POST /compute/v2.1/os-aggregates/5/action" status: 404 len: 111 microversion: 2.1 time: 0.133183 Nov 01 18:54:23.508987 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 13/34] 10.222.0.13 () {60 vars in 1191 bytes} [Tue Nov 1 18:54:23 2022] POST /compute/v2.1/os-aggregates/5/action => generated 111 bytes in 135 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 01 18:54:23.527465 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-8e6a3d8f-812c-4dc9-a64b-9c13e18b5a23 tempest-FlavorsAccessNegativeTestJSON-1324123958 tempest-FlavorsAccessNegativeTestJSON-1324123958-project-admin] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:54:23.571962 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-8e6a3d8f-812c-4dc9-a64b-9c13e18b5a23 tempest-FlavorsAccessNegativeTestJSON-1324123958 tempest-FlavorsAccessNegativeTestJSON-1324123958-project-admin] 10.222.0.13 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.058247 Nov 01 18:54:23.573520 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 14/35] 10.222.0.13 () {58 vars in 1146 bytes} [Tue Nov 1 18:54:23 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:54:23.944994 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-f3cb4c37-3073-4383-b87b-e3c89c54fe60 tempest-AggregatesAdminTestJSON-768412114 tempest-AggregatesAdminTestJSON-768412114-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AggregatesAdminTestJSON-server-307707134", "imageRef": "2d4a0047-1b9e-445f-8af8-1b5c9d93e881", "flavorRef": "452", "availability_zone": "tempest-test_az-2016780767"}} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 18:54:23.986248 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f3cb4c37-3073-4383-b87b-e3c89c54fe60 tempest-AggregatesAdminTestJSON-768412114 tempest-AggregatesAdminTestJSON-768412114-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:54:23.986918 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f3cb4c37-3073-4383-b87b-e3c89c54fe60 tempest-AggregatesAdminTestJSON-768412114 tempest-AggregatesAdminTestJSON-768412114-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:54:23.987360 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f3cb4c37-3073-4383-b87b-e3c89c54fe60 tempest-AggregatesAdminTestJSON-768412114 tempest-AggregatesAdminTestJSON-768412114-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:54:23.988697 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f3cb4c37-3073-4383-b87b-e3c89c54fe60 tempest-AggregatesAdminTestJSON-768412114 tempest-AggregatesAdminTestJSON-768412114-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:54:23.989168 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f3cb4c37-3073-4383-b87b-e3c89c54fe60 tempest-AggregatesAdminTestJSON-768412114 tempest-AggregatesAdminTestJSON-768412114-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:54:23.989740 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f3cb4c37-3073-4383-b87b-e3c89c54fe60 tempest-AggregatesAdminTestJSON-768412114 tempest-AggregatesAdminTestJSON-768412114-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:54:24.168932 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.network.neutron [None req-f3cb4c37-3073-4383-b87b-e3c89c54fe60 tempest-AggregatesAdminTestJSON-768412114 tempest-AggregatesAdminTestJSON-768412114-project] validate_networks() for None {{(pid=121403) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 01 18:54:24.561491 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-d8f4404d-297d-4e4b-8740-7dd6ad43d3c1 tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce2e0d1828674809a3344a7a68f375c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8e1248497284006a7acbb8169627ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:54:24.580570 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-d8f4404d-297d-4e4b-8740-7dd6ad43d3c1 tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] 10.222.0.13 "GET /compute/v2.1/servers/4ebac531-6f77-4108-afc9-0eccb86dee8b" status: 200 len: 1219 microversion: 2.1 time: 1.568358 Nov 01 18:54:24.592616 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 22/36] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:54:23 2022] GET /compute/v2.1/servers/4ebac531-6f77-4108-afc9-0eccb86dee8b => generated 1219 bytes in 1571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:54:24.592616 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-24674568-6647-4319-b487-6ab1ece19881 tempest-AggregatesAdminNegativeTestJSON-1815627383 tempest-AggregatesAdminNegativeTestJSON-1815627383-project-admin] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:54:24.610480 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.virt.hardware [None req-f3cb4c37-3073-4383-b87b-e3c89c54fe60 tempest-AggregatesAdminTestJSON-768412114 tempest-AggregatesAdminTestJSON-768412114-project] Flavor limits 0:0:0 {{(pid=121403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 01 18:54:24.611064 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.virt.hardware [None req-f3cb4c37-3073-4383-b87b-e3c89c54fe60 tempest-AggregatesAdminTestJSON-768412114 tempest-AggregatesAdminTestJSON-768412114-project] Image limits 0:0:0 {{(pid=121403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 01 18:54:24.611367 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.virt.hardware [None req-f3cb4c37-3073-4383-b87b-e3c89c54fe60 tempest-AggregatesAdminTestJSON-768412114 tempest-AggregatesAdminTestJSON-768412114-project] Flavor pref 0:0:0 {{(pid=121403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 01 18:54:24.611766 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.virt.hardware [None req-f3cb4c37-3073-4383-b87b-e3c89c54fe60 tempest-AggregatesAdminTestJSON-768412114 tempest-AggregatesAdminTestJSON-768412114-project] Image pref 0:0:0 {{(pid=121403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 01 18:54:24.612171 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.virt.hardware [None req-f3cb4c37-3073-4383-b87b-e3c89c54fe60 tempest-AggregatesAdminTestJSON-768412114 tempest-AggregatesAdminTestJSON-768412114-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 01 18:54:24.626678 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f3cb4c37-3073-4383-b87b-e3c89c54fe60 tempest-AggregatesAdminTestJSON-768412114 tempest-AggregatesAdminTestJSON-768412114-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:54:24.627670 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f3cb4c37-3073-4383-b87b-e3c89c54fe60 tempest-AggregatesAdminTestJSON-768412114 tempest-AggregatesAdminTestJSON-768412114-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:54:24.627670 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f3cb4c37-3073-4383-b87b-e3c89c54fe60 tempest-AggregatesAdminTestJSON-768412114 tempest-AggregatesAdminTestJSON-768412114-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:54:24.628297 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f3cb4c37-3073-4383-b87b-e3c89c54fe60 tempest-AggregatesAdminTestJSON-768412114 tempest-AggregatesAdminTestJSON-768412114-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:54:24.628839 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f3cb4c37-3073-4383-b87b-e3c89c54fe60 tempest-AggregatesAdminTestJSON-768412114 tempest-AggregatesAdminTestJSON-768412114-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:54:24.633414 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f3cb4c37-3073-4383-b87b-e3c89c54fe60 tempest-AggregatesAdminTestJSON-768412114 tempest-AggregatesAdminTestJSON-768412114-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:54:24.671163 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-24674568-6647-4319-b487-6ab1ece19881 tempest-AggregatesAdminNegativeTestJSON-1815627383 tempest-AggregatesAdminNegativeTestJSON-1815627383-project-admin] 10.222.0.13 "DELETE /compute/v2.1/os-aggregates/5" status: 200 len: 0 microversion: 2.1 time: 0.085517 Nov 01 18:54:24.672230 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 23/37] 10.222.0.13 () {58 vars in 1152 bytes} [Tue Nov 1 18:54:24 2022] DELETE /compute/v2.1/os-aggregates/5 => generated 0 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Nov 01 18:54:24.677593 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-9790b2b6-1229-4ea8-9777-b4da64914321 tempest-FlavorsAccessNegativeTestJSON-1324123958 tempest-FlavorsAccessNegativeTestJSON-1324123958-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-537122038", "id": 89375400, "os-flavor-access:is_public": "True"}} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 18:54:24.696399 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.quota [None req-f3cb4c37-3073-4383-b87b-e3c89c54fe60 tempest-AggregatesAdminTestJSON-768412114 tempest-AggregatesAdminTestJSON-768412114-project] Getting quotas for project 8382e1376b104295aa5cef36ba07cf45. Resources: {'cores', 'ram', 'instances'} {{(pid=121403) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 01 18:54:24.712639 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.quota [None req-f3cb4c37-3073-4383-b87b-e3c89c54fe60 tempest-AggregatesAdminTestJSON-768412114 tempest-AggregatesAdminTestJSON-768412114-project] Getting quotas for user 439a7ac2509640c49361f9ba6636b34d and project 8382e1376b104295aa5cef36ba07cf45. Resources: {'cores', 'ram', 'instances'} {{(pid=121403) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 01 18:54:24.714249 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-9790b2b6-1229-4ea8-9777-b4da64914321 tempest-FlavorsAccessNegativeTestJSON-1324123958 tempest-FlavorsAccessNegativeTestJSON-1324123958-project-admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 431 microversion: 2.1 time: 0.040413 Nov 01 18:54:24.716720 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 24/38] 10.222.0.13 () {60 vars in 1147 bytes} [Tue Nov 1 18:54:24 2022] POST /compute/v2.1/flavors => generated 431 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 18:54:24.737302 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-b1c56604-7d35-47e8-a545-e9542696e3a2 tempest-AggregatesAdminNegativeTestJSON-1815627383 tempest-AggregatesAdminNegativeTestJSON-1815627383-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 18:54:24.748262 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-b1c56604-7d35-47e8-a545-e9542696e3a2 tempest-AggregatesAdminNegativeTestJSON-1815627383 tempest-AggregatesAdminNegativeTestJSON-1815627383-project-admin] Request method failure captured: Nov 01 18:54:24.748262 n-d-863052-2 devstack@n-api.service[121402]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Nov 01 18:54:24.748262 n-d-863052-2 devstack@n-api.service[121402]: Accept: application/json Nov 01 18:54:24.748262 n-d-863052-2 devstack@n-api.service[121402]: Accept-Encoding: identity Nov 01 18:54:24.748262 n-d-863052-2 devstack@n-api.service[121402]: Connection: close Nov 01 18:54:24.748262 n-d-863052-2 devstack@n-api.service[121402]: Content-Length: 283 Nov 01 18:54:24.748262 n-d-863052-2 devstack@n-api.service[121402]: Content-Type: application/json Nov 01 18:54:24.748262 n-d-863052-2 devstack@n-api.service[121402]: Host: 10.222.0.13 Nov 01 18:54:24.748262 n-d-863052-2 devstack@n-api.service[121402]: Openstack-System-Scope: None Nov 01 18:54:24.748262 n-d-863052-2 devstack@n-api.service[121402]: User-Agent: python-urllib3/1.26.12 Nov 01 18:54:24.748262 n-d-863052-2 devstack@n-api.service[121402]: X-Auth-Token: gAAAAABjYWtaOKWCV3M4Q9P_m1t8bGgxDQkcvYwf_Ps7PzARRUub1dlRxoN3WEeASuv14dc3CyCQ8TmOXer2bxb0hUPpMshCv0Cmn5BRA-Qnk1qDPphkl5oircZzNZGMuZgA5lMqzCR8y9Yywlv7fSmfpCEiAjI39vME7oMbjgkHjO3679hxVVg Nov 01 18:54:24.748262 n-d-863052-2 devstack@n-api.service[121402]: X-Domain-Id: None Nov 01 18:54:24.748262 n-d-863052-2 devstack@n-api.service[121402]: X-Domain-Name: None Nov 01 18:54:24.748262 n-d-863052-2 devstack@n-api.service[121402]: X-Identity-Status: Confirmed Nov 01 18:54:24.748262 n-d-863052-2 devstack@n-api.service[121402]: X-Is-Admin-Project: True Nov 01 18:54:24.748262 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Domain-Id: default Nov 01 18:54:24.748262 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Domain-Name: Default Nov 01 18:54:24.748262 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Id: 1000a18d48e74513aa3f04bb3f4446ff Nov 01 18:54:24.748262 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1815627383 Nov 01 18:54:24.748262 n-d-863052-2 devstack@n-api.service[121402]: X-Role: admin,member,reader Nov 01 18:54:24.748262 n-d-863052-2 devstack@n-api.service[121402]: X-Roles: admin,member,reader Nov 01 18:54:24.749458 n-d-863052-2 devstack@n-api.service[121402]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/1000a18d48e74513aa3f04bb3f4446ff"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/1000a18d48e74513aa3f04bb3f4446ff"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_1000a18d48e74513aa3f04bb3f4446ff", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/1000a18d48e74513aa3f04bb3f4446ff"}]}] Nov 01 18:54:24.749458 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1815627383 Nov 01 18:54:24.749458 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant-Id: 1000a18d48e74513aa3f04bb3f4446ff Nov 01 18:54:24.749458 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1815627383 Nov 01 18:54:24.749458 n-d-863052-2 devstack@n-api.service[121402]: X-User: tempest-AggregatesAdminNegativeTestJSON-1815627383-project-admin Nov 01 18:54:24.749458 n-d-863052-2 devstack@n-api.service[121402]: X-User-Domain-Id: default Nov 01 18:54:24.749458 n-d-863052-2 devstack@n-api.service[121402]: X-User-Domain-Name: Default Nov 01 18:54:24.749458 n-d-863052-2 devstack@n-api.service[121402]: X-User-Id: c9f24a2ce22a47d28828869433d41de9 Nov 01 18:54:24.749458 n-d-863052-2 devstack@n-api.service[121402]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1815627383-project-admin Nov 01 18:54:24.749458 n-d-863052-2 devstack@n-api.service[121402]: Nov 01 18:54:24.750106 n-d-863052-2 devstack@n-api.service[121402]: {"aggregate": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Nov 01 18:54:24.750106 n-d-863052-2 devstack@n-api.service[121402]: method: > Nov 01 18:54:24.750106 n-d-863052-2 devstack@n-api.service[121402]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Nov 01 18:54:24.750106 n-d-863052-2 devstack@n-api.service[121402]: action_args: {'body': {'aggregate': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Nov 01 18:54:24.750106 n-d-863052-2 devstack@n-api.service[121402]: {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 01 18:54:24.750106 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:54:24.750106 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Nov 01 18:54:24.750106 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Nov 01 18:54:24.750106 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Nov 01 18:54:24.750106 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise error Nov 01 18:54:24.750608 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Nov 01 18:54:24.750608 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 18:54:24.750608 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['aggregate']['properties']['name']: Nov 01 18:54:24.750608 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Nov 01 18:54:24.750608 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 18:54:24.750608 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi On instance['aggregate']: Nov 01 18:54:24.750608 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Nov 01 18:54:24.750608 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 18:54:24.750608 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 18:54:24.750608 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 18:54:24.750608 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:54:24.750608 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 18:54:24.750608 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 18:54:24.750608 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 01 18:54:24.750608 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 01 18:54:24.750608 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 01 18:54:24.750608 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 01 18:54:24.751404 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 01 18:54:24.751404 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 01 18:54:24.751404 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Nov 01 18:54:24.751404 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Nov 01 18:54:24.751404 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Nov 01 18:54:24.751404 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Nov 01 18:54:24.751404 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Nov 01 18:54:24.751404 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Nov 01 18:54:24.751404 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Nov 01 18:54:24.751404 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 18:54:24.751404 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 18:54:24.751404 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 18:54:24.751404 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:54:24.751404 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 18:54:24.751404 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 18:54:24.752138 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Nov 01 18:54:24.752138 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Nov 01 18:54:24.752138 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Nov 01 18:54:24.752138 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 18:54:24.760809 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-b1c56604-7d35-47e8-a545-e9542696e3a2 tempest-AggregatesAdminNegativeTestJSON-1815627383 tempest-AggregatesAdminNegativeTestJSON-1815627383-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=121402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 01 18:54:24.764549 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-f3cb4c37-3073-4383-b87b-e3c89c54fe60 tempest-AggregatesAdminTestJSON-768412114 tempest-AggregatesAdminTestJSON-768412114-project] Going to run 1 instances... {{(pid=121403) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 01 18:54:24.765608 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-b1c56604-7d35-47e8-a545-e9542696e3a2 tempest-AggregatesAdminNegativeTestJSON-1815627383 tempest-AggregatesAdminNegativeTestJSON-1815627383-project-admin] 10.222.0.13 "POST /compute/v2.1/os-aggregates" status: 400 len: 619 microversion: 2.1 time: 0.047297 Nov 01 18:54:24.766349 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 25/39] 10.222.0.13 () {60 vars in 1165 bytes} [Tue Nov 1 18:54:24 2022] POST /compute/v2.1/os-aggregates => generated 619 bytes in 49 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 01 18:54:24.768395 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-f3cb4c37-3073-4383-b87b-e3c89c54fe60 tempest-AggregatesAdminTestJSON-768412114 tempest-AggregatesAdminTestJSON-768412114-project] [instance: 7967bf1f-943f-441d-befd-373868bbb3aa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2d4a0047-1b9e-445f-8af8-1b5c9d93e881',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121403) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 01 18:54:24.771621 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-1c6eb6d6-b839-44fb-a6a0-26b209b75e24 tempest-FlavorsAccessNegativeTestJSON-1324123958 tempest-FlavorsAccessNegativeTestJSON-1324123958-project-admin] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:54:24.798519 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.wsgi [None req-1c6eb6d6-b839-44fb-a6a0-26b209b75e24 tempest-FlavorsAccessNegativeTestJSON-1324123958 tempest-FlavorsAccessNegativeTestJSON-1324123958-project-admin] HTTP exception thrown: Access list not available for public flavors. Nov 01 18:54:24.800159 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-1c6eb6d6-b839-44fb-a6a0-26b209b75e24 tempest-FlavorsAccessNegativeTestJSON-1324123958 tempest-FlavorsAccessNegativeTestJSON-1324123958-project-admin] Request method failure captured: Nov 01 18:54:24.800159 n-d-863052-2 devstack@n-api.service[121402]: request: GET /compute/v2.1/flavors/89375400/os-flavor-access HTTP/1.1 Nov 01 18:54:24.800159 n-d-863052-2 devstack@n-api.service[121402]: Accept: application/json Nov 01 18:54:24.800159 n-d-863052-2 devstack@n-api.service[121402]: Accept-Encoding: identity Nov 01 18:54:24.800159 n-d-863052-2 devstack@n-api.service[121402]: Connection: close Nov 01 18:54:24.800159 n-d-863052-2 devstack@n-api.service[121402]: Content-Length: 0 Nov 01 18:54:24.800159 n-d-863052-2 devstack@n-api.service[121402]: Content-Type: application/json Nov 01 18:54:24.800159 n-d-863052-2 devstack@n-api.service[121402]: Host: 10.222.0.13 Nov 01 18:54:24.800159 n-d-863052-2 devstack@n-api.service[121402]: Openstack-System-Scope: None Nov 01 18:54:24.800159 n-d-863052-2 devstack@n-api.service[121402]: User-Agent: python-urllib3/1.26.12 Nov 01 18:54:24.800159 n-d-863052-2 devstack@n-api.service[121402]: X-Auth-Token: gAAAAABjYWtaKDQxU1HAN-hE8muWbrn8LFATSrLppCxxaHhX1W3GPdjcJz-HNjcSHGtohMgWFTY1vb-P8ceC9A1AJ6rdpZpDgg90gSK5oiXVWFCK5BToKuloW0fFWUz2FatmiKzGgTb1cjaDcwFblLF7bl0QIErdL-JSmnWQMFz6HH7eRbFS_Y8 Nov 01 18:54:24.800159 n-d-863052-2 devstack@n-api.service[121402]: X-Domain-Id: None Nov 01 18:54:24.800159 n-d-863052-2 devstack@n-api.service[121402]: X-Domain-Name: None Nov 01 18:54:24.800159 n-d-863052-2 devstack@n-api.service[121402]: X-Identity-Status: Confirmed Nov 01 18:54:24.800159 n-d-863052-2 devstack@n-api.service[121402]: X-Is-Admin-Project: True Nov 01 18:54:24.800159 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Domain-Id: default Nov 01 18:54:24.800159 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Domain-Name: Default Nov 01 18:54:24.800159 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Id: 68a228081a16469ca92f0f8a56dd05e9 Nov 01 18:54:24.800159 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-1324123958 Nov 01 18:54:24.800159 n-d-863052-2 devstack@n-api.service[121402]: X-Role: admin,member,reader Nov 01 18:54:24.800159 n-d-863052-2 devstack@n-api.service[121402]: X-Roles: admin,member,reader Nov 01 18:54:24.801587 n-d-863052-2 devstack@n-api.service[121402]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/68a228081a16469ca92f0f8a56dd05e9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/68a228081a16469ca92f0f8a56dd05e9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_68a228081a16469ca92f0f8a56dd05e9", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/68a228081a16469ca92f0f8a56dd05e9"}]}] Nov 01 18:54:24.801587 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-1324123958 Nov 01 18:54:24.801587 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant-Id: 68a228081a16469ca92f0f8a56dd05e9 Nov 01 18:54:24.801587 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-1324123958 Nov 01 18:54:24.801587 n-d-863052-2 devstack@n-api.service[121402]: X-User: tempest-FlavorsAccessNegativeTestJSON-1324123958-project-admin Nov 01 18:54:24.801587 n-d-863052-2 devstack@n-api.service[121402]: X-User-Domain-Id: default Nov 01 18:54:24.801587 n-d-863052-2 devstack@n-api.service[121402]: X-User-Domain-Name: Default Nov 01 18:54:24.801587 n-d-863052-2 devstack@n-api.service[121402]: X-User-Id: ea9642617d114bc3ac329691a82bd5d0 Nov 01 18:54:24.801587 n-d-863052-2 devstack@n-api.service[121402]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-1324123958-project-admin Nov 01 18:54:24.801587 n-d-863052-2 devstack@n-api.service[121402]: method: > Nov 01 18:54:24.801587 n-d-863052-2 devstack@n-api.service[121402]: exception: Access list not available for public flavors. Nov 01 18:54:24.801587 n-d-863052-2 devstack@n-api.service[121402]: action_args: {'flavor_id': '89375400'} Nov 01 18:54:24.802178 n-d-863052-2 devstack@n-api.service[121402]: {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 01 18:54:24.802178 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:54:24.802178 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 18:54:24.802178 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 18:54:24.802178 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 01 18:54:24.802178 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 01 18:54:24.802178 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 01 18:54:24.802178 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 01 18:54:24.802178 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 52, in index Nov 01 18:54:24.802178 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Nov 01 18:54:24.802178 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Access list not available for public flavors. Nov 01 18:54:24.802178 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 18:54:24.802178 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 18:54:24.802178 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 18:54:24.802178 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:54:24.802178 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 18:54:24.802178 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 18:54:24.802178 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 01 18:54:24.802178 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 01 18:54:24.802178 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Access list not available for public flavors. Nov 01 18:54:24.802178 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 18:54:24.808122 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-1c6eb6d6-b839-44fb-a6a0-26b209b75e24 tempest-FlavorsAccessNegativeTestJSON-1324123958 tempest-FlavorsAccessNegativeTestJSON-1324123958-project-admin] Returning 404 to user: Access list not available for public flavors. {{(pid=121402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 01 18:54:24.809370 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-1c6eb6d6-b839-44fb-a6a0-26b209b75e24 tempest-FlavorsAccessNegativeTestJSON-1324123958 tempest-FlavorsAccessNegativeTestJSON-1324123958-project-admin] 10.222.0.13 "GET /compute/v2.1/flavors/89375400/os-flavor-access" status: 404 len: 91 microversion: 2.1 time: 0.041414 Nov 01 18:54:24.809943 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 26/40] 10.222.0.13 () {58 vars in 1203 bytes} [Tue Nov 1 18:54:24 2022] GET /compute/v2.1/flavors/89375400/os-flavor-access => generated 91 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 01 18:54:24.827263 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-59b238c8-cdac-4d61-a4ed-5eb490a22ea1 tempest-AggregatesAdminNegativeTestJSON-1815627383 tempest-AggregatesAdminNegativeTestJSON-1815627383-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": ""}} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 18:54:24.834285 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-59b238c8-cdac-4d61-a4ed-5eb490a22ea1 tempest-AggregatesAdminNegativeTestJSON-1815627383 tempest-AggregatesAdminNegativeTestJSON-1815627383-project-admin] Request method failure captured: Nov 01 18:54:24.834285 n-d-863052-2 devstack@n-api.service[121402]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Nov 01 18:54:24.834285 n-d-863052-2 devstack@n-api.service[121402]: Accept: application/json Nov 01 18:54:24.834285 n-d-863052-2 devstack@n-api.service[121402]: Accept-Encoding: identity Nov 01 18:54:24.834285 n-d-863052-2 devstack@n-api.service[121402]: Connection: close Nov 01 18:54:24.834285 n-d-863052-2 devstack@n-api.service[121402]: Content-Length: 27 Nov 01 18:54:24.834285 n-d-863052-2 devstack@n-api.service[121402]: Content-Type: application/json Nov 01 18:54:24.834285 n-d-863052-2 devstack@n-api.service[121402]: Host: 10.222.0.13 Nov 01 18:54:24.834285 n-d-863052-2 devstack@n-api.service[121402]: Openstack-System-Scope: None Nov 01 18:54:24.834285 n-d-863052-2 devstack@n-api.service[121402]: User-Agent: python-urllib3/1.26.12 Nov 01 18:54:24.834285 n-d-863052-2 devstack@n-api.service[121402]: X-Auth-Token: gAAAAABjYWtaOKWCV3M4Q9P_m1t8bGgxDQkcvYwf_Ps7PzARRUub1dlRxoN3WEeASuv14dc3CyCQ8TmOXer2bxb0hUPpMshCv0Cmn5BRA-Qnk1qDPphkl5oircZzNZGMuZgA5lMqzCR8y9Yywlv7fSmfpCEiAjI39vME7oMbjgkHjO3679hxVVg Nov 01 18:54:24.834285 n-d-863052-2 devstack@n-api.service[121402]: X-Domain-Id: None Nov 01 18:54:24.834285 n-d-863052-2 devstack@n-api.service[121402]: X-Domain-Name: None Nov 01 18:54:24.834285 n-d-863052-2 devstack@n-api.service[121402]: X-Identity-Status: Confirmed Nov 01 18:54:24.834285 n-d-863052-2 devstack@n-api.service[121402]: X-Is-Admin-Project: True Nov 01 18:54:24.834285 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Domain-Id: default Nov 01 18:54:24.834285 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Domain-Name: Default Nov 01 18:54:24.834285 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Id: 1000a18d48e74513aa3f04bb3f4446ff Nov 01 18:54:24.834285 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1815627383 Nov 01 18:54:24.834285 n-d-863052-2 devstack@n-api.service[121402]: X-Role: admin,member,reader Nov 01 18:54:24.834285 n-d-863052-2 devstack@n-api.service[121402]: X-Roles: admin,member,reader Nov 01 18:54:24.835544 n-d-863052-2 devstack@n-api.service[121402]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/1000a18d48e74513aa3f04bb3f4446ff"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/1000a18d48e74513aa3f04bb3f4446ff"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_1000a18d48e74513aa3f04bb3f4446ff", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/1000a18d48e74513aa3f04bb3f4446ff"}]}] Nov 01 18:54:24.835544 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1815627383 Nov 01 18:54:24.835544 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant-Id: 1000a18d48e74513aa3f04bb3f4446ff Nov 01 18:54:24.835544 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1815627383 Nov 01 18:54:24.835544 n-d-863052-2 devstack@n-api.service[121402]: X-User: tempest-AggregatesAdminNegativeTestJSON-1815627383-project-admin Nov 01 18:54:24.835544 n-d-863052-2 devstack@n-api.service[121402]: X-User-Domain-Id: default Nov 01 18:54:24.835544 n-d-863052-2 devstack@n-api.service[121402]: X-User-Domain-Name: Default Nov 01 18:54:24.835544 n-d-863052-2 devstack@n-api.service[121402]: X-User-Id: c9f24a2ce22a47d28828869433d41de9 Nov 01 18:54:24.835544 n-d-863052-2 devstack@n-api.service[121402]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1815627383-project-admin Nov 01 18:54:24.835544 n-d-863052-2 devstack@n-api.service[121402]: Nov 01 18:54:24.835544 n-d-863052-2 devstack@n-api.service[121402]: {"aggregate": {"name": ""}} Nov 01 18:54:24.835544 n-d-863052-2 devstack@n-api.service[121402]: method: > Nov 01 18:54:24.835544 n-d-863052-2 devstack@n-api.service[121402]: exception: Invalid input for field/attribute name. Value: . '' is too short Nov 01 18:54:24.836195 n-d-863052-2 devstack@n-api.service[121402]: action_args: {'body': {'aggregate': {'name': ''}}} Nov 01 18:54:24.836195 n-d-863052-2 devstack@n-api.service[121402]: {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 01 18:54:24.836195 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:54:24.836195 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Nov 01 18:54:24.836195 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Nov 01 18:54:24.836195 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Nov 01 18:54:24.836195 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise error Nov 01 18:54:24.836195 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Nov 01 18:54:24.836195 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 18:54:24.836195 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['aggregate']['properties']['name']: Nov 01 18:54:24.836195 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Nov 01 18:54:24.836195 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 18:54:24.836195 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi On instance['aggregate']: Nov 01 18:54:24.836195 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi '' Nov 01 18:54:24.836195 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 18:54:24.836195 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 18:54:24.836195 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 18:54:24.836195 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:54:24.836195 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 18:54:24.836195 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 18:54:24.836195 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 01 18:54:24.836195 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 01 18:54:24.836195 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 01 18:54:24.837522 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 01 18:54:24.837522 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 01 18:54:24.837522 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 01 18:54:24.837522 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Nov 01 18:54:24.837522 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Nov 01 18:54:24.837522 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Nov 01 18:54:24.837522 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Nov 01 18:54:24.837522 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Nov 01 18:54:24.837522 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Nov 01 18:54:24.837522 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Nov 01 18:54:24.837522 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 18:54:24.837522 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 18:54:24.837522 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 18:54:24.837522 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:54:24.837522 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 18:54:24.837522 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 18:54:24.837522 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Nov 01 18:54:24.837522 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Nov 01 18:54:24.837522 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Nov 01 18:54:24.837522 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 18:54:24.838548 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-59b238c8-cdac-4d61-a4ed-5eb490a22ea1 tempest-AggregatesAdminNegativeTestJSON-1815627383 tempest-AggregatesAdminNegativeTestJSON-1815627383-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=121402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 01 18:54:24.838739 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-59b238c8-cdac-4d61-a4ed-5eb490a22ea1 tempest-AggregatesAdminNegativeTestJSON-1815627383 tempest-AggregatesAdminNegativeTestJSON-1815627383-project-admin] 10.222.0.13 "POST /compute/v2.1/os-aggregates" status: 400 len: 108 microversion: 2.1 time: 0.023150 Nov 01 18:54:24.842779 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 27/41] 10.222.0.13 () {60 vars in 1164 bytes} [Tue Nov 1 18:54:24 2022] POST /compute/v2.1/os-aggregates => generated 108 bytes in 27 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 01 18:54:24.860406 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-f7a55b65-2cf2-4651-9f30-f6c175c5700e tempest-FlavorsAccessNegativeTestJSON-1324123958 tempest-FlavorsAccessNegativeTestJSON-1324123958-project-admin] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:54:24.878749 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-f3cb4c37-3073-4383-b87b-e3c89c54fe60 tempest-AggregatesAdminTestJSON-768412114 tempest-AggregatesAdminTestJSON-768412114-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.303517 Nov 01 18:54:24.880651 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 15/42] 10.222.0.13 () {60 vars in 1147 bytes} [Tue Nov 1 18:54:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 1306 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 01 18:54:24.889482 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-f7a55b65-2cf2-4651-9f30-f6c175c5700e tempest-FlavorsAccessNegativeTestJSON-1324123958 tempest-FlavorsAccessNegativeTestJSON-1324123958-project-admin] 10.222.0.13 "DELETE /compute/v2.1/flavors/89375400" status: 202 len: 0 microversion: 2.1 time: 0.044801 Nov 01 18:54:24.891071 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 28/43] 10.222.0.13 () {58 vars in 1155 bytes} [Tue Nov 1 18:54:24 2022] DELETE /compute/v2.1/flavors/89375400 => generated 0 bytes in 48 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 01 18:54:24.896032 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-f3b9c459-f57a-4a01-991b-7f11cb125dd7 tempest-AggregatesAdminNegativeTestJSON-701968823 tempest-AggregatesAdminNegativeTestJSON-701968823-project] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-2030876000"}} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 18:54:24.901020 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-f3b9c459-f57a-4a01-991b-7f11cb125dd7 tempest-AggregatesAdminNegativeTestJSON-701968823 tempest-AggregatesAdminNegativeTestJSON-701968823-project] Policy check for os_compute_api:os-aggregates:create failed with credentials {'is_admin': False, 'user_id': '050138637ab247cabfa21c187e4463dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440456c174424b5c8a796711a95a8b69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:54:24.902412 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-eb654711-bc06-453a-b4c9-2ae3bb65700c tempest-AggregatesAdminTestJSON-768412114 tempest-AggregatesAdminTestJSON-768412114-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:54:24.905196 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-eb654711-bc06-453a-b4c9-2ae3bb65700c tempest-AggregatesAdminTestJSON-768412114 tempest-AggregatesAdminTestJSON-768412114-project] [instance: 7967bf1f-943f-441d-befd-373868bbb3aa] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:54:24.907653 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-f3b9c459-f57a-4a01-991b-7f11cb125dd7 tempest-AggregatesAdminNegativeTestJSON-701968823 tempest-AggregatesAdminNegativeTestJSON-701968823-project] Request method failure captured: Nov 01 18:54:24.907653 n-d-863052-2 devstack@n-api.service[121403]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Nov 01 18:54:24.907653 n-d-863052-2 devstack@n-api.service[121403]: Accept: application/json Nov 01 18:54:24.907653 n-d-863052-2 devstack@n-api.service[121403]: Accept-Encoding: identity Nov 01 18:54:24.907653 n-d-863052-2 devstack@n-api.service[121403]: Connection: close Nov 01 18:54:24.907653 n-d-863052-2 devstack@n-api.service[121403]: Content-Length: 60 Nov 01 18:54:24.907653 n-d-863052-2 devstack@n-api.service[121403]: Content-Type: application/json Nov 01 18:54:24.907653 n-d-863052-2 devstack@n-api.service[121403]: Host: 10.222.0.13 Nov 01 18:54:24.907653 n-d-863052-2 devstack@n-api.service[121403]: Openstack-System-Scope: None Nov 01 18:54:24.907653 n-d-863052-2 devstack@n-api.service[121403]: User-Agent: python-urllib3/1.26.12 Nov 01 18:54:24.907653 n-d-863052-2 devstack@n-api.service[121403]: X-Auth-Token: gAAAAABjYWtYF75HWf8dApD_m447tyf_mGJPzf8sow1wwvz71bWsgfnuNEDZD8kc7FNf8UQaBOnL1PRXNN_SusWujUfI-Zl9-t1OxUPEVGqV5sgKS3MOb-9Fl7jDxrPPOZQJ67Sffw3RwRGNWR2S2MXGQmO3tiflrv5n_iOXTXf2esQHwC8DD0E Nov 01 18:54:24.907653 n-d-863052-2 devstack@n-api.service[121403]: X-Domain-Id: None Nov 01 18:54:24.907653 n-d-863052-2 devstack@n-api.service[121403]: X-Domain-Name: None Nov 01 18:54:24.907653 n-d-863052-2 devstack@n-api.service[121403]: X-Identity-Status: Confirmed Nov 01 18:54:24.907653 n-d-863052-2 devstack@n-api.service[121403]: X-Is-Admin-Project: True Nov 01 18:54:24.907653 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Domain-Id: default Nov 01 18:54:24.907653 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Domain-Name: Default Nov 01 18:54:24.907653 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Id: 440456c174424b5c8a796711a95a8b69 Nov 01 18:54:24.907653 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-701968823 Nov 01 18:54:24.907653 n-d-863052-2 devstack@n-api.service[121403]: X-Role: member,reader Nov 01 18:54:24.907653 n-d-863052-2 devstack@n-api.service[121403]: X-Roles: member,reader Nov 01 18:54:24.910079 n-d-863052-2 devstack@n-api.service[121403]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/440456c174424b5c8a796711a95a8b69"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/440456c174424b5c8a796711a95a8b69"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_440456c174424b5c8a796711a95a8b69", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/440456c174424b5c8a796711a95a8b69"}]}] Nov 01 18:54:24.910079 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-701968823 Nov 01 18:54:24.910079 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant-Id: 440456c174424b5c8a796711a95a8b69 Nov 01 18:54:24.910079 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-701968823 Nov 01 18:54:24.910079 n-d-863052-2 devstack@n-api.service[121403]: X-User: tempest-AggregatesAdminNegativeTestJSON-701968823-project Nov 01 18:54:24.910079 n-d-863052-2 devstack@n-api.service[121403]: X-User-Domain-Id: default Nov 01 18:54:24.910079 n-d-863052-2 devstack@n-api.service[121403]: X-User-Domain-Name: Default Nov 01 18:54:24.910079 n-d-863052-2 devstack@n-api.service[121403]: X-User-Id: 050138637ab247cabfa21c187e4463dc Nov 01 18:54:24.910079 n-d-863052-2 devstack@n-api.service[121403]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-701968823-project Nov 01 18:54:24.910079 n-d-863052-2 devstack@n-api.service[121403]: Nov 01 18:54:24.910079 n-d-863052-2 devstack@n-api.service[121403]: {"aggregate": {"name": "tempest-test_aggregate-2030876000"}} Nov 01 18:54:24.910079 n-d-863052-2 devstack@n-api.service[121403]: method: > Nov 01 18:54:24.910079 n-d-863052-2 devstack@n-api.service[121403]: exception: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Nov 01 18:54:24.910865 n-d-863052-2 devstack@n-api.service[121403]: action_args: {'body': {'aggregate': {'name': 'tempest-test_aggregate-2030876000'}}} Nov 01 18:54:24.910865 n-d-863052-2 devstack@n-api.service[121403]: {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 01 18:54:24.910865 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:54:24.910865 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 18:54:24.910865 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 18:54:24.910865 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 01 18:54:24.910865 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 01 18:54:24.910865 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 01 18:54:24.910865 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 01 18:54:24.910865 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 01 18:54:24.910865 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 01 18:54:24.910865 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 01 18:54:24.910865 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 01 18:54:24.910865 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 70, in create Nov 01 18:54:24.910865 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'create', target={}) Nov 01 18:54:24.910865 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Nov 01 18:54:24.910865 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Nov 01 18:54:24.910865 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Nov 01 18:54:24.910865 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Nov 01 18:54:24.911952 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 01 18:54:24.911952 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 01 18:54:24.911952 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 01 18:54:24.911952 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise self.value Nov 01 18:54:24.911952 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Nov 01 18:54:24.911952 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Nov 01 18:54:24.911952 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Nov 01 18:54:24.911952 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return self.enforce( Nov 01 18:54:24.911952 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Nov 01 18:54:24.911952 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Nov 01 18:54:24.911952 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Nov 01 18:54:24.911952 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 18:54:24.911952 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 18:54:24.911952 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 18:54:24.911952 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:54:24.911952 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 18:54:24.911952 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 18:54:24.911952 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Nov 01 18:54:24.911952 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Nov 01 18:54:24.911952 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Nov 01 18:54:24.913139 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 18:54:24.913139 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-f3b9c459-f57a-4a01-991b-7f11cb125dd7 tempest-AggregatesAdminNegativeTestJSON-701968823 tempest-AggregatesAdminNegativeTestJSON-701968823-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. {{(pid=121403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 01 18:54:24.913139 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-f3b9c459-f57a-4a01-991b-7f11cb125dd7 tempest-AggregatesAdminNegativeTestJSON-701968823 tempest-AggregatesAdminNegativeTestJSON-701968823-project] 10.222.0.13 "POST /compute/v2.1/os-aggregates" status: 403 len: 116 microversion: 2.1 time: 0.020923 Nov 01 18:54:24.919908 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 16/44] 10.222.0.13 () {60 vars in 1164 bytes} [Tue Nov 1 18:54:24 2022] POST /compute/v2.1/os-aggregates => generated 116 bytes in 25 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Nov 01 18:54:24.923253 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-e3246ae1-b6f2-444b-a30f-5b94df84b32e tempest-FlavorsAccessNegativeTestJSON-1324123958 tempest-FlavorsAccessNegativeTestJSON-1324123958-project-admin] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:54:24.949048 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-e3246ae1-b6f2-444b-a30f-5b94df84b32e tempest-FlavorsAccessNegativeTestJSON-1324123958 tempest-FlavorsAccessNegativeTestJSON-1324123958-project-admin] 10.222.0.13 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.034106 Nov 01 18:54:24.949966 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 17/45] 10.222.0.13 () {58 vars in 1146 bytes} [Tue Nov 1 18:54:24 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:54:24.964919 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-8c35c7dd-616d-46d6-84e6-fcf808095b6e tempest-AggregatesAdminNegativeTestJSON-1815627383 tempest-AggregatesAdminNegativeTestJSON-1815627383-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1171227857"}} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 18:54:24.968982 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.objects.aggregate [None req-8c35c7dd-616d-46d6-84e6-fcf808095b6e tempest-AggregatesAdminNegativeTestJSON-1815627383 tempest-AggregatesAdminNegativeTestJSON-1815627383-project-admin] Generated uuid f6465f83-f6d5-4b95-8b88-84efbc97aedc for aggregate {{(pid=121403) create /opt/stack/nova/nova/objects/aggregate.py:298}} Nov 01 18:54:25.034605 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-8c35c7dd-616d-46d6-84e6-fcf808095b6e tempest-AggregatesAdminNegativeTestJSON-1815627383 tempest-AggregatesAdminNegativeTestJSON-1815627383-project-admin] 10.222.0.13 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.080940 Nov 01 18:54:25.040937 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 18/46] 10.222.0.13 () {60 vars in 1164 bytes} [Tue Nov 1 18:54:24 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 18:54:25.047100 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-01fd7b29-87fd-4585-b91d-81488d70abec tempest-FlavorsAccessNegativeTestJSON-1324123958 tempest-FlavorsAccessNegativeTestJSON-1324123958-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1330653695", "id": 1403947932, "os-flavor-access:is_public": "False"}} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 18:54:25.093067 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-01fd7b29-87fd-4585-b91d-81488d70abec tempest-FlavorsAccessNegativeTestJSON-1324123958 tempest-FlavorsAccessNegativeTestJSON-1324123958-project-admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 439 microversion: 2.1 time: 0.050006 Nov 01 18:54:25.096977 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-eb654711-bc06-453a-b4c9-2ae3bb65700c tempest-AggregatesAdminTestJSON-768412114 tempest-AggregatesAdminTestJSON-768412114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439a7ac2509640c49361f9ba6636b34d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8382e1376b104295aa5cef36ba07cf45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:54:25.101515 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 19/47] 10.222.0.13 () {60 vars in 1147 bytes} [Tue Nov 1 18:54:25 2022] POST /compute/v2.1/flavors => generated 439 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 18:54:25.106876 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-eb654711-bc06-453a-b4c9-2ae3bb65700c tempest-AggregatesAdminTestJSON-768412114 tempest-AggregatesAdminTestJSON-768412114-project] 10.222.0.13 "GET /compute/v2.1/servers/7967bf1f-943f-441d-befd-373868bbb3aa" status: 200 len: 1242 microversion: 2.1 time: 0.213860 Nov 01 18:54:25.107449 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 29/48] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:54:24 2022] GET /compute/v2.1/servers/7967bf1f-943f-441d-befd-373868bbb3aa => generated 1242 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:54:25.122078 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-db90ccca-35e3-4f16-af00-07e20493e4c9 tempest-AggregatesAdminNegativeTestJSON-1815627383 tempest-AggregatesAdminNegativeTestJSON-1815627383-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1171227857"}} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 18:54:25.128885 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.objects.aggregate [None req-db90ccca-35e3-4f16-af00-07e20493e4c9 tempest-AggregatesAdminNegativeTestJSON-1815627383 tempest-AggregatesAdminNegativeTestJSON-1815627383-project-admin] Generated uuid 50da3baa-283e-4aeb-b30f-efdca8280a4b for aggregate {{(pid=121403) create /opt/stack/nova/nova/objects/aggregate.py:298}} Nov 01 18:54:25.144766 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.wsgi [None req-db90ccca-35e3-4f16-af00-07e20493e4c9 tempest-AggregatesAdminNegativeTestJSON-1815627383 tempest-AggregatesAdminNegativeTestJSON-1815627383-project-admin] HTTP exception thrown: Aggregate tempest-test_aggregate-1171227857 already exists. Nov 01 18:54:25.147163 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-db90ccca-35e3-4f16-af00-07e20493e4c9 tempest-AggregatesAdminNegativeTestJSON-1815627383 tempest-AggregatesAdminNegativeTestJSON-1815627383-project-admin] Request method failure captured: Nov 01 18:54:25.147163 n-d-863052-2 devstack@n-api.service[121403]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Nov 01 18:54:25.147163 n-d-863052-2 devstack@n-api.service[121403]: Accept: application/json Nov 01 18:54:25.147163 n-d-863052-2 devstack@n-api.service[121403]: Accept-Encoding: identity Nov 01 18:54:25.147163 n-d-863052-2 devstack@n-api.service[121403]: Connection: close Nov 01 18:54:25.147163 n-d-863052-2 devstack@n-api.service[121403]: Content-Length: 60 Nov 01 18:54:25.147163 n-d-863052-2 devstack@n-api.service[121403]: Content-Type: application/json Nov 01 18:54:25.147163 n-d-863052-2 devstack@n-api.service[121403]: Host: 10.222.0.13 Nov 01 18:54:25.147163 n-d-863052-2 devstack@n-api.service[121403]: Openstack-System-Scope: None Nov 01 18:54:25.147163 n-d-863052-2 devstack@n-api.service[121403]: User-Agent: python-urllib3/1.26.12 Nov 01 18:54:25.147163 n-d-863052-2 devstack@n-api.service[121403]: X-Auth-Token: gAAAAABjYWtaOKWCV3M4Q9P_m1t8bGgxDQkcvYwf_Ps7PzARRUub1dlRxoN3WEeASuv14dc3CyCQ8TmOXer2bxb0hUPpMshCv0Cmn5BRA-Qnk1qDPphkl5oircZzNZGMuZgA5lMqzCR8y9Yywlv7fSmfpCEiAjI39vME7oMbjgkHjO3679hxVVg Nov 01 18:54:25.147163 n-d-863052-2 devstack@n-api.service[121403]: X-Domain-Id: None Nov 01 18:54:25.147163 n-d-863052-2 devstack@n-api.service[121403]: X-Domain-Name: None Nov 01 18:54:25.147163 n-d-863052-2 devstack@n-api.service[121403]: X-Identity-Status: Confirmed Nov 01 18:54:25.147163 n-d-863052-2 devstack@n-api.service[121403]: X-Is-Admin-Project: True Nov 01 18:54:25.147163 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Domain-Id: default Nov 01 18:54:25.147163 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Domain-Name: Default Nov 01 18:54:25.147163 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Id: 1000a18d48e74513aa3f04bb3f4446ff Nov 01 18:54:25.147163 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1815627383 Nov 01 18:54:25.147163 n-d-863052-2 devstack@n-api.service[121403]: X-Role: admin,member,reader Nov 01 18:54:25.147163 n-d-863052-2 devstack@n-api.service[121403]: X-Roles: admin,member,reader Nov 01 18:54:25.148449 n-d-863052-2 devstack@n-api.service[121403]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/1000a18d48e74513aa3f04bb3f4446ff"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/1000a18d48e74513aa3f04bb3f4446ff"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_1000a18d48e74513aa3f04bb3f4446ff", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/1000a18d48e74513aa3f04bb3f4446ff"}]}] Nov 01 18:54:25.148449 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1815627383 Nov 01 18:54:25.148449 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant-Id: 1000a18d48e74513aa3f04bb3f4446ff Nov 01 18:54:25.148449 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1815627383 Nov 01 18:54:25.148449 n-d-863052-2 devstack@n-api.service[121403]: X-User: tempest-AggregatesAdminNegativeTestJSON-1815627383-project-admin Nov 01 18:54:25.148449 n-d-863052-2 devstack@n-api.service[121403]: X-User-Domain-Id: default Nov 01 18:54:25.148449 n-d-863052-2 devstack@n-api.service[121403]: X-User-Domain-Name: Default Nov 01 18:54:25.148449 n-d-863052-2 devstack@n-api.service[121403]: X-User-Id: c9f24a2ce22a47d28828869433d41de9 Nov 01 18:54:25.148449 n-d-863052-2 devstack@n-api.service[121403]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1815627383-project-admin Nov 01 18:54:25.148449 n-d-863052-2 devstack@n-api.service[121403]: Nov 01 18:54:25.148449 n-d-863052-2 devstack@n-api.service[121403]: {"aggregate": {"name": "tempest-test_aggregate-1171227857"}} Nov 01 18:54:25.148449 n-d-863052-2 devstack@n-api.service[121403]: method: > Nov 01 18:54:25.148449 n-d-863052-2 devstack@n-api.service[121403]: exception: Aggregate tempest-test_aggregate-1171227857 already exists. Nov 01 18:54:25.149273 n-d-863052-2 devstack@n-api.service[121403]: action_args: {'body': {'aggregate': {'name': 'tempest-test_aggregate-1171227857'}}} Nov 01 18:54:25.149273 n-d-863052-2 devstack@n-api.service[121403]: {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 01 18:54:25.149273 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:54:25.149273 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 78, in create Nov 01 18:54:25.149273 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi aggregate = self.api.create_aggregate(context, name, avail_zone) Nov 01 18:54:25.149273 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Nov 01 18:54:25.149273 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Nov 01 18:54:25.149273 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 01 18:54:25.149273 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 01 18:54:25.149273 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 01 18:54:25.149273 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise self.value Nov 01 18:54:25.149273 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Nov 01 18:54:25.149273 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Nov 01 18:54:25.149273 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6458, in create_aggregate Nov 01 18:54:25.149273 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi aggregate.create() Nov 01 18:54:25.149273 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Nov 01 18:54:25.149273 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Nov 01 18:54:25.149273 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 310, in create Nov 01 18:54:25.149273 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_create_in_db(self._context, updates, Nov 01 18:54:25.151710 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Nov 01 18:54:25.151710 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Nov 01 18:54:25.151710 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 175, in _aggregate_create_in_db Nov 01 18:54:25.151710 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise exception.AggregateNameExists(aggregate_name=values['name']) Nov 01 18:54:25.151710 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNameExists: Aggregate tempest-test_aggregate-1171227857 already exists. Nov 01 18:54:25.151710 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 18:54:25.151710 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 18:54:25.151710 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 18:54:25.151710 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:54:25.151710 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 18:54:25.151710 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 18:54:25.151710 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 01 18:54:25.151710 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 01 18:54:25.151710 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 01 18:54:25.151710 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 01 18:54:25.151710 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 01 18:54:25.151710 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 01 18:54:25.151710 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 01 18:54:25.151710 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 01 18:54:25.151710 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 80, in create Nov 01 18:54:25.153208 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise exc.HTTPConflict(explanation=e.format_message()) Nov 01 18:54:25.153208 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Aggregate tempest-test_aggregate-1171227857 already exists. Nov 01 18:54:25.153208 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 18:54:25.153208 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 18:54:25.153208 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 18:54:25.153208 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:54:25.153208 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 18:54:25.153208 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 18:54:25.153208 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 01 18:54:25.153208 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 01 18:54:25.153208 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate tempest-test_aggregate-1171227857 already exists. Nov 01 18:54:25.153208 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 18:54:25.157684 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-db90ccca-35e3-4f16-af00-07e20493e4c9 tempest-AggregatesAdminNegativeTestJSON-1815627383 tempest-AggregatesAdminNegativeTestJSON-1815627383-project-admin] Returning 409 to user: Aggregate tempest-test_aggregate-1171227857 already exists. {{(pid=121403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 01 18:54:25.163069 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-db90ccca-35e3-4f16-af00-07e20493e4c9 tempest-AggregatesAdminNegativeTestJSON-1815627383 tempest-AggregatesAdminNegativeTestJSON-1815627383-project-admin] 10.222.0.13 "POST /compute/v2.1/os-aggregates" status: 409 len: 111 microversion: 2.1 time: 0.060074 Nov 01 18:54:25.164061 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 20/49] 10.222.0.13 () {60 vars in 1164 bytes} [Tue Nov 1 18:54:25 2022] POST /compute/v2.1/os-aggregates => generated 111 bytes in 62 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Nov 01 18:54:25.173295 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-63f784a1-0015-4c2b-9e7f-b90ce17b407a tempest-AggregatesAdminNegativeTestJSON-1815627383 tempest-AggregatesAdminNegativeTestJSON-1815627383-project-admin] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:54:25.200392 n-d-863052-2 devstack@n-api.service[121403]: DEBUG dbcounter [-] [121403] Writing DB stats nova_api:SELECT=84,nova_api:INSERT=12,nova_api:DELETE=4 {{(pid=121403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 18:54:25.242111 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-63f784a1-0015-4c2b-9e7f-b90ce17b407a tempest-AggregatesAdminNegativeTestJSON-1815627383 tempest-AggregatesAdminNegativeTestJSON-1815627383-project-admin] 10.222.0.13 "DELETE /compute/v2.1/os-aggregates/6" status: 200 len: 0 microversion: 2.1 time: 0.072358 Nov 01 18:54:25.244698 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 21/50] 10.222.0.13 () {58 vars in 1152 bytes} [Tue Nov 1 18:54:25 2022] DELETE /compute/v2.1/os-aggregates/6 => generated 0 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Nov 01 18:54:25.261132 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-0fba4d32-78e9-4313-b875-5e6aa4f543f1 tempest-AggregatesAdminNegativeTestJSON-1815627383 tempest-AggregatesAdminNegativeTestJSON-1815627383-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1587488292"}} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 18:54:25.264943 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.objects.aggregate [None req-0fba4d32-78e9-4313-b875-5e6aa4f543f1 tempest-AggregatesAdminNegativeTestJSON-1815627383 tempest-AggregatesAdminNegativeTestJSON-1815627383-project-admin] Generated uuid a01fc373-70ae-4a3e-b9d0-427dc65c11a6 for aggregate {{(pid=121403) create /opt/stack/nova/nova/objects/aggregate.py:298}} Nov 01 18:54:25.319097 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-0fba4d32-78e9-4313-b875-5e6aa4f543f1 tempest-AggregatesAdminNegativeTestJSON-1815627383 tempest-AggregatesAdminNegativeTestJSON-1815627383-project-admin] 10.222.0.13 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.068607 Nov 01 18:54:25.320512 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 22/51] 10.222.0.13 () {60 vars in 1164 bytes} [Tue Nov 1 18:54:25 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 18:54:25.348195 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-96e476ad-a31d-42e4-ad4b-ebec1112a946 tempest-AggregatesAdminNegativeTestJSON-701968823 tempest-AggregatesAdminNegativeTestJSON-701968823-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:54:25.351155 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-96e476ad-a31d-42e4-ad4b-ebec1112a946 tempest-AggregatesAdminNegativeTestJSON-701968823 tempest-AggregatesAdminNegativeTestJSON-701968823-project] Policy check for os_compute_api:os-aggregates:delete failed with credentials {'is_admin': False, 'user_id': '050138637ab247cabfa21c187e4463dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440456c174424b5c8a796711a95a8b69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:54:25.356375 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-96e476ad-a31d-42e4-ad4b-ebec1112a946 tempest-AggregatesAdminNegativeTestJSON-701968823 tempest-AggregatesAdminNegativeTestJSON-701968823-project] Request method failure captured: Nov 01 18:54:25.356375 n-d-863052-2 devstack@n-api.service[121403]: request: DELETE /compute/v2.1/os-aggregates/7 HTTP/1.1 Nov 01 18:54:25.356375 n-d-863052-2 devstack@n-api.service[121403]: Accept: application/json Nov 01 18:54:25.356375 n-d-863052-2 devstack@n-api.service[121403]: Accept-Encoding: identity Nov 01 18:54:25.356375 n-d-863052-2 devstack@n-api.service[121403]: Connection: close Nov 01 18:54:25.356375 n-d-863052-2 devstack@n-api.service[121403]: Content-Length: 0 Nov 01 18:54:25.356375 n-d-863052-2 devstack@n-api.service[121403]: Content-Type: application/json Nov 01 18:54:25.356375 n-d-863052-2 devstack@n-api.service[121403]: Host: 10.222.0.13 Nov 01 18:54:25.356375 n-d-863052-2 devstack@n-api.service[121403]: Openstack-System-Scope: None Nov 01 18:54:25.356375 n-d-863052-2 devstack@n-api.service[121403]: User-Agent: python-urllib3/1.26.12 Nov 01 18:54:25.356375 n-d-863052-2 devstack@n-api.service[121403]: X-Auth-Token: gAAAAABjYWtYF75HWf8dApD_m447tyf_mGJPzf8sow1wwvz71bWsgfnuNEDZD8kc7FNf8UQaBOnL1PRXNN_SusWujUfI-Zl9-t1OxUPEVGqV5sgKS3MOb-9Fl7jDxrPPOZQJ67Sffw3RwRGNWR2S2MXGQmO3tiflrv5n_iOXTXf2esQHwC8DD0E Nov 01 18:54:25.356375 n-d-863052-2 devstack@n-api.service[121403]: X-Domain-Id: None Nov 01 18:54:25.356375 n-d-863052-2 devstack@n-api.service[121403]: X-Domain-Name: None Nov 01 18:54:25.356375 n-d-863052-2 devstack@n-api.service[121403]: X-Identity-Status: Confirmed Nov 01 18:54:25.356375 n-d-863052-2 devstack@n-api.service[121403]: X-Is-Admin-Project: True Nov 01 18:54:25.356375 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Domain-Id: default Nov 01 18:54:25.356375 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Domain-Name: Default Nov 01 18:54:25.356375 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Id: 440456c174424b5c8a796711a95a8b69 Nov 01 18:54:25.356375 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-701968823 Nov 01 18:54:25.356375 n-d-863052-2 devstack@n-api.service[121403]: X-Role: member,reader Nov 01 18:54:25.356375 n-d-863052-2 devstack@n-api.service[121403]: X-Roles: member,reader Nov 01 18:54:25.357984 n-d-863052-2 devstack@n-api.service[121403]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/440456c174424b5c8a796711a95a8b69"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/440456c174424b5c8a796711a95a8b69"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_440456c174424b5c8a796711a95a8b69", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/440456c174424b5c8a796711a95a8b69"}]}] Nov 01 18:54:25.357984 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-701968823 Nov 01 18:54:25.357984 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant-Id: 440456c174424b5c8a796711a95a8b69 Nov 01 18:54:25.357984 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-701968823 Nov 01 18:54:25.357984 n-d-863052-2 devstack@n-api.service[121403]: X-User: tempest-AggregatesAdminNegativeTestJSON-701968823-project Nov 01 18:54:25.357984 n-d-863052-2 devstack@n-api.service[121403]: X-User-Domain-Id: default Nov 01 18:54:25.357984 n-d-863052-2 devstack@n-api.service[121403]: X-User-Domain-Name: Default Nov 01 18:54:25.357984 n-d-863052-2 devstack@n-api.service[121403]: X-User-Id: 050138637ab247cabfa21c187e4463dc Nov 01 18:54:25.357984 n-d-863052-2 devstack@n-api.service[121403]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-701968823-project Nov 01 18:54:25.357984 n-d-863052-2 devstack@n-api.service[121403]: method: > Nov 01 18:54:25.357984 n-d-863052-2 devstack@n-api.service[121403]: exception: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Nov 01 18:54:25.357984 n-d-863052-2 devstack@n-api.service[121403]: action_args: {'id': '7'} Nov 01 18:54:25.358723 n-d-863052-2 devstack@n-api.service[121403]: {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 01 18:54:25.358723 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:54:25.358723 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 18:54:25.358723 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 18:54:25.358723 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 01 18:54:25.358723 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 01 18:54:25.358723 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 01 18:54:25.358723 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 01 18:54:25.358723 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 147, in delete Nov 01 18:54:25.358723 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'delete', target={}) Nov 01 18:54:25.358723 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Nov 01 18:54:25.358723 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Nov 01 18:54:25.358723 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Nov 01 18:54:25.358723 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Nov 01 18:54:25.358723 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 01 18:54:25.358723 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 01 18:54:25.358723 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 01 18:54:25.358723 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise self.value Nov 01 18:54:25.358723 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Nov 01 18:54:25.359821 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Nov 01 18:54:25.359821 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Nov 01 18:54:25.359821 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return self.enforce( Nov 01 18:54:25.359821 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Nov 01 18:54:25.359821 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Nov 01 18:54:25.359821 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Nov 01 18:54:25.359821 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 18:54:25.359821 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 18:54:25.359821 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 18:54:25.359821 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:54:25.359821 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 18:54:25.359821 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 18:54:25.359821 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Nov 01 18:54:25.359821 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Nov 01 18:54:25.359821 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Nov 01 18:54:25.359821 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 18:54:25.365000 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-96e476ad-a31d-42e4-ad4b-ebec1112a946 tempest-AggregatesAdminNegativeTestJSON-701968823 tempest-AggregatesAdminNegativeTestJSON-701968823-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. {{(pid=121403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 01 18:54:25.365986 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-96e476ad-a31d-42e4-ad4b-ebec1112a946 tempest-AggregatesAdminNegativeTestJSON-701968823 tempest-AggregatesAdminNegativeTestJSON-701968823-project] 10.222.0.13 "DELETE /compute/v2.1/os-aggregates/7" status: 403 len: 116 microversion: 2.1 time: 0.037066 Nov 01 18:54:25.367808 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 23/52] 10.222.0.13 () {58 vars in 1152 bytes} [Tue Nov 1 18:54:25 2022] DELETE /compute/v2.1/os-aggregates/7 => generated 116 bytes in 40 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Nov 01 18:54:25.385710 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-11686ce3-e454-4804-884f-80f807f724b6 tempest-AggregatesAdminNegativeTestJSON-1815627383 tempest-AggregatesAdminNegativeTestJSON-1815627383-project-admin] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:54:25.455935 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-11686ce3-e454-4804-884f-80f807f724b6 tempest-AggregatesAdminNegativeTestJSON-1815627383 tempest-AggregatesAdminNegativeTestJSON-1815627383-project-admin] 10.222.0.13 "DELETE /compute/v2.1/os-aggregates/7" status: 200 len: 0 microversion: 2.1 time: 0.082804 Nov 01 18:54:25.457320 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 24/53] 10.222.0.13 () {58 vars in 1152 bytes} [Tue Nov 1 18:54:25 2022] DELETE /compute/v2.1/os-aggregates/7 => generated 0 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Nov 01 18:54:25.467507 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-e146bd87-b3d9-4463-ad66-be085b4b9a2d tempest-AggregatesAdminNegativeTestJSON-1815627383 tempest-AggregatesAdminNegativeTestJSON-1815627383-project-admin] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:54:25.499146 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.wsgi [None req-e146bd87-b3d9-4463-ad66-be085b4b9a2d tempest-AggregatesAdminNegativeTestJSON-1815627383 tempest-AggregatesAdminNegativeTestJSON-1815627383-project-admin] HTTP exception thrown: Aggregate -1 could not be found. Nov 01 18:54:25.502032 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-e146bd87-b3d9-4463-ad66-be085b4b9a2d tempest-AggregatesAdminNegativeTestJSON-1815627383 tempest-AggregatesAdminNegativeTestJSON-1815627383-project-admin] Request method failure captured: Nov 01 18:54:25.502032 n-d-863052-2 devstack@n-api.service[121403]: request: DELETE /compute/v2.1/os-aggregates/-1 HTTP/1.1 Nov 01 18:54:25.502032 n-d-863052-2 devstack@n-api.service[121403]: Accept: application/json Nov 01 18:54:25.502032 n-d-863052-2 devstack@n-api.service[121403]: Accept-Encoding: identity Nov 01 18:54:25.502032 n-d-863052-2 devstack@n-api.service[121403]: Connection: close Nov 01 18:54:25.502032 n-d-863052-2 devstack@n-api.service[121403]: Content-Length: 0 Nov 01 18:54:25.502032 n-d-863052-2 devstack@n-api.service[121403]: Content-Type: application/json Nov 01 18:54:25.502032 n-d-863052-2 devstack@n-api.service[121403]: Host: 10.222.0.13 Nov 01 18:54:25.502032 n-d-863052-2 devstack@n-api.service[121403]: Openstack-System-Scope: None Nov 01 18:54:25.502032 n-d-863052-2 devstack@n-api.service[121403]: User-Agent: python-urllib3/1.26.12 Nov 01 18:54:25.502032 n-d-863052-2 devstack@n-api.service[121403]: X-Auth-Token: gAAAAABjYWtaOKWCV3M4Q9P_m1t8bGgxDQkcvYwf_Ps7PzARRUub1dlRxoN3WEeASuv14dc3CyCQ8TmOXer2bxb0hUPpMshCv0Cmn5BRA-Qnk1qDPphkl5oircZzNZGMuZgA5lMqzCR8y9Yywlv7fSmfpCEiAjI39vME7oMbjgkHjO3679hxVVg Nov 01 18:54:25.502032 n-d-863052-2 devstack@n-api.service[121403]: X-Domain-Id: None Nov 01 18:54:25.502032 n-d-863052-2 devstack@n-api.service[121403]: X-Domain-Name: None Nov 01 18:54:25.502032 n-d-863052-2 devstack@n-api.service[121403]: X-Identity-Status: Confirmed Nov 01 18:54:25.502032 n-d-863052-2 devstack@n-api.service[121403]: X-Is-Admin-Project: True Nov 01 18:54:25.502032 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Domain-Id: default Nov 01 18:54:25.502032 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Domain-Name: Default Nov 01 18:54:25.502032 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Id: 1000a18d48e74513aa3f04bb3f4446ff Nov 01 18:54:25.502032 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1815627383 Nov 01 18:54:25.502032 n-d-863052-2 devstack@n-api.service[121403]: X-Role: admin,member,reader Nov 01 18:54:25.502032 n-d-863052-2 devstack@n-api.service[121403]: X-Roles: admin,member,reader Nov 01 18:54:25.503256 n-d-863052-2 devstack@n-api.service[121403]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/1000a18d48e74513aa3f04bb3f4446ff"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/1000a18d48e74513aa3f04bb3f4446ff"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_1000a18d48e74513aa3f04bb3f4446ff", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/1000a18d48e74513aa3f04bb3f4446ff"}]}] Nov 01 18:54:25.503256 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1815627383 Nov 01 18:54:25.503256 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant-Id: 1000a18d48e74513aa3f04bb3f4446ff Nov 01 18:54:25.503256 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1815627383 Nov 01 18:54:25.503256 n-d-863052-2 devstack@n-api.service[121403]: X-User: tempest-AggregatesAdminNegativeTestJSON-1815627383-project-admin Nov 01 18:54:25.503256 n-d-863052-2 devstack@n-api.service[121403]: X-User-Domain-Id: default Nov 01 18:54:25.503256 n-d-863052-2 devstack@n-api.service[121403]: X-User-Domain-Name: Default Nov 01 18:54:25.503256 n-d-863052-2 devstack@n-api.service[121403]: X-User-Id: c9f24a2ce22a47d28828869433d41de9 Nov 01 18:54:25.503256 n-d-863052-2 devstack@n-api.service[121403]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1815627383-project-admin Nov 01 18:54:25.503256 n-d-863052-2 devstack@n-api.service[121403]: method: > Nov 01 18:54:25.503256 n-d-863052-2 devstack@n-api.service[121403]: exception: Aggregate -1 could not be found. Nov 01 18:54:25.503256 n-d-863052-2 devstack@n-api.service[121403]: action_args: {'id': '-1'} Nov 01 18:54:25.503971 n-d-863052-2 devstack@n-api.service[121403]: {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 01 18:54:25.503971 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:54:25.503971 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Nov 01 18:54:25.503971 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Nov 01 18:54:25.503971 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Nov 01 18:54:25.503971 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Nov 01 18:54:25.503971 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 01 18:54:25.503971 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 01 18:54:25.503971 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 01 18:54:25.503971 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise self.value Nov 01 18:54:25.503971 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Nov 01 18:54:25.503971 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Nov 01 18:54:25.503971 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6517, in delete_aggregate Nov 01 18:54:25.503971 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Nov 01 18:54:25.503971 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 01 18:54:25.503971 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 01 18:54:25.503971 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Nov 01 18:54:25.503971 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Nov 01 18:54:25.503971 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Nov 01 18:54:25.505114 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Nov 01 18:54:25.505114 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Nov 01 18:54:25.505114 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Nov 01 18:54:25.505114 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate -1 could not be found. Nov 01 18:54:25.505114 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 18:54:25.505114 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 18:54:25.505114 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 18:54:25.505114 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:54:25.505114 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 18:54:25.505114 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 18:54:25.505114 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 01 18:54:25.505114 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 01 18:54:25.505114 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 01 18:54:25.505114 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 01 18:54:25.505114 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Nov 01 18:54:25.505114 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 01 18:54:25.505114 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate -1 could not be found. Nov 01 18:54:25.505114 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 18:54:25.505114 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 18:54:25.505114 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 18:54:25.505114 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:54:25.506299 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 18:54:25.506299 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 18:54:25.506299 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 01 18:54:25.506299 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 01 18:54:25.506299 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate -1 could not be found. Nov 01 18:54:25.506299 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 18:54:25.506299 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-e146bd87-b3d9-4463-ad66-be085b4b9a2d tempest-AggregatesAdminNegativeTestJSON-1815627383 tempest-AggregatesAdminNegativeTestJSON-1815627383-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=121403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 01 18:54:25.506299 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-e146bd87-b3d9-4463-ad66-be085b4b9a2d tempest-AggregatesAdminNegativeTestJSON-1815627383 tempest-AggregatesAdminNegativeTestJSON-1815627383-project-admin] 10.222.0.13 "DELETE /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.042584 Nov 01 18:54:25.507289 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 25/54] 10.222.0.13 () {58 vars in 1155 bytes} [Tue Nov 1 18:54:25 2022] DELETE /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 01 18:54:25.528318 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-890862dd-8ff3-464f-b98d-cded8d49fc81 tempest-AggregatesAdminNegativeTestJSON-1815627383 tempest-AggregatesAdminNegativeTestJSON-1815627383-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-2049422586"}} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 18:54:25.532115 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.objects.aggregate [None req-890862dd-8ff3-464f-b98d-cded8d49fc81 tempest-AggregatesAdminNegativeTestJSON-1815627383 tempest-AggregatesAdminNegativeTestJSON-1815627383-project-admin] Generated uuid c5b78b17-5ca5-4861-9b7e-d80f98653e69 for aggregate {{(pid=121403) create /opt/stack/nova/nova/objects/aggregate.py:298}} Nov 01 18:54:25.587031 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-e259f6ce-3c16-4260-ad28-0c62e643b1bf tempest-FlavorsAccessNegativeTestJSON-1511445044 tempest-FlavorsAccessNegativeTestJSON-1511445044-project] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "2ab59873a8224b47ba0d6ca3ee7e021b"}} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 18:54:25.594168 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-e259f6ce-3c16-4260-ad28-0c62e643b1bf tempest-FlavorsAccessNegativeTestJSON-1511445044 tempest-FlavorsAccessNegativeTestJSON-1511445044-project] Policy check for os_compute_api:os-flavor-access:add_tenant_access failed with credentials {'is_admin': False, 'user_id': 'b35a70cffa1a4a198237df53ded3bb34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ab59873a8224b47ba0d6ca3ee7e021b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:54:25.597383 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-e259f6ce-3c16-4260-ad28-0c62e643b1bf tempest-FlavorsAccessNegativeTestJSON-1511445044 tempest-FlavorsAccessNegativeTestJSON-1511445044-project] Request method failure captured: Nov 01 18:54:25.597383 n-d-863052-2 devstack@n-api.service[121402]: request: POST /compute/v2.1/flavors/1403947932/action HTTP/1.1 Nov 01 18:54:25.597383 n-d-863052-2 devstack@n-api.service[121402]: Accept: application/json Nov 01 18:54:25.597383 n-d-863052-2 devstack@n-api.service[121402]: Accept-Encoding: identity Nov 01 18:54:25.597383 n-d-863052-2 devstack@n-api.service[121402]: Connection: close Nov 01 18:54:25.597383 n-d-863052-2 devstack@n-api.service[121402]: Content-Length: 67 Nov 01 18:54:25.597383 n-d-863052-2 devstack@n-api.service[121402]: Content-Type: application/json Nov 01 18:54:25.597383 n-d-863052-2 devstack@n-api.service[121402]: Host: 10.222.0.13 Nov 01 18:54:25.597383 n-d-863052-2 devstack@n-api.service[121402]: Openstack-System-Scope: None Nov 01 18:54:25.597383 n-d-863052-2 devstack@n-api.service[121402]: User-Agent: python-urllib3/1.26.12 Nov 01 18:54:25.597383 n-d-863052-2 devstack@n-api.service[121402]: X-Auth-Token: gAAAAABjYWtYpXJvz4O35i5OIXqPYRVy2zqu47yQ4kTVTKLHrVbFcT_jixDWoDTk5h9ybbXZkqa6XI_kd4KTPgnbzQBnKPm0WQuOEBs0GFQYEKh-BejIrHzbH9acDh07idUeW4FfJgAxoLe4jTkBoUJLAa6DFG91RDl4WxYjyJnyKntNcudYGtk Nov 01 18:54:25.597383 n-d-863052-2 devstack@n-api.service[121402]: X-Domain-Id: None Nov 01 18:54:25.597383 n-d-863052-2 devstack@n-api.service[121402]: X-Domain-Name: None Nov 01 18:54:25.597383 n-d-863052-2 devstack@n-api.service[121402]: X-Identity-Status: Confirmed Nov 01 18:54:25.597383 n-d-863052-2 devstack@n-api.service[121402]: X-Is-Admin-Project: True Nov 01 18:54:25.597383 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Domain-Id: default Nov 01 18:54:25.597383 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Domain-Name: Default Nov 01 18:54:25.597383 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Id: 2ab59873a8224b47ba0d6ca3ee7e021b Nov 01 18:54:25.597383 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-1511445044 Nov 01 18:54:25.597383 n-d-863052-2 devstack@n-api.service[121402]: X-Role: member,reader Nov 01 18:54:25.597383 n-d-863052-2 devstack@n-api.service[121402]: X-Roles: member,reader Nov 01 18:54:25.598661 n-d-863052-2 devstack@n-api.service[121402]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/2ab59873a8224b47ba0d6ca3ee7e021b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/2ab59873a8224b47ba0d6ca3ee7e021b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_2ab59873a8224b47ba0d6ca3ee7e021b", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/2ab59873a8224b47ba0d6ca3ee7e021b"}]}] Nov 01 18:54:25.598661 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-1511445044 Nov 01 18:54:25.598661 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant-Id: 2ab59873a8224b47ba0d6ca3ee7e021b Nov 01 18:54:25.598661 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-1511445044 Nov 01 18:54:25.598661 n-d-863052-2 devstack@n-api.service[121402]: X-User: tempest-FlavorsAccessNegativeTestJSON-1511445044-project Nov 01 18:54:25.598661 n-d-863052-2 devstack@n-api.service[121402]: X-User-Domain-Id: default Nov 01 18:54:25.598661 n-d-863052-2 devstack@n-api.service[121402]: X-User-Domain-Name: Default Nov 01 18:54:25.598661 n-d-863052-2 devstack@n-api.service[121402]: X-User-Id: b35a70cffa1a4a198237df53ded3bb34 Nov 01 18:54:25.598661 n-d-863052-2 devstack@n-api.service[121402]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-1511445044-project Nov 01 18:54:25.598661 n-d-863052-2 devstack@n-api.service[121402]: Nov 01 18:54:25.598661 n-d-863052-2 devstack@n-api.service[121402]: {"addTenantAccess": {"tenant": "2ab59873a8224b47ba0d6ca3ee7e021b"}} Nov 01 18:54:25.598661 n-d-863052-2 devstack@n-api.service[121402]: method: > Nov 01 18:54:25.599344 n-d-863052-2 devstack@n-api.service[121402]: exception: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Nov 01 18:54:25.599344 n-d-863052-2 devstack@n-api.service[121402]: action_args: {'id': '1403947932', 'body': {'addTenantAccess': {'tenant': '2ab59873a8224b47ba0d6ca3ee7e021b'}}} Nov 01 18:54:25.599344 n-d-863052-2 devstack@n-api.service[121402]: {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 01 18:54:25.599344 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:54:25.599344 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 18:54:25.599344 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 18:54:25.599344 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 01 18:54:25.599344 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 01 18:54:25.599344 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 01 18:54:25.599344 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 01 18:54:25.599344 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 01 18:54:25.599344 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 01 18:54:25.599344 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 66, in _add_tenant_access Nov 01 18:54:25.599344 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi context.can(fa_policies.POLICY_ROOT % "add_tenant_access", target={}) Nov 01 18:54:25.599344 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Nov 01 18:54:25.599344 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Nov 01 18:54:25.599344 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Nov 01 18:54:25.599344 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Nov 01 18:54:25.599344 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 01 18:54:25.600221 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 01 18:54:25.600221 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 01 18:54:25.600221 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise self.value Nov 01 18:54:25.600221 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Nov 01 18:54:25.600221 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Nov 01 18:54:25.600221 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Nov 01 18:54:25.600221 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return self.enforce( Nov 01 18:54:25.600221 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Nov 01 18:54:25.600221 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Nov 01 18:54:25.600221 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Nov 01 18:54:25.600221 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 18:54:25.600221 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 18:54:25.600221 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 18:54:25.600221 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:54:25.600221 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 18:54:25.600221 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 18:54:25.600221 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Nov 01 18:54:25.600221 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Nov 01 18:54:25.600221 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Nov 01 18:54:25.600221 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 18:54:25.601220 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-e259f6ce-3c16-4260-ad28-0c62e643b1bf tempest-FlavorsAccessNegativeTestJSON-1511445044 tempest-FlavorsAccessNegativeTestJSON-1511445044-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. {{(pid=121402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 01 18:54:25.604352 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-e259f6ce-3c16-4260-ad28-0c62e643b1bf tempest-FlavorsAccessNegativeTestJSON-1511445044 tempest-FlavorsAccessNegativeTestJSON-1511445044-project] 10.222.0.13 "POST /compute/v2.1/flavors/1403947932/action" status: 403 len: 130 microversion: 2.1 time: 0.490459 Nov 01 18:54:25.611422 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 30/55] 10.222.0.13 () {60 vars in 1200 bytes} [Tue Nov 1 18:54:25 2022] POST /compute/v2.1/flavors/1403947932/action => generated 130 bytes in 499 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Nov 01 18:54:25.622743 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-d2461163-8701-41aa-8bcb-6407f7a3d98e tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:54:25.624234 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-890862dd-8ff3-464f-b98d-cded8d49fc81 tempest-AggregatesAdminNegativeTestJSON-1815627383 tempest-AggregatesAdminNegativeTestJSON-1815627383-project-admin] 10.222.0.13 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.109791 Nov 01 18:54:25.628162 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 26/56] 10.222.0.13 () {60 vars in 1164 bytes} [Tue Nov 1 18:54:25 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 18:54:25.630923 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-d2461163-8701-41aa-8bcb-6407f7a3d98e tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] [instance: 4ebac531-6f77-4108-afc9-0eccb86dee8b] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:54:25.646761 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-aef84e4c-17ee-4928-9779-853e20338f42 tempest-FlavorsAccessNegativeTestJSON-1324123958 tempest-FlavorsAccessNegativeTestJSON-1324123958-project-admin] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:54:25.658008 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-d2461163-8701-41aa-8bcb-6407f7a3d98e tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:54:25.658531 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-d2461163-8701-41aa-8bcb-6407f7a3d98e tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:54:25.658980 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-d2461163-8701-41aa-8bcb-6407f7a3d98e tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:54:25.661690 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-d2461163-8701-41aa-8bcb-6407f7a3d98e tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:54:25.663098 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-d2461163-8701-41aa-8bcb-6407f7a3d98e tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:54:25.665093 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-d2461163-8701-41aa-8bcb-6407f7a3d98e tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:54:25.692637 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-aef84e4c-17ee-4928-9779-853e20338f42 tempest-FlavorsAccessNegativeTestJSON-1324123958 tempest-FlavorsAccessNegativeTestJSON-1324123958-project-admin] 10.222.0.13 "DELETE /compute/v2.1/flavors/1403947932" status: 202 len: 0 microversion: 2.1 time: 0.060631 Nov 01 18:54:25.702209 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 27/57] 10.222.0.13 () {58 vars in 1161 bytes} [Tue Nov 1 18:54:25 2022] DELETE /compute/v2.1/flavors/1403947932 => generated 0 bytes in 73 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 01 18:54:25.707469 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-966a2f8e-7f78-446f-bf3c-cea22ce2acd5 tempest-AggregatesAdminNegativeTestJSON-701968823 tempest-AggregatesAdminNegativeTestJSON-701968823-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:54:25.711643 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-966a2f8e-7f78-446f-bf3c-cea22ce2acd5 tempest-AggregatesAdminNegativeTestJSON-701968823 tempest-AggregatesAdminNegativeTestJSON-701968823-project] Policy check for os_compute_api:os-aggregates:show failed with credentials {'is_admin': False, 'user_id': '050138637ab247cabfa21c187e4463dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440456c174424b5c8a796711a95a8b69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:54:25.717201 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-966a2f8e-7f78-446f-bf3c-cea22ce2acd5 tempest-AggregatesAdminNegativeTestJSON-701968823 tempest-AggregatesAdminNegativeTestJSON-701968823-project] Request method failure captured: Nov 01 18:54:25.717201 n-d-863052-2 devstack@n-api.service[121403]: request: GET /compute/v2.1/os-aggregates/8 HTTP/1.1 Nov 01 18:54:25.717201 n-d-863052-2 devstack@n-api.service[121403]: Accept: application/json Nov 01 18:54:25.717201 n-d-863052-2 devstack@n-api.service[121403]: Accept-Encoding: identity Nov 01 18:54:25.717201 n-d-863052-2 devstack@n-api.service[121403]: Connection: close Nov 01 18:54:25.717201 n-d-863052-2 devstack@n-api.service[121403]: Content-Length: 0 Nov 01 18:54:25.717201 n-d-863052-2 devstack@n-api.service[121403]: Content-Type: application/json Nov 01 18:54:25.717201 n-d-863052-2 devstack@n-api.service[121403]: Host: 10.222.0.13 Nov 01 18:54:25.717201 n-d-863052-2 devstack@n-api.service[121403]: Openstack-System-Scope: None Nov 01 18:54:25.717201 n-d-863052-2 devstack@n-api.service[121403]: User-Agent: python-urllib3/1.26.12 Nov 01 18:54:25.717201 n-d-863052-2 devstack@n-api.service[121403]: X-Auth-Token: gAAAAABjYWtYF75HWf8dApD_m447tyf_mGJPzf8sow1wwvz71bWsgfnuNEDZD8kc7FNf8UQaBOnL1PRXNN_SusWujUfI-Zl9-t1OxUPEVGqV5sgKS3MOb-9Fl7jDxrPPOZQJ67Sffw3RwRGNWR2S2MXGQmO3tiflrv5n_iOXTXf2esQHwC8DD0E Nov 01 18:54:25.717201 n-d-863052-2 devstack@n-api.service[121403]: X-Domain-Id: None Nov 01 18:54:25.717201 n-d-863052-2 devstack@n-api.service[121403]: X-Domain-Name: None Nov 01 18:54:25.717201 n-d-863052-2 devstack@n-api.service[121403]: X-Identity-Status: Confirmed Nov 01 18:54:25.717201 n-d-863052-2 devstack@n-api.service[121403]: X-Is-Admin-Project: True Nov 01 18:54:25.717201 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Domain-Id: default Nov 01 18:54:25.717201 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Domain-Name: Default Nov 01 18:54:25.717201 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Id: 440456c174424b5c8a796711a95a8b69 Nov 01 18:54:25.717201 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-701968823 Nov 01 18:54:25.717201 n-d-863052-2 devstack@n-api.service[121403]: X-Role: member,reader Nov 01 18:54:25.717201 n-d-863052-2 devstack@n-api.service[121403]: X-Roles: member,reader Nov 01 18:54:25.718487 n-d-863052-2 devstack@n-api.service[121403]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/440456c174424b5c8a796711a95a8b69"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/440456c174424b5c8a796711a95a8b69"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_440456c174424b5c8a796711a95a8b69", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/440456c174424b5c8a796711a95a8b69"}]}] Nov 01 18:54:25.718487 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-701968823 Nov 01 18:54:25.718487 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant-Id: 440456c174424b5c8a796711a95a8b69 Nov 01 18:54:25.718487 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-701968823 Nov 01 18:54:25.718487 n-d-863052-2 devstack@n-api.service[121403]: X-User: tempest-AggregatesAdminNegativeTestJSON-701968823-project Nov 01 18:54:25.718487 n-d-863052-2 devstack@n-api.service[121403]: X-User-Domain-Id: default Nov 01 18:54:25.718487 n-d-863052-2 devstack@n-api.service[121403]: X-User-Domain-Name: Default Nov 01 18:54:25.718487 n-d-863052-2 devstack@n-api.service[121403]: X-User-Id: 050138637ab247cabfa21c187e4463dc Nov 01 18:54:25.718487 n-d-863052-2 devstack@n-api.service[121403]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-701968823-project Nov 01 18:54:25.718487 n-d-863052-2 devstack@n-api.service[121403]: method: > Nov 01 18:54:25.718487 n-d-863052-2 devstack@n-api.service[121403]: exception: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Nov 01 18:54:25.718487 n-d-863052-2 devstack@n-api.service[121403]: action_args: {'id': '8'} Nov 01 18:54:25.719073 n-d-863052-2 devstack@n-api.service[121403]: {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 01 18:54:25.719073 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:54:25.719073 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 18:54:25.719073 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 18:54:25.719073 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 01 18:54:25.719073 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 01 18:54:25.719073 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 01 18:54:25.719073 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 01 18:54:25.719073 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 100, in show Nov 01 18:54:25.719073 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'show', target={}) Nov 01 18:54:25.719073 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Nov 01 18:54:25.719073 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Nov 01 18:54:25.719073 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Nov 01 18:54:25.719073 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Nov 01 18:54:25.719073 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 01 18:54:25.719073 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 01 18:54:25.719073 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 01 18:54:25.719073 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise self.value Nov 01 18:54:25.719073 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Nov 01 18:54:25.719962 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Nov 01 18:54:25.719962 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Nov 01 18:54:25.719962 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return self.enforce( Nov 01 18:54:25.719962 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Nov 01 18:54:25.719962 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Nov 01 18:54:25.719962 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Nov 01 18:54:25.719962 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 18:54:25.719962 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 18:54:25.719962 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 18:54:25.719962 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:54:25.719962 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 18:54:25.719962 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 18:54:25.719962 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Nov 01 18:54:25.719962 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Nov 01 18:54:25.719962 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Nov 01 18:54:25.719962 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 18:54:25.721910 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-966a2f8e-7f78-446f-bf3c-cea22ce2acd5 tempest-AggregatesAdminNegativeTestJSON-701968823 tempest-AggregatesAdminNegativeTestJSON-701968823-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. {{(pid=121403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 01 18:54:25.722946 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-966a2f8e-7f78-446f-bf3c-cea22ce2acd5 tempest-AggregatesAdminNegativeTestJSON-701968823 tempest-AggregatesAdminNegativeTestJSON-701968823-project] 10.222.0.13 "GET /compute/v2.1/os-aggregates/8" status: 403 len: 114 microversion: 2.1 time: 0.019453 Nov 01 18:54:25.728129 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 28/58] 10.222.0.13 () {58 vars in 1149 bytes} [Tue Nov 1 18:54:25 2022] GET /compute/v2.1/os-aggregates/8 => generated 114 bytes in 25 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Nov 01 18:54:25.738686 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-d81c9830-a684-440f-a4b6-d979dac18c22 tempest-FlavorsAccessNegativeTestJSON-1324123958 tempest-FlavorsAccessNegativeTestJSON-1324123958-project-admin] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:54:25.781931 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-d81c9830-a684-440f-a4b6-d979dac18c22 tempest-FlavorsAccessNegativeTestJSON-1324123958 tempest-FlavorsAccessNegativeTestJSON-1324123958-project-admin] 10.222.0.13 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.052204 Nov 01 18:54:25.783559 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 29/59] 10.222.0.13 () {58 vars in 1146 bytes} [Tue Nov 1 18:54:25 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:54:25.811838 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-98f86587-a04c-4f09-82ee-23b8bcce0b54 tempest-AggregatesAdminNegativeTestJSON-1815627383 tempest-AggregatesAdminNegativeTestJSON-1815627383-project-admin] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:54:25.852029 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-98f86587-a04c-4f09-82ee-23b8bcce0b54 tempest-AggregatesAdminNegativeTestJSON-1815627383 tempest-AggregatesAdminNegativeTestJSON-1815627383-project-admin] 10.222.0.13 "DELETE /compute/v2.1/os-aggregates/8" status: 200 len: 0 microversion: 2.1 time: 0.052388 Nov 01 18:54:25.855579 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 30/60] 10.222.0.13 () {58 vars in 1152 bytes} [Tue Nov 1 18:54:25 2022] DELETE /compute/v2.1/os-aggregates/8 => generated 0 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Nov 01 18:54:25.871095 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-ec2f6567-8453-4b79-a4d0-b9ce9f47232c tempest-FlavorsAccessNegativeTestJSON-1324123958 tempest-FlavorsAccessNegativeTestJSON-1324123958-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1221312674", "id": 1141062893, "os-flavor-access:is_public": "False"}} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 18:54:25.920941 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-ec2f6567-8453-4b79-a4d0-b9ce9f47232c tempest-FlavorsAccessNegativeTestJSON-1324123958 tempest-FlavorsAccessNegativeTestJSON-1324123958-project-admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 439 microversion: 2.1 time: 0.062476 Nov 01 18:54:25.923510 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 31/61] 10.222.0.13 () {60 vars in 1147 bytes} [Tue Nov 1 18:54:25 2022] POST /compute/v2.1/flavors => generated 439 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 18:54:25.931531 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-6b37e43c-7b6c-4158-95aa-194d8aab5bdf tempest-AggregatesAdminNegativeTestJSON-1815627383 tempest-AggregatesAdminNegativeTestJSON-1815627383-project-admin] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:54:25.941637 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.wsgi [None req-6b37e43c-7b6c-4158-95aa-194d8aab5bdf tempest-AggregatesAdminNegativeTestJSON-1815627383 tempest-AggregatesAdminNegativeTestJSON-1815627383-project-admin] HTTP exception thrown: Aggregate -1 could not be found. Nov 01 18:54:25.943720 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-6b37e43c-7b6c-4158-95aa-194d8aab5bdf tempest-AggregatesAdminNegativeTestJSON-1815627383 tempest-AggregatesAdminNegativeTestJSON-1815627383-project-admin] Request method failure captured: Nov 01 18:54:25.943720 n-d-863052-2 devstack@n-api.service[121403]: request: GET /compute/v2.1/os-aggregates/-1 HTTP/1.1 Nov 01 18:54:25.943720 n-d-863052-2 devstack@n-api.service[121403]: Accept: application/json Nov 01 18:54:25.943720 n-d-863052-2 devstack@n-api.service[121403]: Accept-Encoding: identity Nov 01 18:54:25.943720 n-d-863052-2 devstack@n-api.service[121403]: Connection: close Nov 01 18:54:25.943720 n-d-863052-2 devstack@n-api.service[121403]: Content-Length: 0 Nov 01 18:54:25.943720 n-d-863052-2 devstack@n-api.service[121403]: Content-Type: application/json Nov 01 18:54:25.943720 n-d-863052-2 devstack@n-api.service[121403]: Host: 10.222.0.13 Nov 01 18:54:25.943720 n-d-863052-2 devstack@n-api.service[121403]: Openstack-System-Scope: None Nov 01 18:54:25.943720 n-d-863052-2 devstack@n-api.service[121403]: User-Agent: python-urllib3/1.26.12 Nov 01 18:54:25.943720 n-d-863052-2 devstack@n-api.service[121403]: X-Auth-Token: gAAAAABjYWtaOKWCV3M4Q9P_m1t8bGgxDQkcvYwf_Ps7PzARRUub1dlRxoN3WEeASuv14dc3CyCQ8TmOXer2bxb0hUPpMshCv0Cmn5BRA-Qnk1qDPphkl5oircZzNZGMuZgA5lMqzCR8y9Yywlv7fSmfpCEiAjI39vME7oMbjgkHjO3679hxVVg Nov 01 18:54:25.943720 n-d-863052-2 devstack@n-api.service[121403]: X-Domain-Id: None Nov 01 18:54:25.943720 n-d-863052-2 devstack@n-api.service[121403]: X-Domain-Name: None Nov 01 18:54:25.943720 n-d-863052-2 devstack@n-api.service[121403]: X-Identity-Status: Confirmed Nov 01 18:54:25.943720 n-d-863052-2 devstack@n-api.service[121403]: X-Is-Admin-Project: True Nov 01 18:54:25.943720 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Domain-Id: default Nov 01 18:54:25.943720 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Domain-Name: Default Nov 01 18:54:25.943720 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Id: 1000a18d48e74513aa3f04bb3f4446ff Nov 01 18:54:25.943720 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1815627383 Nov 01 18:54:25.943720 n-d-863052-2 devstack@n-api.service[121403]: X-Role: admin,member,reader Nov 01 18:54:25.943720 n-d-863052-2 devstack@n-api.service[121403]: X-Roles: admin,member,reader Nov 01 18:54:25.944778 n-d-863052-2 devstack@n-api.service[121403]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/1000a18d48e74513aa3f04bb3f4446ff"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/1000a18d48e74513aa3f04bb3f4446ff"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_1000a18d48e74513aa3f04bb3f4446ff", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/1000a18d48e74513aa3f04bb3f4446ff"}]}] Nov 01 18:54:25.944778 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1815627383 Nov 01 18:54:25.944778 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant-Id: 1000a18d48e74513aa3f04bb3f4446ff Nov 01 18:54:25.944778 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1815627383 Nov 01 18:54:25.944778 n-d-863052-2 devstack@n-api.service[121403]: X-User: tempest-AggregatesAdminNegativeTestJSON-1815627383-project-admin Nov 01 18:54:25.944778 n-d-863052-2 devstack@n-api.service[121403]: X-User-Domain-Id: default Nov 01 18:54:25.944778 n-d-863052-2 devstack@n-api.service[121403]: X-User-Domain-Name: Default Nov 01 18:54:25.944778 n-d-863052-2 devstack@n-api.service[121403]: X-User-Id: c9f24a2ce22a47d28828869433d41de9 Nov 01 18:54:25.944778 n-d-863052-2 devstack@n-api.service[121403]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1815627383-project-admin Nov 01 18:54:25.944778 n-d-863052-2 devstack@n-api.service[121403]: method: > Nov 01 18:54:25.944778 n-d-863052-2 devstack@n-api.service[121403]: exception: Aggregate -1 could not be found. Nov 01 18:54:25.944778 n-d-863052-2 devstack@n-api.service[121403]: action_args: {'id': '-1'} Nov 01 18:54:25.945419 n-d-863052-2 devstack@n-api.service[121403]: {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 01 18:54:25.945419 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:54:25.945419 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Nov 01 18:54:25.945419 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Nov 01 18:54:25.945419 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6464, in get_aggregate Nov 01 18:54:25.945419 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Nov 01 18:54:25.945419 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 01 18:54:25.945419 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 01 18:54:25.945419 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Nov 01 18:54:25.945419 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Nov 01 18:54:25.945419 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Nov 01 18:54:25.945419 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Nov 01 18:54:25.945419 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Nov 01 18:54:25.945419 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Nov 01 18:54:25.945419 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate -1 could not be found. Nov 01 18:54:25.945419 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 18:54:25.945419 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 18:54:25.945419 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 18:54:25.945419 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:54:25.945419 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 18:54:25.947021 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 18:54:25.947021 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 01 18:54:25.947021 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 01 18:54:25.947021 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 01 18:54:25.947021 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 01 18:54:25.947021 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Nov 01 18:54:25.947021 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 01 18:54:25.947021 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate -1 could not be found. Nov 01 18:54:25.947021 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 18:54:25.947021 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 18:54:25.947021 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 18:54:25.947021 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:54:25.947021 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 18:54:25.947021 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 18:54:25.947021 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 01 18:54:25.947021 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 01 18:54:25.947021 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate -1 could not be found. Nov 01 18:54:25.947021 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 18:54:25.948459 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-6b37e43c-7b6c-4158-95aa-194d8aab5bdf tempest-AggregatesAdminNegativeTestJSON-1815627383 tempest-AggregatesAdminNegativeTestJSON-1815627383-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=121403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 01 18:54:25.948459 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-6b37e43c-7b6c-4158-95aa-194d8aab5bdf tempest-AggregatesAdminNegativeTestJSON-1815627383 tempest-AggregatesAdminNegativeTestJSON-1815627383-project-admin] 10.222.0.13 "GET /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.019757 Nov 01 18:54:25.948459 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 32/62] 10.222.0.13 () {58 vars in 1152 bytes} [Tue Nov 1 18:54:25 2022] GET /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 21 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 01 18:54:25.957079 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-8ff7bb6a-a6e8-4d97-ad51-1a094a904bd7 tempest-FlavorsAccessNegativeTestJSON-1324123958 tempest-FlavorsAccessNegativeTestJSON-1324123958-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "2ab59873a8224b47ba0d6ca3ee7e021b"}} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 18:54:26.234390 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-d2461163-8701-41aa-8bcb-6407f7a3d98e tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce2e0d1828674809a3344a7a68f375c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8e1248497284006a7acbb8169627ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:54:26.266017 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-d2461163-8701-41aa-8bcb-6407f7a3d98e tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] 10.222.0.13 "GET /compute/v2.1/servers/4ebac531-6f77-4108-afc9-0eccb86dee8b" status: 200 len: 1299 microversion: 2.1 time: 0.653013 Nov 01 18:54:26.282752 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 31/63] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:54:25 2022] GET /compute/v2.1/servers/4ebac531-6f77-4108-afc9-0eccb86dee8b => generated 1299 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:54:26.295600 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-5458e90b-0aa7-4565-8d02-cd5f332f12e9 tempest-AggregatesAdminNegativeTestJSON-701968823 tempest-AggregatesAdminNegativeTestJSON-701968823-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:54:26.297170 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-5458e90b-0aa7-4565-8d02-cd5f332f12e9 tempest-AggregatesAdminNegativeTestJSON-701968823 tempest-AggregatesAdminNegativeTestJSON-701968823-project] Policy check for os_compute_api:os-aggregates:index failed with credentials {'is_admin': False, 'user_id': '050138637ab247cabfa21c187e4463dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440456c174424b5c8a796711a95a8b69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:54:26.309148 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-5458e90b-0aa7-4565-8d02-cd5f332f12e9 tempest-AggregatesAdminNegativeTestJSON-701968823 tempest-AggregatesAdminNegativeTestJSON-701968823-project] Request method failure captured: Nov 01 18:54:26.309148 n-d-863052-2 devstack@n-api.service[121402]: request: GET /compute/v2.1/os-aggregates HTTP/1.1 Nov 01 18:54:26.309148 n-d-863052-2 devstack@n-api.service[121402]: Accept: application/json Nov 01 18:54:26.309148 n-d-863052-2 devstack@n-api.service[121402]: Accept-Encoding: identity Nov 01 18:54:26.309148 n-d-863052-2 devstack@n-api.service[121402]: Connection: close Nov 01 18:54:26.309148 n-d-863052-2 devstack@n-api.service[121402]: Content-Length: 0 Nov 01 18:54:26.309148 n-d-863052-2 devstack@n-api.service[121402]: Content-Type: application/json Nov 01 18:54:26.309148 n-d-863052-2 devstack@n-api.service[121402]: Host: 10.222.0.13 Nov 01 18:54:26.309148 n-d-863052-2 devstack@n-api.service[121402]: Openstack-System-Scope: None Nov 01 18:54:26.309148 n-d-863052-2 devstack@n-api.service[121402]: User-Agent: python-urllib3/1.26.12 Nov 01 18:54:26.309148 n-d-863052-2 devstack@n-api.service[121402]: X-Auth-Token: gAAAAABjYWtYF75HWf8dApD_m447tyf_mGJPzf8sow1wwvz71bWsgfnuNEDZD8kc7FNf8UQaBOnL1PRXNN_SusWujUfI-Zl9-t1OxUPEVGqV5sgKS3MOb-9Fl7jDxrPPOZQJ67Sffw3RwRGNWR2S2MXGQmO3tiflrv5n_iOXTXf2esQHwC8DD0E Nov 01 18:54:26.309148 n-d-863052-2 devstack@n-api.service[121402]: X-Domain-Id: None Nov 01 18:54:26.309148 n-d-863052-2 devstack@n-api.service[121402]: X-Domain-Name: None Nov 01 18:54:26.309148 n-d-863052-2 devstack@n-api.service[121402]: X-Identity-Status: Confirmed Nov 01 18:54:26.309148 n-d-863052-2 devstack@n-api.service[121402]: X-Is-Admin-Project: True Nov 01 18:54:26.309148 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Domain-Id: default Nov 01 18:54:26.309148 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Domain-Name: Default Nov 01 18:54:26.309148 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Id: 440456c174424b5c8a796711a95a8b69 Nov 01 18:54:26.309148 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-701968823 Nov 01 18:54:26.309148 n-d-863052-2 devstack@n-api.service[121402]: X-Role: member,reader Nov 01 18:54:26.309148 n-d-863052-2 devstack@n-api.service[121402]: X-Roles: member,reader Nov 01 18:54:26.310279 n-d-863052-2 devstack@n-api.service[121402]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/440456c174424b5c8a796711a95a8b69"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/440456c174424b5c8a796711a95a8b69"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_440456c174424b5c8a796711a95a8b69", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/440456c174424b5c8a796711a95a8b69"}]}] Nov 01 18:54:26.310279 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-701968823 Nov 01 18:54:26.310279 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant-Id: 440456c174424b5c8a796711a95a8b69 Nov 01 18:54:26.310279 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-701968823 Nov 01 18:54:26.310279 n-d-863052-2 devstack@n-api.service[121402]: X-User: tempest-AggregatesAdminNegativeTestJSON-701968823-project Nov 01 18:54:26.310279 n-d-863052-2 devstack@n-api.service[121402]: X-User-Domain-Id: default Nov 01 18:54:26.310279 n-d-863052-2 devstack@n-api.service[121402]: X-User-Domain-Name: Default Nov 01 18:54:26.310279 n-d-863052-2 devstack@n-api.service[121402]: X-User-Id: 050138637ab247cabfa21c187e4463dc Nov 01 18:54:26.310279 n-d-863052-2 devstack@n-api.service[121402]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-701968823-project Nov 01 18:54:26.310279 n-d-863052-2 devstack@n-api.service[121402]: method: > Nov 01 18:54:26.310279 n-d-863052-2 devstack@n-api.service[121402]: exception: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Nov 01 18:54:26.310279 n-d-863052-2 devstack@n-api.service[121402]: action_args: {} Nov 01 18:54:26.310878 n-d-863052-2 devstack@n-api.service[121402]: {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 01 18:54:26.310878 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:54:26.310878 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 18:54:26.310878 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 18:54:26.310878 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 01 18:54:26.310878 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 01 18:54:26.310878 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 01 18:54:26.310878 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 01 18:54:26.310878 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 55, in index Nov 01 18:54:26.310878 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'index', target={}) Nov 01 18:54:26.310878 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Nov 01 18:54:26.310878 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Nov 01 18:54:26.310878 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Nov 01 18:54:26.310878 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Nov 01 18:54:26.310878 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 01 18:54:26.310878 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 01 18:54:26.310878 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 01 18:54:26.310878 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise self.value Nov 01 18:54:26.310878 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Nov 01 18:54:26.311793 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Nov 01 18:54:26.311793 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Nov 01 18:54:26.311793 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return self.enforce( Nov 01 18:54:26.311793 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Nov 01 18:54:26.311793 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Nov 01 18:54:26.311793 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Nov 01 18:54:26.311793 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 18:54:26.311793 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 18:54:26.311793 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 18:54:26.311793 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:54:26.311793 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 18:54:26.311793 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 18:54:26.311793 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Nov 01 18:54:26.311793 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Nov 01 18:54:26.311793 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Nov 01 18:54:26.311793 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 18:54:26.311793 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-5458e90b-0aa7-4565-8d02-cd5f332f12e9 tempest-AggregatesAdminNegativeTestJSON-701968823 tempest-AggregatesAdminNegativeTestJSON-701968823-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. {{(pid=121402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 01 18:54:26.313241 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-5458e90b-0aa7-4565-8d02-cd5f332f12e9 tempest-AggregatesAdminNegativeTestJSON-701968823 tempest-AggregatesAdminNegativeTestJSON-701968823-project] 10.222.0.13 "GET /compute/v2.1/os-aggregates" status: 403 len: 115 microversion: 2.1 time: 0.021761 Nov 01 18:54:26.313241 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 32/64] 10.222.0.13 () {58 vars in 1143 bytes} [Tue Nov 1 18:54:26 2022] GET /compute/v2.1/os-aggregates => generated 115 bytes in 28 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Nov 01 18:54:26.322385 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-02e83c03-0fa2-46e8-a50c-9f8d2e97d958 tempest-AggregatesAdminTestJSON-768412114 tempest-AggregatesAdminTestJSON-768412114-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:54:26.325236 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-02e83c03-0fa2-46e8-a50c-9f8d2e97d958 tempest-AggregatesAdminTestJSON-768412114 tempest-AggregatesAdminTestJSON-768412114-project] [instance: 7967bf1f-943f-441d-befd-373868bbb3aa] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:54:26.466551 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-02e83c03-0fa2-46e8-a50c-9f8d2e97d958 tempest-AggregatesAdminTestJSON-768412114 tempest-AggregatesAdminTestJSON-768412114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439a7ac2509640c49361f9ba6636b34d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8382e1376b104295aa5cef36ba07cf45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:54:26.475857 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-02e83c03-0fa2-46e8-a50c-9f8d2e97d958 tempest-AggregatesAdminTestJSON-768412114 tempest-AggregatesAdminTestJSON-768412114-project] 10.222.0.13 "GET /compute/v2.1/servers/7967bf1f-943f-441d-befd-373868bbb3aa" status: 200 len: 1242 microversion: 2.1 time: 0.163378 Nov 01 18:54:26.476445 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 33/65] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:54:26 2022] GET /compute/v2.1/servers/7967bf1f-943f-441d-befd-373868bbb3aa => generated 1242 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:54:26.896107 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-8ff7bb6a-a6e8-4d97-ad51-1a094a904bd7 tempest-FlavorsAccessNegativeTestJSON-1324123958 tempest-FlavorsAccessNegativeTestJSON-1324123958-project-admin] 10.222.0.13 "POST /compute/v2.1/flavors/1141062893/action" status: 200 len: 97 microversion: 2.1 time: 0.942736 Nov 01 18:54:26.898571 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 33/66] 10.222.0.13 () {60 vars in 1200 bytes} [Tue Nov 1 18:54:25 2022] POST /compute/v2.1/flavors/1141062893/action => generated 97 bytes in 952 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 01 18:54:26.908923 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-d0a39fdc-8f98-4588-badd-8e166979d62d tempest-FlavorsAccessNegativeTestJSON-1511445044 tempest-FlavorsAccessNegativeTestJSON-1511445044-project] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "2ab59873a8224b47ba0d6ca3ee7e021b"}} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 18:54:26.912660 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-d0a39fdc-8f98-4588-badd-8e166979d62d tempest-FlavorsAccessNegativeTestJSON-1511445044 tempest-FlavorsAccessNegativeTestJSON-1511445044-project] Policy check for os_compute_api:os-flavor-access:remove_tenant_access failed with credentials {'is_admin': False, 'user_id': 'b35a70cffa1a4a198237df53ded3bb34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ab59873a8224b47ba0d6ca3ee7e021b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:54:26.915637 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-d0a39fdc-8f98-4588-badd-8e166979d62d tempest-FlavorsAccessNegativeTestJSON-1511445044 tempest-FlavorsAccessNegativeTestJSON-1511445044-project] Request method failure captured: Nov 01 18:54:26.915637 n-d-863052-2 devstack@n-api.service[121402]: request: POST /compute/v2.1/flavors/1141062893/action HTTP/1.1 Nov 01 18:54:26.915637 n-d-863052-2 devstack@n-api.service[121402]: Accept: application/json Nov 01 18:54:26.915637 n-d-863052-2 devstack@n-api.service[121402]: Accept-Encoding: identity Nov 01 18:54:26.915637 n-d-863052-2 devstack@n-api.service[121402]: Connection: close Nov 01 18:54:26.915637 n-d-863052-2 devstack@n-api.service[121402]: Content-Length: 70 Nov 01 18:54:26.915637 n-d-863052-2 devstack@n-api.service[121402]: Content-Type: application/json Nov 01 18:54:26.915637 n-d-863052-2 devstack@n-api.service[121402]: Host: 10.222.0.13 Nov 01 18:54:26.915637 n-d-863052-2 devstack@n-api.service[121402]: Openstack-System-Scope: None Nov 01 18:54:26.915637 n-d-863052-2 devstack@n-api.service[121402]: User-Agent: python-urllib3/1.26.12 Nov 01 18:54:26.915637 n-d-863052-2 devstack@n-api.service[121402]: X-Auth-Token: gAAAAABjYWtYpXJvz4O35i5OIXqPYRVy2zqu47yQ4kTVTKLHrVbFcT_jixDWoDTk5h9ybbXZkqa6XI_kd4KTPgnbzQBnKPm0WQuOEBs0GFQYEKh-BejIrHzbH9acDh07idUeW4FfJgAxoLe4jTkBoUJLAa6DFG91RDl4WxYjyJnyKntNcudYGtk Nov 01 18:54:26.915637 n-d-863052-2 devstack@n-api.service[121402]: X-Domain-Id: None Nov 01 18:54:26.915637 n-d-863052-2 devstack@n-api.service[121402]: X-Domain-Name: None Nov 01 18:54:26.915637 n-d-863052-2 devstack@n-api.service[121402]: X-Identity-Status: Confirmed Nov 01 18:54:26.915637 n-d-863052-2 devstack@n-api.service[121402]: X-Is-Admin-Project: True Nov 01 18:54:26.915637 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Domain-Id: default Nov 01 18:54:26.915637 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Domain-Name: Default Nov 01 18:54:26.915637 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Id: 2ab59873a8224b47ba0d6ca3ee7e021b Nov 01 18:54:26.915637 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-1511445044 Nov 01 18:54:26.915637 n-d-863052-2 devstack@n-api.service[121402]: X-Role: member,reader Nov 01 18:54:26.915637 n-d-863052-2 devstack@n-api.service[121402]: X-Roles: member,reader Nov 01 18:54:26.917682 n-d-863052-2 devstack@n-api.service[121402]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/2ab59873a8224b47ba0d6ca3ee7e021b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/2ab59873a8224b47ba0d6ca3ee7e021b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_2ab59873a8224b47ba0d6ca3ee7e021b", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/2ab59873a8224b47ba0d6ca3ee7e021b"}]}] Nov 01 18:54:26.917682 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-1511445044 Nov 01 18:54:26.917682 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant-Id: 2ab59873a8224b47ba0d6ca3ee7e021b Nov 01 18:54:26.917682 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-1511445044 Nov 01 18:54:26.917682 n-d-863052-2 devstack@n-api.service[121402]: X-User: tempest-FlavorsAccessNegativeTestJSON-1511445044-project Nov 01 18:54:26.917682 n-d-863052-2 devstack@n-api.service[121402]: X-User-Domain-Id: default Nov 01 18:54:26.917682 n-d-863052-2 devstack@n-api.service[121402]: X-User-Domain-Name: Default Nov 01 18:54:26.917682 n-d-863052-2 devstack@n-api.service[121402]: X-User-Id: b35a70cffa1a4a198237df53ded3bb34 Nov 01 18:54:26.917682 n-d-863052-2 devstack@n-api.service[121402]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-1511445044-project Nov 01 18:54:26.917682 n-d-863052-2 devstack@n-api.service[121402]: Nov 01 18:54:26.917682 n-d-863052-2 devstack@n-api.service[121402]: {"removeTenantAccess": {"tenant": "2ab59873a8224b47ba0d6ca3ee7e021b"}} Nov 01 18:54:26.917682 n-d-863052-2 devstack@n-api.service[121402]: method: > Nov 01 18:54:26.918409 n-d-863052-2 devstack@n-api.service[121402]: exception: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Nov 01 18:54:26.918409 n-d-863052-2 devstack@n-api.service[121402]: action_args: {'id': '1141062893', 'body': {'removeTenantAccess': {'tenant': '2ab59873a8224b47ba0d6ca3ee7e021b'}}} Nov 01 18:54:26.918409 n-d-863052-2 devstack@n-api.service[121402]: {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 01 18:54:26.918409 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:54:26.918409 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 18:54:26.918409 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 18:54:26.918409 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 01 18:54:26.918409 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 01 18:54:26.918409 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 01 18:54:26.918409 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 01 18:54:26.918409 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 01 18:54:26.918409 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 01 18:54:26.918409 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 91, in _remove_tenant_access Nov 01 18:54:26.918409 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi context.can( Nov 01 18:54:26.918409 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Nov 01 18:54:26.918409 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Nov 01 18:54:26.918409 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Nov 01 18:54:26.918409 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Nov 01 18:54:26.918409 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 01 18:54:26.918409 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 01 18:54:26.919500 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 01 18:54:26.919500 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise self.value Nov 01 18:54:26.919500 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Nov 01 18:54:26.919500 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Nov 01 18:54:26.919500 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Nov 01 18:54:26.919500 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return self.enforce( Nov 01 18:54:26.919500 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Nov 01 18:54:26.919500 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Nov 01 18:54:26.919500 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Nov 01 18:54:26.919500 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 18:54:26.919500 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 18:54:26.919500 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 18:54:26.919500 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:54:26.919500 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 18:54:26.919500 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 18:54:26.919500 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Nov 01 18:54:26.919500 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Nov 01 18:54:26.919500 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Nov 01 18:54:26.919500 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 18:54:26.920412 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-d0a39fdc-8f98-4588-badd-8e166979d62d tempest-FlavorsAccessNegativeTestJSON-1511445044 tempest-FlavorsAccessNegativeTestJSON-1511445044-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. {{(pid=121402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 01 18:54:26.920412 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-d0a39fdc-8f98-4588-badd-8e166979d62d tempest-FlavorsAccessNegativeTestJSON-1511445044 tempest-FlavorsAccessNegativeTestJSON-1511445044-project] 10.222.0.13 "POST /compute/v2.1/flavors/1141062893/action" status: 403 len: 133 microversion: 2.1 time: 0.013906 Nov 01 18:54:26.920412 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 34/67] 10.222.0.13 () {60 vars in 1200 bytes} [Tue Nov 1 18:54:26 2022] POST /compute/v2.1/flavors/1141062893/action => generated 133 bytes in 15 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Nov 01 18:54:26.929098 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-76882b55-13e9-44fc-b1c9-1ca38222b113 tempest-FlavorsAccessNegativeTestJSON-1324123958 tempest-FlavorsAccessNegativeTestJSON-1324123958-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "2ab59873a8224b47ba0d6ca3ee7e021b"}} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 18:54:27.290654 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-fd59686e-c00d-435c-8ca1-c6fa9b54a56a tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:54:27.292022 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-fd59686e-c00d-435c-8ca1-c6fa9b54a56a tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] [instance: 4ebac531-6f77-4108-afc9-0eccb86dee8b] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:54:27.306232 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-fd59686e-c00d-435c-8ca1-c6fa9b54a56a tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:54:27.306939 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-fd59686e-c00d-435c-8ca1-c6fa9b54a56a tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:54:27.307198 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-fd59686e-c00d-435c-8ca1-c6fa9b54a56a tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:54:27.313925 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-fd59686e-c00d-435c-8ca1-c6fa9b54a56a tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:54:27.316197 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-fd59686e-c00d-435c-8ca1-c6fa9b54a56a tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:54:27.322352 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-fd59686e-c00d-435c-8ca1-c6fa9b54a56a tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:54:27.605642 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-fd59686e-c00d-435c-8ca1-c6fa9b54a56a tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce2e0d1828674809a3344a7a68f375c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8e1248497284006a7acbb8169627ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:54:27.624082 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-fd59686e-c00d-435c-8ca1-c6fa9b54a56a tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] 10.222.0.13 "GET /compute/v2.1/servers/4ebac531-6f77-4108-afc9-0eccb86dee8b" status: 200 len: 1341 microversion: 2.1 time: 0.337093 Nov 01 18:54:27.643676 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 35/68] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:54:27 2022] GET /compute/v2.1/servers/4ebac531-6f77-4108-afc9-0eccb86dee8b => generated 1341 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 18:54:27.683861 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-7f2c82e4-aefd-40a8-a5a3-69ed28b06fff tempest-AggregatesAdminTestJSON-768412114 tempest-AggregatesAdminTestJSON-768412114-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:54:27.685906 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-7f2c82e4-aefd-40a8-a5a3-69ed28b06fff tempest-AggregatesAdminTestJSON-768412114 tempest-AggregatesAdminTestJSON-768412114-project] [instance: 7967bf1f-943f-441d-befd-373868bbb3aa] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:54:27.719576 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-7f2c82e4-aefd-40a8-a5a3-69ed28b06fff tempest-AggregatesAdminTestJSON-768412114 tempest-AggregatesAdminTestJSON-768412114-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:54:27.721525 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-7f2c82e4-aefd-40a8-a5a3-69ed28b06fff tempest-AggregatesAdminTestJSON-768412114 tempest-AggregatesAdminTestJSON-768412114-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:54:27.722178 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-7f2c82e4-aefd-40a8-a5a3-69ed28b06fff tempest-AggregatesAdminTestJSON-768412114 tempest-AggregatesAdminTestJSON-768412114-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:54:27.723953 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-7f2c82e4-aefd-40a8-a5a3-69ed28b06fff tempest-AggregatesAdminTestJSON-768412114 tempest-AggregatesAdminTestJSON-768412114-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:54:27.726695 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-7f2c82e4-aefd-40a8-a5a3-69ed28b06fff tempest-AggregatesAdminTestJSON-768412114 tempest-AggregatesAdminTestJSON-768412114-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:54:27.727968 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-7f2c82e4-aefd-40a8-a5a3-69ed28b06fff tempest-AggregatesAdminTestJSON-768412114 tempest-AggregatesAdminTestJSON-768412114-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:54:27.926020 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-7f2c82e4-aefd-40a8-a5a3-69ed28b06fff tempest-AggregatesAdminTestJSON-768412114 tempest-AggregatesAdminTestJSON-768412114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439a7ac2509640c49361f9ba6636b34d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8382e1376b104295aa5cef36ba07cf45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:54:27.938187 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-7f2c82e4-aefd-40a8-a5a3-69ed28b06fff tempest-AggregatesAdminTestJSON-768412114 tempest-AggregatesAdminTestJSON-768412114-project] 10.222.0.13 "GET /compute/v2.1/servers/7967bf1f-943f-441d-befd-373868bbb3aa" status: 200 len: 1290 microversion: 2.1 time: 0.292283 Nov 01 18:54:27.957690 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 36/69] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:54:27 2022] GET /compute/v2.1/servers/7967bf1f-943f-441d-befd-373868bbb3aa => generated 1290 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:54:28.476622 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-76882b55-13e9-44fc-b1c9-1ca38222b113 tempest-FlavorsAccessNegativeTestJSON-1324123958 tempest-FlavorsAccessNegativeTestJSON-1324123958-project-admin] 10.222.0.13 "POST /compute/v2.1/flavors/1141062893/action" status: 200 len: 21 microversion: 2.1 time: 1.549777 Nov 01 18:54:28.477274 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 34/70] 10.222.0.13 () {60 vars in 1200 bytes} [Tue Nov 1 18:54:26 2022] POST /compute/v2.1/flavors/1141062893/action => generated 21 bytes in 1554 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 01 18:54:28.488574 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-ea0c5c79-09ad-4eaf-809a-700bedc6450f tempest-FlavorsAccessNegativeTestJSON-1324123958 tempest-FlavorsAccessNegativeTestJSON-1324123958-project-admin] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:54:28.532344 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-ea0c5c79-09ad-4eaf-809a-700bedc6450f tempest-FlavorsAccessNegativeTestJSON-1324123958 tempest-FlavorsAccessNegativeTestJSON-1324123958-project-admin] 10.222.0.13 "DELETE /compute/v2.1/flavors/1141062893" status: 202 len: 0 microversion: 2.1 time: 0.048223 Nov 01 18:54:28.532958 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 37/71] 10.222.0.13 () {58 vars in 1161 bytes} [Tue Nov 1 18:54:28 2022] DELETE /compute/v2.1/flavors/1141062893 => generated 0 bytes in 50 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 01 18:54:28.542911 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-6f243035-19f7-4dab-8c42-65f97f1bad69 tempest-FlavorsAccessNegativeTestJSON-1324123958 tempest-FlavorsAccessNegativeTestJSON-1324123958-project-admin] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:54:28.595206 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-6f243035-19f7-4dab-8c42-65f97f1bad69 tempest-FlavorsAccessNegativeTestJSON-1324123958 tempest-FlavorsAccessNegativeTestJSON-1324123958-project-admin] 10.222.0.13 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.056831 Nov 01 18:54:28.600923 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 35/72] 10.222.0.13 () {58 vars in 1146 bytes} [Tue Nov 1 18:54:28 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 18:54:28.620378 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-b4b1787d-2eba-4c2d-bdda-8e4caa333931 tempest-FlavorsAccessNegativeTestJSON-1324123958 tempest-FlavorsAccessNegativeTestJSON-1324123958-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-586581513", "id": 812990622, "os-flavor-access:is_public": "False"}} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 18:54:28.650099 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-33bfe806-c84b-439d-98a6-fcb8594888c0 tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:54:28.651977 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-33bfe806-c84b-439d-98a6-fcb8594888c0 tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] [instance: 4ebac531-6f77-4108-afc9-0eccb86dee8b] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:54:28.663318 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-b4b1787d-2eba-4c2d-bdda-8e4caa333931 tempest-FlavorsAccessNegativeTestJSON-1324123958 tempest-FlavorsAccessNegativeTestJSON-1324123958-project-admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 435 microversion: 2.1 time: 0.048819 Nov 01 18:54:28.667215 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 38/73] 10.222.0.13 () {60 vars in 1147 bytes} [Tue Nov 1 18:54:28 2022] POST /compute/v2.1/flavors => generated 435 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 18:54:28.669968 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-33bfe806-c84b-439d-98a6-fcb8594888c0 tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:54:28.673551 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-33bfe806-c84b-439d-98a6-fcb8594888c0 tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:54:28.674047 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-33bfe806-c84b-439d-98a6-fcb8594888c0 tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:54:28.676461 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-33bfe806-c84b-439d-98a6-fcb8594888c0 tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:54:28.678629 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-33bfe806-c84b-439d-98a6-fcb8594888c0 tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:54:28.679087 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-33bfe806-c84b-439d-98a6-fcb8594888c0 tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:54:28.695955 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-7b537a49-58f1-4677-a006-7af9b8eaef69 tempest-FlavorsAccessNegativeTestJSON-1324123958 tempest-FlavorsAccessNegativeTestJSON-1324123958-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "1d8d59799be24c0ba81c8d6933bc456d"}} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 18:54:29.703498 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.wsgi [None req-7b537a49-58f1-4677-a006-7af9b8eaef69 tempest-FlavorsAccessNegativeTestJSON-1324123958 tempest-FlavorsAccessNegativeTestJSON-1324123958-project-admin] HTTP exception thrown: Flavor access not found for 20 / 1d8d59799be24c0ba81c8d6933bc456d combination. Nov 01 18:54:29.706719 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-7b537a49-58f1-4677-a006-7af9b8eaef69 tempest-FlavorsAccessNegativeTestJSON-1324123958 tempest-FlavorsAccessNegativeTestJSON-1324123958-project-admin] Request method failure captured: Nov 01 18:54:29.706719 n-d-863052-2 devstack@n-api.service[121402]: request: POST /compute/v2.1/flavors/812990622/action HTTP/1.1 Nov 01 18:54:29.706719 n-d-863052-2 devstack@n-api.service[121402]: Accept: application/json Nov 01 18:54:29.706719 n-d-863052-2 devstack@n-api.service[121402]: Accept-Encoding: identity Nov 01 18:54:29.706719 n-d-863052-2 devstack@n-api.service[121402]: Connection: close Nov 01 18:54:29.706719 n-d-863052-2 devstack@n-api.service[121402]: Content-Length: 70 Nov 01 18:54:29.706719 n-d-863052-2 devstack@n-api.service[121402]: Content-Type: application/json Nov 01 18:54:29.706719 n-d-863052-2 devstack@n-api.service[121402]: Host: 10.222.0.13 Nov 01 18:54:29.706719 n-d-863052-2 devstack@n-api.service[121402]: Openstack-System-Scope: None Nov 01 18:54:29.706719 n-d-863052-2 devstack@n-api.service[121402]: User-Agent: python-urllib3/1.26.12 Nov 01 18:54:29.706719 n-d-863052-2 devstack@n-api.service[121402]: X-Auth-Token: gAAAAABjYWtaKDQxU1HAN-hE8muWbrn8LFATSrLppCxxaHhX1W3GPdjcJz-HNjcSHGtohMgWFTY1vb-P8ceC9A1AJ6rdpZpDgg90gSK5oiXVWFCK5BToKuloW0fFWUz2FatmiKzGgTb1cjaDcwFblLF7bl0QIErdL-JSmnWQMFz6HH7eRbFS_Y8 Nov 01 18:54:29.706719 n-d-863052-2 devstack@n-api.service[121402]: X-Domain-Id: None Nov 01 18:54:29.706719 n-d-863052-2 devstack@n-api.service[121402]: X-Domain-Name: None Nov 01 18:54:29.706719 n-d-863052-2 devstack@n-api.service[121402]: X-Identity-Status: Confirmed Nov 01 18:54:29.706719 n-d-863052-2 devstack@n-api.service[121402]: X-Is-Admin-Project: True Nov 01 18:54:29.706719 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Domain-Id: default Nov 01 18:54:29.706719 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Domain-Name: Default Nov 01 18:54:29.706719 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Id: 68a228081a16469ca92f0f8a56dd05e9 Nov 01 18:54:29.706719 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-1324123958 Nov 01 18:54:29.706719 n-d-863052-2 devstack@n-api.service[121402]: X-Role: admin,member,reader Nov 01 18:54:29.706719 n-d-863052-2 devstack@n-api.service[121402]: X-Roles: admin,member,reader Nov 01 18:54:29.707951 n-d-863052-2 devstack@n-api.service[121402]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/68a228081a16469ca92f0f8a56dd05e9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/68a228081a16469ca92f0f8a56dd05e9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_68a228081a16469ca92f0f8a56dd05e9", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/68a228081a16469ca92f0f8a56dd05e9"}]}] Nov 01 18:54:29.707951 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-1324123958 Nov 01 18:54:29.707951 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant-Id: 68a228081a16469ca92f0f8a56dd05e9 Nov 01 18:54:29.707951 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-1324123958 Nov 01 18:54:29.707951 n-d-863052-2 devstack@n-api.service[121402]: X-User: tempest-FlavorsAccessNegativeTestJSON-1324123958-project-admin Nov 01 18:54:29.707951 n-d-863052-2 devstack@n-api.service[121402]: X-User-Domain-Id: default Nov 01 18:54:29.707951 n-d-863052-2 devstack@n-api.service[121402]: X-User-Domain-Name: Default Nov 01 18:54:29.707951 n-d-863052-2 devstack@n-api.service[121402]: X-User-Id: ea9642617d114bc3ac329691a82bd5d0 Nov 01 18:54:29.707951 n-d-863052-2 devstack@n-api.service[121402]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-1324123958-project-admin Nov 01 18:54:29.707951 n-d-863052-2 devstack@n-api.service[121402]: Nov 01 18:54:29.707951 n-d-863052-2 devstack@n-api.service[121402]: {"removeTenantAccess": {"tenant": "1d8d59799be24c0ba81c8d6933bc456d"}} Nov 01 18:54:29.707951 n-d-863052-2 devstack@n-api.service[121402]: method: > Nov 01 18:54:29.708655 n-d-863052-2 devstack@n-api.service[121402]: exception: Flavor access not found for 20 / 1d8d59799be24c0ba81c8d6933bc456d combination. Nov 01 18:54:29.708655 n-d-863052-2 devstack@n-api.service[121402]: action_args: {'id': '812990622', 'body': {'removeTenantAccess': {'tenant': '1d8d59799be24c0ba81c8d6933bc456d'}}} Nov 01 18:54:29.708655 n-d-863052-2 devstack@n-api.service[121402]: {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 01 18:54:29.708655 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:54:29.708655 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 104, in _remove_tenant_access Nov 01 18:54:29.708655 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi flavor.remove_access(tenant) Nov 01 18:54:29.708655 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Nov 01 18:54:29.708655 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Nov 01 18:54:29.708655 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 423, in remove_access Nov 01 18:54:29.708655 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi self._remove_access(project_id) Nov 01 18:54:29.708655 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 416, in _remove_access Nov 01 18:54:29.708655 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi self._flavor_del_project(self._context, self.id, project_id) Nov 01 18:54:29.708655 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 401, in _flavor_del_project Nov 01 18:54:29.708655 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return _flavor_del_project(context, flavor_id, project_id) Nov 01 18:54:29.708655 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Nov 01 18:54:29.708655 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Nov 01 18:54:29.708655 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 86, in _flavor_del_project Nov 01 18:54:29.708655 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise exception.FlavorAccessNotFound(flavor_id=flavor_id, Nov 01 18:54:29.709727 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi nova.exception.FlavorAccessNotFound: Flavor access not found for 20 / 1d8d59799be24c0ba81c8d6933bc456d combination. Nov 01 18:54:29.709727 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 18:54:29.709727 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 18:54:29.709727 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 18:54:29.709727 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:54:29.709727 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 18:54:29.709727 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 18:54:29.709727 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 01 18:54:29.709727 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 01 18:54:29.709727 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 01 18:54:29.709727 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 01 18:54:29.709727 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 01 18:54:29.709727 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 01 18:54:29.709727 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 107, in _remove_tenant_access Nov 01 18:54:29.709727 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Nov 01 18:54:29.709727 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor access not found for 20 / 1d8d59799be24c0ba81c8d6933bc456d combination. Nov 01 18:54:29.709727 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 18:54:29.709727 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 18:54:29.709727 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 18:54:29.709727 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:54:29.710848 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 18:54:29.710848 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 18:54:29.710848 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 01 18:54:29.710848 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 01 18:54:29.710848 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor access not found for 20 / 1d8d59799be24c0ba81c8d6933bc456d combination. Nov 01 18:54:29.710848 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 18:54:29.717273 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-7b537a49-58f1-4677-a006-7af9b8eaef69 tempest-FlavorsAccessNegativeTestJSON-1324123958 tempest-FlavorsAccessNegativeTestJSON-1324123958-project-admin] Returning 404 to user: Flavor access not found for 20 / 1d8d59799be24c0ba81c8d6933bc456d combination. {{(pid=121402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 01 18:54:29.722260 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-7b537a49-58f1-4677-a006-7af9b8eaef69 tempest-FlavorsAccessNegativeTestJSON-1324123958 tempest-FlavorsAccessNegativeTestJSON-1324123958-project-admin] 10.222.0.13 "POST /compute/v2.1/flavors/812990622/action" status: 404 len: 124 microversion: 2.1 time: 1.045740 Nov 01 18:54:29.725048 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 39/74] 10.222.0.13 () {60 vars in 1197 bytes} [Tue Nov 1 18:54:28 2022] POST /compute/v2.1/flavors/812990622/action => generated 124 bytes in 1051 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 01 18:54:29.738900 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-30c7a769-119d-402b-890a-d43baf8b42ea tempest-AggregatesAdminTestJSON-768412114 tempest-AggregatesAdminTestJSON-768412114-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:54:29.741663 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-30c7a769-119d-402b-890a-d43baf8b42ea tempest-AggregatesAdminTestJSON-768412114 tempest-AggregatesAdminTestJSON-768412114-project] [instance: 7967bf1f-943f-441d-befd-373868bbb3aa] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:54:29.762067 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-30c7a769-119d-402b-890a-d43baf8b42ea tempest-AggregatesAdminTestJSON-768412114 tempest-AggregatesAdminTestJSON-768412114-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:54:29.762945 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-30c7a769-119d-402b-890a-d43baf8b42ea tempest-AggregatesAdminTestJSON-768412114 tempest-AggregatesAdminTestJSON-768412114-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:54:29.763720 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-30c7a769-119d-402b-890a-d43baf8b42ea tempest-AggregatesAdminTestJSON-768412114 tempest-AggregatesAdminTestJSON-768412114-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:54:29.764909 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-30c7a769-119d-402b-890a-d43baf8b42ea tempest-AggregatesAdminTestJSON-768412114 tempest-AggregatesAdminTestJSON-768412114-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:54:29.766932 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-30c7a769-119d-402b-890a-d43baf8b42ea tempest-AggregatesAdminTestJSON-768412114 tempest-AggregatesAdminTestJSON-768412114-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:54:29.768871 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-30c7a769-119d-402b-890a-d43baf8b42ea tempest-AggregatesAdminTestJSON-768412114 tempest-AggregatesAdminTestJSON-768412114-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:54:29.851992 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-33bfe806-c84b-439d-98a6-fcb8594888c0 tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce2e0d1828674809a3344a7a68f375c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8e1248497284006a7acbb8169627ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:54:29.885457 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-33bfe806-c84b-439d-98a6-fcb8594888c0 tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] 10.222.0.13 "GET /compute/v2.1/servers/4ebac531-6f77-4108-afc9-0eccb86dee8b" status: 200 len: 1341 microversion: 2.1 time: 1.239569 Nov 01 18:54:29.900308 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 36/75] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:54:28 2022] GET /compute/v2.1/servers/4ebac531-6f77-4108-afc9-0eccb86dee8b => generated 1341 bytes in 1244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:54:30.619753 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-30c7a769-119d-402b-890a-d43baf8b42ea tempest-AggregatesAdminTestJSON-768412114 tempest-AggregatesAdminTestJSON-768412114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439a7ac2509640c49361f9ba6636b34d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8382e1376b104295aa5cef36ba07cf45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:54:30.641882 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-30c7a769-119d-402b-890a-d43baf8b42ea tempest-AggregatesAdminTestJSON-768412114 tempest-AggregatesAdminTestJSON-768412114-project] 10.222.0.13 "GET /compute/v2.1/servers/7967bf1f-943f-441d-befd-373868bbb3aa" status: 200 len: 1296 microversion: 2.1 time: 0.911833 Nov 01 18:54:30.650149 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 40/76] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:54:29 2022] GET /compute/v2.1/servers/7967bf1f-943f-441d-befd-373868bbb3aa => generated 1296 bytes in 924 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:54:30.685636 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-f0ac6e53-4cc1-4ba7-9a4d-cd6cba8a5c4d tempest-FlavorsAccessNegativeTestJSON-1324123958 tempest-FlavorsAccessNegativeTestJSON-1324123958-project-admin] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:54:30.764333 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-f0ac6e53-4cc1-4ba7-9a4d-cd6cba8a5c4d tempest-FlavorsAccessNegativeTestJSON-1324123958 tempest-FlavorsAccessNegativeTestJSON-1324123958-project-admin] 10.222.0.13 "DELETE /compute/v2.1/flavors/812990622" status: 202 len: 0 microversion: 2.1 time: 0.103562 Nov 01 18:54:30.766813 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 41/77] 10.222.0.13 () {58 vars in 1158 bytes} [Tue Nov 1 18:54:30 2022] DELETE /compute/v2.1/flavors/812990622 => generated 0 bytes in 116 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 01 18:54:30.769485 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-656a8111-82e4-4b7f-af3a-647825a14aad tempest-HypervisorAdminNegativeTestJSON-1533100 tempest-HypervisorAdminNegativeTestJSON-1533100-project] Calling method '.version_select at 0x7f0ae31a3820>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:54:30.771545 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-656a8111-82e4-4b7f-af3a-647825a14aad tempest-HypervisorAdminNegativeTestJSON-1533100 tempest-HypervisorAdminNegativeTestJSON-1533100-project] Policy check for os_compute_api:os-hypervisors:list-detail failed with credentials {'is_admin': False, 'user_id': 'dcaa25d0dff141ecad9bffe7836fbf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6297e6cddda24a60aafab65c96a4fad8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:54:30.774874 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-656a8111-82e4-4b7f-af3a-647825a14aad tempest-HypervisorAdminNegativeTestJSON-1533100 tempest-HypervisorAdminNegativeTestJSON-1533100-project] Request method failure captured: Nov 01 18:54:30.774874 n-d-863052-2 devstack@n-api.service[121403]: request: GET /compute/v2.1/os-hypervisors/detail HTTP/1.1 Nov 01 18:54:30.774874 n-d-863052-2 devstack@n-api.service[121403]: Accept: application/json Nov 01 18:54:30.774874 n-d-863052-2 devstack@n-api.service[121403]: Accept-Encoding: identity Nov 01 18:54:30.774874 n-d-863052-2 devstack@n-api.service[121403]: Connection: close Nov 01 18:54:30.774874 n-d-863052-2 devstack@n-api.service[121403]: Content-Length: 0 Nov 01 18:54:30.774874 n-d-863052-2 devstack@n-api.service[121403]: Content-Type: application/json Nov 01 18:54:30.774874 n-d-863052-2 devstack@n-api.service[121403]: Host: 10.222.0.13 Nov 01 18:54:30.774874 n-d-863052-2 devstack@n-api.service[121403]: Openstack-System-Scope: None Nov 01 18:54:30.774874 n-d-863052-2 devstack@n-api.service[121403]: User-Agent: python-urllib3/1.26.12 Nov 01 18:54:30.774874 n-d-863052-2 devstack@n-api.service[121403]: X-Auth-Token: gAAAAABjYWthPN5DlhCvyce2BPg6oyUfrCVpJtSBMOYQSSiUPSiaBcquZj6IqB0zyPfwghpj6Qf2_NaQUl6ynYMsbDP9DAIcFjVYotmlu518yoZckllqB-5KRkLPxTThkkp1d3IaarEFp0vpZCHYQstaskeTURcfO0smEyRwpbdFu1jw1QiOscQ Nov 01 18:54:30.774874 n-d-863052-2 devstack@n-api.service[121403]: X-Domain-Id: None Nov 01 18:54:30.774874 n-d-863052-2 devstack@n-api.service[121403]: X-Domain-Name: None Nov 01 18:54:30.774874 n-d-863052-2 devstack@n-api.service[121403]: X-Identity-Status: Confirmed Nov 01 18:54:30.774874 n-d-863052-2 devstack@n-api.service[121403]: X-Is-Admin-Project: True Nov 01 18:54:30.774874 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Domain-Id: default Nov 01 18:54:30.774874 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Domain-Name: Default Nov 01 18:54:30.774874 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Id: 6297e6cddda24a60aafab65c96a4fad8 Nov 01 18:54:30.774874 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1533100 Nov 01 18:54:30.774874 n-d-863052-2 devstack@n-api.service[121403]: X-Role: member,reader Nov 01 18:54:30.774874 n-d-863052-2 devstack@n-api.service[121403]: X-Roles: member,reader Nov 01 18:54:30.776335 n-d-863052-2 devstack@n-api.service[121403]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/6297e6cddda24a60aafab65c96a4fad8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/6297e6cddda24a60aafab65c96a4fad8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_6297e6cddda24a60aafab65c96a4fad8", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/6297e6cddda24a60aafab65c96a4fad8"}]}] Nov 01 18:54:30.776335 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1533100 Nov 01 18:54:30.776335 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant-Id: 6297e6cddda24a60aafab65c96a4fad8 Nov 01 18:54:30.776335 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1533100 Nov 01 18:54:30.776335 n-d-863052-2 devstack@n-api.service[121403]: X-User: tempest-HypervisorAdminNegativeTestJSON-1533100-project Nov 01 18:54:30.776335 n-d-863052-2 devstack@n-api.service[121403]: X-User-Domain-Id: default Nov 01 18:54:30.776335 n-d-863052-2 devstack@n-api.service[121403]: X-User-Domain-Name: Default Nov 01 18:54:30.776335 n-d-863052-2 devstack@n-api.service[121403]: X-User-Id: dcaa25d0dff141ecad9bffe7836fbf9b Nov 01 18:54:30.776335 n-d-863052-2 devstack@n-api.service[121403]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1533100-project Nov 01 18:54:30.776335 n-d-863052-2 devstack@n-api.service[121403]: method: Nov 01 18:54:30.776335 n-d-863052-2 devstack@n-api.service[121403]: exception: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Nov 01 18:54:30.776335 n-d-863052-2 devstack@n-api.service[121403]: action_args: {} Nov 01 18:54:30.776335 n-d-863052-2 devstack@n-api.service[121403]: {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 01 18:54:30.777285 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:54:30.777285 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 18:54:30.777285 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 18:54:30.777285 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 01 18:54:30.777285 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 01 18:54:30.777285 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 01 18:54:30.777285 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 01 18:54:30.777285 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 01 18:54:30.777285 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 01 18:54:30.777285 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 285, in detail Nov 01 18:54:30.777285 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return self._detail(req) Nov 01 18:54:30.777285 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 289, in _detail Nov 01 18:54:30.777285 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'list-detail', target={}) Nov 01 18:54:30.777285 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Nov 01 18:54:30.777285 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Nov 01 18:54:30.777285 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Nov 01 18:54:30.777285 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Nov 01 18:54:30.777285 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 01 18:54:30.777285 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 01 18:54:30.778308 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 01 18:54:30.778308 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise self.value Nov 01 18:54:30.778308 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Nov 01 18:54:30.778308 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Nov 01 18:54:30.778308 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Nov 01 18:54:30.778308 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return self.enforce( Nov 01 18:54:30.778308 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Nov 01 18:54:30.778308 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Nov 01 18:54:30.778308 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Nov 01 18:54:30.778308 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 18:54:30.778308 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 18:54:30.778308 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 18:54:30.778308 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:54:30.778308 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 18:54:30.778308 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 18:54:30.778308 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Nov 01 18:54:30.778308 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Nov 01 18:54:30.778308 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Nov 01 18:54:30.778308 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 18:54:30.779561 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-213bc0cb-7734-415b-bedb-f83f78a2464b tempest-FlavorsAccessNegativeTestJSON-1324123958 tempest-FlavorsAccessNegativeTestJSON-1324123958-project-admin] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:54:30.780710 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-656a8111-82e4-4b7f-af3a-647825a14aad tempest-HypervisorAdminNegativeTestJSON-1533100 tempest-HypervisorAdminNegativeTestJSON-1533100-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. {{(pid=121403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 01 18:54:30.783385 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-656a8111-82e4-4b7f-af3a-647825a14aad tempest-HypervisorAdminNegativeTestJSON-1533100 tempest-HypervisorAdminNegativeTestJSON-1533100-project] 10.222.0.13 "GET /compute/v2.1/os-hypervisors/detail" status: 403 len: 122 microversion: 2.1 time: 0.885327 Nov 01 18:54:30.785297 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 37/78] 10.222.0.13 () {58 vars in 1167 bytes} [Tue Nov 1 18:54:29 2022] GET /compute/v2.1/os-hypervisors/detail => generated 122 bytes in 896 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Nov 01 18:54:30.795317 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-4fda3ce2-e87e-4253-86f3-81470ad4205f tempest-HypervisorAdminNegativeTestJSON-1533100 tempest-HypervisorAdminNegativeTestJSON-1533100-project] Calling method '.version_select at 0x7f0ae34fb430>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:54:30.797540 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-4fda3ce2-e87e-4253-86f3-81470ad4205f tempest-HypervisorAdminNegativeTestJSON-1533100 tempest-HypervisorAdminNegativeTestJSON-1533100-project] Policy check for os_compute_api:os-hypervisors:list failed with credentials {'is_admin': False, 'user_id': 'dcaa25d0dff141ecad9bffe7836fbf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6297e6cddda24a60aafab65c96a4fad8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:54:30.812516 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-4fda3ce2-e87e-4253-86f3-81470ad4205f tempest-HypervisorAdminNegativeTestJSON-1533100 tempest-HypervisorAdminNegativeTestJSON-1533100-project] Request method failure captured: Nov 01 18:54:30.812516 n-d-863052-2 devstack@n-api.service[121403]: request: GET /compute/v2.1/os-hypervisors HTTP/1.1 Nov 01 18:54:30.812516 n-d-863052-2 devstack@n-api.service[121403]: Accept: application/json Nov 01 18:54:30.812516 n-d-863052-2 devstack@n-api.service[121403]: Accept-Encoding: identity Nov 01 18:54:30.812516 n-d-863052-2 devstack@n-api.service[121403]: Connection: close Nov 01 18:54:30.812516 n-d-863052-2 devstack@n-api.service[121403]: Content-Length: 0 Nov 01 18:54:30.812516 n-d-863052-2 devstack@n-api.service[121403]: Content-Type: application/json Nov 01 18:54:30.812516 n-d-863052-2 devstack@n-api.service[121403]: Host: 10.222.0.13 Nov 01 18:54:30.812516 n-d-863052-2 devstack@n-api.service[121403]: Openstack-System-Scope: None Nov 01 18:54:30.812516 n-d-863052-2 devstack@n-api.service[121403]: User-Agent: python-urllib3/1.26.12 Nov 01 18:54:30.812516 n-d-863052-2 devstack@n-api.service[121403]: X-Auth-Token: gAAAAABjYWthPN5DlhCvyce2BPg6oyUfrCVpJtSBMOYQSSiUPSiaBcquZj6IqB0zyPfwghpj6Qf2_NaQUl6ynYMsbDP9DAIcFjVYotmlu518yoZckllqB-5KRkLPxTThkkp1d3IaarEFp0vpZCHYQstaskeTURcfO0smEyRwpbdFu1jw1QiOscQ Nov 01 18:54:30.812516 n-d-863052-2 devstack@n-api.service[121403]: X-Domain-Id: None Nov 01 18:54:30.812516 n-d-863052-2 devstack@n-api.service[121403]: X-Domain-Name: None Nov 01 18:54:30.812516 n-d-863052-2 devstack@n-api.service[121403]: X-Identity-Status: Confirmed Nov 01 18:54:30.812516 n-d-863052-2 devstack@n-api.service[121403]: X-Is-Admin-Project: True Nov 01 18:54:30.812516 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Domain-Id: default Nov 01 18:54:30.812516 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Domain-Name: Default Nov 01 18:54:30.812516 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Id: 6297e6cddda24a60aafab65c96a4fad8 Nov 01 18:54:30.812516 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1533100 Nov 01 18:54:30.812516 n-d-863052-2 devstack@n-api.service[121403]: X-Role: member,reader Nov 01 18:54:30.812516 n-d-863052-2 devstack@n-api.service[121403]: X-Roles: member,reader Nov 01 18:54:30.813676 n-d-863052-2 devstack@n-api.service[121403]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/6297e6cddda24a60aafab65c96a4fad8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/6297e6cddda24a60aafab65c96a4fad8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_6297e6cddda24a60aafab65c96a4fad8", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/6297e6cddda24a60aafab65c96a4fad8"}]}] Nov 01 18:54:30.813676 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1533100 Nov 01 18:54:30.813676 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant-Id: 6297e6cddda24a60aafab65c96a4fad8 Nov 01 18:54:30.813676 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1533100 Nov 01 18:54:30.813676 n-d-863052-2 devstack@n-api.service[121403]: X-User: tempest-HypervisorAdminNegativeTestJSON-1533100-project Nov 01 18:54:30.813676 n-d-863052-2 devstack@n-api.service[121403]: X-User-Domain-Id: default Nov 01 18:54:30.813676 n-d-863052-2 devstack@n-api.service[121403]: X-User-Domain-Name: Default Nov 01 18:54:30.813676 n-d-863052-2 devstack@n-api.service[121403]: X-User-Id: dcaa25d0dff141ecad9bffe7836fbf9b Nov 01 18:54:30.813676 n-d-863052-2 devstack@n-api.service[121403]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1533100-project Nov 01 18:54:30.813676 n-d-863052-2 devstack@n-api.service[121403]: method: Nov 01 18:54:30.813676 n-d-863052-2 devstack@n-api.service[121403]: exception: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Nov 01 18:54:30.813676 n-d-863052-2 devstack@n-api.service[121403]: action_args: {} Nov 01 18:54:30.813676 n-d-863052-2 devstack@n-api.service[121403]: {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 01 18:54:30.814334 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:54:30.814334 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 18:54:30.814334 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 18:54:30.814334 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 01 18:54:30.814334 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 01 18:54:30.814334 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 01 18:54:30.814334 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 01 18:54:30.814334 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 01 18:54:30.814334 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 01 18:54:30.814334 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 253, in index Nov 01 18:54:30.814334 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return self._index(req) Nov 01 18:54:30.814334 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 257, in _index Nov 01 18:54:30.814334 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'list', target={}) Nov 01 18:54:30.814334 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Nov 01 18:54:30.814334 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Nov 01 18:54:30.814334 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Nov 01 18:54:30.814334 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Nov 01 18:54:30.814334 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 01 18:54:30.814334 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 01 18:54:30.815269 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 01 18:54:30.815269 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise self.value Nov 01 18:54:30.815269 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Nov 01 18:54:30.815269 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Nov 01 18:54:30.815269 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Nov 01 18:54:30.815269 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return self.enforce( Nov 01 18:54:30.815269 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Nov 01 18:54:30.815269 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Nov 01 18:54:30.815269 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Nov 01 18:54:30.815269 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 18:54:30.815269 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 18:54:30.815269 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 18:54:30.815269 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:54:30.815269 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 18:54:30.815269 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 18:54:30.815269 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Nov 01 18:54:30.815269 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Nov 01 18:54:30.815269 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Nov 01 18:54:30.815269 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 18:54:30.821816 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-4fda3ce2-e87e-4253-86f3-81470ad4205f tempest-HypervisorAdminNegativeTestJSON-1533100 tempest-HypervisorAdminNegativeTestJSON-1533100-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. {{(pid=121403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 01 18:54:30.823210 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-4fda3ce2-e87e-4253-86f3-81470ad4205f tempest-HypervisorAdminNegativeTestJSON-1533100 tempest-HypervisorAdminNegativeTestJSON-1533100-project] 10.222.0.13 "GET /compute/v2.1/os-hypervisors" status: 403 len: 115 microversion: 2.1 time: 0.032806 Nov 01 18:54:30.825640 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 38/79] 10.222.0.13 () {58 vars in 1146 bytes} [Tue Nov 1 18:54:30 2022] GET /compute/v2.1/os-hypervisors => generated 115 bytes in 36 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Nov 01 18:54:30.845443 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-e25407fe-0d16-41c7-b4e5-ce77d9b30811 tempest-HypervisorAdminNegativeTestJSON-1533100 tempest-HypervisorAdminNegativeTestJSON-1533100-project] Calling method '.version_select at 0x7f0ae30e6ee0>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:54:30.850424 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-e25407fe-0d16-41c7-b4e5-ce77d9b30811 tempest-HypervisorAdminNegativeTestJSON-1533100 tempest-HypervisorAdminNegativeTestJSON-1533100-project] Policy check for os_compute_api:os-hypervisors:statistics failed with credentials {'is_admin': False, 'user_id': 'dcaa25d0dff141ecad9bffe7836fbf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6297e6cddda24a60aafab65c96a4fad8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:54:30.853192 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-e25407fe-0d16-41c7-b4e5-ce77d9b30811 tempest-HypervisorAdminNegativeTestJSON-1533100 tempest-HypervisorAdminNegativeTestJSON-1533100-project] Request method failure captured: Nov 01 18:54:30.853192 n-d-863052-2 devstack@n-api.service[121403]: request: GET /compute/v2.1/os-hypervisors/statistics HTTP/1.1 Nov 01 18:54:30.853192 n-d-863052-2 devstack@n-api.service[121403]: Accept: application/json Nov 01 18:54:30.853192 n-d-863052-2 devstack@n-api.service[121403]: Accept-Encoding: identity Nov 01 18:54:30.853192 n-d-863052-2 devstack@n-api.service[121403]: Connection: close Nov 01 18:54:30.853192 n-d-863052-2 devstack@n-api.service[121403]: Content-Length: 0 Nov 01 18:54:30.853192 n-d-863052-2 devstack@n-api.service[121403]: Content-Type: application/json Nov 01 18:54:30.853192 n-d-863052-2 devstack@n-api.service[121403]: Host: 10.222.0.13 Nov 01 18:54:30.853192 n-d-863052-2 devstack@n-api.service[121403]: Openstack-System-Scope: None Nov 01 18:54:30.853192 n-d-863052-2 devstack@n-api.service[121403]: User-Agent: python-urllib3/1.26.12 Nov 01 18:54:30.853192 n-d-863052-2 devstack@n-api.service[121403]: X-Auth-Token: gAAAAABjYWthPN5DlhCvyce2BPg6oyUfrCVpJtSBMOYQSSiUPSiaBcquZj6IqB0zyPfwghpj6Qf2_NaQUl6ynYMsbDP9DAIcFjVYotmlu518yoZckllqB-5KRkLPxTThkkp1d3IaarEFp0vpZCHYQstaskeTURcfO0smEyRwpbdFu1jw1QiOscQ Nov 01 18:54:30.853192 n-d-863052-2 devstack@n-api.service[121403]: X-Domain-Id: None Nov 01 18:54:30.853192 n-d-863052-2 devstack@n-api.service[121403]: X-Domain-Name: None Nov 01 18:54:30.853192 n-d-863052-2 devstack@n-api.service[121403]: X-Identity-Status: Confirmed Nov 01 18:54:30.853192 n-d-863052-2 devstack@n-api.service[121403]: X-Is-Admin-Project: True Nov 01 18:54:30.853192 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Domain-Id: default Nov 01 18:54:30.853192 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Domain-Name: Default Nov 01 18:54:30.853192 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Id: 6297e6cddda24a60aafab65c96a4fad8 Nov 01 18:54:30.853192 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1533100 Nov 01 18:54:30.853192 n-d-863052-2 devstack@n-api.service[121403]: X-Role: member,reader Nov 01 18:54:30.853192 n-d-863052-2 devstack@n-api.service[121403]: X-Roles: member,reader Nov 01 18:54:30.855594 n-d-863052-2 devstack@n-api.service[121403]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/6297e6cddda24a60aafab65c96a4fad8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/6297e6cddda24a60aafab65c96a4fad8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_6297e6cddda24a60aafab65c96a4fad8", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/6297e6cddda24a60aafab65c96a4fad8"}]}] Nov 01 18:54:30.855594 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1533100 Nov 01 18:54:30.855594 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant-Id: 6297e6cddda24a60aafab65c96a4fad8 Nov 01 18:54:30.855594 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1533100 Nov 01 18:54:30.855594 n-d-863052-2 devstack@n-api.service[121403]: X-User: tempest-HypervisorAdminNegativeTestJSON-1533100-project Nov 01 18:54:30.855594 n-d-863052-2 devstack@n-api.service[121403]: X-User-Domain-Id: default Nov 01 18:54:30.855594 n-d-863052-2 devstack@n-api.service[121403]: X-User-Domain-Name: Default Nov 01 18:54:30.855594 n-d-863052-2 devstack@n-api.service[121403]: X-User-Id: dcaa25d0dff141ecad9bffe7836fbf9b Nov 01 18:54:30.855594 n-d-863052-2 devstack@n-api.service[121403]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1533100-project Nov 01 18:54:30.855594 n-d-863052-2 devstack@n-api.service[121403]: method: Nov 01 18:54:30.855594 n-d-863052-2 devstack@n-api.service[121403]: exception: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Nov 01 18:54:30.855594 n-d-863052-2 devstack@n-api.service[121403]: action_args: {} Nov 01 18:54:30.855594 n-d-863052-2 devstack@n-api.service[121403]: {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 01 18:54:30.856538 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:54:30.856538 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 18:54:30.856538 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 18:54:30.856538 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 01 18:54:30.856538 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 01 18:54:30.856538 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 01 18:54:30.856538 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 01 18:54:30.856538 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 01 18:54:30.856538 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 01 18:54:30.856538 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 521, in statistics Nov 01 18:54:30.856538 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'statistics', target={}) Nov 01 18:54:30.856538 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Nov 01 18:54:30.856538 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Nov 01 18:54:30.856538 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Nov 01 18:54:30.856538 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Nov 01 18:54:30.856538 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 01 18:54:30.856538 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 01 18:54:30.856538 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 01 18:54:30.856538 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise self.value Nov 01 18:54:30.858132 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Nov 01 18:54:30.858132 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Nov 01 18:54:30.858132 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Nov 01 18:54:30.858132 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return self.enforce( Nov 01 18:54:30.858132 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Nov 01 18:54:30.858132 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Nov 01 18:54:30.858132 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Nov 01 18:54:30.858132 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 18:54:30.858132 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 18:54:30.858132 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 18:54:30.858132 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:54:30.858132 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 18:54:30.858132 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 18:54:30.858132 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Nov 01 18:54:30.858132 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Nov 01 18:54:30.858132 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Nov 01 18:54:30.858132 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 18:54:30.870794 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-e25407fe-0d16-41c7-b4e5-ce77d9b30811 tempest-HypervisorAdminNegativeTestJSON-1533100 tempest-HypervisorAdminNegativeTestJSON-1533100-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. {{(pid=121403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 01 18:54:30.872027 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-e25407fe-0d16-41c7-b4e5-ce77d9b30811 tempest-HypervisorAdminNegativeTestJSON-1533100 tempest-HypervisorAdminNegativeTestJSON-1533100-project] 10.222.0.13 "GET /compute/v2.1/os-hypervisors/statistics" status: 403 len: 121 microversion: 2.1 time: 0.033006 Nov 01 18:54:30.873927 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 39/80] 10.222.0.13 () {58 vars in 1179 bytes} [Tue Nov 1 18:54:30 2022] GET /compute/v2.1/os-hypervisors/statistics => generated 121 bytes in 37 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Nov 01 18:54:30.886407 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-213bc0cb-7734-415b-bedb-f83f78a2464b tempest-FlavorsAccessNegativeTestJSON-1324123958 tempest-FlavorsAccessNegativeTestJSON-1324123958-project-admin] 10.222.0.13 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.116919 Nov 01 18:54:30.899732 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 42/81] 10.222.0.13 () {58 vars in 1146 bytes} [Tue Nov 1 18:54:30 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:54:30.915359 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-8c317ba6-0e6b-4d13-b609-631cd3fbf9a5 tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:54:30.916509 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-8c317ba6-0e6b-4d13-b609-631cd3fbf9a5 tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] [instance: 4ebac531-6f77-4108-afc9-0eccb86dee8b] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:54:30.961562 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-8c317ba6-0e6b-4d13-b609-631cd3fbf9a5 tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:54:30.962061 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-8c317ba6-0e6b-4d13-b609-631cd3fbf9a5 tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:54:30.962502 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-8c317ba6-0e6b-4d13-b609-631cd3fbf9a5 tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:54:30.963750 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-8c317ba6-0e6b-4d13-b609-631cd3fbf9a5 tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:54:30.964224 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-8c317ba6-0e6b-4d13-b609-631cd3fbf9a5 tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:54:30.964687 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-8c317ba6-0e6b-4d13-b609-631cd3fbf9a5 tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:54:32.052440 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-754576e3-1f33-41de-a135-f3a52da6af77 tempest-HypervisorAdminNegativeTestJSON-1372933775 tempest-HypervisorAdminNegativeTestJSON-1372933775-project-admin] Calling method '.version_select at 0x7f0ae309ee50>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:54:32.055059 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-754576e3-1f33-41de-a135-f3a52da6af77 tempest-HypervisorAdminNegativeTestJSON-1372933775 tempest-HypervisorAdminNegativeTestJSON-1372933775-project-admin] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:54:32.055644 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-754576e3-1f33-41de-a135-f3a52da6af77 tempest-HypervisorAdminNegativeTestJSON-1372933775 tempest-HypervisorAdminNegativeTestJSON-1372933775-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:54:32.056180 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-754576e3-1f33-41de-a135-f3a52da6af77 tempest-HypervisorAdminNegativeTestJSON-1372933775 tempest-HypervisorAdminNegativeTestJSON-1372933775-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:54:32.131580 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-754576e3-1f33-41de-a135-f3a52da6af77 tempest-HypervisorAdminNegativeTestJSON-1372933775 tempest-HypervisorAdminNegativeTestJSON-1372933775-project-admin] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:54:32.132149 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-754576e3-1f33-41de-a135-f3a52da6af77 tempest-HypervisorAdminNegativeTestJSON-1372933775 tempest-HypervisorAdminNegativeTestJSON-1372933775-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:54:32.134213 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-754576e3-1f33-41de-a135-f3a52da6af77 tempest-HypervisorAdminNegativeTestJSON-1372933775 tempest-HypervisorAdminNegativeTestJSON-1372933775-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:54:32.156328 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-754576e3-1f33-41de-a135-f3a52da6af77 tempest-HypervisorAdminNegativeTestJSON-1372933775 tempest-HypervisorAdminNegativeTestJSON-1372933775-project-admin] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:54:32.157070 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-754576e3-1f33-41de-a135-f3a52da6af77 tempest-HypervisorAdminNegativeTestJSON-1372933775 tempest-HypervisorAdminNegativeTestJSON-1372933775-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:54:32.157645 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-754576e3-1f33-41de-a135-f3a52da6af77 tempest-HypervisorAdminNegativeTestJSON-1372933775 tempest-HypervisorAdminNegativeTestJSON-1372933775-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:54:32.176163 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-754576e3-1f33-41de-a135-f3a52da6af77 tempest-HypervisorAdminNegativeTestJSON-1372933775 tempest-HypervisorAdminNegativeTestJSON-1372933775-project-admin] 10.222.0.13 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 1.295164 Nov 01 18:54:32.177732 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 40/82] 10.222.0.13 () {58 vars in 1146 bytes} [Tue Nov 1 18:54:30 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 1297 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 18:54:32.407539 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-5d874c8b-38e8-4436-ae49-6a09d007c849 tempest-HostsAdminNegativeTestJSON-71042643 tempest-HostsAdminNegativeTestJSON-71042643-project-admin] Calling method '.version_select at 0x7f0ae31a3b80>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:54:32.420489 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-5d874c8b-38e8-4436-ae49-6a09d007c849 tempest-HostsAdminNegativeTestJSON-71042643 tempest-HostsAdminNegativeTestJSON-71042643-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:54:32.421013 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-5d874c8b-38e8-4436-ae49-6a09d007c849 tempest-HostsAdminNegativeTestJSON-71042643 tempest-HostsAdminNegativeTestJSON-71042643-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:54:32.421460 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-5d874c8b-38e8-4436-ae49-6a09d007c849 tempest-HostsAdminNegativeTestJSON-71042643 tempest-HostsAdminNegativeTestJSON-71042643-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:54:32.422169 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-5d874c8b-38e8-4436-ae49-6a09d007c849 tempest-HostsAdminNegativeTestJSON-71042643 tempest-HostsAdminNegativeTestJSON-71042643-project-admin] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:54:32.422637 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-5d874c8b-38e8-4436-ae49-6a09d007c849 tempest-HostsAdminNegativeTestJSON-71042643 tempest-HostsAdminNegativeTestJSON-71042643-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:54:32.423111 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-5d874c8b-38e8-4436-ae49-6a09d007c849 tempest-HostsAdminNegativeTestJSON-71042643 tempest-HostsAdminNegativeTestJSON-71042643-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:54:32.540342 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-5d874c8b-38e8-4436-ae49-6a09d007c849 tempest-HostsAdminNegativeTestJSON-71042643 tempest-HostsAdminNegativeTestJSON-71042643-project-admin] 10.222.0.13 "GET /compute/v2.1/os-hosts" status: 200 len: 398 microversion: 2.1 time: 0.361029 Nov 01 18:54:32.554632 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 41/83] 10.222.0.13 () {58 vars in 1128 bytes} [Tue Nov 1 18:54:32 2022] GET /compute/v2.1/os-hosts => generated 398 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 18:54:32.564193 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-8c317ba6-0e6b-4d13-b609-631cd3fbf9a5 tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce2e0d1828674809a3344a7a68f375c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8e1248497284006a7acbb8169627ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:54:32.578766 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-8c317ba6-0e6b-4d13-b609-631cd3fbf9a5 tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] 10.222.0.13 "GET /compute/v2.1/servers/4ebac531-6f77-4108-afc9-0eccb86dee8b" status: 200 len: 1341 microversion: 2.1 time: 1.667090 Nov 01 18:54:32.588603 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 43/84] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:54:30 2022] GET /compute/v2.1/servers/4ebac531-6f77-4108-afc9-0eccb86dee8b => generated 1341 bytes in 1668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:54:32.603235 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-dc76a40c-aa4b-43e2-9935-58477e68478d tempest-AggregatesAdminTestJSON-768412114 tempest-AggregatesAdminTestJSON-768412114-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:54:32.604361 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-dc76a40c-aa4b-43e2-9935-58477e68478d tempest-AggregatesAdminTestJSON-768412114 tempest-AggregatesAdminTestJSON-768412114-project] [instance: 7967bf1f-943f-441d-befd-373868bbb3aa] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:54:32.620308 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-dc76a40c-aa4b-43e2-9935-58477e68478d tempest-AggregatesAdminTestJSON-768412114 tempest-AggregatesAdminTestJSON-768412114-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:54:32.621337 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-dc76a40c-aa4b-43e2-9935-58477e68478d tempest-AggregatesAdminTestJSON-768412114 tempest-AggregatesAdminTestJSON-768412114-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:54:32.624040 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-dc76a40c-aa4b-43e2-9935-58477e68478d tempest-AggregatesAdminTestJSON-768412114 tempest-AggregatesAdminTestJSON-768412114-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:54:32.632308 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-dc76a40c-aa4b-43e2-9935-58477e68478d tempest-AggregatesAdminTestJSON-768412114 tempest-AggregatesAdminTestJSON-768412114-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:54:32.632859 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-dc76a40c-aa4b-43e2-9935-58477e68478d tempest-AggregatesAdminTestJSON-768412114 tempest-AggregatesAdminTestJSON-768412114-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:54:32.635448 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-dc76a40c-aa4b-43e2-9935-58477e68478d tempest-AggregatesAdminTestJSON-768412114 tempest-AggregatesAdminTestJSON-768412114-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:54:32.949979 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-13a514d0-7b25-47f9-b803-e9c835dfd650 tempest-AZAdminV2TestJSON-225246196 tempest-AZAdminV2TestJSON-225246196-project-admin] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:54:32.954910 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-13a514d0-7b25-47f9-b803-e9c835dfd650 tempest-AZAdminV2TestJSON-225246196 tempest-AZAdminV2TestJSON-225246196-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:54:32.955437 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-13a514d0-7b25-47f9-b803-e9c835dfd650 tempest-AZAdminV2TestJSON-225246196 tempest-AZAdminV2TestJSON-225246196-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:54:32.955883 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-13a514d0-7b25-47f9-b803-e9c835dfd650 tempest-AZAdminV2TestJSON-225246196 tempest-AZAdminV2TestJSON-225246196-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:54:32.957001 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-13a514d0-7b25-47f9-b803-e9c835dfd650 tempest-AZAdminV2TestJSON-225246196 tempest-AZAdminV2TestJSON-225246196-project-admin] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:54:32.957114 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-13a514d0-7b25-47f9-b803-e9c835dfd650 tempest-AZAdminV2TestJSON-225246196 tempest-AZAdminV2TestJSON-225246196-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:54:32.957507 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-13a514d0-7b25-47f9-b803-e9c835dfd650 tempest-AZAdminV2TestJSON-225246196 tempest-AZAdminV2TestJSON-225246196-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:54:33.040122 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-13a514d0-7b25-47f9-b803-e9c835dfd650 tempest-AZAdminV2TestJSON-225246196 tempest-AZAdminV2TestJSON-225246196-project-admin] 10.222.0.13 "GET /compute/v2.1/os-availability-zone" status: 200 len: 190 microversion: 2.1 time: 0.483975 Nov 01 18:54:33.042759 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 42/85] 10.222.0.13 () {58 vars in 1164 bytes} [Tue Nov 1 18:54:32 2022] GET /compute/v2.1/os-availability-zone => generated 190 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 18:54:33.049117 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-a3bcb7cb-9c5c-457d-a122-77223b579312 tempest-HypervisorAdminNegativeTestJSON-1533100 tempest-HypervisorAdminNegativeTestJSON-1533100-project] Calling method '.version_select at 0x7f0ae309eee0>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:54:33.060393 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-a3bcb7cb-9c5c-457d-a122-77223b579312 tempest-HypervisorAdminNegativeTestJSON-1533100 tempest-HypervisorAdminNegativeTestJSON-1533100-project] Policy check for os_compute_api:os-hypervisors:uptime failed with credentials {'is_admin': False, 'user_id': 'dcaa25d0dff141ecad9bffe7836fbf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6297e6cddda24a60aafab65c96a4fad8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:54:33.064834 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-a3bcb7cb-9c5c-457d-a122-77223b579312 tempest-HypervisorAdminNegativeTestJSON-1533100 tempest-HypervisorAdminNegativeTestJSON-1533100-project] Request method failure captured: Nov 01 18:54:33.064834 n-d-863052-2 devstack@n-api.service[121403]: request: GET /compute/v2.1/os-hypervisors/1/uptime HTTP/1.1 Nov 01 18:54:33.064834 n-d-863052-2 devstack@n-api.service[121403]: Accept: application/json Nov 01 18:54:33.064834 n-d-863052-2 devstack@n-api.service[121403]: Accept-Encoding: identity Nov 01 18:54:33.064834 n-d-863052-2 devstack@n-api.service[121403]: Connection: close Nov 01 18:54:33.064834 n-d-863052-2 devstack@n-api.service[121403]: Content-Length: 0 Nov 01 18:54:33.064834 n-d-863052-2 devstack@n-api.service[121403]: Content-Type: application/json Nov 01 18:54:33.064834 n-d-863052-2 devstack@n-api.service[121403]: Host: 10.222.0.13 Nov 01 18:54:33.064834 n-d-863052-2 devstack@n-api.service[121403]: Openstack-System-Scope: None Nov 01 18:54:33.064834 n-d-863052-2 devstack@n-api.service[121403]: User-Agent: python-urllib3/1.26.12 Nov 01 18:54:33.064834 n-d-863052-2 devstack@n-api.service[121403]: X-Auth-Token: gAAAAABjYWthPN5DlhCvyce2BPg6oyUfrCVpJtSBMOYQSSiUPSiaBcquZj6IqB0zyPfwghpj6Qf2_NaQUl6ynYMsbDP9DAIcFjVYotmlu518yoZckllqB-5KRkLPxTThkkp1d3IaarEFp0vpZCHYQstaskeTURcfO0smEyRwpbdFu1jw1QiOscQ Nov 01 18:54:33.064834 n-d-863052-2 devstack@n-api.service[121403]: X-Domain-Id: None Nov 01 18:54:33.064834 n-d-863052-2 devstack@n-api.service[121403]: X-Domain-Name: None Nov 01 18:54:33.064834 n-d-863052-2 devstack@n-api.service[121403]: X-Identity-Status: Confirmed Nov 01 18:54:33.064834 n-d-863052-2 devstack@n-api.service[121403]: X-Is-Admin-Project: True Nov 01 18:54:33.064834 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Domain-Id: default Nov 01 18:54:33.064834 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Domain-Name: Default Nov 01 18:54:33.064834 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Id: 6297e6cddda24a60aafab65c96a4fad8 Nov 01 18:54:33.064834 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1533100 Nov 01 18:54:33.064834 n-d-863052-2 devstack@n-api.service[121403]: X-Role: member,reader Nov 01 18:54:33.064834 n-d-863052-2 devstack@n-api.service[121403]: X-Roles: member,reader Nov 01 18:54:33.066164 n-d-863052-2 devstack@n-api.service[121403]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/6297e6cddda24a60aafab65c96a4fad8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/6297e6cddda24a60aafab65c96a4fad8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_6297e6cddda24a60aafab65c96a4fad8", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/6297e6cddda24a60aafab65c96a4fad8"}]}] Nov 01 18:54:33.066164 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1533100 Nov 01 18:54:33.066164 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant-Id: 6297e6cddda24a60aafab65c96a4fad8 Nov 01 18:54:33.066164 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1533100 Nov 01 18:54:33.066164 n-d-863052-2 devstack@n-api.service[121403]: X-User: tempest-HypervisorAdminNegativeTestJSON-1533100-project Nov 01 18:54:33.066164 n-d-863052-2 devstack@n-api.service[121403]: X-User-Domain-Id: default Nov 01 18:54:33.066164 n-d-863052-2 devstack@n-api.service[121403]: X-User-Domain-Name: Default Nov 01 18:54:33.066164 n-d-863052-2 devstack@n-api.service[121403]: X-User-Id: dcaa25d0dff141ecad9bffe7836fbf9b Nov 01 18:54:33.066164 n-d-863052-2 devstack@n-api.service[121403]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1533100-project Nov 01 18:54:33.066164 n-d-863052-2 devstack@n-api.service[121403]: method: Nov 01 18:54:33.066164 n-d-863052-2 devstack@n-api.service[121403]: exception: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Nov 01 18:54:33.066164 n-d-863052-2 devstack@n-api.service[121403]: action_args: {'id': '1'} Nov 01 18:54:33.066164 n-d-863052-2 devstack@n-api.service[121403]: {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 01 18:54:33.066980 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:54:33.066980 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 18:54:33.066980 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 18:54:33.066980 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 01 18:54:33.066980 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 01 18:54:33.066980 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 01 18:54:33.066980 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 01 18:54:33.066980 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 01 18:54:33.066980 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 01 18:54:33.066980 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 387, in uptime Nov 01 18:54:33.066980 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'uptime', target={}) Nov 01 18:54:33.066980 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Nov 01 18:54:33.066980 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Nov 01 18:54:33.066980 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Nov 01 18:54:33.066980 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Nov 01 18:54:33.066980 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 01 18:54:33.066980 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 01 18:54:33.066980 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 01 18:54:33.066980 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise self.value Nov 01 18:54:33.068041 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Nov 01 18:54:33.068041 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Nov 01 18:54:33.068041 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Nov 01 18:54:33.068041 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return self.enforce( Nov 01 18:54:33.068041 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Nov 01 18:54:33.068041 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Nov 01 18:54:33.068041 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Nov 01 18:54:33.068041 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 18:54:33.068041 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 18:54:33.068041 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 18:54:33.068041 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:54:33.068041 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 18:54:33.068041 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 18:54:33.068041 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Nov 01 18:54:33.068041 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Nov 01 18:54:33.068041 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Nov 01 18:54:33.068041 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 18:54:33.075876 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-a3bcb7cb-9c5c-457d-a122-77223b579312 tempest-HypervisorAdminNegativeTestJSON-1533100 tempest-HypervisorAdminNegativeTestJSON-1533100-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. {{(pid=121403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 01 18:54:33.077586 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-a3bcb7cb-9c5c-457d-a122-77223b579312 tempest-HypervisorAdminNegativeTestJSON-1533100 tempest-HypervisorAdminNegativeTestJSON-1533100-project] 10.222.0.13 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 403 len: 117 microversion: 2.1 time: 0.033396 Nov 01 18:54:33.080150 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 43/86] 10.222.0.13 () {58 vars in 1173 bytes} [Tue Nov 1 18:54:33 2022] GET /compute/v2.1/os-hypervisors/1/uptime => generated 117 bytes in 36 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Nov 01 18:54:33.401315 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-5eaa2377-368c-4911-9e71-cff45ba5adec tempest-HostsAdminNegativeTestJSON-1687021239 tempest-HostsAdminNegativeTestJSON-1687021239-project] Calling method '.version_select at 0x7f0ae30c45e0>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:54:33.403719 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-dc76a40c-aa4b-43e2-9935-58477e68478d tempest-AggregatesAdminTestJSON-768412114 tempest-AggregatesAdminTestJSON-768412114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439a7ac2509640c49361f9ba6636b34d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8382e1376b104295aa5cef36ba07cf45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:54:33.405351 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-5eaa2377-368c-4911-9e71-cff45ba5adec tempest-HostsAdminNegativeTestJSON-1687021239 tempest-HostsAdminNegativeTestJSON-1687021239-project] Policy check for os_compute_api:os-hosts:list failed with credentials {'is_admin': False, 'user_id': 'ff1e2d2d83ea49d5b1f03b5d9f18806e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '832b609a394a47049a94e1b5c0e19cf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:54:33.407915 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-5eaa2377-368c-4911-9e71-cff45ba5adec tempest-HostsAdminNegativeTestJSON-1687021239 tempest-HostsAdminNegativeTestJSON-1687021239-project] Request method failure captured: Nov 01 18:54:33.407915 n-d-863052-2 devstack@n-api.service[121403]: request: GET /compute/v2.1/os-hosts HTTP/1.1 Nov 01 18:54:33.407915 n-d-863052-2 devstack@n-api.service[121403]: Accept: application/json Nov 01 18:54:33.407915 n-d-863052-2 devstack@n-api.service[121403]: Accept-Encoding: identity Nov 01 18:54:33.407915 n-d-863052-2 devstack@n-api.service[121403]: Connection: close Nov 01 18:54:33.407915 n-d-863052-2 devstack@n-api.service[121403]: Content-Length: 0 Nov 01 18:54:33.407915 n-d-863052-2 devstack@n-api.service[121403]: Content-Type: application/json Nov 01 18:54:33.407915 n-d-863052-2 devstack@n-api.service[121403]: Host: 10.222.0.13 Nov 01 18:54:33.407915 n-d-863052-2 devstack@n-api.service[121403]: Openstack-System-Scope: None Nov 01 18:54:33.407915 n-d-863052-2 devstack@n-api.service[121403]: User-Agent: python-urllib3/1.26.12 Nov 01 18:54:33.407915 n-d-863052-2 devstack@n-api.service[121403]: X-Auth-Token: gAAAAABjYWtiIql9we6LCtbD02Cqvs-kfbeXJqsYuTCdlDG34Im5njq3YVPsJ6fYgh6UoU2eV0F1yGGY1ZBTjP_h6a4n-sp_6sGJEDLqgYwwpTZCmssS8yK9iLjMR9fnnTIyMEgFmNNtfCxgezUZrnO4MrqucB7BVTTAOUBFbdp09YeNonT0A_E Nov 01 18:54:33.407915 n-d-863052-2 devstack@n-api.service[121403]: X-Domain-Id: None Nov 01 18:54:33.407915 n-d-863052-2 devstack@n-api.service[121403]: X-Domain-Name: None Nov 01 18:54:33.407915 n-d-863052-2 devstack@n-api.service[121403]: X-Identity-Status: Confirmed Nov 01 18:54:33.407915 n-d-863052-2 devstack@n-api.service[121403]: X-Is-Admin-Project: True Nov 01 18:54:33.407915 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Domain-Id: default Nov 01 18:54:33.407915 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Domain-Name: Default Nov 01 18:54:33.407915 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Id: 832b609a394a47049a94e1b5c0e19cf4 Nov 01 18:54:33.407915 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1687021239 Nov 01 18:54:33.407915 n-d-863052-2 devstack@n-api.service[121403]: X-Role: member,reader Nov 01 18:54:33.407915 n-d-863052-2 devstack@n-api.service[121403]: X-Roles: member,reader Nov 01 18:54:33.409019 n-d-863052-2 devstack@n-api.service[121403]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/832b609a394a47049a94e1b5c0e19cf4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/832b609a394a47049a94e1b5c0e19cf4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_832b609a394a47049a94e1b5c0e19cf4", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/832b609a394a47049a94e1b5c0e19cf4"}]}] Nov 01 18:54:33.409019 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1687021239 Nov 01 18:54:33.409019 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant-Id: 832b609a394a47049a94e1b5c0e19cf4 Nov 01 18:54:33.409019 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1687021239 Nov 01 18:54:33.409019 n-d-863052-2 devstack@n-api.service[121403]: X-User: tempest-HostsAdminNegativeTestJSON-1687021239-project Nov 01 18:54:33.409019 n-d-863052-2 devstack@n-api.service[121403]: X-User-Domain-Id: default Nov 01 18:54:33.409019 n-d-863052-2 devstack@n-api.service[121403]: X-User-Domain-Name: Default Nov 01 18:54:33.409019 n-d-863052-2 devstack@n-api.service[121403]: X-User-Id: ff1e2d2d83ea49d5b1f03b5d9f18806e Nov 01 18:54:33.409019 n-d-863052-2 devstack@n-api.service[121403]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1687021239-project Nov 01 18:54:33.409019 n-d-863052-2 devstack@n-api.service[121403]: method: Nov 01 18:54:33.409019 n-d-863052-2 devstack@n-api.service[121403]: exception: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Nov 01 18:54:33.409019 n-d-863052-2 devstack@n-api.service[121403]: action_args: {} Nov 01 18:54:33.409019 n-d-863052-2 devstack@n-api.service[121403]: {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 01 18:54:33.409721 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:54:33.409721 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 18:54:33.409721 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 18:54:33.409721 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 01 18:54:33.409721 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 01 18:54:33.409721 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 01 18:54:33.409721 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 01 18:54:33.409721 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Nov 01 18:54:33.409721 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 01 18:54:33.409721 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 01 18:54:33.409721 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 01 18:54:33.409721 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 74, in index Nov 01 18:54:33.409721 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'list', Nov 01 18:54:33.409721 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Nov 01 18:54:33.409721 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Nov 01 18:54:33.409721 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Nov 01 18:54:33.409721 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Nov 01 18:54:33.409721 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 01 18:54:33.409721 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 01 18:54:33.410787 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 01 18:54:33.410787 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise self.value Nov 01 18:54:33.410787 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Nov 01 18:54:33.410787 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Nov 01 18:54:33.410787 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Nov 01 18:54:33.410787 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return self.enforce( Nov 01 18:54:33.410787 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Nov 01 18:54:33.410787 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Nov 01 18:54:33.410787 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Nov 01 18:54:33.410787 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 18:54:33.410787 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 18:54:33.410787 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 18:54:33.410787 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:54:33.410787 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 18:54:33.410787 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 18:54:33.410787 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Nov 01 18:54:33.410787 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Nov 01 18:54:33.410787 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Nov 01 18:54:33.410787 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 18:54:33.413543 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-5eaa2377-368c-4911-9e71-cff45ba5adec tempest-HostsAdminNegativeTestJSON-1687021239 tempest-HostsAdminNegativeTestJSON-1687021239-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:list to be performed. {{(pid=121403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 01 18:54:33.413543 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-5eaa2377-368c-4911-9e71-cff45ba5adec tempest-HostsAdminNegativeTestJSON-1687021239 tempest-HostsAdminNegativeTestJSON-1687021239-project] 10.222.0.13 "GET /compute/v2.1/os-hosts" status: 403 len: 109 microversion: 2.1 time: 0.327974 Nov 01 18:54:33.414709 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 44/87] 10.222.0.13 () {58 vars in 1128 bytes} [Tue Nov 1 18:54:33 2022] GET /compute/v2.1/os-hosts => generated 109 bytes in 334 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Nov 01 18:54:33.419055 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-dc76a40c-aa4b-43e2-9935-58477e68478d tempest-AggregatesAdminTestJSON-768412114 tempest-AggregatesAdminTestJSON-768412114-project] 10.222.0.13 "GET /compute/v2.1/servers/7967bf1f-943f-441d-befd-373868bbb3aa" status: 200 len: 1338 microversion: 2.1 time: 0.836690 Nov 01 18:54:33.420031 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 44/88] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:54:32 2022] GET /compute/v2.1/servers/7967bf1f-943f-441d-befd-373868bbb3aa => generated 1338 bytes in 840 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:54:33.424470 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-027edf65-c761-4ebb-8b4f-2fd8c0fb5cdb tempest-HypervisorAdminNegativeTestJSON-1372933775 tempest-HypervisorAdminNegativeTestJSON-1372933775-project-admin] Calling method '.version_select at 0x7f0ae30d7310>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:54:33.426071 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.wsgi [None req-027edf65-c761-4ebb-8b4f-2fd8c0fb5cdb tempest-HypervisorAdminNegativeTestJSON-1372933775 tempest-HypervisorAdminNegativeTestJSON-1372933775-project-admin] HTTP exception thrown: Hypervisor with ID '705ebd3a-8714-4e7b-b8d3-e5df0decdcd7' could not be found. Nov 01 18:54:33.439639 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-0013f8a3-fe04-4aca-b80c-470fc2ca920f tempest-AZAdminV2TestJSON-225246196 tempest-AZAdminV2TestJSON-225246196-project-admin] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:54:33.442656 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-0013f8a3-fe04-4aca-b80c-470fc2ca920f tempest-AZAdminV2TestJSON-225246196 tempest-AZAdminV2TestJSON-225246196-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:54:33.444382 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-0013f8a3-fe04-4aca-b80c-470fc2ca920f tempest-AZAdminV2TestJSON-225246196 tempest-AZAdminV2TestJSON-225246196-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:54:33.445051 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-0013f8a3-fe04-4aca-b80c-470fc2ca920f tempest-AZAdminV2TestJSON-225246196 tempest-AZAdminV2TestJSON-225246196-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:54:33.447751 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-0013f8a3-fe04-4aca-b80c-470fc2ca920f tempest-AZAdminV2TestJSON-225246196 tempest-AZAdminV2TestJSON-225246196-project-admin] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:54:33.447751 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-0013f8a3-fe04-4aca-b80c-470fc2ca920f tempest-AZAdminV2TestJSON-225246196 tempest-AZAdminV2TestJSON-225246196-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:54:33.447751 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-0013f8a3-fe04-4aca-b80c-470fc2ca920f tempest-AZAdminV2TestJSON-225246196 tempest-AZAdminV2TestJSON-225246196-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:54:33.450581 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-027edf65-c761-4ebb-8b4f-2fd8c0fb5cdb tempest-HypervisorAdminNegativeTestJSON-1372933775 tempest-HypervisorAdminNegativeTestJSON-1372933775-project-admin] Request method failure captured: Nov 01 18:54:33.450581 n-d-863052-2 devstack@n-api.service[121402]: request: GET /compute/v2.1/os-hypervisors/705ebd3a-8714-4e7b-b8d3-e5df0decdcd7/uptime HTTP/1.1 Nov 01 18:54:33.450581 n-d-863052-2 devstack@n-api.service[121402]: Accept: application/json Nov 01 18:54:33.450581 n-d-863052-2 devstack@n-api.service[121402]: Accept-Encoding: identity Nov 01 18:54:33.450581 n-d-863052-2 devstack@n-api.service[121402]: Connection: close Nov 01 18:54:33.450581 n-d-863052-2 devstack@n-api.service[121402]: Content-Length: 0 Nov 01 18:54:33.450581 n-d-863052-2 devstack@n-api.service[121402]: Content-Type: application/json Nov 01 18:54:33.450581 n-d-863052-2 devstack@n-api.service[121402]: Host: 10.222.0.13 Nov 01 18:54:33.450581 n-d-863052-2 devstack@n-api.service[121402]: Openstack-System-Scope: None Nov 01 18:54:33.450581 n-d-863052-2 devstack@n-api.service[121402]: User-Agent: python-urllib3/1.26.12 Nov 01 18:54:33.450581 n-d-863052-2 devstack@n-api.service[121402]: X-Auth-Token: gAAAAABjYWtk_8UsnMs_UpwM-lXvuWSf0kfF35PvJIW_FuZbhO1Pbtw1_2dfb-TQMsCNV2DKeLlVUNicnhBGBNyDxOftB9j4X_kb0Wphcu5RTYS5cWobLqUbAc7jRP7tMSHwyK_4Tvvt67HPlGLNsjYdghDUZKXcqLvqZVdvCc_Il91Ke47alCs Nov 01 18:54:33.450581 n-d-863052-2 devstack@n-api.service[121402]: X-Domain-Id: None Nov 01 18:54:33.450581 n-d-863052-2 devstack@n-api.service[121402]: X-Domain-Name: None Nov 01 18:54:33.450581 n-d-863052-2 devstack@n-api.service[121402]: X-Identity-Status: Confirmed Nov 01 18:54:33.450581 n-d-863052-2 devstack@n-api.service[121402]: X-Is-Admin-Project: True Nov 01 18:54:33.450581 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Domain-Id: default Nov 01 18:54:33.450581 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Domain-Name: Default Nov 01 18:54:33.450581 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Id: 21f3044b70fb498e94f23a2697099171 Nov 01 18:54:33.450581 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1372933775 Nov 01 18:54:33.450581 n-d-863052-2 devstack@n-api.service[121402]: X-Role: admin,member,reader Nov 01 18:54:33.450581 n-d-863052-2 devstack@n-api.service[121402]: X-Roles: admin,member,reader Nov 01 18:54:33.451999 n-d-863052-2 devstack@n-api.service[121402]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/21f3044b70fb498e94f23a2697099171"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/21f3044b70fb498e94f23a2697099171"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_21f3044b70fb498e94f23a2697099171", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/21f3044b70fb498e94f23a2697099171"}]}] Nov 01 18:54:33.451999 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1372933775 Nov 01 18:54:33.451999 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant-Id: 21f3044b70fb498e94f23a2697099171 Nov 01 18:54:33.451999 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1372933775 Nov 01 18:54:33.451999 n-d-863052-2 devstack@n-api.service[121402]: X-User: tempest-HypervisorAdminNegativeTestJSON-1372933775-project-admin Nov 01 18:54:33.451999 n-d-863052-2 devstack@n-api.service[121402]: X-User-Domain-Id: default Nov 01 18:54:33.451999 n-d-863052-2 devstack@n-api.service[121402]: X-User-Domain-Name: Default Nov 01 18:54:33.451999 n-d-863052-2 devstack@n-api.service[121402]: X-User-Id: 147c076be05b4811b75adc11889bd230 Nov 01 18:54:33.451999 n-d-863052-2 devstack@n-api.service[121402]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1372933775-project-admin Nov 01 18:54:33.451999 n-d-863052-2 devstack@n-api.service[121402]: method: Nov 01 18:54:33.451999 n-d-863052-2 devstack@n-api.service[121402]: exception: Hypervisor with ID '705ebd3a-8714-4e7b-b8d3-e5df0decdcd7' could not be found. Nov 01 18:54:33.451999 n-d-863052-2 devstack@n-api.service[121402]: action_args: {'id': '705ebd3a-8714-4e7b-b8d3-e5df0decdcd7'} Nov 01 18:54:33.452775 n-d-863052-2 devstack@n-api.service[121402]: {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 01 18:54:33.452775 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:54:33.452775 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 501, in validate_integer Nov 01 18:54:33.452775 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi value = int(str(value)) Nov 01 18:54:33.452775 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi ValueError: invalid literal for int() with base 10: '705ebd3a-8714-4e7b-b8d3-e5df0decdcd7' Nov 01 18:54:33.452775 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 18:54:33.452775 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 18:54:33.452775 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 18:54:33.452775 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:54:33.452775 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 614, in validate_integer Nov 01 18:54:33.452775 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return strutils.validate_integer(value, name, min_value, max_value) Nov 01 18:54:33.452775 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 505, in validate_integer Nov 01 18:54:33.452775 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise ValueError(msg) Nov 01 18:54:33.452775 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi ValueError: id must be an integer Nov 01 18:54:33.452775 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 18:54:33.452775 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 18:54:33.452775 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 18:54:33.452775 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:54:33.452775 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 313, in _validate_id Nov 01 18:54:33.452775 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi utils.validate_integer(hypervisor_id, 'id') Nov 01 18:54:33.452775 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 616, in validate_integer Nov 01 18:54:33.452775 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise exception.InvalidInput(reason=str(e)) Nov 01 18:54:33.453906 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: id must be an integer Nov 01 18:54:33.453906 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 18:54:33.453906 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 18:54:33.453906 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 18:54:33.453906 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:54:33.453906 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 18:54:33.453906 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 18:54:33.453906 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 01 18:54:33.453906 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 01 18:54:33.453906 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 01 18:54:33.453906 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 01 18:54:33.453906 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 01 18:54:33.453906 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 01 18:54:33.453906 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 389, in uptime Nov 01 18:54:33.453906 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi self._validate_id(req, id) Nov 01 18:54:33.453906 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 317, in _validate_id Nov 01 18:54:33.453906 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Nov 01 18:54:33.453906 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Hypervisor with ID '705ebd3a-8714-4e7b-b8d3-e5df0decdcd7' could not be found. Nov 01 18:54:33.453906 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 18:54:33.453906 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 18:54:33.453906 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 18:54:33.454941 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:54:33.454941 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 18:54:33.454941 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 18:54:33.454941 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 01 18:54:33.454941 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 01 18:54:33.454941 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Hypervisor with ID '705ebd3a-8714-4e7b-b8d3-e5df0decdcd7' could not be found. Nov 01 18:54:33.454941 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 18:54:33.456829 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-027edf65-c761-4ebb-8b4f-2fd8c0fb5cdb tempest-HypervisorAdminNegativeTestJSON-1372933775 tempest-HypervisorAdminNegativeTestJSON-1372933775-project-admin] Returning 404 to user: Hypervisor with ID '705ebd3a-8714-4e7b-b8d3-e5df0decdcd7' could not be found. {{(pid=121402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 01 18:54:33.458000 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-027edf65-c761-4ebb-8b4f-2fd8c0fb5cdb tempest-HypervisorAdminNegativeTestJSON-1372933775 tempest-HypervisorAdminNegativeTestJSON-1372933775-project-admin] 10.222.0.13 "GET /compute/v2.1/os-hypervisors/705ebd3a-8714-4e7b-b8d3-e5df0decdcd7/uptime" status: 404 len: 123 microversion: 2.1 time: 0.037037 Nov 01 18:54:33.458919 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 45/89] 10.222.0.13 () {58 vars in 1278 bytes} [Tue Nov 1 18:54:33 2022] GET /compute/v2.1/os-hypervisors/705ebd3a-8714-4e7b-b8d3-e5df0decdcd7/uptime => generated 123 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 01 18:54:33.465760 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-9b2e4082-2398-4275-85f7-066f019aee05 tempest-HostsAdminNegativeTestJSON-1687021239 tempest-HostsAdminNegativeTestJSON-1687021239-project] Calling method '.version_select at 0x7f0ae30f2670>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:54:33.470634 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-9b2e4082-2398-4275-85f7-066f019aee05 tempest-HostsAdminNegativeTestJSON-1687021239 tempest-HostsAdminNegativeTestJSON-1687021239-project] Policy check for os_compute_api:os-hosts:reboot failed with credentials {'is_admin': False, 'user_id': 'ff1e2d2d83ea49d5b1f03b5d9f18806e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '832b609a394a47049a94e1b5c0e19cf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:54:33.477824 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-0013f8a3-fe04-4aca-b80c-470fc2ca920f tempest-AZAdminV2TestJSON-225246196 tempest-AZAdminV2TestJSON-225246196-project-admin] 10.222.0.13 "GET /compute/v2.1/os-availability-zone/detail" status: 200 len: 701 microversion: 2.1 time: 0.061950 Nov 01 18:54:33.478401 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-9b2e4082-2398-4275-85f7-066f019aee05 tempest-HostsAdminNegativeTestJSON-1687021239 tempest-HostsAdminNegativeTestJSON-1687021239-project] Request method failure captured: Nov 01 18:54:33.478401 n-d-863052-2 devstack@n-api.service[121402]: request: GET /compute/v2.1/os-hosts/n-d-863052-2/reboot HTTP/1.1 Nov 01 18:54:33.478401 n-d-863052-2 devstack@n-api.service[121402]: Accept: application/json Nov 01 18:54:33.478401 n-d-863052-2 devstack@n-api.service[121402]: Accept-Encoding: identity Nov 01 18:54:33.478401 n-d-863052-2 devstack@n-api.service[121402]: Connection: close Nov 01 18:54:33.478401 n-d-863052-2 devstack@n-api.service[121402]: Content-Length: 0 Nov 01 18:54:33.478401 n-d-863052-2 devstack@n-api.service[121402]: Content-Type: application/json Nov 01 18:54:33.478401 n-d-863052-2 devstack@n-api.service[121402]: Host: 10.222.0.13 Nov 01 18:54:33.478401 n-d-863052-2 devstack@n-api.service[121402]: Openstack-System-Scope: None Nov 01 18:54:33.478401 n-d-863052-2 devstack@n-api.service[121402]: User-Agent: python-urllib3/1.26.12 Nov 01 18:54:33.478401 n-d-863052-2 devstack@n-api.service[121402]: X-Auth-Token: gAAAAABjYWtiIql9we6LCtbD02Cqvs-kfbeXJqsYuTCdlDG34Im5njq3YVPsJ6fYgh6UoU2eV0F1yGGY1ZBTjP_h6a4n-sp_6sGJEDLqgYwwpTZCmssS8yK9iLjMR9fnnTIyMEgFmNNtfCxgezUZrnO4MrqucB7BVTTAOUBFbdp09YeNonT0A_E Nov 01 18:54:33.478401 n-d-863052-2 devstack@n-api.service[121402]: X-Domain-Id: None Nov 01 18:54:33.478401 n-d-863052-2 devstack@n-api.service[121402]: X-Domain-Name: None Nov 01 18:54:33.478401 n-d-863052-2 devstack@n-api.service[121402]: X-Identity-Status: Confirmed Nov 01 18:54:33.478401 n-d-863052-2 devstack@n-api.service[121402]: X-Is-Admin-Project: True Nov 01 18:54:33.478401 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Domain-Id: default Nov 01 18:54:33.478401 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Domain-Name: Default Nov 01 18:54:33.478401 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Id: 832b609a394a47049a94e1b5c0e19cf4 Nov 01 18:54:33.478401 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1687021239 Nov 01 18:54:33.478401 n-d-863052-2 devstack@n-api.service[121402]: X-Role: member,reader Nov 01 18:54:33.478401 n-d-863052-2 devstack@n-api.service[121402]: X-Roles: member,reader Nov 01 18:54:33.479771 n-d-863052-2 devstack@n-api.service[121402]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/832b609a394a47049a94e1b5c0e19cf4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/832b609a394a47049a94e1b5c0e19cf4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_832b609a394a47049a94e1b5c0e19cf4", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/832b609a394a47049a94e1b5c0e19cf4"}]}] Nov 01 18:54:33.479771 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1687021239 Nov 01 18:54:33.479771 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant-Id: 832b609a394a47049a94e1b5c0e19cf4 Nov 01 18:54:33.479771 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1687021239 Nov 01 18:54:33.479771 n-d-863052-2 devstack@n-api.service[121402]: X-User: tempest-HostsAdminNegativeTestJSON-1687021239-project Nov 01 18:54:33.479771 n-d-863052-2 devstack@n-api.service[121402]: X-User-Domain-Id: default Nov 01 18:54:33.479771 n-d-863052-2 devstack@n-api.service[121402]: X-User-Domain-Name: Default Nov 01 18:54:33.479771 n-d-863052-2 devstack@n-api.service[121402]: X-User-Id: ff1e2d2d83ea49d5b1f03b5d9f18806e Nov 01 18:54:33.479771 n-d-863052-2 devstack@n-api.service[121402]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1687021239-project Nov 01 18:54:33.479771 n-d-863052-2 devstack@n-api.service[121402]: method: Nov 01 18:54:33.479771 n-d-863052-2 devstack@n-api.service[121402]: exception: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Nov 01 18:54:33.479771 n-d-863052-2 devstack@n-api.service[121402]: action_args: {'id': 'n-d-863052-2'} Nov 01 18:54:33.479771 n-d-863052-2 devstack@n-api.service[121402]: {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 01 18:54:33.480653 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:54:33.480653 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 18:54:33.480653 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 18:54:33.480653 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 01 18:54:33.480653 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 01 18:54:33.480653 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 01 18:54:33.480653 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 01 18:54:33.480653 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 01 18:54:33.480653 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 01 18:54:33.480653 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 203, in reboot Nov 01 18:54:33.480653 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'reboot', Nov 01 18:54:33.480653 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Nov 01 18:54:33.480653 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Nov 01 18:54:33.480653 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Nov 01 18:54:33.480653 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Nov 01 18:54:33.480653 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 01 18:54:33.480653 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 01 18:54:33.480653 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 01 18:54:33.480653 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise self.value Nov 01 18:54:33.481799 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Nov 01 18:54:33.481799 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Nov 01 18:54:33.481799 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Nov 01 18:54:33.481799 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return self.enforce( Nov 01 18:54:33.481799 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Nov 01 18:54:33.481799 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Nov 01 18:54:33.481799 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Nov 01 18:54:33.481799 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 18:54:33.481799 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 18:54:33.481799 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 18:54:33.481799 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:54:33.481799 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 18:54:33.481799 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 18:54:33.481799 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Nov 01 18:54:33.481799 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Nov 01 18:54:33.481799 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Nov 01 18:54:33.481799 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 18:54:33.484145 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 45/90] 10.222.0.13 () {58 vars in 1185 bytes} [Tue Nov 1 18:54:33 2022] GET /compute/v2.1/os-availability-zone/detail => generated 701 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 18:54:33.491723 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-fc23dd50-291b-4501-8a7b-dfc950ca1230 tempest-HypervisorAdminNegativeTestJSON-1372933775 tempest-HypervisorAdminNegativeTestJSON-1372933775-project-admin] Calling method '.version_select at 0x7f0ae30573a0>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:54:33.496884 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-fc23dd50-291b-4501-8a7b-dfc950ca1230 tempest-HypervisorAdminNegativeTestJSON-1372933775 tempest-HypervisorAdminNegativeTestJSON-1372933775-project-admin] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:54:33.497667 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-fc23dd50-291b-4501-8a7b-dfc950ca1230 tempest-HypervisorAdminNegativeTestJSON-1372933775 tempest-HypervisorAdminNegativeTestJSON-1372933775-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:54:33.498476 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-9b2e4082-2398-4275-85f7-066f019aee05 tempest-HostsAdminNegativeTestJSON-1687021239 tempest-HostsAdminNegativeTestJSON-1687021239-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. {{(pid=121402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 01 18:54:33.498696 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-fc23dd50-291b-4501-8a7b-dfc950ca1230 tempest-HypervisorAdminNegativeTestJSON-1372933775 tempest-HypervisorAdminNegativeTestJSON-1372933775-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:54:33.499487 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-9b2e4082-2398-4275-85f7-066f019aee05 tempest-HostsAdminNegativeTestJSON-1687021239 tempest-HostsAdminNegativeTestJSON-1687021239-project] 10.222.0.13 "GET /compute/v2.1/os-hosts/n-d-863052-2/reboot" status: 403 len: 111 microversion: 2.1 time: 0.039381 Nov 01 18:54:33.504840 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 46/91] 10.222.0.13 () {58 vars in 1188 bytes} [Tue Nov 1 18:54:33 2022] GET /compute/v2.1/os-hosts/n-d-863052-2/reboot => generated 111 bytes in 45 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Nov 01 18:54:33.517655 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-96ffb927-e727-4b9e-8306-5637ec79b92b tempest-HostsAdminNegativeTestJSON-71042643 tempest-HostsAdminNegativeTestJSON-71042643-project-admin] Calling method '.version_select at 0x7f0ae3055af0>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:54:33.522488 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-fc23dd50-291b-4501-8a7b-dfc950ca1230 tempest-HypervisorAdminNegativeTestJSON-1372933775 tempest-HypervisorAdminNegativeTestJSON-1372933775-project-admin] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:54:33.523390 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-fc23dd50-291b-4501-8a7b-dfc950ca1230 tempest-HypervisorAdminNegativeTestJSON-1372933775 tempest-HypervisorAdminNegativeTestJSON-1372933775-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:54:33.524135 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-fc23dd50-291b-4501-8a7b-dfc950ca1230 tempest-HypervisorAdminNegativeTestJSON-1372933775 tempest-HypervisorAdminNegativeTestJSON-1372933775-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:54:33.538841 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.wsgi [None req-96ffb927-e727-4b9e-8306-5637ec79b92b tempest-HostsAdminNegativeTestJSON-71042643 tempest-HostsAdminNegativeTestJSON-71042643-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Nov 01 18:54:33.539990 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-fc23dd50-291b-4501-8a7b-dfc950ca1230 tempest-HypervisorAdminNegativeTestJSON-1372933775 tempest-HypervisorAdminNegativeTestJSON-1372933775-project-admin] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:54:33.540795 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-fc23dd50-291b-4501-8a7b-dfc950ca1230 tempest-HypervisorAdminNegativeTestJSON-1372933775 tempest-HypervisorAdminNegativeTestJSON-1372933775-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:54:33.540989 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-96ffb927-e727-4b9e-8306-5637ec79b92b tempest-HostsAdminNegativeTestJSON-71042643 tempest-HostsAdminNegativeTestJSON-71042643-project-admin] Request method failure captured: Nov 01 18:54:33.540989 n-d-863052-2 devstack@n-api.service[121402]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot HTTP/1.1 Nov 01 18:54:33.540989 n-d-863052-2 devstack@n-api.service[121402]: Accept: application/json Nov 01 18:54:33.540989 n-d-863052-2 devstack@n-api.service[121402]: Accept-Encoding: identity Nov 01 18:54:33.540989 n-d-863052-2 devstack@n-api.service[121402]: Connection: close Nov 01 18:54:33.540989 n-d-863052-2 devstack@n-api.service[121402]: Content-Length: 0 Nov 01 18:54:33.540989 n-d-863052-2 devstack@n-api.service[121402]: Content-Type: application/json Nov 01 18:54:33.540989 n-d-863052-2 devstack@n-api.service[121402]: Host: 10.222.0.13 Nov 01 18:54:33.540989 n-d-863052-2 devstack@n-api.service[121402]: Openstack-System-Scope: None Nov 01 18:54:33.540989 n-d-863052-2 devstack@n-api.service[121402]: User-Agent: python-urllib3/1.26.12 Nov 01 18:54:33.540989 n-d-863052-2 devstack@n-api.service[121402]: X-Auth-Token: gAAAAABjYWtmQiiLNHq9ur8rEtsm3eq9CYkmwS0_KmQO_dwTJ_Exa9Gf0moKVlE6SoRNzknb4dL8HQNJuWP4bCA9XKQfEBFCoLzBtGj5oL_0RWHHBmKw7UInua9Y8hNZ6YTwgEf6BnQUnfR9SKHNkqP5jAF89SNQh-Z9wCCOyw-jhaz5mE2Sigk Nov 01 18:54:33.540989 n-d-863052-2 devstack@n-api.service[121402]: X-Domain-Id: None Nov 01 18:54:33.540989 n-d-863052-2 devstack@n-api.service[121402]: X-Domain-Name: None Nov 01 18:54:33.540989 n-d-863052-2 devstack@n-api.service[121402]: X-Identity-Status: Confirmed Nov 01 18:54:33.540989 n-d-863052-2 devstack@n-api.service[121402]: X-Is-Admin-Project: True Nov 01 18:54:33.540989 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Domain-Id: default Nov 01 18:54:33.540989 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Domain-Name: Default Nov 01 18:54:33.540989 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Id: 7af0f6aa8f964e4984e90607ba7a63c6 Nov 01 18:54:33.540989 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-71042643 Nov 01 18:54:33.540989 n-d-863052-2 devstack@n-api.service[121402]: X-Role: admin,member,reader Nov 01 18:54:33.540989 n-d-863052-2 devstack@n-api.service[121402]: X-Roles: admin,member,reader Nov 01 18:54:33.542473 n-d-863052-2 devstack@n-api.service[121402]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/7af0f6aa8f964e4984e90607ba7a63c6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/7af0f6aa8f964e4984e90607ba7a63c6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_7af0f6aa8f964e4984e90607ba7a63c6", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/7af0f6aa8f964e4984e90607ba7a63c6"}]}] Nov 01 18:54:33.542473 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant: tempest-HostsAdminNegativeTestJSON-71042643 Nov 01 18:54:33.542473 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant-Id: 7af0f6aa8f964e4984e90607ba7a63c6 Nov 01 18:54:33.542473 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-71042643 Nov 01 18:54:33.542473 n-d-863052-2 devstack@n-api.service[121402]: X-User: tempest-HostsAdminNegativeTestJSON-71042643-project-admin Nov 01 18:54:33.542473 n-d-863052-2 devstack@n-api.service[121402]: X-User-Domain-Id: default Nov 01 18:54:33.542473 n-d-863052-2 devstack@n-api.service[121402]: X-User-Domain-Name: Default Nov 01 18:54:33.542473 n-d-863052-2 devstack@n-api.service[121402]: X-User-Id: f1ec0327398c42729f080ae38ed0623b Nov 01 18:54:33.542473 n-d-863052-2 devstack@n-api.service[121402]: X-User-Name: tempest-HostsAdminNegativeTestJSON-71042643-project-admin Nov 01 18:54:33.542473 n-d-863052-2 devstack@n-api.service[121402]: method: Nov 01 18:54:33.542473 n-d-863052-2 devstack@n-api.service[121402]: exception: Host 'nonexistent_hostname' is not mapped to any cell Nov 01 18:54:33.542473 n-d-863052-2 devstack@n-api.service[121402]: action_args: {'id': 'nonexistent_hostname'} Nov 01 18:54:33.542473 n-d-863052-2 devstack@n-api.service[121402]: {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 01 18:54:33.543341 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:54:33.543341 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Nov 01 18:54:33.543341 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Nov 01 18:54:33.543341 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Nov 01 18:54:33.543341 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Nov 01 18:54:33.543341 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 01 18:54:33.543341 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 01 18:54:33.543341 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 01 18:54:33.543341 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise self.value Nov 01 18:54:33.543341 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Nov 01 18:54:33.543341 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Nov 01 18:54:33.543341 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5990, in targeted Nov 01 18:54:33.543341 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Nov 01 18:54:33.543341 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 01 18:54:33.543341 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 01 18:54:33.543341 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Nov 01 18:54:33.543341 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Nov 01 18:54:33.543341 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Nov 01 18:54:33.543341 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Nov 01 18:54:33.544530 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Nov 01 18:54:33.544530 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Nov 01 18:54:33.544530 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Nov 01 18:54:33.544530 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 18:54:33.544530 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 18:54:33.544530 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 18:54:33.544530 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:54:33.544530 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 18:54:33.544530 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 18:54:33.544530 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 01 18:54:33.544530 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 01 18:54:33.544530 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 01 18:54:33.544530 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 01 18:54:33.544530 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 01 18:54:33.544530 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 01 18:54:33.544530 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 205, in reboot Nov 01 18:54:33.544530 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="reboot") Nov 01 18:54:33.544530 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Nov 01 18:54:33.544530 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Nov 01 18:54:33.545680 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Nov 01 18:54:33.545680 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 18:54:33.545680 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 18:54:33.545680 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 18:54:33.545680 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:54:33.545680 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 18:54:33.545680 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 18:54:33.545680 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 01 18:54:33.545680 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 01 18:54:33.545680 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Nov 01 18:54:33.545680 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 18:54:33.547128 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-fc23dd50-291b-4501-8a7b-dfc950ca1230 tempest-HypervisorAdminNegativeTestJSON-1372933775 tempest-HypervisorAdminNegativeTestJSON-1372933775-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:54:33.554918 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-fc23dd50-291b-4501-8a7b-dfc950ca1230 tempest-HypervisorAdminNegativeTestJSON-1372933775 tempest-HypervisorAdminNegativeTestJSON-1372933775-project-admin] 10.222.0.13 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.068364 Nov 01 18:54:33.557738 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 46/92] 10.222.0.13 () {58 vars in 1146 bytes} [Tue Nov 1 18:54:33 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 18:54:33.560254 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-96ffb927-e727-4b9e-8306-5637ec79b92b tempest-HostsAdminNegativeTestJSON-71042643 tempest-HostsAdminNegativeTestJSON-71042643-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=121402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 01 18:54:33.561148 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-96ffb927-e727-4b9e-8306-5637ec79b92b tempest-HostsAdminNegativeTestJSON-71042643 tempest-HostsAdminNegativeTestJSON-71042643-project-admin] 10.222.0.13 "GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot" status: 404 len: 99 microversion: 2.1 time: 0.053581 Nov 01 18:54:33.571450 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-6d15ab94-7ccf-4277-b0d7-03f1a673a56f tempest-HypervisorAdminNegativeTestJSON-1533100 tempest-HypervisorAdminNegativeTestJSON-1533100-project] Calling method '.version_select at 0x7f0ae3057700>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:54:33.571907 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 47/93] 10.222.0.13 () {58 vars in 1212 bytes} [Tue Nov 1 18:54:33 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot => generated 99 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 01 18:54:33.576953 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-6d15ab94-7ccf-4277-b0d7-03f1a673a56f tempest-HypervisorAdminNegativeTestJSON-1533100 tempest-HypervisorAdminNegativeTestJSON-1533100-project] Policy check for os_compute_api:os-hypervisors:show failed with credentials {'is_admin': False, 'user_id': 'dcaa25d0dff141ecad9bffe7836fbf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6297e6cddda24a60aafab65c96a4fad8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:54:33.584301 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-66c38884-0088-4087-a2dd-11d0772ca3e8 tempest-HostsAdminNegativeTestJSON-1687021239 tempest-HostsAdminNegativeTestJSON-1687021239-project] Calling method '.version_select at 0x7f0ae30d75e0>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:54:33.593151 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-6d15ab94-7ccf-4277-b0d7-03f1a673a56f tempest-HypervisorAdminNegativeTestJSON-1533100 tempest-HypervisorAdminNegativeTestJSON-1533100-project] Request method failure captured: Nov 01 18:54:33.593151 n-d-863052-2 devstack@n-api.service[121403]: request: GET /compute/v2.1/os-hypervisors/1 HTTP/1.1 Nov 01 18:54:33.593151 n-d-863052-2 devstack@n-api.service[121403]: Accept: application/json Nov 01 18:54:33.593151 n-d-863052-2 devstack@n-api.service[121403]: Accept-Encoding: identity Nov 01 18:54:33.593151 n-d-863052-2 devstack@n-api.service[121403]: Connection: close Nov 01 18:54:33.593151 n-d-863052-2 devstack@n-api.service[121403]: Content-Length: 0 Nov 01 18:54:33.593151 n-d-863052-2 devstack@n-api.service[121403]: Content-Type: application/json Nov 01 18:54:33.593151 n-d-863052-2 devstack@n-api.service[121403]: Host: 10.222.0.13 Nov 01 18:54:33.593151 n-d-863052-2 devstack@n-api.service[121403]: Openstack-System-Scope: None Nov 01 18:54:33.593151 n-d-863052-2 devstack@n-api.service[121403]: User-Agent: python-urllib3/1.26.12 Nov 01 18:54:33.593151 n-d-863052-2 devstack@n-api.service[121403]: X-Auth-Token: gAAAAABjYWthPN5DlhCvyce2BPg6oyUfrCVpJtSBMOYQSSiUPSiaBcquZj6IqB0zyPfwghpj6Qf2_NaQUl6ynYMsbDP9DAIcFjVYotmlu518yoZckllqB-5KRkLPxTThkkp1d3IaarEFp0vpZCHYQstaskeTURcfO0smEyRwpbdFu1jw1QiOscQ Nov 01 18:54:33.593151 n-d-863052-2 devstack@n-api.service[121403]: X-Domain-Id: None Nov 01 18:54:33.593151 n-d-863052-2 devstack@n-api.service[121403]: X-Domain-Name: None Nov 01 18:54:33.593151 n-d-863052-2 devstack@n-api.service[121403]: X-Identity-Status: Confirmed Nov 01 18:54:33.593151 n-d-863052-2 devstack@n-api.service[121403]: X-Is-Admin-Project: True Nov 01 18:54:33.593151 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Domain-Id: default Nov 01 18:54:33.593151 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Domain-Name: Default Nov 01 18:54:33.593151 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Id: 6297e6cddda24a60aafab65c96a4fad8 Nov 01 18:54:33.593151 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1533100 Nov 01 18:54:33.593151 n-d-863052-2 devstack@n-api.service[121403]: X-Role: member,reader Nov 01 18:54:33.593151 n-d-863052-2 devstack@n-api.service[121403]: X-Roles: member,reader Nov 01 18:54:33.594599 n-d-863052-2 devstack@n-api.service[121403]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/6297e6cddda24a60aafab65c96a4fad8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/6297e6cddda24a60aafab65c96a4fad8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_6297e6cddda24a60aafab65c96a4fad8", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/6297e6cddda24a60aafab65c96a4fad8"}]}] Nov 01 18:54:33.594599 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1533100 Nov 01 18:54:33.594599 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant-Id: 6297e6cddda24a60aafab65c96a4fad8 Nov 01 18:54:33.594599 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1533100 Nov 01 18:54:33.594599 n-d-863052-2 devstack@n-api.service[121403]: X-User: tempest-HypervisorAdminNegativeTestJSON-1533100-project Nov 01 18:54:33.594599 n-d-863052-2 devstack@n-api.service[121403]: X-User-Domain-Id: default Nov 01 18:54:33.594599 n-d-863052-2 devstack@n-api.service[121403]: X-User-Domain-Name: Default Nov 01 18:54:33.594599 n-d-863052-2 devstack@n-api.service[121403]: X-User-Id: dcaa25d0dff141ecad9bffe7836fbf9b Nov 01 18:54:33.594599 n-d-863052-2 devstack@n-api.service[121403]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1533100-project Nov 01 18:54:33.594599 n-d-863052-2 devstack@n-api.service[121403]: method: Nov 01 18:54:33.594599 n-d-863052-2 devstack@n-api.service[121403]: exception: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Nov 01 18:54:33.594599 n-d-863052-2 devstack@n-api.service[121403]: action_args: {'id': '1'} Nov 01 18:54:33.594599 n-d-863052-2 devstack@n-api.service[121403]: {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 01 18:54:33.595397 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:54:33.595397 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 18:54:33.595397 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 18:54:33.595397 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 01 18:54:33.595397 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 01 18:54:33.595397 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 01 18:54:33.595397 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 01 18:54:33.595397 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 01 18:54:33.595397 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 01 18:54:33.595397 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 337, in show Nov 01 18:54:33.595397 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return self._show(req, id) Nov 01 18:54:33.595397 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 341, in _show Nov 01 18:54:33.595397 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'show', target={}) Nov 01 18:54:33.595397 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Nov 01 18:54:33.595397 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Nov 01 18:54:33.595397 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Nov 01 18:54:33.595397 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Nov 01 18:54:33.595397 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 01 18:54:33.595397 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 01 18:54:33.596478 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 01 18:54:33.596478 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise self.value Nov 01 18:54:33.596478 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Nov 01 18:54:33.596478 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Nov 01 18:54:33.596478 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Nov 01 18:54:33.596478 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return self.enforce( Nov 01 18:54:33.596478 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Nov 01 18:54:33.596478 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Nov 01 18:54:33.596478 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Nov 01 18:54:33.596478 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 18:54:33.596478 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 18:54:33.596478 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 18:54:33.596478 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:54:33.596478 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 18:54:33.596478 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 18:54:33.596478 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Nov 01 18:54:33.596478 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Nov 01 18:54:33.596478 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Nov 01 18:54:33.596478 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 18:54:33.597520 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-6d15ab94-7ccf-4277-b0d7-03f1a673a56f tempest-HypervisorAdminNegativeTestJSON-1533100 tempest-HypervisorAdminNegativeTestJSON-1533100-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. {{(pid=121403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 01 18:54:33.597520 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-6d15ab94-7ccf-4277-b0d7-03f1a673a56f tempest-HypervisorAdminNegativeTestJSON-1533100 tempest-HypervisorAdminNegativeTestJSON-1533100-project] 10.222.0.13 "GET /compute/v2.1/os-hypervisors/1" status: 403 len: 115 microversion: 2.1 time: 0.031171 Nov 01 18:54:33.599224 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 47/94] 10.222.0.13 () {58 vars in 1152 bytes} [Tue Nov 1 18:54:33 2022] GET /compute/v2.1/os-hypervisors/1 => generated 115 bytes in 35 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Nov 01 18:54:33.600029 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-66c38884-0088-4087-a2dd-11d0772ca3e8 tempest-HostsAdminNegativeTestJSON-1687021239 tempest-HostsAdminNegativeTestJSON-1687021239-project] Policy check for os_compute_api:os-hosts:show failed with credentials {'is_admin': False, 'user_id': 'ff1e2d2d83ea49d5b1f03b5d9f18806e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '832b609a394a47049a94e1b5c0e19cf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:54:33.607333 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-66c38884-0088-4087-a2dd-11d0772ca3e8 tempest-HostsAdminNegativeTestJSON-1687021239 tempest-HostsAdminNegativeTestJSON-1687021239-project] Request method failure captured: Nov 01 18:54:33.607333 n-d-863052-2 devstack@n-api.service[121402]: request: GET /compute/v2.1/os-hosts/n-d-863052-2 HTTP/1.1 Nov 01 18:54:33.607333 n-d-863052-2 devstack@n-api.service[121402]: Accept: application/json Nov 01 18:54:33.607333 n-d-863052-2 devstack@n-api.service[121402]: Accept-Encoding: identity Nov 01 18:54:33.607333 n-d-863052-2 devstack@n-api.service[121402]: Connection: close Nov 01 18:54:33.607333 n-d-863052-2 devstack@n-api.service[121402]: Content-Length: 0 Nov 01 18:54:33.607333 n-d-863052-2 devstack@n-api.service[121402]: Content-Type: application/json Nov 01 18:54:33.607333 n-d-863052-2 devstack@n-api.service[121402]: Host: 10.222.0.13 Nov 01 18:54:33.607333 n-d-863052-2 devstack@n-api.service[121402]: Openstack-System-Scope: None Nov 01 18:54:33.607333 n-d-863052-2 devstack@n-api.service[121402]: User-Agent: python-urllib3/1.26.12 Nov 01 18:54:33.607333 n-d-863052-2 devstack@n-api.service[121402]: X-Auth-Token: gAAAAABjYWtiIql9we6LCtbD02Cqvs-kfbeXJqsYuTCdlDG34Im5njq3YVPsJ6fYgh6UoU2eV0F1yGGY1ZBTjP_h6a4n-sp_6sGJEDLqgYwwpTZCmssS8yK9iLjMR9fnnTIyMEgFmNNtfCxgezUZrnO4MrqucB7BVTTAOUBFbdp09YeNonT0A_E Nov 01 18:54:33.607333 n-d-863052-2 devstack@n-api.service[121402]: X-Domain-Id: None Nov 01 18:54:33.607333 n-d-863052-2 devstack@n-api.service[121402]: X-Domain-Name: None Nov 01 18:54:33.607333 n-d-863052-2 devstack@n-api.service[121402]: X-Identity-Status: Confirmed Nov 01 18:54:33.607333 n-d-863052-2 devstack@n-api.service[121402]: X-Is-Admin-Project: True Nov 01 18:54:33.607333 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Domain-Id: default Nov 01 18:54:33.607333 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Domain-Name: Default Nov 01 18:54:33.607333 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Id: 832b609a394a47049a94e1b5c0e19cf4 Nov 01 18:54:33.607333 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1687021239 Nov 01 18:54:33.607333 n-d-863052-2 devstack@n-api.service[121402]: X-Role: member,reader Nov 01 18:54:33.607333 n-d-863052-2 devstack@n-api.service[121402]: X-Roles: member,reader Nov 01 18:54:33.608469 n-d-863052-2 devstack@n-api.service[121402]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/832b609a394a47049a94e1b5c0e19cf4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/832b609a394a47049a94e1b5c0e19cf4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_832b609a394a47049a94e1b5c0e19cf4", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/832b609a394a47049a94e1b5c0e19cf4"}]}] Nov 01 18:54:33.608469 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1687021239 Nov 01 18:54:33.608469 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant-Id: 832b609a394a47049a94e1b5c0e19cf4 Nov 01 18:54:33.608469 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1687021239 Nov 01 18:54:33.608469 n-d-863052-2 devstack@n-api.service[121402]: X-User: tempest-HostsAdminNegativeTestJSON-1687021239-project Nov 01 18:54:33.608469 n-d-863052-2 devstack@n-api.service[121402]: X-User-Domain-Id: default Nov 01 18:54:33.608469 n-d-863052-2 devstack@n-api.service[121402]: X-User-Domain-Name: Default Nov 01 18:54:33.608469 n-d-863052-2 devstack@n-api.service[121402]: X-User-Id: ff1e2d2d83ea49d5b1f03b5d9f18806e Nov 01 18:54:33.608469 n-d-863052-2 devstack@n-api.service[121402]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1687021239-project Nov 01 18:54:33.608469 n-d-863052-2 devstack@n-api.service[121402]: method: Nov 01 18:54:33.608469 n-d-863052-2 devstack@n-api.service[121402]: exception: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Nov 01 18:54:33.608469 n-d-863052-2 devstack@n-api.service[121402]: action_args: {'id': 'n-d-863052-2'} Nov 01 18:54:33.608469 n-d-863052-2 devstack@n-api.service[121402]: {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 01 18:54:33.609180 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:54:33.609180 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 18:54:33.609180 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 18:54:33.609180 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 01 18:54:33.609180 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 01 18:54:33.609180 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 01 18:54:33.609180 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 01 18:54:33.609180 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 01 18:54:33.609180 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 01 18:54:33.609180 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 270, in show Nov 01 18:54:33.609180 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'show', Nov 01 18:54:33.609180 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Nov 01 18:54:33.609180 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Nov 01 18:54:33.609180 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Nov 01 18:54:33.609180 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Nov 01 18:54:33.609180 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 01 18:54:33.609180 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 01 18:54:33.609180 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 01 18:54:33.609180 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise self.value Nov 01 18:54:33.610225 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Nov 01 18:54:33.610225 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Nov 01 18:54:33.610225 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Nov 01 18:54:33.610225 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return self.enforce( Nov 01 18:54:33.610225 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Nov 01 18:54:33.610225 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Nov 01 18:54:33.610225 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Nov 01 18:54:33.610225 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 18:54:33.610225 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 18:54:33.610225 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 18:54:33.610225 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:54:33.610225 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 18:54:33.610225 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 18:54:33.610225 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Nov 01 18:54:33.610225 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Nov 01 18:54:33.610225 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Nov 01 18:54:33.610225 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 18:54:33.613683 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-66c38884-0088-4087-a2dd-11d0772ca3e8 tempest-HostsAdminNegativeTestJSON-1687021239 tempest-HostsAdminNegativeTestJSON-1687021239-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:show to be performed. {{(pid=121402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 01 18:54:33.614375 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-06d5fc71-24dd-4e21-88c5-81d1366c9363 tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:54:33.615405 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-06d5fc71-24dd-4e21-88c5-81d1366c9363 tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] [instance: 4ebac531-6f77-4108-afc9-0eccb86dee8b] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:54:33.616509 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-66c38884-0088-4087-a2dd-11d0772ca3e8 tempest-HostsAdminNegativeTestJSON-1687021239 tempest-HostsAdminNegativeTestJSON-1687021239-project] 10.222.0.13 "GET /compute/v2.1/os-hosts/n-d-863052-2" status: 403 len: 109 microversion: 2.1 time: 0.038232 Nov 01 18:54:33.624386 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 48/95] 10.222.0.13 () {58 vars in 1167 bytes} [Tue Nov 1 18:54:33 2022] GET /compute/v2.1/os-hosts/n-d-863052-2 => generated 109 bytes in 52 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Nov 01 18:54:33.629497 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-8b07f597-0740-44a7-b87f-21fa134c5aa7 tempest-HypervisorAdminNegativeTestJSON-1372933775 tempest-HypervisorAdminNegativeTestJSON-1372933775-project-admin] Calling method '.version_select at 0x7f0ae30e1160>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:54:33.631335 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.wsgi [None req-8b07f597-0740-44a7-b87f-21fa134c5aa7 tempest-HypervisorAdminNegativeTestJSON-1372933775 tempest-HypervisorAdminNegativeTestJSON-1372933775-project-admin] HTTP exception thrown: Hypervisor with ID '152761d7-8f18-4c2b-b8ed-7145f9d4264d' could not be found. Nov 01 18:54:33.631447 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-06d5fc71-24dd-4e21-88c5-81d1366c9363 tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:54:33.631988 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-06d5fc71-24dd-4e21-88c5-81d1366c9363 tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:54:33.632491 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-06d5fc71-24dd-4e21-88c5-81d1366c9363 tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:54:33.633287 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-06d5fc71-24dd-4e21-88c5-81d1366c9363 tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:54:33.633965 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-8b07f597-0740-44a7-b87f-21fa134c5aa7 tempest-HypervisorAdminNegativeTestJSON-1372933775 tempest-HypervisorAdminNegativeTestJSON-1372933775-project-admin] Request method failure captured: Nov 01 18:54:33.633965 n-d-863052-2 devstack@n-api.service[121402]: request: GET /compute/v2.1/os-hypervisors/152761d7-8f18-4c2b-b8ed-7145f9d4264d HTTP/1.1 Nov 01 18:54:33.633965 n-d-863052-2 devstack@n-api.service[121402]: Accept: application/json Nov 01 18:54:33.633965 n-d-863052-2 devstack@n-api.service[121402]: Accept-Encoding: identity Nov 01 18:54:33.633965 n-d-863052-2 devstack@n-api.service[121402]: Connection: close Nov 01 18:54:33.633965 n-d-863052-2 devstack@n-api.service[121402]: Content-Length: 0 Nov 01 18:54:33.633965 n-d-863052-2 devstack@n-api.service[121402]: Content-Type: application/json Nov 01 18:54:33.633965 n-d-863052-2 devstack@n-api.service[121402]: Host: 10.222.0.13 Nov 01 18:54:33.633965 n-d-863052-2 devstack@n-api.service[121402]: Openstack-System-Scope: None Nov 01 18:54:33.633965 n-d-863052-2 devstack@n-api.service[121402]: User-Agent: python-urllib3/1.26.12 Nov 01 18:54:33.633965 n-d-863052-2 devstack@n-api.service[121402]: X-Auth-Token: gAAAAABjYWtk_8UsnMs_UpwM-lXvuWSf0kfF35PvJIW_FuZbhO1Pbtw1_2dfb-TQMsCNV2DKeLlVUNicnhBGBNyDxOftB9j4X_kb0Wphcu5RTYS5cWobLqUbAc7jRP7tMSHwyK_4Tvvt67HPlGLNsjYdghDUZKXcqLvqZVdvCc_Il91Ke47alCs Nov 01 18:54:33.633965 n-d-863052-2 devstack@n-api.service[121402]: X-Domain-Id: None Nov 01 18:54:33.633965 n-d-863052-2 devstack@n-api.service[121402]: X-Domain-Name: None Nov 01 18:54:33.633965 n-d-863052-2 devstack@n-api.service[121402]: X-Identity-Status: Confirmed Nov 01 18:54:33.633965 n-d-863052-2 devstack@n-api.service[121402]: X-Is-Admin-Project: True Nov 01 18:54:33.633965 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Domain-Id: default Nov 01 18:54:33.633965 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Domain-Name: Default Nov 01 18:54:33.633965 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Id: 21f3044b70fb498e94f23a2697099171 Nov 01 18:54:33.633965 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1372933775 Nov 01 18:54:33.633965 n-d-863052-2 devstack@n-api.service[121402]: X-Role: admin,member,reader Nov 01 18:54:33.633965 n-d-863052-2 devstack@n-api.service[121402]: X-Roles: admin,member,reader Nov 01 18:54:33.635682 n-d-863052-2 devstack@n-api.service[121402]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/21f3044b70fb498e94f23a2697099171"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/21f3044b70fb498e94f23a2697099171"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_21f3044b70fb498e94f23a2697099171", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/21f3044b70fb498e94f23a2697099171"}]}] Nov 01 18:54:33.635682 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1372933775 Nov 01 18:54:33.635682 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant-Id: 21f3044b70fb498e94f23a2697099171 Nov 01 18:54:33.635682 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1372933775 Nov 01 18:54:33.635682 n-d-863052-2 devstack@n-api.service[121402]: X-User: tempest-HypervisorAdminNegativeTestJSON-1372933775-project-admin Nov 01 18:54:33.635682 n-d-863052-2 devstack@n-api.service[121402]: X-User-Domain-Id: default Nov 01 18:54:33.635682 n-d-863052-2 devstack@n-api.service[121402]: X-User-Domain-Name: Default Nov 01 18:54:33.635682 n-d-863052-2 devstack@n-api.service[121402]: X-User-Id: 147c076be05b4811b75adc11889bd230 Nov 01 18:54:33.635682 n-d-863052-2 devstack@n-api.service[121402]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1372933775-project-admin Nov 01 18:54:33.635682 n-d-863052-2 devstack@n-api.service[121402]: method: Nov 01 18:54:33.635682 n-d-863052-2 devstack@n-api.service[121402]: exception: Hypervisor with ID '152761d7-8f18-4c2b-b8ed-7145f9d4264d' could not be found. Nov 01 18:54:33.635682 n-d-863052-2 devstack@n-api.service[121402]: action_args: {'id': '152761d7-8f18-4c2b-b8ed-7145f9d4264d'} Nov 01 18:54:33.636400 n-d-863052-2 devstack@n-api.service[121402]: {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 01 18:54:33.636400 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:54:33.636400 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 501, in validate_integer Nov 01 18:54:33.636400 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi value = int(str(value)) Nov 01 18:54:33.636400 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi ValueError: invalid literal for int() with base 10: '152761d7-8f18-4c2b-b8ed-7145f9d4264d' Nov 01 18:54:33.636400 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 18:54:33.636400 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 18:54:33.636400 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 18:54:33.636400 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:54:33.636400 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 614, in validate_integer Nov 01 18:54:33.636400 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return strutils.validate_integer(value, name, min_value, max_value) Nov 01 18:54:33.636400 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 505, in validate_integer Nov 01 18:54:33.636400 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise ValueError(msg) Nov 01 18:54:33.636400 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi ValueError: id must be an integer Nov 01 18:54:33.636400 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 18:54:33.636400 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 18:54:33.636400 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 18:54:33.636400 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:54:33.636400 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 313, in _validate_id Nov 01 18:54:33.636400 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi utils.validate_integer(hypervisor_id, 'id') Nov 01 18:54:33.636400 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 616, in validate_integer Nov 01 18:54:33.636400 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise exception.InvalidInput(reason=str(e)) Nov 01 18:54:33.637518 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: id must be an integer Nov 01 18:54:33.637518 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 18:54:33.637518 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 18:54:33.637518 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 18:54:33.637518 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:54:33.637518 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 18:54:33.637518 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 18:54:33.637518 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 01 18:54:33.637518 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 01 18:54:33.637518 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 01 18:54:33.637518 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 01 18:54:33.637518 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 01 18:54:33.637518 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 01 18:54:33.637518 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 337, in show Nov 01 18:54:33.637518 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return self._show(req, id) Nov 01 18:54:33.637518 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 343, in _show Nov 01 18:54:33.637518 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi self._validate_id(req, id) Nov 01 18:54:33.637518 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 317, in _validate_id Nov 01 18:54:33.637518 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Nov 01 18:54:33.637518 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Hypervisor with ID '152761d7-8f18-4c2b-b8ed-7145f9d4264d' could not be found. Nov 01 18:54:33.638490 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 18:54:33.638490 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 18:54:33.638490 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 18:54:33.638490 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:54:33.638490 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 18:54:33.638490 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 18:54:33.638490 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 01 18:54:33.638490 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 01 18:54:33.638490 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Hypervisor with ID '152761d7-8f18-4c2b-b8ed-7145f9d4264d' could not be found. Nov 01 18:54:33.638490 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 18:54:33.639019 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-06d5fc71-24dd-4e21-88c5-81d1366c9363 tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:54:33.639019 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-06d5fc71-24dd-4e21-88c5-81d1366c9363 tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:54:33.640984 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-8b07f597-0740-44a7-b87f-21fa134c5aa7 tempest-HypervisorAdminNegativeTestJSON-1372933775 tempest-HypervisorAdminNegativeTestJSON-1372933775-project-admin] Returning 404 to user: Hypervisor with ID '152761d7-8f18-4c2b-b8ed-7145f9d4264d' could not be found. {{(pid=121402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 01 18:54:33.642030 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-8b07f597-0740-44a7-b87f-21fa134c5aa7 tempest-HypervisorAdminNegativeTestJSON-1372933775 tempest-HypervisorAdminNegativeTestJSON-1372933775-project-admin] 10.222.0.13 "GET /compute/v2.1/os-hypervisors/152761d7-8f18-4c2b-b8ed-7145f9d4264d" status: 404 len: 123 microversion: 2.1 time: 0.016405 Nov 01 18:54:33.643067 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 49/96] 10.222.0.13 () {58 vars in 1257 bytes} [Tue Nov 1 18:54:33 2022] GET /compute/v2.1/os-hypervisors/152761d7-8f18-4c2b-b8ed-7145f9d4264d => generated 123 bytes in 18 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 01 18:54:33.652336 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-358df2ed-c23c-4561-a876-8c8aa8a03ed1 tempest-HostsAdminNegativeTestJSON-71042643 tempest-HostsAdminNegativeTestJSON-71042643-project-admin] Calling method '.version_select at 0x7f0ae30d7b80>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:54:33.659341 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.wsgi [None req-358df2ed-c23c-4561-a876-8c8aa8a03ed1 tempest-HostsAdminNegativeTestJSON-71042643 tempest-HostsAdminNegativeTestJSON-71042643-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Nov 01 18:54:33.661315 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-358df2ed-c23c-4561-a876-8c8aa8a03ed1 tempest-HostsAdminNegativeTestJSON-71042643 tempest-HostsAdminNegativeTestJSON-71042643-project-admin] Request method failure captured: Nov 01 18:54:33.661315 n-d-863052-2 devstack@n-api.service[121402]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname HTTP/1.1 Nov 01 18:54:33.661315 n-d-863052-2 devstack@n-api.service[121402]: Accept: application/json Nov 01 18:54:33.661315 n-d-863052-2 devstack@n-api.service[121402]: Accept-Encoding: identity Nov 01 18:54:33.661315 n-d-863052-2 devstack@n-api.service[121402]: Connection: close Nov 01 18:54:33.661315 n-d-863052-2 devstack@n-api.service[121402]: Content-Length: 0 Nov 01 18:54:33.661315 n-d-863052-2 devstack@n-api.service[121402]: Content-Type: application/json Nov 01 18:54:33.661315 n-d-863052-2 devstack@n-api.service[121402]: Host: 10.222.0.13 Nov 01 18:54:33.661315 n-d-863052-2 devstack@n-api.service[121402]: Openstack-System-Scope: None Nov 01 18:54:33.661315 n-d-863052-2 devstack@n-api.service[121402]: User-Agent: python-urllib3/1.26.12 Nov 01 18:54:33.661315 n-d-863052-2 devstack@n-api.service[121402]: X-Auth-Token: gAAAAABjYWtmQiiLNHq9ur8rEtsm3eq9CYkmwS0_KmQO_dwTJ_Exa9Gf0moKVlE6SoRNzknb4dL8HQNJuWP4bCA9XKQfEBFCoLzBtGj5oL_0RWHHBmKw7UInua9Y8hNZ6YTwgEf6BnQUnfR9SKHNkqP5jAF89SNQh-Z9wCCOyw-jhaz5mE2Sigk Nov 01 18:54:33.661315 n-d-863052-2 devstack@n-api.service[121402]: X-Domain-Id: None Nov 01 18:54:33.661315 n-d-863052-2 devstack@n-api.service[121402]: X-Domain-Name: None Nov 01 18:54:33.661315 n-d-863052-2 devstack@n-api.service[121402]: X-Identity-Status: Confirmed Nov 01 18:54:33.661315 n-d-863052-2 devstack@n-api.service[121402]: X-Is-Admin-Project: True Nov 01 18:54:33.661315 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Domain-Id: default Nov 01 18:54:33.661315 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Domain-Name: Default Nov 01 18:54:33.661315 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Id: 7af0f6aa8f964e4984e90607ba7a63c6 Nov 01 18:54:33.661315 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-71042643 Nov 01 18:54:33.661315 n-d-863052-2 devstack@n-api.service[121402]: X-Role: admin,member,reader Nov 01 18:54:33.661315 n-d-863052-2 devstack@n-api.service[121402]: X-Roles: admin,member,reader Nov 01 18:54:33.662413 n-d-863052-2 devstack@n-api.service[121402]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/7af0f6aa8f964e4984e90607ba7a63c6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/7af0f6aa8f964e4984e90607ba7a63c6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_7af0f6aa8f964e4984e90607ba7a63c6", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/7af0f6aa8f964e4984e90607ba7a63c6"}]}] Nov 01 18:54:33.662413 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant: tempest-HostsAdminNegativeTestJSON-71042643 Nov 01 18:54:33.662413 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant-Id: 7af0f6aa8f964e4984e90607ba7a63c6 Nov 01 18:54:33.662413 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-71042643 Nov 01 18:54:33.662413 n-d-863052-2 devstack@n-api.service[121402]: X-User: tempest-HostsAdminNegativeTestJSON-71042643-project-admin Nov 01 18:54:33.662413 n-d-863052-2 devstack@n-api.service[121402]: X-User-Domain-Id: default Nov 01 18:54:33.662413 n-d-863052-2 devstack@n-api.service[121402]: X-User-Domain-Name: Default Nov 01 18:54:33.662413 n-d-863052-2 devstack@n-api.service[121402]: X-User-Id: f1ec0327398c42729f080ae38ed0623b Nov 01 18:54:33.662413 n-d-863052-2 devstack@n-api.service[121402]: X-User-Name: tempest-HostsAdminNegativeTestJSON-71042643-project-admin Nov 01 18:54:33.662413 n-d-863052-2 devstack@n-api.service[121402]: method: Nov 01 18:54:33.662413 n-d-863052-2 devstack@n-api.service[121402]: exception: Host 'nonexistent_hostname' is not mapped to any cell Nov 01 18:54:33.662413 n-d-863052-2 devstack@n-api.service[121402]: action_args: {'id': 'nonexistent_hostname'} Nov 01 18:54:33.662413 n-d-863052-2 devstack@n-api.service[121402]: {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 01 18:54:33.663064 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:54:33.663064 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 274, in show Nov 01 18:54:33.663064 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Nov 01 18:54:33.663064 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 01 18:54:33.663064 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 01 18:54:33.663064 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Nov 01 18:54:33.663064 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Nov 01 18:54:33.663064 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Nov 01 18:54:33.663064 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Nov 01 18:54:33.663064 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Nov 01 18:54:33.663064 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Nov 01 18:54:33.663064 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Nov 01 18:54:33.663064 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 18:54:33.663064 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 18:54:33.663064 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 18:54:33.663064 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:54:33.663064 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 18:54:33.663064 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 18:54:33.663064 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 01 18:54:33.663979 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 01 18:54:33.663979 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 01 18:54:33.663979 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 01 18:54:33.663979 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 01 18:54:33.663979 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 01 18:54:33.663979 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 282, in show Nov 01 18:54:33.663979 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Nov 01 18:54:33.663979 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Nov 01 18:54:33.663979 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 18:54:33.663979 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 18:54:33.663979 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 18:54:33.663979 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:54:33.663979 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 18:54:33.663979 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 18:54:33.663979 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 01 18:54:33.663979 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 01 18:54:33.663979 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Nov 01 18:54:33.663979 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 18:54:33.666505 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-358df2ed-c23c-4561-a876-8c8aa8a03ed1 tempest-HostsAdminNegativeTestJSON-71042643 tempest-HostsAdminNegativeTestJSON-71042643-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=121402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 01 18:54:33.667561 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-358df2ed-c23c-4561-a876-8c8aa8a03ed1 tempest-HostsAdminNegativeTestJSON-71042643 tempest-HostsAdminNegativeTestJSON-71042643-project-admin] 10.222.0.13 "GET /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.022722 Nov 01 18:54:33.674486 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 50/97] 10.222.0.13 () {58 vars in 1191 bytes} [Tue Nov 1 18:54:33 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 01 18:54:33.680405 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-c0405143-c4f4-4eaa-8382-ba899ea9daa7 tempest-HostsAdminNegativeTestJSON-1687021239 tempest-HostsAdminNegativeTestJSON-1687021239-project] Calling method '.version_select at 0x7f0ae30e1f70>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:54:33.683148 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-c0405143-c4f4-4eaa-8382-ba899ea9daa7 tempest-HostsAdminNegativeTestJSON-1687021239 tempest-HostsAdminNegativeTestJSON-1687021239-project] Policy check for os_compute_api:os-hosts:shutdown failed with credentials {'is_admin': False, 'user_id': 'ff1e2d2d83ea49d5b1f03b5d9f18806e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '832b609a394a47049a94e1b5c0e19cf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:54:33.685271 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-c0405143-c4f4-4eaa-8382-ba899ea9daa7 tempest-HostsAdminNegativeTestJSON-1687021239 tempest-HostsAdminNegativeTestJSON-1687021239-project] Request method failure captured: Nov 01 18:54:33.685271 n-d-863052-2 devstack@n-api.service[121402]: request: GET /compute/v2.1/os-hosts/n-d-863052-2/shutdown HTTP/1.1 Nov 01 18:54:33.685271 n-d-863052-2 devstack@n-api.service[121402]: Accept: application/json Nov 01 18:54:33.685271 n-d-863052-2 devstack@n-api.service[121402]: Accept-Encoding: identity Nov 01 18:54:33.685271 n-d-863052-2 devstack@n-api.service[121402]: Connection: close Nov 01 18:54:33.685271 n-d-863052-2 devstack@n-api.service[121402]: Content-Length: 0 Nov 01 18:54:33.685271 n-d-863052-2 devstack@n-api.service[121402]: Content-Type: application/json Nov 01 18:54:33.685271 n-d-863052-2 devstack@n-api.service[121402]: Host: 10.222.0.13 Nov 01 18:54:33.685271 n-d-863052-2 devstack@n-api.service[121402]: Openstack-System-Scope: None Nov 01 18:54:33.685271 n-d-863052-2 devstack@n-api.service[121402]: User-Agent: python-urllib3/1.26.12 Nov 01 18:54:33.685271 n-d-863052-2 devstack@n-api.service[121402]: X-Auth-Token: gAAAAABjYWtiIql9we6LCtbD02Cqvs-kfbeXJqsYuTCdlDG34Im5njq3YVPsJ6fYgh6UoU2eV0F1yGGY1ZBTjP_h6a4n-sp_6sGJEDLqgYwwpTZCmssS8yK9iLjMR9fnnTIyMEgFmNNtfCxgezUZrnO4MrqucB7BVTTAOUBFbdp09YeNonT0A_E Nov 01 18:54:33.685271 n-d-863052-2 devstack@n-api.service[121402]: X-Domain-Id: None Nov 01 18:54:33.685271 n-d-863052-2 devstack@n-api.service[121402]: X-Domain-Name: None Nov 01 18:54:33.685271 n-d-863052-2 devstack@n-api.service[121402]: X-Identity-Status: Confirmed Nov 01 18:54:33.685271 n-d-863052-2 devstack@n-api.service[121402]: X-Is-Admin-Project: True Nov 01 18:54:33.685271 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Domain-Id: default Nov 01 18:54:33.685271 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Domain-Name: Default Nov 01 18:54:33.685271 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Id: 832b609a394a47049a94e1b5c0e19cf4 Nov 01 18:54:33.685271 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1687021239 Nov 01 18:54:33.685271 n-d-863052-2 devstack@n-api.service[121402]: X-Role: member,reader Nov 01 18:54:33.685271 n-d-863052-2 devstack@n-api.service[121402]: X-Roles: member,reader Nov 01 18:54:33.686443 n-d-863052-2 devstack@n-api.service[121402]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/832b609a394a47049a94e1b5c0e19cf4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/832b609a394a47049a94e1b5c0e19cf4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_832b609a394a47049a94e1b5c0e19cf4", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/832b609a394a47049a94e1b5c0e19cf4"}]}] Nov 01 18:54:33.686443 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1687021239 Nov 01 18:54:33.686443 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant-Id: 832b609a394a47049a94e1b5c0e19cf4 Nov 01 18:54:33.686443 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1687021239 Nov 01 18:54:33.686443 n-d-863052-2 devstack@n-api.service[121402]: X-User: tempest-HostsAdminNegativeTestJSON-1687021239-project Nov 01 18:54:33.686443 n-d-863052-2 devstack@n-api.service[121402]: X-User-Domain-Id: default Nov 01 18:54:33.686443 n-d-863052-2 devstack@n-api.service[121402]: X-User-Domain-Name: Default Nov 01 18:54:33.686443 n-d-863052-2 devstack@n-api.service[121402]: X-User-Id: ff1e2d2d83ea49d5b1f03b5d9f18806e Nov 01 18:54:33.686443 n-d-863052-2 devstack@n-api.service[121402]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1687021239-project Nov 01 18:54:33.686443 n-d-863052-2 devstack@n-api.service[121402]: method: Nov 01 18:54:33.686443 n-d-863052-2 devstack@n-api.service[121402]: exception: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Nov 01 18:54:33.686443 n-d-863052-2 devstack@n-api.service[121402]: action_args: {'id': 'n-d-863052-2'} Nov 01 18:54:33.686443 n-d-863052-2 devstack@n-api.service[121402]: {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 01 18:54:33.687368 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:54:33.687368 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 18:54:33.687368 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 18:54:33.687368 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 01 18:54:33.687368 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 01 18:54:33.687368 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 01 18:54:33.687368 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 01 18:54:33.687368 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 01 18:54:33.687368 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 01 18:54:33.687368 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 195, in shutdown Nov 01 18:54:33.687368 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'shutdown', Nov 01 18:54:33.687368 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Nov 01 18:54:33.687368 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Nov 01 18:54:33.687368 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Nov 01 18:54:33.687368 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Nov 01 18:54:33.687368 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 01 18:54:33.687368 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 01 18:54:33.687368 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 01 18:54:33.687368 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise self.value Nov 01 18:54:33.688315 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Nov 01 18:54:33.688315 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Nov 01 18:54:33.688315 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Nov 01 18:54:33.688315 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return self.enforce( Nov 01 18:54:33.688315 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Nov 01 18:54:33.688315 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Nov 01 18:54:33.688315 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Nov 01 18:54:33.688315 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 18:54:33.688315 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 18:54:33.688315 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 18:54:33.688315 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:54:33.688315 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 18:54:33.688315 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 18:54:33.688315 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Nov 01 18:54:33.688315 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Nov 01 18:54:33.688315 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Nov 01 18:54:33.688315 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 18:54:33.690801 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-c0405143-c4f4-4eaa-8382-ba899ea9daa7 tempest-HostsAdminNegativeTestJSON-1687021239 tempest-HostsAdminNegativeTestJSON-1687021239-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. {{(pid=121402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 01 18:54:33.691944 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-c0405143-c4f4-4eaa-8382-ba899ea9daa7 tempest-HostsAdminNegativeTestJSON-1687021239 tempest-HostsAdminNegativeTestJSON-1687021239-project] 10.222.0.13 "GET /compute/v2.1/os-hosts/n-d-863052-2/shutdown" status: 403 len: 113 microversion: 2.1 time: 0.016219 Nov 01 18:54:33.699167 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 51/98] 10.222.0.13 () {58 vars in 1194 bytes} [Tue Nov 1 18:54:33 2022] GET /compute/v2.1/os-hosts/n-d-863052-2/shutdown => generated 113 bytes in 24 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Nov 01 18:54:33.704277 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-496ed4f6-f75a-442a-8fea-25f5a37d7caf tempest-HostsAdminNegativeTestJSON-71042643 tempest-HostsAdminNegativeTestJSON-71042643-project-admin] Calling method '.version_select at 0x7f0ae310f5e0>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:54:33.715893 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.wsgi [None req-496ed4f6-f75a-442a-8fea-25f5a37d7caf tempest-HostsAdminNegativeTestJSON-71042643 tempest-HostsAdminNegativeTestJSON-71042643-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Nov 01 18:54:33.717875 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-496ed4f6-f75a-442a-8fea-25f5a37d7caf tempest-HostsAdminNegativeTestJSON-71042643 tempest-HostsAdminNegativeTestJSON-71042643-project-admin] Request method failure captured: Nov 01 18:54:33.717875 n-d-863052-2 devstack@n-api.service[121402]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown HTTP/1.1 Nov 01 18:54:33.717875 n-d-863052-2 devstack@n-api.service[121402]: Accept: application/json Nov 01 18:54:33.717875 n-d-863052-2 devstack@n-api.service[121402]: Accept-Encoding: identity Nov 01 18:54:33.717875 n-d-863052-2 devstack@n-api.service[121402]: Connection: close Nov 01 18:54:33.717875 n-d-863052-2 devstack@n-api.service[121402]: Content-Length: 0 Nov 01 18:54:33.717875 n-d-863052-2 devstack@n-api.service[121402]: Content-Type: application/json Nov 01 18:54:33.717875 n-d-863052-2 devstack@n-api.service[121402]: Host: 10.222.0.13 Nov 01 18:54:33.717875 n-d-863052-2 devstack@n-api.service[121402]: Openstack-System-Scope: None Nov 01 18:54:33.717875 n-d-863052-2 devstack@n-api.service[121402]: User-Agent: python-urllib3/1.26.12 Nov 01 18:54:33.717875 n-d-863052-2 devstack@n-api.service[121402]: X-Auth-Token: gAAAAABjYWtmQiiLNHq9ur8rEtsm3eq9CYkmwS0_KmQO_dwTJ_Exa9Gf0moKVlE6SoRNzknb4dL8HQNJuWP4bCA9XKQfEBFCoLzBtGj5oL_0RWHHBmKw7UInua9Y8hNZ6YTwgEf6BnQUnfR9SKHNkqP5jAF89SNQh-Z9wCCOyw-jhaz5mE2Sigk Nov 01 18:54:33.717875 n-d-863052-2 devstack@n-api.service[121402]: X-Domain-Id: None Nov 01 18:54:33.717875 n-d-863052-2 devstack@n-api.service[121402]: X-Domain-Name: None Nov 01 18:54:33.717875 n-d-863052-2 devstack@n-api.service[121402]: X-Identity-Status: Confirmed Nov 01 18:54:33.717875 n-d-863052-2 devstack@n-api.service[121402]: X-Is-Admin-Project: True Nov 01 18:54:33.717875 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Domain-Id: default Nov 01 18:54:33.717875 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Domain-Name: Default Nov 01 18:54:33.717875 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Id: 7af0f6aa8f964e4984e90607ba7a63c6 Nov 01 18:54:33.717875 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-71042643 Nov 01 18:54:33.717875 n-d-863052-2 devstack@n-api.service[121402]: X-Role: admin,member,reader Nov 01 18:54:33.717875 n-d-863052-2 devstack@n-api.service[121402]: X-Roles: admin,member,reader Nov 01 18:54:33.719137 n-d-863052-2 devstack@n-api.service[121402]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/7af0f6aa8f964e4984e90607ba7a63c6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/7af0f6aa8f964e4984e90607ba7a63c6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_7af0f6aa8f964e4984e90607ba7a63c6", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/7af0f6aa8f964e4984e90607ba7a63c6"}]}] Nov 01 18:54:33.719137 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant: tempest-HostsAdminNegativeTestJSON-71042643 Nov 01 18:54:33.719137 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant-Id: 7af0f6aa8f964e4984e90607ba7a63c6 Nov 01 18:54:33.719137 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-71042643 Nov 01 18:54:33.719137 n-d-863052-2 devstack@n-api.service[121402]: X-User: tempest-HostsAdminNegativeTestJSON-71042643-project-admin Nov 01 18:54:33.719137 n-d-863052-2 devstack@n-api.service[121402]: X-User-Domain-Id: default Nov 01 18:54:33.719137 n-d-863052-2 devstack@n-api.service[121402]: X-User-Domain-Name: Default Nov 01 18:54:33.719137 n-d-863052-2 devstack@n-api.service[121402]: X-User-Id: f1ec0327398c42729f080ae38ed0623b Nov 01 18:54:33.719137 n-d-863052-2 devstack@n-api.service[121402]: X-User-Name: tempest-HostsAdminNegativeTestJSON-71042643-project-admin Nov 01 18:54:33.719137 n-d-863052-2 devstack@n-api.service[121402]: method: Nov 01 18:54:33.719137 n-d-863052-2 devstack@n-api.service[121402]: exception: Host 'nonexistent_hostname' is not mapped to any cell Nov 01 18:54:33.719137 n-d-863052-2 devstack@n-api.service[121402]: action_args: {'id': 'nonexistent_hostname'} Nov 01 18:54:33.719137 n-d-863052-2 devstack@n-api.service[121402]: {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 01 18:54:33.719911 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:54:33.719911 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Nov 01 18:54:33.719911 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Nov 01 18:54:33.719911 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Nov 01 18:54:33.719911 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Nov 01 18:54:33.719911 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 01 18:54:33.719911 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 01 18:54:33.719911 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 01 18:54:33.719911 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise self.value Nov 01 18:54:33.719911 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Nov 01 18:54:33.719911 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Nov 01 18:54:33.719911 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5990, in targeted Nov 01 18:54:33.719911 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Nov 01 18:54:33.719911 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 01 18:54:33.719911 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 01 18:54:33.719911 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Nov 01 18:54:33.719911 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Nov 01 18:54:33.719911 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Nov 01 18:54:33.719911 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Nov 01 18:54:33.721377 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Nov 01 18:54:33.721377 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Nov 01 18:54:33.721377 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Nov 01 18:54:33.721377 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 18:54:33.721377 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 18:54:33.721377 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 18:54:33.721377 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:54:33.721377 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 18:54:33.721377 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 18:54:33.721377 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 01 18:54:33.721377 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 01 18:54:33.721377 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 01 18:54:33.721377 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 01 18:54:33.721377 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 01 18:54:33.721377 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 01 18:54:33.721377 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 197, in shutdown Nov 01 18:54:33.721377 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="shutdown") Nov 01 18:54:33.721377 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Nov 01 18:54:33.721377 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Nov 01 18:54:33.722396 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Nov 01 18:54:33.722396 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 18:54:33.722396 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 18:54:33.722396 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 18:54:33.722396 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:54:33.722396 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 18:54:33.722396 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 18:54:33.722396 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 01 18:54:33.722396 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 01 18:54:33.722396 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Nov 01 18:54:33.722396 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 18:54:33.724724 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-496ed4f6-f75a-442a-8fea-25f5a37d7caf tempest-HostsAdminNegativeTestJSON-71042643 tempest-HostsAdminNegativeTestJSON-71042643-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=121402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 01 18:54:33.725882 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-496ed4f6-f75a-442a-8fea-25f5a37d7caf tempest-HostsAdminNegativeTestJSON-71042643 tempest-HostsAdminNegativeTestJSON-71042643-project-admin] 10.222.0.13 "GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown" status: 404 len: 99 microversion: 2.1 time: 0.025468 Nov 01 18:54:33.726620 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 52/99] 10.222.0.13 () {58 vars in 1218 bytes} [Tue Nov 1 18:54:33 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown => generated 99 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 01 18:54:33.743288 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-571602f8-8aae-4c55-b8d9-2001b9660854 tempest-HostsAdminNegativeTestJSON-1687021239 tempest-HostsAdminNegativeTestJSON-1687021239-project] Calling method '.version_select at 0x7f0ae30e1040>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:54:33.746295 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-571602f8-8aae-4c55-b8d9-2001b9660854 tempest-HostsAdminNegativeTestJSON-1687021239 tempest-HostsAdminNegativeTestJSON-1687021239-project] Policy check for os_compute_api:os-hosts:start failed with credentials {'is_admin': False, 'user_id': 'ff1e2d2d83ea49d5b1f03b5d9f18806e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '832b609a394a47049a94e1b5c0e19cf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:54:33.760297 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-571602f8-8aae-4c55-b8d9-2001b9660854 tempest-HostsAdminNegativeTestJSON-1687021239 tempest-HostsAdminNegativeTestJSON-1687021239-project] Request method failure captured: Nov 01 18:54:33.760297 n-d-863052-2 devstack@n-api.service[121402]: request: GET /compute/v2.1/os-hosts/n-d-863052-2/startup HTTP/1.1 Nov 01 18:54:33.760297 n-d-863052-2 devstack@n-api.service[121402]: Accept: application/json Nov 01 18:54:33.760297 n-d-863052-2 devstack@n-api.service[121402]: Accept-Encoding: identity Nov 01 18:54:33.760297 n-d-863052-2 devstack@n-api.service[121402]: Connection: close Nov 01 18:54:33.760297 n-d-863052-2 devstack@n-api.service[121402]: Content-Length: 0 Nov 01 18:54:33.760297 n-d-863052-2 devstack@n-api.service[121402]: Content-Type: application/json Nov 01 18:54:33.760297 n-d-863052-2 devstack@n-api.service[121402]: Host: 10.222.0.13 Nov 01 18:54:33.760297 n-d-863052-2 devstack@n-api.service[121402]: Openstack-System-Scope: None Nov 01 18:54:33.760297 n-d-863052-2 devstack@n-api.service[121402]: User-Agent: python-urllib3/1.26.12 Nov 01 18:54:33.760297 n-d-863052-2 devstack@n-api.service[121402]: X-Auth-Token: gAAAAABjYWtiIql9we6LCtbD02Cqvs-kfbeXJqsYuTCdlDG34Im5njq3YVPsJ6fYgh6UoU2eV0F1yGGY1ZBTjP_h6a4n-sp_6sGJEDLqgYwwpTZCmssS8yK9iLjMR9fnnTIyMEgFmNNtfCxgezUZrnO4MrqucB7BVTTAOUBFbdp09YeNonT0A_E Nov 01 18:54:33.760297 n-d-863052-2 devstack@n-api.service[121402]: X-Domain-Id: None Nov 01 18:54:33.760297 n-d-863052-2 devstack@n-api.service[121402]: X-Domain-Name: None Nov 01 18:54:33.760297 n-d-863052-2 devstack@n-api.service[121402]: X-Identity-Status: Confirmed Nov 01 18:54:33.760297 n-d-863052-2 devstack@n-api.service[121402]: X-Is-Admin-Project: True Nov 01 18:54:33.760297 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Domain-Id: default Nov 01 18:54:33.760297 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Domain-Name: Default Nov 01 18:54:33.760297 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Id: 832b609a394a47049a94e1b5c0e19cf4 Nov 01 18:54:33.760297 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1687021239 Nov 01 18:54:33.760297 n-d-863052-2 devstack@n-api.service[121402]: X-Role: member,reader Nov 01 18:54:33.760297 n-d-863052-2 devstack@n-api.service[121402]: X-Roles: member,reader Nov 01 18:54:33.761556 n-d-863052-2 devstack@n-api.service[121402]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/832b609a394a47049a94e1b5c0e19cf4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/832b609a394a47049a94e1b5c0e19cf4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_832b609a394a47049a94e1b5c0e19cf4", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/832b609a394a47049a94e1b5c0e19cf4"}]}] Nov 01 18:54:33.761556 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1687021239 Nov 01 18:54:33.761556 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant-Id: 832b609a394a47049a94e1b5c0e19cf4 Nov 01 18:54:33.761556 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1687021239 Nov 01 18:54:33.761556 n-d-863052-2 devstack@n-api.service[121402]: X-User: tempest-HostsAdminNegativeTestJSON-1687021239-project Nov 01 18:54:33.761556 n-d-863052-2 devstack@n-api.service[121402]: X-User-Domain-Id: default Nov 01 18:54:33.761556 n-d-863052-2 devstack@n-api.service[121402]: X-User-Domain-Name: Default Nov 01 18:54:33.761556 n-d-863052-2 devstack@n-api.service[121402]: X-User-Id: ff1e2d2d83ea49d5b1f03b5d9f18806e Nov 01 18:54:33.761556 n-d-863052-2 devstack@n-api.service[121402]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1687021239-project Nov 01 18:54:33.761556 n-d-863052-2 devstack@n-api.service[121402]: method: Nov 01 18:54:33.761556 n-d-863052-2 devstack@n-api.service[121402]: exception: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Nov 01 18:54:33.761556 n-d-863052-2 devstack@n-api.service[121402]: action_args: {'id': 'n-d-863052-2'} Nov 01 18:54:33.761556 n-d-863052-2 devstack@n-api.service[121402]: {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 01 18:54:33.762203 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:54:33.762203 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 18:54:33.762203 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 18:54:33.762203 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 01 18:54:33.762203 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 01 18:54:33.762203 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 01 18:54:33.762203 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 01 18:54:33.762203 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 01 18:54:33.762203 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 01 18:54:33.762203 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 187, in startup Nov 01 18:54:33.762203 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'start', Nov 01 18:54:33.762203 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Nov 01 18:54:33.762203 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Nov 01 18:54:33.762203 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Nov 01 18:54:33.762203 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Nov 01 18:54:33.762203 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 01 18:54:33.762203 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 01 18:54:33.762203 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 01 18:54:33.762203 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise self.value Nov 01 18:54:33.763129 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Nov 01 18:54:33.763129 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Nov 01 18:54:33.763129 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Nov 01 18:54:33.763129 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return self.enforce( Nov 01 18:54:33.763129 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Nov 01 18:54:33.763129 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Nov 01 18:54:33.763129 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Nov 01 18:54:33.763129 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 18:54:33.763129 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 18:54:33.763129 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 18:54:33.763129 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:54:33.763129 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 18:54:33.763129 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 18:54:33.763129 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Nov 01 18:54:33.763129 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Nov 01 18:54:33.763129 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Nov 01 18:54:33.763129 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 18:54:33.763970 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-571602f8-8aae-4c55-b8d9-2001b9660854 tempest-HostsAdminNegativeTestJSON-1687021239 tempest-HostsAdminNegativeTestJSON-1687021239-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:start to be performed. {{(pid=121402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 01 18:54:33.763970 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-571602f8-8aae-4c55-b8d9-2001b9660854 tempest-HostsAdminNegativeTestJSON-1687021239 tempest-HostsAdminNegativeTestJSON-1687021239-project] 10.222.0.13 "GET /compute/v2.1/os-hosts/n-d-863052-2/startup" status: 403 len: 110 microversion: 2.1 time: 0.028802 Nov 01 18:54:33.766287 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 53/100] 10.222.0.13 () {58 vars in 1191 bytes} [Tue Nov 1 18:54:33 2022] GET /compute/v2.1/os-hosts/n-d-863052-2/startup => generated 110 bytes in 33 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Nov 01 18:54:33.779459 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-e712c789-9293-4465-aec3-3d0f444af770 tempest-HostsAdminNegativeTestJSON-71042643 tempest-HostsAdminNegativeTestJSON-71042643-project-admin] Calling method '.version_select at 0x7f0ae30d7dc0>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:54:33.803067 n-d-863052-2 devstack@n-api.service[121402]: DEBUG dbcounter [-] [121402] Writing DB stats nova_api:SELECT=81,nova_api:INSERT=5,nova_api:DELETE=14 {{(pid=121402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 18:54:33.837910 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.wsgi [None req-e712c789-9293-4465-aec3-3d0f444af770 tempest-HostsAdminNegativeTestJSON-71042643 tempest-HostsAdminNegativeTestJSON-71042643-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Nov 01 18:54:33.856723 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-e712c789-9293-4465-aec3-3d0f444af770 tempest-HostsAdminNegativeTestJSON-71042643 tempest-HostsAdminNegativeTestJSON-71042643-project-admin] Request method failure captured: Nov 01 18:54:33.856723 n-d-863052-2 devstack@n-api.service[121402]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/startup HTTP/1.1 Nov 01 18:54:33.856723 n-d-863052-2 devstack@n-api.service[121402]: Accept: application/json Nov 01 18:54:33.856723 n-d-863052-2 devstack@n-api.service[121402]: Accept-Encoding: identity Nov 01 18:54:33.856723 n-d-863052-2 devstack@n-api.service[121402]: Connection: close Nov 01 18:54:33.856723 n-d-863052-2 devstack@n-api.service[121402]: Content-Length: 0 Nov 01 18:54:33.856723 n-d-863052-2 devstack@n-api.service[121402]: Content-Type: application/json Nov 01 18:54:33.856723 n-d-863052-2 devstack@n-api.service[121402]: Host: 10.222.0.13 Nov 01 18:54:33.856723 n-d-863052-2 devstack@n-api.service[121402]: Openstack-System-Scope: None Nov 01 18:54:33.856723 n-d-863052-2 devstack@n-api.service[121402]: User-Agent: python-urllib3/1.26.12 Nov 01 18:54:33.856723 n-d-863052-2 devstack@n-api.service[121402]: X-Auth-Token: gAAAAABjYWtmQiiLNHq9ur8rEtsm3eq9CYkmwS0_KmQO_dwTJ_Exa9Gf0moKVlE6SoRNzknb4dL8HQNJuWP4bCA9XKQfEBFCoLzBtGj5oL_0RWHHBmKw7UInua9Y8hNZ6YTwgEf6BnQUnfR9SKHNkqP5jAF89SNQh-Z9wCCOyw-jhaz5mE2Sigk Nov 01 18:54:33.856723 n-d-863052-2 devstack@n-api.service[121402]: X-Domain-Id: None Nov 01 18:54:33.856723 n-d-863052-2 devstack@n-api.service[121402]: X-Domain-Name: None Nov 01 18:54:33.856723 n-d-863052-2 devstack@n-api.service[121402]: X-Identity-Status: Confirmed Nov 01 18:54:33.856723 n-d-863052-2 devstack@n-api.service[121402]: X-Is-Admin-Project: True Nov 01 18:54:33.856723 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Domain-Id: default Nov 01 18:54:33.856723 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Domain-Name: Default Nov 01 18:54:33.856723 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Id: 7af0f6aa8f964e4984e90607ba7a63c6 Nov 01 18:54:33.856723 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-71042643 Nov 01 18:54:33.856723 n-d-863052-2 devstack@n-api.service[121402]: X-Role: admin,member,reader Nov 01 18:54:33.856723 n-d-863052-2 devstack@n-api.service[121402]: X-Roles: admin,member,reader Nov 01 18:54:33.858045 n-d-863052-2 devstack@n-api.service[121402]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/7af0f6aa8f964e4984e90607ba7a63c6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/7af0f6aa8f964e4984e90607ba7a63c6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_7af0f6aa8f964e4984e90607ba7a63c6", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/7af0f6aa8f964e4984e90607ba7a63c6"}]}] Nov 01 18:54:33.858045 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant: tempest-HostsAdminNegativeTestJSON-71042643 Nov 01 18:54:33.858045 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant-Id: 7af0f6aa8f964e4984e90607ba7a63c6 Nov 01 18:54:33.858045 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-71042643 Nov 01 18:54:33.858045 n-d-863052-2 devstack@n-api.service[121402]: X-User: tempest-HostsAdminNegativeTestJSON-71042643-project-admin Nov 01 18:54:33.858045 n-d-863052-2 devstack@n-api.service[121402]: X-User-Domain-Id: default Nov 01 18:54:33.858045 n-d-863052-2 devstack@n-api.service[121402]: X-User-Domain-Name: Default Nov 01 18:54:33.858045 n-d-863052-2 devstack@n-api.service[121402]: X-User-Id: f1ec0327398c42729f080ae38ed0623b Nov 01 18:54:33.858045 n-d-863052-2 devstack@n-api.service[121402]: X-User-Name: tempest-HostsAdminNegativeTestJSON-71042643-project-admin Nov 01 18:54:33.858045 n-d-863052-2 devstack@n-api.service[121402]: method: Nov 01 18:54:33.858045 n-d-863052-2 devstack@n-api.service[121402]: exception: Host 'nonexistent_hostname' is not mapped to any cell Nov 01 18:54:33.858045 n-d-863052-2 devstack@n-api.service[121402]: action_args: {'id': 'nonexistent_hostname'} Nov 01 18:54:33.858045 n-d-863052-2 devstack@n-api.service[121402]: {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 01 18:54:33.858793 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:54:33.858793 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Nov 01 18:54:33.858793 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Nov 01 18:54:33.858793 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Nov 01 18:54:33.858793 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Nov 01 18:54:33.858793 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 01 18:54:33.858793 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 01 18:54:33.858793 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 01 18:54:33.858793 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise self.value Nov 01 18:54:33.858793 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Nov 01 18:54:33.858793 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Nov 01 18:54:33.858793 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5990, in targeted Nov 01 18:54:33.858793 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Nov 01 18:54:33.858793 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 01 18:54:33.858793 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 01 18:54:33.858793 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Nov 01 18:54:33.858793 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Nov 01 18:54:33.858793 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Nov 01 18:54:33.858793 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Nov 01 18:54:33.859852 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Nov 01 18:54:33.859852 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Nov 01 18:54:33.859852 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Nov 01 18:54:33.859852 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 18:54:33.859852 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 18:54:33.859852 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 18:54:33.859852 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:54:33.859852 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 18:54:33.859852 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 18:54:33.859852 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 01 18:54:33.859852 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 01 18:54:33.859852 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 01 18:54:33.859852 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 01 18:54:33.859852 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 01 18:54:33.859852 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 01 18:54:33.859852 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 189, in startup Nov 01 18:54:33.859852 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="startup") Nov 01 18:54:33.859852 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Nov 01 18:54:33.859852 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Nov 01 18:54:33.861367 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Nov 01 18:54:33.861367 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 18:54:33.861367 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 18:54:33.861367 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 18:54:33.861367 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:54:33.861367 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 18:54:33.861367 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 18:54:33.861367 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 01 18:54:33.861367 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 01 18:54:33.861367 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Nov 01 18:54:33.861367 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 18:54:33.861367 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-e712c789-9293-4465-aec3-3d0f444af770 tempest-HostsAdminNegativeTestJSON-71042643 tempest-HostsAdminNegativeTestJSON-71042643-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=121402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 01 18:54:33.863610 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-e712c789-9293-4465-aec3-3d0f444af770 tempest-HostsAdminNegativeTestJSON-71042643 tempest-HostsAdminNegativeTestJSON-71042643-project-admin] 10.222.0.13 "GET /compute/v2.1/os-hosts/nonexistent_hostname/startup" status: 404 len: 99 microversion: 2.1 time: 0.088436 Nov 01 18:54:33.872257 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 54/101] 10.222.0.13 () {58 vars in 1215 bytes} [Tue Nov 1 18:54:33 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/startup => generated 99 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 01 18:54:33.926387 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-6a0e5bee-8b0a-4c07-a75a-919e6b7686a8 tempest-HostsAdminNegativeTestJSON-71042643 tempest-HostsAdminNegativeTestJSON-71042643-project-admin] Action: 'update', calling method: .version_select at 0x7f0ae30f2670>, body: {"status": "enable", "maintenance_mode": "invalid"} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 18:54:33.953347 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-6a0e5bee-8b0a-4c07-a75a-919e6b7686a8 tempest-HostsAdminNegativeTestJSON-71042643 tempest-HostsAdminNegativeTestJSON-71042643-project-admin] Request method failure captured: Nov 01 18:54:33.953347 n-d-863052-2 devstack@n-api.service[121402]: request: PUT /compute/v2.1/os-hosts/n-d-863052-2 HTTP/1.1 Nov 01 18:54:33.953347 n-d-863052-2 devstack@n-api.service[121402]: Accept: application/json Nov 01 18:54:33.953347 n-d-863052-2 devstack@n-api.service[121402]: Accept-Encoding: identity Nov 01 18:54:33.953347 n-d-863052-2 devstack@n-api.service[121402]: Connection: close Nov 01 18:54:33.953347 n-d-863052-2 devstack@n-api.service[121402]: Content-Length: 51 Nov 01 18:54:33.953347 n-d-863052-2 devstack@n-api.service[121402]: Content-Type: application/json Nov 01 18:54:33.953347 n-d-863052-2 devstack@n-api.service[121402]: Host: 10.222.0.13 Nov 01 18:54:33.953347 n-d-863052-2 devstack@n-api.service[121402]: Openstack-System-Scope: None Nov 01 18:54:33.953347 n-d-863052-2 devstack@n-api.service[121402]: User-Agent: python-urllib3/1.26.12 Nov 01 18:54:33.953347 n-d-863052-2 devstack@n-api.service[121402]: X-Auth-Token: gAAAAABjYWtmQiiLNHq9ur8rEtsm3eq9CYkmwS0_KmQO_dwTJ_Exa9Gf0moKVlE6SoRNzknb4dL8HQNJuWP4bCA9XKQfEBFCoLzBtGj5oL_0RWHHBmKw7UInua9Y8hNZ6YTwgEf6BnQUnfR9SKHNkqP5jAF89SNQh-Z9wCCOyw-jhaz5mE2Sigk Nov 01 18:54:33.953347 n-d-863052-2 devstack@n-api.service[121402]: X-Domain-Id: None Nov 01 18:54:33.953347 n-d-863052-2 devstack@n-api.service[121402]: X-Domain-Name: None Nov 01 18:54:33.953347 n-d-863052-2 devstack@n-api.service[121402]: X-Identity-Status: Confirmed Nov 01 18:54:33.953347 n-d-863052-2 devstack@n-api.service[121402]: X-Is-Admin-Project: True Nov 01 18:54:33.953347 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Domain-Id: default Nov 01 18:54:33.953347 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Domain-Name: Default Nov 01 18:54:33.953347 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Id: 7af0f6aa8f964e4984e90607ba7a63c6 Nov 01 18:54:33.953347 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-71042643 Nov 01 18:54:33.953347 n-d-863052-2 devstack@n-api.service[121402]: X-Role: admin,member,reader Nov 01 18:54:33.953347 n-d-863052-2 devstack@n-api.service[121402]: X-Roles: admin,member,reader Nov 01 18:54:33.954497 n-d-863052-2 devstack@n-api.service[121402]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/7af0f6aa8f964e4984e90607ba7a63c6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/7af0f6aa8f964e4984e90607ba7a63c6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_7af0f6aa8f964e4984e90607ba7a63c6", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/7af0f6aa8f964e4984e90607ba7a63c6"}]}] Nov 01 18:54:33.954497 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant: tempest-HostsAdminNegativeTestJSON-71042643 Nov 01 18:54:33.954497 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant-Id: 7af0f6aa8f964e4984e90607ba7a63c6 Nov 01 18:54:33.954497 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-71042643 Nov 01 18:54:33.954497 n-d-863052-2 devstack@n-api.service[121402]: X-User: tempest-HostsAdminNegativeTestJSON-71042643-project-admin Nov 01 18:54:33.954497 n-d-863052-2 devstack@n-api.service[121402]: X-User-Domain-Id: default Nov 01 18:54:33.954497 n-d-863052-2 devstack@n-api.service[121402]: X-User-Domain-Name: Default Nov 01 18:54:33.954497 n-d-863052-2 devstack@n-api.service[121402]: X-User-Id: f1ec0327398c42729f080ae38ed0623b Nov 01 18:54:33.954497 n-d-863052-2 devstack@n-api.service[121402]: X-User-Name: tempest-HostsAdminNegativeTestJSON-71042643-project-admin Nov 01 18:54:33.954497 n-d-863052-2 devstack@n-api.service[121402]: Nov 01 18:54:33.954497 n-d-863052-2 devstack@n-api.service[121402]: {"status": "enable", "maintenance_mode": "invalid"} Nov 01 18:54:33.954497 n-d-863052-2 devstack@n-api.service[121402]: method: Nov 01 18:54:33.954497 n-d-863052-2 devstack@n-api.service[121402]: exception: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Nov 01 18:54:33.955293 n-d-863052-2 devstack@n-api.service[121402]: action_args: {'id': 'n-d-863052-2', 'body': {'status': 'enable', 'maintenance_mode': 'invalid'}} Nov 01 18:54:33.955293 n-d-863052-2 devstack@n-api.service[121402]: {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 01 18:54:33.955293 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:54:33.955293 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Nov 01 18:54:33.955293 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Nov 01 18:54:33.955293 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Nov 01 18:54:33.955293 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise error Nov 01 18:54:33.955293 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Nov 01 18:54:33.955293 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 18:54:33.955293 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['maintenance_mode']: Nov 01 18:54:33.955293 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Nov 01 18:54:33.955293 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi 'disable', Nov 01 18:54:33.955293 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi 'Enable', Nov 01 18:54:33.955293 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi 'Disable', Nov 01 18:54:33.955293 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi 'ENABLE', Nov 01 18:54:33.955293 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi 'DISABLE'], Nov 01 18:54:33.955293 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi 'type': 'string'} Nov 01 18:54:33.955293 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 18:54:33.955293 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi On instance: Nov 01 18:54:33.955293 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi 'invalid' Nov 01 18:54:33.955293 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 18:54:33.955293 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 18:54:33.955293 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 18:54:33.955293 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:54:33.955293 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 18:54:33.956738 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 18:54:33.956738 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 01 18:54:33.956738 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 01 18:54:33.956738 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 01 18:54:33.956738 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 01 18:54:33.956738 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 01 18:54:33.956738 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 01 18:54:33.956738 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Nov 01 18:54:33.956738 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Nov 01 18:54:33.956738 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Nov 01 18:54:33.956738 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Nov 01 18:54:33.956738 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Nov 01 18:54:33.956738 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Nov 01 18:54:33.956738 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Nov 01 18:54:33.956738 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 18:54:33.956738 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 18:54:33.956738 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 18:54:33.956738 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:54:33.956738 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 18:54:33.957724 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 18:54:33.957724 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Nov 01 18:54:33.957724 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Nov 01 18:54:33.957724 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Nov 01 18:54:33.957724 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 18:54:33.964205 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-6a0e5bee-8b0a-4c07-a75a-919e6b7686a8 tempest-HostsAdminNegativeTestJSON-71042643 tempest-HostsAdminNegativeTestJSON-71042643-project-admin] Returning 400 to user: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=121402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 01 18:54:33.968288 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-6a0e5bee-8b0a-4c07-a75a-919e6b7686a8 tempest-HostsAdminNegativeTestJSON-71042643 tempest-HostsAdminNegativeTestJSON-71042643-project-admin] 10.222.0.13 "PUT /compute/v2.1/os-hosts/n-d-863052-2" status: 400 len: 199 microversion: 2.1 time: 0.067641 Nov 01 18:54:33.974598 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 55/102] 10.222.0.13 () {60 vars in 1187 bytes} [Tue Nov 1 18:54:33 2022] PUT /compute/v2.1/os-hosts/n-d-863052-2 => generated 199 bytes in 76 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 01 18:54:33.991964 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-ef8ed0a5-bbe9-4eb1-a13e-3b954f66a3ea tempest-HostsAdminNegativeTestJSON-71042643 tempest-HostsAdminNegativeTestJSON-71042643-project-admin] Action: 'update', calling method: .version_select at 0x7f0ae30299d0>, body: {"status": "invalid", "maintenance_mode": "enable"} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 18:54:33.998110 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-06d5fc71-24dd-4e21-88c5-81d1366c9363 tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce2e0d1828674809a3344a7a68f375c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8e1248497284006a7acbb8169627ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:54:34.012641 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-06d5fc71-24dd-4e21-88c5-81d1366c9363 tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] 10.222.0.13 "GET /compute/v2.1/servers/4ebac531-6f77-4108-afc9-0eccb86dee8b" status: 200 len: 1341 microversion: 2.1 time: 0.408006 Nov 01 18:54:34.013533 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 48/103] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:54:33 2022] GET /compute/v2.1/servers/4ebac531-6f77-4108-afc9-0eccb86dee8b => generated 1341 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:54:34.021431 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-ef8ed0a5-bbe9-4eb1-a13e-3b954f66a3ea tempest-HostsAdminNegativeTestJSON-71042643 tempest-HostsAdminNegativeTestJSON-71042643-project-admin] Request method failure captured: Nov 01 18:54:34.021431 n-d-863052-2 devstack@n-api.service[121402]: request: PUT /compute/v2.1/os-hosts/n-d-863052-2 HTTP/1.1 Nov 01 18:54:34.021431 n-d-863052-2 devstack@n-api.service[121402]: Accept: application/json Nov 01 18:54:34.021431 n-d-863052-2 devstack@n-api.service[121402]: Accept-Encoding: identity Nov 01 18:54:34.021431 n-d-863052-2 devstack@n-api.service[121402]: Connection: close Nov 01 18:54:34.021431 n-d-863052-2 devstack@n-api.service[121402]: Content-Length: 51 Nov 01 18:54:34.021431 n-d-863052-2 devstack@n-api.service[121402]: Content-Type: application/json Nov 01 18:54:34.021431 n-d-863052-2 devstack@n-api.service[121402]: Host: 10.222.0.13 Nov 01 18:54:34.021431 n-d-863052-2 devstack@n-api.service[121402]: Openstack-System-Scope: None Nov 01 18:54:34.021431 n-d-863052-2 devstack@n-api.service[121402]: User-Agent: python-urllib3/1.26.12 Nov 01 18:54:34.021431 n-d-863052-2 devstack@n-api.service[121402]: X-Auth-Token: gAAAAABjYWtmQiiLNHq9ur8rEtsm3eq9CYkmwS0_KmQO_dwTJ_Exa9Gf0moKVlE6SoRNzknb4dL8HQNJuWP4bCA9XKQfEBFCoLzBtGj5oL_0RWHHBmKw7UInua9Y8hNZ6YTwgEf6BnQUnfR9SKHNkqP5jAF89SNQh-Z9wCCOyw-jhaz5mE2Sigk Nov 01 18:54:34.021431 n-d-863052-2 devstack@n-api.service[121402]: X-Domain-Id: None Nov 01 18:54:34.021431 n-d-863052-2 devstack@n-api.service[121402]: X-Domain-Name: None Nov 01 18:54:34.021431 n-d-863052-2 devstack@n-api.service[121402]: X-Identity-Status: Confirmed Nov 01 18:54:34.021431 n-d-863052-2 devstack@n-api.service[121402]: X-Is-Admin-Project: True Nov 01 18:54:34.021431 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Domain-Id: default Nov 01 18:54:34.021431 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Domain-Name: Default Nov 01 18:54:34.021431 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Id: 7af0f6aa8f964e4984e90607ba7a63c6 Nov 01 18:54:34.021431 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-71042643 Nov 01 18:54:34.021431 n-d-863052-2 devstack@n-api.service[121402]: X-Role: admin,member,reader Nov 01 18:54:34.021431 n-d-863052-2 devstack@n-api.service[121402]: X-Roles: admin,member,reader Nov 01 18:54:34.022561 n-d-863052-2 devstack@n-api.service[121402]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/7af0f6aa8f964e4984e90607ba7a63c6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/7af0f6aa8f964e4984e90607ba7a63c6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_7af0f6aa8f964e4984e90607ba7a63c6", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/7af0f6aa8f964e4984e90607ba7a63c6"}]}] Nov 01 18:54:34.022561 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant: tempest-HostsAdminNegativeTestJSON-71042643 Nov 01 18:54:34.022561 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant-Id: 7af0f6aa8f964e4984e90607ba7a63c6 Nov 01 18:54:34.022561 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-71042643 Nov 01 18:54:34.022561 n-d-863052-2 devstack@n-api.service[121402]: X-User: tempest-HostsAdminNegativeTestJSON-71042643-project-admin Nov 01 18:54:34.022561 n-d-863052-2 devstack@n-api.service[121402]: X-User-Domain-Id: default Nov 01 18:54:34.022561 n-d-863052-2 devstack@n-api.service[121402]: X-User-Domain-Name: Default Nov 01 18:54:34.022561 n-d-863052-2 devstack@n-api.service[121402]: X-User-Id: f1ec0327398c42729f080ae38ed0623b Nov 01 18:54:34.022561 n-d-863052-2 devstack@n-api.service[121402]: X-User-Name: tempest-HostsAdminNegativeTestJSON-71042643-project-admin Nov 01 18:54:34.022561 n-d-863052-2 devstack@n-api.service[121402]: Nov 01 18:54:34.022561 n-d-863052-2 devstack@n-api.service[121402]: {"status": "invalid", "maintenance_mode": "enable"} Nov 01 18:54:34.022561 n-d-863052-2 devstack@n-api.service[121402]: method: Nov 01 18:54:34.022561 n-d-863052-2 devstack@n-api.service[121402]: exception: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Nov 01 18:54:34.023253 n-d-863052-2 devstack@n-api.service[121402]: action_args: {'id': 'n-d-863052-2', 'body': {'status': 'invalid', 'maintenance_mode': 'enable'}} Nov 01 18:54:34.023253 n-d-863052-2 devstack@n-api.service[121402]: {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 01 18:54:34.023253 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:54:34.023253 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Nov 01 18:54:34.023253 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Nov 01 18:54:34.023253 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Nov 01 18:54:34.023253 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise error Nov 01 18:54:34.023253 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Nov 01 18:54:34.023253 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 18:54:34.023253 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['status']: Nov 01 18:54:34.023253 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Nov 01 18:54:34.023253 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi 'disable', Nov 01 18:54:34.023253 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi 'Enable', Nov 01 18:54:34.023253 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi 'Disable', Nov 01 18:54:34.023253 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi 'ENABLE', Nov 01 18:54:34.023253 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi 'DISABLE'], Nov 01 18:54:34.023253 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi 'type': 'string'} Nov 01 18:54:34.023253 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 18:54:34.023253 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi On instance: Nov 01 18:54:34.023253 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi 'invalid' Nov 01 18:54:34.023253 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 18:54:34.023253 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 18:54:34.023253 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 18:54:34.023253 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:54:34.023253 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 18:54:34.024490 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 18:54:34.024490 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 01 18:54:34.024490 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 01 18:54:34.024490 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 01 18:54:34.024490 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 01 18:54:34.024490 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 01 18:54:34.024490 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 01 18:54:34.024490 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Nov 01 18:54:34.024490 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Nov 01 18:54:34.024490 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Nov 01 18:54:34.024490 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Nov 01 18:54:34.024490 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Nov 01 18:54:34.024490 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Nov 01 18:54:34.024490 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Nov 01 18:54:34.024490 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 18:54:34.024490 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 18:54:34.024490 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 18:54:34.024490 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:54:34.024490 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 18:54:34.026088 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 18:54:34.026088 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Nov 01 18:54:34.026088 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Nov 01 18:54:34.026088 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Nov 01 18:54:34.026088 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 18:54:34.026088 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-ef8ed0a5-bbe9-4eb1-a13e-3b954f66a3ea tempest-HostsAdminNegativeTestJSON-71042643 tempest-HostsAdminNegativeTestJSON-71042643-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=121402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 01 18:54:34.027703 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-ef8ed0a5-bbe9-4eb1-a13e-3b954f66a3ea tempest-HostsAdminNegativeTestJSON-71042643 tempest-HostsAdminNegativeTestJSON-71042643-project-admin] 10.222.0.13 "PUT /compute/v2.1/os-hosts/n-d-863052-2" status: 400 len: 189 microversion: 2.1 time: 0.050948 Nov 01 18:54:34.036716 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 56/104] 10.222.0.13 () {60 vars in 1187 bytes} [Tue Nov 1 18:54:33 2022] PUT /compute/v2.1/os-hosts/n-d-863052-2 => generated 189 bytes in 56 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 01 18:54:34.041911 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-d36c5e02-0baf-46e9-850d-555147bcbe63 tempest-HostsAdminNegativeTestJSON-1687021239 tempest-HostsAdminNegativeTestJSON-1687021239-project] Action: 'update', calling method: .version_select at 0x7f0ae30c43a0>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 18:54:34.045981 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-d36c5e02-0baf-46e9-850d-555147bcbe63 tempest-HostsAdminNegativeTestJSON-1687021239 tempest-HostsAdminNegativeTestJSON-1687021239-project] Policy check for os_compute_api:os-hosts:update failed with credentials {'is_admin': False, 'user_id': 'ff1e2d2d83ea49d5b1f03b5d9f18806e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '832b609a394a47049a94e1b5c0e19cf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:54:34.047582 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-d36c5e02-0baf-46e9-850d-555147bcbe63 tempest-HostsAdminNegativeTestJSON-1687021239 tempest-HostsAdminNegativeTestJSON-1687021239-project] Request method failure captured: Nov 01 18:54:34.047582 n-d-863052-2 devstack@n-api.service[121403]: request: PUT /compute/v2.1/os-hosts/n-d-863052-2 HTTP/1.1 Nov 01 18:54:34.047582 n-d-863052-2 devstack@n-api.service[121403]: Accept: application/json Nov 01 18:54:34.047582 n-d-863052-2 devstack@n-api.service[121403]: Accept-Encoding: identity Nov 01 18:54:34.047582 n-d-863052-2 devstack@n-api.service[121403]: Connection: close Nov 01 18:54:34.047582 n-d-863052-2 devstack@n-api.service[121403]: Content-Length: 50 Nov 01 18:54:34.047582 n-d-863052-2 devstack@n-api.service[121403]: Content-Type: application/json Nov 01 18:54:34.047582 n-d-863052-2 devstack@n-api.service[121403]: Host: 10.222.0.13 Nov 01 18:54:34.047582 n-d-863052-2 devstack@n-api.service[121403]: Openstack-System-Scope: None Nov 01 18:54:34.047582 n-d-863052-2 devstack@n-api.service[121403]: User-Agent: python-urllib3/1.26.12 Nov 01 18:54:34.047582 n-d-863052-2 devstack@n-api.service[121403]: X-Auth-Token: gAAAAABjYWtiIql9we6LCtbD02Cqvs-kfbeXJqsYuTCdlDG34Im5njq3YVPsJ6fYgh6UoU2eV0F1yGGY1ZBTjP_h6a4n-sp_6sGJEDLqgYwwpTZCmssS8yK9iLjMR9fnnTIyMEgFmNNtfCxgezUZrnO4MrqucB7BVTTAOUBFbdp09YeNonT0A_E Nov 01 18:54:34.047582 n-d-863052-2 devstack@n-api.service[121403]: X-Domain-Id: None Nov 01 18:54:34.047582 n-d-863052-2 devstack@n-api.service[121403]: X-Domain-Name: None Nov 01 18:54:34.047582 n-d-863052-2 devstack@n-api.service[121403]: X-Identity-Status: Confirmed Nov 01 18:54:34.047582 n-d-863052-2 devstack@n-api.service[121403]: X-Is-Admin-Project: True Nov 01 18:54:34.047582 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Domain-Id: default Nov 01 18:54:34.047582 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Domain-Name: Default Nov 01 18:54:34.047582 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Id: 832b609a394a47049a94e1b5c0e19cf4 Nov 01 18:54:34.047582 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1687021239 Nov 01 18:54:34.047582 n-d-863052-2 devstack@n-api.service[121403]: X-Role: member,reader Nov 01 18:54:34.047582 n-d-863052-2 devstack@n-api.service[121403]: X-Roles: member,reader Nov 01 18:54:34.049062 n-d-863052-2 devstack@n-api.service[121403]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/832b609a394a47049a94e1b5c0e19cf4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/832b609a394a47049a94e1b5c0e19cf4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_832b609a394a47049a94e1b5c0e19cf4", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/832b609a394a47049a94e1b5c0e19cf4"}]}] Nov 01 18:54:34.049062 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1687021239 Nov 01 18:54:34.049062 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant-Id: 832b609a394a47049a94e1b5c0e19cf4 Nov 01 18:54:34.049062 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1687021239 Nov 01 18:54:34.049062 n-d-863052-2 devstack@n-api.service[121403]: X-User: tempest-HostsAdminNegativeTestJSON-1687021239-project Nov 01 18:54:34.049062 n-d-863052-2 devstack@n-api.service[121403]: X-User-Domain-Id: default Nov 01 18:54:34.049062 n-d-863052-2 devstack@n-api.service[121403]: X-User-Domain-Name: Default Nov 01 18:54:34.049062 n-d-863052-2 devstack@n-api.service[121403]: X-User-Id: ff1e2d2d83ea49d5b1f03b5d9f18806e Nov 01 18:54:34.049062 n-d-863052-2 devstack@n-api.service[121403]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1687021239-project Nov 01 18:54:34.049062 n-d-863052-2 devstack@n-api.service[121403]: Nov 01 18:54:34.049062 n-d-863052-2 devstack@n-api.service[121403]: {"status": "enable", "maintenance_mode": "enable"} Nov 01 18:54:34.049062 n-d-863052-2 devstack@n-api.service[121403]: method: Nov 01 18:54:34.049062 n-d-863052-2 devstack@n-api.service[121403]: exception: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Nov 01 18:54:34.049062 n-d-863052-2 devstack@n-api.service[121403]: action_args: {'id': 'n-d-863052-2', 'body': {'status': 'enable', 'maintenance_mode': 'enable'}} Nov 01 18:54:34.049780 n-d-863052-2 devstack@n-api.service[121403]: {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 01 18:54:34.049780 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:54:34.049780 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 18:54:34.049780 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 18:54:34.049780 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 01 18:54:34.049780 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 01 18:54:34.049780 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 01 18:54:34.049780 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 01 18:54:34.049780 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 01 18:54:34.049780 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 01 18:54:34.049780 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 01 18:54:34.049780 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 01 18:54:34.049780 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 112, in update Nov 01 18:54:34.049780 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'update', Nov 01 18:54:34.049780 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Nov 01 18:54:34.049780 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Nov 01 18:54:34.049780 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Nov 01 18:54:34.049780 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Nov 01 18:54:34.049780 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 01 18:54:34.049780 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 01 18:54:34.051212 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 01 18:54:34.051212 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise self.value Nov 01 18:54:34.051212 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Nov 01 18:54:34.051212 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Nov 01 18:54:34.051212 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Nov 01 18:54:34.051212 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return self.enforce( Nov 01 18:54:34.051212 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Nov 01 18:54:34.051212 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Nov 01 18:54:34.051212 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Nov 01 18:54:34.051212 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 18:54:34.051212 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 18:54:34.051212 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 18:54:34.051212 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:54:34.051212 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 18:54:34.051212 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 18:54:34.051212 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Nov 01 18:54:34.051212 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Nov 01 18:54:34.051212 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Nov 01 18:54:34.051212 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 18:54:34.052176 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-d36c5e02-0baf-46e9-850d-555147bcbe63 tempest-HostsAdminNegativeTestJSON-1687021239 tempest-HostsAdminNegativeTestJSON-1687021239-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:update to be performed. {{(pid=121403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 01 18:54:34.064895 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-d36c5e02-0baf-46e9-850d-555147bcbe63 tempest-HostsAdminNegativeTestJSON-1687021239 tempest-HostsAdminNegativeTestJSON-1687021239-project] 10.222.0.13 "PUT /compute/v2.1/os-hosts/n-d-863052-2" status: 403 len: 111 microversion: 2.1 time: 0.011080 Nov 01 18:54:34.073438 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 49/105] 10.222.0.13 () {60 vars in 1187 bytes} [Tue Nov 1 18:54:34 2022] PUT /compute/v2.1/os-hosts/n-d-863052-2 => generated 111 bytes in 36 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Nov 01 18:54:34.075660 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-fb7247af-3dd4-472a-aba9-d3a926c76c16 tempest-HostsAdminNegativeTestJSON-71042643 tempest-HostsAdminNegativeTestJSON-71042643-project-admin] Action: 'update', calling method: .version_select at 0x7f0ae30d7f70>, body: {"status": null, "maintenance_mode": null} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 18:54:34.080127 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-fb7247af-3dd4-472a-aba9-d3a926c76c16 tempest-HostsAdminNegativeTestJSON-71042643 tempest-HostsAdminNegativeTestJSON-71042643-project-admin] Request method failure captured: Nov 01 18:54:34.080127 n-d-863052-2 devstack@n-api.service[121402]: request: PUT /compute/v2.1/os-hosts/n-d-863052-2 HTTP/1.1 Nov 01 18:54:34.080127 n-d-863052-2 devstack@n-api.service[121402]: Accept: application/json Nov 01 18:54:34.080127 n-d-863052-2 devstack@n-api.service[121402]: Accept-Encoding: identity Nov 01 18:54:34.080127 n-d-863052-2 devstack@n-api.service[121402]: Connection: close Nov 01 18:54:34.080127 n-d-863052-2 devstack@n-api.service[121402]: Content-Length: 42 Nov 01 18:54:34.080127 n-d-863052-2 devstack@n-api.service[121402]: Content-Type: application/json Nov 01 18:54:34.080127 n-d-863052-2 devstack@n-api.service[121402]: Host: 10.222.0.13 Nov 01 18:54:34.080127 n-d-863052-2 devstack@n-api.service[121402]: Openstack-System-Scope: None Nov 01 18:54:34.080127 n-d-863052-2 devstack@n-api.service[121402]: User-Agent: python-urllib3/1.26.12 Nov 01 18:54:34.080127 n-d-863052-2 devstack@n-api.service[121402]: X-Auth-Token: gAAAAABjYWtmQiiLNHq9ur8rEtsm3eq9CYkmwS0_KmQO_dwTJ_Exa9Gf0moKVlE6SoRNzknb4dL8HQNJuWP4bCA9XKQfEBFCoLzBtGj5oL_0RWHHBmKw7UInua9Y8hNZ6YTwgEf6BnQUnfR9SKHNkqP5jAF89SNQh-Z9wCCOyw-jhaz5mE2Sigk Nov 01 18:54:34.080127 n-d-863052-2 devstack@n-api.service[121402]: X-Domain-Id: None Nov 01 18:54:34.080127 n-d-863052-2 devstack@n-api.service[121402]: X-Domain-Name: None Nov 01 18:54:34.080127 n-d-863052-2 devstack@n-api.service[121402]: X-Identity-Status: Confirmed Nov 01 18:54:34.080127 n-d-863052-2 devstack@n-api.service[121402]: X-Is-Admin-Project: True Nov 01 18:54:34.080127 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Domain-Id: default Nov 01 18:54:34.080127 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Domain-Name: Default Nov 01 18:54:34.080127 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Id: 7af0f6aa8f964e4984e90607ba7a63c6 Nov 01 18:54:34.080127 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-71042643 Nov 01 18:54:34.080127 n-d-863052-2 devstack@n-api.service[121402]: X-Role: admin,member,reader Nov 01 18:54:34.080127 n-d-863052-2 devstack@n-api.service[121402]: X-Roles: admin,member,reader Nov 01 18:54:34.081293 n-d-863052-2 devstack@n-api.service[121402]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/7af0f6aa8f964e4984e90607ba7a63c6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/7af0f6aa8f964e4984e90607ba7a63c6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_7af0f6aa8f964e4984e90607ba7a63c6", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/7af0f6aa8f964e4984e90607ba7a63c6"}]}] Nov 01 18:54:34.081293 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant: tempest-HostsAdminNegativeTestJSON-71042643 Nov 01 18:54:34.081293 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant-Id: 7af0f6aa8f964e4984e90607ba7a63c6 Nov 01 18:54:34.081293 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-71042643 Nov 01 18:54:34.081293 n-d-863052-2 devstack@n-api.service[121402]: X-User: tempest-HostsAdminNegativeTestJSON-71042643-project-admin Nov 01 18:54:34.081293 n-d-863052-2 devstack@n-api.service[121402]: X-User-Domain-Id: default Nov 01 18:54:34.081293 n-d-863052-2 devstack@n-api.service[121402]: X-User-Domain-Name: Default Nov 01 18:54:34.081293 n-d-863052-2 devstack@n-api.service[121402]: X-User-Id: f1ec0327398c42729f080ae38ed0623b Nov 01 18:54:34.081293 n-d-863052-2 devstack@n-api.service[121402]: X-User-Name: tempest-HostsAdminNegativeTestJSON-71042643-project-admin Nov 01 18:54:34.081293 n-d-863052-2 devstack@n-api.service[121402]: Nov 01 18:54:34.081293 n-d-863052-2 devstack@n-api.service[121402]: {"status": null, "maintenance_mode": null} Nov 01 18:54:34.081293 n-d-863052-2 devstack@n-api.service[121402]: method: Nov 01 18:54:34.081293 n-d-863052-2 devstack@n-api.service[121402]: exception: Invalid input for field/attribute status. Value: None. None is not of type 'string' Nov 01 18:54:34.081293 n-d-863052-2 devstack@n-api.service[121402]: action_args: {'id': 'n-d-863052-2', 'body': {'status': None, 'maintenance_mode': None}} Nov 01 18:54:34.082018 n-d-863052-2 devstack@n-api.service[121402]: {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 01 18:54:34.082018 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:54:34.082018 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Nov 01 18:54:34.082018 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Nov 01 18:54:34.082018 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Nov 01 18:54:34.082018 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise error Nov 01 18:54:34.082018 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: None is not of type 'string' Nov 01 18:54:34.082018 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 18:54:34.082018 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['status']: Nov 01 18:54:34.082018 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Nov 01 18:54:34.082018 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi 'disable', Nov 01 18:54:34.082018 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi 'Enable', Nov 01 18:54:34.082018 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi 'Disable', Nov 01 18:54:34.082018 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi 'ENABLE', Nov 01 18:54:34.082018 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi 'DISABLE'], Nov 01 18:54:34.082018 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi 'type': 'string'} Nov 01 18:54:34.082018 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 18:54:34.082018 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi On instance: Nov 01 18:54:34.082018 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi None Nov 01 18:54:34.082018 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 18:54:34.082018 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 18:54:34.082018 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 18:54:34.082018 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:54:34.082018 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 18:54:34.082018 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 18:54:34.083281 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 01 18:54:34.083281 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 01 18:54:34.083281 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 01 18:54:34.083281 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 01 18:54:34.083281 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 01 18:54:34.083281 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 01 18:54:34.083281 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Nov 01 18:54:34.083281 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Nov 01 18:54:34.083281 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Nov 01 18:54:34.083281 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Nov 01 18:54:34.083281 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Nov 01 18:54:34.083281 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Nov 01 18:54:34.083281 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute status. Value: None. None is not of type 'string' Nov 01 18:54:34.083281 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 18:54:34.083281 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 18:54:34.083281 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 18:54:34.083281 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:54:34.083281 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 18:54:34.083281 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 18:54:34.084335 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Nov 01 18:54:34.084335 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Nov 01 18:54:34.084335 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute status. Value: None. None is not of type 'string' Nov 01 18:54:34.084335 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 18:54:34.084335 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-fb7247af-3dd4-472a-aba9-d3a926c76c16 tempest-HostsAdminNegativeTestJSON-71042643 tempest-HostsAdminNegativeTestJSON-71042643-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: None. None is not of type 'string' {{(pid=121402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 01 18:54:34.105560 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-fb7247af-3dd4-472a-aba9-d3a926c76c16 tempest-HostsAdminNegativeTestJSON-71042643 tempest-HostsAdminNegativeTestJSON-71042643-project-admin] 10.222.0.13 "PUT /compute/v2.1/os-hosts/n-d-863052-2" status: 400 len: 127 microversion: 2.1 time: 0.012682 Nov 01 18:54:34.106412 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 57/106] 10.222.0.13 () {60 vars in 1187 bytes} [Tue Nov 1 18:54:34 2022] PUT /compute/v2.1/os-hosts/n-d-863052-2 => generated 127 bytes in 36 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 01 18:54:34.116150 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-a62dbb86-40d2-4751-9a5d-82187495d871 tempest-HostsAdminNegativeTestJSON-71042643 tempest-HostsAdminNegativeTestJSON-71042643-project-admin] Action: 'update', calling method: .version_select at 0x7f0ae30574c0>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 18:54:34.119720 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.compute.hosts [None req-a62dbb86-40d2-4751-9a5d-82187495d871 tempest-HostsAdminNegativeTestJSON-71042643 tempest-HostsAdminNegativeTestJSON-71042643-project-admin] Enabling host nonexistent_hostname. Nov 01 18:54:34.153770 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.wsgi [None req-a62dbb86-40d2-4751-9a5d-82187495d871 tempest-HostsAdminNegativeTestJSON-71042643 tempest-HostsAdminNegativeTestJSON-71042643-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Nov 01 18:54:34.161426 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-a62dbb86-40d2-4751-9a5d-82187495d871 tempest-HostsAdminNegativeTestJSON-71042643 tempest-HostsAdminNegativeTestJSON-71042643-project-admin] Request method failure captured: Nov 01 18:54:34.161426 n-d-863052-2 devstack@n-api.service[121403]: request: PUT /compute/v2.1/os-hosts/nonexistent_hostname HTTP/1.1 Nov 01 18:54:34.161426 n-d-863052-2 devstack@n-api.service[121403]: Accept: application/json Nov 01 18:54:34.161426 n-d-863052-2 devstack@n-api.service[121403]: Accept-Encoding: identity Nov 01 18:54:34.161426 n-d-863052-2 devstack@n-api.service[121403]: Connection: close Nov 01 18:54:34.161426 n-d-863052-2 devstack@n-api.service[121403]: Content-Length: 50 Nov 01 18:54:34.161426 n-d-863052-2 devstack@n-api.service[121403]: Content-Type: application/json Nov 01 18:54:34.161426 n-d-863052-2 devstack@n-api.service[121403]: Host: 10.222.0.13 Nov 01 18:54:34.161426 n-d-863052-2 devstack@n-api.service[121403]: Openstack-System-Scope: None Nov 01 18:54:34.161426 n-d-863052-2 devstack@n-api.service[121403]: User-Agent: python-urllib3/1.26.12 Nov 01 18:54:34.161426 n-d-863052-2 devstack@n-api.service[121403]: X-Auth-Token: gAAAAABjYWtmQiiLNHq9ur8rEtsm3eq9CYkmwS0_KmQO_dwTJ_Exa9Gf0moKVlE6SoRNzknb4dL8HQNJuWP4bCA9XKQfEBFCoLzBtGj5oL_0RWHHBmKw7UInua9Y8hNZ6YTwgEf6BnQUnfR9SKHNkqP5jAF89SNQh-Z9wCCOyw-jhaz5mE2Sigk Nov 01 18:54:34.161426 n-d-863052-2 devstack@n-api.service[121403]: X-Domain-Id: None Nov 01 18:54:34.161426 n-d-863052-2 devstack@n-api.service[121403]: X-Domain-Name: None Nov 01 18:54:34.161426 n-d-863052-2 devstack@n-api.service[121403]: X-Identity-Status: Confirmed Nov 01 18:54:34.161426 n-d-863052-2 devstack@n-api.service[121403]: X-Is-Admin-Project: True Nov 01 18:54:34.161426 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Domain-Id: default Nov 01 18:54:34.161426 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Domain-Name: Default Nov 01 18:54:34.161426 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Id: 7af0f6aa8f964e4984e90607ba7a63c6 Nov 01 18:54:34.161426 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-71042643 Nov 01 18:54:34.161426 n-d-863052-2 devstack@n-api.service[121403]: X-Role: admin,member,reader Nov 01 18:54:34.161426 n-d-863052-2 devstack@n-api.service[121403]: X-Roles: admin,member,reader Nov 01 18:54:34.162635 n-d-863052-2 devstack@n-api.service[121403]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/7af0f6aa8f964e4984e90607ba7a63c6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/7af0f6aa8f964e4984e90607ba7a63c6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_7af0f6aa8f964e4984e90607ba7a63c6", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/7af0f6aa8f964e4984e90607ba7a63c6"}]}] Nov 01 18:54:34.162635 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant: tempest-HostsAdminNegativeTestJSON-71042643 Nov 01 18:54:34.162635 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant-Id: 7af0f6aa8f964e4984e90607ba7a63c6 Nov 01 18:54:34.162635 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-71042643 Nov 01 18:54:34.162635 n-d-863052-2 devstack@n-api.service[121403]: X-User: tempest-HostsAdminNegativeTestJSON-71042643-project-admin Nov 01 18:54:34.162635 n-d-863052-2 devstack@n-api.service[121403]: X-User-Domain-Id: default Nov 01 18:54:34.162635 n-d-863052-2 devstack@n-api.service[121403]: X-User-Domain-Name: Default Nov 01 18:54:34.162635 n-d-863052-2 devstack@n-api.service[121403]: X-User-Id: f1ec0327398c42729f080ae38ed0623b Nov 01 18:54:34.162635 n-d-863052-2 devstack@n-api.service[121403]: X-User-Name: tempest-HostsAdminNegativeTestJSON-71042643-project-admin Nov 01 18:54:34.162635 n-d-863052-2 devstack@n-api.service[121403]: Nov 01 18:54:34.162635 n-d-863052-2 devstack@n-api.service[121403]: {"status": "enable", "maintenance_mode": "enable"} Nov 01 18:54:34.162635 n-d-863052-2 devstack@n-api.service[121403]: method: Nov 01 18:54:34.162635 n-d-863052-2 devstack@n-api.service[121403]: exception: Host 'nonexistent_hostname' is not mapped to any cell Nov 01 18:54:34.162635 n-d-863052-2 devstack@n-api.service[121403]: action_args: {'id': 'nonexistent_hostname', 'body': {'status': 'enable', 'maintenance_mode': 'enable'}} Nov 01 18:54:34.163556 n-d-863052-2 devstack@n-api.service[121403]: {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 01 18:54:34.163556 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:54:34.163556 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 159, in _set_enabled_status Nov 01 18:54:34.163556 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi result = self.api.set_host_enabled(context, host_name, enabled) Nov 01 18:54:34.163556 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Nov 01 18:54:34.163556 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Nov 01 18:54:34.163556 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 01 18:54:34.163556 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 01 18:54:34.163556 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 01 18:54:34.163556 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise self.value Nov 01 18:54:34.163556 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Nov 01 18:54:34.163556 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Nov 01 18:54:34.163556 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5990, in targeted Nov 01 18:54:34.163556 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Nov 01 18:54:34.163556 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 01 18:54:34.163556 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 01 18:54:34.163556 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Nov 01 18:54:34.163556 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Nov 01 18:54:34.164490 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Nov 01 18:54:34.164490 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Nov 01 18:54:34.164490 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Nov 01 18:54:34.164490 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Nov 01 18:54:34.164490 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Nov 01 18:54:34.164490 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 18:54:34.164490 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 18:54:34.164490 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 18:54:34.164490 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:54:34.164490 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 18:54:34.164490 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 18:54:34.164490 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 01 18:54:34.164490 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 01 18:54:34.164490 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 01 18:54:34.164490 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 01 18:54:34.164490 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 01 18:54:34.164490 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 01 18:54:34.164490 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 01 18:54:34.164490 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 01 18:54:34.164490 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 124, in update Nov 01 18:54:34.165507 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi result['status'] = self._set_enabled_status(context, id, status) Nov 01 18:54:34.165507 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 163, in _set_enabled_status Nov 01 18:54:34.165507 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Nov 01 18:54:34.165507 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Nov 01 18:54:34.165507 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 18:54:34.165507 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 18:54:34.165507 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 18:54:34.165507 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:54:34.165507 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 18:54:34.165507 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 18:54:34.165507 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 01 18:54:34.165507 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 01 18:54:34.165507 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Nov 01 18:54:34.165507 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 18:54:34.173443 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-a62dbb86-40d2-4751-9a5d-82187495d871 tempest-HostsAdminNegativeTestJSON-71042643 tempest-HostsAdminNegativeTestJSON-71042643-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=121403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 01 18:54:34.177822 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-a62dbb86-40d2-4751-9a5d-82187495d871 tempest-HostsAdminNegativeTestJSON-71042643 tempest-HostsAdminNegativeTestJSON-71042643-project-admin] 10.222.0.13 "PUT /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.065878 Nov 01 18:54:34.184405 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 50/107] 10.222.0.13 () {60 vars in 1211 bytes} [Tue Nov 1 18:54:34 2022] PUT /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 01 18:54:34.456940 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-b09795c1-45f1-4141-8522-71341997bbf2 tempest-AggregatesAdminTestJSON-768412114 tempest-AggregatesAdminTestJSON-768412114-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:54:34.457561 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-b09795c1-45f1-4141-8522-71341997bbf2 tempest-AggregatesAdminTestJSON-768412114 tempest-AggregatesAdminTestJSON-768412114-project] [instance: 7967bf1f-943f-441d-befd-373868bbb3aa] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:54:34.488267 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b09795c1-45f1-4141-8522-71341997bbf2 tempest-AggregatesAdminTestJSON-768412114 tempest-AggregatesAdminTestJSON-768412114-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:54:34.488819 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b09795c1-45f1-4141-8522-71341997bbf2 tempest-AggregatesAdminTestJSON-768412114 tempest-AggregatesAdminTestJSON-768412114-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:54:34.489263 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b09795c1-45f1-4141-8522-71341997bbf2 tempest-AggregatesAdminTestJSON-768412114 tempest-AggregatesAdminTestJSON-768412114-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:54:34.497400 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b09795c1-45f1-4141-8522-71341997bbf2 tempest-AggregatesAdminTestJSON-768412114 tempest-AggregatesAdminTestJSON-768412114-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:54:34.499523 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b09795c1-45f1-4141-8522-71341997bbf2 tempest-AggregatesAdminTestJSON-768412114 tempest-AggregatesAdminTestJSON-768412114-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:54:34.506041 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b09795c1-45f1-4141-8522-71341997bbf2 tempest-AggregatesAdminTestJSON-768412114 tempest-AggregatesAdminTestJSON-768412114-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:54:35.034540 n-d-863052-2 devstack@n-api.service[121403]: DEBUG dbcounter [-] [121403] Writing DB stats nova_cell0:SELECT=14 {{(pid=121403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 18:54:35.039570 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-857abf25-e945-4457-b4d4-ebb07af7070b tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:54:35.040406 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-857abf25-e945-4457-b4d4-ebb07af7070b tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] [instance: 4ebac531-6f77-4108-afc9-0eccb86dee8b] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:54:35.052471 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-857abf25-e945-4457-b4d4-ebb07af7070b tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:54:35.055165 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-857abf25-e945-4457-b4d4-ebb07af7070b tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:54:35.055912 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-857abf25-e945-4457-b4d4-ebb07af7070b tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:54:35.057441 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-857abf25-e945-4457-b4d4-ebb07af7070b tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:54:35.061212 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-857abf25-e945-4457-b4d4-ebb07af7070b tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:54:35.061903 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-857abf25-e945-4457-b4d4-ebb07af7070b tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:54:35.336089 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-b09795c1-45f1-4141-8522-71341997bbf2 tempest-AggregatesAdminTestJSON-768412114 tempest-AggregatesAdminTestJSON-768412114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439a7ac2509640c49361f9ba6636b34d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8382e1376b104295aa5cef36ba07cf45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:54:35.348205 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-b09795c1-45f1-4141-8522-71341997bbf2 tempest-AggregatesAdminTestJSON-768412114 tempest-AggregatesAdminTestJSON-768412114-project] 10.222.0.13 "GET /compute/v2.1/servers/7967bf1f-943f-441d-befd-373868bbb3aa" status: 200 len: 1338 microversion: 2.1 time: 0.904308 Nov 01 18:54:35.350701 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 58/108] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:54:34 2022] GET /compute/v2.1/servers/7967bf1f-943f-441d-befd-373868bbb3aa => generated 1338 bytes in 909 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:54:35.756442 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-857abf25-e945-4457-b4d4-ebb07af7070b tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce2e0d1828674809a3344a7a68f375c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8e1248497284006a7acbb8169627ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:54:35.764458 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [req-4e31a795-c972-4a3f-b1ae-0150851cdacc req-7ede9859-2d6e-4f69-b508-b470c3051745 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4ebac531-6f77-4108-afc9-0eccb86dee8b", "tag": "8abf404d-d3c6-4853-a8a7-331b2d566057"}]} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 18:54:35.769186 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-857abf25-e945-4457-b4d4-ebb07af7070b tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] 10.222.0.13 "GET /compute/v2.1/servers/4ebac531-6f77-4108-afc9-0eccb86dee8b" status: 200 len: 1341 microversion: 2.1 time: 0.733243 Nov 01 18:54:35.769932 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 51/109] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:54:35 2022] GET /compute/v2.1/servers/4ebac531-6f77-4108-afc9-0eccb86dee8b => generated 1341 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 18:54:35.829158 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-4e31a795-c972-4a3f-b1ae-0150851cdacc req-7ede9859-2d6e-4f69-b508-b470c3051745 service nova] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:54:35.830477 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-4e31a795-c972-4a3f-b1ae-0150851cdacc req-7ede9859-2d6e-4f69-b508-b470c3051745 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:54:35.831747 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-4e31a795-c972-4a3f-b1ae-0150851cdacc req-7ede9859-2d6e-4f69-b508-b470c3051745 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:54:35.932976 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.compute.server_external_events [req-4e31a795-c972-4a3f-b1ae-0150851cdacc req-7ede9859-2d6e-4f69-b508-b470c3051745 service nova] Creating event network-changed:8abf404d-d3c6-4853-a8a7-331b2d566057 for instance 4ebac531-6f77-4108-afc9-0eccb86dee8b on n-h1-863052-2 Nov 01 18:54:35.935036 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-4e31a795-c972-4a3f-b1ae-0150851cdacc req-7ede9859-2d6e-4f69-b508-b470c3051745 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=121402) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Nov 01 18:54:35.936697 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-4e31a795-c972-4a3f-b1ae-0150851cdacc req-7ede9859-2d6e-4f69-b508-b470c3051745 service nova] Acquired lock "compute-rpcapi-router" {{(pid=121402) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Nov 01 18:54:35.938786 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-a3b85bd0-8032-4c50-a9c2-db78df52d1b2 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:54:35.940649 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-a3b85bd0-8032-4c50-a9c2-db78df52d1b2 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:54:35.943322 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-a3b85bd0-8032-4c50-a9c2-db78df52d1b2 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:54:35.944963 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-a3b85bd0-8032-4c50-a9c2-db78df52d1b2 None None] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:54:35.946286 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-a3b85bd0-8032-4c50-a9c2-db78df52d1b2 None None] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:54:35.953363 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-a3b85bd0-8032-4c50-a9c2-db78df52d1b2 None None] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:54:35.988077 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.compute.rpcapi [None req-a3b85bd0-8032-4c50-a9c2-db78df52d1b2 None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Nov 01 18:54:35.989026 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-a3b85bd0-8032-4c50-a9c2-db78df52d1b2 None None] Releasing lock "compute-rpcapi-router" {{(pid=121402) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Nov 01 18:54:36.043503 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-a3b85bd0-8032-4c50-a9c2-db78df52d1b2 None None] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.683288 Nov 01 18:54:36.045901 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 59/110] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Nov 1 18:54:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 18:54:36.375671 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-33768b38-670a-4e0f-82ad-e9638b33befb tempest-AggregatesAdminTestJSON-768412114 tempest-AggregatesAdminTestJSON-768412114-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:54:36.376785 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-33768b38-670a-4e0f-82ad-e9638b33befb tempest-AggregatesAdminTestJSON-768412114 tempest-AggregatesAdminTestJSON-768412114-project] [instance: 7967bf1f-943f-441d-befd-373868bbb3aa] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:54:36.384044 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-33768b38-670a-4e0f-82ad-e9638b33befb tempest-AggregatesAdminTestJSON-768412114 tempest-AggregatesAdminTestJSON-768412114-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:54:36.388087 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-33768b38-670a-4e0f-82ad-e9638b33befb tempest-AggregatesAdminTestJSON-768412114 tempest-AggregatesAdminTestJSON-768412114-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:54:36.388531 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-33768b38-670a-4e0f-82ad-e9638b33befb tempest-AggregatesAdminTestJSON-768412114 tempest-AggregatesAdminTestJSON-768412114-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:54:36.390025 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-33768b38-670a-4e0f-82ad-e9638b33befb tempest-AggregatesAdminTestJSON-768412114 tempest-AggregatesAdminTestJSON-768412114-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:54:36.390025 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-33768b38-670a-4e0f-82ad-e9638b33befb tempest-AggregatesAdminTestJSON-768412114 tempest-AggregatesAdminTestJSON-768412114-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:54:36.390208 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-33768b38-670a-4e0f-82ad-e9638b33befb tempest-AggregatesAdminTestJSON-768412114 tempest-AggregatesAdminTestJSON-768412114-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:54:36.796546 n-d-863052-2 devstack@n-api.service[121402]: DEBUG dbcounter [-] [121402] Writing DB stats nova_cell0:SELECT=6 {{(pid=121402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 18:54:36.809675 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-1f24a9ed-25f0-4d2d-9a50-0353b498d0f6 tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:54:36.818167 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-1f24a9ed-25f0-4d2d-9a50-0353b498d0f6 tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] [instance: 4ebac531-6f77-4108-afc9-0eccb86dee8b] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:54:36.860875 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-1f24a9ed-25f0-4d2d-9a50-0353b498d0f6 tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:54:36.862335 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-1f24a9ed-25f0-4d2d-9a50-0353b498d0f6 tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:54:36.863591 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-1f24a9ed-25f0-4d2d-9a50-0353b498d0f6 tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:54:36.865143 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-1f24a9ed-25f0-4d2d-9a50-0353b498d0f6 tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:54:36.870316 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-1f24a9ed-25f0-4d2d-9a50-0353b498d0f6 tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:54:36.873150 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-1f24a9ed-25f0-4d2d-9a50-0353b498d0f6 tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:54:37.734627 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-33768b38-670a-4e0f-82ad-e9638b33befb tempest-AggregatesAdminTestJSON-768412114 tempest-AggregatesAdminTestJSON-768412114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439a7ac2509640c49361f9ba6636b34d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8382e1376b104295aa5cef36ba07cf45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:54:37.778894 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-33768b38-670a-4e0f-82ad-e9638b33befb tempest-AggregatesAdminTestJSON-768412114 tempest-AggregatesAdminTestJSON-768412114-project] 10.222.0.13 "GET /compute/v2.1/servers/7967bf1f-943f-441d-befd-373868bbb3aa" status: 200 len: 1338 microversion: 2.1 time: 1.405624 Nov 01 18:54:37.780610 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 52/111] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:54:36 2022] GET /compute/v2.1/servers/7967bf1f-943f-441d-befd-373868bbb3aa => generated 1338 bytes in 1410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:54:38.111785 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [req-3be5f1db-17b0-4b3c-9194-3ca93805e6ef req-ad7d9eb1-cc57-4fee-bb1c-60a63969517f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7967bf1f-943f-441d-befd-373868bbb3aa", "tag": "963ab751-05a7-4de6-a06a-12599013a0d2"}]} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 18:54:38.135617 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-3be5f1db-17b0-4b3c-9194-3ca93805e6ef req-ad7d9eb1-cc57-4fee-bb1c-60a63969517f service nova] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:54:38.136066 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-1f24a9ed-25f0-4d2d-9a50-0353b498d0f6 tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce2e0d1828674809a3344a7a68f375c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8e1248497284006a7acbb8169627ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:54:38.139376 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-3be5f1db-17b0-4b3c-9194-3ca93805e6ef req-ad7d9eb1-cc57-4fee-bb1c-60a63969517f service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:54:38.144671 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-3be5f1db-17b0-4b3c-9194-3ca93805e6ef req-ad7d9eb1-cc57-4fee-bb1c-60a63969517f service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:54:38.147344 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-1f24a9ed-25f0-4d2d-9a50-0353b498d0f6 tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] 10.222.0.13 "GET /compute/v2.1/servers/4ebac531-6f77-4108-afc9-0eccb86dee8b" status: 200 len: 1341 microversion: 2.1 time: 1.352099 Nov 01 18:54:38.150195 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 60/112] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:54:36 2022] GET /compute/v2.1/servers/4ebac531-6f77-4108-afc9-0eccb86dee8b => generated 1341 bytes in 1356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:54:38.202937 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.compute.server_external_events [req-3be5f1db-17b0-4b3c-9194-3ca93805e6ef req-ad7d9eb1-cc57-4fee-bb1c-60a63969517f service nova] Creating event network-changed:963ab751-05a7-4de6-a06a-12599013a0d2 for instance 7967bf1f-943f-441d-befd-373868bbb3aa on n-h1-863052-2 Nov 01 18:54:38.205746 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-3be5f1db-17b0-4b3c-9194-3ca93805e6ef req-ad7d9eb1-cc57-4fee-bb1c-60a63969517f service nova] Acquiring lock "compute-rpcapi-router" {{(pid=121403) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Nov 01 18:54:38.209190 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-3be5f1db-17b0-4b3c-9194-3ca93805e6ef req-ad7d9eb1-cc57-4fee-bb1c-60a63969517f service nova] Acquired lock "compute-rpcapi-router" {{(pid=121403) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Nov 01 18:54:38.210476 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-c684a447-53e8-4db1-9211-8b9cd93cf32c None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:54:38.211758 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-c684a447-53e8-4db1-9211-8b9cd93cf32c None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:54:38.212378 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-c684a447-53e8-4db1-9211-8b9cd93cf32c None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:54:38.215871 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-c684a447-53e8-4db1-9211-8b9cd93cf32c None None] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:54:38.216497 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-c684a447-53e8-4db1-9211-8b9cd93cf32c None None] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:54:38.217100 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-c684a447-53e8-4db1-9211-8b9cd93cf32c None None] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:54:38.239123 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.compute.rpcapi [None req-c684a447-53e8-4db1-9211-8b9cd93cf32c None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Nov 01 18:54:38.241882 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-c684a447-53e8-4db1-9211-8b9cd93cf32c None None] Releasing lock "compute-rpcapi-router" {{(pid=121403) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Nov 01 18:54:38.271288 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-c684a447-53e8-4db1-9211-8b9cd93cf32c None None] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.163545 Nov 01 18:54:38.275575 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 53/113] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Nov 1 18:54:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 01 18:54:38.812875 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-a0d72dcd-044e-4e43-a03e-31a99adf7f46 tempest-AggregatesAdminTestJSON-768412114 tempest-AggregatesAdminTestJSON-768412114-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:54:38.812875 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-a0d72dcd-044e-4e43-a03e-31a99adf7f46 tempest-AggregatesAdminTestJSON-768412114 tempest-AggregatesAdminTestJSON-768412114-project] [instance: 7967bf1f-943f-441d-befd-373868bbb3aa] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:54:38.828058 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-a0d72dcd-044e-4e43-a03e-31a99adf7f46 tempest-AggregatesAdminTestJSON-768412114 tempest-AggregatesAdminTestJSON-768412114-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:54:38.828563 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-a0d72dcd-044e-4e43-a03e-31a99adf7f46 tempest-AggregatesAdminTestJSON-768412114 tempest-AggregatesAdminTestJSON-768412114-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:54:38.829019 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-a0d72dcd-044e-4e43-a03e-31a99adf7f46 tempest-AggregatesAdminTestJSON-768412114 tempest-AggregatesAdminTestJSON-768412114-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:54:38.829715 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-a0d72dcd-044e-4e43-a03e-31a99adf7f46 tempest-AggregatesAdminTestJSON-768412114 tempest-AggregatesAdminTestJSON-768412114-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:54:38.833244 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-a0d72dcd-044e-4e43-a03e-31a99adf7f46 tempest-AggregatesAdminTestJSON-768412114 tempest-AggregatesAdminTestJSON-768412114-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:54:38.833882 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-a0d72dcd-044e-4e43-a03e-31a99adf7f46 tempest-AggregatesAdminTestJSON-768412114 tempest-AggregatesAdminTestJSON-768412114-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:54:39.176182 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-827badd3-abc9-4419-ac95-e4020283e3cb tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:54:39.186779 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-827badd3-abc9-4419-ac95-e4020283e3cb tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] [instance: 4ebac531-6f77-4108-afc9-0eccb86dee8b] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:54:39.202197 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-827badd3-abc9-4419-ac95-e4020283e3cb tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:54:39.205265 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-827badd3-abc9-4419-ac95-e4020283e3cb tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:54:39.205929 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-827badd3-abc9-4419-ac95-e4020283e3cb tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:54:39.206875 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-827badd3-abc9-4419-ac95-e4020283e3cb tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:54:39.214158 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-827badd3-abc9-4419-ac95-e4020283e3cb tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:54:39.232741 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-827badd3-abc9-4419-ac95-e4020283e3cb tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:54:39.781407 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-827badd3-abc9-4419-ac95-e4020283e3cb tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce2e0d1828674809a3344a7a68f375c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8e1248497284006a7acbb8169627ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:54:39.795737 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-827badd3-abc9-4419-ac95-e4020283e3cb tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] 10.222.0.13 "GET /compute/v2.1/servers/4ebac531-6f77-4108-afc9-0eccb86dee8b" status: 200 len: 1341 microversion: 2.1 time: 0.623930 Nov 01 18:54:39.800785 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 54/114] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:54:39 2022] GET /compute/v2.1/servers/4ebac531-6f77-4108-afc9-0eccb86dee8b => generated 1341 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:54:39.883847 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-a0d72dcd-044e-4e43-a03e-31a99adf7f46 tempest-AggregatesAdminTestJSON-768412114 tempest-AggregatesAdminTestJSON-768412114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439a7ac2509640c49361f9ba6636b34d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8382e1376b104295aa5cef36ba07cf45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:54:39.893723 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-a0d72dcd-044e-4e43-a03e-31a99adf7f46 tempest-AggregatesAdminTestJSON-768412114 tempest-AggregatesAdminTestJSON-768412114-project] 10.222.0.13 "GET /compute/v2.1/servers/7967bf1f-943f-441d-befd-373868bbb3aa" status: 200 len: 1338 microversion: 2.1 time: 1.089336 Nov 01 18:54:39.910661 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 61/115] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:54:38 2022] GET /compute/v2.1/servers/7967bf1f-943f-441d-befd-373868bbb3aa => generated 1338 bytes in 1107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:54:40.833702 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-25164ca5-f49f-40b1-b434-1a2788549219 tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:54:40.834314 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-25164ca5-f49f-40b1-b434-1a2788549219 tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] [instance: 4ebac531-6f77-4108-afc9-0eccb86dee8b] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:54:40.846611 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-25164ca5-f49f-40b1-b434-1a2788549219 tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:54:40.847369 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-25164ca5-f49f-40b1-b434-1a2788549219 tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:54:40.849070 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-25164ca5-f49f-40b1-b434-1a2788549219 tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:54:40.851073 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-25164ca5-f49f-40b1-b434-1a2788549219 tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:54:40.852726 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-25164ca5-f49f-40b1-b434-1a2788549219 tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:54:40.853516 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-25164ca5-f49f-40b1-b434-1a2788549219 tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:54:40.916959 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-76b8a80d-55ef-4060-b740-d6ab65109e81 tempest-AggregatesAdminTestJSON-768412114 tempest-AggregatesAdminTestJSON-768412114-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:54:40.917591 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-76b8a80d-55ef-4060-b740-d6ab65109e81 tempest-AggregatesAdminTestJSON-768412114 tempest-AggregatesAdminTestJSON-768412114-project] [instance: 7967bf1f-943f-441d-befd-373868bbb3aa] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:54:40.923667 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-76b8a80d-55ef-4060-b740-d6ab65109e81 tempest-AggregatesAdminTestJSON-768412114 tempest-AggregatesAdminTestJSON-768412114-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:54:40.932841 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-76b8a80d-55ef-4060-b740-d6ab65109e81 tempest-AggregatesAdminTestJSON-768412114 tempest-AggregatesAdminTestJSON-768412114-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:54:40.933325 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-76b8a80d-55ef-4060-b740-d6ab65109e81 tempest-AggregatesAdminTestJSON-768412114 tempest-AggregatesAdminTestJSON-768412114-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:54:40.934066 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-76b8a80d-55ef-4060-b740-d6ab65109e81 tempest-AggregatesAdminTestJSON-768412114 tempest-AggregatesAdminTestJSON-768412114-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:54:40.934507 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-76b8a80d-55ef-4060-b740-d6ab65109e81 tempest-AggregatesAdminTestJSON-768412114 tempest-AggregatesAdminTestJSON-768412114-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:54:40.941092 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-76b8a80d-55ef-4060-b740-d6ab65109e81 tempest-AggregatesAdminTestJSON-768412114 tempest-AggregatesAdminTestJSON-768412114-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:54:41.150024 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-25164ca5-f49f-40b1-b434-1a2788549219 tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce2e0d1828674809a3344a7a68f375c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8e1248497284006a7acbb8169627ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:54:41.164378 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-25164ca5-f49f-40b1-b434-1a2788549219 tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] 10.222.0.13 "GET /compute/v2.1/servers/4ebac531-6f77-4108-afc9-0eccb86dee8b" status: 200 len: 1341 microversion: 2.1 time: 0.335173 Nov 01 18:54:41.165005 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 55/116] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:54:40 2022] GET /compute/v2.1/servers/4ebac531-6f77-4108-afc9-0eccb86dee8b => generated 1341 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:54:41.420478 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-76b8a80d-55ef-4060-b740-d6ab65109e81 tempest-AggregatesAdminTestJSON-768412114 tempest-AggregatesAdminTestJSON-768412114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439a7ac2509640c49361f9ba6636b34d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8382e1376b104295aa5cef36ba07cf45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:54:41.435095 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-76b8a80d-55ef-4060-b740-d6ab65109e81 tempest-AggregatesAdminTestJSON-768412114 tempest-AggregatesAdminTestJSON-768412114-project] 10.222.0.13 "GET /compute/v2.1/servers/7967bf1f-943f-441d-befd-373868bbb3aa" status: 200 len: 1338 microversion: 2.1 time: 0.516910 Nov 01 18:54:41.436174 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 62/117] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:54:40 2022] GET /compute/v2.1/servers/7967bf1f-943f-441d-befd-373868bbb3aa => generated 1338 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:54:42.191439 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-62298030-489c-43f2-b55f-402f42f6351a tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:54:42.192880 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-62298030-489c-43f2-b55f-402f42f6351a tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] [instance: 4ebac531-6f77-4108-afc9-0eccb86dee8b] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:54:42.203641 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-62298030-489c-43f2-b55f-402f42f6351a tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:54:42.205858 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-62298030-489c-43f2-b55f-402f42f6351a tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:54:42.207036 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-62298030-489c-43f2-b55f-402f42f6351a tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:54:42.209310 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-62298030-489c-43f2-b55f-402f42f6351a tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:54:42.211029 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-62298030-489c-43f2-b55f-402f42f6351a tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:54:42.215053 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-62298030-489c-43f2-b55f-402f42f6351a tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:54:42.459877 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-beffc016-ffcb-4a67-8f81-9e75f0cbca73 tempest-AggregatesAdminTestJSON-768412114 tempest-AggregatesAdminTestJSON-768412114-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:54:42.460721 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-beffc016-ffcb-4a67-8f81-9e75f0cbca73 tempest-AggregatesAdminTestJSON-768412114 tempest-AggregatesAdminTestJSON-768412114-project] [instance: 7967bf1f-943f-441d-befd-373868bbb3aa] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:54:42.473586 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-beffc016-ffcb-4a67-8f81-9e75f0cbca73 tempest-AggregatesAdminTestJSON-768412114 tempest-AggregatesAdminTestJSON-768412114-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:54:42.474721 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-beffc016-ffcb-4a67-8f81-9e75f0cbca73 tempest-AggregatesAdminTestJSON-768412114 tempest-AggregatesAdminTestJSON-768412114-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:54:42.480051 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-beffc016-ffcb-4a67-8f81-9e75f0cbca73 tempest-AggregatesAdminTestJSON-768412114 tempest-AggregatesAdminTestJSON-768412114-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:54:42.482738 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-beffc016-ffcb-4a67-8f81-9e75f0cbca73 tempest-AggregatesAdminTestJSON-768412114 tempest-AggregatesAdminTestJSON-768412114-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:54:42.484574 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-beffc016-ffcb-4a67-8f81-9e75f0cbca73 tempest-AggregatesAdminTestJSON-768412114 tempest-AggregatesAdminTestJSON-768412114-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:54:42.485478 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-beffc016-ffcb-4a67-8f81-9e75f0cbca73 tempest-AggregatesAdminTestJSON-768412114 tempest-AggregatesAdminTestJSON-768412114-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:54:42.492768 n-d-863052-2 devstack@n-api.service[121402]: DEBUG dbcounter [-] [121402] Writing DB stats nova_cell1:SELECT=100 {{(pid=121402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 18:54:42.544545 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-62298030-489c-43f2-b55f-402f42f6351a tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce2e0d1828674809a3344a7a68f375c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8e1248497284006a7acbb8169627ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:54:42.554732 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-62298030-489c-43f2-b55f-402f42f6351a tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] 10.222.0.13 "GET /compute/v2.1/servers/4ebac531-6f77-4108-afc9-0eccb86dee8b" status: 200 len: 1341 microversion: 2.1 time: 0.367562 Nov 01 18:54:42.558939 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 56/118] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:54:42 2022] GET /compute/v2.1/servers/4ebac531-6f77-4108-afc9-0eccb86dee8b => generated 1341 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 18:54:43.190261 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-beffc016-ffcb-4a67-8f81-9e75f0cbca73 tempest-AggregatesAdminTestJSON-768412114 tempest-AggregatesAdminTestJSON-768412114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439a7ac2509640c49361f9ba6636b34d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8382e1376b104295aa5cef36ba07cf45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:54:43.204431 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-beffc016-ffcb-4a67-8f81-9e75f0cbca73 tempest-AggregatesAdminTestJSON-768412114 tempest-AggregatesAdminTestJSON-768412114-project] 10.222.0.13 "GET /compute/v2.1/servers/7967bf1f-943f-441d-befd-373868bbb3aa" status: 200 len: 1338 microversion: 2.1 time: 0.749175 Nov 01 18:54:43.205628 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 63/119] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:54:42 2022] GET /compute/v2.1/servers/7967bf1f-943f-441d-befd-373868bbb3aa => generated 1338 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:54:43.300088 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-0eeee4ff-5b5d-4788-8959-d399ceb4c592 tempest-FlavorsAccessTestJSON-563431774 tempest-FlavorsAccessTestJSON-563431774-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-591303242", "id": 39529427, "os-flavor-access:is_public": "False"}} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 18:54:43.355959 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-0eeee4ff-5b5d-4788-8959-d399ceb4c592 tempest-FlavorsAccessTestJSON-563431774 tempest-FlavorsAccessTestJSON-563431774-project-admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 424 microversion: 2.1 time: 0.504240 Nov 01 18:54:43.357939 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 57/120] 10.222.0.13 () {60 vars in 1147 bytes} [Tue Nov 1 18:54:42 2022] POST /compute/v2.1/flavors => generated 424 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 01 18:54:43.371931 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-fb0a7bbf-d572-4dfa-9323-5e79dcc87ebe tempest-FlavorsAccessTestJSON-563431774 tempest-FlavorsAccessTestJSON-563431774-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "33f5beecaf464abd80720e609dc3c93d"}} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 18:54:43.584943 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-6327f104-cd4e-44db-97de-8e4ab886db4d tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:54:43.585803 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-6327f104-cd4e-44db-97de-8e4ab886db4d tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] [instance: 4ebac531-6f77-4108-afc9-0eccb86dee8b] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:54:43.599664 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-6327f104-cd4e-44db-97de-8e4ab886db4d tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:54:43.600326 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-6327f104-cd4e-44db-97de-8e4ab886db4d tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:54:43.600793 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-6327f104-cd4e-44db-97de-8e4ab886db4d tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:54:43.601512 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-6327f104-cd4e-44db-97de-8e4ab886db4d tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:54:43.604836 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-6327f104-cd4e-44db-97de-8e4ab886db4d tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:54:43.605297 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-6327f104-cd4e-44db-97de-8e4ab886db4d tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:54:43.836856 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-6327f104-cd4e-44db-97de-8e4ab886db4d tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce2e0d1828674809a3344a7a68f375c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8e1248497284006a7acbb8169627ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:54:43.849003 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-6327f104-cd4e-44db-97de-8e4ab886db4d tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] 10.222.0.13 "GET /compute/v2.1/servers/4ebac531-6f77-4108-afc9-0eccb86dee8b" status: 200 len: 1341 microversion: 2.1 time: 0.270059 Nov 01 18:54:43.850214 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 58/121] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:54:43 2022] GET /compute/v2.1/servers/4ebac531-6f77-4108-afc9-0eccb86dee8b => generated 1341 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 18:54:43.923376 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-fb0a7bbf-d572-4dfa-9323-5e79dcc87ebe tempest-FlavorsAccessTestJSON-563431774 tempest-FlavorsAccessTestJSON-563431774-project-admin] 10.222.0.13 "POST /compute/v2.1/flavors/39529427/action" status: 200 len: 95 microversion: 2.1 time: 0.556845 Nov 01 18:54:43.924873 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 64/122] 10.222.0.13 () {60 vars in 1194 bytes} [Tue Nov 1 18:54:43 2022] POST /compute/v2.1/flavors/39529427/action => generated 95 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 01 18:54:44.190648 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-178bca0f-713a-4510-ae18-546f90595e11 tempest-FlavorsAccessTestJSON-1658279288 tempest-FlavorsAccessTestJSON-1658279288-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:54:44.231681 n-d-863052-2 devstack@n-api.service[121403]: DEBUG dbcounter [-] [121403] Writing DB stats nova_api:SELECT=85,nova_api:DELETE=10,nova_api:INSERT=5 {{(pid=121403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 18:54:44.244855 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-178bca0f-713a-4510-ae18-546f90595e11 tempest-FlavorsAccessTestJSON-1658279288 tempest-FlavorsAccessTestJSON-1658279288-project] 10.222.0.13 "GET /compute/v2.1/flavors/detail" status: 200 len: 5405 microversion: 2.1 time: 0.313072 Nov 01 18:54:44.246249 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 59/123] 10.222.0.13 () {58 vars in 1146 bytes} [Tue Nov 1 18:54:43 2022] GET /compute/v2.1/flavors/detail => generated 5405 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:54:44.266967 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-ef0fd871-6bad-4971-ab03-abb3c8d62011 tempest-AggregatesAdminTestJSON-768412114 tempest-AggregatesAdminTestJSON-768412114-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:54:44.268913 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-ef0fd871-6bad-4971-ab03-abb3c8d62011 tempest-AggregatesAdminTestJSON-768412114 tempest-AggregatesAdminTestJSON-768412114-project] [instance: 7967bf1f-943f-441d-befd-373868bbb3aa] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:54:44.285788 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-ef0fd871-6bad-4971-ab03-abb3c8d62011 tempest-AggregatesAdminTestJSON-768412114 tempest-AggregatesAdminTestJSON-768412114-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:54:44.286431 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-ef0fd871-6bad-4971-ab03-abb3c8d62011 tempest-AggregatesAdminTestJSON-768412114 tempest-AggregatesAdminTestJSON-768412114-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:54:44.287966 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-ef0fd871-6bad-4971-ab03-abb3c8d62011 tempest-AggregatesAdminTestJSON-768412114 tempest-AggregatesAdminTestJSON-768412114-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:54:44.288851 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-ef0fd871-6bad-4971-ab03-abb3c8d62011 tempest-AggregatesAdminTestJSON-768412114 tempest-AggregatesAdminTestJSON-768412114-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:54:44.291521 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-ef0fd871-6bad-4971-ab03-abb3c8d62011 tempest-AggregatesAdminTestJSON-768412114 tempest-AggregatesAdminTestJSON-768412114-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:54:44.292714 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-ef0fd871-6bad-4971-ab03-abb3c8d62011 tempest-AggregatesAdminTestJSON-768412114 tempest-AggregatesAdminTestJSON-768412114-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:54:44.610930 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-ef0fd871-6bad-4971-ab03-abb3c8d62011 tempest-AggregatesAdminTestJSON-768412114 tempest-AggregatesAdminTestJSON-768412114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439a7ac2509640c49361f9ba6636b34d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8382e1376b104295aa5cef36ba07cf45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:54:44.619694 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-5a5e574d-cef0-44ae-872f-bd3ebc038dac tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:54:44.623459 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-ef0fd871-6bad-4971-ab03-abb3c8d62011 tempest-AggregatesAdminTestJSON-768412114 tempest-AggregatesAdminTestJSON-768412114-project] 10.222.0.13 "GET /compute/v2.1/servers/7967bf1f-943f-441d-befd-373868bbb3aa" status: 200 len: 1338 microversion: 2.1 time: 0.375672 Nov 01 18:54:44.624511 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 60/124] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:54:44 2022] GET /compute/v2.1/servers/7967bf1f-943f-441d-befd-373868bbb3aa => generated 1338 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:54:44.629153 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-ae7d842f-bac1-4e33-a6ae-04dd0fa506c0 tempest-FlavorsAccessTestJSON-563431774 tempest-FlavorsAccessTestJSON-563431774-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "33f5beecaf464abd80720e609dc3c93d"}} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 18:54:44.655189 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-5a5e574d-cef0-44ae-872f-bd3ebc038dac tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] 10.222.0.13 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.530748 Nov 01 18:54:44.664854 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 65/125] 10.222.0.13 () {58 vars in 1137 bytes} [Tue Nov 1 18:54:44 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 01 18:54:45.067130 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-b59bfa85-689a-4eec-955e-a37df6e68d60 tempest-ServersWithSpecificFlavorTestJSON-733859443 tempest-ServersWithSpecificFlavorTestJSON-733859443-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_1-1163490086", "id": 1548779625, "OS-FLV-EXT-DATA:ephemeral": 1, "os-flavor-access:is_public": "True"}} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 18:54:45.100663 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-b59bfa85-689a-4eec-955e-a37df6e68d60 tempest-ServersWithSpecificFlavorTestJSON-733859443 tempest-ServersWithSpecificFlavorTestJSON-733859443-project-admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 425 microversion: 2.1 time: 0.432052 Nov 01 18:54:45.111489 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 66/126] 10.222.0.13 () {60 vars in 1147 bytes} [Tue Nov 1 18:54:44 2022] POST /compute/v2.1/flavors => generated 425 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 01 18:54:45.220855 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-ae7d842f-bac1-4e33-a6ae-04dd0fa506c0 tempest-FlavorsAccessTestJSON-563431774 tempest-FlavorsAccessTestJSON-563431774-project-admin] 10.222.0.13 "POST /compute/v2.1/flavors/39529427/action" status: 200 len: 21 microversion: 2.1 time: 0.595100 Nov 01 18:54:45.222492 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 61/127] 10.222.0.13 () {60 vars in 1194 bytes} [Tue Nov 1 18:54:44 2022] POST /compute/v2.1/flavors/39529427/action => generated 21 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 01 18:54:45.231219 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-d560b453-fbc6-46cf-a08b-a41873618539 tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:54:45.232070 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-d560b453-fbc6-46cf-a08b-a41873618539 tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] [instance: 4ebac531-6f77-4108-afc9-0eccb86dee8b] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:54:45.248552 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d560b453-fbc6-46cf-a08b-a41873618539 tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:54:45.249351 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d560b453-fbc6-46cf-a08b-a41873618539 tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:54:45.250559 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d560b453-fbc6-46cf-a08b-a41873618539 tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:54:45.254055 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d560b453-fbc6-46cf-a08b-a41873618539 tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:54:45.255658 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d560b453-fbc6-46cf-a08b-a41873618539 tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:54:45.256746 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d560b453-fbc6-46cf-a08b-a41873618539 tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:54:45.394180 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-3436874d-492b-4ac9-be26-c7ff3c8d3326 tempest-FlavorsExtraSpecsTestJSON-970971914 tempest-FlavorsExtraSpecsTestJSON-970971914-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-851085512", "ram": 512, "vcpus": 1, "disk": 10, "id": 1285727622, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 18:54:45.428308 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-3436874d-492b-4ac9-be26-c7ff3c8d3326 tempest-FlavorsExtraSpecsTestJSON-970971914 tempest-FlavorsExtraSpecsTestJSON-970971914-project-admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 415 microversion: 2.1 time: 0.314898 Nov 01 18:54:45.430132 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 67/128] 10.222.0.13 () {60 vars in 1147 bytes} [Tue Nov 1 18:54:45 2022] POST /compute/v2.1/flavors => generated 415 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 18:54:45.434988 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-5cff6aea-97fe-4c64-84ec-90cb15e12b59 tempest-ServersWithSpecificFlavorTestJSON-733859443 tempest-ServersWithSpecificFlavorTestJSON-733859443-project-admin] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:54:45.442940 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-5cff6aea-97fe-4c64-84ec-90cb15e12b59 tempest-ServersWithSpecificFlavorTestJSON-733859443 tempest-ServersWithSpecificFlavorTestJSON-733859443-project-admin] 10.222.0.13 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.011532 Nov 01 18:54:45.448951 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 68/129] 10.222.0.13 () {58 vars in 1182 bytes} [Tue Nov 1 18:54:45 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 01 18:54:45.454469 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-0fd8626a-6444-421c-8de6-80a9d533b7d7 tempest-FlavorsAccessTestJSON-1658279288 tempest-FlavorsAccessTestJSON-1658279288-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:54:45.498869 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-0fd8626a-6444-421c-8de6-80a9d533b7d7 tempest-FlavorsAccessTestJSON-1658279288 tempest-FlavorsAccessTestJSON-1658279288-project] 10.222.0.13 "GET /compute/v2.1/flavors/detail" status: 200 len: 5811 microversion: 2.1 time: 0.048366 Nov 01 18:54:45.500721 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 69/130] 10.222.0.13 () {58 vars in 1146 bytes} [Tue Nov 1 18:54:45 2022] GET /compute/v2.1/flavors/detail => generated 5811 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:54:45.505825 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-96423f19-a947-4bbd-b604-802294da60cb tempest-FlavorsExtraSpecsTestJSON-970971914 tempest-FlavorsExtraSpecsTestJSON-970971914-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 18:54:45.516929 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-d560b453-fbc6-46cf-a08b-a41873618539 tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce2e0d1828674809a3344a7a68f375c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8e1248497284006a7acbb8169627ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:54:45.535076 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-d560b453-fbc6-46cf-a08b-a41873618539 tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] 10.222.0.13 "GET /compute/v2.1/servers/4ebac531-6f77-4108-afc9-0eccb86dee8b" status: 200 len: 1341 microversion: 2.1 time: 0.310569 Nov 01 18:54:45.535776 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 62/131] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:54:45 2022] GET /compute/v2.1/servers/4ebac531-6f77-4108-afc9-0eccb86dee8b => generated 1341 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:54:45.542831 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-026397c2-fb1f-45c9-a025-ef5ecf026b03 tempest-ServersWithSpecificFlavorTestJSON-733859443 tempest-ServersWithSpecificFlavorTestJSON-733859443-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_0-1839036969", "id": 835338155, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": "True"}} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 18:54:45.543532 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-96423f19-a947-4bbd-b604-802294da60cb tempest-FlavorsExtraSpecsTestJSON-970971914 tempest-FlavorsExtraSpecsTestJSON-970971914-project-admin] 10.222.0.13 "POST /compute/v2.1/flavors/1285727622/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.041379 Nov 01 18:54:45.544157 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 70/132] 10.222.0.13 () {60 vars in 1224 bytes} [Tue Nov 1 18:54:45 2022] POST /compute/v2.1/flavors/1285727622/os-extra_specs => generated 66 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 01 18:54:45.553282 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-119fb5bf-b9af-4305-973a-46f2219a0885 tempest-FlavorsAccessTestJSON-563431774 tempest-FlavorsAccessTestJSON-563431774-project-admin] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:54:45.579867 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-026397c2-fb1f-45c9-a025-ef5ecf026b03 tempest-ServersWithSpecificFlavorTestJSON-733859443 tempest-ServersWithSpecificFlavorTestJSON-733859443-project-admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 422 microversion: 2.1 time: 0.043025 Nov 01 18:54:45.580789 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 63/133] 10.222.0.13 () {60 vars in 1147 bytes} [Tue Nov 1 18:54:45 2022] POST /compute/v2.1/flavors => generated 422 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 18:54:45.591933 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-119fb5bf-b9af-4305-973a-46f2219a0885 tempest-FlavorsAccessTestJSON-563431774 tempest-FlavorsAccessTestJSON-563431774-project-admin] 10.222.0.13 "DELETE /compute/v2.1/flavors/39529427" status: 202 len: 0 microversion: 2.1 time: 0.046409 Nov 01 18:54:45.592895 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 71/134] 10.222.0.13 () {58 vars in 1155 bytes} [Tue Nov 1 18:54:45 2022] DELETE /compute/v2.1/flavors/39529427 => generated 0 bytes in 48 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 01 18:54:45.723409 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-d7c58620-94d1-4f11-a71d-9f991d5cb8c6 tempest-HypervisorAdminV228Test-992884266 tempest-HypervisorAdminV228Test-992884266-project-admin] Calling method '.version_select at 0x7f0ae309ec10>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:54:45.725360 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d7c58620-94d1-4f11-a71d-9f991d5cb8c6 tempest-HypervisorAdminV228Test-992884266 tempest-HypervisorAdminV228Test-992884266-project-admin] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:54:45.725956 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d7c58620-94d1-4f11-a71d-9f991d5cb8c6 tempest-HypervisorAdminV228Test-992884266 tempest-HypervisorAdminV228Test-992884266-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:54:45.726502 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d7c58620-94d1-4f11-a71d-9f991d5cb8c6 tempest-HypervisorAdminV228Test-992884266 tempest-HypervisorAdminV228Test-992884266-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:54:45.746839 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d7c58620-94d1-4f11-a71d-9f991d5cb8c6 tempest-HypervisorAdminV228Test-992884266 tempest-HypervisorAdminV228Test-992884266-project-admin] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:54:45.747437 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d7c58620-94d1-4f11-a71d-9f991d5cb8c6 tempest-HypervisorAdminV228Test-992884266 tempest-HypervisorAdminV228Test-992884266-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:54:45.747978 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d7c58620-94d1-4f11-a71d-9f991d5cb8c6 tempest-HypervisorAdminV228Test-992884266 tempest-HypervisorAdminV228Test-992884266-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:54:45.763559 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d7c58620-94d1-4f11-a71d-9f991d5cb8c6 tempest-HypervisorAdminV228Test-992884266 tempest-HypervisorAdminV228Test-992884266-project-admin] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:54:45.764177 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d7c58620-94d1-4f11-a71d-9f991d5cb8c6 tempest-HypervisorAdminV228Test-992884266 tempest-HypervisorAdminV228Test-992884266-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:54:45.764729 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d7c58620-94d1-4f11-a71d-9f991d5cb8c6 tempest-HypervisorAdminV228Test-992884266 tempest-HypervisorAdminV228Test-992884266-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:54:45.773598 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-d7c58620-94d1-4f11-a71d-9f991d5cb8c6 tempest-HypervisorAdminV228Test-992884266 tempest-HypervisorAdminV228Test-992884266-project-admin] 10.222.0.13 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.28 time: 0.191511 Nov 01 18:54:45.782179 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 64/135] 10.222.0.13 () {60 vars in 1187 bytes} [Tue Nov 1 18:54:45 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 01 18:54:45.787149 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-be63497a-fcd5-4a40-9983-0a1c1ac48183 tempest-ServersWithSpecificFlavorTestJSON-733859443 tempest-ServersWithSpecificFlavorTestJSON-733859443-project-admin] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:54:45.802521 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-be63497a-fcd5-4a40-9983-0a1c1ac48183 tempest-ServersWithSpecificFlavorTestJSON-733859443 tempest-ServersWithSpecificFlavorTestJSON-733859443-project-admin] 10.222.0.13 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.018819 Nov 01 18:54:45.804046 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 65/136] 10.222.0.13 () {58 vars in 1182 bytes} [Tue Nov 1 18:54:45 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 01 18:54:45.819208 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-aa6e3e9b-6237-4425-8921-b925607e75a3 tempest-FlavorsAccessTestJSON-563431774 tempest-FlavorsAccessTestJSON-563431774-project-admin] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:54:45.841250 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-7c52168b-efdf-4093-b8ff-82f3c276ea3b tempest-FlavorsExtraSpecsTestJSON-2040590947 tempest-FlavorsExtraSpecsTestJSON-2040590947-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:54:45.851386 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-7c52168b-efdf-4093-b8ff-82f3c276ea3b tempest-FlavorsExtraSpecsTestJSON-2040590947 tempest-FlavorsExtraSpecsTestJSON-2040590947-project] 10.222.0.13 "GET /compute/v2.1/flavors/1285727622/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.257188 Nov 01 18:54:45.852678 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 72/137] 10.222.0.13 () {58 vars in 1203 bytes} [Tue Nov 1 18:54:45 2022] GET /compute/v2.1/flavors/1285727622/os-extra_specs => generated 66 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 01 18:54:45.858559 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-9bb8a829-8ce2-4628-917f-acff589f73b9 tempest-AggregatesAdminTestJSON-768412114 tempest-AggregatesAdminTestJSON-768412114-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:54:45.859616 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-9bb8a829-8ce2-4628-917f-acff589f73b9 tempest-AggregatesAdminTestJSON-768412114 tempest-AggregatesAdminTestJSON-768412114-project] [instance: 7967bf1f-943f-441d-befd-373868bbb3aa] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:54:45.860517 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-aa6e3e9b-6237-4425-8921-b925607e75a3 tempest-FlavorsAccessTestJSON-563431774 tempest-FlavorsAccessTestJSON-563431774-project-admin] 10.222.0.13 "GET /compute/v2.1/flavors/detail" status: 200 len: 6223 microversion: 2.1 time: 0.054876 Nov 01 18:54:45.861429 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 66/138] 10.222.0.13 () {58 vars in 1146 bytes} [Tue Nov 1 18:54:45 2022] GET /compute/v2.1/flavors/detail => generated 6223 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:54:45.866885 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-d6d0a550-e626-445b-94a8-c73f73e82178 tempest-HypervisorAdminV228Test-992884266 tempest-HypervisorAdminV228Test-992884266-project-admin] Calling method '.version_select at 0x7f0ae3072940>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:54:45.869467 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-9bb8a829-8ce2-4628-917f-acff589f73b9 tempest-AggregatesAdminTestJSON-768412114 tempest-AggregatesAdminTestJSON-768412114-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:54:45.869773 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d6d0a550-e626-445b-94a8-c73f73e82178 tempest-HypervisorAdminV228Test-992884266 tempest-HypervisorAdminV228Test-992884266-project-admin] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:54:45.870269 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d6d0a550-e626-445b-94a8-c73f73e82178 tempest-HypervisorAdminV228Test-992884266 tempest-HypervisorAdminV228Test-992884266-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:54:45.870745 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d6d0a550-e626-445b-94a8-c73f73e82178 tempest-HypervisorAdminV228Test-992884266 tempest-HypervisorAdminV228Test-992884266-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:54:45.871137 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-9bb8a829-8ce2-4628-917f-acff589f73b9 tempest-AggregatesAdminTestJSON-768412114 tempest-AggregatesAdminTestJSON-768412114-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:54:45.871791 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-9bb8a829-8ce2-4628-917f-acff589f73b9 tempest-AggregatesAdminTestJSON-768412114 tempest-AggregatesAdminTestJSON-768412114-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:54:45.872881 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-9bb8a829-8ce2-4628-917f-acff589f73b9 tempest-AggregatesAdminTestJSON-768412114 tempest-AggregatesAdminTestJSON-768412114-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:54:45.873730 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-9bb8a829-8ce2-4628-917f-acff589f73b9 tempest-AggregatesAdminTestJSON-768412114 tempest-AggregatesAdminTestJSON-768412114-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:54:45.874363 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-9bb8a829-8ce2-4628-917f-acff589f73b9 tempest-AggregatesAdminTestJSON-768412114 tempest-AggregatesAdminTestJSON-768412114-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:54:45.882880 n-d-863052-2 devstack@n-api.service[121403]: DEBUG dbcounter [-] [121403] Writing DB stats nova_cell1:SELECT=100 {{(pid=121403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 18:54:45.892720 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d6d0a550-e626-445b-94a8-c73f73e82178 tempest-HypervisorAdminV228Test-992884266 tempest-HypervisorAdminV228Test-992884266-project-admin] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:54:45.893208 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d6d0a550-e626-445b-94a8-c73f73e82178 tempest-HypervisorAdminV228Test-992884266 tempest-HypervisorAdminV228Test-992884266-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:54:45.893637 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d6d0a550-e626-445b-94a8-c73f73e82178 tempest-HypervisorAdminV228Test-992884266 tempest-HypervisorAdminV228Test-992884266-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:54:45.902158 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-d6d0a550-e626-445b-94a8-c73f73e82178 tempest-HypervisorAdminV228Test-992884266 tempest-HypervisorAdminV228Test-992884266-project-admin] 10.222.0.13 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 718 microversion: 2.28 time: 0.039713 Nov 01 18:54:45.915415 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 67/139] 10.222.0.13 () {60 vars in 1193 bytes} [Tue Nov 1 18:54:45 2022] GET /compute/v2.1/os-hypervisors/1 => generated 718 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 01 18:54:45.926582 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-5d176efa-7b01-4d0c-8920-dd3c63a5738a tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Action: 'create', calling method: .version_select at 0x7f0ae30721f0>, body: {"keypair": {"name": "tempest-keypair-630059540", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMmapWZmLrEQ5LaUGcTiYVevPCJYg9AaU+OkNwqKhtlSXVi0jc2xgtFr5zmQbUy+fADUDe3673IQ815TyiXPrQsVZh8YnkYkfK1lBMUl9Wj7wsuqXtGZ3X7xx38lF74UVQ=="}} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 18:54:45.952223 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.quota [None req-5d176efa-7b01-4d0c-8920-dd3c63a5738a tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Getting quotas for project 9baf3860ba564f5c8dff93085b9aabe3. Resources: {'key_pairs'} {{(pid=121403) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 01 18:54:45.960451 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.quota [None req-5d176efa-7b01-4d0c-8920-dd3c63a5738a tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Getting quotas for user f07a2a96629f4baea6a3adfc4011ffe9 and project 9baf3860ba564f5c8dff93085b9aabe3. Resources: {'key_pairs'} {{(pid=121403) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 01 18:54:45.976114 n-d-863052-2 devstack@n-api.service[121402]: DEBUG dbcounter [-] [121402] Writing DB stats nova_cell0:SELECT=2 {{(pid=121402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 18:54:46.000707 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-5d176efa-7b01-4d0c-8920-dd3c63a5738a tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.078724 Nov 01 18:54:46.007736 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 68/140] 10.222.0.13 () {60 vars in 1159 bytes} [Tue Nov 1 18:54:45 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 18:54:46.013573 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-092581b3-e515-47cf-866b-63851649c88b tempest-FlavorsExtraSpecsTestJSON-970971914 tempest-FlavorsExtraSpecsTestJSON-970971914-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 18:54:46.076695 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-092581b3-e515-47cf-866b-63851649c88b tempest-FlavorsExtraSpecsTestJSON-970971914 tempest-FlavorsExtraSpecsTestJSON-970971914-project-admin] 10.222.0.13 "POST /compute/v2.1/flavors/1285727622/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.072504 Nov 01 18:54:46.082598 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 69/141] 10.222.0.13 () {60 vars in 1224 bytes} [Tue Nov 1 18:54:46 2022] POST /compute/v2.1/flavors/1285727622/os-extra_specs => generated 66 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 01 18:54:46.090672 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-416f8d68-8885-4d36-9984-dc08b4a0d3db tempest-FlavorsAccessTestJSON-563431774 tempest-FlavorsAccessTestJSON-563431774-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-117147171", "id": 194407865, "os-flavor-access:is_public": "False"}} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 18:54:46.121066 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-416f8d68-8885-4d36-9984-dc08b4a0d3db tempest-FlavorsAccessTestJSON-563431774 tempest-FlavorsAccessTestJSON-563431774-project-admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 427 microversion: 2.1 time: 0.035204 Nov 01 18:54:46.123107 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 70/142] 10.222.0.13 () {60 vars in 1147 bytes} [Tue Nov 1 18:54:46 2022] POST /compute/v2.1/flavors => generated 427 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 18:54:46.133365 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-1520b704-847e-40b4-8365-16bb3263283c tempest-FlavorsExtraSpecsTestJSON-2040590947 tempest-FlavorsExtraSpecsTestJSON-2040590947-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:54:46.150851 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-1520b704-847e-40b4-8365-16bb3263283c tempest-FlavorsExtraSpecsTestJSON-2040590947 tempest-FlavorsExtraSpecsTestJSON-2040590947-project] 10.222.0.13 "GET /compute/v2.1/flavors/1285727622/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.024666 Nov 01 18:54:46.152233 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 71/143] 10.222.0.13 () {58 vars in 1245 bytes} [Tue Nov 1 18:54:46 2022] GET /compute/v2.1/flavors/1285727622/os-extra_specs/hw:numa_nodes => generated 22 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 01 18:54:46.164923 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-33f35a87-f878-40b8-8a43-b6a3f74baf94 tempest-FlavorsAccessTestJSON-563431774 tempest-FlavorsAccessTestJSON-563431774-project-admin] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:54:46.166928 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-9bb8a829-8ce2-4628-917f-acff589f73b9 tempest-AggregatesAdminTestJSON-768412114 tempest-AggregatesAdminTestJSON-768412114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439a7ac2509640c49361f9ba6636b34d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8382e1376b104295aa5cef36ba07cf45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:54:46.176317 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-9bb8a829-8ce2-4628-917f-acff589f73b9 tempest-AggregatesAdminTestJSON-768412114 tempest-AggregatesAdminTestJSON-768412114-project] 10.222.0.13 "GET /compute/v2.1/servers/7967bf1f-943f-441d-befd-373868bbb3aa" status: 200 len: 1338 microversion: 2.1 time: 0.320872 Nov 01 18:54:46.178897 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 73/144] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:54:45 2022] GET /compute/v2.1/servers/7967bf1f-943f-441d-befd-373868bbb3aa => generated 1338 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:54:46.185272 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-33f35a87-f878-40b8-8a43-b6a3f74baf94 tempest-FlavorsAccessTestJSON-563431774 tempest-FlavorsAccessTestJSON-563431774-project-admin] 10.222.0.13 "GET /compute/v2.1/flavors/194407865/os-flavor-access" status: 200 len: 21 microversion: 2.1 time: 0.026139 Nov 01 18:54:46.186332 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 72/145] 10.222.0.13 () {58 vars in 1206 bytes} [Tue Nov 1 18:54:46 2022] GET /compute/v2.1/flavors/194407865/os-flavor-access => generated 21 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 01 18:54:46.188183 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-0177a18e-9644-474e-9122-0471235e3713 tempest-FlavorsExtraSpecsTestJSON-970971914 tempest-FlavorsExtraSpecsTestJSON-970971914-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 18:54:46.203444 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-f97c6cca-4867-473d-925a-d2b9db3e00ea tempest-FlavorsAccessTestJSON-563431774 tempest-FlavorsAccessTestJSON-563431774-project-admin] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:54:46.232214 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-f97c6cca-4867-473d-925a-d2b9db3e00ea tempest-FlavorsAccessTestJSON-563431774 tempest-FlavorsAccessTestJSON-563431774-project-admin] 10.222.0.13 "DELETE /compute/v2.1/flavors/194407865" status: 202 len: 0 microversion: 2.1 time: 0.039253 Nov 01 18:54:46.236024 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 73/146] 10.222.0.13 () {58 vars in 1158 bytes} [Tue Nov 1 18:54:46 2022] DELETE /compute/v2.1/flavors/194407865 => generated 0 bytes in 42 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 01 18:54:46.246169 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-afc103a7-0be1-40a6-896c-2f880a8059b1 tempest-FlavorsAccessTestJSON-563431774 tempest-FlavorsAccessTestJSON-563431774-project-admin] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:54:46.251115 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-0177a18e-9644-474e-9122-0471235e3713 tempest-FlavorsExtraSpecsTestJSON-970971914 tempest-FlavorsExtraSpecsTestJSON-970971914-project-admin] 10.222.0.13 "POST /compute/v2.1/flavors/1285727622/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.069989 Nov 01 18:54:46.252634 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 74/147] 10.222.0.13 () {60 vars in 1224 bytes} [Tue Nov 1 18:54:46 2022] POST /compute/v2.1/flavors/1285727622/os-extra_specs => generated 66 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 01 18:54:46.262656 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-b461d700-10b8-4701-b36f-580be76bf1e4 tempest-FlavorsExtraSpecsTestJSON-970971914 tempest-FlavorsExtraSpecsTestJSON-970971914-project-admin] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:54:46.274098 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-b461d700-10b8-4701-b36f-580be76bf1e4 tempest-FlavorsExtraSpecsTestJSON-970971914 tempest-FlavorsExtraSpecsTestJSON-970971914-project-admin] 10.222.0.13 "GET /compute/v2.1/flavors/1285727622/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.016051 Nov 01 18:54:46.275329 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 75/148] 10.222.0.13 () {58 vars in 1203 bytes} [Tue Nov 1 18:54:46 2022] GET /compute/v2.1/flavors/1285727622/os-extra_specs => generated 66 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 01 18:54:46.280186 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-afc103a7-0be1-40a6-896c-2f880a8059b1 tempest-FlavorsAccessTestJSON-563431774 tempest-FlavorsAccessTestJSON-563431774-project-admin] 10.222.0.13 "GET /compute/v2.1/flavors/detail" status: 200 len: 6223 microversion: 2.1 time: 0.042545 Nov 01 18:54:46.288692 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 74/149] 10.222.0.13 () {58 vars in 1146 bytes} [Tue Nov 1 18:54:46 2022] GET /compute/v2.1/flavors/detail => generated 6223 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:54:46.304710 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-ee4f2e38-fd92-485e-96a4-80ec5fb77ff6 tempest-FlavorsExtraSpecsTestJSON-970971914 tempest-FlavorsExtraSpecsTestJSON-970971914-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "2"} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 18:54:46.357048 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-ee4f2e38-fd92-485e-96a4-80ec5fb77ff6 tempest-FlavorsExtraSpecsTestJSON-970971914 tempest-FlavorsExtraSpecsTestJSON-970971914-project-admin] 10.222.0.13 "PUT /compute/v2.1/flavors/1285727622/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.061361 Nov 01 18:54:46.360858 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 76/150] 10.222.0.13 () {60 vars in 1265 bytes} [Tue Nov 1 18:54:46 2022] PUT /compute/v2.1/flavors/1285727622/os-extra_specs/hw:numa_nodes => generated 22 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 01 18:54:46.379382 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-e47106f1-fcf5-49aa-a1e9-b1efba0d2ab9 tempest-FlavorsExtraSpecsTestJSON-970971914 tempest-FlavorsExtraSpecsTestJSON-970971914-project-admin] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:54:46.398401 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-e47106f1-fcf5-49aa-a1e9-b1efba0d2ab9 tempest-FlavorsExtraSpecsTestJSON-970971914 tempest-FlavorsExtraSpecsTestJSON-970971914-project-admin] 10.222.0.13 "GET /compute/v2.1/flavors/1285727622/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.032260 Nov 01 18:54:46.404962 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 75/151] 10.222.0.13 () {58 vars in 1203 bytes} [Tue Nov 1 18:54:46 2022] GET /compute/v2.1/flavors/1285727622/os-extra_specs => generated 66 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 01 18:54:46.412614 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-9882e82e-0d2c-4c79-bbce-0555ac37718b tempest-FlavorsExtraSpecsTestJSON-970971914 tempest-FlavorsExtraSpecsTestJSON-970971914-project-admin] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:54:46.537499 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-9882e82e-0d2c-4c79-bbce-0555ac37718b tempest-FlavorsExtraSpecsTestJSON-970971914 tempest-FlavorsExtraSpecsTestJSON-970971914-project-admin] 10.222.0.13 "DELETE /compute/v2.1/flavors/1285727622/os-extra_specs/hw:numa_nodes" status: 200 len: 0 microversion: 2.1 time: 0.128456 Nov 01 18:54:46.543774 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 77/152] 10.222.0.13 () {58 vars in 1248 bytes} [Tue Nov 1 18:54:46 2022] DELETE /compute/v2.1/flavors/1285727622/os-extra_specs/hw:numa_nodes => generated 0 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Nov 01 18:54:46.551821 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-215a690e-2f02-4cc5-8253-a75f83c6502b tempest-FlavorsExtraSpecsTestJSON-970971914 tempest-FlavorsExtraSpecsTestJSON-970971914-project-admin] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:54:46.576878 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-55dac209-9f8c-4c22-92fd-976027a2b256 tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:54:46.578519 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-55dac209-9f8c-4c22-92fd-976027a2b256 tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] [instance: 4ebac531-6f77-4108-afc9-0eccb86dee8b] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:54:46.610057 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-55dac209-9f8c-4c22-92fd-976027a2b256 tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:54:46.614891 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-55dac209-9f8c-4c22-92fd-976027a2b256 tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:54:46.615453 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-55dac209-9f8c-4c22-92fd-976027a2b256 tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:54:46.618083 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-55dac209-9f8c-4c22-92fd-976027a2b256 tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:54:46.619323 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-55dac209-9f8c-4c22-92fd-976027a2b256 tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:54:46.624717 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-55dac209-9f8c-4c22-92fd-976027a2b256 tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:54:46.631021 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-215a690e-2f02-4cc5-8253-a75f83c6502b tempest-FlavorsExtraSpecsTestJSON-970971914 tempest-FlavorsExtraSpecsTestJSON-970971914-project-admin] 10.222.0.13 "DELETE /compute/v2.1/flavors/1285727622/os-extra_specs/hw:cpu_policy" status: 200 len: 0 microversion: 2.1 time: 0.083080 Nov 01 18:54:46.641012 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 76/153] 10.222.0.13 () {58 vars in 1248 bytes} [Tue Nov 1 18:54:46 2022] DELETE /compute/v2.1/flavors/1285727622/os-extra_specs/hw:cpu_policy => generated 0 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Nov 01 18:54:46.650957 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-c65795c3-1881-4c55-84bd-a73d1e9c1226 tempest-FlavorsExtraSpecsTestJSON-970971914 tempest-FlavorsExtraSpecsTestJSON-970971914-project-admin] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:54:46.687462 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-c65795c3-1881-4c55-84bd-a73d1e9c1226 tempest-FlavorsExtraSpecsTestJSON-970971914 tempest-FlavorsExtraSpecsTestJSON-970971914-project-admin] 10.222.0.13 "GET /compute/v2.1/flavors/1285727622/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.040449 Nov 01 18:54:46.699944 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 77/154] 10.222.0.13 () {58 vars in 1203 bytes} [Tue Nov 1 18:54:46 2022] GET /compute/v2.1/flavors/1285727622/os-extra_specs => generated 19 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 01 18:54:46.709196 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-97270034-7f13-4a35-b366-19e520b061e7 tempest-FlavorsExtraSpecsTestJSON-970971914 tempest-FlavorsExtraSpecsTestJSON-970971914-project-admin] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:54:46.753137 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-97270034-7f13-4a35-b366-19e520b061e7 tempest-FlavorsExtraSpecsTestJSON-970971914 tempest-FlavorsExtraSpecsTestJSON-970971914-project-admin] 10.222.0.13 "DELETE /compute/v2.1/flavors/1285727622" status: 202 len: 0 microversion: 2.1 time: 0.048355 Nov 01 18:54:46.756834 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 78/155] 10.222.0.13 () {58 vars in 1161 bytes} [Tue Nov 1 18:54:46 2022] DELETE /compute/v2.1/flavors/1285727622 => generated 0 bytes in 53 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 01 18:54:46.770696 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-67e07fbf-abe8-4044-aa5c-9cf42f7edb1d tempest-FlavorsExtraSpecsTestJSON-970971914 tempest-FlavorsExtraSpecsTestJSON-970971914-project-admin] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:54:46.811564 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-67e07fbf-abe8-4044-aa5c-9cf42f7edb1d tempest-FlavorsExtraSpecsTestJSON-970971914 tempest-FlavorsExtraSpecsTestJSON-970971914-project-admin] 10.222.0.13 "GET /compute/v2.1/flavors/detail" status: 200 len: 5818 microversion: 2.1 time: 0.048697 Nov 01 18:54:46.813556 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 79/156] 10.222.0.13 () {58 vars in 1146 bytes} [Tue Nov 1 18:54:46 2022] GET /compute/v2.1/flavors/detail => generated 5818 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 18:54:47.147711 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-55dac209-9f8c-4c22-92fd-976027a2b256 tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce2e0d1828674809a3344a7a68f375c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8e1248497284006a7acbb8169627ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:54:47.157944 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-55dac209-9f8c-4c22-92fd-976027a2b256 tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] 10.222.0.13 "GET /compute/v2.1/servers/4ebac531-6f77-4108-afc9-0eccb86dee8b" status: 200 len: 1341 microversion: 2.1 time: 0.597001 Nov 01 18:54:47.158547 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 78/157] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:54:46 2022] GET /compute/v2.1/servers/4ebac531-6f77-4108-afc9-0eccb86dee8b => generated 1341 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:54:47.208905 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-a19545b3-73fb-4963-9369-62d8ae907b19 tempest-AggregatesAdminTestJSON-768412114 tempest-AggregatesAdminTestJSON-768412114-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:54:47.209718 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-a19545b3-73fb-4963-9369-62d8ae907b19 tempest-AggregatesAdminTestJSON-768412114 tempest-AggregatesAdminTestJSON-768412114-project] [instance: 7967bf1f-943f-441d-befd-373868bbb3aa] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:54:47.220121 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-a19545b3-73fb-4963-9369-62d8ae907b19 tempest-AggregatesAdminTestJSON-768412114 tempest-AggregatesAdminTestJSON-768412114-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:54:47.221411 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-a19545b3-73fb-4963-9369-62d8ae907b19 tempest-AggregatesAdminTestJSON-768412114 tempest-AggregatesAdminTestJSON-768412114-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:54:47.222474 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-a19545b3-73fb-4963-9369-62d8ae907b19 tempest-AggregatesAdminTestJSON-768412114 tempest-AggregatesAdminTestJSON-768412114-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:54:47.222961 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-a19545b3-73fb-4963-9369-62d8ae907b19 tempest-AggregatesAdminTestJSON-768412114 tempest-AggregatesAdminTestJSON-768412114-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:54:47.223745 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-a19545b3-73fb-4963-9369-62d8ae907b19 tempest-AggregatesAdminTestJSON-768412114 tempest-AggregatesAdminTestJSON-768412114-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:54:47.224814 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-a19545b3-73fb-4963-9369-62d8ae907b19 tempest-AggregatesAdminTestJSON-768412114 tempest-AggregatesAdminTestJSON-768412114-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:54:48.040102 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-a19545b3-73fb-4963-9369-62d8ae907b19 tempest-AggregatesAdminTestJSON-768412114 tempest-AggregatesAdminTestJSON-768412114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439a7ac2509640c49361f9ba6636b34d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8382e1376b104295aa5cef36ba07cf45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:54:48.054755 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-a19545b3-73fb-4963-9369-62d8ae907b19 tempest-AggregatesAdminTestJSON-768412114 tempest-AggregatesAdminTestJSON-768412114-project] 10.222.0.13 "GET /compute/v2.1/servers/7967bf1f-943f-441d-befd-373868bbb3aa" status: 200 len: 1338 microversion: 2.1 time: 0.853959 Nov 01 18:54:48.055712 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 80/158] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:54:47 2022] GET /compute/v2.1/servers/7967bf1f-943f-441d-befd-373868bbb3aa => generated 1338 bytes in 856 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:54:48.184182 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-b8416c2e-0426-48e5-bad3-9edbf84cdc18 tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:54:48.184843 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-b8416c2e-0426-48e5-bad3-9edbf84cdc18 tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] [instance: 4ebac531-6f77-4108-afc9-0eccb86dee8b] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:54:48.197034 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b8416c2e-0426-48e5-bad3-9edbf84cdc18 tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:54:48.197531 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b8416c2e-0426-48e5-bad3-9edbf84cdc18 tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:54:48.200872 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b8416c2e-0426-48e5-bad3-9edbf84cdc18 tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:54:48.201919 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b8416c2e-0426-48e5-bad3-9edbf84cdc18 tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:54:48.202994 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b8416c2e-0426-48e5-bad3-9edbf84cdc18 tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:54:48.204170 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b8416c2e-0426-48e5-bad3-9edbf84cdc18 tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:54:48.627898 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-b8416c2e-0426-48e5-bad3-9edbf84cdc18 tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce2e0d1828674809a3344a7a68f375c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8e1248497284006a7acbb8169627ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:54:48.658168 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-b8416c2e-0426-48e5-bad3-9edbf84cdc18 tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] 10.222.0.13 "GET /compute/v2.1/servers/4ebac531-6f77-4108-afc9-0eccb86dee8b" status: 200 len: 1341 microversion: 2.1 time: 0.478425 Nov 01 18:54:48.678522 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 79/159] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:54:48 2022] GET /compute/v2.1/servers/4ebac531-6f77-4108-afc9-0eccb86dee8b => generated 1341 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:54:49.080174 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-f2db42c3-655e-48aa-a5f5-0925188d0ba6 tempest-AggregatesAdminTestJSON-768412114 tempest-AggregatesAdminTestJSON-768412114-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:54:49.080985 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-f2db42c3-655e-48aa-a5f5-0925188d0ba6 tempest-AggregatesAdminTestJSON-768412114 tempest-AggregatesAdminTestJSON-768412114-project] [instance: 7967bf1f-943f-441d-befd-373868bbb3aa] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:54:49.083092 n-d-863052-2 devstack@n-api.service[121403]: DEBUG dbcounter [-] [121403] Writing DB stats nova_cell0:SELECT=18 {{(pid=121403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 18:54:49.100603 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f2db42c3-655e-48aa-a5f5-0925188d0ba6 tempest-AggregatesAdminTestJSON-768412114 tempest-AggregatesAdminTestJSON-768412114-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:54:49.109249 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f2db42c3-655e-48aa-a5f5-0925188d0ba6 tempest-AggregatesAdminTestJSON-768412114 tempest-AggregatesAdminTestJSON-768412114-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:54:49.113319 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f2db42c3-655e-48aa-a5f5-0925188d0ba6 tempest-AggregatesAdminTestJSON-768412114 tempest-AggregatesAdminTestJSON-768412114-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:54:49.114158 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f2db42c3-655e-48aa-a5f5-0925188d0ba6 tempest-AggregatesAdminTestJSON-768412114 tempest-AggregatesAdminTestJSON-768412114-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:54:49.119913 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f2db42c3-655e-48aa-a5f5-0925188d0ba6 tempest-AggregatesAdminTestJSON-768412114 tempest-AggregatesAdminTestJSON-768412114-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:54:49.120644 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f2db42c3-655e-48aa-a5f5-0925188d0ba6 tempest-AggregatesAdminTestJSON-768412114 tempest-AggregatesAdminTestJSON-768412114-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:54:49.533442 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-f2db42c3-655e-48aa-a5f5-0925188d0ba6 tempest-AggregatesAdminTestJSON-768412114 tempest-AggregatesAdminTestJSON-768412114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439a7ac2509640c49361f9ba6636b34d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8382e1376b104295aa5cef36ba07cf45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:54:49.542312 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-f2db42c3-655e-48aa-a5f5-0925188d0ba6 tempest-AggregatesAdminTestJSON-768412114 tempest-AggregatesAdminTestJSON-768412114-project] 10.222.0.13 "GET /compute/v2.1/servers/7967bf1f-943f-441d-befd-373868bbb3aa" status: 200 len: 1338 microversion: 2.1 time: 0.465897 Nov 01 18:54:49.565446 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 81/160] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:54:49 2022] GET /compute/v2.1/servers/7967bf1f-943f-441d-befd-373868bbb3aa => generated 1338 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:54:49.684453 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-3e89bdec-6768-4591-88eb-ced4aabb6b2a tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:54:49.685465 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-3e89bdec-6768-4591-88eb-ced4aabb6b2a tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] [instance: 4ebac531-6f77-4108-afc9-0eccb86dee8b] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:54:49.700150 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-3e89bdec-6768-4591-88eb-ced4aabb6b2a tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:54:49.700920 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-3e89bdec-6768-4591-88eb-ced4aabb6b2a tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:54:49.701522 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-3e89bdec-6768-4591-88eb-ced4aabb6b2a tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:54:49.701795 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [req-f0eece60-97b7-48db-b1fc-d068adc58559 req-bac8b3c6-f80a-4a1c-8969-1d7967f95b57 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4ebac531-6f77-4108-afc9-0eccb86dee8b", "name": "network-vif-plugged", "status": "completed", "tag": "8abf404d-d3c6-4853-a8a7-331b2d566057"}]} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 18:54:49.702885 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-3e89bdec-6768-4591-88eb-ced4aabb6b2a tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:54:49.704152 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-3e89bdec-6768-4591-88eb-ced4aabb6b2a tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:54:49.705188 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-3e89bdec-6768-4591-88eb-ced4aabb6b2a tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:54:49.742394 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-f0eece60-97b7-48db-b1fc-d068adc58559 req-bac8b3c6-f80a-4a1c-8969-1d7967f95b57 service nova] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:54:49.743712 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-f0eece60-97b7-48db-b1fc-d068adc58559 req-bac8b3c6-f80a-4a1c-8969-1d7967f95b57 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:54:49.752914 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-f0eece60-97b7-48db-b1fc-d068adc58559 req-bac8b3c6-f80a-4a1c-8969-1d7967f95b57 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:54:49.844406 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.compute.server_external_events [req-f0eece60-97b7-48db-b1fc-d068adc58559 req-bac8b3c6-f80a-4a1c-8969-1d7967f95b57 service nova] Creating event network-vif-plugged:8abf404d-d3c6-4853-a8a7-331b2d566057 for instance 4ebac531-6f77-4108-afc9-0eccb86dee8b on n-h1-863052-2 Nov 01 18:54:49.866591 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [req-f0eece60-97b7-48db-b1fc-d068adc58559 req-bac8b3c6-f80a-4a1c-8969-1d7967f95b57 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.348810 Nov 01 18:54:49.868716 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 80/161] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Nov 1 18:54:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 18:54:50.075113 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-58a53cd0-8b00-44ba-9428-6bc4389710f5 tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-1608523973", "imageRef": "2d4a0047-1b9e-445f-8af8-1b5c9d93e881", "flavorRef": "835338155", "adminPass": "***", "networks": [{"uuid": "4e9ef1cb-dc90-4afe-8cc8-40e493fafdcb"}], "security_groups": [{"name": "tempest-securitygroup--570641705"}], "key_name": "tempest-keypair-630059540", "user_data": "}} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 18:54:50.115704 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-3e89bdec-6768-4591-88eb-ced4aabb6b2a tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce2e0d1828674809a3344a7a68f375c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8e1248497284006a7acbb8169627ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:54:50.125351 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-3e89bdec-6768-4591-88eb-ced4aabb6b2a tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] 10.222.0.13 "GET /compute/v2.1/servers/4ebac531-6f77-4108-afc9-0eccb86dee8b" status: 200 len: 1341 microversion: 2.1 time: 0.445470 Nov 01 18:54:50.127517 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 82/162] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:54:49 2022] GET /compute/v2.1/servers/4ebac531-6f77-4108-afc9-0eccb86dee8b => generated 1341 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:54:50.537600 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.network.neutron [None req-58a53cd0-8b00-44ba-9428-6bc4389710f5 tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] validate_networks() for [('4e9ef1cb-dc90-4afe-8cc8-40e493fafdcb', None, None, None, None, None)] {{(pid=121402) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 01 18:54:50.588275 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-4b42822f-f56a-439d-89df-b0a6561d53f1 tempest-AggregatesAdminTestJSON-768412114 tempest-AggregatesAdminTestJSON-768412114-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:54:50.588988 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-4b42822f-f56a-439d-89df-b0a6561d53f1 tempest-AggregatesAdminTestJSON-768412114 tempest-AggregatesAdminTestJSON-768412114-project] [instance: 7967bf1f-943f-441d-befd-373868bbb3aa] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:54:50.624487 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-4b42822f-f56a-439d-89df-b0a6561d53f1 tempest-AggregatesAdminTestJSON-768412114 tempest-AggregatesAdminTestJSON-768412114-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:54:50.625223 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-4b42822f-f56a-439d-89df-b0a6561d53f1 tempest-AggregatesAdminTestJSON-768412114 tempest-AggregatesAdminTestJSON-768412114-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:54:50.628611 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-4b42822f-f56a-439d-89df-b0a6561d53f1 tempest-AggregatesAdminTestJSON-768412114 tempest-AggregatesAdminTestJSON-768412114-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:54:50.632999 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-4b42822f-f56a-439d-89df-b0a6561d53f1 tempest-AggregatesAdminTestJSON-768412114 tempest-AggregatesAdminTestJSON-768412114-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:54:50.633639 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-4b42822f-f56a-439d-89df-b0a6561d53f1 tempest-AggregatesAdminTestJSON-768412114 tempest-AggregatesAdminTestJSON-768412114-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:54:50.637256 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-4b42822f-f56a-439d-89df-b0a6561d53f1 tempest-AggregatesAdminTestJSON-768412114 tempest-AggregatesAdminTestJSON-768412114-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:54:51.221162 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-4b42822f-f56a-439d-89df-b0a6561d53f1 tempest-AggregatesAdminTestJSON-768412114 tempest-AggregatesAdminTestJSON-768412114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439a7ac2509640c49361f9ba6636b34d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8382e1376b104295aa5cef36ba07cf45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:54:51.232189 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-4b42822f-f56a-439d-89df-b0a6561d53f1 tempest-AggregatesAdminTestJSON-768412114 tempest-AggregatesAdminTestJSON-768412114-project] 10.222.0.13 "GET /compute/v2.1/servers/7967bf1f-943f-441d-befd-373868bbb3aa" status: 200 len: 1338 microversion: 2.1 time: 0.648682 Nov 01 18:54:51.236899 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 83/163] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:54:50 2022] GET /compute/v2.1/servers/7967bf1f-943f-441d-befd-373868bbb3aa => generated 1338 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 18:54:51.253725 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-f927cf3b-754f-4ec0-933c-1722c29261df tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:54:51.254602 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-f927cf3b-754f-4ec0-933c-1722c29261df tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] [instance: 4ebac531-6f77-4108-afc9-0eccb86dee8b] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:54:51.276381 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f927cf3b-754f-4ec0-933c-1722c29261df tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:54:51.284127 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f927cf3b-754f-4ec0-933c-1722c29261df tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:54:51.286597 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f927cf3b-754f-4ec0-933c-1722c29261df tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:54:51.293893 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f927cf3b-754f-4ec0-933c-1722c29261df tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:54:51.299636 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f927cf3b-754f-4ec0-933c-1722c29261df tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:54:51.302510 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f927cf3b-754f-4ec0-933c-1722c29261df tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:54:51.653017 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-f927cf3b-754f-4ec0-933c-1722c29261df tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce2e0d1828674809a3344a7a68f375c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8e1248497284006a7acbb8169627ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:54:51.662364 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-f927cf3b-754f-4ec0-933c-1722c29261df tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] 10.222.0.13 "GET /compute/v2.1/servers/4ebac531-6f77-4108-afc9-0eccb86dee8b" status: 200 len: 1341 microversion: 2.1 time: 0.423520 Nov 01 18:54:51.682260 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 84/164] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:54:51 2022] GET /compute/v2.1/servers/4ebac531-6f77-4108-afc9-0eccb86dee8b => generated 1341 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:54:52.026010 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [req-d7e8fdf6-639d-415d-87fb-90684fae391e req-7fa5c311-8fba-4512-90e8-c225a0e97e07 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7967bf1f-943f-441d-befd-373868bbb3aa", "name": "network-vif-plugged", "status": "completed", "tag": "963ab751-05a7-4de6-a06a-12599013a0d2"}]} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 18:54:52.038899 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-d7e8fdf6-639d-415d-87fb-90684fae391e req-7fa5c311-8fba-4512-90e8-c225a0e97e07 service nova] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:54:52.039574 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-d7e8fdf6-639d-415d-87fb-90684fae391e req-7fa5c311-8fba-4512-90e8-c225a0e97e07 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:54:52.040213 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-d7e8fdf6-639d-415d-87fb-90684fae391e req-7fa5c311-8fba-4512-90e8-c225a0e97e07 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:54:52.065039 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.compute.server_external_events [req-d7e8fdf6-639d-415d-87fb-90684fae391e req-7fa5c311-8fba-4512-90e8-c225a0e97e07 service nova] Creating event network-vif-plugged:963ab751-05a7-4de6-a06a-12599013a0d2 for instance 7967bf1f-943f-441d-befd-373868bbb3aa on n-h1-863052-2 Nov 01 18:54:52.070408 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [req-d7e8fdf6-639d-415d-87fb-90684fae391e req-7fa5c311-8fba-4512-90e8-c225a0e97e07 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048260 Nov 01 18:54:52.070997 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 85/165] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Nov 1 18:54:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 18:54:52.265675 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-f287f1b8-4055-416c-a5dd-0993e7617873 tempest-AggregatesAdminTestJSON-768412114 tempest-AggregatesAdminTestJSON-768412114-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:54:52.267712 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-f287f1b8-4055-416c-a5dd-0993e7617873 tempest-AggregatesAdminTestJSON-768412114 tempest-AggregatesAdminTestJSON-768412114-project] [instance: 7967bf1f-943f-441d-befd-373868bbb3aa] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:54:52.285076 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f287f1b8-4055-416c-a5dd-0993e7617873 tempest-AggregatesAdminTestJSON-768412114 tempest-AggregatesAdminTestJSON-768412114-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:54:52.290436 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f287f1b8-4055-416c-a5dd-0993e7617873 tempest-AggregatesAdminTestJSON-768412114 tempest-AggregatesAdminTestJSON-768412114-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:54:52.291337 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f287f1b8-4055-416c-a5dd-0993e7617873 tempest-AggregatesAdminTestJSON-768412114 tempest-AggregatesAdminTestJSON-768412114-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:54:52.292518 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f287f1b8-4055-416c-a5dd-0993e7617873 tempest-AggregatesAdminTestJSON-768412114 tempest-AggregatesAdminTestJSON-768412114-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:54:52.293231 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f287f1b8-4055-416c-a5dd-0993e7617873 tempest-AggregatesAdminTestJSON-768412114 tempest-AggregatesAdminTestJSON-768412114-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:54:52.294014 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f287f1b8-4055-416c-a5dd-0993e7617873 tempest-AggregatesAdminTestJSON-768412114 tempest-AggregatesAdminTestJSON-768412114-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:54:52.596269 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-f287f1b8-4055-416c-a5dd-0993e7617873 tempest-AggregatesAdminTestJSON-768412114 tempest-AggregatesAdminTestJSON-768412114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439a7ac2509640c49361f9ba6636b34d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8382e1376b104295aa5cef36ba07cf45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:54:52.605606 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-f287f1b8-4055-416c-a5dd-0993e7617873 tempest-AggregatesAdminTestJSON-768412114 tempest-AggregatesAdminTestJSON-768412114-project] 10.222.0.13 "GET /compute/v2.1/servers/7967bf1f-943f-441d-befd-373868bbb3aa" status: 200 len: 1338 microversion: 2.1 time: 0.348374 Nov 01 18:54:52.606124 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 86/166] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:54:52 2022] GET /compute/v2.1/servers/7967bf1f-943f-441d-befd-373868bbb3aa => generated 1338 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 18:54:52.692098 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-338a3031-7415-4d81-a005-adc760fd049d tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:54:52.692945 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-338a3031-7415-4d81-a005-adc760fd049d tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] [instance: 4ebac531-6f77-4108-afc9-0eccb86dee8b] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:54:52.700390 n-d-863052-2 devstack@n-api.service[121403]: DEBUG dbcounter [-] [121403] Writing DB stats nova_api:SELECT=85,nova_api:DELETE=8,nova_api:INSERT=3,nova_api:SAVEPOINT=2,nova_api:RELEASE=2 {{(pid=121403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 18:54:52.706725 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-338a3031-7415-4d81-a005-adc760fd049d tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:54:52.709063 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-338a3031-7415-4d81-a005-adc760fd049d tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:54:52.710773 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-338a3031-7415-4d81-a005-adc760fd049d tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:54:52.716556 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-338a3031-7415-4d81-a005-adc760fd049d tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:54:52.717115 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-338a3031-7415-4d81-a005-adc760fd049d tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:54:52.717564 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-338a3031-7415-4d81-a005-adc760fd049d tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:54:52.919900 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.virt.hardware [None req-58a53cd0-8b00-44ba-9428-6bc4389710f5 tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Flavor limits 0:0:0 {{(pid=121402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 01 18:54:52.920613 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.virt.hardware [None req-58a53cd0-8b00-44ba-9428-6bc4389710f5 tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Image limits 0:0:0 {{(pid=121402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 01 18:54:52.921365 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.virt.hardware [None req-58a53cd0-8b00-44ba-9428-6bc4389710f5 tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Flavor pref 0:0:0 {{(pid=121402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 01 18:54:52.921903 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.virt.hardware [None req-58a53cd0-8b00-44ba-9428-6bc4389710f5 tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Image pref 0:0:0 {{(pid=121402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 01 18:54:52.922769 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.virt.hardware [None req-58a53cd0-8b00-44ba-9428-6bc4389710f5 tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 01 18:54:52.934001 n-d-863052-2 devstack@n-api.service[121402]: DEBUG dbcounter [-] [121402] Writing DB stats nova_api:SELECT=76,nova_api:INSERT=5,nova_api:SAVEPOINT=7,nova_api:RELEASE=7,nova_api:DELETE=4,nova_api:UPDATE=1 {{(pid=121402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 18:54:52.963810 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-58a53cd0-8b00-44ba-9428-6bc4389710f5 tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:54:52.966496 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-58a53cd0-8b00-44ba-9428-6bc4389710f5 tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:54:52.968568 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-58a53cd0-8b00-44ba-9428-6bc4389710f5 tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:54:52.970675 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-58a53cd0-8b00-44ba-9428-6bc4389710f5 tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:54:52.972913 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-58a53cd0-8b00-44ba-9428-6bc4389710f5 tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:54:52.973845 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-58a53cd0-8b00-44ba-9428-6bc4389710f5 tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:54:53.045233 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-338a3031-7415-4d81-a005-adc760fd049d tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce2e0d1828674809a3344a7a68f375c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8e1248497284006a7acbb8169627ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:54:53.055432 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-338a3031-7415-4d81-a005-adc760fd049d tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] 10.222.0.13 "GET /compute/v2.1/servers/4ebac531-6f77-4108-afc9-0eccb86dee8b" status: 200 len: 1341 microversion: 2.1 time: 0.368649 Nov 01 18:54:53.059073 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 87/167] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:54:52 2022] GET /compute/v2.1/servers/4ebac531-6f77-4108-afc9-0eccb86dee8b => generated 1341 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 18:54:53.080013 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.quota [None req-58a53cd0-8b00-44ba-9428-6bc4389710f5 tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Getting quotas for project 9baf3860ba564f5c8dff93085b9aabe3. Resources: {'cores', 'ram', 'instances'} {{(pid=121402) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 01 18:54:53.106703 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.quota [None req-58a53cd0-8b00-44ba-9428-6bc4389710f5 tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Getting quotas for user f07a2a96629f4baea6a3adfc4011ffe9 and project 9baf3860ba564f5c8dff93085b9aabe3. Resources: {'cores', 'ram', 'instances'} {{(pid=121402) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 01 18:54:53.132950 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-58a53cd0-8b00-44ba-9428-6bc4389710f5 tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Going to run 1 instances... {{(pid=121402) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 01 18:54:53.137742 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-58a53cd0-8b00-44ba-9428-6bc4389710f5 tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] [instance: 26132db2-1798-4ba6-88bb-aaf87f6848b3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2d4a0047-1b9e-445f-8af8-1b5c9d93e881',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121402) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 01 18:54:53.236060 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-58a53cd0-8b00-44ba-9428-6bc4389710f5 tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 3.169014 Nov 01 18:54:53.237332 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 81/168] 10.222.0.13 () {60 vars in 1147 bytes} [Tue Nov 1 18:54:50 2022] POST /compute/v2.1/servers => generated 401 bytes in 3171 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Nov 01 18:54:53.248484 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-411fedb1-b968-468f-aebf-3a61f9054218 tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:54:53.249419 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-411fedb1-b968-468f-aebf-3a61f9054218 tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] [instance: 26132db2-1798-4ba6-88bb-aaf87f6848b3] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:54:53.344225 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-411fedb1-b968-468f-aebf-3a61f9054218 tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07a2a96629f4baea6a3adfc4011ffe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9baf3860ba564f5c8dff93085b9aabe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:54:53.353301 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-411fedb1-b968-468f-aebf-3a61f9054218 tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] 10.222.0.13 "GET /compute/v2.1/servers/26132db2-1798-4ba6-88bb-aaf87f6848b3" status: 200 len: 1262 microversion: 2.1 time: 0.108569 Nov 01 18:54:53.359026 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 88/169] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:54:53 2022] GET /compute/v2.1/servers/26132db2-1798-4ba6-88bb-aaf87f6848b3 => generated 1262 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:54:53.630774 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-48cccd8a-b87e-4d8e-baf4-552cbfa65514 tempest-AggregatesAdminTestJSON-768412114 tempest-AggregatesAdminTestJSON-768412114-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:54:53.632100 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-48cccd8a-b87e-4d8e-baf4-552cbfa65514 tempest-AggregatesAdminTestJSON-768412114 tempest-AggregatesAdminTestJSON-768412114-project] [instance: 7967bf1f-943f-441d-befd-373868bbb3aa] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:54:53.643274 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-48cccd8a-b87e-4d8e-baf4-552cbfa65514 tempest-AggregatesAdminTestJSON-768412114 tempest-AggregatesAdminTestJSON-768412114-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:54:53.647075 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-48cccd8a-b87e-4d8e-baf4-552cbfa65514 tempest-AggregatesAdminTestJSON-768412114 tempest-AggregatesAdminTestJSON-768412114-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:54:53.654631 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-48cccd8a-b87e-4d8e-baf4-552cbfa65514 tempest-AggregatesAdminTestJSON-768412114 tempest-AggregatesAdminTestJSON-768412114-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:54:53.656088 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-48cccd8a-b87e-4d8e-baf4-552cbfa65514 tempest-AggregatesAdminTestJSON-768412114 tempest-AggregatesAdminTestJSON-768412114-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:54:53.666545 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-48cccd8a-b87e-4d8e-baf4-552cbfa65514 tempest-AggregatesAdminTestJSON-768412114 tempest-AggregatesAdminTestJSON-768412114-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:54:53.667262 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-48cccd8a-b87e-4d8e-baf4-552cbfa65514 tempest-AggregatesAdminTestJSON-768412114 tempest-AggregatesAdminTestJSON-768412114-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:54:54.083328 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-681e2392-a7ba-430b-9025-4e898afcd116 tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:54:54.084386 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-681e2392-a7ba-430b-9025-4e898afcd116 tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] [instance: 4ebac531-6f77-4108-afc9-0eccb86dee8b] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:54:54.094991 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-681e2392-a7ba-430b-9025-4e898afcd116 tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:54:54.096700 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-48cccd8a-b87e-4d8e-baf4-552cbfa65514 tempest-AggregatesAdminTestJSON-768412114 tempest-AggregatesAdminTestJSON-768412114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439a7ac2509640c49361f9ba6636b34d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8382e1376b104295aa5cef36ba07cf45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:54:54.097990 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-681e2392-a7ba-430b-9025-4e898afcd116 tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:54:54.100013 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-681e2392-a7ba-430b-9025-4e898afcd116 tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:54:54.102356 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-681e2392-a7ba-430b-9025-4e898afcd116 tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:54:54.103602 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-681e2392-a7ba-430b-9025-4e898afcd116 tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:54:54.104916 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-48cccd8a-b87e-4d8e-baf4-552cbfa65514 tempest-AggregatesAdminTestJSON-768412114 tempest-AggregatesAdminTestJSON-768412114-project] 10.222.0.13 "GET /compute/v2.1/servers/7967bf1f-943f-441d-befd-373868bbb3aa" status: 200 len: 1338 microversion: 2.1 time: 0.478286 Nov 01 18:54:54.105952 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-681e2392-a7ba-430b-9025-4e898afcd116 tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:54:54.108265 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 82/170] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:54:53 2022] GET /compute/v2.1/servers/7967bf1f-943f-441d-befd-373868bbb3aa => generated 1338 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:54:54.382176 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-4ae8710a-611e-4b69-80e5-1a70a8b48b58 tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:54:54.382818 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-4ae8710a-611e-4b69-80e5-1a70a8b48b58 tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] [instance: 26132db2-1798-4ba6-88bb-aaf87f6848b3] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:54:54.394444 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-4ae8710a-611e-4b69-80e5-1a70a8b48b58 tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:54:54.395535 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-4ae8710a-611e-4b69-80e5-1a70a8b48b58 tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:54:54.395973 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-4ae8710a-611e-4b69-80e5-1a70a8b48b58 tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:54:54.396716 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-4ae8710a-611e-4b69-80e5-1a70a8b48b58 tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:54:54.397168 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-4ae8710a-611e-4b69-80e5-1a70a8b48b58 tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:54:54.397586 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-4ae8710a-611e-4b69-80e5-1a70a8b48b58 tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:54:54.407197 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-681e2392-a7ba-430b-9025-4e898afcd116 tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce2e0d1828674809a3344a7a68f375c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8e1248497284006a7acbb8169627ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:54:54.439969 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-681e2392-a7ba-430b-9025-4e898afcd116 tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] 10.222.0.13 "GET /compute/v2.1/servers/4ebac531-6f77-4108-afc9-0eccb86dee8b" status: 200 len: 1491 microversion: 2.1 time: 0.357573 Nov 01 18:54:54.442821 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 89/171] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:54:54 2022] GET /compute/v2.1/servers/4ebac531-6f77-4108-afc9-0eccb86dee8b => generated 1491 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:54:54.566038 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-4ae8710a-611e-4b69-80e5-1a70a8b48b58 tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07a2a96629f4baea6a3adfc4011ffe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9baf3860ba564f5c8dff93085b9aabe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:54:54.576994 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-4ae8710a-611e-4b69-80e5-1a70a8b48b58 tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] 10.222.0.13 "GET /compute/v2.1/servers/26132db2-1798-4ba6-88bb-aaf87f6848b3" status: 200 len: 1266 microversion: 2.1 time: 0.197384 Nov 01 18:54:54.578693 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 83/172] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:54:54 2022] GET /compute/v2.1/servers/26132db2-1798-4ba6-88bb-aaf87f6848b3 => generated 1266 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:54:54.868942 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-f248a1fd-2e82-489c-ac8a-43cd82501334 tempest-InstanceUsageAuditLogNegativeTestJSON-300381411 tempest-InstanceUsageAuditLogNegativeTestJSON-300381411-project-admin] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:54:54.872214 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.wsgi [None req-f248a1fd-2e82-489c-ac8a-43cd82501334 tempest-InstanceUsageAuditLogNegativeTestJSON-300381411 tempest-InstanceUsageAuditLogNegativeTestJSON-300381411-project-admin] HTTP exception thrown: Invalid timestamp for date invalid_time Nov 01 18:54:54.887563 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-f248a1fd-2e82-489c-ac8a-43cd82501334 tempest-InstanceUsageAuditLogNegativeTestJSON-300381411 tempest-InstanceUsageAuditLogNegativeTestJSON-300381411-project-admin] Request method failure captured: Nov 01 18:54:54.887563 n-d-863052-2 devstack@n-api.service[121403]: request: GET /compute/v2.1/os-instance_usage_audit_log/invalid_time HTTP/1.1 Nov 01 18:54:54.887563 n-d-863052-2 devstack@n-api.service[121403]: Accept: application/json Nov 01 18:54:54.887563 n-d-863052-2 devstack@n-api.service[121403]: Accept-Encoding: identity Nov 01 18:54:54.887563 n-d-863052-2 devstack@n-api.service[121403]: Connection: close Nov 01 18:54:54.887563 n-d-863052-2 devstack@n-api.service[121403]: Content-Length: 0 Nov 01 18:54:54.887563 n-d-863052-2 devstack@n-api.service[121403]: Content-Type: application/json Nov 01 18:54:54.887563 n-d-863052-2 devstack@n-api.service[121403]: Host: 10.222.0.13 Nov 01 18:54:54.887563 n-d-863052-2 devstack@n-api.service[121403]: Openstack-System-Scope: None Nov 01 18:54:54.887563 n-d-863052-2 devstack@n-api.service[121403]: User-Agent: python-urllib3/1.26.12 Nov 01 18:54:54.887563 n-d-863052-2 devstack@n-api.service[121403]: X-Auth-Token: gAAAAABjYWt-8o18FNHcDB63Nf5wCWqV-BNzmS2BqlJV3ku9fefHIzmFf2-STeOdoaXjoDXYRizGFS09rjPrD_XqL3X5Nebw5mA_jEQ4jXA-zuzhzbaFpu6lDL93H4V-yoOvJS0xxTtH9LTNj_wURKxpvSyVdUbtUo220js0pUJl8gNsJEwqXLI Nov 01 18:54:54.887563 n-d-863052-2 devstack@n-api.service[121403]: X-Domain-Id: None Nov 01 18:54:54.887563 n-d-863052-2 devstack@n-api.service[121403]: X-Domain-Name: None Nov 01 18:54:54.887563 n-d-863052-2 devstack@n-api.service[121403]: X-Identity-Status: Confirmed Nov 01 18:54:54.887563 n-d-863052-2 devstack@n-api.service[121403]: X-Is-Admin-Project: True Nov 01 18:54:54.887563 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Domain-Id: default Nov 01 18:54:54.887563 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Domain-Name: Default Nov 01 18:54:54.887563 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Id: 37536c80604c4682b327d3d15f3090ad Nov 01 18:54:54.887563 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-300381411 Nov 01 18:54:54.887563 n-d-863052-2 devstack@n-api.service[121403]: X-Role: admin,member,reader Nov 01 18:54:54.887563 n-d-863052-2 devstack@n-api.service[121403]: X-Roles: admin,member,reader Nov 01 18:54:54.889666 n-d-863052-2 devstack@n-api.service[121403]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/37536c80604c4682b327d3d15f3090ad"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/37536c80604c4682b327d3d15f3090ad"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_37536c80604c4682b327d3d15f3090ad", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/37536c80604c4682b327d3d15f3090ad"}]}] Nov 01 18:54:54.889666 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-300381411 Nov 01 18:54:54.889666 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant-Id: 37536c80604c4682b327d3d15f3090ad Nov 01 18:54:54.889666 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-300381411 Nov 01 18:54:54.889666 n-d-863052-2 devstack@n-api.service[121403]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-300381411-project-admin Nov 01 18:54:54.889666 n-d-863052-2 devstack@n-api.service[121403]: X-User-Domain-Id: default Nov 01 18:54:54.889666 n-d-863052-2 devstack@n-api.service[121403]: X-User-Domain-Name: Default Nov 01 18:54:54.889666 n-d-863052-2 devstack@n-api.service[121403]: X-User-Id: 25d204d4b5f8453487fcf19ece77a498 Nov 01 18:54:54.889666 n-d-863052-2 devstack@n-api.service[121403]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-300381411-project-admin Nov 01 18:54:54.889666 n-d-863052-2 devstack@n-api.service[121403]: method: > Nov 01 18:54:54.889666 n-d-863052-2 devstack@n-api.service[121403]: exception: Invalid timestamp for date invalid_time Nov 01 18:54:54.890907 n-d-863052-2 devstack@n-api.service[121403]: action_args: {'id': 'invalid_time'} Nov 01 18:54:54.890907 n-d-863052-2 devstack@n-api.service[121403]: {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 01 18:54:54.890907 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:54:54.890907 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 51, in show Nov 01 18:54:54.890907 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi before_date = datetime.datetime.strptime(str(id), Nov 01 18:54:54.890907 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/_strptime.py", line 568, in _strptime_datetime Nov 01 18:54:54.890907 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi tt, fraction, gmtoff_fraction = _strptime(data_string, format) Nov 01 18:54:54.890907 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/_strptime.py", line 349, in _strptime Nov 01 18:54:54.890907 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise ValueError("time data %r does not match format %r" % Nov 01 18:54:54.890907 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi ValueError: time data 'invalid_time' does not match format '%Y-%m-%d %H:%M:%S' Nov 01 18:54:54.890907 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 18:54:54.890907 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 18:54:54.890907 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 18:54:54.890907 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:54:54.890907 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 18:54:54.890907 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 18:54:54.890907 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 01 18:54:54.890907 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 01 18:54:54.890907 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 01 18:54:54.890907 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 01 18:54:54.893672 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 55, in show Nov 01 18:54:54.893672 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=msg) Nov 01 18:54:54.893672 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid timestamp for date invalid_time Nov 01 18:54:54.893672 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 18:54:54.893672 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 18:54:54.893672 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 18:54:54.893672 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:54:54.893672 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 18:54:54.893672 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 18:54:54.893672 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 01 18:54:54.893672 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 01 18:54:54.893672 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid timestamp for date invalid_time Nov 01 18:54:54.893672 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 18:54:54.893672 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-f248a1fd-2e82-489c-ac8a-43cd82501334 tempest-InstanceUsageAuditLogNegativeTestJSON-300381411 tempest-InstanceUsageAuditLogNegativeTestJSON-300381411-project-admin] Returning 400 to user: Invalid timestamp for date invalid_time {{(pid=121403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 01 18:54:54.893672 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-f248a1fd-2e82-489c-ac8a-43cd82501334 tempest-InstanceUsageAuditLogNegativeTestJSON-300381411 tempest-InstanceUsageAuditLogNegativeTestJSON-300381411-project-admin] 10.222.0.13 "GET /compute/v2.1/os-instance_usage_audit_log/invalid_time" status: 400 len: 83 microversion: 2.1 time: 0.444727 Nov 01 18:54:54.895795 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 90/173] 10.222.0.13 () {58 vars in 1224 bytes} [Tue Nov 1 18:54:54 2022] GET /compute/v2.1/os-instance_usage_audit_log/invalid_time => generated 83 bytes in 447 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Nov 01 18:54:54.927938 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-4c65c604-e801-4a3e-9b4f-ef21e7c8e340 tempest-DeleteServersAdminTestJSON-282148072 tempest-DeleteServersAdminTestJSON-282148072-project-admin] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:54:54.928450 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-4c65c604-e801-4a3e-9b4f-ef21e7c8e340 tempest-DeleteServersAdminTestJSON-282148072 tempest-DeleteServersAdminTestJSON-282148072-project-admin] [instance: 4ebac531-6f77-4108-afc9-0eccb86dee8b] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:54:54.942641 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-4c65c604-e801-4a3e-9b4f-ef21e7c8e340 tempest-DeleteServersAdminTestJSON-282148072 tempest-DeleteServersAdminTestJSON-282148072-project-admin] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:54:54.943136 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-4c65c604-e801-4a3e-9b4f-ef21e7c8e340 tempest-DeleteServersAdminTestJSON-282148072 tempest-DeleteServersAdminTestJSON-282148072-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:54:54.943559 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-4c65c604-e801-4a3e-9b4f-ef21e7c8e340 tempest-DeleteServersAdminTestJSON-282148072 tempest-DeleteServersAdminTestJSON-282148072-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:54:54.944258 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-4c65c604-e801-4a3e-9b4f-ef21e7c8e340 tempest-DeleteServersAdminTestJSON-282148072 tempest-DeleteServersAdminTestJSON-282148072-project-admin] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:54:54.954346 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-4c65c604-e801-4a3e-9b4f-ef21e7c8e340 tempest-DeleteServersAdminTestJSON-282148072 tempest-DeleteServersAdminTestJSON-282148072-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:54:54.955099 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-4c65c604-e801-4a3e-9b4f-ef21e7c8e340 tempest-DeleteServersAdminTestJSON-282148072 tempest-DeleteServersAdminTestJSON-282148072-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:54:55.043002 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-4c65c604-e801-4a3e-9b4f-ef21e7c8e340 tempest-DeleteServersAdminTestJSON-282148072 tempest-DeleteServersAdminTestJSON-282148072-project-admin] [instance: 4ebac531-6f77-4108-afc9-0eccb86dee8b] Going to try to terminate instance {{(pid=121402) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 01 18:54:55.234049 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-4c65c604-e801-4a3e-9b4f-ef21e7c8e340 tempest-DeleteServersAdminTestJSON-282148072 tempest-DeleteServersAdminTestJSON-282148072-project-admin] 10.222.0.13 "DELETE /compute/v2.1/servers/4ebac531-6f77-4108-afc9-0eccb86dee8b" status: 204 len: 0 microversion: 2.1 time: 0.652869 Nov 01 18:54:55.235989 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 84/174] 10.222.0.13 () {58 vars in 1239 bytes} [Tue Nov 1 18:54:54 2022] DELETE /compute/v2.1/servers/4ebac531-6f77-4108-afc9-0eccb86dee8b => generated 0 bytes in 656 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 01 18:54:55.247128 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-1ac4f710-773d-401e-9267-e9f6f0d34737 tempest-AggregatesAdminTestJSON-768412114 tempest-AggregatesAdminTestJSON-768412114-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:54:55.249467 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-1ac4f710-773d-401e-9267-e9f6f0d34737 tempest-AggregatesAdminTestJSON-768412114 tempest-AggregatesAdminTestJSON-768412114-project] [instance: 7967bf1f-943f-441d-befd-373868bbb3aa] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:54:55.264800 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-1ac4f710-773d-401e-9267-e9f6f0d34737 tempest-AggregatesAdminTestJSON-768412114 tempest-AggregatesAdminTestJSON-768412114-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:54:55.265296 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-1ac4f710-773d-401e-9267-e9f6f0d34737 tempest-AggregatesAdminTestJSON-768412114 tempest-AggregatesAdminTestJSON-768412114-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:54:55.265733 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-1ac4f710-773d-401e-9267-e9f6f0d34737 tempest-AggregatesAdminTestJSON-768412114 tempest-AggregatesAdminTestJSON-768412114-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:54:55.266441 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-1ac4f710-773d-401e-9267-e9f6f0d34737 tempest-AggregatesAdminTestJSON-768412114 tempest-AggregatesAdminTestJSON-768412114-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:54:55.267954 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-1ac4f710-773d-401e-9267-e9f6f0d34737 tempest-AggregatesAdminTestJSON-768412114 tempest-AggregatesAdminTestJSON-768412114-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:54:55.268446 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-1ac4f710-773d-401e-9267-e9f6f0d34737 tempest-AggregatesAdminTestJSON-768412114 tempest-AggregatesAdminTestJSON-768412114-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:54:55.399032 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-eb51f21c-00dd-488a-a07f-a7dfd57040ac tempest-InstanceUsageAuditLogNegativeTestJSON-1953502874 tempest-InstanceUsageAuditLogNegativeTestJSON-1953502874-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:54:55.402281 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-eb51f21c-00dd-488a-a07f-a7dfd57040ac tempest-InstanceUsageAuditLogNegativeTestJSON-1953502874 tempest-InstanceUsageAuditLogNegativeTestJSON-1953502874-project] Policy check for os_compute_api:os-instance-usage-audit-log:list failed with credentials {'is_admin': False, 'user_id': '9870b1d542b94a30b2dada8502a2eefe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f13fda5458c47a39ff0db3523418e1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:54:55.404233 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-eb51f21c-00dd-488a-a07f-a7dfd57040ac tempest-InstanceUsageAuditLogNegativeTestJSON-1953502874 tempest-InstanceUsageAuditLogNegativeTestJSON-1953502874-project] Request method failure captured: Nov 01 18:54:55.404233 n-d-863052-2 devstack@n-api.service[121403]: request: GET /compute/v2.1/os-instance_usage_audit_log HTTP/1.1 Nov 01 18:54:55.404233 n-d-863052-2 devstack@n-api.service[121403]: Accept: application/json Nov 01 18:54:55.404233 n-d-863052-2 devstack@n-api.service[121403]: Accept-Encoding: identity Nov 01 18:54:55.404233 n-d-863052-2 devstack@n-api.service[121403]: Connection: close Nov 01 18:54:55.404233 n-d-863052-2 devstack@n-api.service[121403]: Content-Length: 0 Nov 01 18:54:55.404233 n-d-863052-2 devstack@n-api.service[121403]: Content-Type: application/json Nov 01 18:54:55.404233 n-d-863052-2 devstack@n-api.service[121403]: Host: 10.222.0.13 Nov 01 18:54:55.404233 n-d-863052-2 devstack@n-api.service[121403]: Openstack-System-Scope: None Nov 01 18:54:55.404233 n-d-863052-2 devstack@n-api.service[121403]: User-Agent: python-urllib3/1.26.12 Nov 01 18:54:55.404233 n-d-863052-2 devstack@n-api.service[121403]: X-Auth-Token: gAAAAABjYWt8F5n93AH0TgBrW-DKZeJJwX2C4PruRsjNloNAdPQuIpX3MFI35kKXCN62O387MFprAbBzZmgMs8nTYUZKQvLDz0K1K3K2lfcr80OA_XD7F2hW8wDZTLD8SZAC_Wut9J3522I3LuhZX8qxs4eHPSx48tbsymJUDCvSfRBDIa_VrnU Nov 01 18:54:55.404233 n-d-863052-2 devstack@n-api.service[121403]: X-Domain-Id: None Nov 01 18:54:55.404233 n-d-863052-2 devstack@n-api.service[121403]: X-Domain-Name: None Nov 01 18:54:55.404233 n-d-863052-2 devstack@n-api.service[121403]: X-Identity-Status: Confirmed Nov 01 18:54:55.404233 n-d-863052-2 devstack@n-api.service[121403]: X-Is-Admin-Project: True Nov 01 18:54:55.404233 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Domain-Id: default Nov 01 18:54:55.404233 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Domain-Name: Default Nov 01 18:54:55.404233 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Id: 3f13fda5458c47a39ff0db3523418e1a Nov 01 18:54:55.404233 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1953502874 Nov 01 18:54:55.404233 n-d-863052-2 devstack@n-api.service[121403]: X-Role: member,reader Nov 01 18:54:55.404233 n-d-863052-2 devstack@n-api.service[121403]: X-Roles: member,reader Nov 01 18:54:55.406036 n-d-863052-2 devstack@n-api.service[121403]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/3f13fda5458c47a39ff0db3523418e1a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/3f13fda5458c47a39ff0db3523418e1a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_3f13fda5458c47a39ff0db3523418e1a", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/3f13fda5458c47a39ff0db3523418e1a"}]}] Nov 01 18:54:55.406036 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-1953502874 Nov 01 18:54:55.406036 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant-Id: 3f13fda5458c47a39ff0db3523418e1a Nov 01 18:54:55.406036 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1953502874 Nov 01 18:54:55.406036 n-d-863052-2 devstack@n-api.service[121403]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-1953502874-project Nov 01 18:54:55.406036 n-d-863052-2 devstack@n-api.service[121403]: X-User-Domain-Id: default Nov 01 18:54:55.406036 n-d-863052-2 devstack@n-api.service[121403]: X-User-Domain-Name: Default Nov 01 18:54:55.406036 n-d-863052-2 devstack@n-api.service[121403]: X-User-Id: 9870b1d542b94a30b2dada8502a2eefe Nov 01 18:54:55.406036 n-d-863052-2 devstack@n-api.service[121403]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1953502874-project Nov 01 18:54:55.406036 n-d-863052-2 devstack@n-api.service[121403]: method: > Nov 01 18:54:55.406715 n-d-863052-2 devstack@n-api.service[121403]: exception: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Nov 01 18:54:55.406715 n-d-863052-2 devstack@n-api.service[121403]: action_args: {} Nov 01 18:54:55.406715 n-d-863052-2 devstack@n-api.service[121403]: {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 01 18:54:55.406715 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:54:55.406715 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 18:54:55.406715 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 18:54:55.406715 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 01 18:54:55.406715 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 01 18:54:55.406715 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 01 18:54:55.406715 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 01 18:54:55.406715 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 38, in index Nov 01 18:54:55.406715 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi context.can(iual_policies.BASE_POLICY_NAME % 'list', target={}) Nov 01 18:54:55.406715 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Nov 01 18:54:55.406715 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Nov 01 18:54:55.406715 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Nov 01 18:54:55.406715 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Nov 01 18:54:55.406715 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 01 18:54:55.406715 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 01 18:54:55.406715 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 01 18:54:55.406715 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise self.value Nov 01 18:54:55.409897 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Nov 01 18:54:55.409897 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Nov 01 18:54:55.409897 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Nov 01 18:54:55.409897 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return self.enforce( Nov 01 18:54:55.409897 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Nov 01 18:54:55.409897 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Nov 01 18:54:55.409897 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Nov 01 18:54:55.409897 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 18:54:55.409897 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 18:54:55.409897 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 18:54:55.409897 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:54:55.409897 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 18:54:55.409897 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 18:54:55.409897 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Nov 01 18:54:55.409897 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Nov 01 18:54:55.409897 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Nov 01 18:54:55.409897 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 18:54:55.412894 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-eb51f21c-00dd-488a-a07f-a7dfd57040ac tempest-InstanceUsageAuditLogNegativeTestJSON-1953502874 tempest-InstanceUsageAuditLogNegativeTestJSON-1953502874-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. {{(pid=121403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 01 18:54:55.412894 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-eb51f21c-00dd-488a-a07f-a7dfd57040ac tempest-InstanceUsageAuditLogNegativeTestJSON-1953502874 tempest-InstanceUsageAuditLogNegativeTestJSON-1953502874-project] 10.222.0.13 "GET /compute/v2.1/os-instance_usage_audit_log" status: 403 len: 128 microversion: 2.1 time: 0.513847 Nov 01 18:54:55.417441 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 91/175] 10.222.0.13 () {58 vars in 1185 bytes} [Tue Nov 1 18:54:54 2022] GET /compute/v2.1/os-instance_usage_audit_log => generated 128 bytes in 522 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Nov 01 18:54:55.453569 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-fabde0cf-9806-42c1-ad0a-b2eeac47fa84 tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:54:55.455144 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-fabde0cf-9806-42c1-ad0a-b2eeac47fa84 tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] [instance: 4ebac531-6f77-4108-afc9-0eccb86dee8b] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:54:55.480822 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-fabde0cf-9806-42c1-ad0a-b2eeac47fa84 tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:54:55.484018 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-fabde0cf-9806-42c1-ad0a-b2eeac47fa84 tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:54:55.485202 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-fabde0cf-9806-42c1-ad0a-b2eeac47fa84 tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:54:55.495636 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-fabde0cf-9806-42c1-ad0a-b2eeac47fa84 tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:54:55.498655 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-fabde0cf-9806-42c1-ad0a-b2eeac47fa84 tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:54:55.499267 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-fabde0cf-9806-42c1-ad0a-b2eeac47fa84 tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:54:55.778306 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-1ac4f710-773d-401e-9267-e9f6f0d34737 tempest-AggregatesAdminTestJSON-768412114 tempest-AggregatesAdminTestJSON-768412114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439a7ac2509640c49361f9ba6636b34d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8382e1376b104295aa5cef36ba07cf45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:54:55.780860 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-fabde0cf-9806-42c1-ad0a-b2eeac47fa84 tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce2e0d1828674809a3344a7a68f375c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8e1248497284006a7acbb8169627ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:54:55.787689 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-1ac4f710-773d-401e-9267-e9f6f0d34737 tempest-AggregatesAdminTestJSON-768412114 tempest-AggregatesAdminTestJSON-768412114-project] 10.222.0.13 "GET /compute/v2.1/servers/7967bf1f-943f-441d-befd-373868bbb3aa" status: 200 len: 1487 microversion: 2.1 time: 0.550318 Nov 01 18:54:55.795773 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-fabde0cf-9806-42c1-ad0a-b2eeac47fa84 tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] 10.222.0.13 "GET /compute/v2.1/servers/4ebac531-6f77-4108-afc9-0eccb86dee8b" status: 200 len: 1497 microversion: 2.1 time: 0.376475 Nov 01 18:54:55.796396 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 85/176] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:54:55 2022] GET /compute/v2.1/servers/7967bf1f-943f-441d-befd-373868bbb3aa => generated 1487 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:54:55.811786 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 92/177] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:54:55 2022] GET /compute/v2.1/servers/4ebac531-6f77-4108-afc9-0eccb86dee8b => generated 1497 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:54:55.817750 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-f818993f-adee-4da6-b150-ff6fbbd34db8 tempest-InstanceUsageAuditLogNegativeTestJSON-1953502874 tempest-InstanceUsageAuditLogNegativeTestJSON-1953502874-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:54:55.819707 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-f818993f-adee-4da6-b150-ff6fbbd34db8 tempest-InstanceUsageAuditLogNegativeTestJSON-1953502874 tempest-InstanceUsageAuditLogNegativeTestJSON-1953502874-project] Policy check for os_compute_api:os-instance-usage-audit-log:show failed with credentials {'is_admin': False, 'user_id': '9870b1d542b94a30b2dada8502a2eefe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f13fda5458c47a39ff0db3523418e1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:54:55.823082 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-37b44ba5-4f5b-49da-877a-aecf56eba753 tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:54:55.823851 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-37b44ba5-4f5b-49da-877a-aecf56eba753 tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] [instance: 26132db2-1798-4ba6-88bb-aaf87f6848b3] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:54:55.842479 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-37b44ba5-4f5b-49da-877a-aecf56eba753 tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:54:55.843252 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-37b44ba5-4f5b-49da-877a-aecf56eba753 tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:54:55.843981 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-37b44ba5-4f5b-49da-877a-aecf56eba753 tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:54:55.845060 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-37b44ba5-4f5b-49da-877a-aecf56eba753 tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:54:55.845700 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-37b44ba5-4f5b-49da-877a-aecf56eba753 tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:54:55.846281 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-37b44ba5-4f5b-49da-877a-aecf56eba753 tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:54:55.851305 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-f818993f-adee-4da6-b150-ff6fbbd34db8 tempest-InstanceUsageAuditLogNegativeTestJSON-1953502874 tempest-InstanceUsageAuditLogNegativeTestJSON-1953502874-project] Request method failure captured: Nov 01 18:54:55.851305 n-d-863052-2 devstack@n-api.service[121402]: request: GET /compute/v2.1/os-instance_usage_audit_log/2022-11-01%2018:54:55 HTTP/1.1 Nov 01 18:54:55.851305 n-d-863052-2 devstack@n-api.service[121402]: Accept: application/json Nov 01 18:54:55.851305 n-d-863052-2 devstack@n-api.service[121402]: Accept-Encoding: identity Nov 01 18:54:55.851305 n-d-863052-2 devstack@n-api.service[121402]: Connection: close Nov 01 18:54:55.851305 n-d-863052-2 devstack@n-api.service[121402]: Content-Length: 0 Nov 01 18:54:55.851305 n-d-863052-2 devstack@n-api.service[121402]: Content-Type: application/json Nov 01 18:54:55.851305 n-d-863052-2 devstack@n-api.service[121402]: Host: 10.222.0.13 Nov 01 18:54:55.851305 n-d-863052-2 devstack@n-api.service[121402]: Openstack-System-Scope: None Nov 01 18:54:55.851305 n-d-863052-2 devstack@n-api.service[121402]: User-Agent: python-urllib3/1.26.12 Nov 01 18:54:55.851305 n-d-863052-2 devstack@n-api.service[121402]: X-Auth-Token: gAAAAABjYWt8F5n93AH0TgBrW-DKZeJJwX2C4PruRsjNloNAdPQuIpX3MFI35kKXCN62O387MFprAbBzZmgMs8nTYUZKQvLDz0K1K3K2lfcr80OA_XD7F2hW8wDZTLD8SZAC_Wut9J3522I3LuhZX8qxs4eHPSx48tbsymJUDCvSfRBDIa_VrnU Nov 01 18:54:55.851305 n-d-863052-2 devstack@n-api.service[121402]: X-Domain-Id: None Nov 01 18:54:55.851305 n-d-863052-2 devstack@n-api.service[121402]: X-Domain-Name: None Nov 01 18:54:55.851305 n-d-863052-2 devstack@n-api.service[121402]: X-Identity-Status: Confirmed Nov 01 18:54:55.851305 n-d-863052-2 devstack@n-api.service[121402]: X-Is-Admin-Project: True Nov 01 18:54:55.851305 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Domain-Id: default Nov 01 18:54:55.851305 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Domain-Name: Default Nov 01 18:54:55.851305 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Id: 3f13fda5458c47a39ff0db3523418e1a Nov 01 18:54:55.851305 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1953502874 Nov 01 18:54:55.851305 n-d-863052-2 devstack@n-api.service[121402]: X-Role: member,reader Nov 01 18:54:55.851305 n-d-863052-2 devstack@n-api.service[121402]: X-Roles: member,reader Nov 01 18:54:55.853482 n-d-863052-2 devstack@n-api.service[121402]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/3f13fda5458c47a39ff0db3523418e1a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/3f13fda5458c47a39ff0db3523418e1a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_3f13fda5458c47a39ff0db3523418e1a", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/3f13fda5458c47a39ff0db3523418e1a"}]}] Nov 01 18:54:55.853482 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-1953502874 Nov 01 18:54:55.853482 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant-Id: 3f13fda5458c47a39ff0db3523418e1a Nov 01 18:54:55.853482 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1953502874 Nov 01 18:54:55.853482 n-d-863052-2 devstack@n-api.service[121402]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-1953502874-project Nov 01 18:54:55.853482 n-d-863052-2 devstack@n-api.service[121402]: X-User-Domain-Id: default Nov 01 18:54:55.853482 n-d-863052-2 devstack@n-api.service[121402]: X-User-Domain-Name: Default Nov 01 18:54:55.853482 n-d-863052-2 devstack@n-api.service[121402]: X-User-Id: 9870b1d542b94a30b2dada8502a2eefe Nov 01 18:54:55.853482 n-d-863052-2 devstack@n-api.service[121402]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1953502874-project Nov 01 18:54:55.853482 n-d-863052-2 devstack@n-api.service[121402]: method: > Nov 01 18:54:55.854136 n-d-863052-2 devstack@n-api.service[121402]: exception: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Nov 01 18:54:55.854136 n-d-863052-2 devstack@n-api.service[121402]: action_args: {'id': '2022-11-01 18:54:55'} Nov 01 18:54:55.854136 n-d-863052-2 devstack@n-api.service[121402]: {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 01 18:54:55.854136 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:54:55.854136 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 18:54:55.854136 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 18:54:55.854136 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 01 18:54:55.854136 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 01 18:54:55.854136 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 01 18:54:55.854136 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 01 18:54:55.854136 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 45, in show Nov 01 18:54:55.854136 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi context.can(iual_policies.BASE_POLICY_NAME % 'show', target={}) Nov 01 18:54:55.854136 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Nov 01 18:54:55.854136 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Nov 01 18:54:55.854136 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Nov 01 18:54:55.854136 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Nov 01 18:54:55.854136 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 01 18:54:55.854136 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 01 18:54:55.854136 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 01 18:54:55.854136 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise self.value Nov 01 18:54:55.855575 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Nov 01 18:54:55.855575 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Nov 01 18:54:55.855575 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Nov 01 18:54:55.855575 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return self.enforce( Nov 01 18:54:55.855575 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Nov 01 18:54:55.855575 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Nov 01 18:54:55.855575 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Nov 01 18:54:55.855575 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 18:54:55.855575 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 18:54:55.855575 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 18:54:55.855575 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:54:55.855575 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 18:54:55.855575 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 18:54:55.855575 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Nov 01 18:54:55.855575 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Nov 01 18:54:55.855575 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Nov 01 18:54:55.855575 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 18:54:55.857169 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-f818993f-adee-4da6-b150-ff6fbbd34db8 tempest-InstanceUsageAuditLogNegativeTestJSON-1953502874 tempest-InstanceUsageAuditLogNegativeTestJSON-1953502874-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. {{(pid=121402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 01 18:54:55.859384 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-f818993f-adee-4da6-b150-ff6fbbd34db8 tempest-InstanceUsageAuditLogNegativeTestJSON-1953502874 tempest-InstanceUsageAuditLogNegativeTestJSON-1953502874-project] 10.222.0.13 "GET /compute/v2.1/os-instance_usage_audit_log/2022-11-01 18:54:55" status: 403 len: 128 microversion: 2.1 time: 0.060582 Nov 01 18:54:55.864471 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 86/178] 10.222.0.13 () {58 vars in 1251 bytes} [Tue Nov 1 18:54:55 2022] GET /compute/v2.1/os-instance_usage_audit_log/2022-11-01%2018%3A54%3A55 => generated 128 bytes in 65 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Nov 01 18:54:56.013934 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-37b44ba5-4f5b-49da-877a-aecf56eba753 tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07a2a96629f4baea6a3adfc4011ffe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9baf3860ba564f5c8dff93085b9aabe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:54:56.023921 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-37b44ba5-4f5b-49da-877a-aecf56eba753 tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] 10.222.0.13 "GET /compute/v2.1/servers/26132db2-1798-4ba6-88bb-aaf87f6848b3" status: 200 len: 1320 microversion: 2.1 time: 0.210155 Nov 01 18:54:56.024529 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 93/179] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:54:55 2022] GET /compute/v2.1/servers/26132db2-1798-4ba6-88bb-aaf87f6848b3 => generated 1320 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:54:56.037612 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-e65f0df0-70a8-4969-a26d-08eeb2c08211 tempest-AggregatesAdminTestJSON-1442378289 tempest-AggregatesAdminTestJSON-1442378289-project-admin] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:54:56.037612 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-e65f0df0-70a8-4969-a26d-08eeb2c08211 tempest-AggregatesAdminTestJSON-1442378289 tempest-AggregatesAdminTestJSON-1442378289-project-admin] [instance: 7967bf1f-943f-441d-befd-373868bbb3aa] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:54:56.042756 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-e65f0df0-70a8-4969-a26d-08eeb2c08211 tempest-AggregatesAdminTestJSON-1442378289 tempest-AggregatesAdminTestJSON-1442378289-project-admin] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:54:56.042756 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-e65f0df0-70a8-4969-a26d-08eeb2c08211 tempest-AggregatesAdminTestJSON-1442378289 tempest-AggregatesAdminTestJSON-1442378289-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:54:56.042756 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-e65f0df0-70a8-4969-a26d-08eeb2c08211 tempest-AggregatesAdminTestJSON-1442378289 tempest-AggregatesAdminTestJSON-1442378289-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:54:56.042756 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-e65f0df0-70a8-4969-a26d-08eeb2c08211 tempest-AggregatesAdminTestJSON-1442378289 tempest-AggregatesAdminTestJSON-1442378289-project-admin] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:54:56.043138 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-e65f0df0-70a8-4969-a26d-08eeb2c08211 tempest-AggregatesAdminTestJSON-1442378289 tempest-AggregatesAdminTestJSON-1442378289-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:54:56.043138 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-e65f0df0-70a8-4969-a26d-08eeb2c08211 tempest-AggregatesAdminTestJSON-1442378289 tempest-AggregatesAdminTestJSON-1442378289-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:54:56.277837 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-1947d5b8-d10b-44de-abd8-097554e9ce84 tempest-FlavorsV261TestJSON-628721237 tempest-FlavorsV261TestJSON-628721237-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV261TestJSON-flavor-1983219944", "id": 699239029, "os-flavor-access:is_public": "True"}} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 18:54:56.635228 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-1947d5b8-d10b-44de-abd8-097554e9ce84 tempest-FlavorsV261TestJSON-628721237 tempest-FlavorsV261TestJSON-628721237-project-admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 465 microversion: 2.61 time: 0.771047 Nov 01 18:54:56.646044 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 87/180] 10.222.0.13 () {62 vars in 1188 bytes} [Tue Nov 1 18:54:55 2022] POST /compute/v2.1/flavors => generated 465 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 01 18:54:56.695387 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-e65f0df0-70a8-4969-a26d-08eeb2c08211 tempest-AggregatesAdminTestJSON-1442378289 tempest-AggregatesAdminTestJSON-1442378289-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/7967bf1f-943f-441d-befd-373868bbb3aa" status: 200 len: 1638 microversion: 2.1 time: 0.669596 Nov 01 18:54:56.699619 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 94/181] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:54:56 2022] GET /compute/v2.1/servers/7967bf1f-943f-441d-befd-373868bbb3aa => generated 1638 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:54:56.724679 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-b24f3b43-45d6-4b3e-83e9-a584a4a16874 tempest-AggregatesAdminTestJSON-768412114 tempest-AggregatesAdminTestJSON-768412114-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:54:56.725178 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-b24f3b43-45d6-4b3e-83e9-a584a4a16874 tempest-AggregatesAdminTestJSON-768412114 tempest-AggregatesAdminTestJSON-768412114-project] [instance: 7967bf1f-943f-441d-befd-373868bbb3aa] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:54:56.739603 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-b24f3b43-45d6-4b3e-83e9-a584a4a16874 tempest-AggregatesAdminTestJSON-768412114 tempest-AggregatesAdminTestJSON-768412114-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:54:56.740097 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-b24f3b43-45d6-4b3e-83e9-a584a4a16874 tempest-AggregatesAdminTestJSON-768412114 tempest-AggregatesAdminTestJSON-768412114-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:54:56.740526 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-b24f3b43-45d6-4b3e-83e9-a584a4a16874 tempest-AggregatesAdminTestJSON-768412114 tempest-AggregatesAdminTestJSON-768412114-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:54:56.741568 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-b24f3b43-45d6-4b3e-83e9-a584a4a16874 tempest-AggregatesAdminTestJSON-768412114 tempest-AggregatesAdminTestJSON-768412114-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:54:56.741685 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-b24f3b43-45d6-4b3e-83e9-a584a4a16874 tempest-AggregatesAdminTestJSON-768412114 tempest-AggregatesAdminTestJSON-768412114-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:54:56.742096 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-b24f3b43-45d6-4b3e-83e9-a584a4a16874 tempest-AggregatesAdminTestJSON-768412114 tempest-AggregatesAdminTestJSON-768412114-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:54:56.820201 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-b24f3b43-45d6-4b3e-83e9-a584a4a16874 tempest-AggregatesAdminTestJSON-768412114 tempest-AggregatesAdminTestJSON-768412114-project] [instance: 7967bf1f-943f-441d-befd-373868bbb3aa] Going to try to terminate instance {{(pid=121403) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 01 18:54:57.143322 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-b24f3b43-45d6-4b3e-83e9-a584a4a16874 tempest-AggregatesAdminTestJSON-768412114 tempest-AggregatesAdminTestJSON-768412114-project] 10.222.0.13 "DELETE /compute/v2.1/servers/7967bf1f-943f-441d-befd-373868bbb3aa" status: 204 len: 0 microversion: 2.1 time: 0.422511 Nov 01 18:54:57.144017 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 95/182] 10.222.0.13 () {58 vars in 1239 bytes} [Tue Nov 1 18:54:56 2022] DELETE /compute/v2.1/servers/7967bf1f-943f-441d-befd-373868bbb3aa => generated 0 bytes in 424 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 01 18:54:57.419089 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-a81d7b79-9278-452b-b24e-013eb32a7e55 tempest-FlavorsV261TestJSON-877682410 tempest-FlavorsV261TestJSON-877682410-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:54:57.453650 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-a81d7b79-9278-452b-b24e-013eb32a7e55 tempest-FlavorsV261TestJSON-877682410 tempest-FlavorsV261TestJSON-877682410-project] 10.222.0.13 "GET /compute/v2.1/flavors/699239029" status: 200 len: 465 microversion: 2.61 time: 0.806379 Nov 01 18:54:57.466028 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 88/183] 10.222.0.13 () {60 vars in 1196 bytes} [Tue Nov 1 18:54:56 2022] GET /compute/v2.1/flavors/699239029 => generated 465 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 01 18:54:57.471934 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-d2781eb7-013f-40a3-b696-8e4243bbc107 tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:54:57.472985 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-d2781eb7-013f-40a3-b696-8e4243bbc107 tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] [instance: 4ebac531-6f77-4108-afc9-0eccb86dee8b] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:54:57.484478 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-d2781eb7-013f-40a3-b696-8e4243bbc107 tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:54:57.485228 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-d2781eb7-013f-40a3-b696-8e4243bbc107 tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:54:57.485960 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-d2781eb7-013f-40a3-b696-8e4243bbc107 tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:54:57.487108 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-d2781eb7-013f-40a3-b696-8e4243bbc107 tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:54:57.487878 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-d2781eb7-013f-40a3-b696-8e4243bbc107 tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:54:57.488441 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-d2781eb7-013f-40a3-b696-8e4243bbc107 tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:54:57.557857 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-1f130f4c-b457-499d-b83d-8af2d531a7db tempest-HypervisorAdminTestJSON-108693606 tempest-HypervisorAdminTestJSON-108693606-project-admin] Calling method '.version_select at 0x7f0ae30579d0>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:54:57.568648 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-1f130f4c-b457-499d-b83d-8af2d531a7db tempest-HypervisorAdminTestJSON-108693606 tempest-HypervisorAdminTestJSON-108693606-project-admin] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:54:57.569148 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-1f130f4c-b457-499d-b83d-8af2d531a7db tempest-HypervisorAdminTestJSON-108693606 tempest-HypervisorAdminTestJSON-108693606-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:54:57.569585 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-1f130f4c-b457-499d-b83d-8af2d531a7db tempest-HypervisorAdminTestJSON-108693606 tempest-HypervisorAdminTestJSON-108693606-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:54:57.639829 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-d2781eb7-013f-40a3-b696-8e4243bbc107 tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce2e0d1828674809a3344a7a68f375c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8e1248497284006a7acbb8169627ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:54:57.651499 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-d2781eb7-013f-40a3-b696-8e4243bbc107 tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] 10.222.0.13 "GET /compute/v2.1/servers/4ebac531-6f77-4108-afc9-0eccb86dee8b" status: 200 len: 1455 microversion: 2.1 time: 0.183548 Nov 01 18:54:57.652700 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 89/184] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:54:57 2022] GET /compute/v2.1/servers/4ebac531-6f77-4108-afc9-0eccb86dee8b => generated 1455 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:54:57.658075 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-d716896b-86d1-435e-aa64-f169d4bf1199 tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:54:57.658934 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-d716896b-86d1-435e-aa64-f169d4bf1199 tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] [instance: 26132db2-1798-4ba6-88bb-aaf87f6848b3] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:54:57.676935 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-d716896b-86d1-435e-aa64-f169d4bf1199 tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:54:57.677584 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-d716896b-86d1-435e-aa64-f169d4bf1199 tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:54:57.678016 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-d716896b-86d1-435e-aa64-f169d4bf1199 tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:54:57.678720 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-d716896b-86d1-435e-aa64-f169d4bf1199 tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:54:57.679172 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-d716896b-86d1-435e-aa64-f169d4bf1199 tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:54:57.679581 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-d716896b-86d1-435e-aa64-f169d4bf1199 tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:54:57.804860 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-d716896b-86d1-435e-aa64-f169d4bf1199 tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07a2a96629f4baea6a3adfc4011ffe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9baf3860ba564f5c8dff93085b9aabe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:54:57.816312 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-d716896b-86d1-435e-aa64-f169d4bf1199 tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] 10.222.0.13 "GET /compute/v2.1/servers/26132db2-1798-4ba6-88bb-aaf87f6848b3" status: 200 len: 1320 microversion: 2.1 time: 0.162304 Nov 01 18:54:57.820801 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 90/185] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:54:57 2022] GET /compute/v2.1/servers/26132db2-1798-4ba6-88bb-aaf87f6848b3 => generated 1320 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:54:57.832382 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-52067e0c-fd2f-4c73-8e6f-b80f06ef6828 tempest-AggregatesAdminTestJSON-768412114 tempest-AggregatesAdminTestJSON-768412114-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:54:57.833614 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-52067e0c-fd2f-4c73-8e6f-b80f06ef6828 tempest-AggregatesAdminTestJSON-768412114 tempest-AggregatesAdminTestJSON-768412114-project] [instance: 7967bf1f-943f-441d-befd-373868bbb3aa] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:54:57.842538 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-52067e0c-fd2f-4c73-8e6f-b80f06ef6828 tempest-AggregatesAdminTestJSON-768412114 tempest-AggregatesAdminTestJSON-768412114-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:54:57.843902 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-52067e0c-fd2f-4c73-8e6f-b80f06ef6828 tempest-AggregatesAdminTestJSON-768412114 tempest-AggregatesAdminTestJSON-768412114-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:54:57.844561 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-52067e0c-fd2f-4c73-8e6f-b80f06ef6828 tempest-AggregatesAdminTestJSON-768412114 tempest-AggregatesAdminTestJSON-768412114-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:54:57.845482 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-52067e0c-fd2f-4c73-8e6f-b80f06ef6828 tempest-AggregatesAdminTestJSON-768412114 tempest-AggregatesAdminTestJSON-768412114-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:54:57.846302 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-52067e0c-fd2f-4c73-8e6f-b80f06ef6828 tempest-AggregatesAdminTestJSON-768412114 tempest-AggregatesAdminTestJSON-768412114-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:54:57.848435 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-52067e0c-fd2f-4c73-8e6f-b80f06ef6828 tempest-AggregatesAdminTestJSON-768412114 tempest-AggregatesAdminTestJSON-768412114-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:54:57.945062 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-1f130f4c-b457-499d-b83d-8af2d531a7db tempest-HypervisorAdminTestJSON-108693606 tempest-HypervisorAdminTestJSON-108693606-project-admin] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:54:57.945724 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-1f130f4c-b457-499d-b83d-8af2d531a7db tempest-HypervisorAdminTestJSON-108693606 tempest-HypervisorAdminTestJSON-108693606-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:54:57.948143 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-1f130f4c-b457-499d-b83d-8af2d531a7db tempest-HypervisorAdminTestJSON-108693606 tempest-HypervisorAdminTestJSON-108693606-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:54:57.973263 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-1f130f4c-b457-499d-b83d-8af2d531a7db tempest-HypervisorAdminTestJSON-108693606 tempest-HypervisorAdminTestJSON-108693606-project-admin] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:54:57.974497 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-1f130f4c-b457-499d-b83d-8af2d531a7db tempest-HypervisorAdminTestJSON-108693606 tempest-HypervisorAdminTestJSON-108693606-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:54:57.975159 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-1f130f4c-b457-499d-b83d-8af2d531a7db tempest-HypervisorAdminTestJSON-108693606 tempest-HypervisorAdminTestJSON-108693606-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:54:57.993452 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-1f130f4c-b457-499d-b83d-8af2d531a7db tempest-HypervisorAdminTestJSON-108693606 tempest-HypervisorAdminTestJSON-108693606-project-admin] 10.222.0.13 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.847335 Nov 01 18:54:57.994809 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 96/186] 10.222.0.13 () {58 vars in 1146 bytes} [Tue Nov 1 18:54:57 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 850 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 18:54:58.002054 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-10737832-91a6-4f72-b824-7fd605e88e61 tempest-FlavorsV261TestJSON-628721237 tempest-FlavorsV261TestJSON-628721237-project-admin] Action: 'update', calling method: .version_select at 0x7f0ae43b6c10>, body: {"flavor": {"description": "new"}} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 18:54:58.067042 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-10737832-91a6-4f72-b824-7fd605e88e61 tempest-FlavorsV261TestJSON-628721237 tempest-FlavorsV261TestJSON-628721237-project-admin] 10.222.0.13 "PUT /compute/v2.1/flavors/699239029" status: 200 len: 466 microversion: 2.61 time: 0.070864 Nov 01 18:54:58.068032 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-52067e0c-fd2f-4c73-8e6f-b80f06ef6828 tempest-AggregatesAdminTestJSON-768412114 tempest-AggregatesAdminTestJSON-768412114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439a7ac2509640c49361f9ba6636b34d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8382e1376b104295aa5cef36ba07cf45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:54:58.068173 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 97/187] 10.222.0.13 () {62 vars in 1216 bytes} [Tue Nov 1 18:54:57 2022] PUT /compute/v2.1/flavors/699239029 => generated 466 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 01 18:54:58.073191 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [req-a662549a-2bb7-4d6f-b025-a7f1ffcfa0d9 req-7e5d60d9-467a-425c-9f2c-38c4905beb07 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4ebac531-6f77-4108-afc9-0eccb86dee8b", "name": "network-vif-deleted", "tag": "8abf404d-d3c6-4853-a8a7-331b2d566057"}]} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 18:54:58.081495 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-52067e0c-fd2f-4c73-8e6f-b80f06ef6828 tempest-AggregatesAdminTestJSON-768412114 tempest-AggregatesAdminTestJSON-768412114-project] 10.222.0.13 "GET /compute/v2.1/servers/7967bf1f-943f-441d-befd-373868bbb3aa" status: 200 len: 1493 microversion: 2.1 time: 0.258802 Nov 01 18:54:58.097390 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-a662549a-2bb7-4d6f-b025-a7f1ffcfa0d9 req-7e5d60d9-467a-425c-9f2c-38c4905beb07 service nova] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:54:58.097390 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-a662549a-2bb7-4d6f-b025-a7f1ffcfa0d9 req-7e5d60d9-467a-425c-9f2c-38c4905beb07 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:54:58.097390 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-a662549a-2bb7-4d6f-b025-a7f1ffcfa0d9 req-7e5d60d9-467a-425c-9f2c-38c4905beb07 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:54:58.097992 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 91/188] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:54:57 2022] GET /compute/v2.1/servers/7967bf1f-943f-441d-befd-373868bbb3aa => generated 1493 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:54:58.106555 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-d511b187-442e-4801-a324-020d217201b4 tempest-HypervisorAdminTestJSON-108693606 tempest-HypervisorAdminTestJSON-108693606-project-admin] Calling method '.version_select at 0x7f0ae3029940>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:54:58.110512 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-d511b187-442e-4801-a324-020d217201b4 tempest-HypervisorAdminTestJSON-108693606 tempest-HypervisorAdminTestJSON-108693606-project-admin] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:54:58.114672 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-d511b187-442e-4801-a324-020d217201b4 tempest-HypervisorAdminTestJSON-108693606 tempest-HypervisorAdminTestJSON-108693606-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:54:58.115315 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-d511b187-442e-4801-a324-020d217201b4 tempest-HypervisorAdminTestJSON-108693606 tempest-HypervisorAdminTestJSON-108693606-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:54:58.119390 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.compute.server_external_events [req-a662549a-2bb7-4d6f-b025-a7f1ffcfa0d9 req-7e5d60d9-467a-425c-9f2c-38c4905beb07 service nova] Creating event network-vif-deleted:8abf404d-d3c6-4853-a8a7-331b2d566057 for instance 4ebac531-6f77-4108-afc9-0eccb86dee8b on n-h1-863052-2 Nov 01 18:54:58.131398 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [req-a662549a-2bb7-4d6f-b025-a7f1ffcfa0d9 req-7e5d60d9-467a-425c-9f2c-38c4905beb07 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061373 Nov 01 18:54:58.132647 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 98/189] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Nov 1 18:54:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 18:54:58.140480 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-4a9b9a11-1523-4861-a03a-6103ceb02db5 tempest-FlavorsV261TestJSON-877682410 tempest-FlavorsV261TestJSON-877682410-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:54:58.154346 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-d511b187-442e-4801-a324-020d217201b4 tempest-HypervisorAdminTestJSON-108693606 tempest-HypervisorAdminTestJSON-108693606-project-admin] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:54:58.159699 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-d511b187-442e-4801-a324-020d217201b4 tempest-HypervisorAdminTestJSON-108693606 tempest-HypervisorAdminTestJSON-108693606-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:54:58.160363 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-d511b187-442e-4801-a324-020d217201b4 tempest-HypervisorAdminTestJSON-108693606 tempest-HypervisorAdminTestJSON-108693606-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:54:58.169318 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-4a9b9a11-1523-4861-a03a-6103ceb02db5 tempest-FlavorsV261TestJSON-877682410 tempest-FlavorsV261TestJSON-877682410-project] 10.222.0.13 "GET /compute/v2.1/flavors/detail" status: 200 len: 7154 microversion: 2.61 time: 0.034669 Nov 01 18:54:58.182369 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 99/190] 10.222.0.13 () {60 vars in 1187 bytes} [Tue Nov 1 18:54:58 2022] GET /compute/v2.1/flavors/detail => generated 7154 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 18:54:58.189390 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-d511b187-442e-4801-a324-020d217201b4 tempest-HypervisorAdminTestJSON-108693606 tempest-HypervisorAdminTestJSON-108693606-project-admin] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:54:58.189390 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-d511b187-442e-4801-a324-020d217201b4 tempest-HypervisorAdminTestJSON-108693606 tempest-HypervisorAdminTestJSON-108693606-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:54:58.189390 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-d511b187-442e-4801-a324-020d217201b4 tempest-HypervisorAdminTestJSON-108693606 tempest-HypervisorAdminTestJSON-108693606-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:54:58.196467 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-ae2d6f9e-93b5-4996-8abb-f875843e5a53 tempest-FlavorsV261TestJSON-877682410 tempest-FlavorsV261TestJSON-877682410-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:54:58.200058 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-d511b187-442e-4801-a324-020d217201b4 tempest-HypervisorAdminTestJSON-108693606 tempest-HypervisorAdminTestJSON-108693606-project-admin] 10.222.0.13 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1505 microversion: 2.1 time: 0.104907 Nov 01 18:54:58.216887 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 92/191] 10.222.0.13 () {58 vars in 1167 bytes} [Tue Nov 1 18:54:58 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1505 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:54:58.225043 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-2fc465ff-4cf7-45cf-9135-3b87390a81bd tempest-HypervisorAdminTestJSON-108693606 tempest-HypervisorAdminTestJSON-108693606-project-admin] Calling method '.version_select at 0x7f0ae2ec9e50>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:54:58.226999 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2fc465ff-4cf7-45cf-9135-3b87390a81bd tempest-HypervisorAdminTestJSON-108693606 tempest-HypervisorAdminTestJSON-108693606-project-admin] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:54:58.228800 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2fc465ff-4cf7-45cf-9135-3b87390a81bd tempest-HypervisorAdminTestJSON-108693606 tempest-HypervisorAdminTestJSON-108693606-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:54:58.229342 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2fc465ff-4cf7-45cf-9135-3b87390a81bd tempest-HypervisorAdminTestJSON-108693606 tempest-HypervisorAdminTestJSON-108693606-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:54:58.248035 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-ae2d6f9e-93b5-4996-8abb-f875843e5a53 tempest-FlavorsV261TestJSON-877682410 tempest-FlavorsV261TestJSON-877682410-project] 10.222.0.13 "GET /compute/v2.1/flavors" status: 200 len: 3681 microversion: 2.61 time: 0.055599 Nov 01 18:54:58.252686 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 100/192] 10.222.0.13 () {60 vars in 1166 bytes} [Tue Nov 1 18:54:58 2022] GET /compute/v2.1/flavors => generated 3681 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 01 18:54:58.263159 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2fc465ff-4cf7-45cf-9135-3b87390a81bd tempest-HypervisorAdminTestJSON-108693606 tempest-HypervisorAdminTestJSON-108693606-project-admin] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:54:58.263807 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2fc465ff-4cf7-45cf-9135-3b87390a81bd tempest-HypervisorAdminTestJSON-108693606 tempest-HypervisorAdminTestJSON-108693606-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:54:58.264343 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2fc465ff-4cf7-45cf-9135-3b87390a81bd tempest-HypervisorAdminTestJSON-108693606 tempest-HypervisorAdminTestJSON-108693606-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:54:58.269675 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-1e0f7914-b98a-48be-8292-ab84a24f9215 tempest-FlavorsV261TestJSON-628721237 tempest-FlavorsV261TestJSON-628721237-project-admin] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:54:58.295987 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2fc465ff-4cf7-45cf-9135-3b87390a81bd tempest-HypervisorAdminTestJSON-108693606 tempest-HypervisorAdminTestJSON-108693606-project-admin] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:54:58.297998 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2fc465ff-4cf7-45cf-9135-3b87390a81bd tempest-HypervisorAdminTestJSON-108693606 tempest-HypervisorAdminTestJSON-108693606-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:54:58.299756 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2fc465ff-4cf7-45cf-9135-3b87390a81bd tempest-HypervisorAdminTestJSON-108693606 tempest-HypervisorAdminTestJSON-108693606-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:54:58.304100 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-1e0f7914-b98a-48be-8292-ab84a24f9215 tempest-FlavorsV261TestJSON-628721237 tempest-FlavorsV261TestJSON-628721237-project-admin] 10.222.0.13 "DELETE /compute/v2.1/flavors/699239029" status: 202 len: 0 microversion: 2.61 time: 0.039433 Nov 01 18:54:58.309264 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 101/193] 10.222.0.13 () {60 vars in 1199 bytes} [Tue Nov 1 18:54:58 2022] DELETE /compute/v2.1/flavors/699239029 => generated 0 bytes in 42 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 01 18:54:58.316261 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-bec2b16f-5c14-4c9f-b76d-719eea6ef9cb tempest-FlavorsV261TestJSON-628721237 tempest-FlavorsV261TestJSON-628721237-project-admin] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:54:58.318270 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-2fc465ff-4cf7-45cf-9135-3b87390a81bd tempest-HypervisorAdminTestJSON-108693606 tempest-HypervisorAdminTestJSON-108693606-project-admin] 10.222.0.13 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.096742 Nov 01 18:54:58.320679 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 93/194] 10.222.0.13 () {58 vars in 1146 bytes} [Tue Nov 1 18:54:58 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 18:54:58.338671 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-de3e2c56-0d64-4ebb-b0f8-fe4412c772ee tempest-HypervisorAdminTestJSON-108693606 tempest-HypervisorAdminTestJSON-108693606-project-admin] Calling method '.version_select at 0x7f0ae30f2280>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:54:58.349273 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-de3e2c56-0d64-4ebb-b0f8-fe4412c772ee tempest-HypervisorAdminTestJSON-108693606 tempest-HypervisorAdminTestJSON-108693606-project-admin] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:54:58.349778 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-de3e2c56-0d64-4ebb-b0f8-fe4412c772ee tempest-HypervisorAdminTestJSON-108693606 tempest-HypervisorAdminTestJSON-108693606-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:54:58.350225 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-de3e2c56-0d64-4ebb-b0f8-fe4412c772ee tempest-HypervisorAdminTestJSON-108693606 tempest-HypervisorAdminTestJSON-108693606-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:54:58.359868 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-bec2b16f-5c14-4c9f-b76d-719eea6ef9cb tempest-FlavorsV261TestJSON-628721237 tempest-FlavorsV261TestJSON-628721237-project-admin] 10.222.0.13 "GET /compute/v2.1/flavors/detail" status: 200 len: 6698 microversion: 2.61 time: 0.048691 Nov 01 18:54:58.360955 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 102/195] 10.222.0.13 () {60 vars in 1187 bytes} [Tue Nov 1 18:54:58 2022] GET /compute/v2.1/flavors/detail => generated 6698 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 18:54:58.381287 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-de3e2c56-0d64-4ebb-b0f8-fe4412c772ee tempest-HypervisorAdminTestJSON-108693606 tempest-HypervisorAdminTestJSON-108693606-project-admin] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:54:58.381829 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-de3e2c56-0d64-4ebb-b0f8-fe4412c772ee tempest-HypervisorAdminTestJSON-108693606 tempest-HypervisorAdminTestJSON-108693606-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:54:58.382217 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-de3e2c56-0d64-4ebb-b0f8-fe4412c772ee tempest-HypervisorAdminTestJSON-108693606 tempest-HypervisorAdminTestJSON-108693606-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:54:58.440178 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-de3e2c56-0d64-4ebb-b0f8-fe4412c772ee tempest-HypervisorAdminTestJSON-108693606 tempest-HypervisorAdminTestJSON-108693606-project-admin] 10.222.0.13 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 758 microversion: 2.1 time: 0.108813 Nov 01 18:54:58.444242 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 94/196] 10.222.0.13 () {58 vars in 1152 bytes} [Tue Nov 1 18:54:58 2022] GET /compute/v2.1/os-hypervisors/1 => generated 758 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 18:54:58.466290 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-0de66c48-17b0-453e-a548-37ec0fae1142 tempest-HypervisorAdminTestJSON-108693606 tempest-HypervisorAdminTestJSON-108693606-project-admin] Calling method '.version_select at 0x7f0ae30c4430>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:54:58.476460 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-0de66c48-17b0-453e-a548-37ec0fae1142 tempest-HypervisorAdminTestJSON-108693606 tempest-HypervisorAdminTestJSON-108693606-project-admin] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:54:58.481911 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-0de66c48-17b0-453e-a548-37ec0fae1142 tempest-HypervisorAdminTestJSON-108693606 tempest-HypervisorAdminTestJSON-108693606-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:54:58.482632 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-0de66c48-17b0-453e-a548-37ec0fae1142 tempest-HypervisorAdminTestJSON-108693606 tempest-HypervisorAdminTestJSON-108693606-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:54:58.548116 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-0de66c48-17b0-453e-a548-37ec0fae1142 tempest-HypervisorAdminTestJSON-108693606 tempest-HypervisorAdminTestJSON-108693606-project-admin] 10.222.0.13 "GET /compute/v2.1/os-hypervisors/statistics" status: 200 len: 263 microversion: 2.1 time: 0.092268 Nov 01 18:54:58.551026 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 103/197] 10.222.0.13 () {58 vars in 1179 bytes} [Tue Nov 1 18:54:58 2022] GET /compute/v2.1/os-hypervisors/statistics => generated 263 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 18:54:58.563321 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-88a77eec-ec43-4827-85bd-b089ce6b4ff0 tempest-HypervisorAdminTestJSON-108693606 tempest-HypervisorAdminTestJSON-108693606-project-admin] Calling method '.version_select at 0x7f0ae2f640d0>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:54:58.565585 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-88a77eec-ec43-4827-85bd-b089ce6b4ff0 tempest-HypervisorAdminTestJSON-108693606 tempest-HypervisorAdminTestJSON-108693606-project-admin] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:54:58.566169 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-88a77eec-ec43-4827-85bd-b089ce6b4ff0 tempest-HypervisorAdminTestJSON-108693606 tempest-HypervisorAdminTestJSON-108693606-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:54:58.566615 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-88a77eec-ec43-4827-85bd-b089ce6b4ff0 tempest-HypervisorAdminTestJSON-108693606 tempest-HypervisorAdminTestJSON-108693606-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:54:58.594610 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-88a77eec-ec43-4827-85bd-b089ce6b4ff0 tempest-HypervisorAdminTestJSON-108693606 tempest-HypervisorAdminTestJSON-108693606-project-admin] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:54:58.595473 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-88a77eec-ec43-4827-85bd-b089ce6b4ff0 tempest-HypervisorAdminTestJSON-108693606 tempest-HypervisorAdminTestJSON-108693606-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:54:58.596107 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-88a77eec-ec43-4827-85bd-b089ce6b4ff0 tempest-HypervisorAdminTestJSON-108693606 tempest-HypervisorAdminTestJSON-108693606-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:54:58.628891 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-88a77eec-ec43-4827-85bd-b089ce6b4ff0 tempest-HypervisorAdminTestJSON-108693606 tempest-HypervisorAdminTestJSON-108693606-project-admin] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:54:58.629979 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-88a77eec-ec43-4827-85bd-b089ce6b4ff0 tempest-HypervisorAdminTestJSON-108693606 tempest-HypervisorAdminTestJSON-108693606-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:54:58.630562 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-88a77eec-ec43-4827-85bd-b089ce6b4ff0 tempest-HypervisorAdminTestJSON-108693606 tempest-HypervisorAdminTestJSON-108693606-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:54:58.640702 n-d-863052-2 devstack@n-api.service[121402]: DEBUG dbcounter [-] [121402] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 18:54:58.646380 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-88a77eec-ec43-4827-85bd-b089ce6b4ff0 tempest-HypervisorAdminTestJSON-108693606 tempest-HypervisorAdminTestJSON-108693606-project-admin] 10.222.0.13 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.087835 Nov 01 18:54:58.648051 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 95/198] 10.222.0.13 () {58 vars in 1146 bytes} [Tue Nov 1 18:54:58 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 18:54:58.658547 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-e6250774-c8cd-4800-88ac-27a9897709c0 tempest-HypervisorAdminTestJSON-108693606 tempest-HypervisorAdminTestJSON-108693606-project-admin] Calling method '.version_select at 0x7f0ae30c4c10>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:54:58.660365 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-e6250774-c8cd-4800-88ac-27a9897709c0 tempest-HypervisorAdminTestJSON-108693606 tempest-HypervisorAdminTestJSON-108693606-project-admin] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:54:58.660873 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-e6250774-c8cd-4800-88ac-27a9897709c0 tempest-HypervisorAdminTestJSON-108693606 tempest-HypervisorAdminTestJSON-108693606-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:54:58.661307 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-e6250774-c8cd-4800-88ac-27a9897709c0 tempest-HypervisorAdminTestJSON-108693606 tempest-HypervisorAdminTestJSON-108693606-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:54:58.682402 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-a2ab87d1-4db3-40e5-a7fb-e57e0a8fcc3e tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:54:58.683690 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-a2ab87d1-4db3-40e5-a7fb-e57e0a8fcc3e tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] [instance: 4ebac531-6f77-4108-afc9-0eccb86dee8b] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:54:58.699312 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-e6250774-c8cd-4800-88ac-27a9897709c0 tempest-HypervisorAdminTestJSON-108693606 tempest-HypervisorAdminTestJSON-108693606-project-admin] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:54:58.699799 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-e6250774-c8cd-4800-88ac-27a9897709c0 tempest-HypervisorAdminTestJSON-108693606 tempest-HypervisorAdminTestJSON-108693606-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:54:58.705267 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-e6250774-c8cd-4800-88ac-27a9897709c0 tempest-HypervisorAdminTestJSON-108693606 tempest-HypervisorAdminTestJSON-108693606-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:54:58.714597 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-a2ab87d1-4db3-40e5-a7fb-e57e0a8fcc3e tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:54:58.718509 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-a2ab87d1-4db3-40e5-a7fb-e57e0a8fcc3e tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:54:58.719181 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-a2ab87d1-4db3-40e5-a7fb-e57e0a8fcc3e tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:54:58.721518 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-a2ab87d1-4db3-40e5-a7fb-e57e0a8fcc3e tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:54:58.721872 n-d-863052-2 devstack@n-api.service[121403]: DEBUG dbcounter [-] [121403] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 18:54:58.722510 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-a2ab87d1-4db3-40e5-a7fb-e57e0a8fcc3e tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:54:58.723193 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-a2ab87d1-4db3-40e5-a7fb-e57e0a8fcc3e tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:54:58.725198 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-e6250774-c8cd-4800-88ac-27a9897709c0 tempest-HypervisorAdminTestJSON-108693606 tempest-HypervisorAdminTestJSON-108693606-project-admin] 10.222.0.13 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 758 microversion: 2.1 time: 0.071072 Nov 01 18:54:58.725788 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 104/199] 10.222.0.13 () {58 vars in 1152 bytes} [Tue Nov 1 18:54:58 2022] GET /compute/v2.1/os-hypervisors/1 => generated 758 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 18:54:58.770509 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-7280b2d2-8f62-48bc-9bec-dbc058586fa3 tempest-HypervisorAdminTestJSON-108693606 tempest-HypervisorAdminTestJSON-108693606-project-admin] Calling method '.version_select at 0x7f0ae30c4940>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:54:58.786615 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-7280b2d2-8f62-48bc-9bec-dbc058586fa3 tempest-HypervisorAdminTestJSON-108693606 tempest-HypervisorAdminTestJSON-108693606-project-admin] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:54:58.787367 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-7280b2d2-8f62-48bc-9bec-dbc058586fa3 tempest-HypervisorAdminTestJSON-108693606 tempest-HypervisorAdminTestJSON-108693606-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:54:58.789416 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-7280b2d2-8f62-48bc-9bec-dbc058586fa3 tempest-HypervisorAdminTestJSON-108693606 tempest-HypervisorAdminTestJSON-108693606-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:54:58.839069 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-7280b2d2-8f62-48bc-9bec-dbc058586fa3 tempest-HypervisorAdminTestJSON-108693606 tempest-HypervisorAdminTestJSON-108693606-project-admin] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:54:58.839595 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-7280b2d2-8f62-48bc-9bec-dbc058586fa3 tempest-HypervisorAdminTestJSON-108693606 tempest-HypervisorAdminTestJSON-108693606-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:54:58.840064 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-7280b2d2-8f62-48bc-9bec-dbc058586fa3 tempest-HypervisorAdminTestJSON-108693606 tempest-HypervisorAdminTestJSON-108693606-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:54:58.868987 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-7280b2d2-8f62-48bc-9bec-dbc058586fa3 tempest-HypervisorAdminTestJSON-108693606 tempest-HypervisorAdminTestJSON-108693606-project-admin] 10.222.0.13 "GET /compute/v2.1/os-hypervisors/2" status: 200 len: 758 microversion: 2.1 time: 0.131385 Nov 01 18:54:58.890316 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 105/200] 10.222.0.13 () {58 vars in 1152 bytes} [Tue Nov 1 18:54:58 2022] GET /compute/v2.1/os-hypervisors/2 => generated 758 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 01 18:54:58.891378 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-a2ab87d1-4db3-40e5-a7fb-e57e0a8fcc3e tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:54:58.891668 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-a2ab87d1-4db3-40e5-a7fb-e57e0a8fcc3e tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:54:58.899183 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-a2ab87d1-4db3-40e5-a7fb-e57e0a8fcc3e tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:54:58.900511 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.objects.instance [None req-a2ab87d1-4db3-40e5-a7fb-e57e0a8fcc3e tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Lazy-loading 'fault' on Instance uuid 4ebac531-6f77-4108-afc9-0eccb86dee8b {{(pid=121402) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 01 18:54:58.903822 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-89948053-b3e0-42fd-8efa-7f0057b1fcbc tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:54:58.915983 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-89948053-b3e0-42fd-8efa-7f0057b1fcbc tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] [instance: 26132db2-1798-4ba6-88bb-aaf87f6848b3] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:54:58.953216 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-89948053-b3e0-42fd-8efa-7f0057b1fcbc tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:54:58.955938 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-89948053-b3e0-42fd-8efa-7f0057b1fcbc tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:54:58.956596 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-89948053-b3e0-42fd-8efa-7f0057b1fcbc tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:54:58.958072 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-89948053-b3e0-42fd-8efa-7f0057b1fcbc tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:54:58.960492 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-89948053-b3e0-42fd-8efa-7f0057b1fcbc tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:54:58.963323 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-89948053-b3e0-42fd-8efa-7f0057b1fcbc tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:54:59.163609 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-a2ab87d1-4db3-40e5-a7fb-e57e0a8fcc3e tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce2e0d1828674809a3344a7a68f375c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8e1248497284006a7acbb8169627ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:54:59.177946 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-a2ab87d1-4db3-40e5-a7fb-e57e0a8fcc3e tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] 10.222.0.13 "GET /compute/v2.1/servers/4ebac531-6f77-4108-afc9-0eccb86dee8b" status: 200 len: 1331 microversion: 2.1 time: 0.501250 Nov 01 18:54:59.183267 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 96/201] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:54:58 2022] GET /compute/v2.1/servers/4ebac531-6f77-4108-afc9-0eccb86dee8b => generated 1331 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 18:54:59.191993 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-bb0dceb9-1770-4a26-b76a-ca5669221b1a tempest-HypervisorAdminTestJSON-108693606 tempest-HypervisorAdminTestJSON-108693606-project-admin] Calling method '.version_select at 0x7f0ae30003a0>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:54:59.197474 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-bb0dceb9-1770-4a26-b76a-ca5669221b1a tempest-HypervisorAdminTestJSON-108693606 tempest-HypervisorAdminTestJSON-108693606-project-admin] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:54:59.199653 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-bb0dceb9-1770-4a26-b76a-ca5669221b1a tempest-HypervisorAdminTestJSON-108693606 tempest-HypervisorAdminTestJSON-108693606-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:54:59.200446 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-bb0dceb9-1770-4a26-b76a-ca5669221b1a tempest-HypervisorAdminTestJSON-108693606 tempest-HypervisorAdminTestJSON-108693606-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:54:59.230249 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-89948053-b3e0-42fd-8efa-7f0057b1fcbc tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07a2a96629f4baea6a3adfc4011ffe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9baf3860ba564f5c8dff93085b9aabe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:54:59.241681 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-89948053-b3e0-42fd-8efa-7f0057b1fcbc tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] 10.222.0.13 "GET /compute/v2.1/servers/26132db2-1798-4ba6-88bb-aaf87f6848b3" status: 200 len: 1320 microversion: 2.1 time: 0.346248 Nov 01 18:54:59.243727 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 106/202] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:54:58 2022] GET /compute/v2.1/servers/26132db2-1798-4ba6-88bb-aaf87f6848b3 => generated 1320 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:54:59.246945 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-bb0dceb9-1770-4a26-b76a-ca5669221b1a tempest-HypervisorAdminTestJSON-108693606 tempest-HypervisorAdminTestJSON-108693606-project-admin] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:54:59.248039 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-bb0dceb9-1770-4a26-b76a-ca5669221b1a tempest-HypervisorAdminTestJSON-108693606 tempest-HypervisorAdminTestJSON-108693606-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:54:59.252207 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-bb0dceb9-1770-4a26-b76a-ca5669221b1a tempest-HypervisorAdminTestJSON-108693606 tempest-HypervisorAdminTestJSON-108693606-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:54:59.261417 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-d5989ecd-18f0-4d80-8e84-db855a98e571 tempest-AggregatesAdminTestJSON-768412114 tempest-AggregatesAdminTestJSON-768412114-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:54:59.262026 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-d5989ecd-18f0-4d80-8e84-db855a98e571 tempest-AggregatesAdminTestJSON-768412114 tempest-AggregatesAdminTestJSON-768412114-project] [instance: 7967bf1f-943f-441d-befd-373868bbb3aa] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:54:59.275604 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-bb0dceb9-1770-4a26-b76a-ca5669221b1a tempest-HypervisorAdminTestJSON-108693606 tempest-HypervisorAdminTestJSON-108693606-project-admin] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:54:59.276933 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-bb0dceb9-1770-4a26-b76a-ca5669221b1a tempest-HypervisorAdminTestJSON-108693606 tempest-HypervisorAdminTestJSON-108693606-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:54:59.277290 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d5989ecd-18f0-4d80-8e84-db855a98e571 tempest-AggregatesAdminTestJSON-768412114 tempest-AggregatesAdminTestJSON-768412114-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:54:59.277806 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d5989ecd-18f0-4d80-8e84-db855a98e571 tempest-AggregatesAdminTestJSON-768412114 tempest-AggregatesAdminTestJSON-768412114-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:54:59.278746 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-bb0dceb9-1770-4a26-b76a-ca5669221b1a tempest-HypervisorAdminTestJSON-108693606 tempest-HypervisorAdminTestJSON-108693606-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:54:59.279880 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d5989ecd-18f0-4d80-8e84-db855a98e571 tempest-AggregatesAdminTestJSON-768412114 tempest-AggregatesAdminTestJSON-768412114-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:54:59.289517 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d5989ecd-18f0-4d80-8e84-db855a98e571 tempest-AggregatesAdminTestJSON-768412114 tempest-AggregatesAdminTestJSON-768412114-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:54:59.291187 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d5989ecd-18f0-4d80-8e84-db855a98e571 tempest-AggregatesAdminTestJSON-768412114 tempest-AggregatesAdminTestJSON-768412114-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:54:59.291631 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d5989ecd-18f0-4d80-8e84-db855a98e571 tempest-AggregatesAdminTestJSON-768412114 tempest-AggregatesAdminTestJSON-768412114-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:54:59.335330 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-bb0dceb9-1770-4a26-b76a-ca5669221b1a tempest-HypervisorAdminTestJSON-108693606 tempest-HypervisorAdminTestJSON-108693606-project-admin] 10.222.0.13 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 200 len: 175 microversion: 2.1 time: 0.149301 Nov 01 18:54:59.347123 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 97/203] 10.222.0.13 () {58 vars in 1173 bytes} [Tue Nov 1 18:54:59 2022] GET /compute/v2.1/os-hypervisors/1/uptime => generated 175 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 18:54:59.668214 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-d5989ecd-18f0-4d80-8e84-db855a98e571 tempest-AggregatesAdminTestJSON-768412114 tempest-AggregatesAdminTestJSON-768412114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439a7ac2509640c49361f9ba6636b34d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8382e1376b104295aa5cef36ba07cf45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:54:59.679667 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-d5989ecd-18f0-4d80-8e84-db855a98e571 tempest-AggregatesAdminTestJSON-768412114 tempest-AggregatesAdminTestJSON-768412114-project] 10.222.0.13 "GET /compute/v2.1/servers/7967bf1f-943f-441d-befd-373868bbb3aa" status: 200 len: 1493 microversion: 2.1 time: 0.434197 Nov 01 18:54:59.681748 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 107/204] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:54:59 2022] GET /compute/v2.1/servers/7967bf1f-943f-441d-befd-373868bbb3aa => generated 1493 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:55:00.158544 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [req-69139f1f-e812-4092-b631-f2b5e4c9a066 req-c4d65ad3-9d9b-45a7-bef8-5197958c5303 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7967bf1f-943f-441d-befd-373868bbb3aa", "name": "network-vif-deleted", "tag": "963ab751-05a7-4de6-a06a-12599013a0d2"}]} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 18:55:00.176798 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-69139f1f-e812-4092-b631-f2b5e4c9a066 req-c4d65ad3-9d9b-45a7-bef8-5197958c5303 service nova] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:55:00.177599 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-69139f1f-e812-4092-b631-f2b5e4c9a066 req-c4d65ad3-9d9b-45a7-bef8-5197958c5303 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:55:00.178283 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-69139f1f-e812-4092-b631-f2b5e4c9a066 req-c4d65ad3-9d9b-45a7-bef8-5197958c5303 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:55:00.199185 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.compute.server_external_events [req-69139f1f-e812-4092-b631-f2b5e4c9a066 req-c4d65ad3-9d9b-45a7-bef8-5197958c5303 service nova] Creating event network-vif-deleted:963ab751-05a7-4de6-a06a-12599013a0d2 for instance 7967bf1f-943f-441d-befd-373868bbb3aa on n-h1-863052-2 Nov 01 18:55:00.206211 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [req-69139f1f-e812-4092-b631-f2b5e4c9a066 req-c4d65ad3-9d9b-45a7-bef8-5197958c5303 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055542 Nov 01 18:55:00.207306 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 98/205] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Nov 1 18:55:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 18:55:00.212350 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-89dba61e-b7ba-4b60-b170-7675ed2f8f01 tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:55:00.217017 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-89dba61e-b7ba-4b60-b170-7675ed2f8f01 tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] [instance: 4ebac531-6f77-4108-afc9-0eccb86dee8b] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:55:00.226169 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-89dba61e-b7ba-4b60-b170-7675ed2f8f01 tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:55:00.227200 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-89dba61e-b7ba-4b60-b170-7675ed2f8f01 tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:55:00.227880 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-89dba61e-b7ba-4b60-b170-7675ed2f8f01 tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:55:00.229319 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-89dba61e-b7ba-4b60-b170-7675ed2f8f01 tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:55:00.230060 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-89dba61e-b7ba-4b60-b170-7675ed2f8f01 tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:55:00.232548 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-89dba61e-b7ba-4b60-b170-7675ed2f8f01 tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:55:00.254339 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.wsgi [None req-89dba61e-b7ba-4b60-b170-7675ed2f8f01 tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] HTTP exception thrown: Instance 4ebac531-6f77-4108-afc9-0eccb86dee8b could not be found. Nov 01 18:55:00.258103 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-89dba61e-b7ba-4b60-b170-7675ed2f8f01 tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Request method failure captured: Nov 01 18:55:00.258103 n-d-863052-2 devstack@n-api.service[121403]: request: GET /compute/v2.1/servers/4ebac531-6f77-4108-afc9-0eccb86dee8b HTTP/1.1 Nov 01 18:55:00.258103 n-d-863052-2 devstack@n-api.service[121403]: Accept: application/json Nov 01 18:55:00.258103 n-d-863052-2 devstack@n-api.service[121403]: Accept-Encoding: identity Nov 01 18:55:00.258103 n-d-863052-2 devstack@n-api.service[121403]: Connection: close Nov 01 18:55:00.258103 n-d-863052-2 devstack@n-api.service[121403]: Content-Length: 0 Nov 01 18:55:00.258103 n-d-863052-2 devstack@n-api.service[121403]: Content-Type: application/json Nov 01 18:55:00.258103 n-d-863052-2 devstack@n-api.service[121403]: Host: 10.222.0.13 Nov 01 18:55:00.258103 n-d-863052-2 devstack@n-api.service[121403]: Openstack-System-Scope: None Nov 01 18:55:00.258103 n-d-863052-2 devstack@n-api.service[121403]: User-Agent: python-urllib3/1.26.12 Nov 01 18:55:00.258103 n-d-863052-2 devstack@n-api.service[121403]: X-Auth-Token: gAAAAABjYWtYDQwdAak_LjSmdo26bmKvpWtv73rP8cG6S9cMNmWfs8LwYmpnAj7Ol9mmIwvJVFGihix85N_khX1wVu6qw6bw-56m6Mp9CQTu5Az6nunubYmH0HGLQV25fRJm8xBu_cIiDsr_617cASQvaowfLvvLes1yddcCUl8oNjqt7aPNvls Nov 01 18:55:00.258103 n-d-863052-2 devstack@n-api.service[121403]: X-Domain-Id: None Nov 01 18:55:00.258103 n-d-863052-2 devstack@n-api.service[121403]: X-Domain-Name: None Nov 01 18:55:00.258103 n-d-863052-2 devstack@n-api.service[121403]: X-Identity-Status: Confirmed Nov 01 18:55:00.258103 n-d-863052-2 devstack@n-api.service[121403]: X-Is-Admin-Project: True Nov 01 18:55:00.258103 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Domain-Id: default Nov 01 18:55:00.258103 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Domain-Name: Default Nov 01 18:55:00.258103 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Id: c8e1248497284006a7acbb8169627ea5 Nov 01 18:55:00.258103 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Name: tempest-DeleteServersAdminTestJSON-742542561 Nov 01 18:55:00.258103 n-d-863052-2 devstack@n-api.service[121403]: X-Role: member,reader Nov 01 18:55:00.258103 n-d-863052-2 devstack@n-api.service[121403]: X-Roles: member,reader Nov 01 18:55:00.260300 n-d-863052-2 devstack@n-api.service[121403]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/c8e1248497284006a7acbb8169627ea5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/c8e1248497284006a7acbb8169627ea5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_c8e1248497284006a7acbb8169627ea5", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/c8e1248497284006a7acbb8169627ea5"}]}] Nov 01 18:55:00.260300 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant: tempest-DeleteServersAdminTestJSON-742542561 Nov 01 18:55:00.260300 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant-Id: c8e1248497284006a7acbb8169627ea5 Nov 01 18:55:00.260300 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-742542561 Nov 01 18:55:00.260300 n-d-863052-2 devstack@n-api.service[121403]: X-User: tempest-DeleteServersAdminTestJSON-742542561-project Nov 01 18:55:00.260300 n-d-863052-2 devstack@n-api.service[121403]: X-User-Domain-Id: default Nov 01 18:55:00.260300 n-d-863052-2 devstack@n-api.service[121403]: X-User-Domain-Name: Default Nov 01 18:55:00.260300 n-d-863052-2 devstack@n-api.service[121403]: X-User-Id: ce2e0d1828674809a3344a7a68f375c5 Nov 01 18:55:00.260300 n-d-863052-2 devstack@n-api.service[121403]: X-User-Name: tempest-DeleteServersAdminTestJSON-742542561-project Nov 01 18:55:00.260300 n-d-863052-2 devstack@n-api.service[121403]: method: > Nov 01 18:55:00.260300 n-d-863052-2 devstack@n-api.service[121403]: exception: Instance 4ebac531-6f77-4108-afc9-0eccb86dee8b could not be found. Nov 01 18:55:00.260300 n-d-863052-2 devstack@n-api.service[121403]: action_args: {'id': '4ebac531-6f77-4108-afc9-0eccb86dee8b'} Nov 01 18:55:00.261209 n-d-863052-2 devstack@n-api.service[121403]: {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 01 18:55:00.261209 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:55:00.261209 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 01 18:55:00.261209 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 01 18:55:00.261209 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 01 18:55:00.261209 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 01 18:55:00.261209 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 01 18:55:00.261209 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 01 18:55:00.261209 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 01 18:55:00.261209 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 01 18:55:00.261209 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4ebac531-6f77-4108-afc9-0eccb86dee8b could not be found. Nov 01 18:55:00.261209 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 18:55:00.261209 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 18:55:00.261209 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 18:55:00.261209 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:55:00.261209 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 18:55:00.261209 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 18:55:00.261209 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 01 18:55:00.261209 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 01 18:55:00.261209 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 01 18:55:00.262698 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 01 18:55:00.262698 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 01 18:55:00.262698 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 01 18:55:00.262698 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 01 18:55:00.262698 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 01 18:55:00.262698 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 01 18:55:00.262698 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 01 18:55:00.262698 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4ebac531-6f77-4108-afc9-0eccb86dee8b could not be found. Nov 01 18:55:00.262698 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 18:55:00.262698 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 18:55:00.262698 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 18:55:00.262698 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:55:00.262698 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 18:55:00.262698 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 18:55:00.262698 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 01 18:55:00.262698 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 01 18:55:00.262698 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4ebac531-6f77-4108-afc9-0eccb86dee8b could not be found. Nov 01 18:55:00.262698 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 18:55:00.266737 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-f129a70c-e052-4ea0-9b21-2108461e490c tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:55:00.267490 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-f129a70c-e052-4ea0-9b21-2108461e490c tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] [instance: 26132db2-1798-4ba6-88bb-aaf87f6848b3] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:55:00.269616 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-89dba61e-b7ba-4b60-b170-7675ed2f8f01 tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Returning 404 to user: Instance 4ebac531-6f77-4108-afc9-0eccb86dee8b could not be found. {{(pid=121403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 01 18:55:00.270860 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-89dba61e-b7ba-4b60-b170-7675ed2f8f01 tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] 10.222.0.13 "GET /compute/v2.1/servers/4ebac531-6f77-4108-afc9-0eccb86dee8b" status: 404 len: 111 microversion: 2.1 time: 0.064570 Nov 01 18:55:00.277665 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 108/206] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:55:00 2022] GET /compute/v2.1/servers/4ebac531-6f77-4108-afc9-0eccb86dee8b => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 01 18:55:00.299127 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f129a70c-e052-4ea0-9b21-2108461e490c tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:55:00.301467 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f129a70c-e052-4ea0-9b21-2108461e490c tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:55:00.304294 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f129a70c-e052-4ea0-9b21-2108461e490c tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:55:00.309107 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f129a70c-e052-4ea0-9b21-2108461e490c tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:55:00.310475 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f129a70c-e052-4ea0-9b21-2108461e490c tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:55:00.310937 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f129a70c-e052-4ea0-9b21-2108461e490c tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:55:00.463308 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-f129a70c-e052-4ea0-9b21-2108461e490c tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07a2a96629f4baea6a3adfc4011ffe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9baf3860ba564f5c8dff93085b9aabe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:55:00.470548 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-3abad9ec-26b6-47e2-81b1-a12f24f5346b tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-880152029", "imageRef": "2d4a0047-1b9e-445f-8af8-1b5c9d93e881", "flavorRef": "452"}} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 18:55:00.473602 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-f129a70c-e052-4ea0-9b21-2108461e490c tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] 10.222.0.13 "GET /compute/v2.1/servers/26132db2-1798-4ba6-88bb-aaf87f6848b3" status: 200 len: 1320 microversion: 2.1 time: 0.211844 Nov 01 18:55:00.474961 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 99/207] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:55:00 2022] GET /compute/v2.1/servers/26132db2-1798-4ba6-88bb-aaf87f6848b3 => generated 1320 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:55:00.597039 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.network.neutron [None req-3abad9ec-26b6-47e2-81b1-a12f24f5346b tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] validate_networks() for None {{(pid=121403) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 01 18:55:00.708880 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-e5facc1b-81fd-405f-91eb-170ab573b08b tempest-AggregatesAdminTestJSON-768412114 tempest-AggregatesAdminTestJSON-768412114-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:55:00.709794 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-e5facc1b-81fd-405f-91eb-170ab573b08b tempest-AggregatesAdminTestJSON-768412114 tempest-AggregatesAdminTestJSON-768412114-project] [instance: 7967bf1f-943f-441d-befd-373868bbb3aa] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:55:00.725347 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e5facc1b-81fd-405f-91eb-170ab573b08b tempest-AggregatesAdminTestJSON-768412114 tempest-AggregatesAdminTestJSON-768412114-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:55:00.728111 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e5facc1b-81fd-405f-91eb-170ab573b08b tempest-AggregatesAdminTestJSON-768412114 tempest-AggregatesAdminTestJSON-768412114-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:55:00.741092 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e5facc1b-81fd-405f-91eb-170ab573b08b tempest-AggregatesAdminTestJSON-768412114 tempest-AggregatesAdminTestJSON-768412114-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:55:00.742594 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e5facc1b-81fd-405f-91eb-170ab573b08b tempest-AggregatesAdminTestJSON-768412114 tempest-AggregatesAdminTestJSON-768412114-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:55:00.746756 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e5facc1b-81fd-405f-91eb-170ab573b08b tempest-AggregatesAdminTestJSON-768412114 tempest-AggregatesAdminTestJSON-768412114-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:55:00.751927 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e5facc1b-81fd-405f-91eb-170ab573b08b tempest-AggregatesAdminTestJSON-768412114 tempest-AggregatesAdminTestJSON-768412114-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:55:00.822353 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.wsgi [None req-e5facc1b-81fd-405f-91eb-170ab573b08b tempest-AggregatesAdminTestJSON-768412114 tempest-AggregatesAdminTestJSON-768412114-project] HTTP exception thrown: Instance 7967bf1f-943f-441d-befd-373868bbb3aa could not be found. Nov 01 18:55:00.827887 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-e5facc1b-81fd-405f-91eb-170ab573b08b tempest-AggregatesAdminTestJSON-768412114 tempest-AggregatesAdminTestJSON-768412114-project] Request method failure captured: Nov 01 18:55:00.827887 n-d-863052-2 devstack@n-api.service[121402]: request: GET /compute/v2.1/servers/7967bf1f-943f-441d-befd-373868bbb3aa HTTP/1.1 Nov 01 18:55:00.827887 n-d-863052-2 devstack@n-api.service[121402]: Accept: application/json Nov 01 18:55:00.827887 n-d-863052-2 devstack@n-api.service[121402]: Accept-Encoding: identity Nov 01 18:55:00.827887 n-d-863052-2 devstack@n-api.service[121402]: Connection: close Nov 01 18:55:00.827887 n-d-863052-2 devstack@n-api.service[121402]: Content-Length: 0 Nov 01 18:55:00.827887 n-d-863052-2 devstack@n-api.service[121402]: Content-Type: application/json Nov 01 18:55:00.827887 n-d-863052-2 devstack@n-api.service[121402]: Host: 10.222.0.13 Nov 01 18:55:00.827887 n-d-863052-2 devstack@n-api.service[121402]: Openstack-System-Scope: None Nov 01 18:55:00.827887 n-d-863052-2 devstack@n-api.service[121402]: User-Agent: python-urllib3/1.26.12 Nov 01 18:55:00.827887 n-d-863052-2 devstack@n-api.service[121402]: X-Auth-Token: gAAAAABjYWtYz1g8wPe9y8KpEQ3zvr9HdFVVZUcanD9j0jmHTm-zzNN9102xUrHUhnG49Y18CpM4FI4Nent3nDZxqKFJoiZUdWAM6W6rT4ndxXWfdAHym-_Bv5wXx1wyqxi3yxBfqyx63ZBehoXa0sZC5BjBG686qL_SG9UyT7P6uND0QOLA9Bs Nov 01 18:55:00.827887 n-d-863052-2 devstack@n-api.service[121402]: X-Domain-Id: None Nov 01 18:55:00.827887 n-d-863052-2 devstack@n-api.service[121402]: X-Domain-Name: None Nov 01 18:55:00.827887 n-d-863052-2 devstack@n-api.service[121402]: X-Identity-Status: Confirmed Nov 01 18:55:00.827887 n-d-863052-2 devstack@n-api.service[121402]: X-Is-Admin-Project: True Nov 01 18:55:00.827887 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Domain-Id: default Nov 01 18:55:00.827887 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Domain-Name: Default Nov 01 18:55:00.827887 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Id: 8382e1376b104295aa5cef36ba07cf45 Nov 01 18:55:00.827887 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Name: tempest-AggregatesAdminTestJSON-768412114 Nov 01 18:55:00.827887 n-d-863052-2 devstack@n-api.service[121402]: X-Role: member,reader Nov 01 18:55:00.827887 n-d-863052-2 devstack@n-api.service[121402]: X-Roles: member,reader Nov 01 18:55:00.829414 n-d-863052-2 devstack@n-api.service[121402]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/8382e1376b104295aa5cef36ba07cf45"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/8382e1376b104295aa5cef36ba07cf45"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_8382e1376b104295aa5cef36ba07cf45", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/8382e1376b104295aa5cef36ba07cf45"}]}] Nov 01 18:55:00.829414 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant: tempest-AggregatesAdminTestJSON-768412114 Nov 01 18:55:00.829414 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant-Id: 8382e1376b104295aa5cef36ba07cf45 Nov 01 18:55:00.829414 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-768412114 Nov 01 18:55:00.829414 n-d-863052-2 devstack@n-api.service[121402]: X-User: tempest-AggregatesAdminTestJSON-768412114-project Nov 01 18:55:00.829414 n-d-863052-2 devstack@n-api.service[121402]: X-User-Domain-Id: default Nov 01 18:55:00.829414 n-d-863052-2 devstack@n-api.service[121402]: X-User-Domain-Name: Default Nov 01 18:55:00.829414 n-d-863052-2 devstack@n-api.service[121402]: X-User-Id: 439a7ac2509640c49361f9ba6636b34d Nov 01 18:55:00.829414 n-d-863052-2 devstack@n-api.service[121402]: X-User-Name: tempest-AggregatesAdminTestJSON-768412114-project Nov 01 18:55:00.829414 n-d-863052-2 devstack@n-api.service[121402]: method: > Nov 01 18:55:00.829414 n-d-863052-2 devstack@n-api.service[121402]: exception: Instance 7967bf1f-943f-441d-befd-373868bbb3aa could not be found. Nov 01 18:55:00.829414 n-d-863052-2 devstack@n-api.service[121402]: action_args: {'id': '7967bf1f-943f-441d-befd-373868bbb3aa'} Nov 01 18:55:00.830151 n-d-863052-2 devstack@n-api.service[121402]: {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 01 18:55:00.830151 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:55:00.830151 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 01 18:55:00.830151 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 01 18:55:00.830151 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 01 18:55:00.830151 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 01 18:55:00.830151 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 01 18:55:00.830151 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 01 18:55:00.830151 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 01 18:55:00.830151 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 01 18:55:00.830151 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7967bf1f-943f-441d-befd-373868bbb3aa could not be found. Nov 01 18:55:00.830151 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 18:55:00.830151 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 18:55:00.830151 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 18:55:00.830151 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:55:00.830151 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 18:55:00.830151 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 18:55:00.830151 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 01 18:55:00.830151 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 01 18:55:00.830151 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 01 18:55:00.831280 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 01 18:55:00.831280 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 01 18:55:00.831280 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 01 18:55:00.831280 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 01 18:55:00.831280 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 01 18:55:00.831280 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 01 18:55:00.831280 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 01 18:55:00.831280 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7967bf1f-943f-441d-befd-373868bbb3aa could not be found. Nov 01 18:55:00.831280 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 18:55:00.831280 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 18:55:00.831280 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 18:55:00.831280 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:55:00.831280 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 18:55:00.831280 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 18:55:00.831280 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 01 18:55:00.831280 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 01 18:55:00.831280 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7967bf1f-943f-441d-befd-373868bbb3aa could not be found. Nov 01 18:55:00.831280 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 18:55:00.834641 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-e5facc1b-81fd-405f-91eb-170ab573b08b tempest-AggregatesAdminTestJSON-768412114 tempest-AggregatesAdminTestJSON-768412114-project] Returning 404 to user: Instance 7967bf1f-943f-441d-befd-373868bbb3aa could not be found. {{(pid=121402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 01 18:55:00.835693 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-e5facc1b-81fd-405f-91eb-170ab573b08b tempest-AggregatesAdminTestJSON-768412114 tempest-AggregatesAdminTestJSON-768412114-project] 10.222.0.13 "GET /compute/v2.1/servers/7967bf1f-943f-441d-befd-373868bbb3aa" status: 404 len: 111 microversion: 2.1 time: 0.132302 Nov 01 18:55:00.836945 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 100/208] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:55:00 2022] GET /compute/v2.1/servers/7967bf1f-943f-441d-befd-373868bbb3aa => generated 111 bytes in 134 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 01 18:55:00.851794 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-dcc37c50-b1c8-4e54-b056-c8ed975aaf09 tempest-AggregatesAdminTestJSON-1442378289 tempest-AggregatesAdminTestJSON-1442378289-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-863052-2"}} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 18:55:00.870085 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-dcc37c50-b1c8-4e54-b056-c8ed975aaf09 tempest-AggregatesAdminTestJSON-1442378289 tempest-AggregatesAdminTestJSON-1442378289-project-admin] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:55:00.874429 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-dcc37c50-b1c8-4e54-b056-c8ed975aaf09 tempest-AggregatesAdminTestJSON-1442378289 tempest-AggregatesAdminTestJSON-1442378289-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:55:00.875873 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-dcc37c50-b1c8-4e54-b056-c8ed975aaf09 tempest-AggregatesAdminTestJSON-1442378289 tempest-AggregatesAdminTestJSON-1442378289-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:55:01.162025 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-dcc37c50-b1c8-4e54-b056-c8ed975aaf09 tempest-AggregatesAdminTestJSON-1442378289 tempest-AggregatesAdminTestJSON-1442378289-project-admin] 10.222.0.13 "POST /compute/v2.1/os-aggregates/4/action" status: 200 len: 300 microversion: 2.1 time: 0.314141 Nov 01 18:55:01.176499 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 101/209] 10.222.0.13 () {60 vars in 1191 bytes} [Tue Nov 1 18:55:00 2022] POST /compute/v2.1/os-aggregates/4/action => generated 300 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 18:55:01.181421 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-1bed46f6-4f5c-4ce8-b58f-9fd18f5454e9 tempest-AggregatesAdminTestJSON-1442378289 tempest-AggregatesAdminTestJSON-1442378289-project-admin] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:55:01.247407 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-1bed46f6-4f5c-4ce8-b58f-9fd18f5454e9 tempest-AggregatesAdminTestJSON-1442378289 tempest-AggregatesAdminTestJSON-1442378289-project-admin] 10.222.0.13 "DELETE /compute/v2.1/os-aggregates/4" status: 200 len: 0 microversion: 2.1 time: 0.069550 Nov 01 18:55:01.248056 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 102/210] 10.222.0.13 () {58 vars in 1152 bytes} [Tue Nov 1 18:55:01 2022] DELETE /compute/v2.1/os-aggregates/4 => generated 0 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Nov 01 18:55:01.284242 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-11e14b0f-5747-4252-8558-518b1405cfe2 tempest-AggregatesAdminNegativeTestJSON-1815627383 tempest-AggregatesAdminNegativeTestJSON-1815627383-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-762702167"}} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 18:55:01.288437 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.objects.aggregate [None req-11e14b0f-5747-4252-8558-518b1405cfe2 tempest-AggregatesAdminNegativeTestJSON-1815627383 tempest-AggregatesAdminNegativeTestJSON-1815627383-project-admin] Generated uuid d8544600-90f4-49e4-a357-9514f58b82d7 for aggregate {{(pid=121402) create /opt/stack/nova/nova/objects/aggregate.py:298}} Nov 01 18:55:01.331730 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-11e14b0f-5747-4252-8558-518b1405cfe2 tempest-AggregatesAdminNegativeTestJSON-1815627383 tempest-AggregatesAdminNegativeTestJSON-1815627383-project-admin] 10.222.0.13 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.077060 Nov 01 18:55:01.334950 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 103/211] 10.222.0.13 () {60 vars in 1164 bytes} [Tue Nov 1 18:55:01 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 18:55:01.362117 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-b62d4242-7557-4864-8440-10eec88bd8d7 tempest-AggregatesAdminNegativeTestJSON-1815627383 tempest-AggregatesAdminNegativeTestJSON-1815627383-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-863052-2"}} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 18:55:01.368936 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b62d4242-7557-4864-8440-10eec88bd8d7 tempest-AggregatesAdminNegativeTestJSON-1815627383 tempest-AggregatesAdminNegativeTestJSON-1815627383-project-admin] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:55:01.369931 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b62d4242-7557-4864-8440-10eec88bd8d7 tempest-AggregatesAdminNegativeTestJSON-1815627383 tempest-AggregatesAdminNegativeTestJSON-1815627383-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:55:01.370588 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b62d4242-7557-4864-8440-10eec88bd8d7 tempest-AggregatesAdminNegativeTestJSON-1815627383 tempest-AggregatesAdminNegativeTestJSON-1815627383-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:55:01.472197 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.virt.hardware [None req-3abad9ec-26b6-47e2-81b1-a12f24f5346b tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Flavor limits 0:0:0 {{(pid=121403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 01 18:55:01.473886 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.virt.hardware [None req-3abad9ec-26b6-47e2-81b1-a12f24f5346b tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Image limits 0:0:0 {{(pid=121403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 01 18:55:01.474681 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.virt.hardware [None req-3abad9ec-26b6-47e2-81b1-a12f24f5346b tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Flavor pref 0:0:0 {{(pid=121403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 01 18:55:01.476676 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.virt.hardware [None req-3abad9ec-26b6-47e2-81b1-a12f24f5346b tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Image pref 0:0:0 {{(pid=121403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 01 18:55:01.478218 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.virt.hardware [None req-3abad9ec-26b6-47e2-81b1-a12f24f5346b tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 01 18:55:01.503510 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-3abad9ec-26b6-47e2-81b1-a12f24f5346b tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:55:01.506230 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-3abad9ec-26b6-47e2-81b1-a12f24f5346b tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:55:01.508089 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-3abad9ec-26b6-47e2-81b1-a12f24f5346b tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:55:01.510031 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-3abad9ec-26b6-47e2-81b1-a12f24f5346b tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:55:01.513675 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-3abad9ec-26b6-47e2-81b1-a12f24f5346b tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:55:01.514273 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-3abad9ec-26b6-47e2-81b1-a12f24f5346b tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:55:01.553941 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.quota [None req-3abad9ec-26b6-47e2-81b1-a12f24f5346b tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Getting quotas for project c8e1248497284006a7acbb8169627ea5. Resources: {'cores', 'ram', 'instances'} {{(pid=121403) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 01 18:55:01.560101 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.quota [None req-3abad9ec-26b6-47e2-81b1-a12f24f5346b tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Getting quotas for user ce2e0d1828674809a3344a7a68f375c5 and project c8e1248497284006a7acbb8169627ea5. Resources: {'cores', 'ram', 'instances'} {{(pid=121403) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 01 18:55:01.587581 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-b62d4242-7557-4864-8440-10eec88bd8d7 tempest-AggregatesAdminNegativeTestJSON-1815627383 tempest-AggregatesAdminNegativeTestJSON-1815627383-project-admin] 10.222.0.13 "POST /compute/v2.1/os-aggregates/9/action" status: 200 len: 241 microversion: 2.1 time: 0.240116 Nov 01 18:55:01.589308 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 104/212] 10.222.0.13 () {60 vars in 1191 bytes} [Tue Nov 1 18:55:01 2022] POST /compute/v2.1/os-aggregates/9/action => generated 241 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 18:55:01.609728 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-917a6789-487c-4437-a3d8-b451c7a35324 tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:55:01.612740 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-917a6789-487c-4437-a3d8-b451c7a35324 tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] [instance: 26132db2-1798-4ba6-88bb-aaf87f6848b3] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:55:01.615805 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-3abad9ec-26b6-47e2-81b1-a12f24f5346b tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Going to run 1 instances... {{(pid=121403) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 01 18:55:01.625985 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-3abad9ec-26b6-47e2-81b1-a12f24f5346b tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] [instance: ada7d07e-42e4-49a3-8e59-d16dee8cb0f0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2d4a0047-1b9e-445f-8af8-1b5c9d93e881',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121403) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 01 18:55:01.628913 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-917a6789-487c-4437-a3d8-b451c7a35324 tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:55:01.631388 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-917a6789-487c-4437-a3d8-b451c7a35324 tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:55:01.634847 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-917a6789-487c-4437-a3d8-b451c7a35324 tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:55:01.635820 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-917a6789-487c-4437-a3d8-b451c7a35324 tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:55:01.636445 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-917a6789-487c-4437-a3d8-b451c7a35324 tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:55:01.637459 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-917a6789-487c-4437-a3d8-b451c7a35324 tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:55:01.827347 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-3abad9ec-26b6-47e2-81b1-a12f24f5346b tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.371373 Nov 01 18:55:01.830339 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 109/213] 10.222.0.13 () {60 vars in 1147 bytes} [Tue Nov 1 18:55:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 1377 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Nov 01 18:55:01.833273 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-917a6789-487c-4437-a3d8-b451c7a35324 tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07a2a96629f4baea6a3adfc4011ffe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9baf3860ba564f5c8dff93085b9aabe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:55:01.846915 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-5b6713ab-9d7a-42f3-89f9-9cfaee8f9462 tempest-AggregatesAdminNegativeTestJSON-701968823 tempest-AggregatesAdminNegativeTestJSON-701968823-project] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-863052-2"}} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 18:55:01.847348 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-917a6789-487c-4437-a3d8-b451c7a35324 tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] 10.222.0.13 "GET /compute/v2.1/servers/26132db2-1798-4ba6-88bb-aaf87f6848b3" status: 200 len: 1320 microversion: 2.1 time: 0.248323 Nov 01 18:55:01.857269 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-5b6713ab-9d7a-42f3-89f9-9cfaee8f9462 tempest-AggregatesAdminNegativeTestJSON-701968823 tempest-AggregatesAdminNegativeTestJSON-701968823-project] Policy check for os_compute_api:os-aggregates:remove_host failed with credentials {'is_admin': False, 'user_id': '050138637ab247cabfa21c187e4463dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440456c174424b5c8a796711a95a8b69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:55:01.859151 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-5b6713ab-9d7a-42f3-89f9-9cfaee8f9462 tempest-AggregatesAdminNegativeTestJSON-701968823 tempest-AggregatesAdminNegativeTestJSON-701968823-project] Request method failure captured: Nov 01 18:55:01.859151 n-d-863052-2 devstack@n-api.service[121403]: request: POST /compute/v2.1/os-aggregates/9/action HTTP/1.1 Nov 01 18:55:01.859151 n-d-863052-2 devstack@n-api.service[121403]: Accept: application/json Nov 01 18:55:01.859151 n-d-863052-2 devstack@n-api.service[121403]: Accept-Encoding: identity Nov 01 18:55:01.859151 n-d-863052-2 devstack@n-api.service[121403]: Connection: close Nov 01 18:55:01.859151 n-d-863052-2 devstack@n-api.service[121403]: Content-Length: 42 Nov 01 18:55:01.859151 n-d-863052-2 devstack@n-api.service[121403]: Content-Type: application/json Nov 01 18:55:01.859151 n-d-863052-2 devstack@n-api.service[121403]: Host: 10.222.0.13 Nov 01 18:55:01.859151 n-d-863052-2 devstack@n-api.service[121403]: Openstack-System-Scope: None Nov 01 18:55:01.859151 n-d-863052-2 devstack@n-api.service[121403]: User-Agent: python-urllib3/1.26.12 Nov 01 18:55:01.859151 n-d-863052-2 devstack@n-api.service[121403]: X-Auth-Token: gAAAAABjYWtYF75HWf8dApD_m447tyf_mGJPzf8sow1wwvz71bWsgfnuNEDZD8kc7FNf8UQaBOnL1PRXNN_SusWujUfI-Zl9-t1OxUPEVGqV5sgKS3MOb-9Fl7jDxrPPOZQJ67Sffw3RwRGNWR2S2MXGQmO3tiflrv5n_iOXTXf2esQHwC8DD0E Nov 01 18:55:01.859151 n-d-863052-2 devstack@n-api.service[121403]: X-Domain-Id: None Nov 01 18:55:01.859151 n-d-863052-2 devstack@n-api.service[121403]: X-Domain-Name: None Nov 01 18:55:01.859151 n-d-863052-2 devstack@n-api.service[121403]: X-Identity-Status: Confirmed Nov 01 18:55:01.859151 n-d-863052-2 devstack@n-api.service[121403]: X-Is-Admin-Project: True Nov 01 18:55:01.859151 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Domain-Id: default Nov 01 18:55:01.859151 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Domain-Name: Default Nov 01 18:55:01.859151 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Id: 440456c174424b5c8a796711a95a8b69 Nov 01 18:55:01.859151 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-701968823 Nov 01 18:55:01.859151 n-d-863052-2 devstack@n-api.service[121403]: X-Role: member,reader Nov 01 18:55:01.859151 n-d-863052-2 devstack@n-api.service[121403]: X-Roles: member,reader Nov 01 18:55:01.860511 n-d-863052-2 devstack@n-api.service[121403]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/440456c174424b5c8a796711a95a8b69"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/440456c174424b5c8a796711a95a8b69"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_440456c174424b5c8a796711a95a8b69", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/440456c174424b5c8a796711a95a8b69"}]}] Nov 01 18:55:01.860511 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-701968823 Nov 01 18:55:01.860511 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant-Id: 440456c174424b5c8a796711a95a8b69 Nov 01 18:55:01.860511 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-701968823 Nov 01 18:55:01.860511 n-d-863052-2 devstack@n-api.service[121403]: X-User: tempest-AggregatesAdminNegativeTestJSON-701968823-project Nov 01 18:55:01.860511 n-d-863052-2 devstack@n-api.service[121403]: X-User-Domain-Id: default Nov 01 18:55:01.860511 n-d-863052-2 devstack@n-api.service[121403]: X-User-Domain-Name: Default Nov 01 18:55:01.860511 n-d-863052-2 devstack@n-api.service[121403]: X-User-Id: 050138637ab247cabfa21c187e4463dc Nov 01 18:55:01.860511 n-d-863052-2 devstack@n-api.service[121403]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-701968823-project Nov 01 18:55:01.860511 n-d-863052-2 devstack@n-api.service[121403]: Nov 01 18:55:01.860511 n-d-863052-2 devstack@n-api.service[121403]: {"remove_host": {"host": "n-h1-863052-2"}} Nov 01 18:55:01.860511 n-d-863052-2 devstack@n-api.service[121403]: method: > Nov 01 18:55:01.860511 n-d-863052-2 devstack@n-api.service[121403]: exception: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Nov 01 18:55:01.861353 n-d-863052-2 devstack@n-api.service[121403]: action_args: {'id': '9', 'body': {'remove_host': {'host': 'n-h1-863052-2'}}} Nov 01 18:55:01.861353 n-d-863052-2 devstack@n-api.service[121403]: {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 01 18:55:01.861353 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:55:01.861353 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 18:55:01.861353 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 18:55:01.861353 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 01 18:55:01.861353 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 01 18:55:01.861353 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 01 18:55:01.861353 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 01 18:55:01.861353 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 01 18:55:01.861353 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 01 18:55:01.861353 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 201, in _remove_host Nov 01 18:55:01.861353 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'remove_host', target={}) Nov 01 18:55:01.861353 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Nov 01 18:55:01.861353 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Nov 01 18:55:01.861353 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Nov 01 18:55:01.861353 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Nov 01 18:55:01.861353 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 01 18:55:01.861353 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 01 18:55:01.862403 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 01 18:55:01.862403 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise self.value Nov 01 18:55:01.862403 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Nov 01 18:55:01.862403 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Nov 01 18:55:01.862403 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Nov 01 18:55:01.862403 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return self.enforce( Nov 01 18:55:01.862403 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Nov 01 18:55:01.862403 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Nov 01 18:55:01.862403 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Nov 01 18:55:01.862403 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 18:55:01.862403 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 18:55:01.862403 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 18:55:01.862403 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:55:01.862403 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 18:55:01.862403 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 18:55:01.862403 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Nov 01 18:55:01.862403 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Nov 01 18:55:01.862403 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Nov 01 18:55:01.862403 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 18:55:01.864210 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-5b6713ab-9d7a-42f3-89f9-9cfaee8f9462 tempest-AggregatesAdminNegativeTestJSON-701968823 tempest-AggregatesAdminNegativeTestJSON-701968823-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. {{(pid=121403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 01 18:55:01.864210 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-5b6713ab-9d7a-42f3-89f9-9cfaee8f9462 tempest-AggregatesAdminNegativeTestJSON-701968823 tempest-AggregatesAdminNegativeTestJSON-701968823-project] 10.222.0.13 "POST /compute/v2.1/os-aggregates/9/action" status: 403 len: 121 microversion: 2.1 time: 0.028361 Nov 01 18:55:01.864210 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 110/214] 10.222.0.13 () {60 vars in 1191 bytes} [Tue Nov 1 18:55:01 2022] POST /compute/v2.1/os-aggregates/9/action => generated 121 bytes in 30 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Nov 01 18:55:01.864611 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 105/215] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:55:01 2022] GET /compute/v2.1/servers/26132db2-1798-4ba6-88bb-aaf87f6848b3 => generated 1320 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:55:01.879862 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-cc5cee6d-e4d4-4ea0-8f0b-08062dae9976 tempest-AggregatesAdminNegativeTestJSON-1815627383 tempest-AggregatesAdminNegativeTestJSON-1815627383-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-863052-2"}} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 18:55:01.899394 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-cc5cee6d-e4d4-4ea0-8f0b-08062dae9976 tempest-AggregatesAdminNegativeTestJSON-1815627383 tempest-AggregatesAdminNegativeTestJSON-1815627383-project-admin] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:55:01.900438 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-cc5cee6d-e4d4-4ea0-8f0b-08062dae9976 tempest-AggregatesAdminNegativeTestJSON-1815627383 tempest-AggregatesAdminNegativeTestJSON-1815627383-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:55:01.901124 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-cc5cee6d-e4d4-4ea0-8f0b-08062dae9976 tempest-AggregatesAdminNegativeTestJSON-1815627383 tempest-AggregatesAdminNegativeTestJSON-1815627383-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:55:01.902525 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-a14cba01-b341-4be5-9323-74d58e987fc8 tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:55:01.903175 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-a14cba01-b341-4be5-9323-74d58e987fc8 tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] [instance: ada7d07e-42e4-49a3-8e59-d16dee8cb0f0] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:55:02.047972 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-a14cba01-b341-4be5-9323-74d58e987fc8 tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce2e0d1828674809a3344a7a68f375c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8e1248497284006a7acbb8169627ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:55:02.062568 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-a14cba01-b341-4be5-9323-74d58e987fc8 tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] 10.222.0.13 "GET /compute/v2.1/servers/ada7d07e-42e4-49a3-8e59-d16dee8cb0f0" status: 200 len: 1219 microversion: 2.1 time: 0.192595 Nov 01 18:55:02.064533 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 111/216] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:55:01 2022] GET /compute/v2.1/servers/ada7d07e-42e4-49a3-8e59-d16dee8cb0f0 => generated 1219 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:55:02.083335 n-d-863052-2 devstack@n-api.service[121402]: DEBUG dbcounter [-] [121402] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=6,nova_api:UPDATE=1,nova_api:DELETE=3 {{(pid=121402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 18:55:02.124897 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-cc5cee6d-e4d4-4ea0-8f0b-08062dae9976 tempest-AggregatesAdminNegativeTestJSON-1815627383 tempest-AggregatesAdminNegativeTestJSON-1815627383-project-admin] 10.222.0.13 "POST /compute/v2.1/os-aggregates/9/action" status: 200 len: 226 microversion: 2.1 time: 0.255098 Nov 01 18:55:02.125814 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 106/217] 10.222.0.13 () {60 vars in 1191 bytes} [Tue Nov 1 18:55:01 2022] POST /compute/v2.1/os-aggregates/9/action => generated 226 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 01 18:55:02.137340 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-4001eed8-a9f2-4896-897f-974d7cd2c64d tempest-AggregatesAdminNegativeTestJSON-1815627383 tempest-AggregatesAdminNegativeTestJSON-1815627383-project-admin] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:55:02.185521 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-4001eed8-a9f2-4896-897f-974d7cd2c64d tempest-AggregatesAdminNegativeTestJSON-1815627383 tempest-AggregatesAdminNegativeTestJSON-1815627383-project-admin] 10.222.0.13 "DELETE /compute/v2.1/os-aggregates/9" status: 200 len: 0 microversion: 2.1 time: 0.052133 Nov 01 18:55:02.192754 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 112/218] 10.222.0.13 () {58 vars in 1152 bytes} [Tue Nov 1 18:55:02 2022] DELETE /compute/v2.1/os-aggregates/9 => generated 0 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Nov 01 18:55:02.198652 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-58933a6b-0562-4ef7-bb7c-ba3ac8829066 tempest-AggregatesAdminNegativeTestJSON-1815627383 tempest-AggregatesAdminNegativeTestJSON-1815627383-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1124841958"}} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 18:55:02.202207 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.objects.aggregate [None req-58933a6b-0562-4ef7-bb7c-ba3ac8829066 tempest-AggregatesAdminNegativeTestJSON-1815627383 tempest-AggregatesAdminNegativeTestJSON-1815627383-project-admin] Generated uuid 88606cb2-a487-4553-9655-da37e4d2c3aa for aggregate {{(pid=121402) create /opt/stack/nova/nova/objects/aggregate.py:298}} Nov 01 18:55:02.218360 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-8ab3baea-6aa1-4928-b3bf-14bb15497369 tempest-AggregatesAdminTestJSON-1442378289 tempest-AggregatesAdminTestJSON-1442378289-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-350168675"}} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 18:55:02.222745 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.objects.aggregate [None req-8ab3baea-6aa1-4928-b3bf-14bb15497369 tempest-AggregatesAdminTestJSON-1442378289 tempest-AggregatesAdminTestJSON-1442378289-project-admin] Generated uuid f0eca261-52e4-4d27-adf1-18799e5f8a35 for aggregate {{(pid=121403) create /opt/stack/nova/nova/objects/aggregate.py:298}} Nov 01 18:55:02.269317 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-58933a6b-0562-4ef7-bb7c-ba3ac8829066 tempest-AggregatesAdminNegativeTestJSON-1815627383 tempest-AggregatesAdminNegativeTestJSON-1815627383-project-admin] 10.222.0.13 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.075139 Nov 01 18:55:02.283317 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 107/219] 10.222.0.13 () {60 vars in 1164 bytes} [Tue Nov 1 18:55:02 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 18:55:02.286956 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-8ab3baea-6aa1-4928-b3bf-14bb15497369 tempest-AggregatesAdminTestJSON-1442378289 tempest-AggregatesAdminTestJSON-1442378289-project-admin] 10.222.0.13 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.072907 Nov 01 18:55:02.309876 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 113/220] 10.222.0.13 () {60 vars in 1164 bytes} [Tue Nov 1 18:55:02 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 01 18:55:02.324376 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-f64c090f-bece-40d2-a163-8ddae4214e8b tempest-AggregatesAdminNegativeTestJSON-1815627383 tempest-AggregatesAdminNegativeTestJSON-1815627383-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nonexist_host"}} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 18:55:02.339128 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-04dad644-8141-464b-af8b-c544a1eaeb2b tempest-AggregatesAdminTestJSON-1442378289 tempest-AggregatesAdminTestJSON-1442378289-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-863052-2"}} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 18:55:02.366978 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f64c090f-bece-40d2-a163-8ddae4214e8b tempest-AggregatesAdminNegativeTestJSON-1815627383 tempest-AggregatesAdminNegativeTestJSON-1815627383-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:55:02.367468 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f64c090f-bece-40d2-a163-8ddae4214e8b tempest-AggregatesAdminNegativeTestJSON-1815627383 tempest-AggregatesAdminNegativeTestJSON-1815627383-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:55:02.373971 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f64c090f-bece-40d2-a163-8ddae4214e8b tempest-AggregatesAdminNegativeTestJSON-1815627383 tempest-AggregatesAdminNegativeTestJSON-1815627383-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:55:02.381686 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-04dad644-8141-464b-af8b-c544a1eaeb2b tempest-AggregatesAdminTestJSON-1442378289 tempest-AggregatesAdminTestJSON-1442378289-project-admin] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:55:02.382442 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-04dad644-8141-464b-af8b-c544a1eaeb2b tempest-AggregatesAdminTestJSON-1442378289 tempest-AggregatesAdminTestJSON-1442378289-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:55:02.383369 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-04dad644-8141-464b-af8b-c544a1eaeb2b tempest-AggregatesAdminTestJSON-1442378289 tempest-AggregatesAdminTestJSON-1442378289-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:55:02.419262 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f64c090f-bece-40d2-a163-8ddae4214e8b tempest-AggregatesAdminNegativeTestJSON-1815627383 tempest-AggregatesAdminNegativeTestJSON-1815627383-project-admin] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:55:02.419870 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f64c090f-bece-40d2-a163-8ddae4214e8b tempest-AggregatesAdminNegativeTestJSON-1815627383 tempest-AggregatesAdminNegativeTestJSON-1815627383-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:55:02.423488 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f64c090f-bece-40d2-a163-8ddae4214e8b tempest-AggregatesAdminNegativeTestJSON-1815627383 tempest-AggregatesAdminNegativeTestJSON-1815627383-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:55:02.453954 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.compute.aggregates [None req-f64c090f-bece-40d2-a163-8ddae4214e8b tempest-AggregatesAdminNegativeTestJSON-1815627383 tempest-AggregatesAdminNegativeTestJSON-1815627383-project-admin] Failed to remove host nonexist_host from aggregate 10. Error: Compute host nonexist_host could not be found.: nova.exception.ComputeHostNotFound: Compute host nonexist_host could not be found. Nov 01 18:55:02.455652 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.wsgi [None req-f64c090f-bece-40d2-a163-8ddae4214e8b tempest-AggregatesAdminNegativeTestJSON-1815627383 tempest-AggregatesAdminNegativeTestJSON-1815627383-project-admin] HTTP exception thrown: Cannot remove host nonexist_host in aggregate 10 Nov 01 18:55:02.470852 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-f64c090f-bece-40d2-a163-8ddae4214e8b tempest-AggregatesAdminNegativeTestJSON-1815627383 tempest-AggregatesAdminNegativeTestJSON-1815627383-project-admin] Request method failure captured: Nov 01 18:55:02.470852 n-d-863052-2 devstack@n-api.service[121402]: request: POST /compute/v2.1/os-aggregates/10/action HTTP/1.1 Nov 01 18:55:02.470852 n-d-863052-2 devstack@n-api.service[121402]: Accept: application/json Nov 01 18:55:02.470852 n-d-863052-2 devstack@n-api.service[121402]: Accept-Encoding: identity Nov 01 18:55:02.470852 n-d-863052-2 devstack@n-api.service[121402]: Connection: close Nov 01 18:55:02.470852 n-d-863052-2 devstack@n-api.service[121402]: Content-Length: 42 Nov 01 18:55:02.470852 n-d-863052-2 devstack@n-api.service[121402]: Content-Type: application/json Nov 01 18:55:02.470852 n-d-863052-2 devstack@n-api.service[121402]: Host: 10.222.0.13 Nov 01 18:55:02.470852 n-d-863052-2 devstack@n-api.service[121402]: Openstack-System-Scope: None Nov 01 18:55:02.470852 n-d-863052-2 devstack@n-api.service[121402]: User-Agent: python-urllib3/1.26.12 Nov 01 18:55:02.470852 n-d-863052-2 devstack@n-api.service[121402]: X-Auth-Token: gAAAAABjYWtaOKWCV3M4Q9P_m1t8bGgxDQkcvYwf_Ps7PzARRUub1dlRxoN3WEeASuv14dc3CyCQ8TmOXer2bxb0hUPpMshCv0Cmn5BRA-Qnk1qDPphkl5oircZzNZGMuZgA5lMqzCR8y9Yywlv7fSmfpCEiAjI39vME7oMbjgkHjO3679hxVVg Nov 01 18:55:02.470852 n-d-863052-2 devstack@n-api.service[121402]: X-Domain-Id: None Nov 01 18:55:02.470852 n-d-863052-2 devstack@n-api.service[121402]: X-Domain-Name: None Nov 01 18:55:02.470852 n-d-863052-2 devstack@n-api.service[121402]: X-Identity-Status: Confirmed Nov 01 18:55:02.470852 n-d-863052-2 devstack@n-api.service[121402]: X-Is-Admin-Project: True Nov 01 18:55:02.470852 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Domain-Id: default Nov 01 18:55:02.470852 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Domain-Name: Default Nov 01 18:55:02.470852 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Id: 1000a18d48e74513aa3f04bb3f4446ff Nov 01 18:55:02.470852 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1815627383 Nov 01 18:55:02.470852 n-d-863052-2 devstack@n-api.service[121402]: X-Role: admin,member,reader Nov 01 18:55:02.470852 n-d-863052-2 devstack@n-api.service[121402]: X-Roles: admin,member,reader Nov 01 18:55:02.472093 n-d-863052-2 devstack@n-api.service[121402]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/1000a18d48e74513aa3f04bb3f4446ff"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/1000a18d48e74513aa3f04bb3f4446ff"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_1000a18d48e74513aa3f04bb3f4446ff", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/1000a18d48e74513aa3f04bb3f4446ff"}]}] Nov 01 18:55:02.472093 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1815627383 Nov 01 18:55:02.472093 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant-Id: 1000a18d48e74513aa3f04bb3f4446ff Nov 01 18:55:02.472093 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1815627383 Nov 01 18:55:02.472093 n-d-863052-2 devstack@n-api.service[121402]: X-User: tempest-AggregatesAdminNegativeTestJSON-1815627383-project-admin Nov 01 18:55:02.472093 n-d-863052-2 devstack@n-api.service[121402]: X-User-Domain-Id: default Nov 01 18:55:02.472093 n-d-863052-2 devstack@n-api.service[121402]: X-User-Domain-Name: Default Nov 01 18:55:02.472093 n-d-863052-2 devstack@n-api.service[121402]: X-User-Id: c9f24a2ce22a47d28828869433d41de9 Nov 01 18:55:02.472093 n-d-863052-2 devstack@n-api.service[121402]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1815627383-project-admin Nov 01 18:55:02.472093 n-d-863052-2 devstack@n-api.service[121402]: Nov 01 18:55:02.472093 n-d-863052-2 devstack@n-api.service[121402]: {"remove_host": {"host": "nonexist_host"}} Nov 01 18:55:02.472093 n-d-863052-2 devstack@n-api.service[121402]: method: > Nov 01 18:55:02.472093 n-d-863052-2 devstack@n-api.service[121402]: exception: Cannot remove host nonexist_host in aggregate 10 Nov 01 18:55:02.472873 n-d-863052-2 devstack@n-api.service[121402]: action_args: {'id': '10', 'body': {'remove_host': {'host': 'nonexist_host'}}} Nov 01 18:55:02.472873 n-d-863052-2 devstack@n-api.service[121402]: {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 01 18:55:02.472873 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:55:02.472873 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5999, in _get_service_in_cell_by_host Nov 01 18:55:02.472873 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Nov 01 18:55:02.472873 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 01 18:55:02.472873 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 01 18:55:02.472873 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Nov 01 18:55:02.472873 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Nov 01 18:55:02.472873 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Nov 01 18:55:02.472873 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Nov 01 18:55:02.472873 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Nov 01 18:55:02.472873 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Nov 01 18:55:02.472873 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexist_host' is not mapped to any cell Nov 01 18:55:02.472873 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 18:55:02.472873 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 18:55:02.472873 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 18:55:02.472873 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:55:02.472873 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6005, in _get_service_in_cell_by_host Nov 01 18:55:02.472873 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi service = _find_service_in_cell(context, service_host=host_name) Nov 01 18:55:02.474419 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Nov 01 18:55:02.474419 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Nov 01 18:55:02.474419 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Nov 01 18:55:02.474419 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 18:55:02.474419 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 18:55:02.474419 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 18:55:02.474419 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:55:02.474419 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 209, in _remove_host Nov 01 18:55:02.474419 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi aggregate = self.api.remove_host_from_aggregate(context, id, host) Nov 01 18:55:02.474419 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Nov 01 18:55:02.474419 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Nov 01 18:55:02.474419 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 01 18:55:02.474419 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 01 18:55:02.474419 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 01 18:55:02.474419 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise self.value Nov 01 18:55:02.474419 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Nov 01 18:55:02.474419 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Nov 01 18:55:02.474419 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6683, in remove_host_from_aggregate Nov 01 18:55:02.474419 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi _get_service_in_cell_by_host(context, host_name) Nov 01 18:55:02.474419 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6007, in _get_service_in_cell_by_host Nov 01 18:55:02.475590 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host_name) Nov 01 18:55:02.475590 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host nonexist_host could not be found. Nov 01 18:55:02.475590 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 18:55:02.475590 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 18:55:02.475590 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 18:55:02.475590 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:55:02.475590 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 18:55:02.475590 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 18:55:02.475590 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 01 18:55:02.475590 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 01 18:55:02.475590 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 01 18:55:02.475590 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 01 18:55:02.475590 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 01 18:55:02.475590 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 01 18:55:02.475590 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 217, in _remove_host Nov 01 18:55:02.475590 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Nov 01 18:55:02.475590 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Cannot remove host nonexist_host in aggregate 10 Nov 01 18:55:02.475590 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 18:55:02.475590 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 18:55:02.475590 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 18:55:02.475590 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:55:02.478146 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 18:55:02.478146 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 18:55:02.478146 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 01 18:55:02.478146 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 01 18:55:02.478146 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot remove host nonexist_host in aggregate 10 Nov 01 18:55:02.478146 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 18:55:02.478146 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-f64c090f-bece-40d2-a163-8ddae4214e8b tempest-AggregatesAdminNegativeTestJSON-1815627383 tempest-AggregatesAdminNegativeTestJSON-1815627383-project-admin] Returning 404 to user: Cannot remove host nonexist_host in aggregate 10 {{(pid=121402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 01 18:55:02.478146 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-f64c090f-bece-40d2-a163-8ddae4214e8b tempest-AggregatesAdminNegativeTestJSON-1815627383 tempest-AggregatesAdminNegativeTestJSON-1815627383-project-admin] 10.222.0.13 "POST /compute/v2.1/os-aggregates/10/action" status: 404 len: 94 microversion: 2.1 time: 0.187994 Nov 01 18:55:02.478146 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 108/221] 10.222.0.13 () {60 vars in 1194 bytes} [Tue Nov 1 18:55:02 2022] POST /compute/v2.1/os-aggregates/10/action => generated 94 bytes in 189 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 01 18:55:02.504344 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-a9fbfed4-e3f5-4de7-9d34-8692d24f42fc tempest-AggregatesAdminNegativeTestJSON-1815627383 tempest-AggregatesAdminNegativeTestJSON-1815627383-project-admin] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:55:02.588069 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-a9fbfed4-e3f5-4de7-9d34-8692d24f42fc tempest-AggregatesAdminNegativeTestJSON-1815627383 tempest-AggregatesAdminNegativeTestJSON-1815627383-project-admin] 10.222.0.13 "DELETE /compute/v2.1/os-aggregates/10" status: 200 len: 0 microversion: 2.1 time: 0.100780 Nov 01 18:55:02.589769 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 109/222] 10.222.0.13 () {58 vars in 1155 bytes} [Tue Nov 1 18:55:02 2022] DELETE /compute/v2.1/os-aggregates/10 => generated 0 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Nov 01 18:55:02.873040 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-f22aaed3-dbc4-49c8-997b-53ff0dc844c4 tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:55:02.873815 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-f22aaed3-dbc4-49c8-997b-53ff0dc844c4 tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] [instance: 26132db2-1798-4ba6-88bb-aaf87f6848b3] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:55:02.893216 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f22aaed3-dbc4-49c8-997b-53ff0dc844c4 tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:55:02.893869 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f22aaed3-dbc4-49c8-997b-53ff0dc844c4 tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:55:02.894317 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f22aaed3-dbc4-49c8-997b-53ff0dc844c4 tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:55:02.897126 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f22aaed3-dbc4-49c8-997b-53ff0dc844c4 tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:55:02.897642 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f22aaed3-dbc4-49c8-997b-53ff0dc844c4 tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:55:02.900220 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f22aaed3-dbc4-49c8-997b-53ff0dc844c4 tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:55:03.119785 n-d-863052-2 devstack@n-api.service[121402]: DEBUG dbcounter [-] [121402] Writing DB stats nova_cell0:SELECT=6 {{(pid=121402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 18:55:03.302809 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-f22aaed3-dbc4-49c8-997b-53ff0dc844c4 tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07a2a96629f4baea6a3adfc4011ffe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9baf3860ba564f5c8dff93085b9aabe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:55:03.315037 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-f22aaed3-dbc4-49c8-997b-53ff0dc844c4 tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] 10.222.0.13 "GET /compute/v2.1/servers/26132db2-1798-4ba6-88bb-aaf87f6848b3" status: 200 len: 1387 microversion: 2.1 time: 0.445696 Nov 01 18:55:03.319754 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 110/223] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:55:02 2022] GET /compute/v2.1/servers/26132db2-1798-4ba6-88bb-aaf87f6848b3 => generated 1387 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 18:55:03.331269 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-f28615a2-5ee2-4152-ae8a-f575f9a0a15c tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:55:03.332385 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-f28615a2-5ee2-4152-ae8a-f575f9a0a15c tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] [instance: ada7d07e-42e4-49a3-8e59-d16dee8cb0f0] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:55:03.349657 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f28615a2-5ee2-4152-ae8a-f575f9a0a15c tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:55:03.350155 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f28615a2-5ee2-4152-ae8a-f575f9a0a15c tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:55:03.350595 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f28615a2-5ee2-4152-ae8a-f575f9a0a15c tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:55:03.355429 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f28615a2-5ee2-4152-ae8a-f575f9a0a15c tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:55:03.355931 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f28615a2-5ee2-4152-ae8a-f575f9a0a15c tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:55:03.356378 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f28615a2-5ee2-4152-ae8a-f575f9a0a15c tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:55:03.455577 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-04dad644-8141-464b-af8b-c544a1eaeb2b tempest-AggregatesAdminTestJSON-1442378289 tempest-AggregatesAdminTestJSON-1442378289-project-admin] 10.222.0.13 "POST /compute/v2.1/os-aggregates/11/action" status: 200 len: 242 microversion: 2.1 time: 1.144392 Nov 01 18:55:03.456529 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 114/224] 10.222.0.13 () {60 vars in 1194 bytes} [Tue Nov 1 18:55:02 2022] POST /compute/v2.1/os-aggregates/11/action => generated 242 bytes in 1146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 18:55:03.469876 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-927f34e4-33d5-41e9-b5ec-84e7f0f89424 tempest-AggregatesAdminTestJSON-1442378289 tempest-AggregatesAdminTestJSON-1442378289-project-admin] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:55:03.478966 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-927f34e4-33d5-41e9-b5ec-84e7f0f89424 tempest-AggregatesAdminTestJSON-1442378289 tempest-AggregatesAdminTestJSON-1442378289-project-admin] 10.222.0.13 "GET /compute/v2.1/os-aggregates/11" status: 200 len: 242 microversion: 2.1 time: 0.014391 Nov 01 18:55:03.479770 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 115/225] 10.222.0.13 () {58 vars in 1152 bytes} [Tue Nov 1 18:55:03 2022] GET /compute/v2.1/os-aggregates/11 => generated 242 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 18:55:03.498654 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-bc6f9265-740e-47a3-8304-4f6ed7ec5296 tempest-AggregatesAdminTestJSON-1442378289 tempest-AggregatesAdminTestJSON-1442378289-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-863052-2"}} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 18:55:03.530434 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-bc6f9265-740e-47a3-8304-4f6ed7ec5296 tempest-AggregatesAdminTestJSON-1442378289 tempest-AggregatesAdminTestJSON-1442378289-project-admin] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:55:03.532112 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-bc6f9265-740e-47a3-8304-4f6ed7ec5296 tempest-AggregatesAdminTestJSON-1442378289 tempest-AggregatesAdminTestJSON-1442378289-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:55:03.533615 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-bc6f9265-740e-47a3-8304-4f6ed7ec5296 tempest-AggregatesAdminTestJSON-1442378289 tempest-AggregatesAdminTestJSON-1442378289-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:55:03.564519 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-f28615a2-5ee2-4152-ae8a-f575f9a0a15c tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce2e0d1828674809a3344a7a68f375c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8e1248497284006a7acbb8169627ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:55:03.576894 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-f28615a2-5ee2-4152-ae8a-f575f9a0a15c tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] 10.222.0.13 "GET /compute/v2.1/servers/ada7d07e-42e4-49a3-8e59-d16dee8cb0f0" status: 200 len: 1271 microversion: 2.1 time: 0.255965 Nov 01 18:55:03.586280 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 111/226] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:55:03 2022] GET /compute/v2.1/servers/ada7d07e-42e4-49a3-8e59-d16dee8cb0f0 => generated 1271 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:55:03.751962 n-d-863052-2 devstack@n-api.service[121403]: DEBUG dbcounter [-] [121403] Writing DB stats nova_api:SELECT=88,nova_api:UPDATE=2,nova_api:DELETE=5,nova_api:INSERT=5 {{(pid=121403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 18:55:03.766454 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-bc6f9265-740e-47a3-8304-4f6ed7ec5296 tempest-AggregatesAdminTestJSON-1442378289 tempest-AggregatesAdminTestJSON-1442378289-project-admin] 10.222.0.13 "POST /compute/v2.1/os-aggregates/11/action" status: 200 len: 227 microversion: 2.1 time: 0.279196 Nov 01 18:55:03.773836 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 116/227] 10.222.0.13 () {60 vars in 1194 bytes} [Tue Nov 1 18:55:03 2022] POST /compute/v2.1/os-aggregates/11/action => generated 227 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 18:55:03.778973 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-b57ea7fd-9751-428b-827a-1b8e612d8a09 tempest-AggregatesAdminTestJSON-1442378289 tempest-AggregatesAdminTestJSON-1442378289-project-admin] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:55:03.816841 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-b57ea7fd-9751-428b-827a-1b8e612d8a09 tempest-AggregatesAdminTestJSON-1442378289 tempest-AggregatesAdminTestJSON-1442378289-project-admin] 10.222.0.13 "DELETE /compute/v2.1/os-aggregates/11" status: 200 len: 0 microversion: 2.1 time: 0.041620 Nov 01 18:55:03.822883 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 112/228] 10.222.0.13 () {58 vars in 1155 bytes} [Tue Nov 1 18:55:03 2022] DELETE /compute/v2.1/os-aggregates/11 => generated 0 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Nov 01 18:55:03.837635 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-a8825234-5135-433a-aa76-00e3632d28ff tempest-AggregatesAdminTestJSON-1442378289 tempest-AggregatesAdminTestJSON-1442378289-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-606482455"}} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 18:55:03.841844 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.objects.aggregate [None req-a8825234-5135-433a-aa76-00e3632d28ff tempest-AggregatesAdminTestJSON-1442378289 tempest-AggregatesAdminTestJSON-1442378289-project-admin] Generated uuid 7bd7efa1-c93d-48c2-bdd1-2657b89783ea for aggregate {{(pid=121403) create /opt/stack/nova/nova/objects/aggregate.py:298}} Nov 01 18:55:03.872505 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-a8825234-5135-433a-aa76-00e3632d28ff tempest-AggregatesAdminTestJSON-1442378289 tempest-AggregatesAdminTestJSON-1442378289-project-admin] 10.222.0.13 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.046756 Nov 01 18:55:03.875092 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 117/229] 10.222.0.13 () {60 vars in 1164 bytes} [Tue Nov 1 18:55:03 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 18:55:03.886546 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-50017468-c4a6-4194-a87a-39216d0e734d tempest-AggregatesAdminTestJSON-1442378289 tempest-AggregatesAdminTestJSON-1442378289-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-863052-2"}} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 18:55:03.925889 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-50017468-c4a6-4194-a87a-39216d0e734d tempest-AggregatesAdminTestJSON-1442378289 tempest-AggregatesAdminTestJSON-1442378289-project-admin] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:55:03.927238 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-50017468-c4a6-4194-a87a-39216d0e734d tempest-AggregatesAdminTestJSON-1442378289 tempest-AggregatesAdminTestJSON-1442378289-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:55:03.928385 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-50017468-c4a6-4194-a87a-39216d0e734d tempest-AggregatesAdminTestJSON-1442378289 tempest-AggregatesAdminTestJSON-1442378289-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:55:04.139160 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-50017468-c4a6-4194-a87a-39216d0e734d tempest-AggregatesAdminTestJSON-1442378289 tempest-AggregatesAdminTestJSON-1442378289-project-admin] 10.222.0.13 "POST /compute/v2.1/os-aggregates/12/action" status: 200 len: 242 microversion: 2.1 time: 0.256335 Nov 01 18:55:04.145341 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 113/230] 10.222.0.13 () {60 vars in 1194 bytes} [Tue Nov 1 18:55:03 2022] POST /compute/v2.1/os-aggregates/12/action => generated 242 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 18:55:04.151158 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-9074e01b-18a7-48ff-891d-380d216832e4 tempest-AggregatesAdminTestJSON-1442378289 tempest-AggregatesAdminTestJSON-1442378289-project-admin] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:55:04.164761 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-9074e01b-18a7-48ff-891d-380d216832e4 tempest-AggregatesAdminTestJSON-1442378289 tempest-AggregatesAdminTestJSON-1442378289-project-admin] 10.222.0.13 "GET /compute/v2.1/os-aggregates" status: 200 len: 245 microversion: 2.1 time: 0.017329 Nov 01 18:55:04.168607 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 118/231] 10.222.0.13 () {58 vars in 1143 bytes} [Tue Nov 1 18:55:04 2022] GET /compute/v2.1/os-aggregates => generated 245 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 18:55:04.181118 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-979aedb5-a16d-46c4-b361-a6b0c3f454d8 tempest-AggregatesAdminTestJSON-1442378289 tempest-AggregatesAdminTestJSON-1442378289-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-863052-2"}} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 18:55:04.193062 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-979aedb5-a16d-46c4-b361-a6b0c3f454d8 tempest-AggregatesAdminTestJSON-1442378289 tempest-AggregatesAdminTestJSON-1442378289-project-admin] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:55:04.193530 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-979aedb5-a16d-46c4-b361-a6b0c3f454d8 tempest-AggregatesAdminTestJSON-1442378289 tempest-AggregatesAdminTestJSON-1442378289-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:55:04.194369 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-979aedb5-a16d-46c4-b361-a6b0c3f454d8 tempest-AggregatesAdminTestJSON-1442378289 tempest-AggregatesAdminTestJSON-1442378289-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:55:04.348028 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-3f1a8e12-6e51-4a3d-9d38-c0bfe54c15ac tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:55:04.349061 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-3f1a8e12-6e51-4a3d-9d38-c0bfe54c15ac tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] [instance: 26132db2-1798-4ba6-88bb-aaf87f6848b3] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:55:04.356512 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-3f1a8e12-6e51-4a3d-9d38-c0bfe54c15ac tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:55:04.358534 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-3f1a8e12-6e51-4a3d-9d38-c0bfe54c15ac tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:55:04.359489 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-3f1a8e12-6e51-4a3d-9d38-c0bfe54c15ac tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:55:04.360533 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-3f1a8e12-6e51-4a3d-9d38-c0bfe54c15ac tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:55:04.361314 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-3f1a8e12-6e51-4a3d-9d38-c0bfe54c15ac tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:55:04.362448 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-3f1a8e12-6e51-4a3d-9d38-c0bfe54c15ac tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:55:04.393471 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-979aedb5-a16d-46c4-b361-a6b0c3f454d8 tempest-AggregatesAdminTestJSON-1442378289 tempest-AggregatesAdminTestJSON-1442378289-project-admin] 10.222.0.13 "POST /compute/v2.1/os-aggregates/12/action" status: 200 len: 227 microversion: 2.1 time: 0.217043 Nov 01 18:55:04.401268 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 114/232] 10.222.0.13 () {60 vars in 1194 bytes} [Tue Nov 1 18:55:04 2022] POST /compute/v2.1/os-aggregates/12/action => generated 227 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 18:55:04.410433 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-5bccfa8b-3ef3-45e9-ad8a-a285a5565881 tempest-AggregatesAdminTestJSON-1442378289 tempest-AggregatesAdminTestJSON-1442378289-project-admin] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:55:04.437965 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-5bccfa8b-3ef3-45e9-ad8a-a285a5565881 tempest-AggregatesAdminTestJSON-1442378289 tempest-AggregatesAdminTestJSON-1442378289-project-admin] 10.222.0.13 "DELETE /compute/v2.1/os-aggregates/12" status: 200 len: 0 microversion: 2.1 time: 0.035576 Nov 01 18:55:04.440986 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 115/233] 10.222.0.13 () {58 vars in 1155 bytes} [Tue Nov 1 18:55:04 2022] DELETE /compute/v2.1/os-aggregates/12 => generated 0 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Nov 01 18:55:04.452476 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-cbed711d-b2e7-49fe-993c-ed7387dd212c tempest-AggregatesAdminTestJSON-1442378289 tempest-AggregatesAdminTestJSON-1442378289-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-334207894"}} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 18:55:04.457298 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.objects.aggregate [None req-cbed711d-b2e7-49fe-993c-ed7387dd212c tempest-AggregatesAdminTestJSON-1442378289 tempest-AggregatesAdminTestJSON-1442378289-project-admin] Generated uuid a8ef1d30-c934-4dd7-a0ab-0b2b72ff2494 for aggregate {{(pid=121402) create /opt/stack/nova/nova/objects/aggregate.py:298}} Nov 01 18:55:04.491879 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-cbed711d-b2e7-49fe-993c-ed7387dd212c tempest-AggregatesAdminTestJSON-1442378289 tempest-AggregatesAdminTestJSON-1442378289-project-admin] 10.222.0.13 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.043434 Nov 01 18:55:04.492497 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 116/234] 10.222.0.13 () {60 vars in 1164 bytes} [Tue Nov 1 18:55:04 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 18:55:04.506254 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-aedea51e-e8d6-46e6-ad75-1f0a096da7c7 tempest-AggregatesAdminTestJSON-1442378289 tempest-AggregatesAdminTestJSON-1442378289-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-863052-2"}} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 18:55:04.530402 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-aedea51e-e8d6-46e6-ad75-1f0a096da7c7 tempest-AggregatesAdminTestJSON-1442378289 tempest-AggregatesAdminTestJSON-1442378289-project-admin] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:55:04.530893 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-aedea51e-e8d6-46e6-ad75-1f0a096da7c7 tempest-AggregatesAdminTestJSON-1442378289 tempest-AggregatesAdminTestJSON-1442378289-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:55:04.531326 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-aedea51e-e8d6-46e6-ad75-1f0a096da7c7 tempest-AggregatesAdminTestJSON-1442378289 tempest-AggregatesAdminTestJSON-1442378289-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:55:04.721448 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-aedea51e-e8d6-46e6-ad75-1f0a096da7c7 tempest-AggregatesAdminTestJSON-1442378289 tempest-AggregatesAdminTestJSON-1442378289-project-admin] 10.222.0.13 "POST /compute/v2.1/os-aggregates/13/action" status: 200 len: 242 microversion: 2.1 time: 0.219984 Nov 01 18:55:04.729346 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 117/235] 10.222.0.13 () {60 vars in 1194 bytes} [Tue Nov 1 18:55:04 2022] POST /compute/v2.1/os-aggregates/13/action => generated 242 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 18:55:04.735121 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-bcecf5aa-6f82-428f-b4b9-0f0645bc463f tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:55:04.735936 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-bcecf5aa-6f82-428f-b4b9-0f0645bc463f tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] [instance: ada7d07e-42e4-49a3-8e59-d16dee8cb0f0] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:55:04.744133 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-bcecf5aa-6f82-428f-b4b9-0f0645bc463f tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:55:04.744908 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-bcecf5aa-6f82-428f-b4b9-0f0645bc463f tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:55:04.745951 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-bcecf5aa-6f82-428f-b4b9-0f0645bc463f tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:55:04.746808 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-bcecf5aa-6f82-428f-b4b9-0f0645bc463f tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:55:04.747410 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-bcecf5aa-6f82-428f-b4b9-0f0645bc463f tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:55:04.747991 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-bcecf5aa-6f82-428f-b4b9-0f0645bc463f tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:55:04.849477 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-3f1a8e12-6e51-4a3d-9d38-c0bfe54c15ac tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07a2a96629f4baea6a3adfc4011ffe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9baf3860ba564f5c8dff93085b9aabe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:55:04.863735 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-3f1a8e12-6e51-4a3d-9d38-c0bfe54c15ac tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] 10.222.0.13 "GET /compute/v2.1/servers/26132db2-1798-4ba6-88bb-aaf87f6848b3" status: 200 len: 1387 microversion: 2.1 time: 0.521344 Nov 01 18:55:04.864708 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 119/236] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:55:04 2022] GET /compute/v2.1/servers/26132db2-1798-4ba6-88bb-aaf87f6848b3 => generated 1387 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:55:04.871984 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-1617f0f4-0c08-4e61-ad65-297ea85d6892 tempest-AggregatesAdminTestJSON-1442378289 tempest-AggregatesAdminTestJSON-1442378289-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-863052-2"}} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 18:55:04.885758 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-1617f0f4-0c08-4e61-ad65-297ea85d6892 tempest-AggregatesAdminTestJSON-1442378289 tempest-AggregatesAdminTestJSON-1442378289-project-admin] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:55:04.886248 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-1617f0f4-0c08-4e61-ad65-297ea85d6892 tempest-AggregatesAdminTestJSON-1442378289 tempest-AggregatesAdminTestJSON-1442378289-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:55:04.888019 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-1617f0f4-0c08-4e61-ad65-297ea85d6892 tempest-AggregatesAdminTestJSON-1442378289 tempest-AggregatesAdminTestJSON-1442378289-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:55:04.910891 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-bcecf5aa-6f82-428f-b4b9-0f0645bc463f tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce2e0d1828674809a3344a7a68f375c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8e1248497284006a7acbb8169627ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:55:04.926975 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-bcecf5aa-6f82-428f-b4b9-0f0645bc463f tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] 10.222.0.13 "GET /compute/v2.1/servers/ada7d07e-42e4-49a3-8e59-d16dee8cb0f0" status: 200 len: 1277 microversion: 2.1 time: 0.196186 Nov 01 18:55:04.927549 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 118/237] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:55:04 2022] GET /compute/v2.1/servers/ada7d07e-42e4-49a3-8e59-d16dee8cb0f0 => generated 1277 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:55:05.077948 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-1617f0f4-0c08-4e61-ad65-297ea85d6892 tempest-AggregatesAdminTestJSON-1442378289 tempest-AggregatesAdminTestJSON-1442378289-project-admin] 10.222.0.13 "POST /compute/v2.1/os-aggregates/13/action" status: 200 len: 227 microversion: 2.1 time: 0.212162 Nov 01 18:55:05.084789 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 120/238] 10.222.0.13 () {60 vars in 1194 bytes} [Tue Nov 1 18:55:04 2022] POST /compute/v2.1/os-aggregates/13/action => generated 227 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 18:55:05.094560 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-9327741d-8c85-408d-a06e-5074da4eeffa tempest-AggregatesAdminTestJSON-1442378289 tempest-AggregatesAdminTestJSON-1442378289-project-admin] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:55:05.151138 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-9327741d-8c85-408d-a06e-5074da4eeffa tempest-AggregatesAdminTestJSON-1442378289 tempest-AggregatesAdminTestJSON-1442378289-project-admin] 10.222.0.13 "DELETE /compute/v2.1/os-aggregates/13" status: 200 len: 0 microversion: 2.1 time: 0.064286 Nov 01 18:55:05.158347 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 119/239] 10.222.0.13 () {58 vars in 1155 bytes} [Tue Nov 1 18:55:05 2022] DELETE /compute/v2.1/os-aggregates/13 => generated 0 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Nov 01 18:55:05.169672 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-bee60305-7b92-4629-8fae-37f19f36677d tempest-AggregatesAdminTestJSON-1442378289 tempest-AggregatesAdminTestJSON-1442378289-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1464966518"}} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 18:55:05.177542 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.objects.aggregate [None req-bee60305-7b92-4629-8fae-37f19f36677d tempest-AggregatesAdminTestJSON-1442378289 tempest-AggregatesAdminTestJSON-1442378289-project-admin] Generated uuid 93ced20a-5e1e-45a8-a9ce-fd74610afed8 for aggregate {{(pid=121403) create /opt/stack/nova/nova/objects/aggregate.py:298}} Nov 01 18:55:05.233493 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-bee60305-7b92-4629-8fae-37f19f36677d tempest-AggregatesAdminTestJSON-1442378289 tempest-AggregatesAdminTestJSON-1442378289-project-admin] 10.222.0.13 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.062501 Nov 01 18:55:05.234577 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 121/240] 10.222.0.13 () {60 vars in 1164 bytes} [Tue Nov 1 18:55:05 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 18:55:05.250353 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-ef27a016-1899-4db7-a42b-8937e0a7277d tempest-AggregatesAdminTestJSON-1442378289 tempest-AggregatesAdminTestJSON-1442378289-project-admin] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:55:05.291133 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-ef27a016-1899-4db7-a42b-8937e0a7277d tempest-AggregatesAdminTestJSON-1442378289 tempest-AggregatesAdminTestJSON-1442378289-project-admin] 10.222.0.13 "DELETE /compute/v2.1/os-aggregates/14" status: 200 len: 0 microversion: 2.1 time: 0.048515 Nov 01 18:55:05.291879 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 120/241] 10.222.0.13 () {58 vars in 1155 bytes} [Tue Nov 1 18:55:05 2022] DELETE /compute/v2.1/os-aggregates/14 => generated 0 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Nov 01 18:55:05.302715 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-c8ce4c48-b71e-4413-89d7-7e9c11e692b4 tempest-AggregatesAdminTestJSON-1442378289 tempest-AggregatesAdminTestJSON-1442378289-project-admin] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:55:05.346740 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.wsgi [None req-c8ce4c48-b71e-4413-89d7-7e9c11e692b4 tempest-AggregatesAdminTestJSON-1442378289 tempest-AggregatesAdminTestJSON-1442378289-project-admin] HTTP exception thrown: Aggregate 14 could not be found. Nov 01 18:55:05.357652 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-c8ce4c48-b71e-4413-89d7-7e9c11e692b4 tempest-AggregatesAdminTestJSON-1442378289 tempest-AggregatesAdminTestJSON-1442378289-project-admin] Request method failure captured: Nov 01 18:55:05.357652 n-d-863052-2 devstack@n-api.service[121403]: request: GET /compute/v2.1/os-aggregates/14 HTTP/1.1 Nov 01 18:55:05.357652 n-d-863052-2 devstack@n-api.service[121403]: Accept: application/json Nov 01 18:55:05.357652 n-d-863052-2 devstack@n-api.service[121403]: Accept-Encoding: identity Nov 01 18:55:05.357652 n-d-863052-2 devstack@n-api.service[121403]: Connection: close Nov 01 18:55:05.357652 n-d-863052-2 devstack@n-api.service[121403]: Content-Length: 0 Nov 01 18:55:05.357652 n-d-863052-2 devstack@n-api.service[121403]: Content-Type: application/json Nov 01 18:55:05.357652 n-d-863052-2 devstack@n-api.service[121403]: Host: 10.222.0.13 Nov 01 18:55:05.357652 n-d-863052-2 devstack@n-api.service[121403]: Openstack-System-Scope: None Nov 01 18:55:05.357652 n-d-863052-2 devstack@n-api.service[121403]: User-Agent: python-urllib3/1.26.12 Nov 01 18:55:05.357652 n-d-863052-2 devstack@n-api.service[121403]: X-Auth-Token: gAAAAABjYWtaL3ZhwqOBKgcL-f2B_aY9JGqHsbQ5-7DC8xbXifpaoyHq8uG-JcyeP9QZGk7ih-XjRgXDW3pRyMb75f5pRUzdWdHa3Dw8qF1h-QtYJE54xxslCirMA3Ur0-CepyU7axPNdlPPw1XB7vDz6bZSn5_P3F0mgwU8VZ6s8Oe6ryw-ylQ Nov 01 18:55:05.357652 n-d-863052-2 devstack@n-api.service[121403]: X-Domain-Id: None Nov 01 18:55:05.357652 n-d-863052-2 devstack@n-api.service[121403]: X-Domain-Name: None Nov 01 18:55:05.357652 n-d-863052-2 devstack@n-api.service[121403]: X-Identity-Status: Confirmed Nov 01 18:55:05.357652 n-d-863052-2 devstack@n-api.service[121403]: X-Is-Admin-Project: True Nov 01 18:55:05.357652 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Domain-Id: default Nov 01 18:55:05.357652 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Domain-Name: Default Nov 01 18:55:05.357652 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Id: 7fc6161512634fb79c917463f766384a Nov 01 18:55:05.357652 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Name: tempest-AggregatesAdminTestJSON-1442378289 Nov 01 18:55:05.357652 n-d-863052-2 devstack@n-api.service[121403]: X-Role: admin,member,reader Nov 01 18:55:05.357652 n-d-863052-2 devstack@n-api.service[121403]: X-Roles: admin,member,reader Nov 01 18:55:05.359076 n-d-863052-2 devstack@n-api.service[121403]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/7fc6161512634fb79c917463f766384a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/7fc6161512634fb79c917463f766384a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_7fc6161512634fb79c917463f766384a", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/7fc6161512634fb79c917463f766384a"}]}] Nov 01 18:55:05.359076 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant: tempest-AggregatesAdminTestJSON-1442378289 Nov 01 18:55:05.359076 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant-Id: 7fc6161512634fb79c917463f766384a Nov 01 18:55:05.359076 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1442378289 Nov 01 18:55:05.359076 n-d-863052-2 devstack@n-api.service[121403]: X-User: tempest-AggregatesAdminTestJSON-1442378289-project-admin Nov 01 18:55:05.359076 n-d-863052-2 devstack@n-api.service[121403]: X-User-Domain-Id: default Nov 01 18:55:05.359076 n-d-863052-2 devstack@n-api.service[121403]: X-User-Domain-Name: Default Nov 01 18:55:05.359076 n-d-863052-2 devstack@n-api.service[121403]: X-User-Id: 541d39b69e684c9e9950e2cbb946c485 Nov 01 18:55:05.359076 n-d-863052-2 devstack@n-api.service[121403]: X-User-Name: tempest-AggregatesAdminTestJSON-1442378289-project-admin Nov 01 18:55:05.359076 n-d-863052-2 devstack@n-api.service[121403]: method: > Nov 01 18:55:05.359076 n-d-863052-2 devstack@n-api.service[121403]: exception: Aggregate 14 could not be found. Nov 01 18:55:05.359076 n-d-863052-2 devstack@n-api.service[121403]: action_args: {'id': '14'} Nov 01 18:55:05.359076 n-d-863052-2 devstack@n-api.service[121403]: {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 01 18:55:05.359894 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:55:05.359894 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Nov 01 18:55:05.359894 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Nov 01 18:55:05.359894 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6464, in get_aggregate Nov 01 18:55:05.359894 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Nov 01 18:55:05.359894 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 01 18:55:05.359894 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 01 18:55:05.359894 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Nov 01 18:55:05.359894 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Nov 01 18:55:05.359894 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Nov 01 18:55:05.359894 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Nov 01 18:55:05.359894 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Nov 01 18:55:05.359894 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Nov 01 18:55:05.359894 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 14 could not be found. Nov 01 18:55:05.359894 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 18:55:05.359894 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 18:55:05.359894 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 18:55:05.359894 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:55:05.359894 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 18:55:05.361857 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 18:55:05.361857 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 01 18:55:05.361857 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 01 18:55:05.361857 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 01 18:55:05.361857 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 01 18:55:05.361857 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Nov 01 18:55:05.361857 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 01 18:55:05.361857 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 14 could not be found. Nov 01 18:55:05.361857 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 18:55:05.361857 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 18:55:05.361857 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 18:55:05.361857 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:55:05.361857 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 18:55:05.361857 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 18:55:05.361857 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 01 18:55:05.361857 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 01 18:55:05.361857 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 14 could not be found. Nov 01 18:55:05.361857 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 18:55:05.366325 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-c8ce4c48-b71e-4413-89d7-7e9c11e692b4 tempest-AggregatesAdminTestJSON-1442378289 tempest-AggregatesAdminTestJSON-1442378289-project-admin] Returning 404 to user: Aggregate 14 could not be found. {{(pid=121403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 01 18:55:05.369338 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-c8ce4c48-b71e-4413-89d7-7e9c11e692b4 tempest-AggregatesAdminTestJSON-1442378289 tempest-AggregatesAdminTestJSON-1442378289-project-admin] 10.222.0.13 "GET /compute/v2.1/os-aggregates/14" status: 404 len: 78 microversion: 2.1 time: 0.072615 Nov 01 18:55:05.370767 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 122/242] 10.222.0.13 () {58 vars in 1152 bytes} [Tue Nov 1 18:55:05 2022] GET /compute/v2.1/os-aggregates/14 => generated 78 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 01 18:55:05.380136 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-c66f0e28-9ab7-4057-9dc9-dc1240ca9e1c tempest-AggregatesAdminTestJSON-1442378289 tempest-AggregatesAdminTestJSON-1442378289-project-admin] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:55:05.418686 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.wsgi [None req-c66f0e28-9ab7-4057-9dc9-dc1240ca9e1c tempest-AggregatesAdminTestJSON-1442378289 tempest-AggregatesAdminTestJSON-1442378289-project-admin] HTTP exception thrown: Aggregate 14 could not be found. Nov 01 18:55:05.431150 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-c66f0e28-9ab7-4057-9dc9-dc1240ca9e1c tempest-AggregatesAdminTestJSON-1442378289 tempest-AggregatesAdminTestJSON-1442378289-project-admin] Request method failure captured: Nov 01 18:55:05.431150 n-d-863052-2 devstack@n-api.service[121402]: request: DELETE /compute/v2.1/os-aggregates/14 HTTP/1.1 Nov 01 18:55:05.431150 n-d-863052-2 devstack@n-api.service[121402]: Accept: application/json Nov 01 18:55:05.431150 n-d-863052-2 devstack@n-api.service[121402]: Accept-Encoding: identity Nov 01 18:55:05.431150 n-d-863052-2 devstack@n-api.service[121402]: Connection: close Nov 01 18:55:05.431150 n-d-863052-2 devstack@n-api.service[121402]: Content-Length: 0 Nov 01 18:55:05.431150 n-d-863052-2 devstack@n-api.service[121402]: Content-Type: application/json Nov 01 18:55:05.431150 n-d-863052-2 devstack@n-api.service[121402]: Host: 10.222.0.13 Nov 01 18:55:05.431150 n-d-863052-2 devstack@n-api.service[121402]: Openstack-System-Scope: None Nov 01 18:55:05.431150 n-d-863052-2 devstack@n-api.service[121402]: User-Agent: python-urllib3/1.26.12 Nov 01 18:55:05.431150 n-d-863052-2 devstack@n-api.service[121402]: X-Auth-Token: gAAAAABjYWtaL3ZhwqOBKgcL-f2B_aY9JGqHsbQ5-7DC8xbXifpaoyHq8uG-JcyeP9QZGk7ih-XjRgXDW3pRyMb75f5pRUzdWdHa3Dw8qF1h-QtYJE54xxslCirMA3Ur0-CepyU7axPNdlPPw1XB7vDz6bZSn5_P3F0mgwU8VZ6s8Oe6ryw-ylQ Nov 01 18:55:05.431150 n-d-863052-2 devstack@n-api.service[121402]: X-Domain-Id: None Nov 01 18:55:05.431150 n-d-863052-2 devstack@n-api.service[121402]: X-Domain-Name: None Nov 01 18:55:05.431150 n-d-863052-2 devstack@n-api.service[121402]: X-Identity-Status: Confirmed Nov 01 18:55:05.431150 n-d-863052-2 devstack@n-api.service[121402]: X-Is-Admin-Project: True Nov 01 18:55:05.431150 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Domain-Id: default Nov 01 18:55:05.431150 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Domain-Name: Default Nov 01 18:55:05.431150 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Id: 7fc6161512634fb79c917463f766384a Nov 01 18:55:05.431150 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Name: tempest-AggregatesAdminTestJSON-1442378289 Nov 01 18:55:05.431150 n-d-863052-2 devstack@n-api.service[121402]: X-Role: admin,member,reader Nov 01 18:55:05.431150 n-d-863052-2 devstack@n-api.service[121402]: X-Roles: admin,member,reader Nov 01 18:55:05.432489 n-d-863052-2 devstack@n-api.service[121402]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/7fc6161512634fb79c917463f766384a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/7fc6161512634fb79c917463f766384a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_7fc6161512634fb79c917463f766384a", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/7fc6161512634fb79c917463f766384a"}]}] Nov 01 18:55:05.432489 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant: tempest-AggregatesAdminTestJSON-1442378289 Nov 01 18:55:05.432489 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant-Id: 7fc6161512634fb79c917463f766384a Nov 01 18:55:05.432489 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1442378289 Nov 01 18:55:05.432489 n-d-863052-2 devstack@n-api.service[121402]: X-User: tempest-AggregatesAdminTestJSON-1442378289-project-admin Nov 01 18:55:05.432489 n-d-863052-2 devstack@n-api.service[121402]: X-User-Domain-Id: default Nov 01 18:55:05.432489 n-d-863052-2 devstack@n-api.service[121402]: X-User-Domain-Name: Default Nov 01 18:55:05.432489 n-d-863052-2 devstack@n-api.service[121402]: X-User-Id: 541d39b69e684c9e9950e2cbb946c485 Nov 01 18:55:05.432489 n-d-863052-2 devstack@n-api.service[121402]: X-User-Name: tempest-AggregatesAdminTestJSON-1442378289-project-admin Nov 01 18:55:05.432489 n-d-863052-2 devstack@n-api.service[121402]: method: > Nov 01 18:55:05.432489 n-d-863052-2 devstack@n-api.service[121402]: exception: Aggregate 14 could not be found. Nov 01 18:55:05.432489 n-d-863052-2 devstack@n-api.service[121402]: action_args: {'id': '14'} Nov 01 18:55:05.432489 n-d-863052-2 devstack@n-api.service[121402]: {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 01 18:55:05.433356 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:55:05.433356 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Nov 01 18:55:05.433356 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Nov 01 18:55:05.433356 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Nov 01 18:55:05.433356 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Nov 01 18:55:05.433356 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 01 18:55:05.433356 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 01 18:55:05.433356 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 01 18:55:05.433356 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise self.value Nov 01 18:55:05.433356 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Nov 01 18:55:05.433356 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Nov 01 18:55:05.433356 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6517, in delete_aggregate Nov 01 18:55:05.433356 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Nov 01 18:55:05.433356 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 01 18:55:05.433356 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 01 18:55:05.433356 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Nov 01 18:55:05.433356 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Nov 01 18:55:05.433356 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Nov 01 18:55:05.433356 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Nov 01 18:55:05.434575 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Nov 01 18:55:05.434575 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Nov 01 18:55:05.434575 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 14 could not be found. Nov 01 18:55:05.434575 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 18:55:05.434575 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 18:55:05.434575 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 18:55:05.434575 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:55:05.434575 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 18:55:05.434575 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 18:55:05.434575 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 01 18:55:05.434575 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 01 18:55:05.434575 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 01 18:55:05.434575 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 01 18:55:05.434575 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Nov 01 18:55:05.434575 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 01 18:55:05.434575 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 14 could not be found. Nov 01 18:55:05.434575 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 18:55:05.434575 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 18:55:05.434575 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 18:55:05.434575 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:55:05.434575 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 18:55:05.435864 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 18:55:05.435864 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 01 18:55:05.435864 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 01 18:55:05.435864 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 14 could not be found. Nov 01 18:55:05.435864 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 18:55:05.442640 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-c66f0e28-9ab7-4057-9dc9-dc1240ca9e1c tempest-AggregatesAdminTestJSON-1442378289 tempest-AggregatesAdminTestJSON-1442378289-project-admin] Returning 404 to user: Aggregate 14 could not be found. {{(pid=121402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 01 18:55:05.447953 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-c66f0e28-9ab7-4057-9dc9-dc1240ca9e1c tempest-AggregatesAdminTestJSON-1442378289 tempest-AggregatesAdminTestJSON-1442378289-project-admin] 10.222.0.13 "DELETE /compute/v2.1/os-aggregates/14" status: 404 len: 78 microversion: 2.1 time: 0.072503 Nov 01 18:55:05.451418 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 121/243] 10.222.0.13 () {58 vars in 1155 bytes} [Tue Nov 1 18:55:05 2022] DELETE /compute/v2.1/os-aggregates/14 => generated 78 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Nov 01 18:55:05.462072 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-e22d5765-bc82-430e-937b-0c27edf32289 tempest-AggregatesAdminTestJSON-1442378289 tempest-AggregatesAdminTestJSON-1442378289-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-1146281339", "name": "tempest-test_aggregate-455386233"}} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 18:55:05.509861 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.objects.aggregate [None req-e22d5765-bc82-430e-937b-0c27edf32289 tempest-AggregatesAdminTestJSON-1442378289 tempest-AggregatesAdminTestJSON-1442378289-project-admin] Generated uuid 86255754-c2db-4cb2-b7b0-45eb4e01db73 for aggregate {{(pid=121403) create /opt/stack/nova/nova/objects/aggregate.py:298}} Nov 01 18:55:05.579392 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-e22d5765-bc82-430e-937b-0c27edf32289 tempest-AggregatesAdminTestJSON-1442378289 tempest-AggregatesAdminTestJSON-1442378289-project-admin] 10.222.0.13 "POST /compute/v2.1/os-aggregates" status: 200 len: 222 microversion: 2.1 time: 0.121047 Nov 01 18:55:05.580365 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 123/244] 10.222.0.13 () {60 vars in 1165 bytes} [Tue Nov 1 18:55:05 2022] POST /compute/v2.1/os-aggregates => generated 222 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 01 18:55:05.593830 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-b258dfa9-b64b-420c-b70d-cc7dad49c84a tempest-AggregatesAdminTestJSON-1442378289 tempest-AggregatesAdminTestJSON-1442378289-project-admin] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:55:05.614126 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [req-1ca2be7e-c8a4-4f12-92b4-137990f0c105 req-2b5f5766-a22e-49e3-a100-ab94d6087fb2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "26132db2-1798-4ba6-88bb-aaf87f6848b3", "tag": "9bb445f8-37ab-49c7-9c66-0066ff9683cc"}]} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 18:55:05.645175 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-1ca2be7e-c8a4-4f12-92b4-137990f0c105 req-2b5f5766-a22e-49e3-a100-ab94d6087fb2 service nova] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:55:05.648608 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-1ca2be7e-c8a4-4f12-92b4-137990f0c105 req-2b5f5766-a22e-49e3-a100-ab94d6087fb2 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:55:05.650855 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-1ca2be7e-c8a4-4f12-92b4-137990f0c105 req-2b5f5766-a22e-49e3-a100-ab94d6087fb2 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:55:05.673965 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-b258dfa9-b64b-420c-b70d-cc7dad49c84a tempest-AggregatesAdminTestJSON-1442378289 tempest-AggregatesAdminTestJSON-1442378289-project-admin] 10.222.0.13 "DELETE /compute/v2.1/os-aggregates/15" status: 200 len: 0 microversion: 2.1 time: 0.084515 Nov 01 18:55:05.677007 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 122/245] 10.222.0.13 () {58 vars in 1155 bytes} [Tue Nov 1 18:55:05 2022] DELETE /compute/v2.1/os-aggregates/15 => generated 0 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Nov 01 18:55:05.691698 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-1bf1858e-7168-48b7-a09b-bdc9d55c2eac tempest-AggregatesAdminTestJSON-1442378289 tempest-AggregatesAdminTestJSON-1442378289-project-admin] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:55:05.700425 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.compute.server_external_events [req-1ca2be7e-c8a4-4f12-92b4-137990f0c105 req-2b5f5766-a22e-49e3-a100-ab94d6087fb2 service nova] Creating event network-changed:9bb445f8-37ab-49c7-9c66-0066ff9683cc for instance 26132db2-1798-4ba6-88bb-aaf87f6848b3 on n-h2-863052-2 Nov 01 18:55:05.712863 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.wsgi [None req-1bf1858e-7168-48b7-a09b-bdc9d55c2eac tempest-AggregatesAdminTestJSON-1442378289 tempest-AggregatesAdminTestJSON-1442378289-project-admin] HTTP exception thrown: Aggregate 15 could not be found. Nov 01 18:55:05.715012 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-1bf1858e-7168-48b7-a09b-bdc9d55c2eac tempest-AggregatesAdminTestJSON-1442378289 tempest-AggregatesAdminTestJSON-1442378289-project-admin] Request method failure captured: Nov 01 18:55:05.715012 n-d-863052-2 devstack@n-api.service[121402]: request: GET /compute/v2.1/os-aggregates/15 HTTP/1.1 Nov 01 18:55:05.715012 n-d-863052-2 devstack@n-api.service[121402]: Accept: application/json Nov 01 18:55:05.715012 n-d-863052-2 devstack@n-api.service[121402]: Accept-Encoding: identity Nov 01 18:55:05.715012 n-d-863052-2 devstack@n-api.service[121402]: Connection: close Nov 01 18:55:05.715012 n-d-863052-2 devstack@n-api.service[121402]: Content-Length: 0 Nov 01 18:55:05.715012 n-d-863052-2 devstack@n-api.service[121402]: Content-Type: application/json Nov 01 18:55:05.715012 n-d-863052-2 devstack@n-api.service[121402]: Host: 10.222.0.13 Nov 01 18:55:05.715012 n-d-863052-2 devstack@n-api.service[121402]: Openstack-System-Scope: None Nov 01 18:55:05.715012 n-d-863052-2 devstack@n-api.service[121402]: User-Agent: python-urllib3/1.26.12 Nov 01 18:55:05.715012 n-d-863052-2 devstack@n-api.service[121402]: X-Auth-Token: gAAAAABjYWtaL3ZhwqOBKgcL-f2B_aY9JGqHsbQ5-7DC8xbXifpaoyHq8uG-JcyeP9QZGk7ih-XjRgXDW3pRyMb75f5pRUzdWdHa3Dw8qF1h-QtYJE54xxslCirMA3Ur0-CepyU7axPNdlPPw1XB7vDz6bZSn5_P3F0mgwU8VZ6s8Oe6ryw-ylQ Nov 01 18:55:05.715012 n-d-863052-2 devstack@n-api.service[121402]: X-Domain-Id: None Nov 01 18:55:05.715012 n-d-863052-2 devstack@n-api.service[121402]: X-Domain-Name: None Nov 01 18:55:05.715012 n-d-863052-2 devstack@n-api.service[121402]: X-Identity-Status: Confirmed Nov 01 18:55:05.715012 n-d-863052-2 devstack@n-api.service[121402]: X-Is-Admin-Project: True Nov 01 18:55:05.715012 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Domain-Id: default Nov 01 18:55:05.715012 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Domain-Name: Default Nov 01 18:55:05.715012 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Id: 7fc6161512634fb79c917463f766384a Nov 01 18:55:05.715012 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Name: tempest-AggregatesAdminTestJSON-1442378289 Nov 01 18:55:05.715012 n-d-863052-2 devstack@n-api.service[121402]: X-Role: admin,member,reader Nov 01 18:55:05.715012 n-d-863052-2 devstack@n-api.service[121402]: X-Roles: admin,member,reader Nov 01 18:55:05.716295 n-d-863052-2 devstack@n-api.service[121402]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/7fc6161512634fb79c917463f766384a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/7fc6161512634fb79c917463f766384a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_7fc6161512634fb79c917463f766384a", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/7fc6161512634fb79c917463f766384a"}]}] Nov 01 18:55:05.716295 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant: tempest-AggregatesAdminTestJSON-1442378289 Nov 01 18:55:05.716295 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant-Id: 7fc6161512634fb79c917463f766384a Nov 01 18:55:05.716295 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1442378289 Nov 01 18:55:05.716295 n-d-863052-2 devstack@n-api.service[121402]: X-User: tempest-AggregatesAdminTestJSON-1442378289-project-admin Nov 01 18:55:05.716295 n-d-863052-2 devstack@n-api.service[121402]: X-User-Domain-Id: default Nov 01 18:55:05.716295 n-d-863052-2 devstack@n-api.service[121402]: X-User-Domain-Name: Default Nov 01 18:55:05.716295 n-d-863052-2 devstack@n-api.service[121402]: X-User-Id: 541d39b69e684c9e9950e2cbb946c485 Nov 01 18:55:05.716295 n-d-863052-2 devstack@n-api.service[121402]: X-User-Name: tempest-AggregatesAdminTestJSON-1442378289-project-admin Nov 01 18:55:05.716295 n-d-863052-2 devstack@n-api.service[121402]: method: > Nov 01 18:55:05.716295 n-d-863052-2 devstack@n-api.service[121402]: exception: Aggregate 15 could not be found. Nov 01 18:55:05.716295 n-d-863052-2 devstack@n-api.service[121402]: action_args: {'id': '15'} Nov 01 18:55:05.716295 n-d-863052-2 devstack@n-api.service[121402]: {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 01 18:55:05.717067 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:55:05.717067 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Nov 01 18:55:05.717067 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Nov 01 18:55:05.717067 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6464, in get_aggregate Nov 01 18:55:05.717067 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Nov 01 18:55:05.717067 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 01 18:55:05.717067 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 01 18:55:05.717067 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Nov 01 18:55:05.717067 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Nov 01 18:55:05.717067 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Nov 01 18:55:05.717067 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Nov 01 18:55:05.717067 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Nov 01 18:55:05.717067 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Nov 01 18:55:05.717067 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 15 could not be found. Nov 01 18:55:05.717067 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 18:55:05.717067 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 18:55:05.717067 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 18:55:05.717067 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:55:05.717067 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 18:55:05.718218 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 18:55:05.718218 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 01 18:55:05.718218 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 01 18:55:05.718218 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 01 18:55:05.718218 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 01 18:55:05.718218 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Nov 01 18:55:05.718218 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 01 18:55:05.718218 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 15 could not be found. Nov 01 18:55:05.718218 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 18:55:05.718218 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 18:55:05.718218 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 18:55:05.718218 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:55:05.718218 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 18:55:05.718218 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 18:55:05.718218 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 01 18:55:05.718218 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 01 18:55:05.718218 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 15 could not be found. Nov 01 18:55:05.718218 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 18:55:05.719170 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [req-1ca2be7e-c8a4-4f12-92b4-137990f0c105 req-2b5f5766-a22e-49e3-a100-ab94d6087fb2 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.107339 Nov 01 18:55:05.719170 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 124/246] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Nov 1 18:55:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 01 18:55:05.721023 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-1bf1858e-7168-48b7-a09b-bdc9d55c2eac tempest-AggregatesAdminTestJSON-1442378289 tempest-AggregatesAdminTestJSON-1442378289-project-admin] Returning 404 to user: Aggregate 15 could not be found. {{(pid=121402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 01 18:55:05.721883 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-1bf1858e-7168-48b7-a09b-bdc9d55c2eac tempest-AggregatesAdminTestJSON-1442378289 tempest-AggregatesAdminTestJSON-1442378289-project-admin] 10.222.0.13 "GET /compute/v2.1/os-aggregates/15" status: 404 len: 78 microversion: 2.1 time: 0.039801 Nov 01 18:55:05.726832 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 123/247] 10.222.0.13 () {58 vars in 1152 bytes} [Tue Nov 1 18:55:05 2022] GET /compute/v2.1/os-aggregates/15 => generated 78 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 01 18:55:05.736844 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-9f2ef832-cc4e-4a05-ab8c-f5618d015290 tempest-AggregatesAdminTestJSON-1442378289 tempest-AggregatesAdminTestJSON-1442378289-project-admin] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:55:05.769745 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.wsgi [None req-9f2ef832-cc4e-4a05-ab8c-f5618d015290 tempest-AggregatesAdminTestJSON-1442378289 tempest-AggregatesAdminTestJSON-1442378289-project-admin] HTTP exception thrown: Aggregate 15 could not be found. Nov 01 18:55:05.771535 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-9f2ef832-cc4e-4a05-ab8c-f5618d015290 tempest-AggregatesAdminTestJSON-1442378289 tempest-AggregatesAdminTestJSON-1442378289-project-admin] Request method failure captured: Nov 01 18:55:05.771535 n-d-863052-2 devstack@n-api.service[121403]: request: DELETE /compute/v2.1/os-aggregates/15 HTTP/1.1 Nov 01 18:55:05.771535 n-d-863052-2 devstack@n-api.service[121403]: Accept: application/json Nov 01 18:55:05.771535 n-d-863052-2 devstack@n-api.service[121403]: Accept-Encoding: identity Nov 01 18:55:05.771535 n-d-863052-2 devstack@n-api.service[121403]: Connection: close Nov 01 18:55:05.771535 n-d-863052-2 devstack@n-api.service[121403]: Content-Length: 0 Nov 01 18:55:05.771535 n-d-863052-2 devstack@n-api.service[121403]: Content-Type: application/json Nov 01 18:55:05.771535 n-d-863052-2 devstack@n-api.service[121403]: Host: 10.222.0.13 Nov 01 18:55:05.771535 n-d-863052-2 devstack@n-api.service[121403]: Openstack-System-Scope: None Nov 01 18:55:05.771535 n-d-863052-2 devstack@n-api.service[121403]: User-Agent: python-urllib3/1.26.12 Nov 01 18:55:05.771535 n-d-863052-2 devstack@n-api.service[121403]: X-Auth-Token: gAAAAABjYWtaL3ZhwqOBKgcL-f2B_aY9JGqHsbQ5-7DC8xbXifpaoyHq8uG-JcyeP9QZGk7ih-XjRgXDW3pRyMb75f5pRUzdWdHa3Dw8qF1h-QtYJE54xxslCirMA3Ur0-CepyU7axPNdlPPw1XB7vDz6bZSn5_P3F0mgwU8VZ6s8Oe6ryw-ylQ Nov 01 18:55:05.771535 n-d-863052-2 devstack@n-api.service[121403]: X-Domain-Id: None Nov 01 18:55:05.771535 n-d-863052-2 devstack@n-api.service[121403]: X-Domain-Name: None Nov 01 18:55:05.771535 n-d-863052-2 devstack@n-api.service[121403]: X-Identity-Status: Confirmed Nov 01 18:55:05.771535 n-d-863052-2 devstack@n-api.service[121403]: X-Is-Admin-Project: True Nov 01 18:55:05.771535 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Domain-Id: default Nov 01 18:55:05.771535 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Domain-Name: Default Nov 01 18:55:05.771535 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Id: 7fc6161512634fb79c917463f766384a Nov 01 18:55:05.771535 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Name: tempest-AggregatesAdminTestJSON-1442378289 Nov 01 18:55:05.771535 n-d-863052-2 devstack@n-api.service[121403]: X-Role: admin,member,reader Nov 01 18:55:05.771535 n-d-863052-2 devstack@n-api.service[121403]: X-Roles: admin,member,reader Nov 01 18:55:05.772768 n-d-863052-2 devstack@n-api.service[121403]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/7fc6161512634fb79c917463f766384a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/7fc6161512634fb79c917463f766384a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_7fc6161512634fb79c917463f766384a", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/7fc6161512634fb79c917463f766384a"}]}] Nov 01 18:55:05.772768 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant: tempest-AggregatesAdminTestJSON-1442378289 Nov 01 18:55:05.772768 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant-Id: 7fc6161512634fb79c917463f766384a Nov 01 18:55:05.772768 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1442378289 Nov 01 18:55:05.772768 n-d-863052-2 devstack@n-api.service[121403]: X-User: tempest-AggregatesAdminTestJSON-1442378289-project-admin Nov 01 18:55:05.772768 n-d-863052-2 devstack@n-api.service[121403]: X-User-Domain-Id: default Nov 01 18:55:05.772768 n-d-863052-2 devstack@n-api.service[121403]: X-User-Domain-Name: Default Nov 01 18:55:05.772768 n-d-863052-2 devstack@n-api.service[121403]: X-User-Id: 541d39b69e684c9e9950e2cbb946c485 Nov 01 18:55:05.772768 n-d-863052-2 devstack@n-api.service[121403]: X-User-Name: tempest-AggregatesAdminTestJSON-1442378289-project-admin Nov 01 18:55:05.772768 n-d-863052-2 devstack@n-api.service[121403]: method: > Nov 01 18:55:05.772768 n-d-863052-2 devstack@n-api.service[121403]: exception: Aggregate 15 could not be found. Nov 01 18:55:05.772768 n-d-863052-2 devstack@n-api.service[121403]: action_args: {'id': '15'} Nov 01 18:55:05.772768 n-d-863052-2 devstack@n-api.service[121403]: {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 01 18:55:05.773541 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:55:05.773541 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Nov 01 18:55:05.773541 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Nov 01 18:55:05.773541 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Nov 01 18:55:05.773541 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Nov 01 18:55:05.773541 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 01 18:55:05.773541 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 01 18:55:05.773541 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 01 18:55:05.773541 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise self.value Nov 01 18:55:05.773541 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Nov 01 18:55:05.773541 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Nov 01 18:55:05.773541 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6517, in delete_aggregate Nov 01 18:55:05.773541 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Nov 01 18:55:05.773541 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 01 18:55:05.773541 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 01 18:55:05.773541 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Nov 01 18:55:05.773541 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Nov 01 18:55:05.773541 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Nov 01 18:55:05.773541 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Nov 01 18:55:05.776941 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Nov 01 18:55:05.776941 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Nov 01 18:55:05.776941 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 15 could not be found. Nov 01 18:55:05.776941 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 18:55:05.776941 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 18:55:05.776941 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 18:55:05.776941 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:55:05.776941 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 18:55:05.776941 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 18:55:05.776941 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 01 18:55:05.776941 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 01 18:55:05.776941 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 01 18:55:05.776941 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 01 18:55:05.776941 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Nov 01 18:55:05.776941 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 01 18:55:05.776941 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 15 could not be found. Nov 01 18:55:05.776941 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 18:55:05.776941 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 18:55:05.776941 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 18:55:05.776941 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:55:05.776941 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 18:55:05.779926 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 18:55:05.779926 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 01 18:55:05.779926 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 01 18:55:05.779926 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 15 could not be found. Nov 01 18:55:05.779926 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 18:55:05.779926 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-9f2ef832-cc4e-4a05-ab8c-f5618d015290 tempest-AggregatesAdminTestJSON-1442378289 tempest-AggregatesAdminTestJSON-1442378289-project-admin] Returning 404 to user: Aggregate 15 could not be found. {{(pid=121403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 01 18:55:05.779926 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-9f2ef832-cc4e-4a05-ab8c-f5618d015290 tempest-AggregatesAdminTestJSON-1442378289 tempest-AggregatesAdminTestJSON-1442378289-project-admin] 10.222.0.13 "DELETE /compute/v2.1/os-aggregates/15" status: 404 len: 78 microversion: 2.1 time: 0.041606 Nov 01 18:55:05.779926 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 125/248] 10.222.0.13 () {58 vars in 1155 bytes} [Tue Nov 1 18:55:05 2022] DELETE /compute/v2.1/os-aggregates/15 => generated 78 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 01 18:55:05.784167 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-6eaa2e5d-6001-44f8-98da-9cba7c5a26c9 tempest-AggregatesAdminTestJSON-1442378289 tempest-AggregatesAdminTestJSON-1442378289-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1109019176"}} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 18:55:05.787666 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.objects.aggregate [None req-6eaa2e5d-6001-44f8-98da-9cba7c5a26c9 tempest-AggregatesAdminTestJSON-1442378289 tempest-AggregatesAdminTestJSON-1442378289-project-admin] Generated uuid 77053c64-361d-42bf-8006-f948922ed289 for aggregate {{(pid=121402) create /opt/stack/nova/nova/objects/aggregate.py:298}} Nov 01 18:55:05.846231 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-6eaa2e5d-6001-44f8-98da-9cba7c5a26c9 tempest-AggregatesAdminTestJSON-1442378289 tempest-AggregatesAdminTestJSON-1442378289-project-admin] 10.222.0.13 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.064761 Nov 01 18:55:05.854683 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 124/249] 10.222.0.13 () {60 vars in 1164 bytes} [Tue Nov 1 18:55:05 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 18:55:05.859071 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-2d0532b0-34c3-4c40-aaca-d8afd48d9bc7 tempest-AggregatesAdminTestJSON-1442378289 tempest-AggregatesAdminTestJSON-1442378289-project-admin] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:55:05.874081 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-2d0532b0-34c3-4c40-aaca-d8afd48d9bc7 tempest-AggregatesAdminTestJSON-1442378289 tempest-AggregatesAdminTestJSON-1442378289-project-admin] 10.222.0.13 "GET /compute/v2.1/os-aggregates/16" status: 200 len: 228 microversion: 2.1 time: 0.018550 Nov 01 18:55:05.887007 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-0340b0cb-a255-4558-b8c4-8b2a72cc37cc tempest-AggregatesAdminTestJSON-1442378289 tempest-AggregatesAdminTestJSON-1442378289-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"key": "value"}}} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 18:55:05.889509 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 126/250] 10.222.0.13 () {58 vars in 1152 bytes} [Tue Nov 1 18:55:05 2022] GET /compute/v2.1/os-aggregates/16 => generated 228 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 18:55:05.898551 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-efb613be-dc0a-4f53-96c8-4e7d436e1c30 tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:55:05.907718 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-efb613be-dc0a-4f53-96c8-4e7d436e1c30 tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] [instance: 26132db2-1798-4ba6-88bb-aaf87f6848b3] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:55:05.918242 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-efb613be-dc0a-4f53-96c8-4e7d436e1c30 tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:55:05.918932 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-efb613be-dc0a-4f53-96c8-4e7d436e1c30 tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:55:05.919613 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-efb613be-dc0a-4f53-96c8-4e7d436e1c30 tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:55:05.920668 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-efb613be-dc0a-4f53-96c8-4e7d436e1c30 tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:55:05.921289 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-efb613be-dc0a-4f53-96c8-4e7d436e1c30 tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:55:05.921868 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-efb613be-dc0a-4f53-96c8-4e7d436e1c30 tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:55:05.924291 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-0340b0cb-a255-4558-b8c4-8b2a72cc37cc tempest-AggregatesAdminTestJSON-1442378289 tempest-AggregatesAdminTestJSON-1442378289-project-admin] 10.222.0.13 "POST /compute/v2.1/os-aggregates/16/action" status: 200 len: 266 microversion: 2.1 time: 0.040304 Nov 01 18:55:05.942239 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 125/251] 10.222.0.13 () {60 vars in 1194 bytes} [Tue Nov 1 18:55:05 2022] POST /compute/v2.1/os-aggregates/16/action => generated 266 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 18:55:05.973248 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-d4d14368-ca98-42e1-a07a-817d702c8b7f tempest-AggregatesAdminTestJSON-1442378289 tempest-AggregatesAdminTestJSON-1442378289-project-admin] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:55:05.996637 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-d4d14368-ca98-42e1-a07a-817d702c8b7f tempest-AggregatesAdminTestJSON-1442378289 tempest-AggregatesAdminTestJSON-1442378289-project-admin] 10.222.0.13 "GET /compute/v2.1/os-aggregates/16" status: 200 len: 242 microversion: 2.1 time: 0.039641 Nov 01 18:55:06.006404 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 126/252] 10.222.0.13 () {58 vars in 1152 bytes} [Tue Nov 1 18:55:05 2022] GET /compute/v2.1/os-aggregates/16 => generated 242 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 18:55:06.012240 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-aebc01b3-ae0f-4732-81e9-7434f27bb693 tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:55:06.013288 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-aebc01b3-ae0f-4732-81e9-7434f27bb693 tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] [instance: ada7d07e-42e4-49a3-8e59-d16dee8cb0f0] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:55:06.023160 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-aebc01b3-ae0f-4732-81e9-7434f27bb693 tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:55:06.024035 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-aebc01b3-ae0f-4732-81e9-7434f27bb693 tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:55:06.025268 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-aebc01b3-ae0f-4732-81e9-7434f27bb693 tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:55:06.028170 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-aebc01b3-ae0f-4732-81e9-7434f27bb693 tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:55:06.028933 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-aebc01b3-ae0f-4732-81e9-7434f27bb693 tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:55:06.029569 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-aebc01b3-ae0f-4732-81e9-7434f27bb693 tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:55:06.307115 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-aebc01b3-ae0f-4732-81e9-7434f27bb693 tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce2e0d1828674809a3344a7a68f375c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8e1248497284006a7acbb8169627ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:55:06.317221 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-aebc01b3-ae0f-4732-81e9-7434f27bb693 tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] 10.222.0.13 "GET /compute/v2.1/servers/ada7d07e-42e4-49a3-8e59-d16dee8cb0f0" status: 200 len: 1277 microversion: 2.1 time: 0.309440 Nov 01 18:55:06.322538 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 127/253] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:55:06 2022] GET /compute/v2.1/servers/ada7d07e-42e4-49a3-8e59-d16dee8cb0f0 => generated 1277 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:55:06.328958 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-63b500c7-a54a-4298-8b7a-b52c9bcca03e tempest-AggregatesAdminTestJSON-1442378289 tempest-AggregatesAdminTestJSON-1442378289-project-admin] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:55:06.382410 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-63b500c7-a54a-4298-8b7a-b52c9bcca03e tempest-AggregatesAdminTestJSON-1442378289 tempest-AggregatesAdminTestJSON-1442378289-project-admin] 10.222.0.13 "DELETE /compute/v2.1/os-aggregates/16" status: 200 len: 0 microversion: 2.1 time: 0.057139 Nov 01 18:55:06.384270 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 128/254] 10.222.0.13 () {58 vars in 1155 bytes} [Tue Nov 1 18:55:06 2022] DELETE /compute/v2.1/os-aggregates/16 => generated 0 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Nov 01 18:55:06.393116 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-0105e454-5b6b-46d3-85c9-076ee00a7448 tempest-AggregatesAdminTestJSON-1442378289 tempest-AggregatesAdminTestJSON-1442378289-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1630204340", "availability_zone": "tempest-test_az-997584119"}} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 18:55:06.399235 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.objects.aggregate [None req-0105e454-5b6b-46d3-85c9-076ee00a7448 tempest-AggregatesAdminTestJSON-1442378289 tempest-AggregatesAdminTestJSON-1442378289-project-admin] Generated uuid 5a095b39-1b69-4989-9142-f5feaff93701 for aggregate {{(pid=121402) create /opt/stack/nova/nova/objects/aggregate.py:298}} Nov 01 18:55:06.431875 n-d-863052-2 devstack@n-api.service[121402]: DEBUG dbcounter [-] [121402] Writing DB stats nova_api:DELETE=16,nova_api:SELECT=76,nova_api:INSERT=8 {{(pid=121402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 18:55:06.455634 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-0105e454-5b6b-46d3-85c9-076ee00a7448 tempest-AggregatesAdminTestJSON-1442378289 tempest-AggregatesAdminTestJSON-1442378289-project-admin] 10.222.0.13 "POST /compute/v2.1/os-aggregates" status: 200 len: 222 microversion: 2.1 time: 0.066220 Nov 01 18:55:06.458887 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 129/255] 10.222.0.13 () {60 vars in 1165 bytes} [Tue Nov 1 18:55:06 2022] POST /compute/v2.1/os-aggregates => generated 222 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 18:55:06.470336 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-3b0581bf-4b60-43a2-99b1-48c053ca55c0 tempest-AggregatesAdminTestJSON-1442378289 tempest-AggregatesAdminTestJSON-1442378289-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1630204340_new", "availability_zone": "tempest-test_az-997584119_new"}} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 18:55:06.658812 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-3b0581bf-4b60-43a2-99b1-48c053ca55c0 tempest-AggregatesAdminTestJSON-1442378289 tempest-AggregatesAdminTestJSON-1442378289-project-admin] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:55:06.659311 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-3b0581bf-4b60-43a2-99b1-48c053ca55c0 tempest-AggregatesAdminTestJSON-1442378289 tempest-AggregatesAdminTestJSON-1442378289-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:55:06.659745 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-3b0581bf-4b60-43a2-99b1-48c053ca55c0 tempest-AggregatesAdminTestJSON-1442378289 tempest-AggregatesAdminTestJSON-1442378289-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:55:06.750431 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-3b0581bf-4b60-43a2-99b1-48c053ca55c0 tempest-AggregatesAdminTestJSON-1442378289 tempest-AggregatesAdminTestJSON-1442378289-project-admin] 10.222.0.13 "PUT /compute/v2.1/os-aggregates/17" status: 200 len: 335 microversion: 2.1 time: 0.284250 Nov 01 18:55:06.751459 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 130/256] 10.222.0.13 () {60 vars in 1173 bytes} [Tue Nov 1 18:55:06 2022] PUT /compute/v2.1/os-aggregates/17 => generated 335 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 18:55:06.763664 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-6c57129c-c696-4b84-9b10-50be69570191 tempest-AggregatesAdminTestJSON-1442378289 tempest-AggregatesAdminTestJSON-1442378289-project-admin] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:55:06.793136 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-6c57129c-c696-4b84-9b10-50be69570191 tempest-AggregatesAdminTestJSON-1442378289 tempest-AggregatesAdminTestJSON-1442378289-project-admin] 10.222.0.13 "GET /compute/v2.1/os-aggregates" status: 200 len: 338 microversion: 2.1 time: 0.033231 Nov 01 18:55:06.794981 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 131/257] 10.222.0.13 () {58 vars in 1143 bytes} [Tue Nov 1 18:55:06 2022] GET /compute/v2.1/os-aggregates => generated 338 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 18:55:06.808987 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-9cc0f59d-ee31-4590-ad5b-553859c2a0c3 tempest-AggregatesAdminTestJSON-1442378289 tempest-AggregatesAdminTestJSON-1442378289-project-admin] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:55:06.864467 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-9cc0f59d-ee31-4590-ad5b-553859c2a0c3 tempest-AggregatesAdminTestJSON-1442378289 tempest-AggregatesAdminTestJSON-1442378289-project-admin] 10.222.0.13 "DELETE /compute/v2.1/os-aggregates/17" status: 200 len: 0 microversion: 2.1 time: 0.062237 Nov 01 18:55:06.870129 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 132/258] 10.222.0.13 () {58 vars in 1155 bytes} [Tue Nov 1 18:55:06 2022] DELETE /compute/v2.1/os-aggregates/17 => generated 0 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Nov 01 18:55:06.880978 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-c8d35f77-699e-4bf7-adea-e894d1039944 tempest-AggregatesAdminTestJSON-1442378289 tempest-AggregatesAdminTestJSON-1442378289-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-600915061"}} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 18:55:06.891623 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.objects.aggregate [None req-c8d35f77-699e-4bf7-adea-e894d1039944 tempest-AggregatesAdminTestJSON-1442378289 tempest-AggregatesAdminTestJSON-1442378289-project-admin] Generated uuid 20667f67-ec54-4b0e-9e48-e841ff54003d for aggregate {{(pid=121402) create /opt/stack/nova/nova/objects/aggregate.py:298}} Nov 01 18:55:06.950846 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-efb613be-dc0a-4f53-96c8-4e7d436e1c30 tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07a2a96629f4baea6a3adfc4011ffe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9baf3860ba564f5c8dff93085b9aabe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:55:06.968878 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-c8d35f77-699e-4bf7-adea-e894d1039944 tempest-AggregatesAdminTestJSON-1442378289 tempest-AggregatesAdminTestJSON-1442378289-project-admin] 10.222.0.13 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.092982 Nov 01 18:55:06.978368 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-efb613be-dc0a-4f53-96c8-4e7d436e1c30 tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] 10.222.0.13 "GET /compute/v2.1/servers/26132db2-1798-4ba6-88bb-aaf87f6848b3" status: 200 len: 1387 microversion: 2.1 time: 1.081670 Nov 01 18:55:06.980534 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 127/259] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:55:05 2022] GET /compute/v2.1/servers/26132db2-1798-4ba6-88bb-aaf87f6848b3 => generated 1387 bytes in 1090 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:55:06.982886 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 133/260] 10.222.0.13 () {60 vars in 1164 bytes} [Tue Nov 1 18:55:06 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 18:55:07.009476 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-c3628f03-7d93-4be0-a135-0eb8ccf34489 tempest-AggregatesAdminTestJSON-1442378289 tempest-AggregatesAdminTestJSON-1442378289-project-admin] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:55:07.036224 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-c3628f03-7d93-4be0-a135-0eb8ccf34489 tempest-AggregatesAdminTestJSON-1442378289 tempest-AggregatesAdminTestJSON-1442378289-project-admin] 10.222.0.13 "GET /compute/v2.1/os-aggregates" status: 200 len: 230 microversion: 2.1 time: 0.049888 Nov 01 18:55:07.038230 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 128/261] 10.222.0.13 () {58 vars in 1143 bytes} [Tue Nov 1 18:55:06 2022] GET /compute/v2.1/os-aggregates => generated 230 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 18:55:07.052951 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-5c053940-799f-4c6a-a2fb-5285188c9fc2 tempest-AggregatesAdminTestJSON-1442378289 tempest-AggregatesAdminTestJSON-1442378289-project-admin] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:55:07.112035 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-5c053940-799f-4c6a-a2fb-5285188c9fc2 tempest-AggregatesAdminTestJSON-1442378289 tempest-AggregatesAdminTestJSON-1442378289-project-admin] 10.222.0.13 "DELETE /compute/v2.1/os-aggregates/18" status: 200 len: 0 microversion: 2.1 time: 0.064755 Nov 01 18:55:07.115282 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 134/262] 10.222.0.13 () {58 vars in 1155 bytes} [Tue Nov 1 18:55:07 2022] DELETE /compute/v2.1/os-aggregates/18 => generated 0 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Nov 01 18:55:07.125709 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-25852fe4-1c89-43fd-a01e-6250cb6637d9 tempest-AggregatesAdminTestJSON-768412114 tempest-AggregatesAdminTestJSON-768412114-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:55:07.128571 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-25852fe4-1c89-43fd-a01e-6250cb6637d9 tempest-AggregatesAdminTestJSON-768412114 tempest-AggregatesAdminTestJSON-768412114-project] [instance: 7967bf1f-943f-441d-befd-373868bbb3aa] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:55:07.142159 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-25852fe4-1c89-43fd-a01e-6250cb6637d9 tempest-AggregatesAdminTestJSON-768412114 tempest-AggregatesAdminTestJSON-768412114-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:55:07.147332 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-25852fe4-1c89-43fd-a01e-6250cb6637d9 tempest-AggregatesAdminTestJSON-768412114 tempest-AggregatesAdminTestJSON-768412114-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:55:07.148234 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-25852fe4-1c89-43fd-a01e-6250cb6637d9 tempest-AggregatesAdminTestJSON-768412114 tempest-AggregatesAdminTestJSON-768412114-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:55:07.149734 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-25852fe4-1c89-43fd-a01e-6250cb6637d9 tempest-AggregatesAdminTestJSON-768412114 tempest-AggregatesAdminTestJSON-768412114-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:55:07.150628 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-25852fe4-1c89-43fd-a01e-6250cb6637d9 tempest-AggregatesAdminTestJSON-768412114 tempest-AggregatesAdminTestJSON-768412114-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:55:07.153024 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-25852fe4-1c89-43fd-a01e-6250cb6637d9 tempest-AggregatesAdminTestJSON-768412114 tempest-AggregatesAdminTestJSON-768412114-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:55:07.223936 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.wsgi [None req-25852fe4-1c89-43fd-a01e-6250cb6637d9 tempest-AggregatesAdminTestJSON-768412114 tempest-AggregatesAdminTestJSON-768412114-project] HTTP exception thrown: Instance 7967bf1f-943f-441d-befd-373868bbb3aa could not be found. Nov 01 18:55:07.236150 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-25852fe4-1c89-43fd-a01e-6250cb6637d9 tempest-AggregatesAdminTestJSON-768412114 tempest-AggregatesAdminTestJSON-768412114-project] Request method failure captured: Nov 01 18:55:07.236150 n-d-863052-2 devstack@n-api.service[121403]: request: DELETE /compute/v2.1/servers/7967bf1f-943f-441d-befd-373868bbb3aa HTTP/1.1 Nov 01 18:55:07.236150 n-d-863052-2 devstack@n-api.service[121403]: Accept: application/json Nov 01 18:55:07.236150 n-d-863052-2 devstack@n-api.service[121403]: Accept-Encoding: identity Nov 01 18:55:07.236150 n-d-863052-2 devstack@n-api.service[121403]: Connection: close Nov 01 18:55:07.236150 n-d-863052-2 devstack@n-api.service[121403]: Content-Length: 0 Nov 01 18:55:07.236150 n-d-863052-2 devstack@n-api.service[121403]: Content-Type: application/json Nov 01 18:55:07.236150 n-d-863052-2 devstack@n-api.service[121403]: Host: 10.222.0.13 Nov 01 18:55:07.236150 n-d-863052-2 devstack@n-api.service[121403]: Openstack-System-Scope: None Nov 01 18:55:07.236150 n-d-863052-2 devstack@n-api.service[121403]: User-Agent: python-urllib3/1.26.12 Nov 01 18:55:07.236150 n-d-863052-2 devstack@n-api.service[121403]: X-Auth-Token: gAAAAABjYWtYz1g8wPe9y8KpEQ3zvr9HdFVVZUcanD9j0jmHTm-zzNN9102xUrHUhnG49Y18CpM4FI4Nent3nDZxqKFJoiZUdWAM6W6rT4ndxXWfdAHym-_Bv5wXx1wyqxi3yxBfqyx63ZBehoXa0sZC5BjBG686qL_SG9UyT7P6uND0QOLA9Bs Nov 01 18:55:07.236150 n-d-863052-2 devstack@n-api.service[121403]: X-Domain-Id: None Nov 01 18:55:07.236150 n-d-863052-2 devstack@n-api.service[121403]: X-Domain-Name: None Nov 01 18:55:07.236150 n-d-863052-2 devstack@n-api.service[121403]: X-Identity-Status: Confirmed Nov 01 18:55:07.236150 n-d-863052-2 devstack@n-api.service[121403]: X-Is-Admin-Project: True Nov 01 18:55:07.236150 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Domain-Id: default Nov 01 18:55:07.236150 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Domain-Name: Default Nov 01 18:55:07.236150 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Id: 8382e1376b104295aa5cef36ba07cf45 Nov 01 18:55:07.236150 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Name: tempest-AggregatesAdminTestJSON-768412114 Nov 01 18:55:07.236150 n-d-863052-2 devstack@n-api.service[121403]: X-Role: member,reader Nov 01 18:55:07.236150 n-d-863052-2 devstack@n-api.service[121403]: X-Roles: member,reader Nov 01 18:55:07.237585 n-d-863052-2 devstack@n-api.service[121403]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/8382e1376b104295aa5cef36ba07cf45"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/8382e1376b104295aa5cef36ba07cf45"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_8382e1376b104295aa5cef36ba07cf45", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/8382e1376b104295aa5cef36ba07cf45"}]}] Nov 01 18:55:07.237585 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant: tempest-AggregatesAdminTestJSON-768412114 Nov 01 18:55:07.237585 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant-Id: 8382e1376b104295aa5cef36ba07cf45 Nov 01 18:55:07.237585 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-768412114 Nov 01 18:55:07.237585 n-d-863052-2 devstack@n-api.service[121403]: X-User: tempest-AggregatesAdminTestJSON-768412114-project Nov 01 18:55:07.237585 n-d-863052-2 devstack@n-api.service[121403]: X-User-Domain-Id: default Nov 01 18:55:07.237585 n-d-863052-2 devstack@n-api.service[121403]: X-User-Domain-Name: Default Nov 01 18:55:07.237585 n-d-863052-2 devstack@n-api.service[121403]: X-User-Id: 439a7ac2509640c49361f9ba6636b34d Nov 01 18:55:07.237585 n-d-863052-2 devstack@n-api.service[121403]: X-User-Name: tempest-AggregatesAdminTestJSON-768412114-project Nov 01 18:55:07.237585 n-d-863052-2 devstack@n-api.service[121403]: method: > Nov 01 18:55:07.237585 n-d-863052-2 devstack@n-api.service[121403]: exception: Instance 7967bf1f-943f-441d-befd-373868bbb3aa could not be found. Nov 01 18:55:07.237585 n-d-863052-2 devstack@n-api.service[121403]: action_args: {'id': '7967bf1f-943f-441d-befd-373868bbb3aa'} Nov 01 18:55:07.238346 n-d-863052-2 devstack@n-api.service[121403]: {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 01 18:55:07.238346 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:55:07.238346 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 01 18:55:07.238346 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 01 18:55:07.238346 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 01 18:55:07.238346 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 01 18:55:07.238346 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 01 18:55:07.238346 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 01 18:55:07.238346 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 01 18:55:07.238346 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 01 18:55:07.238346 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7967bf1f-943f-441d-befd-373868bbb3aa could not be found. Nov 01 18:55:07.238346 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 18:55:07.238346 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 18:55:07.238346 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 18:55:07.238346 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:55:07.238346 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 18:55:07.238346 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 18:55:07.238346 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 01 18:55:07.238346 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 01 18:55:07.238346 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 01 18:55:07.239771 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 01 18:55:07.239771 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 01 18:55:07.239771 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 01 18:55:07.239771 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 01 18:55:07.239771 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 01 18:55:07.239771 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 01 18:55:07.239771 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 01 18:55:07.239771 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 01 18:55:07.239771 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 01 18:55:07.239771 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7967bf1f-943f-441d-befd-373868bbb3aa could not be found. Nov 01 18:55:07.239771 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 18:55:07.239771 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 18:55:07.239771 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 18:55:07.239771 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:55:07.239771 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 18:55:07.239771 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 18:55:07.239771 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 01 18:55:07.239771 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 01 18:55:07.239771 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7967bf1f-943f-441d-befd-373868bbb3aa could not be found. Nov 01 18:55:07.239771 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 18:55:07.241135 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-25852fe4-1c89-43fd-a01e-6250cb6637d9 tempest-AggregatesAdminTestJSON-768412114 tempest-AggregatesAdminTestJSON-768412114-project] Returning 404 to user: Instance 7967bf1f-943f-441d-befd-373868bbb3aa could not be found. {{(pid=121403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 01 18:55:07.253132 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-25852fe4-1c89-43fd-a01e-6250cb6637d9 tempest-AggregatesAdminTestJSON-768412114 tempest-AggregatesAdminTestJSON-768412114-project] 10.222.0.13 "DELETE /compute/v2.1/servers/7967bf1f-943f-441d-befd-373868bbb3aa" status: 404 len: 111 microversion: 2.1 time: 0.121611 Nov 01 18:55:07.260365 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 129/263] 10.222.0.13 () {58 vars in 1239 bytes} [Tue Nov 1 18:55:07 2022] DELETE /compute/v2.1/servers/7967bf1f-943f-441d-befd-373868bbb3aa => generated 111 bytes in 138 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 01 18:55:07.268007 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-11decb6e-925e-43cc-b4d1-b617516f9c2e tempest-AggregatesAdminTestJSON-768412114 tempest-AggregatesAdminTestJSON-768412114-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:55:07.276459 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-11decb6e-925e-43cc-b4d1-b617516f9c2e tempest-AggregatesAdminTestJSON-768412114 tempest-AggregatesAdminTestJSON-768412114-project] [instance: 7967bf1f-943f-441d-befd-373868bbb3aa] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:55:07.307685 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-11decb6e-925e-43cc-b4d1-b617516f9c2e tempest-AggregatesAdminTestJSON-768412114 tempest-AggregatesAdminTestJSON-768412114-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:55:07.310382 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-11decb6e-925e-43cc-b4d1-b617516f9c2e tempest-AggregatesAdminTestJSON-768412114 tempest-AggregatesAdminTestJSON-768412114-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:55:07.311408 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-11decb6e-925e-43cc-b4d1-b617516f9c2e tempest-AggregatesAdminTestJSON-768412114 tempest-AggregatesAdminTestJSON-768412114-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:55:07.317488 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-11decb6e-925e-43cc-b4d1-b617516f9c2e tempest-AggregatesAdminTestJSON-768412114 tempest-AggregatesAdminTestJSON-768412114-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:55:07.319014 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-11decb6e-925e-43cc-b4d1-b617516f9c2e tempest-AggregatesAdminTestJSON-768412114 tempest-AggregatesAdminTestJSON-768412114-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:55:07.321765 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-11decb6e-925e-43cc-b4d1-b617516f9c2e tempest-AggregatesAdminTestJSON-768412114 tempest-AggregatesAdminTestJSON-768412114-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:55:07.350410 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-5181000a-ae59-42e0-b44b-dc6851bef461 tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:55:07.355275 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-5181000a-ae59-42e0-b44b-dc6851bef461 tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] [instance: ada7d07e-42e4-49a3-8e59-d16dee8cb0f0] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:55:07.377510 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-5181000a-ae59-42e0-b44b-dc6851bef461 tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:55:07.382977 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-5181000a-ae59-42e0-b44b-dc6851bef461 tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:55:07.387111 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-5181000a-ae59-42e0-b44b-dc6851bef461 tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:55:07.389406 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-5181000a-ae59-42e0-b44b-dc6851bef461 tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:55:07.390064 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-5181000a-ae59-42e0-b44b-dc6851bef461 tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:55:07.393954 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-5181000a-ae59-42e0-b44b-dc6851bef461 tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:55:07.402540 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.wsgi [None req-11decb6e-925e-43cc-b4d1-b617516f9c2e tempest-AggregatesAdminTestJSON-768412114 tempest-AggregatesAdminTestJSON-768412114-project] HTTP exception thrown: Instance 7967bf1f-943f-441d-befd-373868bbb3aa could not be found. Nov 01 18:55:07.406444 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-11decb6e-925e-43cc-b4d1-b617516f9c2e tempest-AggregatesAdminTestJSON-768412114 tempest-AggregatesAdminTestJSON-768412114-project] Request method failure captured: Nov 01 18:55:07.406444 n-d-863052-2 devstack@n-api.service[121402]: request: GET /compute/v2.1/servers/7967bf1f-943f-441d-befd-373868bbb3aa HTTP/1.1 Nov 01 18:55:07.406444 n-d-863052-2 devstack@n-api.service[121402]: Accept: application/json Nov 01 18:55:07.406444 n-d-863052-2 devstack@n-api.service[121402]: Accept-Encoding: identity Nov 01 18:55:07.406444 n-d-863052-2 devstack@n-api.service[121402]: Connection: close Nov 01 18:55:07.406444 n-d-863052-2 devstack@n-api.service[121402]: Content-Length: 0 Nov 01 18:55:07.406444 n-d-863052-2 devstack@n-api.service[121402]: Content-Type: application/json Nov 01 18:55:07.406444 n-d-863052-2 devstack@n-api.service[121402]: Host: 10.222.0.13 Nov 01 18:55:07.406444 n-d-863052-2 devstack@n-api.service[121402]: Openstack-System-Scope: None Nov 01 18:55:07.406444 n-d-863052-2 devstack@n-api.service[121402]: User-Agent: python-urllib3/1.26.12 Nov 01 18:55:07.406444 n-d-863052-2 devstack@n-api.service[121402]: X-Auth-Token: gAAAAABjYWtYz1g8wPe9y8KpEQ3zvr9HdFVVZUcanD9j0jmHTm-zzNN9102xUrHUhnG49Y18CpM4FI4Nent3nDZxqKFJoiZUdWAM6W6rT4ndxXWfdAHym-_Bv5wXx1wyqxi3yxBfqyx63ZBehoXa0sZC5BjBG686qL_SG9UyT7P6uND0QOLA9Bs Nov 01 18:55:07.406444 n-d-863052-2 devstack@n-api.service[121402]: X-Domain-Id: None Nov 01 18:55:07.406444 n-d-863052-2 devstack@n-api.service[121402]: X-Domain-Name: None Nov 01 18:55:07.406444 n-d-863052-2 devstack@n-api.service[121402]: X-Identity-Status: Confirmed Nov 01 18:55:07.406444 n-d-863052-2 devstack@n-api.service[121402]: X-Is-Admin-Project: True Nov 01 18:55:07.406444 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Domain-Id: default Nov 01 18:55:07.406444 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Domain-Name: Default Nov 01 18:55:07.406444 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Id: 8382e1376b104295aa5cef36ba07cf45 Nov 01 18:55:07.406444 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Name: tempest-AggregatesAdminTestJSON-768412114 Nov 01 18:55:07.406444 n-d-863052-2 devstack@n-api.service[121402]: X-Role: member,reader Nov 01 18:55:07.406444 n-d-863052-2 devstack@n-api.service[121402]: X-Roles: member,reader Nov 01 18:55:07.407737 n-d-863052-2 devstack@n-api.service[121402]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/8382e1376b104295aa5cef36ba07cf45"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/8382e1376b104295aa5cef36ba07cf45"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_8382e1376b104295aa5cef36ba07cf45", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/8382e1376b104295aa5cef36ba07cf45"}]}] Nov 01 18:55:07.407737 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant: tempest-AggregatesAdminTestJSON-768412114 Nov 01 18:55:07.407737 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant-Id: 8382e1376b104295aa5cef36ba07cf45 Nov 01 18:55:07.407737 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-768412114 Nov 01 18:55:07.407737 n-d-863052-2 devstack@n-api.service[121402]: X-User: tempest-AggregatesAdminTestJSON-768412114-project Nov 01 18:55:07.407737 n-d-863052-2 devstack@n-api.service[121402]: X-User-Domain-Id: default Nov 01 18:55:07.407737 n-d-863052-2 devstack@n-api.service[121402]: X-User-Domain-Name: Default Nov 01 18:55:07.407737 n-d-863052-2 devstack@n-api.service[121402]: X-User-Id: 439a7ac2509640c49361f9ba6636b34d Nov 01 18:55:07.407737 n-d-863052-2 devstack@n-api.service[121402]: X-User-Name: tempest-AggregatesAdminTestJSON-768412114-project Nov 01 18:55:07.407737 n-d-863052-2 devstack@n-api.service[121402]: method: > Nov 01 18:55:07.407737 n-d-863052-2 devstack@n-api.service[121402]: exception: Instance 7967bf1f-943f-441d-befd-373868bbb3aa could not be found. Nov 01 18:55:07.407737 n-d-863052-2 devstack@n-api.service[121402]: action_args: {'id': '7967bf1f-943f-441d-befd-373868bbb3aa'} Nov 01 18:55:07.408385 n-d-863052-2 devstack@n-api.service[121402]: {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 01 18:55:07.408385 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:55:07.408385 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 01 18:55:07.408385 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 01 18:55:07.408385 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 01 18:55:07.408385 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 01 18:55:07.408385 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 01 18:55:07.408385 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 01 18:55:07.408385 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 01 18:55:07.408385 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 01 18:55:07.408385 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7967bf1f-943f-441d-befd-373868bbb3aa could not be found. Nov 01 18:55:07.408385 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 18:55:07.408385 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 18:55:07.408385 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 18:55:07.408385 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:55:07.408385 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 18:55:07.408385 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 18:55:07.408385 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 01 18:55:07.408385 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 01 18:55:07.408385 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 01 18:55:07.409469 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 01 18:55:07.409469 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 01 18:55:07.409469 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 01 18:55:07.409469 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 01 18:55:07.409469 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 01 18:55:07.409469 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 01 18:55:07.409469 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 01 18:55:07.409469 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7967bf1f-943f-441d-befd-373868bbb3aa could not be found. Nov 01 18:55:07.409469 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 18:55:07.409469 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 18:55:07.409469 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 18:55:07.409469 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:55:07.409469 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 18:55:07.409469 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 18:55:07.409469 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 01 18:55:07.409469 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 01 18:55:07.409469 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7967bf1f-943f-441d-befd-373868bbb3aa could not be found. Nov 01 18:55:07.409469 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 18:55:07.416554 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-11decb6e-925e-43cc-b4d1-b617516f9c2e tempest-AggregatesAdminTestJSON-768412114 tempest-AggregatesAdminTestJSON-768412114-project] Returning 404 to user: Instance 7967bf1f-943f-441d-befd-373868bbb3aa could not be found. {{(pid=121402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 01 18:55:07.417479 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-11decb6e-925e-43cc-b4d1-b617516f9c2e tempest-AggregatesAdminTestJSON-768412114 tempest-AggregatesAdminTestJSON-768412114-project] 10.222.0.13 "GET /compute/v2.1/servers/7967bf1f-943f-441d-befd-373868bbb3aa" status: 404 len: 111 microversion: 2.1 time: 0.155849 Nov 01 18:55:07.418054 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 135/264] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:55:07 2022] GET /compute/v2.1/servers/7967bf1f-943f-441d-befd-373868bbb3aa => generated 111 bytes in 157 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 01 18:55:07.474782 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-11decb6e-925e-43cc-b4d1-b617516f9c2e tempest-AggregatesAdminTestJSON-768412114 tempest-AggregatesAdminTestJSON-768412114-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:55:07.475798 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-11decb6e-925e-43cc-b4d1-b617516f9c2e tempest-AggregatesAdminTestJSON-768412114 tempest-AggregatesAdminTestJSON-768412114-project] 10.222.0.13 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001329 Nov 01 18:55:07.476144 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 136/265] 10.222.0.13 () {56 vars in 886 bytes} [Tue Nov 1 18:55:07 2022] GET /compute/ => generated 377 bytes in 2 msecs (HTTP/1.1 200) 3 headers in 91 bytes (2 switches on core 0) Nov 01 18:55:08.003797 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-fea90a17-df82-47bf-84dd-45c1b4c2d7bb tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:55:08.004347 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-fea90a17-df82-47bf-84dd-45c1b4c2d7bb tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] [instance: 26132db2-1798-4ba6-88bb-aaf87f6848b3] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:55:08.012330 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-fea90a17-df82-47bf-84dd-45c1b4c2d7bb tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:55:08.016705 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-fea90a17-df82-47bf-84dd-45c1b4c2d7bb tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:55:08.017704 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-fea90a17-df82-47bf-84dd-45c1b4c2d7bb tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:55:08.018860 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-fea90a17-df82-47bf-84dd-45c1b4c2d7bb tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:55:08.020915 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-fea90a17-df82-47bf-84dd-45c1b4c2d7bb tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:55:08.021506 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-fea90a17-df82-47bf-84dd-45c1b4c2d7bb tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:55:08.199335 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-5181000a-ae59-42e0-b44b-dc6851bef461 tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce2e0d1828674809a3344a7a68f375c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8e1248497284006a7acbb8169627ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:55:08.218980 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-5181000a-ae59-42e0-b44b-dc6851bef461 tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] 10.222.0.13 "GET /compute/v2.1/servers/ada7d07e-42e4-49a3-8e59-d16dee8cb0f0" status: 200 len: 1319 microversion: 2.1 time: 0.874064 Nov 01 18:55:08.220230 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 130/266] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:55:07 2022] GET /compute/v2.1/servers/ada7d07e-42e4-49a3-8e59-d16dee8cb0f0 => generated 1319 bytes in 877 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:55:08.720562 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-fea90a17-df82-47bf-84dd-45c1b4c2d7bb tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07a2a96629f4baea6a3adfc4011ffe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9baf3860ba564f5c8dff93085b9aabe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:55:08.744185 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-fea90a17-df82-47bf-84dd-45c1b4c2d7bb tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] 10.222.0.13 "GET /compute/v2.1/servers/26132db2-1798-4ba6-88bb-aaf87f6848b3" status: 200 len: 1387 microversion: 2.1 time: 0.744225 Nov 01 18:55:08.763521 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 137/267] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:55:07 2022] GET /compute/v2.1/servers/26132db2-1798-4ba6-88bb-aaf87f6848b3 => generated 1387 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 18:55:09.243073 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-f44ed823-d108-4170-a7fd-a0f130a84ad5 tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:55:09.244241 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-f44ed823-d108-4170-a7fd-a0f130a84ad5 tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] [instance: ada7d07e-42e4-49a3-8e59-d16dee8cb0f0] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:55:09.258280 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f44ed823-d108-4170-a7fd-a0f130a84ad5 tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:55:09.260286 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f44ed823-d108-4170-a7fd-a0f130a84ad5 tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:55:09.265787 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f44ed823-d108-4170-a7fd-a0f130a84ad5 tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:55:09.266685 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f44ed823-d108-4170-a7fd-a0f130a84ad5 tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:55:09.268766 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f44ed823-d108-4170-a7fd-a0f130a84ad5 tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:55:09.272611 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f44ed823-d108-4170-a7fd-a0f130a84ad5 tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:55:09.769358 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-2a5c737e-31ed-4b13-87cd-68a36b7539aa tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:55:09.770687 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-2a5c737e-31ed-4b13-87cd-68a36b7539aa tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] [instance: 26132db2-1798-4ba6-88bb-aaf87f6848b3] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:55:09.783165 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2a5c737e-31ed-4b13-87cd-68a36b7539aa tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:55:09.787034 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2a5c737e-31ed-4b13-87cd-68a36b7539aa tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:55:09.787843 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2a5c737e-31ed-4b13-87cd-68a36b7539aa tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:55:09.789729 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2a5c737e-31ed-4b13-87cd-68a36b7539aa tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:55:09.790376 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2a5c737e-31ed-4b13-87cd-68a36b7539aa tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:55:09.792042 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2a5c737e-31ed-4b13-87cd-68a36b7539aa tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:55:09.882726 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-f44ed823-d108-4170-a7fd-a0f130a84ad5 tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce2e0d1828674809a3344a7a68f375c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8e1248497284006a7acbb8169627ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:55:09.892035 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-f44ed823-d108-4170-a7fd-a0f130a84ad5 tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] 10.222.0.13 "GET /compute/v2.1/servers/ada7d07e-42e4-49a3-8e59-d16dee8cb0f0" status: 200 len: 1319 microversion: 2.1 time: 0.653353 Nov 01 18:55:09.895430 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 131/268] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:55:09 2022] GET /compute/v2.1/servers/ada7d07e-42e4-49a3-8e59-d16dee8cb0f0 => generated 1319 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:55:10.559153 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-2a5c737e-31ed-4b13-87cd-68a36b7539aa tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07a2a96629f4baea6a3adfc4011ffe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9baf3860ba564f5c8dff93085b9aabe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:55:10.574973 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-2a5c737e-31ed-4b13-87cd-68a36b7539aa tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] 10.222.0.13 "GET /compute/v2.1/servers/26132db2-1798-4ba6-88bb-aaf87f6848b3" status: 200 len: 1387 microversion: 2.1 time: 0.810949 Nov 01 18:55:10.577576 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 138/269] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:55:09 2022] GET /compute/v2.1/servers/26132db2-1798-4ba6-88bb-aaf87f6848b3 => generated 1387 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:55:10.929824 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-5875b857-a8e3-404a-99e8-ed472a1d170a tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:55:10.930951 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-5875b857-a8e3-404a-99e8-ed472a1d170a tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] [instance: ada7d07e-42e4-49a3-8e59-d16dee8cb0f0] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:55:10.961906 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-5875b857-a8e3-404a-99e8-ed472a1d170a tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:55:10.963807 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-5875b857-a8e3-404a-99e8-ed472a1d170a tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:55:10.966298 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-5875b857-a8e3-404a-99e8-ed472a1d170a tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:55:10.969954 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-5875b857-a8e3-404a-99e8-ed472a1d170a tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:55:10.971923 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-5875b857-a8e3-404a-99e8-ed472a1d170a tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:55:10.976457 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-5875b857-a8e3-404a-99e8-ed472a1d170a tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:55:11.468506 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-5875b857-a8e3-404a-99e8-ed472a1d170a tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce2e0d1828674809a3344a7a68f375c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8e1248497284006a7acbb8169627ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:55:11.476307 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-5875b857-a8e3-404a-99e8-ed472a1d170a tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] 10.222.0.13 "GET /compute/v2.1/servers/ada7d07e-42e4-49a3-8e59-d16dee8cb0f0" status: 200 len: 1319 microversion: 2.1 time: 0.557089 Nov 01 18:55:11.477576 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 132/270] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:55:10 2022] GET /compute/v2.1/servers/ada7d07e-42e4-49a3-8e59-d16dee8cb0f0 => generated 1319 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:55:11.601824 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-8925b2cc-bc8e-424d-ad66-d05f1a77ad39 tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:55:11.602713 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-8925b2cc-bc8e-424d-ad66-d05f1a77ad39 tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] [instance: 26132db2-1798-4ba6-88bb-aaf87f6848b3] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:55:11.609621 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-8925b2cc-bc8e-424d-ad66-d05f1a77ad39 tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:55:11.610410 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-8925b2cc-bc8e-424d-ad66-d05f1a77ad39 tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:55:11.611012 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-8925b2cc-bc8e-424d-ad66-d05f1a77ad39 tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:55:11.611861 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-8925b2cc-bc8e-424d-ad66-d05f1a77ad39 tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:55:11.612511 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-8925b2cc-bc8e-424d-ad66-d05f1a77ad39 tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:55:11.613163 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-8925b2cc-bc8e-424d-ad66-d05f1a77ad39 tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:55:11.635604 n-d-863052-2 devstack@n-api.service[121402]: DEBUG dbcounter [-] [121402] Writing DB stats nova_cell1:SELECT=100 {{(pid=121402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 18:55:11.871676 n-d-863052-2 devstack@n-api.service[121403]: DEBUG dbcounter [-] [121403] Writing DB stats nova_cell0:SELECT=2 {{(pid=121403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 18:55:12.052459 n-d-863052-2 devstack@n-api.service[121403]: DEBUG dbcounter [-] [121403] Writing DB stats nova_cell0:SELECT=14 {{(pid=121403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 18:55:12.108755 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-9d19e487-8f1e-4aa7-a2cd-e905aa6bfd8e tempest-FlavorsV255TestJSON-1806808116 tempest-FlavorsV255TestJSON-1806808116-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV255TestJSON-flavor-1405538415", "id": 739566803, "os-flavor-access:is_public": "True"}} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 18:55:12.150484 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-9d19e487-8f1e-4aa7-a2cd-e905aa6bfd8e tempest-FlavorsV255TestJSON-1806808116 tempest-FlavorsV255TestJSON-1806808116-project-admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 446 microversion: 2.55 time: 0.284518 Nov 01 18:55:12.153725 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 133/271] 10.222.0.13 () {62 vars in 1188 bytes} [Tue Nov 1 18:55:11 2022] POST /compute/v2.1/flavors => generated 446 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 01 18:55:12.161075 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [req-20dbf166-663f-49a1-bd73-f2bc7a4e2697 req-e58a006b-6c1f-466e-967f-4e32f90b22ea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ada7d07e-42e4-49a3-8e59-d16dee8cb0f0", "tag": "dc725968-cc56-440f-a6f5-163832220fd5"}]} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 18:55:12.189390 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-20dbf166-663f-49a1-bd73-f2bc7a4e2697 req-e58a006b-6c1f-466e-967f-4e32f90b22ea service nova] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:55:12.190302 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-20dbf166-663f-49a1-bd73-f2bc7a4e2697 req-e58a006b-6c1f-466e-967f-4e32f90b22ea service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:55:12.192434 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-20dbf166-663f-49a1-bd73-f2bc7a4e2697 req-e58a006b-6c1f-466e-967f-4e32f90b22ea service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:55:12.232460 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.compute.server_external_events [req-20dbf166-663f-49a1-bd73-f2bc7a4e2697 req-e58a006b-6c1f-466e-967f-4e32f90b22ea service nova] Creating event network-changed:dc725968-cc56-440f-a6f5-163832220fd5 for instance ada7d07e-42e4-49a3-8e59-d16dee8cb0f0 on n-h1-863052-2 Nov 01 18:55:12.249670 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [req-20dbf166-663f-49a1-bd73-f2bc7a4e2697 req-e58a006b-6c1f-466e-967f-4e32f90b22ea service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093538 Nov 01 18:55:12.252486 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 134/272] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Nov 1 18:55:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 18:55:12.401819 n-d-863052-2 devstack@n-api.service[121402]: DEBUG dbcounter [-] [121402] Writing DB stats nova_cell0:SELECT=4 {{(pid=121402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 18:55:12.662099 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-8925b2cc-bc8e-424d-ad66-d05f1a77ad39 tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07a2a96629f4baea6a3adfc4011ffe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9baf3860ba564f5c8dff93085b9aabe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:55:12.670870 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-8925b2cc-bc8e-424d-ad66-d05f1a77ad39 tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] 10.222.0.13 "GET /compute/v2.1/servers/26132db2-1798-4ba6-88bb-aaf87f6848b3" status: 200 len: 1387 microversion: 2.1 time: 1.073610 Nov 01 18:55:12.686728 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 139/273] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:55:11 2022] GET /compute/v2.1/servers/26132db2-1798-4ba6-88bb-aaf87f6848b3 => generated 1387 bytes in 1090 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:55:12.749956 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-47adef25-ed39-4651-aeba-23a44da3db94 tempest-FlavorsV255TestJSON-563474708 tempest-FlavorsV255TestJSON-563474708-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:55:12.766846 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-47adef25-ed39-4651-aeba-23a44da3db94 tempest-FlavorsV255TestJSON-563474708 tempest-FlavorsV255TestJSON-563474708-project] 10.222.0.13 "GET /compute/v2.1/flavors/739566803" status: 200 len: 446 microversion: 2.55 time: 0.513018 Nov 01 18:55:12.767444 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 135/274] 10.222.0.13 () {60 vars in 1196 bytes} [Tue Nov 1 18:55:12 2022] GET /compute/v2.1/flavors/739566803 => generated 446 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 01 18:55:12.782098 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-19b5fe08-f9a0-42d8-b339-2833661c7d1a tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:55:12.784553 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-19b5fe08-f9a0-42d8-b339-2833661c7d1a tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] [instance: ada7d07e-42e4-49a3-8e59-d16dee8cb0f0] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:55:12.806438 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-19b5fe08-f9a0-42d8-b339-2833661c7d1a tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:55:12.807342 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-19b5fe08-f9a0-42d8-b339-2833661c7d1a tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:55:12.807979 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-19b5fe08-f9a0-42d8-b339-2833661c7d1a tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:55:12.809704 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-19b5fe08-f9a0-42d8-b339-2833661c7d1a tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:55:12.810661 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-19b5fe08-f9a0-42d8-b339-2833661c7d1a tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:55:12.813126 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-19b5fe08-f9a0-42d8-b339-2833661c7d1a tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:55:13.151927 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-8ef34f65-f1a1-4df2-89a5-271a87041250 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-219960415", "imageRef": "2d4a0047-1b9e-445f-8af8-1b5c9d93e881", "flavorRef": "452", "networks": [{"uuid": "a490666d-5de7-4ec8-8f65-f4383cb45da6"}]}} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 18:55:13.162969 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-19b5fe08-f9a0-42d8-b339-2833661c7d1a tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce2e0d1828674809a3344a7a68f375c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8e1248497284006a7acbb8169627ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:55:13.175388 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-19b5fe08-f9a0-42d8-b339-2833661c7d1a tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] 10.222.0.13 "GET /compute/v2.1/servers/ada7d07e-42e4-49a3-8e59-d16dee8cb0f0" status: 200 len: 1319 microversion: 2.1 time: 0.405264 Nov 01 18:55:13.179644 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 136/275] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:55:12 2022] GET /compute/v2.1/servers/ada7d07e-42e4-49a3-8e59-d16dee8cb0f0 => generated 1319 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:55:13.195842 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-e2ff5501-03f4-4a10-8e42-785aa986cd02 tempest-FlavorsV255TestJSON-1806808116 tempest-FlavorsV255TestJSON-1806808116-project-admin] Action: 'update', calling method: , body: {"flavor": {"description": "new"}} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 18:55:13.245819 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-e2ff5501-03f4-4a10-8e42-785aa986cd02 tempest-FlavorsV255TestJSON-1806808116 tempest-FlavorsV255TestJSON-1806808116-project-admin] 10.222.0.13 "PUT /compute/v2.1/flavors/739566803" status: 200 len: 447 microversion: 2.55 time: 0.065048 Nov 01 18:55:13.246422 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 137/276] 10.222.0.13 () {62 vars in 1216 bytes} [Tue Nov 1 18:55:13 2022] PUT /compute/v2.1/flavors/739566803 => generated 447 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 01 18:55:13.254063 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.network.neutron [None req-8ef34f65-f1a1-4df2-89a5-271a87041250 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] validate_networks() for [('a490666d-5de7-4ec8-8f65-f4383cb45da6', None, None, None, None, None)] {{(pid=121402) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 01 18:55:13.278301 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-68175c2d-46bd-48f6-8f35-5eb5d3301bd0 tempest-FlavorsV255TestJSON-563474708 tempest-FlavorsV255TestJSON-563474708-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:55:13.312076 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-68175c2d-46bd-48f6-8f35-5eb5d3301bd0 tempest-FlavorsV255TestJSON-563474708 tempest-FlavorsV255TestJSON-563474708-project] 10.222.0.13 "GET /compute/v2.1/flavors/detail" status: 200 len: 6591 microversion: 2.55 time: 0.052206 Nov 01 18:55:13.313202 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 138/277] 10.222.0.13 () {60 vars in 1187 bytes} [Tue Nov 1 18:55:13 2022] GET /compute/v2.1/flavors/detail => generated 6591 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 18:55:13.337604 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-f9d08ed1-0e98-49e4-9cbd-6880f509d4b0 tempest-FlavorsV255TestJSON-563474708 tempest-FlavorsV255TestJSON-563474708-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:55:13.364300 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-f9d08ed1-0e98-49e4-9cbd-6880f509d4b0 tempest-FlavorsV255TestJSON-563474708 tempest-FlavorsV255TestJSON-563474708-project] 10.222.0.13 "GET /compute/v2.1/flavors" status: 200 len: 3681 microversion: 2.55 time: 0.031772 Nov 01 18:55:13.365307 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 139/278] 10.222.0.13 () {60 vars in 1166 bytes} [Tue Nov 1 18:55:13 2022] GET /compute/v2.1/flavors => generated 3681 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 18:55:13.384667 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-3dbfc21a-5620-41b3-b23d-457c82f1752f tempest-FlavorsV255TestJSON-1806808116 tempest-FlavorsV255TestJSON-1806808116-project-admin] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:55:13.409264 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-3dbfc21a-5620-41b3-b23d-457c82f1752f tempest-FlavorsV255TestJSON-1806808116 tempest-FlavorsV255TestJSON-1806808116-project-admin] 10.222.0.13 "DELETE /compute/v2.1/flavors/739566803" status: 202 len: 0 microversion: 2.55 time: 0.027858 Nov 01 18:55:13.414800 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 140/279] 10.222.0.13 () {60 vars in 1199 bytes} [Tue Nov 1 18:55:13 2022] DELETE /compute/v2.1/flavors/739566803 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 01 18:55:13.420335 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-a2da54a1-da5c-4522-b6bb-af165f53def2 tempest-FlavorsV255TestJSON-1806808116 tempest-FlavorsV255TestJSON-1806808116-project-admin] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:55:13.451450 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-a2da54a1-da5c-4522-b6bb-af165f53def2 tempest-FlavorsV255TestJSON-1806808116 tempest-FlavorsV255TestJSON-1806808116-project-admin] 10.222.0.13 "GET /compute/v2.1/flavors/detail" status: 200 len: 6154 microversion: 2.55 time: 0.034610 Nov 01 18:55:13.469464 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 141/280] 10.222.0.13 () {60 vars in 1187 bytes} [Tue Nov 1 18:55:13 2022] GET /compute/v2.1/flavors/detail => generated 6154 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 18:55:13.700046 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-05078155-aab8-4c61-ae67-73075fd57137 tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:55:13.701298 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-05078155-aab8-4c61-ae67-73075fd57137 tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] [instance: 26132db2-1798-4ba6-88bb-aaf87f6848b3] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:55:13.719051 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-05078155-aab8-4c61-ae67-73075fd57137 tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:55:13.719943 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-05078155-aab8-4c61-ae67-73075fd57137 tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:55:13.724388 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-05078155-aab8-4c61-ae67-73075fd57137 tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:55:13.726767 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-05078155-aab8-4c61-ae67-73075fd57137 tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:55:13.730549 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-05078155-aab8-4c61-ae67-73075fd57137 tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:55:13.732808 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-05078155-aab8-4c61-ae67-73075fd57137 tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:55:14.542886 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-05078155-aab8-4c61-ae67-73075fd57137 tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07a2a96629f4baea6a3adfc4011ffe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9baf3860ba564f5c8dff93085b9aabe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:55:14.563387 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-05078155-aab8-4c61-ae67-73075fd57137 tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] 10.222.0.13 "GET /compute/v2.1/servers/26132db2-1798-4ba6-88bb-aaf87f6848b3" status: 200 len: 1387 microversion: 2.1 time: 0.868832 Nov 01 18:55:14.583322 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 142/281] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:55:13 2022] GET /compute/v2.1/servers/26132db2-1798-4ba6-88bb-aaf87f6848b3 => generated 1387 bytes in 890 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 18:55:14.594206 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-22be582d-8657-434f-bd8e-5593851cca00 tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:55:14.596035 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-22be582d-8657-434f-bd8e-5593851cca00 tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] [instance: ada7d07e-42e4-49a3-8e59-d16dee8cb0f0] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:55:14.610643 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-22be582d-8657-434f-bd8e-5593851cca00 tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:55:14.613277 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-22be582d-8657-434f-bd8e-5593851cca00 tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:55:14.615041 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-22be582d-8657-434f-bd8e-5593851cca00 tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:55:14.618138 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-22be582d-8657-434f-bd8e-5593851cca00 tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:55:14.619492 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-22be582d-8657-434f-bd8e-5593851cca00 tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:55:14.622006 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-22be582d-8657-434f-bd8e-5593851cca00 tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:55:14.650218 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.virt.hardware [None req-8ef34f65-f1a1-4df2-89a5-271a87041250 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Flavor limits 0:0:0 {{(pid=121402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 01 18:55:14.651369 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.virt.hardware [None req-8ef34f65-f1a1-4df2-89a5-271a87041250 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Image limits 0:0:0 {{(pid=121402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 01 18:55:14.652144 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.virt.hardware [None req-8ef34f65-f1a1-4df2-89a5-271a87041250 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Flavor pref 0:0:0 {{(pid=121402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 01 18:55:14.652805 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.virt.hardware [None req-8ef34f65-f1a1-4df2-89a5-271a87041250 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Image pref 0:0:0 {{(pid=121402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 01 18:55:14.653457 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.virt.hardware [None req-8ef34f65-f1a1-4df2-89a5-271a87041250 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 01 18:55:14.676433 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-8ef34f65-f1a1-4df2-89a5-271a87041250 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:55:14.678088 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-8ef34f65-f1a1-4df2-89a5-271a87041250 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:55:14.679421 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-8ef34f65-f1a1-4df2-89a5-271a87041250 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:55:14.681800 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-8ef34f65-f1a1-4df2-89a5-271a87041250 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:55:14.683659 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-8ef34f65-f1a1-4df2-89a5-271a87041250 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:55:14.684331 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-8ef34f65-f1a1-4df2-89a5-271a87041250 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:55:14.739751 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.quota [None req-8ef34f65-f1a1-4df2-89a5-271a87041250 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Getting quotas for project d9b9d4c236b944f9b2e8e502a50a8f8b. Resources: {'cores', 'ram', 'instances'} {{(pid=121402) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 01 18:55:14.750839 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.quota [None req-8ef34f65-f1a1-4df2-89a5-271a87041250 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Getting quotas for user f32f5fba1976432d938e664c7714e52b and project d9b9d4c236b944f9b2e8e502a50a8f8b. Resources: {'cores', 'ram', 'instances'} {{(pid=121402) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 01 18:55:14.787400 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-8ef34f65-f1a1-4df2-89a5-271a87041250 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Going to run 1 instances... {{(pid=121402) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 01 18:55:14.791907 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-8ef34f65-f1a1-4df2-89a5-271a87041250 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] [instance: de2ff806-a2fa-4390-b4d5-11ff24dd27ca] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2d4a0047-1b9e-445f-8af8-1b5c9d93e881',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121402) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 01 18:55:14.958937 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-8ef34f65-f1a1-4df2-89a5-271a87041250 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.268237 Nov 01 18:55:14.962369 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 140/282] 10.222.0.13 () {60 vars in 1147 bytes} [Tue Nov 1 18:55:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 2275 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 01 18:55:14.984128 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-386ee5a8-b797-4099-9f51-d52afa937d6b tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:55:14.998007 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-386ee5a8-b797-4099-9f51-d52afa937d6b tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] [instance: de2ff806-a2fa-4390-b4d5-11ff24dd27ca] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:55:15.416920 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-386ee5a8-b797-4099-9f51-d52afa937d6b tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f32f5fba1976432d938e664c7714e52b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b9d4c236b944f9b2e8e502a50a8f8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:55:15.426197 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-386ee5a8-b797-4099-9f51-d52afa937d6b tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] 10.222.0.13 "GET /compute/v2.1/servers/de2ff806-a2fa-4390-b4d5-11ff24dd27ca" status: 200 len: 1210 microversion: 2.1 time: 0.446252 Nov 01 18:55:15.430458 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 141/283] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:55:14 2022] GET /compute/v2.1/servers/de2ff806-a2fa-4390-b4d5-11ff24dd27ca => generated 1210 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:55:15.651348 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-22be582d-8657-434f-bd8e-5593851cca00 tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce2e0d1828674809a3344a7a68f375c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8e1248497284006a7acbb8169627ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:55:15.659469 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-22be582d-8657-434f-bd8e-5593851cca00 tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] 10.222.0.13 "GET /compute/v2.1/servers/ada7d07e-42e4-49a3-8e59-d16dee8cb0f0" status: 200 len: 1319 microversion: 2.1 time: 1.074905 Nov 01 18:55:15.672854 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 143/284] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:55:14 2022] GET /compute/v2.1/servers/ada7d07e-42e4-49a3-8e59-d16dee8cb0f0 => generated 1319 bytes in 1087 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:55:15.676896 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-4f43628d-43ca-4e98-bcba-2d4debeb8ef6 tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:55:15.682129 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-4f43628d-43ca-4e98-bcba-2d4debeb8ef6 tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] [instance: 26132db2-1798-4ba6-88bb-aaf87f6848b3] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:55:15.697024 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-4f43628d-43ca-4e98-bcba-2d4debeb8ef6 tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:55:15.699956 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-4f43628d-43ca-4e98-bcba-2d4debeb8ef6 tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:55:15.704926 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-4f43628d-43ca-4e98-bcba-2d4debeb8ef6 tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:55:15.706285 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-4f43628d-43ca-4e98-bcba-2d4debeb8ef6 tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:55:15.707178 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-4f43628d-43ca-4e98-bcba-2d4debeb8ef6 tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:55:15.707780 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-4f43628d-43ca-4e98-bcba-2d4debeb8ef6 tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:55:16.088345 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-02be00c2-c388-4c86-a320-8fe31941208d tempest-FlavorsAdminTestJSON-2136163503 tempest-FlavorsAdminTestJSON-2136163503-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": "1024", "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1163298177", "id": 906604138, "os-flavor-access:is_public": "True"}} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 18:55:16.117153 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-02be00c2-c388-4c86-a320-8fe31941208d tempest-FlavorsAdminTestJSON-2136163503 tempest-FlavorsAdminTestJSON-2136163503-project-admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 427 microversion: 2.1 time: 0.684504 Nov 01 18:55:16.123079 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 142/285] 10.222.0.13 () {60 vars in 1147 bytes} [Tue Nov 1 18:55:15 2022] POST /compute/v2.1/flavors => generated 427 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 18:55:16.143311 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-f4d0dc5a-8003-43f1-bdfb-7475b9c44e0d tempest-FlavorsAdminTestJSON-2136163503 tempest-FlavorsAdminTestJSON-2136163503-project-admin] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:55:16.191211 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-f4d0dc5a-8003-43f1-bdfb-7475b9c44e0d tempest-FlavorsAdminTestJSON-2136163503 tempest-FlavorsAdminTestJSON-2136163503-project-admin] 10.222.0.13 "DELETE /compute/v2.1/flavors/906604138" status: 202 len: 0 microversion: 2.1 time: 0.058856 Nov 01 18:55:16.192158 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 143/286] 10.222.0.13 () {58 vars in 1158 bytes} [Tue Nov 1 18:55:16 2022] DELETE /compute/v2.1/flavors/906604138 => generated 0 bytes in 61 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 01 18:55:16.204461 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-3e17e66f-907e-45c3-8f4c-999c88371f21 tempest-FlavorsAdminTestJSON-2136163503 tempest-FlavorsAdminTestJSON-2136163503-project-admin] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:55:16.250837 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-3e17e66f-907e-45c3-8f4c-999c88371f21 tempest-FlavorsAdminTestJSON-2136163503 tempest-FlavorsAdminTestJSON-2136163503-project-admin] 10.222.0.13 "GET /compute/v2.1/flavors/detail" status: 200 len: 5818 microversion: 2.1 time: 0.053147 Nov 01 18:55:16.252462 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 144/287] 10.222.0.13 () {58 vars in 1146 bytes} [Tue Nov 1 18:55:16 2022] GET /compute/v2.1/flavors/detail => generated 5818 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 18:55:16.279188 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-7fcc2441-81cd-4899-ac3a-2cff11f8efb6 tempest-FlavorsAdminTestJSON-2136163503 tempest-FlavorsAdminTestJSON-2136163503-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1338321419", "id": 1333177053, "swap": 1024, "rxtx_factor": 2, "OS-FLV-EXT-DATA:ephemeral": 10, "os-flavor-access:is_public": "True"}} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 18:55:16.319989 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-7fcc2441-81cd-4899-ac3a-2cff11f8efb6 tempest-FlavorsAdminTestJSON-2136163503 tempest-FlavorsAdminTestJSON-2136163503-project-admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 417 microversion: 2.1 time: 0.046030 Nov 01 18:55:16.322448 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 145/288] 10.222.0.13 () {60 vars in 1147 bytes} [Tue Nov 1 18:55:16 2022] POST /compute/v2.1/flavors => generated 417 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 18:55:16.341125 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-3aefc22f-06cb-4e63-89a1-13550bc77d26 tempest-FlavorsAdminTestJSON-2136163503 tempest-FlavorsAdminTestJSON-2136163503-project-admin] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:55:16.376295 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-3aefc22f-06cb-4e63-89a1-13550bc77d26 tempest-FlavorsAdminTestJSON-2136163503 tempest-FlavorsAdminTestJSON-2136163503-project-admin] 10.222.0.13 "GET /compute/v2.1/flavors/detail" status: 200 len: 6225 microversion: 2.1 time: 0.045485 Nov 01 18:55:16.378588 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 146/289] 10.222.0.13 () {58 vars in 1146 bytes} [Tue Nov 1 18:55:16 2022] GET /compute/v2.1/flavors/detail => generated 6225 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 18:55:16.399348 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-0bea3472-4fb1-44f6-b405-280849f6bdc2 tempest-FlavorsAdminTestJSON-2136163503 tempest-FlavorsAdminTestJSON-2136163503-project-admin] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:55:16.432274 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-0bea3472-4fb1-44f6-b405-280849f6bdc2 tempest-FlavorsAdminTestJSON-2136163503 tempest-FlavorsAdminTestJSON-2136163503-project-admin] 10.222.0.13 "DELETE /compute/v2.1/flavors/1333177053" status: 202 len: 0 microversion: 2.1 time: 0.036484 Nov 01 18:55:16.436346 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 147/290] 10.222.0.13 () {58 vars in 1161 bytes} [Tue Nov 1 18:55:16 2022] DELETE /compute/v2.1/flavors/1333177053 => generated 0 bytes in 41 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 01 18:55:16.442424 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-4d0092c2-36a6-462f-972e-8a21b1a6014e tempest-FlavorsAdminTestJSON-2136163503 tempest-FlavorsAdminTestJSON-2136163503-project-admin] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:55:16.467920 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-4d0092c2-36a6-462f-972e-8a21b1a6014e tempest-FlavorsAdminTestJSON-2136163503 tempest-FlavorsAdminTestJSON-2136163503-project-admin] 10.222.0.13 "GET /compute/v2.1/flavors/detail" status: 200 len: 5818 microversion: 2.1 time: 0.029578 Nov 01 18:55:16.481886 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 148/291] 10.222.0.13 () {58 vars in 1146 bytes} [Tue Nov 1 18:55:16 2022] GET /compute/v2.1/flavors/detail => generated 5818 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:55:16.493246 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-c851a315-4f2c-4925-8ac3-6b879586a49a tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:55:16.494549 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-c851a315-4f2c-4925-8ac3-6b879586a49a tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] [instance: de2ff806-a2fa-4390-b4d5-11ff24dd27ca] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:55:16.503840 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-c851a315-4f2c-4925-8ac3-6b879586a49a tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:55:16.504554 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-c851a315-4f2c-4925-8ac3-6b879586a49a tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:55:16.505336 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-c851a315-4f2c-4925-8ac3-6b879586a49a tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:55:16.507054 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-c851a315-4f2c-4925-8ac3-6b879586a49a tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:55:16.507667 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-c851a315-4f2c-4925-8ac3-6b879586a49a tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:55:16.508337 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-c851a315-4f2c-4925-8ac3-6b879586a49a tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:55:16.572514 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-4f43628d-43ca-4e98-bcba-2d4debeb8ef6 tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07a2a96629f4baea6a3adfc4011ffe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9baf3860ba564f5c8dff93085b9aabe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:55:16.583627 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-4f43628d-43ca-4e98-bcba-2d4debeb8ef6 tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] 10.222.0.13 "GET /compute/v2.1/servers/26132db2-1798-4ba6-88bb-aaf87f6848b3" status: 200 len: 1387 microversion: 2.1 time: 0.908996 Nov 01 18:55:16.590982 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 144/292] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:55:15 2022] GET /compute/v2.1/servers/26132db2-1798-4ba6-88bb-aaf87f6848b3 => generated 1387 bytes in 919 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:55:16.601548 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-5d6c3130-c6ea-48e0-89ad-e43190e34e54 tempest-FlavorsAdminTestJSON-2136163503 tempest-FlavorsAdminTestJSON-2136163503-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1469005078", "id": 984753920, "os-flavor-access:is_public": "True"}} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 18:55:16.604405 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-c851a315-4f2c-4925-8ac3-6b879586a49a tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f32f5fba1976432d938e664c7714e52b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b9d4c236b944f9b2e8e502a50a8f8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:55:16.613484 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-c851a315-4f2c-4925-8ac3-6b879586a49a tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] 10.222.0.13 "GET /compute/v2.1/servers/de2ff806-a2fa-4390-b4d5-11ff24dd27ca" status: 200 len: 1206 microversion: 2.1 time: 0.129693 Nov 01 18:55:16.631740 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 149/293] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:55:16 2022] GET /compute/v2.1/servers/de2ff806-a2fa-4390-b4d5-11ff24dd27ca => generated 1206 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:55:16.672247 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-5d6c3130-c6ea-48e0-89ad-e43190e34e54 tempest-FlavorsAdminTestJSON-2136163503 tempest-FlavorsAdminTestJSON-2136163503-project-admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 426 microversion: 2.1 time: 0.080052 Nov 01 18:55:16.680954 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 145/294] 10.222.0.13 () {60 vars in 1147 bytes} [Tue Nov 1 18:55:16 2022] POST /compute/v2.1/flavors => generated 426 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 18:55:16.698638 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-82bc1bde-081e-4273-b23d-5f6887a1fae8 tempest-FlavorsAdminTestJSON-2136163503 tempest-FlavorsAdminTestJSON-2136163503-project-admin] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:55:16.699786 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-1ffbb36d-fef6-4756-a8fa-d15a59e2cf32 tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:55:16.700645 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-1ffbb36d-fef6-4756-a8fa-d15a59e2cf32 tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] [instance: ada7d07e-42e4-49a3-8e59-d16dee8cb0f0] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:55:16.724183 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-1ffbb36d-fef6-4756-a8fa-d15a59e2cf32 tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:55:16.725152 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-1ffbb36d-fef6-4756-a8fa-d15a59e2cf32 tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:55:16.725856 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-1ffbb36d-fef6-4756-a8fa-d15a59e2cf32 tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:55:16.733373 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-1ffbb36d-fef6-4756-a8fa-d15a59e2cf32 tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:55:16.738326 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-1ffbb36d-fef6-4756-a8fa-d15a59e2cf32 tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:55:16.739107 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-1ffbb36d-fef6-4756-a8fa-d15a59e2cf32 tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:55:16.761781 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-82bc1bde-081e-4273-b23d-5f6887a1fae8 tempest-FlavorsAdminTestJSON-2136163503 tempest-FlavorsAdminTestJSON-2136163503-project-admin] 10.222.0.13 "DELETE /compute/v2.1/flavors/984753920" status: 202 len: 0 microversion: 2.1 time: 0.071241 Nov 01 18:55:16.763711 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 150/295] 10.222.0.13 () {58 vars in 1158 bytes} [Tue Nov 1 18:55:16 2022] DELETE /compute/v2.1/flavors/984753920 => generated 0 bytes in 75 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 01 18:55:16.778692 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-01e18acf-12e8-4283-9901-15f76130d831 tempest-FlavorsAdminTestJSON-2136163503 tempest-FlavorsAdminTestJSON-2136163503-project-admin] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:55:16.821861 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-01e18acf-12e8-4283-9901-15f76130d831 tempest-FlavorsAdminTestJSON-2136163503 tempest-FlavorsAdminTestJSON-2136163503-project-admin] 10.222.0.13 "GET /compute/v2.1/flavors/detail" status: 200 len: 5818 microversion: 2.1 time: 0.052198 Nov 01 18:55:16.823037 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 151/296] 10.222.0.13 () {58 vars in 1146 bytes} [Tue Nov 1 18:55:16 2022] GET /compute/v2.1/flavors/detail => generated 5818 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:55:16.847785 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-c3d9cb4c-8505-4ad0-a513-dc39c5cd3560 tempest-FlavorsAdminTestJSON-2136163503 tempest-FlavorsAdminTestJSON-2136163503-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-793859763", "id": null, "os-flavor-access:is_public": "True"}} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 18:55:16.885878 n-d-863052-2 devstack@n-api.service[121402]: DEBUG dbcounter [-] [121402] Writing DB stats nova_api:SELECT=78,nova_api:UPDATE=2,nova_api:DELETE=13,nova_api:INSERT=7 {{(pid=121402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 18:55:16.892268 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-c3d9cb4c-8505-4ad0-a513-dc39c5cd3560 tempest-FlavorsAdminTestJSON-2136163503 tempest-FlavorsAdminTestJSON-2136163503-project-admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 506 microversion: 2.1 time: 0.051702 Nov 01 18:55:16.893133 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 152/297] 10.222.0.13 () {60 vars in 1147 bytes} [Tue Nov 1 18:55:16 2022] POST /compute/v2.1/flavors => generated 506 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 18:55:16.908675 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-e687c30a-38ff-42de-b58c-f1a5d12da126 tempest-FlavorsAdminTestJSON-2136163503 tempest-FlavorsAdminTestJSON-2136163503-project-admin] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:55:16.932909 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-e687c30a-38ff-42de-b58c-f1a5d12da126 tempest-FlavorsAdminTestJSON-2136163503 tempest-FlavorsAdminTestJSON-2136163503-project-admin] 10.222.0.13 "DELETE /compute/v2.1/flavors/d566699a-4605-408c-bd26-f23e0c14ebb9" status: 202 len: 0 microversion: 2.1 time: 0.028936 Nov 01 18:55:16.938224 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 153/298] 10.222.0.13 () {58 vars in 1239 bytes} [Tue Nov 1 18:55:16 2022] DELETE /compute/v2.1/flavors/d566699a-4605-408c-bd26-f23e0c14ebb9 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 01 18:55:16.951759 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-00742312-f0d8-4a69-8719-488a80f40931 tempest-FlavorsAdminTestJSON-2136163503 tempest-FlavorsAdminTestJSON-2136163503-project-admin] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:55:16.997105 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-00742312-f0d8-4a69-8719-488a80f40931 tempest-FlavorsAdminTestJSON-2136163503 tempest-FlavorsAdminTestJSON-2136163503-project-admin] 10.222.0.13 "GET /compute/v2.1/flavors/detail" status: 200 len: 5818 microversion: 2.1 time: 0.057661 Nov 01 18:55:16.997700 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 154/299] 10.222.0.13 () {58 vars in 1146 bytes} [Tue Nov 1 18:55:16 2022] GET /compute/v2.1/flavors/detail => generated 5818 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:55:17.022551 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-2320d2c6-3b12-49f3-a8fe-f212f25408cc tempest-FlavorsAdminTestJSON-2136163503 tempest-FlavorsAdminTestJSON-2136163503-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-30078042", "id": "2f9a1c1a-b33f-47e3-98bb-58dfd4ca2de6", "os-flavor-access:is_public": "True"}} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 18:55:17.065275 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-2320d2c6-3b12-49f3-a8fe-f212f25408cc tempest-FlavorsAdminTestJSON-2136163503 tempest-FlavorsAdminTestJSON-2136163503-project-admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 505 microversion: 2.1 time: 0.044001 Nov 01 18:55:17.069460 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 155/300] 10.222.0.13 () {60 vars in 1147 bytes} [Tue Nov 1 18:55:17 2022] POST /compute/v2.1/flavors => generated 505 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 18:55:17.088302 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-e9185f8d-b084-4b40-8ae3-096df7ceecb0 tempest-FlavorsAdminTestJSON-2136163503 tempest-FlavorsAdminTestJSON-2136163503-project-admin] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:55:17.129045 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-e9185f8d-b084-4b40-8ae3-096df7ceecb0 tempest-FlavorsAdminTestJSON-2136163503 tempest-FlavorsAdminTestJSON-2136163503-project-admin] 10.222.0.13 "DELETE /compute/v2.1/flavors/2f9a1c1a-b33f-47e3-98bb-58dfd4ca2de6" status: 202 len: 0 microversion: 2.1 time: 0.050869 Nov 01 18:55:17.130731 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 156/301] 10.222.0.13 () {58 vars in 1239 bytes} [Tue Nov 1 18:55:17 2022] DELETE /compute/v2.1/flavors/2f9a1c1a-b33f-47e3-98bb-58dfd4ca2de6 => generated 0 bytes in 56 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 01 18:55:17.149364 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-a68e54e4-67d6-41f2-afe6-9915b16bc0f3 tempest-FlavorsAdminTestJSON-2136163503 tempest-FlavorsAdminTestJSON-2136163503-project-admin] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:55:17.224689 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-a68e54e4-67d6-41f2-afe6-9915b16bc0f3 tempest-FlavorsAdminTestJSON-2136163503 tempest-FlavorsAdminTestJSON-2136163503-project-admin] 10.222.0.13 "GET /compute/v2.1/flavors/detail" status: 200 len: 5818 microversion: 2.1 time: 0.089282 Nov 01 18:55:17.229868 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 157/302] 10.222.0.13 () {58 vars in 1146 bytes} [Tue Nov 1 18:55:17 2022] GET /compute/v2.1/flavors/detail => generated 5818 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:55:17.253598 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-15ff4dcc-79fd-4087-ad24-d7de8f4f7d7e tempest-FlavorsAdminTestJSON-2136163503 tempest-FlavorsAdminTestJSON-2136163503-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-61777475", "id": 216805675, "os-flavor-access:is_public": "True"}} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 18:55:17.275708 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-15ff4dcc-79fd-4087-ad24-d7de8f4f7d7e tempest-FlavorsAdminTestJSON-2136163503 tempest-FlavorsAdminTestJSON-2136163503-project-admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.1 time: 0.024555 Nov 01 18:55:17.284941 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 158/303] 10.222.0.13 () {60 vars in 1147 bytes} [Tue Nov 1 18:55:17 2022] POST /compute/v2.1/flavors => generated 409 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 01 18:55:17.296401 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-661a3d01-ab60-45aa-93d8-56257f539354 tempest-FlavorsAdminTestJSON-2136163503 tempest-FlavorsAdminTestJSON-2136163503-project-admin] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:55:17.304496 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-661a3d01-ab60-45aa-93d8-56257f539354 tempest-FlavorsAdminTestJSON-2136163503 tempest-FlavorsAdminTestJSON-2136163503-project-admin] 10.222.0.13 "GET /compute/v2.1/flavors/216805675" status: 200 len: 409 microversion: 2.1 time: 0.017648 Nov 01 18:55:17.315356 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 159/304] 10.222.0.13 () {58 vars in 1155 bytes} [Tue Nov 1 18:55:17 2022] GET /compute/v2.1/flavors/216805675 => generated 409 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 18:55:17.593711 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-1ffbb36d-fef6-4756-a8fa-d15a59e2cf32 tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce2e0d1828674809a3344a7a68f375c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8e1248497284006a7acbb8169627ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:55:17.613174 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-1ffbb36d-fef6-4756-a8fa-d15a59e2cf32 tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] 10.222.0.13 "GET /compute/v2.1/servers/ada7d07e-42e4-49a3-8e59-d16dee8cb0f0" status: 200 len: 1319 microversion: 2.1 time: 0.922447 Nov 01 18:55:17.613765 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 146/305] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:55:16 2022] GET /compute/v2.1/servers/ada7d07e-42e4-49a3-8e59-d16dee8cb0f0 => generated 1319 bytes in 924 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:55:17.635280 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-5f3aa097-6f8d-4c86-9202-50e2db934396 tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:55:17.635957 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-5f3aa097-6f8d-4c86-9202-50e2db934396 tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] [instance: 26132db2-1798-4ba6-88bb-aaf87f6848b3] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:55:17.662981 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-5f3aa097-6f8d-4c86-9202-50e2db934396 tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:55:17.663476 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-5f3aa097-6f8d-4c86-9202-50e2db934396 tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:55:17.669569 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-5f3aa097-6f8d-4c86-9202-50e2db934396 tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:55:17.672084 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-5f3aa097-6f8d-4c86-9202-50e2db934396 tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:55:17.673281 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-5f3aa097-6f8d-4c86-9202-50e2db934396 tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:55:17.673797 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-5f3aa097-6f8d-4c86-9202-50e2db934396 tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:55:17.696175 n-d-863052-2 devstack@n-api.service[121403]: DEBUG dbcounter [-] [121403] Writing DB stats nova_cell1:SELECT=100 {{(pid=121403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 18:55:17.934176 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-e02ab3dc-5c75-44ca-909a-21a42eee6c2f tempest-FlavorsAdminTestJSON-2078145999 tempest-FlavorsAdminTestJSON-2078145999-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:55:17.964506 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-e02ab3dc-5c75-44ca-909a-21a42eee6c2f tempest-FlavorsAdminTestJSON-2078145999 tempest-FlavorsAdminTestJSON-2078145999-project] 10.222.0.13 "GET /compute/v2.1/flavors/detail" status: 200 len: 6217 microversion: 2.1 time: 0.647184 Nov 01 18:55:17.965840 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 160/306] 10.222.0.13 () {58 vars in 1146 bytes} [Tue Nov 1 18:55:17 2022] GET /compute/v2.1/flavors/detail => generated 6217 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:55:17.970988 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-1e47f7c6-255b-4fd0-bed7-1d113e5ad141 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:55:17.972988 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-1e47f7c6-255b-4fd0-bed7-1d113e5ad141 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] [instance: de2ff806-a2fa-4390-b4d5-11ff24dd27ca] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:55:17.988063 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-1e47f7c6-255b-4fd0-bed7-1d113e5ad141 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:55:17.988983 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-1e47f7c6-255b-4fd0-bed7-1d113e5ad141 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:55:17.990166 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-1e47f7c6-255b-4fd0-bed7-1d113e5ad141 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:55:17.991449 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-1e47f7c6-255b-4fd0-bed7-1d113e5ad141 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:55:17.993014 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-1e47f7c6-255b-4fd0-bed7-1d113e5ad141 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:55:17.993657 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-1e47f7c6-255b-4fd0-bed7-1d113e5ad141 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:55:18.087149 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-1e47f7c6-255b-4fd0-bed7-1d113e5ad141 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f32f5fba1976432d938e664c7714e52b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b9d4c236b944f9b2e8e502a50a8f8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:55:18.100707 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-1e47f7c6-255b-4fd0-bed7-1d113e5ad141 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] 10.222.0.13 "GET /compute/v2.1/servers/de2ff806-a2fa-4390-b4d5-11ff24dd27ca" status: 200 len: 1268 microversion: 2.1 time: 0.132150 Nov 01 18:55:18.101470 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 161/307] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:55:17 2022] GET /compute/v2.1/servers/de2ff806-a2fa-4390-b4d5-11ff24dd27ca => generated 1268 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:55:18.255020 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-95fbc403-6de3-4d06-b1b7-3f93a3be0b54 tempest-HypervisorAdminUnderV252Test-1488648424 tempest-HypervisorAdminUnderV252Test-1488648424-project-admin] Calling method '.version_select at 0x7f0ae2d7c1f0>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:55:18.257341 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-95fbc403-6de3-4d06-b1b7-3f93a3be0b54 tempest-HypervisorAdminUnderV252Test-1488648424 tempest-HypervisorAdminUnderV252Test-1488648424-project-admin] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:55:18.258981 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-95fbc403-6de3-4d06-b1b7-3f93a3be0b54 tempest-HypervisorAdminUnderV252Test-1488648424 tempest-HypervisorAdminUnderV252Test-1488648424-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:55:18.259566 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-95fbc403-6de3-4d06-b1b7-3f93a3be0b54 tempest-HypervisorAdminUnderV252Test-1488648424 tempest-HypervisorAdminUnderV252Test-1488648424-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:55:18.288080 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-95fbc403-6de3-4d06-b1b7-3f93a3be0b54 tempest-HypervisorAdminUnderV252Test-1488648424 tempest-HypervisorAdminUnderV252Test-1488648424-project-admin] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:55:18.288591 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-95fbc403-6de3-4d06-b1b7-3f93a3be0b54 tempest-HypervisorAdminUnderV252Test-1488648424 tempest-HypervisorAdminUnderV252Test-1488648424-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:55:18.289045 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-95fbc403-6de3-4d06-b1b7-3f93a3be0b54 tempest-HypervisorAdminUnderV252Test-1488648424 tempest-HypervisorAdminUnderV252Test-1488648424-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:55:18.302443 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-95fbc403-6de3-4d06-b1b7-3f93a3be0b54 tempest-HypervisorAdminUnderV252Test-1488648424 tempest-HypervisorAdminUnderV252Test-1488648424-project-admin] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:55:18.302933 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-95fbc403-6de3-4d06-b1b7-3f93a3be0b54 tempest-HypervisorAdminUnderV252Test-1488648424 tempest-HypervisorAdminUnderV252Test-1488648424-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:55:18.303799 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-95fbc403-6de3-4d06-b1b7-3f93a3be0b54 tempest-HypervisorAdminUnderV252Test-1488648424 tempest-HypervisorAdminUnderV252Test-1488648424-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:55:18.314285 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-95fbc403-6de3-4d06-b1b7-3f93a3be0b54 tempest-HypervisorAdminUnderV252Test-1488648424 tempest-HypervisorAdminUnderV252Test-1488648424-project-admin] 10.222.0.13 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.210845 Nov 01 18:55:18.315232 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 162/308] 10.222.0.13 () {58 vars in 1146 bytes} [Tue Nov 1 18:55:18 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 18:55:18.321175 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-5320b36b-67f1-4cc7-bc7d-f624db0b2968 tempest-FlavorsAdminTestJSON-2136163503 tempest-FlavorsAdminTestJSON-2136163503-project-admin] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:55:18.340324 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-5320b36b-67f1-4cc7-bc7d-f624db0b2968 tempest-FlavorsAdminTestJSON-2136163503 tempest-FlavorsAdminTestJSON-2136163503-project-admin] 10.222.0.13 "DELETE /compute/v2.1/flavors/216805675" status: 202 len: 0 microversion: 2.1 time: 0.023941 Nov 01 18:55:18.341510 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 163/309] 10.222.0.13 () {58 vars in 1158 bytes} [Tue Nov 1 18:55:18 2022] DELETE /compute/v2.1/flavors/216805675 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 01 18:55:18.347430 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-b53585e4-8717-426d-8d46-bd772517d579 tempest-HypervisorAdminUnderV252Test-1488648424 tempest-HypervisorAdminUnderV252Test-1488648424-project-admin] Calling method '.version_select at 0x7f0ae2d7c5e0>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:55:18.349256 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b53585e4-8717-426d-8d46-bd772517d579 tempest-HypervisorAdminUnderV252Test-1488648424 tempest-HypervisorAdminUnderV252Test-1488648424-project-admin] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:55:18.349914 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b53585e4-8717-426d-8d46-bd772517d579 tempest-HypervisorAdminUnderV252Test-1488648424 tempest-HypervisorAdminUnderV252Test-1488648424-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:55:18.350562 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b53585e4-8717-426d-8d46-bd772517d579 tempest-HypervisorAdminUnderV252Test-1488648424 tempest-HypervisorAdminUnderV252Test-1488648424-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:55:18.375244 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b53585e4-8717-426d-8d46-bd772517d579 tempest-HypervisorAdminUnderV252Test-1488648424 tempest-HypervisorAdminUnderV252Test-1488648424-project-admin] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:55:18.376013 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b53585e4-8717-426d-8d46-bd772517d579 tempest-HypervisorAdminUnderV252Test-1488648424 tempest-HypervisorAdminUnderV252Test-1488648424-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:55:18.376658 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b53585e4-8717-426d-8d46-bd772517d579 tempest-HypervisorAdminUnderV252Test-1488648424 tempest-HypervisorAdminUnderV252Test-1488648424-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:55:18.382026 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-5f3aa097-6f8d-4c86-9202-50e2db934396 tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07a2a96629f4baea6a3adfc4011ffe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9baf3860ba564f5c8dff93085b9aabe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:55:18.394923 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-5f3aa097-6f8d-4c86-9202-50e2db934396 tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] 10.222.0.13 "GET /compute/v2.1/servers/26132db2-1798-4ba6-88bb-aaf87f6848b3" status: 200 len: 1387 microversion: 2.1 time: 0.772902 Nov 01 18:55:18.395777 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 147/310] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:55:17 2022] GET /compute/v2.1/servers/26132db2-1798-4ba6-88bb-aaf87f6848b3 => generated 1387 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:55:18.408145 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-a0d2d320-68ea-4f9f-8223-eab12ad42362 tempest-FlavorsAdminTestJSON-2136163503 tempest-FlavorsAdminTestJSON-2136163503-project-admin] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:55:18.457844 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b53585e4-8717-426d-8d46-bd772517d579 tempest-HypervisorAdminUnderV252Test-1488648424 tempest-HypervisorAdminUnderV252Test-1488648424-project-admin] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:55:18.462205 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b53585e4-8717-426d-8d46-bd772517d579 tempest-HypervisorAdminUnderV252Test-1488648424 tempest-HypervisorAdminUnderV252Test-1488648424-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:55:18.462886 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b53585e4-8717-426d-8d46-bd772517d579 tempest-HypervisorAdminUnderV252Test-1488648424 tempest-HypervisorAdminUnderV252Test-1488648424-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:55:18.472541 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-b53585e4-8717-426d-8d46-bd772517d579 tempest-HypervisorAdminUnderV252Test-1488648424 tempest-HypervisorAdminUnderV252Test-1488648424-project-admin] 10.222.0.13 "GET /compute/v2.1/os-hypervisors/n-h1-863052-2/servers" status: 200 len: 275 microversion: 2.1 time: 0.129682 Nov 01 18:55:18.473433 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 164/311] 10.222.0.13 () {58 vars in 1212 bytes} [Tue Nov 1 18:55:18 2022] GET /compute/v2.1/os-hypervisors/n-h1-863052-2/servers => generated 275 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 18:55:18.478968 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [req-8a9262de-ade3-4a35-a60f-92dfb0b52f80 req-3da17db2-ea99-4f94-9b53-25af04af05aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "26132db2-1798-4ba6-88bb-aaf87f6848b3", "name": "network-vif-plugged", "status": "completed", "tag": "9bb445f8-37ab-49c7-9c66-0066ff9683cc"}]} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 18:55:18.490800 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-8a9262de-ade3-4a35-a60f-92dfb0b52f80 req-3da17db2-ea99-4f94-9b53-25af04af05aa service nova] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:55:18.491643 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-8a9262de-ade3-4a35-a60f-92dfb0b52f80 req-3da17db2-ea99-4f94-9b53-25af04af05aa service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:55:18.492364 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-8a9262de-ade3-4a35-a60f-92dfb0b52f80 req-3da17db2-ea99-4f94-9b53-25af04af05aa service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:55:18.508703 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.compute.server_external_events [req-8a9262de-ade3-4a35-a60f-92dfb0b52f80 req-3da17db2-ea99-4f94-9b53-25af04af05aa service nova] Creating event network-vif-plugged:9bb445f8-37ab-49c7-9c66-0066ff9683cc for instance 26132db2-1798-4ba6-88bb-aaf87f6848b3 on n-h2-863052-2 Nov 01 18:55:18.516119 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-a0d2d320-68ea-4f9f-8223-eab12ad42362 tempest-FlavorsAdminTestJSON-2136163503 tempest-FlavorsAdminTestJSON-2136163503-project-admin] 10.222.0.13 "GET /compute/v2.1/flavors/detail" status: 200 len: 5818 microversion: 2.1 time: 0.103738 Nov 01 18:55:18.518430 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 148/312] 10.222.0.13 () {58 vars in 1146 bytes} [Tue Nov 1 18:55:18 2022] GET /compute/v2.1/flavors/detail => generated 5818 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:55:18.529775 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-1f0e4508-640d-4fb6-aaf7-af4f8de46757 tempest-HypervisorAdminUnderV252Test-1488648424 tempest-HypervisorAdminUnderV252Test-1488648424-project-admin] Calling method '.version_select at 0x7f0ae2dd9f70>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:55:18.538796 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [req-8a9262de-ade3-4a35-a60f-92dfb0b52f80 req-3da17db2-ea99-4f94-9b53-25af04af05aa service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063920 Nov 01 18:55:18.540311 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 165/313] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Nov 1 18:55:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 18:55:18.551078 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-1f0e4508-640d-4fb6-aaf7-af4f8de46757 tempest-HypervisorAdminUnderV252Test-1488648424 tempest-HypervisorAdminUnderV252Test-1488648424-project-admin] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:55:18.555517 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-1f0e4508-640d-4fb6-aaf7-af4f8de46757 tempest-HypervisorAdminUnderV252Test-1488648424 tempest-HypervisorAdminUnderV252Test-1488648424-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:55:18.556234 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-1f0e4508-640d-4fb6-aaf7-af4f8de46757 tempest-HypervisorAdminUnderV252Test-1488648424 tempest-HypervisorAdminUnderV252Test-1488648424-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:55:18.580284 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-b94456b5-3778-4836-95fd-9aa2f86d5d3d tempest-FlavorsAdminTestJSON-2136163503 tempest-FlavorsAdminTestJSON-2136163503-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-414103754", "id": 1022468188, "os-flavor-access:is_public": "False"}} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 18:55:18.618913 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-1f0e4508-640d-4fb6-aaf7-af4f8de46757 tempest-HypervisorAdminUnderV252Test-1488648424 tempest-HypervisorAdminUnderV252Test-1488648424-project-admin] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:55:18.622339 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-1f0e4508-640d-4fb6-aaf7-af4f8de46757 tempest-HypervisorAdminUnderV252Test-1488648424 tempest-HypervisorAdminUnderV252Test-1488648424-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:55:18.623959 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-1f0e4508-640d-4fb6-aaf7-af4f8de46757 tempest-HypervisorAdminUnderV252Test-1488648424 tempest-HypervisorAdminUnderV252Test-1488648424-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:55:18.630329 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-b94456b5-3778-4836-95fd-9aa2f86d5d3d tempest-FlavorsAdminTestJSON-2136163503 tempest-FlavorsAdminTestJSON-2136163503-project-admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 429 microversion: 2.1 time: 0.088754 Nov 01 18:55:18.631531 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 166/314] 10.222.0.13 () {60 vars in 1147 bytes} [Tue Nov 1 18:55:18 2022] POST /compute/v2.1/flavors => generated 429 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 18:55:18.651488 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-707f4a48-6a78-4e44-a55b-fadde771dfec tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:55:18.652771 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-707f4a48-6a78-4e44-a55b-fadde771dfec tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] [instance: ada7d07e-42e4-49a3-8e59-d16dee8cb0f0] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:55:18.662005 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-707f4a48-6a78-4e44-a55b-fadde771dfec tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:55:18.663015 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-707f4a48-6a78-4e44-a55b-fadde771dfec tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:55:18.663775 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-707f4a48-6a78-4e44-a55b-fadde771dfec tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:55:18.664782 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-707f4a48-6a78-4e44-a55b-fadde771dfec tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:55:18.665045 n-d-863052-2 devstack@n-api.service[121403]: DEBUG dbcounter [-] [121403] Writing DB stats nova_api:SELECT=88,nova_api:DELETE=5,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=121403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 18:55:18.665675 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-707f4a48-6a78-4e44-a55b-fadde771dfec tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:55:18.666294 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-707f4a48-6a78-4e44-a55b-fadde771dfec tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:55:18.676138 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-1f0e4508-640d-4fb6-aaf7-af4f8de46757 tempest-HypervisorAdminUnderV252Test-1488648424 tempest-HypervisorAdminUnderV252Test-1488648424-project-admin] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:55:18.676741 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-1f0e4508-640d-4fb6-aaf7-af4f8de46757 tempest-HypervisorAdminUnderV252Test-1488648424 tempest-HypervisorAdminUnderV252Test-1488648424-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:55:18.681180 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-1f0e4508-640d-4fb6-aaf7-af4f8de46757 tempest-HypervisorAdminUnderV252Test-1488648424 tempest-HypervisorAdminUnderV252Test-1488648424-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:55:18.721521 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-1f0e4508-640d-4fb6-aaf7-af4f8de46757 tempest-HypervisorAdminUnderV252Test-1488648424 tempest-HypervisorAdminUnderV252Test-1488648424-project-admin] 10.222.0.13 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.199727 Nov 01 18:55:18.724372 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 149/315] 10.222.0.13 () {58 vars in 1146 bytes} [Tue Nov 1 18:55:18 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 18:55:18.734206 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-85d44096-16fb-4201-854f-2fb66f1edfb3 tempest-FlavorsAdminTestJSON-2078145999 tempest-FlavorsAdminTestJSON-2078145999-project] Action: 'create', calling method: >, body: {"server": {"name": "test", "imageRef": "2d4a0047-1b9e-445f-8af8-1b5c9d93e881", "flavorRef": "1022468188"}} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 18:55:18.769235 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.wsgi [None req-85d44096-16fb-4201-854f-2fb66f1edfb3 tempest-FlavorsAdminTestJSON-2078145999 tempest-FlavorsAdminTestJSON-2078145999-project] HTTP exception thrown: Flavor 1022468188 could not be found. Nov 01 18:55:18.786799 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-85d44096-16fb-4201-854f-2fb66f1edfb3 tempest-FlavorsAdminTestJSON-2078145999 tempest-FlavorsAdminTestJSON-2078145999-project] Request method failure captured: Nov 01 18:55:18.786799 n-d-863052-2 devstack@n-api.service[121403]: request: POST /compute/v2.1/servers HTTP/1.1 Nov 01 18:55:18.786799 n-d-863052-2 devstack@n-api.service[121403]: Accept: application/json Nov 01 18:55:18.786799 n-d-863052-2 devstack@n-api.service[121403]: Accept-Encoding: identity Nov 01 18:55:18.786799 n-d-863052-2 devstack@n-api.service[121403]: Connection: close Nov 01 18:55:18.786799 n-d-863052-2 devstack@n-api.service[121403]: Content-Length: 107 Nov 01 18:55:18.786799 n-d-863052-2 devstack@n-api.service[121403]: Content-Type: application/json Nov 01 18:55:18.786799 n-d-863052-2 devstack@n-api.service[121403]: Host: 10.222.0.13 Nov 01 18:55:18.786799 n-d-863052-2 devstack@n-api.service[121403]: Openstack-System-Scope: None Nov 01 18:55:18.786799 n-d-863052-2 devstack@n-api.service[121403]: User-Agent: python-urllib3/1.26.12 Nov 01 18:55:18.786799 n-d-863052-2 devstack@n-api.service[121403]: X-Auth-Token: gAAAAABjYWuROULWH9Bj-5C4byXD-aEIQgiqpSPIWJL5zbWQlx4zbI9caf5VCOdpQzeE-0nEyzAkScVXxoflRxvrr9NXVHGJ4JjSzDfhDvyMxWC843Mywbm5maGFq9rmHTJIWbEND0mvTR1EVSlyiDB7hQnhYwLFBL8N0Tt69YyLvEAvnHGd1Ck Nov 01 18:55:18.786799 n-d-863052-2 devstack@n-api.service[121403]: X-Domain-Id: None Nov 01 18:55:18.786799 n-d-863052-2 devstack@n-api.service[121403]: X-Domain-Name: None Nov 01 18:55:18.786799 n-d-863052-2 devstack@n-api.service[121403]: X-Identity-Status: Confirmed Nov 01 18:55:18.786799 n-d-863052-2 devstack@n-api.service[121403]: X-Is-Admin-Project: True Nov 01 18:55:18.786799 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Domain-Id: default Nov 01 18:55:18.786799 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Domain-Name: Default Nov 01 18:55:18.786799 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Id: a0d5fc639e2444ab95153ac9485bd334 Nov 01 18:55:18.786799 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Name: tempest-FlavorsAdminTestJSON-2078145999 Nov 01 18:55:18.786799 n-d-863052-2 devstack@n-api.service[121403]: X-Role: member,reader Nov 01 18:55:18.786799 n-d-863052-2 devstack@n-api.service[121403]: X-Roles: member,reader Nov 01 18:55:18.788097 n-d-863052-2 devstack@n-api.service[121403]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/a0d5fc639e2444ab95153ac9485bd334"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/a0d5fc639e2444ab95153ac9485bd334"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_a0d5fc639e2444ab95153ac9485bd334", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/a0d5fc639e2444ab95153ac9485bd334"}]}] Nov 01 18:55:18.788097 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant: tempest-FlavorsAdminTestJSON-2078145999 Nov 01 18:55:18.788097 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant-Id: a0d5fc639e2444ab95153ac9485bd334 Nov 01 18:55:18.788097 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant-Name: tempest-FlavorsAdminTestJSON-2078145999 Nov 01 18:55:18.788097 n-d-863052-2 devstack@n-api.service[121403]: X-User: tempest-FlavorsAdminTestJSON-2078145999-project Nov 01 18:55:18.788097 n-d-863052-2 devstack@n-api.service[121403]: X-User-Domain-Id: default Nov 01 18:55:18.788097 n-d-863052-2 devstack@n-api.service[121403]: X-User-Domain-Name: Default Nov 01 18:55:18.788097 n-d-863052-2 devstack@n-api.service[121403]: X-User-Id: 36825dad9cf44349a7a21d3d1e1b4195 Nov 01 18:55:18.788097 n-d-863052-2 devstack@n-api.service[121403]: X-User-Name: tempest-FlavorsAdminTestJSON-2078145999-project Nov 01 18:55:18.788097 n-d-863052-2 devstack@n-api.service[121403]: Nov 01 18:55:18.788097 n-d-863052-2 devstack@n-api.service[121403]: {"server": {"name": "test", "imageRef": "2d4a0047-1b9e-445f-8af8-1b5c9d93e881", "flavorRef": "1022468188"}} Nov 01 18:55:18.788097 n-d-863052-2 devstack@n-api.service[121403]: method: > Nov 01 18:55:18.788097 n-d-863052-2 devstack@n-api.service[121403]: exception: Flavor 1022468188 could not be found. Nov 01 18:55:18.788908 n-d-863052-2 devstack@n-api.service[121403]: action_args: {'body': {'server': {'name': 'test', 'imageRef': '2d4a0047-1b9e-445f-8af8-1b5c9d93e881', 'flavorRef': '1022468188'}}} Nov 01 18:55:18.788908 n-d-863052-2 devstack@n-api.service[121403]: {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 01 18:55:18.788908 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:55:18.788908 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 778, in create Nov 01 18:55:18.788908 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id( Nov 01 18:55:18.788908 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Nov 01 18:55:18.788908 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Nov 01 18:55:18.788908 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 01 18:55:18.788908 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 01 18:55:18.788908 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Nov 01 18:55:18.788908 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Nov 01 18:55:18.788908 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Nov 01 18:55:18.788908 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 01 18:55:18.788908 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Nov 01 18:55:18.788908 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Nov 01 18:55:18.788908 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 1022468188 could not be found. Nov 01 18:55:18.788908 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 18:55:18.788908 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 18:55:18.788908 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 18:55:18.788908 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:55:18.790084 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 18:55:18.790084 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 18:55:18.790084 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 01 18:55:18.790084 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 01 18:55:18.790084 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 01 18:55:18.790084 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 01 18:55:18.790084 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 01 18:55:18.790084 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 01 18:55:18.790084 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 01 18:55:18.790084 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 01 18:55:18.790084 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 01 18:55:18.790084 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 01 18:55:18.790084 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Nov 01 18:55:18.790084 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Nov 01 18:55:18.790084 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Nov 01 18:55:18.790084 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor 1022468188 could not be found. Nov 01 18:55:18.790084 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 18:55:18.790084 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 18:55:18.790084 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 18:55:18.790084 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:55:18.790084 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 18:55:18.793885 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 18:55:18.793885 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 01 18:55:18.793885 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 01 18:55:18.793885 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 1022468188 could not be found. Nov 01 18:55:18.793885 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 18:55:18.795951 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-85d44096-16fb-4201-854f-2fb66f1edfb3 tempest-FlavorsAdminTestJSON-2078145999 tempest-FlavorsAdminTestJSON-2078145999-project] Returning 400 to user: Flavor 1022468188 could not be found. {{(pid=121403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 01 18:55:18.797052 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-85d44096-16fb-4201-854f-2fb66f1edfb3 tempest-FlavorsAdminTestJSON-2078145999 tempest-FlavorsAdminTestJSON-2078145999-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 400 len: 81 microversion: 2.1 time: 0.071363 Nov 01 18:55:18.798477 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 150/316] 10.222.0.13 () {60 vars in 1147 bytes} [Tue Nov 1 18:55:18 2022] POST /compute/v2.1/servers => generated 81 bytes in 73 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Nov 01 18:55:18.810580 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-ae27e4f1-9b96-461f-b022-0dcc71550a05 tempest-HypervisorAdminUnderV252Test-1488648424 tempest-HypervisorAdminUnderV252Test-1488648424-project-admin] Calling method '.version_select at 0x7f0ae2df4550>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:55:18.824087 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-ae27e4f1-9b96-461f-b022-0dcc71550a05 tempest-HypervisorAdminUnderV252Test-1488648424 tempest-HypervisorAdminUnderV252Test-1488648424-project-admin] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:55:18.829044 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-ae27e4f1-9b96-461f-b022-0dcc71550a05 tempest-HypervisorAdminUnderV252Test-1488648424 tempest-HypervisorAdminUnderV252Test-1488648424-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:55:18.837384 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-ae27e4f1-9b96-461f-b022-0dcc71550a05 tempest-HypervisorAdminUnderV252Test-1488648424 tempest-HypervisorAdminUnderV252Test-1488648424-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:55:18.895215 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-ae27e4f1-9b96-461f-b022-0dcc71550a05 tempest-HypervisorAdminUnderV252Test-1488648424 tempest-HypervisorAdminUnderV252Test-1488648424-project-admin] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:55:18.899212 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-ae27e4f1-9b96-461f-b022-0dcc71550a05 tempest-HypervisorAdminUnderV252Test-1488648424 tempest-HypervisorAdminUnderV252Test-1488648424-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:55:18.899925 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-ae27e4f1-9b96-461f-b022-0dcc71550a05 tempest-HypervisorAdminUnderV252Test-1488648424 tempest-HypervisorAdminUnderV252Test-1488648424-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:55:18.913448 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-ae27e4f1-9b96-461f-b022-0dcc71550a05 tempest-HypervisorAdminUnderV252Test-1488648424 tempest-HypervisorAdminUnderV252Test-1488648424-project-admin] 10.222.0.13 "GET /compute/v2.1/os-hypervisors/n-h1-863052-2/search" status: 200 len: 104 microversion: 2.1 time: 0.113642 Nov 01 18:55:18.915663 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 151/317] 10.222.0.13 () {58 vars in 1209 bytes} [Tue Nov 1 18:55:18 2022] GET /compute/v2.1/os-hypervisors/n-h1-863052-2/search => generated 104 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 18:55:18.925888 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-e0f4d8fd-1629-4c23-93a0-65ed99346b61 tempest-FlavorsAdminTestJSON-2136163503 tempest-FlavorsAdminTestJSON-2136163503-project-admin] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:55:18.980303 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-e0f4d8fd-1629-4c23-93a0-65ed99346b61 tempest-FlavorsAdminTestJSON-2136163503 tempest-FlavorsAdminTestJSON-2136163503-project-admin] 10.222.0.13 "DELETE /compute/v2.1/flavors/1022468188" status: 202 len: 0 microversion: 2.1 time: 0.060740 Nov 01 18:55:18.983996 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 152/318] 10.222.0.13 () {58 vars in 1161 bytes} [Tue Nov 1 18:55:18 2022] DELETE /compute/v2.1/flavors/1022468188 => generated 0 bytes in 62 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 01 18:55:18.990656 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-693009d5-a141-497f-93ce-4b3bbfd16d87 tempest-FlavorsAdminTestJSON-2136163503 tempest-FlavorsAdminTestJSON-2136163503-project-admin] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:55:19.037011 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-693009d5-a141-497f-93ce-4b3bbfd16d87 tempest-FlavorsAdminTestJSON-2136163503 tempest-FlavorsAdminTestJSON-2136163503-project-admin] 10.222.0.13 "GET /compute/v2.1/flavors/detail" status: 200 len: 5818 microversion: 2.1 time: 0.050174 Nov 01 18:55:19.048618 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 153/319] 10.222.0.13 () {58 vars in 1146 bytes} [Tue Nov 1 18:55:18 2022] GET /compute/v2.1/flavors/detail => generated 5818 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:55:19.061469 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-4b20606c-79b9-4d36-951a-dff074a84a50 tempest-FlavorsAdminTestJSON-2136163503 tempest-FlavorsAdminTestJSON-2136163503-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1541496505", "id": 1129795532, "os-flavor-access:is_public": "False"}} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 18:55:19.106433 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-4b20606c-79b9-4d36-951a-dff074a84a50 tempest-FlavorsAdminTestJSON-2136163503 tempest-FlavorsAdminTestJSON-2136163503-project-admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 415 microversion: 2.1 time: 0.051006 Nov 01 18:55:19.108561 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 154/320] 10.222.0.13 () {60 vars in 1147 bytes} [Tue Nov 1 18:55:19 2022] POST /compute/v2.1/flavors => generated 415 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 18:55:19.126420 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-7484e9c5-3254-4a3a-85fd-4a7d5c8c1460 tempest-FlavorsAdminTestJSON-2136163503 tempest-FlavorsAdminTestJSON-2136163503-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-2123574016", "id": 1062507904, "os-flavor-access:is_public": "True"}} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 18:55:19.179541 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-7484e9c5-3254-4a3a-85fd-4a7d5c8c1460 tempest-FlavorsAdminTestJSON-2136163503 tempest-FlavorsAdminTestJSON-2136163503-project-admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 414 microversion: 2.1 time: 0.063003 Nov 01 18:55:19.182320 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 155/321] 10.222.0.13 () {60 vars in 1147 bytes} [Tue Nov 1 18:55:19 2022] POST /compute/v2.1/flavors => generated 414 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 18:55:19.187818 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-84e6b5e7-f6ec-4ec5-8ffe-695f54f9579b tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:55:19.188883 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-84e6b5e7-f6ec-4ec5-8ffe-695f54f9579b tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] [instance: de2ff806-a2fa-4390-b4d5-11ff24dd27ca] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:55:19.202732 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-84e6b5e7-f6ec-4ec5-8ffe-695f54f9579b tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:55:19.209307 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-84e6b5e7-f6ec-4ec5-8ffe-695f54f9579b tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:55:19.211285 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-84e6b5e7-f6ec-4ec5-8ffe-695f54f9579b tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:55:19.224142 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-84e6b5e7-f6ec-4ec5-8ffe-695f54f9579b tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:55:19.225740 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-84e6b5e7-f6ec-4ec5-8ffe-695f54f9579b tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:55:19.227865 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-84e6b5e7-f6ec-4ec5-8ffe-695f54f9579b tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:55:19.410562 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-84e6b5e7-f6ec-4ec5-8ffe-695f54f9579b tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f32f5fba1976432d938e664c7714e52b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b9d4c236b944f9b2e8e502a50a8f8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:55:19.425736 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-84e6b5e7-f6ec-4ec5-8ffe-695f54f9579b tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] 10.222.0.13 "GET /compute/v2.1/servers/de2ff806-a2fa-4390-b4d5-11ff24dd27ca" status: 200 len: 1268 microversion: 2.1 time: 0.240922 Nov 01 18:55:19.429497 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 156/322] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:55:19 2022] GET /compute/v2.1/servers/de2ff806-a2fa-4390-b4d5-11ff24dd27ca => generated 1268 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:55:19.443690 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-b53b2483-dfd7-413b-9c81-25866a6c0c4b tempest-FlavorsAdminTestJSON-2136163503 tempest-FlavorsAdminTestJSON-2136163503-project-admin] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:55:19.494941 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-b53b2483-dfd7-413b-9c81-25866a6c0c4b tempest-FlavorsAdminTestJSON-2136163503 tempest-FlavorsAdminTestJSON-2136163503-project-admin] 10.222.0.13 "GET /compute/v2.1/flavors/detail?is_public=f" status: 200 len: 418 microversion: 2.1 time: 0.057399 Nov 01 18:55:19.497479 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 157/323] 10.222.0.13 () {58 vars in 1169 bytes} [Tue Nov 1 18:55:19 2022] GET /compute/v2.1/flavors/detail?is_public=f => generated 418 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 18:55:19.513242 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-c0e4d99c-9f1e-41e3-8268-d2ef4f39980a tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:55:19.516227 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-c0e4d99c-9f1e-41e3-8268-d2ef4f39980a tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] [instance: 26132db2-1798-4ba6-88bb-aaf87f6848b3] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:55:19.534338 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-c0e4d99c-9f1e-41e3-8268-d2ef4f39980a tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:55:19.536194 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-c0e4d99c-9f1e-41e3-8268-d2ef4f39980a tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:55:19.538644 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-c0e4d99c-9f1e-41e3-8268-d2ef4f39980a tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:55:19.541303 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-c0e4d99c-9f1e-41e3-8268-d2ef4f39980a tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:55:19.542126 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-c0e4d99c-9f1e-41e3-8268-d2ef4f39980a tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:55:19.546744 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-c0e4d99c-9f1e-41e3-8268-d2ef4f39980a tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:55:19.916756 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-707f4a48-6a78-4e44-a55b-fadde771dfec tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce2e0d1828674809a3344a7a68f375c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8e1248497284006a7acbb8169627ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:55:19.927392 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-707f4a48-6a78-4e44-a55b-fadde771dfec tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] 10.222.0.13 "GET /compute/v2.1/servers/ada7d07e-42e4-49a3-8e59-d16dee8cb0f0" status: 200 len: 1319 microversion: 2.1 time: 1.283243 Nov 01 18:55:19.933467 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 167/324] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:55:18 2022] GET /compute/v2.1/servers/ada7d07e-42e4-49a3-8e59-d16dee8cb0f0 => generated 1319 bytes in 1290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:55:19.949882 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-253f731f-7405-410b-bbac-7b83804b3e32 tempest-FlavorsAdminTestJSON-2136163503 tempest-FlavorsAdminTestJSON-2136163503-project-admin] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:55:20.005209 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-253f731f-7405-410b-bbac-7b83804b3e32 tempest-FlavorsAdminTestJSON-2136163503 tempest-FlavorsAdminTestJSON-2136163503-project-admin] 10.222.0.13 "GET /compute/v2.1/flavors/detail?is_public=false" status: 200 len: 418 microversion: 2.1 time: 0.070131 Nov 01 18:55:20.005842 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 168/325] 10.222.0.13 () {58 vars in 1177 bytes} [Tue Nov 1 18:55:19 2022] GET /compute/v2.1/flavors/detail?is_public=false => generated 418 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 18:55:20.020641 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-c633841e-ea4f-4d81-9e3e-830924381da7 tempest-FlavorsAdminTestJSON-2136163503 tempest-FlavorsAdminTestJSON-2136163503-project-admin] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:55:20.042249 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-c633841e-ea4f-4d81-9e3e-830924381da7 tempest-FlavorsAdminTestJSON-2136163503 tempest-FlavorsAdminTestJSON-2136163503-project-admin] 10.222.0.13 "GET /compute/v2.1/flavors/detail?is_public=no" status: 200 len: 418 microversion: 2.1 time: 0.025710 Nov 01 18:55:20.045652 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 169/326] 10.222.0.13 () {58 vars in 1171 bytes} [Tue Nov 1 18:55:20 2022] GET /compute/v2.1/flavors/detail?is_public=no => generated 418 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 01 18:55:20.069786 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-f5a2aa92-b975-4aff-8ceb-5b6699bd361b tempest-FlavorsAdminTestJSON-2136163503 tempest-FlavorsAdminTestJSON-2136163503-project-admin] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:55:20.129172 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-f5a2aa92-b975-4aff-8ceb-5b6699bd361b tempest-FlavorsAdminTestJSON-2136163503 tempest-FlavorsAdminTestJSON-2136163503-project-admin] 10.222.0.13 "GET /compute/v2.1/flavors/detail?is_public=0" status: 200 len: 418 microversion: 2.1 time: 0.072054 Nov 01 18:55:20.138022 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 170/327] 10.222.0.13 () {58 vars in 1169 bytes} [Tue Nov 1 18:55:20 2022] GET /compute/v2.1/flavors/detail?is_public=0 => generated 418 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 18:55:20.145152 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-56c5f983-3283-4e12-a6c0-242a25d0d165 tempest-FlavorsAdminTestJSON-2136163503 tempest-FlavorsAdminTestJSON-2136163503-project-admin] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:55:20.227992 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-56c5f983-3283-4e12-a6c0-242a25d0d165 tempest-FlavorsAdminTestJSON-2136163503 tempest-FlavorsAdminTestJSON-2136163503-project-admin] 10.222.0.13 "GET /compute/v2.1/flavors/detail?is_public=t" status: 200 len: 6222 microversion: 2.1 time: 0.086620 Nov 01 18:55:20.241446 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 171/328] 10.222.0.13 () {58 vars in 1169 bytes} [Tue Nov 1 18:55:20 2022] GET /compute/v2.1/flavors/detail?is_public=t => generated 6222 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 18:55:20.253742 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-0824d10d-a42c-4983-9127-7ce426c27b49 tempest-FlavorsAdminTestJSON-2136163503 tempest-FlavorsAdminTestJSON-2136163503-project-admin] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:55:20.334529 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-0824d10d-a42c-4983-9127-7ce426c27b49 tempest-FlavorsAdminTestJSON-2136163503 tempest-FlavorsAdminTestJSON-2136163503-project-admin] 10.222.0.13 "GET /compute/v2.1/flavors/detail?is_public=true" status: 200 len: 6222 microversion: 2.1 time: 0.085126 Nov 01 18:55:20.336290 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 172/329] 10.222.0.13 () {58 vars in 1175 bytes} [Tue Nov 1 18:55:20 2022] GET /compute/v2.1/flavors/detail?is_public=true => generated 6222 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:55:20.356945 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-127701a3-eb1f-4953-a909-5d98b7e27049 tempest-FlavorsAdminTestJSON-2136163503 tempest-FlavorsAdminTestJSON-2136163503-project-admin] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:55:20.419708 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-127701a3-eb1f-4953-a909-5d98b7e27049 tempest-FlavorsAdminTestJSON-2136163503 tempest-FlavorsAdminTestJSON-2136163503-project-admin] 10.222.0.13 "GET /compute/v2.1/flavors/detail?is_public=yes" status: 200 len: 6222 microversion: 2.1 time: 0.068124 Nov 01 18:55:20.424685 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 173/330] 10.222.0.13 () {58 vars in 1173 bytes} [Tue Nov 1 18:55:20 2022] GET /compute/v2.1/flavors/detail?is_public=yes => generated 6222 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:55:20.447292 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-c1e7c9b3-a006-4265-b6a6-f37fd119ce78 tempest-FlavorsAdminTestJSON-2136163503 tempest-FlavorsAdminTestJSON-2136163503-project-admin] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:55:20.507025 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-c1e7c9b3-a006-4265-b6a6-f37fd119ce78 tempest-FlavorsAdminTestJSON-2136163503 tempest-FlavorsAdminTestJSON-2136163503-project-admin] 10.222.0.13 "GET /compute/v2.1/flavors/detail?is_public=1" status: 200 len: 6222 microversion: 2.1 time: 0.064097 Nov 01 18:55:20.508385 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 174/331] 10.222.0.13 () {58 vars in 1169 bytes} [Tue Nov 1 18:55:20 2022] GET /compute/v2.1/flavors/detail?is_public=1 => generated 6222 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:55:20.514347 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-c0e4d99c-9f1e-41e3-8268-d2ef4f39980a tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07a2a96629f4baea6a3adfc4011ffe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9baf3860ba564f5c8dff93085b9aabe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:55:20.514879 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-db8b75b2-6756-4fd8-a9ca-a3874a515348 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:55:20.514980 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-db8b75b2-6756-4fd8-a9ca-a3874a515348 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] [instance: de2ff806-a2fa-4390-b4d5-11ff24dd27ca] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:55:20.524372 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-c0e4d99c-9f1e-41e3-8268-d2ef4f39980a tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] 10.222.0.13 "GET /compute/v2.1/servers/26132db2-1798-4ba6-88bb-aaf87f6848b3" status: 200 len: 1387 microversion: 2.1 time: 1.024671 Nov 01 18:55:20.524969 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 158/332] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:55:19 2022] GET /compute/v2.1/servers/26132db2-1798-4ba6-88bb-aaf87f6848b3 => generated 1387 bytes in 1027 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:55:20.534709 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-db8b75b2-6756-4fd8-a9ca-a3874a515348 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:55:20.535202 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-db8b75b2-6756-4fd8-a9ca-a3874a515348 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:55:20.535639 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-db8b75b2-6756-4fd8-a9ca-a3874a515348 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:55:20.536475 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-db8b75b2-6756-4fd8-a9ca-a3874a515348 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:55:20.536955 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-db8b75b2-6756-4fd8-a9ca-a3874a515348 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:55:20.540519 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-a1147e69-e90d-469a-bc51-1c3d8d3d437f tempest-FlavorsAdminTestJSON-2136163503 tempest-FlavorsAdminTestJSON-2136163503-project-admin] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:55:20.543102 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-db8b75b2-6756-4fd8-a9ca-a3874a515348 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:55:20.598020 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-a1147e69-e90d-469a-bc51-1c3d8d3d437f tempest-FlavorsAdminTestJSON-2136163503 tempest-FlavorsAdminTestJSON-2136163503-project-admin] 10.222.0.13 "DELETE /compute/v2.1/flavors/1062507904" status: 202 len: 0 microversion: 2.1 time: 0.067081 Nov 01 18:55:20.603101 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 159/333] 10.222.0.13 () {58 vars in 1161 bytes} [Tue Nov 1 18:55:20 2022] DELETE /compute/v2.1/flavors/1062507904 => generated 0 bytes in 73 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 01 18:55:20.609503 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-c026944b-d460-451e-a9eb-d3de032e421a tempest-FlavorsAdminTestJSON-2136163503 tempest-FlavorsAdminTestJSON-2136163503-project-admin] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:55:20.633593 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-c026944b-d460-451e-a9eb-d3de032e421a tempest-FlavorsAdminTestJSON-2136163503 tempest-FlavorsAdminTestJSON-2136163503-project-admin] 10.222.0.13 "GET /compute/v2.1/flavors/detail" status: 200 len: 5818 microversion: 2.1 time: 0.028738 Nov 01 18:55:20.649114 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 160/334] 10.222.0.13 () {58 vars in 1146 bytes} [Tue Nov 1 18:55:20 2022] GET /compute/v2.1/flavors/detail => generated 5818 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:55:20.654281 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-2228c272-b496-4630-af01-88eda4d4c508 tempest-FlavorsAdminTestJSON-2136163503 tempest-FlavorsAdminTestJSON-2136163503-project-admin] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:55:20.720505 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-2228c272-b496-4630-af01-88eda4d4c508 tempest-FlavorsAdminTestJSON-2136163503 tempest-FlavorsAdminTestJSON-2136163503-project-admin] 10.222.0.13 "DELETE /compute/v2.1/flavors/1129795532" status: 202 len: 0 microversion: 2.1 time: 0.069530 Nov 01 18:55:20.721795 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 161/335] 10.222.0.13 () {58 vars in 1161 bytes} [Tue Nov 1 18:55:20 2022] DELETE /compute/v2.1/flavors/1129795532 => generated 0 bytes in 72 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 01 18:55:20.745949 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-ae15e88f-63d0-472d-ac46-53e220922820 tempest-FlavorsAdminTestJSON-2136163503 tempest-FlavorsAdminTestJSON-2136163503-project-admin] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:55:20.793002 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-ae15e88f-63d0-472d-ac46-53e220922820 tempest-FlavorsAdminTestJSON-2136163503 tempest-FlavorsAdminTestJSON-2136163503-project-admin] 10.222.0.13 "GET /compute/v2.1/flavors/detail" status: 200 len: 5818 microversion: 2.1 time: 0.064594 Nov 01 18:55:20.804863 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 162/336] 10.222.0.13 () {58 vars in 1146 bytes} [Tue Nov 1 18:55:20 2022] GET /compute/v2.1/flavors/detail => generated 5818 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:55:20.817645 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-65a5f262-a2f5-4c5a-bfdc-17ffc6af3818 tempest-FlavorsAdminTestJSON-2136163503 tempest-FlavorsAdminTestJSON-2136163503-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1378304900", "id": 1282864061, "os-flavor-access:is_public": "False"}} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 18:55:20.853141 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-65a5f262-a2f5-4c5a-bfdc-17ffc6af3818 tempest-FlavorsAdminTestJSON-2136163503 tempest-FlavorsAdminTestJSON-2136163503-project-admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 415 microversion: 2.1 time: 0.039156 Nov 01 18:55:20.854052 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 163/337] 10.222.0.13 () {60 vars in 1147 bytes} [Tue Nov 1 18:55:20 2022] POST /compute/v2.1/flavors => generated 415 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 18:55:20.862647 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-db8b75b2-6756-4fd8-a9ca-a3874a515348 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f32f5fba1976432d938e664c7714e52b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b9d4c236b944f9b2e8e502a50a8f8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:55:20.866271 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-5efdea36-dde1-4ae3-9b0e-7a73fc3608e4 tempest-FlavorsAdminTestJSON-2136163503 tempest-FlavorsAdminTestJSON-2136163503-project-admin] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:55:20.902930 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-db8b75b2-6756-4fd8-a9ca-a3874a515348 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] 10.222.0.13 "GET /compute/v2.1/servers/de2ff806-a2fa-4390-b4d5-11ff24dd27ca" status: 200 len: 1310 microversion: 2.1 time: 0.392550 Nov 01 18:55:20.903860 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-5efdea36-dde1-4ae3-9b0e-7a73fc3608e4 tempest-FlavorsAdminTestJSON-2136163503 tempest-FlavorsAdminTestJSON-2136163503-project-admin] 10.222.0.13 "GET /compute/v2.1/flavors/detail" status: 200 len: 5818 microversion: 2.1 time: 0.041387 Nov 01 18:55:20.906949 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 175/338] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:55:20 2022] GET /compute/v2.1/servers/de2ff806-a2fa-4390-b4d5-11ff24dd27ca => generated 1310 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:55:20.914692 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 164/339] 10.222.0.13 () {58 vars in 1146 bytes} [Tue Nov 1 18:55:20 2022] GET /compute/v2.1/flavors/detail => generated 5818 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 18:55:20.940205 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-78422d44-b24e-4b88-8742-8085ae15d319 tempest-FlavorsAdminTestJSON-2078145999 tempest-FlavorsAdminTestJSON-2078145999-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:55:20.955262 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-7e633900-8955-4319-ab69-c1d6dcda4637 tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:55:20.955873 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-7e633900-8955-4319-ab69-c1d6dcda4637 tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] [instance: ada7d07e-42e4-49a3-8e59-d16dee8cb0f0] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:55:20.972142 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-7e633900-8955-4319-ab69-c1d6dcda4637 tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:55:20.972542 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-7e633900-8955-4319-ab69-c1d6dcda4637 tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:55:20.973007 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-7e633900-8955-4319-ab69-c1d6dcda4637 tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:55:20.973718 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-7e633900-8955-4319-ab69-c1d6dcda4637 tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:55:20.974177 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-7e633900-8955-4319-ab69-c1d6dcda4637 tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:55:20.974614 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-7e633900-8955-4319-ab69-c1d6dcda4637 tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:55:20.982827 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-78422d44-b24e-4b88-8742-8085ae15d319 tempest-FlavorsAdminTestJSON-2078145999 tempest-FlavorsAdminTestJSON-2078145999-project] 10.222.0.13 "GET /compute/v2.1/flavors/detail" status: 200 len: 5818 microversion: 2.1 time: 0.050506 Nov 01 18:55:20.984385 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 176/340] 10.222.0.13 () {58 vars in 1146 bytes} [Tue Nov 1 18:55:20 2022] GET /compute/v2.1/flavors/detail => generated 5818 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:55:21.007174 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-edae34a9-a7e8-461a-a01c-265e3cac2f4a tempest-FlavorsAdminTestJSON-2136163503 tempest-FlavorsAdminTestJSON-2136163503-project-admin] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:55:21.043276 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-edae34a9-a7e8-461a-a01c-265e3cac2f4a tempest-FlavorsAdminTestJSON-2136163503 tempest-FlavorsAdminTestJSON-2136163503-project-admin] 10.222.0.13 "DELETE /compute/v2.1/flavors/1282864061" status: 202 len: 0 microversion: 2.1 time: 0.040135 Nov 01 18:55:21.044873 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 177/341] 10.222.0.13 () {58 vars in 1161 bytes} [Tue Nov 1 18:55:21 2022] DELETE /compute/v2.1/flavors/1282864061 => generated 0 bytes in 43 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 01 18:55:21.068408 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-f02e4ecc-12b6-4c92-89cf-c9ee4dcee7fe tempest-FlavorsAdminTestJSON-2136163503 tempest-FlavorsAdminTestJSON-2136163503-project-admin] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:55:21.115061 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-f02e4ecc-12b6-4c92-89cf-c9ee4dcee7fe tempest-FlavorsAdminTestJSON-2136163503 tempest-FlavorsAdminTestJSON-2136163503-project-admin] 10.222.0.13 "GET /compute/v2.1/flavors/detail" status: 200 len: 5818 microversion: 2.1 time: 0.065760 Nov 01 18:55:21.117711 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 178/342] 10.222.0.13 () {58 vars in 1146 bytes} [Tue Nov 1 18:55:21 2022] GET /compute/v2.1/flavors/detail => generated 5818 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 18:55:21.155196 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-d198230a-a8ea-4983-a801-d6e8333d954b tempest-FlavorsAdminTestJSON-2136163503 tempest-FlavorsAdminTestJSON-2136163503-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-822619343", "id": 613293166, "os-flavor-access:is_public": "True"}} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 18:55:21.214889 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-d198230a-a8ea-4983-a801-d6e8333d954b tempest-FlavorsAdminTestJSON-2136163503 tempest-FlavorsAdminTestJSON-2136163503-project-admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 410 microversion: 2.1 time: 0.077541 Nov 01 18:55:21.227574 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 179/343] 10.222.0.13 () {60 vars in 1147 bytes} [Tue Nov 1 18:55:21 2022] POST /compute/v2.1/flavors => generated 410 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 01 18:55:21.239438 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-d1d3ab57-586a-4f5c-83e4-fc48b21882fa tempest-FlavorsAdminTestJSON-2078145999 tempest-FlavorsAdminTestJSON-2078145999-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:55:21.320049 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-d1d3ab57-586a-4f5c-83e4-fc48b21882fa tempest-FlavorsAdminTestJSON-2078145999 tempest-FlavorsAdminTestJSON-2078145999-project] 10.222.0.13 "GET /compute/v2.1/flavors/detail" status: 200 len: 6218 microversion: 2.1 time: 0.089254 Nov 01 18:55:21.361128 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 180/344] 10.222.0.13 () {58 vars in 1146 bytes} [Tue Nov 1 18:55:21 2022] GET /compute/v2.1/flavors/detail => generated 6218 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:55:21.377025 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-ba514b80-d22f-45db-b0a7-86373beff390 tempest-FlavorsAdminTestJSON-2136163503 tempest-FlavorsAdminTestJSON-2136163503-project-admin] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:55:21.419959 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-ba514b80-d22f-45db-b0a7-86373beff390 tempest-FlavorsAdminTestJSON-2136163503 tempest-FlavorsAdminTestJSON-2136163503-project-admin] 10.222.0.13 "DELETE /compute/v2.1/flavors/613293166" status: 202 len: 0 microversion: 2.1 time: 0.056192 Nov 01 18:55:21.425714 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 181/345] 10.222.0.13 () {58 vars in 1158 bytes} [Tue Nov 1 18:55:21 2022] DELETE /compute/v2.1/flavors/613293166 => generated 0 bytes in 64 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 01 18:55:21.434585 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-3f989eb7-6528-41b6-9224-43efd2bd3431 tempest-FlavorsAdminTestJSON-2136163503 tempest-FlavorsAdminTestJSON-2136163503-project-admin] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:55:21.510548 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-3f989eb7-6528-41b6-9224-43efd2bd3431 tempest-FlavorsAdminTestJSON-2136163503 tempest-FlavorsAdminTestJSON-2136163503-project-admin] 10.222.0.13 "GET /compute/v2.1/flavors/detail" status: 200 len: 5818 microversion: 2.1 time: 0.082793 Nov 01 18:55:21.523454 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 182/346] 10.222.0.13 () {58 vars in 1146 bytes} [Tue Nov 1 18:55:21 2022] GET /compute/v2.1/flavors/detail => generated 5818 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:55:21.560461 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-3ad8423a-d252-46ec-a336-75086fa96fe6 tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:55:21.561417 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-3ad8423a-d252-46ec-a336-75086fa96fe6 tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] [instance: 26132db2-1798-4ba6-88bb-aaf87f6848b3] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:55:21.586929 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-3ad8423a-d252-46ec-a336-75086fa96fe6 tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:55:21.587426 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-3ad8423a-d252-46ec-a336-75086fa96fe6 tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:55:21.587861 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-3ad8423a-d252-46ec-a336-75086fa96fe6 tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:55:21.588572 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-3ad8423a-d252-46ec-a336-75086fa96fe6 tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:55:21.589084 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-3ad8423a-d252-46ec-a336-75086fa96fe6 tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:55:21.589500 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-3ad8423a-d252-46ec-a336-75086fa96fe6 tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:55:21.736130 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-7e633900-8955-4319-ab69-c1d6dcda4637 tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce2e0d1828674809a3344a7a68f375c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8e1248497284006a7acbb8169627ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:55:21.748907 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-7e633900-8955-4319-ab69-c1d6dcda4637 tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] 10.222.0.13 "GET /compute/v2.1/servers/ada7d07e-42e4-49a3-8e59-d16dee8cb0f0" status: 200 len: 1319 microversion: 2.1 time: 0.794268 Nov 01 18:55:21.750564 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 165/347] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:55:20 2022] GET /compute/v2.1/servers/ada7d07e-42e4-49a3-8e59-d16dee8cb0f0 => generated 1319 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 18:55:21.930436 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-3e5ce392-fd8f-477a-8276-21331a35e470 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:55:21.932152 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-3e5ce392-fd8f-477a-8276-21331a35e470 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] [instance: de2ff806-a2fa-4390-b4d5-11ff24dd27ca] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:55:21.944788 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-3e5ce392-fd8f-477a-8276-21331a35e470 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:55:21.946630 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-3e5ce392-fd8f-477a-8276-21331a35e470 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:55:21.947346 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-3e5ce392-fd8f-477a-8276-21331a35e470 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:55:21.950786 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-3e5ce392-fd8f-477a-8276-21331a35e470 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:55:21.954275 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-3e5ce392-fd8f-477a-8276-21331a35e470 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:55:21.955064 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-3e5ce392-fd8f-477a-8276-21331a35e470 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:55:22.240568 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-3ad8423a-d252-46ec-a336-75086fa96fe6 tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07a2a96629f4baea6a3adfc4011ffe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9baf3860ba564f5c8dff93085b9aabe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:55:22.248749 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-3ad8423a-d252-46ec-a336-75086fa96fe6 tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] 10.222.0.13 "GET /compute/v2.1/servers/26132db2-1798-4ba6-88bb-aaf87f6848b3" status: 200 len: 1387 microversion: 2.1 time: 0.702217 Nov 01 18:55:22.260908 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 183/348] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:55:21 2022] GET /compute/v2.1/servers/26132db2-1798-4ba6-88bb-aaf87f6848b3 => generated 1387 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:55:22.269323 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-3e5ce392-fd8f-477a-8276-21331a35e470 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f32f5fba1976432d938e664c7714e52b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b9d4c236b944f9b2e8e502a50a8f8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:55:22.286387 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-3e5ce392-fd8f-477a-8276-21331a35e470 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] 10.222.0.13 "GET /compute/v2.1/servers/de2ff806-a2fa-4390-b4d5-11ff24dd27ca" status: 200 len: 1310 microversion: 2.1 time: 0.360901 Nov 01 18:55:22.286984 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 166/349] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:55:21 2022] GET /compute/v2.1/servers/de2ff806-a2fa-4390-b4d5-11ff24dd27ca => generated 1310 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 18:55:22.563913 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [req-f61eb047-372e-452a-940a-f85042cd9a83 req-74701165-2166-4ab2-bb4d-3de9ee54df10 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "de2ff806-a2fa-4390-b4d5-11ff24dd27ca", "tag": "4157a71a-6529-42b5-9194-408c1d22d219"}]} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 18:55:22.569256 n-d-863052-2 devstack@n-api.service[121402]: DEBUG dbcounter [-] [121402] Writing DB stats nova_api:SELECT=81,nova_api:DELETE=15,nova_api:INSERT=4 {{(pid=121402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 18:55:22.594934 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-f61eb047-372e-452a-940a-f85042cd9a83 req-74701165-2166-4ab2-bb4d-3de9ee54df10 service nova] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:55:22.595430 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-f61eb047-372e-452a-940a-f85042cd9a83 req-74701165-2166-4ab2-bb4d-3de9ee54df10 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:55:22.595868 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-f61eb047-372e-452a-940a-f85042cd9a83 req-74701165-2166-4ab2-bb4d-3de9ee54df10 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:55:22.644118 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.compute.server_external_events [req-f61eb047-372e-452a-940a-f85042cd9a83 req-74701165-2166-4ab2-bb4d-3de9ee54df10 service nova] Creating event network-changed:4157a71a-6529-42b5-9194-408c1d22d219 for instance de2ff806-a2fa-4390-b4d5-11ff24dd27ca on n-h1-863052-2 Nov 01 18:55:22.660313 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [req-f61eb047-372e-452a-940a-f85042cd9a83 req-74701165-2166-4ab2-bb4d-3de9ee54df10 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103376 Nov 01 18:55:22.660959 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 184/350] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Nov 1 18:55:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 18:55:22.776170 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-19fdf774-fff3-41f4-9982-fb6272c2ad7e tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:55:22.777458 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-19fdf774-fff3-41f4-9982-fb6272c2ad7e tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] [instance: ada7d07e-42e4-49a3-8e59-d16dee8cb0f0] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:55:22.788877 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-19fdf774-fff3-41f4-9982-fb6272c2ad7e tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:55:22.789845 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-19fdf774-fff3-41f4-9982-fb6272c2ad7e tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:55:22.790531 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-19fdf774-fff3-41f4-9982-fb6272c2ad7e tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:55:22.796297 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-19fdf774-fff3-41f4-9982-fb6272c2ad7e tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:55:22.797179 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-19fdf774-fff3-41f4-9982-fb6272c2ad7e tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:55:22.797822 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-19fdf774-fff3-41f4-9982-fb6272c2ad7e tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:55:23.168279 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [req-f181218e-b4a3-41c8-9640-556e93e5deba req-8851e458-1db1-4814-82b3-f93090d007aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ada7d07e-42e4-49a3-8e59-d16dee8cb0f0", "name": "network-vif-plugged", "status": "completed", "tag": "dc725968-cc56-440f-a6f5-163832220fd5"}]} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 18:55:23.196875 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-f181218e-b4a3-41c8-9640-556e93e5deba req-8851e458-1db1-4814-82b3-f93090d007aa service nova] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:55:23.197864 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-f181218e-b4a3-41c8-9640-556e93e5deba req-8851e458-1db1-4814-82b3-f93090d007aa service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:55:23.200070 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-f181218e-b4a3-41c8-9640-556e93e5deba req-8851e458-1db1-4814-82b3-f93090d007aa service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:55:23.225022 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.compute.server_external_events [req-f181218e-b4a3-41c8-9640-556e93e5deba req-8851e458-1db1-4814-82b3-f93090d007aa service nova] Creating event network-vif-plugged:dc725968-cc56-440f-a6f5-163832220fd5 for instance ada7d07e-42e4-49a3-8e59-d16dee8cb0f0 on n-h1-863052-2 Nov 01 18:55:23.244474 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [req-f181218e-b4a3-41c8-9640-556e93e5deba req-8851e458-1db1-4814-82b3-f93090d007aa service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081158 Nov 01 18:55:23.253882 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 185/351] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Nov 1 18:55:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 01 18:55:23.276907 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-6ff81150-3565-4feb-9d14-3686dac4fce6 tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:55:23.277878 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-6ff81150-3565-4feb-9d14-3686dac4fce6 tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] [instance: 26132db2-1798-4ba6-88bb-aaf87f6848b3] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:55:23.288714 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-6ff81150-3565-4feb-9d14-3686dac4fce6 tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:55:23.293176 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-6ff81150-3565-4feb-9d14-3686dac4fce6 tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:55:23.293783 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-6ff81150-3565-4feb-9d14-3686dac4fce6 tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:55:23.294668 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-6ff81150-3565-4feb-9d14-3686dac4fce6 tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:55:23.295873 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-6ff81150-3565-4feb-9d14-3686dac4fce6 tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:55:23.297542 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-6ff81150-3565-4feb-9d14-3686dac4fce6 tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:55:23.668451 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-19fdf774-fff3-41f4-9982-fb6272c2ad7e tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce2e0d1828674809a3344a7a68f375c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8e1248497284006a7acbb8169627ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:55:23.682635 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-19fdf774-fff3-41f4-9982-fb6272c2ad7e tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] 10.222.0.13 "GET /compute/v2.1/servers/ada7d07e-42e4-49a3-8e59-d16dee8cb0f0" status: 200 len: 1319 microversion: 2.1 time: 0.909708 Nov 01 18:55:23.684328 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 167/352] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:55:22 2022] GET /compute/v2.1/servers/ada7d07e-42e4-49a3-8e59-d16dee8cb0f0 => generated 1319 bytes in 914 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 18:55:23.705980 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-b0fc62d1-16d6-4cd1-9ca0-73108d465ac4 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:55:23.706697 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-b0fc62d1-16d6-4cd1-9ca0-73108d465ac4 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] [instance: de2ff806-a2fa-4390-b4d5-11ff24dd27ca] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:55:23.718643 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-b0fc62d1-16d6-4cd1-9ca0-73108d465ac4 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:55:23.719417 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-b0fc62d1-16d6-4cd1-9ca0-73108d465ac4 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:55:23.723667 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-b0fc62d1-16d6-4cd1-9ca0-73108d465ac4 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:55:23.724994 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-b0fc62d1-16d6-4cd1-9ca0-73108d465ac4 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:55:23.725661 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-b0fc62d1-16d6-4cd1-9ca0-73108d465ac4 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:55:23.726232 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-b0fc62d1-16d6-4cd1-9ca0-73108d465ac4 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:55:24.153331 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-6ff81150-3565-4feb-9d14-3686dac4fce6 tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07a2a96629f4baea6a3adfc4011ffe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9baf3860ba564f5c8dff93085b9aabe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:55:24.167577 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-6ff81150-3565-4feb-9d14-3686dac4fce6 tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] 10.222.0.13 "GET /compute/v2.1/servers/26132db2-1798-4ba6-88bb-aaf87f6848b3" status: 200 len: 1586 microversion: 2.1 time: 0.895412 Nov 01 18:55:24.171296 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 186/353] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:55:23 2022] GET /compute/v2.1/servers/26132db2-1798-4ba6-88bb-aaf87f6848b3 => generated 1586 bytes in 900 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:55:24.325324 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-b0fc62d1-16d6-4cd1-9ca0-73108d465ac4 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f32f5fba1976432d938e664c7714e52b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b9d4c236b944f9b2e8e502a50a8f8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:55:24.335404 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-b0fc62d1-16d6-4cd1-9ca0-73108d465ac4 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] 10.222.0.13 "GET /compute/v2.1/servers/de2ff806-a2fa-4390-b4d5-11ff24dd27ca" status: 200 len: 1310 microversion: 2.1 time: 0.649852 Nov 01 18:55:24.356718 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 168/354] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:55:23 2022] GET /compute/v2.1/servers/de2ff806-a2fa-4390-b4d5-11ff24dd27ca => generated 1310 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:55:24.370728 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-4c3c080e-2d80-4fa5-a185-746226747875 tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:55:24.372567 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-4c3c080e-2d80-4fa5-a185-746226747875 tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] [instance: 26132db2-1798-4ba6-88bb-aaf87f6848b3] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:55:24.379710 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-4c3c080e-2d80-4fa5-a185-746226747875 tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:55:24.380499 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-4c3c080e-2d80-4fa5-a185-746226747875 tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:55:24.381167 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-4c3c080e-2d80-4fa5-a185-746226747875 tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:55:24.382103 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-4c3c080e-2d80-4fa5-a185-746226747875 tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:55:24.382810 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-4c3c080e-2d80-4fa5-a185-746226747875 tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:55:24.385063 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-4c3c080e-2d80-4fa5-a185-746226747875 tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:55:24.399264 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-f3c3f534-f2c3-43cb-aa0a-dbcc4e3d48ad tempest-KeyPairsV210TestJSON-1905251405 tempest-KeyPairsV210TestJSON-1905251405-project-admin] Action: 'create', calling method: .version_select at 0x7f0ae2db3a60>, body: {"keypair": {"name": "tempest-keypair-1989968781", "type": "ssh", "user_id": "169ef7b83ba341f588fa3b3125924fab", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJxEsq6yVn/79619TnR+jj+jfyNEsZN1SzIFC+YzV2EZQ9UxbjzsXV3AoHNqPwkPZVQpwh3YKsQP9AmIBP97UL9Inoe2jpa4zaGn5ISUtSHBEB7YfGeoxfOvNEmAqlbDjw=="}} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 18:55:24.452428 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.quota [None req-f3c3f534-f2c3-43cb-aa0a-dbcc4e3d48ad tempest-KeyPairsV210TestJSON-1905251405 tempest-KeyPairsV210TestJSON-1905251405-project-admin] Getting quotas for project c647a81b94d44f57822ade672f4bd86c. Resources: {'key_pairs'} {{(pid=121402) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 01 18:55:24.459732 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.quota [None req-f3c3f534-f2c3-43cb-aa0a-dbcc4e3d48ad tempest-KeyPairsV210TestJSON-1905251405 tempest-KeyPairsV210TestJSON-1905251405-project-admin] Getting quotas for user 5ca1c79e92a745b1969a5ec171b4aebe and project c647a81b94d44f57822ade672f4bd86c. Resources: {'key_pairs'} {{(pid=121402) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 01 18:55:24.504076 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-f3c3f534-f2c3-43cb-aa0a-dbcc4e3d48ad tempest-KeyPairsV210TestJSON-1905251405 tempest-KeyPairsV210TestJSON-1905251405-project-admin] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.10 time: 0.331448 Nov 01 18:55:24.505643 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 187/355] 10.222.0.13 () {62 vars in 1200 bytes} [Tue Nov 1 18:55:24 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 334 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Nov 01 18:55:24.519799 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-3c36ad50-6c2d-4d88-ad54-1079cbaea70a tempest-KeyPairsV210TestJSON-1905251405 tempest-KeyPairsV210TestJSON-1905251405-project-admin] Action: 'create', calling method: .version_select at 0x7f0ae2d65550>, body: {"keypair": {"name": "tempest-keypair-2143135287", "type": "ssh", "user_id": "169ef7b83ba341f588fa3b3125924fab", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDDY6Dv6erkReDehWwtdLALvHmBhHmGTCinjdCJRem4fdUSFvVPDlRTv9h8QnGFDSc4ZmYIpYYDiufh26RYUtPN9UTBMCGuHj+W2e6tItJWyRNsTY09XiN/9TSnd5melTA=="}} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 18:55:24.558289 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.quota [None req-3c36ad50-6c2d-4d88-ad54-1079cbaea70a tempest-KeyPairsV210TestJSON-1905251405 tempest-KeyPairsV210TestJSON-1905251405-project-admin] Getting quotas for project c647a81b94d44f57822ade672f4bd86c. Resources: {'key_pairs'} {{(pid=121402) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 01 18:55:24.563230 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.quota [None req-3c36ad50-6c2d-4d88-ad54-1079cbaea70a tempest-KeyPairsV210TestJSON-1905251405 tempest-KeyPairsV210TestJSON-1905251405-project-admin] Getting quotas for user 5ca1c79e92a745b1969a5ec171b4aebe and project c647a81b94d44f57822ade672f4bd86c. Resources: {'key_pairs'} {{(pid=121402) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 01 18:55:24.609040 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-3c36ad50-6c2d-4d88-ad54-1079cbaea70a tempest-KeyPairsV210TestJSON-1905251405 tempest-KeyPairsV210TestJSON-1905251405-project-admin] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.10 time: 0.093964 Nov 01 18:55:24.611245 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 188/356] 10.222.0.13 () {62 vars in 1200 bytes} [Tue Nov 1 18:55:24 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 97 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Nov 01 18:55:24.626459 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-524bb599-815d-4902-b2df-e5768986e64c tempest-KeyPairsV210TestJSON-1905251405 tempest-KeyPairsV210TestJSON-1905251405-project-admin] Calling method '.version_select at 0x7f0ae2cdff70>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:55:24.649510 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-524bb599-815d-4902-b2df-e5768986e64c tempest-KeyPairsV210TestJSON-1905251405 tempest-KeyPairsV210TestJSON-1905251405-project-admin] 10.222.0.13 "GET /compute/v2.1/os-keypairs/tempest-keypair-1989968781?user_id=169ef7b83ba341f588fa3b3125924fab" status: 200 len: 512 microversion: 2.10 time: 0.030226 Nov 01 18:55:24.652221 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 189/357] 10.222.0.13 () {60 vars in 1340 bytes} [Tue Nov 1 18:55:24 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1989968781?user_id=169ef7b83ba341f588fa3b3125924fab => generated 512 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 01 18:55:24.668694 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-ed26ad84-6cdb-40ea-89b1-a02454a1083a tempest-KeyPairsV210TestJSON-1905251405 tempest-KeyPairsV210TestJSON-1905251405-project-admin] Action: 'create', calling method: .version_select at 0x7f0ae2cdfb80>, body: {"keypair": {"name": "tempest-KeyPairsV210TestJSON-keypair-193758865", "type": "ssh", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMkuSGjU8tJdMKSJNQ2sdkqCAVni0Zgz9QXwAtam6NCjLXEUG0VwxQlysfsHoahngHLjwrLAKCuUeaHZRtrTF/h2OfwXbqHcI9vhIqlL8C2IMIL+1hnv2X2A1NaIhkYdsw=="}} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 18:55:24.714027 n-d-863052-2 devstack@n-api.service[121402]: DEBUG dbcounter [-] [121402] Writing DB stats nova_cell0:SELECT=2 {{(pid=121402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 18:55:24.714898 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.quota [None req-ed26ad84-6cdb-40ea-89b1-a02454a1083a tempest-KeyPairsV210TestJSON-1905251405 tempest-KeyPairsV210TestJSON-1905251405-project-admin] Getting quotas for project c647a81b94d44f57822ade672f4bd86c. Resources: {'key_pairs'} {{(pid=121402) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 01 18:55:24.730936 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.quota [None req-ed26ad84-6cdb-40ea-89b1-a02454a1083a tempest-KeyPairsV210TestJSON-1905251405 tempest-KeyPairsV210TestJSON-1905251405-project-admin] Getting quotas for user 5ca1c79e92a745b1969a5ec171b4aebe and project c647a81b94d44f57822ade672f4bd86c. Resources: {'key_pairs'} {{(pid=121402) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 01 18:55:24.794055 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-ed26ad84-6cdb-40ea-89b1-a02454a1083a tempest-KeyPairsV210TestJSON-1905251405 tempest-KeyPairsV210TestJSON-1905251405-project-admin] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 201 len: 421 microversion: 2.10 time: 0.131833 Nov 01 18:55:24.795744 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 190/358] 10.222.0.13 () {62 vars in 1200 bytes} [Tue Nov 1 18:55:24 2022] POST /compute/v2.1/os-keypairs => generated 421 bytes in 135 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Nov 01 18:55:24.812967 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-2f1dac01-cd9d-4815-bfb2-bf48b0a76980 tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:55:24.814951 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-2f1dac01-cd9d-4815-bfb2-bf48b0a76980 tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] [instance: ada7d07e-42e4-49a3-8e59-d16dee8cb0f0] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:55:24.828731 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2f1dac01-cd9d-4815-bfb2-bf48b0a76980 tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:55:24.830758 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2f1dac01-cd9d-4815-bfb2-bf48b0a76980 tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:55:24.833153 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2f1dac01-cd9d-4815-bfb2-bf48b0a76980 tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:55:24.834224 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2f1dac01-cd9d-4815-bfb2-bf48b0a76980 tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:55:24.836156 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-4c3c080e-2d80-4fa5-a185-746226747875 tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] 10.222.0.13 "GET /compute/v2.1/servers/26132db2-1798-4ba6-88bb-aaf87f6848b3/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.476073 Nov 01 18:55:24.836861 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2f1dac01-cd9d-4815-bfb2-bf48b0a76980 tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:55:24.837397 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2f1dac01-cd9d-4815-bfb2-bf48b0a76980 tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:55:24.845471 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 169/359] 10.222.0.13 () {58 vars in 1275 bytes} [Tue Nov 1 18:55:24 2022] GET /compute/v2.1/servers/26132db2-1798-4ba6-88bb-aaf87f6848b3/os-interface => generated 284 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 18:55:24.852307 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-333c319a-ca1a-4292-8633-42601a40986b tempest-KeyPairsV210TestJSON-1905251405 tempest-KeyPairsV210TestJSON-1905251405-project-admin] Calling method '.version_select at 0x7f0ae2e02e50>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:55:24.858416 n-d-863052-2 devstack@n-api.service[121403]: WARNING oslo_db.sqlalchemy.utils [None req-333c319a-ca1a-4292-8633-42601a40986b tempest-KeyPairsV210TestJSON-1905251405 tempest-KeyPairsV210TestJSON-1905251405-project-admin] Unique keys not in sort_keys. The sorting order may be unstable. Nov 01 18:55:24.870562 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-333c319a-ca1a-4292-8633-42601a40986b tempest-KeyPairsV210TestJSON-1905251405 tempest-KeyPairsV210TestJSON-1905251405-project-admin] 10.222.0.13 "GET /compute/v2.1/os-keypairs?user_id=169ef7b83ba341f588fa3b3125924fab" status: 200 len: 726 microversion: 2.10 time: 0.022826 Nov 01 18:55:24.871869 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 170/360] 10.222.0.13 () {60 vars in 1259 bytes} [Tue Nov 1 18:55:24 2022] GET /compute/v2.1/os-keypairs?user_id=169ef7b83ba341f588fa3b3125924fab => generated 726 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 01 18:55:24.890930 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-def073d6-c88e-4f90-b6cc-be5c64ffdd4f tempest-KeyPairsV210TestJSON-1905251405 tempest-KeyPairsV210TestJSON-1905251405-project-admin] Calling method '.version_select at 0x7f0ae3072790>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:55:24.941979 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-def073d6-c88e-4f90-b6cc-be5c64ffdd4f tempest-KeyPairsV210TestJSON-1905251405 tempest-KeyPairsV210TestJSON-1905251405-project-admin] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-193758865" status: 204 len: 0 microversion: 2.10 time: 0.059376 Nov 01 18:55:24.943523 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 171/361] 10.222.0.13 () {60 vars in 1322 bytes} [Tue Nov 1 18:55:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-193758865 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 01 18:55:24.951698 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-ee090d7c-d99d-4995-9703-649584599487 tempest-KeyPairsV210TestJSON-1905251405 tempest-KeyPairsV210TestJSON-1905251405-project-admin] Calling method '.version_select at 0x7f0ae3005040>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:55:24.990280 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-ee090d7c-d99d-4995-9703-649584599487 tempest-KeyPairsV210TestJSON-1905251405 tempest-KeyPairsV210TestJSON-1905251405-project-admin] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2143135287?user_id=169ef7b83ba341f588fa3b3125924fab" status: 204 len: 0 microversion: 2.10 time: 0.042141 Nov 01 18:55:24.991121 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 172/362] 10.222.0.13 () {60 vars in 1343 bytes} [Tue Nov 1 18:55:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2143135287?user_id=169ef7b83ba341f588fa3b3125924fab => generated 0 bytes in 43 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Nov 01 18:55:24.999132 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-aafc3655-2229-4768-a28a-7606e5bf250a tempest-KeyPairsV210TestJSON-1905251405 tempest-KeyPairsV210TestJSON-1905251405-project-admin] Calling method '.version_select at 0x7f0ae2e023a0>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:55:25.040816 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-aafc3655-2229-4768-a28a-7606e5bf250a tempest-KeyPairsV210TestJSON-1905251405 tempest-KeyPairsV210TestJSON-1905251405-project-admin] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1989968781?user_id=169ef7b83ba341f588fa3b3125924fab" status: 204 len: 0 microversion: 2.10 time: 0.045200 Nov 01 18:55:25.041702 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 173/363] 10.222.0.13 () {60 vars in 1343 bytes} [Tue Nov 1 18:55:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1989968781?user_id=169ef7b83ba341f588fa3b3125924fab => generated 0 bytes in 47 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Nov 01 18:55:25.265875 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-2f1dac01-cd9d-4815-bfb2-bf48b0a76980 tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce2e0d1828674809a3344a7a68f375c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8e1248497284006a7acbb8169627ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:55:25.277556 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-2f1dac01-cd9d-4815-bfb2-bf48b0a76980 tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] 10.222.0.13 "GET /compute/v2.1/servers/ada7d07e-42e4-49a3-8e59-d16dee8cb0f0" status: 200 len: 1319 microversion: 2.1 time: 0.479996 Nov 01 18:55:25.281082 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 191/364] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:55:24 2022] GET /compute/v2.1/servers/ada7d07e-42e4-49a3-8e59-d16dee8cb0f0 => generated 1319 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:55:25.364400 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-36e0608c-99dd-4110-a156-e175eda98674 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:55:25.366384 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-36e0608c-99dd-4110-a156-e175eda98674 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] [instance: de2ff806-a2fa-4390-b4d5-11ff24dd27ca] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:55:25.397488 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-36e0608c-99dd-4110-a156-e175eda98674 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:55:25.401905 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-36e0608c-99dd-4110-a156-e175eda98674 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:55:25.402763 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-36e0608c-99dd-4110-a156-e175eda98674 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:55:25.403650 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-36e0608c-99dd-4110-a156-e175eda98674 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:55:25.404812 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-36e0608c-99dd-4110-a156-e175eda98674 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:55:25.407146 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-36e0608c-99dd-4110-a156-e175eda98674 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:55:26.305982 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-fff70b3f-e07c-431e-935b-c57209b53d43 tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:55:26.306842 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-fff70b3f-e07c-431e-935b-c57209b53d43 tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] [instance: ada7d07e-42e4-49a3-8e59-d16dee8cb0f0] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:55:26.324099 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-fff70b3f-e07c-431e-935b-c57209b53d43 tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:55:26.324656 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-fff70b3f-e07c-431e-935b-c57209b53d43 tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:55:26.325091 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-fff70b3f-e07c-431e-935b-c57209b53d43 tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:55:26.330966 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-fff70b3f-e07c-431e-935b-c57209b53d43 tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:55:26.331484 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-fff70b3f-e07c-431e-935b-c57209b53d43 tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:55:26.331943 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-fff70b3f-e07c-431e-935b-c57209b53d43 tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:55:26.510763 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-36e0608c-99dd-4110-a156-e175eda98674 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f32f5fba1976432d938e664c7714e52b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b9d4c236b944f9b2e8e502a50a8f8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:55:26.524130 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-36e0608c-99dd-4110-a156-e175eda98674 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] 10.222.0.13 "GET /compute/v2.1/servers/de2ff806-a2fa-4390-b4d5-11ff24dd27ca" status: 200 len: 1310 microversion: 2.1 time: 1.161504 Nov 01 18:55:26.539926 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 174/365] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:55:25 2022] GET /compute/v2.1/servers/de2ff806-a2fa-4390-b4d5-11ff24dd27ca => generated 1310 bytes in 1181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:55:26.692826 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-fff70b3f-e07c-431e-935b-c57209b53d43 tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce2e0d1828674809a3344a7a68f375c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8e1248497284006a7acbb8169627ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:55:26.710876 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-fff70b3f-e07c-431e-935b-c57209b53d43 tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] 10.222.0.13 "GET /compute/v2.1/servers/ada7d07e-42e4-49a3-8e59-d16dee8cb0f0" status: 200 len: 1469 microversion: 2.1 time: 0.409789 Nov 01 18:55:26.713638 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 192/366] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:55:26 2022] GET /compute/v2.1/servers/ada7d07e-42e4-49a3-8e59-d16dee8cb0f0 => generated 1469 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:55:26.738039 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-736effed-6e4b-4ba5-a80e-f47b15734547 tempest-DeleteServersAdminTestJSON-282148072 tempest-DeleteServersAdminTestJSON-282148072-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 18:55:26.741051 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-736effed-6e4b-4ba5-a80e-f47b15734547 tempest-DeleteServersAdminTestJSON-282148072 tempest-DeleteServersAdminTestJSON-282148072-project-admin] [instance: ada7d07e-42e4-49a3-8e59-d16dee8cb0f0] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:55:26.760032 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-736effed-6e4b-4ba5-a80e-f47b15734547 tempest-DeleteServersAdminTestJSON-282148072 tempest-DeleteServersAdminTestJSON-282148072-project-admin] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:55:26.763912 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-736effed-6e4b-4ba5-a80e-f47b15734547 tempest-DeleteServersAdminTestJSON-282148072 tempest-DeleteServersAdminTestJSON-282148072-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:55:26.765654 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-736effed-6e4b-4ba5-a80e-f47b15734547 tempest-DeleteServersAdminTestJSON-282148072 tempest-DeleteServersAdminTestJSON-282148072-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:55:26.769562 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-736effed-6e4b-4ba5-a80e-f47b15734547 tempest-DeleteServersAdminTestJSON-282148072 tempest-DeleteServersAdminTestJSON-282148072-project-admin] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:55:26.771333 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-736effed-6e4b-4ba5-a80e-f47b15734547 tempest-DeleteServersAdminTestJSON-282148072 tempest-DeleteServersAdminTestJSON-282148072-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:55:26.773201 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-736effed-6e4b-4ba5-a80e-f47b15734547 tempest-DeleteServersAdminTestJSON-282148072 tempest-DeleteServersAdminTestJSON-282148072-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:55:27.158504 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-736effed-6e4b-4ba5-a80e-f47b15734547 tempest-DeleteServersAdminTestJSON-282148072 tempest-DeleteServersAdminTestJSON-282148072-project-admin] 10.222.0.13 "POST /compute/v2.1/servers/ada7d07e-42e4-49a3-8e59-d16dee8cb0f0/action" status: 202 len: 0 microversion: 2.1 time: 0.424740 Nov 01 18:55:27.161136 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 175/367] 10.222.0.13 () {60 vars in 1278 bytes} [Tue Nov 1 18:55:26 2022] POST /compute/v2.1/servers/ada7d07e-42e4-49a3-8e59-d16dee8cb0f0/action => generated 0 bytes in 428 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 01 18:55:27.168126 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-8a7af65c-961c-4627-b7fe-066219ef1b6b tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:55:27.168776 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-8a7af65c-961c-4627-b7fe-066219ef1b6b tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] [instance: ada7d07e-42e4-49a3-8e59-d16dee8cb0f0] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:55:27.183973 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-8a7af65c-961c-4627-b7fe-066219ef1b6b tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:55:27.184477 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-8a7af65c-961c-4627-b7fe-066219ef1b6b tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:55:27.184943 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-8a7af65c-961c-4627-b7fe-066219ef1b6b tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:55:27.191321 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-8a7af65c-961c-4627-b7fe-066219ef1b6b tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:55:27.197644 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-8a7af65c-961c-4627-b7fe-066219ef1b6b tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:55:27.202443 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-8a7af65c-961c-4627-b7fe-066219ef1b6b tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:55:27.282371 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-8a7af65c-961c-4627-b7fe-066219ef1b6b tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:55:27.284027 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-8a7af65c-961c-4627-b7fe-066219ef1b6b tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:55:27.287204 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-8a7af65c-961c-4627-b7fe-066219ef1b6b tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:55:27.292554 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.objects.instance [None req-8a7af65c-961c-4627-b7fe-066219ef1b6b tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Lazy-loading 'fault' on Instance uuid ada7d07e-42e4-49a3-8e59-d16dee8cb0f0 {{(pid=121402) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 01 18:55:27.551824 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-8dbfc9cb-d408-4f47-bc9b-a8133576ced1 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:55:27.553105 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-8dbfc9cb-d408-4f47-bc9b-a8133576ced1 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] [instance: de2ff806-a2fa-4390-b4d5-11ff24dd27ca] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:55:27.564987 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-8a7af65c-961c-4627-b7fe-066219ef1b6b tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce2e0d1828674809a3344a7a68f375c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8e1248497284006a7acbb8169627ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:55:27.579811 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-8dbfc9cb-d408-4f47-bc9b-a8133576ced1 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:55:27.580383 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-8dbfc9cb-d408-4f47-bc9b-a8133576ced1 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:55:27.580852 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-8dbfc9cb-d408-4f47-bc9b-a8133576ced1 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:55:27.587768 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-8a7af65c-961c-4627-b7fe-066219ef1b6b tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] 10.222.0.13 "GET /compute/v2.1/servers/ada7d07e-42e4-49a3-8e59-d16dee8cb0f0" status: 200 len: 1452 microversion: 2.1 time: 0.424047 Nov 01 18:55:27.588848 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-8dbfc9cb-d408-4f47-bc9b-a8133576ced1 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:55:27.590346 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-8dbfc9cb-d408-4f47-bc9b-a8133576ced1 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:55:27.591242 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-8dbfc9cb-d408-4f47-bc9b-a8133576ced1 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:55:27.594691 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 193/368] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:55:27 2022] GET /compute/v2.1/servers/ada7d07e-42e4-49a3-8e59-d16dee8cb0f0 => generated 1452 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:55:27.624369 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-2bce0006-94a3-46fa-8ee8-82e5207eda1d tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:55:27.625192 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-2bce0006-94a3-46fa-8ee8-82e5207eda1d tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] [instance: ada7d07e-42e4-49a3-8e59-d16dee8cb0f0] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:55:27.637882 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2bce0006-94a3-46fa-8ee8-82e5207eda1d tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:55:27.641964 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2bce0006-94a3-46fa-8ee8-82e5207eda1d tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:55:27.645204 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2bce0006-94a3-46fa-8ee8-82e5207eda1d tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:55:27.646056 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2bce0006-94a3-46fa-8ee8-82e5207eda1d tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:55:27.646598 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2bce0006-94a3-46fa-8ee8-82e5207eda1d tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:55:27.647403 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2bce0006-94a3-46fa-8ee8-82e5207eda1d tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:55:27.718842 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-2bce0006-94a3-46fa-8ee8-82e5207eda1d tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] [instance: ada7d07e-42e4-49a3-8e59-d16dee8cb0f0] Going to try to terminate instance {{(pid=121402) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 01 18:55:27.908002 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-2bce0006-94a3-46fa-8ee8-82e5207eda1d tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] 10.222.0.13 "DELETE /compute/v2.1/servers/ada7d07e-42e4-49a3-8e59-d16dee8cb0f0" status: 204 len: 0 microversion: 2.1 time: 0.293245 Nov 01 18:55:27.908837 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 194/369] 10.222.0.13 () {58 vars in 1239 bytes} [Tue Nov 1 18:55:27 2022] DELETE /compute/v2.1/servers/ada7d07e-42e4-49a3-8e59-d16dee8cb0f0 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 01 18:55:27.918898 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-efded5fe-09f0-4f42-a797-c54a485d85dc tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:55:27.919840 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-efded5fe-09f0-4f42-a797-c54a485d85dc tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] [instance: ada7d07e-42e4-49a3-8e59-d16dee8cb0f0] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:55:27.927523 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-efded5fe-09f0-4f42-a797-c54a485d85dc tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:55:27.933374 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-efded5fe-09f0-4f42-a797-c54a485d85dc tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:55:27.934033 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-efded5fe-09f0-4f42-a797-c54a485d85dc tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:55:27.935288 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-efded5fe-09f0-4f42-a797-c54a485d85dc tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:55:27.935921 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-efded5fe-09f0-4f42-a797-c54a485d85dc tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:55:27.936500 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-efded5fe-09f0-4f42-a797-c54a485d85dc tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:55:27.966098 n-d-863052-2 devstack@n-api.service[121402]: DEBUG dbcounter [-] [121402] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 18:55:27.982789 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-efded5fe-09f0-4f42-a797-c54a485d85dc tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:55:27.983677 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-efded5fe-09f0-4f42-a797-c54a485d85dc tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:55:27.984549 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-efded5fe-09f0-4f42-a797-c54a485d85dc tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:55:27.985301 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.objects.instance [None req-efded5fe-09f0-4f42-a797-c54a485d85dc tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Lazy-loading 'fault' on Instance uuid ada7d07e-42e4-49a3-8e59-d16dee8cb0f0 {{(pid=121402) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 01 18:55:28.271184 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-efded5fe-09f0-4f42-a797-c54a485d85dc tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce2e0d1828674809a3344a7a68f375c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8e1248497284006a7acbb8169627ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:55:28.285078 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-efded5fe-09f0-4f42-a797-c54a485d85dc tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] 10.222.0.13 "GET /compute/v2.1/servers/ada7d07e-42e4-49a3-8e59-d16dee8cb0f0" status: 200 len: 1458 microversion: 2.1 time: 0.371098 Nov 01 18:55:28.288397 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 195/370] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:55:27 2022] GET /compute/v2.1/servers/ada7d07e-42e4-49a3-8e59-d16dee8cb0f0 => generated 1458 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:55:28.558570 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-ead2dd87-dd1d-4f7d-b539-31c18d4abcd8 tempest-InstanceUsageAuditLogTestJSON-774381639 tempest-InstanceUsageAuditLogTestJSON-774381639-project-admin] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:55:28.622653 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-ead2dd87-dd1d-4f7d-b539-31c18d4abcd8 tempest-InstanceUsageAuditLogTestJSON-774381639 tempest-InstanceUsageAuditLogTestJSON-774381639-project-admin] 10.222.0.13 "GET /compute/v2.1/os-instance_usage_audit_log/2022-11-01 18:55:28" status: 200 len: 318 microversion: 2.1 time: 0.274076 Nov 01 18:55:28.625047 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 196/371] 10.222.0.13 () {58 vars in 1251 bytes} [Tue Nov 1 18:55:28 2022] GET /compute/v2.1/os-instance_usage_audit_log/2022-11-01%2018%3A55%3A28 => generated 318 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 18:55:28.641837 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-20c567a6-72e2-4460-be8f-b9fceeb79298 tempest-InstanceUsageAuditLogTestJSON-774381639 tempest-InstanceUsageAuditLogTestJSON-774381639-project-admin] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:55:28.687008 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-20c567a6-72e2-4460-be8f-b9fceeb79298 tempest-InstanceUsageAuditLogTestJSON-774381639 tempest-InstanceUsageAuditLogTestJSON-774381639-project-admin] 10.222.0.13 "GET /compute/v2.1/os-instance_usage_audit_log" status: 200 len: 319 microversion: 2.1 time: 0.052061 Nov 01 18:55:28.689269 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 197/372] 10.222.0.13 () {58 vars in 1185 bytes} [Tue Nov 1 18:55:28 2022] GET /compute/v2.1/os-instance_usage_audit_log => generated 319 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 18:55:28.697213 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-8dbfc9cb-d408-4f47-bc9b-a8133576ced1 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f32f5fba1976432d938e664c7714e52b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b9d4c236b944f9b2e8e502a50a8f8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:55:28.705752 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-8dbfc9cb-d408-4f47-bc9b-a8133576ced1 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] 10.222.0.13 "GET /compute/v2.1/servers/de2ff806-a2fa-4390-b4d5-11ff24dd27ca" status: 200 len: 1310 microversion: 2.1 time: 1.157665 Nov 01 18:55:28.711580 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 176/373] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:55:27 2022] GET /compute/v2.1/servers/de2ff806-a2fa-4390-b4d5-11ff24dd27ca => generated 1310 bytes in 1164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:55:29.312408 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-36a6dbbd-fb6b-4759-b390-ea50292395cb tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:55:29.313605 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-36a6dbbd-fb6b-4759-b390-ea50292395cb tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] [instance: ada7d07e-42e4-49a3-8e59-d16dee8cb0f0] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:55:29.328492 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-36a6dbbd-fb6b-4759-b390-ea50292395cb tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:55:29.330942 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-36a6dbbd-fb6b-4759-b390-ea50292395cb tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:55:29.332556 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-36a6dbbd-fb6b-4759-b390-ea50292395cb tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:55:29.334686 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-36a6dbbd-fb6b-4759-b390-ea50292395cb tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:55:29.336829 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-36a6dbbd-fb6b-4759-b390-ea50292395cb tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:55:29.337486 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-36a6dbbd-fb6b-4759-b390-ea50292395cb tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:55:29.446985 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-36a6dbbd-fb6b-4759-b390-ea50292395cb tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:55:29.447474 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-36a6dbbd-fb6b-4759-b390-ea50292395cb tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:55:29.447903 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-36a6dbbd-fb6b-4759-b390-ea50292395cb tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:55:29.448366 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.objects.instance [None req-36a6dbbd-fb6b-4759-b390-ea50292395cb tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Lazy-loading 'fault' on Instance uuid ada7d07e-42e4-49a3-8e59-d16dee8cb0f0 {{(pid=121402) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 01 18:55:29.709979 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-36a6dbbd-fb6b-4759-b390-ea50292395cb tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce2e0d1828674809a3344a7a68f375c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8e1248497284006a7acbb8169627ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:55:29.720139 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-36a6dbbd-fb6b-4759-b390-ea50292395cb tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] 10.222.0.13 "GET /compute/v2.1/servers/ada7d07e-42e4-49a3-8e59-d16dee8cb0f0" status: 200 len: 1458 microversion: 2.1 time: 0.413724 Nov 01 18:55:29.725474 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 198/374] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:55:29 2022] GET /compute/v2.1/servers/ada7d07e-42e4-49a3-8e59-d16dee8cb0f0 => generated 1458 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:55:29.749173 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-a51e4715-f56f-490c-b840-4fdda315096a tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:55:29.750405 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-a51e4715-f56f-490c-b840-4fdda315096a tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] [instance: de2ff806-a2fa-4390-b4d5-11ff24dd27ca] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:55:29.768407 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-a51e4715-f56f-490c-b840-4fdda315096a tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:55:29.770605 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-a51e4715-f56f-490c-b840-4fdda315096a tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:55:29.771246 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-a51e4715-f56f-490c-b840-4fdda315096a tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:55:29.774766 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-a51e4715-f56f-490c-b840-4fdda315096a tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:55:29.775430 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-a51e4715-f56f-490c-b840-4fdda315096a tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:55:29.776975 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-a51e4715-f56f-490c-b840-4fdda315096a tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:55:29.941180 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-c1e0bb0c-221a-47e9-b780-9ea9e7f0df96 tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:55:29.942023 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-c1e0bb0c-221a-47e9-b780-9ea9e7f0df96 tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] [instance: 26132db2-1798-4ba6-88bb-aaf87f6848b3] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:55:29.953414 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-c1e0bb0c-221a-47e9-b780-9ea9e7f0df96 tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:55:29.955386 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-c1e0bb0c-221a-47e9-b780-9ea9e7f0df96 tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:55:29.955848 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-c1e0bb0c-221a-47e9-b780-9ea9e7f0df96 tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:55:29.969439 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-c1e0bb0c-221a-47e9-b780-9ea9e7f0df96 tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:55:29.969962 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-c1e0bb0c-221a-47e9-b780-9ea9e7f0df96 tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:55:29.970413 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-c1e0bb0c-221a-47e9-b780-9ea9e7f0df96 tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:55:30.451808 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-c1e0bb0c-221a-47e9-b780-9ea9e7f0df96 tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07a2a96629f4baea6a3adfc4011ffe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9baf3860ba564f5c8dff93085b9aabe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:55:30.462147 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-c1e0bb0c-221a-47e9-b780-9ea9e7f0df96 tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] 10.222.0.13 "GET /compute/v2.1/servers/26132db2-1798-4ba6-88bb-aaf87f6848b3" status: 200 len: 1586 microversion: 2.1 time: 0.527690 Nov 01 18:55:30.469697 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 199/375] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:55:29 2022] GET /compute/v2.1/servers/26132db2-1798-4ba6-88bb-aaf87f6848b3 => generated 1586 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 18:55:30.479286 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [req-1df8c05d-f1f7-451f-8354-eb1a745bdb6e req-5af4309a-a248-4e00-b69e-599bf7e443cf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ada7d07e-42e4-49a3-8e59-d16dee8cb0f0", "name": "network-vif-deleted", "tag": "dc725968-cc56-440f-a6f5-163832220fd5"}]} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 18:55:30.511303 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-1df8c05d-f1f7-451f-8354-eb1a745bdb6e req-5af4309a-a248-4e00-b69e-599bf7e443cf service nova] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:55:30.511781 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-1df8c05d-f1f7-451f-8354-eb1a745bdb6e req-5af4309a-a248-4e00-b69e-599bf7e443cf service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:55:30.514500 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-1df8c05d-f1f7-451f-8354-eb1a745bdb6e req-5af4309a-a248-4e00-b69e-599bf7e443cf service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:55:30.574367 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.compute.server_external_events [req-1df8c05d-f1f7-451f-8354-eb1a745bdb6e req-5af4309a-a248-4e00-b69e-599bf7e443cf service nova] Creating event network-vif-deleted:dc725968-cc56-440f-a6f5-163832220fd5 for instance ada7d07e-42e4-49a3-8e59-d16dee8cb0f0 on n-h1-863052-2 Nov 01 18:55:30.592377 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [req-1df8c05d-f1f7-451f-8354-eb1a745bdb6e req-5af4309a-a248-4e00-b69e-599bf7e443cf service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.121181 Nov 01 18:55:30.595871 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 200/376] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Nov 1 18:55:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 18:55:30.608243 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [req-21ec755d-c312-4668-b1c7-0e099ed89456 req-0b34c3ad-2141-41ec-9743-39a65eef154f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "de2ff806-a2fa-4390-b4d5-11ff24dd27ca", "name": "network-vif-plugged", "status": "completed", "tag": "4157a71a-6529-42b5-9194-408c1d22d219"}]} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 18:55:30.635191 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-21ec755d-c312-4668-b1c7-0e099ed89456 req-0b34c3ad-2141-41ec-9743-39a65eef154f service nova] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:55:30.635673 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-21ec755d-c312-4668-b1c7-0e099ed89456 req-0b34c3ad-2141-41ec-9743-39a65eef154f service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:55:30.640169 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-21ec755d-c312-4668-b1c7-0e099ed89456 req-0b34c3ad-2141-41ec-9743-39a65eef154f service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:55:30.690018 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.compute.server_external_events [req-21ec755d-c312-4668-b1c7-0e099ed89456 req-0b34c3ad-2141-41ec-9743-39a65eef154f service nova] Creating event network-vif-plugged:4157a71a-6529-42b5-9194-408c1d22d219 for instance de2ff806-a2fa-4390-b4d5-11ff24dd27ca on n-h1-863052-2 Nov 01 18:55:30.713117 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [req-21ec755d-c312-4668-b1c7-0e099ed89456 req-0b34c3ad-2141-41ec-9743-39a65eef154f service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.110881 Nov 01 18:55:30.717127 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 201/377] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Nov 1 18:55:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 18:55:30.850232 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-a51e4715-f56f-490c-b840-4fdda315096a tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f32f5fba1976432d938e664c7714e52b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b9d4c236b944f9b2e8e502a50a8f8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:55:30.866110 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-a51e4715-f56f-490c-b840-4fdda315096a tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] 10.222.0.13 "GET /compute/v2.1/servers/de2ff806-a2fa-4390-b4d5-11ff24dd27ca" status: 200 len: 1310 microversion: 2.1 time: 1.129301 Nov 01 18:55:30.866685 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 177/378] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:55:29 2022] GET /compute/v2.1/servers/de2ff806-a2fa-4390-b4d5-11ff24dd27ca => generated 1310 bytes in 1131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:55:30.882413 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-f5aa11b2-bd38-496c-8f69-0e39d814ea0b tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:55:30.883824 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-f5aa11b2-bd38-496c-8f69-0e39d814ea0b tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] [instance: ada7d07e-42e4-49a3-8e59-d16dee8cb0f0] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:55:30.906715 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f5aa11b2-bd38-496c-8f69-0e39d814ea0b tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:55:30.911819 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f5aa11b2-bd38-496c-8f69-0e39d814ea0b tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:55:30.915056 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f5aa11b2-bd38-496c-8f69-0e39d814ea0b tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:55:30.915940 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f5aa11b2-bd38-496c-8f69-0e39d814ea0b tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:55:30.920087 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f5aa11b2-bd38-496c-8f69-0e39d814ea0b tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:55:30.920673 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f5aa11b2-bd38-496c-8f69-0e39d814ea0b tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:55:31.030770 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f5aa11b2-bd38-496c-8f69-0e39d814ea0b tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:55:31.031604 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f5aa11b2-bd38-496c-8f69-0e39d814ea0b tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:55:31.032259 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f5aa11b2-bd38-496c-8f69-0e39d814ea0b tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:55:31.033131 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.objects.instance [None req-f5aa11b2-bd38-496c-8f69-0e39d814ea0b tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Lazy-loading 'fault' on Instance uuid ada7d07e-42e4-49a3-8e59-d16dee8cb0f0 {{(pid=121403) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 01 18:55:31.039543 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [req-a140a226-b0a6-44f2-a64b-be154501563b req-8fe2cf98-0612-43f7-9c3f-bddfcb9e8e56 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "26132db2-1798-4ba6-88bb-aaf87f6848b3", "tag": "9bb445f8-37ab-49c7-9c66-0066ff9683cc"}]} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 18:55:31.095175 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-a140a226-b0a6-44f2-a64b-be154501563b req-8fe2cf98-0612-43f7-9c3f-bddfcb9e8e56 service nova] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:55:31.095542 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-a140a226-b0a6-44f2-a64b-be154501563b req-8fe2cf98-0612-43f7-9c3f-bddfcb9e8e56 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:55:31.096152 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-a140a226-b0a6-44f2-a64b-be154501563b req-8fe2cf98-0612-43f7-9c3f-bddfcb9e8e56 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:55:31.126726 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.compute.server_external_events [req-a140a226-b0a6-44f2-a64b-be154501563b req-8fe2cf98-0612-43f7-9c3f-bddfcb9e8e56 service nova] Creating event network-changed:9bb445f8-37ab-49c7-9c66-0066ff9683cc for instance 26132db2-1798-4ba6-88bb-aaf87f6848b3 on n-h2-863052-2 Nov 01 18:55:31.136258 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [req-a140a226-b0a6-44f2-a64b-be154501563b req-8fe2cf98-0612-43f7-9c3f-bddfcb9e8e56 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.415734 Nov 01 18:55:31.139026 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 202/379] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Nov 1 18:55:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 18:55:31.430625 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-f5aa11b2-bd38-496c-8f69-0e39d814ea0b tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce2e0d1828674809a3344a7a68f375c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8e1248497284006a7acbb8169627ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:55:31.439432 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-f5aa11b2-bd38-496c-8f69-0e39d814ea0b tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] 10.222.0.13 "GET /compute/v2.1/servers/ada7d07e-42e4-49a3-8e59-d16dee8cb0f0" status: 200 len: 1309 microversion: 2.1 time: 0.570899 Nov 01 18:55:31.447553 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 178/380] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:55:30 2022] GET /compute/v2.1/servers/ada7d07e-42e4-49a3-8e59-d16dee8cb0f0 => generated 1309 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:55:31.894722 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-b5537a23-7438-4b6b-b3bc-ee274858d930 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:55:31.896062 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-b5537a23-7438-4b6b-b3bc-ee274858d930 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] [instance: de2ff806-a2fa-4390-b4d5-11ff24dd27ca] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:55:31.911331 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b5537a23-7438-4b6b-b3bc-ee274858d930 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:55:31.914286 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b5537a23-7438-4b6b-b3bc-ee274858d930 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:55:31.915059 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b5537a23-7438-4b6b-b3bc-ee274858d930 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:55:31.916067 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b5537a23-7438-4b6b-b3bc-ee274858d930 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:55:31.916786 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b5537a23-7438-4b6b-b3bc-ee274858d930 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:55:31.917438 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b5537a23-7438-4b6b-b3bc-ee274858d930 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:55:32.459464 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-b5537a23-7438-4b6b-b3bc-ee274858d930 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f32f5fba1976432d938e664c7714e52b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b9d4c236b944f9b2e8e502a50a8f8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:55:32.472606 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-b5537a23-7438-4b6b-b3bc-ee274858d930 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] 10.222.0.13 "GET /compute/v2.1/servers/de2ff806-a2fa-4390-b4d5-11ff24dd27ca" status: 200 len: 1310 microversion: 2.1 time: 0.584332 Nov 01 18:55:32.473932 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-162df353-5be6-4a86-a9e4-77c08f88583c tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:55:32.474652 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-162df353-5be6-4a86-a9e4-77c08f88583c tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] [instance: ada7d07e-42e4-49a3-8e59-d16dee8cb0f0] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:55:32.475429 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 203/381] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:55:31 2022] GET /compute/v2.1/servers/de2ff806-a2fa-4390-b4d5-11ff24dd27ca => generated 1310 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:55:32.486499 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-162df353-5be6-4a86-a9e4-77c08f88583c tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:55:32.487605 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-162df353-5be6-4a86-a9e4-77c08f88583c tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:55:32.488408 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-162df353-5be6-4a86-a9e4-77c08f88583c tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:55:32.489815 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-162df353-5be6-4a86-a9e4-77c08f88583c tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:55:32.490657 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-162df353-5be6-4a86-a9e4-77c08f88583c tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:55:32.491430 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-162df353-5be6-4a86-a9e4-77c08f88583c tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:55:32.526797 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.wsgi [None req-162df353-5be6-4a86-a9e4-77c08f88583c tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] HTTP exception thrown: Instance ada7d07e-42e4-49a3-8e59-d16dee8cb0f0 could not be found. Nov 01 18:55:32.530262 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-162df353-5be6-4a86-a9e4-77c08f88583c tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Request method failure captured: Nov 01 18:55:32.530262 n-d-863052-2 devstack@n-api.service[121403]: request: GET /compute/v2.1/servers/ada7d07e-42e4-49a3-8e59-d16dee8cb0f0 HTTP/1.1 Nov 01 18:55:32.530262 n-d-863052-2 devstack@n-api.service[121403]: Accept: application/json Nov 01 18:55:32.530262 n-d-863052-2 devstack@n-api.service[121403]: Accept-Encoding: identity Nov 01 18:55:32.530262 n-d-863052-2 devstack@n-api.service[121403]: Connection: close Nov 01 18:55:32.530262 n-d-863052-2 devstack@n-api.service[121403]: Content-Length: 0 Nov 01 18:55:32.530262 n-d-863052-2 devstack@n-api.service[121403]: Content-Type: application/json Nov 01 18:55:32.530262 n-d-863052-2 devstack@n-api.service[121403]: Host: 10.222.0.13 Nov 01 18:55:32.530262 n-d-863052-2 devstack@n-api.service[121403]: Openstack-System-Scope: None Nov 01 18:55:32.530262 n-d-863052-2 devstack@n-api.service[121403]: User-Agent: python-urllib3/1.26.12 Nov 01 18:55:32.530262 n-d-863052-2 devstack@n-api.service[121403]: X-Auth-Token: gAAAAABjYWtYDQwdAak_LjSmdo26bmKvpWtv73rP8cG6S9cMNmWfs8LwYmpnAj7Ol9mmIwvJVFGihix85N_khX1wVu6qw6bw-56m6Mp9CQTu5Az6nunubYmH0HGLQV25fRJm8xBu_cIiDsr_617cASQvaowfLvvLes1yddcCUl8oNjqt7aPNvls Nov 01 18:55:32.530262 n-d-863052-2 devstack@n-api.service[121403]: X-Domain-Id: None Nov 01 18:55:32.530262 n-d-863052-2 devstack@n-api.service[121403]: X-Domain-Name: None Nov 01 18:55:32.530262 n-d-863052-2 devstack@n-api.service[121403]: X-Identity-Status: Confirmed Nov 01 18:55:32.530262 n-d-863052-2 devstack@n-api.service[121403]: X-Is-Admin-Project: True Nov 01 18:55:32.530262 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Domain-Id: default Nov 01 18:55:32.530262 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Domain-Name: Default Nov 01 18:55:32.530262 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Id: c8e1248497284006a7acbb8169627ea5 Nov 01 18:55:32.530262 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Name: tempest-DeleteServersAdminTestJSON-742542561 Nov 01 18:55:32.530262 n-d-863052-2 devstack@n-api.service[121403]: X-Role: member,reader Nov 01 18:55:32.530262 n-d-863052-2 devstack@n-api.service[121403]: X-Roles: member,reader Nov 01 18:55:32.531847 n-d-863052-2 devstack@n-api.service[121403]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/c8e1248497284006a7acbb8169627ea5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/c8e1248497284006a7acbb8169627ea5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_c8e1248497284006a7acbb8169627ea5", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/c8e1248497284006a7acbb8169627ea5"}]}] Nov 01 18:55:32.531847 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant: tempest-DeleteServersAdminTestJSON-742542561 Nov 01 18:55:32.531847 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant-Id: c8e1248497284006a7acbb8169627ea5 Nov 01 18:55:32.531847 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-742542561 Nov 01 18:55:32.531847 n-d-863052-2 devstack@n-api.service[121403]: X-User: tempest-DeleteServersAdminTestJSON-742542561-project Nov 01 18:55:32.531847 n-d-863052-2 devstack@n-api.service[121403]: X-User-Domain-Id: default Nov 01 18:55:32.531847 n-d-863052-2 devstack@n-api.service[121403]: X-User-Domain-Name: Default Nov 01 18:55:32.531847 n-d-863052-2 devstack@n-api.service[121403]: X-User-Id: ce2e0d1828674809a3344a7a68f375c5 Nov 01 18:55:32.531847 n-d-863052-2 devstack@n-api.service[121403]: X-User-Name: tempest-DeleteServersAdminTestJSON-742542561-project Nov 01 18:55:32.531847 n-d-863052-2 devstack@n-api.service[121403]: method: > Nov 01 18:55:32.531847 n-d-863052-2 devstack@n-api.service[121403]: exception: Instance ada7d07e-42e4-49a3-8e59-d16dee8cb0f0 could not be found. Nov 01 18:55:32.531847 n-d-863052-2 devstack@n-api.service[121403]: action_args: {'id': 'ada7d07e-42e4-49a3-8e59-d16dee8cb0f0'} Nov 01 18:55:32.532669 n-d-863052-2 devstack@n-api.service[121403]: {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 01 18:55:32.532669 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:55:32.532669 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 01 18:55:32.532669 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 01 18:55:32.532669 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 01 18:55:32.532669 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 01 18:55:32.532669 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 01 18:55:32.532669 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 01 18:55:32.532669 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 01 18:55:32.532669 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 01 18:55:32.532669 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ada7d07e-42e4-49a3-8e59-d16dee8cb0f0 could not be found. Nov 01 18:55:32.532669 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 18:55:32.532669 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 18:55:32.532669 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 18:55:32.532669 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:55:32.532669 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 18:55:32.532669 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 18:55:32.532669 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 01 18:55:32.532669 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 01 18:55:32.532669 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 01 18:55:32.535332 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 01 18:55:32.535332 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 01 18:55:32.535332 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 01 18:55:32.535332 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 01 18:55:32.535332 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 01 18:55:32.535332 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 01 18:55:32.535332 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 01 18:55:32.535332 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ada7d07e-42e4-49a3-8e59-d16dee8cb0f0 could not be found. Nov 01 18:55:32.535332 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 18:55:32.535332 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 18:55:32.535332 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 18:55:32.535332 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:55:32.535332 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 18:55:32.535332 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 18:55:32.535332 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 01 18:55:32.535332 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 01 18:55:32.535332 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ada7d07e-42e4-49a3-8e59-d16dee8cb0f0 could not be found. Nov 01 18:55:32.535332 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 18:55:32.536576 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-162df353-5be6-4a86-a9e4-77c08f88583c tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Returning 404 to user: Instance ada7d07e-42e4-49a3-8e59-d16dee8cb0f0 could not be found. {{(pid=121403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 01 18:55:32.536576 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-162df353-5be6-4a86-a9e4-77c08f88583c tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] 10.222.0.13 "GET /compute/v2.1/servers/ada7d07e-42e4-49a3-8e59-d16dee8cb0f0" status: 404 len: 111 microversion: 2.1 time: 0.066088 Nov 01 18:55:32.553971 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-1a4e5598-2e13-4453-8afe-f2f392fedd21 tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:55:32.554999 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-1a4e5598-2e13-4453-8afe-f2f392fedd21 tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] [instance: ada7d07e-42e4-49a3-8e59-d16dee8cb0f0] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:55:32.561797 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 179/382] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:55:32 2022] GET /compute/v2.1/servers/ada7d07e-42e4-49a3-8e59-d16dee8cb0f0 => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 01 18:55:32.567723 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-1a4e5598-2e13-4453-8afe-f2f392fedd21 tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:55:32.574378 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-1a4e5598-2e13-4453-8afe-f2f392fedd21 tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:55:32.576678 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-1a4e5598-2e13-4453-8afe-f2f392fedd21 tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:55:32.579138 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-1a4e5598-2e13-4453-8afe-f2f392fedd21 tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:55:32.581745 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-1a4e5598-2e13-4453-8afe-f2f392fedd21 tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:55:32.583071 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-1a4e5598-2e13-4453-8afe-f2f392fedd21 tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:55:32.631086 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.wsgi [None req-1a4e5598-2e13-4453-8afe-f2f392fedd21 tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] HTTP exception thrown: Instance ada7d07e-42e4-49a3-8e59-d16dee8cb0f0 could not be found. Nov 01 18:55:32.631328 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-1a4e5598-2e13-4453-8afe-f2f392fedd21 tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Request method failure captured: Nov 01 18:55:32.631328 n-d-863052-2 devstack@n-api.service[121402]: request: DELETE /compute/v2.1/servers/ada7d07e-42e4-49a3-8e59-d16dee8cb0f0 HTTP/1.1 Nov 01 18:55:32.631328 n-d-863052-2 devstack@n-api.service[121402]: Accept: application/json Nov 01 18:55:32.631328 n-d-863052-2 devstack@n-api.service[121402]: Accept-Encoding: identity Nov 01 18:55:32.631328 n-d-863052-2 devstack@n-api.service[121402]: Connection: close Nov 01 18:55:32.631328 n-d-863052-2 devstack@n-api.service[121402]: Content-Length: 0 Nov 01 18:55:32.631328 n-d-863052-2 devstack@n-api.service[121402]: Content-Type: application/json Nov 01 18:55:32.631328 n-d-863052-2 devstack@n-api.service[121402]: Host: 10.222.0.13 Nov 01 18:55:32.631328 n-d-863052-2 devstack@n-api.service[121402]: Openstack-System-Scope: None Nov 01 18:55:32.631328 n-d-863052-2 devstack@n-api.service[121402]: User-Agent: python-urllib3/1.26.12 Nov 01 18:55:32.631328 n-d-863052-2 devstack@n-api.service[121402]: X-Auth-Token: gAAAAABjYWtYDQwdAak_LjSmdo26bmKvpWtv73rP8cG6S9cMNmWfs8LwYmpnAj7Ol9mmIwvJVFGihix85N_khX1wVu6qw6bw-56m6Mp9CQTu5Az6nunubYmH0HGLQV25fRJm8xBu_cIiDsr_617cASQvaowfLvvLes1yddcCUl8oNjqt7aPNvls Nov 01 18:55:32.631328 n-d-863052-2 devstack@n-api.service[121402]: X-Domain-Id: None Nov 01 18:55:32.631328 n-d-863052-2 devstack@n-api.service[121402]: X-Domain-Name: None Nov 01 18:55:32.631328 n-d-863052-2 devstack@n-api.service[121402]: X-Identity-Status: Confirmed Nov 01 18:55:32.631328 n-d-863052-2 devstack@n-api.service[121402]: X-Is-Admin-Project: True Nov 01 18:55:32.631328 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Domain-Id: default Nov 01 18:55:32.631328 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Domain-Name: Default Nov 01 18:55:32.631328 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Id: c8e1248497284006a7acbb8169627ea5 Nov 01 18:55:32.631328 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Name: tempest-DeleteServersAdminTestJSON-742542561 Nov 01 18:55:32.631328 n-d-863052-2 devstack@n-api.service[121402]: X-Role: member,reader Nov 01 18:55:32.631328 n-d-863052-2 devstack@n-api.service[121402]: X-Roles: member,reader Nov 01 18:55:32.633420 n-d-863052-2 devstack@n-api.service[121402]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/c8e1248497284006a7acbb8169627ea5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/c8e1248497284006a7acbb8169627ea5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_c8e1248497284006a7acbb8169627ea5", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/c8e1248497284006a7acbb8169627ea5"}]}] Nov 01 18:55:32.633420 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant: tempest-DeleteServersAdminTestJSON-742542561 Nov 01 18:55:32.633420 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant-Id: c8e1248497284006a7acbb8169627ea5 Nov 01 18:55:32.633420 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-742542561 Nov 01 18:55:32.633420 n-d-863052-2 devstack@n-api.service[121402]: X-User: tempest-DeleteServersAdminTestJSON-742542561-project Nov 01 18:55:32.633420 n-d-863052-2 devstack@n-api.service[121402]: X-User-Domain-Id: default Nov 01 18:55:32.633420 n-d-863052-2 devstack@n-api.service[121402]: X-User-Domain-Name: Default Nov 01 18:55:32.633420 n-d-863052-2 devstack@n-api.service[121402]: X-User-Id: ce2e0d1828674809a3344a7a68f375c5 Nov 01 18:55:32.633420 n-d-863052-2 devstack@n-api.service[121402]: X-User-Name: tempest-DeleteServersAdminTestJSON-742542561-project Nov 01 18:55:32.633420 n-d-863052-2 devstack@n-api.service[121402]: method: > Nov 01 18:55:32.633420 n-d-863052-2 devstack@n-api.service[121402]: exception: Instance ada7d07e-42e4-49a3-8e59-d16dee8cb0f0 could not be found. Nov 01 18:55:32.633420 n-d-863052-2 devstack@n-api.service[121402]: action_args: {'id': 'ada7d07e-42e4-49a3-8e59-d16dee8cb0f0'} Nov 01 18:55:32.634212 n-d-863052-2 devstack@n-api.service[121402]: {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 01 18:55:32.634212 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:55:32.634212 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 01 18:55:32.634212 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 01 18:55:32.634212 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 01 18:55:32.634212 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 01 18:55:32.634212 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 01 18:55:32.634212 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 01 18:55:32.634212 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 01 18:55:32.634212 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 01 18:55:32.634212 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ada7d07e-42e4-49a3-8e59-d16dee8cb0f0 could not be found. Nov 01 18:55:32.634212 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 18:55:32.634212 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 18:55:32.634212 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 18:55:32.634212 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:55:32.634212 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 18:55:32.634212 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 18:55:32.634212 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 01 18:55:32.634212 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 01 18:55:32.634212 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 01 18:55:32.635536 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 01 18:55:32.635536 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 01 18:55:32.635536 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 01 18:55:32.635536 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 01 18:55:32.635536 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 01 18:55:32.635536 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 01 18:55:32.635536 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 01 18:55:32.635536 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 01 18:55:32.635536 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 01 18:55:32.635536 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ada7d07e-42e4-49a3-8e59-d16dee8cb0f0 could not be found. Nov 01 18:55:32.635536 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 18:55:32.635536 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 18:55:32.635536 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 18:55:32.635536 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:55:32.635536 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 18:55:32.635536 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 18:55:32.635536 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 01 18:55:32.635536 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 01 18:55:32.635536 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ada7d07e-42e4-49a3-8e59-d16dee8cb0f0 could not be found. Nov 01 18:55:32.635536 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 18:55:32.636996 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-1a4e5598-2e13-4453-8afe-f2f392fedd21 tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Returning 404 to user: Instance ada7d07e-42e4-49a3-8e59-d16dee8cb0f0 could not be found. {{(pid=121402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 01 18:55:32.637310 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-1a4e5598-2e13-4453-8afe-f2f392fedd21 tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] 10.222.0.13 "DELETE /compute/v2.1/servers/ada7d07e-42e4-49a3-8e59-d16dee8cb0f0" status: 404 len: 111 microversion: 2.1 time: 0.091715 Nov 01 18:55:32.642125 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 204/383] 10.222.0.13 () {58 vars in 1239 bytes} [Tue Nov 1 18:55:32 2022] DELETE /compute/v2.1/servers/ada7d07e-42e4-49a3-8e59-d16dee8cb0f0 => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 01 18:55:32.650248 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-ab98d30a-2b9c-448b-be0a-6b0e88462422 tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:55:32.651138 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-ab98d30a-2b9c-448b-be0a-6b0e88462422 tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] [instance: ada7d07e-42e4-49a3-8e59-d16dee8cb0f0] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:55:32.662241 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-ab98d30a-2b9c-448b-be0a-6b0e88462422 tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:55:32.668239 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-ab98d30a-2b9c-448b-be0a-6b0e88462422 tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:55:32.677263 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-ab98d30a-2b9c-448b-be0a-6b0e88462422 tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:55:32.678694 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-ab98d30a-2b9c-448b-be0a-6b0e88462422 tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:55:32.679954 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-ab98d30a-2b9c-448b-be0a-6b0e88462422 tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:55:32.680625 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-ab98d30a-2b9c-448b-be0a-6b0e88462422 tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:55:32.721366 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.wsgi [None req-ab98d30a-2b9c-448b-be0a-6b0e88462422 tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] HTTP exception thrown: Instance ada7d07e-42e4-49a3-8e59-d16dee8cb0f0 could not be found. Nov 01 18:55:32.724837 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-ab98d30a-2b9c-448b-be0a-6b0e88462422 tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Request method failure captured: Nov 01 18:55:32.724837 n-d-863052-2 devstack@n-api.service[121403]: request: GET /compute/v2.1/servers/ada7d07e-42e4-49a3-8e59-d16dee8cb0f0 HTTP/1.1 Nov 01 18:55:32.724837 n-d-863052-2 devstack@n-api.service[121403]: Accept: application/json Nov 01 18:55:32.724837 n-d-863052-2 devstack@n-api.service[121403]: Accept-Encoding: identity Nov 01 18:55:32.724837 n-d-863052-2 devstack@n-api.service[121403]: Connection: close Nov 01 18:55:32.724837 n-d-863052-2 devstack@n-api.service[121403]: Content-Length: 0 Nov 01 18:55:32.724837 n-d-863052-2 devstack@n-api.service[121403]: Content-Type: application/json Nov 01 18:55:32.724837 n-d-863052-2 devstack@n-api.service[121403]: Host: 10.222.0.13 Nov 01 18:55:32.724837 n-d-863052-2 devstack@n-api.service[121403]: Openstack-System-Scope: None Nov 01 18:55:32.724837 n-d-863052-2 devstack@n-api.service[121403]: User-Agent: python-urllib3/1.26.12 Nov 01 18:55:32.724837 n-d-863052-2 devstack@n-api.service[121403]: X-Auth-Token: gAAAAABjYWtYDQwdAak_LjSmdo26bmKvpWtv73rP8cG6S9cMNmWfs8LwYmpnAj7Ol9mmIwvJVFGihix85N_khX1wVu6qw6bw-56m6Mp9CQTu5Az6nunubYmH0HGLQV25fRJm8xBu_cIiDsr_617cASQvaowfLvvLes1yddcCUl8oNjqt7aPNvls Nov 01 18:55:32.724837 n-d-863052-2 devstack@n-api.service[121403]: X-Domain-Id: None Nov 01 18:55:32.724837 n-d-863052-2 devstack@n-api.service[121403]: X-Domain-Name: None Nov 01 18:55:32.724837 n-d-863052-2 devstack@n-api.service[121403]: X-Identity-Status: Confirmed Nov 01 18:55:32.724837 n-d-863052-2 devstack@n-api.service[121403]: X-Is-Admin-Project: True Nov 01 18:55:32.724837 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Domain-Id: default Nov 01 18:55:32.724837 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Domain-Name: Default Nov 01 18:55:32.724837 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Id: c8e1248497284006a7acbb8169627ea5 Nov 01 18:55:32.724837 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Name: tempest-DeleteServersAdminTestJSON-742542561 Nov 01 18:55:32.724837 n-d-863052-2 devstack@n-api.service[121403]: X-Role: member,reader Nov 01 18:55:32.724837 n-d-863052-2 devstack@n-api.service[121403]: X-Roles: member,reader Nov 01 18:55:32.726074 n-d-863052-2 devstack@n-api.service[121403]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/c8e1248497284006a7acbb8169627ea5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/c8e1248497284006a7acbb8169627ea5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_c8e1248497284006a7acbb8169627ea5", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/c8e1248497284006a7acbb8169627ea5"}]}] Nov 01 18:55:32.726074 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant: tempest-DeleteServersAdminTestJSON-742542561 Nov 01 18:55:32.726074 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant-Id: c8e1248497284006a7acbb8169627ea5 Nov 01 18:55:32.726074 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-742542561 Nov 01 18:55:32.726074 n-d-863052-2 devstack@n-api.service[121403]: X-User: tempest-DeleteServersAdminTestJSON-742542561-project Nov 01 18:55:32.726074 n-d-863052-2 devstack@n-api.service[121403]: X-User-Domain-Id: default Nov 01 18:55:32.726074 n-d-863052-2 devstack@n-api.service[121403]: X-User-Domain-Name: Default Nov 01 18:55:32.726074 n-d-863052-2 devstack@n-api.service[121403]: X-User-Id: ce2e0d1828674809a3344a7a68f375c5 Nov 01 18:55:32.726074 n-d-863052-2 devstack@n-api.service[121403]: X-User-Name: tempest-DeleteServersAdminTestJSON-742542561-project Nov 01 18:55:32.726074 n-d-863052-2 devstack@n-api.service[121403]: method: > Nov 01 18:55:32.726074 n-d-863052-2 devstack@n-api.service[121403]: exception: Instance ada7d07e-42e4-49a3-8e59-d16dee8cb0f0 could not be found. Nov 01 18:55:32.726074 n-d-863052-2 devstack@n-api.service[121403]: action_args: {'id': 'ada7d07e-42e4-49a3-8e59-d16dee8cb0f0'} Nov 01 18:55:32.726794 n-d-863052-2 devstack@n-api.service[121403]: {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 01 18:55:32.726794 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:55:32.726794 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 01 18:55:32.726794 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 01 18:55:32.726794 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 01 18:55:32.726794 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 01 18:55:32.726794 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 01 18:55:32.726794 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 01 18:55:32.726794 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 01 18:55:32.726794 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 01 18:55:32.726794 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ada7d07e-42e4-49a3-8e59-d16dee8cb0f0 could not be found. Nov 01 18:55:32.726794 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 18:55:32.726794 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 18:55:32.726794 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 18:55:32.726794 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:55:32.726794 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 18:55:32.726794 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 18:55:32.726794 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 01 18:55:32.726794 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 01 18:55:32.726794 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 01 18:55:32.727835 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 01 18:55:32.727835 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 01 18:55:32.727835 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 01 18:55:32.727835 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 01 18:55:32.727835 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 01 18:55:32.727835 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 01 18:55:32.727835 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 01 18:55:32.727835 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ada7d07e-42e4-49a3-8e59-d16dee8cb0f0 could not be found. Nov 01 18:55:32.727835 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 18:55:32.727835 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 18:55:32.727835 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 18:55:32.727835 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:55:32.727835 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 18:55:32.727835 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 18:55:32.727835 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 01 18:55:32.727835 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 01 18:55:32.727835 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ada7d07e-42e4-49a3-8e59-d16dee8cb0f0 could not be found. Nov 01 18:55:32.727835 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 18:55:32.728810 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-ab98d30a-2b9c-448b-be0a-6b0e88462422 tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Returning 404 to user: Instance ada7d07e-42e4-49a3-8e59-d16dee8cb0f0 could not be found. {{(pid=121403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 01 18:55:32.728810 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-ab98d30a-2b9c-448b-be0a-6b0e88462422 tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] 10.222.0.13 "GET /compute/v2.1/servers/ada7d07e-42e4-49a3-8e59-d16dee8cb0f0" status: 404 len: 111 microversion: 2.1 time: 0.082122 Nov 01 18:55:32.740318 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 180/384] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:55:32 2022] GET /compute/v2.1/servers/ada7d07e-42e4-49a3-8e59-d16dee8cb0f0 => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 01 18:55:32.747996 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-28101297-680b-44b5-8e42-ef613ebe1660 tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:55:32.748769 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-28101297-680b-44b5-8e42-ef613ebe1660 tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] [instance: 4ebac531-6f77-4108-afc9-0eccb86dee8b] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:55:32.760951 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-28101297-680b-44b5-8e42-ef613ebe1660 tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:55:32.761742 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-28101297-680b-44b5-8e42-ef613ebe1660 tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:55:32.762364 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-28101297-680b-44b5-8e42-ef613ebe1660 tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:55:32.763283 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-28101297-680b-44b5-8e42-ef613ebe1660 tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:55:32.765120 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-28101297-680b-44b5-8e42-ef613ebe1660 tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:55:32.765758 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-28101297-680b-44b5-8e42-ef613ebe1660 tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:55:32.813753 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.wsgi [None req-28101297-680b-44b5-8e42-ef613ebe1660 tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] HTTP exception thrown: Instance 4ebac531-6f77-4108-afc9-0eccb86dee8b could not be found. Nov 01 18:55:32.815464 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-28101297-680b-44b5-8e42-ef613ebe1660 tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Request method failure captured: Nov 01 18:55:32.815464 n-d-863052-2 devstack@n-api.service[121402]: request: DELETE /compute/v2.1/servers/4ebac531-6f77-4108-afc9-0eccb86dee8b HTTP/1.1 Nov 01 18:55:32.815464 n-d-863052-2 devstack@n-api.service[121402]: Accept: application/json Nov 01 18:55:32.815464 n-d-863052-2 devstack@n-api.service[121402]: Accept-Encoding: identity Nov 01 18:55:32.815464 n-d-863052-2 devstack@n-api.service[121402]: Connection: close Nov 01 18:55:32.815464 n-d-863052-2 devstack@n-api.service[121402]: Content-Length: 0 Nov 01 18:55:32.815464 n-d-863052-2 devstack@n-api.service[121402]: Content-Type: application/json Nov 01 18:55:32.815464 n-d-863052-2 devstack@n-api.service[121402]: Host: 10.222.0.13 Nov 01 18:55:32.815464 n-d-863052-2 devstack@n-api.service[121402]: Openstack-System-Scope: None Nov 01 18:55:32.815464 n-d-863052-2 devstack@n-api.service[121402]: User-Agent: python-urllib3/1.26.12 Nov 01 18:55:32.815464 n-d-863052-2 devstack@n-api.service[121402]: X-Auth-Token: gAAAAABjYWtYDQwdAak_LjSmdo26bmKvpWtv73rP8cG6S9cMNmWfs8LwYmpnAj7Ol9mmIwvJVFGihix85N_khX1wVu6qw6bw-56m6Mp9CQTu5Az6nunubYmH0HGLQV25fRJm8xBu_cIiDsr_617cASQvaowfLvvLes1yddcCUl8oNjqt7aPNvls Nov 01 18:55:32.815464 n-d-863052-2 devstack@n-api.service[121402]: X-Domain-Id: None Nov 01 18:55:32.815464 n-d-863052-2 devstack@n-api.service[121402]: X-Domain-Name: None Nov 01 18:55:32.815464 n-d-863052-2 devstack@n-api.service[121402]: X-Identity-Status: Confirmed Nov 01 18:55:32.815464 n-d-863052-2 devstack@n-api.service[121402]: X-Is-Admin-Project: True Nov 01 18:55:32.815464 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Domain-Id: default Nov 01 18:55:32.815464 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Domain-Name: Default Nov 01 18:55:32.815464 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Id: c8e1248497284006a7acbb8169627ea5 Nov 01 18:55:32.815464 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Name: tempest-DeleteServersAdminTestJSON-742542561 Nov 01 18:55:32.815464 n-d-863052-2 devstack@n-api.service[121402]: X-Role: member,reader Nov 01 18:55:32.815464 n-d-863052-2 devstack@n-api.service[121402]: X-Roles: member,reader Nov 01 18:55:32.816977 n-d-863052-2 devstack@n-api.service[121402]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/c8e1248497284006a7acbb8169627ea5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/c8e1248497284006a7acbb8169627ea5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_c8e1248497284006a7acbb8169627ea5", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/c8e1248497284006a7acbb8169627ea5"}]}] Nov 01 18:55:32.816977 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant: tempest-DeleteServersAdminTestJSON-742542561 Nov 01 18:55:32.816977 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant-Id: c8e1248497284006a7acbb8169627ea5 Nov 01 18:55:32.816977 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-742542561 Nov 01 18:55:32.816977 n-d-863052-2 devstack@n-api.service[121402]: X-User: tempest-DeleteServersAdminTestJSON-742542561-project Nov 01 18:55:32.816977 n-d-863052-2 devstack@n-api.service[121402]: X-User-Domain-Id: default Nov 01 18:55:32.816977 n-d-863052-2 devstack@n-api.service[121402]: X-User-Domain-Name: Default Nov 01 18:55:32.816977 n-d-863052-2 devstack@n-api.service[121402]: X-User-Id: ce2e0d1828674809a3344a7a68f375c5 Nov 01 18:55:32.816977 n-d-863052-2 devstack@n-api.service[121402]: X-User-Name: tempest-DeleteServersAdminTestJSON-742542561-project Nov 01 18:55:32.816977 n-d-863052-2 devstack@n-api.service[121402]: method: > Nov 01 18:55:32.816977 n-d-863052-2 devstack@n-api.service[121402]: exception: Instance 4ebac531-6f77-4108-afc9-0eccb86dee8b could not be found. Nov 01 18:55:32.816977 n-d-863052-2 devstack@n-api.service[121402]: action_args: {'id': '4ebac531-6f77-4108-afc9-0eccb86dee8b'} Nov 01 18:55:32.817812 n-d-863052-2 devstack@n-api.service[121402]: {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 01 18:55:32.817812 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:55:32.817812 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 01 18:55:32.817812 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 01 18:55:32.817812 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 01 18:55:32.817812 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 01 18:55:32.817812 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 01 18:55:32.817812 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 01 18:55:32.817812 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 01 18:55:32.817812 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 01 18:55:32.817812 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4ebac531-6f77-4108-afc9-0eccb86dee8b could not be found. Nov 01 18:55:32.817812 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 18:55:32.817812 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 18:55:32.817812 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 18:55:32.817812 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:55:32.817812 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 18:55:32.817812 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 18:55:32.817812 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 01 18:55:32.817812 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 01 18:55:32.817812 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 01 18:55:32.819291 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 01 18:55:32.819291 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 01 18:55:32.819291 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 01 18:55:32.819291 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 01 18:55:32.819291 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 01 18:55:32.819291 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 01 18:55:32.819291 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 01 18:55:32.819291 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 01 18:55:32.819291 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 01 18:55:32.819291 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4ebac531-6f77-4108-afc9-0eccb86dee8b could not be found. Nov 01 18:55:32.819291 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 18:55:32.819291 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 18:55:32.819291 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 18:55:32.819291 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:55:32.819291 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 18:55:32.819291 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 18:55:32.819291 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 01 18:55:32.819291 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 01 18:55:32.819291 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4ebac531-6f77-4108-afc9-0eccb86dee8b could not be found. Nov 01 18:55:32.819291 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 18:55:32.825866 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-28101297-680b-44b5-8e42-ef613ebe1660 tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Returning 404 to user: Instance 4ebac531-6f77-4108-afc9-0eccb86dee8b could not be found. {{(pid=121402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 01 18:55:32.826745 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-28101297-680b-44b5-8e42-ef613ebe1660 tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] 10.222.0.13 "DELETE /compute/v2.1/servers/4ebac531-6f77-4108-afc9-0eccb86dee8b" status: 404 len: 111 microversion: 2.1 time: 0.085644 Nov 01 18:55:32.827310 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 205/385] 10.222.0.13 () {58 vars in 1239 bytes} [Tue Nov 1 18:55:32 2022] DELETE /compute/v2.1/servers/4ebac531-6f77-4108-afc9-0eccb86dee8b => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 01 18:55:32.839748 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-b5b389cf-eb30-4215-82e3-bee607acf36b tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:55:32.839748 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-b5b389cf-eb30-4215-82e3-bee607acf36b tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] [instance: 4ebac531-6f77-4108-afc9-0eccb86dee8b] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:55:32.846451 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-b5b389cf-eb30-4215-82e3-bee607acf36b tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:55:32.847354 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-b5b389cf-eb30-4215-82e3-bee607acf36b tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:55:32.848149 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-b5b389cf-eb30-4215-82e3-bee607acf36b tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:55:32.852823 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-b5b389cf-eb30-4215-82e3-bee607acf36b tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:55:32.855138 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-b5b389cf-eb30-4215-82e3-bee607acf36b tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:55:32.856999 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-b5b389cf-eb30-4215-82e3-bee607acf36b tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:55:32.867969 n-d-863052-2 devstack@n-api.service[121403]: DEBUG dbcounter [-] [121403] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=1,nova_cell1:UPDATE=2 {{(pid=121403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 18:55:32.896688 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.wsgi [None req-b5b389cf-eb30-4215-82e3-bee607acf36b tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] HTTP exception thrown: Instance 4ebac531-6f77-4108-afc9-0eccb86dee8b could not be found. Nov 01 18:55:32.899699 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-b5b389cf-eb30-4215-82e3-bee607acf36b tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Request method failure captured: Nov 01 18:55:32.899699 n-d-863052-2 devstack@n-api.service[121403]: request: GET /compute/v2.1/servers/4ebac531-6f77-4108-afc9-0eccb86dee8b HTTP/1.1 Nov 01 18:55:32.899699 n-d-863052-2 devstack@n-api.service[121403]: Accept: application/json Nov 01 18:55:32.899699 n-d-863052-2 devstack@n-api.service[121403]: Accept-Encoding: identity Nov 01 18:55:32.899699 n-d-863052-2 devstack@n-api.service[121403]: Connection: close Nov 01 18:55:32.899699 n-d-863052-2 devstack@n-api.service[121403]: Content-Length: 0 Nov 01 18:55:32.899699 n-d-863052-2 devstack@n-api.service[121403]: Content-Type: application/json Nov 01 18:55:32.899699 n-d-863052-2 devstack@n-api.service[121403]: Host: 10.222.0.13 Nov 01 18:55:32.899699 n-d-863052-2 devstack@n-api.service[121403]: Openstack-System-Scope: None Nov 01 18:55:32.899699 n-d-863052-2 devstack@n-api.service[121403]: User-Agent: python-urllib3/1.26.12 Nov 01 18:55:32.899699 n-d-863052-2 devstack@n-api.service[121403]: X-Auth-Token: gAAAAABjYWtYDQwdAak_LjSmdo26bmKvpWtv73rP8cG6S9cMNmWfs8LwYmpnAj7Ol9mmIwvJVFGihix85N_khX1wVu6qw6bw-56m6Mp9CQTu5Az6nunubYmH0HGLQV25fRJm8xBu_cIiDsr_617cASQvaowfLvvLes1yddcCUl8oNjqt7aPNvls Nov 01 18:55:32.899699 n-d-863052-2 devstack@n-api.service[121403]: X-Domain-Id: None Nov 01 18:55:32.899699 n-d-863052-2 devstack@n-api.service[121403]: X-Domain-Name: None Nov 01 18:55:32.899699 n-d-863052-2 devstack@n-api.service[121403]: X-Identity-Status: Confirmed Nov 01 18:55:32.899699 n-d-863052-2 devstack@n-api.service[121403]: X-Is-Admin-Project: True Nov 01 18:55:32.899699 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Domain-Id: default Nov 01 18:55:32.899699 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Domain-Name: Default Nov 01 18:55:32.899699 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Id: c8e1248497284006a7acbb8169627ea5 Nov 01 18:55:32.899699 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Name: tempest-DeleteServersAdminTestJSON-742542561 Nov 01 18:55:32.899699 n-d-863052-2 devstack@n-api.service[121403]: X-Role: member,reader Nov 01 18:55:32.899699 n-d-863052-2 devstack@n-api.service[121403]: X-Roles: member,reader Nov 01 18:55:32.901419 n-d-863052-2 devstack@n-api.service[121403]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/c8e1248497284006a7acbb8169627ea5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/c8e1248497284006a7acbb8169627ea5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_c8e1248497284006a7acbb8169627ea5", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/c8e1248497284006a7acbb8169627ea5"}]}] Nov 01 18:55:32.901419 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant: tempest-DeleteServersAdminTestJSON-742542561 Nov 01 18:55:32.901419 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant-Id: c8e1248497284006a7acbb8169627ea5 Nov 01 18:55:32.901419 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-742542561 Nov 01 18:55:32.901419 n-d-863052-2 devstack@n-api.service[121403]: X-User: tempest-DeleteServersAdminTestJSON-742542561-project Nov 01 18:55:32.901419 n-d-863052-2 devstack@n-api.service[121403]: X-User-Domain-Id: default Nov 01 18:55:32.901419 n-d-863052-2 devstack@n-api.service[121403]: X-User-Domain-Name: Default Nov 01 18:55:32.901419 n-d-863052-2 devstack@n-api.service[121403]: X-User-Id: ce2e0d1828674809a3344a7a68f375c5 Nov 01 18:55:32.901419 n-d-863052-2 devstack@n-api.service[121403]: X-User-Name: tempest-DeleteServersAdminTestJSON-742542561-project Nov 01 18:55:32.901419 n-d-863052-2 devstack@n-api.service[121403]: method: > Nov 01 18:55:32.901419 n-d-863052-2 devstack@n-api.service[121403]: exception: Instance 4ebac531-6f77-4108-afc9-0eccb86dee8b could not be found. Nov 01 18:55:32.901419 n-d-863052-2 devstack@n-api.service[121403]: action_args: {'id': '4ebac531-6f77-4108-afc9-0eccb86dee8b'} Nov 01 18:55:32.902259 n-d-863052-2 devstack@n-api.service[121403]: {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 01 18:55:32.902259 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:55:32.902259 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 01 18:55:32.902259 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 01 18:55:32.902259 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 01 18:55:32.902259 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 01 18:55:32.902259 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 01 18:55:32.902259 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 01 18:55:32.902259 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 01 18:55:32.902259 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 01 18:55:32.902259 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4ebac531-6f77-4108-afc9-0eccb86dee8b could not be found. Nov 01 18:55:32.902259 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 18:55:32.902259 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 18:55:32.902259 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 18:55:32.902259 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:55:32.902259 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 18:55:32.902259 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 18:55:32.902259 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 01 18:55:32.902259 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 01 18:55:32.902259 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 01 18:55:32.903996 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 01 18:55:32.903996 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 01 18:55:32.903996 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 01 18:55:32.903996 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 01 18:55:32.903996 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 01 18:55:32.903996 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 01 18:55:32.903996 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 01 18:55:32.903996 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4ebac531-6f77-4108-afc9-0eccb86dee8b could not be found. Nov 01 18:55:32.903996 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 18:55:32.903996 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 18:55:32.903996 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 18:55:32.903996 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:55:32.903996 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 18:55:32.903996 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 18:55:32.903996 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 01 18:55:32.903996 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 01 18:55:32.903996 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4ebac531-6f77-4108-afc9-0eccb86dee8b could not be found. Nov 01 18:55:32.903996 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 18:55:32.907121 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-b5b389cf-eb30-4215-82e3-bee607acf36b tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] Returning 404 to user: Instance 4ebac531-6f77-4108-afc9-0eccb86dee8b could not be found. {{(pid=121403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 01 18:55:32.907986 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-b5b389cf-eb30-4215-82e3-bee607acf36b tempest-DeleteServersAdminTestJSON-742542561 tempest-DeleteServersAdminTestJSON-742542561-project] 10.222.0.13 "GET /compute/v2.1/servers/4ebac531-6f77-4108-afc9-0eccb86dee8b" status: 404 len: 111 microversion: 2.1 time: 0.075969 Nov 01 18:55:32.911633 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 181/386] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:55:32 2022] GET /compute/v2.1/servers/4ebac531-6f77-4108-afc9-0eccb86dee8b => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 01 18:55:33.436818 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-b375fae4-8bfd-4dd8-99cf-2c5823ef36ff tempest-FlavorsExtraSpecsNegativeTestJSON-61345516 tempest-FlavorsExtraSpecsNegativeTestJSON-61345516-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-2039828891", "ram": 512, "vcpus": 1, "disk": 10, "id": 2128110116, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 18:55:33.479515 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-b375fae4-8bfd-4dd8-99cf-2c5823ef36ff tempest-FlavorsExtraSpecsNegativeTestJSON-61345516 tempest-FlavorsExtraSpecsNegativeTestJSON-61345516-project-admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 416 microversion: 2.1 time: 0.590583 Nov 01 18:55:33.490380 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 206/387] 10.222.0.13 () {60 vars in 1147 bytes} [Tue Nov 1 18:55:32 2022] POST /compute/v2.1/flavors => generated 416 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 01 18:55:33.499251 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-159e52eb-80ce-49d4-9bfc-ff1de9965856 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:55:33.501495 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-159e52eb-80ce-49d4-9bfc-ff1de9965856 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] [instance: de2ff806-a2fa-4390-b4d5-11ff24dd27ca] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:55:33.511107 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-159e52eb-80ce-49d4-9bfc-ff1de9965856 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:55:33.512643 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-159e52eb-80ce-49d4-9bfc-ff1de9965856 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:55:33.513294 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-159e52eb-80ce-49d4-9bfc-ff1de9965856 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:55:33.514367 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-159e52eb-80ce-49d4-9bfc-ff1de9965856 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:55:33.515055 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-159e52eb-80ce-49d4-9bfc-ff1de9965856 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:55:33.515680 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-159e52eb-80ce-49d4-9bfc-ff1de9965856 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:55:33.944783 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-159e52eb-80ce-49d4-9bfc-ff1de9965856 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f32f5fba1976432d938e664c7714e52b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b9d4c236b944f9b2e8e502a50a8f8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:55:33.947985 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-d5f614b3-b6a4-4694-aead-d9de3714bfeb tempest-FlavorsExtraSpecsNegativeTestJSON-1729339004 tempest-FlavorsExtraSpecsNegativeTestJSON-1729339004-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:55:33.967612 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.wsgi [None req-d5f614b3-b6a4-4694-aead-d9de3714bfeb tempest-FlavorsExtraSpecsNegativeTestJSON-1729339004 tempest-FlavorsExtraSpecsNegativeTestJSON-1729339004-project] HTTP exception thrown: Flavor 2128110116 has no extra specs with key hw:cpu_thread_policy. Nov 01 18:55:33.968641 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-159e52eb-80ce-49d4-9bfc-ff1de9965856 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] 10.222.0.13 "GET /compute/v2.1/servers/de2ff806-a2fa-4390-b4d5-11ff24dd27ca" status: 200 len: 1492 microversion: 2.1 time: 0.474905 Nov 01 18:55:33.974368 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 207/388] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:55:33 2022] GET /compute/v2.1/servers/de2ff806-a2fa-4390-b4d5-11ff24dd27ca => generated 1492 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:55:33.976422 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-d5f614b3-b6a4-4694-aead-d9de3714bfeb tempest-FlavorsExtraSpecsNegativeTestJSON-1729339004 tempest-FlavorsExtraSpecsNegativeTestJSON-1729339004-project] Request method failure captured: Nov 01 18:55:33.976422 n-d-863052-2 devstack@n-api.service[121403]: request: GET /compute/v2.1/flavors/2128110116/os-extra_specs/hw:cpu_thread_policy HTTP/1.1 Nov 01 18:55:33.976422 n-d-863052-2 devstack@n-api.service[121403]: Accept: application/json Nov 01 18:55:33.976422 n-d-863052-2 devstack@n-api.service[121403]: Accept-Encoding: identity Nov 01 18:55:33.976422 n-d-863052-2 devstack@n-api.service[121403]: Connection: close Nov 01 18:55:33.976422 n-d-863052-2 devstack@n-api.service[121403]: Content-Length: 0 Nov 01 18:55:33.976422 n-d-863052-2 devstack@n-api.service[121403]: Content-Type: application/json Nov 01 18:55:33.976422 n-d-863052-2 devstack@n-api.service[121403]: Host: 10.222.0.13 Nov 01 18:55:33.976422 n-d-863052-2 devstack@n-api.service[121403]: Openstack-System-Scope: None Nov 01 18:55:33.976422 n-d-863052-2 devstack@n-api.service[121403]: User-Agent: python-urllib3/1.26.12 Nov 01 18:55:33.976422 n-d-863052-2 devstack@n-api.service[121403]: X-Auth-Token: gAAAAABjYWujBuYvk8G6GEDcP3wNNGPTYIaK7gdhqETS-pAcvao4jie89aN5YR41_QUnr1tYe4iB51Rta2Y8Ig29Iiy6ddjVTUm5jR3gyvgg_VJ5T0TT5SYYrzrUtS1Is7MlFnaEXcqMFDxN45eUzMExdGL12kgJX4dpV6TSEewKav-obG_i_Pg Nov 01 18:55:33.976422 n-d-863052-2 devstack@n-api.service[121403]: X-Domain-Id: None Nov 01 18:55:33.976422 n-d-863052-2 devstack@n-api.service[121403]: X-Domain-Name: None Nov 01 18:55:33.976422 n-d-863052-2 devstack@n-api.service[121403]: X-Identity-Status: Confirmed Nov 01 18:55:33.976422 n-d-863052-2 devstack@n-api.service[121403]: X-Is-Admin-Project: True Nov 01 18:55:33.976422 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Domain-Id: default Nov 01 18:55:33.976422 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Domain-Name: Default Nov 01 18:55:33.976422 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Id: c8ab2b7c511b44f4aec6e3574f35e10a Nov 01 18:55:33.976422 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1729339004 Nov 01 18:55:33.976422 n-d-863052-2 devstack@n-api.service[121403]: X-Role: member,reader Nov 01 18:55:33.976422 n-d-863052-2 devstack@n-api.service[121403]: X-Roles: member,reader Nov 01 18:55:33.977907 n-d-863052-2 devstack@n-api.service[121403]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/c8ab2b7c511b44f4aec6e3574f35e10a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/c8ab2b7c511b44f4aec6e3574f35e10a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_c8ab2b7c511b44f4aec6e3574f35e10a", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/c8ab2b7c511b44f4aec6e3574f35e10a"}]}] Nov 01 18:55:33.977907 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1729339004 Nov 01 18:55:33.977907 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant-Id: c8ab2b7c511b44f4aec6e3574f35e10a Nov 01 18:55:33.977907 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1729339004 Nov 01 18:55:33.977907 n-d-863052-2 devstack@n-api.service[121403]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1729339004-project Nov 01 18:55:33.977907 n-d-863052-2 devstack@n-api.service[121403]: X-User-Domain-Id: default Nov 01 18:55:33.977907 n-d-863052-2 devstack@n-api.service[121403]: X-User-Domain-Name: Default Nov 01 18:55:33.977907 n-d-863052-2 devstack@n-api.service[121403]: X-User-Id: b3a51b3ff5cb4a5f81dff30d0038ac90 Nov 01 18:55:33.977907 n-d-863052-2 devstack@n-api.service[121403]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1729339004-project Nov 01 18:55:33.977907 n-d-863052-2 devstack@n-api.service[121403]: method: > Nov 01 18:55:33.977907 n-d-863052-2 devstack@n-api.service[121403]: exception: Flavor 2128110116 has no extra specs with key hw:cpu_thread_policy. Nov 01 18:55:33.978544 n-d-863052-2 devstack@n-api.service[121403]: action_args: {'flavor_id': '2128110116', 'id': 'hw:cpu_thread_policy'} Nov 01 18:55:33.978544 n-d-863052-2 devstack@n-api.service[121403]: {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 01 18:55:33.978544 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:55:33.978544 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 115, in show Nov 01 18:55:33.978544 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return {id: flavor.extra_specs[id]} Nov 01 18:55:33.978544 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi KeyError: 'hw:cpu_thread_policy' Nov 01 18:55:33.978544 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 18:55:33.978544 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 18:55:33.978544 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 18:55:33.978544 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:55:33.978544 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 18:55:33.978544 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 18:55:33.978544 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 01 18:55:33.978544 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 01 18:55:33.978544 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 01 18:55:33.978544 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 01 18:55:33.978544 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 120, in show Nov 01 18:55:33.978544 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Nov 01 18:55:33.978544 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 2128110116 has no extra specs with key hw:cpu_thread_policy. Nov 01 18:55:33.978544 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 18:55:33.978544 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 18:55:33.978544 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 18:55:33.979726 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:55:33.979726 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 18:55:33.979726 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 18:55:33.979726 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 01 18:55:33.979726 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 01 18:55:33.979726 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 2128110116 has no extra specs with key hw:cpu_thread_policy. Nov 01 18:55:33.979726 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 18:55:33.986539 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-d5f614b3-b6a4-4694-aead-d9de3714bfeb tempest-FlavorsExtraSpecsNegativeTestJSON-1729339004 tempest-FlavorsExtraSpecsNegativeTestJSON-1729339004-project] Returning 404 to user: Flavor 2128110116 has no extra specs with key hw:cpu_thread_policy. {{(pid=121403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 01 18:55:33.987731 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-d5f614b3-b6a4-4694-aead-d9de3714bfeb tempest-FlavorsExtraSpecsNegativeTestJSON-1729339004 tempest-FlavorsExtraSpecsNegativeTestJSON-1729339004-project] 10.222.0.13 "GET /compute/v2.1/flavors/2128110116/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 113 microversion: 2.1 time: 0.496840 Nov 01 18:55:33.995412 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 182/389] 10.222.0.13 () {58 vars in 1266 bytes} [Tue Nov 1 18:55:33 2022] GET /compute/v2.1/flavors/2128110116/os-extra_specs/hw:cpu_thread_policy => generated 113 bytes in 505 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 01 18:55:34.011617 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-721216ce-e90b-4ca2-adc8-ac55c225185e tempest-FlavorsExtraSpecsNegativeTestJSON-1729339004 tempest-FlavorsExtraSpecsNegativeTestJSON-1729339004-project] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 18:55:34.022105 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-721216ce-e90b-4ca2-adc8-ac55c225185e tempest-FlavorsExtraSpecsNegativeTestJSON-1729339004 tempest-FlavorsExtraSpecsNegativeTestJSON-1729339004-project] Policy check for os_compute_api:os-flavor-extra-specs:create failed with credentials {'is_admin': False, 'user_id': 'b3a51b3ff5cb4a5f81dff30d0038ac90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8ab2b7c511b44f4aec6e3574f35e10a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:55:34.027791 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-721216ce-e90b-4ca2-adc8-ac55c225185e tempest-FlavorsExtraSpecsNegativeTestJSON-1729339004 tempest-FlavorsExtraSpecsNegativeTestJSON-1729339004-project] Request method failure captured: Nov 01 18:55:34.027791 n-d-863052-2 devstack@n-api.service[121403]: request: POST /compute/v2.1/flavors/2128110116/os-extra_specs HTTP/1.1 Nov 01 18:55:34.027791 n-d-863052-2 devstack@n-api.service[121403]: Accept: application/json Nov 01 18:55:34.027791 n-d-863052-2 devstack@n-api.service[121403]: Accept-Encoding: identity Nov 01 18:55:34.027791 n-d-863052-2 devstack@n-api.service[121403]: Connection: close Nov 01 18:55:34.027791 n-d-863052-2 devstack@n-api.service[121403]: Content-Length: 66 Nov 01 18:55:34.027791 n-d-863052-2 devstack@n-api.service[121403]: Content-Type: application/json Nov 01 18:55:34.027791 n-d-863052-2 devstack@n-api.service[121403]: Host: 10.222.0.13 Nov 01 18:55:34.027791 n-d-863052-2 devstack@n-api.service[121403]: Openstack-System-Scope: None Nov 01 18:55:34.027791 n-d-863052-2 devstack@n-api.service[121403]: User-Agent: python-urllib3/1.26.12 Nov 01 18:55:34.027791 n-d-863052-2 devstack@n-api.service[121403]: X-Auth-Token: gAAAAABjYWujBuYvk8G6GEDcP3wNNGPTYIaK7gdhqETS-pAcvao4jie89aN5YR41_QUnr1tYe4iB51Rta2Y8Ig29Iiy6ddjVTUm5jR3gyvgg_VJ5T0TT5SYYrzrUtS1Is7MlFnaEXcqMFDxN45eUzMExdGL12kgJX4dpV6TSEewKav-obG_i_Pg Nov 01 18:55:34.027791 n-d-863052-2 devstack@n-api.service[121403]: X-Domain-Id: None Nov 01 18:55:34.027791 n-d-863052-2 devstack@n-api.service[121403]: X-Domain-Name: None Nov 01 18:55:34.027791 n-d-863052-2 devstack@n-api.service[121403]: X-Identity-Status: Confirmed Nov 01 18:55:34.027791 n-d-863052-2 devstack@n-api.service[121403]: X-Is-Admin-Project: True Nov 01 18:55:34.027791 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Domain-Id: default Nov 01 18:55:34.027791 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Domain-Name: Default Nov 01 18:55:34.027791 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Id: c8ab2b7c511b44f4aec6e3574f35e10a Nov 01 18:55:34.027791 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1729339004 Nov 01 18:55:34.027791 n-d-863052-2 devstack@n-api.service[121403]: X-Role: member,reader Nov 01 18:55:34.027791 n-d-863052-2 devstack@n-api.service[121403]: X-Roles: member,reader Nov 01 18:55:34.029186 n-d-863052-2 devstack@n-api.service[121403]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/c8ab2b7c511b44f4aec6e3574f35e10a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/c8ab2b7c511b44f4aec6e3574f35e10a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_c8ab2b7c511b44f4aec6e3574f35e10a", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/c8ab2b7c511b44f4aec6e3574f35e10a"}]}] Nov 01 18:55:34.029186 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1729339004 Nov 01 18:55:34.029186 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant-Id: c8ab2b7c511b44f4aec6e3574f35e10a Nov 01 18:55:34.029186 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1729339004 Nov 01 18:55:34.029186 n-d-863052-2 devstack@n-api.service[121403]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1729339004-project Nov 01 18:55:34.029186 n-d-863052-2 devstack@n-api.service[121403]: X-User-Domain-Id: default Nov 01 18:55:34.029186 n-d-863052-2 devstack@n-api.service[121403]: X-User-Domain-Name: Default Nov 01 18:55:34.029186 n-d-863052-2 devstack@n-api.service[121403]: X-User-Id: b3a51b3ff5cb4a5f81dff30d0038ac90 Nov 01 18:55:34.029186 n-d-863052-2 devstack@n-api.service[121403]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1729339004-project Nov 01 18:55:34.029186 n-d-863052-2 devstack@n-api.service[121403]: Nov 01 18:55:34.029186 n-d-863052-2 devstack@n-api.service[121403]: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} Nov 01 18:55:34.029186 n-d-863052-2 devstack@n-api.service[121403]: method: > Nov 01 18:55:34.030360 n-d-863052-2 devstack@n-api.service[121403]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Nov 01 18:55:34.030360 n-d-863052-2 devstack@n-api.service[121403]: action_args: {'flavor_id': '2128110116', 'body': {'extra_specs': {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'}}} Nov 01 18:55:34.030360 n-d-863052-2 devstack@n-api.service[121403]: {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 01 18:55:34.030360 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:55:34.030360 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 18:55:34.030360 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 18:55:34.030360 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 01 18:55:34.030360 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 01 18:55:34.030360 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 01 18:55:34.030360 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 01 18:55:34.030360 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 01 18:55:34.030360 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 01 18:55:34.030360 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 73, in create Nov 01 18:55:34.030360 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'create', target={}) Nov 01 18:55:34.030360 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Nov 01 18:55:34.030360 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Nov 01 18:55:34.030360 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Nov 01 18:55:34.030360 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Nov 01 18:55:34.030360 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 01 18:55:34.031714 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 01 18:55:34.031714 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 01 18:55:34.031714 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise self.value Nov 01 18:55:34.031714 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Nov 01 18:55:34.031714 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Nov 01 18:55:34.031714 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Nov 01 18:55:34.031714 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return self.enforce( Nov 01 18:55:34.031714 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Nov 01 18:55:34.031714 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Nov 01 18:55:34.031714 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Nov 01 18:55:34.031714 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 18:55:34.031714 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 18:55:34.031714 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 18:55:34.031714 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:55:34.031714 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 18:55:34.031714 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 18:55:34.031714 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Nov 01 18:55:34.031714 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Nov 01 18:55:34.031714 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Nov 01 18:55:34.031714 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 18:55:34.034437 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-721216ce-e90b-4ca2-adc8-ac55c225185e tempest-FlavorsExtraSpecsNegativeTestJSON-1729339004 tempest-FlavorsExtraSpecsNegativeTestJSON-1729339004-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. {{(pid=121403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 01 18:55:34.038986 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-721216ce-e90b-4ca2-adc8-ac55c225185e tempest-FlavorsExtraSpecsNegativeTestJSON-1729339004 tempest-FlavorsExtraSpecsNegativeTestJSON-1729339004-project] 10.222.0.13 "POST /compute/v2.1/flavors/2128110116/os-extra_specs" status: 403 len: 124 microversion: 2.1 time: 0.037621 Nov 01 18:55:34.040117 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 183/390] 10.222.0.13 () {60 vars in 1224 bytes} [Tue Nov 1 18:55:34 2022] POST /compute/v2.1/flavors/2128110116/os-extra_specs => generated 124 bytes in 39 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Nov 01 18:55:34.050986 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-796091bb-e20e-4876-81a9-3eb5b40df50d tempest-FlavorsExtraSpecsNegativeTestJSON-61345516 tempest-FlavorsExtraSpecsNegativeTestJSON-61345516-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 18:55:34.081202 n-d-863052-2 devstack@n-api.service[121403]: DEBUG dbcounter [-] [121403] Writing DB stats nova_api:SELECT=85,nova_api:DELETE=12,nova_api:INSERT=3 {{(pid=121403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 18:55:34.127902 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-796091bb-e20e-4876-81a9-3eb5b40df50d tempest-FlavorsExtraSpecsNegativeTestJSON-61345516 tempest-FlavorsExtraSpecsNegativeTestJSON-61345516-project-admin] 10.222.0.13 "POST /compute/v2.1/flavors/2128110116/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.080009 Nov 01 18:55:34.130412 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 184/391] 10.222.0.13 () {60 vars in 1224 bytes} [Tue Nov 1 18:55:34 2022] POST /compute/v2.1/flavors/2128110116/os-extra_specs => generated 66 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 01 18:55:34.151368 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-97900d23-980f-4d7d-9eb1-bffe18487eb9 tempest-FlavorsExtraSpecsNegativeTestJSON-1729339004 tempest-FlavorsExtraSpecsNegativeTestJSON-1729339004-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:55:34.152957 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-97900d23-980f-4d7d-9eb1-bffe18487eb9 tempest-FlavorsExtraSpecsNegativeTestJSON-1729339004 tempest-FlavorsExtraSpecsNegativeTestJSON-1729339004-project] Policy check for os_compute_api:os-flavor-extra-specs:delete failed with credentials {'is_admin': False, 'user_id': 'b3a51b3ff5cb4a5f81dff30d0038ac90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8ab2b7c511b44f4aec6e3574f35e10a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:55:34.155789 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-97900d23-980f-4d7d-9eb1-bffe18487eb9 tempest-FlavorsExtraSpecsNegativeTestJSON-1729339004 tempest-FlavorsExtraSpecsNegativeTestJSON-1729339004-project] Request method failure captured: Nov 01 18:55:34.155789 n-d-863052-2 devstack@n-api.service[121403]: request: DELETE /compute/v2.1/flavors/2128110116/os-extra_specs/hw:numa_nodes HTTP/1.1 Nov 01 18:55:34.155789 n-d-863052-2 devstack@n-api.service[121403]: Accept: application/json Nov 01 18:55:34.155789 n-d-863052-2 devstack@n-api.service[121403]: Accept-Encoding: identity Nov 01 18:55:34.155789 n-d-863052-2 devstack@n-api.service[121403]: Connection: close Nov 01 18:55:34.155789 n-d-863052-2 devstack@n-api.service[121403]: Content-Length: 0 Nov 01 18:55:34.155789 n-d-863052-2 devstack@n-api.service[121403]: Content-Type: application/json Nov 01 18:55:34.155789 n-d-863052-2 devstack@n-api.service[121403]: Host: 10.222.0.13 Nov 01 18:55:34.155789 n-d-863052-2 devstack@n-api.service[121403]: Openstack-System-Scope: None Nov 01 18:55:34.155789 n-d-863052-2 devstack@n-api.service[121403]: User-Agent: python-urllib3/1.26.12 Nov 01 18:55:34.155789 n-d-863052-2 devstack@n-api.service[121403]: X-Auth-Token: gAAAAABjYWujBuYvk8G6GEDcP3wNNGPTYIaK7gdhqETS-pAcvao4jie89aN5YR41_QUnr1tYe4iB51Rta2Y8Ig29Iiy6ddjVTUm5jR3gyvgg_VJ5T0TT5SYYrzrUtS1Is7MlFnaEXcqMFDxN45eUzMExdGL12kgJX4dpV6TSEewKav-obG_i_Pg Nov 01 18:55:34.155789 n-d-863052-2 devstack@n-api.service[121403]: X-Domain-Id: None Nov 01 18:55:34.155789 n-d-863052-2 devstack@n-api.service[121403]: X-Domain-Name: None Nov 01 18:55:34.155789 n-d-863052-2 devstack@n-api.service[121403]: X-Identity-Status: Confirmed Nov 01 18:55:34.155789 n-d-863052-2 devstack@n-api.service[121403]: X-Is-Admin-Project: True Nov 01 18:55:34.155789 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Domain-Id: default Nov 01 18:55:34.155789 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Domain-Name: Default Nov 01 18:55:34.155789 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Id: c8ab2b7c511b44f4aec6e3574f35e10a Nov 01 18:55:34.155789 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1729339004 Nov 01 18:55:34.155789 n-d-863052-2 devstack@n-api.service[121403]: X-Role: member,reader Nov 01 18:55:34.155789 n-d-863052-2 devstack@n-api.service[121403]: X-Roles: member,reader Nov 01 18:55:34.157065 n-d-863052-2 devstack@n-api.service[121403]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/c8ab2b7c511b44f4aec6e3574f35e10a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/c8ab2b7c511b44f4aec6e3574f35e10a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_c8ab2b7c511b44f4aec6e3574f35e10a", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/c8ab2b7c511b44f4aec6e3574f35e10a"}]}] Nov 01 18:55:34.157065 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1729339004 Nov 01 18:55:34.157065 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant-Id: c8ab2b7c511b44f4aec6e3574f35e10a Nov 01 18:55:34.157065 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1729339004 Nov 01 18:55:34.157065 n-d-863052-2 devstack@n-api.service[121403]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1729339004-project Nov 01 18:55:34.157065 n-d-863052-2 devstack@n-api.service[121403]: X-User-Domain-Id: default Nov 01 18:55:34.157065 n-d-863052-2 devstack@n-api.service[121403]: X-User-Domain-Name: Default Nov 01 18:55:34.157065 n-d-863052-2 devstack@n-api.service[121403]: X-User-Id: b3a51b3ff5cb4a5f81dff30d0038ac90 Nov 01 18:55:34.157065 n-d-863052-2 devstack@n-api.service[121403]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1729339004-project Nov 01 18:55:34.157065 n-d-863052-2 devstack@n-api.service[121403]: method: > Nov 01 18:55:34.157065 n-d-863052-2 devstack@n-api.service[121403]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Nov 01 18:55:34.160967 n-d-863052-2 devstack@n-api.service[121403]: action_args: {'flavor_id': '2128110116', 'id': 'hw:numa_nodes'} Nov 01 18:55:34.160967 n-d-863052-2 devstack@n-api.service[121403]: {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 01 18:55:34.160967 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:55:34.160967 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 18:55:34.160967 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 18:55:34.160967 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 01 18:55:34.160967 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 01 18:55:34.160967 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 01 18:55:34.160967 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 01 18:55:34.160967 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 129, in delete Nov 01 18:55:34.160967 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'delete', target={}) Nov 01 18:55:34.160967 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Nov 01 18:55:34.160967 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Nov 01 18:55:34.160967 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Nov 01 18:55:34.160967 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Nov 01 18:55:34.160967 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 01 18:55:34.160967 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 01 18:55:34.160967 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 01 18:55:34.160967 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise self.value Nov 01 18:55:34.160967 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Nov 01 18:55:34.162246 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Nov 01 18:55:34.162246 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Nov 01 18:55:34.162246 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return self.enforce( Nov 01 18:55:34.162246 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Nov 01 18:55:34.162246 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Nov 01 18:55:34.162246 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Nov 01 18:55:34.162246 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 18:55:34.162246 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 18:55:34.162246 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 18:55:34.162246 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:55:34.162246 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 18:55:34.162246 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 18:55:34.162246 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Nov 01 18:55:34.162246 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Nov 01 18:55:34.162246 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Nov 01 18:55:34.162246 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 18:55:34.162246 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-97900d23-980f-4d7d-9eb1-bffe18487eb9 tempest-FlavorsExtraSpecsNegativeTestJSON-1729339004 tempest-FlavorsExtraSpecsNegativeTestJSON-1729339004-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. {{(pid=121403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 01 18:55:34.163371 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-97900d23-980f-4d7d-9eb1-bffe18487eb9 tempest-FlavorsExtraSpecsNegativeTestJSON-1729339004 tempest-FlavorsExtraSpecsNegativeTestJSON-1729339004-project] 10.222.0.13 "DELETE /compute/v2.1/flavors/2128110116/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.023541 Nov 01 18:55:34.163371 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 185/392] 10.222.0.13 () {58 vars in 1248 bytes} [Tue Nov 1 18:55:34 2022] DELETE /compute/v2.1/flavors/2128110116/os-extra_specs/hw:numa_nodes => generated 124 bytes in 26 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Nov 01 18:55:34.170628 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-62ad48d0-abae-4163-b11a-4dbd45dff6e2 tempest-FlavorsExtraSpecsNegativeTestJSON-61345516 tempest-FlavorsExtraSpecsNegativeTestJSON-61345516-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 18:55:34.245134 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-62ad48d0-abae-4163-b11a-4dbd45dff6e2 tempest-FlavorsExtraSpecsNegativeTestJSON-61345516 tempest-FlavorsExtraSpecsNegativeTestJSON-61345516-project-admin] 10.222.0.13 "POST /compute/v2.1/flavors/2128110116/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.078323 Nov 01 18:55:34.252651 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 186/393] 10.222.0.13 () {60 vars in 1224 bytes} [Tue Nov 1 18:55:34 2022] POST /compute/v2.1/flavors/2128110116/os-extra_specs => generated 66 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 01 18:55:34.654595 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-d8f9048b-33c7-473a-ae4d-5cf499593271 tempest-LiveMigrationTest-1695240876 tempest-LiveMigrationTest-1695240876-project-admin] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:55:34.655213 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-d8f9048b-33c7-473a-ae4d-5cf499593271 tempest-LiveMigrationTest-1695240876 tempest-LiveMigrationTest-1695240876-project-admin] [instance: de2ff806-a2fa-4390-b4d5-11ff24dd27ca] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:55:34.663364 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-d8f9048b-33c7-473a-ae4d-5cf499593271 tempest-LiveMigrationTest-1695240876 tempest-LiveMigrationTest-1695240876-project-admin] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:55:34.665089 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-d8f9048b-33c7-473a-ae4d-5cf499593271 tempest-LiveMigrationTest-1695240876 tempest-LiveMigrationTest-1695240876-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:55:34.665728 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-d8f9048b-33c7-473a-ae4d-5cf499593271 tempest-LiveMigrationTest-1695240876 tempest-LiveMigrationTest-1695240876-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:55:34.667705 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-d8f9048b-33c7-473a-ae4d-5cf499593271 tempest-LiveMigrationTest-1695240876 tempest-LiveMigrationTest-1695240876-project-admin] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:55:34.668434 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-d8f9048b-33c7-473a-ae4d-5cf499593271 tempest-LiveMigrationTest-1695240876 tempest-LiveMigrationTest-1695240876-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:55:34.669067 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-d8f9048b-33c7-473a-ae4d-5cf499593271 tempest-LiveMigrationTest-1695240876 tempest-LiveMigrationTest-1695240876-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:55:34.849373 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-cb005c94-7fe3-4594-96a9-78e52c23b58d tempest-QuotasAdminTestJSON-146785592 tempest-QuotasAdminTestJSON-146785592-project-admin] Calling method '.version_select at 0x7f0ae2d9f040>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:55:35.016447 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-d8f9048b-33c7-473a-ae4d-5cf499593271 tempest-LiveMigrationTest-1695240876 tempest-LiveMigrationTest-1695240876-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/de2ff806-a2fa-4390-b4d5-11ff24dd27ca" status: 200 len: 1643 microversion: 2.1 time: 1.026595 Nov 01 18:55:35.018987 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 208/394] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:55:33 2022] GET /compute/v2.1/servers/de2ff806-a2fa-4390-b4d5-11ff24dd27ca => generated 1643 bytes in 1030 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 18:55:35.032908 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-2253f6e2-9408-4095-b089-e02054a2c794 tempest-FlavorsExtraSpecsNegativeTestJSON-1729339004 tempest-FlavorsExtraSpecsNegativeTestJSON-1729339004-project] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1"} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 18:55:35.044882 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-2253f6e2-9408-4095-b089-e02054a2c794 tempest-FlavorsExtraSpecsNegativeTestJSON-1729339004 tempest-FlavorsExtraSpecsNegativeTestJSON-1729339004-project] Policy check for os_compute_api:os-flavor-extra-specs:update failed with credentials {'is_admin': False, 'user_id': 'b3a51b3ff5cb4a5f81dff30d0038ac90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8ab2b7c511b44f4aec6e3574f35e10a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:55:35.046856 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-2253f6e2-9408-4095-b089-e02054a2c794 tempest-FlavorsExtraSpecsNegativeTestJSON-1729339004 tempest-FlavorsExtraSpecsNegativeTestJSON-1729339004-project] Request method failure captured: Nov 01 18:55:35.046856 n-d-863052-2 devstack@n-api.service[121402]: request: PUT /compute/v2.1/flavors/2128110116/os-extra_specs/hw:numa_nodes HTTP/1.1 Nov 01 18:55:35.046856 n-d-863052-2 devstack@n-api.service[121402]: Accept: application/json Nov 01 18:55:35.046856 n-d-863052-2 devstack@n-api.service[121402]: Accept-Encoding: identity Nov 01 18:55:35.046856 n-d-863052-2 devstack@n-api.service[121402]: Connection: close Nov 01 18:55:35.046856 n-d-863052-2 devstack@n-api.service[121402]: Content-Length: 22 Nov 01 18:55:35.046856 n-d-863052-2 devstack@n-api.service[121402]: Content-Type: application/json Nov 01 18:55:35.046856 n-d-863052-2 devstack@n-api.service[121402]: Host: 10.222.0.13 Nov 01 18:55:35.046856 n-d-863052-2 devstack@n-api.service[121402]: Openstack-System-Scope: None Nov 01 18:55:35.046856 n-d-863052-2 devstack@n-api.service[121402]: User-Agent: python-urllib3/1.26.12 Nov 01 18:55:35.046856 n-d-863052-2 devstack@n-api.service[121402]: X-Auth-Token: gAAAAABjYWujBuYvk8G6GEDcP3wNNGPTYIaK7gdhqETS-pAcvao4jie89aN5YR41_QUnr1tYe4iB51Rta2Y8Ig29Iiy6ddjVTUm5jR3gyvgg_VJ5T0TT5SYYrzrUtS1Is7MlFnaEXcqMFDxN45eUzMExdGL12kgJX4dpV6TSEewKav-obG_i_Pg Nov 01 18:55:35.046856 n-d-863052-2 devstack@n-api.service[121402]: X-Domain-Id: None Nov 01 18:55:35.046856 n-d-863052-2 devstack@n-api.service[121402]: X-Domain-Name: None Nov 01 18:55:35.046856 n-d-863052-2 devstack@n-api.service[121402]: X-Identity-Status: Confirmed Nov 01 18:55:35.046856 n-d-863052-2 devstack@n-api.service[121402]: X-Is-Admin-Project: True Nov 01 18:55:35.046856 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Domain-Id: default Nov 01 18:55:35.046856 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Domain-Name: Default Nov 01 18:55:35.046856 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Id: c8ab2b7c511b44f4aec6e3574f35e10a Nov 01 18:55:35.046856 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1729339004 Nov 01 18:55:35.046856 n-d-863052-2 devstack@n-api.service[121402]: X-Role: member,reader Nov 01 18:55:35.046856 n-d-863052-2 devstack@n-api.service[121402]: X-Roles: member,reader Nov 01 18:55:35.047993 n-d-863052-2 devstack@n-api.service[121402]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/c8ab2b7c511b44f4aec6e3574f35e10a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/c8ab2b7c511b44f4aec6e3574f35e10a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_c8ab2b7c511b44f4aec6e3574f35e10a", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/c8ab2b7c511b44f4aec6e3574f35e10a"}]}] Nov 01 18:55:35.047993 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1729339004 Nov 01 18:55:35.047993 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant-Id: c8ab2b7c511b44f4aec6e3574f35e10a Nov 01 18:55:35.047993 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1729339004 Nov 01 18:55:35.047993 n-d-863052-2 devstack@n-api.service[121402]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1729339004-project Nov 01 18:55:35.047993 n-d-863052-2 devstack@n-api.service[121402]: X-User-Domain-Id: default Nov 01 18:55:35.047993 n-d-863052-2 devstack@n-api.service[121402]: X-User-Domain-Name: Default Nov 01 18:55:35.047993 n-d-863052-2 devstack@n-api.service[121402]: X-User-Id: b3a51b3ff5cb4a5f81dff30d0038ac90 Nov 01 18:55:35.047993 n-d-863052-2 devstack@n-api.service[121402]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1729339004-project Nov 01 18:55:35.047993 n-d-863052-2 devstack@n-api.service[121402]: Nov 01 18:55:35.047993 n-d-863052-2 devstack@n-api.service[121402]: {"hw:numa_nodes": "1"} Nov 01 18:55:35.047993 n-d-863052-2 devstack@n-api.service[121402]: method: > Nov 01 18:55:35.047993 n-d-863052-2 devstack@n-api.service[121402]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Nov 01 18:55:35.048764 n-d-863052-2 devstack@n-api.service[121402]: action_args: {'flavor_id': '2128110116', 'id': 'hw:numa_nodes', 'body': {'hw:numa_nodes': '1'}} Nov 01 18:55:35.048764 n-d-863052-2 devstack@n-api.service[121402]: {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 01 18:55:35.048764 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:55:35.048764 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 18:55:35.048764 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 18:55:35.048764 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 01 18:55:35.048764 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 01 18:55:35.048764 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 01 18:55:35.048764 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 01 18:55:35.048764 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 01 18:55:35.048764 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 01 18:55:35.048764 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 91, in update Nov 01 18:55:35.048764 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'update', target={}) Nov 01 18:55:35.048764 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Nov 01 18:55:35.048764 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Nov 01 18:55:35.048764 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Nov 01 18:55:35.048764 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Nov 01 18:55:35.048764 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 01 18:55:35.048764 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 01 18:55:35.050398 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 01 18:55:35.050398 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise self.value Nov 01 18:55:35.050398 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Nov 01 18:55:35.050398 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Nov 01 18:55:35.050398 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Nov 01 18:55:35.050398 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return self.enforce( Nov 01 18:55:35.050398 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Nov 01 18:55:35.050398 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Nov 01 18:55:35.050398 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Nov 01 18:55:35.050398 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 18:55:35.050398 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 18:55:35.050398 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 18:55:35.050398 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:55:35.050398 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 18:55:35.050398 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 18:55:35.050398 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Nov 01 18:55:35.050398 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Nov 01 18:55:35.050398 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Nov 01 18:55:35.050398 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 18:55:35.053477 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-2253f6e2-9408-4095-b089-e02054a2c794 tempest-FlavorsExtraSpecsNegativeTestJSON-1729339004 tempest-FlavorsExtraSpecsNegativeTestJSON-1729339004-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. {{(pid=121402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 01 18:55:35.053477 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-2253f6e2-9408-4095-b089-e02054a2c794 tempest-FlavorsExtraSpecsNegativeTestJSON-1729339004 tempest-FlavorsExtraSpecsNegativeTestJSON-1729339004-project] 10.222.0.13 "PUT /compute/v2.1/flavors/2128110116/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.028193 Nov 01 18:55:35.053477 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 209/395] 10.222.0.13 () {60 vars in 1265 bytes} [Tue Nov 1 18:55:35 2022] PUT /compute/v2.1/flavors/2128110116/os-extra_specs/hw:numa_nodes => generated 124 bytes in 29 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Nov 01 18:55:35.056680 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-29789d80-1d66-43a7-8963-88da33208ed3 tempest-LiveMigrationTest-1695240876 tempest-LiveMigrationTest-1695240876-project-admin] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:55:35.059850 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-29789d80-1d66-43a7-8963-88da33208ed3 tempest-LiveMigrationTest-1695240876 tempest-LiveMigrationTest-1695240876-project-admin] [instance: de2ff806-a2fa-4390-b4d5-11ff24dd27ca] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:55:35.081286 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-29789d80-1d66-43a7-8963-88da33208ed3 tempest-LiveMigrationTest-1695240876 tempest-LiveMigrationTest-1695240876-project-admin] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:55:35.082148 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-29789d80-1d66-43a7-8963-88da33208ed3 tempest-LiveMigrationTest-1695240876 tempest-LiveMigrationTest-1695240876-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:55:35.082761 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-29789d80-1d66-43a7-8963-88da33208ed3 tempest-LiveMigrationTest-1695240876 tempest-LiveMigrationTest-1695240876-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:55:35.083731 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-29789d80-1d66-43a7-8963-88da33208ed3 tempest-LiveMigrationTest-1695240876 tempest-LiveMigrationTest-1695240876-project-admin] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:55:35.084357 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-29789d80-1d66-43a7-8963-88da33208ed3 tempest-LiveMigrationTest-1695240876 tempest-LiveMigrationTest-1695240876-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:55:35.084979 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-29789d80-1d66-43a7-8963-88da33208ed3 tempest-LiveMigrationTest-1695240876 tempest-LiveMigrationTest-1695240876-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:55:35.096232 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-cb005c94-7fe3-4594-96a9-78e52c23b58d tempest-QuotasAdminTestJSON-146785592 tempest-QuotasAdminTestJSON-146785592-project-admin] 10.222.0.13 "GET /compute/v2.1/os-quota-sets/d00948c80c4e4d7cadba73bf7a023a28" status: 200 len: 371 microversion: 2.1 time: 0.841161 Nov 01 18:55:35.098204 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 187/396] 10.222.0.13 () {58 vars in 1242 bytes} [Tue Nov 1 18:55:34 2022] GET /compute/v2.1/os-quota-sets/d00948c80c4e4d7cadba73bf7a023a28 => generated 371 bytes in 845 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 18:55:35.109160 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-da1c809a-919b-4698-97c4-47a9d3473cd8 tempest-FlavorsExtraSpecsNegativeTestJSON-61345516 tempest-FlavorsExtraSpecsNegativeTestJSON-61345516-project-admin] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:55:35.137852 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.wsgi [None req-da1c809a-919b-4698-97c4-47a9d3473cd8 tempest-FlavorsExtraSpecsNegativeTestJSON-61345516 tempest-FlavorsExtraSpecsNegativeTestJSON-61345516-project-admin] HTTP exception thrown: Flavor 2128110116 has no extra specs with key hw:cpu_thread_policy. Nov 01 18:55:35.139360 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-da1c809a-919b-4698-97c4-47a9d3473cd8 tempest-FlavorsExtraSpecsNegativeTestJSON-61345516 tempest-FlavorsExtraSpecsNegativeTestJSON-61345516-project-admin] Request method failure captured: Nov 01 18:55:35.139360 n-d-863052-2 devstack@n-api.service[121403]: request: DELETE /compute/v2.1/flavors/2128110116/os-extra_specs/hw:cpu_thread_policy HTTP/1.1 Nov 01 18:55:35.139360 n-d-863052-2 devstack@n-api.service[121403]: Accept: application/json Nov 01 18:55:35.139360 n-d-863052-2 devstack@n-api.service[121403]: Accept-Encoding: identity Nov 01 18:55:35.139360 n-d-863052-2 devstack@n-api.service[121403]: Connection: close Nov 01 18:55:35.139360 n-d-863052-2 devstack@n-api.service[121403]: Content-Length: 0 Nov 01 18:55:35.139360 n-d-863052-2 devstack@n-api.service[121403]: Content-Type: application/json Nov 01 18:55:35.139360 n-d-863052-2 devstack@n-api.service[121403]: Host: 10.222.0.13 Nov 01 18:55:35.139360 n-d-863052-2 devstack@n-api.service[121403]: Openstack-System-Scope: None Nov 01 18:55:35.139360 n-d-863052-2 devstack@n-api.service[121403]: User-Agent: python-urllib3/1.26.12 Nov 01 18:55:35.139360 n-d-863052-2 devstack@n-api.service[121403]: X-Auth-Token: gAAAAABjYWukDowLDZIbVlNDDX1NP_wj9g3yRXU5Bk5TG1A1KKd_VHPYng59niYZBImuWaM7onTkPxa9EDhu1uNGn08yOhg7KdK_zKPtKDexWQZh2pDutAIhMmvYWE-25r34nUwxrp2zvp0nw4L-RzFuWH-ZHO4-dRWevD1vUzNQW_yGo5v_v-4 Nov 01 18:55:35.139360 n-d-863052-2 devstack@n-api.service[121403]: X-Domain-Id: None Nov 01 18:55:35.139360 n-d-863052-2 devstack@n-api.service[121403]: X-Domain-Name: None Nov 01 18:55:35.139360 n-d-863052-2 devstack@n-api.service[121403]: X-Identity-Status: Confirmed Nov 01 18:55:35.139360 n-d-863052-2 devstack@n-api.service[121403]: X-Is-Admin-Project: True Nov 01 18:55:35.139360 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Domain-Id: default Nov 01 18:55:35.139360 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Domain-Name: Default Nov 01 18:55:35.139360 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Id: 9fc07bb136614108857e0806af16bb7d Nov 01 18:55:35.139360 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-61345516 Nov 01 18:55:35.139360 n-d-863052-2 devstack@n-api.service[121403]: X-Role: admin,member,reader Nov 01 18:55:35.139360 n-d-863052-2 devstack@n-api.service[121403]: X-Roles: admin,member,reader Nov 01 18:55:35.140614 n-d-863052-2 devstack@n-api.service[121403]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/9fc07bb136614108857e0806af16bb7d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/9fc07bb136614108857e0806af16bb7d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_9fc07bb136614108857e0806af16bb7d", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/9fc07bb136614108857e0806af16bb7d"}]}] Nov 01 18:55:35.140614 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-61345516 Nov 01 18:55:35.140614 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant-Id: 9fc07bb136614108857e0806af16bb7d Nov 01 18:55:35.140614 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-61345516 Nov 01 18:55:35.140614 n-d-863052-2 devstack@n-api.service[121403]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-61345516-project-admin Nov 01 18:55:35.140614 n-d-863052-2 devstack@n-api.service[121403]: X-User-Domain-Id: default Nov 01 18:55:35.140614 n-d-863052-2 devstack@n-api.service[121403]: X-User-Domain-Name: Default Nov 01 18:55:35.140614 n-d-863052-2 devstack@n-api.service[121403]: X-User-Id: 34523c9f71e94645858356c489752572 Nov 01 18:55:35.140614 n-d-863052-2 devstack@n-api.service[121403]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-61345516-project-admin Nov 01 18:55:35.140614 n-d-863052-2 devstack@n-api.service[121403]: method: > Nov 01 18:55:35.140614 n-d-863052-2 devstack@n-api.service[121403]: exception: Flavor 2128110116 has no extra specs with key hw:cpu_thread_policy. Nov 01 18:55:35.141266 n-d-863052-2 devstack@n-api.service[121403]: action_args: {'flavor_id': '2128110116', 'id': 'hw:cpu_thread_policy'} Nov 01 18:55:35.141266 n-d-863052-2 devstack@n-api.service[121403]: {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 01 18:55:35.141266 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:55:35.141266 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 132, in delete Nov 01 18:55:35.141266 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi del flavor.extra_specs[id] Nov 01 18:55:35.141266 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi KeyError: 'hw:cpu_thread_policy' Nov 01 18:55:35.141266 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 18:55:35.141266 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 18:55:35.141266 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 18:55:35.141266 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:55:35.141266 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 18:55:35.141266 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 18:55:35.141266 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 01 18:55:35.141266 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 01 18:55:35.141266 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 01 18:55:35.141266 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 01 18:55:35.141266 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 141, in delete Nov 01 18:55:35.141266 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Nov 01 18:55:35.141266 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 2128110116 has no extra specs with key hw:cpu_thread_policy. Nov 01 18:55:35.141266 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 18:55:35.141266 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 18:55:35.141266 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 18:55:35.142529 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:55:35.142529 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 18:55:35.142529 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 18:55:35.142529 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 01 18:55:35.142529 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 01 18:55:35.142529 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 2128110116 has no extra specs with key hw:cpu_thread_policy. Nov 01 18:55:35.142529 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 18:55:35.142529 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-da1c809a-919b-4698-97c4-47a9d3473cd8 tempest-FlavorsExtraSpecsNegativeTestJSON-61345516 tempest-FlavorsExtraSpecsNegativeTestJSON-61345516-project-admin] Returning 404 to user: Flavor 2128110116 has no extra specs with key hw:cpu_thread_policy. {{(pid=121403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 01 18:55:35.165720 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-da1c809a-919b-4698-97c4-47a9d3473cd8 tempest-FlavorsExtraSpecsNegativeTestJSON-61345516 tempest-FlavorsExtraSpecsNegativeTestJSON-61345516-project-admin] 10.222.0.13 "DELETE /compute/v2.1/flavors/2128110116/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 113 microversion: 2.1 time: 0.065654 Nov 01 18:55:35.166318 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 188/397] 10.222.0.13 () {58 vars in 1269 bytes} [Tue Nov 1 18:55:35 2022] DELETE /compute/v2.1/flavors/2128110116/os-extra_specs/hw:cpu_thread_policy => generated 113 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 01 18:55:35.182570 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-6f303ea8-5cbb-4092-9cec-ffd21028450f tempest-QuotasAdminTestJSON-146785592 tempest-QuotasAdminTestJSON-146785592-project-admin] Action: 'update', calling method: .version_select at 0x7f0ae2cdcaf0>, body: {"quota_set": {"ram": "5120"}} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 18:55:35.565259 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-29789d80-1d66-43a7-8963-88da33208ed3 tempest-LiveMigrationTest-1695240876 tempest-LiveMigrationTest-1695240876-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/de2ff806-a2fa-4390-b4d5-11ff24dd27ca" status: 200 len: 1643 microversion: 2.1 time: 0.515374 Nov 01 18:55:35.572973 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 210/398] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:55:35 2022] GET /compute/v2.1/servers/de2ff806-a2fa-4390-b4d5-11ff24dd27ca => generated 1643 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:55:35.577914 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-3f70ac76-de22-4eb9-af33-b12f4b69ab07 tempest-FlavorsExtraSpecsNegativeTestJSON-61345516 tempest-FlavorsExtraSpecsNegativeTestJSON-61345516-project-admin] Action: 'update', calling method: >, body: {"hw:cpu_policy": "shared"} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 18:55:35.581619 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.wsgi [None req-3f70ac76-de22-4eb9-af33-b12f4b69ab07 tempest-FlavorsExtraSpecsNegativeTestJSON-61345516 tempest-FlavorsExtraSpecsNegativeTestJSON-61345516-project-admin] HTTP exception thrown: Request body and URI mismatch Nov 01 18:55:35.587200 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-3f70ac76-de22-4eb9-af33-b12f4b69ab07 tempest-FlavorsExtraSpecsNegativeTestJSON-61345516 tempest-FlavorsExtraSpecsNegativeTestJSON-61345516-project-admin] Request method failure captured: Nov 01 18:55:35.587200 n-d-863052-2 devstack@n-api.service[121402]: request: PUT /compute/v2.1/flavors/2128110116/os-extra_specs/hw:numa_nodes HTTP/1.1 Nov 01 18:55:35.587200 n-d-863052-2 devstack@n-api.service[121402]: Accept: application/json Nov 01 18:55:35.587200 n-d-863052-2 devstack@n-api.service[121402]: Accept-Encoding: identity Nov 01 18:55:35.587200 n-d-863052-2 devstack@n-api.service[121402]: Connection: close Nov 01 18:55:35.587200 n-d-863052-2 devstack@n-api.service[121402]: Content-Length: 27 Nov 01 18:55:35.587200 n-d-863052-2 devstack@n-api.service[121402]: Content-Type: application/json Nov 01 18:55:35.587200 n-d-863052-2 devstack@n-api.service[121402]: Host: 10.222.0.13 Nov 01 18:55:35.587200 n-d-863052-2 devstack@n-api.service[121402]: Openstack-System-Scope: None Nov 01 18:55:35.587200 n-d-863052-2 devstack@n-api.service[121402]: User-Agent: python-urllib3/1.26.12 Nov 01 18:55:35.587200 n-d-863052-2 devstack@n-api.service[121402]: X-Auth-Token: gAAAAABjYWukDowLDZIbVlNDDX1NP_wj9g3yRXU5Bk5TG1A1KKd_VHPYng59niYZBImuWaM7onTkPxa9EDhu1uNGn08yOhg7KdK_zKPtKDexWQZh2pDutAIhMmvYWE-25r34nUwxrp2zvp0nw4L-RzFuWH-ZHO4-dRWevD1vUzNQW_yGo5v_v-4 Nov 01 18:55:35.587200 n-d-863052-2 devstack@n-api.service[121402]: X-Domain-Id: None Nov 01 18:55:35.587200 n-d-863052-2 devstack@n-api.service[121402]: X-Domain-Name: None Nov 01 18:55:35.587200 n-d-863052-2 devstack@n-api.service[121402]: X-Identity-Status: Confirmed Nov 01 18:55:35.587200 n-d-863052-2 devstack@n-api.service[121402]: X-Is-Admin-Project: True Nov 01 18:55:35.587200 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Domain-Id: default Nov 01 18:55:35.587200 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Domain-Name: Default Nov 01 18:55:35.587200 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Id: 9fc07bb136614108857e0806af16bb7d Nov 01 18:55:35.587200 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-61345516 Nov 01 18:55:35.587200 n-d-863052-2 devstack@n-api.service[121402]: X-Role: admin,member,reader Nov 01 18:55:35.587200 n-d-863052-2 devstack@n-api.service[121402]: X-Roles: admin,member,reader Nov 01 18:55:35.588630 n-d-863052-2 devstack@n-api.service[121402]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/9fc07bb136614108857e0806af16bb7d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/9fc07bb136614108857e0806af16bb7d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_9fc07bb136614108857e0806af16bb7d", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/9fc07bb136614108857e0806af16bb7d"}]}] Nov 01 18:55:35.588630 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-61345516 Nov 01 18:55:35.588630 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant-Id: 9fc07bb136614108857e0806af16bb7d Nov 01 18:55:35.588630 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-61345516 Nov 01 18:55:35.588630 n-d-863052-2 devstack@n-api.service[121402]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-61345516-project-admin Nov 01 18:55:35.588630 n-d-863052-2 devstack@n-api.service[121402]: X-User-Domain-Id: default Nov 01 18:55:35.588630 n-d-863052-2 devstack@n-api.service[121402]: X-User-Domain-Name: Default Nov 01 18:55:35.588630 n-d-863052-2 devstack@n-api.service[121402]: X-User-Id: 34523c9f71e94645858356c489752572 Nov 01 18:55:35.588630 n-d-863052-2 devstack@n-api.service[121402]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-61345516-project-admin Nov 01 18:55:35.588630 n-d-863052-2 devstack@n-api.service[121402]: Nov 01 18:55:35.588630 n-d-863052-2 devstack@n-api.service[121402]: {"hw:cpu_policy": "shared"} Nov 01 18:55:35.588630 n-d-863052-2 devstack@n-api.service[121402]: method: > Nov 01 18:55:35.588630 n-d-863052-2 devstack@n-api.service[121402]: exception: Request body and URI mismatch Nov 01 18:55:35.589410 n-d-863052-2 devstack@n-api.service[121402]: action_args: {'flavor_id': '2128110116', 'id': 'hw:numa_nodes', 'body': {'hw:cpu_policy': 'shared'}} Nov 01 18:55:35.589410 n-d-863052-2 devstack@n-api.service[121402]: {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 01 18:55:35.589410 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:55:35.589410 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 18:55:35.589410 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 18:55:35.589410 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 01 18:55:35.589410 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 01 18:55:35.589410 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 01 18:55:35.589410 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 01 18:55:35.589410 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 01 18:55:35.589410 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 01 18:55:35.589410 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 96, in update Nov 01 18:55:35.589410 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=expl) Nov 01 18:55:35.589410 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Request body and URI mismatch Nov 01 18:55:35.589410 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 18:55:35.589410 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 18:55:35.589410 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 18:55:35.589410 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:55:35.589410 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 18:55:35.589410 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 18:55:35.590568 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 01 18:55:35.590568 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 01 18:55:35.590568 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Request body and URI mismatch Nov 01 18:55:35.590568 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 18:55:35.593833 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-3f70ac76-de22-4eb9-af33-b12f4b69ab07 tempest-FlavorsExtraSpecsNegativeTestJSON-61345516 tempest-FlavorsExtraSpecsNegativeTestJSON-61345516-project-admin] Returning 400 to user: Request body and URI mismatch {{(pid=121402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 01 18:55:35.596936 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-3f70ac76-de22-4eb9-af33-b12f4b69ab07 tempest-FlavorsExtraSpecsNegativeTestJSON-61345516 tempest-FlavorsExtraSpecsNegativeTestJSON-61345516-project-admin] 10.222.0.13 "PUT /compute/v2.1/flavors/2128110116/os-extra_specs/hw:numa_nodes" status: 400 len: 73 microversion: 2.1 time: 0.022686 Nov 01 18:55:35.603461 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 211/399] 10.222.0.13 () {60 vars in 1265 bytes} [Tue Nov 1 18:55:35 2022] PUT /compute/v2.1/flavors/2128110116/os-extra_specs/hw:numa_nodes => generated 73 bytes in 30 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Nov 01 18:55:35.618326 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-2579153b-14b7-4575-b517-ddf0600b3f2b tempest-LiveMigrationTest-1695240876 tempest-LiveMigrationTest-1695240876-project-admin] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:55:35.623258 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2579153b-14b7-4575-b517-ddf0600b3f2b tempest-LiveMigrationTest-1695240876 tempest-LiveMigrationTest-1695240876-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:55:35.623751 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2579153b-14b7-4575-b517-ddf0600b3f2b tempest-LiveMigrationTest-1695240876 tempest-LiveMigrationTest-1695240876-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:55:35.624195 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2579153b-14b7-4575-b517-ddf0600b3f2b tempest-LiveMigrationTest-1695240876 tempest-LiveMigrationTest-1695240876-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:55:35.628446 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2579153b-14b7-4575-b517-ddf0600b3f2b tempest-LiveMigrationTest-1695240876 tempest-LiveMigrationTest-1695240876-project-admin] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:55:35.629314 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2579153b-14b7-4575-b517-ddf0600b3f2b tempest-LiveMigrationTest-1695240876 tempest-LiveMigrationTest-1695240876-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:55:35.629754 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2579153b-14b7-4575-b517-ddf0600b3f2b tempest-LiveMigrationTest-1695240876 tempest-LiveMigrationTest-1695240876-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:55:35.692395 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-2579153b-14b7-4575-b517-ddf0600b3f2b tempest-LiveMigrationTest-1695240876 tempest-LiveMigrationTest-1695240876-project-admin] 10.222.0.13 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.087822 Nov 01 18:55:35.693044 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 212/400] 10.222.0.13 () {58 vars in 1176 bytes} [Tue Nov 1 18:55:35 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 18:55:35.709750 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-1348db89-29d7-4b29-8a73-0b09e1f0483e tempest-FlavorsExtraSpecsNegativeTestJSON-61345516 tempest-FlavorsExtraSpecsNegativeTestJSON-61345516-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 18:55:35.726208 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-1348db89-29d7-4b29-8a73-0b09e1f0483e tempest-FlavorsExtraSpecsNegativeTestJSON-61345516 tempest-FlavorsExtraSpecsNegativeTestJSON-61345516-project-admin] Request method failure captured: Nov 01 18:55:35.726208 n-d-863052-2 devstack@n-api.service[121402]: request: PUT /compute/v2.1/flavors/2128110116/os-extra_specs/hw:numa_nodes HTTP/1.1 Nov 01 18:55:35.726208 n-d-863052-2 devstack@n-api.service[121402]: Accept: application/json Nov 01 18:55:35.726208 n-d-863052-2 devstack@n-api.service[121402]: Accept-Encoding: identity Nov 01 18:55:35.726208 n-d-863052-2 devstack@n-api.service[121402]: Connection: close Nov 01 18:55:35.726208 n-d-863052-2 devstack@n-api.service[121402]: Content-Length: 49 Nov 01 18:55:35.726208 n-d-863052-2 devstack@n-api.service[121402]: Content-Type: application/json Nov 01 18:55:35.726208 n-d-863052-2 devstack@n-api.service[121402]: Host: 10.222.0.13 Nov 01 18:55:35.726208 n-d-863052-2 devstack@n-api.service[121402]: Openstack-System-Scope: None Nov 01 18:55:35.726208 n-d-863052-2 devstack@n-api.service[121402]: User-Agent: python-urllib3/1.26.12 Nov 01 18:55:35.726208 n-d-863052-2 devstack@n-api.service[121402]: X-Auth-Token: gAAAAABjYWukDowLDZIbVlNDDX1NP_wj9g3yRXU5Bk5TG1A1KKd_VHPYng59niYZBImuWaM7onTkPxa9EDhu1uNGn08yOhg7KdK_zKPtKDexWQZh2pDutAIhMmvYWE-25r34nUwxrp2zvp0nw4L-RzFuWH-ZHO4-dRWevD1vUzNQW_yGo5v_v-4 Nov 01 18:55:35.726208 n-d-863052-2 devstack@n-api.service[121402]: X-Domain-Id: None Nov 01 18:55:35.726208 n-d-863052-2 devstack@n-api.service[121402]: X-Domain-Name: None Nov 01 18:55:35.726208 n-d-863052-2 devstack@n-api.service[121402]: X-Identity-Status: Confirmed Nov 01 18:55:35.726208 n-d-863052-2 devstack@n-api.service[121402]: X-Is-Admin-Project: True Nov 01 18:55:35.726208 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Domain-Id: default Nov 01 18:55:35.726208 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Domain-Name: Default Nov 01 18:55:35.726208 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Id: 9fc07bb136614108857e0806af16bb7d Nov 01 18:55:35.726208 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-61345516 Nov 01 18:55:35.726208 n-d-863052-2 devstack@n-api.service[121402]: X-Role: admin,member,reader Nov 01 18:55:35.726208 n-d-863052-2 devstack@n-api.service[121402]: X-Roles: admin,member,reader Nov 01 18:55:35.727557 n-d-863052-2 devstack@n-api.service[121402]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/9fc07bb136614108857e0806af16bb7d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/9fc07bb136614108857e0806af16bb7d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_9fc07bb136614108857e0806af16bb7d", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/9fc07bb136614108857e0806af16bb7d"}]}] Nov 01 18:55:35.727557 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-61345516 Nov 01 18:55:35.727557 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant-Id: 9fc07bb136614108857e0806af16bb7d Nov 01 18:55:35.727557 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-61345516 Nov 01 18:55:35.727557 n-d-863052-2 devstack@n-api.service[121402]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-61345516-project-admin Nov 01 18:55:35.727557 n-d-863052-2 devstack@n-api.service[121402]: X-User-Domain-Id: default Nov 01 18:55:35.727557 n-d-863052-2 devstack@n-api.service[121402]: X-User-Domain-Name: Default Nov 01 18:55:35.727557 n-d-863052-2 devstack@n-api.service[121402]: X-User-Id: 34523c9f71e94645858356c489752572 Nov 01 18:55:35.727557 n-d-863052-2 devstack@n-api.service[121402]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-61345516-project-admin Nov 01 18:55:35.727557 n-d-863052-2 devstack@n-api.service[121402]: Nov 01 18:55:35.727557 n-d-863052-2 devstack@n-api.service[121402]: {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"} Nov 01 18:55:35.727557 n-d-863052-2 devstack@n-api.service[121402]: method: > Nov 01 18:55:35.728234 n-d-863052-2 devstack@n-api.service[121402]: exception: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Nov 01 18:55:35.728234 n-d-863052-2 devstack@n-api.service[121402]: action_args: {'flavor_id': '2128110116', 'id': 'hw:numa_nodes', 'body': {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'}} Nov 01 18:55:35.728234 n-d-863052-2 devstack@n-api.service[121402]: {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 01 18:55:35.728234 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:55:35.728234 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Nov 01 18:55:35.728234 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Nov 01 18:55:35.728234 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Nov 01 18:55:35.728234 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise error Nov 01 18:55:35.728234 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Nov 01 18:55:35.728234 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 18:55:35.728234 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Failed validating 'maxProperties' in schema: Nov 01 18:55:35.728234 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Nov 01 18:55:35.728234 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi 'maxProperties': 1, Nov 01 18:55:35.728234 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi 'minProperties': 1, Nov 01 18:55:35.728234 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Nov 01 18:55:35.728234 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi 'type': ['string', Nov 01 18:55:35.728234 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi 'number']}}, Nov 01 18:55:35.728234 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi 'type': 'object'} Nov 01 18:55:35.728234 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 18:55:35.728234 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi On instance: Nov 01 18:55:35.728234 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi {'hw:cpu_policy': 'shared', 'hw:numa_nodes': '1'} Nov 01 18:55:35.728234 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 18:55:35.730156 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 18:55:35.730156 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 18:55:35.730156 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:55:35.730156 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 18:55:35.730156 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 18:55:35.730156 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 01 18:55:35.730156 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 01 18:55:35.730156 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 01 18:55:35.730156 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 01 18:55:35.730156 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Nov 01 18:55:35.730156 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Nov 01 18:55:35.730156 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Nov 01 18:55:35.730156 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Nov 01 18:55:35.730156 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Nov 01 18:55:35.730156 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Nov 01 18:55:35.730156 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Nov 01 18:55:35.730156 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 18:55:35.730156 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 18:55:35.730156 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 18:55:35.730156 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:55:35.731493 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 18:55:35.731493 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 18:55:35.731493 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Nov 01 18:55:35.731493 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Nov 01 18:55:35.731493 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Nov 01 18:55:35.731493 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 18:55:35.731493 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-1348db89-29d7-4b29-8a73-0b09e1f0483e tempest-FlavorsExtraSpecsNegativeTestJSON-61345516 tempest-FlavorsExtraSpecsNegativeTestJSON-61345516-project-admin] Returning 400 to user: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties {{(pid=121402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 01 18:55:35.731493 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-1348db89-29d7-4b29-8a73-0b09e1f0483e tempest-FlavorsExtraSpecsNegativeTestJSON-61345516 tempest-FlavorsExtraSpecsNegativeTestJSON-61345516-project-admin] 10.222.0.13 "PUT /compute/v2.1/flavors/2128110116/os-extra_specs/hw:numa_nodes" status: 400 len: 117 microversion: 2.1 time: 0.033783 Nov 01 18:55:35.732835 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 213/401] 10.222.0.13 () {60 vars in 1265 bytes} [Tue Nov 1 18:55:35 2022] PUT /compute/v2.1/flavors/2128110116/os-extra_specs/hw:numa_nodes => generated 117 bytes in 38 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 01 18:55:35.737563 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-3220db9a-acf8-46e6-947c-c50f463693a9 tempest-LiveMigrationTest-1695240876 tempest-LiveMigrationTest-1695240876-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-863052-2", "block_migration": true, "disk_over_commit": false}} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 18:55:35.750788 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-3220db9a-acf8-46e6-947c-c50f463693a9 tempest-LiveMigrationTest-1695240876 tempest-LiveMigrationTest-1695240876-project-admin] [instance: de2ff806-a2fa-4390-b4d5-11ff24dd27ca] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:55:35.761536 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-3220db9a-acf8-46e6-947c-c50f463693a9 tempest-LiveMigrationTest-1695240876 tempest-LiveMigrationTest-1695240876-project-admin] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:55:35.762024 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-3220db9a-acf8-46e6-947c-c50f463693a9 tempest-LiveMigrationTest-1695240876 tempest-LiveMigrationTest-1695240876-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:55:35.762735 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-3220db9a-acf8-46e6-947c-c50f463693a9 tempest-LiveMigrationTest-1695240876 tempest-LiveMigrationTest-1695240876-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:55:35.763586 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-3220db9a-acf8-46e6-947c-c50f463693a9 tempest-LiveMigrationTest-1695240876 tempest-LiveMigrationTest-1695240876-project-admin] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:55:35.764267 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-3220db9a-acf8-46e6-947c-c50f463693a9 tempest-LiveMigrationTest-1695240876 tempest-LiveMigrationTest-1695240876-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:55:35.764925 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-3220db9a-acf8-46e6-947c-c50f463693a9 tempest-LiveMigrationTest-1695240876 tempest-LiveMigrationTest-1695240876-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:55:35.844781 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-6f303ea8-5cbb-4092-9cec-ffd21028450f tempest-QuotasAdminTestJSON-146785592 tempest-QuotasAdminTestJSON-146785592-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:55:35.845285 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-6f303ea8-5cbb-4092-9cec-ffd21028450f tempest-QuotasAdminTestJSON-146785592 tempest-QuotasAdminTestJSON-146785592-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:55:35.848183 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-6f303ea8-5cbb-4092-9cec-ffd21028450f tempest-QuotasAdminTestJSON-146785592 tempest-QuotasAdminTestJSON-146785592-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:55:35.848974 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-6f303ea8-5cbb-4092-9cec-ffd21028450f tempest-QuotasAdminTestJSON-146785592 tempest-QuotasAdminTestJSON-146785592-project-admin] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:55:35.849442 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-6f303ea8-5cbb-4092-9cec-ffd21028450f tempest-QuotasAdminTestJSON-146785592 tempest-QuotasAdminTestJSON-146785592-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:55:35.849874 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-6f303ea8-5cbb-4092-9cec-ffd21028450f tempest-QuotasAdminTestJSON-146785592 tempest-QuotasAdminTestJSON-146785592-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:55:36.010379 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-6f303ea8-5cbb-4092-9cec-ffd21028450f tempest-QuotasAdminTestJSON-146785592 tempest-QuotasAdminTestJSON-146785592-project-admin] 10.222.0.13 "PUT /compute/v2.1/os-quota-sets/d00948c80c4e4d7cadba73bf7a023a28" status: 200 len: 328 microversion: 2.1 time: 0.842037 Nov 01 18:55:36.013540 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 189/402] 10.222.0.13 () {60 vars in 1262 bytes} [Tue Nov 1 18:55:35 2022] PUT /compute/v2.1/os-quota-sets/d00948c80c4e4d7cadba73bf7a023a28 => generated 328 bytes in 845 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 18:55:36.021180 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-17b04669-2d2d-44cf-8082-90aac387b9a0 tempest-FlavorsExtraSpecsNegativeTestJSON-61345516 tempest-FlavorsExtraSpecsNegativeTestJSON-61345516-project-admin] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:55:36.071117 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-17b04669-2d2d-44cf-8082-90aac387b9a0 tempest-FlavorsExtraSpecsNegativeTestJSON-61345516 tempest-FlavorsExtraSpecsNegativeTestJSON-61345516-project-admin] 10.222.0.13 "DELETE /compute/v2.1/flavors/2128110116" status: 202 len: 0 microversion: 2.1 time: 0.055019 Nov 01 18:55:36.071757 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 190/403] 10.222.0.13 () {58 vars in 1161 bytes} [Tue Nov 1 18:55:36 2022] DELETE /compute/v2.1/flavors/2128110116 => generated 0 bytes in 56 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 01 18:55:36.080528 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-b8363f1a-ed2b-4f41-a3eb-769b79085c7a tempest-QuotasAdminTestJSON-146785592 tempest-QuotasAdminTestJSON-146785592-project-admin] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:55:36.121466 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-b8363f1a-ed2b-4f41-a3eb-769b79085c7a tempest-QuotasAdminTestJSON-146785592 tempest-QuotasAdminTestJSON-146785592-project-admin] 10.222.0.13 "DELETE /compute/v2.1/os-quota-sets/d00948c80c4e4d7cadba73bf7a023a28" status: 202 len: 0 microversion: 2.1 time: 0.041936 Nov 01 18:55:36.133235 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 191/404] 10.222.0.13 () {58 vars in 1245 bytes} [Tue Nov 1 18:55:36 2022] DELETE /compute/v2.1/os-quota-sets/d00948c80c4e4d7cadba73bf7a023a28 => generated 0 bytes in 61 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 01 18:55:36.142366 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-dc126a2a-db2c-405d-9ee1-12baa31220b7 tempest-FlavorsExtraSpecsNegativeTestJSON-61345516 tempest-FlavorsExtraSpecsNegativeTestJSON-61345516-project-admin] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:55:36.194801 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-dc126a2a-db2c-405d-9ee1-12baa31220b7 tempest-FlavorsExtraSpecsNegativeTestJSON-61345516 tempest-FlavorsExtraSpecsNegativeTestJSON-61345516-project-admin] 10.222.0.13 "GET /compute/v2.1/flavors/detail" status: 200 len: 5818 microversion: 2.1 time: 0.060073 Nov 01 18:55:36.198061 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 192/405] 10.222.0.13 () {58 vars in 1146 bytes} [Tue Nov 1 18:55:36 2022] GET /compute/v2.1/flavors/detail => generated 5818 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:55:36.488005 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.objects.instance [None req-3220db9a-acf8-46e6-947c-c50f463693a9 tempest-LiveMigrationTest-1695240876 tempest-LiveMigrationTest-1695240876-project-admin] Lazy-loading 'flavor' on Instance uuid de2ff806-a2fa-4390-b4d5-11ff24dd27ca {{(pid=121402) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 01 18:55:36.643347 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-ddfcd8aa-4f5f-49b7-a445-f9abafa8c00f tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-263491483", "imageRef": "2d4a0047-1b9e-445f-8af8-1b5c9d93e881", "flavorRef": "452", "networks": [{"uuid": "fca4c402-6e8d-4413-8958-dd7eef1647f7"}]}} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 18:55:36.649578 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-3220db9a-acf8-46e6-947c-c50f463693a9 tempest-LiveMigrationTest-1695240876 tempest-LiveMigrationTest-1695240876-project-admin] [instance: de2ff806-a2fa-4390-b4d5-11ff24dd27ca] Going to try to live migrate instance to n-h2-863052-2 {{(pid=121402) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Nov 01 18:55:36.762889 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.network.neutron [None req-ddfcd8aa-4f5f-49b7-a445-f9abafa8c00f tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] validate_networks() for [('fca4c402-6e8d-4413-8958-dd7eef1647f7', None, None, None, None, None)] {{(pid=121403) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 01 18:55:38.673699 n-d-863052-2 devstack@n-api.service[121402]: DEBUG dbcounter [-] [121402] Writing DB stats nova_cell0:SELECT=28 {{(pid=121402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 18:55:38.885878 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.virt.hardware [None req-ddfcd8aa-4f5f-49b7-a445-f9abafa8c00f tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Flavor limits 0:0:0 {{(pid=121403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 01 18:55:38.886398 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.virt.hardware [None req-ddfcd8aa-4f5f-49b7-a445-f9abafa8c00f tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Image limits 0:0:0 {{(pid=121403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 01 18:55:38.886758 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.virt.hardware [None req-ddfcd8aa-4f5f-49b7-a445-f9abafa8c00f tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Flavor pref 0:0:0 {{(pid=121403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 01 18:55:38.887162 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.virt.hardware [None req-ddfcd8aa-4f5f-49b7-a445-f9abafa8c00f tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Image pref 0:0:0 {{(pid=121403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 01 18:55:38.887613 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.virt.hardware [None req-ddfcd8aa-4f5f-49b7-a445-f9abafa8c00f tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 01 18:55:38.921325 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-ddfcd8aa-4f5f-49b7-a445-f9abafa8c00f tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:55:38.922024 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-ddfcd8aa-4f5f-49b7-a445-f9abafa8c00f tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:55:38.922858 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-ddfcd8aa-4f5f-49b7-a445-f9abafa8c00f tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:55:38.925679 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-ddfcd8aa-4f5f-49b7-a445-f9abafa8c00f tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:55:38.926574 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-ddfcd8aa-4f5f-49b7-a445-f9abafa8c00f tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:55:38.927189 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-ddfcd8aa-4f5f-49b7-a445-f9abafa8c00f tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:55:38.985299 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.quota [None req-ddfcd8aa-4f5f-49b7-a445-f9abafa8c00f tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Getting quotas for project 75730f90ec924cbebd605d6d6d747efe. Resources: {'cores', 'ram', 'instances'} {{(pid=121403) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 01 18:55:39.001687 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.quota [None req-ddfcd8aa-4f5f-49b7-a445-f9abafa8c00f tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Getting quotas for user c2ddf0211c374fe2a0db89546beb8e96 and project 75730f90ec924cbebd605d6d6d747efe. Resources: {'cores', 'ram', 'instances'} {{(pid=121403) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 01 18:55:39.018650 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-ddfcd8aa-4f5f-49b7-a445-f9abafa8c00f tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Going to run 1 instances... {{(pid=121403) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 01 18:55:39.024363 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-ddfcd8aa-4f5f-49b7-a445-f9abafa8c00f tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] [instance: 2d3a927e-a478-40b1-8c92-80396c82f76c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2d4a0047-1b9e-445f-8af8-1b5c9d93e881',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121403) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 01 18:55:39.105992 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-ddfcd8aa-4f5f-49b7-a445-f9abafa8c00f tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 2.905880 Nov 01 18:55:39.109011 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 193/406] 10.222.0.13 () {62 vars in 1188 bytes} [Tue Nov 1 18:55:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 2910 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Nov 01 18:55:39.120960 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-bccf9344-5de4-4c15-ab5e-d2df9985e9a5 tempest-QuotasAdminTestJSON-146785592 tempest-QuotasAdminTestJSON-146785592-project-admin] Calling method '.version_select at 0x7f0ae2d298b0>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:55:39.904897 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-bccf9344-5de4-4c15-ab5e-d2df9985e9a5 tempest-QuotasAdminTestJSON-146785592 tempest-QuotasAdminTestJSON-146785592-project-admin] 10.222.0.13 "GET /compute/v2.1/os-quota-sets/d00948c80c4e4d7cadba73bf7a023a28" status: 200 len: 371 microversion: 2.1 time: 0.773375 Nov 01 18:55:39.906231 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 194/407] 10.222.0.13 () {58 vars in 1242 bytes} [Tue Nov 1 18:55:39 2022] GET /compute/v2.1/os-quota-sets/d00948c80c4e4d7cadba73bf7a023a28 => generated 371 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 18:55:39.917808 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-363a8624-6ffd-482c-ae07-311749aec6f7 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:55:39.922353 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-363a8624-6ffd-482c-ae07-311749aec6f7 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] [instance: 2d3a927e-a478-40b1-8c92-80396c82f76c] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:55:40.043955 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-363a8624-6ffd-482c-ae07-311749aec6f7 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:55:40.065227 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-363a8624-6ffd-482c-ae07-311749aec6f7 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:55:40.066841 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-363a8624-6ffd-482c-ae07-311749aec6f7 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:55:40.072396 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-363a8624-6ffd-482c-ae07-311749aec6f7 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] 10.222.0.13 "GET /compute/v2.1/servers/2d3a927e-a478-40b1-8c92-80396c82f76c" status: 200 len: 1261 microversion: 2.25 time: 0.159886 Nov 01 18:55:40.073300 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 195/408] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 18:55:39 2022] GET /compute/v2.1/servers/2d3a927e-a478-40b1-8c92-80396c82f76c => generated 1261 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 18:55:41.173903 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-40fa246f-f81f-45c6-a069-590732853cc2 tempest-QuotasAdminNegativeTest-1138996703 tempest-QuotasAdminNegativeTest-1138996703-project-admin] Calling method '.version_select at 0x7f0ae2c989d0>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:55:41.805853 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-40fa246f-f81f-45c6-a069-590732853cc2 tempest-QuotasAdminNegativeTest-1138996703 tempest-QuotasAdminNegativeTest-1138996703-project-admin] 10.222.0.13 "GET /compute/v2.1/os-quota-sets/bc1278822def4e9980c698a5d21092af" status: 200 len: 371 microversion: 2.1 time: 1.532923 Nov 01 18:55:41.813823 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 196/409] 10.222.0.13 () {58 vars in 1242 bytes} [Tue Nov 1 18:55:40 2022] GET /compute/v2.1/os-quota-sets/bc1278822def4e9980c698a5d21092af => generated 371 bytes in 1535 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 01 18:55:41.814713 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-be258219-bfc7-4b05-ad88-bc149d61c22d tempest-QuotasAdminTestJSON-146785592 tempest-QuotasAdminTestJSON-146785592-project-admin] Calling method '.version_select at 0x7f0ae2c98f70>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:55:41.920298 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-3220db9a-acf8-46e6-947c-c50f463693a9 tempest-LiveMigrationTest-1695240876 tempest-LiveMigrationTest-1695240876-project-admin] 10.222.0.13 "POST /compute/v2.1/servers/de2ff806-a2fa-4390-b4d5-11ff24dd27ca/action" status: 202 len: 0 microversion: 2.1 time: 6.187093 Nov 01 18:55:41.921033 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 214/410] 10.222.0.13 () {60 vars in 1278 bytes} [Tue Nov 1 18:55:35 2022] POST /compute/v2.1/servers/de2ff806-a2fa-4390-b4d5-11ff24dd27ca/action => generated 0 bytes in 6188 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 01 18:55:41.926952 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-39fd01d9-7bf1-4739-9de1-5915eebe0eb0 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:55:41.927496 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-39fd01d9-7bf1-4739-9de1-5915eebe0eb0 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] [instance: 2d3a927e-a478-40b1-8c92-80396c82f76c] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:55:41.949592 n-d-863052-2 devstack@n-api.service[121402]: DEBUG dbcounter [-] [121402] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=121402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 18:55:41.960396 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-39fd01d9-7bf1-4739-9de1-5915eebe0eb0 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:55:41.961568 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-39fd01d9-7bf1-4739-9de1-5915eebe0eb0 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:55:41.962679 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-39fd01d9-7bf1-4739-9de1-5915eebe0eb0 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:55:41.970319 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-39fd01d9-7bf1-4739-9de1-5915eebe0eb0 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:55:41.973635 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-39fd01d9-7bf1-4739-9de1-5915eebe0eb0 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:55:41.978296 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-39fd01d9-7bf1-4739-9de1-5915eebe0eb0 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:55:42.284825 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-39fd01d9-7bf1-4739-9de1-5915eebe0eb0 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:55:42.300095 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-39fd01d9-7bf1-4739-9de1-5915eebe0eb0 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:55:42.301999 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-39fd01d9-7bf1-4739-9de1-5915eebe0eb0 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:55:42.303522 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-39fd01d9-7bf1-4739-9de1-5915eebe0eb0 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] 10.222.0.13 "GET /compute/v2.1/servers/2d3a927e-a478-40b1-8c92-80396c82f76c" status: 200 len: 1319 microversion: 2.25 time: 0.381647 Nov 01 18:55:42.317888 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 215/411] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 18:55:41 2022] GET /compute/v2.1/servers/2d3a927e-a478-40b1-8c92-80396c82f76c => generated 1319 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 18:55:42.329129 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-e9f5946b-09bd-4174-a0a2-90aa1e0150d5 tempest-QuotasAdminNegativeTest-1138996703 tempest-QuotasAdminNegativeTest-1138996703-project-admin] Action: 'update', calling method: .version_select at 0x7f0ae2d7c700>, body: {"quota_set": {"force": true, "cores": 0}} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 18:55:42.411588 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-be258219-bfc7-4b05-ad88-bc149d61c22d tempest-QuotasAdminTestJSON-146785592 tempest-QuotasAdminTestJSON-146785592-project-admin] 10.222.0.13 "GET /compute/v2.1/os-quota-sets/65f0cf532f66453cae500a307f4d7989/defaults" status: 200 len: 371 microversion: 2.1 time: 0.603702 Nov 01 18:55:42.413044 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 197/412] 10.222.0.13 () {58 vars in 1269 bytes} [Tue Nov 1 18:55:41 2022] GET /compute/v2.1/os-quota-sets/65f0cf532f66453cae500a307f4d7989/defaults => generated 371 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 18:55:42.419606 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-9ac04ad6-1087-4559-abf7-3824eecfc771 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:55:42.420411 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-9ac04ad6-1087-4559-abf7-3824eecfc771 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] [instance: de2ff806-a2fa-4390-b4d5-11ff24dd27ca] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:55:42.427821 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-9ac04ad6-1087-4559-abf7-3824eecfc771 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:55:42.428515 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-9ac04ad6-1087-4559-abf7-3824eecfc771 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:55:42.429185 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-9ac04ad6-1087-4559-abf7-3824eecfc771 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:55:42.430812 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-9ac04ad6-1087-4559-abf7-3824eecfc771 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:55:42.431485 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-9ac04ad6-1087-4559-abf7-3824eecfc771 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:55:42.432091 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-9ac04ad6-1087-4559-abf7-3824eecfc771 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:55:42.633150 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-9ac04ad6-1087-4559-abf7-3824eecfc771 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f32f5fba1976432d938e664c7714e52b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b9d4c236b944f9b2e8e502a50a8f8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:55:42.649777 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-9ac04ad6-1087-4559-abf7-3824eecfc771 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] 10.222.0.13 "GET /compute/v2.1/servers/de2ff806-a2fa-4390-b4d5-11ff24dd27ca" status: 200 len: 1502 microversion: 2.1 time: 0.234473 Nov 01 18:55:42.666748 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 198/413] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:55:42 2022] GET /compute/v2.1/servers/de2ff806-a2fa-4390-b4d5-11ff24dd27ca => generated 1502 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:55:42.934868 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e9f5946b-09bd-4174-a0a2-90aa1e0150d5 tempest-QuotasAdminNegativeTest-1138996703 tempest-QuotasAdminNegativeTest-1138996703-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:55:42.935347 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e9f5946b-09bd-4174-a0a2-90aa1e0150d5 tempest-QuotasAdminNegativeTest-1138996703 tempest-QuotasAdminNegativeTest-1138996703-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:55:42.936468 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e9f5946b-09bd-4174-a0a2-90aa1e0150d5 tempest-QuotasAdminNegativeTest-1138996703 tempest-QuotasAdminNegativeTest-1138996703-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:55:42.938521 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e9f5946b-09bd-4174-a0a2-90aa1e0150d5 tempest-QuotasAdminNegativeTest-1138996703 tempest-QuotasAdminNegativeTest-1138996703-project-admin] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:55:42.939048 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e9f5946b-09bd-4174-a0a2-90aa1e0150d5 tempest-QuotasAdminNegativeTest-1138996703 tempest-QuotasAdminNegativeTest-1138996703-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:55:42.940510 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e9f5946b-09bd-4174-a0a2-90aa1e0150d5 tempest-QuotasAdminNegativeTest-1138996703 tempest-QuotasAdminNegativeTest-1138996703-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:55:43.057716 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-e9f5946b-09bd-4174-a0a2-90aa1e0150d5 tempest-QuotasAdminNegativeTest-1138996703 tempest-QuotasAdminNegativeTest-1138996703-project-admin] 10.222.0.13 "PUT /compute/v2.1/os-quota-sets/bc1278822def4e9980c698a5d21092af" status: 200 len: 328 microversion: 2.1 time: 0.736147 Nov 01 18:55:43.059878 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 216/414] 10.222.0.13 () {60 vars in 1262 bytes} [Tue Nov 1 18:55:42 2022] PUT /compute/v2.1/os-quota-sets/bc1278822def4e9980c698a5d21092af => generated 328 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 18:55:43.101864 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-dedc2604-0237-455a-abfc-eea5bb7ee732 tempest-QuotasAdminTestJSON-146785592 tempest-QuotasAdminTestJSON-146785592-project-admin] Action: 'update', calling method: .version_select at 0x7f0ae2b7cc10>, body: {"quota_set": {"ram": "5120"}} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 18:55:43.281939 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-67f20a72-b6f0-46e3-b93a-a6435dfc4d2c tempest-HypervisorAdminV253TestBase-484556320 tempest-HypervisorAdminV253TestBase-484556320-project-admin] Calling method '.version_select at 0x7f0ae2ce28b0>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:55:43.288631 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-67f20a72-b6f0-46e3-b93a-a6435dfc4d2c tempest-HypervisorAdminV253TestBase-484556320 tempest-HypervisorAdminV253TestBase-484556320-project-admin] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:55:43.289492 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-67f20a72-b6f0-46e3-b93a-a6435dfc4d2c tempest-HypervisorAdminV253TestBase-484556320 tempest-HypervisorAdminV253TestBase-484556320-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:55:43.290227 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-67f20a72-b6f0-46e3-b93a-a6435dfc4d2c tempest-HypervisorAdminV253TestBase-484556320 tempest-HypervisorAdminV253TestBase-484556320-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:55:43.330934 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-67f20a72-b6f0-46e3-b93a-a6435dfc4d2c tempest-HypervisorAdminV253TestBase-484556320 tempest-HypervisorAdminV253TestBase-484556320-project-admin] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:55:43.331742 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-67f20a72-b6f0-46e3-b93a-a6435dfc4d2c tempest-HypervisorAdminV253TestBase-484556320 tempest-HypervisorAdminV253TestBase-484556320-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:55:43.332796 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-67f20a72-b6f0-46e3-b93a-a6435dfc4d2c tempest-HypervisorAdminV253TestBase-484556320 tempest-HypervisorAdminV253TestBase-484556320-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:55:43.399180 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-67f20a72-b6f0-46e3-b93a-a6435dfc4d2c tempest-HypervisorAdminV253TestBase-484556320 tempest-HypervisorAdminV253TestBase-484556320-project-admin] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:55:43.399672 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-67f20a72-b6f0-46e3-b93a-a6435dfc4d2c tempest-HypervisorAdminV253TestBase-484556320 tempest-HypervisorAdminV253TestBase-484556320-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:55:43.400104 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-67f20a72-b6f0-46e3-b93a-a6435dfc4d2c tempest-HypervisorAdminV253TestBase-484556320 tempest-HypervisorAdminV253TestBase-484556320-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:55:43.431783 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-67f20a72-b6f0-46e3-b93a-a6435dfc4d2c tempest-HypervisorAdminV253TestBase-484556320 tempest-HypervisorAdminV253TestBase-484556320-project-admin] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:55:43.432407 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-67f20a72-b6f0-46e3-b93a-a6435dfc4d2c tempest-HypervisorAdminV253TestBase-484556320 tempest-HypervisorAdminV253TestBase-484556320-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:55:43.434621 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-67f20a72-b6f0-46e3-b93a-a6435dfc4d2c tempest-HypervisorAdminV253TestBase-484556320 tempest-HypervisorAdminV253TestBase-484556320-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:55:43.493507 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-67f20a72-b6f0-46e3-b93a-a6435dfc4d2c tempest-HypervisorAdminV253TestBase-484556320 tempest-HypervisorAdminV253TestBase-484556320-project-admin] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:55:43.493836 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-67f20a72-b6f0-46e3-b93a-a6435dfc4d2c tempest-HypervisorAdminV253TestBase-484556320 tempest-HypervisorAdminV253TestBase-484556320-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:55:43.494662 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-67f20a72-b6f0-46e3-b93a-a6435dfc4d2c tempest-HypervisorAdminV253TestBase-484556320 tempest-HypervisorAdminV253TestBase-484556320-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:55:43.517465 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-67f20a72-b6f0-46e3-b93a-a6435dfc4d2c tempest-HypervisorAdminV253TestBase-484556320 tempest-HypervisorAdminV253TestBase-484556320-project-admin] 10.222.0.13 "GET /compute/v2.1/os-hypervisors/detail?with_servers=True" status: 200 len: 1836 microversion: 2.53 time: 0.849365 Nov 01 18:55:43.518065 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 199/415] 10.222.0.13 () {60 vars in 1243 bytes} [Tue Nov 1 18:55:42 2022] GET /compute/v2.1/os-hypervisors/detail?with_servers=True => generated 1836 bytes in 851 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 18:55:43.535571 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-7d49be1d-ea1d-4dea-8ef5-a8bd94c47c9c tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:55:43.536234 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-7d49be1d-ea1d-4dea-8ef5-a8bd94c47c9c tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] [instance: 2d3a927e-a478-40b1-8c92-80396c82f76c] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:55:43.557976 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-7d49be1d-ea1d-4dea-8ef5-a8bd94c47c9c tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:55:43.559271 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-7d49be1d-ea1d-4dea-8ef5-a8bd94c47c9c tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:55:43.559719 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-7d49be1d-ea1d-4dea-8ef5-a8bd94c47c9c tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:55:43.563225 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-7d49be1d-ea1d-4dea-8ef5-a8bd94c47c9c tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:55:43.563722 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-7d49be1d-ea1d-4dea-8ef5-a8bd94c47c9c tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:55:43.564404 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-7d49be1d-ea1d-4dea-8ef5-a8bd94c47c9c tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:55:43.708556 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-7d49be1d-ea1d-4dea-8ef5-a8bd94c47c9c tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:55:43.718487 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-7d49be1d-ea1d-4dea-8ef5-a8bd94c47c9c tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:55:43.729793 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-7d49be1d-ea1d-4dea-8ef5-a8bd94c47c9c tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:55:43.730931 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-7d49be1d-ea1d-4dea-8ef5-a8bd94c47c9c tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] 10.222.0.13 "GET /compute/v2.1/servers/2d3a927e-a478-40b1-8c92-80396c82f76c" status: 200 len: 1319 microversion: 2.25 time: 0.211882 Nov 01 18:55:43.731422 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 200/416] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 18:55:43 2022] GET /compute/v2.1/servers/2d3a927e-a478-40b1-8c92-80396c82f76c => generated 1319 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 18:55:43.809790 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-dedc2604-0237-455a-abfc-eea5bb7ee732 tempest-QuotasAdminTestJSON-146785592 tempest-QuotasAdminTestJSON-146785592-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:55:43.810772 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-dedc2604-0237-455a-abfc-eea5bb7ee732 tempest-QuotasAdminTestJSON-146785592 tempest-QuotasAdminTestJSON-146785592-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:55:43.811581 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-dedc2604-0237-455a-abfc-eea5bb7ee732 tempest-QuotasAdminTestJSON-146785592 tempest-QuotasAdminTestJSON-146785592-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:55:43.812852 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-dedc2604-0237-455a-abfc-eea5bb7ee732 tempest-QuotasAdminTestJSON-146785592 tempest-QuotasAdminTestJSON-146785592-project-admin] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:55:43.814172 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-dedc2604-0237-455a-abfc-eea5bb7ee732 tempest-QuotasAdminTestJSON-146785592 tempest-QuotasAdminTestJSON-146785592-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:55:43.816352 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-dedc2604-0237-455a-abfc-eea5bb7ee732 tempest-QuotasAdminTestJSON-146785592 tempest-QuotasAdminTestJSON-146785592-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:55:43.940458 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-dedc2604-0237-455a-abfc-eea5bb7ee732 tempest-QuotasAdminTestJSON-146785592 tempest-QuotasAdminTestJSON-146785592-project-admin] 10.222.0.13 "PUT /compute/v2.1/os-quota-sets/1bb5da3aea6344dd93fc91756e5274bb" status: 200 len: 328 microversion: 2.1 time: 0.845343 Nov 01 18:55:43.950158 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 217/417] 10.222.0.13 () {60 vars in 1262 bytes} [Tue Nov 1 18:55:43 2022] PUT /compute/v2.1/os-quota-sets/1bb5da3aea6344dd93fc91756e5274bb => generated 328 bytes in 856 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 01 18:55:43.961217 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-f52db7cb-d729-4be6-9097-6fc4f265b375 tempest-HypervisorAdminV253TestBase-484556320 tempest-HypervisorAdminV253TestBase-484556320-project-admin] Calling method '.version_select at 0x7f0ae2ca5310>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:55:43.967065 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f52db7cb-d729-4be6-9097-6fc4f265b375 tempest-HypervisorAdminV253TestBase-484556320 tempest-HypervisorAdminV253TestBase-484556320-project-admin] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:55:43.970226 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f52db7cb-d729-4be6-9097-6fc4f265b375 tempest-HypervisorAdminV253TestBase-484556320 tempest-HypervisorAdminV253TestBase-484556320-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:55:43.970937 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f52db7cb-d729-4be6-9097-6fc4f265b375 tempest-HypervisorAdminV253TestBase-484556320 tempest-HypervisorAdminV253TestBase-484556320-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:55:44.015732 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f52db7cb-d729-4be6-9097-6fc4f265b375 tempest-HypervisorAdminV253TestBase-484556320 tempest-HypervisorAdminV253TestBase-484556320-project-admin] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:55:44.016875 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f52db7cb-d729-4be6-9097-6fc4f265b375 tempest-HypervisorAdminV253TestBase-484556320 tempest-HypervisorAdminV253TestBase-484556320-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:55:44.019483 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f52db7cb-d729-4be6-9097-6fc4f265b375 tempest-HypervisorAdminV253TestBase-484556320 tempest-HypervisorAdminV253TestBase-484556320-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:55:44.075690 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f52db7cb-d729-4be6-9097-6fc4f265b375 tempest-HypervisorAdminV253TestBase-484556320 tempest-HypervisorAdminV253TestBase-484556320-project-admin] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:55:44.076192 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f52db7cb-d729-4be6-9097-6fc4f265b375 tempest-HypervisorAdminV253TestBase-484556320 tempest-HypervisorAdminV253TestBase-484556320-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:55:44.076647 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f52db7cb-d729-4be6-9097-6fc4f265b375 tempest-HypervisorAdminV253TestBase-484556320 tempest-HypervisorAdminV253TestBase-484556320-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:55:44.129217 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-2f185eb7-df89-4fcd-90a1-95cba2ef6016 tempest-QuotasAdminNegativeTest-1518083747 tempest-QuotasAdminNegativeTest-1518083747-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-878241712", "imageRef": "2d4a0047-1b9e-445f-8af8-1b5c9d93e881", "flavorRef": "452"}} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 18:55:44.135997 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f52db7cb-d729-4be6-9097-6fc4f265b375 tempest-HypervisorAdminV253TestBase-484556320 tempest-HypervisorAdminV253TestBase-484556320-project-admin] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:55:44.137370 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f52db7cb-d729-4be6-9097-6fc4f265b375 tempest-HypervisorAdminV253TestBase-484556320 tempest-HypervisorAdminV253TestBase-484556320-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:55:44.138661 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f52db7cb-d729-4be6-9097-6fc4f265b375 tempest-HypervisorAdminV253TestBase-484556320 tempest-HypervisorAdminV253TestBase-484556320-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:55:44.168742 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f52db7cb-d729-4be6-9097-6fc4f265b375 tempest-HypervisorAdminV253TestBase-484556320 tempest-HypervisorAdminV253TestBase-484556320-project-admin] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:55:44.169884 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f52db7cb-d729-4be6-9097-6fc4f265b375 tempest-HypervisorAdminV253TestBase-484556320 tempest-HypervisorAdminV253TestBase-484556320-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:55:44.170498 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f52db7cb-d729-4be6-9097-6fc4f265b375 tempest-HypervisorAdminV253TestBase-484556320 tempest-HypervisorAdminV253TestBase-484556320-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:55:44.179881 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-f52db7cb-d729-4be6-9097-6fc4f265b375 tempest-HypervisorAdminV253TestBase-484556320 tempest-HypervisorAdminV253TestBase-484556320-project-admin] 10.222.0.13 "GET /compute/v2.1/os-hypervisors?with_servers=True" status: 200 len: 528 microversion: 2.53 time: 0.226618 Nov 01 18:55:44.181761 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 218/418] 10.222.0.13 () {60 vars in 1222 bytes} [Tue Nov 1 18:55:43 2022] GET /compute/v2.1/os-hypervisors?with_servers=True => generated 528 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 01 18:55:44.193588 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-c67d6f54-5dca-4b65-905b-02e46863e659 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:55:44.199173 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-c67d6f54-5dca-4b65-905b-02e46863e659 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] [instance: de2ff806-a2fa-4390-b4d5-11ff24dd27ca] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:55:44.212131 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-c67d6f54-5dca-4b65-905b-02e46863e659 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:55:44.220739 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-c67d6f54-5dca-4b65-905b-02e46863e659 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:55:44.222040 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-c67d6f54-5dca-4b65-905b-02e46863e659 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:55:44.223162 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-c67d6f54-5dca-4b65-905b-02e46863e659 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:55:44.224110 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-c67d6f54-5dca-4b65-905b-02e46863e659 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:55:44.227087 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-c67d6f54-5dca-4b65-905b-02e46863e659 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:55:44.235751 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.network.neutron [None req-2f185eb7-df89-4fcd-90a1-95cba2ef6016 tempest-QuotasAdminNegativeTest-1518083747 tempest-QuotasAdminNegativeTest-1518083747-project] validate_networks() for None {{(pid=121403) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 01 18:55:44.281863 n-d-863052-2 devstack@n-api.service[121402]: DEBUG dbcounter [-] [121402] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 18:55:44.551614 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.virt.hardware [None req-2f185eb7-df89-4fcd-90a1-95cba2ef6016 tempest-QuotasAdminNegativeTest-1518083747 tempest-QuotasAdminNegativeTest-1518083747-project] Flavor limits 0:0:0 {{(pid=121403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 01 18:55:44.552220 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.virt.hardware [None req-2f185eb7-df89-4fcd-90a1-95cba2ef6016 tempest-QuotasAdminNegativeTest-1518083747 tempest-QuotasAdminNegativeTest-1518083747-project] Image limits 0:0:0 {{(pid=121403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 01 18:55:44.553374 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.virt.hardware [None req-2f185eb7-df89-4fcd-90a1-95cba2ef6016 tempest-QuotasAdminNegativeTest-1518083747 tempest-QuotasAdminNegativeTest-1518083747-project] Flavor pref 0:0:0 {{(pid=121403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 01 18:55:44.554745 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.virt.hardware [None req-2f185eb7-df89-4fcd-90a1-95cba2ef6016 tempest-QuotasAdminNegativeTest-1518083747 tempest-QuotasAdminNegativeTest-1518083747-project] Image pref 0:0:0 {{(pid=121403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 01 18:55:44.555545 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.virt.hardware [None req-2f185eb7-df89-4fcd-90a1-95cba2ef6016 tempest-QuotasAdminNegativeTest-1518083747 tempest-QuotasAdminNegativeTest-1518083747-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 01 18:55:44.580834 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-2f185eb7-df89-4fcd-90a1-95cba2ef6016 tempest-QuotasAdminNegativeTest-1518083747 tempest-QuotasAdminNegativeTest-1518083747-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:55:44.582814 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-2f185eb7-df89-4fcd-90a1-95cba2ef6016 tempest-QuotasAdminNegativeTest-1518083747 tempest-QuotasAdminNegativeTest-1518083747-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:55:44.584411 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-2f185eb7-df89-4fcd-90a1-95cba2ef6016 tempest-QuotasAdminNegativeTest-1518083747 tempest-QuotasAdminNegativeTest-1518083747-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:55:44.595547 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-2f185eb7-df89-4fcd-90a1-95cba2ef6016 tempest-QuotasAdminNegativeTest-1518083747 tempest-QuotasAdminNegativeTest-1518083747-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:55:44.596442 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-2f185eb7-df89-4fcd-90a1-95cba2ef6016 tempest-QuotasAdminNegativeTest-1518083747 tempest-QuotasAdminNegativeTest-1518083747-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:55:44.597069 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-2f185eb7-df89-4fcd-90a1-95cba2ef6016 tempest-QuotasAdminNegativeTest-1518083747 tempest-QuotasAdminNegativeTest-1518083747-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:55:44.636937 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.quota [None req-2f185eb7-df89-4fcd-90a1-95cba2ef6016 tempest-QuotasAdminNegativeTest-1518083747 tempest-QuotasAdminNegativeTest-1518083747-project] Getting quotas for project bc1278822def4e9980c698a5d21092af. Resources: {'cores', 'ram', 'instances'} {{(pid=121403) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 01 18:55:44.644829 n-d-863052-2 devstack@n-api.service[121403]: DEBUG dbcounter [-] [121403] Writing DB stats nova_api:SAVEPOINT=4,nova_api:INSERT=6,nova_api:RELEASE=4,nova_api:SELECT=81,nova_api:DELETE=5 {{(pid=121403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 18:55:44.646110 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.quota [None req-2f185eb7-df89-4fcd-90a1-95cba2ef6016 tempest-QuotasAdminNegativeTest-1518083747 tempest-QuotasAdminNegativeTest-1518083747-project] Getting quotas for user 01bcc4a301b948dab0e690707170fdb2 and project bc1278822def4e9980c698a5d21092af. Resources: {'cores', 'ram', 'instances'} {{(pid=121403) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 01 18:55:44.665505 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.utils [None req-2f185eb7-df89-4fcd-90a1-95cba2ef6016 tempest-QuotasAdminNegativeTest-1518083747 tempest-QuotasAdminNegativeTest-1518083747-project] cores quota exceeded for bc1278822def4e9980c698a5d21092af, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=121403) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Nov 01 18:55:44.666484 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.wsgi [None req-2f185eb7-df89-4fcd-90a1-95cba2ef6016 tempest-QuotasAdminNegativeTest-1518083747 tempest-QuotasAdminNegativeTest-1518083747-project] HTTP exception thrown: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Nov 01 18:55:44.670883 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-2f185eb7-df89-4fcd-90a1-95cba2ef6016 tempest-QuotasAdminNegativeTest-1518083747 tempest-QuotasAdminNegativeTest-1518083747-project] Request method failure captured: Nov 01 18:55:44.670883 n-d-863052-2 devstack@n-api.service[121403]: request: POST /compute/v2.1/servers HTTP/1.1 Nov 01 18:55:44.670883 n-d-863052-2 devstack@n-api.service[121403]: Accept: application/json Nov 01 18:55:44.670883 n-d-863052-2 devstack@n-api.service[121403]: Accept-Encoding: identity Nov 01 18:55:44.670883 n-d-863052-2 devstack@n-api.service[121403]: Connection: close Nov 01 18:55:44.670883 n-d-863052-2 devstack@n-api.service[121403]: Content-Length: 144 Nov 01 18:55:44.670883 n-d-863052-2 devstack@n-api.service[121403]: Content-Type: application/json Nov 01 18:55:44.670883 n-d-863052-2 devstack@n-api.service[121403]: Host: 10.222.0.13 Nov 01 18:55:44.670883 n-d-863052-2 devstack@n-api.service[121403]: Openstack-System-Scope: None Nov 01 18:55:44.670883 n-d-863052-2 devstack@n-api.service[121403]: User-Agent: python-urllib3/1.26.12 Nov 01 18:55:44.670883 n-d-863052-2 devstack@n-api.service[121403]: X-Auth-Token: gAAAAABjYWupllb0-YmEC7tn-BvSZEkJE1EMvES1hWAnmFSJcqyHVC1KV6qoJuylLGMGBqTm4LnJ2nr6GVdBCD5P3jYu15-lHKKkpkFyHwpioFbb-X7kgYX1YtTaJGBY3mZKTTU-KIgchU2r2xr4yqWXnVWn5Y3KxKPnA6THzuoKvFMd6cf8FMo Nov 01 18:55:44.670883 n-d-863052-2 devstack@n-api.service[121403]: X-Domain-Id: None Nov 01 18:55:44.670883 n-d-863052-2 devstack@n-api.service[121403]: X-Domain-Name: None Nov 01 18:55:44.670883 n-d-863052-2 devstack@n-api.service[121403]: X-Identity-Status: Confirmed Nov 01 18:55:44.670883 n-d-863052-2 devstack@n-api.service[121403]: X-Is-Admin-Project: True Nov 01 18:55:44.670883 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Domain-Id: default Nov 01 18:55:44.670883 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Domain-Name: Default Nov 01 18:55:44.670883 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Id: bc1278822def4e9980c698a5d21092af Nov 01 18:55:44.670883 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Name: tempest-QuotasAdminNegativeTest-1518083747 Nov 01 18:55:44.670883 n-d-863052-2 devstack@n-api.service[121403]: X-Role: member,reader Nov 01 18:55:44.670883 n-d-863052-2 devstack@n-api.service[121403]: X-Roles: member,reader Nov 01 18:55:44.672247 n-d-863052-2 devstack@n-api.service[121403]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/bc1278822def4e9980c698a5d21092af"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/bc1278822def4e9980c698a5d21092af"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_bc1278822def4e9980c698a5d21092af", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/bc1278822def4e9980c698a5d21092af"}]}] Nov 01 18:55:44.672247 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant: tempest-QuotasAdminNegativeTest-1518083747 Nov 01 18:55:44.672247 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant-Id: bc1278822def4e9980c698a5d21092af Nov 01 18:55:44.672247 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-1518083747 Nov 01 18:55:44.672247 n-d-863052-2 devstack@n-api.service[121403]: X-User: tempest-QuotasAdminNegativeTest-1518083747-project Nov 01 18:55:44.672247 n-d-863052-2 devstack@n-api.service[121403]: X-User-Domain-Id: default Nov 01 18:55:44.672247 n-d-863052-2 devstack@n-api.service[121403]: X-User-Domain-Name: Default Nov 01 18:55:44.672247 n-d-863052-2 devstack@n-api.service[121403]: X-User-Id: 01bcc4a301b948dab0e690707170fdb2 Nov 01 18:55:44.672247 n-d-863052-2 devstack@n-api.service[121403]: X-User-Name: tempest-QuotasAdminNegativeTest-1518083747-project Nov 01 18:55:44.672247 n-d-863052-2 devstack@n-api.service[121403]: Nov 01 18:55:44.672247 n-d-863052-2 devstack@n-api.service[121403]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-878241712", "imageRef": "2d4a0047-1b9e-445f-8af8-1b5c9d93e881", "flavorRef": "452"}} Nov 01 18:55:44.672247 n-d-863052-2 devstack@n-api.service[121403]: method: > Nov 01 18:55:44.672990 n-d-863052-2 devstack@n-api.service[121403]: exception: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Nov 01 18:55:44.672990 n-d-863052-2 devstack@n-api.service[121403]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-878241712', 'imageRef': '2d4a0047-1b9e-445f-8af8-1b5c9d93e881', 'flavorRef': '452'}}} Nov 01 18:55:44.672990 n-d-863052-2 devstack@n-api.service[121403]: {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 01 18:55:44.672990 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:55:44.672990 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Nov 01 18:55:44.672990 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Nov 01 18:55:44.672990 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 01 18:55:44.672990 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 01 18:55:44.672990 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Nov 01 18:55:44.672990 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise exc Nov 01 18:55:44.672990 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Nov 01 18:55:44.672990 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Nov 01 18:55:44.672990 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 01 18:55:44.672990 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 01 18:55:44.672990 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Nov 01 18:55:44.672990 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Nov 01 18:55:44.672990 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Nov 01 18:55:44.672990 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Nov 01 18:55:44.673954 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Nov 01 18:55:44.673954 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Nov 01 18:55:44.673954 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['cores'] Nov 01 18:55:44.673954 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 18:55:44.673954 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 18:55:44.673954 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 18:55:44.673954 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:55:44.673954 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Nov 01 18:55:44.673954 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Nov 01 18:55:44.673954 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Nov 01 18:55:44.673954 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return self._create_instance( Nov 01 18:55:44.673954 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1733, in _create_instance Nov 01 18:55:44.673954 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Nov 01 18:55:44.673954 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1362, in _provision_instances Nov 01 18:55:44.673954 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Nov 01 18:55:44.673954 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Nov 01 18:55:44.673954 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Nov 01 18:55:44.673954 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Nov 01 18:55:44.673954 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 18:55:44.673954 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 18:55:44.673954 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 18:55:44.676368 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:55:44.676368 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 18:55:44.676368 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 18:55:44.676368 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 01 18:55:44.676368 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 01 18:55:44.676368 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 01 18:55:44.676368 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 01 18:55:44.676368 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 01 18:55:44.676368 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 01 18:55:44.676368 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 01 18:55:44.676368 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 01 18:55:44.676368 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 01 18:55:44.676368 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 01 18:55:44.676368 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Nov 01 18:55:44.676368 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Nov 01 18:55:44.676368 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Nov 01 18:55:44.676368 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Nov 01 18:55:44.676368 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 18:55:44.676368 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 18:55:44.676368 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 18:55:44.676368 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:55:44.678757 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 18:55:44.678757 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 18:55:44.678757 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 01 18:55:44.678757 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 01 18:55:44.678757 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Nov 01 18:55:44.678757 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 18:55:44.678757 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-2f185eb7-df89-4fcd-90a1-95cba2ef6016 tempest-QuotasAdminNegativeTest-1518083747 tempest-QuotasAdminNegativeTest-1518083747-project] Returning 403 to user: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores {{(pid=121403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 01 18:55:44.678757 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-2f185eb7-df89-4fcd-90a1-95cba2ef6016 tempest-QuotasAdminNegativeTest-1518083747 tempest-QuotasAdminNegativeTest-1518083747-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 403 len: 111 microversion: 2.1 time: 0.939749 Nov 01 18:55:44.678757 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 201/419] 10.222.0.13 () {60 vars in 1147 bytes} [Tue Nov 1 18:55:43 2022] POST /compute/v2.1/servers => generated 111 bytes in 945 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Nov 01 18:55:44.683467 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-46868c29-6ed4-49f9-aad3-f9e045668d64 tempest-QuotasAdminTestJSON-146785592 tempest-QuotasAdminTestJSON-146785592-project-admin] Calling method '.version_select at 0x7f0ae2dd93a0>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:55:44.897372 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-46868c29-6ed4-49f9-aad3-f9e045668d64 tempest-QuotasAdminTestJSON-146785592 tempest-QuotasAdminTestJSON-146785592-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:55:44.899285 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-46868c29-6ed4-49f9-aad3-f9e045668d64 tempest-QuotasAdminTestJSON-146785592 tempest-QuotasAdminTestJSON-146785592-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:55:44.901096 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-46868c29-6ed4-49f9-aad3-f9e045668d64 tempest-QuotasAdminTestJSON-146785592 tempest-QuotasAdminTestJSON-146785592-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:55:44.903233 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-46868c29-6ed4-49f9-aad3-f9e045668d64 tempest-QuotasAdminTestJSON-146785592 tempest-QuotasAdminTestJSON-146785592-project-admin] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:55:44.904204 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-46868c29-6ed4-49f9-aad3-f9e045668d64 tempest-QuotasAdminTestJSON-146785592 tempest-QuotasAdminTestJSON-146785592-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:55:44.904977 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-46868c29-6ed4-49f9-aad3-f9e045668d64 tempest-QuotasAdminTestJSON-146785592 tempest-QuotasAdminTestJSON-146785592-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:55:44.939791 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-46868c29-6ed4-49f9-aad3-f9e045668d64 tempest-QuotasAdminTestJSON-146785592 tempest-QuotasAdminTestJSON-146785592-project-admin] 10.222.0.13 "GET /compute/v2.1/os-quota-sets/1bb5da3aea6344dd93fc91756e5274bb/detail" status: 200 len: 916 microversion: 2.1 time: 0.261055 Nov 01 18:55:44.940407 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 202/420] 10.222.0.13 () {58 vars in 1263 bytes} [Tue Nov 1 18:55:44 2022] GET /compute/v2.1/os-quota-sets/1bb5da3aea6344dd93fc91756e5274bb/detail => generated 916 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 18:55:44.952063 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-7fca3717-eca8-49f5-8ba5-e58440a0f63a tempest-HypervisorAdminV253TestBase-484556320 tempest-HypervisorAdminV253TestBase-484556320-project-admin] Calling method '.version_select at 0x7f0ae2d403a0>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:55:44.962212 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-7fca3717-eca8-49f5-8ba5-e58440a0f63a tempest-HypervisorAdminV253TestBase-484556320 tempest-HypervisorAdminV253TestBase-484556320-project-admin] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:55:44.964960 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-7fca3717-eca8-49f5-8ba5-e58440a0f63a tempest-HypervisorAdminV253TestBase-484556320 tempest-HypervisorAdminV253TestBase-484556320-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:55:44.965616 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-7fca3717-eca8-49f5-8ba5-e58440a0f63a tempest-HypervisorAdminV253TestBase-484556320 tempest-HypervisorAdminV253TestBase-484556320-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:55:45.005017 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-7fca3717-eca8-49f5-8ba5-e58440a0f63a tempest-HypervisorAdminV253TestBase-484556320 tempest-HypervisorAdminV253TestBase-484556320-project-admin] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:55:45.008051 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-7fca3717-eca8-49f5-8ba5-e58440a0f63a tempest-HypervisorAdminV253TestBase-484556320 tempest-HypervisorAdminV253TestBase-484556320-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:55:45.010615 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-7fca3717-eca8-49f5-8ba5-e58440a0f63a tempest-HypervisorAdminV253TestBase-484556320 tempest-HypervisorAdminV253TestBase-484556320-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:55:45.021706 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-c67d6f54-5dca-4b65-905b-02e46863e659 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f32f5fba1976432d938e664c7714e52b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b9d4c236b944f9b2e8e502a50a8f8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:55:45.026080 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-7fca3717-eca8-49f5-8ba5-e58440a0f63a tempest-HypervisorAdminV253TestBase-484556320 tempest-HypervisorAdminV253TestBase-484556320-project-admin] 10.222.0.13 "GET /compute/v2.1/os-hypervisors/5a2a2a91-2208-489c-ab9f-2a516c51ae2f" status: 200 len: 792 microversion: 2.53 time: 0.082891 Nov 01 18:55:45.029562 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-c67d6f54-5dca-4b65-905b-02e46863e659 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] 10.222.0.13 "GET /compute/v2.1/servers/de2ff806-a2fa-4390-b4d5-11ff24dd27ca" status: 200 len: 1502 microversion: 2.1 time: 0.846000 Nov 01 18:55:45.030129 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 219/421] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:55:44 2022] GET /compute/v2.1/servers/de2ff806-a2fa-4390-b4d5-11ff24dd27ca => generated 1502 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:55:45.041053 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 203/422] 10.222.0.13 () {60 vars in 1298 bytes} [Tue Nov 1 18:55:44 2022] GET /compute/v2.1/os-hypervisors/5a2a2a91-2208-489c-ab9f-2a516c51ae2f => generated 792 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 01 18:55:45.051380 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-ed98e7aa-7424-4c9a-9af5-b9fa55941aa6 tempest-QuotasAdminNegativeTest-1138996703 tempest-QuotasAdminNegativeTest-1138996703-project-admin] Action: 'update', calling method: .version_select at 0x7f0ae2e02a60>, body: {"quota_set": {"cores": 20}} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 18:55:45.162502 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-fc413a09-5422-4dd6-9e43-753e63a51931 tempest-HostsAdminTestJSON-1627096250 tempest-HostsAdminTestJSON-1627096250-project-admin] Calling method '.version_select at 0x7f0ae2c180d0>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:55:45.166461 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-fc413a09-5422-4dd6-9e43-753e63a51931 tempest-HostsAdminTestJSON-1627096250 tempest-HostsAdminTestJSON-1627096250-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:55:45.166940 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-fc413a09-5422-4dd6-9e43-753e63a51931 tempest-HostsAdminTestJSON-1627096250 tempest-HostsAdminTestJSON-1627096250-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:55:45.167369 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-fc413a09-5422-4dd6-9e43-753e63a51931 tempest-HostsAdminTestJSON-1627096250 tempest-HostsAdminTestJSON-1627096250-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:55:45.173886 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-fc413a09-5422-4dd6-9e43-753e63a51931 tempest-HostsAdminTestJSON-1627096250 tempest-HostsAdminTestJSON-1627096250-project-admin] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:55:45.174394 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-fc413a09-5422-4dd6-9e43-753e63a51931 tempest-HostsAdminTestJSON-1627096250 tempest-HostsAdminTestJSON-1627096250-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:55:45.174828 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-fc413a09-5422-4dd6-9e43-753e63a51931 tempest-HostsAdminTestJSON-1627096250 tempest-HostsAdminTestJSON-1627096250-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:55:45.243954 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-fc413a09-5422-4dd6-9e43-753e63a51931 tempest-HostsAdminTestJSON-1627096250 tempest-HostsAdminTestJSON-1627096250-project-admin] 10.222.0.13 "GET /compute/v2.1/os-hosts" status: 200 len: 376 microversion: 2.1 time: 0.208405 Nov 01 18:55:45.245217 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 220/423] 10.222.0.13 () {58 vars in 1128 bytes} [Tue Nov 1 18:55:45 2022] GET /compute/v2.1/os-hosts => generated 376 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 18:55:45.255694 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-fae62d19-88f8-4dc2-b04c-765a81628efc tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:55:45.257590 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-fae62d19-88f8-4dc2-b04c-765a81628efc tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] [instance: 2d3a927e-a478-40b1-8c92-80396c82f76c] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:55:45.264306 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-fae62d19-88f8-4dc2-b04c-765a81628efc tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:55:45.265170 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-fae62d19-88f8-4dc2-b04c-765a81628efc tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:55:45.265778 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-fae62d19-88f8-4dc2-b04c-765a81628efc tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:55:45.266664 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-fae62d19-88f8-4dc2-b04c-765a81628efc tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:55:45.267267 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-fae62d19-88f8-4dc2-b04c-765a81628efc tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:55:45.267892 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-fae62d19-88f8-4dc2-b04c-765a81628efc tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:55:45.609249 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-ed98e7aa-7424-4c9a-9af5-b9fa55941aa6 tempest-QuotasAdminNegativeTest-1138996703 tempest-QuotasAdminNegativeTest-1138996703-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:55:45.610340 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-ed98e7aa-7424-4c9a-9af5-b9fa55941aa6 tempest-QuotasAdminNegativeTest-1138996703 tempest-QuotasAdminNegativeTest-1138996703-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:55:45.611577 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-ed98e7aa-7424-4c9a-9af5-b9fa55941aa6 tempest-QuotasAdminNegativeTest-1138996703 tempest-QuotasAdminNegativeTest-1138996703-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:55:45.612928 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-ed98e7aa-7424-4c9a-9af5-b9fa55941aa6 tempest-QuotasAdminNegativeTest-1138996703 tempest-QuotasAdminNegativeTest-1138996703-project-admin] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:55:45.613578 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-ed98e7aa-7424-4c9a-9af5-b9fa55941aa6 tempest-QuotasAdminNegativeTest-1138996703 tempest-QuotasAdminNegativeTest-1138996703-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:55:45.614368 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-ed98e7aa-7424-4c9a-9af5-b9fa55941aa6 tempest-QuotasAdminNegativeTest-1138996703 tempest-QuotasAdminNegativeTest-1138996703-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:55:45.717428 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-ed98e7aa-7424-4c9a-9af5-b9fa55941aa6 tempest-QuotasAdminNegativeTest-1138996703 tempest-QuotasAdminNegativeTest-1138996703-project-admin] 10.222.0.13 "PUT /compute/v2.1/os-quota-sets/bc1278822def4e9980c698a5d21092af" status: 200 len: 329 microversion: 2.1 time: 0.674886 Nov 01 18:55:45.719124 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 204/424] 10.222.0.13 () {60 vars in 1262 bytes} [Tue Nov 1 18:55:45 2022] PUT /compute/v2.1/os-quota-sets/bc1278822def4e9980c698a5d21092af => generated 329 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 18:55:45.732378 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-7c9d7178-a550-4411-84a5-be539498a5a8 tempest-HostsAdminTestJSON-1627096250 tempest-HostsAdminTestJSON-1627096250-project-admin] Calling method '.version_select at 0x7f0ae2d40940>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:55:45.736050 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-7c9d7178-a550-4411-84a5-be539498a5a8 tempest-HostsAdminTestJSON-1627096250 tempest-HostsAdminTestJSON-1627096250-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:55:45.736534 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-7c9d7178-a550-4411-84a5-be539498a5a8 tempest-HostsAdminTestJSON-1627096250 tempest-HostsAdminTestJSON-1627096250-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:55:45.737007 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-7c9d7178-a550-4411-84a5-be539498a5a8 tempest-HostsAdminTestJSON-1627096250 tempest-HostsAdminTestJSON-1627096250-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:55:45.737727 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-7c9d7178-a550-4411-84a5-be539498a5a8 tempest-HostsAdminTestJSON-1627096250 tempest-HostsAdminTestJSON-1627096250-project-admin] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:55:45.738176 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-7c9d7178-a550-4411-84a5-be539498a5a8 tempest-HostsAdminTestJSON-1627096250 tempest-HostsAdminTestJSON-1627096250-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:55:45.738589 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-7c9d7178-a550-4411-84a5-be539498a5a8 tempest-HostsAdminTestJSON-1627096250 tempest-HostsAdminTestJSON-1627096250-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:55:45.765735 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-7c9d7178-a550-4411-84a5-be539498a5a8 tempest-HostsAdminTestJSON-1627096250 tempest-HostsAdminTestJSON-1627096250-project-admin] 10.222.0.13 "GET /compute/v2.1/os-hosts?zone=" status: 200 len: 376 microversion: 2.1 time: 0.042063 Nov 01 18:55:45.774020 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 205/425] 10.222.0.13 () {58 vars in 1139 bytes} [Tue Nov 1 18:55:45 2022] GET /compute/v2.1/os-hosts?zone= => generated 376 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 18:55:45.779122 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-3ef26047-c097-4dba-b9ca-c6d6ceb98022 tempest-QuotasAdminTestJSON-146785592 tempest-QuotasAdminTestJSON-146785592-project-admin] Action: 'update', calling method: .version_select at 0x7f0ae2c98670>, body: {"quota_set": {"ram": "2048"}} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 18:55:45.794707 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-fae62d19-88f8-4dc2-b04c-765a81628efc tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:55:45.819375 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-fae62d19-88f8-4dc2-b04c-765a81628efc tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:55:45.821836 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-fae62d19-88f8-4dc2-b04c-765a81628efc tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:55:45.823017 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-fae62d19-88f8-4dc2-b04c-765a81628efc tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] 10.222.0.13 "GET /compute/v2.1/servers/2d3a927e-a478-40b1-8c92-80396c82f76c" status: 200 len: 1361 microversion: 2.25 time: 0.576444 Nov 01 18:55:45.824204 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 221/426] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 18:55:45 2022] GET /compute/v2.1/servers/2d3a927e-a478-40b1-8c92-80396c82f76c => generated 1361 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 18:55:45.829550 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-c7851998-85c2-498d-8aa0-7b7c76d953e6 tempest-QuotasAdminNegativeTest-1138996703 tempest-QuotasAdminNegativeTest-1138996703-project-admin] Calling method '.version_select at 0x7f0ae2b48280>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:55:45.953092 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-c7851998-85c2-498d-8aa0-7b7c76d953e6 tempest-QuotasAdminNegativeTest-1138996703 tempest-QuotasAdminNegativeTest-1138996703-project-admin] 10.222.0.13 "GET /compute/v2.1/os-quota-sets/bc1278822def4e9980c698a5d21092af" status: 200 len: 371 microversion: 2.1 time: 0.126145 Nov 01 18:55:45.957915 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 222/427] 10.222.0.13 () {58 vars in 1242 bytes} [Tue Nov 1 18:55:45 2022] GET /compute/v2.1/os-quota-sets/bc1278822def4e9980c698a5d21092af => generated 371 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 18:55:45.965482 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-ffc1b398-64a9-48be-bc85-1c40832a7385 tempest-HostsAdminTestJSON-1627096250 tempest-HostsAdminTestJSON-1627096250-project-admin] Calling method '.version_select at 0x7f0ae2b6ed30>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:55:45.974190 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-ffc1b398-64a9-48be-bc85-1c40832a7385 tempest-HostsAdminTestJSON-1627096250 tempest-HostsAdminTestJSON-1627096250-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:55:45.975274 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-ffc1b398-64a9-48be-bc85-1c40832a7385 tempest-HostsAdminTestJSON-1627096250 tempest-HostsAdminTestJSON-1627096250-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:55:45.975924 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-ffc1b398-64a9-48be-bc85-1c40832a7385 tempest-HostsAdminTestJSON-1627096250 tempest-HostsAdminTestJSON-1627096250-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:55:45.976417 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-ffc1b398-64a9-48be-bc85-1c40832a7385 tempest-HostsAdminTestJSON-1627096250 tempest-HostsAdminTestJSON-1627096250-project-admin] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:55:45.976900 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-ffc1b398-64a9-48be-bc85-1c40832a7385 tempest-HostsAdminTestJSON-1627096250 tempest-HostsAdminTestJSON-1627096250-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:55:45.977322 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-ffc1b398-64a9-48be-bc85-1c40832a7385 tempest-HostsAdminTestJSON-1627096250 tempest-HostsAdminTestJSON-1627096250-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:55:46.015953 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-ffc1b398-64a9-48be-bc85-1c40832a7385 tempest-HostsAdminTestJSON-1627096250 tempest-HostsAdminTestJSON-1627096250-project-admin] 10.222.0.13 "GET /compute/v2.1/os-hosts?zone=xxx" status: 200 len: 13 microversion: 2.1 time: 0.056943 Nov 01 18:55:46.016844 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 223/428] 10.222.0.13 () {58 vars in 1145 bytes} [Tue Nov 1 18:55:45 2022] GET /compute/v2.1/os-hosts?zone=xxx => generated 13 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 01 18:55:46.030346 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-34f9c27d-1a03-4a0d-8e94-6f52e56d6f72 tempest-QuotasAdminNegativeTest-1138996703 tempest-QuotasAdminNegativeTest-1138996703-project-admin] Action: 'update', calling method: .version_select at 0x7f0ae2b6e940>, body: {"quota_set": {"force": true, "instances": 0}} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 18:55:46.041763 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-3ef26047-c097-4dba-b9ca-c6d6ceb98022 tempest-QuotasAdminTestJSON-146785592 tempest-QuotasAdminTestJSON-146785592-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:55:46.042715 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-3ef26047-c097-4dba-b9ca-c6d6ceb98022 tempest-QuotasAdminTestJSON-146785592 tempest-QuotasAdminTestJSON-146785592-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:55:46.042715 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-3ef26047-c097-4dba-b9ca-c6d6ceb98022 tempest-QuotasAdminTestJSON-146785592 tempest-QuotasAdminTestJSON-146785592-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:55:46.043409 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-3ef26047-c097-4dba-b9ca-c6d6ceb98022 tempest-QuotasAdminTestJSON-146785592 tempest-QuotasAdminTestJSON-146785592-project-admin] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:55:46.043862 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-3ef26047-c097-4dba-b9ca-c6d6ceb98022 tempest-QuotasAdminTestJSON-146785592 tempest-QuotasAdminTestJSON-146785592-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:55:46.044280 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-3ef26047-c097-4dba-b9ca-c6d6ceb98022 tempest-QuotasAdminTestJSON-146785592 tempest-QuotasAdminTestJSON-146785592-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:55:46.097834 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-3ef26047-c097-4dba-b9ca-c6d6ceb98022 tempest-QuotasAdminTestJSON-146785592 tempest-QuotasAdminTestJSON-146785592-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:55:46.098336 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-3ef26047-c097-4dba-b9ca-c6d6ceb98022 tempest-QuotasAdminTestJSON-146785592 tempest-QuotasAdminTestJSON-146785592-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:55:46.098747 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-3ef26047-c097-4dba-b9ca-c6d6ceb98022 tempest-QuotasAdminTestJSON-146785592 tempest-QuotasAdminTestJSON-146785592-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:55:46.099698 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-3ef26047-c097-4dba-b9ca-c6d6ceb98022 tempest-QuotasAdminTestJSON-146785592 tempest-QuotasAdminTestJSON-146785592-project-admin] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:55:46.100315 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-3ef26047-c097-4dba-b9ca-c6d6ceb98022 tempest-QuotasAdminTestJSON-146785592 tempest-QuotasAdminTestJSON-146785592-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:55:46.100839 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-3ef26047-c097-4dba-b9ca-c6d6ceb98022 tempest-QuotasAdminTestJSON-146785592 tempest-QuotasAdminTestJSON-146785592-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:55:46.140447 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-34f9c27d-1a03-4a0d-8e94-6f52e56d6f72 tempest-QuotasAdminNegativeTest-1138996703 tempest-QuotasAdminNegativeTest-1138996703-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:55:46.140967 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-34f9c27d-1a03-4a0d-8e94-6f52e56d6f72 tempest-QuotasAdminNegativeTest-1138996703 tempest-QuotasAdminNegativeTest-1138996703-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:55:46.141399 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-34f9c27d-1a03-4a0d-8e94-6f52e56d6f72 tempest-QuotasAdminNegativeTest-1138996703 tempest-QuotasAdminNegativeTest-1138996703-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:55:46.142122 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-34f9c27d-1a03-4a0d-8e94-6f52e56d6f72 tempest-QuotasAdminNegativeTest-1138996703 tempest-QuotasAdminNegativeTest-1138996703-project-admin] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:55:46.142574 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-34f9c27d-1a03-4a0d-8e94-6f52e56d6f72 tempest-QuotasAdminNegativeTest-1138996703 tempest-QuotasAdminNegativeTest-1138996703-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:55:46.143002 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-34f9c27d-1a03-4a0d-8e94-6f52e56d6f72 tempest-QuotasAdminNegativeTest-1138996703 tempest-QuotasAdminNegativeTest-1138996703-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:55:46.192665 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-3ef26047-c097-4dba-b9ca-c6d6ceb98022 tempest-QuotasAdminTestJSON-146785592 tempest-QuotasAdminTestJSON-146785592-project-admin] 10.222.0.13 "PUT /compute/v2.1/os-quota-sets/1bb5da3aea6344dd93fc91756e5274bb?user_id=22d4fc4dffd6492c8786d68c0a020764" status: 200 len: 328 microversion: 2.1 time: 0.417086 Nov 01 18:55:46.193865 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 206/429] 10.222.0.13 () {60 vars in 1343 bytes} [Tue Nov 1 18:55:45 2022] PUT /compute/v2.1/os-quota-sets/1bb5da3aea6344dd93fc91756e5274bb?user_id=22d4fc4dffd6492c8786d68c0a020764 => generated 328 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 18:55:46.199719 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-4c86c772-5a00-4d05-a0bd-5de137d68af6 tempest-HostsAdminTestJSON-1627096250 tempest-HostsAdminTestJSON-1627096250-project-admin] Calling method '.version_select at 0x7f0ae3072310>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:55:46.204096 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-4c86c772-5a00-4d05-a0bd-5de137d68af6 tempest-HostsAdminTestJSON-1627096250 tempest-HostsAdminTestJSON-1627096250-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:55:46.204850 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-4c86c772-5a00-4d05-a0bd-5de137d68af6 tempest-HostsAdminTestJSON-1627096250 tempest-HostsAdminTestJSON-1627096250-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:55:46.205766 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-4c86c772-5a00-4d05-a0bd-5de137d68af6 tempest-HostsAdminTestJSON-1627096250 tempest-HostsAdminTestJSON-1627096250-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:55:46.206748 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-4c86c772-5a00-4d05-a0bd-5de137d68af6 tempest-HostsAdminTestJSON-1627096250 tempest-HostsAdminTestJSON-1627096250-project-admin] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:55:46.207244 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-4c86c772-5a00-4d05-a0bd-5de137d68af6 tempest-HostsAdminTestJSON-1627096250 tempest-HostsAdminTestJSON-1627096250-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:55:46.207669 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-4c86c772-5a00-4d05-a0bd-5de137d68af6 tempest-HostsAdminTestJSON-1627096250 tempest-HostsAdminTestJSON-1627096250-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:55:46.232726 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-4c86c772-5a00-4d05-a0bd-5de137d68af6 tempest-HostsAdminTestJSON-1627096250 tempest-HostsAdminTestJSON-1627096250-project-admin] 10.222.0.13 "GET /compute/v2.1/os-hosts" status: 200 len: 376 microversion: 2.1 time: 0.036975 Nov 01 18:55:46.233676 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 207/430] 10.222.0.13 () {58 vars in 1128 bytes} [Tue Nov 1 18:55:46 2022] GET /compute/v2.1/os-hosts => generated 376 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 18:55:46.243550 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-97c2b25c-9c89-4288-b81f-c0c955f3333f tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:55:46.244164 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-97c2b25c-9c89-4288-b81f-c0c955f3333f tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] [instance: de2ff806-a2fa-4390-b4d5-11ff24dd27ca] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:55:46.249680 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-34f9c27d-1a03-4a0d-8e94-6f52e56d6f72 tempest-QuotasAdminNegativeTest-1138996703 tempest-QuotasAdminNegativeTest-1138996703-project-admin] 10.222.0.13 "PUT /compute/v2.1/os-quota-sets/bc1278822def4e9980c698a5d21092af" status: 200 len: 328 microversion: 2.1 time: 0.223644 Nov 01 18:55:46.250320 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 224/431] 10.222.0.13 () {60 vars in 1262 bytes} [Tue Nov 1 18:55:46 2022] PUT /compute/v2.1/os-quota-sets/bc1278822def4e9980c698a5d21092af => generated 328 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 18:55:46.250506 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-97c2b25c-9c89-4288-b81f-c0c955f3333f tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:55:46.251262 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-97c2b25c-9c89-4288-b81f-c0c955f3333f tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:55:46.251845 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-97c2b25c-9c89-4288-b81f-c0c955f3333f tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:55:46.252830 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-97c2b25c-9c89-4288-b81f-c0c955f3333f tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:55:46.253428 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-97c2b25c-9c89-4288-b81f-c0c955f3333f tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:55:46.253994 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-97c2b25c-9c89-4288-b81f-c0c955f3333f tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:55:46.269816 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-8d17ea2d-2490-4a0c-b0a4-ddbcbf3f7a81 tempest-QuotasAdminTestJSON-146785592 tempest-QuotasAdminTestJSON-146785592-project-admin] Calling method '.version_select at 0x7f0ae2ae6280>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:55:46.613153 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-97c2b25c-9c89-4288-b81f-c0c955f3333f tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f32f5fba1976432d938e664c7714e52b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b9d4c236b944f9b2e8e502a50a8f8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:55:46.647044 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-97c2b25c-9c89-4288-b81f-c0c955f3333f tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] 10.222.0.13 "GET /compute/v2.1/servers/de2ff806-a2fa-4390-b4d5-11ff24dd27ca" status: 200 len: 1502 microversion: 2.1 time: 0.411798 Nov 01 18:55:46.649422 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 208/432] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:55:46 2022] GET /compute/v2.1/servers/de2ff806-a2fa-4390-b4d5-11ff24dd27ca => generated 1502 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:55:46.655460 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-0c903d21-fbc7-40ab-a082-5143b41b955e tempest-HostsAdminTestJSON-1627096250 tempest-HostsAdminTestJSON-1627096250-project-admin] Calling method '.version_select at 0x7f0ae2df40d0>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:55:46.660660 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-0c903d21-fbc7-40ab-a082-5143b41b955e tempest-HostsAdminTestJSON-1627096250 tempest-HostsAdminTestJSON-1627096250-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:55:46.661400 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-0c903d21-fbc7-40ab-a082-5143b41b955e tempest-HostsAdminTestJSON-1627096250 tempest-HostsAdminTestJSON-1627096250-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:55:46.662015 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-0c903d21-fbc7-40ab-a082-5143b41b955e tempest-HostsAdminTestJSON-1627096250 tempest-HostsAdminTestJSON-1627096250-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:55:46.663010 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-0c903d21-fbc7-40ab-a082-5143b41b955e tempest-HostsAdminTestJSON-1627096250 tempest-HostsAdminTestJSON-1627096250-project-admin] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:55:46.663557 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-0c903d21-fbc7-40ab-a082-5143b41b955e tempest-HostsAdminTestJSON-1627096250 tempest-HostsAdminTestJSON-1627096250-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:55:46.663993 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-0c903d21-fbc7-40ab-a082-5143b41b955e tempest-HostsAdminTestJSON-1627096250 tempest-HostsAdminTestJSON-1627096250-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:55:46.705687 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-8d17ea2d-2490-4a0c-b0a4-ddbcbf3f7a81 tempest-QuotasAdminTestJSON-146785592 tempest-QuotasAdminTestJSON-146785592-project-admin] 10.222.0.13 "GET /compute/v2.1/os-quota-sets/1bb5da3aea6344dd93fc91756e5274bb?user_id=22d4fc4dffd6492c8786d68c0a020764" status: 200 len: 370 microversion: 2.1 time: 0.454132 Nov 01 18:55:46.706613 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 225/433] 10.222.0.13 () {58 vars in 1323 bytes} [Tue Nov 1 18:55:46 2022] GET /compute/v2.1/os-quota-sets/1bb5da3aea6344dd93fc91756e5274bb?user_id=22d4fc4dffd6492c8786d68c0a020764 => generated 370 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 18:55:46.715306 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-0c903d21-fbc7-40ab-a082-5143b41b955e tempest-HostsAdminTestJSON-1627096250 tempest-HostsAdminTestJSON-1627096250-project-admin] 10.222.0.13 "GET /compute/v2.1/os-hosts?zone=internal" status: 200 len: 236 microversion: 2.1 time: 0.064199 Nov 01 18:55:46.716601 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 209/434] 10.222.0.13 () {58 vars in 1155 bytes} [Tue Nov 1 18:55:46 2022] GET /compute/v2.1/os-hosts?zone=internal => generated 236 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 18:55:46.723595 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-f2eecbb6-b16c-4573-b707-2ed60027a35f tempest-QuotasAdminNegativeTest-1518083747 tempest-QuotasAdminNegativeTest-1518083747-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1927325488", "imageRef": "2d4a0047-1b9e-445f-8af8-1b5c9d93e881", "flavorRef": "452"}} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 18:55:46.737923 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [req-b3661622-5581-4bbe-99dd-4f41874835c6 req-62ef40c7-5523-4d1e-9b96-13756b5edfd9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "de2ff806-a2fa-4390-b4d5-11ff24dd27ca", "name": "network-vif-unplugged", "status": "completed", "tag": "4157a71a-6529-42b5-9194-408c1d22d219"}]} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 18:55:46.777471 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-b3661622-5581-4bbe-99dd-4f41874835c6 req-62ef40c7-5523-4d1e-9b96-13756b5edfd9 service nova] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:55:46.778408 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-b3661622-5581-4bbe-99dd-4f41874835c6 req-62ef40c7-5523-4d1e-9b96-13756b5edfd9 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:55:46.780661 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-b3661622-5581-4bbe-99dd-4f41874835c6 req-62ef40c7-5523-4d1e-9b96-13756b5edfd9 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:55:46.802410 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.compute.server_external_events [req-b3661622-5581-4bbe-99dd-4f41874835c6 req-62ef40c7-5523-4d1e-9b96-13756b5edfd9 service nova] Creating event network-vif-unplugged:4157a71a-6529-42b5-9194-408c1d22d219 for instance de2ff806-a2fa-4390-b4d5-11ff24dd27ca on n-h1-863052-2 Nov 01 18:55:46.818391 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [req-b3661622-5581-4bbe-99dd-4f41874835c6 req-62ef40c7-5523-4d1e-9b96-13756b5edfd9 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.084038 Nov 01 18:55:46.821633 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 226/435] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Nov 1 18:55:46 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 18:55:46.837924 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-9c305da2-1a36-442c-bd46-dc174e04f894 tempest-HostsAdminTestJSON-1627096250 tempest-HostsAdminTestJSON-1627096250-project-admin] Calling method '.version_select at 0x7f0ae2d65e50>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:55:46.848978 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-9c305da2-1a36-442c-bd46-dc174e04f894 tempest-HostsAdminTestJSON-1627096250 tempest-HostsAdminTestJSON-1627096250-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:55:46.849943 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-9c305da2-1a36-442c-bd46-dc174e04f894 tempest-HostsAdminTestJSON-1627096250 tempest-HostsAdminTestJSON-1627096250-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:55:46.852025 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-9c305da2-1a36-442c-bd46-dc174e04f894 tempest-HostsAdminTestJSON-1627096250 tempest-HostsAdminTestJSON-1627096250-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:55:46.854328 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.network.neutron [None req-f2eecbb6-b16c-4573-b707-2ed60027a35f tempest-QuotasAdminNegativeTest-1518083747 tempest-QuotasAdminNegativeTest-1518083747-project] validate_networks() for None {{(pid=121403) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 01 18:55:46.856173 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-9c305da2-1a36-442c-bd46-dc174e04f894 tempest-HostsAdminTestJSON-1627096250 tempest-HostsAdminTestJSON-1627096250-project-admin] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:55:46.858166 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-9c305da2-1a36-442c-bd46-dc174e04f894 tempest-HostsAdminTestJSON-1627096250 tempest-HostsAdminTestJSON-1627096250-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:55:46.858832 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-9c305da2-1a36-442c-bd46-dc174e04f894 tempest-HostsAdminTestJSON-1627096250 tempest-HostsAdminTestJSON-1627096250-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:55:46.925719 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-9c305da2-1a36-442c-bd46-dc174e04f894 tempest-HostsAdminTestJSON-1627096250 tempest-HostsAdminTestJSON-1627096250-project-admin] 10.222.0.13 "GET /compute/v2.1/os-hosts" status: 200 len: 376 microversion: 2.1 time: 0.100703 Nov 01 18:55:46.932379 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 227/436] 10.222.0.13 () {58 vars in 1128 bytes} [Tue Nov 1 18:55:46 2022] GET /compute/v2.1/os-hosts => generated 376 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 18:55:46.938679 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-2d60a79c-d452-49d1-9c26-1b435cf9bb35 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:55:46.939402 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-2d60a79c-d452-49d1-9c26-1b435cf9bb35 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] [instance: 2d3a927e-a478-40b1-8c92-80396c82f76c] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:55:46.947267 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2d60a79c-d452-49d1-9c26-1b435cf9bb35 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:55:46.947924 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2d60a79c-d452-49d1-9c26-1b435cf9bb35 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:55:46.948520 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2d60a79c-d452-49d1-9c26-1b435cf9bb35 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:55:46.949794 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2d60a79c-d452-49d1-9c26-1b435cf9bb35 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:55:46.950400 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2d60a79c-d452-49d1-9c26-1b435cf9bb35 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:55:46.950968 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2d60a79c-d452-49d1-9c26-1b435cf9bb35 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:55:47.438689 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.virt.hardware [None req-f2eecbb6-b16c-4573-b707-2ed60027a35f tempest-QuotasAdminNegativeTest-1518083747 tempest-QuotasAdminNegativeTest-1518083747-project] Flavor limits 0:0:0 {{(pid=121403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 01 18:55:47.439709 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.virt.hardware [None req-f2eecbb6-b16c-4573-b707-2ed60027a35f tempest-QuotasAdminNegativeTest-1518083747 tempest-QuotasAdminNegativeTest-1518083747-project] Image limits 0:0:0 {{(pid=121403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 01 18:55:47.440784 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.virt.hardware [None req-f2eecbb6-b16c-4573-b707-2ed60027a35f tempest-QuotasAdminNegativeTest-1518083747 tempest-QuotasAdminNegativeTest-1518083747-project] Flavor pref 0:0:0 {{(pid=121403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 01 18:55:47.441348 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.virt.hardware [None req-f2eecbb6-b16c-4573-b707-2ed60027a35f tempest-QuotasAdminNegativeTest-1518083747 tempest-QuotasAdminNegativeTest-1518083747-project] Image pref 0:0:0 {{(pid=121403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 01 18:55:47.442512 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.virt.hardware [None req-f2eecbb6-b16c-4573-b707-2ed60027a35f tempest-QuotasAdminNegativeTest-1518083747 tempest-QuotasAdminNegativeTest-1518083747-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 01 18:55:47.462578 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f2eecbb6-b16c-4573-b707-2ed60027a35f tempest-QuotasAdminNegativeTest-1518083747 tempest-QuotasAdminNegativeTest-1518083747-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:55:47.463295 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f2eecbb6-b16c-4573-b707-2ed60027a35f tempest-QuotasAdminNegativeTest-1518083747 tempest-QuotasAdminNegativeTest-1518083747-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:55:47.465214 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f2eecbb6-b16c-4573-b707-2ed60027a35f tempest-QuotasAdminNegativeTest-1518083747 tempest-QuotasAdminNegativeTest-1518083747-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:55:47.466144 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f2eecbb6-b16c-4573-b707-2ed60027a35f tempest-QuotasAdminNegativeTest-1518083747 tempest-QuotasAdminNegativeTest-1518083747-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:55:47.475267 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f2eecbb6-b16c-4573-b707-2ed60027a35f tempest-QuotasAdminNegativeTest-1518083747 tempest-QuotasAdminNegativeTest-1518083747-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:55:47.476357 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f2eecbb6-b16c-4573-b707-2ed60027a35f tempest-QuotasAdminNegativeTest-1518083747 tempest-QuotasAdminNegativeTest-1518083747-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:55:47.517645 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.quota [None req-f2eecbb6-b16c-4573-b707-2ed60027a35f tempest-QuotasAdminNegativeTest-1518083747 tempest-QuotasAdminNegativeTest-1518083747-project] Getting quotas for project bc1278822def4e9980c698a5d21092af. Resources: {'cores', 'ram', 'instances'} {{(pid=121403) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 01 18:55:47.523465 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.quota [None req-f2eecbb6-b16c-4573-b707-2ed60027a35f tempest-QuotasAdminNegativeTest-1518083747 tempest-QuotasAdminNegativeTest-1518083747-project] Getting quotas for user 01bcc4a301b948dab0e690707170fdb2 and project bc1278822def4e9980c698a5d21092af. Resources: {'cores', 'ram', 'instances'} {{(pid=121403) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 01 18:55:47.543336 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.utils [None req-f2eecbb6-b16c-4573-b707-2ed60027a35f tempest-QuotasAdminNegativeTest-1518083747 tempest-QuotasAdminNegativeTest-1518083747-project] instances quota exceeded for bc1278822def4e9980c698a5d21092af, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=121403) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Nov 01 18:55:47.550848 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.wsgi [None req-f2eecbb6-b16c-4573-b707-2ed60027a35f tempest-QuotasAdminNegativeTest-1518083747 tempest-QuotasAdminNegativeTest-1518083747-project] HTTP exception thrown: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Nov 01 18:55:47.552984 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-f2eecbb6-b16c-4573-b707-2ed60027a35f tempest-QuotasAdminNegativeTest-1518083747 tempest-QuotasAdminNegativeTest-1518083747-project] Request method failure captured: Nov 01 18:55:47.552984 n-d-863052-2 devstack@n-api.service[121403]: request: POST /compute/v2.1/servers HTTP/1.1 Nov 01 18:55:47.552984 n-d-863052-2 devstack@n-api.service[121403]: Accept: application/json Nov 01 18:55:47.552984 n-d-863052-2 devstack@n-api.service[121403]: Accept-Encoding: identity Nov 01 18:55:47.552984 n-d-863052-2 devstack@n-api.service[121403]: Connection: close Nov 01 18:55:47.552984 n-d-863052-2 devstack@n-api.service[121403]: Content-Length: 145 Nov 01 18:55:47.552984 n-d-863052-2 devstack@n-api.service[121403]: Content-Type: application/json Nov 01 18:55:47.552984 n-d-863052-2 devstack@n-api.service[121403]: Host: 10.222.0.13 Nov 01 18:55:47.552984 n-d-863052-2 devstack@n-api.service[121403]: Openstack-System-Scope: None Nov 01 18:55:47.552984 n-d-863052-2 devstack@n-api.service[121403]: User-Agent: python-urllib3/1.26.12 Nov 01 18:55:47.552984 n-d-863052-2 devstack@n-api.service[121403]: X-Auth-Token: gAAAAABjYWupllb0-YmEC7tn-BvSZEkJE1EMvES1hWAnmFSJcqyHVC1KV6qoJuylLGMGBqTm4LnJ2nr6GVdBCD5P3jYu15-lHKKkpkFyHwpioFbb-X7kgYX1YtTaJGBY3mZKTTU-KIgchU2r2xr4yqWXnVWn5Y3KxKPnA6THzuoKvFMd6cf8FMo Nov 01 18:55:47.552984 n-d-863052-2 devstack@n-api.service[121403]: X-Domain-Id: None Nov 01 18:55:47.552984 n-d-863052-2 devstack@n-api.service[121403]: X-Domain-Name: None Nov 01 18:55:47.552984 n-d-863052-2 devstack@n-api.service[121403]: X-Identity-Status: Confirmed Nov 01 18:55:47.552984 n-d-863052-2 devstack@n-api.service[121403]: X-Is-Admin-Project: True Nov 01 18:55:47.552984 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Domain-Id: default Nov 01 18:55:47.552984 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Domain-Name: Default Nov 01 18:55:47.552984 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Id: bc1278822def4e9980c698a5d21092af Nov 01 18:55:47.552984 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Name: tempest-QuotasAdminNegativeTest-1518083747 Nov 01 18:55:47.552984 n-d-863052-2 devstack@n-api.service[121403]: X-Role: member,reader Nov 01 18:55:47.552984 n-d-863052-2 devstack@n-api.service[121403]: X-Roles: member,reader Nov 01 18:55:47.554503 n-d-863052-2 devstack@n-api.service[121403]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/bc1278822def4e9980c698a5d21092af"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/bc1278822def4e9980c698a5d21092af"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_bc1278822def4e9980c698a5d21092af", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/bc1278822def4e9980c698a5d21092af"}]}] Nov 01 18:55:47.554503 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant: tempest-QuotasAdminNegativeTest-1518083747 Nov 01 18:55:47.554503 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant-Id: bc1278822def4e9980c698a5d21092af Nov 01 18:55:47.554503 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-1518083747 Nov 01 18:55:47.554503 n-d-863052-2 devstack@n-api.service[121403]: X-User: tempest-QuotasAdminNegativeTest-1518083747-project Nov 01 18:55:47.554503 n-d-863052-2 devstack@n-api.service[121403]: X-User-Domain-Id: default Nov 01 18:55:47.554503 n-d-863052-2 devstack@n-api.service[121403]: X-User-Domain-Name: Default Nov 01 18:55:47.554503 n-d-863052-2 devstack@n-api.service[121403]: X-User-Id: 01bcc4a301b948dab0e690707170fdb2 Nov 01 18:55:47.554503 n-d-863052-2 devstack@n-api.service[121403]: X-User-Name: tempest-QuotasAdminNegativeTest-1518083747-project Nov 01 18:55:47.554503 n-d-863052-2 devstack@n-api.service[121403]: Nov 01 18:55:47.554503 n-d-863052-2 devstack@n-api.service[121403]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1927325488", "imageRef": "2d4a0047-1b9e-445f-8af8-1b5c9d93e881", "flavorRef": "452"}} Nov 01 18:55:47.554503 n-d-863052-2 devstack@n-api.service[121403]: method: > Nov 01 18:55:47.559309 n-d-863052-2 devstack@n-api.service[121403]: exception: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Nov 01 18:55:47.559309 n-d-863052-2 devstack@n-api.service[121403]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-1927325488', 'imageRef': '2d4a0047-1b9e-445f-8af8-1b5c9d93e881', 'flavorRef': '452'}}} Nov 01 18:55:47.559309 n-d-863052-2 devstack@n-api.service[121403]: {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 01 18:55:47.559309 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:55:47.559309 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Nov 01 18:55:47.559309 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Nov 01 18:55:47.559309 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 01 18:55:47.559309 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 01 18:55:47.559309 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Nov 01 18:55:47.559309 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise exc Nov 01 18:55:47.559309 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Nov 01 18:55:47.559309 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Nov 01 18:55:47.559309 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 01 18:55:47.559309 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 01 18:55:47.559309 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Nov 01 18:55:47.559309 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Nov 01 18:55:47.559309 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Nov 01 18:55:47.559309 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Nov 01 18:55:47.560508 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Nov 01 18:55:47.560508 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Nov 01 18:55:47.560508 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['instances'] Nov 01 18:55:47.560508 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 18:55:47.560508 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 18:55:47.560508 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 18:55:47.560508 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:55:47.560508 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Nov 01 18:55:47.560508 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Nov 01 18:55:47.560508 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Nov 01 18:55:47.560508 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return self._create_instance( Nov 01 18:55:47.560508 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1733, in _create_instance Nov 01 18:55:47.560508 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Nov 01 18:55:47.560508 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1362, in _provision_instances Nov 01 18:55:47.560508 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Nov 01 18:55:47.560508 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Nov 01 18:55:47.560508 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Nov 01 18:55:47.560508 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Nov 01 18:55:47.560508 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 18:55:47.560508 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 18:55:47.560508 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 18:55:47.562796 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:55:47.562796 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 18:55:47.562796 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 18:55:47.562796 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 01 18:55:47.562796 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 01 18:55:47.562796 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 01 18:55:47.562796 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 01 18:55:47.562796 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 01 18:55:47.562796 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 01 18:55:47.562796 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 01 18:55:47.562796 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 01 18:55:47.562796 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 01 18:55:47.562796 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 01 18:55:47.562796 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Nov 01 18:55:47.562796 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Nov 01 18:55:47.562796 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Nov 01 18:55:47.562796 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Nov 01 18:55:47.562796 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 18:55:47.562796 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 18:55:47.562796 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 18:55:47.562796 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:55:47.564315 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 18:55:47.564315 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 18:55:47.564315 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 01 18:55:47.564315 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 01 18:55:47.564315 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Nov 01 18:55:47.564315 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 18:55:47.564315 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-f2eecbb6-b16c-4573-b707-2ed60027a35f tempest-QuotasAdminNegativeTest-1518083747 tempest-QuotasAdminNegativeTest-1518083747-project] Returning 403 to user: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances {{(pid=121403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 01 18:55:47.564315 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-f2eecbb6-b16c-4573-b707-2ed60027a35f tempest-QuotasAdminNegativeTest-1518083747 tempest-QuotasAdminNegativeTest-1518083747-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 403 len: 119 microversion: 2.1 time: 0.836616 Nov 01 18:55:47.564315 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 210/437] 10.222.0.13 () {60 vars in 1147 bytes} [Tue Nov 1 18:55:46 2022] POST /compute/v2.1/servers => generated 119 bytes in 838 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Nov 01 18:55:47.564315 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-acb1c8fe-ac9b-4cb8-8ce2-7d8fd308296d tempest-HostsAdminTestJSON-1627096250 tempest-HostsAdminTestJSON-1627096250-project-admin] Calling method '.version_select at 0x7f0ae2c989d0>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:55:47.587855 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-acb1c8fe-ac9b-4cb8-8ce2-7d8fd308296d tempest-HostsAdminTestJSON-1627096250 tempest-HostsAdminTestJSON-1627096250-project-admin] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:55:47.588512 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-acb1c8fe-ac9b-4cb8-8ce2-7d8fd308296d tempest-HostsAdminTestJSON-1627096250 tempest-HostsAdminTestJSON-1627096250-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:55:47.588892 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-acb1c8fe-ac9b-4cb8-8ce2-7d8fd308296d tempest-HostsAdminTestJSON-1627096250 tempest-HostsAdminTestJSON-1627096250-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:55:47.632090 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-acb1c8fe-ac9b-4cb8-8ce2-7d8fd308296d tempest-HostsAdminTestJSON-1627096250 tempest-HostsAdminTestJSON-1627096250-project-admin] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:55:47.633245 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-acb1c8fe-ac9b-4cb8-8ce2-7d8fd308296d tempest-HostsAdminTestJSON-1627096250 tempest-HostsAdminTestJSON-1627096250-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:55:47.633834 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-acb1c8fe-ac9b-4cb8-8ce2-7d8fd308296d tempest-HostsAdminTestJSON-1627096250 tempest-HostsAdminTestJSON-1627096250-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:55:47.670485 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-acb1c8fe-ac9b-4cb8-8ce2-7d8fd308296d tempest-HostsAdminTestJSON-1627096250 tempest-HostsAdminTestJSON-1627096250-project-admin] 10.222.0.13 "GET /compute/v2.1/os-hosts/n-h1-863052-2" status: 200 len: 598 microversion: 2.1 time: 0.114098 Nov 01 18:55:47.671057 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 211/438] 10.222.0.13 () {58 vars in 1170 bytes} [Tue Nov 1 18:55:47 2022] GET /compute/v2.1/os-hosts/n-h1-863052-2 => generated 598 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 18:55:47.682951 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-d5f0fa34-52f9-45f7-9f80-7a18e54afd82 tempest-QuotasAdminNegativeTest-1138996703 tempest-QuotasAdminNegativeTest-1138996703-project-admin] Action: 'update', calling method: .version_select at 0x7f0ae2d9f4c0>, body: {"quota_set": {"instances": 10}} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 18:55:47.940139 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-2d60a79c-d452-49d1-9c26-1b435cf9bb35 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:55:47.949098 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-2d60a79c-d452-49d1-9c26-1b435cf9bb35 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:55:47.950557 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-2d60a79c-d452-49d1-9c26-1b435cf9bb35 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:55:47.951734 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-2d60a79c-d452-49d1-9c26-1b435cf9bb35 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] 10.222.0.13 "GET /compute/v2.1/servers/2d3a927e-a478-40b1-8c92-80396c82f76c" status: 200 len: 1361 microversion: 2.25 time: 1.018151 Nov 01 18:55:47.969702 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 228/439] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 18:55:46 2022] GET /compute/v2.1/servers/2d3a927e-a478-40b1-8c92-80396c82f76c => generated 1361 bytes in 1036 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 18:55:47.977672 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-fe8a9ae2-75cf-4536-af74-3dc9c3120aad tempest-QuotasAdminTestJSON-146785592 tempest-QuotasAdminTestJSON-146785592-project-admin] Calling method '.version_select at 0x7f0ae2b7cd30>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:55:48.044302 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d5f0fa34-52f9-45f7-9f80-7a18e54afd82 tempest-QuotasAdminNegativeTest-1138996703 tempest-QuotasAdminNegativeTest-1138996703-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:55:48.044828 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d5f0fa34-52f9-45f7-9f80-7a18e54afd82 tempest-QuotasAdminNegativeTest-1138996703 tempest-QuotasAdminNegativeTest-1138996703-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:55:48.045553 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d5f0fa34-52f9-45f7-9f80-7a18e54afd82 tempest-QuotasAdminNegativeTest-1138996703 tempest-QuotasAdminNegativeTest-1138996703-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:55:48.046287 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d5f0fa34-52f9-45f7-9f80-7a18e54afd82 tempest-QuotasAdminNegativeTest-1138996703 tempest-QuotasAdminNegativeTest-1138996703-project-admin] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:55:48.046739 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d5f0fa34-52f9-45f7-9f80-7a18e54afd82 tempest-QuotasAdminNegativeTest-1138996703 tempest-QuotasAdminNegativeTest-1138996703-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:55:48.048364 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d5f0fa34-52f9-45f7-9f80-7a18e54afd82 tempest-QuotasAdminNegativeTest-1138996703 tempest-QuotasAdminNegativeTest-1138996703-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:55:48.169873 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-d5f0fa34-52f9-45f7-9f80-7a18e54afd82 tempest-QuotasAdminNegativeTest-1138996703 tempest-QuotasAdminNegativeTest-1138996703-project-admin] 10.222.0.13 "PUT /compute/v2.1/os-quota-sets/bc1278822def4e9980c698a5d21092af" status: 200 len: 329 microversion: 2.1 time: 0.495710 Nov 01 18:55:48.170788 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 212/440] 10.222.0.13 () {60 vars in 1262 bytes} [Tue Nov 1 18:55:47 2022] PUT /compute/v2.1/os-quota-sets/bc1278822def4e9980c698a5d21092af => generated 329 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 18:55:48.190131 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-da6ebd69-ac82-40e2-97d6-6b1eca76d3cb tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:55:48.192315 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-da6ebd69-ac82-40e2-97d6-6b1eca76d3cb tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] [instance: de2ff806-a2fa-4390-b4d5-11ff24dd27ca] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:55:48.207229 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-da6ebd69-ac82-40e2-97d6-6b1eca76d3cb tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:55:48.207742 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-da6ebd69-ac82-40e2-97d6-6b1eca76d3cb tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:55:48.208217 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-da6ebd69-ac82-40e2-97d6-6b1eca76d3cb tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:55:48.209846 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-da6ebd69-ac82-40e2-97d6-6b1eca76d3cb tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:55:48.210822 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-da6ebd69-ac82-40e2-97d6-6b1eca76d3cb tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:55:48.211271 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-da6ebd69-ac82-40e2-97d6-6b1eca76d3cb tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:55:48.546650 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-fe8a9ae2-75cf-4536-af74-3dc9c3120aad tempest-QuotasAdminTestJSON-146785592 tempest-QuotasAdminTestJSON-146785592-project-admin] 10.222.0.13 "GET /compute/v2.1/os-quota-sets/65f0cf532f66453cae500a307f4d7989/defaults" status: 200 len: 371 microversion: 2.1 time: 0.575452 Nov 01 18:55:48.547228 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 229/441] 10.222.0.13 () {58 vars in 1269 bytes} [Tue Nov 1 18:55:47 2022] GET /compute/v2.1/os-quota-sets/65f0cf532f66453cae500a307f4d7989/defaults => generated 371 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 18:55:48.558149 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-49713f98-f078-4087-92a9-86d04c7edd2b tempest-HostsAdminTestJSON-1627096250 tempest-HostsAdminTestJSON-1627096250-project-admin] Calling method '.version_select at 0x7f0ae2b480d0>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:55:48.576666 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-49713f98-f078-4087-92a9-86d04c7edd2b tempest-HostsAdminTestJSON-1627096250 tempest-HostsAdminTestJSON-1627096250-project-admin] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:55:48.582090 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-49713f98-f078-4087-92a9-86d04c7edd2b tempest-HostsAdminTestJSON-1627096250 tempest-HostsAdminTestJSON-1627096250-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:55:48.590511 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-49713f98-f078-4087-92a9-86d04c7edd2b tempest-HostsAdminTestJSON-1627096250 tempest-HostsAdminTestJSON-1627096250-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:55:48.611801 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-49713f98-f078-4087-92a9-86d04c7edd2b tempest-HostsAdminTestJSON-1627096250 tempest-HostsAdminTestJSON-1627096250-project-admin] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:55:48.613137 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-49713f98-f078-4087-92a9-86d04c7edd2b tempest-HostsAdminTestJSON-1627096250 tempest-HostsAdminTestJSON-1627096250-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:55:48.617377 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-49713f98-f078-4087-92a9-86d04c7edd2b tempest-HostsAdminTestJSON-1627096250 tempest-HostsAdminTestJSON-1627096250-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:55:48.649560 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-49713f98-f078-4087-92a9-86d04c7edd2b tempest-HostsAdminTestJSON-1627096250 tempest-HostsAdminTestJSON-1627096250-project-admin] 10.222.0.13 "GET /compute/v2.1/os-hosts/n-h2-863052-2" status: 200 len: 467 microversion: 2.1 time: 0.100875 Nov 01 18:55:48.652069 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 230/442] 10.222.0.13 () {58 vars in 1170 bytes} [Tue Nov 1 18:55:48 2022] GET /compute/v2.1/os-hosts/n-h2-863052-2 => generated 467 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 18:55:48.661871 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-efcc76af-a3f4-42be-8e83-4ea58dc9add1 tempest-QuotasAdminNegativeTest-1138996703 tempest-QuotasAdminNegativeTest-1138996703-project-admin] Calling method '.version_select at 0x7f0ae2b7cee0>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:55:49.052965 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-da6ebd69-ac82-40e2-97d6-6b1eca76d3cb tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f32f5fba1976432d938e664c7714e52b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b9d4c236b944f9b2e8e502a50a8f8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:55:49.079605 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-da6ebd69-ac82-40e2-97d6-6b1eca76d3cb tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] 10.222.0.13 "GET /compute/v2.1/servers/de2ff806-a2fa-4390-b4d5-11ff24dd27ca" status: 200 len: 1502 microversion: 2.1 time: 0.907644 Nov 01 18:55:49.082911 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 213/443] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:55:48 2022] GET /compute/v2.1/servers/de2ff806-a2fa-4390-b4d5-11ff24dd27ca => generated 1502 bytes in 912 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:55:49.108986 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-17318b82-ee3e-4f71-adeb-b648b8a20c75 tempest-QuotasAdminTestJSON-146785592 tempest-QuotasAdminTestJSON-146785592-project-admin] Action: 'update', calling method: .version_select at 0x7f0ae2ceac10>, body: {"quota_set": {"force": true, "metadata_items": 256, "ram": 10240, "key_pairs": 200, "instances": 20, "server_groups": 20, "server_group_members": 20, "cores": 2, "fixed_ips": 10, "floating_ips": 20, "security_group_rules": 20, "security_groups": 20, "injected_file_content_bytes": 20480, "injected_file_path_bytes": 512, "injected_files": 10}} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 18:55:49.304014 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-efcc76af-a3f4-42be-8e83-4ea58dc9add1 tempest-QuotasAdminNegativeTest-1138996703 tempest-QuotasAdminNegativeTest-1138996703-project-admin] 10.222.0.13 "GET /compute/v2.1/os-quota-sets/bc1278822def4e9980c698a5d21092af" status: 200 len: 371 microversion: 2.1 time: 0.647905 Nov 01 18:55:49.305739 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 231/444] 10.222.0.13 () {58 vars in 1242 bytes} [Tue Nov 1 18:55:48 2022] GET /compute/v2.1/os-quota-sets/bc1278822def4e9980c698a5d21092af => generated 371 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 18:55:49.322879 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [req-f940dd39-e912-4cb2-8377-a0f6dca30c09 req-8cdc6890-7323-4701-9865-6be2c97d0e68 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2d3a927e-a478-40b1-8c92-80396c82f76c", "tag": "9765089c-d945-4fd6-a621-1f90f70e4416"}, {"name": "network-changed", "server_uuid": "de2ff806-a2fa-4390-b4d5-11ff24dd27ca", "tag": "4157a71a-6529-42b5-9194-408c1d22d219"}]} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 18:55:49.353211 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-f940dd39-e912-4cb2-8377-a0f6dca30c09 req-8cdc6890-7323-4701-9865-6be2c97d0e68 service nova] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:55:49.354894 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-f940dd39-e912-4cb2-8377-a0f6dca30c09 req-8cdc6890-7323-4701-9865-6be2c97d0e68 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:55:49.355503 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-f940dd39-e912-4cb2-8377-a0f6dca30c09 req-8cdc6890-7323-4701-9865-6be2c97d0e68 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:55:49.390355 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.compute.server_external_events [req-f940dd39-e912-4cb2-8377-a0f6dca30c09 req-8cdc6890-7323-4701-9865-6be2c97d0e68 service nova] Creating event network-changed:9765089c-d945-4fd6-a621-1f90f70e4416 for instance 2d3a927e-a478-40b1-8c92-80396c82f76c on n-h1-863052-2 Nov 01 18:55:49.392298 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.compute.server_external_events [req-f940dd39-e912-4cb2-8377-a0f6dca30c09 req-8cdc6890-7323-4701-9865-6be2c97d0e68 service nova] Creating event network-changed:4157a71a-6529-42b5-9194-408c1d22d219 for instance de2ff806-a2fa-4390-b4d5-11ff24dd27ca on n-h1-863052-2 Nov 01 18:55:49.410235 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [req-f940dd39-e912-4cb2-8377-a0f6dca30c09 req-8cdc6890-7323-4701-9865-6be2c97d0e68 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.101124 Nov 01 18:55:49.412564 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 232/445] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Nov 1 18:55:49 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 18:55:49.429150 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-9c735216-6eed-42f5-bc8e-9d0464d046fa tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:55:49.430181 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-9c735216-6eed-42f5-bc8e-9d0464d046fa tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] [instance: 2d3a927e-a478-40b1-8c92-80396c82f76c] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:55:49.443105 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-9c735216-6eed-42f5-bc8e-9d0464d046fa tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:55:49.448446 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-9c735216-6eed-42f5-bc8e-9d0464d046fa tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:55:49.449031 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-9c735216-6eed-42f5-bc8e-9d0464d046fa tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:55:49.450339 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-9c735216-6eed-42f5-bc8e-9d0464d046fa tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:55:49.451011 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-9c735216-6eed-42f5-bc8e-9d0464d046fa tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:55:49.451636 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-9c735216-6eed-42f5-bc8e-9d0464d046fa tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:55:49.695488 n-d-863052-2 devstack@n-api.service[121403]: DEBUG dbcounter [-] [121403] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=121403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 18:55:49.703059 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-17318b82-ee3e-4f71-adeb-b648b8a20c75 tempest-QuotasAdminTestJSON-146785592 tempest-QuotasAdminTestJSON-146785592-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:55:49.703912 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-17318b82-ee3e-4f71-adeb-b648b8a20c75 tempest-QuotasAdminTestJSON-146785592 tempest-QuotasAdminTestJSON-146785592-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:55:49.704539 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-17318b82-ee3e-4f71-adeb-b648b8a20c75 tempest-QuotasAdminTestJSON-146785592 tempest-QuotasAdminTestJSON-146785592-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:55:49.706156 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-17318b82-ee3e-4f71-adeb-b648b8a20c75 tempest-QuotasAdminTestJSON-146785592 tempest-QuotasAdminTestJSON-146785592-project-admin] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:55:49.706967 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-17318b82-ee3e-4f71-adeb-b648b8a20c75 tempest-QuotasAdminTestJSON-146785592 tempest-QuotasAdminTestJSON-146785592-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:55:49.707551 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-17318b82-ee3e-4f71-adeb-b648b8a20c75 tempest-QuotasAdminTestJSON-146785592 tempest-QuotasAdminTestJSON-146785592-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:55:49.732500 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-9c735216-6eed-42f5-bc8e-9d0464d046fa tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:55:49.747232 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-9c735216-6eed-42f5-bc8e-9d0464d046fa tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:55:49.749057 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-9c735216-6eed-42f5-bc8e-9d0464d046fa tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:55:49.753720 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-9c735216-6eed-42f5-bc8e-9d0464d046fa tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] 10.222.0.13 "GET /compute/v2.1/servers/2d3a927e-a478-40b1-8c92-80396c82f76c" status: 200 len: 1361 microversion: 2.25 time: 0.337329 Nov 01 18:55:49.755968 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 233/446] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 18:55:49 2022] GET /compute/v2.1/servers/2d3a927e-a478-40b1-8c92-80396c82f76c => generated 1361 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 18:55:49.773129 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-ba51d7d1-b14f-445a-ad2d-c6f0f59408ba tempest-QuotasAdminNegativeTest-1138996703 tempest-QuotasAdminNegativeTest-1138996703-project-admin] Action: 'update', calling method: .version_select at 0x7f0ae2ca50d0>, body: {"quota_set": {"force": true, "ram": 0}} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 18:55:50.181567 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-17318b82-ee3e-4f71-adeb-b648b8a20c75 tempest-QuotasAdminTestJSON-146785592 tempest-QuotasAdminTestJSON-146785592-project-admin] 10.222.0.13 "PUT /compute/v2.1/os-quota-sets/65f0cf532f66453cae500a307f4d7989" status: 200 len: 329 microversion: 2.1 time: 1.086512 Nov 01 18:55:50.191083 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 214/447] 10.222.0.13 () {60 vars in 1263 bytes} [Tue Nov 1 18:55:49 2022] PUT /compute/v2.1/os-quota-sets/65f0cf532f66453cae500a307f4d7989 => generated 329 bytes in 1097 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 18:55:50.197324 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-3df2bf87-3b4f-4bb9-b191-e5c35487ef4a tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:55:50.197931 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-3df2bf87-3b4f-4bb9-b191-e5c35487ef4a tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] [instance: de2ff806-a2fa-4390-b4d5-11ff24dd27ca] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:55:50.221421 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-3df2bf87-3b4f-4bb9-b191-e5c35487ef4a tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:55:50.221924 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-3df2bf87-3b4f-4bb9-b191-e5c35487ef4a tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:55:50.222356 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-3df2bf87-3b4f-4bb9-b191-e5c35487ef4a tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:55:50.223065 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-3df2bf87-3b4f-4bb9-b191-e5c35487ef4a tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:55:50.223522 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-3df2bf87-3b4f-4bb9-b191-e5c35487ef4a tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:55:50.223941 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-3df2bf87-3b4f-4bb9-b191-e5c35487ef4a tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:55:50.408474 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-ba51d7d1-b14f-445a-ad2d-c6f0f59408ba tempest-QuotasAdminNegativeTest-1138996703 tempest-QuotasAdminNegativeTest-1138996703-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:55:50.413919 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-ba51d7d1-b14f-445a-ad2d-c6f0f59408ba tempest-QuotasAdminNegativeTest-1138996703 tempest-QuotasAdminNegativeTest-1138996703-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:55:50.414305 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-ba51d7d1-b14f-445a-ad2d-c6f0f59408ba tempest-QuotasAdminNegativeTest-1138996703 tempest-QuotasAdminNegativeTest-1138996703-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:55:50.415431 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-ba51d7d1-b14f-445a-ad2d-c6f0f59408ba tempest-QuotasAdminNegativeTest-1138996703 tempest-QuotasAdminNegativeTest-1138996703-project-admin] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:55:50.416055 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-ba51d7d1-b14f-445a-ad2d-c6f0f59408ba tempest-QuotasAdminNegativeTest-1138996703 tempest-QuotasAdminNegativeTest-1138996703-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:55:50.416488 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-ba51d7d1-b14f-445a-ad2d-c6f0f59408ba tempest-QuotasAdminNegativeTest-1138996703 tempest-QuotasAdminNegativeTest-1138996703-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:55:50.423813 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-3df2bf87-3b4f-4bb9-b191-e5c35487ef4a tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f32f5fba1976432d938e664c7714e52b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b9d4c236b944f9b2e8e502a50a8f8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:55:50.433032 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-3df2bf87-3b4f-4bb9-b191-e5c35487ef4a tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] 10.222.0.13 "GET /compute/v2.1/servers/de2ff806-a2fa-4390-b4d5-11ff24dd27ca" status: 200 len: 1502 microversion: 2.1 time: 0.239382 Nov 01 18:55:50.445167 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 215/448] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:55:50 2022] GET /compute/v2.1/servers/de2ff806-a2fa-4390-b4d5-11ff24dd27ca => generated 1502 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:55:50.457140 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-4fae0ff6-0520-4db2-9114-53304ffe9456 tempest-QuotasAdminTestJSON-146785592 tempest-QuotasAdminTestJSON-146785592-project-admin] Action: 'update', calling method: .version_select at 0x7f0ae2cdca60>, body: {"quota_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1, "server_group_members": 10, "server_groups": 10}} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 18:55:50.472236 n-d-863052-2 devstack@n-api.service[121402]: DEBUG dbcounter [-] [121402] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=121402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 18:55:50.550529 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-ba51d7d1-b14f-445a-ad2d-c6f0f59408ba tempest-QuotasAdminNegativeTest-1138996703 tempest-QuotasAdminNegativeTest-1138996703-project-admin] 10.222.0.13 "PUT /compute/v2.1/os-quota-sets/bc1278822def4e9980c698a5d21092af" status: 200 len: 325 microversion: 2.1 time: 0.790502 Nov 01 18:55:50.564976 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 234/449] 10.222.0.13 () {60 vars in 1262 bytes} [Tue Nov 1 18:55:49 2022] PUT /compute/v2.1/os-quota-sets/bc1278822def4e9980c698a5d21092af => generated 325 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 18:55:50.783952 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-e988c734-7a1d-4cf6-9ba5-0dfa0d8246d7 tempest-QuotasAdminNegativeTest-1518083747 tempest-QuotasAdminNegativeTest-1518083747-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1499725956", "imageRef": "2d4a0047-1b9e-445f-8af8-1b5c9d93e881", "flavorRef": "452"}} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 18:55:50.893024 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.network.neutron [None req-e988c734-7a1d-4cf6-9ba5-0dfa0d8246d7 tempest-QuotasAdminNegativeTest-1518083747 tempest-QuotasAdminNegativeTest-1518083747-project] validate_networks() for None {{(pid=121402) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 01 18:55:51.205126 n-d-863052-2 devstack@n-api.service[121403]: DEBUG dbcounter [-] [121403] Writing DB stats nova_cell0:SELECT=100 {{(pid=121403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 18:55:51.215046 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-4fae0ff6-0520-4db2-9114-53304ffe9456 tempest-QuotasAdminTestJSON-146785592 tempest-QuotasAdminTestJSON-146785592-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:55:51.222796 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-4fae0ff6-0520-4db2-9114-53304ffe9456 tempest-QuotasAdminTestJSON-146785592 tempest-QuotasAdminTestJSON-146785592-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:55:51.223609 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-4fae0ff6-0520-4db2-9114-53304ffe9456 tempest-QuotasAdminTestJSON-146785592 tempest-QuotasAdminTestJSON-146785592-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:55:51.228410 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-4fae0ff6-0520-4db2-9114-53304ffe9456 tempest-QuotasAdminTestJSON-146785592 tempest-QuotasAdminTestJSON-146785592-project-admin] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:55:51.231552 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-4fae0ff6-0520-4db2-9114-53304ffe9456 tempest-QuotasAdminTestJSON-146785592 tempest-QuotasAdminTestJSON-146785592-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:55:51.232431 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-4fae0ff6-0520-4db2-9114-53304ffe9456 tempest-QuotasAdminTestJSON-146785592 tempest-QuotasAdminTestJSON-146785592-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:55:51.248506 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.virt.hardware [None req-e988c734-7a1d-4cf6-9ba5-0dfa0d8246d7 tempest-QuotasAdminNegativeTest-1518083747 tempest-QuotasAdminNegativeTest-1518083747-project] Flavor limits 0:0:0 {{(pid=121402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 01 18:55:51.249334 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.virt.hardware [None req-e988c734-7a1d-4cf6-9ba5-0dfa0d8246d7 tempest-QuotasAdminNegativeTest-1518083747 tempest-QuotasAdminNegativeTest-1518083747-project] Image limits 0:0:0 {{(pid=121402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 01 18:55:51.249947 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.virt.hardware [None req-e988c734-7a1d-4cf6-9ba5-0dfa0d8246d7 tempest-QuotasAdminNegativeTest-1518083747 tempest-QuotasAdminNegativeTest-1518083747-project] Flavor pref 0:0:0 {{(pid=121402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 01 18:55:51.250580 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.virt.hardware [None req-e988c734-7a1d-4cf6-9ba5-0dfa0d8246d7 tempest-QuotasAdminNegativeTest-1518083747 tempest-QuotasAdminNegativeTest-1518083747-project] Image pref 0:0:0 {{(pid=121402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 01 18:55:51.251035 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.virt.hardware [None req-e988c734-7a1d-4cf6-9ba5-0dfa0d8246d7 tempest-QuotasAdminNegativeTest-1518083747 tempest-QuotasAdminNegativeTest-1518083747-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 01 18:55:51.272771 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e988c734-7a1d-4cf6-9ba5-0dfa0d8246d7 tempest-QuotasAdminNegativeTest-1518083747 tempest-QuotasAdminNegativeTest-1518083747-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:55:51.276539 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e988c734-7a1d-4cf6-9ba5-0dfa0d8246d7 tempest-QuotasAdminNegativeTest-1518083747 tempest-QuotasAdminNegativeTest-1518083747-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:55:51.277213 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e988c734-7a1d-4cf6-9ba5-0dfa0d8246d7 tempest-QuotasAdminNegativeTest-1518083747 tempest-QuotasAdminNegativeTest-1518083747-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:55:51.278129 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e988c734-7a1d-4cf6-9ba5-0dfa0d8246d7 tempest-QuotasAdminNegativeTest-1518083747 tempest-QuotasAdminNegativeTest-1518083747-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:55:51.280637 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e988c734-7a1d-4cf6-9ba5-0dfa0d8246d7 tempest-QuotasAdminNegativeTest-1518083747 tempest-QuotasAdminNegativeTest-1518083747-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:55:51.281058 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e988c734-7a1d-4cf6-9ba5-0dfa0d8246d7 tempest-QuotasAdminNegativeTest-1518083747 tempest-QuotasAdminNegativeTest-1518083747-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:55:51.357025 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.quota [None req-e988c734-7a1d-4cf6-9ba5-0dfa0d8246d7 tempest-QuotasAdminNegativeTest-1518083747 tempest-QuotasAdminNegativeTest-1518083747-project] Getting quotas for project bc1278822def4e9980c698a5d21092af. Resources: {'cores', 'ram', 'instances'} {{(pid=121402) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 01 18:55:51.384640 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.quota [None req-e988c734-7a1d-4cf6-9ba5-0dfa0d8246d7 tempest-QuotasAdminNegativeTest-1518083747 tempest-QuotasAdminNegativeTest-1518083747-project] Getting quotas for user 01bcc4a301b948dab0e690707170fdb2 and project bc1278822def4e9980c698a5d21092af. Resources: {'cores', 'ram', 'instances'} {{(pid=121402) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 01 18:55:51.402276 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.utils [None req-e988c734-7a1d-4cf6-9ba5-0dfa0d8246d7 tempest-QuotasAdminNegativeTest-1518083747 tempest-QuotasAdminNegativeTest-1518083747-project] ram quota exceeded for bc1278822def4e9980c698a5d21092af, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=121402) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Nov 01 18:55:51.403534 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.wsgi [None req-e988c734-7a1d-4cf6-9ba5-0dfa0d8246d7 tempest-QuotasAdminNegativeTest-1518083747 tempest-QuotasAdminNegativeTest-1518083747-project] HTTP exception thrown: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Nov 01 18:55:51.408013 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-e988c734-7a1d-4cf6-9ba5-0dfa0d8246d7 tempest-QuotasAdminNegativeTest-1518083747 tempest-QuotasAdminNegativeTest-1518083747-project] Request method failure captured: Nov 01 18:55:51.408013 n-d-863052-2 devstack@n-api.service[121402]: request: POST /compute/v2.1/servers HTTP/1.1 Nov 01 18:55:51.408013 n-d-863052-2 devstack@n-api.service[121402]: Accept: application/json Nov 01 18:55:51.408013 n-d-863052-2 devstack@n-api.service[121402]: Accept-Encoding: identity Nov 01 18:55:51.408013 n-d-863052-2 devstack@n-api.service[121402]: Connection: close Nov 01 18:55:51.408013 n-d-863052-2 devstack@n-api.service[121402]: Content-Length: 145 Nov 01 18:55:51.408013 n-d-863052-2 devstack@n-api.service[121402]: Content-Type: application/json Nov 01 18:55:51.408013 n-d-863052-2 devstack@n-api.service[121402]: Host: 10.222.0.13 Nov 01 18:55:51.408013 n-d-863052-2 devstack@n-api.service[121402]: Openstack-System-Scope: None Nov 01 18:55:51.408013 n-d-863052-2 devstack@n-api.service[121402]: User-Agent: python-urllib3/1.26.12 Nov 01 18:55:51.408013 n-d-863052-2 devstack@n-api.service[121402]: X-Auth-Token: gAAAAABjYWupllb0-YmEC7tn-BvSZEkJE1EMvES1hWAnmFSJcqyHVC1KV6qoJuylLGMGBqTm4LnJ2nr6GVdBCD5P3jYu15-lHKKkpkFyHwpioFbb-X7kgYX1YtTaJGBY3mZKTTU-KIgchU2r2xr4yqWXnVWn5Y3KxKPnA6THzuoKvFMd6cf8FMo Nov 01 18:55:51.408013 n-d-863052-2 devstack@n-api.service[121402]: X-Domain-Id: None Nov 01 18:55:51.408013 n-d-863052-2 devstack@n-api.service[121402]: X-Domain-Name: None Nov 01 18:55:51.408013 n-d-863052-2 devstack@n-api.service[121402]: X-Identity-Status: Confirmed Nov 01 18:55:51.408013 n-d-863052-2 devstack@n-api.service[121402]: X-Is-Admin-Project: True Nov 01 18:55:51.408013 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Domain-Id: default Nov 01 18:55:51.408013 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Domain-Name: Default Nov 01 18:55:51.408013 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Id: bc1278822def4e9980c698a5d21092af Nov 01 18:55:51.408013 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Name: tempest-QuotasAdminNegativeTest-1518083747 Nov 01 18:55:51.408013 n-d-863052-2 devstack@n-api.service[121402]: X-Role: member,reader Nov 01 18:55:51.408013 n-d-863052-2 devstack@n-api.service[121402]: X-Roles: member,reader Nov 01 18:55:51.410347 n-d-863052-2 devstack@n-api.service[121402]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/bc1278822def4e9980c698a5d21092af"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/bc1278822def4e9980c698a5d21092af"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_bc1278822def4e9980c698a5d21092af", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/bc1278822def4e9980c698a5d21092af"}]}] Nov 01 18:55:51.410347 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant: tempest-QuotasAdminNegativeTest-1518083747 Nov 01 18:55:51.410347 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant-Id: bc1278822def4e9980c698a5d21092af Nov 01 18:55:51.410347 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-1518083747 Nov 01 18:55:51.410347 n-d-863052-2 devstack@n-api.service[121402]: X-User: tempest-QuotasAdminNegativeTest-1518083747-project Nov 01 18:55:51.410347 n-d-863052-2 devstack@n-api.service[121402]: X-User-Domain-Id: default Nov 01 18:55:51.410347 n-d-863052-2 devstack@n-api.service[121402]: X-User-Domain-Name: Default Nov 01 18:55:51.410347 n-d-863052-2 devstack@n-api.service[121402]: X-User-Id: 01bcc4a301b948dab0e690707170fdb2 Nov 01 18:55:51.410347 n-d-863052-2 devstack@n-api.service[121402]: X-User-Name: tempest-QuotasAdminNegativeTest-1518083747-project Nov 01 18:55:51.410347 n-d-863052-2 devstack@n-api.service[121402]: Nov 01 18:55:51.410347 n-d-863052-2 devstack@n-api.service[121402]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1499725956", "imageRef": "2d4a0047-1b9e-445f-8af8-1b5c9d93e881", "flavorRef": "452"}} Nov 01 18:55:51.410347 n-d-863052-2 devstack@n-api.service[121402]: method: > Nov 01 18:55:51.411284 n-d-863052-2 devstack@n-api.service[121402]: exception: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Nov 01 18:55:51.411284 n-d-863052-2 devstack@n-api.service[121402]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-1499725956', 'imageRef': '2d4a0047-1b9e-445f-8af8-1b5c9d93e881', 'flavorRef': '452'}}} Nov 01 18:55:51.411284 n-d-863052-2 devstack@n-api.service[121402]: {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 01 18:55:51.411284 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:55:51.411284 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Nov 01 18:55:51.411284 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Nov 01 18:55:51.411284 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 01 18:55:51.411284 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 01 18:55:51.411284 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Nov 01 18:55:51.411284 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise exc Nov 01 18:55:51.411284 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Nov 01 18:55:51.411284 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Nov 01 18:55:51.411284 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 01 18:55:51.411284 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 01 18:55:51.411284 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Nov 01 18:55:51.411284 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Nov 01 18:55:51.411284 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Nov 01 18:55:51.411284 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Nov 01 18:55:51.412337 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Nov 01 18:55:51.412337 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Nov 01 18:55:51.412337 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['ram'] Nov 01 18:55:51.412337 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 18:55:51.412337 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 18:55:51.412337 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 18:55:51.412337 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:55:51.412337 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Nov 01 18:55:51.412337 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Nov 01 18:55:51.412337 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Nov 01 18:55:51.412337 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return self._create_instance( Nov 01 18:55:51.412337 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1733, in _create_instance Nov 01 18:55:51.412337 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Nov 01 18:55:51.412337 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1362, in _provision_instances Nov 01 18:55:51.412337 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Nov 01 18:55:51.412337 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Nov 01 18:55:51.412337 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Nov 01 18:55:51.412337 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Nov 01 18:55:51.412337 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 18:55:51.412337 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 18:55:51.412337 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 18:55:51.414828 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:55:51.414828 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 18:55:51.414828 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 18:55:51.414828 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 01 18:55:51.414828 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 01 18:55:51.414828 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 01 18:55:51.414828 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 01 18:55:51.414828 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 01 18:55:51.414828 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 01 18:55:51.414828 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 01 18:55:51.414828 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 01 18:55:51.414828 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 01 18:55:51.414828 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 01 18:55:51.414828 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Nov 01 18:55:51.414828 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Nov 01 18:55:51.414828 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Nov 01 18:55:51.414828 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Nov 01 18:55:51.414828 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 18:55:51.414828 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 18:55:51.414828 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 18:55:51.414828 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:55:51.417540 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 18:55:51.417540 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 18:55:51.417540 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 01 18:55:51.417540 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 01 18:55:51.417540 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Nov 01 18:55:51.417540 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 18:55:51.417540 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-e988c734-7a1d-4cf6-9ba5-0dfa0d8246d7 tempest-QuotasAdminNegativeTest-1518083747 tempest-QuotasAdminNegativeTest-1518083747-project] Returning 403 to user: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram {{(pid=121402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 01 18:55:51.417540 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-e988c734-7a1d-4cf6-9ba5-0dfa0d8246d7 tempest-QuotasAdminNegativeTest-1518083747 tempest-QuotasAdminNegativeTest-1518083747-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 403 len: 110 microversion: 2.1 time: 0.631109 Nov 01 18:55:51.417540 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 235/450] 10.222.0.13 () {60 vars in 1147 bytes} [Tue Nov 1 18:55:50 2022] POST /compute/v2.1/servers => generated 110 bytes in 638 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Nov 01 18:55:51.431449 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-19e27046-1d19-4099-a0e2-0acab172b57d tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:55:51.432100 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-19e27046-1d19-4099-a0e2-0acab172b57d tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] [instance: 2d3a927e-a478-40b1-8c92-80396c82f76c] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:55:51.450643 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-19e27046-1d19-4099-a0e2-0acab172b57d tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:55:51.451399 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-19e27046-1d19-4099-a0e2-0acab172b57d tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:55:51.452093 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-19e27046-1d19-4099-a0e2-0acab172b57d tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:55:51.453067 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-19e27046-1d19-4099-a0e2-0acab172b57d tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:55:51.453769 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-19e27046-1d19-4099-a0e2-0acab172b57d tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:55:51.454726 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-19e27046-1d19-4099-a0e2-0acab172b57d tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:55:51.807913 n-d-863052-2 devstack@n-api.service[121403]: DEBUG dbcounter [-] [121403] Writing DB stats nova_api:SELECT=61,nova_api:INSERT=27,nova_api:UPDATE=12 {{(pid=121403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 18:55:51.870409 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-4fae0ff6-0520-4db2-9114-53304ffe9456 tempest-QuotasAdminTestJSON-146785592 tempest-QuotasAdminTestJSON-146785592-project-admin] 10.222.0.13 "PUT /compute/v2.1/os-quota-sets/65f0cf532f66453cae500a307f4d7989" status: 200 len: 329 microversion: 2.1 time: 1.424021 Nov 01 18:55:51.871320 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 216/451] 10.222.0.13 () {60 vars in 1263 bytes} [Tue Nov 1 18:55:50 2022] PUT /compute/v2.1/os-quota-sets/65f0cf532f66453cae500a307f4d7989 => generated 329 bytes in 1425 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 18:55:51.878283 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-7cb80e23-f807-48e4-9e5d-b36ab04af5a2 tempest-QuotasAdminNegativeTest-1138996703 tempest-QuotasAdminNegativeTest-1138996703-project-admin] Action: 'update', calling method: .version_select at 0x7f0ae2ce2430>, body: {"quota_set": {"ram": 51200}} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 18:55:51.948441 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-19e27046-1d19-4099-a0e2-0acab172b57d tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:55:51.958188 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-19e27046-1d19-4099-a0e2-0acab172b57d tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:55:51.965938 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-19e27046-1d19-4099-a0e2-0acab172b57d tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:55:51.967326 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-19e27046-1d19-4099-a0e2-0acab172b57d tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] 10.222.0.13 "GET /compute/v2.1/servers/2d3a927e-a478-40b1-8c92-80396c82f76c" status: 200 len: 1361 microversion: 2.25 time: 0.548820 Nov 01 18:55:51.969461 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 236/452] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 18:55:51 2022] GET /compute/v2.1/servers/2d3a927e-a478-40b1-8c92-80396c82f76c => generated 1361 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 18:55:51.974864 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-be6e6a97-4142-4364-b384-83a34749b327 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:55:51.977373 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-be6e6a97-4142-4364-b384-83a34749b327 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] [instance: de2ff806-a2fa-4390-b4d5-11ff24dd27ca] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:55:51.994277 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-be6e6a97-4142-4364-b384-83a34749b327 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:55:51.997828 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-be6e6a97-4142-4364-b384-83a34749b327 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:55:51.998458 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-be6e6a97-4142-4364-b384-83a34749b327 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:55:51.999324 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-be6e6a97-4142-4364-b384-83a34749b327 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:55:52.001110 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-be6e6a97-4142-4364-b384-83a34749b327 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:55:52.002064 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-be6e6a97-4142-4364-b384-83a34749b327 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:55:52.314682 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-be6e6a97-4142-4364-b384-83a34749b327 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f32f5fba1976432d938e664c7714e52b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b9d4c236b944f9b2e8e502a50a8f8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:55:52.330920 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-be6e6a97-4142-4364-b384-83a34749b327 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] 10.222.0.13 "GET /compute/v2.1/servers/de2ff806-a2fa-4390-b4d5-11ff24dd27ca" status: 200 len: 1502 microversion: 2.1 time: 0.359658 Nov 01 18:55:52.347347 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-7cb80e23-f807-48e4-9e5d-b36ab04af5a2 tempest-QuotasAdminNegativeTest-1138996703 tempest-QuotasAdminNegativeTest-1138996703-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:55:52.347347 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-7cb80e23-f807-48e4-9e5d-b36ab04af5a2 tempest-QuotasAdminNegativeTest-1138996703 tempest-QuotasAdminNegativeTest-1138996703-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:55:52.347347 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-7cb80e23-f807-48e4-9e5d-b36ab04af5a2 tempest-QuotasAdminNegativeTest-1138996703 tempest-QuotasAdminNegativeTest-1138996703-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:55:52.347347 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-7cb80e23-f807-48e4-9e5d-b36ab04af5a2 tempest-QuotasAdminNegativeTest-1138996703 tempest-QuotasAdminNegativeTest-1138996703-project-admin] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:55:52.348002 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-7cb80e23-f807-48e4-9e5d-b36ab04af5a2 tempest-QuotasAdminNegativeTest-1138996703 tempest-QuotasAdminNegativeTest-1138996703-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:55:52.348002 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-7cb80e23-f807-48e4-9e5d-b36ab04af5a2 tempest-QuotasAdminNegativeTest-1138996703 tempest-QuotasAdminNegativeTest-1138996703-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:55:52.348816 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 237/453] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:55:51 2022] GET /compute/v2.1/servers/de2ff806-a2fa-4390-b4d5-11ff24dd27ca => generated 1502 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:55:52.473461 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-7cb80e23-f807-48e4-9e5d-b36ab04af5a2 tempest-QuotasAdminNegativeTest-1138996703 tempest-QuotasAdminNegativeTest-1138996703-project-admin] 10.222.0.13 "PUT /compute/v2.1/os-quota-sets/bc1278822def4e9980c698a5d21092af" status: 200 len: 329 microversion: 2.1 time: 0.600946 Nov 01 18:55:52.474920 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 217/454] 10.222.0.13 () {60 vars in 1262 bytes} [Tue Nov 1 18:55:51 2022] PUT /compute/v2.1/os-quota-sets/bc1278822def4e9980c698a5d21092af => generated 329 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 18:55:52.494188 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-1d1873f5-c03b-4909-9a88-ea8bec95f1bd tempest-QuotasAdminNegativeTest-1518083747 tempest-QuotasAdminNegativeTest-1518083747-project] Action: 'update', calling method: .version_select at 0x7f0ae2bd4ca0>, body: {"quota_set": {"ram": 0}} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 18:55:52.508724 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-1d1873f5-c03b-4909-9a88-ea8bec95f1bd tempest-QuotasAdminNegativeTest-1518083747 tempest-QuotasAdminNegativeTest-1518083747-project] Policy check for os_compute_api:os-quota-sets:update failed with credentials {'is_admin': False, 'user_id': '01bcc4a301b948dab0e690707170fdb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1278822def4e9980c698a5d21092af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:55:52.510711 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-1d1873f5-c03b-4909-9a88-ea8bec95f1bd tempest-QuotasAdminNegativeTest-1518083747 tempest-QuotasAdminNegativeTest-1518083747-project] Request method failure captured: Nov 01 18:55:52.510711 n-d-863052-2 devstack@n-api.service[121403]: request: PUT /compute/v2.1/os-quota-sets/bc1278822def4e9980c698a5d21092af HTTP/1.1 Nov 01 18:55:52.510711 n-d-863052-2 devstack@n-api.service[121403]: Accept: application/json Nov 01 18:55:52.510711 n-d-863052-2 devstack@n-api.service[121403]: Accept-Encoding: identity Nov 01 18:55:52.510711 n-d-863052-2 devstack@n-api.service[121403]: Connection: close Nov 01 18:55:52.510711 n-d-863052-2 devstack@n-api.service[121403]: Content-Length: 25 Nov 01 18:55:52.510711 n-d-863052-2 devstack@n-api.service[121403]: Content-Type: application/json Nov 01 18:55:52.510711 n-d-863052-2 devstack@n-api.service[121403]: Host: 10.222.0.13 Nov 01 18:55:52.510711 n-d-863052-2 devstack@n-api.service[121403]: Openstack-System-Scope: None Nov 01 18:55:52.510711 n-d-863052-2 devstack@n-api.service[121403]: User-Agent: python-urllib3/1.26.12 Nov 01 18:55:52.510711 n-d-863052-2 devstack@n-api.service[121403]: X-Auth-Token: gAAAAABjYWupllb0-YmEC7tn-BvSZEkJE1EMvES1hWAnmFSJcqyHVC1KV6qoJuylLGMGBqTm4LnJ2nr6GVdBCD5P3jYu15-lHKKkpkFyHwpioFbb-X7kgYX1YtTaJGBY3mZKTTU-KIgchU2r2xr4yqWXnVWn5Y3KxKPnA6THzuoKvFMd6cf8FMo Nov 01 18:55:52.510711 n-d-863052-2 devstack@n-api.service[121403]: X-Domain-Id: None Nov 01 18:55:52.510711 n-d-863052-2 devstack@n-api.service[121403]: X-Domain-Name: None Nov 01 18:55:52.510711 n-d-863052-2 devstack@n-api.service[121403]: X-Identity-Status: Confirmed Nov 01 18:55:52.510711 n-d-863052-2 devstack@n-api.service[121403]: X-Is-Admin-Project: True Nov 01 18:55:52.510711 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Domain-Id: default Nov 01 18:55:52.510711 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Domain-Name: Default Nov 01 18:55:52.510711 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Id: bc1278822def4e9980c698a5d21092af Nov 01 18:55:52.510711 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Name: tempest-QuotasAdminNegativeTest-1518083747 Nov 01 18:55:52.510711 n-d-863052-2 devstack@n-api.service[121403]: X-Role: member,reader Nov 01 18:55:52.510711 n-d-863052-2 devstack@n-api.service[121403]: X-Roles: member,reader Nov 01 18:55:52.512136 n-d-863052-2 devstack@n-api.service[121403]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/bc1278822def4e9980c698a5d21092af"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/bc1278822def4e9980c698a5d21092af"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_bc1278822def4e9980c698a5d21092af", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/bc1278822def4e9980c698a5d21092af"}]}] Nov 01 18:55:52.512136 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant: tempest-QuotasAdminNegativeTest-1518083747 Nov 01 18:55:52.512136 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant-Id: bc1278822def4e9980c698a5d21092af Nov 01 18:55:52.512136 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-1518083747 Nov 01 18:55:52.512136 n-d-863052-2 devstack@n-api.service[121403]: X-User: tempest-QuotasAdminNegativeTest-1518083747-project Nov 01 18:55:52.512136 n-d-863052-2 devstack@n-api.service[121403]: X-User-Domain-Id: default Nov 01 18:55:52.512136 n-d-863052-2 devstack@n-api.service[121403]: X-User-Domain-Name: Default Nov 01 18:55:52.512136 n-d-863052-2 devstack@n-api.service[121403]: X-User-Id: 01bcc4a301b948dab0e690707170fdb2 Nov 01 18:55:52.512136 n-d-863052-2 devstack@n-api.service[121403]: X-User-Name: tempest-QuotasAdminNegativeTest-1518083747-project Nov 01 18:55:52.512136 n-d-863052-2 devstack@n-api.service[121403]: Nov 01 18:55:52.512136 n-d-863052-2 devstack@n-api.service[121403]: {"quota_set": {"ram": 0}} Nov 01 18:55:52.512136 n-d-863052-2 devstack@n-api.service[121403]: method: Nov 01 18:55:52.512136 n-d-863052-2 devstack@n-api.service[121403]: exception: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Nov 01 18:55:52.512136 n-d-863052-2 devstack@n-api.service[121403]: action_args: {'id': 'bc1278822def4e9980c698a5d21092af', 'body': {'quota_set': {'ram': 0}}} Nov 01 18:55:52.513085 n-d-863052-2 devstack@n-api.service[121403]: {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 01 18:55:52.513085 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:55:52.513085 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 18:55:52.513085 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 18:55:52.513085 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 01 18:55:52.513085 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 01 18:55:52.513085 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 01 18:55:52.513085 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 01 18:55:52.513085 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 01 18:55:52.513085 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 01 18:55:52.513085 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 01 18:55:52.513085 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 01 18:55:52.513085 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/quota_sets.py", line 170, in update Nov 01 18:55:52.513085 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return self._update(req, id, body, []) Nov 01 18:55:52.513085 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Nov 01 18:55:52.513085 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 01 18:55:52.513085 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Nov 01 18:55:52.513085 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 01 18:55:52.513085 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/quota_sets.py", line 189, in _update Nov 01 18:55:52.514959 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi context.can(qs_policies.POLICY_ROOT % 'update', {'project_id': id}) Nov 01 18:55:52.514959 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Nov 01 18:55:52.514959 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Nov 01 18:55:52.514959 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Nov 01 18:55:52.514959 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Nov 01 18:55:52.514959 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 01 18:55:52.514959 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 01 18:55:52.514959 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 01 18:55:52.514959 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise self.value Nov 01 18:55:52.514959 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Nov 01 18:55:52.514959 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Nov 01 18:55:52.514959 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Nov 01 18:55:52.514959 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return self.enforce( Nov 01 18:55:52.514959 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Nov 01 18:55:52.514959 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Nov 01 18:55:52.514959 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Nov 01 18:55:52.514959 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 18:55:52.514959 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 18:55:52.514959 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 18:55:52.514959 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:55:52.516640 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 18:55:52.516640 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 18:55:52.516640 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Nov 01 18:55:52.516640 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Nov 01 18:55:52.516640 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Nov 01 18:55:52.516640 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 18:55:52.516640 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-1d1873f5-c03b-4909-9a88-ea8bec95f1bd tempest-QuotasAdminNegativeTest-1518083747 tempest-QuotasAdminNegativeTest-1518083747-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. {{(pid=121403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 01 18:55:52.516640 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-1d1873f5-c03b-4909-9a88-ea8bec95f1bd tempest-QuotasAdminNegativeTest-1518083747 tempest-QuotasAdminNegativeTest-1518083747-project] 10.222.0.13 "PUT /compute/v2.1/os-quota-sets/bc1278822def4e9980c698a5d21092af" status: 403 len: 116 microversion: 2.1 time: 0.032014 Nov 01 18:55:52.526542 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 218/455] 10.222.0.13 () {60 vars in 1262 bytes} [Tue Nov 1 18:55:52 2022] PUT /compute/v2.1/os-quota-sets/bc1278822def4e9980c698a5d21092af => generated 116 bytes in 36 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Nov 01 18:55:52.704746 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-2a0cc258-8e9c-49b2-93f8-bb7415821f51 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-779779543", "imageRef": "2d4a0047-1b9e-445f-8af8-1b5c9d93e881", "flavorRef": "452"}} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 18:55:52.795135 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.network.neutron [None req-2a0cc258-8e9c-49b2-93f8-bb7415821f51 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] validate_networks() for None {{(pid=121402) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 01 18:55:53.000740 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-cb92b059-42be-4384-aec2-a39699e36a78 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:55:53.001558 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-cb92b059-42be-4384-aec2-a39699e36a78 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] [instance: 2d3a927e-a478-40b1-8c92-80396c82f76c] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:55:53.017375 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-cb92b059-42be-4384-aec2-a39699e36a78 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:55:53.019343 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-cb92b059-42be-4384-aec2-a39699e36a78 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:55:53.020779 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-cb92b059-42be-4384-aec2-a39699e36a78 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:55:53.023197 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-cb92b059-42be-4384-aec2-a39699e36a78 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:55:53.023876 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-cb92b059-42be-4384-aec2-a39699e36a78 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:55:53.024466 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-cb92b059-42be-4384-aec2-a39699e36a78 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:55:53.268461 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.virt.hardware [None req-2a0cc258-8e9c-49b2-93f8-bb7415821f51 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Flavor limits 0:0:0 {{(pid=121402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 01 18:55:53.268993 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.virt.hardware [None req-2a0cc258-8e9c-49b2-93f8-bb7415821f51 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Image limits 0:0:0 {{(pid=121402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 01 18:55:53.269805 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.virt.hardware [None req-2a0cc258-8e9c-49b2-93f8-bb7415821f51 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Flavor pref 0:0:0 {{(pid=121402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 01 18:55:53.270361 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.virt.hardware [None req-2a0cc258-8e9c-49b2-93f8-bb7415821f51 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Image pref 0:0:0 {{(pid=121402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 01 18:55:53.271684 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.virt.hardware [None req-2a0cc258-8e9c-49b2-93f8-bb7415821f51 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 01 18:55:53.288059 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2a0cc258-8e9c-49b2-93f8-bb7415821f51 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:55:53.290874 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2a0cc258-8e9c-49b2-93f8-bb7415821f51 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:55:53.294459 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2a0cc258-8e9c-49b2-93f8-bb7415821f51 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:55:53.296749 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2a0cc258-8e9c-49b2-93f8-bb7415821f51 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:55:53.297244 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2a0cc258-8e9c-49b2-93f8-bb7415821f51 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:55:53.297682 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2a0cc258-8e9c-49b2-93f8-bb7415821f51 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:55:53.342769 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.quota [None req-2a0cc258-8e9c-49b2-93f8-bb7415821f51 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Getting quotas for project 45d4c047d3c44324a27a27831236ab0d. Resources: {'cores', 'ram', 'instances'} {{(pid=121402) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 01 18:55:53.354632 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.quota [None req-2a0cc258-8e9c-49b2-93f8-bb7415821f51 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Getting quotas for user 72117f17294649d6b8bc16c66c7efab2 and project 45d4c047d3c44324a27a27831236ab0d. Resources: {'cores', 'ram', 'instances'} {{(pid=121402) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 01 18:55:53.384892 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-2a0cc258-8e9c-49b2-93f8-bb7415821f51 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Going to run 1 instances... {{(pid=121402) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 01 18:55:53.387375 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-2a0cc258-8e9c-49b2-93f8-bb7415821f51 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] [instance: 614eb691-9a9a-4ca0-933d-686d80cc0ef1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2d4a0047-1b9e-445f-8af8-1b5c9d93e881',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121402) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 01 18:55:53.510656 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-2a0cc258-8e9c-49b2-93f8-bb7415821f51 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.160286 Nov 01 18:55:53.519847 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 238/456] 10.222.0.13 () {60 vars in 1147 bytes} [Tue Nov 1 18:55:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 1170 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 01 18:55:53.525318 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-cb92b059-42be-4384-aec2-a39699e36a78 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:55:53.533576 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-acda9d70-71c5-4f2b-9b8a-722f5d87b559 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:55:53.533974 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-cb92b059-42be-4384-aec2-a39699e36a78 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:55:53.535575 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-acda9d70-71c5-4f2b-9b8a-722f5d87b559 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] [instance: de2ff806-a2fa-4390-b4d5-11ff24dd27ca] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:55:53.544664 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-cb92b059-42be-4384-aec2-a39699e36a78 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:55:53.545842 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-cb92b059-42be-4384-aec2-a39699e36a78 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] 10.222.0.13 "GET /compute/v2.1/servers/2d3a927e-a478-40b1-8c92-80396c82f76c" status: 200 len: 1361 microversion: 2.25 time: 0.550049 Nov 01 18:55:53.549614 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 219/457] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 18:55:52 2022] GET /compute/v2.1/servers/2d3a927e-a478-40b1-8c92-80396c82f76c => generated 1361 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 01 18:55:53.560134 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-9be40a23-bb27-4ab5-ba36-e71b1b2a1f31 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:55:53.560783 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-9be40a23-bb27-4ab5-ba36-e71b1b2a1f31 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] [instance: 614eb691-9a9a-4ca0-933d-686d80cc0ef1] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:55:53.572364 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-acda9d70-71c5-4f2b-9b8a-722f5d87b559 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:55:53.572932 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-acda9d70-71c5-4f2b-9b8a-722f5d87b559 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:55:53.576454 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-acda9d70-71c5-4f2b-9b8a-722f5d87b559 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:55:53.577313 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-acda9d70-71c5-4f2b-9b8a-722f5d87b559 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:55:53.577847 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-acda9d70-71c5-4f2b-9b8a-722f5d87b559 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:55:53.578286 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-acda9d70-71c5-4f2b-9b8a-722f5d87b559 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:55:53.728955 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-9be40a23-bb27-4ab5-ba36-e71b1b2a1f31 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72117f17294649d6b8bc16c66c7efab2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45d4c047d3c44324a27a27831236ab0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:55:53.737902 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-9be40a23-bb27-4ab5-ba36-e71b1b2a1f31 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] 10.222.0.13 "GET /compute/v2.1/servers/614eb691-9a9a-4ca0-933d-686d80cc0ef1" status: 200 len: 1212 microversion: 2.1 time: 0.187257 Nov 01 18:55:53.739244 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 220/458] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:55:53 2022] GET /compute/v2.1/servers/614eb691-9a9a-4ca0-933d-686d80cc0ef1 => generated 1212 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:55:54.255984 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-acda9d70-71c5-4f2b-9b8a-722f5d87b559 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f32f5fba1976432d938e664c7714e52b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b9d4c236b944f9b2e8e502a50a8f8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:55:54.271325 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-acda9d70-71c5-4f2b-9b8a-722f5d87b559 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] 10.222.0.13 "GET /compute/v2.1/servers/de2ff806-a2fa-4390-b4d5-11ff24dd27ca" status: 200 len: 1502 microversion: 2.1 time: 0.741543 Nov 01 18:55:54.273065 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 239/459] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:55:53 2022] GET /compute/v2.1/servers/de2ff806-a2fa-4390-b4d5-11ff24dd27ca => generated 1502 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:55:54.578263 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-ef436239-8d0d-424a-a7e5-23769a360a7b tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:55:54.579037 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-ef436239-8d0d-424a-a7e5-23769a360a7b tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] [instance: 2d3a927e-a478-40b1-8c92-80396c82f76c] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:55:54.598231 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-ef436239-8d0d-424a-a7e5-23769a360a7b tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:55:54.599026 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-ef436239-8d0d-424a-a7e5-23769a360a7b tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:55:54.599649 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-ef436239-8d0d-424a-a7e5-23769a360a7b tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:55:54.602881 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-ef436239-8d0d-424a-a7e5-23769a360a7b tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:55:54.604303 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-ef436239-8d0d-424a-a7e5-23769a360a7b tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:55:54.606543 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-ef436239-8d0d-424a-a7e5-23769a360a7b tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:55:54.766464 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-57b17bf2-679b-4c29-b5fd-879a90bf9a53 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:55:54.768061 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-57b17bf2-679b-4c29-b5fd-879a90bf9a53 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] [instance: 614eb691-9a9a-4ca0-933d-686d80cc0ef1] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:55:54.788508 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-57b17bf2-679b-4c29-b5fd-879a90bf9a53 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:55:54.789838 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-57b17bf2-679b-4c29-b5fd-879a90bf9a53 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:55:54.790581 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-57b17bf2-679b-4c29-b5fd-879a90bf9a53 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:55:54.791644 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-57b17bf2-679b-4c29-b5fd-879a90bf9a53 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:55:54.793382 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-57b17bf2-679b-4c29-b5fd-879a90bf9a53 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:55:54.795000 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-57b17bf2-679b-4c29-b5fd-879a90bf9a53 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:55:55.027231 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-57b17bf2-679b-4c29-b5fd-879a90bf9a53 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72117f17294649d6b8bc16c66c7efab2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45d4c047d3c44324a27a27831236ab0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:55:55.042867 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-57b17bf2-679b-4c29-b5fd-879a90bf9a53 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] 10.222.0.13 "GET /compute/v2.1/servers/614eb691-9a9a-4ca0-933d-686d80cc0ef1" status: 200 len: 1264 microversion: 2.1 time: 0.284570 Nov 01 18:55:55.044509 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 240/460] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:55:54 2022] GET /compute/v2.1/servers/614eb691-9a9a-4ca0-933d-686d80cc0ef1 => generated 1264 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 18:55:55.120665 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [req-87d8ccc4-a08b-43bc-9e8e-5dbf1c74b1ca req-b699910b-38d8-4813-a44e-e2ff808777a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d3a927e-a478-40b1-8c92-80396c82f76c", "name": "network-vif-plugged", "status": "completed", "tag": "9765089c-d945-4fd6-a621-1f90f70e4416"}]} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 18:55:55.144636 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-87d8ccc4-a08b-43bc-9e8e-5dbf1c74b1ca req-b699910b-38d8-4813-a44e-e2ff808777a8 service nova] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:55:55.146522 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-87d8ccc4-a08b-43bc-9e8e-5dbf1c74b1ca req-b699910b-38d8-4813-a44e-e2ff808777a8 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:55:55.147877 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-87d8ccc4-a08b-43bc-9e8e-5dbf1c74b1ca req-b699910b-38d8-4813-a44e-e2ff808777a8 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:55:55.175729 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.compute.server_external_events [req-87d8ccc4-a08b-43bc-9e8e-5dbf1c74b1ca req-b699910b-38d8-4813-a44e-e2ff808777a8 service nova] Creating event network-vif-plugged:9765089c-d945-4fd6-a621-1f90f70e4416 for instance 2d3a927e-a478-40b1-8c92-80396c82f76c on n-h1-863052-2 Nov 01 18:55:55.189772 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [req-87d8ccc4-a08b-43bc-9e8e-5dbf1c74b1ca req-b699910b-38d8-4813-a44e-e2ff808777a8 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073328 Nov 01 18:55:55.195323 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 241/461] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Nov 1 18:55:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 01 18:55:55.225996 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-ef436239-8d0d-424a-a7e5-23769a360a7b tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:55:55.238891 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-ef436239-8d0d-424a-a7e5-23769a360a7b tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:55:55.246432 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-ef436239-8d0d-424a-a7e5-23769a360a7b tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:55:55.249780 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-ef436239-8d0d-424a-a7e5-23769a360a7b tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] 10.222.0.13 "GET /compute/v2.1/servers/2d3a927e-a478-40b1-8c92-80396c82f76c" status: 200 len: 1361 microversion: 2.25 time: 0.675622 Nov 01 18:55:55.268498 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 221/462] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 18:55:54 2022] GET /compute/v2.1/servers/2d3a927e-a478-40b1-8c92-80396c82f76c => generated 1361 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 18:55:55.302350 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-f7e2c2c0-487c-457f-bd5d-f85a505cc4fa tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:55:55.303273 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-f7e2c2c0-487c-457f-bd5d-f85a505cc4fa tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] [instance: de2ff806-a2fa-4390-b4d5-11ff24dd27ca] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:55:55.316528 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f7e2c2c0-487c-457f-bd5d-f85a505cc4fa tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:55:55.317203 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f7e2c2c0-487c-457f-bd5d-f85a505cc4fa tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:55:55.325742 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f7e2c2c0-487c-457f-bd5d-f85a505cc4fa tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:55:55.327014 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f7e2c2c0-487c-457f-bd5d-f85a505cc4fa tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:55:55.327721 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f7e2c2c0-487c-457f-bd5d-f85a505cc4fa tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:55:55.328370 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f7e2c2c0-487c-457f-bd5d-f85a505cc4fa tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:55:56.082526 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-655a7bcf-e9ba-4ff7-b921-3b48627fa254 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:55:56.084943 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-655a7bcf-e9ba-4ff7-b921-3b48627fa254 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] [instance: 614eb691-9a9a-4ca0-933d-686d80cc0ef1] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:55:56.102360 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-655a7bcf-e9ba-4ff7-b921-3b48627fa254 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:55:56.103719 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-655a7bcf-e9ba-4ff7-b921-3b48627fa254 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:55:56.109683 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-655a7bcf-e9ba-4ff7-b921-3b48627fa254 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:55:56.112612 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-655a7bcf-e9ba-4ff7-b921-3b48627fa254 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:55:56.114708 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-655a7bcf-e9ba-4ff7-b921-3b48627fa254 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:55:56.116575 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-655a7bcf-e9ba-4ff7-b921-3b48627fa254 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:55:56.125143 n-d-863052-2 devstack@n-api.service[121403]: DEBUG dbcounter [-] [121403] Writing DB stats nova_cell1:SELECT=100 {{(pid=121403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 18:55:56.199696 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-655a7bcf-e9ba-4ff7-b921-3b48627fa254 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72117f17294649d6b8bc16c66c7efab2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45d4c047d3c44324a27a27831236ab0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:55:56.209007 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-655a7bcf-e9ba-4ff7-b921-3b48627fa254 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] 10.222.0.13 "GET /compute/v2.1/servers/614eb691-9a9a-4ca0-933d-686d80cc0ef1" status: 200 len: 1270 microversion: 2.1 time: 0.140451 Nov 01 18:55:56.210080 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 222/463] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:55:56 2022] GET /compute/v2.1/servers/614eb691-9a9a-4ca0-933d-686d80cc0ef1 => generated 1270 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:55:56.263866 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-f7e2c2c0-487c-457f-bd5d-f85a505cc4fa tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f32f5fba1976432d938e664c7714e52b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b9d4c236b944f9b2e8e502a50a8f8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:55:56.278819 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-f7e2c2c0-487c-457f-bd5d-f85a505cc4fa tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] 10.222.0.13 "GET /compute/v2.1/servers/de2ff806-a2fa-4390-b4d5-11ff24dd27ca" status: 200 len: 1502 microversion: 2.1 time: 0.983545 Nov 01 18:55:56.279995 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 242/464] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:55:55 2022] GET /compute/v2.1/servers/de2ff806-a2fa-4390-b4d5-11ff24dd27ca => generated 1502 bytes in 986 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:55:56.287245 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-0762e2de-6c15-403a-8abf-e404fb465e94 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:55:56.288776 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-0762e2de-6c15-403a-8abf-e404fb465e94 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] [instance: 2d3a927e-a478-40b1-8c92-80396c82f76c] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:55:56.297613 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-0762e2de-6c15-403a-8abf-e404fb465e94 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:55:56.298676 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-0762e2de-6c15-403a-8abf-e404fb465e94 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:55:56.299686 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-0762e2de-6c15-403a-8abf-e404fb465e94 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:55:56.300943 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-0762e2de-6c15-403a-8abf-e404fb465e94 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:55:56.302069 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-0762e2de-6c15-403a-8abf-e404fb465e94 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:55:56.304084 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-0762e2de-6c15-403a-8abf-e404fb465e94 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:55:56.482788 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-65da27fa-3cd2-41aa-b210-608b740c9ce3 tempest-ServerDiagnosticsNegativeTest-50806246 tempest-ServerDiagnosticsNegativeTest-50806246-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiagnosticsNegativeTest-server-1271654746", "imageRef": "2d4a0047-1b9e-445f-8af8-1b5c9d93e881", "flavorRef": "452"}} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 18:55:56.574514 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.network.neutron [None req-65da27fa-3cd2-41aa-b210-608b740c9ce3 tempest-ServerDiagnosticsNegativeTest-50806246 tempest-ServerDiagnosticsNegativeTest-50806246-project] validate_networks() for None {{(pid=121403) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 01 18:55:56.795531 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-0762e2de-6c15-403a-8abf-e404fb465e94 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:55:56.815348 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-0762e2de-6c15-403a-8abf-e404fb465e94 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:55:56.821467 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-0762e2de-6c15-403a-8abf-e404fb465e94 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:55:56.826262 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-0762e2de-6c15-403a-8abf-e404fb465e94 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] 10.222.0.13 "GET /compute/v2.1/servers/2d3a927e-a478-40b1-8c92-80396c82f76c" status: 200 len: 1361 microversion: 2.25 time: 0.544812 Nov 01 18:55:56.836606 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 243/465] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 18:55:56 2022] GET /compute/v2.1/servers/2d3a927e-a478-40b1-8c92-80396c82f76c => generated 1361 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 18:55:56.836606 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-2c994037-d3ae-432c-9eca-76eb07b0dabe tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:55:56.836606 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-2c994037-d3ae-432c-9eca-76eb07b0dabe tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] [instance: 26132db2-1798-4ba6-88bb-aaf87f6848b3] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:55:56.842802 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2c994037-d3ae-432c-9eca-76eb07b0dabe tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:55:56.842802 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2c994037-d3ae-432c-9eca-76eb07b0dabe tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:55:56.842802 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2c994037-d3ae-432c-9eca-76eb07b0dabe tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:55:56.843683 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2c994037-d3ae-432c-9eca-76eb07b0dabe tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:55:56.844831 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2c994037-d3ae-432c-9eca-76eb07b0dabe tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:55:56.854955 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2c994037-d3ae-432c-9eca-76eb07b0dabe tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:55:56.892095 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.virt.hardware [None req-65da27fa-3cd2-41aa-b210-608b740c9ce3 tempest-ServerDiagnosticsNegativeTest-50806246 tempest-ServerDiagnosticsNegativeTest-50806246-project] Flavor limits 0:0:0 {{(pid=121403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 01 18:55:56.892521 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.virt.hardware [None req-65da27fa-3cd2-41aa-b210-608b740c9ce3 tempest-ServerDiagnosticsNegativeTest-50806246 tempest-ServerDiagnosticsNegativeTest-50806246-project] Image limits 0:0:0 {{(pid=121403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 01 18:55:56.893552 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.virt.hardware [None req-65da27fa-3cd2-41aa-b210-608b740c9ce3 tempest-ServerDiagnosticsNegativeTest-50806246 tempest-ServerDiagnosticsNegativeTest-50806246-project] Flavor pref 0:0:0 {{(pid=121403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 01 18:55:56.894294 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.virt.hardware [None req-65da27fa-3cd2-41aa-b210-608b740c9ce3 tempest-ServerDiagnosticsNegativeTest-50806246 tempest-ServerDiagnosticsNegativeTest-50806246-project] Image pref 0:0:0 {{(pid=121403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 01 18:55:56.894935 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.virt.hardware [None req-65da27fa-3cd2-41aa-b210-608b740c9ce3 tempest-ServerDiagnosticsNegativeTest-50806246 tempest-ServerDiagnosticsNegativeTest-50806246-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 01 18:55:56.927215 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-2c994037-d3ae-432c-9eca-76eb07b0dabe tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] [instance: 26132db2-1798-4ba6-88bb-aaf87f6848b3] Going to try to terminate instance {{(pid=121402) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 01 18:55:56.943357 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-65da27fa-3cd2-41aa-b210-608b740c9ce3 tempest-ServerDiagnosticsNegativeTest-50806246 tempest-ServerDiagnosticsNegativeTest-50806246-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:55:56.944299 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-65da27fa-3cd2-41aa-b210-608b740c9ce3 tempest-ServerDiagnosticsNegativeTest-50806246 tempest-ServerDiagnosticsNegativeTest-50806246-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:55:56.945110 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-65da27fa-3cd2-41aa-b210-608b740c9ce3 tempest-ServerDiagnosticsNegativeTest-50806246 tempest-ServerDiagnosticsNegativeTest-50806246-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:55:56.947407 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-65da27fa-3cd2-41aa-b210-608b740c9ce3 tempest-ServerDiagnosticsNegativeTest-50806246 tempest-ServerDiagnosticsNegativeTest-50806246-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:55:56.947964 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-65da27fa-3cd2-41aa-b210-608b740c9ce3 tempest-ServerDiagnosticsNegativeTest-50806246 tempest-ServerDiagnosticsNegativeTest-50806246-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:55:56.948472 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-65da27fa-3cd2-41aa-b210-608b740c9ce3 tempest-ServerDiagnosticsNegativeTest-50806246 tempest-ServerDiagnosticsNegativeTest-50806246-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:55:56.985599 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.quota [None req-65da27fa-3cd2-41aa-b210-608b740c9ce3 tempest-ServerDiagnosticsNegativeTest-50806246 tempest-ServerDiagnosticsNegativeTest-50806246-project] Getting quotas for project 741e5c81bd1d4383a5faff2e2a3dbbf0. Resources: {'cores', 'ram', 'instances'} {{(pid=121403) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 01 18:55:56.996021 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.quota [None req-65da27fa-3cd2-41aa-b210-608b740c9ce3 tempest-ServerDiagnosticsNegativeTest-50806246 tempest-ServerDiagnosticsNegativeTest-50806246-project] Getting quotas for user a8087408d8b947f8b603fdeaee878fee and project 741e5c81bd1d4383a5faff2e2a3dbbf0. Resources: {'cores', 'ram', 'instances'} {{(pid=121403) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 01 18:55:57.031178 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-65da27fa-3cd2-41aa-b210-608b740c9ce3 tempest-ServerDiagnosticsNegativeTest-50806246 tempest-ServerDiagnosticsNegativeTest-50806246-project] Going to run 1 instances... {{(pid=121403) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 01 18:55:57.033673 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-65da27fa-3cd2-41aa-b210-608b740c9ce3 tempest-ServerDiagnosticsNegativeTest-50806246 tempest-ServerDiagnosticsNegativeTest-50806246-project] [instance: 7fe37e78-fffe-4261-b0cd-be9037a208d5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2d4a0047-1b9e-445f-8af8-1b5c9d93e881',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121403) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 01 18:55:57.165352 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-65da27fa-3cd2-41aa-b210-608b740c9ce3 tempest-ServerDiagnosticsNegativeTest-50806246 tempest-ServerDiagnosticsNegativeTest-50806246-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.953455 Nov 01 18:55:57.170149 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-2c994037-d3ae-432c-9eca-76eb07b0dabe tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] 10.222.0.13 "DELETE /compute/v2.1/servers/26132db2-1798-4ba6-88bb-aaf87f6848b3" status: 204 len: 0 microversion: 2.1 time: 0.341636 Nov 01 18:55:57.172773 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 223/466] 10.222.0.13 () {60 vars in 1147 bytes} [Tue Nov 1 18:55:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 962 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 01 18:55:57.173874 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 244/467] 10.222.0.13 () {58 vars in 1239 bytes} [Tue Nov 1 18:55:56 2022] DELETE /compute/v2.1/servers/26132db2-1798-4ba6-88bb-aaf87f6848b3 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 01 18:55:57.193770 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-9b4ffa37-79c5-4e58-b375-be55f16daf2f tempest-ServerDiagnosticsNegativeTest-50806246 tempest-ServerDiagnosticsNegativeTest-50806246-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:55:57.195807 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-9b4ffa37-79c5-4e58-b375-be55f16daf2f tempest-ServerDiagnosticsNegativeTest-50806246 tempest-ServerDiagnosticsNegativeTest-50806246-project] [instance: 7fe37e78-fffe-4261-b0cd-be9037a208d5] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:55:57.237498 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-30dab39e-7045-42c6-8c15-fd4fad010851 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:55:57.238207 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-30dab39e-7045-42c6-8c15-fd4fad010851 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] [instance: 614eb691-9a9a-4ca0-933d-686d80cc0ef1] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:55:57.254413 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-30dab39e-7045-42c6-8c15-fd4fad010851 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:55:57.254947 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-30dab39e-7045-42c6-8c15-fd4fad010851 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:55:57.255391 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-30dab39e-7045-42c6-8c15-fd4fad010851 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:55:57.256114 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-30dab39e-7045-42c6-8c15-fd4fad010851 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:55:57.256644 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-30dab39e-7045-42c6-8c15-fd4fad010851 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:55:57.257071 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-30dab39e-7045-42c6-8c15-fd4fad010851 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:55:57.292244 n-d-863052-2 devstack@n-api.service[121402]: DEBUG dbcounter [-] [121402] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 18:55:57.427340 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-9b4ffa37-79c5-4e58-b375-be55f16daf2f tempest-ServerDiagnosticsNegativeTest-50806246 tempest-ServerDiagnosticsNegativeTest-50806246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8087408d8b947f8b603fdeaee878fee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '741e5c81bd1d4383a5faff2e2a3dbbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:55:57.435889 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-9b4ffa37-79c5-4e58-b375-be55f16daf2f tempest-ServerDiagnosticsNegativeTest-50806246 tempest-ServerDiagnosticsNegativeTest-50806246-project] 10.222.0.13 "GET /compute/v2.1/servers/7fe37e78-fffe-4261-b0cd-be9037a208d5" status: 200 len: 1223 microversion: 2.1 time: 0.247632 Nov 01 18:55:57.437809 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 224/468] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:55:57 2022] GET /compute/v2.1/servers/7fe37e78-fffe-4261-b0cd-be9037a208d5 => generated 1223 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:55:57.448124 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-bb8d0f53-80be-453d-a17c-6820ec852b87 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:55:57.449296 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-bb8d0f53-80be-453d-a17c-6820ec852b87 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] [instance: de2ff806-a2fa-4390-b4d5-11ff24dd27ca] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:55:57.463842 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-bb8d0f53-80be-453d-a17c-6820ec852b87 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:55:57.465722 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-bb8d0f53-80be-453d-a17c-6820ec852b87 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:55:57.467699 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-bb8d0f53-80be-453d-a17c-6820ec852b87 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:55:57.468896 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-bb8d0f53-80be-453d-a17c-6820ec852b87 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:55:57.471387 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-bb8d0f53-80be-453d-a17c-6820ec852b87 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:55:57.471877 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-bb8d0f53-80be-453d-a17c-6820ec852b87 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:55:57.519483 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-30dab39e-7045-42c6-8c15-fd4fad010851 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72117f17294649d6b8bc16c66c7efab2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45d4c047d3c44324a27a27831236ab0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:55:57.532087 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-30dab39e-7045-42c6-8c15-fd4fad010851 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] 10.222.0.13 "GET /compute/v2.1/servers/614eb691-9a9a-4ca0-933d-686d80cc0ef1" status: 200 len: 1270 microversion: 2.1 time: 0.298216 Nov 01 18:55:57.533427 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 245/469] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:55:57 2022] GET /compute/v2.1/servers/614eb691-9a9a-4ca0-933d-686d80cc0ef1 => generated 1270 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:55:57.550548 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-0605f1a2-e972-4206-9844-ec2a4736cc0c tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-1328098849", "imageRef": "2d4a0047-1b9e-445f-8af8-1b5c9d93e881", "flavorRef": "1548779625", "adminPass": "***", "networks": [{"uuid": "4e9ef1cb-dc90-4afe-8cc8-40e493fafdcb"}], "security_groups": [{"name": "tempest-securitygroup--570641705"}], "key_name": "tempest-keypair-630059540", "user_data": "}} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 18:55:57.798258 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-bb8d0f53-80be-453d-a17c-6820ec852b87 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f32f5fba1976432d938e664c7714e52b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b9d4c236b944f9b2e8e502a50a8f8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:55:57.811068 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-bb8d0f53-80be-453d-a17c-6820ec852b87 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] 10.222.0.13 "GET /compute/v2.1/servers/de2ff806-a2fa-4390-b4d5-11ff24dd27ca" status: 200 len: 1502 microversion: 2.1 time: 0.371991 Nov 01 18:55:57.811656 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 225/470] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:55:57 2022] GET /compute/v2.1/servers/de2ff806-a2fa-4390-b4d5-11ff24dd27ca => generated 1502 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:55:57.858024 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-2df8ec9f-43d1-43a6-8c11-a06aee637211 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:55:57.858993 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-2df8ec9f-43d1-43a6-8c11-a06aee637211 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] [instance: 2d3a927e-a478-40b1-8c92-80396c82f76c] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:55:57.868785 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-2df8ec9f-43d1-43a6-8c11-a06aee637211 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:55:57.871561 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-2df8ec9f-43d1-43a6-8c11-a06aee637211 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:55:57.872392 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-2df8ec9f-43d1-43a6-8c11-a06aee637211 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:55:57.875443 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-2df8ec9f-43d1-43a6-8c11-a06aee637211 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:55:57.876233 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-2df8ec9f-43d1-43a6-8c11-a06aee637211 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:55:57.876882 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-2df8ec9f-43d1-43a6-8c11-a06aee637211 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:55:57.920896 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.network.neutron [None req-0605f1a2-e972-4206-9844-ec2a4736cc0c tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] validate_networks() for [('4e9ef1cb-dc90-4afe-8cc8-40e493fafdcb', None, None, None, None, None)] {{(pid=121402) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 01 18:55:58.181375 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-2df8ec9f-43d1-43a6-8c11-a06aee637211 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:55:58.205845 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-2df8ec9f-43d1-43a6-8c11-a06aee637211 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:55:58.207671 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-2df8ec9f-43d1-43a6-8c11-a06aee637211 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:55:58.216165 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-2df8ec9f-43d1-43a6-8c11-a06aee637211 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] 10.222.0.13 "GET /compute/v2.1/servers/2d3a927e-a478-40b1-8c92-80396c82f76c" status: 200 len: 1557 microversion: 2.25 time: 0.355429 Nov 01 18:55:58.217291 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 226/471] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 18:55:57 2022] GET /compute/v2.1/servers/2d3a927e-a478-40b1-8c92-80396c82f76c => generated 1557 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 18:55:58.856134 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-e8b8448d-24ca-40a1-b92c-393c50b27b6a tempest-LiveAutoBlockMigrationV225Test-1358532044 tempest-LiveAutoBlockMigrationV225Test-1358532044-project-admin] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:55:58.857007 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-e8b8448d-24ca-40a1-b92c-393c50b27b6a tempest-LiveAutoBlockMigrationV225Test-1358532044 tempest-LiveAutoBlockMigrationV225Test-1358532044-project-admin] [instance: 2d3a927e-a478-40b1-8c92-80396c82f76c] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:55:58.868709 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-e8b8448d-24ca-40a1-b92c-393c50b27b6a tempest-LiveAutoBlockMigrationV225Test-1358532044 tempest-LiveAutoBlockMigrationV225Test-1358532044-project-admin] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:55:58.869141 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-e8b8448d-24ca-40a1-b92c-393c50b27b6a tempest-LiveAutoBlockMigrationV225Test-1358532044 tempest-LiveAutoBlockMigrationV225Test-1358532044-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:55:58.869574 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-e8b8448d-24ca-40a1-b92c-393c50b27b6a tempest-LiveAutoBlockMigrationV225Test-1358532044 tempest-LiveAutoBlockMigrationV225Test-1358532044-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:55:58.878859 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-e8b8448d-24ca-40a1-b92c-393c50b27b6a tempest-LiveAutoBlockMigrationV225Test-1358532044 tempest-LiveAutoBlockMigrationV225Test-1358532044-project-admin] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:55:58.879358 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-e8b8448d-24ca-40a1-b92c-393c50b27b6a tempest-LiveAutoBlockMigrationV225Test-1358532044 tempest-LiveAutoBlockMigrationV225Test-1358532044-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:55:58.879802 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-e8b8448d-24ca-40a1-b92c-393c50b27b6a tempest-LiveAutoBlockMigrationV225Test-1358532044 tempest-LiveAutoBlockMigrationV225Test-1358532044-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:55:59.552537 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.objects.instance [None req-e8b8448d-24ca-40a1-b92c-393c50b27b6a tempest-LiveAutoBlockMigrationV225Test-1358532044 tempest-LiveAutoBlockMigrationV225Test-1358532044-project-admin] Lazy-loading 'services' on Instance uuid 2d3a927e-a478-40b1-8c92-80396c82f76c {{(pid=121403) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 01 18:55:59.614417 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-e8b8448d-24ca-40a1-b92c-393c50b27b6a tempest-LiveAutoBlockMigrationV225Test-1358532044 tempest-LiveAutoBlockMigrationV225Test-1358532044-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/2d3a927e-a478-40b1-8c92-80396c82f76c" status: 200 len: 2049 microversion: 2.25 time: 1.370882 Nov 01 18:55:59.621560 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 227/472] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 18:55:58 2022] GET /compute/v2.1/servers/2d3a927e-a478-40b1-8c92-80396c82f76c => generated 2049 bytes in 1379 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 01 18:55:59.632679 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-7f56fa9d-82f1-407f-adcd-fc03fb83075c tempest-ServerDiagnosticsNegativeTest-50806246 tempest-ServerDiagnosticsNegativeTest-50806246-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:55:59.634196 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-7f56fa9d-82f1-407f-adcd-fc03fb83075c tempest-ServerDiagnosticsNegativeTest-50806246 tempest-ServerDiagnosticsNegativeTest-50806246-project] [instance: 7fe37e78-fffe-4261-b0cd-be9037a208d5] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:55:59.641218 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-7f56fa9d-82f1-407f-adcd-fc03fb83075c tempest-ServerDiagnosticsNegativeTest-50806246 tempest-ServerDiagnosticsNegativeTest-50806246-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:55:59.641909 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-7f56fa9d-82f1-407f-adcd-fc03fb83075c tempest-ServerDiagnosticsNegativeTest-50806246 tempest-ServerDiagnosticsNegativeTest-50806246-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:55:59.642345 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-7f56fa9d-82f1-407f-adcd-fc03fb83075c tempest-ServerDiagnosticsNegativeTest-50806246 tempest-ServerDiagnosticsNegativeTest-50806246-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:55:59.643043 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-7f56fa9d-82f1-407f-adcd-fc03fb83075c tempest-ServerDiagnosticsNegativeTest-50806246 tempest-ServerDiagnosticsNegativeTest-50806246-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:55:59.643496 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-7f56fa9d-82f1-407f-adcd-fc03fb83075c tempest-ServerDiagnosticsNegativeTest-50806246 tempest-ServerDiagnosticsNegativeTest-50806246-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:55:59.644077 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-7f56fa9d-82f1-407f-adcd-fc03fb83075c tempest-ServerDiagnosticsNegativeTest-50806246 tempest-ServerDiagnosticsNegativeTest-50806246-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:55:59.743772 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-7f56fa9d-82f1-407f-adcd-fc03fb83075c tempest-ServerDiagnosticsNegativeTest-50806246 tempest-ServerDiagnosticsNegativeTest-50806246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8087408d8b947f8b603fdeaee878fee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '741e5c81bd1d4383a5faff2e2a3dbbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:55:59.752424 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-7f56fa9d-82f1-407f-adcd-fc03fb83075c tempest-ServerDiagnosticsNegativeTest-50806246 tempest-ServerDiagnosticsNegativeTest-50806246-project] 10.222.0.13 "GET /compute/v2.1/servers/7fe37e78-fffe-4261-b0cd-be9037a208d5" status: 200 len: 1281 microversion: 2.1 time: 0.129902 Nov 01 18:55:59.760666 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 228/473] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:55:59 2022] GET /compute/v2.1/servers/7fe37e78-fffe-4261-b0cd-be9037a208d5 => generated 1281 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:55:59.769256 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-f0d295fa-e1fb-4322-a05f-1e7e69897a10 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:55:59.770975 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-f0d295fa-e1fb-4322-a05f-1e7e69897a10 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] [instance: 614eb691-9a9a-4ca0-933d-686d80cc0ef1] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:55:59.776609 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f0d295fa-e1fb-4322-a05f-1e7e69897a10 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:55:59.777750 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f0d295fa-e1fb-4322-a05f-1e7e69897a10 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:55:59.778196 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f0d295fa-e1fb-4322-a05f-1e7e69897a10 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:55:59.779002 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f0d295fa-e1fb-4322-a05f-1e7e69897a10 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:55:59.779452 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f0d295fa-e1fb-4322-a05f-1e7e69897a10 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:55:59.779873 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f0d295fa-e1fb-4322-a05f-1e7e69897a10 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:00.063213 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.virt.hardware [None req-0605f1a2-e972-4206-9844-ec2a4736cc0c tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Flavor limits 0:0:0 {{(pid=121402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 01 18:56:00.064172 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.virt.hardware [None req-0605f1a2-e972-4206-9844-ec2a4736cc0c tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Image limits 0:0:0 {{(pid=121402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 01 18:56:00.065054 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.virt.hardware [None req-0605f1a2-e972-4206-9844-ec2a4736cc0c tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Flavor pref 0:0:0 {{(pid=121402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 01 18:56:00.065942 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-f0d295fa-e1fb-4322-a05f-1e7e69897a10 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72117f17294649d6b8bc16c66c7efab2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45d4c047d3c44324a27a27831236ab0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:56:00.066424 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.virt.hardware [None req-0605f1a2-e972-4206-9844-ec2a4736cc0c tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Image pref 0:0:0 {{(pid=121402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 01 18:56:00.067032 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.virt.hardware [None req-0605f1a2-e972-4206-9844-ec2a4736cc0c tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 01 18:56:00.079601 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-0605f1a2-e972-4206-9844-ec2a4736cc0c tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:00.080224 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-0605f1a2-e972-4206-9844-ec2a4736cc0c tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:00.080951 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-0605f1a2-e972-4206-9844-ec2a4736cc0c tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:00.081163 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-f0d295fa-e1fb-4322-a05f-1e7e69897a10 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] 10.222.0.13 "GET /compute/v2.1/servers/614eb691-9a9a-4ca0-933d-686d80cc0ef1" status: 200 len: 1270 microversion: 2.1 time: 0.318291 Nov 01 18:56:00.081928 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 229/474] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:55:59 2022] GET /compute/v2.1/servers/614eb691-9a9a-4ca0-933d-686d80cc0ef1 => generated 1270 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:56:00.096261 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-0605f1a2-e972-4206-9844-ec2a4736cc0c tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:00.096261 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-0605f1a2-e972-4206-9844-ec2a4736cc0c tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:00.096261 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-0605f1a2-e972-4206-9844-ec2a4736cc0c tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:00.102125 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-58791e11-743c-43da-9fff-4bf2a7c4d9f5 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:56:00.102978 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-58791e11-743c-43da-9fff-4bf2a7c4d9f5 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] [instance: de2ff806-a2fa-4390-b4d5-11ff24dd27ca] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:56:00.109009 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.quota [None req-0605f1a2-e972-4206-9844-ec2a4736cc0c tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Getting quotas for project 9baf3860ba564f5c8dff93085b9aabe3. Resources: {'cores', 'ram', 'instances'} {{(pid=121402) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 01 18:56:00.109329 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-58791e11-743c-43da-9fff-4bf2a7c4d9f5 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:00.109964 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-58791e11-743c-43da-9fff-4bf2a7c4d9f5 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:00.110564 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-58791e11-743c-43da-9fff-4bf2a7c4d9f5 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:00.111472 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-58791e11-743c-43da-9fff-4bf2a7c4d9f5 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:00.112068 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-58791e11-743c-43da-9fff-4bf2a7c4d9f5 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:00.112683 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-58791e11-743c-43da-9fff-4bf2a7c4d9f5 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:00.114610 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.quota [None req-0605f1a2-e972-4206-9844-ec2a4736cc0c tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Getting quotas for user f07a2a96629f4baea6a3adfc4011ffe9 and project 9baf3860ba564f5c8dff93085b9aabe3. Resources: {'cores', 'ram', 'instances'} {{(pid=121402) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 01 18:56:00.131041 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-0605f1a2-e972-4206-9844-ec2a4736cc0c tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Going to run 1 instances... {{(pid=121402) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 01 18:56:00.134344 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-0605f1a2-e972-4206-9844-ec2a4736cc0c tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] [instance: ab3530ff-d70f-4c6c-abd0-3afa14fd9954] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2d4a0047-1b9e-445f-8af8-1b5c9d93e881',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=-1,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='blank',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=121402) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 01 18:56:00.200334 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-0605f1a2-e972-4206-9844-ec2a4736cc0c tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 2.664042 Nov 01 18:56:00.201773 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 246/475] 10.222.0.13 () {60 vars in 1147 bytes} [Tue Nov 1 18:55:57 2022] POST /compute/v2.1/servers => generated 401 bytes in 2666 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 01 18:56:00.443733 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-1fc83c4f-da6e-4b1f-aac7-c9dcd24e6263 tempest-ServicesAdminTestJSON-6943053 tempest-ServicesAdminTestJSON-6943053-project-admin] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:56:00.448567 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-1fc83c4f-da6e-4b1f-aac7-c9dcd24e6263 tempest-ServicesAdminTestJSON-6943053 tempest-ServicesAdminTestJSON-6943053-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:00.449091 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-1fc83c4f-da6e-4b1f-aac7-c9dcd24e6263 tempest-ServicesAdminTestJSON-6943053 tempest-ServicesAdminTestJSON-6943053-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:00.449614 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-1fc83c4f-da6e-4b1f-aac7-c9dcd24e6263 tempest-ServicesAdminTestJSON-6943053 tempest-ServicesAdminTestJSON-6943053-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:00.451802 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-1fc83c4f-da6e-4b1f-aac7-c9dcd24e6263 tempest-ServicesAdminTestJSON-6943053 tempest-ServicesAdminTestJSON-6943053-project-admin] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:00.452264 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-1fc83c4f-da6e-4b1f-aac7-c9dcd24e6263 tempest-ServicesAdminTestJSON-6943053 tempest-ServicesAdminTestJSON-6943053-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:00.452844 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-1fc83c4f-da6e-4b1f-aac7-c9dcd24e6263 tempest-ServicesAdminTestJSON-6943053 tempest-ServicesAdminTestJSON-6943053-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:00.490825 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-1fc83c4f-da6e-4b1f-aac7-c9dcd24e6263 tempest-ServicesAdminTestJSON-6943053 tempest-ServicesAdminTestJSON-6943053-project-admin] 10.222.0.13 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.287522 Nov 01 18:56:00.500003 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 247/476] 10.222.0.13 () {58 vars in 1137 bytes} [Tue Nov 1 18:56:00 2022] GET /compute/v2.1/os-services => generated 944 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 18:56:00.507781 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-883331ff-c92a-4a3d-ab74-508b702ac2c5 tempest-LiveAutoBlockMigrationV225Test-1358532044 tempest-LiveAutoBlockMigrationV225Test-1358532044-project-admin] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:56:00.508401 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-883331ff-c92a-4a3d-ab74-508b702ac2c5 tempest-LiveAutoBlockMigrationV225Test-1358532044 tempest-LiveAutoBlockMigrationV225Test-1358532044-project-admin] [instance: 2d3a927e-a478-40b1-8c92-80396c82f76c] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:56:00.517110 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-883331ff-c92a-4a3d-ab74-508b702ac2c5 tempest-LiveAutoBlockMigrationV225Test-1358532044 tempest-LiveAutoBlockMigrationV225Test-1358532044-project-admin] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:00.518569 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-883331ff-c92a-4a3d-ab74-508b702ac2c5 tempest-LiveAutoBlockMigrationV225Test-1358532044 tempest-LiveAutoBlockMigrationV225Test-1358532044-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:00.519230 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-883331ff-c92a-4a3d-ab74-508b702ac2c5 tempest-LiveAutoBlockMigrationV225Test-1358532044 tempest-LiveAutoBlockMigrationV225Test-1358532044-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:00.520541 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-883331ff-c92a-4a3d-ab74-508b702ac2c5 tempest-LiveAutoBlockMigrationV225Test-1358532044 tempest-LiveAutoBlockMigrationV225Test-1358532044-project-admin] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:00.521767 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-883331ff-c92a-4a3d-ab74-508b702ac2c5 tempest-LiveAutoBlockMigrationV225Test-1358532044 tempest-LiveAutoBlockMigrationV225Test-1358532044-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:00.523479 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-883331ff-c92a-4a3d-ab74-508b702ac2c5 tempest-LiveAutoBlockMigrationV225Test-1358532044 tempest-LiveAutoBlockMigrationV225Test-1358532044-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:00.953651 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-58791e11-743c-43da-9fff-4bf2a7c4d9f5 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f32f5fba1976432d938e664c7714e52b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b9d4c236b944f9b2e8e502a50a8f8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:56:00.965968 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-58791e11-743c-43da-9fff-4bf2a7c4d9f5 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] 10.222.0.13 "GET /compute/v2.1/servers/de2ff806-a2fa-4390-b4d5-11ff24dd27ca" status: 200 len: 1502 microversion: 2.1 time: 0.868037 Nov 01 18:56:00.966557 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 230/477] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:56:00 2022] GET /compute/v2.1/servers/de2ff806-a2fa-4390-b4d5-11ff24dd27ca => generated 1502 bytes in 869 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:56:00.971407 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-7133064f-61c8-4394-8b81-a2ddef7fb8b9 tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:56:00.972017 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-7133064f-61c8-4394-8b81-a2ddef7fb8b9 tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] [instance: ab3530ff-d70f-4c6c-abd0-3afa14fd9954] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:56:00.989912 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-7133064f-61c8-4394-8b81-a2ddef7fb8b9 tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:00.991251 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-7133064f-61c8-4394-8b81-a2ddef7fb8b9 tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:00.991916 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-7133064f-61c8-4394-8b81-a2ddef7fb8b9 tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:00.992834 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-7133064f-61c8-4394-8b81-a2ddef7fb8b9 tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:00.993472 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-7133064f-61c8-4394-8b81-a2ddef7fb8b9 tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:00.994077 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-7133064f-61c8-4394-8b81-a2ddef7fb8b9 tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:01.047626 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.objects.instance [None req-883331ff-c92a-4a3d-ab74-508b702ac2c5 tempest-LiveAutoBlockMigrationV225Test-1358532044 tempest-LiveAutoBlockMigrationV225Test-1358532044-project-admin] Lazy-loading 'services' on Instance uuid 2d3a927e-a478-40b1-8c92-80396c82f76c {{(pid=121402) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 01 18:56:01.085642 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-7133064f-61c8-4394-8b81-a2ddef7fb8b9 tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07a2a96629f4baea6a3adfc4011ffe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9baf3860ba564f5c8dff93085b9aabe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:56:01.101039 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-7133064f-61c8-4394-8b81-a2ddef7fb8b9 tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] 10.222.0.13 "GET /compute/v2.1/servers/ab3530ff-d70f-4c6c-abd0-3afa14fd9954" status: 200 len: 1268 microversion: 2.1 time: 0.133160 Nov 01 18:56:01.113141 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 231/478] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:56:00 2022] GET /compute/v2.1/servers/ab3530ff-d70f-4c6c-abd0-3afa14fd9954 => generated 1268 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:56:01.125064 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-5f77df56-82a4-4f76-b527-f81ab0c467be tempest-ServicesAdminTestJSON-6943053 tempest-ServicesAdminTestJSON-6943053-project-admin] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:56:01.129063 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-5f77df56-82a4-4f76-b527-f81ab0c467be tempest-ServicesAdminTestJSON-6943053 tempest-ServicesAdminTestJSON-6943053-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:01.129734 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-5f77df56-82a4-4f76-b527-f81ab0c467be tempest-ServicesAdminTestJSON-6943053 tempest-ServicesAdminTestJSON-6943053-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:01.130338 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-5f77df56-82a4-4f76-b527-f81ab0c467be tempest-ServicesAdminTestJSON-6943053 tempest-ServicesAdminTestJSON-6943053-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:01.131224 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-5f77df56-82a4-4f76-b527-f81ab0c467be tempest-ServicesAdminTestJSON-6943053 tempest-ServicesAdminTestJSON-6943053-project-admin] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:01.132476 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-5f77df56-82a4-4f76-b527-f81ab0c467be tempest-ServicesAdminTestJSON-6943053 tempest-ServicesAdminTestJSON-6943053-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:01.133079 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-5f77df56-82a4-4f76-b527-f81ab0c467be tempest-ServicesAdminTestJSON-6943053 tempest-ServicesAdminTestJSON-6943053-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:01.159195 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-5f77df56-82a4-4f76-b527-f81ab0c467be tempest-ServicesAdminTestJSON-6943053 tempest-ServicesAdminTestJSON-6943053-project-admin] 10.222.0.13 "GET /compute/v2.1/os-services?host=n-d-863052-2" status: 200 len: 578 microversion: 2.1 time: 0.044619 Nov 01 18:56:01.160482 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 232/479] 10.222.0.13 () {58 vars in 1172 bytes} [Tue Nov 1 18:56:01 2022] GET /compute/v2.1/os-services?host=n-d-863052-2 => generated 578 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 18:56:01.168392 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-883331ff-c92a-4a3d-ab74-508b702ac2c5 tempest-LiveAutoBlockMigrationV225Test-1358532044 tempest-LiveAutoBlockMigrationV225Test-1358532044-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/2d3a927e-a478-40b1-8c92-80396c82f76c" status: 200 len: 2049 microversion: 2.25 time: 0.665666 Nov 01 18:56:01.169415 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 248/480] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 18:56:00 2022] GET /compute/v2.1/servers/2d3a927e-a478-40b1-8c92-80396c82f76c => generated 2049 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 18:56:01.176412 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-63ca5c1d-1912-4bd9-9fd5-5d94de42cf43 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:56:01.177108 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-63ca5c1d-1912-4bd9-9fd5-5d94de42cf43 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] [instance: 614eb691-9a9a-4ca0-933d-686d80cc0ef1] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:56:01.187838 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-69339a3a-b434-4196-be1d-3020a1db68c1 tempest-ServerDiagnosticsNegativeTest-50806246 tempest-ServerDiagnosticsNegativeTest-50806246-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:56:01.189683 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-69339a3a-b434-4196-be1d-3020a1db68c1 tempest-ServerDiagnosticsNegativeTest-50806246 tempest-ServerDiagnosticsNegativeTest-50806246-project] [instance: 7fe37e78-fffe-4261-b0cd-be9037a208d5] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:56:01.196829 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-63ca5c1d-1912-4bd9-9fd5-5d94de42cf43 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:01.197332 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-63ca5c1d-1912-4bd9-9fd5-5d94de42cf43 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:01.197769 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-63ca5c1d-1912-4bd9-9fd5-5d94de42cf43 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:01.198531 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-63ca5c1d-1912-4bd9-9fd5-5d94de42cf43 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:01.201196 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-63ca5c1d-1912-4bd9-9fd5-5d94de42cf43 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:01.201796 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-63ca5c1d-1912-4bd9-9fd5-5d94de42cf43 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:01.202184 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-69339a3a-b434-4196-be1d-3020a1db68c1 tempest-ServerDiagnosticsNegativeTest-50806246 tempest-ServerDiagnosticsNegativeTest-50806246-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:01.202867 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-69339a3a-b434-4196-be1d-3020a1db68c1 tempest-ServerDiagnosticsNegativeTest-50806246 tempest-ServerDiagnosticsNegativeTest-50806246-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:01.203893 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-69339a3a-b434-4196-be1d-3020a1db68c1 tempest-ServerDiagnosticsNegativeTest-50806246 tempest-ServerDiagnosticsNegativeTest-50806246-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:01.204815 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-69339a3a-b434-4196-be1d-3020a1db68c1 tempest-ServerDiagnosticsNegativeTest-50806246 tempest-ServerDiagnosticsNegativeTest-50806246-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:01.205500 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-69339a3a-b434-4196-be1d-3020a1db68c1 tempest-ServerDiagnosticsNegativeTest-50806246 tempest-ServerDiagnosticsNegativeTest-50806246-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:01.206108 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-69339a3a-b434-4196-be1d-3020a1db68c1 tempest-ServerDiagnosticsNegativeTest-50806246 tempest-ServerDiagnosticsNegativeTest-50806246-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:01.482791 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-69339a3a-b434-4196-be1d-3020a1db68c1 tempest-ServerDiagnosticsNegativeTest-50806246 tempest-ServerDiagnosticsNegativeTest-50806246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8087408d8b947f8b603fdeaee878fee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '741e5c81bd1d4383a5faff2e2a3dbbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:56:01.496776 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-69339a3a-b434-4196-be1d-3020a1db68c1 tempest-ServerDiagnosticsNegativeTest-50806246 tempest-ServerDiagnosticsNegativeTest-50806246-project] 10.222.0.13 "GET /compute/v2.1/servers/7fe37e78-fffe-4261-b0cd-be9037a208d5" status: 200 len: 1281 microversion: 2.1 time: 0.321556 Nov 01 18:56:01.504200 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 233/481] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:56:01 2022] GET /compute/v2.1/servers/7fe37e78-fffe-4261-b0cd-be9037a208d5 => generated 1281 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:56:01.540230 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-8d098362-f4c9-4a86-8302-4da6ed66a000 tempest-ServicesAdminTestJSON-6943053 tempest-ServicesAdminTestJSON-6943053-project-admin] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:56:01.548112 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-8d098362-f4c9-4a86-8302-4da6ed66a000 tempest-ServicesAdminTestJSON-6943053 tempest-ServicesAdminTestJSON-6943053-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:01.553866 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-8d098362-f4c9-4a86-8302-4da6ed66a000 tempest-ServicesAdminTestJSON-6943053 tempest-ServicesAdminTestJSON-6943053-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:01.557173 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-8d098362-f4c9-4a86-8302-4da6ed66a000 tempest-ServicesAdminTestJSON-6943053 tempest-ServicesAdminTestJSON-6943053-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:01.558193 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-8d098362-f4c9-4a86-8302-4da6ed66a000 tempest-ServicesAdminTestJSON-6943053 tempest-ServicesAdminTestJSON-6943053-project-admin] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:01.572968 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-8d098362-f4c9-4a86-8302-4da6ed66a000 tempest-ServicesAdminTestJSON-6943053 tempest-ServicesAdminTestJSON-6943053-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:01.575476 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-8d098362-f4c9-4a86-8302-4da6ed66a000 tempest-ServicesAdminTestJSON-6943053 tempest-ServicesAdminTestJSON-6943053-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:01.652669 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-8d098362-f4c9-4a86-8302-4da6ed66a000 tempest-ServicesAdminTestJSON-6943053 tempest-ServicesAdminTestJSON-6943053-project-admin] 10.222.0.13 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.125409 Nov 01 18:56:01.653280 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 234/482] 10.222.0.13 () {58 vars in 1176 bytes} [Tue Nov 1 18:56:01 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 18:56:01.661003 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-d588bdb0-fdd9-4558-b79c-ae0bfc207afe tempest-LiveAutoBlockMigrationV225Test-1358532044 tempest-LiveAutoBlockMigrationV225Test-1358532044-project-admin] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:56:01.672729 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d588bdb0-fdd9-4558-b79c-ae0bfc207afe tempest-LiveAutoBlockMigrationV225Test-1358532044 tempest-LiveAutoBlockMigrationV225Test-1358532044-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:01.677189 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d588bdb0-fdd9-4558-b79c-ae0bfc207afe tempest-LiveAutoBlockMigrationV225Test-1358532044 tempest-LiveAutoBlockMigrationV225Test-1358532044-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:01.677952 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d588bdb0-fdd9-4558-b79c-ae0bfc207afe tempest-LiveAutoBlockMigrationV225Test-1358532044 tempest-LiveAutoBlockMigrationV225Test-1358532044-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:01.679420 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d588bdb0-fdd9-4558-b79c-ae0bfc207afe tempest-LiveAutoBlockMigrationV225Test-1358532044 tempest-LiveAutoBlockMigrationV225Test-1358532044-project-admin] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:01.681717 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d588bdb0-fdd9-4558-b79c-ae0bfc207afe tempest-LiveAutoBlockMigrationV225Test-1358532044 tempest-LiveAutoBlockMigrationV225Test-1358532044-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:01.685194 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d588bdb0-fdd9-4558-b79c-ae0bfc207afe tempest-LiveAutoBlockMigrationV225Test-1358532044 tempest-LiveAutoBlockMigrationV225Test-1358532044-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:01.742258 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-d588bdb0-fdd9-4558-b79c-ae0bfc207afe tempest-LiveAutoBlockMigrationV225Test-1358532044 tempest-LiveAutoBlockMigrationV225Test-1358532044-project-admin] 10.222.0.13 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.084991 Nov 01 18:56:01.744649 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 235/483] 10.222.0.13 () {60 vars in 1217 bytes} [Tue Nov 1 18:56:01 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 01 18:56:01.750378 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [req-72483d07-f629-4677-81f7-9943babcad2a req-34de6f77-afa1-4490-95b7-bab897f930e0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "26132db2-1798-4ba6-88bb-aaf87f6848b3", "name": "network-vif-deleted", "tag": "9bb445f8-37ab-49c7-9c66-0066ff9683cc"}]} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 18:56:01.773505 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-72483d07-f629-4677-81f7-9943babcad2a req-34de6f77-afa1-4490-95b7-bab897f930e0 service nova] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:01.774245 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-72483d07-f629-4677-81f7-9943babcad2a req-34de6f77-afa1-4490-95b7-bab897f930e0 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:01.774831 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-72483d07-f629-4677-81f7-9943babcad2a req-34de6f77-afa1-4490-95b7-bab897f930e0 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:01.800658 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.compute.server_external_events [req-72483d07-f629-4677-81f7-9943babcad2a req-34de6f77-afa1-4490-95b7-bab897f930e0 service nova] Creating event network-vif-deleted:9bb445f8-37ab-49c7-9c66-0066ff9683cc for instance 26132db2-1798-4ba6-88bb-aaf87f6848b3 on n-h2-863052-2 Nov 01 18:56:01.818390 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [req-72483d07-f629-4677-81f7-9943babcad2a req-34de6f77-afa1-4490-95b7-bab897f930e0 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071711 Nov 01 18:56:01.819040 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 236/484] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Nov 1 18:56:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 18:56:01.830224 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-669cec7e-2066-4cef-8996-24872ddcb397 tempest-ServicesAdminTestJSON-6943053 tempest-ServicesAdminTestJSON-6943053-project-admin] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:56:01.834075 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-669cec7e-2066-4cef-8996-24872ddcb397 tempest-ServicesAdminTestJSON-6943053 tempest-ServicesAdminTestJSON-6943053-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:01.842239 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-669cec7e-2066-4cef-8996-24872ddcb397 tempest-ServicesAdminTestJSON-6943053 tempest-ServicesAdminTestJSON-6943053-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:01.843081 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-669cec7e-2066-4cef-8996-24872ddcb397 tempest-ServicesAdminTestJSON-6943053 tempest-ServicesAdminTestJSON-6943053-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:01.844152 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-669cec7e-2066-4cef-8996-24872ddcb397 tempest-ServicesAdminTestJSON-6943053 tempest-ServicesAdminTestJSON-6943053-project-admin] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:01.844812 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-669cec7e-2066-4cef-8996-24872ddcb397 tempest-ServicesAdminTestJSON-6943053 tempest-ServicesAdminTestJSON-6943053-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:01.845414 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-669cec7e-2066-4cef-8996-24872ddcb397 tempest-ServicesAdminTestJSON-6943053 tempest-ServicesAdminTestJSON-6943053-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:01.874506 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-669cec7e-2066-4cef-8996-24872ddcb397 tempest-ServicesAdminTestJSON-6943053 tempest-ServicesAdminTestJSON-6943053-project-admin] 10.222.0.13 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.049592 Nov 01 18:56:01.875384 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 237/485] 10.222.0.13 () {58 vars in 1137 bytes} [Tue Nov 1 18:56:01 2022] GET /compute/v2.1/os-services => generated 944 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 18:56:01.888349 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-c42a4a2a-04ae-40ea-993e-096bef6d9be4 tempest-LiveAutoBlockMigrationV225Test-1358532044 tempest-LiveAutoBlockMigrationV225Test-1358532044-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-863052-2", "block_migration": "auto"}} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 18:56:01.891365 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-c42a4a2a-04ae-40ea-993e-096bef6d9be4 tempest-LiveAutoBlockMigrationV225Test-1358532044 tempest-LiveAutoBlockMigrationV225Test-1358532044-project-admin] [instance: 2d3a927e-a478-40b1-8c92-80396c82f76c] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:56:01.909584 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-c42a4a2a-04ae-40ea-993e-096bef6d9be4 tempest-LiveAutoBlockMigrationV225Test-1358532044 tempest-LiveAutoBlockMigrationV225Test-1358532044-project-admin] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:01.913602 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-c42a4a2a-04ae-40ea-993e-096bef6d9be4 tempest-LiveAutoBlockMigrationV225Test-1358532044 tempest-LiveAutoBlockMigrationV225Test-1358532044-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:01.914293 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-c42a4a2a-04ae-40ea-993e-096bef6d9be4 tempest-LiveAutoBlockMigrationV225Test-1358532044 tempest-LiveAutoBlockMigrationV225Test-1358532044-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:01.916883 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-c42a4a2a-04ae-40ea-993e-096bef6d9be4 tempest-LiveAutoBlockMigrationV225Test-1358532044 tempest-LiveAutoBlockMigrationV225Test-1358532044-project-admin] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:01.917519 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-c42a4a2a-04ae-40ea-993e-096bef6d9be4 tempest-LiveAutoBlockMigrationV225Test-1358532044 tempest-LiveAutoBlockMigrationV225Test-1358532044-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:01.919891 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-c42a4a2a-04ae-40ea-993e-096bef6d9be4 tempest-LiveAutoBlockMigrationV225Test-1358532044 tempest-LiveAutoBlockMigrationV225Test-1358532044-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:02.138542 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.objects.instance [None req-c42a4a2a-04ae-40ea-993e-096bef6d9be4 tempest-LiveAutoBlockMigrationV225Test-1358532044 tempest-LiveAutoBlockMigrationV225Test-1358532044-project-admin] Lazy-loading 'flavor' on Instance uuid 2d3a927e-a478-40b1-8c92-80396c82f76c {{(pid=121403) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 01 18:56:02.271497 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-c42a4a2a-04ae-40ea-993e-096bef6d9be4 tempest-LiveAutoBlockMigrationV225Test-1358532044 tempest-LiveAutoBlockMigrationV225Test-1358532044-project-admin] [instance: 2d3a927e-a478-40b1-8c92-80396c82f76c] Going to try to live migrate instance to n-h2-863052-2 {{(pid=121403) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Nov 01 18:56:02.315012 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-63ca5c1d-1912-4bd9-9fd5-5d94de42cf43 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72117f17294649d6b8bc16c66c7efab2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45d4c047d3c44324a27a27831236ab0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:56:02.330854 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-63ca5c1d-1912-4bd9-9fd5-5d94de42cf43 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] 10.222.0.13 "GET /compute/v2.1/servers/614eb691-9a9a-4ca0-933d-686d80cc0ef1" status: 200 len: 1312 microversion: 2.1 time: 1.153809 Nov 01 18:56:02.349678 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 249/486] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:56:01 2022] GET /compute/v2.1/servers/614eb691-9a9a-4ca0-933d-686d80cc0ef1 => generated 1312 bytes in 1165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:56:02.361624 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-89ce8f6e-a3bc-42b6-b001-cd3067df55fe tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:56:02.368234 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-89ce8f6e-a3bc-42b6-b001-cd3067df55fe tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] [instance: de2ff806-a2fa-4390-b4d5-11ff24dd27ca] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:56:02.386804 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-89ce8f6e-a3bc-42b6-b001-cd3067df55fe tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:02.387537 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-89ce8f6e-a3bc-42b6-b001-cd3067df55fe tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:02.389565 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-89ce8f6e-a3bc-42b6-b001-cd3067df55fe tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:02.392667 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-89ce8f6e-a3bc-42b6-b001-cd3067df55fe tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:02.393433 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-89ce8f6e-a3bc-42b6-b001-cd3067df55fe tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:02.394112 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-89ce8f6e-a3bc-42b6-b001-cd3067df55fe tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:03.649164 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-89ce8f6e-a3bc-42b6-b001-cd3067df55fe tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f32f5fba1976432d938e664c7714e52b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b9d4c236b944f9b2e8e502a50a8f8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:56:03.665886 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-89ce8f6e-a3bc-42b6-b001-cd3067df55fe tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] 10.222.0.13 "GET /compute/v2.1/servers/de2ff806-a2fa-4390-b4d5-11ff24dd27ca" status: 200 len: 1492 microversion: 2.1 time: 1.309072 Nov 01 18:56:03.666994 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 250/487] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:56:02 2022] GET /compute/v2.1/servers/de2ff806-a2fa-4390-b4d5-11ff24dd27ca => generated 1492 bytes in 1316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:56:03.681091 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-ea07b15a-f730-4823-bf34-8c58e81b8537 tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:56:03.682044 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-ea07b15a-f730-4823-bf34-8c58e81b8537 tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] [instance: ab3530ff-d70f-4c6c-abd0-3afa14fd9954] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:56:03.691248 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-ea07b15a-f730-4823-bf34-8c58e81b8537 tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:03.693047 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-ea07b15a-f730-4823-bf34-8c58e81b8537 tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:03.698886 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-ea07b15a-f730-4823-bf34-8c58e81b8537 tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:03.700069 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-ea07b15a-f730-4823-bf34-8c58e81b8537 tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:03.700808 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-ea07b15a-f730-4823-bf34-8c58e81b8537 tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:03.701394 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-ea07b15a-f730-4823-bf34-8c58e81b8537 tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:04.135186 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-ea07b15a-f730-4823-bf34-8c58e81b8537 tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07a2a96629f4baea6a3adfc4011ffe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9baf3860ba564f5c8dff93085b9aabe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:56:04.143494 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-ea07b15a-f730-4823-bf34-8c58e81b8537 tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] 10.222.0.13 "GET /compute/v2.1/servers/ab3530ff-d70f-4c6c-abd0-3afa14fd9954" status: 200 len: 1322 microversion: 2.1 time: 0.475019 Nov 01 18:56:04.159606 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 251/488] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:56:03 2022] GET /compute/v2.1/servers/ab3530ff-d70f-4c6c-abd0-3afa14fd9954 => generated 1322 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:56:04.169905 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-34590739-dd80-4d98-8c87-98045acec570 tempest-ServerDiagnosticsNegativeTest-50806246 tempest-ServerDiagnosticsNegativeTest-50806246-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:56:04.170549 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-34590739-dd80-4d98-8c87-98045acec570 tempest-ServerDiagnosticsNegativeTest-50806246 tempest-ServerDiagnosticsNegativeTest-50806246-project] [instance: 7fe37e78-fffe-4261-b0cd-be9037a208d5] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:56:04.183080 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-34590739-dd80-4d98-8c87-98045acec570 tempest-ServerDiagnosticsNegativeTest-50806246 tempest-ServerDiagnosticsNegativeTest-50806246-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:04.185355 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-34590739-dd80-4d98-8c87-98045acec570 tempest-ServerDiagnosticsNegativeTest-50806246 tempest-ServerDiagnosticsNegativeTest-50806246-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:04.185976 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-34590739-dd80-4d98-8c87-98045acec570 tempest-ServerDiagnosticsNegativeTest-50806246 tempest-ServerDiagnosticsNegativeTest-50806246-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:04.187980 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-34590739-dd80-4d98-8c87-98045acec570 tempest-ServerDiagnosticsNegativeTest-50806246 tempest-ServerDiagnosticsNegativeTest-50806246-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:04.188625 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-34590739-dd80-4d98-8c87-98045acec570 tempest-ServerDiagnosticsNegativeTest-50806246 tempest-ServerDiagnosticsNegativeTest-50806246-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:04.189213 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-34590739-dd80-4d98-8c87-98045acec570 tempest-ServerDiagnosticsNegativeTest-50806246 tempest-ServerDiagnosticsNegativeTest-50806246-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:04.435124 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-34590739-dd80-4d98-8c87-98045acec570 tempest-ServerDiagnosticsNegativeTest-50806246 tempest-ServerDiagnosticsNegativeTest-50806246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8087408d8b947f8b603fdeaee878fee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '741e5c81bd1d4383a5faff2e2a3dbbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:56:04.450412 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-34590739-dd80-4d98-8c87-98045acec570 tempest-ServerDiagnosticsNegativeTest-50806246 tempest-ServerDiagnosticsNegativeTest-50806246-project] 10.222.0.13 "GET /compute/v2.1/servers/7fe37e78-fffe-4261-b0cd-be9037a208d5" status: 200 len: 1281 microversion: 2.1 time: 0.289620 Nov 01 18:56:04.460615 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 252/489] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:56:04 2022] GET /compute/v2.1/servers/7fe37e78-fffe-4261-b0cd-be9037a208d5 => generated 1281 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:56:04.463727 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-1a954647-0b1d-45b8-b7ef-ac17aa7d4851 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:56:04.464337 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-1a954647-0b1d-45b8-b7ef-ac17aa7d4851 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] [instance: 614eb691-9a9a-4ca0-933d-686d80cc0ef1] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:56:04.479693 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-1a954647-0b1d-45b8-b7ef-ac17aa7d4851 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:04.480189 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-1a954647-0b1d-45b8-b7ef-ac17aa7d4851 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:04.480642 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-1a954647-0b1d-45b8-b7ef-ac17aa7d4851 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:04.481343 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-1a954647-0b1d-45b8-b7ef-ac17aa7d4851 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:04.481797 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-1a954647-0b1d-45b8-b7ef-ac17aa7d4851 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:04.482215 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-1a954647-0b1d-45b8-b7ef-ac17aa7d4851 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:05.077054 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-1a954647-0b1d-45b8-b7ef-ac17aa7d4851 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72117f17294649d6b8bc16c66c7efab2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45d4c047d3c44324a27a27831236ab0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:56:05.089700 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-1a954647-0b1d-45b8-b7ef-ac17aa7d4851 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] 10.222.0.13 "GET /compute/v2.1/servers/614eb691-9a9a-4ca0-933d-686d80cc0ef1" status: 200 len: 1312 microversion: 2.1 time: 0.637519 Nov 01 18:56:05.090853 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 253/490] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:56:04 2022] GET /compute/v2.1/servers/614eb691-9a9a-4ca0-933d-686d80cc0ef1 => generated 1312 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:56:05.104555 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-74a195d8-da5f-477a-91c3-956cfd337f3d tempest-LiveMigrationTest-1695240876 tempest-LiveMigrationTest-1695240876-project-admin] Calling method '.version_select at 0x7f0ae29d8550>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:56:05.109116 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-74a195d8-da5f-477a-91c3-956cfd337f3d tempest-LiveMigrationTest-1695240876 tempest-LiveMigrationTest-1695240876-project-admin] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:05.110106 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-74a195d8-da5f-477a-91c3-956cfd337f3d tempest-LiveMigrationTest-1695240876 tempest-LiveMigrationTest-1695240876-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:05.110906 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-74a195d8-da5f-477a-91c3-956cfd337f3d tempest-LiveMigrationTest-1695240876 tempest-LiveMigrationTest-1695240876-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:05.130836 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-74a195d8-da5f-477a-91c3-956cfd337f3d tempest-LiveMigrationTest-1695240876 tempest-LiveMigrationTest-1695240876-project-admin] 10.222.0.13 "GET /compute/v2.1/os-migrations" status: 200 len: 737 microversion: 2.1 time: 0.038883 Nov 01 18:56:05.132121 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 254/491] 10.222.0.13 () {58 vars in 1143 bytes} [Tue Nov 1 18:56:05 2022] GET /compute/v2.1/os-migrations => generated 737 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 18:56:05.145562 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-da69a96c-449f-4163-bdb1-3cfcd803ab8c tempest-LiveMigrationTest-1695240876 tempest-LiveMigrationTest-1695240876-project-admin] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:56:05.147082 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-da69a96c-449f-4163-bdb1-3cfcd803ab8c tempest-LiveMigrationTest-1695240876 tempest-LiveMigrationTest-1695240876-project-admin] [instance: de2ff806-a2fa-4390-b4d5-11ff24dd27ca] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:56:05.154889 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-da69a96c-449f-4163-bdb1-3cfcd803ab8c tempest-LiveMigrationTest-1695240876 tempest-LiveMigrationTest-1695240876-project-admin] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:05.157321 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-da69a96c-449f-4163-bdb1-3cfcd803ab8c tempest-LiveMigrationTest-1695240876 tempest-LiveMigrationTest-1695240876-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:05.158123 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-da69a96c-449f-4163-bdb1-3cfcd803ab8c tempest-LiveMigrationTest-1695240876 tempest-LiveMigrationTest-1695240876-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:05.159091 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-da69a96c-449f-4163-bdb1-3cfcd803ab8c tempest-LiveMigrationTest-1695240876 tempest-LiveMigrationTest-1695240876-project-admin] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:05.159800 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-da69a96c-449f-4163-bdb1-3cfcd803ab8c tempest-LiveMigrationTest-1695240876 tempest-LiveMigrationTest-1695240876-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:05.160385 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-da69a96c-449f-4163-bdb1-3cfcd803ab8c tempest-LiveMigrationTest-1695240876 tempest-LiveMigrationTest-1695240876-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:06.281165 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-da69a96c-449f-4163-bdb1-3cfcd803ab8c tempest-LiveMigrationTest-1695240876 tempest-LiveMigrationTest-1695240876-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/de2ff806-a2fa-4390-b4d5-11ff24dd27ca" status: 200 len: 1643 microversion: 2.1 time: 1.139611 Nov 01 18:56:06.297046 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 255/492] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:56:05 2022] GET /compute/v2.1/servers/de2ff806-a2fa-4390-b4d5-11ff24dd27ca => generated 1643 bytes in 1156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 18:56:06.313657 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-a72c1085-5fcd-487f-823b-613ef3235582 tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:56:06.314829 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-a72c1085-5fcd-487f-823b-613ef3235582 tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] [instance: ab3530ff-d70f-4c6c-abd0-3afa14fd9954] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:56:06.322894 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-a72c1085-5fcd-487f-823b-613ef3235582 tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:06.323764 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-a72c1085-5fcd-487f-823b-613ef3235582 tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:06.324394 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-a72c1085-5fcd-487f-823b-613ef3235582 tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:06.325451 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-a72c1085-5fcd-487f-823b-613ef3235582 tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:06.326287 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-a72c1085-5fcd-487f-823b-613ef3235582 tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:06.326769 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-a72c1085-5fcd-487f-823b-613ef3235582 tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:06.336504 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-c42a4a2a-04ae-40ea-993e-096bef6d9be4 tempest-LiveAutoBlockMigrationV225Test-1358532044 tempest-LiveAutoBlockMigrationV225Test-1358532044-project-admin] 10.222.0.13 "POST /compute/v2.1/servers/2d3a927e-a478-40b1-8c92-80396c82f76c/action" status: 202 len: 0 microversion: 2.25 time: 4.459671 Nov 01 18:56:06.349099 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 238/493] 10.222.0.13 () {62 vars in 1319 bytes} [Tue Nov 1 18:56:01 2022] POST /compute/v2.1/servers/2d3a927e-a478-40b1-8c92-80396c82f76c/action => generated 0 bytes in 4473 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 01 18:56:06.370809 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [req-38b40e5a-c04b-4953-894f-6b999abbf68e req-e3b28560-ee3d-4f5f-87e5-9d7a5ffe9cbb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "614eb691-9a9a-4ca0-933d-686d80cc0ef1", "tag": "1c1a6351-a4fe-4a16-830e-df55738ac180"}]} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 18:56:06.400411 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-38b40e5a-c04b-4953-894f-6b999abbf68e req-e3b28560-ee3d-4f5f-87e5-9d7a5ffe9cbb service nova] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:06.401333 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-38b40e5a-c04b-4953-894f-6b999abbf68e req-e3b28560-ee3d-4f5f-87e5-9d7a5ffe9cbb service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:06.402002 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-38b40e5a-c04b-4953-894f-6b999abbf68e req-e3b28560-ee3d-4f5f-87e5-9d7a5ffe9cbb service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:06.439075 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.compute.server_external_events [req-38b40e5a-c04b-4953-894f-6b999abbf68e req-e3b28560-ee3d-4f5f-87e5-9d7a5ffe9cbb service nova] Creating event network-changed:1c1a6351-a4fe-4a16-830e-df55738ac180 for instance 614eb691-9a9a-4ca0-933d-686d80cc0ef1 on n-h2-863052-2 Nov 01 18:56:06.451708 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [req-38b40e5a-c04b-4953-894f-6b999abbf68e req-e3b28560-ee3d-4f5f-87e5-9d7a5ffe9cbb service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101193 Nov 01 18:56:06.453679 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 239/494] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Nov 1 18:56:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 18:56:06.461732 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-2cab6685-5307-4ee4-812c-d707c9253c76 tempest-ServerDiagnosticsNegativeTest-50806246 tempest-ServerDiagnosticsNegativeTest-50806246-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:56:06.462792 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-2cab6685-5307-4ee4-812c-d707c9253c76 tempest-ServerDiagnosticsNegativeTest-50806246 tempest-ServerDiagnosticsNegativeTest-50806246-project] [instance: 7fe37e78-fffe-4261-b0cd-be9037a208d5] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:56:06.473702 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-2cab6685-5307-4ee4-812c-d707c9253c76 tempest-ServerDiagnosticsNegativeTest-50806246 tempest-ServerDiagnosticsNegativeTest-50806246-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:06.474542 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-2cab6685-5307-4ee4-812c-d707c9253c76 tempest-ServerDiagnosticsNegativeTest-50806246 tempest-ServerDiagnosticsNegativeTest-50806246-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:06.475304 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-2cab6685-5307-4ee4-812c-d707c9253c76 tempest-ServerDiagnosticsNegativeTest-50806246 tempest-ServerDiagnosticsNegativeTest-50806246-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:06.479788 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-2cab6685-5307-4ee4-812c-d707c9253c76 tempest-ServerDiagnosticsNegativeTest-50806246 tempest-ServerDiagnosticsNegativeTest-50806246-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:06.480310 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-2cab6685-5307-4ee4-812c-d707c9253c76 tempest-ServerDiagnosticsNegativeTest-50806246 tempest-ServerDiagnosticsNegativeTest-50806246-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:06.480828 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-2cab6685-5307-4ee4-812c-d707c9253c76 tempest-ServerDiagnosticsNegativeTest-50806246 tempest-ServerDiagnosticsNegativeTest-50806246-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:06.957891 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-2cab6685-5307-4ee4-812c-d707c9253c76 tempest-ServerDiagnosticsNegativeTest-50806246 tempest-ServerDiagnosticsNegativeTest-50806246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8087408d8b947f8b603fdeaee878fee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '741e5c81bd1d4383a5faff2e2a3dbbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:56:06.972013 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-a72c1085-5fcd-487f-823b-613ef3235582 tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07a2a96629f4baea6a3adfc4011ffe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9baf3860ba564f5c8dff93085b9aabe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:56:06.973885 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-2cab6685-5307-4ee4-812c-d707c9253c76 tempest-ServerDiagnosticsNegativeTest-50806246 tempest-ServerDiagnosticsNegativeTest-50806246-project] 10.222.0.13 "GET /compute/v2.1/servers/7fe37e78-fffe-4261-b0cd-be9037a208d5" status: 200 len: 1323 microversion: 2.1 time: 0.518445 Nov 01 18:56:06.985208 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-a72c1085-5fcd-487f-823b-613ef3235582 tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] 10.222.0.13 "GET /compute/v2.1/servers/ab3530ff-d70f-4c6c-abd0-3afa14fd9954" status: 200 len: 1389 microversion: 2.1 time: 0.686869 Nov 01 18:56:06.988641 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 256/495] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:56:06 2022] GET /compute/v2.1/servers/ab3530ff-d70f-4c6c-abd0-3afa14fd9954 => generated 1389 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:56:06.996961 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 240/496] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:56:06 2022] GET /compute/v2.1/servers/7fe37e78-fffe-4261-b0cd-be9037a208d5 => generated 1323 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:56:07.003385 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-35484a98-e616-4794-b9d0-aeca03f5bc6f tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:56:07.003989 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-35484a98-e616-4794-b9d0-aeca03f5bc6f tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] [instance: 614eb691-9a9a-4ca0-933d-686d80cc0ef1] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:56:07.024869 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-35484a98-e616-4794-b9d0-aeca03f5bc6f tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:07.026318 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-35484a98-e616-4794-b9d0-aeca03f5bc6f tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:07.027488 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-35484a98-e616-4794-b9d0-aeca03f5bc6f tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:07.028199 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-35484a98-e616-4794-b9d0-aeca03f5bc6f tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:07.028678 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-35484a98-e616-4794-b9d0-aeca03f5bc6f tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:07.029105 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-35484a98-e616-4794-b9d0-aeca03f5bc6f tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:07.432746 n-d-863052-2 devstack@n-api.service[121403]: DEBUG dbcounter [-] [121403] Writing DB stats nova_cell0:SELECT=50 {{(pid=121403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 18:56:07.470831 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-35484a98-e616-4794-b9d0-aeca03f5bc6f tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72117f17294649d6b8bc16c66c7efab2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45d4c047d3c44324a27a27831236ab0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:56:07.480524 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-35484a98-e616-4794-b9d0-aeca03f5bc6f tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] 10.222.0.13 "GET /compute/v2.1/servers/614eb691-9a9a-4ca0-933d-686d80cc0ef1" status: 200 len: 1312 microversion: 2.1 time: 0.482385 Nov 01 18:56:07.481128 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 241/497] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:56:06 2022] GET /compute/v2.1/servers/614eb691-9a9a-4ca0-933d-686d80cc0ef1 => generated 1312 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:56:07.502913 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-ef0593f1-41b6-405d-bd71-89f7c8883df6 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:56:07.503934 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-ef0593f1-41b6-405d-bd71-89f7c8883df6 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] [instance: 2d3a927e-a478-40b1-8c92-80396c82f76c] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:56:07.508181 n-d-863052-2 devstack@n-api.service[121403]: DEBUG dbcounter [-] [121403] Writing DB stats nova_api:UPDATE=3,nova_api:SELECT=92,nova_api:INSERT=5 {{(pid=121403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 18:56:07.513670 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-9eaed508-2a23-44b3-8aab-520d0c592fb3 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-UnshelveToHostMultiNodesTest-server-525225338", "imageRef": "2d4a0047-1b9e-445f-8af8-1b5c9d93e881", "flavorRef": "452", "networks": "none"}} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 18:56:07.528096 n-d-863052-2 devstack@n-api.service[121402]: DEBUG dbcounter [-] [121402] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=7,nova_api:UPDATE=1 {{(pid=121402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 18:56:07.528371 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-ef0593f1-41b6-405d-bd71-89f7c8883df6 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:07.531870 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-ef0593f1-41b6-405d-bd71-89f7c8883df6 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:07.533085 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-ef0593f1-41b6-405d-bd71-89f7c8883df6 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:07.534663 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-ef0593f1-41b6-405d-bd71-89f7c8883df6 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:07.536643 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-ef0593f1-41b6-405d-bd71-89f7c8883df6 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:07.537289 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-ef0593f1-41b6-405d-bd71-89f7c8883df6 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:07.551902 n-d-863052-2 devstack@n-api.service[121403]: DEBUG dbcounter [-] [121403] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 18:56:07.622789 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.virt.hardware [None req-9eaed508-2a23-44b3-8aab-520d0c592fb3 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Flavor limits 0:0:0 {{(pid=121402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 01 18:56:07.623468 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.virt.hardware [None req-9eaed508-2a23-44b3-8aab-520d0c592fb3 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Image limits 0:0:0 {{(pid=121402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 01 18:56:07.624181 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.virt.hardware [None req-9eaed508-2a23-44b3-8aab-520d0c592fb3 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Flavor pref 0:0:0 {{(pid=121402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 01 18:56:07.624825 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.virt.hardware [None req-9eaed508-2a23-44b3-8aab-520d0c592fb3 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Image pref 0:0:0 {{(pid=121402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 01 18:56:07.625454 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.virt.hardware [None req-9eaed508-2a23-44b3-8aab-520d0c592fb3 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 01 18:56:07.636563 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-9eaed508-2a23-44b3-8aab-520d0c592fb3 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:07.637370 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-9eaed508-2a23-44b3-8aab-520d0c592fb3 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:07.638020 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-9eaed508-2a23-44b3-8aab-520d0c592fb3 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:07.639015 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-9eaed508-2a23-44b3-8aab-520d0c592fb3 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:07.640041 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-9eaed508-2a23-44b3-8aab-520d0c592fb3 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:07.640826 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-9eaed508-2a23-44b3-8aab-520d0c592fb3 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:07.648704 n-d-863052-2 devstack@n-api.service[121402]: DEBUG dbcounter [-] [121402] Writing DB stats nova_cell0:SELECT=25 {{(pid=121402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 18:56:07.662764 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.quota [None req-9eaed508-2a23-44b3-8aab-520d0c592fb3 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Getting quotas for project c804370880454c7aa02cef2c2c3cf144. Resources: {'cores', 'ram', 'instances'} {{(pid=121402) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 01 18:56:07.670065 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.quota [None req-9eaed508-2a23-44b3-8aab-520d0c592fb3 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Getting quotas for user 3c1314c21d8547ff890ede1c2ad281c6 and project c804370880454c7aa02cef2c2c3cf144. Resources: {'cores', 'ram', 'instances'} {{(pid=121402) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 01 18:56:07.695676 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-9eaed508-2a23-44b3-8aab-520d0c592fb3 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Going to run 1 instances... {{(pid=121402) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 01 18:56:07.698609 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-9eaed508-2a23-44b3-8aab-520d0c592fb3 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] [instance: ea631032-dd04-429b-988e-e6362ea42cf7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2d4a0047-1b9e-445f-8af8-1b5c9d93e881',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121402) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 01 18:56:07.789776 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-9eaed508-2a23-44b3-8aab-520d0c592fb3 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.91 time: 0.799417 Nov 01 18:56:07.790981 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 257/498] 10.222.0.13 () {62 vars in 1188 bytes} [Tue Nov 1 18:56:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 802 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Nov 01 18:56:07.796386 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-ff17be1e-cf05-46d2-8ed6-81b387acf246 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-583638552", "imageRef": "2d4a0047-1b9e-445f-8af8-1b5c9d93e881", "flavorRef": "452", "networks": [{"uuid": "a490666d-5de7-4ec8-8f65-f4383cb45da6"}]}} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 18:56:07.862686 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.network.neutron [None req-ff17be1e-cf05-46d2-8ed6-81b387acf246 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] validate_networks() for [('a490666d-5de7-4ec8-8f65-f4383cb45da6', None, None, None, None, None)] {{(pid=121402) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 01 18:56:07.982838 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-ef0593f1-41b6-405d-bd71-89f7c8883df6 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:56:07.994081 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-ef0593f1-41b6-405d-bd71-89f7c8883df6 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:56:07.996128 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-ef0593f1-41b6-405d-bd71-89f7c8883df6 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:56:08.001689 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-ef0593f1-41b6-405d-bd71-89f7c8883df6 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] 10.222.0.13 "GET /compute/v2.1/servers/2d3a927e-a478-40b1-8c92-80396c82f76c" status: 200 len: 1567 microversion: 2.25 time: 0.515484 Nov 01 18:56:08.002934 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 242/499] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 18:56:07 2022] GET /compute/v2.1/servers/2d3a927e-a478-40b1-8c92-80396c82f76c => generated 1567 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 18:56:08.010661 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-3f5067d6-e0c8-4c16-ba1b-30e1c9833439 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:56:08.011833 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-3f5067d6-e0c8-4c16-ba1b-30e1c9833439 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] [instance: ea631032-dd04-429b-988e-e6362ea42cf7] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:56:08.391798 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-3f5067d6-e0c8-4c16-ba1b-30e1c9833439 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c1314c21d8547ff890ede1c2ad281c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c804370880454c7aa02cef2c2c3cf144', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:56:08.400206 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-3f5067d6-e0c8-4c16-ba1b-30e1c9833439 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c1314c21d8547ff890ede1c2ad281c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c804370880454c7aa02cef2c2c3cf144', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:56:08.401672 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-3f5067d6-e0c8-4c16-ba1b-30e1c9833439 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c1314c21d8547ff890ede1c2ad281c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c804370880454c7aa02cef2c2c3cf144', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:56:08.419874 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-3f5067d6-e0c8-4c16-ba1b-30e1c9833439 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] 10.222.0.13 "GET /compute/v2.1/servers/ea631032-dd04-429b-988e-e6362ea42cf7" status: 200 len: 1452 microversion: 2.91 time: 0.415208 Nov 01 18:56:08.421043 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 243/500] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 18:56:08 2022] GET /compute/v2.1/servers/ea631032-dd04-429b-988e-e6362ea42cf7 => generated 1452 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 18:56:08.447234 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-3990b130-982c-4062-be15-eb9488b682a6 tempest-ServerDiagnosticsNegativeTest-50806246 tempest-ServerDiagnosticsNegativeTest-50806246-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:56:08.449269 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-3990b130-982c-4062-be15-eb9488b682a6 tempest-ServerDiagnosticsNegativeTest-50806246 tempest-ServerDiagnosticsNegativeTest-50806246-project] [instance: 7fe37e78-fffe-4261-b0cd-be9037a208d5] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:56:08.457496 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-3990b130-982c-4062-be15-eb9488b682a6 tempest-ServerDiagnosticsNegativeTest-50806246 tempest-ServerDiagnosticsNegativeTest-50806246-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:08.458054 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-3990b130-982c-4062-be15-eb9488b682a6 tempest-ServerDiagnosticsNegativeTest-50806246 tempest-ServerDiagnosticsNegativeTest-50806246-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:08.458592 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-3990b130-982c-4062-be15-eb9488b682a6 tempest-ServerDiagnosticsNegativeTest-50806246 tempest-ServerDiagnosticsNegativeTest-50806246-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:08.460067 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-3990b130-982c-4062-be15-eb9488b682a6 tempest-ServerDiagnosticsNegativeTest-50806246 tempest-ServerDiagnosticsNegativeTest-50806246-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:08.461014 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-3990b130-982c-4062-be15-eb9488b682a6 tempest-ServerDiagnosticsNegativeTest-50806246 tempest-ServerDiagnosticsNegativeTest-50806246-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:08.461659 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-3990b130-982c-4062-be15-eb9488b682a6 tempest-ServerDiagnosticsNegativeTest-50806246 tempest-ServerDiagnosticsNegativeTest-50806246-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:08.854177 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-3990b130-982c-4062-be15-eb9488b682a6 tempest-ServerDiagnosticsNegativeTest-50806246 tempest-ServerDiagnosticsNegativeTest-50806246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8087408d8b947f8b603fdeaee878fee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '741e5c81bd1d4383a5faff2e2a3dbbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:56:08.867243 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-3990b130-982c-4062-be15-eb9488b682a6 tempest-ServerDiagnosticsNegativeTest-50806246 tempest-ServerDiagnosticsNegativeTest-50806246-project] 10.222.0.13 "GET /compute/v2.1/servers/7fe37e78-fffe-4261-b0cd-be9037a208d5" status: 200 len: 1323 microversion: 2.1 time: 0.427881 Nov 01 18:56:08.868691 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 244/501] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:56:08 2022] GET /compute/v2.1/servers/7fe37e78-fffe-4261-b0cd-be9037a208d5 => generated 1323 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:56:08.873815 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-5868bcd7-2dc7-45f9-8551-08b216c69f43 tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:56:08.874739 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-5868bcd7-2dc7-45f9-8551-08b216c69f43 tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] [instance: ab3530ff-d70f-4c6c-abd0-3afa14fd9954] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:56:08.881868 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-5868bcd7-2dc7-45f9-8551-08b216c69f43 tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:08.882849 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-5868bcd7-2dc7-45f9-8551-08b216c69f43 tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:08.883731 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-5868bcd7-2dc7-45f9-8551-08b216c69f43 tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:08.884448 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-5868bcd7-2dc7-45f9-8551-08b216c69f43 tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:08.884951 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-5868bcd7-2dc7-45f9-8551-08b216c69f43 tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:08.885446 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-5868bcd7-2dc7-45f9-8551-08b216c69f43 tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:09.097000 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.virt.hardware [None req-ff17be1e-cf05-46d2-8ed6-81b387acf246 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Flavor limits 0:0:0 {{(pid=121402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 01 18:56:09.098103 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.virt.hardware [None req-ff17be1e-cf05-46d2-8ed6-81b387acf246 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Image limits 0:0:0 {{(pid=121402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 01 18:56:09.099536 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.virt.hardware [None req-ff17be1e-cf05-46d2-8ed6-81b387acf246 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Flavor pref 0:0:0 {{(pid=121402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 01 18:56:09.100408 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.virt.hardware [None req-ff17be1e-cf05-46d2-8ed6-81b387acf246 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Image pref 0:0:0 {{(pid=121402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 01 18:56:09.101072 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.virt.hardware [None req-ff17be1e-cf05-46d2-8ed6-81b387acf246 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 01 18:56:09.109534 n-d-863052-2 devstack@n-api.service[121402]: DEBUG dbcounter [-] [121402] Writing DB stats nova_cell0:SELECT=65 {{(pid=121402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 18:56:09.112071 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-ff17be1e-cf05-46d2-8ed6-81b387acf246 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:09.112627 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-ff17be1e-cf05-46d2-8ed6-81b387acf246 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:09.113308 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-ff17be1e-cf05-46d2-8ed6-81b387acf246 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:09.114026 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-ff17be1e-cf05-46d2-8ed6-81b387acf246 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:09.114616 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-ff17be1e-cf05-46d2-8ed6-81b387acf246 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:09.115032 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-ff17be1e-cf05-46d2-8ed6-81b387acf246 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:09.134465 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.quota [None req-ff17be1e-cf05-46d2-8ed6-81b387acf246 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Getting quotas for project d9b9d4c236b944f9b2e8e502a50a8f8b. Resources: {'cores', 'ram', 'instances'} {{(pid=121402) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 01 18:56:09.138981 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.quota [None req-ff17be1e-cf05-46d2-8ed6-81b387acf246 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Getting quotas for user f32f5fba1976432d938e664c7714e52b and project d9b9d4c236b944f9b2e8e502a50a8f8b. Resources: {'cores', 'ram', 'instances'} {{(pid=121402) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 01 18:56:09.151764 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-ff17be1e-cf05-46d2-8ed6-81b387acf246 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Going to run 1 instances... {{(pid=121402) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 01 18:56:09.153999 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-ff17be1e-cf05-46d2-8ed6-81b387acf246 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] [instance: 58d02dff-26f6-4c2f-b886-cdbdccbfcec9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2d4a0047-1b9e-445f-8af8-1b5c9d93e881',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121402) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 01 18:56:09.211669 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-ff17be1e-cf05-46d2-8ed6-81b387acf246 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.419296 Nov 01 18:56:09.218768 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 258/502] 10.222.0.13 () {60 vars in 1147 bytes} [Tue Nov 1 18:56:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 1427 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 01 18:56:09.224912 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-5868bcd7-2dc7-45f9-8551-08b216c69f43 tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07a2a96629f4baea6a3adfc4011ffe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9baf3860ba564f5c8dff93085b9aabe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:56:09.246097 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [req-f3fe6c35-65bb-4e5c-b11a-37c9caf56d08 req-cf8da1c5-c875-4969-8a80-2f13f018235d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7fe37e78-fffe-4261-b0cd-be9037a208d5", "tag": "2d4e964c-336f-49a7-86d8-bfcacbbee6b8"}]} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 18:56:09.250205 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-5868bcd7-2dc7-45f9-8551-08b216c69f43 tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] 10.222.0.13 "GET /compute/v2.1/servers/ab3530ff-d70f-4c6c-abd0-3afa14fd9954" status: 200 len: 1389 microversion: 2.1 time: 0.380178 Nov 01 18:56:09.251089 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 245/503] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:56:08 2022] GET /compute/v2.1/servers/ab3530ff-d70f-4c6c-abd0-3afa14fd9954 => generated 1389 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:56:09.263713 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-5df9be2f-5fbf-4a18-881a-f571217e31ad tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:56:09.270786 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-5df9be2f-5fbf-4a18-881a-f571217e31ad tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] [instance: 614eb691-9a9a-4ca0-933d-686d80cc0ef1] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:56:09.283194 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-f3fe6c35-65bb-4e5c-b11a-37c9caf56d08 req-cf8da1c5-c875-4969-8a80-2f13f018235d service nova] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:09.283671 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-f3fe6c35-65bb-4e5c-b11a-37c9caf56d08 req-cf8da1c5-c875-4969-8a80-2f13f018235d service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:09.284190 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-f3fe6c35-65bb-4e5c-b11a-37c9caf56d08 req-cf8da1c5-c875-4969-8a80-2f13f018235d service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:09.285524 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-5df9be2f-5fbf-4a18-881a-f571217e31ad tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:09.289216 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-5df9be2f-5fbf-4a18-881a-f571217e31ad tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:09.290155 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-5df9be2f-5fbf-4a18-881a-f571217e31ad tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:09.291133 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-5df9be2f-5fbf-4a18-881a-f571217e31ad tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:09.294301 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-5df9be2f-5fbf-4a18-881a-f571217e31ad tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:09.294968 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-5df9be2f-5fbf-4a18-881a-f571217e31ad tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:09.303923 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.compute.server_external_events [req-f3fe6c35-65bb-4e5c-b11a-37c9caf56d08 req-cf8da1c5-c875-4969-8a80-2f13f018235d service nova] Creating event network-changed:2d4e964c-336f-49a7-86d8-bfcacbbee6b8 for instance 7fe37e78-fffe-4261-b0cd-be9037a208d5 on n-h1-863052-2 Nov 01 18:56:09.324104 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [req-f3fe6c35-65bb-4e5c-b11a-37c9caf56d08 req-cf8da1c5-c875-4969-8a80-2f13f018235d service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.104002 Nov 01 18:56:09.325072 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 259/504] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Nov 1 18:56:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 18:56:09.330331 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [req-a94fd1ae-51ca-45ae-9e08-0d784b19c288 req-2f81b752-e389-4bec-8447-93fee695ba83 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ab3530ff-d70f-4c6c-abd0-3afa14fd9954", "tag": "5a8ac51b-9c28-4dee-aa83-db1236898e3d"}]} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 18:56:09.342613 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-a94fd1ae-51ca-45ae-9e08-0d784b19c288 req-2f81b752-e389-4bec-8447-93fee695ba83 service nova] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:09.343666 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-a94fd1ae-51ca-45ae-9e08-0d784b19c288 req-2f81b752-e389-4bec-8447-93fee695ba83 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:09.344285 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-a94fd1ae-51ca-45ae-9e08-0d784b19c288 req-2f81b752-e389-4bec-8447-93fee695ba83 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:09.371218 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.compute.server_external_events [req-a94fd1ae-51ca-45ae-9e08-0d784b19c288 req-2f81b752-e389-4bec-8447-93fee695ba83 service nova] Creating event network-changed:5a8ac51b-9c28-4dee-aa83-db1236898e3d for instance ab3530ff-d70f-4c6c-abd0-3afa14fd9954 on n-h2-863052-2 Nov 01 18:56:09.387120 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [req-a94fd1ae-51ca-45ae-9e08-0d784b19c288 req-2f81b752-e389-4bec-8447-93fee695ba83 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060410 Nov 01 18:56:09.397651 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 260/505] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Nov 1 18:56:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 18:56:09.404134 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-f75e9d9f-bf74-4eea-8d5f-90d2e03e93e3 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:56:09.410478 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-f75e9d9f-bf74-4eea-8d5f-90d2e03e93e3 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] [instance: 2d3a927e-a478-40b1-8c92-80396c82f76c] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:56:09.421656 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f75e9d9f-bf74-4eea-8d5f-90d2e03e93e3 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:09.424812 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f75e9d9f-bf74-4eea-8d5f-90d2e03e93e3 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:09.425521 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f75e9d9f-bf74-4eea-8d5f-90d2e03e93e3 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:09.426462 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f75e9d9f-bf74-4eea-8d5f-90d2e03e93e3 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:09.430556 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f75e9d9f-bf74-4eea-8d5f-90d2e03e93e3 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:09.431421 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f75e9d9f-bf74-4eea-8d5f-90d2e03e93e3 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:09.767736 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-5df9be2f-5fbf-4a18-881a-f571217e31ad tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72117f17294649d6b8bc16c66c7efab2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45d4c047d3c44324a27a27831236ab0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:56:09.777483 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-5df9be2f-5fbf-4a18-881a-f571217e31ad tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] 10.222.0.13 "GET /compute/v2.1/servers/614eb691-9a9a-4ca0-933d-686d80cc0ef1" status: 200 len: 1312 microversion: 2.1 time: 0.518183 Nov 01 18:56:09.779516 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 246/506] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:56:09 2022] GET /compute/v2.1/servers/614eb691-9a9a-4ca0-933d-686d80cc0ef1 => generated 1312 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:56:09.785304 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-d63b4f39-5150-4b85-ab25-63d5e6095a41 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:56:09.786241 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-d63b4f39-5150-4b85-ab25-63d5e6095a41 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] [instance: 58d02dff-26f6-4c2f-b886-cdbdccbfcec9] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:56:09.893466 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-d63b4f39-5150-4b85-ab25-63d5e6095a41 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f32f5fba1976432d938e664c7714e52b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b9d4c236b944f9b2e8e502a50a8f8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:56:09.924893 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-d63b4f39-5150-4b85-ab25-63d5e6095a41 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] 10.222.0.13 "GET /compute/v2.1/servers/58d02dff-26f6-4c2f-b886-cdbdccbfcec9" status: 200 len: 1210 microversion: 2.1 time: 0.129675 Nov 01 18:56:09.925886 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 247/507] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:56:09 2022] GET /compute/v2.1/servers/58d02dff-26f6-4c2f-b886-cdbdccbfcec9 => generated 1210 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:56:09.931673 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-580d2c47-a90a-4406-a4f6-dbeaa9c8b6ea tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:56:09.932283 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-580d2c47-a90a-4406-a4f6-dbeaa9c8b6ea tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] [instance: ea631032-dd04-429b-988e-e6362ea42cf7] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:56:09.950937 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-580d2c47-a90a-4406-a4f6-dbeaa9c8b6ea tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:09.951441 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-580d2c47-a90a-4406-a4f6-dbeaa9c8b6ea tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:09.952072 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-580d2c47-a90a-4406-a4f6-dbeaa9c8b6ea tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:09.954920 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-580d2c47-a90a-4406-a4f6-dbeaa9c8b6ea tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:09.955381 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-580d2c47-a90a-4406-a4f6-dbeaa9c8b6ea tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:09.955823 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-580d2c47-a90a-4406-a4f6-dbeaa9c8b6ea tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:10.159147 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-f75e9d9f-bf74-4eea-8d5f-90d2e03e93e3 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:56:10.177787 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-f75e9d9f-bf74-4eea-8d5f-90d2e03e93e3 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:56:10.179767 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-f75e9d9f-bf74-4eea-8d5f-90d2e03e93e3 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:56:10.181020 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-f75e9d9f-bf74-4eea-8d5f-90d2e03e93e3 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] 10.222.0.13 "GET /compute/v2.1/servers/2d3a927e-a478-40b1-8c92-80396c82f76c" status: 200 len: 1567 microversion: 2.25 time: 0.781831 Nov 01 18:56:10.181566 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 261/508] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 18:56:09 2022] GET /compute/v2.1/servers/2d3a927e-a478-40b1-8c92-80396c82f76c => generated 1567 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 18:56:10.186248 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-3b159c48-9c28-4245-ad55-444c7e9dcf90 tempest-ServerDiagnosticsNegativeTest-50806246 tempest-ServerDiagnosticsNegativeTest-50806246-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:56:10.186837 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-3b159c48-9c28-4245-ad55-444c7e9dcf90 tempest-ServerDiagnosticsNegativeTest-50806246 tempest-ServerDiagnosticsNegativeTest-50806246-project] [instance: 7fe37e78-fffe-4261-b0cd-be9037a208d5] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:56:10.200129 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-3b159c48-9c28-4245-ad55-444c7e9dcf90 tempest-ServerDiagnosticsNegativeTest-50806246 tempest-ServerDiagnosticsNegativeTest-50806246-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:10.203032 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-3b159c48-9c28-4245-ad55-444c7e9dcf90 tempest-ServerDiagnosticsNegativeTest-50806246 tempest-ServerDiagnosticsNegativeTest-50806246-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:10.206223 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-3b159c48-9c28-4245-ad55-444c7e9dcf90 tempest-ServerDiagnosticsNegativeTest-50806246 tempest-ServerDiagnosticsNegativeTest-50806246-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:10.207327 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-3b159c48-9c28-4245-ad55-444c7e9dcf90 tempest-ServerDiagnosticsNegativeTest-50806246 tempest-ServerDiagnosticsNegativeTest-50806246-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:10.208239 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-3b159c48-9c28-4245-ad55-444c7e9dcf90 tempest-ServerDiagnosticsNegativeTest-50806246 tempest-ServerDiagnosticsNegativeTest-50806246-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:10.209754 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-3b159c48-9c28-4245-ad55-444c7e9dcf90 tempest-ServerDiagnosticsNegativeTest-50806246 tempest-ServerDiagnosticsNegativeTest-50806246-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:10.301401 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-580d2c47-a90a-4406-a4f6-dbeaa9c8b6ea tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c1314c21d8547ff890ede1c2ad281c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c804370880454c7aa02cef2c2c3cf144', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:56:10.312830 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-580d2c47-a90a-4406-a4f6-dbeaa9c8b6ea tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c1314c21d8547ff890ede1c2ad281c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c804370880454c7aa02cef2c2c3cf144', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:56:10.314676 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-580d2c47-a90a-4406-a4f6-dbeaa9c8b6ea tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c1314c21d8547ff890ede1c2ad281c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c804370880454c7aa02cef2c2c3cf144', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:56:10.322078 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-580d2c47-a90a-4406-a4f6-dbeaa9c8b6ea tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] 10.222.0.13 "GET /compute/v2.1/servers/ea631032-dd04-429b-988e-e6362ea42cf7" status: 200 len: 1510 microversion: 2.91 time: 0.394758 Nov 01 18:56:10.323193 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 248/509] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 18:56:09 2022] GET /compute/v2.1/servers/ea631032-dd04-429b-988e-e6362ea42cf7 => generated 1510 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 18:56:10.340782 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-4792162f-acb2-4046-8d38-7c7a3449edd9 tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:56:10.341652 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-4792162f-acb2-4046-8d38-7c7a3449edd9 tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] [instance: ab3530ff-d70f-4c6c-abd0-3afa14fd9954] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:56:10.349605 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-4792162f-acb2-4046-8d38-7c7a3449edd9 tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:10.351026 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-4792162f-acb2-4046-8d38-7c7a3449edd9 tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:10.352516 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-4792162f-acb2-4046-8d38-7c7a3449edd9 tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:10.353746 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-4792162f-acb2-4046-8d38-7c7a3449edd9 tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:10.354928 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-4792162f-acb2-4046-8d38-7c7a3449edd9 tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:10.355921 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-4792162f-acb2-4046-8d38-7c7a3449edd9 tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:10.512779 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-3b159c48-9c28-4245-ad55-444c7e9dcf90 tempest-ServerDiagnosticsNegativeTest-50806246 tempest-ServerDiagnosticsNegativeTest-50806246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8087408d8b947f8b603fdeaee878fee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '741e5c81bd1d4383a5faff2e2a3dbbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:56:10.522709 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-3b159c48-9c28-4245-ad55-444c7e9dcf90 tempest-ServerDiagnosticsNegativeTest-50806246 tempest-ServerDiagnosticsNegativeTest-50806246-project] 10.222.0.13 "GET /compute/v2.1/servers/7fe37e78-fffe-4261-b0cd-be9037a208d5" status: 200 len: 1323 microversion: 2.1 time: 0.339608 Nov 01 18:56:10.523496 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 262/510] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:56:10 2022] GET /compute/v2.1/servers/7fe37e78-fffe-4261-b0cd-be9037a208d5 => generated 1323 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:56:10.627803 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-4792162f-acb2-4046-8d38-7c7a3449edd9 tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07a2a96629f4baea6a3adfc4011ffe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9baf3860ba564f5c8dff93085b9aabe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:56:10.636002 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-4792162f-acb2-4046-8d38-7c7a3449edd9 tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] 10.222.0.13 "GET /compute/v2.1/servers/ab3530ff-d70f-4c6c-abd0-3afa14fd9954" status: 200 len: 1389 microversion: 2.1 time: 0.311402 Nov 01 18:56:10.636728 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 249/511] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:56:10 2022] GET /compute/v2.1/servers/ab3530ff-d70f-4c6c-abd0-3afa14fd9954 => generated 1389 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:56:10.812196 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-f83de356-c5fe-40d6-9c12-7c870b464250 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:56:10.813790 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-f83de356-c5fe-40d6-9c12-7c870b464250 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] [instance: 614eb691-9a9a-4ca0-933d-686d80cc0ef1] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:56:10.823987 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f83de356-c5fe-40d6-9c12-7c870b464250 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:10.825037 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f83de356-c5fe-40d6-9c12-7c870b464250 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:10.825731 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f83de356-c5fe-40d6-9c12-7c870b464250 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:10.827514 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f83de356-c5fe-40d6-9c12-7c870b464250 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:10.828530 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f83de356-c5fe-40d6-9c12-7c870b464250 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:10.830894 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f83de356-c5fe-40d6-9c12-7c870b464250 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:10.950781 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-cb48e1b3-829b-4110-aab9-d9b1691bf428 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:56:10.952512 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-cb48e1b3-829b-4110-aab9-d9b1691bf428 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] [instance: 58d02dff-26f6-4c2f-b886-cdbdccbfcec9] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:56:10.962117 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-cb48e1b3-829b-4110-aab9-d9b1691bf428 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:10.963378 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-cb48e1b3-829b-4110-aab9-d9b1691bf428 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:10.964085 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-cb48e1b3-829b-4110-aab9-d9b1691bf428 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:10.965082 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-cb48e1b3-829b-4110-aab9-d9b1691bf428 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:10.965858 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-cb48e1b3-829b-4110-aab9-d9b1691bf428 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:10.966452 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-cb48e1b3-829b-4110-aab9-d9b1691bf428 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:11.106672 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-cb48e1b3-829b-4110-aab9-d9b1691bf428 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f32f5fba1976432d938e664c7714e52b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b9d4c236b944f9b2e8e502a50a8f8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:56:11.122571 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-cb48e1b3-829b-4110-aab9-d9b1691bf428 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] 10.222.0.13 "GET /compute/v2.1/servers/58d02dff-26f6-4c2f-b886-cdbdccbfcec9" status: 200 len: 1206 microversion: 2.1 time: 0.174859 Nov 01 18:56:11.139288 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 250/512] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:56:10 2022] GET /compute/v2.1/servers/58d02dff-26f6-4c2f-b886-cdbdccbfcec9 => generated 1206 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:56:11.156542 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-f83de356-c5fe-40d6-9c12-7c870b464250 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72117f17294649d6b8bc16c66c7efab2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45d4c047d3c44324a27a27831236ab0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:56:11.167186 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-f83de356-c5fe-40d6-9c12-7c870b464250 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] 10.222.0.13 "GET /compute/v2.1/servers/614eb691-9a9a-4ca0-933d-686d80cc0ef1" status: 200 len: 1312 microversion: 2.1 time: 0.362085 Nov 01 18:56:11.168454 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 263/513] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:56:10 2022] GET /compute/v2.1/servers/614eb691-9a9a-4ca0-933d-686d80cc0ef1 => generated 1312 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:56:11.211543 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-39b34646-e075-45cb-b65b-2e62f948204d tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:56:11.213001 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-39b34646-e075-45cb-b65b-2e62f948204d tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] [instance: 2d3a927e-a478-40b1-8c92-80396c82f76c] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:56:11.220776 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-39b34646-e075-45cb-b65b-2e62f948204d tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:11.221435 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-39b34646-e075-45cb-b65b-2e62f948204d tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:11.222029 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-39b34646-e075-45cb-b65b-2e62f948204d tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:11.222888 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-39b34646-e075-45cb-b65b-2e62f948204d tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:11.223499 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-39b34646-e075-45cb-b65b-2e62f948204d tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:11.224089 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-39b34646-e075-45cb-b65b-2e62f948204d tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:11.361698 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-c886f4fb-be60-41a8-bc10-bc2eaac6796c tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:56:11.362937 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-c886f4fb-be60-41a8-bc10-bc2eaac6796c tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] [instance: ea631032-dd04-429b-988e-e6362ea42cf7] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:56:11.375009 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-c886f4fb-be60-41a8-bc10-bc2eaac6796c tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:11.375969 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-c886f4fb-be60-41a8-bc10-bc2eaac6796c tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:11.376613 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-c886f4fb-be60-41a8-bc10-bc2eaac6796c tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:11.379580 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-c886f4fb-be60-41a8-bc10-bc2eaac6796c tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:11.381100 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-c886f4fb-be60-41a8-bc10-bc2eaac6796c tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:11.385188 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-c886f4fb-be60-41a8-bc10-bc2eaac6796c tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:11.546825 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-39b34646-e075-45cb-b65b-2e62f948204d tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:56:11.564791 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-39b34646-e075-45cb-b65b-2e62f948204d tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:56:11.571250 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-39b34646-e075-45cb-b65b-2e62f948204d tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:56:11.573343 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-39b34646-e075-45cb-b65b-2e62f948204d tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] 10.222.0.13 "GET /compute/v2.1/servers/2d3a927e-a478-40b1-8c92-80396c82f76c" status: 200 len: 1567 microversion: 2.25 time: 0.365483 Nov 01 18:56:11.575663 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 251/514] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 18:56:11 2022] GET /compute/v2.1/servers/2d3a927e-a478-40b1-8c92-80396c82f76c => generated 1567 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 18:56:11.588533 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [req-d1617688-0484-4c6c-926f-e5c686844543 req-84ae7750-6c9d-42f3-8a56-e88b9bbba6bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d3a927e-a478-40b1-8c92-80396c82f76c", "name": "network-vif-unplugged", "status": "completed", "tag": "9765089c-d945-4fd6-a621-1f90f70e4416"}, {"name": "network-changed", "server_uuid": "2d3a927e-a478-40b1-8c92-80396c82f76c", "tag": "9765089c-d945-4fd6-a621-1f90f70e4416"}]} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 18:56:11.609133 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-d1617688-0484-4c6c-926f-e5c686844543 req-84ae7750-6c9d-42f3-8a56-e88b9bbba6bf service nova] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:11.609615 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-d1617688-0484-4c6c-926f-e5c686844543 req-84ae7750-6c9d-42f3-8a56-e88b9bbba6bf service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:11.610051 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-d1617688-0484-4c6c-926f-e5c686844543 req-84ae7750-6c9d-42f3-8a56-e88b9bbba6bf service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:11.638787 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.compute.server_external_events [req-d1617688-0484-4c6c-926f-e5c686844543 req-84ae7750-6c9d-42f3-8a56-e88b9bbba6bf service nova] Creating event network-vif-unplugged:9765089c-d945-4fd6-a621-1f90f70e4416 for instance 2d3a927e-a478-40b1-8c92-80396c82f76c on n-h1-863052-2 Nov 01 18:56:11.639552 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.compute.server_external_events [req-d1617688-0484-4c6c-926f-e5c686844543 req-84ae7750-6c9d-42f3-8a56-e88b9bbba6bf service nova] Creating event network-changed:9765089c-d945-4fd6-a621-1f90f70e4416 for instance 2d3a927e-a478-40b1-8c92-80396c82f76c on n-h1-863052-2 Nov 01 18:56:11.645232 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [req-d1617688-0484-4c6c-926f-e5c686844543 req-84ae7750-6c9d-42f3-8a56-e88b9bbba6bf service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 352 microversion: 2.1 time: 0.067775 Nov 01 18:56:11.646334 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 252/515] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Nov 1 18:56:11 2022] POST /compute/v2.1/os-server-external-events => generated 352 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 18:56:11.652375 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-df8e917e-0848-4434-8b5c-8187c4ce69fc tempest-ServerDiagnosticsNegativeTest-50806246 tempest-ServerDiagnosticsNegativeTest-50806246-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:56:11.653395 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-df8e917e-0848-4434-8b5c-8187c4ce69fc tempest-ServerDiagnosticsNegativeTest-50806246 tempest-ServerDiagnosticsNegativeTest-50806246-project] [instance: 7fe37e78-fffe-4261-b0cd-be9037a208d5] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:56:11.659810 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-df8e917e-0848-4434-8b5c-8187c4ce69fc tempest-ServerDiagnosticsNegativeTest-50806246 tempest-ServerDiagnosticsNegativeTest-50806246-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:11.660657 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-df8e917e-0848-4434-8b5c-8187c4ce69fc tempest-ServerDiagnosticsNegativeTest-50806246 tempest-ServerDiagnosticsNegativeTest-50806246-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:11.661348 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-df8e917e-0848-4434-8b5c-8187c4ce69fc tempest-ServerDiagnosticsNegativeTest-50806246 tempest-ServerDiagnosticsNegativeTest-50806246-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:11.662968 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-df8e917e-0848-4434-8b5c-8187c4ce69fc tempest-ServerDiagnosticsNegativeTest-50806246 tempest-ServerDiagnosticsNegativeTest-50806246-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:11.663645 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-df8e917e-0848-4434-8b5c-8187c4ce69fc tempest-ServerDiagnosticsNegativeTest-50806246 tempest-ServerDiagnosticsNegativeTest-50806246-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:11.664281 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-df8e917e-0848-4434-8b5c-8187c4ce69fc tempest-ServerDiagnosticsNegativeTest-50806246 tempest-ServerDiagnosticsNegativeTest-50806246-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:11.721081 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-c886f4fb-be60-41a8-bc10-bc2eaac6796c tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c1314c21d8547ff890ede1c2ad281c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c804370880454c7aa02cef2c2c3cf144', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:56:11.730568 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-c886f4fb-be60-41a8-bc10-bc2eaac6796c tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c1314c21d8547ff890ede1c2ad281c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c804370880454c7aa02cef2c2c3cf144', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:56:11.732571 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-c886f4fb-be60-41a8-bc10-bc2eaac6796c tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c1314c21d8547ff890ede1c2ad281c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c804370880454c7aa02cef2c2c3cf144', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:56:11.741118 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-c886f4fb-be60-41a8-bc10-bc2eaac6796c tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] 10.222.0.13 "GET /compute/v2.1/servers/ea631032-dd04-429b-988e-e6362ea42cf7" status: 200 len: 1510 microversion: 2.91 time: 0.383154 Nov 01 18:56:11.742239 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 264/516] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 18:56:11 2022] GET /compute/v2.1/servers/ea631032-dd04-429b-988e-e6362ea42cf7 => generated 1510 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 01 18:56:11.855191 n-d-863052-2 devstack@n-api.service[121403]: DEBUG dbcounter [-] [121403] Writing DB stats nova_cell0:SELECT=41 {{(pid=121403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 18:56:11.936356 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-40bd06ac-b5dc-4cdd-a1a8-b5b771cf1e8b tempest-QuotaClassesAdminTestJSON-1476877878 tempest-QuotaClassesAdminTestJSON-1476877878-project-admin] Calling method '.version_select at 0x7f0ae2a795e0>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:56:11.960486 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-40bd06ac-b5dc-4cdd-a1a8-b5b771cf1e8b tempest-QuotaClassesAdminTestJSON-1476877878 tempest-QuotaClassesAdminTestJSON-1476877878-project-admin] 10.222.0.13 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 303 microversion: 2.1 time: 0.216143 Nov 01 18:56:11.969438 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 265/517] 10.222.0.13 () {58 vars in 1185 bytes} [Tue Nov 1 18:56:11 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 303 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 18:56:11.979772 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-54215731-5f27-4e86-834d-e36084c51805 tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:56:11.980449 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-54215731-5f27-4e86-834d-e36084c51805 tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] [instance: ab3530ff-d70f-4c6c-abd0-3afa14fd9954] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:56:11.986980 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-54215731-5f27-4e86-834d-e36084c51805 tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:11.987729 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-54215731-5f27-4e86-834d-e36084c51805 tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:11.988375 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-54215731-5f27-4e86-834d-e36084c51805 tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:11.989945 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-54215731-5f27-4e86-834d-e36084c51805 tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:11.990771 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-54215731-5f27-4e86-834d-e36084c51805 tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:11.991393 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-54215731-5f27-4e86-834d-e36084c51805 tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:12.003625 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-df8e917e-0848-4434-8b5c-8187c4ce69fc tempest-ServerDiagnosticsNegativeTest-50806246 tempest-ServerDiagnosticsNegativeTest-50806246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8087408d8b947f8b603fdeaee878fee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '741e5c81bd1d4383a5faff2e2a3dbbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:56:12.017791 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-df8e917e-0848-4434-8b5c-8187c4ce69fc tempest-ServerDiagnosticsNegativeTest-50806246 tempest-ServerDiagnosticsNegativeTest-50806246-project] 10.222.0.13 "GET /compute/v2.1/servers/7fe37e78-fffe-4261-b0cd-be9037a208d5" status: 200 len: 1323 microversion: 2.1 time: 0.369424 Nov 01 18:56:12.033353 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 253/518] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:56:11 2022] GET /compute/v2.1/servers/7fe37e78-fffe-4261-b0cd-be9037a208d5 => generated 1323 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:56:12.039912 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-61cdd654-7c38-431f-946c-22ab718f5891 tempest-QuotaClassesAdminTestJSON-1476877878 tempest-QuotaClassesAdminTestJSON-1476877878-project-admin] Action: 'update', calling method: .version_select at 0x7f0ae2a9dd30>, body: {"quota_class_set": {"cores": 120, "fixed_ips": 99, "floating_ips": 99, "injected_file_content_bytes": 10340, "injected_file_path_bytes": 355, "injected_files": 105, "instances": 110, "key_pairs": 200, "metadata_items": 228, "ram": 51300, "security_group_rules": 99, "security_groups": 99}} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 18:56:12.306484 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-54215731-5f27-4e86-834d-e36084c51805 tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07a2a96629f4baea6a3adfc4011ffe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9baf3860ba564f5c8dff93085b9aabe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:56:12.318173 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-54215731-5f27-4e86-834d-e36084c51805 tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] 10.222.0.13 "GET /compute/v2.1/servers/ab3530ff-d70f-4c6c-abd0-3afa14fd9954" status: 200 len: 1389 microversion: 2.1 time: 0.346033 Nov 01 18:56:12.336610 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 266/519] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:56:11 2022] GET /compute/v2.1/servers/ab3530ff-d70f-4c6c-abd0-3afa14fd9954 => generated 1389 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:56:12.336610 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-dd4b633e-e21e-4094-87a0-1efdf21b1246 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:56:12.336610 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-dd4b633e-e21e-4094-87a0-1efdf21b1246 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] [instance: 58d02dff-26f6-4c2f-b886-cdbdccbfcec9] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:56:12.351697 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-dd4b633e-e21e-4094-87a0-1efdf21b1246 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:12.352291 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-dd4b633e-e21e-4094-87a0-1efdf21b1246 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:12.352827 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-dd4b633e-e21e-4094-87a0-1efdf21b1246 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:12.353606 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-dd4b633e-e21e-4094-87a0-1efdf21b1246 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:12.364572 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-dd4b633e-e21e-4094-87a0-1efdf21b1246 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:12.365992 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-dd4b633e-e21e-4094-87a0-1efdf21b1246 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:12.370842 n-d-863052-2 devstack@n-api.service[121402]: DEBUG dbcounter [-] [121402] Writing DB stats nova_cell1:SELECT=100 {{(pid=121402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 18:56:12.475178 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-dd4b633e-e21e-4094-87a0-1efdf21b1246 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f32f5fba1976432d938e664c7714e52b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b9d4c236b944f9b2e8e502a50a8f8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:56:12.496179 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-dd4b633e-e21e-4094-87a0-1efdf21b1246 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] 10.222.0.13 "GET /compute/v2.1/servers/58d02dff-26f6-4c2f-b886-cdbdccbfcec9" status: 200 len: 1262 microversion: 2.1 time: 0.169061 Nov 01 18:56:12.497252 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 267/520] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:56:12 2022] GET /compute/v2.1/servers/58d02dff-26f6-4c2f-b886-cdbdccbfcec9 => generated 1262 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:56:12.503451 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-9db05e7e-43d3-4104-aa3c-cca8e897e99a tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:56:12.504346 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-9db05e7e-43d3-4104-aa3c-cca8e897e99a tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] [instance: 614eb691-9a9a-4ca0-933d-686d80cc0ef1] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:56:12.511809 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-9db05e7e-43d3-4104-aa3c-cca8e897e99a tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:12.512904 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-9db05e7e-43d3-4104-aa3c-cca8e897e99a tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:12.513605 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-9db05e7e-43d3-4104-aa3c-cca8e897e99a tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:12.514629 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-9db05e7e-43d3-4104-aa3c-cca8e897e99a tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:12.515449 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-9db05e7e-43d3-4104-aa3c-cca8e897e99a tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:12.516336 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-9db05e7e-43d3-4104-aa3c-cca8e897e99a tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:12.536193 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-61cdd654-7c38-431f-946c-22ab718f5891 tempest-QuotaClassesAdminTestJSON-1476877878 tempest-QuotaClassesAdminTestJSON-1476877878-project-admin] 10.222.0.13 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 290 microversion: 2.1 time: 0.501629 Nov 01 18:56:12.543576 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 254/521] 10.222.0.13 () {60 vars in 1206 bytes} [Tue Nov 1 18:56:12 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 290 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 18:56:12.548688 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-4d28b08d-e100-49f2-90f5-7be9505277b0 tempest-QuotaClassesAdminTestJSON-1476877878 tempest-QuotaClassesAdminTestJSON-1476877878-project-admin] Calling method '.version_select at 0x7f0ae2a9dee0>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:56:12.570414 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-4d28b08d-e100-49f2-90f5-7be9505277b0 tempest-QuotaClassesAdminTestJSON-1476877878 tempest-QuotaClassesAdminTestJSON-1476877878-project-admin] 10.222.0.13 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 307 microversion: 2.1 time: 0.023840 Nov 01 18:56:12.572630 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 255/522] 10.222.0.13 () {58 vars in 1185 bytes} [Tue Nov 1 18:56:12 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 307 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 18:56:12.586186 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-cbac7d7a-1554-472b-a6a0-e00695185a26 tempest-QuotaClassesAdminTestJSON-1476877878 tempest-QuotaClassesAdminTestJSON-1476877878-project-admin] Action: 'update', calling method: .version_select at 0x7f0ae2a94700>, body: {"quota_class_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1}} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 18:56:12.629494 n-d-863052-2 devstack@n-api.service[121403]: DEBUG dbcounter [-] [121403] Writing DB stats nova_api:SELECT=74,nova_api:UPDATE=14,nova_api:INSERT=12 {{(pid=121403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 18:56:12.727316 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-cbac7d7a-1554-472b-a6a0-e00695185a26 tempest-QuotaClassesAdminTestJSON-1476877878 tempest-QuotaClassesAdminTestJSON-1476877878-project-admin] 10.222.0.13 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 286 microversion: 2.1 time: 0.140807 Nov 01 18:56:12.728296 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 256/523] 10.222.0.13 () {60 vars in 1206 bytes} [Tue Nov 1 18:56:12 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 286 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 18:56:12.733397 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-eda7347f-ec08-4060-ac5c-e48ba98fe7ae tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:56:12.734238 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-eda7347f-ec08-4060-ac5c-e48ba98fe7ae tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] [instance: 2d3a927e-a478-40b1-8c92-80396c82f76c] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:56:12.747529 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-eda7347f-ec08-4060-ac5c-e48ba98fe7ae tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:12.747529 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-eda7347f-ec08-4060-ac5c-e48ba98fe7ae tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:12.747529 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-eda7347f-ec08-4060-ac5c-e48ba98fe7ae tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:12.747529 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-eda7347f-ec08-4060-ac5c-e48ba98fe7ae tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:12.747850 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-eda7347f-ec08-4060-ac5c-e48ba98fe7ae tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:12.747850 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-eda7347f-ec08-4060-ac5c-e48ba98fe7ae tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:13.002914 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-eda7347f-ec08-4060-ac5c-e48ba98fe7ae tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:56:13.012371 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-eda7347f-ec08-4060-ac5c-e48ba98fe7ae tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:56:13.013817 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-eda7347f-ec08-4060-ac5c-e48ba98fe7ae tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:56:13.015381 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-eda7347f-ec08-4060-ac5c-e48ba98fe7ae tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] 10.222.0.13 "GET /compute/v2.1/servers/2d3a927e-a478-40b1-8c92-80396c82f76c" status: 200 len: 1567 microversion: 2.25 time: 0.285962 Nov 01 18:56:13.016322 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 257/524] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 18:56:12 2022] GET /compute/v2.1/servers/2d3a927e-a478-40b1-8c92-80396c82f76c => generated 1567 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 18:56:13.022909 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-22d896a0-2046-478d-a222-610afe58ad4a tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:56:13.023680 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-22d896a0-2046-478d-a222-610afe58ad4a tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] [instance: ea631032-dd04-429b-988e-e6362ea42cf7] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:56:13.029983 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-22d896a0-2046-478d-a222-610afe58ad4a tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:13.030472 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-22d896a0-2046-478d-a222-610afe58ad4a tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:13.030913 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-22d896a0-2046-478d-a222-610afe58ad4a tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:13.031604 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-22d896a0-2046-478d-a222-610afe58ad4a tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:13.032060 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-22d896a0-2046-478d-a222-610afe58ad4a tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:13.032536 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-22d896a0-2046-478d-a222-610afe58ad4a tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:13.110697 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-22d896a0-2046-478d-a222-610afe58ad4a tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c1314c21d8547ff890ede1c2ad281c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c804370880454c7aa02cef2c2c3cf144', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:56:13.120016 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-22d896a0-2046-478d-a222-610afe58ad4a tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c1314c21d8547ff890ede1c2ad281c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c804370880454c7aa02cef2c2c3cf144', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:56:13.121721 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-22d896a0-2046-478d-a222-610afe58ad4a tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c1314c21d8547ff890ede1c2ad281c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c804370880454c7aa02cef2c2c3cf144', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:56:13.128073 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-22d896a0-2046-478d-a222-610afe58ad4a tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] 10.222.0.13 "GET /compute/v2.1/servers/ea631032-dd04-429b-988e-e6362ea42cf7" status: 200 len: 1531 microversion: 2.91 time: 0.109272 Nov 01 18:56:13.128887 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 258/525] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 18:56:13 2022] GET /compute/v2.1/servers/ea631032-dd04-429b-988e-e6362ea42cf7 => generated 1531 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 18:56:13.133590 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-f547f19e-1d61-4c69-a240-d98263c268fa tempest-ServerDiagnosticsNegativeTest-50806246 tempest-ServerDiagnosticsNegativeTest-50806246-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:56:13.134199 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-f547f19e-1d61-4c69-a240-d98263c268fa tempest-ServerDiagnosticsNegativeTest-50806246 tempest-ServerDiagnosticsNegativeTest-50806246-project] [instance: 7fe37e78-fffe-4261-b0cd-be9037a208d5] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:56:13.157585 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f547f19e-1d61-4c69-a240-d98263c268fa tempest-ServerDiagnosticsNegativeTest-50806246 tempest-ServerDiagnosticsNegativeTest-50806246-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:13.158299 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f547f19e-1d61-4c69-a240-d98263c268fa tempest-ServerDiagnosticsNegativeTest-50806246 tempest-ServerDiagnosticsNegativeTest-50806246-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:13.158748 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f547f19e-1d61-4c69-a240-d98263c268fa tempest-ServerDiagnosticsNegativeTest-50806246 tempest-ServerDiagnosticsNegativeTest-50806246-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:13.159455 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f547f19e-1d61-4c69-a240-d98263c268fa tempest-ServerDiagnosticsNegativeTest-50806246 tempest-ServerDiagnosticsNegativeTest-50806246-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:13.160436 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f547f19e-1d61-4c69-a240-d98263c268fa tempest-ServerDiagnosticsNegativeTest-50806246 tempest-ServerDiagnosticsNegativeTest-50806246-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:13.160906 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f547f19e-1d61-4c69-a240-d98263c268fa tempest-ServerDiagnosticsNegativeTest-50806246 tempest-ServerDiagnosticsNegativeTest-50806246-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:13.406282 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-f547f19e-1d61-4c69-a240-d98263c268fa tempest-ServerDiagnosticsNegativeTest-50806246 tempest-ServerDiagnosticsNegativeTest-50806246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8087408d8b947f8b603fdeaee878fee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '741e5c81bd1d4383a5faff2e2a3dbbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:56:13.409790 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-9db05e7e-43d3-4104-aa3c-cca8e897e99a tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72117f17294649d6b8bc16c66c7efab2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45d4c047d3c44324a27a27831236ab0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:56:13.419008 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-f547f19e-1d61-4c69-a240-d98263c268fa tempest-ServerDiagnosticsNegativeTest-50806246 tempest-ServerDiagnosticsNegativeTest-50806246-project] 10.222.0.13 "GET /compute/v2.1/servers/7fe37e78-fffe-4261-b0cd-be9037a208d5" status: 200 len: 1323 microversion: 2.1 time: 0.289239 Nov 01 18:56:13.421118 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 259/526] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:56:13 2022] GET /compute/v2.1/servers/7fe37e78-fffe-4261-b0cd-be9037a208d5 => generated 1323 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:56:13.431438 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-9db05e7e-43d3-4104-aa3c-cca8e897e99a tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] 10.222.0.13 "GET /compute/v2.1/servers/614eb691-9a9a-4ca0-933d-686d80cc0ef1" status: 200 len: 1312 microversion: 2.1 time: 0.925684 Nov 01 18:56:13.431438 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 268/527] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:56:12 2022] GET /compute/v2.1/servers/614eb691-9a9a-4ca0-933d-686d80cc0ef1 => generated 1312 bytes in 933 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:56:13.440703 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [req-da47c327-4c3a-4aa5-8bd5-f669b4913c5d req-021a582e-3424-4af3-9e7d-88a058265401 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "614eb691-9a9a-4ca0-933d-686d80cc0ef1", "name": "network-vif-plugged", "status": "completed", "tag": "1c1a6351-a4fe-4a16-830e-df55738ac180"}]} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 18:56:13.454085 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-da47c327-4c3a-4aa5-8bd5-f669b4913c5d req-021a582e-3424-4af3-9e7d-88a058265401 service nova] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:13.454892 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-da47c327-4c3a-4aa5-8bd5-f669b4913c5d req-021a582e-3424-4af3-9e7d-88a058265401 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:13.455577 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-da47c327-4c3a-4aa5-8bd5-f669b4913c5d req-021a582e-3424-4af3-9e7d-88a058265401 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:13.489185 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.compute.server_external_events [req-da47c327-4c3a-4aa5-8bd5-f669b4913c5d req-021a582e-3424-4af3-9e7d-88a058265401 service nova] Creating event network-vif-plugged:1c1a6351-a4fe-4a16-830e-df55738ac180 for instance 614eb691-9a9a-4ca0-933d-686d80cc0ef1 on n-h2-863052-2 Nov 01 18:56:13.505425 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [req-da47c327-4c3a-4aa5-8bd5-f669b4913c5d req-021a582e-3424-4af3-9e7d-88a058265401 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072832 Nov 01 18:56:13.506860 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 269/528] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Nov 1 18:56:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 18:56:13.515110 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-3f1184d2-0fb8-4c83-a426-949bc4fda303 tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:56:13.516052 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-3f1184d2-0fb8-4c83-a426-949bc4fda303 tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] [instance: ab3530ff-d70f-4c6c-abd0-3afa14fd9954] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:56:13.534761 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-3f1184d2-0fb8-4c83-a426-949bc4fda303 tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:13.535269 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-3f1184d2-0fb8-4c83-a426-949bc4fda303 tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:13.535710 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-3f1184d2-0fb8-4c83-a426-949bc4fda303 tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:13.536421 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-3f1184d2-0fb8-4c83-a426-949bc4fda303 tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:13.544466 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-3f1184d2-0fb8-4c83-a426-949bc4fda303 tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:13.544991 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-3f1184d2-0fb8-4c83-a426-949bc4fda303 tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:13.801827 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-27803a42-2621-40dd-9ee4-e62cdade67e1 tempest-UnshelveToHostMultiNodesTest-2124505700 tempest-UnshelveToHostMultiNodesTest-2124505700-project-admin] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:56:13.802450 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-27803a42-2621-40dd-9ee4-e62cdade67e1 tempest-UnshelveToHostMultiNodesTest-2124505700 tempest-UnshelveToHostMultiNodesTest-2124505700-project-admin] [instance: ea631032-dd04-429b-988e-e6362ea42cf7] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:56:13.813236 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-27803a42-2621-40dd-9ee4-e62cdade67e1 tempest-UnshelveToHostMultiNodesTest-2124505700 tempest-UnshelveToHostMultiNodesTest-2124505700-project-admin] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:13.813810 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-27803a42-2621-40dd-9ee4-e62cdade67e1 tempest-UnshelveToHostMultiNodesTest-2124505700 tempest-UnshelveToHostMultiNodesTest-2124505700-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:13.814150 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-27803a42-2621-40dd-9ee4-e62cdade67e1 tempest-UnshelveToHostMultiNodesTest-2124505700 tempest-UnshelveToHostMultiNodesTest-2124505700-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:13.814851 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-27803a42-2621-40dd-9ee4-e62cdade67e1 tempest-UnshelveToHostMultiNodesTest-2124505700 tempest-UnshelveToHostMultiNodesTest-2124505700-project-admin] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:13.818189 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-27803a42-2621-40dd-9ee4-e62cdade67e1 tempest-UnshelveToHostMultiNodesTest-2124505700 tempest-UnshelveToHostMultiNodesTest-2124505700-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:13.819624 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-27803a42-2621-40dd-9ee4-e62cdade67e1 tempest-UnshelveToHostMultiNodesTest-2124505700 tempest-UnshelveToHostMultiNodesTest-2124505700-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:13.965975 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-3f1184d2-0fb8-4c83-a426-949bc4fda303 tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07a2a96629f4baea6a3adfc4011ffe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9baf3860ba564f5c8dff93085b9aabe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:56:13.976343 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-3f1184d2-0fb8-4c83-a426-949bc4fda303 tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] 10.222.0.13 "GET /compute/v2.1/servers/ab3530ff-d70f-4c6c-abd0-3afa14fd9954" status: 200 len: 1389 microversion: 2.1 time: 0.468048 Nov 01 18:56:13.977506 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 270/529] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:56:13 2022] GET /compute/v2.1/servers/ab3530ff-d70f-4c6c-abd0-3afa14fd9954 => generated 1389 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:56:13.996318 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-fa419387-f910-4ff7-b7a2-87329a96dcde tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:56:13.997254 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-fa419387-f910-4ff7-b7a2-87329a96dcde tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] [instance: 58d02dff-26f6-4c2f-b886-cdbdccbfcec9] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:56:14.009407 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-fa419387-f910-4ff7-b7a2-87329a96dcde tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:14.009904 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-fa419387-f910-4ff7-b7a2-87329a96dcde tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:14.010332 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-fa419387-f910-4ff7-b7a2-87329a96dcde tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:14.011211 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-fa419387-f910-4ff7-b7a2-87329a96dcde tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:14.011672 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-fa419387-f910-4ff7-b7a2-87329a96dcde tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:14.012090 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-fa419387-f910-4ff7-b7a2-87329a96dcde tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:14.161617 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-fa419387-f910-4ff7-b7a2-87329a96dcde tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f32f5fba1976432d938e664c7714e52b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b9d4c236b944f9b2e8e502a50a8f8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:56:14.174231 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-fa419387-f910-4ff7-b7a2-87329a96dcde tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] 10.222.0.13 "GET /compute/v2.1/servers/58d02dff-26f6-4c2f-b886-cdbdccbfcec9" status: 200 len: 1268 microversion: 2.1 time: 0.195408 Nov 01 18:56:14.190183 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 271/530] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:56:13 2022] GET /compute/v2.1/servers/58d02dff-26f6-4c2f-b886-cdbdccbfcec9 => generated 1268 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:56:14.196888 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-3fbe1443-1cef-417c-a954-7001e55f102b tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:56:14.197737 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-3fbe1443-1cef-417c-a954-7001e55f102b tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] [instance: 2d3a927e-a478-40b1-8c92-80396c82f76c] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:56:14.207655 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-3fbe1443-1cef-417c-a954-7001e55f102b tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:14.209806 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-3fbe1443-1cef-417c-a954-7001e55f102b tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:14.210990 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-3fbe1443-1cef-417c-a954-7001e55f102b tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:14.212182 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-3fbe1443-1cef-417c-a954-7001e55f102b tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:14.213289 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-3fbe1443-1cef-417c-a954-7001e55f102b tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:14.214035 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-3fbe1443-1cef-417c-a954-7001e55f102b tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:14.238050 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.objects.instance [None req-27803a42-2621-40dd-9ee4-e62cdade67e1 tempest-UnshelveToHostMultiNodesTest-2124505700 tempest-UnshelveToHostMultiNodesTest-2124505700-project-admin] Lazy-loading 'services' on Instance uuid ea631032-dd04-429b-988e-e6362ea42cf7 {{(pid=121403) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 01 18:56:14.288318 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-27803a42-2621-40dd-9ee4-e62cdade67e1 tempest-UnshelveToHostMultiNodesTest-2124505700 tempest-UnshelveToHostMultiNodesTest-2124505700-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/ea631032-dd04-429b-988e-e6362ea42cf7" status: 200 len: 1936 microversion: 2.91 time: 0.860443 Nov 01 18:56:14.292035 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 260/531] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 18:56:13 2022] GET /compute/v2.1/servers/ea631032-dd04-429b-988e-e6362ea42cf7 => generated 1936 bytes in 870 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 18:56:14.327120 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-40ab84f5-5776-4383-9945-368088ad82a0 tempest-UnshelveToHostMultiNodesTest-2124505700 tempest-UnshelveToHostMultiNodesTest-2124505700-project-admin] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:56:14.328512 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-40ab84f5-5776-4383-9945-368088ad82a0 tempest-UnshelveToHostMultiNodesTest-2124505700 tempest-UnshelveToHostMultiNodesTest-2124505700-project-admin] [instance: ea631032-dd04-429b-988e-e6362ea42cf7] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:56:14.340532 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-40ab84f5-5776-4383-9945-368088ad82a0 tempest-UnshelveToHostMultiNodesTest-2124505700 tempest-UnshelveToHostMultiNodesTest-2124505700-project-admin] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:14.341126 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-40ab84f5-5776-4383-9945-368088ad82a0 tempest-UnshelveToHostMultiNodesTest-2124505700 tempest-UnshelveToHostMultiNodesTest-2124505700-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:14.341572 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-40ab84f5-5776-4383-9945-368088ad82a0 tempest-UnshelveToHostMultiNodesTest-2124505700 tempest-UnshelveToHostMultiNodesTest-2124505700-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:14.343166 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-40ab84f5-5776-4383-9945-368088ad82a0 tempest-UnshelveToHostMultiNodesTest-2124505700 tempest-UnshelveToHostMultiNodesTest-2124505700-project-admin] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:14.343958 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-40ab84f5-5776-4383-9945-368088ad82a0 tempest-UnshelveToHostMultiNodesTest-2124505700 tempest-UnshelveToHostMultiNodesTest-2124505700-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:14.344500 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-40ab84f5-5776-4383-9945-368088ad82a0 tempest-UnshelveToHostMultiNodesTest-2124505700 tempest-UnshelveToHostMultiNodesTest-2124505700-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:14.507292 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.objects.instance [None req-40ab84f5-5776-4383-9945-368088ad82a0 tempest-UnshelveToHostMultiNodesTest-2124505700 tempest-UnshelveToHostMultiNodesTest-2124505700-project-admin] Lazy-loading 'services' on Instance uuid ea631032-dd04-429b-988e-e6362ea42cf7 {{(pid=121403) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 01 18:56:14.526837 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-40ab84f5-5776-4383-9945-368088ad82a0 tempest-UnshelveToHostMultiNodesTest-2124505700 tempest-UnshelveToHostMultiNodesTest-2124505700-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/ea631032-dd04-429b-988e-e6362ea42cf7" status: 200 len: 1936 microversion: 2.91 time: 0.204834 Nov 01 18:56:14.527755 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 261/532] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 18:56:14 2022] GET /compute/v2.1/servers/ea631032-dd04-429b-988e-e6362ea42cf7 => generated 1936 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 01 18:56:14.545962 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-820978fe-19e3-4dd1-b166-82f53a3789fc tempest-ServerDiagnosticsNegativeTest-50806246 tempest-ServerDiagnosticsNegativeTest-50806246-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:56:14.550451 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-820978fe-19e3-4dd1-b166-82f53a3789fc tempest-ServerDiagnosticsNegativeTest-50806246 tempest-ServerDiagnosticsNegativeTest-50806246-project] [instance: 7fe37e78-fffe-4261-b0cd-be9037a208d5] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:56:14.561467 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-820978fe-19e3-4dd1-b166-82f53a3789fc tempest-ServerDiagnosticsNegativeTest-50806246 tempest-ServerDiagnosticsNegativeTest-50806246-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:14.561948 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-820978fe-19e3-4dd1-b166-82f53a3789fc tempest-ServerDiagnosticsNegativeTest-50806246 tempest-ServerDiagnosticsNegativeTest-50806246-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:14.566740 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-820978fe-19e3-4dd1-b166-82f53a3789fc tempest-ServerDiagnosticsNegativeTest-50806246 tempest-ServerDiagnosticsNegativeTest-50806246-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:14.567992 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-820978fe-19e3-4dd1-b166-82f53a3789fc tempest-ServerDiagnosticsNegativeTest-50806246 tempest-ServerDiagnosticsNegativeTest-50806246-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:14.567992 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-820978fe-19e3-4dd1-b166-82f53a3789fc tempest-ServerDiagnosticsNegativeTest-50806246 tempest-ServerDiagnosticsNegativeTest-50806246-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:14.568471 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-820978fe-19e3-4dd1-b166-82f53a3789fc tempest-ServerDiagnosticsNegativeTest-50806246 tempest-ServerDiagnosticsNegativeTest-50806246-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:14.765102 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-3fbe1443-1cef-417c-a954-7001e55f102b tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:56:14.789282 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-3fbe1443-1cef-417c-a954-7001e55f102b tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:56:14.791044 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-3fbe1443-1cef-417c-a954-7001e55f102b tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:56:14.792314 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-3fbe1443-1cef-417c-a954-7001e55f102b tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] 10.222.0.13 "GET /compute/v2.1/servers/2d3a927e-a478-40b1-8c92-80396c82f76c" status: 200 len: 1567 microversion: 2.25 time: 0.600824 Nov 01 18:56:14.810434 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 272/533] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 18:56:14 2022] GET /compute/v2.1/servers/2d3a927e-a478-40b1-8c92-80396c82f76c => generated 1567 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 18:56:14.816308 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-820978fe-19e3-4dd1-b166-82f53a3789fc tempest-ServerDiagnosticsNegativeTest-50806246 tempest-ServerDiagnosticsNegativeTest-50806246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8087408d8b947f8b603fdeaee878fee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '741e5c81bd1d4383a5faff2e2a3dbbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:56:14.823886 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-3f966d8f-b02a-4091-b4bd-8b12f2fc88ad tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:56:14.824752 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-3f966d8f-b02a-4091-b4bd-8b12f2fc88ad tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] [instance: 614eb691-9a9a-4ca0-933d-686d80cc0ef1] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:56:14.825151 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-820978fe-19e3-4dd1-b166-82f53a3789fc tempest-ServerDiagnosticsNegativeTest-50806246 tempest-ServerDiagnosticsNegativeTest-50806246-project] 10.222.0.13 "GET /compute/v2.1/servers/7fe37e78-fffe-4261-b0cd-be9037a208d5" status: 200 len: 1323 microversion: 2.1 time: 0.296279 Nov 01 18:56:14.836460 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-3f966d8f-b02a-4091-b4bd-8b12f2fc88ad tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:14.837131 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 262/534] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:56:14 2022] GET /compute/v2.1/servers/7fe37e78-fffe-4261-b0cd-be9037a208d5 => generated 1323 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:56:14.837792 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-3f966d8f-b02a-4091-b4bd-8b12f2fc88ad tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:14.838398 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-3f966d8f-b02a-4091-b4bd-8b12f2fc88ad tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:14.839282 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-3f966d8f-b02a-4091-b4bd-8b12f2fc88ad tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:14.839886 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-3f966d8f-b02a-4091-b4bd-8b12f2fc88ad tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:14.840640 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-3f966d8f-b02a-4091-b4bd-8b12f2fc88ad tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:14.845532 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-250b5574-c88a-437a-9510-90549a84b1b2 tempest-UnshelveToHostMultiNodesTest-2124505700 tempest-UnshelveToHostMultiNodesTest-2124505700-project-admin] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:56:14.849450 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-250b5574-c88a-437a-9510-90549a84b1b2 tempest-UnshelveToHostMultiNodesTest-2124505700 tempest-UnshelveToHostMultiNodesTest-2124505700-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:14.850451 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-250b5574-c88a-437a-9510-90549a84b1b2 tempest-UnshelveToHostMultiNodesTest-2124505700 tempest-UnshelveToHostMultiNodesTest-2124505700-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:14.850887 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-250b5574-c88a-437a-9510-90549a84b1b2 tempest-UnshelveToHostMultiNodesTest-2124505700 tempest-UnshelveToHostMultiNodesTest-2124505700-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:14.851608 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-250b5574-c88a-437a-9510-90549a84b1b2 tempest-UnshelveToHostMultiNodesTest-2124505700 tempest-UnshelveToHostMultiNodesTest-2124505700-project-admin] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:14.852056 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-250b5574-c88a-437a-9510-90549a84b1b2 tempest-UnshelveToHostMultiNodesTest-2124505700 tempest-UnshelveToHostMultiNodesTest-2124505700-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:14.852478 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-250b5574-c88a-437a-9510-90549a84b1b2 tempest-UnshelveToHostMultiNodesTest-2124505700 tempest-UnshelveToHostMultiNodesTest-2124505700-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:14.882600 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-250b5574-c88a-437a-9510-90549a84b1b2 tempest-UnshelveToHostMultiNodesTest-2124505700 tempest-UnshelveToHostMultiNodesTest-2124505700-project-admin] 10.222.0.13 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 498 microversion: 2.91 time: 0.044265 Nov 01 18:56:14.890926 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 263/535] 10.222.0.13 () {60 vars in 1217 bytes} [Tue Nov 1 18:56:14 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 498 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 01 18:56:14.895904 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-71101b7a-bc2f-43ee-9313-4103eeeac85c tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 18:56:14.896491 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-71101b7a-bc2f-43ee-9313-4103eeeac85c tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] [instance: ea631032-dd04-429b-988e-e6362ea42cf7] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:56:14.904176 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-71101b7a-bc2f-43ee-9313-4103eeeac85c tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:14.904784 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-71101b7a-bc2f-43ee-9313-4103eeeac85c tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:14.905341 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-71101b7a-bc2f-43ee-9313-4103eeeac85c tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:14.906130 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-71101b7a-bc2f-43ee-9313-4103eeeac85c tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:14.906667 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-71101b7a-bc2f-43ee-9313-4103eeeac85c tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:14.907298 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-71101b7a-bc2f-43ee-9313-4103eeeac85c tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:14.927625 n-d-863052-2 devstack@n-api.service[121403]: DEBUG dbcounter [-] [121403] Writing DB stats nova_cell1:SELECT=100 {{(pid=121403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 18:56:14.937997 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.objects.instance [None req-71101b7a-bc2f-43ee-9313-4103eeeac85c tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lazy-loading 'flavor' on Instance uuid ea631032-dd04-429b-988e-e6362ea42cf7 {{(pid=121403) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 01 18:56:15.155634 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-3f966d8f-b02a-4091-b4bd-8b12f2fc88ad tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72117f17294649d6b8bc16c66c7efab2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45d4c047d3c44324a27a27831236ab0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:56:15.168370 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-3f966d8f-b02a-4091-b4bd-8b12f2fc88ad tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] 10.222.0.13 "GET /compute/v2.1/servers/614eb691-9a9a-4ca0-933d-686d80cc0ef1" status: 200 len: 1312 microversion: 2.1 time: 0.356332 Nov 01 18:56:15.182263 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 273/536] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:56:14 2022] GET /compute/v2.1/servers/614eb691-9a9a-4ca0-933d-686d80cc0ef1 => generated 1312 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:56:15.190713 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-05e08b0f-0c56-4109-9ffd-f7f0475e4960 tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:56:15.191336 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-05e08b0f-0c56-4109-9ffd-f7f0475e4960 tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] [instance: ab3530ff-d70f-4c6c-abd0-3afa14fd9954] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:56:15.210084 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-05e08b0f-0c56-4109-9ffd-f7f0475e4960 tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:15.211971 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-05e08b0f-0c56-4109-9ffd-f7f0475e4960 tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:15.213543 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-05e08b0f-0c56-4109-9ffd-f7f0475e4960 tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:15.228211 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-05e08b0f-0c56-4109-9ffd-f7f0475e4960 tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:15.229135 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-05e08b0f-0c56-4109-9ffd-f7f0475e4960 tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:15.230922 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-05e08b0f-0c56-4109-9ffd-f7f0475e4960 tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:15.443965 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-71101b7a-bc2f-43ee-9313-4103eeeac85c tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] 10.222.0.13 "POST /compute/v2.1/servers/ea631032-dd04-429b-988e-e6362ea42cf7/action" status: 202 len: 0 microversion: 2.91 time: 0.551214 Nov 01 18:56:15.449000 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 264/537] 10.222.0.13 () {62 vars in 1319 bytes} [Tue Nov 1 18:56:14 2022] POST /compute/v2.1/servers/ea631032-dd04-429b-988e-e6362ea42cf7/action => generated 0 bytes in 557 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 01 18:56:15.455856 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-e437d50c-65e7-4ffe-ba48-b800c5f43ebc tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:56:15.456856 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-e437d50c-65e7-4ffe-ba48-b800c5f43ebc tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] [instance: 58d02dff-26f6-4c2f-b886-cdbdccbfcec9] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:56:15.465987 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-e437d50c-65e7-4ffe-ba48-b800c5f43ebc tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:15.466871 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-e437d50c-65e7-4ffe-ba48-b800c5f43ebc tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:15.467516 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-e437d50c-65e7-4ffe-ba48-b800c5f43ebc tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:15.468427 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-e437d50c-65e7-4ffe-ba48-b800c5f43ebc tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:15.469201 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-e437d50c-65e7-4ffe-ba48-b800c5f43ebc tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:15.469825 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-e437d50c-65e7-4ffe-ba48-b800c5f43ebc tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:15.774696 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-05e08b0f-0c56-4109-9ffd-f7f0475e4960 tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07a2a96629f4baea6a3adfc4011ffe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9baf3860ba564f5c8dff93085b9aabe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:56:15.789197 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-05e08b0f-0c56-4109-9ffd-f7f0475e4960 tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] 10.222.0.13 "GET /compute/v2.1/servers/ab3530ff-d70f-4c6c-abd0-3afa14fd9954" status: 200 len: 1389 microversion: 2.1 time: 0.605747 Nov 01 18:56:15.793460 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 274/538] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:56:15 2022] GET /compute/v2.1/servers/ab3530ff-d70f-4c6c-abd0-3afa14fd9954 => generated 1389 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:56:15.804289 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-d42360dd-7e09-40fe-bc56-4dbf52bafd1a tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:56:15.805164 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-d42360dd-7e09-40fe-bc56-4dbf52bafd1a tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] [instance: ea631032-dd04-429b-988e-e6362ea42cf7] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:56:15.832127 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-d42360dd-7e09-40fe-bc56-4dbf52bafd1a tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:15.833568 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-d42360dd-7e09-40fe-bc56-4dbf52bafd1a tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:15.834859 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-d42360dd-7e09-40fe-bc56-4dbf52bafd1a tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:15.835650 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-d42360dd-7e09-40fe-bc56-4dbf52bafd1a tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:15.836319 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-d42360dd-7e09-40fe-bc56-4dbf52bafd1a tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:15.836994 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-d42360dd-7e09-40fe-bc56-4dbf52bafd1a tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:15.949622 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-d42360dd-7e09-40fe-bc56-4dbf52bafd1a tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c1314c21d8547ff890ede1c2ad281c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c804370880454c7aa02cef2c2c3cf144', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:56:15.960956 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-d42360dd-7e09-40fe-bc56-4dbf52bafd1a tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c1314c21d8547ff890ede1c2ad281c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c804370880454c7aa02cef2c2c3cf144', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:56:15.963279 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-d42360dd-7e09-40fe-bc56-4dbf52bafd1a tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c1314c21d8547ff890ede1c2ad281c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c804370880454c7aa02cef2c2c3cf144', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:56:15.971304 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-d42360dd-7e09-40fe-bc56-4dbf52bafd1a tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] 10.222.0.13 "GET /compute/v2.1/servers/ea631032-dd04-429b-988e-e6362ea42cf7" status: 200 len: 1537 microversion: 2.91 time: 0.176367 Nov 01 18:56:15.975317 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 275/539] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 18:56:15 2022] GET /compute/v2.1/servers/ea631032-dd04-429b-988e-e6362ea42cf7 => generated 1537 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 18:56:15.987507 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-8405a6e2-284c-4de0-8a85-7fcca8af3ccf tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:56:15.988456 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-8405a6e2-284c-4de0-8a85-7fcca8af3ccf tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] [instance: 2d3a927e-a478-40b1-8c92-80396c82f76c] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:56:15.998123 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-8405a6e2-284c-4de0-8a85-7fcca8af3ccf tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:15.998796 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-8405a6e2-284c-4de0-8a85-7fcca8af3ccf tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:15.999309 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-8405a6e2-284c-4de0-8a85-7fcca8af3ccf tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:16.000135 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-8405a6e2-284c-4de0-8a85-7fcca8af3ccf tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:16.000720 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-8405a6e2-284c-4de0-8a85-7fcca8af3ccf tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:16.001815 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-8405a6e2-284c-4de0-8a85-7fcca8af3ccf tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:16.026984 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-e437d50c-65e7-4ffe-ba48-b800c5f43ebc tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f32f5fba1976432d938e664c7714e52b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b9d4c236b944f9b2e8e502a50a8f8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:56:16.035424 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-e437d50c-65e7-4ffe-ba48-b800c5f43ebc tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] 10.222.0.13 "GET /compute/v2.1/servers/58d02dff-26f6-4c2f-b886-cdbdccbfcec9" status: 200 len: 1310 microversion: 2.1 time: 0.584846 Nov 01 18:56:16.036008 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 265/540] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:56:15 2022] GET /compute/v2.1/servers/58d02dff-26f6-4c2f-b886-cdbdccbfcec9 => generated 1310 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:56:16.050109 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-8236529b-f1c4-4789-8eed-915b2dad0c5b tempest-ServerDiagnosticsNegativeTest-50806246 tempest-ServerDiagnosticsNegativeTest-50806246-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:56:16.050760 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-8236529b-f1c4-4789-8eed-915b2dad0c5b tempest-ServerDiagnosticsNegativeTest-50806246 tempest-ServerDiagnosticsNegativeTest-50806246-project] [instance: 7fe37e78-fffe-4261-b0cd-be9037a208d5] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:56:16.068187 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-8236529b-f1c4-4789-8eed-915b2dad0c5b tempest-ServerDiagnosticsNegativeTest-50806246 tempest-ServerDiagnosticsNegativeTest-50806246-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:16.069822 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-8236529b-f1c4-4789-8eed-915b2dad0c5b tempest-ServerDiagnosticsNegativeTest-50806246 tempest-ServerDiagnosticsNegativeTest-50806246-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:16.070483 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-8236529b-f1c4-4789-8eed-915b2dad0c5b tempest-ServerDiagnosticsNegativeTest-50806246 tempest-ServerDiagnosticsNegativeTest-50806246-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:16.071406 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-8236529b-f1c4-4789-8eed-915b2dad0c5b tempest-ServerDiagnosticsNegativeTest-50806246 tempest-ServerDiagnosticsNegativeTest-50806246-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:16.072069 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-8236529b-f1c4-4789-8eed-915b2dad0c5b tempest-ServerDiagnosticsNegativeTest-50806246 tempest-ServerDiagnosticsNegativeTest-50806246-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:16.072745 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-8236529b-f1c4-4789-8eed-915b2dad0c5b tempest-ServerDiagnosticsNegativeTest-50806246 tempest-ServerDiagnosticsNegativeTest-50806246-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:16.353581 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-8405a6e2-284c-4de0-8a85-7fcca8af3ccf tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:56:16.356124 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-8405a6e2-284c-4de0-8a85-7fcca8af3ccf tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:56:16.357877 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-8405a6e2-284c-4de0-8a85-7fcca8af3ccf tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:56:16.359220 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-8405a6e2-284c-4de0-8a85-7fcca8af3ccf tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] 10.222.0.13 "GET /compute/v2.1/servers/2d3a927e-a478-40b1-8c92-80396c82f76c" status: 200 len: 1567 microversion: 2.25 time: 0.382735 Nov 01 18:56:16.360394 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 276/541] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 18:56:15 2022] GET /compute/v2.1/servers/2d3a927e-a478-40b1-8c92-80396c82f76c => generated 1567 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 18:56:16.366441 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-0e7697d6-91f1-4e02-b5f8-ff75705e9304 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:56:16.372956 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-0e7697d6-91f1-4e02-b5f8-ff75705e9304 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] [instance: 614eb691-9a9a-4ca0-933d-686d80cc0ef1] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:56:16.393611 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-0e7697d6-91f1-4e02-b5f8-ff75705e9304 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:16.394471 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-0e7697d6-91f1-4e02-b5f8-ff75705e9304 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:16.395164 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-0e7697d6-91f1-4e02-b5f8-ff75705e9304 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:16.397591 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-0e7697d6-91f1-4e02-b5f8-ff75705e9304 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:16.398255 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-0e7697d6-91f1-4e02-b5f8-ff75705e9304 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:16.400676 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-0e7697d6-91f1-4e02-b5f8-ff75705e9304 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:16.634549 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-8236529b-f1c4-4789-8eed-915b2dad0c5b tempest-ServerDiagnosticsNegativeTest-50806246 tempest-ServerDiagnosticsNegativeTest-50806246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8087408d8b947f8b603fdeaee878fee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '741e5c81bd1d4383a5faff2e2a3dbbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:56:16.650284 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-8236529b-f1c4-4789-8eed-915b2dad0c5b tempest-ServerDiagnosticsNegativeTest-50806246 tempest-ServerDiagnosticsNegativeTest-50806246-project] 10.222.0.13 "GET /compute/v2.1/servers/7fe37e78-fffe-4261-b0cd-be9037a208d5" status: 200 len: 1323 microversion: 2.1 time: 0.605941 Nov 01 18:56:16.651034 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 266/542] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:56:16 2022] GET /compute/v2.1/servers/7fe37e78-fffe-4261-b0cd-be9037a208d5 => generated 1323 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:56:16.803451 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-0e7697d6-91f1-4e02-b5f8-ff75705e9304 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72117f17294649d6b8bc16c66c7efab2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45d4c047d3c44324a27a27831236ab0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:56:16.816705 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-14536236-b0dd-4a27-9207-5cdff43149b6 tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:56:16.817322 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-14536236-b0dd-4a27-9207-5cdff43149b6 tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] [instance: ab3530ff-d70f-4c6c-abd0-3afa14fd9954] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:56:16.818755 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-0e7697d6-91f1-4e02-b5f8-ff75705e9304 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] 10.222.0.13 "GET /compute/v2.1/servers/614eb691-9a9a-4ca0-933d-686d80cc0ef1" status: 200 len: 1461 microversion: 2.1 time: 0.454548 Nov 01 18:56:16.819928 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 277/543] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:56:16 2022] GET /compute/v2.1/servers/614eb691-9a9a-4ca0-933d-686d80cc0ef1 => generated 1461 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:56:16.826191 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-14536236-b0dd-4a27-9207-5cdff43149b6 tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:16.826966 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-14536236-b0dd-4a27-9207-5cdff43149b6 tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:16.828023 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-14536236-b0dd-4a27-9207-5cdff43149b6 tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:16.829049 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-14536236-b0dd-4a27-9207-5cdff43149b6 tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:16.829706 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-14536236-b0dd-4a27-9207-5cdff43149b6 tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:16.830371 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-14536236-b0dd-4a27-9207-5cdff43149b6 tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:17.155021 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-14536236-b0dd-4a27-9207-5cdff43149b6 tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07a2a96629f4baea6a3adfc4011ffe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9baf3860ba564f5c8dff93085b9aabe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:56:17.167487 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-14536236-b0dd-4a27-9207-5cdff43149b6 tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] 10.222.0.13 "GET /compute/v2.1/servers/ab3530ff-d70f-4c6c-abd0-3afa14fd9954" status: 200 len: 1389 microversion: 2.1 time: 0.355459 Nov 01 18:56:17.169461 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 267/544] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:56:16 2022] GET /compute/v2.1/servers/ab3530ff-d70f-4c6c-abd0-3afa14fd9954 => generated 1389 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:56:17.184709 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-026b655f-a8b9-4479-a88e-bf9c67b203ea tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:56:17.185752 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-026b655f-a8b9-4479-a88e-bf9c67b203ea tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] [instance: ea631032-dd04-429b-988e-e6362ea42cf7] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:56:17.197136 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-026b655f-a8b9-4479-a88e-bf9c67b203ea tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:17.202249 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-026b655f-a8b9-4479-a88e-bf9c67b203ea tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:17.203419 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-026b655f-a8b9-4479-a88e-bf9c67b203ea tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:17.204163 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-026b655f-a8b9-4479-a88e-bf9c67b203ea tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:17.204652 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-026b655f-a8b9-4479-a88e-bf9c67b203ea tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:17.205082 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-026b655f-a8b9-4479-a88e-bf9c67b203ea tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:17.331368 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-026b655f-a8b9-4479-a88e-bf9c67b203ea tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c1314c21d8547ff890ede1c2ad281c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c804370880454c7aa02cef2c2c3cf144', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:56:17.361017 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-026b655f-a8b9-4479-a88e-bf9c67b203ea tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c1314c21d8547ff890ede1c2ad281c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c804370880454c7aa02cef2c2c3cf144', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:56:17.364095 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-026b655f-a8b9-4479-a88e-bf9c67b203ea tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c1314c21d8547ff890ede1c2ad281c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c804370880454c7aa02cef2c2c3cf144', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:56:17.385500 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-026b655f-a8b9-4479-a88e-bf9c67b203ea tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] 10.222.0.13 "GET /compute/v2.1/servers/ea631032-dd04-429b-988e-e6362ea42cf7" status: 200 len: 1537 microversion: 2.91 time: 0.210069 Nov 01 18:56:17.388123 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 268/545] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 18:56:17 2022] GET /compute/v2.1/servers/ea631032-dd04-429b-988e-e6362ea42cf7 => generated 1537 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 18:56:17.419802 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-4e121010-564f-462c-8165-285acb1b93b9 tempest-MigrationsAdminTest-1970194929 tempest-MigrationsAdminTest-1970194929-project-admin] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:56:17.420403 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-4e121010-564f-462c-8165-285acb1b93b9 tempest-MigrationsAdminTest-1970194929 tempest-MigrationsAdminTest-1970194929-project-admin] [instance: 614eb691-9a9a-4ca0-933d-686d80cc0ef1] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:56:17.439395 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-4e121010-564f-462c-8165-285acb1b93b9 tempest-MigrationsAdminTest-1970194929 tempest-MigrationsAdminTest-1970194929-project-admin] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:17.441578 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-4e121010-564f-462c-8165-285acb1b93b9 tempest-MigrationsAdminTest-1970194929 tempest-MigrationsAdminTest-1970194929-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:17.443343 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-d74a21aa-5095-4939-a1f3-cf781c277d50 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:56:17.444691 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-4e121010-564f-462c-8165-285acb1b93b9 tempest-MigrationsAdminTest-1970194929 tempest-MigrationsAdminTest-1970194929-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:17.446717 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-4e121010-564f-462c-8165-285acb1b93b9 tempest-MigrationsAdminTest-1970194929 tempest-MigrationsAdminTest-1970194929-project-admin] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:17.447602 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-4e121010-564f-462c-8165-285acb1b93b9 tempest-MigrationsAdminTest-1970194929 tempest-MigrationsAdminTest-1970194929-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:17.449407 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-d74a21aa-5095-4939-a1f3-cf781c277d50 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] [instance: 58d02dff-26f6-4c2f-b886-cdbdccbfcec9] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:56:17.452798 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-4e121010-564f-462c-8165-285acb1b93b9 tempest-MigrationsAdminTest-1970194929 tempest-MigrationsAdminTest-1970194929-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:17.470340 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d74a21aa-5095-4939-a1f3-cf781c277d50 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:17.478335 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d74a21aa-5095-4939-a1f3-cf781c277d50 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:17.483536 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d74a21aa-5095-4939-a1f3-cf781c277d50 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:17.484792 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d74a21aa-5095-4939-a1f3-cf781c277d50 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:17.486737 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d74a21aa-5095-4939-a1f3-cf781c277d50 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:17.487388 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d74a21aa-5095-4939-a1f3-cf781c277d50 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:17.911837 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-d74a21aa-5095-4939-a1f3-cf781c277d50 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f32f5fba1976432d938e664c7714e52b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b9d4c236b944f9b2e8e502a50a8f8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:56:17.928318 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-d74a21aa-5095-4939-a1f3-cf781c277d50 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] 10.222.0.13 "GET /compute/v2.1/servers/58d02dff-26f6-4c2f-b886-cdbdccbfcec9" status: 200 len: 1310 microversion: 2.1 time: 0.498069 Nov 01 18:56:17.928965 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 269/546] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:56:17 2022] GET /compute/v2.1/servers/58d02dff-26f6-4c2f-b886-cdbdccbfcec9 => generated 1310 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:56:17.945265 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [req-7228585f-a7e6-4ea1-9ddd-c822a4b3f7f2 req-35a81e06-e4a9-400f-b085-442d265e94d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7fe37e78-fffe-4261-b0cd-be9037a208d5", "name": "network-vif-plugged", "status": "completed", "tag": "2d4e964c-336f-49a7-86d8-bfcacbbee6b8"}]} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 18:56:17.957819 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-7228585f-a7e6-4ea1-9ddd-c822a4b3f7f2 req-35a81e06-e4a9-400f-b085-442d265e94d0 service nova] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:17.958595 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-7228585f-a7e6-4ea1-9ddd-c822a4b3f7f2 req-35a81e06-e4a9-400f-b085-442d265e94d0 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:17.958730 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-7228585f-a7e6-4ea1-9ddd-c822a4b3f7f2 req-35a81e06-e4a9-400f-b085-442d265e94d0 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:17.976127 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.compute.server_external_events [req-7228585f-a7e6-4ea1-9ddd-c822a4b3f7f2 req-35a81e06-e4a9-400f-b085-442d265e94d0 service nova] Creating event network-vif-plugged:2d4e964c-336f-49a7-86d8-bfcacbbee6b8 for instance 7fe37e78-fffe-4261-b0cd-be9037a208d5 on n-h1-863052-2 Nov 01 18:56:17.983576 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [req-7228585f-a7e6-4ea1-9ddd-c822a4b3f7f2 req-35a81e06-e4a9-400f-b085-442d265e94d0 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053384 Nov 01 18:56:17.984336 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 270/547] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Nov 1 18:56:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 18:56:17.989340 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-d12552a5-591c-4033-a9c6-3286d3b7f673 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:56:17.990114 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-d12552a5-591c-4033-a9c6-3286d3b7f673 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] [instance: 2d3a927e-a478-40b1-8c92-80396c82f76c] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:56:17.998508 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d12552a5-591c-4033-a9c6-3286d3b7f673 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:17.999102 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d12552a5-591c-4033-a9c6-3286d3b7f673 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:17.999423 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d12552a5-591c-4033-a9c6-3286d3b7f673 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:18.002592 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d12552a5-591c-4033-a9c6-3286d3b7f673 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:18.003058 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d12552a5-591c-4033-a9c6-3286d3b7f673 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:18.003495 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d12552a5-591c-4033-a9c6-3286d3b7f673 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:18.436824 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-4e121010-564f-462c-8165-285acb1b93b9 tempest-MigrationsAdminTest-1970194929 tempest-MigrationsAdminTest-1970194929-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/614eb691-9a9a-4ca0-933d-686d80cc0ef1" status: 200 len: 1612 microversion: 2.1 time: 1.573375 Nov 01 18:56:18.439094 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 278/548] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:56:16 2022] GET /compute/v2.1/servers/614eb691-9a9a-4ca0-933d-686d80cc0ef1 => generated 1612 bytes in 1577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 18:56:18.446142 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-995d649d-351e-4315-952b-c9d07aa7a34a tempest-ServerDiagnosticsNegativeTest-50806246 tempest-ServerDiagnosticsNegativeTest-50806246-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:56:18.446728 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-995d649d-351e-4315-952b-c9d07aa7a34a tempest-ServerDiagnosticsNegativeTest-50806246 tempest-ServerDiagnosticsNegativeTest-50806246-project] [instance: 7fe37e78-fffe-4261-b0cd-be9037a208d5] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:56:18.464483 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-995d649d-351e-4315-952b-c9d07aa7a34a tempest-ServerDiagnosticsNegativeTest-50806246 tempest-ServerDiagnosticsNegativeTest-50806246-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:18.468686 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-995d649d-351e-4315-952b-c9d07aa7a34a tempest-ServerDiagnosticsNegativeTest-50806246 tempest-ServerDiagnosticsNegativeTest-50806246-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:18.469292 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-995d649d-351e-4315-952b-c9d07aa7a34a tempest-ServerDiagnosticsNegativeTest-50806246 tempest-ServerDiagnosticsNegativeTest-50806246-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:18.470191 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-995d649d-351e-4315-952b-c9d07aa7a34a tempest-ServerDiagnosticsNegativeTest-50806246 tempest-ServerDiagnosticsNegativeTest-50806246-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:18.470660 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-995d649d-351e-4315-952b-c9d07aa7a34a tempest-ServerDiagnosticsNegativeTest-50806246 tempest-ServerDiagnosticsNegativeTest-50806246-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:18.471084 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-995d649d-351e-4315-952b-c9d07aa7a34a tempest-ServerDiagnosticsNegativeTest-50806246 tempest-ServerDiagnosticsNegativeTest-50806246-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:18.792288 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-995d649d-351e-4315-952b-c9d07aa7a34a tempest-ServerDiagnosticsNegativeTest-50806246 tempest-ServerDiagnosticsNegativeTest-50806246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8087408d8b947f8b603fdeaee878fee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '741e5c81bd1d4383a5faff2e2a3dbbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:56:18.806470 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-995d649d-351e-4315-952b-c9d07aa7a34a tempest-ServerDiagnosticsNegativeTest-50806246 tempest-ServerDiagnosticsNegativeTest-50806246-project] 10.222.0.13 "GET /compute/v2.1/servers/7fe37e78-fffe-4261-b0cd-be9037a208d5" status: 200 len: 1323 microversion: 2.1 time: 0.366164 Nov 01 18:56:18.809200 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 279/549] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:56:18 2022] GET /compute/v2.1/servers/7fe37e78-fffe-4261-b0cd-be9037a208d5 => generated 1323 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:56:18.825580 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [req-1c64886c-a75a-43a5-a890-76000bb97576 req-26d7329e-2512-427d-83a1-f30efa27b3a3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "58d02dff-26f6-4c2f-b886-cdbdccbfcec9", "tag": "8434dc9d-ed20-488e-a620-72caae7c1bd3"}]} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 18:56:18.848234 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-1c64886c-a75a-43a5-a890-76000bb97576 req-26d7329e-2512-427d-83a1-f30efa27b3a3 service nova] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:18.849699 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-1c64886c-a75a-43a5-a890-76000bb97576 req-26d7329e-2512-427d-83a1-f30efa27b3a3 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:18.850141 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-1c64886c-a75a-43a5-a890-76000bb97576 req-26d7329e-2512-427d-83a1-f30efa27b3a3 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:18.865901 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-d12552a5-591c-4033-a9c6-3286d3b7f673 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:56:18.879463 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.compute.server_external_events [req-1c64886c-a75a-43a5-a890-76000bb97576 req-26d7329e-2512-427d-83a1-f30efa27b3a3 service nova] Creating event network-changed:8434dc9d-ed20-488e-a620-72caae7c1bd3 for instance 58d02dff-26f6-4c2f-b886-cdbdccbfcec9 on n-h1-863052-2 Nov 01 18:56:18.882695 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-d12552a5-591c-4033-a9c6-3286d3b7f673 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:56:18.886291 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-d12552a5-591c-4033-a9c6-3286d3b7f673 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:56:18.890110 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-d12552a5-591c-4033-a9c6-3286d3b7f673 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] 10.222.0.13 "GET /compute/v2.1/servers/2d3a927e-a478-40b1-8c92-80396c82f76c" status: 200 len: 1567 microversion: 2.25 time: 0.903399 Nov 01 18:56:18.892526 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 271/550] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 18:56:17 2022] GET /compute/v2.1/servers/2d3a927e-a478-40b1-8c92-80396c82f76c => generated 1567 bytes in 908 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 18:56:18.893425 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [req-1c64886c-a75a-43a5-a890-76000bb97576 req-26d7329e-2512-427d-83a1-f30efa27b3a3 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069597 Nov 01 18:56:18.895926 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 280/551] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Nov 1 18:56:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 18:56:18.906502 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-366e7a72-dbf4-492f-bee6-6a034a626659 tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:56:18.920453 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-366e7a72-dbf4-492f-bee6-6a034a626659 tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] [instance: ab3530ff-d70f-4c6c-abd0-3afa14fd9954] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:56:18.921119 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-58cf9e65-a902-4406-b15a-ee87af2b568b tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:56:18.923318 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-58cf9e65-a902-4406-b15a-ee87af2b568b tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] [instance: ea631032-dd04-429b-988e-e6362ea42cf7] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:56:18.936116 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-58cf9e65-a902-4406-b15a-ee87af2b568b tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:18.936537 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-58cf9e65-a902-4406-b15a-ee87af2b568b tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:18.937003 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-58cf9e65-a902-4406-b15a-ee87af2b568b tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:18.937956 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-58cf9e65-a902-4406-b15a-ee87af2b568b tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:18.940313 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-58cf9e65-a902-4406-b15a-ee87af2b568b tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:18.940987 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-366e7a72-dbf4-492f-bee6-6a034a626659 tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:18.941735 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-366e7a72-dbf4-492f-bee6-6a034a626659 tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:18.945077 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-58cf9e65-a902-4406-b15a-ee87af2b568b tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:18.945594 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-366e7a72-dbf4-492f-bee6-6a034a626659 tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:18.948176 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-366e7a72-dbf4-492f-bee6-6a034a626659 tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:18.950316 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-366e7a72-dbf4-492f-bee6-6a034a626659 tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:18.951517 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-366e7a72-dbf4-492f-bee6-6a034a626659 tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:19.064618 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-58cf9e65-a902-4406-b15a-ee87af2b568b tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c1314c21d8547ff890ede1c2ad281c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c804370880454c7aa02cef2c2c3cf144', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:56:19.082084 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-58cf9e65-a902-4406-b15a-ee87af2b568b tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c1314c21d8547ff890ede1c2ad281c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c804370880454c7aa02cef2c2c3cf144', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:56:19.084207 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-58cf9e65-a902-4406-b15a-ee87af2b568b tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c1314c21d8547ff890ede1c2ad281c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c804370880454c7aa02cef2c2c3cf144', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:56:19.098492 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-58cf9e65-a902-4406-b15a-ee87af2b568b tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] 10.222.0.13 "GET /compute/v2.1/servers/ea631032-dd04-429b-988e-e6362ea42cf7" status: 200 len: 1537 microversion: 2.91 time: 0.197854 Nov 01 18:56:19.104683 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 281/552] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 18:56:18 2022] GET /compute/v2.1/servers/ea631032-dd04-429b-988e-e6362ea42cf7 => generated 1537 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 18:56:19.105943 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-9210213c-97fb-4cff-88c8-4adbb03dc1ac tempest-MigrationsAdminTest-1970194929 tempest-MigrationsAdminTest-1970194929-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 18:56:19.106693 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-9210213c-97fb-4cff-88c8-4adbb03dc1ac tempest-MigrationsAdminTest-1970194929 tempest-MigrationsAdminTest-1970194929-project-admin] [instance: 614eb691-9a9a-4ca0-933d-686d80cc0ef1] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:56:19.115003 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-9210213c-97fb-4cff-88c8-4adbb03dc1ac tempest-MigrationsAdminTest-1970194929 tempest-MigrationsAdminTest-1970194929-project-admin] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:19.116307 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-9210213c-97fb-4cff-88c8-4adbb03dc1ac tempest-MigrationsAdminTest-1970194929 tempest-MigrationsAdminTest-1970194929-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:19.117427 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-9210213c-97fb-4cff-88c8-4adbb03dc1ac tempest-MigrationsAdminTest-1970194929 tempest-MigrationsAdminTest-1970194929-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:19.119466 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-9210213c-97fb-4cff-88c8-4adbb03dc1ac tempest-MigrationsAdminTest-1970194929 tempest-MigrationsAdminTest-1970194929-project-admin] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:19.120137 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-9210213c-97fb-4cff-88c8-4adbb03dc1ac tempest-MigrationsAdminTest-1970194929 tempest-MigrationsAdminTest-1970194929-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:19.120802 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-9210213c-97fb-4cff-88c8-4adbb03dc1ac tempest-MigrationsAdminTest-1970194929 tempest-MigrationsAdminTest-1970194929-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:19.169791 n-d-863052-2 devstack@n-api.service[121402]: DEBUG dbcounter [-] [121402] Writing DB stats nova_cell0:SELECT=3 {{(pid=121402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 18:56:19.226143 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-9210213c-97fb-4cff-88c8-4adbb03dc1ac tempest-MigrationsAdminTest-1970194929 tempest-MigrationsAdminTest-1970194929-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '4010ab88bbfe478ab22c6e52e1c2c72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a3c26d879564e2d868fe0e73372aa90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:56:19.226832 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-9210213c-97fb-4cff-88c8-4adbb03dc1ac tempest-MigrationsAdminTest-1970194929 tempest-MigrationsAdminTest-1970194929-project-admin] [instance: 614eb691-9a9a-4ca0-933d-686d80cc0ef1] flavor_id is None. Assuming migration. {{(pid=121402) resize /opt/stack/nova/nova/compute/api.py:4196}} Nov 01 18:56:19.227390 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-9210213c-97fb-4cff-88c8-4adbb03dc1ac tempest-MigrationsAdminTest-1970194929 tempest-MigrationsAdminTest-1970194929-project-admin] [instance: 614eb691-9a9a-4ca0-933d-686d80cc0ef1] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=121402) resize /opt/stack/nova/nova/compute/api.py:4220}} Nov 01 18:56:19.462992 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-9210213c-97fb-4cff-88c8-4adbb03dc1ac tempest-MigrationsAdminTest-1970194929 tempest-MigrationsAdminTest-1970194929-project-admin] 10.222.0.13 "POST /compute/v2.1/servers/614eb691-9a9a-4ca0-933d-686d80cc0ef1/action" status: 202 len: 0 microversion: 2.1 time: 0.359323 Nov 01 18:56:19.464311 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 282/553] 10.222.0.13 () {60 vars in 1278 bytes} [Tue Nov 1 18:56:19 2022] POST /compute/v2.1/servers/614eb691-9a9a-4ca0-933d-686d80cc0ef1/action => generated 0 bytes in 363 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 01 18:56:19.476323 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-366e7a72-dbf4-492f-bee6-6a034a626659 tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07a2a96629f4baea6a3adfc4011ffe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9baf3860ba564f5c8dff93085b9aabe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:56:19.479885 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-8df9b183-0d81-4532-890b-2eea1e9a86d9 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:56:19.480749 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-8df9b183-0d81-4532-890b-2eea1e9a86d9 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] [instance: 58d02dff-26f6-4c2f-b886-cdbdccbfcec9] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:56:19.487555 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-366e7a72-dbf4-492f-bee6-6a034a626659 tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] 10.222.0.13 "GET /compute/v2.1/servers/ab3530ff-d70f-4c6c-abd0-3afa14fd9954" status: 200 len: 1389 microversion: 2.1 time: 0.592500 Nov 01 18:56:19.488154 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 272/554] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:56:18 2022] GET /compute/v2.1/servers/ab3530ff-d70f-4c6c-abd0-3afa14fd9954 => generated 1389 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:56:19.506298 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-8df9b183-0d81-4532-890b-2eea1e9a86d9 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:19.506990 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-8df9b183-0d81-4532-890b-2eea1e9a86d9 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:19.507454 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-8df9b183-0d81-4532-890b-2eea1e9a86d9 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:19.513052 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-8df9b183-0d81-4532-890b-2eea1e9a86d9 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:19.513881 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-8df9b183-0d81-4532-890b-2eea1e9a86d9 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:19.514541 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-8df9b183-0d81-4532-890b-2eea1e9a86d9 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:19.545001 n-d-863052-2 devstack@n-api.service[121402]: DEBUG dbcounter [-] [121402] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 18:56:19.688116 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-8a073fe4-0bb9-4676-a600-14678f86abf7 tempest-QuotasAdminTestV257-506769457 tempest-QuotasAdminTestV257-506769457-project-admin] Action: 'update', calling method: .version_select at 0x7f0ae29d1160>, body: {"quota_set": {"ram": "5120"}} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 18:56:19.739846 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-8df9b183-0d81-4532-890b-2eea1e9a86d9 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f32f5fba1976432d938e664c7714e52b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b9d4c236b944f9b2e8e502a50a8f8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:56:19.752748 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-8df9b183-0d81-4532-890b-2eea1e9a86d9 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] 10.222.0.13 "GET /compute/v2.1/servers/58d02dff-26f6-4c2f-b886-cdbdccbfcec9" status: 200 len: 1310 microversion: 2.1 time: 0.284976 Nov 01 18:56:19.753928 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 283/555] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:56:19 2022] GET /compute/v2.1/servers/58d02dff-26f6-4c2f-b886-cdbdccbfcec9 => generated 1310 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:56:19.759385 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-789b0200-ad39-45ba-9a2a-56bbc57ece5a tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:56:19.760030 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-789b0200-ad39-45ba-9a2a-56bbc57ece5a tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] [instance: 614eb691-9a9a-4ca0-933d-686d80cc0ef1] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:56:19.774071 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-789b0200-ad39-45ba-9a2a-56bbc57ece5a tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:19.774568 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-789b0200-ad39-45ba-9a2a-56bbc57ece5a tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:19.775156 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-789b0200-ad39-45ba-9a2a-56bbc57ece5a tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:19.776181 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-789b0200-ad39-45ba-9a2a-56bbc57ece5a tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:19.776662 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-789b0200-ad39-45ba-9a2a-56bbc57ece5a tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:19.777093 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-789b0200-ad39-45ba-9a2a-56bbc57ece5a tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:19.834284 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-8a073fe4-0bb9-4676-a600-14678f86abf7 tempest-QuotasAdminTestV257-506769457 tempest-QuotasAdminTestV257-506769457-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:19.839661 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-8a073fe4-0bb9-4676-a600-14678f86abf7 tempest-QuotasAdminTestV257-506769457 tempest-QuotasAdminTestV257-506769457-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:19.840446 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-8a073fe4-0bb9-4676-a600-14678f86abf7 tempest-QuotasAdminTestV257-506769457 tempest-QuotasAdminTestV257-506769457-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:19.841851 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-8a073fe4-0bb9-4676-a600-14678f86abf7 tempest-QuotasAdminTestV257-506769457 tempest-QuotasAdminTestV257-506769457-project-admin] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:19.842478 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-8a073fe4-0bb9-4676-a600-14678f86abf7 tempest-QuotasAdminTestV257-506769457 tempest-QuotasAdminTestV257-506769457-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:19.843311 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-8a073fe4-0bb9-4676-a600-14678f86abf7 tempest-QuotasAdminTestV257-506769457 tempest-QuotasAdminTestV257-506769457-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:19.928085 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-8a073fe4-0bb9-4676-a600-14678f86abf7 tempest-QuotasAdminTestV257-506769457 tempest-QuotasAdminTestV257-506769457-project-admin] 10.222.0.13 "PUT /compute/v2.1/os-quota-sets/7ced16ae0a8948cc9eff0f44ef908137" status: 200 len: 148 microversion: 2.57 time: 0.438607 Nov 01 18:56:19.929064 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 273/556] 10.222.0.13 () {62 vars in 1303 bytes} [Tue Nov 1 18:56:19 2022] PUT /compute/v2.1/os-quota-sets/7ced16ae0a8948cc9eff0f44ef908137 => generated 148 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 01 18:56:19.934371 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-1433016f-243f-47c9-8155-5ed08858a5d4 tempest-ServerDiagnosticsNegativeTest-50806246 tempest-ServerDiagnosticsNegativeTest-50806246-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:56:19.935185 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-1433016f-243f-47c9-8155-5ed08858a5d4 tempest-ServerDiagnosticsNegativeTest-50806246 tempest-ServerDiagnosticsNegativeTest-50806246-project] [instance: 7fe37e78-fffe-4261-b0cd-be9037a208d5] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:56:19.941763 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-1433016f-243f-47c9-8155-5ed08858a5d4 tempest-ServerDiagnosticsNegativeTest-50806246 tempest-ServerDiagnosticsNegativeTest-50806246-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:19.942272 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-1433016f-243f-47c9-8155-5ed08858a5d4 tempest-ServerDiagnosticsNegativeTest-50806246 tempest-ServerDiagnosticsNegativeTest-50806246-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:19.942659 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-1433016f-243f-47c9-8155-5ed08858a5d4 tempest-ServerDiagnosticsNegativeTest-50806246 tempest-ServerDiagnosticsNegativeTest-50806246-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:19.943689 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-1433016f-243f-47c9-8155-5ed08858a5d4 tempest-ServerDiagnosticsNegativeTest-50806246 tempest-ServerDiagnosticsNegativeTest-50806246-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:19.944147 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-1433016f-243f-47c9-8155-5ed08858a5d4 tempest-ServerDiagnosticsNegativeTest-50806246 tempest-ServerDiagnosticsNegativeTest-50806246-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:19.944568 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-1433016f-243f-47c9-8155-5ed08858a5d4 tempest-ServerDiagnosticsNegativeTest-50806246 tempest-ServerDiagnosticsNegativeTest-50806246-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:19.962929 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-789b0200-ad39-45ba-9a2a-56bbc57ece5a tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72117f17294649d6b8bc16c66c7efab2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45d4c047d3c44324a27a27831236ab0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:56:19.973589 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-789b0200-ad39-45ba-9a2a-56bbc57ece5a tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] 10.222.0.13 "GET /compute/v2.1/servers/614eb691-9a9a-4ca0-933d-686d80cc0ef1" status: 200 len: 1470 microversion: 2.1 time: 0.218107 Nov 01 18:56:19.975187 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 284/557] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:56:19 2022] GET /compute/v2.1/servers/614eb691-9a9a-4ca0-933d-686d80cc0ef1 => generated 1470 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:56:19.991816 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-5f33b320-b84c-4eb8-9d8a-64757737ee07 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:56:19.992851 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-5f33b320-b84c-4eb8-9d8a-64757737ee07 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] [instance: 2d3a927e-a478-40b1-8c92-80396c82f76c] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:56:20.000681 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-5f33b320-b84c-4eb8-9d8a-64757737ee07 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:20.001345 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-5f33b320-b84c-4eb8-9d8a-64757737ee07 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:20.001921 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-5f33b320-b84c-4eb8-9d8a-64757737ee07 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:20.002716 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-5f33b320-b84c-4eb8-9d8a-64757737ee07 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:20.003707 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-5f33b320-b84c-4eb8-9d8a-64757737ee07 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:20.004782 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-5f33b320-b84c-4eb8-9d8a-64757737ee07 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:20.177373 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-5f33b320-b84c-4eb8-9d8a-64757737ee07 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:56:20.189660 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-5f33b320-b84c-4eb8-9d8a-64757737ee07 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:56:20.191507 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-5f33b320-b84c-4eb8-9d8a-64757737ee07 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:56:20.192881 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-5f33b320-b84c-4eb8-9d8a-64757737ee07 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] 10.222.0.13 "GET /compute/v2.1/servers/2d3a927e-a478-40b1-8c92-80396c82f76c" status: 200 len: 1567 microversion: 2.25 time: 0.206079 Nov 01 18:56:20.194055 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 285/558] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 18:56:19 2022] GET /compute/v2.1/servers/2d3a927e-a478-40b1-8c92-80396c82f76c => generated 1567 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 18:56:20.198756 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-3a73ccf7-dbd0-4088-a3ba-0c644a1eb5c7 tempest-QuotasAdminTestV257-506769457 tempest-QuotasAdminTestV257-506769457-project-admin] Calling method '.version_select at 0x7f0ae2944940>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:56:20.293818 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-3a73ccf7-dbd0-4088-a3ba-0c644a1eb5c7 tempest-QuotasAdminTestV257-506769457 tempest-QuotasAdminTestV257-506769457-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:20.294681 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-3a73ccf7-dbd0-4088-a3ba-0c644a1eb5c7 tempest-QuotasAdminTestV257-506769457 tempest-QuotasAdminTestV257-506769457-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:20.296357 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-3a73ccf7-dbd0-4088-a3ba-0c644a1eb5c7 tempest-QuotasAdminTestV257-506769457 tempest-QuotasAdminTestV257-506769457-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:20.297319 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-3a73ccf7-dbd0-4088-a3ba-0c644a1eb5c7 tempest-QuotasAdminTestV257-506769457 tempest-QuotasAdminTestV257-506769457-project-admin] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:20.297936 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-3a73ccf7-dbd0-4088-a3ba-0c644a1eb5c7 tempest-QuotasAdminTestV257-506769457 tempest-QuotasAdminTestV257-506769457-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:20.298590 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-3a73ccf7-dbd0-4088-a3ba-0c644a1eb5c7 tempest-QuotasAdminTestV257-506769457 tempest-QuotasAdminTestV257-506769457-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:20.330769 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-3a73ccf7-dbd0-4088-a3ba-0c644a1eb5c7 tempest-QuotasAdminTestV257-506769457 tempest-QuotasAdminTestV257-506769457-project-admin] 10.222.0.13 "GET /compute/v2.1/os-quota-sets/7ced16ae0a8948cc9eff0f44ef908137/detail" status: 200 len: 463 microversion: 2.57 time: 0.135366 Nov 01 18:56:20.344133 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-1433016f-243f-47c9-8155-5ed08858a5d4 tempest-ServerDiagnosticsNegativeTest-50806246 tempest-ServerDiagnosticsNegativeTest-50806246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8087408d8b947f8b603fdeaee878fee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '741e5c81bd1d4383a5faff2e2a3dbbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:56:20.344525 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 286/559] 10.222.0.13 () {60 vars in 1304 bytes} [Tue Nov 1 18:56:20 2022] GET /compute/v2.1/os-quota-sets/7ced16ae0a8948cc9eff0f44ef908137/detail => generated 463 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 01 18:56:20.350583 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [req-d49e945a-0e24-484d-8ee4-2f697e064c3f req-92e4c3ba-8936-4131-891d-87692010f390 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ab3530ff-d70f-4c6c-abd0-3afa14fd9954", "name": "network-vif-plugged", "status": "completed", "tag": "5a8ac51b-9c28-4dee-aa83-db1236898e3d"}]} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 18:56:20.352269 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-1433016f-243f-47c9-8155-5ed08858a5d4 tempest-ServerDiagnosticsNegativeTest-50806246 tempest-ServerDiagnosticsNegativeTest-50806246-project] 10.222.0.13 "GET /compute/v2.1/servers/7fe37e78-fffe-4261-b0cd-be9037a208d5" status: 200 len: 1473 microversion: 2.1 time: 0.421910 Nov 01 18:56:20.374119 n-d-863052-2 devstack@n-api.service[121402]: DEBUG dbcounter [-] [121402] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=121402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 18:56:20.374119 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-d49e945a-0e24-484d-8ee4-2f697e064c3f req-92e4c3ba-8936-4131-891d-87692010f390 service nova] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:20.374119 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-d49e945a-0e24-484d-8ee4-2f697e064c3f req-92e4c3ba-8936-4131-891d-87692010f390 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:20.374119 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-d49e945a-0e24-484d-8ee4-2f697e064c3f req-92e4c3ba-8936-4131-891d-87692010f390 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:20.375564 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 274/560] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:56:19 2022] GET /compute/v2.1/servers/7fe37e78-fffe-4261-b0cd-be9037a208d5 => generated 1473 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:56:20.376764 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.compute.server_external_events [req-d49e945a-0e24-484d-8ee4-2f697e064c3f req-92e4c3ba-8936-4131-891d-87692010f390 service nova] Creating event network-vif-plugged:5a8ac51b-9c28-4dee-aa83-db1236898e3d for instance ab3530ff-d70f-4c6c-abd0-3afa14fd9954 on n-h2-863052-2 Nov 01 18:56:20.381659 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-b8a54287-0a84-4d07-a837-835d6e828168 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:56:20.382272 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-b8a54287-0a84-4d07-a837-835d6e828168 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] [instance: ea631032-dd04-429b-988e-e6362ea42cf7] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:56:20.384037 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [req-d49e945a-0e24-484d-8ee4-2f697e064c3f req-92e4c3ba-8936-4131-891d-87692010f390 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037983 Nov 01 18:56:20.385530 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 287/561] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Nov 1 18:56:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 18:56:20.391712 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-0fd002bf-b897-47e4-a239-4c2a0f086ca3 tempest-ServerDiagnosticsNegativeTest-50806246 tempest-ServerDiagnosticsNegativeTest-50806246-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:56:20.392378 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-0fd002bf-b897-47e4-a239-4c2a0f086ca3 tempest-ServerDiagnosticsNegativeTest-50806246 tempest-ServerDiagnosticsNegativeTest-50806246-project] [instance: 7fe37e78-fffe-4261-b0cd-be9037a208d5] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:56:20.404154 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-0fd002bf-b897-47e4-a239-4c2a0f086ca3 tempest-ServerDiagnosticsNegativeTest-50806246 tempest-ServerDiagnosticsNegativeTest-50806246-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:20.404943 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-0fd002bf-b897-47e4-a239-4c2a0f086ca3 tempest-ServerDiagnosticsNegativeTest-50806246 tempest-ServerDiagnosticsNegativeTest-50806246-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:20.405566 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-0fd002bf-b897-47e4-a239-4c2a0f086ca3 tempest-ServerDiagnosticsNegativeTest-50806246 tempest-ServerDiagnosticsNegativeTest-50806246-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:20.407433 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-0fd002bf-b897-47e4-a239-4c2a0f086ca3 tempest-ServerDiagnosticsNegativeTest-50806246 tempest-ServerDiagnosticsNegativeTest-50806246-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:20.408562 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-0fd002bf-b897-47e4-a239-4c2a0f086ca3 tempest-ServerDiagnosticsNegativeTest-50806246 tempest-ServerDiagnosticsNegativeTest-50806246-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:20.409173 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-0fd002bf-b897-47e4-a239-4c2a0f086ca3 tempest-ServerDiagnosticsNegativeTest-50806246 tempest-ServerDiagnosticsNegativeTest-50806246-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:20.410456 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-b8a54287-0a84-4d07-a837-835d6e828168 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:20.410964 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-b8a54287-0a84-4d07-a837-835d6e828168 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:20.411414 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-b8a54287-0a84-4d07-a837-835d6e828168 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:20.412177 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-b8a54287-0a84-4d07-a837-835d6e828168 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:20.412681 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-b8a54287-0a84-4d07-a837-835d6e828168 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:20.413105 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-b8a54287-0a84-4d07-a837-835d6e828168 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:20.467056 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-0fd002bf-b897-47e4-a239-4c2a0f086ca3 tempest-ServerDiagnosticsNegativeTest-50806246 tempest-ServerDiagnosticsNegativeTest-50806246-project] Policy check for os_compute_api:os-server-diagnostics failed with credentials {'is_admin': False, 'user_id': 'a8087408d8b947f8b603fdeaee878fee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '741e5c81bd1d4383a5faff2e2a3dbbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:56:20.470935 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-0fd002bf-b897-47e4-a239-4c2a0f086ca3 tempest-ServerDiagnosticsNegativeTest-50806246 tempest-ServerDiagnosticsNegativeTest-50806246-project] Request method failure captured: Nov 01 18:56:20.470935 n-d-863052-2 devstack@n-api.service[121402]: request: GET /compute/v2.1/servers/7fe37e78-fffe-4261-b0cd-be9037a208d5/diagnostics HTTP/1.1 Nov 01 18:56:20.470935 n-d-863052-2 devstack@n-api.service[121402]: Accept: application/json Nov 01 18:56:20.470935 n-d-863052-2 devstack@n-api.service[121402]: Accept-Encoding: identity Nov 01 18:56:20.470935 n-d-863052-2 devstack@n-api.service[121402]: Connection: close Nov 01 18:56:20.470935 n-d-863052-2 devstack@n-api.service[121402]: Content-Length: 0 Nov 01 18:56:20.470935 n-d-863052-2 devstack@n-api.service[121402]: Content-Type: application/json Nov 01 18:56:20.470935 n-d-863052-2 devstack@n-api.service[121402]: Host: 10.222.0.13 Nov 01 18:56:20.470935 n-d-863052-2 devstack@n-api.service[121402]: Openstack-System-Scope: None Nov 01 18:56:20.470935 n-d-863052-2 devstack@n-api.service[121402]: User-Agent: python-urllib3/1.26.12 Nov 01 18:56:20.470935 n-d-863052-2 devstack@n-api.service[121402]: X-Auth-Token: gAAAAABjYWu6JtA84MMF7nsfjOcbHjECyd0E5k96ddbFp3KWVXRj3d2TxqBYu0J_V-OXV78_4eClLy_AzFQERoVEBoAjGu6i-2YurVwR9XWLNQwUbeo8SVU1nQ2c1usk-7WO7J2rqCa2LvHoI8Ppat8HS45-kXMvCAkzWNCdoGb3q4R3EJPIRRM Nov 01 18:56:20.470935 n-d-863052-2 devstack@n-api.service[121402]: X-Domain-Id: None Nov 01 18:56:20.470935 n-d-863052-2 devstack@n-api.service[121402]: X-Domain-Name: None Nov 01 18:56:20.470935 n-d-863052-2 devstack@n-api.service[121402]: X-Identity-Status: Confirmed Nov 01 18:56:20.470935 n-d-863052-2 devstack@n-api.service[121402]: X-Is-Admin-Project: True Nov 01 18:56:20.470935 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Domain-Id: default Nov 01 18:56:20.470935 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Domain-Name: Default Nov 01 18:56:20.470935 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Id: 741e5c81bd1d4383a5faff2e2a3dbbf0 Nov 01 18:56:20.470935 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Name: tempest-ServerDiagnosticsNegativeTest-50806246 Nov 01 18:56:20.470935 n-d-863052-2 devstack@n-api.service[121402]: X-Role: member,reader Nov 01 18:56:20.470935 n-d-863052-2 devstack@n-api.service[121402]: X-Roles: member,reader Nov 01 18:56:20.472291 n-d-863052-2 devstack@n-api.service[121402]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/741e5c81bd1d4383a5faff2e2a3dbbf0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/741e5c81bd1d4383a5faff2e2a3dbbf0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_741e5c81bd1d4383a5faff2e2a3dbbf0", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/741e5c81bd1d4383a5faff2e2a3dbbf0"}]}] Nov 01 18:56:20.472291 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant: tempest-ServerDiagnosticsNegativeTest-50806246 Nov 01 18:56:20.472291 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant-Id: 741e5c81bd1d4383a5faff2e2a3dbbf0 Nov 01 18:56:20.472291 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant-Name: tempest-ServerDiagnosticsNegativeTest-50806246 Nov 01 18:56:20.472291 n-d-863052-2 devstack@n-api.service[121402]: X-User: tempest-ServerDiagnosticsNegativeTest-50806246-project Nov 01 18:56:20.472291 n-d-863052-2 devstack@n-api.service[121402]: X-User-Domain-Id: default Nov 01 18:56:20.472291 n-d-863052-2 devstack@n-api.service[121402]: X-User-Domain-Name: Default Nov 01 18:56:20.472291 n-d-863052-2 devstack@n-api.service[121402]: X-User-Id: a8087408d8b947f8b603fdeaee878fee Nov 01 18:56:20.472291 n-d-863052-2 devstack@n-api.service[121402]: X-User-Name: tempest-ServerDiagnosticsNegativeTest-50806246-project Nov 01 18:56:20.472291 n-d-863052-2 devstack@n-api.service[121402]: method: > Nov 01 18:56:20.472291 n-d-863052-2 devstack@n-api.service[121402]: exception: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Nov 01 18:56:20.473231 n-d-863052-2 devstack@n-api.service[121402]: action_args: {'server_id': '7fe37e78-fffe-4261-b0cd-be9037a208d5'} Nov 01 18:56:20.473231 n-d-863052-2 devstack@n-api.service[121402]: {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 01 18:56:20.473231 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:56:20.473231 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 18:56:20.473231 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 18:56:20.473231 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 01 18:56:20.473231 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 01 18:56:20.473231 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 01 18:56:20.473231 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 01 18:56:20.473231 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_diagnostics.py", line 38, in index Nov 01 18:56:20.473231 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi context.can(sd_policies.BASE_POLICY_NAME, Nov 01 18:56:20.473231 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Nov 01 18:56:20.473231 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Nov 01 18:56:20.473231 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Nov 01 18:56:20.473231 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Nov 01 18:56:20.473231 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 01 18:56:20.473231 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 01 18:56:20.473231 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 01 18:56:20.473231 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise self.value Nov 01 18:56:20.473231 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Nov 01 18:56:20.475278 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Nov 01 18:56:20.475278 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Nov 01 18:56:20.475278 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return self.enforce( Nov 01 18:56:20.475278 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Nov 01 18:56:20.475278 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Nov 01 18:56:20.475278 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Nov 01 18:56:20.475278 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 18:56:20.475278 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 18:56:20.475278 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 18:56:20.475278 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:56:20.475278 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 18:56:20.475278 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 18:56:20.475278 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Nov 01 18:56:20.475278 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Nov 01 18:56:20.475278 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Nov 01 18:56:20.475278 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 18:56:20.479723 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-0fd002bf-b897-47e4-a239-4c2a0f086ca3 tempest-ServerDiagnosticsNegativeTest-50806246 tempest-ServerDiagnosticsNegativeTest-50806246-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. {{(pid=121402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 01 18:56:20.481169 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-0fd002bf-b897-47e4-a239-4c2a0f086ca3 tempest-ServerDiagnosticsNegativeTest-50806246 tempest-ServerDiagnosticsNegativeTest-50806246-project] 10.222.0.13 "GET /compute/v2.1/servers/7fe37e78-fffe-4261-b0cd-be9037a208d5/diagnostics" status: 403 len: 117 microversion: 2.1 time: 0.094174 Nov 01 18:56:20.481923 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 288/562] 10.222.0.13 () {58 vars in 1272 bytes} [Tue Nov 1 18:56:20 2022] GET /compute/v2.1/servers/7fe37e78-fffe-4261-b0cd-be9037a208d5/diagnostics => generated 117 bytes in 96 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Nov 01 18:56:20.494363 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-1b87081d-a5cd-437b-aaf6-a20808e0de07 tempest-ServerDiagnosticsNegativeTest-50806246 tempest-ServerDiagnosticsNegativeTest-50806246-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:56:20.495093 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-1b87081d-a5cd-437b-aaf6-a20808e0de07 tempest-ServerDiagnosticsNegativeTest-50806246 tempest-ServerDiagnosticsNegativeTest-50806246-project] [instance: 7fe37e78-fffe-4261-b0cd-be9037a208d5] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:56:20.507728 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-1b87081d-a5cd-437b-aaf6-a20808e0de07 tempest-ServerDiagnosticsNegativeTest-50806246 tempest-ServerDiagnosticsNegativeTest-50806246-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:20.508480 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-1b87081d-a5cd-437b-aaf6-a20808e0de07 tempest-ServerDiagnosticsNegativeTest-50806246 tempest-ServerDiagnosticsNegativeTest-50806246-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:20.509571 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-1b87081d-a5cd-437b-aaf6-a20808e0de07 tempest-ServerDiagnosticsNegativeTest-50806246 tempest-ServerDiagnosticsNegativeTest-50806246-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:20.511057 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-1b87081d-a5cd-437b-aaf6-a20808e0de07 tempest-ServerDiagnosticsNegativeTest-50806246 tempest-ServerDiagnosticsNegativeTest-50806246-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:20.512326 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-1b87081d-a5cd-437b-aaf6-a20808e0de07 tempest-ServerDiagnosticsNegativeTest-50806246 tempest-ServerDiagnosticsNegativeTest-50806246-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:20.512326 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-1b87081d-a5cd-437b-aaf6-a20808e0de07 tempest-ServerDiagnosticsNegativeTest-50806246 tempest-ServerDiagnosticsNegativeTest-50806246-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:20.562116 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-1b87081d-a5cd-437b-aaf6-a20808e0de07 tempest-ServerDiagnosticsNegativeTest-50806246 tempest-ServerDiagnosticsNegativeTest-50806246-project] [instance: 7fe37e78-fffe-4261-b0cd-be9037a208d5] Going to try to terminate instance {{(pid=121402) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 01 18:56:20.622636 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-b8a54287-0a84-4d07-a837-835d6e828168 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c1314c21d8547ff890ede1c2ad281c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c804370880454c7aa02cef2c2c3cf144', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:56:20.631449 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-b8a54287-0a84-4d07-a837-835d6e828168 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c1314c21d8547ff890ede1c2ad281c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c804370880454c7aa02cef2c2c3cf144', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:56:20.638515 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-b8a54287-0a84-4d07-a837-835d6e828168 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c1314c21d8547ff890ede1c2ad281c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c804370880454c7aa02cef2c2c3cf144', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:56:20.647272 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-b8a54287-0a84-4d07-a837-835d6e828168 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] 10.222.0.13 "GET /compute/v2.1/servers/ea631032-dd04-429b-988e-e6362ea42cf7" status: 200 len: 1537 microversion: 2.91 time: 0.270235 Nov 01 18:56:20.665592 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 275/563] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 18:56:20 2022] GET /compute/v2.1/servers/ea631032-dd04-429b-988e-e6362ea42cf7 => generated 1537 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 18:56:20.670634 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-486f91f9-b0b3-42f3-ad31-d337c6e8d1b2 tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:56:20.677440 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-486f91f9-b0b3-42f3-ad31-d337c6e8d1b2 tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] [instance: ab3530ff-d70f-4c6c-abd0-3afa14fd9954] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:56:20.684499 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-486f91f9-b0b3-42f3-ad31-d337c6e8d1b2 tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:20.685007 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-486f91f9-b0b3-42f3-ad31-d337c6e8d1b2 tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:20.685636 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-486f91f9-b0b3-42f3-ad31-d337c6e8d1b2 tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:20.687836 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-486f91f9-b0b3-42f3-ad31-d337c6e8d1b2 tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:20.688300 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-486f91f9-b0b3-42f3-ad31-d337c6e8d1b2 tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:20.688752 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-486f91f9-b0b3-42f3-ad31-d337c6e8d1b2 tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:20.739323 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-1b87081d-a5cd-437b-aaf6-a20808e0de07 tempest-ServerDiagnosticsNegativeTest-50806246 tempest-ServerDiagnosticsNegativeTest-50806246-project] 10.222.0.13 "DELETE /compute/v2.1/servers/7fe37e78-fffe-4261-b0cd-be9037a208d5" status: 204 len: 0 microversion: 2.1 time: 0.248835 Nov 01 18:56:20.741586 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 289/564] 10.222.0.13 () {58 vars in 1239 bytes} [Tue Nov 1 18:56:20 2022] DELETE /compute/v2.1/servers/7fe37e78-fffe-4261-b0cd-be9037a208d5 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 01 18:56:20.749449 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-331d29b1-d4e0-4366-b4f6-75944a517d1d tempest-QuotasAdminTestV257-506769457 tempest-QuotasAdminTestV257-506769457-project-admin] Action: 'update', calling method: .version_select at 0x7f0ae298d160>, body: {"quota_set": {"ram": "2048"}} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 18:56:20.830980 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-331d29b1-d4e0-4366-b4f6-75944a517d1d tempest-QuotasAdminTestV257-506769457 tempest-QuotasAdminTestV257-506769457-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:20.831463 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-331d29b1-d4e0-4366-b4f6-75944a517d1d tempest-QuotasAdminTestV257-506769457 tempest-QuotasAdminTestV257-506769457-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:20.831894 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-331d29b1-d4e0-4366-b4f6-75944a517d1d tempest-QuotasAdminTestV257-506769457 tempest-QuotasAdminTestV257-506769457-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:20.832623 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-331d29b1-d4e0-4366-b4f6-75944a517d1d tempest-QuotasAdminTestV257-506769457 tempest-QuotasAdminTestV257-506769457-project-admin] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:20.833230 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-331d29b1-d4e0-4366-b4f6-75944a517d1d tempest-QuotasAdminTestV257-506769457 tempest-QuotasAdminTestV257-506769457-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:20.833488 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-331d29b1-d4e0-4366-b4f6-75944a517d1d tempest-QuotasAdminTestV257-506769457 tempest-QuotasAdminTestV257-506769457-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:20.868809 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-331d29b1-d4e0-4366-b4f6-75944a517d1d tempest-QuotasAdminTestV257-506769457 tempest-QuotasAdminTestV257-506769457-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:20.869289 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-331d29b1-d4e0-4366-b4f6-75944a517d1d tempest-QuotasAdminTestV257-506769457 tempest-QuotasAdminTestV257-506769457-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:20.869756 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-331d29b1-d4e0-4366-b4f6-75944a517d1d tempest-QuotasAdminTestV257-506769457 tempest-QuotasAdminTestV257-506769457-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:20.870443 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-331d29b1-d4e0-4366-b4f6-75944a517d1d tempest-QuotasAdminTestV257-506769457 tempest-QuotasAdminTestV257-506769457-project-admin] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:20.870891 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-331d29b1-d4e0-4366-b4f6-75944a517d1d tempest-QuotasAdminTestV257-506769457 tempest-QuotasAdminTestV257-506769457-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:20.871307 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-331d29b1-d4e0-4366-b4f6-75944a517d1d tempest-QuotasAdminTestV257-506769457 tempest-QuotasAdminTestV257-506769457-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:20.936120 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-331d29b1-d4e0-4366-b4f6-75944a517d1d tempest-QuotasAdminTestV257-506769457 tempest-QuotasAdminTestV257-506769457-project-admin] 10.222.0.13 "PUT /compute/v2.1/os-quota-sets/7ced16ae0a8948cc9eff0f44ef908137?user_id=918775dd29254bbb9ae1dadc30ff2664" status: 200 len: 148 microversion: 2.57 time: 0.192959 Nov 01 18:56:20.937508 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 290/565] 10.222.0.13 () {62 vars in 1384 bytes} [Tue Nov 1 18:56:20 2022] PUT /compute/v2.1/os-quota-sets/7ced16ae0a8948cc9eff0f44ef908137?user_id=918775dd29254bbb9ae1dadc30ff2664 => generated 148 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 01 18:56:20.941883 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-6dc8c26b-9367-4d11-ad7e-ec3a1b9de71e tempest-ServerDiagnosticsNegativeTest-50806246 tempest-ServerDiagnosticsNegativeTest-50806246-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:56:20.942603 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-6dc8c26b-9367-4d11-ad7e-ec3a1b9de71e tempest-ServerDiagnosticsNegativeTest-50806246 tempest-ServerDiagnosticsNegativeTest-50806246-project] [instance: 7fe37e78-fffe-4261-b0cd-be9037a208d5] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:56:20.948705 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-6dc8c26b-9367-4d11-ad7e-ec3a1b9de71e tempest-ServerDiagnosticsNegativeTest-50806246 tempest-ServerDiagnosticsNegativeTest-50806246-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:20.949746 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-6dc8c26b-9367-4d11-ad7e-ec3a1b9de71e tempest-ServerDiagnosticsNegativeTest-50806246 tempest-ServerDiagnosticsNegativeTest-50806246-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:20.949746 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-6dc8c26b-9367-4d11-ad7e-ec3a1b9de71e tempest-ServerDiagnosticsNegativeTest-50806246 tempest-ServerDiagnosticsNegativeTest-50806246-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:20.950309 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-6dc8c26b-9367-4d11-ad7e-ec3a1b9de71e tempest-ServerDiagnosticsNegativeTest-50806246 tempest-ServerDiagnosticsNegativeTest-50806246-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:20.950752 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-6dc8c26b-9367-4d11-ad7e-ec3a1b9de71e tempest-ServerDiagnosticsNegativeTest-50806246 tempest-ServerDiagnosticsNegativeTest-50806246-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:20.951165 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-6dc8c26b-9367-4d11-ad7e-ec3a1b9de71e tempest-ServerDiagnosticsNegativeTest-50806246 tempest-ServerDiagnosticsNegativeTest-50806246-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:21.060031 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-486f91f9-b0b3-42f3-ad31-d337c6e8d1b2 tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07a2a96629f4baea6a3adfc4011ffe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9baf3860ba564f5c8dff93085b9aabe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:56:21.068685 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-486f91f9-b0b3-42f3-ad31-d337c6e8d1b2 tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] 10.222.0.13 "GET /compute/v2.1/servers/ab3530ff-d70f-4c6c-abd0-3afa14fd9954" status: 200 len: 1389 microversion: 2.1 time: 0.401623 Nov 01 18:56:21.069435 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 276/566] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:56:20 2022] GET /compute/v2.1/servers/ab3530ff-d70f-4c6c-abd0-3afa14fd9954 => generated 1389 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:56:21.074216 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-d82a9d41-0364-456d-8d5b-a79860e1f3e2 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:56:21.075760 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-d82a9d41-0364-456d-8d5b-a79860e1f3e2 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] [instance: 58d02dff-26f6-4c2f-b886-cdbdccbfcec9] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:56:21.082204 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d82a9d41-0364-456d-8d5b-a79860e1f3e2 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:21.082815 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d82a9d41-0364-456d-8d5b-a79860e1f3e2 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:21.083509 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d82a9d41-0364-456d-8d5b-a79860e1f3e2 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:21.084493 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d82a9d41-0364-456d-8d5b-a79860e1f3e2 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:21.085094 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d82a9d41-0364-456d-8d5b-a79860e1f3e2 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:21.085603 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d82a9d41-0364-456d-8d5b-a79860e1f3e2 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:21.111080 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-6dc8c26b-9367-4d11-ad7e-ec3a1b9de71e tempest-ServerDiagnosticsNegativeTest-50806246 tempest-ServerDiagnosticsNegativeTest-50806246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8087408d8b947f8b603fdeaee878fee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '741e5c81bd1d4383a5faff2e2a3dbbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:56:21.120177 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-6dc8c26b-9367-4d11-ad7e-ec3a1b9de71e tempest-ServerDiagnosticsNegativeTest-50806246 tempest-ServerDiagnosticsNegativeTest-50806246-project] 10.222.0.13 "GET /compute/v2.1/servers/7fe37e78-fffe-4261-b0cd-be9037a208d5" status: 200 len: 1479 microversion: 2.1 time: 0.181843 Nov 01 18:56:21.133086 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 291/567] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:56:20 2022] GET /compute/v2.1/servers/7fe37e78-fffe-4261-b0cd-be9037a208d5 => generated 1479 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:56:21.139217 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-ccdabf58-ca23-4f22-954f-22010cfc5f38 tempest-QuotasAdminTestV257-506769457 tempest-QuotasAdminTestV257-506769457-project-admin] Calling method '.version_select at 0x7f0ae2818c10>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:56:21.230460 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-ccdabf58-ca23-4f22-954f-22010cfc5f38 tempest-QuotasAdminTestV257-506769457 tempest-QuotasAdminTestV257-506769457-project-admin] 10.222.0.13 "GET /compute/v2.1/os-quota-sets/7ced16ae0a8948cc9eff0f44ef908137?user_id=918775dd29254bbb9ae1dadc30ff2664" status: 200 len: 190 microversion: 2.57 time: 0.099744 Nov 01 18:56:21.231037 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 292/568] 10.222.0.13 () {60 vars in 1364 bytes} [Tue Nov 1 18:56:21 2022] GET /compute/v2.1/os-quota-sets/7ced16ae0a8948cc9eff0f44ef908137?user_id=918775dd29254bbb9ae1dadc30ff2664 => generated 190 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 01 18:56:21.231946 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-d82a9d41-0364-456d-8d5b-a79860e1f3e2 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f32f5fba1976432d938e664c7714e52b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b9d4c236b944f9b2e8e502a50a8f8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:56:21.238218 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-25986ba3-1191-452e-811c-38177e9b03d4 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:56:21.238825 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-25986ba3-1191-452e-811c-38177e9b03d4 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] [instance: 614eb691-9a9a-4ca0-933d-686d80cc0ef1] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:56:21.245133 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-25986ba3-1191-452e-811c-38177e9b03d4 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:21.245717 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-25986ba3-1191-452e-811c-38177e9b03d4 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:21.246351 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-25986ba3-1191-452e-811c-38177e9b03d4 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:21.247132 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-25986ba3-1191-452e-811c-38177e9b03d4 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:21.247904 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-25986ba3-1191-452e-811c-38177e9b03d4 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:21.248415 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-25986ba3-1191-452e-811c-38177e9b03d4 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:21.249256 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-d82a9d41-0364-456d-8d5b-a79860e1f3e2 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] 10.222.0.13 "GET /compute/v2.1/servers/58d02dff-26f6-4c2f-b886-cdbdccbfcec9" status: 200 len: 1310 microversion: 2.1 time: 0.178705 Nov 01 18:56:21.265221 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 277/569] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:56:21 2022] GET /compute/v2.1/servers/58d02dff-26f6-4c2f-b886-cdbdccbfcec9 => generated 1310 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:56:21.281127 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-bb661e38-759e-4b4d-9c37-a311505b7e0f tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:56:21.281734 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-bb661e38-759e-4b4d-9c37-a311505b7e0f tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] [instance: 2d3a927e-a478-40b1-8c92-80396c82f76c] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:56:21.293305 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-bb661e38-759e-4b4d-9c37-a311505b7e0f tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:21.293788 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-bb661e38-759e-4b4d-9c37-a311505b7e0f tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:21.294219 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-bb661e38-759e-4b4d-9c37-a311505b7e0f tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:21.294909 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-bb661e38-759e-4b4d-9c37-a311505b7e0f tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:21.295357 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-bb661e38-759e-4b4d-9c37-a311505b7e0f tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:21.295777 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-bb661e38-759e-4b4d-9c37-a311505b7e0f tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:21.431069 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-25986ba3-1191-452e-811c-38177e9b03d4 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72117f17294649d6b8bc16c66c7efab2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45d4c047d3c44324a27a27831236ab0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:56:21.441273 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-25986ba3-1191-452e-811c-38177e9b03d4 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] 10.222.0.13 "GET /compute/v2.1/servers/614eb691-9a9a-4ca0-933d-686d80cc0ef1" status: 200 len: 1470 microversion: 2.1 time: 0.209208 Nov 01 18:56:21.442463 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 293/570] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:56:21 2022] GET /compute/v2.1/servers/614eb691-9a9a-4ca0-933d-686d80cc0ef1 => generated 1470 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:56:21.514059 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-bb661e38-759e-4b4d-9c37-a311505b7e0f tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:56:21.514649 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-cfb194f0-b328-4784-9e1a-e4671ad4a025 tempest-FloatingIPsNegativeTestJSON-2087211548 tempest-FloatingIPsNegativeTestJSON-2087211548-project] Calling method '.version_select at 0x7f0ae27d7310>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:56:21.524269 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-bb661e38-759e-4b4d-9c37-a311505b7e0f tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:56:21.525739 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-bb661e38-759e-4b4d-9c37-a311505b7e0f tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:56:21.526893 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-bb661e38-759e-4b4d-9c37-a311505b7e0f tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] 10.222.0.13 "GET /compute/v2.1/servers/2d3a927e-a478-40b1-8c92-80396c82f76c" status: 200 len: 1567 microversion: 2.25 time: 0.260648 Nov 01 18:56:21.527452 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 278/571] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 18:56:21 2022] GET /compute/v2.1/servers/2d3a927e-a478-40b1-8c92-80396c82f76c => generated 1567 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 18:56:21.588223 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-cfb194f0-b328-4784-9e1a-e4671ad4a025 tempest-FloatingIPsNegativeTestJSON-2087211548 tempest-FloatingIPsNegativeTestJSON-2087211548-project] 10.222.0.13 "GET /compute/v2.1/os-floating-ips" status: 200 len: 20 microversion: 2.1 time: 0.144637 Nov 01 18:56:21.588854 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 294/572] 10.222.0.13 () {58 vars in 1149 bytes} [Tue Nov 1 18:56:21 2022] GET /compute/v2.1/os-floating-ips => generated 20 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 01 18:56:21.602711 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-33175bfc-d506-47e6-a122-2322c1980a5f tempest-FloatingIPsNegativeTestJSON-2087211548 tempest-FloatingIPsNegativeTestJSON-2087211548-project] Action: 'create', calling method: .version_select at 0x7f0ae2999160>, body: {"pool": "non_exist_pool"} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 18:56:21.648632 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.wsgi [None req-33175bfc-d506-47e6-a122-2322c1980a5f tempest-FloatingIPsNegativeTestJSON-2087211548 tempest-FloatingIPsNegativeTestJSON-2087211548-project] HTTP exception thrown: Floating IP pool not found. Nov 01 18:56:21.651938 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-33175bfc-d506-47e6-a122-2322c1980a5f tempest-FloatingIPsNegativeTestJSON-2087211548 tempest-FloatingIPsNegativeTestJSON-2087211548-project] Request method failure captured: Nov 01 18:56:21.651938 n-d-863052-2 devstack@n-api.service[121403]: request: POST /compute/v2.1/os-floating-ips HTTP/1.1 Nov 01 18:56:21.651938 n-d-863052-2 devstack@n-api.service[121403]: Accept: application/json Nov 01 18:56:21.651938 n-d-863052-2 devstack@n-api.service[121403]: Accept-Encoding: identity Nov 01 18:56:21.651938 n-d-863052-2 devstack@n-api.service[121403]: Connection: close Nov 01 18:56:21.651938 n-d-863052-2 devstack@n-api.service[121403]: Content-Length: 26 Nov 01 18:56:21.651938 n-d-863052-2 devstack@n-api.service[121403]: Content-Type: application/json Nov 01 18:56:21.651938 n-d-863052-2 devstack@n-api.service[121403]: Host: 10.222.0.13 Nov 01 18:56:21.651938 n-d-863052-2 devstack@n-api.service[121403]: Openstack-System-Scope: None Nov 01 18:56:21.651938 n-d-863052-2 devstack@n-api.service[121403]: User-Agent: python-urllib3/1.26.12 Nov 01 18:56:21.651938 n-d-863052-2 devstack@n-api.service[121403]: X-Auth-Token: gAAAAABjYWvV32FyJSNeqYsk7zJKZxne2onl01IvKCHWLFqLwrp-yw9wVHDoCskk9bC_NCWey7ymJdPCcbkxy6npwbAqJJoxGvrzofOPyo465boiNoukDVz3XXa_YQu2yB77zgEI1QoCJuupPrN4lFRiay0s7PyK5Oc-uuba0AZhrAIf160YL8M Nov 01 18:56:21.651938 n-d-863052-2 devstack@n-api.service[121403]: X-Domain-Id: None Nov 01 18:56:21.651938 n-d-863052-2 devstack@n-api.service[121403]: X-Domain-Name: None Nov 01 18:56:21.651938 n-d-863052-2 devstack@n-api.service[121403]: X-Identity-Status: Confirmed Nov 01 18:56:21.651938 n-d-863052-2 devstack@n-api.service[121403]: X-Is-Admin-Project: True Nov 01 18:56:21.651938 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Domain-Id: default Nov 01 18:56:21.651938 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Domain-Name: Default Nov 01 18:56:21.651938 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Id: e918416103c54aa6bf5bf1fd73f11cb8 Nov 01 18:56:21.651938 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Name: tempest-FloatingIPsNegativeTestJSON-2087211548 Nov 01 18:56:21.651938 n-d-863052-2 devstack@n-api.service[121403]: X-Role: member,reader Nov 01 18:56:21.651938 n-d-863052-2 devstack@n-api.service[121403]: X-Roles: member,reader Nov 01 18:56:21.653299 n-d-863052-2 devstack@n-api.service[121403]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/e918416103c54aa6bf5bf1fd73f11cb8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/e918416103c54aa6bf5bf1fd73f11cb8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_e918416103c54aa6bf5bf1fd73f11cb8", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/e918416103c54aa6bf5bf1fd73f11cb8"}]}] Nov 01 18:56:21.653299 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant: tempest-FloatingIPsNegativeTestJSON-2087211548 Nov 01 18:56:21.653299 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant-Id: e918416103c54aa6bf5bf1fd73f11cb8 Nov 01 18:56:21.653299 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant-Name: tempest-FloatingIPsNegativeTestJSON-2087211548 Nov 01 18:56:21.653299 n-d-863052-2 devstack@n-api.service[121403]: X-User: tempest-FloatingIPsNegativeTestJSON-2087211548-project Nov 01 18:56:21.653299 n-d-863052-2 devstack@n-api.service[121403]: X-User-Domain-Id: default Nov 01 18:56:21.653299 n-d-863052-2 devstack@n-api.service[121403]: X-User-Domain-Name: Default Nov 01 18:56:21.653299 n-d-863052-2 devstack@n-api.service[121403]: X-User-Id: ed2174dc91724932b1bc709aa401887c Nov 01 18:56:21.653299 n-d-863052-2 devstack@n-api.service[121403]: X-User-Name: tempest-FloatingIPsNegativeTestJSON-2087211548-project Nov 01 18:56:21.653299 n-d-863052-2 devstack@n-api.service[121403]: Nov 01 18:56:21.653299 n-d-863052-2 devstack@n-api.service[121403]: {"pool": "non_exist_pool"} Nov 01 18:56:21.653299 n-d-863052-2 devstack@n-api.service[121403]: method: Nov 01 18:56:21.653299 n-d-863052-2 devstack@n-api.service[121403]: exception: Floating IP pool not found. Nov 01 18:56:21.653299 n-d-863052-2 devstack@n-api.service[121403]: action_args: {'body': {'pool': 'non_exist_pool'}} Nov 01 18:56:21.653299 n-d-863052-2 devstack@n-api.service[121403]: {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 01 18:56:21.654244 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:56:21.654244 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 127, in create Nov 01 18:56:21.654244 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi address = self.network_api.allocate_floating_ip(context, pool) Nov 01 18:56:21.654244 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2972, in allocate_floating_ip Nov 01 18:56:21.654244 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi pool_id = self._get_floating_ip_pool_id_by_name_or_id(client, pool) Nov 01 18:56:21.654244 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2962, in _get_floating_ip_pool_id_by_name_or_id Nov 01 18:56:21.654244 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpPoolNotFound() Nov 01 18:56:21.654244 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpPoolNotFound: Floating IP pool not found. Nov 01 18:56:21.654244 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 18:56:21.654244 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 18:56:21.654244 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 18:56:21.654244 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:56:21.654244 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 18:56:21.654244 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 18:56:21.654244 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 01 18:56:21.654244 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 01 18:56:21.654244 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 01 18:56:21.654244 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 01 18:56:21.654244 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 01 18:56:21.654244 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 01 18:56:21.656255 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 142, in create Nov 01 18:56:21.656255 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Nov 01 18:56:21.656255 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP pool not found. Nov 01 18:56:21.656255 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 18:56:21.656255 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 18:56:21.656255 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 18:56:21.656255 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:56:21.656255 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 18:56:21.656255 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 18:56:21.656255 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 01 18:56:21.656255 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 01 18:56:21.656255 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP pool not found. Nov 01 18:56:21.656255 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 18:56:21.656255 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-33175bfc-d506-47e6-a122-2322c1980a5f tempest-FloatingIPsNegativeTestJSON-2087211548 tempest-FloatingIPsNegativeTestJSON-2087211548-project] Returning 404 to user: Floating IP pool not found. {{(pid=121403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 01 18:56:21.656255 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-33175bfc-d506-47e6-a122-2322c1980a5f tempest-FloatingIPsNegativeTestJSON-2087211548 tempest-FloatingIPsNegativeTestJSON-2087211548-project] 10.222.0.13 "POST /compute/v2.1/os-floating-ips" status: 404 len: 73 microversion: 2.1 time: 0.054718 Nov 01 18:56:21.657309 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 279/573] 10.222.0.13 () {60 vars in 1170 bytes} [Tue Nov 1 18:56:21 2022] POST /compute/v2.1/os-floating-ips => generated 73 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 01 18:56:21.663205 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-75e5af50-69ce-4f7a-b122-f6d3b8648ec4 tempest-FloatingIPsNegativeTestJSON-2087211548 tempest-FloatingIPsNegativeTestJSON-2087211548-project] Calling method '.version_select at 0x7f0ae2818ca0>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:56:21.681148 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-6cfc7214-889a-4353-be18-118cf5a465ac tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:56:21.681755 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-6cfc7214-889a-4353-be18-118cf5a465ac tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] [instance: ea631032-dd04-429b-988e-e6362ea42cf7] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:56:21.691646 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-6cfc7214-889a-4353-be18-118cf5a465ac tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:21.692535 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-6cfc7214-889a-4353-be18-118cf5a465ac tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:21.693029 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-6cfc7214-889a-4353-be18-118cf5a465ac tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:21.697862 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-6cfc7214-889a-4353-be18-118cf5a465ac tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:21.699517 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-6cfc7214-889a-4353-be18-118cf5a465ac tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:21.700144 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-6cfc7214-889a-4353-be18-118cf5a465ac tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:21.740451 n-d-863052-2 devstack@n-api.service[121402]: DEBUG neutronclient.v2_0.client [None req-75e5af50-69ce-4f7a-b122-f6d3b8648ec4 tempest-FloatingIPsNegativeTestJSON-2087211548 tempest-FloatingIPsNegativeTestJSON-2087211548-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 3b096490-b2c9-434b-b28b-1e5aee302e48 could not be found", "detail": ""}} {{(pid=121402) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Nov 01 18:56:21.741391 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.wsgi [None req-75e5af50-69ce-4f7a-b122-f6d3b8648ec4 tempest-FloatingIPsNegativeTestJSON-2087211548 tempest-FloatingIPsNegativeTestJSON-2087211548-project] HTTP exception thrown: Floating IP not found for ID 3b096490-b2c9-434b-b28b-1e5aee302e48 Nov 01 18:56:21.753657 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-75e5af50-69ce-4f7a-b122-f6d3b8648ec4 tempest-FloatingIPsNegativeTestJSON-2087211548 tempest-FloatingIPsNegativeTestJSON-2087211548-project] Request method failure captured: Nov 01 18:56:21.753657 n-d-863052-2 devstack@n-api.service[121402]: request: DELETE /compute/v2.1/os-floating-ips/3b096490-b2c9-434b-b28b-1e5aee302e48 HTTP/1.1 Nov 01 18:56:21.753657 n-d-863052-2 devstack@n-api.service[121402]: Accept: application/json Nov 01 18:56:21.753657 n-d-863052-2 devstack@n-api.service[121402]: Accept-Encoding: identity Nov 01 18:56:21.753657 n-d-863052-2 devstack@n-api.service[121402]: Connection: close Nov 01 18:56:21.753657 n-d-863052-2 devstack@n-api.service[121402]: Content-Length: 0 Nov 01 18:56:21.753657 n-d-863052-2 devstack@n-api.service[121402]: Content-Type: application/json Nov 01 18:56:21.753657 n-d-863052-2 devstack@n-api.service[121402]: Host: 10.222.0.13 Nov 01 18:56:21.753657 n-d-863052-2 devstack@n-api.service[121402]: Openstack-System-Scope: None Nov 01 18:56:21.753657 n-d-863052-2 devstack@n-api.service[121402]: User-Agent: python-urllib3/1.26.12 Nov 01 18:56:21.753657 n-d-863052-2 devstack@n-api.service[121402]: X-Auth-Token: gAAAAABjYWvV32FyJSNeqYsk7zJKZxne2onl01IvKCHWLFqLwrp-yw9wVHDoCskk9bC_NCWey7ymJdPCcbkxy6npwbAqJJoxGvrzofOPyo465boiNoukDVz3XXa_YQu2yB77zgEI1QoCJuupPrN4lFRiay0s7PyK5Oc-uuba0AZhrAIf160YL8M Nov 01 18:56:21.753657 n-d-863052-2 devstack@n-api.service[121402]: X-Domain-Id: None Nov 01 18:56:21.753657 n-d-863052-2 devstack@n-api.service[121402]: X-Domain-Name: None Nov 01 18:56:21.753657 n-d-863052-2 devstack@n-api.service[121402]: X-Identity-Status: Confirmed Nov 01 18:56:21.753657 n-d-863052-2 devstack@n-api.service[121402]: X-Is-Admin-Project: True Nov 01 18:56:21.753657 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Domain-Id: default Nov 01 18:56:21.753657 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Domain-Name: Default Nov 01 18:56:21.753657 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Id: e918416103c54aa6bf5bf1fd73f11cb8 Nov 01 18:56:21.753657 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Name: tempest-FloatingIPsNegativeTestJSON-2087211548 Nov 01 18:56:21.753657 n-d-863052-2 devstack@n-api.service[121402]: X-Role: member,reader Nov 01 18:56:21.753657 n-d-863052-2 devstack@n-api.service[121402]: X-Roles: member,reader Nov 01 18:56:21.755050 n-d-863052-2 devstack@n-api.service[121402]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/e918416103c54aa6bf5bf1fd73f11cb8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/e918416103c54aa6bf5bf1fd73f11cb8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_e918416103c54aa6bf5bf1fd73f11cb8", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/e918416103c54aa6bf5bf1fd73f11cb8"}]}] Nov 01 18:56:21.755050 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant: tempest-FloatingIPsNegativeTestJSON-2087211548 Nov 01 18:56:21.755050 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant-Id: e918416103c54aa6bf5bf1fd73f11cb8 Nov 01 18:56:21.755050 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant-Name: tempest-FloatingIPsNegativeTestJSON-2087211548 Nov 01 18:56:21.755050 n-d-863052-2 devstack@n-api.service[121402]: X-User: tempest-FloatingIPsNegativeTestJSON-2087211548-project Nov 01 18:56:21.755050 n-d-863052-2 devstack@n-api.service[121402]: X-User-Domain-Id: default Nov 01 18:56:21.755050 n-d-863052-2 devstack@n-api.service[121402]: X-User-Domain-Name: Default Nov 01 18:56:21.755050 n-d-863052-2 devstack@n-api.service[121402]: X-User-Id: ed2174dc91724932b1bc709aa401887c Nov 01 18:56:21.755050 n-d-863052-2 devstack@n-api.service[121402]: X-User-Name: tempest-FloatingIPsNegativeTestJSON-2087211548-project Nov 01 18:56:21.755050 n-d-863052-2 devstack@n-api.service[121402]: method: Nov 01 18:56:21.755050 n-d-863052-2 devstack@n-api.service[121402]: exception: Floating IP not found for ID 3b096490-b2c9-434b-b28b-1e5aee302e48 Nov 01 18:56:21.755050 n-d-863052-2 devstack@n-api.service[121402]: action_args: {'id': '3b096490-b2c9-434b-b28b-1e5aee302e48'} Nov 01 18:56:21.755050 n-d-863052-2 devstack@n-api.service[121402]: {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 01 18:56:21.756379 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:56:21.756379 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Nov 01 18:56:21.756379 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Nov 01 18:56:21.756379 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 01 18:56:21.756379 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 01 18:56:21.756379 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1008, in show_floatingip Nov 01 18:56:21.756379 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Nov 01 18:56:21.756379 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 01 18:56:21.756379 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 01 18:56:21.756379 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 01 18:56:21.756379 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 01 18:56:21.756379 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 01 18:56:21.756379 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 01 18:56:21.756379 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 01 18:56:21.756379 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 01 18:56:21.756379 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 01 18:56:21.756379 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 01 18:56:21.756379 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Nov 01 18:56:21.756379 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Nov 01 18:56:21.758848 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 01 18:56:21.758848 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 01 18:56:21.758848 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Nov 01 18:56:21.758848 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Nov 01 18:56:21.758848 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Nov 01 18:56:21.758848 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Nov 01 18:56:21.758848 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 3b096490-b2c9-434b-b28b-1e5aee302e48 could not be found Nov 01 18:56:21.758848 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e317a07e-b967-4e96-b2e0-37750c9afd04'] Nov 01 18:56:21.758848 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 18:56:21.758848 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 18:56:21.758848 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 18:56:21.758848 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:56:21.758848 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 158, in delete Nov 01 18:56:21.758848 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Nov 01 18:56:21.758848 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Nov 01 18:56:21.758848 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Nov 01 18:56:21.758848 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 3b096490-b2c9-434b-b28b-1e5aee302e48. Nov 01 18:56:21.758848 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 18:56:21.758848 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 18:56:21.758848 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 18:56:21.761373 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:56:21.761373 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 18:56:21.761373 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 18:56:21.761373 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 01 18:56:21.761373 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 01 18:56:21.761373 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 01 18:56:21.761373 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 01 18:56:21.761373 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 01 18:56:21.761373 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 01 18:56:21.761373 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 161, in delete Nov 01 18:56:21.761373 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Nov 01 18:56:21.761373 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 3b096490-b2c9-434b-b28b-1e5aee302e48 Nov 01 18:56:21.761373 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 18:56:21.761373 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 18:56:21.761373 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 18:56:21.761373 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:56:21.761373 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 18:56:21.761373 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 18:56:21.761373 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 01 18:56:21.761373 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 01 18:56:21.763674 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 3b096490-b2c9-434b-b28b-1e5aee302e48 Nov 01 18:56:21.763674 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 18:56:21.765133 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-75e5af50-69ce-4f7a-b122-f6d3b8648ec4 tempest-FloatingIPsNegativeTestJSON-2087211548 tempest-FloatingIPsNegativeTestJSON-2087211548-project] Returning 404 to user: Floating IP not found for ID 3b096490-b2c9-434b-b28b-1e5aee302e48 {{(pid=121402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 01 18:56:21.766195 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-75e5af50-69ce-4f7a-b122-f6d3b8648ec4 tempest-FloatingIPsNegativeTestJSON-2087211548 tempest-FloatingIPsNegativeTestJSON-2087211548-project] 10.222.0.13 "DELETE /compute/v2.1/os-floating-ips/3b096490-b2c9-434b-b28b-1e5aee302e48" status: 404 len: 111 microversion: 2.1 time: 0.106930 Nov 01 18:56:21.767277 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 295/574] 10.222.0.13 () {58 vars in 1263 bytes} [Tue Nov 1 18:56:21 2022] DELETE /compute/v2.1/os-floating-ips/3b096490-b2c9-434b-b28b-1e5aee302e48 => generated 111 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 01 18:56:21.893445 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-6cfc7214-889a-4353-be18-118cf5a465ac tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c1314c21d8547ff890ede1c2ad281c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c804370880454c7aa02cef2c2c3cf144', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:56:21.908056 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-6cfc7214-889a-4353-be18-118cf5a465ac tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c1314c21d8547ff890ede1c2ad281c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c804370880454c7aa02cef2c2c3cf144', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:56:21.914932 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-6cfc7214-889a-4353-be18-118cf5a465ac tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c1314c21d8547ff890ede1c2ad281c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c804370880454c7aa02cef2c2c3cf144', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:56:21.926428 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-6cfc7214-889a-4353-be18-118cf5a465ac tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] 10.222.0.13 "GET /compute/v2.1/servers/ea631032-dd04-429b-988e-e6362ea42cf7" status: 200 len: 1537 microversion: 2.91 time: 0.249180 Nov 01 18:56:21.930739 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 280/575] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 18:56:21 2022] GET /compute/v2.1/servers/ea631032-dd04-429b-988e-e6362ea42cf7 => generated 1537 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 18:56:22.094010 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-cc27cc8a-e8d8-4c0f-8715-d1441a7d3527 tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:56:22.095039 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-cc27cc8a-e8d8-4c0f-8715-d1441a7d3527 tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] [instance: ab3530ff-d70f-4c6c-abd0-3afa14fd9954] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:56:22.109137 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-cc27cc8a-e8d8-4c0f-8715-d1441a7d3527 tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:22.111816 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-cc27cc8a-e8d8-4c0f-8715-d1441a7d3527 tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:22.112794 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-cc27cc8a-e8d8-4c0f-8715-d1441a7d3527 tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:22.113794 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-cc27cc8a-e8d8-4c0f-8715-d1441a7d3527 tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:22.116722 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-cc27cc8a-e8d8-4c0f-8715-d1441a7d3527 tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:22.118402 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-cc27cc8a-e8d8-4c0f-8715-d1441a7d3527 tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:22.152642 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-fb0c4cb2-f5fc-4b7d-9f16-2c0c4e47ba6f tempest-ServerDiagnosticsNegativeTest-50806246 tempest-ServerDiagnosticsNegativeTest-50806246-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:56:22.154475 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-fb0c4cb2-f5fc-4b7d-9f16-2c0c4e47ba6f tempest-ServerDiagnosticsNegativeTest-50806246 tempest-ServerDiagnosticsNegativeTest-50806246-project] [instance: 7fe37e78-fffe-4261-b0cd-be9037a208d5] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:56:22.167025 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-fb0c4cb2-f5fc-4b7d-9f16-2c0c4e47ba6f tempest-ServerDiagnosticsNegativeTest-50806246 tempest-ServerDiagnosticsNegativeTest-50806246-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:22.167802 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-fb0c4cb2-f5fc-4b7d-9f16-2c0c4e47ba6f tempest-ServerDiagnosticsNegativeTest-50806246 tempest-ServerDiagnosticsNegativeTest-50806246-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:22.170825 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-fb0c4cb2-f5fc-4b7d-9f16-2c0c4e47ba6f tempest-ServerDiagnosticsNegativeTest-50806246 tempest-ServerDiagnosticsNegativeTest-50806246-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:22.171931 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-fb0c4cb2-f5fc-4b7d-9f16-2c0c4e47ba6f tempest-ServerDiagnosticsNegativeTest-50806246 tempest-ServerDiagnosticsNegativeTest-50806246-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:22.173167 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-fb0c4cb2-f5fc-4b7d-9f16-2c0c4e47ba6f tempest-ServerDiagnosticsNegativeTest-50806246 tempest-ServerDiagnosticsNegativeTest-50806246-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:22.174778 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-fb0c4cb2-f5fc-4b7d-9f16-2c0c4e47ba6f tempest-ServerDiagnosticsNegativeTest-50806246 tempest-ServerDiagnosticsNegativeTest-50806246-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:22.214472 n-d-863052-2 devstack@n-api.service[121403]: DEBUG dbcounter [-] [121403] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 18:56:22.584677 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-cc27cc8a-e8d8-4c0f-8715-d1441a7d3527 tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07a2a96629f4baea6a3adfc4011ffe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9baf3860ba564f5c8dff93085b9aabe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:56:22.594561 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-cc27cc8a-e8d8-4c0f-8715-d1441a7d3527 tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] 10.222.0.13 "GET /compute/v2.1/servers/ab3530ff-d70f-4c6c-abd0-3afa14fd9954" status: 200 len: 1588 microversion: 2.1 time: 0.506447 Nov 01 18:56:22.595122 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 296/576] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:56:22 2022] GET /compute/v2.1/servers/ab3530ff-d70f-4c6c-abd0-3afa14fd9954 => generated 1588 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:56:22.603724 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-e78ee922-ed70-4178-80b7-776822693bdb tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:56:22.604328 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-e78ee922-ed70-4178-80b7-776822693bdb tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] [instance: 58d02dff-26f6-4c2f-b886-cdbdccbfcec9] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:56:22.610808 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e78ee922-ed70-4178-80b7-776822693bdb tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:22.611470 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e78ee922-ed70-4178-80b7-776822693bdb tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:22.612047 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e78ee922-ed70-4178-80b7-776822693bdb tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:22.613468 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e78ee922-ed70-4178-80b7-776822693bdb tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:22.614565 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e78ee922-ed70-4178-80b7-776822693bdb tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:22.615710 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e78ee922-ed70-4178-80b7-776822693bdb tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:22.784686 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-fb0c4cb2-f5fc-4b7d-9f16-2c0c4e47ba6f tempest-ServerDiagnosticsNegativeTest-50806246 tempest-ServerDiagnosticsNegativeTest-50806246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8087408d8b947f8b603fdeaee878fee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '741e5c81bd1d4383a5faff2e2a3dbbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:56:22.805122 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-fb0c4cb2-f5fc-4b7d-9f16-2c0c4e47ba6f tempest-ServerDiagnosticsNegativeTest-50806246 tempest-ServerDiagnosticsNegativeTest-50806246-project] 10.222.0.13 "GET /compute/v2.1/servers/7fe37e78-fffe-4261-b0cd-be9037a208d5" status: 200 len: 1479 microversion: 2.1 time: 0.657424 Nov 01 18:56:22.808278 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 281/577] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:56:22 2022] GET /compute/v2.1/servers/7fe37e78-fffe-4261-b0cd-be9037a208d5 => generated 1479 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:56:22.813585 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-5dec3f10-d7d6-4c14-a0eb-223b01dd7644 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:56:22.814358 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-5dec3f10-d7d6-4c14-a0eb-223b01dd7644 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] [instance: 614eb691-9a9a-4ca0-933d-686d80cc0ef1] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:56:22.820406 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-5dec3f10-d7d6-4c14-a0eb-223b01dd7644 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:22.821117 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-5dec3f10-d7d6-4c14-a0eb-223b01dd7644 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:22.822025 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-5dec3f10-d7d6-4c14-a0eb-223b01dd7644 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:22.823144 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-5dec3f10-d7d6-4c14-a0eb-223b01dd7644 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:22.823588 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-5dec3f10-d7d6-4c14-a0eb-223b01dd7644 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:22.824417 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-5dec3f10-d7d6-4c14-a0eb-223b01dd7644 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:23.269111 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-e78ee922-ed70-4178-80b7-776822693bdb tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f32f5fba1976432d938e664c7714e52b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b9d4c236b944f9b2e8e502a50a8f8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:56:23.282553 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-e78ee922-ed70-4178-80b7-776822693bdb tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] 10.222.0.13 "GET /compute/v2.1/servers/58d02dff-26f6-4c2f-b886-cdbdccbfcec9" status: 200 len: 1310 microversion: 2.1 time: 0.680376 Nov 01 18:56:23.284913 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 297/578] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:56:22 2022] GET /compute/v2.1/servers/58d02dff-26f6-4c2f-b886-cdbdccbfcec9 => generated 1310 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:56:23.294484 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-2d4553cf-419c-4582-adac-3d536c33f356 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:56:23.296111 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-2d4553cf-419c-4582-adac-3d536c33f356 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] [instance: 2d3a927e-a478-40b1-8c92-80396c82f76c] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:56:23.311419 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2d4553cf-419c-4582-adac-3d536c33f356 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:23.315044 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2d4553cf-419c-4582-adac-3d536c33f356 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:23.315801 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2d4553cf-419c-4582-adac-3d536c33f356 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:23.316444 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2d4553cf-419c-4582-adac-3d536c33f356 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:23.316929 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2d4553cf-419c-4582-adac-3d536c33f356 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:23.320132 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2d4553cf-419c-4582-adac-3d536c33f356 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:23.500986 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-5dec3f10-d7d6-4c14-a0eb-223b01dd7644 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72117f17294649d6b8bc16c66c7efab2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45d4c047d3c44324a27a27831236ab0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:56:23.525156 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-5dec3f10-d7d6-4c14-a0eb-223b01dd7644 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] 10.222.0.13 "GET /compute/v2.1/servers/614eb691-9a9a-4ca0-933d-686d80cc0ef1" status: 200 len: 1470 microversion: 2.1 time: 0.704982 Nov 01 18:56:23.545011 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 282/579] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:56:22 2022] GET /compute/v2.1/servers/614eb691-9a9a-4ca0-933d-686d80cc0ef1 => generated 1470 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:56:23.555376 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-2fa04b06-a92a-4f1a-9514-5838bc241d32 tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:56:23.556168 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-2fa04b06-a92a-4f1a-9514-5838bc241d32 tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] [instance: ab3530ff-d70f-4c6c-abd0-3afa14fd9954] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:56:23.575541 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-2fa04b06-a92a-4f1a-9514-5838bc241d32 tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:23.577092 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-2fa04b06-a92a-4f1a-9514-5838bc241d32 tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:23.577723 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-2fa04b06-a92a-4f1a-9514-5838bc241d32 tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:23.579031 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-2fa04b06-a92a-4f1a-9514-5838bc241d32 tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:23.579680 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-2fa04b06-a92a-4f1a-9514-5838bc241d32 tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:23.580960 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-2fa04b06-a92a-4f1a-9514-5838bc241d32 tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:23.743358 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-2d4553cf-419c-4582-adac-3d536c33f356 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:56:23.750496 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-2fa04b06-a92a-4f1a-9514-5838bc241d32 tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] 10.222.0.13 "GET /compute/v2.1/servers/ab3530ff-d70f-4c6c-abd0-3afa14fd9954/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.204078 Nov 01 18:56:23.752062 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 283/580] 10.222.0.13 () {58 vars in 1275 bytes} [Tue Nov 1 18:56:23 2022] GET /compute/v2.1/servers/ab3530ff-d70f-4c6c-abd0-3afa14fd9954/os-interface => generated 284 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 18:56:23.753742 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-2d4553cf-419c-4582-adac-3d536c33f356 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:56:23.761730 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-2d4553cf-419c-4582-adac-3d536c33f356 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:56:23.763590 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-2d4553cf-419c-4582-adac-3d536c33f356 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] 10.222.0.13 "GET /compute/v2.1/servers/2d3a927e-a478-40b1-8c92-80396c82f76c" status: 200 len: 1557 microversion: 2.25 time: 0.477547 Nov 01 18:56:23.764384 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 298/581] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 18:56:23 2022] GET /compute/v2.1/servers/2d3a927e-a478-40b1-8c92-80396c82f76c => generated 1557 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 18:56:23.772852 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [req-e70d8bd0-a92a-4d9a-8cb5-05c81369110e req-41027b07-693e-4c62-99f2-0d241a1d69a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7fe37e78-fffe-4261-b0cd-be9037a208d5", "name": "network-vif-deleted", "tag": "2d4e964c-336f-49a7-86d8-bfcacbbee6b8"}]} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 18:56:23.773425 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-3268162b-3d13-4579-80ca-0a6c823f61ac tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:56:23.774064 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-3268162b-3d13-4579-80ca-0a6c823f61ac tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] [instance: ea631032-dd04-429b-988e-e6362ea42cf7] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:56:23.788197 n-d-863052-2 devstack@n-api.service[121403]: DEBUG dbcounter [-] [121403] Writing DB stats nova_api:UPDATE=10,nova_api:SELECT=89,nova_api:INSERT=1 {{(pid=121403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 18:56:23.793640 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-3268162b-3d13-4579-80ca-0a6c823f61ac tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:23.794165 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-3268162b-3d13-4579-80ca-0a6c823f61ac tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:23.794606 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-3268162b-3d13-4579-80ca-0a6c823f61ac tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:23.794895 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-e70d8bd0-a92a-4d9a-8cb5-05c81369110e req-41027b07-693e-4c62-99f2-0d241a1d69a2 service nova] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:23.795320 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-3268162b-3d13-4579-80ca-0a6c823f61ac tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:23.795767 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-3268162b-3d13-4579-80ca-0a6c823f61ac tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:23.796089 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-e70d8bd0-a92a-4d9a-8cb5-05c81369110e req-41027b07-693e-4c62-99f2-0d241a1d69a2 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:23.797247 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-3268162b-3d13-4579-80ca-0a6c823f61ac tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:23.797888 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-e70d8bd0-a92a-4d9a-8cb5-05c81369110e req-41027b07-693e-4c62-99f2-0d241a1d69a2 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:23.814397 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.compute.server_external_events [req-e70d8bd0-a92a-4d9a-8cb5-05c81369110e req-41027b07-693e-4c62-99f2-0d241a1d69a2 service nova] Creating event network-vif-deleted:2d4e964c-336f-49a7-86d8-bfcacbbee6b8 for instance 7fe37e78-fffe-4261-b0cd-be9037a208d5 on n-h1-863052-2 Nov 01 18:56:23.882493 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [req-e70d8bd0-a92a-4d9a-8cb5-05c81369110e req-41027b07-693e-4c62-99f2-0d241a1d69a2 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.116612 Nov 01 18:56:23.892288 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 299/582] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Nov 1 18:56:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 18:56:23.905094 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-c0be8156-5fa5-4873-ab0a-40a7c77a9aca tempest-LiveAutoBlockMigrationV225Test-1358532044 tempest-LiveAutoBlockMigrationV225Test-1358532044-project-admin] Calling method '.version_select at 0x7f0ae27d7f70>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:56:23.908974 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-c0be8156-5fa5-4873-ab0a-40a7c77a9aca tempest-LiveAutoBlockMigrationV225Test-1358532044 tempest-LiveAutoBlockMigrationV225Test-1358532044-project-admin] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:23.909469 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-c0be8156-5fa5-4873-ab0a-40a7c77a9aca tempest-LiveAutoBlockMigrationV225Test-1358532044 tempest-LiveAutoBlockMigrationV225Test-1358532044-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:23.909906 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-c0be8156-5fa5-4873-ab0a-40a7c77a9aca tempest-LiveAutoBlockMigrationV225Test-1358532044 tempest-LiveAutoBlockMigrationV225Test-1358532044-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:23.920286 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-c0be8156-5fa5-4873-ab0a-40a7c77a9aca tempest-LiveAutoBlockMigrationV225Test-1358532044 tempest-LiveAutoBlockMigrationV225Test-1358532044-project-admin] 10.222.0.13 "GET /compute/v2.1/os-migrations" status: 200 len: 1528 microversion: 2.25 time: 0.026215 Nov 01 18:56:23.920877 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 300/583] 10.222.0.13 () {60 vars in 1184 bytes} [Tue Nov 1 18:56:23 2022] GET /compute/v2.1/os-migrations => generated 1528 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 18:56:23.930893 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-aa599a6a-0a39-4f6c-b740-8216952de4bd tempest-ServerDiagnosticsNegativeTest-50806246 tempest-ServerDiagnosticsNegativeTest-50806246-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:56:23.932296 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-aa599a6a-0a39-4f6c-b740-8216952de4bd tempest-ServerDiagnosticsNegativeTest-50806246 tempest-ServerDiagnosticsNegativeTest-50806246-project] [instance: 7fe37e78-fffe-4261-b0cd-be9037a208d5] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:56:23.940478 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-aa599a6a-0a39-4f6c-b740-8216952de4bd tempest-ServerDiagnosticsNegativeTest-50806246 tempest-ServerDiagnosticsNegativeTest-50806246-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:23.941210 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-aa599a6a-0a39-4f6c-b740-8216952de4bd tempest-ServerDiagnosticsNegativeTest-50806246 tempest-ServerDiagnosticsNegativeTest-50806246-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:23.941647 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-aa599a6a-0a39-4f6c-b740-8216952de4bd tempest-ServerDiagnosticsNegativeTest-50806246 tempest-ServerDiagnosticsNegativeTest-50806246-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:23.942343 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-aa599a6a-0a39-4f6c-b740-8216952de4bd tempest-ServerDiagnosticsNegativeTest-50806246 tempest-ServerDiagnosticsNegativeTest-50806246-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:23.942794 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-aa599a6a-0a39-4f6c-b740-8216952de4bd tempest-ServerDiagnosticsNegativeTest-50806246 tempest-ServerDiagnosticsNegativeTest-50806246-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:23.945984 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-aa599a6a-0a39-4f6c-b740-8216952de4bd tempest-ServerDiagnosticsNegativeTest-50806246 tempest-ServerDiagnosticsNegativeTest-50806246-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:24.019120 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-aa599a6a-0a39-4f6c-b740-8216952de4bd tempest-ServerDiagnosticsNegativeTest-50806246 tempest-ServerDiagnosticsNegativeTest-50806246-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:24.020354 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-aa599a6a-0a39-4f6c-b740-8216952de4bd tempest-ServerDiagnosticsNegativeTest-50806246 tempest-ServerDiagnosticsNegativeTest-50806246-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:24.020950 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-aa599a6a-0a39-4f6c-b740-8216952de4bd tempest-ServerDiagnosticsNegativeTest-50806246 tempest-ServerDiagnosticsNegativeTest-50806246-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:24.021705 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.objects.instance [None req-aa599a6a-0a39-4f6c-b740-8216952de4bd tempest-ServerDiagnosticsNegativeTest-50806246 tempest-ServerDiagnosticsNegativeTest-50806246-project] Lazy-loading 'fault' on Instance uuid 7fe37e78-fffe-4261-b0cd-be9037a208d5 {{(pid=121402) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 01 18:56:24.030731 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-3268162b-3d13-4579-80ca-0a6c823f61ac tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c1314c21d8547ff890ede1c2ad281c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c804370880454c7aa02cef2c2c3cf144', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:56:24.046377 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-3268162b-3d13-4579-80ca-0a6c823f61ac tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c1314c21d8547ff890ede1c2ad281c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c804370880454c7aa02cef2c2c3cf144', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:56:24.051842 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-3268162b-3d13-4579-80ca-0a6c823f61ac tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c1314c21d8547ff890ede1c2ad281c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c804370880454c7aa02cef2c2c3cf144', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:56:24.075860 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-3268162b-3d13-4579-80ca-0a6c823f61ac tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] 10.222.0.13 "GET /compute/v2.1/servers/ea631032-dd04-429b-988e-e6362ea42cf7" status: 200 len: 1537 microversion: 2.91 time: 0.321591 Nov 01 18:56:24.076374 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 284/584] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 18:56:23 2022] GET /compute/v2.1/servers/ea631032-dd04-429b-988e-e6362ea42cf7 => generated 1537 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 18:56:24.098732 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-f60518e2-7e4e-486f-a07a-93a017039099 tempest-LiveAutoBlockMigrationV225Test-1358532044 tempest-LiveAutoBlockMigrationV225Test-1358532044-project-admin] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:56:24.099824 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-f60518e2-7e4e-486f-a07a-93a017039099 tempest-LiveAutoBlockMigrationV225Test-1358532044 tempest-LiveAutoBlockMigrationV225Test-1358532044-project-admin] [instance: 2d3a927e-a478-40b1-8c92-80396c82f76c] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:56:24.110808 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f60518e2-7e4e-486f-a07a-93a017039099 tempest-LiveAutoBlockMigrationV225Test-1358532044 tempest-LiveAutoBlockMigrationV225Test-1358532044-project-admin] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:24.111302 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f60518e2-7e4e-486f-a07a-93a017039099 tempest-LiveAutoBlockMigrationV225Test-1358532044 tempest-LiveAutoBlockMigrationV225Test-1358532044-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:24.111765 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f60518e2-7e4e-486f-a07a-93a017039099 tempest-LiveAutoBlockMigrationV225Test-1358532044 tempest-LiveAutoBlockMigrationV225Test-1358532044-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:24.122500 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f60518e2-7e4e-486f-a07a-93a017039099 tempest-LiveAutoBlockMigrationV225Test-1358532044 tempest-LiveAutoBlockMigrationV225Test-1358532044-project-admin] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:24.123083 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f60518e2-7e4e-486f-a07a-93a017039099 tempest-LiveAutoBlockMigrationV225Test-1358532044 tempest-LiveAutoBlockMigrationV225Test-1358532044-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:24.123521 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f60518e2-7e4e-486f-a07a-93a017039099 tempest-LiveAutoBlockMigrationV225Test-1358532044 tempest-LiveAutoBlockMigrationV225Test-1358532044-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:24.179227 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-aa599a6a-0a39-4f6c-b740-8216952de4bd tempest-ServerDiagnosticsNegativeTest-50806246 tempest-ServerDiagnosticsNegativeTest-50806246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8087408d8b947f8b603fdeaee878fee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '741e5c81bd1d4383a5faff2e2a3dbbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:56:24.197097 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-aa599a6a-0a39-4f6c-b740-8216952de4bd tempest-ServerDiagnosticsNegativeTest-50806246 tempest-ServerDiagnosticsNegativeTest-50806246-project] 10.222.0.13 "GET /compute/v2.1/servers/7fe37e78-fffe-4261-b0cd-be9037a208d5" status: 200 len: 1313 microversion: 2.1 time: 0.274845 Nov 01 18:56:24.205054 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 301/585] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:56:23 2022] GET /compute/v2.1/servers/7fe37e78-fffe-4261-b0cd-be9037a208d5 => generated 1313 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:56:24.309175 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-0b26c528-df11-492f-ac0e-77b9d1addda8 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:56:24.310109 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-0b26c528-df11-492f-ac0e-77b9d1addda8 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] [instance: 58d02dff-26f6-4c2f-b886-cdbdccbfcec9] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:56:24.334701 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-0b26c528-df11-492f-ac0e-77b9d1addda8 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:24.346281 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-0b26c528-df11-492f-ac0e-77b9d1addda8 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:24.346888 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-0b26c528-df11-492f-ac0e-77b9d1addda8 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:24.347766 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-0b26c528-df11-492f-ac0e-77b9d1addda8 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:24.349974 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-0b26c528-df11-492f-ac0e-77b9d1addda8 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:24.350707 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-0b26c528-df11-492f-ac0e-77b9d1addda8 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:24.612695 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.objects.instance [None req-f60518e2-7e4e-486f-a07a-93a017039099 tempest-LiveAutoBlockMigrationV225Test-1358532044 tempest-LiveAutoBlockMigrationV225Test-1358532044-project-admin] Lazy-loading 'services' on Instance uuid 2d3a927e-a478-40b1-8c92-80396c82f76c {{(pid=121403) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 01 18:56:24.651915 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-f60518e2-7e4e-486f-a07a-93a017039099 tempest-LiveAutoBlockMigrationV225Test-1358532044 tempest-LiveAutoBlockMigrationV225Test-1358532044-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/2d3a927e-a478-40b1-8c92-80396c82f76c" status: 200 len: 2049 microversion: 2.25 time: 0.569305 Nov 01 18:56:24.653232 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 285/586] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 18:56:24 2022] GET /compute/v2.1/servers/2d3a927e-a478-40b1-8c92-80396c82f76c => generated 2049 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 18:56:24.678281 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-a6b1da72-5490-4b21-9b30-c528c1678160 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:56:24.679301 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-a6b1da72-5490-4b21-9b30-c528c1678160 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] [instance: 614eb691-9a9a-4ca0-933d-686d80cc0ef1] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:56:24.686277 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-a6b1da72-5490-4b21-9b30-c528c1678160 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:24.687077 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-a6b1da72-5490-4b21-9b30-c528c1678160 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:24.688201 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-a6b1da72-5490-4b21-9b30-c528c1678160 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:24.689832 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-a6b1da72-5490-4b21-9b30-c528c1678160 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:24.690526 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-a6b1da72-5490-4b21-9b30-c528c1678160 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:24.691159 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-a6b1da72-5490-4b21-9b30-c528c1678160 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:24.980086 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-a6b1da72-5490-4b21-9b30-c528c1678160 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72117f17294649d6b8bc16c66c7efab2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45d4c047d3c44324a27a27831236ab0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:56:24.988438 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-a6b1da72-5490-4b21-9b30-c528c1678160 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] 10.222.0.13 "GET /compute/v2.1/servers/614eb691-9a9a-4ca0-933d-686d80cc0ef1" status: 200 len: 1470 microversion: 2.1 time: 0.333700 Nov 01 18:56:24.997893 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 286/587] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:56:24 2022] GET /compute/v2.1/servers/614eb691-9a9a-4ca0-933d-686d80cc0ef1 => generated 1470 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:56:25.018518 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-4f69f220-56b7-4630-81a3-262b26d9cdd0 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-412797263", "imageRef": "2d4a0047-1b9e-445f-8af8-1b5c9d93e881", "flavorRef": "452", "networks": [{"uuid": "fca4c402-6e8d-4413-8958-dd7eef1647f7"}]}} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 18:56:25.101596 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-0b26c528-df11-492f-ac0e-77b9d1addda8 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f32f5fba1976432d938e664c7714e52b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b9d4c236b944f9b2e8e502a50a8f8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:56:25.113777 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-0b26c528-df11-492f-ac0e-77b9d1addda8 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] 10.222.0.13 "GET /compute/v2.1/servers/58d02dff-26f6-4c2f-b886-cdbdccbfcec9" status: 200 len: 1310 microversion: 2.1 time: 0.809732 Nov 01 18:56:25.115578 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.network.neutron [None req-4f69f220-56b7-4630-81a3-262b26d9cdd0 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] validate_networks() for [('fca4c402-6e8d-4413-8958-dd7eef1647f7', None, None, None, None, None)] {{(pid=121403) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 01 18:56:25.116243 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 302/588] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:56:24 2022] GET /compute/v2.1/servers/58d02dff-26f6-4c2f-b886-cdbdccbfcec9 => generated 1310 bytes in 815 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:56:25.124388 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [req-f25eb491-c560-4415-974c-fe2c9cca8d82 req-ce14b86d-0676-448a-a872-77bd60f0eef1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58d02dff-26f6-4c2f-b886-cdbdccbfcec9", "name": "network-vif-plugged", "status": "completed", "tag": "8434dc9d-ed20-488e-a620-72caae7c1bd3"}]} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 18:56:25.152684 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-f25eb491-c560-4415-974c-fe2c9cca8d82 req-ce14b86d-0676-448a-a872-77bd60f0eef1 service nova] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:25.153171 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-f25eb491-c560-4415-974c-fe2c9cca8d82 req-ce14b86d-0676-448a-a872-77bd60f0eef1 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:25.153605 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-f25eb491-c560-4415-974c-fe2c9cca8d82 req-ce14b86d-0676-448a-a872-77bd60f0eef1 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:25.171807 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.compute.server_external_events [req-f25eb491-c560-4415-974c-fe2c9cca8d82 req-ce14b86d-0676-448a-a872-77bd60f0eef1 service nova] Creating event network-vif-plugged:8434dc9d-ed20-488e-a620-72caae7c1bd3 for instance 58d02dff-26f6-4c2f-b886-cdbdccbfcec9 on n-h1-863052-2 Nov 01 18:56:25.186598 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [req-f25eb491-c560-4415-974c-fe2c9cca8d82 req-ce14b86d-0676-448a-a872-77bd60f0eef1 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061388 Nov 01 18:56:25.187810 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 303/589] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Nov 1 18:56:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 18:56:25.193655 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-22b8f979-8a81-405f-adbc-b0f6cd45de8f tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:56:25.194342 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-22b8f979-8a81-405f-adbc-b0f6cd45de8f tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] [instance: ea631032-dd04-429b-988e-e6362ea42cf7] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:56:25.220407 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-22b8f979-8a81-405f-adbc-b0f6cd45de8f tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:25.220969 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-22b8f979-8a81-405f-adbc-b0f6cd45de8f tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:25.221603 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-22b8f979-8a81-405f-adbc-b0f6cd45de8f tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:25.222565 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-22b8f979-8a81-405f-adbc-b0f6cd45de8f tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:25.223026 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-22b8f979-8a81-405f-adbc-b0f6cd45de8f tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:25.233038 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-22b8f979-8a81-405f-adbc-b0f6cd45de8f tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:25.357665 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-22b8f979-8a81-405f-adbc-b0f6cd45de8f tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c1314c21d8547ff890ede1c2ad281c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c804370880454c7aa02cef2c2c3cf144', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:56:25.374067 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-22b8f979-8a81-405f-adbc-b0f6cd45de8f tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c1314c21d8547ff890ede1c2ad281c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c804370880454c7aa02cef2c2c3cf144', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:56:25.375929 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-22b8f979-8a81-405f-adbc-b0f6cd45de8f tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c1314c21d8547ff890ede1c2ad281c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c804370880454c7aa02cef2c2c3cf144', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:56:25.385647 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-22b8f979-8a81-405f-adbc-b0f6cd45de8f tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] 10.222.0.13 "GET /compute/v2.1/servers/ea631032-dd04-429b-988e-e6362ea42cf7" status: 200 len: 1537 microversion: 2.91 time: 0.195149 Nov 01 18:56:25.386908 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 304/590] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 18:56:25 2022] GET /compute/v2.1/servers/ea631032-dd04-429b-988e-e6362ea42cf7 => generated 1537 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 18:56:25.391787 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-f0638f5b-3be4-4de4-a6ee-5f1b3b8ccc39 tempest-ServerDiagnosticsNegativeTest-50806246 tempest-ServerDiagnosticsNegativeTest-50806246-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:56:25.410526 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-f0638f5b-3be4-4de4-a6ee-5f1b3b8ccc39 tempest-ServerDiagnosticsNegativeTest-50806246 tempest-ServerDiagnosticsNegativeTest-50806246-project] [instance: 7fe37e78-fffe-4261-b0cd-be9037a208d5] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:56:25.429800 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f0638f5b-3be4-4de4-a6ee-5f1b3b8ccc39 tempest-ServerDiagnosticsNegativeTest-50806246 tempest-ServerDiagnosticsNegativeTest-50806246-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:25.430293 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f0638f5b-3be4-4de4-a6ee-5f1b3b8ccc39 tempest-ServerDiagnosticsNegativeTest-50806246 tempest-ServerDiagnosticsNegativeTest-50806246-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:25.430724 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f0638f5b-3be4-4de4-a6ee-5f1b3b8ccc39 tempest-ServerDiagnosticsNegativeTest-50806246 tempest-ServerDiagnosticsNegativeTest-50806246-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:25.431428 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f0638f5b-3be4-4de4-a6ee-5f1b3b8ccc39 tempest-ServerDiagnosticsNegativeTest-50806246 tempest-ServerDiagnosticsNegativeTest-50806246-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:25.431877 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f0638f5b-3be4-4de4-a6ee-5f1b3b8ccc39 tempest-ServerDiagnosticsNegativeTest-50806246 tempest-ServerDiagnosticsNegativeTest-50806246-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:25.432293 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f0638f5b-3be4-4de4-a6ee-5f1b3b8ccc39 tempest-ServerDiagnosticsNegativeTest-50806246 tempest-ServerDiagnosticsNegativeTest-50806246-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:25.435327 n-d-863052-2 devstack@n-api.service[121402]: DEBUG dbcounter [-] [121402] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 18:56:25.460443 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.wsgi [None req-f0638f5b-3be4-4de4-a6ee-5f1b3b8ccc39 tempest-ServerDiagnosticsNegativeTest-50806246 tempest-ServerDiagnosticsNegativeTest-50806246-project] HTTP exception thrown: Instance 7fe37e78-fffe-4261-b0cd-be9037a208d5 could not be found. Nov 01 18:56:25.482668 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-f0638f5b-3be4-4de4-a6ee-5f1b3b8ccc39 tempest-ServerDiagnosticsNegativeTest-50806246 tempest-ServerDiagnosticsNegativeTest-50806246-project] Request method failure captured: Nov 01 18:56:25.482668 n-d-863052-2 devstack@n-api.service[121402]: request: GET /compute/v2.1/servers/7fe37e78-fffe-4261-b0cd-be9037a208d5 HTTP/1.1 Nov 01 18:56:25.482668 n-d-863052-2 devstack@n-api.service[121402]: Accept: application/json Nov 01 18:56:25.482668 n-d-863052-2 devstack@n-api.service[121402]: Accept-Encoding: identity Nov 01 18:56:25.482668 n-d-863052-2 devstack@n-api.service[121402]: Connection: close Nov 01 18:56:25.482668 n-d-863052-2 devstack@n-api.service[121402]: Content-Length: 0 Nov 01 18:56:25.482668 n-d-863052-2 devstack@n-api.service[121402]: Content-Type: application/json Nov 01 18:56:25.482668 n-d-863052-2 devstack@n-api.service[121402]: Host: 10.222.0.13 Nov 01 18:56:25.482668 n-d-863052-2 devstack@n-api.service[121402]: Openstack-System-Scope: None Nov 01 18:56:25.482668 n-d-863052-2 devstack@n-api.service[121402]: User-Agent: python-urllib3/1.26.12 Nov 01 18:56:25.482668 n-d-863052-2 devstack@n-api.service[121402]: X-Auth-Token: gAAAAABjYWu6JtA84MMF7nsfjOcbHjECyd0E5k96ddbFp3KWVXRj3d2TxqBYu0J_V-OXV78_4eClLy_AzFQERoVEBoAjGu6i-2YurVwR9XWLNQwUbeo8SVU1nQ2c1usk-7WO7J2rqCa2LvHoI8Ppat8HS45-kXMvCAkzWNCdoGb3q4R3EJPIRRM Nov 01 18:56:25.482668 n-d-863052-2 devstack@n-api.service[121402]: X-Domain-Id: None Nov 01 18:56:25.482668 n-d-863052-2 devstack@n-api.service[121402]: X-Domain-Name: None Nov 01 18:56:25.482668 n-d-863052-2 devstack@n-api.service[121402]: X-Identity-Status: Confirmed Nov 01 18:56:25.482668 n-d-863052-2 devstack@n-api.service[121402]: X-Is-Admin-Project: True Nov 01 18:56:25.482668 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Domain-Id: default Nov 01 18:56:25.482668 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Domain-Name: Default Nov 01 18:56:25.482668 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Id: 741e5c81bd1d4383a5faff2e2a3dbbf0 Nov 01 18:56:25.482668 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Name: tempest-ServerDiagnosticsNegativeTest-50806246 Nov 01 18:56:25.482668 n-d-863052-2 devstack@n-api.service[121402]: X-Role: member,reader Nov 01 18:56:25.482668 n-d-863052-2 devstack@n-api.service[121402]: X-Roles: member,reader Nov 01 18:56:25.484139 n-d-863052-2 devstack@n-api.service[121402]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/741e5c81bd1d4383a5faff2e2a3dbbf0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/741e5c81bd1d4383a5faff2e2a3dbbf0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_741e5c81bd1d4383a5faff2e2a3dbbf0", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/741e5c81bd1d4383a5faff2e2a3dbbf0"}]}] Nov 01 18:56:25.484139 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant: tempest-ServerDiagnosticsNegativeTest-50806246 Nov 01 18:56:25.484139 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant-Id: 741e5c81bd1d4383a5faff2e2a3dbbf0 Nov 01 18:56:25.484139 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant-Name: tempest-ServerDiagnosticsNegativeTest-50806246 Nov 01 18:56:25.484139 n-d-863052-2 devstack@n-api.service[121402]: X-User: tempest-ServerDiagnosticsNegativeTest-50806246-project Nov 01 18:56:25.484139 n-d-863052-2 devstack@n-api.service[121402]: X-User-Domain-Id: default Nov 01 18:56:25.484139 n-d-863052-2 devstack@n-api.service[121402]: X-User-Domain-Name: Default Nov 01 18:56:25.484139 n-d-863052-2 devstack@n-api.service[121402]: X-User-Id: a8087408d8b947f8b603fdeaee878fee Nov 01 18:56:25.484139 n-d-863052-2 devstack@n-api.service[121402]: X-User-Name: tempest-ServerDiagnosticsNegativeTest-50806246-project Nov 01 18:56:25.484139 n-d-863052-2 devstack@n-api.service[121402]: method: > Nov 01 18:56:25.484139 n-d-863052-2 devstack@n-api.service[121402]: exception: Instance 7fe37e78-fffe-4261-b0cd-be9037a208d5 could not be found. Nov 01 18:56:25.484139 n-d-863052-2 devstack@n-api.service[121402]: action_args: {'id': '7fe37e78-fffe-4261-b0cd-be9037a208d5'} Nov 01 18:56:25.485432 n-d-863052-2 devstack@n-api.service[121402]: {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 01 18:56:25.485432 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:56:25.485432 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 01 18:56:25.485432 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 01 18:56:25.485432 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 01 18:56:25.485432 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 01 18:56:25.485432 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 01 18:56:25.485432 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 01 18:56:25.485432 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 01 18:56:25.485432 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 01 18:56:25.485432 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7fe37e78-fffe-4261-b0cd-be9037a208d5 could not be found. Nov 01 18:56:25.485432 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 18:56:25.485432 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 18:56:25.485432 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 18:56:25.485432 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:56:25.485432 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 18:56:25.485432 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 18:56:25.485432 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 01 18:56:25.485432 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 01 18:56:25.485432 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 01 18:56:25.490823 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 01 18:56:25.490823 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 01 18:56:25.490823 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 01 18:56:25.490823 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 01 18:56:25.490823 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 01 18:56:25.490823 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 01 18:56:25.490823 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 01 18:56:25.490823 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7fe37e78-fffe-4261-b0cd-be9037a208d5 could not be found. Nov 01 18:56:25.490823 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 18:56:25.490823 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 18:56:25.490823 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 18:56:25.490823 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:56:25.490823 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 18:56:25.490823 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 18:56:25.490823 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 01 18:56:25.490823 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 01 18:56:25.490823 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7fe37e78-fffe-4261-b0cd-be9037a208d5 could not be found. Nov 01 18:56:25.490823 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 18:56:25.496173 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-f0638f5b-3be4-4de4-a6ee-5f1b3b8ccc39 tempest-ServerDiagnosticsNegativeTest-50806246 tempest-ServerDiagnosticsNegativeTest-50806246-project] Returning 404 to user: Instance 7fe37e78-fffe-4261-b0cd-be9037a208d5 could not be found. {{(pid=121402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 01 18:56:25.497629 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-f0638f5b-3be4-4de4-a6ee-5f1b3b8ccc39 tempest-ServerDiagnosticsNegativeTest-50806246 tempest-ServerDiagnosticsNegativeTest-50806246-project] 10.222.0.13 "GET /compute/v2.1/servers/7fe37e78-fffe-4261-b0cd-be9037a208d5" status: 404 len: 111 microversion: 2.1 time: 0.109563 Nov 01 18:56:25.503817 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 305/591] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:56:25 2022] GET /compute/v2.1/servers/7fe37e78-fffe-4261-b0cd-be9037a208d5 => generated 111 bytes in 116 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 01 18:56:26.025576 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-fd51d7f6-ef05-4df6-abb6-6607bbe5e963 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:56:26.026197 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-fd51d7f6-ef05-4df6-abb6-6607bbe5e963 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] [instance: 614eb691-9a9a-4ca0-933d-686d80cc0ef1] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:56:26.038350 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-fd51d7f6-ef05-4df6-abb6-6607bbe5e963 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:26.038875 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-fd51d7f6-ef05-4df6-abb6-6607bbe5e963 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:26.039319 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-fd51d7f6-ef05-4df6-abb6-6607bbe5e963 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:26.040034 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-fd51d7f6-ef05-4df6-abb6-6607bbe5e963 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:26.040501 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-fd51d7f6-ef05-4df6-abb6-6607bbe5e963 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:26.042833 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-fd51d7f6-ef05-4df6-abb6-6607bbe5e963 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:26.407207 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-fd51d7f6-ef05-4df6-abb6-6607bbe5e963 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72117f17294649d6b8bc16c66c7efab2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45d4c047d3c44324a27a27831236ab0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:56:26.417981 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-fd51d7f6-ef05-4df6-abb6-6607bbe5e963 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] 10.222.0.13 "GET /compute/v2.1/servers/614eb691-9a9a-4ca0-933d-686d80cc0ef1" status: 200 len: 1475 microversion: 2.1 time: 0.397214 Nov 01 18:56:26.420439 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 306/592] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:56:26 2022] GET /compute/v2.1/servers/614eb691-9a9a-4ca0-933d-686d80cc0ef1 => generated 1475 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 18:56:26.441314 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-83ea2bb1-f0ed-4788-ab26-f8122ffdd2e0 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:56:26.442188 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-83ea2bb1-f0ed-4788-ab26-f8122ffdd2e0 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] [instance: 58d02dff-26f6-4c2f-b886-cdbdccbfcec9] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:56:26.452323 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-83ea2bb1-f0ed-4788-ab26-f8122ffdd2e0 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:26.454177 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-83ea2bb1-f0ed-4788-ab26-f8122ffdd2e0 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:26.454955 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-83ea2bb1-f0ed-4788-ab26-f8122ffdd2e0 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:26.457764 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-83ea2bb1-f0ed-4788-ab26-f8122ffdd2e0 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:26.458428 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-83ea2bb1-f0ed-4788-ab26-f8122ffdd2e0 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:26.459530 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-83ea2bb1-f0ed-4788-ab26-f8122ffdd2e0 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:26.682293 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.virt.hardware [None req-4f69f220-56b7-4630-81a3-262b26d9cdd0 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Flavor limits 0:0:0 {{(pid=121403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 01 18:56:26.683324 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.virt.hardware [None req-4f69f220-56b7-4630-81a3-262b26d9cdd0 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Image limits 0:0:0 {{(pid=121403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 01 18:56:26.683963 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.virt.hardware [None req-4f69f220-56b7-4630-81a3-262b26d9cdd0 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Flavor pref 0:0:0 {{(pid=121403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 01 18:56:26.684524 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.virt.hardware [None req-4f69f220-56b7-4630-81a3-262b26d9cdd0 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Image pref 0:0:0 {{(pid=121403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 01 18:56:26.685272 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.virt.hardware [None req-4f69f220-56b7-4630-81a3-262b26d9cdd0 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 01 18:56:26.707785 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-4f69f220-56b7-4630-81a3-262b26d9cdd0 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:26.709349 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-4f69f220-56b7-4630-81a3-262b26d9cdd0 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:26.710039 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-4f69f220-56b7-4630-81a3-262b26d9cdd0 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:26.713060 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-4f69f220-56b7-4630-81a3-262b26d9cdd0 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:26.713770 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-4f69f220-56b7-4630-81a3-262b26d9cdd0 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:26.714407 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-4f69f220-56b7-4630-81a3-262b26d9cdd0 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:26.763880 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.quota [None req-4f69f220-56b7-4630-81a3-262b26d9cdd0 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Getting quotas for project 75730f90ec924cbebd605d6d6d747efe. Resources: {'cores', 'ram', 'instances'} {{(pid=121403) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 01 18:56:26.789828 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.quota [None req-4f69f220-56b7-4630-81a3-262b26d9cdd0 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Getting quotas for user c2ddf0211c374fe2a0db89546beb8e96 and project 75730f90ec924cbebd605d6d6d747efe. Resources: {'cores', 'ram', 'instances'} {{(pid=121403) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 01 18:56:26.817456 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-4f69f220-56b7-4630-81a3-262b26d9cdd0 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Going to run 1 instances... {{(pid=121403) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 01 18:56:26.823828 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-4f69f220-56b7-4630-81a3-262b26d9cdd0 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] [instance: bee52bae-2df5-46a3-9aa9-f6b24bea11e3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2d4a0047-1b9e-445f-8af8-1b5c9d93e881',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121403) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 01 18:56:26.844498 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-83ea2bb1-f0ed-4788-ab26-f8122ffdd2e0 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f32f5fba1976432d938e664c7714e52b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b9d4c236b944f9b2e8e502a50a8f8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:56:26.856455 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-83ea2bb1-f0ed-4788-ab26-f8122ffdd2e0 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] 10.222.0.13 "GET /compute/v2.1/servers/58d02dff-26f6-4c2f-b886-cdbdccbfcec9" status: 200 len: 1310 microversion: 2.1 time: 0.433643 Nov 01 18:56:26.867972 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 307/593] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:56:26 2022] GET /compute/v2.1/servers/58d02dff-26f6-4c2f-b886-cdbdccbfcec9 => generated 1310 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:56:26.877804 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-7d50b980-c3d6-40dd-9a1f-6f0e5a1331af tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:56:26.878721 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-7d50b980-c3d6-40dd-9a1f-6f0e5a1331af tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] [instance: ea631032-dd04-429b-988e-e6362ea42cf7] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:56:26.887579 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-4f69f220-56b7-4630-81a3-262b26d9cdd0 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 1.888425 Nov 01 18:56:26.890520 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 287/594] 10.222.0.13 () {62 vars in 1188 bytes} [Tue Nov 1 18:56:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 1892 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Nov 01 18:56:26.909092 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-7d50b980-c3d6-40dd-9a1f-6f0e5a1331af tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:26.909562 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-c7ba3f05-46f8-4bed-9457-1f6d44674791 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:56:26.910041 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-7d50b980-c3d6-40dd-9a1f-6f0e5a1331af tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:26.910701 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-7d50b980-c3d6-40dd-9a1f-6f0e5a1331af tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:26.910827 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-c7ba3f05-46f8-4bed-9457-1f6d44674791 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] [instance: bee52bae-2df5-46a3-9aa9-f6b24bea11e3] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:56:26.911897 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-7d50b980-c3d6-40dd-9a1f-6f0e5a1331af tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:26.912556 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-7d50b980-c3d6-40dd-9a1f-6f0e5a1331af tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:26.913514 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-7d50b980-c3d6-40dd-9a1f-6f0e5a1331af tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:27.032026 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-c7ba3f05-46f8-4bed-9457-1f6d44674791 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:56:27.040191 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-c7ba3f05-46f8-4bed-9457-1f6d44674791 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:56:27.041753 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-c7ba3f05-46f8-4bed-9457-1f6d44674791 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:56:27.043603 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-c7ba3f05-46f8-4bed-9457-1f6d44674791 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] 10.222.0.13 "GET /compute/v2.1/servers/bee52bae-2df5-46a3-9aa9-f6b24bea11e3" status: 200 len: 1261 microversion: 2.25 time: 0.144930 Nov 01 18:56:27.058976 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 288/595] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 18:56:26 2022] GET /compute/v2.1/servers/bee52bae-2df5-46a3-9aa9-f6b24bea11e3 => generated 1261 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 18:56:27.156313 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-e075c2da-2807-4e17-888e-bb14cef4d258 tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:56:27.157191 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-e075c2da-2807-4e17-888e-bb14cef4d258 tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] [instance: ab3530ff-d70f-4c6c-abd0-3afa14fd9954] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:56:27.165024 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-e075c2da-2807-4e17-888e-bb14cef4d258 tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:27.166089 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-e075c2da-2807-4e17-888e-bb14cef4d258 tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:27.167207 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-e075c2da-2807-4e17-888e-bb14cef4d258 tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:27.168260 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-e075c2da-2807-4e17-888e-bb14cef4d258 tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:27.168949 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-e075c2da-2807-4e17-888e-bb14cef4d258 tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:27.169580 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-e075c2da-2807-4e17-888e-bb14cef4d258 tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:27.310042 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-7d50b980-c3d6-40dd-9a1f-6f0e5a1331af tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c1314c21d8547ff890ede1c2ad281c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c804370880454c7aa02cef2c2c3cf144', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:56:27.328051 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-7d50b980-c3d6-40dd-9a1f-6f0e5a1331af tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c1314c21d8547ff890ede1c2ad281c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c804370880454c7aa02cef2c2c3cf144', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:56:27.336742 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-7d50b980-c3d6-40dd-9a1f-6f0e5a1331af tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c1314c21d8547ff890ede1c2ad281c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c804370880454c7aa02cef2c2c3cf144', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:56:27.348809 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-7d50b980-c3d6-40dd-9a1f-6f0e5a1331af tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] 10.222.0.13 "GET /compute/v2.1/servers/ea631032-dd04-429b-988e-e6362ea42cf7" status: 200 len: 1537 microversion: 2.91 time: 0.479526 Nov 01 18:56:27.349449 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 308/596] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 18:56:26 2022] GET /compute/v2.1/servers/ea631032-dd04-429b-988e-e6362ea42cf7 => generated 1537 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 18:56:27.374335 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [req-cd1f8f41-25e5-4399-8155-f054c9b0fa76 req-8dac2155-8aa3-408c-a571-0d2462bcb722 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ab3530ff-d70f-4c6c-abd0-3afa14fd9954", "tag": "5a8ac51b-9c28-4dee-aa83-db1236898e3d"}]} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 18:56:27.417058 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-cd1f8f41-25e5-4399-8155-f054c9b0fa76 req-8dac2155-8aa3-408c-a571-0d2462bcb722 service nova] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:27.422318 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-cd1f8f41-25e5-4399-8155-f054c9b0fa76 req-8dac2155-8aa3-408c-a571-0d2462bcb722 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:27.422816 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-cd1f8f41-25e5-4399-8155-f054c9b0fa76 req-8dac2155-8aa3-408c-a571-0d2462bcb722 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:27.443802 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.compute.server_external_events [req-cd1f8f41-25e5-4399-8155-f054c9b0fa76 req-8dac2155-8aa3-408c-a571-0d2462bcb722 service nova] Creating event network-changed:5a8ac51b-9c28-4dee-aa83-db1236898e3d for instance ab3530ff-d70f-4c6c-abd0-3afa14fd9954 on n-h2-863052-2 Nov 01 18:56:27.458211 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [req-cd1f8f41-25e5-4399-8155-f054c9b0fa76 req-8dac2155-8aa3-408c-a571-0d2462bcb722 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100771 Nov 01 18:56:27.461396 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 309/597] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Nov 1 18:56:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 18:56:27.478118 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-7b90a173-2356-4598-9d26-16f79c35f2e9 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:56:27.479142 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-7b90a173-2356-4598-9d26-16f79c35f2e9 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] [instance: 614eb691-9a9a-4ca0-933d-686d80cc0ef1] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:56:27.495376 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-7b90a173-2356-4598-9d26-16f79c35f2e9 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:27.497228 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-7b90a173-2356-4598-9d26-16f79c35f2e9 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:27.498461 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-7b90a173-2356-4598-9d26-16f79c35f2e9 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:27.500124 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-7b90a173-2356-4598-9d26-16f79c35f2e9 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:27.501893 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-7b90a173-2356-4598-9d26-16f79c35f2e9 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:27.502736 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-7b90a173-2356-4598-9d26-16f79c35f2e9 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:27.512896 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-e075c2da-2807-4e17-888e-bb14cef4d258 tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07a2a96629f4baea6a3adfc4011ffe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9baf3860ba564f5c8dff93085b9aabe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:56:27.525940 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-e075c2da-2807-4e17-888e-bb14cef4d258 tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] 10.222.0.13 "GET /compute/v2.1/servers/ab3530ff-d70f-4c6c-abd0-3afa14fd9954" status: 200 len: 1588 microversion: 2.1 time: 0.373554 Nov 01 18:56:27.529608 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 289/598] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:56:27 2022] GET /compute/v2.1/servers/ab3530ff-d70f-4c6c-abd0-3afa14fd9954 => generated 1588 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:56:27.885562 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-5979dd36-9886-4f4d-bd8a-c36ef2c97442 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:56:27.886889 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-5979dd36-9886-4f4d-bd8a-c36ef2c97442 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] [instance: 58d02dff-26f6-4c2f-b886-cdbdccbfcec9] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:56:27.904385 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-5979dd36-9886-4f4d-bd8a-c36ef2c97442 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:27.909003 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-5979dd36-9886-4f4d-bd8a-c36ef2c97442 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:27.910254 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-5979dd36-9886-4f4d-bd8a-c36ef2c97442 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:27.917015 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-5979dd36-9886-4f4d-bd8a-c36ef2c97442 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:27.918137 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-5979dd36-9886-4f4d-bd8a-c36ef2c97442 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:27.923686 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-5979dd36-9886-4f4d-bd8a-c36ef2c97442 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:28.073500 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-7b90a173-2356-4598-9d26-16f79c35f2e9 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72117f17294649d6b8bc16c66c7efab2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45d4c047d3c44324a27a27831236ab0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:56:28.084668 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-7b90a173-2356-4598-9d26-16f79c35f2e9 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] 10.222.0.13 "GET /compute/v2.1/servers/614eb691-9a9a-4ca0-933d-686d80cc0ef1" status: 200 len: 1475 microversion: 2.1 time: 0.619791 Nov 01 18:56:28.085259 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 310/599] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:56:27 2022] GET /compute/v2.1/servers/614eb691-9a9a-4ca0-933d-686d80cc0ef1 => generated 1475 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:56:28.089734 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-c00a6ad2-9d2d-4eb2-a8f1-952f1e92622e tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:56:28.090330 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-c00a6ad2-9d2d-4eb2-a8f1-952f1e92622e tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] [instance: bee52bae-2df5-46a3-9aa9-f6b24bea11e3] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:56:28.118758 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-c00a6ad2-9d2d-4eb2-a8f1-952f1e92622e tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:28.119454 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-c00a6ad2-9d2d-4eb2-a8f1-952f1e92622e tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:28.120044 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-c00a6ad2-9d2d-4eb2-a8f1-952f1e92622e tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:28.120940 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-c00a6ad2-9d2d-4eb2-a8f1-952f1e92622e tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:28.121604 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-c00a6ad2-9d2d-4eb2-a8f1-952f1e92622e tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:28.122178 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-c00a6ad2-9d2d-4eb2-a8f1-952f1e92622e tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:28.252949 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-c00a6ad2-9d2d-4eb2-a8f1-952f1e92622e tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:56:28.261110 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-c00a6ad2-9d2d-4eb2-a8f1-952f1e92622e tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:56:28.263101 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-c00a6ad2-9d2d-4eb2-a8f1-952f1e92622e tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:56:28.264406 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-c00a6ad2-9d2d-4eb2-a8f1-952f1e92622e tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] 10.222.0.13 "GET /compute/v2.1/servers/bee52bae-2df5-46a3-9aa9-f6b24bea11e3" status: 200 len: 1313 microversion: 2.25 time: 0.178239 Nov 01 18:56:28.265154 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 311/600] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 18:56:28 2022] GET /compute/v2.1/servers/bee52bae-2df5-46a3-9aa9-f6b24bea11e3 => generated 1313 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 18:56:28.378263 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-eab1a86c-4890-4f3d-89b5-3427cbd60467 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:56:28.378982 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-eab1a86c-4890-4f3d-89b5-3427cbd60467 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] [instance: ea631032-dd04-429b-988e-e6362ea42cf7] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:56:28.389136 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-eab1a86c-4890-4f3d-89b5-3427cbd60467 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:28.389775 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-eab1a86c-4890-4f3d-89b5-3427cbd60467 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:28.390301 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-eab1a86c-4890-4f3d-89b5-3427cbd60467 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:28.393567 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-eab1a86c-4890-4f3d-89b5-3427cbd60467 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:28.394157 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-eab1a86c-4890-4f3d-89b5-3427cbd60467 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:28.395680 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-eab1a86c-4890-4f3d-89b5-3427cbd60467 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:28.610837 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-eab1a86c-4890-4f3d-89b5-3427cbd60467 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c1314c21d8547ff890ede1c2ad281c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c804370880454c7aa02cef2c2c3cf144', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:56:28.612406 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-5979dd36-9886-4f4d-bd8a-c36ef2c97442 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f32f5fba1976432d938e664c7714e52b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b9d4c236b944f9b2e8e502a50a8f8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:56:28.621720 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-eab1a86c-4890-4f3d-89b5-3427cbd60467 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c1314c21d8547ff890ede1c2ad281c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c804370880454c7aa02cef2c2c3cf144', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:56:28.624295 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-5979dd36-9886-4f4d-bd8a-c36ef2c97442 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] 10.222.0.13 "GET /compute/v2.1/servers/58d02dff-26f6-4c2f-b886-cdbdccbfcec9" status: 200 len: 1492 microversion: 2.1 time: 0.742868 Nov 01 18:56:28.628669 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 290/601] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:56:27 2022] GET /compute/v2.1/servers/58d02dff-26f6-4c2f-b886-cdbdccbfcec9 => generated 1492 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:56:28.636725 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-eab1a86c-4890-4f3d-89b5-3427cbd60467 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c1314c21d8547ff890ede1c2ad281c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c804370880454c7aa02cef2c2c3cf144', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:56:28.654262 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-f4e1e4ce-676a-4158-aa85-cf582a8c7406 tempest-LiveMigrationTest-1695240876 tempest-LiveMigrationTest-1695240876-project-admin] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:56:28.654906 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-f4e1e4ce-676a-4158-aa85-cf582a8c7406 tempest-LiveMigrationTest-1695240876 tempest-LiveMigrationTest-1695240876-project-admin] [instance: 58d02dff-26f6-4c2f-b886-cdbdccbfcec9] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:56:28.666450 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f4e1e4ce-676a-4158-aa85-cf582a8c7406 tempest-LiveMigrationTest-1695240876 tempest-LiveMigrationTest-1695240876-project-admin] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:28.668472 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-eab1a86c-4890-4f3d-89b5-3427cbd60467 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] 10.222.0.13 "GET /compute/v2.1/servers/ea631032-dd04-429b-988e-e6362ea42cf7" status: 200 len: 1537 microversion: 2.91 time: 0.294294 Nov 01 18:56:28.669921 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f4e1e4ce-676a-4158-aa85-cf582a8c7406 tempest-LiveMigrationTest-1695240876 tempest-LiveMigrationTest-1695240876-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:28.670776 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f4e1e4ce-676a-4158-aa85-cf582a8c7406 tempest-LiveMigrationTest-1695240876 tempest-LiveMigrationTest-1695240876-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:28.671277 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 312/602] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 18:56:28 2022] GET /compute/v2.1/servers/ea631032-dd04-429b-988e-e6362ea42cf7 => generated 1537 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 01 18:56:28.674522 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f4e1e4ce-676a-4158-aa85-cf582a8c7406 tempest-LiveMigrationTest-1695240876 tempest-LiveMigrationTest-1695240876-project-admin] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:28.675169 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f4e1e4ce-676a-4158-aa85-cf582a8c7406 tempest-LiveMigrationTest-1695240876 tempest-LiveMigrationTest-1695240876-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:28.676404 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f4e1e4ce-676a-4158-aa85-cf582a8c7406 tempest-LiveMigrationTest-1695240876 tempest-LiveMigrationTest-1695240876-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:29.070319 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-f4e1e4ce-676a-4158-aa85-cf582a8c7406 tempest-LiveMigrationTest-1695240876 tempest-LiveMigrationTest-1695240876-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/58d02dff-26f6-4c2f-b886-cdbdccbfcec9" status: 200 len: 1643 microversion: 2.1 time: 0.420190 Nov 01 18:56:29.070953 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 291/603] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:56:28 2022] GET /compute/v2.1/servers/58d02dff-26f6-4c2f-b886-cdbdccbfcec9 => generated 1643 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:56:29.095959 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-edcbe54d-f5fe-480f-b005-6dc06e04bd45 tempest-LiveMigrationTest-1695240876 tempest-LiveMigrationTest-1695240876-project-admin] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:56:29.097978 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-edcbe54d-f5fe-480f-b005-6dc06e04bd45 tempest-LiveMigrationTest-1695240876 tempest-LiveMigrationTest-1695240876-project-admin] [instance: 58d02dff-26f6-4c2f-b886-cdbdccbfcec9] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:56:29.107338 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-edcbe54d-f5fe-480f-b005-6dc06e04bd45 tempest-LiveMigrationTest-1695240876 tempest-LiveMigrationTest-1695240876-project-admin] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:29.109669 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-edcbe54d-f5fe-480f-b005-6dc06e04bd45 tempest-LiveMigrationTest-1695240876 tempest-LiveMigrationTest-1695240876-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:29.111235 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-edcbe54d-f5fe-480f-b005-6dc06e04bd45 tempest-LiveMigrationTest-1695240876 tempest-LiveMigrationTest-1695240876-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:29.111944 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-edcbe54d-f5fe-480f-b005-6dc06e04bd45 tempest-LiveMigrationTest-1695240876 tempest-LiveMigrationTest-1695240876-project-admin] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:29.112774 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-edcbe54d-f5fe-480f-b005-6dc06e04bd45 tempest-LiveMigrationTest-1695240876 tempest-LiveMigrationTest-1695240876-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:29.113351 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-edcbe54d-f5fe-480f-b005-6dc06e04bd45 tempest-LiveMigrationTest-1695240876 tempest-LiveMigrationTest-1695240876-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:29.383016 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-edcbe54d-f5fe-480f-b005-6dc06e04bd45 tempest-LiveMigrationTest-1695240876 tempest-LiveMigrationTest-1695240876-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/58d02dff-26f6-4c2f-b886-cdbdccbfcec9" status: 200 len: 1643 microversion: 2.1 time: 0.292078 Nov 01 18:56:29.388637 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 292/604] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:56:29 2022] GET /compute/v2.1/servers/58d02dff-26f6-4c2f-b886-cdbdccbfcec9 => generated 1643 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 18:56:29.394821 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-92c5fce8-d36f-4eb7-ab44-276569b35278 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:56:29.395601 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-92c5fce8-d36f-4eb7-ab44-276569b35278 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] [instance: 614eb691-9a9a-4ca0-933d-686d80cc0ef1] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:56:29.405911 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-92c5fce8-d36f-4eb7-ab44-276569b35278 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:29.407141 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-92c5fce8-d36f-4eb7-ab44-276569b35278 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:29.414690 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-92c5fce8-d36f-4eb7-ab44-276569b35278 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:29.416026 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-92c5fce8-d36f-4eb7-ab44-276569b35278 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:29.417582 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-92c5fce8-d36f-4eb7-ab44-276569b35278 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:29.419081 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-92c5fce8-d36f-4eb7-ab44-276569b35278 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:29.425928 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-c931cf20-685c-4913-a7da-de49e09473e7 tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdmin275Test-server-1001380213", "imageRef": "2d4a0047-1b9e-445f-8af8-1b5c9d93e881", "flavorRef": "452", "networks": "none"}} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 18:56:29.489984 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.virt.hardware [None req-c931cf20-685c-4913-a7da-de49e09473e7 tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] Flavor limits 0:0:0 {{(pid=121402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 01 18:56:29.490547 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.virt.hardware [None req-c931cf20-685c-4913-a7da-de49e09473e7 tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] Image limits 0:0:0 {{(pid=121402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 01 18:56:29.492681 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.virt.hardware [None req-c931cf20-685c-4913-a7da-de49e09473e7 tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] Flavor pref 0:0:0 {{(pid=121402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 01 18:56:29.493198 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.virt.hardware [None req-c931cf20-685c-4913-a7da-de49e09473e7 tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] Image pref 0:0:0 {{(pid=121402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 01 18:56:29.494014 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.virt.hardware [None req-c931cf20-685c-4913-a7da-de49e09473e7 tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 01 18:56:29.514349 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-c931cf20-685c-4913-a7da-de49e09473e7 tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:29.515530 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-c931cf20-685c-4913-a7da-de49e09473e7 tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:29.516155 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-c931cf20-685c-4913-a7da-de49e09473e7 tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:29.516939 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-c931cf20-685c-4913-a7da-de49e09473e7 tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:29.521768 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-c931cf20-685c-4913-a7da-de49e09473e7 tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:29.522223 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-c931cf20-685c-4913-a7da-de49e09473e7 tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:29.573849 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.quota [None req-c931cf20-685c-4913-a7da-de49e09473e7 tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] Getting quotas for project 6e9fb3117f68434bae7a463c357818dd. Resources: {'cores', 'ram', 'instances'} {{(pid=121402) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 01 18:56:29.588323 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.quota [None req-c931cf20-685c-4913-a7da-de49e09473e7 tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] Getting quotas for user 576abe5db27b461889fef2029d477e40 and project 6e9fb3117f68434bae7a463c357818dd. Resources: {'cores', 'ram', 'instances'} {{(pid=121402) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 01 18:56:29.608645 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-c931cf20-685c-4913-a7da-de49e09473e7 tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] Going to run 1 instances... {{(pid=121402) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 01 18:56:29.612307 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-c931cf20-685c-4913-a7da-de49e09473e7 tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] [instance: 87679611-878a-49b2-bf8f-39e784c6d70b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2d4a0047-1b9e-445f-8af8-1b5c9d93e881',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121402) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 01 18:56:29.653806 n-d-863052-2 devstack@n-api.service[121402]: DEBUG dbcounter [-] [121402] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=121402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 18:56:29.673436 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-c931cf20-685c-4913-a7da-de49e09473e7 tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.75 time: 0.618645 Nov 01 18:56:29.674747 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 313/605] 10.222.0.13 () {62 vars in 1188 bytes} [Tue Nov 1 18:56:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 621 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Nov 01 18:56:29.679542 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-82b2d49f-9682-4528-8341-cd78b6cf64ee tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:56:29.680413 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-82b2d49f-9682-4528-8341-cd78b6cf64ee tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] [instance: bee52bae-2df5-46a3-9aa9-f6b24bea11e3] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:56:29.692335 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-82b2d49f-9682-4528-8341-cd78b6cf64ee tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:29.693391 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-82b2d49f-9682-4528-8341-cd78b6cf64ee tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:29.694046 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-82b2d49f-9682-4528-8341-cd78b6cf64ee tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:29.694993 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-82b2d49f-9682-4528-8341-cd78b6cf64ee tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:29.697229 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-82b2d49f-9682-4528-8341-cd78b6cf64ee tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:29.698769 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-82b2d49f-9682-4528-8341-cd78b6cf64ee tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:29.707842 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-92c5fce8-d36f-4eb7-ab44-276569b35278 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72117f17294649d6b8bc16c66c7efab2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45d4c047d3c44324a27a27831236ab0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:56:29.722894 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-92c5fce8-d36f-4eb7-ab44-276569b35278 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] 10.222.0.13 "GET /compute/v2.1/servers/614eb691-9a9a-4ca0-933d-686d80cc0ef1" status: 200 len: 1475 microversion: 2.1 time: 0.335361 Nov 01 18:56:29.727581 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 293/606] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:56:29 2022] GET /compute/v2.1/servers/614eb691-9a9a-4ca0-933d-686d80cc0ef1 => generated 1475 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:56:29.750439 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-dbd4dc7b-35db-49fb-ac3f-7dee7eebede3 tempest-LiveMigrationTest-1695240876 tempest-LiveMigrationTest-1695240876-project-admin] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:56:29.763336 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-dbd4dc7b-35db-49fb-ac3f-7dee7eebede3 tempest-LiveMigrationTest-1695240876 tempest-LiveMigrationTest-1695240876-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:29.763832 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-dbd4dc7b-35db-49fb-ac3f-7dee7eebede3 tempest-LiveMigrationTest-1695240876 tempest-LiveMigrationTest-1695240876-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:29.770249 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-dbd4dc7b-35db-49fb-ac3f-7dee7eebede3 tempest-LiveMigrationTest-1695240876 tempest-LiveMigrationTest-1695240876-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:29.771631 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-dbd4dc7b-35db-49fb-ac3f-7dee7eebede3 tempest-LiveMigrationTest-1695240876 tempest-LiveMigrationTest-1695240876-project-admin] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:29.772117 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-dbd4dc7b-35db-49fb-ac3f-7dee7eebede3 tempest-LiveMigrationTest-1695240876 tempest-LiveMigrationTest-1695240876-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:29.772560 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-dbd4dc7b-35db-49fb-ac3f-7dee7eebede3 tempest-LiveMigrationTest-1695240876 tempest-LiveMigrationTest-1695240876-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:29.810344 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-dbd4dc7b-35db-49fb-ac3f-7dee7eebede3 tempest-LiveMigrationTest-1695240876 tempest-LiveMigrationTest-1695240876-project-admin] 10.222.0.13 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.081271 Nov 01 18:56:29.811689 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 294/607] 10.222.0.13 () {58 vars in 1176 bytes} [Tue Nov 1 18:56:29 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 18:56:29.816984 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-5b4ca300-155a-42d1-81cf-063531e9adb5 tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] Action: 'update', calling method: >, body: {"server": {}} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 18:56:29.820910 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-5b4ca300-155a-42d1-81cf-063531e9adb5 tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] [instance: 87679611-878a-49b2-bf8f-39e784c6d70b] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:56:29.903478 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-82b2d49f-9682-4528-8341-cd78b6cf64ee tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:56:29.914186 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-82b2d49f-9682-4528-8341-cd78b6cf64ee tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:56:29.915675 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-82b2d49f-9682-4528-8341-cd78b6cf64ee tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:56:29.929709 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-82b2d49f-9682-4528-8341-cd78b6cf64ee tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] 10.222.0.13 "GET /compute/v2.1/servers/bee52bae-2df5-46a3-9aa9-f6b24bea11e3" status: 200 len: 1319 microversion: 2.25 time: 0.253643 Nov 01 18:56:29.934419 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 314/608] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 18:56:29 2022] GET /compute/v2.1/servers/bee52bae-2df5-46a3-9aa9-f6b24bea11e3 => generated 1319 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 18:56:29.940614 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-5b4ca300-155a-42d1-81cf-063531e9adb5 tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '576abe5db27b461889fef2029d477e40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e9fb3117f68434bae7a463c357818dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:56:29.946395 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-cd8c18a0-1b00-44ae-b6f5-8383bab5f8d9 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:56:29.947065 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-cd8c18a0-1b00-44ae-b6f5-8383bab5f8d9 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] [instance: ea631032-dd04-429b-988e-e6362ea42cf7] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:56:29.953976 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-5b4ca300-155a-42d1-81cf-063531e9adb5 tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '576abe5db27b461889fef2029d477e40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e9fb3117f68434bae7a463c357818dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:56:29.956374 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-5b4ca300-155a-42d1-81cf-063531e9adb5 tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '576abe5db27b461889fef2029d477e40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e9fb3117f68434bae7a463c357818dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:56:29.964743 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-cd8c18a0-1b00-44ae-b6f5-8383bab5f8d9 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:29.965269 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-cd8c18a0-1b00-44ae-b6f5-8383bab5f8d9 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:29.966698 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-cd8c18a0-1b00-44ae-b6f5-8383bab5f8d9 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:29.968668 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-cd8c18a0-1b00-44ae-b6f5-8383bab5f8d9 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:29.969457 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-cd8c18a0-1b00-44ae-b6f5-8383bab5f8d9 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:29.970505 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-cd8c18a0-1b00-44ae-b6f5-8383bab5f8d9 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:29.974030 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-5b4ca300-155a-42d1-81cf-063531e9adb5 tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] 10.222.0.13 "PUT /compute/v2.1/servers/87679611-878a-49b2-bf8f-39e784c6d70b" status: 200 len: 1359 microversion: 2.75 time: 0.160329 Nov 01 18:56:29.977645 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 295/609] 10.222.0.13 () {62 vars in 1297 bytes} [Tue Nov 1 18:56:29 2022] PUT /compute/v2.1/servers/87679611-878a-49b2-bf8f-39e784c6d70b => generated 1359 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 18:56:29.985888 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-19db4cc8-64d8-4b87-ba41-1c18c8543470 tempest-LiveMigrationTest-1695240876 tempest-LiveMigrationTest-1695240876-project-admin] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 18:56:29.989445 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-19db4cc8-64d8-4b87-ba41-1c18c8543470 tempest-LiveMigrationTest-1695240876 tempest-LiveMigrationTest-1695240876-project-admin] [instance: 58d02dff-26f6-4c2f-b886-cdbdccbfcec9] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:56:30.002621 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-19db4cc8-64d8-4b87-ba41-1c18c8543470 tempest-LiveMigrationTest-1695240876 tempest-LiveMigrationTest-1695240876-project-admin] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:30.003476 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-19db4cc8-64d8-4b87-ba41-1c18c8543470 tempest-LiveMigrationTest-1695240876 tempest-LiveMigrationTest-1695240876-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:30.003922 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-19db4cc8-64d8-4b87-ba41-1c18c8543470 tempest-LiveMigrationTest-1695240876 tempest-LiveMigrationTest-1695240876-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:30.009066 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-19db4cc8-64d8-4b87-ba41-1c18c8543470 tempest-LiveMigrationTest-1695240876 tempest-LiveMigrationTest-1695240876-project-admin] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:30.010156 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-19db4cc8-64d8-4b87-ba41-1c18c8543470 tempest-LiveMigrationTest-1695240876 tempest-LiveMigrationTest-1695240876-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:30.010595 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-19db4cc8-64d8-4b87-ba41-1c18c8543470 tempest-LiveMigrationTest-1695240876 tempest-LiveMigrationTest-1695240876-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:30.134446 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-cd8c18a0-1b00-44ae-b6f5-8383bab5f8d9 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c1314c21d8547ff890ede1c2ad281c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c804370880454c7aa02cef2c2c3cf144', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:56:30.147357 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-cd8c18a0-1b00-44ae-b6f5-8383bab5f8d9 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c1314c21d8547ff890ede1c2ad281c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c804370880454c7aa02cef2c2c3cf144', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:56:30.161077 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-19db4cc8-64d8-4b87-ba41-1c18c8543470 tempest-LiveMigrationTest-1695240876 tempest-LiveMigrationTest-1695240876-project-admin] 10.222.0.13 "POST /compute/v2.1/servers/58d02dff-26f6-4c2f-b886-cdbdccbfcec9/action" status: 202 len: 0 microversion: 2.1 time: 0.181939 Nov 01 18:56:30.166539 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 296/610] 10.222.0.13 () {60 vars in 1278 bytes} [Tue Nov 1 18:56:29 2022] POST /compute/v2.1/servers/58d02dff-26f6-4c2f-b886-cdbdccbfcec9/action => generated 0 bytes in 185 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 01 18:56:30.174829 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-127514c9-15d9-4262-a0b4-973aba85caa2 tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:56:30.175256 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-cd8c18a0-1b00-44ae-b6f5-8383bab5f8d9 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c1314c21d8547ff890ede1c2ad281c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c804370880454c7aa02cef2c2c3cf144', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:56:30.177984 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-127514c9-15d9-4262-a0b4-973aba85caa2 tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] [instance: 87679611-878a-49b2-bf8f-39e784c6d70b] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:56:30.191027 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-cd8c18a0-1b00-44ae-b6f5-8383bab5f8d9 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] 10.222.0.13 "GET /compute/v2.1/servers/ea631032-dd04-429b-988e-e6362ea42cf7" status: 200 len: 1537 microversion: 2.91 time: 0.255159 Nov 01 18:56:30.197419 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 315/611] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 18:56:29 2022] GET /compute/v2.1/servers/ea631032-dd04-429b-988e-e6362ea42cf7 => generated 1537 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 18:56:30.215381 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-7e9d42de-15b6-4a5e-aaa7-c21347e2a7a5 tempest-LiveMigrationTest-1695240876 tempest-LiveMigrationTest-1695240876-project-admin] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:56:30.216056 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-7e9d42de-15b6-4a5e-aaa7-c21347e2a7a5 tempest-LiveMigrationTest-1695240876 tempest-LiveMigrationTest-1695240876-project-admin] [instance: 58d02dff-26f6-4c2f-b886-cdbdccbfcec9] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:56:30.231695 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-7e9d42de-15b6-4a5e-aaa7-c21347e2a7a5 tempest-LiveMigrationTest-1695240876 tempest-LiveMigrationTest-1695240876-project-admin] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:30.232211 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-7e9d42de-15b6-4a5e-aaa7-c21347e2a7a5 tempest-LiveMigrationTest-1695240876 tempest-LiveMigrationTest-1695240876-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:30.232656 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-7e9d42de-15b6-4a5e-aaa7-c21347e2a7a5 tempest-LiveMigrationTest-1695240876 tempest-LiveMigrationTest-1695240876-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:30.234909 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-7e9d42de-15b6-4a5e-aaa7-c21347e2a7a5 tempest-LiveMigrationTest-1695240876 tempest-LiveMigrationTest-1695240876-project-admin] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:30.235565 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-7e9d42de-15b6-4a5e-aaa7-c21347e2a7a5 tempest-LiveMigrationTest-1695240876 tempest-LiveMigrationTest-1695240876-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:30.236156 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-7e9d42de-15b6-4a5e-aaa7-c21347e2a7a5 tempest-LiveMigrationTest-1695240876 tempest-LiveMigrationTest-1695240876-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:30.331450 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-127514c9-15d9-4262-a0b4-973aba85caa2 tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '576abe5db27b461889fef2029d477e40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e9fb3117f68434bae7a463c357818dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:56:30.347190 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-127514c9-15d9-4262-a0b4-973aba85caa2 tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '576abe5db27b461889fef2029d477e40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e9fb3117f68434bae7a463c357818dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:56:30.350210 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-127514c9-15d9-4262-a0b4-973aba85caa2 tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '576abe5db27b461889fef2029d477e40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e9fb3117f68434bae7a463c357818dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:56:30.401100 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-127514c9-15d9-4262-a0b4-973aba85caa2 tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] 10.222.0.13 "GET /compute/v2.1/servers/87679611-878a-49b2-bf8f-39e784c6d70b" status: 200 len: 1359 microversion: 2.75 time: 0.219506 Nov 01 18:56:30.417733 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 297/612] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 18:56:30 2022] GET /compute/v2.1/servers/87679611-878a-49b2-bf8f-39e784c6d70b => generated 1359 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 18:56:30.698047 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-7e9d42de-15b6-4a5e-aaa7-c21347e2a7a5 tempest-LiveMigrationTest-1695240876 tempest-LiveMigrationTest-1695240876-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/58d02dff-26f6-4c2f-b886-cdbdccbfcec9" status: 200 len: 1648 microversion: 2.1 time: 0.498876 Nov 01 18:56:30.710402 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 316/613] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:56:30 2022] GET /compute/v2.1/servers/58d02dff-26f6-4c2f-b886-cdbdccbfcec9 => generated 1648 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:56:30.751061 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-f9ae497f-8c15-4f37-8164-8134fa92a7cb tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:56:30.752290 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-f9ae497f-8c15-4f37-8164-8134fa92a7cb tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] [instance: 614eb691-9a9a-4ca0-933d-686d80cc0ef1] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:56:30.767414 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f9ae497f-8c15-4f37-8164-8134fa92a7cb tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:30.767883 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f9ae497f-8c15-4f37-8164-8134fa92a7cb tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:30.768338 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f9ae497f-8c15-4f37-8164-8134fa92a7cb tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:30.769088 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f9ae497f-8c15-4f37-8164-8134fa92a7cb tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:30.769551 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f9ae497f-8c15-4f37-8164-8134fa92a7cb tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:30.769988 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f9ae497f-8c15-4f37-8164-8134fa92a7cb tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:30.972937 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-2f07e371-34c6-484e-9310-ae0dc3514c26 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:56:30.973599 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-2f07e371-34c6-484e-9310-ae0dc3514c26 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] [instance: bee52bae-2df5-46a3-9aa9-f6b24bea11e3] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:56:30.990119 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2f07e371-34c6-484e-9310-ae0dc3514c26 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:30.992914 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2f07e371-34c6-484e-9310-ae0dc3514c26 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:30.994927 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2f07e371-34c6-484e-9310-ae0dc3514c26 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:30.995948 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2f07e371-34c6-484e-9310-ae0dc3514c26 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:30.997619 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2f07e371-34c6-484e-9310-ae0dc3514c26 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:30.999600 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2f07e371-34c6-484e-9310-ae0dc3514c26 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:31.049622 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-f9ae497f-8c15-4f37-8164-8134fa92a7cb tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72117f17294649d6b8bc16c66c7efab2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45d4c047d3c44324a27a27831236ab0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:56:31.063152 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-f9ae497f-8c15-4f37-8164-8134fa92a7cb tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] 10.222.0.13 "GET /compute/v2.1/servers/614eb691-9a9a-4ca0-933d-686d80cc0ef1" status: 200 len: 1475 microversion: 2.1 time: 0.316475 Nov 01 18:56:31.065328 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 298/614] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:56:30 2022] GET /compute/v2.1/servers/614eb691-9a9a-4ca0-933d-686d80cc0ef1 => generated 1475 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:56:31.214359 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-2f07e371-34c6-484e-9310-ae0dc3514c26 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:56:31.223160 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-c9cb55e5-4e22-4ba6-a99d-76818cba75d4 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:56:31.223756 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-c9cb55e5-4e22-4ba6-a99d-76818cba75d4 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] [instance: ea631032-dd04-429b-988e-e6362ea42cf7] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:56:31.234020 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-2f07e371-34c6-484e-9310-ae0dc3514c26 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:56:31.235941 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-c9cb55e5-4e22-4ba6-a99d-76818cba75d4 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:31.236426 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-c9cb55e5-4e22-4ba6-a99d-76818cba75d4 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:31.238610 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-c9cb55e5-4e22-4ba6-a99d-76818cba75d4 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:31.240368 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-2f07e371-34c6-484e-9310-ae0dc3514c26 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:56:31.241319 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-c9cb55e5-4e22-4ba6-a99d-76818cba75d4 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:31.241930 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-c9cb55e5-4e22-4ba6-a99d-76818cba75d4 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:31.243251 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-2f07e371-34c6-484e-9310-ae0dc3514c26 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] 10.222.0.13 "GET /compute/v2.1/servers/bee52bae-2df5-46a3-9aa9-f6b24bea11e3" status: 200 len: 1361 microversion: 2.25 time: 0.281816 Nov 01 18:56:31.243855 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-c9cb55e5-4e22-4ba6-a99d-76818cba75d4 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:31.248935 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 317/615] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 18:56:30 2022] GET /compute/v2.1/servers/bee52bae-2df5-46a3-9aa9-f6b24bea11e3 => generated 1361 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 18:56:31.383513 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-c9cb55e5-4e22-4ba6-a99d-76818cba75d4 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c1314c21d8547ff890ede1c2ad281c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c804370880454c7aa02cef2c2c3cf144', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:56:31.392383 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-c9cb55e5-4e22-4ba6-a99d-76818cba75d4 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c1314c21d8547ff890ede1c2ad281c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c804370880454c7aa02cef2c2c3cf144', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:56:31.398331 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-c9cb55e5-4e22-4ba6-a99d-76818cba75d4 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c1314c21d8547ff890ede1c2ad281c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c804370880454c7aa02cef2c2c3cf144', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:56:31.412548 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-c9cb55e5-4e22-4ba6-a99d-76818cba75d4 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] 10.222.0.13 "GET /compute/v2.1/servers/ea631032-dd04-429b-988e-e6362ea42cf7" status: 200 len: 1537 microversion: 2.91 time: 0.192502 Nov 01 18:56:31.425381 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 299/616] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 18:56:31 2022] GET /compute/v2.1/servers/ea631032-dd04-429b-988e-e6362ea42cf7 => generated 1537 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 01 18:56:31.433861 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-9fddfe48-ffde-450a-a400-89cd1b1d49e7 tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:56:31.434443 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-9fddfe48-ffde-450a-a400-89cd1b1d49e7 tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] [instance: 87679611-878a-49b2-bf8f-39e784c6d70b] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:56:31.441146 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-9fddfe48-ffde-450a-a400-89cd1b1d49e7 tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:31.441623 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-9fddfe48-ffde-450a-a400-89cd1b1d49e7 tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:31.442053 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-9fddfe48-ffde-450a-a400-89cd1b1d49e7 tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:31.442774 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-9fddfe48-ffde-450a-a400-89cd1b1d49e7 tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:31.443268 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-9fddfe48-ffde-450a-a400-89cd1b1d49e7 tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:31.443709 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-9fddfe48-ffde-450a-a400-89cd1b1d49e7 tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:31.539370 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-9fddfe48-ffde-450a-a400-89cd1b1d49e7 tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '576abe5db27b461889fef2029d477e40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e9fb3117f68434bae7a463c357818dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:56:31.559834 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-9fddfe48-ffde-450a-a400-89cd1b1d49e7 tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '576abe5db27b461889fef2029d477e40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e9fb3117f68434bae7a463c357818dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:56:31.561356 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-9fddfe48-ffde-450a-a400-89cd1b1d49e7 tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '576abe5db27b461889fef2029d477e40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e9fb3117f68434bae7a463c357818dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:56:31.575518 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-9fddfe48-ffde-450a-a400-89cd1b1d49e7 tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] 10.222.0.13 "GET /compute/v2.1/servers/87679611-878a-49b2-bf8f-39e784c6d70b" status: 200 len: 1419 microversion: 2.75 time: 0.144855 Nov 01 18:56:31.580179 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 318/617] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 18:56:31 2022] GET /compute/v2.1/servers/87679611-878a-49b2-bf8f-39e784c6d70b => generated 1419 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 18:56:31.729505 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-d8640718-37cf-4e2f-97e9-e03757b9bd04 tempest-LiveMigrationTest-1695240876 tempest-LiveMigrationTest-1695240876-project-admin] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:56:31.732399 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-d8640718-37cf-4e2f-97e9-e03757b9bd04 tempest-LiveMigrationTest-1695240876 tempest-LiveMigrationTest-1695240876-project-admin] [instance: 58d02dff-26f6-4c2f-b886-cdbdccbfcec9] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:56:31.733234 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [req-c38afae5-f0eb-4f7d-8581-f09b32776a25 req-0f595946-13d9-439a-a557-b919c7e0bfd3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bee52bae-2df5-46a3-9aa9-f6b24bea11e3", "tag": "8f917f95-25be-4ada-95ec-6e61439ce94b"}]} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 18:56:31.747259 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-d8640718-37cf-4e2f-97e9-e03757b9bd04 tempest-LiveMigrationTest-1695240876 tempest-LiveMigrationTest-1695240876-project-admin] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:31.750138 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-d8640718-37cf-4e2f-97e9-e03757b9bd04 tempest-LiveMigrationTest-1695240876 tempest-LiveMigrationTest-1695240876-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:31.751928 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-d8640718-37cf-4e2f-97e9-e03757b9bd04 tempest-LiveMigrationTest-1695240876 tempest-LiveMigrationTest-1695240876-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:31.753143 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-d8640718-37cf-4e2f-97e9-e03757b9bd04 tempest-LiveMigrationTest-1695240876 tempest-LiveMigrationTest-1695240876-project-admin] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:31.754600 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-d8640718-37cf-4e2f-97e9-e03757b9bd04 tempest-LiveMigrationTest-1695240876 tempest-LiveMigrationTest-1695240876-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:31.757023 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-c38afae5-f0eb-4f7d-8581-f09b32776a25 req-0f595946-13d9-439a-a557-b919c7e0bfd3 service nova] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:31.757690 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-d8640718-37cf-4e2f-97e9-e03757b9bd04 tempest-LiveMigrationTest-1695240876 tempest-LiveMigrationTest-1695240876-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:31.762534 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-c38afae5-f0eb-4f7d-8581-f09b32776a25 req-0f595946-13d9-439a-a557-b919c7e0bfd3 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:31.763195 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-c38afae5-f0eb-4f7d-8581-f09b32776a25 req-0f595946-13d9-439a-a557-b919c7e0bfd3 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:31.791789 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.compute.server_external_events [req-c38afae5-f0eb-4f7d-8581-f09b32776a25 req-0f595946-13d9-439a-a557-b919c7e0bfd3 service nova] Creating event network-changed:8f917f95-25be-4ada-95ec-6e61439ce94b for instance bee52bae-2df5-46a3-9aa9-f6b24bea11e3 on n-h1-863052-2 Nov 01 18:56:31.801739 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [req-c38afae5-f0eb-4f7d-8581-f09b32776a25 req-0f595946-13d9-439a-a557-b919c7e0bfd3 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084260 Nov 01 18:56:31.802758 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 300/618] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Nov 1 18:56:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 01 18:56:31.965288 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-d8640718-37cf-4e2f-97e9-e03757b9bd04 tempest-LiveMigrationTest-1695240876 tempest-LiveMigrationTest-1695240876-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/58d02dff-26f6-4c2f-b886-cdbdccbfcec9" status: 200 len: 1628 microversion: 2.1 time: 0.246115 Nov 01 18:56:31.965853 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 319/619] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:56:31 2022] GET /compute/v2.1/servers/58d02dff-26f6-4c2f-b886-cdbdccbfcec9 => generated 1628 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 18:56:31.990186 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-a9e281ab-f846-4384-8641-c467eff85f5c tempest-LiveMigrationTest-1695240876 tempest-LiveMigrationTest-1695240876-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-863052-2", "block_migration": true, "disk_over_commit": false}} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 18:56:31.993186 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-a9e281ab-f846-4384-8641-c467eff85f5c tempest-LiveMigrationTest-1695240876 tempest-LiveMigrationTest-1695240876-project-admin] [instance: 58d02dff-26f6-4c2f-b886-cdbdccbfcec9] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:56:31.999482 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-a9e281ab-f846-4384-8641-c467eff85f5c tempest-LiveMigrationTest-1695240876 tempest-LiveMigrationTest-1695240876-project-admin] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:32.000273 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-a9e281ab-f846-4384-8641-c467eff85f5c tempest-LiveMigrationTest-1695240876 tempest-LiveMigrationTest-1695240876-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:32.000928 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-a9e281ab-f846-4384-8641-c467eff85f5c tempest-LiveMigrationTest-1695240876 tempest-LiveMigrationTest-1695240876-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:32.001988 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-a9e281ab-f846-4384-8641-c467eff85f5c tempest-LiveMigrationTest-1695240876 tempest-LiveMigrationTest-1695240876-project-admin] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:32.002974 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-a9e281ab-f846-4384-8641-c467eff85f5c tempest-LiveMigrationTest-1695240876 tempest-LiveMigrationTest-1695240876-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:32.003624 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-a9e281ab-f846-4384-8641-c467eff85f5c tempest-LiveMigrationTest-1695240876 tempest-LiveMigrationTest-1695240876-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:32.031849 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.objects.instance [None req-a9e281ab-f846-4384-8641-c467eff85f5c tempest-LiveMigrationTest-1695240876 tempest-LiveMigrationTest-1695240876-project-admin] Lazy-loading 'flavor' on Instance uuid 58d02dff-26f6-4c2f-b886-cdbdccbfcec9 {{(pid=121403) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 01 18:56:32.045632 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-a9e281ab-f846-4384-8641-c467eff85f5c tempest-LiveMigrationTest-1695240876 tempest-LiveMigrationTest-1695240876-project-admin] [instance: 58d02dff-26f6-4c2f-b886-cdbdccbfcec9] Going to try to live migrate instance to n-h2-863052-2 {{(pid=121403) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Nov 01 18:56:32.049710 n-d-863052-2 devstack@n-api.service[121403]: DEBUG dbcounter [-] [121403] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 18:56:32.089271 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-32c1b248-6020-42d6-bb83-3f1b1e27aee9 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:56:32.089954 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-32c1b248-6020-42d6-bb83-3f1b1e27aee9 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] [instance: 614eb691-9a9a-4ca0-933d-686d80cc0ef1] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:56:32.095848 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-32c1b248-6020-42d6-bb83-3f1b1e27aee9 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:32.096971 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-32c1b248-6020-42d6-bb83-3f1b1e27aee9 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:32.097785 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-32c1b248-6020-42d6-bb83-3f1b1e27aee9 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:32.099272 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-32c1b248-6020-42d6-bb83-3f1b1e27aee9 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:32.100566 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-32c1b248-6020-42d6-bb83-3f1b1e27aee9 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:32.101207 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-32c1b248-6020-42d6-bb83-3f1b1e27aee9 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:32.463685 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-32c1b248-6020-42d6-bb83-3f1b1e27aee9 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72117f17294649d6b8bc16c66c7efab2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45d4c047d3c44324a27a27831236ab0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:56:32.472415 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-32c1b248-6020-42d6-bb83-3f1b1e27aee9 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] 10.222.0.13 "GET /compute/v2.1/servers/614eb691-9a9a-4ca0-933d-686d80cc0ef1" status: 200 len: 1475 microversion: 2.1 time: 0.386995 Nov 01 18:56:32.485183 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 320/620] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:56:32 2022] GET /compute/v2.1/servers/614eb691-9a9a-4ca0-933d-686d80cc0ef1 => generated 1475 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 18:56:32.494697 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-66194479-7264-465e-8151-48465a0febeb tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:56:32.495772 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-66194479-7264-465e-8151-48465a0febeb tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] [instance: bee52bae-2df5-46a3-9aa9-f6b24bea11e3] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:56:32.502092 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-66194479-7264-465e-8151-48465a0febeb tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:32.503366 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-66194479-7264-465e-8151-48465a0febeb tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:32.504046 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-66194479-7264-465e-8151-48465a0febeb tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:32.505906 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-66194479-7264-465e-8151-48465a0febeb tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:32.506585 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-66194479-7264-465e-8151-48465a0febeb tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:32.507323 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-66194479-7264-465e-8151-48465a0febeb tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:32.916442 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-66194479-7264-465e-8151-48465a0febeb tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:56:32.925183 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-66194479-7264-465e-8151-48465a0febeb tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:56:32.926733 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-66194479-7264-465e-8151-48465a0febeb tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:56:32.928532 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-66194479-7264-465e-8151-48465a0febeb tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] 10.222.0.13 "GET /compute/v2.1/servers/bee52bae-2df5-46a3-9aa9-f6b24bea11e3" status: 200 len: 1361 microversion: 2.25 time: 0.438616 Nov 01 18:56:32.929110 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 321/621] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 18:56:32 2022] GET /compute/v2.1/servers/bee52bae-2df5-46a3-9aa9-f6b24bea11e3 => generated 1361 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 18:56:32.934736 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-25dcb041-a5f5-45b1-b8bf-d9ef0a7d2f5b tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:56:32.935592 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-25dcb041-a5f5-45b1-b8bf-d9ef0a7d2f5b tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] [instance: ea631032-dd04-429b-988e-e6362ea42cf7] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:56:32.942010 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-25dcb041-a5f5-45b1-b8bf-d9ef0a7d2f5b tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:32.942569 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-25dcb041-a5f5-45b1-b8bf-d9ef0a7d2f5b tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:32.943115 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-25dcb041-a5f5-45b1-b8bf-d9ef0a7d2f5b tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:32.943982 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-25dcb041-a5f5-45b1-b8bf-d9ef0a7d2f5b tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:32.944500 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-25dcb041-a5f5-45b1-b8bf-d9ef0a7d2f5b tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:32.945175 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-25dcb041-a5f5-45b1-b8bf-d9ef0a7d2f5b tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:33.028001 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-25dcb041-a5f5-45b1-b8bf-d9ef0a7d2f5b tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c1314c21d8547ff890ede1c2ad281c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c804370880454c7aa02cef2c2c3cf144', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:56:33.038055 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-25dcb041-a5f5-45b1-b8bf-d9ef0a7d2f5b tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c1314c21d8547ff890ede1c2ad281c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c804370880454c7aa02cef2c2c3cf144', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:56:33.039517 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-25dcb041-a5f5-45b1-b8bf-d9ef0a7d2f5b tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c1314c21d8547ff890ede1c2ad281c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c804370880454c7aa02cef2c2c3cf144', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:56:33.046220 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-25dcb041-a5f5-45b1-b8bf-d9ef0a7d2f5b tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] 10.222.0.13 "GET /compute/v2.1/servers/ea631032-dd04-429b-988e-e6362ea42cf7" status: 200 len: 1537 microversion: 2.91 time: 0.115763 Nov 01 18:56:33.067426 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 322/622] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 18:56:32 2022] GET /compute/v2.1/servers/ea631032-dd04-429b-988e-e6362ea42cf7 => generated 1537 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 18:56:33.075128 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-834cce10-50a6-4ee0-baab-e40fc5201337 tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:56:33.075976 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-834cce10-50a6-4ee0-baab-e40fc5201337 tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] [instance: 87679611-878a-49b2-bf8f-39e784c6d70b] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:56:33.082278 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-834cce10-50a6-4ee0-baab-e40fc5201337 tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:33.082775 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-834cce10-50a6-4ee0-baab-e40fc5201337 tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:33.083206 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-834cce10-50a6-4ee0-baab-e40fc5201337 tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:33.083943 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-834cce10-50a6-4ee0-baab-e40fc5201337 tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:33.084564 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-834cce10-50a6-4ee0-baab-e40fc5201337 tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:33.085019 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-834cce10-50a6-4ee0-baab-e40fc5201337 tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:33.213655 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-834cce10-50a6-4ee0-baab-e40fc5201337 tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '576abe5db27b461889fef2029d477e40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e9fb3117f68434bae7a463c357818dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:56:33.216236 n-d-863052-2 devstack@n-api.service[121402]: DEBUG dbcounter [-] [121402] Writing DB stats nova_cell1:SELECT=100 {{(pid=121402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 18:56:33.225310 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-834cce10-50a6-4ee0-baab-e40fc5201337 tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '576abe5db27b461889fef2029d477e40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e9fb3117f68434bae7a463c357818dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:56:33.227137 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-834cce10-50a6-4ee0-baab-e40fc5201337 tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '576abe5db27b461889fef2029d477e40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e9fb3117f68434bae7a463c357818dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:56:33.233306 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-834cce10-50a6-4ee0-baab-e40fc5201337 tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] 10.222.0.13 "GET /compute/v2.1/servers/87679611-878a-49b2-bf8f-39e784c6d70b" status: 200 len: 1417 microversion: 2.75 time: 0.164325 Nov 01 18:56:33.234496 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 323/623] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 18:56:33 2022] GET /compute/v2.1/servers/87679611-878a-49b2-bf8f-39e784c6d70b => generated 1417 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 18:56:33.496786 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-74f102e2-54c0-4a81-be7a-5265bba25627 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:56:33.497700 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-74f102e2-54c0-4a81-be7a-5265bba25627 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] [instance: 614eb691-9a9a-4ca0-933d-686d80cc0ef1] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:56:33.505187 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-74f102e2-54c0-4a81-be7a-5265bba25627 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:33.506066 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-74f102e2-54c0-4a81-be7a-5265bba25627 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:33.506753 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-74f102e2-54c0-4a81-be7a-5265bba25627 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:33.508202 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-74f102e2-54c0-4a81-be7a-5265bba25627 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:33.508924 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-74f102e2-54c0-4a81-be7a-5265bba25627 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:33.509581 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-74f102e2-54c0-4a81-be7a-5265bba25627 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:33.753252 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-74f102e2-54c0-4a81-be7a-5265bba25627 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72117f17294649d6b8bc16c66c7efab2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45d4c047d3c44324a27a27831236ab0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:56:33.768570 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-74f102e2-54c0-4a81-be7a-5265bba25627 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] 10.222.0.13 "GET /compute/v2.1/servers/614eb691-9a9a-4ca0-933d-686d80cc0ef1" status: 200 len: 1475 microversion: 2.1 time: 0.275447 Nov 01 18:56:33.772703 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 324/624] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:56:33 2022] GET /compute/v2.1/servers/614eb691-9a9a-4ca0-933d-686d80cc0ef1 => generated 1475 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 18:56:33.957182 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-9dbee428-6972-4615-b7ff-663f969a1127 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:56:33.957921 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-9dbee428-6972-4615-b7ff-663f969a1127 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] [instance: bee52bae-2df5-46a3-9aa9-f6b24bea11e3] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:56:33.969439 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-9dbee428-6972-4615-b7ff-663f969a1127 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:33.970189 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-9dbee428-6972-4615-b7ff-663f969a1127 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:33.970619 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-9dbee428-6972-4615-b7ff-663f969a1127 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:33.971485 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-9dbee428-6972-4615-b7ff-663f969a1127 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:33.972818 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-9dbee428-6972-4615-b7ff-663f969a1127 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:33.973431 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-9dbee428-6972-4615-b7ff-663f969a1127 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:34.293221 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-9dbee428-6972-4615-b7ff-663f969a1127 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:56:34.309519 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-9dbee428-6972-4615-b7ff-663f969a1127 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:56:34.311389 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-9dbee428-6972-4615-b7ff-663f969a1127 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:56:34.312993 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-9dbee428-6972-4615-b7ff-663f969a1127 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] 10.222.0.13 "GET /compute/v2.1/servers/bee52bae-2df5-46a3-9aa9-f6b24bea11e3" status: 200 len: 1361 microversion: 2.25 time: 0.361876 Nov 01 18:56:34.313856 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 325/625] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 18:56:33 2022] GET /compute/v2.1/servers/bee52bae-2df5-46a3-9aa9-f6b24bea11e3 => generated 1361 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 01 18:56:34.324597 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-ec5fb609-8092-435c-9088-68b31b4d7209 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:56:34.325526 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-ec5fb609-8092-435c-9088-68b31b4d7209 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] [instance: ea631032-dd04-429b-988e-e6362ea42cf7] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:56:34.339047 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-a9e281ab-f846-4384-8641-c467eff85f5c tempest-LiveMigrationTest-1695240876 tempest-LiveMigrationTest-1695240876-project-admin] 10.222.0.13 "POST /compute/v2.1/servers/58d02dff-26f6-4c2f-b886-cdbdccbfcec9/action" status: 202 len: 0 microversion: 2.1 time: 2.353324 Nov 01 18:56:34.339750 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 301/626] 10.222.0.13 () {60 vars in 1278 bytes} [Tue Nov 1 18:56:31 2022] POST /compute/v2.1/servers/58d02dff-26f6-4c2f-b886-cdbdccbfcec9/action => generated 0 bytes in 2355 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 01 18:56:34.341788 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-ec5fb609-8092-435c-9088-68b31b4d7209 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:34.343419 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-ec5fb609-8092-435c-9088-68b31b4d7209 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:34.344708 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-ec5fb609-8092-435c-9088-68b31b4d7209 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:34.347090 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-ec5fb609-8092-435c-9088-68b31b4d7209 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:34.347774 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-ec5fb609-8092-435c-9088-68b31b4d7209 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:34.348001 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-e5f04fbc-94a5-4d21-b988-a81733e11420 tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:56:34.349535 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-e5f04fbc-94a5-4d21-b988-a81733e11420 tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] [instance: 87679611-878a-49b2-bf8f-39e784c6d70b] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:56:34.354823 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-ec5fb609-8092-435c-9088-68b31b4d7209 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:34.363307 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-e5f04fbc-94a5-4d21-b988-a81733e11420 tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:34.363798 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-e5f04fbc-94a5-4d21-b988-a81733e11420 tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:34.364233 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-e5f04fbc-94a5-4d21-b988-a81733e11420 tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:34.369731 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-e5f04fbc-94a5-4d21-b988-a81733e11420 tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:34.372281 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-e5f04fbc-94a5-4d21-b988-a81733e11420 tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:34.377348 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-e5f04fbc-94a5-4d21-b988-a81733e11420 tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:34.523629 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-e5f04fbc-94a5-4d21-b988-a81733e11420 tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '576abe5db27b461889fef2029d477e40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e9fb3117f68434bae7a463c357818dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:56:34.524036 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-ec5fb609-8092-435c-9088-68b31b4d7209 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c1314c21d8547ff890ede1c2ad281c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c804370880454c7aa02cef2c2c3cf144', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:56:34.532193 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-e5f04fbc-94a5-4d21-b988-a81733e11420 tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '576abe5db27b461889fef2029d477e40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e9fb3117f68434bae7a463c357818dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:56:34.538047 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-e5f04fbc-94a5-4d21-b988-a81733e11420 tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '576abe5db27b461889fef2029d477e40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e9fb3117f68434bae7a463c357818dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:56:34.548643 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-e5f04fbc-94a5-4d21-b988-a81733e11420 tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] 10.222.0.13 "GET /compute/v2.1/servers/87679611-878a-49b2-bf8f-39e784c6d70b" status: 200 len: 1438 microversion: 2.75 time: 0.207206 Nov 01 18:56:34.554373 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-ec5fb609-8092-435c-9088-68b31b4d7209 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c1314c21d8547ff890ede1c2ad281c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c804370880454c7aa02cef2c2c3cf144', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:56:34.555472 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 302/627] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 18:56:34 2022] GET /compute/v2.1/servers/87679611-878a-49b2-bf8f-39e784c6d70b => generated 1438 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 18:56:34.564622 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-ec5fb609-8092-435c-9088-68b31b4d7209 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c1314c21d8547ff890ede1c2ad281c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c804370880454c7aa02cef2c2c3cf144', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:56:34.567738 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-ff53540b-b54b-4299-98a2-084534134972 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:56:34.568444 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-ff53540b-b54b-4299-98a2-084534134972 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] [instance: 58d02dff-26f6-4c2f-b886-cdbdccbfcec9] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:56:34.573932 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-ec5fb609-8092-435c-9088-68b31b4d7209 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] 10.222.0.13 "GET /compute/v2.1/servers/ea631032-dd04-429b-988e-e6362ea42cf7" status: 200 len: 1537 microversion: 2.91 time: 0.259064 Nov 01 18:56:34.584674 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 326/628] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 18:56:34 2022] GET /compute/v2.1/servers/ea631032-dd04-429b-988e-e6362ea42cf7 => generated 1537 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 18:56:34.584881 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-ff53540b-b54b-4299-98a2-084534134972 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:34.584973 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-2b83c00d-d901-42e6-96c2-281e0c079594 tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "2d4a0047-1b9e-445f-8af8-1b5c9d93e881"}} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 18:56:34.585076 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-ff53540b-b54b-4299-98a2-084534134972 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:34.585265 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-ff53540b-b54b-4299-98a2-084534134972 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:34.585987 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-ff53540b-b54b-4299-98a2-084534134972 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:34.586445 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-ff53540b-b54b-4299-98a2-084534134972 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:34.586868 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-ff53540b-b54b-4299-98a2-084534134972 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:34.591115 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-2b83c00d-d901-42e6-96c2-281e0c079594 tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] [instance: 87679611-878a-49b2-bf8f-39e784c6d70b] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:56:34.604033 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2b83c00d-d901-42e6-96c2-281e0c079594 tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:34.604823 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2b83c00d-d901-42e6-96c2-281e0c079594 tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:34.605415 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2b83c00d-d901-42e6-96c2-281e0c079594 tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:34.606302 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2b83c00d-d901-42e6-96c2-281e0c079594 tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:34.606918 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2b83c00d-d901-42e6-96c2-281e0c079594 tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:34.607500 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2b83c00d-d901-42e6-96c2-281e0c079594 tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:34.738028 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.virt.hardware [None req-2b83c00d-d901-42e6-96c2-281e0c079594 tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] Flavor limits 0:0:0 {{(pid=121402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 01 18:56:34.738589 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.virt.hardware [None req-2b83c00d-d901-42e6-96c2-281e0c079594 tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] Image limits 0:0:0 {{(pid=121402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 01 18:56:34.745408 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.virt.hardware [None req-2b83c00d-d901-42e6-96c2-281e0c079594 tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] Flavor pref 0:0:0 {{(pid=121402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 01 18:56:34.746038 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.virt.hardware [None req-2b83c00d-d901-42e6-96c2-281e0c079594 tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] Image pref 0:0:0 {{(pid=121402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 01 18:56:34.746544 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.virt.hardware [None req-2b83c00d-d901-42e6-96c2-281e0c079594 tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 01 18:56:34.822804 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-ff53540b-b54b-4299-98a2-084534134972 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f32f5fba1976432d938e664c7714e52b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b9d4c236b944f9b2e8e502a50a8f8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:56:34.837061 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-ff53540b-b54b-4299-98a2-084534134972 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] 10.222.0.13 "GET /compute/v2.1/servers/58d02dff-26f6-4c2f-b886-cdbdccbfcec9" status: 200 len: 1502 microversion: 2.1 time: 0.280123 Nov 01 18:56:34.837652 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 303/629] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:56:34 2022] GET /compute/v2.1/servers/58d02dff-26f6-4c2f-b886-cdbdccbfcec9 => generated 1502 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:56:34.840551 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-2b83c00d-d901-42e6-96c2-281e0c079594 tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] [instance: 87679611-878a-49b2-bf8f-39e784c6d70b] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:56:34.842800 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-fc33cb7a-a992-4370-ac21-f559a47b9ee0 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:56:34.843701 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-fc33cb7a-a992-4370-ac21-f559a47b9ee0 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] [instance: 614eb691-9a9a-4ca0-933d-686d80cc0ef1] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:56:34.850671 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-fc33cb7a-a992-4370-ac21-f559a47b9ee0 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:34.851256 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-fc33cb7a-a992-4370-ac21-f559a47b9ee0 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:34.851937 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-fc33cb7a-a992-4370-ac21-f559a47b9ee0 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:34.852662 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-fc33cb7a-a992-4370-ac21-f559a47b9ee0 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:34.853372 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-fc33cb7a-a992-4370-ac21-f559a47b9ee0 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:34.854012 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-fc33cb7a-a992-4370-ac21-f559a47b9ee0 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:34.854465 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2b83c00d-d901-42e6-96c2-281e0c079594 tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:34.855070 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2b83c00d-d901-42e6-96c2-281e0c079594 tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:34.855586 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2b83c00d-d901-42e6-96c2-281e0c079594 tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:34.856370 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2b83c00d-d901-42e6-96c2-281e0c079594 tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:34.856917 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2b83c00d-d901-42e6-96c2-281e0c079594 tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:34.857351 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2b83c00d-d901-42e6-96c2-281e0c079594 tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:35.019454 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-2b83c00d-d901-42e6-96c2-281e0c079594 tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '576abe5db27b461889fef2029d477e40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e9fb3117f68434bae7a463c357818dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:56:35.033636 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-2b83c00d-d901-42e6-96c2-281e0c079594 tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '576abe5db27b461889fef2029d477e40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e9fb3117f68434bae7a463c357818dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:56:35.035283 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-2b83c00d-d901-42e6-96c2-281e0c079594 tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '576abe5db27b461889fef2029d477e40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e9fb3117f68434bae7a463c357818dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:56:35.041811 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-2b83c00d-d901-42e6-96c2-281e0c079594 tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] 10.222.0.13 "POST /compute/v2.1/servers/87679611-878a-49b2-bf8f-39e784c6d70b/action" status: 202 len: 1495 microversion: 2.75 time: 0.461630 Nov 01 18:56:35.042809 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 327/630] 10.222.0.13 () {62 vars in 1319 bytes} [Tue Nov 1 18:56:34 2022] POST /compute/v2.1/servers/87679611-878a-49b2-bf8f-39e784c6d70b/action => generated 1495 bytes in 463 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Nov 01 18:56:35.070988 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-cfd9fda5-15d8-415e-a653-33e8b543f3c5 tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:56:35.071671 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-cfd9fda5-15d8-415e-a653-33e8b543f3c5 tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] [instance: 87679611-878a-49b2-bf8f-39e784c6d70b] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:56:35.078701 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-cfd9fda5-15d8-415e-a653-33e8b543f3c5 tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:35.079190 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-cfd9fda5-15d8-415e-a653-33e8b543f3c5 tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:35.079921 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-cfd9fda5-15d8-415e-a653-33e8b543f3c5 tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:35.080686 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-cfd9fda5-15d8-415e-a653-33e8b543f3c5 tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:35.081154 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-cfd9fda5-15d8-415e-a653-33e8b543f3c5 tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:35.081624 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-cfd9fda5-15d8-415e-a653-33e8b543f3c5 tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:35.236450 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-cfd9fda5-15d8-415e-a653-33e8b543f3c5 tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '576abe5db27b461889fef2029d477e40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e9fb3117f68434bae7a463c357818dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:56:35.248023 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-cfd9fda5-15d8-415e-a653-33e8b543f3c5 tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '576abe5db27b461889fef2029d477e40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e9fb3117f68434bae7a463c357818dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:56:35.250141 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-cfd9fda5-15d8-415e-a653-33e8b543f3c5 tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '576abe5db27b461889fef2029d477e40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e9fb3117f68434bae7a463c357818dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:56:35.260103 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-cfd9fda5-15d8-415e-a653-33e8b543f3c5 tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] 10.222.0.13 "GET /compute/v2.1/servers/87679611-878a-49b2-bf8f-39e784c6d70b" status: 200 len: 1447 microversion: 2.75 time: 0.194531 Nov 01 18:56:35.272696 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 328/631] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 18:56:35 2022] GET /compute/v2.1/servers/87679611-878a-49b2-bf8f-39e784c6d70b => generated 1447 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 01 18:56:35.342413 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-d8f0981a-d298-4eae-bd56-77d9516a4475 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:56:35.343147 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-d8f0981a-d298-4eae-bd56-77d9516a4475 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] [instance: bee52bae-2df5-46a3-9aa9-f6b24bea11e3] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:56:35.349995 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-fc33cb7a-a992-4370-ac21-f559a47b9ee0 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72117f17294649d6b8bc16c66c7efab2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45d4c047d3c44324a27a27831236ab0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:56:35.357458 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-d8f0981a-d298-4eae-bd56-77d9516a4475 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:35.361230 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-fc33cb7a-a992-4370-ac21-f559a47b9ee0 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] 10.222.0.13 "GET /compute/v2.1/servers/614eb691-9a9a-4ca0-933d-686d80cc0ef1" status: 200 len: 1475 microversion: 2.1 time: 0.522286 Nov 01 18:56:35.361812 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-d8f0981a-d298-4eae-bd56-77d9516a4475 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:35.362826 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-d8f0981a-d298-4eae-bd56-77d9516a4475 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:35.366182 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-d8f0981a-d298-4eae-bd56-77d9516a4475 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:35.366814 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-d8f0981a-d298-4eae-bd56-77d9516a4475 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:35.367255 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-d8f0981a-d298-4eae-bd56-77d9516a4475 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:35.377602 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 304/632] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:56:34 2022] GET /compute/v2.1/servers/614eb691-9a9a-4ca0-933d-686d80cc0ef1 => generated 1475 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:56:35.613425 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-cb969eae-5a76-438a-ba47-c507beae7cc3 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:56:35.614245 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-cb969eae-5a76-438a-ba47-c507beae7cc3 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] [instance: ea631032-dd04-429b-988e-e6362ea42cf7] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:56:35.621107 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-cb969eae-5a76-438a-ba47-c507beae7cc3 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:35.621591 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-cb969eae-5a76-438a-ba47-c507beae7cc3 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:35.622017 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-cb969eae-5a76-438a-ba47-c507beae7cc3 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:35.622896 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-cb969eae-5a76-438a-ba47-c507beae7cc3 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:35.623502 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-cb969eae-5a76-438a-ba47-c507beae7cc3 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:35.624342 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-cb969eae-5a76-438a-ba47-c507beae7cc3 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:35.841816 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-d8f0981a-d298-4eae-bd56-77d9516a4475 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:56:35.854218 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-d8f0981a-d298-4eae-bd56-77d9516a4475 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:56:35.856187 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-d8f0981a-d298-4eae-bd56-77d9516a4475 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:56:35.857533 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-d8f0981a-d298-4eae-bd56-77d9516a4475 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] 10.222.0.13 "GET /compute/v2.1/servers/bee52bae-2df5-46a3-9aa9-f6b24bea11e3" status: 200 len: 1361 microversion: 2.25 time: 0.519172 Nov 01 18:56:35.858870 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 329/633] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 18:56:35 2022] GET /compute/v2.1/servers/bee52bae-2df5-46a3-9aa9-f6b24bea11e3 => generated 1361 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 01 18:56:35.864329 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-e2241b8a-b3d4-47e9-8b8d-1af93df9a4bd tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:56:35.865243 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-e2241b8a-b3d4-47e9-8b8d-1af93df9a4bd tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] [instance: 58d02dff-26f6-4c2f-b886-cdbdccbfcec9] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:56:35.872331 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e2241b8a-b3d4-47e9-8b8d-1af93df9a4bd tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:35.873302 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e2241b8a-b3d4-47e9-8b8d-1af93df9a4bd tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:35.874253 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e2241b8a-b3d4-47e9-8b8d-1af93df9a4bd tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:35.875195 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e2241b8a-b3d4-47e9-8b8d-1af93df9a4bd tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:35.875854 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e2241b8a-b3d4-47e9-8b8d-1af93df9a4bd tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:35.876478 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e2241b8a-b3d4-47e9-8b8d-1af93df9a4bd tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:35.985916 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-cb969eae-5a76-438a-ba47-c507beae7cc3 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c1314c21d8547ff890ede1c2ad281c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c804370880454c7aa02cef2c2c3cf144', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:56:35.996469 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-cb969eae-5a76-438a-ba47-c507beae7cc3 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c1314c21d8547ff890ede1c2ad281c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c804370880454c7aa02cef2c2c3cf144', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:56:36.002651 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-cb969eae-5a76-438a-ba47-c507beae7cc3 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c1314c21d8547ff890ede1c2ad281c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c804370880454c7aa02cef2c2c3cf144', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:56:36.011248 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-cb969eae-5a76-438a-ba47-c507beae7cc3 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] 10.222.0.13 "GET /compute/v2.1/servers/ea631032-dd04-429b-988e-e6362ea42cf7" status: 200 len: 1537 microversion: 2.91 time: 0.410370 Nov 01 18:56:36.050127 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 305/634] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 18:56:35 2022] GET /compute/v2.1/servers/ea631032-dd04-429b-988e-e6362ea42cf7 => generated 1537 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 18:56:36.214043 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-e2241b8a-b3d4-47e9-8b8d-1af93df9a4bd tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f32f5fba1976432d938e664c7714e52b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b9d4c236b944f9b2e8e502a50a8f8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:56:36.225783 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-e2241b8a-b3d4-47e9-8b8d-1af93df9a4bd tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] 10.222.0.13 "GET /compute/v2.1/servers/58d02dff-26f6-4c2f-b886-cdbdccbfcec9" status: 200 len: 1502 microversion: 2.1 time: 0.365122 Nov 01 18:56:36.228194 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 330/635] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:56:35 2022] GET /compute/v2.1/servers/58d02dff-26f6-4c2f-b886-cdbdccbfcec9 => generated 1502 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:56:36.296896 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-90ca3dfb-3a38-43bb-a67c-e9fe74b63d06 tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:56:36.298472 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-90ca3dfb-3a38-43bb-a67c-e9fe74b63d06 tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] [instance: 87679611-878a-49b2-bf8f-39e784c6d70b] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:56:36.308642 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-90ca3dfb-3a38-43bb-a67c-e9fe74b63d06 tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:36.311693 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-90ca3dfb-3a38-43bb-a67c-e9fe74b63d06 tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:36.312644 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-90ca3dfb-3a38-43bb-a67c-e9fe74b63d06 tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:36.316023 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-90ca3dfb-3a38-43bb-a67c-e9fe74b63d06 tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:36.316765 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-90ca3dfb-3a38-43bb-a67c-e9fe74b63d06 tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:36.321484 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-90ca3dfb-3a38-43bb-a67c-e9fe74b63d06 tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:36.390843 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-5cfa297c-2dcd-4dc3-98e5-02f643062a05 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:56:36.391922 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-5cfa297c-2dcd-4dc3-98e5-02f643062a05 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] [instance: 614eb691-9a9a-4ca0-933d-686d80cc0ef1] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:56:36.403424 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-5cfa297c-2dcd-4dc3-98e5-02f643062a05 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:36.404231 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-5cfa297c-2dcd-4dc3-98e5-02f643062a05 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:36.404949 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-5cfa297c-2dcd-4dc3-98e5-02f643062a05 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:36.407240 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-5cfa297c-2dcd-4dc3-98e5-02f643062a05 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:36.411948 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-5cfa297c-2dcd-4dc3-98e5-02f643062a05 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:36.411948 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-5cfa297c-2dcd-4dc3-98e5-02f643062a05 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:36.527140 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-90ca3dfb-3a38-43bb-a67c-e9fe74b63d06 tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '576abe5db27b461889fef2029d477e40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e9fb3117f68434bae7a463c357818dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:56:36.542460 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-90ca3dfb-3a38-43bb-a67c-e9fe74b63d06 tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '576abe5db27b461889fef2029d477e40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e9fb3117f68434bae7a463c357818dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:56:36.546940 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-90ca3dfb-3a38-43bb-a67c-e9fe74b63d06 tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '576abe5db27b461889fef2029d477e40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e9fb3117f68434bae7a463c357818dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:56:36.564463 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-90ca3dfb-3a38-43bb-a67c-e9fe74b63d06 tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] 10.222.0.13 "GET /compute/v2.1/servers/87679611-878a-49b2-bf8f-39e784c6d70b" status: 200 len: 1447 microversion: 2.75 time: 0.270922 Nov 01 18:56:36.569511 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 306/636] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 18:56:36 2022] GET /compute/v2.1/servers/87679611-878a-49b2-bf8f-39e784c6d70b => generated 1447 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 18:56:36.889937 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-767ccbd2-7dbb-425c-9739-b9c98145027f tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:56:36.890556 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-767ccbd2-7dbb-425c-9739-b9c98145027f tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] [instance: bee52bae-2df5-46a3-9aa9-f6b24bea11e3] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:56:36.906597 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-767ccbd2-7dbb-425c-9739-b9c98145027f tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:36.907099 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-767ccbd2-7dbb-425c-9739-b9c98145027f tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:36.907767 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-767ccbd2-7dbb-425c-9739-b9c98145027f tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:36.908487 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-767ccbd2-7dbb-425c-9739-b9c98145027f tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:36.908990 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-767ccbd2-7dbb-425c-9739-b9c98145027f tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:36.909485 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-767ccbd2-7dbb-425c-9739-b9c98145027f tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:36.961525 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-5cfa297c-2dcd-4dc3-98e5-02f643062a05 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72117f17294649d6b8bc16c66c7efab2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45d4c047d3c44324a27a27831236ab0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:56:36.975958 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-5cfa297c-2dcd-4dc3-98e5-02f643062a05 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] 10.222.0.13 "GET /compute/v2.1/servers/614eb691-9a9a-4ca0-933d-686d80cc0ef1" status: 200 len: 1475 microversion: 2.1 time: 0.587379 Nov 01 18:56:36.992252 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 331/637] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:56:36 2022] GET /compute/v2.1/servers/614eb691-9a9a-4ca0-933d-686d80cc0ef1 => generated 1475 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:56:37.047461 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-a9c35e7a-e2db-4f4e-861b-fcafe68ad124 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:56:37.048392 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-a9c35e7a-e2db-4f4e-861b-fcafe68ad124 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] [instance: ea631032-dd04-429b-988e-e6362ea42cf7] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:56:37.056487 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-a9c35e7a-e2db-4f4e-861b-fcafe68ad124 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:37.057291 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-a9c35e7a-e2db-4f4e-861b-fcafe68ad124 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:37.058236 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-a9c35e7a-e2db-4f4e-861b-fcafe68ad124 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:37.059159 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-a9c35e7a-e2db-4f4e-861b-fcafe68ad124 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:37.059809 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-a9c35e7a-e2db-4f4e-861b-fcafe68ad124 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:37.060457 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-a9c35e7a-e2db-4f4e-861b-fcafe68ad124 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:37.155016 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-a9c35e7a-e2db-4f4e-861b-fcafe68ad124 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c1314c21d8547ff890ede1c2ad281c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c804370880454c7aa02cef2c2c3cf144', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:56:37.169617 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-a9c35e7a-e2db-4f4e-861b-fcafe68ad124 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c1314c21d8547ff890ede1c2ad281c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c804370880454c7aa02cef2c2c3cf144', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:56:37.171347 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-a9c35e7a-e2db-4f4e-861b-fcafe68ad124 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c1314c21d8547ff890ede1c2ad281c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c804370880454c7aa02cef2c2c3cf144', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:56:37.180168 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-a9c35e7a-e2db-4f4e-861b-fcafe68ad124 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] 10.222.0.13 "GET /compute/v2.1/servers/ea631032-dd04-429b-988e-e6362ea42cf7" status: 200 len: 1537 microversion: 2.91 time: 0.137415 Nov 01 18:56:37.181228 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 332/638] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 18:56:37 2022] GET /compute/v2.1/servers/ea631032-dd04-429b-988e-e6362ea42cf7 => generated 1537 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 01 18:56:37.256093 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-81865873-56b4-4030-b402-82e80f092b7e tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:56:37.256757 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-81865873-56b4-4030-b402-82e80f092b7e tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] [instance: 58d02dff-26f6-4c2f-b886-cdbdccbfcec9] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:56:37.263004 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-81865873-56b4-4030-b402-82e80f092b7e tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:37.263499 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-81865873-56b4-4030-b402-82e80f092b7e tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:37.263932 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-81865873-56b4-4030-b402-82e80f092b7e tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:37.264655 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-81865873-56b4-4030-b402-82e80f092b7e tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:37.265114 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-81865873-56b4-4030-b402-82e80f092b7e tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:37.265534 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-81865873-56b4-4030-b402-82e80f092b7e tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:37.509348 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-767ccbd2-7dbb-425c-9739-b9c98145027f tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:56:37.526588 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-81865873-56b4-4030-b402-82e80f092b7e tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f32f5fba1976432d938e664c7714e52b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b9d4c236b944f9b2e8e502a50a8f8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:56:37.527183 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-767ccbd2-7dbb-425c-9739-b9c98145027f tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:56:37.531451 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-767ccbd2-7dbb-425c-9739-b9c98145027f tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:56:37.535453 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-767ccbd2-7dbb-425c-9739-b9c98145027f tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] 10.222.0.13 "GET /compute/v2.1/servers/bee52bae-2df5-46a3-9aa9-f6b24bea11e3" status: 200 len: 1361 microversion: 2.25 time: 0.649674 Nov 01 18:56:37.535618 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-81865873-56b4-4030-b402-82e80f092b7e tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] 10.222.0.13 "GET /compute/v2.1/servers/58d02dff-26f6-4c2f-b886-cdbdccbfcec9" status: 200 len: 1502 microversion: 2.1 time: 0.284171 Nov 01 18:56:37.539010 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 333/639] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:56:37 2022] GET /compute/v2.1/servers/58d02dff-26f6-4c2f-b886-cdbdccbfcec9 => generated 1502 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 18:56:37.539313 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 307/640] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 18:56:36 2022] GET /compute/v2.1/servers/bee52bae-2df5-46a3-9aa9-f6b24bea11e3 => generated 1361 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 18:56:37.592437 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-2fb4f0d6-3e85-4148-8ceb-26df5d99b1ab tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:56:37.593052 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-2fb4f0d6-3e85-4148-8ceb-26df5d99b1ab tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] [instance: 87679611-878a-49b2-bf8f-39e784c6d70b] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:56:37.601743 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2fb4f0d6-3e85-4148-8ceb-26df5d99b1ab tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:37.604736 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2fb4f0d6-3e85-4148-8ceb-26df5d99b1ab tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:37.605455 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2fb4f0d6-3e85-4148-8ceb-26df5d99b1ab tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:37.607428 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2fb4f0d6-3e85-4148-8ceb-26df5d99b1ab tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:37.608962 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2fb4f0d6-3e85-4148-8ceb-26df5d99b1ab tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:37.609560 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2fb4f0d6-3e85-4148-8ceb-26df5d99b1ab tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:37.729834 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-2fb4f0d6-3e85-4148-8ceb-26df5d99b1ab tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '576abe5db27b461889fef2029d477e40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e9fb3117f68434bae7a463c357818dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:56:37.738705 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-2fb4f0d6-3e85-4148-8ceb-26df5d99b1ab tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '576abe5db27b461889fef2029d477e40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e9fb3117f68434bae7a463c357818dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:56:37.740546 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-2fb4f0d6-3e85-4148-8ceb-26df5d99b1ab tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '576abe5db27b461889fef2029d477e40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e9fb3117f68434bae7a463c357818dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:56:37.746787 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-2fb4f0d6-3e85-4148-8ceb-26df5d99b1ab tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] 10.222.0.13 "GET /compute/v2.1/servers/87679611-878a-49b2-bf8f-39e784c6d70b" status: 200 len: 1447 microversion: 2.75 time: 0.158313 Nov 01 18:56:37.748042 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 334/641] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 18:56:37 2022] GET /compute/v2.1/servers/87679611-878a-49b2-bf8f-39e784c6d70b => generated 1447 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 18:56:38.019869 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-0a5229df-ece0-42cd-bd8a-c542c8672c7d tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:56:38.021663 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-0a5229df-ece0-42cd-bd8a-c542c8672c7d tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] [instance: 614eb691-9a9a-4ca0-933d-686d80cc0ef1] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:56:38.041747 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-0a5229df-ece0-42cd-bd8a-c542c8672c7d tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:38.042555 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-0a5229df-ece0-42cd-bd8a-c542c8672c7d tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:38.043658 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-0a5229df-ece0-42cd-bd8a-c542c8672c7d tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:38.044752 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-0a5229df-ece0-42cd-bd8a-c542c8672c7d tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:38.045560 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-0a5229df-ece0-42cd-bd8a-c542c8672c7d tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:38.046156 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-0a5229df-ece0-42cd-bd8a-c542c8672c7d tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:38.213903 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-130489b6-3f08-48d8-acff-84ae18f7dbe0 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:56:38.214516 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-130489b6-3f08-48d8-acff-84ae18f7dbe0 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] [instance: ea631032-dd04-429b-988e-e6362ea42cf7] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:56:38.227284 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-130489b6-3f08-48d8-acff-84ae18f7dbe0 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:38.237372 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-130489b6-3f08-48d8-acff-84ae18f7dbe0 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:38.238076 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-130489b6-3f08-48d8-acff-84ae18f7dbe0 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:38.238997 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-130489b6-3f08-48d8-acff-84ae18f7dbe0 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:38.239651 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-130489b6-3f08-48d8-acff-84ae18f7dbe0 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:38.240266 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-130489b6-3f08-48d8-acff-84ae18f7dbe0 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:38.409756 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-130489b6-3f08-48d8-acff-84ae18f7dbe0 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c1314c21d8547ff890ede1c2ad281c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c804370880454c7aa02cef2c2c3cf144', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:56:38.412534 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-0a5229df-ece0-42cd-bd8a-c542c8672c7d tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72117f17294649d6b8bc16c66c7efab2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45d4c047d3c44324a27a27831236ab0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:56:38.421061 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-130489b6-3f08-48d8-acff-84ae18f7dbe0 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c1314c21d8547ff890ede1c2ad281c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c804370880454c7aa02cef2c2c3cf144', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:56:38.421681 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-0a5229df-ece0-42cd-bd8a-c542c8672c7d tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] 10.222.0.13 "GET /compute/v2.1/servers/614eb691-9a9a-4ca0-933d-686d80cc0ef1" status: 200 len: 1475 microversion: 2.1 time: 0.425275 Nov 01 18:56:38.423379 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 308/642] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:56:37 2022] GET /compute/v2.1/servers/614eb691-9a9a-4ca0-933d-686d80cc0ef1 => generated 1475 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:56:38.429141 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-130489b6-3f08-48d8-acff-84ae18f7dbe0 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c1314c21d8547ff890ede1c2ad281c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c804370880454c7aa02cef2c2c3cf144', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:56:38.431018 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [req-34b55206-4a96-45bf-9ad9-d9a06fd572a3 req-ef28b332-45a0-434a-b68d-6149f859991d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58d02dff-26f6-4c2f-b886-cdbdccbfcec9", "name": "network-vif-unplugged", "status": "completed", "tag": "8434dc9d-ed20-488e-a620-72caae7c1bd3"}]} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 18:56:38.445619 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-34b55206-4a96-45bf-9ad9-d9a06fd572a3 req-ef28b332-45a0-434a-b68d-6149f859991d service nova] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:38.446536 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-34b55206-4a96-45bf-9ad9-d9a06fd572a3 req-ef28b332-45a0-434a-b68d-6149f859991d service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:38.447261 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-34b55206-4a96-45bf-9ad9-d9a06fd572a3 req-ef28b332-45a0-434a-b68d-6149f859991d service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:38.450997 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-130489b6-3f08-48d8-acff-84ae18f7dbe0 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] 10.222.0.13 "GET /compute/v2.1/servers/ea631032-dd04-429b-988e-e6362ea42cf7" status: 200 len: 1537 microversion: 2.91 time: 0.240115 Nov 01 18:56:38.454678 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 335/643] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 18:56:38 2022] GET /compute/v2.1/servers/ea631032-dd04-429b-988e-e6362ea42cf7 => generated 1537 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 18:56:38.490110 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.compute.server_external_events [req-34b55206-4a96-45bf-9ad9-d9a06fd572a3 req-ef28b332-45a0-434a-b68d-6149f859991d service nova] Creating event network-vif-unplugged:8434dc9d-ed20-488e-a620-72caae7c1bd3 for instance 58d02dff-26f6-4c2f-b886-cdbdccbfcec9 on n-h1-863052-2 Nov 01 18:56:38.498373 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [req-34b55206-4a96-45bf-9ad9-d9a06fd572a3 req-ef28b332-45a0-434a-b68d-6149f859991d service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.073224 Nov 01 18:56:38.499622 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 309/644] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Nov 1 18:56:38 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 18:56:38.563968 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-7ef22cf0-244a-4cbf-be48-b20c1d45207b tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:56:38.564532 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-7ef22cf0-244a-4cbf-be48-b20c1d45207b tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] [instance: bee52bae-2df5-46a3-9aa9-f6b24bea11e3] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:56:38.569792 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-fd932001-a73d-40fe-9525-0b0e0b3b7ea5 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:56:38.570614 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-fd932001-a73d-40fe-9525-0b0e0b3b7ea5 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] [instance: 58d02dff-26f6-4c2f-b886-cdbdccbfcec9] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:56:38.577248 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-7ef22cf0-244a-4cbf-be48-b20c1d45207b tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:38.577983 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-7ef22cf0-244a-4cbf-be48-b20c1d45207b tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:38.580512 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-7ef22cf0-244a-4cbf-be48-b20c1d45207b tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:38.581546 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-7ef22cf0-244a-4cbf-be48-b20c1d45207b tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:38.582017 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-7ef22cf0-244a-4cbf-be48-b20c1d45207b tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:38.583835 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-fd932001-a73d-40fe-9525-0b0e0b3b7ea5 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:38.584511 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-7ef22cf0-244a-4cbf-be48-b20c1d45207b tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:38.586295 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-fd932001-a73d-40fe-9525-0b0e0b3b7ea5 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:38.587603 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-fd932001-a73d-40fe-9525-0b0e0b3b7ea5 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:38.588347 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-fd932001-a73d-40fe-9525-0b0e0b3b7ea5 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:38.590949 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-fd932001-a73d-40fe-9525-0b0e0b3b7ea5 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:38.592939 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-fd932001-a73d-40fe-9525-0b0e0b3b7ea5 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:38.916640 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-7ef22cf0-244a-4cbf-be48-b20c1d45207b tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:56:38.934431 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-7ef22cf0-244a-4cbf-be48-b20c1d45207b tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:56:38.935776 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-7ef22cf0-244a-4cbf-be48-b20c1d45207b tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:56:38.938968 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-7ef22cf0-244a-4cbf-be48-b20c1d45207b tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] 10.222.0.13 "GET /compute/v2.1/servers/bee52bae-2df5-46a3-9aa9-f6b24bea11e3" status: 200 len: 1361 microversion: 2.25 time: 0.377462 Nov 01 18:56:38.944521 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 336/645] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 18:56:38 2022] GET /compute/v2.1/servers/bee52bae-2df5-46a3-9aa9-f6b24bea11e3 => generated 1361 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 18:56:38.953651 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-20f72421-cd73-44c1-b579-36e5a8e05591 tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:56:38.958475 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-20f72421-cd73-44c1-b579-36e5a8e05591 tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] [instance: 87679611-878a-49b2-bf8f-39e784c6d70b] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:56:38.971159 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-20f72421-cd73-44c1-b579-36e5a8e05591 tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:38.971873 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-20f72421-cd73-44c1-b579-36e5a8e05591 tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:38.972258 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-20f72421-cd73-44c1-b579-36e5a8e05591 tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:38.973015 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-20f72421-cd73-44c1-b579-36e5a8e05591 tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:38.973477 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-20f72421-cd73-44c1-b579-36e5a8e05591 tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:38.979711 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-20f72421-cd73-44c1-b579-36e5a8e05591 tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:39.091368 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-fd932001-a73d-40fe-9525-0b0e0b3b7ea5 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f32f5fba1976432d938e664c7714e52b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b9d4c236b944f9b2e8e502a50a8f8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:56:39.100434 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-fd932001-a73d-40fe-9525-0b0e0b3b7ea5 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] 10.222.0.13 "GET /compute/v2.1/servers/58d02dff-26f6-4c2f-b886-cdbdccbfcec9" status: 200 len: 1502 microversion: 2.1 time: 0.538114 Nov 01 18:56:39.104970 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 310/646] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:56:38 2022] GET /compute/v2.1/servers/58d02dff-26f6-4c2f-b886-cdbdccbfcec9 => generated 1502 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 18:56:39.164576 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-20f72421-cd73-44c1-b579-36e5a8e05591 tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '576abe5db27b461889fef2029d477e40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e9fb3117f68434bae7a463c357818dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:56:39.175332 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-20f72421-cd73-44c1-b579-36e5a8e05591 tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '576abe5db27b461889fef2029d477e40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e9fb3117f68434bae7a463c357818dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:56:39.177383 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-20f72421-cd73-44c1-b579-36e5a8e05591 tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '576abe5db27b461889fef2029d477e40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e9fb3117f68434bae7a463c357818dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:56:39.192850 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-20f72421-cd73-44c1-b579-36e5a8e05591 tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] 10.222.0.13 "GET /compute/v2.1/servers/87679611-878a-49b2-bf8f-39e784c6d70b" status: 200 len: 1447 microversion: 2.75 time: 0.244177 Nov 01 18:56:39.206265 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 337/647] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 18:56:38 2022] GET /compute/v2.1/servers/87679611-878a-49b2-bf8f-39e784c6d70b => generated 1447 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 18:56:39.458877 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-7907168b-ecca-438a-890e-cd246ee73efc tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:56:39.459746 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-7907168b-ecca-438a-890e-cd246ee73efc tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] [instance: 614eb691-9a9a-4ca0-933d-686d80cc0ef1] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:56:39.470660 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-7907168b-ecca-438a-890e-cd246ee73efc tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:39.473148 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-7907168b-ecca-438a-890e-cd246ee73efc tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:39.475039 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-7907168b-ecca-438a-890e-cd246ee73efc tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:39.476673 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-7907168b-ecca-438a-890e-cd246ee73efc tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:39.478800 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-7907168b-ecca-438a-890e-cd246ee73efc tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:39.480972 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-7907168b-ecca-438a-890e-cd246ee73efc tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:39.493762 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-432861e7-b051-45fa-b032-15a41bd41979 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:56:39.497043 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-432861e7-b051-45fa-b032-15a41bd41979 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] [instance: ea631032-dd04-429b-988e-e6362ea42cf7] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:56:39.518734 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-432861e7-b051-45fa-b032-15a41bd41979 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:39.525225 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-432861e7-b051-45fa-b032-15a41bd41979 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:39.525731 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-432861e7-b051-45fa-b032-15a41bd41979 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:39.528850 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-432861e7-b051-45fa-b032-15a41bd41979 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:39.534924 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-432861e7-b051-45fa-b032-15a41bd41979 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:39.543598 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-432861e7-b051-45fa-b032-15a41bd41979 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:39.548463 n-d-863052-2 devstack@n-api.service[121402]: DEBUG dbcounter [-] [121402] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 18:56:39.626616 n-d-863052-2 devstack@n-api.service[121402]: DEBUG dbcounter [-] [121402] Writing DB stats nova_cell0:SELECT=9 {{(pid=121402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 18:56:39.634168 n-d-863052-2 devstack@n-api.service[121402]: DEBUG dbcounter [-] [121402] Writing DB stats nova_cell0:SELECT=31 {{(pid=121402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 18:56:39.789304 n-d-863052-2 devstack@n-api.service[121403]: DEBUG dbcounter [-] [121403] Writing DB stats nova_cell0:SELECT=8 {{(pid=121403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 18:56:39.850824 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-432861e7-b051-45fa-b032-15a41bd41979 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c1314c21d8547ff890ede1c2ad281c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c804370880454c7aa02cef2c2c3cf144', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:56:39.861825 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-432861e7-b051-45fa-b032-15a41bd41979 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c1314c21d8547ff890ede1c2ad281c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c804370880454c7aa02cef2c2c3cf144', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:56:39.866369 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-432861e7-b051-45fa-b032-15a41bd41979 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c1314c21d8547ff890ede1c2ad281c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c804370880454c7aa02cef2c2c3cf144', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:56:39.875278 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-432861e7-b051-45fa-b032-15a41bd41979 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] 10.222.0.13 "GET /compute/v2.1/servers/ea631032-dd04-429b-988e-e6362ea42cf7" status: 200 len: 1537 microversion: 2.91 time: 0.391385 Nov 01 18:56:39.893023 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 338/648] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 18:56:39 2022] GET /compute/v2.1/servers/ea631032-dd04-429b-988e-e6362ea42cf7 => generated 1537 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 18:56:39.970864 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-74f51c8b-31fc-44ca-ab17-929839847e56 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:56:39.972073 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-74f51c8b-31fc-44ca-ab17-929839847e56 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] [instance: bee52bae-2df5-46a3-9aa9-f6b24bea11e3] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:56:39.993709 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-74f51c8b-31fc-44ca-ab17-929839847e56 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:39.994127 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-74f51c8b-31fc-44ca-ab17-929839847e56 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:39.997488 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-74f51c8b-31fc-44ca-ab17-929839847e56 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:39.998872 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-74f51c8b-31fc-44ca-ab17-929839847e56 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:40.000391 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-74f51c8b-31fc-44ca-ab17-929839847e56 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:40.001037 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-74f51c8b-31fc-44ca-ab17-929839847e56 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:40.151287 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-7907168b-ecca-438a-890e-cd246ee73efc tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72117f17294649d6b8bc16c66c7efab2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45d4c047d3c44324a27a27831236ab0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:56:40.160189 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-7907168b-ecca-438a-890e-cd246ee73efc tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] 10.222.0.13 "GET /compute/v2.1/servers/614eb691-9a9a-4ca0-933d-686d80cc0ef1" status: 200 len: 1475 microversion: 2.1 time: 0.713790 Nov 01 18:56:40.161700 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 311/649] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:56:39 2022] GET /compute/v2.1/servers/614eb691-9a9a-4ca0-933d-686d80cc0ef1 => generated 1475 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:56:40.190166 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-74f51c8b-31fc-44ca-ab17-929839847e56 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:56:40.201726 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-74f51c8b-31fc-44ca-ab17-929839847e56 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:56:40.203282 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-74f51c8b-31fc-44ca-ab17-929839847e56 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:56:40.204517 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-74f51c8b-31fc-44ca-ab17-929839847e56 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] 10.222.0.13 "GET /compute/v2.1/servers/bee52bae-2df5-46a3-9aa9-f6b24bea11e3" status: 200 len: 1361 microversion: 2.25 time: 0.237811 Nov 01 18:56:40.205480 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 339/650] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 18:56:39 2022] GET /compute/v2.1/servers/bee52bae-2df5-46a3-9aa9-f6b24bea11e3 => generated 1361 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 18:56:40.211561 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-8039c753-672f-4c6d-943f-9862612e356f tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:56:40.212250 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-8039c753-672f-4c6d-943f-9862612e356f tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] [instance: 58d02dff-26f6-4c2f-b886-cdbdccbfcec9] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:56:40.221001 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-8039c753-672f-4c6d-943f-9862612e356f tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:40.221878 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-8039c753-672f-4c6d-943f-9862612e356f tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:40.222508 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-8039c753-672f-4c6d-943f-9862612e356f tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:40.223622 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-8039c753-672f-4c6d-943f-9862612e356f tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:40.224282 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-8039c753-672f-4c6d-943f-9862612e356f tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:40.225417 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-8039c753-672f-4c6d-943f-9862612e356f tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:40.336540 n-d-863052-2 devstack@n-api.service[121403]: DEBUG dbcounter [-] [121403] Writing DB stats nova_cell0:SELECT=66,nova_cell0:UPDATE=12 {{(pid=121403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 18:56:40.384761 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-05d8e99e-9edf-4220-aba0-96efb2cdd7b0 tempest-ServerAddressesNegativeTestJSON-736278170 tempest-ServerAddressesNegativeTestJSON-736278170-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerAddressesNegativeTestJSON-server-1351314524", "imageRef": "2d4a0047-1b9e-445f-8af8-1b5c9d93e881", "flavorRef": "452", "networks": [{"uuid": "35fbd29c-8884-47ea-b840-1c0e9492c232"}]}} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 18:56:40.448229 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-8039c753-672f-4c6d-943f-9862612e356f tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f32f5fba1976432d938e664c7714e52b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b9d4c236b944f9b2e8e502a50a8f8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:56:40.461043 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-8039c753-672f-4c6d-943f-9862612e356f tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] 10.222.0.13 "GET /compute/v2.1/servers/58d02dff-26f6-4c2f-b886-cdbdccbfcec9" status: 200 len: 1502 microversion: 2.1 time: 0.254316 Nov 01 18:56:40.461864 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 340/651] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:56:40 2022] GET /compute/v2.1/servers/58d02dff-26f6-4c2f-b886-cdbdccbfcec9 => generated 1502 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:56:40.471114 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-e7daad97-29de-4976-9924-13eea5d0d224 tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:56:40.471964 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-e7daad97-29de-4976-9924-13eea5d0d224 tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] [instance: 87679611-878a-49b2-bf8f-39e784c6d70b] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:56:40.481936 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e7daad97-29de-4976-9924-13eea5d0d224 tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:40.482433 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e7daad97-29de-4976-9924-13eea5d0d224 tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:40.482868 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e7daad97-29de-4976-9924-13eea5d0d224 tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:40.483578 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e7daad97-29de-4976-9924-13eea5d0d224 tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:40.484456 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e7daad97-29de-4976-9924-13eea5d0d224 tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:40.485069 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e7daad97-29de-4976-9924-13eea5d0d224 tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:40.504558 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.network.neutron [None req-05d8e99e-9edf-4220-aba0-96efb2cdd7b0 tempest-ServerAddressesNegativeTestJSON-736278170 tempest-ServerAddressesNegativeTestJSON-736278170-project] validate_networks() for [('35fbd29c-8884-47ea-b840-1c0e9492c232', None, None, None, None, None)] {{(pid=121403) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 01 18:56:40.579289 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-e7daad97-29de-4976-9924-13eea5d0d224 tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '576abe5db27b461889fef2029d477e40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e9fb3117f68434bae7a463c357818dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:56:40.593389 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-e7daad97-29de-4976-9924-13eea5d0d224 tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '576abe5db27b461889fef2029d477e40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e9fb3117f68434bae7a463c357818dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:56:40.595316 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-e7daad97-29de-4976-9924-13eea5d0d224 tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '576abe5db27b461889fef2029d477e40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e9fb3117f68434bae7a463c357818dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:56:40.601770 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-e7daad97-29de-4976-9924-13eea5d0d224 tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] 10.222.0.13 "GET /compute/v2.1/servers/87679611-878a-49b2-bf8f-39e784c6d70b" status: 200 len: 1447 microversion: 2.75 time: 0.138623 Nov 01 18:56:40.602454 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 341/652] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 18:56:40 2022] GET /compute/v2.1/servers/87679611-878a-49b2-bf8f-39e784c6d70b => generated 1447 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 18:56:40.616052 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [req-66f47426-687e-47b5-b006-502c938e2669 req-5a14717e-fe74-4708-a0e2-262a10a2feca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "58d02dff-26f6-4c2f-b886-cdbdccbfcec9", "tag": "8434dc9d-ed20-488e-a620-72caae7c1bd3"}]} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 18:56:40.631594 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-66f47426-687e-47b5-b006-502c938e2669 req-5a14717e-fe74-4708-a0e2-262a10a2feca service nova] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:40.632405 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-66f47426-687e-47b5-b006-502c938e2669 req-5a14717e-fe74-4708-a0e2-262a10a2feca service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:40.633017 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-66f47426-687e-47b5-b006-502c938e2669 req-5a14717e-fe74-4708-a0e2-262a10a2feca service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:40.650958 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.compute.server_external_events [req-66f47426-687e-47b5-b006-502c938e2669 req-5a14717e-fe74-4708-a0e2-262a10a2feca service nova] Creating event network-changed:8434dc9d-ed20-488e-a620-72caae7c1bd3 for instance 58d02dff-26f6-4c2f-b886-cdbdccbfcec9 on n-h1-863052-2 Nov 01 18:56:40.663123 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [req-66f47426-687e-47b5-b006-502c938e2669 req-5a14717e-fe74-4708-a0e2-262a10a2feca service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058744 Nov 01 18:56:40.664348 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 342/653] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Nov 1 18:56:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 18:56:40.912147 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-8398226a-53dd-4209-8776-b4ac984f0908 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:56:40.913082 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-8398226a-53dd-4209-8776-b4ac984f0908 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] [instance: ea631032-dd04-429b-988e-e6362ea42cf7] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:56:40.925754 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-8398226a-53dd-4209-8776-b4ac984f0908 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:40.927103 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-8398226a-53dd-4209-8776-b4ac984f0908 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:40.929198 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-8398226a-53dd-4209-8776-b4ac984f0908 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:40.933743 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-8398226a-53dd-4209-8776-b4ac984f0908 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:40.945239 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-8398226a-53dd-4209-8776-b4ac984f0908 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:40.946006 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-8398226a-53dd-4209-8776-b4ac984f0908 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:41.069001 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-8398226a-53dd-4209-8776-b4ac984f0908 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c1314c21d8547ff890ede1c2ad281c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c804370880454c7aa02cef2c2c3cf144', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:56:41.078895 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-8398226a-53dd-4209-8776-b4ac984f0908 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c1314c21d8547ff890ede1c2ad281c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c804370880454c7aa02cef2c2c3cf144', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:56:41.083821 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-8398226a-53dd-4209-8776-b4ac984f0908 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c1314c21d8547ff890ede1c2ad281c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c804370880454c7aa02cef2c2c3cf144', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:56:41.093598 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-8398226a-53dd-4209-8776-b4ac984f0908 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] 10.222.0.13 "GET /compute/v2.1/servers/ea631032-dd04-429b-988e-e6362ea42cf7" status: 200 len: 1537 microversion: 2.91 time: 0.186791 Nov 01 18:56:41.096642 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 343/654] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 18:56:40 2022] GET /compute/v2.1/servers/ea631032-dd04-429b-988e-e6362ea42cf7 => generated 1537 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 18:56:41.100482 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [req-87592057-c015-4a39-8068-ef40d84fc580 req-e1317372-0717-457f-8dc6-7b069a8af745 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bee52bae-2df5-46a3-9aa9-f6b24bea11e3", "name": "network-vif-plugged", "status": "completed", "tag": "8f917f95-25be-4ada-95ec-6e61439ce94b"}]} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 18:56:41.118220 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-87592057-c015-4a39-8068-ef40d84fc580 req-e1317372-0717-457f-8dc6-7b069a8af745 service nova] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:41.120092 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-87592057-c015-4a39-8068-ef40d84fc580 req-e1317372-0717-457f-8dc6-7b069a8af745 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:41.120669 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-87592057-c015-4a39-8068-ef40d84fc580 req-e1317372-0717-457f-8dc6-7b069a8af745 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:41.133275 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.compute.server_external_events [req-87592057-c015-4a39-8068-ef40d84fc580 req-e1317372-0717-457f-8dc6-7b069a8af745 service nova] Creating event network-vif-plugged:8f917f95-25be-4ada-95ec-6e61439ce94b for instance bee52bae-2df5-46a3-9aa9-f6b24bea11e3 on n-h1-863052-2 Nov 01 18:56:41.139522 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [req-87592057-c015-4a39-8068-ef40d84fc580 req-e1317372-0717-457f-8dc6-7b069a8af745 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043156 Nov 01 18:56:41.140531 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 344/655] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Nov 1 18:56:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 18:56:41.184022 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-3154a3c3-5d50-49cb-8132-5556aa9c1058 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:56:41.184750 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-3154a3c3-5d50-49cb-8132-5556aa9c1058 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] [instance: 614eb691-9a9a-4ca0-933d-686d80cc0ef1] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:56:41.191662 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-3154a3c3-5d50-49cb-8132-5556aa9c1058 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:41.192159 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-3154a3c3-5d50-49cb-8132-5556aa9c1058 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:41.193558 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-3154a3c3-5d50-49cb-8132-5556aa9c1058 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:41.193853 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-3154a3c3-5d50-49cb-8132-5556aa9c1058 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:41.194311 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-3154a3c3-5d50-49cb-8132-5556aa9c1058 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:41.194730 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-3154a3c3-5d50-49cb-8132-5556aa9c1058 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:41.458426 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-3154a3c3-5d50-49cb-8132-5556aa9c1058 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72117f17294649d6b8bc16c66c7efab2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45d4c047d3c44324a27a27831236ab0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:56:41.477053 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-3154a3c3-5d50-49cb-8132-5556aa9c1058 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] 10.222.0.13 "GET /compute/v2.1/servers/614eb691-9a9a-4ca0-933d-686d80cc0ef1" status: 200 len: 1475 microversion: 2.1 time: 0.297135 Nov 01 18:56:41.479997 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 345/656] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:56:41 2022] GET /compute/v2.1/servers/614eb691-9a9a-4ca0-933d-686d80cc0ef1 => generated 1475 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 18:56:41.490860 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-d0cd750d-a595-4617-9cf9-efc6d57f2f7b tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:56:41.493653 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-d0cd750d-a595-4617-9cf9-efc6d57f2f7b tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] [instance: bee52bae-2df5-46a3-9aa9-f6b24bea11e3] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:56:41.499831 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-d0cd750d-a595-4617-9cf9-efc6d57f2f7b tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:41.500470 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-d0cd750d-a595-4617-9cf9-efc6d57f2f7b tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:41.500940 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-d0cd750d-a595-4617-9cf9-efc6d57f2f7b tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:41.501640 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-d0cd750d-a595-4617-9cf9-efc6d57f2f7b tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:41.502752 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-d0cd750d-a595-4617-9cf9-efc6d57f2f7b tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:41.503189 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-d0cd750d-a595-4617-9cf9-efc6d57f2f7b tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:41.660499 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-d0cd750d-a595-4617-9cf9-efc6d57f2f7b tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:56:41.669176 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-d0cd750d-a595-4617-9cf9-efc6d57f2f7b tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:56:41.670647 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-d0cd750d-a595-4617-9cf9-efc6d57f2f7b tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:56:41.671782 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-d0cd750d-a595-4617-9cf9-efc6d57f2f7b tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] 10.222.0.13 "GET /compute/v2.1/servers/bee52bae-2df5-46a3-9aa9-f6b24bea11e3" status: 200 len: 1361 microversion: 2.25 time: 0.191973 Nov 01 18:56:41.672343 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 346/657] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 18:56:41 2022] GET /compute/v2.1/servers/bee52bae-2df5-46a3-9aa9-f6b24bea11e3 => generated 1361 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 18:56:41.688929 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-cf423fae-1b1f-4b3c-954c-01860b60faab tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:56:41.689835 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-cf423fae-1b1f-4b3c-954c-01860b60faab tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] [instance: 58d02dff-26f6-4c2f-b886-cdbdccbfcec9] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:56:41.694046 n-d-863052-2 devstack@n-api.service[121402]: DEBUG dbcounter [-] [121402] Writing DB stats nova_api:SELECT=100 {{(pid=121402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 18:56:41.698144 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-cf423fae-1b1f-4b3c-954c-01860b60faab tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:41.698646 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-cf423fae-1b1f-4b3c-954c-01860b60faab tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:41.699702 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-cf423fae-1b1f-4b3c-954c-01860b60faab tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:41.700422 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-cf423fae-1b1f-4b3c-954c-01860b60faab tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:41.701057 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-cf423fae-1b1f-4b3c-954c-01860b60faab tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:41.701483 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-cf423fae-1b1f-4b3c-954c-01860b60faab tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:41.844555 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.virt.hardware [None req-05d8e99e-9edf-4220-aba0-96efb2cdd7b0 tempest-ServerAddressesNegativeTestJSON-736278170 tempest-ServerAddressesNegativeTestJSON-736278170-project] Flavor limits 0:0:0 {{(pid=121403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 01 18:56:41.845573 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.virt.hardware [None req-05d8e99e-9edf-4220-aba0-96efb2cdd7b0 tempest-ServerAddressesNegativeTestJSON-736278170 tempest-ServerAddressesNegativeTestJSON-736278170-project] Image limits 0:0:0 {{(pid=121403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 01 18:56:41.846547 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-cf423fae-1b1f-4b3c-954c-01860b60faab tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f32f5fba1976432d938e664c7714e52b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b9d4c236b944f9b2e8e502a50a8f8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:56:41.846817 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.virt.hardware [None req-05d8e99e-9edf-4220-aba0-96efb2cdd7b0 tempest-ServerAddressesNegativeTestJSON-736278170 tempest-ServerAddressesNegativeTestJSON-736278170-project] Flavor pref 0:0:0 {{(pid=121403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 01 18:56:41.847445 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.virt.hardware [None req-05d8e99e-9edf-4220-aba0-96efb2cdd7b0 tempest-ServerAddressesNegativeTestJSON-736278170 tempest-ServerAddressesNegativeTestJSON-736278170-project] Image pref 0:0:0 {{(pid=121403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 01 18:56:41.849942 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.virt.hardware [None req-05d8e99e-9edf-4220-aba0-96efb2cdd7b0 tempest-ServerAddressesNegativeTestJSON-736278170 tempest-ServerAddressesNegativeTestJSON-736278170-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 01 18:56:41.856620 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-cf423fae-1b1f-4b3c-954c-01860b60faab tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] 10.222.0.13 "GET /compute/v2.1/servers/58d02dff-26f6-4c2f-b886-cdbdccbfcec9" status: 200 len: 1502 microversion: 2.1 time: 0.183026 Nov 01 18:56:41.857272 n-d-863052-2 devstack@n-api.service[121403]: DEBUG dbcounter [-] [121403] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=121403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 18:56:41.864952 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 347/658] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:56:41 2022] GET /compute/v2.1/servers/58d02dff-26f6-4c2f-b886-cdbdccbfcec9 => generated 1502 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:56:41.864952 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-f272bc41-79ce-462a-89fd-b5cd3e03276d tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:56:41.864952 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-f272bc41-79ce-462a-89fd-b5cd3e03276d tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] [instance: 87679611-878a-49b2-bf8f-39e784c6d70b] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:56:41.871445 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f272bc41-79ce-462a-89fd-b5cd3e03276d tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:41.872457 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f272bc41-79ce-462a-89fd-b5cd3e03276d tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:41.873806 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f272bc41-79ce-462a-89fd-b5cd3e03276d tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:41.874935 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f272bc41-79ce-462a-89fd-b5cd3e03276d tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:41.875822 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f272bc41-79ce-462a-89fd-b5cd3e03276d tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:41.876679 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f272bc41-79ce-462a-89fd-b5cd3e03276d tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:41.883570 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-05d8e99e-9edf-4220-aba0-96efb2cdd7b0 tempest-ServerAddressesNegativeTestJSON-736278170 tempest-ServerAddressesNegativeTestJSON-736278170-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:41.884096 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-05d8e99e-9edf-4220-aba0-96efb2cdd7b0 tempest-ServerAddressesNegativeTestJSON-736278170 tempest-ServerAddressesNegativeTestJSON-736278170-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:41.884537 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-05d8e99e-9edf-4220-aba0-96efb2cdd7b0 tempest-ServerAddressesNegativeTestJSON-736278170 tempest-ServerAddressesNegativeTestJSON-736278170-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:41.885296 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-05d8e99e-9edf-4220-aba0-96efb2cdd7b0 tempest-ServerAddressesNegativeTestJSON-736278170 tempest-ServerAddressesNegativeTestJSON-736278170-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:41.885755 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-05d8e99e-9edf-4220-aba0-96efb2cdd7b0 tempest-ServerAddressesNegativeTestJSON-736278170 tempest-ServerAddressesNegativeTestJSON-736278170-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:41.886179 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-05d8e99e-9edf-4220-aba0-96efb2cdd7b0 tempest-ServerAddressesNegativeTestJSON-736278170 tempest-ServerAddressesNegativeTestJSON-736278170-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:41.905244 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.quota [None req-05d8e99e-9edf-4220-aba0-96efb2cdd7b0 tempest-ServerAddressesNegativeTestJSON-736278170 tempest-ServerAddressesNegativeTestJSON-736278170-project] Getting quotas for project 11d85b21bccf4bc78d4cbffd4f80357f. Resources: {'cores', 'ram', 'instances'} {{(pid=121403) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 01 18:56:41.910532 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.quota [None req-05d8e99e-9edf-4220-aba0-96efb2cdd7b0 tempest-ServerAddressesNegativeTestJSON-736278170 tempest-ServerAddressesNegativeTestJSON-736278170-project] Getting quotas for user a5a7d955d1004147b12eb569a7e7355a and project 11d85b21bccf4bc78d4cbffd4f80357f. Resources: {'cores', 'ram', 'instances'} {{(pid=121403) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 01 18:56:41.929341 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-05d8e99e-9edf-4220-aba0-96efb2cdd7b0 tempest-ServerAddressesNegativeTestJSON-736278170 tempest-ServerAddressesNegativeTestJSON-736278170-project] Going to run 1 instances... {{(pid=121403) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 01 18:56:41.932155 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-05d8e99e-9edf-4220-aba0-96efb2cdd7b0 tempest-ServerAddressesNegativeTestJSON-736278170 tempest-ServerAddressesNegativeTestJSON-736278170-project] [instance: 034c1271-a323-4728-985c-3d70df31eeb2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2d4a0047-1b9e-445f-8af8-1b5c9d93e881',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121403) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 01 18:56:41.963796 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-f272bc41-79ce-462a-89fd-b5cd3e03276d tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '576abe5db27b461889fef2029d477e40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e9fb3117f68434bae7a463c357818dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:56:41.972282 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-f272bc41-79ce-462a-89fd-b5cd3e03276d tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '576abe5db27b461889fef2029d477e40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e9fb3117f68434bae7a463c357818dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:56:41.974393 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-f272bc41-79ce-462a-89fd-b5cd3e03276d tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '576abe5db27b461889fef2029d477e40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e9fb3117f68434bae7a463c357818dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:56:41.990637 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-f272bc41-79ce-462a-89fd-b5cd3e03276d tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] 10.222.0.13 "GET /compute/v2.1/servers/87679611-878a-49b2-bf8f-39e784c6d70b" status: 200 len: 1447 microversion: 2.75 time: 0.131309 Nov 01 18:56:41.991235 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 348/659] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 18:56:41 2022] GET /compute/v2.1/servers/87679611-878a-49b2-bf8f-39e784c6d70b => generated 1447 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 18:56:42.058927 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-05d8e99e-9edf-4220-aba0-96efb2cdd7b0 tempest-ServerAddressesNegativeTestJSON-736278170 tempest-ServerAddressesNegativeTestJSON-736278170-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.893314 Nov 01 18:56:42.060499 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 312/660] 10.222.0.13 () {60 vars in 1147 bytes} [Tue Nov 1 18:56:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 1895 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 01 18:56:42.071582 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-365e38ed-7ba8-451d-8db8-a6625f31800e tempest-ServerAddressesNegativeTestJSON-736278170 tempest-ServerAddressesNegativeTestJSON-736278170-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:56:42.072194 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-365e38ed-7ba8-451d-8db8-a6625f31800e tempest-ServerAddressesNegativeTestJSON-736278170 tempest-ServerAddressesNegativeTestJSON-736278170-project] [instance: 034c1271-a323-4728-985c-3d70df31eeb2] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:56:42.124740 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-c1860c7b-2f91-4da2-9b2c-eacd381565f8 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:56:42.126744 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-c1860c7b-2f91-4da2-9b2c-eacd381565f8 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] [instance: ea631032-dd04-429b-988e-e6362ea42cf7] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:56:42.141841 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-c1860c7b-2f91-4da2-9b2c-eacd381565f8 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:42.142582 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-c1860c7b-2f91-4da2-9b2c-eacd381565f8 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:42.144339 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-c1860c7b-2f91-4da2-9b2c-eacd381565f8 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:42.145256 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-c1860c7b-2f91-4da2-9b2c-eacd381565f8 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:42.148162 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-c1860c7b-2f91-4da2-9b2c-eacd381565f8 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:42.151238 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-c1860c7b-2f91-4da2-9b2c-eacd381565f8 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:42.200188 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-365e38ed-7ba8-451d-8db8-a6625f31800e tempest-ServerAddressesNegativeTestJSON-736278170 tempest-ServerAddressesNegativeTestJSON-736278170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5a7d955d1004147b12eb569a7e7355a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d85b21bccf4bc78d4cbffd4f80357f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:56:42.227904 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-365e38ed-7ba8-451d-8db8-a6625f31800e tempest-ServerAddressesNegativeTestJSON-736278170 tempest-ServerAddressesNegativeTestJSON-736278170-project] 10.222.0.13 "GET /compute/v2.1/servers/034c1271-a323-4728-985c-3d70df31eeb2" status: 200 len: 1225 microversion: 2.1 time: 0.160099 Nov 01 18:56:42.233881 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 349/661] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:56:42 2022] GET /compute/v2.1/servers/034c1271-a323-4728-985c-3d70df31eeb2 => generated 1225 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:56:42.396293 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-c1860c7b-2f91-4da2-9b2c-eacd381565f8 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c1314c21d8547ff890ede1c2ad281c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c804370880454c7aa02cef2c2c3cf144', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:56:42.414860 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-c1860c7b-2f91-4da2-9b2c-eacd381565f8 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c1314c21d8547ff890ede1c2ad281c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c804370880454c7aa02cef2c2c3cf144', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:56:42.416419 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-c1860c7b-2f91-4da2-9b2c-eacd381565f8 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c1314c21d8547ff890ede1c2ad281c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c804370880454c7aa02cef2c2c3cf144', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:56:42.422379 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-c1860c7b-2f91-4da2-9b2c-eacd381565f8 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] 10.222.0.13 "GET /compute/v2.1/servers/ea631032-dd04-429b-988e-e6362ea42cf7" status: 200 len: 1558 microversion: 2.91 time: 0.302537 Nov 01 18:56:42.433830 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 313/662] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 18:56:42 2022] GET /compute/v2.1/servers/ea631032-dd04-429b-988e-e6362ea42cf7 => generated 1558 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 01 18:56:42.502719 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-02148c42-35fe-4543-800a-348d5b6085e3 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:56:42.503858 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-02148c42-35fe-4543-800a-348d5b6085e3 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] [instance: 614eb691-9a9a-4ca0-933d-686d80cc0ef1] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:56:42.512495 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-02148c42-35fe-4543-800a-348d5b6085e3 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:42.514082 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-02148c42-35fe-4543-800a-348d5b6085e3 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:42.515365 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-02148c42-35fe-4543-800a-348d5b6085e3 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:42.518242 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-02148c42-35fe-4543-800a-348d5b6085e3 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:42.518731 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-02148c42-35fe-4543-800a-348d5b6085e3 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:42.519609 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-02148c42-35fe-4543-800a-348d5b6085e3 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:42.716413 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-09d3d79b-a9b3-470a-afd0-8e8c992add5d tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-1886607845", "imageRef": "2d4a0047-1b9e-445f-8af8-1b5c9d93e881", "flavorRef": "452", "networks": [{"uuid": "b865614d-f372-4a97-a96c-04f1f6457952"}]}} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 18:56:42.830372 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.network.neutron [None req-09d3d79b-a9b3-470a-afd0-8e8c992add5d tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] validate_networks() for [('b865614d-f372-4a97-a96c-04f1f6457952', None, None, None, None, None)] {{(pid=121403) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 01 18:56:42.874710 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-02148c42-35fe-4543-800a-348d5b6085e3 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72117f17294649d6b8bc16c66c7efab2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45d4c047d3c44324a27a27831236ab0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:56:42.887583 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-02148c42-35fe-4543-800a-348d5b6085e3 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] 10.222.0.13 "GET /compute/v2.1/servers/614eb691-9a9a-4ca0-933d-686d80cc0ef1" status: 200 len: 1475 microversion: 2.1 time: 0.389461 Nov 01 18:56:42.888172 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 350/663] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:56:42 2022] GET /compute/v2.1/servers/614eb691-9a9a-4ca0-933d-686d80cc0ef1 => generated 1475 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:56:42.901809 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-5c36785f-365d-47f2-82f0-c41f97bbda5e tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:56:42.904298 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-5c36785f-365d-47f2-82f0-c41f97bbda5e tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] [instance: bee52bae-2df5-46a3-9aa9-f6b24bea11e3] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:56:42.918887 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-5c36785f-365d-47f2-82f0-c41f97bbda5e tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:42.919390 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-5c36785f-365d-47f2-82f0-c41f97bbda5e tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:42.920538 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-5c36785f-365d-47f2-82f0-c41f97bbda5e tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:42.923253 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-5c36785f-365d-47f2-82f0-c41f97bbda5e tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:42.924851 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-5c36785f-365d-47f2-82f0-c41f97bbda5e tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:42.926078 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-5c36785f-365d-47f2-82f0-c41f97bbda5e tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:43.180373 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-5c36785f-365d-47f2-82f0-c41f97bbda5e tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:56:43.190055 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-5c36785f-365d-47f2-82f0-c41f97bbda5e tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:56:43.192138 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-5c36785f-365d-47f2-82f0-c41f97bbda5e tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:56:43.194085 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-5c36785f-365d-47f2-82f0-c41f97bbda5e tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] 10.222.0.13 "GET /compute/v2.1/servers/bee52bae-2df5-46a3-9aa9-f6b24bea11e3" status: 200 len: 1556 microversion: 2.25 time: 0.299652 Nov 01 18:56:43.194793 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 351/664] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 18:56:42 2022] GET /compute/v2.1/servers/bee52bae-2df5-46a3-9aa9-f6b24bea11e3 => generated 1556 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 18:56:43.207189 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-c782a965-5dc3-4bca-be3f-9df23fb0cab2 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:56:43.208064 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-c782a965-5dc3-4bca-be3f-9df23fb0cab2 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] [instance: 58d02dff-26f6-4c2f-b886-cdbdccbfcec9] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:56:43.224705 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-c782a965-5dc3-4bca-be3f-9df23fb0cab2 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:43.225161 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-c782a965-5dc3-4bca-be3f-9df23fb0cab2 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:43.231419 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-c782a965-5dc3-4bca-be3f-9df23fb0cab2 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:43.233715 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-c782a965-5dc3-4bca-be3f-9df23fb0cab2 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:43.238264 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-c782a965-5dc3-4bca-be3f-9df23fb0cab2 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:43.238917 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-c782a965-5dc3-4bca-be3f-9df23fb0cab2 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:43.465545 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-c782a965-5dc3-4bca-be3f-9df23fb0cab2 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f32f5fba1976432d938e664c7714e52b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b9d4c236b944f9b2e8e502a50a8f8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:56:43.477400 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-c782a965-5dc3-4bca-be3f-9df23fb0cab2 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] 10.222.0.13 "GET /compute/v2.1/servers/58d02dff-26f6-4c2f-b886-cdbdccbfcec9" status: 200 len: 1502 microversion: 2.1 time: 0.281284 Nov 01 18:56:43.478804 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 352/665] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:56:43 2022] GET /compute/v2.1/servers/58d02dff-26f6-4c2f-b886-cdbdccbfcec9 => generated 1502 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:56:43.491386 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-79d8a81b-b7ad-43f0-8027-1a6829b5c809 tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:56:43.493297 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-79d8a81b-b7ad-43f0-8027-1a6829b5c809 tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] [instance: 87679611-878a-49b2-bf8f-39e784c6d70b] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:56:43.539049 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-79d8a81b-b7ad-43f0-8027-1a6829b5c809 tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:43.539926 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-79d8a81b-b7ad-43f0-8027-1a6829b5c809 tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:43.541308 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-79d8a81b-b7ad-43f0-8027-1a6829b5c809 tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:43.542215 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-79d8a81b-b7ad-43f0-8027-1a6829b5c809 tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:43.542873 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-79d8a81b-b7ad-43f0-8027-1a6829b5c809 tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:43.543606 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-79d8a81b-b7ad-43f0-8027-1a6829b5c809 tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:43.699671 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-79d8a81b-b7ad-43f0-8027-1a6829b5c809 tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '576abe5db27b461889fef2029d477e40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e9fb3117f68434bae7a463c357818dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:56:43.709743 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-79d8a81b-b7ad-43f0-8027-1a6829b5c809 tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '576abe5db27b461889fef2029d477e40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e9fb3117f68434bae7a463c357818dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:56:43.711195 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-79d8a81b-b7ad-43f0-8027-1a6829b5c809 tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '576abe5db27b461889fef2029d477e40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e9fb3117f68434bae7a463c357818dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:56:43.717662 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.virt.hardware [None req-09d3d79b-a9b3-470a-afd0-8e8c992add5d tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Flavor limits 0:0:0 {{(pid=121403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 01 18:56:43.718681 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.virt.hardware [None req-09d3d79b-a9b3-470a-afd0-8e8c992add5d tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Image limits 0:0:0 {{(pid=121403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 01 18:56:43.719376 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.virt.hardware [None req-09d3d79b-a9b3-470a-afd0-8e8c992add5d tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Flavor pref 0:0:0 {{(pid=121403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 01 18:56:43.720716 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.virt.hardware [None req-09d3d79b-a9b3-470a-afd0-8e8c992add5d tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Image pref 0:0:0 {{(pid=121403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 01 18:56:43.721331 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.virt.hardware [None req-09d3d79b-a9b3-470a-afd0-8e8c992add5d tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 01 18:56:43.734797 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-79d8a81b-b7ad-43f0-8027-1a6829b5c809 tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] 10.222.0.13 "GET /compute/v2.1/servers/87679611-878a-49b2-bf8f-39e784c6d70b" status: 200 len: 1447 microversion: 2.75 time: 0.254675 Nov 01 18:56:43.738371 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-09d3d79b-a9b3-470a-afd0-8e8c992add5d tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:43.738572 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 353/666] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 18:56:43 2022] GET /compute/v2.1/servers/87679611-878a-49b2-bf8f-39e784c6d70b => generated 1447 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 18:56:43.740425 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-09d3d79b-a9b3-470a-afd0-8e8c992add5d tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:43.743389 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-09d3d79b-a9b3-470a-afd0-8e8c992add5d tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:43.744236 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-09d3d79b-a9b3-470a-afd0-8e8c992add5d tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:43.744715 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-09d3d79b-a9b3-470a-afd0-8e8c992add5d tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:43.746389 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-dcf2dd53-f985-4ac5-91fe-ca601df8f247 tempest-LiveAutoBlockMigrationV225Test-1358532044 tempest-LiveAutoBlockMigrationV225Test-1358532044-project-admin] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:56:43.746963 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-09d3d79b-a9b3-470a-afd0-8e8c992add5d tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:43.750240 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-dcf2dd53-f985-4ac5-91fe-ca601df8f247 tempest-LiveAutoBlockMigrationV225Test-1358532044 tempest-LiveAutoBlockMigrationV225Test-1358532044-project-admin] [instance: bee52bae-2df5-46a3-9aa9-f6b24bea11e3] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:56:43.780795 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-dcf2dd53-f985-4ac5-91fe-ca601df8f247 tempest-LiveAutoBlockMigrationV225Test-1358532044 tempest-LiveAutoBlockMigrationV225Test-1358532044-project-admin] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:43.781291 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-dcf2dd53-f985-4ac5-91fe-ca601df8f247 tempest-LiveAutoBlockMigrationV225Test-1358532044 tempest-LiveAutoBlockMigrationV225Test-1358532044-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:43.781722 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-dcf2dd53-f985-4ac5-91fe-ca601df8f247 tempest-LiveAutoBlockMigrationV225Test-1358532044 tempest-LiveAutoBlockMigrationV225Test-1358532044-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:43.782443 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-dcf2dd53-f985-4ac5-91fe-ca601df8f247 tempest-LiveAutoBlockMigrationV225Test-1358532044 tempest-LiveAutoBlockMigrationV225Test-1358532044-project-admin] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:43.787964 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-dcf2dd53-f985-4ac5-91fe-ca601df8f247 tempest-LiveAutoBlockMigrationV225Test-1358532044 tempest-LiveAutoBlockMigrationV225Test-1358532044-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:43.792705 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-dcf2dd53-f985-4ac5-91fe-ca601df8f247 tempest-LiveAutoBlockMigrationV225Test-1358532044 tempest-LiveAutoBlockMigrationV225Test-1358532044-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:43.809496 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.quota [None req-09d3d79b-a9b3-470a-afd0-8e8c992add5d tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Getting quotas for project 708bc0ea4b5a4baf81933725792bedd5. Resources: {'cores', 'ram', 'instances'} {{(pid=121403) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 01 18:56:43.817105 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.quota [None req-09d3d79b-a9b3-470a-afd0-8e8c992add5d tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Getting quotas for user 09b52b7dcbb044f9bfc424e4417c77fa and project 708bc0ea4b5a4baf81933725792bedd5. Resources: {'cores', 'ram', 'instances'} {{(pid=121403) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 01 18:56:43.857560 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-09d3d79b-a9b3-470a-afd0-8e8c992add5d tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Going to run 1 instances... {{(pid=121403) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 01 18:56:43.862703 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-09d3d79b-a9b3-470a-afd0-8e8c992add5d tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] [instance: 97de391d-c836-40ac-b126-0b6684406d52] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2d4a0047-1b9e-445f-8af8-1b5c9d93e881',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121403) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 01 18:56:43.986572 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.objects.instance [None req-dcf2dd53-f985-4ac5-91fe-ca601df8f247 tempest-LiveAutoBlockMigrationV225Test-1358532044 tempest-LiveAutoBlockMigrationV225Test-1358532044-project-admin] Lazy-loading 'services' on Instance uuid bee52bae-2df5-46a3-9aa9-f6b24bea11e3 {{(pid=121402) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 01 18:56:44.005841 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-dcf2dd53-f985-4ac5-91fe-ca601df8f247 tempest-LiveAutoBlockMigrationV225Test-1358532044 tempest-LiveAutoBlockMigrationV225Test-1358532044-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/bee52bae-2df5-46a3-9aa9-f6b24bea11e3" status: 200 len: 2048 microversion: 2.25 time: 0.265070 Nov 01 18:56:44.007130 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 354/667] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 18:56:43 2022] GET /compute/v2.1/servers/bee52bae-2df5-46a3-9aa9-f6b24bea11e3 => generated 2048 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 18:56:44.012783 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-4e060945-2519-40a1-bc26-6cf7703f4366 tempest-ServerAddressesNegativeTestJSON-736278170 tempest-ServerAddressesNegativeTestJSON-736278170-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:56:44.014477 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-4e060945-2519-40a1-bc26-6cf7703f4366 tempest-ServerAddressesNegativeTestJSON-736278170 tempest-ServerAddressesNegativeTestJSON-736278170-project] [instance: 034c1271-a323-4728-985c-3d70df31eeb2] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:56:44.022960 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-4e060945-2519-40a1-bc26-6cf7703f4366 tempest-ServerAddressesNegativeTestJSON-736278170 tempest-ServerAddressesNegativeTestJSON-736278170-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:44.023598 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-4e060945-2519-40a1-bc26-6cf7703f4366 tempest-ServerAddressesNegativeTestJSON-736278170 tempest-ServerAddressesNegativeTestJSON-736278170-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:44.024927 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-4e060945-2519-40a1-bc26-6cf7703f4366 tempest-ServerAddressesNegativeTestJSON-736278170 tempest-ServerAddressesNegativeTestJSON-736278170-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:44.025830 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-4e060945-2519-40a1-bc26-6cf7703f4366 tempest-ServerAddressesNegativeTestJSON-736278170 tempest-ServerAddressesNegativeTestJSON-736278170-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:44.026458 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-4e060945-2519-40a1-bc26-6cf7703f4366 tempest-ServerAddressesNegativeTestJSON-736278170 tempest-ServerAddressesNegativeTestJSON-736278170-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:44.027203 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-4e060945-2519-40a1-bc26-6cf7703f4366 tempest-ServerAddressesNegativeTestJSON-736278170 tempest-ServerAddressesNegativeTestJSON-736278170-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:44.044173 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-09d3d79b-a9b3-470a-afd0-8e8c992add5d tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.451482 Nov 01 18:56:44.049637 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 314/668] 10.222.0.13 () {60 vars in 1147 bytes} [Tue Nov 1 18:56:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 1458 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Nov 01 18:56:44.069374 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-11d24fd0-971a-44f4-9186-b1641060b563 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:56:44.074073 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-11d24fd0-971a-44f4-9186-b1641060b563 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] [instance: ea631032-dd04-429b-988e-e6362ea42cf7] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:56:44.104497 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-11d24fd0-971a-44f4-9186-b1641060b563 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:44.108412 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-11d24fd0-971a-44f4-9186-b1641060b563 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:44.109561 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-11d24fd0-971a-44f4-9186-b1641060b563 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:44.112743 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-11d24fd0-971a-44f4-9186-b1641060b563 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:44.116456 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-11d24fd0-971a-44f4-9186-b1641060b563 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:44.117164 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-11d24fd0-971a-44f4-9186-b1641060b563 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:44.193858 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-4e060945-2519-40a1-bc26-6cf7703f4366 tempest-ServerAddressesNegativeTestJSON-736278170 tempest-ServerAddressesNegativeTestJSON-736278170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5a7d955d1004147b12eb569a7e7355a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d85b21bccf4bc78d4cbffd4f80357f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:56:44.209990 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-4e060945-2519-40a1-bc26-6cf7703f4366 tempest-ServerAddressesNegativeTestJSON-736278170 tempest-ServerAddressesNegativeTestJSON-736278170-project] 10.222.0.13 "GET /compute/v2.1/servers/034c1271-a323-4728-985c-3d70df31eeb2" status: 200 len: 1277 microversion: 2.1 time: 0.201564 Nov 01 18:56:44.211098 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 355/669] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:56:44 2022] GET /compute/v2.1/servers/034c1271-a323-4728-985c-3d70df31eeb2 => generated 1277 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:56:44.217844 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-b3bb2bbd-3f46-4566-ba27-5fd90e1cd0be tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:56:44.218749 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-b3bb2bbd-3f46-4566-ba27-5fd90e1cd0be tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] [instance: 614eb691-9a9a-4ca0-933d-686d80cc0ef1] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:56:44.229822 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b3bb2bbd-3f46-4566-ba27-5fd90e1cd0be tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:44.231885 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b3bb2bbd-3f46-4566-ba27-5fd90e1cd0be tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:44.234219 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b3bb2bbd-3f46-4566-ba27-5fd90e1cd0be tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:44.235363 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b3bb2bbd-3f46-4566-ba27-5fd90e1cd0be tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:44.238449 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b3bb2bbd-3f46-4566-ba27-5fd90e1cd0be tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:44.240398 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b3bb2bbd-3f46-4566-ba27-5fd90e1cd0be tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:44.251157 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-11d24fd0-971a-44f4-9186-b1641060b563 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c1314c21d8547ff890ede1c2ad281c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c804370880454c7aa02cef2c2c3cf144', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:56:44.263106 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-11d24fd0-971a-44f4-9186-b1641060b563 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c1314c21d8547ff890ede1c2ad281c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c804370880454c7aa02cef2c2c3cf144', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:56:44.268974 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-11d24fd0-971a-44f4-9186-b1641060b563 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c1314c21d8547ff890ede1c2ad281c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c804370880454c7aa02cef2c2c3cf144', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:56:44.284375 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-11d24fd0-971a-44f4-9186-b1641060b563 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] 10.222.0.13 "GET /compute/v2.1/servers/ea631032-dd04-429b-988e-e6362ea42cf7" status: 200 len: 1553 microversion: 2.91 time: 0.230530 Nov 01 18:56:44.287327 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 315/670] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 18:56:44 2022] GET /compute/v2.1/servers/ea631032-dd04-429b-988e-e6362ea42cf7 => generated 1553 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 18:56:44.295738 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-af2672a2-51a9-42ba-aa0b-76de335fcf33 tempest-LiveAutoBlockMigrationV225Test-1358532044 tempest-LiveAutoBlockMigrationV225Test-1358532044-project-admin] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:56:44.298498 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-af2672a2-51a9-42ba-aa0b-76de335fcf33 tempest-LiveAutoBlockMigrationV225Test-1358532044 tempest-LiveAutoBlockMigrationV225Test-1358532044-project-admin] [instance: bee52bae-2df5-46a3-9aa9-f6b24bea11e3] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:56:44.333770 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-af2672a2-51a9-42ba-aa0b-76de335fcf33 tempest-LiveAutoBlockMigrationV225Test-1358532044 tempest-LiveAutoBlockMigrationV225Test-1358532044-project-admin] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:44.336450 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-af2672a2-51a9-42ba-aa0b-76de335fcf33 tempest-LiveAutoBlockMigrationV225Test-1358532044 tempest-LiveAutoBlockMigrationV225Test-1358532044-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:44.339220 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-af2672a2-51a9-42ba-aa0b-76de335fcf33 tempest-LiveAutoBlockMigrationV225Test-1358532044 tempest-LiveAutoBlockMigrationV225Test-1358532044-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:44.341458 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-af2672a2-51a9-42ba-aa0b-76de335fcf33 tempest-LiveAutoBlockMigrationV225Test-1358532044 tempest-LiveAutoBlockMigrationV225Test-1358532044-project-admin] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:44.344428 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-af2672a2-51a9-42ba-aa0b-76de335fcf33 tempest-LiveAutoBlockMigrationV225Test-1358532044 tempest-LiveAutoBlockMigrationV225Test-1358532044-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:44.347096 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-af2672a2-51a9-42ba-aa0b-76de335fcf33 tempest-LiveAutoBlockMigrationV225Test-1358532044 tempest-LiveAutoBlockMigrationV225Test-1358532044-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:44.606755 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-b3bb2bbd-3f46-4566-ba27-5fd90e1cd0be tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72117f17294649d6b8bc16c66c7efab2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45d4c047d3c44324a27a27831236ab0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:56:44.615282 n-d-863052-2 devstack@n-api.service[121402]: DEBUG dbcounter [-] [121402] Writing DB stats nova_cell1:SELECT=100 {{(pid=121402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 18:56:44.622118 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-b3bb2bbd-3f46-4566-ba27-5fd90e1cd0be tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] 10.222.0.13 "GET /compute/v2.1/servers/614eb691-9a9a-4ca0-933d-686d80cc0ef1" status: 200 len: 1475 microversion: 2.1 time: 0.409636 Nov 01 18:56:44.643563 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 356/671] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:56:44 2022] GET /compute/v2.1/servers/614eb691-9a9a-4ca0-933d-686d80cc0ef1 => generated 1475 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:56:44.654010 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-4a9f6543-2c57-43f8-b2e3-80535c348bf2 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:56:44.655750 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-4a9f6543-2c57-43f8-b2e3-80535c348bf2 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] [instance: 97de391d-c836-40ac-b126-0b6684406d52] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:56:44.751537 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-4a9f6543-2c57-43f8-b2e3-80535c348bf2 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b52b7dcbb044f9bfc424e4417c77fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '708bc0ea4b5a4baf81933725792bedd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:56:44.760407 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-4a9f6543-2c57-43f8-b2e3-80535c348bf2 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] 10.222.0.13 "GET /compute/v2.1/servers/97de391d-c836-40ac-b126-0b6684406d52" status: 200 len: 1225 microversion: 2.1 time: 0.115498 Nov 01 18:56:44.761080 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 357/672] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:56:44 2022] GET /compute/v2.1/servers/97de391d-c836-40ac-b126-0b6684406d52 => generated 1225 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:56:44.778041 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-37e45f21-c2d6-478e-948d-c10e9139e169 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:56:44.778441 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-37e45f21-c2d6-478e-948d-c10e9139e169 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] [instance: 58d02dff-26f6-4c2f-b886-cdbdccbfcec9] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:56:44.790537 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-37e45f21-c2d6-478e-948d-c10e9139e169 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:44.791027 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-37e45f21-c2d6-478e-948d-c10e9139e169 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:44.791460 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-37e45f21-c2d6-478e-948d-c10e9139e169 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:44.792159 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-37e45f21-c2d6-478e-948d-c10e9139e169 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:44.795621 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-37e45f21-c2d6-478e-948d-c10e9139e169 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:44.802465 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-37e45f21-c2d6-478e-948d-c10e9139e169 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:45.076923 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.objects.instance [None req-af2672a2-51a9-42ba-aa0b-76de335fcf33 tempest-LiveAutoBlockMigrationV225Test-1358532044 tempest-LiveAutoBlockMigrationV225Test-1358532044-project-admin] Lazy-loading 'services' on Instance uuid bee52bae-2df5-46a3-9aa9-f6b24bea11e3 {{(pid=121403) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 01 18:56:45.081306 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-37e45f21-c2d6-478e-948d-c10e9139e169 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f32f5fba1976432d938e664c7714e52b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b9d4c236b944f9b2e8e502a50a8f8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:56:45.099994 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-37e45f21-c2d6-478e-948d-c10e9139e169 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] 10.222.0.13 "GET /compute/v2.1/servers/58d02dff-26f6-4c2f-b886-cdbdccbfcec9" status: 200 len: 1502 microversion: 2.1 time: 0.330834 Nov 01 18:56:45.123187 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 358/673] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:56:44 2022] GET /compute/v2.1/servers/58d02dff-26f6-4c2f-b886-cdbdccbfcec9 => generated 1502 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:56:45.144127 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-6d705765-9836-4a54-a025-53061cc41355 tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:56:45.149612 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-6d705765-9836-4a54-a025-53061cc41355 tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] [instance: 87679611-878a-49b2-bf8f-39e784c6d70b] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:56:45.164336 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-af2672a2-51a9-42ba-aa0b-76de335fcf33 tempest-LiveAutoBlockMigrationV225Test-1358532044 tempest-LiveAutoBlockMigrationV225Test-1358532044-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/bee52bae-2df5-46a3-9aa9-f6b24bea11e3" status: 200 len: 2048 microversion: 2.25 time: 0.875199 Nov 01 18:56:45.166476 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 316/674] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 18:56:44 2022] GET /compute/v2.1/servers/bee52bae-2df5-46a3-9aa9-f6b24bea11e3 => generated 2048 bytes in 878 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 18:56:45.168134 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-6d705765-9836-4a54-a025-53061cc41355 tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:45.172695 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-6d705765-9836-4a54-a025-53061cc41355 tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:45.173393 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-6d705765-9836-4a54-a025-53061cc41355 tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:45.174351 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-6d705765-9836-4a54-a025-53061cc41355 tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:45.175976 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-6d705765-9836-4a54-a025-53061cc41355 tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:45.178889 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-6d705765-9836-4a54-a025-53061cc41355 tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:45.204553 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-9f267c4b-3b49-4623-ae0b-e2b789c2deaa tempest-LiveAutoBlockMigrationV225Test-1358532044 tempest-LiveAutoBlockMigrationV225Test-1358532044-project-admin] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:56:45.212826 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-9f267c4b-3b49-4623-ae0b-e2b789c2deaa tempest-LiveAutoBlockMigrationV225Test-1358532044 tempest-LiveAutoBlockMigrationV225Test-1358532044-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:45.215138 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-9f267c4b-3b49-4623-ae0b-e2b789c2deaa tempest-LiveAutoBlockMigrationV225Test-1358532044 tempest-LiveAutoBlockMigrationV225Test-1358532044-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:45.215865 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-9f267c4b-3b49-4623-ae0b-e2b789c2deaa tempest-LiveAutoBlockMigrationV225Test-1358532044 tempest-LiveAutoBlockMigrationV225Test-1358532044-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:45.218802 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-9f267c4b-3b49-4623-ae0b-e2b789c2deaa tempest-LiveAutoBlockMigrationV225Test-1358532044 tempest-LiveAutoBlockMigrationV225Test-1358532044-project-admin] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:45.219456 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-9f267c4b-3b49-4623-ae0b-e2b789c2deaa tempest-LiveAutoBlockMigrationV225Test-1358532044 tempest-LiveAutoBlockMigrationV225Test-1358532044-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:45.220040 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-9f267c4b-3b49-4623-ae0b-e2b789c2deaa tempest-LiveAutoBlockMigrationV225Test-1358532044 tempest-LiveAutoBlockMigrationV225Test-1358532044-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:45.300233 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-9f267c4b-3b49-4623-ae0b-e2b789c2deaa tempest-LiveAutoBlockMigrationV225Test-1358532044 tempest-LiveAutoBlockMigrationV225Test-1358532044-project-admin] 10.222.0.13 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.100715 Nov 01 18:56:45.316603 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 317/675] 10.222.0.13 () {60 vars in 1217 bytes} [Tue Nov 1 18:56:45 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 01 18:56:45.333165 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-eda86ec5-676e-4a41-92b8-a8e6aafdb75b tempest-ServerAddressesNegativeTestJSON-736278170 tempest-ServerAddressesNegativeTestJSON-736278170-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:56:45.336486 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-eda86ec5-676e-4a41-92b8-a8e6aafdb75b tempest-ServerAddressesNegativeTestJSON-736278170 tempest-ServerAddressesNegativeTestJSON-736278170-project] [instance: 034c1271-a323-4728-985c-3d70df31eeb2] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:56:45.379124 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-eda86ec5-676e-4a41-92b8-a8e6aafdb75b tempest-ServerAddressesNegativeTestJSON-736278170 tempest-ServerAddressesNegativeTestJSON-736278170-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:45.380411 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-eda86ec5-676e-4a41-92b8-a8e6aafdb75b tempest-ServerAddressesNegativeTestJSON-736278170 tempest-ServerAddressesNegativeTestJSON-736278170-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:45.381538 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-eda86ec5-676e-4a41-92b8-a8e6aafdb75b tempest-ServerAddressesNegativeTestJSON-736278170 tempest-ServerAddressesNegativeTestJSON-736278170-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:45.382389 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-eda86ec5-676e-4a41-92b8-a8e6aafdb75b tempest-ServerAddressesNegativeTestJSON-736278170 tempest-ServerAddressesNegativeTestJSON-736278170-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:45.383427 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-eda86ec5-676e-4a41-92b8-a8e6aafdb75b tempest-ServerAddressesNegativeTestJSON-736278170 tempest-ServerAddressesNegativeTestJSON-736278170-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:45.383976 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-eda86ec5-676e-4a41-92b8-a8e6aafdb75b tempest-ServerAddressesNegativeTestJSON-736278170 tempest-ServerAddressesNegativeTestJSON-736278170-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:45.395415 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-6d705765-9836-4a54-a025-53061cc41355 tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '576abe5db27b461889fef2029d477e40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e9fb3117f68434bae7a463c357818dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:56:45.406158 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-6d705765-9836-4a54-a025-53061cc41355 tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '576abe5db27b461889fef2029d477e40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e9fb3117f68434bae7a463c357818dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:56:45.408145 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-6d705765-9836-4a54-a025-53061cc41355 tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '576abe5db27b461889fef2029d477e40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e9fb3117f68434bae7a463c357818dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:56:45.414893 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-6d705765-9836-4a54-a025-53061cc41355 tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] 10.222.0.13 "GET /compute/v2.1/servers/87679611-878a-49b2-bf8f-39e784c6d70b" status: 200 len: 1447 microversion: 2.75 time: 0.287609 Nov 01 18:56:45.415816 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 359/676] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 18:56:45 2022] GET /compute/v2.1/servers/87679611-878a-49b2-bf8f-39e784c6d70b => generated 1447 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 18:56:45.468182 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-503d907b-436f-4aea-b8b4-71e21eb3e0db tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:56:45.469041 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-503d907b-436f-4aea-b8b4-71e21eb3e0db tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] [instance: ea631032-dd04-429b-988e-e6362ea42cf7] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:56:45.487872 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-503d907b-436f-4aea-b8b4-71e21eb3e0db tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:45.488388 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-503d907b-436f-4aea-b8b4-71e21eb3e0db tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:45.495539 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-503d907b-436f-4aea-b8b4-71e21eb3e0db tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:45.496356 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-503d907b-436f-4aea-b8b4-71e21eb3e0db tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:45.496866 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-503d907b-436f-4aea-b8b4-71e21eb3e0db tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:45.497302 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-503d907b-436f-4aea-b8b4-71e21eb3e0db tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:45.596947 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-eda86ec5-676e-4a41-92b8-a8e6aafdb75b tempest-ServerAddressesNegativeTestJSON-736278170 tempest-ServerAddressesNegativeTestJSON-736278170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5a7d955d1004147b12eb569a7e7355a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d85b21bccf4bc78d4cbffd4f80357f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:56:45.610032 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-eda86ec5-676e-4a41-92b8-a8e6aafdb75b tempest-ServerAddressesNegativeTestJSON-736278170 tempest-ServerAddressesNegativeTestJSON-736278170-project] 10.222.0.13 "GET /compute/v2.1/servers/034c1271-a323-4728-985c-3d70df31eeb2" status: 200 len: 1283 microversion: 2.1 time: 0.285441 Nov 01 18:56:45.611446 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 318/677] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:56:45 2022] GET /compute/v2.1/servers/034c1271-a323-4728-985c-3d70df31eeb2 => generated 1283 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:56:45.631804 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-d74b06ae-4712-41e6-9851-6c650c7cce43 tempest-LiveAutoBlockMigrationV225Test-1358532044 tempest-LiveAutoBlockMigrationV225Test-1358532044-project-admin] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 18:56:45.639134 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-d74b06ae-4712-41e6-9851-6c650c7cce43 tempest-LiveAutoBlockMigrationV225Test-1358532044 tempest-LiveAutoBlockMigrationV225Test-1358532044-project-admin] [instance: bee52bae-2df5-46a3-9aa9-f6b24bea11e3] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:56:45.651961 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d74b06ae-4712-41e6-9851-6c650c7cce43 tempest-LiveAutoBlockMigrationV225Test-1358532044 tempest-LiveAutoBlockMigrationV225Test-1358532044-project-admin] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:45.654062 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d74b06ae-4712-41e6-9851-6c650c7cce43 tempest-LiveAutoBlockMigrationV225Test-1358532044 tempest-LiveAutoBlockMigrationV225Test-1358532044-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:45.654984 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d74b06ae-4712-41e6-9851-6c650c7cce43 tempest-LiveAutoBlockMigrationV225Test-1358532044 tempest-LiveAutoBlockMigrationV225Test-1358532044-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:45.659400 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d74b06ae-4712-41e6-9851-6c650c7cce43 tempest-LiveAutoBlockMigrationV225Test-1358532044 tempest-LiveAutoBlockMigrationV225Test-1358532044-project-admin] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:45.660676 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d74b06ae-4712-41e6-9851-6c650c7cce43 tempest-LiveAutoBlockMigrationV225Test-1358532044 tempest-LiveAutoBlockMigrationV225Test-1358532044-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:45.683745 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-503d907b-436f-4aea-b8b4-71e21eb3e0db tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c1314c21d8547ff890ede1c2ad281c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c804370880454c7aa02cef2c2c3cf144', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:56:45.687035 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d74b06ae-4712-41e6-9851-6c650c7cce43 tempest-LiveAutoBlockMigrationV225Test-1358532044 tempest-LiveAutoBlockMigrationV225Test-1358532044-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:45.691527 n-d-863052-2 devstack@n-api.service[121403]: DEBUG dbcounter [-] [121403] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 18:56:45.718639 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-503d907b-436f-4aea-b8b4-71e21eb3e0db tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c1314c21d8547ff890ede1c2ad281c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c804370880454c7aa02cef2c2c3cf144', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:56:45.720127 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-503d907b-436f-4aea-b8b4-71e21eb3e0db tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c1314c21d8547ff890ede1c2ad281c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c804370880454c7aa02cef2c2c3cf144', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:56:45.743136 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-503d907b-436f-4aea-b8b4-71e21eb3e0db tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] 10.222.0.13 "GET /compute/v2.1/servers/ea631032-dd04-429b-988e-e6362ea42cf7" status: 200 len: 1553 microversion: 2.91 time: 0.325895 Nov 01 18:56:45.743898 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 360/678] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 18:56:45 2022] GET /compute/v2.1/servers/ea631032-dd04-429b-988e-e6362ea42cf7 => generated 1553 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 18:56:45.758607 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-d0787c27-71c5-414b-8da6-36728aa861b8 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:56:45.759948 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-d0787c27-71c5-414b-8da6-36728aa861b8 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] [instance: 614eb691-9a9a-4ca0-933d-686d80cc0ef1] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:56:45.768178 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-d0787c27-71c5-414b-8da6-36728aa861b8 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:45.769286 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-d0787c27-71c5-414b-8da6-36728aa861b8 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:45.769880 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-d0787c27-71c5-414b-8da6-36728aa861b8 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:45.774023 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-d0787c27-71c5-414b-8da6-36728aa861b8 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:45.774754 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-d0787c27-71c5-414b-8da6-36728aa861b8 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:45.775556 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-d0787c27-71c5-414b-8da6-36728aa861b8 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:45.889912 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-d74b06ae-4712-41e6-9851-6c650c7cce43 tempest-LiveAutoBlockMigrationV225Test-1358532044 tempest-LiveAutoBlockMigrationV225Test-1358532044-project-admin] 10.222.0.13 "POST /compute/v2.1/servers/bee52bae-2df5-46a3-9aa9-f6b24bea11e3/action" status: 202 len: 0 microversion: 2.25 time: 0.273952 Nov 01 18:56:45.903671 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 319/679] 10.222.0.13 () {62 vars in 1319 bytes} [Tue Nov 1 18:56:45 2022] POST /compute/v2.1/servers/bee52bae-2df5-46a3-9aa9-f6b24bea11e3/action => generated 0 bytes in 291 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 01 18:56:45.923001 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-b7efde82-279a-4bc0-a352-eca9893ab3e1 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:56:45.924938 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-b7efde82-279a-4bc0-a352-eca9893ab3e1 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] [instance: 97de391d-c836-40ac-b126-0b6684406d52] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:56:45.938923 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-b7efde82-279a-4bc0-a352-eca9893ab3e1 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:45.939805 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-b7efde82-279a-4bc0-a352-eca9893ab3e1 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:45.940519 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-b7efde82-279a-4bc0-a352-eca9893ab3e1 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:45.941520 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-b7efde82-279a-4bc0-a352-eca9893ab3e1 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:45.942296 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-b7efde82-279a-4bc0-a352-eca9893ab3e1 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:45.942946 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-b7efde82-279a-4bc0-a352-eca9893ab3e1 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:46.130484 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-b7efde82-279a-4bc0-a352-eca9893ab3e1 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b52b7dcbb044f9bfc424e4417c77fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '708bc0ea4b5a4baf81933725792bedd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:56:46.145015 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-b7efde82-279a-4bc0-a352-eca9893ab3e1 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] 10.222.0.13 "GET /compute/v2.1/servers/97de391d-c836-40ac-b126-0b6684406d52" status: 200 len: 1277 microversion: 2.1 time: 0.234170 Nov 01 18:56:46.149612 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 320/680] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:56:45 2022] GET /compute/v2.1/servers/97de391d-c836-40ac-b126-0b6684406d52 => generated 1277 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:56:46.156546 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-638639ec-0906-4493-8500-b271b9f9eda1 tempest-LiveAutoBlockMigrationV225Test-1358532044 tempest-LiveAutoBlockMigrationV225Test-1358532044-project-admin] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:56:46.159427 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-638639ec-0906-4493-8500-b271b9f9eda1 tempest-LiveAutoBlockMigrationV225Test-1358532044 tempest-LiveAutoBlockMigrationV225Test-1358532044-project-admin] [instance: bee52bae-2df5-46a3-9aa9-f6b24bea11e3] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:56:46.181236 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-638639ec-0906-4493-8500-b271b9f9eda1 tempest-LiveAutoBlockMigrationV225Test-1358532044 tempest-LiveAutoBlockMigrationV225Test-1358532044-project-admin] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:46.181872 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-638639ec-0906-4493-8500-b271b9f9eda1 tempest-LiveAutoBlockMigrationV225Test-1358532044 tempest-LiveAutoBlockMigrationV225Test-1358532044-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:46.184130 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-638639ec-0906-4493-8500-b271b9f9eda1 tempest-LiveAutoBlockMigrationV225Test-1358532044 tempest-LiveAutoBlockMigrationV225Test-1358532044-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:46.188272 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-638639ec-0906-4493-8500-b271b9f9eda1 tempest-LiveAutoBlockMigrationV225Test-1358532044 tempest-LiveAutoBlockMigrationV225Test-1358532044-project-admin] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:46.189242 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-638639ec-0906-4493-8500-b271b9f9eda1 tempest-LiveAutoBlockMigrationV225Test-1358532044 tempest-LiveAutoBlockMigrationV225Test-1358532044-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:46.189796 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-638639ec-0906-4493-8500-b271b9f9eda1 tempest-LiveAutoBlockMigrationV225Test-1358532044 tempest-LiveAutoBlockMigrationV225Test-1358532044-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:46.229523 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-d0787c27-71c5-414b-8da6-36728aa861b8 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72117f17294649d6b8bc16c66c7efab2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45d4c047d3c44324a27a27831236ab0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:56:46.237564 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-d0787c27-71c5-414b-8da6-36728aa861b8 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] 10.222.0.13 "GET /compute/v2.1/servers/614eb691-9a9a-4ca0-933d-686d80cc0ef1" status: 200 len: 1475 microversion: 2.1 time: 0.492500 Nov 01 18:56:46.240071 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 361/681] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:56:45 2022] GET /compute/v2.1/servers/614eb691-9a9a-4ca0-933d-686d80cc0ef1 => generated 1475 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:56:46.257207 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-ae7ed081-e540-42e8-8622-08530943a2cc tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:56:46.257811 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-ae7ed081-e540-42e8-8622-08530943a2cc tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] [instance: 58d02dff-26f6-4c2f-b886-cdbdccbfcec9] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:56:46.265474 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-ae7ed081-e540-42e8-8622-08530943a2cc tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:46.266452 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-ae7ed081-e540-42e8-8622-08530943a2cc tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:46.267047 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-ae7ed081-e540-42e8-8622-08530943a2cc tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:46.267937 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-ae7ed081-e540-42e8-8622-08530943a2cc tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:46.268551 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-ae7ed081-e540-42e8-8622-08530943a2cc tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:46.269143 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-ae7ed081-e540-42e8-8622-08530943a2cc tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:46.518511 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.objects.instance [None req-638639ec-0906-4493-8500-b271b9f9eda1 tempest-LiveAutoBlockMigrationV225Test-1358532044 tempest-LiveAutoBlockMigrationV225Test-1358532044-project-admin] Lazy-loading 'services' on Instance uuid bee52bae-2df5-46a3-9aa9-f6b24bea11e3 {{(pid=121403) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 01 18:56:46.568191 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-638639ec-0906-4493-8500-b271b9f9eda1 tempest-LiveAutoBlockMigrationV225Test-1358532044 tempest-LiveAutoBlockMigrationV225Test-1358532044-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/bee52bae-2df5-46a3-9aa9-f6b24bea11e3" status: 200 len: 2053 microversion: 2.25 time: 0.415250 Nov 01 18:56:46.593012 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 321/682] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 18:56:46 2022] GET /compute/v2.1/servers/bee52bae-2df5-46a3-9aa9-f6b24bea11e3 => generated 2053 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 18:56:46.612125 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-d7e99a22-3824-4b09-bfd8-640e58204d6d tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:56:46.612779 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-d7e99a22-3824-4b09-bfd8-640e58204d6d tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] [instance: 87679611-878a-49b2-bf8f-39e784c6d70b] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:56:46.613688 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-ae7ed081-e540-42e8-8622-08530943a2cc tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f32f5fba1976432d938e664c7714e52b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b9d4c236b944f9b2e8e502a50a8f8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:56:46.624121 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-ae7ed081-e540-42e8-8622-08530943a2cc tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] 10.222.0.13 "GET /compute/v2.1/servers/58d02dff-26f6-4c2f-b886-cdbdccbfcec9" status: 200 len: 1502 microversion: 2.1 time: 0.382902 Nov 01 18:56:46.639189 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d7e99a22-3824-4b09-bfd8-640e58204d6d tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:46.645180 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d7e99a22-3824-4b09-bfd8-640e58204d6d tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:46.652377 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 362/683] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:56:46 2022] GET /compute/v2.1/servers/58d02dff-26f6-4c2f-b886-cdbdccbfcec9 => generated 1502 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:56:46.657174 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d7e99a22-3824-4b09-bfd8-640e58204d6d tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:46.657935 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d7e99a22-3824-4b09-bfd8-640e58204d6d tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:46.658436 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d7e99a22-3824-4b09-bfd8-640e58204d6d tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:46.658854 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d7e99a22-3824-4b09-bfd8-640e58204d6d tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:46.669407 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-df8296fc-fe86-4287-91e2-707e6b23551d tempest-ServerAddressesNegativeTestJSON-736278170 tempest-ServerAddressesNegativeTestJSON-736278170-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:56:46.670863 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-df8296fc-fe86-4287-91e2-707e6b23551d tempest-ServerAddressesNegativeTestJSON-736278170 tempest-ServerAddressesNegativeTestJSON-736278170-project] [instance: 034c1271-a323-4728-985c-3d70df31eeb2] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:56:46.685592 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-df8296fc-fe86-4287-91e2-707e6b23551d tempest-ServerAddressesNegativeTestJSON-736278170 tempest-ServerAddressesNegativeTestJSON-736278170-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:46.686484 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-df8296fc-fe86-4287-91e2-707e6b23551d tempest-ServerAddressesNegativeTestJSON-736278170 tempest-ServerAddressesNegativeTestJSON-736278170-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:46.687650 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-df8296fc-fe86-4287-91e2-707e6b23551d tempest-ServerAddressesNegativeTestJSON-736278170 tempest-ServerAddressesNegativeTestJSON-736278170-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:46.689197 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-df8296fc-fe86-4287-91e2-707e6b23551d tempest-ServerAddressesNegativeTestJSON-736278170 tempest-ServerAddressesNegativeTestJSON-736278170-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:46.689854 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-df8296fc-fe86-4287-91e2-707e6b23551d tempest-ServerAddressesNegativeTestJSON-736278170 tempest-ServerAddressesNegativeTestJSON-736278170-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:46.690509 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-df8296fc-fe86-4287-91e2-707e6b23551d tempest-ServerAddressesNegativeTestJSON-736278170 tempest-ServerAddressesNegativeTestJSON-736278170-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:47.133136 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-df8296fc-fe86-4287-91e2-707e6b23551d tempest-ServerAddressesNegativeTestJSON-736278170 tempest-ServerAddressesNegativeTestJSON-736278170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5a7d955d1004147b12eb569a7e7355a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d85b21bccf4bc78d4cbffd4f80357f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:56:47.143254 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-df8296fc-fe86-4287-91e2-707e6b23551d tempest-ServerAddressesNegativeTestJSON-736278170 tempest-ServerAddressesNegativeTestJSON-736278170-project] 10.222.0.13 "GET /compute/v2.1/servers/034c1271-a323-4728-985c-3d70df31eeb2" status: 200 len: 1325 microversion: 2.1 time: 0.489384 Nov 01 18:56:47.147137 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 363/684] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:56:46 2022] GET /compute/v2.1/servers/034c1271-a323-4728-985c-3d70df31eeb2 => generated 1325 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:56:47.157494 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-9ace4512-1540-4529-ab1e-282be4d2e898 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:56:47.157891 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-9ace4512-1540-4529-ab1e-282be4d2e898 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] [instance: ea631032-dd04-429b-988e-e6362ea42cf7] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:56:47.175993 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-9ace4512-1540-4529-ab1e-282be4d2e898 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:47.177163 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-9ace4512-1540-4529-ab1e-282be4d2e898 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:47.179252 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-9ace4512-1540-4529-ab1e-282be4d2e898 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:47.180134 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-9ace4512-1540-4529-ab1e-282be4d2e898 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:47.180612 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-9ace4512-1540-4529-ab1e-282be4d2e898 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:47.181051 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-9ace4512-1540-4529-ab1e-282be4d2e898 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:47.316421 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-9ace4512-1540-4529-ab1e-282be4d2e898 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c1314c21d8547ff890ede1c2ad281c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c804370880454c7aa02cef2c2c3cf144', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:56:47.331871 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-9ace4512-1540-4529-ab1e-282be4d2e898 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c1314c21d8547ff890ede1c2ad281c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c804370880454c7aa02cef2c2c3cf144', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:56:47.334387 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-9ace4512-1540-4529-ab1e-282be4d2e898 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c1314c21d8547ff890ede1c2ad281c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c804370880454c7aa02cef2c2c3cf144', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:56:47.345267 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-9ace4512-1540-4529-ab1e-282be4d2e898 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] 10.222.0.13 "GET /compute/v2.1/servers/ea631032-dd04-429b-988e-e6362ea42cf7" status: 200 len: 1553 microversion: 2.91 time: 0.196611 Nov 01 18:56:47.350522 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 364/685] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 18:56:47 2022] GET /compute/v2.1/servers/ea631032-dd04-429b-988e-e6362ea42cf7 => generated 1553 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 18:56:47.356996 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-112a8585-1f83-4ba7-b9e1-c2b3dc1e98f2 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:56:47.357539 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-112a8585-1f83-4ba7-b9e1-c2b3dc1e98f2 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] [instance: 97de391d-c836-40ac-b126-0b6684406d52] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:56:47.374073 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-112a8585-1f83-4ba7-b9e1-c2b3dc1e98f2 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:47.374565 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-112a8585-1f83-4ba7-b9e1-c2b3dc1e98f2 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:47.375003 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-112a8585-1f83-4ba7-b9e1-c2b3dc1e98f2 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:47.375713 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-112a8585-1f83-4ba7-b9e1-c2b3dc1e98f2 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:47.376166 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-112a8585-1f83-4ba7-b9e1-c2b3dc1e98f2 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:47.376634 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-112a8585-1f83-4ba7-b9e1-c2b3dc1e98f2 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:47.400615 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-d7e99a22-3824-4b09-bfd8-640e58204d6d tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '576abe5db27b461889fef2029d477e40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e9fb3117f68434bae7a463c357818dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:56:47.410732 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-d7e99a22-3824-4b09-bfd8-640e58204d6d tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '576abe5db27b461889fef2029d477e40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e9fb3117f68434bae7a463c357818dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:56:47.416005 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-d7e99a22-3824-4b09-bfd8-640e58204d6d tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '576abe5db27b461889fef2029d477e40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e9fb3117f68434bae7a463c357818dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:56:47.437024 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-d7e99a22-3824-4b09-bfd8-640e58204d6d tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] 10.222.0.13 "GET /compute/v2.1/servers/87679611-878a-49b2-bf8f-39e784c6d70b" status: 200 len: 1447 microversion: 2.75 time: 0.842739 Nov 01 18:56:47.438009 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 322/686] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 18:56:46 2022] GET /compute/v2.1/servers/87679611-878a-49b2-bf8f-39e784c6d70b => generated 1447 bytes in 844 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 18:56:47.455137 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-26268ac8-9464-417d-8d0e-7202650530cb tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:56:47.476086 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-26268ac8-9464-417d-8d0e-7202650530cb tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] [instance: 614eb691-9a9a-4ca0-933d-686d80cc0ef1] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:56:47.497982 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-26268ac8-9464-417d-8d0e-7202650530cb tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:47.499595 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-26268ac8-9464-417d-8d0e-7202650530cb tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:47.500955 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-26268ac8-9464-417d-8d0e-7202650530cb tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:47.502009 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-26268ac8-9464-417d-8d0e-7202650530cb tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:47.502684 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-26268ac8-9464-417d-8d0e-7202650530cb tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:47.503756 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-26268ac8-9464-417d-8d0e-7202650530cb tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:47.758806 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-112a8585-1f83-4ba7-b9e1-c2b3dc1e98f2 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b52b7dcbb044f9bfc424e4417c77fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '708bc0ea4b5a4baf81933725792bedd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:56:47.773489 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-112a8585-1f83-4ba7-b9e1-c2b3dc1e98f2 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] 10.222.0.13 "GET /compute/v2.1/servers/97de391d-c836-40ac-b126-0b6684406d52" status: 200 len: 1283 microversion: 2.1 time: 0.422013 Nov 01 18:56:47.796628 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 365/687] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:56:47 2022] GET /compute/v2.1/servers/97de391d-c836-40ac-b126-0b6684406d52 => generated 1283 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:56:47.824486 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-b3ca7405-cd3d-4c34-912d-2fbbd30aa7b1 tempest-LiveAutoBlockMigrationV225Test-1358532044 tempest-LiveAutoBlockMigrationV225Test-1358532044-project-admin] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:56:47.825576 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-b3ca7405-cd3d-4c34-912d-2fbbd30aa7b1 tempest-LiveAutoBlockMigrationV225Test-1358532044 tempest-LiveAutoBlockMigrationV225Test-1358532044-project-admin] [instance: bee52bae-2df5-46a3-9aa9-f6b24bea11e3] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:56:47.865662 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b3ca7405-cd3d-4c34-912d-2fbbd30aa7b1 tempest-LiveAutoBlockMigrationV225Test-1358532044 tempest-LiveAutoBlockMigrationV225Test-1358532044-project-admin] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:47.866593 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b3ca7405-cd3d-4c34-912d-2fbbd30aa7b1 tempest-LiveAutoBlockMigrationV225Test-1358532044 tempest-LiveAutoBlockMigrationV225Test-1358532044-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:47.867212 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b3ca7405-cd3d-4c34-912d-2fbbd30aa7b1 tempest-LiveAutoBlockMigrationV225Test-1358532044 tempest-LiveAutoBlockMigrationV225Test-1358532044-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:47.869404 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b3ca7405-cd3d-4c34-912d-2fbbd30aa7b1 tempest-LiveAutoBlockMigrationV225Test-1358532044 tempest-LiveAutoBlockMigrationV225Test-1358532044-project-admin] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:47.870053 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b3ca7405-cd3d-4c34-912d-2fbbd30aa7b1 tempest-LiveAutoBlockMigrationV225Test-1358532044 tempest-LiveAutoBlockMigrationV225Test-1358532044-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:47.874441 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b3ca7405-cd3d-4c34-912d-2fbbd30aa7b1 tempest-LiveAutoBlockMigrationV225Test-1358532044 tempest-LiveAutoBlockMigrationV225Test-1358532044-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:48.400288 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.objects.instance [None req-b3ca7405-cd3d-4c34-912d-2fbbd30aa7b1 tempest-LiveAutoBlockMigrationV225Test-1358532044 tempest-LiveAutoBlockMigrationV225Test-1358532044-project-admin] Lazy-loading 'services' on Instance uuid bee52bae-2df5-46a3-9aa9-f6b24bea11e3 {{(pid=121402) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 01 18:56:48.426029 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-b3ca7405-cd3d-4c34-912d-2fbbd30aa7b1 tempest-LiveAutoBlockMigrationV225Test-1358532044 tempest-LiveAutoBlockMigrationV225Test-1358532044-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/bee52bae-2df5-46a3-9aa9-f6b24bea11e3" status: 200 len: 2033 microversion: 2.25 time: 0.628193 Nov 01 18:56:48.466510 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 366/688] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 18:56:47 2022] GET /compute/v2.1/servers/bee52bae-2df5-46a3-9aa9-f6b24bea11e3 => generated 2033 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 18:56:48.474625 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-1f6ef0e0-8bc0-4537-a371-f36632c148e2 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:56:48.475503 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-1f6ef0e0-8bc0-4537-a371-f36632c148e2 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] [instance: 58d02dff-26f6-4c2f-b886-cdbdccbfcec9] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:56:48.489689 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-1f6ef0e0-8bc0-4537-a371-f36632c148e2 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:48.490854 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-1f6ef0e0-8bc0-4537-a371-f36632c148e2 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:48.491531 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-1f6ef0e0-8bc0-4537-a371-f36632c148e2 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:48.492341 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-1f6ef0e0-8bc0-4537-a371-f36632c148e2 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:48.492989 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-1f6ef0e0-8bc0-4537-a371-f36632c148e2 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:48.493488 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-1f6ef0e0-8bc0-4537-a371-f36632c148e2 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:48.739990 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-26268ac8-9464-417d-8d0e-7202650530cb tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72117f17294649d6b8bc16c66c7efab2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45d4c047d3c44324a27a27831236ab0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:56:48.757365 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-26268ac8-9464-417d-8d0e-7202650530cb tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] 10.222.0.13 "GET /compute/v2.1/servers/614eb691-9a9a-4ca0-933d-686d80cc0ef1" status: 200 len: 1475 microversion: 2.1 time: 1.315124 Nov 01 18:56:48.759042 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 323/689] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:56:47 2022] GET /compute/v2.1/servers/614eb691-9a9a-4ca0-933d-686d80cc0ef1 => generated 1475 bytes in 1318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:56:48.780405 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-a5188678-4d67-47a5-9cf8-427be10d31be tempest-ServerAddressesNegativeTestJSON-736278170 tempest-ServerAddressesNegativeTestJSON-736278170-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:56:48.781361 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-a5188678-4d67-47a5-9cf8-427be10d31be tempest-ServerAddressesNegativeTestJSON-736278170 tempest-ServerAddressesNegativeTestJSON-736278170-project] [instance: 034c1271-a323-4728-985c-3d70df31eeb2] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:56:48.789851 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-a5188678-4d67-47a5-9cf8-427be10d31be tempest-ServerAddressesNegativeTestJSON-736278170 tempest-ServerAddressesNegativeTestJSON-736278170-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:48.790666 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-a5188678-4d67-47a5-9cf8-427be10d31be tempest-ServerAddressesNegativeTestJSON-736278170 tempest-ServerAddressesNegativeTestJSON-736278170-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:48.791279 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-a5188678-4d67-47a5-9cf8-427be10d31be tempest-ServerAddressesNegativeTestJSON-736278170 tempest-ServerAddressesNegativeTestJSON-736278170-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:48.792506 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-a5188678-4d67-47a5-9cf8-427be10d31be tempest-ServerAddressesNegativeTestJSON-736278170 tempest-ServerAddressesNegativeTestJSON-736278170-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:48.793150 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-a5188678-4d67-47a5-9cf8-427be10d31be tempest-ServerAddressesNegativeTestJSON-736278170 tempest-ServerAddressesNegativeTestJSON-736278170-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:48.793724 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-a5188678-4d67-47a5-9cf8-427be10d31be tempest-ServerAddressesNegativeTestJSON-736278170 tempest-ServerAddressesNegativeTestJSON-736278170-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:49.142698 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-1f6ef0e0-8bc0-4537-a371-f36632c148e2 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f32f5fba1976432d938e664c7714e52b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b9d4c236b944f9b2e8e502a50a8f8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:56:49.154210 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-1f6ef0e0-8bc0-4537-a371-f36632c148e2 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] 10.222.0.13 "GET /compute/v2.1/servers/58d02dff-26f6-4c2f-b886-cdbdccbfcec9" status: 200 len: 1502 microversion: 2.1 time: 0.682880 Nov 01 18:56:49.155122 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 367/690] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:56:48 2022] GET /compute/v2.1/servers/58d02dff-26f6-4c2f-b886-cdbdccbfcec9 => generated 1502 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:56:49.175768 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-8394a2df-fdb9-4648-a71c-7b02b7051a09 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:56:49.181222 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-8394a2df-fdb9-4648-a71c-7b02b7051a09 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] [instance: ea631032-dd04-429b-988e-e6362ea42cf7] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:56:49.198445 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-8394a2df-fdb9-4648-a71c-7b02b7051a09 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:49.198948 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-8394a2df-fdb9-4648-a71c-7b02b7051a09 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:49.199399 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-8394a2df-fdb9-4648-a71c-7b02b7051a09 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:49.200102 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-8394a2df-fdb9-4648-a71c-7b02b7051a09 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:49.200555 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-8394a2df-fdb9-4648-a71c-7b02b7051a09 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:49.208756 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-8394a2df-fdb9-4648-a71c-7b02b7051a09 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:49.262527 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-a5188678-4d67-47a5-9cf8-427be10d31be tempest-ServerAddressesNegativeTestJSON-736278170 tempest-ServerAddressesNegativeTestJSON-736278170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5a7d955d1004147b12eb569a7e7355a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d85b21bccf4bc78d4cbffd4f80357f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:56:49.275795 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-a5188678-4d67-47a5-9cf8-427be10d31be tempest-ServerAddressesNegativeTestJSON-736278170 tempest-ServerAddressesNegativeTestJSON-736278170-project] 10.222.0.13 "GET /compute/v2.1/servers/034c1271-a323-4728-985c-3d70df31eeb2" status: 200 len: 1325 microversion: 2.1 time: 0.514481 Nov 01 18:56:49.276617 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 324/691] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:56:48 2022] GET /compute/v2.1/servers/034c1271-a323-4728-985c-3d70df31eeb2 => generated 1325 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:56:49.311254 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-f3732e42-cf9b-45dd-8b41-6cb0aa8ef4f7 tempest-LiveAutoBlockMigrationV225Test-1358532044 tempest-LiveAutoBlockMigrationV225Test-1358532044-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-863052-2", "block_migration": "auto"}} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 18:56:49.319396 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-f3732e42-cf9b-45dd-8b41-6cb0aa8ef4f7 tempest-LiveAutoBlockMigrationV225Test-1358532044 tempest-LiveAutoBlockMigrationV225Test-1358532044-project-admin] [instance: bee52bae-2df5-46a3-9aa9-f6b24bea11e3] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:56:49.340934 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f3732e42-cf9b-45dd-8b41-6cb0aa8ef4f7 tempest-LiveAutoBlockMigrationV225Test-1358532044 tempest-LiveAutoBlockMigrationV225Test-1358532044-project-admin] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:49.341836 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f3732e42-cf9b-45dd-8b41-6cb0aa8ef4f7 tempest-LiveAutoBlockMigrationV225Test-1358532044 tempest-LiveAutoBlockMigrationV225Test-1358532044-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:49.342856 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f3732e42-cf9b-45dd-8b41-6cb0aa8ef4f7 tempest-LiveAutoBlockMigrationV225Test-1358532044 tempest-LiveAutoBlockMigrationV225Test-1358532044-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:49.344162 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f3732e42-cf9b-45dd-8b41-6cb0aa8ef4f7 tempest-LiveAutoBlockMigrationV225Test-1358532044 tempest-LiveAutoBlockMigrationV225Test-1358532044-project-admin] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:49.344983 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f3732e42-cf9b-45dd-8b41-6cb0aa8ef4f7 tempest-LiveAutoBlockMigrationV225Test-1358532044 tempest-LiveAutoBlockMigrationV225Test-1358532044-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:49.345563 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f3732e42-cf9b-45dd-8b41-6cb0aa8ef4f7 tempest-LiveAutoBlockMigrationV225Test-1358532044 tempest-LiveAutoBlockMigrationV225Test-1358532044-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:49.382131 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-8394a2df-fdb9-4648-a71c-7b02b7051a09 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c1314c21d8547ff890ede1c2ad281c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c804370880454c7aa02cef2c2c3cf144', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:56:49.391763 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-8394a2df-fdb9-4648-a71c-7b02b7051a09 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c1314c21d8547ff890ede1c2ad281c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c804370880454c7aa02cef2c2c3cf144', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:56:49.405614 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-8394a2df-fdb9-4648-a71c-7b02b7051a09 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c1314c21d8547ff890ede1c2ad281c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c804370880454c7aa02cef2c2c3cf144', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:56:49.415325 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.objects.instance [None req-f3732e42-cf9b-45dd-8b41-6cb0aa8ef4f7 tempest-LiveAutoBlockMigrationV225Test-1358532044 tempest-LiveAutoBlockMigrationV225Test-1358532044-project-admin] Lazy-loading 'flavor' on Instance uuid bee52bae-2df5-46a3-9aa9-f6b24bea11e3 {{(pid=121403) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 01 18:56:49.418444 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-8394a2df-fdb9-4648-a71c-7b02b7051a09 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] 10.222.0.13 "GET /compute/v2.1/servers/ea631032-dd04-429b-988e-e6362ea42cf7" status: 200 len: 1553 microversion: 2.91 time: 0.262077 Nov 01 18:56:49.432990 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 368/692] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 18:56:49 2022] GET /compute/v2.1/servers/ea631032-dd04-429b-988e-e6362ea42cf7 => generated 1553 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 18:56:49.438223 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-f3732e42-cf9b-45dd-8b41-6cb0aa8ef4f7 tempest-LiveAutoBlockMigrationV225Test-1358532044 tempest-LiveAutoBlockMigrationV225Test-1358532044-project-admin] [instance: bee52bae-2df5-46a3-9aa9-f6b24bea11e3] Going to try to live migrate instance to n-h2-863052-2 {{(pid=121403) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Nov 01 18:56:49.461026 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-3db69299-03d8-4db8-81e7-438284ed32f8 tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:56:49.461772 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-3db69299-03d8-4db8-81e7-438284ed32f8 tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] [instance: 87679611-878a-49b2-bf8f-39e784c6d70b] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:56:49.474714 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-3db69299-03d8-4db8-81e7-438284ed32f8 tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:49.475445 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-3db69299-03d8-4db8-81e7-438284ed32f8 tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:49.476039 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-3db69299-03d8-4db8-81e7-438284ed32f8 tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:49.476958 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-3db69299-03d8-4db8-81e7-438284ed32f8 tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:49.478202 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-3db69299-03d8-4db8-81e7-438284ed32f8 tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:49.478783 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-3db69299-03d8-4db8-81e7-438284ed32f8 tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:49.677251 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-3db69299-03d8-4db8-81e7-438284ed32f8 tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '576abe5db27b461889fef2029d477e40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e9fb3117f68434bae7a463c357818dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:56:49.688418 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-3db69299-03d8-4db8-81e7-438284ed32f8 tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '576abe5db27b461889fef2029d477e40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e9fb3117f68434bae7a463c357818dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:56:49.702567 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-3db69299-03d8-4db8-81e7-438284ed32f8 tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '576abe5db27b461889fef2029d477e40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e9fb3117f68434bae7a463c357818dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:56:49.709709 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-3db69299-03d8-4db8-81e7-438284ed32f8 tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] 10.222.0.13 "GET /compute/v2.1/servers/87679611-878a-49b2-bf8f-39e784c6d70b" status: 200 len: 1447 microversion: 2.75 time: 0.275539 Nov 01 18:56:49.710902 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 369/693] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 18:56:49 2022] GET /compute/v2.1/servers/87679611-878a-49b2-bf8f-39e784c6d70b => generated 1447 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 18:56:49.715637 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-fa5e668a-a765-4e70-b730-2babc3aa78f5 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:56:49.716461 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-fa5e668a-a765-4e70-b730-2babc3aa78f5 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] [instance: 97de391d-c836-40ac-b126-0b6684406d52] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:56:49.722934 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-fa5e668a-a765-4e70-b730-2babc3aa78f5 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:49.724301 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-fa5e668a-a765-4e70-b730-2babc3aa78f5 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:49.724960 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-fa5e668a-a765-4e70-b730-2babc3aa78f5 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:49.725874 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-fa5e668a-a765-4e70-b730-2babc3aa78f5 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:49.726489 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-fa5e668a-a765-4e70-b730-2babc3aa78f5 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:49.727070 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-fa5e668a-a765-4e70-b730-2babc3aa78f5 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:50.428903 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-fa5e668a-a765-4e70-b730-2babc3aa78f5 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b52b7dcbb044f9bfc424e4417c77fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '708bc0ea4b5a4baf81933725792bedd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:56:50.456001 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-fa5e668a-a765-4e70-b730-2babc3aa78f5 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] 10.222.0.13 "GET /compute/v2.1/servers/97de391d-c836-40ac-b126-0b6684406d52" status: 200 len: 1325 microversion: 2.1 time: 0.743856 Nov 01 18:56:50.479727 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 370/694] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:56:49 2022] GET /compute/v2.1/servers/97de391d-c836-40ac-b126-0b6684406d52 => generated 1325 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:56:50.490434 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [req-d3a342c6-0205-484e-85bd-a54ca0bc93ef req-bdd6c106-95a2-42f7-b7f1-92d75e21794b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "614eb691-9a9a-4ca0-933d-686d80cc0ef1", "name": "network-vif-unplugged", "status": "completed", "tag": "1c1a6351-a4fe-4a16-830e-df55738ac180"}]} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 18:56:50.507558 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-d3a342c6-0205-484e-85bd-a54ca0bc93ef req-bdd6c106-95a2-42f7-b7f1-92d75e21794b service nova] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:50.508526 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-d3a342c6-0205-484e-85bd-a54ca0bc93ef req-bdd6c106-95a2-42f7-b7f1-92d75e21794b service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:50.509196 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-d3a342c6-0205-484e-85bd-a54ca0bc93ef req-bdd6c106-95a2-42f7-b7f1-92d75e21794b service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:50.528900 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.compute.server_external_events [req-d3a342c6-0205-484e-85bd-a54ca0bc93ef req-bdd6c106-95a2-42f7-b7f1-92d75e21794b service nova] Creating event network-vif-unplugged:1c1a6351-a4fe-4a16-830e-df55738ac180 for instance 614eb691-9a9a-4ca0-933d-686d80cc0ef1 on n-h1-863052-2 Nov 01 18:56:50.542170 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [req-d3a342c6-0205-484e-85bd-a54ca0bc93ef req-bdd6c106-95a2-42f7-b7f1-92d75e21794b service nova] Instance 614eb691-9a9a-4ca0-933d-686d80cc0ef1 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-863052-2', 'n-h2-863052-2'} {{(pid=121402) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Nov 01 18:56:50.562773 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [req-d3a342c6-0205-484e-85bd-a54ca0bc93ef req-bdd6c106-95a2-42f7-b7f1-92d75e21794b service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.081122 Nov 01 18:56:50.563887 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 371/695] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Nov 1 18:56:50 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 18:56:50.570579 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-b0474f4a-cbcf-43c3-a260-4b03bc103b9e tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:56:50.571616 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-b0474f4a-cbcf-43c3-a260-4b03bc103b9e tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] [instance: 614eb691-9a9a-4ca0-933d-686d80cc0ef1] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:56:50.583910 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b0474f4a-cbcf-43c3-a260-4b03bc103b9e tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:50.584686 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b0474f4a-cbcf-43c3-a260-4b03bc103b9e tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:50.585356 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b0474f4a-cbcf-43c3-a260-4b03bc103b9e tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:50.586300 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b0474f4a-cbcf-43c3-a260-4b03bc103b9e tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:50.586973 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b0474f4a-cbcf-43c3-a260-4b03bc103b9e tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:50.587611 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b0474f4a-cbcf-43c3-a260-4b03bc103b9e tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:51.012921 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-b0474f4a-cbcf-43c3-a260-4b03bc103b9e tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72117f17294649d6b8bc16c66c7efab2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45d4c047d3c44324a27a27831236ab0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:56:51.022522 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-b0474f4a-cbcf-43c3-a260-4b03bc103b9e tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] 10.222.0.13 "GET /compute/v2.1/servers/614eb691-9a9a-4ca0-933d-686d80cc0ef1" status: 200 len: 1474 microversion: 2.1 time: 0.456696 Nov 01 18:56:51.045641 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 372/696] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:56:50 2022] GET /compute/v2.1/servers/614eb691-9a9a-4ca0-933d-686d80cc0ef1 => generated 1474 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:56:51.062140 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-8b6e355b-71e8-4133-b62d-22bfa5d40978 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:56:51.063331 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-8b6e355b-71e8-4133-b62d-22bfa5d40978 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] [instance: 58d02dff-26f6-4c2f-b886-cdbdccbfcec9] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:56:51.070671 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-8b6e355b-71e8-4133-b62d-22bfa5d40978 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:51.072558 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-8b6e355b-71e8-4133-b62d-22bfa5d40978 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:51.074922 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-8b6e355b-71e8-4133-b62d-22bfa5d40978 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:51.075871 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-8b6e355b-71e8-4133-b62d-22bfa5d40978 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:51.103189 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-8b6e355b-71e8-4133-b62d-22bfa5d40978 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:51.103189 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-8b6e355b-71e8-4133-b62d-22bfa5d40978 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:51.637025 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-8b6e355b-71e8-4133-b62d-22bfa5d40978 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f32f5fba1976432d938e664c7714e52b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b9d4c236b944f9b2e8e502a50a8f8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:56:51.651671 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-8b6e355b-71e8-4133-b62d-22bfa5d40978 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] 10.222.0.13 "GET /compute/v2.1/servers/58d02dff-26f6-4c2f-b886-cdbdccbfcec9" status: 200 len: 1477 microversion: 2.1 time: 0.604488 Nov 01 18:56:51.653290 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 373/697] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:56:51 2022] GET /compute/v2.1/servers/58d02dff-26f6-4c2f-b886-cdbdccbfcec9 => generated 1477 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:56:51.659849 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-19a9b2fe-5efb-4883-9794-5d0b19b57186 tempest-ServerAddressesNegativeTestJSON-736278170 tempest-ServerAddressesNegativeTestJSON-736278170-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:56:51.661455 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-19a9b2fe-5efb-4883-9794-5d0b19b57186 tempest-ServerAddressesNegativeTestJSON-736278170 tempest-ServerAddressesNegativeTestJSON-736278170-project] [instance: 034c1271-a323-4728-985c-3d70df31eeb2] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:56:51.669232 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-19a9b2fe-5efb-4883-9794-5d0b19b57186 tempest-ServerAddressesNegativeTestJSON-736278170 tempest-ServerAddressesNegativeTestJSON-736278170-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:51.669945 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-19a9b2fe-5efb-4883-9794-5d0b19b57186 tempest-ServerAddressesNegativeTestJSON-736278170 tempest-ServerAddressesNegativeTestJSON-736278170-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:51.670389 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-19a9b2fe-5efb-4883-9794-5d0b19b57186 tempest-ServerAddressesNegativeTestJSON-736278170 tempest-ServerAddressesNegativeTestJSON-736278170-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:51.671095 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-19a9b2fe-5efb-4883-9794-5d0b19b57186 tempest-ServerAddressesNegativeTestJSON-736278170 tempest-ServerAddressesNegativeTestJSON-736278170-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:51.671583 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-19a9b2fe-5efb-4883-9794-5d0b19b57186 tempest-ServerAddressesNegativeTestJSON-736278170 tempest-ServerAddressesNegativeTestJSON-736278170-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:51.672009 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-19a9b2fe-5efb-4883-9794-5d0b19b57186 tempest-ServerAddressesNegativeTestJSON-736278170 tempest-ServerAddressesNegativeTestJSON-736278170-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:51.693575 n-d-863052-2 devstack@n-api.service[121402]: DEBUG dbcounter [-] [121402] Writing DB stats nova_cell1:SELECT=100 {{(pid=121402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 18:56:51.977078 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-19a9b2fe-5efb-4883-9794-5d0b19b57186 tempest-ServerAddressesNegativeTestJSON-736278170 tempest-ServerAddressesNegativeTestJSON-736278170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5a7d955d1004147b12eb569a7e7355a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d85b21bccf4bc78d4cbffd4f80357f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:56:51.991298 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-19a9b2fe-5efb-4883-9794-5d0b19b57186 tempest-ServerAddressesNegativeTestJSON-736278170 tempest-ServerAddressesNegativeTestJSON-736278170-project] 10.222.0.13 "GET /compute/v2.1/servers/034c1271-a323-4728-985c-3d70df31eeb2" status: 200 len: 1325 microversion: 2.1 time: 0.336675 Nov 01 18:56:51.996929 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 374/698] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:56:51 2022] GET /compute/v2.1/servers/034c1271-a323-4728-985c-3d70df31eeb2 => generated 1325 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:56:52.001584 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-84d88564-1300-4335-9d88-3653cf0a12ac tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:56:52.002189 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-84d88564-1300-4335-9d88-3653cf0a12ac tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] [instance: ea631032-dd04-429b-988e-e6362ea42cf7] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:56:52.023524 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-84d88564-1300-4335-9d88-3653cf0a12ac tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:52.024087 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-84d88564-1300-4335-9d88-3653cf0a12ac tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:52.024611 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-84d88564-1300-4335-9d88-3653cf0a12ac tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:52.025535 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-84d88564-1300-4335-9d88-3653cf0a12ac tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:52.026934 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-84d88564-1300-4335-9d88-3653cf0a12ac tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:52.031875 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-84d88564-1300-4335-9d88-3653cf0a12ac tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:52.146510 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-f3732e42-cf9b-45dd-8b41-6cb0aa8ef4f7 tempest-LiveAutoBlockMigrationV225Test-1358532044 tempest-LiveAutoBlockMigrationV225Test-1358532044-project-admin] 10.222.0.13 "POST /compute/v2.1/servers/bee52bae-2df5-46a3-9aa9-f6b24bea11e3/action" status: 202 len: 0 microversion: 2.25 time: 2.851622 Nov 01 18:56:52.148791 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 325/699] 10.222.0.13 () {62 vars in 1319 bytes} [Tue Nov 1 18:56:49 2022] POST /compute/v2.1/servers/bee52bae-2df5-46a3-9aa9-f6b24bea11e3/action => generated 0 bytes in 2871 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 01 18:56:52.159390 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-84d88564-1300-4335-9d88-3653cf0a12ac tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c1314c21d8547ff890ede1c2ad281c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c804370880454c7aa02cef2c2c3cf144', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:56:52.163011 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [req-3b2df1ae-31d7-47bf-8ad1-14d13853b877 req-aafaa5e9-d745-42a6-8cb4-8e14677ad7b5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "034c1271-a323-4728-985c-3d70df31eeb2", "tag": "2b4443bc-cfe3-4140-a278-7c9306ec0e67"}]} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 18:56:52.180185 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-84d88564-1300-4335-9d88-3653cf0a12ac tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c1314c21d8547ff890ede1c2ad281c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c804370880454c7aa02cef2c2c3cf144', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:56:52.188661 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-84d88564-1300-4335-9d88-3653cf0a12ac tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c1314c21d8547ff890ede1c2ad281c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c804370880454c7aa02cef2c2c3cf144', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:56:52.194810 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-3b2df1ae-31d7-47bf-8ad1-14d13853b877 req-aafaa5e9-d745-42a6-8cb4-8e14677ad7b5 service nova] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:52.195362 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-3b2df1ae-31d7-47bf-8ad1-14d13853b877 req-aafaa5e9-d745-42a6-8cb4-8e14677ad7b5 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:52.195811 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-3b2df1ae-31d7-47bf-8ad1-14d13853b877 req-aafaa5e9-d745-42a6-8cb4-8e14677ad7b5 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:52.207294 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-84d88564-1300-4335-9d88-3653cf0a12ac tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] 10.222.0.13 "GET /compute/v2.1/servers/ea631032-dd04-429b-988e-e6362ea42cf7" status: 200 len: 1553 microversion: 2.91 time: 0.209224 Nov 01 18:56:52.212560 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 375/700] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 18:56:51 2022] GET /compute/v2.1/servers/ea631032-dd04-429b-988e-e6362ea42cf7 => generated 1553 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 18:56:52.219761 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-e5b60d31-8f22-4980-9141-579cb036a44f tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:56:52.221335 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-e5b60d31-8f22-4980-9141-579cb036a44f tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] [instance: 87679611-878a-49b2-bf8f-39e784c6d70b] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:56:52.221476 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.compute.server_external_events [req-3b2df1ae-31d7-47bf-8ad1-14d13853b877 req-aafaa5e9-d745-42a6-8cb4-8e14677ad7b5 service nova] Creating event network-changed:2b4443bc-cfe3-4140-a278-7c9306ec0e67 for instance 034c1271-a323-4728-985c-3d70df31eeb2 on n-h2-863052-2 Nov 01 18:56:52.229465 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [req-3b2df1ae-31d7-47bf-8ad1-14d13853b877 req-aafaa5e9-d745-42a6-8cb4-8e14677ad7b5 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078663 Nov 01 18:56:52.230124 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 326/701] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Nov 1 18:56:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 18:56:52.234207 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e5b60d31-8f22-4980-9141-579cb036a44f tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:52.235091 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e5b60d31-8f22-4980-9141-579cb036a44f tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:52.236188 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e5b60d31-8f22-4980-9141-579cb036a44f tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:52.237652 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e5b60d31-8f22-4980-9141-579cb036a44f tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:52.241122 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e5b60d31-8f22-4980-9141-579cb036a44f tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:52.242397 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e5b60d31-8f22-4980-9141-579cb036a44f tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:52.247348 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-cda66576-cbf4-4b9a-b80a-d443165a7742 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:56:52.248356 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-cda66576-cbf4-4b9a-b80a-d443165a7742 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] [instance: 97de391d-c836-40ac-b126-0b6684406d52] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:56:52.264043 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-cda66576-cbf4-4b9a-b80a-d443165a7742 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:52.265136 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-cda66576-cbf4-4b9a-b80a-d443165a7742 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:52.269426 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-cda66576-cbf4-4b9a-b80a-d443165a7742 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:52.271023 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-cda66576-cbf4-4b9a-b80a-d443165a7742 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:52.271705 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-cda66576-cbf4-4b9a-b80a-d443165a7742 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:52.272372 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-cda66576-cbf4-4b9a-b80a-d443165a7742 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:52.367882 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-e5b60d31-8f22-4980-9141-579cb036a44f tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '576abe5db27b461889fef2029d477e40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e9fb3117f68434bae7a463c357818dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:56:52.378687 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-e5b60d31-8f22-4980-9141-579cb036a44f tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '576abe5db27b461889fef2029d477e40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e9fb3117f68434bae7a463c357818dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:56:52.385167 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-e5b60d31-8f22-4980-9141-579cb036a44f tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '576abe5db27b461889fef2029d477e40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e9fb3117f68434bae7a463c357818dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:56:52.391179 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-e5b60d31-8f22-4980-9141-579cb036a44f tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] 10.222.0.13 "GET /compute/v2.1/servers/87679611-878a-49b2-bf8f-39e784c6d70b" status: 200 len: 1447 microversion: 2.75 time: 0.176490 Nov 01 18:56:52.406425 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 376/702] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 18:56:52 2022] GET /compute/v2.1/servers/87679611-878a-49b2-bf8f-39e784c6d70b => generated 1447 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 18:56:52.420809 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-b81604ed-7b62-4471-bfd0-c07cb83858e3 tempest-LiveMigrationTest-1695240876 tempest-LiveMigrationTest-1695240876-project-admin] Calling method '.version_select at 0x7f0ae27373a0>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:56:52.424482 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b81604ed-7b62-4471-bfd0-c07cb83858e3 tempest-LiveMigrationTest-1695240876 tempest-LiveMigrationTest-1695240876-project-admin] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:52.425016 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b81604ed-7b62-4471-bfd0-c07cb83858e3 tempest-LiveMigrationTest-1695240876 tempest-LiveMigrationTest-1695240876-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:52.425639 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b81604ed-7b62-4471-bfd0-c07cb83858e3 tempest-LiveMigrationTest-1695240876 tempest-LiveMigrationTest-1695240876-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:52.444079 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-b81604ed-7b62-4471-bfd0-c07cb83858e3 tempest-LiveMigrationTest-1695240876 tempest-LiveMigrationTest-1695240876-project-admin] 10.222.0.13 "GET /compute/v2.1/os-migrations" status: 200 len: 1950 microversion: 2.1 time: 0.036520 Nov 01 18:56:52.445388 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 377/703] 10.222.0.13 () {58 vars in 1143 bytes} [Tue Nov 1 18:56:52 2022] GET /compute/v2.1/os-migrations => generated 1950 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:56:52.451290 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-73948ea6-37e9-41a6-8e79-36622c174188 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:56:52.452190 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-73948ea6-37e9-41a6-8e79-36622c174188 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] [instance: 614eb691-9a9a-4ca0-933d-686d80cc0ef1] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:56:52.459727 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-73948ea6-37e9-41a6-8e79-36622c174188 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:52.461543 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-73948ea6-37e9-41a6-8e79-36622c174188 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:52.462286 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-73948ea6-37e9-41a6-8e79-36622c174188 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:52.463276 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-73948ea6-37e9-41a6-8e79-36622c174188 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:52.465415 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-73948ea6-37e9-41a6-8e79-36622c174188 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:52.466074 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-73948ea6-37e9-41a6-8e79-36622c174188 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:52.573956 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-cda66576-cbf4-4b9a-b80a-d443165a7742 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b52b7dcbb044f9bfc424e4417c77fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '708bc0ea4b5a4baf81933725792bedd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:56:52.594337 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-cda66576-cbf4-4b9a-b80a-d443165a7742 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] 10.222.0.13 "GET /compute/v2.1/servers/97de391d-c836-40ac-b126-0b6684406d52" status: 200 len: 1325 microversion: 2.1 time: 0.362784 Nov 01 18:56:52.598425 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 327/704] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:56:52 2022] GET /compute/v2.1/servers/97de391d-c836-40ac-b126-0b6684406d52 => generated 1325 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:56:52.603241 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-6562cc3d-5483-457f-b58a-bd6183484873 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:56:52.603850 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-6562cc3d-5483-457f-b58a-bd6183484873 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] [instance: bee52bae-2df5-46a3-9aa9-f6b24bea11e3] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:56:52.616652 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-6562cc3d-5483-457f-b58a-bd6183484873 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:52.617370 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-6562cc3d-5483-457f-b58a-bd6183484873 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:52.618023 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-6562cc3d-5483-457f-b58a-bd6183484873 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:52.618920 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-6562cc3d-5483-457f-b58a-bd6183484873 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:52.619775 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-6562cc3d-5483-457f-b58a-bd6183484873 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:52.620422 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-6562cc3d-5483-457f-b58a-bd6183484873 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:52.672468 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-73948ea6-37e9-41a6-8e79-36622c174188 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72117f17294649d6b8bc16c66c7efab2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45d4c047d3c44324a27a27831236ab0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:56:52.680955 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-73948ea6-37e9-41a6-8e79-36622c174188 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] 10.222.0.13 "GET /compute/v2.1/servers/614eb691-9a9a-4ca0-933d-686d80cc0ef1" status: 200 len: 1474 microversion: 2.1 time: 0.234076 Nov 01 18:56:52.681519 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 378/705] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:56:52 2022] GET /compute/v2.1/servers/614eb691-9a9a-4ca0-933d-686d80cc0ef1 => generated 1474 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:56:52.702965 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-54db06ad-f7a4-4736-b364-4636cfa265cb tempest-LiveMigrationTest-1695240876 tempest-LiveMigrationTest-1695240876-project-admin] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:56:52.703580 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-54db06ad-f7a4-4736-b364-4636cfa265cb tempest-LiveMigrationTest-1695240876 tempest-LiveMigrationTest-1695240876-project-admin] [instance: 58d02dff-26f6-4c2f-b886-cdbdccbfcec9] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:56:52.710204 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-54db06ad-f7a4-4736-b364-4636cfa265cb tempest-LiveMigrationTest-1695240876 tempest-LiveMigrationTest-1695240876-project-admin] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:52.710702 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-54db06ad-f7a4-4736-b364-4636cfa265cb tempest-LiveMigrationTest-1695240876 tempest-LiveMigrationTest-1695240876-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:52.711137 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-54db06ad-f7a4-4736-b364-4636cfa265cb tempest-LiveMigrationTest-1695240876 tempest-LiveMigrationTest-1695240876-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:52.711850 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-54db06ad-f7a4-4736-b364-4636cfa265cb tempest-LiveMigrationTest-1695240876 tempest-LiveMigrationTest-1695240876-project-admin] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:52.712303 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-54db06ad-f7a4-4736-b364-4636cfa265cb tempest-LiveMigrationTest-1695240876 tempest-LiveMigrationTest-1695240876-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:52.712774 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-54db06ad-f7a4-4736-b364-4636cfa265cb tempest-LiveMigrationTest-1695240876 tempest-LiveMigrationTest-1695240876-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:52.830136 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-6562cc3d-5483-457f-b58a-bd6183484873 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:56:52.848828 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-6562cc3d-5483-457f-b58a-bd6183484873 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:56:52.854187 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-6562cc3d-5483-457f-b58a-bd6183484873 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:56:52.856380 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-6562cc3d-5483-457f-b58a-bd6183484873 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] 10.222.0.13 "GET /compute/v2.1/servers/bee52bae-2df5-46a3-9aa9-f6b24bea11e3" status: 200 len: 1566 microversion: 2.25 time: 0.256450 Nov 01 18:56:52.880230 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 328/706] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 18:56:52 2022] GET /compute/v2.1/servers/bee52bae-2df5-46a3-9aa9-f6b24bea11e3 => generated 1566 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 18:56:52.896943 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [req-9c82faaf-5f2c-4076-b9c3-b3f472190a37 req-73d1662a-8dbd-47ee-ab7e-ce1627559dcd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "614eb691-9a9a-4ca0-933d-686d80cc0ef1", "tag": "1c1a6351-a4fe-4a16-830e-df55738ac180"}]} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 18:56:52.908889 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-9c82faaf-5f2c-4076-b9c3-b3f472190a37 req-73d1662a-8dbd-47ee-ab7e-ce1627559dcd service nova] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:52.909795 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-9c82faaf-5f2c-4076-b9c3-b3f472190a37 req-73d1662a-8dbd-47ee-ab7e-ce1627559dcd service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:52.910453 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-9c82faaf-5f2c-4076-b9c3-b3f472190a37 req-73d1662a-8dbd-47ee-ab7e-ce1627559dcd service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:52.925448 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.compute.server_external_events [req-9c82faaf-5f2c-4076-b9c3-b3f472190a37 req-73d1662a-8dbd-47ee-ab7e-ce1627559dcd service nova] Creating event network-changed:1c1a6351-a4fe-4a16-830e-df55738ac180 for instance 614eb691-9a9a-4ca0-933d-686d80cc0ef1 on n-h1-863052-2 Nov 01 18:56:52.940144 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [req-9c82faaf-5f2c-4076-b9c3-b3f472190a37 req-73d1662a-8dbd-47ee-ab7e-ce1627559dcd service nova] Instance 614eb691-9a9a-4ca0-933d-686d80cc0ef1 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-863052-2', 'n-h2-863052-2'} {{(pid=121403) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Nov 01 18:56:52.954029 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [req-9c82faaf-5f2c-4076-b9c3-b3f472190a37 req-73d1662a-8dbd-47ee-ab7e-ce1627559dcd service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067009 Nov 01 18:56:52.955116 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 329/707] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Nov 1 18:56:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 18:56:53.020340 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-a788aeb8-e49b-47ae-9e1e-96594e3e439c tempest-ServerAddressesNegativeTestJSON-736278170 tempest-ServerAddressesNegativeTestJSON-736278170-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:56:53.021193 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-a788aeb8-e49b-47ae-9e1e-96594e3e439c tempest-ServerAddressesNegativeTestJSON-736278170 tempest-ServerAddressesNegativeTestJSON-736278170-project] [instance: 034c1271-a323-4728-985c-3d70df31eeb2] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:56:53.036507 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-a788aeb8-e49b-47ae-9e1e-96594e3e439c tempest-ServerAddressesNegativeTestJSON-736278170 tempest-ServerAddressesNegativeTestJSON-736278170-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:53.037131 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-a788aeb8-e49b-47ae-9e1e-96594e3e439c tempest-ServerAddressesNegativeTestJSON-736278170 tempest-ServerAddressesNegativeTestJSON-736278170-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:53.037648 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-a788aeb8-e49b-47ae-9e1e-96594e3e439c tempest-ServerAddressesNegativeTestJSON-736278170 tempest-ServerAddressesNegativeTestJSON-736278170-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:53.038437 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-a788aeb8-e49b-47ae-9e1e-96594e3e439c tempest-ServerAddressesNegativeTestJSON-736278170 tempest-ServerAddressesNegativeTestJSON-736278170-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:53.038552 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-54db06ad-f7a4-4736-b364-4636cfa265cb tempest-LiveMigrationTest-1695240876 tempest-LiveMigrationTest-1695240876-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/58d02dff-26f6-4c2f-b886-cdbdccbfcec9" status: 200 len: 1628 microversion: 2.1 time: 0.343722 Nov 01 18:56:53.050863 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 379/708] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:56:52 2022] GET /compute/v2.1/servers/58d02dff-26f6-4c2f-b886-cdbdccbfcec9 => generated 1628 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:56:53.050971 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-a788aeb8-e49b-47ae-9e1e-96594e3e439c tempest-ServerAddressesNegativeTestJSON-736278170 tempest-ServerAddressesNegativeTestJSON-736278170-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:53.050971 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-a788aeb8-e49b-47ae-9e1e-96594e3e439c tempest-ServerAddressesNegativeTestJSON-736278170 tempest-ServerAddressesNegativeTestJSON-736278170-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:53.070364 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-b04da971-ac00-4598-ae0c-4b0071e000cc tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Action: 'create', calling method: .version_select at 0x7f0ae2ae6670>, body: {"keypair": {"name": "tempest-keypair-1346805597", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMfV2ATTVEa+c/7H6bOnaAkRNwMzlijakHZ/pxNsrbPnS7XXkGj9mDdwDLO5eiiw/tVhzSVfiWCBvDh2Wo/uDLO9J2SLKRbuuI5MGlcKzSAGJCHb5TQ98Q2FcNLKB0cqaQ=="}} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 18:56:53.116653 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.quota [None req-b04da971-ac00-4598-ae0c-4b0071e000cc tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Getting quotas for project d9b9d4c236b944f9b2e8e502a50a8f8b. Resources: {'key_pairs'} {{(pid=121402) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 01 18:56:53.123776 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.quota [None req-b04da971-ac00-4598-ae0c-4b0071e000cc tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Getting quotas for user f32f5fba1976432d938e664c7714e52b and project d9b9d4c236b944f9b2e8e502a50a8f8b. Resources: {'key_pairs'} {{(pid=121402) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 01 18:56:53.167458 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-b04da971-ac00-4598-ae0c-4b0071e000cc tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.101095 Nov 01 18:56:53.175980 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 380/709] 10.222.0.13 () {60 vars in 1159 bytes} [Tue Nov 1 18:56:53 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 18:56:53.243504 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-77f931eb-2916-486c-ad23-abe3194aff22 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:56:53.244126 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-77f931eb-2916-486c-ad23-abe3194aff22 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] [instance: ea631032-dd04-429b-988e-e6362ea42cf7] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:56:53.251908 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-77f931eb-2916-486c-ad23-abe3194aff22 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:53.252405 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-77f931eb-2916-486c-ad23-abe3194aff22 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:53.258304 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-77f931eb-2916-486c-ad23-abe3194aff22 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:53.259148 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-77f931eb-2916-486c-ad23-abe3194aff22 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:53.259709 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-77f931eb-2916-486c-ad23-abe3194aff22 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:53.260079 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-77f931eb-2916-486c-ad23-abe3194aff22 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:53.426956 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-a788aeb8-e49b-47ae-9e1e-96594e3e439c tempest-ServerAddressesNegativeTestJSON-736278170 tempest-ServerAddressesNegativeTestJSON-736278170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5a7d955d1004147b12eb569a7e7355a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d85b21bccf4bc78d4cbffd4f80357f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:56:53.442385 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-a788aeb8-e49b-47ae-9e1e-96594e3e439c tempest-ServerAddressesNegativeTestJSON-736278170 tempest-ServerAddressesNegativeTestJSON-736278170-project] 10.222.0.13 "GET /compute/v2.1/servers/034c1271-a323-4728-985c-3d70df31eeb2" status: 200 len: 1325 microversion: 2.1 time: 0.426602 Nov 01 18:56:53.458301 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-77f931eb-2916-486c-ad23-abe3194aff22 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c1314c21d8547ff890ede1c2ad281c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c804370880454c7aa02cef2c2c3cf144', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:56:53.458693 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 330/710] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:56:53 2022] GET /compute/v2.1/servers/034c1271-a323-4728-985c-3d70df31eeb2 => generated 1325 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:56:53.464047 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-f8fe77da-e822-493b-83ac-434ccd576e04 tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:56:53.466680 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-f8fe77da-e822-493b-83ac-434ccd576e04 tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] [instance: 87679611-878a-49b2-bf8f-39e784c6d70b] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:56:53.475706 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-77f931eb-2916-486c-ad23-abe3194aff22 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c1314c21d8547ff890ede1c2ad281c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c804370880454c7aa02cef2c2c3cf144', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:56:53.478237 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-77f931eb-2916-486c-ad23-abe3194aff22 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c1314c21d8547ff890ede1c2ad281c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c804370880454c7aa02cef2c2c3cf144', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:56:53.479939 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f8fe77da-e822-493b-83ac-434ccd576e04 tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:53.481168 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f8fe77da-e822-493b-83ac-434ccd576e04 tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:53.485225 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f8fe77da-e822-493b-83ac-434ccd576e04 tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:53.485579 n-d-863052-2 devstack@n-api.service[121402]: DEBUG dbcounter [-] [121402] Writing DB stats nova_api:SELECT=99,nova_api:INSERT=1 {{(pid=121402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 18:56:53.486365 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f8fe77da-e822-493b-83ac-434ccd576e04 tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:53.487004 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f8fe77da-e822-493b-83ac-434ccd576e04 tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:53.487587 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f8fe77da-e822-493b-83ac-434ccd576e04 tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:53.495548 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-77f931eb-2916-486c-ad23-abe3194aff22 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] 10.222.0.13 "GET /compute/v2.1/servers/ea631032-dd04-429b-988e-e6362ea42cf7" status: 200 len: 1553 microversion: 2.91 time: 0.256606 Nov 01 18:56:53.496255 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 381/711] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 18:56:53 2022] GET /compute/v2.1/servers/ea631032-dd04-429b-988e-e6362ea42cf7 => generated 1553 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 18:56:53.624127 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-1ab6e773-9000-403c-a0e3-5e8c838e94af tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:56:53.625181 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-1ab6e773-9000-403c-a0e3-5e8c838e94af tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] [instance: 97de391d-c836-40ac-b126-0b6684406d52] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:56:53.634571 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-1ab6e773-9000-403c-a0e3-5e8c838e94af tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:53.636566 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-1ab6e773-9000-403c-a0e3-5e8c838e94af tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:53.640627 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-1ab6e773-9000-403c-a0e3-5e8c838e94af tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:53.642078 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-1ab6e773-9000-403c-a0e3-5e8c838e94af tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:53.642760 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-1ab6e773-9000-403c-a0e3-5e8c838e94af tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:53.644008 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-1ab6e773-9000-403c-a0e3-5e8c838e94af tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:53.781986 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-f8fe77da-e822-493b-83ac-434ccd576e04 tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '576abe5db27b461889fef2029d477e40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e9fb3117f68434bae7a463c357818dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:56:53.793058 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-f8fe77da-e822-493b-83ac-434ccd576e04 tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '576abe5db27b461889fef2029d477e40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e9fb3117f68434bae7a463c357818dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:56:53.805051 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-f8fe77da-e822-493b-83ac-434ccd576e04 tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '576abe5db27b461889fef2029d477e40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e9fb3117f68434bae7a463c357818dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:56:53.811638 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-f8fe77da-e822-493b-83ac-434ccd576e04 tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] 10.222.0.13 "GET /compute/v2.1/servers/87679611-878a-49b2-bf8f-39e784c6d70b" status: 200 len: 1447 microversion: 2.75 time: 0.351541 Nov 01 18:56:53.813281 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 331/712] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 18:56:53 2022] GET /compute/v2.1/servers/87679611-878a-49b2-bf8f-39e784c6d70b => generated 1447 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 18:56:53.826960 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-da03ef5e-5bb8-43fb-9cca-8001881af673 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:56:53.827948 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-da03ef5e-5bb8-43fb-9cca-8001881af673 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] [instance: 614eb691-9a9a-4ca0-933d-686d80cc0ef1] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:56:53.843683 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-da03ef5e-5bb8-43fb-9cca-8001881af673 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:53.844668 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-da03ef5e-5bb8-43fb-9cca-8001881af673 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:53.845326 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-da03ef5e-5bb8-43fb-9cca-8001881af673 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:53.846376 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-da03ef5e-5bb8-43fb-9cca-8001881af673 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:53.847028 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-da03ef5e-5bb8-43fb-9cca-8001881af673 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:53.847643 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-da03ef5e-5bb8-43fb-9cca-8001881af673 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:53.848957 n-d-863052-2 devstack@n-api.service[121403]: DEBUG dbcounter [-] [121403] Writing DB stats nova_cell0:SELECT=12 {{(pid=121403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 18:56:54.048627 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-1ab6e773-9000-403c-a0e3-5e8c838e94af tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b52b7dcbb044f9bfc424e4417c77fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '708bc0ea4b5a4baf81933725792bedd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:56:54.063843 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-1ab6e773-9000-403c-a0e3-5e8c838e94af tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] 10.222.0.13 "GET /compute/v2.1/servers/97de391d-c836-40ac-b126-0b6684406d52" status: 200 len: 1325 microversion: 2.1 time: 0.441434 Nov 01 18:56:54.069235 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 382/713] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:56:53 2022] GET /compute/v2.1/servers/97de391d-c836-40ac-b126-0b6684406d52 => generated 1325 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:56:54.075365 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-52db4f37-55ee-40db-9241-956bee30a34f tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:56:54.076686 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-52db4f37-55ee-40db-9241-956bee30a34f tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] [instance: bee52bae-2df5-46a3-9aa9-f6b24bea11e3] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:56:54.089564 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-52db4f37-55ee-40db-9241-956bee30a34f tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:54.091150 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-52db4f37-55ee-40db-9241-956bee30a34f tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:54.092074 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-52db4f37-55ee-40db-9241-956bee30a34f tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:54.093238 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-52db4f37-55ee-40db-9241-956bee30a34f tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:54.094311 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-52db4f37-55ee-40db-9241-956bee30a34f tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:54.095031 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-52db4f37-55ee-40db-9241-956bee30a34f tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:54.368223 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-52db4f37-55ee-40db-9241-956bee30a34f tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:56:54.383181 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-52db4f37-55ee-40db-9241-956bee30a34f tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:56:54.387342 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-52db4f37-55ee-40db-9241-956bee30a34f tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:56:54.390428 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-52db4f37-55ee-40db-9241-956bee30a34f tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] 10.222.0.13 "GET /compute/v2.1/servers/bee52bae-2df5-46a3-9aa9-f6b24bea11e3" status: 200 len: 1566 microversion: 2.25 time: 0.319437 Nov 01 18:56:54.393130 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 383/714] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 18:56:54 2022] GET /compute/v2.1/servers/bee52bae-2df5-46a3-9aa9-f6b24bea11e3 => generated 1566 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 18:56:54.404828 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [req-fb743712-b43d-41fc-82d4-d0643c11e795 req-32dd06de-e3d0-4d5d-a73b-01fb61f39e99 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "97de391d-c836-40ac-b126-0b6684406d52", "tag": "7d838ab6-b291-4c63-b4a9-0e37df1c216f"}]} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 18:56:54.425996 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-da03ef5e-5bb8-43fb-9cca-8001881af673 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72117f17294649d6b8bc16c66c7efab2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45d4c047d3c44324a27a27831236ab0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:56:54.435257 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-fb743712-b43d-41fc-82d4-d0643c11e795 req-32dd06de-e3d0-4d5d-a73b-01fb61f39e99 service nova] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:54.436068 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-fb743712-b43d-41fc-82d4-d0643c11e795 req-32dd06de-e3d0-4d5d-a73b-01fb61f39e99 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:54.436207 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-da03ef5e-5bb8-43fb-9cca-8001881af673 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] 10.222.0.13 "GET /compute/v2.1/servers/614eb691-9a9a-4ca0-933d-686d80cc0ef1" status: 200 len: 1472 microversion: 2.1 time: 0.619840 Nov 01 18:56:54.438217 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 332/715] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:56:53 2022] GET /compute/v2.1/servers/614eb691-9a9a-4ca0-933d-686d80cc0ef1 => generated 1472 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:56:54.451609 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-fb743712-b43d-41fc-82d4-d0643c11e795 req-32dd06de-e3d0-4d5d-a73b-01fb61f39e99 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:54.465829 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-18235808-437f-44f3-8b6a-373dd8abc1ca tempest-ServerAddressesNegativeTestJSON-736278170 tempest-ServerAddressesNegativeTestJSON-736278170-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:56:54.466311 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.compute.server_external_events [req-fb743712-b43d-41fc-82d4-d0643c11e795 req-32dd06de-e3d0-4d5d-a73b-01fb61f39e99 service nova] Creating event network-changed:7d838ab6-b291-4c63-b4a9-0e37df1c216f for instance 97de391d-c836-40ac-b126-0b6684406d52 on n-h1-863052-2 Nov 01 18:56:54.466988 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-18235808-437f-44f3-8b6a-373dd8abc1ca tempest-ServerAddressesNegativeTestJSON-736278170 tempest-ServerAddressesNegativeTestJSON-736278170-project] [instance: 034c1271-a323-4728-985c-3d70df31eeb2] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:56:54.473169 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [req-fb743712-b43d-41fc-82d4-d0643c11e795 req-32dd06de-e3d0-4d5d-a73b-01fb61f39e99 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078306 Nov 01 18:56:54.474384 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 384/716] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Nov 1 18:56:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 18:56:54.474802 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-18235808-437f-44f3-8b6a-373dd8abc1ca tempest-ServerAddressesNegativeTestJSON-736278170 tempest-ServerAddressesNegativeTestJSON-736278170-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:54.475358 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-18235808-437f-44f3-8b6a-373dd8abc1ca tempest-ServerAddressesNegativeTestJSON-736278170 tempest-ServerAddressesNegativeTestJSON-736278170-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:54.476034 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-18235808-437f-44f3-8b6a-373dd8abc1ca tempest-ServerAddressesNegativeTestJSON-736278170 tempest-ServerAddressesNegativeTestJSON-736278170-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:54.476979 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-18235808-437f-44f3-8b6a-373dd8abc1ca tempest-ServerAddressesNegativeTestJSON-736278170 tempest-ServerAddressesNegativeTestJSON-736278170-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:54.477749 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-18235808-437f-44f3-8b6a-373dd8abc1ca tempest-ServerAddressesNegativeTestJSON-736278170 tempest-ServerAddressesNegativeTestJSON-736278170-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:54.478380 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-18235808-437f-44f3-8b6a-373dd8abc1ca tempest-ServerAddressesNegativeTestJSON-736278170 tempest-ServerAddressesNegativeTestJSON-736278170-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:54.502577 n-d-863052-2 devstack@n-api.service[121403]: DEBUG dbcounter [-] [121403] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=121403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 18:56:54.529074 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-d2bad753-19ed-479d-b602-f1ac3f97a465 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:56:54.530541 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-d2bad753-19ed-479d-b602-f1ac3f97a465 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] [instance: ea631032-dd04-429b-988e-e6362ea42cf7] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:56:54.537084 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-d2bad753-19ed-479d-b602-f1ac3f97a465 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:54.537612 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-d2bad753-19ed-479d-b602-f1ac3f97a465 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:54.538051 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-d2bad753-19ed-479d-b602-f1ac3f97a465 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:54.538757 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-d2bad753-19ed-479d-b602-f1ac3f97a465 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:54.539216 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-d2bad753-19ed-479d-b602-f1ac3f97a465 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:54.540752 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-d2bad753-19ed-479d-b602-f1ac3f97a465 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:54.658314 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-d2bad753-19ed-479d-b602-f1ac3f97a465 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c1314c21d8547ff890ede1c2ad281c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c804370880454c7aa02cef2c2c3cf144', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:56:54.671725 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-d2bad753-19ed-479d-b602-f1ac3f97a465 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c1314c21d8547ff890ede1c2ad281c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c804370880454c7aa02cef2c2c3cf144', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:56:54.677680 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-d2bad753-19ed-479d-b602-f1ac3f97a465 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c1314c21d8547ff890ede1c2ad281c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c804370880454c7aa02cef2c2c3cf144', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:56:54.686885 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-d2bad753-19ed-479d-b602-f1ac3f97a465 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] 10.222.0.13 "GET /compute/v2.1/servers/ea631032-dd04-429b-988e-e6362ea42cf7" status: 200 len: 1553 microversion: 2.91 time: 0.162202 Nov 01 18:56:54.694120 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 385/717] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 18:56:54 2022] GET /compute/v2.1/servers/ea631032-dd04-429b-988e-e6362ea42cf7 => generated 1553 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 01 18:56:54.842982 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-ba23afe4-5d9a-44a2-af08-5ba72ed61cb7 tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:56:54.843630 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-ba23afe4-5d9a-44a2-af08-5ba72ed61cb7 tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] [instance: 87679611-878a-49b2-bf8f-39e784c6d70b] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:56:54.856556 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-ba23afe4-5d9a-44a2-af08-5ba72ed61cb7 tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:54.857113 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-ba23afe4-5d9a-44a2-af08-5ba72ed61cb7 tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:54.857551 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-ba23afe4-5d9a-44a2-af08-5ba72ed61cb7 tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:54.859826 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-ba23afe4-5d9a-44a2-af08-5ba72ed61cb7 tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:54.860295 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-ba23afe4-5d9a-44a2-af08-5ba72ed61cb7 tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:54.860772 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-ba23afe4-5d9a-44a2-af08-5ba72ed61cb7 tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:55.239612 n-d-863052-2 devstack@n-api.service[121403]: DEBUG dbcounter [-] [121403] Writing DB stats nova_cell0:SELECT=6 {{(pid=121403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 18:56:55.300214 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-18235808-437f-44f3-8b6a-373dd8abc1ca tempest-ServerAddressesNegativeTestJSON-736278170 tempest-ServerAddressesNegativeTestJSON-736278170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5a7d955d1004147b12eb569a7e7355a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d85b21bccf4bc78d4cbffd4f80357f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:56:55.310831 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-18235808-437f-44f3-8b6a-373dd8abc1ca tempest-ServerAddressesNegativeTestJSON-736278170 tempest-ServerAddressesNegativeTestJSON-736278170-project] 10.222.0.13 "GET /compute/v2.1/servers/034c1271-a323-4728-985c-3d70df31eeb2" status: 200 len: 1325 microversion: 2.1 time: 0.848704 Nov 01 18:56:55.332142 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 333/718] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:56:54 2022] GET /compute/v2.1/servers/034c1271-a323-4728-985c-3d70df31eeb2 => generated 1325 bytes in 864 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 18:56:55.341284 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-c1d8f63c-253a-4d9e-94d2-88abb3931891 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:56:55.343441 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-c1d8f63c-253a-4d9e-94d2-88abb3931891 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] [instance: 97de391d-c836-40ac-b126-0b6684406d52] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:56:55.358139 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-c1d8f63c-253a-4d9e-94d2-88abb3931891 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:55.358867 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-c1d8f63c-253a-4d9e-94d2-88abb3931891 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:55.359467 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-c1d8f63c-253a-4d9e-94d2-88abb3931891 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:55.360343 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-c1d8f63c-253a-4d9e-94d2-88abb3931891 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:55.360988 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-c1d8f63c-253a-4d9e-94d2-88abb3931891 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:55.364312 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-c1d8f63c-253a-4d9e-94d2-88abb3931891 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:55.393262 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-ba23afe4-5d9a-44a2-af08-5ba72ed61cb7 tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '576abe5db27b461889fef2029d477e40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e9fb3117f68434bae7a463c357818dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:56:55.405977 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-ba23afe4-5d9a-44a2-af08-5ba72ed61cb7 tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '576abe5db27b461889fef2029d477e40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e9fb3117f68434bae7a463c357818dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:56:55.412910 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-ba23afe4-5d9a-44a2-af08-5ba72ed61cb7 tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '576abe5db27b461889fef2029d477e40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e9fb3117f68434bae7a463c357818dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:56:55.424181 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-ba23afe4-5d9a-44a2-af08-5ba72ed61cb7 tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] 10.222.0.13 "GET /compute/v2.1/servers/87679611-878a-49b2-bf8f-39e784c6d70b" status: 200 len: 1447 microversion: 2.75 time: 0.585499 Nov 01 18:56:55.424811 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 386/719] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 18:56:54 2022] GET /compute/v2.1/servers/87679611-878a-49b2-bf8f-39e784c6d70b => generated 1447 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 01 18:56:55.435055 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-6fcad194-f793-4810-a023-4da07dc3eb93 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:56:55.435684 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-6fcad194-f793-4810-a023-4da07dc3eb93 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] [instance: bee52bae-2df5-46a3-9aa9-f6b24bea11e3] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:56:55.447658 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-6fcad194-f793-4810-a023-4da07dc3eb93 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:55.448164 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-6fcad194-f793-4810-a023-4da07dc3eb93 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:55.448624 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-6fcad194-f793-4810-a023-4da07dc3eb93 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:55.456361 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-6fcad194-f793-4810-a023-4da07dc3eb93 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:55.458635 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-6fcad194-f793-4810-a023-4da07dc3eb93 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:55.458635 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-6fcad194-f793-4810-a023-4da07dc3eb93 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:55.767687 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-c1d8f63c-253a-4d9e-94d2-88abb3931891 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b52b7dcbb044f9bfc424e4417c77fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '708bc0ea4b5a4baf81933725792bedd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:56:55.776429 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-c1d8f63c-253a-4d9e-94d2-88abb3931891 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] 10.222.0.13 "GET /compute/v2.1/servers/97de391d-c836-40ac-b126-0b6684406d52" status: 200 len: 1325 microversion: 2.1 time: 0.442343 Nov 01 18:56:55.779633 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 334/720] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:56:55 2022] GET /compute/v2.1/servers/97de391d-c836-40ac-b126-0b6684406d52 => generated 1325 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:56:55.784344 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-27657bc1-61ce-472d-9c35-2f7a23eb8576 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:56:55.790005 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-27657bc1-61ce-472d-9c35-2f7a23eb8576 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] [instance: 614eb691-9a9a-4ca0-933d-686d80cc0ef1] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:56:55.811916 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-27657bc1-61ce-472d-9c35-2f7a23eb8576 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:55.812712 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-27657bc1-61ce-472d-9c35-2f7a23eb8576 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:55.813157 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-27657bc1-61ce-472d-9c35-2f7a23eb8576 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:55.813868 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-27657bc1-61ce-472d-9c35-2f7a23eb8576 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:55.814323 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-27657bc1-61ce-472d-9c35-2f7a23eb8576 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:55.814748 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-27657bc1-61ce-472d-9c35-2f7a23eb8576 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:55.888070 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-6fcad194-f793-4810-a023-4da07dc3eb93 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:56:55.900176 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-6fcad194-f793-4810-a023-4da07dc3eb93 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:56:55.901557 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-6fcad194-f793-4810-a023-4da07dc3eb93 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:56:55.902897 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-6fcad194-f793-4810-a023-4da07dc3eb93 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] 10.222.0.13 "GET /compute/v2.1/servers/bee52bae-2df5-46a3-9aa9-f6b24bea11e3" status: 200 len: 1566 microversion: 2.25 time: 0.477128 Nov 01 18:56:55.904426 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 387/721] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 18:56:55 2022] GET /compute/v2.1/servers/bee52bae-2df5-46a3-9aa9-f6b24bea11e3 => generated 1566 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 18:56:55.912761 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-d5755a68-ac4b-492e-966e-d2cd9afb3b4a tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:56:55.913371 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-d5755a68-ac4b-492e-966e-d2cd9afb3b4a tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] [instance: ea631032-dd04-429b-988e-e6362ea42cf7] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:56:55.942637 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-d5755a68-ac4b-492e-966e-d2cd9afb3b4a tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:55.943279 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-d5755a68-ac4b-492e-966e-d2cd9afb3b4a tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:55.943787 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-d5755a68-ac4b-492e-966e-d2cd9afb3b4a tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:55.944521 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-d5755a68-ac4b-492e-966e-d2cd9afb3b4a tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:55.945060 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-d5755a68-ac4b-492e-966e-d2cd9afb3b4a tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:55.945495 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-d5755a68-ac4b-492e-966e-d2cd9afb3b4a tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:56.074916 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-d5755a68-ac4b-492e-966e-d2cd9afb3b4a tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c1314c21d8547ff890ede1c2ad281c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c804370880454c7aa02cef2c2c3cf144', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:56:56.086669 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-d5755a68-ac4b-492e-966e-d2cd9afb3b4a tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c1314c21d8547ff890ede1c2ad281c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c804370880454c7aa02cef2c2c3cf144', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:56:56.089468 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-d5755a68-ac4b-492e-966e-d2cd9afb3b4a tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c1314c21d8547ff890ede1c2ad281c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c804370880454c7aa02cef2c2c3cf144', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:56:56.107074 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-d5755a68-ac4b-492e-966e-d2cd9afb3b4a tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] 10.222.0.13 "GET /compute/v2.1/servers/ea631032-dd04-429b-988e-e6362ea42cf7" status: 200 len: 1553 microversion: 2.91 time: 0.201468 Nov 01 18:56:56.112768 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 388/722] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 18:56:55 2022] GET /compute/v2.1/servers/ea631032-dd04-429b-988e-e6362ea42cf7 => generated 1553 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 18:56:56.157900 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-27657bc1-61ce-472d-9c35-2f7a23eb8576 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72117f17294649d6b8bc16c66c7efab2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45d4c047d3c44324a27a27831236ab0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:56:56.168974 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-27657bc1-61ce-472d-9c35-2f7a23eb8576 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] 10.222.0.13 "GET /compute/v2.1/servers/614eb691-9a9a-4ca0-933d-686d80cc0ef1" status: 200 len: 1469 microversion: 2.1 time: 0.388016 Nov 01 18:56:56.169554 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 335/723] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:56:55 2022] GET /compute/v2.1/servers/614eb691-9a9a-4ca0-933d-686d80cc0ef1 => generated 1469 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:56:56.193987 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-891f5996-9d9e-46f0-bfb4-3aea370000d0 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 18:56:56.194542 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-891f5996-9d9e-46f0-bfb4-3aea370000d0 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] [instance: 614eb691-9a9a-4ca0-933d-686d80cc0ef1] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:56:56.201259 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-891f5996-9d9e-46f0-bfb4-3aea370000d0 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:56.201816 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-891f5996-9d9e-46f0-bfb4-3aea370000d0 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:56.202553 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-891f5996-9d9e-46f0-bfb4-3aea370000d0 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:56.203180 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-891f5996-9d9e-46f0-bfb4-3aea370000d0 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:56.203694 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-891f5996-9d9e-46f0-bfb4-3aea370000d0 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:56.204133 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-891f5996-9d9e-46f0-bfb4-3aea370000d0 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:56.300029 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-891f5996-9d9e-46f0-bfb4-3aea370000d0 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] 10.222.0.13 "POST /compute/v2.1/servers/614eb691-9a9a-4ca0-933d-686d80cc0ef1/action" status: 204 len: 0 microversion: 2.1 time: 0.110834 Nov 01 18:56:56.303180 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 389/724] 10.222.0.13 () {60 vars in 1278 bytes} [Tue Nov 1 18:56:56 2022] POST /compute/v2.1/servers/614eb691-9a9a-4ca0-933d-686d80cc0ef1/action => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 01 18:56:56.311596 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-e0a56a61-9831-464e-b262-e7f804a13be3 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:56:56.312829 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-e0a56a61-9831-464e-b262-e7f804a13be3 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] [instance: 614eb691-9a9a-4ca0-933d-686d80cc0ef1] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:56:56.319905 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-e0a56a61-9831-464e-b262-e7f804a13be3 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:56.320811 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-e0a56a61-9831-464e-b262-e7f804a13be3 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:56.321473 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-e0a56a61-9831-464e-b262-e7f804a13be3 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:56.322494 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-e0a56a61-9831-464e-b262-e7f804a13be3 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:56.323195 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-e0a56a61-9831-464e-b262-e7f804a13be3 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:56.323834 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-e0a56a61-9831-464e-b262-e7f804a13be3 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:56.342611 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-2ee8b428-3f34-4db0-809a-fce57dcf55e8 tempest-ServerAddressesNegativeTestJSON-736278170 tempest-ServerAddressesNegativeTestJSON-736278170-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:56:56.343591 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-2ee8b428-3f34-4db0-809a-fce57dcf55e8 tempest-ServerAddressesNegativeTestJSON-736278170 tempest-ServerAddressesNegativeTestJSON-736278170-project] [instance: 034c1271-a323-4728-985c-3d70df31eeb2] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:56:56.361548 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2ee8b428-3f34-4db0-809a-fce57dcf55e8 tempest-ServerAddressesNegativeTestJSON-736278170 tempest-ServerAddressesNegativeTestJSON-736278170-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:56.362054 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2ee8b428-3f34-4db0-809a-fce57dcf55e8 tempest-ServerAddressesNegativeTestJSON-736278170 tempest-ServerAddressesNegativeTestJSON-736278170-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:56.363144 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2ee8b428-3f34-4db0-809a-fce57dcf55e8 tempest-ServerAddressesNegativeTestJSON-736278170 tempest-ServerAddressesNegativeTestJSON-736278170-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:56.365543 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2ee8b428-3f34-4db0-809a-fce57dcf55e8 tempest-ServerAddressesNegativeTestJSON-736278170 tempest-ServerAddressesNegativeTestJSON-736278170-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:56.366019 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2ee8b428-3f34-4db0-809a-fce57dcf55e8 tempest-ServerAddressesNegativeTestJSON-736278170 tempest-ServerAddressesNegativeTestJSON-736278170-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:56.366467 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2ee8b428-3f34-4db0-809a-fce57dcf55e8 tempest-ServerAddressesNegativeTestJSON-736278170 tempest-ServerAddressesNegativeTestJSON-736278170-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:56.787941 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-2ee8b428-3f34-4db0-809a-fce57dcf55e8 tempest-ServerAddressesNegativeTestJSON-736278170 tempest-ServerAddressesNegativeTestJSON-736278170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5a7d955d1004147b12eb569a7e7355a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d85b21bccf4bc78d4cbffd4f80357f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:56:56.815698 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-2ee8b428-3f34-4db0-809a-fce57dcf55e8 tempest-ServerAddressesNegativeTestJSON-736278170 tempest-ServerAddressesNegativeTestJSON-736278170-project] 10.222.0.13 "GET /compute/v2.1/servers/034c1271-a323-4728-985c-3d70df31eeb2" status: 200 len: 1325 microversion: 2.1 time: 0.479542 Nov 01 18:56:56.818057 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 390/725] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:56:56 2022] GET /compute/v2.1/servers/034c1271-a323-4728-985c-3d70df31eeb2 => generated 1325 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 18:56:56.852961 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-b114c08e-2c76-4ee7-a265-aa0879a609b3 tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:56:56.859015 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-b114c08e-2c76-4ee7-a265-aa0879a609b3 tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] [instance: 87679611-878a-49b2-bf8f-39e784c6d70b] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:56:56.904640 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b114c08e-2c76-4ee7-a265-aa0879a609b3 tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:56.909589 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b114c08e-2c76-4ee7-a265-aa0879a609b3 tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:56.909589 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b114c08e-2c76-4ee7-a265-aa0879a609b3 tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:56.910251 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b114c08e-2c76-4ee7-a265-aa0879a609b3 tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:56.911255 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b114c08e-2c76-4ee7-a265-aa0879a609b3 tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:56.920892 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b114c08e-2c76-4ee7-a265-aa0879a609b3 tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:57.026451 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-e0a56a61-9831-464e-b262-e7f804a13be3 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72117f17294649d6b8bc16c66c7efab2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45d4c047d3c44324a27a27831236ab0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:56:57.043479 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-e0a56a61-9831-464e-b262-e7f804a13be3 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] 10.222.0.13 "GET /compute/v2.1/servers/614eb691-9a9a-4ca0-933d-686d80cc0ef1" status: 200 len: 1469 microversion: 2.1 time: 0.735726 Nov 01 18:56:57.044105 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 336/726] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:56:56 2022] GET /compute/v2.1/servers/614eb691-9a9a-4ca0-933d-686d80cc0ef1 => generated 1469 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:56:57.056171 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [req-b3ccd186-659d-4ec9-ba3b-5c61e68d98af req-19a94d4f-a3a7-408c-9e74-1db1a282da18 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bee52bae-2df5-46a3-9aa9-f6b24bea11e3", "name": "network-vif-unplugged", "status": "completed", "tag": "8f917f95-25be-4ada-95ec-6e61439ce94b"}]} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 18:56:57.072441 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-b3ccd186-659d-4ec9-ba3b-5c61e68d98af req-19a94d4f-a3a7-408c-9e74-1db1a282da18 service nova] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:57.072951 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-b3ccd186-659d-4ec9-ba3b-5c61e68d98af req-19a94d4f-a3a7-408c-9e74-1db1a282da18 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:57.073380 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-b3ccd186-659d-4ec9-ba3b-5c61e68d98af req-19a94d4f-a3a7-408c-9e74-1db1a282da18 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:57.098948 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.compute.server_external_events [req-b3ccd186-659d-4ec9-ba3b-5c61e68d98af req-19a94d4f-a3a7-408c-9e74-1db1a282da18 service nova] Creating event network-vif-unplugged:8f917f95-25be-4ada-95ec-6e61439ce94b for instance bee52bae-2df5-46a3-9aa9-f6b24bea11e3 on n-h1-863052-2 Nov 01 18:56:57.108748 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [req-b3ccd186-659d-4ec9-ba3b-5c61e68d98af req-19a94d4f-a3a7-408c-9e74-1db1a282da18 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.063261 Nov 01 18:56:57.109363 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 337/727] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Nov 1 18:56:57 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 18:56:57.119847 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-b114c08e-2c76-4ee7-a265-aa0879a609b3 tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '576abe5db27b461889fef2029d477e40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e9fb3117f68434bae7a463c357818dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:56:57.127119 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-4fc24c4a-6bd8-4660-8531-7ce3397dff71 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:56:57.133036 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-b114c08e-2c76-4ee7-a265-aa0879a609b3 tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '576abe5db27b461889fef2029d477e40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e9fb3117f68434bae7a463c357818dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:56:57.134495 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-b114c08e-2c76-4ee7-a265-aa0879a609b3 tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '576abe5db27b461889fef2029d477e40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e9fb3117f68434bae7a463c357818dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:56:57.140849 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-4fc24c4a-6bd8-4660-8531-7ce3397dff71 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] [instance: 97de391d-c836-40ac-b126-0b6684406d52] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:56:57.164353 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-4fc24c4a-6bd8-4660-8531-7ce3397dff71 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:57.168638 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-b114c08e-2c76-4ee7-a265-aa0879a609b3 tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] 10.222.0.13 "GET /compute/v2.1/servers/87679611-878a-49b2-bf8f-39e784c6d70b" status: 200 len: 1447 microversion: 2.75 time: 0.341266 Nov 01 18:56:57.169406 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 391/728] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 18:56:56 2022] GET /compute/v2.1/servers/87679611-878a-49b2-bf8f-39e784c6d70b => generated 1447 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 18:56:57.170479 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-4fc24c4a-6bd8-4660-8531-7ce3397dff71 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:57.170998 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-4fc24c4a-6bd8-4660-8531-7ce3397dff71 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:57.171740 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-4fc24c4a-6bd8-4660-8531-7ce3397dff71 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:57.172212 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-4fc24c4a-6bd8-4660-8531-7ce3397dff71 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:57.172663 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-4fc24c4a-6bd8-4660-8531-7ce3397dff71 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:57.189133 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-78059fd6-1374-4c0c-95f8-8979ab177bf3 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:56:57.189907 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-78059fd6-1374-4c0c-95f8-8979ab177bf3 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] [instance: bee52bae-2df5-46a3-9aa9-f6b24bea11e3] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:56:57.211027 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-78059fd6-1374-4c0c-95f8-8979ab177bf3 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:57.211526 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-78059fd6-1374-4c0c-95f8-8979ab177bf3 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:57.211975 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-78059fd6-1374-4c0c-95f8-8979ab177bf3 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:57.212820 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-78059fd6-1374-4c0c-95f8-8979ab177bf3 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:57.213295 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-78059fd6-1374-4c0c-95f8-8979ab177bf3 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:57.213706 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-78059fd6-1374-4c0c-95f8-8979ab177bf3 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:57.218476 n-d-863052-2 devstack@n-api.service[121402]: DEBUG dbcounter [-] [121402] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 18:56:57.493275 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-78059fd6-1374-4c0c-95f8-8979ab177bf3 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:56:57.509911 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-78059fd6-1374-4c0c-95f8-8979ab177bf3 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:56:57.513364 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-78059fd6-1374-4c0c-95f8-8979ab177bf3 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:56:57.516204 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-78059fd6-1374-4c0c-95f8-8979ab177bf3 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] 10.222.0.13 "GET /compute/v2.1/servers/bee52bae-2df5-46a3-9aa9-f6b24bea11e3" status: 200 len: 1566 microversion: 2.25 time: 0.345769 Nov 01 18:56:57.528678 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 392/729] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 18:56:57 2022] GET /compute/v2.1/servers/bee52bae-2df5-46a3-9aa9-f6b24bea11e3 => generated 1566 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 18:56:57.536093 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-e7d5be97-3c66-4934-81ae-38b24b89f504 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:56:57.536875 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-e7d5be97-3c66-4934-81ae-38b24b89f504 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] [instance: ea631032-dd04-429b-988e-e6362ea42cf7] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:56:57.556219 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e7d5be97-3c66-4934-81ae-38b24b89f504 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:57.556783 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e7d5be97-3c66-4934-81ae-38b24b89f504 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:57.557215 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e7d5be97-3c66-4934-81ae-38b24b89f504 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:57.557941 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e7d5be97-3c66-4934-81ae-38b24b89f504 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:57.558405 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e7d5be97-3c66-4934-81ae-38b24b89f504 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:57.558842 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e7d5be97-3c66-4934-81ae-38b24b89f504 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:57.652966 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-4fc24c4a-6bd8-4660-8531-7ce3397dff71 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b52b7dcbb044f9bfc424e4417c77fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '708bc0ea4b5a4baf81933725792bedd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:56:57.661326 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-4fc24c4a-6bd8-4660-8531-7ce3397dff71 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] 10.222.0.13 "GET /compute/v2.1/servers/97de391d-c836-40ac-b126-0b6684406d52" status: 200 len: 1325 microversion: 2.1 time: 0.547798 Nov 01 18:56:57.661902 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 338/730] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:56:57 2022] GET /compute/v2.1/servers/97de391d-c836-40ac-b126-0b6684406d52 => generated 1325 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:56:57.679749 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-6901c0f2-6e62-4960-8249-0afb95cbab3a tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-1064528337", "imageRef": "2d4a0047-1b9e-445f-8af8-1b5c9d93e881", "flavorRef": "452", "networks": [{"uuid": "a490666d-5de7-4ec8-8f65-f4383cb45da6"}], "security_groups": [{"name": "tempest-securitygroup--1609122766"}], "key_name": "tempest-keypair-1346805597", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 18:56:57.683217 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-e7d5be97-3c66-4934-81ae-38b24b89f504 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c1314c21d8547ff890ede1c2ad281c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c804370880454c7aa02cef2c2c3cf144', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:56:57.693303 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-e7d5be97-3c66-4934-81ae-38b24b89f504 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c1314c21d8547ff890ede1c2ad281c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c804370880454c7aa02cef2c2c3cf144', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:56:57.695063 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-e7d5be97-3c66-4934-81ae-38b24b89f504 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c1314c21d8547ff890ede1c2ad281c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c804370880454c7aa02cef2c2c3cf144', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:56:57.701761 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-e7d5be97-3c66-4934-81ae-38b24b89f504 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] 10.222.0.13 "GET /compute/v2.1/servers/ea631032-dd04-429b-988e-e6362ea42cf7" status: 200 len: 1553 microversion: 2.91 time: 0.180772 Nov 01 18:56:57.707017 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 393/731] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 18:56:57 2022] GET /compute/v2.1/servers/ea631032-dd04-429b-988e-e6362ea42cf7 => generated 1553 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 18:56:57.841792 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-3930a321-b58f-4a8f-8070-668adcc0114f tempest-ServerAddressesNegativeTestJSON-736278170 tempest-ServerAddressesNegativeTestJSON-736278170-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:56:57.844193 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-3930a321-b58f-4a8f-8070-668adcc0114f tempest-ServerAddressesNegativeTestJSON-736278170 tempest-ServerAddressesNegativeTestJSON-736278170-project] [instance: 034c1271-a323-4728-985c-3d70df31eeb2] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:56:57.859895 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-3930a321-b58f-4a8f-8070-668adcc0114f tempest-ServerAddressesNegativeTestJSON-736278170 tempest-ServerAddressesNegativeTestJSON-736278170-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:57.861386 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-3930a321-b58f-4a8f-8070-668adcc0114f tempest-ServerAddressesNegativeTestJSON-736278170 tempest-ServerAddressesNegativeTestJSON-736278170-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:57.862184 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-3930a321-b58f-4a8f-8070-668adcc0114f tempest-ServerAddressesNegativeTestJSON-736278170 tempest-ServerAddressesNegativeTestJSON-736278170-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:57.863919 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-3930a321-b58f-4a8f-8070-668adcc0114f tempest-ServerAddressesNegativeTestJSON-736278170 tempest-ServerAddressesNegativeTestJSON-736278170-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:57.866433 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-3930a321-b58f-4a8f-8070-668adcc0114f tempest-ServerAddressesNegativeTestJSON-736278170 tempest-ServerAddressesNegativeTestJSON-736278170-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:57.868759 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-3930a321-b58f-4a8f-8070-668adcc0114f tempest-ServerAddressesNegativeTestJSON-736278170 tempest-ServerAddressesNegativeTestJSON-736278170-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:57.914275 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.network.neutron [None req-6901c0f2-6e62-4960-8249-0afb95cbab3a tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] validate_networks() for [('a490666d-5de7-4ec8-8f65-f4383cb45da6', None, None, None, None, None)] {{(pid=121403) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 01 18:56:58.081526 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-3930a321-b58f-4a8f-8070-668adcc0114f tempest-ServerAddressesNegativeTestJSON-736278170 tempest-ServerAddressesNegativeTestJSON-736278170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5a7d955d1004147b12eb569a7e7355a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d85b21bccf4bc78d4cbffd4f80357f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:56:58.094287 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-3930a321-b58f-4a8f-8070-668adcc0114f tempest-ServerAddressesNegativeTestJSON-736278170 tempest-ServerAddressesNegativeTestJSON-736278170-project] 10.222.0.13 "GET /compute/v2.1/servers/034c1271-a323-4728-985c-3d70df31eeb2" status: 200 len: 1325 microversion: 2.1 time: 0.257168 Nov 01 18:56:58.098658 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 394/732] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:56:57 2022] GET /compute/v2.1/servers/034c1271-a323-4728-985c-3d70df31eeb2 => generated 1325 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 18:56:58.109776 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [req-5068a2b8-9ec4-4971-8bf9-c428b2cfdb47 req-385f79f3-0c31-482e-8893-d1571b77dc28 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "034c1271-a323-4728-985c-3d70df31eeb2", "name": "network-vif-plugged", "status": "completed", "tag": "2b4443bc-cfe3-4140-a278-7c9306ec0e67"}]} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 18:56:58.126052 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-5068a2b8-9ec4-4971-8bf9-c428b2cfdb47 req-385f79f3-0c31-482e-8893-d1571b77dc28 service nova] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:58.126533 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-5068a2b8-9ec4-4971-8bf9-c428b2cfdb47 req-385f79f3-0c31-482e-8893-d1571b77dc28 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:58.126966 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-5068a2b8-9ec4-4971-8bf9-c428b2cfdb47 req-385f79f3-0c31-482e-8893-d1571b77dc28 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:58.146663 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.compute.server_external_events [req-5068a2b8-9ec4-4971-8bf9-c428b2cfdb47 req-385f79f3-0c31-482e-8893-d1571b77dc28 service nova] Creating event network-vif-plugged:2b4443bc-cfe3-4140-a278-7c9306ec0e67 for instance 034c1271-a323-4728-985c-3d70df31eeb2 on n-h2-863052-2 Nov 01 18:56:58.153519 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [req-5068a2b8-9ec4-4971-8bf9-c428b2cfdb47 req-385f79f3-0c31-482e-8893-d1571b77dc28 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053300 Nov 01 18:56:58.155588 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 395/733] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Nov 1 18:56:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 18:56:58.163877 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-4874b60c-559f-4636-bace-19cd92ffc369 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:56:58.177401 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-4874b60c-559f-4636-bace-19cd92ffc369 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] [instance: 614eb691-9a9a-4ca0-933d-686d80cc0ef1] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:56:58.199947 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-4874b60c-559f-4636-bace-19cd92ffc369 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:58.206654 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-4874b60c-559f-4636-bace-19cd92ffc369 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:58.210497 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-4874b60c-559f-4636-bace-19cd92ffc369 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:58.215022 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-4874b60c-559f-4636-bace-19cd92ffc369 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:58.215805 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-4874b60c-559f-4636-bace-19cd92ffc369 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:58.217100 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-4874b60c-559f-4636-bace-19cd92ffc369 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:58.391449 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-4874b60c-559f-4636-bace-19cd92ffc369 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72117f17294649d6b8bc16c66c7efab2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45d4c047d3c44324a27a27831236ab0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:56:58.401579 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-4874b60c-559f-4636-bace-19cd92ffc369 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] 10.222.0.13 "GET /compute/v2.1/servers/614eb691-9a9a-4ca0-933d-686d80cc0ef1" status: 200 len: 1469 microversion: 2.1 time: 0.244041 Nov 01 18:56:58.408023 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 396/734] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:56:58 2022] GET /compute/v2.1/servers/614eb691-9a9a-4ca0-933d-686d80cc0ef1 => generated 1469 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:56:58.415237 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-bd454419-1eaf-436d-878c-c50a89635718 tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:56:58.416661 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-bd454419-1eaf-436d-878c-c50a89635718 tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] [instance: 87679611-878a-49b2-bf8f-39e784c6d70b] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:56:58.423516 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-bd454419-1eaf-436d-878c-c50a89635718 tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:58.424313 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-bd454419-1eaf-436d-878c-c50a89635718 tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:58.425293 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-bd454419-1eaf-436d-878c-c50a89635718 tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:58.426280 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-bd454419-1eaf-436d-878c-c50a89635718 tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:58.427624 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-bd454419-1eaf-436d-878c-c50a89635718 tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:58.427624 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-bd454419-1eaf-436d-878c-c50a89635718 tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:58.508779 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-bd454419-1eaf-436d-878c-c50a89635718 tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '576abe5db27b461889fef2029d477e40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e9fb3117f68434bae7a463c357818dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:56:58.518331 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-bd454419-1eaf-436d-878c-c50a89635718 tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '576abe5db27b461889fef2029d477e40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e9fb3117f68434bae7a463c357818dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:56:58.520374 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-bd454419-1eaf-436d-878c-c50a89635718 tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '576abe5db27b461889fef2029d477e40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e9fb3117f68434bae7a463c357818dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:56:58.526131 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-bd454419-1eaf-436d-878c-c50a89635718 tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] 10.222.0.13 "GET /compute/v2.1/servers/87679611-878a-49b2-bf8f-39e784c6d70b" status: 200 len: 1447 microversion: 2.75 time: 0.116378 Nov 01 18:56:58.526916 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 397/735] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 18:56:58 2022] GET /compute/v2.1/servers/87679611-878a-49b2-bf8f-39e784c6d70b => generated 1447 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 18:56:58.547743 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-5a0d4439-c8ae-437c-9fda-fa5cf4b0170d tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:56:58.548744 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-5a0d4439-c8ae-437c-9fda-fa5cf4b0170d tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] [instance: bee52bae-2df5-46a3-9aa9-f6b24bea11e3] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:56:58.563712 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-5a0d4439-c8ae-437c-9fda-fa5cf4b0170d tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:58.564219 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-5a0d4439-c8ae-437c-9fda-fa5cf4b0170d tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:58.569453 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-5a0d4439-c8ae-437c-9fda-fa5cf4b0170d tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:58.571939 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-5a0d4439-c8ae-437c-9fda-fa5cf4b0170d tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:58.572558 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-5a0d4439-c8ae-437c-9fda-fa5cf4b0170d tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:58.577375 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-5a0d4439-c8ae-437c-9fda-fa5cf4b0170d tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:58.787703 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-5a0d4439-c8ae-437c-9fda-fa5cf4b0170d tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:56:58.800801 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-5a0d4439-c8ae-437c-9fda-fa5cf4b0170d tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:56:58.804922 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-5a0d4439-c8ae-437c-9fda-fa5cf4b0170d tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:56:58.809383 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-5a0d4439-c8ae-437c-9fda-fa5cf4b0170d tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] 10.222.0.13 "GET /compute/v2.1/servers/bee52bae-2df5-46a3-9aa9-f6b24bea11e3" status: 200 len: 1566 microversion: 2.25 time: 0.264145 Nov 01 18:56:58.825850 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 398/736] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 18:56:58 2022] GET /compute/v2.1/servers/bee52bae-2df5-46a3-9aa9-f6b24bea11e3 => generated 1566 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 01 18:56:58.839989 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-99c73d43-f17c-4712-9733-3b27a1b56c81 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:56:58.840624 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-99c73d43-f17c-4712-9733-3b27a1b56c81 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] [instance: 97de391d-c836-40ac-b126-0b6684406d52] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:56:58.848412 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-99c73d43-f17c-4712-9733-3b27a1b56c81 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:58.849092 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-99c73d43-f17c-4712-9733-3b27a1b56c81 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:58.852836 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-99c73d43-f17c-4712-9733-3b27a1b56c81 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:58.854958 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-99c73d43-f17c-4712-9733-3b27a1b56c81 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:58.855771 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-99c73d43-f17c-4712-9733-3b27a1b56c81 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:58.856538 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-99c73d43-f17c-4712-9733-3b27a1b56c81 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:59.021264 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-99c73d43-f17c-4712-9733-3b27a1b56c81 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b52b7dcbb044f9bfc424e4417c77fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '708bc0ea4b5a4baf81933725792bedd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:56:59.022481 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.virt.hardware [None req-6901c0f2-6e62-4960-8249-0afb95cbab3a tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Flavor limits 0:0:0 {{(pid=121403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 01 18:56:59.022956 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.virt.hardware [None req-6901c0f2-6e62-4960-8249-0afb95cbab3a tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Image limits 0:0:0 {{(pid=121403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 01 18:56:59.023363 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.virt.hardware [None req-6901c0f2-6e62-4960-8249-0afb95cbab3a tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Flavor pref 0:0:0 {{(pid=121403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 01 18:56:59.023948 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.virt.hardware [None req-6901c0f2-6e62-4960-8249-0afb95cbab3a tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Image pref 0:0:0 {{(pid=121403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 01 18:56:59.024361 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.virt.hardware [None req-6901c0f2-6e62-4960-8249-0afb95cbab3a tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 01 18:56:59.034422 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-6901c0f2-6e62-4960-8249-0afb95cbab3a tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:59.034902 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-6901c0f2-6e62-4960-8249-0afb95cbab3a tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:59.035327 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-6901c0f2-6e62-4960-8249-0afb95cbab3a tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:59.036925 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-6901c0f2-6e62-4960-8249-0afb95cbab3a tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:59.037596 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-6901c0f2-6e62-4960-8249-0afb95cbab3a tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:59.038276 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-6901c0f2-6e62-4960-8249-0afb95cbab3a tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:59.039516 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-99c73d43-f17c-4712-9733-3b27a1b56c81 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] 10.222.0.13 "GET /compute/v2.1/servers/97de391d-c836-40ac-b126-0b6684406d52" status: 200 len: 1325 microversion: 2.1 time: 0.212432 Nov 01 18:56:59.040286 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 399/737] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:56:58 2022] GET /compute/v2.1/servers/97de391d-c836-40ac-b126-0b6684406d52 => generated 1325 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:56:59.044849 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-603d1453-f0cf-4314-a972-d8111f7570dc tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:56:59.045199 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-603d1453-f0cf-4314-a972-d8111f7570dc tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] [instance: ea631032-dd04-429b-988e-e6362ea42cf7] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:56:59.054112 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-603d1453-f0cf-4314-a972-d8111f7570dc tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:59.054597 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-603d1453-f0cf-4314-a972-d8111f7570dc tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:59.055025 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-603d1453-f0cf-4314-a972-d8111f7570dc tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:59.055715 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-603d1453-f0cf-4314-a972-d8111f7570dc tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:59.056168 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-603d1453-f0cf-4314-a972-d8111f7570dc tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:59.056619 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-603d1453-f0cf-4314-a972-d8111f7570dc tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:59.064969 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.quota [None req-6901c0f2-6e62-4960-8249-0afb95cbab3a tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Getting quotas for project d9b9d4c236b944f9b2e8e502a50a8f8b. Resources: {'cores', 'ram', 'instances'} {{(pid=121403) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 01 18:56:59.072505 n-d-863052-2 devstack@n-api.service[121403]: DEBUG dbcounter [-] [121403] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=121403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 18:56:59.074107 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.quota [None req-6901c0f2-6e62-4960-8249-0afb95cbab3a tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Getting quotas for user f32f5fba1976432d938e664c7714e52b and project d9b9d4c236b944f9b2e8e502a50a8f8b. Resources: {'cores', 'ram', 'instances'} {{(pid=121403) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 01 18:56:59.090574 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-6901c0f2-6e62-4960-8249-0afb95cbab3a tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Going to run 1 instances... {{(pid=121403) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 01 18:56:59.093660 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-6901c0f2-6e62-4960-8249-0afb95cbab3a tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] [instance: 2d525a31-b0be-44cb-8fb7-335075145f08] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2d4a0047-1b9e-445f-8af8-1b5c9d93e881',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121403) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 01 18:56:59.141020 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-603d1453-f0cf-4314-a972-d8111f7570dc tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c1314c21d8547ff890ede1c2ad281c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c804370880454c7aa02cef2c2c3cf144', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:56:59.153324 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-603d1453-f0cf-4314-a972-d8111f7570dc tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c1314c21d8547ff890ede1c2ad281c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c804370880454c7aa02cef2c2c3cf144', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:56:59.154795 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-603d1453-f0cf-4314-a972-d8111f7570dc tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c1314c21d8547ff890ede1c2ad281c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c804370880454c7aa02cef2c2c3cf144', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:56:59.161656 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-603d1453-f0cf-4314-a972-d8111f7570dc tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] 10.222.0.13 "GET /compute/v2.1/servers/ea631032-dd04-429b-988e-e6362ea42cf7" status: 200 len: 1553 microversion: 2.91 time: 0.120416 Nov 01 18:56:59.168963 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-6901c0f2-6e62-4960-8249-0afb95cbab3a tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.505813 Nov 01 18:56:59.179561 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 339/738] 10.222.0.13 () {60 vars in 1147 bytes} [Tue Nov 1 18:56:57 2022] POST /compute/v2.1/servers => generated 406 bytes in 1517 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 01 18:56:59.188993 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-439dc0ca-cfab-4587-b3f8-f89841d68bf1 tempest-ServerAddressesNegativeTestJSON-736278170 tempest-ServerAddressesNegativeTestJSON-736278170-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:56:59.189856 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-439dc0ca-cfab-4587-b3f8-f89841d68bf1 tempest-ServerAddressesNegativeTestJSON-736278170 tempest-ServerAddressesNegativeTestJSON-736278170-project] [instance: 034c1271-a323-4728-985c-3d70df31eeb2] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:56:59.190119 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 400/739] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 18:56:59 2022] GET /compute/v2.1/servers/ea631032-dd04-429b-988e-e6362ea42cf7 => generated 1553 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 18:56:59.195161 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [req-5cd17757-5be0-42c4-956a-85dd3af7fa01 req-e3b2da9c-37e6-4f79-b7f0-1ded390c1537 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bee52bae-2df5-46a3-9aa9-f6b24bea11e3", "tag": "8f917f95-25be-4ada-95ec-6e61439ce94b"}]} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 18:56:59.201370 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-439dc0ca-cfab-4587-b3f8-f89841d68bf1 tempest-ServerAddressesNegativeTestJSON-736278170 tempest-ServerAddressesNegativeTestJSON-736278170-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:59.202146 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-439dc0ca-cfab-4587-b3f8-f89841d68bf1 tempest-ServerAddressesNegativeTestJSON-736278170 tempest-ServerAddressesNegativeTestJSON-736278170-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:59.202815 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-439dc0ca-cfab-4587-b3f8-f89841d68bf1 tempest-ServerAddressesNegativeTestJSON-736278170 tempest-ServerAddressesNegativeTestJSON-736278170-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:59.203709 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-439dc0ca-cfab-4587-b3f8-f89841d68bf1 tempest-ServerAddressesNegativeTestJSON-736278170 tempest-ServerAddressesNegativeTestJSON-736278170-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:59.204323 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-439dc0ca-cfab-4587-b3f8-f89841d68bf1 tempest-ServerAddressesNegativeTestJSON-736278170 tempest-ServerAddressesNegativeTestJSON-736278170-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:59.205700 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-439dc0ca-cfab-4587-b3f8-f89841d68bf1 tempest-ServerAddressesNegativeTestJSON-736278170 tempest-ServerAddressesNegativeTestJSON-736278170-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:59.227825 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-5cd17757-5be0-42c4-956a-85dd3af7fa01 req-e3b2da9c-37e6-4f79-b7f0-1ded390c1537 service nova] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:59.228449 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-5cd17757-5be0-42c4-956a-85dd3af7fa01 req-e3b2da9c-37e6-4f79-b7f0-1ded390c1537 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:59.229005 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-5cd17757-5be0-42c4-956a-85dd3af7fa01 req-e3b2da9c-37e6-4f79-b7f0-1ded390c1537 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:59.247087 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.compute.server_external_events [req-5cd17757-5be0-42c4-956a-85dd3af7fa01 req-e3b2da9c-37e6-4f79-b7f0-1ded390c1537 service nova] Creating event network-changed:8f917f95-25be-4ada-95ec-6e61439ce94b for instance bee52bae-2df5-46a3-9aa9-f6b24bea11e3 on n-h1-863052-2 Nov 01 18:56:59.254500 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [req-5cd17757-5be0-42c4-956a-85dd3af7fa01 req-e3b2da9c-37e6-4f79-b7f0-1ded390c1537 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062885 Nov 01 18:56:59.258568 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 401/740] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Nov 1 18:56:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 18:56:59.264242 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-8fb66b9a-9132-4a6f-b95f-788388e65a99 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:56:59.265112 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-8fb66b9a-9132-4a6f-b95f-788388e65a99 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] [instance: 2d525a31-b0be-44cb-8fb7-335075145f08] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:56:59.361019 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-8fb66b9a-9132-4a6f-b95f-788388e65a99 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f32f5fba1976432d938e664c7714e52b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b9d4c236b944f9b2e8e502a50a8f8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:56:59.372393 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-8fb66b9a-9132-4a6f-b95f-788388e65a99 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] 10.222.0.13 "GET /compute/v2.1/servers/2d525a31-b0be-44cb-8fb7-335075145f08" status: 200 len: 1235 microversion: 2.1 time: 0.112273 Nov 01 18:56:59.373252 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 402/741] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:56:59 2022] GET /compute/v2.1/servers/2d525a31-b0be-44cb-8fb7-335075145f08 => generated 1235 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:56:59.428062 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-fdfacef6-6497-4b57-bb34-09b67b90685e tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:56:59.428704 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-fdfacef6-6497-4b57-bb34-09b67b90685e tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] [instance: 614eb691-9a9a-4ca0-933d-686d80cc0ef1] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:56:59.435243 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-fdfacef6-6497-4b57-bb34-09b67b90685e tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:59.435742 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-fdfacef6-6497-4b57-bb34-09b67b90685e tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:59.436185 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-fdfacef6-6497-4b57-bb34-09b67b90685e tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:59.437264 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-fdfacef6-6497-4b57-bb34-09b67b90685e tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:59.437988 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-fdfacef6-6497-4b57-bb34-09b67b90685e tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:59.439040 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-fdfacef6-6497-4b57-bb34-09b67b90685e tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:59.499102 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-439dc0ca-cfab-4587-b3f8-f89841d68bf1 tempest-ServerAddressesNegativeTestJSON-736278170 tempest-ServerAddressesNegativeTestJSON-736278170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5a7d955d1004147b12eb569a7e7355a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d85b21bccf4bc78d4cbffd4f80357f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:56:59.507155 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-439dc0ca-cfab-4587-b3f8-f89841d68bf1 tempest-ServerAddressesNegativeTestJSON-736278170 tempest-ServerAddressesNegativeTestJSON-736278170-project] 10.222.0.13 "GET /compute/v2.1/servers/034c1271-a323-4728-985c-3d70df31eeb2" status: 200 len: 1325 microversion: 2.1 time: 0.325806 Nov 01 18:56:59.520607 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 340/742] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:56:59 2022] GET /compute/v2.1/servers/034c1271-a323-4728-985c-3d70df31eeb2 => generated 1325 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:56:59.559564 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-0f2e7cfa-e98b-4bc7-9a4a-7e67e5a8bd42 tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:56:59.560180 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-0f2e7cfa-e98b-4bc7-9a4a-7e67e5a8bd42 tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] [instance: 87679611-878a-49b2-bf8f-39e784c6d70b] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:56:59.573780 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-0f2e7cfa-e98b-4bc7-9a4a-7e67e5a8bd42 tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:59.574224 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-0f2e7cfa-e98b-4bc7-9a4a-7e67e5a8bd42 tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:59.576097 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-0f2e7cfa-e98b-4bc7-9a4a-7e67e5a8bd42 tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:59.576921 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-0f2e7cfa-e98b-4bc7-9a4a-7e67e5a8bd42 tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:59.578468 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-0f2e7cfa-e98b-4bc7-9a4a-7e67e5a8bd42 tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:59.580161 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-0f2e7cfa-e98b-4bc7-9a4a-7e67e5a8bd42 tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:59.769332 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-0f2e7cfa-e98b-4bc7-9a4a-7e67e5a8bd42 tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '576abe5db27b461889fef2029d477e40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e9fb3117f68434bae7a463c357818dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:56:59.781905 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-0f2e7cfa-e98b-4bc7-9a4a-7e67e5a8bd42 tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '576abe5db27b461889fef2029d477e40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e9fb3117f68434bae7a463c357818dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:56:59.783623 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-0f2e7cfa-e98b-4bc7-9a4a-7e67e5a8bd42 tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '576abe5db27b461889fef2029d477e40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e9fb3117f68434bae7a463c357818dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:56:59.814329 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-0f2e7cfa-e98b-4bc7-9a4a-7e67e5a8bd42 tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] 10.222.0.13 "GET /compute/v2.1/servers/87679611-878a-49b2-bf8f-39e784c6d70b" status: 200 len: 1447 microversion: 2.75 time: 0.261610 Nov 01 18:56:59.819058 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 341/743] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 18:56:59 2022] GET /compute/v2.1/servers/87679611-878a-49b2-bf8f-39e784c6d70b => generated 1447 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 01 18:56:59.847624 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-fbf08353-88e7-41a3-a873-eafb888a9691 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:56:59.849106 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-fbf08353-88e7-41a3-a873-eafb888a9691 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] [instance: bee52bae-2df5-46a3-9aa9-f6b24bea11e3] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:56:59.870412 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-fbf08353-88e7-41a3-a873-eafb888a9691 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:59.872125 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-fbf08353-88e7-41a3-a873-eafb888a9691 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:59.872571 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-fbf08353-88e7-41a3-a873-eafb888a9691 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:56:59.874041 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-fbf08353-88e7-41a3-a873-eafb888a9691 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:56:59.874506 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-fbf08353-88e7-41a3-a873-eafb888a9691 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:56:59.874934 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-fbf08353-88e7-41a3-a873-eafb888a9691 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:00.135250 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-fbf08353-88e7-41a3-a873-eafb888a9691 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:57:00.145350 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-fdfacef6-6497-4b57-bb34-09b67b90685e tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72117f17294649d6b8bc16c66c7efab2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45d4c047d3c44324a27a27831236ab0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:57:00.162331 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-fdfacef6-6497-4b57-bb34-09b67b90685e tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] 10.222.0.13 "GET /compute/v2.1/servers/614eb691-9a9a-4ca0-933d-686d80cc0ef1" status: 200 len: 1469 microversion: 2.1 time: 0.734951 Nov 01 18:57:00.163258 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 403/744] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:56:59 2022] GET /compute/v2.1/servers/614eb691-9a9a-4ca0-933d-686d80cc0ef1 => generated 1469 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:57:00.165518 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-fbf08353-88e7-41a3-a873-eafb888a9691 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:57:00.167852 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-fbf08353-88e7-41a3-a873-eafb888a9691 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:57:00.171337 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-fbf08353-88e7-41a3-a873-eafb888a9691 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] 10.222.0.13 "GET /compute/v2.1/servers/bee52bae-2df5-46a3-9aa9-f6b24bea11e3" status: 200 len: 1566 microversion: 2.25 time: 0.329988 Nov 01 18:57:00.173332 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 342/745] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 18:56:59 2022] GET /compute/v2.1/servers/bee52bae-2df5-46a3-9aa9-f6b24bea11e3 => generated 1566 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 18:57:00.178937 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-edb5aa45-b756-4ca1-afa0-d32fb3610294 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:57:00.181628 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-edb5aa45-b756-4ca1-afa0-d32fb3610294 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] [instance: 97de391d-c836-40ac-b126-0b6684406d52] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:57:00.196526 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-edb5aa45-b756-4ca1-afa0-d32fb3610294 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:00.197293 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-edb5aa45-b756-4ca1-afa0-d32fb3610294 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:00.198079 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-edb5aa45-b756-4ca1-afa0-d32fb3610294 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:00.198797 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-edb5aa45-b756-4ca1-afa0-d32fb3610294 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:00.200559 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-edb5aa45-b756-4ca1-afa0-d32fb3610294 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:00.202129 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-edb5aa45-b756-4ca1-afa0-d32fb3610294 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:00.205407 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-c30352dd-f8dd-4569-9880-96653f1dc929 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:57:00.211906 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-c30352dd-f8dd-4569-9880-96653f1dc929 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] [instance: ea631032-dd04-429b-988e-e6362ea42cf7] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:57:00.227501 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-c30352dd-f8dd-4569-9880-96653f1dc929 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:00.233818 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-c30352dd-f8dd-4569-9880-96653f1dc929 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:00.234582 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-c30352dd-f8dd-4569-9880-96653f1dc929 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:00.235947 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-c30352dd-f8dd-4569-9880-96653f1dc929 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:00.239953 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-c30352dd-f8dd-4569-9880-96653f1dc929 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:00.241224 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-c30352dd-f8dd-4569-9880-96653f1dc929 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:00.367244 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-c30352dd-f8dd-4569-9880-96653f1dc929 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c1314c21d8547ff890ede1c2ad281c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c804370880454c7aa02cef2c2c3cf144', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:57:00.376038 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-c30352dd-f8dd-4569-9880-96653f1dc929 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c1314c21d8547ff890ede1c2ad281c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c804370880454c7aa02cef2c2c3cf144', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:57:00.377609 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-c30352dd-f8dd-4569-9880-96653f1dc929 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c1314c21d8547ff890ede1c2ad281c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c804370880454c7aa02cef2c2c3cf144', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:57:00.385157 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-c30352dd-f8dd-4569-9880-96653f1dc929 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] 10.222.0.13 "GET /compute/v2.1/servers/ea631032-dd04-429b-988e-e6362ea42cf7" status: 200 len: 1553 microversion: 2.91 time: 0.189731 Nov 01 18:57:00.399242 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 343/746] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 18:57:00 2022] GET /compute/v2.1/servers/ea631032-dd04-429b-988e-e6362ea42cf7 => generated 1553 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 18:57:00.399242 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [req-9fe1bfd8-d025-4e38-b922-23d842c964b5 req-d5d51dbd-18d4-4093-a251-160d2d0918d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "614eb691-9a9a-4ca0-933d-686d80cc0ef1", "name": "network-vif-plugged", "status": "completed", "tag": "1c1a6351-a4fe-4a16-830e-df55738ac180"}, {"server_uuid": "97de391d-c836-40ac-b126-0b6684406d52", "name": "network-vif-plugged", "status": "completed", "tag": "7d838ab6-b291-4c63-b4a9-0e37df1c216f"}]} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 18:57:00.402247 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-9fe1bfd8-d025-4e38-b922-23d842c964b5 req-d5d51dbd-18d4-4093-a251-160d2d0918d1 service nova] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:00.402598 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-9fe1bfd8-d025-4e38-b922-23d842c964b5 req-d5d51dbd-18d4-4093-a251-160d2d0918d1 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:00.403130 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-9fe1bfd8-d025-4e38-b922-23d842c964b5 req-d5d51dbd-18d4-4093-a251-160d2d0918d1 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:00.425652 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.compute.server_external_events [req-9fe1bfd8-d025-4e38-b922-23d842c964b5 req-d5d51dbd-18d4-4093-a251-160d2d0918d1 service nova] Creating event network-vif-plugged:1c1a6351-a4fe-4a16-830e-df55738ac180 for instance 614eb691-9a9a-4ca0-933d-686d80cc0ef1 on n-h1-863052-2 Nov 01 18:57:00.426209 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.compute.server_external_events [req-9fe1bfd8-d025-4e38-b922-23d842c964b5 req-d5d51dbd-18d4-4093-a251-160d2d0918d1 service nova] Creating event network-vif-plugged:7d838ab6-b291-4c63-b4a9-0e37df1c216f for instance 97de391d-c836-40ac-b126-0b6684406d52 on n-h1-863052-2 Nov 01 18:57:00.442734 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [req-9fe1bfd8-d025-4e38-b922-23d842c964b5 req-d5d51dbd-18d4-4093-a251-160d2d0918d1 service nova] Instance 614eb691-9a9a-4ca0-933d-686d80cc0ef1 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-863052-2', 'n-h2-863052-2'} {{(pid=121403) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Nov 01 18:57:00.455791 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [req-9fe1bfd8-d025-4e38-b922-23d842c964b5 req-d5d51dbd-18d4-4093-a251-160d2d0918d1 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.068507 Nov 01 18:57:00.456795 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 344/747] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Nov 1 18:57:00 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 18:57:00.462355 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-b485286b-cd76-48fe-94ea-352fd6ad26d8 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:57:00.463060 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-b485286b-cd76-48fe-94ea-352fd6ad26d8 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] [instance: 2d525a31-b0be-44cb-8fb7-335075145f08] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:57:00.470315 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-b485286b-cd76-48fe-94ea-352fd6ad26d8 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:00.470806 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-b485286b-cd76-48fe-94ea-352fd6ad26d8 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:00.471247 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-b485286b-cd76-48fe-94ea-352fd6ad26d8 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:00.471951 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-b485286b-cd76-48fe-94ea-352fd6ad26d8 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:00.472431 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-b485286b-cd76-48fe-94ea-352fd6ad26d8 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:00.473471 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-b485286b-cd76-48fe-94ea-352fd6ad26d8 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:00.504603 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-edb5aa45-b756-4ca1-afa0-d32fb3610294 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b52b7dcbb044f9bfc424e4417c77fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '708bc0ea4b5a4baf81933725792bedd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:57:00.512664 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-edb5aa45-b756-4ca1-afa0-d32fb3610294 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] 10.222.0.13 "GET /compute/v2.1/servers/97de391d-c836-40ac-b126-0b6684406d52" status: 200 len: 1325 microversion: 2.1 time: 0.346741 Nov 01 18:57:00.515819 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 404/748] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:57:00 2022] GET /compute/v2.1/servers/97de391d-c836-40ac-b126-0b6684406d52 => generated 1325 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:57:00.541454 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-e25b02af-a2a8-4b40-af22-96629a85ad4e tempest-ServerAddressesNegativeTestJSON-736278170 tempest-ServerAddressesNegativeTestJSON-736278170-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:57:00.541454 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-e25b02af-a2a8-4b40-af22-96629a85ad4e tempest-ServerAddressesNegativeTestJSON-736278170 tempest-ServerAddressesNegativeTestJSON-736278170-project] [instance: 034c1271-a323-4728-985c-3d70df31eeb2] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:57:00.565084 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e25b02af-a2a8-4b40-af22-96629a85ad4e tempest-ServerAddressesNegativeTestJSON-736278170 tempest-ServerAddressesNegativeTestJSON-736278170-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:00.565553 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e25b02af-a2a8-4b40-af22-96629a85ad4e tempest-ServerAddressesNegativeTestJSON-736278170 tempest-ServerAddressesNegativeTestJSON-736278170-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:00.565994 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e25b02af-a2a8-4b40-af22-96629a85ad4e tempest-ServerAddressesNegativeTestJSON-736278170 tempest-ServerAddressesNegativeTestJSON-736278170-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:00.567261 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e25b02af-a2a8-4b40-af22-96629a85ad4e tempest-ServerAddressesNegativeTestJSON-736278170 tempest-ServerAddressesNegativeTestJSON-736278170-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:00.567704 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e25b02af-a2a8-4b40-af22-96629a85ad4e tempest-ServerAddressesNegativeTestJSON-736278170 tempest-ServerAddressesNegativeTestJSON-736278170-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:00.568142 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e25b02af-a2a8-4b40-af22-96629a85ad4e tempest-ServerAddressesNegativeTestJSON-736278170 tempest-ServerAddressesNegativeTestJSON-736278170-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:00.619689 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-b485286b-cd76-48fe-94ea-352fd6ad26d8 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f32f5fba1976432d938e664c7714e52b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b9d4c236b944f9b2e8e502a50a8f8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:57:00.631467 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-b485286b-cd76-48fe-94ea-352fd6ad26d8 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] 10.222.0.13 "GET /compute/v2.1/servers/2d525a31-b0be-44cb-8fb7-335075145f08" status: 200 len: 1231 microversion: 2.1 time: 0.172855 Nov 01 18:57:00.632061 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 345/749] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:57:00 2022] GET /compute/v2.1/servers/2d525a31-b0be-44cb-8fb7-335075145f08 => generated 1231 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:57:00.750686 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-e25b02af-a2a8-4b40-af22-96629a85ad4e tempest-ServerAddressesNegativeTestJSON-736278170 tempest-ServerAddressesNegativeTestJSON-736278170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5a7d955d1004147b12eb569a7e7355a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d85b21bccf4bc78d4cbffd4f80357f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:57:00.760939 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-e25b02af-a2a8-4b40-af22-96629a85ad4e tempest-ServerAddressesNegativeTestJSON-736278170 tempest-ServerAddressesNegativeTestJSON-736278170-project] 10.222.0.13 "GET /compute/v2.1/servers/034c1271-a323-4728-985c-3d70df31eeb2" status: 200 len: 1521 microversion: 2.1 time: 0.226027 Nov 01 18:57:00.762139 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 405/750] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:57:00 2022] GET /compute/v2.1/servers/034c1271-a323-4728-985c-3d70df31eeb2 => generated 1521 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 18:57:00.792929 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-ecef5dd1-1c2a-42b8-a610-d20d77ed7b5f tempest-ServerAddressesNegativeTestJSON-736278170 tempest-ServerAddressesNegativeTestJSON-736278170-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:57:00.793420 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-ecef5dd1-1c2a-42b8-a610-d20d77ed7b5f tempest-ServerAddressesNegativeTestJSON-736278170 tempest-ServerAddressesNegativeTestJSON-736278170-project] [instance: 034c1271-a323-4728-985c-3d70df31eeb2] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:57:00.805385 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-ecef5dd1-1c2a-42b8-a610-d20d77ed7b5f tempest-ServerAddressesNegativeTestJSON-736278170 tempest-ServerAddressesNegativeTestJSON-736278170-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:00.805935 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-ecef5dd1-1c2a-42b8-a610-d20d77ed7b5f tempest-ServerAddressesNegativeTestJSON-736278170 tempest-ServerAddressesNegativeTestJSON-736278170-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:00.806371 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-ecef5dd1-1c2a-42b8-a610-d20d77ed7b5f tempest-ServerAddressesNegativeTestJSON-736278170 tempest-ServerAddressesNegativeTestJSON-736278170-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:00.807071 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-ecef5dd1-1c2a-42b8-a610-d20d77ed7b5f tempest-ServerAddressesNegativeTestJSON-736278170 tempest-ServerAddressesNegativeTestJSON-736278170-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:00.807524 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-ecef5dd1-1c2a-42b8-a610-d20d77ed7b5f tempest-ServerAddressesNegativeTestJSON-736278170 tempest-ServerAddressesNegativeTestJSON-736278170-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:00.807973 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-ecef5dd1-1c2a-42b8-a610-d20d77ed7b5f tempest-ServerAddressesNegativeTestJSON-736278170 tempest-ServerAddressesNegativeTestJSON-736278170-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:00.852689 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-b89ab7c5-f093-4b1b-a2e2-3b2321179ce3 tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:57:00.853351 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-b89ab7c5-f093-4b1b-a2e2-3b2321179ce3 tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] [instance: 87679611-878a-49b2-bf8f-39e784c6d70b] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:57:00.869868 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.wsgi [None req-ecef5dd1-1c2a-42b8-a610-d20d77ed7b5f tempest-ServerAddressesNegativeTestJSON-736278170 tempest-ServerAddressesNegativeTestJSON-736278170-project] HTTP exception thrown: Instance is not a member of specified network Nov 01 18:57:00.870079 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b89ab7c5-f093-4b1b-a2e2-3b2321179ce3 tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:00.870826 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b89ab7c5-f093-4b1b-a2e2-3b2321179ce3 tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:00.873115 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b89ab7c5-f093-4b1b-a2e2-3b2321179ce3 tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:00.874383 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-ecef5dd1-1c2a-42b8-a610-d20d77ed7b5f tempest-ServerAddressesNegativeTestJSON-736278170 tempest-ServerAddressesNegativeTestJSON-736278170-project] Request method failure captured: Nov 01 18:57:00.874383 n-d-863052-2 devstack@n-api.service[121403]: request: GET /compute/v2.1/servers/034c1271-a323-4728-985c-3d70df31eeb2/ips/invalid HTTP/1.1 Nov 01 18:57:00.874383 n-d-863052-2 devstack@n-api.service[121403]: Accept: application/json Nov 01 18:57:00.874383 n-d-863052-2 devstack@n-api.service[121403]: Accept-Encoding: identity Nov 01 18:57:00.874383 n-d-863052-2 devstack@n-api.service[121403]: Connection: close Nov 01 18:57:00.874383 n-d-863052-2 devstack@n-api.service[121403]: Content-Length: 0 Nov 01 18:57:00.874383 n-d-863052-2 devstack@n-api.service[121403]: Content-Type: application/json Nov 01 18:57:00.874383 n-d-863052-2 devstack@n-api.service[121403]: Host: 10.222.0.13 Nov 01 18:57:00.874383 n-d-863052-2 devstack@n-api.service[121403]: Openstack-System-Scope: None Nov 01 18:57:00.874383 n-d-863052-2 devstack@n-api.service[121403]: User-Agent: python-urllib3/1.26.12 Nov 01 18:57:00.874383 n-d-863052-2 devstack@n-api.service[121403]: X-Auth-Token: gAAAAABjYWvnX2Zca5aLsN03WoIEudZ38cRl3Ae10mWd2d28YtRINDRAQM4pAPmkpFw8hgwXNchp-aFH63_nVvqiuUEZDy_ZLY1flmAgFN1rPzoQWKonIqlVwqFfLIyS9V4gYbYYm7AliJt7CHR_9jJNaOtaW1lGAQdNQOMkQPrI06CmhhcYvSE Nov 01 18:57:00.874383 n-d-863052-2 devstack@n-api.service[121403]: X-Domain-Id: None Nov 01 18:57:00.874383 n-d-863052-2 devstack@n-api.service[121403]: X-Domain-Name: None Nov 01 18:57:00.874383 n-d-863052-2 devstack@n-api.service[121403]: X-Identity-Status: Confirmed Nov 01 18:57:00.874383 n-d-863052-2 devstack@n-api.service[121403]: X-Is-Admin-Project: True Nov 01 18:57:00.874383 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Domain-Id: default Nov 01 18:57:00.874383 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Domain-Name: Default Nov 01 18:57:00.874383 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Id: 11d85b21bccf4bc78d4cbffd4f80357f Nov 01 18:57:00.874383 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-736278170 Nov 01 18:57:00.874383 n-d-863052-2 devstack@n-api.service[121403]: X-Role: member,reader Nov 01 18:57:00.874383 n-d-863052-2 devstack@n-api.service[121403]: X-Roles: member,reader Nov 01 18:57:00.875836 n-d-863052-2 devstack@n-api.service[121403]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/11d85b21bccf4bc78d4cbffd4f80357f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/11d85b21bccf4bc78d4cbffd4f80357f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_11d85b21bccf4bc78d4cbffd4f80357f", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/11d85b21bccf4bc78d4cbffd4f80357f"}]}] Nov 01 18:57:00.875836 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-736278170 Nov 01 18:57:00.875836 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant-Id: 11d85b21bccf4bc78d4cbffd4f80357f Nov 01 18:57:00.875836 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-736278170 Nov 01 18:57:00.875836 n-d-863052-2 devstack@n-api.service[121403]: X-User: tempest-ServerAddressesNegativeTestJSON-736278170-project Nov 01 18:57:00.875836 n-d-863052-2 devstack@n-api.service[121403]: X-User-Domain-Id: default Nov 01 18:57:00.875836 n-d-863052-2 devstack@n-api.service[121403]: X-User-Domain-Name: Default Nov 01 18:57:00.875836 n-d-863052-2 devstack@n-api.service[121403]: X-User-Id: a5a7d955d1004147b12eb569a7e7355a Nov 01 18:57:00.875836 n-d-863052-2 devstack@n-api.service[121403]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-736278170-project Nov 01 18:57:00.875836 n-d-863052-2 devstack@n-api.service[121403]: method: > Nov 01 18:57:00.875836 n-d-863052-2 devstack@n-api.service[121403]: exception: Instance is not a member of specified network Nov 01 18:57:00.875836 n-d-863052-2 devstack@n-api.service[121403]: action_args: {'server_id': '034c1271-a323-4728-985c-3d70df31eeb2', 'id': 'invalid'} Nov 01 18:57:00.876659 n-d-863052-2 devstack@n-api.service[121403]: {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 01 18:57:00.876659 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:57:00.876659 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 18:57:00.876659 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 18:57:00.876659 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 01 18:57:00.876659 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 01 18:57:00.876659 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 01 18:57:00.876659 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 01 18:57:00.876659 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/ips.py", line 52, in show Nov 01 18:57:00.876659 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Nov 01 18:57:00.876659 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance is not a member of specified network Nov 01 18:57:00.876659 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 18:57:00.876659 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 18:57:00.876659 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 18:57:00.876659 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:57:00.876659 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 18:57:00.876659 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 18:57:00.876659 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 01 18:57:00.876659 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 01 18:57:00.876659 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance is not a member of specified network Nov 01 18:57:00.876659 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 18:57:00.883711 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b89ab7c5-f093-4b1b-a2e2-3b2321179ce3 tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:00.885221 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b89ab7c5-f093-4b1b-a2e2-3b2321179ce3 tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:00.885863 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b89ab7c5-f093-4b1b-a2e2-3b2321179ce3 tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:00.886020 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-ecef5dd1-1c2a-42b8-a610-d20d77ed7b5f tempest-ServerAddressesNegativeTestJSON-736278170 tempest-ServerAddressesNegativeTestJSON-736278170-project] Returning 404 to user: Instance is not a member of specified network {{(pid=121403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 01 18:57:00.887006 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-ecef5dd1-1c2a-42b8-a610-d20d77ed7b5f tempest-ServerAddressesNegativeTestJSON-736278170 tempest-ServerAddressesNegativeTestJSON-736278170-project] 10.222.0.13 "GET /compute/v2.1/servers/034c1271-a323-4728-985c-3d70df31eeb2/ips/invalid" status: 404 len: 91 microversion: 2.1 time: 0.098687 Nov 01 18:57:00.891166 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 346/751] 10.222.0.13 () {58 vars in 1272 bytes} [Tue Nov 1 18:57:00 2022] GET /compute/v2.1/servers/034c1271-a323-4728-985c-3d70df31eeb2/ips/invalid => generated 91 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 01 18:57:00.908142 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-925f7bd8-2701-4e53-8344-1b9cc986d00f tempest-ServerAddressesNegativeTestJSON-736278170 tempest-ServerAddressesNegativeTestJSON-736278170-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:57:00.911285 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-925f7bd8-2701-4e53-8344-1b9cc986d00f tempest-ServerAddressesNegativeTestJSON-736278170 tempest-ServerAddressesNegativeTestJSON-736278170-project] Failed to fetch instance by id 999 {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2981}} Nov 01 18:57:00.911826 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.wsgi [None req-925f7bd8-2701-4e53-8344-1b9cc986d00f tempest-ServerAddressesNegativeTestJSON-736278170 tempest-ServerAddressesNegativeTestJSON-736278170-project] HTTP exception thrown: Instance 999 could not be found. Nov 01 18:57:00.920918 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-925f7bd8-2701-4e53-8344-1b9cc986d00f tempest-ServerAddressesNegativeTestJSON-736278170 tempest-ServerAddressesNegativeTestJSON-736278170-project] Request method failure captured: Nov 01 18:57:00.920918 n-d-863052-2 devstack@n-api.service[121403]: request: GET /compute/v2.1/servers/999/ips HTTP/1.1 Nov 01 18:57:00.920918 n-d-863052-2 devstack@n-api.service[121403]: Accept: application/json Nov 01 18:57:00.920918 n-d-863052-2 devstack@n-api.service[121403]: Accept-Encoding: identity Nov 01 18:57:00.920918 n-d-863052-2 devstack@n-api.service[121403]: Connection: close Nov 01 18:57:00.920918 n-d-863052-2 devstack@n-api.service[121403]: Content-Length: 0 Nov 01 18:57:00.920918 n-d-863052-2 devstack@n-api.service[121403]: Content-Type: application/json Nov 01 18:57:00.920918 n-d-863052-2 devstack@n-api.service[121403]: Host: 10.222.0.13 Nov 01 18:57:00.920918 n-d-863052-2 devstack@n-api.service[121403]: Openstack-System-Scope: None Nov 01 18:57:00.920918 n-d-863052-2 devstack@n-api.service[121403]: User-Agent: python-urllib3/1.26.12 Nov 01 18:57:00.920918 n-d-863052-2 devstack@n-api.service[121403]: X-Auth-Token: gAAAAABjYWvnX2Zca5aLsN03WoIEudZ38cRl3Ae10mWd2d28YtRINDRAQM4pAPmkpFw8hgwXNchp-aFH63_nVvqiuUEZDy_ZLY1flmAgFN1rPzoQWKonIqlVwqFfLIyS9V4gYbYYm7AliJt7CHR_9jJNaOtaW1lGAQdNQOMkQPrI06CmhhcYvSE Nov 01 18:57:00.920918 n-d-863052-2 devstack@n-api.service[121403]: X-Domain-Id: None Nov 01 18:57:00.920918 n-d-863052-2 devstack@n-api.service[121403]: X-Domain-Name: None Nov 01 18:57:00.920918 n-d-863052-2 devstack@n-api.service[121403]: X-Identity-Status: Confirmed Nov 01 18:57:00.920918 n-d-863052-2 devstack@n-api.service[121403]: X-Is-Admin-Project: True Nov 01 18:57:00.920918 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Domain-Id: default Nov 01 18:57:00.920918 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Domain-Name: Default Nov 01 18:57:00.920918 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Id: 11d85b21bccf4bc78d4cbffd4f80357f Nov 01 18:57:00.920918 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-736278170 Nov 01 18:57:00.920918 n-d-863052-2 devstack@n-api.service[121403]: X-Role: member,reader Nov 01 18:57:00.920918 n-d-863052-2 devstack@n-api.service[121403]: X-Roles: member,reader Nov 01 18:57:00.922319 n-d-863052-2 devstack@n-api.service[121403]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/11d85b21bccf4bc78d4cbffd4f80357f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/11d85b21bccf4bc78d4cbffd4f80357f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_11d85b21bccf4bc78d4cbffd4f80357f", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/11d85b21bccf4bc78d4cbffd4f80357f"}]}] Nov 01 18:57:00.922319 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-736278170 Nov 01 18:57:00.922319 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant-Id: 11d85b21bccf4bc78d4cbffd4f80357f Nov 01 18:57:00.922319 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-736278170 Nov 01 18:57:00.922319 n-d-863052-2 devstack@n-api.service[121403]: X-User: tempest-ServerAddressesNegativeTestJSON-736278170-project Nov 01 18:57:00.922319 n-d-863052-2 devstack@n-api.service[121403]: X-User-Domain-Id: default Nov 01 18:57:00.922319 n-d-863052-2 devstack@n-api.service[121403]: X-User-Domain-Name: Default Nov 01 18:57:00.922319 n-d-863052-2 devstack@n-api.service[121403]: X-User-Id: a5a7d955d1004147b12eb569a7e7355a Nov 01 18:57:00.922319 n-d-863052-2 devstack@n-api.service[121403]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-736278170-project Nov 01 18:57:00.922319 n-d-863052-2 devstack@n-api.service[121403]: method: > Nov 01 18:57:00.922319 n-d-863052-2 devstack@n-api.service[121403]: exception: Instance 999 could not be found. Nov 01 18:57:00.922319 n-d-863052-2 devstack@n-api.service[121403]: action_args: {'server_id': '999'} Nov 01 18:57:00.923078 n-d-863052-2 devstack@n-api.service[121403]: {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 01 18:57:00.923078 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:57:00.923078 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 01 18:57:00.923078 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 01 18:57:00.923078 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Nov 01 18:57:00.923078 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Nov 01 18:57:00.923078 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 999 could not be found. Nov 01 18:57:00.923078 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 18:57:00.923078 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 18:57:00.923078 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 18:57:00.923078 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:57:00.923078 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 18:57:00.923078 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 18:57:00.923078 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 01 18:57:00.923078 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 01 18:57:00.923078 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 01 18:57:00.923078 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 01 18:57:00.923078 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/ips.py", line 37, in index Nov 01 18:57:00.923078 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self._compute_api, context, server_id) Nov 01 18:57:00.923078 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 01 18:57:00.924257 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 01 18:57:00.924257 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 999 could not be found. Nov 01 18:57:00.924257 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 18:57:00.924257 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 18:57:00.924257 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 18:57:00.924257 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:57:00.924257 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 18:57:00.924257 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 18:57:00.924257 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 01 18:57:00.924257 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 01 18:57:00.924257 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 999 could not be found. Nov 01 18:57:00.924257 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 18:57:00.924257 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-925f7bd8-2701-4e53-8344-1b9cc986d00f tempest-ServerAddressesNegativeTestJSON-736278170 tempest-ServerAddressesNegativeTestJSON-736278170-project] Returning 404 to user: Instance 999 could not be found. {{(pid=121403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 01 18:57:00.924257 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-925f7bd8-2701-4e53-8344-1b9cc986d00f tempest-ServerAddressesNegativeTestJSON-736278170 tempest-ServerAddressesNegativeTestJSON-736278170-project] 10.222.0.13 "GET /compute/v2.1/servers/999/ips" status: 404 len: 78 microversion: 2.1 time: 0.023898 Nov 01 18:57:00.928697 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 347/752] 10.222.0.13 () {58 vars in 1149 bytes} [Tue Nov 1 18:57:00 2022] GET /compute/v2.1/servers/999/ips => generated 78 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 01 18:57:00.935479 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-a295d5d0-0088-4beb-8696-a23842dc0d48 tempest-ServerAddressesNegativeTestJSON-736278170 tempest-ServerAddressesNegativeTestJSON-736278170-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:57:00.935479 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-a295d5d0-0088-4beb-8696-a23842dc0d48 tempest-ServerAddressesNegativeTestJSON-736278170 tempest-ServerAddressesNegativeTestJSON-736278170-project] [instance: 034c1271-a323-4728-985c-3d70df31eeb2] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:57:00.948533 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-a295d5d0-0088-4beb-8696-a23842dc0d48 tempest-ServerAddressesNegativeTestJSON-736278170 tempest-ServerAddressesNegativeTestJSON-736278170-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:00.951920 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-a295d5d0-0088-4beb-8696-a23842dc0d48 tempest-ServerAddressesNegativeTestJSON-736278170 tempest-ServerAddressesNegativeTestJSON-736278170-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:00.952713 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-a295d5d0-0088-4beb-8696-a23842dc0d48 tempest-ServerAddressesNegativeTestJSON-736278170 tempest-ServerAddressesNegativeTestJSON-736278170-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:00.953652 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-a295d5d0-0088-4beb-8696-a23842dc0d48 tempest-ServerAddressesNegativeTestJSON-736278170 tempest-ServerAddressesNegativeTestJSON-736278170-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:00.954394 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-a295d5d0-0088-4beb-8696-a23842dc0d48 tempest-ServerAddressesNegativeTestJSON-736278170 tempest-ServerAddressesNegativeTestJSON-736278170-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:00.954862 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-a295d5d0-0088-4beb-8696-a23842dc0d48 tempest-ServerAddressesNegativeTestJSON-736278170 tempest-ServerAddressesNegativeTestJSON-736278170-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:00.993911 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-a295d5d0-0088-4beb-8696-a23842dc0d48 tempest-ServerAddressesNegativeTestJSON-736278170 tempest-ServerAddressesNegativeTestJSON-736278170-project] [instance: 034c1271-a323-4728-985c-3d70df31eeb2] Going to try to terminate instance {{(pid=121403) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 01 18:57:00.997393 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-b89ab7c5-f093-4b1b-a2e2-3b2321179ce3 tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '576abe5db27b461889fef2029d477e40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e9fb3117f68434bae7a463c357818dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:57:01.015730 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-b89ab7c5-f093-4b1b-a2e2-3b2321179ce3 tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '576abe5db27b461889fef2029d477e40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e9fb3117f68434bae7a463c357818dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:57:01.017518 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-b89ab7c5-f093-4b1b-a2e2-3b2321179ce3 tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '576abe5db27b461889fef2029d477e40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e9fb3117f68434bae7a463c357818dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:57:01.024017 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-b89ab7c5-f093-4b1b-a2e2-3b2321179ce3 tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] 10.222.0.13 "GET /compute/v2.1/servers/87679611-878a-49b2-bf8f-39e784c6d70b" status: 200 len: 1447 microversion: 2.75 time: 0.176779 Nov 01 18:57:01.024550 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 406/753] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 18:57:00 2022] GET /compute/v2.1/servers/87679611-878a-49b2-bf8f-39e784c6d70b => generated 1447 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 01 18:57:01.113505 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-a295d5d0-0088-4beb-8696-a23842dc0d48 tempest-ServerAddressesNegativeTestJSON-736278170 tempest-ServerAddressesNegativeTestJSON-736278170-project] 10.222.0.13 "DELETE /compute/v2.1/servers/034c1271-a323-4728-985c-3d70df31eeb2" status: 204 len: 0 microversion: 2.1 time: 0.183501 Nov 01 18:57:01.115438 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 348/754] 10.222.0.13 () {58 vars in 1239 bytes} [Tue Nov 1 18:57:00 2022] DELETE /compute/v2.1/servers/034c1271-a323-4728-985c-3d70df31eeb2 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 01 18:57:01.123479 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-fa377eca-20b1-44bc-8c91-e7bf9860546d tempest-ServerAddressesNegativeTestJSON-736278170 tempest-ServerAddressesNegativeTestJSON-736278170-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:57:01.124103 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-fa377eca-20b1-44bc-8c91-e7bf9860546d tempest-ServerAddressesNegativeTestJSON-736278170 tempest-ServerAddressesNegativeTestJSON-736278170-project] [instance: 034c1271-a323-4728-985c-3d70df31eeb2] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:57:01.130417 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-fa377eca-20b1-44bc-8c91-e7bf9860546d tempest-ServerAddressesNegativeTestJSON-736278170 tempest-ServerAddressesNegativeTestJSON-736278170-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:01.131230 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-fa377eca-20b1-44bc-8c91-e7bf9860546d tempest-ServerAddressesNegativeTestJSON-736278170 tempest-ServerAddressesNegativeTestJSON-736278170-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:01.131948 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-fa377eca-20b1-44bc-8c91-e7bf9860546d tempest-ServerAddressesNegativeTestJSON-736278170 tempest-ServerAddressesNegativeTestJSON-736278170-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:01.133209 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-fa377eca-20b1-44bc-8c91-e7bf9860546d tempest-ServerAddressesNegativeTestJSON-736278170 tempest-ServerAddressesNegativeTestJSON-736278170-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:01.133902 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-fa377eca-20b1-44bc-8c91-e7bf9860546d tempest-ServerAddressesNegativeTestJSON-736278170 tempest-ServerAddressesNegativeTestJSON-736278170-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:01.134538 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-fa377eca-20b1-44bc-8c91-e7bf9860546d tempest-ServerAddressesNegativeTestJSON-736278170 tempest-ServerAddressesNegativeTestJSON-736278170-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:01.190090 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-49ec3e51-406f-4091-a0b9-824a75ddc2ce tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:57:01.190866 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-49ec3e51-406f-4091-a0b9-824a75ddc2ce tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] [instance: 614eb691-9a9a-4ca0-933d-686d80cc0ef1] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:57:01.201415 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-49ec3e51-406f-4091-a0b9-824a75ddc2ce tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:01.204180 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-49ec3e51-406f-4091-a0b9-824a75ddc2ce tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:01.205598 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-49ec3e51-406f-4091-a0b9-824a75ddc2ce tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:01.209235 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-49ec3e51-406f-4091-a0b9-824a75ddc2ce tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:01.210591 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-49ec3e51-406f-4091-a0b9-824a75ddc2ce tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:01.211314 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-49ec3e51-406f-4091-a0b9-824a75ddc2ce tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:01.298450 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-fa377eca-20b1-44bc-8c91-e7bf9860546d tempest-ServerAddressesNegativeTestJSON-736278170 tempest-ServerAddressesNegativeTestJSON-736278170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5a7d955d1004147b12eb569a7e7355a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d85b21bccf4bc78d4cbffd4f80357f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:57:01.307812 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-fa377eca-20b1-44bc-8c91-e7bf9860546d tempest-ServerAddressesNegativeTestJSON-736278170 tempest-ServerAddressesNegativeTestJSON-736278170-project] 10.222.0.13 "GET /compute/v2.1/servers/034c1271-a323-4728-985c-3d70df31eeb2" status: 200 len: 1527 microversion: 2.1 time: 0.188284 Nov 01 18:57:01.309097 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 407/755] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:57:01 2022] GET /compute/v2.1/servers/034c1271-a323-4728-985c-3d70df31eeb2 => generated 1527 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:57:01.320301 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-7e55be03-1fb9-4ba9-ac6c-7b1e0c79155f tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:57:01.321634 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-7e55be03-1fb9-4ba9-ac6c-7b1e0c79155f tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] [instance: bee52bae-2df5-46a3-9aa9-f6b24bea11e3] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:57:01.337076 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-7e55be03-1fb9-4ba9-ac6c-7b1e0c79155f tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:01.337937 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-7e55be03-1fb9-4ba9-ac6c-7b1e0c79155f tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:01.338630 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-7e55be03-1fb9-4ba9-ac6c-7b1e0c79155f tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:01.339649 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-7e55be03-1fb9-4ba9-ac6c-7b1e0c79155f tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:01.340346 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-7e55be03-1fb9-4ba9-ac6c-7b1e0c79155f tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:01.341361 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-7e55be03-1fb9-4ba9-ac6c-7b1e0c79155f tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:01.511385 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-49ec3e51-406f-4091-a0b9-824a75ddc2ce tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72117f17294649d6b8bc16c66c7efab2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45d4c047d3c44324a27a27831236ab0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:57:01.522127 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-49ec3e51-406f-4091-a0b9-824a75ddc2ce tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] 10.222.0.13 "GET /compute/v2.1/servers/614eb691-9a9a-4ca0-933d-686d80cc0ef1" status: 200 len: 1461 microversion: 2.1 time: 0.336428 Nov 01 18:57:01.524347 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 349/756] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:57:01 2022] GET /compute/v2.1/servers/614eb691-9a9a-4ca0-933d-686d80cc0ef1 => generated 1461 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:57:01.529135 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-36dc9620-d973-493e-8108-871b91b2d47d tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:57:01.529938 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-36dc9620-d973-493e-8108-871b91b2d47d tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] [instance: ea631032-dd04-429b-988e-e6362ea42cf7] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:57:01.537991 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-36dc9620-d973-493e-8108-871b91b2d47d tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:01.538716 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-36dc9620-d973-493e-8108-871b91b2d47d tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:01.539147 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-36dc9620-d973-493e-8108-871b91b2d47d tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:01.539848 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-36dc9620-d973-493e-8108-871b91b2d47d tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:01.540519 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-36dc9620-d973-493e-8108-871b91b2d47d tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:01.540975 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-36dc9620-d973-493e-8108-871b91b2d47d tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:01.552243 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-7e55be03-1fb9-4ba9-ac6c-7b1e0c79155f tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:57:01.561981 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-7e55be03-1fb9-4ba9-ac6c-7b1e0c79155f tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:57:01.564826 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-7e55be03-1fb9-4ba9-ac6c-7b1e0c79155f tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:57:01.566101 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-7e55be03-1fb9-4ba9-ac6c-7b1e0c79155f tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] 10.222.0.13 "GET /compute/v2.1/servers/bee52bae-2df5-46a3-9aa9-f6b24bea11e3" status: 200 len: 1566 microversion: 2.25 time: 0.254750 Nov 01 18:57:01.571534 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 408/757] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 18:57:01 2022] GET /compute/v2.1/servers/bee52bae-2df5-46a3-9aa9-f6b24bea11e3 => generated 1566 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 18:57:01.572138 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-3758b43b-19b1-4fc2-b20d-470857ca35bd tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:57:01.572807 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-3758b43b-19b1-4fc2-b20d-470857ca35bd tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] [instance: 97de391d-c836-40ac-b126-0b6684406d52] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:57:01.579330 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-3758b43b-19b1-4fc2-b20d-470857ca35bd tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:01.579839 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-3758b43b-19b1-4fc2-b20d-470857ca35bd tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:01.580283 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-3758b43b-19b1-4fc2-b20d-470857ca35bd tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:01.581597 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-3758b43b-19b1-4fc2-b20d-470857ca35bd tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:01.581597 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-3758b43b-19b1-4fc2-b20d-470857ca35bd tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:01.581939 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-3758b43b-19b1-4fc2-b20d-470857ca35bd tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:01.790501 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-3758b43b-19b1-4fc2-b20d-470857ca35bd tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b52b7dcbb044f9bfc424e4417c77fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '708bc0ea4b5a4baf81933725792bedd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:57:01.790501 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-3758b43b-19b1-4fc2-b20d-470857ca35bd tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] 10.222.0.13 "GET /compute/v2.1/servers/97de391d-c836-40ac-b126-0b6684406d52" status: 200 len: 1325 microversion: 2.1 time: 0.221574 Nov 01 18:57:01.797114 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 409/758] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:57:01 2022] GET /compute/v2.1/servers/97de391d-c836-40ac-b126-0b6684406d52 => generated 1325 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:57:01.802313 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-7e996020-3a3d-425b-aa9c-90eb1fd6f1ff tempest-MigrationsAdminTest-1970194929 tempest-MigrationsAdminTest-1970194929-project-admin] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:57:01.802937 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-7e996020-3a3d-425b-aa9c-90eb1fd6f1ff tempest-MigrationsAdminTest-1970194929 tempest-MigrationsAdminTest-1970194929-project-admin] [instance: 614eb691-9a9a-4ca0-933d-686d80cc0ef1] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:57:01.813117 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-7e996020-3a3d-425b-aa9c-90eb1fd6f1ff tempest-MigrationsAdminTest-1970194929 tempest-MigrationsAdminTest-1970194929-project-admin] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:01.813681 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-7e996020-3a3d-425b-aa9c-90eb1fd6f1ff tempest-MigrationsAdminTest-1970194929 tempest-MigrationsAdminTest-1970194929-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:01.814068 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-36dc9620-d973-493e-8108-871b91b2d47d tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c1314c21d8547ff890ede1c2ad281c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c804370880454c7aa02cef2c2c3cf144', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:57:01.814234 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-7e996020-3a3d-425b-aa9c-90eb1fd6f1ff tempest-MigrationsAdminTest-1970194929 tempest-MigrationsAdminTest-1970194929-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:01.815359 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-7e996020-3a3d-425b-aa9c-90eb1fd6f1ff tempest-MigrationsAdminTest-1970194929 tempest-MigrationsAdminTest-1970194929-project-admin] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:01.816125 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-7e996020-3a3d-425b-aa9c-90eb1fd6f1ff tempest-MigrationsAdminTest-1970194929 tempest-MigrationsAdminTest-1970194929-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:01.816612 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-7e996020-3a3d-425b-aa9c-90eb1fd6f1ff tempest-MigrationsAdminTest-1970194929 tempest-MigrationsAdminTest-1970194929-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:01.822335 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-36dc9620-d973-493e-8108-871b91b2d47d tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c1314c21d8547ff890ede1c2ad281c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c804370880454c7aa02cef2c2c3cf144', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:57:01.824044 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-36dc9620-d973-493e-8108-871b91b2d47d tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c1314c21d8547ff890ede1c2ad281c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c804370880454c7aa02cef2c2c3cf144', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:57:01.829041 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-36dc9620-d973-493e-8108-871b91b2d47d tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] 10.222.0.13 "GET /compute/v2.1/servers/ea631032-dd04-429b-988e-e6362ea42cf7" status: 200 len: 1553 microversion: 2.91 time: 0.303438 Nov 01 18:57:01.840609 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 350/759] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 18:57:01 2022] GET /compute/v2.1/servers/ea631032-dd04-429b-988e-e6362ea42cf7 => generated 1553 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 18:57:01.840609 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-66fade43-6eb9-4b15-a1e8-72cd44771505 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:57:01.840609 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-66fade43-6eb9-4b15-a1e8-72cd44771505 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] [instance: 2d525a31-b0be-44cb-8fb7-335075145f08] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:57:01.856619 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-66fade43-6eb9-4b15-a1e8-72cd44771505 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:01.856619 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-66fade43-6eb9-4b15-a1e8-72cd44771505 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:01.856619 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-66fade43-6eb9-4b15-a1e8-72cd44771505 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:01.856619 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-66fade43-6eb9-4b15-a1e8-72cd44771505 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:01.857129 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-66fade43-6eb9-4b15-a1e8-72cd44771505 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:01.857129 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-66fade43-6eb9-4b15-a1e8-72cd44771505 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:01.876466 n-d-863052-2 devstack@n-api.service[121403]: DEBUG dbcounter [-] [121403] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 18:57:01.927616 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-66fade43-6eb9-4b15-a1e8-72cd44771505 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f32f5fba1976432d938e664c7714e52b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b9d4c236b944f9b2e8e502a50a8f8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:57:01.936463 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-66fade43-6eb9-4b15-a1e8-72cd44771505 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] 10.222.0.13 "GET /compute/v2.1/servers/2d525a31-b0be-44cb-8fb7-335075145f08" status: 200 len: 1287 microversion: 2.1 time: 0.105841 Nov 01 18:57:01.937061 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 351/760] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:57:01 2022] GET /compute/v2.1/servers/2d525a31-b0be-44cb-8fb7-335075145f08 => generated 1287 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:57:02.004621 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-7e996020-3a3d-425b-aa9c-90eb1fd6f1ff tempest-MigrationsAdminTest-1970194929 tempest-MigrationsAdminTest-1970194929-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/614eb691-9a9a-4ca0-933d-686d80cc0ef1" status: 200 len: 1612 microversion: 2.1 time: 0.205768 Nov 01 18:57:02.005946 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 410/761] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:57:01 2022] GET /compute/v2.1/servers/614eb691-9a9a-4ca0-933d-686d80cc0ef1 => generated 1612 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:57:02.041207 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-12c04a5e-ccd1-4084-b827-a868dc9b2510 tempest-MigrationsAdminTest-1970194929 tempest-MigrationsAdminTest-1970194929-project-admin] Calling method '.version_select at 0x7f0ae282ae50>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:57:02.047984 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-12c04a5e-ccd1-4084-b827-a868dc9b2510 tempest-MigrationsAdminTest-1970194929 tempest-MigrationsAdminTest-1970194929-project-admin] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:02.048551 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-12c04a5e-ccd1-4084-b827-a868dc9b2510 tempest-MigrationsAdminTest-1970194929 tempest-MigrationsAdminTest-1970194929-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:02.049028 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-12c04a5e-ccd1-4084-b827-a868dc9b2510 tempest-MigrationsAdminTest-1970194929 tempest-MigrationsAdminTest-1970194929-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:02.051903 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-77d8cd0d-2007-42c5-9608-92513aa1043e tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:57:02.052500 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-77d8cd0d-2007-42c5-9608-92513aa1043e tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] [instance: 87679611-878a-49b2-bf8f-39e784c6d70b] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:57:02.059799 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-77d8cd0d-2007-42c5-9608-92513aa1043e tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:02.061951 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-12c04a5e-ccd1-4084-b827-a868dc9b2510 tempest-MigrationsAdminTest-1970194929 tempest-MigrationsAdminTest-1970194929-project-admin] 10.222.0.13 "GET /compute/v2.1/os-migrations" status: 200 len: 1943 microversion: 2.1 time: 0.024528 Nov 01 18:57:02.063000 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-77d8cd0d-2007-42c5-9608-92513aa1043e tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:02.063727 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-77d8cd0d-2007-42c5-9608-92513aa1043e tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:02.064812 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-77d8cd0d-2007-42c5-9608-92513aa1043e tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:02.065565 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-77d8cd0d-2007-42c5-9608-92513aa1043e tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:02.066360 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-77d8cd0d-2007-42c5-9608-92513aa1043e tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:02.072971 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 352/762] 10.222.0.13 () {58 vars in 1143 bytes} [Tue Nov 1 18:57:02 2022] GET /compute/v2.1/os-migrations => generated 1943 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:57:02.073135 n-d-863052-2 devstack@n-api.service[121402]: DEBUG dbcounter [-] [121402] Writing DB stats nova_cell1:SELECT=100 {{(pid=121402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 18:57:02.181337 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-77d8cd0d-2007-42c5-9608-92513aa1043e tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '576abe5db27b461889fef2029d477e40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e9fb3117f68434bae7a463c357818dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:57:02.193857 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-77d8cd0d-2007-42c5-9608-92513aa1043e tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '576abe5db27b461889fef2029d477e40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e9fb3117f68434bae7a463c357818dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:57:02.197200 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-77d8cd0d-2007-42c5-9608-92513aa1043e tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '576abe5db27b461889fef2029d477e40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e9fb3117f68434bae7a463c357818dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:57:02.205930 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-77d8cd0d-2007-42c5-9608-92513aa1043e tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] 10.222.0.13 "GET /compute/v2.1/servers/87679611-878a-49b2-bf8f-39e784c6d70b" status: 200 len: 1447 microversion: 2.75 time: 0.157465 Nov 01 18:57:02.206780 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 411/763] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 18:57:02 2022] GET /compute/v2.1/servers/87679611-878a-49b2-bf8f-39e784c6d70b => generated 1447 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 01 18:57:02.283776 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-1c0ac3a6-34e5-415b-ae36-4b2bfef50601 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-716790399", "imageRef": "2d4a0047-1b9e-445f-8af8-1b5c9d93e881", "flavorRef": "452"}} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 18:57:02.340644 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-16dab767-c27b-4d69-8f71-db850ac68435 tempest-ServerAddressesNegativeTestJSON-736278170 tempest-ServerAddressesNegativeTestJSON-736278170-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:57:02.341247 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-16dab767-c27b-4d69-8f71-db850ac68435 tempest-ServerAddressesNegativeTestJSON-736278170 tempest-ServerAddressesNegativeTestJSON-736278170-project] [instance: 034c1271-a323-4728-985c-3d70df31eeb2] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:57:02.359116 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-16dab767-c27b-4d69-8f71-db850ac68435 tempest-ServerAddressesNegativeTestJSON-736278170 tempest-ServerAddressesNegativeTestJSON-736278170-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:02.361414 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-16dab767-c27b-4d69-8f71-db850ac68435 tempest-ServerAddressesNegativeTestJSON-736278170 tempest-ServerAddressesNegativeTestJSON-736278170-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:02.363469 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-16dab767-c27b-4d69-8f71-db850ac68435 tempest-ServerAddressesNegativeTestJSON-736278170 tempest-ServerAddressesNegativeTestJSON-736278170-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:02.367722 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-16dab767-c27b-4d69-8f71-db850ac68435 tempest-ServerAddressesNegativeTestJSON-736278170 tempest-ServerAddressesNegativeTestJSON-736278170-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:02.368672 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-16dab767-c27b-4d69-8f71-db850ac68435 tempest-ServerAddressesNegativeTestJSON-736278170 tempest-ServerAddressesNegativeTestJSON-736278170-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:02.373920 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-16dab767-c27b-4d69-8f71-db850ac68435 tempest-ServerAddressesNegativeTestJSON-736278170 tempest-ServerAddressesNegativeTestJSON-736278170-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:02.381303 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.network.neutron [None req-1c0ac3a6-34e5-415b-ae36-4b2bfef50601 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] validate_networks() for None {{(pid=121403) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 01 18:57:02.771415 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-16dab767-c27b-4d69-8f71-db850ac68435 tempest-ServerAddressesNegativeTestJSON-736278170 tempest-ServerAddressesNegativeTestJSON-736278170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5a7d955d1004147b12eb569a7e7355a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d85b21bccf4bc78d4cbffd4f80357f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:57:02.791411 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-16dab767-c27b-4d69-8f71-db850ac68435 tempest-ServerAddressesNegativeTestJSON-736278170 tempest-ServerAddressesNegativeTestJSON-736278170-project] 10.222.0.13 "GET /compute/v2.1/servers/034c1271-a323-4728-985c-3d70df31eeb2" status: 200 len: 1527 microversion: 2.1 time: 0.457681 Nov 01 18:57:02.792213 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 412/764] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:57:02 2022] GET /compute/v2.1/servers/034c1271-a323-4728-985c-3d70df31eeb2 => generated 1527 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:57:02.817644 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-4de6b8b7-d872-43e1-b5c5-6a0b8fd10ca7 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:57:02.818928 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-4de6b8b7-d872-43e1-b5c5-6a0b8fd10ca7 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] [instance: bee52bae-2df5-46a3-9aa9-f6b24bea11e3] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:57:02.827117 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-4de6b8b7-d872-43e1-b5c5-6a0b8fd10ca7 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:02.827674 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-4de6b8b7-d872-43e1-b5c5-6a0b8fd10ca7 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:02.828107 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-4de6b8b7-d872-43e1-b5c5-6a0b8fd10ca7 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:02.829400 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-4de6b8b7-d872-43e1-b5c5-6a0b8fd10ca7 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:02.830048 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-4de6b8b7-d872-43e1-b5c5-6a0b8fd10ca7 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:02.831345 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-4de6b8b7-d872-43e1-b5c5-6a0b8fd10ca7 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:02.899721 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.virt.hardware [None req-1c0ac3a6-34e5-415b-ae36-4b2bfef50601 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Flavor limits 0:0:0 {{(pid=121403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 01 18:57:02.900487 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.virt.hardware [None req-1c0ac3a6-34e5-415b-ae36-4b2bfef50601 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Image limits 0:0:0 {{(pid=121403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 01 18:57:02.900986 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.virt.hardware [None req-1c0ac3a6-34e5-415b-ae36-4b2bfef50601 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Flavor pref 0:0:0 {{(pid=121403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 01 18:57:02.901418 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.virt.hardware [None req-1c0ac3a6-34e5-415b-ae36-4b2bfef50601 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Image pref 0:0:0 {{(pid=121403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 01 18:57:02.901822 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.virt.hardware [None req-1c0ac3a6-34e5-415b-ae36-4b2bfef50601 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 01 18:57:02.924617 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-1c0ac3a6-34e5-415b-ae36-4b2bfef50601 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:02.925162 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-1c0ac3a6-34e5-415b-ae36-4b2bfef50601 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:02.925736 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-1c0ac3a6-34e5-415b-ae36-4b2bfef50601 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:02.926589 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-1c0ac3a6-34e5-415b-ae36-4b2bfef50601 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:02.927113 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-1c0ac3a6-34e5-415b-ae36-4b2bfef50601 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:02.927816 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-1c0ac3a6-34e5-415b-ae36-4b2bfef50601 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:02.949365 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.quota [None req-1c0ac3a6-34e5-415b-ae36-4b2bfef50601 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Getting quotas for project 45d4c047d3c44324a27a27831236ab0d. Resources: {'cores', 'ram', 'instances'} {{(pid=121403) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 01 18:57:02.956217 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.quota [None req-1c0ac3a6-34e5-415b-ae36-4b2bfef50601 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Getting quotas for user 72117f17294649d6b8bc16c66c7efab2 and project 45d4c047d3c44324a27a27831236ab0d. Resources: {'cores', 'ram', 'instances'} {{(pid=121403) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 01 18:57:02.973563 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-1c0ac3a6-34e5-415b-ae36-4b2bfef50601 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Going to run 1 instances... {{(pid=121403) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 01 18:57:02.976655 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-1c0ac3a6-34e5-415b-ae36-4b2bfef50601 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] [instance: 7218f99b-b011-4f08-931e-340d47069f6e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2d4a0047-1b9e-445f-8af8-1b5c9d93e881',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121403) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 01 18:57:03.026867 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-1c0ac3a6-34e5-415b-ae36-4b2bfef50601 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.746680 Nov 01 18:57:03.027854 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 353/765] 10.222.0.13 () {60 vars in 1147 bytes} [Tue Nov 1 18:57:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 748 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 01 18:57:03.032546 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-d5108566-4297-4478-b3fb-b4e40edecd13 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:57:03.033198 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-d5108566-4297-4478-b3fb-b4e40edecd13 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] [instance: 97de391d-c836-40ac-b126-0b6684406d52] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:57:03.040569 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d5108566-4297-4478-b3fb-b4e40edecd13 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:03.040972 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d5108566-4297-4478-b3fb-b4e40edecd13 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:03.041329 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d5108566-4297-4478-b3fb-b4e40edecd13 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:03.042042 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d5108566-4297-4478-b3fb-b4e40edecd13 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:03.042504 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d5108566-4297-4478-b3fb-b4e40edecd13 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:03.042934 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d5108566-4297-4478-b3fb-b4e40edecd13 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:03.331058 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-4de6b8b7-d872-43e1-b5c5-6a0b8fd10ca7 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:57:03.344359 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-4de6b8b7-d872-43e1-b5c5-6a0b8fd10ca7 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:57:03.347549 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-4de6b8b7-d872-43e1-b5c5-6a0b8fd10ca7 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:57:03.349080 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-4de6b8b7-d872-43e1-b5c5-6a0b8fd10ca7 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] 10.222.0.13 "GET /compute/v2.1/servers/bee52bae-2df5-46a3-9aa9-f6b24bea11e3" status: 200 len: 1566 microversion: 2.25 time: 0.541597 Nov 01 18:57:03.350155 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 413/766] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 18:57:02 2022] GET /compute/v2.1/servers/bee52bae-2df5-46a3-9aa9-f6b24bea11e3 => generated 1566 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 18:57:03.353428 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-d5108566-4297-4478-b3fb-b4e40edecd13 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b52b7dcbb044f9bfc424e4417c77fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '708bc0ea4b5a4baf81933725792bedd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:57:03.365427 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-d5108566-4297-4478-b3fb-b4e40edecd13 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] 10.222.0.13 "GET /compute/v2.1/servers/97de391d-c836-40ac-b126-0b6684406d52" status: 200 len: 1522 microversion: 2.1 time: 0.336520 Nov 01 18:57:03.366517 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 354/767] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:57:03 2022] GET /compute/v2.1/servers/97de391d-c836-40ac-b126-0b6684406d52 => generated 1522 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:57:03.377075 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-bd558362-c892-4efd-9232-459079706d28 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:57:03.377232 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-25db787e-f938-4061-a323-834c6596710e tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:57:03.377783 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-bd558362-c892-4efd-9232-459079706d28 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] [instance: 2d525a31-b0be-44cb-8fb7-335075145f08] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:57:03.381858 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-25db787e-f938-4061-a323-834c6596710e tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] [instance: ea631032-dd04-429b-988e-e6362ea42cf7] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:57:03.391946 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-25db787e-f938-4061-a323-834c6596710e tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:03.392550 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-25db787e-f938-4061-a323-834c6596710e tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:03.393014 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-25db787e-f938-4061-a323-834c6596710e tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:03.393928 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-25db787e-f938-4061-a323-834c6596710e tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:03.394390 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-25db787e-f938-4061-a323-834c6596710e tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:03.394876 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-25db787e-f938-4061-a323-834c6596710e tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:03.402650 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-bd558362-c892-4efd-9232-459079706d28 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:03.402853 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-bd558362-c892-4efd-9232-459079706d28 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:03.403528 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-bd558362-c892-4efd-9232-459079706d28 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:03.404397 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-bd558362-c892-4efd-9232-459079706d28 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:03.405026 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-bd558362-c892-4efd-9232-459079706d28 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:03.405793 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-bd558362-c892-4efd-9232-459079706d28 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:03.510543 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-bd558362-c892-4efd-9232-459079706d28 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f32f5fba1976432d938e664c7714e52b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b9d4c236b944f9b2e8e502a50a8f8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:57:03.522542 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-bd558362-c892-4efd-9232-459079706d28 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] 10.222.0.13 "GET /compute/v2.1/servers/2d525a31-b0be-44cb-8fb7-335075145f08" status: 200 len: 1293 microversion: 2.1 time: 0.154328 Nov 01 18:57:03.537643 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 355/768] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:57:03 2022] GET /compute/v2.1/servers/2d525a31-b0be-44cb-8fb7-335075145f08 => generated 1293 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:57:03.547664 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-a147d962-5f2b-4c08-8e79-0e1ef6bb6547 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:57:03.548283 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-a147d962-5f2b-4c08-8e79-0e1ef6bb6547 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] [instance: 7218f99b-b011-4f08-931e-340d47069f6e] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:57:03.572108 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-25db787e-f938-4061-a323-834c6596710e tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c1314c21d8547ff890ede1c2ad281c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c804370880454c7aa02cef2c2c3cf144', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:57:03.589562 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-25db787e-f938-4061-a323-834c6596710e tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c1314c21d8547ff890ede1c2ad281c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c804370880454c7aa02cef2c2c3cf144', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:57:03.591015 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-25db787e-f938-4061-a323-834c6596710e tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c1314c21d8547ff890ede1c2ad281c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c804370880454c7aa02cef2c2c3cf144', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:57:03.597255 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-25db787e-f938-4061-a323-834c6596710e tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] 10.222.0.13 "GET /compute/v2.1/servers/ea631032-dd04-429b-988e-e6362ea42cf7" status: 200 len: 1553 microversion: 2.91 time: 0.245895 Nov 01 18:57:03.613004 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 414/769] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 18:57:03 2022] GET /compute/v2.1/servers/ea631032-dd04-429b-988e-e6362ea42cf7 => generated 1553 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 18:57:03.620125 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-664499c5-3d77-4709-a461-03ce57ca58f2 tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:57:03.621037 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-664499c5-3d77-4709-a461-03ce57ca58f2 tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] [instance: 87679611-878a-49b2-bf8f-39e784c6d70b] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:57:03.627510 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-664499c5-3d77-4709-a461-03ce57ca58f2 tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:03.628123 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-664499c5-3d77-4709-a461-03ce57ca58f2 tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:03.628713 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-664499c5-3d77-4709-a461-03ce57ca58f2 tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:03.629548 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-664499c5-3d77-4709-a461-03ce57ca58f2 tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:03.630101 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-664499c5-3d77-4709-a461-03ce57ca58f2 tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:03.630743 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-664499c5-3d77-4709-a461-03ce57ca58f2 tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:03.640083 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-a147d962-5f2b-4c08-8e79-0e1ef6bb6547 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72117f17294649d6b8bc16c66c7efab2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45d4c047d3c44324a27a27831236ab0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:57:03.648213 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-a147d962-5f2b-4c08-8e79-0e1ef6bb6547 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] 10.222.0.13 "GET /compute/v2.1/servers/7218f99b-b011-4f08-931e-340d47069f6e" status: 200 len: 1212 microversion: 2.1 time: 0.109293 Nov 01 18:57:03.651681 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 356/770] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:57:03 2022] GET /compute/v2.1/servers/7218f99b-b011-4f08-931e-340d47069f6e => generated 1212 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:57:03.665671 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-029eaba7-f65a-4c46-b702-affbe9290744 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:57:03.666853 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-029eaba7-f65a-4c46-b702-affbe9290744 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] [instance: 97de391d-c836-40ac-b126-0b6684406d52] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:57:03.691821 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-029eaba7-f65a-4c46-b702-affbe9290744 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:03.692330 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-029eaba7-f65a-4c46-b702-affbe9290744 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:03.694031 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-029eaba7-f65a-4c46-b702-affbe9290744 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:03.695917 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-029eaba7-f65a-4c46-b702-affbe9290744 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:03.696426 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-029eaba7-f65a-4c46-b702-affbe9290744 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:03.697302 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-029eaba7-f65a-4c46-b702-affbe9290744 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:03.850420 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-664499c5-3d77-4709-a461-03ce57ca58f2 tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '576abe5db27b461889fef2029d477e40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e9fb3117f68434bae7a463c357818dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:57:03.862150 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-664499c5-3d77-4709-a461-03ce57ca58f2 tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '576abe5db27b461889fef2029d477e40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e9fb3117f68434bae7a463c357818dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:57:03.866913 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-664499c5-3d77-4709-a461-03ce57ca58f2 tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '576abe5db27b461889fef2029d477e40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e9fb3117f68434bae7a463c357818dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:57:03.875348 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-664499c5-3d77-4709-a461-03ce57ca58f2 tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] 10.222.0.13 "GET /compute/v2.1/servers/87679611-878a-49b2-bf8f-39e784c6d70b" status: 200 len: 1447 microversion: 2.75 time: 0.259390 Nov 01 18:57:03.876727 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 415/771] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 18:57:03 2022] GET /compute/v2.1/servers/87679611-878a-49b2-bf8f-39e784c6d70b => generated 1447 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 18:57:03.881686 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-22fa8c5a-090a-4306-8117-125db78ec0d9 tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:57:03.882632 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-22fa8c5a-090a-4306-8117-125db78ec0d9 tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] [instance: ab3530ff-d70f-4c6c-abd0-3afa14fd9954] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:57:03.888895 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-22fa8c5a-090a-4306-8117-125db78ec0d9 tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:03.889647 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-22fa8c5a-090a-4306-8117-125db78ec0d9 tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:03.890354 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-22fa8c5a-090a-4306-8117-125db78ec0d9 tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:03.891992 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-22fa8c5a-090a-4306-8117-125db78ec0d9 tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:03.893090 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-22fa8c5a-090a-4306-8117-125db78ec0d9 tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:03.894162 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-22fa8c5a-090a-4306-8117-125db78ec0d9 tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:03.930520 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-22fa8c5a-090a-4306-8117-125db78ec0d9 tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] [instance: ab3530ff-d70f-4c6c-abd0-3afa14fd9954] Going to try to terminate instance {{(pid=121402) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 01 18:57:04.089660 n-d-863052-2 devstack@n-api.service[121402]: DEBUG dbcounter [-] [121402] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=121402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 18:57:04.099345 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-029eaba7-f65a-4c46-b702-affbe9290744 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b52b7dcbb044f9bfc424e4417c77fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '708bc0ea4b5a4baf81933725792bedd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:57:04.101554 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-22fa8c5a-090a-4306-8117-125db78ec0d9 tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] 10.222.0.13 "DELETE /compute/v2.1/servers/ab3530ff-d70f-4c6c-abd0-3afa14fd9954" status: 204 len: 0 microversion: 2.1 time: 0.222352 Nov 01 18:57:04.104514 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 416/772] 10.222.0.13 () {58 vars in 1239 bytes} [Tue Nov 1 18:57:03 2022] DELETE /compute/v2.1/servers/ab3530ff-d70f-4c6c-abd0-3afa14fd9954 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 01 18:57:04.113028 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-029eaba7-f65a-4c46-b702-affbe9290744 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] 10.222.0.13 "GET /compute/v2.1/servers/97de391d-c836-40ac-b126-0b6684406d52" status: 200 len: 1522 microversion: 2.1 time: 0.455850 Nov 01 18:57:04.114053 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-75dac73a-db1d-477a-8eab-077bd0c698a9 tempest-ServerAddressesNegativeTestJSON-736278170 tempest-ServerAddressesNegativeTestJSON-736278170-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:57:04.114751 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 357/773] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:57:03 2022] GET /compute/v2.1/servers/97de391d-c836-40ac-b126-0b6684406d52 => generated 1522 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:57:04.121491 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-f141a598-8f60-44ca-8213-f93bfccf1c26 tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:57:04.122110 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-f141a598-8f60-44ca-8213-f93bfccf1c26 tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] [instance: ab3530ff-d70f-4c6c-abd0-3afa14fd9954] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:57:04.122231 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-75dac73a-db1d-477a-8eab-077bd0c698a9 tempest-ServerAddressesNegativeTestJSON-736278170 tempest-ServerAddressesNegativeTestJSON-736278170-project] [instance: 034c1271-a323-4728-985c-3d70df31eeb2] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:57:04.134618 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-75dac73a-db1d-477a-8eab-077bd0c698a9 tempest-ServerAddressesNegativeTestJSON-736278170 tempest-ServerAddressesNegativeTestJSON-736278170-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:04.135272 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-75dac73a-db1d-477a-8eab-077bd0c698a9 tempest-ServerAddressesNegativeTestJSON-736278170 tempest-ServerAddressesNegativeTestJSON-736278170-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:04.135884 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-75dac73a-db1d-477a-8eab-077bd0c698a9 tempest-ServerAddressesNegativeTestJSON-736278170 tempest-ServerAddressesNegativeTestJSON-736278170-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:04.136896 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-75dac73a-db1d-477a-8eab-077bd0c698a9 tempest-ServerAddressesNegativeTestJSON-736278170 tempest-ServerAddressesNegativeTestJSON-736278170-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:04.137454 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-75dac73a-db1d-477a-8eab-077bd0c698a9 tempest-ServerAddressesNegativeTestJSON-736278170 tempest-ServerAddressesNegativeTestJSON-736278170-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:04.137945 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-75dac73a-db1d-477a-8eab-077bd0c698a9 tempest-ServerAddressesNegativeTestJSON-736278170 tempest-ServerAddressesNegativeTestJSON-736278170-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:04.142352 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f141a598-8f60-44ca-8213-f93bfccf1c26 tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:04.142810 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f141a598-8f60-44ca-8213-f93bfccf1c26 tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:04.143319 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f141a598-8f60-44ca-8213-f93bfccf1c26 tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:04.144042 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f141a598-8f60-44ca-8213-f93bfccf1c26 tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:04.144506 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f141a598-8f60-44ca-8213-f93bfccf1c26 tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:04.145485 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f141a598-8f60-44ca-8213-f93bfccf1c26 tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:04.220004 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-75dac73a-db1d-477a-8eab-077bd0c698a9 tempest-ServerAddressesNegativeTestJSON-736278170 tempest-ServerAddressesNegativeTestJSON-736278170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5a7d955d1004147b12eb569a7e7355a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d85b21bccf4bc78d4cbffd4f80357f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:57:04.229170 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-75dac73a-db1d-477a-8eab-077bd0c698a9 tempest-ServerAddressesNegativeTestJSON-736278170 tempest-ServerAddressesNegativeTestJSON-736278170-project] 10.222.0.13 "GET /compute/v2.1/servers/034c1271-a323-4728-985c-3d70df31eeb2" status: 200 len: 1485 microversion: 2.1 time: 0.121840 Nov 01 18:57:04.231550 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 417/774] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:57:04 2022] GET /compute/v2.1/servers/034c1271-a323-4728-985c-3d70df31eeb2 => generated 1485 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:57:04.238549 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-cc7bd723-1391-485c-8037-2a1f3fea9585 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-664306782", "metadata": {"": ""}}} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 18:57:04.244080 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-cc7bd723-1391-485c-8037-2a1f3fea9585 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Request method failure captured: Nov 01 18:57:04.244080 n-d-863052-2 devstack@n-api.service[121402]: request: POST /compute/v2.1/servers/97de391d-c836-40ac-b126-0b6684406d52/action HTTP/1.1 Nov 01 18:57:04.244080 n-d-863052-2 devstack@n-api.service[121402]: Accept: application/json Nov 01 18:57:04.244080 n-d-863052-2 devstack@n-api.service[121402]: Accept-Encoding: identity Nov 01 18:57:04.244080 n-d-863052-2 devstack@n-api.service[121402]: Connection: close Nov 01 18:57:04.244080 n-d-863052-2 devstack@n-api.service[121402]: Content-Length: 106 Nov 01 18:57:04.244080 n-d-863052-2 devstack@n-api.service[121402]: Content-Type: application/json Nov 01 18:57:04.244080 n-d-863052-2 devstack@n-api.service[121402]: Host: 10.222.0.13 Nov 01 18:57:04.244080 n-d-863052-2 devstack@n-api.service[121402]: Openstack-System-Scope: None Nov 01 18:57:04.244080 n-d-863052-2 devstack@n-api.service[121402]: User-Agent: python-urllib3/1.26.12 Nov 01 18:57:04.244080 n-d-863052-2 devstack@n-api.service[121402]: X-Auth-Token: gAAAAABjYWvqbQtaNCf0vN3RIHicQ7eZzuMpptpvowYCNSOJcJRxrJ9QX4Bvdyyh6S1_lak_JDolcn4qSC02atGGl8uI3NqpWQKt52qXcbtBLMPpaEiNHqRmhd3SjpSTdiucZ2dSpVmatQ9uPpkpENeFkI_E8IIwNVu5-V-pSAlLNGA0j86IptM Nov 01 18:57:04.244080 n-d-863052-2 devstack@n-api.service[121402]: X-Domain-Id: None Nov 01 18:57:04.244080 n-d-863052-2 devstack@n-api.service[121402]: X-Domain-Name: None Nov 01 18:57:04.244080 n-d-863052-2 devstack@n-api.service[121402]: X-Identity-Status: Confirmed Nov 01 18:57:04.244080 n-d-863052-2 devstack@n-api.service[121402]: X-Is-Admin-Project: True Nov 01 18:57:04.244080 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Domain-Id: default Nov 01 18:57:04.244080 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Domain-Name: Default Nov 01 18:57:04.244080 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Id: 708bc0ea4b5a4baf81933725792bedd5 Nov 01 18:57:04.244080 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1431666313 Nov 01 18:57:04.244080 n-d-863052-2 devstack@n-api.service[121402]: X-Role: member,reader Nov 01 18:57:04.244080 n-d-863052-2 devstack@n-api.service[121402]: X-Roles: member,reader Nov 01 18:57:04.245615 n-d-863052-2 devstack@n-api.service[121402]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/708bc0ea4b5a4baf81933725792bedd5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/708bc0ea4b5a4baf81933725792bedd5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_708bc0ea4b5a4baf81933725792bedd5", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/708bc0ea4b5a4baf81933725792bedd5"}]}] Nov 01 18:57:04.245615 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1431666313 Nov 01 18:57:04.245615 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant-Id: 708bc0ea4b5a4baf81933725792bedd5 Nov 01 18:57:04.245615 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1431666313 Nov 01 18:57:04.245615 n-d-863052-2 devstack@n-api.service[121402]: X-User: tempest-ImagesOneServerNegativeTestJSON-1431666313-project Nov 01 18:57:04.245615 n-d-863052-2 devstack@n-api.service[121402]: X-User-Domain-Id: default Nov 01 18:57:04.245615 n-d-863052-2 devstack@n-api.service[121402]: X-User-Domain-Name: Default Nov 01 18:57:04.245615 n-d-863052-2 devstack@n-api.service[121402]: X-User-Id: 09b52b7dcbb044f9bfc424e4417c77fa Nov 01 18:57:04.245615 n-d-863052-2 devstack@n-api.service[121402]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1431666313-project Nov 01 18:57:04.245615 n-d-863052-2 devstack@n-api.service[121402]: Nov 01 18:57:04.245615 n-d-863052-2 devstack@n-api.service[121402]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-664306782", "metadata": {"": ""}}} Nov 01 18:57:04.245615 n-d-863052-2 devstack@n-api.service[121402]: method: > Nov 01 18:57:04.246508 n-d-863052-2 devstack@n-api.service[121402]: exception: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Nov 01 18:57:04.246508 n-d-863052-2 devstack@n-api.service[121402]: action_args: {'id': '97de391d-c836-40ac-b126-0b6684406d52', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-664306782', 'metadata': {'': ''}}}} Nov 01 18:57:04.246508 n-d-863052-2 devstack@n-api.service[121402]: {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 01 18:57:04.246508 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:57:04.246508 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Nov 01 18:57:04.246508 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Nov 01 18:57:04.246508 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Nov 01 18:57:04.246508 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise error Nov 01 18:57:04.246508 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Nov 01 18:57:04.246508 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 18:57:04.246508 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['createImage']['properties']['metadata']: Nov 01 18:57:04.246508 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Nov 01 18:57:04.246508 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Nov 01 18:57:04.246508 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Nov 01 18:57:04.246508 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi 'type': 'object'} Nov 01 18:57:04.246508 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 18:57:04.246508 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi On instance['createImage']: Nov 01 18:57:04.246508 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi {'': ''} Nov 01 18:57:04.246508 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 18:57:04.246508 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 18:57:04.246508 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 18:57:04.247987 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:57:04.247987 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 18:57:04.247987 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 18:57:04.247987 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 01 18:57:04.247987 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 01 18:57:04.247987 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 01 18:57:04.247987 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 01 18:57:04.247987 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 01 18:57:04.247987 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 01 18:57:04.247987 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Nov 01 18:57:04.247987 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Nov 01 18:57:04.247987 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Nov 01 18:57:04.247987 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Nov 01 18:57:04.247987 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Nov 01 18:57:04.247987 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Nov 01 18:57:04.247987 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Nov 01 18:57:04.247987 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 18:57:04.247987 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 18:57:04.247987 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 18:57:04.247987 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:57:04.249494 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 18:57:04.249494 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 18:57:04.249494 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Nov 01 18:57:04.249494 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Nov 01 18:57:04.249494 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Nov 01 18:57:04.249494 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 18:57:04.250682 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-cc7bd723-1391-485c-8037-2a1f3fea9585 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=121402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 01 18:57:04.251903 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-cc7bd723-1391-485c-8037-2a1f3fea9585 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] 10.222.0.13 "POST /compute/v2.1/servers/97de391d-c836-40ac-b126-0b6684406d52/action" status: 400 len: 170 microversion: 2.1 time: 0.018947 Nov 01 18:57:04.252987 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 418/775] 10.222.0.13 () {60 vars in 1279 bytes} [Tue Nov 1 18:57:04 2022] POST /compute/v2.1/servers/97de391d-c836-40ac-b126-0b6684406d52/action => generated 170 bytes in 21 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 01 18:57:04.260695 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [req-fab49ca4-6b30-4f25-a717-6445fabe6972 req-02ef96ab-9b39-46bb-8ab9-c8dda5f47856 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "034c1271-a323-4728-985c-3d70df31eeb2", "name": "network-vif-deleted", "tag": "2b4443bc-cfe3-4140-a278-7c9306ec0e67"}]} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 18:57:04.273391 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-fab49ca4-6b30-4f25-a717-6445fabe6972 req-02ef96ab-9b39-46bb-8ab9-c8dda5f47856 service nova] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:04.273710 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-fab49ca4-6b30-4f25-a717-6445fabe6972 req-02ef96ab-9b39-46bb-8ab9-c8dda5f47856 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:04.274318 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-fab49ca4-6b30-4f25-a717-6445fabe6972 req-02ef96ab-9b39-46bb-8ab9-c8dda5f47856 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:04.288913 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.compute.server_external_events [req-fab49ca4-6b30-4f25-a717-6445fabe6972 req-02ef96ab-9b39-46bb-8ab9-c8dda5f47856 service nova] Creating event network-vif-deleted:2b4443bc-cfe3-4140-a278-7c9306ec0e67 for instance 034c1271-a323-4728-985c-3d70df31eeb2 on n-h2-863052-2 Nov 01 18:57:04.294496 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [req-fab49ca4-6b30-4f25-a717-6445fabe6972 req-02ef96ab-9b39-46bb-8ab9-c8dda5f47856 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040172 Nov 01 18:57:04.295190 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 419/776] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Nov 1 18:57:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 18:57:04.301010 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-19f85196-4586-4367-b3dd-98ef87786e6e tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:57:04.301775 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-19f85196-4586-4367-b3dd-98ef87786e6e tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] [instance: 97de391d-c836-40ac-b126-0b6684406d52] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:57:04.308510 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-19f85196-4586-4367-b3dd-98ef87786e6e tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:04.309041 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-19f85196-4586-4367-b3dd-98ef87786e6e tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:04.309479 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-19f85196-4586-4367-b3dd-98ef87786e6e tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:04.310270 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-19f85196-4586-4367-b3dd-98ef87786e6e tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:04.310725 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-19f85196-4586-4367-b3dd-98ef87786e6e tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:04.311142 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-19f85196-4586-4367-b3dd-98ef87786e6e tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:04.320900 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-f141a598-8f60-44ca-8213-f93bfccf1c26 tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07a2a96629f4baea6a3adfc4011ffe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9baf3860ba564f5c8dff93085b9aabe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:57:04.329728 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-f141a598-8f60-44ca-8213-f93bfccf1c26 tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] 10.222.0.13 "GET /compute/v2.1/servers/ab3530ff-d70f-4c6c-abd0-3afa14fd9954" status: 200 len: 1713 microversion: 2.1 time: 0.213509 Nov 01 18:57:04.342504 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 358/777] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:57:04 2022] GET /compute/v2.1/servers/ab3530ff-d70f-4c6c-abd0-3afa14fd9954 => generated 1713 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:57:04.377206 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-61b6bf31-a775-4717-90fc-ffd9a3224c17 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:57:04.377841 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-61b6bf31-a775-4717-90fc-ffd9a3224c17 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] [instance: bee52bae-2df5-46a3-9aa9-f6b24bea11e3] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:57:04.385206 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-61b6bf31-a775-4717-90fc-ffd9a3224c17 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:04.385688 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-61b6bf31-a775-4717-90fc-ffd9a3224c17 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:04.386119 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-61b6bf31-a775-4717-90fc-ffd9a3224c17 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:04.386806 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-61b6bf31-a775-4717-90fc-ffd9a3224c17 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:04.387262 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-61b6bf31-a775-4717-90fc-ffd9a3224c17 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:04.387658 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-61b6bf31-a775-4717-90fc-ffd9a3224c17 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:04.450390 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-19f85196-4586-4367-b3dd-98ef87786e6e tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b52b7dcbb044f9bfc424e4417c77fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '708bc0ea4b5a4baf81933725792bedd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:57:04.458642 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-19f85196-4586-4367-b3dd-98ef87786e6e tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] 10.222.0.13 "GET /compute/v2.1/servers/97de391d-c836-40ac-b126-0b6684406d52" status: 200 len: 1522 microversion: 2.1 time: 0.162284 Nov 01 18:57:04.463741 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 420/778] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:57:04 2022] GET /compute/v2.1/servers/97de391d-c836-40ac-b126-0b6684406d52 => generated 1522 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:57:04.480766 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-53df5da3-4b11-4aca-91c2-d3e27d06d3bd tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:57:04.481366 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-53df5da3-4b11-4aca-91c2-d3e27d06d3bd tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] [instance: 97de391d-c836-40ac-b126-0b6684406d52] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:57:04.487525 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-53df5da3-4b11-4aca-91c2-d3e27d06d3bd tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:04.488013 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-53df5da3-4b11-4aca-91c2-d3e27d06d3bd tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:04.488480 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-53df5da3-4b11-4aca-91c2-d3e27d06d3bd tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:04.489204 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-53df5da3-4b11-4aca-91c2-d3e27d06d3bd tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:04.489662 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-53df5da3-4b11-4aca-91c2-d3e27d06d3bd tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:04.490082 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-53df5da3-4b11-4aca-91c2-d3e27d06d3bd tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:04.523577 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-61b6bf31-a775-4717-90fc-ffd9a3224c17 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:57:04.532086 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-61b6bf31-a775-4717-90fc-ffd9a3224c17 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:57:04.533581 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-61b6bf31-a775-4717-90fc-ffd9a3224c17 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:57:04.534777 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-61b6bf31-a775-4717-90fc-ffd9a3224c17 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] 10.222.0.13 "GET /compute/v2.1/servers/bee52bae-2df5-46a3-9aa9-f6b24bea11e3" status: 200 len: 1566 microversion: 2.25 time: 0.162253 Nov 01 18:57:04.535346 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 359/779] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 18:57:04 2022] GET /compute/v2.1/servers/bee52bae-2df5-46a3-9aa9-f6b24bea11e3 => generated 1566 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 01 18:57:04.552443 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-40ce11ed-e28e-4940-ad5f-f13b06f3e4e4 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:57:04.553182 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-40ce11ed-e28e-4940-ad5f-f13b06f3e4e4 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] [instance: 2d525a31-b0be-44cb-8fb7-335075145f08] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:57:04.561547 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-40ce11ed-e28e-4940-ad5f-f13b06f3e4e4 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:04.562031 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-40ce11ed-e28e-4940-ad5f-f13b06f3e4e4 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:04.562717 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-40ce11ed-e28e-4940-ad5f-f13b06f3e4e4 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:04.563411 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-40ce11ed-e28e-4940-ad5f-f13b06f3e4e4 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:04.563861 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-40ce11ed-e28e-4940-ad5f-f13b06f3e4e4 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:04.564275 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-40ce11ed-e28e-4940-ad5f-f13b06f3e4e4 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:04.625272 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-53df5da3-4b11-4aca-91c2-d3e27d06d3bd tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b52b7dcbb044f9bfc424e4417c77fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '708bc0ea4b5a4baf81933725792bedd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:57:04.633457 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-53df5da3-4b11-4aca-91c2-d3e27d06d3bd tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] 10.222.0.13 "GET /compute/v2.1/servers/97de391d-c836-40ac-b126-0b6684406d52" status: 200 len: 1522 microversion: 2.1 time: 0.156415 Nov 01 18:57:04.634375 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 421/780] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:57:04 2022] GET /compute/v2.1/servers/97de391d-c836-40ac-b126-0b6684406d52 => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:57:04.639539 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-c9752313-3de4-49b9-bb4f-3adfb5442bc0 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:57:04.640274 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-c9752313-3de4-49b9-bb4f-3adfb5442bc0 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] [instance: ea631032-dd04-429b-988e-e6362ea42cf7] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:57:04.647053 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-c9752313-3de4-49b9-bb4f-3adfb5442bc0 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:04.647994 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-c9752313-3de4-49b9-bb4f-3adfb5442bc0 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:04.647994 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-c9752313-3de4-49b9-bb4f-3adfb5442bc0 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:04.649516 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-c9752313-3de4-49b9-bb4f-3adfb5442bc0 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:04.649978 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-c9752313-3de4-49b9-bb4f-3adfb5442bc0 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:04.650408 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-c9752313-3de4-49b9-bb4f-3adfb5442bc0 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:04.702620 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-40ce11ed-e28e-4940-ad5f-f13b06f3e4e4 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f32f5fba1976432d938e664c7714e52b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b9d4c236b944f9b2e8e502a50a8f8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:57:04.710336 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-40ce11ed-e28e-4940-ad5f-f13b06f3e4e4 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] 10.222.0.13 "GET /compute/v2.1/servers/2d525a31-b0be-44cb-8fb7-335075145f08" status: 200 len: 1361 microversion: 2.1 time: 0.163647 Nov 01 18:57:04.710892 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 360/781] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:57:04 2022] GET /compute/v2.1/servers/2d525a31-b0be-44cb-8fb7-335075145f08 => generated 1361 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 18:57:04.719265 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-c9752313-3de4-49b9-bb4f-3adfb5442bc0 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c1314c21d8547ff890ede1c2ad281c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c804370880454c7aa02cef2c2c3cf144', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:57:04.721696 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-2cbc3813-0d21-4432-9252-9cb7cf07b2fc tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1513709831", "metadata": {"aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}}} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 18:57:04.728211 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-c9752313-3de4-49b9-bb4f-3adfb5442bc0 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c1314c21d8547ff890ede1c2ad281c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c804370880454c7aa02cef2c2c3cf144', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:57:04.729742 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-c9752313-3de4-49b9-bb4f-3adfb5442bc0 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c1314c21d8547ff890ede1c2ad281c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c804370880454c7aa02cef2c2c3cf144', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:57:04.731004 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-2cbc3813-0d21-4432-9252-9cb7cf07b2fc tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Request method failure captured: Nov 01 18:57:04.731004 n-d-863052-2 devstack@n-api.service[121403]: request: POST /compute/v2.1/servers/97de391d-c836-40ac-b126-0b6684406d52/action HTTP/1.1 Nov 01 18:57:04.731004 n-d-863052-2 devstack@n-api.service[121403]: Accept: application/json Nov 01 18:57:04.731004 n-d-863052-2 devstack@n-api.service[121403]: Accept-Encoding: identity Nov 01 18:57:04.731004 n-d-863052-2 devstack@n-api.service[121403]: Connection: close Nov 01 18:57:04.731004 n-d-863052-2 devstack@n-api.service[121403]: Content-Length: 619 Nov 01 18:57:04.731004 n-d-863052-2 devstack@n-api.service[121403]: Content-Type: application/json Nov 01 18:57:04.731004 n-d-863052-2 devstack@n-api.service[121403]: Host: 10.222.0.13 Nov 01 18:57:04.731004 n-d-863052-2 devstack@n-api.service[121403]: Openstack-System-Scope: None Nov 01 18:57:04.731004 n-d-863052-2 devstack@n-api.service[121403]: User-Agent: python-urllib3/1.26.12 Nov 01 18:57:04.731004 n-d-863052-2 devstack@n-api.service[121403]: X-Auth-Token: gAAAAABjYWvqbQtaNCf0vN3RIHicQ7eZzuMpptpvowYCNSOJcJRxrJ9QX4Bvdyyh6S1_lak_JDolcn4qSC02atGGl8uI3NqpWQKt52qXcbtBLMPpaEiNHqRmhd3SjpSTdiucZ2dSpVmatQ9uPpkpENeFkI_E8IIwNVu5-V-pSAlLNGA0j86IptM Nov 01 18:57:04.731004 n-d-863052-2 devstack@n-api.service[121403]: X-Domain-Id: None Nov 01 18:57:04.731004 n-d-863052-2 devstack@n-api.service[121403]: X-Domain-Name: None Nov 01 18:57:04.731004 n-d-863052-2 devstack@n-api.service[121403]: X-Identity-Status: Confirmed Nov 01 18:57:04.731004 n-d-863052-2 devstack@n-api.service[121403]: X-Is-Admin-Project: True Nov 01 18:57:04.731004 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Domain-Id: default Nov 01 18:57:04.731004 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Domain-Name: Default Nov 01 18:57:04.731004 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Id: 708bc0ea4b5a4baf81933725792bedd5 Nov 01 18:57:04.731004 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1431666313 Nov 01 18:57:04.731004 n-d-863052-2 devstack@n-api.service[121403]: X-Role: member,reader Nov 01 18:57:04.731004 n-d-863052-2 devstack@n-api.service[121403]: X-Roles: member,reader Nov 01 18:57:04.732472 n-d-863052-2 devstack@n-api.service[121403]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/708bc0ea4b5a4baf81933725792bedd5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/708bc0ea4b5a4baf81933725792bedd5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_708bc0ea4b5a4baf81933725792bedd5", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/708bc0ea4b5a4baf81933725792bedd5"}]}] Nov 01 18:57:04.732472 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1431666313 Nov 01 18:57:04.732472 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant-Id: 708bc0ea4b5a4baf81933725792bedd5 Nov 01 18:57:04.732472 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1431666313 Nov 01 18:57:04.732472 n-d-863052-2 devstack@n-api.service[121403]: X-User: tempest-ImagesOneServerNegativeTestJSON-1431666313-project Nov 01 18:57:04.732472 n-d-863052-2 devstack@n-api.service[121403]: X-User-Domain-Id: default Nov 01 18:57:04.732472 n-d-863052-2 devstack@n-api.service[121403]: X-User-Domain-Name: Default Nov 01 18:57:04.732472 n-d-863052-2 devstack@n-api.service[121403]: X-User-Id: 09b52b7dcbb044f9bfc424e4417c77fa Nov 01 18:57:04.732472 n-d-863052-2 devstack@n-api.service[121403]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1431666313-project Nov 01 18:57:04.732472 n-d-863052-2 devstack@n-api.service[121403]: Nov 01 18:57:04.733222 n-d-863052-2 devstack@n-api.service[121403]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1513709831", "metadata": {"aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}}} Nov 01 18:57:04.733222 n-d-863052-2 devstack@n-api.service[121403]: method: > Nov 01 18:57:04.733222 n-d-863052-2 devstack@n-api.service[121403]: exception: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Nov 01 18:57:04.733477 n-d-863052-2 devstack@n-api.service[121403]: action_args: {'id': '97de391d-c836-40ac-b126-0b6684406d52', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-1513709831', 'metadata': {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}}}} Nov 01 18:57:04.733477 n-d-863052-2 devstack@n-api.service[121403]: {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 01 18:57:04.733477 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:57:04.733477 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Nov 01 18:57:04.733477 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Nov 01 18:57:04.733477 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Nov 01 18:57:04.733477 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise error Nov 01 18:57:04.733477 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Nov 01 18:57:04.733477 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 18:57:04.733477 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['createImage']['properties']['metadata']: Nov 01 18:57:04.733477 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Nov 01 18:57:04.734390 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Nov 01 18:57:04.734390 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Nov 01 18:57:04.734390 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi 'type': 'object'} Nov 01 18:57:04.734390 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 18:57:04.734390 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi On instance['createImage']: Nov 01 18:57:04.734390 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'} Nov 01 18:57:04.734390 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 18:57:04.734390 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 18:57:04.734390 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 18:57:04.734390 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:57:04.734390 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 18:57:04.734390 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 18:57:04.734390 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 01 18:57:04.734390 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 01 18:57:04.734390 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 01 18:57:04.734390 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 01 18:57:04.734390 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 01 18:57:04.735606 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 01 18:57:04.735606 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Nov 01 18:57:04.735606 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Nov 01 18:57:04.735606 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Nov 01 18:57:04.735606 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Nov 01 18:57:04.735606 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Nov 01 18:57:04.735606 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Nov 01 18:57:04.735606 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Nov 01 18:57:04.735606 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 18:57:04.735606 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 18:57:04.735606 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 18:57:04.735606 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:57:04.736599 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 18:57:04.736599 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 18:57:04.736599 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Nov 01 18:57:04.736599 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Nov 01 18:57:04.736599 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Nov 01 18:57:04.736599 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 18:57:04.737136 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-2cbc3813-0d21-4432-9252-9cb7cf07b2fc tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=121403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 01 18:57:04.737136 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-2cbc3813-0d21-4432-9252-9cb7cf07b2fc tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] 10.222.0.13 "POST /compute/v2.1/servers/97de391d-c836-40ac-b126-0b6684406d52/action" status: 400 len: 938 microversion: 2.1 time: 0.015481 Nov 01 18:57:04.737320 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-c9752313-3de4-49b9-bb4f-3adfb5442bc0 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] 10.222.0.13 "GET /compute/v2.1/servers/ea631032-dd04-429b-988e-e6362ea42cf7" status: 200 len: 1535 microversion: 2.91 time: 0.099509 Nov 01 18:57:04.737410 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 361/782] 10.222.0.13 () {60 vars in 1279 bytes} [Tue Nov 1 18:57:04 2022] POST /compute/v2.1/servers/97de391d-c836-40ac-b126-0b6684406d52/action => generated 938 bytes in 25 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 01 18:57:04.740708 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 422/783] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 18:57:04 2022] GET /compute/v2.1/servers/ea631032-dd04-429b-988e-e6362ea42cf7 => generated 1535 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 18:57:04.741855 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-e3ce3f42-673d-4c21-907e-8cb751291a09 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:57:04.742459 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-e3ce3f42-673d-4c21-907e-8cb751291a09 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] [instance: 7218f99b-b011-4f08-931e-340d47069f6e] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:57:04.745613 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-9c0256de-576a-443d-b1ac-1d25523302d3 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:57:04.746246 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-9c0256de-576a-443d-b1ac-1d25523302d3 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] [instance: 97de391d-c836-40ac-b126-0b6684406d52] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:57:04.749450 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-e3ce3f42-673d-4c21-907e-8cb751291a09 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:04.750134 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-e3ce3f42-673d-4c21-907e-8cb751291a09 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:04.750567 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-e3ce3f42-673d-4c21-907e-8cb751291a09 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:04.751411 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-e3ce3f42-673d-4c21-907e-8cb751291a09 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:04.751888 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-e3ce3f42-673d-4c21-907e-8cb751291a09 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:04.752004 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-9c0256de-576a-443d-b1ac-1d25523302d3 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:04.752296 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-e3ce3f42-673d-4c21-907e-8cb751291a09 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:04.752484 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-9c0256de-576a-443d-b1ac-1d25523302d3 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:04.753149 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-9c0256de-576a-443d-b1ac-1d25523302d3 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:04.753844 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-9c0256de-576a-443d-b1ac-1d25523302d3 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:04.754857 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-9c0256de-576a-443d-b1ac-1d25523302d3 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:04.755384 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-9c0256de-576a-443d-b1ac-1d25523302d3 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:04.814153 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-e3ce3f42-673d-4c21-907e-8cb751291a09 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72117f17294649d6b8bc16c66c7efab2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45d4c047d3c44324a27a27831236ab0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:57:04.822455 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-e3ce3f42-673d-4c21-907e-8cb751291a09 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] 10.222.0.13 "GET /compute/v2.1/servers/7218f99b-b011-4f08-931e-340d47069f6e" status: 200 len: 1264 microversion: 2.1 time: 0.084693 Nov 01 18:57:04.823030 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 362/784] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:57:04 2022] GET /compute/v2.1/servers/7218f99b-b011-4f08-931e-340d47069f6e => generated 1264 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:57:04.884721 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-9c0256de-576a-443d-b1ac-1d25523302d3 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b52b7dcbb044f9bfc424e4417c77fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '708bc0ea4b5a4baf81933725792bedd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:57:04.892366 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-9c0256de-576a-443d-b1ac-1d25523302d3 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] 10.222.0.13 "GET /compute/v2.1/servers/97de391d-c836-40ac-b126-0b6684406d52" status: 200 len: 1522 microversion: 2.1 time: 0.150469 Nov 01 18:57:04.892964 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 423/785] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:57:04 2022] GET /compute/v2.1/servers/97de391d-c836-40ac-b126-0b6684406d52 => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:57:04.906866 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-f6ae742e-384f-4f5e-8d21-71fb49749e7a tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:57:04.907477 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-f6ae742e-384f-4f5e-8d21-71fb49749e7a tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] [instance: 87679611-878a-49b2-bf8f-39e784c6d70b] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:57:04.913516 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f6ae742e-384f-4f5e-8d21-71fb49749e7a tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:04.914004 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f6ae742e-384f-4f5e-8d21-71fb49749e7a tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:04.914446 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f6ae742e-384f-4f5e-8d21-71fb49749e7a tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:04.915141 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f6ae742e-384f-4f5e-8d21-71fb49749e7a tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:04.915599 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f6ae742e-384f-4f5e-8d21-71fb49749e7a tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:04.915721 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-5b9a9f8c-4237-4492-ab40-72dc634df4ac tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:57:04.916023 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f6ae742e-384f-4f5e-8d21-71fb49749e7a tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:04.916291 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-5b9a9f8c-4237-4492-ab40-72dc634df4ac tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] [instance: 97de391d-c836-40ac-b126-0b6684406d52] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:57:04.922198 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-5b9a9f8c-4237-4492-ab40-72dc634df4ac tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:04.922678 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-5b9a9f8c-4237-4492-ab40-72dc634df4ac tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:04.923113 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-5b9a9f8c-4237-4492-ab40-72dc634df4ac tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:04.923792 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-5b9a9f8c-4237-4492-ab40-72dc634df4ac tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:04.924277 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-5b9a9f8c-4237-4492-ab40-72dc634df4ac tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:04.924734 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-5b9a9f8c-4237-4492-ab40-72dc634df4ac tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:04.982663 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-f6ae742e-384f-4f5e-8d21-71fb49749e7a tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '576abe5db27b461889fef2029d477e40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e9fb3117f68434bae7a463c357818dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:57:04.991785 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-f6ae742e-384f-4f5e-8d21-71fb49749e7a tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '576abe5db27b461889fef2029d477e40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e9fb3117f68434bae7a463c357818dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:57:04.993277 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-f6ae742e-384f-4f5e-8d21-71fb49749e7a tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '576abe5db27b461889fef2029d477e40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e9fb3117f68434bae7a463c357818dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:57:04.998717 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-f6ae742e-384f-4f5e-8d21-71fb49749e7a tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] 10.222.0.13 "GET /compute/v2.1/servers/87679611-878a-49b2-bf8f-39e784c6d70b" status: 200 len: 1447 microversion: 2.75 time: 0.095656 Nov 01 18:57:04.999289 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 363/786] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 18:57:04 2022] GET /compute/v2.1/servers/87679611-878a-49b2-bf8f-39e784c6d70b => generated 1447 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 18:57:05.055290 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-5b9a9f8c-4237-4492-ab40-72dc634df4ac tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b52b7dcbb044f9bfc424e4417c77fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '708bc0ea4b5a4baf81933725792bedd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:57:05.063173 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-5b9a9f8c-4237-4492-ab40-72dc634df4ac tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] 10.222.0.13 "GET /compute/v2.1/servers/97de391d-c836-40ac-b126-0b6684406d52" status: 200 len: 1522 microversion: 2.1 time: 0.151270 Nov 01 18:57:05.063734 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 424/787] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:57:04 2022] GET /compute/v2.1/servers/97de391d-c836-40ac-b126-0b6684406d52 => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 18:57:05.085366 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-4ca3013e-482c-407f-a5bb-4ed7f2396e72 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Action: 'action', calling method: >, body: {"createImage": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 18:57:05.089415 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-4ca3013e-482c-407f-a5bb-4ed7f2396e72 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Request method failure captured: Nov 01 18:57:05.089415 n-d-863052-2 devstack@n-api.service[121403]: request: POST /compute/v2.1/servers/97de391d-c836-40ac-b126-0b6684406d52/action HTTP/1.1 Nov 01 18:57:05.089415 n-d-863052-2 devstack@n-api.service[121403]: Accept: application/json Nov 01 18:57:05.089415 n-d-863052-2 devstack@n-api.service[121403]: Accept-Encoding: identity Nov 01 18:57:05.089415 n-d-863052-2 devstack@n-api.service[121403]: Connection: close Nov 01 18:57:05.089415 n-d-863052-2 devstack@n-api.service[121403]: Content-Length: 285 Nov 01 18:57:05.089415 n-d-863052-2 devstack@n-api.service[121403]: Content-Type: application/json Nov 01 18:57:05.089415 n-d-863052-2 devstack@n-api.service[121403]: Host: 10.222.0.13 Nov 01 18:57:05.089415 n-d-863052-2 devstack@n-api.service[121403]: Openstack-System-Scope: None Nov 01 18:57:05.089415 n-d-863052-2 devstack@n-api.service[121403]: User-Agent: python-urllib3/1.26.12 Nov 01 18:57:05.089415 n-d-863052-2 devstack@n-api.service[121403]: X-Auth-Token: gAAAAABjYWvqbQtaNCf0vN3RIHicQ7eZzuMpptpvowYCNSOJcJRxrJ9QX4Bvdyyh6S1_lak_JDolcn4qSC02atGGl8uI3NqpWQKt52qXcbtBLMPpaEiNHqRmhd3SjpSTdiucZ2dSpVmatQ9uPpkpENeFkI_E8IIwNVu5-V-pSAlLNGA0j86IptM Nov 01 18:57:05.089415 n-d-863052-2 devstack@n-api.service[121403]: X-Domain-Id: None Nov 01 18:57:05.089415 n-d-863052-2 devstack@n-api.service[121403]: X-Domain-Name: None Nov 01 18:57:05.089415 n-d-863052-2 devstack@n-api.service[121403]: X-Identity-Status: Confirmed Nov 01 18:57:05.089415 n-d-863052-2 devstack@n-api.service[121403]: X-Is-Admin-Project: True Nov 01 18:57:05.089415 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Domain-Id: default Nov 01 18:57:05.089415 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Domain-Name: Default Nov 01 18:57:05.089415 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Id: 708bc0ea4b5a4baf81933725792bedd5 Nov 01 18:57:05.089415 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1431666313 Nov 01 18:57:05.089415 n-d-863052-2 devstack@n-api.service[121403]: X-Role: member,reader Nov 01 18:57:05.089415 n-d-863052-2 devstack@n-api.service[121403]: X-Roles: member,reader Nov 01 18:57:05.091001 n-d-863052-2 devstack@n-api.service[121403]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/708bc0ea4b5a4baf81933725792bedd5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/708bc0ea4b5a4baf81933725792bedd5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_708bc0ea4b5a4baf81933725792bedd5", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/708bc0ea4b5a4baf81933725792bedd5"}]}] Nov 01 18:57:05.091001 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1431666313 Nov 01 18:57:05.091001 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant-Id: 708bc0ea4b5a4baf81933725792bedd5 Nov 01 18:57:05.091001 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1431666313 Nov 01 18:57:05.091001 n-d-863052-2 devstack@n-api.service[121403]: X-User: tempest-ImagesOneServerNegativeTestJSON-1431666313-project Nov 01 18:57:05.091001 n-d-863052-2 devstack@n-api.service[121403]: X-User-Domain-Id: default Nov 01 18:57:05.091001 n-d-863052-2 devstack@n-api.service[121403]: X-User-Domain-Name: Default Nov 01 18:57:05.091001 n-d-863052-2 devstack@n-api.service[121403]: X-User-Id: 09b52b7dcbb044f9bfc424e4417c77fa Nov 01 18:57:05.091001 n-d-863052-2 devstack@n-api.service[121403]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1431666313-project Nov 01 18:57:05.091001 n-d-863052-2 devstack@n-api.service[121403]: Nov 01 18:57:05.091001 n-d-863052-2 devstack@n-api.service[121403]: {"createImage": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Nov 01 18:57:05.091785 n-d-863052-2 devstack@n-api.service[121403]: method: > Nov 01 18:57:05.091785 n-d-863052-2 devstack@n-api.service[121403]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Nov 01 18:57:05.091785 n-d-863052-2 devstack@n-api.service[121403]: action_args: {'id': '97de391d-c836-40ac-b126-0b6684406d52', 'body': {'createImage': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Nov 01 18:57:05.091785 n-d-863052-2 devstack@n-api.service[121403]: {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 01 18:57:05.091785 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:57:05.091785 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Nov 01 18:57:05.091785 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Nov 01 18:57:05.091785 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Nov 01 18:57:05.091785 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise error Nov 01 18:57:05.091785 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Nov 01 18:57:05.092444 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 18:57:05.092444 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['createImage']['properties']['name']: Nov 01 18:57:05.092444 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Nov 01 18:57:05.092444 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 18:57:05.092444 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi On instance['createImage']: Nov 01 18:57:05.092444 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Nov 01 18:57:05.092444 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 18:57:05.092444 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 18:57:05.092444 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 18:57:05.092444 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:57:05.092444 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 18:57:05.092444 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 18:57:05.092444 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 01 18:57:05.092444 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 01 18:57:05.092444 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 01 18:57:05.092444 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 01 18:57:05.092444 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 01 18:57:05.092444 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 01 18:57:05.092444 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Nov 01 18:57:05.092444 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Nov 01 18:57:05.093749 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Nov 01 18:57:05.093749 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Nov 01 18:57:05.093749 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Nov 01 18:57:05.093749 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Nov 01 18:57:05.093749 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Nov 01 18:57:05.093749 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 18:57:05.093749 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 18:57:05.093749 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 18:57:05.093749 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:57:05.093749 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 18:57:05.093749 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 18:57:05.093749 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Nov 01 18:57:05.093749 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Nov 01 18:57:05.094632 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Nov 01 18:57:05.094632 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 18:57:05.094632 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-4ca3013e-482c-407f-a5bb-4ed7f2396e72 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=121403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 01 18:57:05.094632 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-4ca3013e-482c-407f-a5bb-4ed7f2396e72 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] 10.222.0.13 "POST /compute/v2.1/servers/97de391d-c836-40ac-b126-0b6684406d52/action" status: 400 len: 619 microversion: 2.1 time: 0.010972 Nov 01 18:57:05.094979 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 364/788] 10.222.0.13 () {60 vars in 1279 bytes} [Tue Nov 1 18:57:05 2022] POST /compute/v2.1/servers/97de391d-c836-40ac-b126-0b6684406d52/action => generated 619 bytes in 13 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 01 18:57:05.102905 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-0f27d03f-fc90-4359-9e49-d39ba0b49ea7 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:57:05.103516 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-0f27d03f-fc90-4359-9e49-d39ba0b49ea7 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] [instance: 97de391d-c836-40ac-b126-0b6684406d52] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:57:05.109504 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-0f27d03f-fc90-4359-9e49-d39ba0b49ea7 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:05.109987 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-0f27d03f-fc90-4359-9e49-d39ba0b49ea7 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:05.110424 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-0f27d03f-fc90-4359-9e49-d39ba0b49ea7 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:05.111112 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-0f27d03f-fc90-4359-9e49-d39ba0b49ea7 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:05.111567 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-0f27d03f-fc90-4359-9e49-d39ba0b49ea7 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:05.111994 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-0f27d03f-fc90-4359-9e49-d39ba0b49ea7 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:05.258224 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-f21cdb40-ed50-4c28-95c7-6e3de37bb11b tempest-ServerAddressesNegativeTestJSON-736278170 tempest-ServerAddressesNegativeTestJSON-736278170-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:57:05.258838 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-f21cdb40-ed50-4c28-95c7-6e3de37bb11b tempest-ServerAddressesNegativeTestJSON-736278170 tempest-ServerAddressesNegativeTestJSON-736278170-project] [instance: 034c1271-a323-4728-985c-3d70df31eeb2] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:57:05.261537 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-0f27d03f-fc90-4359-9e49-d39ba0b49ea7 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b52b7dcbb044f9bfc424e4417c77fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '708bc0ea4b5a4baf81933725792bedd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:57:05.267002 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f21cdb40-ed50-4c28-95c7-6e3de37bb11b tempest-ServerAddressesNegativeTestJSON-736278170 tempest-ServerAddressesNegativeTestJSON-736278170-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:05.268051 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f21cdb40-ed50-4c28-95c7-6e3de37bb11b tempest-ServerAddressesNegativeTestJSON-736278170 tempest-ServerAddressesNegativeTestJSON-736278170-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:05.268694 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f21cdb40-ed50-4c28-95c7-6e3de37bb11b tempest-ServerAddressesNegativeTestJSON-736278170 tempest-ServerAddressesNegativeTestJSON-736278170-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:05.269605 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f21cdb40-ed50-4c28-95c7-6e3de37bb11b tempest-ServerAddressesNegativeTestJSON-736278170 tempest-ServerAddressesNegativeTestJSON-736278170-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:05.270209 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f21cdb40-ed50-4c28-95c7-6e3de37bb11b tempest-ServerAddressesNegativeTestJSON-736278170 tempest-ServerAddressesNegativeTestJSON-736278170-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:05.270332 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-0f27d03f-fc90-4359-9e49-d39ba0b49ea7 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] 10.222.0.13 "GET /compute/v2.1/servers/97de391d-c836-40ac-b126-0b6684406d52" status: 200 len: 1522 microversion: 2.1 time: 0.171469 Nov 01 18:57:05.274916 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 425/789] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:57:05 2022] GET /compute/v2.1/servers/97de391d-c836-40ac-b126-0b6684406d52 => generated 1522 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 18:57:05.290850 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f21cdb40-ed50-4c28-95c7-6e3de37bb11b tempest-ServerAddressesNegativeTestJSON-736278170 tempest-ServerAddressesNegativeTestJSON-736278170-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:05.297560 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-f6ddfe33-4ce1-4090-88b0-b31dc0449c90 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:57:05.298441 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-f6ddfe33-4ce1-4090-88b0-b31dc0449c90 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] [instance: 97de391d-c836-40ac-b126-0b6684406d52] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:57:05.308983 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f6ddfe33-4ce1-4090-88b0-b31dc0449c90 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:05.310920 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f6ddfe33-4ce1-4090-88b0-b31dc0449c90 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:05.311527 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f6ddfe33-4ce1-4090-88b0-b31dc0449c90 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:05.313692 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f6ddfe33-4ce1-4090-88b0-b31dc0449c90 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:05.314319 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f6ddfe33-4ce1-4090-88b0-b31dc0449c90 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:05.315854 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f6ddfe33-4ce1-4090-88b0-b31dc0449c90 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:05.340379 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f21cdb40-ed50-4c28-95c7-6e3de37bb11b tempest-ServerAddressesNegativeTestJSON-736278170 tempest-ServerAddressesNegativeTestJSON-736278170-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:05.341749 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f21cdb40-ed50-4c28-95c7-6e3de37bb11b tempest-ServerAddressesNegativeTestJSON-736278170 tempest-ServerAddressesNegativeTestJSON-736278170-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:05.342337 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f21cdb40-ed50-4c28-95c7-6e3de37bb11b tempest-ServerAddressesNegativeTestJSON-736278170 tempest-ServerAddressesNegativeTestJSON-736278170-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:05.342947 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.objects.instance [None req-f21cdb40-ed50-4c28-95c7-6e3de37bb11b tempest-ServerAddressesNegativeTestJSON-736278170 tempest-ServerAddressesNegativeTestJSON-736278170-project] Lazy-loading 'fault' on Instance uuid 034c1271-a323-4728-985c-3d70df31eeb2 {{(pid=121403) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 01 18:57:05.439717 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-f21cdb40-ed50-4c28-95c7-6e3de37bb11b tempest-ServerAddressesNegativeTestJSON-736278170 tempest-ServerAddressesNegativeTestJSON-736278170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5a7d955d1004147b12eb569a7e7355a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d85b21bccf4bc78d4cbffd4f80357f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:57:05.449980 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-f21cdb40-ed50-4c28-95c7-6e3de37bb11b tempest-ServerAddressesNegativeTestJSON-736278170 tempest-ServerAddressesNegativeTestJSON-736278170-project] 10.222.0.13 "GET /compute/v2.1/servers/034c1271-a323-4728-985c-3d70df31eeb2" status: 200 len: 1315 microversion: 2.1 time: 0.195731 Nov 01 18:57:05.466170 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 365/790] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:57:05 2022] GET /compute/v2.1/servers/034c1271-a323-4728-985c-3d70df31eeb2 => generated 1315 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 18:57:05.470571 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-edbde13a-0f4c-42e4-a2f4-a1e1a91dcc6a tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:57:05.471195 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-edbde13a-0f4c-42e4-a2f4-a1e1a91dcc6a tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] [instance: ab3530ff-d70f-4c6c-abd0-3afa14fd9954] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:57:05.488703 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-edbde13a-0f4c-42e4-a2f4-a1e1a91dcc6a tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:05.489527 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-edbde13a-0f4c-42e4-a2f4-a1e1a91dcc6a tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:05.491716 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-edbde13a-0f4c-42e4-a2f4-a1e1a91dcc6a tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:05.492480 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-edbde13a-0f4c-42e4-a2f4-a1e1a91dcc6a tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:05.495795 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-edbde13a-0f4c-42e4-a2f4-a1e1a91dcc6a tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:05.497156 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-edbde13a-0f4c-42e4-a2f4-a1e1a91dcc6a tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:05.606160 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-f6ddfe33-4ce1-4090-88b0-b31dc0449c90 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b52b7dcbb044f9bfc424e4417c77fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '708bc0ea4b5a4baf81933725792bedd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:57:05.614103 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-f6ddfe33-4ce1-4090-88b0-b31dc0449c90 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] 10.222.0.13 "GET /compute/v2.1/servers/97de391d-c836-40ac-b126-0b6684406d52" status: 200 len: 1522 microversion: 2.1 time: 0.322504 Nov 01 18:57:05.630914 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 426/791] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:57:05 2022] GET /compute/v2.1/servers/97de391d-c836-40ac-b126-0b6684406d52 => generated 1522 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 18:57:05.635667 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-ae148444-4af6-468d-960c-71debaa14015 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:57:05.636273 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-ae148444-4af6-468d-960c-71debaa14015 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] [instance: bee52bae-2df5-46a3-9aa9-f6b24bea11e3] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:57:05.651050 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-ae148444-4af6-468d-960c-71debaa14015 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:05.651544 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-ae148444-4af6-468d-960c-71debaa14015 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:05.652191 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-ae148444-4af6-468d-960c-71debaa14015 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:05.652952 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-ae148444-4af6-468d-960c-71debaa14015 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:05.653413 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-ae148444-4af6-468d-960c-71debaa14015 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:05.653837 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-ae148444-4af6-468d-960c-71debaa14015 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:05.797548 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-edbde13a-0f4c-42e4-a2f4-a1e1a91dcc6a tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07a2a96629f4baea6a3adfc4011ffe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9baf3860ba564f5c8dff93085b9aabe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:57:05.805753 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-edbde13a-0f4c-42e4-a2f4-a1e1a91dcc6a tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] 10.222.0.13 "GET /compute/v2.1/servers/ab3530ff-d70f-4c6c-abd0-3afa14fd9954" status: 200 len: 1713 microversion: 2.1 time: 0.345559 Nov 01 18:57:05.806321 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 366/792] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:57:05 2022] GET /compute/v2.1/servers/ab3530ff-d70f-4c6c-abd0-3afa14fd9954 => generated 1713 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:57:05.826370 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-2648ec07-9d3f-4c69-8e94-a5d53ae14365 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-172373995"}} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 18:57:05.829071 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-2648ec07-9d3f-4c69-8e94-a5d53ae14365 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] [instance: 97de391d-c836-40ac-b126-0b6684406d52] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:57:05.836030 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-2648ec07-9d3f-4c69-8e94-a5d53ae14365 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:05.836671 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-2648ec07-9d3f-4c69-8e94-a5d53ae14365 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:05.837182 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-2648ec07-9d3f-4c69-8e94-a5d53ae14365 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:05.838071 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-2648ec07-9d3f-4c69-8e94-a5d53ae14365 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:05.838710 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-2648ec07-9d3f-4c69-8e94-a5d53ae14365 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:05.839139 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-2648ec07-9d3f-4c69-8e94-a5d53ae14365 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:05.882034 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-ae148444-4af6-468d-960c-71debaa14015 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:57:05.885547 n-d-863052-2 devstack@n-api.service[121402]: DEBUG dbcounter [-] [121402] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 18:57:05.902667 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-ae148444-4af6-468d-960c-71debaa14015 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:57:05.904105 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-ae148444-4af6-468d-960c-71debaa14015 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:57:05.909101 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-ae148444-4af6-468d-960c-71debaa14015 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] 10.222.0.13 "GET /compute/v2.1/servers/bee52bae-2df5-46a3-9aa9-f6b24bea11e3" status: 200 len: 1566 microversion: 2.25 time: 0.275826 Nov 01 18:57:05.910984 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 427/793] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 18:57:05 2022] GET /compute/v2.1/servers/bee52bae-2df5-46a3-9aa9-f6b24bea11e3 => generated 1566 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 18:57:05.917072 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-76aff80b-b328-4566-932b-d905ce442dfd tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:57:05.917731 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-76aff80b-b328-4566-932b-d905ce442dfd tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] [instance: 2d525a31-b0be-44cb-8fb7-335075145f08] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:57:05.933736 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-76aff80b-b328-4566-932b-d905ce442dfd tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:05.934257 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-76aff80b-b328-4566-932b-d905ce442dfd tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:05.934931 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-76aff80b-b328-4566-932b-d905ce442dfd tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:05.938786 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-76aff80b-b328-4566-932b-d905ce442dfd tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:05.939468 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-76aff80b-b328-4566-932b-d905ce442dfd tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:05.939934 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-76aff80b-b328-4566-932b-d905ce442dfd tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:06.165611 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-2648ec07-9d3f-4c69-8e94-a5d53ae14365 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] 10.222.0.13 "POST /compute/v2.1/servers/97de391d-c836-40ac-b126-0b6684406d52/action" status: 202 len: 0 microversion: 2.1 time: 0.357957 Nov 01 18:57:06.167669 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 367/794] 10.222.0.13 () {60 vars in 1278 bytes} [Tue Nov 1 18:57:05 2022] POST /compute/v2.1/servers/97de391d-c836-40ac-b126-0b6684406d52/action => generated 0 bytes in 361 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 01 18:57:06.178615 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-a5ee0106-84f7-4977-9c01-aae8cb895ada tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:57:06.179592 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-a5ee0106-84f7-4977-9c01-aae8cb895ada tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] [instance: ea631032-dd04-429b-988e-e6362ea42cf7] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:57:06.188281 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-a5ee0106-84f7-4977-9c01-aae8cb895ada tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:06.190205 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-a5ee0106-84f7-4977-9c01-aae8cb895ada tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:06.191011 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-a5ee0106-84f7-4977-9c01-aae8cb895ada tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:06.192613 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-a5ee0106-84f7-4977-9c01-aae8cb895ada tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:06.193470 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-a5ee0106-84f7-4977-9c01-aae8cb895ada tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:06.194064 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-a5ee0106-84f7-4977-9c01-aae8cb895ada tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:06.294326 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-76aff80b-b328-4566-932b-d905ce442dfd tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f32f5fba1976432d938e664c7714e52b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b9d4c236b944f9b2e8e502a50a8f8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:57:06.308638 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-a5ee0106-84f7-4977-9c01-aae8cb895ada tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c1314c21d8547ff890ede1c2ad281c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c804370880454c7aa02cef2c2c3cf144', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:57:06.310684 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-76aff80b-b328-4566-932b-d905ce442dfd tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] 10.222.0.13 "GET /compute/v2.1/servers/2d525a31-b0be-44cb-8fb7-335075145f08" status: 200 len: 1361 microversion: 2.1 time: 0.398369 Nov 01 18:57:06.311750 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 428/795] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:57:05 2022] GET /compute/v2.1/servers/2d525a31-b0be-44cb-8fb7-335075145f08 => generated 1361 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:57:06.318573 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-6bde1b3a-937f-4d8e-aa6e-4903cb73350c tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:57:06.319626 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-6bde1b3a-937f-4d8e-aa6e-4903cb73350c tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] [instance: 7218f99b-b011-4f08-931e-340d47069f6e] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:57:06.333988 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-a5ee0106-84f7-4977-9c01-aae8cb895ada tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c1314c21d8547ff890ede1c2ad281c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c804370880454c7aa02cef2c2c3cf144', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:57:06.335603 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-a5ee0106-84f7-4977-9c01-aae8cb895ada tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c1314c21d8547ff890ede1c2ad281c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c804370880454c7aa02cef2c2c3cf144', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:57:06.339893 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-6bde1b3a-937f-4d8e-aa6e-4903cb73350c tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:06.340541 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-6bde1b3a-937f-4d8e-aa6e-4903cb73350c tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:06.342315 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-6bde1b3a-937f-4d8e-aa6e-4903cb73350c tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:06.344299 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-6bde1b3a-937f-4d8e-aa6e-4903cb73350c tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:06.345017 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-a5ee0106-84f7-4977-9c01-aae8cb895ada tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] 10.222.0.13 "GET /compute/v2.1/servers/ea631032-dd04-429b-988e-e6362ea42cf7" status: 200 len: 1538 microversion: 2.91 time: 0.175724 Nov 01 18:57:06.345913 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 368/796] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 18:57:06 2022] GET /compute/v2.1/servers/ea631032-dd04-429b-988e-e6362ea42cf7 => generated 1538 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 18:57:06.351004 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-ff978c92-94de-480c-a4d8-fc029bebc9ed tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:57:06.351647 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-ff978c92-94de-480c-a4d8-fc029bebc9ed tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] [instance: 87679611-878a-49b2-bf8f-39e784c6d70b] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:57:06.356437 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-6bde1b3a-937f-4d8e-aa6e-4903cb73350c tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:06.365987 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-6bde1b3a-937f-4d8e-aa6e-4903cb73350c tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:06.373792 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-ff978c92-94de-480c-a4d8-fc029bebc9ed tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:06.374378 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-ff978c92-94de-480c-a4d8-fc029bebc9ed tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:06.375930 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-ff978c92-94de-480c-a4d8-fc029bebc9ed tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:06.376949 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-ff978c92-94de-480c-a4d8-fc029bebc9ed tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:06.377600 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-ff978c92-94de-480c-a4d8-fc029bebc9ed tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:06.378227 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-ff978c92-94de-480c-a4d8-fc029bebc9ed tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:06.518625 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-ff978c92-94de-480c-a4d8-fc029bebc9ed tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '576abe5db27b461889fef2029d477e40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e9fb3117f68434bae7a463c357818dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:57:06.528574 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-6bde1b3a-937f-4d8e-aa6e-4903cb73350c tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72117f17294649d6b8bc16c66c7efab2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45d4c047d3c44324a27a27831236ab0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:57:06.530343 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-ff978c92-94de-480c-a4d8-fc029bebc9ed tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '576abe5db27b461889fef2029d477e40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e9fb3117f68434bae7a463c357818dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:57:06.531831 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-ff978c92-94de-480c-a4d8-fc029bebc9ed tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '576abe5db27b461889fef2029d477e40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e9fb3117f68434bae7a463c357818dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:57:06.543285 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-ff978c92-94de-480c-a4d8-fc029bebc9ed tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] 10.222.0.13 "GET /compute/v2.1/servers/87679611-878a-49b2-bf8f-39e784c6d70b" status: 200 len: 1447 microversion: 2.75 time: 0.196252 Nov 01 18:57:06.544128 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 369/797] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 18:57:06 2022] GET /compute/v2.1/servers/87679611-878a-49b2-bf8f-39e784c6d70b => generated 1447 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 18:57:06.546847 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-6bde1b3a-937f-4d8e-aa6e-4903cb73350c tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] 10.222.0.13 "GET /compute/v2.1/servers/7218f99b-b011-4f08-931e-340d47069f6e" status: 200 len: 1270 microversion: 2.1 time: 0.233068 Nov 01 18:57:06.556738 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 429/798] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:57:06 2022] GET /compute/v2.1/servers/7218f99b-b011-4f08-931e-340d47069f6e => generated 1270 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:57:06.556738 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-a0cdbfaa-c616-42e3-b72b-e7c457855422 tempest-UnshelveToHostMultiNodesTest-2124505700 tempest-UnshelveToHostMultiNodesTest-2124505700-project-admin] Action: 'action', calling method: >, body: {"unshelve": {"host": "n-h1-863052-2"}} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 18:57:06.556738 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-a0cdbfaa-c616-42e3-b72b-e7c457855422 tempest-UnshelveToHostMultiNodesTest-2124505700 tempest-UnshelveToHostMultiNodesTest-2124505700-project-admin] [instance: ea631032-dd04-429b-988e-e6362ea42cf7] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:57:06.564667 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-d10bb30f-ff80-4fd6-99aa-67a26118c409 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1001360765"}} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 18:57:06.564667 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-d10bb30f-ff80-4fd6-99aa-67a26118c409 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] [instance: 97de391d-c836-40ac-b126-0b6684406d52] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:57:06.575644 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-a0cdbfaa-c616-42e3-b72b-e7c457855422 tempest-UnshelveToHostMultiNodesTest-2124505700 tempest-UnshelveToHostMultiNodesTest-2124505700-project-admin] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:06.576001 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-a0cdbfaa-c616-42e3-b72b-e7c457855422 tempest-UnshelveToHostMultiNodesTest-2124505700 tempest-UnshelveToHostMultiNodesTest-2124505700-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:06.576436 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-a0cdbfaa-c616-42e3-b72b-e7c457855422 tempest-UnshelveToHostMultiNodesTest-2124505700 tempest-UnshelveToHostMultiNodesTest-2124505700-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:06.577170 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-a0cdbfaa-c616-42e3-b72b-e7c457855422 tempest-UnshelveToHostMultiNodesTest-2124505700 tempest-UnshelveToHostMultiNodesTest-2124505700-project-admin] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:06.577631 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-a0cdbfaa-c616-42e3-b72b-e7c457855422 tempest-UnshelveToHostMultiNodesTest-2124505700 tempest-UnshelveToHostMultiNodesTest-2124505700-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:06.578986 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d10bb30f-ff80-4fd6-99aa-67a26118c409 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:06.578986 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d10bb30f-ff80-4fd6-99aa-67a26118c409 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:06.579374 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d10bb30f-ff80-4fd6-99aa-67a26118c409 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:06.580264 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d10bb30f-ff80-4fd6-99aa-67a26118c409 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:06.580519 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d10bb30f-ff80-4fd6-99aa-67a26118c409 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:06.580963 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d10bb30f-ff80-4fd6-99aa-67a26118c409 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:06.583952 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-a0cdbfaa-c616-42e3-b72b-e7c457855422 tempest-UnshelveToHostMultiNodesTest-2124505700 tempest-UnshelveToHostMultiNodesTest-2124505700-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:06.623265 n-d-863052-2 devstack@n-api.service[121403]: DEBUG dbcounter [-] [121403] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 18:57:06.627799 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.wsgi [None req-d10bb30f-ff80-4fd6-99aa-67a26118c409 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] HTTP exception thrown: Cannot 'createImage' instance 97de391d-c836-40ac-b126-0b6684406d52 while it is in task_state image_snapshot_pending Nov 01 18:57:06.629885 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-d10bb30f-ff80-4fd6-99aa-67a26118c409 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Request method failure captured: Nov 01 18:57:06.629885 n-d-863052-2 devstack@n-api.service[121403]: request: POST /compute/v2.1/servers/97de391d-c836-40ac-b126-0b6684406d52/action HTTP/1.1 Nov 01 18:57:06.629885 n-d-863052-2 devstack@n-api.service[121403]: Accept: application/json Nov 01 18:57:06.629885 n-d-863052-2 devstack@n-api.service[121403]: Accept-Encoding: identity Nov 01 18:57:06.629885 n-d-863052-2 devstack@n-api.service[121403]: Connection: close Nov 01 18:57:06.629885 n-d-863052-2 devstack@n-api.service[121403]: Content-Length: 85 Nov 01 18:57:06.629885 n-d-863052-2 devstack@n-api.service[121403]: Content-Type: application/json Nov 01 18:57:06.629885 n-d-863052-2 devstack@n-api.service[121403]: Host: 10.222.0.13 Nov 01 18:57:06.629885 n-d-863052-2 devstack@n-api.service[121403]: Openstack-System-Scope: None Nov 01 18:57:06.629885 n-d-863052-2 devstack@n-api.service[121403]: User-Agent: python-urllib3/1.26.12 Nov 01 18:57:06.629885 n-d-863052-2 devstack@n-api.service[121403]: X-Auth-Token: gAAAAABjYWvqbQtaNCf0vN3RIHicQ7eZzuMpptpvowYCNSOJcJRxrJ9QX4Bvdyyh6S1_lak_JDolcn4qSC02atGGl8uI3NqpWQKt52qXcbtBLMPpaEiNHqRmhd3SjpSTdiucZ2dSpVmatQ9uPpkpENeFkI_E8IIwNVu5-V-pSAlLNGA0j86IptM Nov 01 18:57:06.629885 n-d-863052-2 devstack@n-api.service[121403]: X-Domain-Id: None Nov 01 18:57:06.629885 n-d-863052-2 devstack@n-api.service[121403]: X-Domain-Name: None Nov 01 18:57:06.629885 n-d-863052-2 devstack@n-api.service[121403]: X-Identity-Status: Confirmed Nov 01 18:57:06.629885 n-d-863052-2 devstack@n-api.service[121403]: X-Is-Admin-Project: True Nov 01 18:57:06.629885 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Domain-Id: default Nov 01 18:57:06.629885 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Domain-Name: Default Nov 01 18:57:06.629885 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Id: 708bc0ea4b5a4baf81933725792bedd5 Nov 01 18:57:06.629885 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1431666313 Nov 01 18:57:06.629885 n-d-863052-2 devstack@n-api.service[121403]: X-Role: member,reader Nov 01 18:57:06.629885 n-d-863052-2 devstack@n-api.service[121403]: X-Roles: member,reader Nov 01 18:57:06.631181 n-d-863052-2 devstack@n-api.service[121403]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/708bc0ea4b5a4baf81933725792bedd5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/708bc0ea4b5a4baf81933725792bedd5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_708bc0ea4b5a4baf81933725792bedd5", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/708bc0ea4b5a4baf81933725792bedd5"}]}] Nov 01 18:57:06.631181 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1431666313 Nov 01 18:57:06.631181 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant-Id: 708bc0ea4b5a4baf81933725792bedd5 Nov 01 18:57:06.631181 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1431666313 Nov 01 18:57:06.631181 n-d-863052-2 devstack@n-api.service[121403]: X-User: tempest-ImagesOneServerNegativeTestJSON-1431666313-project Nov 01 18:57:06.631181 n-d-863052-2 devstack@n-api.service[121403]: X-User-Domain-Id: default Nov 01 18:57:06.631181 n-d-863052-2 devstack@n-api.service[121403]: X-User-Domain-Name: Default Nov 01 18:57:06.631181 n-d-863052-2 devstack@n-api.service[121403]: X-User-Id: 09b52b7dcbb044f9bfc424e4417c77fa Nov 01 18:57:06.631181 n-d-863052-2 devstack@n-api.service[121403]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1431666313-project Nov 01 18:57:06.631181 n-d-863052-2 devstack@n-api.service[121403]: Nov 01 18:57:06.631181 n-d-863052-2 devstack@n-api.service[121403]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1001360765"}} Nov 01 18:57:06.631181 n-d-863052-2 devstack@n-api.service[121403]: method: > Nov 01 18:57:06.631891 n-d-863052-2 devstack@n-api.service[121403]: exception: Cannot 'createImage' instance 97de391d-c836-40ac-b126-0b6684406d52 while it is in task_state image_snapshot_pending Nov 01 18:57:06.631891 n-d-863052-2 devstack@n-api.service[121403]: action_args: {'id': '97de391d-c836-40ac-b126-0b6684406d52', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-1001360765'}}} Nov 01 18:57:06.631891 n-d-863052-2 devstack@n-api.service[121403]: {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 01 18:57:06.631891 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:57:06.631891 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1349, in _action_create_image Nov 01 18:57:06.631891 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi image = self.compute_api.snapshot(context, Nov 01 18:57:06.631891 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 155, in inner Nov 01 18:57:06.631891 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Nov 01 18:57:06.631891 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 97de391d-c836-40ac-b126-0b6684406d52 in task_state image_snapshot_pending. Cannot snapshot while the instance is in this state. Nov 01 18:57:06.631891 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 18:57:06.631891 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 18:57:06.631891 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 18:57:06.631891 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:57:06.631891 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 18:57:06.631891 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 18:57:06.631891 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 01 18:57:06.631891 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 01 18:57:06.631891 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 01 18:57:06.631891 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 01 18:57:06.633047 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 01 18:57:06.633047 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 01 18:57:06.633047 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 01 18:57:06.633047 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 01 18:57:06.633047 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1354, in _action_create_image Nov 01 18:57:06.633047 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Nov 01 18:57:06.633047 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Nov 01 18:57:06.633047 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Nov 01 18:57:06.633047 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'createImage' instance 97de391d-c836-40ac-b126-0b6684406d52 while it is in task_state image_snapshot_pending Nov 01 18:57:06.633047 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 18:57:06.633047 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 18:57:06.633047 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 18:57:06.633047 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:57:06.633047 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 18:57:06.633047 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 18:57:06.633047 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 01 18:57:06.633047 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 01 18:57:06.633047 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'createImage' instance 97de391d-c836-40ac-b126-0b6684406d52 while it is in task_state image_snapshot_pending Nov 01 18:57:06.633047 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 18:57:06.634141 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-d10bb30f-ff80-4fd6-99aa-67a26118c409 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Returning 409 to user: Cannot 'createImage' instance 97de391d-c836-40ac-b126-0b6684406d52 while it is in task_state image_snapshot_pending {{(pid=121403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 01 18:57:06.634141 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-d10bb30f-ff80-4fd6-99aa-67a26118c409 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] 10.222.0.13 "POST /compute/v2.1/servers/97de391d-c836-40ac-b126-0b6684406d52/action" status: 409 len: 167 microversion: 2.1 time: 0.089351 Nov 01 18:57:06.635482 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 370/799] 10.222.0.13 () {60 vars in 1278 bytes} [Tue Nov 1 18:57:06 2022] POST /compute/v2.1/servers/97de391d-c836-40ac-b126-0b6684406d52/action => generated 167 bytes in 91 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Nov 01 18:57:06.641438 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-0525c2c6-3159-4247-b86b-4864366221f5 tempest-ServerAddressesNegativeTestJSON-736278170 tempest-ServerAddressesNegativeTestJSON-736278170-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:57:06.642052 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-0525c2c6-3159-4247-b86b-4864366221f5 tempest-ServerAddressesNegativeTestJSON-736278170 tempest-ServerAddressesNegativeTestJSON-736278170-project] [instance: 034c1271-a323-4728-985c-3d70df31eeb2] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:57:06.648106 n-d-863052-2 devstack@n-api.service[121403]: DEBUG dbcounter [-] [121403] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=121403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 18:57:06.654108 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-0525c2c6-3159-4247-b86b-4864366221f5 tempest-ServerAddressesNegativeTestJSON-736278170 tempest-ServerAddressesNegativeTestJSON-736278170-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:06.654789 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-0525c2c6-3159-4247-b86b-4864366221f5 tempest-ServerAddressesNegativeTestJSON-736278170 tempest-ServerAddressesNegativeTestJSON-736278170-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:06.655150 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-0525c2c6-3159-4247-b86b-4864366221f5 tempest-ServerAddressesNegativeTestJSON-736278170 tempest-ServerAddressesNegativeTestJSON-736278170-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:06.655857 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-0525c2c6-3159-4247-b86b-4864366221f5 tempest-ServerAddressesNegativeTestJSON-736278170 tempest-ServerAddressesNegativeTestJSON-736278170-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:06.656512 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-0525c2c6-3159-4247-b86b-4864366221f5 tempest-ServerAddressesNegativeTestJSON-736278170 tempest-ServerAddressesNegativeTestJSON-736278170-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:06.658792 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-0525c2c6-3159-4247-b86b-4864366221f5 tempest-ServerAddressesNegativeTestJSON-736278170 tempest-ServerAddressesNegativeTestJSON-736278170-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:06.662635 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-a0cdbfaa-c616-42e3-b72b-e7c457855422 tempest-UnshelveToHostMultiNodesTest-2124505700 tempest-UnshelveToHostMultiNodesTest-2124505700-project-admin] [instance: ea631032-dd04-429b-988e-e6362ea42cf7] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "n-h1-863052-2". {{(pid=121402) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Nov 01 18:57:06.738027 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-0525c2c6-3159-4247-b86b-4864366221f5 tempest-ServerAddressesNegativeTestJSON-736278170 tempest-ServerAddressesNegativeTestJSON-736278170-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:06.738027 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-0525c2c6-3159-4247-b86b-4864366221f5 tempest-ServerAddressesNegativeTestJSON-736278170 tempest-ServerAddressesNegativeTestJSON-736278170-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:06.738883 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-0525c2c6-3159-4247-b86b-4864366221f5 tempest-ServerAddressesNegativeTestJSON-736278170 tempest-ServerAddressesNegativeTestJSON-736278170-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:06.739608 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.objects.instance [None req-0525c2c6-3159-4247-b86b-4864366221f5 tempest-ServerAddressesNegativeTestJSON-736278170 tempest-ServerAddressesNegativeTestJSON-736278170-project] Lazy-loading 'fault' on Instance uuid 034c1271-a323-4728-985c-3d70df31eeb2 {{(pid=121403) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 01 18:57:06.775583 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-a0cdbfaa-c616-42e3-b72b-e7c457855422 tempest-UnshelveToHostMultiNodesTest-2124505700 tempest-UnshelveToHostMultiNodesTest-2124505700-project-admin] 10.222.0.13 "POST /compute/v2.1/servers/ea631032-dd04-429b-988e-e6362ea42cf7/action" status: 202 len: 0 microversion: 2.91 time: 0.227111 Nov 01 18:57:06.780083 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 430/800] 10.222.0.13 () {62 vars in 1319 bytes} [Tue Nov 1 18:57:06 2022] POST /compute/v2.1/servers/ea631032-dd04-429b-988e-e6362ea42cf7/action => generated 0 bytes in 232 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 01 18:57:06.785749 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-9a469a36-3b9f-44f9-96f2-67d9e3eb51b8 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Calling method '.version_select at 0x7f0ae2e02c10>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:57:06.818091 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-0525c2c6-3159-4247-b86b-4864366221f5 tempest-ServerAddressesNegativeTestJSON-736278170 tempest-ServerAddressesNegativeTestJSON-736278170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5a7d955d1004147b12eb569a7e7355a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d85b21bccf4bc78d4cbffd4f80357f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:57:06.827750 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-0525c2c6-3159-4247-b86b-4864366221f5 tempest-ServerAddressesNegativeTestJSON-736278170 tempest-ServerAddressesNegativeTestJSON-736278170-project] 10.222.0.13 "GET /compute/v2.1/servers/034c1271-a323-4728-985c-3d70df31eeb2" status: 200 len: 1315 microversion: 2.1 time: 0.191318 Nov 01 18:57:06.841218 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 371/801] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:57:06 2022] GET /compute/v2.1/servers/034c1271-a323-4728-985c-3d70df31eeb2 => generated 1315 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:57:06.841218 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-cbf5bb8d-fd23-4368-a28a-c01f970165cc tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:57:06.841218 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-cbf5bb8d-fd23-4368-a28a-c01f970165cc tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] [instance: ea631032-dd04-429b-988e-e6362ea42cf7] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:57:06.841218 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-cbf5bb8d-fd23-4368-a28a-c01f970165cc tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:06.841934 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-cbf5bb8d-fd23-4368-a28a-c01f970165cc tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:06.841934 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-cbf5bb8d-fd23-4368-a28a-c01f970165cc tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:06.841934 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-cbf5bb8d-fd23-4368-a28a-c01f970165cc tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:06.848722 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-cbf5bb8d-fd23-4368-a28a-c01f970165cc tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:06.853533 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-cbf5bb8d-fd23-4368-a28a-c01f970165cc tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:07.039597 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-9a469a36-3b9f-44f9-96f2-67d9e3eb51b8 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] 10.222.0.13 "DELETE /compute/v2.1/images/0c425376-8367-4840-be1a-213cd2791d79" status: 204 len: 0 microversion: 2.1 time: 0.258024 Nov 01 18:57:07.041042 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 431/802] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:57:06 2022] DELETE /compute/v2.1/images/0c425376-8367-4840-be1a-213cd2791d79 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 01 18:57:07.046327 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-df358158-ab0b-43ca-b199-a6a592e9a300 tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:57:07.047103 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-df358158-ab0b-43ca-b199-a6a592e9a300 tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] [instance: ab3530ff-d70f-4c6c-abd0-3afa14fd9954] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:57:07.059893 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-df358158-ab0b-43ca-b199-a6a592e9a300 tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:07.063469 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-df358158-ab0b-43ca-b199-a6a592e9a300 tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:07.064159 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-df358158-ab0b-43ca-b199-a6a592e9a300 tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:07.065093 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-df358158-ab0b-43ca-b199-a6a592e9a300 tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:07.068748 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-df358158-ab0b-43ca-b199-a6a592e9a300 tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:07.069462 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-df358158-ab0b-43ca-b199-a6a592e9a300 tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:07.146316 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-cbf5bb8d-fd23-4368-a28a-c01f970165cc tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c1314c21d8547ff890ede1c2ad281c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c804370880454c7aa02cef2c2c3cf144', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:57:07.155629 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-cbf5bb8d-fd23-4368-a28a-c01f970165cc tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c1314c21d8547ff890ede1c2ad281c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c804370880454c7aa02cef2c2c3cf144', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:57:07.161815 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-cbf5bb8d-fd23-4368-a28a-c01f970165cc tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c1314c21d8547ff890ede1c2ad281c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c804370880454c7aa02cef2c2c3cf144', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:57:07.175489 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-cbf5bb8d-fd23-4368-a28a-c01f970165cc tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] 10.222.0.13 "GET /compute/v2.1/servers/ea631032-dd04-429b-988e-e6362ea42cf7" status: 200 len: 1546 microversion: 2.91 time: 0.345703 Nov 01 18:57:07.178855 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 372/803] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 18:57:06 2022] GET /compute/v2.1/servers/ea631032-dd04-429b-988e-e6362ea42cf7 => generated 1546 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 18:57:07.207713 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-3d401c0d-3734-4d5f-ac58-4afef3b15a0f tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:57:07.208641 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-3d401c0d-3734-4d5f-ac58-4afef3b15a0f tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] [instance: bee52bae-2df5-46a3-9aa9-f6b24bea11e3] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:57:07.232430 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-3d401c0d-3734-4d5f-ac58-4afef3b15a0f tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:07.233058 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-3d401c0d-3734-4d5f-ac58-4afef3b15a0f tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:07.233499 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-3d401c0d-3734-4d5f-ac58-4afef3b15a0f tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:07.241178 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-3d401c0d-3734-4d5f-ac58-4afef3b15a0f tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:07.241926 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-3d401c0d-3734-4d5f-ac58-4afef3b15a0f tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:07.242534 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-3d401c0d-3734-4d5f-ac58-4afef3b15a0f tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:07.638054 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-df358158-ab0b-43ca-b199-a6a592e9a300 tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07a2a96629f4baea6a3adfc4011ffe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9baf3860ba564f5c8dff93085b9aabe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:57:07.647646 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-df358158-ab0b-43ca-b199-a6a592e9a300 tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] 10.222.0.13 "GET /compute/v2.1/servers/ab3530ff-d70f-4c6c-abd0-3afa14fd9954" status: 200 len: 1713 microversion: 2.1 time: 0.605531 Nov 01 18:57:07.648324 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 432/804] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:57:07 2022] GET /compute/v2.1/servers/ab3530ff-d70f-4c6c-abd0-3afa14fd9954 => generated 1713 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:57:07.658647 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [req-05f7e608-8d3e-4b40-8112-a9de1ecebc62 req-e81b25c9-21bf-4221-834e-eb68fbaa7914 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2d525a31-b0be-44cb-8fb7-335075145f08", "tag": "3737be69-e488-4046-be48-2027dbcedf12"}]} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 18:57:07.678041 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-05f7e608-8d3e-4b40-8112-a9de1ecebc62 req-e81b25c9-21bf-4221-834e-eb68fbaa7914 service nova] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:07.681380 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-05f7e608-8d3e-4b40-8112-a9de1ecebc62 req-e81b25c9-21bf-4221-834e-eb68fbaa7914 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:07.683768 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-05f7e608-8d3e-4b40-8112-a9de1ecebc62 req-e81b25c9-21bf-4221-834e-eb68fbaa7914 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:07.725010 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.compute.server_external_events [req-05f7e608-8d3e-4b40-8112-a9de1ecebc62 req-e81b25c9-21bf-4221-834e-eb68fbaa7914 service nova] Creating event network-changed:3737be69-e488-4046-be48-2027dbcedf12 for instance 2d525a31-b0be-44cb-8fb7-335075145f08 on n-h1-863052-2 Nov 01 18:57:07.739545 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [req-05f7e608-8d3e-4b40-8112-a9de1ecebc62 req-e81b25c9-21bf-4221-834e-eb68fbaa7914 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084533 Nov 01 18:57:07.740298 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 433/805] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Nov 1 18:57:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 18:57:07.747650 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-5d2dd026-b068-4e45-86ec-ad365f5b06a5 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:57:07.748568 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-5d2dd026-b068-4e45-86ec-ad365f5b06a5 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] [instance: 97de391d-c836-40ac-b126-0b6684406d52] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:57:07.755849 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-5d2dd026-b068-4e45-86ec-ad365f5b06a5 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:07.756344 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-5d2dd026-b068-4e45-86ec-ad365f5b06a5 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:07.756889 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-5d2dd026-b068-4e45-86ec-ad365f5b06a5 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:07.757601 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-5d2dd026-b068-4e45-86ec-ad365f5b06a5 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:07.758058 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-5d2dd026-b068-4e45-86ec-ad365f5b06a5 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:07.758487 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-5d2dd026-b068-4e45-86ec-ad365f5b06a5 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:07.946886 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-3d401c0d-3734-4d5f-ac58-4afef3b15a0f tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:57:07.958639 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-3d401c0d-3734-4d5f-ac58-4afef3b15a0f tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:57:07.960097 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-3d401c0d-3734-4d5f-ac58-4afef3b15a0f tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:57:07.961313 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-3d401c0d-3734-4d5f-ac58-4afef3b15a0f tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] 10.222.0.13 "GET /compute/v2.1/servers/bee52bae-2df5-46a3-9aa9-f6b24bea11e3" status: 200 len: 1566 microversion: 2.25 time: 0.766293 Nov 01 18:57:07.977592 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 373/806] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 18:57:07 2022] GET /compute/v2.1/servers/bee52bae-2df5-46a3-9aa9-f6b24bea11e3 => generated 1566 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 18:57:07.986071 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-d9598995-d1db-476a-9e8f-06035a2df1b7 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:57:07.987510 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-d9598995-d1db-476a-9e8f-06035a2df1b7 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] [instance: 2d525a31-b0be-44cb-8fb7-335075145f08] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:57:07.995281 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d9598995-d1db-476a-9e8f-06035a2df1b7 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:07.996020 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d9598995-d1db-476a-9e8f-06035a2df1b7 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:07.998005 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d9598995-d1db-476a-9e8f-06035a2df1b7 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:07.998939 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d9598995-d1db-476a-9e8f-06035a2df1b7 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:07.999574 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d9598995-d1db-476a-9e8f-06035a2df1b7 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:08.000164 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d9598995-d1db-476a-9e8f-06035a2df1b7 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:08.027053 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-5d2dd026-b068-4e45-86ec-ad365f5b06a5 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b52b7dcbb044f9bfc424e4417c77fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '708bc0ea4b5a4baf81933725792bedd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:57:08.037157 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-5d2dd026-b068-4e45-86ec-ad365f5b06a5 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] 10.222.0.13 "GET /compute/v2.1/servers/97de391d-c836-40ac-b126-0b6684406d52" status: 200 len: 1534 microversion: 2.1 time: 0.295182 Nov 01 18:57:08.038465 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 434/807] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:57:07 2022] GET /compute/v2.1/servers/97de391d-c836-40ac-b126-0b6684406d52 => generated 1534 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:57:08.043558 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-6a570d3f-f446-4281-8ca2-336c8bcea046 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:57:08.044444 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-6a570d3f-f446-4281-8ca2-336c8bcea046 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] [instance: 7218f99b-b011-4f08-931e-340d47069f6e] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:57:08.058752 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-6a570d3f-f446-4281-8ca2-336c8bcea046 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:08.059492 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-6a570d3f-f446-4281-8ca2-336c8bcea046 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:08.060009 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-6a570d3f-f446-4281-8ca2-336c8bcea046 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:08.063222 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-6a570d3f-f446-4281-8ca2-336c8bcea046 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:08.064972 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-6a570d3f-f446-4281-8ca2-336c8bcea046 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:08.065705 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-6a570d3f-f446-4281-8ca2-336c8bcea046 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:08.357698 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-d9598995-d1db-476a-9e8f-06035a2df1b7 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f32f5fba1976432d938e664c7714e52b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b9d4c236b944f9b2e8e502a50a8f8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:57:08.375388 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-d9598995-d1db-476a-9e8f-06035a2df1b7 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] 10.222.0.13 "GET /compute/v2.1/servers/2d525a31-b0be-44cb-8fb7-335075145f08" status: 200 len: 1361 microversion: 2.1 time: 0.396242 Nov 01 18:57:08.376237 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 374/808] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:57:07 2022] GET /compute/v2.1/servers/2d525a31-b0be-44cb-8fb7-335075145f08 => generated 1361 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:57:08.385762 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-23e5bd13-a0bb-4513-94dc-03b1ecf0492d tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:57:08.386626 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-23e5bd13-a0bb-4513-94dc-03b1ecf0492d tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] [instance: 87679611-878a-49b2-bf8f-39e784c6d70b] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:57:08.410731 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-23e5bd13-a0bb-4513-94dc-03b1ecf0492d tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:08.411245 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-23e5bd13-a0bb-4513-94dc-03b1ecf0492d tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:08.413239 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-23e5bd13-a0bb-4513-94dc-03b1ecf0492d tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:08.415568 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-23e5bd13-a0bb-4513-94dc-03b1ecf0492d tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:08.416049 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-23e5bd13-a0bb-4513-94dc-03b1ecf0492d tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:08.416503 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-23e5bd13-a0bb-4513-94dc-03b1ecf0492d tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:08.523182 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-6a570d3f-f446-4281-8ca2-336c8bcea046 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72117f17294649d6b8bc16c66c7efab2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45d4c047d3c44324a27a27831236ab0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:57:08.530904 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-6a570d3f-f446-4281-8ca2-336c8bcea046 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] 10.222.0.13 "GET /compute/v2.1/servers/7218f99b-b011-4f08-931e-340d47069f6e" status: 200 len: 1312 microversion: 2.1 time: 0.491228 Nov 01 18:57:08.545230 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 435/809] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:57:08 2022] GET /compute/v2.1/servers/7218f99b-b011-4f08-931e-340d47069f6e => generated 1312 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:57:08.545230 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-25a9e624-2cb9-4dbc-b4c3-5fc13f7248b0 tempest-ServerAddressesNegativeTestJSON-736278170 tempest-ServerAddressesNegativeTestJSON-736278170-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:57:08.545230 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-25a9e624-2cb9-4dbc-b4c3-5fc13f7248b0 tempest-ServerAddressesNegativeTestJSON-736278170 tempest-ServerAddressesNegativeTestJSON-736278170-project] [instance: 034c1271-a323-4728-985c-3d70df31eeb2] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:57:08.557957 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-25a9e624-2cb9-4dbc-b4c3-5fc13f7248b0 tempest-ServerAddressesNegativeTestJSON-736278170 tempest-ServerAddressesNegativeTestJSON-736278170-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:08.558493 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-25a9e624-2cb9-4dbc-b4c3-5fc13f7248b0 tempest-ServerAddressesNegativeTestJSON-736278170 tempest-ServerAddressesNegativeTestJSON-736278170-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:08.559065 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-25a9e624-2cb9-4dbc-b4c3-5fc13f7248b0 tempest-ServerAddressesNegativeTestJSON-736278170 tempest-ServerAddressesNegativeTestJSON-736278170-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:08.559786 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-25a9e624-2cb9-4dbc-b4c3-5fc13f7248b0 tempest-ServerAddressesNegativeTestJSON-736278170 tempest-ServerAddressesNegativeTestJSON-736278170-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:08.560244 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-25a9e624-2cb9-4dbc-b4c3-5fc13f7248b0 tempest-ServerAddressesNegativeTestJSON-736278170 tempest-ServerAddressesNegativeTestJSON-736278170-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:08.560704 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-25a9e624-2cb9-4dbc-b4c3-5fc13f7248b0 tempest-ServerAddressesNegativeTestJSON-736278170 tempest-ServerAddressesNegativeTestJSON-736278170-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:08.584455 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.wsgi [None req-25a9e624-2cb9-4dbc-b4c3-5fc13f7248b0 tempest-ServerAddressesNegativeTestJSON-736278170 tempest-ServerAddressesNegativeTestJSON-736278170-project] HTTP exception thrown: Instance 034c1271-a323-4728-985c-3d70df31eeb2 could not be found. Nov 01 18:57:08.586415 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-25a9e624-2cb9-4dbc-b4c3-5fc13f7248b0 tempest-ServerAddressesNegativeTestJSON-736278170 tempest-ServerAddressesNegativeTestJSON-736278170-project] Request method failure captured: Nov 01 18:57:08.586415 n-d-863052-2 devstack@n-api.service[121402]: request: GET /compute/v2.1/servers/034c1271-a323-4728-985c-3d70df31eeb2 HTTP/1.1 Nov 01 18:57:08.586415 n-d-863052-2 devstack@n-api.service[121402]: Accept: application/json Nov 01 18:57:08.586415 n-d-863052-2 devstack@n-api.service[121402]: Accept-Encoding: identity Nov 01 18:57:08.586415 n-d-863052-2 devstack@n-api.service[121402]: Connection: close Nov 01 18:57:08.586415 n-d-863052-2 devstack@n-api.service[121402]: Content-Length: 0 Nov 01 18:57:08.586415 n-d-863052-2 devstack@n-api.service[121402]: Content-Type: application/json Nov 01 18:57:08.586415 n-d-863052-2 devstack@n-api.service[121402]: Host: 10.222.0.13 Nov 01 18:57:08.586415 n-d-863052-2 devstack@n-api.service[121402]: Openstack-System-Scope: None Nov 01 18:57:08.586415 n-d-863052-2 devstack@n-api.service[121402]: User-Agent: python-urllib3/1.26.12 Nov 01 18:57:08.586415 n-d-863052-2 devstack@n-api.service[121402]: X-Auth-Token: gAAAAABjYWvnX2Zca5aLsN03WoIEudZ38cRl3Ae10mWd2d28YtRINDRAQM4pAPmkpFw8hgwXNchp-aFH63_nVvqiuUEZDy_ZLY1flmAgFN1rPzoQWKonIqlVwqFfLIyS9V4gYbYYm7AliJt7CHR_9jJNaOtaW1lGAQdNQOMkQPrI06CmhhcYvSE Nov 01 18:57:08.586415 n-d-863052-2 devstack@n-api.service[121402]: X-Domain-Id: None Nov 01 18:57:08.586415 n-d-863052-2 devstack@n-api.service[121402]: X-Domain-Name: None Nov 01 18:57:08.586415 n-d-863052-2 devstack@n-api.service[121402]: X-Identity-Status: Confirmed Nov 01 18:57:08.586415 n-d-863052-2 devstack@n-api.service[121402]: X-Is-Admin-Project: True Nov 01 18:57:08.586415 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Domain-Id: default Nov 01 18:57:08.586415 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Domain-Name: Default Nov 01 18:57:08.586415 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Id: 11d85b21bccf4bc78d4cbffd4f80357f Nov 01 18:57:08.586415 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-736278170 Nov 01 18:57:08.586415 n-d-863052-2 devstack@n-api.service[121402]: X-Role: member,reader Nov 01 18:57:08.586415 n-d-863052-2 devstack@n-api.service[121402]: X-Roles: member,reader Nov 01 18:57:08.587937 n-d-863052-2 devstack@n-api.service[121402]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/11d85b21bccf4bc78d4cbffd4f80357f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/11d85b21bccf4bc78d4cbffd4f80357f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_11d85b21bccf4bc78d4cbffd4f80357f", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/11d85b21bccf4bc78d4cbffd4f80357f"}]}] Nov 01 18:57:08.587937 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-736278170 Nov 01 18:57:08.587937 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant-Id: 11d85b21bccf4bc78d4cbffd4f80357f Nov 01 18:57:08.587937 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-736278170 Nov 01 18:57:08.587937 n-d-863052-2 devstack@n-api.service[121402]: X-User: tempest-ServerAddressesNegativeTestJSON-736278170-project Nov 01 18:57:08.587937 n-d-863052-2 devstack@n-api.service[121402]: X-User-Domain-Id: default Nov 01 18:57:08.587937 n-d-863052-2 devstack@n-api.service[121402]: X-User-Domain-Name: Default Nov 01 18:57:08.587937 n-d-863052-2 devstack@n-api.service[121402]: X-User-Id: a5a7d955d1004147b12eb569a7e7355a Nov 01 18:57:08.587937 n-d-863052-2 devstack@n-api.service[121402]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-736278170-project Nov 01 18:57:08.587937 n-d-863052-2 devstack@n-api.service[121402]: method: > Nov 01 18:57:08.587937 n-d-863052-2 devstack@n-api.service[121402]: exception: Instance 034c1271-a323-4728-985c-3d70df31eeb2 could not be found. Nov 01 18:57:08.587937 n-d-863052-2 devstack@n-api.service[121402]: action_args: {'id': '034c1271-a323-4728-985c-3d70df31eeb2'} Nov 01 18:57:08.588883 n-d-863052-2 devstack@n-api.service[121402]: {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 01 18:57:08.588883 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:57:08.588883 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 01 18:57:08.588883 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 01 18:57:08.588883 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 01 18:57:08.588883 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 01 18:57:08.588883 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 01 18:57:08.588883 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 01 18:57:08.588883 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 01 18:57:08.588883 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 01 18:57:08.588883 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 034c1271-a323-4728-985c-3d70df31eeb2 could not be found. Nov 01 18:57:08.588883 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 18:57:08.588883 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 18:57:08.588883 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 18:57:08.588883 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:57:08.588883 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 18:57:08.588883 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 18:57:08.588883 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 01 18:57:08.588883 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 01 18:57:08.588883 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 01 18:57:08.590266 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 01 18:57:08.590266 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 01 18:57:08.590266 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 01 18:57:08.590266 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 01 18:57:08.590266 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 01 18:57:08.590266 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 01 18:57:08.590266 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 01 18:57:08.590266 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 034c1271-a323-4728-985c-3d70df31eeb2 could not be found. Nov 01 18:57:08.590266 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 18:57:08.590266 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 18:57:08.590266 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 18:57:08.590266 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:57:08.590266 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 18:57:08.590266 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 18:57:08.590266 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 01 18:57:08.590266 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 01 18:57:08.590266 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 034c1271-a323-4728-985c-3d70df31eeb2 could not be found. Nov 01 18:57:08.590266 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 18:57:08.609446 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-25a9e624-2cb9-4dbc-b4c3-5fc13f7248b0 tempest-ServerAddressesNegativeTestJSON-736278170 tempest-ServerAddressesNegativeTestJSON-736278170-project] Returning 404 to user: Instance 034c1271-a323-4728-985c-3d70df31eeb2 could not be found. {{(pid=121402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 01 18:57:08.610296 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-23e5bd13-a0bb-4513-94dc-03b1ecf0492d tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '576abe5db27b461889fef2029d477e40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e9fb3117f68434bae7a463c357818dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:57:08.610439 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-25a9e624-2cb9-4dbc-b4c3-5fc13f7248b0 tempest-ServerAddressesNegativeTestJSON-736278170 tempest-ServerAddressesNegativeTestJSON-736278170-project] 10.222.0.13 "GET /compute/v2.1/servers/034c1271-a323-4728-985c-3d70df31eeb2" status: 404 len: 111 microversion: 2.1 time: 0.074243 Nov 01 18:57:08.613665 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 436/810] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:57:08 2022] GET /compute/v2.1/servers/034c1271-a323-4728-985c-3d70df31eeb2 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 01 18:57:08.632316 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-23e5bd13-a0bb-4513-94dc-03b1ecf0492d tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '576abe5db27b461889fef2029d477e40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e9fb3117f68434bae7a463c357818dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:57:08.636277 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-2b503730-3d93-4891-a36b-1e03851d759d tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:57:08.638171 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-2b503730-3d93-4891-a36b-1e03851d759d tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] [instance: ea631032-dd04-429b-988e-e6362ea42cf7] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:57:08.639127 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-23e5bd13-a0bb-4513-94dc-03b1ecf0492d tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '576abe5db27b461889fef2029d477e40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e9fb3117f68434bae7a463c357818dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:57:08.653894 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-23e5bd13-a0bb-4513-94dc-03b1ecf0492d tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] 10.222.0.13 "GET /compute/v2.1/servers/87679611-878a-49b2-bf8f-39e784c6d70b" status: 200 len: 1453 microversion: 2.75 time: 0.276040 Nov 01 18:57:08.657929 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 375/811] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 18:57:08 2022] GET /compute/v2.1/servers/87679611-878a-49b2-bf8f-39e784c6d70b => generated 1453 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 18:57:08.675683 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2b503730-3d93-4891-a36b-1e03851d759d tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:08.680274 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2b503730-3d93-4891-a36b-1e03851d759d tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.026s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:08.683968 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2b503730-3d93-4891-a36b-1e03851d759d tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:08.684706 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [req-8e59a01f-2bb3-42b2-8242-b1cdc74b9d99 req-ebfda038-e664-4de1-bc01-0a02bbb48faa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ab3530ff-d70f-4c6c-abd0-3afa14fd9954", "name": "network-vif-deleted", "tag": "5a8ac51b-9c28-4dee-aa83-db1236898e3d"}]} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 18:57:08.687650 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2b503730-3d93-4891-a36b-1e03851d759d tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:08.694241 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2b503730-3d93-4891-a36b-1e03851d759d tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:08.697414 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2b503730-3d93-4891-a36b-1e03851d759d tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:08.727927 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-8e59a01f-2bb3-42b2-8242-b1cdc74b9d99 req-ebfda038-e664-4de1-bc01-0a02bbb48faa service nova] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:08.728418 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-8e59a01f-2bb3-42b2-8242-b1cdc74b9d99 req-ebfda038-e664-4de1-bc01-0a02bbb48faa service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:08.728884 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-8e59a01f-2bb3-42b2-8242-b1cdc74b9d99 req-ebfda038-e664-4de1-bc01-0a02bbb48faa service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:08.753517 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.compute.server_external_events [req-8e59a01f-2bb3-42b2-8242-b1cdc74b9d99 req-ebfda038-e664-4de1-bc01-0a02bbb48faa service nova] Creating event network-vif-deleted:5a8ac51b-9c28-4dee-aa83-db1236898e3d for instance ab3530ff-d70f-4c6c-abd0-3afa14fd9954 on n-h2-863052-2 Nov 01 18:57:08.759210 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [req-8e59a01f-2bb3-42b2-8242-b1cdc74b9d99 req-ebfda038-e664-4de1-bc01-0a02bbb48faa service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098629 Nov 01 18:57:08.760169 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 376/812] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Nov 1 18:57:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 18:57:08.767636 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-49c92d94-fa8a-4606-ad08-f9470f3c94ad tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:57:08.768538 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-49c92d94-fa8a-4606-ad08-f9470f3c94ad tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] [instance: ab3530ff-d70f-4c6c-abd0-3afa14fd9954] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:57:08.777815 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-49c92d94-fa8a-4606-ad08-f9470f3c94ad tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:08.779535 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-49c92d94-fa8a-4606-ad08-f9470f3c94ad tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:08.780249 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-49c92d94-fa8a-4606-ad08-f9470f3c94ad tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:08.781432 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-49c92d94-fa8a-4606-ad08-f9470f3c94ad tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:08.782097 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-49c92d94-fa8a-4606-ad08-f9470f3c94ad tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:08.782895 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-49c92d94-fa8a-4606-ad08-f9470f3c94ad tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:08.831902 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-49c92d94-fa8a-4606-ad08-f9470f3c94ad tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:08.833447 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-49c92d94-fa8a-4606-ad08-f9470f3c94ad tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:08.834906 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-49c92d94-fa8a-4606-ad08-f9470f3c94ad tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:08.835975 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.objects.instance [None req-49c92d94-fa8a-4606-ad08-f9470f3c94ad tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Lazy-loading 'fault' on Instance uuid ab3530ff-d70f-4c6c-abd0-3afa14fd9954 {{(pid=121403) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 01 18:57:08.840678 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-2b503730-3d93-4891-a36b-1e03851d759d tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c1314c21d8547ff890ede1c2ad281c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c804370880454c7aa02cef2c2c3cf144', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:57:08.856436 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-2b503730-3d93-4891-a36b-1e03851d759d tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c1314c21d8547ff890ede1c2ad281c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c804370880454c7aa02cef2c2c3cf144', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:57:08.857997 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-2b503730-3d93-4891-a36b-1e03851d759d tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c1314c21d8547ff890ede1c2ad281c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c804370880454c7aa02cef2c2c3cf144', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:57:08.870390 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-2b503730-3d93-4891-a36b-1e03851d759d tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] 10.222.0.13 "GET /compute/v2.1/servers/ea631032-dd04-429b-988e-e6362ea42cf7" status: 200 len: 1546 microversion: 2.91 time: 0.255302 Nov 01 18:57:08.873958 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 437/813] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 18:57:08 2022] GET /compute/v2.1/servers/ea631032-dd04-429b-988e-e6362ea42cf7 => generated 1546 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 18:57:08.922580 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-49c92d94-fa8a-4606-ad08-f9470f3c94ad tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07a2a96629f4baea6a3adfc4011ffe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9baf3860ba564f5c8dff93085b9aabe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:57:08.933215 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-49c92d94-fa8a-4606-ad08-f9470f3c94ad tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] 10.222.0.13 "GET /compute/v2.1/servers/ab3530ff-d70f-4c6c-abd0-3afa14fd9954" status: 200 len: 1354 microversion: 2.1 time: 0.171007 Nov 01 18:57:08.933812 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 377/814] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:57:08 2022] GET /compute/v2.1/servers/ab3530ff-d70f-4c6c-abd0-3afa14fd9954 => generated 1354 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:57:08.992018 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-737f0a3e-4588-4a1a-aac4-5dc9fd00ccc6 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:57:08.994720 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-737f0a3e-4588-4a1a-aac4-5dc9fd00ccc6 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] [instance: bee52bae-2df5-46a3-9aa9-f6b24bea11e3] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:57:09.002620 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-737f0a3e-4588-4a1a-aac4-5dc9fd00ccc6 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:09.003387 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-737f0a3e-4588-4a1a-aac4-5dc9fd00ccc6 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:09.004511 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-737f0a3e-4588-4a1a-aac4-5dc9fd00ccc6 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:09.005390 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-737f0a3e-4588-4a1a-aac4-5dc9fd00ccc6 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:09.006159 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-737f0a3e-4588-4a1a-aac4-5dc9fd00ccc6 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:09.006733 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-737f0a3e-4588-4a1a-aac4-5dc9fd00ccc6 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:09.068361 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-6fc042a3-9ac2-4baf-9795-133384e09a98 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:57:09.069860 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-6fc042a3-9ac2-4baf-9795-133384e09a98 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] [instance: 97de391d-c836-40ac-b126-0b6684406d52] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:57:09.090250 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-6fc042a3-9ac2-4baf-9795-133384e09a98 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:09.091056 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-6fc042a3-9ac2-4baf-9795-133384e09a98 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:09.091862 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-6fc042a3-9ac2-4baf-9795-133384e09a98 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:09.093047 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-6fc042a3-9ac2-4baf-9795-133384e09a98 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:09.093665 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-6fc042a3-9ac2-4baf-9795-133384e09a98 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:09.094256 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-6fc042a3-9ac2-4baf-9795-133384e09a98 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:09.370360 n-d-863052-2 devstack@n-api.service[121402]: DEBUG dbcounter [-] [121402] Writing DB stats nova_cell0:SELECT=10 {{(pid=121402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 18:57:09.503561 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-6fc042a3-9ac2-4baf-9795-133384e09a98 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b52b7dcbb044f9bfc424e4417c77fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '708bc0ea4b5a4baf81933725792bedd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:57:09.513271 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-6fc042a3-9ac2-4baf-9795-133384e09a98 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] 10.222.0.13 "GET /compute/v2.1/servers/97de391d-c836-40ac-b126-0b6684406d52" status: 200 len: 1540 microversion: 2.1 time: 0.452680 Nov 01 18:57:09.514560 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 378/815] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:57:09 2022] GET /compute/v2.1/servers/97de391d-c836-40ac-b126-0b6684406d52 => generated 1540 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:57:09.533291 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-737f0a3e-4588-4a1a-aac4-5dc9fd00ccc6 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:57:09.533524 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-baa9c8c9-e94d-41fb-83a4-a748c55bbe43 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:57:09.534893 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-baa9c8c9-e94d-41fb-83a4-a748c55bbe43 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] [instance: 2d525a31-b0be-44cb-8fb7-335075145f08] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:57:09.546266 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-baa9c8c9-e94d-41fb-83a4-a748c55bbe43 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:09.547073 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-baa9c8c9-e94d-41fb-83a4-a748c55bbe43 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:09.547911 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-baa9c8c9-e94d-41fb-83a4-a748c55bbe43 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:09.548927 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-baa9c8c9-e94d-41fb-83a4-a748c55bbe43 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:09.549186 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-737f0a3e-4588-4a1a-aac4-5dc9fd00ccc6 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:57:09.549630 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-baa9c8c9-e94d-41fb-83a4-a748c55bbe43 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:09.550063 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-baa9c8c9-e94d-41fb-83a4-a748c55bbe43 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:09.551713 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-737f0a3e-4588-4a1a-aac4-5dc9fd00ccc6 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:57:09.553119 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-737f0a3e-4588-4a1a-aac4-5dc9fd00ccc6 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] 10.222.0.13 "GET /compute/v2.1/servers/bee52bae-2df5-46a3-9aa9-f6b24bea11e3" status: 200 len: 1541 microversion: 2.25 time: 0.566856 Nov 01 18:57:09.554296 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 438/816] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 18:57:08 2022] GET /compute/v2.1/servers/bee52bae-2df5-46a3-9aa9-f6b24bea11e3 => generated 1541 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 01 18:57:09.564439 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-27db057d-8d7b-451c-9fc6-04018d97e057 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:57:09.575528 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-27db057d-8d7b-451c-9fc6-04018d97e057 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] [instance: 7218f99b-b011-4f08-931e-340d47069f6e] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:57:09.582840 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-27db057d-8d7b-451c-9fc6-04018d97e057 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:09.583329 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-27db057d-8d7b-451c-9fc6-04018d97e057 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:09.583761 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-27db057d-8d7b-451c-9fc6-04018d97e057 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:09.584456 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-27db057d-8d7b-451c-9fc6-04018d97e057 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:09.585012 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-27db057d-8d7b-451c-9fc6-04018d97e057 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:09.585434 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-27db057d-8d7b-451c-9fc6-04018d97e057 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:09.844666 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-baa9c8c9-e94d-41fb-83a4-a748c55bbe43 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f32f5fba1976432d938e664c7714e52b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b9d4c236b944f9b2e8e502a50a8f8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:57:09.853058 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-baa9c8c9-e94d-41fb-83a4-a748c55bbe43 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] 10.222.0.13 "GET /compute/v2.1/servers/2d525a31-b0be-44cb-8fb7-335075145f08" status: 200 len: 1361 microversion: 2.1 time: 0.336814 Nov 01 18:57:09.854242 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 379/817] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:57:09 2022] GET /compute/v2.1/servers/2d525a31-b0be-44cb-8fb7-335075145f08 => generated 1361 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:57:09.858693 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-79cc265c-203a-490e-bed2-99070b214b6d tempest-LiveAutoBlockMigrationV225Test-1358532044 tempest-LiveAutoBlockMigrationV225Test-1358532044-project-admin] Calling method '.version_select at 0x7f0ae2827e50>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:57:09.862307 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-79cc265c-203a-490e-bed2-99070b214b6d tempest-LiveAutoBlockMigrationV225Test-1358532044 tempest-LiveAutoBlockMigrationV225Test-1358532044-project-admin] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:09.862935 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-79cc265c-203a-490e-bed2-99070b214b6d tempest-LiveAutoBlockMigrationV225Test-1358532044 tempest-LiveAutoBlockMigrationV225Test-1358532044-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:09.864192 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-79cc265c-203a-490e-bed2-99070b214b6d tempest-LiveAutoBlockMigrationV225Test-1358532044 tempest-LiveAutoBlockMigrationV225Test-1358532044-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:09.874230 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-79cc265c-203a-490e-bed2-99070b214b6d tempest-LiveAutoBlockMigrationV225Test-1358532044 tempest-LiveAutoBlockMigrationV225Test-1358532044-project-admin] 10.222.0.13 "GET /compute/v2.1/os-migrations" status: 200 len: 2364 microversion: 2.25 time: 0.018738 Nov 01 18:57:09.875425 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 380/818] 10.222.0.13 () {60 vars in 1184 bytes} [Tue Nov 1 18:57:09 2022] GET /compute/v2.1/os-migrations => generated 2364 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 18:57:09.880382 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-061a2dcd-7893-4e5d-ad81-c0231bd38c41 tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:57:09.881289 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-061a2dcd-7893-4e5d-ad81-c0231bd38c41 tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] [instance: 87679611-878a-49b2-bf8f-39e784c6d70b] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:57:09.887720 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-061a2dcd-7893-4e5d-ad81-c0231bd38c41 tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:09.888428 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-061a2dcd-7893-4e5d-ad81-c0231bd38c41 tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:09.889035 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-061a2dcd-7893-4e5d-ad81-c0231bd38c41 tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:09.889875 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-061a2dcd-7893-4e5d-ad81-c0231bd38c41 tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:09.890478 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-061a2dcd-7893-4e5d-ad81-c0231bd38c41 tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:09.891137 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-061a2dcd-7893-4e5d-ad81-c0231bd38c41 tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:10.019217 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-061a2dcd-7893-4e5d-ad81-c0231bd38c41 tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '576abe5db27b461889fef2029d477e40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e9fb3117f68434bae7a463c357818dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:57:10.029042 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-061a2dcd-7893-4e5d-ad81-c0231bd38c41 tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '576abe5db27b461889fef2029d477e40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e9fb3117f68434bae7a463c357818dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:57:10.030793 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-061a2dcd-7893-4e5d-ad81-c0231bd38c41 tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '576abe5db27b461889fef2029d477e40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e9fb3117f68434bae7a463c357818dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:57:10.037322 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-061a2dcd-7893-4e5d-ad81-c0231bd38c41 tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] 10.222.0.13 "GET /compute/v2.1/servers/87679611-878a-49b2-bf8f-39e784c6d70b" status: 200 len: 1453 microversion: 2.75 time: 0.160696 Nov 01 18:57:10.048612 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-27db057d-8d7b-451c-9fc6-04018d97e057 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72117f17294649d6b8bc16c66c7efab2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45d4c047d3c44324a27a27831236ab0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:57:10.050423 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 381/819] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 18:57:09 2022] GET /compute/v2.1/servers/87679611-878a-49b2-bf8f-39e784c6d70b => generated 1453 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 18:57:10.062212 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-27db057d-8d7b-451c-9fc6-04018d97e057 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] 10.222.0.13 "GET /compute/v2.1/servers/7218f99b-b011-4f08-931e-340d47069f6e" status: 200 len: 1312 microversion: 2.1 time: 0.498197 Nov 01 18:57:10.062212 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 439/820] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:57:09 2022] GET /compute/v2.1/servers/7218f99b-b011-4f08-931e-340d47069f6e => generated 1312 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:57:10.064840 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-827df14c-4e60-4da8-9a8d-2e4c0d515fa6 tempest-LiveAutoBlockMigrationV225Test-1358532044 tempest-LiveAutoBlockMigrationV225Test-1358532044-project-admin] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:57:10.065163 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-75d91481-8eb5-4b17-8b86-e44f6bc05e43 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:57:10.065871 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-827df14c-4e60-4da8-9a8d-2e4c0d515fa6 tempest-LiveAutoBlockMigrationV225Test-1358532044 tempest-LiveAutoBlockMigrationV225Test-1358532044-project-admin] [instance: bee52bae-2df5-46a3-9aa9-f6b24bea11e3] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:57:10.066144 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-75d91481-8eb5-4b17-8b86-e44f6bc05e43 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] [instance: ea631032-dd04-429b-988e-e6362ea42cf7] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:57:10.072250 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-75d91481-8eb5-4b17-8b86-e44f6bc05e43 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:10.072453 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-827df14c-4e60-4da8-9a8d-2e4c0d515fa6 tempest-LiveAutoBlockMigrationV225Test-1358532044 tempest-LiveAutoBlockMigrationV225Test-1358532044-project-admin] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:10.072955 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-75d91481-8eb5-4b17-8b86-e44f6bc05e43 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:10.073426 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-75d91481-8eb5-4b17-8b86-e44f6bc05e43 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:10.073791 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-827df14c-4e60-4da8-9a8d-2e4c0d515fa6 tempest-LiveAutoBlockMigrationV225Test-1358532044 tempest-LiveAutoBlockMigrationV225Test-1358532044-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:10.074262 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-75d91481-8eb5-4b17-8b86-e44f6bc05e43 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:10.074557 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-827df14c-4e60-4da8-9a8d-2e4c0d515fa6 tempest-LiveAutoBlockMigrationV225Test-1358532044 tempest-LiveAutoBlockMigrationV225Test-1358532044-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:10.074906 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-75d91481-8eb5-4b17-8b86-e44f6bc05e43 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:10.075474 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-75d91481-8eb5-4b17-8b86-e44f6bc05e43 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:10.075818 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-827df14c-4e60-4da8-9a8d-2e4c0d515fa6 tempest-LiveAutoBlockMigrationV225Test-1358532044 tempest-LiveAutoBlockMigrationV225Test-1358532044-project-admin] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:10.076426 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-827df14c-4e60-4da8-9a8d-2e4c0d515fa6 tempest-LiveAutoBlockMigrationV225Test-1358532044 tempest-LiveAutoBlockMigrationV225Test-1358532044-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:10.077050 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-827df14c-4e60-4da8-9a8d-2e4c0d515fa6 tempest-LiveAutoBlockMigrationV225Test-1358532044 tempest-LiveAutoBlockMigrationV225Test-1358532044-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:10.161201 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-75d91481-8eb5-4b17-8b86-e44f6bc05e43 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c1314c21d8547ff890ede1c2ad281c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c804370880454c7aa02cef2c2c3cf144', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:57:10.170241 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-75d91481-8eb5-4b17-8b86-e44f6bc05e43 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c1314c21d8547ff890ede1c2ad281c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c804370880454c7aa02cef2c2c3cf144', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:57:10.171699 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-75d91481-8eb5-4b17-8b86-e44f6bc05e43 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c1314c21d8547ff890ede1c2ad281c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c804370880454c7aa02cef2c2c3cf144', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:57:10.177045 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-75d91481-8eb5-4b17-8b86-e44f6bc05e43 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] 10.222.0.13 "GET /compute/v2.1/servers/ea631032-dd04-429b-988e-e6362ea42cf7" status: 200 len: 1488 microversion: 2.91 time: 0.121729 Nov 01 18:57:10.178233 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 440/821] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 18:57:10 2022] GET /compute/v2.1/servers/ea631032-dd04-429b-988e-e6362ea42cf7 => generated 1488 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 18:57:10.183123 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-1c24e944-445b-4f9c-a4a2-ba8083411b94 tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:57:10.184115 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-1c24e944-445b-4f9c-a4a2-ba8083411b94 tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] [instance: ab3530ff-d70f-4c6c-abd0-3afa14fd9954] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:57:10.210420 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-1c24e944-445b-4f9c-a4a2-ba8083411b94 tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:10.214035 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-1c24e944-445b-4f9c-a4a2-ba8083411b94 tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:10.214820 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-1c24e944-445b-4f9c-a4a2-ba8083411b94 tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:10.216195 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-1c24e944-445b-4f9c-a4a2-ba8083411b94 tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:10.217247 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-1c24e944-445b-4f9c-a4a2-ba8083411b94 tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:10.218104 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-1c24e944-445b-4f9c-a4a2-ba8083411b94 tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:10.236852 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.wsgi [None req-1c24e944-445b-4f9c-a4a2-ba8083411b94 tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] HTTP exception thrown: Instance ab3530ff-d70f-4c6c-abd0-3afa14fd9954 could not be found. Nov 01 18:57:10.240028 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-1c24e944-445b-4f9c-a4a2-ba8083411b94 tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Request method failure captured: Nov 01 18:57:10.240028 n-d-863052-2 devstack@n-api.service[121402]: request: GET /compute/v2.1/servers/ab3530ff-d70f-4c6c-abd0-3afa14fd9954 HTTP/1.1 Nov 01 18:57:10.240028 n-d-863052-2 devstack@n-api.service[121402]: Accept: application/json Nov 01 18:57:10.240028 n-d-863052-2 devstack@n-api.service[121402]: Accept-Encoding: identity Nov 01 18:57:10.240028 n-d-863052-2 devstack@n-api.service[121402]: Connection: close Nov 01 18:57:10.240028 n-d-863052-2 devstack@n-api.service[121402]: Content-Length: 0 Nov 01 18:57:10.240028 n-d-863052-2 devstack@n-api.service[121402]: Content-Type: application/json Nov 01 18:57:10.240028 n-d-863052-2 devstack@n-api.service[121402]: Host: 10.222.0.13 Nov 01 18:57:10.240028 n-d-863052-2 devstack@n-api.service[121402]: Openstack-System-Scope: None Nov 01 18:57:10.240028 n-d-863052-2 devstack@n-api.service[121402]: User-Agent: python-urllib3/1.26.12 Nov 01 18:57:10.240028 n-d-863052-2 devstack@n-api.service[121402]: X-Auth-Token: gAAAAABjYWtozHpS0i5b3FmooDEFzM7aI2GvghgSuCjRMDqqA1K-mrXHx0vj40NA7ol1qca-ndomXIXtqfZdPmyEoOtrMUWcGb9HUzHxJ1dJBD3CzpfRv7SjwGtl6mxUr3rGxHNEotN_NGn7a3T19M9ynR1YUptXMbFB_M-lty5Wgp_3KS2_t64 Nov 01 18:57:10.240028 n-d-863052-2 devstack@n-api.service[121402]: X-Domain-Id: None Nov 01 18:57:10.240028 n-d-863052-2 devstack@n-api.service[121402]: X-Domain-Name: None Nov 01 18:57:10.240028 n-d-863052-2 devstack@n-api.service[121402]: X-Identity-Status: Confirmed Nov 01 18:57:10.240028 n-d-863052-2 devstack@n-api.service[121402]: X-Is-Admin-Project: True Nov 01 18:57:10.240028 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Domain-Id: default Nov 01 18:57:10.240028 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Domain-Name: Default Nov 01 18:57:10.240028 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Id: 9baf3860ba564f5c8dff93085b9aabe3 Nov 01 18:57:10.240028 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1367743902 Nov 01 18:57:10.240028 n-d-863052-2 devstack@n-api.service[121402]: X-Role: member,reader Nov 01 18:57:10.240028 n-d-863052-2 devstack@n-api.service[121402]: X-Roles: member,reader Nov 01 18:57:10.241342 n-d-863052-2 devstack@n-api.service[121402]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/9baf3860ba564f5c8dff93085b9aabe3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/9baf3860ba564f5c8dff93085b9aabe3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_9baf3860ba564f5c8dff93085b9aabe3", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/9baf3860ba564f5c8dff93085b9aabe3"}]}] Nov 01 18:57:10.241342 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1367743902 Nov 01 18:57:10.241342 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant-Id: 9baf3860ba564f5c8dff93085b9aabe3 Nov 01 18:57:10.241342 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1367743902 Nov 01 18:57:10.241342 n-d-863052-2 devstack@n-api.service[121402]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1367743902-project Nov 01 18:57:10.241342 n-d-863052-2 devstack@n-api.service[121402]: X-User-Domain-Id: default Nov 01 18:57:10.241342 n-d-863052-2 devstack@n-api.service[121402]: X-User-Domain-Name: Default Nov 01 18:57:10.241342 n-d-863052-2 devstack@n-api.service[121402]: X-User-Id: f07a2a96629f4baea6a3adfc4011ffe9 Nov 01 18:57:10.241342 n-d-863052-2 devstack@n-api.service[121402]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1367743902-project Nov 01 18:57:10.241342 n-d-863052-2 devstack@n-api.service[121402]: method: > Nov 01 18:57:10.241342 n-d-863052-2 devstack@n-api.service[121402]: exception: Instance ab3530ff-d70f-4c6c-abd0-3afa14fd9954 could not be found. Nov 01 18:57:10.241342 n-d-863052-2 devstack@n-api.service[121402]: action_args: {'id': 'ab3530ff-d70f-4c6c-abd0-3afa14fd9954'} Nov 01 18:57:10.242166 n-d-863052-2 devstack@n-api.service[121402]: {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 01 18:57:10.242166 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:57:10.242166 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 01 18:57:10.242166 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 01 18:57:10.242166 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 01 18:57:10.242166 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 01 18:57:10.242166 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 01 18:57:10.242166 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 01 18:57:10.242166 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 01 18:57:10.242166 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 01 18:57:10.242166 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ab3530ff-d70f-4c6c-abd0-3afa14fd9954 could not be found. Nov 01 18:57:10.242166 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 18:57:10.242166 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 18:57:10.242166 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 18:57:10.242166 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:57:10.242166 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 18:57:10.242166 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 18:57:10.242166 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 01 18:57:10.242166 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 01 18:57:10.242166 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 01 18:57:10.243363 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 01 18:57:10.243363 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 01 18:57:10.243363 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 01 18:57:10.243363 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 01 18:57:10.243363 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 01 18:57:10.243363 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 01 18:57:10.243363 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 01 18:57:10.243363 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ab3530ff-d70f-4c6c-abd0-3afa14fd9954 could not be found. Nov 01 18:57:10.243363 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 18:57:10.243363 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 18:57:10.243363 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 18:57:10.243363 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:57:10.243363 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 18:57:10.243363 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 18:57:10.243363 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 01 18:57:10.243363 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 01 18:57:10.243363 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ab3530ff-d70f-4c6c-abd0-3afa14fd9954 could not be found. Nov 01 18:57:10.243363 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 18:57:10.245851 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-1c24e944-445b-4f9c-a4a2-ba8083411b94 tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Returning 404 to user: Instance ab3530ff-d70f-4c6c-abd0-3afa14fd9954 could not be found. {{(pid=121402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 01 18:57:10.246891 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-1c24e944-445b-4f9c-a4a2-ba8083411b94 tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] 10.222.0.13 "GET /compute/v2.1/servers/ab3530ff-d70f-4c6c-abd0-3afa14fd9954" status: 404 len: 111 microversion: 2.1 time: 0.067505 Nov 01 18:57:10.248007 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 441/822] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:57:10 2022] GET /compute/v2.1/servers/ab3530ff-d70f-4c6c-abd0-3afa14fd9954 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 01 18:57:10.256685 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-6b69ff67-2cb6-4e1d-8075-cf348c3781b9 tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:57:10.257459 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-6b69ff67-2cb6-4e1d-8075-cf348c3781b9 tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] [instance: 26132db2-1798-4ba6-88bb-aaf87f6848b3] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:57:10.263995 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-6b69ff67-2cb6-4e1d-8075-cf348c3781b9 tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:10.264766 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-6b69ff67-2cb6-4e1d-8075-cf348c3781b9 tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:10.265567 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-6b69ff67-2cb6-4e1d-8075-cf348c3781b9 tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:10.266463 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-6b69ff67-2cb6-4e1d-8075-cf348c3781b9 tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:10.267110 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-6b69ff67-2cb6-4e1d-8075-cf348c3781b9 tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:10.267721 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-6b69ff67-2cb6-4e1d-8075-cf348c3781b9 tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:10.283215 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.wsgi [None req-6b69ff67-2cb6-4e1d-8075-cf348c3781b9 tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] HTTP exception thrown: Instance 26132db2-1798-4ba6-88bb-aaf87f6848b3 could not be found. Nov 01 18:57:10.285700 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-6b69ff67-2cb6-4e1d-8075-cf348c3781b9 tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Request method failure captured: Nov 01 18:57:10.285700 n-d-863052-2 devstack@n-api.service[121402]: request: DELETE /compute/v2.1/servers/26132db2-1798-4ba6-88bb-aaf87f6848b3 HTTP/1.1 Nov 01 18:57:10.285700 n-d-863052-2 devstack@n-api.service[121402]: Accept: application/json Nov 01 18:57:10.285700 n-d-863052-2 devstack@n-api.service[121402]: Accept-Encoding: identity Nov 01 18:57:10.285700 n-d-863052-2 devstack@n-api.service[121402]: Connection: close Nov 01 18:57:10.285700 n-d-863052-2 devstack@n-api.service[121402]: Content-Length: 0 Nov 01 18:57:10.285700 n-d-863052-2 devstack@n-api.service[121402]: Content-Type: application/json Nov 01 18:57:10.285700 n-d-863052-2 devstack@n-api.service[121402]: Host: 10.222.0.13 Nov 01 18:57:10.285700 n-d-863052-2 devstack@n-api.service[121402]: Openstack-System-Scope: None Nov 01 18:57:10.285700 n-d-863052-2 devstack@n-api.service[121402]: User-Agent: python-urllib3/1.26.12 Nov 01 18:57:10.285700 n-d-863052-2 devstack@n-api.service[121402]: X-Auth-Token: gAAAAABjYWtozHpS0i5b3FmooDEFzM7aI2GvghgSuCjRMDqqA1K-mrXHx0vj40NA7ol1qca-ndomXIXtqfZdPmyEoOtrMUWcGb9HUzHxJ1dJBD3CzpfRv7SjwGtl6mxUr3rGxHNEotN_NGn7a3T19M9ynR1YUptXMbFB_M-lty5Wgp_3KS2_t64 Nov 01 18:57:10.285700 n-d-863052-2 devstack@n-api.service[121402]: X-Domain-Id: None Nov 01 18:57:10.285700 n-d-863052-2 devstack@n-api.service[121402]: X-Domain-Name: None Nov 01 18:57:10.285700 n-d-863052-2 devstack@n-api.service[121402]: X-Identity-Status: Confirmed Nov 01 18:57:10.285700 n-d-863052-2 devstack@n-api.service[121402]: X-Is-Admin-Project: True Nov 01 18:57:10.285700 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Domain-Id: default Nov 01 18:57:10.285700 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Domain-Name: Default Nov 01 18:57:10.285700 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Id: 9baf3860ba564f5c8dff93085b9aabe3 Nov 01 18:57:10.285700 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1367743902 Nov 01 18:57:10.285700 n-d-863052-2 devstack@n-api.service[121402]: X-Role: member,reader Nov 01 18:57:10.285700 n-d-863052-2 devstack@n-api.service[121402]: X-Roles: member,reader Nov 01 18:57:10.287109 n-d-863052-2 devstack@n-api.service[121402]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/9baf3860ba564f5c8dff93085b9aabe3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/9baf3860ba564f5c8dff93085b9aabe3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_9baf3860ba564f5c8dff93085b9aabe3", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/9baf3860ba564f5c8dff93085b9aabe3"}]}] Nov 01 18:57:10.287109 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1367743902 Nov 01 18:57:10.287109 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant-Id: 9baf3860ba564f5c8dff93085b9aabe3 Nov 01 18:57:10.287109 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1367743902 Nov 01 18:57:10.287109 n-d-863052-2 devstack@n-api.service[121402]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1367743902-project Nov 01 18:57:10.287109 n-d-863052-2 devstack@n-api.service[121402]: X-User-Domain-Id: default Nov 01 18:57:10.287109 n-d-863052-2 devstack@n-api.service[121402]: X-User-Domain-Name: Default Nov 01 18:57:10.287109 n-d-863052-2 devstack@n-api.service[121402]: X-User-Id: f07a2a96629f4baea6a3adfc4011ffe9 Nov 01 18:57:10.287109 n-d-863052-2 devstack@n-api.service[121402]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1367743902-project Nov 01 18:57:10.287109 n-d-863052-2 devstack@n-api.service[121402]: method: > Nov 01 18:57:10.287109 n-d-863052-2 devstack@n-api.service[121402]: exception: Instance 26132db2-1798-4ba6-88bb-aaf87f6848b3 could not be found. Nov 01 18:57:10.287109 n-d-863052-2 devstack@n-api.service[121402]: action_args: {'id': '26132db2-1798-4ba6-88bb-aaf87f6848b3'} Nov 01 18:57:10.287862 n-d-863052-2 devstack@n-api.service[121402]: {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 01 18:57:10.287862 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:57:10.287862 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 01 18:57:10.287862 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 01 18:57:10.287862 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 01 18:57:10.287862 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 01 18:57:10.287862 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 01 18:57:10.287862 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 01 18:57:10.287862 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 01 18:57:10.287862 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 01 18:57:10.287862 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 26132db2-1798-4ba6-88bb-aaf87f6848b3 could not be found. Nov 01 18:57:10.287862 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 18:57:10.287862 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 18:57:10.287862 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 18:57:10.287862 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:57:10.287862 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 18:57:10.287862 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 18:57:10.287862 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 01 18:57:10.287862 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 01 18:57:10.287862 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 01 18:57:10.289069 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 01 18:57:10.289069 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 01 18:57:10.289069 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 01 18:57:10.289069 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 01 18:57:10.289069 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 01 18:57:10.289069 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 01 18:57:10.289069 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 01 18:57:10.289069 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 01 18:57:10.289069 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 01 18:57:10.289069 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 26132db2-1798-4ba6-88bb-aaf87f6848b3 could not be found. Nov 01 18:57:10.289069 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 18:57:10.289069 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 18:57:10.289069 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 18:57:10.289069 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:57:10.289069 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 18:57:10.289069 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 18:57:10.289069 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 01 18:57:10.289069 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 01 18:57:10.289069 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 26132db2-1798-4ba6-88bb-aaf87f6848b3 could not be found. Nov 01 18:57:10.289069 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 18:57:10.291740 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-6b69ff67-2cb6-4e1d-8075-cf348c3781b9 tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Returning 404 to user: Instance 26132db2-1798-4ba6-88bb-aaf87f6848b3 could not be found. {{(pid=121402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 01 18:57:10.292953 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-6b69ff67-2cb6-4e1d-8075-cf348c3781b9 tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] 10.222.0.13 "DELETE /compute/v2.1/servers/26132db2-1798-4ba6-88bb-aaf87f6848b3" status: 404 len: 111 microversion: 2.1 time: 0.040723 Nov 01 18:57:10.294277 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 442/823] 10.222.0.13 () {58 vars in 1239 bytes} [Tue Nov 1 18:57:10 2022] DELETE /compute/v2.1/servers/26132db2-1798-4ba6-88bb-aaf87f6848b3 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 01 18:57:10.305785 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-d5b1e610-e0d4-4cc6-898a-cecba7e3f266 tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:57:10.311493 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.objects.instance [None req-827df14c-4e60-4da8-9a8d-2e4c0d515fa6 tempest-LiveAutoBlockMigrationV225Test-1358532044 tempest-LiveAutoBlockMigrationV225Test-1358532044-project-admin] Lazy-loading 'services' on Instance uuid bee52bae-2df5-46a3-9aa9-f6b24bea11e3 {{(pid=121403) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 01 18:57:10.315132 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-d5b1e610-e0d4-4cc6-898a-cecba7e3f266 tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] [instance: 26132db2-1798-4ba6-88bb-aaf87f6848b3] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:57:10.323812 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-d5b1e610-e0d4-4cc6-898a-cecba7e3f266 tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:10.324311 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-d5b1e610-e0d4-4cc6-898a-cecba7e3f266 tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:10.324785 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-d5b1e610-e0d4-4cc6-898a-cecba7e3f266 tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:10.325567 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-d5b1e610-e0d4-4cc6-898a-cecba7e3f266 tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:10.326977 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-d5b1e610-e0d4-4cc6-898a-cecba7e3f266 tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:10.327492 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-d5b1e610-e0d4-4cc6-898a-cecba7e3f266 tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:10.332523 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-827df14c-4e60-4da8-9a8d-2e4c0d515fa6 tempest-LiveAutoBlockMigrationV225Test-1358532044 tempest-LiveAutoBlockMigrationV225Test-1358532044-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/bee52bae-2df5-46a3-9aa9-f6b24bea11e3" status: 200 len: 2033 microversion: 2.25 time: 0.280111 Nov 01 18:57:10.333518 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 382/824] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 18:57:10 2022] GET /compute/v2.1/servers/bee52bae-2df5-46a3-9aa9-f6b24bea11e3 => generated 2033 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 18:57:10.368609 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-09829ff3-f05a-41ad-9754-16db0d40da2d tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Action: 'create', calling method: .version_select at 0x7f0ae2b79940>, body: {"keypair": {"name": "tempest-keypair-608263486", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLsRdcTOveXix+2m4OxL0AuMz0Eg8eh4UmkOg3nofpMLVdsL5NoY9/954EYoIQG3envWsYADYZxoVdGuxLBcLFn6KzrAiB1gb1iuxx8HDTourY4TuWeW9ot4b/cpaV95LA=="}} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 18:57:10.382109 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.wsgi [None req-d5b1e610-e0d4-4cc6-898a-cecba7e3f266 tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] HTTP exception thrown: Instance 26132db2-1798-4ba6-88bb-aaf87f6848b3 could not be found. Nov 01 18:57:10.384032 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-d5b1e610-e0d4-4cc6-898a-cecba7e3f266 tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Request method failure captured: Nov 01 18:57:10.384032 n-d-863052-2 devstack@n-api.service[121402]: request: GET /compute/v2.1/servers/26132db2-1798-4ba6-88bb-aaf87f6848b3 HTTP/1.1 Nov 01 18:57:10.384032 n-d-863052-2 devstack@n-api.service[121402]: Accept: application/json Nov 01 18:57:10.384032 n-d-863052-2 devstack@n-api.service[121402]: Accept-Encoding: identity Nov 01 18:57:10.384032 n-d-863052-2 devstack@n-api.service[121402]: Connection: close Nov 01 18:57:10.384032 n-d-863052-2 devstack@n-api.service[121402]: Content-Length: 0 Nov 01 18:57:10.384032 n-d-863052-2 devstack@n-api.service[121402]: Content-Type: application/json Nov 01 18:57:10.384032 n-d-863052-2 devstack@n-api.service[121402]: Host: 10.222.0.13 Nov 01 18:57:10.384032 n-d-863052-2 devstack@n-api.service[121402]: Openstack-System-Scope: None Nov 01 18:57:10.384032 n-d-863052-2 devstack@n-api.service[121402]: User-Agent: python-urllib3/1.26.12 Nov 01 18:57:10.384032 n-d-863052-2 devstack@n-api.service[121402]: X-Auth-Token: gAAAAABjYWtozHpS0i5b3FmooDEFzM7aI2GvghgSuCjRMDqqA1K-mrXHx0vj40NA7ol1qca-ndomXIXtqfZdPmyEoOtrMUWcGb9HUzHxJ1dJBD3CzpfRv7SjwGtl6mxUr3rGxHNEotN_NGn7a3T19M9ynR1YUptXMbFB_M-lty5Wgp_3KS2_t64 Nov 01 18:57:10.384032 n-d-863052-2 devstack@n-api.service[121402]: X-Domain-Id: None Nov 01 18:57:10.384032 n-d-863052-2 devstack@n-api.service[121402]: X-Domain-Name: None Nov 01 18:57:10.384032 n-d-863052-2 devstack@n-api.service[121402]: X-Identity-Status: Confirmed Nov 01 18:57:10.384032 n-d-863052-2 devstack@n-api.service[121402]: X-Is-Admin-Project: True Nov 01 18:57:10.384032 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Domain-Id: default Nov 01 18:57:10.384032 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Domain-Name: Default Nov 01 18:57:10.384032 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Id: 9baf3860ba564f5c8dff93085b9aabe3 Nov 01 18:57:10.384032 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1367743902 Nov 01 18:57:10.384032 n-d-863052-2 devstack@n-api.service[121402]: X-Role: member,reader Nov 01 18:57:10.384032 n-d-863052-2 devstack@n-api.service[121402]: X-Roles: member,reader Nov 01 18:57:10.385426 n-d-863052-2 devstack@n-api.service[121402]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/9baf3860ba564f5c8dff93085b9aabe3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/9baf3860ba564f5c8dff93085b9aabe3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_9baf3860ba564f5c8dff93085b9aabe3", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/9baf3860ba564f5c8dff93085b9aabe3"}]}] Nov 01 18:57:10.385426 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1367743902 Nov 01 18:57:10.385426 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant-Id: 9baf3860ba564f5c8dff93085b9aabe3 Nov 01 18:57:10.385426 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1367743902 Nov 01 18:57:10.385426 n-d-863052-2 devstack@n-api.service[121402]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1367743902-project Nov 01 18:57:10.385426 n-d-863052-2 devstack@n-api.service[121402]: X-User-Domain-Id: default Nov 01 18:57:10.385426 n-d-863052-2 devstack@n-api.service[121402]: X-User-Domain-Name: Default Nov 01 18:57:10.385426 n-d-863052-2 devstack@n-api.service[121402]: X-User-Id: f07a2a96629f4baea6a3adfc4011ffe9 Nov 01 18:57:10.385426 n-d-863052-2 devstack@n-api.service[121402]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1367743902-project Nov 01 18:57:10.385426 n-d-863052-2 devstack@n-api.service[121402]: method: > Nov 01 18:57:10.385426 n-d-863052-2 devstack@n-api.service[121402]: exception: Instance 26132db2-1798-4ba6-88bb-aaf87f6848b3 could not be found. Nov 01 18:57:10.385426 n-d-863052-2 devstack@n-api.service[121402]: action_args: {'id': '26132db2-1798-4ba6-88bb-aaf87f6848b3'} Nov 01 18:57:10.386149 n-d-863052-2 devstack@n-api.service[121402]: {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 01 18:57:10.386149 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:57:10.386149 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 01 18:57:10.386149 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 01 18:57:10.386149 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 01 18:57:10.386149 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 01 18:57:10.386149 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 01 18:57:10.386149 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 01 18:57:10.386149 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 01 18:57:10.386149 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 01 18:57:10.386149 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 26132db2-1798-4ba6-88bb-aaf87f6848b3 could not be found. Nov 01 18:57:10.386149 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 18:57:10.386149 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 18:57:10.386149 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 18:57:10.386149 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:57:10.386149 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 18:57:10.386149 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 18:57:10.386149 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 01 18:57:10.386149 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 01 18:57:10.386149 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 01 18:57:10.388037 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 01 18:57:10.388037 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 01 18:57:10.388037 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 01 18:57:10.388037 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 01 18:57:10.388037 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 01 18:57:10.388037 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 01 18:57:10.388037 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 01 18:57:10.388037 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 26132db2-1798-4ba6-88bb-aaf87f6848b3 could not be found. Nov 01 18:57:10.388037 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 18:57:10.388037 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 18:57:10.388037 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 18:57:10.388037 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:57:10.388037 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 18:57:10.388037 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 18:57:10.388037 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 01 18:57:10.388037 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 01 18:57:10.388037 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 26132db2-1798-4ba6-88bb-aaf87f6848b3 could not be found. Nov 01 18:57:10.388037 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 18:57:10.390768 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-d5b1e610-e0d4-4cc6-898a-cecba7e3f266 tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Returning 404 to user: Instance 26132db2-1798-4ba6-88bb-aaf87f6848b3 could not be found. {{(pid=121402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 01 18:57:10.390768 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-d5b1e610-e0d4-4cc6-898a-cecba7e3f266 tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] 10.222.0.13 "GET /compute/v2.1/servers/26132db2-1798-4ba6-88bb-aaf87f6848b3" status: 404 len: 111 microversion: 2.1 time: 0.085184 Nov 01 18:57:10.391059 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.quota [None req-09829ff3-f05a-41ad-9754-16db0d40da2d tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Getting quotas for project 75730f90ec924cbebd605d6d6d747efe. Resources: {'key_pairs'} {{(pid=121403) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 01 18:57:10.391263 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 443/825] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:57:10 2022] GET /compute/v2.1/servers/26132db2-1798-4ba6-88bb-aaf87f6848b3 => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 01 18:57:10.392052 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.quota [None req-09829ff3-f05a-41ad-9754-16db0d40da2d tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Getting quotas for user c2ddf0211c374fe2a0db89546beb8e96 and project 75730f90ec924cbebd605d6d6d747efe. Resources: {'key_pairs'} {{(pid=121403) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 01 18:57:10.398434 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-7aa9e5a4-ee7f-4849-b2a0-9fa7ba0cdb4f tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Calling method '.version_select at 0x7f0ae2df9940>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:57:10.420699 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-09829ff3-f05a-41ad-9754-16db0d40da2d tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.25 time: 0.056696 Nov 01 18:57:10.422199 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 383/826] 10.222.0.13 () {62 vars in 1200 bytes} [Tue Nov 1 18:57:10 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 59 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Nov 01 18:57:10.441734 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [req-d731c9b7-ef08-494c-bccb-dc74c0602af9 req-5aacc19c-b9df-4e8f-9fc9-2a2df51eec95 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7218f99b-b011-4f08-931e-340d47069f6e", "tag": "8d7f9336-82a3-4d8c-a178-f498c4931099"}]} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 18:57:10.443694 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-7aa9e5a4-ee7f-4849-b2a0-9fa7ba0cdb4f tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-630059540" status: 202 len: 0 microversion: 2.1 time: 0.052476 Nov 01 18:57:10.445162 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 444/827] 10.222.0.13 () {58 vars in 1218 bytes} [Tue Nov 1 18:57:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-630059540 => generated 0 bytes in 55 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 01 18:57:10.453042 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-d731c9b7-ef08-494c-bccb-dc74c0602af9 req-5aacc19c-b9df-4e8f-9fc9-2a2df51eec95 service nova] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:10.453732 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-d731c9b7-ef08-494c-bccb-dc74c0602af9 req-5aacc19c-b9df-4e8f-9fc9-2a2df51eec95 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:10.455291 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-d731c9b7-ef08-494c-bccb-dc74c0602af9 req-5aacc19c-b9df-4e8f-9fc9-2a2df51eec95 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:10.469740 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.compute.server_external_events [req-d731c9b7-ef08-494c-bccb-dc74c0602af9 req-5aacc19c-b9df-4e8f-9fc9-2a2df51eec95 service nova] Creating event network-changed:8d7f9336-82a3-4d8c-a178-f498c4931099 for instance 7218f99b-b011-4f08-931e-340d47069f6e on n-h2-863052-2 Nov 01 18:57:10.476679 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [req-d731c9b7-ef08-494c-bccb-dc74c0602af9 req-5aacc19c-b9df-4e8f-9fc9-2a2df51eec95 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051887 Nov 01 18:57:10.477377 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 384/828] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Nov 1 18:57:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 18:57:10.538627 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-54f94cb2-cda3-464f-8da1-4b4f5df7efdf tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:57:10.539242 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-54f94cb2-cda3-464f-8da1-4b4f5df7efdf tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] [instance: 97de391d-c836-40ac-b126-0b6684406d52] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:57:10.560770 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-54f94cb2-cda3-464f-8da1-4b4f5df7efdf tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:10.561555 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-54f94cb2-cda3-464f-8da1-4b4f5df7efdf tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:10.562162 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-54f94cb2-cda3-464f-8da1-4b4f5df7efdf tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:10.563292 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-54f94cb2-cda3-464f-8da1-4b4f5df7efdf tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:10.564028 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-54f94cb2-cda3-464f-8da1-4b4f5df7efdf tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:10.564621 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-54f94cb2-cda3-464f-8da1-4b4f5df7efdf tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:10.758978 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-54f94cb2-cda3-464f-8da1-4b4f5df7efdf tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b52b7dcbb044f9bfc424e4417c77fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '708bc0ea4b5a4baf81933725792bedd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:57:10.767589 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-54f94cb2-cda3-464f-8da1-4b4f5df7efdf tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] 10.222.0.13 "GET /compute/v2.1/servers/97de391d-c836-40ac-b126-0b6684406d52" status: 200 len: 1540 microversion: 2.1 time: 0.232916 Nov 01 18:57:10.768396 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 445/829] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:57:10 2022] GET /compute/v2.1/servers/97de391d-c836-40ac-b126-0b6684406d52 => generated 1540 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:57:10.881469 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-c992bab0-145a-475e-aa95-c5861360412c tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:57:10.882585 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-c992bab0-145a-475e-aa95-c5861360412c tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] [instance: 2d525a31-b0be-44cb-8fb7-335075145f08] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:57:10.890525 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-c992bab0-145a-475e-aa95-c5861360412c tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:10.891167 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-c992bab0-145a-475e-aa95-c5861360412c tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:10.891939 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-c992bab0-145a-475e-aa95-c5861360412c tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:10.892863 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-c992bab0-145a-475e-aa95-c5861360412c tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:10.893322 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-c992bab0-145a-475e-aa95-c5861360412c tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:10.893743 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-c992bab0-145a-475e-aa95-c5861360412c tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:11.079823 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-0c7de4ce-4bbe-414c-ae66-0977d5a1083f tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:57:11.081437 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-0c7de4ce-4bbe-414c-ae66-0977d5a1083f tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] [instance: 87679611-878a-49b2-bf8f-39e784c6d70b] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:57:11.106350 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-0c7de4ce-4bbe-414c-ae66-0977d5a1083f tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:11.109365 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-0c7de4ce-4bbe-414c-ae66-0977d5a1083f tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:11.110244 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-0c7de4ce-4bbe-414c-ae66-0977d5a1083f tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:11.111197 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-0c7de4ce-4bbe-414c-ae66-0977d5a1083f tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:11.115163 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-0c7de4ce-4bbe-414c-ae66-0977d5a1083f tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:11.115920 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-0c7de4ce-4bbe-414c-ae66-0977d5a1083f tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:11.220658 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-0c7de4ce-4bbe-414c-ae66-0977d5a1083f tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '576abe5db27b461889fef2029d477e40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e9fb3117f68434bae7a463c357818dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:57:11.230016 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-0c7de4ce-4bbe-414c-ae66-0977d5a1083f tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '576abe5db27b461889fef2029d477e40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e9fb3117f68434bae7a463c357818dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:57:11.231866 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-0c7de4ce-4bbe-414c-ae66-0977d5a1083f tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '576abe5db27b461889fef2029d477e40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e9fb3117f68434bae7a463c357818dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:57:11.238890 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-0c7de4ce-4bbe-414c-ae66-0977d5a1083f tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] 10.222.0.13 "GET /compute/v2.1/servers/87679611-878a-49b2-bf8f-39e784c6d70b" status: 200 len: 1453 microversion: 2.75 time: 0.170246 Nov 01 18:57:11.239901 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 446/830] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 18:57:11 2022] GET /compute/v2.1/servers/87679611-878a-49b2-bf8f-39e784c6d70b => generated 1453 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 18:57:11.246839 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-647105b6-4884-4a34-b97b-15034629b8ed tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:57:11.248232 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-647105b6-4884-4a34-b97b-15034629b8ed tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] [instance: 7218f99b-b011-4f08-931e-340d47069f6e] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:57:11.255608 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-647105b6-4884-4a34-b97b-15034629b8ed tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:11.256523 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-647105b6-4884-4a34-b97b-15034629b8ed tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:11.257200 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-647105b6-4884-4a34-b97b-15034629b8ed tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:11.258702 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-647105b6-4884-4a34-b97b-15034629b8ed tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:11.259372 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-647105b6-4884-4a34-b97b-15034629b8ed tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:11.260005 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-647105b6-4884-4a34-b97b-15034629b8ed tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:11.310467 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-c992bab0-145a-475e-aa95-c5861360412c tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f32f5fba1976432d938e664c7714e52b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b9d4c236b944f9b2e8e502a50a8f8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:57:11.328129 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-c992bab0-145a-475e-aa95-c5861360412c tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] 10.222.0.13 "GET /compute/v2.1/servers/2d525a31-b0be-44cb-8fb7-335075145f08" status: 200 len: 1361 microversion: 2.1 time: 0.451937 Nov 01 18:57:11.328947 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 385/831] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:57:10 2022] GET /compute/v2.1/servers/2d525a31-b0be-44cb-8fb7-335075145f08 => generated 1361 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:57:11.333985 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-35612c1a-4c12-47ee-b113-fcd7161b73ca tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:57:11.336213 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-35612c1a-4c12-47ee-b113-fcd7161b73ca tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] [instance: ea631032-dd04-429b-988e-e6362ea42cf7] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:57:11.359832 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-35612c1a-4c12-47ee-b113-fcd7161b73ca tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:11.360477 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-35612c1a-4c12-47ee-b113-fcd7161b73ca tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:11.361089 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-35612c1a-4c12-47ee-b113-fcd7161b73ca tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:11.365369 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-35612c1a-4c12-47ee-b113-fcd7161b73ca tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:11.366877 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-35612c1a-4c12-47ee-b113-fcd7161b73ca tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:11.367581 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-35612c1a-4c12-47ee-b113-fcd7161b73ca tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:11.511320 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-35612c1a-4c12-47ee-b113-fcd7161b73ca tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c1314c21d8547ff890ede1c2ad281c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c804370880454c7aa02cef2c2c3cf144', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:57:11.518328 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-647105b6-4884-4a34-b97b-15034629b8ed tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72117f17294649d6b8bc16c66c7efab2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45d4c047d3c44324a27a27831236ab0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:57:11.527460 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-647105b6-4884-4a34-b97b-15034629b8ed tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] 10.222.0.13 "GET /compute/v2.1/servers/7218f99b-b011-4f08-931e-340d47069f6e" status: 200 len: 1312 microversion: 2.1 time: 0.286138 Nov 01 18:57:11.533827 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-35612c1a-4c12-47ee-b113-fcd7161b73ca tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c1314c21d8547ff890ede1c2ad281c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c804370880454c7aa02cef2c2c3cf144', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:57:11.538533 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-35612c1a-4c12-47ee-b113-fcd7161b73ca tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c1314c21d8547ff890ede1c2ad281c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c804370880454c7aa02cef2c2c3cf144', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:57:11.548308 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-35612c1a-4c12-47ee-b113-fcd7161b73ca tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] 10.222.0.13 "GET /compute/v2.1/servers/ea631032-dd04-429b-988e-e6362ea42cf7" status: 200 len: 1488 microversion: 2.91 time: 0.218485 Nov 01 18:57:11.563150 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 386/832] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 18:57:11 2022] GET /compute/v2.1/servers/ea631032-dd04-429b-988e-e6362ea42cf7 => generated 1488 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 18:57:11.566165 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 447/833] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:57:11 2022] GET /compute/v2.1/servers/7218f99b-b011-4f08-931e-340d47069f6e => generated 1312 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:57:11.792613 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-a031f692-3852-48fa-ba62-dc8d9ee36164 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:57:11.794291 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-a031f692-3852-48fa-ba62-dc8d9ee36164 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] [instance: 97de391d-c836-40ac-b126-0b6684406d52] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:57:11.804556 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-a031f692-3852-48fa-ba62-dc8d9ee36164 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:11.805273 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-a031f692-3852-48fa-ba62-dc8d9ee36164 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:11.805513 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-a031f692-3852-48fa-ba62-dc8d9ee36164 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:11.806224 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-a031f692-3852-48fa-ba62-dc8d9ee36164 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:11.806685 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-a031f692-3852-48fa-ba62-dc8d9ee36164 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:11.807200 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-a031f692-3852-48fa-ba62-dc8d9ee36164 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:12.272861 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-9280da5c-5728-488e-9f5f-f11e5b3957e6 tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:57:12.274149 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-9280da5c-5728-488e-9f5f-f11e5b3957e6 tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] [instance: 87679611-878a-49b2-bf8f-39e784c6d70b] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:57:12.281562 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-9280da5c-5728-488e-9f5f-f11e5b3957e6 tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:12.282269 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-9280da5c-5728-488e-9f5f-f11e5b3957e6 tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:12.282944 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-9280da5c-5728-488e-9f5f-f11e5b3957e6 tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:12.284487 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-9280da5c-5728-488e-9f5f-f11e5b3957e6 tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:12.285236 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-9280da5c-5728-488e-9f5f-f11e5b3957e6 tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:12.285883 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-9280da5c-5728-488e-9f5f-f11e5b3957e6 tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:12.324566 n-d-863052-2 devstack@n-api.service[121402]: DEBUG dbcounter [-] [121402] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 18:57:12.521658 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-9280da5c-5728-488e-9f5f-f11e5b3957e6 tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '576abe5db27b461889fef2029d477e40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e9fb3117f68434bae7a463c357818dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:57:12.536938 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-9280da5c-5728-488e-9f5f-f11e5b3957e6 tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '576abe5db27b461889fef2029d477e40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e9fb3117f68434bae7a463c357818dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:57:12.538814 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-9280da5c-5728-488e-9f5f-f11e5b3957e6 tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '576abe5db27b461889fef2029d477e40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e9fb3117f68434bae7a463c357818dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:57:12.558417 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-9280da5c-5728-488e-9f5f-f11e5b3957e6 tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] 10.222.0.13 "GET /compute/v2.1/servers/87679611-878a-49b2-bf8f-39e784c6d70b" status: 200 len: 1438 microversion: 2.75 time: 0.289459 Nov 01 18:57:12.559289 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 448/834] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 18:57:12 2022] GET /compute/v2.1/servers/87679611-878a-49b2-bf8f-39e784c6d70b => generated 1438 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 01 18:57:12.564817 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-2e144dda-9648-4ee0-90e5-9a9797be7c23 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:57:12.567078 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-2e144dda-9648-4ee0-90e5-9a9797be7c23 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] [instance: 2d525a31-b0be-44cb-8fb7-335075145f08] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:57:12.581692 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2e144dda-9648-4ee0-90e5-9a9797be7c23 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:12.582517 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2e144dda-9648-4ee0-90e5-9a9797be7c23 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:12.582953 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2e144dda-9648-4ee0-90e5-9a9797be7c23 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:12.583670 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2e144dda-9648-4ee0-90e5-9a9797be7c23 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:12.584136 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2e144dda-9648-4ee0-90e5-9a9797be7c23 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:12.584568 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2e144dda-9648-4ee0-90e5-9a9797be7c23 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:12.877615 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-a031f692-3852-48fa-ba62-dc8d9ee36164 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b52b7dcbb044f9bfc424e4417c77fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '708bc0ea4b5a4baf81933725792bedd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:57:12.890999 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-a031f692-3852-48fa-ba62-dc8d9ee36164 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] 10.222.0.13 "GET /compute/v2.1/servers/97de391d-c836-40ac-b126-0b6684406d52" status: 200 len: 1540 microversion: 2.1 time: 1.102574 Nov 01 18:57:12.892034 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 387/835] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:57:11 2022] GET /compute/v2.1/servers/97de391d-c836-40ac-b126-0b6684406d52 => generated 1540 bytes in 1105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:57:12.903521 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-689e694e-0239-42ae-89ff-d8c7f74b09a7 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:57:12.904896 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-689e694e-0239-42ae-89ff-d8c7f74b09a7 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] [instance: 7218f99b-b011-4f08-931e-340d47069f6e] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:57:12.918293 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-689e694e-0239-42ae-89ff-d8c7f74b09a7 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:12.919037 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-689e694e-0239-42ae-89ff-d8c7f74b09a7 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:12.919686 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-689e694e-0239-42ae-89ff-d8c7f74b09a7 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:12.920618 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-689e694e-0239-42ae-89ff-d8c7f74b09a7 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:12.921753 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-689e694e-0239-42ae-89ff-d8c7f74b09a7 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:12.922368 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-689e694e-0239-42ae-89ff-d8c7f74b09a7 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:12.945397 n-d-863052-2 devstack@n-api.service[121403]: DEBUG dbcounter [-] [121403] Writing DB stats nova_cell0:SELECT=4 {{(pid=121403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 18:57:13.104449 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-689e694e-0239-42ae-89ff-d8c7f74b09a7 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72117f17294649d6b8bc16c66c7efab2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45d4c047d3c44324a27a27831236ab0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:57:13.115464 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-689e694e-0239-42ae-89ff-d8c7f74b09a7 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] 10.222.0.13 "GET /compute/v2.1/servers/7218f99b-b011-4f08-931e-340d47069f6e" status: 200 len: 1312 microversion: 2.1 time: 0.217185 Nov 01 18:57:13.116742 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 388/836] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:57:12 2022] GET /compute/v2.1/servers/7218f99b-b011-4f08-931e-340d47069f6e => generated 1312 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:57:13.121775 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-a3026198-5239-43dc-88c8-f18700378be4 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:57:13.122480 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-a3026198-5239-43dc-88c8-f18700378be4 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] [instance: ea631032-dd04-429b-988e-e6362ea42cf7] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:57:13.129243 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-a3026198-5239-43dc-88c8-f18700378be4 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:13.129846 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-a3026198-5239-43dc-88c8-f18700378be4 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:13.130382 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-a3026198-5239-43dc-88c8-f18700378be4 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:13.131341 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-a3026198-5239-43dc-88c8-f18700378be4 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:13.132276 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-a3026198-5239-43dc-88c8-f18700378be4 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:13.133167 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-a3026198-5239-43dc-88c8-f18700378be4 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:13.161678 n-d-863052-2 devstack@n-api.service[121403]: DEBUG dbcounter [-] [121403] Writing DB stats nova_cell1:SELECT=100 {{(pid=121403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 18:57:13.217220 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-a3026198-5239-43dc-88c8-f18700378be4 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c1314c21d8547ff890ede1c2ad281c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c804370880454c7aa02cef2c2c3cf144', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:57:13.226612 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-a3026198-5239-43dc-88c8-f18700378be4 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c1314c21d8547ff890ede1c2ad281c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c804370880454c7aa02cef2c2c3cf144', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:57:13.228531 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-a3026198-5239-43dc-88c8-f18700378be4 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c1314c21d8547ff890ede1c2ad281c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c804370880454c7aa02cef2c2c3cf144', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:57:13.234213 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-a3026198-5239-43dc-88c8-f18700378be4 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] 10.222.0.13 "GET /compute/v2.1/servers/ea631032-dd04-429b-988e-e6362ea42cf7" status: 200 len: 1544 microversion: 2.91 time: 0.116239 Nov 01 18:57:13.249334 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 389/837] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 18:57:13 2022] GET /compute/v2.1/servers/ea631032-dd04-429b-988e-e6362ea42cf7 => generated 1544 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 18:57:13.387133 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-3782b1a5-71de-468c-8c7b-3b1a101e38b6 tempest-ServersAdmin275Test-1925739795 tempest-ServersAdmin275Test-1925739795-project-admin] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "2d4a0047-1b9e-445f-8af8-1b5c9d93e881"}} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 18:57:13.390037 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-3782b1a5-71de-468c-8c7b-3b1a101e38b6 tempest-ServersAdmin275Test-1925739795 tempest-ServersAdmin275Test-1925739795-project-admin] [instance: 87679611-878a-49b2-bf8f-39e784c6d70b] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:57:13.397571 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-3782b1a5-71de-468c-8c7b-3b1a101e38b6 tempest-ServersAdmin275Test-1925739795 tempest-ServersAdmin275Test-1925739795-project-admin] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:13.398070 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-3782b1a5-71de-468c-8c7b-3b1a101e38b6 tempest-ServersAdmin275Test-1925739795 tempest-ServersAdmin275Test-1925739795-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:13.398507 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-3782b1a5-71de-468c-8c7b-3b1a101e38b6 tempest-ServersAdmin275Test-1925739795 tempest-ServersAdmin275Test-1925739795-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:13.399210 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-3782b1a5-71de-468c-8c7b-3b1a101e38b6 tempest-ServersAdmin275Test-1925739795 tempest-ServersAdmin275Test-1925739795-project-admin] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:13.399668 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-3782b1a5-71de-468c-8c7b-3b1a101e38b6 tempest-ServersAdmin275Test-1925739795 tempest-ServersAdmin275Test-1925739795-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:13.400090 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-3782b1a5-71de-468c-8c7b-3b1a101e38b6 tempest-ServersAdmin275Test-1925739795 tempest-ServersAdmin275Test-1925739795-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:13.462710 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-2e144dda-9648-4ee0-90e5-9a9797be7c23 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f32f5fba1976432d938e664c7714e52b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b9d4c236b944f9b2e8e502a50a8f8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:57:13.480132 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-2e144dda-9648-4ee0-90e5-9a9797be7c23 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] 10.222.0.13 "GET /compute/v2.1/servers/2d525a31-b0be-44cb-8fb7-335075145f08" status: 200 len: 1361 microversion: 2.1 time: 0.919537 Nov 01 18:57:13.491800 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 449/838] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:57:12 2022] GET /compute/v2.1/servers/2d525a31-b0be-44cb-8fb7-335075145f08 => generated 1361 bytes in 932 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:57:13.502932 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-3df4e50d-e503-42d0-a3ee-71930b8c4251 tempest-ServersWithSpecificFlavorTestJSON-733859443 tempest-ServersWithSpecificFlavorTestJSON-733859443-project-admin] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:57:13.520034 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.virt.hardware [None req-3782b1a5-71de-468c-8c7b-3b1a101e38b6 tempest-ServersAdmin275Test-1925739795 tempest-ServersAdmin275Test-1925739795-project-admin] Flavor limits 0:0:0 {{(pid=121403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 01 18:57:13.521202 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.virt.hardware [None req-3782b1a5-71de-468c-8c7b-3b1a101e38b6 tempest-ServersAdmin275Test-1925739795 tempest-ServersAdmin275Test-1925739795-project-admin] Image limits 0:0:0 {{(pid=121403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 01 18:57:13.522888 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.virt.hardware [None req-3782b1a5-71de-468c-8c7b-3b1a101e38b6 tempest-ServersAdmin275Test-1925739795 tempest-ServersAdmin275Test-1925739795-project-admin] Flavor pref 0:0:0 {{(pid=121403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 01 18:57:13.524228 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.virt.hardware [None req-3782b1a5-71de-468c-8c7b-3b1a101e38b6 tempest-ServersAdmin275Test-1925739795 tempest-ServersAdmin275Test-1925739795-project-admin] Image pref 0:0:0 {{(pid=121403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 01 18:57:13.525723 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-3df4e50d-e503-42d0-a3ee-71930b8c4251 tempest-ServersWithSpecificFlavorTestJSON-733859443 tempest-ServersWithSpecificFlavorTestJSON-733859443-project-admin] 10.222.0.13 "DELETE /compute/v2.1/flavors/835338155" status: 202 len: 0 microversion: 2.1 time: 0.026690 Nov 01 18:57:13.526757 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.virt.hardware [None req-3782b1a5-71de-468c-8c7b-3b1a101e38b6 tempest-ServersAdmin275Test-1925739795 tempest-ServersAdmin275Test-1925739795-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 01 18:57:13.528957 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 450/839] 10.222.0.13 () {58 vars in 1158 bytes} [Tue Nov 1 18:57:13 2022] DELETE /compute/v2.1/flavors/835338155 => generated 0 bytes in 36 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 01 18:57:13.542988 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-8964b6dd-45d7-4107-8922-72ced8ce83f7 tempest-ServersWithSpecificFlavorTestJSON-733859443 tempest-ServersWithSpecificFlavorTestJSON-733859443-project-admin] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:57:13.571143 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-8964b6dd-45d7-4107-8922-72ced8ce83f7 tempest-ServersWithSpecificFlavorTestJSON-733859443 tempest-ServersWithSpecificFlavorTestJSON-733859443-project-admin] 10.222.0.13 "GET /compute/v2.1/flavors/detail" status: 200 len: 5406 microversion: 2.1 time: 0.037560 Nov 01 18:57:13.572478 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 451/840] 10.222.0.13 () {58 vars in 1146 bytes} [Tue Nov 1 18:57:13 2022] GET /compute/v2.1/flavors/detail => generated 5406 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:57:13.591948 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-3da5dc48-192c-4808-9877-8240a64c4c90 tempest-ServersWithSpecificFlavorTestJSON-733859443 tempest-ServersWithSpecificFlavorTestJSON-733859443-project-admin] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:57:13.613668 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-3da5dc48-192c-4808-9877-8240a64c4c90 tempest-ServersWithSpecificFlavorTestJSON-733859443 tempest-ServersWithSpecificFlavorTestJSON-733859443-project-admin] 10.222.0.13 "DELETE /compute/v2.1/flavors/1548779625" status: 202 len: 0 microversion: 2.1 time: 0.024738 Nov 01 18:57:13.614595 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 452/841] 10.222.0.13 () {58 vars in 1161 bytes} [Tue Nov 1 18:57:13 2022] DELETE /compute/v2.1/flavors/1548779625 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 01 18:57:13.624909 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-3782b1a5-71de-468c-8c7b-3b1a101e38b6 tempest-ServersAdmin275Test-1925739795 tempest-ServersAdmin275Test-1925739795-project-admin] [instance: 87679611-878a-49b2-bf8f-39e784c6d70b] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:57:13.631705 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-3782b1a5-71de-468c-8c7b-3b1a101e38b6 tempest-ServersAdmin275Test-1925739795 tempest-ServersAdmin275Test-1925739795-project-admin] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:13.632453 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-3782b1a5-71de-468c-8c7b-3b1a101e38b6 tempest-ServersAdmin275Test-1925739795 tempest-ServersAdmin275Test-1925739795-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:13.632968 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-3782b1a5-71de-468c-8c7b-3b1a101e38b6 tempest-ServersAdmin275Test-1925739795 tempest-ServersAdmin275Test-1925739795-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:13.633843 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-3782b1a5-71de-468c-8c7b-3b1a101e38b6 tempest-ServersAdmin275Test-1925739795 tempest-ServersAdmin275Test-1925739795-project-admin] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:13.634300 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-3782b1a5-71de-468c-8c7b-3b1a101e38b6 tempest-ServersAdmin275Test-1925739795 tempest-ServersAdmin275Test-1925739795-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:13.634727 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-3782b1a5-71de-468c-8c7b-3b1a101e38b6 tempest-ServersAdmin275Test-1925739795 tempest-ServersAdmin275Test-1925739795-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:13.641438 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-d301f110-04be-417e-a575-d0c3bb750db9 tempest-ServersWithSpecificFlavorTestJSON-733859443 tempest-ServersWithSpecificFlavorTestJSON-733859443-project-admin] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:57:13.693161 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-d301f110-04be-417e-a575-d0c3bb750db9 tempest-ServersWithSpecificFlavorTestJSON-733859443 tempest-ServersWithSpecificFlavorTestJSON-733859443-project-admin] 10.222.0.13 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.071715 Nov 01 18:57:13.708481 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 453/842] 10.222.0.13 () {58 vars in 1146 bytes} [Tue Nov 1 18:57:13 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:57:13.719773 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-074415dc-0bec-4f88-afe6-b2a861a47e36 tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:57:13.720792 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-074415dc-0bec-4f88-afe6-b2a861a47e36 tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] [instance: ab3530ff-d70f-4c6c-abd0-3afa14fd9954] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:57:13.729040 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-074415dc-0bec-4f88-afe6-b2a861a47e36 tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:13.729919 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-074415dc-0bec-4f88-afe6-b2a861a47e36 tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:13.730575 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-074415dc-0bec-4f88-afe6-b2a861a47e36 tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:13.731483 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-074415dc-0bec-4f88-afe6-b2a861a47e36 tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:13.732096 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-074415dc-0bec-4f88-afe6-b2a861a47e36 tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:13.732857 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-074415dc-0bec-4f88-afe6-b2a861a47e36 tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:13.749137 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.wsgi [None req-074415dc-0bec-4f88-afe6-b2a861a47e36 tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] HTTP exception thrown: Instance ab3530ff-d70f-4c6c-abd0-3afa14fd9954 could not be found. Nov 01 18:57:13.751611 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-074415dc-0bec-4f88-afe6-b2a861a47e36 tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Request method failure captured: Nov 01 18:57:13.751611 n-d-863052-2 devstack@n-api.service[121402]: request: DELETE /compute/v2.1/servers/ab3530ff-d70f-4c6c-abd0-3afa14fd9954 HTTP/1.1 Nov 01 18:57:13.751611 n-d-863052-2 devstack@n-api.service[121402]: Accept: application/json Nov 01 18:57:13.751611 n-d-863052-2 devstack@n-api.service[121402]: Accept-Encoding: identity Nov 01 18:57:13.751611 n-d-863052-2 devstack@n-api.service[121402]: Connection: close Nov 01 18:57:13.751611 n-d-863052-2 devstack@n-api.service[121402]: Content-Length: 0 Nov 01 18:57:13.751611 n-d-863052-2 devstack@n-api.service[121402]: Content-Type: application/json Nov 01 18:57:13.751611 n-d-863052-2 devstack@n-api.service[121402]: Host: 10.222.0.13 Nov 01 18:57:13.751611 n-d-863052-2 devstack@n-api.service[121402]: Openstack-System-Scope: None Nov 01 18:57:13.751611 n-d-863052-2 devstack@n-api.service[121402]: User-Agent: python-urllib3/1.26.12 Nov 01 18:57:13.751611 n-d-863052-2 devstack@n-api.service[121402]: X-Auth-Token: gAAAAABjYWtozHpS0i5b3FmooDEFzM7aI2GvghgSuCjRMDqqA1K-mrXHx0vj40NA7ol1qca-ndomXIXtqfZdPmyEoOtrMUWcGb9HUzHxJ1dJBD3CzpfRv7SjwGtl6mxUr3rGxHNEotN_NGn7a3T19M9ynR1YUptXMbFB_M-lty5Wgp_3KS2_t64 Nov 01 18:57:13.751611 n-d-863052-2 devstack@n-api.service[121402]: X-Domain-Id: None Nov 01 18:57:13.751611 n-d-863052-2 devstack@n-api.service[121402]: X-Domain-Name: None Nov 01 18:57:13.751611 n-d-863052-2 devstack@n-api.service[121402]: X-Identity-Status: Confirmed Nov 01 18:57:13.751611 n-d-863052-2 devstack@n-api.service[121402]: X-Is-Admin-Project: True Nov 01 18:57:13.751611 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Domain-Id: default Nov 01 18:57:13.751611 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Domain-Name: Default Nov 01 18:57:13.751611 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Id: 9baf3860ba564f5c8dff93085b9aabe3 Nov 01 18:57:13.751611 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1367743902 Nov 01 18:57:13.751611 n-d-863052-2 devstack@n-api.service[121402]: X-Role: member,reader Nov 01 18:57:13.751611 n-d-863052-2 devstack@n-api.service[121402]: X-Roles: member,reader Nov 01 18:57:13.753196 n-d-863052-2 devstack@n-api.service[121402]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/9baf3860ba564f5c8dff93085b9aabe3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/9baf3860ba564f5c8dff93085b9aabe3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_9baf3860ba564f5c8dff93085b9aabe3", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/9baf3860ba564f5c8dff93085b9aabe3"}]}] Nov 01 18:57:13.753196 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1367743902 Nov 01 18:57:13.753196 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant-Id: 9baf3860ba564f5c8dff93085b9aabe3 Nov 01 18:57:13.753196 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1367743902 Nov 01 18:57:13.753196 n-d-863052-2 devstack@n-api.service[121402]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1367743902-project Nov 01 18:57:13.753196 n-d-863052-2 devstack@n-api.service[121402]: X-User-Domain-Id: default Nov 01 18:57:13.753196 n-d-863052-2 devstack@n-api.service[121402]: X-User-Domain-Name: Default Nov 01 18:57:13.753196 n-d-863052-2 devstack@n-api.service[121402]: X-User-Id: f07a2a96629f4baea6a3adfc4011ffe9 Nov 01 18:57:13.753196 n-d-863052-2 devstack@n-api.service[121402]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1367743902-project Nov 01 18:57:13.753196 n-d-863052-2 devstack@n-api.service[121402]: method: > Nov 01 18:57:13.753196 n-d-863052-2 devstack@n-api.service[121402]: exception: Instance ab3530ff-d70f-4c6c-abd0-3afa14fd9954 could not be found. Nov 01 18:57:13.753196 n-d-863052-2 devstack@n-api.service[121402]: action_args: {'id': 'ab3530ff-d70f-4c6c-abd0-3afa14fd9954'} Nov 01 18:57:13.754069 n-d-863052-2 devstack@n-api.service[121402]: {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 01 18:57:13.754069 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:57:13.754069 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 01 18:57:13.754069 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 01 18:57:13.754069 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 01 18:57:13.754069 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 01 18:57:13.754069 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 01 18:57:13.754069 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 01 18:57:13.754069 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 01 18:57:13.754069 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 01 18:57:13.754069 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ab3530ff-d70f-4c6c-abd0-3afa14fd9954 could not be found. Nov 01 18:57:13.754069 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 18:57:13.754069 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 18:57:13.754069 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 18:57:13.754069 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:57:13.754069 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 18:57:13.754069 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 18:57:13.754069 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 01 18:57:13.754069 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 01 18:57:13.754069 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 01 18:57:13.755327 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 01 18:57:13.755327 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 01 18:57:13.755327 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 01 18:57:13.755327 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 01 18:57:13.755327 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 01 18:57:13.755327 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 01 18:57:13.755327 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 01 18:57:13.755327 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 01 18:57:13.755327 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 01 18:57:13.755327 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ab3530ff-d70f-4c6c-abd0-3afa14fd9954 could not be found. Nov 01 18:57:13.755327 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 18:57:13.755327 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 18:57:13.755327 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 18:57:13.755327 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:57:13.755327 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 18:57:13.755327 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 18:57:13.755327 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 01 18:57:13.755327 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 01 18:57:13.755327 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ab3530ff-d70f-4c6c-abd0-3afa14fd9954 could not be found. Nov 01 18:57:13.755327 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 18:57:13.758167 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-074415dc-0bec-4f88-afe6-b2a861a47e36 tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Returning 404 to user: Instance ab3530ff-d70f-4c6c-abd0-3afa14fd9954 could not be found. {{(pid=121402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 01 18:57:13.758635 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.objects.instance [None req-3782b1a5-71de-468c-8c7b-3b1a101e38b6 tempest-ServersAdmin275Test-1925739795 tempest-ServersAdmin275Test-1925739795-project-admin] Lazy-loading 'services' on Instance uuid 87679611-878a-49b2-bf8f-39e784c6d70b {{(pid=121403) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 01 18:57:13.759701 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-074415dc-0bec-4f88-afe6-b2a861a47e36 tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] 10.222.0.13 "DELETE /compute/v2.1/servers/ab3530ff-d70f-4c6c-abd0-3afa14fd9954" status: 404 len: 111 microversion: 2.1 time: 0.044711 Nov 01 18:57:13.764050 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 454/843] 10.222.0.13 () {58 vars in 1239 bytes} [Tue Nov 1 18:57:13 2022] DELETE /compute/v2.1/servers/ab3530ff-d70f-4c6c-abd0-3afa14fd9954 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 01 18:57:13.772033 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-a747eac4-a81d-48fc-9736-38e6a5555902 tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:57:13.773003 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-a747eac4-a81d-48fc-9736-38e6a5555902 tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] [instance: ab3530ff-d70f-4c6c-abd0-3afa14fd9954] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:57:13.780368 n-d-863052-2 devstack@n-api.service[121402]: DEBUG dbcounter [-] [121402] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=1,nova_api:DELETE=7 {{(pid=121402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 18:57:13.782405 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-a747eac4-a81d-48fc-9736-38e6a5555902 tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:13.783143 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-a747eac4-a81d-48fc-9736-38e6a5555902 tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:13.783813 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-a747eac4-a81d-48fc-9736-38e6a5555902 tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:13.786355 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-a747eac4-a81d-48fc-9736-38e6a5555902 tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:13.786991 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-a747eac4-a81d-48fc-9736-38e6a5555902 tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:13.787575 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-a747eac4-a81d-48fc-9736-38e6a5555902 tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:13.795539 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-3782b1a5-71de-468c-8c7b-3b1a101e38b6 tempest-ServersAdmin275Test-1925739795 tempest-ServersAdmin275Test-1925739795-project-admin] 10.222.0.13 "POST /compute/v2.1/servers/87679611-878a-49b2-bf8f-39e784c6d70b/action" status: 202 len: 1942 microversion: 2.75 time: 0.544760 Nov 01 18:57:13.804632 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 390/844] 10.222.0.13 () {62 vars in 1319 bytes} [Tue Nov 1 18:57:13 2022] POST /compute/v2.1/servers/87679611-878a-49b2-bf8f-39e784c6d70b/action => generated 1942 bytes in 546 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Nov 01 18:57:13.816991 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [req-e7c7641a-41e9-4db5-a822-412220ddff9e req-8404568c-5ca0-4944-963e-19ba2045bc68 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "97de391d-c836-40ac-b126-0b6684406d52", "name": "network-vif-plugged", "status": "completed", "tag": "7d838ab6-b291-4c63-b4a9-0e37df1c216f"}]} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 18:57:13.834853 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-e7c7641a-41e9-4db5-a822-412220ddff9e req-8404568c-5ca0-4944-963e-19ba2045bc68 service nova] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:13.835538 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-e7c7641a-41e9-4db5-a822-412220ddff9e req-8404568c-5ca0-4944-963e-19ba2045bc68 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:13.836188 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-e7c7641a-41e9-4db5-a822-412220ddff9e req-8404568c-5ca0-4944-963e-19ba2045bc68 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:13.841431 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.wsgi [None req-a747eac4-a81d-48fc-9736-38e6a5555902 tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] HTTP exception thrown: Instance ab3530ff-d70f-4c6c-abd0-3afa14fd9954 could not be found. Nov 01 18:57:13.844760 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-a747eac4-a81d-48fc-9736-38e6a5555902 tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Request method failure captured: Nov 01 18:57:13.844760 n-d-863052-2 devstack@n-api.service[121402]: request: GET /compute/v2.1/servers/ab3530ff-d70f-4c6c-abd0-3afa14fd9954 HTTP/1.1 Nov 01 18:57:13.844760 n-d-863052-2 devstack@n-api.service[121402]: Accept: application/json Nov 01 18:57:13.844760 n-d-863052-2 devstack@n-api.service[121402]: Accept-Encoding: identity Nov 01 18:57:13.844760 n-d-863052-2 devstack@n-api.service[121402]: Connection: close Nov 01 18:57:13.844760 n-d-863052-2 devstack@n-api.service[121402]: Content-Length: 0 Nov 01 18:57:13.844760 n-d-863052-2 devstack@n-api.service[121402]: Content-Type: application/json Nov 01 18:57:13.844760 n-d-863052-2 devstack@n-api.service[121402]: Host: 10.222.0.13 Nov 01 18:57:13.844760 n-d-863052-2 devstack@n-api.service[121402]: Openstack-System-Scope: None Nov 01 18:57:13.844760 n-d-863052-2 devstack@n-api.service[121402]: User-Agent: python-urllib3/1.26.12 Nov 01 18:57:13.844760 n-d-863052-2 devstack@n-api.service[121402]: X-Auth-Token: gAAAAABjYWtozHpS0i5b3FmooDEFzM7aI2GvghgSuCjRMDqqA1K-mrXHx0vj40NA7ol1qca-ndomXIXtqfZdPmyEoOtrMUWcGb9HUzHxJ1dJBD3CzpfRv7SjwGtl6mxUr3rGxHNEotN_NGn7a3T19M9ynR1YUptXMbFB_M-lty5Wgp_3KS2_t64 Nov 01 18:57:13.844760 n-d-863052-2 devstack@n-api.service[121402]: X-Domain-Id: None Nov 01 18:57:13.844760 n-d-863052-2 devstack@n-api.service[121402]: X-Domain-Name: None Nov 01 18:57:13.844760 n-d-863052-2 devstack@n-api.service[121402]: X-Identity-Status: Confirmed Nov 01 18:57:13.844760 n-d-863052-2 devstack@n-api.service[121402]: X-Is-Admin-Project: True Nov 01 18:57:13.844760 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Domain-Id: default Nov 01 18:57:13.844760 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Domain-Name: Default Nov 01 18:57:13.844760 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Id: 9baf3860ba564f5c8dff93085b9aabe3 Nov 01 18:57:13.844760 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1367743902 Nov 01 18:57:13.844760 n-d-863052-2 devstack@n-api.service[121402]: X-Role: member,reader Nov 01 18:57:13.844760 n-d-863052-2 devstack@n-api.service[121402]: X-Roles: member,reader Nov 01 18:57:13.846400 n-d-863052-2 devstack@n-api.service[121402]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/9baf3860ba564f5c8dff93085b9aabe3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/9baf3860ba564f5c8dff93085b9aabe3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_9baf3860ba564f5c8dff93085b9aabe3", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/9baf3860ba564f5c8dff93085b9aabe3"}]}] Nov 01 18:57:13.846400 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1367743902 Nov 01 18:57:13.846400 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant-Id: 9baf3860ba564f5c8dff93085b9aabe3 Nov 01 18:57:13.846400 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1367743902 Nov 01 18:57:13.846400 n-d-863052-2 devstack@n-api.service[121402]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1367743902-project Nov 01 18:57:13.846400 n-d-863052-2 devstack@n-api.service[121402]: X-User-Domain-Id: default Nov 01 18:57:13.846400 n-d-863052-2 devstack@n-api.service[121402]: X-User-Domain-Name: Default Nov 01 18:57:13.846400 n-d-863052-2 devstack@n-api.service[121402]: X-User-Id: f07a2a96629f4baea6a3adfc4011ffe9 Nov 01 18:57:13.846400 n-d-863052-2 devstack@n-api.service[121402]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1367743902-project Nov 01 18:57:13.846400 n-d-863052-2 devstack@n-api.service[121402]: method: > Nov 01 18:57:13.846400 n-d-863052-2 devstack@n-api.service[121402]: exception: Instance ab3530ff-d70f-4c6c-abd0-3afa14fd9954 could not be found. Nov 01 18:57:13.846400 n-d-863052-2 devstack@n-api.service[121402]: action_args: {'id': 'ab3530ff-d70f-4c6c-abd0-3afa14fd9954'} Nov 01 18:57:13.847243 n-d-863052-2 devstack@n-api.service[121402]: {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 01 18:57:13.847243 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:57:13.847243 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 01 18:57:13.847243 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 01 18:57:13.847243 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 01 18:57:13.847243 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 01 18:57:13.847243 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 01 18:57:13.847243 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 01 18:57:13.847243 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 01 18:57:13.847243 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 01 18:57:13.847243 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ab3530ff-d70f-4c6c-abd0-3afa14fd9954 could not be found. Nov 01 18:57:13.847243 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 18:57:13.847243 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 18:57:13.847243 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 18:57:13.847243 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:57:13.847243 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 18:57:13.847243 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 18:57:13.847243 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 01 18:57:13.847243 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 01 18:57:13.847243 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 01 18:57:13.849218 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 01 18:57:13.849218 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 01 18:57:13.849218 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 01 18:57:13.849218 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 01 18:57:13.849218 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 01 18:57:13.849218 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 01 18:57:13.849218 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 01 18:57:13.849218 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ab3530ff-d70f-4c6c-abd0-3afa14fd9954 could not be found. Nov 01 18:57:13.849218 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 18:57:13.849218 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 18:57:13.849218 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 18:57:13.849218 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:57:13.849218 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 18:57:13.849218 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 18:57:13.849218 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 01 18:57:13.849218 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 01 18:57:13.849218 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ab3530ff-d70f-4c6c-abd0-3afa14fd9954 could not be found. Nov 01 18:57:13.849218 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 18:57:13.853886 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-a747eac4-a81d-48fc-9736-38e6a5555902 tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Returning 404 to user: Instance ab3530ff-d70f-4c6c-abd0-3afa14fd9954 could not be found. {{(pid=121402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 01 18:57:13.853886 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-a747eac4-a81d-48fc-9736-38e6a5555902 tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] 10.222.0.13 "GET /compute/v2.1/servers/ab3530ff-d70f-4c6c-abd0-3afa14fd9954" status: 404 len: 111 microversion: 2.1 time: 0.086900 Nov 01 18:57:13.853886 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 455/845] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:57:13 2022] GET /compute/v2.1/servers/ab3530ff-d70f-4c6c-abd0-3afa14fd9954 => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 01 18:57:13.857854 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-11e14c0e-8a6f-40c9-a538-b497c8a1867e tempest-ServersAdmin275Test-1925739795 tempest-ServersAdmin275Test-1925739795-project-admin] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:57:13.859519 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-11e14c0e-8a6f-40c9-a538-b497c8a1867e tempest-ServersAdmin275Test-1925739795 tempest-ServersAdmin275Test-1925739795-project-admin] [instance: 87679611-878a-49b2-bf8f-39e784c6d70b] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:57:13.860110 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.compute.server_external_events [req-e7c7641a-41e9-4db5-a822-412220ddff9e req-8404568c-5ca0-4944-963e-19ba2045bc68 service nova] Creating event network-vif-plugged:7d838ab6-b291-4c63-b4a9-0e37df1c216f for instance 97de391d-c836-40ac-b126-0b6684406d52 on n-h1-863052-2 Nov 01 18:57:13.867659 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-11e14c0e-8a6f-40c9-a538-b497c8a1867e tempest-ServersAdmin275Test-1925739795 tempest-ServersAdmin275Test-1925739795-project-admin] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:13.868033 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [req-e7c7641a-41e9-4db5-a822-412220ddff9e req-8404568c-5ca0-4944-963e-19ba2045bc68 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065645 Nov 01 18:57:13.869076 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-11e14c0e-8a6f-40c9-a538-b497c8a1867e tempest-ServersAdmin275Test-1925739795 tempest-ServersAdmin275Test-1925739795-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:13.869306 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 391/846] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Nov 1 18:57:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 01 18:57:13.869844 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-11e14c0e-8a6f-40c9-a538-b497c8a1867e tempest-ServersAdmin275Test-1925739795 tempest-ServersAdmin275Test-1925739795-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:13.870747 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-11e14c0e-8a6f-40c9-a538-b497c8a1867e tempest-ServersAdmin275Test-1925739795 tempest-ServersAdmin275Test-1925739795-project-admin] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:13.871371 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-11e14c0e-8a6f-40c9-a538-b497c8a1867e tempest-ServersAdmin275Test-1925739795 tempest-ServersAdmin275Test-1925739795-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:13.871956 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-11e14c0e-8a6f-40c9-a538-b497c8a1867e tempest-ServersAdmin275Test-1925739795 tempest-ServersAdmin275Test-1925739795-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:13.874924 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-5d057ec0-ef87-44a5-9cd4-ec824eecc73f tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:57:13.875587 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-5d057ec0-ef87-44a5-9cd4-ec824eecc73f tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] [instance: 26132db2-1798-4ba6-88bb-aaf87f6848b3] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:57:13.883019 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-5d057ec0-ef87-44a5-9cd4-ec824eecc73f tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:13.883675 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-5d057ec0-ef87-44a5-9cd4-ec824eecc73f tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:13.884182 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-5d057ec0-ef87-44a5-9cd4-ec824eecc73f tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:13.885205 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-5d057ec0-ef87-44a5-9cd4-ec824eecc73f tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:13.885913 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-5d057ec0-ef87-44a5-9cd4-ec824eecc73f tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:13.886465 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-5d057ec0-ef87-44a5-9cd4-ec824eecc73f tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:13.911485 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.wsgi [None req-5d057ec0-ef87-44a5-9cd4-ec824eecc73f tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] HTTP exception thrown: Instance 26132db2-1798-4ba6-88bb-aaf87f6848b3 could not be found. Nov 01 18:57:13.913711 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-5d057ec0-ef87-44a5-9cd4-ec824eecc73f tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Request method failure captured: Nov 01 18:57:13.913711 n-d-863052-2 devstack@n-api.service[121403]: request: DELETE /compute/v2.1/servers/26132db2-1798-4ba6-88bb-aaf87f6848b3 HTTP/1.1 Nov 01 18:57:13.913711 n-d-863052-2 devstack@n-api.service[121403]: Accept: application/json Nov 01 18:57:13.913711 n-d-863052-2 devstack@n-api.service[121403]: Accept-Encoding: identity Nov 01 18:57:13.913711 n-d-863052-2 devstack@n-api.service[121403]: Connection: close Nov 01 18:57:13.913711 n-d-863052-2 devstack@n-api.service[121403]: Content-Length: 0 Nov 01 18:57:13.913711 n-d-863052-2 devstack@n-api.service[121403]: Content-Type: application/json Nov 01 18:57:13.913711 n-d-863052-2 devstack@n-api.service[121403]: Host: 10.222.0.13 Nov 01 18:57:13.913711 n-d-863052-2 devstack@n-api.service[121403]: Openstack-System-Scope: None Nov 01 18:57:13.913711 n-d-863052-2 devstack@n-api.service[121403]: User-Agent: python-urllib3/1.26.12 Nov 01 18:57:13.913711 n-d-863052-2 devstack@n-api.service[121403]: X-Auth-Token: gAAAAABjYWtozHpS0i5b3FmooDEFzM7aI2GvghgSuCjRMDqqA1K-mrXHx0vj40NA7ol1qca-ndomXIXtqfZdPmyEoOtrMUWcGb9HUzHxJ1dJBD3CzpfRv7SjwGtl6mxUr3rGxHNEotN_NGn7a3T19M9ynR1YUptXMbFB_M-lty5Wgp_3KS2_t64 Nov 01 18:57:13.913711 n-d-863052-2 devstack@n-api.service[121403]: X-Domain-Id: None Nov 01 18:57:13.913711 n-d-863052-2 devstack@n-api.service[121403]: X-Domain-Name: None Nov 01 18:57:13.913711 n-d-863052-2 devstack@n-api.service[121403]: X-Identity-Status: Confirmed Nov 01 18:57:13.913711 n-d-863052-2 devstack@n-api.service[121403]: X-Is-Admin-Project: True Nov 01 18:57:13.913711 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Domain-Id: default Nov 01 18:57:13.913711 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Domain-Name: Default Nov 01 18:57:13.913711 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Id: 9baf3860ba564f5c8dff93085b9aabe3 Nov 01 18:57:13.913711 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1367743902 Nov 01 18:57:13.913711 n-d-863052-2 devstack@n-api.service[121403]: X-Role: member,reader Nov 01 18:57:13.913711 n-d-863052-2 devstack@n-api.service[121403]: X-Roles: member,reader Nov 01 18:57:13.915024 n-d-863052-2 devstack@n-api.service[121403]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/9baf3860ba564f5c8dff93085b9aabe3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/9baf3860ba564f5c8dff93085b9aabe3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_9baf3860ba564f5c8dff93085b9aabe3", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/9baf3860ba564f5c8dff93085b9aabe3"}]}] Nov 01 18:57:13.915024 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1367743902 Nov 01 18:57:13.915024 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant-Id: 9baf3860ba564f5c8dff93085b9aabe3 Nov 01 18:57:13.915024 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1367743902 Nov 01 18:57:13.915024 n-d-863052-2 devstack@n-api.service[121403]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1367743902-project Nov 01 18:57:13.915024 n-d-863052-2 devstack@n-api.service[121403]: X-User-Domain-Id: default Nov 01 18:57:13.915024 n-d-863052-2 devstack@n-api.service[121403]: X-User-Domain-Name: Default Nov 01 18:57:13.915024 n-d-863052-2 devstack@n-api.service[121403]: X-User-Id: f07a2a96629f4baea6a3adfc4011ffe9 Nov 01 18:57:13.915024 n-d-863052-2 devstack@n-api.service[121403]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1367743902-project Nov 01 18:57:13.915024 n-d-863052-2 devstack@n-api.service[121403]: method: > Nov 01 18:57:13.915024 n-d-863052-2 devstack@n-api.service[121403]: exception: Instance 26132db2-1798-4ba6-88bb-aaf87f6848b3 could not be found. Nov 01 18:57:13.915024 n-d-863052-2 devstack@n-api.service[121403]: action_args: {'id': '26132db2-1798-4ba6-88bb-aaf87f6848b3'} Nov 01 18:57:13.915779 n-d-863052-2 devstack@n-api.service[121403]: {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 01 18:57:13.915779 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:57:13.915779 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 01 18:57:13.915779 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 01 18:57:13.915779 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 01 18:57:13.915779 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 01 18:57:13.915779 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 01 18:57:13.915779 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 01 18:57:13.915779 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 01 18:57:13.915779 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 01 18:57:13.915779 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 26132db2-1798-4ba6-88bb-aaf87f6848b3 could not be found. Nov 01 18:57:13.915779 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 18:57:13.915779 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 18:57:13.915779 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 18:57:13.915779 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:57:13.915779 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 18:57:13.915779 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 18:57:13.915779 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 01 18:57:13.915779 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 01 18:57:13.915779 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 01 18:57:13.917913 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 01 18:57:13.917913 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 01 18:57:13.917913 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 01 18:57:13.917913 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 01 18:57:13.917913 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 01 18:57:13.917913 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 01 18:57:13.917913 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 01 18:57:13.917913 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 01 18:57:13.917913 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 01 18:57:13.917913 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 26132db2-1798-4ba6-88bb-aaf87f6848b3 could not be found. Nov 01 18:57:13.917913 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 18:57:13.917913 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 18:57:13.917913 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 18:57:13.917913 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:57:13.917913 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 18:57:13.917913 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 18:57:13.917913 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 01 18:57:13.917913 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 01 18:57:13.917913 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 26132db2-1798-4ba6-88bb-aaf87f6848b3 could not be found. Nov 01 18:57:13.917913 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 18:57:13.921346 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-5d057ec0-ef87-44a5-9cd4-ec824eecc73f tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Returning 404 to user: Instance 26132db2-1798-4ba6-88bb-aaf87f6848b3 could not be found. {{(pid=121403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 01 18:57:13.922050 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-5d057ec0-ef87-44a5-9cd4-ec824eecc73f tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] 10.222.0.13 "DELETE /compute/v2.1/servers/26132db2-1798-4ba6-88bb-aaf87f6848b3" status: 404 len: 111 microversion: 2.1 time: 0.051251 Nov 01 18:57:13.922427 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 392/847] 10.222.0.13 () {58 vars in 1239 bytes} [Tue Nov 1 18:57:13 2022] DELETE /compute/v2.1/servers/26132db2-1798-4ba6-88bb-aaf87f6848b3 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 01 18:57:13.937538 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-572b911e-3877-47ba-96ca-c96004cfd8b1 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:57:13.938189 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-572b911e-3877-47ba-96ca-c96004cfd8b1 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] [instance: 97de391d-c836-40ac-b126-0b6684406d52] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:57:13.961095 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-572b911e-3877-47ba-96ca-c96004cfd8b1 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:13.961947 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-572b911e-3877-47ba-96ca-c96004cfd8b1 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:13.962967 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-572b911e-3877-47ba-96ca-c96004cfd8b1 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:13.965132 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-572b911e-3877-47ba-96ca-c96004cfd8b1 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:13.965799 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-572b911e-3877-47ba-96ca-c96004cfd8b1 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:13.966454 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-572b911e-3877-47ba-96ca-c96004cfd8b1 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:14.143973 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.objects.instance [None req-11e14c0e-8a6f-40c9-a538-b497c8a1867e tempest-ServersAdmin275Test-1925739795 tempest-ServersAdmin275Test-1925739795-project-admin] Lazy-loading 'services' on Instance uuid 87679611-878a-49b2-bf8f-39e784c6d70b {{(pid=121402) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 01 18:57:14.152980 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-572b911e-3877-47ba-96ca-c96004cfd8b1 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b52b7dcbb044f9bfc424e4417c77fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '708bc0ea4b5a4baf81933725792bedd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:57:14.161559 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-572b911e-3877-47ba-96ca-c96004cfd8b1 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] 10.222.0.13 "GET /compute/v2.1/servers/97de391d-c836-40ac-b126-0b6684406d52" status: 200 len: 1522 microversion: 2.1 time: 0.232216 Nov 01 18:57:14.163346 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 393/848] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:57:13 2022] GET /compute/v2.1/servers/97de391d-c836-40ac-b126-0b6684406d52 => generated 1522 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:57:14.168109 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-1d0638eb-ee2b-48fb-8669-e19d147f2665 tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:57:14.168923 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-1d0638eb-ee2b-48fb-8669-e19d147f2665 tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] [instance: 26132db2-1798-4ba6-88bb-aaf87f6848b3] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:57:14.175884 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-11e14c0e-8a6f-40c9-a538-b497c8a1867e tempest-ServersAdmin275Test-1925739795 tempest-ServersAdmin275Test-1925739795-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/87679611-878a-49b2-bf8f-39e784c6d70b" status: 200 len: 1929 microversion: 2.75 time: 0.322190 Nov 01 18:57:14.184618 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 456/849] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 18:57:13 2022] GET /compute/v2.1/servers/87679611-878a-49b2-bf8f-39e784c6d70b => generated 1929 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 18:57:14.192658 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-8dfb5d8d-fb50-4539-a02d-a3cb30ab150e tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:57:14.192658 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-8dfb5d8d-fb50-4539-a02d-a3cb30ab150e tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] [instance: 7218f99b-b011-4f08-931e-340d47069f6e] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:57:14.205737 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-8dfb5d8d-fb50-4539-a02d-a3cb30ab150e tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:14.205737 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-8dfb5d8d-fb50-4539-a02d-a3cb30ab150e tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:14.205737 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-8dfb5d8d-fb50-4539-a02d-a3cb30ab150e tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:14.206401 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-8dfb5d8d-fb50-4539-a02d-a3cb30ab150e tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:14.207355 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-1d0638eb-ee2b-48fb-8669-e19d147f2665 tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:14.207678 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-8dfb5d8d-fb50-4539-a02d-a3cb30ab150e tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:14.208262 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-1d0638eb-ee2b-48fb-8669-e19d147f2665 tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:14.209076 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-1d0638eb-ee2b-48fb-8669-e19d147f2665 tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:14.209596 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-8dfb5d8d-fb50-4539-a02d-a3cb30ab150e tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:14.210715 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-1d0638eb-ee2b-48fb-8669-e19d147f2665 tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:14.211256 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-1d0638eb-ee2b-48fb-8669-e19d147f2665 tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:14.211630 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-1d0638eb-ee2b-48fb-8669-e19d147f2665 tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:14.240148 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.wsgi [None req-1d0638eb-ee2b-48fb-8669-e19d147f2665 tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] HTTP exception thrown: Instance 26132db2-1798-4ba6-88bb-aaf87f6848b3 could not be found. Nov 01 18:57:14.242107 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-1d0638eb-ee2b-48fb-8669-e19d147f2665 tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Request method failure captured: Nov 01 18:57:14.242107 n-d-863052-2 devstack@n-api.service[121403]: request: GET /compute/v2.1/servers/26132db2-1798-4ba6-88bb-aaf87f6848b3 HTTP/1.1 Nov 01 18:57:14.242107 n-d-863052-2 devstack@n-api.service[121403]: Accept: application/json Nov 01 18:57:14.242107 n-d-863052-2 devstack@n-api.service[121403]: Accept-Encoding: identity Nov 01 18:57:14.242107 n-d-863052-2 devstack@n-api.service[121403]: Connection: close Nov 01 18:57:14.242107 n-d-863052-2 devstack@n-api.service[121403]: Content-Length: 0 Nov 01 18:57:14.242107 n-d-863052-2 devstack@n-api.service[121403]: Content-Type: application/json Nov 01 18:57:14.242107 n-d-863052-2 devstack@n-api.service[121403]: Host: 10.222.0.13 Nov 01 18:57:14.242107 n-d-863052-2 devstack@n-api.service[121403]: Openstack-System-Scope: None Nov 01 18:57:14.242107 n-d-863052-2 devstack@n-api.service[121403]: User-Agent: python-urllib3/1.26.12 Nov 01 18:57:14.242107 n-d-863052-2 devstack@n-api.service[121403]: X-Auth-Token: gAAAAABjYWtozHpS0i5b3FmooDEFzM7aI2GvghgSuCjRMDqqA1K-mrXHx0vj40NA7ol1qca-ndomXIXtqfZdPmyEoOtrMUWcGb9HUzHxJ1dJBD3CzpfRv7SjwGtl6mxUr3rGxHNEotN_NGn7a3T19M9ynR1YUptXMbFB_M-lty5Wgp_3KS2_t64 Nov 01 18:57:14.242107 n-d-863052-2 devstack@n-api.service[121403]: X-Domain-Id: None Nov 01 18:57:14.242107 n-d-863052-2 devstack@n-api.service[121403]: X-Domain-Name: None Nov 01 18:57:14.242107 n-d-863052-2 devstack@n-api.service[121403]: X-Identity-Status: Confirmed Nov 01 18:57:14.242107 n-d-863052-2 devstack@n-api.service[121403]: X-Is-Admin-Project: True Nov 01 18:57:14.242107 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Domain-Id: default Nov 01 18:57:14.242107 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Domain-Name: Default Nov 01 18:57:14.242107 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Id: 9baf3860ba564f5c8dff93085b9aabe3 Nov 01 18:57:14.242107 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1367743902 Nov 01 18:57:14.242107 n-d-863052-2 devstack@n-api.service[121403]: X-Role: member,reader Nov 01 18:57:14.242107 n-d-863052-2 devstack@n-api.service[121403]: X-Roles: member,reader Nov 01 18:57:14.243419 n-d-863052-2 devstack@n-api.service[121403]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/9baf3860ba564f5c8dff93085b9aabe3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/9baf3860ba564f5c8dff93085b9aabe3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_9baf3860ba564f5c8dff93085b9aabe3", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/9baf3860ba564f5c8dff93085b9aabe3"}]}] Nov 01 18:57:14.243419 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1367743902 Nov 01 18:57:14.243419 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant-Id: 9baf3860ba564f5c8dff93085b9aabe3 Nov 01 18:57:14.243419 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1367743902 Nov 01 18:57:14.243419 n-d-863052-2 devstack@n-api.service[121403]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1367743902-project Nov 01 18:57:14.243419 n-d-863052-2 devstack@n-api.service[121403]: X-User-Domain-Id: default Nov 01 18:57:14.243419 n-d-863052-2 devstack@n-api.service[121403]: X-User-Domain-Name: Default Nov 01 18:57:14.243419 n-d-863052-2 devstack@n-api.service[121403]: X-User-Id: f07a2a96629f4baea6a3adfc4011ffe9 Nov 01 18:57:14.243419 n-d-863052-2 devstack@n-api.service[121403]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1367743902-project Nov 01 18:57:14.243419 n-d-863052-2 devstack@n-api.service[121403]: method: > Nov 01 18:57:14.243419 n-d-863052-2 devstack@n-api.service[121403]: exception: Instance 26132db2-1798-4ba6-88bb-aaf87f6848b3 could not be found. Nov 01 18:57:14.243419 n-d-863052-2 devstack@n-api.service[121403]: action_args: {'id': '26132db2-1798-4ba6-88bb-aaf87f6848b3'} Nov 01 18:57:14.244147 n-d-863052-2 devstack@n-api.service[121403]: {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 01 18:57:14.244147 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:57:14.244147 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 01 18:57:14.244147 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 01 18:57:14.244147 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 01 18:57:14.244147 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 01 18:57:14.244147 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 01 18:57:14.244147 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 01 18:57:14.244147 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 01 18:57:14.244147 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 01 18:57:14.244147 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 26132db2-1798-4ba6-88bb-aaf87f6848b3 could not be found. Nov 01 18:57:14.244147 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 18:57:14.244147 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 18:57:14.244147 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 18:57:14.244147 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:57:14.244147 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 18:57:14.244147 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 18:57:14.244147 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 01 18:57:14.244147 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 01 18:57:14.244147 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 01 18:57:14.245356 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 01 18:57:14.245356 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 01 18:57:14.245356 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 01 18:57:14.245356 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 01 18:57:14.245356 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 01 18:57:14.245356 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 01 18:57:14.245356 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 01 18:57:14.245356 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 26132db2-1798-4ba6-88bb-aaf87f6848b3 could not be found. Nov 01 18:57:14.245356 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 18:57:14.245356 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 18:57:14.245356 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 18:57:14.245356 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:57:14.245356 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 18:57:14.245356 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 18:57:14.245356 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 01 18:57:14.245356 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 01 18:57:14.245356 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 26132db2-1798-4ba6-88bb-aaf87f6848b3 could not be found. Nov 01 18:57:14.245356 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 18:57:14.246417 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-1d0638eb-ee2b-48fb-8669-e19d147f2665 tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] Returning 404 to user: Instance 26132db2-1798-4ba6-88bb-aaf87f6848b3 could not be found. {{(pid=121403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 01 18:57:14.248912 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-1d0638eb-ee2b-48fb-8669-e19d147f2665 tempest-ServersWithSpecificFlavorTestJSON-1367743902 tempest-ServersWithSpecificFlavorTestJSON-1367743902-project] 10.222.0.13 "GET /compute/v2.1/servers/26132db2-1798-4ba6-88bb-aaf87f6848b3" status: 404 len: 111 microversion: 2.1 time: 0.079010 Nov 01 18:57:14.249743 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 394/850] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:57:14 2022] GET /compute/v2.1/servers/26132db2-1798-4ba6-88bb-aaf87f6848b3 => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 01 18:57:14.259817 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-03e5394f-ea68-4d62-b888-d435d5a9b158 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:57:14.261965 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-03e5394f-ea68-4d62-b888-d435d5a9b158 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] [instance: 97de391d-c836-40ac-b126-0b6684406d52] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:57:14.270922 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-03e5394f-ea68-4d62-b888-d435d5a9b158 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:14.271713 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-03e5394f-ea68-4d62-b888-d435d5a9b158 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:14.272159 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-03e5394f-ea68-4d62-b888-d435d5a9b158 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:14.273098 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-03e5394f-ea68-4d62-b888-d435d5a9b158 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:14.273716 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-03e5394f-ea68-4d62-b888-d435d5a9b158 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:14.274306 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-03e5394f-ea68-4d62-b888-d435d5a9b158 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:14.305288 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-03e5394f-ea68-4d62-b888-d435d5a9b158 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] [instance: 97de391d-c836-40ac-b126-0b6684406d52] Going to try to terminate instance {{(pid=121403) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 01 18:57:14.422779 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-03e5394f-ea68-4d62-b888-d435d5a9b158 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] 10.222.0.13 "DELETE /compute/v2.1/servers/97de391d-c836-40ac-b126-0b6684406d52" status: 204 len: 0 microversion: 2.1 time: 0.170241 Nov 01 18:57:14.424151 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 395/851] 10.222.0.13 () {58 vars in 1239 bytes} [Tue Nov 1 18:57:14 2022] DELETE /compute/v2.1/servers/97de391d-c836-40ac-b126-0b6684406d52 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 01 18:57:14.433018 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-a896fe85-b78b-4eea-9541-8154e7d5bbdf tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:57:14.433982 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-a896fe85-b78b-4eea-9541-8154e7d5bbdf tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] [instance: ea631032-dd04-429b-988e-e6362ea42cf7] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:57:14.441871 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-a896fe85-b78b-4eea-9541-8154e7d5bbdf tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:14.442566 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-a896fe85-b78b-4eea-9541-8154e7d5bbdf tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:14.443199 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-a896fe85-b78b-4eea-9541-8154e7d5bbdf tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:14.444100 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-a896fe85-b78b-4eea-9541-8154e7d5bbdf tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:14.444792 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-a896fe85-b78b-4eea-9541-8154e7d5bbdf tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:14.445751 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-a896fe85-b78b-4eea-9541-8154e7d5bbdf tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:14.571227 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-a896fe85-b78b-4eea-9541-8154e7d5bbdf tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c1314c21d8547ff890ede1c2ad281c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c804370880454c7aa02cef2c2c3cf144', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:57:14.583984 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-a896fe85-b78b-4eea-9541-8154e7d5bbdf tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c1314c21d8547ff890ede1c2ad281c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c804370880454c7aa02cef2c2c3cf144', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:57:14.589874 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-a896fe85-b78b-4eea-9541-8154e7d5bbdf tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c1314c21d8547ff890ede1c2ad281c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c804370880454c7aa02cef2c2c3cf144', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:57:14.596863 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-a896fe85-b78b-4eea-9541-8154e7d5bbdf tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] 10.222.0.13 "GET /compute/v2.1/servers/ea631032-dd04-429b-988e-e6362ea42cf7" status: 200 len: 1544 microversion: 2.91 time: 0.171083 Nov 01 18:57:14.608611 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 396/852] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 18:57:14 2022] GET /compute/v2.1/servers/ea631032-dd04-429b-988e-e6362ea42cf7 => generated 1544 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 18:57:14.608611 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-29be35a8-0a16-4e17-a17a-6a5b95386e01 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:57:14.608611 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-29be35a8-0a16-4e17-a17a-6a5b95386e01 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] [instance: 97de391d-c836-40ac-b126-0b6684406d52] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:57:14.610306 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-29be35a8-0a16-4e17-a17a-6a5b95386e01 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:14.610306 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-29be35a8-0a16-4e17-a17a-6a5b95386e01 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:14.610306 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-29be35a8-0a16-4e17-a17a-6a5b95386e01 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:14.610797 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-29be35a8-0a16-4e17-a17a-6a5b95386e01 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:14.611263 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-29be35a8-0a16-4e17-a17a-6a5b95386e01 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:14.611915 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-29be35a8-0a16-4e17-a17a-6a5b95386e01 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:14.782686 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-8dfb5d8d-fb50-4539-a02d-a3cb30ab150e tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72117f17294649d6b8bc16c66c7efab2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45d4c047d3c44324a27a27831236ab0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:57:14.793919 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-8dfb5d8d-fb50-4539-a02d-a3cb30ab150e tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] 10.222.0.13 "GET /compute/v2.1/servers/7218f99b-b011-4f08-931e-340d47069f6e" status: 200 len: 1312 microversion: 2.1 time: 0.615018 Nov 01 18:57:14.808634 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 457/853] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:57:14 2022] GET /compute/v2.1/servers/7218f99b-b011-4f08-931e-340d47069f6e => generated 1312 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:57:14.815119 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-dc29176b-be65-4126-a525-2cdcbf803621 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:57:14.815119 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-dc29176b-be65-4126-a525-2cdcbf803621 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] [instance: 2d525a31-b0be-44cb-8fb7-335075145f08] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:57:14.825892 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-dc29176b-be65-4126-a525-2cdcbf803621 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:14.826386 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-dc29176b-be65-4126-a525-2cdcbf803621 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:14.829343 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-dc29176b-be65-4126-a525-2cdcbf803621 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:14.830736 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-dc29176b-be65-4126-a525-2cdcbf803621 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:14.839929 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-dc29176b-be65-4126-a525-2cdcbf803621 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:14.840706 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-dc29176b-be65-4126-a525-2cdcbf803621 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:14.861331 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-29be35a8-0a16-4e17-a17a-6a5b95386e01 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b52b7dcbb044f9bfc424e4417c77fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '708bc0ea4b5a4baf81933725792bedd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:57:14.875784 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-29be35a8-0a16-4e17-a17a-6a5b95386e01 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] 10.222.0.13 "GET /compute/v2.1/servers/97de391d-c836-40ac-b126-0b6684406d52" status: 200 len: 1528 microversion: 2.1 time: 0.276870 Nov 01 18:57:14.876520 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 397/854] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:57:14 2022] GET /compute/v2.1/servers/97de391d-c836-40ac-b126-0b6684406d52 => generated 1528 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:57:15.160423 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-dc29176b-be65-4126-a525-2cdcbf803621 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f32f5fba1976432d938e664c7714e52b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b9d4c236b944f9b2e8e502a50a8f8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:57:15.173138 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-dc29176b-be65-4126-a525-2cdcbf803621 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] 10.222.0.13 "GET /compute/v2.1/servers/2d525a31-b0be-44cb-8fb7-335075145f08" status: 200 len: 1361 microversion: 2.1 time: 0.373843 Nov 01 18:57:15.173736 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 458/855] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:57:14 2022] GET /compute/v2.1/servers/2d525a31-b0be-44cb-8fb7-335075145f08 => generated 1361 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:57:15.213925 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-522c9b7f-5c9f-4ee4-80a0-d05c0f2928f3 tempest-ServersAdmin275Test-1925739795 tempest-ServersAdmin275Test-1925739795-project-admin] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:57:15.214548 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-522c9b7f-5c9f-4ee4-80a0-d05c0f2928f3 tempest-ServersAdmin275Test-1925739795 tempest-ServersAdmin275Test-1925739795-project-admin] [instance: 87679611-878a-49b2-bf8f-39e784c6d70b] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:57:15.221356 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-522c9b7f-5c9f-4ee4-80a0-d05c0f2928f3 tempest-ServersAdmin275Test-1925739795 tempest-ServersAdmin275Test-1925739795-project-admin] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:15.222162 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-522c9b7f-5c9f-4ee4-80a0-d05c0f2928f3 tempest-ServersAdmin275Test-1925739795 tempest-ServersAdmin275Test-1925739795-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:15.223355 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-522c9b7f-5c9f-4ee4-80a0-d05c0f2928f3 tempest-ServersAdmin275Test-1925739795 tempest-ServersAdmin275Test-1925739795-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:15.224426 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-522c9b7f-5c9f-4ee4-80a0-d05c0f2928f3 tempest-ServersAdmin275Test-1925739795 tempest-ServersAdmin275Test-1925739795-project-admin] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:15.225225 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-522c9b7f-5c9f-4ee4-80a0-d05c0f2928f3 tempest-ServersAdmin275Test-1925739795 tempest-ServersAdmin275Test-1925739795-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:15.225860 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-522c9b7f-5c9f-4ee4-80a0-d05c0f2928f3 tempest-ServersAdmin275Test-1925739795 tempest-ServersAdmin275Test-1925739795-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:15.320550 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.objects.instance [None req-522c9b7f-5c9f-4ee4-80a0-d05c0f2928f3 tempest-ServersAdmin275Test-1925739795 tempest-ServersAdmin275Test-1925739795-project-admin] Lazy-loading 'services' on Instance uuid 87679611-878a-49b2-bf8f-39e784c6d70b {{(pid=121403) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 01 18:57:15.351346 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-522c9b7f-5c9f-4ee4-80a0-d05c0f2928f3 tempest-ServersAdmin275Test-1925739795 tempest-ServersAdmin275Test-1925739795-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/87679611-878a-49b2-bf8f-39e784c6d70b" status: 200 len: 1929 microversion: 2.75 time: 0.141105 Nov 01 18:57:15.353338 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 398/856] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 18:57:15 2022] GET /compute/v2.1/servers/87679611-878a-49b2-bf8f-39e784c6d70b => generated 1929 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 01 18:57:15.603992 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-64c7208a-e227-4f27-83e7-84efe57a11d8 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-1630599546", "imageRef": "2d4a0047-1b9e-445f-8af8-1b5c9d93e881", "flavorRef": "452", "networks": [{"uuid": "fca4c402-6e8d-4413-8958-dd7eef1647f7"}], "security_groups": [{"name": "tempest-securitygroup--806578814"}], "key_name": "tempest-keypair-608263486", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 18:57:15.637173 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-a7d12f0f-f3f1-4762-af96-ba6b01ebb58a tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:57:15.639200 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-a7d12f0f-f3f1-4762-af96-ba6b01ebb58a tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] [instance: ea631032-dd04-429b-988e-e6362ea42cf7] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:57:15.657883 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-a7d12f0f-f3f1-4762-af96-ba6b01ebb58a tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:15.661338 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-a7d12f0f-f3f1-4762-af96-ba6b01ebb58a tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:15.661982 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-a7d12f0f-f3f1-4762-af96-ba6b01ebb58a tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:15.662730 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-a7d12f0f-f3f1-4762-af96-ba6b01ebb58a tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:15.663204 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-a7d12f0f-f3f1-4762-af96-ba6b01ebb58a tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:15.668015 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-a7d12f0f-f3f1-4762-af96-ba6b01ebb58a tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:15.899659 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.network.neutron [None req-64c7208a-e227-4f27-83e7-84efe57a11d8 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] validate_networks() for [('fca4c402-6e8d-4413-8958-dd7eef1647f7', None, None, None, None, None)] {{(pid=121402) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 01 18:57:16.004301 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-a7d12f0f-f3f1-4762-af96-ba6b01ebb58a tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c1314c21d8547ff890ede1c2ad281c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c804370880454c7aa02cef2c2c3cf144', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:57:16.036091 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-a7d12f0f-f3f1-4762-af96-ba6b01ebb58a tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c1314c21d8547ff890ede1c2ad281c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c804370880454c7aa02cef2c2c3cf144', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:57:16.040412 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-a7d12f0f-f3f1-4762-af96-ba6b01ebb58a tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c1314c21d8547ff890ede1c2ad281c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c804370880454c7aa02cef2c2c3cf144', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:57:16.073034 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-a7d12f0f-f3f1-4762-af96-ba6b01ebb58a tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] 10.222.0.13 "GET /compute/v2.1/servers/ea631032-dd04-429b-988e-e6362ea42cf7" status: 200 len: 1544 microversion: 2.91 time: 0.441473 Nov 01 18:57:16.079291 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 399/857] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 18:57:15 2022] GET /compute/v2.1/servers/ea631032-dd04-429b-988e-e6362ea42cf7 => generated 1544 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 01 18:57:16.099025 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-d91f40dd-8f1e-4b6b-854d-4abd71db5f4d tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:57:16.099665 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-d91f40dd-8f1e-4b6b-854d-4abd71db5f4d tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] [instance: 7218f99b-b011-4f08-931e-340d47069f6e] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:57:16.114058 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d91f40dd-8f1e-4b6b-854d-4abd71db5f4d tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:16.115538 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d91f40dd-8f1e-4b6b-854d-4abd71db5f4d tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:16.116972 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d91f40dd-8f1e-4b6b-854d-4abd71db5f4d tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:16.118422 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d91f40dd-8f1e-4b6b-854d-4abd71db5f4d tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:16.118900 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d91f40dd-8f1e-4b6b-854d-4abd71db5f4d tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:16.120764 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d91f40dd-8f1e-4b6b-854d-4abd71db5f4d tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:16.415453 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-d91f40dd-8f1e-4b6b-854d-4abd71db5f4d tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72117f17294649d6b8bc16c66c7efab2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45d4c047d3c44324a27a27831236ab0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:57:16.427992 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-d91f40dd-8f1e-4b6b-854d-4abd71db5f4d tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] 10.222.0.13 "GET /compute/v2.1/servers/7218f99b-b011-4f08-931e-340d47069f6e" status: 200 len: 1312 microversion: 2.1 time: 0.344170 Nov 01 18:57:16.447165 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 400/858] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:57:16 2022] GET /compute/v2.1/servers/7218f99b-b011-4f08-931e-340d47069f6e => generated 1312 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:57:16.459688 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-cd2e0ce1-acab-4575-808c-e1b491afe86b tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:57:16.460572 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-cd2e0ce1-acab-4575-808c-e1b491afe86b tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] [instance: 97de391d-c836-40ac-b126-0b6684406d52] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:57:16.473436 n-d-863052-2 devstack@n-api.service[121403]: DEBUG dbcounter [-] [121403] Writing DB stats nova_api:SELECT=98,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=121403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 18:57:16.480250 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-cd2e0ce1-acab-4575-808c-e1b491afe86b tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:16.481105 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-cd2e0ce1-acab-4575-808c-e1b491afe86b tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:16.481765 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-cd2e0ce1-acab-4575-808c-e1b491afe86b tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:16.482691 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-cd2e0ce1-acab-4575-808c-e1b491afe86b tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:16.486220 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-cd2e0ce1-acab-4575-808c-e1b491afe86b tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:16.486908 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-cd2e0ce1-acab-4575-808c-e1b491afe86b tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:16.927886 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-cd2e0ce1-acab-4575-808c-e1b491afe86b tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b52b7dcbb044f9bfc424e4417c77fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '708bc0ea4b5a4baf81933725792bedd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:57:16.930954 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.virt.hardware [None req-64c7208a-e227-4f27-83e7-84efe57a11d8 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Flavor limits 0:0:0 {{(pid=121402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 01 18:57:16.932050 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.virt.hardware [None req-64c7208a-e227-4f27-83e7-84efe57a11d8 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Image limits 0:0:0 {{(pid=121402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 01 18:57:16.933697 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.virt.hardware [None req-64c7208a-e227-4f27-83e7-84efe57a11d8 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Flavor pref 0:0:0 {{(pid=121402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 01 18:57:16.935471 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.virt.hardware [None req-64c7208a-e227-4f27-83e7-84efe57a11d8 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Image pref 0:0:0 {{(pid=121402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 01 18:57:16.936753 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.virt.hardware [None req-64c7208a-e227-4f27-83e7-84efe57a11d8 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 01 18:57:16.956823 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-cd2e0ce1-acab-4575-808c-e1b491afe86b tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] 10.222.0.13 "GET /compute/v2.1/servers/97de391d-c836-40ac-b126-0b6684406d52" status: 200 len: 1528 microversion: 2.1 time: 0.507057 Nov 01 18:57:16.959987 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 401/859] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:57:16 2022] GET /compute/v2.1/servers/97de391d-c836-40ac-b126-0b6684406d52 => generated 1528 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:57:16.970596 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-64c7208a-e227-4f27-83e7-84efe57a11d8 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:16.976232 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-64c7208a-e227-4f27-83e7-84efe57a11d8 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:16.980262 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-64c7208a-e227-4f27-83e7-84efe57a11d8 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:16.983588 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-64c7208a-e227-4f27-83e7-84efe57a11d8 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:16.985591 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [req-a3936184-29bb-4e2c-a510-45e0b9beba0c req-cfcaa013-7575-47bb-96e7-3a7871ab2a65 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d525a31-b0be-44cb-8fb7-335075145f08", "name": "network-vif-plugged", "status": "completed", "tag": "3737be69-e488-4046-be48-2027dbcedf12"}, {"server_uuid": "97de391d-c836-40ac-b126-0b6684406d52", "name": "network-vif-unplugged", "status": "completed", "tag": "7d838ab6-b291-4c63-b4a9-0e37df1c216f"}]} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 18:57:16.985826 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-64c7208a-e227-4f27-83e7-84efe57a11d8 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:16.987299 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-64c7208a-e227-4f27-83e7-84efe57a11d8 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:17.044104 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-a3936184-29bb-4e2c-a510-45e0b9beba0c req-cfcaa013-7575-47bb-96e7-3a7871ab2a65 service nova] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:17.044986 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-a3936184-29bb-4e2c-a510-45e0b9beba0c req-cfcaa013-7575-47bb-96e7-3a7871ab2a65 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:17.048209 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-a3936184-29bb-4e2c-a510-45e0b9beba0c req-cfcaa013-7575-47bb-96e7-3a7871ab2a65 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:17.075723 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.quota [None req-64c7208a-e227-4f27-83e7-84efe57a11d8 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Getting quotas for project 75730f90ec924cbebd605d6d6d747efe. Resources: {'cores', 'ram', 'instances'} {{(pid=121402) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 01 18:57:17.095331 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.quota [None req-64c7208a-e227-4f27-83e7-84efe57a11d8 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Getting quotas for user c2ddf0211c374fe2a0db89546beb8e96 and project 75730f90ec924cbebd605d6d6d747efe. Resources: {'cores', 'ram', 'instances'} {{(pid=121402) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 01 18:57:17.096918 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.compute.server_external_events [req-a3936184-29bb-4e2c-a510-45e0b9beba0c req-cfcaa013-7575-47bb-96e7-3a7871ab2a65 service nova] Creating event network-vif-plugged:3737be69-e488-4046-be48-2027dbcedf12 for instance 2d525a31-b0be-44cb-8fb7-335075145f08 on n-h1-863052-2 Nov 01 18:57:17.099917 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.compute.server_external_events [req-a3936184-29bb-4e2c-a510-45e0b9beba0c req-cfcaa013-7575-47bb-96e7-3a7871ab2a65 service nova] Creating event network-vif-unplugged:7d838ab6-b291-4c63-b4a9-0e37df1c216f for instance 97de391d-c836-40ac-b126-0b6684406d52 on n-h1-863052-2 Nov 01 18:57:17.119208 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [req-a3936184-29bb-4e2c-a510-45e0b9beba0c req-cfcaa013-7575-47bb-96e7-3a7871ab2a65 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.152199 Nov 01 18:57:17.120720 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 402/860] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Nov 1 18:57:16 2022] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 18:57:17.131855 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-64c7208a-e227-4f27-83e7-84efe57a11d8 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Going to run 1 instances... {{(pid=121402) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 01 18:57:17.135510 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-c377dd0a-78b4-4293-b8cc-7aeecfcd5001 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:57:17.138831 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-c377dd0a-78b4-4293-b8cc-7aeecfcd5001 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] [instance: 2d525a31-b0be-44cb-8fb7-335075145f08] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:57:17.141957 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-64c7208a-e227-4f27-83e7-84efe57a11d8 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] [instance: a7f88d19-08ee-47bf-9240-7d49afd775e2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2d4a0047-1b9e-445f-8af8-1b5c9d93e881',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121402) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 01 18:57:17.158867 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-c377dd0a-78b4-4293-b8cc-7aeecfcd5001 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:17.160254 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-c377dd0a-78b4-4293-b8cc-7aeecfcd5001 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:17.161750 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-c377dd0a-78b4-4293-b8cc-7aeecfcd5001 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:17.164391 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-c377dd0a-78b4-4293-b8cc-7aeecfcd5001 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:17.165885 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-c377dd0a-78b4-4293-b8cc-7aeecfcd5001 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:17.169164 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-c377dd0a-78b4-4293-b8cc-7aeecfcd5001 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:17.290037 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-64c7208a-e227-4f27-83e7-84efe57a11d8 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.25 time: 1.684782 Nov 01 18:57:17.291428 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 459/861] 10.222.0.13 () {62 vars in 1188 bytes} [Tue Nov 1 18:57:15 2022] POST /compute/v2.1/servers => generated 405 bytes in 1692 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Nov 01 18:57:17.302681 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-80bd5d6b-81a7-40c3-b7bb-2033b729565a tempest-ServersAdmin275Test-1925739795 tempest-ServersAdmin275Test-1925739795-project-admin] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:57:17.305358 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-80bd5d6b-81a7-40c3-b7bb-2033b729565a tempest-ServersAdmin275Test-1925739795 tempest-ServersAdmin275Test-1925739795-project-admin] [instance: 87679611-878a-49b2-bf8f-39e784c6d70b] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:57:17.364797 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-80bd5d6b-81a7-40c3-b7bb-2033b729565a tempest-ServersAdmin275Test-1925739795 tempest-ServersAdmin275Test-1925739795-project-admin] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:17.369070 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-80bd5d6b-81a7-40c3-b7bb-2033b729565a tempest-ServersAdmin275Test-1925739795 tempest-ServersAdmin275Test-1925739795-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:17.373908 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-80bd5d6b-81a7-40c3-b7bb-2033b729565a tempest-ServersAdmin275Test-1925739795 tempest-ServersAdmin275Test-1925739795-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:17.376617 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-80bd5d6b-81a7-40c3-b7bb-2033b729565a tempest-ServersAdmin275Test-1925739795 tempest-ServersAdmin275Test-1925739795-project-admin] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:17.379688 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-80bd5d6b-81a7-40c3-b7bb-2033b729565a tempest-ServersAdmin275Test-1925739795 tempest-ServersAdmin275Test-1925739795-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:17.381043 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-80bd5d6b-81a7-40c3-b7bb-2033b729565a tempest-ServersAdmin275Test-1925739795 tempest-ServersAdmin275Test-1925739795-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:18.008746 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-c377dd0a-78b4-4293-b8cc-7aeecfcd5001 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f32f5fba1976432d938e664c7714e52b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b9d4c236b944f9b2e8e502a50a8f8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:57:18.027164 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-c377dd0a-78b4-4293-b8cc-7aeecfcd5001 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] 10.222.0.13 "GET /compute/v2.1/servers/2d525a31-b0be-44cb-8fb7-335075145f08" status: 200 len: 1361 microversion: 2.1 time: 0.904087 Nov 01 18:57:18.030284 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 403/862] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:57:17 2022] GET /compute/v2.1/servers/2d525a31-b0be-44cb-8fb7-335075145f08 => generated 1361 bytes in 909 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:57:18.040434 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-7e7a404f-8675-4ff3-91c2-1282528a3228 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:57:18.043323 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-7e7a404f-8675-4ff3-91c2-1282528a3228 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] [instance: ea631032-dd04-429b-988e-e6362ea42cf7] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:57:18.058955 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-7e7a404f-8675-4ff3-91c2-1282528a3228 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:18.062794 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-7e7a404f-8675-4ff3-91c2-1282528a3228 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:18.065289 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-7e7a404f-8675-4ff3-91c2-1282528a3228 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:18.067030 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-7e7a404f-8675-4ff3-91c2-1282528a3228 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:18.075416 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-7e7a404f-8675-4ff3-91c2-1282528a3228 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:18.076175 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-7e7a404f-8675-4ff3-91c2-1282528a3228 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:18.140103 n-d-863052-2 devstack@n-api.service[121403]: DEBUG dbcounter [-] [121403] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=121403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 18:57:18.155144 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.objects.instance [None req-80bd5d6b-81a7-40c3-b7bb-2033b729565a tempest-ServersAdmin275Test-1925739795 tempest-ServersAdmin275Test-1925739795-project-admin] Lazy-loading 'services' on Instance uuid 87679611-878a-49b2-bf8f-39e784c6d70b {{(pid=121402) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 01 18:57:18.228089 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-80bd5d6b-81a7-40c3-b7bb-2033b729565a tempest-ServersAdmin275Test-1925739795 tempest-ServersAdmin275Test-1925739795-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/87679611-878a-49b2-bf8f-39e784c6d70b" status: 200 len: 1929 microversion: 2.75 time: 0.935220 Nov 01 18:57:18.236908 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 460/863] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 18:57:17 2022] GET /compute/v2.1/servers/87679611-878a-49b2-bf8f-39e784c6d70b => generated 1929 bytes in 945 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 18:57:18.259806 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-c63c7d7e-7682-4bb1-a733-7ce7069b9ffc tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:57:18.260532 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-c63c7d7e-7682-4bb1-a733-7ce7069b9ffc tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] [instance: a7f88d19-08ee-47bf-9240-7d49afd775e2] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:57:18.368131 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-7e7a404f-8675-4ff3-91c2-1282528a3228 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c1314c21d8547ff890ede1c2ad281c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c804370880454c7aa02cef2c2c3cf144', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:57:18.393868 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-7e7a404f-8675-4ff3-91c2-1282528a3228 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c1314c21d8547ff890ede1c2ad281c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c804370880454c7aa02cef2c2c3cf144', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:57:18.398914 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-7e7a404f-8675-4ff3-91c2-1282528a3228 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c1314c21d8547ff890ede1c2ad281c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c804370880454c7aa02cef2c2c3cf144', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:57:18.404541 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-7e7a404f-8675-4ff3-91c2-1282528a3228 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] 10.222.0.13 "GET /compute/v2.1/servers/ea631032-dd04-429b-988e-e6362ea42cf7" status: 200 len: 1544 microversion: 2.91 time: 0.370835 Nov 01 18:57:18.405393 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 404/864] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 18:57:18 2022] GET /compute/v2.1/servers/ea631032-dd04-429b-988e-e6362ea42cf7 => generated 1544 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 18:57:18.414369 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-092ba3a2-8bed-4193-899c-728e0ff21669 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:57:18.415814 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-092ba3a2-8bed-4193-899c-728e0ff21669 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] [instance: 7218f99b-b011-4f08-931e-340d47069f6e] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:57:18.422545 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-092ba3a2-8bed-4193-899c-728e0ff21669 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:18.423212 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-092ba3a2-8bed-4193-899c-728e0ff21669 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:18.423864 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-092ba3a2-8bed-4193-899c-728e0ff21669 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:18.426144 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-092ba3a2-8bed-4193-899c-728e0ff21669 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:18.426835 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-092ba3a2-8bed-4193-899c-728e0ff21669 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:18.427568 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-092ba3a2-8bed-4193-899c-728e0ff21669 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:18.905319 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-c63c7d7e-7682-4bb1-a733-7ce7069b9ffc tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:57:18.914937 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-c63c7d7e-7682-4bb1-a733-7ce7069b9ffc tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:57:18.920106 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-c63c7d7e-7682-4bb1-a733-7ce7069b9ffc tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:57:18.924830 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-c63c7d7e-7682-4bb1-a733-7ce7069b9ffc tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] 10.222.0.13 "GET /compute/v2.1/servers/a7f88d19-08ee-47bf-9240-7d49afd775e2" status: 200 len: 1285 microversion: 2.25 time: 0.682191 Nov 01 18:57:18.926302 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 461/865] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 18:57:18 2022] GET /compute/v2.1/servers/a7f88d19-08ee-47bf-9240-7d49afd775e2 => generated 1285 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 18:57:18.942039 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-d0769cb5-8076-4dcd-ada9-6fd0c1803856 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:57:18.943127 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-d0769cb5-8076-4dcd-ada9-6fd0c1803856 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] [instance: 97de391d-c836-40ac-b126-0b6684406d52] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:57:18.967291 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-d0769cb5-8076-4dcd-ada9-6fd0c1803856 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:18.968324 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-d0769cb5-8076-4dcd-ada9-6fd0c1803856 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:18.969464 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-d0769cb5-8076-4dcd-ada9-6fd0c1803856 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:18.970583 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-d0769cb5-8076-4dcd-ada9-6fd0c1803856 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:18.971360 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-d0769cb5-8076-4dcd-ada9-6fd0c1803856 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:18.972185 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-d0769cb5-8076-4dcd-ada9-6fd0c1803856 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:19.544564 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-092ba3a2-8bed-4193-899c-728e0ff21669 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72117f17294649d6b8bc16c66c7efab2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45d4c047d3c44324a27a27831236ab0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:57:19.572985 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-092ba3a2-8bed-4193-899c-728e0ff21669 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] 10.222.0.13 "GET /compute/v2.1/servers/7218f99b-b011-4f08-931e-340d47069f6e" status: 200 len: 1312 microversion: 2.1 time: 1.150319 Nov 01 18:57:19.588155 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 405/866] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:57:18 2022] GET /compute/v2.1/servers/7218f99b-b011-4f08-931e-340d47069f6e => generated 1312 bytes in 1182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:57:19.611946 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-9390cb3c-68b5-495e-8d20-f4f23fdf2ef1 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:57:19.613274 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-9390cb3c-68b5-495e-8d20-f4f23fdf2ef1 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] [instance: 2d525a31-b0be-44cb-8fb7-335075145f08] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:57:19.632859 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-9390cb3c-68b5-495e-8d20-f4f23fdf2ef1 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:19.637692 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-9390cb3c-68b5-495e-8d20-f4f23fdf2ef1 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:19.641331 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-9390cb3c-68b5-495e-8d20-f4f23fdf2ef1 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:19.642328 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-9390cb3c-68b5-495e-8d20-f4f23fdf2ef1 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:19.646397 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-9390cb3c-68b5-495e-8d20-f4f23fdf2ef1 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:19.647048 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-9390cb3c-68b5-495e-8d20-f4f23fdf2ef1 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:19.689433 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-d0769cb5-8076-4dcd-ada9-6fd0c1803856 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b52b7dcbb044f9bfc424e4417c77fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '708bc0ea4b5a4baf81933725792bedd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:57:19.715029 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-d0769cb5-8076-4dcd-ada9-6fd0c1803856 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] 10.222.0.13 "GET /compute/v2.1/servers/97de391d-c836-40ac-b126-0b6684406d52" status: 200 len: 1528 microversion: 2.1 time: 0.782568 Nov 01 18:57:19.721701 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 462/867] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:57:18 2022] GET /compute/v2.1/servers/97de391d-c836-40ac-b126-0b6684406d52 => generated 1528 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:57:19.733055 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-162f32e8-7418-499d-b7ed-38fdce600ea1 tempest-ServersAdmin275Test-1925739795 tempest-ServersAdmin275Test-1925739795-project-admin] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:57:19.734040 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-162f32e8-7418-499d-b7ed-38fdce600ea1 tempest-ServersAdmin275Test-1925739795 tempest-ServersAdmin275Test-1925739795-project-admin] [instance: 87679611-878a-49b2-bf8f-39e784c6d70b] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:57:19.760468 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-162f32e8-7418-499d-b7ed-38fdce600ea1 tempest-ServersAdmin275Test-1925739795 tempest-ServersAdmin275Test-1925739795-project-admin] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:19.765431 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-162f32e8-7418-499d-b7ed-38fdce600ea1 tempest-ServersAdmin275Test-1925739795 tempest-ServersAdmin275Test-1925739795-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:19.766150 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-162f32e8-7418-499d-b7ed-38fdce600ea1 tempest-ServersAdmin275Test-1925739795 tempest-ServersAdmin275Test-1925739795-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:19.767036 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-162f32e8-7418-499d-b7ed-38fdce600ea1 tempest-ServersAdmin275Test-1925739795 tempest-ServersAdmin275Test-1925739795-project-admin] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:19.770082 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-162f32e8-7418-499d-b7ed-38fdce600ea1 tempest-ServersAdmin275Test-1925739795 tempest-ServersAdmin275Test-1925739795-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:19.770742 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-162f32e8-7418-499d-b7ed-38fdce600ea1 tempest-ServersAdmin275Test-1925739795 tempest-ServersAdmin275Test-1925739795-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:20.051062 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-9390cb3c-68b5-495e-8d20-f4f23fdf2ef1 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f32f5fba1976432d938e664c7714e52b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b9d4c236b944f9b2e8e502a50a8f8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:57:20.067584 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-9390cb3c-68b5-495e-8d20-f4f23fdf2ef1 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] 10.222.0.13 "GET /compute/v2.1/servers/2d525a31-b0be-44cb-8fb7-335075145f08" status: 200 len: 1361 microversion: 2.1 time: 0.471934 Nov 01 18:57:20.071104 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 406/868] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:57:19 2022] GET /compute/v2.1/servers/2d525a31-b0be-44cb-8fb7-335075145f08 => generated 1361 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:57:20.082604 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-8cdcd7c8-4a06-45d5-9082-4f3874831ff2 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:57:20.084515 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-8cdcd7c8-4a06-45d5-9082-4f3874831ff2 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] [instance: ea631032-dd04-429b-988e-e6362ea42cf7] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:57:20.085075 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.objects.instance [None req-162f32e8-7418-499d-b7ed-38fdce600ea1 tempest-ServersAdmin275Test-1925739795 tempest-ServersAdmin275Test-1925739795-project-admin] Lazy-loading 'services' on Instance uuid 87679611-878a-49b2-bf8f-39e784c6d70b {{(pid=121402) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 01 18:57:20.096946 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-8cdcd7c8-4a06-45d5-9082-4f3874831ff2 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:20.099518 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-8cdcd7c8-4a06-45d5-9082-4f3874831ff2 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:20.100139 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-8cdcd7c8-4a06-45d5-9082-4f3874831ff2 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:20.101063 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-8cdcd7c8-4a06-45d5-9082-4f3874831ff2 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:20.101852 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-8cdcd7c8-4a06-45d5-9082-4f3874831ff2 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:20.102440 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-8cdcd7c8-4a06-45d5-9082-4f3874831ff2 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:20.122812 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-162f32e8-7418-499d-b7ed-38fdce600ea1 tempest-ServersAdmin275Test-1925739795 tempest-ServersAdmin275Test-1925739795-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/87679611-878a-49b2-bf8f-39e784c6d70b" status: 200 len: 1929 microversion: 2.75 time: 0.399640 Nov 01 18:57:20.127408 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 463/869] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 18:57:19 2022] GET /compute/v2.1/servers/87679611-878a-49b2-bf8f-39e784c6d70b => generated 1929 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 18:57:20.133883 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-fdfdffd1-ebfa-4fe9-94d4-a42367fac6e4 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:57:20.134486 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-fdfdffd1-ebfa-4fe9-94d4-a42367fac6e4 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] [instance: a7f88d19-08ee-47bf-9240-7d49afd775e2] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:57:20.140731 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-fdfdffd1-ebfa-4fe9-94d4-a42367fac6e4 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:20.141540 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-fdfdffd1-ebfa-4fe9-94d4-a42367fac6e4 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:20.141982 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-fdfdffd1-ebfa-4fe9-94d4-a42367fac6e4 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:20.142771 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-fdfdffd1-ebfa-4fe9-94d4-a42367fac6e4 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:20.143228 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-fdfdffd1-ebfa-4fe9-94d4-a42367fac6e4 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:20.143739 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-fdfdffd1-ebfa-4fe9-94d4-a42367fac6e4 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:20.249011 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-fdfdffd1-ebfa-4fe9-94d4-a42367fac6e4 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:57:20.259190 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-fdfdffd1-ebfa-4fe9-94d4-a42367fac6e4 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:57:20.260881 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-fdfdffd1-ebfa-4fe9-94d4-a42367fac6e4 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:57:20.262192 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-fdfdffd1-ebfa-4fe9-94d4-a42367fac6e4 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] 10.222.0.13 "GET /compute/v2.1/servers/a7f88d19-08ee-47bf-9240-7d49afd775e2" status: 200 len: 1337 microversion: 2.25 time: 0.133768 Nov 01 18:57:20.280781 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 464/870] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 18:57:20 2022] GET /compute/v2.1/servers/a7f88d19-08ee-47bf-9240-7d49afd775e2 => generated 1337 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 18:57:20.288960 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [req-00781e47-91c5-4fe2-876e-1fa865a43451 req-17c79f0f-8731-47c1-b1cc-e1a047de025e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7218f99b-b011-4f08-931e-340d47069f6e", "name": "network-vif-plugged", "status": "completed", "tag": "8d7f9336-82a3-4d8c-a178-f498c4931099"}]} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 18:57:20.310712 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-00781e47-91c5-4fe2-876e-1fa865a43451 req-17c79f0f-8731-47c1-b1cc-e1a047de025e service nova] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:20.314434 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-00781e47-91c5-4fe2-876e-1fa865a43451 req-17c79f0f-8731-47c1-b1cc-e1a047de025e service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:20.315092 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-00781e47-91c5-4fe2-876e-1fa865a43451 req-17c79f0f-8731-47c1-b1cc-e1a047de025e service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:20.346598 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-8cdcd7c8-4a06-45d5-9082-4f3874831ff2 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c1314c21d8547ff890ede1c2ad281c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c804370880454c7aa02cef2c2c3cf144', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:57:20.348894 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.compute.server_external_events [req-00781e47-91c5-4fe2-876e-1fa865a43451 req-17c79f0f-8731-47c1-b1cc-e1a047de025e service nova] Creating event network-vif-plugged:8d7f9336-82a3-4d8c-a178-f498c4931099 for instance 7218f99b-b011-4f08-931e-340d47069f6e on n-h2-863052-2 Nov 01 18:57:20.384648 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [req-00781e47-91c5-4fe2-876e-1fa865a43451 req-17c79f0f-8731-47c1-b1cc-e1a047de025e service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101293 Nov 01 18:57:20.391048 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 465/871] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Nov 1 18:57:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 18:57:20.394785 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-8cdcd7c8-4a06-45d5-9082-4f3874831ff2 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c1314c21d8547ff890ede1c2ad281c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c804370880454c7aa02cef2c2c3cf144', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:57:20.398786 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-8cdcd7c8-4a06-45d5-9082-4f3874831ff2 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c1314c21d8547ff890ede1c2ad281c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c804370880454c7aa02cef2c2c3cf144', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:57:20.405197 n-d-863052-2 devstack@n-api.service[121403]: DEBUG dbcounter [-] [121403] Writing DB stats nova_cell0:SELECT=18 {{(pid=121403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 18:57:20.406807 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-8cdcd7c8-4a06-45d5-9082-4f3874831ff2 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] 10.222.0.13 "GET /compute/v2.1/servers/ea631032-dd04-429b-988e-e6362ea42cf7" status: 200 len: 1544 microversion: 2.91 time: 0.334541 Nov 01 18:57:20.408468 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 407/872] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 18:57:20 2022] GET /compute/v2.1/servers/ea631032-dd04-429b-988e-e6362ea42cf7 => generated 1544 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 18:57:20.422767 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [req-2fc8627d-b2a1-4325-9b6b-32c37b315c7a req-9a1f6775-f80b-4b7c-824a-2a3b2620a869 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "97de391d-c836-40ac-b126-0b6684406d52", "name": "network-vif-deleted", "tag": "7d838ab6-b291-4c63-b4a9-0e37df1c216f"}]} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 18:57:20.450401 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-2fc8627d-b2a1-4325-9b6b-32c37b315c7a req-9a1f6775-f80b-4b7c-824a-2a3b2620a869 service nova] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:20.450885 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-2fc8627d-b2a1-4325-9b6b-32c37b315c7a req-9a1f6775-f80b-4b7c-824a-2a3b2620a869 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:20.451307 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-2fc8627d-b2a1-4325-9b6b-32c37b315c7a req-9a1f6775-f80b-4b7c-824a-2a3b2620a869 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:20.487989 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.compute.server_external_events [req-2fc8627d-b2a1-4325-9b6b-32c37b315c7a req-9a1f6775-f80b-4b7c-824a-2a3b2620a869 service nova] Creating event network-vif-deleted:7d838ab6-b291-4c63-b4a9-0e37df1c216f for instance 97de391d-c836-40ac-b126-0b6684406d52 on n-h1-863052-2 Nov 01 18:57:20.498210 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [req-2fc8627d-b2a1-4325-9b6b-32c37b315c7a req-9a1f6775-f80b-4b7c-824a-2a3b2620a869 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104685 Nov 01 18:57:20.499300 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 466/873] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Nov 1 18:57:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 18:57:20.601831 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-8429a49a-378a-4e31-b20d-dd13a54c01bc tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:57:20.603070 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-8429a49a-378a-4e31-b20d-dd13a54c01bc tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] [instance: 7218f99b-b011-4f08-931e-340d47069f6e] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:57:20.620264 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-8429a49a-378a-4e31-b20d-dd13a54c01bc tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:20.621080 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-8429a49a-378a-4e31-b20d-dd13a54c01bc tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:20.621674 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-8429a49a-378a-4e31-b20d-dd13a54c01bc tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:20.622537 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-8429a49a-378a-4e31-b20d-dd13a54c01bc tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:20.623552 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-8429a49a-378a-4e31-b20d-dd13a54c01bc tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:20.624139 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-8429a49a-378a-4e31-b20d-dd13a54c01bc tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:20.745646 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-8ce207e0-3005-43b2-bb2d-d6da5b15c172 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:57:20.747206 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-8ce207e0-3005-43b2-bb2d-d6da5b15c172 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] [instance: 97de391d-c836-40ac-b126-0b6684406d52] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:57:20.761262 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-8ce207e0-3005-43b2-bb2d-d6da5b15c172 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:20.761948 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-8ce207e0-3005-43b2-bb2d-d6da5b15c172 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:20.762557 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-8ce207e0-3005-43b2-bb2d-d6da5b15c172 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:20.763504 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-8ce207e0-3005-43b2-bb2d-d6da5b15c172 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:20.764134 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-8ce207e0-3005-43b2-bb2d-d6da5b15c172 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:20.764824 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-8ce207e0-3005-43b2-bb2d-d6da5b15c172 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:20.931194 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-8ce207e0-3005-43b2-bb2d-d6da5b15c172 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b52b7dcbb044f9bfc424e4417c77fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '708bc0ea4b5a4baf81933725792bedd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:57:20.961822 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-8ce207e0-3005-43b2-bb2d-d6da5b15c172 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] 10.222.0.13 "GET /compute/v2.1/servers/97de391d-c836-40ac-b126-0b6684406d52" status: 200 len: 1486 microversion: 2.1 time: 0.222065 Nov 01 18:57:20.963779 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 467/874] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:57:20 2022] GET /compute/v2.1/servers/97de391d-c836-40ac-b126-0b6684406d52 => generated 1486 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:57:20.972868 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-8429a49a-378a-4e31-b20d-dd13a54c01bc tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72117f17294649d6b8bc16c66c7efab2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45d4c047d3c44324a27a27831236ab0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:57:20.981673 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-8429a49a-378a-4e31-b20d-dd13a54c01bc tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] 10.222.0.13 "GET /compute/v2.1/servers/7218f99b-b011-4f08-931e-340d47069f6e" status: 200 len: 1312 microversion: 2.1 time: 0.383399 Nov 01 18:57:20.982610 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 408/875] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:57:20 2022] GET /compute/v2.1/servers/7218f99b-b011-4f08-931e-340d47069f6e => generated 1312 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:57:21.094097 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-ad11e071-14ee-4405-8203-4fa264957fec tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:57:21.095129 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-ad11e071-14ee-4405-8203-4fa264957fec tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] [instance: 2d525a31-b0be-44cb-8fb7-335075145f08] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:57:21.106019 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-ad11e071-14ee-4405-8203-4fa264957fec tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:21.107540 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-ad11e071-14ee-4405-8203-4fa264957fec tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:21.108198 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-ad11e071-14ee-4405-8203-4fa264957fec tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:21.112429 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-ad11e071-14ee-4405-8203-4fa264957fec tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:21.113237 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-ad11e071-14ee-4405-8203-4fa264957fec tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:21.115153 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-ad11e071-14ee-4405-8203-4fa264957fec tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:21.159726 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-d6c3ee95-5fc7-47cc-9a2e-9451288e28e9 tempest-ServersAdmin275Test-1925739795 tempest-ServersAdmin275Test-1925739795-project-admin] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:57:21.160327 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-d6c3ee95-5fc7-47cc-9a2e-9451288e28e9 tempest-ServersAdmin275Test-1925739795 tempest-ServersAdmin275Test-1925739795-project-admin] [instance: 87679611-878a-49b2-bf8f-39e784c6d70b] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:57:21.185654 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d6c3ee95-5fc7-47cc-9a2e-9451288e28e9 tempest-ServersAdmin275Test-1925739795 tempest-ServersAdmin275Test-1925739795-project-admin] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:21.185654 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d6c3ee95-5fc7-47cc-9a2e-9451288e28e9 tempest-ServersAdmin275Test-1925739795 tempest-ServersAdmin275Test-1925739795-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:21.185654 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d6c3ee95-5fc7-47cc-9a2e-9451288e28e9 tempest-ServersAdmin275Test-1925739795 tempest-ServersAdmin275Test-1925739795-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:21.185654 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d6c3ee95-5fc7-47cc-9a2e-9451288e28e9 tempest-ServersAdmin275Test-1925739795 tempest-ServersAdmin275Test-1925739795-project-admin] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:21.186780 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d6c3ee95-5fc7-47cc-9a2e-9451288e28e9 tempest-ServersAdmin275Test-1925739795 tempest-ServersAdmin275Test-1925739795-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:21.186780 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d6c3ee95-5fc7-47cc-9a2e-9451288e28e9 tempest-ServersAdmin275Test-1925739795 tempest-ServersAdmin275Test-1925739795-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:21.349423 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.objects.instance [None req-d6c3ee95-5fc7-47cc-9a2e-9451288e28e9 tempest-ServersAdmin275Test-1925739795 tempest-ServersAdmin275Test-1925739795-project-admin] Lazy-loading 'services' on Instance uuid 87679611-878a-49b2-bf8f-39e784c6d70b {{(pid=121403) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 01 18:57:21.385028 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-d6c3ee95-5fc7-47cc-9a2e-9451288e28e9 tempest-ServersAdmin275Test-1925739795 tempest-ServersAdmin275Test-1925739795-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/87679611-878a-49b2-bf8f-39e784c6d70b" status: 200 len: 1929 microversion: 2.75 time: 0.229713 Nov 01 18:57:21.405612 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 409/876] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 18:57:21 2022] GET /compute/v2.1/servers/87679611-878a-49b2-bf8f-39e784c6d70b => generated 1929 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 01 18:57:21.423225 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-dbdc23c4-67e7-4ce3-a9df-856cbf62c5f7 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:57:21.424049 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-dbdc23c4-67e7-4ce3-a9df-856cbf62c5f7 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] [instance: a7f88d19-08ee-47bf-9240-7d49afd775e2] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:57:21.436855 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-dbdc23c4-67e7-4ce3-a9df-856cbf62c5f7 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:21.437925 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-dbdc23c4-67e7-4ce3-a9df-856cbf62c5f7 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:21.438539 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-dbdc23c4-67e7-4ce3-a9df-856cbf62c5f7 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:21.439765 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-dbdc23c4-67e7-4ce3-a9df-856cbf62c5f7 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:21.440385 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-dbdc23c4-67e7-4ce3-a9df-856cbf62c5f7 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:21.442487 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-dbdc23c4-67e7-4ce3-a9df-856cbf62c5f7 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:21.493713 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-ad11e071-14ee-4405-8203-4fa264957fec tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f32f5fba1976432d938e664c7714e52b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b9d4c236b944f9b2e8e502a50a8f8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:57:21.512914 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-ad11e071-14ee-4405-8203-4fa264957fec tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] 10.222.0.13 "GET /compute/v2.1/servers/2d525a31-b0be-44cb-8fb7-335075145f08" status: 200 len: 1361 microversion: 2.1 time: 0.420350 Nov 01 18:57:21.515072 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 468/877] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:57:21 2022] GET /compute/v2.1/servers/2d525a31-b0be-44cb-8fb7-335075145f08 => generated 1361 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:57:21.528849 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-8bbe83cf-1b6d-4ce4-a410-6325ab231927 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:57:21.537685 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-8bbe83cf-1b6d-4ce4-a410-6325ab231927 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] [instance: ea631032-dd04-429b-988e-e6362ea42cf7] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:57:21.562114 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-8bbe83cf-1b6d-4ce4-a410-6325ab231927 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:21.563118 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-8bbe83cf-1b6d-4ce4-a410-6325ab231927 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:21.563668 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-8bbe83cf-1b6d-4ce4-a410-6325ab231927 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:21.564932 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-8bbe83cf-1b6d-4ce4-a410-6325ab231927 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:21.567990 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-8bbe83cf-1b6d-4ce4-a410-6325ab231927 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:21.568738 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-8bbe83cf-1b6d-4ce4-a410-6325ab231927 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:21.569036 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-dbdc23c4-67e7-4ce3-a9df-856cbf62c5f7 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:57:21.579161 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-dbdc23c4-67e7-4ce3-a9df-856cbf62c5f7 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:57:21.581173 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-dbdc23c4-67e7-4ce3-a9df-856cbf62c5f7 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:57:21.582767 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-dbdc23c4-67e7-4ce3-a9df-856cbf62c5f7 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] 10.222.0.13 "GET /compute/v2.1/servers/a7f88d19-08ee-47bf-9240-7d49afd775e2" status: 200 len: 1337 microversion: 2.25 time: 0.176094 Nov 01 18:57:21.594810 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 410/878] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 18:57:21 2022] GET /compute/v2.1/servers/a7f88d19-08ee-47bf-9240-7d49afd775e2 => generated 1337 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 18:57:21.711305 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-8bbe83cf-1b6d-4ce4-a410-6325ab231927 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c1314c21d8547ff890ede1c2ad281c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c804370880454c7aa02cef2c2c3cf144', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:57:21.721245 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-8bbe83cf-1b6d-4ce4-a410-6325ab231927 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c1314c21d8547ff890ede1c2ad281c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c804370880454c7aa02cef2c2c3cf144', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:57:21.723227 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-8bbe83cf-1b6d-4ce4-a410-6325ab231927 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c1314c21d8547ff890ede1c2ad281c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c804370880454c7aa02cef2c2c3cf144', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:57:21.734378 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-8bbe83cf-1b6d-4ce4-a410-6325ab231927 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] 10.222.0.13 "GET /compute/v2.1/servers/ea631032-dd04-429b-988e-e6362ea42cf7" status: 200 len: 1544 microversion: 2.91 time: 0.216610 Nov 01 18:57:21.741390 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 469/879] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 18:57:21 2022] GET /compute/v2.1/servers/ea631032-dd04-429b-988e-e6362ea42cf7 => generated 1544 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 18:57:21.987786 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-6976e758-6c90-4595-8694-b7280c4e324c tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:57:21.988536 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-6976e758-6c90-4595-8694-b7280c4e324c tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] [instance: 97de391d-c836-40ac-b126-0b6684406d52] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:57:21.998090 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-6976e758-6c90-4595-8694-b7280c4e324c tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:21.998575 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-6976e758-6c90-4595-8694-b7280c4e324c tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:21.999010 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-6976e758-6c90-4595-8694-b7280c4e324c tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:21.999706 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-6976e758-6c90-4595-8694-b7280c4e324c tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:22.005480 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-a821fd14-5532-4926-8beb-23066d0d4dd0 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:57:22.006873 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-a821fd14-5532-4926-8beb-23066d0d4dd0 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] [instance: 7218f99b-b011-4f08-931e-340d47069f6e] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:57:22.016529 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-6976e758-6c90-4595-8694-b7280c4e324c tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:22.023424 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-6976e758-6c90-4595-8694-b7280c4e324c tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:22.024205 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-a821fd14-5532-4926-8beb-23066d0d4dd0 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:22.024912 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-a821fd14-5532-4926-8beb-23066d0d4dd0 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:22.027182 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-a821fd14-5532-4926-8beb-23066d0d4dd0 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:22.028240 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-a821fd14-5532-4926-8beb-23066d0d4dd0 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:22.031857 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-a821fd14-5532-4926-8beb-23066d0d4dd0 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:22.032474 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-a821fd14-5532-4926-8beb-23066d0d4dd0 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:22.205018 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-6976e758-6c90-4595-8694-b7280c4e324c tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b52b7dcbb044f9bfc424e4417c77fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '708bc0ea4b5a4baf81933725792bedd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:57:22.227831 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-6976e758-6c90-4595-8694-b7280c4e324c tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] 10.222.0.13 "GET /compute/v2.1/servers/97de391d-c836-40ac-b126-0b6684406d52" status: 200 len: 1486 microversion: 2.1 time: 0.243148 Nov 01 18:57:22.252970 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 411/880] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:57:21 2022] GET /compute/v2.1/servers/97de391d-c836-40ac-b126-0b6684406d52 => generated 1486 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:57:22.427040 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-cf36f851-e4f5-4237-b8d5-71faff7a42a9 tempest-ServersAdmin275Test-1925739795 tempest-ServersAdmin275Test-1925739795-project-admin] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:57:22.427817 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-cf36f851-e4f5-4237-b8d5-71faff7a42a9 tempest-ServersAdmin275Test-1925739795 tempest-ServersAdmin275Test-1925739795-project-admin] [instance: 87679611-878a-49b2-bf8f-39e784c6d70b] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:57:22.440370 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-cf36f851-e4f5-4237-b8d5-71faff7a42a9 tempest-ServersAdmin275Test-1925739795 tempest-ServersAdmin275Test-1925739795-project-admin] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:22.449317 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-cf36f851-e4f5-4237-b8d5-71faff7a42a9 tempest-ServersAdmin275Test-1925739795 tempest-ServersAdmin275Test-1925739795-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:22.450102 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-cf36f851-e4f5-4237-b8d5-71faff7a42a9 tempest-ServersAdmin275Test-1925739795 tempest-ServersAdmin275Test-1925739795-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:22.451097 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-cf36f851-e4f5-4237-b8d5-71faff7a42a9 tempest-ServersAdmin275Test-1925739795 tempest-ServersAdmin275Test-1925739795-project-admin] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:22.451798 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-cf36f851-e4f5-4237-b8d5-71faff7a42a9 tempest-ServersAdmin275Test-1925739795 tempest-ServersAdmin275Test-1925739795-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:22.452489 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-cf36f851-e4f5-4237-b8d5-71faff7a42a9 tempest-ServersAdmin275Test-1925739795 tempest-ServersAdmin275Test-1925739795-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:22.607261 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.objects.instance [None req-cf36f851-e4f5-4237-b8d5-71faff7a42a9 tempest-ServersAdmin275Test-1925739795 tempest-ServersAdmin275Test-1925739795-project-admin] Lazy-loading 'services' on Instance uuid 87679611-878a-49b2-bf8f-39e784c6d70b {{(pid=121403) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 01 18:57:22.655958 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-cf36f851-e4f5-4237-b8d5-71faff7a42a9 tempest-ServersAdmin275Test-1925739795 tempest-ServersAdmin275Test-1925739795-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/87679611-878a-49b2-bf8f-39e784c6d70b" status: 200 len: 1929 microversion: 2.75 time: 0.233044 Nov 01 18:57:22.657414 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 412/881] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 18:57:22 2022] GET /compute/v2.1/servers/87679611-878a-49b2-bf8f-39e784c6d70b => generated 1929 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 01 18:57:22.677679 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-8f557e81-fca2-4649-8759-67e3435066a6 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:57:22.678807 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-8f557e81-fca2-4649-8759-67e3435066a6 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] [instance: 2d525a31-b0be-44cb-8fb7-335075145f08] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:57:22.679098 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-a821fd14-5532-4926-8beb-23066d0d4dd0 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72117f17294649d6b8bc16c66c7efab2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45d4c047d3c44324a27a27831236ab0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:57:22.687122 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-a821fd14-5532-4926-8beb-23066d0d4dd0 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] 10.222.0.13 "GET /compute/v2.1/servers/7218f99b-b011-4f08-931e-340d47069f6e" status: 200 len: 1462 microversion: 2.1 time: 0.685559 Nov 01 18:57:22.687955 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 470/882] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:57:22 2022] GET /compute/v2.1/servers/7218f99b-b011-4f08-931e-340d47069f6e => generated 1462 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 18:57:22.699023 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-9c55ba2c-44dc-4267-b3fd-0d9023e27f00 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:57:22.703350 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-9c55ba2c-44dc-4267-b3fd-0d9023e27f00 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] [instance: a7f88d19-08ee-47bf-9240-7d49afd775e2] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:57:22.715096 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-8f557e81-fca2-4649-8759-67e3435066a6 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:22.715752 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-8f557e81-fca2-4649-8759-67e3435066a6 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:22.716734 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-8f557e81-fca2-4649-8759-67e3435066a6 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:22.716871 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-8f557e81-fca2-4649-8759-67e3435066a6 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:22.717211 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-8f557e81-fca2-4649-8759-67e3435066a6 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:22.717337 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-9c55ba2c-44dc-4267-b3fd-0d9023e27f00 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:22.717891 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-9c55ba2c-44dc-4267-b3fd-0d9023e27f00 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:22.718186 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-8f557e81-fca2-4649-8759-67e3435066a6 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:22.718315 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-9c55ba2c-44dc-4267-b3fd-0d9023e27f00 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:22.719055 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-9c55ba2c-44dc-4267-b3fd-0d9023e27f00 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:22.719512 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-9c55ba2c-44dc-4267-b3fd-0d9023e27f00 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:22.719937 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-9c55ba2c-44dc-4267-b3fd-0d9023e27f00 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:22.902947 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-9c55ba2c-44dc-4267-b3fd-0d9023e27f00 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:57:22.914938 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-9c55ba2c-44dc-4267-b3fd-0d9023e27f00 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:57:22.917380 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-9c55ba2c-44dc-4267-b3fd-0d9023e27f00 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:57:22.919173 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-9c55ba2c-44dc-4267-b3fd-0d9023e27f00 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] 10.222.0.13 "GET /compute/v2.1/servers/a7f88d19-08ee-47bf-9240-7d49afd775e2" status: 200 len: 1337 microversion: 2.25 time: 0.223822 Nov 01 18:57:22.920281 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 471/883] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 18:57:22 2022] GET /compute/v2.1/servers/a7f88d19-08ee-47bf-9240-7d49afd775e2 => generated 1337 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 18:57:22.930432 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-61e66bc7-32a5-431b-9509-e1aa1ae5d310 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 18:57:22.943439 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-61e66bc7-32a5-431b-9509-e1aa1ae5d310 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] [instance: 7218f99b-b011-4f08-931e-340d47069f6e] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:57:22.960455 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-61e66bc7-32a5-431b-9509-e1aa1ae5d310 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:22.974788 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-61e66bc7-32a5-431b-9509-e1aa1ae5d310 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:22.977241 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-61e66bc7-32a5-431b-9509-e1aa1ae5d310 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:22.978222 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-61e66bc7-32a5-431b-9509-e1aa1ae5d310 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:22.979891 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-61e66bc7-32a5-431b-9509-e1aa1ae5d310 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:22.980981 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-61e66bc7-32a5-431b-9509-e1aa1ae5d310 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:23.101961 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-8f557e81-fca2-4649-8759-67e3435066a6 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f32f5fba1976432d938e664c7714e52b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b9d4c236b944f9b2e8e502a50a8f8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:57:23.116154 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-8f557e81-fca2-4649-8759-67e3435066a6 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] 10.222.0.13 "GET /compute/v2.1/servers/2d525a31-b0be-44cb-8fb7-335075145f08" status: 200 len: 1544 microversion: 2.1 time: 0.457438 Nov 01 18:57:23.117838 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 413/884] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:57:22 2022] GET /compute/v2.1/servers/2d525a31-b0be-44cb-8fb7-335075145f08 => generated 1544 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:57:23.135804 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-3381bda0-fb4a-4e0a-8575-b9f129370242 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:57:23.140387 n-d-863052-2 devstack@n-api.service[121402]: DEBUG dbcounter [-] [121402] Writing DB stats nova_cell1:SELECT=100 {{(pid=121402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 18:57:23.146316 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-3381bda0-fb4a-4e0a-8575-b9f129370242 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] [instance: ea631032-dd04-429b-988e-e6362ea42cf7] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:57:23.166227 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-3381bda0-fb4a-4e0a-8575-b9f129370242 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:23.167260 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-3381bda0-fb4a-4e0a-8575-b9f129370242 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:23.167860 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-3381bda0-fb4a-4e0a-8575-b9f129370242 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:23.168942 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-3381bda0-fb4a-4e0a-8575-b9f129370242 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:23.169663 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-3381bda0-fb4a-4e0a-8575-b9f129370242 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:23.170264 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-3381bda0-fb4a-4e0a-8575-b9f129370242 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:23.180398 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-61e66bc7-32a5-431b-9509-e1aa1ae5d310 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '72117f17294649d6b8bc16c66c7efab2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45d4c047d3c44324a27a27831236ab0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:57:23.198718 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-61e66bc7-32a5-431b-9509-e1aa1ae5d310 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] [instance: 7218f99b-b011-4f08-931e-340d47069f6e] Old instance type m1.heat2, new instance type m1.heat {{(pid=121402) resize /opt/stack/nova/nova/compute/api.py:4220}} Nov 01 18:57:23.219226 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.virt.hardware [None req-61e66bc7-32a5-431b-9509-e1aa1ae5d310 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Flavor limits 0:0:0 {{(pid=121402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 01 18:57:23.221478 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.virt.hardware [None req-61e66bc7-32a5-431b-9509-e1aa1ae5d310 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Image limits 0:0:0 {{(pid=121402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 01 18:57:23.222674 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.virt.hardware [None req-61e66bc7-32a5-431b-9509-e1aa1ae5d310 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Flavor pref 0:0:0 {{(pid=121402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 01 18:57:23.224382 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.virt.hardware [None req-61e66bc7-32a5-431b-9509-e1aa1ae5d310 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Image pref 0:0:0 {{(pid=121402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 01 18:57:23.225547 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.virt.hardware [None req-61e66bc7-32a5-431b-9509-e1aa1ae5d310 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 01 18:57:23.364474 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-3381bda0-fb4a-4e0a-8575-b9f129370242 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c1314c21d8547ff890ede1c2ad281c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c804370880454c7aa02cef2c2c3cf144', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:57:23.383149 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-3381bda0-fb4a-4e0a-8575-b9f129370242 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c1314c21d8547ff890ede1c2ad281c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c804370880454c7aa02cef2c2c3cf144', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:57:23.387299 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-3381bda0-fb4a-4e0a-8575-b9f129370242 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c1314c21d8547ff890ede1c2ad281c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c804370880454c7aa02cef2c2c3cf144', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:57:23.402751 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-3381bda0-fb4a-4e0a-8575-b9f129370242 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] 10.222.0.13 "GET /compute/v2.1/servers/ea631032-dd04-429b-988e-e6362ea42cf7" status: 200 len: 1544 microversion: 2.91 time: 0.280578 Nov 01 18:57:23.404800 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 414/885] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 18:57:23 2022] GET /compute/v2.1/servers/ea631032-dd04-429b-988e-e6362ea42cf7 => generated 1544 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 18:57:23.425530 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-3f6addbb-4758-4812-bd45-79ed69b81b21 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:57:23.426336 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-3f6addbb-4758-4812-bd45-79ed69b81b21 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] [instance: 2d525a31-b0be-44cb-8fb7-335075145f08] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:57:23.438649 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-3f6addbb-4758-4812-bd45-79ed69b81b21 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:23.439622 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-3f6addbb-4758-4812-bd45-79ed69b81b21 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:23.440388 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-3f6addbb-4758-4812-bd45-79ed69b81b21 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:23.441571 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-3f6addbb-4758-4812-bd45-79ed69b81b21 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:23.444753 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-3f6addbb-4758-4812-bd45-79ed69b81b21 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:23.445722 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-3f6addbb-4758-4812-bd45-79ed69b81b21 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:23.533752 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-61e66bc7-32a5-431b-9509-e1aa1ae5d310 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] 10.222.0.13 "POST /compute/v2.1/servers/7218f99b-b011-4f08-931e-340d47069f6e/action" status: 202 len: 0 microversion: 2.1 time: 0.611312 Nov 01 18:57:23.537908 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 472/886] 10.222.0.13 () {60 vars in 1278 bytes} [Tue Nov 1 18:57:22 2022] POST /compute/v2.1/servers/7218f99b-b011-4f08-931e-340d47069f6e/action => generated 0 bytes in 616 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 01 18:57:23.574698 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-c88ac073-a334-4422-8858-5c0eb4134805 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:57:23.580751 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-c88ac073-a334-4422-8858-5c0eb4134805 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] [instance: 97de391d-c836-40ac-b126-0b6684406d52] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:57:23.609850 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-c88ac073-a334-4422-8858-5c0eb4134805 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:23.610351 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-c88ac073-a334-4422-8858-5c0eb4134805 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:23.618641 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-c88ac073-a334-4422-8858-5c0eb4134805 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:23.619459 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-c88ac073-a334-4422-8858-5c0eb4134805 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:23.627716 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-c88ac073-a334-4422-8858-5c0eb4134805 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:23.628972 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-c88ac073-a334-4422-8858-5c0eb4134805 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:23.711783 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-c88ac073-a334-4422-8858-5c0eb4134805 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:23.712760 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-c88ac073-a334-4422-8858-5c0eb4134805 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:23.713611 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-c88ac073-a334-4422-8858-5c0eb4134805 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:23.714580 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.objects.instance [None req-c88ac073-a334-4422-8858-5c0eb4134805 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Lazy-loading 'fault' on Instance uuid 97de391d-c836-40ac-b126-0b6684406d52 {{(pid=121402) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 01 18:57:23.784949 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-3f6addbb-4758-4812-bd45-79ed69b81b21 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] 10.222.0.13 "GET /compute/v2.1/servers/2d525a31-b0be-44cb-8fb7-335075145f08/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.378206 Nov 01 18:57:23.792792 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 415/887] 10.222.0.13 () {58 vars in 1275 bytes} [Tue Nov 1 18:57:23 2022] GET /compute/v2.1/servers/2d525a31-b0be-44cb-8fb7-335075145f08/os-interface => generated 285 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 18:57:23.798606 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-3402d2fa-48e0-4917-818b-6e45acfb8063 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:57:23.799554 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-3402d2fa-48e0-4917-818b-6e45acfb8063 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] [instance: 7218f99b-b011-4f08-931e-340d47069f6e] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:57:23.803000 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-c88ac073-a334-4422-8858-5c0eb4134805 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b52b7dcbb044f9bfc424e4417c77fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '708bc0ea4b5a4baf81933725792bedd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:57:23.813390 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-c88ac073-a334-4422-8858-5c0eb4134805 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] 10.222.0.13 "GET /compute/v2.1/servers/97de391d-c836-40ac-b126-0b6684406d52" status: 200 len: 1315 microversion: 2.1 time: 0.273580 Nov 01 18:57:23.814593 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 473/888] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:57:23 2022] GET /compute/v2.1/servers/97de391d-c836-40ac-b126-0b6684406d52 => generated 1315 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:57:23.817044 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-3402d2fa-48e0-4917-818b-6e45acfb8063 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:23.817709 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-3402d2fa-48e0-4917-818b-6e45acfb8063 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:23.818344 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-3402d2fa-48e0-4917-818b-6e45acfb8063 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:23.819215 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-3402d2fa-48e0-4917-818b-6e45acfb8063 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:23.820346 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-781bc953-fc4d-4c91-8d4e-f4dfc59ef943 tempest-ServersAdmin275Test-1925739795 tempest-ServersAdmin275Test-1925739795-project-admin] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:57:23.820980 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-781bc953-fc4d-4c91-8d4e-f4dfc59ef943 tempest-ServersAdmin275Test-1925739795 tempest-ServersAdmin275Test-1925739795-project-admin] [instance: 87679611-878a-49b2-bf8f-39e784c6d70b] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:57:23.821194 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-3402d2fa-48e0-4917-818b-6e45acfb8063 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:23.823302 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-3402d2fa-48e0-4917-818b-6e45acfb8063 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:23.829521 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-781bc953-fc4d-4c91-8d4e-f4dfc59ef943 tempest-ServersAdmin275Test-1925739795 tempest-ServersAdmin275Test-1925739795-project-admin] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:23.830379 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-781bc953-fc4d-4c91-8d4e-f4dfc59ef943 tempest-ServersAdmin275Test-1925739795 tempest-ServersAdmin275Test-1925739795-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:23.830817 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-781bc953-fc4d-4c91-8d4e-f4dfc59ef943 tempest-ServersAdmin275Test-1925739795 tempest-ServersAdmin275Test-1925739795-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:23.831703 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-781bc953-fc4d-4c91-8d4e-f4dfc59ef943 tempest-ServersAdmin275Test-1925739795 tempest-ServersAdmin275Test-1925739795-project-admin] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:23.832168 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-781bc953-fc4d-4c91-8d4e-f4dfc59ef943 tempest-ServersAdmin275Test-1925739795 tempest-ServersAdmin275Test-1925739795-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:23.832618 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-781bc953-fc4d-4c91-8d4e-f4dfc59ef943 tempest-ServersAdmin275Test-1925739795 tempest-ServersAdmin275Test-1925739795-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:23.985514 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.objects.instance [None req-781bc953-fc4d-4c91-8d4e-f4dfc59ef943 tempest-ServersAdmin275Test-1925739795 tempest-ServersAdmin275Test-1925739795-project-admin] Lazy-loading 'services' on Instance uuid 87679611-878a-49b2-bf8f-39e784c6d70b {{(pid=121402) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 01 18:57:24.033975 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-781bc953-fc4d-4c91-8d4e-f4dfc59ef943 tempest-ServersAdmin275Test-1925739795 tempest-ServersAdmin275Test-1925739795-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/87679611-878a-49b2-bf8f-39e784c6d70b" status: 200 len: 1929 microversion: 2.75 time: 0.218228 Nov 01 18:57:24.046302 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 474/889] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 18:57:23 2022] GET /compute/v2.1/servers/87679611-878a-49b2-bf8f-39e784c6d70b => generated 1929 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 18:57:24.062164 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-f0117108-8307-40f8-b7bf-6f0f9034a5a2 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:57:24.062944 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-f0117108-8307-40f8-b7bf-6f0f9034a5a2 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] [instance: a7f88d19-08ee-47bf-9240-7d49afd775e2] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:57:24.071209 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f0117108-8307-40f8-b7bf-6f0f9034a5a2 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:24.072010 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f0117108-8307-40f8-b7bf-6f0f9034a5a2 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:24.072180 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f0117108-8307-40f8-b7bf-6f0f9034a5a2 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:24.072926 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f0117108-8307-40f8-b7bf-6f0f9034a5a2 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:24.074076 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f0117108-8307-40f8-b7bf-6f0f9034a5a2 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:24.074076 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f0117108-8307-40f8-b7bf-6f0f9034a5a2 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:24.229216 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-3402d2fa-48e0-4917-818b-6e45acfb8063 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72117f17294649d6b8bc16c66c7efab2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45d4c047d3c44324a27a27831236ab0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:57:24.238222 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-3402d2fa-48e0-4917-818b-6e45acfb8063 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] 10.222.0.13 "GET /compute/v2.1/servers/7218f99b-b011-4f08-931e-340d47069f6e" status: 200 len: 1471 microversion: 2.1 time: 0.443799 Nov 01 18:57:24.241466 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 416/890] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:57:23 2022] GET /compute/v2.1/servers/7218f99b-b011-4f08-931e-340d47069f6e => generated 1471 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:57:24.445003 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-dc0bcc25-454a-4802-b768-bcf75ad03824 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:57:24.448092 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-dc0bcc25-454a-4802-b768-bcf75ad03824 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] [instance: ea631032-dd04-429b-988e-e6362ea42cf7] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:57:24.461274 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-dc0bcc25-454a-4802-b768-bcf75ad03824 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:24.465895 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-dc0bcc25-454a-4802-b768-bcf75ad03824 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:24.466644 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-dc0bcc25-454a-4802-b768-bcf75ad03824 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:24.471361 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-dc0bcc25-454a-4802-b768-bcf75ad03824 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:24.473003 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-dc0bcc25-454a-4802-b768-bcf75ad03824 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:24.473673 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-dc0bcc25-454a-4802-b768-bcf75ad03824 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:24.649926 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-dc0bcc25-454a-4802-b768-bcf75ad03824 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c1314c21d8547ff890ede1c2ad281c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c804370880454c7aa02cef2c2c3cf144', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:57:24.675322 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-dc0bcc25-454a-4802-b768-bcf75ad03824 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c1314c21d8547ff890ede1c2ad281c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c804370880454c7aa02cef2c2c3cf144', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:57:24.686646 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-dc0bcc25-454a-4802-b768-bcf75ad03824 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c1314c21d8547ff890ede1c2ad281c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c804370880454c7aa02cef2c2c3cf144', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:57:24.721181 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-dc0bcc25-454a-4802-b768-bcf75ad03824 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] 10.222.0.13 "GET /compute/v2.1/servers/ea631032-dd04-429b-988e-e6362ea42cf7" status: 200 len: 1544 microversion: 2.91 time: 0.273061 Nov 01 18:57:24.724593 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 417/891] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 18:57:24 2022] GET /compute/v2.1/servers/ea631032-dd04-429b-988e-e6362ea42cf7 => generated 1544 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 18:57:24.843025 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-d96e78f3-cb27-4406-b4cd-3ca7dfaa55c7 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:57:24.843816 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-d96e78f3-cb27-4406-b4cd-3ca7dfaa55c7 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] [instance: 97de391d-c836-40ac-b126-0b6684406d52] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:57:24.855971 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d96e78f3-cb27-4406-b4cd-3ca7dfaa55c7 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:24.857463 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d96e78f3-cb27-4406-b4cd-3ca7dfaa55c7 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:24.859681 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d96e78f3-cb27-4406-b4cd-3ca7dfaa55c7 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:24.862008 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d96e78f3-cb27-4406-b4cd-3ca7dfaa55c7 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:24.864407 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d96e78f3-cb27-4406-b4cd-3ca7dfaa55c7 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:24.865159 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d96e78f3-cb27-4406-b4cd-3ca7dfaa55c7 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:24.978179 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d96e78f3-cb27-4406-b4cd-3ca7dfaa55c7 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:24.979837 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d96e78f3-cb27-4406-b4cd-3ca7dfaa55c7 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:24.980656 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d96e78f3-cb27-4406-b4cd-3ca7dfaa55c7 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:24.981545 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.objects.instance [None req-d96e78f3-cb27-4406-b4cd-3ca7dfaa55c7 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Lazy-loading 'fault' on Instance uuid 97de391d-c836-40ac-b126-0b6684406d52 {{(pid=121403) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 01 18:57:24.991396 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-f0117108-8307-40f8-b7bf-6f0f9034a5a2 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:57:25.011913 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-f0117108-8307-40f8-b7bf-6f0f9034a5a2 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:57:25.021310 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-f0117108-8307-40f8-b7bf-6f0f9034a5a2 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:57:25.038231 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-f0117108-8307-40f8-b7bf-6f0f9034a5a2 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] 10.222.0.13 "GET /compute/v2.1/servers/a7f88d19-08ee-47bf-9240-7d49afd775e2" status: 200 len: 1337 microversion: 2.25 time: 0.991040 Nov 01 18:57:25.043406 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 475/892] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 18:57:24 2022] GET /compute/v2.1/servers/a7f88d19-08ee-47bf-9240-7d49afd775e2 => generated 1337 bytes in 997 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 18:57:25.054936 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-d96e78f3-cb27-4406-b4cd-3ca7dfaa55c7 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b52b7dcbb044f9bfc424e4417c77fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '708bc0ea4b5a4baf81933725792bedd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:57:25.064923 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-d96e78f3-cb27-4406-b4cd-3ca7dfaa55c7 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] 10.222.0.13 "GET /compute/v2.1/servers/97de391d-c836-40ac-b126-0b6684406d52" status: 200 len: 1315 microversion: 2.1 time: 0.226910 Nov 01 18:57:25.066449 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-5da2fa85-ea87-4b37-a42b-bfb74339f5dc tempest-ServersAdmin275Test-1925739795 tempest-ServersAdmin275Test-1925739795-project-admin] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:57:25.067114 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-5da2fa85-ea87-4b37-a42b-bfb74339f5dc tempest-ServersAdmin275Test-1925739795 tempest-ServersAdmin275Test-1925739795-project-admin] [instance: 87679611-878a-49b2-bf8f-39e784c6d70b] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:57:25.084106 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-5da2fa85-ea87-4b37-a42b-bfb74339f5dc tempest-ServersAdmin275Test-1925739795 tempest-ServersAdmin275Test-1925739795-project-admin] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:25.085830 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 418/893] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:57:24 2022] GET /compute/v2.1/servers/97de391d-c836-40ac-b126-0b6684406d52 => generated 1315 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 18:57:25.091945 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-5da2fa85-ea87-4b37-a42b-bfb74339f5dc tempest-ServersAdmin275Test-1925739795 tempest-ServersAdmin275Test-1925739795-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:25.094430 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-5da2fa85-ea87-4b37-a42b-bfb74339f5dc tempest-ServersAdmin275Test-1925739795 tempest-ServersAdmin275Test-1925739795-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:25.095509 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-5da2fa85-ea87-4b37-a42b-bfb74339f5dc tempest-ServersAdmin275Test-1925739795 tempest-ServersAdmin275Test-1925739795-project-admin] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:25.102468 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-5da2fa85-ea87-4b37-a42b-bfb74339f5dc tempest-ServersAdmin275Test-1925739795 tempest-ServersAdmin275Test-1925739795-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:25.103303 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-5da2fa85-ea87-4b37-a42b-bfb74339f5dc tempest-ServersAdmin275Test-1925739795 tempest-ServersAdmin275Test-1925739795-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:25.270195 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-d1f90a0d-cf3a-4a29-84dd-24f637a09fd0 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:57:25.270910 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-d1f90a0d-cf3a-4a29-84dd-24f637a09fd0 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] [instance: 7218f99b-b011-4f08-931e-340d47069f6e] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:57:25.287654 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d1f90a0d-cf3a-4a29-84dd-24f637a09fd0 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:25.289386 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d1f90a0d-cf3a-4a29-84dd-24f637a09fd0 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:25.291044 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d1f90a0d-cf3a-4a29-84dd-24f637a09fd0 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:25.292112 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d1f90a0d-cf3a-4a29-84dd-24f637a09fd0 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:25.294024 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d1f90a0d-cf3a-4a29-84dd-24f637a09fd0 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:25.295552 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d1f90a0d-cf3a-4a29-84dd-24f637a09fd0 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:25.624776 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-d1f90a0d-cf3a-4a29-84dd-24f637a09fd0 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72117f17294649d6b8bc16c66c7efab2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45d4c047d3c44324a27a27831236ab0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:57:25.637884 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-d1f90a0d-cf3a-4a29-84dd-24f637a09fd0 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] 10.222.0.13 "GET /compute/v2.1/servers/7218f99b-b011-4f08-931e-340d47069f6e" status: 200 len: 1471 microversion: 2.1 time: 0.374196 Nov 01 18:57:25.638376 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.objects.instance [None req-5da2fa85-ea87-4b37-a42b-bfb74339f5dc tempest-ServersAdmin275Test-1925739795 tempest-ServersAdmin275Test-1925739795-project-admin] Lazy-loading 'services' on Instance uuid 87679611-878a-49b2-bf8f-39e784c6d70b {{(pid=121402) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 01 18:57:25.651045 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 419/894] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:57:25 2022] GET /compute/v2.1/servers/7218f99b-b011-4f08-931e-340d47069f6e => generated 1471 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 18:57:25.690284 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-5da2fa85-ea87-4b37-a42b-bfb74339f5dc tempest-ServersAdmin275Test-1925739795 tempest-ServersAdmin275Test-1925739795-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/87679611-878a-49b2-bf8f-39e784c6d70b" status: 200 len: 1929 microversion: 2.75 time: 0.628436 Nov 01 18:57:25.692399 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 476/895] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 18:57:25 2022] GET /compute/v2.1/servers/87679611-878a-49b2-bf8f-39e784c6d70b => generated 1929 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 18:57:25.763386 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-302d766b-44ae-488e-ad07-03b3d0749610 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:57:25.772342 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-302d766b-44ae-488e-ad07-03b3d0749610 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] [instance: ea631032-dd04-429b-988e-e6362ea42cf7] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:57:25.786020 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-302d766b-44ae-488e-ad07-03b3d0749610 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:25.792361 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-302d766b-44ae-488e-ad07-03b3d0749610 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:25.793036 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-302d766b-44ae-488e-ad07-03b3d0749610 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:25.796078 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-302d766b-44ae-488e-ad07-03b3d0749610 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:25.802616 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-302d766b-44ae-488e-ad07-03b3d0749610 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:25.804079 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-302d766b-44ae-488e-ad07-03b3d0749610 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:25.829751 n-d-863052-2 devstack@n-api.service[121403]: DEBUG dbcounter [-] [121403] Writing DB stats nova_cell1:SELECT=100 {{(pid=121403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 18:57:26.045831 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-302d766b-44ae-488e-ad07-03b3d0749610 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c1314c21d8547ff890ede1c2ad281c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c804370880454c7aa02cef2c2c3cf144', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:57:26.061686 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-302d766b-44ae-488e-ad07-03b3d0749610 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c1314c21d8547ff890ede1c2ad281c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c804370880454c7aa02cef2c2c3cf144', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:57:26.067186 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-302d766b-44ae-488e-ad07-03b3d0749610 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c1314c21d8547ff890ede1c2ad281c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c804370880454c7aa02cef2c2c3cf144', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:57:26.073086 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-91df0d56-4fcd-4236-8b6a-793f780c2b63 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:57:26.073752 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-91df0d56-4fcd-4236-8b6a-793f780c2b63 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] [instance: a7f88d19-08ee-47bf-9240-7d49afd775e2] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:57:26.076780 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-302d766b-44ae-488e-ad07-03b3d0749610 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] 10.222.0.13 "GET /compute/v2.1/servers/ea631032-dd04-429b-988e-e6362ea42cf7" status: 200 len: 1544 microversion: 2.91 time: 0.322987 Nov 01 18:57:26.085068 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 420/896] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 18:57:25 2022] GET /compute/v2.1/servers/ea631032-dd04-429b-988e-e6362ea42cf7 => generated 1544 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 18:57:26.100477 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-91df0d56-4fcd-4236-8b6a-793f780c2b63 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:26.101416 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-91df0d56-4fcd-4236-8b6a-793f780c2b63 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:26.102098 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-91df0d56-4fcd-4236-8b6a-793f780c2b63 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:26.103085 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-91df0d56-4fcd-4236-8b6a-793f780c2b63 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:26.104373 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-6aed6bff-b199-4e3c-9cf4-044b941e962a tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:57:26.104834 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-91df0d56-4fcd-4236-8b6a-793f780c2b63 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:26.105002 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-6aed6bff-b199-4e3c-9cf4-044b941e962a tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] [instance: 97de391d-c836-40ac-b126-0b6684406d52] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:57:26.106277 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-91df0d56-4fcd-4236-8b6a-793f780c2b63 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:26.120641 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-6aed6bff-b199-4e3c-9cf4-044b941e962a tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:26.122744 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-6aed6bff-b199-4e3c-9cf4-044b941e962a tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:26.125132 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-6aed6bff-b199-4e3c-9cf4-044b941e962a tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:26.126143 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-6aed6bff-b199-4e3c-9cf4-044b941e962a tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:26.126581 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-6aed6bff-b199-4e3c-9cf4-044b941e962a tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:26.127038 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-6aed6bff-b199-4e3c-9cf4-044b941e962a tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:26.160234 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.wsgi [None req-6aed6bff-b199-4e3c-9cf4-044b941e962a tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] HTTP exception thrown: Instance 97de391d-c836-40ac-b126-0b6684406d52 could not be found. Nov 01 18:57:26.161924 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-6aed6bff-b199-4e3c-9cf4-044b941e962a tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Request method failure captured: Nov 01 18:57:26.161924 n-d-863052-2 devstack@n-api.service[121403]: request: GET /compute/v2.1/servers/97de391d-c836-40ac-b126-0b6684406d52 HTTP/1.1 Nov 01 18:57:26.161924 n-d-863052-2 devstack@n-api.service[121403]: Accept: application/json Nov 01 18:57:26.161924 n-d-863052-2 devstack@n-api.service[121403]: Accept-Encoding: identity Nov 01 18:57:26.161924 n-d-863052-2 devstack@n-api.service[121403]: Connection: close Nov 01 18:57:26.161924 n-d-863052-2 devstack@n-api.service[121403]: Content-Length: 0 Nov 01 18:57:26.161924 n-d-863052-2 devstack@n-api.service[121403]: Content-Type: application/json Nov 01 18:57:26.161924 n-d-863052-2 devstack@n-api.service[121403]: Host: 10.222.0.13 Nov 01 18:57:26.161924 n-d-863052-2 devstack@n-api.service[121403]: Openstack-System-Scope: None Nov 01 18:57:26.161924 n-d-863052-2 devstack@n-api.service[121403]: User-Agent: python-urllib3/1.26.12 Nov 01 18:57:26.161924 n-d-863052-2 devstack@n-api.service[121403]: X-Auth-Token: gAAAAABjYWvqbQtaNCf0vN3RIHicQ7eZzuMpptpvowYCNSOJcJRxrJ9QX4Bvdyyh6S1_lak_JDolcn4qSC02atGGl8uI3NqpWQKt52qXcbtBLMPpaEiNHqRmhd3SjpSTdiucZ2dSpVmatQ9uPpkpENeFkI_E8IIwNVu5-V-pSAlLNGA0j86IptM Nov 01 18:57:26.161924 n-d-863052-2 devstack@n-api.service[121403]: X-Domain-Id: None Nov 01 18:57:26.161924 n-d-863052-2 devstack@n-api.service[121403]: X-Domain-Name: None Nov 01 18:57:26.161924 n-d-863052-2 devstack@n-api.service[121403]: X-Identity-Status: Confirmed Nov 01 18:57:26.161924 n-d-863052-2 devstack@n-api.service[121403]: X-Is-Admin-Project: True Nov 01 18:57:26.161924 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Domain-Id: default Nov 01 18:57:26.161924 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Domain-Name: Default Nov 01 18:57:26.161924 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Id: 708bc0ea4b5a4baf81933725792bedd5 Nov 01 18:57:26.161924 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1431666313 Nov 01 18:57:26.161924 n-d-863052-2 devstack@n-api.service[121403]: X-Role: member,reader Nov 01 18:57:26.161924 n-d-863052-2 devstack@n-api.service[121403]: X-Roles: member,reader Nov 01 18:57:26.163383 n-d-863052-2 devstack@n-api.service[121403]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/708bc0ea4b5a4baf81933725792bedd5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/708bc0ea4b5a4baf81933725792bedd5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_708bc0ea4b5a4baf81933725792bedd5", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/708bc0ea4b5a4baf81933725792bedd5"}]}] Nov 01 18:57:26.163383 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1431666313 Nov 01 18:57:26.163383 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant-Id: 708bc0ea4b5a4baf81933725792bedd5 Nov 01 18:57:26.163383 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1431666313 Nov 01 18:57:26.163383 n-d-863052-2 devstack@n-api.service[121403]: X-User: tempest-ImagesOneServerNegativeTestJSON-1431666313-project Nov 01 18:57:26.163383 n-d-863052-2 devstack@n-api.service[121403]: X-User-Domain-Id: default Nov 01 18:57:26.163383 n-d-863052-2 devstack@n-api.service[121403]: X-User-Domain-Name: Default Nov 01 18:57:26.163383 n-d-863052-2 devstack@n-api.service[121403]: X-User-Id: 09b52b7dcbb044f9bfc424e4417c77fa Nov 01 18:57:26.163383 n-d-863052-2 devstack@n-api.service[121403]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1431666313-project Nov 01 18:57:26.163383 n-d-863052-2 devstack@n-api.service[121403]: method: > Nov 01 18:57:26.163383 n-d-863052-2 devstack@n-api.service[121403]: exception: Instance 97de391d-c836-40ac-b126-0b6684406d52 could not be found. Nov 01 18:57:26.163383 n-d-863052-2 devstack@n-api.service[121403]: action_args: {'id': '97de391d-c836-40ac-b126-0b6684406d52'} Nov 01 18:57:26.164270 n-d-863052-2 devstack@n-api.service[121403]: {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 01 18:57:26.164270 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:57:26.164270 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 01 18:57:26.164270 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 01 18:57:26.164270 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 01 18:57:26.164270 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 01 18:57:26.164270 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 01 18:57:26.164270 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 01 18:57:26.164270 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 01 18:57:26.164270 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 01 18:57:26.164270 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 97de391d-c836-40ac-b126-0b6684406d52 could not be found. Nov 01 18:57:26.164270 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 18:57:26.164270 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 18:57:26.164270 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 18:57:26.164270 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:57:26.164270 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 18:57:26.164270 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 18:57:26.164270 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 01 18:57:26.164270 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 01 18:57:26.164270 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 01 18:57:26.166832 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 01 18:57:26.166832 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 01 18:57:26.166832 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 01 18:57:26.166832 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 01 18:57:26.166832 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 01 18:57:26.166832 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 01 18:57:26.166832 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 01 18:57:26.166832 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 97de391d-c836-40ac-b126-0b6684406d52 could not be found. Nov 01 18:57:26.166832 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 18:57:26.166832 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 18:57:26.166832 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 18:57:26.166832 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:57:26.166832 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 18:57:26.166832 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 18:57:26.166832 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 01 18:57:26.166832 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 01 18:57:26.166832 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 97de391d-c836-40ac-b126-0b6684406d52 could not be found. Nov 01 18:57:26.166832 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 18:57:26.169574 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-6aed6bff-b199-4e3c-9cf4-044b941e962a tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Returning 404 to user: Instance 97de391d-c836-40ac-b126-0b6684406d52 could not be found. {{(pid=121403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 01 18:57:26.169574 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-6aed6bff-b199-4e3c-9cf4-044b941e962a tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] 10.222.0.13 "GET /compute/v2.1/servers/97de391d-c836-40ac-b126-0b6684406d52" status: 404 len: 111 microversion: 2.1 time: 0.062876 Nov 01 18:57:26.181757 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 421/897] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:57:26 2022] GET /compute/v2.1/servers/97de391d-c836-40ac-b126-0b6684406d52 => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 01 18:57:26.186969 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-0ca2f8be-4a42-49aa-b474-8a09116740d9 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Action: 'create', calling method: .version_select at 0x7f0ae29d1820>, body: {"keypair": {"name": "tempest-keypair-1505489971", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEUP3Ew08zfNuZ+gZHvLqOpz8REcXUC7kkGumZTzpeHWpFIZZDRZbP2kYAEMtsI6e+73GeLpduzAI47/fL+DlROSOxtN9dO1s7F7DgWdeWSOoUpwdRyWllV2RRqGgte0sQ=="}} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 18:57:26.230618 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.quota [None req-0ca2f8be-4a42-49aa-b474-8a09116740d9 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Getting quotas for project 708bc0ea4b5a4baf81933725792bedd5. Resources: {'key_pairs'} {{(pid=121403) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 01 18:57:26.251039 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.quota [None req-0ca2f8be-4a42-49aa-b474-8a09116740d9 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Getting quotas for user 09b52b7dcbb044f9bfc424e4417c77fa and project 708bc0ea4b5a4baf81933725792bedd5. Resources: {'key_pairs'} {{(pid=121403) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 01 18:57:26.317174 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-0ca2f8be-4a42-49aa-b474-8a09116740d9 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.134010 Nov 01 18:57:26.325292 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 422/898] 10.222.0.13 () {60 vars in 1159 bytes} [Tue Nov 1 18:57:26 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 18:57:26.575513 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-91df0d56-4fcd-4236-8b6a-793f780c2b63 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:57:26.588877 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-91df0d56-4fcd-4236-8b6a-793f780c2b63 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:57:26.590356 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-91df0d56-4fcd-4236-8b6a-793f780c2b63 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:57:26.591492 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-91df0d56-4fcd-4236-8b6a-793f780c2b63 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] 10.222.0.13 "GET /compute/v2.1/servers/a7f88d19-08ee-47bf-9240-7d49afd775e2" status: 200 len: 1343 microversion: 2.25 time: 0.523175 Nov 01 18:57:26.595493 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 477/899] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 18:57:26 2022] GET /compute/v2.1/servers/a7f88d19-08ee-47bf-9240-7d49afd775e2 => generated 1343 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 18:57:26.674269 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-cb4de103-5b03-4bcb-9de7-8d3945145404 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:57:26.675940 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-cb4de103-5b03-4bcb-9de7-8d3945145404 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] [instance: 7218f99b-b011-4f08-931e-340d47069f6e] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:57:26.683136 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-cb4de103-5b03-4bcb-9de7-8d3945145404 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:26.683926 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-cb4de103-5b03-4bcb-9de7-8d3945145404 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:26.684892 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-cb4de103-5b03-4bcb-9de7-8d3945145404 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:26.685827 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-cb4de103-5b03-4bcb-9de7-8d3945145404 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:26.687083 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-cb4de103-5b03-4bcb-9de7-8d3945145404 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:26.687972 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-cb4de103-5b03-4bcb-9de7-8d3945145404 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:26.724940 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-f31b57d0-a6de-4329-a1ae-02b833077867 tempest-ServersAdmin275Test-1925739795 tempest-ServersAdmin275Test-1925739795-project-admin] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:57:26.725669 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-f31b57d0-a6de-4329-a1ae-02b833077867 tempest-ServersAdmin275Test-1925739795 tempest-ServersAdmin275Test-1925739795-project-admin] [instance: 87679611-878a-49b2-bf8f-39e784c6d70b] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:57:26.739115 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f31b57d0-a6de-4329-a1ae-02b833077867 tempest-ServersAdmin275Test-1925739795 tempest-ServersAdmin275Test-1925739795-project-admin] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:26.741415 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f31b57d0-a6de-4329-a1ae-02b833077867 tempest-ServersAdmin275Test-1925739795 tempest-ServersAdmin275Test-1925739795-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:26.741978 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f31b57d0-a6de-4329-a1ae-02b833077867 tempest-ServersAdmin275Test-1925739795 tempest-ServersAdmin275Test-1925739795-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:26.745481 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f31b57d0-a6de-4329-a1ae-02b833077867 tempest-ServersAdmin275Test-1925739795 tempest-ServersAdmin275Test-1925739795-project-admin] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:26.746078 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f31b57d0-a6de-4329-a1ae-02b833077867 tempest-ServersAdmin275Test-1925739795 tempest-ServersAdmin275Test-1925739795-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:26.746613 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f31b57d0-a6de-4329-a1ae-02b833077867 tempest-ServersAdmin275Test-1925739795 tempest-ServersAdmin275Test-1925739795-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:26.907701 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.objects.instance [None req-f31b57d0-a6de-4329-a1ae-02b833077867 tempest-ServersAdmin275Test-1925739795 tempest-ServersAdmin275Test-1925739795-project-admin] Lazy-loading 'services' on Instance uuid 87679611-878a-49b2-bf8f-39e784c6d70b {{(pid=121402) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 01 18:57:26.956025 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-f31b57d0-a6de-4329-a1ae-02b833077867 tempest-ServersAdmin275Test-1925739795 tempest-ServersAdmin275Test-1925739795-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/87679611-878a-49b2-bf8f-39e784c6d70b" status: 200 len: 1929 microversion: 2.75 time: 0.238089 Nov 01 18:57:26.974285 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 478/900] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 18:57:26 2022] GET /compute/v2.1/servers/87679611-878a-49b2-bf8f-39e784c6d70b => generated 1929 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 18:57:27.116620 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-71479660-ef7c-4b58-b24f-a409daceaf2e tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:57:27.118027 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-71479660-ef7c-4b58-b24f-a409daceaf2e tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] [instance: ea631032-dd04-429b-988e-e6362ea42cf7] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:57:27.120135 n-d-863052-2 devstack@n-api.service[121402]: DEBUG dbcounter [-] [121402] Writing DB stats nova_cell0:SELECT=2 {{(pid=121402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 18:57:27.135987 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-71479660-ef7c-4b58-b24f-a409daceaf2e tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:27.137532 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-71479660-ef7c-4b58-b24f-a409daceaf2e tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:27.138247 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-71479660-ef7c-4b58-b24f-a409daceaf2e tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:27.140696 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-71479660-ef7c-4b58-b24f-a409daceaf2e tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:27.141358 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-71479660-ef7c-4b58-b24f-a409daceaf2e tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:27.141960 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-71479660-ef7c-4b58-b24f-a409daceaf2e tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:27.229685 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-cb4de103-5b03-4bcb-9de7-8d3945145404 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72117f17294649d6b8bc16c66c7efab2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45d4c047d3c44324a27a27831236ab0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:57:27.243070 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-cb4de103-5b03-4bcb-9de7-8d3945145404 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] 10.222.0.13 "GET /compute/v2.1/servers/7218f99b-b011-4f08-931e-340d47069f6e" status: 200 len: 1471 microversion: 2.1 time: 0.572567 Nov 01 18:57:27.251656 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 423/901] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:57:26 2022] GET /compute/v2.1/servers/7218f99b-b011-4f08-931e-340d47069f6e => generated 1471 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:57:27.305349 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-71479660-ef7c-4b58-b24f-a409daceaf2e tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c1314c21d8547ff890ede1c2ad281c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c804370880454c7aa02cef2c2c3cf144', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:57:27.318230 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-71479660-ef7c-4b58-b24f-a409daceaf2e tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c1314c21d8547ff890ede1c2ad281c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c804370880454c7aa02cef2c2c3cf144', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:57:27.320013 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-71479660-ef7c-4b58-b24f-a409daceaf2e tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c1314c21d8547ff890ede1c2ad281c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c804370880454c7aa02cef2c2c3cf144', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:57:27.336556 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-71479660-ef7c-4b58-b24f-a409daceaf2e tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] 10.222.0.13 "GET /compute/v2.1/servers/ea631032-dd04-429b-988e-e6362ea42cf7" status: 200 len: 1544 microversion: 2.91 time: 0.225521 Nov 01 18:57:27.337728 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 479/902] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 18:57:27 2022] GET /compute/v2.1/servers/ea631032-dd04-429b-988e-e6362ea42cf7 => generated 1544 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 18:57:27.618147 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-62ff9392-c6c9-47df-ac6b-3cd7e33d0988 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:57:27.619441 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-62ff9392-c6c9-47df-ac6b-3cd7e33d0988 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] [instance: a7f88d19-08ee-47bf-9240-7d49afd775e2] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:57:27.626344 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-62ff9392-c6c9-47df-ac6b-3cd7e33d0988 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:27.627103 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-62ff9392-c6c9-47df-ac6b-3cd7e33d0988 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:27.627735 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-62ff9392-c6c9-47df-ac6b-3cd7e33d0988 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:27.629208 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-62ff9392-c6c9-47df-ac6b-3cd7e33d0988 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:27.629875 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-62ff9392-c6c9-47df-ac6b-3cd7e33d0988 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:27.630516 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-62ff9392-c6c9-47df-ac6b-3cd7e33d0988 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:27.861965 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-62ff9392-c6c9-47df-ac6b-3cd7e33d0988 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:57:27.876233 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-62ff9392-c6c9-47df-ac6b-3cd7e33d0988 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:57:27.881880 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-62ff9392-c6c9-47df-ac6b-3cd7e33d0988 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:57:27.883664 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-62ff9392-c6c9-47df-ac6b-3cd7e33d0988 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] 10.222.0.13 "GET /compute/v2.1/servers/a7f88d19-08ee-47bf-9240-7d49afd775e2" status: 200 len: 1343 microversion: 2.25 time: 0.269558 Nov 01 18:57:27.884988 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 424/903] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 18:57:27 2022] GET /compute/v2.1/servers/a7f88d19-08ee-47bf-9240-7d49afd775e2 => generated 1343 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 18:57:27.996651 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-83889d39-c3a9-4bdb-b8fe-985963693ac0 tempest-ServersAdmin275Test-1925739795 tempest-ServersAdmin275Test-1925739795-project-admin] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:57:27.997736 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-83889d39-c3a9-4bdb-b8fe-985963693ac0 tempest-ServersAdmin275Test-1925739795 tempest-ServersAdmin275Test-1925739795-project-admin] [instance: 87679611-878a-49b2-bf8f-39e784c6d70b] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:57:28.006296 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-83889d39-c3a9-4bdb-b8fe-985963693ac0 tempest-ServersAdmin275Test-1925739795 tempest-ServersAdmin275Test-1925739795-project-admin] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:28.006296 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-83889d39-c3a9-4bdb-b8fe-985963693ac0 tempest-ServersAdmin275Test-1925739795 tempest-ServersAdmin275Test-1925739795-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:28.006629 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-83889d39-c3a9-4bdb-b8fe-985963693ac0 tempest-ServersAdmin275Test-1925739795 tempest-ServersAdmin275Test-1925739795-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:28.007339 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-83889d39-c3a9-4bdb-b8fe-985963693ac0 tempest-ServersAdmin275Test-1925739795 tempest-ServersAdmin275Test-1925739795-project-admin] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:28.007959 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-83889d39-c3a9-4bdb-b8fe-985963693ac0 tempest-ServersAdmin275Test-1925739795 tempest-ServersAdmin275Test-1925739795-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:28.008560 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-83889d39-c3a9-4bdb-b8fe-985963693ac0 tempest-ServersAdmin275Test-1925739795 tempest-ServersAdmin275Test-1925739795-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:28.173373 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.objects.instance [None req-83889d39-c3a9-4bdb-b8fe-985963693ac0 tempest-ServersAdmin275Test-1925739795 tempest-ServersAdmin275Test-1925739795-project-admin] Lazy-loading 'services' on Instance uuid 87679611-878a-49b2-bf8f-39e784c6d70b {{(pid=121402) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 01 18:57:28.203388 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-83889d39-c3a9-4bdb-b8fe-985963693ac0 tempest-ServersAdmin275Test-1925739795 tempest-ServersAdmin275Test-1925739795-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/87679611-878a-49b2-bf8f-39e784c6d70b" status: 200 len: 1929 microversion: 2.75 time: 0.210862 Nov 01 18:57:28.204492 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 480/904] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 18:57:27 2022] GET /compute/v2.1/servers/87679611-878a-49b2-bf8f-39e784c6d70b => generated 1929 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 18:57:28.274280 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-b6f949a9-4363-4826-ad95-9c65bf80b1b6 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:57:28.275243 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-b6f949a9-4363-4826-ad95-9c65bf80b1b6 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] [instance: 7218f99b-b011-4f08-931e-340d47069f6e] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:57:28.287044 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-b6f949a9-4363-4826-ad95-9c65bf80b1b6 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:28.291428 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-b6f949a9-4363-4826-ad95-9c65bf80b1b6 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:28.292012 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-b6f949a9-4363-4826-ad95-9c65bf80b1b6 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:28.292885 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-b6f949a9-4363-4826-ad95-9c65bf80b1b6 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:28.293453 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-b6f949a9-4363-4826-ad95-9c65bf80b1b6 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:28.293984 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-b6f949a9-4363-4826-ad95-9c65bf80b1b6 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:28.368063 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-445cdd24-2fb2-416f-a53c-25f2cc49f779 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:57:28.369229 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-445cdd24-2fb2-416f-a53c-25f2cc49f779 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] [instance: ea631032-dd04-429b-988e-e6362ea42cf7] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:57:28.383536 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-445cdd24-2fb2-416f-a53c-25f2cc49f779 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:28.384049 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-445cdd24-2fb2-416f-a53c-25f2cc49f779 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:28.387714 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-445cdd24-2fb2-416f-a53c-25f2cc49f779 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:28.391419 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-445cdd24-2fb2-416f-a53c-25f2cc49f779 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:28.391925 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-445cdd24-2fb2-416f-a53c-25f2cc49f779 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:28.392539 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-445cdd24-2fb2-416f-a53c-25f2cc49f779 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:28.567109 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-445cdd24-2fb2-416f-a53c-25f2cc49f779 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c1314c21d8547ff890ede1c2ad281c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c804370880454c7aa02cef2c2c3cf144', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:57:28.582764 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-445cdd24-2fb2-416f-a53c-25f2cc49f779 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c1314c21d8547ff890ede1c2ad281c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c804370880454c7aa02cef2c2c3cf144', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:57:28.584551 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-445cdd24-2fb2-416f-a53c-25f2cc49f779 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c1314c21d8547ff890ede1c2ad281c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c804370880454c7aa02cef2c2c3cf144', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:57:28.593392 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-445cdd24-2fb2-416f-a53c-25f2cc49f779 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] 10.222.0.13 "GET /compute/v2.1/servers/ea631032-dd04-429b-988e-e6362ea42cf7" status: 200 len: 1544 microversion: 2.91 time: 0.229674 Nov 01 18:57:28.609388 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 481/905] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 18:57:28 2022] GET /compute/v2.1/servers/ea631032-dd04-429b-988e-e6362ea42cf7 => generated 1544 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 18:57:28.622682 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [req-e023d857-7920-4a98-aa6f-ab7cf294b1f7 req-41826cfa-1999-42c1-bd2c-32cb5d574f77 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2d525a31-b0be-44cb-8fb7-335075145f08", "tag": "3737be69-e488-4046-be48-2027dbcedf12"}]} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 18:57:28.646798 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-e023d857-7920-4a98-aa6f-ab7cf294b1f7 req-41826cfa-1999-42c1-bd2c-32cb5d574f77 service nova] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:28.647810 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-e023d857-7920-4a98-aa6f-ab7cf294b1f7 req-41826cfa-1999-42c1-bd2c-32cb5d574f77 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:28.649805 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-e023d857-7920-4a98-aa6f-ab7cf294b1f7 req-41826cfa-1999-42c1-bd2c-32cb5d574f77 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:28.669980 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.compute.server_external_events [req-e023d857-7920-4a98-aa6f-ab7cf294b1f7 req-41826cfa-1999-42c1-bd2c-32cb5d574f77 service nova] Creating event network-changed:3737be69-e488-4046-be48-2027dbcedf12 for instance 2d525a31-b0be-44cb-8fb7-335075145f08 on n-h1-863052-2 Nov 01 18:57:28.684745 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [req-e023d857-7920-4a98-aa6f-ab7cf294b1f7 req-41826cfa-1999-42c1-bd2c-32cb5d574f77 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073712 Nov 01 18:57:28.686088 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 482/906] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Nov 1 18:57:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 18:57:28.921530 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-aaea4af7-9e2d-4ac0-9667-dd255488beea tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:57:28.925145 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-aaea4af7-9e2d-4ac0-9667-dd255488beea tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] [instance: a7f88d19-08ee-47bf-9240-7d49afd775e2] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:57:28.926910 n-d-863052-2 devstack@n-api.service[121402]: DEBUG dbcounter [-] [121402] Writing DB stats nova_cell0:SELECT=8 {{(pid=121402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 18:57:28.927685 n-d-863052-2 devstack@n-api.service[121402]: DEBUG dbcounter [-] [121402] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=121402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 18:57:28.942181 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-aaea4af7-9e2d-4ac0-9667-dd255488beea tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:28.942509 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-aaea4af7-9e2d-4ac0-9667-dd255488beea tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:28.942945 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-aaea4af7-9e2d-4ac0-9667-dd255488beea tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:28.946630 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-aaea4af7-9e2d-4ac0-9667-dd255488beea tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:28.947136 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-aaea4af7-9e2d-4ac0-9667-dd255488beea tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:28.948699 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-aaea4af7-9e2d-4ac0-9667-dd255488beea tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:29.058251 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-b6f949a9-4363-4826-ad95-9c65bf80b1b6 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72117f17294649d6b8bc16c66c7efab2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45d4c047d3c44324a27a27831236ab0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:57:29.077029 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-b6f949a9-4363-4826-ad95-9c65bf80b1b6 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] 10.222.0.13 "GET /compute/v2.1/servers/7218f99b-b011-4f08-931e-340d47069f6e" status: 200 len: 1471 microversion: 2.1 time: 0.806171 Nov 01 18:57:29.082884 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 425/907] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:57:28 2022] GET /compute/v2.1/servers/7218f99b-b011-4f08-931e-340d47069f6e => generated 1471 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:57:29.103760 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-aaea4af7-9e2d-4ac0-9667-dd255488beea tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:57:29.112205 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-aaea4af7-9e2d-4ac0-9667-dd255488beea tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:57:29.129321 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-aaea4af7-9e2d-4ac0-9667-dd255488beea tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:57:29.130841 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-aaea4af7-9e2d-4ac0-9667-dd255488beea tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] 10.222.0.13 "GET /compute/v2.1/servers/a7f88d19-08ee-47bf-9240-7d49afd775e2" status: 200 len: 1343 microversion: 2.25 time: 0.218553 Nov 01 18:57:29.131597 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 483/908] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 18:57:28 2022] GET /compute/v2.1/servers/a7f88d19-08ee-47bf-9240-7d49afd775e2 => generated 1343 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 01 18:57:29.244593 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-3b4e1c3c-6652-4bae-b3fd-2fd0a57132a6 tempest-ServersAdmin275Test-1925739795 tempest-ServersAdmin275Test-1925739795-project-admin] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:57:29.247172 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-3b4e1c3c-6652-4bae-b3fd-2fd0a57132a6 tempest-ServersAdmin275Test-1925739795 tempest-ServersAdmin275Test-1925739795-project-admin] [instance: 87679611-878a-49b2-bf8f-39e784c6d70b] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:57:29.278558 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-3b4e1c3c-6652-4bae-b3fd-2fd0a57132a6 tempest-ServersAdmin275Test-1925739795 tempest-ServersAdmin275Test-1925739795-project-admin] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:29.279875 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-3b4e1c3c-6652-4bae-b3fd-2fd0a57132a6 tempest-ServersAdmin275Test-1925739795 tempest-ServersAdmin275Test-1925739795-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:29.281473 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-3b4e1c3c-6652-4bae-b3fd-2fd0a57132a6 tempest-ServersAdmin275Test-1925739795 tempest-ServersAdmin275Test-1925739795-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:29.282872 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-3b4e1c3c-6652-4bae-b3fd-2fd0a57132a6 tempest-ServersAdmin275Test-1925739795 tempest-ServersAdmin275Test-1925739795-project-admin] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:29.285020 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-3b4e1c3c-6652-4bae-b3fd-2fd0a57132a6 tempest-ServersAdmin275Test-1925739795 tempest-ServersAdmin275Test-1925739795-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:29.285859 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-3b4e1c3c-6652-4bae-b3fd-2fd0a57132a6 tempest-ServersAdmin275Test-1925739795 tempest-ServersAdmin275Test-1925739795-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:29.462962 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.objects.instance [None req-3b4e1c3c-6652-4bae-b3fd-2fd0a57132a6 tempest-ServersAdmin275Test-1925739795 tempest-ServersAdmin275Test-1925739795-project-admin] Lazy-loading 'services' on Instance uuid 87679611-878a-49b2-bf8f-39e784c6d70b {{(pid=121403) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 01 18:57:29.504280 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-3b4e1c3c-6652-4bae-b3fd-2fd0a57132a6 tempest-ServersAdmin275Test-1925739795 tempest-ServersAdmin275Test-1925739795-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/87679611-878a-49b2-bf8f-39e784c6d70b" status: 200 len: 1929 microversion: 2.75 time: 0.269437 Nov 01 18:57:29.505515 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 426/909] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 18:57:29 2022] GET /compute/v2.1/servers/87679611-878a-49b2-bf8f-39e784c6d70b => generated 1929 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 18:57:29.627363 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-d1304a6e-4c94-4131-972d-ba28f3461e20 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:57:29.628576 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-d1304a6e-4c94-4131-972d-ba28f3461e20 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] [instance: ea631032-dd04-429b-988e-e6362ea42cf7] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:57:29.646800 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-d1304a6e-4c94-4131-972d-ba28f3461e20 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:29.656440 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-d1304a6e-4c94-4131-972d-ba28f3461e20 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:29.656921 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-d1304a6e-4c94-4131-972d-ba28f3461e20 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:29.657659 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-d1304a6e-4c94-4131-972d-ba28f3461e20 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:29.658116 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-d1304a6e-4c94-4131-972d-ba28f3461e20 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:29.658539 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-d1304a6e-4c94-4131-972d-ba28f3461e20 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:29.850666 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-d1304a6e-4c94-4131-972d-ba28f3461e20 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c1314c21d8547ff890ede1c2ad281c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c804370880454c7aa02cef2c2c3cf144', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:57:29.865766 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-d1304a6e-4c94-4131-972d-ba28f3461e20 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c1314c21d8547ff890ede1c2ad281c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c804370880454c7aa02cef2c2c3cf144', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:57:29.867753 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-d1304a6e-4c94-4131-972d-ba28f3461e20 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c1314c21d8547ff890ede1c2ad281c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c804370880454c7aa02cef2c2c3cf144', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:57:29.908214 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-d1304a6e-4c94-4131-972d-ba28f3461e20 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] 10.222.0.13 "GET /compute/v2.1/servers/ea631032-dd04-429b-988e-e6362ea42cf7" status: 200 len: 1544 microversion: 2.91 time: 0.275018 Nov 01 18:57:29.910505 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 484/910] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 18:57:29 2022] GET /compute/v2.1/servers/ea631032-dd04-429b-988e-e6362ea42cf7 => generated 1544 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 18:57:30.128121 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-fc162577-b17b-485f-9fa1-2ffde7f2e281 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:57:30.129515 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-fc162577-b17b-485f-9fa1-2ffde7f2e281 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] [instance: 7218f99b-b011-4f08-931e-340d47069f6e] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:57:30.139696 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-fc162577-b17b-485f-9fa1-2ffde7f2e281 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:30.141005 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-fc162577-b17b-485f-9fa1-2ffde7f2e281 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:30.141712 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-fc162577-b17b-485f-9fa1-2ffde7f2e281 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:30.142698 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-fc162577-b17b-485f-9fa1-2ffde7f2e281 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:30.143985 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-fc162577-b17b-485f-9fa1-2ffde7f2e281 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:30.144708 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-fc162577-b17b-485f-9fa1-2ffde7f2e281 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:30.161914 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-a71dd951-eab0-466e-b3dd-7dd843ca4e16 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:57:30.163123 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-a71dd951-eab0-466e-b3dd-7dd843ca4e16 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] [instance: a7f88d19-08ee-47bf-9240-7d49afd775e2] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:57:30.181450 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-a71dd951-eab0-466e-b3dd-7dd843ca4e16 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:30.184720 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-a71dd951-eab0-466e-b3dd-7dd843ca4e16 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:30.186436 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-a71dd951-eab0-466e-b3dd-7dd843ca4e16 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:30.188302 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-a71dd951-eab0-466e-b3dd-7dd843ca4e16 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:30.190195 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-a71dd951-eab0-466e-b3dd-7dd843ca4e16 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:30.190840 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-a71dd951-eab0-466e-b3dd-7dd843ca4e16 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:30.600475 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-a71dd951-eab0-466e-b3dd-7dd843ca4e16 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:57:30.614923 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-a71dd951-eab0-466e-b3dd-7dd843ca4e16 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:57:30.616667 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-a71dd951-eab0-466e-b3dd-7dd843ca4e16 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:57:30.621006 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-a71dd951-eab0-466e-b3dd-7dd843ca4e16 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] 10.222.0.13 "GET /compute/v2.1/servers/a7f88d19-08ee-47bf-9240-7d49afd775e2" status: 200 len: 1410 microversion: 2.25 time: 0.462216 Nov 01 18:57:30.621731 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 485/911] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 18:57:30 2022] GET /compute/v2.1/servers/a7f88d19-08ee-47bf-9240-7d49afd775e2 => generated 1410 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 18:57:30.636418 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-9cc9965b-4c78-4295-b223-75510650dec9 tempest-ServersAdmin275Test-1925739795 tempest-ServersAdmin275Test-1925739795-project-admin] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:57:30.644770 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-9cc9965b-4c78-4295-b223-75510650dec9 tempest-ServersAdmin275Test-1925739795 tempest-ServersAdmin275Test-1925739795-project-admin] [instance: 87679611-878a-49b2-bf8f-39e784c6d70b] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:57:30.651096 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-9cc9965b-4c78-4295-b223-75510650dec9 tempest-ServersAdmin275Test-1925739795 tempest-ServersAdmin275Test-1925739795-project-admin] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:30.651848 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-9cc9965b-4c78-4295-b223-75510650dec9 tempest-ServersAdmin275Test-1925739795 tempest-ServersAdmin275Test-1925739795-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:30.652531 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-9cc9965b-4c78-4295-b223-75510650dec9 tempest-ServersAdmin275Test-1925739795 tempest-ServersAdmin275Test-1925739795-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:30.653483 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-9cc9965b-4c78-4295-b223-75510650dec9 tempest-ServersAdmin275Test-1925739795 tempest-ServersAdmin275Test-1925739795-project-admin] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:30.654151 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-9cc9965b-4c78-4295-b223-75510650dec9 tempest-ServersAdmin275Test-1925739795 tempest-ServersAdmin275Test-1925739795-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:30.654781 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-9cc9965b-4c78-4295-b223-75510650dec9 tempest-ServersAdmin275Test-1925739795 tempest-ServersAdmin275Test-1925739795-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:30.686834 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-fc162577-b17b-485f-9fa1-2ffde7f2e281 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72117f17294649d6b8bc16c66c7efab2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45d4c047d3c44324a27a27831236ab0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:57:30.697099 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-fc162577-b17b-485f-9fa1-2ffde7f2e281 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] 10.222.0.13 "GET /compute/v2.1/servers/7218f99b-b011-4f08-931e-340d47069f6e" status: 200 len: 1476 microversion: 2.1 time: 0.577875 Nov 01 18:57:30.700952 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 427/912] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:57:30 2022] GET /compute/v2.1/servers/7218f99b-b011-4f08-931e-340d47069f6e => generated 1476 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:57:30.788442 n-d-863052-2 devstack@n-api.service[121402]: DEBUG dbcounter [-] [121402] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 18:57:30.792691 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.objects.instance [None req-9cc9965b-4c78-4295-b223-75510650dec9 tempest-ServersAdmin275Test-1925739795 tempest-ServersAdmin275Test-1925739795-project-admin] Lazy-loading 'services' on Instance uuid 87679611-878a-49b2-bf8f-39e784c6d70b {{(pid=121402) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 01 18:57:30.826827 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-9cc9965b-4c78-4295-b223-75510650dec9 tempest-ServersAdmin275Test-1925739795 tempest-ServersAdmin275Test-1925739795-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/87679611-878a-49b2-bf8f-39e784c6d70b" status: 200 len: 1929 microversion: 2.75 time: 0.203138 Nov 01 18:57:30.827729 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 486/913] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 18:57:30 2022] GET /compute/v2.1/servers/87679611-878a-49b2-bf8f-39e784c6d70b => generated 1929 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 18:57:30.946928 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-7cf82666-eba4-423d-86ad-ca50c60e08bd tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:57:30.950245 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-7cf82666-eba4-423d-86ad-ca50c60e08bd tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] [instance: ea631032-dd04-429b-988e-e6362ea42cf7] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:57:30.966771 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-7cf82666-eba4-423d-86ad-ca50c60e08bd tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:30.967269 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-7cf82666-eba4-423d-86ad-ca50c60e08bd tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:30.967712 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-7cf82666-eba4-423d-86ad-ca50c60e08bd tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:30.968418 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-7cf82666-eba4-423d-86ad-ca50c60e08bd tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:30.973889 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-7cf82666-eba4-423d-86ad-ca50c60e08bd tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:30.975932 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-7cf82666-eba4-423d-86ad-ca50c60e08bd tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:31.133322 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-7cf82666-eba4-423d-86ad-ca50c60e08bd tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c1314c21d8547ff890ede1c2ad281c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c804370880454c7aa02cef2c2c3cf144', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:57:31.151204 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-7cf82666-eba4-423d-86ad-ca50c60e08bd tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c1314c21d8547ff890ede1c2ad281c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c804370880454c7aa02cef2c2c3cf144', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:57:31.156807 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-7cf82666-eba4-423d-86ad-ca50c60e08bd tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c1314c21d8547ff890ede1c2ad281c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c804370880454c7aa02cef2c2c3cf144', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:57:31.171880 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-7cf82666-eba4-423d-86ad-ca50c60e08bd tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] 10.222.0.13 "GET /compute/v2.1/servers/ea631032-dd04-429b-988e-e6362ea42cf7" status: 200 len: 1531 microversion: 2.91 time: 0.232586 Nov 01 18:57:31.189854 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 428/914] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 18:57:30 2022] GET /compute/v2.1/servers/ea631032-dd04-429b-988e-e6362ea42cf7 => generated 1531 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 18:57:31.210019 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-fab253fd-6d30-4728-999a-0da8391f8ab9 tempest-UnshelveToHostMultiNodesTest-2124505700 tempest-UnshelveToHostMultiNodesTest-2124505700-project-admin] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:57:31.210625 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-fab253fd-6d30-4728-999a-0da8391f8ab9 tempest-UnshelveToHostMultiNodesTest-2124505700 tempest-UnshelveToHostMultiNodesTest-2124505700-project-admin] [instance: ea631032-dd04-429b-988e-e6362ea42cf7] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:57:31.217014 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-fab253fd-6d30-4728-999a-0da8391f8ab9 tempest-UnshelveToHostMultiNodesTest-2124505700 tempest-UnshelveToHostMultiNodesTest-2124505700-project-admin] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:31.217509 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-fab253fd-6d30-4728-999a-0da8391f8ab9 tempest-UnshelveToHostMultiNodesTest-2124505700 tempest-UnshelveToHostMultiNodesTest-2124505700-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:31.217942 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-fab253fd-6d30-4728-999a-0da8391f8ab9 tempest-UnshelveToHostMultiNodesTest-2124505700 tempest-UnshelveToHostMultiNodesTest-2124505700-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:31.218614 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-fab253fd-6d30-4728-999a-0da8391f8ab9 tempest-UnshelveToHostMultiNodesTest-2124505700 tempest-UnshelveToHostMultiNodesTest-2124505700-project-admin] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:31.227215 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-fab253fd-6d30-4728-999a-0da8391f8ab9 tempest-UnshelveToHostMultiNodesTest-2124505700 tempest-UnshelveToHostMultiNodesTest-2124505700-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:31.227925 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-fab253fd-6d30-4728-999a-0da8391f8ab9 tempest-UnshelveToHostMultiNodesTest-2124505700 tempest-UnshelveToHostMultiNodesTest-2124505700-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:31.652800 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-fb577d0b-3c40-49b2-9f09-d8110d96abcf tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:57:31.653941 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-fb577d0b-3c40-49b2-9f09-d8110d96abcf tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] [instance: a7f88d19-08ee-47bf-9240-7d49afd775e2] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:57:31.665515 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-fb577d0b-3c40-49b2-9f09-d8110d96abcf tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:31.666303 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-fb577d0b-3c40-49b2-9f09-d8110d96abcf tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:31.667087 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-fb577d0b-3c40-49b2-9f09-d8110d96abcf tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:31.668068 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-fb577d0b-3c40-49b2-9f09-d8110d96abcf tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:31.669307 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-fb577d0b-3c40-49b2-9f09-d8110d96abcf tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:31.670010 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-fb577d0b-3c40-49b2-9f09-d8110d96abcf tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:31.677936 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.objects.instance [None req-fab253fd-6d30-4728-999a-0da8391f8ab9 tempest-UnshelveToHostMultiNodesTest-2124505700 tempest-UnshelveToHostMultiNodesTest-2124505700-project-admin] Lazy-loading 'services' on Instance uuid ea631032-dd04-429b-988e-e6362ea42cf7 {{(pid=121402) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 01 18:57:31.700106 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-fab253fd-6d30-4728-999a-0da8391f8ab9 tempest-UnshelveToHostMultiNodesTest-2124505700 tempest-UnshelveToHostMultiNodesTest-2124505700-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/ea631032-dd04-429b-988e-e6362ea42cf7" status: 200 len: 1936 microversion: 2.91 time: 0.493809 Nov 01 18:57:31.701050 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 487/915] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 18:57:31 2022] GET /compute/v2.1/servers/ea631032-dd04-429b-988e-e6362ea42cf7 => generated 1936 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 18:57:31.725571 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-33bfda7b-237e-4e42-b4ab-f378f2697737 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:57:31.726407 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-33bfda7b-237e-4e42-b4ab-f378f2697737 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] [instance: 7218f99b-b011-4f08-931e-340d47069f6e] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:57:31.740450 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-33bfda7b-237e-4e42-b4ab-f378f2697737 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:31.745172 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-33bfda7b-237e-4e42-b4ab-f378f2697737 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:31.746629 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-33bfda7b-237e-4e42-b4ab-f378f2697737 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:31.749124 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-33bfda7b-237e-4e42-b4ab-f378f2697737 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:31.751058 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-33bfda7b-237e-4e42-b4ab-f378f2697737 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:31.752211 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-33bfda7b-237e-4e42-b4ab-f378f2697737 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:32.054460 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-fb577d0b-3c40-49b2-9f09-d8110d96abcf tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:57:32.063210 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-fb577d0b-3c40-49b2-9f09-d8110d96abcf tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:57:32.080065 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-fb577d0b-3c40-49b2-9f09-d8110d96abcf tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:57:32.081915 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-fb577d0b-3c40-49b2-9f09-d8110d96abcf tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] 10.222.0.13 "GET /compute/v2.1/servers/a7f88d19-08ee-47bf-9240-7d49afd775e2" status: 200 len: 1410 microversion: 2.25 time: 0.434253 Nov 01 18:57:32.102934 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 429/916] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 18:57:31 2022] GET /compute/v2.1/servers/a7f88d19-08ee-47bf-9240-7d49afd775e2 => generated 1410 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 01 18:57:32.115680 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-2ef648b2-7355-4508-acec-4a15ae794e70 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 18:57:32.118585 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-2ef648b2-7355-4508-acec-4a15ae794e70 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] [instance: ea631032-dd04-429b-988e-e6362ea42cf7] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:57:32.132529 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-2ef648b2-7355-4508-acec-4a15ae794e70 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:32.133054 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-2ef648b2-7355-4508-acec-4a15ae794e70 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:32.133491 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-2ef648b2-7355-4508-acec-4a15ae794e70 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:32.136479 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-33bfda7b-237e-4e42-b4ab-f378f2697737 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72117f17294649d6b8bc16c66c7efab2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45d4c047d3c44324a27a27831236ab0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:57:32.139229 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-2ef648b2-7355-4508-acec-4a15ae794e70 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:32.139878 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-2ef648b2-7355-4508-acec-4a15ae794e70 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:32.140461 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-2ef648b2-7355-4508-acec-4a15ae794e70 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:32.146961 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-33bfda7b-237e-4e42-b4ab-f378f2697737 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] 10.222.0.13 "GET /compute/v2.1/servers/7218f99b-b011-4f08-931e-340d47069f6e" status: 200 len: 1476 microversion: 2.1 time: 0.427208 Nov 01 18:57:32.158760 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 488/917] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:57:31 2022] GET /compute/v2.1/servers/7218f99b-b011-4f08-931e-340d47069f6e => generated 1476 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 18:57:32.164107 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-29714af7-ca55-4dc2-bbc3-be04052504e9 tempest-ServersAdmin275Test-1925739795 tempest-ServersAdmin275Test-1925739795-project-admin] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:57:32.164748 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-29714af7-ca55-4dc2-bbc3-be04052504e9 tempest-ServersAdmin275Test-1925739795 tempest-ServersAdmin275Test-1925739795-project-admin] [instance: 87679611-878a-49b2-bf8f-39e784c6d70b] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:57:32.179666 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.objects.instance [None req-2ef648b2-7355-4508-acec-4a15ae794e70 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lazy-loading 'flavor' on Instance uuid ea631032-dd04-429b-988e-e6362ea42cf7 {{(pid=121403) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 01 18:57:32.192542 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-29714af7-ca55-4dc2-bbc3-be04052504e9 tempest-ServersAdmin275Test-1925739795 tempest-ServersAdmin275Test-1925739795-project-admin] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:32.193060 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-29714af7-ca55-4dc2-bbc3-be04052504e9 tempest-ServersAdmin275Test-1925739795 tempest-ServersAdmin275Test-1925739795-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:32.193485 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-29714af7-ca55-4dc2-bbc3-be04052504e9 tempest-ServersAdmin275Test-1925739795 tempest-ServersAdmin275Test-1925739795-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:32.194383 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-29714af7-ca55-4dc2-bbc3-be04052504e9 tempest-ServersAdmin275Test-1925739795 tempest-ServersAdmin275Test-1925739795-project-admin] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:32.194979 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-29714af7-ca55-4dc2-bbc3-be04052504e9 tempest-ServersAdmin275Test-1925739795 tempest-ServersAdmin275Test-1925739795-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:32.195552 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-29714af7-ca55-4dc2-bbc3-be04052504e9 tempest-ServersAdmin275Test-1925739795 tempest-ServersAdmin275Test-1925739795-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:32.334076 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.objects.instance [None req-29714af7-ca55-4dc2-bbc3-be04052504e9 tempest-ServersAdmin275Test-1925739795 tempest-ServersAdmin275Test-1925739795-project-admin] Lazy-loading 'services' on Instance uuid 87679611-878a-49b2-bf8f-39e784c6d70b {{(pid=121402) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 01 18:57:32.370318 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-29714af7-ca55-4dc2-bbc3-be04052504e9 tempest-ServersAdmin275Test-1925739795 tempest-ServersAdmin275Test-1925739795-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/87679611-878a-49b2-bf8f-39e784c6d70b" status: 200 len: 1929 microversion: 2.75 time: 0.209435 Nov 01 18:57:32.370979 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 489/918] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 18:57:32 2022] GET /compute/v2.1/servers/87679611-878a-49b2-bf8f-39e784c6d70b => generated 1929 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 18:57:32.466854 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [req-ad585a36-5aa3-485e-9011-69c964e347c8 req-7966c8b2-f987-4f35-b395-20c704020fc2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a7f88d19-08ee-47bf-9240-7d49afd775e2", "tag": "01aee5f9-544a-4c0f-b9a3-2410eedf25a5"}]} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 18:57:32.489126 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-ad585a36-5aa3-485e-9011-69c964e347c8 req-7966c8b2-f987-4f35-b395-20c704020fc2 service nova] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:32.489599 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-ad585a36-5aa3-485e-9011-69c964e347c8 req-7966c8b2-f987-4f35-b395-20c704020fc2 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:32.490029 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-ad585a36-5aa3-485e-9011-69c964e347c8 req-7966c8b2-f987-4f35-b395-20c704020fc2 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:32.501671 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.compute.server_external_events [req-ad585a36-5aa3-485e-9011-69c964e347c8 req-7966c8b2-f987-4f35-b395-20c704020fc2 service nova] Creating event network-changed:01aee5f9-544a-4c0f-b9a3-2410eedf25a5 for instance a7f88d19-08ee-47bf-9240-7d49afd775e2 on n-h1-863052-2 Nov 01 18:57:32.505957 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-2ef648b2-7355-4508-acec-4a15ae794e70 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] 10.222.0.13 "POST /compute/v2.1/servers/ea631032-dd04-429b-988e-e6362ea42cf7/action" status: 202 len: 0 microversion: 2.91 time: 0.401679 Nov 01 18:57:32.506850 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [req-ad585a36-5aa3-485e-9011-69c964e347c8 req-7966c8b2-f987-4f35-b395-20c704020fc2 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043602 Nov 01 18:57:32.507061 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 430/919] 10.222.0.13 () {62 vars in 1319 bytes} [Tue Nov 1 18:57:32 2022] POST /compute/v2.1/servers/ea631032-dd04-429b-988e-e6362ea42cf7/action => generated 0 bytes in 403 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 01 18:57:32.507575 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 490/920] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Nov 1 18:57:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 01 18:57:32.516291 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-a356b3f8-bfad-4bc1-b487-54c3c71424db tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:57:32.517191 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-a356b3f8-bfad-4bc1-b487-54c3c71424db tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] [instance: ea631032-dd04-429b-988e-e6362ea42cf7] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:57:32.523960 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-a356b3f8-bfad-4bc1-b487-54c3c71424db tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:32.524713 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-a356b3f8-bfad-4bc1-b487-54c3c71424db tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:32.525810 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-a356b3f8-bfad-4bc1-b487-54c3c71424db tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:32.526755 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-a356b3f8-bfad-4bc1-b487-54c3c71424db tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:32.527413 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-a356b3f8-bfad-4bc1-b487-54c3c71424db tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:32.528060 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-a356b3f8-bfad-4bc1-b487-54c3c71424db tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:32.630305 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-a356b3f8-bfad-4bc1-b487-54c3c71424db tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c1314c21d8547ff890ede1c2ad281c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c804370880454c7aa02cef2c2c3cf144', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:57:32.647229 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-a356b3f8-bfad-4bc1-b487-54c3c71424db tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c1314c21d8547ff890ede1c2ad281c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c804370880454c7aa02cef2c2c3cf144', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:57:32.649253 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-a356b3f8-bfad-4bc1-b487-54c3c71424db tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c1314c21d8547ff890ede1c2ad281c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c804370880454c7aa02cef2c2c3cf144', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:57:32.655145 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-a356b3f8-bfad-4bc1-b487-54c3c71424db tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] 10.222.0.13 "GET /compute/v2.1/servers/ea631032-dd04-429b-988e-e6362ea42cf7" status: 200 len: 1537 microversion: 2.91 time: 0.143735 Nov 01 18:57:32.656216 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 431/921] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 18:57:32 2022] GET /compute/v2.1/servers/ea631032-dd04-429b-988e-e6362ea42cf7 => generated 1537 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 01 18:57:32.757639 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-8ed952f5-58e4-4e99-8e8c-b608ffbb0b37 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-1958781074", "imageRef": "2d4a0047-1b9e-445f-8af8-1b5c9d93e881", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 18:57:32.817390 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.network.neutron [None req-8ed952f5-58e4-4e99-8e8c-b608ffbb0b37 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] validate_networks() for [('b865614d-f372-4a97-a96c-04f1f6457952', None, None, None, None, None)] {{(pid=121402) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 01 18:57:33.118259 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-113e2260-c77a-47f9-83cc-38fcb6490b37 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:57:33.119472 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-113e2260-c77a-47f9-83cc-38fcb6490b37 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] [instance: a7f88d19-08ee-47bf-9240-7d49afd775e2] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:57:33.128023 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-113e2260-c77a-47f9-83cc-38fcb6490b37 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:33.128971 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-113e2260-c77a-47f9-83cc-38fcb6490b37 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:33.129708 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-113e2260-c77a-47f9-83cc-38fcb6490b37 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:33.130721 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-113e2260-c77a-47f9-83cc-38fcb6490b37 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:33.131377 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-113e2260-c77a-47f9-83cc-38fcb6490b37 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:33.131897 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-113e2260-c77a-47f9-83cc-38fcb6490b37 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:33.290789 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-113e2260-c77a-47f9-83cc-38fcb6490b37 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:57:33.304143 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-113e2260-c77a-47f9-83cc-38fcb6490b37 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:57:33.304832 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-113e2260-c77a-47f9-83cc-38fcb6490b37 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:57:33.307352 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-113e2260-c77a-47f9-83cc-38fcb6490b37 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] 10.222.0.13 "GET /compute/v2.1/servers/a7f88d19-08ee-47bf-9240-7d49afd775e2" status: 200 len: 1410 microversion: 2.25 time: 0.193452 Nov 01 18:57:33.308372 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 432/922] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 18:57:33 2022] GET /compute/v2.1/servers/a7f88d19-08ee-47bf-9240-7d49afd775e2 => generated 1410 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 01 18:57:33.314858 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-153b60c4-8e41-4ed3-a946-7533f00470ea tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:57:33.315509 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-153b60c4-8e41-4ed3-a946-7533f00470ea tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] [instance: 7218f99b-b011-4f08-931e-340d47069f6e] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:57:33.321996 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-153b60c4-8e41-4ed3-a946-7533f00470ea tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:33.322612 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-153b60c4-8e41-4ed3-a946-7533f00470ea tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:33.323461 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-153b60c4-8e41-4ed3-a946-7533f00470ea tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:33.324283 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-153b60c4-8e41-4ed3-a946-7533f00470ea tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:33.325186 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-153b60c4-8e41-4ed3-a946-7533f00470ea tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:33.325728 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-153b60c4-8e41-4ed3-a946-7533f00470ea tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:33.478462 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-153b60c4-8e41-4ed3-a946-7533f00470ea tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72117f17294649d6b8bc16c66c7efab2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45d4c047d3c44324a27a27831236ab0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:57:33.488675 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-153b60c4-8e41-4ed3-a946-7533f00470ea tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] 10.222.0.13 "GET /compute/v2.1/servers/7218f99b-b011-4f08-931e-340d47069f6e" status: 200 len: 1476 microversion: 2.1 time: 0.179185 Nov 01 18:57:33.489573 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 433/923] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:57:33 2022] GET /compute/v2.1/servers/7218f99b-b011-4f08-931e-340d47069f6e => generated 1476 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:57:33.509711 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-21815615-ba66-4db7-9c6e-d0a5df24b442 tempest-ServersAdmin275Test-1925739795 tempest-ServersAdmin275Test-1925739795-project-admin] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:57:33.510608 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-21815615-ba66-4db7-9c6e-d0a5df24b442 tempest-ServersAdmin275Test-1925739795 tempest-ServersAdmin275Test-1925739795-project-admin] [instance: 87679611-878a-49b2-bf8f-39e784c6d70b] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:57:33.516805 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-21815615-ba66-4db7-9c6e-d0a5df24b442 tempest-ServersAdmin275Test-1925739795 tempest-ServersAdmin275Test-1925739795-project-admin] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:33.517539 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-21815615-ba66-4db7-9c6e-d0a5df24b442 tempest-ServersAdmin275Test-1925739795 tempest-ServersAdmin275Test-1925739795-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:33.518164 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-21815615-ba66-4db7-9c6e-d0a5df24b442 tempest-ServersAdmin275Test-1925739795 tempest-ServersAdmin275Test-1925739795-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:33.519609 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-21815615-ba66-4db7-9c6e-d0a5df24b442 tempest-ServersAdmin275Test-1925739795 tempest-ServersAdmin275Test-1925739795-project-admin] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:33.520271 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-21815615-ba66-4db7-9c6e-d0a5df24b442 tempest-ServersAdmin275Test-1925739795 tempest-ServersAdmin275Test-1925739795-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:33.520974 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-21815615-ba66-4db7-9c6e-d0a5df24b442 tempest-ServersAdmin275Test-1925739795 tempest-ServersAdmin275Test-1925739795-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:33.602404 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.objects.instance [None req-21815615-ba66-4db7-9c6e-d0a5df24b442 tempest-ServersAdmin275Test-1925739795 tempest-ServersAdmin275Test-1925739795-project-admin] Lazy-loading 'services' on Instance uuid 87679611-878a-49b2-bf8f-39e784c6d70b {{(pid=121403) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 01 18:57:33.619541 n-d-863052-2 devstack@n-api.service[121403]: DEBUG dbcounter [-] [121403] Writing DB stats nova_api:SELECT=99,nova_api:INSERT=1 {{(pid=121403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 18:57:33.622868 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-21815615-ba66-4db7-9c6e-d0a5df24b442 tempest-ServersAdmin275Test-1925739795 tempest-ServersAdmin275Test-1925739795-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/87679611-878a-49b2-bf8f-39e784c6d70b" status: 200 len: 1929 microversion: 2.75 time: 0.116839 Nov 01 18:57:33.637080 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 434/924] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 18:57:33 2022] GET /compute/v2.1/servers/87679611-878a-49b2-bf8f-39e784c6d70b => generated 1929 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 18:57:33.686594 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-60f72bea-24f7-435a-aff6-5405e2468599 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:57:33.687936 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-60f72bea-24f7-435a-aff6-5405e2468599 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] [instance: ea631032-dd04-429b-988e-e6362ea42cf7] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:57:33.696961 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-60f72bea-24f7-435a-aff6-5405e2468599 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:33.697370 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-60f72bea-24f7-435a-aff6-5405e2468599 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:33.697810 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-60f72bea-24f7-435a-aff6-5405e2468599 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:33.698673 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-60f72bea-24f7-435a-aff6-5405e2468599 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:33.699126 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-60f72bea-24f7-435a-aff6-5405e2468599 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:33.699553 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-60f72bea-24f7-435a-aff6-5405e2468599 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:33.797573 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-60f72bea-24f7-435a-aff6-5405e2468599 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c1314c21d8547ff890ede1c2ad281c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c804370880454c7aa02cef2c2c3cf144', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:57:33.808817 n-d-863052-2 devstack@n-api.service[121403]: DEBUG dbcounter [-] [121403] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 18:57:33.813901 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-60f72bea-24f7-435a-aff6-5405e2468599 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c1314c21d8547ff890ede1c2ad281c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c804370880454c7aa02cef2c2c3cf144', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:57:33.818611 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-60f72bea-24f7-435a-aff6-5405e2468599 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c1314c21d8547ff890ede1c2ad281c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c804370880454c7aa02cef2c2c3cf144', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:57:33.828524 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-60f72bea-24f7-435a-aff6-5405e2468599 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] 10.222.0.13 "GET /compute/v2.1/servers/ea631032-dd04-429b-988e-e6362ea42cf7" status: 200 len: 1537 microversion: 2.91 time: 0.148228 Nov 01 18:57:33.829420 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 435/925] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 18:57:33 2022] GET /compute/v2.1/servers/ea631032-dd04-429b-988e-e6362ea42cf7 => generated 1537 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 01 18:57:33.896934 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.virt.hardware [None req-8ed952f5-58e4-4e99-8e8c-b608ffbb0b37 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Flavor limits 0:0:0 {{(pid=121402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 01 18:57:33.897495 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.virt.hardware [None req-8ed952f5-58e4-4e99-8e8c-b608ffbb0b37 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Image limits 0:0:0 {{(pid=121402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 01 18:57:33.897816 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.virt.hardware [None req-8ed952f5-58e4-4e99-8e8c-b608ffbb0b37 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Flavor pref 0:0:0 {{(pid=121402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 01 18:57:33.898221 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.virt.hardware [None req-8ed952f5-58e4-4e99-8e8c-b608ffbb0b37 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Image pref 0:0:0 {{(pid=121402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 01 18:57:33.898638 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.virt.hardware [None req-8ed952f5-58e4-4e99-8e8c-b608ffbb0b37 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 01 18:57:33.908971 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-8ed952f5-58e4-4e99-8e8c-b608ffbb0b37 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:33.910120 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-8ed952f5-58e4-4e99-8e8c-b608ffbb0b37 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:33.910679 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-8ed952f5-58e4-4e99-8e8c-b608ffbb0b37 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:33.911504 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-8ed952f5-58e4-4e99-8e8c-b608ffbb0b37 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:33.912294 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-8ed952f5-58e4-4e99-8e8c-b608ffbb0b37 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:33.912911 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-8ed952f5-58e4-4e99-8e8c-b608ffbb0b37 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:33.935379 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.quota [None req-8ed952f5-58e4-4e99-8e8c-b608ffbb0b37 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Getting quotas for project 708bc0ea4b5a4baf81933725792bedd5. Resources: {'cores', 'ram', 'instances'} {{(pid=121402) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 01 18:57:33.944064 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.quota [None req-8ed952f5-58e4-4e99-8e8c-b608ffbb0b37 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Getting quotas for user 09b52b7dcbb044f9bfc424e4417c77fa and project 708bc0ea4b5a4baf81933725792bedd5. Resources: {'cores', 'ram', 'instances'} {{(pid=121402) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 01 18:57:33.958174 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-8ed952f5-58e4-4e99-8e8c-b608ffbb0b37 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Going to run 1 instances... {{(pid=121402) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 01 18:57:33.960596 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-8ed952f5-58e4-4e99-8e8c-b608ffbb0b37 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] [instance: e43fa43a-f523-4438-a8ba-a4460ea4a210] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2d4a0047-1b9e-445f-8af8-1b5c9d93e881',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121402) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 01 18:57:34.025865 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-8ed952f5-58e4-4e99-8e8c-b608ffbb0b37 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.274229 Nov 01 18:57:34.032400 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 491/926] 10.222.0.13 () {60 vars in 1147 bytes} [Tue Nov 1 18:57:32 2022] POST /compute/v2.1/servers => generated 383 bytes in 1282 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 01 18:57:34.039414 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-0997dd0c-f87b-4f33-90a1-8724291dd465 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:57:34.040005 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-0997dd0c-f87b-4f33-90a1-8724291dd465 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] [instance: e43fa43a-f523-4438-a8ba-a4460ea4a210] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:57:34.145109 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-0997dd0c-f87b-4f33-90a1-8724291dd465 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b52b7dcbb044f9bfc424e4417c77fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '708bc0ea4b5a4baf81933725792bedd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:57:34.153670 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-0997dd0c-f87b-4f33-90a1-8724291dd465 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] 10.222.0.13 "GET /compute/v2.1/servers/e43fa43a-f523-4438-a8ba-a4460ea4a210" status: 200 len: 1225 microversion: 2.1 time: 0.118282 Nov 01 18:57:34.154261 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 436/927] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:57:34 2022] GET /compute/v2.1/servers/e43fa43a-f523-4438-a8ba-a4460ea4a210 => generated 1225 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:57:34.338690 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-0eb38ed0-19a8-4177-93ba-ccd83f0fcfe2 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:57:34.339942 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-0eb38ed0-19a8-4177-93ba-ccd83f0fcfe2 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] [instance: a7f88d19-08ee-47bf-9240-7d49afd775e2] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:57:34.354988 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-0eb38ed0-19a8-4177-93ba-ccd83f0fcfe2 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:34.356100 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-0eb38ed0-19a8-4177-93ba-ccd83f0fcfe2 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:34.356902 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-0eb38ed0-19a8-4177-93ba-ccd83f0fcfe2 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:34.357679 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-0eb38ed0-19a8-4177-93ba-ccd83f0fcfe2 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:34.360045 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-0eb38ed0-19a8-4177-93ba-ccd83f0fcfe2 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:34.361087 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-0eb38ed0-19a8-4177-93ba-ccd83f0fcfe2 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:34.511230 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-3957b1c2-93b6-4a1c-ade8-88c485070d5c tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:57:34.511844 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-3957b1c2-93b6-4a1c-ade8-88c485070d5c tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] [instance: 7218f99b-b011-4f08-931e-340d47069f6e] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:57:34.526429 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-3957b1c2-93b6-4a1c-ade8-88c485070d5c tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:34.528138 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-3957b1c2-93b6-4a1c-ade8-88c485070d5c tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:34.528815 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-3957b1c2-93b6-4a1c-ade8-88c485070d5c tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:34.530049 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-3957b1c2-93b6-4a1c-ade8-88c485070d5c tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:34.532967 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-3957b1c2-93b6-4a1c-ade8-88c485070d5c tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:34.534508 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-3957b1c2-93b6-4a1c-ade8-88c485070d5c tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:34.799314 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-3957b1c2-93b6-4a1c-ade8-88c485070d5c tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72117f17294649d6b8bc16c66c7efab2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45d4c047d3c44324a27a27831236ab0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:57:34.809471 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-3957b1c2-93b6-4a1c-ade8-88c485070d5c tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] 10.222.0.13 "GET /compute/v2.1/servers/7218f99b-b011-4f08-931e-340d47069f6e" status: 200 len: 1476 microversion: 2.1 time: 0.301626 Nov 01 18:57:34.810816 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 437/928] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:57:34 2022] GET /compute/v2.1/servers/7218f99b-b011-4f08-931e-340d47069f6e => generated 1476 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:57:34.817980 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-d6c94a5d-fb33-4230-b1da-87f606213a06 tempest-ServersAdmin275Test-1925739795 tempest-ServersAdmin275Test-1925739795-project-admin] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:57:34.819015 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-d6c94a5d-fb33-4230-b1da-87f606213a06 tempest-ServersAdmin275Test-1925739795 tempest-ServersAdmin275Test-1925739795-project-admin] [instance: 87679611-878a-49b2-bf8f-39e784c6d70b] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:57:34.825738 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d6c94a5d-fb33-4230-b1da-87f606213a06 tempest-ServersAdmin275Test-1925739795 tempest-ServersAdmin275Test-1925739795-project-admin] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:34.826514 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d6c94a5d-fb33-4230-b1da-87f606213a06 tempest-ServersAdmin275Test-1925739795 tempest-ServersAdmin275Test-1925739795-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:34.827306 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d6c94a5d-fb33-4230-b1da-87f606213a06 tempest-ServersAdmin275Test-1925739795 tempest-ServersAdmin275Test-1925739795-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:34.828320 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d6c94a5d-fb33-4230-b1da-87f606213a06 tempest-ServersAdmin275Test-1925739795 tempest-ServersAdmin275Test-1925739795-project-admin] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:34.829010 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d6c94a5d-fb33-4230-b1da-87f606213a06 tempest-ServersAdmin275Test-1925739795 tempest-ServersAdmin275Test-1925739795-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:34.829618 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d6c94a5d-fb33-4230-b1da-87f606213a06 tempest-ServersAdmin275Test-1925739795 tempest-ServersAdmin275Test-1925739795-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:34.890952 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-0eb38ed0-19a8-4177-93ba-ccd83f0fcfe2 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:57:34.907315 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-0eb38ed0-19a8-4177-93ba-ccd83f0fcfe2 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:57:34.910131 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-0eb38ed0-19a8-4177-93ba-ccd83f0fcfe2 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:57:34.911490 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-0eb38ed0-19a8-4177-93ba-ccd83f0fcfe2 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] 10.222.0.13 "GET /compute/v2.1/servers/a7f88d19-08ee-47bf-9240-7d49afd775e2" status: 200 len: 1410 microversion: 2.25 time: 0.578943 Nov 01 18:57:34.914258 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 492/929] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 18:57:34 2022] GET /compute/v2.1/servers/a7f88d19-08ee-47bf-9240-7d49afd775e2 => generated 1410 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 18:57:34.926794 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-c600e00b-e5b7-4f32-b3df-1e20e0cb41e5 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:57:34.927744 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-c600e00b-e5b7-4f32-b3df-1e20e0cb41e5 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] [instance: ea631032-dd04-429b-988e-e6362ea42cf7] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:57:34.945339 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-c600e00b-e5b7-4f32-b3df-1e20e0cb41e5 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:34.945545 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.objects.instance [None req-d6c94a5d-fb33-4230-b1da-87f606213a06 tempest-ServersAdmin275Test-1925739795 tempest-ServersAdmin275Test-1925739795-project-admin] Lazy-loading 'services' on Instance uuid 87679611-878a-49b2-bf8f-39e784c6d70b {{(pid=121403) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 01 18:57:34.945930 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-c600e00b-e5b7-4f32-b3df-1e20e0cb41e5 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:34.946585 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-c600e00b-e5b7-4f32-b3df-1e20e0cb41e5 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:34.947352 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-c600e00b-e5b7-4f32-b3df-1e20e0cb41e5 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:34.948024 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-c600e00b-e5b7-4f32-b3df-1e20e0cb41e5 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:34.948509 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-c600e00b-e5b7-4f32-b3df-1e20e0cb41e5 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:34.979435 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-d6c94a5d-fb33-4230-b1da-87f606213a06 tempest-ServersAdmin275Test-1925739795 tempest-ServersAdmin275Test-1925739795-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/87679611-878a-49b2-bf8f-39e784c6d70b" status: 200 len: 1929 microversion: 2.75 time: 0.165252 Nov 01 18:57:34.980039 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 438/930] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 18:57:34 2022] GET /compute/v2.1/servers/87679611-878a-49b2-bf8f-39e784c6d70b => generated 1929 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 18:57:35.177068 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-5314545d-c525-42bd-868d-6a3438fa0d58 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:57:35.178507 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-5314545d-c525-42bd-868d-6a3438fa0d58 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] [instance: e43fa43a-f523-4438-a8ba-a4460ea4a210] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:57:35.188094 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-5314545d-c525-42bd-868d-6a3438fa0d58 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:35.188811 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-5314545d-c525-42bd-868d-6a3438fa0d58 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:35.189672 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-5314545d-c525-42bd-868d-6a3438fa0d58 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:35.191293 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-5314545d-c525-42bd-868d-6a3438fa0d58 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:35.191866 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-5314545d-c525-42bd-868d-6a3438fa0d58 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:35.192251 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-5314545d-c525-42bd-868d-6a3438fa0d58 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:35.271226 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-5314545d-c525-42bd-868d-6a3438fa0d58 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b52b7dcbb044f9bfc424e4417c77fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '708bc0ea4b5a4baf81933725792bedd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:57:35.280429 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-5314545d-c525-42bd-868d-6a3438fa0d58 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] 10.222.0.13 "GET /compute/v2.1/servers/e43fa43a-f523-4438-a8ba-a4460ea4a210" status: 200 len: 1277 microversion: 2.1 time: 0.107896 Nov 01 18:57:35.281383 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 439/931] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:57:35 2022] GET /compute/v2.1/servers/e43fa43a-f523-4438-a8ba-a4460ea4a210 => generated 1277 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:57:35.358592 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-c600e00b-e5b7-4f32-b3df-1e20e0cb41e5 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c1314c21d8547ff890ede1c2ad281c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c804370880454c7aa02cef2c2c3cf144', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:57:35.372324 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-c600e00b-e5b7-4f32-b3df-1e20e0cb41e5 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c1314c21d8547ff890ede1c2ad281c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c804370880454c7aa02cef2c2c3cf144', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:57:35.373941 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-c600e00b-e5b7-4f32-b3df-1e20e0cb41e5 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c1314c21d8547ff890ede1c2ad281c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c804370880454c7aa02cef2c2c3cf144', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:57:35.384381 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-c600e00b-e5b7-4f32-b3df-1e20e0cb41e5 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] 10.222.0.13 "GET /compute/v2.1/servers/ea631032-dd04-429b-988e-e6362ea42cf7" status: 200 len: 1537 microversion: 2.91 time: 0.468676 Nov 01 18:57:35.385299 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 493/932] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 18:57:34 2022] GET /compute/v2.1/servers/ea631032-dd04-429b-988e-e6362ea42cf7 => generated 1537 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 18:57:35.839027 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-458f7271-6adb-4f68-bdf4-5fd71b1295f5 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:57:35.840912 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-458f7271-6adb-4f68-bdf4-5fd71b1295f5 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] [instance: 7218f99b-b011-4f08-931e-340d47069f6e] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:57:35.857868 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-458f7271-6adb-4f68-bdf4-5fd71b1295f5 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:35.859349 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-458f7271-6adb-4f68-bdf4-5fd71b1295f5 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:35.860781 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-458f7271-6adb-4f68-bdf4-5fd71b1295f5 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:35.865382 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-458f7271-6adb-4f68-bdf4-5fd71b1295f5 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:35.865989 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-458f7271-6adb-4f68-bdf4-5fd71b1295f5 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:35.866639 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-458f7271-6adb-4f68-bdf4-5fd71b1295f5 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:35.941885 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-02c5a5c8-25c2-4fdc-a078-93c5bcf42023 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:57:35.942495 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-02c5a5c8-25c2-4fdc-a078-93c5bcf42023 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] [instance: a7f88d19-08ee-47bf-9240-7d49afd775e2] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:57:35.956741 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-02c5a5c8-25c2-4fdc-a078-93c5bcf42023 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:35.958947 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-02c5a5c8-25c2-4fdc-a078-93c5bcf42023 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:35.959931 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-02c5a5c8-25c2-4fdc-a078-93c5bcf42023 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:35.961035 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-02c5a5c8-25c2-4fdc-a078-93c5bcf42023 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:35.961722 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-02c5a5c8-25c2-4fdc-a078-93c5bcf42023 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:35.963282 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-02c5a5c8-25c2-4fdc-a078-93c5bcf42023 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:36.070969 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-458f7271-6adb-4f68-bdf4-5fd71b1295f5 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72117f17294649d6b8bc16c66c7efab2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45d4c047d3c44324a27a27831236ab0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:57:36.081013 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-458f7271-6adb-4f68-bdf4-5fd71b1295f5 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] 10.222.0.13 "GET /compute/v2.1/servers/7218f99b-b011-4f08-931e-340d47069f6e" status: 200 len: 1476 microversion: 2.1 time: 0.246787 Nov 01 18:57:36.081949 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 440/933] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:57:35 2022] GET /compute/v2.1/servers/7218f99b-b011-4f08-931e-340d47069f6e => generated 1476 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:57:36.086723 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-eccb66c2-1acd-4a74-bede-cbbe5ab385a8 tempest-ServersAdmin275Test-1925739795 tempest-ServersAdmin275Test-1925739795-project-admin] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:57:36.087331 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-eccb66c2-1acd-4a74-bede-cbbe5ab385a8 tempest-ServersAdmin275Test-1925739795 tempest-ServersAdmin275Test-1925739795-project-admin] [instance: 87679611-878a-49b2-bf8f-39e784c6d70b] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:57:36.093302 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-eccb66c2-1acd-4a74-bede-cbbe5ab385a8 tempest-ServersAdmin275Test-1925739795 tempest-ServersAdmin275Test-1925739795-project-admin] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:36.094017 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-eccb66c2-1acd-4a74-bede-cbbe5ab385a8 tempest-ServersAdmin275Test-1925739795 tempest-ServersAdmin275Test-1925739795-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:36.094600 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-eccb66c2-1acd-4a74-bede-cbbe5ab385a8 tempest-ServersAdmin275Test-1925739795 tempest-ServersAdmin275Test-1925739795-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:36.095471 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-eccb66c2-1acd-4a74-bede-cbbe5ab385a8 tempest-ServersAdmin275Test-1925739795 tempest-ServersAdmin275Test-1925739795-project-admin] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:36.096203 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-eccb66c2-1acd-4a74-bede-cbbe5ab385a8 tempest-ServersAdmin275Test-1925739795 tempest-ServersAdmin275Test-1925739795-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:36.097334 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-eccb66c2-1acd-4a74-bede-cbbe5ab385a8 tempest-ServersAdmin275Test-1925739795 tempest-ServersAdmin275Test-1925739795-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:36.182234 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.objects.instance [None req-eccb66c2-1acd-4a74-bede-cbbe5ab385a8 tempest-ServersAdmin275Test-1925739795 tempest-ServersAdmin275Test-1925739795-project-admin] Lazy-loading 'services' on Instance uuid 87679611-878a-49b2-bf8f-39e784c6d70b {{(pid=121403) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 01 18:57:36.204172 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-eccb66c2-1acd-4a74-bede-cbbe5ab385a8 tempest-ServersAdmin275Test-1925739795 tempest-ServersAdmin275Test-1925739795-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/87679611-878a-49b2-bf8f-39e784c6d70b" status: 200 len: 1929 microversion: 2.75 time: 0.120873 Nov 01 18:57:36.215715 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 441/934] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 18:57:36 2022] GET /compute/v2.1/servers/87679611-878a-49b2-bf8f-39e784c6d70b => generated 1929 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 18:57:36.373469 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-f7005b60-4c2a-4f74-ba7a-4b752239a8d0 tempest-HypervisorAdminNegativeUnderV252Test-814809636 tempest-HypervisorAdminNegativeUnderV252Test-814809636-project-admin] Calling method '.version_select at 0x7f0ae2826d30>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:57:36.375234 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f7005b60-4c2a-4f74-ba7a-4b752239a8d0 tempest-HypervisorAdminNegativeUnderV252Test-814809636 tempest-HypervisorAdminNegativeUnderV252Test-814809636-project-admin] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:36.375736 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f7005b60-4c2a-4f74-ba7a-4b752239a8d0 tempest-HypervisorAdminNegativeUnderV252Test-814809636 tempest-HypervisorAdminNegativeUnderV252Test-814809636-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:36.376195 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f7005b60-4c2a-4f74-ba7a-4b752239a8d0 tempest-HypervisorAdminNegativeUnderV252Test-814809636 tempest-HypervisorAdminNegativeUnderV252Test-814809636-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:36.390250 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f7005b60-4c2a-4f74-ba7a-4b752239a8d0 tempest-HypervisorAdminNegativeUnderV252Test-814809636 tempest-HypervisorAdminNegativeUnderV252Test-814809636-project-admin] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:36.390731 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f7005b60-4c2a-4f74-ba7a-4b752239a8d0 tempest-HypervisorAdminNegativeUnderV252Test-814809636 tempest-HypervisorAdminNegativeUnderV252Test-814809636-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:36.391163 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f7005b60-4c2a-4f74-ba7a-4b752239a8d0 tempest-HypervisorAdminNegativeUnderV252Test-814809636 tempest-HypervisorAdminNegativeUnderV252Test-814809636-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:36.403833 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f7005b60-4c2a-4f74-ba7a-4b752239a8d0 tempest-HypervisorAdminNegativeUnderV252Test-814809636 tempest-HypervisorAdminNegativeUnderV252Test-814809636-project-admin] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:36.404502 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f7005b60-4c2a-4f74-ba7a-4b752239a8d0 tempest-HypervisorAdminNegativeUnderV252Test-814809636 tempest-HypervisorAdminNegativeUnderV252Test-814809636-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:36.404964 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f7005b60-4c2a-4f74-ba7a-4b752239a8d0 tempest-HypervisorAdminNegativeUnderV252Test-814809636 tempest-HypervisorAdminNegativeUnderV252Test-814809636-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:36.413072 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-f7005b60-4c2a-4f74-ba7a-4b752239a8d0 tempest-HypervisorAdminNegativeUnderV252Test-814809636 tempest-HypervisorAdminNegativeUnderV252Test-814809636-project-admin] 10.222.0.13 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.195393 Nov 01 18:57:36.414082 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 442/935] 10.222.0.13 () {58 vars in 1146 bytes} [Tue Nov 1 18:57:36 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 18:57:36.419103 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-0ce5b0ab-e098-4487-9a03-e44aa1cee6c4 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:57:36.419861 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-0ce5b0ab-e098-4487-9a03-e44aa1cee6c4 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] [instance: e43fa43a-f523-4438-a8ba-a4460ea4a210] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:57:36.426743 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-0ce5b0ab-e098-4487-9a03-e44aa1cee6c4 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:36.427939 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-0ce5b0ab-e098-4487-9a03-e44aa1cee6c4 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:36.428445 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-0ce5b0ab-e098-4487-9a03-e44aa1cee6c4 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:36.429207 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-0ce5b0ab-e098-4487-9a03-e44aa1cee6c4 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:36.429673 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-0ce5b0ab-e098-4487-9a03-e44aa1cee6c4 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:36.430101 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-0ce5b0ab-e098-4487-9a03-e44aa1cee6c4 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:36.497040 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-02c5a5c8-25c2-4fdc-a078-93c5bcf42023 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:57:36.499583 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-0ce5b0ab-e098-4487-9a03-e44aa1cee6c4 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b52b7dcbb044f9bfc424e4417c77fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '708bc0ea4b5a4baf81933725792bedd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:57:36.506075 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-02c5a5c8-25c2-4fdc-a078-93c5bcf42023 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:57:36.507492 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-0ce5b0ab-e098-4487-9a03-e44aa1cee6c4 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] 10.222.0.13 "GET /compute/v2.1/servers/e43fa43a-f523-4438-a8ba-a4460ea4a210" status: 200 len: 1283 microversion: 2.1 time: 0.092282 Nov 01 18:57:36.507614 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-02c5a5c8-25c2-4fdc-a078-93c5bcf42023 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:57:36.511308 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 443/936] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:57:36 2022] GET /compute/v2.1/servers/e43fa43a-f523-4438-a8ba-a4460ea4a210 => generated 1283 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:57:36.511456 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-02c5a5c8-25c2-4fdc-a078-93c5bcf42023 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] 10.222.0.13 "GET /compute/v2.1/servers/a7f88d19-08ee-47bf-9240-7d49afd775e2" status: 200 len: 1410 microversion: 2.25 time: 0.573265 Nov 01 18:57:36.511456 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 494/937] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 18:57:35 2022] GET /compute/v2.1/servers/a7f88d19-08ee-47bf-9240-7d49afd775e2 => generated 1410 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 01 18:57:36.526182 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-852afacd-e9e4-4ef1-8400-3a73d0aff99a tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:57:36.526779 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-852afacd-e9e4-4ef1-8400-3a73d0aff99a tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] [instance: ea631032-dd04-429b-988e-e6362ea42cf7] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:57:36.533838 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-852afacd-e9e4-4ef1-8400-3a73d0aff99a tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:36.534852 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-852afacd-e9e4-4ef1-8400-3a73d0aff99a tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:36.535479 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-852afacd-e9e4-4ef1-8400-3a73d0aff99a tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:36.536183 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-852afacd-e9e4-4ef1-8400-3a73d0aff99a tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:36.536706 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-852afacd-e9e4-4ef1-8400-3a73d0aff99a tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:36.537139 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-852afacd-e9e4-4ef1-8400-3a73d0aff99a tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:36.608208 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-852afacd-e9e4-4ef1-8400-3a73d0aff99a tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c1314c21d8547ff890ede1c2ad281c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c804370880454c7aa02cef2c2c3cf144', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:57:36.618619 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-852afacd-e9e4-4ef1-8400-3a73d0aff99a tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c1314c21d8547ff890ede1c2ad281c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c804370880454c7aa02cef2c2c3cf144', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:57:36.620687 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-852afacd-e9e4-4ef1-8400-3a73d0aff99a tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c1314c21d8547ff890ede1c2ad281c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c804370880454c7aa02cef2c2c3cf144', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:57:36.626234 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-852afacd-e9e4-4ef1-8400-3a73d0aff99a tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] 10.222.0.13 "GET /compute/v2.1/servers/ea631032-dd04-429b-988e-e6362ea42cf7" status: 200 len: 1537 microversion: 2.91 time: 0.116837 Nov 01 18:57:36.628423 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 444/938] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 18:57:36 2022] GET /compute/v2.1/servers/ea631032-dd04-429b-988e-e6362ea42cf7 => generated 1537 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 18:57:36.653204 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-ff0d4c19-e050-472e-b575-015de16ab708 tempest-HypervisorAdminNegativeUnderV252Test-261011894 tempest-HypervisorAdminNegativeUnderV252Test-261011894-project] Calling method '.version_select at 0x7f0ae265c1f0>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:57:36.654966 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-ff0d4c19-e050-472e-b575-015de16ab708 tempest-HypervisorAdminNegativeUnderV252Test-261011894 tempest-HypervisorAdminNegativeUnderV252Test-261011894-project] Policy check for os_compute_api:os-hypervisors:search failed with credentials {'is_admin': False, 'user_id': '1b4844d31b8343ff9619b667d2bc6d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ccf24a942e48e2a21f4d0ecf4d1125', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:57:36.656649 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-ff0d4c19-e050-472e-b575-015de16ab708 tempest-HypervisorAdminNegativeUnderV252Test-261011894 tempest-HypervisorAdminNegativeUnderV252Test-261011894-project] Request method failure captured: Nov 01 18:57:36.656649 n-d-863052-2 devstack@n-api.service[121402]: request: GET /compute/v2.1/os-hypervisors/n-h1-863052-2/search HTTP/1.1 Nov 01 18:57:36.656649 n-d-863052-2 devstack@n-api.service[121402]: Accept: application/json Nov 01 18:57:36.656649 n-d-863052-2 devstack@n-api.service[121402]: Accept-Encoding: identity Nov 01 18:57:36.656649 n-d-863052-2 devstack@n-api.service[121402]: Connection: close Nov 01 18:57:36.656649 n-d-863052-2 devstack@n-api.service[121402]: Content-Length: 0 Nov 01 18:57:36.656649 n-d-863052-2 devstack@n-api.service[121402]: Content-Type: application/json Nov 01 18:57:36.656649 n-d-863052-2 devstack@n-api.service[121402]: Host: 10.222.0.13 Nov 01 18:57:36.656649 n-d-863052-2 devstack@n-api.service[121402]: Openstack-System-Scope: None Nov 01 18:57:36.656649 n-d-863052-2 devstack@n-api.service[121402]: User-Agent: python-urllib3/1.26.12 Nov 01 18:57:36.656649 n-d-863052-2 devstack@n-api.service[121402]: X-Auth-Token: gAAAAABjYWwf0opsUtDqmfvdU_5IsYKDBSGpmV8_eXG7_xBy3-MxmtM05Nu8t_-d_CAQHAFygFHm4uY3Fs2JTLHHRUdBngUsig17f7SbSCQM0EtxH8yZn9uTkTJd8Oyg8KgZNp75p180HQXNIFJukTLyh8Kek3yKvnGzgveXH0JvdGb8jbQ6jhw Nov 01 18:57:36.656649 n-d-863052-2 devstack@n-api.service[121402]: X-Domain-Id: None Nov 01 18:57:36.656649 n-d-863052-2 devstack@n-api.service[121402]: X-Domain-Name: None Nov 01 18:57:36.656649 n-d-863052-2 devstack@n-api.service[121402]: X-Identity-Status: Confirmed Nov 01 18:57:36.656649 n-d-863052-2 devstack@n-api.service[121402]: X-Is-Admin-Project: True Nov 01 18:57:36.656649 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Domain-Id: default Nov 01 18:57:36.656649 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Domain-Name: Default Nov 01 18:57:36.656649 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Id: 89ccf24a942e48e2a21f4d0ecf4d1125 Nov 01 18:57:36.656649 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-261011894 Nov 01 18:57:36.656649 n-d-863052-2 devstack@n-api.service[121402]: X-Role: member,reader Nov 01 18:57:36.656649 n-d-863052-2 devstack@n-api.service[121402]: X-Roles: member,reader Nov 01 18:57:36.658100 n-d-863052-2 devstack@n-api.service[121402]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/89ccf24a942e48e2a21f4d0ecf4d1125"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/89ccf24a942e48e2a21f4d0ecf4d1125"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_89ccf24a942e48e2a21f4d0ecf4d1125", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/89ccf24a942e48e2a21f4d0ecf4d1125"}]}] Nov 01 18:57:36.658100 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-261011894 Nov 01 18:57:36.658100 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant-Id: 89ccf24a942e48e2a21f4d0ecf4d1125 Nov 01 18:57:36.658100 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-261011894 Nov 01 18:57:36.658100 n-d-863052-2 devstack@n-api.service[121402]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-261011894-project Nov 01 18:57:36.658100 n-d-863052-2 devstack@n-api.service[121402]: X-User-Domain-Id: default Nov 01 18:57:36.658100 n-d-863052-2 devstack@n-api.service[121402]: X-User-Domain-Name: Default Nov 01 18:57:36.658100 n-d-863052-2 devstack@n-api.service[121402]: X-User-Id: 1b4844d31b8343ff9619b667d2bc6d01 Nov 01 18:57:36.658100 n-d-863052-2 devstack@n-api.service[121402]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-261011894-project Nov 01 18:57:36.658100 n-d-863052-2 devstack@n-api.service[121402]: method: Nov 01 18:57:36.658100 n-d-863052-2 devstack@n-api.service[121402]: exception: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Nov 01 18:57:36.658100 n-d-863052-2 devstack@n-api.service[121402]: action_args: {'id': 'n-h1-863052-2'} Nov 01 18:57:36.658944 n-d-863052-2 devstack@n-api.service[121402]: {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 01 18:57:36.658944 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:57:36.658944 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 18:57:36.658944 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 18:57:36.658944 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 01 18:57:36.658944 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 01 18:57:36.658944 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 01 18:57:36.658944 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 01 18:57:36.658944 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 01 18:57:36.658944 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 01 18:57:36.658944 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 439, in search Nov 01 18:57:36.658944 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'search', target={}) Nov 01 18:57:36.658944 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Nov 01 18:57:36.658944 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Nov 01 18:57:36.658944 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Nov 01 18:57:36.658944 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Nov 01 18:57:36.658944 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 01 18:57:36.658944 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 01 18:57:36.658944 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 01 18:57:36.660335 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise self.value Nov 01 18:57:36.660335 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Nov 01 18:57:36.660335 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Nov 01 18:57:36.660335 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Nov 01 18:57:36.660335 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return self.enforce( Nov 01 18:57:36.660335 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Nov 01 18:57:36.660335 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Nov 01 18:57:36.660335 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Nov 01 18:57:36.660335 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 18:57:36.660335 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 18:57:36.660335 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 18:57:36.660335 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:57:36.660335 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 18:57:36.660335 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 18:57:36.660335 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Nov 01 18:57:36.660335 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Nov 01 18:57:36.660335 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Nov 01 18:57:36.660335 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 18:57:36.661655 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-ff0d4c19-e050-472e-b575-015de16ab708 tempest-HypervisorAdminNegativeUnderV252Test-261011894 tempest-HypervisorAdminNegativeUnderV252Test-261011894-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. {{(pid=121402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 01 18:57:36.661655 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-ff0d4c19-e050-472e-b575-015de16ab708 tempest-HypervisorAdminNegativeUnderV252Test-261011894 tempest-HypervisorAdminNegativeUnderV252Test-261011894-project] 10.222.0.13 "GET /compute/v2.1/os-hypervisors/n-h1-863052-2/search" status: 403 len: 117 microversion: 2.1 time: 0.147363 Nov 01 18:57:36.661655 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 495/939] 10.222.0.13 () {58 vars in 1209 bytes} [Tue Nov 1 18:57:36 2022] GET /compute/v2.1/os-hypervisors/n-h1-863052-2/search => generated 117 bytes in 148 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Nov 01 18:57:36.667770 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-d6635fdf-7fd1-4595-b42b-4ce8bdfe994f tempest-HypervisorAdminNegativeUnderV252Test-814809636 tempest-HypervisorAdminNegativeUnderV252Test-814809636-project-admin] Calling method '.version_select at 0x7f0ae2a94940>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:57:36.669514 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d6635fdf-7fd1-4595-b42b-4ce8bdfe994f tempest-HypervisorAdminNegativeUnderV252Test-814809636 tempest-HypervisorAdminNegativeUnderV252Test-814809636-project-admin] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:36.670023 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d6635fdf-7fd1-4595-b42b-4ce8bdfe994f tempest-HypervisorAdminNegativeUnderV252Test-814809636 tempest-HypervisorAdminNegativeUnderV252Test-814809636-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:36.670490 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d6635fdf-7fd1-4595-b42b-4ce8bdfe994f tempest-HypervisorAdminNegativeUnderV252Test-814809636 tempest-HypervisorAdminNegativeUnderV252Test-814809636-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:36.677093 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.wsgi [None req-d6635fdf-7fd1-4595-b42b-4ce8bdfe994f tempest-HypervisorAdminNegativeUnderV252Test-814809636 tempest-HypervisorAdminNegativeUnderV252Test-814809636-project-admin] HTTP exception thrown: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Nov 01 18:57:36.678524 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-d6635fdf-7fd1-4595-b42b-4ce8bdfe994f tempest-HypervisorAdminNegativeUnderV252Test-814809636 tempest-HypervisorAdminNegativeUnderV252Test-814809636-project-admin] Request method failure captured: Nov 01 18:57:36.678524 n-d-863052-2 devstack@n-api.service[121403]: request: GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search HTTP/1.1 Nov 01 18:57:36.678524 n-d-863052-2 devstack@n-api.service[121403]: Accept: application/json Nov 01 18:57:36.678524 n-d-863052-2 devstack@n-api.service[121403]: Accept-Encoding: identity Nov 01 18:57:36.678524 n-d-863052-2 devstack@n-api.service[121403]: Connection: close Nov 01 18:57:36.678524 n-d-863052-2 devstack@n-api.service[121403]: Content-Length: 0 Nov 01 18:57:36.678524 n-d-863052-2 devstack@n-api.service[121403]: Content-Type: application/json Nov 01 18:57:36.678524 n-d-863052-2 devstack@n-api.service[121403]: Host: 10.222.0.13 Nov 01 18:57:36.678524 n-d-863052-2 devstack@n-api.service[121403]: Openstack-System-Scope: None Nov 01 18:57:36.678524 n-d-863052-2 devstack@n-api.service[121403]: User-Agent: python-urllib3/1.26.12 Nov 01 18:57:36.678524 n-d-863052-2 devstack@n-api.service[121403]: X-Auth-Token: gAAAAABjYWwf0Zxzts6tLIP0SWrIUdzpAnocuZAE5mcnaJRO0PGvG1IOsJWZ8X7B_7E6K4Een0aiFRn16xYLeV91bk9OiLv1HUpTUQsz2pJmGRoIDx0-u7YMJHmK5iuFm3fQlcw8Q9MatPjNi01Wp_wIC8ZvhR9wLsA5ALHeTxF5_OO6QfTv_AU Nov 01 18:57:36.678524 n-d-863052-2 devstack@n-api.service[121403]: X-Domain-Id: None Nov 01 18:57:36.678524 n-d-863052-2 devstack@n-api.service[121403]: X-Domain-Name: None Nov 01 18:57:36.678524 n-d-863052-2 devstack@n-api.service[121403]: X-Identity-Status: Confirmed Nov 01 18:57:36.678524 n-d-863052-2 devstack@n-api.service[121403]: X-Is-Admin-Project: True Nov 01 18:57:36.678524 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Domain-Id: default Nov 01 18:57:36.678524 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Domain-Name: Default Nov 01 18:57:36.678524 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Id: 085cfb748b6f47edacaabe611de920b4 Nov 01 18:57:36.678524 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-814809636 Nov 01 18:57:36.678524 n-d-863052-2 devstack@n-api.service[121403]: X-Role: admin,member,reader Nov 01 18:57:36.678524 n-d-863052-2 devstack@n-api.service[121403]: X-Roles: admin,member,reader Nov 01 18:57:36.680081 n-d-863052-2 devstack@n-api.service[121403]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/085cfb748b6f47edacaabe611de920b4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/085cfb748b6f47edacaabe611de920b4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_085cfb748b6f47edacaabe611de920b4", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/085cfb748b6f47edacaabe611de920b4"}]}] Nov 01 18:57:36.680081 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-814809636 Nov 01 18:57:36.680081 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant-Id: 085cfb748b6f47edacaabe611de920b4 Nov 01 18:57:36.680081 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-814809636 Nov 01 18:57:36.680081 n-d-863052-2 devstack@n-api.service[121403]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-814809636-project-admin Nov 01 18:57:36.680081 n-d-863052-2 devstack@n-api.service[121403]: X-User-Domain-Id: default Nov 01 18:57:36.680081 n-d-863052-2 devstack@n-api.service[121403]: X-User-Domain-Name: Default Nov 01 18:57:36.680081 n-d-863052-2 devstack@n-api.service[121403]: X-User-Id: 5452e75112184a608a5913acecb6b56d Nov 01 18:57:36.680081 n-d-863052-2 devstack@n-api.service[121403]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-814809636-project-admin Nov 01 18:57:36.680081 n-d-863052-2 devstack@n-api.service[121403]: method: Nov 01 18:57:36.680081 n-d-863052-2 devstack@n-api.service[121403]: exception: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Nov 01 18:57:36.680081 n-d-863052-2 devstack@n-api.service[121403]: action_args: {'id': 'nonexistent_hypervisor_name'} Nov 01 18:57:36.681027 n-d-863052-2 devstack@n-api.service[121403]: {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 01 18:57:36.681027 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:57:36.681027 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 18:57:36.681027 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 18:57:36.681027 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 01 18:57:36.681027 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 01 18:57:36.681027 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 01 18:57:36.681027 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 01 18:57:36.681027 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 01 18:57:36.681027 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 01 18:57:36.681027 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 443, in search Nov 01 18:57:36.681027 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi compute_nodes = self._get_compute_nodes_by_name_pattern(context, id) Nov 01 18:57:36.681027 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 139, in _get_compute_nodes_by_name_pattern Nov 01 18:57:36.681027 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Nov 01 18:57:36.681027 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Nov 01 18:57:36.681027 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 18:57:36.681027 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 18:57:36.681027 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 18:57:36.681027 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:57:36.681027 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 18:57:36.682435 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 18:57:36.682435 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 01 18:57:36.682435 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 01 18:57:36.682435 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Nov 01 18:57:36.682435 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 18:57:36.682435 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-d6635fdf-7fd1-4595-b42b-4ce8bdfe994f tempest-HypervisorAdminNegativeUnderV252Test-814809636 tempest-HypervisorAdminNegativeUnderV252Test-814809636-project-admin] Returning 404 to user: No hypervisor matching 'nonexistent_hypervisor_name' could be found. {{(pid=121403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 01 18:57:36.682435 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-d6635fdf-7fd1-4595-b42b-4ce8bdfe994f tempest-HypervisorAdminNegativeUnderV252Test-814809636 tempest-HypervisorAdminNegativeUnderV252Test-814809636-project-admin] 10.222.0.13 "GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search" status: 404 len: 114 microversion: 2.1 time: 0.016216 Nov 01 18:57:36.682435 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 445/940] 10.222.0.13 () {58 vars in 1251 bytes} [Tue Nov 1 18:57:36 2022] GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search => generated 114 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 01 18:57:36.689601 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-da712256-7021-4f50-a4a6-6ae5a9ae5994 tempest-HypervisorAdminNegativeUnderV252Test-814809636 tempest-HypervisorAdminNegativeUnderV252Test-814809636-project-admin] Calling method '.version_select at 0x7f0ae255eca0>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:57:36.691837 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-da712256-7021-4f50-a4a6-6ae5a9ae5994 tempest-HypervisorAdminNegativeUnderV252Test-814809636 tempest-HypervisorAdminNegativeUnderV252Test-814809636-project-admin] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:36.692319 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-da712256-7021-4f50-a4a6-6ae5a9ae5994 tempest-HypervisorAdminNegativeUnderV252Test-814809636 tempest-HypervisorAdminNegativeUnderV252Test-814809636-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:36.692784 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-da712256-7021-4f50-a4a6-6ae5a9ae5994 tempest-HypervisorAdminNegativeUnderV252Test-814809636 tempest-HypervisorAdminNegativeUnderV252Test-814809636-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:36.707608 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-da712256-7021-4f50-a4a6-6ae5a9ae5994 tempest-HypervisorAdminNegativeUnderV252Test-814809636 tempest-HypervisorAdminNegativeUnderV252Test-814809636-project-admin] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:36.708094 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-da712256-7021-4f50-a4a6-6ae5a9ae5994 tempest-HypervisorAdminNegativeUnderV252Test-814809636 tempest-HypervisorAdminNegativeUnderV252Test-814809636-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:36.708533 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-da712256-7021-4f50-a4a6-6ae5a9ae5994 tempest-HypervisorAdminNegativeUnderV252Test-814809636 tempest-HypervisorAdminNegativeUnderV252Test-814809636-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:36.718334 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-da712256-7021-4f50-a4a6-6ae5a9ae5994 tempest-HypervisorAdminNegativeUnderV252Test-814809636 tempest-HypervisorAdminNegativeUnderV252Test-814809636-project-admin] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:36.718808 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-da712256-7021-4f50-a4a6-6ae5a9ae5994 tempest-HypervisorAdminNegativeUnderV252Test-814809636 tempest-HypervisorAdminNegativeUnderV252Test-814809636-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:36.719244 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-da712256-7021-4f50-a4a6-6ae5a9ae5994 tempest-HypervisorAdminNegativeUnderV252Test-814809636 tempest-HypervisorAdminNegativeUnderV252Test-814809636-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:36.725423 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-da712256-7021-4f50-a4a6-6ae5a9ae5994 tempest-HypervisorAdminNegativeUnderV252Test-814809636 tempest-HypervisorAdminNegativeUnderV252Test-814809636-project-admin] 10.222.0.13 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.039767 Nov 01 18:57:36.726009 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 496/941] 10.222.0.13 () {58 vars in 1146 bytes} [Tue Nov 1 18:57:36 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 18:57:36.736793 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-73086017-64cb-4d9b-9171-903deef58f7d tempest-HypervisorAdminNegativeUnderV252Test-261011894 tempest-HypervisorAdminNegativeUnderV252Test-261011894-project] Calling method '.version_select at 0x7f0ae2a948b0>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:57:36.738627 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-73086017-64cb-4d9b-9171-903deef58f7d tempest-HypervisorAdminNegativeUnderV252Test-261011894 tempest-HypervisorAdminNegativeUnderV252Test-261011894-project] Policy check for os_compute_api:os-hypervisors:servers failed with credentials {'is_admin': False, 'user_id': '1b4844d31b8343ff9619b667d2bc6d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ccf24a942e48e2a21f4d0ecf4d1125', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:57:36.740155 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-73086017-64cb-4d9b-9171-903deef58f7d tempest-HypervisorAdminNegativeUnderV252Test-261011894 tempest-HypervisorAdminNegativeUnderV252Test-261011894-project] Request method failure captured: Nov 01 18:57:36.740155 n-d-863052-2 devstack@n-api.service[121403]: request: GET /compute/v2.1/os-hypervisors/1/servers HTTP/1.1 Nov 01 18:57:36.740155 n-d-863052-2 devstack@n-api.service[121403]: Accept: application/json Nov 01 18:57:36.740155 n-d-863052-2 devstack@n-api.service[121403]: Accept-Encoding: identity Nov 01 18:57:36.740155 n-d-863052-2 devstack@n-api.service[121403]: Connection: close Nov 01 18:57:36.740155 n-d-863052-2 devstack@n-api.service[121403]: Content-Length: 0 Nov 01 18:57:36.740155 n-d-863052-2 devstack@n-api.service[121403]: Content-Type: application/json Nov 01 18:57:36.740155 n-d-863052-2 devstack@n-api.service[121403]: Host: 10.222.0.13 Nov 01 18:57:36.740155 n-d-863052-2 devstack@n-api.service[121403]: Openstack-System-Scope: None Nov 01 18:57:36.740155 n-d-863052-2 devstack@n-api.service[121403]: User-Agent: python-urllib3/1.26.12 Nov 01 18:57:36.740155 n-d-863052-2 devstack@n-api.service[121403]: X-Auth-Token: gAAAAABjYWwf0opsUtDqmfvdU_5IsYKDBSGpmV8_eXG7_xBy3-MxmtM05Nu8t_-d_CAQHAFygFHm4uY3Fs2JTLHHRUdBngUsig17f7SbSCQM0EtxH8yZn9uTkTJd8Oyg8KgZNp75p180HQXNIFJukTLyh8Kek3yKvnGzgveXH0JvdGb8jbQ6jhw Nov 01 18:57:36.740155 n-d-863052-2 devstack@n-api.service[121403]: X-Domain-Id: None Nov 01 18:57:36.740155 n-d-863052-2 devstack@n-api.service[121403]: X-Domain-Name: None Nov 01 18:57:36.740155 n-d-863052-2 devstack@n-api.service[121403]: X-Identity-Status: Confirmed Nov 01 18:57:36.740155 n-d-863052-2 devstack@n-api.service[121403]: X-Is-Admin-Project: True Nov 01 18:57:36.740155 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Domain-Id: default Nov 01 18:57:36.740155 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Domain-Name: Default Nov 01 18:57:36.740155 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Id: 89ccf24a942e48e2a21f4d0ecf4d1125 Nov 01 18:57:36.740155 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-261011894 Nov 01 18:57:36.740155 n-d-863052-2 devstack@n-api.service[121403]: X-Role: member,reader Nov 01 18:57:36.740155 n-d-863052-2 devstack@n-api.service[121403]: X-Roles: member,reader Nov 01 18:57:36.741623 n-d-863052-2 devstack@n-api.service[121403]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/89ccf24a942e48e2a21f4d0ecf4d1125"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/89ccf24a942e48e2a21f4d0ecf4d1125"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_89ccf24a942e48e2a21f4d0ecf4d1125", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/89ccf24a942e48e2a21f4d0ecf4d1125"}]}] Nov 01 18:57:36.741623 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-261011894 Nov 01 18:57:36.741623 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant-Id: 89ccf24a942e48e2a21f4d0ecf4d1125 Nov 01 18:57:36.741623 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-261011894 Nov 01 18:57:36.741623 n-d-863052-2 devstack@n-api.service[121403]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-261011894-project Nov 01 18:57:36.741623 n-d-863052-2 devstack@n-api.service[121403]: X-User-Domain-Id: default Nov 01 18:57:36.741623 n-d-863052-2 devstack@n-api.service[121403]: X-User-Domain-Name: Default Nov 01 18:57:36.741623 n-d-863052-2 devstack@n-api.service[121403]: X-User-Id: 1b4844d31b8343ff9619b667d2bc6d01 Nov 01 18:57:36.741623 n-d-863052-2 devstack@n-api.service[121403]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-261011894-project Nov 01 18:57:36.741623 n-d-863052-2 devstack@n-api.service[121403]: method: Nov 01 18:57:36.741623 n-d-863052-2 devstack@n-api.service[121403]: exception: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Nov 01 18:57:36.741623 n-d-863052-2 devstack@n-api.service[121403]: action_args: {'id': '1'} Nov 01 18:57:36.742375 n-d-863052-2 devstack@n-api.service[121403]: {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 01 18:57:36.742375 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:57:36.742375 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 18:57:36.742375 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 18:57:36.742375 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 01 18:57:36.742375 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 01 18:57:36.742375 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 01 18:57:36.742375 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 01 18:57:36.742375 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 01 18:57:36.742375 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 01 18:57:36.742375 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 478, in servers Nov 01 18:57:36.742375 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'servers', target={}) Nov 01 18:57:36.742375 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Nov 01 18:57:36.742375 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Nov 01 18:57:36.742375 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Nov 01 18:57:36.742375 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Nov 01 18:57:36.742375 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 01 18:57:36.742375 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 01 18:57:36.742375 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 01 18:57:36.743961 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise self.value Nov 01 18:57:36.743961 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Nov 01 18:57:36.743961 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Nov 01 18:57:36.743961 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Nov 01 18:57:36.743961 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return self.enforce( Nov 01 18:57:36.743961 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Nov 01 18:57:36.743961 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Nov 01 18:57:36.743961 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Nov 01 18:57:36.743961 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 18:57:36.743961 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 18:57:36.743961 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 18:57:36.743961 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:57:36.743961 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 18:57:36.743961 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 18:57:36.743961 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Nov 01 18:57:36.743961 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Nov 01 18:57:36.743961 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Nov 01 18:57:36.743961 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 18:57:36.745494 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-73086017-64cb-4d9b-9171-903deef58f7d tempest-HypervisorAdminNegativeUnderV252Test-261011894 tempest-HypervisorAdminNegativeUnderV252Test-261011894-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. {{(pid=121403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 01 18:57:36.745494 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-73086017-64cb-4d9b-9171-903deef58f7d tempest-HypervisorAdminNegativeUnderV252Test-261011894 tempest-HypervisorAdminNegativeUnderV252Test-261011894-project] 10.222.0.13 "GET /compute/v2.1/os-hypervisors/1/servers" status: 403 len: 118 microversion: 2.1 time: 0.008833 Nov 01 18:57:36.745494 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 446/942] 10.222.0.13 () {58 vars in 1176 bytes} [Tue Nov 1 18:57:36 2022] GET /compute/v2.1/os-hypervisors/1/servers => generated 118 bytes in 10 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Nov 01 18:57:36.751059 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-7987fed0-1224-49a9-aae6-8ed7b493a9e7 tempest-HypervisorAdminNegativeUnderV252Test-814809636 tempest-HypervisorAdminNegativeUnderV252Test-814809636-project-admin] Calling method '.version_select at 0x7f0ae255e280>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:57:36.752398 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-7987fed0-1224-49a9-aae6-8ed7b493a9e7 tempest-HypervisorAdminNegativeUnderV252Test-814809636 tempest-HypervisorAdminNegativeUnderV252Test-814809636-project-admin] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:36.753436 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-7987fed0-1224-49a9-aae6-8ed7b493a9e7 tempest-HypervisorAdminNegativeUnderV252Test-814809636 tempest-HypervisorAdminNegativeUnderV252Test-814809636-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:36.753869 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-7987fed0-1224-49a9-aae6-8ed7b493a9e7 tempest-HypervisorAdminNegativeUnderV252Test-814809636 tempest-HypervisorAdminNegativeUnderV252Test-814809636-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:36.759845 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.wsgi [None req-7987fed0-1224-49a9-aae6-8ed7b493a9e7 tempest-HypervisorAdminNegativeUnderV252Test-814809636 tempest-HypervisorAdminNegativeUnderV252Test-814809636-project-admin] HTTP exception thrown: No hypervisor matching '3f7e5ac2-e58b-43ae-9bd3-ca4303a08f2e' could be found. Nov 01 18:57:36.761195 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-7987fed0-1224-49a9-aae6-8ed7b493a9e7 tempest-HypervisorAdminNegativeUnderV252Test-814809636 tempest-HypervisorAdminNegativeUnderV252Test-814809636-project-admin] Request method failure captured: Nov 01 18:57:36.761195 n-d-863052-2 devstack@n-api.service[121402]: request: GET /compute/v2.1/os-hypervisors/3f7e5ac2-e58b-43ae-9bd3-ca4303a08f2e/servers HTTP/1.1 Nov 01 18:57:36.761195 n-d-863052-2 devstack@n-api.service[121402]: Accept: application/json Nov 01 18:57:36.761195 n-d-863052-2 devstack@n-api.service[121402]: Accept-Encoding: identity Nov 01 18:57:36.761195 n-d-863052-2 devstack@n-api.service[121402]: Connection: close Nov 01 18:57:36.761195 n-d-863052-2 devstack@n-api.service[121402]: Content-Length: 0 Nov 01 18:57:36.761195 n-d-863052-2 devstack@n-api.service[121402]: Content-Type: application/json Nov 01 18:57:36.761195 n-d-863052-2 devstack@n-api.service[121402]: Host: 10.222.0.13 Nov 01 18:57:36.761195 n-d-863052-2 devstack@n-api.service[121402]: Openstack-System-Scope: None Nov 01 18:57:36.761195 n-d-863052-2 devstack@n-api.service[121402]: User-Agent: python-urllib3/1.26.12 Nov 01 18:57:36.761195 n-d-863052-2 devstack@n-api.service[121402]: X-Auth-Token: gAAAAABjYWwf0Zxzts6tLIP0SWrIUdzpAnocuZAE5mcnaJRO0PGvG1IOsJWZ8X7B_7E6K4Een0aiFRn16xYLeV91bk9OiLv1HUpTUQsz2pJmGRoIDx0-u7YMJHmK5iuFm3fQlcw8Q9MatPjNi01Wp_wIC8ZvhR9wLsA5ALHeTxF5_OO6QfTv_AU Nov 01 18:57:36.761195 n-d-863052-2 devstack@n-api.service[121402]: X-Domain-Id: None Nov 01 18:57:36.761195 n-d-863052-2 devstack@n-api.service[121402]: X-Domain-Name: None Nov 01 18:57:36.761195 n-d-863052-2 devstack@n-api.service[121402]: X-Identity-Status: Confirmed Nov 01 18:57:36.761195 n-d-863052-2 devstack@n-api.service[121402]: X-Is-Admin-Project: True Nov 01 18:57:36.761195 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Domain-Id: default Nov 01 18:57:36.761195 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Domain-Name: Default Nov 01 18:57:36.761195 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Id: 085cfb748b6f47edacaabe611de920b4 Nov 01 18:57:36.761195 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-814809636 Nov 01 18:57:36.761195 n-d-863052-2 devstack@n-api.service[121402]: X-Role: admin,member,reader Nov 01 18:57:36.761195 n-d-863052-2 devstack@n-api.service[121402]: X-Roles: admin,member,reader Nov 01 18:57:36.762506 n-d-863052-2 devstack@n-api.service[121402]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/085cfb748b6f47edacaabe611de920b4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/085cfb748b6f47edacaabe611de920b4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_085cfb748b6f47edacaabe611de920b4", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/085cfb748b6f47edacaabe611de920b4"}]}] Nov 01 18:57:36.762506 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-814809636 Nov 01 18:57:36.762506 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant-Id: 085cfb748b6f47edacaabe611de920b4 Nov 01 18:57:36.762506 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-814809636 Nov 01 18:57:36.762506 n-d-863052-2 devstack@n-api.service[121402]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-814809636-project-admin Nov 01 18:57:36.762506 n-d-863052-2 devstack@n-api.service[121402]: X-User-Domain-Id: default Nov 01 18:57:36.762506 n-d-863052-2 devstack@n-api.service[121402]: X-User-Domain-Name: Default Nov 01 18:57:36.762506 n-d-863052-2 devstack@n-api.service[121402]: X-User-Id: 5452e75112184a608a5913acecb6b56d Nov 01 18:57:36.762506 n-d-863052-2 devstack@n-api.service[121402]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-814809636-project-admin Nov 01 18:57:36.762506 n-d-863052-2 devstack@n-api.service[121402]: method: Nov 01 18:57:36.762506 n-d-863052-2 devstack@n-api.service[121402]: exception: No hypervisor matching '3f7e5ac2-e58b-43ae-9bd3-ca4303a08f2e' could be found. Nov 01 18:57:36.762506 n-d-863052-2 devstack@n-api.service[121402]: action_args: {'id': '3f7e5ac2-e58b-43ae-9bd3-ca4303a08f2e'} Nov 01 18:57:36.763284 n-d-863052-2 devstack@n-api.service[121402]: {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 01 18:57:36.763284 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:57:36.763284 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 18:57:36.763284 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 18:57:36.763284 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 01 18:57:36.763284 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 01 18:57:36.763284 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 01 18:57:36.763284 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 01 18:57:36.763284 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 01 18:57:36.763284 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 01 18:57:36.763284 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 482, in servers Nov 01 18:57:36.763284 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi compute_nodes = self._get_compute_nodes_by_name_pattern(context, id) Nov 01 18:57:36.763284 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 139, in _get_compute_nodes_by_name_pattern Nov 01 18:57:36.763284 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Nov 01 18:57:36.763284 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: No hypervisor matching '3f7e5ac2-e58b-43ae-9bd3-ca4303a08f2e' could be found. Nov 01 18:57:36.763284 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 18:57:36.763284 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 18:57:36.763284 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 18:57:36.763284 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:57:36.764565 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 18:57:36.764565 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 18:57:36.764565 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 01 18:57:36.764565 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 01 18:57:36.764565 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: No hypervisor matching '3f7e5ac2-e58b-43ae-9bd3-ca4303a08f2e' could be found. Nov 01 18:57:36.764565 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 18:57:36.764565 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-7987fed0-1224-49a9-aae6-8ed7b493a9e7 tempest-HypervisorAdminNegativeUnderV252Test-814809636 tempest-HypervisorAdminNegativeUnderV252Test-814809636-project-admin] Returning 404 to user: No hypervisor matching '3f7e5ac2-e58b-43ae-9bd3-ca4303a08f2e' could be found. {{(pid=121402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 01 18:57:36.764565 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-7987fed0-1224-49a9-aae6-8ed7b493a9e7 tempest-HypervisorAdminNegativeUnderV252Test-814809636 tempest-HypervisorAdminNegativeUnderV252Test-814809636-project-admin] 10.222.0.13 "GET /compute/v2.1/os-hypervisors/3f7e5ac2-e58b-43ae-9bd3-ca4303a08f2e/servers" status: 404 len: 123 microversion: 2.1 time: 0.015650 Nov 01 18:57:36.767260 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 497/943] 10.222.0.13 () {58 vars in 1281 bytes} [Tue Nov 1 18:57:36 2022] GET /compute/v2.1/os-hypervisors/3f7e5ac2-e58b-43ae-9bd3-ca4303a08f2e/servers => generated 123 bytes in 21 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 01 18:57:37.105389 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-5efc75d2-d7dd-4c4a-8ba1-4be3a0a8972e tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:57:37.106796 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-5efc75d2-d7dd-4c4a-8ba1-4be3a0a8972e tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] [instance: 7218f99b-b011-4f08-931e-340d47069f6e] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:57:37.116716 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-5efc75d2-d7dd-4c4a-8ba1-4be3a0a8972e tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:37.117701 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-5efc75d2-d7dd-4c4a-8ba1-4be3a0a8972e tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:37.118288 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-5efc75d2-d7dd-4c4a-8ba1-4be3a0a8972e tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:37.119169 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-5efc75d2-d7dd-4c4a-8ba1-4be3a0a8972e tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:37.119932 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-5efc75d2-d7dd-4c4a-8ba1-4be3a0a8972e tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:37.120496 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-5efc75d2-d7dd-4c4a-8ba1-4be3a0a8972e tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:37.295403 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-8f5acbdd-f4f4-492a-b7f5-6d4eeff59908 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-835815760", "imageRef": "2d4a0047-1b9e-445f-8af8-1b5c9d93e881", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 18:57:37.383897 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.network.neutron [None req-8f5acbdd-f4f4-492a-b7f5-6d4eeff59908 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] validate_networks() for [('d3f550cf-0d04-4207-acff-a4965931d488', None, None, None, None, None)] {{(pid=121403) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 01 18:57:37.400097 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-5efc75d2-d7dd-4c4a-8ba1-4be3a0a8972e tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72117f17294649d6b8bc16c66c7efab2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45d4c047d3c44324a27a27831236ab0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:57:37.413808 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-5efc75d2-d7dd-4c4a-8ba1-4be3a0a8972e tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] 10.222.0.13 "GET /compute/v2.1/servers/7218f99b-b011-4f08-931e-340d47069f6e" status: 200 len: 1476 microversion: 2.1 time: 0.313998 Nov 01 18:57:37.414399 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 498/944] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:57:37 2022] GET /compute/v2.1/servers/7218f99b-b011-4f08-931e-340d47069f6e => generated 1476 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:57:37.422388 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-6cc7fea0-60ff-4fb0-8bcb-ed6674c8d7cf tempest-ServersAdmin275Test-1925739795 tempest-ServersAdmin275Test-1925739795-project-admin] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:57:37.425495 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-6cc7fea0-60ff-4fb0-8bcb-ed6674c8d7cf tempest-ServersAdmin275Test-1925739795 tempest-ServersAdmin275Test-1925739795-project-admin] [instance: 87679611-878a-49b2-bf8f-39e784c6d70b] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:57:37.442572 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-6cc7fea0-60ff-4fb0-8bcb-ed6674c8d7cf tempest-ServersAdmin275Test-1925739795 tempest-ServersAdmin275Test-1925739795-project-admin] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:37.443208 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-6cc7fea0-60ff-4fb0-8bcb-ed6674c8d7cf tempest-ServersAdmin275Test-1925739795 tempest-ServersAdmin275Test-1925739795-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:37.443667 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-6cc7fea0-60ff-4fb0-8bcb-ed6674c8d7cf tempest-ServersAdmin275Test-1925739795 tempest-ServersAdmin275Test-1925739795-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:37.444388 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-6cc7fea0-60ff-4fb0-8bcb-ed6674c8d7cf tempest-ServersAdmin275Test-1925739795 tempest-ServersAdmin275Test-1925739795-project-admin] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:37.444878 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-6cc7fea0-60ff-4fb0-8bcb-ed6674c8d7cf tempest-ServersAdmin275Test-1925739795 tempest-ServersAdmin275Test-1925739795-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:37.445306 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-6cc7fea0-60ff-4fb0-8bcb-ed6674c8d7cf tempest-ServersAdmin275Test-1925739795 tempest-ServersAdmin275Test-1925739795-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:37.574093 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.objects.instance [None req-6cc7fea0-60ff-4fb0-8bcb-ed6674c8d7cf tempest-ServersAdmin275Test-1925739795 tempest-ServersAdmin275Test-1925739795-project-admin] Lazy-loading 'services' on Instance uuid 87679611-878a-49b2-bf8f-39e784c6d70b {{(pid=121402) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 01 18:57:37.598860 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-6cc7fea0-60ff-4fb0-8bcb-ed6674c8d7cf tempest-ServersAdmin275Test-1925739795 tempest-ServersAdmin275Test-1925739795-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/87679611-878a-49b2-bf8f-39e784c6d70b" status: 200 len: 1929 microversion: 2.75 time: 0.183322 Nov 01 18:57:37.600208 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 499/945] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 18:57:37 2022] GET /compute/v2.1/servers/87679611-878a-49b2-bf8f-39e784c6d70b => generated 1929 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 18:57:37.619242 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-ceceef02-fea6-451b-bf91-6a6dbdb42c47 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:57:37.619870 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-ceceef02-fea6-451b-bf91-6a6dbdb42c47 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] [instance: e43fa43a-f523-4438-a8ba-a4460ea4a210] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:57:37.631753 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-ceceef02-fea6-451b-bf91-6a6dbdb42c47 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:37.632263 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-ceceef02-fea6-451b-bf91-6a6dbdb42c47 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:37.632742 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-ceceef02-fea6-451b-bf91-6a6dbdb42c47 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:37.633460 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-ceceef02-fea6-451b-bf91-6a6dbdb42c47 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:37.633929 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-ceceef02-fea6-451b-bf91-6a6dbdb42c47 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:37.634362 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-ceceef02-fea6-451b-bf91-6a6dbdb42c47 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:37.880250 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-ceceef02-fea6-451b-bf91-6a6dbdb42c47 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b52b7dcbb044f9bfc424e4417c77fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '708bc0ea4b5a4baf81933725792bedd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:57:37.897948 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-ceceef02-fea6-451b-bf91-6a6dbdb42c47 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] 10.222.0.13 "GET /compute/v2.1/servers/e43fa43a-f523-4438-a8ba-a4460ea4a210" status: 200 len: 1325 microversion: 2.1 time: 0.295903 Nov 01 18:57:37.900610 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 500/946] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:57:37 2022] GET /compute/v2.1/servers/e43fa43a-f523-4438-a8ba-a4460ea4a210 => generated 1325 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:57:37.911438 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-9e02db47-2796-4f1c-a069-08e57f8ac3da tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:57:37.912401 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-9e02db47-2796-4f1c-a069-08e57f8ac3da tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] [instance: a7f88d19-08ee-47bf-9240-7d49afd775e2] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:57:37.921931 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-9e02db47-2796-4f1c-a069-08e57f8ac3da tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:37.924837 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-9e02db47-2796-4f1c-a069-08e57f8ac3da tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:37.925520 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-9e02db47-2796-4f1c-a069-08e57f8ac3da tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:37.926465 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-9e02db47-2796-4f1c-a069-08e57f8ac3da tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:37.929285 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-9e02db47-2796-4f1c-a069-08e57f8ac3da tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:37.929930 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-9e02db47-2796-4f1c-a069-08e57f8ac3da tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:38.064415 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.virt.hardware [None req-8f5acbdd-f4f4-492a-b7f5-6d4eeff59908 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Flavor limits 0:0:0 {{(pid=121403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 01 18:57:38.064931 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.virt.hardware [None req-8f5acbdd-f4f4-492a-b7f5-6d4eeff59908 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Image limits 0:0:0 {{(pid=121403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 01 18:57:38.066010 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.virt.hardware [None req-8f5acbdd-f4f4-492a-b7f5-6d4eeff59908 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Flavor pref 0:0:0 {{(pid=121403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 01 18:57:38.066589 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.virt.hardware [None req-8f5acbdd-f4f4-492a-b7f5-6d4eeff59908 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Image pref 0:0:0 {{(pid=121403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 01 18:57:38.067233 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.virt.hardware [None req-8f5acbdd-f4f4-492a-b7f5-6d4eeff59908 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 01 18:57:38.079320 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-8f5acbdd-f4f4-492a-b7f5-6d4eeff59908 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:38.080042 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-8f5acbdd-f4f4-492a-b7f5-6d4eeff59908 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:38.082063 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-8f5acbdd-f4f4-492a-b7f5-6d4eeff59908 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:38.083061 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-8f5acbdd-f4f4-492a-b7f5-6d4eeff59908 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:38.083797 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-8f5acbdd-f4f4-492a-b7f5-6d4eeff59908 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:38.084966 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-8f5acbdd-f4f4-492a-b7f5-6d4eeff59908 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:38.106817 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.quota [None req-8f5acbdd-f4f4-492a-b7f5-6d4eeff59908 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Getting quotas for project 4a1bb191cff948e99c008b5e861ce4a8. Resources: {'cores', 'ram', 'instances'} {{(pid=121403) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 01 18:57:38.113558 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.quota [None req-8f5acbdd-f4f4-492a-b7f5-6d4eeff59908 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Getting quotas for user 6a63d69c99a546f0af16329cff3ca717 and project 4a1bb191cff948e99c008b5e861ce4a8. Resources: {'cores', 'ram', 'instances'} {{(pid=121403) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 01 18:57:38.128232 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-8f5acbdd-f4f4-492a-b7f5-6d4eeff59908 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Going to run 1 instances... {{(pid=121403) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 01 18:57:38.130896 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-8f5acbdd-f4f4-492a-b7f5-6d4eeff59908 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] [instance: ed4798be-a45e-46f5-8f7e-1165f6479bd1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2d4a0047-1b9e-445f-8af8-1b5c9d93e881',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121403) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 01 18:57:38.188226 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-8f5acbdd-f4f4-492a-b7f5-6d4eeff59908 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.180445 Nov 01 18:57:38.189411 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 447/947] 10.222.0.13 () {60 vars in 1147 bytes} [Tue Nov 1 18:57:37 2022] POST /compute/v2.1/servers => generated 383 bytes in 1182 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 01 18:57:38.196823 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-d4fd042c-a70e-49b3-8c85-0028d4e4a5cb tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:57:38.197641 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-d4fd042c-a70e-49b3-8c85-0028d4e4a5cb tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] [instance: ea631032-dd04-429b-988e-e6362ea42cf7] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:57:38.204604 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d4fd042c-a70e-49b3-8c85-0028d4e4a5cb tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:38.205304 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d4fd042c-a70e-49b3-8c85-0028d4e4a5cb tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:38.206329 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d4fd042c-a70e-49b3-8c85-0028d4e4a5cb tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:38.207190 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d4fd042c-a70e-49b3-8c85-0028d4e4a5cb tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:38.207879 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d4fd042c-a70e-49b3-8c85-0028d4e4a5cb tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:38.208490 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d4fd042c-a70e-49b3-8c85-0028d4e4a5cb tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:38.295310 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-d4fd042c-a70e-49b3-8c85-0028d4e4a5cb tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c1314c21d8547ff890ede1c2ad281c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c804370880454c7aa02cef2c2c3cf144', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:57:38.306756 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-d4fd042c-a70e-49b3-8c85-0028d4e4a5cb tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c1314c21d8547ff890ede1c2ad281c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c804370880454c7aa02cef2c2c3cf144', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:57:38.309039 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-d4fd042c-a70e-49b3-8c85-0028d4e4a5cb tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c1314c21d8547ff890ede1c2ad281c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c804370880454c7aa02cef2c2c3cf144', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:57:38.316201 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-d4fd042c-a70e-49b3-8c85-0028d4e4a5cb tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] 10.222.0.13 "GET /compute/v2.1/servers/ea631032-dd04-429b-988e-e6362ea42cf7" status: 200 len: 1537 microversion: 2.91 time: 0.124078 Nov 01 18:57:38.317461 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 448/948] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 18:57:38 2022] GET /compute/v2.1/servers/ea631032-dd04-429b-988e-e6362ea42cf7 => generated 1537 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 18:57:38.323732 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-3fdb27ce-5b85-400c-bf16-c8f6c41d129e tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:57:38.324565 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-3fdb27ce-5b85-400c-bf16-c8f6c41d129e tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] [instance: ed4798be-a45e-46f5-8f7e-1165f6479bd1] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:57:38.388416 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-9e02db47-2796-4f1c-a069-08e57f8ac3da tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:57:38.390773 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-3fdb27ce-5b85-400c-bf16-c8f6c41d129e tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a63d69c99a546f0af16329cff3ca717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a1bb191cff948e99c008b5e861ce4a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:57:38.398711 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-3fdb27ce-5b85-400c-bf16-c8f6c41d129e tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] 10.222.0.13 "GET /compute/v2.1/servers/ed4798be-a45e-46f5-8f7e-1165f6479bd1" status: 200 len: 1221 microversion: 2.1 time: 0.079938 Nov 01 18:57:38.401253 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 449/949] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:57:38 2022] GET /compute/v2.1/servers/ed4798be-a45e-46f5-8f7e-1165f6479bd1 => generated 1221 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:57:38.402873 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-9e02db47-2796-4f1c-a069-08e57f8ac3da tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:57:38.404382 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-9e02db47-2796-4f1c-a069-08e57f8ac3da tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:57:38.405599 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-9e02db47-2796-4f1c-a069-08e57f8ac3da tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] 10.222.0.13 "GET /compute/v2.1/servers/a7f88d19-08ee-47bf-9240-7d49afd775e2" status: 200 len: 1410 microversion: 2.25 time: 0.501879 Nov 01 18:57:38.406151 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 501/950] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 18:57:37 2022] GET /compute/v2.1/servers/a7f88d19-08ee-47bf-9240-7d49afd775e2 => generated 1410 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 18:57:38.442938 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-f2f9e1c6-ba81-4733-9911-902adbbe2188 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:57:38.443615 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-f2f9e1c6-ba81-4733-9911-902adbbe2188 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] [instance: 7218f99b-b011-4f08-931e-340d47069f6e] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:57:38.454008 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f2f9e1c6-ba81-4733-9911-902adbbe2188 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:38.455352 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f2f9e1c6-ba81-4733-9911-902adbbe2188 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:38.456877 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f2f9e1c6-ba81-4733-9911-902adbbe2188 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:38.457735 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f2f9e1c6-ba81-4733-9911-902adbbe2188 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:38.458341 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f2f9e1c6-ba81-4733-9911-902adbbe2188 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:38.458914 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f2f9e1c6-ba81-4733-9911-902adbbe2188 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:38.631283 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-d6da749c-beb8-44e4-9dbf-c924f01dbcf0 tempest-ServersAdmin275Test-1925739795 tempest-ServersAdmin275Test-1925739795-project-admin] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:57:38.631979 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-d6da749c-beb8-44e4-9dbf-c924f01dbcf0 tempest-ServersAdmin275Test-1925739795 tempest-ServersAdmin275Test-1925739795-project-admin] [instance: 87679611-878a-49b2-bf8f-39e784c6d70b] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:57:38.639188 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-d6da749c-beb8-44e4-9dbf-c924f01dbcf0 tempest-ServersAdmin275Test-1925739795 tempest-ServersAdmin275Test-1925739795-project-admin] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:38.640129 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-d6da749c-beb8-44e4-9dbf-c924f01dbcf0 tempest-ServersAdmin275Test-1925739795 tempest-ServersAdmin275Test-1925739795-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:38.640786 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-d6da749c-beb8-44e4-9dbf-c924f01dbcf0 tempest-ServersAdmin275Test-1925739795 tempest-ServersAdmin275Test-1925739795-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:38.641674 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-d6da749c-beb8-44e4-9dbf-c924f01dbcf0 tempest-ServersAdmin275Test-1925739795 tempest-ServersAdmin275Test-1925739795-project-admin] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:38.642859 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-d6da749c-beb8-44e4-9dbf-c924f01dbcf0 tempest-ServersAdmin275Test-1925739795 tempest-ServersAdmin275Test-1925739795-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:38.643747 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-d6da749c-beb8-44e4-9dbf-c924f01dbcf0 tempest-ServersAdmin275Test-1925739795 tempest-ServersAdmin275Test-1925739795-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:38.798156 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.objects.instance [None req-d6da749c-beb8-44e4-9dbf-c924f01dbcf0 tempest-ServersAdmin275Test-1925739795 tempest-ServersAdmin275Test-1925739795-project-admin] Lazy-loading 'services' on Instance uuid 87679611-878a-49b2-bf8f-39e784c6d70b {{(pid=121402) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 01 18:57:38.835764 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-f2f9e1c6-ba81-4733-9911-902adbbe2188 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72117f17294649d6b8bc16c66c7efab2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45d4c047d3c44324a27a27831236ab0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:57:38.837067 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-d6da749c-beb8-44e4-9dbf-c924f01dbcf0 tempest-ServersAdmin275Test-1925739795 tempest-ServersAdmin275Test-1925739795-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/87679611-878a-49b2-bf8f-39e784c6d70b" status: 200 len: 1929 microversion: 2.75 time: 0.210788 Nov 01 18:57:38.837774 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 502/951] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 18:57:38 2022] GET /compute/v2.1/servers/87679611-878a-49b2-bf8f-39e784c6d70b => generated 1929 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 18:57:38.852805 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-0a476aae-5a3c-43f1-8b0d-21410eef8272 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-347810818", "imageRef": "2d4a0047-1b9e-445f-8af8-1b5c9d93e881", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 18:57:38.865174 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-f2f9e1c6-ba81-4733-9911-902adbbe2188 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] 10.222.0.13 "GET /compute/v2.1/servers/7218f99b-b011-4f08-931e-340d47069f6e" status: 200 len: 1476 microversion: 2.1 time: 0.428250 Nov 01 18:57:38.882725 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 450/952] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:57:38 2022] GET /compute/v2.1/servers/7218f99b-b011-4f08-931e-340d47069f6e => generated 1476 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:57:38.906912 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [req-0b84232e-367c-44d8-a778-07756b9b3a9a req-5e2a8d7d-4faa-4904-b0ba-af2773511072 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e43fa43a-f523-4438-a8ba-a4460ea4a210", "tag": "9f4a6ee5-6fd1-413d-8d9e-aa1c5b8782b3"}]} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 18:57:38.937033 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-0b84232e-367c-44d8-a778-07756b9b3a9a req-5e2a8d7d-4faa-4904-b0ba-af2773511072 service nova] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:38.938194 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-0b84232e-367c-44d8-a778-07756b9b3a9a req-5e2a8d7d-4faa-4904-b0ba-af2773511072 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:38.938830 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-0b84232e-367c-44d8-a778-07756b9b3a9a req-5e2a8d7d-4faa-4904-b0ba-af2773511072 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:38.940894 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.network.neutron [None req-0a476aae-5a3c-43f1-8b0d-21410eef8272 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] validate_networks() for [('d3f550cf-0d04-4207-acff-a4965931d488', None, None, None, None, None)] {{(pid=121402) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 01 18:57:38.985257 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.compute.server_external_events [req-0b84232e-367c-44d8-a778-07756b9b3a9a req-5e2a8d7d-4faa-4904-b0ba-af2773511072 service nova] Creating event network-changed:9f4a6ee5-6fd1-413d-8d9e-aa1c5b8782b3 for instance e43fa43a-f523-4438-a8ba-a4460ea4a210 on n-h2-863052-2 Nov 01 18:57:39.005615 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [req-0b84232e-367c-44d8-a778-07756b9b3a9a req-5e2a8d7d-4faa-4904-b0ba-af2773511072 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.106341 Nov 01 18:57:39.009048 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 451/953] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Nov 1 18:57:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 18:57:39.027374 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-77245cec-b2a6-4168-ae34-64d184a5a453 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:57:39.029178 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-77245cec-b2a6-4168-ae34-64d184a5a453 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] [instance: e43fa43a-f523-4438-a8ba-a4460ea4a210] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:57:39.046932 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-77245cec-b2a6-4168-ae34-64d184a5a453 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:39.047655 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-77245cec-b2a6-4168-ae34-64d184a5a453 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:39.048172 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-77245cec-b2a6-4168-ae34-64d184a5a453 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:39.049151 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-77245cec-b2a6-4168-ae34-64d184a5a453 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:39.050184 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-77245cec-b2a6-4168-ae34-64d184a5a453 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:39.056696 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-77245cec-b2a6-4168-ae34-64d184a5a453 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:39.296114 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-77245cec-b2a6-4168-ae34-64d184a5a453 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b52b7dcbb044f9bfc424e4417c77fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '708bc0ea4b5a4baf81933725792bedd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:57:39.308181 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-77245cec-b2a6-4168-ae34-64d184a5a453 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] 10.222.0.13 "GET /compute/v2.1/servers/e43fa43a-f523-4438-a8ba-a4460ea4a210" status: 200 len: 1325 microversion: 2.1 time: 0.294634 Nov 01 18:57:39.309187 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 452/954] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:57:39 2022] GET /compute/v2.1/servers/e43fa43a-f523-4438-a8ba-a4460ea4a210 => generated 1325 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:57:39.359667 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-2162163b-55aa-4478-9940-4940e3392d55 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:57:39.360400 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-2162163b-55aa-4478-9940-4940e3392d55 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] [instance: ea631032-dd04-429b-988e-e6362ea42cf7] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:57:39.371734 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-2162163b-55aa-4478-9940-4940e3392d55 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:39.372239 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-2162163b-55aa-4478-9940-4940e3392d55 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:39.373305 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-2162163b-55aa-4478-9940-4940e3392d55 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:39.374307 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-2162163b-55aa-4478-9940-4940e3392d55 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:39.375428 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-2162163b-55aa-4478-9940-4940e3392d55 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:39.376136 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-2162163b-55aa-4478-9940-4940e3392d55 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:39.526907 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-2162163b-55aa-4478-9940-4940e3392d55 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c1314c21d8547ff890ede1c2ad281c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c804370880454c7aa02cef2c2c3cf144', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:57:39.544228 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-2162163b-55aa-4478-9940-4940e3392d55 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c1314c21d8547ff890ede1c2ad281c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c804370880454c7aa02cef2c2c3cf144', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:57:39.545920 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-2162163b-55aa-4478-9940-4940e3392d55 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c1314c21d8547ff890ede1c2ad281c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c804370880454c7aa02cef2c2c3cf144', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:57:39.552291 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-2162163b-55aa-4478-9940-4940e3392d55 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] 10.222.0.13 "GET /compute/v2.1/servers/ea631032-dd04-429b-988e-e6362ea42cf7" status: 200 len: 1537 microversion: 2.91 time: 0.205991 Nov 01 18:57:39.553683 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 453/955] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 18:57:39 2022] GET /compute/v2.1/servers/ea631032-dd04-429b-988e-e6362ea42cf7 => generated 1537 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 18:57:39.561251 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-127dc2ca-9366-4379-9417-d59af54926e2 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:57:39.561874 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-127dc2ca-9366-4379-9417-d59af54926e2 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] [instance: a7f88d19-08ee-47bf-9240-7d49afd775e2] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:57:39.579918 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-127dc2ca-9366-4379-9417-d59af54926e2 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:39.580410 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-127dc2ca-9366-4379-9417-d59af54926e2 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:39.581628 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-127dc2ca-9366-4379-9417-d59af54926e2 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:39.582686 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-127dc2ca-9366-4379-9417-d59af54926e2 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:39.583301 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-127dc2ca-9366-4379-9417-d59af54926e2 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:39.583911 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-127dc2ca-9366-4379-9417-d59af54926e2 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:39.828444 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-127dc2ca-9366-4379-9417-d59af54926e2 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:57:39.839214 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-127dc2ca-9366-4379-9417-d59af54926e2 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:57:39.843239 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-127dc2ca-9366-4379-9417-d59af54926e2 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:57:39.844566 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-127dc2ca-9366-4379-9417-d59af54926e2 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] 10.222.0.13 "GET /compute/v2.1/servers/a7f88d19-08ee-47bf-9240-7d49afd775e2" status: 200 len: 1410 microversion: 2.25 time: 0.289409 Nov 01 18:57:39.861336 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 454/956] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 18:57:39 2022] GET /compute/v2.1/servers/a7f88d19-08ee-47bf-9240-7d49afd775e2 => generated 1410 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 18:57:39.870422 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [req-38a67253-b05f-4df9-8ffa-911788585c65 req-7e9b10f1-d430-4a71-8da7-e4ce42704a8d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a7f88d19-08ee-47bf-9240-7d49afd775e2", "name": "network-vif-plugged", "status": "completed", "tag": "01aee5f9-544a-4c0f-b9a3-2410eedf25a5"}]} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 18:57:39.880681 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-38a67253-b05f-4df9-8ffa-911788585c65 req-7e9b10f1-d430-4a71-8da7-e4ce42704a8d service nova] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:39.881287 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-38a67253-b05f-4df9-8ffa-911788585c65 req-7e9b10f1-d430-4a71-8da7-e4ce42704a8d service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:39.881720 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-38a67253-b05f-4df9-8ffa-911788585c65 req-7e9b10f1-d430-4a71-8da7-e4ce42704a8d service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:39.894272 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.compute.server_external_events [req-38a67253-b05f-4df9-8ffa-911788585c65 req-7e9b10f1-d430-4a71-8da7-e4ce42704a8d service nova] Creating event network-vif-plugged:01aee5f9-544a-4c0f-b9a3-2410eedf25a5 for instance a7f88d19-08ee-47bf-9240-7d49afd775e2 on n-h1-863052-2 Nov 01 18:57:39.899266 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [req-38a67253-b05f-4df9-8ffa-911788585c65 req-7e9b10f1-d430-4a71-8da7-e4ce42704a8d service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036624 Nov 01 18:57:39.900233 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 455/957] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Nov 1 18:57:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 18:57:39.905276 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-fcc528ba-49e5-4167-a342-c78c71e14ebe tempest-ServersAdmin275Test-1925739795 tempest-ServersAdmin275Test-1925739795-project-admin] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:57:39.905978 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-fcc528ba-49e5-4167-a342-c78c71e14ebe tempest-ServersAdmin275Test-1925739795 tempest-ServersAdmin275Test-1925739795-project-admin] [instance: 87679611-878a-49b2-bf8f-39e784c6d70b] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:57:39.912312 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-fcc528ba-49e5-4167-a342-c78c71e14ebe tempest-ServersAdmin275Test-1925739795 tempest-ServersAdmin275Test-1925739795-project-admin] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:39.912835 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-fcc528ba-49e5-4167-a342-c78c71e14ebe tempest-ServersAdmin275Test-1925739795 tempest-ServersAdmin275Test-1925739795-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:39.913270 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-fcc528ba-49e5-4167-a342-c78c71e14ebe tempest-ServersAdmin275Test-1925739795 tempest-ServersAdmin275Test-1925739795-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:39.913967 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-fcc528ba-49e5-4167-a342-c78c71e14ebe tempest-ServersAdmin275Test-1925739795 tempest-ServersAdmin275Test-1925739795-project-admin] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:39.914694 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-fcc528ba-49e5-4167-a342-c78c71e14ebe tempest-ServersAdmin275Test-1925739795 tempest-ServersAdmin275Test-1925739795-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:39.914843 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-fcc528ba-49e5-4167-a342-c78c71e14ebe tempest-ServersAdmin275Test-1925739795 tempest-ServersAdmin275Test-1925739795-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:39.998082 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.objects.instance [None req-fcc528ba-49e5-4167-a342-c78c71e14ebe tempest-ServersAdmin275Test-1925739795 tempest-ServersAdmin275Test-1925739795-project-admin] Lazy-loading 'services' on Instance uuid 87679611-878a-49b2-bf8f-39e784c6d70b {{(pid=121403) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 01 18:57:40.019012 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-fcc528ba-49e5-4167-a342-c78c71e14ebe tempest-ServersAdmin275Test-1925739795 tempest-ServersAdmin275Test-1925739795-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/87679611-878a-49b2-bf8f-39e784c6d70b" status: 200 len: 1929 microversion: 2.75 time: 0.116504 Nov 01 18:57:40.019880 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 456/958] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 18:57:39 2022] GET /compute/v2.1/servers/87679611-878a-49b2-bf8f-39e784c6d70b => generated 1929 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 18:57:40.039523 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-ebb0cc63-11cb-45e6-86d1-46577a4ee23c tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:57:40.039523 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-ebb0cc63-11cb-45e6-86d1-46577a4ee23c tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] [instance: 7218f99b-b011-4f08-931e-340d47069f6e] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:57:40.039523 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-ebb0cc63-11cb-45e6-86d1-46577a4ee23c tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:40.039523 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-ebb0cc63-11cb-45e6-86d1-46577a4ee23c tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:40.039922 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-ebb0cc63-11cb-45e6-86d1-46577a4ee23c tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:40.039922 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-ebb0cc63-11cb-45e6-86d1-46577a4ee23c tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:40.039922 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-ebb0cc63-11cb-45e6-86d1-46577a4ee23c tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:40.039922 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-ebb0cc63-11cb-45e6-86d1-46577a4ee23c tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:40.040258 n-d-863052-2 devstack@n-api.service[121403]: DEBUG dbcounter [-] [121403] Writing DB stats nova_cell1:SELECT=100 {{(pid=121403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 18:57:40.292727 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-ebb0cc63-11cb-45e6-86d1-46577a4ee23c tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72117f17294649d6b8bc16c66c7efab2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45d4c047d3c44324a27a27831236ab0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:57:40.306467 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-ebb0cc63-11cb-45e6-86d1-46577a4ee23c tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] 10.222.0.13 "GET /compute/v2.1/servers/7218f99b-b011-4f08-931e-340d47069f6e" status: 200 len: 1476 microversion: 2.1 time: 0.285441 Nov 01 18:57:40.323008 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 457/959] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:57:40 2022] GET /compute/v2.1/servers/7218f99b-b011-4f08-931e-340d47069f6e => generated 1476 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:57:40.341992 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-eaf7e790-0612-4d82-926e-4efc2e9ca484 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:57:40.342969 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-eaf7e790-0612-4d82-926e-4efc2e9ca484 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] [instance: e43fa43a-f523-4438-a8ba-a4460ea4a210] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:57:40.357137 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-eaf7e790-0612-4d82-926e-4efc2e9ca484 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:40.362688 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-eaf7e790-0612-4d82-926e-4efc2e9ca484 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:40.363150 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-eaf7e790-0612-4d82-926e-4efc2e9ca484 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:40.364973 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-eaf7e790-0612-4d82-926e-4efc2e9ca484 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:40.365647 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-eaf7e790-0612-4d82-926e-4efc2e9ca484 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:40.366237 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-eaf7e790-0612-4d82-926e-4efc2e9ca484 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:40.419548 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.virt.hardware [None req-0a476aae-5a3c-43f1-8b0d-21410eef8272 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Flavor limits 0:0:0 {{(pid=121402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 01 18:57:40.420670 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.virt.hardware [None req-0a476aae-5a3c-43f1-8b0d-21410eef8272 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Image limits 0:0:0 {{(pid=121402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 01 18:57:40.421337 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.virt.hardware [None req-0a476aae-5a3c-43f1-8b0d-21410eef8272 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Flavor pref 0:0:0 {{(pid=121402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 01 18:57:40.422808 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.virt.hardware [None req-0a476aae-5a3c-43f1-8b0d-21410eef8272 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Image pref 0:0:0 {{(pid=121402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 01 18:57:40.423572 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.virt.hardware [None req-0a476aae-5a3c-43f1-8b0d-21410eef8272 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 01 18:57:40.446539 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-0a476aae-5a3c-43f1-8b0d-21410eef8272 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:40.458865 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-0a476aae-5a3c-43f1-8b0d-21410eef8272 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:40.462728 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-0a476aae-5a3c-43f1-8b0d-21410eef8272 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:40.481247 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-0a476aae-5a3c-43f1-8b0d-21410eef8272 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:40.484618 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-0a476aae-5a3c-43f1-8b0d-21410eef8272 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:40.485236 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-0a476aae-5a3c-43f1-8b0d-21410eef8272 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:40.511182 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.quota [None req-0a476aae-5a3c-43f1-8b0d-21410eef8272 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Getting quotas for project 4a1bb191cff948e99c008b5e861ce4a8. Resources: {'cores', 'ram', 'instances'} {{(pid=121402) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 01 18:57:40.522972 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.quota [None req-0a476aae-5a3c-43f1-8b0d-21410eef8272 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Getting quotas for user 6a63d69c99a546f0af16329cff3ca717 and project 4a1bb191cff948e99c008b5e861ce4a8. Resources: {'cores', 'ram', 'instances'} {{(pid=121402) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 01 18:57:40.537371 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-0a476aae-5a3c-43f1-8b0d-21410eef8272 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Going to run 1 instances... {{(pid=121402) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 01 18:57:40.540454 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-0a476aae-5a3c-43f1-8b0d-21410eef8272 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] [instance: 869ca597-f199-474f-a680-59b0a75512c7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2d4a0047-1b9e-445f-8af8-1b5c9d93e881',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121402) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 01 18:57:40.552071 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-eaf7e790-0612-4d82-926e-4efc2e9ca484 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b52b7dcbb044f9bfc424e4417c77fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '708bc0ea4b5a4baf81933725792bedd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:57:40.562626 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-eaf7e790-0612-4d82-926e-4efc2e9ca484 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] 10.222.0.13 "GET /compute/v2.1/servers/e43fa43a-f523-4438-a8ba-a4460ea4a210" status: 200 len: 1325 microversion: 2.1 time: 0.229962 Nov 01 18:57:40.564123 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 458/960] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:57:40 2022] GET /compute/v2.1/servers/e43fa43a-f523-4438-a8ba-a4460ea4a210 => generated 1325 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:57:40.583687 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-c2b8aba8-040f-4320-b0f6-901cf87fd936 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:57:40.584567 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-c2b8aba8-040f-4320-b0f6-901cf87fd936 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] [instance: ea631032-dd04-429b-988e-e6362ea42cf7] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:57:40.595766 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-c2b8aba8-040f-4320-b0f6-901cf87fd936 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:40.597360 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-c2b8aba8-040f-4320-b0f6-901cf87fd936 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:40.598118 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-c2b8aba8-040f-4320-b0f6-901cf87fd936 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:40.599943 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-c2b8aba8-040f-4320-b0f6-901cf87fd936 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:40.600765 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-c2b8aba8-040f-4320-b0f6-901cf87fd936 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:40.601486 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-c2b8aba8-040f-4320-b0f6-901cf87fd936 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:40.632160 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-0a476aae-5a3c-43f1-8b0d-21410eef8272 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.792924 Nov 01 18:57:40.632858 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 503/961] 10.222.0.13 () {60 vars in 1147 bytes} [Tue Nov 1 18:57:38 2022] POST /compute/v2.1/servers => generated 383 bytes in 1795 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 01 18:57:40.650486 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-ff80dc96-02c2-497f-a556-8ccbc9309520 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:57:40.651235 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-ff80dc96-02c2-497f-a556-8ccbc9309520 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] [instance: 869ca597-f199-474f-a680-59b0a75512c7] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:57:40.688436 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-c2b8aba8-040f-4320-b0f6-901cf87fd936 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c1314c21d8547ff890ede1c2ad281c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c804370880454c7aa02cef2c2c3cf144', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:57:40.698037 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-c2b8aba8-040f-4320-b0f6-901cf87fd936 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c1314c21d8547ff890ede1c2ad281c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c804370880454c7aa02cef2c2c3cf144', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:57:40.699902 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-c2b8aba8-040f-4320-b0f6-901cf87fd936 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c1314c21d8547ff890ede1c2ad281c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c804370880454c7aa02cef2c2c3cf144', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:57:40.709209 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-c2b8aba8-040f-4320-b0f6-901cf87fd936 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] 10.222.0.13 "GET /compute/v2.1/servers/ea631032-dd04-429b-988e-e6362ea42cf7" status: 200 len: 1537 microversion: 2.91 time: 0.125922 Nov 01 18:57:40.710483 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 459/962] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 18:57:40 2022] GET /compute/v2.1/servers/ea631032-dd04-429b-988e-e6362ea42cf7 => generated 1537 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 01 18:57:40.760505 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-ff80dc96-02c2-497f-a556-8ccbc9309520 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a63d69c99a546f0af16329cff3ca717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a1bb191cff948e99c008b5e861ce4a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:57:40.769986 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-ff80dc96-02c2-497f-a556-8ccbc9309520 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] 10.222.0.13 "GET /compute/v2.1/servers/869ca597-f199-474f-a680-59b0a75512c7" status: 200 len: 1221 microversion: 2.1 time: 0.129711 Nov 01 18:57:40.771288 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 504/963] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:57:40 2022] GET /compute/v2.1/servers/869ca597-f199-474f-a680-59b0a75512c7 => generated 1221 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:57:40.878582 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-1f733863-d4d4-41a4-9eef-62f261ca88d8 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:57:40.879379 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-1f733863-d4d4-41a4-9eef-62f261ca88d8 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] [instance: a7f88d19-08ee-47bf-9240-7d49afd775e2] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:57:40.887238 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-1f733863-d4d4-41a4-9eef-62f261ca88d8 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:40.887739 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-1f733863-d4d4-41a4-9eef-62f261ca88d8 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:40.888185 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-1f733863-d4d4-41a4-9eef-62f261ca88d8 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:40.888940 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-1f733863-d4d4-41a4-9eef-62f261ca88d8 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:40.889399 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-1f733863-d4d4-41a4-9eef-62f261ca88d8 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:40.889828 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-1f733863-d4d4-41a4-9eef-62f261ca88d8 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:41.047813 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-9e055da0-aa45-4db8-8773-07497cfc5236 tempest-ServersAdmin275Test-1925739795 tempest-ServersAdmin275Test-1925739795-project-admin] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:57:41.050865 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-9e055da0-aa45-4db8-8773-07497cfc5236 tempest-ServersAdmin275Test-1925739795 tempest-ServersAdmin275Test-1925739795-project-admin] [instance: 87679611-878a-49b2-bf8f-39e784c6d70b] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:57:41.064747 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-9e055da0-aa45-4db8-8773-07497cfc5236 tempest-ServersAdmin275Test-1925739795 tempest-ServersAdmin275Test-1925739795-project-admin] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:41.068173 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-9e055da0-aa45-4db8-8773-07497cfc5236 tempest-ServersAdmin275Test-1925739795 tempest-ServersAdmin275Test-1925739795-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:41.069990 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-9e055da0-aa45-4db8-8773-07497cfc5236 tempest-ServersAdmin275Test-1925739795 tempest-ServersAdmin275Test-1925739795-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:41.071289 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-9e055da0-aa45-4db8-8773-07497cfc5236 tempest-ServersAdmin275Test-1925739795 tempest-ServersAdmin275Test-1925739795-project-admin] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:41.072385 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-9e055da0-aa45-4db8-8773-07497cfc5236 tempest-ServersAdmin275Test-1925739795 tempest-ServersAdmin275Test-1925739795-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:41.074303 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-9e055da0-aa45-4db8-8773-07497cfc5236 tempest-ServersAdmin275Test-1925739795 tempest-ServersAdmin275Test-1925739795-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:41.094568 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-1f733863-d4d4-41a4-9eef-62f261ca88d8 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:57:41.108325 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-1f733863-d4d4-41a4-9eef-62f261ca88d8 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:57:41.110726 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-1f733863-d4d4-41a4-9eef-62f261ca88d8 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:57:41.111997 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-1f733863-d4d4-41a4-9eef-62f261ca88d8 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] 10.222.0.13 "GET /compute/v2.1/servers/a7f88d19-08ee-47bf-9240-7d49afd775e2" status: 200 len: 1410 microversion: 2.25 time: 0.239510 Nov 01 18:57:41.128605 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 460/964] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 18:57:40 2022] GET /compute/v2.1/servers/a7f88d19-08ee-47bf-9240-7d49afd775e2 => generated 1410 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 18:57:41.210394 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.objects.instance [None req-9e055da0-aa45-4db8-8773-07497cfc5236 tempest-ServersAdmin275Test-1925739795 tempest-ServersAdmin275Test-1925739795-project-admin] Lazy-loading 'services' on Instance uuid 87679611-878a-49b2-bf8f-39e784c6d70b {{(pid=121402) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 01 18:57:41.244412 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-9e055da0-aa45-4db8-8773-07497cfc5236 tempest-ServersAdmin275Test-1925739795 tempest-ServersAdmin275Test-1925739795-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/87679611-878a-49b2-bf8f-39e784c6d70b" status: 200 len: 1929 microversion: 2.75 time: 0.200774 Nov 01 18:57:41.249065 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 505/965] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 18:57:41 2022] GET /compute/v2.1/servers/87679611-878a-49b2-bf8f-39e784c6d70b => generated 1929 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 18:57:41.337585 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-227b50cb-b8cc-49fd-96d2-343803267cb7 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:57:41.338365 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-227b50cb-b8cc-49fd-96d2-343803267cb7 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] [instance: 7218f99b-b011-4f08-931e-340d47069f6e] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:57:41.350797 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-227b50cb-b8cc-49fd-96d2-343803267cb7 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:41.351309 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-227b50cb-b8cc-49fd-96d2-343803267cb7 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:41.353392 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-227b50cb-b8cc-49fd-96d2-343803267cb7 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:41.354137 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-227b50cb-b8cc-49fd-96d2-343803267cb7 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:41.357197 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-227b50cb-b8cc-49fd-96d2-343803267cb7 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:41.358079 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-227b50cb-b8cc-49fd-96d2-343803267cb7 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:41.620181 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-227b50cb-b8cc-49fd-96d2-343803267cb7 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72117f17294649d6b8bc16c66c7efab2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45d4c047d3c44324a27a27831236ab0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:57:41.631009 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-227b50cb-b8cc-49fd-96d2-343803267cb7 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] 10.222.0.13 "GET /compute/v2.1/servers/7218f99b-b011-4f08-931e-340d47069f6e" status: 200 len: 1476 microversion: 2.1 time: 0.300642 Nov 01 18:57:41.631897 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 461/966] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:57:41 2022] GET /compute/v2.1/servers/7218f99b-b011-4f08-931e-340d47069f6e => generated 1476 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:57:41.637906 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-56772d94-44b8-4176-8e52-ee7524590b45 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:57:41.638818 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-56772d94-44b8-4176-8e52-ee7524590b45 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] [instance: e43fa43a-f523-4438-a8ba-a4460ea4a210] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:57:41.646634 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-56772d94-44b8-4176-8e52-ee7524590b45 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:41.647366 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-56772d94-44b8-4176-8e52-ee7524590b45 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:41.647969 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-56772d94-44b8-4176-8e52-ee7524590b45 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:41.649017 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-56772d94-44b8-4176-8e52-ee7524590b45 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:41.649636 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-56772d94-44b8-4176-8e52-ee7524590b45 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:41.650227 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-56772d94-44b8-4176-8e52-ee7524590b45 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:41.689673 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-e4bb215f-ea62-4b61-8361-b166570808d5 tempest-NetworksTest-1353345240 tempest-NetworksTest-1353345240-project-admin] Calling method '.version_select at 0x7f0ae265cb80>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:57:41.881240 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-56772d94-44b8-4176-8e52-ee7524590b45 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b52b7dcbb044f9bfc424e4417c77fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '708bc0ea4b5a4baf81933725792bedd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:57:41.889018 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-56772d94-44b8-4176-8e52-ee7524590b45 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] 10.222.0.13 "GET /compute/v2.1/servers/e43fa43a-f523-4438-a8ba-a4460ea4a210" status: 200 len: 1325 microversion: 2.1 time: 0.255590 Nov 01 18:57:41.904445 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 462/967] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:57:41 2022] GET /compute/v2.1/servers/e43fa43a-f523-4438-a8ba-a4460ea4a210 => generated 1325 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:57:41.910998 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-4ec4761d-2499-4766-ac6d-c71651700e7c tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:57:41.911714 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-4ec4761d-2499-4766-ac6d-c71651700e7c tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] [instance: ea631032-dd04-429b-988e-e6362ea42cf7] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:57:41.920510 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-4ec4761d-2499-4766-ac6d-c71651700e7c tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:41.921304 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-4ec4761d-2499-4766-ac6d-c71651700e7c tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:41.921749 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-4ec4761d-2499-4766-ac6d-c71651700e7c tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:41.922484 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-4ec4761d-2499-4766-ac6d-c71651700e7c tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:41.923018 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-4ec4761d-2499-4766-ac6d-c71651700e7c tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:41.923560 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-4ec4761d-2499-4766-ac6d-c71651700e7c tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:42.015472 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-4ec4761d-2499-4766-ac6d-c71651700e7c tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c1314c21d8547ff890ede1c2ad281c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c804370880454c7aa02cef2c2c3cf144', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:57:42.024937 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-4ec4761d-2499-4766-ac6d-c71651700e7c tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c1314c21d8547ff890ede1c2ad281c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c804370880454c7aa02cef2c2c3cf144', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:57:42.026413 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-4ec4761d-2499-4766-ac6d-c71651700e7c tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c1314c21d8547ff890ede1c2ad281c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c804370880454c7aa02cef2c2c3cf144', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:57:42.032207 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-4ec4761d-2499-4766-ac6d-c71651700e7c tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] 10.222.0.13 "GET /compute/v2.1/servers/ea631032-dd04-429b-988e-e6362ea42cf7" status: 200 len: 1537 microversion: 2.91 time: 0.126465 Nov 01 18:57:42.044781 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 463/968] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 18:57:41 2022] GET /compute/v2.1/servers/ea631032-dd04-429b-988e-e6362ea42cf7 => generated 1537 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 18:57:42.057179 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-7b847feb-8763-4c19-942c-dd652df562c2 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:57:42.057820 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-7b847feb-8763-4c19-942c-dd652df562c2 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] [instance: 869ca597-f199-474f-a680-59b0a75512c7] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:57:42.064445 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-7b847feb-8763-4c19-942c-dd652df562c2 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:42.064993 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-7b847feb-8763-4c19-942c-dd652df562c2 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:42.066274 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-7b847feb-8763-4c19-942c-dd652df562c2 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:42.066274 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-7b847feb-8763-4c19-942c-dd652df562c2 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:42.066604 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-7b847feb-8763-4c19-942c-dd652df562c2 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:42.067134 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-7b847feb-8763-4c19-942c-dd652df562c2 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:42.135004 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-e4bb215f-ea62-4b61-8361-b166570808d5 tempest-NetworksTest-1353345240 tempest-NetworksTest-1353345240-project-admin] 10.222.0.13 "GET /compute/v2.1/os-networks" status: 200 len: 6059 microversion: 2.1 time: 0.756069 Nov 01 18:57:42.136174 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 506/969] 10.222.0.13 () {58 vars in 1137 bytes} [Tue Nov 1 18:57:41 2022] GET /compute/v2.1/os-networks => generated 6059 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 18:57:42.140308 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-7b847feb-8763-4c19-942c-dd652df562c2 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a63d69c99a546f0af16329cff3ca717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a1bb191cff948e99c008b5e861ce4a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:57:42.144149 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-001b4c53-1bc0-4365-b353-d46b25924fdb tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:57:42.144923 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-001b4c53-1bc0-4365-b353-d46b25924fdb tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] [instance: a7f88d19-08ee-47bf-9240-7d49afd775e2] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:57:42.148320 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-7b847feb-8763-4c19-942c-dd652df562c2 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] 10.222.0.13 "GET /compute/v2.1/servers/869ca597-f199-474f-a680-59b0a75512c7" status: 200 len: 1273 microversion: 2.1 time: 0.097739 Nov 01 18:57:42.149127 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 464/970] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:57:42 2022] GET /compute/v2.1/servers/869ca597-f199-474f-a680-59b0a75512c7 => generated 1273 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:57:42.151170 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-001b4c53-1bc0-4365-b353-d46b25924fdb tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:42.151891 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-001b4c53-1bc0-4365-b353-d46b25924fdb tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:42.152526 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-001b4c53-1bc0-4365-b353-d46b25924fdb tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:42.153882 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-e4670c50-436a-4da2-b962-8e40aee6c401 tempest-NetworksTest-1353345240 tempest-NetworksTest-1353345240-project-admin] Calling method '.version_select at 0x7f0ae2c45550>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:57:42.154521 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-001b4c53-1bc0-4365-b353-d46b25924fdb tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:42.155180 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-001b4c53-1bc0-4365-b353-d46b25924fdb tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:42.156278 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-001b4c53-1bc0-4365-b353-d46b25924fdb tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:42.163972 n-d-863052-2 devstack@n-api.service[121402]: DEBUG dbcounter [-] [121402] Writing DB stats nova_cell1:SELECT=100 {{(pid=121402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 18:57:42.258467 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-e4670c50-436a-4da2-b962-8e40aee6c401 tempest-NetworksTest-1353345240 tempest-NetworksTest-1353345240-project-admin] 10.222.0.13 "GET /compute/v2.1/os-networks/3c6bfafa-c688-4384-8c54-de7825ea90b1" status: 200 len: 652 microversion: 2.1 time: 0.108094 Nov 01 18:57:42.259139 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 465/971] 10.222.0.13 () {58 vars in 1248 bytes} [Tue Nov 1 18:57:42 2022] GET /compute/v2.1/os-networks/3c6bfafa-c688-4384-8c54-de7825ea90b1 => generated 652 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 18:57:42.267860 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-65f54715-cd1d-4568-8069-b49512201388 tempest-NetworksTest-1353345240 tempest-NetworksTest-1353345240-project-admin] Calling method '.version_select at 0x7f0ae282ac10>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:57:42.412446 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-65f54715-cd1d-4568-8069-b49512201388 tempest-NetworksTest-1353345240 tempest-NetworksTest-1353345240-project-admin] 10.222.0.13 "GET /compute/v2.1/os-networks" status: 200 len: 6059 microversion: 2.1 time: 0.147971 Nov 01 18:57:42.414246 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 466/972] 10.222.0.13 () {58 vars in 1137 bytes} [Tue Nov 1 18:57:42 2022] GET /compute/v2.1/os-networks => generated 6059 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 18:57:42.421473 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-fa8ec2f1-9172-40f3-9271-db28bd7bb941 tempest-ServersAdmin275Test-1925739795 tempest-ServersAdmin275Test-1925739795-project-admin] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:57:42.422450 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-fa8ec2f1-9172-40f3-9271-db28bd7bb941 tempest-ServersAdmin275Test-1925739795 tempest-ServersAdmin275Test-1925739795-project-admin] [instance: 87679611-878a-49b2-bf8f-39e784c6d70b] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:57:42.430993 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-fa8ec2f1-9172-40f3-9271-db28bd7bb941 tempest-ServersAdmin275Test-1925739795 tempest-ServersAdmin275Test-1925739795-project-admin] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:42.431985 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-fa8ec2f1-9172-40f3-9271-db28bd7bb941 tempest-ServersAdmin275Test-1925739795 tempest-ServersAdmin275Test-1925739795-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:42.432653 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-fa8ec2f1-9172-40f3-9271-db28bd7bb941 tempest-ServersAdmin275Test-1925739795 tempest-ServersAdmin275Test-1925739795-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:42.433420 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-fa8ec2f1-9172-40f3-9271-db28bd7bb941 tempest-ServersAdmin275Test-1925739795 tempest-ServersAdmin275Test-1925739795-project-admin] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:42.434061 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-fa8ec2f1-9172-40f3-9271-db28bd7bb941 tempest-ServersAdmin275Test-1925739795 tempest-ServersAdmin275Test-1925739795-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:42.434694 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-fa8ec2f1-9172-40f3-9271-db28bd7bb941 tempest-ServersAdmin275Test-1925739795 tempest-ServersAdmin275Test-1925739795-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:42.444711 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-001b4c53-1bc0-4365-b353-d46b25924fdb tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:57:42.454348 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-001b4c53-1bc0-4365-b353-d46b25924fdb tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:57:42.461107 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-001b4c53-1bc0-4365-b353-d46b25924fdb tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:57:42.463012 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-001b4c53-1bc0-4365-b353-d46b25924fdb tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] 10.222.0.13 "GET /compute/v2.1/servers/a7f88d19-08ee-47bf-9240-7d49afd775e2" status: 200 len: 1605 microversion: 2.25 time: 0.323464 Nov 01 18:57:42.476606 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 507/973] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 18:57:42 2022] GET /compute/v2.1/servers/a7f88d19-08ee-47bf-9240-7d49afd775e2 => generated 1605 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 18:57:42.498572 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-8e8ea108-eba2-4d97-b5cb-acaabbdd0f7f tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:57:42.499005 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-8e8ea108-eba2-4d97-b5cb-acaabbdd0f7f tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] [instance: a7f88d19-08ee-47bf-9240-7d49afd775e2] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:57:42.521113 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-8e8ea108-eba2-4d97-b5cb-acaabbdd0f7f tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:42.522227 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-8e8ea108-eba2-4d97-b5cb-acaabbdd0f7f tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:42.522814 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-8e8ea108-eba2-4d97-b5cb-acaabbdd0f7f tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:42.528231 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-8e8ea108-eba2-4d97-b5cb-acaabbdd0f7f tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:42.529794 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-8e8ea108-eba2-4d97-b5cb-acaabbdd0f7f tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:42.531080 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-8e8ea108-eba2-4d97-b5cb-acaabbdd0f7f tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:42.604354 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.objects.instance [None req-fa8ec2f1-9172-40f3-9271-db28bd7bb941 tempest-ServersAdmin275Test-1925739795 tempest-ServersAdmin275Test-1925739795-project-admin] Lazy-loading 'services' on Instance uuid 87679611-878a-49b2-bf8f-39e784c6d70b {{(pid=121403) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 01 18:57:42.625365 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-fa8ec2f1-9172-40f3-9271-db28bd7bb941 tempest-ServersAdmin275Test-1925739795 tempest-ServersAdmin275Test-1925739795-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/87679611-878a-49b2-bf8f-39e784c6d70b" status: 200 len: 1929 microversion: 2.75 time: 0.209487 Nov 01 18:57:42.626192 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 467/974] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 18:57:42 2022] GET /compute/v2.1/servers/87679611-878a-49b2-bf8f-39e784c6d70b => generated 1929 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 18:57:42.657889 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-d29e528a-74df-47a8-994d-3978be6dc17a tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:57:42.658587 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-d29e528a-74df-47a8-994d-3978be6dc17a tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] [instance: 7218f99b-b011-4f08-931e-340d47069f6e] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:57:42.662355 n-d-863052-2 devstack@n-api.service[121403]: DEBUG dbcounter [-] [121403] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=121403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 18:57:42.676894 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d29e528a-74df-47a8-994d-3978be6dc17a tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:42.677823 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d29e528a-74df-47a8-994d-3978be6dc17a tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:42.679028 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d29e528a-74df-47a8-994d-3978be6dc17a tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:42.679971 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d29e528a-74df-47a8-994d-3978be6dc17a tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:42.680539 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d29e528a-74df-47a8-994d-3978be6dc17a tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:42.681086 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d29e528a-74df-47a8-994d-3978be6dc17a tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:42.799731 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-8e8ea108-eba2-4d97-b5cb-acaabbdd0f7f tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] 10.222.0.13 "GET /compute/v2.1/servers/a7f88d19-08ee-47bf-9240-7d49afd775e2/os-interface" status: 200 len: 284 microversion: 2.25 time: 0.312784 Nov 01 18:57:42.808303 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 508/975] 10.222.0.13 () {60 vars in 1316 bytes} [Tue Nov 1 18:57:42 2022] GET /compute/v2.1/servers/a7f88d19-08ee-47bf-9240-7d49afd775e2/os-interface => generated 284 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 01 18:57:42.911416 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-9df9900b-3155-4a88-b68b-c4d023e95203 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:57:42.912038 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-9df9900b-3155-4a88-b68b-c4d023e95203 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] [instance: e43fa43a-f523-4438-a8ba-a4460ea4a210] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:57:42.918174 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-9df9900b-3155-4a88-b68b-c4d023e95203 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:42.918936 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-9df9900b-3155-4a88-b68b-c4d023e95203 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:42.919551 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-9df9900b-3155-4a88-b68b-c4d023e95203 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:42.920254 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-9df9900b-3155-4a88-b68b-c4d023e95203 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:42.920906 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-9df9900b-3155-4a88-b68b-c4d023e95203 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:42.921333 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-9df9900b-3155-4a88-b68b-c4d023e95203 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:42.951594 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-d29e528a-74df-47a8-994d-3978be6dc17a tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72117f17294649d6b8bc16c66c7efab2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45d4c047d3c44324a27a27831236ab0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:57:42.967939 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-d29e528a-74df-47a8-994d-3978be6dc17a tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] 10.222.0.13 "GET /compute/v2.1/servers/7218f99b-b011-4f08-931e-340d47069f6e" status: 200 len: 1476 microversion: 2.1 time: 0.315335 Nov 01 18:57:42.968731 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 468/976] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:57:42 2022] GET /compute/v2.1/servers/7218f99b-b011-4f08-931e-340d47069f6e => generated 1476 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:57:43.064515 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-6f348c6e-b678-47a6-b032-dff241197c1b tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:57:43.067190 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-6f348c6e-b678-47a6-b032-dff241197c1b tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] [instance: ea631032-dd04-429b-988e-e6362ea42cf7] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:57:43.076342 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-6f348c6e-b678-47a6-b032-dff241197c1b tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:43.077390 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-6f348c6e-b678-47a6-b032-dff241197c1b tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:43.078002 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-6f348c6e-b678-47a6-b032-dff241197c1b tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:43.078888 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-6f348c6e-b678-47a6-b032-dff241197c1b tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:43.079512 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-6f348c6e-b678-47a6-b032-dff241197c1b tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:43.080104 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-6f348c6e-b678-47a6-b032-dff241197c1b tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:43.181795 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-6f348c6e-b678-47a6-b032-dff241197c1b tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c1314c21d8547ff890ede1c2ad281c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c804370880454c7aa02cef2c2c3cf144', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:57:43.191817 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-6f348c6e-b678-47a6-b032-dff241197c1b tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c1314c21d8547ff890ede1c2ad281c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c804370880454c7aa02cef2c2c3cf144', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:57:43.193312 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-6f348c6e-b678-47a6-b032-dff241197c1b tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c1314c21d8547ff890ede1c2ad281c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c804370880454c7aa02cef2c2c3cf144', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:57:43.198486 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-6f348c6e-b678-47a6-b032-dff241197c1b tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] 10.222.0.13 "GET /compute/v2.1/servers/ea631032-dd04-429b-988e-e6362ea42cf7" status: 200 len: 1537 microversion: 2.91 time: 0.140124 Nov 01 18:57:43.199323 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 469/977] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 18:57:43 2022] GET /compute/v2.1/servers/ea631032-dd04-429b-988e-e6362ea42cf7 => generated 1537 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 01 18:57:43.224447 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-601194ba-166d-4dfa-9ea1-5ee29ad4cba3 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:57:43.225160 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-601194ba-166d-4dfa-9ea1-5ee29ad4cba3 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] [instance: 869ca597-f199-474f-a680-59b0a75512c7] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:57:43.232187 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-601194ba-166d-4dfa-9ea1-5ee29ad4cba3 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:43.232717 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-601194ba-166d-4dfa-9ea1-5ee29ad4cba3 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:43.233160 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-601194ba-166d-4dfa-9ea1-5ee29ad4cba3 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:43.233955 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-601194ba-166d-4dfa-9ea1-5ee29ad4cba3 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:43.234487 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-601194ba-166d-4dfa-9ea1-5ee29ad4cba3 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:43.234923 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-601194ba-166d-4dfa-9ea1-5ee29ad4cba3 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:43.387029 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-601194ba-166d-4dfa-9ea1-5ee29ad4cba3 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a63d69c99a546f0af16329cff3ca717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a1bb191cff948e99c008b5e861ce4a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:57:43.395710 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-601194ba-166d-4dfa-9ea1-5ee29ad4cba3 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] 10.222.0.13 "GET /compute/v2.1/servers/869ca597-f199-474f-a680-59b0a75512c7" status: 200 len: 1279 microversion: 2.1 time: 0.177215 Nov 01 18:57:43.396636 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 470/978] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:57:43 2022] GET /compute/v2.1/servers/869ca597-f199-474f-a680-59b0a75512c7 => generated 1279 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:57:43.551090 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-9df9900b-3155-4a88-b68b-c4d023e95203 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b52b7dcbb044f9bfc424e4417c77fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '708bc0ea4b5a4baf81933725792bedd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:57:43.573127 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-9df9900b-3155-4a88-b68b-c4d023e95203 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] 10.222.0.13 "GET /compute/v2.1/servers/e43fa43a-f523-4438-a8ba-a4460ea4a210" status: 200 len: 1325 microversion: 2.1 time: 0.663279 Nov 01 18:57:43.575193 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 509/979] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:57:42 2022] GET /compute/v2.1/servers/e43fa43a-f523-4438-a8ba-a4460ea4a210 => generated 1325 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 18:57:43.657175 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-1c6516dc-58a4-480e-856e-5df2241f5a0b tempest-ServersAdmin275Test-1925739795 tempest-ServersAdmin275Test-1925739795-project-admin] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:57:43.658347 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-1c6516dc-58a4-480e-856e-5df2241f5a0b tempest-ServersAdmin275Test-1925739795 tempest-ServersAdmin275Test-1925739795-project-admin] [instance: 87679611-878a-49b2-bf8f-39e784c6d70b] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:57:43.668069 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-1c6516dc-58a4-480e-856e-5df2241f5a0b tempest-ServersAdmin275Test-1925739795 tempest-ServersAdmin275Test-1925739795-project-admin] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:43.668558 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-1c6516dc-58a4-480e-856e-5df2241f5a0b tempest-ServersAdmin275Test-1925739795 tempest-ServersAdmin275Test-1925739795-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:43.669022 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-1c6516dc-58a4-480e-856e-5df2241f5a0b tempest-ServersAdmin275Test-1925739795 tempest-ServersAdmin275Test-1925739795-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:43.669724 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-1c6516dc-58a4-480e-856e-5df2241f5a0b tempest-ServersAdmin275Test-1925739795 tempest-ServersAdmin275Test-1925739795-project-admin] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:43.670174 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-1c6516dc-58a4-480e-856e-5df2241f5a0b tempest-ServersAdmin275Test-1925739795 tempest-ServersAdmin275Test-1925739795-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:43.671116 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-1c6516dc-58a4-480e-856e-5df2241f5a0b tempest-ServersAdmin275Test-1925739795 tempest-ServersAdmin275Test-1925739795-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:43.907427 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.objects.instance [None req-1c6516dc-58a4-480e-856e-5df2241f5a0b tempest-ServersAdmin275Test-1925739795 tempest-ServersAdmin275Test-1925739795-project-admin] Lazy-loading 'services' on Instance uuid 87679611-878a-49b2-bf8f-39e784c6d70b {{(pid=121403) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 01 18:57:43.943375 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-1c6516dc-58a4-480e-856e-5df2241f5a0b tempest-ServersAdmin275Test-1925739795 tempest-ServersAdmin275Test-1925739795-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/87679611-878a-49b2-bf8f-39e784c6d70b" status: 200 len: 1929 microversion: 2.75 time: 0.289826 Nov 01 18:57:43.944289 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 471/980] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 18:57:43 2022] GET /compute/v2.1/servers/87679611-878a-49b2-bf8f-39e784c6d70b => generated 1929 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 18:57:43.997435 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-67b270f4-5294-42e4-989a-656557ff52c3 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:57:43.998047 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-67b270f4-5294-42e4-989a-656557ff52c3 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] [instance: 7218f99b-b011-4f08-931e-340d47069f6e] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:57:44.009067 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-67b270f4-5294-42e4-989a-656557ff52c3 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:44.009564 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-67b270f4-5294-42e4-989a-656557ff52c3 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:44.010003 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-67b270f4-5294-42e4-989a-656557ff52c3 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:44.010800 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-67b270f4-5294-42e4-989a-656557ff52c3 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:44.011308 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-67b270f4-5294-42e4-989a-656557ff52c3 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:44.015921 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-67b270f4-5294-42e4-989a-656557ff52c3 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:44.048256 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [req-2a10ca8b-1ed6-41b9-9bf3-52ed0f5f4cb9 req-c92cc611-1137-4520-9822-8937c37535bc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ed4798be-a45e-46f5-8f7e-1165f6479bd1", "tag": "0dfdc28e-1bcb-444f-bd33-acd74444c684"}]} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 18:57:44.068817 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-2a10ca8b-1ed6-41b9-9bf3-52ed0f5f4cb9 req-c92cc611-1137-4520-9822-8937c37535bc service nova] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:44.070493 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-2a10ca8b-1ed6-41b9-9bf3-52ed0f5f4cb9 req-c92cc611-1137-4520-9822-8937c37535bc service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:44.072171 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-2a10ca8b-1ed6-41b9-9bf3-52ed0f5f4cb9 req-c92cc611-1137-4520-9822-8937c37535bc service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:44.089230 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.compute.server_external_events [req-2a10ca8b-1ed6-41b9-9bf3-52ed0f5f4cb9 req-c92cc611-1137-4520-9822-8937c37535bc service nova] Creating event network-changed:0dfdc28e-1bcb-444f-bd33-acd74444c684 for instance ed4798be-a45e-46f5-8f7e-1165f6479bd1 on n-h1-863052-2 Nov 01 18:57:44.096823 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [req-2a10ca8b-1ed6-41b9-9bf3-52ed0f5f4cb9 req-c92cc611-1137-4520-9822-8937c37535bc service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054767 Nov 01 18:57:44.097885 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 472/981] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Nov 1 18:57:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 18:57:44.230846 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-02e58c56-1b41-4049-ae0a-3e21f104462d tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:57:44.231556 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-02e58c56-1b41-4049-ae0a-3e21f104462d tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] [instance: ea631032-dd04-429b-988e-e6362ea42cf7] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:57:44.238649 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-02e58c56-1b41-4049-ae0a-3e21f104462d tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:44.239149 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-02e58c56-1b41-4049-ae0a-3e21f104462d tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:44.239588 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-02e58c56-1b41-4049-ae0a-3e21f104462d tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:44.240630 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-02e58c56-1b41-4049-ae0a-3e21f104462d tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:44.241238 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-02e58c56-1b41-4049-ae0a-3e21f104462d tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:44.241238 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-02e58c56-1b41-4049-ae0a-3e21f104462d tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:44.343418 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-02e58c56-1b41-4049-ae0a-3e21f104462d tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c1314c21d8547ff890ede1c2ad281c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c804370880454c7aa02cef2c2c3cf144', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:57:44.357005 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-02e58c56-1b41-4049-ae0a-3e21f104462d tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c1314c21d8547ff890ede1c2ad281c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c804370880454c7aa02cef2c2c3cf144', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:57:44.358693 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-02e58c56-1b41-4049-ae0a-3e21f104462d tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c1314c21d8547ff890ede1c2ad281c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c804370880454c7aa02cef2c2c3cf144', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:57:44.365868 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-02e58c56-1b41-4049-ae0a-3e21f104462d tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] 10.222.0.13 "GET /compute/v2.1/servers/ea631032-dd04-429b-988e-e6362ea42cf7" status: 200 len: 1537 microversion: 2.91 time: 0.139334 Nov 01 18:57:44.366856 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 473/982] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 18:57:44 2022] GET /compute/v2.1/servers/ea631032-dd04-429b-988e-e6362ea42cf7 => generated 1537 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 01 18:57:44.420397 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-f0202ceb-abf7-43aa-837f-9a875bc2d288 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:57:44.420979 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-f0202ceb-abf7-43aa-837f-9a875bc2d288 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] [instance: 869ca597-f199-474f-a680-59b0a75512c7] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:57:44.428127 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f0202ceb-abf7-43aa-837f-9a875bc2d288 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:44.428639 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f0202ceb-abf7-43aa-837f-9a875bc2d288 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:44.429079 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f0202ceb-abf7-43aa-837f-9a875bc2d288 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:44.429778 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f0202ceb-abf7-43aa-837f-9a875bc2d288 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:44.430382 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f0202ceb-abf7-43aa-837f-9a875bc2d288 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:44.430652 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f0202ceb-abf7-43aa-837f-9a875bc2d288 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:44.442323 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-67b270f4-5294-42e4-989a-656557ff52c3 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72117f17294649d6b8bc16c66c7efab2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45d4c047d3c44324a27a27831236ab0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:57:44.450746 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-67b270f4-5294-42e4-989a-656557ff52c3 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] 10.222.0.13 "GET /compute/v2.1/servers/7218f99b-b011-4f08-931e-340d47069f6e" status: 200 len: 1476 microversion: 2.1 time: 0.463243 Nov 01 18:57:44.460769 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 510/983] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:57:43 2022] GET /compute/v2.1/servers/7218f99b-b011-4f08-931e-340d47069f6e => generated 1476 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:57:44.603203 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-513f1fb8-7869-40db-8297-a58ea0332a2c tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:57:44.603973 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-513f1fb8-7869-40db-8297-a58ea0332a2c tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] [instance: e43fa43a-f523-4438-a8ba-a4460ea4a210] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:57:44.612506 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-513f1fb8-7869-40db-8297-a58ea0332a2c tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:44.613277 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-513f1fb8-7869-40db-8297-a58ea0332a2c tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:44.613811 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-513f1fb8-7869-40db-8297-a58ea0332a2c tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:44.614619 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-513f1fb8-7869-40db-8297-a58ea0332a2c tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:44.615551 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-513f1fb8-7869-40db-8297-a58ea0332a2c tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:44.616077 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-513f1fb8-7869-40db-8297-a58ea0332a2c tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:44.723540 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-f0202ceb-abf7-43aa-837f-9a875bc2d288 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a63d69c99a546f0af16329cff3ca717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a1bb191cff948e99c008b5e861ce4a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:57:44.733826 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-f0202ceb-abf7-43aa-837f-9a875bc2d288 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] 10.222.0.13 "GET /compute/v2.1/servers/869ca597-f199-474f-a680-59b0a75512c7" status: 200 len: 1321 microversion: 2.1 time: 0.316237 Nov 01 18:57:44.735137 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 474/984] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:57:44 2022] GET /compute/v2.1/servers/869ca597-f199-474f-a680-59b0a75512c7 => generated 1321 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 18:57:44.975442 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-99963cac-8126-4a56-a957-b2446522db8f tempest-ServersAdmin275Test-1925739795 tempest-ServersAdmin275Test-1925739795-project-admin] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:57:44.976738 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-99963cac-8126-4a56-a957-b2446522db8f tempest-ServersAdmin275Test-1925739795 tempest-ServersAdmin275Test-1925739795-project-admin] [instance: 87679611-878a-49b2-bf8f-39e784c6d70b] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:57:44.983378 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-99963cac-8126-4a56-a957-b2446522db8f tempest-ServersAdmin275Test-1925739795 tempest-ServersAdmin275Test-1925739795-project-admin] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:44.984181 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-99963cac-8126-4a56-a957-b2446522db8f tempest-ServersAdmin275Test-1925739795 tempest-ServersAdmin275Test-1925739795-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:44.984674 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-99963cac-8126-4a56-a957-b2446522db8f tempest-ServersAdmin275Test-1925739795 tempest-ServersAdmin275Test-1925739795-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:44.985338 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-99963cac-8126-4a56-a957-b2446522db8f tempest-ServersAdmin275Test-1925739795 tempest-ServersAdmin275Test-1925739795-project-admin] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:44.985936 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-99963cac-8126-4a56-a957-b2446522db8f tempest-ServersAdmin275Test-1925739795 tempest-ServersAdmin275Test-1925739795-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:44.986952 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-99963cac-8126-4a56-a957-b2446522db8f tempest-ServersAdmin275Test-1925739795 tempest-ServersAdmin275Test-1925739795-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:45.005595 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-513f1fb8-7869-40db-8297-a58ea0332a2c tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b52b7dcbb044f9bfc424e4417c77fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '708bc0ea4b5a4baf81933725792bedd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:57:45.025610 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-513f1fb8-7869-40db-8297-a58ea0332a2c tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] 10.222.0.13 "GET /compute/v2.1/servers/e43fa43a-f523-4438-a8ba-a4460ea4a210" status: 200 len: 1325 microversion: 2.1 time: 0.427196 Nov 01 18:57:45.026524 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 511/985] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:57:44 2022] GET /compute/v2.1/servers/e43fa43a-f523-4438-a8ba-a4460ea4a210 => generated 1325 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 18:57:45.045732 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [req-544a504b-f387-494f-b0c2-d4bf8bc1dbc4 req-a58f2935-e07b-4ee4-bb42-1d5d7e05bfd0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "869ca597-f199-474f-a680-59b0a75512c7", "tag": "97110a86-c3fd-48ee-9f17-518284b372d0"}]} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 18:57:45.055792 n-d-863052-2 devstack@n-api.service[121402]: DEBUG dbcounter [-] [121402] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=121402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 18:57:45.058255 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-544a504b-f387-494f-b0c2-d4bf8bc1dbc4 req-a58f2935-e07b-4ee4-bb42-1d5d7e05bfd0 service nova] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:45.058904 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-544a504b-f387-494f-b0c2-d4bf8bc1dbc4 req-a58f2935-e07b-4ee4-bb42-1d5d7e05bfd0 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:45.059730 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-544a504b-f387-494f-b0c2-d4bf8bc1dbc4 req-a58f2935-e07b-4ee4-bb42-1d5d7e05bfd0 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:45.079086 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.compute.server_external_events [req-544a504b-f387-494f-b0c2-d4bf8bc1dbc4 req-a58f2935-e07b-4ee4-bb42-1d5d7e05bfd0 service nova] Creating event network-changed:97110a86-c3fd-48ee-9f17-518284b372d0 for instance 869ca597-f199-474f-a680-59b0a75512c7 on n-h2-863052-2 Nov 01 18:57:45.086632 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [req-544a504b-f387-494f-b0c2-d4bf8bc1dbc4 req-a58f2935-e07b-4ee4-bb42-1d5d7e05bfd0 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058515 Nov 01 18:57:45.087767 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 512/986] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Nov 1 18:57:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 18:57:45.140100 n-d-863052-2 devstack@n-api.service[121403]: DEBUG dbcounter [-] [121403] Writing DB stats nova_cell1:SELECT=100 {{(pid=121403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 18:57:45.149439 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.objects.instance [None req-99963cac-8126-4a56-a957-b2446522db8f tempest-ServersAdmin275Test-1925739795 tempest-ServersAdmin275Test-1925739795-project-admin] Lazy-loading 'services' on Instance uuid 87679611-878a-49b2-bf8f-39e784c6d70b {{(pid=121403) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 01 18:57:45.179854 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-99963cac-8126-4a56-a957-b2446522db8f tempest-ServersAdmin275Test-1925739795 tempest-ServersAdmin275Test-1925739795-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/87679611-878a-49b2-bf8f-39e784c6d70b" status: 200 len: 1929 microversion: 2.75 time: 0.210294 Nov 01 18:57:45.180791 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 475/987] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 18:57:44 2022] GET /compute/v2.1/servers/87679611-878a-49b2-bf8f-39e784c6d70b => generated 1929 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 18:57:45.400094 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-cd00c8fc-c5eb-4403-954b-1fc13b525ac3 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:57:45.400933 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-cd00c8fc-c5eb-4403-954b-1fc13b525ac3 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] [instance: ea631032-dd04-429b-988e-e6362ea42cf7] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:57:45.408127 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-cd00c8fc-c5eb-4403-954b-1fc13b525ac3 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:45.409063 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-cd00c8fc-c5eb-4403-954b-1fc13b525ac3 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:45.409724 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-cd00c8fc-c5eb-4403-954b-1fc13b525ac3 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:45.410920 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-cd00c8fc-c5eb-4403-954b-1fc13b525ac3 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:45.412005 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-cd00c8fc-c5eb-4403-954b-1fc13b525ac3 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:45.412713 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-cd00c8fc-c5eb-4403-954b-1fc13b525ac3 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:45.475977 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-25398925-5744-4d24-a629-cdc5c465b0b7 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:57:45.476574 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-25398925-5744-4d24-a629-cdc5c465b0b7 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] [instance: 7218f99b-b011-4f08-931e-340d47069f6e] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:57:45.483497 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-25398925-5744-4d24-a629-cdc5c465b0b7 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:45.483991 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-25398925-5744-4d24-a629-cdc5c465b0b7 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:45.484424 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-25398925-5744-4d24-a629-cdc5c465b0b7 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:45.485155 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-25398925-5744-4d24-a629-cdc5c465b0b7 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:45.485609 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-25398925-5744-4d24-a629-cdc5c465b0b7 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:45.486029 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-25398925-5744-4d24-a629-cdc5c465b0b7 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:45.514610 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-cd00c8fc-c5eb-4403-954b-1fc13b525ac3 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c1314c21d8547ff890ede1c2ad281c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c804370880454c7aa02cef2c2c3cf144', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:57:45.551072 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-cd00c8fc-c5eb-4403-954b-1fc13b525ac3 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c1314c21d8547ff890ede1c2ad281c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c804370880454c7aa02cef2c2c3cf144', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:57:45.568379 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-cd00c8fc-c5eb-4403-954b-1fc13b525ac3 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c1314c21d8547ff890ede1c2ad281c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c804370880454c7aa02cef2c2c3cf144', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:57:45.579716 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-cd00c8fc-c5eb-4403-954b-1fc13b525ac3 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] 10.222.0.13 "GET /compute/v2.1/servers/ea631032-dd04-429b-988e-e6362ea42cf7" status: 200 len: 1537 microversion: 2.91 time: 0.185694 Nov 01 18:57:45.585639 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 513/988] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 18:57:45 2022] GET /compute/v2.1/servers/ea631032-dd04-429b-988e-e6362ea42cf7 => generated 1537 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 18:57:45.758980 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-f580b9dd-30d9-4013-baac-e7a8fb950f9c tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:57:45.759632 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-f580b9dd-30d9-4013-baac-e7a8fb950f9c tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] [instance: 869ca597-f199-474f-a680-59b0a75512c7] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:57:45.770855 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f580b9dd-30d9-4013-baac-e7a8fb950f9c tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:45.773058 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f580b9dd-30d9-4013-baac-e7a8fb950f9c tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:45.773704 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f580b9dd-30d9-4013-baac-e7a8fb950f9c tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:45.774736 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f580b9dd-30d9-4013-baac-e7a8fb950f9c tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:45.777223 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f580b9dd-30d9-4013-baac-e7a8fb950f9c tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:45.778498 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f580b9dd-30d9-4013-baac-e7a8fb950f9c tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:46.055932 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-25398925-5744-4d24-a629-cdc5c465b0b7 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72117f17294649d6b8bc16c66c7efab2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45d4c047d3c44324a27a27831236ab0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:57:46.067948 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-25398925-5744-4d24-a629-cdc5c465b0b7 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] 10.222.0.13 "GET /compute/v2.1/servers/7218f99b-b011-4f08-931e-340d47069f6e" status: 200 len: 1476 microversion: 2.1 time: 0.595706 Nov 01 18:57:46.069186 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 476/989] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:57:45 2022] GET /compute/v2.1/servers/7218f99b-b011-4f08-931e-340d47069f6e => generated 1476 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:57:46.074680 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [req-4ed40aa9-9b26-4ad0-9705-c143bd89711b req-aa9a804f-adf3-4a07-b580-01173cdf7ca3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e43fa43a-f523-4438-a8ba-a4460ea4a210", "name": "network-vif-plugged", "status": "completed", "tag": "9f4a6ee5-6fd1-413d-8d9e-aa1c5b8782b3"}]} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 18:57:46.088690 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-4ed40aa9-9b26-4ad0-9705-c143bd89711b req-aa9a804f-adf3-4a07-b580-01173cdf7ca3 service nova] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:46.089552 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-4ed40aa9-9b26-4ad0-9705-c143bd89711b req-aa9a804f-adf3-4a07-b580-01173cdf7ca3 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:46.090816 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-4ed40aa9-9b26-4ad0-9705-c143bd89711b req-aa9a804f-adf3-4a07-b580-01173cdf7ca3 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:46.104741 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.compute.server_external_events [req-4ed40aa9-9b26-4ad0-9705-c143bd89711b req-aa9a804f-adf3-4a07-b580-01173cdf7ca3 service nova] Creating event network-vif-plugged:9f4a6ee5-6fd1-413d-8d9e-aa1c5b8782b3 for instance e43fa43a-f523-4438-a8ba-a4460ea4a210 on n-h2-863052-2 Nov 01 18:57:46.111842 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [req-4ed40aa9-9b26-4ad0-9705-c143bd89711b req-aa9a804f-adf3-4a07-b580-01173cdf7ca3 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041027 Nov 01 18:57:46.112984 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 477/990] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Nov 1 18:57:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 18:57:46.121122 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-f580b9dd-30d9-4013-baac-e7a8fb950f9c tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a63d69c99a546f0af16329cff3ca717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a1bb191cff948e99c008b5e861ce4a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:57:46.126850 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-f2b1a666-6c75-4877-866c-dec32c40021e tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:57:46.127615 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-f2b1a666-6c75-4877-866c-dec32c40021e tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] [instance: e43fa43a-f523-4438-a8ba-a4460ea4a210] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:57:46.132495 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-f580b9dd-30d9-4013-baac-e7a8fb950f9c tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] 10.222.0.13 "GET /compute/v2.1/servers/869ca597-f199-474f-a680-59b0a75512c7" status: 200 len: 1321 microversion: 2.1 time: 0.380080 Nov 01 18:57:46.133432 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 514/991] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:57:45 2022] GET /compute/v2.1/servers/869ca597-f199-474f-a680-59b0a75512c7 => generated 1321 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 18:57:46.137822 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [req-3e2fbb3a-f0c3-4cf7-b240-bd8ac6f46007 req-1250412f-9577-4f1c-b3fc-0ef02705b1de service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a7f88d19-08ee-47bf-9240-7d49afd775e2", "tag": "01aee5f9-544a-4c0f-b9a3-2410eedf25a5"}]} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 18:57:46.148093 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f2b1a666-6c75-4877-866c-dec32c40021e tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:46.149211 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f2b1a666-6c75-4877-866c-dec32c40021e tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:46.149674 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f2b1a666-6c75-4877-866c-dec32c40021e tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:46.150383 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f2b1a666-6c75-4877-866c-dec32c40021e tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:46.150837 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f2b1a666-6c75-4877-866c-dec32c40021e tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:46.151261 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f2b1a666-6c75-4877-866c-dec32c40021e tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:46.163707 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-3e2fbb3a-f0c3-4cf7-b240-bd8ac6f46007 req-1250412f-9577-4f1c-b3fc-0ef02705b1de service nova] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:46.164502 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-3e2fbb3a-f0c3-4cf7-b240-bd8ac6f46007 req-1250412f-9577-4f1c-b3fc-0ef02705b1de service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:46.165016 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-3e2fbb3a-f0c3-4cf7-b240-bd8ac6f46007 req-1250412f-9577-4f1c-b3fc-0ef02705b1de service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:46.178140 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.compute.server_external_events [req-3e2fbb3a-f0c3-4cf7-b240-bd8ac6f46007 req-1250412f-9577-4f1c-b3fc-0ef02705b1de service nova] Creating event network-changed:01aee5f9-544a-4c0f-b9a3-2410eedf25a5 for instance a7f88d19-08ee-47bf-9240-7d49afd775e2 on n-h1-863052-2 Nov 01 18:57:46.184622 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [req-3e2fbb3a-f0c3-4cf7-b240-bd8ac6f46007 req-1250412f-9577-4f1c-b3fc-0ef02705b1de service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050024 Nov 01 18:57:46.185800 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 515/992] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Nov 1 18:57:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 18:57:46.210021 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-e2ca11dd-bf84-4360-9590-74bbc505d707 tempest-ServersAdmin275Test-1925739795 tempest-ServersAdmin275Test-1925739795-project-admin] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:57:46.211150 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-e2ca11dd-bf84-4360-9590-74bbc505d707 tempest-ServersAdmin275Test-1925739795 tempest-ServersAdmin275Test-1925739795-project-admin] [instance: 87679611-878a-49b2-bf8f-39e784c6d70b] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:57:46.218465 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e2ca11dd-bf84-4360-9590-74bbc505d707 tempest-ServersAdmin275Test-1925739795 tempest-ServersAdmin275Test-1925739795-project-admin] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:46.219318 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e2ca11dd-bf84-4360-9590-74bbc505d707 tempest-ServersAdmin275Test-1925739795 tempest-ServersAdmin275Test-1925739795-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:46.219942 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e2ca11dd-bf84-4360-9590-74bbc505d707 tempest-ServersAdmin275Test-1925739795 tempest-ServersAdmin275Test-1925739795-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:46.220937 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e2ca11dd-bf84-4360-9590-74bbc505d707 tempest-ServersAdmin275Test-1925739795 tempest-ServersAdmin275Test-1925739795-project-admin] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:46.221747 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e2ca11dd-bf84-4360-9590-74bbc505d707 tempest-ServersAdmin275Test-1925739795 tempest-ServersAdmin275Test-1925739795-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:46.222187 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e2ca11dd-bf84-4360-9590-74bbc505d707 tempest-ServersAdmin275Test-1925739795 tempest-ServersAdmin275Test-1925739795-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:46.300059 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-f2b1a666-6c75-4877-866c-dec32c40021e tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b52b7dcbb044f9bfc424e4417c77fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '708bc0ea4b5a4baf81933725792bedd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:57:46.312981 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-f2b1a666-6c75-4877-866c-dec32c40021e tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] 10.222.0.13 "GET /compute/v2.1/servers/e43fa43a-f523-4438-a8ba-a4460ea4a210" status: 200 len: 1325 microversion: 2.1 time: 0.194195 Nov 01 18:57:46.313620 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 478/993] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:57:46 2022] GET /compute/v2.1/servers/e43fa43a-f523-4438-a8ba-a4460ea4a210 => generated 1325 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:57:46.333007 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.objects.instance [None req-e2ca11dd-bf84-4360-9590-74bbc505d707 tempest-ServersAdmin275Test-1925739795 tempest-ServersAdmin275Test-1925739795-project-admin] Lazy-loading 'services' on Instance uuid 87679611-878a-49b2-bf8f-39e784c6d70b {{(pid=121402) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 01 18:57:46.353376 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-e2ca11dd-bf84-4360-9590-74bbc505d707 tempest-ServersAdmin275Test-1925739795 tempest-ServersAdmin275Test-1925739795-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/87679611-878a-49b2-bf8f-39e784c6d70b" status: 200 len: 1947 microversion: 2.75 time: 0.148056 Nov 01 18:57:46.368571 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 516/994] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 18:57:46 2022] GET /compute/v2.1/servers/87679611-878a-49b2-bf8f-39e784c6d70b => generated 1947 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 01 18:57:46.612620 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-87480a71-20a5-41df-8fd8-26062a9eb228 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:57:46.614136 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-87480a71-20a5-41df-8fd8-26062a9eb228 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] [instance: ea631032-dd04-429b-988e-e6362ea42cf7] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:57:46.620693 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-87480a71-20a5-41df-8fd8-26062a9eb228 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:46.622007 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-87480a71-20a5-41df-8fd8-26062a9eb228 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:46.622644 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-87480a71-20a5-41df-8fd8-26062a9eb228 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:46.623358 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-87480a71-20a5-41df-8fd8-26062a9eb228 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:46.623810 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-87480a71-20a5-41df-8fd8-26062a9eb228 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:46.624238 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-87480a71-20a5-41df-8fd8-26062a9eb228 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:46.700433 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-87480a71-20a5-41df-8fd8-26062a9eb228 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c1314c21d8547ff890ede1c2ad281c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c804370880454c7aa02cef2c2c3cf144', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:57:46.709470 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-87480a71-20a5-41df-8fd8-26062a9eb228 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c1314c21d8547ff890ede1c2ad281c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c804370880454c7aa02cef2c2c3cf144', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:57:46.710919 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-87480a71-20a5-41df-8fd8-26062a9eb228 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c1314c21d8547ff890ede1c2ad281c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c804370880454c7aa02cef2c2c3cf144', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:57:46.716420 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-87480a71-20a5-41df-8fd8-26062a9eb228 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] 10.222.0.13 "GET /compute/v2.1/servers/ea631032-dd04-429b-988e-e6362ea42cf7" status: 200 len: 1537 microversion: 2.91 time: 0.109516 Nov 01 18:57:46.717030 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 479/995] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 18:57:46 2022] GET /compute/v2.1/servers/ea631032-dd04-429b-988e-e6362ea42cf7 => generated 1537 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 18:57:46.843009 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-e7030908-3eaa-4515-8224-7db7928d1c39 tempest-ServicesAdminNegativeV253TestJSON-1296266883 tempest-ServicesAdminNegativeV253TestJSON-1296266883-project-admin] Action: 'update', calling method: .version_select at 0x7f0ae259cb80>, body: {"status": "disabled", "disabled_reason": "maintenance"} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 18:57:46.847418 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e7030908-3eaa-4515-8224-7db7928d1c39 tempest-ServicesAdminNegativeV253TestJSON-1296266883 tempest-ServicesAdminNegativeV253TestJSON-1296266883-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:46.847929 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e7030908-3eaa-4515-8224-7db7928d1c39 tempest-ServicesAdminNegativeV253TestJSON-1296266883 tempest-ServicesAdminNegativeV253TestJSON-1296266883-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:46.848370 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e7030908-3eaa-4515-8224-7db7928d1c39 tempest-ServicesAdminNegativeV253TestJSON-1296266883 tempest-ServicesAdminNegativeV253TestJSON-1296266883-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:46.855615 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e7030908-3eaa-4515-8224-7db7928d1c39 tempest-ServicesAdminNegativeV253TestJSON-1296266883 tempest-ServicesAdminNegativeV253TestJSON-1296266883-project-admin] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:46.856118 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e7030908-3eaa-4515-8224-7db7928d1c39 tempest-ServicesAdminNegativeV253TestJSON-1296266883 tempest-ServicesAdminNegativeV253TestJSON-1296266883-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:46.856550 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e7030908-3eaa-4515-8224-7db7928d1c39 tempest-ServicesAdminNegativeV253TestJSON-1296266883 tempest-ServicesAdminNegativeV253TestJSON-1296266883-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:46.863343 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.wsgi [None req-e7030908-3eaa-4515-8224-7db7928d1c39 tempest-ServicesAdminNegativeV253TestJSON-1296266883 tempest-ServicesAdminNegativeV253TestJSON-1296266883-project-admin] HTTP exception thrown: Service 00f3c32f-bd74-4278-9b65-2d1c83e01e89 could not be found. Nov 01 18:57:46.865442 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-e7030908-3eaa-4515-8224-7db7928d1c39 tempest-ServicesAdminNegativeV253TestJSON-1296266883 tempest-ServicesAdminNegativeV253TestJSON-1296266883-project-admin] Request method failure captured: Nov 01 18:57:46.865442 n-d-863052-2 devstack@n-api.service[121402]: request: PUT /compute/v2.1/os-services/00f3c32f-bd74-4278-9b65-2d1c83e01e89 HTTP/1.1 Nov 01 18:57:46.865442 n-d-863052-2 devstack@n-api.service[121402]: Accept: application/json Nov 01 18:57:46.865442 n-d-863052-2 devstack@n-api.service[121402]: Accept-Encoding: identity Nov 01 18:57:46.865442 n-d-863052-2 devstack@n-api.service[121402]: Connection: close Nov 01 18:57:46.865442 n-d-863052-2 devstack@n-api.service[121402]: Content-Length: 56 Nov 01 18:57:46.865442 n-d-863052-2 devstack@n-api.service[121402]: Content-Type: application/json Nov 01 18:57:46.865442 n-d-863052-2 devstack@n-api.service[121402]: Host: 10.222.0.13 Nov 01 18:57:46.865442 n-d-863052-2 devstack@n-api.service[121402]: Openstack-System-Scope: None Nov 01 18:57:46.865442 n-d-863052-2 devstack@n-api.service[121402]: User-Agent: python-urllib3/1.26.12 Nov 01 18:57:46.865442 n-d-863052-2 devstack@n-api.service[121402]: X-Auth-Token: gAAAAABjYWwq8yo0drRxkTMy6lxjiJAZiUUwDJPEidV2C9tvEkX3ysfXBe9gHVPUMQl7EnsUIUTnjDRwUz4YodJgrO76MZ2ZXOyps-fUOxwQfhSY2etrYRbMhmwQt5g90772N4evBIysRAey0ZV8EMR3iYgEebylKpb4iAvkyLzh7JVxxVqy5zE Nov 01 18:57:46.865442 n-d-863052-2 devstack@n-api.service[121402]: X-Domain-Id: None Nov 01 18:57:46.865442 n-d-863052-2 devstack@n-api.service[121402]: X-Domain-Name: None Nov 01 18:57:46.865442 n-d-863052-2 devstack@n-api.service[121402]: X-Identity-Status: Confirmed Nov 01 18:57:46.865442 n-d-863052-2 devstack@n-api.service[121402]: X-Is-Admin-Project: True Nov 01 18:57:46.865442 n-d-863052-2 devstack@n-api.service[121402]: X-Openstack-Nova-Api-Version: 2.53 Nov 01 18:57:46.865442 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Domain-Id: default Nov 01 18:57:46.865442 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Domain-Name: Default Nov 01 18:57:46.865442 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Id: 355e56cf5ef743d0a895d6a75aed9383 Nov 01 18:57:46.865442 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-1296266883 Nov 01 18:57:46.865442 n-d-863052-2 devstack@n-api.service[121402]: X-Role: admin,member,reader Nov 01 18:57:46.865442 n-d-863052-2 devstack@n-api.service[121402]: X-Roles: admin,member,reader Nov 01 18:57:46.867060 n-d-863052-2 devstack@n-api.service[121402]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/355e56cf5ef743d0a895d6a75aed9383"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/355e56cf5ef743d0a895d6a75aed9383"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_355e56cf5ef743d0a895d6a75aed9383", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/355e56cf5ef743d0a895d6a75aed9383"}]}] Nov 01 18:57:46.867060 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-1296266883 Nov 01 18:57:46.867060 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant-Id: 355e56cf5ef743d0a895d6a75aed9383 Nov 01 18:57:46.867060 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-1296266883 Nov 01 18:57:46.867060 n-d-863052-2 devstack@n-api.service[121402]: X-User: tempest-ServicesAdminNegativeV253TestJSON-1296266883-project-admin Nov 01 18:57:46.867060 n-d-863052-2 devstack@n-api.service[121402]: X-User-Domain-Id: default Nov 01 18:57:46.867060 n-d-863052-2 devstack@n-api.service[121402]: X-User-Domain-Name: Default Nov 01 18:57:46.867060 n-d-863052-2 devstack@n-api.service[121402]: X-User-Id: 8b97c6a6e3084b06afc3aedae6e79c68 Nov 01 18:57:46.867060 n-d-863052-2 devstack@n-api.service[121402]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-1296266883-project-admin Nov 01 18:57:46.867060 n-d-863052-2 devstack@n-api.service[121402]: Nov 01 18:57:46.867060 n-d-863052-2 devstack@n-api.service[121402]: {"status": "disabled", "disabled_reason": "maintenance"} Nov 01 18:57:46.867060 n-d-863052-2 devstack@n-api.service[121402]: method: Nov 01 18:57:46.867060 n-d-863052-2 devstack@n-api.service[121402]: exception: Service 00f3c32f-bd74-4278-9b65-2d1c83e01e89 could not be found. Nov 01 18:57:46.867931 n-d-863052-2 devstack@n-api.service[121402]: action_args: {'id': '00f3c32f-bd74-4278-9b65-2d1c83e01e89', 'body': {'status': 'disabled', 'disabled_reason': 'maintenance'}} Nov 01 18:57:46.867931 n-d-863052-2 devstack@n-api.service[121402]: {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 01 18:57:46.867931 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:57:46.867931 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6207, in service_get_by_id Nov 01 18:57:46.867931 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Nov 01 18:57:46.867931 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Nov 01 18:57:46.867931 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Nov 01 18:57:46.867931 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Nov 01 18:57:46.867931 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 18:57:46.867931 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 18:57:46.867931 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 18:57:46.867931 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:57:46.867931 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 436, in update Nov 01 18:57:46.867931 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Nov 01 18:57:46.867931 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6209, in service_get_by_id Nov 01 18:57:46.867931 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Nov 01 18:57:46.867931 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service 00f3c32f-bd74-4278-9b65-2d1c83e01e89 could not be found. Nov 01 18:57:46.867931 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 18:57:46.867931 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 18:57:46.867931 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 18:57:46.867931 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:57:46.869211 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 18:57:46.869211 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 18:57:46.869211 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 01 18:57:46.869211 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 01 18:57:46.869211 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 01 18:57:46.869211 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 01 18:57:46.869211 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 01 18:57:46.869211 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 01 18:57:46.869211 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 01 18:57:46.869211 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 01 18:57:46.869211 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 441, in update Nov 01 18:57:46.869211 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Nov 01 18:57:46.869211 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service 00f3c32f-bd74-4278-9b65-2d1c83e01e89 could not be found. Nov 01 18:57:46.869211 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 18:57:46.869211 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 18:57:46.869211 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 18:57:46.869211 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:57:46.869211 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 18:57:46.869211 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 18:57:46.869211 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 01 18:57:46.870420 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 01 18:57:46.870420 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service 00f3c32f-bd74-4278-9b65-2d1c83e01e89 could not be found. Nov 01 18:57:46.870420 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 18:57:46.870420 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-e7030908-3eaa-4515-8224-7db7928d1c39 tempest-ServicesAdminNegativeV253TestJSON-1296266883 tempest-ServicesAdminNegativeV253TestJSON-1296266883-project-admin] Returning 404 to user: Service 00f3c32f-bd74-4278-9b65-2d1c83e01e89 could not be found. {{(pid=121402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 01 18:57:46.870420 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-e7030908-3eaa-4515-8224-7db7928d1c39 tempest-ServicesAdminNegativeV253TestJSON-1296266883 tempest-ServicesAdminNegativeV253TestJSON-1296266883-project-admin] 10.222.0.13 "PUT /compute/v2.1/os-services/00f3c32f-bd74-4278-9b65-2d1c83e01e89" status: 404 len: 110 microversion: 2.53 time: 0.136263 Nov 01 18:57:46.870420 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 517/996] 10.222.0.13 () {62 vars in 1309 bytes} [Tue Nov 1 18:57:46 2022] PUT /compute/v2.1/os-services/00f3c32f-bd74-4278-9b65-2d1c83e01e89 => generated 110 bytes in 137 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 01 18:57:46.876547 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-e8f47bcf-3731-488f-819d-c4cc9baf3a49 tempest-ServicesAdminNegativeV253TestJSON-1296266883 tempest-ServicesAdminNegativeV253TestJSON-1296266883-project-admin] Action: 'update', calling method: .version_select at 0x7f0ae2a940d0>, body: {"status": "disabled"} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 18:57:46.880143 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-e8f47bcf-3731-488f-819d-c4cc9baf3a49 tempest-ServicesAdminNegativeV253TestJSON-1296266883 tempest-ServicesAdminNegativeV253TestJSON-1296266883-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:46.880647 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-e8f47bcf-3731-488f-819d-c4cc9baf3a49 tempest-ServicesAdminNegativeV253TestJSON-1296266883 tempest-ServicesAdminNegativeV253TestJSON-1296266883-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:46.881081 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-e8f47bcf-3731-488f-819d-c4cc9baf3a49 tempest-ServicesAdminNegativeV253TestJSON-1296266883 tempest-ServicesAdminNegativeV253TestJSON-1296266883-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:46.888257 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-e8f47bcf-3731-488f-819d-c4cc9baf3a49 tempest-ServicesAdminNegativeV253TestJSON-1296266883 tempest-ServicesAdminNegativeV253TestJSON-1296266883-project-admin] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:46.888772 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-e8f47bcf-3731-488f-819d-c4cc9baf3a49 tempest-ServicesAdminNegativeV253TestJSON-1296266883 tempest-ServicesAdminNegativeV253TestJSON-1296266883-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:46.889202 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-e8f47bcf-3731-488f-819d-c4cc9baf3a49 tempest-ServicesAdminNegativeV253TestJSON-1296266883 tempest-ServicesAdminNegativeV253TestJSON-1296266883-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:46.895791 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.wsgi [None req-e8f47bcf-3731-488f-819d-c4cc9baf3a49 tempest-ServicesAdminNegativeV253TestJSON-1296266883 tempest-ServicesAdminNegativeV253TestJSON-1296266883-project-admin] HTTP exception thrown: Service 00f3c32f-bd74-4278-9b65-2d1c83e01e89 could not be found. Nov 01 18:57:46.897970 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-e8f47bcf-3731-488f-819d-c4cc9baf3a49 tempest-ServicesAdminNegativeV253TestJSON-1296266883 tempest-ServicesAdminNegativeV253TestJSON-1296266883-project-admin] Request method failure captured: Nov 01 18:57:46.897970 n-d-863052-2 devstack@n-api.service[121403]: request: PUT /compute/v2.1/os-services/00f3c32f-bd74-4278-9b65-2d1c83e01e89 HTTP/1.1 Nov 01 18:57:46.897970 n-d-863052-2 devstack@n-api.service[121403]: Accept: application/json Nov 01 18:57:46.897970 n-d-863052-2 devstack@n-api.service[121403]: Accept-Encoding: identity Nov 01 18:57:46.897970 n-d-863052-2 devstack@n-api.service[121403]: Connection: close Nov 01 18:57:46.897970 n-d-863052-2 devstack@n-api.service[121403]: Content-Length: 22 Nov 01 18:57:46.897970 n-d-863052-2 devstack@n-api.service[121403]: Content-Type: application/json Nov 01 18:57:46.897970 n-d-863052-2 devstack@n-api.service[121403]: Host: 10.222.0.13 Nov 01 18:57:46.897970 n-d-863052-2 devstack@n-api.service[121403]: Openstack-System-Scope: None Nov 01 18:57:46.897970 n-d-863052-2 devstack@n-api.service[121403]: User-Agent: python-urllib3/1.26.12 Nov 01 18:57:46.897970 n-d-863052-2 devstack@n-api.service[121403]: X-Auth-Token: gAAAAABjYWwq8yo0drRxkTMy6lxjiJAZiUUwDJPEidV2C9tvEkX3ysfXBe9gHVPUMQl7EnsUIUTnjDRwUz4YodJgrO76MZ2ZXOyps-fUOxwQfhSY2etrYRbMhmwQt5g90772N4evBIysRAey0ZV8EMR3iYgEebylKpb4iAvkyLzh7JVxxVqy5zE Nov 01 18:57:46.897970 n-d-863052-2 devstack@n-api.service[121403]: X-Domain-Id: None Nov 01 18:57:46.897970 n-d-863052-2 devstack@n-api.service[121403]: X-Domain-Name: None Nov 01 18:57:46.897970 n-d-863052-2 devstack@n-api.service[121403]: X-Identity-Status: Confirmed Nov 01 18:57:46.897970 n-d-863052-2 devstack@n-api.service[121403]: X-Is-Admin-Project: True Nov 01 18:57:46.897970 n-d-863052-2 devstack@n-api.service[121403]: X-Openstack-Nova-Api-Version: 2.53 Nov 01 18:57:46.897970 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Domain-Id: default Nov 01 18:57:46.897970 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Domain-Name: Default Nov 01 18:57:46.897970 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Id: 355e56cf5ef743d0a895d6a75aed9383 Nov 01 18:57:46.897970 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-1296266883 Nov 01 18:57:46.897970 n-d-863052-2 devstack@n-api.service[121403]: X-Role: admin,member,reader Nov 01 18:57:46.897970 n-d-863052-2 devstack@n-api.service[121403]: X-Roles: admin,member,reader Nov 01 18:57:46.899587 n-d-863052-2 devstack@n-api.service[121403]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/355e56cf5ef743d0a895d6a75aed9383"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/355e56cf5ef743d0a895d6a75aed9383"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_355e56cf5ef743d0a895d6a75aed9383", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/355e56cf5ef743d0a895d6a75aed9383"}]}] Nov 01 18:57:46.899587 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-1296266883 Nov 01 18:57:46.899587 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant-Id: 355e56cf5ef743d0a895d6a75aed9383 Nov 01 18:57:46.899587 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-1296266883 Nov 01 18:57:46.899587 n-d-863052-2 devstack@n-api.service[121403]: X-User: tempest-ServicesAdminNegativeV253TestJSON-1296266883-project-admin Nov 01 18:57:46.899587 n-d-863052-2 devstack@n-api.service[121403]: X-User-Domain-Id: default Nov 01 18:57:46.899587 n-d-863052-2 devstack@n-api.service[121403]: X-User-Domain-Name: Default Nov 01 18:57:46.899587 n-d-863052-2 devstack@n-api.service[121403]: X-User-Id: 8b97c6a6e3084b06afc3aedae6e79c68 Nov 01 18:57:46.899587 n-d-863052-2 devstack@n-api.service[121403]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-1296266883-project-admin Nov 01 18:57:46.899587 n-d-863052-2 devstack@n-api.service[121403]: Nov 01 18:57:46.899587 n-d-863052-2 devstack@n-api.service[121403]: {"status": "disabled"} Nov 01 18:57:46.899587 n-d-863052-2 devstack@n-api.service[121403]: method: Nov 01 18:57:46.899587 n-d-863052-2 devstack@n-api.service[121403]: exception: Service 00f3c32f-bd74-4278-9b65-2d1c83e01e89 could not be found. Nov 01 18:57:46.899587 n-d-863052-2 devstack@n-api.service[121403]: action_args: {'id': '00f3c32f-bd74-4278-9b65-2d1c83e01e89', 'body': {'status': 'disabled'}} Nov 01 18:57:46.900814 n-d-863052-2 devstack@n-api.service[121403]: {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 01 18:57:46.900814 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:57:46.900814 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6207, in service_get_by_id Nov 01 18:57:46.900814 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Nov 01 18:57:46.900814 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Nov 01 18:57:46.900814 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Nov 01 18:57:46.900814 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Nov 01 18:57:46.900814 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 18:57:46.900814 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 18:57:46.900814 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 18:57:46.900814 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:57:46.900814 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 436, in update Nov 01 18:57:46.900814 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Nov 01 18:57:46.900814 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6209, in service_get_by_id Nov 01 18:57:46.900814 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Nov 01 18:57:46.900814 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service 00f3c32f-bd74-4278-9b65-2d1c83e01e89 could not be found. Nov 01 18:57:46.900814 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 18:57:46.900814 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 18:57:46.900814 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 18:57:46.900814 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:57:46.900814 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 18:57:46.902581 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 18:57:46.902581 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 01 18:57:46.902581 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 01 18:57:46.902581 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 01 18:57:46.902581 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 01 18:57:46.902581 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 01 18:57:46.902581 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 01 18:57:46.902581 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 01 18:57:46.902581 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 01 18:57:46.902581 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 441, in update Nov 01 18:57:46.902581 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Nov 01 18:57:46.902581 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service 00f3c32f-bd74-4278-9b65-2d1c83e01e89 could not be found. Nov 01 18:57:46.902581 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 18:57:46.902581 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 18:57:46.902581 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 18:57:46.902581 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:57:46.902581 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 18:57:46.902581 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 18:57:46.902581 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 01 18:57:46.902581 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 01 18:57:46.905947 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service 00f3c32f-bd74-4278-9b65-2d1c83e01e89 could not be found. Nov 01 18:57:46.905947 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 18:57:46.905947 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-e8f47bcf-3731-488f-819d-c4cc9baf3a49 tempest-ServicesAdminNegativeV253TestJSON-1296266883 tempest-ServicesAdminNegativeV253TestJSON-1296266883-project-admin] Returning 404 to user: Service 00f3c32f-bd74-4278-9b65-2d1c83e01e89 could not be found. {{(pid=121403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 01 18:57:46.905947 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-e8f47bcf-3731-488f-819d-c4cc9baf3a49 tempest-ServicesAdminNegativeV253TestJSON-1296266883 tempest-ServicesAdminNegativeV253TestJSON-1296266883-project-admin] 10.222.0.13 "PUT /compute/v2.1/os-services/00f3c32f-bd74-4278-9b65-2d1c83e01e89" status: 404 len: 110 microversion: 2.53 time: 0.026633 Nov 01 18:57:46.905947 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 480/997] 10.222.0.13 () {62 vars in 1309 bytes} [Tue Nov 1 18:57:46 2022] PUT /compute/v2.1/os-services/00f3c32f-bd74-4278-9b65-2d1c83e01e89 => generated 110 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 01 18:57:46.909413 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-68532d7b-dabb-4313-97f6-05cac36c2b7e tempest-ServicesAdminNegativeV253TestJSON-1296266883 tempest-ServicesAdminNegativeV253TestJSON-1296266883-project-admin] Action: 'update', calling method: .version_select at 0x7f0ae2659280>, body: {"status": "enabled"} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 18:57:46.912888 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-68532d7b-dabb-4313-97f6-05cac36c2b7e tempest-ServicesAdminNegativeV253TestJSON-1296266883 tempest-ServicesAdminNegativeV253TestJSON-1296266883-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:46.913370 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-68532d7b-dabb-4313-97f6-05cac36c2b7e tempest-ServicesAdminNegativeV253TestJSON-1296266883 tempest-ServicesAdminNegativeV253TestJSON-1296266883-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:46.913805 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-68532d7b-dabb-4313-97f6-05cac36c2b7e tempest-ServicesAdminNegativeV253TestJSON-1296266883 tempest-ServicesAdminNegativeV253TestJSON-1296266883-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:46.919296 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-68532d7b-dabb-4313-97f6-05cac36c2b7e tempest-ServicesAdminNegativeV253TestJSON-1296266883 tempest-ServicesAdminNegativeV253TestJSON-1296266883-project-admin] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:46.919771 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-68532d7b-dabb-4313-97f6-05cac36c2b7e tempest-ServicesAdminNegativeV253TestJSON-1296266883 tempest-ServicesAdminNegativeV253TestJSON-1296266883-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:46.920312 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-68532d7b-dabb-4313-97f6-05cac36c2b7e tempest-ServicesAdminNegativeV253TestJSON-1296266883 tempest-ServicesAdminNegativeV253TestJSON-1296266883-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:46.925511 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.wsgi [None req-68532d7b-dabb-4313-97f6-05cac36c2b7e tempest-ServicesAdminNegativeV253TestJSON-1296266883 tempest-ServicesAdminNegativeV253TestJSON-1296266883-project-admin] HTTP exception thrown: Service 00f3c32f-bd74-4278-9b65-2d1c83e01e89 could not be found. Nov 01 18:57:46.927161 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-68532d7b-dabb-4313-97f6-05cac36c2b7e tempest-ServicesAdminNegativeV253TestJSON-1296266883 tempest-ServicesAdminNegativeV253TestJSON-1296266883-project-admin] Request method failure captured: Nov 01 18:57:46.927161 n-d-863052-2 devstack@n-api.service[121402]: request: PUT /compute/v2.1/os-services/00f3c32f-bd74-4278-9b65-2d1c83e01e89 HTTP/1.1 Nov 01 18:57:46.927161 n-d-863052-2 devstack@n-api.service[121402]: Accept: application/json Nov 01 18:57:46.927161 n-d-863052-2 devstack@n-api.service[121402]: Accept-Encoding: identity Nov 01 18:57:46.927161 n-d-863052-2 devstack@n-api.service[121402]: Connection: close Nov 01 18:57:46.927161 n-d-863052-2 devstack@n-api.service[121402]: Content-Length: 21 Nov 01 18:57:46.927161 n-d-863052-2 devstack@n-api.service[121402]: Content-Type: application/json Nov 01 18:57:46.927161 n-d-863052-2 devstack@n-api.service[121402]: Host: 10.222.0.13 Nov 01 18:57:46.927161 n-d-863052-2 devstack@n-api.service[121402]: Openstack-System-Scope: None Nov 01 18:57:46.927161 n-d-863052-2 devstack@n-api.service[121402]: User-Agent: python-urllib3/1.26.12 Nov 01 18:57:46.927161 n-d-863052-2 devstack@n-api.service[121402]: X-Auth-Token: gAAAAABjYWwq8yo0drRxkTMy6lxjiJAZiUUwDJPEidV2C9tvEkX3ysfXBe9gHVPUMQl7EnsUIUTnjDRwUz4YodJgrO76MZ2ZXOyps-fUOxwQfhSY2etrYRbMhmwQt5g90772N4evBIysRAey0ZV8EMR3iYgEebylKpb4iAvkyLzh7JVxxVqy5zE Nov 01 18:57:46.927161 n-d-863052-2 devstack@n-api.service[121402]: X-Domain-Id: None Nov 01 18:57:46.927161 n-d-863052-2 devstack@n-api.service[121402]: X-Domain-Name: None Nov 01 18:57:46.927161 n-d-863052-2 devstack@n-api.service[121402]: X-Identity-Status: Confirmed Nov 01 18:57:46.927161 n-d-863052-2 devstack@n-api.service[121402]: X-Is-Admin-Project: True Nov 01 18:57:46.927161 n-d-863052-2 devstack@n-api.service[121402]: X-Openstack-Nova-Api-Version: 2.53 Nov 01 18:57:46.927161 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Domain-Id: default Nov 01 18:57:46.927161 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Domain-Name: Default Nov 01 18:57:46.927161 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Id: 355e56cf5ef743d0a895d6a75aed9383 Nov 01 18:57:46.927161 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-1296266883 Nov 01 18:57:46.927161 n-d-863052-2 devstack@n-api.service[121402]: X-Role: admin,member,reader Nov 01 18:57:46.927161 n-d-863052-2 devstack@n-api.service[121402]: X-Roles: admin,member,reader Nov 01 18:57:46.928575 n-d-863052-2 devstack@n-api.service[121402]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/355e56cf5ef743d0a895d6a75aed9383"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/355e56cf5ef743d0a895d6a75aed9383"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_355e56cf5ef743d0a895d6a75aed9383", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/355e56cf5ef743d0a895d6a75aed9383"}]}] Nov 01 18:57:46.928575 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-1296266883 Nov 01 18:57:46.928575 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant-Id: 355e56cf5ef743d0a895d6a75aed9383 Nov 01 18:57:46.928575 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-1296266883 Nov 01 18:57:46.928575 n-d-863052-2 devstack@n-api.service[121402]: X-User: tempest-ServicesAdminNegativeV253TestJSON-1296266883-project-admin Nov 01 18:57:46.928575 n-d-863052-2 devstack@n-api.service[121402]: X-User-Domain-Id: default Nov 01 18:57:46.928575 n-d-863052-2 devstack@n-api.service[121402]: X-User-Domain-Name: Default Nov 01 18:57:46.928575 n-d-863052-2 devstack@n-api.service[121402]: X-User-Id: 8b97c6a6e3084b06afc3aedae6e79c68 Nov 01 18:57:46.928575 n-d-863052-2 devstack@n-api.service[121402]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-1296266883-project-admin Nov 01 18:57:46.928575 n-d-863052-2 devstack@n-api.service[121402]: Nov 01 18:57:46.928575 n-d-863052-2 devstack@n-api.service[121402]: {"status": "enabled"} Nov 01 18:57:46.928575 n-d-863052-2 devstack@n-api.service[121402]: method: Nov 01 18:57:46.928575 n-d-863052-2 devstack@n-api.service[121402]: exception: Service 00f3c32f-bd74-4278-9b65-2d1c83e01e89 could not be found. Nov 01 18:57:46.928575 n-d-863052-2 devstack@n-api.service[121402]: action_args: {'id': '00f3c32f-bd74-4278-9b65-2d1c83e01e89', 'body': {'status': 'enabled'}} Nov 01 18:57:46.929735 n-d-863052-2 devstack@n-api.service[121402]: {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 01 18:57:46.929735 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:57:46.929735 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6207, in service_get_by_id Nov 01 18:57:46.929735 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Nov 01 18:57:46.929735 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Nov 01 18:57:46.929735 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Nov 01 18:57:46.929735 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Nov 01 18:57:46.929735 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 18:57:46.929735 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 18:57:46.929735 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 18:57:46.929735 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:57:46.929735 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 436, in update Nov 01 18:57:46.929735 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Nov 01 18:57:46.929735 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6209, in service_get_by_id Nov 01 18:57:46.929735 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Nov 01 18:57:46.929735 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service 00f3c32f-bd74-4278-9b65-2d1c83e01e89 could not be found. Nov 01 18:57:46.929735 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 18:57:46.929735 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 18:57:46.929735 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 18:57:46.929735 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:57:46.929735 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 18:57:46.930985 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 18:57:46.930985 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 01 18:57:46.930985 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 01 18:57:46.930985 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 01 18:57:46.930985 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 01 18:57:46.930985 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 01 18:57:46.930985 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 01 18:57:46.930985 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 01 18:57:46.930985 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 01 18:57:46.930985 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 441, in update Nov 01 18:57:46.930985 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Nov 01 18:57:46.930985 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service 00f3c32f-bd74-4278-9b65-2d1c83e01e89 could not be found. Nov 01 18:57:46.930985 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 18:57:46.930985 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 18:57:46.930985 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 18:57:46.930985 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:57:46.930985 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 18:57:46.930985 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 18:57:46.930985 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 01 18:57:46.930985 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 01 18:57:46.934054 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service 00f3c32f-bd74-4278-9b65-2d1c83e01e89 could not be found. Nov 01 18:57:46.934054 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 18:57:46.934054 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-68532d7b-dabb-4313-97f6-05cac36c2b7e tempest-ServicesAdminNegativeV253TestJSON-1296266883 tempest-ServicesAdminNegativeV253TestJSON-1296266883-project-admin] Returning 404 to user: Service 00f3c32f-bd74-4278-9b65-2d1c83e01e89 could not be found. {{(pid=121402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 01 18:57:46.934054 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-68532d7b-dabb-4313-97f6-05cac36c2b7e tempest-ServicesAdminNegativeV253TestJSON-1296266883 tempest-ServicesAdminNegativeV253TestJSON-1296266883-project-admin] 10.222.0.13 "PUT /compute/v2.1/os-services/00f3c32f-bd74-4278-9b65-2d1c83e01e89" status: 404 len: 110 microversion: 2.53 time: 0.023422 Nov 01 18:57:46.934054 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 518/998] 10.222.0.13 () {62 vars in 1309 bytes} [Tue Nov 1 18:57:46 2022] PUT /compute/v2.1/os-services/00f3c32f-bd74-4278-9b65-2d1c83e01e89 => generated 110 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 01 18:57:46.939812 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-d338bc15-44d6-4276-9530-97455163a48e tempest-ServicesAdminNegativeV253TestJSON-1296266883 tempest-ServicesAdminNegativeV253TestJSON-1296266883-project-admin] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:57:46.943571 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d338bc15-44d6-4276-9530-97455163a48e tempest-ServicesAdminNegativeV253TestJSON-1296266883 tempest-ServicesAdminNegativeV253TestJSON-1296266883-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:46.944314 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d338bc15-44d6-4276-9530-97455163a48e tempest-ServicesAdminNegativeV253TestJSON-1296266883 tempest-ServicesAdminNegativeV253TestJSON-1296266883-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:46.944790 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d338bc15-44d6-4276-9530-97455163a48e tempest-ServicesAdminNegativeV253TestJSON-1296266883 tempest-ServicesAdminNegativeV253TestJSON-1296266883-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:46.945526 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d338bc15-44d6-4276-9530-97455163a48e tempest-ServicesAdminNegativeV253TestJSON-1296266883 tempest-ServicesAdminNegativeV253TestJSON-1296266883-project-admin] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:46.945981 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d338bc15-44d6-4276-9530-97455163a48e tempest-ServicesAdminNegativeV253TestJSON-1296266883 tempest-ServicesAdminNegativeV253TestJSON-1296266883-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:46.946396 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d338bc15-44d6-4276-9530-97455163a48e tempest-ServicesAdminNegativeV253TestJSON-1296266883 tempest-ServicesAdminNegativeV253TestJSON-1296266883-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:46.970742 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-d338bc15-44d6-4276-9530-97455163a48e tempest-ServicesAdminNegativeV253TestJSON-1296266883 tempest-ServicesAdminNegativeV253TestJSON-1296266883-project-admin] 10.222.0.13 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.53 time: 0.036437 Nov 01 18:57:46.972320 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 481/999] 10.222.0.13 () {60 vars in 1178 bytes} [Tue Nov 1 18:57:46 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 18:57:46.984687 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-b19e6afc-d5ac-4c02-b4d5-cc2c655550ca tempest-ServicesAdminNegativeV253TestJSON-1296266883 tempest-ServicesAdminNegativeV253TestJSON-1296266883-project-admin] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:57:46.988809 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b19e6afc-d5ac-4c02-b4d5-cc2c655550ca tempest-ServicesAdminNegativeV253TestJSON-1296266883 tempest-ServicesAdminNegativeV253TestJSON-1296266883-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:46.989298 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b19e6afc-d5ac-4c02-b4d5-cc2c655550ca tempest-ServicesAdminNegativeV253TestJSON-1296266883 tempest-ServicesAdminNegativeV253TestJSON-1296266883-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:46.989730 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b19e6afc-d5ac-4c02-b4d5-cc2c655550ca tempest-ServicesAdminNegativeV253TestJSON-1296266883 tempest-ServicesAdminNegativeV253TestJSON-1296266883-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:46.990676 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b19e6afc-d5ac-4c02-b4d5-cc2c655550ca tempest-ServicesAdminNegativeV253TestJSON-1296266883 tempest-ServicesAdminNegativeV253TestJSON-1296266883-project-admin] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:46.991328 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b19e6afc-d5ac-4c02-b4d5-cc2c655550ca tempest-ServicesAdminNegativeV253TestJSON-1296266883 tempest-ServicesAdminNegativeV253TestJSON-1296266883-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:46.991981 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b19e6afc-d5ac-4c02-b4d5-cc2c655550ca tempest-ServicesAdminNegativeV253TestJSON-1296266883 tempest-ServicesAdminNegativeV253TestJSON-1296266883-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:47.015998 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-b19e6afc-d5ac-4c02-b4d5-cc2c655550ca tempest-ServicesAdminNegativeV253TestJSON-1296266883 tempest-ServicesAdminNegativeV253TestJSON-1296266883-project-admin] 10.222.0.13 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.53 time: 0.035057 Nov 01 18:57:47.016784 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 519/1000] 10.222.0.13 () {60 vars in 1211 bytes} [Tue Nov 1 18:57:46 2022] GET /compute/v2.1/os-services?xxx=nova-compute => generated 1239 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 18:57:47.030597 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-862159fc-48a9-4f70-adac-9ff30554c3c3 tempest-ServicesAdminNegativeV253TestJSON-1296266883 tempest-ServicesAdminNegativeV253TestJSON-1296266883-project-admin] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:57:47.034616 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-862159fc-48a9-4f70-adac-9ff30554c3c3 tempest-ServicesAdminNegativeV253TestJSON-1296266883 tempest-ServicesAdminNegativeV253TestJSON-1296266883-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:47.035099 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-862159fc-48a9-4f70-adac-9ff30554c3c3 tempest-ServicesAdminNegativeV253TestJSON-1296266883 tempest-ServicesAdminNegativeV253TestJSON-1296266883-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:47.035535 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-862159fc-48a9-4f70-adac-9ff30554c3c3 tempest-ServicesAdminNegativeV253TestJSON-1296266883 tempest-ServicesAdminNegativeV253TestJSON-1296266883-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:47.036288 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-862159fc-48a9-4f70-adac-9ff30554c3c3 tempest-ServicesAdminNegativeV253TestJSON-1296266883 tempest-ServicesAdminNegativeV253TestJSON-1296266883-project-admin] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:47.036963 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-862159fc-48a9-4f70-adac-9ff30554c3c3 tempest-ServicesAdminNegativeV253TestJSON-1296266883 tempest-ServicesAdminNegativeV253TestJSON-1296266883-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:47.037394 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-862159fc-48a9-4f70-adac-9ff30554c3c3 tempest-ServicesAdminNegativeV253TestJSON-1296266883 tempest-ServicesAdminNegativeV253TestJSON-1296266883-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:47.061099 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-862159fc-48a9-4f70-adac-9ff30554c3c3 tempest-ServicesAdminNegativeV253TestJSON-1296266883 tempest-ServicesAdminNegativeV253TestJSON-1296266883-project-admin] 10.222.0.13 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.53 time: 0.034106 Nov 01 18:57:47.065261 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 482/1001] 10.222.0.13 () {60 vars in 1178 bytes} [Tue Nov 1 18:57:47 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 18:57:47.074881 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-46b204a8-3fc1-4a13-a5d4-c528b5a35a18 tempest-ServicesAdminNegativeV253TestJSON-1296266883 tempest-ServicesAdminNegativeV253TestJSON-1296266883-project-admin] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:57:47.078546 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-46b204a8-3fc1-4a13-a5d4-c528b5a35a18 tempest-ServicesAdminNegativeV253TestJSON-1296266883 tempest-ServicesAdminNegativeV253TestJSON-1296266883-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:47.079039 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-46b204a8-3fc1-4a13-a5d4-c528b5a35a18 tempest-ServicesAdminNegativeV253TestJSON-1296266883 tempest-ServicesAdminNegativeV253TestJSON-1296266883-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:47.079494 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-46b204a8-3fc1-4a13-a5d4-c528b5a35a18 tempest-ServicesAdminNegativeV253TestJSON-1296266883 tempest-ServicesAdminNegativeV253TestJSON-1296266883-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:47.080244 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-46b204a8-3fc1-4a13-a5d4-c528b5a35a18 tempest-ServicesAdminNegativeV253TestJSON-1296266883 tempest-ServicesAdminNegativeV253TestJSON-1296266883-project-admin] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:47.081276 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-46b204a8-3fc1-4a13-a5d4-c528b5a35a18 tempest-ServicesAdminNegativeV253TestJSON-1296266883 tempest-ServicesAdminNegativeV253TestJSON-1296266883-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:47.081709 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-46b204a8-3fc1-4a13-a5d4-c528b5a35a18 tempest-ServicesAdminNegativeV253TestJSON-1296266883 tempest-ServicesAdminNegativeV253TestJSON-1296266883-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:47.090904 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-78676196-308e-4d3f-8eb5-1493a5f85ec0 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:57:47.091590 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-78676196-308e-4d3f-8eb5-1493a5f85ec0 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] [instance: 7218f99b-b011-4f08-931e-340d47069f6e] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:57:47.098202 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-78676196-308e-4d3f-8eb5-1493a5f85ec0 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:47.098773 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-78676196-308e-4d3f-8eb5-1493a5f85ec0 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:47.099208 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-78676196-308e-4d3f-8eb5-1493a5f85ec0 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:47.100003 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-78676196-308e-4d3f-8eb5-1493a5f85ec0 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:47.100514 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-78676196-308e-4d3f-8eb5-1493a5f85ec0 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:47.100961 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-78676196-308e-4d3f-8eb5-1493a5f85ec0 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:47.104490 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-46b204a8-3fc1-4a13-a5d4-c528b5a35a18 tempest-ServicesAdminNegativeV253TestJSON-1296266883 tempest-ServicesAdminNegativeV253TestJSON-1296266883-project-admin] 10.222.0.13 "GET /compute/v2.1/os-services?host=n-d-863052-2&binary=xxx" status: 200 len: 16 microversion: 2.53 time: 0.033390 Nov 01 18:57:47.105139 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 520/1002] 10.222.0.13 () {60 vars in 1235 bytes} [Tue Nov 1 18:57:47 2022] GET /compute/v2.1/os-services?host=n-d-863052-2&binary=xxx => generated 16 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:57:47.118244 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-d39e1deb-e9a4-4a2e-804b-4eed4864072a tempest-ServicesAdminNegativeV253TestJSON-1296266883 tempest-ServicesAdminNegativeV253TestJSON-1296266883-project-admin] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:57:47.123151 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-d39e1deb-e9a4-4a2e-804b-4eed4864072a tempest-ServicesAdminNegativeV253TestJSON-1296266883 tempest-ServicesAdminNegativeV253TestJSON-1296266883-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:47.123933 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-d39e1deb-e9a4-4a2e-804b-4eed4864072a tempest-ServicesAdminNegativeV253TestJSON-1296266883 tempest-ServicesAdminNegativeV253TestJSON-1296266883-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:47.124434 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-d39e1deb-e9a4-4a2e-804b-4eed4864072a tempest-ServicesAdminNegativeV253TestJSON-1296266883 tempest-ServicesAdminNegativeV253TestJSON-1296266883-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:47.125225 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-d39e1deb-e9a4-4a2e-804b-4eed4864072a tempest-ServicesAdminNegativeV253TestJSON-1296266883 tempest-ServicesAdminNegativeV253TestJSON-1296266883-project-admin] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:47.125675 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-d39e1deb-e9a4-4a2e-804b-4eed4864072a tempest-ServicesAdminNegativeV253TestJSON-1296266883 tempest-ServicesAdminNegativeV253TestJSON-1296266883-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:47.126094 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-d39e1deb-e9a4-4a2e-804b-4eed4864072a tempest-ServicesAdminNegativeV253TestJSON-1296266883 tempest-ServicesAdminNegativeV253TestJSON-1296266883-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:47.156679 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-d39e1deb-e9a4-4a2e-804b-4eed4864072a tempest-ServicesAdminNegativeV253TestJSON-1296266883 tempest-ServicesAdminNegativeV253TestJSON-1296266883-project-admin] 10.222.0.13 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.53 time: 0.042679 Nov 01 18:57:47.157453 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 521/1003] 10.222.0.13 () {60 vars in 1178 bytes} [Tue Nov 1 18:57:47 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 01 18:57:47.161839 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-a19c8e75-f0f4-4c23-bca7-9eb88d731e4d tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:57:47.162433 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-a19c8e75-f0f4-4c23-bca7-9eb88d731e4d tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] [instance: 869ca597-f199-474f-a680-59b0a75512c7] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:57:47.171384 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-a19c8e75-f0f4-4c23-bca7-9eb88d731e4d tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:47.171384 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-a19c8e75-f0f4-4c23-bca7-9eb88d731e4d tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:47.171775 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-a19c8e75-f0f4-4c23-bca7-9eb88d731e4d tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:47.172715 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-a19c8e75-f0f4-4c23-bca7-9eb88d731e4d tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:47.173170 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-a19c8e75-f0f4-4c23-bca7-9eb88d731e4d tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:47.173703 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-a19c8e75-f0f4-4c23-bca7-9eb88d731e4d tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:47.245802 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-78676196-308e-4d3f-8eb5-1493a5f85ec0 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72117f17294649d6b8bc16c66c7efab2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45d4c047d3c44324a27a27831236ab0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:57:47.257344 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-78676196-308e-4d3f-8eb5-1493a5f85ec0 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] 10.222.0.13 "GET /compute/v2.1/servers/7218f99b-b011-4f08-931e-340d47069f6e" status: 200 len: 1476 microversion: 2.1 time: 0.170052 Nov 01 18:57:47.257923 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 483/1004] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:57:47 2022] GET /compute/v2.1/servers/7218f99b-b011-4f08-931e-340d47069f6e => generated 1476 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 18:57:47.262567 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-e72ca495-d646-4e14-937e-164d3316cdc1 tempest-ServicesAdminNegativeV253TestJSON-1296266883 tempest-ServicesAdminNegativeV253TestJSON-1296266883-project-admin] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:57:47.266544 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-e72ca495-d646-4e14-937e-164d3316cdc1 tempest-ServicesAdminNegativeV253TestJSON-1296266883 tempest-ServicesAdminNegativeV253TestJSON-1296266883-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:47.267178 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-e72ca495-d646-4e14-937e-164d3316cdc1 tempest-ServicesAdminNegativeV253TestJSON-1296266883 tempest-ServicesAdminNegativeV253TestJSON-1296266883-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:47.267777 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-e72ca495-d646-4e14-937e-164d3316cdc1 tempest-ServicesAdminNegativeV253TestJSON-1296266883 tempest-ServicesAdminNegativeV253TestJSON-1296266883-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:47.269221 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-e72ca495-d646-4e14-937e-164d3316cdc1 tempest-ServicesAdminNegativeV253TestJSON-1296266883 tempest-ServicesAdminNegativeV253TestJSON-1296266883-project-admin] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:47.269905 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-e72ca495-d646-4e14-937e-164d3316cdc1 tempest-ServicesAdminNegativeV253TestJSON-1296266883 tempest-ServicesAdminNegativeV253TestJSON-1296266883-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:47.270581 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-e72ca495-d646-4e14-937e-164d3316cdc1 tempest-ServicesAdminNegativeV253TestJSON-1296266883 tempest-ServicesAdminNegativeV253TestJSON-1296266883-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:47.296502 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-e72ca495-d646-4e14-937e-164d3316cdc1 tempest-ServicesAdminNegativeV253TestJSON-1296266883 tempest-ServicesAdminNegativeV253TestJSON-1296266883-project-admin] 10.222.0.13 "GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler" status: 200 len: 16 microversion: 2.53 time: 0.037369 Nov 01 18:57:47.297135 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 484/1005] 10.222.0.13 () {60 vars in 1239 bytes} [Tue Nov 1 18:57:47 2022] GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler => generated 16 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:57:47.430620 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-a51a0db1-fe25-4331-82c2-b62ed33e06ef tempest-ServicesAdminNegativeV253TestJSON-1084481576 tempest-ServicesAdminNegativeV253TestJSON-1084481576-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:57:47.434106 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-a51a0db1-fe25-4331-82c2-b62ed33e06ef tempest-ServicesAdminNegativeV253TestJSON-1084481576 tempest-ServicesAdminNegativeV253TestJSON-1084481576-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': 'a7f08fae628e40e89731768d1d06c438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea322e48e0de433ba506c6613e9ca29a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:57:47.435658 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-a51a0db1-fe25-4331-82c2-b62ed33e06ef tempest-ServicesAdminNegativeV253TestJSON-1084481576 tempest-ServicesAdminNegativeV253TestJSON-1084481576-project] Request method failure captured: Nov 01 18:57:47.435658 n-d-863052-2 devstack@n-api.service[121403]: request: GET /compute/v2.1/os-services HTTP/1.1 Nov 01 18:57:47.435658 n-d-863052-2 devstack@n-api.service[121403]: Accept: application/json Nov 01 18:57:47.435658 n-d-863052-2 devstack@n-api.service[121403]: Accept-Encoding: identity Nov 01 18:57:47.435658 n-d-863052-2 devstack@n-api.service[121403]: Connection: close Nov 01 18:57:47.435658 n-d-863052-2 devstack@n-api.service[121403]: Content-Length: 0 Nov 01 18:57:47.435658 n-d-863052-2 devstack@n-api.service[121403]: Content-Type: application/json Nov 01 18:57:47.435658 n-d-863052-2 devstack@n-api.service[121403]: Host: 10.222.0.13 Nov 01 18:57:47.435658 n-d-863052-2 devstack@n-api.service[121403]: Openstack-System-Scope: None Nov 01 18:57:47.435658 n-d-863052-2 devstack@n-api.service[121403]: User-Agent: python-urllib3/1.26.12 Nov 01 18:57:47.435658 n-d-863052-2 devstack@n-api.service[121403]: X-Auth-Token: gAAAAABjYWwp_xyBizaCTwQPu0x0krM-7YYYcTtKzPBlRHHZ2TxKaSk7RMM2V1g46z1TBMGSYnJ4plunZa-R6XMtY3_NWc3jhEo68wWzHEYuB5IsN0QWdGvcQVKsODsKEqAqhjtgS6e-X1I2RQukNawCigZiIse_5HuNPzEandFYxWh2yZDnU4M Nov 01 18:57:47.435658 n-d-863052-2 devstack@n-api.service[121403]: X-Domain-Id: None Nov 01 18:57:47.435658 n-d-863052-2 devstack@n-api.service[121403]: X-Domain-Name: None Nov 01 18:57:47.435658 n-d-863052-2 devstack@n-api.service[121403]: X-Identity-Status: Confirmed Nov 01 18:57:47.435658 n-d-863052-2 devstack@n-api.service[121403]: X-Is-Admin-Project: True Nov 01 18:57:47.435658 n-d-863052-2 devstack@n-api.service[121403]: X-Openstack-Nova-Api-Version: 2.53 Nov 01 18:57:47.435658 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Domain-Id: default Nov 01 18:57:47.435658 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Domain-Name: Default Nov 01 18:57:47.435658 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Id: ea322e48e0de433ba506c6613e9ca29a Nov 01 18:57:47.435658 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-1084481576 Nov 01 18:57:47.435658 n-d-863052-2 devstack@n-api.service[121403]: X-Role: member,reader Nov 01 18:57:47.435658 n-d-863052-2 devstack@n-api.service[121403]: X-Roles: member,reader Nov 01 18:57:47.437157 n-d-863052-2 devstack@n-api.service[121403]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/ea322e48e0de433ba506c6613e9ca29a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/ea322e48e0de433ba506c6613e9ca29a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_ea322e48e0de433ba506c6613e9ca29a", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/ea322e48e0de433ba506c6613e9ca29a"}]}] Nov 01 18:57:47.437157 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-1084481576 Nov 01 18:57:47.437157 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant-Id: ea322e48e0de433ba506c6613e9ca29a Nov 01 18:57:47.437157 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-1084481576 Nov 01 18:57:47.437157 n-d-863052-2 devstack@n-api.service[121403]: X-User: tempest-ServicesAdminNegativeV253TestJSON-1084481576-project Nov 01 18:57:47.437157 n-d-863052-2 devstack@n-api.service[121403]: X-User-Domain-Id: default Nov 01 18:57:47.437157 n-d-863052-2 devstack@n-api.service[121403]: X-User-Domain-Name: Default Nov 01 18:57:47.437157 n-d-863052-2 devstack@n-api.service[121403]: X-User-Id: a7f08fae628e40e89731768d1d06c438 Nov 01 18:57:47.437157 n-d-863052-2 devstack@n-api.service[121403]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-1084481576-project Nov 01 18:57:47.437157 n-d-863052-2 devstack@n-api.service[121403]: method: > Nov 01 18:57:47.437157 n-d-863052-2 devstack@n-api.service[121403]: exception: Policy doesn't allow os_compute_api:os-services:list to be performed. Nov 01 18:57:47.437157 n-d-863052-2 devstack@n-api.service[121403]: action_args: {} Nov 01 18:57:47.442907 n-d-863052-2 devstack@n-api.service[121403]: {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 01 18:57:47.442907 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:57:47.442907 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 18:57:47.442907 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 18:57:47.442907 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 01 18:57:47.442907 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 01 18:57:47.442907 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Nov 01 18:57:47.442907 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 01 18:57:47.442907 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Nov 01 18:57:47.442907 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 01 18:57:47.442907 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 01 18:57:47.442907 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 01 18:57:47.442907 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 384, in index Nov 01 18:57:47.442907 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi context.can(services_policies.BASE_POLICY_NAME % 'list', target={}) Nov 01 18:57:47.442907 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Nov 01 18:57:47.442907 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Nov 01 18:57:47.442907 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Nov 01 18:57:47.442907 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Nov 01 18:57:47.442907 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 01 18:57:47.444307 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 01 18:57:47.444307 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 01 18:57:47.444307 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise self.value Nov 01 18:57:47.444307 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Nov 01 18:57:47.444307 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Nov 01 18:57:47.444307 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Nov 01 18:57:47.444307 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return self.enforce( Nov 01 18:57:47.444307 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Nov 01 18:57:47.444307 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Nov 01 18:57:47.444307 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-services:list to be performed. Nov 01 18:57:47.444307 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 18:57:47.444307 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 18:57:47.444307 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 18:57:47.444307 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:57:47.444307 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 18:57:47.444307 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 18:57:47.444307 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Nov 01 18:57:47.444307 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Nov 01 18:57:47.444307 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-services:list to be performed. Nov 01 18:57:47.444307 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 18:57:47.446147 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-a51a0db1-fe25-4331-82c2-b62ed33e06ef tempest-ServicesAdminNegativeV253TestJSON-1084481576 tempest-ServicesAdminNegativeV253TestJSON-1084481576-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=121403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 01 18:57:47.446147 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-a51a0db1-fe25-4331-82c2-b62ed33e06ef tempest-ServicesAdminNegativeV253TestJSON-1084481576 tempest-ServicesAdminNegativeV253TestJSON-1084481576-project] 10.222.0.13 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.53 time: 0.130782 Nov 01 18:57:47.446147 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 485/1006] 10.222.0.13 () {60 vars in 1178 bytes} [Tue Nov 1 18:57:47 2022] GET /compute/v2.1/os-services => generated 112 bytes in 132 msecs (HTTP/1.1 403) 9 headers in 381 bytes (1 switches on core 0) Nov 01 18:57:47.446147 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-db383148-2573-45ad-b572-a166c1a0b1c7 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:57:47.450664 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-db383148-2573-45ad-b572-a166c1a0b1c7 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] [instance: e43fa43a-f523-4438-a8ba-a4460ea4a210] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:57:47.460045 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-db383148-2573-45ad-b572-a166c1a0b1c7 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:47.460959 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-db383148-2573-45ad-b572-a166c1a0b1c7 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:47.461691 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-db383148-2573-45ad-b572-a166c1a0b1c7 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:47.462405 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-db383148-2573-45ad-b572-a166c1a0b1c7 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:47.463274 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-db383148-2573-45ad-b572-a166c1a0b1c7 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:47.463711 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-db383148-2573-45ad-b572-a166c1a0b1c7 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:47.507258 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-a19c8e75-f0f4-4c23-bca7-9eb88d731e4d tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a63d69c99a546f0af16329cff3ca717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a1bb191cff948e99c008b5e861ce4a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:57:47.518930 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-a19c8e75-f0f4-4c23-bca7-9eb88d731e4d tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] 10.222.0.13 "GET /compute/v2.1/servers/869ca597-f199-474f-a680-59b0a75512c7" status: 200 len: 1321 microversion: 2.1 time: 0.360556 Nov 01 18:57:47.519511 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 522/1007] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:57:47 2022] GET /compute/v2.1/servers/869ca597-f199-474f-a680-59b0a75512c7 => generated 1321 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:57:47.529206 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-475768f6-46a0-4bcf-9e83-cd42f82799be tempest-ServersAdmin275Test-1925739795 tempest-ServersAdmin275Test-1925739795-project-admin] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:57:47.529811 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-475768f6-46a0-4bcf-9e83-cd42f82799be tempest-ServersAdmin275Test-1925739795 tempest-ServersAdmin275Test-1925739795-project-admin] [instance: 87679611-878a-49b2-bf8f-39e784c6d70b] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:57:47.537935 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-475768f6-46a0-4bcf-9e83-cd42f82799be tempest-ServersAdmin275Test-1925739795 tempest-ServersAdmin275Test-1925739795-project-admin] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:47.538420 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-475768f6-46a0-4bcf-9e83-cd42f82799be tempest-ServersAdmin275Test-1925739795 tempest-ServersAdmin275Test-1925739795-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:47.538856 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-475768f6-46a0-4bcf-9e83-cd42f82799be tempest-ServersAdmin275Test-1925739795 tempest-ServersAdmin275Test-1925739795-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:47.539826 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-475768f6-46a0-4bcf-9e83-cd42f82799be tempest-ServersAdmin275Test-1925739795 tempest-ServersAdmin275Test-1925739795-project-admin] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:47.540441 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-475768f6-46a0-4bcf-9e83-cd42f82799be tempest-ServersAdmin275Test-1925739795 tempest-ServersAdmin275Test-1925739795-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:47.541234 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-475768f6-46a0-4bcf-9e83-cd42f82799be tempest-ServersAdmin275Test-1925739795 tempest-ServersAdmin275Test-1925739795-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:47.609089 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-db383148-2573-45ad-b572-a166c1a0b1c7 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b52b7dcbb044f9bfc424e4417c77fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '708bc0ea4b5a4baf81933725792bedd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:57:47.619691 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-db383148-2573-45ad-b572-a166c1a0b1c7 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] 10.222.0.13 "GET /compute/v2.1/servers/e43fa43a-f523-4438-a8ba-a4460ea4a210" status: 200 len: 1325 microversion: 2.1 time: 0.180763 Nov 01 18:57:47.625053 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 486/1008] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:57:47 2022] GET /compute/v2.1/servers/e43fa43a-f523-4438-a8ba-a4460ea4a210 => generated 1325 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:57:47.646515 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.objects.instance [None req-475768f6-46a0-4bcf-9e83-cd42f82799be tempest-ServersAdmin275Test-1925739795 tempest-ServersAdmin275Test-1925739795-project-admin] Lazy-loading 'services' on Instance uuid 87679611-878a-49b2-bf8f-39e784c6d70b {{(pid=121402) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 01 18:57:47.663628 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-475768f6-46a0-4bcf-9e83-cd42f82799be tempest-ServersAdmin275Test-1925739795 tempest-ServersAdmin275Test-1925739795-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/87679611-878a-49b2-bf8f-39e784c6d70b" status: 200 len: 1935 microversion: 2.75 time: 0.142935 Nov 01 18:57:47.664204 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 523/1009] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 18:57:47 2022] GET /compute/v2.1/servers/87679611-878a-49b2-bf8f-39e784c6d70b => generated 1935 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 18:57:47.745264 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-12690972-65e9-40d3-8b4d-795ae39c9d51 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:57:47.746207 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-12690972-65e9-40d3-8b4d-795ae39c9d51 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] [instance: ea631032-dd04-429b-988e-e6362ea42cf7] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:57:47.753141 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-12690972-65e9-40d3-8b4d-795ae39c9d51 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:47.753696 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-12690972-65e9-40d3-8b4d-795ae39c9d51 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:47.754202 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-12690972-65e9-40d3-8b4d-795ae39c9d51 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:47.754957 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-12690972-65e9-40d3-8b4d-795ae39c9d51 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:47.755472 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-12690972-65e9-40d3-8b4d-795ae39c9d51 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:47.756087 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-12690972-65e9-40d3-8b4d-795ae39c9d51 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:47.851747 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-12690972-65e9-40d3-8b4d-795ae39c9d51 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c1314c21d8547ff890ede1c2ad281c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c804370880454c7aa02cef2c2c3cf144', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:57:47.860114 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-12690972-65e9-40d3-8b4d-795ae39c9d51 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c1314c21d8547ff890ede1c2ad281c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c804370880454c7aa02cef2c2c3cf144', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:57:47.862352 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-12690972-65e9-40d3-8b4d-795ae39c9d51 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c1314c21d8547ff890ede1c2ad281c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c804370880454c7aa02cef2c2c3cf144', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:57:47.867784 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-12690972-65e9-40d3-8b4d-795ae39c9d51 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] 10.222.0.13 "GET /compute/v2.1/servers/ea631032-dd04-429b-988e-e6362ea42cf7" status: 200 len: 1537 microversion: 2.91 time: 0.126509 Nov 01 18:57:47.868845 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 487/1010] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 18:57:47 2022] GET /compute/v2.1/servers/ea631032-dd04-429b-988e-e6362ea42cf7 => generated 1537 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 01 18:57:48.282971 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-8182c5da-0e0e-4a84-b825-b6e2fa38cc6a tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:57:48.284393 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-8182c5da-0e0e-4a84-b825-b6e2fa38cc6a tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] [instance: 7218f99b-b011-4f08-931e-340d47069f6e] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:57:48.291216 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-8182c5da-0e0e-4a84-b825-b6e2fa38cc6a tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:48.291759 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-8182c5da-0e0e-4a84-b825-b6e2fa38cc6a tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:48.292196 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-8182c5da-0e0e-4a84-b825-b6e2fa38cc6a tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:48.293246 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-8182c5da-0e0e-4a84-b825-b6e2fa38cc6a tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:48.293710 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-8182c5da-0e0e-4a84-b825-b6e2fa38cc6a tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:48.294127 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-8182c5da-0e0e-4a84-b825-b6e2fa38cc6a tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:48.540423 n-d-863052-2 devstack@n-api.service[121403]: DEBUG dbcounter [-] [121403] Writing DB stats nova_cell0:SELECT=14 {{(pid=121403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 18:57:48.547055 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-793d31f8-6e52-42e5-9f92-b3b9857504d4 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:57:48.547753 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-793d31f8-6e52-42e5-9f92-b3b9857504d4 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] [instance: 869ca597-f199-474f-a680-59b0a75512c7] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:57:48.555990 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-793d31f8-6e52-42e5-9f92-b3b9857504d4 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:48.556568 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-793d31f8-6e52-42e5-9f92-b3b9857504d4 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:48.557051 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-793d31f8-6e52-42e5-9f92-b3b9857504d4 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:48.557821 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-793d31f8-6e52-42e5-9f92-b3b9857504d4 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:48.557945 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-8182c5da-0e0e-4a84-b825-b6e2fa38cc6a tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72117f17294649d6b8bc16c66c7efab2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45d4c047d3c44324a27a27831236ab0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:57:48.558557 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-793d31f8-6e52-42e5-9f92-b3b9857504d4 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:48.559317 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-793d31f8-6e52-42e5-9f92-b3b9857504d4 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:48.568682 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-8182c5da-0e0e-4a84-b825-b6e2fa38cc6a tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] 10.222.0.13 "GET /compute/v2.1/servers/7218f99b-b011-4f08-931e-340d47069f6e" status: 200 len: 1476 microversion: 2.1 time: 0.289464 Nov 01 18:57:48.578556 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 524/1011] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:57:48 2022] GET /compute/v2.1/servers/7218f99b-b011-4f08-931e-340d47069f6e => generated 1476 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:57:48.647930 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-e798154f-3397-48f3-8f89-a7b6fc0e102c tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:57:48.648541 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-e798154f-3397-48f3-8f89-a7b6fc0e102c tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] [instance: e43fa43a-f523-4438-a8ba-a4460ea4a210] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:57:48.657213 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e798154f-3397-48f3-8f89-a7b6fc0e102c tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:48.658124 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e798154f-3397-48f3-8f89-a7b6fc0e102c tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:48.658767 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e798154f-3397-48f3-8f89-a7b6fc0e102c tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:48.659652 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e798154f-3397-48f3-8f89-a7b6fc0e102c tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:48.661026 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e798154f-3397-48f3-8f89-a7b6fc0e102c tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:48.661651 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e798154f-3397-48f3-8f89-a7b6fc0e102c tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:48.714533 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-793d31f8-6e52-42e5-9f92-b3b9857504d4 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a63d69c99a546f0af16329cff3ca717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a1bb191cff948e99c008b5e861ce4a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:57:48.724197 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-793d31f8-6e52-42e5-9f92-b3b9857504d4 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] 10.222.0.13 "GET /compute/v2.1/servers/869ca597-f199-474f-a680-59b0a75512c7" status: 200 len: 1321 microversion: 2.1 time: 0.185765 Nov 01 18:57:48.724810 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 488/1012] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:57:48 2022] GET /compute/v2.1/servers/869ca597-f199-474f-a680-59b0a75512c7 => generated 1321 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 18:57:48.731964 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-12cb4be1-5e65-4735-b726-1823c6749bc3 tempest-ServersAdmin275Test-1925739795 tempest-ServersAdmin275Test-1925739795-project-admin] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:57:48.732573 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-12cb4be1-5e65-4735-b726-1823c6749bc3 tempest-ServersAdmin275Test-1925739795 tempest-ServersAdmin275Test-1925739795-project-admin] [instance: 87679611-878a-49b2-bf8f-39e784c6d70b] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:57:48.738568 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-12cb4be1-5e65-4735-b726-1823c6749bc3 tempest-ServersAdmin275Test-1925739795 tempest-ServersAdmin275Test-1925739795-project-admin] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:48.739352 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-12cb4be1-5e65-4735-b726-1823c6749bc3 tempest-ServersAdmin275Test-1925739795 tempest-ServersAdmin275Test-1925739795-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:48.739470 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-12cb4be1-5e65-4735-b726-1823c6749bc3 tempest-ServersAdmin275Test-1925739795 tempest-ServersAdmin275Test-1925739795-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:48.740171 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-12cb4be1-5e65-4735-b726-1823c6749bc3 tempest-ServersAdmin275Test-1925739795 tempest-ServersAdmin275Test-1925739795-project-admin] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:48.740645 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-12cb4be1-5e65-4735-b726-1823c6749bc3 tempest-ServersAdmin275Test-1925739795 tempest-ServersAdmin275Test-1925739795-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:48.741074 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-12cb4be1-5e65-4735-b726-1823c6749bc3 tempest-ServersAdmin275Test-1925739795 tempest-ServersAdmin275Test-1925739795-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:48.817423 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.objects.instance [None req-12cb4be1-5e65-4735-b726-1823c6749bc3 tempest-ServersAdmin275Test-1925739795 tempest-ServersAdmin275Test-1925739795-project-admin] Lazy-loading 'services' on Instance uuid 87679611-878a-49b2-bf8f-39e784c6d70b {{(pid=121403) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 01 18:57:48.834942 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-12cb4be1-5e65-4735-b726-1823c6749bc3 tempest-ServersAdmin275Test-1925739795 tempest-ServersAdmin275Test-1925739795-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/87679611-878a-49b2-bf8f-39e784c6d70b" status: 200 len: 1935 microversion: 2.75 time: 0.106605 Nov 01 18:57:48.835532 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 489/1013] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 18:57:48 2022] GET /compute/v2.1/servers/87679611-878a-49b2-bf8f-39e784c6d70b => generated 1935 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 18:57:48.896164 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-bd6be0c5-8aba-4f23-97b8-4fb5aa0e3888 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:57:48.897016 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-bd6be0c5-8aba-4f23-97b8-4fb5aa0e3888 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] [instance: ea631032-dd04-429b-988e-e6362ea42cf7] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:57:48.903847 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-bd6be0c5-8aba-4f23-97b8-4fb5aa0e3888 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:48.904339 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-bd6be0c5-8aba-4f23-97b8-4fb5aa0e3888 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:48.904811 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-bd6be0c5-8aba-4f23-97b8-4fb5aa0e3888 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:48.905544 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-bd6be0c5-8aba-4f23-97b8-4fb5aa0e3888 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:48.905998 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-bd6be0c5-8aba-4f23-97b8-4fb5aa0e3888 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:48.906420 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-bd6be0c5-8aba-4f23-97b8-4fb5aa0e3888 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:48.974283 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-bd6be0c5-8aba-4f23-97b8-4fb5aa0e3888 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c1314c21d8547ff890ede1c2ad281c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c804370880454c7aa02cef2c2c3cf144', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:57:48.982772 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-bd6be0c5-8aba-4f23-97b8-4fb5aa0e3888 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c1314c21d8547ff890ede1c2ad281c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c804370880454c7aa02cef2c2c3cf144', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:57:48.984270 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-bd6be0c5-8aba-4f23-97b8-4fb5aa0e3888 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c1314c21d8547ff890ede1c2ad281c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c804370880454c7aa02cef2c2c3cf144', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:57:48.990274 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-bd6be0c5-8aba-4f23-97b8-4fb5aa0e3888 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] 10.222.0.13 "GET /compute/v2.1/servers/ea631032-dd04-429b-988e-e6362ea42cf7" status: 200 len: 1537 microversion: 2.91 time: 0.098687 Nov 01 18:57:48.990859 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 490/1014] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 18:57:48 2022] GET /compute/v2.1/servers/ea631032-dd04-429b-988e-e6362ea42cf7 => generated 1537 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 01 18:57:49.157008 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-e798154f-3397-48f3-8f89-a7b6fc0e102c tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b52b7dcbb044f9bfc424e4417c77fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '708bc0ea4b5a4baf81933725792bedd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:57:49.165116 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-e798154f-3397-48f3-8f89-a7b6fc0e102c tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] 10.222.0.13 "GET /compute/v2.1/servers/e43fa43a-f523-4438-a8ba-a4460ea4a210" status: 200 len: 1523 microversion: 2.1 time: 0.521038 Nov 01 18:57:49.165686 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 525/1015] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:57:48 2022] GET /compute/v2.1/servers/e43fa43a-f523-4438-a8ba-a4460ea4a210 => generated 1523 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 18:57:49.192144 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-28dc0848-96d1-4451-b535-681405af6e07 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:57:49.194120 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-28dc0848-96d1-4451-b535-681405af6e07 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] [instance: e43fa43a-f523-4438-a8ba-a4460ea4a210] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:57:49.201177 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-28dc0848-96d1-4451-b535-681405af6e07 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:49.201854 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-28dc0848-96d1-4451-b535-681405af6e07 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:49.202833 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-28dc0848-96d1-4451-b535-681405af6e07 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:49.203986 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-28dc0848-96d1-4451-b535-681405af6e07 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:49.205063 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-28dc0848-96d1-4451-b535-681405af6e07 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:49.206107 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-28dc0848-96d1-4451-b535-681405af6e07 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:49.362150 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-28dc0848-96d1-4451-b535-681405af6e07 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b52b7dcbb044f9bfc424e4417c77fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '708bc0ea4b5a4baf81933725792bedd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:57:49.373682 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-28dc0848-96d1-4451-b535-681405af6e07 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] 10.222.0.13 "GET /compute/v2.1/servers/e43fa43a-f523-4438-a8ba-a4460ea4a210" status: 200 len: 1523 microversion: 2.1 time: 0.186040 Nov 01 18:57:49.376144 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 491/1016] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:57:49 2022] GET /compute/v2.1/servers/e43fa43a-f523-4438-a8ba-a4460ea4a210 => generated 1523 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:57:49.402226 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-c73433c1-b9ee-47ae-bf3b-041eec2bfc37 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-762488883"}} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 18:57:49.405131 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-c73433c1-b9ee-47ae-bf3b-041eec2bfc37 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] [instance: e43fa43a-f523-4438-a8ba-a4460ea4a210] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:57:49.416390 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-c73433c1-b9ee-47ae-bf3b-041eec2bfc37 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:49.418054 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-c73433c1-b9ee-47ae-bf3b-041eec2bfc37 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:49.423409 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-c73433c1-b9ee-47ae-bf3b-041eec2bfc37 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:49.424890 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-c73433c1-b9ee-47ae-bf3b-041eec2bfc37 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:49.427293 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-c73433c1-b9ee-47ae-bf3b-041eec2bfc37 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:49.428138 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-c73433c1-b9ee-47ae-bf3b-041eec2bfc37 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:49.597890 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-3a2742de-34a5-40bf-9a95-009f2d70d851 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:57:49.598501 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-3a2742de-34a5-40bf-9a95-009f2d70d851 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] [instance: 7218f99b-b011-4f08-931e-340d47069f6e] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:57:49.607336 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-3a2742de-34a5-40bf-9a95-009f2d70d851 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:49.608072 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-3a2742de-34a5-40bf-9a95-009f2d70d851 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:49.608248 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-3a2742de-34a5-40bf-9a95-009f2d70d851 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:49.609293 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-3a2742de-34a5-40bf-9a95-009f2d70d851 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:49.609931 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-3a2742de-34a5-40bf-9a95-009f2d70d851 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:49.610658 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-3a2742de-34a5-40bf-9a95-009f2d70d851 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:49.759857 n-d-863052-2 devstack@n-api.service[121402]: DEBUG dbcounter [-] [121402] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 18:57:49.781780 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-c73433c1-b9ee-47ae-bf3b-041eec2bfc37 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] 10.222.0.13 "POST /compute/v2.1/servers/e43fa43a-f523-4438-a8ba-a4460ea4a210/action" status: 202 len: 0 microversion: 2.1 time: 0.388872 Nov 01 18:57:49.784516 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 526/1017] 10.222.0.13 () {60 vars in 1278 bytes} [Tue Nov 1 18:57:49 2022] POST /compute/v2.1/servers/e43fa43a-f523-4438-a8ba-a4460ea4a210/action => generated 0 bytes in 392 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 01 18:57:49.793384 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-89f221c7-0808-42c3-933a-2533da849a07 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:57:49.794872 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-89f221c7-0808-42c3-933a-2533da849a07 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] [instance: 869ca597-f199-474f-a680-59b0a75512c7] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:57:49.803562 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-89f221c7-0808-42c3-933a-2533da849a07 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:49.804869 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-89f221c7-0808-42c3-933a-2533da849a07 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:49.806087 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-89f221c7-0808-42c3-933a-2533da849a07 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:49.807079 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-89f221c7-0808-42c3-933a-2533da849a07 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:49.807769 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-89f221c7-0808-42c3-933a-2533da849a07 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:49.808405 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-89f221c7-0808-42c3-933a-2533da849a07 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:49.842757 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-3a2742de-34a5-40bf-9a95-009f2d70d851 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72117f17294649d6b8bc16c66c7efab2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45d4c047d3c44324a27a27831236ab0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:57:49.854786 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-3a2742de-34a5-40bf-9a95-009f2d70d851 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] 10.222.0.13 "GET /compute/v2.1/servers/7218f99b-b011-4f08-931e-340d47069f6e" status: 200 len: 1476 microversion: 2.1 time: 0.264038 Nov 01 18:57:49.863329 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 492/1018] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:57:49 2022] GET /compute/v2.1/servers/7218f99b-b011-4f08-931e-340d47069f6e => generated 1476 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:57:49.869851 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-b2bcab6e-7855-4b76-ba59-2fa08e79a512 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Calling method '.version_select at 0x7f0ae2824b80>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:57:50.051439 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-b2bcab6e-7855-4b76-ba59-2fa08e79a512 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] 10.222.0.13 "DELETE /compute/v2.1/images/1c57a094-5a17-4bde-a122-affe79707cb2" status: 204 len: 0 microversion: 2.1 time: 0.186017 Nov 01 18:57:50.052071 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 493/1019] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:57:49 2022] DELETE /compute/v2.1/images/1c57a094-5a17-4bde-a122-affe79707cb2 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 01 18:57:50.056193 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-89f221c7-0808-42c3-933a-2533da849a07 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a63d69c99a546f0af16329cff3ca717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a1bb191cff948e99c008b5e861ce4a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:57:50.067470 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-89f221c7-0808-42c3-933a-2533da849a07 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] 10.222.0.13 "GET /compute/v2.1/servers/869ca597-f199-474f-a680-59b0a75512c7" status: 200 len: 1321 microversion: 2.1 time: 0.280629 Nov 01 18:57:50.080882 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-4b67b8ee-5187-43dc-99f9-a4e2f86b203d tempest-ServersAdmin275Test-1925739795 tempest-ServersAdmin275Test-1925739795-project-admin] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:57:50.080882 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-4b67b8ee-5187-43dc-99f9-a4e2f86b203d tempest-ServersAdmin275Test-1925739795 tempest-ServersAdmin275Test-1925739795-project-admin] [instance: 87679611-878a-49b2-bf8f-39e784c6d70b] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:57:50.080882 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-4b67b8ee-5187-43dc-99f9-a4e2f86b203d tempest-ServersAdmin275Test-1925739795 tempest-ServersAdmin275Test-1925739795-project-admin] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:50.080882 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-4b67b8ee-5187-43dc-99f9-a4e2f86b203d tempest-ServersAdmin275Test-1925739795 tempest-ServersAdmin275Test-1925739795-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:50.081727 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-4b67b8ee-5187-43dc-99f9-a4e2f86b203d tempest-ServersAdmin275Test-1925739795 tempest-ServersAdmin275Test-1925739795-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:50.081727 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-4b67b8ee-5187-43dc-99f9-a4e2f86b203d tempest-ServersAdmin275Test-1925739795 tempest-ServersAdmin275Test-1925739795-project-admin] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:50.081727 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-4b67b8ee-5187-43dc-99f9-a4e2f86b203d tempest-ServersAdmin275Test-1925739795 tempest-ServersAdmin275Test-1925739795-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:50.081727 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-4b67b8ee-5187-43dc-99f9-a4e2f86b203d tempest-ServersAdmin275Test-1925739795 tempest-ServersAdmin275Test-1925739795-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:50.083363 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 527/1020] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:57:49 2022] GET /compute/v2.1/servers/869ca597-f199-474f-a680-59b0a75512c7 => generated 1321 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:57:50.095626 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-f71481f6-3fbb-4b82-851a-86be74018f6a tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:57:50.096325 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-f71481f6-3fbb-4b82-851a-86be74018f6a tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] [instance: ea631032-dd04-429b-988e-e6362ea42cf7] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:57:50.104101 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f71481f6-3fbb-4b82-851a-86be74018f6a tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:50.104813 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f71481f6-3fbb-4b82-851a-86be74018f6a tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:50.105464 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f71481f6-3fbb-4b82-851a-86be74018f6a tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:50.106220 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f71481f6-3fbb-4b82-851a-86be74018f6a tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:50.106865 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f71481f6-3fbb-4b82-851a-86be74018f6a tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:50.107386 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f71481f6-3fbb-4b82-851a-86be74018f6a tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:50.172675 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.objects.instance [None req-4b67b8ee-5187-43dc-99f9-a4e2f86b203d tempest-ServersAdmin275Test-1925739795 tempest-ServersAdmin275Test-1925739795-project-admin] Lazy-loading 'services' on Instance uuid 87679611-878a-49b2-bf8f-39e784c6d70b {{(pid=121403) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 01 18:57:50.191326 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-f71481f6-3fbb-4b82-851a-86be74018f6a tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c1314c21d8547ff890ede1c2ad281c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c804370880454c7aa02cef2c2c3cf144', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:57:50.198373 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-4b67b8ee-5187-43dc-99f9-a4e2f86b203d tempest-ServersAdmin275Test-1925739795 tempest-ServersAdmin275Test-1925739795-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/87679611-878a-49b2-bf8f-39e784c6d70b" status: 200 len: 1920 microversion: 2.75 time: 0.139754 Nov 01 18:57:50.199107 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 494/1021] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 18:57:50 2022] GET /compute/v2.1/servers/87679611-878a-49b2-bf8f-39e784c6d70b => generated 1920 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 18:57:50.207827 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-26e8821a-3a93-4c0b-961f-464371adc178 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Calling method '.version_select at 0x7f0ae2826820>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:57:50.208255 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-f71481f6-3fbb-4b82-851a-86be74018f6a tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c1314c21d8547ff890ede1c2ad281c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c804370880454c7aa02cef2c2c3cf144', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:57:50.209987 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-f71481f6-3fbb-4b82-851a-86be74018f6a tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c1314c21d8547ff890ede1c2ad281c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c804370880454c7aa02cef2c2c3cf144', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:57:50.219074 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-f71481f6-3fbb-4b82-851a-86be74018f6a tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] 10.222.0.13 "GET /compute/v2.1/servers/ea631032-dd04-429b-988e-e6362ea42cf7" status: 200 len: 1537 microversion: 2.91 time: 0.134260 Nov 01 18:57:50.219912 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 528/1022] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 18:57:50 2022] GET /compute/v2.1/servers/ea631032-dd04-429b-988e-e6362ea42cf7 => generated 1537 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 18:57:50.240162 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-1c9e00b9-4aa4-49d6-8a50-7443b5db2f5e tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:57:50.240678 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-1c9e00b9-4aa4-49d6-8a50-7443b5db2f5e tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] [instance: 87679611-878a-49b2-bf8f-39e784c6d70b] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:57:50.249087 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-1c9e00b9-4aa4-49d6-8a50-7443b5db2f5e tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:50.249728 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-1c9e00b9-4aa4-49d6-8a50-7443b5db2f5e tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:50.250211 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-1c9e00b9-4aa4-49d6-8a50-7443b5db2f5e tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:50.251651 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-1c9e00b9-4aa4-49d6-8a50-7443b5db2f5e tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:50.253758 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-1c9e00b9-4aa4-49d6-8a50-7443b5db2f5e tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:50.253758 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-1c9e00b9-4aa4-49d6-8a50-7443b5db2f5e tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:50.258526 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.wsgi [None req-26e8821a-3a93-4c0b-961f-464371adc178 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] HTTP exception thrown: Image not found. Nov 01 18:57:50.279588 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-26e8821a-3a93-4c0b-961f-464371adc178 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Request method failure captured: Nov 01 18:57:50.279588 n-d-863052-2 devstack@n-api.service[121403]: request: GET /compute/v2.1/images/1c57a094-5a17-4bde-a122-affe79707cb2 HTTP/1.1 Nov 01 18:57:50.279588 n-d-863052-2 devstack@n-api.service[121403]: Accept: application/json Nov 01 18:57:50.279588 n-d-863052-2 devstack@n-api.service[121403]: Accept-Encoding: identity Nov 01 18:57:50.279588 n-d-863052-2 devstack@n-api.service[121403]: Connection: close Nov 01 18:57:50.279588 n-d-863052-2 devstack@n-api.service[121403]: Content-Length: 0 Nov 01 18:57:50.279588 n-d-863052-2 devstack@n-api.service[121403]: Content-Type: application/json Nov 01 18:57:50.279588 n-d-863052-2 devstack@n-api.service[121403]: Host: 10.222.0.13 Nov 01 18:57:50.279588 n-d-863052-2 devstack@n-api.service[121403]: Openstack-System-Scope: None Nov 01 18:57:50.279588 n-d-863052-2 devstack@n-api.service[121403]: User-Agent: python-urllib3/1.26.12 Nov 01 18:57:50.279588 n-d-863052-2 devstack@n-api.service[121403]: X-Auth-Token: gAAAAABjYWvqbQtaNCf0vN3RIHicQ7eZzuMpptpvowYCNSOJcJRxrJ9QX4Bvdyyh6S1_lak_JDolcn4qSC02atGGl8uI3NqpWQKt52qXcbtBLMPpaEiNHqRmhd3SjpSTdiucZ2dSpVmatQ9uPpkpENeFkI_E8IIwNVu5-V-pSAlLNGA0j86IptM Nov 01 18:57:50.279588 n-d-863052-2 devstack@n-api.service[121403]: X-Domain-Id: None Nov 01 18:57:50.279588 n-d-863052-2 devstack@n-api.service[121403]: X-Domain-Name: None Nov 01 18:57:50.279588 n-d-863052-2 devstack@n-api.service[121403]: X-Identity-Status: Confirmed Nov 01 18:57:50.279588 n-d-863052-2 devstack@n-api.service[121403]: X-Is-Admin-Project: True Nov 01 18:57:50.279588 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Domain-Id: default Nov 01 18:57:50.279588 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Domain-Name: Default Nov 01 18:57:50.279588 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Id: 708bc0ea4b5a4baf81933725792bedd5 Nov 01 18:57:50.279588 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1431666313 Nov 01 18:57:50.279588 n-d-863052-2 devstack@n-api.service[121403]: X-Role: member,reader Nov 01 18:57:50.279588 n-d-863052-2 devstack@n-api.service[121403]: X-Roles: member,reader Nov 01 18:57:50.281058 n-d-863052-2 devstack@n-api.service[121403]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/708bc0ea4b5a4baf81933725792bedd5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/708bc0ea4b5a4baf81933725792bedd5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_708bc0ea4b5a4baf81933725792bedd5", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/708bc0ea4b5a4baf81933725792bedd5"}]}] Nov 01 18:57:50.281058 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1431666313 Nov 01 18:57:50.281058 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant-Id: 708bc0ea4b5a4baf81933725792bedd5 Nov 01 18:57:50.281058 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1431666313 Nov 01 18:57:50.281058 n-d-863052-2 devstack@n-api.service[121403]: X-User: tempest-ImagesOneServerNegativeTestJSON-1431666313-project Nov 01 18:57:50.281058 n-d-863052-2 devstack@n-api.service[121403]: X-User-Domain-Id: default Nov 01 18:57:50.281058 n-d-863052-2 devstack@n-api.service[121403]: X-User-Domain-Name: Default Nov 01 18:57:50.281058 n-d-863052-2 devstack@n-api.service[121403]: X-User-Id: 09b52b7dcbb044f9bfc424e4417c77fa Nov 01 18:57:50.281058 n-d-863052-2 devstack@n-api.service[121403]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1431666313-project Nov 01 18:57:50.281058 n-d-863052-2 devstack@n-api.service[121403]: method: Nov 01 18:57:50.281058 n-d-863052-2 devstack@n-api.service[121403]: exception: Image not found. Nov 01 18:57:50.281058 n-d-863052-2 devstack@n-api.service[121403]: action_args: {'id': '1c57a094-5a17-4bde-a122-affe79707cb2'} Nov 01 18:57:50.281058 n-d-863052-2 devstack@n-api.service[121403]: {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 01 18:57:50.281826 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:57:50.281826 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Nov 01 18:57:50.281826 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Nov 01 18:57:50.281826 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Nov 01 18:57:50.281826 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Nov 01 18:57:50.281826 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Nov 01 18:57:50.281826 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return self._get(image_id) Nov 01 18:57:50.281826 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Nov 01 18:57:50.281826 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Nov 01 18:57:50.281826 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Nov 01 18:57:50.281826 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Nov 01 18:57:50.281826 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Nov 01 18:57:50.281826 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Nov 01 18:57:50.281826 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Nov 01 18:57:50.281826 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Nov 01 18:57:50.281826 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Nov 01 18:57:50.281826 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Nov 01 18:57:50.281826 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 1c57a094-5a17-4bde-a122-affe79707cb2 Nov 01 18:57:50.282906 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 18:57:50.282906 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 18:57:50.282906 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 18:57:50.282906 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:57:50.282906 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Nov 01 18:57:50.282906 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Nov 01 18:57:50.282906 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Nov 01 18:57:50.282906 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Nov 01 18:57:50.282906 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Nov 01 18:57:50.282906 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Nov 01 18:57:50.282906 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Nov 01 18:57:50.282906 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Nov 01 18:57:50.282906 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Nov 01 18:57:50.282906 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Nov 01 18:57:50.282906 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Nov 01 18:57:50.282906 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Nov 01 18:57:50.282906 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Nov 01 18:57:50.282906 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return self._get(image_id) Nov 01 18:57:50.282906 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Nov 01 18:57:50.282906 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Nov 01 18:57:50.284106 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Nov 01 18:57:50.284106 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Nov 01 18:57:50.284106 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Nov 01 18:57:50.284106 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Nov 01 18:57:50.284106 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Nov 01 18:57:50.284106 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Nov 01 18:57:50.284106 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Nov 01 18:57:50.284106 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Nov 01 18:57:50.284106 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 1c57a094-5a17-4bde-a122-affe79707cb2 could not be found. Nov 01 18:57:50.284106 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 18:57:50.284106 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 18:57:50.284106 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 18:57:50.284106 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:57:50.284106 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 18:57:50.284106 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 18:57:50.284106 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 01 18:57:50.284106 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 01 18:57:50.284106 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 01 18:57:50.284106 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 01 18:57:50.285337 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 01 18:57:50.285337 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 01 18:57:50.285337 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Nov 01 18:57:50.285337 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Nov 01 18:57:50.285337 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Nov 01 18:57:50.285337 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 18:57:50.285337 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 18:57:50.285337 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 18:57:50.285337 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:57:50.285337 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 18:57:50.285337 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 18:57:50.285337 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 01 18:57:50.285337 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 01 18:57:50.285337 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Nov 01 18:57:50.285337 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 18:57:50.286855 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-26e8821a-3a93-4c0b-961f-464371adc178 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Returning 404 to user: Image not found. {{(pid=121403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 01 18:57:50.287735 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-26e8821a-3a93-4c0b-961f-464371adc178 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] 10.222.0.13 "GET /compute/v2.1/images/1c57a094-5a17-4bde-a122-affe79707cb2" status: 404 len: 62 microversion: 2.1 time: 0.087624 Nov 01 18:57:50.291523 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 495/1023] 10.222.0.13 () {58 vars in 1233 bytes} [Tue Nov 1 18:57:50 2022] GET /compute/v2.1/images/1c57a094-5a17-4bde-a122-affe79707cb2 => generated 62 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 01 18:57:50.291753 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-1c9e00b9-4aa4-49d6-8a50-7443b5db2f5e tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] [instance: 87679611-878a-49b2-bf8f-39e784c6d70b] Going to try to terminate instance {{(pid=121402) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 01 18:57:50.302145 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-90936133-062e-463b-bbb5-83e4b2e9d475 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:57:50.302145 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-90936133-062e-463b-bbb5-83e4b2e9d475 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] [instance: e43fa43a-f523-4438-a8ba-a4460ea4a210] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:57:50.307438 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-90936133-062e-463b-bbb5-83e4b2e9d475 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:50.308045 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-90936133-062e-463b-bbb5-83e4b2e9d475 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:50.308613 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-90936133-062e-463b-bbb5-83e4b2e9d475 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:50.309549 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-90936133-062e-463b-bbb5-83e4b2e9d475 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:50.309875 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-90936133-062e-463b-bbb5-83e4b2e9d475 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:50.310319 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-90936133-062e-463b-bbb5-83e4b2e9d475 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:50.383421 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-1c9e00b9-4aa4-49d6-8a50-7443b5db2f5e tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] 10.222.0.13 "DELETE /compute/v2.1/servers/87679611-878a-49b2-bf8f-39e784c6d70b" status: 204 len: 0 microversion: 2.75 time: 0.148807 Nov 01 18:57:50.387249 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 529/1024] 10.222.0.13 () {60 vars in 1280 bytes} [Tue Nov 1 18:57:50 2022] DELETE /compute/v2.1/servers/87679611-878a-49b2-bf8f-39e784c6d70b => generated 0 bytes in 151 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Nov 01 18:57:50.394808 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-91b72165-f452-4322-95e2-b635a17c419b tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:57:50.395469 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-91b72165-f452-4322-95e2-b635a17c419b tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] [instance: 87679611-878a-49b2-bf8f-39e784c6d70b] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:57:50.404393 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-91b72165-f452-4322-95e2-b635a17c419b tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:50.405944 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-91b72165-f452-4322-95e2-b635a17c419b tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:50.406654 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-91b72165-f452-4322-95e2-b635a17c419b tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:50.407494 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-91b72165-f452-4322-95e2-b635a17c419b tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:50.407957 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-91b72165-f452-4322-95e2-b635a17c419b tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:50.408411 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-91b72165-f452-4322-95e2-b635a17c419b tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:50.462391 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-90936133-062e-463b-bbb5-83e4b2e9d475 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b52b7dcbb044f9bfc424e4417c77fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '708bc0ea4b5a4baf81933725792bedd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:57:50.471010 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-90936133-062e-463b-bbb5-83e4b2e9d475 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] 10.222.0.13 "GET /compute/v2.1/servers/e43fa43a-f523-4438-a8ba-a4460ea4a210" status: 200 len: 1543 microversion: 2.1 time: 0.178184 Nov 01 18:57:50.471772 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 496/1025] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:57:50 2022] GET /compute/v2.1/servers/e43fa43a-f523-4438-a8ba-a4460ea4a210 => generated 1543 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:57:50.490504 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-91b72165-f452-4322-95e2-b635a17c419b tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '576abe5db27b461889fef2029d477e40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e9fb3117f68434bae7a463c357818dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:57:50.500462 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-91b72165-f452-4322-95e2-b635a17c419b tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '576abe5db27b461889fef2029d477e40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e9fb3117f68434bae7a463c357818dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:57:50.504123 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-91b72165-f452-4322-95e2-b635a17c419b tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '576abe5db27b461889fef2029d477e40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e9fb3117f68434bae7a463c357818dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:57:50.509794 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-91b72165-f452-4322-95e2-b635a17c419b tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] 10.222.0.13 "GET /compute/v2.1/servers/87679611-878a-49b2-bf8f-39e784c6d70b" status: 200 len: 1444 microversion: 2.75 time: 0.120959 Nov 01 18:57:50.510957 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 530/1026] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 18:57:50 2022] GET /compute/v2.1/servers/87679611-878a-49b2-bf8f-39e784c6d70b => generated 1444 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 18:57:50.879136 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-2bfe99f9-de05-4527-8fd7-3c211b6c8b17 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:57:50.879750 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-2bfe99f9-de05-4527-8fd7-3c211b6c8b17 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] [instance: 7218f99b-b011-4f08-931e-340d47069f6e] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:57:50.886696 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-2bfe99f9-de05-4527-8fd7-3c211b6c8b17 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:50.887597 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-2bfe99f9-de05-4527-8fd7-3c211b6c8b17 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:50.888193 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-2bfe99f9-de05-4527-8fd7-3c211b6c8b17 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:50.889077 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-2bfe99f9-de05-4527-8fd7-3c211b6c8b17 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:50.889689 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-2bfe99f9-de05-4527-8fd7-3c211b6c8b17 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:50.890292 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-2bfe99f9-de05-4527-8fd7-3c211b6c8b17 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:51.100076 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-83303b93-9464-4081-b743-9c9bef765616 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:57:51.100762 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-83303b93-9464-4081-b743-9c9bef765616 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] [instance: 869ca597-f199-474f-a680-59b0a75512c7] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:57:51.102794 n-d-863052-2 devstack@n-api.service[121402]: DEBUG dbcounter [-] [121402] Writing DB stats nova_cell0:SELECT=14 {{(pid=121402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 18:57:51.109802 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-83303b93-9464-4081-b743-9c9bef765616 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:51.110295 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-83303b93-9464-4081-b743-9c9bef765616 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:51.110730 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-83303b93-9464-4081-b743-9c9bef765616 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:51.111450 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-83303b93-9464-4081-b743-9c9bef765616 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:51.112444 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-83303b93-9464-4081-b743-9c9bef765616 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:51.112893 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-83303b93-9464-4081-b743-9c9bef765616 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:51.137356 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-2bfe99f9-de05-4527-8fd7-3c211b6c8b17 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72117f17294649d6b8bc16c66c7efab2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45d4c047d3c44324a27a27831236ab0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:57:51.147086 n-d-863052-2 devstack@n-api.service[121403]: DEBUG dbcounter [-] [121403] Writing DB stats nova_cell1:SELECT=100 {{(pid=121403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 18:57:51.151631 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-2bfe99f9-de05-4527-8fd7-3c211b6c8b17 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] 10.222.0.13 "GET /compute/v2.1/servers/7218f99b-b011-4f08-931e-340d47069f6e" status: 200 len: 1476 microversion: 2.1 time: 0.276365 Nov 01 18:57:51.152360 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 497/1027] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:57:50 2022] GET /compute/v2.1/servers/7218f99b-b011-4f08-931e-340d47069f6e => generated 1476 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 18:57:51.252353 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-83303b93-9464-4081-b743-9c9bef765616 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a63d69c99a546f0af16329cff3ca717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a1bb191cff948e99c008b5e861ce4a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:57:51.257277 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-64e79f66-4129-4bd0-826f-f2f7f52b5e74 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:57:51.257982 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-64e79f66-4129-4bd0-826f-f2f7f52b5e74 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] [instance: ea631032-dd04-429b-988e-e6362ea42cf7] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:57:51.261365 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-83303b93-9464-4081-b743-9c9bef765616 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] 10.222.0.13 "GET /compute/v2.1/servers/869ca597-f199-474f-a680-59b0a75512c7" status: 200 len: 1321 microversion: 2.1 time: 0.165572 Nov 01 18:57:51.261836 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 531/1028] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:57:51 2022] GET /compute/v2.1/servers/869ca597-f199-474f-a680-59b0a75512c7 => generated 1321 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 18:57:51.264820 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-64e79f66-4129-4bd0-826f-f2f7f52b5e74 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:51.265395 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-64e79f66-4129-4bd0-826f-f2f7f52b5e74 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:51.265930 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-64e79f66-4129-4bd0-826f-f2f7f52b5e74 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:51.266791 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-64e79f66-4129-4bd0-826f-f2f7f52b5e74 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:51.267346 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-64e79f66-4129-4bd0-826f-f2f7f52b5e74 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:51.268384 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-64e79f66-4129-4bd0-826f-f2f7f52b5e74 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:51.350201 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-64e79f66-4129-4bd0-826f-f2f7f52b5e74 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c1314c21d8547ff890ede1c2ad281c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c804370880454c7aa02cef2c2c3cf144', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:57:51.367327 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-64e79f66-4129-4bd0-826f-f2f7f52b5e74 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c1314c21d8547ff890ede1c2ad281c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c804370880454c7aa02cef2c2c3cf144', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:57:51.369606 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-64e79f66-4129-4bd0-826f-f2f7f52b5e74 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c1314c21d8547ff890ede1c2ad281c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c804370880454c7aa02cef2c2c3cf144', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:57:51.375758 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-64e79f66-4129-4bd0-826f-f2f7f52b5e74 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] 10.222.0.13 "GET /compute/v2.1/servers/ea631032-dd04-429b-988e-e6362ea42cf7" status: 200 len: 1537 microversion: 2.91 time: 0.122468 Nov 01 18:57:51.376568 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 498/1029] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 18:57:51 2022] GET /compute/v2.1/servers/ea631032-dd04-429b-988e-e6362ea42cf7 => generated 1537 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 01 18:57:51.494866 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-8d3071cd-32ca-4a78-a799-3ef57f8f4d7b tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:57:51.495481 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-8d3071cd-32ca-4a78-a799-3ef57f8f4d7b tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] [instance: e43fa43a-f523-4438-a8ba-a4460ea4a210] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:57:51.502595 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-8d3071cd-32ca-4a78-a799-3ef57f8f4d7b tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:51.503087 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-8d3071cd-32ca-4a78-a799-3ef57f8f4d7b tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:51.503527 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-8d3071cd-32ca-4a78-a799-3ef57f8f4d7b tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:51.504265 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-8d3071cd-32ca-4a78-a799-3ef57f8f4d7b tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:51.504757 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-8d3071cd-32ca-4a78-a799-3ef57f8f4d7b tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:51.505183 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-8d3071cd-32ca-4a78-a799-3ef57f8f4d7b tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:51.542990 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-5a6f653e-4ac4-42ca-b100-6f1e73cce8ad tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:57:51.551198 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-5a6f653e-4ac4-42ca-b100-6f1e73cce8ad tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] [instance: 87679611-878a-49b2-bf8f-39e784c6d70b] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:57:51.569397 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-5a6f653e-4ac4-42ca-b100-6f1e73cce8ad tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:51.570123 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-5a6f653e-4ac4-42ca-b100-6f1e73cce8ad tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:51.570724 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-5a6f653e-4ac4-42ca-b100-6f1e73cce8ad tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:51.571659 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-5a6f653e-4ac4-42ca-b100-6f1e73cce8ad tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:51.572453 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-5a6f653e-4ac4-42ca-b100-6f1e73cce8ad tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:51.573408 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-5a6f653e-4ac4-42ca-b100-6f1e73cce8ad tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:51.658059 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-8d3071cd-32ca-4a78-a799-3ef57f8f4d7b tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b52b7dcbb044f9bfc424e4417c77fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '708bc0ea4b5a4baf81933725792bedd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:57:51.669652 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-8d3071cd-32ca-4a78-a799-3ef57f8f4d7b tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] 10.222.0.13 "GET /compute/v2.1/servers/e43fa43a-f523-4438-a8ba-a4460ea4a210" status: 200 len: 1535 microversion: 2.1 time: 0.178334 Nov 01 18:57:51.670340 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 532/1030] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:57:51 2022] GET /compute/v2.1/servers/e43fa43a-f523-4438-a8ba-a4460ea4a210 => generated 1535 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:57:51.715184 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-5a6f653e-4ac4-42ca-b100-6f1e73cce8ad tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '576abe5db27b461889fef2029d477e40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e9fb3117f68434bae7a463c357818dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:57:51.724048 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-5a6f653e-4ac4-42ca-b100-6f1e73cce8ad tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '576abe5db27b461889fef2029d477e40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e9fb3117f68434bae7a463c357818dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:57:51.725536 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-5a6f653e-4ac4-42ca-b100-6f1e73cce8ad tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '576abe5db27b461889fef2029d477e40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e9fb3117f68434bae7a463c357818dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:57:51.731577 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-5a6f653e-4ac4-42ca-b100-6f1e73cce8ad tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] 10.222.0.13 "GET /compute/v2.1/servers/87679611-878a-49b2-bf8f-39e784c6d70b" status: 200 len: 1444 microversion: 2.75 time: 0.195781 Nov 01 18:57:51.748406 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 499/1031] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 18:57:51 2022] GET /compute/v2.1/servers/87679611-878a-49b2-bf8f-39e784c6d70b => generated 1444 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 18:57:51.800628 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [req-9e0c642e-ab78-4789-a5f3-4f6b79957845 req-9d955a51-d470-42b1-8f54-0803eeb424e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed4798be-a45e-46f5-8f7e-1165f6479bd1", "name": "network-vif-plugged", "status": "completed", "tag": "0dfdc28e-1bcb-444f-bd33-acd74444c684"}]} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 18:57:51.811502 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-9e0c642e-ab78-4789-a5f3-4f6b79957845 req-9d955a51-d470-42b1-8f54-0803eeb424e4 service nova] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:51.812525 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-9e0c642e-ab78-4789-a5f3-4f6b79957845 req-9d955a51-d470-42b1-8f54-0803eeb424e4 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:51.813072 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-9e0c642e-ab78-4789-a5f3-4f6b79957845 req-9d955a51-d470-42b1-8f54-0803eeb424e4 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:51.826537 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.compute.server_external_events [req-9e0c642e-ab78-4789-a5f3-4f6b79957845 req-9d955a51-d470-42b1-8f54-0803eeb424e4 service nova] Creating event network-vif-plugged:0dfdc28e-1bcb-444f-bd33-acd74444c684 for instance ed4798be-a45e-46f5-8f7e-1165f6479bd1 on n-h1-863052-2 Nov 01 18:57:51.832494 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [req-9e0c642e-ab78-4789-a5f3-4f6b79957845 req-9d955a51-d470-42b1-8f54-0803eeb424e4 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036161 Nov 01 18:57:51.833741 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 533/1032] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Nov 1 18:57:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 18:57:52.177982 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-fdb85a15-cc62-4e11-a8e8-d16416a35044 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:57:52.179204 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-fdb85a15-cc62-4e11-a8e8-d16416a35044 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] [instance: 7218f99b-b011-4f08-931e-340d47069f6e] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:57:52.187966 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-fdb85a15-cc62-4e11-a8e8-d16416a35044 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:52.188570 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-fdb85a15-cc62-4e11-a8e8-d16416a35044 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:52.189259 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-fdb85a15-cc62-4e11-a8e8-d16416a35044 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:52.190793 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-fdb85a15-cc62-4e11-a8e8-d16416a35044 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:52.191300 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-fdb85a15-cc62-4e11-a8e8-d16416a35044 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:52.191806 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-fdb85a15-cc62-4e11-a8e8-d16416a35044 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:52.284929 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-aff3fe0d-1f6f-4d62-97c3-f936156a2701 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:57:52.286050 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-aff3fe0d-1f6f-4d62-97c3-f936156a2701 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] [instance: 869ca597-f199-474f-a680-59b0a75512c7] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:57:52.292806 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-aff3fe0d-1f6f-4d62-97c3-f936156a2701 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:52.295612 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-aff3fe0d-1f6f-4d62-97c3-f936156a2701 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:52.296296 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-aff3fe0d-1f6f-4d62-97c3-f936156a2701 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:52.297160 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-aff3fe0d-1f6f-4d62-97c3-f936156a2701 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:52.297629 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-aff3fe0d-1f6f-4d62-97c3-f936156a2701 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:52.298340 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-aff3fe0d-1f6f-4d62-97c3-f936156a2701 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:52.451025 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-aff3fe0d-1f6f-4d62-97c3-f936156a2701 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a63d69c99a546f0af16329cff3ca717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a1bb191cff948e99c008b5e861ce4a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:57:52.460610 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-aff3fe0d-1f6f-4d62-97c3-f936156a2701 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] 10.222.0.13 "GET /compute/v2.1/servers/869ca597-f199-474f-a680-59b0a75512c7" status: 200 len: 1321 microversion: 2.1 time: 0.179854 Nov 01 18:57:52.462152 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 534/1033] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:57:52 2022] GET /compute/v2.1/servers/869ca597-f199-474f-a680-59b0a75512c7 => generated 1321 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:57:52.481674 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-e12e70e5-de3c-4809-9ecb-a51b0582b069 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:57:52.482598 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-e12e70e5-de3c-4809-9ecb-a51b0582b069 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] [instance: ea631032-dd04-429b-988e-e6362ea42cf7] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:57:52.490729 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e12e70e5-de3c-4809-9ecb-a51b0582b069 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:52.491688 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e12e70e5-de3c-4809-9ecb-a51b0582b069 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:52.492390 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e12e70e5-de3c-4809-9ecb-a51b0582b069 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:52.493477 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e12e70e5-de3c-4809-9ecb-a51b0582b069 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:52.494151 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e12e70e5-de3c-4809-9ecb-a51b0582b069 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:52.495529 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e12e70e5-de3c-4809-9ecb-a51b0582b069 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:52.522609 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-fdb85a15-cc62-4e11-a8e8-d16416a35044 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72117f17294649d6b8bc16c66c7efab2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45d4c047d3c44324a27a27831236ab0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:57:52.535653 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-fdb85a15-cc62-4e11-a8e8-d16416a35044 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] 10.222.0.13 "GET /compute/v2.1/servers/7218f99b-b011-4f08-931e-340d47069f6e" status: 200 len: 1475 microversion: 2.1 time: 0.363966 Nov 01 18:57:52.536268 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 500/1034] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:57:52 2022] GET /compute/v2.1/servers/7218f99b-b011-4f08-931e-340d47069f6e => generated 1475 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:57:52.590346 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-e12e70e5-de3c-4809-9ecb-a51b0582b069 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c1314c21d8547ff890ede1c2ad281c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c804370880454c7aa02cef2c2c3cf144', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:57:52.605091 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-e12e70e5-de3c-4809-9ecb-a51b0582b069 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c1314c21d8547ff890ede1c2ad281c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c804370880454c7aa02cef2c2c3cf144', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:57:52.606872 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-e12e70e5-de3c-4809-9ecb-a51b0582b069 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c1314c21d8547ff890ede1c2ad281c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c804370880454c7aa02cef2c2c3cf144', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:57:52.620821 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-e12e70e5-de3c-4809-9ecb-a51b0582b069 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] 10.222.0.13 "GET /compute/v2.1/servers/ea631032-dd04-429b-988e-e6362ea42cf7" status: 200 len: 1537 microversion: 2.91 time: 0.157007 Nov 01 18:57:52.622876 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 535/1035] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 18:57:52 2022] GET /compute/v2.1/servers/ea631032-dd04-429b-988e-e6362ea42cf7 => generated 1537 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 18:57:52.694747 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-b778f11e-e2b0-46e9-bbdf-1936ddc55cd9 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:57:52.701372 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-b778f11e-e2b0-46e9-bbdf-1936ddc55cd9 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] [instance: e43fa43a-f523-4438-a8ba-a4460ea4a210] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:57:52.722773 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-b778f11e-e2b0-46e9-bbdf-1936ddc55cd9 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:52.727189 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-b778f11e-e2b0-46e9-bbdf-1936ddc55cd9 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:52.728008 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-b778f11e-e2b0-46e9-bbdf-1936ddc55cd9 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:52.728837 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-b778f11e-e2b0-46e9-bbdf-1936ddc55cd9 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:52.729321 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-b778f11e-e2b0-46e9-bbdf-1936ddc55cd9 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:52.729744 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-b778f11e-e2b0-46e9-bbdf-1936ddc55cd9 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:52.763167 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-862fd647-36aa-4cc7-9230-14c25dc4673f tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:57:52.766480 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-862fd647-36aa-4cc7-9230-14c25dc4673f tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] [instance: 87679611-878a-49b2-bf8f-39e784c6d70b] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:57:52.775407 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-862fd647-36aa-4cc7-9230-14c25dc4673f tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:52.776324 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-862fd647-36aa-4cc7-9230-14c25dc4673f tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:52.777068 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-862fd647-36aa-4cc7-9230-14c25dc4673f tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:52.778002 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-862fd647-36aa-4cc7-9230-14c25dc4673f tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:52.778711 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-862fd647-36aa-4cc7-9230-14c25dc4673f tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:52.779258 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-862fd647-36aa-4cc7-9230-14c25dc4673f tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:52.832427 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-862fd647-36aa-4cc7-9230-14c25dc4673f tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:52.833032 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-862fd647-36aa-4cc7-9230-14c25dc4673f tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:52.833476 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-862fd647-36aa-4cc7-9230-14c25dc4673f tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:52.833933 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.objects.instance [None req-862fd647-36aa-4cc7-9230-14c25dc4673f tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] Lazy-loading 'fault' on Instance uuid 87679611-878a-49b2-bf8f-39e784c6d70b {{(pid=121402) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 01 18:57:52.891347 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-862fd647-36aa-4cc7-9230-14c25dc4673f tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '576abe5db27b461889fef2029d477e40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e9fb3117f68434bae7a463c357818dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:57:52.900719 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-862fd647-36aa-4cc7-9230-14c25dc4673f tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '576abe5db27b461889fef2029d477e40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e9fb3117f68434bae7a463c357818dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:57:52.902484 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-862fd647-36aa-4cc7-9230-14c25dc4673f tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '576abe5db27b461889fef2029d477e40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e9fb3117f68434bae7a463c357818dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:57:52.908062 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-862fd647-36aa-4cc7-9230-14c25dc4673f tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] 10.222.0.13 "GET /compute/v2.1/servers/87679611-878a-49b2-bf8f-39e784c6d70b" status: 200 len: 1449 microversion: 2.75 time: 0.150471 Nov 01 18:57:52.909248 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 536/1036] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 18:57:52 2022] GET /compute/v2.1/servers/87679611-878a-49b2-bf8f-39e784c6d70b => generated 1449 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 01 18:57:53.026924 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-b778f11e-e2b0-46e9-bbdf-1936ddc55cd9 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b52b7dcbb044f9bfc424e4417c77fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '708bc0ea4b5a4baf81933725792bedd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:57:53.035639 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-b778f11e-e2b0-46e9-bbdf-1936ddc55cd9 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] 10.222.0.13 "GET /compute/v2.1/servers/e43fa43a-f523-4438-a8ba-a4460ea4a210" status: 200 len: 1541 microversion: 2.1 time: 0.345287 Nov 01 18:57:53.036503 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 501/1037] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:57:52 2022] GET /compute/v2.1/servers/e43fa43a-f523-4438-a8ba-a4460ea4a210 => generated 1541 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:57:53.485416 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-5fdcf8c8-4374-4028-9b48-016c0960965a tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:57:53.486281 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-5fdcf8c8-4374-4028-9b48-016c0960965a tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] [instance: 869ca597-f199-474f-a680-59b0a75512c7] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:57:53.493172 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-5fdcf8c8-4374-4028-9b48-016c0960965a tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:53.493660 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-5fdcf8c8-4374-4028-9b48-016c0960965a tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:53.494274 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-5fdcf8c8-4374-4028-9b48-016c0960965a tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:53.495248 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-5fdcf8c8-4374-4028-9b48-016c0960965a tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:53.495861 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-5fdcf8c8-4374-4028-9b48-016c0960965a tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:53.502577 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-5fdcf8c8-4374-4028-9b48-016c0960965a tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:53.562668 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-46a129ed-0bf0-46f9-9f32-30231973e39c tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:57:53.562668 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-46a129ed-0bf0-46f9-9f32-30231973e39c tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] [instance: 7218f99b-b011-4f08-931e-340d47069f6e] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:57:53.580133 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-46a129ed-0bf0-46f9-9f32-30231973e39c tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:53.581711 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-46a129ed-0bf0-46f9-9f32-30231973e39c tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:53.582331 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-46a129ed-0bf0-46f9-9f32-30231973e39c tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:53.583213 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-46a129ed-0bf0-46f9-9f32-30231973e39c tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:53.583829 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-46a129ed-0bf0-46f9-9f32-30231973e39c tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:53.584802 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-46a129ed-0bf0-46f9-9f32-30231973e39c tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:53.765743 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-5fdcf8c8-4374-4028-9b48-016c0960965a tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a63d69c99a546f0af16329cff3ca717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a1bb191cff948e99c008b5e861ce4a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:57:53.774968 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-5fdcf8c8-4374-4028-9b48-016c0960965a tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] 10.222.0.13 "GET /compute/v2.1/servers/869ca597-f199-474f-a680-59b0a75512c7" status: 200 len: 1321 microversion: 2.1 time: 0.292406 Nov 01 18:57:53.776130 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 537/1038] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:57:53 2022] GET /compute/v2.1/servers/869ca597-f199-474f-a680-59b0a75512c7 => generated 1321 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:57:53.782648 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-e843cd2d-4c62-4084-aa34-53c374433f7d tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:57:53.783285 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-e843cd2d-4c62-4084-aa34-53c374433f7d tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] [instance: ea631032-dd04-429b-988e-e6362ea42cf7] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:57:53.790054 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e843cd2d-4c62-4084-aa34-53c374433f7d tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:53.790544 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e843cd2d-4c62-4084-aa34-53c374433f7d tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:53.790979 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e843cd2d-4c62-4084-aa34-53c374433f7d tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:53.792469 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e843cd2d-4c62-4084-aa34-53c374433f7d tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:53.793032 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e843cd2d-4c62-4084-aa34-53c374433f7d tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:53.793571 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e843cd2d-4c62-4084-aa34-53c374433f7d tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:53.893283 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-e843cd2d-4c62-4084-aa34-53c374433f7d tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c1314c21d8547ff890ede1c2ad281c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c804370880454c7aa02cef2c2c3cf144', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:57:53.902776 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-e843cd2d-4c62-4084-aa34-53c374433f7d tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c1314c21d8547ff890ede1c2ad281c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c804370880454c7aa02cef2c2c3cf144', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:57:53.904215 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-e843cd2d-4c62-4084-aa34-53c374433f7d tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c1314c21d8547ff890ede1c2ad281c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c804370880454c7aa02cef2c2c3cf144', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:57:53.910667 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-e843cd2d-4c62-4084-aa34-53c374433f7d tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] 10.222.0.13 "GET /compute/v2.1/servers/ea631032-dd04-429b-988e-e6362ea42cf7" status: 200 len: 1537 microversion: 2.91 time: 0.132338 Nov 01 18:57:53.911609 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 538/1039] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 18:57:53 2022] GET /compute/v2.1/servers/ea631032-dd04-429b-988e-e6362ea42cf7 => generated 1537 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 18:57:53.939396 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-65e14b09-ab33-46de-a960-62b323fc6b2e tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:57:53.940041 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-65e14b09-ab33-46de-a960-62b323fc6b2e tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] [instance: 87679611-878a-49b2-bf8f-39e784c6d70b] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:57:53.946218 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-65e14b09-ab33-46de-a960-62b323fc6b2e tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:53.946706 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-65e14b09-ab33-46de-a960-62b323fc6b2e tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:53.947136 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-65e14b09-ab33-46de-a960-62b323fc6b2e tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:53.947836 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-65e14b09-ab33-46de-a960-62b323fc6b2e tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:53.948622 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-65e14b09-ab33-46de-a960-62b323fc6b2e tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:53.949221 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-65e14b09-ab33-46de-a960-62b323fc6b2e tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:53.957753 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-46a129ed-0bf0-46f9-9f32-30231973e39c tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72117f17294649d6b8bc16c66c7efab2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45d4c047d3c44324a27a27831236ab0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:57:53.964086 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.wsgi [None req-65e14b09-ab33-46de-a960-62b323fc6b2e tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] HTTP exception thrown: Instance 87679611-878a-49b2-bf8f-39e784c6d70b could not be found. Nov 01 18:57:53.965962 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-65e14b09-ab33-46de-a960-62b323fc6b2e tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] Request method failure captured: Nov 01 18:57:53.965962 n-d-863052-2 devstack@n-api.service[121402]: request: GET /compute/v2.1/servers/87679611-878a-49b2-bf8f-39e784c6d70b HTTP/1.1 Nov 01 18:57:53.965962 n-d-863052-2 devstack@n-api.service[121402]: Accept: application/json Nov 01 18:57:53.965962 n-d-863052-2 devstack@n-api.service[121402]: Accept-Encoding: identity Nov 01 18:57:53.965962 n-d-863052-2 devstack@n-api.service[121402]: Connection: close Nov 01 18:57:53.965962 n-d-863052-2 devstack@n-api.service[121402]: Content-Length: 0 Nov 01 18:57:53.965962 n-d-863052-2 devstack@n-api.service[121402]: Content-Type: application/json Nov 01 18:57:53.965962 n-d-863052-2 devstack@n-api.service[121402]: Host: 10.222.0.13 Nov 01 18:57:53.965962 n-d-863052-2 devstack@n-api.service[121402]: Openstack-System-Scope: None Nov 01 18:57:53.965962 n-d-863052-2 devstack@n-api.service[121402]: User-Agent: python-urllib3/1.26.12 Nov 01 18:57:53.965962 n-d-863052-2 devstack@n-api.service[121402]: X-Auth-Token: gAAAAABjYWvbW0GlW0GNKuaFgItMsJtuxm55IILmE9_HGOFMyBk8P93q5bpXm8KqHbogORfm2V2NNknuEXTVmVNNbd7qlWY__scVIhmwMxaXRnDgyKb2bqkrjvaEHZOnNYwXNwsb7RmiwFZRHKC1r9KUgzRBMafmgpKmsctSExdJIAQNB3t57s8 Nov 01 18:57:53.965962 n-d-863052-2 devstack@n-api.service[121402]: X-Domain-Id: None Nov 01 18:57:53.965962 n-d-863052-2 devstack@n-api.service[121402]: X-Domain-Name: None Nov 01 18:57:53.965962 n-d-863052-2 devstack@n-api.service[121402]: X-Identity-Status: Confirmed Nov 01 18:57:53.965962 n-d-863052-2 devstack@n-api.service[121402]: X-Is-Admin-Project: True Nov 01 18:57:53.965962 n-d-863052-2 devstack@n-api.service[121402]: X-Openstack-Nova-Api-Version: 2.75 Nov 01 18:57:53.965962 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Domain-Id: default Nov 01 18:57:53.965962 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Domain-Name: Default Nov 01 18:57:53.965962 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Id: 6e9fb3117f68434bae7a463c357818dd Nov 01 18:57:53.965962 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Name: tempest-ServersAdmin275Test-356436467 Nov 01 18:57:53.965962 n-d-863052-2 devstack@n-api.service[121402]: X-Role: member,reader Nov 01 18:57:53.965962 n-d-863052-2 devstack@n-api.service[121402]: X-Roles: member,reader Nov 01 18:57:53.967328 n-d-863052-2 devstack@n-api.service[121402]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/6e9fb3117f68434bae7a463c357818dd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/6e9fb3117f68434bae7a463c357818dd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_6e9fb3117f68434bae7a463c357818dd", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/6e9fb3117f68434bae7a463c357818dd"}]}] Nov 01 18:57:53.967328 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant: tempest-ServersAdmin275Test-356436467 Nov 01 18:57:53.967328 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant-Id: 6e9fb3117f68434bae7a463c357818dd Nov 01 18:57:53.967328 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant-Name: tempest-ServersAdmin275Test-356436467 Nov 01 18:57:53.967328 n-d-863052-2 devstack@n-api.service[121402]: X-User: tempest-ServersAdmin275Test-356436467-project Nov 01 18:57:53.967328 n-d-863052-2 devstack@n-api.service[121402]: X-User-Domain-Id: default Nov 01 18:57:53.967328 n-d-863052-2 devstack@n-api.service[121402]: X-User-Domain-Name: Default Nov 01 18:57:53.967328 n-d-863052-2 devstack@n-api.service[121402]: X-User-Id: 576abe5db27b461889fef2029d477e40 Nov 01 18:57:53.967328 n-d-863052-2 devstack@n-api.service[121402]: X-User-Name: tempest-ServersAdmin275Test-356436467-project Nov 01 18:57:53.967328 n-d-863052-2 devstack@n-api.service[121402]: method: > Nov 01 18:57:53.967328 n-d-863052-2 devstack@n-api.service[121402]: exception: Instance 87679611-878a-49b2-bf8f-39e784c6d70b could not be found. Nov 01 18:57:53.967328 n-d-863052-2 devstack@n-api.service[121402]: action_args: {'id': '87679611-878a-49b2-bf8f-39e784c6d70b'} Nov 01 18:57:53.968945 n-d-863052-2 devstack@n-api.service[121402]: {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 01 18:57:53.968945 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:57:53.968945 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 01 18:57:53.968945 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 01 18:57:53.968945 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 01 18:57:53.968945 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 01 18:57:53.968945 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 01 18:57:53.968945 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 01 18:57:53.968945 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 01 18:57:53.968945 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 01 18:57:53.968945 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 87679611-878a-49b2-bf8f-39e784c6d70b could not be found. Nov 01 18:57:53.968945 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 18:57:53.968945 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 18:57:53.968945 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 18:57:53.968945 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:57:53.968945 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 18:57:53.968945 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 18:57:53.968945 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 01 18:57:53.968945 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 01 18:57:53.968945 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 01 18:57:53.970383 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 01 18:57:53.970383 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 01 18:57:53.970383 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 01 18:57:53.970383 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 01 18:57:53.970383 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 01 18:57:53.970383 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 01 18:57:53.970383 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 01 18:57:53.970383 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 87679611-878a-49b2-bf8f-39e784c6d70b could not be found. Nov 01 18:57:53.970383 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 18:57:53.970383 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 18:57:53.970383 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 18:57:53.970383 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:57:53.970383 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 18:57:53.970383 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 18:57:53.970383 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 01 18:57:53.970383 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 01 18:57:53.970383 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 87679611-878a-49b2-bf8f-39e784c6d70b could not be found. Nov 01 18:57:53.970383 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 18:57:53.972226 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-65e14b09-ab33-46de-a960-62b323fc6b2e tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] Returning 404 to user: Instance 87679611-878a-49b2-bf8f-39e784c6d70b could not be found. {{(pid=121402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 01 18:57:53.972226 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-65e14b09-ab33-46de-a960-62b323fc6b2e tempest-ServersAdmin275Test-356436467 tempest-ServersAdmin275Test-356436467-project] 10.222.0.13 "GET /compute/v2.1/servers/87679611-878a-49b2-bf8f-39e784c6d70b" status: 404 len: 111 microversion: 2.75 time: 0.032815 Nov 01 18:57:53.972226 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 539/1040] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 18:57:53 2022] GET /compute/v2.1/servers/87679611-878a-49b2-bf8f-39e784c6d70b => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 01 18:57:53.977236 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-46a129ed-0bf0-46f9-9f32-30231973e39c tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] 10.222.0.13 "GET /compute/v2.1/servers/7218f99b-b011-4f08-931e-340d47069f6e" status: 200 len: 1473 microversion: 2.1 time: 0.419600 Nov 01 18:57:53.985948 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 502/1041] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:57:53 2022] GET /compute/v2.1/servers/7218f99b-b011-4f08-931e-340d47069f6e => generated 1473 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:57:54.048193 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [req-da270b11-0db3-43ed-acb0-8ebbc1f48b05 req-402ad8f9-8f78-4d11-a80e-97c39f06c7ca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "869ca597-f199-474f-a680-59b0a75512c7", "name": "network-vif-plugged", "status": "completed", "tag": "97110a86-c3fd-48ee-9f17-518284b372d0"}]} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 18:57:54.059585 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-b34caec2-7289-4a6c-9fe7-afbea2499e66 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:57:54.060627 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-b34caec2-7289-4a6c-9fe7-afbea2499e66 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] [instance: e43fa43a-f523-4438-a8ba-a4460ea4a210] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:57:54.068484 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-da270b11-0db3-43ed-acb0-8ebbc1f48b05 req-402ad8f9-8f78-4d11-a80e-97c39f06c7ca service nova] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:54.069387 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-da270b11-0db3-43ed-acb0-8ebbc1f48b05 req-402ad8f9-8f78-4d11-a80e-97c39f06c7ca service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:54.070142 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-da270b11-0db3-43ed-acb0-8ebbc1f48b05 req-402ad8f9-8f78-4d11-a80e-97c39f06c7ca service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:54.073456 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-b34caec2-7289-4a6c-9fe7-afbea2499e66 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:54.074694 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-b34caec2-7289-4a6c-9fe7-afbea2499e66 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:54.076311 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-b34caec2-7289-4a6c-9fe7-afbea2499e66 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:54.078288 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-b34caec2-7289-4a6c-9fe7-afbea2499e66 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:54.078842 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-b34caec2-7289-4a6c-9fe7-afbea2499e66 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:54.081591 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-b34caec2-7289-4a6c-9fe7-afbea2499e66 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:54.103531 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.compute.server_external_events [req-da270b11-0db3-43ed-acb0-8ebbc1f48b05 req-402ad8f9-8f78-4d11-a80e-97c39f06c7ca service nova] Creating event network-vif-plugged:97110a86-c3fd-48ee-9f17-518284b372d0 for instance 869ca597-f199-474f-a680-59b0a75512c7 on n-h2-863052-2 Nov 01 18:57:54.118521 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [req-da270b11-0db3-43ed-acb0-8ebbc1f48b05 req-402ad8f9-8f78-4d11-a80e-97c39f06c7ca service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075427 Nov 01 18:57:54.120032 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 540/1042] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Nov 1 18:57:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 18:57:54.440723 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-b34caec2-7289-4a6c-9fe7-afbea2499e66 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b52b7dcbb044f9bfc424e4417c77fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '708bc0ea4b5a4baf81933725792bedd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:57:54.457622 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-b34caec2-7289-4a6c-9fe7-afbea2499e66 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] 10.222.0.13 "GET /compute/v2.1/servers/e43fa43a-f523-4438-a8ba-a4460ea4a210" status: 200 len: 1541 microversion: 2.1 time: 0.401984 Nov 01 18:57:54.461736 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 503/1043] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:57:54 2022] GET /compute/v2.1/servers/e43fa43a-f523-4438-a8ba-a4460ea4a210 => generated 1541 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:57:54.814017 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-137bd162-2a6a-4f7d-b07f-03a642f8a094 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:57:54.818786 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-137bd162-2a6a-4f7d-b07f-03a642f8a094 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] [instance: 869ca597-f199-474f-a680-59b0a75512c7] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:57:54.847381 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-137bd162-2a6a-4f7d-b07f-03a642f8a094 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:54.848036 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-137bd162-2a6a-4f7d-b07f-03a642f8a094 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:54.848486 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-137bd162-2a6a-4f7d-b07f-03a642f8a094 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:54.850184 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-137bd162-2a6a-4f7d-b07f-03a642f8a094 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:54.850652 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-137bd162-2a6a-4f7d-b07f-03a642f8a094 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:54.853202 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-137bd162-2a6a-4f7d-b07f-03a642f8a094 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:54.944756 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-a5fc7c1e-53a7-477a-81f8-9da0bf9345be tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:57:54.945418 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-a5fc7c1e-53a7-477a-81f8-9da0bf9345be tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] [instance: ea631032-dd04-429b-988e-e6362ea42cf7] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:57:54.976995 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-a5fc7c1e-53a7-477a-81f8-9da0bf9345be tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:54.977831 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-a5fc7c1e-53a7-477a-81f8-9da0bf9345be tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:54.981987 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-a5fc7c1e-53a7-477a-81f8-9da0bf9345be tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:54.984220 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-a5fc7c1e-53a7-477a-81f8-9da0bf9345be tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:54.987471 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-a5fc7c1e-53a7-477a-81f8-9da0bf9345be tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:54.990554 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-a5fc7c1e-53a7-477a-81f8-9da0bf9345be tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:55.089212 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-a5fc7c1e-53a7-477a-81f8-9da0bf9345be tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c1314c21d8547ff890ede1c2ad281c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c804370880454c7aa02cef2c2c3cf144', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:57:55.098739 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-a5fc7c1e-53a7-477a-81f8-9da0bf9345be tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c1314c21d8547ff890ede1c2ad281c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c804370880454c7aa02cef2c2c3cf144', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:57:55.100480 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-a5fc7c1e-53a7-477a-81f8-9da0bf9345be tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c1314c21d8547ff890ede1c2ad281c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c804370880454c7aa02cef2c2c3cf144', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:57:55.107494 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-a5fc7c1e-53a7-477a-81f8-9da0bf9345be tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] 10.222.0.13 "GET /compute/v2.1/servers/ea631032-dd04-429b-988e-e6362ea42cf7" status: 200 len: 1537 microversion: 2.91 time: 0.170030 Nov 01 18:57:55.124395 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 504/1044] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 18:57:54 2022] GET /compute/v2.1/servers/ea631032-dd04-429b-988e-e6362ea42cf7 => generated 1537 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 01 18:57:55.130188 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-45bf57fb-95c6-4414-b57a-29232785d193 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:57:55.130801 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-45bf57fb-95c6-4414-b57a-29232785d193 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] [instance: 7218f99b-b011-4f08-931e-340d47069f6e] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:57:55.148916 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-45bf57fb-95c6-4414-b57a-29232785d193 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:55.149384 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-45bf57fb-95c6-4414-b57a-29232785d193 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:55.152804 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-45bf57fb-95c6-4414-b57a-29232785d193 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:55.153779 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-45bf57fb-95c6-4414-b57a-29232785d193 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:55.154396 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-45bf57fb-95c6-4414-b57a-29232785d193 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:55.157306 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-45bf57fb-95c6-4414-b57a-29232785d193 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:55.255721 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-137bd162-2a6a-4f7d-b07f-03a642f8a094 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a63d69c99a546f0af16329cff3ca717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a1bb191cff948e99c008b5e861ce4a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:57:55.264405 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-137bd162-2a6a-4f7d-b07f-03a642f8a094 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] 10.222.0.13 "GET /compute/v2.1/servers/869ca597-f199-474f-a680-59b0a75512c7" status: 200 len: 1321 microversion: 2.1 time: 0.464120 Nov 01 18:57:55.265000 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 541/1045] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:57:54 2022] GET /compute/v2.1/servers/869ca597-f199-474f-a680-59b0a75512c7 => generated 1321 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:57:55.402482 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-45bf57fb-95c6-4414-b57a-29232785d193 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72117f17294649d6b8bc16c66c7efab2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45d4c047d3c44324a27a27831236ab0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:57:55.419049 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-45bf57fb-95c6-4414-b57a-29232785d193 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] 10.222.0.13 "GET /compute/v2.1/servers/7218f99b-b011-4f08-931e-340d47069f6e" status: 200 len: 1470 microversion: 2.1 time: 0.293164 Nov 01 18:57:55.442036 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 505/1046] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:57:55 2022] GET /compute/v2.1/servers/7218f99b-b011-4f08-931e-340d47069f6e => generated 1470 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:57:55.448084 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-42688fc8-c673-4ff9-8841-e0e9e3fdd140 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 18:57:55.449090 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-42688fc8-c673-4ff9-8841-e0e9e3fdd140 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] [instance: 7218f99b-b011-4f08-931e-340d47069f6e] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:57:55.461413 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-42688fc8-c673-4ff9-8841-e0e9e3fdd140 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:55.463156 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-42688fc8-c673-4ff9-8841-e0e9e3fdd140 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:55.465032 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-42688fc8-c673-4ff9-8841-e0e9e3fdd140 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:55.467064 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-42688fc8-c673-4ff9-8841-e0e9e3fdd140 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:55.468994 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-42688fc8-c673-4ff9-8841-e0e9e3fdd140 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:55.470240 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-42688fc8-c673-4ff9-8841-e0e9e3fdd140 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:55.487773 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-0bcc7c05-7b6d-4bff-88c8-71f6fd7b34df tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:57:55.488695 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-0bcc7c05-7b6d-4bff-88c8-71f6fd7b34df tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] [instance: e43fa43a-f523-4438-a8ba-a4460ea4a210] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:57:55.501214 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-0bcc7c05-7b6d-4bff-88c8-71f6fd7b34df tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:55.502013 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-0bcc7c05-7b6d-4bff-88c8-71f6fd7b34df tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:55.502616 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-0bcc7c05-7b6d-4bff-88c8-71f6fd7b34df tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:55.504272 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-0bcc7c05-7b6d-4bff-88c8-71f6fd7b34df tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:55.505461 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-0bcc7c05-7b6d-4bff-88c8-71f6fd7b34df tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:55.507823 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-0bcc7c05-7b6d-4bff-88c8-71f6fd7b34df tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:55.608492 n-d-863052-2 devstack@n-api.service[121402]: DEBUG dbcounter [-] [121402] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 18:57:55.665116 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-42688fc8-c673-4ff9-8841-e0e9e3fdd140 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] 10.222.0.13 "POST /compute/v2.1/servers/7218f99b-b011-4f08-931e-340d47069f6e/action" status: 204 len: 0 microversion: 2.1 time: 0.220900 Nov 01 18:57:55.670533 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 542/1047] 10.222.0.13 () {60 vars in 1278 bytes} [Tue Nov 1 18:57:55 2022] POST /compute/v2.1/servers/7218f99b-b011-4f08-931e-340d47069f6e/action => generated 0 bytes in 225 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 01 18:57:55.679378 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-afeae766-eee9-4c0f-a3a5-ea8138e564f9 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:57:55.680085 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-afeae766-eee9-4c0f-a3a5-ea8138e564f9 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] [instance: 7218f99b-b011-4f08-931e-340d47069f6e] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:57:55.689911 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-afeae766-eee9-4c0f-a3a5-ea8138e564f9 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:55.692625 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-afeae766-eee9-4c0f-a3a5-ea8138e564f9 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:55.693237 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-afeae766-eee9-4c0f-a3a5-ea8138e564f9 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:55.694282 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-afeae766-eee9-4c0f-a3a5-ea8138e564f9 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:55.694903 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-afeae766-eee9-4c0f-a3a5-ea8138e564f9 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:55.695703 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-afeae766-eee9-4c0f-a3a5-ea8138e564f9 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:55.957077 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-0bcc7c05-7b6d-4bff-88c8-71f6fd7b34df tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b52b7dcbb044f9bfc424e4417c77fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '708bc0ea4b5a4baf81933725792bedd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:57:55.972159 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-0bcc7c05-7b6d-4bff-88c8-71f6fd7b34df tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] 10.222.0.13 "GET /compute/v2.1/servers/e43fa43a-f523-4438-a8ba-a4460ea4a210" status: 200 len: 1523 microversion: 2.1 time: 0.486859 Nov 01 18:57:55.972969 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 506/1048] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:57:55 2022] GET /compute/v2.1/servers/e43fa43a-f523-4438-a8ba-a4460ea4a210 => generated 1523 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:57:55.995923 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-5baf58b9-e138-445b-a894-7ac7faf002ca tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:57:55.996425 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-5baf58b9-e138-445b-a894-7ac7faf002ca tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] [instance: e43fa43a-f523-4438-a8ba-a4460ea4a210] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:57:56.003428 n-d-863052-2 devstack@n-api.service[121403]: DEBUG dbcounter [-] [121403] Writing DB stats nova_api:SELECT=100 {{(pid=121403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 18:57:56.006639 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-5baf58b9-e138-445b-a894-7ac7faf002ca tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:56.007205 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-5baf58b9-e138-445b-a894-7ac7faf002ca tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:56.009561 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-5baf58b9-e138-445b-a894-7ac7faf002ca tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:56.011140 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-5baf58b9-e138-445b-a894-7ac7faf002ca tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:56.016121 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-5baf58b9-e138-445b-a894-7ac7faf002ca tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:56.016830 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-5baf58b9-e138-445b-a894-7ac7faf002ca tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:56.085103 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-5baf58b9-e138-445b-a894-7ac7faf002ca tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] [instance: e43fa43a-f523-4438-a8ba-a4460ea4a210] Going to try to terminate instance {{(pid=121403) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 01 18:57:56.103678 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-afeae766-eee9-4c0f-a3a5-ea8138e564f9 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72117f17294649d6b8bc16c66c7efab2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45d4c047d3c44324a27a27831236ab0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:57:56.113265 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-afeae766-eee9-4c0f-a3a5-ea8138e564f9 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] 10.222.0.13 "GET /compute/v2.1/servers/7218f99b-b011-4f08-931e-340d47069f6e" status: 200 len: 1470 microversion: 2.1 time: 0.441333 Nov 01 18:57:56.129305 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 543/1049] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:57:55 2022] GET /compute/v2.1/servers/7218f99b-b011-4f08-931e-340d47069f6e => generated 1470 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:57:56.140060 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-b05fdb71-6770-47ef-892b-ce9603f07ac6 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:57:56.140755 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-b05fdb71-6770-47ef-892b-ce9603f07ac6 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] [instance: ea631032-dd04-429b-988e-e6362ea42cf7] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:57:56.171829 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b05fdb71-6770-47ef-892b-ce9603f07ac6 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:56.172445 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b05fdb71-6770-47ef-892b-ce9603f07ac6 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:56.173184 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b05fdb71-6770-47ef-892b-ce9603f07ac6 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:56.173943 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b05fdb71-6770-47ef-892b-ce9603f07ac6 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:56.174403 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b05fdb71-6770-47ef-892b-ce9603f07ac6 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:56.174928 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b05fdb71-6770-47ef-892b-ce9603f07ac6 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:56.310493 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-5baf58b9-e138-445b-a894-7ac7faf002ca tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] 10.222.0.13 "DELETE /compute/v2.1/servers/e43fa43a-f523-4438-a8ba-a4460ea4a210" status: 204 len: 0 microversion: 2.1 time: 0.318326 Nov 01 18:57:56.315819 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 507/1050] 10.222.0.13 () {58 vars in 1239 bytes} [Tue Nov 1 18:57:55 2022] DELETE /compute/v2.1/servers/e43fa43a-f523-4438-a8ba-a4460ea4a210 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 01 18:57:56.322496 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-f08be016-1e0b-4724-a6e1-d61c64a44c76 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:57:56.323214 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-f08be016-1e0b-4724-a6e1-d61c64a44c76 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] [instance: 869ca597-f199-474f-a680-59b0a75512c7] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:57:56.331935 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f08be016-1e0b-4724-a6e1-d61c64a44c76 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:56.332525 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f08be016-1e0b-4724-a6e1-d61c64a44c76 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:56.333020 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f08be016-1e0b-4724-a6e1-d61c64a44c76 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:56.333794 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f08be016-1e0b-4724-a6e1-d61c64a44c76 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:56.334928 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f08be016-1e0b-4724-a6e1-d61c64a44c76 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:56.334928 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f08be016-1e0b-4724-a6e1-d61c64a44c76 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:56.568114 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-b05fdb71-6770-47ef-892b-ce9603f07ac6 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c1314c21d8547ff890ede1c2ad281c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c804370880454c7aa02cef2c2c3cf144', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:57:56.583591 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-b05fdb71-6770-47ef-892b-ce9603f07ac6 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c1314c21d8547ff890ede1c2ad281c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c804370880454c7aa02cef2c2c3cf144', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:57:56.589186 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-b05fdb71-6770-47ef-892b-ce9603f07ac6 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c1314c21d8547ff890ede1c2ad281c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c804370880454c7aa02cef2c2c3cf144', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:57:56.597973 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-b05fdb71-6770-47ef-892b-ce9603f07ac6 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] 10.222.0.13 "GET /compute/v2.1/servers/ea631032-dd04-429b-988e-e6362ea42cf7" status: 200 len: 1537 microversion: 2.91 time: 0.464939 Nov 01 18:57:56.612546 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 544/1051] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 18:57:56 2022] GET /compute/v2.1/servers/ea631032-dd04-429b-988e-e6362ea42cf7 => generated 1537 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 18:57:56.629036 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-a636cd86-db8e-4f51-94e3-6dbb02c7f3ba tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:57:56.629845 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-a636cd86-db8e-4f51-94e3-6dbb02c7f3ba tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] [instance: e43fa43a-f523-4438-a8ba-a4460ea4a210] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:57:56.638855 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-a636cd86-db8e-4f51-94e3-6dbb02c7f3ba tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:56.639359 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-a636cd86-db8e-4f51-94e3-6dbb02c7f3ba tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:56.639800 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-a636cd86-db8e-4f51-94e3-6dbb02c7f3ba tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:56.640520 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-a636cd86-db8e-4f51-94e3-6dbb02c7f3ba tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:56.642096 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-a636cd86-db8e-4f51-94e3-6dbb02c7f3ba tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:56.642584 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-a636cd86-db8e-4f51-94e3-6dbb02c7f3ba tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:56.698083 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-f08be016-1e0b-4724-a6e1-d61c64a44c76 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a63d69c99a546f0af16329cff3ca717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a1bb191cff948e99c008b5e861ce4a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:57:56.707064 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-f08be016-1e0b-4724-a6e1-d61c64a44c76 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] 10.222.0.13 "GET /compute/v2.1/servers/869ca597-f199-474f-a680-59b0a75512c7" status: 200 len: 1514 microversion: 2.1 time: 0.389758 Nov 01 18:57:56.709750 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 508/1052] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:57:56 2022] GET /compute/v2.1/servers/869ca597-f199-474f-a680-59b0a75512c7 => generated 1514 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:57:56.726906 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [req-cd882759-a76a-4d7e-ac8e-1bdca35e4aa4 req-3203c024-a827-45ab-8790-9a96544573a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e43fa43a-f523-4438-a8ba-a4460ea4a210", "name": "network-vif-plugged", "status": "completed", "tag": "9f4a6ee5-6fd1-413d-8d9e-aa1c5b8782b3"}]} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 18:57:56.750138 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-cd882759-a76a-4d7e-ac8e-1bdca35e4aa4 req-3203c024-a827-45ab-8790-9a96544573a6 service nova] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:56.751064 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-cd882759-a76a-4d7e-ac8e-1bdca35e4aa4 req-3203c024-a827-45ab-8790-9a96544573a6 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:56.751574 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-cd882759-a76a-4d7e-ac8e-1bdca35e4aa4 req-3203c024-a827-45ab-8790-9a96544573a6 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:56.769926 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.compute.server_external_events [req-cd882759-a76a-4d7e-ac8e-1bdca35e4aa4 req-3203c024-a827-45ab-8790-9a96544573a6 service nova] Creating event network-vif-plugged:9f4a6ee5-6fd1-413d-8d9e-aa1c5b8782b3 for instance e43fa43a-f523-4438-a8ba-a4460ea4a210 on n-h2-863052-2 Nov 01 18:57:56.793036 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [req-cd882759-a76a-4d7e-ac8e-1bdca35e4aa4 req-3203c024-a827-45ab-8790-9a96544573a6 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065418 Nov 01 18:57:56.793822 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 509/1053] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Nov 1 18:57:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 18:57:56.804030 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-297533e2-e099-49ce-8037-1b4e696967c1 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 18:57:56.807015 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-297533e2-e099-49ce-8037-1b4e696967c1 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] [instance: 869ca597-f199-474f-a680-59b0a75512c7] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:57:56.822082 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-297533e2-e099-49ce-8037-1b4e696967c1 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:56.822753 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-297533e2-e099-49ce-8037-1b4e696967c1 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:56.825227 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-297533e2-e099-49ce-8037-1b4e696967c1 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:56.826838 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-297533e2-e099-49ce-8037-1b4e696967c1 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:56.827685 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-297533e2-e099-49ce-8037-1b4e696967c1 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:56.828109 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-297533e2-e099-49ce-8037-1b4e696967c1 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:56.904650 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.objects.instance [None req-297533e2-e099-49ce-8037-1b4e696967c1 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lazy-loading 'flavor' on Instance uuid 869ca597-f199-474f-a680-59b0a75512c7 {{(pid=121403) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 01 18:57:56.966124 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-a636cd86-db8e-4f51-94e3-6dbb02c7f3ba tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b52b7dcbb044f9bfc424e4417c77fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '708bc0ea4b5a4baf81933725792bedd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:57:56.981566 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-a636cd86-db8e-4f51-94e3-6dbb02c7f3ba tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] 10.222.0.13 "GET /compute/v2.1/servers/e43fa43a-f523-4438-a8ba-a4460ea4a210" status: 200 len: 1529 microversion: 2.1 time: 0.360810 Nov 01 18:57:56.982421 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 545/1054] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:57:56 2022] GET /compute/v2.1/servers/e43fa43a-f523-4438-a8ba-a4460ea4a210 => generated 1529 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:57:57.038559 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-297533e2-e099-49ce-8037-1b4e696967c1 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] 10.222.0.13 "POST /compute/v2.1/servers/869ca597-f199-474f-a680-59b0a75512c7/action" status: 200 len: 32 microversion: 2.1 time: 0.243003 Nov 01 18:57:57.039740 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 510/1055] 10.222.0.13 () {60 vars in 1278 bytes} [Tue Nov 1 18:57:56 2022] POST /compute/v2.1/servers/869ca597-f199-474f-a680-59b0a75512c7/action => generated 32 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 01 18:57:57.052695 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-5c5fb029-28cd-4a4c-897b-d9481036f3d3 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:57:57.054158 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-5c5fb029-28cd-4a4c-897b-d9481036f3d3 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] [instance: 869ca597-f199-474f-a680-59b0a75512c7] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:57:57.061552 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-5c5fb029-28cd-4a4c-897b-d9481036f3d3 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:57.062663 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-5c5fb029-28cd-4a4c-897b-d9481036f3d3 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:57.063246 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-5c5fb029-28cd-4a4c-897b-d9481036f3d3 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:57.064071 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-5c5fb029-28cd-4a4c-897b-d9481036f3d3 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:57.064710 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-5c5fb029-28cd-4a4c-897b-d9481036f3d3 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:57.065368 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-5c5fb029-28cd-4a4c-897b-d9481036f3d3 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:57.143087 n-d-863052-2 devstack@n-api.service[121402]: DEBUG dbcounter [-] [121402] Writing DB stats nova_cell0:SELECT=14 {{(pid=121402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 18:57:57.157085 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-1f5dc55c-11c4-41dd-9d1d-9b849a421fda tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:57:57.157991 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-1f5dc55c-11c4-41dd-9d1d-9b849a421fda tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] [instance: 7218f99b-b011-4f08-931e-340d47069f6e] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:57:57.173818 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-1f5dc55c-11c4-41dd-9d1d-9b849a421fda tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:57.175171 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-1f5dc55c-11c4-41dd-9d1d-9b849a421fda tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:57.176617 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-1f5dc55c-11c4-41dd-9d1d-9b849a421fda tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:57.176617 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-1f5dc55c-11c4-41dd-9d1d-9b849a421fda tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:57.177202 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-1f5dc55c-11c4-41dd-9d1d-9b849a421fda tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:57.177720 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-1f5dc55c-11c4-41dd-9d1d-9b849a421fda tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:57.217197 n-d-863052-2 devstack@n-api.service[121403]: DEBUG dbcounter [-] [121403] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=121403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 18:57:57.278906 n-d-863052-2 devstack@n-api.service[121403]: DEBUG dbcounter [-] [121403] Writing DB stats nova_cell0:SELECT=10 {{(pid=121403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 18:57:57.399770 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-1f5dc55c-11c4-41dd-9d1d-9b849a421fda tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72117f17294649d6b8bc16c66c7efab2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45d4c047d3c44324a27a27831236ab0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:57:57.411013 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-1f5dc55c-11c4-41dd-9d1d-9b849a421fda tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] 10.222.0.13 "GET /compute/v2.1/servers/7218f99b-b011-4f08-931e-340d47069f6e" status: 200 len: 1470 microversion: 2.1 time: 0.269404 Nov 01 18:57:57.411834 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 511/1056] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:57:57 2022] GET /compute/v2.1/servers/7218f99b-b011-4f08-931e-340d47069f6e => generated 1470 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:57:57.474716 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-5c5fb029-28cd-4a4c-897b-d9481036f3d3 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a63d69c99a546f0af16329cff3ca717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a1bb191cff948e99c008b5e861ce4a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:57:57.484223 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-5c5fb029-28cd-4a4c-897b-d9481036f3d3 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] 10.222.0.13 "GET /compute/v2.1/servers/869ca597-f199-474f-a680-59b0a75512c7" status: 200 len: 1520 microversion: 2.1 time: 0.438538 Nov 01 18:57:57.485251 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 546/1057] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:57:57 2022] GET /compute/v2.1/servers/869ca597-f199-474f-a680-59b0a75512c7 => generated 1520 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:57:57.632863 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-bfc3f2b9-0f24-48ea-a10b-fb007307b118 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:57:57.632863 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-bfc3f2b9-0f24-48ea-a10b-fb007307b118 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] [instance: ea631032-dd04-429b-988e-e6362ea42cf7] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:57:57.638939 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-bfc3f2b9-0f24-48ea-a10b-fb007307b118 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:57.639347 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-bfc3f2b9-0f24-48ea-a10b-fb007307b118 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:57.639785 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-bfc3f2b9-0f24-48ea-a10b-fb007307b118 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:57.640484 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-bfc3f2b9-0f24-48ea-a10b-fb007307b118 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:57.640963 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-bfc3f2b9-0f24-48ea-a10b-fb007307b118 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:57.641475 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-bfc3f2b9-0f24-48ea-a10b-fb007307b118 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:57.781347 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-bfc3f2b9-0f24-48ea-a10b-fb007307b118 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c1314c21d8547ff890ede1c2ad281c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c804370880454c7aa02cef2c2c3cf144', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:57:57.789517 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-bfc3f2b9-0f24-48ea-a10b-fb007307b118 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c1314c21d8547ff890ede1c2ad281c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c804370880454c7aa02cef2c2c3cf144', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:57:57.790946 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-bfc3f2b9-0f24-48ea-a10b-fb007307b118 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c1314c21d8547ff890ede1c2ad281c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c804370880454c7aa02cef2c2c3cf144', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:57:57.811818 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-bfc3f2b9-0f24-48ea-a10b-fb007307b118 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] 10.222.0.13 "GET /compute/v2.1/servers/ea631032-dd04-429b-988e-e6362ea42cf7" status: 200 len: 1537 microversion: 2.91 time: 0.183951 Nov 01 18:57:57.816375 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 512/1058] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 18:57:57 2022] GET /compute/v2.1/servers/ea631032-dd04-429b-988e-e6362ea42cf7 => generated 1537 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 18:57:58.007759 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-9adc1e91-959a-421b-a1fa-c3e6c0e23f32 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:57:58.008371 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-9adc1e91-959a-421b-a1fa-c3e6c0e23f32 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] [instance: e43fa43a-f523-4438-a8ba-a4460ea4a210] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:57:58.016800 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-9adc1e91-959a-421b-a1fa-c3e6c0e23f32 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:58.029003 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-9adc1e91-959a-421b-a1fa-c3e6c0e23f32 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:58.029719 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-9adc1e91-959a-421b-a1fa-c3e6c0e23f32 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:58.030471 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-9adc1e91-959a-421b-a1fa-c3e6c0e23f32 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:58.030959 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-9adc1e91-959a-421b-a1fa-c3e6c0e23f32 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:58.031362 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-9adc1e91-959a-421b-a1fa-c3e6c0e23f32 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:58.153444 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-e73b1e4f-4853-40c5-9bdb-5abb78e6a492 tempest-FloatingIPsAssociationNegativeTestJSON-296725392 tempest-FloatingIPsAssociationNegativeTestJSON-296725392-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationNegativeTestJSON-server-266690738", "imageRef": "2d4a0047-1b9e-445f-8af8-1b5c9d93e881", "flavorRef": "452", "networks": [{"uuid": "86bacc2f-968e-47bf-8353-16e36ae733f8"}]}} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 18:57:58.258235 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.network.neutron [None req-e73b1e4f-4853-40c5-9bdb-5abb78e6a492 tempest-FloatingIPsAssociationNegativeTestJSON-296725392 tempest-FloatingIPsAssociationNegativeTestJSON-296725392-project] validate_networks() for [('86bacc2f-968e-47bf-8353-16e36ae733f8', None, None, None, None, None)] {{(pid=121402) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 01 18:57:58.480542 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-9adc1e91-959a-421b-a1fa-c3e6c0e23f32 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b52b7dcbb044f9bfc424e4417c77fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '708bc0ea4b5a4baf81933725792bedd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:57:58.490296 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-9adc1e91-959a-421b-a1fa-c3e6c0e23f32 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] 10.222.0.13 "GET /compute/v2.1/servers/e43fa43a-f523-4438-a8ba-a4460ea4a210" status: 200 len: 1529 microversion: 2.1 time: 0.486551 Nov 01 18:57:58.495962 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 513/1059] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:57:58 2022] GET /compute/v2.1/servers/e43fa43a-f523-4438-a8ba-a4460ea4a210 => generated 1529 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:57:58.512008 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-dc90053f-5050-4f9b-ad7a-7fbf92948e91 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:57:58.513950 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-dc90053f-5050-4f9b-ad7a-7fbf92948e91 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] [instance: 7218f99b-b011-4f08-931e-340d47069f6e] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:57:58.529926 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-dc90053f-5050-4f9b-ad7a-7fbf92948e91 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:58.532766 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-dc90053f-5050-4f9b-ad7a-7fbf92948e91 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:58.534205 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-dc90053f-5050-4f9b-ad7a-7fbf92948e91 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:58.536227 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-dc90053f-5050-4f9b-ad7a-7fbf92948e91 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:58.536846 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-dc90053f-5050-4f9b-ad7a-7fbf92948e91 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:58.537658 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-dc90053f-5050-4f9b-ad7a-7fbf92948e91 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:58.887578 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-dc90053f-5050-4f9b-ad7a-7fbf92948e91 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72117f17294649d6b8bc16c66c7efab2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45d4c047d3c44324a27a27831236ab0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:57:58.901920 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-dc90053f-5050-4f9b-ad7a-7fbf92948e91 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] 10.222.0.13 "GET /compute/v2.1/servers/7218f99b-b011-4f08-931e-340d47069f6e" status: 200 len: 1470 microversion: 2.1 time: 0.404764 Nov 01 18:57:58.904735 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 514/1060] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:57:58 2022] GET /compute/v2.1/servers/7218f99b-b011-4f08-931e-340d47069f6e => generated 1470 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:57:58.911955 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-ab1ba754-764c-42c3-b878-3b079026fe7a tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:57:58.912617 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-ab1ba754-764c-42c3-b878-3b079026fe7a tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] [instance: 869ca597-f199-474f-a680-59b0a75512c7] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:57:58.930828 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-ab1ba754-764c-42c3-b878-3b079026fe7a tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:58.931381 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-ab1ba754-764c-42c3-b878-3b079026fe7a tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:58.931871 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-ab1ba754-764c-42c3-b878-3b079026fe7a tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:58.933416 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-ab1ba754-764c-42c3-b878-3b079026fe7a tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:58.933886 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-ab1ba754-764c-42c3-b878-3b079026fe7a tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:58.934316 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-ab1ba754-764c-42c3-b878-3b079026fe7a tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:59.307690 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-ab1ba754-764c-42c3-b878-3b079026fe7a tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a63d69c99a546f0af16329cff3ca717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a1bb191cff948e99c008b5e861ce4a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:57:59.324863 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-ab1ba754-764c-42c3-b878-3b079026fe7a tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] 10.222.0.13 "GET /compute/v2.1/servers/869ca597-f199-474f-a680-59b0a75512c7" status: 200 len: 1520 microversion: 2.1 time: 0.418336 Nov 01 18:57:59.326351 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 515/1061] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:57:58 2022] GET /compute/v2.1/servers/869ca597-f199-474f-a680-59b0a75512c7 => generated 1520 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:57:59.333112 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-e4c7c247-4914-4d56-87aa-1b339160e586 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:57:59.334007 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-e4c7c247-4914-4d56-87aa-1b339160e586 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] [instance: ea631032-dd04-429b-988e-e6362ea42cf7] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:57:59.344656 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-e4c7c247-4914-4d56-87aa-1b339160e586 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:59.347413 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-e4c7c247-4914-4d56-87aa-1b339160e586 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:59.347876 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-e4c7c247-4914-4d56-87aa-1b339160e586 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:59.348813 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-e4c7c247-4914-4d56-87aa-1b339160e586 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:59.349099 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-e4c7c247-4914-4d56-87aa-1b339160e586 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:59.349513 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-e4c7c247-4914-4d56-87aa-1b339160e586 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:59.468712 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-e4c7c247-4914-4d56-87aa-1b339160e586 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c1314c21d8547ff890ede1c2ad281c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c804370880454c7aa02cef2c2c3cf144', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:57:59.482269 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-e4c7c247-4914-4d56-87aa-1b339160e586 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c1314c21d8547ff890ede1c2ad281c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c804370880454c7aa02cef2c2c3cf144', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:57:59.484477 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-e4c7c247-4914-4d56-87aa-1b339160e586 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c1314c21d8547ff890ede1c2ad281c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c804370880454c7aa02cef2c2c3cf144', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:57:59.496097 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-e4c7c247-4914-4d56-87aa-1b339160e586 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] 10.222.0.13 "GET /compute/v2.1/servers/ea631032-dd04-429b-988e-e6362ea42cf7" status: 200 len: 1537 microversion: 2.91 time: 0.168422 Nov 01 18:57:59.497357 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 516/1062] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 18:57:59 2022] GET /compute/v2.1/servers/ea631032-dd04-429b-988e-e6362ea42cf7 => generated 1537 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 18:57:59.513493 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [req-1253470d-338c-45e2-9660-5870f3fd6001 req-06ea1de3-f07c-49e5-9160-ea6751c11d62 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7218f99b-b011-4f08-931e-340d47069f6e", "name": "network-vif-plugged", "status": "completed", "tag": "8d7f9336-82a3-4d8c-a178-f498c4931099"}, {"server_uuid": "e43fa43a-f523-4438-a8ba-a4460ea4a210", "name": "network-vif-unplugged", "status": "completed", "tag": "9f4a6ee5-6fd1-413d-8d9e-aa1c5b8782b3"}]} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 18:57:59.521191 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-1253470d-338c-45e2-9660-5870f3fd6001 req-06ea1de3-f07c-49e5-9160-ea6751c11d62 service nova] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:59.521668 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-1253470d-338c-45e2-9660-5870f3fd6001 req-06ea1de3-f07c-49e5-9160-ea6751c11d62 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:59.522095 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-1253470d-338c-45e2-9660-5870f3fd6001 req-06ea1de3-f07c-49e5-9160-ea6751c11d62 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:59.535729 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.compute.server_external_events [req-1253470d-338c-45e2-9660-5870f3fd6001 req-06ea1de3-f07c-49e5-9160-ea6751c11d62 service nova] Creating event network-vif-plugged:8d7f9336-82a3-4d8c-a178-f498c4931099 for instance 7218f99b-b011-4f08-931e-340d47069f6e on n-h2-863052-2 Nov 01 18:57:59.536634 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.compute.server_external_events [req-1253470d-338c-45e2-9660-5870f3fd6001 req-06ea1de3-f07c-49e5-9160-ea6751c11d62 service nova] Creating event network-vif-unplugged:9f4a6ee5-6fd1-413d-8d9e-aa1c5b8782b3 for instance e43fa43a-f523-4438-a8ba-a4460ea4a210 on n-h2-863052-2 Nov 01 18:57:59.544842 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [req-1253470d-338c-45e2-9660-5870f3fd6001 req-06ea1de3-f07c-49e5-9160-ea6751c11d62 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.046011 Nov 01 18:57:59.545975 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 517/1063] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Nov 1 18:57:59 2022] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 18:57:59.552681 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [req-f941adbb-86d1-4351-9fb8-db740140069f req-0bb3107b-29be-48d3-b937-33f297b02ee8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e43fa43a-f523-4438-a8ba-a4460ea4a210", "name": "network-vif-deleted", "tag": "9f4a6ee5-6fd1-413d-8d9e-aa1c5b8782b3"}]} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 18:57:59.577841 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-f941adbb-86d1-4351-9fb8-db740140069f req-0bb3107b-29be-48d3-b937-33f297b02ee8 service nova] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:59.578333 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-f941adbb-86d1-4351-9fb8-db740140069f req-0bb3107b-29be-48d3-b937-33f297b02ee8 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:59.578817 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-f941adbb-86d1-4351-9fb8-db740140069f req-0bb3107b-29be-48d3-b937-33f297b02ee8 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:59.599197 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.virt.hardware [None req-e73b1e4f-4853-40c5-9bdb-5abb78e6a492 tempest-FloatingIPsAssociationNegativeTestJSON-296725392 tempest-FloatingIPsAssociationNegativeTestJSON-296725392-project] Flavor limits 0:0:0 {{(pid=121402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 01 18:57:59.600014 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.virt.hardware [None req-e73b1e4f-4853-40c5-9bdb-5abb78e6a492 tempest-FloatingIPsAssociationNegativeTestJSON-296725392 tempest-FloatingIPsAssociationNegativeTestJSON-296725392-project] Image limits 0:0:0 {{(pid=121402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 01 18:57:59.600806 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.virt.hardware [None req-e73b1e4f-4853-40c5-9bdb-5abb78e6a492 tempest-FloatingIPsAssociationNegativeTestJSON-296725392 tempest-FloatingIPsAssociationNegativeTestJSON-296725392-project] Flavor pref 0:0:0 {{(pid=121402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 01 18:57:59.601411 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.virt.hardware [None req-e73b1e4f-4853-40c5-9bdb-5abb78e6a492 tempest-FloatingIPsAssociationNegativeTestJSON-296725392 tempest-FloatingIPsAssociationNegativeTestJSON-296725392-project] Image pref 0:0:0 {{(pid=121402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 01 18:57:59.601943 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.virt.hardware [None req-e73b1e4f-4853-40c5-9bdb-5abb78e6a492 tempest-FloatingIPsAssociationNegativeTestJSON-296725392 tempest-FloatingIPsAssociationNegativeTestJSON-296725392-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 01 18:57:59.607780 n-d-863052-2 devstack@n-api.service[121402]: DEBUG dbcounter [-] [121402] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=121402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 18:57:59.622777 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.compute.server_external_events [req-f941adbb-86d1-4351-9fb8-db740140069f req-0bb3107b-29be-48d3-b937-33f297b02ee8 service nova] Creating event network-vif-deleted:9f4a6ee5-6fd1-413d-8d9e-aa1c5b8782b3 for instance e43fa43a-f523-4438-a8ba-a4460ea4a210 on n-h2-863052-2 Nov 01 18:57:59.632072 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e73b1e4f-4853-40c5-9bdb-5abb78e6a492 tempest-FloatingIPsAssociationNegativeTestJSON-296725392 tempest-FloatingIPsAssociationNegativeTestJSON-296725392-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:59.635557 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e73b1e4f-4853-40c5-9bdb-5abb78e6a492 tempest-FloatingIPsAssociationNegativeTestJSON-296725392 tempest-FloatingIPsAssociationNegativeTestJSON-296725392-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:59.635917 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [req-f941adbb-86d1-4351-9fb8-db740140069f req-0bb3107b-29be-48d3-b937-33f297b02ee8 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088384 Nov 01 18:57:59.636532 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 518/1064] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Nov 1 18:57:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 18:57:59.641043 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e73b1e4f-4853-40c5-9bdb-5abb78e6a492 tempest-FloatingIPsAssociationNegativeTestJSON-296725392 tempest-FloatingIPsAssociationNegativeTestJSON-296725392-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:59.644204 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e73b1e4f-4853-40c5-9bdb-5abb78e6a492 tempest-FloatingIPsAssociationNegativeTestJSON-296725392 tempest-FloatingIPsAssociationNegativeTestJSON-296725392-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:59.645476 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e73b1e4f-4853-40c5-9bdb-5abb78e6a492 tempest-FloatingIPsAssociationNegativeTestJSON-296725392 tempest-FloatingIPsAssociationNegativeTestJSON-296725392-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:59.648936 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e73b1e4f-4853-40c5-9bdb-5abb78e6a492 tempest-FloatingIPsAssociationNegativeTestJSON-296725392 tempest-FloatingIPsAssociationNegativeTestJSON-296725392-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:59.657585 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-a612cf02-f967-4739-8894-391ab8147262 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:57:59.658396 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-a612cf02-f967-4739-8894-391ab8147262 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] [instance: e43fa43a-f523-4438-a8ba-a4460ea4a210] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:57:59.687066 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-a612cf02-f967-4739-8894-391ab8147262 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:59.687954 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-a612cf02-f967-4739-8894-391ab8147262 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:59.688569 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-a612cf02-f967-4739-8894-391ab8147262 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:59.690682 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-a612cf02-f967-4739-8894-391ab8147262 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:59.692180 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-a612cf02-f967-4739-8894-391ab8147262 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:59.693213 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-a612cf02-f967-4739-8894-391ab8147262 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:59.711643 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.quota [None req-e73b1e4f-4853-40c5-9bdb-5abb78e6a492 tempest-FloatingIPsAssociationNegativeTestJSON-296725392 tempest-FloatingIPsAssociationNegativeTestJSON-296725392-project] Getting quotas for project e3bd3f356d364e11b14d90d71cb5d598. Resources: {'cores', 'ram', 'instances'} {{(pid=121402) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 01 18:57:59.732959 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.quota [None req-e73b1e4f-4853-40c5-9bdb-5abb78e6a492 tempest-FloatingIPsAssociationNegativeTestJSON-296725392 tempest-FloatingIPsAssociationNegativeTestJSON-296725392-project] Getting quotas for user d40b11c70b8e40d0b7e7f5f7d2967184 and project e3bd3f356d364e11b14d90d71cb5d598. Resources: {'cores', 'ram', 'instances'} {{(pid=121402) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 01 18:57:59.779848 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-e73b1e4f-4853-40c5-9bdb-5abb78e6a492 tempest-FloatingIPsAssociationNegativeTestJSON-296725392 tempest-FloatingIPsAssociationNegativeTestJSON-296725392-project] Going to run 1 instances... {{(pid=121402) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 01 18:57:59.785977 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-a612cf02-f967-4739-8894-391ab8147262 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:59.788275 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-e73b1e4f-4853-40c5-9bdb-5abb78e6a492 tempest-FloatingIPsAssociationNegativeTestJSON-296725392 tempest-FloatingIPsAssociationNegativeTestJSON-296725392-project] [instance: 8e62f12b-8b96-414a-8099-0f9acb7fabf5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2d4a0047-1b9e-445f-8af8-1b5c9d93e881',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121402) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 01 18:57:59.790348 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-a612cf02-f967-4739-8894-391ab8147262 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:59.791173 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-a612cf02-f967-4739-8894-391ab8147262 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:59.792553 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.objects.instance [None req-a612cf02-f967-4739-8894-391ab8147262 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Lazy-loading 'fault' on Instance uuid e43fa43a-f523-4438-a8ba-a4460ea4a210 {{(pid=121403) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 01 18:57:59.859564 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-e73b1e4f-4853-40c5-9bdb-5abb78e6a492 tempest-FloatingIPsAssociationNegativeTestJSON-296725392 tempest-FloatingIPsAssociationNegativeTestJSON-296725392-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.923970 Nov 01 18:57:59.863372 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 547/1065] 10.222.0.13 () {60 vars in 1147 bytes} [Tue Nov 1 18:57:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 1929 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 01 18:57:59.877757 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-d31771b6-9813-4212-a34c-43559d06ac70 tempest-FloatingIPsAssociationNegativeTestJSON-296725392 tempest-FloatingIPsAssociationNegativeTestJSON-296725392-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:57:59.878933 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-d31771b6-9813-4212-a34c-43559d06ac70 tempest-FloatingIPsAssociationNegativeTestJSON-296725392 tempest-FloatingIPsAssociationNegativeTestJSON-296725392-project] [instance: 8e62f12b-8b96-414a-8099-0f9acb7fabf5] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:57:59.925866 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-a612cf02-f967-4739-8894-391ab8147262 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b52b7dcbb044f9bfc424e4417c77fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '708bc0ea4b5a4baf81933725792bedd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:57:59.938713 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-a612cf02-f967-4739-8894-391ab8147262 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] 10.222.0.13 "GET /compute/v2.1/servers/e43fa43a-f523-4438-a8ba-a4460ea4a210" status: 200 len: 1315 microversion: 2.1 time: 0.296507 Nov 01 18:57:59.943375 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 519/1066] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:57:59 2022] GET /compute/v2.1/servers/e43fa43a-f523-4438-a8ba-a4460ea4a210 => generated 1315 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:57:59.956187 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-50c95593-31dc-4d22-90b8-402e585b6dcb tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:57:59.956896 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-50c95593-31dc-4d22-90b8-402e585b6dcb tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] [instance: 7218f99b-b011-4f08-931e-340d47069f6e] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:57:59.972641 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-50c95593-31dc-4d22-90b8-402e585b6dcb tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:59.973495 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-50c95593-31dc-4d22-90b8-402e585b6dcb tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:59.974176 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-50c95593-31dc-4d22-90b8-402e585b6dcb tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:59.975465 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-50c95593-31dc-4d22-90b8-402e585b6dcb tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:57:59.976029 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-50c95593-31dc-4d22-90b8-402e585b6dcb tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:57:59.976564 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-50c95593-31dc-4d22-90b8-402e585b6dcb tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:57:59.980440 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-d31771b6-9813-4212-a34c-43559d06ac70 tempest-FloatingIPsAssociationNegativeTestJSON-296725392 tempest-FloatingIPsAssociationNegativeTestJSON-296725392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd40b11c70b8e40d0b7e7f5f7d2967184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bd3f356d364e11b14d90d71cb5d598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:57:59.990472 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-d31771b6-9813-4212-a34c-43559d06ac70 tempest-FloatingIPsAssociationNegativeTestJSON-296725392 tempest-FloatingIPsAssociationNegativeTestJSON-296725392-project] 10.222.0.13 "GET /compute/v2.1/servers/8e62f12b-8b96-414a-8099-0f9acb7fabf5" status: 200 len: 1231 microversion: 2.1 time: 0.119360 Nov 01 18:58:00.005198 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 548/1067] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:57:59 2022] GET /compute/v2.1/servers/8e62f12b-8b96-414a-8099-0f9acb7fabf5 => generated 1231 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:58:00.199585 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-50c95593-31dc-4d22-90b8-402e585b6dcb tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72117f17294649d6b8bc16c66c7efab2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45d4c047d3c44324a27a27831236ab0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:58:00.211459 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-50c95593-31dc-4d22-90b8-402e585b6dcb tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] 10.222.0.13 "GET /compute/v2.1/servers/7218f99b-b011-4f08-931e-340d47069f6e" status: 200 len: 1462 microversion: 2.1 time: 0.266156 Nov 01 18:58:00.212289 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 520/1068] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:57:59 2022] GET /compute/v2.1/servers/7218f99b-b011-4f08-931e-340d47069f6e => generated 1462 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:58:00.237097 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-9dfce371-7aed-401b-9201-f0240f8c9728 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:58:00.238244 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-9dfce371-7aed-401b-9201-f0240f8c9728 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] [instance: 7218f99b-b011-4f08-931e-340d47069f6e] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:58:00.241330 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-422c0068-d12b-41ad-bf77-950a1000c635 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1610749317", "imageRef": "2d4a0047-1b9e-445f-8af8-1b5c9d93e881", "flavorRef": "452"}} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 18:58:00.245928 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-9dfce371-7aed-401b-9201-f0240f8c9728 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:00.246764 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-9dfce371-7aed-401b-9201-f0240f8c9728 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:00.247357 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-9dfce371-7aed-401b-9201-f0240f8c9728 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:00.248211 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-9dfce371-7aed-401b-9201-f0240f8c9728 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:00.248852 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-9dfce371-7aed-401b-9201-f0240f8c9728 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:00.249442 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-9dfce371-7aed-401b-9201-f0240f8c9728 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:00.370339 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.network.neutron [None req-422c0068-d12b-41ad-bf77-950a1000c635 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] validate_networks() for None {{(pid=121402) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 01 18:58:00.438803 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-9dfce371-7aed-401b-9201-f0240f8c9728 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72117f17294649d6b8bc16c66c7efab2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45d4c047d3c44324a27a27831236ab0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:58:00.450417 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-9dfce371-7aed-401b-9201-f0240f8c9728 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] 10.222.0.13 "GET /compute/v2.1/servers/7218f99b-b011-4f08-931e-340d47069f6e" status: 200 len: 1462 microversion: 2.1 time: 0.217944 Nov 01 18:58:00.451557 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 521/1069] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:58:00 2022] GET /compute/v2.1/servers/7218f99b-b011-4f08-931e-340d47069f6e => generated 1462 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 18:58:00.458134 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-e13bb93c-80b3-4fb1-8186-1f3a548addc1 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:58:00.459102 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-e13bb93c-80b3-4fb1-8186-1f3a548addc1 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] [instance: 869ca597-f199-474f-a680-59b0a75512c7] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:58:00.464929 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-e13bb93c-80b3-4fb1-8186-1f3a548addc1 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:00.465795 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-e13bb93c-80b3-4fb1-8186-1f3a548addc1 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:00.466408 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-e13bb93c-80b3-4fb1-8186-1f3a548addc1 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:00.467275 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-e13bb93c-80b3-4fb1-8186-1f3a548addc1 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:00.467918 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-e13bb93c-80b3-4fb1-8186-1f3a548addc1 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:00.468649 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-e13bb93c-80b3-4fb1-8186-1f3a548addc1 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:00.652665 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.virt.hardware [None req-422c0068-d12b-41ad-bf77-950a1000c635 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Flavor limits 0:0:0 {{(pid=121402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 01 18:58:00.653686 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.virt.hardware [None req-422c0068-d12b-41ad-bf77-950a1000c635 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Image limits 0:0:0 {{(pid=121402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 01 18:58:00.654348 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.virt.hardware [None req-422c0068-d12b-41ad-bf77-950a1000c635 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Flavor pref 0:0:0 {{(pid=121402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 01 18:58:00.654925 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.virt.hardware [None req-422c0068-d12b-41ad-bf77-950a1000c635 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Image pref 0:0:0 {{(pid=121402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 01 18:58:00.655617 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.virt.hardware [None req-422c0068-d12b-41ad-bf77-950a1000c635 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 01 18:58:00.658506 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-e13bb93c-80b3-4fb1-8186-1f3a548addc1 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a63d69c99a546f0af16329cff3ca717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a1bb191cff948e99c008b5e861ce4a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:58:00.665530 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-422c0068-d12b-41ad-bf77-950a1000c635 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:00.666046 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-422c0068-d12b-41ad-bf77-950a1000c635 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:00.666479 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-422c0068-d12b-41ad-bf77-950a1000c635 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:00.667203 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-422c0068-d12b-41ad-bf77-950a1000c635 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:00.667661 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-422c0068-d12b-41ad-bf77-950a1000c635 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:00.667881 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-e13bb93c-80b3-4fb1-8186-1f3a548addc1 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] 10.222.0.13 "GET /compute/v2.1/servers/869ca597-f199-474f-a680-59b0a75512c7" status: 200 len: 1520 microversion: 2.1 time: 0.214788 Nov 01 18:58:00.668214 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-422c0068-d12b-41ad-bf77-950a1000c635 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:00.668901 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 522/1070] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:58:00 2022] GET /compute/v2.1/servers/869ca597-f199-474f-a680-59b0a75512c7 => generated 1520 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:58:00.677877 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-cb40828b-e8d0-44a1-9f29-71e103b71ffe tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Action: 'create', calling method: .version_select at 0x7f0ae29a5dc0>, body: {"keypair": {"name": "tempest-keypair-1522475146", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPuS5rr17v4R0zq8GNnCI7oeq9IN+Rth56WeVVyPupNe5gN7TO1HRJsl9LiaePh5cHlfH/hduBM6V4aoOoUrtr0qsl/JqOPAzYouuN06pjq+I6VdRlQi78TX52xkk+HbDg=="}} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 18:58:00.696971 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.quota [None req-422c0068-d12b-41ad-bf77-950a1000c635 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Getting quotas for project 86941784237549838bba63ce88053b88. Resources: {'cores', 'ram', 'instances'} {{(pid=121402) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 01 18:58:00.697191 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.quota [None req-cb40828b-e8d0-44a1-9f29-71e103b71ffe tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Getting quotas for project 45d4c047d3c44324a27a27831236ab0d. Resources: {'key_pairs'} {{(pid=121403) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 01 18:58:00.703042 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.quota [None req-422c0068-d12b-41ad-bf77-950a1000c635 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Getting quotas for user 0290a6bb8bc24b8988a925327ac0381c and project 86941784237549838bba63ce88053b88. Resources: {'cores', 'ram', 'instances'} {{(pid=121402) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 01 18:58:00.703885 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.quota [None req-cb40828b-e8d0-44a1-9f29-71e103b71ffe tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Getting quotas for user 72117f17294649d6b8bc16c66c7efab2 and project 45d4c047d3c44324a27a27831236ab0d. Resources: {'key_pairs'} {{(pid=121403) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 01 18:58:00.717863 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-422c0068-d12b-41ad-bf77-950a1000c635 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Going to run 1 instances... {{(pid=121402) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 01 18:58:00.721579 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-422c0068-d12b-41ad-bf77-950a1000c635 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] [instance: 7186700c-1951-4ab3-a872-865dc1a45fa1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2d4a0047-1b9e-445f-8af8-1b5c9d93e881',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121402) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 01 18:58:00.732631 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-cb40828b-e8d0-44a1-9f29-71e103b71ffe tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.061959 Nov 01 18:58:00.733873 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 523/1071] 10.222.0.13 () {60 vars in 1159 bytes} [Tue Nov 1 18:58:00 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 18:58:00.738909 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-2dfaed0b-cd51-45f0-9e1b-676977510515 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:58:00.739826 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-2dfaed0b-cd51-45f0-9e1b-676977510515 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] [instance: ea631032-dd04-429b-988e-e6362ea42cf7] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:58:00.747176 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-2dfaed0b-cd51-45f0-9e1b-676977510515 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:00.747894 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-2dfaed0b-cd51-45f0-9e1b-676977510515 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:00.748499 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-2dfaed0b-cd51-45f0-9e1b-676977510515 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:00.749453 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-2dfaed0b-cd51-45f0-9e1b-676977510515 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:00.750279 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-2dfaed0b-cd51-45f0-9e1b-676977510515 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:00.750857 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-2dfaed0b-cd51-45f0-9e1b-676977510515 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:00.781766 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-422c0068-d12b-41ad-bf77-950a1000c635 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.671398 Nov 01 18:58:00.782866 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 549/1072] 10.222.0.13 () {60 vars in 1147 bytes} [Tue Nov 1 18:58:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 673 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Nov 01 18:58:00.799118 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-0be4a33f-52b4-4cf5-a564-87c23e2bc75b tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:58:00.801122 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-0be4a33f-52b4-4cf5-a564-87c23e2bc75b tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] [instance: 7186700c-1951-4ab3-a872-865dc1a45fa1] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:58:00.904870 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-0be4a33f-52b4-4cf5-a564-87c23e2bc75b tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0290a6bb8bc24b8988a925327ac0381c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86941784237549838bba63ce88053b88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:58:00.907254 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-2dfaed0b-cd51-45f0-9e1b-676977510515 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c1314c21d8547ff890ede1c2ad281c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c804370880454c7aa02cef2c2c3cf144', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:58:00.917839 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-0be4a33f-52b4-4cf5-a564-87c23e2bc75b tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] 10.222.0.13 "GET /compute/v2.1/servers/7186700c-1951-4ab3-a872-865dc1a45fa1" status: 200 len: 1217 microversion: 2.1 time: 0.127116 Nov 01 18:58:00.918863 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 550/1073] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:58:00 2022] GET /compute/v2.1/servers/7186700c-1951-4ab3-a872-865dc1a45fa1 => generated 1217 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:58:00.919607 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-2dfaed0b-cd51-45f0-9e1b-676977510515 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c1314c21d8547ff890ede1c2ad281c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c804370880454c7aa02cef2c2c3cf144', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:58:00.922619 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-2dfaed0b-cd51-45f0-9e1b-676977510515 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c1314c21d8547ff890ede1c2ad281c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c804370880454c7aa02cef2c2c3cf144', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:58:00.936165 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-2dfaed0b-cd51-45f0-9e1b-676977510515 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] 10.222.0.13 "GET /compute/v2.1/servers/ea631032-dd04-429b-988e-e6362ea42cf7" status: 200 len: 1537 microversion: 2.91 time: 0.200999 Nov 01 18:58:00.938777 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 524/1074] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 18:58:00 2022] GET /compute/v2.1/servers/ea631032-dd04-429b-988e-e6362ea42cf7 => generated 1537 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 18:58:00.967343 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-6c110503-2c92-4ee2-bd9a-5f25302f4b46 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:58:00.967986 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-6c110503-2c92-4ee2-bd9a-5f25302f4b46 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] [instance: e43fa43a-f523-4438-a8ba-a4460ea4a210] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:58:00.977756 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-6c110503-2c92-4ee2-bd9a-5f25302f4b46 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:00.978625 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-6c110503-2c92-4ee2-bd9a-5f25302f4b46 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:00.978854 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-6c110503-2c92-4ee2-bd9a-5f25302f4b46 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:00.979753 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-6c110503-2c92-4ee2-bd9a-5f25302f4b46 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:00.980375 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-6c110503-2c92-4ee2-bd9a-5f25302f4b46 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:00.981089 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-6c110503-2c92-4ee2-bd9a-5f25302f4b46 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:01.002147 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.wsgi [None req-6c110503-2c92-4ee2-bd9a-5f25302f4b46 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] HTTP exception thrown: Instance e43fa43a-f523-4438-a8ba-a4460ea4a210 could not be found. Nov 01 18:58:01.003847 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-6c110503-2c92-4ee2-bd9a-5f25302f4b46 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Request method failure captured: Nov 01 18:58:01.003847 n-d-863052-2 devstack@n-api.service[121402]: request: GET /compute/v2.1/servers/e43fa43a-f523-4438-a8ba-a4460ea4a210 HTTP/1.1 Nov 01 18:58:01.003847 n-d-863052-2 devstack@n-api.service[121402]: Accept: application/json Nov 01 18:58:01.003847 n-d-863052-2 devstack@n-api.service[121402]: Accept-Encoding: identity Nov 01 18:58:01.003847 n-d-863052-2 devstack@n-api.service[121402]: Connection: close Nov 01 18:58:01.003847 n-d-863052-2 devstack@n-api.service[121402]: Content-Length: 0 Nov 01 18:58:01.003847 n-d-863052-2 devstack@n-api.service[121402]: Content-Type: application/json Nov 01 18:58:01.003847 n-d-863052-2 devstack@n-api.service[121402]: Host: 10.222.0.13 Nov 01 18:58:01.003847 n-d-863052-2 devstack@n-api.service[121402]: Openstack-System-Scope: None Nov 01 18:58:01.003847 n-d-863052-2 devstack@n-api.service[121402]: User-Agent: python-urllib3/1.26.12 Nov 01 18:58:01.003847 n-d-863052-2 devstack@n-api.service[121402]: X-Auth-Token: gAAAAABjYWvqbQtaNCf0vN3RIHicQ7eZzuMpptpvowYCNSOJcJRxrJ9QX4Bvdyyh6S1_lak_JDolcn4qSC02atGGl8uI3NqpWQKt52qXcbtBLMPpaEiNHqRmhd3SjpSTdiucZ2dSpVmatQ9uPpkpENeFkI_E8IIwNVu5-V-pSAlLNGA0j86IptM Nov 01 18:58:01.003847 n-d-863052-2 devstack@n-api.service[121402]: X-Domain-Id: None Nov 01 18:58:01.003847 n-d-863052-2 devstack@n-api.service[121402]: X-Domain-Name: None Nov 01 18:58:01.003847 n-d-863052-2 devstack@n-api.service[121402]: X-Identity-Status: Confirmed Nov 01 18:58:01.003847 n-d-863052-2 devstack@n-api.service[121402]: X-Is-Admin-Project: True Nov 01 18:58:01.003847 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Domain-Id: default Nov 01 18:58:01.003847 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Domain-Name: Default Nov 01 18:58:01.003847 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Id: 708bc0ea4b5a4baf81933725792bedd5 Nov 01 18:58:01.003847 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1431666313 Nov 01 18:58:01.003847 n-d-863052-2 devstack@n-api.service[121402]: X-Role: member,reader Nov 01 18:58:01.003847 n-d-863052-2 devstack@n-api.service[121402]: X-Roles: member,reader Nov 01 18:58:01.005719 n-d-863052-2 devstack@n-api.service[121402]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/708bc0ea4b5a4baf81933725792bedd5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/708bc0ea4b5a4baf81933725792bedd5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_708bc0ea4b5a4baf81933725792bedd5", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/708bc0ea4b5a4baf81933725792bedd5"}]}] Nov 01 18:58:01.005719 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1431666313 Nov 01 18:58:01.005719 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant-Id: 708bc0ea4b5a4baf81933725792bedd5 Nov 01 18:58:01.005719 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1431666313 Nov 01 18:58:01.005719 n-d-863052-2 devstack@n-api.service[121402]: X-User: tempest-ImagesOneServerNegativeTestJSON-1431666313-project Nov 01 18:58:01.005719 n-d-863052-2 devstack@n-api.service[121402]: X-User-Domain-Id: default Nov 01 18:58:01.005719 n-d-863052-2 devstack@n-api.service[121402]: X-User-Domain-Name: Default Nov 01 18:58:01.005719 n-d-863052-2 devstack@n-api.service[121402]: X-User-Id: 09b52b7dcbb044f9bfc424e4417c77fa Nov 01 18:58:01.005719 n-d-863052-2 devstack@n-api.service[121402]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1431666313-project Nov 01 18:58:01.005719 n-d-863052-2 devstack@n-api.service[121402]: method: > Nov 01 18:58:01.005719 n-d-863052-2 devstack@n-api.service[121402]: exception: Instance e43fa43a-f523-4438-a8ba-a4460ea4a210 could not be found. Nov 01 18:58:01.005719 n-d-863052-2 devstack@n-api.service[121402]: action_args: {'id': 'e43fa43a-f523-4438-a8ba-a4460ea4a210'} Nov 01 18:58:01.006651 n-d-863052-2 devstack@n-api.service[121402]: {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 01 18:58:01.006651 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:58:01.006651 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 01 18:58:01.006651 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 01 18:58:01.006651 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 01 18:58:01.006651 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 01 18:58:01.006651 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 01 18:58:01.006651 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 01 18:58:01.006651 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 01 18:58:01.006651 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 01 18:58:01.006651 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e43fa43a-f523-4438-a8ba-a4460ea4a210 could not be found. Nov 01 18:58:01.006651 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 18:58:01.006651 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 18:58:01.006651 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 18:58:01.006651 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:58:01.006651 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 18:58:01.006651 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 18:58:01.006651 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 01 18:58:01.006651 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 01 18:58:01.006651 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 01 18:58:01.009686 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 01 18:58:01.009686 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 01 18:58:01.009686 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 01 18:58:01.009686 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 01 18:58:01.009686 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 01 18:58:01.009686 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 01 18:58:01.009686 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 01 18:58:01.009686 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e43fa43a-f523-4438-a8ba-a4460ea4a210 could not be found. Nov 01 18:58:01.009686 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 18:58:01.009686 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 18:58:01.009686 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 18:58:01.009686 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:58:01.009686 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 18:58:01.009686 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 18:58:01.009686 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 01 18:58:01.009686 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 01 18:58:01.009686 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e43fa43a-f523-4438-a8ba-a4460ea4a210 could not be found. Nov 01 18:58:01.009686 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 18:58:01.011154 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-6c110503-2c92-4ee2-bd9a-5f25302f4b46 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Returning 404 to user: Instance e43fa43a-f523-4438-a8ba-a4460ea4a210 could not be found. {{(pid=121402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 01 18:58:01.011154 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-6c110503-2c92-4ee2-bd9a-5f25302f4b46 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] 10.222.0.13 "GET /compute/v2.1/servers/e43fa43a-f523-4438-a8ba-a4460ea4a210" status: 404 len: 111 microversion: 2.1 time: 0.043195 Nov 01 18:58:01.014811 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 551/1075] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:58:00 2022] GET /compute/v2.1/servers/e43fa43a-f523-4438-a8ba-a4460ea4a210 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 01 18:58:01.018765 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-379525d8-312e-4824-8970-4c2c5fd97fca tempest-FloatingIPsAssociationNegativeTestJSON-296725392 tempest-FloatingIPsAssociationNegativeTestJSON-296725392-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:58:01.019392 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-379525d8-312e-4824-8970-4c2c5fd97fca tempest-FloatingIPsAssociationNegativeTestJSON-296725392 tempest-FloatingIPsAssociationNegativeTestJSON-296725392-project] [instance: 8e62f12b-8b96-414a-8099-0f9acb7fabf5] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:58:01.042172 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-379525d8-312e-4824-8970-4c2c5fd97fca tempest-FloatingIPsAssociationNegativeTestJSON-296725392 tempest-FloatingIPsAssociationNegativeTestJSON-296725392-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:01.042680 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-379525d8-312e-4824-8970-4c2c5fd97fca tempest-FloatingIPsAssociationNegativeTestJSON-296725392 tempest-FloatingIPsAssociationNegativeTestJSON-296725392-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:01.043129 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-379525d8-312e-4824-8970-4c2c5fd97fca tempest-FloatingIPsAssociationNegativeTestJSON-296725392 tempest-FloatingIPsAssociationNegativeTestJSON-296725392-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:01.050570 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-379525d8-312e-4824-8970-4c2c5fd97fca tempest-FloatingIPsAssociationNegativeTestJSON-296725392 tempest-FloatingIPsAssociationNegativeTestJSON-296725392-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:01.051574 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-379525d8-312e-4824-8970-4c2c5fd97fca tempest-FloatingIPsAssociationNegativeTestJSON-296725392 tempest-FloatingIPsAssociationNegativeTestJSON-296725392-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:01.052042 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-379525d8-312e-4824-8970-4c2c5fd97fca tempest-FloatingIPsAssociationNegativeTestJSON-296725392 tempest-FloatingIPsAssociationNegativeTestJSON-296725392-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:01.155734 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-379525d8-312e-4824-8970-4c2c5fd97fca tempest-FloatingIPsAssociationNegativeTestJSON-296725392 tempest-FloatingIPsAssociationNegativeTestJSON-296725392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd40b11c70b8e40d0b7e7f5f7d2967184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bd3f356d364e11b14d90d71cb5d598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:58:01.172009 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-379525d8-312e-4824-8970-4c2c5fd97fca tempest-FloatingIPsAssociationNegativeTestJSON-296725392 tempest-FloatingIPsAssociationNegativeTestJSON-296725392-project] 10.222.0.13 "GET /compute/v2.1/servers/8e62f12b-8b96-414a-8099-0f9acb7fabf5" status: 200 len: 1283 microversion: 2.1 time: 0.162259 Nov 01 18:58:01.172995 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 525/1076] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:58:01 2022] GET /compute/v2.1/servers/8e62f12b-8b96-414a-8099-0f9acb7fabf5 => generated 1283 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:58:01.258171 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-91c71a17-1299-4938-bb6d-11ec02d26fbd tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-1629081148", "imageRef": "2d4a0047-1b9e-445f-8af8-1b5c9d93e881", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 18:58:01.337336 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.network.neutron [None req-91c71a17-1299-4938-bb6d-11ec02d26fbd tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] validate_networks() for [('b865614d-f372-4a97-a96c-04f1f6457952', None, None, None, None, None)] {{(pid=121402) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 01 18:58:01.694684 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-d3a0b497-c8bb-43b0-bbae-cd486b61e808 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:58:01.695297 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-d3a0b497-c8bb-43b0-bbae-cd486b61e808 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] [instance: 869ca597-f199-474f-a680-59b0a75512c7] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:58:01.704879 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d3a0b497-c8bb-43b0-bbae-cd486b61e808 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:01.705708 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d3a0b497-c8bb-43b0-bbae-cd486b61e808 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:01.707538 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d3a0b497-c8bb-43b0-bbae-cd486b61e808 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:01.708448 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d3a0b497-c8bb-43b0-bbae-cd486b61e808 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:01.711380 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d3a0b497-c8bb-43b0-bbae-cd486b61e808 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:01.712006 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d3a0b497-c8bb-43b0-bbae-cd486b61e808 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:02.099236 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-d3a0b497-c8bb-43b0-bbae-cd486b61e808 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a63d69c99a546f0af16329cff3ca717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a1bb191cff948e99c008b5e861ce4a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:58:02.109025 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-d3a0b497-c8bb-43b0-bbae-cd486b61e808 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] 10.222.0.13 "GET /compute/v2.1/servers/869ca597-f199-474f-a680-59b0a75512c7" status: 200 len: 1520 microversion: 2.1 time: 0.417489 Nov 01 18:58:02.110164 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 526/1077] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:58:01 2022] GET /compute/v2.1/servers/869ca597-f199-474f-a680-59b0a75512c7 => generated 1520 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:58:02.117886 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-036d7305-3fe3-4f4e-8f93-0fe14b57eb3f tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:58:02.119046 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-036d7305-3fe3-4f4e-8f93-0fe14b57eb3f tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] [instance: 7186700c-1951-4ab3-a872-865dc1a45fa1] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:58:02.126733 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-036d7305-3fe3-4f4e-8f93-0fe14b57eb3f tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:02.132207 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-036d7305-3fe3-4f4e-8f93-0fe14b57eb3f tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:02.132708 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-036d7305-3fe3-4f4e-8f93-0fe14b57eb3f tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:02.133446 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-036d7305-3fe3-4f4e-8f93-0fe14b57eb3f tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:02.133920 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-036d7305-3fe3-4f4e-8f93-0fe14b57eb3f tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:02.134332 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-036d7305-3fe3-4f4e-8f93-0fe14b57eb3f tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:02.213200 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.virt.hardware [None req-91c71a17-1299-4938-bb6d-11ec02d26fbd tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Flavor limits 0:0:0 {{(pid=121402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 01 18:58:02.213715 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.virt.hardware [None req-91c71a17-1299-4938-bb6d-11ec02d26fbd tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Image limits 0:0:0 {{(pid=121402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 01 18:58:02.214075 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.virt.hardware [None req-91c71a17-1299-4938-bb6d-11ec02d26fbd tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Flavor pref 0:0:0 {{(pid=121402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 01 18:58:02.214477 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.virt.hardware [None req-91c71a17-1299-4938-bb6d-11ec02d26fbd tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Image pref 0:0:0 {{(pid=121402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 01 18:58:02.214880 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.virt.hardware [None req-91c71a17-1299-4938-bb6d-11ec02d26fbd tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 01 18:58:02.229501 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-91c71a17-1299-4938-bb6d-11ec02d26fbd tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:02.230249 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-91c71a17-1299-4938-bb6d-11ec02d26fbd tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:02.230847 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-91c71a17-1299-4938-bb6d-11ec02d26fbd tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:02.231750 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-91c71a17-1299-4938-bb6d-11ec02d26fbd tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:02.232358 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-91c71a17-1299-4938-bb6d-11ec02d26fbd tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:02.232985 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-91c71a17-1299-4938-bb6d-11ec02d26fbd tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:02.234623 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-036d7305-3fe3-4f4e-8f93-0fe14b57eb3f tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0290a6bb8bc24b8988a925327ac0381c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86941784237549838bba63ce88053b88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:58:02.245420 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-036d7305-3fe3-4f4e-8f93-0fe14b57eb3f tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] 10.222.0.13 "GET /compute/v2.1/servers/7186700c-1951-4ab3-a872-865dc1a45fa1" status: 200 len: 1269 microversion: 2.1 time: 0.133085 Nov 01 18:58:02.256194 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.quota [None req-91c71a17-1299-4938-bb6d-11ec02d26fbd tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Getting quotas for project 708bc0ea4b5a4baf81933725792bedd5. Resources: {'cores', 'ram', 'instances'} {{(pid=121402) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 01 18:58:02.261863 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.quota [None req-91c71a17-1299-4938-bb6d-11ec02d26fbd tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Getting quotas for user 09b52b7dcbb044f9bfc424e4417c77fa and project 708bc0ea4b5a4baf81933725792bedd5. Resources: {'cores', 'ram', 'instances'} {{(pid=121402) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 01 18:58:02.263626 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 527/1078] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:58:02 2022] GET /compute/v2.1/servers/7186700c-1951-4ab3-a872-865dc1a45fa1 => generated 1269 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:58:02.282186 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-91c71a17-1299-4938-bb6d-11ec02d26fbd tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Going to run 1 instances... {{(pid=121402) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 01 18:58:02.285218 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-91c71a17-1299-4938-bb6d-11ec02d26fbd tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] [instance: eebaed86-332c-47dc-af0f-f37e9b69d52f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2d4a0047-1b9e-445f-8af8-1b5c9d93e881',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121402) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 01 18:58:02.286719 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-8eeda94b-7f16-4b79-aa58-9b79a9d77f74 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:58:02.287336 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-8eeda94b-7f16-4b79-aa58-9b79a9d77f74 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] [instance: ea631032-dd04-429b-988e-e6362ea42cf7] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:58:02.299915 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-8eeda94b-7f16-4b79-aa58-9b79a9d77f74 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:02.301096 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-8eeda94b-7f16-4b79-aa58-9b79a9d77f74 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:02.301740 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-8eeda94b-7f16-4b79-aa58-9b79a9d77f74 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:02.302806 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-8eeda94b-7f16-4b79-aa58-9b79a9d77f74 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:02.303422 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-8eeda94b-7f16-4b79-aa58-9b79a9d77f74 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:02.304189 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-8eeda94b-7f16-4b79-aa58-9b79a9d77f74 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:02.390964 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-91c71a17-1299-4938-bb6d-11ec02d26fbd tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.136877 Nov 01 18:58:02.401507 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 552/1079] 10.222.0.13 () {60 vars in 1147 bytes} [Tue Nov 1 18:58:01 2022] POST /compute/v2.1/servers => generated 383 bytes in 1147 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 01 18:58:02.406860 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-e7334a12-e631-4b8b-86ca-6e07b4a28333 tempest-LiveMigrationTest-1695240876 tempest-LiveMigrationTest-1695240876-project-admin] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:58:02.407654 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-e7334a12-e631-4b8b-86ca-6e07b4a28333 tempest-LiveMigrationTest-1695240876 tempest-LiveMigrationTest-1695240876-project-admin] [instance: 2d525a31-b0be-44cb-8fb7-335075145f08] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:58:02.422244 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e7334a12-e631-4b8b-86ca-6e07b4a28333 tempest-LiveMigrationTest-1695240876 tempest-LiveMigrationTest-1695240876-project-admin] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:02.423007 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e7334a12-e631-4b8b-86ca-6e07b4a28333 tempest-LiveMigrationTest-1695240876 tempest-LiveMigrationTest-1695240876-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:02.424999 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e7334a12-e631-4b8b-86ca-6e07b4a28333 tempest-LiveMigrationTest-1695240876 tempest-LiveMigrationTest-1695240876-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:02.425865 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e7334a12-e631-4b8b-86ca-6e07b4a28333 tempest-LiveMigrationTest-1695240876 tempest-LiveMigrationTest-1695240876-project-admin] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:02.426470 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e7334a12-e631-4b8b-86ca-6e07b4a28333 tempest-LiveMigrationTest-1695240876 tempest-LiveMigrationTest-1695240876-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:02.427042 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e7334a12-e631-4b8b-86ca-6e07b4a28333 tempest-LiveMigrationTest-1695240876 tempest-LiveMigrationTest-1695240876-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:02.437622 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-8eeda94b-7f16-4b79-aa58-9b79a9d77f74 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c1314c21d8547ff890ede1c2ad281c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c804370880454c7aa02cef2c2c3cf144', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:58:02.473925 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-8eeda94b-7f16-4b79-aa58-9b79a9d77f74 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c1314c21d8547ff890ede1c2ad281c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c804370880454c7aa02cef2c2c3cf144', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:58:02.479771 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-8eeda94b-7f16-4b79-aa58-9b79a9d77f74 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c1314c21d8547ff890ede1c2ad281c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c804370880454c7aa02cef2c2c3cf144', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:58:02.493662 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-8eeda94b-7f16-4b79-aa58-9b79a9d77f74 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] 10.222.0.13 "GET /compute/v2.1/servers/ea631032-dd04-429b-988e-e6362ea42cf7" status: 200 len: 1537 microversion: 2.91 time: 0.228713 Nov 01 18:58:02.517738 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 528/1080] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 18:58:02 2022] GET /compute/v2.1/servers/ea631032-dd04-429b-988e-e6362ea42cf7 => generated 1537 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 18:58:02.531005 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-b6bc57ae-7b6a-4c07-b26e-afac85c379aa tempest-FloatingIPsAssociationNegativeTestJSON-296725392 tempest-FloatingIPsAssociationNegativeTestJSON-296725392-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:58:02.535085 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-b6bc57ae-7b6a-4c07-b26e-afac85c379aa tempest-FloatingIPsAssociationNegativeTestJSON-296725392 tempest-FloatingIPsAssociationNegativeTestJSON-296725392-project] [instance: 8e62f12b-8b96-414a-8099-0f9acb7fabf5] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:58:02.563302 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-b6bc57ae-7b6a-4c07-b26e-afac85c379aa tempest-FloatingIPsAssociationNegativeTestJSON-296725392 tempest-FloatingIPsAssociationNegativeTestJSON-296725392-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:02.563803 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-b6bc57ae-7b6a-4c07-b26e-afac85c379aa tempest-FloatingIPsAssociationNegativeTestJSON-296725392 tempest-FloatingIPsAssociationNegativeTestJSON-296725392-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:02.564295 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-b6bc57ae-7b6a-4c07-b26e-afac85c379aa tempest-FloatingIPsAssociationNegativeTestJSON-296725392 tempest-FloatingIPsAssociationNegativeTestJSON-296725392-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:02.565033 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-b6bc57ae-7b6a-4c07-b26e-afac85c379aa tempest-FloatingIPsAssociationNegativeTestJSON-296725392 tempest-FloatingIPsAssociationNegativeTestJSON-296725392-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:02.567254 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-b6bc57ae-7b6a-4c07-b26e-afac85c379aa tempest-FloatingIPsAssociationNegativeTestJSON-296725392 tempest-FloatingIPsAssociationNegativeTestJSON-296725392-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:02.569261 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-b6bc57ae-7b6a-4c07-b26e-afac85c379aa tempest-FloatingIPsAssociationNegativeTestJSON-296725392 tempest-FloatingIPsAssociationNegativeTestJSON-296725392-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:03.132284 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-e7334a12-e631-4b8b-86ca-6e07b4a28333 tempest-LiveMigrationTest-1695240876 tempest-LiveMigrationTest-1695240876-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/2d525a31-b0be-44cb-8fb7-335075145f08" status: 200 len: 1813 microversion: 2.1 time: 0.728278 Nov 01 18:58:03.141595 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 553/1081] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:58:02 2022] GET /compute/v2.1/servers/2d525a31-b0be-44cb-8fb7-335075145f08 => generated 1813 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:58:03.161577 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-9f2b744b-a6a3-47a2-83e4-adc57aff3063 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:58:03.162648 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-9f2b744b-a6a3-47a2-83e4-adc57aff3063 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] [instance: eebaed86-332c-47dc-af0f-f37e9b69d52f] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:58:03.183211 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-9f2b744b-a6a3-47a2-83e4-adc57aff3063 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:03.194171 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-9f2b744b-a6a3-47a2-83e4-adc57aff3063 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:03.194781 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-9f2b744b-a6a3-47a2-83e4-adc57aff3063 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:03.195546 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-9f2b744b-a6a3-47a2-83e4-adc57aff3063 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:03.196013 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-9f2b744b-a6a3-47a2-83e4-adc57aff3063 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:03.196443 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-9f2b744b-a6a3-47a2-83e4-adc57aff3063 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:03.294703 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-b6bc57ae-7b6a-4c07-b26e-afac85c379aa tempest-FloatingIPsAssociationNegativeTestJSON-296725392 tempest-FloatingIPsAssociationNegativeTestJSON-296725392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd40b11c70b8e40d0b7e7f5f7d2967184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bd3f356d364e11b14d90d71cb5d598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:58:03.303861 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-b6bc57ae-7b6a-4c07-b26e-afac85c379aa tempest-FloatingIPsAssociationNegativeTestJSON-296725392 tempest-FloatingIPsAssociationNegativeTestJSON-296725392-project] 10.222.0.13 "GET /compute/v2.1/servers/8e62f12b-8b96-414a-8099-0f9acb7fabf5" status: 200 len: 1331 microversion: 2.1 time: 0.782579 Nov 01 18:58:03.304852 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 529/1082] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:58:02 2022] GET /compute/v2.1/servers/8e62f12b-8b96-414a-8099-0f9acb7fabf5 => generated 1331 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:58:03.315756 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-6a817fa9-b6f5-48a2-9b31-c8cc3146b68b tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:58:03.318951 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-6a817fa9-b6f5-48a2-9b31-c8cc3146b68b tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] [instance: 869ca597-f199-474f-a680-59b0a75512c7] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:58:03.330329 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-6a817fa9-b6f5-48a2-9b31-c8cc3146b68b tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:03.331865 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-6a817fa9-b6f5-48a2-9b31-c8cc3146b68b tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:03.332504 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-6a817fa9-b6f5-48a2-9b31-c8cc3146b68b tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:03.333680 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-6a817fa9-b6f5-48a2-9b31-c8cc3146b68b tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:03.334111 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-6a817fa9-b6f5-48a2-9b31-c8cc3146b68b tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:03.334769 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-6a817fa9-b6f5-48a2-9b31-c8cc3146b68b tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:03.341522 n-d-863052-2 devstack@n-api.service[121403]: DEBUG dbcounter [-] [121403] Writing DB stats nova_cell1:SELECT=100 {{(pid=121403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 18:58:03.441973 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-9f2b744b-a6a3-47a2-83e4-adc57aff3063 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b52b7dcbb044f9bfc424e4417c77fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '708bc0ea4b5a4baf81933725792bedd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:58:03.451764 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-9f2b744b-a6a3-47a2-83e4-adc57aff3063 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] 10.222.0.13 "GET /compute/v2.1/servers/eebaed86-332c-47dc-af0f-f37e9b69d52f" status: 200 len: 1229 microversion: 2.1 time: 0.304800 Nov 01 18:58:03.477694 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 554/1083] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:58:03 2022] GET /compute/v2.1/servers/eebaed86-332c-47dc-af0f-f37e9b69d52f => generated 1229 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:58:03.485790 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-ec3ba218-bab0-418d-9bf1-d907d35fc33d tempest-LiveMigrationTest-1695240876 tempest-LiveMigrationTest-1695240876-project-admin] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:58:03.508755 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-ec3ba218-bab0-418d-9bf1-d907d35fc33d tempest-LiveMigrationTest-1695240876 tempest-LiveMigrationTest-1695240876-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:03.509542 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-ec3ba218-bab0-418d-9bf1-d907d35fc33d tempest-LiveMigrationTest-1695240876 tempest-LiveMigrationTest-1695240876-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:03.511058 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-ec3ba218-bab0-418d-9bf1-d907d35fc33d tempest-LiveMigrationTest-1695240876 tempest-LiveMigrationTest-1695240876-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:03.511983 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-ec3ba218-bab0-418d-9bf1-d907d35fc33d tempest-LiveMigrationTest-1695240876 tempest-LiveMigrationTest-1695240876-project-admin] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:03.512446 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-ec3ba218-bab0-418d-9bf1-d907d35fc33d tempest-LiveMigrationTest-1695240876 tempest-LiveMigrationTest-1695240876-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:03.512900 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-ec3ba218-bab0-418d-9bf1-d907d35fc33d tempest-LiveMigrationTest-1695240876 tempest-LiveMigrationTest-1695240876-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:03.565323 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-ec3ba218-bab0-418d-9bf1-d907d35fc33d tempest-LiveMigrationTest-1695240876 tempest-LiveMigrationTest-1695240876-project-admin] 10.222.0.13 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.083384 Nov 01 18:58:03.575779 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 555/1084] 10.222.0.13 () {58 vars in 1176 bytes} [Tue Nov 1 18:58:03 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 18:58:03.582237 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-2d1425fd-4d66-4465-a291-dd6782a3c6d5 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:58:03.583846 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-2d1425fd-4d66-4465-a291-dd6782a3c6d5 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] [instance: 7186700c-1951-4ab3-a872-865dc1a45fa1] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:58:03.592173 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2d1425fd-4d66-4465-a291-dd6782a3c6d5 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:03.592943 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2d1425fd-4d66-4465-a291-dd6782a3c6d5 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:03.595197 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2d1425fd-4d66-4465-a291-dd6782a3c6d5 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:03.597012 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2d1425fd-4d66-4465-a291-dd6782a3c6d5 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:03.597535 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2d1425fd-4d66-4465-a291-dd6782a3c6d5 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:03.598038 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2d1425fd-4d66-4465-a291-dd6782a3c6d5 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:03.662909 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-6a817fa9-b6f5-48a2-9b31-c8cc3146b68b tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a63d69c99a546f0af16329cff3ca717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a1bb191cff948e99c008b5e861ce4a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:58:03.671935 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-6a817fa9-b6f5-48a2-9b31-c8cc3146b68b tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] 10.222.0.13 "GET /compute/v2.1/servers/869ca597-f199-474f-a680-59b0a75512c7" status: 200 len: 1520 microversion: 2.1 time: 0.365744 Nov 01 18:58:03.672515 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 530/1085] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:58:03 2022] GET /compute/v2.1/servers/869ca597-f199-474f-a680-59b0a75512c7 => generated 1520 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:58:03.681371 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-d74e76d0-ba1f-4cb7-a8ed-552d5c066107 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:58:03.684538 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-d74e76d0-ba1f-4cb7-a8ed-552d5c066107 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] [instance: ea631032-dd04-429b-988e-e6362ea42cf7] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:58:03.691209 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d74e76d0-ba1f-4cb7-a8ed-552d5c066107 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:03.691690 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d74e76d0-ba1f-4cb7-a8ed-552d5c066107 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:03.692233 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d74e76d0-ba1f-4cb7-a8ed-552d5c066107 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:03.693158 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d74e76d0-ba1f-4cb7-a8ed-552d5c066107 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:03.693978 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d74e76d0-ba1f-4cb7-a8ed-552d5c066107 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:03.694562 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d74e76d0-ba1f-4cb7-a8ed-552d5c066107 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:03.749547 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-2d1425fd-4d66-4465-a291-dd6782a3c6d5 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0290a6bb8bc24b8988a925327ac0381c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86941784237549838bba63ce88053b88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:58:03.758745 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-2d1425fd-4d66-4465-a291-dd6782a3c6d5 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] 10.222.0.13 "GET /compute/v2.1/servers/7186700c-1951-4ab3-a872-865dc1a45fa1" status: 200 len: 1275 microversion: 2.1 time: 0.180763 Nov 01 18:58:03.780815 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 556/1086] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:58:03 2022] GET /compute/v2.1/servers/7186700c-1951-4ab3-a872-865dc1a45fa1 => generated 1275 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:58:03.786425 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-62952aaf-bc1d-41be-81b1-32ef7fd5c26b tempest-MigrationsAdminTest-1970194929 tempest-MigrationsAdminTest-1970194929-project-admin] Calling method '.version_select at 0x7f0ae2529c10>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:58:03.793072 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-62952aaf-bc1d-41be-81b1-32ef7fd5c26b tempest-MigrationsAdminTest-1970194929 tempest-MigrationsAdminTest-1970194929-project-admin] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:03.793567 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-62952aaf-bc1d-41be-81b1-32ef7fd5c26b tempest-MigrationsAdminTest-1970194929 tempest-MigrationsAdminTest-1970194929-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:03.796541 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-62952aaf-bc1d-41be-81b1-32ef7fd5c26b tempest-MigrationsAdminTest-1970194929 tempest-MigrationsAdminTest-1970194929-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:03.800097 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-d74e76d0-ba1f-4cb7-a8ed-552d5c066107 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c1314c21d8547ff890ede1c2ad281c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c804370880454c7aa02cef2c2c3cf144', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:58:03.810864 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-d74e76d0-ba1f-4cb7-a8ed-552d5c066107 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c1314c21d8547ff890ede1c2ad281c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c804370880454c7aa02cef2c2c3cf144', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:58:03.812894 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-d74e76d0-ba1f-4cb7-a8ed-552d5c066107 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c1314c21d8547ff890ede1c2ad281c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c804370880454c7aa02cef2c2c3cf144', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:58:03.813715 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-62952aaf-bc1d-41be-81b1-32ef7fd5c26b tempest-MigrationsAdminTest-1970194929 tempest-MigrationsAdminTest-1970194929-project-admin] 10.222.0.13 "GET /compute/v2.1/os-migrations" status: 200 len: 2338 microversion: 2.1 time: 0.031581 Nov 01 18:58:03.819023 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-d74e76d0-ba1f-4cb7-a8ed-552d5c066107 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] 10.222.0.13 "GET /compute/v2.1/servers/ea631032-dd04-429b-988e-e6362ea42cf7" status: 200 len: 1558 microversion: 2.91 time: 0.141260 Nov 01 18:58:03.819664 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 531/1087] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 18:58:03 2022] GET /compute/v2.1/servers/ea631032-dd04-429b-988e-e6362ea42cf7 => generated 1558 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 18:58:03.823883 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 557/1088] 10.222.0.13 () {58 vars in 1143 bytes} [Tue Nov 1 18:58:03 2022] GET /compute/v2.1/os-migrations => generated 2338 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:58:03.856609 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-afbb4b7b-8b6c-4707-b249-6ab51a7d79cf tempest-MigrationsAdminTest-1970194929 tempest-MigrationsAdminTest-1970194929-project-admin] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:58:03.865587 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-afbb4b7b-8b6c-4707-b249-6ab51a7d79cf tempest-MigrationsAdminTest-1970194929 tempest-MigrationsAdminTest-1970194929-project-admin] 10.222.0.13 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.021415 Nov 01 18:58:03.869136 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 532/1089] 10.222.0.13 () {58 vars in 1137 bytes} [Tue Nov 1 18:58:03 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 18:58:03.879633 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-607b511d-967f-4795-b443-77d8d4ea3240 tempest-MigrationsAdminTest-1970194929 tempest-MigrationsAdminTest-1970194929-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_resize_flavor_-1817160234", "ram": 1024, "disk": 1, "vcpus": 1}} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 18:58:03.913017 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-607b511d-967f-4795-b443-77d8d4ea3240 tempest-MigrationsAdminTest-1970194929 tempest-MigrationsAdminTest-1970194929-project-admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 499 microversion: 2.1 time: 0.037318 Nov 01 18:58:03.914190 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 558/1090] 10.222.0.13 () {60 vars in 1146 bytes} [Tue Nov 1 18:58:03 2022] POST /compute/v2.1/flavors => generated 499 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 18:58:03.926433 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-51d4f6e7-16da-4b31-9903-8d6f4ac3d356 tempest-MigrationsAdminTest-1970194929 tempest-MigrationsAdminTest-1970194929-project-admin] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:58:03.933967 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-51d4f6e7-16da-4b31-9903-8d6f4ac3d356 tempest-MigrationsAdminTest-1970194929 tempest-MigrationsAdminTest-1970194929-project-admin] 10.222.0.13 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.012087 Nov 01 18:58:03.934967 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 533/1091] 10.222.0.13 () {58 vars in 1182 bytes} [Tue Nov 1 18:58:03 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 01 18:58:04.123195 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-b50c2606-02e7-4300-98d2-66f4323bf660 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-1700693399", "imageRef": "2d4a0047-1b9e-445f-8af8-1b5c9d93e881", "flavorRef": "5ea4b6f0-c10d-445f-be41-707913d8c773"}} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 18:58:04.191534 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.network.neutron [None req-b50c2606-02e7-4300-98d2-66f4323bf660 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] validate_networks() for None {{(pid=121402) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 01 18:58:04.331278 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-fa3ffbe2-58a5-4779-8358-31e1d9202f7d tempest-FloatingIPsAssociationNegativeTestJSON-296725392 tempest-FloatingIPsAssociationNegativeTestJSON-296725392-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:58:04.332526 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-fa3ffbe2-58a5-4779-8358-31e1d9202f7d tempest-FloatingIPsAssociationNegativeTestJSON-296725392 tempest-FloatingIPsAssociationNegativeTestJSON-296725392-project] [instance: 8e62f12b-8b96-414a-8099-0f9acb7fabf5] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:58:04.340322 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-fa3ffbe2-58a5-4779-8358-31e1d9202f7d tempest-FloatingIPsAssociationNegativeTestJSON-296725392 tempest-FloatingIPsAssociationNegativeTestJSON-296725392-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:04.341793 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-fa3ffbe2-58a5-4779-8358-31e1d9202f7d tempest-FloatingIPsAssociationNegativeTestJSON-296725392 tempest-FloatingIPsAssociationNegativeTestJSON-296725392-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:04.342594 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-fa3ffbe2-58a5-4779-8358-31e1d9202f7d tempest-FloatingIPsAssociationNegativeTestJSON-296725392 tempest-FloatingIPsAssociationNegativeTestJSON-296725392-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:04.343793 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-fa3ffbe2-58a5-4779-8358-31e1d9202f7d tempest-FloatingIPsAssociationNegativeTestJSON-296725392 tempest-FloatingIPsAssociationNegativeTestJSON-296725392-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:04.344508 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-fa3ffbe2-58a5-4779-8358-31e1d9202f7d tempest-FloatingIPsAssociationNegativeTestJSON-296725392 tempest-FloatingIPsAssociationNegativeTestJSON-296725392-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:04.345218 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-fa3ffbe2-58a5-4779-8358-31e1d9202f7d tempest-FloatingIPsAssociationNegativeTestJSON-296725392 tempest-FloatingIPsAssociationNegativeTestJSON-296725392-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:04.572050 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-fa3ffbe2-58a5-4779-8358-31e1d9202f7d tempest-FloatingIPsAssociationNegativeTestJSON-296725392 tempest-FloatingIPsAssociationNegativeTestJSON-296725392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd40b11c70b8e40d0b7e7f5f7d2967184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bd3f356d364e11b14d90d71cb5d598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:58:04.582023 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-fa3ffbe2-58a5-4779-8358-31e1d9202f7d tempest-FloatingIPsAssociationNegativeTestJSON-296725392 tempest-FloatingIPsAssociationNegativeTestJSON-296725392-project] 10.222.0.13 "GET /compute/v2.1/servers/8e62f12b-8b96-414a-8099-0f9acb7fabf5" status: 200 len: 1331 microversion: 2.1 time: 0.254898 Nov 01 18:58:04.596886 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 534/1092] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:58:04 2022] GET /compute/v2.1/servers/8e62f12b-8b96-414a-8099-0f9acb7fabf5 => generated 1331 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 18:58:04.603277 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-35366cef-a8ca-4496-bd8a-8d187a17c9e2 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:58:04.604204 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-35366cef-a8ca-4496-bd8a-8d187a17c9e2 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] [instance: eebaed86-332c-47dc-af0f-f37e9b69d52f] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:58:04.610850 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-35366cef-a8ca-4496-bd8a-8d187a17c9e2 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:04.611637 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-35366cef-a8ca-4496-bd8a-8d187a17c9e2 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:04.612502 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-35366cef-a8ca-4496-bd8a-8d187a17c9e2 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:04.613444 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-35366cef-a8ca-4496-bd8a-8d187a17c9e2 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:04.614086 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-35366cef-a8ca-4496-bd8a-8d187a17c9e2 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:04.614896 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-35366cef-a8ca-4496-bd8a-8d187a17c9e2 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:04.709510 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-35366cef-a8ca-4496-bd8a-8d187a17c9e2 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b52b7dcbb044f9bfc424e4417c77fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '708bc0ea4b5a4baf81933725792bedd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:58:04.717489 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-35366cef-a8ca-4496-bd8a-8d187a17c9e2 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] 10.222.0.13 "GET /compute/v2.1/servers/eebaed86-332c-47dc-af0f-f37e9b69d52f" status: 200 len: 1295 microversion: 2.1 time: 0.119161 Nov 01 18:58:04.718149 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 535/1093] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:58:04 2022] GET /compute/v2.1/servers/eebaed86-332c-47dc-af0f-f37e9b69d52f => generated 1295 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:58:04.724238 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-36d471a9-0f31-40cd-8a7c-0e4c7f163830 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:58:04.725210 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-36d471a9-0f31-40cd-8a7c-0e4c7f163830 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] [instance: 869ca597-f199-474f-a680-59b0a75512c7] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:58:04.731666 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-36d471a9-0f31-40cd-8a7c-0e4c7f163830 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:04.732464 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-36d471a9-0f31-40cd-8a7c-0e4c7f163830 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:04.733169 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-36d471a9-0f31-40cd-8a7c-0e4c7f163830 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:04.734114 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-36d471a9-0f31-40cd-8a7c-0e4c7f163830 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:04.734806 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-36d471a9-0f31-40cd-8a7c-0e4c7f163830 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:04.735306 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-36d471a9-0f31-40cd-8a7c-0e4c7f163830 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:04.882954 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-36d471a9-0f31-40cd-8a7c-0e4c7f163830 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a63d69c99a546f0af16329cff3ca717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a1bb191cff948e99c008b5e861ce4a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:58:04.891963 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-36d471a9-0f31-40cd-8a7c-0e4c7f163830 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] 10.222.0.13 "GET /compute/v2.1/servers/869ca597-f199-474f-a680-59b0a75512c7" status: 200 len: 1520 microversion: 2.1 time: 0.172561 Nov 01 18:58:04.893847 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 536/1094] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:58:04 2022] GET /compute/v2.1/servers/869ca597-f199-474f-a680-59b0a75512c7 => generated 1520 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:58:04.899564 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-f092fb01-674b-4fce-89de-5a550cc06519 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:58:04.901274 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-f092fb01-674b-4fce-89de-5a550cc06519 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] [instance: 7186700c-1951-4ab3-a872-865dc1a45fa1] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:58:04.907503 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f092fb01-674b-4fce-89de-5a550cc06519 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:04.909516 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f092fb01-674b-4fce-89de-5a550cc06519 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:04.910195 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f092fb01-674b-4fce-89de-5a550cc06519 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:04.911161 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f092fb01-674b-4fce-89de-5a550cc06519 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:04.911836 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f092fb01-674b-4fce-89de-5a550cc06519 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:04.912494 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f092fb01-674b-4fce-89de-5a550cc06519 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:04.915101 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.virt.hardware [None req-b50c2606-02e7-4300-98d2-66f4323bf660 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Flavor limits 0:0:0 {{(pid=121402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 01 18:58:04.916116 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.virt.hardware [None req-b50c2606-02e7-4300-98d2-66f4323bf660 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Image limits 0:0:0 {{(pid=121402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 01 18:58:04.916831 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.virt.hardware [None req-b50c2606-02e7-4300-98d2-66f4323bf660 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Flavor pref 0:0:0 {{(pid=121402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 01 18:58:04.917396 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.virt.hardware [None req-b50c2606-02e7-4300-98d2-66f4323bf660 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Image pref 0:0:0 {{(pid=121402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 01 18:58:04.918044 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.virt.hardware [None req-b50c2606-02e7-4300-98d2-66f4323bf660 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 01 18:58:04.928560 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b50c2606-02e7-4300-98d2-66f4323bf660 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:04.929520 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b50c2606-02e7-4300-98d2-66f4323bf660 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:04.930165 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b50c2606-02e7-4300-98d2-66f4323bf660 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:04.932253 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b50c2606-02e7-4300-98d2-66f4323bf660 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:04.933005 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b50c2606-02e7-4300-98d2-66f4323bf660 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:04.934720 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b50c2606-02e7-4300-98d2-66f4323bf660 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:04.964910 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.quota [None req-b50c2606-02e7-4300-98d2-66f4323bf660 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Getting quotas for project 45d4c047d3c44324a27a27831236ab0d. Resources: {'cores', 'ram', 'instances'} {{(pid=121402) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 01 18:58:04.971352 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.quota [None req-b50c2606-02e7-4300-98d2-66f4323bf660 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Getting quotas for user 72117f17294649d6b8bc16c66c7efab2 and project 45d4c047d3c44324a27a27831236ab0d. Resources: {'cores', 'ram', 'instances'} {{(pid=121402) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 01 18:58:04.983029 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-f092fb01-674b-4fce-89de-5a550cc06519 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0290a6bb8bc24b8988a925327ac0381c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86941784237549838bba63ce88053b88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:58:04.987151 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-b50c2606-02e7-4300-98d2-66f4323bf660 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Going to run 1 instances... {{(pid=121402) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 01 18:58:04.989463 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-b50c2606-02e7-4300-98d2-66f4323bf660 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] [instance: 9249c81d-e57b-4985-a398-8ad97526d5c7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2d4a0047-1b9e-445f-8af8-1b5c9d93e881',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121402) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 01 18:58:04.992422 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-f092fb01-674b-4fce-89de-5a550cc06519 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] 10.222.0.13 "GET /compute/v2.1/servers/7186700c-1951-4ab3-a872-865dc1a45fa1" status: 200 len: 1275 microversion: 2.1 time: 0.097423 Nov 01 18:58:04.993273 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 537/1095] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:58:04 2022] GET /compute/v2.1/servers/7186700c-1951-4ab3-a872-865dc1a45fa1 => generated 1275 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:58:05.019250 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-6b6f5782-3927-42b8-b5f0-3375834c0774 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:58:05.020443 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-6b6f5782-3927-42b8-b5f0-3375834c0774 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] [instance: ea631032-dd04-429b-988e-e6362ea42cf7] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:58:05.027435 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-6b6f5782-3927-42b8-b5f0-3375834c0774 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:05.027996 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-6b6f5782-3927-42b8-b5f0-3375834c0774 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:05.028439 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-6b6f5782-3927-42b8-b5f0-3375834c0774 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:05.029372 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-6b6f5782-3927-42b8-b5f0-3375834c0774 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:05.030329 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-6b6f5782-3927-42b8-b5f0-3375834c0774 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:05.031555 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-6b6f5782-3927-42b8-b5f0-3375834c0774 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:05.043828 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-b50c2606-02e7-4300-98d2-66f4323bf660 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.925695 Nov 01 18:58:05.052512 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 559/1096] 10.222.0.13 () {60 vars in 1147 bytes} [Tue Nov 1 18:58:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 935 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 01 18:58:05.058549 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-88f3b9c5-4757-493f-bea4-135240187c07 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:58:05.059637 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-88f3b9c5-4757-493f-bea4-135240187c07 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] [instance: 9249c81d-e57b-4985-a398-8ad97526d5c7] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:58:05.135310 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-6b6f5782-3927-42b8-b5f0-3375834c0774 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c1314c21d8547ff890ede1c2ad281c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c804370880454c7aa02cef2c2c3cf144', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:58:05.145842 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-6b6f5782-3927-42b8-b5f0-3375834c0774 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c1314c21d8547ff890ede1c2ad281c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c804370880454c7aa02cef2c2c3cf144', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:58:05.151166 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-6b6f5782-3927-42b8-b5f0-3375834c0774 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c1314c21d8547ff890ede1c2ad281c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c804370880454c7aa02cef2c2c3cf144', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:58:05.163370 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-88f3b9c5-4757-493f-bea4-135240187c07 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72117f17294649d6b8bc16c66c7efab2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45d4c047d3c44324a27a27831236ab0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:58:05.163623 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-6b6f5782-3927-42b8-b5f0-3375834c0774 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] 10.222.0.13 "GET /compute/v2.1/servers/ea631032-dd04-429b-988e-e6362ea42cf7" status: 200 len: 1558 microversion: 2.91 time: 0.151123 Nov 01 18:58:05.164272 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 538/1097] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 18:58:05 2022] GET /compute/v2.1/servers/ea631032-dd04-429b-988e-e6362ea42cf7 => generated 1558 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 18:58:05.186728 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-88f3b9c5-4757-493f-bea4-135240187c07 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] 10.222.0.13 "GET /compute/v2.1/servers/9249c81d-e57b-4985-a398-8ad97526d5c7" status: 200 len: 1279 microversion: 2.1 time: 0.132630 Nov 01 18:58:05.187491 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 560/1098] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:58:05 2022] GET /compute/v2.1/servers/9249c81d-e57b-4985-a398-8ad97526d5c7 => generated 1279 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:58:05.609608 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-b9cd6538-4a84-4452-9534-24d989983f73 tempest-FloatingIPsAssociationNegativeTestJSON-296725392 tempest-FloatingIPsAssociationNegativeTestJSON-296725392-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:58:05.610623 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-b9cd6538-4a84-4452-9534-24d989983f73 tempest-FloatingIPsAssociationNegativeTestJSON-296725392 tempest-FloatingIPsAssociationNegativeTestJSON-296725392-project] [instance: 8e62f12b-8b96-414a-8099-0f9acb7fabf5] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:58:05.621972 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-b9cd6538-4a84-4452-9534-24d989983f73 tempest-FloatingIPsAssociationNegativeTestJSON-296725392 tempest-FloatingIPsAssociationNegativeTestJSON-296725392-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:05.622591 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-b9cd6538-4a84-4452-9534-24d989983f73 tempest-FloatingIPsAssociationNegativeTestJSON-296725392 tempest-FloatingIPsAssociationNegativeTestJSON-296725392-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:05.623200 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-b9cd6538-4a84-4452-9534-24d989983f73 tempest-FloatingIPsAssociationNegativeTestJSON-296725392 tempest-FloatingIPsAssociationNegativeTestJSON-296725392-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:05.623970 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-b9cd6538-4a84-4452-9534-24d989983f73 tempest-FloatingIPsAssociationNegativeTestJSON-296725392 tempest-FloatingIPsAssociationNegativeTestJSON-296725392-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:05.625998 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-b9cd6538-4a84-4452-9534-24d989983f73 tempest-FloatingIPsAssociationNegativeTestJSON-296725392 tempest-FloatingIPsAssociationNegativeTestJSON-296725392-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:05.626964 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-b9cd6538-4a84-4452-9534-24d989983f73 tempest-FloatingIPsAssociationNegativeTestJSON-296725392 tempest-FloatingIPsAssociationNegativeTestJSON-296725392-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:05.744503 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-1e3534d3-7af1-4689-8ffd-7fa528b4408a tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:58:05.745148 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-1e3534d3-7af1-4689-8ffd-7fa528b4408a tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] [instance: eebaed86-332c-47dc-af0f-f37e9b69d52f] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:58:05.759034 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-1e3534d3-7af1-4689-8ffd-7fa528b4408a tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:05.761153 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-1e3534d3-7af1-4689-8ffd-7fa528b4408a tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:05.762515 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-1e3534d3-7af1-4689-8ffd-7fa528b4408a tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:05.764960 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-1e3534d3-7af1-4689-8ffd-7fa528b4408a tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:05.769220 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-1e3534d3-7af1-4689-8ffd-7fa528b4408a tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:05.769897 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-1e3534d3-7af1-4689-8ffd-7fa528b4408a tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:05.941039 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-b9cd6538-4a84-4452-9534-24d989983f73 tempest-FloatingIPsAssociationNegativeTestJSON-296725392 tempest-FloatingIPsAssociationNegativeTestJSON-296725392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd40b11c70b8e40d0b7e7f5f7d2967184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bd3f356d364e11b14d90d71cb5d598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:58:05.958243 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-b9cd6538-4a84-4452-9534-24d989983f73 tempest-FloatingIPsAssociationNegativeTestJSON-296725392 tempest-FloatingIPsAssociationNegativeTestJSON-296725392-project] 10.222.0.13 "GET /compute/v2.1/servers/8e62f12b-8b96-414a-8099-0f9acb7fabf5" status: 200 len: 1331 microversion: 2.1 time: 0.352591 Nov 01 18:58:05.963488 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 539/1099] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:58:05 2022] GET /compute/v2.1/servers/8e62f12b-8b96-414a-8099-0f9acb7fabf5 => generated 1331 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:58:05.995053 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-986813a2-f928-4e80-a73a-a6ef6c6780c2 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:58:05.996079 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-986813a2-f928-4e80-a73a-a6ef6c6780c2 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] [instance: 869ca597-f199-474f-a680-59b0a75512c7] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:58:06.019993 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-986813a2-f928-4e80-a73a-a6ef6c6780c2 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:06.034452 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-986813a2-f928-4e80-a73a-a6ef6c6780c2 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:06.035142 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-986813a2-f928-4e80-a73a-a6ef6c6780c2 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:06.036724 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-986813a2-f928-4e80-a73a-a6ef6c6780c2 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:06.039265 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-986813a2-f928-4e80-a73a-a6ef6c6780c2 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:06.040985 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-1e3534d3-7af1-4689-8ffd-7fa528b4408a tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b52b7dcbb044f9bfc424e4417c77fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '708bc0ea4b5a4baf81933725792bedd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:58:06.041781 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-986813a2-f928-4e80-a73a-a6ef6c6780c2 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:06.062634 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-1e3534d3-7af1-4689-8ffd-7fa528b4408a tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] 10.222.0.13 "GET /compute/v2.1/servers/eebaed86-332c-47dc-af0f-f37e9b69d52f" status: 200 len: 1283 microversion: 2.1 time: 0.324332 Nov 01 18:58:06.063365 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 561/1100] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:58:05 2022] GET /compute/v2.1/servers/eebaed86-332c-47dc-af0f-f37e9b69d52f => generated 1283 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:58:06.090004 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [req-0759a682-643f-4d54-a65d-8934a84d236e req-dc1468f5-ee82-41f8-a4ce-a7abb3802aaa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8e62f12b-8b96-414a-8099-0f9acb7fabf5", "tag": "8b2113da-4763-4f79-99c9-989625f65d00"}]} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 18:58:06.120520 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-0759a682-643f-4d54-a65d-8934a84d236e req-dc1468f5-ee82-41f8-a4ce-a7abb3802aaa service nova] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:06.121420 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-0759a682-643f-4d54-a65d-8934a84d236e req-dc1468f5-ee82-41f8-a4ce-a7abb3802aaa service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:06.122070 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-0759a682-643f-4d54-a65d-8934a84d236e req-dc1468f5-ee82-41f8-a4ce-a7abb3802aaa service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:06.140258 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.compute.server_external_events [req-0759a682-643f-4d54-a65d-8934a84d236e req-dc1468f5-ee82-41f8-a4ce-a7abb3802aaa service nova] Creating event network-changed:8b2113da-4763-4f79-99c9-989625f65d00 for instance 8e62f12b-8b96-414a-8099-0f9acb7fabf5 on n-h2-863052-2 Nov 01 18:58:06.152250 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [req-0759a682-643f-4d54-a65d-8934a84d236e req-dc1468f5-ee82-41f8-a4ce-a7abb3802aaa service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086241 Nov 01 18:58:06.153495 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 562/1101] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Nov 1 18:58:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 18:58:06.164315 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-48d88e21-6204-43fa-971b-afb59e8966ea tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:58:06.165531 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-48d88e21-6204-43fa-971b-afb59e8966ea tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] [instance: 7186700c-1951-4ab3-a872-865dc1a45fa1] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:58:06.179711 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-48d88e21-6204-43fa-971b-afb59e8966ea tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:06.180709 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-48d88e21-6204-43fa-971b-afb59e8966ea tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:06.181424 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-48d88e21-6204-43fa-971b-afb59e8966ea tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:06.182374 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-48d88e21-6204-43fa-971b-afb59e8966ea tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:06.183146 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-48d88e21-6204-43fa-971b-afb59e8966ea tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:06.183775 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-48d88e21-6204-43fa-971b-afb59e8966ea tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:06.398691 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-986813a2-f928-4e80-a73a-a6ef6c6780c2 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a63d69c99a546f0af16329cff3ca717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a1bb191cff948e99c008b5e861ce4a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:58:06.415764 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-986813a2-f928-4e80-a73a-a6ef6c6780c2 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] 10.222.0.13 "GET /compute/v2.1/servers/869ca597-f199-474f-a680-59b0a75512c7" status: 200 len: 1520 microversion: 2.1 time: 0.444408 Nov 01 18:58:06.419973 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 540/1102] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:58:05 2022] GET /compute/v2.1/servers/869ca597-f199-474f-a680-59b0a75512c7 => generated 1520 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:58:06.434560 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-1283b44d-033c-4fef-8fad-6ef02d1ac7c8 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:58:06.447679 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-1283b44d-033c-4fef-8fad-6ef02d1ac7c8 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] [instance: ea631032-dd04-429b-988e-e6362ea42cf7] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:58:06.478942 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-1283b44d-033c-4fef-8fad-6ef02d1ac7c8 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:06.482226 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-1283b44d-033c-4fef-8fad-6ef02d1ac7c8 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:06.483370 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-1283b44d-033c-4fef-8fad-6ef02d1ac7c8 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:06.488214 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-1283b44d-033c-4fef-8fad-6ef02d1ac7c8 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:06.491164 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-1283b44d-033c-4fef-8fad-6ef02d1ac7c8 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:06.491599 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-1283b44d-033c-4fef-8fad-6ef02d1ac7c8 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:06.656050 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-1283b44d-033c-4fef-8fad-6ef02d1ac7c8 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c1314c21d8547ff890ede1c2ad281c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c804370880454c7aa02cef2c2c3cf144', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:58:06.670698 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-1283b44d-033c-4fef-8fad-6ef02d1ac7c8 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c1314c21d8547ff890ede1c2ad281c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c804370880454c7aa02cef2c2c3cf144', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:58:06.674473 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-1283b44d-033c-4fef-8fad-6ef02d1ac7c8 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c1314c21d8547ff890ede1c2ad281c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c804370880454c7aa02cef2c2c3cf144', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:58:06.680342 n-d-863052-2 devstack@n-api.service[121403]: DEBUG dbcounter [-] [121403] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=121403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 18:58:06.682384 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-1283b44d-033c-4fef-8fad-6ef02d1ac7c8 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] 10.222.0.13 "GET /compute/v2.1/servers/ea631032-dd04-429b-988e-e6362ea42cf7" status: 200 len: 1553 microversion: 2.91 time: 0.261369 Nov 01 18:58:06.696689 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 541/1103] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 18:58:06 2022] GET /compute/v2.1/servers/ea631032-dd04-429b-988e-e6362ea42cf7 => generated 1553 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 18:58:06.707738 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-8617ca47-018b-4384-b578-a494a9ce0701 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:58:06.713494 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-8617ca47-018b-4384-b578-a494a9ce0701 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] [instance: 9249c81d-e57b-4985-a398-8ad97526d5c7] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:58:06.732914 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-8617ca47-018b-4384-b578-a494a9ce0701 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:06.733403 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-8617ca47-018b-4384-b578-a494a9ce0701 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:06.734079 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-8617ca47-018b-4384-b578-a494a9ce0701 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:06.734936 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-8617ca47-018b-4384-b578-a494a9ce0701 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:06.735399 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-8617ca47-018b-4384-b578-a494a9ce0701 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:06.735887 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-8617ca47-018b-4384-b578-a494a9ce0701 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:06.822700 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-8617ca47-018b-4384-b578-a494a9ce0701 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72117f17294649d6b8bc16c66c7efab2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45d4c047d3c44324a27a27831236ab0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:58:06.831892 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-8617ca47-018b-4384-b578-a494a9ce0701 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] 10.222.0.13 "GET /compute/v2.1/servers/9249c81d-e57b-4985-a398-8ad97526d5c7" status: 200 len: 1331 microversion: 2.1 time: 0.140543 Nov 01 18:58:06.836679 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 542/1104] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:58:06 2022] GET /compute/v2.1/servers/9249c81d-e57b-4985-a398-8ad97526d5c7 => generated 1331 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:58:06.842554 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-672df154-3a14-4cf0-9214-31823ce14716 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7fb968ae-6b31-4687-bc84-4372e9905f0b", "device": "/dev/xvdb"}} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 18:58:06.846274 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-672df154-3a14-4cf0-9214-31823ce14716 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] [instance: 2d525a31-b0be-44cb-8fb7-335075145f08] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:58:06.854018 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-672df154-3a14-4cf0-9214-31823ce14716 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:06.854524 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-672df154-3a14-4cf0-9214-31823ce14716 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:06.855158 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-672df154-3a14-4cf0-9214-31823ce14716 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:06.855870 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-672df154-3a14-4cf0-9214-31823ce14716 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:06.856327 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-672df154-3a14-4cf0-9214-31823ce14716 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:06.856905 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-672df154-3a14-4cf0-9214-31823ce14716 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:06.906901 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-48d88e21-6204-43fa-971b-afb59e8966ea tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0290a6bb8bc24b8988a925327ac0381c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86941784237549838bba63ce88053b88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:58:06.926508 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-48d88e21-6204-43fa-971b-afb59e8966ea tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] 10.222.0.13 "GET /compute/v2.1/servers/7186700c-1951-4ab3-a872-865dc1a45fa1" status: 200 len: 1317 microversion: 2.1 time: 0.767320 Nov 01 18:58:06.927279 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 563/1105] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:58:06 2022] GET /compute/v2.1/servers/7186700c-1951-4ab3-a872-865dc1a45fa1 => generated 1317 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:58:06.986954 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-203c58c5-d9a6-4892-87a3-7a2a15440985 tempest-FloatingIPsAssociationNegativeTestJSON-296725392 tempest-FloatingIPsAssociationNegativeTestJSON-296725392-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:58:06.987912 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-203c58c5-d9a6-4892-87a3-7a2a15440985 tempest-FloatingIPsAssociationNegativeTestJSON-296725392 tempest-FloatingIPsAssociationNegativeTestJSON-296725392-project] [instance: 8e62f12b-8b96-414a-8099-0f9acb7fabf5] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:58:06.997812 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-203c58c5-d9a6-4892-87a3-7a2a15440985 tempest-FloatingIPsAssociationNegativeTestJSON-296725392 tempest-FloatingIPsAssociationNegativeTestJSON-296725392-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:07.000916 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-203c58c5-d9a6-4892-87a3-7a2a15440985 tempest-FloatingIPsAssociationNegativeTestJSON-296725392 tempest-FloatingIPsAssociationNegativeTestJSON-296725392-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:07.001493 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-203c58c5-d9a6-4892-87a3-7a2a15440985 tempest-FloatingIPsAssociationNegativeTestJSON-296725392 tempest-FloatingIPsAssociationNegativeTestJSON-296725392-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:07.002310 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-203c58c5-d9a6-4892-87a3-7a2a15440985 tempest-FloatingIPsAssociationNegativeTestJSON-296725392 tempest-FloatingIPsAssociationNegativeTestJSON-296725392-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:07.002840 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-203c58c5-d9a6-4892-87a3-7a2a15440985 tempest-FloatingIPsAssociationNegativeTestJSON-296725392 tempest-FloatingIPsAssociationNegativeTestJSON-296725392-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:07.003970 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-203c58c5-d9a6-4892-87a3-7a2a15440985 tempest-FloatingIPsAssociationNegativeTestJSON-296725392 tempest-FloatingIPsAssociationNegativeTestJSON-296725392-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:07.369772 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-672df154-3a14-4cf0-9214-31823ce14716 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] 10.222.0.13 "POST /compute/v2.1/servers/2d525a31-b0be-44cb-8fb7-335075145f08/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.531490 Nov 01 18:58:07.375952 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 543/1106] 10.222.0.13 () {60 vars in 1323 bytes} [Tue Nov 1 18:58:06 2022] POST /compute/v2.1/servers/2d525a31-b0be-44cb-8fb7-335075145f08/os-volume_attachments => generated 194 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 18:58:07.377275 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-8c278285-0a89-4f8a-b408-cc63f6d49256 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:58:07.378289 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-8c278285-0a89-4f8a-b408-cc63f6d49256 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] [instance: eebaed86-332c-47dc-af0f-f37e9b69d52f] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:58:07.387758 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-8c278285-0a89-4f8a-b408-cc63f6d49256 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:07.388492 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-8c278285-0a89-4f8a-b408-cc63f6d49256 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:07.389876 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-8c278285-0a89-4f8a-b408-cc63f6d49256 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:07.390731 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-8c278285-0a89-4f8a-b408-cc63f6d49256 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:07.391882 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-8c278285-0a89-4f8a-b408-cc63f6d49256 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:07.393913 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-8c278285-0a89-4f8a-b408-cc63f6d49256 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:07.744324 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-8c278285-0a89-4f8a-b408-cc63f6d49256 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b52b7dcbb044f9bfc424e4417c77fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '708bc0ea4b5a4baf81933725792bedd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:58:07.756744 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-8c278285-0a89-4f8a-b408-cc63f6d49256 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] 10.222.0.13 "GET /compute/v2.1/servers/eebaed86-332c-47dc-af0f-f37e9b69d52f" status: 200 len: 1325 microversion: 2.1 time: 0.383368 Nov 01 18:58:07.759792 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 544/1107] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:58:07 2022] GET /compute/v2.1/servers/eebaed86-332c-47dc-af0f-f37e9b69d52f => generated 1325 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:58:07.773374 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-100be711-7d67-44c6-989a-fe5610ebbcbe tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:58:07.778988 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-100be711-7d67-44c6-989a-fe5610ebbcbe tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] [instance: 869ca597-f199-474f-a680-59b0a75512c7] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:58:07.790210 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-100be711-7d67-44c6-989a-fe5610ebbcbe tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:07.790712 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-100be711-7d67-44c6-989a-fe5610ebbcbe tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:07.791151 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-100be711-7d67-44c6-989a-fe5610ebbcbe tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:07.792603 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-100be711-7d67-44c6-989a-fe5610ebbcbe tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:07.793614 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-100be711-7d67-44c6-989a-fe5610ebbcbe tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:07.794223 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-203c58c5-d9a6-4892-87a3-7a2a15440985 tempest-FloatingIPsAssociationNegativeTestJSON-296725392 tempest-FloatingIPsAssociationNegativeTestJSON-296725392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd40b11c70b8e40d0b7e7f5f7d2967184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bd3f356d364e11b14d90d71cb5d598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:58:07.795039 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-100be711-7d67-44c6-989a-fe5610ebbcbe tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:07.805750 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-203c58c5-d9a6-4892-87a3-7a2a15440985 tempest-FloatingIPsAssociationNegativeTestJSON-296725392 tempest-FloatingIPsAssociationNegativeTestJSON-296725392-project] 10.222.0.13 "GET /compute/v2.1/servers/8e62f12b-8b96-414a-8099-0f9acb7fabf5" status: 200 len: 1331 microversion: 2.1 time: 0.823212 Nov 01 18:58:07.807429 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 564/1108] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:58:06 2022] GET /compute/v2.1/servers/8e62f12b-8b96-414a-8099-0f9acb7fabf5 => generated 1331 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 18:58:07.821368 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-acacddf2-df36-4790-b891-0b995528328d tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:58:07.822130 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-acacddf2-df36-4790-b891-0b995528328d tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] [instance: ea631032-dd04-429b-988e-e6362ea42cf7] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:58:07.836936 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-acacddf2-df36-4790-b891-0b995528328d tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:07.837682 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-acacddf2-df36-4790-b891-0b995528328d tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:07.838189 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-acacddf2-df36-4790-b891-0b995528328d tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:07.839138 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-acacddf2-df36-4790-b891-0b995528328d tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:07.839822 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-acacddf2-df36-4790-b891-0b995528328d tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:07.841099 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-acacddf2-df36-4790-b891-0b995528328d tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:07.985699 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-acacddf2-df36-4790-b891-0b995528328d tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c1314c21d8547ff890ede1c2ad281c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c804370880454c7aa02cef2c2c3cf144', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:58:08.001481 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-acacddf2-df36-4790-b891-0b995528328d tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c1314c21d8547ff890ede1c2ad281c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c804370880454c7aa02cef2c2c3cf144', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:58:08.003903 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-acacddf2-df36-4790-b891-0b995528328d tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c1314c21d8547ff890ede1c2ad281c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c804370880454c7aa02cef2c2c3cf144', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:58:08.020248 n-d-863052-2 devstack@n-api.service[121402]: DEBUG dbcounter [-] [121402] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=13 {{(pid=121402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 18:58:08.033921 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-acacddf2-df36-4790-b891-0b995528328d tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] 10.222.0.13 "GET /compute/v2.1/servers/ea631032-dd04-429b-988e-e6362ea42cf7" status: 200 len: 1553 microversion: 2.91 time: 0.213119 Nov 01 18:58:08.041690 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 565/1109] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 18:58:07 2022] GET /compute/v2.1/servers/ea631032-dd04-429b-988e-e6362ea42cf7 => generated 1553 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 18:58:08.050188 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-b6a86200-9b1a-46c0-95c9-3186513d10dd tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:58:08.052482 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-b6a86200-9b1a-46c0-95c9-3186513d10dd tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] [instance: 9249c81d-e57b-4985-a398-8ad97526d5c7] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:58:08.074133 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b6a86200-9b1a-46c0-95c9-3186513d10dd tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:08.075359 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b6a86200-9b1a-46c0-95c9-3186513d10dd tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:08.076455 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b6a86200-9b1a-46c0-95c9-3186513d10dd tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:08.080555 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b6a86200-9b1a-46c0-95c9-3186513d10dd tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:08.081559 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b6a86200-9b1a-46c0-95c9-3186513d10dd tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:08.083634 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b6a86200-9b1a-46c0-95c9-3186513d10dd tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:08.249200 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-100be711-7d67-44c6-989a-fe5610ebbcbe tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a63d69c99a546f0af16329cff3ca717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a1bb191cff948e99c008b5e861ce4a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:58:08.263641 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-100be711-7d67-44c6-989a-fe5610ebbcbe tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] 10.222.0.13 "GET /compute/v2.1/servers/869ca597-f199-474f-a680-59b0a75512c7" status: 200 len: 1520 microversion: 2.1 time: 0.499978 Nov 01 18:58:08.286857 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 545/1110] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:58:07 2022] GET /compute/v2.1/servers/869ca597-f199-474f-a680-59b0a75512c7 => generated 1520 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:58:08.293232 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-3b6fcf66-d73a-44e3-bb4a-33c651c0752d tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:58:08.295375 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-3b6fcf66-d73a-44e3-bb4a-33c651c0752d tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] [instance: 7186700c-1951-4ab3-a872-865dc1a45fa1] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:58:08.305709 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-b6a86200-9b1a-46c0-95c9-3186513d10dd tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72117f17294649d6b8bc16c66c7efab2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45d4c047d3c44324a27a27831236ab0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:58:08.325619 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-b6a86200-9b1a-46c0-95c9-3186513d10dd tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] 10.222.0.13 "GET /compute/v2.1/servers/9249c81d-e57b-4985-a398-8ad97526d5c7" status: 200 len: 1337 microversion: 2.1 time: 0.279656 Nov 01 18:58:08.326475 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 566/1111] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:58:08 2022] GET /compute/v2.1/servers/9249c81d-e57b-4985-a398-8ad97526d5c7 => generated 1337 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:58:08.329198 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-3b6fcf66-d73a-44e3-bb4a-33c651c0752d tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:08.330004 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-3b6fcf66-d73a-44e3-bb4a-33c651c0752d tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:08.330600 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-3b6fcf66-d73a-44e3-bb4a-33c651c0752d tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:08.331482 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-3b6fcf66-d73a-44e3-bb4a-33c651c0752d tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:08.332156 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-3b6fcf66-d73a-44e3-bb4a-33c651c0752d tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:08.332785 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-3b6fcf66-d73a-44e3-bb4a-33c651c0752d tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:08.782525 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-33f9a973-b8d9-450f-818b-d7e9074816f2 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:58:08.783430 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-33f9a973-b8d9-450f-818b-d7e9074816f2 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] [instance: eebaed86-332c-47dc-af0f-f37e9b69d52f] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:58:08.798946 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-33f9a973-b8d9-450f-818b-d7e9074816f2 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:08.800770 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-33f9a973-b8d9-450f-818b-d7e9074816f2 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:08.801402 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-33f9a973-b8d9-450f-818b-d7e9074816f2 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:08.802290 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-33f9a973-b8d9-450f-818b-d7e9074816f2 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:08.802920 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-33f9a973-b8d9-450f-818b-d7e9074816f2 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:08.803506 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-33f9a973-b8d9-450f-818b-d7e9074816f2 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:08.918016 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-3b6fcf66-d73a-44e3-bb4a-33c651c0752d tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0290a6bb8bc24b8988a925327ac0381c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86941784237549838bba63ce88053b88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:58:08.934092 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-3b6fcf66-d73a-44e3-bb4a-33c651c0752d tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] 10.222.0.13 "GET /compute/v2.1/servers/7186700c-1951-4ab3-a872-865dc1a45fa1" status: 200 len: 1317 microversion: 2.1 time: 0.645604 Nov 01 18:58:08.942175 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 546/1112] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:58:08 2022] GET /compute/v2.1/servers/7186700c-1951-4ab3-a872-865dc1a45fa1 => generated 1317 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:58:08.951216 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-85bbab9c-fe45-4676-804f-9202d7f87b2a tempest-FloatingIPsAssociationNegativeTestJSON-296725392 tempest-FloatingIPsAssociationNegativeTestJSON-296725392-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:58:08.951822 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-85bbab9c-fe45-4676-804f-9202d7f87b2a tempest-FloatingIPsAssociationNegativeTestJSON-296725392 tempest-FloatingIPsAssociationNegativeTestJSON-296725392-project] [instance: 8e62f12b-8b96-414a-8099-0f9acb7fabf5] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:58:08.972713 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-85bbab9c-fe45-4676-804f-9202d7f87b2a tempest-FloatingIPsAssociationNegativeTestJSON-296725392 tempest-FloatingIPsAssociationNegativeTestJSON-296725392-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:08.973222 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-85bbab9c-fe45-4676-804f-9202d7f87b2a tempest-FloatingIPsAssociationNegativeTestJSON-296725392 tempest-FloatingIPsAssociationNegativeTestJSON-296725392-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:08.973659 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-85bbab9c-fe45-4676-804f-9202d7f87b2a tempest-FloatingIPsAssociationNegativeTestJSON-296725392 tempest-FloatingIPsAssociationNegativeTestJSON-296725392-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:08.974370 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-85bbab9c-fe45-4676-804f-9202d7f87b2a tempest-FloatingIPsAssociationNegativeTestJSON-296725392 tempest-FloatingIPsAssociationNegativeTestJSON-296725392-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:08.974821 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-85bbab9c-fe45-4676-804f-9202d7f87b2a tempest-FloatingIPsAssociationNegativeTestJSON-296725392 tempest-FloatingIPsAssociationNegativeTestJSON-296725392-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:08.980048 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-85bbab9c-fe45-4676-804f-9202d7f87b2a tempest-FloatingIPsAssociationNegativeTestJSON-296725392 tempest-FloatingIPsAssociationNegativeTestJSON-296725392-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:09.027805 n-d-863052-2 devstack@n-api.service[121403]: DEBUG dbcounter [-] [121403] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 18:58:09.325793 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-85bbab9c-fe45-4676-804f-9202d7f87b2a tempest-FloatingIPsAssociationNegativeTestJSON-296725392 tempest-FloatingIPsAssociationNegativeTestJSON-296725392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd40b11c70b8e40d0b7e7f5f7d2967184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bd3f356d364e11b14d90d71cb5d598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:58:09.338497 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-85bbab9c-fe45-4676-804f-9202d7f87b2a tempest-FloatingIPsAssociationNegativeTestJSON-296725392 tempest-FloatingIPsAssociationNegativeTestJSON-296725392-project] 10.222.0.13 "GET /compute/v2.1/servers/8e62f12b-8b96-414a-8099-0f9acb7fabf5" status: 200 len: 1331 microversion: 2.1 time: 0.392368 Nov 01 18:58:09.360667 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 547/1113] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:58:08 2022] GET /compute/v2.1/servers/8e62f12b-8b96-414a-8099-0f9acb7fabf5 => generated 1331 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:58:09.382046 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-efb46f3f-c256-4d23-8fe7-532732631a2b tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:58:09.382661 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-efb46f3f-c256-4d23-8fe7-532732631a2b tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] [instance: ea631032-dd04-429b-988e-e6362ea42cf7] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:58:09.403032 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-efb46f3f-c256-4d23-8fe7-532732631a2b tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:09.403245 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-efb46f3f-c256-4d23-8fe7-532732631a2b tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:09.403579 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-efb46f3f-c256-4d23-8fe7-532732631a2b tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:09.404254 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-efb46f3f-c256-4d23-8fe7-532732631a2b tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:09.405150 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-efb46f3f-c256-4d23-8fe7-532732631a2b tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:09.405150 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-efb46f3f-c256-4d23-8fe7-532732631a2b tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:09.484675 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-33f9a973-b8d9-450f-818b-d7e9074816f2 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b52b7dcbb044f9bfc424e4417c77fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '708bc0ea4b5a4baf81933725792bedd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:58:09.492433 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-33f9a973-b8d9-450f-818b-d7e9074816f2 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] 10.222.0.13 "GET /compute/v2.1/servers/eebaed86-332c-47dc-af0f-f37e9b69d52f" status: 200 len: 1325 microversion: 2.1 time: 0.713806 Nov 01 18:58:09.509071 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 567/1114] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:58:08 2022] GET /compute/v2.1/servers/eebaed86-332c-47dc-af0f-f37e9b69d52f => generated 1325 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 18:58:09.519166 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-33764930-c898-4e22-9bc5-5031926ecb40 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:58:09.519793 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-33764930-c898-4e22-9bc5-5031926ecb40 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] [instance: 869ca597-f199-474f-a680-59b0a75512c7] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:58:09.538537 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-33764930-c898-4e22-9bc5-5031926ecb40 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:09.539734 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-33764930-c898-4e22-9bc5-5031926ecb40 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:09.542614 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-33764930-c898-4e22-9bc5-5031926ecb40 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:09.543580 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-33764930-c898-4e22-9bc5-5031926ecb40 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:09.549885 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-33764930-c898-4e22-9bc5-5031926ecb40 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:09.563251 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-33764930-c898-4e22-9bc5-5031926ecb40 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:09.568165 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-efb46f3f-c256-4d23-8fe7-532732631a2b tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c1314c21d8547ff890ede1c2ad281c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c804370880454c7aa02cef2c2c3cf144', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:58:09.577621 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-efb46f3f-c256-4d23-8fe7-532732631a2b tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c1314c21d8547ff890ede1c2ad281c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c804370880454c7aa02cef2c2c3cf144', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:58:09.579002 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-efb46f3f-c256-4d23-8fe7-532732631a2b tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c1314c21d8547ff890ede1c2ad281c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c804370880454c7aa02cef2c2c3cf144', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:58:09.592767 n-d-863052-2 devstack@n-api.service[121402]: DEBUG dbcounter [-] [121402] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=98,nova_cell1:INSERT=1 {{(pid=121402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 18:58:09.597161 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-efb46f3f-c256-4d23-8fe7-532732631a2b tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] 10.222.0.13 "GET /compute/v2.1/servers/ea631032-dd04-429b-988e-e6362ea42cf7" status: 200 len: 1553 microversion: 2.91 time: 0.235065 Nov 01 18:58:09.608604 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 548/1115] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 18:58:09 2022] GET /compute/v2.1/servers/ea631032-dd04-429b-988e-e6362ea42cf7 => generated 1553 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 18:58:09.615965 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-9b9b77eb-9c3c-4757-b5e1-78c8906ae15e tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:58:09.615965 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-9b9b77eb-9c3c-4757-b5e1-78c8906ae15e tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] [instance: 9249c81d-e57b-4985-a398-8ad97526d5c7] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:58:09.637556 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-9b9b77eb-9c3c-4757-b5e1-78c8906ae15e tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:09.638317 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-9b9b77eb-9c3c-4757-b5e1-78c8906ae15e tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:09.638905 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-9b9b77eb-9c3c-4757-b5e1-78c8906ae15e tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:09.639765 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-9b9b77eb-9c3c-4757-b5e1-78c8906ae15e tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:09.640368 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-9b9b77eb-9c3c-4757-b5e1-78c8906ae15e tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:09.640983 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-9b9b77eb-9c3c-4757-b5e1-78c8906ae15e tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:10.242264 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-9b9b77eb-9c3c-4757-b5e1-78c8906ae15e tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72117f17294649d6b8bc16c66c7efab2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45d4c047d3c44324a27a27831236ab0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:58:10.277230 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-9b9b77eb-9c3c-4757-b5e1-78c8906ae15e tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] 10.222.0.13 "GET /compute/v2.1/servers/9249c81d-e57b-4985-a398-8ad97526d5c7" status: 200 len: 1379 microversion: 2.1 time: 0.665962 Nov 01 18:58:10.281369 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 549/1116] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:58:09 2022] GET /compute/v2.1/servers/9249c81d-e57b-4985-a398-8ad97526d5c7 => generated 1379 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:58:10.307539 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [req-8ff87ea6-27b3-4b88-9b3b-5a2826d5e742 req-a48f4784-17d0-4343-9c38-a676ec87eda2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7186700c-1951-4ab3-a872-865dc1a45fa1", "tag": "77cc2e93-7bb9-47d9-9c54-7857a7ba35e5"}]} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 18:58:10.348018 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-8ff87ea6-27b3-4b88-9b3b-5a2826d5e742 req-a48f4784-17d0-4343-9c38-a676ec87eda2 service nova] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:10.348511 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-8ff87ea6-27b3-4b88-9b3b-5a2826d5e742 req-a48f4784-17d0-4343-9c38-a676ec87eda2 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:10.349295 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-8ff87ea6-27b3-4b88-9b3b-5a2826d5e742 req-a48f4784-17d0-4343-9c38-a676ec87eda2 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:10.382301 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.compute.server_external_events [req-8ff87ea6-27b3-4b88-9b3b-5a2826d5e742 req-a48f4784-17d0-4343-9c38-a676ec87eda2 service nova] Creating event network-changed:77cc2e93-7bb9-47d9-9c54-7857a7ba35e5 for instance 7186700c-1951-4ab3-a872-865dc1a45fa1 on n-h1-863052-2 Nov 01 18:58:10.389177 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [req-8ff87ea6-27b3-4b88-9b3b-5a2826d5e742 req-a48f4784-17d0-4343-9c38-a676ec87eda2 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105998 Nov 01 18:58:10.390172 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 550/1117] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Nov 1 18:58:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 18:58:10.407856 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-da3f0b8b-6c42-4f90-9e77-c6fd643d75b2 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:58:10.408892 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-da3f0b8b-6c42-4f90-9e77-c6fd643d75b2 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] [instance: 7186700c-1951-4ab3-a872-865dc1a45fa1] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:58:10.415355 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-da3f0b8b-6c42-4f90-9e77-c6fd643d75b2 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:10.416107 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-da3f0b8b-6c42-4f90-9e77-c6fd643d75b2 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:10.417133 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-da3f0b8b-6c42-4f90-9e77-c6fd643d75b2 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:10.429669 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-da3f0b8b-6c42-4f90-9e77-c6fd643d75b2 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:10.430459 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-da3f0b8b-6c42-4f90-9e77-c6fd643d75b2 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:10.431104 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-da3f0b8b-6c42-4f90-9e77-c6fd643d75b2 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:10.701973 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-da3f0b8b-6c42-4f90-9e77-c6fd643d75b2 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0290a6bb8bc24b8988a925327ac0381c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86941784237549838bba63ce88053b88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:58:10.717136 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-da3f0b8b-6c42-4f90-9e77-c6fd643d75b2 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] 10.222.0.13 "GET /compute/v2.1/servers/7186700c-1951-4ab3-a872-865dc1a45fa1" status: 200 len: 1317 microversion: 2.1 time: 0.322213 Nov 01 18:58:10.718492 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 551/1118] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:58:10 2022] GET /compute/v2.1/servers/7186700c-1951-4ab3-a872-865dc1a45fa1 => generated 1317 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:58:10.731395 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-0fb44598-0cc7-43c0-afc0-0c43c654255c tempest-FloatingIPsAssociationNegativeTestJSON-296725392 tempest-FloatingIPsAssociationNegativeTestJSON-296725392-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:58:10.732250 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-0fb44598-0cc7-43c0-afc0-0c43c654255c tempest-FloatingIPsAssociationNegativeTestJSON-296725392 tempest-FloatingIPsAssociationNegativeTestJSON-296725392-project] [instance: 8e62f12b-8b96-414a-8099-0f9acb7fabf5] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:58:10.740642 n-d-863052-2 devstack@n-api.service[121403]: DEBUG dbcounter [-] [121403] Writing DB stats nova_cell0:SELECT=4 {{(pid=121403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 18:58:10.751960 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-0fb44598-0cc7-43c0-afc0-0c43c654255c tempest-FloatingIPsAssociationNegativeTestJSON-296725392 tempest-FloatingIPsAssociationNegativeTestJSON-296725392-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:10.752801 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-0fb44598-0cc7-43c0-afc0-0c43c654255c tempest-FloatingIPsAssociationNegativeTestJSON-296725392 tempest-FloatingIPsAssociationNegativeTestJSON-296725392-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:10.754894 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-0fb44598-0cc7-43c0-afc0-0c43c654255c tempest-FloatingIPsAssociationNegativeTestJSON-296725392 tempest-FloatingIPsAssociationNegativeTestJSON-296725392-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:10.755859 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-0fb44598-0cc7-43c0-afc0-0c43c654255c tempest-FloatingIPsAssociationNegativeTestJSON-296725392 tempest-FloatingIPsAssociationNegativeTestJSON-296725392-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:10.756480 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-0fb44598-0cc7-43c0-afc0-0c43c654255c tempest-FloatingIPsAssociationNegativeTestJSON-296725392 tempest-FloatingIPsAssociationNegativeTestJSON-296725392-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:10.757256 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-0fb44598-0cc7-43c0-afc0-0c43c654255c tempest-FloatingIPsAssociationNegativeTestJSON-296725392 tempest-FloatingIPsAssociationNegativeTestJSON-296725392-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:10.859395 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-33764930-c898-4e22-9bc5-5031926ecb40 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a63d69c99a546f0af16329cff3ca717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a1bb191cff948e99c008b5e861ce4a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:58:10.872091 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-33764930-c898-4e22-9bc5-5031926ecb40 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] 10.222.0.13 "GET /compute/v2.1/servers/869ca597-f199-474f-a680-59b0a75512c7" status: 200 len: 1520 microversion: 2.1 time: 1.361831 Nov 01 18:58:10.872715 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 568/1119] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:58:09 2022] GET /compute/v2.1/servers/869ca597-f199-474f-a680-59b0a75512c7 => generated 1520 bytes in 1363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:58:10.879893 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-b5525c65-b3f5-40ae-8ef7-0b1c83125d4b tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:58:10.891223 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-b5525c65-b3f5-40ae-8ef7-0b1c83125d4b tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] [instance: eebaed86-332c-47dc-af0f-f37e9b69d52f] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:58:10.904314 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b5525c65-b3f5-40ae-8ef7-0b1c83125d4b tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:10.904828 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b5525c65-b3f5-40ae-8ef7-0b1c83125d4b tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:10.905260 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b5525c65-b3f5-40ae-8ef7-0b1c83125d4b tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:10.905958 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b5525c65-b3f5-40ae-8ef7-0b1c83125d4b tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:10.906410 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b5525c65-b3f5-40ae-8ef7-0b1c83125d4b tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:10.906831 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b5525c65-b3f5-40ae-8ef7-0b1c83125d4b tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:11.077512 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-0fb44598-0cc7-43c0-afc0-0c43c654255c tempest-FloatingIPsAssociationNegativeTestJSON-296725392 tempest-FloatingIPsAssociationNegativeTestJSON-296725392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd40b11c70b8e40d0b7e7f5f7d2967184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bd3f356d364e11b14d90d71cb5d598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:58:11.089498 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-0fb44598-0cc7-43c0-afc0-0c43c654255c tempest-FloatingIPsAssociationNegativeTestJSON-296725392 tempest-FloatingIPsAssociationNegativeTestJSON-296725392-project] 10.222.0.13 "GET /compute/v2.1/servers/8e62f12b-8b96-414a-8099-0f9acb7fabf5" status: 200 len: 1331 microversion: 2.1 time: 0.364923 Nov 01 18:58:11.090258 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 552/1120] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:58:10 2022] GET /compute/v2.1/servers/8e62f12b-8b96-414a-8099-0f9acb7fabf5 => generated 1331 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:58:11.100203 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-d9029acc-2357-4ac3-9cf8-354f4fad4c67 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:58:11.101086 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-d9029acc-2357-4ac3-9cf8-354f4fad4c67 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] [instance: ea631032-dd04-429b-988e-e6362ea42cf7] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:58:11.110966 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d9029acc-2357-4ac3-9cf8-354f4fad4c67 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:11.117921 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d9029acc-2357-4ac3-9cf8-354f4fad4c67 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:11.118604 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d9029acc-2357-4ac3-9cf8-354f4fad4c67 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:11.121460 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d9029acc-2357-4ac3-9cf8-354f4fad4c67 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:11.122111 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d9029acc-2357-4ac3-9cf8-354f4fad4c67 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:11.122708 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d9029acc-2357-4ac3-9cf8-354f4fad4c67 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:11.245698 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-d9029acc-2357-4ac3-9cf8-354f4fad4c67 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c1314c21d8547ff890ede1c2ad281c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c804370880454c7aa02cef2c2c3cf144', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:58:11.254609 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-d9029acc-2357-4ac3-9cf8-354f4fad4c67 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c1314c21d8547ff890ede1c2ad281c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c804370880454c7aa02cef2c2c3cf144', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:58:11.256040 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-d9029acc-2357-4ac3-9cf8-354f4fad4c67 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c1314c21d8547ff890ede1c2ad281c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c804370880454c7aa02cef2c2c3cf144', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:58:11.270016 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-d9029acc-2357-4ac3-9cf8-354f4fad4c67 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] 10.222.0.13 "GET /compute/v2.1/servers/ea631032-dd04-429b-988e-e6362ea42cf7" status: 200 len: 1553 microversion: 2.91 time: 0.178530 Nov 01 18:58:11.270612 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 553/1121] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 18:58:11 2022] GET /compute/v2.1/servers/ea631032-dd04-429b-988e-e6362ea42cf7 => generated 1553 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 18:58:11.298833 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [req-b198bf35-84c5-4a79-b1f5-c69ca6693250 req-3291f7d0-01b6-4f04-9c7a-6dad105095d4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9249c81d-e57b-4985-a398-8ad97526d5c7", "tag": "b471dd14-4ce9-4781-a7a0-1bd2ae3a7e55"}]} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 18:58:11.334290 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-b198bf35-84c5-4a79-b1f5-c69ca6693250 req-3291f7d0-01b6-4f04-9c7a-6dad105095d4 service nova] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:11.335263 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-b198bf35-84c5-4a79-b1f5-c69ca6693250 req-3291f7d0-01b6-4f04-9c7a-6dad105095d4 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:11.335900 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-b198bf35-84c5-4a79-b1f5-c69ca6693250 req-3291f7d0-01b6-4f04-9c7a-6dad105095d4 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:11.369882 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.compute.server_external_events [req-b198bf35-84c5-4a79-b1f5-c69ca6693250 req-3291f7d0-01b6-4f04-9c7a-6dad105095d4 service nova] Creating event network-changed:b471dd14-4ce9-4781-a7a0-1bd2ae3a7e55 for instance 9249c81d-e57b-4985-a398-8ad97526d5c7 on n-h2-863052-2 Nov 01 18:58:11.376204 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [req-b198bf35-84c5-4a79-b1f5-c69ca6693250 req-3291f7d0-01b6-4f04-9c7a-6dad105095d4 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080872 Nov 01 18:58:11.383621 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 554/1122] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Nov 1 18:58:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 18:58:11.392564 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-7940fb41-8cb5-4313-a9d1-d096cdcf1a01 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:58:11.397170 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-7940fb41-8cb5-4313-a9d1-d096cdcf1a01 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] [instance: 9249c81d-e57b-4985-a398-8ad97526d5c7] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:58:11.409371 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-7940fb41-8cb5-4313-a9d1-d096cdcf1a01 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:11.412155 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-7940fb41-8cb5-4313-a9d1-d096cdcf1a01 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:11.412815 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-7940fb41-8cb5-4313-a9d1-d096cdcf1a01 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:11.416063 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-7940fb41-8cb5-4313-a9d1-d096cdcf1a01 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:11.416745 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-7940fb41-8cb5-4313-a9d1-d096cdcf1a01 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:11.417331 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-7940fb41-8cb5-4313-a9d1-d096cdcf1a01 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:11.550114 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-b5525c65-b3f5-40ae-8ef7-0b1c83125d4b tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b52b7dcbb044f9bfc424e4417c77fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '708bc0ea4b5a4baf81933725792bedd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:58:11.559473 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-b5525c65-b3f5-40ae-8ef7-0b1c83125d4b tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] 10.222.0.13 "GET /compute/v2.1/servers/eebaed86-332c-47dc-af0f-f37e9b69d52f" status: 200 len: 1325 microversion: 2.1 time: 0.685706 Nov 01 18:58:11.565899 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 569/1123] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:58:10 2022] GET /compute/v2.1/servers/eebaed86-332c-47dc-af0f-f37e9b69d52f => generated 1325 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:58:11.680250 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-7940fb41-8cb5-4313-a9d1-d096cdcf1a01 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72117f17294649d6b8bc16c66c7efab2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45d4c047d3c44324a27a27831236ab0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:58:11.691568 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-7940fb41-8cb5-4313-a9d1-d096cdcf1a01 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] 10.222.0.13 "GET /compute/v2.1/servers/9249c81d-e57b-4985-a398-8ad97526d5c7" status: 200 len: 1379 microversion: 2.1 time: 0.305808 Nov 01 18:58:11.708115 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 555/1124] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:58:11 2022] GET /compute/v2.1/servers/9249c81d-e57b-4985-a398-8ad97526d5c7 => generated 1379 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:58:11.746731 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-b8560f55-b371-4a7f-a032-c2296253070d tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:58:11.747339 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-b8560f55-b371-4a7f-a032-c2296253070d tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] [instance: 7186700c-1951-4ab3-a872-865dc1a45fa1] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:58:11.760106 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b8560f55-b371-4a7f-a032-c2296253070d tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:11.760624 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b8560f55-b371-4a7f-a032-c2296253070d tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:11.761059 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b8560f55-b371-4a7f-a032-c2296253070d tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:11.761885 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b8560f55-b371-4a7f-a032-c2296253070d tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:11.762336 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b8560f55-b371-4a7f-a032-c2296253070d tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:11.762754 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b8560f55-b371-4a7f-a032-c2296253070d tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:11.899894 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-14e2617b-5847-4d1a-b78f-af88d73d9c28 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:58:11.900569 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-14e2617b-5847-4d1a-b78f-af88d73d9c28 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] [instance: 869ca597-f199-474f-a680-59b0a75512c7] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:58:11.919732 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-14e2617b-5847-4d1a-b78f-af88d73d9c28 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:11.920619 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-14e2617b-5847-4d1a-b78f-af88d73d9c28 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:11.925315 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-14e2617b-5847-4d1a-b78f-af88d73d9c28 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:11.926498 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-14e2617b-5847-4d1a-b78f-af88d73d9c28 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:11.927138 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-14e2617b-5847-4d1a-b78f-af88d73d9c28 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:11.927760 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-14e2617b-5847-4d1a-b78f-af88d73d9c28 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:12.014095 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-b8560f55-b371-4a7f-a032-c2296253070d tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0290a6bb8bc24b8988a925327ac0381c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86941784237549838bba63ce88053b88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:58:12.023893 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-b8560f55-b371-4a7f-a032-c2296253070d tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] 10.222.0.13 "GET /compute/v2.1/servers/7186700c-1951-4ab3-a872-865dc1a45fa1" status: 200 len: 1317 microversion: 2.1 time: 0.280928 Nov 01 18:58:12.038505 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 570/1125] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:58:11 2022] GET /compute/v2.1/servers/7186700c-1951-4ab3-a872-865dc1a45fa1 => generated 1317 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:58:12.121562 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-856d10fc-c696-4e8f-a5e1-31c90b04477d tempest-FloatingIPsAssociationNegativeTestJSON-296725392 tempest-FloatingIPsAssociationNegativeTestJSON-296725392-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:58:12.122477 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-856d10fc-c696-4e8f-a5e1-31c90b04477d tempest-FloatingIPsAssociationNegativeTestJSON-296725392 tempest-FloatingIPsAssociationNegativeTestJSON-296725392-project] [instance: 8e62f12b-8b96-414a-8099-0f9acb7fabf5] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:58:12.129543 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-856d10fc-c696-4e8f-a5e1-31c90b04477d tempest-FloatingIPsAssociationNegativeTestJSON-296725392 tempest-FloatingIPsAssociationNegativeTestJSON-296725392-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:12.130600 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-856d10fc-c696-4e8f-a5e1-31c90b04477d tempest-FloatingIPsAssociationNegativeTestJSON-296725392 tempest-FloatingIPsAssociationNegativeTestJSON-296725392-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:12.131362 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-856d10fc-c696-4e8f-a5e1-31c90b04477d tempest-FloatingIPsAssociationNegativeTestJSON-296725392 tempest-FloatingIPsAssociationNegativeTestJSON-296725392-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:12.132388 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-856d10fc-c696-4e8f-a5e1-31c90b04477d tempest-FloatingIPsAssociationNegativeTestJSON-296725392 tempest-FloatingIPsAssociationNegativeTestJSON-296725392-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:12.133018 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-856d10fc-c696-4e8f-a5e1-31c90b04477d tempest-FloatingIPsAssociationNegativeTestJSON-296725392 tempest-FloatingIPsAssociationNegativeTestJSON-296725392-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:12.133615 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-856d10fc-c696-4e8f-a5e1-31c90b04477d tempest-FloatingIPsAssociationNegativeTestJSON-296725392 tempest-FloatingIPsAssociationNegativeTestJSON-296725392-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:12.159387 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-14e2617b-5847-4d1a-b78f-af88d73d9c28 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a63d69c99a546f0af16329cff3ca717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a1bb191cff948e99c008b5e861ce4a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:58:12.170821 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-14e2617b-5847-4d1a-b78f-af88d73d9c28 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] 10.222.0.13 "GET /compute/v2.1/servers/869ca597-f199-474f-a680-59b0a75512c7" status: 200 len: 1520 microversion: 2.1 time: 0.276445 Nov 01 18:58:12.190046 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 556/1126] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:58:11 2022] GET /compute/v2.1/servers/869ca597-f199-474f-a680-59b0a75512c7 => generated 1520 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:58:12.302634 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [req-2a7479d3-4724-42f1-814f-c3c85888720f req-0b83ab45-5b91-4dea-b609-25aad4177038 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e62f12b-8b96-414a-8099-0f9acb7fabf5", "name": "network-vif-plugged", "status": "completed", "tag": "8b2113da-4763-4f79-99c9-989625f65d00"}]} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 18:58:12.326141 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-856d10fc-c696-4e8f-a5e1-31c90b04477d tempest-FloatingIPsAssociationNegativeTestJSON-296725392 tempest-FloatingIPsAssociationNegativeTestJSON-296725392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd40b11c70b8e40d0b7e7f5f7d2967184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bd3f356d364e11b14d90d71cb5d598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:58:12.334861 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-856d10fc-c696-4e8f-a5e1-31c90b04477d tempest-FloatingIPsAssociationNegativeTestJSON-296725392 tempest-FloatingIPsAssociationNegativeTestJSON-296725392-project] 10.222.0.13 "GET /compute/v2.1/servers/8e62f12b-8b96-414a-8099-0f9acb7fabf5" status: 200 len: 1331 microversion: 2.1 time: 0.218270 Nov 01 18:58:12.354336 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 571/1127] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:58:12 2022] GET /compute/v2.1/servers/8e62f12b-8b96-414a-8099-0f9acb7fabf5 => generated 1331 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:58:12.356063 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-2a7479d3-4724-42f1-814f-c3c85888720f req-0b83ab45-5b91-4dea-b609-25aad4177038 service nova] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:12.361391 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-2a7479d3-4724-42f1-814f-c3c85888720f req-0b83ab45-5b91-4dea-b609-25aad4177038 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:12.363852 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-2a7479d3-4724-42f1-814f-c3c85888720f req-0b83ab45-5b91-4dea-b609-25aad4177038 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:12.370111 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-c89f7d5a-63b4-4b8a-9edf-a1fa0b557f51 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:58:12.372329 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-c89f7d5a-63b4-4b8a-9edf-a1fa0b557f51 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] [instance: ea631032-dd04-429b-988e-e6362ea42cf7] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:58:12.390127 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-c89f7d5a-63b4-4b8a-9edf-a1fa0b557f51 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:12.391454 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-c89f7d5a-63b4-4b8a-9edf-a1fa0b557f51 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:12.393967 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-c89f7d5a-63b4-4b8a-9edf-a1fa0b557f51 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:12.395038 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-c89f7d5a-63b4-4b8a-9edf-a1fa0b557f51 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:12.396992 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-c89f7d5a-63b4-4b8a-9edf-a1fa0b557f51 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:12.398051 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.compute.server_external_events [req-2a7479d3-4724-42f1-814f-c3c85888720f req-0b83ab45-5b91-4dea-b609-25aad4177038 service nova] Creating event network-vif-plugged:8b2113da-4763-4f79-99c9-989625f65d00 for instance 8e62f12b-8b96-414a-8099-0f9acb7fabf5 on n-h2-863052-2 Nov 01 18:58:12.398288 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-c89f7d5a-63b4-4b8a-9edf-a1fa0b557f51 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:12.403959 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [req-2a7479d3-4724-42f1-814f-c3c85888720f req-0b83ab45-5b91-4dea-b609-25aad4177038 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108328 Nov 01 18:58:12.405228 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 557/1128] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Nov 1 18:58:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 18:58:12.493451 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-c89f7d5a-63b4-4b8a-9edf-a1fa0b557f51 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c1314c21d8547ff890ede1c2ad281c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c804370880454c7aa02cef2c2c3cf144', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:58:12.507035 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-c89f7d5a-63b4-4b8a-9edf-a1fa0b557f51 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c1314c21d8547ff890ede1c2ad281c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c804370880454c7aa02cef2c2c3cf144', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:58:12.508727 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-c89f7d5a-63b4-4b8a-9edf-a1fa0b557f51 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c1314c21d8547ff890ede1c2ad281c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c804370880454c7aa02cef2c2c3cf144', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:58:12.514358 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-c89f7d5a-63b4-4b8a-9edf-a1fa0b557f51 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] 10.222.0.13 "GET /compute/v2.1/servers/ea631032-dd04-429b-988e-e6362ea42cf7" status: 200 len: 1553 microversion: 2.91 time: 0.157408 Nov 01 18:58:12.520654 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 572/1129] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 18:58:12 2022] GET /compute/v2.1/servers/ea631032-dd04-429b-988e-e6362ea42cf7 => generated 1553 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 18:58:12.553492 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [req-43083a4e-dc08-4db1-86de-02a07437c74d req-a5b47a23-4d43-4177-8b9d-0e47358cb3bd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eebaed86-332c-47dc-af0f-f37e9b69d52f", "tag": "0e64752c-4421-48b4-a71d-203804b58462"}]} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 18:58:12.571987 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-43083a4e-dc08-4db1-86de-02a07437c74d req-a5b47a23-4d43-4177-8b9d-0e47358cb3bd service nova] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:12.572516 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-43083a4e-dc08-4db1-86de-02a07437c74d req-a5b47a23-4d43-4177-8b9d-0e47358cb3bd service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:12.573383 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-43083a4e-dc08-4db1-86de-02a07437c74d req-a5b47a23-4d43-4177-8b9d-0e47358cb3bd service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:12.586498 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.compute.server_external_events [req-43083a4e-dc08-4db1-86de-02a07437c74d req-a5b47a23-4d43-4177-8b9d-0e47358cb3bd service nova] Creating event network-changed:0e64752c-4421-48b4-a71d-203804b58462 for instance eebaed86-332c-47dc-af0f-f37e9b69d52f on n-h1-863052-2 Nov 01 18:58:12.602017 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-20b9a5d0-ef27-476b-a283-9fd2ed5d9019 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:58:12.602633 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-20b9a5d0-ef27-476b-a283-9fd2ed5d9019 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] [instance: eebaed86-332c-47dc-af0f-f37e9b69d52f] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:58:12.605891 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [req-43083a4e-dc08-4db1-86de-02a07437c74d req-a5b47a23-4d43-4177-8b9d-0e47358cb3bd service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042038 Nov 01 18:58:12.609820 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 558/1130] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Nov 1 18:58:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 01 18:58:12.610958 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-20b9a5d0-ef27-476b-a283-9fd2ed5d9019 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:12.612068 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-20b9a5d0-ef27-476b-a283-9fd2ed5d9019 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:12.612068 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-20b9a5d0-ef27-476b-a283-9fd2ed5d9019 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:12.612752 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-20b9a5d0-ef27-476b-a283-9fd2ed5d9019 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:12.613217 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-20b9a5d0-ef27-476b-a283-9fd2ed5d9019 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:12.613632 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-20b9a5d0-ef27-476b-a283-9fd2ed5d9019 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:12.715176 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-53587dd2-c70e-42a5-82e8-b91367b85b79 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:58:12.716519 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-53587dd2-c70e-42a5-82e8-b91367b85b79 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] [instance: 9249c81d-e57b-4985-a398-8ad97526d5c7] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:58:12.745791 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-53587dd2-c70e-42a5-82e8-b91367b85b79 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:12.748862 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-53587dd2-c70e-42a5-82e8-b91367b85b79 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:12.749350 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-53587dd2-c70e-42a5-82e8-b91367b85b79 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:12.753349 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-53587dd2-c70e-42a5-82e8-b91367b85b79 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:12.753850 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-53587dd2-c70e-42a5-82e8-b91367b85b79 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:12.754294 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-53587dd2-c70e-42a5-82e8-b91367b85b79 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:13.160848 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-20b9a5d0-ef27-476b-a283-9fd2ed5d9019 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b52b7dcbb044f9bfc424e4417c77fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '708bc0ea4b5a4baf81933725792bedd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:58:13.173737 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-20b9a5d0-ef27-476b-a283-9fd2ed5d9019 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] 10.222.0.13 "GET /compute/v2.1/servers/eebaed86-332c-47dc-af0f-f37e9b69d52f" status: 200 len: 1325 microversion: 2.1 time: 0.579439 Nov 01 18:58:13.209132 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 573/1131] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:58:12 2022] GET /compute/v2.1/servers/eebaed86-332c-47dc-af0f-f37e9b69d52f => generated 1325 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 18:58:13.228129 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-086e0ba8-5ddb-4544-b7f5-63d9864d2410 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:58:13.228940 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-086e0ba8-5ddb-4544-b7f5-63d9864d2410 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] [instance: 7186700c-1951-4ab3-a872-865dc1a45fa1] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:58:13.235585 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-086e0ba8-5ddb-4544-b7f5-63d9864d2410 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:13.236344 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-086e0ba8-5ddb-4544-b7f5-63d9864d2410 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:13.236959 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-086e0ba8-5ddb-4544-b7f5-63d9864d2410 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:13.237802 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-086e0ba8-5ddb-4544-b7f5-63d9864d2410 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:13.238392 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-086e0ba8-5ddb-4544-b7f5-63d9864d2410 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:13.238923 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-086e0ba8-5ddb-4544-b7f5-63d9864d2410 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:13.325230 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-53587dd2-c70e-42a5-82e8-b91367b85b79 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72117f17294649d6b8bc16c66c7efab2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45d4c047d3c44324a27a27831236ab0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:58:13.333480 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-53587dd2-c70e-42a5-82e8-b91367b85b79 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] 10.222.0.13 "GET /compute/v2.1/servers/9249c81d-e57b-4985-a398-8ad97526d5c7" status: 200 len: 1379 microversion: 2.1 time: 0.622591 Nov 01 18:58:13.352937 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 559/1132] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:58:12 2022] GET /compute/v2.1/servers/9249c81d-e57b-4985-a398-8ad97526d5c7 => generated 1379 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:58:13.370553 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-fee4df7e-0535-487b-b2d6-9cf0716a874e tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:58:13.371409 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-fee4df7e-0535-487b-b2d6-9cf0716a874e tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] [instance: 869ca597-f199-474f-a680-59b0a75512c7] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:58:13.386140 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-fee4df7e-0535-487b-b2d6-9cf0716a874e tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:13.386901 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-fee4df7e-0535-487b-b2d6-9cf0716a874e tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:13.387504 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-fee4df7e-0535-487b-b2d6-9cf0716a874e tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:13.388399 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-fee4df7e-0535-487b-b2d6-9cf0716a874e tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:13.389025 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-fee4df7e-0535-487b-b2d6-9cf0716a874e tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:13.389775 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-fee4df7e-0535-487b-b2d6-9cf0716a874e tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:13.582460 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-fee4df7e-0535-487b-b2d6-9cf0716a874e tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a63d69c99a546f0af16329cff3ca717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a1bb191cff948e99c008b5e861ce4a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:58:13.596267 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-fee4df7e-0535-487b-b2d6-9cf0716a874e tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] 10.222.0.13 "GET /compute/v2.1/servers/869ca597-f199-474f-a680-59b0a75512c7" status: 200 len: 1520 microversion: 2.1 time: 0.242147 Nov 01 18:58:13.597266 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 560/1133] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:58:13 2022] GET /compute/v2.1/servers/869ca597-f199-474f-a680-59b0a75512c7 => generated 1520 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:58:13.604612 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-02ffff91-462c-4fc9-9194-210ca209829e tempest-FloatingIPsAssociationNegativeTestJSON-296725392 tempest-FloatingIPsAssociationNegativeTestJSON-296725392-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:58:13.609318 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-02ffff91-462c-4fc9-9194-210ca209829e tempest-FloatingIPsAssociationNegativeTestJSON-296725392 tempest-FloatingIPsAssociationNegativeTestJSON-296725392-project] [instance: 8e62f12b-8b96-414a-8099-0f9acb7fabf5] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:58:13.627087 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-02ffff91-462c-4fc9-9194-210ca209829e tempest-FloatingIPsAssociationNegativeTestJSON-296725392 tempest-FloatingIPsAssociationNegativeTestJSON-296725392-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:13.627944 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-02ffff91-462c-4fc9-9194-210ca209829e tempest-FloatingIPsAssociationNegativeTestJSON-296725392 tempest-FloatingIPsAssociationNegativeTestJSON-296725392-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:13.628568 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-02ffff91-462c-4fc9-9194-210ca209829e tempest-FloatingIPsAssociationNegativeTestJSON-296725392 tempest-FloatingIPsAssociationNegativeTestJSON-296725392-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:13.629243 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-086e0ba8-5ddb-4544-b7f5-63d9864d2410 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0290a6bb8bc24b8988a925327ac0381c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86941784237549838bba63ce88053b88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:58:13.629647 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-02ffff91-462c-4fc9-9194-210ca209829e tempest-FloatingIPsAssociationNegativeTestJSON-296725392 tempest-FloatingIPsAssociationNegativeTestJSON-296725392-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:13.630247 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-02ffff91-462c-4fc9-9194-210ca209829e tempest-FloatingIPsAssociationNegativeTestJSON-296725392 tempest-FloatingIPsAssociationNegativeTestJSON-296725392-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:13.630826 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-02ffff91-462c-4fc9-9194-210ca209829e tempest-FloatingIPsAssociationNegativeTestJSON-296725392 tempest-FloatingIPsAssociationNegativeTestJSON-296725392-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:13.643462 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-086e0ba8-5ddb-4544-b7f5-63d9864d2410 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] 10.222.0.13 "GET /compute/v2.1/servers/7186700c-1951-4ab3-a872-865dc1a45fa1" status: 200 len: 1317 microversion: 2.1 time: 0.433062 Nov 01 18:58:13.658058 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 574/1134] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:58:13 2022] GET /compute/v2.1/servers/7186700c-1951-4ab3-a872-865dc1a45fa1 => generated 1317 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:58:13.666906 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-cbe3af4f-be90-4453-8a86-ccaf8db549ba tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:58:13.671951 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-cbe3af4f-be90-4453-8a86-ccaf8db549ba tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] [instance: ea631032-dd04-429b-988e-e6362ea42cf7] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:58:13.681708 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-cbe3af4f-be90-4453-8a86-ccaf8db549ba tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:13.682500 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-cbe3af4f-be90-4453-8a86-ccaf8db549ba tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:13.683113 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-cbe3af4f-be90-4453-8a86-ccaf8db549ba tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:13.683998 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-cbe3af4f-be90-4453-8a86-ccaf8db549ba tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:13.684640 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-cbe3af4f-be90-4453-8a86-ccaf8db549ba tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:13.685234 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-cbe3af4f-be90-4453-8a86-ccaf8db549ba tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:13.885225 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-cbe3af4f-be90-4453-8a86-ccaf8db549ba tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c1314c21d8547ff890ede1c2ad281c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c804370880454c7aa02cef2c2c3cf144', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:58:13.897011 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-cbe3af4f-be90-4453-8a86-ccaf8db549ba tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c1314c21d8547ff890ede1c2ad281c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c804370880454c7aa02cef2c2c3cf144', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:58:13.898626 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-cbe3af4f-be90-4453-8a86-ccaf8db549ba tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c1314c21d8547ff890ede1c2ad281c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c804370880454c7aa02cef2c2c3cf144', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:58:13.915379 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-cbe3af4f-be90-4453-8a86-ccaf8db549ba tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] 10.222.0.13 "GET /compute/v2.1/servers/ea631032-dd04-429b-988e-e6362ea42cf7" status: 200 len: 1553 microversion: 2.91 time: 0.252534 Nov 01 18:58:13.916019 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 575/1135] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 18:58:13 2022] GET /compute/v2.1/servers/ea631032-dd04-429b-988e-e6362ea42cf7 => generated 1553 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 18:58:13.991250 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-02ffff91-462c-4fc9-9194-210ca209829e tempest-FloatingIPsAssociationNegativeTestJSON-296725392 tempest-FloatingIPsAssociationNegativeTestJSON-296725392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd40b11c70b8e40d0b7e7f5f7d2967184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bd3f356d364e11b14d90d71cb5d598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:58:14.016071 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-02ffff91-462c-4fc9-9194-210ca209829e tempest-FloatingIPsAssociationNegativeTestJSON-296725392 tempest-FloatingIPsAssociationNegativeTestJSON-296725392-project] 10.222.0.13 "GET /compute/v2.1/servers/8e62f12b-8b96-414a-8099-0f9acb7fabf5" status: 200 len: 1331 microversion: 2.1 time: 0.417511 Nov 01 18:58:14.016679 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 561/1136] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:58:13 2022] GET /compute/v2.1/servers/8e62f12b-8b96-414a-8099-0f9acb7fabf5 => generated 1331 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:58:14.200298 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-76509838-e726-428a-96d6-e80844e733ed tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:58:14.201622 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-76509838-e726-428a-96d6-e80844e733ed tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] [instance: eebaed86-332c-47dc-af0f-f37e9b69d52f] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:58:14.208731 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-76509838-e726-428a-96d6-e80844e733ed tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:14.209962 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-76509838-e726-428a-96d6-e80844e733ed tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:14.215918 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-76509838-e726-428a-96d6-e80844e733ed tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:14.216934 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-76509838-e726-428a-96d6-e80844e733ed tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:14.217583 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-76509838-e726-428a-96d6-e80844e733ed tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:14.218369 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-76509838-e726-428a-96d6-e80844e733ed tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:14.357221 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-82dc08dd-1133-4f35-a2ab-efb96623eb8c tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:58:14.360969 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-82dc08dd-1133-4f35-a2ab-efb96623eb8c tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] [instance: 9249c81d-e57b-4985-a398-8ad97526d5c7] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:58:14.369041 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-82dc08dd-1133-4f35-a2ab-efb96623eb8c tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:14.369928 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-82dc08dd-1133-4f35-a2ab-efb96623eb8c tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:14.371220 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-82dc08dd-1133-4f35-a2ab-efb96623eb8c tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:14.372392 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-82dc08dd-1133-4f35-a2ab-efb96623eb8c tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:14.373098 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-82dc08dd-1133-4f35-a2ab-efb96623eb8c tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:14.373746 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-82dc08dd-1133-4f35-a2ab-efb96623eb8c tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:14.604700 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-76509838-e726-428a-96d6-e80844e733ed tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b52b7dcbb044f9bfc424e4417c77fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '708bc0ea4b5a4baf81933725792bedd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:58:14.618604 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-76509838-e726-428a-96d6-e80844e733ed tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] 10.222.0.13 "GET /compute/v2.1/servers/eebaed86-332c-47dc-af0f-f37e9b69d52f" status: 200 len: 1325 microversion: 2.1 time: 0.422407 Nov 01 18:58:14.619483 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 576/1137] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:58:14 2022] GET /compute/v2.1/servers/eebaed86-332c-47dc-af0f-f37e9b69d52f => generated 1325 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:58:14.624004 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-a12204d3-95bb-47dc-93bc-35b9e20162f3 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:58:14.639410 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-a12204d3-95bb-47dc-93bc-35b9e20162f3 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] [instance: 869ca597-f199-474f-a680-59b0a75512c7] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:58:14.658734 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-a12204d3-95bb-47dc-93bc-35b9e20162f3 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:14.659806 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-a12204d3-95bb-47dc-93bc-35b9e20162f3 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:14.660606 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-a12204d3-95bb-47dc-93bc-35b9e20162f3 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:14.661626 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-a12204d3-95bb-47dc-93bc-35b9e20162f3 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:14.662371 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-a12204d3-95bb-47dc-93bc-35b9e20162f3 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:14.663071 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-a12204d3-95bb-47dc-93bc-35b9e20162f3 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:14.876036 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-a12204d3-95bb-47dc-93bc-35b9e20162f3 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a63d69c99a546f0af16329cff3ca717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a1bb191cff948e99c008b5e861ce4a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:58:14.887224 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-a12204d3-95bb-47dc-93bc-35b9e20162f3 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] 10.222.0.13 "GET /compute/v2.1/servers/869ca597-f199-474f-a680-59b0a75512c7" status: 200 len: 1520 microversion: 2.1 time: 0.264341 Nov 01 18:58:14.891206 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 577/1138] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:58:14 2022] GET /compute/v2.1/servers/869ca597-f199-474f-a680-59b0a75512c7 => generated 1520 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:58:14.904121 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-be567e82-a927-4acc-b90f-19f17f23b816 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:58:14.905196 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-be567e82-a927-4acc-b90f-19f17f23b816 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] [instance: 7186700c-1951-4ab3-a872-865dc1a45fa1] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:58:14.919527 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-be567e82-a927-4acc-b90f-19f17f23b816 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:14.920284 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-be567e82-a927-4acc-b90f-19f17f23b816 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:14.920980 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-be567e82-a927-4acc-b90f-19f17f23b816 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:14.922076 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-be567e82-a927-4acc-b90f-19f17f23b816 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:14.922750 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-be567e82-a927-4acc-b90f-19f17f23b816 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:14.923956 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-be567e82-a927-4acc-b90f-19f17f23b816 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:14.953444 n-d-863052-2 devstack@n-api.service[121402]: DEBUG dbcounter [-] [121402] Writing DB stats nova_cell0:SELECT=10 {{(pid=121402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 18:58:15.009635 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-82dc08dd-1133-4f35-a2ab-efb96623eb8c tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72117f17294649d6b8bc16c66c7efab2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45d4c047d3c44324a27a27831236ab0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:58:15.018763 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-82dc08dd-1133-4f35-a2ab-efb96623eb8c tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] 10.222.0.13 "GET /compute/v2.1/servers/9249c81d-e57b-4985-a398-8ad97526d5c7" status: 200 len: 1379 microversion: 2.1 time: 0.666806 Nov 01 18:58:15.021832 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 562/1139] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:58:14 2022] GET /compute/v2.1/servers/9249c81d-e57b-4985-a398-8ad97526d5c7 => generated 1379 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 18:58:15.036801 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-6cabf012-1b47-4b56-8f6b-a38aff0e2e1a tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:58:15.037694 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-6cabf012-1b47-4b56-8f6b-a38aff0e2e1a tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] [instance: ea631032-dd04-429b-988e-e6362ea42cf7] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:58:15.045889 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-6cabf012-1b47-4b56-8f6b-a38aff0e2e1a tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:15.046819 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-6cabf012-1b47-4b56-8f6b-a38aff0e2e1a tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:15.047924 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-6cabf012-1b47-4b56-8f6b-a38aff0e2e1a tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:15.049972 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-6cabf012-1b47-4b56-8f6b-a38aff0e2e1a tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:15.050712 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-6cabf012-1b47-4b56-8f6b-a38aff0e2e1a tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:15.051504 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-6cabf012-1b47-4b56-8f6b-a38aff0e2e1a tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:15.182375 n-d-863052-2 devstack@n-api.service[121402]: DEBUG dbcounter [-] [121402] Writing DB stats nova_cell0:SELECT=30 {{(pid=121402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 18:58:15.197437 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-be567e82-a927-4acc-b90f-19f17f23b816 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0290a6bb8bc24b8988a925327ac0381c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86941784237549838bba63ce88053b88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:58:15.206731 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-be567e82-a927-4acc-b90f-19f17f23b816 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] 10.222.0.13 "GET /compute/v2.1/servers/7186700c-1951-4ab3-a872-865dc1a45fa1" status: 200 len: 1317 microversion: 2.1 time: 0.314043 Nov 01 18:58:15.207451 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 578/1140] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:58:14 2022] GET /compute/v2.1/servers/7186700c-1951-4ab3-a872-865dc1a45fa1 => generated 1317 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:58:15.212306 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-199c01a3-a1f5-4885-8458-26a08e0e7582 tempest-FloatingIPsAssociationNegativeTestJSON-296725392 tempest-FloatingIPsAssociationNegativeTestJSON-296725392-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:58:15.212928 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-199c01a3-a1f5-4885-8458-26a08e0e7582 tempest-FloatingIPsAssociationNegativeTestJSON-296725392 tempest-FloatingIPsAssociationNegativeTestJSON-296725392-project] [instance: 8e62f12b-8b96-414a-8099-0f9acb7fabf5] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:58:15.219656 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-199c01a3-a1f5-4885-8458-26a08e0e7582 tempest-FloatingIPsAssociationNegativeTestJSON-296725392 tempest-FloatingIPsAssociationNegativeTestJSON-296725392-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:15.220834 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-199c01a3-a1f5-4885-8458-26a08e0e7582 tempest-FloatingIPsAssociationNegativeTestJSON-296725392 tempest-FloatingIPsAssociationNegativeTestJSON-296725392-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:15.221277 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-199c01a3-a1f5-4885-8458-26a08e0e7582 tempest-FloatingIPsAssociationNegativeTestJSON-296725392 tempest-FloatingIPsAssociationNegativeTestJSON-296725392-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:15.221977 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-199c01a3-a1f5-4885-8458-26a08e0e7582 tempest-FloatingIPsAssociationNegativeTestJSON-296725392 tempest-FloatingIPsAssociationNegativeTestJSON-296725392-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:15.222428 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-199c01a3-a1f5-4885-8458-26a08e0e7582 tempest-FloatingIPsAssociationNegativeTestJSON-296725392 tempest-FloatingIPsAssociationNegativeTestJSON-296725392-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:15.222858 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-199c01a3-a1f5-4885-8458-26a08e0e7582 tempest-FloatingIPsAssociationNegativeTestJSON-296725392 tempest-FloatingIPsAssociationNegativeTestJSON-296725392-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:15.262740 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-6cabf012-1b47-4b56-8f6b-a38aff0e2e1a tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c1314c21d8547ff890ede1c2ad281c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c804370880454c7aa02cef2c2c3cf144', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:58:15.275500 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-6cabf012-1b47-4b56-8f6b-a38aff0e2e1a tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c1314c21d8547ff890ede1c2ad281c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c804370880454c7aa02cef2c2c3cf144', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:58:15.280976 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-6cabf012-1b47-4b56-8f6b-a38aff0e2e1a tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c1314c21d8547ff890ede1c2ad281c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c804370880454c7aa02cef2c2c3cf144', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:58:15.292945 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-6cabf012-1b47-4b56-8f6b-a38aff0e2e1a tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] 10.222.0.13 "GET /compute/v2.1/servers/ea631032-dd04-429b-988e-e6362ea42cf7" status: 200 len: 1553 microversion: 2.91 time: 0.266981 Nov 01 18:58:15.309380 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 563/1141] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 18:58:15 2022] GET /compute/v2.1/servers/ea631032-dd04-429b-988e-e6362ea42cf7 => generated 1553 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 18:58:15.395138 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-199c01a3-a1f5-4885-8458-26a08e0e7582 tempest-FloatingIPsAssociationNegativeTestJSON-296725392 tempest-FloatingIPsAssociationNegativeTestJSON-296725392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd40b11c70b8e40d0b7e7f5f7d2967184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bd3f356d364e11b14d90d71cb5d598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:58:15.406046 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-199c01a3-a1f5-4885-8458-26a08e0e7582 tempest-FloatingIPsAssociationNegativeTestJSON-296725392 tempest-FloatingIPsAssociationNegativeTestJSON-296725392-project] 10.222.0.13 "GET /compute/v2.1/servers/8e62f12b-8b96-414a-8099-0f9acb7fabf5" status: 200 len: 1536 microversion: 2.1 time: 0.197227 Nov 01 18:58:15.406916 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 579/1142] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:58:15 2022] GET /compute/v2.1/servers/8e62f12b-8b96-414a-8099-0f9acb7fabf5 => generated 1536 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:58:15.433608 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-160f8337-0174-402b-9d9f-65c3fd023c45 tempest-FloatingIPsAssociationNegativeTestJSON-296725392 tempest-FloatingIPsAssociationNegativeTestJSON-296725392-project] Action: 'create', calling method: .version_select at 0x7f0ae67f19d0>, body: {"pool": "3c6bfafa-c688-4384-8c54-de7825ea90b1"} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 18:58:15.648834 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-cbbf36b6-4019-47b1-93b9-0abf576efe00 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:58:15.649448 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-cbbf36b6-4019-47b1-93b9-0abf576efe00 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] [instance: eebaed86-332c-47dc-af0f-f37e9b69d52f] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:58:15.661000 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-cbbf36b6-4019-47b1-93b9-0abf576efe00 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:15.665284 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-cbbf36b6-4019-47b1-93b9-0abf576efe00 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:15.666161 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-cbbf36b6-4019-47b1-93b9-0abf576efe00 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:15.670469 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-cbbf36b6-4019-47b1-93b9-0abf576efe00 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:15.673881 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-cbbf36b6-4019-47b1-93b9-0abf576efe00 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:15.674757 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-cbbf36b6-4019-47b1-93b9-0abf576efe00 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:15.956293 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-cbbf36b6-4019-47b1-93b9-0abf576efe00 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b52b7dcbb044f9bfc424e4417c77fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '708bc0ea4b5a4baf81933725792bedd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:58:15.967274 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-cbbf36b6-4019-47b1-93b9-0abf576efe00 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] 10.222.0.13 "GET /compute/v2.1/servers/eebaed86-332c-47dc-af0f-f37e9b69d52f" status: 200 len: 1325 microversion: 2.1 time: 0.322855 Nov 01 18:58:15.981790 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 580/1143] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:58:15 2022] GET /compute/v2.1/servers/eebaed86-332c-47dc-af0f-f37e9b69d52f => generated 1325 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:58:15.990260 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-59db079f-f505-4557-ba17-c2e0047a07ab tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:58:15.991755 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-59db079f-f505-4557-ba17-c2e0047a07ab tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] [instance: 869ca597-f199-474f-a680-59b0a75512c7] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:58:15.998596 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-59db079f-f505-4557-ba17-c2e0047a07ab tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:15.999096 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-59db079f-f505-4557-ba17-c2e0047a07ab tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:15.999535 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-59db079f-f505-4557-ba17-c2e0047a07ab tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:16.000246 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-59db079f-f505-4557-ba17-c2e0047a07ab tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:16.000731 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-59db079f-f505-4557-ba17-c2e0047a07ab tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:16.002595 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-59db079f-f505-4557-ba17-c2e0047a07ab tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:16.291434 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-59db079f-f505-4557-ba17-c2e0047a07ab tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a63d69c99a546f0af16329cff3ca717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a1bb191cff948e99c008b5e861ce4a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:58:16.301777 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-59db079f-f505-4557-ba17-c2e0047a07ab tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] 10.222.0.13 "GET /compute/v2.1/servers/869ca597-f199-474f-a680-59b0a75512c7" status: 200 len: 1520 microversion: 2.1 time: 0.318733 Nov 01 18:58:16.316690 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 581/1144] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:58:15 2022] GET /compute/v2.1/servers/869ca597-f199-474f-a680-59b0a75512c7 => generated 1520 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:58:16.316690 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-ed9fd533-cd2f-4486-8e92-76934f8cbbc8 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:58:16.316690 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-ed9fd533-cd2f-4486-8e92-76934f8cbbc8 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] [instance: 9249c81d-e57b-4985-a398-8ad97526d5c7] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:58:16.319666 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-ed9fd533-cd2f-4486-8e92-76934f8cbbc8 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:16.319666 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-ed9fd533-cd2f-4486-8e92-76934f8cbbc8 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:16.322932 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-ed9fd533-cd2f-4486-8e92-76934f8cbbc8 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:16.322932 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-ed9fd533-cd2f-4486-8e92-76934f8cbbc8 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:16.322932 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-ed9fd533-cd2f-4486-8e92-76934f8cbbc8 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:16.322932 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-ed9fd533-cd2f-4486-8e92-76934f8cbbc8 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:16.667704 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-ed9fd533-cd2f-4486-8e92-76934f8cbbc8 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72117f17294649d6b8bc16c66c7efab2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45d4c047d3c44324a27a27831236ab0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:58:16.685040 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-ed9fd533-cd2f-4486-8e92-76934f8cbbc8 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] 10.222.0.13 "GET /compute/v2.1/servers/9249c81d-e57b-4985-a398-8ad97526d5c7" status: 200 len: 1379 microversion: 2.1 time: 0.380658 Nov 01 18:58:16.685775 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 582/1145] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:58:16 2022] GET /compute/v2.1/servers/9249c81d-e57b-4985-a398-8ad97526d5c7 => generated 1379 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:58:16.715053 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-2aee9997-d4cf-48eb-93f7-4dd665bb4ce3 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:58:16.715685 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-2aee9997-d4cf-48eb-93f7-4dd665bb4ce3 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] [instance: 7186700c-1951-4ab3-a872-865dc1a45fa1] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:58:16.742637 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2aee9997-d4cf-48eb-93f7-4dd665bb4ce3 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:16.743132 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2aee9997-d4cf-48eb-93f7-4dd665bb4ce3 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:16.743564 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2aee9997-d4cf-48eb-93f7-4dd665bb4ce3 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:16.744331 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2aee9997-d4cf-48eb-93f7-4dd665bb4ce3 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:16.744812 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2aee9997-d4cf-48eb-93f7-4dd665bb4ce3 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:16.745230 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2aee9997-d4cf-48eb-93f7-4dd665bb4ce3 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:16.928588 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-2aee9997-d4cf-48eb-93f7-4dd665bb4ce3 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0290a6bb8bc24b8988a925327ac0381c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86941784237549838bba63ce88053b88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:58:16.940421 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-2aee9997-d4cf-48eb-93f7-4dd665bb4ce3 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] 10.222.0.13 "GET /compute/v2.1/servers/7186700c-1951-4ab3-a872-865dc1a45fa1" status: 200 len: 1317 microversion: 2.1 time: 0.252997 Nov 01 18:58:16.941238 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 583/1146] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:58:16 2022] GET /compute/v2.1/servers/7186700c-1951-4ab3-a872-865dc1a45fa1 => generated 1317 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:58:16.946066 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-87709c52-d21c-4611-8f11-3e5357ec1829 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:58:16.946667 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-87709c52-d21c-4611-8f11-3e5357ec1829 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] [instance: ea631032-dd04-429b-988e-e6362ea42cf7] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:58:16.953037 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-87709c52-d21c-4611-8f11-3e5357ec1829 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:16.953521 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-87709c52-d21c-4611-8f11-3e5357ec1829 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:16.954013 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-87709c52-d21c-4611-8f11-3e5357ec1829 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:16.954867 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-87709c52-d21c-4611-8f11-3e5357ec1829 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:16.955373 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-87709c52-d21c-4611-8f11-3e5357ec1829 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:16.955796 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-87709c52-d21c-4611-8f11-3e5357ec1829 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:17.031119 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-87709c52-d21c-4611-8f11-3e5357ec1829 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c1314c21d8547ff890ede1c2ad281c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c804370880454c7aa02cef2c2c3cf144', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:58:17.041325 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-87709c52-d21c-4611-8f11-3e5357ec1829 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c1314c21d8547ff890ede1c2ad281c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c804370880454c7aa02cef2c2c3cf144', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:58:17.043385 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-87709c52-d21c-4611-8f11-3e5357ec1829 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c1314c21d8547ff890ede1c2ad281c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c804370880454c7aa02cef2c2c3cf144', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:58:17.051740 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-87709c52-d21c-4611-8f11-3e5357ec1829 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] 10.222.0.13 "GET /compute/v2.1/servers/ea631032-dd04-429b-988e-e6362ea42cf7" status: 200 len: 1553 microversion: 2.91 time: 0.109561 Nov 01 18:58:17.053125 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 584/1147] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 18:58:16 2022] GET /compute/v2.1/servers/ea631032-dd04-429b-988e-e6362ea42cf7 => generated 1553 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 18:58:17.059127 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [req-fcb7905f-bbd5-48cb-bb00-a268cab9e69e req-fa46e7b9-e828-4fb0-83f6-91a9443b9445 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9249c81d-e57b-4985-a398-8ad97526d5c7", "name": "network-vif-plugged", "status": "completed", "tag": "b471dd14-4ce9-4781-a7a0-1bd2ae3a7e55"}]} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 18:58:17.070827 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-fcb7905f-bbd5-48cb-bb00-a268cab9e69e req-fa46e7b9-e828-4fb0-83f6-91a9443b9445 service nova] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:17.071309 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-fcb7905f-bbd5-48cb-bb00-a268cab9e69e req-fa46e7b9-e828-4fb0-83f6-91a9443b9445 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:17.071734 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-fcb7905f-bbd5-48cb-bb00-a268cab9e69e req-fa46e7b9-e828-4fb0-83f6-91a9443b9445 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:17.074607 n-d-863052-2 devstack@n-api.service[121402]: DEBUG dbcounter [-] [121402] Writing DB stats nova_cell1:SELECT=100 {{(pid=121402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 18:58:17.087631 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.compute.server_external_events [req-fcb7905f-bbd5-48cb-bb00-a268cab9e69e req-fa46e7b9-e828-4fb0-83f6-91a9443b9445 service nova] Creating event network-vif-plugged:b471dd14-4ce9-4781-a7a0-1bd2ae3a7e55 for instance 9249c81d-e57b-4985-a398-8ad97526d5c7 on n-h2-863052-2 Nov 01 18:58:17.093565 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [req-fcb7905f-bbd5-48cb-bb00-a268cab9e69e req-fa46e7b9-e828-4fb0-83f6-91a9443b9445 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038826 Nov 01 18:58:17.094225 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 585/1148] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Nov 1 18:58:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 18:58:17.100767 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-aa16abb3-2138-4d8e-8dce-e0d1646480b3 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:58:17.101467 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-aa16abb3-2138-4d8e-8dce-e0d1646480b3 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] [instance: eebaed86-332c-47dc-af0f-f37e9b69d52f] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:58:17.108748 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-aa16abb3-2138-4d8e-8dce-e0d1646480b3 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:17.109073 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-aa16abb3-2138-4d8e-8dce-e0d1646480b3 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:17.109535 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-aa16abb3-2138-4d8e-8dce-e0d1646480b3 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:17.110242 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-aa16abb3-2138-4d8e-8dce-e0d1646480b3 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:17.111414 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-aa16abb3-2138-4d8e-8dce-e0d1646480b3 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:17.112230 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-aa16abb3-2138-4d8e-8dce-e0d1646480b3 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:17.276710 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-aa16abb3-2138-4d8e-8dce-e0d1646480b3 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b52b7dcbb044f9bfc424e4417c77fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '708bc0ea4b5a4baf81933725792bedd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:58:17.285729 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-aa16abb3-2138-4d8e-8dce-e0d1646480b3 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] 10.222.0.13 "GET /compute/v2.1/servers/eebaed86-332c-47dc-af0f-f37e9b69d52f" status: 200 len: 1325 microversion: 2.1 time: 0.189704 Nov 01 18:58:17.301254 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 586/1149] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:58:17 2022] GET /compute/v2.1/servers/eebaed86-332c-47dc-af0f-f37e9b69d52f => generated 1325 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:58:17.333948 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-2dc518cb-371d-4d37-9527-06cf21b58cc3 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:58:17.334748 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-2dc518cb-371d-4d37-9527-06cf21b58cc3 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] [instance: 869ca597-f199-474f-a680-59b0a75512c7] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:58:17.341006 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2dc518cb-371d-4d37-9527-06cf21b58cc3 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:17.341775 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2dc518cb-371d-4d37-9527-06cf21b58cc3 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:17.342358 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2dc518cb-371d-4d37-9527-06cf21b58cc3 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:17.343182 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2dc518cb-371d-4d37-9527-06cf21b58cc3 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:17.343645 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2dc518cb-371d-4d37-9527-06cf21b58cc3 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:17.344072 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2dc518cb-371d-4d37-9527-06cf21b58cc3 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:17.521974 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-2dc518cb-371d-4d37-9527-06cf21b58cc3 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a63d69c99a546f0af16329cff3ca717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a1bb191cff948e99c008b5e861ce4a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:58:17.532624 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-2dc518cb-371d-4d37-9527-06cf21b58cc3 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] 10.222.0.13 "GET /compute/v2.1/servers/869ca597-f199-474f-a680-59b0a75512c7" status: 200 len: 1520 microversion: 2.1 time: 0.203642 Nov 01 18:58:17.544220 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 587/1150] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:58:17 2022] GET /compute/v2.1/servers/869ca597-f199-474f-a680-59b0a75512c7 => generated 1520 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:58:17.709029 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-72b1521c-3256-4739-92e7-fc0417dc1f79 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:58:17.709671 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-72b1521c-3256-4739-92e7-fc0417dc1f79 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] [instance: 9249c81d-e57b-4985-a398-8ad97526d5c7] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:58:17.771271 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-72b1521c-3256-4739-92e7-fc0417dc1f79 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:17.772293 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-72b1521c-3256-4739-92e7-fc0417dc1f79 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:17.773722 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-72b1521c-3256-4739-92e7-fc0417dc1f79 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:17.778266 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-72b1521c-3256-4739-92e7-fc0417dc1f79 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:17.778956 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-72b1521c-3256-4739-92e7-fc0417dc1f79 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:17.780708 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-72b1521c-3256-4739-92e7-fc0417dc1f79 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:18.011464 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-72b1521c-3256-4739-92e7-fc0417dc1f79 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72117f17294649d6b8bc16c66c7efab2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45d4c047d3c44324a27a27831236ab0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:58:18.024719 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-72b1521c-3256-4739-92e7-fc0417dc1f79 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] 10.222.0.13 "GET /compute/v2.1/servers/9249c81d-e57b-4985-a398-8ad97526d5c7" status: 200 len: 1379 microversion: 2.1 time: 0.319960 Nov 01 18:58:18.025433 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 588/1151] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:58:17 2022] GET /compute/v2.1/servers/9249c81d-e57b-4985-a398-8ad97526d5c7 => generated 1379 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 18:58:18.031080 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-ace27d8f-114c-4ba5-ad58-a36e8b0b22b4 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:58:18.036387 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-ace27d8f-114c-4ba5-ad58-a36e8b0b22b4 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] [instance: 7186700c-1951-4ab3-a872-865dc1a45fa1] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:58:18.046404 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-ace27d8f-114c-4ba5-ad58-a36e8b0b22b4 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:18.046908 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-ace27d8f-114c-4ba5-ad58-a36e8b0b22b4 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:18.047491 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-ace27d8f-114c-4ba5-ad58-a36e8b0b22b4 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:18.048247 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-ace27d8f-114c-4ba5-ad58-a36e8b0b22b4 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:18.048731 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-ace27d8f-114c-4ba5-ad58-a36e8b0b22b4 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:18.049318 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-ace27d8f-114c-4ba5-ad58-a36e8b0b22b4 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:18.215804 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-ace27d8f-114c-4ba5-ad58-a36e8b0b22b4 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0290a6bb8bc24b8988a925327ac0381c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86941784237549838bba63ce88053b88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:58:18.227092 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-ace27d8f-114c-4ba5-ad58-a36e8b0b22b4 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] 10.222.0.13 "GET /compute/v2.1/servers/7186700c-1951-4ab3-a872-865dc1a45fa1" status: 200 len: 1317 microversion: 2.1 time: 0.200324 Nov 01 18:58:18.228035 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 589/1152] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:58:18 2022] GET /compute/v2.1/servers/7186700c-1951-4ab3-a872-865dc1a45fa1 => generated 1317 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:58:18.233253 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-96be8f75-4795-40fa-b46d-dc47342a86fd tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:58:18.234075 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-96be8f75-4795-40fa-b46d-dc47342a86fd tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] [instance: ea631032-dd04-429b-988e-e6362ea42cf7] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:58:18.239687 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-160f8337-0174-402b-9d9f-65c3fd023c45 tempest-FloatingIPsAssociationNegativeTestJSON-296725392 tempest-FloatingIPsAssociationNegativeTestJSON-296725392-project] 10.222.0.13 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 2.810414 Nov 01 18:58:18.240247 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 564/1153] 10.222.0.13 () {60 vars in 1170 bytes} [Tue Nov 1 18:58:15 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 2812 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 18:58:18.242110 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-96be8f75-4795-40fa-b46d-dc47342a86fd tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:18.242827 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-96be8f75-4795-40fa-b46d-dc47342a86fd tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:18.243462 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-96be8f75-4795-40fa-b46d-dc47342a86fd tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:18.244972 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-96be8f75-4795-40fa-b46d-dc47342a86fd tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:18.245573 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-96be8f75-4795-40fa-b46d-dc47342a86fd tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:18.248108 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-96be8f75-4795-40fa-b46d-dc47342a86fd tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:18.253261 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-b411625d-8e23-400b-bdfa-642be95bf523 tempest-FloatingIPsAssociationNegativeTestJSON-296725392 tempest-FloatingIPsAssociationNegativeTestJSON-296725392-project] Action: 'action', calling method: .version_select at 0x7f0ae4237af0>, body: {"addFloatingIp": {"address": "172.25.8.124"}} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 18:58:18.256138 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-b411625d-8e23-400b-bdfa-642be95bf523 tempest-FloatingIPsAssociationNegativeTestJSON-296725392 tempest-FloatingIPsAssociationNegativeTestJSON-296725392-project] [instance: 8e62f12b-8b96-414a-8099-0f9acb7fabf5] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:58:18.265858 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-b411625d-8e23-400b-bdfa-642be95bf523 tempest-FloatingIPsAssociationNegativeTestJSON-296725392 tempest-FloatingIPsAssociationNegativeTestJSON-296725392-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:18.271009 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-b411625d-8e23-400b-bdfa-642be95bf523 tempest-FloatingIPsAssociationNegativeTestJSON-296725392 tempest-FloatingIPsAssociationNegativeTestJSON-296725392-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:18.271737 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-b411625d-8e23-400b-bdfa-642be95bf523 tempest-FloatingIPsAssociationNegativeTestJSON-296725392 tempest-FloatingIPsAssociationNegativeTestJSON-296725392-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:18.272802 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-b411625d-8e23-400b-bdfa-642be95bf523 tempest-FloatingIPsAssociationNegativeTestJSON-296725392 tempest-FloatingIPsAssociationNegativeTestJSON-296725392-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:18.273455 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-b411625d-8e23-400b-bdfa-642be95bf523 tempest-FloatingIPsAssociationNegativeTestJSON-296725392 tempest-FloatingIPsAssociationNegativeTestJSON-296725392-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:18.274042 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-b411625d-8e23-400b-bdfa-642be95bf523 tempest-FloatingIPsAssociationNegativeTestJSON-296725392 tempest-FloatingIPsAssociationNegativeTestJSON-296725392-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:18.332072 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-96be8f75-4795-40fa-b46d-dc47342a86fd tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c1314c21d8547ff890ede1c2ad281c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c804370880454c7aa02cef2c2c3cf144', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:58:18.341449 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-96be8f75-4795-40fa-b46d-dc47342a86fd tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c1314c21d8547ff890ede1c2ad281c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c804370880454c7aa02cef2c2c3cf144', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:58:18.343431 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-96be8f75-4795-40fa-b46d-dc47342a86fd tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c1314c21d8547ff890ede1c2ad281c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c804370880454c7aa02cef2c2c3cf144', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:58:18.349807 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-96be8f75-4795-40fa-b46d-dc47342a86fd tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] 10.222.0.13 "GET /compute/v2.1/servers/ea631032-dd04-429b-988e-e6362ea42cf7" status: 200 len: 1553 microversion: 2.91 time: 0.120246 Nov 01 18:58:18.350482 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 590/1154] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 18:58:18 2022] GET /compute/v2.1/servers/ea631032-dd04-429b-988e-e6362ea42cf7 => generated 1553 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 18:58:18.355497 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-b411625d-8e23-400b-bdfa-642be95bf523 tempest-FloatingIPsAssociationNegativeTestJSON-296725392 tempest-FloatingIPsAssociationNegativeTestJSON-296725392-project] Acquiring lock "refresh_cache-8e62f12b-8b96-414a-8099-0f9acb7fabf5" {{(pid=121403) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Nov 01 18:58:18.356111 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-b411625d-8e23-400b-bdfa-642be95bf523 tempest-FloatingIPsAssociationNegativeTestJSON-296725392 tempest-FloatingIPsAssociationNegativeTestJSON-296725392-project] Acquired lock "refresh_cache-8e62f12b-8b96-414a-8099-0f9acb7fabf5" {{(pid=121403) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Nov 01 18:58:18.367024 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-9b2b7156-d31e-43bb-b1d3-0789736edfb7 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:58:18.368016 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-9b2b7156-d31e-43bb-b1d3-0789736edfb7 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] [instance: eebaed86-332c-47dc-af0f-f37e9b69d52f] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:58:18.374744 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-9b2b7156-d31e-43bb-b1d3-0789736edfb7 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:18.375647 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-9b2b7156-d31e-43bb-b1d3-0789736edfb7 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:18.376411 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-9b2b7156-d31e-43bb-b1d3-0789736edfb7 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:18.377365 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-9b2b7156-d31e-43bb-b1d3-0789736edfb7 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:18.377972 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-9b2b7156-d31e-43bb-b1d3-0789736edfb7 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:18.378553 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-9b2b7156-d31e-43bb-b1d3-0789736edfb7 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:18.551495 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-9b2b7156-d31e-43bb-b1d3-0789736edfb7 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b52b7dcbb044f9bfc424e4417c77fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '708bc0ea4b5a4baf81933725792bedd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:58:18.563200 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-9b2b7156-d31e-43bb-b1d3-0789736edfb7 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] 10.222.0.13 "GET /compute/v2.1/servers/eebaed86-332c-47dc-af0f-f37e9b69d52f" status: 200 len: 1325 microversion: 2.1 time: 0.204302 Nov 01 18:58:18.577118 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 591/1155] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:58:18 2022] GET /compute/v2.1/servers/eebaed86-332c-47dc-af0f-f37e9b69d52f => generated 1325 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:58:18.588783 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-01945db3-b275-4173-90c5-af20090f8103 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:58:18.589663 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-01945db3-b275-4173-90c5-af20090f8103 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] [instance: 869ca597-f199-474f-a680-59b0a75512c7] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:58:18.597020 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-01945db3-b275-4173-90c5-af20090f8103 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:18.597721 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-01945db3-b275-4173-90c5-af20090f8103 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:18.598342 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-01945db3-b275-4173-90c5-af20090f8103 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:18.599206 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-01945db3-b275-4173-90c5-af20090f8103 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:18.599855 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-01945db3-b275-4173-90c5-af20090f8103 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:18.600470 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-01945db3-b275-4173-90c5-af20090f8103 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:18.763158 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-01945db3-b275-4173-90c5-af20090f8103 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a63d69c99a546f0af16329cff3ca717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a1bb191cff948e99c008b5e861ce4a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:58:18.773701 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-01945db3-b275-4173-90c5-af20090f8103 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] 10.222.0.13 "GET /compute/v2.1/servers/869ca597-f199-474f-a680-59b0a75512c7" status: 200 len: 1520 microversion: 2.1 time: 0.195167 Nov 01 18:58:18.774633 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 592/1156] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:58:18 2022] GET /compute/v2.1/servers/869ca597-f199-474f-a680-59b0a75512c7 => generated 1520 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:58:19.049712 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-d5c44dad-14b7-48d1-981b-8b1e54c7b9e1 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:58:19.050756 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-d5c44dad-14b7-48d1-981b-8b1e54c7b9e1 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] [instance: 9249c81d-e57b-4985-a398-8ad97526d5c7] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:58:19.061536 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-d5c44dad-14b7-48d1-981b-8b1e54c7b9e1 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:19.062662 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-d5c44dad-14b7-48d1-981b-8b1e54c7b9e1 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:19.063319 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-d5c44dad-14b7-48d1-981b-8b1e54c7b9e1 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:19.064429 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-d5c44dad-14b7-48d1-981b-8b1e54c7b9e1 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:19.065143 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-d5c44dad-14b7-48d1-981b-8b1e54c7b9e1 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:19.065801 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-d5c44dad-14b7-48d1-981b-8b1e54c7b9e1 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:19.223590 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-d5c44dad-14b7-48d1-981b-8b1e54c7b9e1 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72117f17294649d6b8bc16c66c7efab2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45d4c047d3c44324a27a27831236ab0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:58:19.231797 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-d5c44dad-14b7-48d1-981b-8b1e54c7b9e1 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] 10.222.0.13 "GET /compute/v2.1/servers/9249c81d-e57b-4985-a398-8ad97526d5c7" status: 200 len: 1529 microversion: 2.1 time: 0.186063 Nov 01 18:58:19.233022 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 593/1157] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:58:19 2022] GET /compute/v2.1/servers/9249c81d-e57b-4985-a398-8ad97526d5c7 => generated 1529 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:58:19.237800 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [req-44144f5a-b1f9-49cb-995f-12016350efe3 req-f768769e-c87a-4388-b153-dd7e40df29ef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7186700c-1951-4ab3-a872-865dc1a45fa1", "name": "network-vif-plugged", "status": "completed", "tag": "77cc2e93-7bb9-47d9-9c54-7857a7ba35e5"}]} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 18:58:19.251774 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-44144f5a-b1f9-49cb-995f-12016350efe3 req-f768769e-c87a-4388-b153-dd7e40df29ef service nova] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:19.252686 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-44144f5a-b1f9-49cb-995f-12016350efe3 req-f768769e-c87a-4388-b153-dd7e40df29ef service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:19.253179 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-44144f5a-b1f9-49cb-995f-12016350efe3 req-f768769e-c87a-4388-b153-dd7e40df29ef service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:19.265608 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.compute.server_external_events [req-44144f5a-b1f9-49cb-995f-12016350efe3 req-f768769e-c87a-4388-b153-dd7e40df29ef service nova] Creating event network-vif-plugged:77cc2e93-7bb9-47d9-9c54-7857a7ba35e5 for instance 7186700c-1951-4ab3-a872-865dc1a45fa1 on n-h1-863052-2 Nov 01 18:58:19.271305 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [req-44144f5a-b1f9-49cb-995f-12016350efe3 req-f768769e-c87a-4388-b153-dd7e40df29ef service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037158 Nov 01 18:58:19.272259 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 594/1158] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Nov 1 18:58:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 18:58:19.279961 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-bc8f0fd8-f007-4e65-bb41-d5779162a440 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:58:19.280697 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-bc8f0fd8-f007-4e65-bb41-d5779162a440 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] [instance: 7186700c-1951-4ab3-a872-865dc1a45fa1] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:58:19.288075 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-bc8f0fd8-f007-4e65-bb41-d5779162a440 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:19.288742 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-bc8f0fd8-f007-4e65-bb41-d5779162a440 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:19.289183 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-bc8f0fd8-f007-4e65-bb41-d5779162a440 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:19.289880 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-bc8f0fd8-f007-4e65-bb41-d5779162a440 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:19.290365 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-bc8f0fd8-f007-4e65-bb41-d5779162a440 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:19.290759 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-bc8f0fd8-f007-4e65-bb41-d5779162a440 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:19.503950 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-bc8f0fd8-f007-4e65-bb41-d5779162a440 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0290a6bb8bc24b8988a925327ac0381c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86941784237549838bba63ce88053b88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:58:19.520553 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-bc8f0fd8-f007-4e65-bb41-d5779162a440 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] 10.222.0.13 "GET /compute/v2.1/servers/7186700c-1951-4ab3-a872-865dc1a45fa1" status: 200 len: 1317 microversion: 2.1 time: 0.246650 Nov 01 18:58:19.521500 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 595/1159] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:58:19 2022] GET /compute/v2.1/servers/7186700c-1951-4ab3-a872-865dc1a45fa1 => generated 1317 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:58:19.527095 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-1ed32c0a-2688-424d-afaf-8608f97ab0e8 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:58:19.527936 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-1ed32c0a-2688-424d-afaf-8608f97ab0e8 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] [instance: 9249c81d-e57b-4985-a398-8ad97526d5c7] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:58:19.534986 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-1ed32c0a-2688-424d-afaf-8608f97ab0e8 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:19.535754 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-1ed32c0a-2688-424d-afaf-8608f97ab0e8 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:19.536572 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-1ed32c0a-2688-424d-afaf-8608f97ab0e8 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:19.537446 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-1ed32c0a-2688-424d-afaf-8608f97ab0e8 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:19.538041 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-1ed32c0a-2688-424d-afaf-8608f97ab0e8 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:19.538915 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-1ed32c0a-2688-424d-afaf-8608f97ab0e8 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:19.768693 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-1ed32c0a-2688-424d-afaf-8608f97ab0e8 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72117f17294649d6b8bc16c66c7efab2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45d4c047d3c44324a27a27831236ab0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:58:19.780801 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-1ed32c0a-2688-424d-afaf-8608f97ab0e8 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] 10.222.0.13 "GET /compute/v2.1/servers/9249c81d-e57b-4985-a398-8ad97526d5c7" status: 200 len: 1529 microversion: 2.1 time: 0.253863 Nov 01 18:58:19.781963 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 596/1160] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:58:19 2022] GET /compute/v2.1/servers/9249c81d-e57b-4985-a398-8ad97526d5c7 => generated 1529 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:58:19.787836 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-e558063e-92b1-4ede-90aa-2917c8a913a5 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:58:19.788897 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-e558063e-92b1-4ede-90aa-2917c8a913a5 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] [instance: ea631032-dd04-429b-988e-e6362ea42cf7] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:58:19.795601 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e558063e-92b1-4ede-90aa-2917c8a913a5 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:19.796414 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e558063e-92b1-4ede-90aa-2917c8a913a5 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:19.797038 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e558063e-92b1-4ede-90aa-2917c8a913a5 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:19.798030 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e558063e-92b1-4ede-90aa-2917c8a913a5 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:19.801290 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e558063e-92b1-4ede-90aa-2917c8a913a5 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:19.802073 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e558063e-92b1-4ede-90aa-2917c8a913a5 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:19.888388 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-e558063e-92b1-4ede-90aa-2917c8a913a5 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c1314c21d8547ff890ede1c2ad281c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c804370880454c7aa02cef2c2c3cf144', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:58:19.898517 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-e558063e-92b1-4ede-90aa-2917c8a913a5 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c1314c21d8547ff890ede1c2ad281c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c804370880454c7aa02cef2c2c3cf144', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:58:19.900143 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-e558063e-92b1-4ede-90aa-2917c8a913a5 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c1314c21d8547ff890ede1c2ad281c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c804370880454c7aa02cef2c2c3cf144', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:58:19.907264 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-e558063e-92b1-4ede-90aa-2917c8a913a5 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] 10.222.0.13 "GET /compute/v2.1/servers/ea631032-dd04-429b-988e-e6362ea42cf7" status: 200 len: 1553 microversion: 2.91 time: 0.123480 Nov 01 18:58:19.908042 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 597/1161] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 18:58:19 2022] GET /compute/v2.1/servers/ea631032-dd04-429b-988e-e6362ea42cf7 => generated 1553 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 18:58:19.912401 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-9ee50db2-fad6-4f77-898f-468f516a1782 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:58:19.913043 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-9ee50db2-fad6-4f77-898f-468f516a1782 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] [instance: eebaed86-332c-47dc-af0f-f37e9b69d52f] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:58:19.918726 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-9ee50db2-fad6-4f77-898f-468f516a1782 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:19.919201 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-9ee50db2-fad6-4f77-898f-468f516a1782 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:19.919628 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-9ee50db2-fad6-4f77-898f-468f516a1782 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:19.920307 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-9ee50db2-fad6-4f77-898f-468f516a1782 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:19.920779 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-9ee50db2-fad6-4f77-898f-468f516a1782 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:19.921194 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-9ee50db2-fad6-4f77-898f-468f516a1782 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:20.096611 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-9ee50db2-fad6-4f77-898f-468f516a1782 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b52b7dcbb044f9bfc424e4417c77fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '708bc0ea4b5a4baf81933725792bedd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:58:20.110825 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-9ee50db2-fad6-4f77-898f-468f516a1782 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] 10.222.0.13 "GET /compute/v2.1/servers/eebaed86-332c-47dc-af0f-f37e9b69d52f" status: 200 len: 1325 microversion: 2.1 time: 0.201874 Nov 01 18:58:20.112278 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 598/1162] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:58:19 2022] GET /compute/v2.1/servers/eebaed86-332c-47dc-af0f-f37e9b69d52f => generated 1325 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:58:20.118754 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-bae9f84a-abd8-454a-99de-4f12c7e479cf tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:58:20.118882 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.network.neutron [None req-b411625d-8e23-400b-bdfa-642be95bf523 tempest-FloatingIPsAssociationNegativeTestJSON-296725392 tempest-FloatingIPsAssociationNegativeTestJSON-296725392-project] [instance: 8e62f12b-8b96-414a-8099-0f9acb7fabf5] Building network info cache for instance {{(pid=121403) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Nov 01 18:58:20.120082 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-bae9f84a-abd8-454a-99de-4f12c7e479cf tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] [instance: 869ca597-f199-474f-a680-59b0a75512c7] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:58:20.128274 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-bae9f84a-abd8-454a-99de-4f12c7e479cf tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:20.128788 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-bae9f84a-abd8-454a-99de-4f12c7e479cf tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:20.129427 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-bae9f84a-abd8-454a-99de-4f12c7e479cf tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:20.130119 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-bae9f84a-abd8-454a-99de-4f12c7e479cf tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:20.130571 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-bae9f84a-abd8-454a-99de-4f12c7e479cf tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:20.130990 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-bae9f84a-abd8-454a-99de-4f12c7e479cf tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:20.320384 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-bae9f84a-abd8-454a-99de-4f12c7e479cf tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a63d69c99a546f0af16329cff3ca717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a1bb191cff948e99c008b5e861ce4a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:58:20.328262 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-bae9f84a-abd8-454a-99de-4f12c7e479cf tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] 10.222.0.13 "GET /compute/v2.1/servers/869ca597-f199-474f-a680-59b0a75512c7" status: 200 len: 1520 microversion: 2.1 time: 0.214712 Nov 01 18:58:20.328875 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 599/1163] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:58:20 2022] GET /compute/v2.1/servers/869ca597-f199-474f-a680-59b0a75512c7 => generated 1520 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:58:20.334209 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-0dd0769f-a29c-4f0d-b3f1-2eb8e23130b2 tempest-MigrationsAdminTest-1970194929 tempest-MigrationsAdminTest-1970194929-project-admin] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:58:20.365127 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-0dd0769f-a29c-4f0d-b3f1-2eb8e23130b2 tempest-MigrationsAdminTest-1970194929 tempest-MigrationsAdminTest-1970194929-project-admin] 10.222.0.13 "DELETE /compute/v2.1/flavors/5ea4b6f0-c10d-445f-be41-707913d8c773" status: 202 len: 0 microversion: 2.1 time: 0.034572 Nov 01 18:58:20.365923 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 600/1164] 10.222.0.13 () {58 vars in 1239 bytes} [Tue Nov 1 18:58:20 2022] DELETE /compute/v2.1/flavors/5ea4b6f0-c10d-445f-be41-707913d8c773 => generated 0 bytes in 36 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 01 18:58:20.382223 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [req-6b9defb1-a082-4333-8d70-ffe405aed9a6 req-06d1ab09-0265-4746-a4e8-7751c5ac5279 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8e62f12b-8b96-414a-8099-0f9acb7fabf5", "tag": "8b2113da-4763-4f79-99c9-989625f65d00"}]} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 18:58:20.397285 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-6b9defb1-a082-4333-8d70-ffe405aed9a6 req-06d1ab09-0265-4746-a4e8-7751c5ac5279 service nova] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:20.398088 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-6b9defb1-a082-4333-8d70-ffe405aed9a6 req-06d1ab09-0265-4746-a4e8-7751c5ac5279 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:20.398528 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-6b9defb1-a082-4333-8d70-ffe405aed9a6 req-06d1ab09-0265-4746-a4e8-7751c5ac5279 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:20.410505 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.compute.server_external_events [req-6b9defb1-a082-4333-8d70-ffe405aed9a6 req-06d1ab09-0265-4746-a4e8-7751c5ac5279 service nova] Creating event network-changed:8b2113da-4763-4f79-99c9-989625f65d00 for instance 8e62f12b-8b96-414a-8099-0f9acb7fabf5 on n-h2-863052-2 Nov 01 18:58:20.415571 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [req-6b9defb1-a082-4333-8d70-ffe405aed9a6 req-06d1ab09-0265-4746-a4e8-7751c5ac5279 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043738 Nov 01 18:58:20.416166 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 601/1165] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Nov 1 18:58:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 18:58:20.421355 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-0de7c7c6-b0eb-495d-b100-d96a80a09834 tempest-MigrationsAdminTest-1970194929 tempest-MigrationsAdminTest-1970194929-project-admin] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:58:20.443505 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-0de7c7c6-b0eb-495d-b100-d96a80a09834 tempest-MigrationsAdminTest-1970194929 tempest-MigrationsAdminTest-1970194929-project-admin] 10.222.0.13 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.025939 Nov 01 18:58:20.444431 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 602/1166] 10.222.0.13 () {58 vars in 1146 bytes} [Tue Nov 1 18:58:20 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:58:20.466784 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-19546c9c-af89-4deb-8d1a-20cf3004c6fb tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 18:58:20.471752 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-19546c9c-af89-4deb-8d1a-20cf3004c6fb tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] [instance: 9249c81d-e57b-4985-a398-8ad97526d5c7] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:58:20.482936 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-19546c9c-af89-4deb-8d1a-20cf3004c6fb tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:20.482936 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-19546c9c-af89-4deb-8d1a-20cf3004c6fb tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:20.483456 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-19546c9c-af89-4deb-8d1a-20cf3004c6fb tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:20.484469 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-19546c9c-af89-4deb-8d1a-20cf3004c6fb tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:20.485091 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-19546c9c-af89-4deb-8d1a-20cf3004c6fb tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:20.486054 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-19546c9c-af89-4deb-8d1a-20cf3004c6fb tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:20.522891 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-19546c9c-af89-4deb-8d1a-20cf3004c6fb tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '72117f17294649d6b8bc16c66c7efab2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45d4c047d3c44324a27a27831236ab0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:58:20.529922 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-19546c9c-af89-4deb-8d1a-20cf3004c6fb tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] [instance: 9249c81d-e57b-4985-a398-8ad97526d5c7] Old instance type tempest-test_resize_flavor_-1817160234, new instance type m1.heat {{(pid=121402) resize /opt/stack/nova/nova/compute/api.py:4220}} Nov 01 18:58:20.544950 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.virt.hardware [None req-19546c9c-af89-4deb-8d1a-20cf3004c6fb tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Flavor limits 0:0:0 {{(pid=121402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 01 18:58:20.544950 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.virt.hardware [None req-19546c9c-af89-4deb-8d1a-20cf3004c6fb tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Image limits 0:0:0 {{(pid=121402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 01 18:58:20.545266 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.virt.hardware [None req-19546c9c-af89-4deb-8d1a-20cf3004c6fb tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Flavor pref 0:0:0 {{(pid=121402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 01 18:58:20.548314 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.virt.hardware [None req-19546c9c-af89-4deb-8d1a-20cf3004c6fb tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Image pref 0:0:0 {{(pid=121402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 01 18:58:20.550120 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.virt.hardware [None req-19546c9c-af89-4deb-8d1a-20cf3004c6fb tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 01 18:58:20.647007 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-19546c9c-af89-4deb-8d1a-20cf3004c6fb tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] 10.222.0.13 "POST /compute/v2.1/servers/9249c81d-e57b-4985-a398-8ad97526d5c7/action" status: 202 len: 0 microversion: 2.1 time: 0.186957 Nov 01 18:58:20.651095 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 603/1167] 10.222.0.13 () {60 vars in 1278 bytes} [Tue Nov 1 18:58:20 2022] POST /compute/v2.1/servers/9249c81d-e57b-4985-a398-8ad97526d5c7/action => generated 0 bytes in 192 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 01 18:58:20.656502 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-14ea7b43-641d-4a80-99d1-6c3bbd26017c tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:58:20.657202 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-14ea7b43-641d-4a80-99d1-6c3bbd26017c tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] [instance: 7186700c-1951-4ab3-a872-865dc1a45fa1] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:58:20.663244 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-14ea7b43-641d-4a80-99d1-6c3bbd26017c tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:20.664217 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-14ea7b43-641d-4a80-99d1-6c3bbd26017c tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:20.664559 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-14ea7b43-641d-4a80-99d1-6c3bbd26017c tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:20.665792 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-14ea7b43-641d-4a80-99d1-6c3bbd26017c tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:20.666337 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-14ea7b43-641d-4a80-99d1-6c3bbd26017c tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:20.666758 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-14ea7b43-641d-4a80-99d1-6c3bbd26017c tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:20.689799 n-d-863052-2 devstack@n-api.service[121402]: DEBUG dbcounter [-] [121402] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 18:58:20.872103 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-14ea7b43-641d-4a80-99d1-6c3bbd26017c tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0290a6bb8bc24b8988a925327ac0381c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86941784237549838bba63ce88053b88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:58:20.882077 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-14ea7b43-641d-4a80-99d1-6c3bbd26017c tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] 10.222.0.13 "GET /compute/v2.1/servers/7186700c-1951-4ab3-a872-865dc1a45fa1" status: 200 len: 1317 microversion: 2.1 time: 0.229544 Nov 01 18:58:20.894368 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 604/1168] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:58:20 2022] GET /compute/v2.1/servers/7186700c-1951-4ab3-a872-865dc1a45fa1 => generated 1317 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:58:20.911255 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-9503c136-8917-4cde-b9e4-ffcaa6718d4f tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:58:20.911963 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-9503c136-8917-4cde-b9e4-ffcaa6718d4f tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] [instance: 9249c81d-e57b-4985-a398-8ad97526d5c7] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:58:20.925363 n-d-863052-2 devstack@n-api.service[121402]: DEBUG dbcounter [-] [121402] Writing DB stats nova_api:SELECT=97,nova_api:DELETE=3 {{(pid=121402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 18:58:20.927344 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-9503c136-8917-4cde-b9e4-ffcaa6718d4f tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:20.928698 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-9503c136-8917-4cde-b9e4-ffcaa6718d4f tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:20.929286 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-9503c136-8917-4cde-b9e4-ffcaa6718d4f tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:20.930806 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-9503c136-8917-4cde-b9e4-ffcaa6718d4f tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:20.931520 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-9503c136-8917-4cde-b9e4-ffcaa6718d4f tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:20.932025 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-9503c136-8917-4cde-b9e4-ffcaa6718d4f tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:21.051295 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.network.neutron [None req-b411625d-8e23-400b-bdfa-642be95bf523 tempest-FloatingIPsAssociationNegativeTestJSON-296725392 tempest-FloatingIPsAssociationNegativeTestJSON-296725392-project] [instance: 8e62f12b-8b96-414a-8099-0f9acb7fabf5] Updating instance_info_cache with network_info: [{"id": "8b2113da-4763-4f79-99c9-989625f65d00", "address": "fa:16:3e:77:c8:88", "network": {"id": "86bacc2f-968e-47bf-8353-16e36ae733f8", "bridge": null, "label": "tempest-FloatingIPsAssociationNegativeTestJSON-1151086199-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.8.124", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "e3bd3f356d364e11b14d90d71cb5d598", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap8b2113da-47", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=121403) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Nov 01 18:58:21.080402 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-b411625d-8e23-400b-bdfa-642be95bf523 tempest-FloatingIPsAssociationNegativeTestJSON-296725392 tempest-FloatingIPsAssociationNegativeTestJSON-296725392-project] Releasing lock "refresh_cache-8e62f12b-8b96-414a-8099-0f9acb7fabf5" {{(pid=121403) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Nov 01 18:58:21.081542 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-b411625d-8e23-400b-bdfa-642be95bf523 tempest-FloatingIPsAssociationNegativeTestJSON-296725392 tempest-FloatingIPsAssociationNegativeTestJSON-296725392-project] 10.222.0.13 "POST /compute/v2.1/servers/8e62f12b-8b96-414a-8099-0f9acb7fabf5/action" status: 202 len: 0 microversion: 2.1 time: 2.832054 Nov 01 18:58:21.084987 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 565/1169] 10.222.0.13 () {60 vars in 1278 bytes} [Tue Nov 1 18:58:18 2022] POST /compute/v2.1/servers/8e62f12b-8b96-414a-8099-0f9acb7fabf5/action => generated 0 bytes in 2834 msecs (HTTP/1.1 202) 9 headers in 369 bytes (2 switches on core 0) Nov 01 18:58:21.093949 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-98f73f01-0774-44f0-9fd1-68102474e15b tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:58:21.097487 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-98f73f01-0774-44f0-9fd1-68102474e15b tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] [instance: ea631032-dd04-429b-988e-e6362ea42cf7] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:58:21.111057 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-98f73f01-0774-44f0-9fd1-68102474e15b tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:21.112140 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-98f73f01-0774-44f0-9fd1-68102474e15b tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:21.112612 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-98f73f01-0774-44f0-9fd1-68102474e15b tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:21.113340 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-98f73f01-0774-44f0-9fd1-68102474e15b tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:21.113805 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-98f73f01-0774-44f0-9fd1-68102474e15b tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:21.114233 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-98f73f01-0774-44f0-9fd1-68102474e15b tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:21.289361 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-9503c136-8917-4cde-b9e4-ffcaa6718d4f tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72117f17294649d6b8bc16c66c7efab2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45d4c047d3c44324a27a27831236ab0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:58:21.307340 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-9503c136-8917-4cde-b9e4-ffcaa6718d4f tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] 10.222.0.13 "GET /compute/v2.1/servers/9249c81d-e57b-4985-a398-8ad97526d5c7" status: 200 len: 1538 microversion: 2.1 time: 0.410675 Nov 01 18:58:21.308281 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 605/1170] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:58:20 2022] GET /compute/v2.1/servers/9249c81d-e57b-4985-a398-8ad97526d5c7 => generated 1538 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:58:21.313297 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-fff87709-e705-4c1c-8767-92bb32d2293c tempest-FloatingIPsAssociationNegativeTestJSON-296725392 tempest-FloatingIPsAssociationNegativeTestJSON-296725392-project] Action: 'create', calling method: .version_select at 0x7f0ae25293a0>, body: {"pool": "3c6bfafa-c688-4384-8c54-de7825ea90b1"} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 18:58:21.332024 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-98f73f01-0774-44f0-9fd1-68102474e15b tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c1314c21d8547ff890ede1c2ad281c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c804370880454c7aa02cef2c2c3cf144', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:58:21.342089 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-98f73f01-0774-44f0-9fd1-68102474e15b tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c1314c21d8547ff890ede1c2ad281c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c804370880454c7aa02cef2c2c3cf144', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:58:21.350880 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-98f73f01-0774-44f0-9fd1-68102474e15b tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c1314c21d8547ff890ede1c2ad281c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c804370880454c7aa02cef2c2c3cf144', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:58:21.365167 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-98f73f01-0774-44f0-9fd1-68102474e15b tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] 10.222.0.13 "GET /compute/v2.1/servers/ea631032-dd04-429b-988e-e6362ea42cf7" status: 200 len: 1553 microversion: 2.91 time: 0.281542 Nov 01 18:58:21.366258 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 566/1171] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 18:58:21 2022] GET /compute/v2.1/servers/ea631032-dd04-429b-988e-e6362ea42cf7 => generated 1553 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 18:58:21.377012 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-f94daabc-98a1-4707-899a-f78dc5513560 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:58:21.379152 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-f94daabc-98a1-4707-899a-f78dc5513560 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] [instance: eebaed86-332c-47dc-af0f-f37e9b69d52f] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:58:21.395489 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f94daabc-98a1-4707-899a-f78dc5513560 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:21.395996 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f94daabc-98a1-4707-899a-f78dc5513560 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:21.413265 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f94daabc-98a1-4707-899a-f78dc5513560 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:21.414032 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f94daabc-98a1-4707-899a-f78dc5513560 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:21.414696 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f94daabc-98a1-4707-899a-f78dc5513560 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:21.415291 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f94daabc-98a1-4707-899a-f78dc5513560 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:21.420376 n-d-863052-2 devstack@n-api.service[121403]: DEBUG dbcounter [-] [121403] Writing DB stats nova_cell1:SELECT=97,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=1,nova_cell1:RELEASE=1 {{(pid=121403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 18:58:21.797267 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-f94daabc-98a1-4707-899a-f78dc5513560 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b52b7dcbb044f9bfc424e4417c77fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '708bc0ea4b5a4baf81933725792bedd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:58:21.807810 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-f94daabc-98a1-4707-899a-f78dc5513560 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] 10.222.0.13 "GET /compute/v2.1/servers/eebaed86-332c-47dc-af0f-f37e9b69d52f" status: 200 len: 1325 microversion: 2.1 time: 0.439651 Nov 01 18:58:21.821341 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 567/1172] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:58:21 2022] GET /compute/v2.1/servers/eebaed86-332c-47dc-af0f-f37e9b69d52f => generated 1325 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:58:21.835380 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [req-f8e7e37b-4cc2-4549-ad45-b8969b12f573 req-858ff093-0389-460a-ab27-c0e54f8e3ec0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eebaed86-332c-47dc-af0f-f37e9b69d52f", "name": "network-vif-plugged", "status": "completed", "tag": "0e64752c-4421-48b4-a71d-203804b58462"}]} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 18:58:21.855489 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-f8e7e37b-4cc2-4549-ad45-b8969b12f573 req-858ff093-0389-460a-ab27-c0e54f8e3ec0 service nova] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:21.856195 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-f8e7e37b-4cc2-4549-ad45-b8969b12f573 req-858ff093-0389-460a-ab27-c0e54f8e3ec0 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:21.856841 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-f8e7e37b-4cc2-4549-ad45-b8969b12f573 req-858ff093-0389-460a-ab27-c0e54f8e3ec0 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:21.886119 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.compute.server_external_events [req-f8e7e37b-4cc2-4549-ad45-b8969b12f573 req-858ff093-0389-460a-ab27-c0e54f8e3ec0 service nova] Creating event network-vif-plugged:0e64752c-4421-48b4-a71d-203804b58462 for instance eebaed86-332c-47dc-af0f-f37e9b69d52f on n-h1-863052-2 Nov 01 18:58:21.892846 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [req-f8e7e37b-4cc2-4549-ad45-b8969b12f573 req-858ff093-0389-460a-ab27-c0e54f8e3ec0 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069143 Nov 01 18:58:21.893846 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 568/1173] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Nov 1 18:58:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 18:58:21.902020 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-eb0a8e76-d566-4ecb-8a8b-cca686ceb032 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:58:21.903445 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-eb0a8e76-d566-4ecb-8a8b-cca686ceb032 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] [instance: 869ca597-f199-474f-a680-59b0a75512c7] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:58:21.911323 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-eb0a8e76-d566-4ecb-8a8b-cca686ceb032 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:21.911994 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-eb0a8e76-d566-4ecb-8a8b-cca686ceb032 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:21.913046 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-eb0a8e76-d566-4ecb-8a8b-cca686ceb032 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:21.914079 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-eb0a8e76-d566-4ecb-8a8b-cca686ceb032 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:21.914753 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-eb0a8e76-d566-4ecb-8a8b-cca686ceb032 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:21.915357 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-eb0a8e76-d566-4ecb-8a8b-cca686ceb032 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:22.106034 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-eb0a8e76-d566-4ecb-8a8b-cca686ceb032 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a63d69c99a546f0af16329cff3ca717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a1bb191cff948e99c008b5e861ce4a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:58:22.116755 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-eb0a8e76-d566-4ecb-8a8b-cca686ceb032 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] 10.222.0.13 "GET /compute/v2.1/servers/869ca597-f199-474f-a680-59b0a75512c7" status: 200 len: 1520 microversion: 2.1 time: 0.219577 Nov 01 18:58:22.129327 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 569/1174] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:58:21 2022] GET /compute/v2.1/servers/869ca597-f199-474f-a680-59b0a75512c7 => generated 1520 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:58:22.139511 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-396207ae-de0b-4be4-be52-335a9e46ba0b tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:58:22.140410 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-396207ae-de0b-4be4-be52-335a9e46ba0b tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] [instance: 7186700c-1951-4ab3-a872-865dc1a45fa1] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:58:22.147788 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-396207ae-de0b-4be4-be52-335a9e46ba0b tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:22.148567 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-396207ae-de0b-4be4-be52-335a9e46ba0b tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:22.149324 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-396207ae-de0b-4be4-be52-335a9e46ba0b tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:22.150190 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-396207ae-de0b-4be4-be52-335a9e46ba0b tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:22.150641 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-396207ae-de0b-4be4-be52-335a9e46ba0b tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:22.151059 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-396207ae-de0b-4be4-be52-335a9e46ba0b tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:22.350392 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-396207ae-de0b-4be4-be52-335a9e46ba0b tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0290a6bb8bc24b8988a925327ac0381c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86941784237549838bba63ce88053b88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:58:22.362893 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-396207ae-de0b-4be4-be52-335a9e46ba0b tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] 10.222.0.13 "GET /compute/v2.1/servers/7186700c-1951-4ab3-a872-865dc1a45fa1" status: 200 len: 1467 microversion: 2.1 time: 0.232117 Nov 01 18:58:22.363481 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 570/1175] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:58:22 2022] GET /compute/v2.1/servers/7186700c-1951-4ab3-a872-865dc1a45fa1 => generated 1467 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:58:22.376826 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-8dc6d0a0-537a-438f-82ea-b21891a500d8 tempest-LiveAutoBlockMigrationV225Test-1358532044 tempest-LiveAutoBlockMigrationV225Test-1358532044-project-admin] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:58:22.376826 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-8dc6d0a0-537a-438f-82ea-b21891a500d8 tempest-LiveAutoBlockMigrationV225Test-1358532044 tempest-LiveAutoBlockMigrationV225Test-1358532044-project-admin] [instance: a7f88d19-08ee-47bf-9240-7d49afd775e2] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:58:22.377289 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-8dc6d0a0-537a-438f-82ea-b21891a500d8 tempest-LiveAutoBlockMigrationV225Test-1358532044 tempest-LiveAutoBlockMigrationV225Test-1358532044-project-admin] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:22.377957 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-8dc6d0a0-537a-438f-82ea-b21891a500d8 tempest-LiveAutoBlockMigrationV225Test-1358532044 tempest-LiveAutoBlockMigrationV225Test-1358532044-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:22.378583 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-8dc6d0a0-537a-438f-82ea-b21891a500d8 tempest-LiveAutoBlockMigrationV225Test-1358532044 tempest-LiveAutoBlockMigrationV225Test-1358532044-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:22.379455 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-8dc6d0a0-537a-438f-82ea-b21891a500d8 tempest-LiveAutoBlockMigrationV225Test-1358532044 tempest-LiveAutoBlockMigrationV225Test-1358532044-project-admin] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:22.380063 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-8dc6d0a0-537a-438f-82ea-b21891a500d8 tempest-LiveAutoBlockMigrationV225Test-1358532044 tempest-LiveAutoBlockMigrationV225Test-1358532044-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:22.380670 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-8dc6d0a0-537a-438f-82ea-b21891a500d8 tempest-LiveAutoBlockMigrationV225Test-1358532044 tempest-LiveAutoBlockMigrationV225Test-1358532044-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:22.551407 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.objects.instance [None req-8dc6d0a0-537a-438f-82ea-b21891a500d8 tempest-LiveAutoBlockMigrationV225Test-1358532044 tempest-LiveAutoBlockMigrationV225Test-1358532044-project-admin] Lazy-loading 'services' on Instance uuid a7f88d19-08ee-47bf-9240-7d49afd775e2 {{(pid=121403) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 01 18:58:22.581614 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-8dc6d0a0-537a-438f-82ea-b21891a500d8 tempest-LiveAutoBlockMigrationV225Test-1358532044 tempest-LiveAutoBlockMigrationV225Test-1358532044-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/a7f88d19-08ee-47bf-9240-7d49afd775e2" status: 200 len: 2343 microversion: 2.25 time: 0.216314 Nov 01 18:58:22.582423 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 571/1176] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 18:58:22 2022] GET /compute/v2.1/servers/a7f88d19-08ee-47bf-9240-7d49afd775e2 => generated 2343 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 18:58:22.587652 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-ebdf351c-90c6-4c19-a459-545c8b22d003 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:58:22.588254 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-ebdf351c-90c6-4c19-a459-545c8b22d003 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] [instance: 9249c81d-e57b-4985-a398-8ad97526d5c7] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:58:22.596073 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-ebdf351c-90c6-4c19-a459-545c8b22d003 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:22.596791 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-ebdf351c-90c6-4c19-a459-545c8b22d003 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:22.597231 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-ebdf351c-90c6-4c19-a459-545c8b22d003 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:22.598436 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-ebdf351c-90c6-4c19-a459-545c8b22d003 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:22.601128 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-ebdf351c-90c6-4c19-a459-545c8b22d003 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:22.601588 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-ebdf351c-90c6-4c19-a459-545c8b22d003 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:22.777701 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-ebdf351c-90c6-4c19-a459-545c8b22d003 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72117f17294649d6b8bc16c66c7efab2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45d4c047d3c44324a27a27831236ab0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:58:22.795683 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-ebdf351c-90c6-4c19-a459-545c8b22d003 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] 10.222.0.13 "GET /compute/v2.1/servers/9249c81d-e57b-4985-a398-8ad97526d5c7" status: 200 len: 1538 microversion: 2.1 time: 0.211695 Nov 01 18:58:22.796663 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 572/1177] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:58:22 2022] GET /compute/v2.1/servers/9249c81d-e57b-4985-a398-8ad97526d5c7 => generated 1538 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:58:22.871302 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-cf7eac59-b990-4bb5-8b8c-00a70c6eb584 tempest-ServersOnMultiNodesTest-1027241392 tempest-ServersOnMultiNodesTest-1027241392-project-admin] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:58:22.872147 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-cf7eac59-b990-4bb5-8b8c-00a70c6eb584 tempest-ServersOnMultiNodesTest-1027241392 tempest-ServersOnMultiNodesTest-1027241392-project-admin] [instance: 7186700c-1951-4ab3-a872-865dc1a45fa1] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:58:22.880316 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-cf7eac59-b990-4bb5-8b8c-00a70c6eb584 tempest-ServersOnMultiNodesTest-1027241392 tempest-ServersOnMultiNodesTest-1027241392-project-admin] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:22.880855 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-cf7eac59-b990-4bb5-8b8c-00a70c6eb584 tempest-ServersOnMultiNodesTest-1027241392 tempest-ServersOnMultiNodesTest-1027241392-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:22.881467 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-cf7eac59-b990-4bb5-8b8c-00a70c6eb584 tempest-ServersOnMultiNodesTest-1027241392 tempest-ServersOnMultiNodesTest-1027241392-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:22.882352 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-cf7eac59-b990-4bb5-8b8c-00a70c6eb584 tempest-ServersOnMultiNodesTest-1027241392 tempest-ServersOnMultiNodesTest-1027241392-project-admin] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:22.882965 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-cf7eac59-b990-4bb5-8b8c-00a70c6eb584 tempest-ServersOnMultiNodesTest-1027241392 tempest-ServersOnMultiNodesTest-1027241392-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:22.883542 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-cf7eac59-b990-4bb5-8b8c-00a70c6eb584 tempest-ServersOnMultiNodesTest-1027241392 tempest-ServersOnMultiNodesTest-1027241392-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:23.175295 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-cf7eac59-b990-4bb5-8b8c-00a70c6eb584 tempest-ServersOnMultiNodesTest-1027241392 tempest-ServersOnMultiNodesTest-1027241392-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/7186700c-1951-4ab3-a872-865dc1a45fa1" status: 200 len: 1618 microversion: 2.1 time: 0.376251 Nov 01 18:58:23.178030 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 573/1178] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:58:22 2022] GET /compute/v2.1/servers/7186700c-1951-4ab3-a872-865dc1a45fa1 => generated 1618 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:58:23.189560 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-1c5cd0c3-5cd9-49fb-a7c9-05a851ee7cb1 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:58:23.191284 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-1c5cd0c3-5cd9-49fb-a7c9-05a851ee7cb1 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] [instance: ea631032-dd04-429b-988e-e6362ea42cf7] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:58:23.207341 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-1c5cd0c3-5cd9-49fb-a7c9-05a851ee7cb1 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:23.207847 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-1c5cd0c3-5cd9-49fb-a7c9-05a851ee7cb1 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:23.214117 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-1c5cd0c3-5cd9-49fb-a7c9-05a851ee7cb1 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:23.215095 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-1c5cd0c3-5cd9-49fb-a7c9-05a851ee7cb1 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:23.215731 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-1c5cd0c3-5cd9-49fb-a7c9-05a851ee7cb1 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:23.216336 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-1c5cd0c3-5cd9-49fb-a7c9-05a851ee7cb1 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:23.401390 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-1c5cd0c3-5cd9-49fb-a7c9-05a851ee7cb1 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c1314c21d8547ff890ede1c2ad281c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c804370880454c7aa02cef2c2c3cf144', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:58:23.410759 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-1c5cd0c3-5cd9-49fb-a7c9-05a851ee7cb1 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c1314c21d8547ff890ede1c2ad281c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c804370880454c7aa02cef2c2c3cf144', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:58:23.412210 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-1c5cd0c3-5cd9-49fb-a7c9-05a851ee7cb1 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c1314c21d8547ff890ede1c2ad281c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c804370880454c7aa02cef2c2c3cf144', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:58:23.418001 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-1c5cd0c3-5cd9-49fb-a7c9-05a851ee7cb1 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] 10.222.0.13 "GET /compute/v2.1/servers/ea631032-dd04-429b-988e-e6362ea42cf7" status: 200 len: 1553 microversion: 2.91 time: 0.238948 Nov 01 18:58:23.429134 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 574/1179] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 18:58:23 2022] GET /compute/v2.1/servers/ea631032-dd04-429b-988e-e6362ea42cf7 => generated 1553 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 18:58:23.440187 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-a55406bf-fa82-4f5c-80e4-fcd45682cad8 tempest-LiveAutoBlockMigrationV225Test-1358532044 tempest-LiveAutoBlockMigrationV225Test-1358532044-project-admin] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:58:23.446555 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-a55406bf-fa82-4f5c-80e4-fcd45682cad8 tempest-LiveAutoBlockMigrationV225Test-1358532044 tempest-LiveAutoBlockMigrationV225Test-1358532044-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:23.448497 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-a55406bf-fa82-4f5c-80e4-fcd45682cad8 tempest-LiveAutoBlockMigrationV225Test-1358532044 tempest-LiveAutoBlockMigrationV225Test-1358532044-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:23.453739 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-a55406bf-fa82-4f5c-80e4-fcd45682cad8 tempest-LiveAutoBlockMigrationV225Test-1358532044 tempest-LiveAutoBlockMigrationV225Test-1358532044-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:23.455974 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-a55406bf-fa82-4f5c-80e4-fcd45682cad8 tempest-LiveAutoBlockMigrationV225Test-1358532044 tempest-LiveAutoBlockMigrationV225Test-1358532044-project-admin] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:23.456545 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-a55406bf-fa82-4f5c-80e4-fcd45682cad8 tempest-LiveAutoBlockMigrationV225Test-1358532044 tempest-LiveAutoBlockMigrationV225Test-1358532044-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:23.457265 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-a55406bf-fa82-4f5c-80e4-fcd45682cad8 tempest-LiveAutoBlockMigrationV225Test-1358532044 tempest-LiveAutoBlockMigrationV225Test-1358532044-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:23.491247 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-a55406bf-fa82-4f5c-80e4-fcd45682cad8 tempest-LiveAutoBlockMigrationV225Test-1358532044 tempest-LiveAutoBlockMigrationV225Test-1358532044-project-admin] 10.222.0.13 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.060637 Nov 01 18:58:23.491994 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 575/1180] 10.222.0.13 () {60 vars in 1217 bytes} [Tue Nov 1 18:58:23 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 01 18:58:23.499509 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-9b58b6b4-b530-4796-a90b-71168aab4a55 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:58:23.501766 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-9b58b6b4-b530-4796-a90b-71168aab4a55 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] [instance: eebaed86-332c-47dc-af0f-f37e9b69d52f] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:58:23.510482 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-9b58b6b4-b530-4796-a90b-71168aab4a55 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:23.511200 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-9b58b6b4-b530-4796-a90b-71168aab4a55 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:23.511612 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-9b58b6b4-b530-4796-a90b-71168aab4a55 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:23.512789 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-9b58b6b4-b530-4796-a90b-71168aab4a55 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:23.513345 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-9b58b6b4-b530-4796-a90b-71168aab4a55 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:23.513860 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-9b58b6b4-b530-4796-a90b-71168aab4a55 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:23.543031 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-fff87709-e705-4c1c-8767-92bb32d2293c tempest-FloatingIPsAssociationNegativeTestJSON-296725392 tempest-FloatingIPsAssociationNegativeTestJSON-296725392-project] 10.222.0.13 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 2.233500 Nov 01 18:58:23.556977 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 606/1181] 10.222.0.13 () {60 vars in 1170 bytes} [Tue Nov 1 18:58:21 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 2248 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 18:58:23.565190 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-f3806478-3a8b-49fe-8e54-afde427af533 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:58:23.567811 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-f3806478-3a8b-49fe-8e54-afde427af533 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] [instance: 869ca597-f199-474f-a680-59b0a75512c7] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:58:23.583382 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f3806478-3a8b-49fe-8e54-afde427af533 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:23.583382 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f3806478-3a8b-49fe-8e54-afde427af533 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:23.583382 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f3806478-3a8b-49fe-8e54-afde427af533 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:23.583382 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f3806478-3a8b-49fe-8e54-afde427af533 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:23.583790 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f3806478-3a8b-49fe-8e54-afde427af533 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:23.583790 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f3806478-3a8b-49fe-8e54-afde427af533 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:23.795840 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-9b58b6b4-b530-4796-a90b-71168aab4a55 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b52b7dcbb044f9bfc424e4417c77fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '708bc0ea4b5a4baf81933725792bedd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:58:23.795840 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-9b58b6b4-b530-4796-a90b-71168aab4a55 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] 10.222.0.13 "GET /compute/v2.1/servers/eebaed86-332c-47dc-af0f-f37e9b69d52f" status: 200 len: 1325 microversion: 2.1 time: 0.300675 Nov 01 18:58:23.797081 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-f3806478-3a8b-49fe-8e54-afde427af533 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a63d69c99a546f0af16329cff3ca717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a1bb191cff948e99c008b5e861ce4a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:58:23.797309 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 576/1182] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:58:23 2022] GET /compute/v2.1/servers/eebaed86-332c-47dc-af0f-f37e9b69d52f => generated 1325 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:58:23.807629 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-99c09e7a-c246-427f-b6f9-498538807984 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Action: 'create', calling method: .version_select at 0x7f0ae67e30d0>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-796062769", "policies": ["affinity"]}} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 18:58:23.808563 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-f3806478-3a8b-49fe-8e54-afde427af533 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] 10.222.0.13 "GET /compute/v2.1/servers/869ca597-f199-474f-a680-59b0a75512c7" status: 200 len: 1520 microversion: 2.1 time: 0.249409 Nov 01 18:58:23.822985 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 607/1183] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:58:23 2022] GET /compute/v2.1/servers/869ca597-f199-474f-a680-59b0a75512c7 => generated 1520 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:58:23.837865 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-833d36b5-c778-419f-aa8d-89cf246685e3 tempest-FloatingIPsAssociationNegativeTestJSON-296725392 tempest-FloatingIPsAssociationNegativeTestJSON-296725392-project] Action: 'action', calling method: .version_select at 0x7f0ae4236af0>, body: {"addFloatingIp": {"address": "172.25.8.234"}} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 18:58:23.841604 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-833d36b5-c778-419f-aa8d-89cf246685e3 tempest-FloatingIPsAssociationNegativeTestJSON-296725392 tempest-FloatingIPsAssociationNegativeTestJSON-296725392-project] [instance: 8e62f12b-8b96-414a-8099-0f9acb7fabf5] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:58:23.855103 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-833d36b5-c778-419f-aa8d-89cf246685e3 tempest-FloatingIPsAssociationNegativeTestJSON-296725392 tempest-FloatingIPsAssociationNegativeTestJSON-296725392-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:23.855620 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-833d36b5-c778-419f-aa8d-89cf246685e3 tempest-FloatingIPsAssociationNegativeTestJSON-296725392 tempest-FloatingIPsAssociationNegativeTestJSON-296725392-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:23.856063 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-833d36b5-c778-419f-aa8d-89cf246685e3 tempest-FloatingIPsAssociationNegativeTestJSON-296725392 tempest-FloatingIPsAssociationNegativeTestJSON-296725392-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:23.856876 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-833d36b5-c778-419f-aa8d-89cf246685e3 tempest-FloatingIPsAssociationNegativeTestJSON-296725392 tempest-FloatingIPsAssociationNegativeTestJSON-296725392-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:23.857512 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-833d36b5-c778-419f-aa8d-89cf246685e3 tempest-FloatingIPsAssociationNegativeTestJSON-296725392 tempest-FloatingIPsAssociationNegativeTestJSON-296725392-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:23.858095 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-833d36b5-c778-419f-aa8d-89cf246685e3 tempest-FloatingIPsAssociationNegativeTestJSON-296725392 tempest-FloatingIPsAssociationNegativeTestJSON-296725392-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:23.863375 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.quota [None req-99c09e7a-c246-427f-b6f9-498538807984 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Getting quotas for project 86941784237549838bba63ce88053b88. Resources: {'server_groups'} {{(pid=121403) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 01 18:58:23.874828 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.quota [None req-99c09e7a-c246-427f-b6f9-498538807984 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Getting quotas for user 0290a6bb8bc24b8988a925327ac0381c and project 86941784237549838bba63ce88053b88. Resources: {'server_groups'} {{(pid=121403) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 01 18:58:23.931753 n-d-863052-2 devstack@n-api.service[121403]: DEBUG dbcounter [-] [121403] Writing DB stats nova_api:SELECT=98,nova_api:INSERT=2 {{(pid=121403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 18:58:23.937675 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-833d36b5-c778-419f-aa8d-89cf246685e3 tempest-FloatingIPsAssociationNegativeTestJSON-296725392 tempest-FloatingIPsAssociationNegativeTestJSON-296725392-project] Acquiring lock "refresh_cache-8e62f12b-8b96-414a-8099-0f9acb7fabf5" {{(pid=121402) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Nov 01 18:58:23.938772 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-833d36b5-c778-419f-aa8d-89cf246685e3 tempest-FloatingIPsAssociationNegativeTestJSON-296725392 tempest-FloatingIPsAssociationNegativeTestJSON-296725392-project] Acquired lock "refresh_cache-8e62f12b-8b96-414a-8099-0f9acb7fabf5" {{(pid=121402) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Nov 01 18:58:23.945490 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.quota [None req-99c09e7a-c246-427f-b6f9-498538807984 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Getting quotas for project 86941784237549838bba63ce88053b88. Resources: {'server_groups'} {{(pid=121403) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 01 18:58:23.951112 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.quota [None req-99c09e7a-c246-427f-b6f9-498538807984 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Getting quotas for user 0290a6bb8bc24b8988a925327ac0381c and project 86941784237549838bba63ce88053b88. Resources: {'server_groups'} {{(pid=121403) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 01 18:58:23.967343 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-99c09e7a-c246-427f-b6f9-498538807984 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] 10.222.0.13 "POST /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.168299 Nov 01 18:58:23.968322 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 577/1184] 10.222.0.13 () {60 vars in 1174 bytes} [Tue Nov 1 18:58:23 2022] POST /compute/v2.1/os-server-groups => generated 187 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 18:58:23.972943 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-6cf61ffd-ccfa-4eff-8565-4807a56f7117 tempest-LiveMigrationTest-1695240876 tempest-LiveMigrationTest-1695240876-project-admin] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:58:23.973556 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-6cf61ffd-ccfa-4eff-8565-4807a56f7117 tempest-LiveMigrationTest-1695240876 tempest-LiveMigrationTest-1695240876-project-admin] [instance: 2d525a31-b0be-44cb-8fb7-335075145f08] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:58:23.979655 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-6cf61ffd-ccfa-4eff-8565-4807a56f7117 tempest-LiveMigrationTest-1695240876 tempest-LiveMigrationTest-1695240876-project-admin] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:23.980326 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-6cf61ffd-ccfa-4eff-8565-4807a56f7117 tempest-LiveMigrationTest-1695240876 tempest-LiveMigrationTest-1695240876-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:23.981106 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-6cf61ffd-ccfa-4eff-8565-4807a56f7117 tempest-LiveMigrationTest-1695240876 tempest-LiveMigrationTest-1695240876-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:23.981490 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-6cf61ffd-ccfa-4eff-8565-4807a56f7117 tempest-LiveMigrationTest-1695240876 tempest-LiveMigrationTest-1695240876-project-admin] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:23.981945 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-6cf61ffd-ccfa-4eff-8565-4807a56f7117 tempest-LiveMigrationTest-1695240876 tempest-LiveMigrationTest-1695240876-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:23.982375 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-6cf61ffd-ccfa-4eff-8565-4807a56f7117 tempest-LiveMigrationTest-1695240876 tempest-LiveMigrationTest-1695240876-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:24.150473 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-6cf61ffd-ccfa-4eff-8565-4807a56f7117 tempest-LiveMigrationTest-1695240876 tempest-LiveMigrationTest-1695240876-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/2d525a31-b0be-44cb-8fb7-335075145f08" status: 200 len: 1859 microversion: 2.1 time: 0.180523 Nov 01 18:58:24.151077 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 578/1185] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:58:23 2022] GET /compute/v2.1/servers/2d525a31-b0be-44cb-8fb7-335075145f08 => generated 1859 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:58:24.168550 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-0d97149a-ffad-4fb0-abab-103add1a58cf tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:58:24.169217 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-0d97149a-ffad-4fb0-abab-103add1a58cf tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] [instance: 9249c81d-e57b-4985-a398-8ad97526d5c7] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:58:24.189421 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-0d97149a-ffad-4fb0-abab-103add1a58cf tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:24.190518 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-0d97149a-ffad-4fb0-abab-103add1a58cf tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:24.191023 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-0d97149a-ffad-4fb0-abab-103add1a58cf tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:24.191905 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-0d97149a-ffad-4fb0-abab-103add1a58cf tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:24.192521 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-0d97149a-ffad-4fb0-abab-103add1a58cf tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:24.193168 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-0d97149a-ffad-4fb0-abab-103add1a58cf tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:24.439805 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-0d97149a-ffad-4fb0-abab-103add1a58cf tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72117f17294649d6b8bc16c66c7efab2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45d4c047d3c44324a27a27831236ab0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:58:24.450803 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-0d97149a-ffad-4fb0-abab-103add1a58cf tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] 10.222.0.13 "GET /compute/v2.1/servers/9249c81d-e57b-4985-a398-8ad97526d5c7" status: 200 len: 1538 microversion: 2.1 time: 0.291910 Nov 01 18:58:24.461894 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 579/1186] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:58:24 2022] GET /compute/v2.1/servers/9249c81d-e57b-4985-a398-8ad97526d5c7 => generated 1538 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:58:24.468826 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-df42a369-d240-4c0d-88e7-1aed14bbda23 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1919309178", "imageRef": "2d4a0047-1b9e-445f-8af8-1b5c9d93e881", "flavorRef": "452", "min_count": 2, "return_reservation_id": true}, "os:scheduler_hints": {"group": "0265752b-95c4-4bf0-aec6-cb81e093d2ee"}} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 18:58:24.555985 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.network.neutron [None req-df42a369-d240-4c0d-88e7-1aed14bbda23 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] validate_networks() for None {{(pid=121403) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 01 18:58:24.619255 n-d-863052-2 devstack@n-api.service[121402]: DEBUG neutronclient.v2_0.client [None req-833d36b5-c778-419f-aa8d-89cf246685e3 tempest-FloatingIPsAssociationNegativeTestJSON-296725392 tempest-FloatingIPsAssociationNegativeTestJSON-296725392-project] Error message: {"NeutronError": {"type": "FloatingIPPortAlreadyAssociated", "message": "Cannot associate floating IP 172.25.8.234 (7d317ac1-2966-4ad5-98e3-e3629b8c4a62) with port 8b2113da-4763-4f79-99c9-989625f65d00 using fixed IP 172.20.0.12, as that fixed IP already has a floating IP on external network 3c6bfafa-c688-4384-8c54-de7825ea90b1.", "detail": ""}} {{(pid=121402) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Nov 01 18:58:24.619727 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-833d36b5-c778-419f-aa8d-89cf246685e3 tempest-FloatingIPsAssociationNegativeTestJSON-296725392 tempest-FloatingIPsAssociationNegativeTestJSON-296725392-project] Releasing lock "refresh_cache-8e62f12b-8b96-414a-8099-0f9acb7fabf5" {{(pid=121402) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Nov 01 18:58:24.620501 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.wsgi [None req-833d36b5-c778-419f-aa8d-89cf246685e3 tempest-FloatingIPsAssociationNegativeTestJSON-296725392 tempest-FloatingIPsAssociationNegativeTestJSON-296725392-project] HTTP exception thrown: Cannot associate floating IP 172.25.8.234 (7d317ac1-2966-4ad5-98e3-e3629b8c4a62) with port 8b2113da-4763-4f79-99c9-989625f65d00 using fixed IP 172.20.0.12, as that fixed IP already has a floating IP on external network 3c6bfafa-c688-4384-8c54-de7825ea90b1. Nov 01 18:58:24.620501 n-d-863052-2 devstack@n-api.service[121402]: Neutron server returns request_ids: ['req-4a4acbed-7ab7-438f-8dc8-aeef53aca87b'] Nov 01 18:58:24.622638 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-833d36b5-c778-419f-aa8d-89cf246685e3 tempest-FloatingIPsAssociationNegativeTestJSON-296725392 tempest-FloatingIPsAssociationNegativeTestJSON-296725392-project] Request method failure captured: Nov 01 18:58:24.622638 n-d-863052-2 devstack@n-api.service[121402]: request: POST /compute/v2.1/servers/8e62f12b-8b96-414a-8099-0f9acb7fabf5/action HTTP/1.1 Nov 01 18:58:24.622638 n-d-863052-2 devstack@n-api.service[121402]: Accept: application/json Nov 01 18:58:24.622638 n-d-863052-2 devstack@n-api.service[121402]: Accept-Encoding: identity Nov 01 18:58:24.622638 n-d-863052-2 devstack@n-api.service[121402]: Connection: close Nov 01 18:58:24.622638 n-d-863052-2 devstack@n-api.service[121402]: Content-Length: 46 Nov 01 18:58:24.622638 n-d-863052-2 devstack@n-api.service[121402]: Content-Type: application/json Nov 01 18:58:24.622638 n-d-863052-2 devstack@n-api.service[121402]: Host: 10.222.0.13 Nov 01 18:58:24.622638 n-d-863052-2 devstack@n-api.service[121402]: Openstack-System-Scope: None Nov 01 18:58:24.622638 n-d-863052-2 devstack@n-api.service[121402]: User-Agent: python-urllib3/1.26.12 Nov 01 18:58:24.622638 n-d-863052-2 devstack@n-api.service[121402]: X-Auth-Token: gAAAAABjYWw1SF5PPvMdN953udCJyfDa_Bfcqy7XVXpdqAKP1KG1AiUlssdsx9OB7pwmIJI0BFf9a3oyI_tT1BfoNA4axNUyVUKrPnNPLB3yEU3vYhuOsCWAaR_lCoKebniusNWQyFM6MZhXiwRWovoCjGCBPgyULskL-0T-0PDaS4BfSFiov1c Nov 01 18:58:24.622638 n-d-863052-2 devstack@n-api.service[121402]: X-Domain-Id: None Nov 01 18:58:24.622638 n-d-863052-2 devstack@n-api.service[121402]: X-Domain-Name: None Nov 01 18:58:24.622638 n-d-863052-2 devstack@n-api.service[121402]: X-Identity-Status: Confirmed Nov 01 18:58:24.622638 n-d-863052-2 devstack@n-api.service[121402]: X-Is-Admin-Project: True Nov 01 18:58:24.622638 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Domain-Id: default Nov 01 18:58:24.622638 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Domain-Name: Default Nov 01 18:58:24.622638 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Id: e3bd3f356d364e11b14d90d71cb5d598 Nov 01 18:58:24.622638 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-296725392 Nov 01 18:58:24.622638 n-d-863052-2 devstack@n-api.service[121402]: X-Role: member,reader Nov 01 18:58:24.622638 n-d-863052-2 devstack@n-api.service[121402]: X-Roles: member,reader Nov 01 18:58:24.624273 n-d-863052-2 devstack@n-api.service[121402]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/e3bd3f356d364e11b14d90d71cb5d598"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/e3bd3f356d364e11b14d90d71cb5d598"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_e3bd3f356d364e11b14d90d71cb5d598", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/e3bd3f356d364e11b14d90d71cb5d598"}]}] Nov 01 18:58:24.624273 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-296725392 Nov 01 18:58:24.624273 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant-Id: e3bd3f356d364e11b14d90d71cb5d598 Nov 01 18:58:24.624273 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-296725392 Nov 01 18:58:24.624273 n-d-863052-2 devstack@n-api.service[121402]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-296725392-project Nov 01 18:58:24.624273 n-d-863052-2 devstack@n-api.service[121402]: X-User-Domain-Id: default Nov 01 18:58:24.624273 n-d-863052-2 devstack@n-api.service[121402]: X-User-Domain-Name: Default Nov 01 18:58:24.624273 n-d-863052-2 devstack@n-api.service[121402]: X-User-Id: d40b11c70b8e40d0b7e7f5f7d2967184 Nov 01 18:58:24.624273 n-d-863052-2 devstack@n-api.service[121402]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-296725392-project Nov 01 18:58:24.624273 n-d-863052-2 devstack@n-api.service[121402]: Nov 01 18:58:24.624273 n-d-863052-2 devstack@n-api.service[121402]: {"addFloatingIp": {"address": "172.25.8.234"}} Nov 01 18:58:24.624273 n-d-863052-2 devstack@n-api.service[121402]: method: Nov 01 18:58:24.625259 n-d-863052-2 devstack@n-api.service[121402]: exception: Cannot associate floating IP 172.25.8.234 (7d317ac1-2966-4ad5-98e3-e3629b8c4a62) with port 8b2113da-4763-4f79-99c9-989625f65d00 using fixed IP 172.20.0.12, as that fixed IP already has a floating IP on external network 3c6bfafa-c688-4384-8c54-de7825ea90b1. Nov 01 18:58:24.625259 n-d-863052-2 devstack@n-api.service[121402]: Neutron server returns request_ids: ['req-4a4acbed-7ab7-438f-8dc8-aeef53aca87b'] Nov 01 18:58:24.625259 n-d-863052-2 devstack@n-api.service[121402]: action_args: {'id': '8e62f12b-8b96-414a-8099-0f9acb7fabf5', 'body': {'addFloatingIp': {'address': '172.25.8.234'}}} Nov 01 18:58:24.625259 n-d-863052-2 devstack@n-api.service[121402]: {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 01 18:58:24.625259 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:58:24.625259 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2703, in associate_floating_ip Nov 01 18:58:24.625259 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi client.update_floatingip(fip['id'], {'floatingip': param}) Nov 01 18:58:24.625259 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 01 18:58:24.625259 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 01 18:58:24.625259 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1016, in update_floatingip Nov 01 18:58:24.625259 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return self._update_resource(self.floatingip_path % (floatingip), Nov 01 18:58:24.625259 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 01 18:58:24.625259 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 01 18:58:24.625259 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 2548, in _update_resource Nov 01 18:58:24.625259 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return self.put(path, **kwargs) Nov 01 18:58:24.625259 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 01 18:58:24.625259 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 01 18:58:24.627292 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 365, in put Nov 01 18:58:24.627292 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return self.retry_request("PUT", action, body=body, Nov 01 18:58:24.627292 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 01 18:58:24.627292 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 01 18:58:24.627292 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 01 18:58:24.627292 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 01 18:58:24.627292 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 01 18:58:24.627292 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 01 18:58:24.627292 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Nov 01 18:58:24.627292 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Nov 01 18:58:24.627292 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 01 18:58:24.627292 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 01 18:58:24.627292 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Nov 01 18:58:24.627292 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Nov 01 18:58:24.627292 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Nov 01 18:58:24.627292 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Nov 01 18:58:24.628702 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Cannot associate floating IP 172.25.8.234 (7d317ac1-2966-4ad5-98e3-e3629b8c4a62) with port 8b2113da-4763-4f79-99c9-989625f65d00 using fixed IP 172.20.0.12, as that fixed IP already has a floating IP on external network 3c6bfafa-c688-4384-8c54-de7825ea90b1. Nov 01 18:58:24.628702 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4a4acbed-7ab7-438f-8dc8-aeef53aca87b'] Nov 01 18:58:24.628702 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 18:58:24.628702 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 18:58:24.628702 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 18:58:24.628702 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:58:24.628702 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 239, in _add_floating_ip Nov 01 18:58:24.628702 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi self.network_api.associate_floating_ip(context, instance, Nov 01 18:58:24.628702 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 165, in wrapper Nov 01 18:58:24.628702 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi res = f(self, context, *args, **kwargs) Nov 01 18:58:24.628702 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2705, in associate_floating_ip Nov 01 18:58:24.628702 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpAssociateFailed(str(e)) Nov 01 18:58:24.628702 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpAssociateFailed: Cannot associate floating IP 172.25.8.234 (7d317ac1-2966-4ad5-98e3-e3629b8c4a62) with port 8b2113da-4763-4f79-99c9-989625f65d00 using fixed IP 172.20.0.12, as that fixed IP already has a floating IP on external network 3c6bfafa-c688-4384-8c54-de7825ea90b1. Nov 01 18:58:24.628702 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4a4acbed-7ab7-438f-8dc8-aeef53aca87b'] Nov 01 18:58:24.628702 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 18:58:24.628702 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 18:58:24.630045 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 18:58:24.630045 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:58:24.630045 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 18:58:24.630045 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 18:58:24.630045 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 01 18:58:24.630045 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 01 18:58:24.630045 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 01 18:58:24.630045 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 01 18:58:24.630045 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 01 18:58:24.630045 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 01 18:58:24.630045 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 01 18:58:24.630045 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 01 18:58:24.630045 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 246, in _add_floating_ip Nov 01 18:58:24.630045 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=e.format_message()) Nov 01 18:58:24.630045 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Cannot associate floating IP 172.25.8.234 (7d317ac1-2966-4ad5-98e3-e3629b8c4a62) with port 8b2113da-4763-4f79-99c9-989625f65d00 using fixed IP 172.20.0.12, as that fixed IP already has a floating IP on external network 3c6bfafa-c688-4384-8c54-de7825ea90b1. Nov 01 18:58:24.630045 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4a4acbed-7ab7-438f-8dc8-aeef53aca87b'] Nov 01 18:58:24.630045 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 18:58:24.630045 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 18:58:24.631517 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 18:58:24.631517 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:58:24.631517 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 18:58:24.631517 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 18:58:24.631517 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 01 18:58:24.631517 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 01 18:58:24.631517 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot associate floating IP 172.25.8.234 (7d317ac1-2966-4ad5-98e3-e3629b8c4a62) with port 8b2113da-4763-4f79-99c9-989625f65d00 using fixed IP 172.20.0.12, as that fixed IP already has a floating IP on external network 3c6bfafa-c688-4384-8c54-de7825ea90b1. Nov 01 18:58:24.631517 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4a4acbed-7ab7-438f-8dc8-aeef53aca87b'] Nov 01 18:58:24.631517 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 18:58:24.631517 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-833d36b5-c778-419f-aa8d-89cf246685e3 tempest-FloatingIPsAssociationNegativeTestJSON-296725392 tempest-FloatingIPsAssociationNegativeTestJSON-296725392-project] Returning 400 to user: Cannot associate floating IP 172.25.8.234 (7d317ac1-2966-4ad5-98e3-e3629b8c4a62) with port 8b2113da-4763-4f79-99c9-989625f65d00 using fixed IP 172.20.0.12, as that fixed IP already has a floating IP on external network 3c6bfafa-c688-4384-8c54-de7825ea90b1. Nov 01 18:58:24.631517 n-d-863052-2 devstack@n-api.service[121402]: Neutron server returns request_ids: ['req-4a4acbed-7ab7-438f-8dc8-aeef53aca87b'] {{(pid=121402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 01 18:58:24.634607 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-833d36b5-c778-419f-aa8d-89cf246685e3 tempest-FloatingIPsAssociationNegativeTestJSON-296725392 tempest-FloatingIPsAssociationNegativeTestJSON-296725392-project] 10.222.0.13 "POST /compute/v2.1/servers/8e62f12b-8b96-414a-8099-0f9acb7fabf5/action" status: 400 len: 382 microversion: 2.1 time: 0.799889 Nov 01 18:58:24.634607 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 608/1187] 10.222.0.13 () {60 vars in 1278 bytes} [Tue Nov 1 18:58:23 2022] POST /compute/v2.1/servers/8e62f12b-8b96-414a-8099-0f9acb7fabf5/action => generated 382 bytes in 808 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 01 18:58:24.637677 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-dcd78480-5ba7-4769-a116-be9f081c2fd4 tempest-LiveMigrationTest-1695240876 tempest-LiveMigrationTest-1695240876-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-863052-2", "block_migration": true, "disk_over_commit": false}} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 18:58:24.640451 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-dcd78480-5ba7-4769-a116-be9f081c2fd4 tempest-LiveMigrationTest-1695240876 tempest-LiveMigrationTest-1695240876-project-admin] [instance: 2d525a31-b0be-44cb-8fb7-335075145f08] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:58:24.671319 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-dcd78480-5ba7-4769-a116-be9f081c2fd4 tempest-LiveMigrationTest-1695240876 tempest-LiveMigrationTest-1695240876-project-admin] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:24.671821 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-dcd78480-5ba7-4769-a116-be9f081c2fd4 tempest-LiveMigrationTest-1695240876 tempest-LiveMigrationTest-1695240876-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:24.672329 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-dcd78480-5ba7-4769-a116-be9f081c2fd4 tempest-LiveMigrationTest-1695240876 tempest-LiveMigrationTest-1695240876-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:24.673085 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-dcd78480-5ba7-4769-a116-be9f081c2fd4 tempest-LiveMigrationTest-1695240876 tempest-LiveMigrationTest-1695240876-project-admin] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:24.673543 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-dcd78480-5ba7-4769-a116-be9f081c2fd4 tempest-LiveMigrationTest-1695240876 tempest-LiveMigrationTest-1695240876-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:24.674010 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-dcd78480-5ba7-4769-a116-be9f081c2fd4 tempest-LiveMigrationTest-1695240876 tempest-LiveMigrationTest-1695240876-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:24.712400 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.objects.instance [None req-dcd78480-5ba7-4769-a116-be9f081c2fd4 tempest-LiveMigrationTest-1695240876 tempest-LiveMigrationTest-1695240876-project-admin] Lazy-loading 'flavor' on Instance uuid 2d525a31-b0be-44cb-8fb7-335075145f08 {{(pid=121402) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 01 18:58:24.732040 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-dcd78480-5ba7-4769-a116-be9f081c2fd4 tempest-LiveMigrationTest-1695240876 tempest-LiveMigrationTest-1695240876-project-admin] [instance: 2d525a31-b0be-44cb-8fb7-335075145f08] Going to try to live migrate instance to n-h2-863052-2 {{(pid=121402) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Nov 01 18:58:24.869428 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.virt.hardware [None req-df42a369-d240-4c0d-88e7-1aed14bbda23 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Flavor limits 0:0:0 {{(pid=121403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 01 18:58:24.870087 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.virt.hardware [None req-df42a369-d240-4c0d-88e7-1aed14bbda23 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Image limits 0:0:0 {{(pid=121403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 01 18:58:24.870729 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.virt.hardware [None req-df42a369-d240-4c0d-88e7-1aed14bbda23 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Flavor pref 0:0:0 {{(pid=121403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 01 18:58:24.871308 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.virt.hardware [None req-df42a369-d240-4c0d-88e7-1aed14bbda23 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Image pref 0:0:0 {{(pid=121403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 01 18:58:24.871881 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.virt.hardware [None req-df42a369-d240-4c0d-88e7-1aed14bbda23 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 01 18:58:24.902406 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-df42a369-d240-4c0d-88e7-1aed14bbda23 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:24.903237 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-df42a369-d240-4c0d-88e7-1aed14bbda23 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:24.903869 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-df42a369-d240-4c0d-88e7-1aed14bbda23 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:24.906475 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-df42a369-d240-4c0d-88e7-1aed14bbda23 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:24.907205 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-df42a369-d240-4c0d-88e7-1aed14bbda23 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:24.907741 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-df42a369-d240-4c0d-88e7-1aed14bbda23 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:24.934101 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.quota [None req-df42a369-d240-4c0d-88e7-1aed14bbda23 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Getting quotas for project 86941784237549838bba63ce88053b88. Resources: {'cores', 'ram', 'instances'} {{(pid=121403) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 01 18:58:24.940677 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.quota [None req-df42a369-d240-4c0d-88e7-1aed14bbda23 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Getting quotas for user 0290a6bb8bc24b8988a925327ac0381c and project 86941784237549838bba63ce88053b88. Resources: {'cores', 'ram', 'instances'} {{(pid=121403) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 01 18:58:24.953294 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-df42a369-d240-4c0d-88e7-1aed14bbda23 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Going to run 2 instances... {{(pid=121403) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 01 18:58:24.955650 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-df42a369-d240-4c0d-88e7-1aed14bbda23 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] [instance: efdf10ba-60d4-4fb0-970d-109a8f936808] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2d4a0047-1b9e-445f-8af8-1b5c9d93e881',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121403) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 01 18:58:24.997248 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.quota [None req-df42a369-d240-4c0d-88e7-1aed14bbda23 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Checking whether user_id and queued_for_delete are populated for all projects {{(pid=121403) is_qfd_populated /opt/stack/nova/nova/quota.py:1268}} Nov 01 18:58:25.021483 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.quota [None req-df42a369-d240-4c0d-88e7-1aed14bbda23 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Getting quotas for project 86941784237549838bba63ce88053b88. Resources: {'server_group_members'} {{(pid=121403) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 01 18:58:25.028868 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.quota [None req-df42a369-d240-4c0d-88e7-1aed14bbda23 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Getting quotas for user 0290a6bb8bc24b8988a925327ac0381c and project 86941784237549838bba63ce88053b88. Resources: {'server_group_members'} {{(pid=121403) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 01 18:58:25.073419 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.quota [None req-df42a369-d240-4c0d-88e7-1aed14bbda23 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Getting quotas for project 86941784237549838bba63ce88053b88. Resources: {'server_group_members'} {{(pid=121403) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 01 18:58:25.078497 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.quota [None req-df42a369-d240-4c0d-88e7-1aed14bbda23 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Getting quotas for user 0290a6bb8bc24b8988a925327ac0381c and project 86941784237549838bba63ce88053b88. Resources: {'server_group_members'} {{(pid=121403) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 01 18:58:25.092701 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-df42a369-d240-4c0d-88e7-1aed14bbda23 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] [instance: 9dbe3d05-9fa8-4fd2-8415-52bfe6ee5801] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2d4a0047-1b9e-445f-8af8-1b5c9d93e881',instance=,instance_uuid=efdf10ba-60d4-4fb0-970d-109a8f936808,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121403) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 01 18:58:25.143395 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.quota [None req-df42a369-d240-4c0d-88e7-1aed14bbda23 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Getting quotas for project 86941784237549838bba63ce88053b88. Resources: {'server_group_members'} {{(pid=121403) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 01 18:58:25.148891 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.quota [None req-df42a369-d240-4c0d-88e7-1aed14bbda23 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Getting quotas for user 0290a6bb8bc24b8988a925327ac0381c and project 86941784237549838bba63ce88053b88. Resources: {'server_group_members'} {{(pid=121403) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 01 18:58:25.185887 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.quota [None req-df42a369-d240-4c0d-88e7-1aed14bbda23 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Getting quotas for project 86941784237549838bba63ce88053b88. Resources: {'server_group_members'} {{(pid=121403) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 01 18:58:25.192621 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.quota [None req-df42a369-d240-4c0d-88e7-1aed14bbda23 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Getting quotas for user 0290a6bb8bc24b8988a925327ac0381c and project 86941784237549838bba63ce88053b88. Resources: {'server_group_members'} {{(pid=121403) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 01 18:58:25.231274 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-df42a369-d240-4c0d-88e7-1aed14bbda23 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 0.768015 Nov 01 18:58:25.232086 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 580/1188] 10.222.0.13 () {60 vars in 1147 bytes} [Tue Nov 1 18:58:24 2022] POST /compute/v2.1/servers => generated 32 bytes in 770 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Nov 01 18:58:25.239351 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-e52ae670-153b-40a3-87fb-9c2594113778 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:58:25.240225 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-e52ae670-153b-40a3-87fb-9c2594113778 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] [instance: ea631032-dd04-429b-988e-e6362ea42cf7] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:58:25.247883 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-e52ae670-153b-40a3-87fb-9c2594113778 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:25.248422 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-e52ae670-153b-40a3-87fb-9c2594113778 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:25.248971 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-e52ae670-153b-40a3-87fb-9c2594113778 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:25.249765 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-e52ae670-153b-40a3-87fb-9c2594113778 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:25.250354 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-e52ae670-153b-40a3-87fb-9c2594113778 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:25.250895 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-e52ae670-153b-40a3-87fb-9c2594113778 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:25.385907 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-e52ae670-153b-40a3-87fb-9c2594113778 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c1314c21d8547ff890ede1c2ad281c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c804370880454c7aa02cef2c2c3cf144', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:58:25.398018 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-e52ae670-153b-40a3-87fb-9c2594113778 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c1314c21d8547ff890ede1c2ad281c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c804370880454c7aa02cef2c2c3cf144', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:58:25.399484 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-e52ae670-153b-40a3-87fb-9c2594113778 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c1314c21d8547ff890ede1c2ad281c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c804370880454c7aa02cef2c2c3cf144', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:58:25.414036 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-e52ae670-153b-40a3-87fb-9c2594113778 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] 10.222.0.13 "GET /compute/v2.1/servers/ea631032-dd04-429b-988e-e6362ea42cf7" status: 200 len: 1553 microversion: 2.91 time: 0.178205 Nov 01 18:58:25.414825 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 581/1189] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 18:58:25 2022] GET /compute/v2.1/servers/ea631032-dd04-429b-988e-e6362ea42cf7 => generated 1553 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 18:58:25.430835 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-0ed3fe88-4edd-4ef4-990f-310995ef84c8 tempest-FloatingIPsAssociationNegativeTestJSON-296725392 tempest-FloatingIPsAssociationNegativeTestJSON-296725392-project] Calling method '.version_select at 0x7f0ae67e38b0>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:58:27.238700 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-dcd78480-5ba7-4769-a116-be9f081c2fd4 tempest-LiveMigrationTest-1695240876 tempest-LiveMigrationTest-1695240876-project-admin] 10.222.0.13 "POST /compute/v2.1/servers/2d525a31-b0be-44cb-8fb7-335075145f08/action" status: 202 len: 0 microversion: 2.1 time: 2.606092 Nov 01 18:58:27.239641 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 609/1190] 10.222.0.13 () {60 vars in 1278 bytes} [Tue Nov 1 18:58:24 2022] POST /compute/v2.1/servers/2d525a31-b0be-44cb-8fb7-335075145f08/action => generated 0 bytes in 2608 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 01 18:58:27.245226 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-cd7a77fd-cde8-46c0-98b2-66320a1cdf26 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:58:27.245640 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-cd7a77fd-cde8-46c0-98b2-66320a1cdf26 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] [instance: 869ca597-f199-474f-a680-59b0a75512c7] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:58:27.253699 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-cd7a77fd-cde8-46c0-98b2-66320a1cdf26 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:27.254193 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-cd7a77fd-cde8-46c0-98b2-66320a1cdf26 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:27.254632 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-cd7a77fd-cde8-46c0-98b2-66320a1cdf26 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:27.255340 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-cd7a77fd-cde8-46c0-98b2-66320a1cdf26 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:27.255990 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-cd7a77fd-cde8-46c0-98b2-66320a1cdf26 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:27.256416 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-cd7a77fd-cde8-46c0-98b2-66320a1cdf26 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:27.335236 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-0ed3fe88-4edd-4ef4-990f-310995ef84c8 tempest-FloatingIPsAssociationNegativeTestJSON-296725392 tempest-FloatingIPsAssociationNegativeTestJSON-296725392-project] 10.222.0.13 "DELETE /compute/v2.1/os-floating-ips/7d317ac1-2966-4ad5-98e3-e3629b8c4a62" status: 202 len: 0 microversion: 2.1 time: 1.919523 Nov 01 18:58:27.336488 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 582/1191] 10.222.0.13 () {58 vars in 1263 bytes} [Tue Nov 1 18:58:25 2022] DELETE /compute/v2.1/os-floating-ips/7d317ac1-2966-4ad5-98e3-e3629b8c4a62 => generated 0 bytes in 1921 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 01 18:58:27.342386 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-2e0660d4-cb37-45dc-9b6e-70c1168e6250 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:58:27.343259 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-2e0660d4-cb37-45dc-9b6e-70c1168e6250 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] [instance: eebaed86-332c-47dc-af0f-f37e9b69d52f] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:58:27.351287 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-2e0660d4-cb37-45dc-9b6e-70c1168e6250 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:27.352619 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-2e0660d4-cb37-45dc-9b6e-70c1168e6250 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:27.353748 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-2e0660d4-cb37-45dc-9b6e-70c1168e6250 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:27.354579 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-2e0660d4-cb37-45dc-9b6e-70c1168e6250 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:27.355473 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-2e0660d4-cb37-45dc-9b6e-70c1168e6250 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:27.356007 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-2e0660d4-cb37-45dc-9b6e-70c1168e6250 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:27.399562 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-cd7a77fd-cde8-46c0-98b2-66320a1cdf26 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a63d69c99a546f0af16329cff3ca717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a1bb191cff948e99c008b5e861ce4a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:58:27.408403 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-cd7a77fd-cde8-46c0-98b2-66320a1cdf26 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] 10.222.0.13 "GET /compute/v2.1/servers/869ca597-f199-474f-a680-59b0a75512c7" status: 200 len: 1520 microversion: 2.1 time: 0.167631 Nov 01 18:58:27.424112 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 610/1192] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:58:27 2022] GET /compute/v2.1/servers/869ca597-f199-474f-a680-59b0a75512c7 => generated 1520 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:58:27.424112 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-1ce79497-6374-46ff-afab-571fa5b8c2e5 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:58:27.424112 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-1ce79497-6374-46ff-afab-571fa5b8c2e5 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0290a6bb8bc24b8988a925327ac0381c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86941784237549838bba63ce88053b88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:58:27.424112 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-1ce79497-6374-46ff-afab-571fa5b8c2e5 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Searching by: {'deleted': False, 'project_id': '86941784237549838bba63ce88053b88'} {{(pid=121402) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 01 18:58:27.427987 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-1ce79497-6374-46ff-afab-571fa5b8c2e5 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:27.428501 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-1ce79497-6374-46ff-afab-571fa5b8c2e5 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:27.428938 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-1ce79497-6374-46ff-afab-571fa5b8c2e5 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:27.429767 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-1ce79497-6374-46ff-afab-571fa5b8c2e5 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:27.430333 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-1ce79497-6374-46ff-afab-571fa5b8c2e5 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:27.430830 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-1ce79497-6374-46ff-afab-571fa5b8c2e5 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:27.498265 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-2e0660d4-cb37-45dc-9b6e-70c1168e6250 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b52b7dcbb044f9bfc424e4417c77fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '708bc0ea4b5a4baf81933725792bedd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:58:27.506587 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-2e0660d4-cb37-45dc-9b6e-70c1168e6250 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] 10.222.0.13 "GET /compute/v2.1/servers/eebaed86-332c-47dc-af0f-f37e9b69d52f" status: 200 len: 1523 microversion: 2.1 time: 0.168888 Nov 01 18:58:27.507166 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 583/1193] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:58:27 2022] GET /compute/v2.1/servers/eebaed86-332c-47dc-af0f-f37e9b69d52f => generated 1523 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:58:27.511690 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-4e76097e-9526-4889-8756-c243fe37e8e7 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:58:27.512290 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-4e76097e-9526-4889-8756-c243fe37e8e7 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] [instance: 9249c81d-e57b-4985-a398-8ad97526d5c7] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:58:27.518653 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-4e76097e-9526-4889-8756-c243fe37e8e7 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:27.519141 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-4e76097e-9526-4889-8756-c243fe37e8e7 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:27.519604 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-4e76097e-9526-4889-8756-c243fe37e8e7 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:27.520293 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-4e76097e-9526-4889-8756-c243fe37e8e7 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:27.520832 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-4e76097e-9526-4889-8756-c243fe37e8e7 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:27.521266 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-4e76097e-9526-4889-8756-c243fe37e8e7 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:27.527779 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.multi_cell_list [None req-1ce79497-6374-46ff-afab-571fa5b8c2e5 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=121402) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 01 18:58:27.663404 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-4e76097e-9526-4889-8756-c243fe37e8e7 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72117f17294649d6b8bc16c66c7efab2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45d4c047d3c44324a27a27831236ab0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:58:27.671578 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-4e76097e-9526-4889-8756-c243fe37e8e7 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] 10.222.0.13 "GET /compute/v2.1/servers/9249c81d-e57b-4985-a398-8ad97526d5c7" status: 200 len: 1543 microversion: 2.1 time: 0.163354 Nov 01 18:58:27.672166 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 584/1194] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:58:27 2022] GET /compute/v2.1/servers/9249c81d-e57b-4985-a398-8ad97526d5c7 => generated 1543 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:58:27.677569 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-68c2c8f1-6d88-44fe-8416-f18752cfe79b tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:58:27.678177 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-68c2c8f1-6d88-44fe-8416-f18752cfe79b tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] [instance: ea631032-dd04-429b-988e-e6362ea42cf7] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:58:27.684952 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-68c2c8f1-6d88-44fe-8416-f18752cfe79b tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:27.685448 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-68c2c8f1-6d88-44fe-8416-f18752cfe79b tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:27.686095 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-68c2c8f1-6d88-44fe-8416-f18752cfe79b tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:27.686809 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-68c2c8f1-6d88-44fe-8416-f18752cfe79b tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:27.687520 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-68c2c8f1-6d88-44fe-8416-f18752cfe79b tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:27.687946 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-68c2c8f1-6d88-44fe-8416-f18752cfe79b tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:27.764038 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-68c2c8f1-6d88-44fe-8416-f18752cfe79b tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c1314c21d8547ff890ede1c2ad281c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c804370880454c7aa02cef2c2c3cf144', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:58:27.773727 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-68c2c8f1-6d88-44fe-8416-f18752cfe79b tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c1314c21d8547ff890ede1c2ad281c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c804370880454c7aa02cef2c2c3cf144', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:58:27.775213 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-68c2c8f1-6d88-44fe-8416-f18752cfe79b tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c1314c21d8547ff890ede1c2ad281c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c804370880454c7aa02cef2c2c3cf144', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:58:27.780908 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-68c2c8f1-6d88-44fe-8416-f18752cfe79b tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] 10.222.0.13 "GET /compute/v2.1/servers/ea631032-dd04-429b-988e-e6362ea42cf7" status: 200 len: 1535 microversion: 2.91 time: 0.107082 Nov 01 18:58:27.781491 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 585/1195] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 18:58:27 2022] GET /compute/v2.1/servers/ea631032-dd04-429b-988e-e6362ea42cf7 => generated 1535 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 18:58:27.787015 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-158545b2-1a09-4a1c-8552-8a231596f781 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fa605d49-a0c2-49cc-9e9b-f7325776aa31", "device": "/dev/xvdb"}} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 18:58:27.789893 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-158545b2-1a09-4a1c-8552-8a231596f781 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] [instance: a7f88d19-08ee-47bf-9240-7d49afd775e2] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:58:27.796162 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-158545b2-1a09-4a1c-8552-8a231596f781 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:27.796900 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-158545b2-1a09-4a1c-8552-8a231596f781 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:27.798188 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-158545b2-1a09-4a1c-8552-8a231596f781 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:27.799206 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-158545b2-1a09-4a1c-8552-8a231596f781 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:27.799818 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-158545b2-1a09-4a1c-8552-8a231596f781 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:27.800400 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-158545b2-1a09-4a1c-8552-8a231596f781 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:27.817775 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-1ce79497-6374-46ff-afab-571fa5b8c2e5 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] 10.222.0.13 "GET /compute/v2.1/servers" status: 200 len: 1004 microversion: 2.1 time: 0.407697 Nov 01 18:58:27.818371 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 611/1196] 10.222.0.13 () {58 vars in 1125 bytes} [Tue Nov 1 18:58:27 2022] GET /compute/v2.1/servers => generated 1004 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:58:27.822997 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-df3b4f35-c39b-4aee-8e39-e3ca146ea638 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:58:27.823602 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-df3b4f35-c39b-4aee-8e39-e3ca146ea638 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] [instance: 2d525a31-b0be-44cb-8fb7-335075145f08] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:58:27.829900 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-df3b4f35-c39b-4aee-8e39-e3ca146ea638 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:27.830396 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-df3b4f35-c39b-4aee-8e39-e3ca146ea638 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:27.830833 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-df3b4f35-c39b-4aee-8e39-e3ca146ea638 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:27.831528 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-df3b4f35-c39b-4aee-8e39-e3ca146ea638 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:27.832093 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-df3b4f35-c39b-4aee-8e39-e3ca146ea638 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:27.832398 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-df3b4f35-c39b-4aee-8e39-e3ca146ea638 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:27.959965 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-df3b4f35-c39b-4aee-8e39-e3ca146ea638 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f32f5fba1976432d938e664c7714e52b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b9d4c236b944f9b2e8e502a50a8f8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:58:27.968138 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-df3b4f35-c39b-4aee-8e39-e3ca146ea638 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] 10.222.0.13 "GET /compute/v2.1/servers/2d525a31-b0be-44cb-8fb7-335075145f08" status: 200 len: 1718 microversion: 2.1 time: 0.148761 Nov 01 18:58:27.968717 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 612/1197] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:58:27 2022] GET /compute/v2.1/servers/2d525a31-b0be-44cb-8fb7-335075145f08 => generated 1718 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:58:27.973799 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-fab2266d-979f-4f4a-af07-921ac100a403 tempest-FloatingIPsAssociationNegativeTestJSON-296725392 tempest-FloatingIPsAssociationNegativeTestJSON-296725392-project] Action: 'action', calling method: .version_select at 0x7f0ae4c270d0>, body: {"removeFloatingIp": {"address": "172.25.8.124"}} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 18:58:28.113673 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-fab2266d-979f-4f4a-af07-921ac100a403 tempest-FloatingIPsAssociationNegativeTestJSON-296725392 tempest-FloatingIPsAssociationNegativeTestJSON-296725392-project] [instance: 8e62f12b-8b96-414a-8099-0f9acb7fabf5] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:58:28.123068 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-fab2266d-979f-4f4a-af07-921ac100a403 tempest-FloatingIPsAssociationNegativeTestJSON-296725392 tempest-FloatingIPsAssociationNegativeTestJSON-296725392-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:28.123925 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-fab2266d-979f-4f4a-af07-921ac100a403 tempest-FloatingIPsAssociationNegativeTestJSON-296725392 tempest-FloatingIPsAssociationNegativeTestJSON-296725392-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:28.124713 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-fab2266d-979f-4f4a-af07-921ac100a403 tempest-FloatingIPsAssociationNegativeTestJSON-296725392 tempest-FloatingIPsAssociationNegativeTestJSON-296725392-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:28.125750 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-fab2266d-979f-4f4a-af07-921ac100a403 tempest-FloatingIPsAssociationNegativeTestJSON-296725392 tempest-FloatingIPsAssociationNegativeTestJSON-296725392-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:28.126530 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-fab2266d-979f-4f4a-af07-921ac100a403 tempest-FloatingIPsAssociationNegativeTestJSON-296725392 tempest-FloatingIPsAssociationNegativeTestJSON-296725392-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:28.127048 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-fab2266d-979f-4f4a-af07-921ac100a403 tempest-FloatingIPsAssociationNegativeTestJSON-296725392 tempest-FloatingIPsAssociationNegativeTestJSON-296725392-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:28.252879 n-d-863052-2 devstack@n-api.service[121403]: DEBUG dbcounter [-] [121403] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=121403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 18:58:28.487126 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-fab2266d-979f-4f4a-af07-921ac100a403 tempest-FloatingIPsAssociationNegativeTestJSON-296725392 tempest-FloatingIPsAssociationNegativeTestJSON-296725392-project] Acquiring lock "refresh_cache-8e62f12b-8b96-414a-8099-0f9acb7fabf5" {{(pid=121402) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Nov 01 18:58:28.488282 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-fab2266d-979f-4f4a-af07-921ac100a403 tempest-FloatingIPsAssociationNegativeTestJSON-296725392 tempest-FloatingIPsAssociationNegativeTestJSON-296725392-project] Acquired lock "refresh_cache-8e62f12b-8b96-414a-8099-0f9acb7fabf5" {{(pid=121402) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Nov 01 18:58:28.498710 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-158545b2-1a09-4a1c-8552-8a231596f781 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] 10.222.0.13 "POST /compute/v2.1/servers/a7f88d19-08ee-47bf-9240-7d49afd775e2/os-volume_attachments" status: 200 len: 194 microversion: 2.25 time: 0.712448 Nov 01 18:58:28.500173 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 586/1198] 10.222.0.13 () {62 vars in 1364 bytes} [Tue Nov 1 18:58:27 2022] POST /compute/v2.1/servers/a7f88d19-08ee-47bf-9240-7d49afd775e2/os-volume_attachments => generated 194 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 01 18:58:28.509788 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-1d1fdba1-3514-4c44-ba13-431c65736c0d tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:58:28.511026 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-1d1fdba1-3514-4c44-ba13-431c65736c0d tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] [instance: eebaed86-332c-47dc-af0f-f37e9b69d52f] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:58:28.515017 n-d-863052-2 devstack@n-api.service[121403]: DEBUG dbcounter [-] [121403] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=8 {{(pid=121403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 18:58:28.521402 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-1d1fdba1-3514-4c44-ba13-431c65736c0d tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:28.522195 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-1d1fdba1-3514-4c44-ba13-431c65736c0d tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:28.523094 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-1d1fdba1-3514-4c44-ba13-431c65736c0d tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:28.524556 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-1d1fdba1-3514-4c44-ba13-431c65736c0d tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:28.525392 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-1d1fdba1-3514-4c44-ba13-431c65736c0d tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:28.526328 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-1d1fdba1-3514-4c44-ba13-431c65736c0d tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:28.575459 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-1d1fdba1-3514-4c44-ba13-431c65736c0d tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] [instance: eebaed86-332c-47dc-af0f-f37e9b69d52f] Going to try to terminate instance {{(pid=121403) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 01 18:58:28.685226 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-1d1fdba1-3514-4c44-ba13-431c65736c0d tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] 10.222.0.13 "DELETE /compute/v2.1/servers/eebaed86-332c-47dc-af0f-f37e9b69d52f" status: 204 len: 0 microversion: 2.1 time: 0.181543 Nov 01 18:58:28.685816 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 587/1199] 10.222.0.13 () {58 vars in 1239 bytes} [Tue Nov 1 18:58:28 2022] DELETE /compute/v2.1/servers/eebaed86-332c-47dc-af0f-f37e9b69d52f => generated 0 bytes in 185 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 01 18:58:28.698762 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-fa9bce73-2484-4654-88b7-330e42814795 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:58:28.700522 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-fa9bce73-2484-4654-88b7-330e42814795 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] [instance: 9dbe3d05-9fa8-4fd2-8415-52bfe6ee5801] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:58:28.712308 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-fa9bce73-2484-4654-88b7-330e42814795 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:28.712842 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-fa9bce73-2484-4654-88b7-330e42814795 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:28.713545 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-fa9bce73-2484-4654-88b7-330e42814795 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:28.714279 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-fa9bce73-2484-4654-88b7-330e42814795 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:28.714891 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-fa9bce73-2484-4654-88b7-330e42814795 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:28.715351 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-fa9bce73-2484-4654-88b7-330e42814795 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:28.814434 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-fa9bce73-2484-4654-88b7-330e42814795 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0290a6bb8bc24b8988a925327ac0381c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86941784237549838bba63ce88053b88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:58:28.822379 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-fa9bce73-2484-4654-88b7-330e42814795 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] 10.222.0.13 "GET /compute/v2.1/servers/9dbe3d05-9fa8-4fd2-8415-52bfe6ee5801" status: 200 len: 1271 microversion: 2.1 time: 0.132164 Nov 01 18:58:28.823034 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 588/1200] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:58:28 2022] GET /compute/v2.1/servers/9dbe3d05-9fa8-4fd2-8415-52bfe6ee5801 => generated 1271 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:58:28.839934 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-b4b0d202-b6f6-4af2-a1d8-6eb953f22085 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:58:28.840646 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-b4b0d202-b6f6-4af2-a1d8-6eb953f22085 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] [instance: 869ca597-f199-474f-a680-59b0a75512c7] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:58:28.846972 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-b4b0d202-b6f6-4af2-a1d8-6eb953f22085 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:28.847544 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-b4b0d202-b6f6-4af2-a1d8-6eb953f22085 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:28.847991 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-b4b0d202-b6f6-4af2-a1d8-6eb953f22085 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:28.848858 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-b4b0d202-b6f6-4af2-a1d8-6eb953f22085 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:28.849389 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-b4b0d202-b6f6-4af2-a1d8-6eb953f22085 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:28.849884 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-b4b0d202-b6f6-4af2-a1d8-6eb953f22085 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:29.173610 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-b4b0d202-b6f6-4af2-a1d8-6eb953f22085 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a63d69c99a546f0af16329cff3ca717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a1bb191cff948e99c008b5e861ce4a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:58:29.183280 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-b4b0d202-b6f6-4af2-a1d8-6eb953f22085 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] 10.222.0.13 "GET /compute/v2.1/servers/869ca597-f199-474f-a680-59b0a75512c7" status: 200 len: 1520 microversion: 2.1 time: 0.347112 Nov 01 18:58:29.183864 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 589/1201] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:58:28 2022] GET /compute/v2.1/servers/869ca597-f199-474f-a680-59b0a75512c7 => generated 1520 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:58:29.189970 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-82fd75f5-1bfe-4790-93a1-783b16146a57 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:58:29.190815 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-82fd75f5-1bfe-4790-93a1-783b16146a57 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] [instance: eebaed86-332c-47dc-af0f-f37e9b69d52f] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:58:29.196798 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-82fd75f5-1bfe-4790-93a1-783b16146a57 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:29.197616 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-82fd75f5-1bfe-4790-93a1-783b16146a57 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:29.198219 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-82fd75f5-1bfe-4790-93a1-783b16146a57 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:29.199082 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-82fd75f5-1bfe-4790-93a1-783b16146a57 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:29.199691 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-82fd75f5-1bfe-4790-93a1-783b16146a57 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:29.200298 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-82fd75f5-1bfe-4790-93a1-783b16146a57 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:29.263316 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.network.neutron [None req-fab2266d-979f-4f4a-af07-921ac100a403 tempest-FloatingIPsAssociationNegativeTestJSON-296725392 tempest-FloatingIPsAssociationNegativeTestJSON-296725392-project] [instance: 8e62f12b-8b96-414a-8099-0f9acb7fabf5] Building network info cache for instance {{(pid=121402) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Nov 01 18:58:29.580774 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-82fd75f5-1bfe-4790-93a1-783b16146a57 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b52b7dcbb044f9bfc424e4417c77fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '708bc0ea4b5a4baf81933725792bedd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:58:29.597884 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-82fd75f5-1bfe-4790-93a1-783b16146a57 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] 10.222.0.13 "GET /compute/v2.1/servers/eebaed86-332c-47dc-af0f-f37e9b69d52f" status: 200 len: 1529 microversion: 2.1 time: 0.412810 Nov 01 18:58:29.598747 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 590/1202] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:58:29 2022] GET /compute/v2.1/servers/eebaed86-332c-47dc-af0f-f37e9b69d52f => generated 1529 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:58:29.619630 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-34e8ae2e-8216-484d-bd4f-2b2d137b4fcb tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:58:29.620487 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-34e8ae2e-8216-484d-bd4f-2b2d137b4fcb tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] [instance: 9249c81d-e57b-4985-a398-8ad97526d5c7] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:58:29.627095 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-34e8ae2e-8216-484d-bd4f-2b2d137b4fcb tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:29.627797 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-34e8ae2e-8216-484d-bd4f-2b2d137b4fcb tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:29.628402 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-34e8ae2e-8216-484d-bd4f-2b2d137b4fcb tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:29.629299 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-34e8ae2e-8216-484d-bd4f-2b2d137b4fcb tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:29.629930 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-34e8ae2e-8216-484d-bd4f-2b2d137b4fcb tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:29.630502 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-34e8ae2e-8216-484d-bd4f-2b2d137b4fcb tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:29.868836 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.network.neutron [None req-fab2266d-979f-4f4a-af07-921ac100a403 tempest-FloatingIPsAssociationNegativeTestJSON-296725392 tempest-FloatingIPsAssociationNegativeTestJSON-296725392-project] [instance: 8e62f12b-8b96-414a-8099-0f9acb7fabf5] Updating instance_info_cache with network_info: [{"id": "8b2113da-4763-4f79-99c9-989625f65d00", "address": "fa:16:3e:77:c8:88", "network": {"id": "86bacc2f-968e-47bf-8353-16e36ae733f8", "bridge": null, "label": "tempest-FloatingIPsAssociationNegativeTestJSON-1151086199-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "e3bd3f356d364e11b14d90d71cb5d598", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap8b2113da-47", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=121402) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Nov 01 18:58:29.928475 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-fab2266d-979f-4f4a-af07-921ac100a403 tempest-FloatingIPsAssociationNegativeTestJSON-296725392 tempest-FloatingIPsAssociationNegativeTestJSON-296725392-project] Releasing lock "refresh_cache-8e62f12b-8b96-414a-8099-0f9acb7fabf5" {{(pid=121402) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Nov 01 18:58:29.929920 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-fab2266d-979f-4f4a-af07-921ac100a403 tempest-FloatingIPsAssociationNegativeTestJSON-296725392 tempest-FloatingIPsAssociationNegativeTestJSON-296725392-project] 10.222.0.13 "POST /compute/v2.1/servers/8e62f12b-8b96-414a-8099-0f9acb7fabf5/action" status: 202 len: 0 microversion: 2.1 time: 1.960124 Nov 01 18:58:29.930721 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-34e8ae2e-8216-484d-bd4f-2b2d137b4fcb tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72117f17294649d6b8bc16c66c7efab2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45d4c047d3c44324a27a27831236ab0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:58:29.931840 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 613/1203] 10.222.0.13 () {60 vars in 1278 bytes} [Tue Nov 1 18:58:27 2022] POST /compute/v2.1/servers/8e62f12b-8b96-414a-8099-0f9acb7fabf5/action => generated 0 bytes in 1962 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Nov 01 18:58:29.944098 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-34e8ae2e-8216-484d-bd4f-2b2d137b4fcb tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] 10.222.0.13 "GET /compute/v2.1/servers/9249c81d-e57b-4985-a398-8ad97526d5c7" status: 200 len: 1543 microversion: 2.1 time: 0.328160 Nov 01 18:58:29.949978 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-fd28a7d5-0ae0-4004-ba62-9aa7cb3eb6eb tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:58:29.954333 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-fd28a7d5-0ae0-4004-ba62-9aa7cb3eb6eb tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] [instance: ea631032-dd04-429b-988e-e6362ea42cf7] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:58:29.956991 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 591/1204] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:58:29 2022] GET /compute/v2.1/servers/9249c81d-e57b-4985-a398-8ad97526d5c7 => generated 1543 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:58:29.965118 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-d764bf49-c3f4-4405-8d50-345a6e9de5e8 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:58:29.966003 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-d764bf49-c3f4-4405-8d50-345a6e9de5e8 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] [instance: 2d525a31-b0be-44cb-8fb7-335075145f08] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:58:29.976981 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d764bf49-c3f4-4405-8d50-345a6e9de5e8 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:29.977534 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-fd28a7d5-0ae0-4004-ba62-9aa7cb3eb6eb tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:29.979238 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-fd28a7d5-0ae0-4004-ba62-9aa7cb3eb6eb tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:29.979482 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d764bf49-c3f4-4405-8d50-345a6e9de5e8 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:29.980679 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-fd28a7d5-0ae0-4004-ba62-9aa7cb3eb6eb tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:29.980898 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d764bf49-c3f4-4405-8d50-345a6e9de5e8 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:29.981766 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d764bf49-c3f4-4405-8d50-345a6e9de5e8 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:29.982647 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-fd28a7d5-0ae0-4004-ba62-9aa7cb3eb6eb tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:29.983276 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d764bf49-c3f4-4405-8d50-345a6e9de5e8 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:29.983917 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-fd28a7d5-0ae0-4004-ba62-9aa7cb3eb6eb tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:29.984505 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d764bf49-c3f4-4405-8d50-345a6e9de5e8 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:29.985182 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-fd28a7d5-0ae0-4004-ba62-9aa7cb3eb6eb tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:30.097514 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-fd28a7d5-0ae0-4004-ba62-9aa7cb3eb6eb tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c1314c21d8547ff890ede1c2ad281c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c804370880454c7aa02cef2c2c3cf144', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:58:30.108391 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-fd28a7d5-0ae0-4004-ba62-9aa7cb3eb6eb tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c1314c21d8547ff890ede1c2ad281c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c804370880454c7aa02cef2c2c3cf144', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:58:30.110228 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-fd28a7d5-0ae0-4004-ba62-9aa7cb3eb6eb tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c1314c21d8547ff890ede1c2ad281c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c804370880454c7aa02cef2c2c3cf144', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:58:30.116438 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-fd28a7d5-0ae0-4004-ba62-9aa7cb3eb6eb tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] 10.222.0.13 "GET /compute/v2.1/servers/ea631032-dd04-429b-988e-e6362ea42cf7" status: 200 len: 1538 microversion: 2.91 time: 0.182168 Nov 01 18:58:30.117120 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 614/1205] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 18:58:29 2022] GET /compute/v2.1/servers/ea631032-dd04-429b-988e-e6362ea42cf7 => generated 1538 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 18:58:30.121769 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [req-05ad0342-300f-45f4-b926-e28c5999b11d req-9a5c5292-a98a-45f9-8d67-98b24a40c828 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8e62f12b-8b96-414a-8099-0f9acb7fabf5", "tag": "8b2113da-4763-4f79-99c9-989625f65d00"}]} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 18:58:30.143213 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-05ad0342-300f-45f4-b926-e28c5999b11d req-9a5c5292-a98a-45f9-8d67-98b24a40c828 service nova] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:30.143213 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-05ad0342-300f-45f4-b926-e28c5999b11d req-9a5c5292-a98a-45f9-8d67-98b24a40c828 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:30.143213 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-05ad0342-300f-45f4-b926-e28c5999b11d req-9a5c5292-a98a-45f9-8d67-98b24a40c828 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:30.149606 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.compute.server_external_events [req-05ad0342-300f-45f4-b926-e28c5999b11d req-9a5c5292-a98a-45f9-8d67-98b24a40c828 service nova] Creating event network-changed:8b2113da-4763-4f79-99c9-989625f65d00 for instance 8e62f12b-8b96-414a-8099-0f9acb7fabf5 on n-h2-863052-2 Nov 01 18:58:30.161342 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [req-05ad0342-300f-45f4-b926-e28c5999b11d req-9a5c5292-a98a-45f9-8d67-98b24a40c828 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042622 Nov 01 18:58:30.162095 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 615/1206] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Nov 1 18:58:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 18:58:30.186176 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-b5462a7b-4efc-4b42-999b-19768d92aa7e tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:58:30.188615 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-b5462a7b-4efc-4b42-999b-19768d92aa7e tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] [instance: 9dbe3d05-9fa8-4fd2-8415-52bfe6ee5801] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:58:30.201861 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b5462a7b-4efc-4b42-999b-19768d92aa7e tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:30.202291 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b5462a7b-4efc-4b42-999b-19768d92aa7e tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:30.202878 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b5462a7b-4efc-4b42-999b-19768d92aa7e tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:30.203755 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b5462a7b-4efc-4b42-999b-19768d92aa7e tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:30.204437 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b5462a7b-4efc-4b42-999b-19768d92aa7e tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:30.207750 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b5462a7b-4efc-4b42-999b-19768d92aa7e tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:30.215383 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-d764bf49-c3f4-4405-8d50-345a6e9de5e8 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f32f5fba1976432d938e664c7714e52b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b9d4c236b944f9b2e8e502a50a8f8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:58:30.229030 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-d764bf49-c3f4-4405-8d50-345a6e9de5e8 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] 10.222.0.13 "GET /compute/v2.1/servers/2d525a31-b0be-44cb-8fb7-335075145f08" status: 200 len: 1718 microversion: 2.1 time: 0.265821 Nov 01 18:58:30.248605 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 592/1207] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:58:29 2022] GET /compute/v2.1/servers/2d525a31-b0be-44cb-8fb7-335075145f08 => generated 1718 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:58:30.248605 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-4649ef2f-f903-44e4-b8b5-1ec24fac6563 tempest-FloatingIPsAssociationNegativeTestJSON-296725392 tempest-FloatingIPsAssociationNegativeTestJSON-296725392-project] Calling method '.version_select at 0x7f0ae67e3310>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:58:30.429144 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-b5462a7b-4efc-4b42-999b-19768d92aa7e tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0290a6bb8bc24b8988a925327ac0381c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86941784237549838bba63ce88053b88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:58:30.442578 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-b5462a7b-4efc-4b42-999b-19768d92aa7e tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] 10.222.0.13 "GET /compute/v2.1/servers/9dbe3d05-9fa8-4fd2-8415-52bfe6ee5801" status: 200 len: 1271 microversion: 2.1 time: 0.262687 Nov 01 18:58:30.464377 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 616/1208] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:58:30 2022] GET /compute/v2.1/servers/9dbe3d05-9fa8-4fd2-8415-52bfe6ee5801 => generated 1271 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:58:30.471555 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-f1eac8b5-8f4b-4ec8-bbac-8b529d1c0a9c tempest-UnshelveToHostMultiNodesTest-2124505700 tempest-UnshelveToHostMultiNodesTest-2124505700-project-admin] Action: 'action', calling method: >, body: {"unshelve": {"host": "n-h2-863052-2"}} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 18:58:30.477219 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-f1eac8b5-8f4b-4ec8-bbac-8b529d1c0a9c tempest-UnshelveToHostMultiNodesTest-2124505700 tempest-UnshelveToHostMultiNodesTest-2124505700-project-admin] [instance: ea631032-dd04-429b-988e-e6362ea42cf7] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:58:30.484688 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f1eac8b5-8f4b-4ec8-bbac-8b529d1c0a9c tempest-UnshelveToHostMultiNodesTest-2124505700 tempest-UnshelveToHostMultiNodesTest-2124505700-project-admin] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:30.486313 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f1eac8b5-8f4b-4ec8-bbac-8b529d1c0a9c tempest-UnshelveToHostMultiNodesTest-2124505700 tempest-UnshelveToHostMultiNodesTest-2124505700-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:30.487285 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f1eac8b5-8f4b-4ec8-bbac-8b529d1c0a9c tempest-UnshelveToHostMultiNodesTest-2124505700 tempest-UnshelveToHostMultiNodesTest-2124505700-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:30.488166 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f1eac8b5-8f4b-4ec8-bbac-8b529d1c0a9c tempest-UnshelveToHostMultiNodesTest-2124505700 tempest-UnshelveToHostMultiNodesTest-2124505700-project-admin] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:30.488844 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f1eac8b5-8f4b-4ec8-bbac-8b529d1c0a9c tempest-UnshelveToHostMultiNodesTest-2124505700 tempest-UnshelveToHostMultiNodesTest-2124505700-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:30.489497 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f1eac8b5-8f4b-4ec8-bbac-8b529d1c0a9c tempest-UnshelveToHostMultiNodesTest-2124505700 tempest-UnshelveToHostMultiNodesTest-2124505700-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:30.578659 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-f1eac8b5-8f4b-4ec8-bbac-8b529d1c0a9c tempest-UnshelveToHostMultiNodesTest-2124505700 tempest-UnshelveToHostMultiNodesTest-2124505700-project-admin] [instance: ea631032-dd04-429b-988e-e6362ea42cf7] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "n-h2-863052-2". {{(pid=121402) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Nov 01 18:58:30.707920 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-f1eac8b5-8f4b-4ec8-bbac-8b529d1c0a9c tempest-UnshelveToHostMultiNodesTest-2124505700 tempest-UnshelveToHostMultiNodesTest-2124505700-project-admin] 10.222.0.13 "POST /compute/v2.1/servers/ea631032-dd04-429b-988e-e6362ea42cf7/action" status: 202 len: 0 microversion: 2.91 time: 0.241118 Nov 01 18:58:30.712096 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 617/1209] 10.222.0.13 () {62 vars in 1319 bytes} [Tue Nov 1 18:58:30 2022] POST /compute/v2.1/servers/ea631032-dd04-429b-988e-e6362ea42cf7/action => generated 0 bytes in 246 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 01 18:58:30.731828 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-2480a165-edc9-4546-af72-03b912b9191d tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:58:30.732594 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-2480a165-edc9-4546-af72-03b912b9191d tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] [instance: 869ca597-f199-474f-a680-59b0a75512c7] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:58:30.759323 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2480a165-edc9-4546-af72-03b912b9191d tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:30.761686 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2480a165-edc9-4546-af72-03b912b9191d tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:30.762443 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2480a165-edc9-4546-af72-03b912b9191d tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:30.765467 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2480a165-edc9-4546-af72-03b912b9191d tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:30.766818 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2480a165-edc9-4546-af72-03b912b9191d tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:30.767815 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2480a165-edc9-4546-af72-03b912b9191d tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:30.810474 n-d-863052-2 devstack@n-api.service[121402]: DEBUG dbcounter [-] [121402] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=4,nova_cell1:INSERT=2,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=121402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 18:58:31.173725 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-2480a165-edc9-4546-af72-03b912b9191d tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a63d69c99a546f0af16329cff3ca717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a1bb191cff948e99c008b5e861ce4a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:58:31.197475 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-2480a165-edc9-4546-af72-03b912b9191d tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] 10.222.0.13 "GET /compute/v2.1/servers/869ca597-f199-474f-a680-59b0a75512c7" status: 200 len: 1520 microversion: 2.1 time: 0.481727 Nov 01 18:58:31.212092 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 618/1210] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:58:30 2022] GET /compute/v2.1/servers/869ca597-f199-474f-a680-59b0a75512c7 => generated 1520 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:58:31.225066 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-b5608908-3f3d-4ce6-b69d-744c0188cc49 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:58:31.226514 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-b5608908-3f3d-4ce6-b69d-744c0188cc49 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] [instance: eebaed86-332c-47dc-af0f-f37e9b69d52f] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:58:31.243694 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b5608908-3f3d-4ce6-b69d-744c0188cc49 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:31.244203 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b5608908-3f3d-4ce6-b69d-744c0188cc49 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:31.244692 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b5608908-3f3d-4ce6-b69d-744c0188cc49 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:31.245418 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b5608908-3f3d-4ce6-b69d-744c0188cc49 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:31.248882 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b5608908-3f3d-4ce6-b69d-744c0188cc49 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:31.249303 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b5608908-3f3d-4ce6-b69d-744c0188cc49 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:32.025561 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-b5608908-3f3d-4ce6-b69d-744c0188cc49 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b52b7dcbb044f9bfc424e4417c77fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '708bc0ea4b5a4baf81933725792bedd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:58:32.038163 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-b5608908-3f3d-4ce6-b69d-744c0188cc49 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] 10.222.0.13 "GET /compute/v2.1/servers/eebaed86-332c-47dc-af0f-f37e9b69d52f" status: 200 len: 1529 microversion: 2.1 time: 0.827359 Nov 01 18:58:32.060180 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 619/1211] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:58:31 2022] GET /compute/v2.1/servers/eebaed86-332c-47dc-af0f-f37e9b69d52f => generated 1529 bytes in 850 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:58:32.067303 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-cd42d99f-56dc-49a4-ad38-3ea5c8c73ea8 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:58:32.069954 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-cd42d99f-56dc-49a4-ad38-3ea5c8c73ea8 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] [instance: ea631032-dd04-429b-988e-e6362ea42cf7] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:58:32.077704 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-cd42d99f-56dc-49a4-ad38-3ea5c8c73ea8 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:32.079411 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-cd42d99f-56dc-49a4-ad38-3ea5c8c73ea8 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:32.080109 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-cd42d99f-56dc-49a4-ad38-3ea5c8c73ea8 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:32.081418 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-cd42d99f-56dc-49a4-ad38-3ea5c8c73ea8 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:32.082051 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-cd42d99f-56dc-49a4-ad38-3ea5c8c73ea8 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:32.082671 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-cd42d99f-56dc-49a4-ad38-3ea5c8c73ea8 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:32.298326 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-cd42d99f-56dc-49a4-ad38-3ea5c8c73ea8 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c1314c21d8547ff890ede1c2ad281c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c804370880454c7aa02cef2c2c3cf144', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:58:32.325068 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-cd42d99f-56dc-49a4-ad38-3ea5c8c73ea8 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c1314c21d8547ff890ede1c2ad281c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c804370880454c7aa02cef2c2c3cf144', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:58:32.327744 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-cd42d99f-56dc-49a4-ad38-3ea5c8c73ea8 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c1314c21d8547ff890ede1c2ad281c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c804370880454c7aa02cef2c2c3cf144', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:58:32.373812 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-cd42d99f-56dc-49a4-ad38-3ea5c8c73ea8 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] 10.222.0.13 "GET /compute/v2.1/servers/ea631032-dd04-429b-988e-e6362ea42cf7" status: 200 len: 1544 microversion: 2.91 time: 0.311540 Nov 01 18:58:32.385341 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 620/1212] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 18:58:32 2022] GET /compute/v2.1/servers/ea631032-dd04-429b-988e-e6362ea42cf7 => generated 1544 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 18:58:32.399088 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-03835e41-57b0-43fa-ad3b-9e8d00428fe7 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:58:32.403140 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-03835e41-57b0-43fa-ad3b-9e8d00428fe7 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] [instance: 9249c81d-e57b-4985-a398-8ad97526d5c7] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:58:32.419260 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-03835e41-57b0-43fa-ad3b-9e8d00428fe7 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:32.423625 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-03835e41-57b0-43fa-ad3b-9e8d00428fe7 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:32.424791 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-03835e41-57b0-43fa-ad3b-9e8d00428fe7 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:32.425733 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-03835e41-57b0-43fa-ad3b-9e8d00428fe7 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:32.429079 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-03835e41-57b0-43fa-ad3b-9e8d00428fe7 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:32.429784 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-03835e41-57b0-43fa-ad3b-9e8d00428fe7 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:32.657495 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-03835e41-57b0-43fa-ad3b-9e8d00428fe7 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72117f17294649d6b8bc16c66c7efab2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45d4c047d3c44324a27a27831236ab0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:58:32.672895 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-03835e41-57b0-43fa-ad3b-9e8d00428fe7 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] 10.222.0.13 "GET /compute/v2.1/servers/9249c81d-e57b-4985-a398-8ad97526d5c7" status: 200 len: 1543 microversion: 2.1 time: 0.285615 Nov 01 18:58:32.676827 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 621/1213] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:58:32 2022] GET /compute/v2.1/servers/9249c81d-e57b-4985-a398-8ad97526d5c7 => generated 1543 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:58:32.678721 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-073b7a45-7903-456c-bb0d-71b9ec0489ae tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:58:32.679336 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-073b7a45-7903-456c-bb0d-71b9ec0489ae tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] [instance: 2d525a31-b0be-44cb-8fb7-335075145f08] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:58:32.693963 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-073b7a45-7903-456c-bb0d-71b9ec0489ae tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:32.694456 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-073b7a45-7903-456c-bb0d-71b9ec0489ae tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:32.697153 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-073b7a45-7903-456c-bb0d-71b9ec0489ae tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:32.698145 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-073b7a45-7903-456c-bb0d-71b9ec0489ae tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:32.702541 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-073b7a45-7903-456c-bb0d-71b9ec0489ae tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:32.703011 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-073b7a45-7903-456c-bb0d-71b9ec0489ae tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:32.961392 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-073b7a45-7903-456c-bb0d-71b9ec0489ae tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f32f5fba1976432d938e664c7714e52b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b9d4c236b944f9b2e8e502a50a8f8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:58:32.974881 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-073b7a45-7903-456c-bb0d-71b9ec0489ae tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] 10.222.0.13 "GET /compute/v2.1/servers/2d525a31-b0be-44cb-8fb7-335075145f08" status: 200 len: 1718 microversion: 2.1 time: 0.299786 Nov 01 18:58:32.989425 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 622/1214] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:58:32 2022] GET /compute/v2.1/servers/2d525a31-b0be-44cb-8fb7-335075145f08 => generated 1718 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:58:32.999307 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-71c69f85-c36e-4dca-8513-ef4ee70c5cb8 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:58:33.000156 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-71c69f85-c36e-4dca-8513-ef4ee70c5cb8 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] [instance: 9dbe3d05-9fa8-4fd2-8415-52bfe6ee5801] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:58:33.007108 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-71c69f85-c36e-4dca-8513-ef4ee70c5cb8 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:33.007876 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-71c69f85-c36e-4dca-8513-ef4ee70c5cb8 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:33.008396 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-71c69f85-c36e-4dca-8513-ef4ee70c5cb8 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:33.009643 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-71c69f85-c36e-4dca-8513-ef4ee70c5cb8 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:33.010437 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-71c69f85-c36e-4dca-8513-ef4ee70c5cb8 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:33.011112 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-71c69f85-c36e-4dca-8513-ef4ee70c5cb8 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:33.374011 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-71c69f85-c36e-4dca-8513-ef4ee70c5cb8 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0290a6bb8bc24b8988a925327ac0381c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86941784237549838bba63ce88053b88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:58:33.379642 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-4649ef2f-f903-44e4-b8b5-1ec24fac6563 tempest-FloatingIPsAssociationNegativeTestJSON-296725392 tempest-FloatingIPsAssociationNegativeTestJSON-296725392-project] 10.222.0.13 "DELETE /compute/v2.1/os-floating-ips/3120dbed-c7be-44ef-b399-e309b52d3209" status: 202 len: 0 microversion: 2.1 time: 3.144207 Nov 01 18:58:33.386393 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 593/1215] 10.222.0.13 () {58 vars in 1263 bytes} [Tue Nov 1 18:58:30 2022] DELETE /compute/v2.1/os-floating-ips/3120dbed-c7be-44ef-b399-e309b52d3209 => generated 0 bytes in 3152 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 01 18:58:33.392478 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-822443e7-5333-4583-bca5-248ce014d6c3 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:58:33.393468 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-822443e7-5333-4583-bca5-248ce014d6c3 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] [instance: 869ca597-f199-474f-a680-59b0a75512c7] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:58:33.399510 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-71c69f85-c36e-4dca-8513-ef4ee70c5cb8 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] 10.222.0.13 "GET /compute/v2.1/servers/9dbe3d05-9fa8-4fd2-8415-52bfe6ee5801" status: 200 len: 1319 microversion: 2.1 time: 0.408491 Nov 01 18:58:33.400425 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-822443e7-5333-4583-bca5-248ce014d6c3 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:33.401176 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-822443e7-5333-4583-bca5-248ce014d6c3 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:33.402263 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-822443e7-5333-4583-bca5-248ce014d6c3 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:33.402954 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-822443e7-5333-4583-bca5-248ce014d6c3 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:33.403649 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-822443e7-5333-4583-bca5-248ce014d6c3 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:33.404294 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-822443e7-5333-4583-bca5-248ce014d6c3 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:33.416737 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 623/1216] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:58:32 2022] GET /compute/v2.1/servers/9dbe3d05-9fa8-4fd2-8415-52bfe6ee5801 => generated 1319 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:58:33.426601 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [req-1189270d-3be4-4ff3-9657-12c034f9cf48 req-9d0a2fc0-950e-4af8-8710-0ec746ba04c5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eebaed86-332c-47dc-af0f-f37e9b69d52f", "name": "network-vif-deleted", "tag": "0e64752c-4421-48b4-a71d-203804b58462"}]} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 18:58:33.470293 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-1189270d-3be4-4ff3-9657-12c034f9cf48 req-9d0a2fc0-950e-4af8-8710-0ec746ba04c5 service nova] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:33.472455 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-1189270d-3be4-4ff3-9657-12c034f9cf48 req-9d0a2fc0-950e-4af8-8710-0ec746ba04c5 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:33.486084 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-1189270d-3be4-4ff3-9657-12c034f9cf48 req-9d0a2fc0-950e-4af8-8710-0ec746ba04c5 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:33.516532 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.compute.server_external_events [req-1189270d-3be4-4ff3-9657-12c034f9cf48 req-9d0a2fc0-950e-4af8-8710-0ec746ba04c5 service nova] Creating event network-vif-deleted:0e64752c-4421-48b4-a71d-203804b58462 for instance eebaed86-332c-47dc-af0f-f37e9b69d52f on n-h1-863052-2 Nov 01 18:58:33.524623 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [req-1189270d-3be4-4ff3-9657-12c034f9cf48 req-9d0a2fc0-950e-4af8-8710-0ec746ba04c5 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.115047 Nov 01 18:58:33.526926 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 624/1217] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Nov 1 18:58:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 18:58:33.536675 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-f1af9b99-bbef-474c-b65b-9c8484eb34a7 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:58:33.538432 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-f1af9b99-bbef-474c-b65b-9c8484eb34a7 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] [instance: eebaed86-332c-47dc-af0f-f37e9b69d52f] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:58:33.548050 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f1af9b99-bbef-474c-b65b-9c8484eb34a7 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:33.549056 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f1af9b99-bbef-474c-b65b-9c8484eb34a7 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:33.549903 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f1af9b99-bbef-474c-b65b-9c8484eb34a7 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:33.550913 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f1af9b99-bbef-474c-b65b-9c8484eb34a7 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:33.551770 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f1af9b99-bbef-474c-b65b-9c8484eb34a7 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:33.552417 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f1af9b99-bbef-474c-b65b-9c8484eb34a7 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:33.572728 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.wsgi [None req-f1af9b99-bbef-474c-b65b-9c8484eb34a7 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] HTTP exception thrown: Instance eebaed86-332c-47dc-af0f-f37e9b69d52f could not be found. Nov 01 18:58:33.575700 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-f1af9b99-bbef-474c-b65b-9c8484eb34a7 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Request method failure captured: Nov 01 18:58:33.575700 n-d-863052-2 devstack@n-api.service[121402]: request: GET /compute/v2.1/servers/eebaed86-332c-47dc-af0f-f37e9b69d52f HTTP/1.1 Nov 01 18:58:33.575700 n-d-863052-2 devstack@n-api.service[121402]: Accept: application/json Nov 01 18:58:33.575700 n-d-863052-2 devstack@n-api.service[121402]: Accept-Encoding: identity Nov 01 18:58:33.575700 n-d-863052-2 devstack@n-api.service[121402]: Connection: close Nov 01 18:58:33.575700 n-d-863052-2 devstack@n-api.service[121402]: Content-Length: 0 Nov 01 18:58:33.575700 n-d-863052-2 devstack@n-api.service[121402]: Content-Type: application/json Nov 01 18:58:33.575700 n-d-863052-2 devstack@n-api.service[121402]: Host: 10.222.0.13 Nov 01 18:58:33.575700 n-d-863052-2 devstack@n-api.service[121402]: Openstack-System-Scope: None Nov 01 18:58:33.575700 n-d-863052-2 devstack@n-api.service[121402]: User-Agent: python-urllib3/1.26.12 Nov 01 18:58:33.575700 n-d-863052-2 devstack@n-api.service[121402]: X-Auth-Token: gAAAAABjYWvqbQtaNCf0vN3RIHicQ7eZzuMpptpvowYCNSOJcJRxrJ9QX4Bvdyyh6S1_lak_JDolcn4qSC02atGGl8uI3NqpWQKt52qXcbtBLMPpaEiNHqRmhd3SjpSTdiucZ2dSpVmatQ9uPpkpENeFkI_E8IIwNVu5-V-pSAlLNGA0j86IptM Nov 01 18:58:33.575700 n-d-863052-2 devstack@n-api.service[121402]: X-Domain-Id: None Nov 01 18:58:33.575700 n-d-863052-2 devstack@n-api.service[121402]: X-Domain-Name: None Nov 01 18:58:33.575700 n-d-863052-2 devstack@n-api.service[121402]: X-Identity-Status: Confirmed Nov 01 18:58:33.575700 n-d-863052-2 devstack@n-api.service[121402]: X-Is-Admin-Project: True Nov 01 18:58:33.575700 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Domain-Id: default Nov 01 18:58:33.575700 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Domain-Name: Default Nov 01 18:58:33.575700 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Id: 708bc0ea4b5a4baf81933725792bedd5 Nov 01 18:58:33.575700 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1431666313 Nov 01 18:58:33.575700 n-d-863052-2 devstack@n-api.service[121402]: X-Role: member,reader Nov 01 18:58:33.575700 n-d-863052-2 devstack@n-api.service[121402]: X-Roles: member,reader Nov 01 18:58:33.577226 n-d-863052-2 devstack@n-api.service[121402]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/708bc0ea4b5a4baf81933725792bedd5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/708bc0ea4b5a4baf81933725792bedd5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_708bc0ea4b5a4baf81933725792bedd5", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/708bc0ea4b5a4baf81933725792bedd5"}]}] Nov 01 18:58:33.577226 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1431666313 Nov 01 18:58:33.577226 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant-Id: 708bc0ea4b5a4baf81933725792bedd5 Nov 01 18:58:33.577226 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1431666313 Nov 01 18:58:33.577226 n-d-863052-2 devstack@n-api.service[121402]: X-User: tempest-ImagesOneServerNegativeTestJSON-1431666313-project Nov 01 18:58:33.577226 n-d-863052-2 devstack@n-api.service[121402]: X-User-Domain-Id: default Nov 01 18:58:33.577226 n-d-863052-2 devstack@n-api.service[121402]: X-User-Domain-Name: Default Nov 01 18:58:33.577226 n-d-863052-2 devstack@n-api.service[121402]: X-User-Id: 09b52b7dcbb044f9bfc424e4417c77fa Nov 01 18:58:33.577226 n-d-863052-2 devstack@n-api.service[121402]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1431666313-project Nov 01 18:58:33.577226 n-d-863052-2 devstack@n-api.service[121402]: method: > Nov 01 18:58:33.577226 n-d-863052-2 devstack@n-api.service[121402]: exception: Instance eebaed86-332c-47dc-af0f-f37e9b69d52f could not be found. Nov 01 18:58:33.577226 n-d-863052-2 devstack@n-api.service[121402]: action_args: {'id': 'eebaed86-332c-47dc-af0f-f37e9b69d52f'} Nov 01 18:58:33.578024 n-d-863052-2 devstack@n-api.service[121402]: {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 01 18:58:33.578024 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:58:33.578024 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 01 18:58:33.578024 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 01 18:58:33.578024 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 01 18:58:33.578024 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 01 18:58:33.578024 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 01 18:58:33.578024 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 01 18:58:33.578024 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 01 18:58:33.578024 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 01 18:58:33.578024 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eebaed86-332c-47dc-af0f-f37e9b69d52f could not be found. Nov 01 18:58:33.578024 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 18:58:33.578024 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 18:58:33.578024 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 18:58:33.578024 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:58:33.578024 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 18:58:33.578024 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 18:58:33.578024 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 01 18:58:33.578024 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 01 18:58:33.578024 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 01 18:58:33.581648 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 01 18:58:33.581648 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 01 18:58:33.581648 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 01 18:58:33.581648 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 01 18:58:33.581648 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 01 18:58:33.581648 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 01 18:58:33.581648 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 01 18:58:33.581648 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eebaed86-332c-47dc-af0f-f37e9b69d52f could not be found. Nov 01 18:58:33.581648 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 18:58:33.581648 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 18:58:33.581648 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 18:58:33.581648 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:58:33.581648 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 18:58:33.581648 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 18:58:33.581648 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 01 18:58:33.581648 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 01 18:58:33.581648 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eebaed86-332c-47dc-af0f-f37e9b69d52f could not be found. Nov 01 18:58:33.581648 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 18:58:33.599718 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-f1af9b99-bbef-474c-b65b-9c8484eb34a7 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Returning 404 to user: Instance eebaed86-332c-47dc-af0f-f37e9b69d52f could not be found. {{(pid=121402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 01 18:58:33.602873 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-f1af9b99-bbef-474c-b65b-9c8484eb34a7 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] 10.222.0.13 "GET /compute/v2.1/servers/eebaed86-332c-47dc-af0f-f37e9b69d52f" status: 404 len: 111 microversion: 2.1 time: 0.073451 Nov 01 18:58:33.604834 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 625/1218] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:58:33 2022] GET /compute/v2.1/servers/eebaed86-332c-47dc-af0f-f37e9b69d52f => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 01 18:58:33.612397 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [req-afc0a395-9e13-4fd2-97fa-5e1a0d972674 req-16198e7f-d6f1-489b-80f2-13c13f009ee2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "efdf10ba-60d4-4fb0-970d-109a8f936808", "tag": "d334cfe4-860d-43f2-bb0d-10cd04b6e568"}]} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 18:58:33.626080 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-afc0a395-9e13-4fd2-97fa-5e1a0d972674 req-16198e7f-d6f1-489b-80f2-13c13f009ee2 service nova] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:33.628854 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-afc0a395-9e13-4fd2-97fa-5e1a0d972674 req-16198e7f-d6f1-489b-80f2-13c13f009ee2 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:33.629877 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-afc0a395-9e13-4fd2-97fa-5e1a0d972674 req-16198e7f-d6f1-489b-80f2-13c13f009ee2 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:33.653032 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.compute.server_external_events [req-afc0a395-9e13-4fd2-97fa-5e1a0d972674 req-16198e7f-d6f1-489b-80f2-13c13f009ee2 service nova] Creating event network-changed:d334cfe4-860d-43f2-bb0d-10cd04b6e568 for instance efdf10ba-60d4-4fb0-970d-109a8f936808 on n-h1-863052-2 Nov 01 18:58:33.658880 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [req-afc0a395-9e13-4fd2-97fa-5e1a0d972674 req-16198e7f-d6f1-489b-80f2-13c13f009ee2 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052011 Nov 01 18:58:33.661141 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 626/1219] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Nov 1 18:58:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 18:58:33.667850 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-d69d97cb-6085-4441-9368-afbdba5f7141 tempest-FloatingIPsAssociationNegativeTestJSON-296725392 tempest-FloatingIPsAssociationNegativeTestJSON-296725392-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": ""}} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 18:58:33.672984 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-d69d97cb-6085-4441-9368-afbdba5f7141 tempest-FloatingIPsAssociationNegativeTestJSON-296725392 tempest-FloatingIPsAssociationNegativeTestJSON-296725392-project] Request method failure captured: Nov 01 18:58:33.672984 n-d-863052-2 devstack@n-api.service[121402]: request: POST /compute/v2.1/servers/8e62f12b-8b96-414a-8099-0f9acb7fabf5/action HTTP/1.1 Nov 01 18:58:33.672984 n-d-863052-2 devstack@n-api.service[121402]: Accept: application/json Nov 01 18:58:33.672984 n-d-863052-2 devstack@n-api.service[121402]: Accept-Encoding: identity Nov 01 18:58:33.672984 n-d-863052-2 devstack@n-api.service[121402]: Connection: close Nov 01 18:58:33.672984 n-d-863052-2 devstack@n-api.service[121402]: Content-Length: 34 Nov 01 18:58:33.672984 n-d-863052-2 devstack@n-api.service[121402]: Content-Type: application/json Nov 01 18:58:33.672984 n-d-863052-2 devstack@n-api.service[121402]: Host: 10.222.0.13 Nov 01 18:58:33.672984 n-d-863052-2 devstack@n-api.service[121402]: Openstack-System-Scope: None Nov 01 18:58:33.672984 n-d-863052-2 devstack@n-api.service[121402]: User-Agent: python-urllib3/1.26.12 Nov 01 18:58:33.672984 n-d-863052-2 devstack@n-api.service[121402]: X-Auth-Token: gAAAAABjYWw1SF5PPvMdN953udCJyfDa_Bfcqy7XVXpdqAKP1KG1AiUlssdsx9OB7pwmIJI0BFf9a3oyI_tT1BfoNA4axNUyVUKrPnNPLB3yEU3vYhuOsCWAaR_lCoKebniusNWQyFM6MZhXiwRWovoCjGCBPgyULskL-0T-0PDaS4BfSFiov1c Nov 01 18:58:33.672984 n-d-863052-2 devstack@n-api.service[121402]: X-Domain-Id: None Nov 01 18:58:33.672984 n-d-863052-2 devstack@n-api.service[121402]: X-Domain-Name: None Nov 01 18:58:33.672984 n-d-863052-2 devstack@n-api.service[121402]: X-Identity-Status: Confirmed Nov 01 18:58:33.672984 n-d-863052-2 devstack@n-api.service[121402]: X-Is-Admin-Project: True Nov 01 18:58:33.672984 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Domain-Id: default Nov 01 18:58:33.672984 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Domain-Name: Default Nov 01 18:58:33.672984 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Id: e3bd3f356d364e11b14d90d71cb5d598 Nov 01 18:58:33.672984 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-296725392 Nov 01 18:58:33.672984 n-d-863052-2 devstack@n-api.service[121402]: X-Role: member,reader Nov 01 18:58:33.672984 n-d-863052-2 devstack@n-api.service[121402]: X-Roles: member,reader Nov 01 18:58:33.674459 n-d-863052-2 devstack@n-api.service[121402]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/e3bd3f356d364e11b14d90d71cb5d598"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/e3bd3f356d364e11b14d90d71cb5d598"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_e3bd3f356d364e11b14d90d71cb5d598", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/e3bd3f356d364e11b14d90d71cb5d598"}]}] Nov 01 18:58:33.674459 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-296725392 Nov 01 18:58:33.674459 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant-Id: e3bd3f356d364e11b14d90d71cb5d598 Nov 01 18:58:33.674459 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-296725392 Nov 01 18:58:33.674459 n-d-863052-2 devstack@n-api.service[121402]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-296725392-project Nov 01 18:58:33.674459 n-d-863052-2 devstack@n-api.service[121402]: X-User-Domain-Id: default Nov 01 18:58:33.674459 n-d-863052-2 devstack@n-api.service[121402]: X-User-Domain-Name: Default Nov 01 18:58:33.674459 n-d-863052-2 devstack@n-api.service[121402]: X-User-Id: d40b11c70b8e40d0b7e7f5f7d2967184 Nov 01 18:58:33.674459 n-d-863052-2 devstack@n-api.service[121402]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-296725392-project Nov 01 18:58:33.674459 n-d-863052-2 devstack@n-api.service[121402]: Nov 01 18:58:33.674459 n-d-863052-2 devstack@n-api.service[121402]: {"addFloatingIp": {"address": ""}} Nov 01 18:58:33.674459 n-d-863052-2 devstack@n-api.service[121402]: method: Nov 01 18:58:33.674459 n-d-863052-2 devstack@n-api.service[121402]: exception: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Nov 01 18:58:33.675303 n-d-863052-2 devstack@n-api.service[121402]: action_args: {'id': '8e62f12b-8b96-414a-8099-0f9acb7fabf5', 'body': {'addFloatingIp': {'address': ''}}} Nov 01 18:58:33.675303 n-d-863052-2 devstack@n-api.service[121402]: {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 01 18:58:33.675303 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:58:33.675303 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Nov 01 18:58:33.675303 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Nov 01 18:58:33.675303 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Nov 01 18:58:33.675303 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise error Nov 01 18:58:33.675303 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is not valid under any of the given schemas Nov 01 18:58:33.675303 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 18:58:33.675303 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Failed validating 'oneOf' in schema['properties']['addFloatingIp']['properties']['address']: Nov 01 18:58:33.675303 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi {'oneOf': [{'format': 'ipv4'}, {'format': 'ipv6'}], 'type': 'string'} Nov 01 18:58:33.675303 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 18:58:33.675303 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi On instance['addFloatingIp']: Nov 01 18:58:33.675303 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi '' Nov 01 18:58:33.675303 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 18:58:33.675303 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 18:58:33.675303 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 18:58:33.675303 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:58:33.675303 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 18:58:33.675303 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 18:58:33.675303 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 01 18:58:33.675303 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 01 18:58:33.676697 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 01 18:58:33.676697 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 01 18:58:33.676697 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 01 18:58:33.676697 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 01 18:58:33.676697 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Nov 01 18:58:33.676697 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Nov 01 18:58:33.676697 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Nov 01 18:58:33.676697 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Nov 01 18:58:33.676697 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Nov 01 18:58:33.676697 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Nov 01 18:58:33.676697 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Nov 01 18:58:33.676697 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 18:58:33.676697 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 18:58:33.676697 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 18:58:33.676697 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:58:33.676697 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 18:58:33.676697 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 18:58:33.676697 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Nov 01 18:58:33.676697 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Nov 01 18:58:33.677886 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Nov 01 18:58:33.677886 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 18:58:33.682350 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-d69d97cb-6085-4441-9368-afbdba5f7141 tempest-FloatingIPsAssociationNegativeTestJSON-296725392 tempest-FloatingIPsAssociationNegativeTestJSON-296725392-project] Returning 400 to user: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas {{(pid=121402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 01 18:58:33.683479 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-d69d97cb-6085-4441-9368-afbdba5f7141 tempest-FloatingIPsAssociationNegativeTestJSON-296725392 tempest-FloatingIPsAssociationNegativeTestJSON-296725392-project] 10.222.0.13 "POST /compute/v2.1/servers/8e62f12b-8b96-414a-8099-0f9acb7fabf5/action" status: 400 len: 142 microversion: 2.1 time: 0.020925 Nov 01 18:58:33.689776 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 627/1220] 10.222.0.13 () {60 vars in 1278 bytes} [Tue Nov 1 18:58:33 2022] POST /compute/v2.1/servers/8e62f12b-8b96-414a-8099-0f9acb7fabf5/action => generated 142 bytes in 28 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 01 18:58:33.695759 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-9f86420a-9134-422d-b98c-04f9e158f009 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:58:33.697064 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-9f86420a-9134-422d-b98c-04f9e158f009 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] [instance: ea631032-dd04-429b-988e-e6362ea42cf7] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:58:33.706454 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-9f86420a-9134-422d-b98c-04f9e158f009 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:33.707347 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-9f86420a-9134-422d-b98c-04f9e158f009 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:33.708057 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-9f86420a-9134-422d-b98c-04f9e158f009 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:33.709078 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-9f86420a-9134-422d-b98c-04f9e158f009 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:33.709798 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-9f86420a-9134-422d-b98c-04f9e158f009 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:33.710460 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-9f86420a-9134-422d-b98c-04f9e158f009 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:33.829816 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-9f86420a-9134-422d-b98c-04f9e158f009 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c1314c21d8547ff890ede1c2ad281c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c804370880454c7aa02cef2c2c3cf144', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:58:33.846697 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-9f86420a-9134-422d-b98c-04f9e158f009 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c1314c21d8547ff890ede1c2ad281c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c804370880454c7aa02cef2c2c3cf144', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:58:33.851723 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-9f86420a-9134-422d-b98c-04f9e158f009 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c1314c21d8547ff890ede1c2ad281c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c804370880454c7aa02cef2c2c3cf144', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:58:33.859778 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-9f86420a-9134-422d-b98c-04f9e158f009 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] 10.222.0.13 "GET /compute/v2.1/servers/ea631032-dd04-429b-988e-e6362ea42cf7" status: 200 len: 1544 microversion: 2.91 time: 0.168374 Nov 01 18:58:33.872682 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 628/1221] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 18:58:33 2022] GET /compute/v2.1/servers/ea631032-dd04-429b-988e-e6362ea42cf7 => generated 1544 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 18:58:33.872682 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-004eb2fd-d2bf-4bc5-ae20-7d71c90a7276 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Calling method '.version_select at 0x7f0ae246d8b0>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:58:33.919833 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.wsgi [None req-004eb2fd-d2bf-4bc5-ae20-7d71c90a7276 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] HTTP exception thrown: Image not found. Nov 01 18:58:33.925523 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-004eb2fd-d2bf-4bc5-ae20-7d71c90a7276 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Request method failure captured: Nov 01 18:58:33.925523 n-d-863052-2 devstack@n-api.service[121402]: request: DELETE /compute/v2.1/images/1c57a094-5a17-4bde-a122-affe79707cb2 HTTP/1.1 Nov 01 18:58:33.925523 n-d-863052-2 devstack@n-api.service[121402]: Accept: application/json Nov 01 18:58:33.925523 n-d-863052-2 devstack@n-api.service[121402]: Accept-Encoding: identity Nov 01 18:58:33.925523 n-d-863052-2 devstack@n-api.service[121402]: Connection: close Nov 01 18:58:33.925523 n-d-863052-2 devstack@n-api.service[121402]: Content-Length: 0 Nov 01 18:58:33.925523 n-d-863052-2 devstack@n-api.service[121402]: Content-Type: application/json Nov 01 18:58:33.925523 n-d-863052-2 devstack@n-api.service[121402]: Host: 10.222.0.13 Nov 01 18:58:33.925523 n-d-863052-2 devstack@n-api.service[121402]: Openstack-System-Scope: None Nov 01 18:58:33.925523 n-d-863052-2 devstack@n-api.service[121402]: User-Agent: python-urllib3/1.26.12 Nov 01 18:58:33.925523 n-d-863052-2 devstack@n-api.service[121402]: X-Auth-Token: gAAAAABjYWvqbQtaNCf0vN3RIHicQ7eZzuMpptpvowYCNSOJcJRxrJ9QX4Bvdyyh6S1_lak_JDolcn4qSC02atGGl8uI3NqpWQKt52qXcbtBLMPpaEiNHqRmhd3SjpSTdiucZ2dSpVmatQ9uPpkpENeFkI_E8IIwNVu5-V-pSAlLNGA0j86IptM Nov 01 18:58:33.925523 n-d-863052-2 devstack@n-api.service[121402]: X-Domain-Id: None Nov 01 18:58:33.925523 n-d-863052-2 devstack@n-api.service[121402]: X-Domain-Name: None Nov 01 18:58:33.925523 n-d-863052-2 devstack@n-api.service[121402]: X-Identity-Status: Confirmed Nov 01 18:58:33.925523 n-d-863052-2 devstack@n-api.service[121402]: X-Is-Admin-Project: True Nov 01 18:58:33.925523 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Domain-Id: default Nov 01 18:58:33.925523 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Domain-Name: Default Nov 01 18:58:33.925523 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Id: 708bc0ea4b5a4baf81933725792bedd5 Nov 01 18:58:33.925523 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1431666313 Nov 01 18:58:33.925523 n-d-863052-2 devstack@n-api.service[121402]: X-Role: member,reader Nov 01 18:58:33.925523 n-d-863052-2 devstack@n-api.service[121402]: X-Roles: member,reader Nov 01 18:58:33.927216 n-d-863052-2 devstack@n-api.service[121402]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/708bc0ea4b5a4baf81933725792bedd5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/708bc0ea4b5a4baf81933725792bedd5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_708bc0ea4b5a4baf81933725792bedd5", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/708bc0ea4b5a4baf81933725792bedd5"}]}] Nov 01 18:58:33.927216 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1431666313 Nov 01 18:58:33.927216 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant-Id: 708bc0ea4b5a4baf81933725792bedd5 Nov 01 18:58:33.927216 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1431666313 Nov 01 18:58:33.927216 n-d-863052-2 devstack@n-api.service[121402]: X-User: tempest-ImagesOneServerNegativeTestJSON-1431666313-project Nov 01 18:58:33.927216 n-d-863052-2 devstack@n-api.service[121402]: X-User-Domain-Id: default Nov 01 18:58:33.927216 n-d-863052-2 devstack@n-api.service[121402]: X-User-Domain-Name: Default Nov 01 18:58:33.927216 n-d-863052-2 devstack@n-api.service[121402]: X-User-Id: 09b52b7dcbb044f9bfc424e4417c77fa Nov 01 18:58:33.927216 n-d-863052-2 devstack@n-api.service[121402]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1431666313-project Nov 01 18:58:33.927216 n-d-863052-2 devstack@n-api.service[121402]: method: Nov 01 18:58:33.927216 n-d-863052-2 devstack@n-api.service[121402]: exception: Image not found. Nov 01 18:58:33.927216 n-d-863052-2 devstack@n-api.service[121402]: action_args: {'id': '1c57a094-5a17-4bde-a122-affe79707cb2'} Nov 01 18:58:33.927216 n-d-863052-2 devstack@n-api.service[121402]: {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 01 18:58:33.928283 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:58:33.928283 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Nov 01 18:58:33.928283 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Nov 01 18:58:33.928283 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Nov 01 18:58:33.928283 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Nov 01 18:58:33.928283 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Nov 01 18:58:33.928283 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Nov 01 18:58:33.928283 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Nov 01 18:58:33.928283 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Nov 01 18:58:33.928283 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Nov 01 18:58:33.928283 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Nov 01 18:58:33.928283 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Nov 01 18:58:33.928283 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Nov 01 18:58:33.928283 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Nov 01 18:58:33.928283 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Nov 01 18:58:33.928283 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 1c57a094-5a17-4bde-a122-affe79707cb2 to delete Nov 01 18:58:33.928283 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 18:58:33.928283 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 18:58:33.928283 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 18:58:33.929674 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:58:33.929674 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Nov 01 18:58:33.929674 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Nov 01 18:58:33.929674 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Nov 01 18:58:33.929674 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Nov 01 18:58:33.929674 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Nov 01 18:58:33.929674 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Nov 01 18:58:33.929674 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 1c57a094-5a17-4bde-a122-affe79707cb2 could not be found. Nov 01 18:58:33.929674 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 18:58:33.929674 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 18:58:33.929674 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 18:58:33.929674 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:58:33.929674 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 18:58:33.929674 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 18:58:33.929674 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 01 18:58:33.929674 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 01 18:58:33.929674 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 01 18:58:33.929674 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 01 18:58:33.929674 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 01 18:58:33.929674 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 01 18:58:33.932064 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Nov 01 18:58:33.932064 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Nov 01 18:58:33.932064 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Nov 01 18:58:33.932064 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 18:58:33.932064 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 18:58:33.932064 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 18:58:33.932064 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:58:33.932064 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 18:58:33.932064 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 18:58:33.932064 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 01 18:58:33.932064 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 01 18:58:33.932064 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Nov 01 18:58:33.932064 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 18:58:33.934710 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-004eb2fd-d2bf-4bc5-ae20-7d71c90a7276 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Returning 404 to user: Image not found. {{(pid=121402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 01 18:58:33.935799 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-004eb2fd-d2bf-4bc5-ae20-7d71c90a7276 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] 10.222.0.13 "DELETE /compute/v2.1/images/1c57a094-5a17-4bde-a122-affe79707cb2" status: 404 len: 62 microversion: 2.1 time: 0.073533 Nov 01 18:58:33.940997 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 629/1222] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:58:33 2022] DELETE /compute/v2.1/images/1c57a094-5a17-4bde-a122-affe79707cb2 => generated 62 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 01 18:58:33.946604 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-3140dbaf-0b1f-4cdf-aa19-f7cf49079185 tempest-FloatingIPsAssociationNegativeTestJSON-296725392 tempest-FloatingIPsAssociationNegativeTestJSON-296725392-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "0.0.0.0"}} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 18:58:33.949486 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-3140dbaf-0b1f-4cdf-aa19-f7cf49079185 tempest-FloatingIPsAssociationNegativeTestJSON-296725392 tempest-FloatingIPsAssociationNegativeTestJSON-296725392-project] [instance: 8e62f12b-8b96-414a-8099-0f9acb7fabf5] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:58:33.957633 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-3140dbaf-0b1f-4cdf-aa19-f7cf49079185 tempest-FloatingIPsAssociationNegativeTestJSON-296725392 tempest-FloatingIPsAssociationNegativeTestJSON-296725392-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:33.958511 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-3140dbaf-0b1f-4cdf-aa19-f7cf49079185 tempest-FloatingIPsAssociationNegativeTestJSON-296725392 tempest-FloatingIPsAssociationNegativeTestJSON-296725392-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:33.960402 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-3140dbaf-0b1f-4cdf-aa19-f7cf49079185 tempest-FloatingIPsAssociationNegativeTestJSON-296725392 tempest-FloatingIPsAssociationNegativeTestJSON-296725392-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:33.961537 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-3140dbaf-0b1f-4cdf-aa19-f7cf49079185 tempest-FloatingIPsAssociationNegativeTestJSON-296725392 tempest-FloatingIPsAssociationNegativeTestJSON-296725392-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:33.962212 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-3140dbaf-0b1f-4cdf-aa19-f7cf49079185 tempest-FloatingIPsAssociationNegativeTestJSON-296725392 tempest-FloatingIPsAssociationNegativeTestJSON-296725392-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:33.962840 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-3140dbaf-0b1f-4cdf-aa19-f7cf49079185 tempest-FloatingIPsAssociationNegativeTestJSON-296725392 tempest-FloatingIPsAssociationNegativeTestJSON-296725392-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:33.980935 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-822443e7-5333-4583-bca5-248ce014d6c3 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a63d69c99a546f0af16329cff3ca717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a1bb191cff948e99c008b5e861ce4a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:58:33.993410 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-3140dbaf-0b1f-4cdf-aa19-f7cf49079185 tempest-FloatingIPsAssociationNegativeTestJSON-296725392 tempest-FloatingIPsAssociationNegativeTestJSON-296725392-project] Acquiring lock "refresh_cache-8e62f12b-8b96-414a-8099-0f9acb7fabf5" {{(pid=121402) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Nov 01 18:58:33.993863 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-3140dbaf-0b1f-4cdf-aa19-f7cf49079185 tempest-FloatingIPsAssociationNegativeTestJSON-296725392 tempest-FloatingIPsAssociationNegativeTestJSON-296725392-project] Acquired lock "refresh_cache-8e62f12b-8b96-414a-8099-0f9acb7fabf5" {{(pid=121402) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Nov 01 18:58:33.995681 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-822443e7-5333-4583-bca5-248ce014d6c3 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] 10.222.0.13 "GET /compute/v2.1/servers/869ca597-f199-474f-a680-59b0a75512c7" status: 200 len: 1520 microversion: 2.1 time: 0.605924 Nov 01 18:58:33.997736 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 594/1223] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:58:33 2022] GET /compute/v2.1/servers/869ca597-f199-474f-a680-59b0a75512c7 => generated 1520 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:58:34.003337 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-da7722b9-0dae-40b8-9c04-8bca72df4911 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:58:34.004174 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-da7722b9-0dae-40b8-9c04-8bca72df4911 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] [instance: 9249c81d-e57b-4985-a398-8ad97526d5c7] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:58:34.019558 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-da7722b9-0dae-40b8-9c04-8bca72df4911 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:34.020508 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-da7722b9-0dae-40b8-9c04-8bca72df4911 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:34.021003 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-da7722b9-0dae-40b8-9c04-8bca72df4911 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:34.022526 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-da7722b9-0dae-40b8-9c04-8bca72df4911 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:34.023349 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-da7722b9-0dae-40b8-9c04-8bca72df4911 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:34.023829 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-da7722b9-0dae-40b8-9c04-8bca72df4911 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:34.158620 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-3140dbaf-0b1f-4cdf-aa19-f7cf49079185 tempest-FloatingIPsAssociationNegativeTestJSON-296725392 tempest-FloatingIPsAssociationNegativeTestJSON-296725392-project] Releasing lock "refresh_cache-8e62f12b-8b96-414a-8099-0f9acb7fabf5" {{(pid=121402) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Nov 01 18:58:34.159391 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.wsgi [None req-3140dbaf-0b1f-4cdf-aa19-f7cf49079185 tempest-FloatingIPsAssociationNegativeTestJSON-296725392 tempest-FloatingIPsAssociationNegativeTestJSON-296725392-project] HTTP exception thrown: floating IP not found Nov 01 18:58:34.162638 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-3140dbaf-0b1f-4cdf-aa19-f7cf49079185 tempest-FloatingIPsAssociationNegativeTestJSON-296725392 tempest-FloatingIPsAssociationNegativeTestJSON-296725392-project] Request method failure captured: Nov 01 18:58:34.162638 n-d-863052-2 devstack@n-api.service[121402]: request: POST /compute/v2.1/servers/8e62f12b-8b96-414a-8099-0f9acb7fabf5/action HTTP/1.1 Nov 01 18:58:34.162638 n-d-863052-2 devstack@n-api.service[121402]: Accept: application/json Nov 01 18:58:34.162638 n-d-863052-2 devstack@n-api.service[121402]: Accept-Encoding: identity Nov 01 18:58:34.162638 n-d-863052-2 devstack@n-api.service[121402]: Connection: close Nov 01 18:58:34.162638 n-d-863052-2 devstack@n-api.service[121402]: Content-Length: 41 Nov 01 18:58:34.162638 n-d-863052-2 devstack@n-api.service[121402]: Content-Type: application/json Nov 01 18:58:34.162638 n-d-863052-2 devstack@n-api.service[121402]: Host: 10.222.0.13 Nov 01 18:58:34.162638 n-d-863052-2 devstack@n-api.service[121402]: Openstack-System-Scope: None Nov 01 18:58:34.162638 n-d-863052-2 devstack@n-api.service[121402]: User-Agent: python-urllib3/1.26.12 Nov 01 18:58:34.162638 n-d-863052-2 devstack@n-api.service[121402]: X-Auth-Token: gAAAAABjYWw1SF5PPvMdN953udCJyfDa_Bfcqy7XVXpdqAKP1KG1AiUlssdsx9OB7pwmIJI0BFf9a3oyI_tT1BfoNA4axNUyVUKrPnNPLB3yEU3vYhuOsCWAaR_lCoKebniusNWQyFM6MZhXiwRWovoCjGCBPgyULskL-0T-0PDaS4BfSFiov1c Nov 01 18:58:34.162638 n-d-863052-2 devstack@n-api.service[121402]: X-Domain-Id: None Nov 01 18:58:34.162638 n-d-863052-2 devstack@n-api.service[121402]: X-Domain-Name: None Nov 01 18:58:34.162638 n-d-863052-2 devstack@n-api.service[121402]: X-Identity-Status: Confirmed Nov 01 18:58:34.162638 n-d-863052-2 devstack@n-api.service[121402]: X-Is-Admin-Project: True Nov 01 18:58:34.162638 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Domain-Id: default Nov 01 18:58:34.162638 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Domain-Name: Default Nov 01 18:58:34.162638 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Id: e3bd3f356d364e11b14d90d71cb5d598 Nov 01 18:58:34.162638 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-296725392 Nov 01 18:58:34.162638 n-d-863052-2 devstack@n-api.service[121402]: X-Role: member,reader Nov 01 18:58:34.162638 n-d-863052-2 devstack@n-api.service[121402]: X-Roles: member,reader Nov 01 18:58:34.164014 n-d-863052-2 devstack@n-api.service[121402]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/e3bd3f356d364e11b14d90d71cb5d598"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/e3bd3f356d364e11b14d90d71cb5d598"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_e3bd3f356d364e11b14d90d71cb5d598", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/e3bd3f356d364e11b14d90d71cb5d598"}]}] Nov 01 18:58:34.164014 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-296725392 Nov 01 18:58:34.164014 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant-Id: e3bd3f356d364e11b14d90d71cb5d598 Nov 01 18:58:34.164014 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-296725392 Nov 01 18:58:34.164014 n-d-863052-2 devstack@n-api.service[121402]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-296725392-project Nov 01 18:58:34.164014 n-d-863052-2 devstack@n-api.service[121402]: X-User-Domain-Id: default Nov 01 18:58:34.164014 n-d-863052-2 devstack@n-api.service[121402]: X-User-Domain-Name: Default Nov 01 18:58:34.164014 n-d-863052-2 devstack@n-api.service[121402]: X-User-Id: d40b11c70b8e40d0b7e7f5f7d2967184 Nov 01 18:58:34.164014 n-d-863052-2 devstack@n-api.service[121402]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-296725392-project Nov 01 18:58:34.164014 n-d-863052-2 devstack@n-api.service[121402]: Nov 01 18:58:34.164014 n-d-863052-2 devstack@n-api.service[121402]: {"addFloatingIp": {"address": "0.0.0.0"}} Nov 01 18:58:34.164014 n-d-863052-2 devstack@n-api.service[121402]: method: Nov 01 18:58:34.164014 n-d-863052-2 devstack@n-api.service[121402]: exception: floating IP not found Nov 01 18:58:34.164846 n-d-863052-2 devstack@n-api.service[121402]: action_args: {'id': '8e62f12b-8b96-414a-8099-0f9acb7fabf5', 'body': {'addFloatingIp': {'address': '0.0.0.0'}}} Nov 01 18:58:34.164846 n-d-863052-2 devstack@n-api.service[121402]: {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 01 18:58:34.164846 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:58:34.164846 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 239, in _add_floating_ip Nov 01 18:58:34.164846 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi self.network_api.associate_floating_ip(context, instance, Nov 01 18:58:34.164846 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 165, in wrapper Nov 01 18:58:34.164846 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi res = f(self, context, *args, **kwargs) Nov 01 18:58:34.164846 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2699, in associate_floating_ip Nov 01 18:58:34.164846 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi fip = self._get_floating_ip_by_address(client, floating_address) Nov 01 18:58:34.164846 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 3011, in _get_floating_ip_by_address Nov 01 18:58:34.164846 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFoundForAddress(address=address) Nov 01 18:58:34.164846 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFoundForAddress: Floating IP not found for address 0.0.0.0. Nov 01 18:58:34.164846 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 18:58:34.164846 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 18:58:34.164846 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 18:58:34.164846 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:58:34.164846 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 18:58:34.164846 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 18:58:34.164846 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 01 18:58:34.166109 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 01 18:58:34.166109 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 01 18:58:34.166109 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 01 18:58:34.166109 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 01 18:58:34.166109 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 01 18:58:34.166109 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 01 18:58:34.166109 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 01 18:58:34.166109 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 252, in _add_floating_ip Nov 01 18:58:34.166109 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Nov 01 18:58:34.166109 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: floating IP not found Nov 01 18:58:34.166109 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 18:58:34.166109 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 18:58:34.166109 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 18:58:34.166109 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:58:34.166109 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 18:58:34.166109 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 18:58:34.166109 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 01 18:58:34.166109 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 01 18:58:34.166109 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: floating IP not found Nov 01 18:58:34.166109 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 18:58:34.174828 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-3140dbaf-0b1f-4cdf-aa19-f7cf49079185 tempest-FloatingIPsAssociationNegativeTestJSON-296725392 tempest-FloatingIPsAssociationNegativeTestJSON-296725392-project] Returning 404 to user: floating IP not found {{(pid=121402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 01 18:58:34.176796 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-3140dbaf-0b1f-4cdf-aa19-f7cf49079185 tempest-FloatingIPsAssociationNegativeTestJSON-296725392 tempest-FloatingIPsAssociationNegativeTestJSON-296725392-project] 10.222.0.13 "POST /compute/v2.1/servers/8e62f12b-8b96-414a-8099-0f9acb7fabf5/action" status: 404 len: 67 microversion: 2.1 time: 0.233948 Nov 01 18:58:34.193463 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 630/1224] 10.222.0.13 () {60 vars in 1278 bytes} [Tue Nov 1 18:58:33 2022] POST /compute/v2.1/servers/8e62f12b-8b96-414a-8099-0f9acb7fabf5/action => generated 67 bytes in 252 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 01 18:58:34.198191 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-af1d1609-231b-408a-81d4-75bdd13e16d8 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:58:34.198691 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-af1d1609-231b-408a-81d4-75bdd13e16d8 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] [instance: e43fa43a-f523-4438-a8ba-a4460ea4a210] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:58:34.204857 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-af1d1609-231b-408a-81d4-75bdd13e16d8 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:34.205271 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-af1d1609-231b-408a-81d4-75bdd13e16d8 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:34.205705 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-af1d1609-231b-408a-81d4-75bdd13e16d8 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:34.206397 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-af1d1609-231b-408a-81d4-75bdd13e16d8 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:34.207476 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-af1d1609-231b-408a-81d4-75bdd13e16d8 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:34.207476 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-af1d1609-231b-408a-81d4-75bdd13e16d8 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:34.221191 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.wsgi [None req-af1d1609-231b-408a-81d4-75bdd13e16d8 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] HTTP exception thrown: Instance e43fa43a-f523-4438-a8ba-a4460ea4a210 could not be found. Nov 01 18:58:34.222757 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-af1d1609-231b-408a-81d4-75bdd13e16d8 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Request method failure captured: Nov 01 18:58:34.222757 n-d-863052-2 devstack@n-api.service[121402]: request: DELETE /compute/v2.1/servers/e43fa43a-f523-4438-a8ba-a4460ea4a210 HTTP/1.1 Nov 01 18:58:34.222757 n-d-863052-2 devstack@n-api.service[121402]: Accept: application/json Nov 01 18:58:34.222757 n-d-863052-2 devstack@n-api.service[121402]: Accept-Encoding: identity Nov 01 18:58:34.222757 n-d-863052-2 devstack@n-api.service[121402]: Connection: close Nov 01 18:58:34.222757 n-d-863052-2 devstack@n-api.service[121402]: Content-Length: 0 Nov 01 18:58:34.222757 n-d-863052-2 devstack@n-api.service[121402]: Content-Type: application/json Nov 01 18:58:34.222757 n-d-863052-2 devstack@n-api.service[121402]: Host: 10.222.0.13 Nov 01 18:58:34.222757 n-d-863052-2 devstack@n-api.service[121402]: Openstack-System-Scope: None Nov 01 18:58:34.222757 n-d-863052-2 devstack@n-api.service[121402]: User-Agent: python-urllib3/1.26.12 Nov 01 18:58:34.222757 n-d-863052-2 devstack@n-api.service[121402]: X-Auth-Token: gAAAAABjYWvqbQtaNCf0vN3RIHicQ7eZzuMpptpvowYCNSOJcJRxrJ9QX4Bvdyyh6S1_lak_JDolcn4qSC02atGGl8uI3NqpWQKt52qXcbtBLMPpaEiNHqRmhd3SjpSTdiucZ2dSpVmatQ9uPpkpENeFkI_E8IIwNVu5-V-pSAlLNGA0j86IptM Nov 01 18:58:34.222757 n-d-863052-2 devstack@n-api.service[121402]: X-Domain-Id: None Nov 01 18:58:34.222757 n-d-863052-2 devstack@n-api.service[121402]: X-Domain-Name: None Nov 01 18:58:34.222757 n-d-863052-2 devstack@n-api.service[121402]: X-Identity-Status: Confirmed Nov 01 18:58:34.222757 n-d-863052-2 devstack@n-api.service[121402]: X-Is-Admin-Project: True Nov 01 18:58:34.222757 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Domain-Id: default Nov 01 18:58:34.222757 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Domain-Name: Default Nov 01 18:58:34.222757 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Id: 708bc0ea4b5a4baf81933725792bedd5 Nov 01 18:58:34.222757 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1431666313 Nov 01 18:58:34.222757 n-d-863052-2 devstack@n-api.service[121402]: X-Role: member,reader Nov 01 18:58:34.222757 n-d-863052-2 devstack@n-api.service[121402]: X-Roles: member,reader Nov 01 18:58:34.224316 n-d-863052-2 devstack@n-api.service[121402]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/708bc0ea4b5a4baf81933725792bedd5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/708bc0ea4b5a4baf81933725792bedd5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_708bc0ea4b5a4baf81933725792bedd5", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/708bc0ea4b5a4baf81933725792bedd5"}]}] Nov 01 18:58:34.224316 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1431666313 Nov 01 18:58:34.224316 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant-Id: 708bc0ea4b5a4baf81933725792bedd5 Nov 01 18:58:34.224316 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1431666313 Nov 01 18:58:34.224316 n-d-863052-2 devstack@n-api.service[121402]: X-User: tempest-ImagesOneServerNegativeTestJSON-1431666313-project Nov 01 18:58:34.224316 n-d-863052-2 devstack@n-api.service[121402]: X-User-Domain-Id: default Nov 01 18:58:34.224316 n-d-863052-2 devstack@n-api.service[121402]: X-User-Domain-Name: Default Nov 01 18:58:34.224316 n-d-863052-2 devstack@n-api.service[121402]: X-User-Id: 09b52b7dcbb044f9bfc424e4417c77fa Nov 01 18:58:34.224316 n-d-863052-2 devstack@n-api.service[121402]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1431666313-project Nov 01 18:58:34.224316 n-d-863052-2 devstack@n-api.service[121402]: method: > Nov 01 18:58:34.224316 n-d-863052-2 devstack@n-api.service[121402]: exception: Instance e43fa43a-f523-4438-a8ba-a4460ea4a210 could not be found. Nov 01 18:58:34.224316 n-d-863052-2 devstack@n-api.service[121402]: action_args: {'id': 'e43fa43a-f523-4438-a8ba-a4460ea4a210'} Nov 01 18:58:34.225182 n-d-863052-2 devstack@n-api.service[121402]: {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 01 18:58:34.225182 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:58:34.225182 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 01 18:58:34.225182 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 01 18:58:34.225182 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 01 18:58:34.225182 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 01 18:58:34.225182 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 01 18:58:34.225182 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 01 18:58:34.225182 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 01 18:58:34.225182 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 01 18:58:34.225182 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e43fa43a-f523-4438-a8ba-a4460ea4a210 could not be found. Nov 01 18:58:34.225182 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 18:58:34.225182 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 18:58:34.225182 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 18:58:34.225182 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:58:34.225182 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 18:58:34.225182 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 18:58:34.225182 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 01 18:58:34.225182 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 01 18:58:34.225182 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 01 18:58:34.226642 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 01 18:58:34.226642 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 01 18:58:34.226642 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 01 18:58:34.226642 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 01 18:58:34.226642 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 01 18:58:34.226642 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 01 18:58:34.226642 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 01 18:58:34.226642 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 01 18:58:34.226642 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 01 18:58:34.226642 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e43fa43a-f523-4438-a8ba-a4460ea4a210 could not be found. Nov 01 18:58:34.226642 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 18:58:34.226642 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 18:58:34.226642 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 18:58:34.226642 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:58:34.226642 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 18:58:34.226642 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 18:58:34.226642 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 01 18:58:34.226642 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 01 18:58:34.226642 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e43fa43a-f523-4438-a8ba-a4460ea4a210 could not be found. Nov 01 18:58:34.226642 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 18:58:34.228157 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-af1d1609-231b-408a-81d4-75bdd13e16d8 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Returning 404 to user: Instance e43fa43a-f523-4438-a8ba-a4460ea4a210 could not be found. {{(pid=121402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 01 18:58:34.228157 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-af1d1609-231b-408a-81d4-75bdd13e16d8 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] 10.222.0.13 "DELETE /compute/v2.1/servers/e43fa43a-f523-4438-a8ba-a4460ea4a210" status: 404 len: 111 microversion: 2.1 time: 0.029782 Nov 01 18:58:34.228157 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 631/1225] 10.222.0.13 () {58 vars in 1239 bytes} [Tue Nov 1 18:58:34 2022] DELETE /compute/v2.1/servers/e43fa43a-f523-4438-a8ba-a4460ea4a210 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 01 18:58:34.229039 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-3a35c730-c0b9-48a3-b157-dbca87d4165b tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:58:34.229636 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-3a35c730-c0b9-48a3-b157-dbca87d4165b tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] [instance: 2d525a31-b0be-44cb-8fb7-335075145f08] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:58:34.236146 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-3a35c730-c0b9-48a3-b157-dbca87d4165b tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:34.236725 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-3a35c730-c0b9-48a3-b157-dbca87d4165b tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:34.237161 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-3a35c730-c0b9-48a3-b157-dbca87d4165b tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:34.237861 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-3a35c730-c0b9-48a3-b157-dbca87d4165b tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:34.238312 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-3a35c730-c0b9-48a3-b157-dbca87d4165b tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:34.238730 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-3a35c730-c0b9-48a3-b157-dbca87d4165b tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:34.389116 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-da7722b9-0dae-40b8-9c04-8bca72df4911 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72117f17294649d6b8bc16c66c7efab2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45d4c047d3c44324a27a27831236ab0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:58:34.409806 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-da7722b9-0dae-40b8-9c04-8bca72df4911 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] 10.222.0.13 "GET /compute/v2.1/servers/9249c81d-e57b-4985-a398-8ad97526d5c7" status: 200 len: 1543 microversion: 2.1 time: 0.410800 Nov 01 18:58:34.414671 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 595/1226] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:58:33 2022] GET /compute/v2.1/servers/9249c81d-e57b-4985-a398-8ad97526d5c7 => generated 1543 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:58:34.423166 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-13038c34-e7d2-480f-822a-5e8f6f47b7cd tempest-FloatingIPsAssociationNegativeTestJSON-296725392 tempest-FloatingIPsAssociationNegativeTestJSON-296725392-project] Action: 'action', calling method: .version_select at 0x7f0ae4c270d0>, body: {"removeFloatingIp": {"address": "0.0.0.0"}} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 18:58:34.488233 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.wsgi [None req-13038c34-e7d2-480f-822a-5e8f6f47b7cd tempest-FloatingIPsAssociationNegativeTestJSON-296725392 tempest-FloatingIPsAssociationNegativeTestJSON-296725392-project] HTTP exception thrown: Floating IP not found for address 0.0.0.0. Nov 01 18:58:34.490695 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-13038c34-e7d2-480f-822a-5e8f6f47b7cd tempest-FloatingIPsAssociationNegativeTestJSON-296725392 tempest-FloatingIPsAssociationNegativeTestJSON-296725392-project] Request method failure captured: Nov 01 18:58:34.490695 n-d-863052-2 devstack@n-api.service[121403]: request: POST /compute/v2.1/servers/8e62f12b-8b96-414a-8099-0f9acb7fabf5/action HTTP/1.1 Nov 01 18:58:34.490695 n-d-863052-2 devstack@n-api.service[121403]: Accept: application/json Nov 01 18:58:34.490695 n-d-863052-2 devstack@n-api.service[121403]: Accept-Encoding: identity Nov 01 18:58:34.490695 n-d-863052-2 devstack@n-api.service[121403]: Connection: close Nov 01 18:58:34.490695 n-d-863052-2 devstack@n-api.service[121403]: Content-Length: 44 Nov 01 18:58:34.490695 n-d-863052-2 devstack@n-api.service[121403]: Content-Type: application/json Nov 01 18:58:34.490695 n-d-863052-2 devstack@n-api.service[121403]: Host: 10.222.0.13 Nov 01 18:58:34.490695 n-d-863052-2 devstack@n-api.service[121403]: Openstack-System-Scope: None Nov 01 18:58:34.490695 n-d-863052-2 devstack@n-api.service[121403]: User-Agent: python-urllib3/1.26.12 Nov 01 18:58:34.490695 n-d-863052-2 devstack@n-api.service[121403]: X-Auth-Token: gAAAAABjYWw1SF5PPvMdN953udCJyfDa_Bfcqy7XVXpdqAKP1KG1AiUlssdsx9OB7pwmIJI0BFf9a3oyI_tT1BfoNA4axNUyVUKrPnNPLB3yEU3vYhuOsCWAaR_lCoKebniusNWQyFM6MZhXiwRWovoCjGCBPgyULskL-0T-0PDaS4BfSFiov1c Nov 01 18:58:34.490695 n-d-863052-2 devstack@n-api.service[121403]: X-Domain-Id: None Nov 01 18:58:34.490695 n-d-863052-2 devstack@n-api.service[121403]: X-Domain-Name: None Nov 01 18:58:34.490695 n-d-863052-2 devstack@n-api.service[121403]: X-Identity-Status: Confirmed Nov 01 18:58:34.490695 n-d-863052-2 devstack@n-api.service[121403]: X-Is-Admin-Project: True Nov 01 18:58:34.490695 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Domain-Id: default Nov 01 18:58:34.490695 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Domain-Name: Default Nov 01 18:58:34.490695 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Id: e3bd3f356d364e11b14d90d71cb5d598 Nov 01 18:58:34.490695 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-296725392 Nov 01 18:58:34.490695 n-d-863052-2 devstack@n-api.service[121403]: X-Role: member,reader Nov 01 18:58:34.490695 n-d-863052-2 devstack@n-api.service[121403]: X-Roles: member,reader Nov 01 18:58:34.492037 n-d-863052-2 devstack@n-api.service[121403]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/e3bd3f356d364e11b14d90d71cb5d598"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/e3bd3f356d364e11b14d90d71cb5d598"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_e3bd3f356d364e11b14d90d71cb5d598", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/e3bd3f356d364e11b14d90d71cb5d598"}]}] Nov 01 18:58:34.492037 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-296725392 Nov 01 18:58:34.492037 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant-Id: e3bd3f356d364e11b14d90d71cb5d598 Nov 01 18:58:34.492037 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-296725392 Nov 01 18:58:34.492037 n-d-863052-2 devstack@n-api.service[121403]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-296725392-project Nov 01 18:58:34.492037 n-d-863052-2 devstack@n-api.service[121403]: X-User-Domain-Id: default Nov 01 18:58:34.492037 n-d-863052-2 devstack@n-api.service[121403]: X-User-Domain-Name: Default Nov 01 18:58:34.492037 n-d-863052-2 devstack@n-api.service[121403]: X-User-Id: d40b11c70b8e40d0b7e7f5f7d2967184 Nov 01 18:58:34.492037 n-d-863052-2 devstack@n-api.service[121403]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-296725392-project Nov 01 18:58:34.492037 n-d-863052-2 devstack@n-api.service[121403]: Nov 01 18:58:34.492037 n-d-863052-2 devstack@n-api.service[121403]: {"removeFloatingIp": {"address": "0.0.0.0"}} Nov 01 18:58:34.492037 n-d-863052-2 devstack@n-api.service[121403]: method: Nov 01 18:58:34.492037 n-d-863052-2 devstack@n-api.service[121403]: exception: Floating IP not found for address 0.0.0.0. Nov 01 18:58:34.493067 n-d-863052-2 devstack@n-api.service[121403]: action_args: {'id': '8e62f12b-8b96-414a-8099-0f9acb7fabf5', 'body': {'removeFloatingIp': {'address': '0.0.0.0'}}} Nov 01 18:58:34.493067 n-d-863052-2 devstack@n-api.service[121403]: {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 01 18:58:34.493067 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:58:34.493067 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 58, in get_instance_by_floating_ip_addr Nov 01 18:58:34.493067 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi self.network_api.get_instance_id_by_floating_address( Nov 01 18:58:34.493067 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2927, in get_instance_id_by_floating_address Nov 01 18:58:34.493067 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi fip = self._get_floating_ip_by_address(client, address) Nov 01 18:58:34.493067 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 3011, in _get_floating_ip_by_address Nov 01 18:58:34.493067 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFoundForAddress(address=address) Nov 01 18:58:34.493067 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFoundForAddress: Floating IP not found for address 0.0.0.0. Nov 01 18:58:34.493067 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 18:58:34.493067 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 18:58:34.493067 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 18:58:34.493067 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:58:34.493067 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 18:58:34.493067 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 18:58:34.493067 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 01 18:58:34.493067 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 01 18:58:34.493067 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 01 18:58:34.494405 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 01 18:58:34.494405 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 01 18:58:34.494405 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 01 18:58:34.494405 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 01 18:58:34.494405 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 01 18:58:34.494405 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 277, in _remove_floating_ip Nov 01 18:58:34.494405 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi instance = get_instance_by_floating_ip_addr(self, context, address) Nov 01 18:58:34.494405 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 61, in get_instance_by_floating_ip_addr Nov 01 18:58:34.494405 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=ex.format_message()) Nov 01 18:58:34.494405 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for address 0.0.0.0. Nov 01 18:58:34.494405 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 18:58:34.494405 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 18:58:34.494405 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 18:58:34.494405 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:58:34.494405 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 18:58:34.494405 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 18:58:34.494405 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 01 18:58:34.494405 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 01 18:58:34.494405 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for address 0.0.0.0. Nov 01 18:58:34.494405 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 18:58:34.496780 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-13038c34-e7d2-480f-822a-5e8f6f47b7cd tempest-FloatingIPsAssociationNegativeTestJSON-296725392 tempest-FloatingIPsAssociationNegativeTestJSON-296725392-project] Returning 404 to user: Floating IP not found for address 0.0.0.0. {{(pid=121403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 01 18:58:34.498550 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-13038c34-e7d2-480f-822a-5e8f6f47b7cd tempest-FloatingIPsAssociationNegativeTestJSON-296725392 tempest-FloatingIPsAssociationNegativeTestJSON-296725392-project] 10.222.0.13 "POST /compute/v2.1/servers/8e62f12b-8b96-414a-8099-0f9acb7fabf5/action" status: 404 len: 88 microversion: 2.1 time: 0.081867 Nov 01 18:58:34.499457 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 596/1227] 10.222.0.13 () {60 vars in 1278 bytes} [Tue Nov 1 18:58:34 2022] POST /compute/v2.1/servers/8e62f12b-8b96-414a-8099-0f9acb7fabf5/action => generated 88 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 01 18:58:34.504835 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-21956287-11fb-4722-be55-5707e2c72d82 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:58:34.505716 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-21956287-11fb-4722-be55-5707e2c72d82 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] [instance: e43fa43a-f523-4438-a8ba-a4460ea4a210] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:58:34.516680 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-21956287-11fb-4722-be55-5707e2c72d82 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:34.517402 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-21956287-11fb-4722-be55-5707e2c72d82 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:34.518037 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-21956287-11fb-4722-be55-5707e2c72d82 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:34.518954 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-21956287-11fb-4722-be55-5707e2c72d82 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:34.519632 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-21956287-11fb-4722-be55-5707e2c72d82 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:34.520118 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-21956287-11fb-4722-be55-5707e2c72d82 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:34.528476 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-3a35c730-c0b9-48a3-b157-dbca87d4165b tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f32f5fba1976432d938e664c7714e52b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b9d4c236b944f9b2e8e502a50a8f8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:58:34.534870 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.wsgi [None req-21956287-11fb-4722-be55-5707e2c72d82 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] HTTP exception thrown: Instance e43fa43a-f523-4438-a8ba-a4460ea4a210 could not be found. Nov 01 18:58:34.536718 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-21956287-11fb-4722-be55-5707e2c72d82 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Request method failure captured: Nov 01 18:58:34.536718 n-d-863052-2 devstack@n-api.service[121403]: request: GET /compute/v2.1/servers/e43fa43a-f523-4438-a8ba-a4460ea4a210 HTTP/1.1 Nov 01 18:58:34.536718 n-d-863052-2 devstack@n-api.service[121403]: Accept: application/json Nov 01 18:58:34.536718 n-d-863052-2 devstack@n-api.service[121403]: Accept-Encoding: identity Nov 01 18:58:34.536718 n-d-863052-2 devstack@n-api.service[121403]: Connection: close Nov 01 18:58:34.536718 n-d-863052-2 devstack@n-api.service[121403]: Content-Length: 0 Nov 01 18:58:34.536718 n-d-863052-2 devstack@n-api.service[121403]: Content-Type: application/json Nov 01 18:58:34.536718 n-d-863052-2 devstack@n-api.service[121403]: Host: 10.222.0.13 Nov 01 18:58:34.536718 n-d-863052-2 devstack@n-api.service[121403]: Openstack-System-Scope: None Nov 01 18:58:34.536718 n-d-863052-2 devstack@n-api.service[121403]: User-Agent: python-urllib3/1.26.12 Nov 01 18:58:34.536718 n-d-863052-2 devstack@n-api.service[121403]: X-Auth-Token: gAAAAABjYWvqbQtaNCf0vN3RIHicQ7eZzuMpptpvowYCNSOJcJRxrJ9QX4Bvdyyh6S1_lak_JDolcn4qSC02atGGl8uI3NqpWQKt52qXcbtBLMPpaEiNHqRmhd3SjpSTdiucZ2dSpVmatQ9uPpkpENeFkI_E8IIwNVu5-V-pSAlLNGA0j86IptM Nov 01 18:58:34.536718 n-d-863052-2 devstack@n-api.service[121403]: X-Domain-Id: None Nov 01 18:58:34.536718 n-d-863052-2 devstack@n-api.service[121403]: X-Domain-Name: None Nov 01 18:58:34.536718 n-d-863052-2 devstack@n-api.service[121403]: X-Identity-Status: Confirmed Nov 01 18:58:34.536718 n-d-863052-2 devstack@n-api.service[121403]: X-Is-Admin-Project: True Nov 01 18:58:34.536718 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Domain-Id: default Nov 01 18:58:34.536718 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Domain-Name: Default Nov 01 18:58:34.536718 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Id: 708bc0ea4b5a4baf81933725792bedd5 Nov 01 18:58:34.536718 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1431666313 Nov 01 18:58:34.536718 n-d-863052-2 devstack@n-api.service[121403]: X-Role: member,reader Nov 01 18:58:34.536718 n-d-863052-2 devstack@n-api.service[121403]: X-Roles: member,reader Nov 01 18:58:34.554659 n-d-863052-2 devstack@n-api.service[121403]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/708bc0ea4b5a4baf81933725792bedd5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/708bc0ea4b5a4baf81933725792bedd5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_708bc0ea4b5a4baf81933725792bedd5", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/708bc0ea4b5a4baf81933725792bedd5"}]}] Nov 01 18:58:34.554659 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1431666313 Nov 01 18:58:34.554659 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant-Id: 708bc0ea4b5a4baf81933725792bedd5 Nov 01 18:58:34.554659 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1431666313 Nov 01 18:58:34.554659 n-d-863052-2 devstack@n-api.service[121403]: X-User: tempest-ImagesOneServerNegativeTestJSON-1431666313-project Nov 01 18:58:34.554659 n-d-863052-2 devstack@n-api.service[121403]: X-User-Domain-Id: default Nov 01 18:58:34.554659 n-d-863052-2 devstack@n-api.service[121403]: X-User-Domain-Name: Default Nov 01 18:58:34.554659 n-d-863052-2 devstack@n-api.service[121403]: X-User-Id: 09b52b7dcbb044f9bfc424e4417c77fa Nov 01 18:58:34.554659 n-d-863052-2 devstack@n-api.service[121403]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1431666313-project Nov 01 18:58:34.554659 n-d-863052-2 devstack@n-api.service[121403]: method: > Nov 01 18:58:34.554659 n-d-863052-2 devstack@n-api.service[121403]: exception: Instance e43fa43a-f523-4438-a8ba-a4460ea4a210 could not be found. Nov 01 18:58:34.554659 n-d-863052-2 devstack@n-api.service[121403]: action_args: {'id': 'e43fa43a-f523-4438-a8ba-a4460ea4a210'} Nov 01 18:58:34.555699 n-d-863052-2 devstack@n-api.service[121403]: {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 01 18:58:34.555699 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:58:34.555699 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 01 18:58:34.555699 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 01 18:58:34.555699 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 01 18:58:34.555699 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 01 18:58:34.555699 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 01 18:58:34.555699 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 01 18:58:34.555699 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 01 18:58:34.555699 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 01 18:58:34.555699 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e43fa43a-f523-4438-a8ba-a4460ea4a210 could not be found. Nov 01 18:58:34.555699 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 18:58:34.555699 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 18:58:34.555699 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 18:58:34.555699 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:58:34.555699 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 18:58:34.555699 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 18:58:34.555699 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 01 18:58:34.555699 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 01 18:58:34.555699 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 01 18:58:34.557021 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 01 18:58:34.557021 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 01 18:58:34.557021 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 01 18:58:34.557021 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 01 18:58:34.557021 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 01 18:58:34.557021 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 01 18:58:34.557021 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 01 18:58:34.557021 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e43fa43a-f523-4438-a8ba-a4460ea4a210 could not be found. Nov 01 18:58:34.557021 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 18:58:34.557021 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 18:58:34.557021 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 18:58:34.557021 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:58:34.557021 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 18:58:34.557021 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 18:58:34.557021 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 01 18:58:34.557021 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 01 18:58:34.557021 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e43fa43a-f523-4438-a8ba-a4460ea4a210 could not be found. Nov 01 18:58:34.557021 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 18:58:34.558099 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-3a35c730-c0b9-48a3-b157-dbca87d4165b tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] 10.222.0.13 "GET /compute/v2.1/servers/2d525a31-b0be-44cb-8fb7-335075145f08" status: 200 len: 1718 microversion: 2.1 time: 0.311703 Nov 01 18:58:34.558099 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 632/1228] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:58:34 2022] GET /compute/v2.1/servers/2d525a31-b0be-44cb-8fb7-335075145f08 => generated 1718 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:58:34.558099 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-d26d7517-d860-4d2b-9d7d-9fdd724e08c0 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:58:34.558099 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-d26d7517-d860-4d2b-9d7d-9fdd724e08c0 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] [instance: 9dbe3d05-9fa8-4fd2-8415-52bfe6ee5801] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:58:34.559350 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-21956287-11fb-4722-be55-5707e2c72d82 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Returning 404 to user: Instance e43fa43a-f523-4438-a8ba-a4460ea4a210 could not be found. {{(pid=121403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 01 18:58:34.561049 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-21956287-11fb-4722-be55-5707e2c72d82 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] 10.222.0.13 "GET /compute/v2.1/servers/e43fa43a-f523-4438-a8ba-a4460ea4a210" status: 404 len: 111 microversion: 2.1 time: 0.060305 Nov 01 18:58:34.566447 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 597/1229] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:58:34 2022] GET /compute/v2.1/servers/e43fa43a-f523-4438-a8ba-a4460ea4a210 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 01 18:58:34.570465 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-d26d7517-d860-4d2b-9d7d-9fdd724e08c0 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:34.570989 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-d26d7517-d860-4d2b-9d7d-9fdd724e08c0 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:34.571926 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-d26d7517-d860-4d2b-9d7d-9fdd724e08c0 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:34.572392 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-2170c184-4146-491b-97fc-2c98ba61b47e tempest-FloatingIPsAssociationNegativeTestJSON-296725392 tempest-FloatingIPsAssociationNegativeTestJSON-296725392-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:58:34.572663 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-d26d7517-d860-4d2b-9d7d-9fdd724e08c0 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:34.573122 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-d26d7517-d860-4d2b-9d7d-9fdd724e08c0 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:34.573433 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-2170c184-4146-491b-97fc-2c98ba61b47e tempest-FloatingIPsAssociationNegativeTestJSON-296725392 tempest-FloatingIPsAssociationNegativeTestJSON-296725392-project] [instance: 8e62f12b-8b96-414a-8099-0f9acb7fabf5] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:58:34.573545 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-d26d7517-d860-4d2b-9d7d-9fdd724e08c0 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:34.580797 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-2170c184-4146-491b-97fc-2c98ba61b47e tempest-FloatingIPsAssociationNegativeTestJSON-296725392 tempest-FloatingIPsAssociationNegativeTestJSON-296725392-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:34.581792 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-2170c184-4146-491b-97fc-2c98ba61b47e tempest-FloatingIPsAssociationNegativeTestJSON-296725392 tempest-FloatingIPsAssociationNegativeTestJSON-296725392-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:34.582480 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-2170c184-4146-491b-97fc-2c98ba61b47e tempest-FloatingIPsAssociationNegativeTestJSON-296725392 tempest-FloatingIPsAssociationNegativeTestJSON-296725392-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:34.583527 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-2170c184-4146-491b-97fc-2c98ba61b47e tempest-FloatingIPsAssociationNegativeTestJSON-296725392 tempest-FloatingIPsAssociationNegativeTestJSON-296725392-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:34.584143 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-2170c184-4146-491b-97fc-2c98ba61b47e tempest-FloatingIPsAssociationNegativeTestJSON-296725392 tempest-FloatingIPsAssociationNegativeTestJSON-296725392-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:34.584766 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-2170c184-4146-491b-97fc-2c98ba61b47e tempest-FloatingIPsAssociationNegativeTestJSON-296725392 tempest-FloatingIPsAssociationNegativeTestJSON-296725392-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:34.613694 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-2170c184-4146-491b-97fc-2c98ba61b47e tempest-FloatingIPsAssociationNegativeTestJSON-296725392 tempest-FloatingIPsAssociationNegativeTestJSON-296725392-project] [instance: 8e62f12b-8b96-414a-8099-0f9acb7fabf5] Going to try to terminate instance {{(pid=121403) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 01 18:58:34.711086 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-2170c184-4146-491b-97fc-2c98ba61b47e tempest-FloatingIPsAssociationNegativeTestJSON-296725392 tempest-FloatingIPsAssociationNegativeTestJSON-296725392-project] 10.222.0.13 "DELETE /compute/v2.1/servers/8e62f12b-8b96-414a-8099-0f9acb7fabf5" status: 204 len: 0 microversion: 2.1 time: 0.142838 Nov 01 18:58:34.712925 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 598/1230] 10.222.0.13 () {58 vars in 1239 bytes} [Tue Nov 1 18:58:34 2022] DELETE /compute/v2.1/servers/8e62f12b-8b96-414a-8099-0f9acb7fabf5 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 01 18:58:34.722390 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-a2f2b9a6-62c5-4ccb-b858-adc982dc3ab7 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Calling method '.version_select at 0x7f0ae68158b0>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:58:34.755512 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-a2f2b9a6-62c5-4ccb-b858-adc982dc3ab7 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1505489971" status: 202 len: 0 microversion: 2.1 time: 0.040726 Nov 01 18:58:34.762437 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 599/1231] 10.222.0.13 () {58 vars in 1221 bytes} [Tue Nov 1 18:58:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1505489971 => generated 0 bytes in 49 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 01 18:58:34.770788 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-d26d7517-d860-4d2b-9d7d-9fdd724e08c0 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0290a6bb8bc24b8988a925327ac0381c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86941784237549838bba63ce88053b88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:58:34.777563 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-626f0bbf-31c1-4365-a4cf-b981c0dc79c3 tempest-FloatingIPsAssociationNegativeTestJSON-296725392 tempest-FloatingIPsAssociationNegativeTestJSON-296725392-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:58:34.779086 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-626f0bbf-31c1-4365-a4cf-b981c0dc79c3 tempest-FloatingIPsAssociationNegativeTestJSON-296725392 tempest-FloatingIPsAssociationNegativeTestJSON-296725392-project] [instance: 8e62f12b-8b96-414a-8099-0f9acb7fabf5] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:58:34.780171 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-d26d7517-d860-4d2b-9d7d-9fdd724e08c0 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] 10.222.0.13 "GET /compute/v2.1/servers/9dbe3d05-9fa8-4fd2-8415-52bfe6ee5801" status: 200 len: 1319 microversion: 2.1 time: 0.241218 Nov 01 18:58:34.780998 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 633/1232] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:58:34 2022] GET /compute/v2.1/servers/9dbe3d05-9fa8-4fd2-8415-52bfe6ee5801 => generated 1319 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:58:34.800402 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-626f0bbf-31c1-4365-a4cf-b981c0dc79c3 tempest-FloatingIPsAssociationNegativeTestJSON-296725392 tempest-FloatingIPsAssociationNegativeTestJSON-296725392-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:34.803093 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-626f0bbf-31c1-4365-a4cf-b981c0dc79c3 tempest-FloatingIPsAssociationNegativeTestJSON-296725392 tempest-FloatingIPsAssociationNegativeTestJSON-296725392-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:34.804685 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-626f0bbf-31c1-4365-a4cf-b981c0dc79c3 tempest-FloatingIPsAssociationNegativeTestJSON-296725392 tempest-FloatingIPsAssociationNegativeTestJSON-296725392-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:34.805451 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-626f0bbf-31c1-4365-a4cf-b981c0dc79c3 tempest-FloatingIPsAssociationNegativeTestJSON-296725392 tempest-FloatingIPsAssociationNegativeTestJSON-296725392-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:34.805924 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-626f0bbf-31c1-4365-a4cf-b981c0dc79c3 tempest-FloatingIPsAssociationNegativeTestJSON-296725392 tempest-FloatingIPsAssociationNegativeTestJSON-296725392-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:34.813190 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-626f0bbf-31c1-4365-a4cf-b981c0dc79c3 tempest-FloatingIPsAssociationNegativeTestJSON-296725392 tempest-FloatingIPsAssociationNegativeTestJSON-296725392-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:34.891961 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-1a78eead-b766-4152-9f63-3b86049b2360 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:58:34.892813 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-1a78eead-b766-4152-9f63-3b86049b2360 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] [instance: ea631032-dd04-429b-988e-e6362ea42cf7] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:58:34.902976 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-1a78eead-b766-4152-9f63-3b86049b2360 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:34.905727 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-1a78eead-b766-4152-9f63-3b86049b2360 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:34.907127 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-1a78eead-b766-4152-9f63-3b86049b2360 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:34.908064 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-1a78eead-b766-4152-9f63-3b86049b2360 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:34.908539 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-1a78eead-b766-4152-9f63-3b86049b2360 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:34.908990 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-1a78eead-b766-4152-9f63-3b86049b2360 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:34.921076 n-d-863052-2 devstack@n-api.service[121403]: DEBUG dbcounter [-] [121403] Writing DB stats nova_cell0:SELECT=4 {{(pid=121403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 18:58:34.990607 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-1a78eead-b766-4152-9f63-3b86049b2360 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c1314c21d8547ff890ede1c2ad281c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c804370880454c7aa02cef2c2c3cf144', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:58:34.999929 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-1a78eead-b766-4152-9f63-3b86049b2360 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c1314c21d8547ff890ede1c2ad281c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c804370880454c7aa02cef2c2c3cf144', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:58:35.001754 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-1a78eead-b766-4152-9f63-3b86049b2360 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c1314c21d8547ff890ede1c2ad281c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c804370880454c7aa02cef2c2c3cf144', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:58:35.008069 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-1a78eead-b766-4152-9f63-3b86049b2360 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] 10.222.0.13 "GET /compute/v2.1/servers/ea631032-dd04-429b-988e-e6362ea42cf7" status: 200 len: 1544 microversion: 2.91 time: 0.120253 Nov 01 18:58:35.009023 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 634/1233] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 18:58:34 2022] GET /compute/v2.1/servers/ea631032-dd04-429b-988e-e6362ea42cf7 => generated 1544 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 18:58:35.021372 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-b1e3a62c-607d-475a-ad5c-ac3e34ca6994 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:58:35.022396 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-b1e3a62c-607d-475a-ad5c-ac3e34ca6994 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] [instance: 869ca597-f199-474f-a680-59b0a75512c7] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:58:35.028403 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b1e3a62c-607d-475a-ad5c-ac3e34ca6994 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:35.028939 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b1e3a62c-607d-475a-ad5c-ac3e34ca6994 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:35.029467 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b1e3a62c-607d-475a-ad5c-ac3e34ca6994 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:35.030351 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b1e3a62c-607d-475a-ad5c-ac3e34ca6994 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:35.030822 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b1e3a62c-607d-475a-ad5c-ac3e34ca6994 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:35.031440 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b1e3a62c-607d-475a-ad5c-ac3e34ca6994 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:35.060837 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-626f0bbf-31c1-4365-a4cf-b981c0dc79c3 tempest-FloatingIPsAssociationNegativeTestJSON-296725392 tempest-FloatingIPsAssociationNegativeTestJSON-296725392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd40b11c70b8e40d0b7e7f5f7d2967184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bd3f356d364e11b14d90d71cb5d598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:58:35.072112 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-626f0bbf-31c1-4365-a4cf-b981c0dc79c3 tempest-FloatingIPsAssociationNegativeTestJSON-296725392 tempest-FloatingIPsAssociationNegativeTestJSON-296725392-project] 10.222.0.13 "GET /compute/v2.1/servers/8e62f12b-8b96-414a-8099-0f9acb7fabf5" status: 200 len: 1542 microversion: 2.1 time: 0.307371 Nov 01 18:58:35.085359 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 600/1234] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:58:34 2022] GET /compute/v2.1/servers/8e62f12b-8b96-414a-8099-0f9acb7fabf5 => generated 1542 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:58:35.190486 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-b1e3a62c-607d-475a-ad5c-ac3e34ca6994 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a63d69c99a546f0af16329cff3ca717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a1bb191cff948e99c008b5e861ce4a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:58:35.198886 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-b1e3a62c-607d-475a-ad5c-ac3e34ca6994 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] 10.222.0.13 "GET /compute/v2.1/servers/869ca597-f199-474f-a680-59b0a75512c7" status: 200 len: 1500 microversion: 2.1 time: 0.182909 Nov 01 18:58:35.199781 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 635/1235] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:58:35 2022] GET /compute/v2.1/servers/869ca597-f199-474f-a680-59b0a75512c7 => generated 1500 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:58:35.223267 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-b5472260-2ae1-4061-acf9-31c74c605c9c tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:58:35.224268 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-b5472260-2ae1-4061-acf9-31c74c605c9c tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] [instance: ed4798be-a45e-46f5-8f7e-1165f6479bd1] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:58:35.226372 n-d-863052-2 devstack@n-api.service[121403]: DEBUG dbcounter [-] [121403] Writing DB stats nova_cell0:SELECT=30 {{(pid=121403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 18:58:35.232301 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-b5472260-2ae1-4061-acf9-31c74c605c9c tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:35.233355 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-b5472260-2ae1-4061-acf9-31c74c605c9c tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:35.233854 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-b5472260-2ae1-4061-acf9-31c74c605c9c tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:35.235435 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-b5472260-2ae1-4061-acf9-31c74c605c9c tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:35.236798 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-b5472260-2ae1-4061-acf9-31c74c605c9c tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:35.237297 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-b5472260-2ae1-4061-acf9-31c74c605c9c tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:35.441373 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-137b11aa-d15d-4009-9f0a-7bb0eef085d4 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:58:35.441876 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-137b11aa-d15d-4009-9f0a-7bb0eef085d4 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] [instance: 9249c81d-e57b-4985-a398-8ad97526d5c7] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:58:35.449618 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-137b11aa-d15d-4009-9f0a-7bb0eef085d4 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:35.450131 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-137b11aa-d15d-4009-9f0a-7bb0eef085d4 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:35.450582 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-137b11aa-d15d-4009-9f0a-7bb0eef085d4 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:35.451608 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-137b11aa-d15d-4009-9f0a-7bb0eef085d4 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:35.452100 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-137b11aa-d15d-4009-9f0a-7bb0eef085d4 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:35.452511 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-137b11aa-d15d-4009-9f0a-7bb0eef085d4 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:35.461865 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-b5472260-2ae1-4061-acf9-31c74c605c9c tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a63d69c99a546f0af16329cff3ca717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a1bb191cff948e99c008b5e861ce4a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:58:35.473072 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-b5472260-2ae1-4061-acf9-31c74c605c9c tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] 10.222.0.13 "GET /compute/v2.1/servers/ed4798be-a45e-46f5-8f7e-1165f6479bd1" status: 200 len: 1515 microversion: 2.1 time: 0.255107 Nov 01 18:58:35.474281 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 601/1236] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:58:35 2022] GET /compute/v2.1/servers/ed4798be-a45e-46f5-8f7e-1165f6479bd1 => generated 1515 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:58:35.495856 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-d20beb0a-8305-4a8f-8069-b866ffe17d72 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Action: 'action', calling method: >, body: {"rescue": {}} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 18:58:35.498670 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-d20beb0a-8305-4a8f-8069-b866ffe17d72 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] [instance: 5e659e78-6a97-4ffd-93d5-ed462b51212d] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:58:35.504443 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.wsgi [None req-d20beb0a-8305-4a8f-8069-b866ffe17d72 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] HTTP exception thrown: Instance 5e659e78-6a97-4ffd-93d5-ed462b51212d could not be found. Nov 01 18:58:35.506577 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-d20beb0a-8305-4a8f-8069-b866ffe17d72 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Request method failure captured: Nov 01 18:58:35.506577 n-d-863052-2 devstack@n-api.service[121403]: request: POST /compute/v2.1/servers/5e659e78-6a97-4ffd-93d5-ed462b51212d/action HTTP/1.1 Nov 01 18:58:35.506577 n-d-863052-2 devstack@n-api.service[121403]: Accept: application/json Nov 01 18:58:35.506577 n-d-863052-2 devstack@n-api.service[121403]: Accept-Encoding: identity Nov 01 18:58:35.506577 n-d-863052-2 devstack@n-api.service[121403]: Connection: close Nov 01 18:58:35.506577 n-d-863052-2 devstack@n-api.service[121403]: Content-Length: 14 Nov 01 18:58:35.506577 n-d-863052-2 devstack@n-api.service[121403]: Content-Type: application/json Nov 01 18:58:35.506577 n-d-863052-2 devstack@n-api.service[121403]: Host: 10.222.0.13 Nov 01 18:58:35.506577 n-d-863052-2 devstack@n-api.service[121403]: Openstack-System-Scope: None Nov 01 18:58:35.506577 n-d-863052-2 devstack@n-api.service[121403]: User-Agent: python-urllib3/1.26.12 Nov 01 18:58:35.506577 n-d-863052-2 devstack@n-api.service[121403]: X-Auth-Token: gAAAAABjYWwgP3kjyQKi9Uf4PP24jmeKCOPNU51FZoHLreZdbFyZPhRW-EeK2Se64f-CjytM5LjMEtkBLCti_PQz0S3BXRBnTu4aanJgpXShIx2i6Yz4YqCrWhQ373B1BFIdgiChyw2k6U5YvJRz35UfhTE-zhCjFxCXYsQplbVOAVzO2wYqVeI Nov 01 18:58:35.506577 n-d-863052-2 devstack@n-api.service[121403]: X-Domain-Id: None Nov 01 18:58:35.506577 n-d-863052-2 devstack@n-api.service[121403]: X-Domain-Name: None Nov 01 18:58:35.506577 n-d-863052-2 devstack@n-api.service[121403]: X-Identity-Status: Confirmed Nov 01 18:58:35.506577 n-d-863052-2 devstack@n-api.service[121403]: X-Is-Admin-Project: True Nov 01 18:58:35.506577 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Domain-Id: default Nov 01 18:58:35.506577 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Domain-Name: Default Nov 01 18:58:35.506577 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Id: 4a1bb191cff948e99c008b5e861ce4a8 Nov 01 18:58:35.506577 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-215636868 Nov 01 18:58:35.506577 n-d-863052-2 devstack@n-api.service[121403]: X-Role: member,reader Nov 01 18:58:35.506577 n-d-863052-2 devstack@n-api.service[121403]: X-Roles: member,reader Nov 01 18:58:35.508087 n-d-863052-2 devstack@n-api.service[121403]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/4a1bb191cff948e99c008b5e861ce4a8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/4a1bb191cff948e99c008b5e861ce4a8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_4a1bb191cff948e99c008b5e861ce4a8", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/4a1bb191cff948e99c008b5e861ce4a8"}]}] Nov 01 18:58:35.508087 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant: tempest-ServerRescueNegativeTestJSON-215636868 Nov 01 18:58:35.508087 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant-Id: 4a1bb191cff948e99c008b5e861ce4a8 Nov 01 18:58:35.508087 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-215636868 Nov 01 18:58:35.508087 n-d-863052-2 devstack@n-api.service[121403]: X-User: tempest-ServerRescueNegativeTestJSON-215636868-project Nov 01 18:58:35.508087 n-d-863052-2 devstack@n-api.service[121403]: X-User-Domain-Id: default Nov 01 18:58:35.508087 n-d-863052-2 devstack@n-api.service[121403]: X-User-Domain-Name: Default Nov 01 18:58:35.508087 n-d-863052-2 devstack@n-api.service[121403]: X-User-Id: 6a63d69c99a546f0af16329cff3ca717 Nov 01 18:58:35.508087 n-d-863052-2 devstack@n-api.service[121403]: X-User-Name: tempest-ServerRescueNegativeTestJSON-215636868-project Nov 01 18:58:35.508087 n-d-863052-2 devstack@n-api.service[121403]: Nov 01 18:58:35.508087 n-d-863052-2 devstack@n-api.service[121403]: {"rescue": {}} Nov 01 18:58:35.508087 n-d-863052-2 devstack@n-api.service[121403]: method: > Nov 01 18:58:35.508087 n-d-863052-2 devstack@n-api.service[121403]: exception: Instance 5e659e78-6a97-4ffd-93d5-ed462b51212d could not be found. Nov 01 18:58:35.508958 n-d-863052-2 devstack@n-api.service[121403]: action_args: {'id': '5e659e78-6a97-4ffd-93d5-ed462b51212d', 'body': {'rescue': {}}} Nov 01 18:58:35.508958 n-d-863052-2 devstack@n-api.service[121403]: {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 01 18:58:35.508958 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:58:35.508958 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 01 18:58:35.508958 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 01 18:58:35.508958 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 01 18:58:35.508958 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 01 18:58:35.508958 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Nov 01 18:58:35.508958 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Nov 01 18:58:35.508958 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5e659e78-6a97-4ffd-93d5-ed462b51212d could not be found. Nov 01 18:58:35.508958 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 18:58:35.508958 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 18:58:35.508958 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 18:58:35.508958 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:58:35.508958 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 18:58:35.508958 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 18:58:35.508958 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 01 18:58:35.508958 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 01 18:58:35.508958 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 01 18:58:35.508958 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 01 18:58:35.510152 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 01 18:58:35.510152 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 01 18:58:35.510152 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 53, in _rescue Nov 01 18:58:35.510152 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Nov 01 18:58:35.510152 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 01 18:58:35.510152 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 01 18:58:35.510152 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5e659e78-6a97-4ffd-93d5-ed462b51212d could not be found. Nov 01 18:58:35.510152 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 18:58:35.510152 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 18:58:35.510152 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 18:58:35.510152 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:58:35.510152 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 18:58:35.510152 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 18:58:35.510152 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 01 18:58:35.510152 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 01 18:58:35.510152 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5e659e78-6a97-4ffd-93d5-ed462b51212d could not be found. Nov 01 18:58:35.510152 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 18:58:35.511771 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-d20beb0a-8305-4a8f-8069-b866ffe17d72 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Returning 404 to user: Instance 5e659e78-6a97-4ffd-93d5-ed462b51212d could not be found. {{(pid=121403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 01 18:58:35.513592 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-d20beb0a-8305-4a8f-8069-b866ffe17d72 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] 10.222.0.13 "POST /compute/v2.1/servers/5e659e78-6a97-4ffd-93d5-ed462b51212d/action" status: 404 len: 111 microversion: 2.1 time: 0.020648 Nov 01 18:58:35.513592 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 602/1237] 10.222.0.13 () {60 vars in 1278 bytes} [Tue Nov 1 18:58:35 2022] POST /compute/v2.1/servers/5e659e78-6a97-4ffd-93d5-ed462b51212d/action => generated 111 bytes in 22 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 01 18:58:35.524733 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-b5f07d2e-bf3b-47a8-81fe-7ee3362da29a tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 18:58:35.525557 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-b5f07d2e-bf3b-47a8-81fe-7ee3362da29a tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] [instance: ed4798be-a45e-46f5-8f7e-1165f6479bd1] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:58:35.534843 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-b5f07d2e-bf3b-47a8-81fe-7ee3362da29a tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:35.535345 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-b5f07d2e-bf3b-47a8-81fe-7ee3362da29a tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:35.535792 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-b5f07d2e-bf3b-47a8-81fe-7ee3362da29a tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:35.536509 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-b5f07d2e-bf3b-47a8-81fe-7ee3362da29a tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:35.537088 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-b5f07d2e-bf3b-47a8-81fe-7ee3362da29a tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:35.537517 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-b5f07d2e-bf3b-47a8-81fe-7ee3362da29a tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:35.580800 n-d-863052-2 devstack@n-api.service[121403]: DEBUG dbcounter [-] [121403] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=121403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 18:58:35.626500 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-b5f07d2e-bf3b-47a8-81fe-7ee3362da29a tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] 10.222.0.13 "POST /compute/v2.1/servers/ed4798be-a45e-46f5-8f7e-1165f6479bd1/action" status: 202 len: 0 microversion: 2.1 time: 0.105447 Nov 01 18:58:35.628031 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 603/1238] 10.222.0.13 () {60 vars in 1278 bytes} [Tue Nov 1 18:58:35 2022] POST /compute/v2.1/servers/ed4798be-a45e-46f5-8f7e-1165f6479bd1/action => generated 0 bytes in 108 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 01 18:58:35.659491 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-4916b189-c76f-4fdd-8651-5a4bc2a72b28 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:58:35.660564 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-4916b189-c76f-4fdd-8651-5a4bc2a72b28 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] [instance: 2d525a31-b0be-44cb-8fb7-335075145f08] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:58:35.680478 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-4916b189-c76f-4fdd-8651-5a4bc2a72b28 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:35.684286 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-4916b189-c76f-4fdd-8651-5a4bc2a72b28 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:35.685250 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-4916b189-c76f-4fdd-8651-5a4bc2a72b28 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:35.686136 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-4916b189-c76f-4fdd-8651-5a4bc2a72b28 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:35.695544 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-4916b189-c76f-4fdd-8651-5a4bc2a72b28 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:35.696202 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-4916b189-c76f-4fdd-8651-5a4bc2a72b28 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:35.720207 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-137b11aa-d15d-4009-9f0a-7bb0eef085d4 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72117f17294649d6b8bc16c66c7efab2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45d4c047d3c44324a27a27831236ab0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:58:35.738035 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-137b11aa-d15d-4009-9f0a-7bb0eef085d4 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] 10.222.0.13 "GET /compute/v2.1/servers/9249c81d-e57b-4985-a398-8ad97526d5c7" status: 200 len: 1543 microversion: 2.1 time: 0.301362 Nov 01 18:58:35.738624 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 636/1239] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:58:35 2022] GET /compute/v2.1/servers/9249c81d-e57b-4985-a398-8ad97526d5c7 => generated 1543 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 18:58:35.743619 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-564c57dc-2941-44c1-8ccf-f6816a80c89b tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:58:35.744437 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-564c57dc-2941-44c1-8ccf-f6816a80c89b tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] [instance: ed4798be-a45e-46f5-8f7e-1165f6479bd1] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:58:35.756508 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-564c57dc-2941-44c1-8ccf-f6816a80c89b tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:35.761254 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-564c57dc-2941-44c1-8ccf-f6816a80c89b tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:35.761882 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-564c57dc-2941-44c1-8ccf-f6816a80c89b tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:35.762615 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-564c57dc-2941-44c1-8ccf-f6816a80c89b tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:35.763112 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-564c57dc-2941-44c1-8ccf-f6816a80c89b tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:35.763486 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-564c57dc-2941-44c1-8ccf-f6816a80c89b tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:36.197759 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-564c57dc-2941-44c1-8ccf-f6816a80c89b tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a63d69c99a546f0af16329cff3ca717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a1bb191cff948e99c008b5e861ce4a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:58:36.214717 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-564c57dc-2941-44c1-8ccf-f6816a80c89b tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] 10.222.0.13 "GET /compute/v2.1/servers/ed4798be-a45e-46f5-8f7e-1165f6479bd1" status: 200 len: 1520 microversion: 2.1 time: 0.474500 Nov 01 18:58:36.232790 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 637/1240] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:58:35 2022] GET /compute/v2.1/servers/ed4798be-a45e-46f5-8f7e-1165f6479bd1 => generated 1520 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:58:36.247227 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-ff9297a8-79e0-4e1c-a3f7-71b504b451bb tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:58:36.248177 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-ff9297a8-79e0-4e1c-a3f7-71b504b451bb tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] [instance: 9dbe3d05-9fa8-4fd2-8415-52bfe6ee5801] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:58:36.260518 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-ff9297a8-79e0-4e1c-a3f7-71b504b451bb tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:36.261049 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-ff9297a8-79e0-4e1c-a3f7-71b504b451bb tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:36.261485 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-ff9297a8-79e0-4e1c-a3f7-71b504b451bb tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:36.262190 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-ff9297a8-79e0-4e1c-a3f7-71b504b451bb tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:36.262647 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-ff9297a8-79e0-4e1c-a3f7-71b504b451bb tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:36.263068 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-ff9297a8-79e0-4e1c-a3f7-71b504b451bb tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:36.326032 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-4916b189-c76f-4fdd-8651-5a4bc2a72b28 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f32f5fba1976432d938e664c7714e52b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b9d4c236b944f9b2e8e502a50a8f8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:58:36.341970 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-4916b189-c76f-4fdd-8651-5a4bc2a72b28 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] 10.222.0.13 "GET /compute/v2.1/servers/2d525a31-b0be-44cb-8fb7-335075145f08" status: 200 len: 1718 microversion: 2.1 time: 0.691376 Nov 01 18:58:36.342856 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 604/1241] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:58:35 2022] GET /compute/v2.1/servers/2d525a31-b0be-44cb-8fb7-335075145f08 => generated 1718 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:58:36.353800 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [req-60a0fb75-970c-4cfb-b252-10c5335a5b66 req-c77cb072-01a7-4dc2-b2e8-d2d36b3669a4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9dbe3d05-9fa8-4fd2-8415-52bfe6ee5801", "tag": "efd34ee7-e836-43e2-aafc-e8436d0a8065"}]} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 18:58:36.397985 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-60a0fb75-970c-4cfb-b252-10c5335a5b66 req-c77cb072-01a7-4dc2-b2e8-d2d36b3669a4 service nova] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:36.399223 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-60a0fb75-970c-4cfb-b252-10c5335a5b66 req-c77cb072-01a7-4dc2-b2e8-d2d36b3669a4 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:36.408828 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-60a0fb75-970c-4cfb-b252-10c5335a5b66 req-c77cb072-01a7-4dc2-b2e8-d2d36b3669a4 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:36.450303 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.compute.server_external_events [req-60a0fb75-970c-4cfb-b252-10c5335a5b66 req-c77cb072-01a7-4dc2-b2e8-d2d36b3669a4 service nova] Creating event network-changed:efd34ee7-e836-43e2-aafc-e8436d0a8065 for instance 9dbe3d05-9fa8-4fd2-8415-52bfe6ee5801 on n-h1-863052-2 Nov 01 18:58:36.474767 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [req-60a0fb75-970c-4cfb-b252-10c5335a5b66 req-c77cb072-01a7-4dc2-b2e8-d2d36b3669a4 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.118865 Nov 01 18:58:36.476131 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 605/1242] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Nov 1 18:58:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 18:58:36.487659 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-5a9f3ef7-bb40-4d58-ad22-d0dc87d36d2a tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Calling method '.version_select at 0x7f0ae66e4dc0>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:58:36.541324 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.wsgi [None req-5a9f3ef7-bb40-4d58-ad22-d0dc87d36d2a tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] HTTP exception thrown: Image not found. Nov 01 18:58:36.552601 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-5a9f3ef7-bb40-4d58-ad22-d0dc87d36d2a tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Request method failure captured: Nov 01 18:58:36.552601 n-d-863052-2 devstack@n-api.service[121403]: request: DELETE /compute/v2.1/images/0c425376-8367-4840-be1a-213cd2791d79 HTTP/1.1 Nov 01 18:58:36.552601 n-d-863052-2 devstack@n-api.service[121403]: Accept: application/json Nov 01 18:58:36.552601 n-d-863052-2 devstack@n-api.service[121403]: Accept-Encoding: identity Nov 01 18:58:36.552601 n-d-863052-2 devstack@n-api.service[121403]: Connection: close Nov 01 18:58:36.552601 n-d-863052-2 devstack@n-api.service[121403]: Content-Length: 0 Nov 01 18:58:36.552601 n-d-863052-2 devstack@n-api.service[121403]: Content-Type: application/json Nov 01 18:58:36.552601 n-d-863052-2 devstack@n-api.service[121403]: Host: 10.222.0.13 Nov 01 18:58:36.552601 n-d-863052-2 devstack@n-api.service[121403]: Openstack-System-Scope: None Nov 01 18:58:36.552601 n-d-863052-2 devstack@n-api.service[121403]: User-Agent: python-urllib3/1.26.12 Nov 01 18:58:36.552601 n-d-863052-2 devstack@n-api.service[121403]: X-Auth-Token: gAAAAABjYWvqbQtaNCf0vN3RIHicQ7eZzuMpptpvowYCNSOJcJRxrJ9QX4Bvdyyh6S1_lak_JDolcn4qSC02atGGl8uI3NqpWQKt52qXcbtBLMPpaEiNHqRmhd3SjpSTdiucZ2dSpVmatQ9uPpkpENeFkI_E8IIwNVu5-V-pSAlLNGA0j86IptM Nov 01 18:58:36.552601 n-d-863052-2 devstack@n-api.service[121403]: X-Domain-Id: None Nov 01 18:58:36.552601 n-d-863052-2 devstack@n-api.service[121403]: X-Domain-Name: None Nov 01 18:58:36.552601 n-d-863052-2 devstack@n-api.service[121403]: X-Identity-Status: Confirmed Nov 01 18:58:36.552601 n-d-863052-2 devstack@n-api.service[121403]: X-Is-Admin-Project: True Nov 01 18:58:36.552601 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Domain-Id: default Nov 01 18:58:36.552601 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Domain-Name: Default Nov 01 18:58:36.552601 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Id: 708bc0ea4b5a4baf81933725792bedd5 Nov 01 18:58:36.552601 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1431666313 Nov 01 18:58:36.552601 n-d-863052-2 devstack@n-api.service[121403]: X-Role: member,reader Nov 01 18:58:36.552601 n-d-863052-2 devstack@n-api.service[121403]: X-Roles: member,reader Nov 01 18:58:36.554046 n-d-863052-2 devstack@n-api.service[121403]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/708bc0ea4b5a4baf81933725792bedd5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/708bc0ea4b5a4baf81933725792bedd5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_708bc0ea4b5a4baf81933725792bedd5", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/708bc0ea4b5a4baf81933725792bedd5"}]}] Nov 01 18:58:36.554046 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1431666313 Nov 01 18:58:36.554046 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant-Id: 708bc0ea4b5a4baf81933725792bedd5 Nov 01 18:58:36.554046 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1431666313 Nov 01 18:58:36.554046 n-d-863052-2 devstack@n-api.service[121403]: X-User: tempest-ImagesOneServerNegativeTestJSON-1431666313-project Nov 01 18:58:36.554046 n-d-863052-2 devstack@n-api.service[121403]: X-User-Domain-Id: default Nov 01 18:58:36.554046 n-d-863052-2 devstack@n-api.service[121403]: X-User-Domain-Name: Default Nov 01 18:58:36.554046 n-d-863052-2 devstack@n-api.service[121403]: X-User-Id: 09b52b7dcbb044f9bfc424e4417c77fa Nov 01 18:58:36.554046 n-d-863052-2 devstack@n-api.service[121403]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1431666313-project Nov 01 18:58:36.554046 n-d-863052-2 devstack@n-api.service[121403]: method: Nov 01 18:58:36.554046 n-d-863052-2 devstack@n-api.service[121403]: exception: Image not found. Nov 01 18:58:36.554046 n-d-863052-2 devstack@n-api.service[121403]: action_args: {'id': '0c425376-8367-4840-be1a-213cd2791d79'} Nov 01 18:58:36.554046 n-d-863052-2 devstack@n-api.service[121403]: {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 01 18:58:36.554858 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:58:36.554858 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Nov 01 18:58:36.554858 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Nov 01 18:58:36.554858 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Nov 01 18:58:36.554858 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Nov 01 18:58:36.554858 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Nov 01 18:58:36.554858 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Nov 01 18:58:36.554858 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Nov 01 18:58:36.554858 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Nov 01 18:58:36.554858 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Nov 01 18:58:36.554858 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Nov 01 18:58:36.554858 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Nov 01 18:58:36.554858 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Nov 01 18:58:36.554858 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Nov 01 18:58:36.554858 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Nov 01 18:58:36.554858 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 0c425376-8367-4840-be1a-213cd2791d79 to delete Nov 01 18:58:36.554858 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 18:58:36.554858 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 18:58:36.554858 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 18:58:36.556637 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:58:36.556637 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Nov 01 18:58:36.556637 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Nov 01 18:58:36.556637 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Nov 01 18:58:36.556637 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Nov 01 18:58:36.556637 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Nov 01 18:58:36.556637 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Nov 01 18:58:36.556637 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 0c425376-8367-4840-be1a-213cd2791d79 could not be found. Nov 01 18:58:36.556637 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 18:58:36.556637 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 18:58:36.556637 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 18:58:36.556637 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:58:36.556637 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 18:58:36.556637 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 18:58:36.556637 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 01 18:58:36.556637 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 01 18:58:36.556637 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 01 18:58:36.556637 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 01 18:58:36.556637 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 01 18:58:36.556637 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 01 18:58:36.559145 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Nov 01 18:58:36.559145 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Nov 01 18:58:36.559145 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Nov 01 18:58:36.559145 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 18:58:36.559145 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 18:58:36.559145 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 18:58:36.559145 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:58:36.559145 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 18:58:36.559145 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 18:58:36.559145 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 01 18:58:36.559145 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 01 18:58:36.559145 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Nov 01 18:58:36.559145 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 18:58:36.559145 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-5a9f3ef7-bb40-4d58-ad22-d0dc87d36d2a tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Returning 404 to user: Image not found. {{(pid=121403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 01 18:58:36.559145 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-5a9f3ef7-bb40-4d58-ad22-d0dc87d36d2a tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] 10.222.0.13 "DELETE /compute/v2.1/images/0c425376-8367-4840-be1a-213cd2791d79" status: 404 len: 62 microversion: 2.1 time: 0.076883 Nov 01 18:58:36.561493 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 606/1243] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:58:36 2022] DELETE /compute/v2.1/images/0c425376-8367-4840-be1a-213cd2791d79 => generated 62 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 01 18:58:36.566738 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-6b90dffe-6159-4f89-b036-c9372062199d tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:58:36.567467 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-6b90dffe-6159-4f89-b036-c9372062199d tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] [instance: ea631032-dd04-429b-988e-e6362ea42cf7] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:58:36.582361 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-ff9297a8-79e0-4e1c-a3f7-71b504b451bb tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0290a6bb8bc24b8988a925327ac0381c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86941784237549838bba63ce88053b88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:58:36.593168 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-6b90dffe-6159-4f89-b036-c9372062199d tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:36.593665 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-6b90dffe-6159-4f89-b036-c9372062199d tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:36.594036 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-ff9297a8-79e0-4e1c-a3f7-71b504b451bb tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] 10.222.0.13 "GET /compute/v2.1/servers/9dbe3d05-9fa8-4fd2-8415-52bfe6ee5801" status: 200 len: 1319 microversion: 2.1 time: 0.351066 Nov 01 18:58:36.594305 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-6b90dffe-6159-4f89-b036-c9372062199d tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:36.594991 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 638/1244] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:58:36 2022] GET /compute/v2.1/servers/9dbe3d05-9fa8-4fd2-8415-52bfe6ee5801 => generated 1319 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:58:36.595106 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-6b90dffe-6159-4f89-b036-c9372062199d tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:36.595464 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-6b90dffe-6159-4f89-b036-c9372062199d tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:36.595885 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-6b90dffe-6159-4f89-b036-c9372062199d tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:36.600317 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-cd59077f-2908-47ae-9672-c0a98cfa5597 tempest-FloatingIPsAssociationNegativeTestJSON-296725392 tempest-FloatingIPsAssociationNegativeTestJSON-296725392-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:58:36.601023 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-cd59077f-2908-47ae-9672-c0a98cfa5597 tempest-FloatingIPsAssociationNegativeTestJSON-296725392 tempest-FloatingIPsAssociationNegativeTestJSON-296725392-project] [instance: 8e62f12b-8b96-414a-8099-0f9acb7fabf5] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:58:36.614016 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-cd59077f-2908-47ae-9672-c0a98cfa5597 tempest-FloatingIPsAssociationNegativeTestJSON-296725392 tempest-FloatingIPsAssociationNegativeTestJSON-296725392-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:36.614650 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-cd59077f-2908-47ae-9672-c0a98cfa5597 tempest-FloatingIPsAssociationNegativeTestJSON-296725392 tempest-FloatingIPsAssociationNegativeTestJSON-296725392-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:36.615285 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-cd59077f-2908-47ae-9672-c0a98cfa5597 tempest-FloatingIPsAssociationNegativeTestJSON-296725392 tempest-FloatingIPsAssociationNegativeTestJSON-296725392-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:36.616252 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-cd59077f-2908-47ae-9672-c0a98cfa5597 tempest-FloatingIPsAssociationNegativeTestJSON-296725392 tempest-FloatingIPsAssociationNegativeTestJSON-296725392-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:36.616782 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-cd59077f-2908-47ae-9672-c0a98cfa5597 tempest-FloatingIPsAssociationNegativeTestJSON-296725392 tempest-FloatingIPsAssociationNegativeTestJSON-296725392-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:36.617209 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-cd59077f-2908-47ae-9672-c0a98cfa5597 tempest-FloatingIPsAssociationNegativeTestJSON-296725392 tempest-FloatingIPsAssociationNegativeTestJSON-296725392-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:36.718077 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-6b90dffe-6159-4f89-b036-c9372062199d tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c1314c21d8547ff890ede1c2ad281c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c804370880454c7aa02cef2c2c3cf144', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:58:36.730077 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-6b90dffe-6159-4f89-b036-c9372062199d tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c1314c21d8547ff890ede1c2ad281c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c804370880454c7aa02cef2c2c3cf144', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:58:36.732046 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-6b90dffe-6159-4f89-b036-c9372062199d tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c1314c21d8547ff890ede1c2ad281c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c804370880454c7aa02cef2c2c3cf144', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:58:36.737750 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-6b90dffe-6159-4f89-b036-c9372062199d tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] 10.222.0.13 "GET /compute/v2.1/servers/ea631032-dd04-429b-988e-e6362ea42cf7" status: 200 len: 1544 microversion: 2.91 time: 0.181134 Nov 01 18:58:36.758312 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 607/1245] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 18:58:36 2022] GET /compute/v2.1/servers/ea631032-dd04-429b-988e-e6362ea42cf7 => generated 1544 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 18:58:36.770903 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-722c4638-be31-4454-b73e-c966a0f79c00 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:58:36.776195 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-722c4638-be31-4454-b73e-c966a0f79c00 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] [instance: 97de391d-c836-40ac-b126-0b6684406d52] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:58:36.786349 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-722c4638-be31-4454-b73e-c966a0f79c00 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:36.787100 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-722c4638-be31-4454-b73e-c966a0f79c00 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:36.796173 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-722c4638-be31-4454-b73e-c966a0f79c00 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:36.797480 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-722c4638-be31-4454-b73e-c966a0f79c00 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:36.798317 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-722c4638-be31-4454-b73e-c966a0f79c00 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:36.798999 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-722c4638-be31-4454-b73e-c966a0f79c00 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:36.824806 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.wsgi [None req-722c4638-be31-4454-b73e-c966a0f79c00 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] HTTP exception thrown: Instance 97de391d-c836-40ac-b126-0b6684406d52 could not be found. Nov 01 18:58:36.830497 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-722c4638-be31-4454-b73e-c966a0f79c00 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Request method failure captured: Nov 01 18:58:36.830497 n-d-863052-2 devstack@n-api.service[121403]: request: DELETE /compute/v2.1/servers/97de391d-c836-40ac-b126-0b6684406d52 HTTP/1.1 Nov 01 18:58:36.830497 n-d-863052-2 devstack@n-api.service[121403]: Accept: application/json Nov 01 18:58:36.830497 n-d-863052-2 devstack@n-api.service[121403]: Accept-Encoding: identity Nov 01 18:58:36.830497 n-d-863052-2 devstack@n-api.service[121403]: Connection: close Nov 01 18:58:36.830497 n-d-863052-2 devstack@n-api.service[121403]: Content-Length: 0 Nov 01 18:58:36.830497 n-d-863052-2 devstack@n-api.service[121403]: Content-Type: application/json Nov 01 18:58:36.830497 n-d-863052-2 devstack@n-api.service[121403]: Host: 10.222.0.13 Nov 01 18:58:36.830497 n-d-863052-2 devstack@n-api.service[121403]: Openstack-System-Scope: None Nov 01 18:58:36.830497 n-d-863052-2 devstack@n-api.service[121403]: User-Agent: python-urllib3/1.26.12 Nov 01 18:58:36.830497 n-d-863052-2 devstack@n-api.service[121403]: X-Auth-Token: gAAAAABjYWvqbQtaNCf0vN3RIHicQ7eZzuMpptpvowYCNSOJcJRxrJ9QX4Bvdyyh6S1_lak_JDolcn4qSC02atGGl8uI3NqpWQKt52qXcbtBLMPpaEiNHqRmhd3SjpSTdiucZ2dSpVmatQ9uPpkpENeFkI_E8IIwNVu5-V-pSAlLNGA0j86IptM Nov 01 18:58:36.830497 n-d-863052-2 devstack@n-api.service[121403]: X-Domain-Id: None Nov 01 18:58:36.830497 n-d-863052-2 devstack@n-api.service[121403]: X-Domain-Name: None Nov 01 18:58:36.830497 n-d-863052-2 devstack@n-api.service[121403]: X-Identity-Status: Confirmed Nov 01 18:58:36.830497 n-d-863052-2 devstack@n-api.service[121403]: X-Is-Admin-Project: True Nov 01 18:58:36.830497 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Domain-Id: default Nov 01 18:58:36.830497 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Domain-Name: Default Nov 01 18:58:36.830497 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Id: 708bc0ea4b5a4baf81933725792bedd5 Nov 01 18:58:36.830497 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1431666313 Nov 01 18:58:36.830497 n-d-863052-2 devstack@n-api.service[121403]: X-Role: member,reader Nov 01 18:58:36.830497 n-d-863052-2 devstack@n-api.service[121403]: X-Roles: member,reader Nov 01 18:58:36.832262 n-d-863052-2 devstack@n-api.service[121403]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/708bc0ea4b5a4baf81933725792bedd5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/708bc0ea4b5a4baf81933725792bedd5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_708bc0ea4b5a4baf81933725792bedd5", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/708bc0ea4b5a4baf81933725792bedd5"}]}] Nov 01 18:58:36.832262 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1431666313 Nov 01 18:58:36.832262 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant-Id: 708bc0ea4b5a4baf81933725792bedd5 Nov 01 18:58:36.832262 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1431666313 Nov 01 18:58:36.832262 n-d-863052-2 devstack@n-api.service[121403]: X-User: tempest-ImagesOneServerNegativeTestJSON-1431666313-project Nov 01 18:58:36.832262 n-d-863052-2 devstack@n-api.service[121403]: X-User-Domain-Id: default Nov 01 18:58:36.832262 n-d-863052-2 devstack@n-api.service[121403]: X-User-Domain-Name: Default Nov 01 18:58:36.832262 n-d-863052-2 devstack@n-api.service[121403]: X-User-Id: 09b52b7dcbb044f9bfc424e4417c77fa Nov 01 18:58:36.832262 n-d-863052-2 devstack@n-api.service[121403]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1431666313-project Nov 01 18:58:36.832262 n-d-863052-2 devstack@n-api.service[121403]: method: > Nov 01 18:58:36.832262 n-d-863052-2 devstack@n-api.service[121403]: exception: Instance 97de391d-c836-40ac-b126-0b6684406d52 could not be found. Nov 01 18:58:36.832262 n-d-863052-2 devstack@n-api.service[121403]: action_args: {'id': '97de391d-c836-40ac-b126-0b6684406d52'} Nov 01 18:58:36.833350 n-d-863052-2 devstack@n-api.service[121403]: {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 01 18:58:36.833350 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:58:36.833350 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 01 18:58:36.833350 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 01 18:58:36.833350 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 01 18:58:36.833350 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 01 18:58:36.833350 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 01 18:58:36.833350 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 01 18:58:36.833350 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 01 18:58:36.833350 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 01 18:58:36.833350 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 97de391d-c836-40ac-b126-0b6684406d52 could not be found. Nov 01 18:58:36.833350 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 18:58:36.833350 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 18:58:36.833350 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 18:58:36.833350 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:58:36.833350 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 18:58:36.833350 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 18:58:36.833350 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 01 18:58:36.833350 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 01 18:58:36.833350 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 01 18:58:36.835059 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 01 18:58:36.835059 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 01 18:58:36.835059 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 01 18:58:36.835059 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 01 18:58:36.835059 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 01 18:58:36.835059 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 01 18:58:36.835059 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 01 18:58:36.835059 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 01 18:58:36.835059 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 01 18:58:36.835059 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 97de391d-c836-40ac-b126-0b6684406d52 could not be found. Nov 01 18:58:36.835059 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 18:58:36.835059 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 18:58:36.835059 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 18:58:36.835059 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:58:36.835059 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 18:58:36.835059 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 18:58:36.835059 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 01 18:58:36.835059 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 01 18:58:36.835059 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 97de391d-c836-40ac-b126-0b6684406d52 could not be found. Nov 01 18:58:36.835059 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 18:58:36.838454 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-722c4638-be31-4454-b73e-c966a0f79c00 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Returning 404 to user: Instance 97de391d-c836-40ac-b126-0b6684406d52 could not be found. {{(pid=121403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 01 18:58:36.839497 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-722c4638-be31-4454-b73e-c966a0f79c00 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] 10.222.0.13 "DELETE /compute/v2.1/servers/97de391d-c836-40ac-b126-0b6684406d52" status: 404 len: 111 microversion: 2.1 time: 0.079737 Nov 01 18:58:36.840065 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 608/1246] 10.222.0.13 () {58 vars in 1239 bytes} [Tue Nov 1 18:58:36 2022] DELETE /compute/v2.1/servers/97de391d-c836-40ac-b126-0b6684406d52 => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 01 18:58:36.851674 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-3979c72e-2323-4cce-89a8-048db07d169b tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:58:36.853296 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-3979c72e-2323-4cce-89a8-048db07d169b tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] [instance: 9249c81d-e57b-4985-a398-8ad97526d5c7] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:58:36.865266 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-3979c72e-2323-4cce-89a8-048db07d169b tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:36.868402 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-3979c72e-2323-4cce-89a8-048db07d169b tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:36.869156 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-3979c72e-2323-4cce-89a8-048db07d169b tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:36.870059 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-3979c72e-2323-4cce-89a8-048db07d169b tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:36.875144 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-3979c72e-2323-4cce-89a8-048db07d169b tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:36.876436 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-3979c72e-2323-4cce-89a8-048db07d169b tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:36.909737 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-cd59077f-2908-47ae-9672-c0a98cfa5597 tempest-FloatingIPsAssociationNegativeTestJSON-296725392 tempest-FloatingIPsAssociationNegativeTestJSON-296725392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd40b11c70b8e40d0b7e7f5f7d2967184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bd3f356d364e11b14d90d71cb5d598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:58:36.918372 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-cd59077f-2908-47ae-9672-c0a98cfa5597 tempest-FloatingIPsAssociationNegativeTestJSON-296725392 tempest-FloatingIPsAssociationNegativeTestJSON-296725392-project] 10.222.0.13 "GET /compute/v2.1/servers/8e62f12b-8b96-414a-8099-0f9acb7fabf5" status: 200 len: 1542 microversion: 2.1 time: 0.322196 Nov 01 18:58:36.940173 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 639/1247] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:58:36 2022] GET /compute/v2.1/servers/8e62f12b-8b96-414a-8099-0f9acb7fabf5 => generated 1542 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:58:36.946941 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-4cba858b-9c76-4b32-8d41-824f8acc7c30 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:58:36.954529 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-4cba858b-9c76-4b32-8d41-824f8acc7c30 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] [instance: 97de391d-c836-40ac-b126-0b6684406d52] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:58:36.973786 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-4cba858b-9c76-4b32-8d41-824f8acc7c30 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:36.974793 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-4cba858b-9c76-4b32-8d41-824f8acc7c30 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:36.975408 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-4cba858b-9c76-4b32-8d41-824f8acc7c30 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:36.976353 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-4cba858b-9c76-4b32-8d41-824f8acc7c30 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:36.977047 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-4cba858b-9c76-4b32-8d41-824f8acc7c30 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:36.977675 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-4cba858b-9c76-4b32-8d41-824f8acc7c30 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:36.986568 n-d-863052-2 devstack@n-api.service[121402]: DEBUG dbcounter [-] [121402] Writing DB stats nova_cell1:SELECT=100 {{(pid=121402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 18:58:37.008252 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.wsgi [None req-4cba858b-9c76-4b32-8d41-824f8acc7c30 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] HTTP exception thrown: Instance 97de391d-c836-40ac-b126-0b6684406d52 could not be found. Nov 01 18:58:37.009841 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-4cba858b-9c76-4b32-8d41-824f8acc7c30 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Request method failure captured: Nov 01 18:58:37.009841 n-d-863052-2 devstack@n-api.service[121402]: request: GET /compute/v2.1/servers/97de391d-c836-40ac-b126-0b6684406d52 HTTP/1.1 Nov 01 18:58:37.009841 n-d-863052-2 devstack@n-api.service[121402]: Accept: application/json Nov 01 18:58:37.009841 n-d-863052-2 devstack@n-api.service[121402]: Accept-Encoding: identity Nov 01 18:58:37.009841 n-d-863052-2 devstack@n-api.service[121402]: Connection: close Nov 01 18:58:37.009841 n-d-863052-2 devstack@n-api.service[121402]: Content-Length: 0 Nov 01 18:58:37.009841 n-d-863052-2 devstack@n-api.service[121402]: Content-Type: application/json Nov 01 18:58:37.009841 n-d-863052-2 devstack@n-api.service[121402]: Host: 10.222.0.13 Nov 01 18:58:37.009841 n-d-863052-2 devstack@n-api.service[121402]: Openstack-System-Scope: None Nov 01 18:58:37.009841 n-d-863052-2 devstack@n-api.service[121402]: User-Agent: python-urllib3/1.26.12 Nov 01 18:58:37.009841 n-d-863052-2 devstack@n-api.service[121402]: X-Auth-Token: gAAAAABjYWvqbQtaNCf0vN3RIHicQ7eZzuMpptpvowYCNSOJcJRxrJ9QX4Bvdyyh6S1_lak_JDolcn4qSC02atGGl8uI3NqpWQKt52qXcbtBLMPpaEiNHqRmhd3SjpSTdiucZ2dSpVmatQ9uPpkpENeFkI_E8IIwNVu5-V-pSAlLNGA0j86IptM Nov 01 18:58:37.009841 n-d-863052-2 devstack@n-api.service[121402]: X-Domain-Id: None Nov 01 18:58:37.009841 n-d-863052-2 devstack@n-api.service[121402]: X-Domain-Name: None Nov 01 18:58:37.009841 n-d-863052-2 devstack@n-api.service[121402]: X-Identity-Status: Confirmed Nov 01 18:58:37.009841 n-d-863052-2 devstack@n-api.service[121402]: X-Is-Admin-Project: True Nov 01 18:58:37.009841 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Domain-Id: default Nov 01 18:58:37.009841 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Domain-Name: Default Nov 01 18:58:37.009841 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Id: 708bc0ea4b5a4baf81933725792bedd5 Nov 01 18:58:37.009841 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1431666313 Nov 01 18:58:37.009841 n-d-863052-2 devstack@n-api.service[121402]: X-Role: member,reader Nov 01 18:58:37.009841 n-d-863052-2 devstack@n-api.service[121402]: X-Roles: member,reader Nov 01 18:58:37.011174 n-d-863052-2 devstack@n-api.service[121402]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/708bc0ea4b5a4baf81933725792bedd5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/708bc0ea4b5a4baf81933725792bedd5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_708bc0ea4b5a4baf81933725792bedd5", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/708bc0ea4b5a4baf81933725792bedd5"}]}] Nov 01 18:58:37.011174 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1431666313 Nov 01 18:58:37.011174 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant-Id: 708bc0ea4b5a4baf81933725792bedd5 Nov 01 18:58:37.011174 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1431666313 Nov 01 18:58:37.011174 n-d-863052-2 devstack@n-api.service[121402]: X-User: tempest-ImagesOneServerNegativeTestJSON-1431666313-project Nov 01 18:58:37.011174 n-d-863052-2 devstack@n-api.service[121402]: X-User-Domain-Id: default Nov 01 18:58:37.011174 n-d-863052-2 devstack@n-api.service[121402]: X-User-Domain-Name: Default Nov 01 18:58:37.011174 n-d-863052-2 devstack@n-api.service[121402]: X-User-Id: 09b52b7dcbb044f9bfc424e4417c77fa Nov 01 18:58:37.011174 n-d-863052-2 devstack@n-api.service[121402]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1431666313-project Nov 01 18:58:37.011174 n-d-863052-2 devstack@n-api.service[121402]: method: > Nov 01 18:58:37.011174 n-d-863052-2 devstack@n-api.service[121402]: exception: Instance 97de391d-c836-40ac-b126-0b6684406d52 could not be found. Nov 01 18:58:37.011174 n-d-863052-2 devstack@n-api.service[121402]: action_args: {'id': '97de391d-c836-40ac-b126-0b6684406d52'} Nov 01 18:58:37.011925 n-d-863052-2 devstack@n-api.service[121402]: {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 01 18:58:37.011925 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:58:37.011925 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 01 18:58:37.011925 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 01 18:58:37.011925 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 01 18:58:37.011925 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 01 18:58:37.011925 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 01 18:58:37.011925 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 01 18:58:37.011925 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 01 18:58:37.011925 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 01 18:58:37.011925 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 97de391d-c836-40ac-b126-0b6684406d52 could not be found. Nov 01 18:58:37.011925 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 18:58:37.011925 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 18:58:37.011925 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 18:58:37.011925 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:58:37.011925 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 18:58:37.011925 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 18:58:37.011925 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 01 18:58:37.011925 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 01 18:58:37.011925 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 01 18:58:37.013636 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 01 18:58:37.013636 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 01 18:58:37.013636 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 01 18:58:37.013636 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 01 18:58:37.013636 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 01 18:58:37.013636 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 01 18:58:37.013636 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 01 18:58:37.013636 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 97de391d-c836-40ac-b126-0b6684406d52 could not be found. Nov 01 18:58:37.013636 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 18:58:37.013636 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 18:58:37.013636 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 18:58:37.013636 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:58:37.013636 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 18:58:37.013636 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 18:58:37.013636 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 01 18:58:37.013636 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 01 18:58:37.013636 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 97de391d-c836-40ac-b126-0b6684406d52 could not be found. Nov 01 18:58:37.013636 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 18:58:37.014689 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-4cba858b-9c76-4b32-8d41-824f8acc7c30 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] Returning 404 to user: Instance 97de391d-c836-40ac-b126-0b6684406d52 could not be found. {{(pid=121402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 01 18:58:37.014689 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-4cba858b-9c76-4b32-8d41-824f8acc7c30 tempest-ImagesOneServerNegativeTestJSON-1431666313 tempest-ImagesOneServerNegativeTestJSON-1431666313-project] 10.222.0.13 "GET /compute/v2.1/servers/97de391d-c836-40ac-b126-0b6684406d52" status: 404 len: 111 microversion: 2.1 time: 0.069731 Nov 01 18:58:37.014689 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 640/1248] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:58:36 2022] GET /compute/v2.1/servers/97de391d-c836-40ac-b126-0b6684406d52 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 01 18:58:37.159746 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-3979c72e-2323-4cce-89a8-048db07d169b tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72117f17294649d6b8bc16c66c7efab2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45d4c047d3c44324a27a27831236ab0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:58:37.172759 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-3979c72e-2323-4cce-89a8-048db07d169b tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] 10.222.0.13 "GET /compute/v2.1/servers/9249c81d-e57b-4985-a398-8ad97526d5c7" status: 200 len: 1543 microversion: 2.1 time: 0.323159 Nov 01 18:58:37.173889 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 609/1249] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:58:36 2022] GET /compute/v2.1/servers/9249c81d-e57b-4985-a398-8ad97526d5c7 => generated 1543 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:58:37.241012 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-485b7970-7eec-42f2-aad5-494b9e70405b tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:58:37.241659 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-485b7970-7eec-42f2-aad5-494b9e70405b tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] [instance: ed4798be-a45e-46f5-8f7e-1165f6479bd1] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:58:37.255964 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-485b7970-7eec-42f2-aad5-494b9e70405b tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:37.256561 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-485b7970-7eec-42f2-aad5-494b9e70405b tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:37.257136 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-485b7970-7eec-42f2-aad5-494b9e70405b tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:37.259731 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-485b7970-7eec-42f2-aad5-494b9e70405b tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:37.260436 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-485b7970-7eec-42f2-aad5-494b9e70405b tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:37.260987 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-485b7970-7eec-42f2-aad5-494b9e70405b tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:37.369607 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-449b1933-b38d-44a4-987c-929c1d7ffa11 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:58:37.370531 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-449b1933-b38d-44a4-987c-929c1d7ffa11 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] [instance: 2d525a31-b0be-44cb-8fb7-335075145f08] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:58:37.379331 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-449b1933-b38d-44a4-987c-929c1d7ffa11 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:37.385279 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-449b1933-b38d-44a4-987c-929c1d7ffa11 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:37.385946 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-449b1933-b38d-44a4-987c-929c1d7ffa11 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:37.386849 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-449b1933-b38d-44a4-987c-929c1d7ffa11 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:37.387465 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-449b1933-b38d-44a4-987c-929c1d7ffa11 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:37.388149 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-449b1933-b38d-44a4-987c-929c1d7ffa11 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:37.465427 n-d-863052-2 devstack@n-api.service[121402]: DEBUG dbcounter [-] [121402] Writing DB stats nova_cell0:SELECT=2 {{(pid=121402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 18:58:37.735413 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-485b7970-7eec-42f2-aad5-494b9e70405b tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a63d69c99a546f0af16329cff3ca717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a1bb191cff948e99c008b5e861ce4a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:58:37.765134 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-485b7970-7eec-42f2-aad5-494b9e70405b tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] 10.222.0.13 "GET /compute/v2.1/servers/ed4798be-a45e-46f5-8f7e-1165f6479bd1" status: 200 len: 1500 microversion: 2.1 time: 0.528856 Nov 01 18:58:37.766686 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 641/1250] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:58:37 2022] GET /compute/v2.1/servers/ed4798be-a45e-46f5-8f7e-1165f6479bd1 => generated 1500 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:58:37.773179 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-e11aba27-b3f8-425e-9564-5b2065752ac5 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:58:37.777544 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-e11aba27-b3f8-425e-9564-5b2065752ac5 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] [instance: 9dbe3d05-9fa8-4fd2-8415-52bfe6ee5801] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:58:37.790790 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e11aba27-b3f8-425e-9564-5b2065752ac5 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:37.794189 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e11aba27-b3f8-425e-9564-5b2065752ac5 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:37.797751 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e11aba27-b3f8-425e-9564-5b2065752ac5 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:37.798758 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e11aba27-b3f8-425e-9564-5b2065752ac5 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:37.799495 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e11aba27-b3f8-425e-9564-5b2065752ac5 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:37.803647 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e11aba27-b3f8-425e-9564-5b2065752ac5 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:38.237765 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-449b1933-b38d-44a4-987c-929c1d7ffa11 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f32f5fba1976432d938e664c7714e52b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b9d4c236b944f9b2e8e502a50a8f8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:58:38.248634 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-449b1933-b38d-44a4-987c-929c1d7ffa11 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] 10.222.0.13 "GET /compute/v2.1/servers/2d525a31-b0be-44cb-8fb7-335075145f08" status: 200 len: 1718 microversion: 2.1 time: 0.882821 Nov 01 18:58:38.249288 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 610/1251] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:58:37 2022] GET /compute/v2.1/servers/2d525a31-b0be-44cb-8fb7-335075145f08 => generated 1718 bytes in 884 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 18:58:38.279173 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-9c603317-669d-47b4-a0ec-1d0921e017fa tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:58:38.280187 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-9c603317-669d-47b4-a0ec-1d0921e017fa tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] [instance: ea631032-dd04-429b-988e-e6362ea42cf7] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:58:38.290077 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-9c603317-669d-47b4-a0ec-1d0921e017fa tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:38.290907 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-9c603317-669d-47b4-a0ec-1d0921e017fa tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:38.291514 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-9c603317-669d-47b4-a0ec-1d0921e017fa tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:38.292389 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-9c603317-669d-47b4-a0ec-1d0921e017fa tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:38.293164 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-9c603317-669d-47b4-a0ec-1d0921e017fa tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:38.295538 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-9c603317-669d-47b4-a0ec-1d0921e017fa tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:38.375108 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-e11aba27-b3f8-425e-9564-5b2065752ac5 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0290a6bb8bc24b8988a925327ac0381c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86941784237549838bba63ce88053b88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:58:38.387270 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-e11aba27-b3f8-425e-9564-5b2065752ac5 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] 10.222.0.13 "GET /compute/v2.1/servers/9dbe3d05-9fa8-4fd2-8415-52bfe6ee5801" status: 200 len: 1319 microversion: 2.1 time: 0.619107 Nov 01 18:58:38.396625 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 642/1252] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:58:37 2022] GET /compute/v2.1/servers/9dbe3d05-9fa8-4fd2-8415-52bfe6ee5801 => generated 1319 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:58:38.396625 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-903aef2d-c9e5-4662-90a1-9927e4f40dec tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Action: 'action', calling method: >, body: {"rescue": {}} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 18:58:38.397098 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-903aef2d-c9e5-4662-90a1-9927e4f40dec tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] [instance: ed4798be-a45e-46f5-8f7e-1165f6479bd1] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:58:38.414435 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-903aef2d-c9e5-4662-90a1-9927e4f40dec tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:38.414931 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-903aef2d-c9e5-4662-90a1-9927e4f40dec tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:38.415377 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-903aef2d-c9e5-4662-90a1-9927e4f40dec tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:38.416089 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-903aef2d-c9e5-4662-90a1-9927e4f40dec tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:38.416547 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-903aef2d-c9e5-4662-90a1-9927e4f40dec tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:38.420285 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-9c603317-669d-47b4-a0ec-1d0921e017fa tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c1314c21d8547ff890ede1c2ad281c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c804370880454c7aa02cef2c2c3cf144', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:58:38.421198 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-903aef2d-c9e5-4662-90a1-9927e4f40dec tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:38.431518 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-9c603317-669d-47b4-a0ec-1d0921e017fa tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c1314c21d8547ff890ede1c2ad281c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c804370880454c7aa02cef2c2c3cf144', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:58:38.433133 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-9c603317-669d-47b4-a0ec-1d0921e017fa tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c1314c21d8547ff890ede1c2ad281c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c804370880454c7aa02cef2c2c3cf144', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:58:38.440265 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-9c603317-669d-47b4-a0ec-1d0921e017fa tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] 10.222.0.13 "GET /compute/v2.1/servers/ea631032-dd04-429b-988e-e6362ea42cf7" status: 200 len: 1544 microversion: 2.91 time: 0.171643 Nov 01 18:58:38.452608 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 611/1253] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 18:58:38 2022] GET /compute/v2.1/servers/ea631032-dd04-429b-988e-e6362ea42cf7 => generated 1544 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 18:58:38.452608 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-5745d035-d07a-40ef-87f6-25d7a8a8d522 tempest-FloatingIPsAssociationNegativeTestJSON-296725392 tempest-FloatingIPsAssociationNegativeTestJSON-296725392-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:58:38.452608 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-5745d035-d07a-40ef-87f6-25d7a8a8d522 tempest-FloatingIPsAssociationNegativeTestJSON-296725392 tempest-FloatingIPsAssociationNegativeTestJSON-296725392-project] [instance: 8e62f12b-8b96-414a-8099-0f9acb7fabf5] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:58:38.455750 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-5745d035-d07a-40ef-87f6-25d7a8a8d522 tempest-FloatingIPsAssociationNegativeTestJSON-296725392 tempest-FloatingIPsAssociationNegativeTestJSON-296725392-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:38.462946 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-5745d035-d07a-40ef-87f6-25d7a8a8d522 tempest-FloatingIPsAssociationNegativeTestJSON-296725392 tempest-FloatingIPsAssociationNegativeTestJSON-296725392-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:38.462946 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-5745d035-d07a-40ef-87f6-25d7a8a8d522 tempest-FloatingIPsAssociationNegativeTestJSON-296725392 tempest-FloatingIPsAssociationNegativeTestJSON-296725392-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:38.462946 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-5745d035-d07a-40ef-87f6-25d7a8a8d522 tempest-FloatingIPsAssociationNegativeTestJSON-296725392 tempest-FloatingIPsAssociationNegativeTestJSON-296725392-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:38.463336 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-5745d035-d07a-40ef-87f6-25d7a8a8d522 tempest-FloatingIPsAssociationNegativeTestJSON-296725392 tempest-FloatingIPsAssociationNegativeTestJSON-296725392-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:38.463336 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-5745d035-d07a-40ef-87f6-25d7a8a8d522 tempest-FloatingIPsAssociationNegativeTestJSON-296725392 tempest-FloatingIPsAssociationNegativeTestJSON-296725392-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:38.504848 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.objects.instance [None req-903aef2d-c9e5-4662-90a1-9927e4f40dec tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lazy-loading 'flavor' on Instance uuid ed4798be-a45e-46f5-8f7e-1165f6479bd1 {{(pid=121402) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 01 18:58:38.629251 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.wsgi [None req-903aef2d-c9e5-4662-90a1-9927e4f40dec tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] HTTP exception thrown: Cannot 'rescue' instance ed4798be-a45e-46f5-8f7e-1165f6479bd1 while it is in vm_state paused Nov 01 18:58:38.633048 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-903aef2d-c9e5-4662-90a1-9927e4f40dec tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Request method failure captured: Nov 01 18:58:38.633048 n-d-863052-2 devstack@n-api.service[121402]: request: POST /compute/v2.1/servers/ed4798be-a45e-46f5-8f7e-1165f6479bd1/action HTTP/1.1 Nov 01 18:58:38.633048 n-d-863052-2 devstack@n-api.service[121402]: Accept: application/json Nov 01 18:58:38.633048 n-d-863052-2 devstack@n-api.service[121402]: Accept-Encoding: identity Nov 01 18:58:38.633048 n-d-863052-2 devstack@n-api.service[121402]: Connection: close Nov 01 18:58:38.633048 n-d-863052-2 devstack@n-api.service[121402]: Content-Length: 14 Nov 01 18:58:38.633048 n-d-863052-2 devstack@n-api.service[121402]: Content-Type: application/json Nov 01 18:58:38.633048 n-d-863052-2 devstack@n-api.service[121402]: Host: 10.222.0.13 Nov 01 18:58:38.633048 n-d-863052-2 devstack@n-api.service[121402]: Openstack-System-Scope: None Nov 01 18:58:38.633048 n-d-863052-2 devstack@n-api.service[121402]: User-Agent: python-urllib3/1.26.12 Nov 01 18:58:38.633048 n-d-863052-2 devstack@n-api.service[121402]: X-Auth-Token: gAAAAABjYWwgP3kjyQKi9Uf4PP24jmeKCOPNU51FZoHLreZdbFyZPhRW-EeK2Se64f-CjytM5LjMEtkBLCti_PQz0S3BXRBnTu4aanJgpXShIx2i6Yz4YqCrWhQ373B1BFIdgiChyw2k6U5YvJRz35UfhTE-zhCjFxCXYsQplbVOAVzO2wYqVeI Nov 01 18:58:38.633048 n-d-863052-2 devstack@n-api.service[121402]: X-Domain-Id: None Nov 01 18:58:38.633048 n-d-863052-2 devstack@n-api.service[121402]: X-Domain-Name: None Nov 01 18:58:38.633048 n-d-863052-2 devstack@n-api.service[121402]: X-Identity-Status: Confirmed Nov 01 18:58:38.633048 n-d-863052-2 devstack@n-api.service[121402]: X-Is-Admin-Project: True Nov 01 18:58:38.633048 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Domain-Id: default Nov 01 18:58:38.633048 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Domain-Name: Default Nov 01 18:58:38.633048 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Id: 4a1bb191cff948e99c008b5e861ce4a8 Nov 01 18:58:38.633048 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-215636868 Nov 01 18:58:38.633048 n-d-863052-2 devstack@n-api.service[121402]: X-Role: member,reader Nov 01 18:58:38.633048 n-d-863052-2 devstack@n-api.service[121402]: X-Roles: member,reader Nov 01 18:58:38.634592 n-d-863052-2 devstack@n-api.service[121402]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/4a1bb191cff948e99c008b5e861ce4a8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/4a1bb191cff948e99c008b5e861ce4a8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_4a1bb191cff948e99c008b5e861ce4a8", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/4a1bb191cff948e99c008b5e861ce4a8"}]}] Nov 01 18:58:38.634592 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant: tempest-ServerRescueNegativeTestJSON-215636868 Nov 01 18:58:38.634592 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant-Id: 4a1bb191cff948e99c008b5e861ce4a8 Nov 01 18:58:38.634592 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-215636868 Nov 01 18:58:38.634592 n-d-863052-2 devstack@n-api.service[121402]: X-User: tempest-ServerRescueNegativeTestJSON-215636868-project Nov 01 18:58:38.634592 n-d-863052-2 devstack@n-api.service[121402]: X-User-Domain-Id: default Nov 01 18:58:38.634592 n-d-863052-2 devstack@n-api.service[121402]: X-User-Domain-Name: Default Nov 01 18:58:38.634592 n-d-863052-2 devstack@n-api.service[121402]: X-User-Id: 6a63d69c99a546f0af16329cff3ca717 Nov 01 18:58:38.634592 n-d-863052-2 devstack@n-api.service[121402]: X-User-Name: tempest-ServerRescueNegativeTestJSON-215636868-project Nov 01 18:58:38.634592 n-d-863052-2 devstack@n-api.service[121402]: Nov 01 18:58:38.634592 n-d-863052-2 devstack@n-api.service[121402]: {"rescue": {}} Nov 01 18:58:38.634592 n-d-863052-2 devstack@n-api.service[121402]: method: > Nov 01 18:58:38.634592 n-d-863052-2 devstack@n-api.service[121402]: exception: Cannot 'rescue' instance ed4798be-a45e-46f5-8f7e-1165f6479bd1 while it is in vm_state paused Nov 01 18:58:38.635556 n-d-863052-2 devstack@n-api.service[121402]: action_args: {'id': 'ed4798be-a45e-46f5-8f7e-1165f6479bd1', 'body': {'rescue': {}}} Nov 01 18:58:38.635556 n-d-863052-2 devstack@n-api.service[121402]: {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 01 18:58:38.635556 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:58:38.635556 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 62, in _rescue Nov 01 18:58:38.635556 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi self.compute_api.rescue(context, instance, Nov 01 18:58:38.635556 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Nov 01 18:58:38.635556 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Nov 01 18:58:38.635556 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Nov 01 18:58:38.635556 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Nov 01 18:58:38.635556 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Nov 01 18:58:38.635556 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Nov 01 18:58:38.635556 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance ed4798be-a45e-46f5-8f7e-1165f6479bd1 in vm_state paused. Cannot rescue while the instance is in this state. Nov 01 18:58:38.635556 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 18:58:38.635556 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 18:58:38.635556 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 18:58:38.635556 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:58:38.635556 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 18:58:38.635556 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 18:58:38.635556 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 01 18:58:38.635556 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 01 18:58:38.637008 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 01 18:58:38.637008 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 01 18:58:38.637008 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 01 18:58:38.637008 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 01 18:58:38.637008 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 72, in _rescue Nov 01 18:58:38.637008 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state( Nov 01 18:58:38.637008 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Nov 01 18:58:38.637008 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Nov 01 18:58:38.637008 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'rescue' instance ed4798be-a45e-46f5-8f7e-1165f6479bd1 while it is in vm_state paused Nov 01 18:58:38.637008 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 18:58:38.637008 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 18:58:38.637008 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 18:58:38.637008 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:58:38.637008 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 18:58:38.637008 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 18:58:38.637008 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 01 18:58:38.637008 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 01 18:58:38.637008 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'rescue' instance ed4798be-a45e-46f5-8f7e-1165f6479bd1 while it is in vm_state paused Nov 01 18:58:38.637008 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 18:58:38.642870 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-903aef2d-c9e5-4662-90a1-9927e4f40dec tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Returning 409 to user: Cannot 'rescue' instance ed4798be-a45e-46f5-8f7e-1165f6479bd1 while it is in vm_state paused {{(pid=121402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 01 18:58:38.646423 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-903aef2d-c9e5-4662-90a1-9927e4f40dec tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] 10.222.0.13 "POST /compute/v2.1/servers/ed4798be-a45e-46f5-8f7e-1165f6479bd1/action" status: 409 len: 144 microversion: 2.1 time: 0.256907 Nov 01 18:58:38.653283 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 643/1254] 10.222.0.13 () {60 vars in 1278 bytes} [Tue Nov 1 18:58:38 2022] POST /compute/v2.1/servers/ed4798be-a45e-46f5-8f7e-1165f6479bd1/action => generated 144 bytes in 264 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Nov 01 18:58:38.664490 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-8846d932-48fd-4cc7-89d4-76bac4eff16b tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:58:38.669662 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-8846d932-48fd-4cc7-89d4-76bac4eff16b tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] [instance: 9249c81d-e57b-4985-a398-8ad97526d5c7] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:58:38.684449 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-8846d932-48fd-4cc7-89d4-76bac4eff16b tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:38.685157 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-8846d932-48fd-4cc7-89d4-76bac4eff16b tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:38.685730 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-8846d932-48fd-4cc7-89d4-76bac4eff16b tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:38.686547 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-8846d932-48fd-4cc7-89d4-76bac4eff16b tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:38.687013 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-8846d932-48fd-4cc7-89d4-76bac4eff16b tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:38.687718 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-8846d932-48fd-4cc7-89d4-76bac4eff16b tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:38.695658 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-5745d035-d07a-40ef-87f6-25d7a8a8d522 tempest-FloatingIPsAssociationNegativeTestJSON-296725392 tempest-FloatingIPsAssociationNegativeTestJSON-296725392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd40b11c70b8e40d0b7e7f5f7d2967184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bd3f356d364e11b14d90d71cb5d598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:58:38.713086 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-5745d035-d07a-40ef-87f6-25d7a8a8d522 tempest-FloatingIPsAssociationNegativeTestJSON-296725392 tempest-FloatingIPsAssociationNegativeTestJSON-296725392-project] 10.222.0.13 "GET /compute/v2.1/servers/8e62f12b-8b96-414a-8099-0f9acb7fabf5" status: 200 len: 1542 microversion: 2.1 time: 0.270046 Nov 01 18:58:38.735114 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 612/1255] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:58:38 2022] GET /compute/v2.1/servers/8e62f12b-8b96-414a-8099-0f9acb7fabf5 => generated 1542 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:58:38.741252 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-c254e964-9478-4bb8-a76f-7ec1c4c40118 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 18:58:38.741792 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-c254e964-9478-4bb8-a76f-7ec1c4c40118 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] [instance: ed4798be-a45e-46f5-8f7e-1165f6479bd1] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:58:38.772146 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-c254e964-9478-4bb8-a76f-7ec1c4c40118 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:38.773028 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-c254e964-9478-4bb8-a76f-7ec1c4c40118 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:38.773724 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-c254e964-9478-4bb8-a76f-7ec1c4c40118 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:38.774966 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-c254e964-9478-4bb8-a76f-7ec1c4c40118 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:38.775859 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-c254e964-9478-4bb8-a76f-7ec1c4c40118 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:38.776750 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-c254e964-9478-4bb8-a76f-7ec1c4c40118 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:38.984606 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-c254e964-9478-4bb8-a76f-7ec1c4c40118 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] 10.222.0.13 "POST /compute/v2.1/servers/ed4798be-a45e-46f5-8f7e-1165f6479bd1/action" status: 202 len: 0 microversion: 2.1 time: 0.247845 Nov 01 18:58:38.985968 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 613/1256] 10.222.0.13 () {60 vars in 1278 bytes} [Tue Nov 1 18:58:38 2022] POST /compute/v2.1/servers/ed4798be-a45e-46f5-8f7e-1165f6479bd1/action => generated 0 bytes in 250 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 01 18:58:39.000825 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-0ea2a575-dd14-43cc-a1a9-2b9006d79448 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:58:39.007809 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-0ea2a575-dd14-43cc-a1a9-2b9006d79448 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] [instance: ed4798be-a45e-46f5-8f7e-1165f6479bd1] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:58:39.008502 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-8846d932-48fd-4cc7-89d4-76bac4eff16b tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72117f17294649d6b8bc16c66c7efab2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45d4c047d3c44324a27a27831236ab0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:58:39.017776 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-8846d932-48fd-4cc7-89d4-76bac4eff16b tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] 10.222.0.13 "GET /compute/v2.1/servers/9249c81d-e57b-4985-a398-8ad97526d5c7" status: 200 len: 1543 microversion: 2.1 time: 0.362887 Nov 01 18:58:39.019586 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-0ea2a575-dd14-43cc-a1a9-2b9006d79448 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:39.020139 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-0ea2a575-dd14-43cc-a1a9-2b9006d79448 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:39.020787 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-0ea2a575-dd14-43cc-a1a9-2b9006d79448 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:39.032604 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-0ea2a575-dd14-43cc-a1a9-2b9006d79448 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:39.032604 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-0ea2a575-dd14-43cc-a1a9-2b9006d79448 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:39.032604 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-0ea2a575-dd14-43cc-a1a9-2b9006d79448 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:39.040605 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 644/1257] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:58:38 2022] GET /compute/v2.1/servers/9249c81d-e57b-4985-a398-8ad97526d5c7 => generated 1543 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:58:39.250637 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-0ea2a575-dd14-43cc-a1a9-2b9006d79448 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a63d69c99a546f0af16329cff3ca717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a1bb191cff948e99c008b5e861ce4a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:58:39.264810 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-0ea2a575-dd14-43cc-a1a9-2b9006d79448 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] 10.222.0.13 "GET /compute/v2.1/servers/ed4798be-a45e-46f5-8f7e-1165f6479bd1" status: 200 len: 1507 microversion: 2.1 time: 0.272262 Nov 01 18:58:39.277259 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-44d7f6a1-47db-41fc-8d7f-7105601b90e2 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:58:39.278810 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-44d7f6a1-47db-41fc-8d7f-7105601b90e2 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] [instance: 2d525a31-b0be-44cb-8fb7-335075145f08] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:58:39.286738 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 614/1258] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:58:38 2022] GET /compute/v2.1/servers/ed4798be-a45e-46f5-8f7e-1165f6479bd1 => generated 1507 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:58:39.297826 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-44d7f6a1-47db-41fc-8d7f-7105601b90e2 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:39.300191 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-44d7f6a1-47db-41fc-8d7f-7105601b90e2 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:39.302807 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-44d7f6a1-47db-41fc-8d7f-7105601b90e2 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:39.305839 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-44d7f6a1-47db-41fc-8d7f-7105601b90e2 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:39.308398 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-44d7f6a1-47db-41fc-8d7f-7105601b90e2 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:39.309938 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-44d7f6a1-47db-41fc-8d7f-7105601b90e2 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:39.415776 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-294643b4-6327-4bba-aa29-da544f6f07f7 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:58:39.416380 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-294643b4-6327-4bba-aa29-da544f6f07f7 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] [instance: 9dbe3d05-9fa8-4fd2-8415-52bfe6ee5801] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:58:39.459860 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-294643b4-6327-4bba-aa29-da544f6f07f7 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:39.461634 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-294643b4-6327-4bba-aa29-da544f6f07f7 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.030s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:39.462128 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-294643b4-6327-4bba-aa29-da544f6f07f7 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:39.464504 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-294643b4-6327-4bba-aa29-da544f6f07f7 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:39.465582 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-294643b4-6327-4bba-aa29-da544f6f07f7 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:39.466276 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-294643b4-6327-4bba-aa29-da544f6f07f7 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:39.729644 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-294643b4-6327-4bba-aa29-da544f6f07f7 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0290a6bb8bc24b8988a925327ac0381c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86941784237549838bba63ce88053b88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:58:39.738618 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-294643b4-6327-4bba-aa29-da544f6f07f7 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] 10.222.0.13 "GET /compute/v2.1/servers/9dbe3d05-9fa8-4fd2-8415-52bfe6ee5801" status: 200 len: 1319 microversion: 2.1 time: 0.326492 Nov 01 18:58:39.741948 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 615/1259] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:58:39 2022] GET /compute/v2.1/servers/9dbe3d05-9fa8-4fd2-8415-52bfe6ee5801 => generated 1319 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:58:39.760418 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-0f52acf0-4d00-4ffa-aca5-386bd34f8a8d tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:58:39.760418 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-0f52acf0-4d00-4ffa-aca5-386bd34f8a8d tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] [instance: ea631032-dd04-429b-988e-e6362ea42cf7] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:58:39.790475 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-0f52acf0-4d00-4ffa-aca5-386bd34f8a8d tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:39.791123 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-0f52acf0-4d00-4ffa-aca5-386bd34f8a8d tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:39.791698 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-0f52acf0-4d00-4ffa-aca5-386bd34f8a8d tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:39.792516 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-0f52acf0-4d00-4ffa-aca5-386bd34f8a8d tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:39.793094 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-0f52acf0-4d00-4ffa-aca5-386bd34f8a8d tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:39.793617 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-0f52acf0-4d00-4ffa-aca5-386bd34f8a8d tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:39.975997 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-0f52acf0-4d00-4ffa-aca5-386bd34f8a8d tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c1314c21d8547ff890ede1c2ad281c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c804370880454c7aa02cef2c2c3cf144', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:58:39.985382 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-0f52acf0-4d00-4ffa-aca5-386bd34f8a8d tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c1314c21d8547ff890ede1c2ad281c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c804370880454c7aa02cef2c2c3cf144', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:58:39.992884 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-0f52acf0-4d00-4ffa-aca5-386bd34f8a8d tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c1314c21d8547ff890ede1c2ad281c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c804370880454c7aa02cef2c2c3cf144', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:58:40.019598 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-0f52acf0-4d00-4ffa-aca5-386bd34f8a8d tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] 10.222.0.13 "GET /compute/v2.1/servers/ea631032-dd04-429b-988e-e6362ea42cf7" status: 200 len: 1544 microversion: 2.91 time: 0.274230 Nov 01 18:58:40.027497 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 616/1260] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 18:58:39 2022] GET /compute/v2.1/servers/ea631032-dd04-429b-988e-e6362ea42cf7 => generated 1544 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 18:58:40.043511 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-e80692ba-d3aa-495e-a45c-3cc6993ce48e tempest-FloatingIPsAssociationNegativeTestJSON-296725392 tempest-FloatingIPsAssociationNegativeTestJSON-296725392-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:58:40.043511 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-e80692ba-d3aa-495e-a45c-3cc6993ce48e tempest-FloatingIPsAssociationNegativeTestJSON-296725392 tempest-FloatingIPsAssociationNegativeTestJSON-296725392-project] [instance: 8e62f12b-8b96-414a-8099-0f9acb7fabf5] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:58:40.058298 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-e80692ba-d3aa-495e-a45c-3cc6993ce48e tempest-FloatingIPsAssociationNegativeTestJSON-296725392 tempest-FloatingIPsAssociationNegativeTestJSON-296725392-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:40.058298 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-e80692ba-d3aa-495e-a45c-3cc6993ce48e tempest-FloatingIPsAssociationNegativeTestJSON-296725392 tempest-FloatingIPsAssociationNegativeTestJSON-296725392-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:40.058298 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-e80692ba-d3aa-495e-a45c-3cc6993ce48e tempest-FloatingIPsAssociationNegativeTestJSON-296725392 tempest-FloatingIPsAssociationNegativeTestJSON-296725392-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:40.060319 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-e80692ba-d3aa-495e-a45c-3cc6993ce48e tempest-FloatingIPsAssociationNegativeTestJSON-296725392 tempest-FloatingIPsAssociationNegativeTestJSON-296725392-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:40.063557 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-e80692ba-d3aa-495e-a45c-3cc6993ce48e tempest-FloatingIPsAssociationNegativeTestJSON-296725392 tempest-FloatingIPsAssociationNegativeTestJSON-296725392-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:40.064096 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-e80692ba-d3aa-495e-a45c-3cc6993ce48e tempest-FloatingIPsAssociationNegativeTestJSON-296725392 tempest-FloatingIPsAssociationNegativeTestJSON-296725392-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:40.177664 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-44d7f6a1-47db-41fc-8d7f-7105601b90e2 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f32f5fba1976432d938e664c7714e52b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b9d4c236b944f9b2e8e502a50a8f8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:58:40.222973 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-44d7f6a1-47db-41fc-8d7f-7105601b90e2 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] 10.222.0.13 "GET /compute/v2.1/servers/2d525a31-b0be-44cb-8fb7-335075145f08" status: 200 len: 1718 microversion: 2.1 time: 0.949650 Nov 01 18:58:40.237525 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 645/1261] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:58:39 2022] GET /compute/v2.1/servers/2d525a31-b0be-44cb-8fb7-335075145f08 => generated 1718 bytes in 968 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:58:40.251348 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-386381f5-185e-41d0-841a-d3ac9eb46d44 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:58:40.252823 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-386381f5-185e-41d0-841a-d3ac9eb46d44 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] [instance: 9249c81d-e57b-4985-a398-8ad97526d5c7] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:58:40.262524 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-386381f5-185e-41d0-841a-d3ac9eb46d44 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:40.263728 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-386381f5-185e-41d0-841a-d3ac9eb46d44 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:40.264509 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-386381f5-185e-41d0-841a-d3ac9eb46d44 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:40.265814 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-386381f5-185e-41d0-841a-d3ac9eb46d44 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:40.266519 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-386381f5-185e-41d0-841a-d3ac9eb46d44 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:40.267258 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-386381f5-185e-41d0-841a-d3ac9eb46d44 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:40.508792 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-e80692ba-d3aa-495e-a45c-3cc6993ce48e tempest-FloatingIPsAssociationNegativeTestJSON-296725392 tempest-FloatingIPsAssociationNegativeTestJSON-296725392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd40b11c70b8e40d0b7e7f5f7d2967184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bd3f356d364e11b14d90d71cb5d598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:58:40.524414 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-e80692ba-d3aa-495e-a45c-3cc6993ce48e tempest-FloatingIPsAssociationNegativeTestJSON-296725392 tempest-FloatingIPsAssociationNegativeTestJSON-296725392-project] 10.222.0.13 "GET /compute/v2.1/servers/8e62f12b-8b96-414a-8099-0f9acb7fabf5" status: 200 len: 1542 microversion: 2.1 time: 0.495772 Nov 01 18:58:40.536606 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 617/1262] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:58:40 2022] GET /compute/v2.1/servers/8e62f12b-8b96-414a-8099-0f9acb7fabf5 => generated 1542 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:58:40.544830 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-3d9bfa6f-f923-4ff7-962f-602b2f354a30 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:58:40.545464 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-3d9bfa6f-f923-4ff7-962f-602b2f354a30 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] [instance: ed4798be-a45e-46f5-8f7e-1165f6479bd1] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:58:40.574518 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-3d9bfa6f-f923-4ff7-962f-602b2f354a30 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:40.574927 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-3d9bfa6f-f923-4ff7-962f-602b2f354a30 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:40.575371 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-3d9bfa6f-f923-4ff7-962f-602b2f354a30 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:40.576085 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-3d9bfa6f-f923-4ff7-962f-602b2f354a30 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:40.576545 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-3d9bfa6f-f923-4ff7-962f-602b2f354a30 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:40.577103 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-3d9bfa6f-f923-4ff7-962f-602b2f354a30 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:40.692336 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-386381f5-185e-41d0-841a-d3ac9eb46d44 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72117f17294649d6b8bc16c66c7efab2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45d4c047d3c44324a27a27831236ab0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:58:40.718000 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-386381f5-185e-41d0-841a-d3ac9eb46d44 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] 10.222.0.13 "GET /compute/v2.1/servers/9249c81d-e57b-4985-a398-8ad97526d5c7" status: 200 len: 1543 microversion: 2.1 time: 0.473105 Nov 01 18:58:40.723652 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 646/1263] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:58:40 2022] GET /compute/v2.1/servers/9249c81d-e57b-4985-a398-8ad97526d5c7 => generated 1543 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:58:40.734133 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [req-5b38ed72-3527-4b4f-93b2-1d70a7390089 req-c36f517f-1903-4d25-822b-4e9b3de5c013 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "efdf10ba-60d4-4fb0-970d-109a8f936808", "name": "network-vif-plugged", "status": "completed", "tag": "d334cfe4-860d-43f2-bb0d-10cd04b6e568"}]} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 18:58:40.757949 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-5b38ed72-3527-4b4f-93b2-1d70a7390089 req-c36f517f-1903-4d25-822b-4e9b3de5c013 service nova] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:40.759235 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-5b38ed72-3527-4b4f-93b2-1d70a7390089 req-c36f517f-1903-4d25-822b-4e9b3de5c013 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:40.759762 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-5b38ed72-3527-4b4f-93b2-1d70a7390089 req-c36f517f-1903-4d25-822b-4e9b3de5c013 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:40.779306 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.compute.server_external_events [req-5b38ed72-3527-4b4f-93b2-1d70a7390089 req-c36f517f-1903-4d25-822b-4e9b3de5c013 service nova] Creating event network-vif-plugged:d334cfe4-860d-43f2-bb0d-10cd04b6e568 for instance efdf10ba-60d4-4fb0-970d-109a8f936808 on n-h1-863052-2 Nov 01 18:58:40.807650 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [req-5b38ed72-3527-4b4f-93b2-1d70a7390089 req-c36f517f-1903-4d25-822b-4e9b3de5c013 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080870 Nov 01 18:58:40.810419 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 647/1264] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Nov 1 18:58:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 18:58:40.823127 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-2c677434-3aff-4ba9-9a70-2af3f730e66d tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:58:40.823776 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-2c677434-3aff-4ba9-9a70-2af3f730e66d tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] [instance: 9dbe3d05-9fa8-4fd2-8415-52bfe6ee5801] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:58:40.850927 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2c677434-3aff-4ba9-9a70-2af3f730e66d tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:40.851434 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2c677434-3aff-4ba9-9a70-2af3f730e66d tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:40.851881 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2c677434-3aff-4ba9-9a70-2af3f730e66d tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:40.852655 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2c677434-3aff-4ba9-9a70-2af3f730e66d tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:40.853078 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2c677434-3aff-4ba9-9a70-2af3f730e66d tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:40.853502 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2c677434-3aff-4ba9-9a70-2af3f730e66d tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:41.366003 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-3d9bfa6f-f923-4ff7-962f-602b2f354a30 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a63d69c99a546f0af16329cff3ca717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a1bb191cff948e99c008b5e861ce4a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:58:41.379945 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-3d9bfa6f-f923-4ff7-962f-602b2f354a30 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] 10.222.0.13 "GET /compute/v2.1/servers/ed4798be-a45e-46f5-8f7e-1165f6479bd1" status: 200 len: 1515 microversion: 2.1 time: 0.852539 Nov 01 18:58:41.395159 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 618/1265] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:58:40 2022] GET /compute/v2.1/servers/ed4798be-a45e-46f5-8f7e-1165f6479bd1 => generated 1515 bytes in 869 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:58:41.412288 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-7f663893-82dc-417a-9312-c1c5d0b937fe tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:58:41.413273 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-7f663893-82dc-417a-9312-c1c5d0b937fe tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] [instance: ea631032-dd04-429b-988e-e6362ea42cf7] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:58:41.420943 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-7f663893-82dc-417a-9312-c1c5d0b937fe tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:41.421819 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-7f663893-82dc-417a-9312-c1c5d0b937fe tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:41.422978 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-7f663893-82dc-417a-9312-c1c5d0b937fe tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:41.423927 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-7f663893-82dc-417a-9312-c1c5d0b937fe tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:41.424692 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-7f663893-82dc-417a-9312-c1c5d0b937fe tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:41.425393 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-7f663893-82dc-417a-9312-c1c5d0b937fe tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:41.525845 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-7f663893-82dc-417a-9312-c1c5d0b937fe tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c1314c21d8547ff890ede1c2ad281c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c804370880454c7aa02cef2c2c3cf144', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:58:41.578789 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-7f663893-82dc-417a-9312-c1c5d0b937fe tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c1314c21d8547ff890ede1c2ad281c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c804370880454c7aa02cef2c2c3cf144', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:58:41.585662 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-7f663893-82dc-417a-9312-c1c5d0b937fe tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c1314c21d8547ff890ede1c2ad281c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c804370880454c7aa02cef2c2c3cf144', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:58:41.608069 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-7f663893-82dc-417a-9312-c1c5d0b937fe tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] 10.222.0.13 "GET /compute/v2.1/servers/ea631032-dd04-429b-988e-e6362ea42cf7" status: 200 len: 1544 microversion: 2.91 time: 0.187496 Nov 01 18:58:41.631342 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 619/1266] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 18:58:41 2022] GET /compute/v2.1/servers/ea631032-dd04-429b-988e-e6362ea42cf7 => generated 1544 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 18:58:41.644325 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-2c677434-3aff-4ba9-9a70-2af3f730e66d tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0290a6bb8bc24b8988a925327ac0381c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86941784237549838bba63ce88053b88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:58:41.658663 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-50507c42-3313-4c36-bee5-074a8fd261f3 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:58:41.660658 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-2c677434-3aff-4ba9-9a70-2af3f730e66d tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] 10.222.0.13 "GET /compute/v2.1/servers/9dbe3d05-9fa8-4fd2-8415-52bfe6ee5801" status: 200 len: 1319 microversion: 2.1 time: 0.846393 Nov 01 18:58:41.665451 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 648/1267] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:58:40 2022] GET /compute/v2.1/servers/9dbe3d05-9fa8-4fd2-8415-52bfe6ee5801 => generated 1319 bytes in 854 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:58:41.675059 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [req-18dbf913-75ce-4e74-8ad9-6e1fdd6b3905 req-1f6ff248-fdd7-4c74-90f6-35e4879aa28a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e62f12b-8b96-414a-8099-0f9acb7fabf5", "name": "network-vif-deleted", "tag": "8b2113da-4763-4f79-99c9-989625f65d00"}]} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 18:58:41.675411 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-50507c42-3313-4c36-bee5-074a8fd261f3 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] [instance: 2d525a31-b0be-44cb-8fb7-335075145f08] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:58:41.700897 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-50507c42-3313-4c36-bee5-074a8fd261f3 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:41.703072 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-50507c42-3313-4c36-bee5-074a8fd261f3 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:41.708407 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-18dbf913-75ce-4e74-8ad9-6e1fdd6b3905 req-1f6ff248-fdd7-4c74-90f6-35e4879aa28a service nova] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:41.709112 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-18dbf913-75ce-4e74-8ad9-6e1fdd6b3905 req-1f6ff248-fdd7-4c74-90f6-35e4879aa28a service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:41.709369 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-50507c42-3313-4c36-bee5-074a8fd261f3 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:41.709597 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-18dbf913-75ce-4e74-8ad9-6e1fdd6b3905 req-1f6ff248-fdd7-4c74-90f6-35e4879aa28a service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:41.710329 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-50507c42-3313-4c36-bee5-074a8fd261f3 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:41.714197 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-50507c42-3313-4c36-bee5-074a8fd261f3 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:41.715688 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-50507c42-3313-4c36-bee5-074a8fd261f3 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:41.809711 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.compute.server_external_events [req-18dbf913-75ce-4e74-8ad9-6e1fdd6b3905 req-1f6ff248-fdd7-4c74-90f6-35e4879aa28a service nova] Creating event network-vif-deleted:8b2113da-4763-4f79-99c9-989625f65d00 for instance 8e62f12b-8b96-414a-8099-0f9acb7fabf5 on n-h2-863052-2 Nov 01 18:58:41.855247 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [req-18dbf913-75ce-4e74-8ad9-6e1fdd6b3905 req-1f6ff248-fdd7-4c74-90f6-35e4879aa28a service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.185936 Nov 01 18:58:41.861805 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 649/1268] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Nov 1 18:58:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 18:58:41.884531 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-68dd22b5-3039-48df-b766-b8ad4eba2098 tempest-FloatingIPsAssociationNegativeTestJSON-296725392 tempest-FloatingIPsAssociationNegativeTestJSON-296725392-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:58:41.891483 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-68dd22b5-3039-48df-b766-b8ad4eba2098 tempest-FloatingIPsAssociationNegativeTestJSON-296725392 tempest-FloatingIPsAssociationNegativeTestJSON-296725392-project] [instance: 8e62f12b-8b96-414a-8099-0f9acb7fabf5] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:58:41.915897 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-68dd22b5-3039-48df-b766-b8ad4eba2098 tempest-FloatingIPsAssociationNegativeTestJSON-296725392 tempest-FloatingIPsAssociationNegativeTestJSON-296725392-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:41.917680 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-68dd22b5-3039-48df-b766-b8ad4eba2098 tempest-FloatingIPsAssociationNegativeTestJSON-296725392 tempest-FloatingIPsAssociationNegativeTestJSON-296725392-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:41.919847 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-68dd22b5-3039-48df-b766-b8ad4eba2098 tempest-FloatingIPsAssociationNegativeTestJSON-296725392 tempest-FloatingIPsAssociationNegativeTestJSON-296725392-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:41.925468 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-68dd22b5-3039-48df-b766-b8ad4eba2098 tempest-FloatingIPsAssociationNegativeTestJSON-296725392 tempest-FloatingIPsAssociationNegativeTestJSON-296725392-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:41.926019 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-68dd22b5-3039-48df-b766-b8ad4eba2098 tempest-FloatingIPsAssociationNegativeTestJSON-296725392 tempest-FloatingIPsAssociationNegativeTestJSON-296725392-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:41.933388 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-68dd22b5-3039-48df-b766-b8ad4eba2098 tempest-FloatingIPsAssociationNegativeTestJSON-296725392 tempest-FloatingIPsAssociationNegativeTestJSON-296725392-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:42.018695 n-d-863052-2 devstack@n-api.service[121402]: DEBUG dbcounter [-] [121402] Writing DB stats nova_api:SELECT=100 {{(pid=121402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 18:58:42.030335 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-68dd22b5-3039-48df-b766-b8ad4eba2098 tempest-FloatingIPsAssociationNegativeTestJSON-296725392 tempest-FloatingIPsAssociationNegativeTestJSON-296725392-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:42.030821 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-68dd22b5-3039-48df-b766-b8ad4eba2098 tempest-FloatingIPsAssociationNegativeTestJSON-296725392 tempest-FloatingIPsAssociationNegativeTestJSON-296725392-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:42.031900 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-68dd22b5-3039-48df-b766-b8ad4eba2098 tempest-FloatingIPsAssociationNegativeTestJSON-296725392 tempest-FloatingIPsAssociationNegativeTestJSON-296725392-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:42.032339 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.objects.instance [None req-68dd22b5-3039-48df-b766-b8ad4eba2098 tempest-FloatingIPsAssociationNegativeTestJSON-296725392 tempest-FloatingIPsAssociationNegativeTestJSON-296725392-project] Lazy-loading 'fault' on Instance uuid 8e62f12b-8b96-414a-8099-0f9acb7fabf5 {{(pid=121402) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 01 18:58:42.111938 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-50507c42-3313-4c36-bee5-074a8fd261f3 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f32f5fba1976432d938e664c7714e52b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b9d4c236b944f9b2e8e502a50a8f8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:58:42.123645 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-50507c42-3313-4c36-bee5-074a8fd261f3 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] 10.222.0.13 "GET /compute/v2.1/servers/2d525a31-b0be-44cb-8fb7-335075145f08" status: 200 len: 1718 microversion: 2.1 time: 0.490614 Nov 01 18:58:42.127325 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 620/1269] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:58:41 2022] GET /compute/v2.1/servers/2d525a31-b0be-44cb-8fb7-335075145f08 => generated 1718 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:58:42.136635 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-8d3ef28e-5d9f-44fa-9ab8-98a6025f041d tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:58:42.141495 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-8d3ef28e-5d9f-44fa-9ab8-98a6025f041d tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] [instance: 9249c81d-e57b-4985-a398-8ad97526d5c7] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:58:42.158598 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-8d3ef28e-5d9f-44fa-9ab8-98a6025f041d tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:42.159087 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-8d3ef28e-5d9f-44fa-9ab8-98a6025f041d tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:42.159580 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-8d3ef28e-5d9f-44fa-9ab8-98a6025f041d tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:42.160273 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-8d3ef28e-5d9f-44fa-9ab8-98a6025f041d tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:42.160835 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-8d3ef28e-5d9f-44fa-9ab8-98a6025f041d tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:42.161254 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-8d3ef28e-5d9f-44fa-9ab8-98a6025f041d tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:42.166742 n-d-863052-2 devstack@n-api.service[121403]: DEBUG dbcounter [-] [121403] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=121403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 18:58:42.169439 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-68dd22b5-3039-48df-b766-b8ad4eba2098 tempest-FloatingIPsAssociationNegativeTestJSON-296725392 tempest-FloatingIPsAssociationNegativeTestJSON-296725392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd40b11c70b8e40d0b7e7f5f7d2967184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bd3f356d364e11b14d90d71cb5d598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:58:42.184101 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-68dd22b5-3039-48df-b766-b8ad4eba2098 tempest-FloatingIPsAssociationNegativeTestJSON-296725392 tempest-FloatingIPsAssociationNegativeTestJSON-296725392-project] 10.222.0.13 "GET /compute/v2.1/servers/8e62f12b-8b96-414a-8099-0f9acb7fabf5" status: 200 len: 1321 microversion: 2.1 time: 0.320896 Nov 01 18:58:42.187131 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 650/1270] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:58:41 2022] GET /compute/v2.1/servers/8e62f12b-8b96-414a-8099-0f9acb7fabf5 => generated 1321 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:58:42.478039 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-8d3ef28e-5d9f-44fa-9ab8-98a6025f041d tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72117f17294649d6b8bc16c66c7efab2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45d4c047d3c44324a27a27831236ab0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:58:42.489259 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-8d3ef28e-5d9f-44fa-9ab8-98a6025f041d tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] 10.222.0.13 "GET /compute/v2.1/servers/9249c81d-e57b-4985-a398-8ad97526d5c7" status: 200 len: 1543 microversion: 2.1 time: 0.358766 Nov 01 18:58:42.490467 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 621/1271] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:58:42 2022] GET /compute/v2.1/servers/9249c81d-e57b-4985-a398-8ad97526d5c7 => generated 1543 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:58:42.643900 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-d614ecff-dd7d-4246-a03a-fb7993d339ad tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:58:42.646387 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-d614ecff-dd7d-4246-a03a-fb7993d339ad tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] [instance: ea631032-dd04-429b-988e-e6362ea42cf7] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:58:42.662407 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-d614ecff-dd7d-4246-a03a-fb7993d339ad tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:42.662920 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-d614ecff-dd7d-4246-a03a-fb7993d339ad tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:42.665863 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-d614ecff-dd7d-4246-a03a-fb7993d339ad tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:42.666890 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-d614ecff-dd7d-4246-a03a-fb7993d339ad tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:42.667376 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-d614ecff-dd7d-4246-a03a-fb7993d339ad tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:42.667816 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-d614ecff-dd7d-4246-a03a-fb7993d339ad tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:42.702626 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-d562cd4e-87ec-413b-8c84-efce859adc7e tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:58:42.702626 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-d562cd4e-87ec-413b-8c84-efce859adc7e tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] [instance: 9dbe3d05-9fa8-4fd2-8415-52bfe6ee5801] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:58:42.711289 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d562cd4e-87ec-413b-8c84-efce859adc7e tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:42.711781 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d562cd4e-87ec-413b-8c84-efce859adc7e tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:42.712219 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d562cd4e-87ec-413b-8c84-efce859adc7e tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:42.717048 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d562cd4e-87ec-413b-8c84-efce859adc7e tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:42.717457 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d562cd4e-87ec-413b-8c84-efce859adc7e tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:42.717672 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d562cd4e-87ec-413b-8c84-efce859adc7e tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:42.866828 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-d614ecff-dd7d-4246-a03a-fb7993d339ad tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c1314c21d8547ff890ede1c2ad281c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c804370880454c7aa02cef2c2c3cf144', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:58:42.879592 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-d614ecff-dd7d-4246-a03a-fb7993d339ad tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c1314c21d8547ff890ede1c2ad281c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c804370880454c7aa02cef2c2c3cf144', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:58:42.885035 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-d614ecff-dd7d-4246-a03a-fb7993d339ad tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c1314c21d8547ff890ede1c2ad281c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c804370880454c7aa02cef2c2c3cf144', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:58:42.897519 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-d614ecff-dd7d-4246-a03a-fb7993d339ad tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] 10.222.0.13 "GET /compute/v2.1/servers/ea631032-dd04-429b-988e-e6362ea42cf7" status: 200 len: 1544 microversion: 2.91 time: 0.259260 Nov 01 18:58:42.898402 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 651/1272] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 18:58:42 2022] GET /compute/v2.1/servers/ea631032-dd04-429b-988e-e6362ea42cf7 => generated 1544 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 18:58:42.928391 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [req-1a906e9a-d2a6-4ce6-a97f-891c32cd35c8 req-ca1f9b5c-c5f0-4773-9f80-62bf7895ce8f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9dbe3d05-9fa8-4fd2-8415-52bfe6ee5801", "name": "network-vif-plugged", "status": "completed", "tag": "efd34ee7-e836-43e2-aafc-e8436d0a8065"}]} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 18:58:42.950304 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-1a906e9a-d2a6-4ce6-a97f-891c32cd35c8 req-ca1f9b5c-c5f0-4773-9f80-62bf7895ce8f service nova] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:42.951085 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-1a906e9a-d2a6-4ce6-a97f-891c32cd35c8 req-ca1f9b5c-c5f0-4773-9f80-62bf7895ce8f service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:42.951697 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-1a906e9a-d2a6-4ce6-a97f-891c32cd35c8 req-ca1f9b5c-c5f0-4773-9f80-62bf7895ce8f service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:42.970601 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.compute.server_external_events [req-1a906e9a-d2a6-4ce6-a97f-891c32cd35c8 req-ca1f9b5c-c5f0-4773-9f80-62bf7895ce8f service nova] Creating event network-vif-plugged:efd34ee7-e836-43e2-aafc-e8436d0a8065 for instance 9dbe3d05-9fa8-4fd2-8415-52bfe6ee5801 on n-h1-863052-2 Nov 01 18:58:42.999491 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [req-1a906e9a-d2a6-4ce6-a97f-891c32cd35c8 req-ca1f9b5c-c5f0-4773-9f80-62bf7895ce8f service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074651 Nov 01 18:58:43.000923 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 652/1273] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Nov 1 18:58:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 01 18:58:43.148946 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-c2e93ffb-64e5-43c4-851a-bef12a8f37f1 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:58:43.150065 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-c2e93ffb-64e5-43c4-851a-bef12a8f37f1 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] [instance: 2d525a31-b0be-44cb-8fb7-335075145f08] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:58:43.180854 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-c2e93ffb-64e5-43c4-851a-bef12a8f37f1 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:43.183523 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-c2e93ffb-64e5-43c4-851a-bef12a8f37f1 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:43.184255 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-c2e93ffb-64e5-43c4-851a-bef12a8f37f1 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:43.186783 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-c2e93ffb-64e5-43c4-851a-bef12a8f37f1 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:43.188435 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-c2e93ffb-64e5-43c4-851a-bef12a8f37f1 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:43.189192 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-c2e93ffb-64e5-43c4-851a-bef12a8f37f1 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:43.500891 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-d562cd4e-87ec-413b-8c84-efce859adc7e tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0290a6bb8bc24b8988a925327ac0381c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86941784237549838bba63ce88053b88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:58:43.513231 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-d562cd4e-87ec-413b-8c84-efce859adc7e tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] 10.222.0.13 "GET /compute/v2.1/servers/9dbe3d05-9fa8-4fd2-8415-52bfe6ee5801" status: 200 len: 1319 microversion: 2.1 time: 0.823854 Nov 01 18:58:43.521616 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 622/1274] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:58:42 2022] GET /compute/v2.1/servers/9dbe3d05-9fa8-4fd2-8415-52bfe6ee5801 => generated 1319 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 18:58:43.530939 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-4bd68556-957b-4f16-af27-10bf3ea00064 tempest-FloatingIPsAssociationNegativeTestJSON-296725392 tempest-FloatingIPsAssociationNegativeTestJSON-296725392-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:58:43.564412 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-4bd68556-957b-4f16-af27-10bf3ea00064 tempest-FloatingIPsAssociationNegativeTestJSON-296725392 tempest-FloatingIPsAssociationNegativeTestJSON-296725392-project] [instance: 8e62f12b-8b96-414a-8099-0f9acb7fabf5] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:58:43.588101 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-4bd68556-957b-4f16-af27-10bf3ea00064 tempest-FloatingIPsAssociationNegativeTestJSON-296725392 tempest-FloatingIPsAssociationNegativeTestJSON-296725392-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:43.588680 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-4bd68556-957b-4f16-af27-10bf3ea00064 tempest-FloatingIPsAssociationNegativeTestJSON-296725392 tempest-FloatingIPsAssociationNegativeTestJSON-296725392-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:43.589134 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-4bd68556-957b-4f16-af27-10bf3ea00064 tempest-FloatingIPsAssociationNegativeTestJSON-296725392 tempest-FloatingIPsAssociationNegativeTestJSON-296725392-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:43.589872 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-4bd68556-957b-4f16-af27-10bf3ea00064 tempest-FloatingIPsAssociationNegativeTestJSON-296725392 tempest-FloatingIPsAssociationNegativeTestJSON-296725392-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:43.597003 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-4bd68556-957b-4f16-af27-10bf3ea00064 tempest-FloatingIPsAssociationNegativeTestJSON-296725392 tempest-FloatingIPsAssociationNegativeTestJSON-296725392-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:43.597450 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-4bd68556-957b-4f16-af27-10bf3ea00064 tempest-FloatingIPsAssociationNegativeTestJSON-296725392 tempest-FloatingIPsAssociationNegativeTestJSON-296725392-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:43.676120 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-c2e93ffb-64e5-43c4-851a-bef12a8f37f1 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f32f5fba1976432d938e664c7714e52b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b9d4c236b944f9b2e8e502a50a8f8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:58:43.677486 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.wsgi [None req-4bd68556-957b-4f16-af27-10bf3ea00064 tempest-FloatingIPsAssociationNegativeTestJSON-296725392 tempest-FloatingIPsAssociationNegativeTestJSON-296725392-project] HTTP exception thrown: Instance 8e62f12b-8b96-414a-8099-0f9acb7fabf5 could not be found. Nov 01 18:58:43.687686 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-4bd68556-957b-4f16-af27-10bf3ea00064 tempest-FloatingIPsAssociationNegativeTestJSON-296725392 tempest-FloatingIPsAssociationNegativeTestJSON-296725392-project] Request method failure captured: Nov 01 18:58:43.687686 n-d-863052-2 devstack@n-api.service[121403]: request: GET /compute/v2.1/servers/8e62f12b-8b96-414a-8099-0f9acb7fabf5 HTTP/1.1 Nov 01 18:58:43.687686 n-d-863052-2 devstack@n-api.service[121403]: Accept: application/json Nov 01 18:58:43.687686 n-d-863052-2 devstack@n-api.service[121403]: Accept-Encoding: identity Nov 01 18:58:43.687686 n-d-863052-2 devstack@n-api.service[121403]: Connection: close Nov 01 18:58:43.687686 n-d-863052-2 devstack@n-api.service[121403]: Content-Length: 0 Nov 01 18:58:43.687686 n-d-863052-2 devstack@n-api.service[121403]: Content-Type: application/json Nov 01 18:58:43.687686 n-d-863052-2 devstack@n-api.service[121403]: Host: 10.222.0.13 Nov 01 18:58:43.687686 n-d-863052-2 devstack@n-api.service[121403]: Openstack-System-Scope: None Nov 01 18:58:43.687686 n-d-863052-2 devstack@n-api.service[121403]: User-Agent: python-urllib3/1.26.12 Nov 01 18:58:43.687686 n-d-863052-2 devstack@n-api.service[121403]: X-Auth-Token: gAAAAABjYWw1SF5PPvMdN953udCJyfDa_Bfcqy7XVXpdqAKP1KG1AiUlssdsx9OB7pwmIJI0BFf9a3oyI_tT1BfoNA4axNUyVUKrPnNPLB3yEU3vYhuOsCWAaR_lCoKebniusNWQyFM6MZhXiwRWovoCjGCBPgyULskL-0T-0PDaS4BfSFiov1c Nov 01 18:58:43.687686 n-d-863052-2 devstack@n-api.service[121403]: X-Domain-Id: None Nov 01 18:58:43.687686 n-d-863052-2 devstack@n-api.service[121403]: X-Domain-Name: None Nov 01 18:58:43.687686 n-d-863052-2 devstack@n-api.service[121403]: X-Identity-Status: Confirmed Nov 01 18:58:43.687686 n-d-863052-2 devstack@n-api.service[121403]: X-Is-Admin-Project: True Nov 01 18:58:43.687686 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Domain-Id: default Nov 01 18:58:43.687686 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Domain-Name: Default Nov 01 18:58:43.687686 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Id: e3bd3f356d364e11b14d90d71cb5d598 Nov 01 18:58:43.687686 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-296725392 Nov 01 18:58:43.687686 n-d-863052-2 devstack@n-api.service[121403]: X-Role: member,reader Nov 01 18:58:43.687686 n-d-863052-2 devstack@n-api.service[121403]: X-Roles: member,reader Nov 01 18:58:43.690274 n-d-863052-2 devstack@n-api.service[121403]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/e3bd3f356d364e11b14d90d71cb5d598"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/e3bd3f356d364e11b14d90d71cb5d598"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_e3bd3f356d364e11b14d90d71cb5d598", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/e3bd3f356d364e11b14d90d71cb5d598"}]}] Nov 01 18:58:43.690274 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-296725392 Nov 01 18:58:43.690274 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant-Id: e3bd3f356d364e11b14d90d71cb5d598 Nov 01 18:58:43.690274 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-296725392 Nov 01 18:58:43.690274 n-d-863052-2 devstack@n-api.service[121403]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-296725392-project Nov 01 18:58:43.690274 n-d-863052-2 devstack@n-api.service[121403]: X-User-Domain-Id: default Nov 01 18:58:43.690274 n-d-863052-2 devstack@n-api.service[121403]: X-User-Domain-Name: Default Nov 01 18:58:43.690274 n-d-863052-2 devstack@n-api.service[121403]: X-User-Id: d40b11c70b8e40d0b7e7f5f7d2967184 Nov 01 18:58:43.690274 n-d-863052-2 devstack@n-api.service[121403]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-296725392-project Nov 01 18:58:43.690274 n-d-863052-2 devstack@n-api.service[121403]: method: > Nov 01 18:58:43.690274 n-d-863052-2 devstack@n-api.service[121403]: exception: Instance 8e62f12b-8b96-414a-8099-0f9acb7fabf5 could not be found. Nov 01 18:58:43.691457 n-d-863052-2 devstack@n-api.service[121403]: action_args: {'id': '8e62f12b-8b96-414a-8099-0f9acb7fabf5'} Nov 01 18:58:43.691457 n-d-863052-2 devstack@n-api.service[121403]: {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 01 18:58:43.691457 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:58:43.691457 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 01 18:58:43.691457 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 01 18:58:43.691457 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 01 18:58:43.691457 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 01 18:58:43.691457 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 01 18:58:43.691457 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 01 18:58:43.691457 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 01 18:58:43.691457 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 01 18:58:43.691457 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8e62f12b-8b96-414a-8099-0f9acb7fabf5 could not be found. Nov 01 18:58:43.691457 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 18:58:43.691457 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 18:58:43.691457 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 18:58:43.691457 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:58:43.691457 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 18:58:43.691457 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 18:58:43.691457 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 01 18:58:43.691457 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 01 18:58:43.693044 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 01 18:58:43.693044 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 01 18:58:43.693044 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 01 18:58:43.693044 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 01 18:58:43.693044 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 01 18:58:43.693044 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 01 18:58:43.693044 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 01 18:58:43.693044 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 01 18:58:43.693044 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8e62f12b-8b96-414a-8099-0f9acb7fabf5 could not be found. Nov 01 18:58:43.693044 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 18:58:43.693044 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 18:58:43.693044 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 18:58:43.693044 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:58:43.693044 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 18:58:43.693044 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 18:58:43.693044 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 01 18:58:43.693044 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 01 18:58:43.693044 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8e62f12b-8b96-414a-8099-0f9acb7fabf5 could not be found. Nov 01 18:58:43.693044 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 18:58:43.694497 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-4bd68556-957b-4f16-af27-10bf3ea00064 tempest-FloatingIPsAssociationNegativeTestJSON-296725392 tempest-FloatingIPsAssociationNegativeTestJSON-296725392-project] Returning 404 to user: Instance 8e62f12b-8b96-414a-8099-0f9acb7fabf5 could not be found. {{(pid=121403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 01 18:58:43.694497 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-4bd68556-957b-4f16-af27-10bf3ea00064 tempest-FloatingIPsAssociationNegativeTestJSON-296725392 tempest-FloatingIPsAssociationNegativeTestJSON-296725392-project] 10.222.0.13 "GET /compute/v2.1/servers/8e62f12b-8b96-414a-8099-0f9acb7fabf5" status: 404 len: 111 microversion: 2.1 time: 0.166300 Nov 01 18:58:43.702383 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 623/1275] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:58:43 2022] GET /compute/v2.1/servers/8e62f12b-8b96-414a-8099-0f9acb7fabf5 => generated 111 bytes in 179 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 01 18:58:43.708547 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-c2e93ffb-64e5-43c4-851a-bef12a8f37f1 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] 10.222.0.13 "GET /compute/v2.1/servers/2d525a31-b0be-44cb-8fb7-335075145f08" status: 200 len: 1718 microversion: 2.1 time: 0.564510 Nov 01 18:58:43.710014 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 653/1276] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:58:43 2022] GET /compute/v2.1/servers/2d525a31-b0be-44cb-8fb7-335075145f08 => generated 1718 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:58:43.732252 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-38990302-1e1f-43e3-bcfc-2b9f9f4697f4 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:58:43.736418 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-38990302-1e1f-43e3-bcfc-2b9f9f4697f4 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] [instance: 9249c81d-e57b-4985-a398-8ad97526d5c7] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:58:43.784987 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-38990302-1e1f-43e3-bcfc-2b9f9f4697f4 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:43.785508 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-38990302-1e1f-43e3-bcfc-2b9f9f4697f4 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:43.785957 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-38990302-1e1f-43e3-bcfc-2b9f9f4697f4 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:43.786681 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-38990302-1e1f-43e3-bcfc-2b9f9f4697f4 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:43.787137 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-38990302-1e1f-43e3-bcfc-2b9f9f4697f4 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:43.787569 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-38990302-1e1f-43e3-bcfc-2b9f9f4697f4 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:43.930032 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-01a8dfb4-e500-487a-b606-182531e69fd4 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:58:43.930950 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-01a8dfb4-e500-487a-b606-182531e69fd4 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] [instance: ea631032-dd04-429b-988e-e6362ea42cf7] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:58:43.944073 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-01a8dfb4-e500-487a-b606-182531e69fd4 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:43.944894 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-01a8dfb4-e500-487a-b606-182531e69fd4 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:43.947116 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-01a8dfb4-e500-487a-b606-182531e69fd4 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:43.951380 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-01a8dfb4-e500-487a-b606-182531e69fd4 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:43.953134 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-01a8dfb4-e500-487a-b606-182531e69fd4 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:43.955043 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-01a8dfb4-e500-487a-b606-182531e69fd4 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:44.301685 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-01a8dfb4-e500-487a-b606-182531e69fd4 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c1314c21d8547ff890ede1c2ad281c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c804370880454c7aa02cef2c2c3cf144', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:58:44.322899 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-01a8dfb4-e500-487a-b606-182531e69fd4 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c1314c21d8547ff890ede1c2ad281c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c804370880454c7aa02cef2c2c3cf144', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:58:44.330596 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-01a8dfb4-e500-487a-b606-182531e69fd4 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c1314c21d8547ff890ede1c2ad281c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c804370880454c7aa02cef2c2c3cf144', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:58:44.351381 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-01a8dfb4-e500-487a-b606-182531e69fd4 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] 10.222.0.13 "GET /compute/v2.1/servers/ea631032-dd04-429b-988e-e6362ea42cf7" status: 200 len: 1544 microversion: 2.91 time: 0.423652 Nov 01 18:58:44.355282 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 654/1277] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 18:58:43 2022] GET /compute/v2.1/servers/ea631032-dd04-429b-988e-e6362ea42cf7 => generated 1544 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 18:58:44.549846 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-f99da54f-3428-44ec-a749-a526212d4382 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:58:44.550931 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-f99da54f-3428-44ec-a749-a526212d4382 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] [instance: 9dbe3d05-9fa8-4fd2-8415-52bfe6ee5801] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:58:44.564613 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f99da54f-3428-44ec-a749-a526212d4382 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:44.568562 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f99da54f-3428-44ec-a749-a526212d4382 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:44.571909 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f99da54f-3428-44ec-a749-a526212d4382 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:44.574291 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f99da54f-3428-44ec-a749-a526212d4382 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:44.581686 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f99da54f-3428-44ec-a749-a526212d4382 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:44.585038 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f99da54f-3428-44ec-a749-a526212d4382 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:44.607331 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-38990302-1e1f-43e3-bcfc-2b9f9f4697f4 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72117f17294649d6b8bc16c66c7efab2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45d4c047d3c44324a27a27831236ab0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:58:44.621188 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-38990302-1e1f-43e3-bcfc-2b9f9f4697f4 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] 10.222.0.13 "GET /compute/v2.1/servers/9249c81d-e57b-4985-a398-8ad97526d5c7" status: 200 len: 1543 microversion: 2.1 time: 0.910028 Nov 01 18:58:44.621775 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 624/1278] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:58:43 2022] GET /compute/v2.1/servers/9249c81d-e57b-4985-a398-8ad97526d5c7 => generated 1543 bytes in 919 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:58:44.739314 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-4fc70836-afa9-4b80-a2b4-b6b2a7d1aa90 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:58:44.740002 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-4fc70836-afa9-4b80-a2b4-b6b2a7d1aa90 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] [instance: 2d525a31-b0be-44cb-8fb7-335075145f08] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:58:44.766640 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-4fc70836-afa9-4b80-a2b4-b6b2a7d1aa90 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:44.767627 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-4fc70836-afa9-4b80-a2b4-b6b2a7d1aa90 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:44.768368 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-4fc70836-afa9-4b80-a2b4-b6b2a7d1aa90 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:44.772933 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-4fc70836-afa9-4b80-a2b4-b6b2a7d1aa90 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:44.778557 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-4fc70836-afa9-4b80-a2b4-b6b2a7d1aa90 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:44.779372 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-4fc70836-afa9-4b80-a2b4-b6b2a7d1aa90 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:45.243929 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-f99da54f-3428-44ec-a749-a526212d4382 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0290a6bb8bc24b8988a925327ac0381c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86941784237549838bba63ce88053b88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:58:45.258715 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-f99da54f-3428-44ec-a749-a526212d4382 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] 10.222.0.13 "GET /compute/v2.1/servers/9dbe3d05-9fa8-4fd2-8415-52bfe6ee5801" status: 200 len: 1319 microversion: 2.1 time: 0.714140 Nov 01 18:58:45.259320 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 655/1279] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:58:44 2022] GET /compute/v2.1/servers/9dbe3d05-9fa8-4fd2-8415-52bfe6ee5801 => generated 1319 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 18:58:45.387776 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-2dc6c94b-92b2-4734-8865-674659ffc7dc tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:58:45.388754 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-2dc6c94b-92b2-4734-8865-674659ffc7dc tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] [instance: ea631032-dd04-429b-988e-e6362ea42cf7] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:58:45.405802 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2dc6c94b-92b2-4734-8865-674659ffc7dc tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:45.408916 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2dc6c94b-92b2-4734-8865-674659ffc7dc tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:45.409718 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2dc6c94b-92b2-4734-8865-674659ffc7dc tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:45.414704 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2dc6c94b-92b2-4734-8865-674659ffc7dc tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:45.415426 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2dc6c94b-92b2-4734-8865-674659ffc7dc tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:45.416216 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2dc6c94b-92b2-4734-8865-674659ffc7dc tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:45.569262 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-2dc6c94b-92b2-4734-8865-674659ffc7dc tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c1314c21d8547ff890ede1c2ad281c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c804370880454c7aa02cef2c2c3cf144', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:58:45.584190 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-4fc70836-afa9-4b80-a2b4-b6b2a7d1aa90 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f32f5fba1976432d938e664c7714e52b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b9d4c236b944f9b2e8e502a50a8f8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:58:45.593480 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-4fc70836-afa9-4b80-a2b4-b6b2a7d1aa90 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] 10.222.0.13 "GET /compute/v2.1/servers/2d525a31-b0be-44cb-8fb7-335075145f08" status: 200 len: 1718 microversion: 2.1 time: 0.858981 Nov 01 18:58:45.596011 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-2dc6c94b-92b2-4734-8865-674659ffc7dc tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c1314c21d8547ff890ede1c2ad281c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c804370880454c7aa02cef2c2c3cf144', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:58:45.601540 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-2dc6c94b-92b2-4734-8865-674659ffc7dc tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c1314c21d8547ff890ede1c2ad281c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c804370880454c7aa02cef2c2c3cf144', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:58:45.602423 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 625/1280] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:58:44 2022] GET /compute/v2.1/servers/2d525a31-b0be-44cb-8fb7-335075145f08 => generated 1718 bytes in 869 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:58:45.621249 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-2dc6c94b-92b2-4734-8865-674659ffc7dc tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] 10.222.0.13 "GET /compute/v2.1/servers/ea631032-dd04-429b-988e-e6362ea42cf7" status: 200 len: 1544 microversion: 2.91 time: 0.238406 Nov 01 18:58:45.622162 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 656/1281] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 18:58:45 2022] GET /compute/v2.1/servers/ea631032-dd04-429b-988e-e6362ea42cf7 => generated 1544 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 01 18:58:45.643904 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-58482911-ca14-4bc0-b3e8-1268813ff8f7 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:58:45.644674 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-58482911-ca14-4bc0-b3e8-1268813ff8f7 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] [instance: 9249c81d-e57b-4985-a398-8ad97526d5c7] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:58:45.654103 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-58482911-ca14-4bc0-b3e8-1268813ff8f7 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:45.662846 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-58482911-ca14-4bc0-b3e8-1268813ff8f7 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:45.665490 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-58482911-ca14-4bc0-b3e8-1268813ff8f7 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:45.666630 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-58482911-ca14-4bc0-b3e8-1268813ff8f7 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:45.667412 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-58482911-ca14-4bc0-b3e8-1268813ff8f7 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:45.669009 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-58482911-ca14-4bc0-b3e8-1268813ff8f7 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:46.037841 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-58482911-ca14-4bc0-b3e8-1268813ff8f7 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72117f17294649d6b8bc16c66c7efab2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45d4c047d3c44324a27a27831236ab0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:58:46.048173 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-58482911-ca14-4bc0-b3e8-1268813ff8f7 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] 10.222.0.13 "GET /compute/v2.1/servers/9249c81d-e57b-4985-a398-8ad97526d5c7" status: 200 len: 1543 microversion: 2.1 time: 0.408536 Nov 01 18:58:46.052334 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 626/1282] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:58:45 2022] GET /compute/v2.1/servers/9249c81d-e57b-4985-a398-8ad97526d5c7 => generated 1543 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:58:46.285021 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-81a4cc80-fd11-4c1c-96e8-43211b2e4a2d tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:58:46.286445 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-81a4cc80-fd11-4c1c-96e8-43211b2e4a2d tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] [instance: 9dbe3d05-9fa8-4fd2-8415-52bfe6ee5801] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:58:46.293655 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-81a4cc80-fd11-4c1c-96e8-43211b2e4a2d tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:46.294292 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-81a4cc80-fd11-4c1c-96e8-43211b2e4a2d tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:46.294872 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-81a4cc80-fd11-4c1c-96e8-43211b2e4a2d tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:46.295687 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-81a4cc80-fd11-4c1c-96e8-43211b2e4a2d tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:46.297492 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-81a4cc80-fd11-4c1c-96e8-43211b2e4a2d tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:46.297492 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-81a4cc80-fd11-4c1c-96e8-43211b2e4a2d tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:46.630722 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-d4326b82-fbbf-404f-8a38-6de56eb59aa7 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:58:46.631406 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-d4326b82-fbbf-404f-8a38-6de56eb59aa7 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] [instance: 2d525a31-b0be-44cb-8fb7-335075145f08] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:58:46.639544 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d4326b82-fbbf-404f-8a38-6de56eb59aa7 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:46.640528 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d4326b82-fbbf-404f-8a38-6de56eb59aa7 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:46.641499 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d4326b82-fbbf-404f-8a38-6de56eb59aa7 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:46.644142 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d4326b82-fbbf-404f-8a38-6de56eb59aa7 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:46.645446 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d4326b82-fbbf-404f-8a38-6de56eb59aa7 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:46.646357 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d4326b82-fbbf-404f-8a38-6de56eb59aa7 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:46.698473 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-81a4cc80-fd11-4c1c-96e8-43211b2e4a2d tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0290a6bb8bc24b8988a925327ac0381c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86941784237549838bba63ce88053b88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:58:46.716755 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-81a4cc80-fd11-4c1c-96e8-43211b2e4a2d tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] 10.222.0.13 "GET /compute/v2.1/servers/9dbe3d05-9fa8-4fd2-8415-52bfe6ee5801" status: 200 len: 1468 microversion: 2.1 time: 0.436276 Nov 01 18:58:46.719514 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 657/1283] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:58:46 2022] GET /compute/v2.1/servers/9dbe3d05-9fa8-4fd2-8415-52bfe6ee5801 => generated 1468 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:58:46.732569 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-ab399bba-fd22-4e04-ae36-b0e671acb8b0 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:58:46.736327 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-ab399bba-fd22-4e04-ae36-b0e671acb8b0 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] [instance: ea631032-dd04-429b-988e-e6362ea42cf7] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:58:46.750330 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-ab399bba-fd22-4e04-ae36-b0e671acb8b0 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:46.750851 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-ab399bba-fd22-4e04-ae36-b0e671acb8b0 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:46.751298 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-ab399bba-fd22-4e04-ae36-b0e671acb8b0 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:46.756936 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-ab399bba-fd22-4e04-ae36-b0e671acb8b0 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:46.757812 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-ab399bba-fd22-4e04-ae36-b0e671acb8b0 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:46.759794 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-ab399bba-fd22-4e04-ae36-b0e671acb8b0 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:46.863355 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-d4326b82-fbbf-404f-8a38-6de56eb59aa7 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f32f5fba1976432d938e664c7714e52b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b9d4c236b944f9b2e8e502a50a8f8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:58:46.872673 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-d4326b82-fbbf-404f-8a38-6de56eb59aa7 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] 10.222.0.13 "GET /compute/v2.1/servers/2d525a31-b0be-44cb-8fb7-335075145f08" status: 200 len: 1718 microversion: 2.1 time: 0.248421 Nov 01 18:58:46.886150 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 627/1284] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:58:46 2022] GET /compute/v2.1/servers/2d525a31-b0be-44cb-8fb7-335075145f08 => generated 1718 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 18:58:46.889784 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-ab399bba-fd22-4e04-ae36-b0e671acb8b0 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c1314c21d8547ff890ede1c2ad281c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c804370880454c7aa02cef2c2c3cf144', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:58:46.893374 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-9ec9c0ad-9f41-49fb-bffe-8f1108940c8e tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:58:46.893774 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-9ec9c0ad-9f41-49fb-bffe-8f1108940c8e tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] [instance: efdf10ba-60d4-4fb0-970d-109a8f936808] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:58:46.901104 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-9ec9c0ad-9f41-49fb-bffe-8f1108940c8e tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:46.901858 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-9ec9c0ad-9f41-49fb-bffe-8f1108940c8e tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:46.902473 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-9ec9c0ad-9f41-49fb-bffe-8f1108940c8e tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:46.903347 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-9ec9c0ad-9f41-49fb-bffe-8f1108940c8e tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:46.903810 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-9ec9c0ad-9f41-49fb-bffe-8f1108940c8e tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:46.904226 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-9ec9c0ad-9f41-49fb-bffe-8f1108940c8e tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:46.904355 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-ab399bba-fd22-4e04-ae36-b0e671acb8b0 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c1314c21d8547ff890ede1c2ad281c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c804370880454c7aa02cef2c2c3cf144', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:58:46.905842 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-ab399bba-fd22-4e04-ae36-b0e671acb8b0 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c1314c21d8547ff890ede1c2ad281c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c804370880454c7aa02cef2c2c3cf144', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:58:46.922408 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-ab399bba-fd22-4e04-ae36-b0e671acb8b0 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] 10.222.0.13 "GET /compute/v2.1/servers/ea631032-dd04-429b-988e-e6362ea42cf7" status: 200 len: 1544 microversion: 2.91 time: 0.198290 Nov 01 18:58:46.923383 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 658/1285] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 18:58:46 2022] GET /compute/v2.1/servers/ea631032-dd04-429b-988e-e6362ea42cf7 => generated 1544 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 18:58:46.931338 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-91915108-f653-441a-a1ca-92b863ff48da tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 18:58:46.939241 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-91915108-f653-441a-a1ca-92b863ff48da tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] [instance: ed4798be-a45e-46f5-8f7e-1165f6479bd1] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:58:46.954053 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-91915108-f653-441a-a1ca-92b863ff48da tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:46.955046 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-91915108-f653-441a-a1ca-92b863ff48da tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:46.956131 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-91915108-f653-441a-a1ca-92b863ff48da tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:46.957103 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-91915108-f653-441a-a1ca-92b863ff48da tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:46.957727 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-91915108-f653-441a-a1ca-92b863ff48da tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:46.958485 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-91915108-f653-441a-a1ca-92b863ff48da tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:46.963154 n-d-863052-2 devstack@n-api.service[121402]: DEBUG dbcounter [-] [121402] Writing DB stats nova_cell1:SELECT=100 {{(pid=121402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 18:58:46.995102 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.objects.instance [None req-91915108-f653-441a-a1ca-92b863ff48da tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lazy-loading 'flavor' on Instance uuid ed4798be-a45e-46f5-8f7e-1165f6479bd1 {{(pid=121402) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 01 18:58:47.080128 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-9ec9c0ad-9f41-49fb-bffe-8f1108940c8e tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0290a6bb8bc24b8988a925327ac0381c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86941784237549838bba63ce88053b88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:58:47.088827 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-9ec9c0ad-9f41-49fb-bffe-8f1108940c8e tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] 10.222.0.13 "GET /compute/v2.1/servers/efdf10ba-60d4-4fb0-970d-109a8f936808" status: 200 len: 1469 microversion: 2.1 time: 0.201141 Nov 01 18:58:47.089472 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 628/1286] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:58:46 2022] GET /compute/v2.1/servers/efdf10ba-60d4-4fb0-970d-109a8f936808 => generated 1469 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:58:47.097018 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-24d9de7b-9afc-4b61-9d9a-5c3d060b7dc5 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:58:47.097856 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-24d9de7b-9afc-4b61-9d9a-5c3d060b7dc5 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] [instance: 9249c81d-e57b-4985-a398-8ad97526d5c7] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:58:47.105095 n-d-863052-2 devstack@n-api.service[121403]: DEBUG dbcounter [-] [121403] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=121403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 18:58:47.106874 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-24d9de7b-9afc-4b61-9d9a-5c3d060b7dc5 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:47.107409 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-24d9de7b-9afc-4b61-9d9a-5c3d060b7dc5 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:47.108147 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-24d9de7b-9afc-4b61-9d9a-5c3d060b7dc5 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:47.110131 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-24d9de7b-9afc-4b61-9d9a-5c3d060b7dc5 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:47.110756 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-24d9de7b-9afc-4b61-9d9a-5c3d060b7dc5 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:47.111995 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-24d9de7b-9afc-4b61-9d9a-5c3d060b7dc5 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:47.147842 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-91915108-f653-441a-a1ca-92b863ff48da tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] 10.222.0.13 "POST /compute/v2.1/servers/ed4798be-a45e-46f5-8f7e-1165f6479bd1/action" status: 200 len: 32 microversion: 2.1 time: 0.222797 Nov 01 18:58:47.154804 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 659/1287] 10.222.0.13 () {60 vars in 1278 bytes} [Tue Nov 1 18:58:46 2022] POST /compute/v2.1/servers/ed4798be-a45e-46f5-8f7e-1165f6479bd1/action => generated 32 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 01 18:58:47.162143 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-68f5c615-f398-4a3b-8d94-8ec60c5ea5ec tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:58:47.167708 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-68f5c615-f398-4a3b-8d94-8ec60c5ea5ec tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0290a6bb8bc24b8988a925327ac0381c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86941784237549838bba63ce88053b88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:58:47.169508 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-68f5c615-f398-4a3b-8d94-8ec60c5ea5ec tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Searching by: {'reservation_id': 'r-mgs1xmct', 'deleted': False, 'project_id': '86941784237549838bba63ce88053b88'} {{(pid=121402) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 01 18:58:47.179080 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-68f5c615-f398-4a3b-8d94-8ec60c5ea5ec tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:47.179367 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-68f5c615-f398-4a3b-8d94-8ec60c5ea5ec tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:47.179991 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-68f5c615-f398-4a3b-8d94-8ec60c5ea5ec tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:47.180779 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-68f5c615-f398-4a3b-8d94-8ec60c5ea5ec tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:47.181420 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-68f5c615-f398-4a3b-8d94-8ec60c5ea5ec tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:47.181998 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-68f5c615-f398-4a3b-8d94-8ec60c5ea5ec tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:47.312923 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-24d9de7b-9afc-4b61-9d9a-5c3d060b7dc5 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72117f17294649d6b8bc16c66c7efab2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45d4c047d3c44324a27a27831236ab0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:58:47.321999 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-24d9de7b-9afc-4b61-9d9a-5c3d060b7dc5 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] 10.222.0.13 "GET /compute/v2.1/servers/9249c81d-e57b-4985-a398-8ad97526d5c7" status: 200 len: 1543 microversion: 2.1 time: 0.231248 Nov 01 18:58:47.322913 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 629/1288] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:58:47 2022] GET /compute/v2.1/servers/9249c81d-e57b-4985-a398-8ad97526d5c7 => generated 1543 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:58:47.327638 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-bdba3157-c90c-4e98-b2f1-b92856e3f422 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:58:47.328634 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-bdba3157-c90c-4e98-b2f1-b92856e3f422 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] [instance: ed4798be-a45e-46f5-8f7e-1165f6479bd1] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:58:47.334779 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-bdba3157-c90c-4e98-b2f1-b92856e3f422 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:47.335658 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-bdba3157-c90c-4e98-b2f1-b92856e3f422 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:47.336939 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-bdba3157-c90c-4e98-b2f1-b92856e3f422 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:47.337816 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-bdba3157-c90c-4e98-b2f1-b92856e3f422 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:47.338428 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-bdba3157-c90c-4e98-b2f1-b92856e3f422 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:47.339120 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-bdba3157-c90c-4e98-b2f1-b92856e3f422 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:47.367617 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.multi_cell_list [None req-68f5c615-f398-4a3b-8d94-8ec60c5ea5ec tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=121402) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 01 18:58:47.518808 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-68f5c615-f398-4a3b-8d94-8ec60c5ea5ec tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0290a6bb8bc24b8988a925327ac0381c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86941784237549838bba63ce88053b88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:58:47.533045 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-68f5c615-f398-4a3b-8d94-8ec60c5ea5ec tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:47.533845 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-68f5c615-f398-4a3b-8d94-8ec60c5ea5ec tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:47.534491 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-68f5c615-f398-4a3b-8d94-8ec60c5ea5ec tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:47.582975 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-bdba3157-c90c-4e98-b2f1-b92856e3f422 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a63d69c99a546f0af16329cff3ca717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a1bb191cff948e99c008b5e861ce4a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:58:47.591229 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-bdba3157-c90c-4e98-b2f1-b92856e3f422 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] 10.222.0.13 "GET /compute/v2.1/servers/ed4798be-a45e-46f5-8f7e-1165f6479bd1" status: 200 len: 1521 microversion: 2.1 time: 0.267086 Nov 01 18:58:47.608113 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 630/1289] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:58:47 2022] GET /compute/v2.1/servers/ed4798be-a45e-46f5-8f7e-1165f6479bd1 => generated 1521 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:58:47.898038 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-e8d88b26-4a8e-4b34-bc95-038defd24432 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:58:47.899897 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-e8d88b26-4a8e-4b34-bc95-038defd24432 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] [instance: 2d525a31-b0be-44cb-8fb7-335075145f08] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:58:47.911016 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-e8d88b26-4a8e-4b34-bc95-038defd24432 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:47.912373 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-e8d88b26-4a8e-4b34-bc95-038defd24432 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:47.913166 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-e8d88b26-4a8e-4b34-bc95-038defd24432 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:47.914401 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-e8d88b26-4a8e-4b34-bc95-038defd24432 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:47.921502 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-e8d88b26-4a8e-4b34-bc95-038defd24432 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:47.922184 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-e8d88b26-4a8e-4b34-bc95-038defd24432 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:48.083720 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-e8d88b26-4a8e-4b34-bc95-038defd24432 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f32f5fba1976432d938e664c7714e52b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b9d4c236b944f9b2e8e502a50a8f8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:58:48.094599 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-e8d88b26-4a8e-4b34-bc95-038defd24432 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] 10.222.0.13 "GET /compute/v2.1/servers/2d525a31-b0be-44cb-8fb7-335075145f08" status: 200 len: 1718 microversion: 2.1 time: 0.200639 Nov 01 18:58:48.095503 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 631/1290] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:58:47 2022] GET /compute/v2.1/servers/2d525a31-b0be-44cb-8fb7-335075145f08 => generated 1718 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:58:48.100272 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-379001d5-4349-4742-a9a1-bc0080de8d7c tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:58:48.100894 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-379001d5-4349-4742-a9a1-bc0080de8d7c tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] [instance: ea631032-dd04-429b-988e-e6362ea42cf7] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:58:48.107564 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-379001d5-4349-4742-a9a1-bc0080de8d7c tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:48.108052 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-379001d5-4349-4742-a9a1-bc0080de8d7c tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:48.108485 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-379001d5-4349-4742-a9a1-bc0080de8d7c tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:48.109754 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-379001d5-4349-4742-a9a1-bc0080de8d7c tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:48.110373 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-379001d5-4349-4742-a9a1-bc0080de8d7c tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:48.110951 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-379001d5-4349-4742-a9a1-bc0080de8d7c tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:48.155218 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-68f5c615-f398-4a3b-8d94-8ec60c5ea5ec tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] 10.222.0.13 "GET /compute/v2.1/servers/detail?reservation_id=r-mgs1xmct" status: 200 len: 2930 microversion: 2.1 time: 0.997444 Nov 01 18:58:48.156977 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 660/1291] 10.222.0.13 () {58 vars in 1197 bytes} [Tue Nov 1 18:58:47 2022] GET /compute/v2.1/servers/detail?reservation_id=r-mgs1xmct => generated 2930 bytes in 1000 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:58:48.182546 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-71d3ec5d-a577-413b-b615-faa1ee1cc23e tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:58:48.191312 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-379001d5-4349-4742-a9a1-bc0080de8d7c tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c1314c21d8547ff890ede1c2ad281c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c804370880454c7aa02cef2c2c3cf144', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:58:48.200937 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-379001d5-4349-4742-a9a1-bc0080de8d7c tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c1314c21d8547ff890ede1c2ad281c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c804370880454c7aa02cef2c2c3cf144', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:58:48.203544 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-379001d5-4349-4742-a9a1-bc0080de8d7c tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c1314c21d8547ff890ede1c2ad281c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c804370880454c7aa02cef2c2c3cf144', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:58:48.209360 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-379001d5-4349-4742-a9a1-bc0080de8d7c tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] 10.222.0.13 "GET /compute/v2.1/servers/ea631032-dd04-429b-988e-e6362ea42cf7" status: 200 len: 1544 microversion: 2.91 time: 0.112830 Nov 01 18:58:48.224615 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.compute.server_groups [None req-71d3ec5d-a577-413b-b615-faa1ee1cc23e tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Querying cell 389766af-efe4-4d8b-b2de-e920ed3438ee(cell1) for 2 instances {{(pid=121402) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Nov 01 18:58:48.224615 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-71d3ec5d-a577-413b-b615-faa1ee1cc23e tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:48.224615 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-71d3ec5d-a577-413b-b615-faa1ee1cc23e tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:48.224615 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-71d3ec5d-a577-413b-b615-faa1ee1cc23e tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:48.226043 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 632/1292] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 18:58:48 2022] GET /compute/v2.1/servers/ea631032-dd04-429b-988e-e6362ea42cf7 => generated 1544 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 18:58:48.245990 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-71d3ec5d-a577-413b-b615-faa1ee1cc23e tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] 10.222.0.13 "GET /compute/v2.1/os-server-groups/0265752b-95c4-4bf0-aec6-cb81e093d2ee" status: 200 len: 265 microversion: 2.1 time: 0.068171 Nov 01 18:58:48.246751 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 661/1293] 10.222.0.13 () {58 vars in 1263 bytes} [Tue Nov 1 18:58:48 2022] GET /compute/v2.1/os-server-groups/0265752b-95c4-4bf0-aec6-cb81e093d2ee => generated 265 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 18:58:48.257170 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-48776822-af83-4ab4-876b-162f0277e2e9 tempest-ServersOnMultiNodesTest-1027241392 tempest-ServersOnMultiNodesTest-1027241392-project-admin] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:58:48.257784 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-48776822-af83-4ab4-876b-162f0277e2e9 tempest-ServersOnMultiNodesTest-1027241392 tempest-ServersOnMultiNodesTest-1027241392-project-admin] [instance: 9dbe3d05-9fa8-4fd2-8415-52bfe6ee5801] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:58:48.264042 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-48776822-af83-4ab4-876b-162f0277e2e9 tempest-ServersOnMultiNodesTest-1027241392 tempest-ServersOnMultiNodesTest-1027241392-project-admin] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:48.264522 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-48776822-af83-4ab4-876b-162f0277e2e9 tempest-ServersOnMultiNodesTest-1027241392 tempest-ServersOnMultiNodesTest-1027241392-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:48.264976 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-48776822-af83-4ab4-876b-162f0277e2e9 tempest-ServersOnMultiNodesTest-1027241392 tempest-ServersOnMultiNodesTest-1027241392-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:48.266208 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-48776822-af83-4ab4-876b-162f0277e2e9 tempest-ServersOnMultiNodesTest-1027241392 tempest-ServersOnMultiNodesTest-1027241392-project-admin] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:48.266662 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-48776822-af83-4ab4-876b-162f0277e2e9 tempest-ServersOnMultiNodesTest-1027241392 tempest-ServersOnMultiNodesTest-1027241392-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:48.267080 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-48776822-af83-4ab4-876b-162f0277e2e9 tempest-ServersOnMultiNodesTest-1027241392 tempest-ServersOnMultiNodesTest-1027241392-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:48.348033 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-587db512-81dc-4fe6-a682-672879508b01 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:58:48.348808 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-587db512-81dc-4fe6-a682-672879508b01 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] [instance: 9249c81d-e57b-4985-a398-8ad97526d5c7] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:58:48.355451 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-587db512-81dc-4fe6-a682-672879508b01 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:48.356179 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-587db512-81dc-4fe6-a682-672879508b01 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:48.356870 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-587db512-81dc-4fe6-a682-672879508b01 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:48.357787 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-587db512-81dc-4fe6-a682-672879508b01 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:48.358436 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-587db512-81dc-4fe6-a682-672879508b01 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:48.359116 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-587db512-81dc-4fe6-a682-672879508b01 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:48.411685 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-48776822-af83-4ab4-876b-162f0277e2e9 tempest-ServersOnMultiNodesTest-1027241392 tempest-ServersOnMultiNodesTest-1027241392-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/9dbe3d05-9fa8-4fd2-8415-52bfe6ee5801" status: 200 len: 1619 microversion: 2.1 time: 0.157941 Nov 01 18:58:48.412367 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 633/1294] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:58:48 2022] GET /compute/v2.1/servers/9dbe3d05-9fa8-4fd2-8415-52bfe6ee5801 => generated 1619 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:58:48.435322 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-252b0dab-44c5-468e-9dab-abb86dd2e79e tempest-ServersOnMultiNodesTest-1027241392 tempest-ServersOnMultiNodesTest-1027241392-project-admin] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:58:48.435942 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-252b0dab-44c5-468e-9dab-abb86dd2e79e tempest-ServersOnMultiNodesTest-1027241392 tempest-ServersOnMultiNodesTest-1027241392-project-admin] [instance: efdf10ba-60d4-4fb0-970d-109a8f936808] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:58:48.443430 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-252b0dab-44c5-468e-9dab-abb86dd2e79e tempest-ServersOnMultiNodesTest-1027241392 tempest-ServersOnMultiNodesTest-1027241392-project-admin] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:48.444107 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-252b0dab-44c5-468e-9dab-abb86dd2e79e tempest-ServersOnMultiNodesTest-1027241392 tempest-ServersOnMultiNodesTest-1027241392-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:48.444794 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-252b0dab-44c5-468e-9dab-abb86dd2e79e tempest-ServersOnMultiNodesTest-1027241392 tempest-ServersOnMultiNodesTest-1027241392-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:48.446035 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-252b0dab-44c5-468e-9dab-abb86dd2e79e tempest-ServersOnMultiNodesTest-1027241392 tempest-ServersOnMultiNodesTest-1027241392-project-admin] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:48.446686 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-252b0dab-44c5-468e-9dab-abb86dd2e79e tempest-ServersOnMultiNodesTest-1027241392 tempest-ServersOnMultiNodesTest-1027241392-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:48.447280 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-252b0dab-44c5-468e-9dab-abb86dd2e79e tempest-ServersOnMultiNodesTest-1027241392 tempest-ServersOnMultiNodesTest-1027241392-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:48.739438 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-587db512-81dc-4fe6-a682-672879508b01 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72117f17294649d6b8bc16c66c7efab2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45d4c047d3c44324a27a27831236ab0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:58:48.747170 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-587db512-81dc-4fe6-a682-672879508b01 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] 10.222.0.13 "GET /compute/v2.1/servers/9249c81d-e57b-4985-a398-8ad97526d5c7" status: 200 len: 1543 microversion: 2.1 time: 0.405251 Nov 01 18:58:48.760930 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 662/1295] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:58:48 2022] GET /compute/v2.1/servers/9249c81d-e57b-4985-a398-8ad97526d5c7 => generated 1543 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:58:48.760930 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-532c5916-9b39-4035-abdc-51459f4ccba1 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:58:48.760930 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-532c5916-9b39-4035-abdc-51459f4ccba1 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] [instance: ed4798be-a45e-46f5-8f7e-1165f6479bd1] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:58:48.774904 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-532c5916-9b39-4035-abdc-51459f4ccba1 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:48.775421 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-532c5916-9b39-4035-abdc-51459f4ccba1 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:48.775944 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-532c5916-9b39-4035-abdc-51459f4ccba1 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:48.776559 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-532c5916-9b39-4035-abdc-51459f4ccba1 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:48.777050 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-532c5916-9b39-4035-abdc-51459f4ccba1 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:48.777474 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-532c5916-9b39-4035-abdc-51459f4ccba1 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:48.848082 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-252b0dab-44c5-468e-9dab-abb86dd2e79e tempest-ServersOnMultiNodesTest-1027241392 tempest-ServersOnMultiNodesTest-1027241392-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/efdf10ba-60d4-4fb0-970d-109a8f936808" status: 200 len: 1620 microversion: 2.1 time: 0.416554 Nov 01 18:58:48.848953 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 634/1296] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:58:48 2022] GET /compute/v2.1/servers/efdf10ba-60d4-4fb0-970d-109a8f936808 => generated 1620 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:58:48.876449 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-8f01c971-f322-45bf-88ea-7189a5386fe5 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Action: 'create', calling method: .version_select at 0x7f0ae225b040>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-1169837040", "policies": ["anti-affinity"]}} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 18:58:48.904191 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.quota [None req-8f01c971-f322-45bf-88ea-7189a5386fe5 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Getting quotas for project 86941784237549838bba63ce88053b88. Resources: {'server_groups'} {{(pid=121403) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 01 18:58:48.924271 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.quota [None req-8f01c971-f322-45bf-88ea-7189a5386fe5 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Getting quotas for user 0290a6bb8bc24b8988a925327ac0381c and project 86941784237549838bba63ce88053b88. Resources: {'server_groups'} {{(pid=121403) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 01 18:58:49.009356 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.quota [None req-8f01c971-f322-45bf-88ea-7189a5386fe5 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Getting quotas for project 86941784237549838bba63ce88053b88. Resources: {'server_groups'} {{(pid=121403) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 01 18:58:49.016057 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.quota [None req-8f01c971-f322-45bf-88ea-7189a5386fe5 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Getting quotas for user 0290a6bb8bc24b8988a925327ac0381c and project 86941784237549838bba63ce88053b88. Resources: {'server_groups'} {{(pid=121403) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 01 18:58:49.063755 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-8f01c971-f322-45bf-88ea-7189a5386fe5 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] 10.222.0.13 "POST /compute/v2.1/os-server-groups" status: 200 len: 193 microversion: 2.1 time: 0.189502 Nov 01 18:58:49.070120 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 635/1297] 10.222.0.13 () {60 vars in 1174 bytes} [Tue Nov 1 18:58:48 2022] POST /compute/v2.1/os-server-groups => generated 193 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 01 18:58:49.123475 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-9875a3c8-6a1f-496a-a365-4c7c95b26273 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:58:49.124276 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-9875a3c8-6a1f-496a-a365-4c7c95b26273 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] [instance: 2d525a31-b0be-44cb-8fb7-335075145f08] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:58:49.138278 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-9875a3c8-6a1f-496a-a365-4c7c95b26273 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:49.138916 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-9875a3c8-6a1f-496a-a365-4c7c95b26273 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:49.139368 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-9875a3c8-6a1f-496a-a365-4c7c95b26273 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:49.140084 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-9875a3c8-6a1f-496a-a365-4c7c95b26273 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:49.140602 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-9875a3c8-6a1f-496a-a365-4c7c95b26273 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:49.141023 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-9875a3c8-6a1f-496a-a365-4c7c95b26273 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:49.221907 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-532c5916-9b39-4035-abdc-51459f4ccba1 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a63d69c99a546f0af16329cff3ca717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a1bb191cff948e99c008b5e861ce4a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:58:49.231671 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-532c5916-9b39-4035-abdc-51459f4ccba1 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] 10.222.0.13 "GET /compute/v2.1/servers/ed4798be-a45e-46f5-8f7e-1165f6479bd1" status: 200 len: 1521 microversion: 2.1 time: 0.479696 Nov 01 18:58:49.254412 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 663/1298] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:58:48 2022] GET /compute/v2.1/servers/ed4798be-a45e-46f5-8f7e-1165f6479bd1 => generated 1521 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:58:49.260042 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-18d62319-2630-4c9d-9980-3b01a1cff3bb tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:58:49.264848 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-18d62319-2630-4c9d-9980-3b01a1cff3bb tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] [instance: ea631032-dd04-429b-988e-e6362ea42cf7] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:58:49.290564 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-18d62319-2630-4c9d-9980-3b01a1cff3bb tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:49.291077 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-18d62319-2630-4c9d-9980-3b01a1cff3bb tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:49.291524 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-18d62319-2630-4c9d-9980-3b01a1cff3bb tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:49.292236 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-18d62319-2630-4c9d-9980-3b01a1cff3bb tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:49.292718 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-18d62319-2630-4c9d-9980-3b01a1cff3bb tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:49.293138 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-18d62319-2630-4c9d-9980-3b01a1cff3bb tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:49.405361 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-18d62319-2630-4c9d-9980-3b01a1cff3bb tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c1314c21d8547ff890ede1c2ad281c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c804370880454c7aa02cef2c2c3cf144', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:58:49.415846 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-18d62319-2630-4c9d-9980-3b01a1cff3bb tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c1314c21d8547ff890ede1c2ad281c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c804370880454c7aa02cef2c2c3cf144', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:58:49.422915 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-18d62319-2630-4c9d-9980-3b01a1cff3bb tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c1314c21d8547ff890ede1c2ad281c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c804370880454c7aa02cef2c2c3cf144', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:58:49.428309 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-18d62319-2630-4c9d-9980-3b01a1cff3bb tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] 10.222.0.13 "GET /compute/v2.1/servers/ea631032-dd04-429b-988e-e6362ea42cf7" status: 200 len: 1544 microversion: 2.91 time: 0.172317 Nov 01 18:58:49.429197 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 664/1299] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 18:58:49 2022] GET /compute/v2.1/servers/ea631032-dd04-429b-988e-e6362ea42cf7 => generated 1544 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 18:58:49.433940 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-439a2220-32b5-4c8a-bff3-fcc21e274f40 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-411028573", "imageRef": "2d4a0047-1b9e-445f-8af8-1b5c9d93e881", "flavorRef": "452", "min_count": 2, "return_reservation_id": true}, "os:scheduler_hints": {"group": "15337c02-bdef-4487-a865-2768be719697"}} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 18:58:49.499098 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.network.neutron [None req-439a2220-32b5-4c8a-bff3-fcc21e274f40 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] validate_networks() for None {{(pid=121402) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 01 18:58:49.552248 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-9875a3c8-6a1f-496a-a365-4c7c95b26273 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f32f5fba1976432d938e664c7714e52b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b9d4c236b944f9b2e8e502a50a8f8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:58:49.566931 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-9875a3c8-6a1f-496a-a365-4c7c95b26273 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] 10.222.0.13 "GET /compute/v2.1/servers/2d525a31-b0be-44cb-8fb7-335075145f08" status: 200 len: 1718 microversion: 2.1 time: 0.447665 Nov 01 18:58:49.570556 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 636/1300] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:58:49 2022] GET /compute/v2.1/servers/2d525a31-b0be-44cb-8fb7-335075145f08 => generated 1718 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 18:58:49.772799 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-5a08ff83-f95f-4ced-acf9-ab83b2e7e427 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:58:49.774162 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-5a08ff83-f95f-4ced-acf9-ab83b2e7e427 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] [instance: 9249c81d-e57b-4985-a398-8ad97526d5c7] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:58:49.784280 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-5a08ff83-f95f-4ced-acf9-ab83b2e7e427 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:49.784821 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-5a08ff83-f95f-4ced-acf9-ab83b2e7e427 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:49.786371 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-5a08ff83-f95f-4ced-acf9-ab83b2e7e427 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:49.787269 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-5a08ff83-f95f-4ced-acf9-ab83b2e7e427 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:49.788196 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-5a08ff83-f95f-4ced-acf9-ab83b2e7e427 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:49.788791 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-5a08ff83-f95f-4ced-acf9-ab83b2e7e427 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:49.795352 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.virt.hardware [None req-439a2220-32b5-4c8a-bff3-fcc21e274f40 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Flavor limits 0:0:0 {{(pid=121402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 01 18:58:49.796508 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.virt.hardware [None req-439a2220-32b5-4c8a-bff3-fcc21e274f40 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Image limits 0:0:0 {{(pid=121402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 01 18:58:49.797738 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.virt.hardware [None req-439a2220-32b5-4c8a-bff3-fcc21e274f40 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Flavor pref 0:0:0 {{(pid=121402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 01 18:58:49.798156 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.virt.hardware [None req-439a2220-32b5-4c8a-bff3-fcc21e274f40 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Image pref 0:0:0 {{(pid=121402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 01 18:58:49.798572 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.virt.hardware [None req-439a2220-32b5-4c8a-bff3-fcc21e274f40 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 01 18:58:49.819440 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-439a2220-32b5-4c8a-bff3-fcc21e274f40 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:49.820461 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-439a2220-32b5-4c8a-bff3-fcc21e274f40 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:49.820972 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-439a2220-32b5-4c8a-bff3-fcc21e274f40 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:49.821824 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-439a2220-32b5-4c8a-bff3-fcc21e274f40 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:49.822291 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-439a2220-32b5-4c8a-bff3-fcc21e274f40 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:49.822717 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-439a2220-32b5-4c8a-bff3-fcc21e274f40 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:49.841027 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.quota [None req-439a2220-32b5-4c8a-bff3-fcc21e274f40 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Getting quotas for project 86941784237549838bba63ce88053b88. Resources: {'cores', 'ram', 'instances'} {{(pid=121402) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 01 18:58:49.846210 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.quota [None req-439a2220-32b5-4c8a-bff3-fcc21e274f40 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Getting quotas for user 0290a6bb8bc24b8988a925327ac0381c and project 86941784237549838bba63ce88053b88. Resources: {'cores', 'ram', 'instances'} {{(pid=121402) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 01 18:58:49.861751 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-439a2220-32b5-4c8a-bff3-fcc21e274f40 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Going to run 2 instances... {{(pid=121402) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 01 18:58:49.864430 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-439a2220-32b5-4c8a-bff3-fcc21e274f40 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] [instance: 5e7ed73c-1243-4adf-94a2-09f7bf73f6fd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2d4a0047-1b9e-445f-8af8-1b5c9d93e881',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121402) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 01 18:58:49.914778 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.quota [None req-439a2220-32b5-4c8a-bff3-fcc21e274f40 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Checking whether user_id and queued_for_delete are populated for all projects {{(pid=121402) is_qfd_populated /opt/stack/nova/nova/quota.py:1268}} Nov 01 18:58:49.934100 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.quota [None req-439a2220-32b5-4c8a-bff3-fcc21e274f40 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Getting quotas for project 86941784237549838bba63ce88053b88. Resources: {'server_group_members'} {{(pid=121402) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 01 18:58:49.943685 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.quota [None req-439a2220-32b5-4c8a-bff3-fcc21e274f40 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Getting quotas for user 0290a6bb8bc24b8988a925327ac0381c and project 86941784237549838bba63ce88053b88. Resources: {'server_group_members'} {{(pid=121402) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 01 18:58:50.015739 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.quota [None req-439a2220-32b5-4c8a-bff3-fcc21e274f40 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Getting quotas for project 86941784237549838bba63ce88053b88. Resources: {'server_group_members'} {{(pid=121402) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 01 18:58:50.040318 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.quota [None req-439a2220-32b5-4c8a-bff3-fcc21e274f40 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Getting quotas for user 0290a6bb8bc24b8988a925327ac0381c and project 86941784237549838bba63ce88053b88. Resources: {'server_group_members'} {{(pid=121402) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 01 18:58:50.066719 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-439a2220-32b5-4c8a-bff3-fcc21e274f40 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] [instance: c04ee904-7b1a-4d73-b0c0-eb379c9aa683] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2d4a0047-1b9e-445f-8af8-1b5c9d93e881',instance=,instance_uuid=5e7ed73c-1243-4adf-94a2-09f7bf73f6fd,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121402) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 01 18:58:50.145304 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.quota [None req-439a2220-32b5-4c8a-bff3-fcc21e274f40 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Getting quotas for project 86941784237549838bba63ce88053b88. Resources: {'server_group_members'} {{(pid=121402) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 01 18:58:50.153209 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.quota [None req-439a2220-32b5-4c8a-bff3-fcc21e274f40 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Getting quotas for user 0290a6bb8bc24b8988a925327ac0381c and project 86941784237549838bba63ce88053b88. Resources: {'server_group_members'} {{(pid=121402) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 01 18:58:50.160313 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-5a08ff83-f95f-4ced-acf9-ab83b2e7e427 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72117f17294649d6b8bc16c66c7efab2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45d4c047d3c44324a27a27831236ab0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:58:50.166630 n-d-863052-2 devstack@n-api.service[121402]: DEBUG dbcounter [-] [121402] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=121402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 18:58:50.176062 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-5a08ff83-f95f-4ced-acf9-ab83b2e7e427 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] 10.222.0.13 "GET /compute/v2.1/servers/9249c81d-e57b-4985-a398-8ad97526d5c7" status: 200 len: 1543 microversion: 2.1 time: 0.408223 Nov 01 18:58:50.188608 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 637/1301] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:58:49 2022] GET /compute/v2.1/servers/9249c81d-e57b-4985-a398-8ad97526d5c7 => generated 1543 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 18:58:50.200975 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.quota [None req-439a2220-32b5-4c8a-bff3-fcc21e274f40 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Getting quotas for project 86941784237549838bba63ce88053b88. Resources: {'server_group_members'} {{(pid=121402) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 01 18:58:50.206584 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.quota [None req-439a2220-32b5-4c8a-bff3-fcc21e274f40 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Getting quotas for user 0290a6bb8bc24b8988a925327ac0381c and project 86941784237549838bba63ce88053b88. Resources: {'server_group_members'} {{(pid=121402) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 01 18:58:50.243413 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-439a2220-32b5-4c8a-bff3-fcc21e274f40 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 0.812994 Nov 01 18:58:50.244443 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 665/1302] 10.222.0.13 () {60 vars in 1147 bytes} [Tue Nov 1 18:58:49 2022] POST /compute/v2.1/servers => generated 32 bytes in 815 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Nov 01 18:58:50.252741 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-740caad8-0785-48b2-9cf7-eb42b4a1a466 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:58:50.257941 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-740caad8-0785-48b2-9cf7-eb42b4a1a466 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0290a6bb8bc24b8988a925327ac0381c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86941784237549838bba63ce88053b88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:58:50.258722 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-740caad8-0785-48b2-9cf7-eb42b4a1a466 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Searching by: {'deleted': False, 'project_id': '86941784237549838bba63ce88053b88'} {{(pid=121403) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 01 18:58:50.262675 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-e3391321-d4c3-46dc-a731-465ecdaaf91b tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:58:50.263501 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-e3391321-d4c3-46dc-a731-465ecdaaf91b tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] [instance: ed4798be-a45e-46f5-8f7e-1165f6479bd1] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:58:50.272084 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e3391321-d4c3-46dc-a731-465ecdaaf91b tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:50.272866 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e3391321-d4c3-46dc-a731-465ecdaaf91b tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:50.273494 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e3391321-d4c3-46dc-a731-465ecdaaf91b tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:50.274687 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e3391321-d4c3-46dc-a731-465ecdaaf91b tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:50.275311 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e3391321-d4c3-46dc-a731-465ecdaaf91b tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:50.275945 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e3391321-d4c3-46dc-a731-465ecdaaf91b tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:50.288453 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-740caad8-0785-48b2-9cf7-eb42b4a1a466 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:50.289687 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-740caad8-0785-48b2-9cf7-eb42b4a1a466 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:50.290312 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-740caad8-0785-48b2-9cf7-eb42b4a1a466 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:50.291227 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-740caad8-0785-48b2-9cf7-eb42b4a1a466 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:50.291842 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-740caad8-0785-48b2-9cf7-eb42b4a1a466 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:50.292413 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-740caad8-0785-48b2-9cf7-eb42b4a1a466 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:50.535691 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-e3391321-d4c3-46dc-a731-465ecdaaf91b tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a63d69c99a546f0af16329cff3ca717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a1bb191cff948e99c008b5e861ce4a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:58:50.549701 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-e3391321-d4c3-46dc-a731-465ecdaaf91b tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] 10.222.0.13 "GET /compute/v2.1/servers/ed4798be-a45e-46f5-8f7e-1165f6479bd1" status: 200 len: 1521 microversion: 2.1 time: 0.291336 Nov 01 18:58:50.569905 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 666/1303] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:58:50 2022] GET /compute/v2.1/servers/ed4798be-a45e-46f5-8f7e-1165f6479bd1 => generated 1521 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 18:58:50.575455 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.multi_cell_list [None req-740caad8-0785-48b2-9cf7-eb42b4a1a466 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Listed batch of 3 results from cell out of 998 limit. Returned 3 total so far. {{(pid=121403) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 01 18:58:50.591027 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-24465f46-edaa-44c1-8820-ec9ed84d9126 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:58:50.594998 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-24465f46-edaa-44c1-8820-ec9ed84d9126 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] [instance: ea631032-dd04-429b-988e-e6362ea42cf7] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:58:50.631513 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-24465f46-edaa-44c1-8820-ec9ed84d9126 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:50.631513 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-24465f46-edaa-44c1-8820-ec9ed84d9126 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:50.631513 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-24465f46-edaa-44c1-8820-ec9ed84d9126 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:50.631513 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-24465f46-edaa-44c1-8820-ec9ed84d9126 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:50.631989 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-24465f46-edaa-44c1-8820-ec9ed84d9126 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:50.634014 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-24465f46-edaa-44c1-8820-ec9ed84d9126 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:50.740069 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-24465f46-edaa-44c1-8820-ec9ed84d9126 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c1314c21d8547ff890ede1c2ad281c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c804370880454c7aa02cef2c2c3cf144', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:58:50.745102 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-740caad8-0785-48b2-9cf7-eb42b4a1a466 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] 10.222.0.13 "GET /compute/v2.1/servers" status: 200 len: 1664 microversion: 2.1 time: 0.496450 Nov 01 18:58:50.752351 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-24465f46-edaa-44c1-8820-ec9ed84d9126 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c1314c21d8547ff890ede1c2ad281c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c804370880454c7aa02cef2c2c3cf144', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:58:50.753294 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 638/1304] 10.222.0.13 () {58 vars in 1125 bytes} [Tue Nov 1 18:58:50 2022] GET /compute/v2.1/servers => generated 1664 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 18:58:50.754838 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-24465f46-edaa-44c1-8820-ec9ed84d9126 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c1314c21d8547ff890ede1c2ad281c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c804370880454c7aa02cef2c2c3cf144', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:58:50.759291 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-8d6b719c-adf3-4641-8730-10e1099c1eac tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:58:50.760275 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-8d6b719c-adf3-4641-8730-10e1099c1eac tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] [instance: 2d525a31-b0be-44cb-8fb7-335075145f08] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:58:50.768092 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-8d6b719c-adf3-4641-8730-10e1099c1eac tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:50.768711 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-8d6b719c-adf3-4641-8730-10e1099c1eac tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:50.769829 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-8d6b719c-adf3-4641-8730-10e1099c1eac tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:50.770355 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-24465f46-edaa-44c1-8820-ec9ed84d9126 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] 10.222.0.13 "GET /compute/v2.1/servers/ea631032-dd04-429b-988e-e6362ea42cf7" status: 200 len: 1531 microversion: 2.91 time: 0.195434 Nov 01 18:58:50.770897 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-8d6b719c-adf3-4641-8730-10e1099c1eac tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:50.771593 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 667/1305] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 18:58:50 2022] GET /compute/v2.1/servers/ea631032-dd04-429b-988e-e6362ea42cf7 => generated 1531 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 18:58:50.777223 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-8d6b719c-adf3-4641-8730-10e1099c1eac tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:50.777855 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-8d6b719c-adf3-4641-8730-10e1099c1eac tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:50.786784 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-b39d6514-e03d-4a49-8c4a-6efe4750a4d4 tempest-LiveAutoBlockMigrationV225Test-1358532044 tempest-LiveAutoBlockMigrationV225Test-1358532044-project-admin] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:58:50.788337 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-b39d6514-e03d-4a49-8c4a-6efe4750a4d4 tempest-LiveAutoBlockMigrationV225Test-1358532044 tempest-LiveAutoBlockMigrationV225Test-1358532044-project-admin] [instance: a7f88d19-08ee-47bf-9240-7d49afd775e2] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:58:50.798712 n-d-863052-2 devstack@n-api.service[121403]: DEBUG dbcounter [-] [121403] Writing DB stats nova_cell1:SELECT=100 {{(pid=121403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 18:58:50.803600 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b39d6514-e03d-4a49-8c4a-6efe4750a4d4 tempest-LiveAutoBlockMigrationV225Test-1358532044 tempest-LiveAutoBlockMigrationV225Test-1358532044-project-admin] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:50.804213 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b39d6514-e03d-4a49-8c4a-6efe4750a4d4 tempest-LiveAutoBlockMigrationV225Test-1358532044 tempest-LiveAutoBlockMigrationV225Test-1358532044-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:50.805152 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b39d6514-e03d-4a49-8c4a-6efe4750a4d4 tempest-LiveAutoBlockMigrationV225Test-1358532044 tempest-LiveAutoBlockMigrationV225Test-1358532044-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:50.805872 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b39d6514-e03d-4a49-8c4a-6efe4750a4d4 tempest-LiveAutoBlockMigrationV225Test-1358532044 tempest-LiveAutoBlockMigrationV225Test-1358532044-project-admin] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:50.806326 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b39d6514-e03d-4a49-8c4a-6efe4750a4d4 tempest-LiveAutoBlockMigrationV225Test-1358532044 tempest-LiveAutoBlockMigrationV225Test-1358532044-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:50.806757 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b39d6514-e03d-4a49-8c4a-6efe4750a4d4 tempest-LiveAutoBlockMigrationV225Test-1358532044 tempest-LiveAutoBlockMigrationV225Test-1358532044-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:51.100449 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-8d6b719c-adf3-4641-8730-10e1099c1eac tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f32f5fba1976432d938e664c7714e52b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b9d4c236b944f9b2e8e502a50a8f8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:58:51.119260 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-8d6b719c-adf3-4641-8730-10e1099c1eac tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] 10.222.0.13 "GET /compute/v2.1/servers/2d525a31-b0be-44cb-8fb7-335075145f08" status: 200 len: 1718 microversion: 2.1 time: 0.364743 Nov 01 18:58:51.120834 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 639/1306] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:58:50 2022] GET /compute/v2.1/servers/2d525a31-b0be-44cb-8fb7-335075145f08 => generated 1718 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:58:51.129763 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-86fe6719-b44b-4e9d-b527-6400ed70ab0b tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:58:51.131103 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-86fe6719-b44b-4e9d-b527-6400ed70ab0b tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] [instance: c04ee904-7b1a-4d73-b0c0-eb379c9aa683] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:58:51.198699 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-86fe6719-b44b-4e9d-b527-6400ed70ab0b tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0290a6bb8bc24b8988a925327ac0381c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86941784237549838bba63ce88053b88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:58:51.207262 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-86fe6719-b44b-4e9d-b527-6400ed70ab0b tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] 10.222.0.13 "GET /compute/v2.1/servers/c04ee904-7b1a-4d73-b0c0-eb379c9aa683" status: 200 len: 1218 microversion: 2.1 time: 0.085036 Nov 01 18:58:51.216901 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 640/1307] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:58:51 2022] GET /compute/v2.1/servers/c04ee904-7b1a-4d73-b0c0-eb379c9aa683 => generated 1218 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:58:51.216901 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-55f48b56-d588-4fc0-99d6-e20ac5320fd5 tempest-UnshelveToHostMultiNodesTest-2124505700 tempest-UnshelveToHostMultiNodesTest-2124505700-project-admin] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:58:51.216901 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-55f48b56-d588-4fc0-99d6-e20ac5320fd5 tempest-UnshelveToHostMultiNodesTest-2124505700 tempest-UnshelveToHostMultiNodesTest-2124505700-project-admin] [instance: ea631032-dd04-429b-988e-e6362ea42cf7] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:58:51.221957 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-55f48b56-d588-4fc0-99d6-e20ac5320fd5 tempest-UnshelveToHostMultiNodesTest-2124505700 tempest-UnshelveToHostMultiNodesTest-2124505700-project-admin] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:51.223341 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-55f48b56-d588-4fc0-99d6-e20ac5320fd5 tempest-UnshelveToHostMultiNodesTest-2124505700 tempest-UnshelveToHostMultiNodesTest-2124505700-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:51.224032 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-55f48b56-d588-4fc0-99d6-e20ac5320fd5 tempest-UnshelveToHostMultiNodesTest-2124505700 tempest-UnshelveToHostMultiNodesTest-2124505700-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:51.225052 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-55f48b56-d588-4fc0-99d6-e20ac5320fd5 tempest-UnshelveToHostMultiNodesTest-2124505700 tempest-UnshelveToHostMultiNodesTest-2124505700-project-admin] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:51.225573 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-55f48b56-d588-4fc0-99d6-e20ac5320fd5 tempest-UnshelveToHostMultiNodesTest-2124505700 tempest-UnshelveToHostMultiNodesTest-2124505700-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:51.226237 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-55f48b56-d588-4fc0-99d6-e20ac5320fd5 tempest-UnshelveToHostMultiNodesTest-2124505700 tempest-UnshelveToHostMultiNodesTest-2124505700-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:51.319707 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.objects.instance [None req-55f48b56-d588-4fc0-99d6-e20ac5320fd5 tempest-UnshelveToHostMultiNodesTest-2124505700 tempest-UnshelveToHostMultiNodesTest-2124505700-project-admin] Lazy-loading 'services' on Instance uuid ea631032-dd04-429b-988e-e6362ea42cf7 {{(pid=121403) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 01 18:58:51.341581 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-55f48b56-d588-4fc0-99d6-e20ac5320fd5 tempest-UnshelveToHostMultiNodesTest-2124505700 tempest-UnshelveToHostMultiNodesTest-2124505700-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/ea631032-dd04-429b-988e-e6362ea42cf7" status: 200 len: 1936 microversion: 2.91 time: 0.132309 Nov 01 18:58:51.342266 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 641/1308] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 18:58:51 2022] GET /compute/v2.1/servers/ea631032-dd04-429b-988e-e6362ea42cf7 => generated 1936 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 18:58:51.397117 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.objects.instance [None req-b39d6514-e03d-4a49-8c4a-6efe4750a4d4 tempest-LiveAutoBlockMigrationV225Test-1358532044 tempest-LiveAutoBlockMigrationV225Test-1358532044-project-admin] Lazy-loading 'services' on Instance uuid a7f88d19-08ee-47bf-9240-7d49afd775e2 {{(pid=121402) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 01 18:58:51.421137 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-b39d6514-e03d-4a49-8c4a-6efe4750a4d4 tempest-LiveAutoBlockMigrationV225Test-1358532044 tempest-LiveAutoBlockMigrationV225Test-1358532044-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/a7f88d19-08ee-47bf-9240-7d49afd775e2" status: 200 len: 2421 microversion: 2.25 time: 0.647420 Nov 01 18:58:51.432976 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 668/1309] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 18:58:50 2022] GET /compute/v2.1/servers/a7f88d19-08ee-47bf-9240-7d49afd775e2 => generated 2421 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 18:58:51.448565 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-26918da8-914e-4530-9dca-572d355c2374 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:58:51.450916 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-26918da8-914e-4530-9dca-572d355c2374 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] [instance: 9249c81d-e57b-4985-a398-8ad97526d5c7] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:58:51.458651 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-26918da8-914e-4530-9dca-572d355c2374 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:51.459487 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-26918da8-914e-4530-9dca-572d355c2374 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:51.460108 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-26918da8-914e-4530-9dca-572d355c2374 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:51.461598 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-26918da8-914e-4530-9dca-572d355c2374 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:51.462228 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-26918da8-914e-4530-9dca-572d355c2374 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:51.462813 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-26918da8-914e-4530-9dca-572d355c2374 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:51.605575 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-258e0330-f893-4ee9-b191-61c7595e69f9 tempest-ListImagesTestJSON-1481725397 tempest-ListImagesTestJSON-1481725397-project] Calling method '.version_select at 0x7f0ae66f1700>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:58:51.662772 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-258e0330-f893-4ee9-b191-61c7595e69f9 tempest-ListImagesTestJSON-1481725397 tempest-ListImagesTestJSON-1481725397-project] 10.222.0.13 "GET /compute/v2.1/images/2d4a0047-1b9e-445f-8af8-1b5c9d93e881" status: 200 len: 784 microversion: 2.1 time: 0.319355 Nov 01 18:58:51.663438 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 642/1310] 10.222.0.13 () {58 vars in 1233 bytes} [Tue Nov 1 18:58:51 2022] GET /compute/v2.1/images/2d4a0047-1b9e-445f-8af8-1b5c9d93e881 => generated 784 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 18:58:51.669011 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-ceaa2c11-9d1f-4723-8730-7f13ede1c8b6 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:58:51.669138 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-ceaa2c11-9d1f-4723-8730-7f13ede1c8b6 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] [instance: ea631032-dd04-429b-988e-e6362ea42cf7] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:58:51.677623 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-ceaa2c11-9d1f-4723-8730-7f13ede1c8b6 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:51.678560 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-ceaa2c11-9d1f-4723-8730-7f13ede1c8b6 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:51.678795 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-ceaa2c11-9d1f-4723-8730-7f13ede1c8b6 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:51.679571 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-ceaa2c11-9d1f-4723-8730-7f13ede1c8b6 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:51.680093 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-ceaa2c11-9d1f-4723-8730-7f13ede1c8b6 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:51.680592 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-ceaa2c11-9d1f-4723-8730-7f13ede1c8b6 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:51.714617 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-ceaa2c11-9d1f-4723-8730-7f13ede1c8b6 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] [instance: ea631032-dd04-429b-988e-e6362ea42cf7] Going to try to terminate instance {{(pid=121403) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 01 18:58:51.819283 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-ceaa2c11-9d1f-4723-8730-7f13ede1c8b6 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] 10.222.0.13 "DELETE /compute/v2.1/servers/ea631032-dd04-429b-988e-e6362ea42cf7" status: 204 len: 0 microversion: 2.91 time: 0.152266 Nov 01 18:58:51.820003 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 643/1311] 10.222.0.13 () {60 vars in 1280 bytes} [Tue Nov 1 18:58:51 2022] DELETE /compute/v2.1/servers/ea631032-dd04-429b-988e-e6362ea42cf7 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 01 18:58:51.827503 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-26918da8-914e-4530-9dca-572d355c2374 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72117f17294649d6b8bc16c66c7efab2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45d4c047d3c44324a27a27831236ab0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:58:51.832808 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-dcf1361c-53ec-486e-8f23-d8c53d96a939 tempest-LiveAutoBlockMigrationV225Test-1358532044 tempest-LiveAutoBlockMigrationV225Test-1358532044-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-863052-2", "block_migration": "auto"}} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 18:58:51.836737 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-dcf1361c-53ec-486e-8f23-d8c53d96a939 tempest-LiveAutoBlockMigrationV225Test-1358532044 tempest-LiveAutoBlockMigrationV225Test-1358532044-project-admin] [instance: a7f88d19-08ee-47bf-9240-7d49afd775e2] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:58:51.844347 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-26918da8-914e-4530-9dca-572d355c2374 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] 10.222.0.13 "GET /compute/v2.1/servers/9249c81d-e57b-4985-a398-8ad97526d5c7" status: 200 len: 1542 microversion: 2.1 time: 0.409558 Nov 01 18:58:51.845284 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 669/1312] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:58:51 2022] GET /compute/v2.1/servers/9249c81d-e57b-4985-a398-8ad97526d5c7 => generated 1542 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:58:51.849852 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-dcf1361c-53ec-486e-8f23-d8c53d96a939 tempest-LiveAutoBlockMigrationV225Test-1358532044 tempest-LiveAutoBlockMigrationV225Test-1358532044-project-admin] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:51.850394 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-dcf1361c-53ec-486e-8f23-d8c53d96a939 tempest-LiveAutoBlockMigrationV225Test-1358532044 tempest-LiveAutoBlockMigrationV225Test-1358532044-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:51.850999 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-dcf1361c-53ec-486e-8f23-d8c53d96a939 tempest-LiveAutoBlockMigrationV225Test-1358532044 tempest-LiveAutoBlockMigrationV225Test-1358532044-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:51.851762 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-dcf1361c-53ec-486e-8f23-d8c53d96a939 tempest-LiveAutoBlockMigrationV225Test-1358532044 tempest-LiveAutoBlockMigrationV225Test-1358532044-project-admin] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:51.852254 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-dcf1361c-53ec-486e-8f23-d8c53d96a939 tempest-LiveAutoBlockMigrationV225Test-1358532044 tempest-LiveAutoBlockMigrationV225Test-1358532044-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:51.852718 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-dcf1361c-53ec-486e-8f23-d8c53d96a939 tempest-LiveAutoBlockMigrationV225Test-1358532044 tempest-LiveAutoBlockMigrationV225Test-1358532044-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:51.870244 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-65c512b8-0fd6-414c-9fb8-2b2b0ca7ab86 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:58:51.870876 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-65c512b8-0fd6-414c-9fb8-2b2b0ca7ab86 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] [instance: ed4798be-a45e-46f5-8f7e-1165f6479bd1] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:58:51.878862 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-65c512b8-0fd6-414c-9fb8-2b2b0ca7ab86 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:51.882330 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.objects.instance [None req-dcf1361c-53ec-486e-8f23-d8c53d96a939 tempest-LiveAutoBlockMigrationV225Test-1358532044 tempest-LiveAutoBlockMigrationV225Test-1358532044-project-admin] Lazy-loading 'flavor' on Instance uuid a7f88d19-08ee-47bf-9240-7d49afd775e2 {{(pid=121403) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 01 18:58:51.883365 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-65c512b8-0fd6-414c-9fb8-2b2b0ca7ab86 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:51.886279 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-65c512b8-0fd6-414c-9fb8-2b2b0ca7ab86 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:51.887033 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-65c512b8-0fd6-414c-9fb8-2b2b0ca7ab86 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:51.887502 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-65c512b8-0fd6-414c-9fb8-2b2b0ca7ab86 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:51.887928 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-65c512b8-0fd6-414c-9fb8-2b2b0ca7ab86 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:51.898885 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-dcf1361c-53ec-486e-8f23-d8c53d96a939 tempest-LiveAutoBlockMigrationV225Test-1358532044 tempest-LiveAutoBlockMigrationV225Test-1358532044-project-admin] [instance: a7f88d19-08ee-47bf-9240-7d49afd775e2] Going to try to live migrate instance to n-h2-863052-2 {{(pid=121403) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Nov 01 18:58:52.313921 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-65c512b8-0fd6-414c-9fb8-2b2b0ca7ab86 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a63d69c99a546f0af16329cff3ca717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a1bb191cff948e99c008b5e861ce4a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:58:52.322500 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-65c512b8-0fd6-414c-9fb8-2b2b0ca7ab86 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] 10.222.0.13 "GET /compute/v2.1/servers/ed4798be-a45e-46f5-8f7e-1165f6479bd1" status: 200 len: 1521 microversion: 2.1 time: 0.472803 Nov 01 18:58:52.323214 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 670/1313] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:58:51 2022] GET /compute/v2.1/servers/ed4798be-a45e-46f5-8f7e-1165f6479bd1 => generated 1521 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:58:52.328743 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-a93b2aef-945c-46ab-b5e1-2f56159b74f3 tempest-ListImagesTestJSON-1481725397 tempest-ListImagesTestJSON-1481725397-project] Calling method '.version_select at 0x7f0ae26e6ca0>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:58:52.418793 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-a93b2aef-945c-46ab-b5e1-2f56159b74f3 tempest-ListImagesTestJSON-1481725397 tempest-ListImagesTestJSON-1481725397-project] 10.222.0.13 "GET /compute/v2.1/images" status: 200 len: 445 microversion: 2.1 time: 0.093909 Nov 01 18:58:52.419340 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 671/1314] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Nov 1 18:58:52 2022] GET /compute/v2.1/images => generated 445 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 18:58:52.425197 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-440f0d23-dcf9-4555-a63c-399d3f283337 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:58:52.426012 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-440f0d23-dcf9-4555-a63c-399d3f283337 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] [instance: ea631032-dd04-429b-988e-e6362ea42cf7] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:58:52.434017 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-440f0d23-dcf9-4555-a63c-399d3f283337 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:52.434637 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-440f0d23-dcf9-4555-a63c-399d3f283337 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:52.435030 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-440f0d23-dcf9-4555-a63c-399d3f283337 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:52.436061 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-440f0d23-dcf9-4555-a63c-399d3f283337 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:52.436539 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-440f0d23-dcf9-4555-a63c-399d3f283337 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:52.436968 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-440f0d23-dcf9-4555-a63c-399d3f283337 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:52.544013 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-440f0d23-dcf9-4555-a63c-399d3f283337 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c1314c21d8547ff890ede1c2ad281c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c804370880454c7aa02cef2c2c3cf144', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:58:52.554887 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-440f0d23-dcf9-4555-a63c-399d3f283337 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c1314c21d8547ff890ede1c2ad281c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c804370880454c7aa02cef2c2c3cf144', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:58:52.556722 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-440f0d23-dcf9-4555-a63c-399d3f283337 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c1314c21d8547ff890ede1c2ad281c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c804370880454c7aa02cef2c2c3cf144', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:58:52.565677 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-440f0d23-dcf9-4555-a63c-399d3f283337 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] 10.222.0.13 "GET /compute/v2.1/servers/ea631032-dd04-429b-988e-e6362ea42cf7" status: 200 len: 1537 microversion: 2.91 time: 0.144979 Nov 01 18:58:52.566282 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 672/1315] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 18:58:52 2022] GET /compute/v2.1/servers/ea631032-dd04-429b-988e-e6362ea42cf7 => generated 1537 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 18:58:52.571881 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-ec6be068-40f5-4f2e-a204-582f787b1c90 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:58:52.572887 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-ec6be068-40f5-4f2e-a204-582f787b1c90 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] [instance: 2d525a31-b0be-44cb-8fb7-335075145f08] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:58:52.579876 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-ec6be068-40f5-4f2e-a204-582f787b1c90 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:52.580369 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-ec6be068-40f5-4f2e-a204-582f787b1c90 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:52.580836 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-ec6be068-40f5-4f2e-a204-582f787b1c90 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:52.582005 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-ec6be068-40f5-4f2e-a204-582f787b1c90 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:52.582464 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-ec6be068-40f5-4f2e-a204-582f787b1c90 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:52.583051 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-ec6be068-40f5-4f2e-a204-582f787b1c90 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:52.801926 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-ec6be068-40f5-4f2e-a204-582f787b1c90 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f32f5fba1976432d938e664c7714e52b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b9d4c236b944f9b2e8e502a50a8f8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:58:52.810855 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-ec6be068-40f5-4f2e-a204-582f787b1c90 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] 10.222.0.13 "GET /compute/v2.1/servers/2d525a31-b0be-44cb-8fb7-335075145f08" status: 200 len: 1718 microversion: 2.1 time: 0.243507 Nov 01 18:58:52.811437 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 673/1316] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:58:52 2022] GET /compute/v2.1/servers/2d525a31-b0be-44cb-8fb7-335075145f08 => generated 1718 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:58:52.825596 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-64c05b8e-96a3-48cc-ac66-83193eeebe80 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:58:52.826497 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-64c05b8e-96a3-48cc-ac66-83193eeebe80 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] [instance: c04ee904-7b1a-4d73-b0c0-eb379c9aa683] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:58:52.833230 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-64c05b8e-96a3-48cc-ac66-83193eeebe80 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:52.834445 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-64c05b8e-96a3-48cc-ac66-83193eeebe80 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:52.835102 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-64c05b8e-96a3-48cc-ac66-83193eeebe80 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:52.836018 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-64c05b8e-96a3-48cc-ac66-83193eeebe80 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:52.836697 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-64c05b8e-96a3-48cc-ac66-83193eeebe80 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:52.837313 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-64c05b8e-96a3-48cc-ac66-83193eeebe80 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:52.955713 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-64c05b8e-96a3-48cc-ac66-83193eeebe80 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0290a6bb8bc24b8988a925327ac0381c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86941784237549838bba63ce88053b88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:58:52.959675 n-d-863052-2 devstack@n-api.service[121402]: DEBUG dbcounter [-] [121402] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 18:58:52.965213 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-64c05b8e-96a3-48cc-ac66-83193eeebe80 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] 10.222.0.13 "GET /compute/v2.1/servers/c04ee904-7b1a-4d73-b0c0-eb379c9aa683" status: 200 len: 1278 microversion: 2.1 time: 0.143205 Nov 01 18:58:52.965804 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 674/1317] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:58:52 2022] GET /compute/v2.1/servers/c04ee904-7b1a-4d73-b0c0-eb379c9aa683 => generated 1278 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:58:52.971717 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [req-f92717ac-41b8-4518-a9a6-4800795dbec4 req-f8bef836-0f5d-429a-8b09-b62ac9badef7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9249c81d-e57b-4985-a398-8ad97526d5c7", "name": "network-vif-unplugged", "status": "completed", "tag": "b471dd14-4ce9-4781-a7a0-1bd2ae3a7e55"}]} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 18:58:52.986873 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-f92717ac-41b8-4518-a9a6-4800795dbec4 req-f8bef836-0f5d-429a-8b09-b62ac9badef7 service nova] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:52.987548 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-f92717ac-41b8-4518-a9a6-4800795dbec4 req-f8bef836-0f5d-429a-8b09-b62ac9badef7 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:52.988053 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-f92717ac-41b8-4518-a9a6-4800795dbec4 req-f8bef836-0f5d-429a-8b09-b62ac9badef7 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:53.002021 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.compute.server_external_events [req-f92717ac-41b8-4518-a9a6-4800795dbec4 req-f8bef836-0f5d-429a-8b09-b62ac9badef7 service nova] Creating event network-vif-unplugged:b471dd14-4ce9-4781-a7a0-1bd2ae3a7e55 for instance 9249c81d-e57b-4985-a398-8ad97526d5c7 on n-h1-863052-2 Nov 01 18:58:53.007895 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [req-f92717ac-41b8-4518-a9a6-4800795dbec4 req-f8bef836-0f5d-429a-8b09-b62ac9badef7 service nova] Instance 9249c81d-e57b-4985-a398-8ad97526d5c7 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-863052-2', 'n-h2-863052-2'} {{(pid=121402) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Nov 01 18:58:53.021728 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [req-f92717ac-41b8-4518-a9a6-4800795dbec4 req-f8bef836-0f5d-429a-8b09-b62ac9badef7 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.054405 Nov 01 18:58:53.022434 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 675/1318] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Nov 1 18:58:52 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 18:58:53.028842 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-9396fde8-86b0-4f2d-9482-ed60c68461c4 tempest-ListImagesTestJSON-1481725397 tempest-ListImagesTestJSON-1481725397-project] Calling method '.version_select at 0x7f0ae2db3d30>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:58:53.083383 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-9396fde8-86b0-4f2d-9482-ed60c68461c4 tempest-ListImagesTestJSON-1481725397 tempest-ListImagesTestJSON-1481725397-project] 10.222.0.13 "GET /compute/v2.1/images/detail" status: 200 len: 787 microversion: 2.1 time: 0.059429 Nov 01 18:58:53.084316 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 676/1319] 10.222.0.13 () {58 vars in 1143 bytes} [Tue Nov 1 18:58:53 2022] GET /compute/v2.1/images/detail => generated 787 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 18:58:53.090027 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-6b974202-b071-4f6d-a368-6dc9c60b5ab8 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:58:53.091052 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-6b974202-b071-4f6d-a368-6dc9c60b5ab8 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] [instance: 9249c81d-e57b-4985-a398-8ad97526d5c7] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:58:53.099326 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-6b974202-b071-4f6d-a368-6dc9c60b5ab8 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:53.099894 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-6b974202-b071-4f6d-a368-6dc9c60b5ab8 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:53.100412 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-6b974202-b071-4f6d-a368-6dc9c60b5ab8 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:53.101230 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-6b974202-b071-4f6d-a368-6dc9c60b5ab8 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:53.101763 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-6b974202-b071-4f6d-a368-6dc9c60b5ab8 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:53.102501 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-6b974202-b071-4f6d-a368-6dc9c60b5ab8 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:53.489935 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-6b974202-b071-4f6d-a368-6dc9c60b5ab8 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72117f17294649d6b8bc16c66c7efab2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45d4c047d3c44324a27a27831236ab0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:58:53.503196 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-6b974202-b071-4f6d-a368-6dc9c60b5ab8 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] 10.222.0.13 "GET /compute/v2.1/servers/9249c81d-e57b-4985-a398-8ad97526d5c7" status: 200 len: 1542 microversion: 2.1 time: 0.415304 Nov 01 18:58:53.510699 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 677/1320] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:58:53 2022] GET /compute/v2.1/servers/9249c81d-e57b-4985-a398-8ad97526d5c7 => generated 1542 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:58:53.531717 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-100e63e8-ffae-4303-8665-f6de578c8766 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:58:53.532265 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-100e63e8-ffae-4303-8665-f6de578c8766 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] [instance: ed4798be-a45e-46f5-8f7e-1165f6479bd1] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:58:53.558100 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-100e63e8-ffae-4303-8665-f6de578c8766 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:53.558526 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-100e63e8-ffae-4303-8665-f6de578c8766 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:53.561564 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-100e63e8-ffae-4303-8665-f6de578c8766 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:53.567222 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-100e63e8-ffae-4303-8665-f6de578c8766 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:53.567941 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-100e63e8-ffae-4303-8665-f6de578c8766 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:53.569839 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-100e63e8-ffae-4303-8665-f6de578c8766 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:54.056109 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-100e63e8-ffae-4303-8665-f6de578c8766 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a63d69c99a546f0af16329cff3ca717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a1bb191cff948e99c008b5e861ce4a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:58:54.071266 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-100e63e8-ffae-4303-8665-f6de578c8766 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] 10.222.0.13 "GET /compute/v2.1/servers/ed4798be-a45e-46f5-8f7e-1165f6479bd1" status: 200 len: 1521 microversion: 2.1 time: 0.557126 Nov 01 18:58:54.081859 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 678/1321] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:58:53 2022] GET /compute/v2.1/servers/ed4798be-a45e-46f5-8f7e-1165f6479bd1 => generated 1521 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:58:54.087946 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-b58ae040-bcb8-4de7-8a4c-3e90aa9bb9a4 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:58:54.089079 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-b58ae040-bcb8-4de7-8a4c-3e90aa9bb9a4 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] [instance: ea631032-dd04-429b-988e-e6362ea42cf7] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:58:54.097019 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b58ae040-bcb8-4de7-8a4c-3e90aa9bb9a4 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:54.098546 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b58ae040-bcb8-4de7-8a4c-3e90aa9bb9a4 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:54.099815 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b58ae040-bcb8-4de7-8a4c-3e90aa9bb9a4 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:54.100538 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b58ae040-bcb8-4de7-8a4c-3e90aa9bb9a4 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:54.101026 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b58ae040-bcb8-4de7-8a4c-3e90aa9bb9a4 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:54.101653 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b58ae040-bcb8-4de7-8a4c-3e90aa9bb9a4 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:54.307257 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-b58ae040-bcb8-4de7-8a4c-3e90aa9bb9a4 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c1314c21d8547ff890ede1c2ad281c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c804370880454c7aa02cef2c2c3cf144', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:58:54.334088 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-b58ae040-bcb8-4de7-8a4c-3e90aa9bb9a4 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c1314c21d8547ff890ede1c2ad281c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c804370880454c7aa02cef2c2c3cf144', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:58:54.341518 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-b58ae040-bcb8-4de7-8a4c-3e90aa9bb9a4 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c1314c21d8547ff890ede1c2ad281c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c804370880454c7aa02cef2c2c3cf144', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:58:54.367938 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-b58ae040-bcb8-4de7-8a4c-3e90aa9bb9a4 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] 10.222.0.13 "GET /compute/v2.1/servers/ea631032-dd04-429b-988e-e6362ea42cf7" status: 200 len: 1537 microversion: 2.91 time: 0.284603 Nov 01 18:58:54.370702 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 679/1322] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 18:58:54 2022] GET /compute/v2.1/servers/ea631032-dd04-429b-988e-e6362ea42cf7 => generated 1537 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 18:58:54.394366 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-36ef86e5-ab84-46f9-a886-2c913d78e661 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:58:54.398013 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-36ef86e5-ab84-46f9-a886-2c913d78e661 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] [instance: 2d525a31-b0be-44cb-8fb7-335075145f08] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:58:54.412112 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-36ef86e5-ab84-46f9-a886-2c913d78e661 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:54.413242 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-36ef86e5-ab84-46f9-a886-2c913d78e661 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:54.420543 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-36ef86e5-ab84-46f9-a886-2c913d78e661 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:54.424155 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-36ef86e5-ab84-46f9-a886-2c913d78e661 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:54.425878 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-36ef86e5-ab84-46f9-a886-2c913d78e661 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:54.427550 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-36ef86e5-ab84-46f9-a886-2c913d78e661 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:54.682338 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-36ef86e5-ab84-46f9-a886-2c913d78e661 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f32f5fba1976432d938e664c7714e52b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b9d4c236b944f9b2e8e502a50a8f8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:58:54.694430 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-36ef86e5-ab84-46f9-a886-2c913d78e661 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] 10.222.0.13 "GET /compute/v2.1/servers/2d525a31-b0be-44cb-8fb7-335075145f08" status: 200 len: 1718 microversion: 2.1 time: 0.321552 Nov 01 18:58:54.695405 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 680/1323] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:58:54 2022] GET /compute/v2.1/servers/2d525a31-b0be-44cb-8fb7-335075145f08 => generated 1718 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:58:54.709142 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-68161ca8-a518-4a15-ae5d-0640bdd554be tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:58:54.709955 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-68161ca8-a518-4a15-ae5d-0640bdd554be tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] [instance: c04ee904-7b1a-4d73-b0c0-eb379c9aa683] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:58:54.722049 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-68161ca8-a518-4a15-ae5d-0640bdd554be tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:54.724018 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-68161ca8-a518-4a15-ae5d-0640bdd554be tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:54.724817 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-68161ca8-a518-4a15-ae5d-0640bdd554be tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:54.726595 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-68161ca8-a518-4a15-ae5d-0640bdd554be tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:54.727222 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-68161ca8-a518-4a15-ae5d-0640bdd554be tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:54.727842 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-68161ca8-a518-4a15-ae5d-0640bdd554be tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:54.888288 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-68161ca8-a518-4a15-ae5d-0640bdd554be tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0290a6bb8bc24b8988a925327ac0381c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86941784237549838bba63ce88053b88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:58:54.897561 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-68161ca8-a518-4a15-ae5d-0640bdd554be tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] 10.222.0.13 "GET /compute/v2.1/servers/c04ee904-7b1a-4d73-b0c0-eb379c9aa683" status: 200 len: 1318 microversion: 2.1 time: 0.200951 Nov 01 18:58:54.898323 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 681/1324] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:58:54 2022] GET /compute/v2.1/servers/c04ee904-7b1a-4d73-b0c0-eb379c9aa683 => generated 1318 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:58:54.903152 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-2d376e44-aa58-413c-83d5-85a96c220159 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:58:54.903769 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-2d376e44-aa58-413c-83d5-85a96c220159 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] [instance: 9249c81d-e57b-4985-a398-8ad97526d5c7] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:58:54.911112 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2d376e44-aa58-413c-83d5-85a96c220159 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:54.911884 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2d376e44-aa58-413c-83d5-85a96c220159 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:54.912328 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2d376e44-aa58-413c-83d5-85a96c220159 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:54.913081 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2d376e44-aa58-413c-83d5-85a96c220159 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:54.913542 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2d376e44-aa58-413c-83d5-85a96c220159 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:54.913970 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2d376e44-aa58-413c-83d5-85a96c220159 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:55.053673 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-2d376e44-aa58-413c-83d5-85a96c220159 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72117f17294649d6b8bc16c66c7efab2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45d4c047d3c44324a27a27831236ab0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:58:55.061999 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-2d376e44-aa58-413c-83d5-85a96c220159 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] 10.222.0.13 "GET /compute/v2.1/servers/9249c81d-e57b-4985-a398-8ad97526d5c7" status: 200 len: 1474 microversion: 2.1 time: 0.162828 Nov 01 18:58:55.063106 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 682/1325] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:58:54 2022] GET /compute/v2.1/servers/9249c81d-e57b-4985-a398-8ad97526d5c7 => generated 1474 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:58:55.240438 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-39ea5cca-c20e-4d6d-8918-9914c6ad99d2 tempest-ListImageFiltersNegativeTestJSON-1253714527 tempest-ListImageFiltersNegativeTestJSON-1253714527-project] Calling method '.version_select at 0x7f0ae2e024c0>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:58:55.260872 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.wsgi [None req-39ea5cca-c20e-4d6d-8918-9914c6ad99d2 tempest-ListImageFiltersNegativeTestJSON-1253714527 tempest-ListImageFiltersNegativeTestJSON-1253714527-project] HTTP exception thrown: Image not found. Nov 01 18:58:55.262978 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-39ea5cca-c20e-4d6d-8918-9914c6ad99d2 tempest-ListImageFiltersNegativeTestJSON-1253714527 tempest-ListImageFiltersNegativeTestJSON-1253714527-project] Request method failure captured: Nov 01 18:58:55.262978 n-d-863052-2 devstack@n-api.service[121402]: request: GET /compute/v2.1/images/451b301c-a643-472f-9b64-e168ec90664b HTTP/1.1 Nov 01 18:58:55.262978 n-d-863052-2 devstack@n-api.service[121402]: Accept: application/json Nov 01 18:58:55.262978 n-d-863052-2 devstack@n-api.service[121402]: Accept-Encoding: identity Nov 01 18:58:55.262978 n-d-863052-2 devstack@n-api.service[121402]: Connection: close Nov 01 18:58:55.262978 n-d-863052-2 devstack@n-api.service[121402]: Content-Length: 0 Nov 01 18:58:55.262978 n-d-863052-2 devstack@n-api.service[121402]: Content-Type: application/json Nov 01 18:58:55.262978 n-d-863052-2 devstack@n-api.service[121402]: Host: 10.222.0.13 Nov 01 18:58:55.262978 n-d-863052-2 devstack@n-api.service[121402]: Openstack-System-Scope: None Nov 01 18:58:55.262978 n-d-863052-2 devstack@n-api.service[121402]: User-Agent: python-urllib3/1.26.12 Nov 01 18:58:55.262978 n-d-863052-2 devstack@n-api.service[121402]: X-Auth-Token: gAAAAABjYWxun7MWMOQ2em3rkK2mRXj_I8v2CA1lctWq61VK4CTks9FyVIJwCRL1s0V21yF_zWtbt7-CzgCp3-2q94-tY2ajfaF2z3xOssaWIhpp_bOdcqkNOAQ3CzLf2y4ZIqlcm0j05ub1HDZLZod6DTn1xxv97yrazqLYA4szdfA2KG4TZxk Nov 01 18:58:55.262978 n-d-863052-2 devstack@n-api.service[121402]: X-Domain-Id: None Nov 01 18:58:55.262978 n-d-863052-2 devstack@n-api.service[121402]: X-Domain-Name: None Nov 01 18:58:55.262978 n-d-863052-2 devstack@n-api.service[121402]: X-Identity-Status: Confirmed Nov 01 18:58:55.262978 n-d-863052-2 devstack@n-api.service[121402]: X-Is-Admin-Project: True Nov 01 18:58:55.262978 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Domain-Id: default Nov 01 18:58:55.262978 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Domain-Name: Default Nov 01 18:58:55.262978 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Id: c6f72042b922498782419ede48981bf7 Nov 01 18:58:55.262978 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Name: tempest-ListImageFiltersNegativeTestJSON-1253714527 Nov 01 18:58:55.262978 n-d-863052-2 devstack@n-api.service[121402]: X-Role: member,reader Nov 01 18:58:55.262978 n-d-863052-2 devstack@n-api.service[121402]: X-Roles: member,reader Nov 01 18:58:55.264425 n-d-863052-2 devstack@n-api.service[121402]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/c6f72042b922498782419ede48981bf7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/c6f72042b922498782419ede48981bf7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_c6f72042b922498782419ede48981bf7", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/c6f72042b922498782419ede48981bf7"}]}] Nov 01 18:58:55.264425 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant: tempest-ListImageFiltersNegativeTestJSON-1253714527 Nov 01 18:58:55.264425 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant-Id: c6f72042b922498782419ede48981bf7 Nov 01 18:58:55.264425 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant-Name: tempest-ListImageFiltersNegativeTestJSON-1253714527 Nov 01 18:58:55.264425 n-d-863052-2 devstack@n-api.service[121402]: X-User: tempest-ListImageFiltersNegativeTestJSON-1253714527-project Nov 01 18:58:55.264425 n-d-863052-2 devstack@n-api.service[121402]: X-User-Domain-Id: default Nov 01 18:58:55.264425 n-d-863052-2 devstack@n-api.service[121402]: X-User-Domain-Name: Default Nov 01 18:58:55.264425 n-d-863052-2 devstack@n-api.service[121402]: X-User-Id: f3cab6ade58f4ed4b94fa98cf83e2ac8 Nov 01 18:58:55.264425 n-d-863052-2 devstack@n-api.service[121402]: X-User-Name: tempest-ListImageFiltersNegativeTestJSON-1253714527-project Nov 01 18:58:55.264425 n-d-863052-2 devstack@n-api.service[121402]: method: Nov 01 18:58:55.264425 n-d-863052-2 devstack@n-api.service[121402]: exception: Image not found. Nov 01 18:58:55.264425 n-d-863052-2 devstack@n-api.service[121402]: action_args: {'id': '451b301c-a643-472f-9b64-e168ec90664b'} Nov 01 18:58:55.264425 n-d-863052-2 devstack@n-api.service[121402]: {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 01 18:58:55.266012 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:58:55.266012 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Nov 01 18:58:55.266012 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Nov 01 18:58:55.266012 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Nov 01 18:58:55.266012 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Nov 01 18:58:55.266012 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Nov 01 18:58:55.266012 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return self._get(image_id) Nov 01 18:58:55.266012 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Nov 01 18:58:55.266012 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Nov 01 18:58:55.266012 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Nov 01 18:58:55.266012 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Nov 01 18:58:55.266012 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Nov 01 18:58:55.266012 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Nov 01 18:58:55.266012 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Nov 01 18:58:55.266012 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Nov 01 18:58:55.266012 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Nov 01 18:58:55.266012 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Nov 01 18:58:55.266012 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 451b301c-a643-472f-9b64-e168ec90664b Nov 01 18:58:55.267133 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 18:58:55.267133 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 18:58:55.267133 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 18:58:55.267133 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:58:55.267133 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Nov 01 18:58:55.267133 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Nov 01 18:58:55.267133 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Nov 01 18:58:55.267133 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Nov 01 18:58:55.267133 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Nov 01 18:58:55.267133 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Nov 01 18:58:55.267133 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Nov 01 18:58:55.267133 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Nov 01 18:58:55.267133 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Nov 01 18:58:55.267133 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Nov 01 18:58:55.267133 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Nov 01 18:58:55.267133 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Nov 01 18:58:55.267133 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Nov 01 18:58:55.267133 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return self._get(image_id) Nov 01 18:58:55.267133 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Nov 01 18:58:55.267133 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Nov 01 18:58:55.268388 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Nov 01 18:58:55.268388 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Nov 01 18:58:55.268388 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Nov 01 18:58:55.268388 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Nov 01 18:58:55.268388 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Nov 01 18:58:55.268388 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Nov 01 18:58:55.268388 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Nov 01 18:58:55.268388 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Nov 01 18:58:55.268388 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 451b301c-a643-472f-9b64-e168ec90664b could not be found. Nov 01 18:58:55.268388 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 18:58:55.268388 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 18:58:55.268388 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 18:58:55.268388 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:58:55.268388 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 18:58:55.268388 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 18:58:55.268388 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 01 18:58:55.268388 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 01 18:58:55.268388 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 01 18:58:55.268388 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 01 18:58:55.269593 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 01 18:58:55.269593 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 01 18:58:55.269593 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Nov 01 18:58:55.269593 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Nov 01 18:58:55.269593 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Nov 01 18:58:55.269593 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 18:58:55.269593 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 18:58:55.269593 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 18:58:55.269593 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:58:55.269593 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 18:58:55.269593 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 18:58:55.269593 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 01 18:58:55.269593 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 01 18:58:55.269593 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Nov 01 18:58:55.269593 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 18:58:55.269593 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-39ea5cca-c20e-4d6d-8918-9914c6ad99d2 tempest-ListImageFiltersNegativeTestJSON-1253714527 tempest-ListImageFiltersNegativeTestJSON-1253714527-project] Returning 404 to user: Image not found. {{(pid=121402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 01 18:58:55.270663 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-39ea5cca-c20e-4d6d-8918-9914c6ad99d2 tempest-ListImageFiltersNegativeTestJSON-1253714527 tempest-ListImageFiltersNegativeTestJSON-1253714527-project] 10.222.0.13 "GET /compute/v2.1/images/451b301c-a643-472f-9b64-e168ec90664b" status: 404 len: 62 microversion: 2.1 time: 0.200389 Nov 01 18:58:55.270663 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 683/1326] 10.222.0.13 () {58 vars in 1233 bytes} [Tue Nov 1 18:58:55 2022] GET /compute/v2.1/images/451b301c-a643-472f-9b64-e168ec90664b => generated 62 bytes in 203 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 01 18:58:55.270818 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [req-a7838c10-0e7e-49f5-8905-08c58c55a76d req-f478e022-dede-48c4-8c4d-8dac410a82e5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9249c81d-e57b-4985-a398-8ad97526d5c7", "tag": "b471dd14-4ce9-4781-a7a0-1bd2ae3a7e55"}]} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 18:58:55.282047 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-a7838c10-0e7e-49f5-8905-08c58c55a76d req-f478e022-dede-48c4-8c4d-8dac410a82e5 service nova] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:55.282532 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-a7838c10-0e7e-49f5-8905-08c58c55a76d req-f478e022-dede-48c4-8c4d-8dac410a82e5 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:55.282970 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-a7838c10-0e7e-49f5-8905-08c58c55a76d req-f478e022-dede-48c4-8c4d-8dac410a82e5 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:55.293939 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.compute.server_external_events [req-a7838c10-0e7e-49f5-8905-08c58c55a76d req-f478e022-dede-48c4-8c4d-8dac410a82e5 service nova] Creating event network-changed:b471dd14-4ce9-4781-a7a0-1bd2ae3a7e55 for instance 9249c81d-e57b-4985-a398-8ad97526d5c7 on n-h1-863052-2 Nov 01 18:58:55.299636 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [req-a7838c10-0e7e-49f5-8905-08c58c55a76d req-f478e022-dede-48c4-8c4d-8dac410a82e5 service nova] Instance 9249c81d-e57b-4985-a398-8ad97526d5c7 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-863052-2', 'n-h2-863052-2'} {{(pid=121402) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Nov 01 18:58:55.312930 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [req-a7838c10-0e7e-49f5-8905-08c58c55a76d req-f478e022-dede-48c4-8c4d-8dac410a82e5 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044747 Nov 01 18:58:55.313781 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 684/1327] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Nov 1 18:58:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 18:58:55.321769 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-8b4820c3-2a34-43b2-9054-57125940d66b tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:58:55.322675 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-8b4820c3-2a34-43b2-9054-57125940d66b tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] [instance: ed4798be-a45e-46f5-8f7e-1165f6479bd1] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:58:55.330471 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-8b4820c3-2a34-43b2-9054-57125940d66b tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:55.331208 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-8b4820c3-2a34-43b2-9054-57125940d66b tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:55.331815 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-8b4820c3-2a34-43b2-9054-57125940d66b tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:55.332735 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-8b4820c3-2a34-43b2-9054-57125940d66b tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:55.333517 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-8b4820c3-2a34-43b2-9054-57125940d66b tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:55.334283 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-8b4820c3-2a34-43b2-9054-57125940d66b tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:55.518878 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-8b4820c3-2a34-43b2-9054-57125940d66b tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a63d69c99a546f0af16329cff3ca717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a1bb191cff948e99c008b5e861ce4a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:58:55.526959 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-8b4820c3-2a34-43b2-9054-57125940d66b tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] 10.222.0.13 "GET /compute/v2.1/servers/ed4798be-a45e-46f5-8f7e-1165f6479bd1" status: 200 len: 1521 microversion: 2.1 time: 0.211897 Nov 01 18:58:55.527887 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 685/1328] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:58:55 2022] GET /compute/v2.1/servers/ed4798be-a45e-46f5-8f7e-1165f6479bd1 => generated 1521 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:58:55.532701 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-63b4cc86-38fc-4e8c-9bdd-c2aaaf098e42 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:58:55.533540 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-63b4cc86-38fc-4e8c-9bdd-c2aaaf098e42 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] [instance: ea631032-dd04-429b-988e-e6362ea42cf7] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:58:55.539313 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-63b4cc86-38fc-4e8c-9bdd-c2aaaf098e42 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:55.539828 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-63b4cc86-38fc-4e8c-9bdd-c2aaaf098e42 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:55.540263 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-63b4cc86-38fc-4e8c-9bdd-c2aaaf098e42 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:55.540972 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-63b4cc86-38fc-4e8c-9bdd-c2aaaf098e42 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:55.541429 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-63b4cc86-38fc-4e8c-9bdd-c2aaaf098e42 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:55.541852 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-63b4cc86-38fc-4e8c-9bdd-c2aaaf098e42 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:55.575660 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-63b4cc86-38fc-4e8c-9bdd-c2aaaf098e42 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:55.576140 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-63b4cc86-38fc-4e8c-9bdd-c2aaaf098e42 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:55.576572 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-63b4cc86-38fc-4e8c-9bdd-c2aaaf098e42 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:55.577051 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.objects.instance [None req-63b4cc86-38fc-4e8c-9bdd-c2aaaf098e42 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lazy-loading 'fault' on Instance uuid ea631032-dd04-429b-988e-e6362ea42cf7 {{(pid=121402) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 01 18:58:55.647461 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-63b4cc86-38fc-4e8c-9bdd-c2aaaf098e42 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c1314c21d8547ff890ede1c2ad281c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c804370880454c7aa02cef2c2c3cf144', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:58:55.659040 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-63b4cc86-38fc-4e8c-9bdd-c2aaaf098e42 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c1314c21d8547ff890ede1c2ad281c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c804370880454c7aa02cef2c2c3cf144', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:58:55.660489 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-63b4cc86-38fc-4e8c-9bdd-c2aaaf098e42 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c1314c21d8547ff890ede1c2ad281c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c804370880454c7aa02cef2c2c3cf144', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:58:55.671983 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-63b4cc86-38fc-4e8c-9bdd-c2aaaf098e42 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] 10.222.0.13 "GET /compute/v2.1/servers/ea631032-dd04-429b-988e-e6362ea42cf7" status: 200 len: 1542 microversion: 2.91 time: 0.142500 Nov 01 18:58:55.673415 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 686/1329] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 18:58:55 2022] GET /compute/v2.1/servers/ea631032-dd04-429b-988e-e6362ea42cf7 => generated 1542 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 18:58:55.962773 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-83f5f643-b068-436e-b9c6-9db79924dc64 tempest-AbsoluteLimitsTestJSON-1573348915 tempest-AbsoluteLimitsTestJSON-1573348915-project] Calling method '.version_select at 0x7f0ae2e02790>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:58:55.982980 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-83f5f643-b068-436e-b9c6-9db79924dc64 tempest-AbsoluteLimitsTestJSON-1573348915 tempest-AbsoluteLimitsTestJSON-1573348915-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:55.985014 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-83f5f643-b068-436e-b9c6-9db79924dc64 tempest-AbsoluteLimitsTestJSON-1573348915 tempest-AbsoluteLimitsTestJSON-1573348915-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:55.986211 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-83f5f643-b068-436e-b9c6-9db79924dc64 tempest-AbsoluteLimitsTestJSON-1573348915 tempest-AbsoluteLimitsTestJSON-1573348915-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:55.988297 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-83f5f643-b068-436e-b9c6-9db79924dc64 tempest-AbsoluteLimitsTestJSON-1573348915 tempest-AbsoluteLimitsTestJSON-1573348915-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:55.989213 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-83f5f643-b068-436e-b9c6-9db79924dc64 tempest-AbsoluteLimitsTestJSON-1573348915 tempest-AbsoluteLimitsTestJSON-1573348915-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:55.990205 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-83f5f643-b068-436e-b9c6-9db79924dc64 tempest-AbsoluteLimitsTestJSON-1573348915 tempest-AbsoluteLimitsTestJSON-1573348915-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:56.025539 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-83f5f643-b068-436e-b9c6-9db79924dc64 tempest-AbsoluteLimitsTestJSON-1573348915 tempest-AbsoluteLimitsTestJSON-1573348915-project] 10.222.0.13 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 0.350332 Nov 01 18:58:56.037317 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 687/1330] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Nov 1 18:58:55 2022] GET /compute/v2.1/limits => generated 511 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 18:58:56.044940 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-18380dc5-2fd7-4dc4-ad42-be4edc7c6ab1 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:58:56.045917 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-18380dc5-2fd7-4dc4-ad42-be4edc7c6ab1 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] [instance: 2d525a31-b0be-44cb-8fb7-335075145f08] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:58:56.059856 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-18380dc5-2fd7-4dc4-ad42-be4edc7c6ab1 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:56.062589 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-18380dc5-2fd7-4dc4-ad42-be4edc7c6ab1 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:56.065510 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-18380dc5-2fd7-4dc4-ad42-be4edc7c6ab1 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:56.067285 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-18380dc5-2fd7-4dc4-ad42-be4edc7c6ab1 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:56.070189 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-18380dc5-2fd7-4dc4-ad42-be4edc7c6ab1 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:56.070841 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-18380dc5-2fd7-4dc4-ad42-be4edc7c6ab1 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:56.749885 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-18380dc5-2fd7-4dc4-ad42-be4edc7c6ab1 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f32f5fba1976432d938e664c7714e52b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b9d4c236b944f9b2e8e502a50a8f8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:58:56.759111 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-18380dc5-2fd7-4dc4-ad42-be4edc7c6ab1 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] 10.222.0.13 "GET /compute/v2.1/servers/2d525a31-b0be-44cb-8fb7-335075145f08" status: 200 len: 1718 microversion: 2.1 time: 0.720159 Nov 01 18:58:56.768620 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 688/1331] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:58:56 2022] GET /compute/v2.1/servers/2d525a31-b0be-44cb-8fb7-335075145f08 => generated 1718 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:58:56.776842 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-5dc6ab25-f9f2-4b9a-a729-c042b8e87019 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:58:56.777853 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-5dc6ab25-f9f2-4b9a-a729-c042b8e87019 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] [instance: c04ee904-7b1a-4d73-b0c0-eb379c9aa683] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:58:56.785613 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-5dc6ab25-f9f2-4b9a-a729-c042b8e87019 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:56.786189 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-5dc6ab25-f9f2-4b9a-a729-c042b8e87019 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:56.786694 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-5dc6ab25-f9f2-4b9a-a729-c042b8e87019 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:56.787520 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-5dc6ab25-f9f2-4b9a-a729-c042b8e87019 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:56.788048 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-5dc6ab25-f9f2-4b9a-a729-c042b8e87019 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:56.788563 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-5dc6ab25-f9f2-4b9a-a729-c042b8e87019 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:57.305309 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-5dc6ab25-f9f2-4b9a-a729-c042b8e87019 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0290a6bb8bc24b8988a925327ac0381c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86941784237549838bba63ce88053b88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:58:57.318076 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-5dc6ab25-f9f2-4b9a-a729-c042b8e87019 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] 10.222.0.13 "GET /compute/v2.1/servers/c04ee904-7b1a-4d73-b0c0-eb379c9aa683" status: 200 len: 1318 microversion: 2.1 time: 0.556221 Nov 01 18:58:57.319559 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 689/1332] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:58:56 2022] GET /compute/v2.1/servers/c04ee904-7b1a-4d73-b0c0-eb379c9aa683 => generated 1318 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:58:57.325512 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-dd140953-b87d-4a91-8c90-8639626cd13b tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:58:57.326800 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-dd140953-b87d-4a91-8c90-8639626cd13b tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] [instance: 9249c81d-e57b-4985-a398-8ad97526d5c7] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:58:57.337056 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-dd140953-b87d-4a91-8c90-8639626cd13b tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:57.338260 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-dd140953-b87d-4a91-8c90-8639626cd13b tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:57.338940 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-dd140953-b87d-4a91-8c90-8639626cd13b tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:57.340218 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-dd140953-b87d-4a91-8c90-8639626cd13b tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:57.340787 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-dd140953-b87d-4a91-8c90-8639626cd13b tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:57.341288 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-dd140953-b87d-4a91-8c90-8639626cd13b tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:57.577508 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-dcf1361c-53ec-486e-8f23-d8c53d96a939 tempest-LiveAutoBlockMigrationV225Test-1358532044 tempest-LiveAutoBlockMigrationV225Test-1358532044-project-admin] 10.222.0.13 "POST /compute/v2.1/servers/a7f88d19-08ee-47bf-9240-7d49afd775e2/action" status: 202 len: 0 microversion: 2.25 time: 5.755903 Nov 01 18:58:57.578849 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 644/1333] 10.222.0.13 () {62 vars in 1319 bytes} [Tue Nov 1 18:58:51 2022] POST /compute/v2.1/servers/a7f88d19-08ee-47bf-9240-7d49afd775e2/action => generated 0 bytes in 5758 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 01 18:58:57.585209 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-514e8de6-e903-4184-ae33-af35776dd4dc tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:58:57.586373 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-514e8de6-e903-4184-ae33-af35776dd4dc tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] [instance: ed4798be-a45e-46f5-8f7e-1165f6479bd1] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:58:57.635296 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-514e8de6-e903-4184-ae33-af35776dd4dc tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:57.636985 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-514e8de6-e903-4184-ae33-af35776dd4dc tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:57.638010 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-514e8de6-e903-4184-ae33-af35776dd4dc tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:57.640496 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-514e8de6-e903-4184-ae33-af35776dd4dc tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:57.641546 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-514e8de6-e903-4184-ae33-af35776dd4dc tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:57.643639 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-514e8de6-e903-4184-ae33-af35776dd4dc tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:57.791765 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-dd140953-b87d-4a91-8c90-8639626cd13b tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72117f17294649d6b8bc16c66c7efab2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45d4c047d3c44324a27a27831236ab0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:58:57.803242 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-dd140953-b87d-4a91-8c90-8639626cd13b tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] 10.222.0.13 "GET /compute/v2.1/servers/9249c81d-e57b-4985-a398-8ad97526d5c7" status: 200 len: 1471 microversion: 2.1 time: 0.482432 Nov 01 18:58:57.805130 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 690/1334] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:58:57 2022] GET /compute/v2.1/servers/9249c81d-e57b-4985-a398-8ad97526d5c7 => generated 1471 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:58:57.822940 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-7552ab5b-b0e4-4731-b078-547e164fac90 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:58:57.823558 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-7552ab5b-b0e4-4731-b078-547e164fac90 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] [instance: ea631032-dd04-429b-988e-e6362ea42cf7] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:58:57.832165 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-7552ab5b-b0e4-4731-b078-547e164fac90 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:57.832687 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-7552ab5b-b0e4-4731-b078-547e164fac90 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:57.833136 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-7552ab5b-b0e4-4731-b078-547e164fac90 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:57.833848 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-7552ab5b-b0e4-4731-b078-547e164fac90 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:57.834315 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-7552ab5b-b0e4-4731-b078-547e164fac90 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:57.834743 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-7552ab5b-b0e4-4731-b078-547e164fac90 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:57.866649 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.wsgi [None req-7552ab5b-b0e4-4731-b078-547e164fac90 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] HTTP exception thrown: Instance ea631032-dd04-429b-988e-e6362ea42cf7 could not be found. Nov 01 18:58:57.868332 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-7552ab5b-b0e4-4731-b078-547e164fac90 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Request method failure captured: Nov 01 18:58:57.868332 n-d-863052-2 devstack@n-api.service[121402]: request: GET /compute/v2.1/servers/ea631032-dd04-429b-988e-e6362ea42cf7 HTTP/1.1 Nov 01 18:58:57.868332 n-d-863052-2 devstack@n-api.service[121402]: Accept: application/json Nov 01 18:58:57.868332 n-d-863052-2 devstack@n-api.service[121402]: Accept-Encoding: identity Nov 01 18:58:57.868332 n-d-863052-2 devstack@n-api.service[121402]: Connection: close Nov 01 18:58:57.868332 n-d-863052-2 devstack@n-api.service[121402]: Content-Length: 0 Nov 01 18:58:57.868332 n-d-863052-2 devstack@n-api.service[121402]: Content-Type: application/json Nov 01 18:58:57.868332 n-d-863052-2 devstack@n-api.service[121402]: Host: 10.222.0.13 Nov 01 18:58:57.868332 n-d-863052-2 devstack@n-api.service[121402]: Openstack-System-Scope: None Nov 01 18:58:57.868332 n-d-863052-2 devstack@n-api.service[121402]: User-Agent: python-urllib3/1.26.12 Nov 01 18:58:57.868332 n-d-863052-2 devstack@n-api.service[121402]: X-Auth-Token: gAAAAABjYWvEtSyoFImgWgI-1BFVskD3FmMceNpgxADKS5oFrVdMbo7goD2pgJtxRdlEOyhEie81QqZTvL39oKwLmrghAy5nYIjb_9Zm0GnaTuZtTIdHwoaQCpcUvS73cTDG8n-o2Ne1YEFTH_iA_HgpDPA9Q1U55zY3VsEIOTQwfGEmwG3G1GM Nov 01 18:58:57.868332 n-d-863052-2 devstack@n-api.service[121402]: X-Domain-Id: None Nov 01 18:58:57.868332 n-d-863052-2 devstack@n-api.service[121402]: X-Domain-Name: None Nov 01 18:58:57.868332 n-d-863052-2 devstack@n-api.service[121402]: X-Identity-Status: Confirmed Nov 01 18:58:57.868332 n-d-863052-2 devstack@n-api.service[121402]: X-Is-Admin-Project: True Nov 01 18:58:57.868332 n-d-863052-2 devstack@n-api.service[121402]: X-Openstack-Nova-Api-Version: 2.91 Nov 01 18:58:57.868332 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Domain-Id: default Nov 01 18:58:57.868332 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Domain-Name: Default Nov 01 18:58:57.868332 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Id: c804370880454c7aa02cef2c2c3cf144 Nov 01 18:58:57.868332 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Name: tempest-UnshelveToHostMultiNodesTest-1875061843 Nov 01 18:58:57.868332 n-d-863052-2 devstack@n-api.service[121402]: X-Role: member,reader Nov 01 18:58:57.868332 n-d-863052-2 devstack@n-api.service[121402]: X-Roles: member,reader Nov 01 18:58:57.870410 n-d-863052-2 devstack@n-api.service[121402]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/c804370880454c7aa02cef2c2c3cf144"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/c804370880454c7aa02cef2c2c3cf144"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_c804370880454c7aa02cef2c2c3cf144", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/c804370880454c7aa02cef2c2c3cf144"}]}] Nov 01 18:58:57.870410 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant: tempest-UnshelveToHostMultiNodesTest-1875061843 Nov 01 18:58:57.870410 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant-Id: c804370880454c7aa02cef2c2c3cf144 Nov 01 18:58:57.870410 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant-Name: tempest-UnshelveToHostMultiNodesTest-1875061843 Nov 01 18:58:57.870410 n-d-863052-2 devstack@n-api.service[121402]: X-User: tempest-UnshelveToHostMultiNodesTest-1875061843-project Nov 01 18:58:57.870410 n-d-863052-2 devstack@n-api.service[121402]: X-User-Domain-Id: default Nov 01 18:58:57.870410 n-d-863052-2 devstack@n-api.service[121402]: X-User-Domain-Name: Default Nov 01 18:58:57.870410 n-d-863052-2 devstack@n-api.service[121402]: X-User-Id: 3c1314c21d8547ff890ede1c2ad281c6 Nov 01 18:58:57.870410 n-d-863052-2 devstack@n-api.service[121402]: X-User-Name: tempest-UnshelveToHostMultiNodesTest-1875061843-project Nov 01 18:58:57.870410 n-d-863052-2 devstack@n-api.service[121402]: method: > Nov 01 18:58:57.870410 n-d-863052-2 devstack@n-api.service[121402]: exception: Instance ea631032-dd04-429b-988e-e6362ea42cf7 could not be found. Nov 01 18:58:57.870410 n-d-863052-2 devstack@n-api.service[121402]: action_args: {'id': 'ea631032-dd04-429b-988e-e6362ea42cf7'} Nov 01 18:58:57.871232 n-d-863052-2 devstack@n-api.service[121402]: {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 01 18:58:57.871232 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:58:57.871232 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 01 18:58:57.871232 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 01 18:58:57.871232 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 01 18:58:57.871232 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 01 18:58:57.871232 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 01 18:58:57.871232 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 01 18:58:57.871232 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 01 18:58:57.871232 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 01 18:58:57.871232 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ea631032-dd04-429b-988e-e6362ea42cf7 could not be found. Nov 01 18:58:57.871232 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 18:58:57.871232 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 18:58:57.871232 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 18:58:57.871232 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:58:57.871232 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 18:58:57.871232 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 18:58:57.871232 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 01 18:58:57.871232 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 01 18:58:57.871232 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 01 18:58:57.872618 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 01 18:58:57.872618 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 01 18:58:57.872618 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 01 18:58:57.872618 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 01 18:58:57.872618 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 01 18:58:57.872618 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 01 18:58:57.872618 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 01 18:58:57.872618 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ea631032-dd04-429b-988e-e6362ea42cf7 could not be found. Nov 01 18:58:57.872618 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 18:58:57.872618 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 18:58:57.872618 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 18:58:57.872618 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:58:57.872618 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 18:58:57.872618 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 18:58:57.872618 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 01 18:58:57.872618 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 01 18:58:57.872618 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ea631032-dd04-429b-988e-e6362ea42cf7 could not be found. Nov 01 18:58:57.872618 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 18:58:57.873773 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-7552ab5b-b0e4-4731-b078-547e164fac90 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] Returning 404 to user: Instance ea631032-dd04-429b-988e-e6362ea42cf7 could not be found. {{(pid=121402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 01 18:58:57.873773 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-7552ab5b-b0e4-4731-b078-547e164fac90 tempest-UnshelveToHostMultiNodesTest-1875061843 tempest-UnshelveToHostMultiNodesTest-1875061843-project] 10.222.0.13 "GET /compute/v2.1/servers/ea631032-dd04-429b-988e-e6362ea42cf7" status: 404 len: 111 microversion: 2.91 time: 0.066257 Nov 01 18:58:57.873773 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 691/1335] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 18:58:57 2022] GET /compute/v2.1/servers/ea631032-dd04-429b-988e-e6362ea42cf7 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 01 18:58:57.885919 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [req-d83d21a9-7cb5-4121-9990-3def6d0b8b71 req-d05c2092-3c20-4aa6-8fbd-60b2e237aaa2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d525a31-b0be-44cb-8fb7-335075145f08", "name": "network-vif-unplugged", "status": "completed", "tag": "3737be69-e488-4046-be48-2027dbcedf12"}]} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 18:58:57.908420 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-d83d21a9-7cb5-4121-9990-3def6d0b8b71 req-d05c2092-3c20-4aa6-8fbd-60b2e237aaa2 service nova] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:57.908959 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-d83d21a9-7cb5-4121-9990-3def6d0b8b71 req-d05c2092-3c20-4aa6-8fbd-60b2e237aaa2 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:57.909396 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-d83d21a9-7cb5-4121-9990-3def6d0b8b71 req-d05c2092-3c20-4aa6-8fbd-60b2e237aaa2 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:57.937528 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.compute.server_external_events [req-d83d21a9-7cb5-4121-9990-3def6d0b8b71 req-d05c2092-3c20-4aa6-8fbd-60b2e237aaa2 service nova] Creating event network-vif-unplugged:3737be69-e488-4046-be48-2027dbcedf12 for instance 2d525a31-b0be-44cb-8fb7-335075145f08 on n-h1-863052-2 Nov 01 18:58:57.946196 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [req-d83d21a9-7cb5-4121-9990-3def6d0b8b71 req-d05c2092-3c20-4aa6-8fbd-60b2e237aaa2 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.071853 Nov 01 18:58:57.947601 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 692/1336] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Nov 1 18:58:57 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 18:58:57.953402 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-76683e84-6012-4c36-97ac-2bb3fec6e176 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:58:57.954041 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-76683e84-6012-4c36-97ac-2bb3fec6e176 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] [instance: a7f88d19-08ee-47bf-9240-7d49afd775e2] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:58:57.974278 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-76683e84-6012-4c36-97ac-2bb3fec6e176 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:57.989357 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-76683e84-6012-4c36-97ac-2bb3fec6e176 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:57.989814 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-76683e84-6012-4c36-97ac-2bb3fec6e176 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:57.990760 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-76683e84-6012-4c36-97ac-2bb3fec6e176 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:57.991395 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-76683e84-6012-4c36-97ac-2bb3fec6e176 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:57.991999 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-76683e84-6012-4c36-97ac-2bb3fec6e176 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:58.150715 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-514e8de6-e903-4184-ae33-af35776dd4dc tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a63d69c99a546f0af16329cff3ca717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a1bb191cff948e99c008b5e861ce4a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:58:58.171781 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-514e8de6-e903-4184-ae33-af35776dd4dc tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] 10.222.0.13 "GET /compute/v2.1/servers/ed4798be-a45e-46f5-8f7e-1165f6479bd1" status: 200 len: 1521 microversion: 2.1 time: 0.591287 Nov 01 18:58:58.173175 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 645/1337] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:58:57 2022] GET /compute/v2.1/servers/ed4798be-a45e-46f5-8f7e-1165f6479bd1 => generated 1521 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:58:58.178443 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-c0063b0b-3ffc-4183-bc39-9d708b59d382 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:58:58.179149 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-c0063b0b-3ffc-4183-bc39-9d708b59d382 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] [instance: 2d525a31-b0be-44cb-8fb7-335075145f08] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:58:58.186100 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-c0063b0b-3ffc-4183-bc39-9d708b59d382 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:58.187651 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-c0063b0b-3ffc-4183-bc39-9d708b59d382 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:58.188600 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-c0063b0b-3ffc-4183-bc39-9d708b59d382 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:58.189529 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-c0063b0b-3ffc-4183-bc39-9d708b59d382 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:58.190206 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-c0063b0b-3ffc-4183-bc39-9d708b59d382 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:58.191061 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-c0063b0b-3ffc-4183-bc39-9d708b59d382 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:58.320015 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-76683e84-6012-4c36-97ac-2bb3fec6e176 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:58:58.335693 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-76683e84-6012-4c36-97ac-2bb3fec6e176 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:58:58.339462 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-76683e84-6012-4c36-97ac-2bb3fec6e176 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:58:58.345142 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-76683e84-6012-4c36-97ac-2bb3fec6e176 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] 10.222.0.13 "GET /compute/v2.1/servers/a7f88d19-08ee-47bf-9240-7d49afd775e2" status: 200 len: 1812 microversion: 2.25 time: 0.395605 Nov 01 18:58:58.345756 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 693/1338] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 18:58:57 2022] GET /compute/v2.1/servers/a7f88d19-08ee-47bf-9240-7d49afd775e2 => generated 1812 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 18:58:58.375481 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-8b16dcf9-656b-490b-a7b8-ded42326fbb3 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 18:58:58.376069 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-8b16dcf9-656b-490b-a7b8-ded42326fbb3 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] [instance: 9249c81d-e57b-4985-a398-8ad97526d5c7] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:58:58.401344 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-8b16dcf9-656b-490b-a7b8-ded42326fbb3 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:58.402240 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-8b16dcf9-656b-490b-a7b8-ded42326fbb3 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:58.402699 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-8b16dcf9-656b-490b-a7b8-ded42326fbb3 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:58.404886 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-8b16dcf9-656b-490b-a7b8-ded42326fbb3 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:58.405355 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-8b16dcf9-656b-490b-a7b8-ded42326fbb3 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:58.408389 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-8b16dcf9-656b-490b-a7b8-ded42326fbb3 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:58.576337 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-8b16dcf9-656b-490b-a7b8-ded42326fbb3 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:58.577106 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-8b16dcf9-656b-490b-a7b8-ded42326fbb3 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:58.578485 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-8b16dcf9-656b-490b-a7b8-ded42326fbb3 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:58.579369 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-8b16dcf9-656b-490b-a7b8-ded42326fbb3 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:58.580360 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-8b16dcf9-656b-490b-a7b8-ded42326fbb3 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:58.582581 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-8b16dcf9-656b-490b-a7b8-ded42326fbb3 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:58.639477 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.quota [None req-8b16dcf9-656b-490b-a7b8-ded42326fbb3 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Getting quotas for project 45d4c047d3c44324a27a27831236ab0d. Resources: {'cores', 'ram'} {{(pid=121402) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 01 18:58:58.658928 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.quota [None req-8b16dcf9-656b-490b-a7b8-ded42326fbb3 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Getting quotas for user 72117f17294649d6b8bc16c66c7efab2 and project 45d4c047d3c44324a27a27831236ab0d. Resources: {'cores', 'ram'} {{(pid=121402) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 01 18:58:58.673358 n-d-863052-2 devstack@n-api.service[121402]: DEBUG dbcounter [-] [121402] Writing DB stats nova_cell1:SELECT=100 {{(pid=121402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 18:58:58.837586 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-8b16dcf9-656b-490b-a7b8-ded42326fbb3 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] 10.222.0.13 "POST /compute/v2.1/servers/9249c81d-e57b-4985-a398-8ad97526d5c7/action" status: 202 len: 0 microversion: 2.1 time: 0.469848 Nov 01 18:58:58.839417 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 694/1339] 10.222.0.13 () {60 vars in 1278 bytes} [Tue Nov 1 18:58:58 2022] POST /compute/v2.1/servers/9249c81d-e57b-4985-a398-8ad97526d5c7/action => generated 0 bytes in 493 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 01 18:58:58.860445 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-44e45f04-d437-4ac4-98d2-71bb129b984b tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:58:58.861888 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-44e45f04-d437-4ac4-98d2-71bb129b984b tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] [instance: c04ee904-7b1a-4d73-b0c0-eb379c9aa683] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:58:58.873784 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-44e45f04-d437-4ac4-98d2-71bb129b984b tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:58.876002 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-44e45f04-d437-4ac4-98d2-71bb129b984b tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:58.876843 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-44e45f04-d437-4ac4-98d2-71bb129b984b tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:58.877822 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-44e45f04-d437-4ac4-98d2-71bb129b984b tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:58.878491 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-44e45f04-d437-4ac4-98d2-71bb129b984b tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:58.879190 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-44e45f04-d437-4ac4-98d2-71bb129b984b tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:59.357956 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-c0063b0b-3ffc-4183-bc39-9d708b59d382 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f32f5fba1976432d938e664c7714e52b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b9d4c236b944f9b2e8e502a50a8f8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:58:59.376844 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-c0063b0b-3ffc-4183-bc39-9d708b59d382 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] 10.222.0.13 "GET /compute/v2.1/servers/2d525a31-b0be-44cb-8fb7-335075145f08" status: 200 len: 1718 microversion: 2.1 time: 1.202237 Nov 01 18:58:59.398720 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 646/1340] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:58:58 2022] GET /compute/v2.1/servers/2d525a31-b0be-44cb-8fb7-335075145f08 => generated 1718 bytes in 1225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:58:59.406659 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-dca7c7ba-5a40-4532-8c98-3fc51cfd1c6c tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:58:59.408001 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-dca7c7ba-5a40-4532-8c98-3fc51cfd1c6c tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] [instance: 9249c81d-e57b-4985-a398-8ad97526d5c7] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:58:59.417487 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-dca7c7ba-5a40-4532-8c98-3fc51cfd1c6c tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:59.418538 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-dca7c7ba-5a40-4532-8c98-3fc51cfd1c6c tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:59.419566 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-dca7c7ba-5a40-4532-8c98-3fc51cfd1c6c tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:59.421072 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-dca7c7ba-5a40-4532-8c98-3fc51cfd1c6c tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:59.422549 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-dca7c7ba-5a40-4532-8c98-3fc51cfd1c6c tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:59.423271 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-dca7c7ba-5a40-4532-8c98-3fc51cfd1c6c tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:59.588575 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-44e45f04-d437-4ac4-98d2-71bb129b984b tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0290a6bb8bc24b8988a925327ac0381c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86941784237549838bba63ce88053b88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:58:59.598033 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-44e45f04-d437-4ac4-98d2-71bb129b984b tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] 10.222.0.13 "GET /compute/v2.1/servers/c04ee904-7b1a-4d73-b0c0-eb379c9aa683" status: 200 len: 1318 microversion: 2.1 time: 0.756936 Nov 01 18:58:59.601314 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 695/1341] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:58:58 2022] GET /compute/v2.1/servers/c04ee904-7b1a-4d73-b0c0-eb379c9aa683 => generated 1318 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:58:59.608961 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-87e983e6-8ad6-4af8-9f15-255dea8717df tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:58:59.613210 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-87e983e6-8ad6-4af8-9f15-255dea8717df tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] [instance: ed4798be-a45e-46f5-8f7e-1165f6479bd1] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:58:59.640504 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-87e983e6-8ad6-4af8-9f15-255dea8717df tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:59.641189 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-87e983e6-8ad6-4af8-9f15-255dea8717df tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:59.642660 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-87e983e6-8ad6-4af8-9f15-255dea8717df tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:59.644414 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-87e983e6-8ad6-4af8-9f15-255dea8717df tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:59.644997 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-87e983e6-8ad6-4af8-9f15-255dea8717df tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:59.646972 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-87e983e6-8ad6-4af8-9f15-255dea8717df tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:59.687621 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-dca7c7ba-5a40-4532-8c98-3fc51cfd1c6c tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72117f17294649d6b8bc16c66c7efab2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45d4c047d3c44324a27a27831236ab0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:58:59.699264 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-dca7c7ba-5a40-4532-8c98-3fc51cfd1c6c tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] 10.222.0.13 "GET /compute/v2.1/servers/9249c81d-e57b-4985-a398-8ad97526d5c7" status: 200 len: 1470 microversion: 2.1 time: 0.298954 Nov 01 18:58:59.699871 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 647/1342] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:58:59 2022] GET /compute/v2.1/servers/9249c81d-e57b-4985-a398-8ad97526d5c7 => generated 1470 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:58:59.721031 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-aa330e93-493a-40a2-9f3a-8edf659ba7cb tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:58:59.723034 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-aa330e93-493a-40a2-9f3a-8edf659ba7cb tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] [instance: a7f88d19-08ee-47bf-9240-7d49afd775e2] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:58:59.731308 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-aa330e93-493a-40a2-9f3a-8edf659ba7cb tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:59.732237 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-aa330e93-493a-40a2-9f3a-8edf659ba7cb tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:59.733055 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-aa330e93-493a-40a2-9f3a-8edf659ba7cb tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:58:59.734110 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-aa330e93-493a-40a2-9f3a-8edf659ba7cb tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:58:59.734781 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-aa330e93-493a-40a2-9f3a-8edf659ba7cb tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:58:59.735420 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-aa330e93-493a-40a2-9f3a-8edf659ba7cb tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:59:00.120306 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-87e983e6-8ad6-4af8-9f15-255dea8717df tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a63d69c99a546f0af16329cff3ca717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a1bb191cff948e99c008b5e861ce4a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:59:00.129428 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-87e983e6-8ad6-4af8-9f15-255dea8717df tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] 10.222.0.13 "GET /compute/v2.1/servers/ed4798be-a45e-46f5-8f7e-1165f6479bd1" status: 200 len: 1521 microversion: 2.1 time: 0.524455 Nov 01 18:59:00.130307 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 696/1343] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:58:59 2022] GET /compute/v2.1/servers/ed4798be-a45e-46f5-8f7e-1165f6479bd1 => generated 1521 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:59:00.135822 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [req-025976ab-4ef4-41e0-98d6-e8393c92b148 req-0b09f1fa-de21-4f59-8c21-da501c724f46 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c04ee904-7b1a-4d73-b0c0-eb379c9aa683", "tag": "34fac85b-afb5-42bd-94cb-4c0ee1272b6e"}, {"name": "network-changed", "server_uuid": "2d525a31-b0be-44cb-8fb7-335075145f08", "tag": "3737be69-e488-4046-be48-2027dbcedf12"}]} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 18:59:00.152756 n-d-863052-2 devstack@n-api.service[121402]: DEBUG dbcounter [-] [121402] Writing DB stats nova_api:SELECT=98,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=121402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 18:59:00.163612 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-025976ab-4ef4-41e0-98d6-e8393c92b148 req-0b09f1fa-de21-4f59-8c21-da501c724f46 service nova] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:59:00.164401 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-025976ab-4ef4-41e0-98d6-e8393c92b148 req-0b09f1fa-de21-4f59-8c21-da501c724f46 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:59:00.165089 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-025976ab-4ef4-41e0-98d6-e8393c92b148 req-0b09f1fa-de21-4f59-8c21-da501c724f46 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:59:00.182450 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.compute.server_external_events [req-025976ab-4ef4-41e0-98d6-e8393c92b148 req-0b09f1fa-de21-4f59-8c21-da501c724f46 service nova] Creating event network-changed:34fac85b-afb5-42bd-94cb-4c0ee1272b6e for instance c04ee904-7b1a-4d73-b0c0-eb379c9aa683 on n-h1-863052-2 Nov 01 18:59:00.183220 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.compute.server_external_events [req-025976ab-4ef4-41e0-98d6-e8393c92b148 req-0b09f1fa-de21-4f59-8c21-da501c724f46 service nova] Creating event network-changed:3737be69-e488-4046-be48-2027dbcedf12 for instance 2d525a31-b0be-44cb-8fb7-335075145f08 on n-h1-863052-2 Nov 01 18:59:00.183415 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-aa330e93-493a-40a2-9f3a-8edf659ba7cb tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:59:00.191802 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [req-025976ab-4ef4-41e0-98d6-e8393c92b148 req-0b09f1fa-de21-4f59-8c21-da501c724f46 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.059932 Nov 01 18:59:00.193471 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 697/1344] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Nov 1 18:59:00 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 18:59:00.198996 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-aa330e93-493a-40a2-9f3a-8edf659ba7cb tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:59:00.201666 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-aa330e93-493a-40a2-9f3a-8edf659ba7cb tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:59:00.206668 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-aa330e93-493a-40a2-9f3a-8edf659ba7cb tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] 10.222.0.13 "GET /compute/v2.1/servers/a7f88d19-08ee-47bf-9240-7d49afd775e2" status: 200 len: 1812 microversion: 2.25 time: 0.496279 Nov 01 18:59:00.215182 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 648/1345] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 18:58:59 2022] GET /compute/v2.1/servers/a7f88d19-08ee-47bf-9240-7d49afd775e2 => generated 1812 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 18:59:00.354138 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [req-8c9d55af-831a-44f1-8efa-7d171d477d42 req-2ab5d16d-9ba9-47a0-a1af-1def400cde00 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5e7ed73c-1243-4adf-94a2-09f7bf73f6fd", "tag": "e54c219d-e64c-46bc-ad98-717d0dfb07e2"}]} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 18:59:00.377128 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-8c9d55af-831a-44f1-8efa-7d171d477d42 req-2ab5d16d-9ba9-47a0-a1af-1def400cde00 service nova] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:59:00.377510 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-8c9d55af-831a-44f1-8efa-7d171d477d42 req-2ab5d16d-9ba9-47a0-a1af-1def400cde00 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:59:00.378040 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-8c9d55af-831a-44f1-8efa-7d171d477d42 req-2ab5d16d-9ba9-47a0-a1af-1def400cde00 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:59:00.410216 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.compute.server_external_events [req-8c9d55af-831a-44f1-8efa-7d171d477d42 req-2ab5d16d-9ba9-47a0-a1af-1def400cde00 service nova] Creating event network-changed:e54c219d-e64c-46bc-ad98-717d0dfb07e2 for instance 5e7ed73c-1243-4adf-94a2-09f7bf73f6fd on n-h2-863052-2 Nov 01 18:59:00.422411 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-d0dcbfaf-18fb-4511-a797-a278497f9c8d tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:59:00.431272 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-d0dcbfaf-18fb-4511-a797-a278497f9c8d tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] [instance: 2d525a31-b0be-44cb-8fb7-335075145f08] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:59:00.432897 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [req-8c9d55af-831a-44f1-8efa-7d171d477d42 req-2ab5d16d-9ba9-47a0-a1af-1def400cde00 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091384 Nov 01 18:59:00.433946 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 698/1346] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Nov 1 18:59:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 18:59:00.455434 n-d-863052-2 devstack@n-api.service[121403]: DEBUG dbcounter [-] [121403] Writing DB stats nova_cell0:SELECT=2 {{(pid=121403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 18:59:00.469605 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d0dcbfaf-18fb-4511-a797-a278497f9c8d tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:59:00.475375 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d0dcbfaf-18fb-4511-a797-a278497f9c8d tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:59:00.475914 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d0dcbfaf-18fb-4511-a797-a278497f9c8d tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:59:00.479703 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d0dcbfaf-18fb-4511-a797-a278497f9c8d tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:59:00.481784 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d0dcbfaf-18fb-4511-a797-a278497f9c8d tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:59:00.482244 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d0dcbfaf-18fb-4511-a797-a278497f9c8d tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:59:00.623973 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-2f50b7b1-ef69-4129-8caf-2b25f75a81c8 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:59:00.624732 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-2f50b7b1-ef69-4129-8caf-2b25f75a81c8 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] [instance: c04ee904-7b1a-4d73-b0c0-eb379c9aa683] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:59:00.631554 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2f50b7b1-ef69-4129-8caf-2b25f75a81c8 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:59:00.632041 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2f50b7b1-ef69-4129-8caf-2b25f75a81c8 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:59:00.632470 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2f50b7b1-ef69-4129-8caf-2b25f75a81c8 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:59:00.633195 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2f50b7b1-ef69-4129-8caf-2b25f75a81c8 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:59:00.633652 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2f50b7b1-ef69-4129-8caf-2b25f75a81c8 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:59:00.637251 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2f50b7b1-ef69-4129-8caf-2b25f75a81c8 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:59:00.994143 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-d0dcbfaf-18fb-4511-a797-a278497f9c8d tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f32f5fba1976432d938e664c7714e52b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b9d4c236b944f9b2e8e502a50a8f8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:59:01.011165 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-d0dcbfaf-18fb-4511-a797-a278497f9c8d tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] 10.222.0.13 "GET /compute/v2.1/servers/2d525a31-b0be-44cb-8fb7-335075145f08" status: 200 len: 1718 microversion: 2.1 time: 0.609247 Nov 01 18:59:01.012037 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 649/1347] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:59:00 2022] GET /compute/v2.1/servers/2d525a31-b0be-44cb-8fb7-335075145f08 => generated 1718 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 18:59:01.020796 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-d474386e-bd06-4f9e-9ee7-c3fb7a6b8ef9 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:59:01.022345 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-d474386e-bd06-4f9e-9ee7-c3fb7a6b8ef9 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] [instance: 9249c81d-e57b-4985-a398-8ad97526d5c7] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:59:01.031072 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d474386e-bd06-4f9e-9ee7-c3fb7a6b8ef9 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:59:01.031722 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d474386e-bd06-4f9e-9ee7-c3fb7a6b8ef9 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:59:01.032056 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d474386e-bd06-4f9e-9ee7-c3fb7a6b8ef9 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:59:01.032813 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d474386e-bd06-4f9e-9ee7-c3fb7a6b8ef9 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:59:01.033276 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d474386e-bd06-4f9e-9ee7-c3fb7a6b8ef9 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:59:01.033701 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d474386e-bd06-4f9e-9ee7-c3fb7a6b8ef9 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:59:01.069997 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-2f50b7b1-ef69-4129-8caf-2b25f75a81c8 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0290a6bb8bc24b8988a925327ac0381c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86941784237549838bba63ce88053b88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:59:01.079761 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-2f50b7b1-ef69-4129-8caf-2b25f75a81c8 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] 10.222.0.13 "GET /compute/v2.1/servers/c04ee904-7b1a-4d73-b0c0-eb379c9aa683" status: 200 len: 1318 microversion: 2.1 time: 0.460002 Nov 01 18:59:01.080695 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 699/1348] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:59:00 2022] GET /compute/v2.1/servers/c04ee904-7b1a-4d73-b0c0-eb379c9aa683 => generated 1318 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:59:01.156633 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-b55f081b-596b-4722-ac7a-2e3e7012204f tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:59:01.157658 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-b55f081b-596b-4722-ac7a-2e3e7012204f tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] [instance: ed4798be-a45e-46f5-8f7e-1165f6479bd1] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:59:01.165093 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b55f081b-596b-4722-ac7a-2e3e7012204f tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:59:01.166215 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b55f081b-596b-4722-ac7a-2e3e7012204f tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:59:01.166943 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b55f081b-596b-4722-ac7a-2e3e7012204f tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:59:01.167979 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b55f081b-596b-4722-ac7a-2e3e7012204f tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:59:01.168712 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b55f081b-596b-4722-ac7a-2e3e7012204f tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:59:01.169995 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b55f081b-596b-4722-ac7a-2e3e7012204f tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:59:01.203556 n-d-863052-2 devstack@n-api.service[121403]: DEBUG dbcounter [-] [121403] Writing DB stats nova_cell0:SELECT=10 {{(pid=121403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 18:59:01.344219 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-d474386e-bd06-4f9e-9ee7-c3fb7a6b8ef9 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72117f17294649d6b8bc16c66c7efab2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45d4c047d3c44324a27a27831236ab0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:59:01.352458 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-d474386e-bd06-4f9e-9ee7-c3fb7a6b8ef9 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] 10.222.0.13 "GET /compute/v2.1/servers/9249c81d-e57b-4985-a398-8ad97526d5c7" status: 200 len: 1470 microversion: 2.1 time: 0.339621 Nov 01 18:59:01.353449 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 650/1349] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:59:01 2022] GET /compute/v2.1/servers/9249c81d-e57b-4985-a398-8ad97526d5c7 => generated 1470 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:59:01.368463 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-bd0b4073-e08c-4ec3-b8a0-5d321af59c08 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:59:01.369489 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-bd0b4073-e08c-4ec3-b8a0-5d321af59c08 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] [instance: a7f88d19-08ee-47bf-9240-7d49afd775e2] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:59:01.382003 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-bd0b4073-e08c-4ec3-b8a0-5d321af59c08 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:59:01.382491 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-bd0b4073-e08c-4ec3-b8a0-5d321af59c08 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:59:01.382937 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-bd0b4073-e08c-4ec3-b8a0-5d321af59c08 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:59:01.383648 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-bd0b4073-e08c-4ec3-b8a0-5d321af59c08 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:59:01.384088 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-bd0b4073-e08c-4ec3-b8a0-5d321af59c08 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:59:01.384513 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-bd0b4073-e08c-4ec3-b8a0-5d321af59c08 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:59:01.417936 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-b55f081b-596b-4722-ac7a-2e3e7012204f tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a63d69c99a546f0af16329cff3ca717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a1bb191cff948e99c008b5e861ce4a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:59:01.428683 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-b55f081b-596b-4722-ac7a-2e3e7012204f tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] 10.222.0.13 "GET /compute/v2.1/servers/ed4798be-a45e-46f5-8f7e-1165f6479bd1" status: 200 len: 1521 microversion: 2.1 time: 0.276609 Nov 01 18:59:01.444607 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 700/1350] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:59:01 2022] GET /compute/v2.1/servers/ed4798be-a45e-46f5-8f7e-1165f6479bd1 => generated 1521 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 18:59:01.479020 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [req-ca87c662-84b0-4cd6-803d-1a1c1ffcb749 req-725e9b5a-8100-46c8-8f2d-c22417215fa9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9249c81d-e57b-4985-a398-8ad97526d5c7", "name": "network-vif-plugged", "status": "completed", "tag": "b471dd14-4ce9-4781-a7a0-1bd2ae3a7e55"}]} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 18:59:01.495567 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-ca87c662-84b0-4cd6-803d-1a1c1ffcb749 req-725e9b5a-8100-46c8-8f2d-c22417215fa9 service nova] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:59:01.496804 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-ca87c662-84b0-4cd6-803d-1a1c1ffcb749 req-725e9b5a-8100-46c8-8f2d-c22417215fa9 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:59:01.497368 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-ca87c662-84b0-4cd6-803d-1a1c1ffcb749 req-725e9b5a-8100-46c8-8f2d-c22417215fa9 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:59:01.511720 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.compute.server_external_events [req-ca87c662-84b0-4cd6-803d-1a1c1ffcb749 req-725e9b5a-8100-46c8-8f2d-c22417215fa9 service nova] Creating event network-vif-plugged:b471dd14-4ce9-4781-a7a0-1bd2ae3a7e55 for instance 9249c81d-e57b-4985-a398-8ad97526d5c7 on n-h1-863052-2 Nov 01 18:59:01.519174 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [req-ca87c662-84b0-4cd6-803d-1a1c1ffcb749 req-725e9b5a-8100-46c8-8f2d-c22417215fa9 service nova] Instance 9249c81d-e57b-4985-a398-8ad97526d5c7 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-863052-2', 'n-h2-863052-2'} {{(pid=121402) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Nov 01 18:59:01.531458 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [req-ca87c662-84b0-4cd6-803d-1a1c1ffcb749 req-725e9b5a-8100-46c8-8f2d-c22417215fa9 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056175 Nov 01 18:59:01.532368 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 701/1351] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Nov 1 18:59:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 18:59:01.821935 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-bd0b4073-e08c-4ec3-b8a0-5d321af59c08 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:59:01.837745 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-bd0b4073-e08c-4ec3-b8a0-5d321af59c08 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:59:01.842153 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-bd0b4073-e08c-4ec3-b8a0-5d321af59c08 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:59:01.845209 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-bd0b4073-e08c-4ec3-b8a0-5d321af59c08 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] 10.222.0.13 "GET /compute/v2.1/servers/a7f88d19-08ee-47bf-9240-7d49afd775e2" status: 200 len: 1812 microversion: 2.25 time: 0.489989 Nov 01 18:59:01.848683 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 651/1352] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 18:59:01 2022] GET /compute/v2.1/servers/a7f88d19-08ee-47bf-9240-7d49afd775e2 => generated 1812 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 18:59:02.040344 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-e31b9ba0-c874-4eb6-978e-3c511b51bd2e tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:59:02.041152 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-e31b9ba0-c874-4eb6-978e-3c511b51bd2e tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] [instance: 2d525a31-b0be-44cb-8fb7-335075145f08] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:59:02.054801 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e31b9ba0-c874-4eb6-978e-3c511b51bd2e tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:59:02.055401 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e31b9ba0-c874-4eb6-978e-3c511b51bd2e tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:59:02.056209 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e31b9ba0-c874-4eb6-978e-3c511b51bd2e tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:59:02.056961 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e31b9ba0-c874-4eb6-978e-3c511b51bd2e tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:59:02.057422 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e31b9ba0-c874-4eb6-978e-3c511b51bd2e tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:59:02.057978 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e31b9ba0-c874-4eb6-978e-3c511b51bd2e tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:59:02.104515 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-b4cae066-79de-4fb7-8110-a4ff33909452 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:59:02.105158 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-b4cae066-79de-4fb7-8110-a4ff33909452 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] [instance: c04ee904-7b1a-4d73-b0c0-eb379c9aa683] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:59:02.113584 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-b4cae066-79de-4fb7-8110-a4ff33909452 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:59:02.114071 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-b4cae066-79de-4fb7-8110-a4ff33909452 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:59:02.114509 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-b4cae066-79de-4fb7-8110-a4ff33909452 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:59:02.120261 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-b4cae066-79de-4fb7-8110-a4ff33909452 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:59:02.120793 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-b4cae066-79de-4fb7-8110-a4ff33909452 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:59:02.121885 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-b4cae066-79de-4fb7-8110-a4ff33909452 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:59:02.583373 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-b4cae066-79de-4fb7-8110-a4ff33909452 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0290a6bb8bc24b8988a925327ac0381c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86941784237549838bba63ce88053b88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:59:02.604213 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-b4cae066-79de-4fb7-8110-a4ff33909452 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] 10.222.0.13 "GET /compute/v2.1/servers/c04ee904-7b1a-4d73-b0c0-eb379c9aa683" status: 200 len: 1318 microversion: 2.1 time: 0.503495 Nov 01 18:59:02.607310 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 652/1353] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:59:02 2022] GET /compute/v2.1/servers/c04ee904-7b1a-4d73-b0c0-eb379c9aa683 => generated 1318 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:59:02.635125 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-d9357bd2-e357-479e-9c96-f249ea16c252 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:59:02.640303 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-d9357bd2-e357-479e-9c96-f249ea16c252 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] [instance: 9249c81d-e57b-4985-a398-8ad97526d5c7] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:59:02.661269 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d9357bd2-e357-479e-9c96-f249ea16c252 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:59:02.661775 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d9357bd2-e357-479e-9c96-f249ea16c252 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:59:02.662217 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d9357bd2-e357-479e-9c96-f249ea16c252 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:59:02.665385 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d9357bd2-e357-479e-9c96-f249ea16c252 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:59:02.665860 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d9357bd2-e357-479e-9c96-f249ea16c252 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:59:02.666299 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d9357bd2-e357-479e-9c96-f249ea16c252 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:59:02.785682 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-e31b9ba0-c874-4eb6-978e-3c511b51bd2e tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f32f5fba1976432d938e664c7714e52b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b9d4c236b944f9b2e8e502a50a8f8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:59:02.796762 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-e31b9ba0-c874-4eb6-978e-3c511b51bd2e tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] 10.222.0.13 "GET /compute/v2.1/servers/2d525a31-b0be-44cb-8fb7-335075145f08" status: 200 len: 1718 microversion: 2.1 time: 0.764534 Nov 01 18:59:02.801221 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 702/1354] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:59:02 2022] GET /compute/v2.1/servers/2d525a31-b0be-44cb-8fb7-335075145f08 => generated 1718 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:59:02.814230 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-7d983017-95dd-4dc3-94c7-be4b14d1bf25 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:59:02.817797 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-7d983017-95dd-4dc3-94c7-be4b14d1bf25 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] [instance: ed4798be-a45e-46f5-8f7e-1165f6479bd1] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:59:02.832460 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-7d983017-95dd-4dc3-94c7-be4b14d1bf25 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:59:02.835126 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-7d983017-95dd-4dc3-94c7-be4b14d1bf25 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:59:02.835805 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-7d983017-95dd-4dc3-94c7-be4b14d1bf25 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:59:02.837918 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-7d983017-95dd-4dc3-94c7-be4b14d1bf25 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:59:02.838701 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-7d983017-95dd-4dc3-94c7-be4b14d1bf25 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:59:02.841002 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-7d983017-95dd-4dc3-94c7-be4b14d1bf25 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:59:03.019885 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-d9357bd2-e357-479e-9c96-f249ea16c252 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72117f17294649d6b8bc16c66c7efab2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45d4c047d3c44324a27a27831236ab0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:59:03.025468 n-d-863052-2 devstack@n-api.service[121403]: DEBUG dbcounter [-] [121403] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=121403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 18:59:03.030723 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-d9357bd2-e357-479e-9c96-f249ea16c252 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] 10.222.0.13 "GET /compute/v2.1/servers/9249c81d-e57b-4985-a398-8ad97526d5c7" status: 200 len: 1470 microversion: 2.1 time: 0.422145 Nov 01 18:59:03.035161 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 653/1355] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:59:02 2022] GET /compute/v2.1/servers/9249c81d-e57b-4985-a398-8ad97526d5c7 => generated 1470 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:59:03.043037 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-5319706f-f50c-443b-b27e-53c2caa85256 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:59:03.043645 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-5319706f-f50c-443b-b27e-53c2caa85256 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] [instance: a7f88d19-08ee-47bf-9240-7d49afd775e2] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:59:03.056110 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-5319706f-f50c-443b-b27e-53c2caa85256 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:59:03.056686 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-5319706f-f50c-443b-b27e-53c2caa85256 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:59:03.060523 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-5319706f-f50c-443b-b27e-53c2caa85256 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:59:03.069094 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-5319706f-f50c-443b-b27e-53c2caa85256 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:59:03.069904 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-5319706f-f50c-443b-b27e-53c2caa85256 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:59:03.073479 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-5319706f-f50c-443b-b27e-53c2caa85256 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:59:03.198048 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-7d983017-95dd-4dc3-94c7-be4b14d1bf25 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a63d69c99a546f0af16329cff3ca717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a1bb191cff948e99c008b5e861ce4a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:59:03.208145 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-7d983017-95dd-4dc3-94c7-be4b14d1bf25 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] 10.222.0.13 "GET /compute/v2.1/servers/ed4798be-a45e-46f5-8f7e-1165f6479bd1" status: 200 len: 1521 microversion: 2.1 time: 0.405620 Nov 01 18:59:03.222639 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 703/1356] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:59:02 2022] GET /compute/v2.1/servers/ed4798be-a45e-46f5-8f7e-1165f6479bd1 => generated 1521 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:59:03.506836 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-5319706f-f50c-443b-b27e-53c2caa85256 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:59:03.519478 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-8ccef38e-f84f-4e7e-83c1-ec261c15cc9d tempest-ImagesMetadataNegativeTestJSON-178060507 tempest-ImagesMetadataNegativeTestJSON-178060507-project] Calling method '.version_select at 0x7f0ae2c30a60>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:59:03.530644 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-5319706f-f50c-443b-b27e-53c2caa85256 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:59:03.538613 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-5319706f-f50c-443b-b27e-53c2caa85256 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:59:03.540418 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-5319706f-f50c-443b-b27e-53c2caa85256 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] 10.222.0.13 "GET /compute/v2.1/servers/a7f88d19-08ee-47bf-9240-7d49afd775e2" status: 200 len: 1812 microversion: 2.25 time: 0.501993 Nov 01 18:59:03.559266 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.wsgi [None req-8ccef38e-f84f-4e7e-83c1-ec261c15cc9d tempest-ImagesMetadataNegativeTestJSON-178060507 tempest-ImagesMetadataNegativeTestJSON-178060507-project] HTTP exception thrown: Image not found. Nov 01 18:59:03.565947 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-8ccef38e-f84f-4e7e-83c1-ec261c15cc9d tempest-ImagesMetadataNegativeTestJSON-178060507 tempest-ImagesMetadataNegativeTestJSON-178060507-project] Request method failure captured: Nov 01 18:59:03.565947 n-d-863052-2 devstack@n-api.service[121402]: request: DELETE /compute/v2.1/images/0c7862f0-3658-4d04-a87e-0e24008c63a2/metadata/os_distro HTTP/1.1 Nov 01 18:59:03.565947 n-d-863052-2 devstack@n-api.service[121402]: Accept: application/json Nov 01 18:59:03.565947 n-d-863052-2 devstack@n-api.service[121402]: Accept-Encoding: identity Nov 01 18:59:03.565947 n-d-863052-2 devstack@n-api.service[121402]: Connection: close Nov 01 18:59:03.565947 n-d-863052-2 devstack@n-api.service[121402]: Content-Length: 0 Nov 01 18:59:03.565947 n-d-863052-2 devstack@n-api.service[121402]: Content-Type: application/json Nov 01 18:59:03.565947 n-d-863052-2 devstack@n-api.service[121402]: Host: 10.222.0.13 Nov 01 18:59:03.565947 n-d-863052-2 devstack@n-api.service[121402]: Openstack-System-Scope: None Nov 01 18:59:03.565947 n-d-863052-2 devstack@n-api.service[121402]: User-Agent: python-urllib3/1.26.12 Nov 01 18:59:03.565947 n-d-863052-2 devstack@n-api.service[121402]: X-Auth-Token: gAAAAABjYWx24FpFaEgYtP51Ea17pzF-4oe1EdPiwr3CUATxf_wTKxwVSpA0E5Ea0s8GZ-Kn9LMBcUQSbCriCV8LoxQclUS-nsvMWI10y4fv-D5a1Hw74djJ7Lu6UnHPO5DBNmuc3oUFF7ruOowcLlKIR1ftlqyzHrRXYSbp2jwN0bfeM_Z_R0s Nov 01 18:59:03.565947 n-d-863052-2 devstack@n-api.service[121402]: X-Domain-Id: None Nov 01 18:59:03.565947 n-d-863052-2 devstack@n-api.service[121402]: X-Domain-Name: None Nov 01 18:59:03.565947 n-d-863052-2 devstack@n-api.service[121402]: X-Identity-Status: Confirmed Nov 01 18:59:03.565947 n-d-863052-2 devstack@n-api.service[121402]: X-Is-Admin-Project: True Nov 01 18:59:03.565947 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Domain-Id: default Nov 01 18:59:03.565947 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Domain-Name: Default Nov 01 18:59:03.565947 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Id: 07c572b57d7d4303a35505e226d2becd Nov 01 18:59:03.565947 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-178060507 Nov 01 18:59:03.565947 n-d-863052-2 devstack@n-api.service[121402]: X-Role: member,reader Nov 01 18:59:03.565947 n-d-863052-2 devstack@n-api.service[121402]: X-Roles: member,reader Nov 01 18:59:03.567573 n-d-863052-2 devstack@n-api.service[121402]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/07c572b57d7d4303a35505e226d2becd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/07c572b57d7d4303a35505e226d2becd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_07c572b57d7d4303a35505e226d2becd", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/07c572b57d7d4303a35505e226d2becd"}]}] Nov 01 18:59:03.567573 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-178060507 Nov 01 18:59:03.567573 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant-Id: 07c572b57d7d4303a35505e226d2becd Nov 01 18:59:03.567573 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-178060507 Nov 01 18:59:03.567573 n-d-863052-2 devstack@n-api.service[121402]: X-User: tempest-ImagesMetadataNegativeTestJSON-178060507-project Nov 01 18:59:03.567573 n-d-863052-2 devstack@n-api.service[121402]: X-User-Domain-Id: default Nov 01 18:59:03.567573 n-d-863052-2 devstack@n-api.service[121402]: X-User-Domain-Name: Default Nov 01 18:59:03.567573 n-d-863052-2 devstack@n-api.service[121402]: X-User-Id: 9080bd954b4a4da8ad4595e34e71bad1 Nov 01 18:59:03.567573 n-d-863052-2 devstack@n-api.service[121402]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-178060507-project Nov 01 18:59:03.567573 n-d-863052-2 devstack@n-api.service[121402]: method: Nov 01 18:59:03.567573 n-d-863052-2 devstack@n-api.service[121402]: exception: Image not found. Nov 01 18:59:03.567573 n-d-863052-2 devstack@n-api.service[121402]: action_args: {'image_id': '0c7862f0-3658-4d04-a87e-0e24008c63a2', 'id': 'os_distro'} Nov 01 18:59:03.567573 n-d-863052-2 devstack@n-api.service[121402]: {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 01 18:59:03.568629 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:59:03.568629 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Nov 01 18:59:03.568629 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Nov 01 18:59:03.568629 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Nov 01 18:59:03.568629 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Nov 01 18:59:03.568629 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Nov 01 18:59:03.568629 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return self._get(image_id) Nov 01 18:59:03.568629 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Nov 01 18:59:03.568629 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Nov 01 18:59:03.568629 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Nov 01 18:59:03.568629 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Nov 01 18:59:03.568629 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Nov 01 18:59:03.568629 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Nov 01 18:59:03.568629 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Nov 01 18:59:03.568629 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Nov 01 18:59:03.568629 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Nov 01 18:59:03.568629 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Nov 01 18:59:03.568629 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 0c7862f0-3658-4d04-a87e-0e24008c63a2 Nov 01 18:59:03.569959 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 18:59:03.569959 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 18:59:03.569959 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 18:59:03.569959 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:59:03.569959 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Nov 01 18:59:03.569959 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Nov 01 18:59:03.569959 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Nov 01 18:59:03.569959 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Nov 01 18:59:03.569959 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Nov 01 18:59:03.569959 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Nov 01 18:59:03.569959 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Nov 01 18:59:03.569959 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Nov 01 18:59:03.569959 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Nov 01 18:59:03.569959 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Nov 01 18:59:03.569959 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Nov 01 18:59:03.569959 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Nov 01 18:59:03.569959 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Nov 01 18:59:03.569959 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return self._get(image_id) Nov 01 18:59:03.569959 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Nov 01 18:59:03.569959 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Nov 01 18:59:03.571309 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Nov 01 18:59:03.571309 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Nov 01 18:59:03.571309 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Nov 01 18:59:03.571309 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Nov 01 18:59:03.571309 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Nov 01 18:59:03.571309 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Nov 01 18:59:03.571309 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Nov 01 18:59:03.571309 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Nov 01 18:59:03.571309 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 0c7862f0-3658-4d04-a87e-0e24008c63a2 could not be found. Nov 01 18:59:03.571309 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 18:59:03.571309 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 18:59:03.571309 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 18:59:03.571309 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:59:03.571309 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 18:59:03.571309 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 18:59:03.571309 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 01 18:59:03.571309 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 01 18:59:03.571309 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 01 18:59:03.571309 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 01 18:59:03.572540 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 01 18:59:03.572540 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 01 18:59:03.572540 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 125, in delete Nov 01 18:59:03.572540 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Nov 01 18:59:03.572540 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Nov 01 18:59:03.572540 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Nov 01 18:59:03.572540 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Nov 01 18:59:03.572540 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 18:59:03.572540 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 18:59:03.572540 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 18:59:03.572540 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:59:03.572540 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 18:59:03.572540 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 18:59:03.572540 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 01 18:59:03.572540 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 01 18:59:03.572540 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Nov 01 18:59:03.572540 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 18:59:03.572540 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-8ccef38e-f84f-4e7e-83c1-ec261c15cc9d tempest-ImagesMetadataNegativeTestJSON-178060507 tempest-ImagesMetadataNegativeTestJSON-178060507-project] Returning 404 to user: Image not found. {{(pid=121402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 01 18:59:03.574014 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 654/1357] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 18:59:03 2022] GET /compute/v2.1/servers/a7f88d19-08ee-47bf-9240-7d49afd775e2 => generated 1812 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 18:59:03.574110 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-8ccef38e-f84f-4e7e-83c1-ec261c15cc9d tempest-ImagesMetadataNegativeTestJSON-178060507 tempest-ImagesMetadataNegativeTestJSON-178060507-project] 10.222.0.13 "DELETE /compute/v2.1/images/0c7862f0-3658-4d04-a87e-0e24008c63a2/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 0.344116 Nov 01 18:59:03.577882 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 704/1358] 10.222.0.13 () {58 vars in 1293 bytes} [Tue Nov 1 18:59:03 2022] DELETE /compute/v2.1/images/0c7862f0-3658-4d04-a87e-0e24008c63a2/metadata/os_distro => generated 62 bytes in 354 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 01 18:59:03.579267 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-f3ea2393-a6fc-4eb7-bc75-6ee75bc2e982 tempest-ImagesMetadataNegativeTestJSON-178060507 tempest-ImagesMetadataNegativeTestJSON-178060507-project] Calling method '.version_select at 0x7f0ae218ec10>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:59:03.602627 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.wsgi [None req-f3ea2393-a6fc-4eb7-bc75-6ee75bc2e982 tempest-ImagesMetadataNegativeTestJSON-178060507 tempest-ImagesMetadataNegativeTestJSON-178060507-project] HTTP exception thrown: Image not found. Nov 01 18:59:03.604998 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-f3ea2393-a6fc-4eb7-bc75-6ee75bc2e982 tempest-ImagesMetadataNegativeTestJSON-178060507 tempest-ImagesMetadataNegativeTestJSON-178060507-project] Request method failure captured: Nov 01 18:59:03.604998 n-d-863052-2 devstack@n-api.service[121403]: request: GET /compute/v2.1/images/502434c1-3408-4b67-b233-c01aaf5e8948/metadata/os_version HTTP/1.1 Nov 01 18:59:03.604998 n-d-863052-2 devstack@n-api.service[121403]: Accept: application/json Nov 01 18:59:03.604998 n-d-863052-2 devstack@n-api.service[121403]: Accept-Encoding: identity Nov 01 18:59:03.604998 n-d-863052-2 devstack@n-api.service[121403]: Connection: close Nov 01 18:59:03.604998 n-d-863052-2 devstack@n-api.service[121403]: Content-Length: 0 Nov 01 18:59:03.604998 n-d-863052-2 devstack@n-api.service[121403]: Content-Type: application/json Nov 01 18:59:03.604998 n-d-863052-2 devstack@n-api.service[121403]: Host: 10.222.0.13 Nov 01 18:59:03.604998 n-d-863052-2 devstack@n-api.service[121403]: Openstack-System-Scope: None Nov 01 18:59:03.604998 n-d-863052-2 devstack@n-api.service[121403]: User-Agent: python-urllib3/1.26.12 Nov 01 18:59:03.604998 n-d-863052-2 devstack@n-api.service[121403]: X-Auth-Token: gAAAAABjYWx24FpFaEgYtP51Ea17pzF-4oe1EdPiwr3CUATxf_wTKxwVSpA0E5Ea0s8GZ-Kn9LMBcUQSbCriCV8LoxQclUS-nsvMWI10y4fv-D5a1Hw74djJ7Lu6UnHPO5DBNmuc3oUFF7ruOowcLlKIR1ftlqyzHrRXYSbp2jwN0bfeM_Z_R0s Nov 01 18:59:03.604998 n-d-863052-2 devstack@n-api.service[121403]: X-Domain-Id: None Nov 01 18:59:03.604998 n-d-863052-2 devstack@n-api.service[121403]: X-Domain-Name: None Nov 01 18:59:03.604998 n-d-863052-2 devstack@n-api.service[121403]: X-Identity-Status: Confirmed Nov 01 18:59:03.604998 n-d-863052-2 devstack@n-api.service[121403]: X-Is-Admin-Project: True Nov 01 18:59:03.604998 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Domain-Id: default Nov 01 18:59:03.604998 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Domain-Name: Default Nov 01 18:59:03.604998 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Id: 07c572b57d7d4303a35505e226d2becd Nov 01 18:59:03.604998 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-178060507 Nov 01 18:59:03.604998 n-d-863052-2 devstack@n-api.service[121403]: X-Role: member,reader Nov 01 18:59:03.604998 n-d-863052-2 devstack@n-api.service[121403]: X-Roles: member,reader Nov 01 18:59:03.606327 n-d-863052-2 devstack@n-api.service[121403]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/07c572b57d7d4303a35505e226d2becd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/07c572b57d7d4303a35505e226d2becd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_07c572b57d7d4303a35505e226d2becd", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/07c572b57d7d4303a35505e226d2becd"}]}] Nov 01 18:59:03.606327 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-178060507 Nov 01 18:59:03.606327 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant-Id: 07c572b57d7d4303a35505e226d2becd Nov 01 18:59:03.606327 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-178060507 Nov 01 18:59:03.606327 n-d-863052-2 devstack@n-api.service[121403]: X-User: tempest-ImagesMetadataNegativeTestJSON-178060507-project Nov 01 18:59:03.606327 n-d-863052-2 devstack@n-api.service[121403]: X-User-Domain-Id: default Nov 01 18:59:03.606327 n-d-863052-2 devstack@n-api.service[121403]: X-User-Domain-Name: Default Nov 01 18:59:03.606327 n-d-863052-2 devstack@n-api.service[121403]: X-User-Id: 9080bd954b4a4da8ad4595e34e71bad1 Nov 01 18:59:03.606327 n-d-863052-2 devstack@n-api.service[121403]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-178060507-project Nov 01 18:59:03.606327 n-d-863052-2 devstack@n-api.service[121403]: method: Nov 01 18:59:03.606327 n-d-863052-2 devstack@n-api.service[121403]: exception: Image not found. Nov 01 18:59:03.606327 n-d-863052-2 devstack@n-api.service[121403]: action_args: {'image_id': '502434c1-3408-4b67-b233-c01aaf5e8948', 'id': 'os_version'} Nov 01 18:59:03.606327 n-d-863052-2 devstack@n-api.service[121403]: {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 01 18:59:03.607131 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:59:03.607131 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Nov 01 18:59:03.607131 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Nov 01 18:59:03.607131 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Nov 01 18:59:03.607131 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Nov 01 18:59:03.607131 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Nov 01 18:59:03.607131 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return self._get(image_id) Nov 01 18:59:03.607131 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Nov 01 18:59:03.607131 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Nov 01 18:59:03.607131 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Nov 01 18:59:03.607131 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Nov 01 18:59:03.607131 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Nov 01 18:59:03.607131 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Nov 01 18:59:03.607131 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Nov 01 18:59:03.607131 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Nov 01 18:59:03.607131 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Nov 01 18:59:03.607131 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Nov 01 18:59:03.607131 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 502434c1-3408-4b67-b233-c01aaf5e8948 Nov 01 18:59:03.608404 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 18:59:03.608404 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 18:59:03.608404 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 18:59:03.608404 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:59:03.608404 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Nov 01 18:59:03.608404 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Nov 01 18:59:03.608404 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Nov 01 18:59:03.608404 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Nov 01 18:59:03.608404 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Nov 01 18:59:03.608404 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Nov 01 18:59:03.608404 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Nov 01 18:59:03.608404 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Nov 01 18:59:03.608404 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Nov 01 18:59:03.608404 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Nov 01 18:59:03.608404 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Nov 01 18:59:03.608404 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Nov 01 18:59:03.608404 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Nov 01 18:59:03.608404 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return self._get(image_id) Nov 01 18:59:03.608404 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Nov 01 18:59:03.608404 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Nov 01 18:59:03.610577 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Nov 01 18:59:03.610577 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Nov 01 18:59:03.610577 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Nov 01 18:59:03.610577 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Nov 01 18:59:03.610577 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Nov 01 18:59:03.610577 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Nov 01 18:59:03.610577 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Nov 01 18:59:03.610577 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Nov 01 18:59:03.610577 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 502434c1-3408-4b67-b233-c01aaf5e8948 could not be found. Nov 01 18:59:03.610577 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 18:59:03.610577 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 18:59:03.610577 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 18:59:03.610577 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:59:03.610577 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 18:59:03.610577 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 18:59:03.610577 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 01 18:59:03.610577 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 01 18:59:03.610577 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 01 18:59:03.610577 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 01 18:59:03.614222 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 01 18:59:03.614222 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 01 18:59:03.614222 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 58, in show Nov 01 18:59:03.614222 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi metadata = self._get_image(context, image_id)['properties'] Nov 01 18:59:03.614222 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Nov 01 18:59:03.614222 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Nov 01 18:59:03.614222 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Nov 01 18:59:03.614222 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 18:59:03.614222 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 18:59:03.614222 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 18:59:03.614222 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:59:03.614222 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 18:59:03.614222 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 18:59:03.614222 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 01 18:59:03.614222 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 01 18:59:03.614222 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Nov 01 18:59:03.614222 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 18:59:03.614222 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-f3ea2393-a6fc-4eb7-bc75-6ee75bc2e982 tempest-ImagesMetadataNegativeTestJSON-178060507 tempest-ImagesMetadataNegativeTestJSON-178060507-project] Returning 404 to user: Image not found. {{(pid=121403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 01 18:59:03.623310 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-f3ea2393-a6fc-4eb7-bc75-6ee75bc2e982 tempest-ImagesMetadataNegativeTestJSON-178060507 tempest-ImagesMetadataNegativeTestJSON-178060507-project] 10.222.0.13 "GET /compute/v2.1/images/502434c1-3408-4b67-b233-c01aaf5e8948/metadata/os_version" status: 404 len: 62 microversion: 2.1 time: 0.042307 Nov 01 18:59:03.628915 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-e563b39f-80d1-4f71-9f69-2c80da59796a tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:59:03.630744 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-e563b39f-80d1-4f71-9f69-2c80da59796a tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] [instance: c04ee904-7b1a-4d73-b0c0-eb379c9aa683] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:59:03.634292 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 655/1359] 10.222.0.13 () {58 vars in 1293 bytes} [Tue Nov 1 18:59:03 2022] GET /compute/v2.1/images/502434c1-3408-4b67-b233-c01aaf5e8948/metadata/os_version => generated 62 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 01 18:59:03.639213 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-7623b493-6c90-488f-b3ed-0bb21e0333ca tempest-ImagesMetadataNegativeTestJSON-178060507 tempest-ImagesMetadataNegativeTestJSON-178060507-project] Calling method '.version_select at 0x7f0ae21204c0>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:59:03.642836 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e563b39f-80d1-4f71-9f69-2c80da59796a tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:59:03.643538 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e563b39f-80d1-4f71-9f69-2c80da59796a tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:59:03.644498 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e563b39f-80d1-4f71-9f69-2c80da59796a tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:59:03.651631 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e563b39f-80d1-4f71-9f69-2c80da59796a tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:59:03.652366 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e563b39f-80d1-4f71-9f69-2c80da59796a tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:59:03.652798 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e563b39f-80d1-4f71-9f69-2c80da59796a tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:59:03.672037 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.wsgi [None req-7623b493-6c90-488f-b3ed-0bb21e0333ca tempest-ImagesMetadataNegativeTestJSON-178060507 tempest-ImagesMetadataNegativeTestJSON-178060507-project] HTTP exception thrown: Image not found. Nov 01 18:59:03.675163 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-7623b493-6c90-488f-b3ed-0bb21e0333ca tempest-ImagesMetadataNegativeTestJSON-178060507 tempest-ImagesMetadataNegativeTestJSON-178060507-project] Request method failure captured: Nov 01 18:59:03.675163 n-d-863052-2 devstack@n-api.service[121403]: request: GET /compute/v2.1/images/22c06a00-08ec-49f4-9323-0a42964fe08b/metadata HTTP/1.1 Nov 01 18:59:03.675163 n-d-863052-2 devstack@n-api.service[121403]: Accept: application/json Nov 01 18:59:03.675163 n-d-863052-2 devstack@n-api.service[121403]: Accept-Encoding: identity Nov 01 18:59:03.675163 n-d-863052-2 devstack@n-api.service[121403]: Connection: close Nov 01 18:59:03.675163 n-d-863052-2 devstack@n-api.service[121403]: Content-Length: 0 Nov 01 18:59:03.675163 n-d-863052-2 devstack@n-api.service[121403]: Content-Type: application/json Nov 01 18:59:03.675163 n-d-863052-2 devstack@n-api.service[121403]: Host: 10.222.0.13 Nov 01 18:59:03.675163 n-d-863052-2 devstack@n-api.service[121403]: Openstack-System-Scope: None Nov 01 18:59:03.675163 n-d-863052-2 devstack@n-api.service[121403]: User-Agent: python-urllib3/1.26.12 Nov 01 18:59:03.675163 n-d-863052-2 devstack@n-api.service[121403]: X-Auth-Token: gAAAAABjYWx24FpFaEgYtP51Ea17pzF-4oe1EdPiwr3CUATxf_wTKxwVSpA0E5Ea0s8GZ-Kn9LMBcUQSbCriCV8LoxQclUS-nsvMWI10y4fv-D5a1Hw74djJ7Lu6UnHPO5DBNmuc3oUFF7ruOowcLlKIR1ftlqyzHrRXYSbp2jwN0bfeM_Z_R0s Nov 01 18:59:03.675163 n-d-863052-2 devstack@n-api.service[121403]: X-Domain-Id: None Nov 01 18:59:03.675163 n-d-863052-2 devstack@n-api.service[121403]: X-Domain-Name: None Nov 01 18:59:03.675163 n-d-863052-2 devstack@n-api.service[121403]: X-Identity-Status: Confirmed Nov 01 18:59:03.675163 n-d-863052-2 devstack@n-api.service[121403]: X-Is-Admin-Project: True Nov 01 18:59:03.675163 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Domain-Id: default Nov 01 18:59:03.675163 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Domain-Name: Default Nov 01 18:59:03.675163 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Id: 07c572b57d7d4303a35505e226d2becd Nov 01 18:59:03.675163 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-178060507 Nov 01 18:59:03.675163 n-d-863052-2 devstack@n-api.service[121403]: X-Role: member,reader Nov 01 18:59:03.675163 n-d-863052-2 devstack@n-api.service[121403]: X-Roles: member,reader Nov 01 18:59:03.676760 n-d-863052-2 devstack@n-api.service[121403]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/07c572b57d7d4303a35505e226d2becd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/07c572b57d7d4303a35505e226d2becd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_07c572b57d7d4303a35505e226d2becd", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/07c572b57d7d4303a35505e226d2becd"}]}] Nov 01 18:59:03.676760 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-178060507 Nov 01 18:59:03.676760 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant-Id: 07c572b57d7d4303a35505e226d2becd Nov 01 18:59:03.676760 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-178060507 Nov 01 18:59:03.676760 n-d-863052-2 devstack@n-api.service[121403]: X-User: tempest-ImagesMetadataNegativeTestJSON-178060507-project Nov 01 18:59:03.676760 n-d-863052-2 devstack@n-api.service[121403]: X-User-Domain-Id: default Nov 01 18:59:03.676760 n-d-863052-2 devstack@n-api.service[121403]: X-User-Domain-Name: Default Nov 01 18:59:03.676760 n-d-863052-2 devstack@n-api.service[121403]: X-User-Id: 9080bd954b4a4da8ad4595e34e71bad1 Nov 01 18:59:03.676760 n-d-863052-2 devstack@n-api.service[121403]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-178060507-project Nov 01 18:59:03.676760 n-d-863052-2 devstack@n-api.service[121403]: method: Nov 01 18:59:03.676760 n-d-863052-2 devstack@n-api.service[121403]: exception: Image not found. Nov 01 18:59:03.676760 n-d-863052-2 devstack@n-api.service[121403]: action_args: {'image_id': '22c06a00-08ec-49f4-9323-0a42964fe08b'} Nov 01 18:59:03.676760 n-d-863052-2 devstack@n-api.service[121403]: {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 01 18:59:03.677571 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:59:03.677571 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Nov 01 18:59:03.677571 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Nov 01 18:59:03.677571 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Nov 01 18:59:03.677571 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Nov 01 18:59:03.677571 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Nov 01 18:59:03.677571 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return self._get(image_id) Nov 01 18:59:03.677571 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Nov 01 18:59:03.677571 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Nov 01 18:59:03.677571 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Nov 01 18:59:03.677571 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Nov 01 18:59:03.677571 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Nov 01 18:59:03.677571 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Nov 01 18:59:03.677571 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Nov 01 18:59:03.677571 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Nov 01 18:59:03.677571 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Nov 01 18:59:03.677571 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Nov 01 18:59:03.677571 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 22c06a00-08ec-49f4-9323-0a42964fe08b Nov 01 18:59:03.678806 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 18:59:03.678806 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 18:59:03.678806 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 18:59:03.678806 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:59:03.678806 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Nov 01 18:59:03.678806 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Nov 01 18:59:03.678806 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Nov 01 18:59:03.678806 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Nov 01 18:59:03.678806 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Nov 01 18:59:03.678806 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Nov 01 18:59:03.678806 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Nov 01 18:59:03.678806 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Nov 01 18:59:03.678806 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Nov 01 18:59:03.678806 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Nov 01 18:59:03.678806 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Nov 01 18:59:03.678806 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Nov 01 18:59:03.678806 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Nov 01 18:59:03.678806 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return self._get(image_id) Nov 01 18:59:03.678806 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Nov 01 18:59:03.678806 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Nov 01 18:59:03.679979 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Nov 01 18:59:03.679979 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Nov 01 18:59:03.679979 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Nov 01 18:59:03.679979 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Nov 01 18:59:03.679979 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Nov 01 18:59:03.679979 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Nov 01 18:59:03.679979 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Nov 01 18:59:03.679979 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Nov 01 18:59:03.679979 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 22c06a00-08ec-49f4-9323-0a42964fe08b could not be found. Nov 01 18:59:03.679979 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 18:59:03.679979 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 18:59:03.679979 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 18:59:03.679979 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:59:03.679979 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 18:59:03.679979 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 18:59:03.679979 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 01 18:59:03.679979 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 01 18:59:03.679979 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 01 18:59:03.679979 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 01 18:59:03.683006 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 01 18:59:03.683006 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 01 18:59:03.683006 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 51, in index Nov 01 18:59:03.683006 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi metadata = self._get_image(context, image_id)['properties'] Nov 01 18:59:03.683006 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Nov 01 18:59:03.683006 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Nov 01 18:59:03.683006 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Nov 01 18:59:03.683006 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 18:59:03.683006 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 18:59:03.683006 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 18:59:03.683006 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:59:03.683006 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 18:59:03.683006 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 18:59:03.683006 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 01 18:59:03.683006 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 01 18:59:03.683006 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Nov 01 18:59:03.683006 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 18:59:03.683006 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-7623b493-6c90-488f-b3ed-0bb21e0333ca tempest-ImagesMetadataNegativeTestJSON-178060507 tempest-ImagesMetadataNegativeTestJSON-178060507-project] Returning 404 to user: Image not found. {{(pid=121403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 01 18:59:03.691474 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-7623b493-6c90-488f-b3ed-0bb21e0333ca tempest-ImagesMetadataNegativeTestJSON-178060507 tempest-ImagesMetadataNegativeTestJSON-178060507-project] 10.222.0.13 "GET /compute/v2.1/images/22c06a00-08ec-49f4-9323-0a42964fe08b/metadata" status: 404 len: 62 microversion: 2.1 time: 0.046823 Nov 01 18:59:03.691474 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 656/1360] 10.222.0.13 () {58 vars in 1260 bytes} [Tue Nov 1 18:59:03 2022] GET /compute/v2.1/images/22c06a00-08ec-49f4-9323-0a42964fe08b/metadata => generated 62 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 01 18:59:03.697270 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-be871c1a-dd9f-4d5b-9fb2-78d90bc4ca64 tempest-ImagesMetadataNegativeTestJSON-178060507 tempest-ImagesMetadataNegativeTestJSON-178060507-project] Action: 'update_all', calling method: .version_select at 0x7f0ae2120dc0>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 18:59:03.728895 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.wsgi [None req-be871c1a-dd9f-4d5b-9fb2-78d90bc4ca64 tempest-ImagesMetadataNegativeTestJSON-178060507 tempest-ImagesMetadataNegativeTestJSON-178060507-project] HTTP exception thrown: Image not found. Nov 01 18:59:03.731206 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-be871c1a-dd9f-4d5b-9fb2-78d90bc4ca64 tempest-ImagesMetadataNegativeTestJSON-178060507 tempest-ImagesMetadataNegativeTestJSON-178060507-project] Request method failure captured: Nov 01 18:59:03.731206 n-d-863052-2 devstack@n-api.service[121403]: request: PUT /compute/v2.1/images/45a9478b-e3c4-4db0-b540-c72cc5358c3f/metadata HTTP/1.1 Nov 01 18:59:03.731206 n-d-863052-2 devstack@n-api.service[121403]: Accept: application/json Nov 01 18:59:03.731206 n-d-863052-2 devstack@n-api.service[121403]: Accept-Encoding: identity Nov 01 18:59:03.731206 n-d-863052-2 devstack@n-api.service[121403]: Connection: close Nov 01 18:59:03.731206 n-d-863052-2 devstack@n-api.service[121403]: Content-Length: 57 Nov 01 18:59:03.731206 n-d-863052-2 devstack@n-api.service[121403]: Content-Type: application/json Nov 01 18:59:03.731206 n-d-863052-2 devstack@n-api.service[121403]: Host: 10.222.0.13 Nov 01 18:59:03.731206 n-d-863052-2 devstack@n-api.service[121403]: Openstack-System-Scope: None Nov 01 18:59:03.731206 n-d-863052-2 devstack@n-api.service[121403]: User-Agent: python-urllib3/1.26.12 Nov 01 18:59:03.731206 n-d-863052-2 devstack@n-api.service[121403]: X-Auth-Token: gAAAAABjYWx24FpFaEgYtP51Ea17pzF-4oe1EdPiwr3CUATxf_wTKxwVSpA0E5Ea0s8GZ-Kn9LMBcUQSbCriCV8LoxQclUS-nsvMWI10y4fv-D5a1Hw74djJ7Lu6UnHPO5DBNmuc3oUFF7ruOowcLlKIR1ftlqyzHrRXYSbp2jwN0bfeM_Z_R0s Nov 01 18:59:03.731206 n-d-863052-2 devstack@n-api.service[121403]: X-Domain-Id: None Nov 01 18:59:03.731206 n-d-863052-2 devstack@n-api.service[121403]: X-Domain-Name: None Nov 01 18:59:03.731206 n-d-863052-2 devstack@n-api.service[121403]: X-Identity-Status: Confirmed Nov 01 18:59:03.731206 n-d-863052-2 devstack@n-api.service[121403]: X-Is-Admin-Project: True Nov 01 18:59:03.731206 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Domain-Id: default Nov 01 18:59:03.731206 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Domain-Name: Default Nov 01 18:59:03.731206 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Id: 07c572b57d7d4303a35505e226d2becd Nov 01 18:59:03.731206 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-178060507 Nov 01 18:59:03.731206 n-d-863052-2 devstack@n-api.service[121403]: X-Role: member,reader Nov 01 18:59:03.731206 n-d-863052-2 devstack@n-api.service[121403]: X-Roles: member,reader Nov 01 18:59:03.732739 n-d-863052-2 devstack@n-api.service[121403]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/07c572b57d7d4303a35505e226d2becd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/07c572b57d7d4303a35505e226d2becd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_07c572b57d7d4303a35505e226d2becd", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/07c572b57d7d4303a35505e226d2becd"}]}] Nov 01 18:59:03.732739 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-178060507 Nov 01 18:59:03.732739 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant-Id: 07c572b57d7d4303a35505e226d2becd Nov 01 18:59:03.732739 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-178060507 Nov 01 18:59:03.732739 n-d-863052-2 devstack@n-api.service[121403]: X-User: tempest-ImagesMetadataNegativeTestJSON-178060507-project Nov 01 18:59:03.732739 n-d-863052-2 devstack@n-api.service[121403]: X-User-Domain-Id: default Nov 01 18:59:03.732739 n-d-863052-2 devstack@n-api.service[121403]: X-User-Domain-Name: Default Nov 01 18:59:03.732739 n-d-863052-2 devstack@n-api.service[121403]: X-User-Id: 9080bd954b4a4da8ad4595e34e71bad1 Nov 01 18:59:03.732739 n-d-863052-2 devstack@n-api.service[121403]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-178060507-project Nov 01 18:59:03.732739 n-d-863052-2 devstack@n-api.service[121403]: Nov 01 18:59:03.732739 n-d-863052-2 devstack@n-api.service[121403]: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} Nov 01 18:59:03.732739 n-d-863052-2 devstack@n-api.service[121403]: method: Nov 01 18:59:03.732739 n-d-863052-2 devstack@n-api.service[121403]: exception: Image not found. Nov 01 18:59:03.732739 n-d-863052-2 devstack@n-api.service[121403]: action_args: {'image_id': '45a9478b-e3c4-4db0-b540-c72cc5358c3f', 'body': {'metadata': {'os_distro': 'alt1', 'os_version': 'alt2'}}} Nov 01 18:59:03.734212 n-d-863052-2 devstack@n-api.service[121403]: {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 01 18:59:03.734212 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:59:03.734212 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Nov 01 18:59:03.734212 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Nov 01 18:59:03.734212 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Nov 01 18:59:03.734212 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Nov 01 18:59:03.734212 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Nov 01 18:59:03.734212 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return self._get(image_id) Nov 01 18:59:03.734212 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Nov 01 18:59:03.734212 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Nov 01 18:59:03.734212 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Nov 01 18:59:03.734212 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Nov 01 18:59:03.734212 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Nov 01 18:59:03.734212 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Nov 01 18:59:03.734212 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Nov 01 18:59:03.734212 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Nov 01 18:59:03.734212 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Nov 01 18:59:03.734212 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Nov 01 18:59:03.735287 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 45a9478b-e3c4-4db0-b540-c72cc5358c3f Nov 01 18:59:03.735287 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 18:59:03.735287 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 18:59:03.735287 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 18:59:03.735287 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:59:03.735287 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Nov 01 18:59:03.735287 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Nov 01 18:59:03.735287 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Nov 01 18:59:03.735287 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Nov 01 18:59:03.735287 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Nov 01 18:59:03.735287 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Nov 01 18:59:03.735287 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Nov 01 18:59:03.735287 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Nov 01 18:59:03.735287 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Nov 01 18:59:03.735287 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Nov 01 18:59:03.735287 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Nov 01 18:59:03.735287 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Nov 01 18:59:03.735287 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Nov 01 18:59:03.735287 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return self._get(image_id) Nov 01 18:59:03.736555 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Nov 01 18:59:03.736555 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Nov 01 18:59:03.736555 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Nov 01 18:59:03.736555 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Nov 01 18:59:03.736555 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Nov 01 18:59:03.736555 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Nov 01 18:59:03.736555 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Nov 01 18:59:03.736555 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Nov 01 18:59:03.736555 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Nov 01 18:59:03.736555 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Nov 01 18:59:03.736555 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 45a9478b-e3c4-4db0-b540-c72cc5358c3f could not be found. Nov 01 18:59:03.736555 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 18:59:03.736555 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 18:59:03.736555 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 18:59:03.736555 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:59:03.736555 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 18:59:03.736555 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 18:59:03.736555 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 01 18:59:03.736555 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 01 18:59:03.737744 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 01 18:59:03.737744 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 01 18:59:03.737744 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 01 18:59:03.737744 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 01 18:59:03.737744 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 01 18:59:03.737744 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 01 18:59:03.737744 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 109, in update_all Nov 01 18:59:03.737744 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Nov 01 18:59:03.737744 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Nov 01 18:59:03.737744 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Nov 01 18:59:03.737744 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Nov 01 18:59:03.737744 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 18:59:03.737744 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 18:59:03.737744 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 18:59:03.737744 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:59:03.737744 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 18:59:03.737744 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 18:59:03.737744 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 01 18:59:03.737744 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 01 18:59:03.737744 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Nov 01 18:59:03.737744 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 18:59:03.741712 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-be871c1a-dd9f-4d5b-9fb2-78d90bc4ca64 tempest-ImagesMetadataNegativeTestJSON-178060507 tempest-ImagesMetadataNegativeTestJSON-178060507-project] Returning 404 to user: Image not found. {{(pid=121403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 01 18:59:03.743085 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-be871c1a-dd9f-4d5b-9fb2-78d90bc4ca64 tempest-ImagesMetadataNegativeTestJSON-178060507 tempest-ImagesMetadataNegativeTestJSON-178060507-project] 10.222.0.13 "PUT /compute/v2.1/images/45a9478b-e3c4-4db0-b540-c72cc5358c3f/metadata" status: 404 len: 62 microversion: 2.1 time: 0.052969 Nov 01 18:59:03.744868 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 657/1361] 10.222.0.13 () {60 vars in 1280 bytes} [Tue Nov 1 18:59:03 2022] PUT /compute/v2.1/images/45a9478b-e3c4-4db0-b540-c72cc5358c3f/metadata => generated 62 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Nov 01 18:59:03.762258 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-4de825e4-d706-4903-995c-4a5ee250533e tempest-ImagesMetadataNegativeTestJSON-178060507 tempest-ImagesMetadataNegativeTestJSON-178060507-project] Action: 'update', calling method: .version_select at 0x7f0ae2824e50>, body: {"meta": {"os_distro": "alt"}} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 18:59:03.787983 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.wsgi [None req-4de825e4-d706-4903-995c-4a5ee250533e tempest-ImagesMetadataNegativeTestJSON-178060507 tempest-ImagesMetadataNegativeTestJSON-178060507-project] HTTP exception thrown: Image not found. Nov 01 18:59:03.790493 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-4de825e4-d706-4903-995c-4a5ee250533e tempest-ImagesMetadataNegativeTestJSON-178060507 tempest-ImagesMetadataNegativeTestJSON-178060507-project] Request method failure captured: Nov 01 18:59:03.790493 n-d-863052-2 devstack@n-api.service[121403]: request: PUT /compute/v2.1/images/33a3c815-c184-4a47-b4bf-277b0508b82d/metadata/os_distro HTTP/1.1 Nov 01 18:59:03.790493 n-d-863052-2 devstack@n-api.service[121403]: Accept: application/json Nov 01 18:59:03.790493 n-d-863052-2 devstack@n-api.service[121403]: Accept-Encoding: identity Nov 01 18:59:03.790493 n-d-863052-2 devstack@n-api.service[121403]: Connection: close Nov 01 18:59:03.790493 n-d-863052-2 devstack@n-api.service[121403]: Content-Length: 30 Nov 01 18:59:03.790493 n-d-863052-2 devstack@n-api.service[121403]: Content-Type: application/json Nov 01 18:59:03.790493 n-d-863052-2 devstack@n-api.service[121403]: Host: 10.222.0.13 Nov 01 18:59:03.790493 n-d-863052-2 devstack@n-api.service[121403]: Openstack-System-Scope: None Nov 01 18:59:03.790493 n-d-863052-2 devstack@n-api.service[121403]: User-Agent: python-urllib3/1.26.12 Nov 01 18:59:03.790493 n-d-863052-2 devstack@n-api.service[121403]: X-Auth-Token: gAAAAABjYWx24FpFaEgYtP51Ea17pzF-4oe1EdPiwr3CUATxf_wTKxwVSpA0E5Ea0s8GZ-Kn9LMBcUQSbCriCV8LoxQclUS-nsvMWI10y4fv-D5a1Hw74djJ7Lu6UnHPO5DBNmuc3oUFF7ruOowcLlKIR1ftlqyzHrRXYSbp2jwN0bfeM_Z_R0s Nov 01 18:59:03.790493 n-d-863052-2 devstack@n-api.service[121403]: X-Domain-Id: None Nov 01 18:59:03.790493 n-d-863052-2 devstack@n-api.service[121403]: X-Domain-Name: None Nov 01 18:59:03.790493 n-d-863052-2 devstack@n-api.service[121403]: X-Identity-Status: Confirmed Nov 01 18:59:03.790493 n-d-863052-2 devstack@n-api.service[121403]: X-Is-Admin-Project: True Nov 01 18:59:03.790493 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Domain-Id: default Nov 01 18:59:03.790493 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Domain-Name: Default Nov 01 18:59:03.790493 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Id: 07c572b57d7d4303a35505e226d2becd Nov 01 18:59:03.790493 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-178060507 Nov 01 18:59:03.790493 n-d-863052-2 devstack@n-api.service[121403]: X-Role: member,reader Nov 01 18:59:03.790493 n-d-863052-2 devstack@n-api.service[121403]: X-Roles: member,reader Nov 01 18:59:03.792178 n-d-863052-2 devstack@n-api.service[121403]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/07c572b57d7d4303a35505e226d2becd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/07c572b57d7d4303a35505e226d2becd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_07c572b57d7d4303a35505e226d2becd", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/07c572b57d7d4303a35505e226d2becd"}]}] Nov 01 18:59:03.792178 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-178060507 Nov 01 18:59:03.792178 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant-Id: 07c572b57d7d4303a35505e226d2becd Nov 01 18:59:03.792178 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-178060507 Nov 01 18:59:03.792178 n-d-863052-2 devstack@n-api.service[121403]: X-User: tempest-ImagesMetadataNegativeTestJSON-178060507-project Nov 01 18:59:03.792178 n-d-863052-2 devstack@n-api.service[121403]: X-User-Domain-Id: default Nov 01 18:59:03.792178 n-d-863052-2 devstack@n-api.service[121403]: X-User-Domain-Name: Default Nov 01 18:59:03.792178 n-d-863052-2 devstack@n-api.service[121403]: X-User-Id: 9080bd954b4a4da8ad4595e34e71bad1 Nov 01 18:59:03.792178 n-d-863052-2 devstack@n-api.service[121403]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-178060507-project Nov 01 18:59:03.792178 n-d-863052-2 devstack@n-api.service[121403]: Nov 01 18:59:03.792178 n-d-863052-2 devstack@n-api.service[121403]: {"meta": {"os_distro": "alt"}} Nov 01 18:59:03.792178 n-d-863052-2 devstack@n-api.service[121403]: method: Nov 01 18:59:03.792178 n-d-863052-2 devstack@n-api.service[121403]: exception: Image not found. Nov 01 18:59:03.792178 n-d-863052-2 devstack@n-api.service[121403]: action_args: {'image_id': '33a3c815-c184-4a47-b4bf-277b0508b82d', 'id': 'os_distro', 'body': {'meta': {'os_distro': 'alt'}}} Nov 01 18:59:03.793574 n-d-863052-2 devstack@n-api.service[121403]: {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 01 18:59:03.793574 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:59:03.793574 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Nov 01 18:59:03.793574 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Nov 01 18:59:03.793574 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Nov 01 18:59:03.793574 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Nov 01 18:59:03.793574 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Nov 01 18:59:03.793574 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return self._get(image_id) Nov 01 18:59:03.793574 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Nov 01 18:59:03.793574 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Nov 01 18:59:03.793574 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Nov 01 18:59:03.793574 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Nov 01 18:59:03.793574 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Nov 01 18:59:03.793574 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Nov 01 18:59:03.793574 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Nov 01 18:59:03.793574 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Nov 01 18:59:03.793574 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Nov 01 18:59:03.793574 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Nov 01 18:59:03.795444 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 33a3c815-c184-4a47-b4bf-277b0508b82d Nov 01 18:59:03.795444 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 18:59:03.795444 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 18:59:03.795444 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 18:59:03.795444 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:59:03.795444 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Nov 01 18:59:03.795444 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Nov 01 18:59:03.795444 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Nov 01 18:59:03.795444 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Nov 01 18:59:03.795444 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Nov 01 18:59:03.795444 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Nov 01 18:59:03.795444 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Nov 01 18:59:03.795444 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Nov 01 18:59:03.795444 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Nov 01 18:59:03.795444 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Nov 01 18:59:03.795444 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Nov 01 18:59:03.795444 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Nov 01 18:59:03.795444 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Nov 01 18:59:03.795444 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return self._get(image_id) Nov 01 18:59:03.798768 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Nov 01 18:59:03.798768 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Nov 01 18:59:03.798768 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Nov 01 18:59:03.798768 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Nov 01 18:59:03.798768 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Nov 01 18:59:03.798768 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Nov 01 18:59:03.798768 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Nov 01 18:59:03.798768 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Nov 01 18:59:03.798768 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Nov 01 18:59:03.798768 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Nov 01 18:59:03.798768 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 33a3c815-c184-4a47-b4bf-277b0508b82d could not be found. Nov 01 18:59:03.798768 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 18:59:03.798768 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 18:59:03.798768 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 18:59:03.798768 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:59:03.798768 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 18:59:03.798768 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 18:59:03.798768 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 01 18:59:03.798768 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 01 18:59:03.803142 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 01 18:59:03.803142 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 01 18:59:03.803142 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 01 18:59:03.803142 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 01 18:59:03.803142 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 01 18:59:03.803142 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 01 18:59:03.803142 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 93, in update Nov 01 18:59:03.803142 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Nov 01 18:59:03.803142 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Nov 01 18:59:03.803142 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Nov 01 18:59:03.803142 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Nov 01 18:59:03.803142 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 18:59:03.803142 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 18:59:03.803142 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 18:59:03.803142 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:59:03.803142 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 18:59:03.803142 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 18:59:03.803142 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 01 18:59:03.803142 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 01 18:59:03.803142 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Nov 01 18:59:03.803142 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 18:59:03.806051 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-4de825e4-d706-4903-995c-4a5ee250533e tempest-ImagesMetadataNegativeTestJSON-178060507 tempest-ImagesMetadataNegativeTestJSON-178060507-project] Returning 404 to user: Image not found. {{(pid=121403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 01 18:59:03.806051 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-4de825e4-d706-4903-995c-4a5ee250533e tempest-ImagesMetadataNegativeTestJSON-178060507 tempest-ImagesMetadataNegativeTestJSON-178060507-project] 10.222.0.13 "PUT /compute/v2.1/images/33a3c815-c184-4a47-b4bf-277b0508b82d/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 0.046221 Nov 01 18:59:03.807380 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 658/1362] 10.222.0.13 () {60 vars in 1310 bytes} [Tue Nov 1 18:59:03 2022] PUT /compute/v2.1/images/33a3c815-c184-4a47-b4bf-277b0508b82d/metadata/os_distro => generated 62 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 01 18:59:03.816192 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-791eb941-68ab-4361-bdf5-a81ee1845413 tempest-ImagesMetadataNegativeTestJSON-178060507 tempest-ImagesMetadataNegativeTestJSON-178060507-project] Action: 'create', calling method: .version_select at 0x7f0ae2254e50>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 18:59:03.841046 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.wsgi [None req-791eb941-68ab-4361-bdf5-a81ee1845413 tempest-ImagesMetadataNegativeTestJSON-178060507 tempest-ImagesMetadataNegativeTestJSON-178060507-project] HTTP exception thrown: Image not found. Nov 01 18:59:03.844099 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-791eb941-68ab-4361-bdf5-a81ee1845413 tempest-ImagesMetadataNegativeTestJSON-178060507 tempest-ImagesMetadataNegativeTestJSON-178060507-project] Request method failure captured: Nov 01 18:59:03.844099 n-d-863052-2 devstack@n-api.service[121403]: request: POST /compute/v2.1/images/a48ad90e-8fa0-4e5b-bbfc-6f966145a836/metadata HTTP/1.1 Nov 01 18:59:03.844099 n-d-863052-2 devstack@n-api.service[121403]: Accept: application/json Nov 01 18:59:03.844099 n-d-863052-2 devstack@n-api.service[121403]: Accept-Encoding: identity Nov 01 18:59:03.844099 n-d-863052-2 devstack@n-api.service[121403]: Connection: close Nov 01 18:59:03.844099 n-d-863052-2 devstack@n-api.service[121403]: Content-Length: 57 Nov 01 18:59:03.844099 n-d-863052-2 devstack@n-api.service[121403]: Content-Type: application/json Nov 01 18:59:03.844099 n-d-863052-2 devstack@n-api.service[121403]: Host: 10.222.0.13 Nov 01 18:59:03.844099 n-d-863052-2 devstack@n-api.service[121403]: Openstack-System-Scope: None Nov 01 18:59:03.844099 n-d-863052-2 devstack@n-api.service[121403]: User-Agent: python-urllib3/1.26.12 Nov 01 18:59:03.844099 n-d-863052-2 devstack@n-api.service[121403]: X-Auth-Token: gAAAAABjYWx24FpFaEgYtP51Ea17pzF-4oe1EdPiwr3CUATxf_wTKxwVSpA0E5Ea0s8GZ-Kn9LMBcUQSbCriCV8LoxQclUS-nsvMWI10y4fv-D5a1Hw74djJ7Lu6UnHPO5DBNmuc3oUFF7ruOowcLlKIR1ftlqyzHrRXYSbp2jwN0bfeM_Z_R0s Nov 01 18:59:03.844099 n-d-863052-2 devstack@n-api.service[121403]: X-Domain-Id: None Nov 01 18:59:03.844099 n-d-863052-2 devstack@n-api.service[121403]: X-Domain-Name: None Nov 01 18:59:03.844099 n-d-863052-2 devstack@n-api.service[121403]: X-Identity-Status: Confirmed Nov 01 18:59:03.844099 n-d-863052-2 devstack@n-api.service[121403]: X-Is-Admin-Project: True Nov 01 18:59:03.844099 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Domain-Id: default Nov 01 18:59:03.844099 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Domain-Name: Default Nov 01 18:59:03.844099 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Id: 07c572b57d7d4303a35505e226d2becd Nov 01 18:59:03.844099 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-178060507 Nov 01 18:59:03.844099 n-d-863052-2 devstack@n-api.service[121403]: X-Role: member,reader Nov 01 18:59:03.844099 n-d-863052-2 devstack@n-api.service[121403]: X-Roles: member,reader Nov 01 18:59:03.845750 n-d-863052-2 devstack@n-api.service[121403]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/07c572b57d7d4303a35505e226d2becd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/07c572b57d7d4303a35505e226d2becd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_07c572b57d7d4303a35505e226d2becd", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/07c572b57d7d4303a35505e226d2becd"}]}] Nov 01 18:59:03.845750 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-178060507 Nov 01 18:59:03.845750 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant-Id: 07c572b57d7d4303a35505e226d2becd Nov 01 18:59:03.845750 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-178060507 Nov 01 18:59:03.845750 n-d-863052-2 devstack@n-api.service[121403]: X-User: tempest-ImagesMetadataNegativeTestJSON-178060507-project Nov 01 18:59:03.845750 n-d-863052-2 devstack@n-api.service[121403]: X-User-Domain-Id: default Nov 01 18:59:03.845750 n-d-863052-2 devstack@n-api.service[121403]: X-User-Domain-Name: Default Nov 01 18:59:03.845750 n-d-863052-2 devstack@n-api.service[121403]: X-User-Id: 9080bd954b4a4da8ad4595e34e71bad1 Nov 01 18:59:03.845750 n-d-863052-2 devstack@n-api.service[121403]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-178060507-project Nov 01 18:59:03.845750 n-d-863052-2 devstack@n-api.service[121403]: Nov 01 18:59:03.845750 n-d-863052-2 devstack@n-api.service[121403]: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} Nov 01 18:59:03.845750 n-d-863052-2 devstack@n-api.service[121403]: method: Nov 01 18:59:03.845750 n-d-863052-2 devstack@n-api.service[121403]: exception: Image not found. Nov 01 18:59:03.845750 n-d-863052-2 devstack@n-api.service[121403]: action_args: {'image_id': 'a48ad90e-8fa0-4e5b-bbfc-6f966145a836', 'body': {'metadata': {'os_distro': 'alt1', 'os_version': 'alt2'}}} Nov 01 18:59:03.846667 n-d-863052-2 devstack@n-api.service[121403]: {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 01 18:59:03.846667 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:59:03.846667 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Nov 01 18:59:03.846667 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Nov 01 18:59:03.846667 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Nov 01 18:59:03.846667 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Nov 01 18:59:03.846667 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Nov 01 18:59:03.846667 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return self._get(image_id) Nov 01 18:59:03.846667 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Nov 01 18:59:03.846667 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Nov 01 18:59:03.846667 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Nov 01 18:59:03.846667 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Nov 01 18:59:03.846667 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Nov 01 18:59:03.846667 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Nov 01 18:59:03.846667 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Nov 01 18:59:03.846667 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Nov 01 18:59:03.846667 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Nov 01 18:59:03.846667 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Nov 01 18:59:03.847747 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID a48ad90e-8fa0-4e5b-bbfc-6f966145a836 Nov 01 18:59:03.847747 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 18:59:03.847747 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 18:59:03.847747 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 18:59:03.847747 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:59:03.847747 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Nov 01 18:59:03.847747 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Nov 01 18:59:03.847747 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Nov 01 18:59:03.847747 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Nov 01 18:59:03.847747 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Nov 01 18:59:03.847747 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Nov 01 18:59:03.847747 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Nov 01 18:59:03.847747 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Nov 01 18:59:03.847747 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Nov 01 18:59:03.847747 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Nov 01 18:59:03.847747 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Nov 01 18:59:03.847747 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Nov 01 18:59:03.847747 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Nov 01 18:59:03.847747 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return self._get(image_id) Nov 01 18:59:03.849345 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Nov 01 18:59:03.849345 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Nov 01 18:59:03.849345 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Nov 01 18:59:03.849345 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Nov 01 18:59:03.849345 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Nov 01 18:59:03.849345 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Nov 01 18:59:03.849345 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Nov 01 18:59:03.849345 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Nov 01 18:59:03.849345 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Nov 01 18:59:03.849345 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Nov 01 18:59:03.849345 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image a48ad90e-8fa0-4e5b-bbfc-6f966145a836 could not be found. Nov 01 18:59:03.849345 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 18:59:03.849345 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 18:59:03.849345 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 18:59:03.849345 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:59:03.849345 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 18:59:03.849345 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 18:59:03.849345 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 01 18:59:03.849345 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 01 18:59:03.851546 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 01 18:59:03.851546 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 01 18:59:03.851546 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 01 18:59:03.851546 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 01 18:59:03.851546 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 01 18:59:03.851546 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 01 18:59:03.851546 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 69, in create Nov 01 18:59:03.851546 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Nov 01 18:59:03.851546 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Nov 01 18:59:03.851546 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Nov 01 18:59:03.851546 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Nov 01 18:59:03.851546 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 18:59:03.851546 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 18:59:03.851546 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 18:59:03.851546 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:59:03.851546 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 18:59:03.851546 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 18:59:03.851546 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 01 18:59:03.851546 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 01 18:59:03.851546 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Nov 01 18:59:03.851546 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 18:59:03.855074 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-791eb941-68ab-4361-bdf5-a81ee1845413 tempest-ImagesMetadataNegativeTestJSON-178060507 tempest-ImagesMetadataNegativeTestJSON-178060507-project] Returning 404 to user: Image not found. {{(pid=121403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 01 18:59:03.855074 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-791eb941-68ab-4361-bdf5-a81ee1845413 tempest-ImagesMetadataNegativeTestJSON-178060507 tempest-ImagesMetadataNegativeTestJSON-178060507-project] 10.222.0.13 "POST /compute/v2.1/images/a48ad90e-8fa0-4e5b-bbfc-6f966145a836/metadata" status: 404 len: 62 microversion: 2.1 time: 0.034527 Nov 01 18:59:03.855074 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 659/1363] 10.222.0.13 () {60 vars in 1281 bytes} [Tue Nov 1 18:59:03 2022] POST /compute/v2.1/images/a48ad90e-8fa0-4e5b-bbfc-6f966145a836/metadata => generated 62 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Nov 01 18:59:03.857642 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-a4a648b1-60f7-4671-a822-4378228c7c21 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:59:03.860090 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-a4a648b1-60f7-4671-a822-4378228c7c21 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] [instance: 2d525a31-b0be-44cb-8fb7-335075145f08] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:59:03.873338 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-a4a648b1-60f7-4671-a822-4378228c7c21 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:59:03.873940 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-a4a648b1-60f7-4671-a822-4378228c7c21 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:59:03.874485 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-a4a648b1-60f7-4671-a822-4378228c7c21 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:59:03.875260 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-a4a648b1-60f7-4671-a822-4378228c7c21 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:59:03.875969 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-a4a648b1-60f7-4671-a822-4378228c7c21 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:59:03.876617 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-a4a648b1-60f7-4671-a822-4378228c7c21 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:59:04.225071 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-e563b39f-80d1-4f71-9f69-2c80da59796a tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0290a6bb8bc24b8988a925327ac0381c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86941784237549838bba63ce88053b88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:59:04.241531 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-e563b39f-80d1-4f71-9f69-2c80da59796a tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] 10.222.0.13 "GET /compute/v2.1/servers/c04ee904-7b1a-4d73-b0c0-eb379c9aa683" status: 200 len: 1318 microversion: 2.1 time: 0.615476 Nov 01 18:59:04.247139 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 705/1364] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:59:03 2022] GET /compute/v2.1/servers/c04ee904-7b1a-4d73-b0c0-eb379c9aa683 => generated 1318 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:59:04.262320 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-890742ec-fa41-4247-a502-5e5cdb5d2171 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:59:04.266861 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-890742ec-fa41-4247-a502-5e5cdb5d2171 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] [instance: 9249c81d-e57b-4985-a398-8ad97526d5c7] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:59:04.283008 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-890742ec-fa41-4247-a502-5e5cdb5d2171 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:59:04.285610 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-890742ec-fa41-4247-a502-5e5cdb5d2171 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:59:04.289995 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-890742ec-fa41-4247-a502-5e5cdb5d2171 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:59:04.292634 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-890742ec-fa41-4247-a502-5e5cdb5d2171 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:59:04.293530 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-890742ec-fa41-4247-a502-5e5cdb5d2171 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:59:04.295232 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-890742ec-fa41-4247-a502-5e5cdb5d2171 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:59:04.671448 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-a4a648b1-60f7-4671-a822-4378228c7c21 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f32f5fba1976432d938e664c7714e52b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b9d4c236b944f9b2e8e502a50a8f8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:59:04.688478 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-a4a648b1-60f7-4671-a822-4378228c7c21 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] 10.222.0.13 "GET /compute/v2.1/servers/2d525a31-b0be-44cb-8fb7-335075145f08" status: 200 len: 1718 microversion: 2.1 time: 0.840059 Nov 01 18:59:04.691546 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 660/1365] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:59:03 2022] GET /compute/v2.1/servers/2d525a31-b0be-44cb-8fb7-335075145f08 => generated 1718 bytes in 844 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:59:04.709728 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-c83f45cd-3ba4-4961-8ee2-4cfdc920eb71 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:59:04.711816 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-c83f45cd-3ba4-4961-8ee2-4cfdc920eb71 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] [instance: ed4798be-a45e-46f5-8f7e-1165f6479bd1] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:59:04.725622 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-c83f45cd-3ba4-4961-8ee2-4cfdc920eb71 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:59:04.726042 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-c83f45cd-3ba4-4961-8ee2-4cfdc920eb71 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:59:04.726475 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-c83f45cd-3ba4-4961-8ee2-4cfdc920eb71 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:59:04.727196 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-c83f45cd-3ba4-4961-8ee2-4cfdc920eb71 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:59:04.727646 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-c83f45cd-3ba4-4961-8ee2-4cfdc920eb71 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:59:04.728071 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-c83f45cd-3ba4-4961-8ee2-4cfdc920eb71 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:59:04.829948 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-890742ec-fa41-4247-a502-5e5cdb5d2171 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72117f17294649d6b8bc16c66c7efab2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45d4c047d3c44324a27a27831236ab0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:59:04.837747 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-890742ec-fa41-4247-a502-5e5cdb5d2171 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] 10.222.0.13 "GET /compute/v2.1/servers/9249c81d-e57b-4985-a398-8ad97526d5c7" status: 200 len: 1470 microversion: 2.1 time: 0.589196 Nov 01 18:59:04.854350 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 706/1366] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:59:04 2022] GET /compute/v2.1/servers/9249c81d-e57b-4985-a398-8ad97526d5c7 => generated 1470 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:59:04.877602 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-88deb825-2e9d-4fd8-9201-9be19cad1dde tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:59:04.878444 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-88deb825-2e9d-4fd8-9201-9be19cad1dde tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] [instance: a7f88d19-08ee-47bf-9240-7d49afd775e2] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:59:04.887200 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-88deb825-2e9d-4fd8-9201-9be19cad1dde tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:59:04.888730 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-88deb825-2e9d-4fd8-9201-9be19cad1dde tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:59:04.889292 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-88deb825-2e9d-4fd8-9201-9be19cad1dde tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:59:04.890063 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-88deb825-2e9d-4fd8-9201-9be19cad1dde tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:59:04.890525 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-88deb825-2e9d-4fd8-9201-9be19cad1dde tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:59:04.890954 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-88deb825-2e9d-4fd8-9201-9be19cad1dde tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:59:05.014284 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-c83f45cd-3ba4-4961-8ee2-4cfdc920eb71 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a63d69c99a546f0af16329cff3ca717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a1bb191cff948e99c008b5e861ce4a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:59:05.027046 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-c83f45cd-3ba4-4961-8ee2-4cfdc920eb71 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] 10.222.0.13 "GET /compute/v2.1/servers/ed4798be-a45e-46f5-8f7e-1165f6479bd1" status: 200 len: 1521 microversion: 2.1 time: 0.333588 Nov 01 18:59:05.028192 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 661/1367] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:59:04 2022] GET /compute/v2.1/servers/ed4798be-a45e-46f5-8f7e-1165f6479bd1 => generated 1521 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:59:05.214272 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-88deb825-2e9d-4fd8-9201-9be19cad1dde tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:59:05.225290 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-88deb825-2e9d-4fd8-9201-9be19cad1dde tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:59:05.227817 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-88deb825-2e9d-4fd8-9201-9be19cad1dde tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:59:05.229526 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-88deb825-2e9d-4fd8-9201-9be19cad1dde tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] 10.222.0.13 "GET /compute/v2.1/servers/a7f88d19-08ee-47bf-9240-7d49afd775e2" status: 200 len: 1812 microversion: 2.25 time: 0.373987 Nov 01 18:59:05.230272 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 707/1368] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 18:59:04 2022] GET /compute/v2.1/servers/a7f88d19-08ee-47bf-9240-7d49afd775e2 => generated 1812 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 18:59:05.270074 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-c9ca6e66-acb0-49f1-a0e1-d93c5ec692e5 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:59:05.271093 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-c9ca6e66-acb0-49f1-a0e1-d93c5ec692e5 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] [instance: c04ee904-7b1a-4d73-b0c0-eb379c9aa683] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:59:05.279396 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-c9ca6e66-acb0-49f1-a0e1-d93c5ec692e5 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:59:05.280992 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-c9ca6e66-acb0-49f1-a0e1-d93c5ec692e5 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:59:05.281616 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-c9ca6e66-acb0-49f1-a0e1-d93c5ec692e5 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:59:05.282495 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-c9ca6e66-acb0-49f1-a0e1-d93c5ec692e5 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:59:05.283109 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-c9ca6e66-acb0-49f1-a0e1-d93c5ec692e5 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:59:05.284547 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-c9ca6e66-acb0-49f1-a0e1-d93c5ec692e5 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:59:05.702995 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-c9ca6e66-acb0-49f1-a0e1-d93c5ec692e5 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0290a6bb8bc24b8988a925327ac0381c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86941784237549838bba63ce88053b88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:59:05.716495 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-8890366f-7012-4692-8563-ec417a0c58cf tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:59:05.717291 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-8890366f-7012-4692-8563-ec417a0c58cf tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] [instance: 2d525a31-b0be-44cb-8fb7-335075145f08] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:59:05.719655 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-c9ca6e66-acb0-49f1-a0e1-d93c5ec692e5 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] 10.222.0.13 "GET /compute/v2.1/servers/c04ee904-7b1a-4d73-b0c0-eb379c9aa683" status: 200 len: 1318 microversion: 2.1 time: 0.451352 Nov 01 18:59:05.720440 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 662/1369] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:59:05 2022] GET /compute/v2.1/servers/c04ee904-7b1a-4d73-b0c0-eb379c9aa683 => generated 1318 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:59:05.750744 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-8890366f-7012-4692-8563-ec417a0c58cf tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:59:05.752144 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-8890366f-7012-4692-8563-ec417a0c58cf tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:59:05.756661 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-8890366f-7012-4692-8563-ec417a0c58cf tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:59:05.757577 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-8890366f-7012-4692-8563-ec417a0c58cf tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:59:05.758072 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-8890366f-7012-4692-8563-ec417a0c58cf tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:59:05.758509 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-8890366f-7012-4692-8563-ec417a0c58cf tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:59:05.869992 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-f327817f-50dd-46f0-9360-b746a90f88e7 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:59:05.870646 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-f327817f-50dd-46f0-9360-b746a90f88e7 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] [instance: 9249c81d-e57b-4985-a398-8ad97526d5c7] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:59:05.885301 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f327817f-50dd-46f0-9360-b746a90f88e7 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:59:05.885794 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f327817f-50dd-46f0-9360-b746a90f88e7 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:59:05.886237 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f327817f-50dd-46f0-9360-b746a90f88e7 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:59:05.887199 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f327817f-50dd-46f0-9360-b746a90f88e7 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:59:05.887653 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f327817f-50dd-46f0-9360-b746a90f88e7 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:59:05.888086 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f327817f-50dd-46f0-9360-b746a90f88e7 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:59:05.979771 n-d-863052-2 devstack@n-api.service[121402]: DEBUG dbcounter [-] [121402] Writing DB stats nova_cell0:SELECT=26 {{(pid=121402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 18:59:06.240072 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-f327817f-50dd-46f0-9360-b746a90f88e7 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72117f17294649d6b8bc16c66c7efab2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45d4c047d3c44324a27a27831236ab0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:59:06.263149 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-f327817f-50dd-46f0-9360-b746a90f88e7 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] 10.222.0.13 "GET /compute/v2.1/servers/9249c81d-e57b-4985-a398-8ad97526d5c7" status: 200 len: 1470 microversion: 2.1 time: 0.397211 Nov 01 18:59:06.264038 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 663/1370] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:59:05 2022] GET /compute/v2.1/servers/9249c81d-e57b-4985-a398-8ad97526d5c7 => generated 1470 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:59:06.279995 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-8f0b8257-ef3a-4359-a896-a01a774ccf3a tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:59:06.281494 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-8f0b8257-ef3a-4359-a896-a01a774ccf3a tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] [instance: ed4798be-a45e-46f5-8f7e-1165f6479bd1] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:59:06.290561 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-8f0b8257-ef3a-4359-a896-a01a774ccf3a tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:59:06.291440 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-8f0b8257-ef3a-4359-a896-a01a774ccf3a tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:59:06.292487 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-8f0b8257-ef3a-4359-a896-a01a774ccf3a tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:59:06.293451 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-8f0b8257-ef3a-4359-a896-a01a774ccf3a tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:59:06.294169 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-8f0b8257-ef3a-4359-a896-a01a774ccf3a tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:59:06.294807 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-8f0b8257-ef3a-4359-a896-a01a774ccf3a tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:59:06.368814 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-8890366f-7012-4692-8563-ec417a0c58cf tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f32f5fba1976432d938e664c7714e52b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b9d4c236b944f9b2e8e502a50a8f8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:59:06.387944 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-8890366f-7012-4692-8563-ec417a0c58cf tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] 10.222.0.13 "GET /compute/v2.1/servers/2d525a31-b0be-44cb-8fb7-335075145f08" status: 200 len: 1718 microversion: 2.1 time: 0.676853 Nov 01 18:59:06.404492 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 708/1371] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:59:05 2022] GET /compute/v2.1/servers/2d525a31-b0be-44cb-8fb7-335075145f08 => generated 1718 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:59:06.434150 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-f8a3f2f5-ad98-4851-8260-ac43d05a637f tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:59:06.450789 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-f8a3f2f5-ad98-4851-8260-ac43d05a637f tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] [instance: a7f88d19-08ee-47bf-9240-7d49afd775e2] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:59:06.472688 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f8a3f2f5-ad98-4851-8260-ac43d05a637f tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:59:06.473775 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f8a3f2f5-ad98-4851-8260-ac43d05a637f tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:59:06.474394 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f8a3f2f5-ad98-4851-8260-ac43d05a637f tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:59:06.475255 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f8a3f2f5-ad98-4851-8260-ac43d05a637f tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:59:06.475861 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f8a3f2f5-ad98-4851-8260-ac43d05a637f tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:59:06.476435 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f8a3f2f5-ad98-4851-8260-ac43d05a637f tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:59:07.161851 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-f8a3f2f5-ad98-4851-8260-ac43d05a637f tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:59:07.172862 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-f8a3f2f5-ad98-4851-8260-ac43d05a637f tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:59:07.179266 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-f8a3f2f5-ad98-4851-8260-ac43d05a637f tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:59:07.181981 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-f8a3f2f5-ad98-4851-8260-ac43d05a637f tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] 10.222.0.13 "GET /compute/v2.1/servers/a7f88d19-08ee-47bf-9240-7d49afd775e2" status: 200 len: 1812 microversion: 2.25 time: 0.775423 Nov 01 18:59:07.205709 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 709/1372] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 18:59:06 2022] GET /compute/v2.1/servers/a7f88d19-08ee-47bf-9240-7d49afd775e2 => generated 1812 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 18:59:07.210972 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-fd5feeeb-957b-4ba0-aa32-7514d5237044 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:59:07.224712 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-8f0b8257-ef3a-4359-a896-a01a774ccf3a tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a63d69c99a546f0af16329cff3ca717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a1bb191cff948e99c008b5e861ce4a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:59:07.231241 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-fd5feeeb-957b-4ba0-aa32-7514d5237044 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] [instance: c04ee904-7b1a-4d73-b0c0-eb379c9aa683] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:59:07.237385 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-8f0b8257-ef3a-4359-a896-a01a774ccf3a tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] 10.222.0.13 "GET /compute/v2.1/servers/ed4798be-a45e-46f5-8f7e-1165f6479bd1" status: 200 len: 1521 microversion: 2.1 time: 0.971754 Nov 01 18:59:07.239155 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 664/1373] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:59:06 2022] GET /compute/v2.1/servers/ed4798be-a45e-46f5-8f7e-1165f6479bd1 => generated 1521 bytes in 974 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:59:07.265142 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-fd5feeeb-957b-4ba0-aa32-7514d5237044 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:59:07.265636 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-fd5feeeb-957b-4ba0-aa32-7514d5237044 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:59:07.266065 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-fd5feeeb-957b-4ba0-aa32-7514d5237044 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:59:07.269493 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-fd5feeeb-957b-4ba0-aa32-7514d5237044 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:59:07.271435 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-fd5feeeb-957b-4ba0-aa32-7514d5237044 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:59:07.272133 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-fd5feeeb-957b-4ba0-aa32-7514d5237044 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:59:07.291249 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-a2eba226-951d-4f98-94c7-8a1f4771be35 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:59:07.292690 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-a2eba226-951d-4f98-94c7-8a1f4771be35 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] [instance: 9249c81d-e57b-4985-a398-8ad97526d5c7] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:59:07.306363 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-a2eba226-951d-4f98-94c7-8a1f4771be35 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:59:07.308977 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-a2eba226-951d-4f98-94c7-8a1f4771be35 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:59:07.311170 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-a2eba226-951d-4f98-94c7-8a1f4771be35 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:59:07.313410 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-a2eba226-951d-4f98-94c7-8a1f4771be35 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:59:07.315522 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-a2eba226-951d-4f98-94c7-8a1f4771be35 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:59:07.318019 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-a2eba226-951d-4f98-94c7-8a1f4771be35 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:59:07.978054 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-a2eba226-951d-4f98-94c7-8a1f4771be35 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72117f17294649d6b8bc16c66c7efab2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45d4c047d3c44324a27a27831236ab0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:59:07.992325 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-a2eba226-951d-4f98-94c7-8a1f4771be35 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] 10.222.0.13 "GET /compute/v2.1/servers/9249c81d-e57b-4985-a398-8ad97526d5c7" status: 200 len: 1536 microversion: 2.1 time: 0.705302 Nov 01 18:59:07.995972 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 665/1374] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:59:07 2022] GET /compute/v2.1/servers/9249c81d-e57b-4985-a398-8ad97526d5c7 => generated 1536 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 18:59:08.007950 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-2bf3c007-9779-445e-9e33-c1d0c1314fb1 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:59:08.009750 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-2bf3c007-9779-445e-9e33-c1d0c1314fb1 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] [instance: 2d525a31-b0be-44cb-8fb7-335075145f08] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:59:08.026886 n-d-863052-2 devstack@n-api.service[121403]: DEBUG dbcounter [-] [121403] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=2,nova_api:UPDATE=1 {{(pid=121403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 18:59:08.028959 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-2bf3c007-9779-445e-9e33-c1d0c1314fb1 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:59:08.031705 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-2bf3c007-9779-445e-9e33-c1d0c1314fb1 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:59:08.035160 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-2bf3c007-9779-445e-9e33-c1d0c1314fb1 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:59:08.039002 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-2bf3c007-9779-445e-9e33-c1d0c1314fb1 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:59:08.040368 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-2bf3c007-9779-445e-9e33-c1d0c1314fb1 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:59:08.041416 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-2bf3c007-9779-445e-9e33-c1d0c1314fb1 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:59:08.495492 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-fd5feeeb-957b-4ba0-aa32-7514d5237044 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0290a6bb8bc24b8988a925327ac0381c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86941784237549838bba63ce88053b88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:59:08.506394 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-fd5feeeb-957b-4ba0-aa32-7514d5237044 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] 10.222.0.13 "GET /compute/v2.1/servers/c04ee904-7b1a-4d73-b0c0-eb379c9aa683" status: 200 len: 1318 microversion: 2.1 time: 1.297096 Nov 01 18:59:08.507328 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 710/1375] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:59:07 2022] GET /compute/v2.1/servers/c04ee904-7b1a-4d73-b0c0-eb379c9aa683 => generated 1318 bytes in 1301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:59:08.609341 n-d-863052-2 devstack@n-api.service[121402]: DEBUG dbcounter [-] [121402] Writing DB stats nova_cell0:SELECT=9 {{(pid=121402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 18:59:08.676869 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-2bf3c007-9779-445e-9e33-c1d0c1314fb1 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f32f5fba1976432d938e664c7714e52b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b9d4c236b944f9b2e8e502a50a8f8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:59:08.688316 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-2bf3c007-9779-445e-9e33-c1d0c1314fb1 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] 10.222.0.13 "GET /compute/v2.1/servers/2d525a31-b0be-44cb-8fb7-335075145f08" status: 200 len: 1718 microversion: 2.1 time: 0.690876 Nov 01 18:59:08.689013 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 666/1376] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:59:07 2022] GET /compute/v2.1/servers/2d525a31-b0be-44cb-8fb7-335075145f08 => generated 1718 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:59:08.725564 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [req-a6405b92-83be-432f-8953-653a1c193685 req-2c287bfb-a432-4ad2-9e99-724c14873aa9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c04ee904-7b1a-4d73-b0c0-eb379c9aa683", "name": "network-vif-plugged", "status": "completed", "tag": "34fac85b-afb5-42bd-94cb-4c0ee1272b6e"}]} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 18:59:08.756526 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-a6405b92-83be-432f-8953-653a1c193685 req-2c287bfb-a432-4ad2-9e99-724c14873aa9 service nova] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:59:08.757038 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-a6405b92-83be-432f-8953-653a1c193685 req-2c287bfb-a432-4ad2-9e99-724c14873aa9 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:59:08.759390 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-a6405b92-83be-432f-8953-653a1c193685 req-2c287bfb-a432-4ad2-9e99-724c14873aa9 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:59:08.789272 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.compute.server_external_events [req-a6405b92-83be-432f-8953-653a1c193685 req-2c287bfb-a432-4ad2-9e99-724c14873aa9 service nova] Creating event network-vif-plugged:34fac85b-afb5-42bd-94cb-4c0ee1272b6e for instance c04ee904-7b1a-4d73-b0c0-eb379c9aa683 on n-h1-863052-2 Nov 01 18:59:08.806153 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [req-a6405b92-83be-432f-8953-653a1c193685 req-2c287bfb-a432-4ad2-9e99-724c14873aa9 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095999 Nov 01 18:59:08.809236 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 667/1377] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Nov 1 18:59:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 18:59:08.825159 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-1ec2b257-1be3-43b2-839e-5f5c801b8612 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:59:08.835864 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-1ec2b257-1be3-43b2-839e-5f5c801b8612 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] [instance: a7f88d19-08ee-47bf-9240-7d49afd775e2] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:59:08.850894 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-1ec2b257-1be3-43b2-839e-5f5c801b8612 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:59:08.853446 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-1ec2b257-1be3-43b2-839e-5f5c801b8612 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:59:08.854346 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-1ec2b257-1be3-43b2-839e-5f5c801b8612 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:59:08.855137 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-1ec2b257-1be3-43b2-839e-5f5c801b8612 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:59:08.855995 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-1ec2b257-1be3-43b2-839e-5f5c801b8612 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:59:08.856678 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-1ec2b257-1be3-43b2-839e-5f5c801b8612 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:59:08.860214 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-8436684b-2c5b-4cd0-ab0c-abde3b14a3fb tempest-ImagesDeleteNegativeTestJSON-896531788 tempest-ImagesDeleteNegativeTestJSON-896531788-project] 10.222.0.13 "DELETE /compute/v2.1/images/" status: 404 len: 112 microversion: - time: 0.351828 Nov 01 18:59:08.864736 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 711/1378] 10.222.0.13 () {58 vars in 1128 bytes} [Tue Nov 1 18:59:08 2022] DELETE /compute/v2.1/images/ => generated 112 bytes in 353 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Nov 01 18:59:08.874582 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-0652edff-6e0c-4c13-ad03-dbf54a24cb4c tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:59:08.876184 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-0652edff-6e0c-4c13-ad03-dbf54a24cb4c tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] [instance: ed4798be-a45e-46f5-8f7e-1165f6479bd1] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:59:08.904812 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-0652edff-6e0c-4c13-ad03-dbf54a24cb4c tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:59:08.906548 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-0652edff-6e0c-4c13-ad03-dbf54a24cb4c tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:59:08.908533 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-0652edff-6e0c-4c13-ad03-dbf54a24cb4c tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:59:08.910929 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-0652edff-6e0c-4c13-ad03-dbf54a24cb4c tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:59:08.914041 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-0652edff-6e0c-4c13-ad03-dbf54a24cb4c tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:59:08.915947 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-0652edff-6e0c-4c13-ad03-dbf54a24cb4c tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:59:09.523288 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-0652edff-6e0c-4c13-ad03-dbf54a24cb4c tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a63d69c99a546f0af16329cff3ca717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a1bb191cff948e99c008b5e861ce4a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:59:09.537291 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-0652edff-6e0c-4c13-ad03-dbf54a24cb4c tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] 10.222.0.13 "GET /compute/v2.1/servers/ed4798be-a45e-46f5-8f7e-1165f6479bd1" status: 200 len: 1521 microversion: 2.1 time: 0.674357 Nov 01 18:59:09.540033 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 712/1379] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:59:08 2022] GET /compute/v2.1/servers/ed4798be-a45e-46f5-8f7e-1165f6479bd1 => generated 1521 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:59:09.586488 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [req-58672c8f-12d3-4a0f-ad3e-e750e93fd8ab req-9fee3d26-f4df-4271-8e26-df38504a3b9a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9249c81d-e57b-4985-a398-8ad97526d5c7", "name": "network-vif-unplugged", "status": "completed", "tag": "b471dd14-4ce9-4781-a7a0-1bd2ae3a7e55"}]} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 18:59:09.643181 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-58672c8f-12d3-4a0f-ad3e-e750e93fd8ab req-9fee3d26-f4df-4271-8e26-df38504a3b9a service nova] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:59:09.644688 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-58672c8f-12d3-4a0f-ad3e-e750e93fd8ab req-9fee3d26-f4df-4271-8e26-df38504a3b9a service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:59:09.645372 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-58672c8f-12d3-4a0f-ad3e-e750e93fd8ab req-9fee3d26-f4df-4271-8e26-df38504a3b9a service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:59:09.654354 n-d-863052-2 devstack@n-api.service[121402]: DEBUG dbcounter [-] [121402] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 18:59:09.673705 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-1ec2b257-1be3-43b2-839e-5f5c801b8612 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:59:09.685813 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.compute.server_external_events [req-58672c8f-12d3-4a0f-ad3e-e750e93fd8ab req-9fee3d26-f4df-4271-8e26-df38504a3b9a service nova] Creating event network-vif-unplugged:b471dd14-4ce9-4781-a7a0-1bd2ae3a7e55 for instance 9249c81d-e57b-4985-a398-8ad97526d5c7 on n-h2-863052-2 Nov 01 18:59:09.696110 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-1ec2b257-1be3-43b2-839e-5f5c801b8612 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:59:09.703113 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-1ec2b257-1be3-43b2-839e-5f5c801b8612 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:59:09.708417 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-1ec2b257-1be3-43b2-839e-5f5c801b8612 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] 10.222.0.13 "GET /compute/v2.1/servers/a7f88d19-08ee-47bf-9240-7d49afd775e2" status: 200 len: 1812 microversion: 2.25 time: 0.891514 Nov 01 18:59:09.709088 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [req-58672c8f-12d3-4a0f-ad3e-e750e93fd8ab req-9fee3d26-f4df-4271-8e26-df38504a3b9a service nova] Instance 9249c81d-e57b-4985-a398-8ad97526d5c7 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-863052-2', 'n-h1-863052-2'} {{(pid=121402) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Nov 01 18:59:09.715947 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 668/1380] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 18:59:08 2022] GET /compute/v2.1/servers/a7f88d19-08ee-47bf-9240-7d49afd775e2 => generated 1812 bytes in 902 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 18:59:09.725346 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-3eec3419-b8ad-4d92-9e0b-9fd672219bd3 tempest-ImagesDeleteNegativeTestJSON-896531788 tempest-ImagesDeleteNegativeTestJSON-896531788-project] Calling method '.version_select at 0x7f0ae2161310>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:59:09.742920 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [req-58672c8f-12d3-4a0f-ad3e-e750e93fd8ab req-9fee3d26-f4df-4271-8e26-df38504a3b9a service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.196037 Nov 01 18:59:09.746518 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 713/1381] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Nov 1 18:59:09 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 18:59:09.754902 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-53258805-c591-4cbd-8de9-6bf4a3750e4b tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:59:09.759395 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-53258805-c591-4cbd-8de9-6bf4a3750e4b tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] [instance: 9249c81d-e57b-4985-a398-8ad97526d5c7] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:59:09.775943 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-53258805-c591-4cbd-8de9-6bf4a3750e4b tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:59:09.776462 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-53258805-c591-4cbd-8de9-6bf4a3750e4b tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:59:09.777134 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-53258805-c591-4cbd-8de9-6bf4a3750e4b tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:59:09.778011 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-53258805-c591-4cbd-8de9-6bf4a3750e4b tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:59:09.778368 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-53258805-c591-4cbd-8de9-6bf4a3750e4b tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:59:09.778798 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-53258805-c591-4cbd-8de9-6bf4a3750e4b tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:59:09.782859 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.wsgi [None req-3eec3419-b8ad-4d92-9e0b-9fd672219bd3 tempest-ImagesDeleteNegativeTestJSON-896531788 tempest-ImagesDeleteNegativeTestJSON-896531788-project] HTTP exception thrown: Image not found. Nov 01 18:59:09.784975 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-3eec3419-b8ad-4d92-9e0b-9fd672219bd3 tempest-ImagesDeleteNegativeTestJSON-896531788 tempest-ImagesDeleteNegativeTestJSON-896531788-project] Request method failure captured: Nov 01 18:59:09.784975 n-d-863052-2 devstack@n-api.service[121403]: request: DELETE /compute/v2.1/images/-1 HTTP/1.1 Nov 01 18:59:09.784975 n-d-863052-2 devstack@n-api.service[121403]: Accept: application/json Nov 01 18:59:09.784975 n-d-863052-2 devstack@n-api.service[121403]: Accept-Encoding: identity Nov 01 18:59:09.784975 n-d-863052-2 devstack@n-api.service[121403]: Connection: close Nov 01 18:59:09.784975 n-d-863052-2 devstack@n-api.service[121403]: Content-Length: 0 Nov 01 18:59:09.784975 n-d-863052-2 devstack@n-api.service[121403]: Content-Type: application/json Nov 01 18:59:09.784975 n-d-863052-2 devstack@n-api.service[121403]: Host: 10.222.0.13 Nov 01 18:59:09.784975 n-d-863052-2 devstack@n-api.service[121403]: Openstack-System-Scope: None Nov 01 18:59:09.784975 n-d-863052-2 devstack@n-api.service[121403]: User-Agent: python-urllib3/1.26.12 Nov 01 18:59:09.784975 n-d-863052-2 devstack@n-api.service[121403]: X-Auth-Token: gAAAAABjYWx7vGVafxvjHTRZzwYiylQTUXiWcc6d3A4DEjUeVYFTKNhgu-k4q79NhoUFeKn5QCBn2JVBgOPsjV-B1YfZ27QZV9Gw77YZvO03MILDOy5HjmI-uus0URNt-H3ytRv52sTBk-IYb_UFRbYJp9-0pxOx-dYdouYUEIyfiVUyH4BFI98 Nov 01 18:59:09.784975 n-d-863052-2 devstack@n-api.service[121403]: X-Domain-Id: None Nov 01 18:59:09.784975 n-d-863052-2 devstack@n-api.service[121403]: X-Domain-Name: None Nov 01 18:59:09.784975 n-d-863052-2 devstack@n-api.service[121403]: X-Identity-Status: Confirmed Nov 01 18:59:09.784975 n-d-863052-2 devstack@n-api.service[121403]: X-Is-Admin-Project: True Nov 01 18:59:09.784975 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Domain-Id: default Nov 01 18:59:09.784975 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Domain-Name: Default Nov 01 18:59:09.784975 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Id: 408bb70abfa24785b3a0ae5c4102b7d3 Nov 01 18:59:09.784975 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-896531788 Nov 01 18:59:09.784975 n-d-863052-2 devstack@n-api.service[121403]: X-Role: member,reader Nov 01 18:59:09.784975 n-d-863052-2 devstack@n-api.service[121403]: X-Roles: member,reader Nov 01 18:59:09.786388 n-d-863052-2 devstack@n-api.service[121403]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/408bb70abfa24785b3a0ae5c4102b7d3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/408bb70abfa24785b3a0ae5c4102b7d3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_408bb70abfa24785b3a0ae5c4102b7d3", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/408bb70abfa24785b3a0ae5c4102b7d3"}]}] Nov 01 18:59:09.786388 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-896531788 Nov 01 18:59:09.786388 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant-Id: 408bb70abfa24785b3a0ae5c4102b7d3 Nov 01 18:59:09.786388 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-896531788 Nov 01 18:59:09.786388 n-d-863052-2 devstack@n-api.service[121403]: X-User: tempest-ImagesDeleteNegativeTestJSON-896531788-project Nov 01 18:59:09.786388 n-d-863052-2 devstack@n-api.service[121403]: X-User-Domain-Id: default Nov 01 18:59:09.786388 n-d-863052-2 devstack@n-api.service[121403]: X-User-Domain-Name: Default Nov 01 18:59:09.786388 n-d-863052-2 devstack@n-api.service[121403]: X-User-Id: 523bf64c1823446884b018d856fea3fe Nov 01 18:59:09.786388 n-d-863052-2 devstack@n-api.service[121403]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-896531788-project Nov 01 18:59:09.786388 n-d-863052-2 devstack@n-api.service[121403]: method: Nov 01 18:59:09.786388 n-d-863052-2 devstack@n-api.service[121403]: exception: Image not found. Nov 01 18:59:09.786388 n-d-863052-2 devstack@n-api.service[121403]: action_args: {'id': '-1'} Nov 01 18:59:09.786388 n-d-863052-2 devstack@n-api.service[121403]: {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 01 18:59:09.786388 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:59:09.793008 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Nov 01 18:59:09.793008 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Nov 01 18:59:09.793008 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Nov 01 18:59:09.793008 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Nov 01 18:59:09.793008 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Nov 01 18:59:09.793008 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Nov 01 18:59:09.793008 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Nov 01 18:59:09.793008 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Nov 01 18:59:09.793008 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Nov 01 18:59:09.793008 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Nov 01 18:59:09.793008 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Nov 01 18:59:09.793008 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Nov 01 18:59:09.793008 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Nov 01 18:59:09.793008 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Nov 01 18:59:09.793008 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image -1 to delete Nov 01 18:59:09.793008 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 18:59:09.793008 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 18:59:09.793008 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 18:59:09.793008 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:59:09.794176 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Nov 01 18:59:09.794176 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Nov 01 18:59:09.794176 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Nov 01 18:59:09.794176 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Nov 01 18:59:09.794176 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Nov 01 18:59:09.794176 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Nov 01 18:59:09.794176 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image -1 could not be found. Nov 01 18:59:09.794176 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 18:59:09.794176 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 18:59:09.794176 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 18:59:09.794176 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:59:09.794176 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 18:59:09.794176 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 18:59:09.794176 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 01 18:59:09.794176 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 01 18:59:09.794176 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 01 18:59:09.794176 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 01 18:59:09.794176 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 01 18:59:09.794176 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 01 18:59:09.794176 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Nov 01 18:59:09.795386 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Nov 01 18:59:09.795386 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Nov 01 18:59:09.795386 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 18:59:09.795386 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 18:59:09.795386 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 18:59:09.795386 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:59:09.795386 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 18:59:09.795386 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 18:59:09.795386 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 01 18:59:09.795386 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 01 18:59:09.795386 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Nov 01 18:59:09.795386 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 18:59:09.795386 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-3eec3419-b8ad-4d92-9e0b-9fd672219bd3 tempest-ImagesDeleteNegativeTestJSON-896531788 tempest-ImagesDeleteNegativeTestJSON-896531788-project] Returning 404 to user: Image not found. {{(pid=121403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 01 18:59:09.795386 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-3eec3419-b8ad-4d92-9e0b-9fd672219bd3 tempest-ImagesDeleteNegativeTestJSON-896531788 tempest-ImagesDeleteNegativeTestJSON-896531788-project] 10.222.0.13 "DELETE /compute/v2.1/images/-1" status: 404 len: 62 microversion: 2.1 time: 0.069414 Nov 01 18:59:09.795386 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 669/1382] 10.222.0.13 () {58 vars in 1134 bytes} [Tue Nov 1 18:59:09 2022] DELETE /compute/v2.1/images/-1 => generated 62 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 01 18:59:09.796348 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-acf4e9ad-7255-4315-ab62-87b6ce6ae7c9 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:59:09.796348 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-acf4e9ad-7255-4315-ab62-87b6ce6ae7c9 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] [instance: c04ee904-7b1a-4d73-b0c0-eb379c9aa683] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:59:09.820708 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-acf4e9ad-7255-4315-ab62-87b6ce6ae7c9 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:59:09.822070 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-acf4e9ad-7255-4315-ab62-87b6ce6ae7c9 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:59:09.822587 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-acf4e9ad-7255-4315-ab62-87b6ce6ae7c9 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:59:09.826701 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-acf4e9ad-7255-4315-ab62-87b6ce6ae7c9 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:59:09.827730 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-acf4e9ad-7255-4315-ab62-87b6ce6ae7c9 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:59:09.828284 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-acf4e9ad-7255-4315-ab62-87b6ce6ae7c9 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:59:10.248127 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-acf4e9ad-7255-4315-ab62-87b6ce6ae7c9 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0290a6bb8bc24b8988a925327ac0381c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86941784237549838bba63ce88053b88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:59:10.257645 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-acf4e9ad-7255-4315-ab62-87b6ce6ae7c9 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] 10.222.0.13 "GET /compute/v2.1/servers/c04ee904-7b1a-4d73-b0c0-eb379c9aa683" status: 200 len: 1318 microversion: 2.1 time: 0.469344 Nov 01 18:59:10.258998 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 670/1383] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:59:09 2022] GET /compute/v2.1/servers/c04ee904-7b1a-4d73-b0c0-eb379c9aa683 => generated 1318 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:59:10.265690 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-97080839-e1d0-4c23-b302-9e87dd28cdbc tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:59:10.266485 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-97080839-e1d0-4c23-b302-9e87dd28cdbc tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] [instance: 2d525a31-b0be-44cb-8fb7-335075145f08] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:59:10.277196 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-97080839-e1d0-4c23-b302-9e87dd28cdbc tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:59:10.278058 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-97080839-e1d0-4c23-b302-9e87dd28cdbc tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:59:10.278725 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-97080839-e1d0-4c23-b302-9e87dd28cdbc tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:59:10.279853 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-97080839-e1d0-4c23-b302-9e87dd28cdbc tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:59:10.280621 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-97080839-e1d0-4c23-b302-9e87dd28cdbc tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:59:10.281208 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-97080839-e1d0-4c23-b302-9e87dd28cdbc tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:59:10.823036 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-53258805-c591-4cbd-8de9-6bf4a3750e4b tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72117f17294649d6b8bc16c66c7efab2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45d4c047d3c44324a27a27831236ab0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:59:10.832877 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-53258805-c591-4cbd-8de9-6bf4a3750e4b tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] 10.222.0.13 "GET /compute/v2.1/servers/9249c81d-e57b-4985-a398-8ad97526d5c7" status: 200 len: 1536 microversion: 2.1 time: 1.084825 Nov 01 18:59:10.849166 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 714/1384] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:59:09 2022] GET /compute/v2.1/servers/9249c81d-e57b-4985-a398-8ad97526d5c7 => generated 1536 bytes in 1102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:59:10.863953 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-251b58e0-c91f-413e-80ac-1bfecbea442f tempest-ImagesDeleteNegativeTestJSON-896531788 tempest-ImagesDeleteNegativeTestJSON-896531788-project] Calling method '.version_select at 0x7f0ae2b725e0>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:59:10.904918 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.wsgi [None req-251b58e0-c91f-413e-80ac-1bfecbea442f tempest-ImagesDeleteNegativeTestJSON-896531788 tempest-ImagesDeleteNegativeTestJSON-896531788-project] HTTP exception thrown: Image not found. Nov 01 18:59:10.907573 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-251b58e0-c91f-413e-80ac-1bfecbea442f tempest-ImagesDeleteNegativeTestJSON-896531788 tempest-ImagesDeleteNegativeTestJSON-896531788-project] Request method failure captured: Nov 01 18:59:10.907573 n-d-863052-2 devstack@n-api.service[121402]: request: DELETE /compute/v2.1/images/10fe0d7e-49fc-4210-9597-dd8ccf61f16j HTTP/1.1 Nov 01 18:59:10.907573 n-d-863052-2 devstack@n-api.service[121402]: Accept: application/json Nov 01 18:59:10.907573 n-d-863052-2 devstack@n-api.service[121402]: Accept-Encoding: identity Nov 01 18:59:10.907573 n-d-863052-2 devstack@n-api.service[121402]: Connection: close Nov 01 18:59:10.907573 n-d-863052-2 devstack@n-api.service[121402]: Content-Length: 0 Nov 01 18:59:10.907573 n-d-863052-2 devstack@n-api.service[121402]: Content-Type: application/json Nov 01 18:59:10.907573 n-d-863052-2 devstack@n-api.service[121402]: Host: 10.222.0.13 Nov 01 18:59:10.907573 n-d-863052-2 devstack@n-api.service[121402]: Openstack-System-Scope: None Nov 01 18:59:10.907573 n-d-863052-2 devstack@n-api.service[121402]: User-Agent: python-urllib3/1.26.12 Nov 01 18:59:10.907573 n-d-863052-2 devstack@n-api.service[121402]: X-Auth-Token: gAAAAABjYWx7vGVafxvjHTRZzwYiylQTUXiWcc6d3A4DEjUeVYFTKNhgu-k4q79NhoUFeKn5QCBn2JVBgOPsjV-B1YfZ27QZV9Gw77YZvO03MILDOy5HjmI-uus0URNt-H3ytRv52sTBk-IYb_UFRbYJp9-0pxOx-dYdouYUEIyfiVUyH4BFI98 Nov 01 18:59:10.907573 n-d-863052-2 devstack@n-api.service[121402]: X-Domain-Id: None Nov 01 18:59:10.907573 n-d-863052-2 devstack@n-api.service[121402]: X-Domain-Name: None Nov 01 18:59:10.907573 n-d-863052-2 devstack@n-api.service[121402]: X-Identity-Status: Confirmed Nov 01 18:59:10.907573 n-d-863052-2 devstack@n-api.service[121402]: X-Is-Admin-Project: True Nov 01 18:59:10.907573 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Domain-Id: default Nov 01 18:59:10.907573 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Domain-Name: Default Nov 01 18:59:10.907573 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Id: 408bb70abfa24785b3a0ae5c4102b7d3 Nov 01 18:59:10.907573 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-896531788 Nov 01 18:59:10.907573 n-d-863052-2 devstack@n-api.service[121402]: X-Role: member,reader Nov 01 18:59:10.907573 n-d-863052-2 devstack@n-api.service[121402]: X-Roles: member,reader Nov 01 18:59:10.909169 n-d-863052-2 devstack@n-api.service[121402]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/408bb70abfa24785b3a0ae5c4102b7d3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/408bb70abfa24785b3a0ae5c4102b7d3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_408bb70abfa24785b3a0ae5c4102b7d3", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/408bb70abfa24785b3a0ae5c4102b7d3"}]}] Nov 01 18:59:10.909169 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-896531788 Nov 01 18:59:10.909169 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant-Id: 408bb70abfa24785b3a0ae5c4102b7d3 Nov 01 18:59:10.909169 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-896531788 Nov 01 18:59:10.909169 n-d-863052-2 devstack@n-api.service[121402]: X-User: tempest-ImagesDeleteNegativeTestJSON-896531788-project Nov 01 18:59:10.909169 n-d-863052-2 devstack@n-api.service[121402]: X-User-Domain-Id: default Nov 01 18:59:10.909169 n-d-863052-2 devstack@n-api.service[121402]: X-User-Domain-Name: Default Nov 01 18:59:10.909169 n-d-863052-2 devstack@n-api.service[121402]: X-User-Id: 523bf64c1823446884b018d856fea3fe Nov 01 18:59:10.909169 n-d-863052-2 devstack@n-api.service[121402]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-896531788-project Nov 01 18:59:10.909169 n-d-863052-2 devstack@n-api.service[121402]: method: Nov 01 18:59:10.909169 n-d-863052-2 devstack@n-api.service[121402]: exception: Image not found. Nov 01 18:59:10.909169 n-d-863052-2 devstack@n-api.service[121402]: action_args: {'id': '10fe0d7e-49fc-4210-9597-dd8ccf61f16j'} Nov 01 18:59:10.909169 n-d-863052-2 devstack@n-api.service[121402]: {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 01 18:59:10.910122 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:59:10.910122 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Nov 01 18:59:10.910122 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Nov 01 18:59:10.910122 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Nov 01 18:59:10.910122 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Nov 01 18:59:10.910122 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Nov 01 18:59:10.910122 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Nov 01 18:59:10.910122 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Nov 01 18:59:10.910122 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Nov 01 18:59:10.910122 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Nov 01 18:59:10.910122 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Nov 01 18:59:10.910122 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Nov 01 18:59:10.910122 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Nov 01 18:59:10.910122 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Nov 01 18:59:10.910122 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Nov 01 18:59:10.910122 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 10fe0d7e-49fc-4210-9597-dd8ccf61f16j to delete Nov 01 18:59:10.910122 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 18:59:10.910122 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 18:59:10.910122 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 18:59:10.911495 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:59:10.911495 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Nov 01 18:59:10.911495 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Nov 01 18:59:10.911495 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Nov 01 18:59:10.911495 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Nov 01 18:59:10.911495 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Nov 01 18:59:10.911495 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Nov 01 18:59:10.911495 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 10fe0d7e-49fc-4210-9597-dd8ccf61f16j could not be found. Nov 01 18:59:10.911495 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 18:59:10.911495 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 18:59:10.911495 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 18:59:10.911495 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:59:10.911495 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 18:59:10.911495 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 18:59:10.911495 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 01 18:59:10.911495 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 01 18:59:10.911495 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 01 18:59:10.911495 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 01 18:59:10.911495 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 01 18:59:10.911495 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 01 18:59:10.912964 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Nov 01 18:59:10.912964 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Nov 01 18:59:10.912964 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Nov 01 18:59:10.912964 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 18:59:10.912964 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 18:59:10.912964 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 18:59:10.912964 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:59:10.912964 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 18:59:10.912964 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 18:59:10.912964 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 01 18:59:10.912964 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 01 18:59:10.912964 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Nov 01 18:59:10.912964 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 18:59:10.914872 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-251b58e0-c91f-413e-80ac-1bfecbea442f tempest-ImagesDeleteNegativeTestJSON-896531788 tempest-ImagesDeleteNegativeTestJSON-896531788-project] Returning 404 to user: Image not found. {{(pid=121402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 01 18:59:10.915931 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-251b58e0-c91f-413e-80ac-1bfecbea442f tempest-ImagesDeleteNegativeTestJSON-896531788 tempest-ImagesDeleteNegativeTestJSON-896531788-project] 10.222.0.13 "DELETE /compute/v2.1/images/10fe0d7e-49fc-4210-9597-dd8ccf61f16j" status: 404 len: 62 microversion: 2.1 time: 0.060453 Nov 01 18:59:10.917432 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 715/1385] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:59:10 2022] DELETE /compute/v2.1/images/10fe0d7e-49fc-4210-9597-dd8ccf61f16j => generated 62 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 01 18:59:10.922731 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-6cf59051-f9c1-428c-9195-3d8f9a418aad tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:59:10.929389 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-6cf59051-f9c1-428c-9195-3d8f9a418aad tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] [instance: ed4798be-a45e-46f5-8f7e-1165f6479bd1] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:59:10.942984 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-6cf59051-f9c1-428c-9195-3d8f9a418aad tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:59:10.943421 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-6cf59051-f9c1-428c-9195-3d8f9a418aad tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:59:10.943870 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-6cf59051-f9c1-428c-9195-3d8f9a418aad tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:59:10.949009 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-6cf59051-f9c1-428c-9195-3d8f9a418aad tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:59:10.949793 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-6cf59051-f9c1-428c-9195-3d8f9a418aad tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:59:10.950419 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-6cf59051-f9c1-428c-9195-3d8f9a418aad tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:59:10.964149 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-97080839-e1d0-4c23-b302-9e87dd28cdbc tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f32f5fba1976432d938e664c7714e52b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b9d4c236b944f9b2e8e502a50a8f8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:59:10.980438 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-97080839-e1d0-4c23-b302-9e87dd28cdbc tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] 10.222.0.13 "GET /compute/v2.1/servers/2d525a31-b0be-44cb-8fb7-335075145f08" status: 200 len: 1718 microversion: 2.1 time: 0.719743 Nov 01 18:59:10.981269 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 671/1386] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:59:10 2022] GET /compute/v2.1/servers/2d525a31-b0be-44cb-8fb7-335075145f08 => generated 1718 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:59:10.994541 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-4d6ba028-b679-4adf-a091-268118965eca tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:59:10.994755 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-4d6ba028-b679-4adf-a091-268118965eca tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] [instance: a7f88d19-08ee-47bf-9240-7d49afd775e2] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:59:11.035341 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-4d6ba028-b679-4adf-a091-268118965eca tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:59:11.036078 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-4d6ba028-b679-4adf-a091-268118965eca tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:59:11.036392 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-4d6ba028-b679-4adf-a091-268118965eca tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:59:11.037164 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-4d6ba028-b679-4adf-a091-268118965eca tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:59:11.038251 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-4d6ba028-b679-4adf-a091-268118965eca tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:59:11.044462 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-4d6ba028-b679-4adf-a091-268118965eca tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:59:11.259770 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-6cf59051-f9c1-428c-9195-3d8f9a418aad tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a63d69c99a546f0af16329cff3ca717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a1bb191cff948e99c008b5e861ce4a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:59:11.269428 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-6cf59051-f9c1-428c-9195-3d8f9a418aad tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] 10.222.0.13 "GET /compute/v2.1/servers/ed4798be-a45e-46f5-8f7e-1165f6479bd1" status: 200 len: 1521 microversion: 2.1 time: 0.350788 Nov 01 18:59:11.273106 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 716/1387] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:59:10 2022] GET /compute/v2.1/servers/ed4798be-a45e-46f5-8f7e-1165f6479bd1 => generated 1521 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:59:11.292036 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [req-0325b073-ffec-42c5-8baa-42b7fd25c50b req-3fb8ced8-070f-4d06-8359-28bc80ee4c4f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5e7ed73c-1243-4adf-94a2-09f7bf73f6fd", "name": "network-vif-plugged", "status": "completed", "tag": "e54c219d-e64c-46bc-ad98-717d0dfb07e2"}]} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 18:59:11.318260 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-0325b073-ffec-42c5-8baa-42b7fd25c50b req-3fb8ced8-070f-4d06-8359-28bc80ee4c4f service nova] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:59:11.319047 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-0325b073-ffec-42c5-8baa-42b7fd25c50b req-3fb8ced8-070f-4d06-8359-28bc80ee4c4f service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:59:11.319639 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-0325b073-ffec-42c5-8baa-42b7fd25c50b req-3fb8ced8-070f-4d06-8359-28bc80ee4c4f service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:59:11.334175 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.compute.server_external_events [req-0325b073-ffec-42c5-8baa-42b7fd25c50b req-3fb8ced8-070f-4d06-8359-28bc80ee4c4f service nova] Creating event network-vif-plugged:e54c219d-e64c-46bc-ad98-717d0dfb07e2 for instance 5e7ed73c-1243-4adf-94a2-09f7bf73f6fd on n-h2-863052-2 Nov 01 18:59:11.339899 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [req-0325b073-ffec-42c5-8baa-42b7fd25c50b req-3fb8ced8-070f-4d06-8359-28bc80ee4c4f service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065482 Nov 01 18:59:11.340859 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 717/1388] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Nov 1 18:59:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 18:59:11.365620 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-421fea21-0db8-41e8-9aaf-2969355f268d tempest-ImagesDeleteNegativeTestJSON-896531788 tempest-ImagesDeleteNegativeTestJSON-896531788-project] Calling method '.version_select at 0x7f0ae2b52700>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:59:11.425799 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.wsgi [None req-421fea21-0db8-41e8-9aaf-2969355f268d tempest-ImagesDeleteNegativeTestJSON-896531788 tempest-ImagesDeleteNegativeTestJSON-896531788-project] HTTP exception thrown: Image not found. Nov 01 18:59:11.430136 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-421fea21-0db8-41e8-9aaf-2969355f268d tempest-ImagesDeleteNegativeTestJSON-896531788 tempest-ImagesDeleteNegativeTestJSON-896531788-project] Request method failure captured: Nov 01 18:59:11.430136 n-d-863052-2 devstack@n-api.service[121402]: request: DELETE /compute/v2.1/images/c888ae58-bf4d-42bf-a057-8f0a7316365a1 HTTP/1.1 Nov 01 18:59:11.430136 n-d-863052-2 devstack@n-api.service[121402]: Accept: application/json Nov 01 18:59:11.430136 n-d-863052-2 devstack@n-api.service[121402]: Accept-Encoding: identity Nov 01 18:59:11.430136 n-d-863052-2 devstack@n-api.service[121402]: Connection: close Nov 01 18:59:11.430136 n-d-863052-2 devstack@n-api.service[121402]: Content-Length: 0 Nov 01 18:59:11.430136 n-d-863052-2 devstack@n-api.service[121402]: Content-Type: application/json Nov 01 18:59:11.430136 n-d-863052-2 devstack@n-api.service[121402]: Host: 10.222.0.13 Nov 01 18:59:11.430136 n-d-863052-2 devstack@n-api.service[121402]: Openstack-System-Scope: None Nov 01 18:59:11.430136 n-d-863052-2 devstack@n-api.service[121402]: User-Agent: python-urllib3/1.26.12 Nov 01 18:59:11.430136 n-d-863052-2 devstack@n-api.service[121402]: X-Auth-Token: gAAAAABjYWx7vGVafxvjHTRZzwYiylQTUXiWcc6d3A4DEjUeVYFTKNhgu-k4q79NhoUFeKn5QCBn2JVBgOPsjV-B1YfZ27QZV9Gw77YZvO03MILDOy5HjmI-uus0URNt-H3ytRv52sTBk-IYb_UFRbYJp9-0pxOx-dYdouYUEIyfiVUyH4BFI98 Nov 01 18:59:11.430136 n-d-863052-2 devstack@n-api.service[121402]: X-Domain-Id: None Nov 01 18:59:11.430136 n-d-863052-2 devstack@n-api.service[121402]: X-Domain-Name: None Nov 01 18:59:11.430136 n-d-863052-2 devstack@n-api.service[121402]: X-Identity-Status: Confirmed Nov 01 18:59:11.430136 n-d-863052-2 devstack@n-api.service[121402]: X-Is-Admin-Project: True Nov 01 18:59:11.430136 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Domain-Id: default Nov 01 18:59:11.430136 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Domain-Name: Default Nov 01 18:59:11.430136 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Id: 408bb70abfa24785b3a0ae5c4102b7d3 Nov 01 18:59:11.430136 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-896531788 Nov 01 18:59:11.430136 n-d-863052-2 devstack@n-api.service[121402]: X-Role: member,reader Nov 01 18:59:11.430136 n-d-863052-2 devstack@n-api.service[121402]: X-Roles: member,reader Nov 01 18:59:11.431768 n-d-863052-2 devstack@n-api.service[121402]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/408bb70abfa24785b3a0ae5c4102b7d3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/408bb70abfa24785b3a0ae5c4102b7d3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_408bb70abfa24785b3a0ae5c4102b7d3", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/408bb70abfa24785b3a0ae5c4102b7d3"}]}] Nov 01 18:59:11.431768 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-896531788 Nov 01 18:59:11.431768 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant-Id: 408bb70abfa24785b3a0ae5c4102b7d3 Nov 01 18:59:11.431768 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-896531788 Nov 01 18:59:11.431768 n-d-863052-2 devstack@n-api.service[121402]: X-User: tempest-ImagesDeleteNegativeTestJSON-896531788-project Nov 01 18:59:11.431768 n-d-863052-2 devstack@n-api.service[121402]: X-User-Domain-Id: default Nov 01 18:59:11.431768 n-d-863052-2 devstack@n-api.service[121402]: X-User-Domain-Name: Default Nov 01 18:59:11.431768 n-d-863052-2 devstack@n-api.service[121402]: X-User-Id: 523bf64c1823446884b018d856fea3fe Nov 01 18:59:11.431768 n-d-863052-2 devstack@n-api.service[121402]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-896531788-project Nov 01 18:59:11.431768 n-d-863052-2 devstack@n-api.service[121402]: method: Nov 01 18:59:11.431768 n-d-863052-2 devstack@n-api.service[121402]: exception: Image not found. Nov 01 18:59:11.431768 n-d-863052-2 devstack@n-api.service[121402]: action_args: {'id': 'c888ae58-bf4d-42bf-a057-8f0a7316365a1'} Nov 01 18:59:11.431768 n-d-863052-2 devstack@n-api.service[121402]: {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 01 18:59:11.432726 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:59:11.432726 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Nov 01 18:59:11.432726 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Nov 01 18:59:11.432726 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Nov 01 18:59:11.432726 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Nov 01 18:59:11.432726 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Nov 01 18:59:11.432726 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Nov 01 18:59:11.432726 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Nov 01 18:59:11.432726 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Nov 01 18:59:11.432726 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Nov 01 18:59:11.432726 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Nov 01 18:59:11.432726 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Nov 01 18:59:11.432726 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Nov 01 18:59:11.432726 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Nov 01 18:59:11.432726 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Nov 01 18:59:11.432726 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image c888ae58-bf4d-42bf-a057-8f0a7316365a1 to delete Nov 01 18:59:11.432726 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 18:59:11.432726 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 18:59:11.432726 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 18:59:11.434089 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:59:11.434089 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Nov 01 18:59:11.434089 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Nov 01 18:59:11.434089 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Nov 01 18:59:11.434089 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Nov 01 18:59:11.434089 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Nov 01 18:59:11.434089 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Nov 01 18:59:11.434089 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image c888ae58-bf4d-42bf-a057-8f0a7316365a1 could not be found. Nov 01 18:59:11.434089 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 18:59:11.434089 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 18:59:11.434089 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 18:59:11.434089 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:59:11.434089 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 18:59:11.434089 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 18:59:11.434089 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 01 18:59:11.434089 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 01 18:59:11.434089 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 01 18:59:11.434089 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 01 18:59:11.434089 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 01 18:59:11.434089 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 01 18:59:11.435556 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Nov 01 18:59:11.435556 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Nov 01 18:59:11.435556 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Nov 01 18:59:11.435556 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 18:59:11.435556 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 18:59:11.435556 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 18:59:11.435556 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:59:11.435556 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 18:59:11.435556 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 18:59:11.435556 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 01 18:59:11.435556 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 01 18:59:11.435556 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Nov 01 18:59:11.435556 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 18:59:11.435556 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-421fea21-0db8-41e8-9aaf-2969355f268d tempest-ImagesDeleteNegativeTestJSON-896531788 tempest-ImagesDeleteNegativeTestJSON-896531788-project] Returning 404 to user: Image not found. {{(pid=121402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 01 18:59:11.435556 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-421fea21-0db8-41e8-9aaf-2969355f268d tempest-ImagesDeleteNegativeTestJSON-896531788 tempest-ImagesDeleteNegativeTestJSON-896531788-project] 10.222.0.13 "DELETE /compute/v2.1/images/c888ae58-bf4d-42bf-a057-8f0a7316365a1" status: 404 len: 62 microversion: 2.1 time: 0.089052 Nov 01 18:59:11.437532 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 718/1389] 10.222.0.13 () {58 vars in 1239 bytes} [Tue Nov 1 18:59:11 2022] DELETE /compute/v2.1/images/c888ae58-bf4d-42bf-a057-8f0a7316365a1 => generated 62 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 01 18:59:11.440867 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-e11cddb4-5098-4fb9-975d-d222aedc1250 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:59:11.441693 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-e11cddb4-5098-4fb9-975d-d222aedc1250 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] [instance: c04ee904-7b1a-4d73-b0c0-eb379c9aa683] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:59:11.452912 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e11cddb4-5098-4fb9-975d-d222aedc1250 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:59:11.452912 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e11cddb4-5098-4fb9-975d-d222aedc1250 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:59:11.452912 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e11cddb4-5098-4fb9-975d-d222aedc1250 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:59:11.453374 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e11cddb4-5098-4fb9-975d-d222aedc1250 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:59:11.453893 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e11cddb4-5098-4fb9-975d-d222aedc1250 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:59:11.454581 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e11cddb4-5098-4fb9-975d-d222aedc1250 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:59:11.827980 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-4d6ba028-b679-4adf-a091-268118965eca tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:59:11.838752 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-4d6ba028-b679-4adf-a091-268118965eca tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:59:11.853811 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-4d6ba028-b679-4adf-a091-268118965eca tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:59:11.855225 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-4d6ba028-b679-4adf-a091-268118965eca tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] 10.222.0.13 "GET /compute/v2.1/servers/a7f88d19-08ee-47bf-9240-7d49afd775e2" status: 200 len: 1812 microversion: 2.25 time: 0.865067 Nov 01 18:59:11.855948 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 672/1390] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 18:59:10 2022] GET /compute/v2.1/servers/a7f88d19-08ee-47bf-9240-7d49afd775e2 => generated 1812 bytes in 874 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 18:59:11.879537 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-1935b101-0c26-4bba-b983-9b3d40cc74ca tempest-ImagesDeleteNegativeTestJSON-896531788 tempest-ImagesDeleteNegativeTestJSON-896531788-project] Calling method '.version_select at 0x7f0ae22cd940>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:59:11.901621 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.wsgi [None req-1935b101-0c26-4bba-b983-9b3d40cc74ca tempest-ImagesDeleteNegativeTestJSON-896531788 tempest-ImagesDeleteNegativeTestJSON-896531788-project] HTTP exception thrown: Image not found. Nov 01 18:59:11.903327 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-1935b101-0c26-4bba-b983-9b3d40cc74ca tempest-ImagesDeleteNegativeTestJSON-896531788 tempest-ImagesDeleteNegativeTestJSON-896531788-project] Request method failure captured: Nov 01 18:59:11.903327 n-d-863052-2 devstack@n-api.service[121403]: request: DELETE /compute/v2.1/images/tempest-invalid-238144968 HTTP/1.1 Nov 01 18:59:11.903327 n-d-863052-2 devstack@n-api.service[121403]: Accept: application/json Nov 01 18:59:11.903327 n-d-863052-2 devstack@n-api.service[121403]: Accept-Encoding: identity Nov 01 18:59:11.903327 n-d-863052-2 devstack@n-api.service[121403]: Connection: close Nov 01 18:59:11.903327 n-d-863052-2 devstack@n-api.service[121403]: Content-Length: 0 Nov 01 18:59:11.903327 n-d-863052-2 devstack@n-api.service[121403]: Content-Type: application/json Nov 01 18:59:11.903327 n-d-863052-2 devstack@n-api.service[121403]: Host: 10.222.0.13 Nov 01 18:59:11.903327 n-d-863052-2 devstack@n-api.service[121403]: Openstack-System-Scope: None Nov 01 18:59:11.903327 n-d-863052-2 devstack@n-api.service[121403]: User-Agent: python-urllib3/1.26.12 Nov 01 18:59:11.903327 n-d-863052-2 devstack@n-api.service[121403]: X-Auth-Token: gAAAAABjYWx7vGVafxvjHTRZzwYiylQTUXiWcc6d3A4DEjUeVYFTKNhgu-k4q79NhoUFeKn5QCBn2JVBgOPsjV-B1YfZ27QZV9Gw77YZvO03MILDOy5HjmI-uus0URNt-H3ytRv52sTBk-IYb_UFRbYJp9-0pxOx-dYdouYUEIyfiVUyH4BFI98 Nov 01 18:59:11.903327 n-d-863052-2 devstack@n-api.service[121403]: X-Domain-Id: None Nov 01 18:59:11.903327 n-d-863052-2 devstack@n-api.service[121403]: X-Domain-Name: None Nov 01 18:59:11.903327 n-d-863052-2 devstack@n-api.service[121403]: X-Identity-Status: Confirmed Nov 01 18:59:11.903327 n-d-863052-2 devstack@n-api.service[121403]: X-Is-Admin-Project: True Nov 01 18:59:11.903327 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Domain-Id: default Nov 01 18:59:11.903327 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Domain-Name: Default Nov 01 18:59:11.903327 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Id: 408bb70abfa24785b3a0ae5c4102b7d3 Nov 01 18:59:11.903327 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-896531788 Nov 01 18:59:11.903327 n-d-863052-2 devstack@n-api.service[121403]: X-Role: member,reader Nov 01 18:59:11.903327 n-d-863052-2 devstack@n-api.service[121403]: X-Roles: member,reader Nov 01 18:59:11.904936 n-d-863052-2 devstack@n-api.service[121403]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/408bb70abfa24785b3a0ae5c4102b7d3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/408bb70abfa24785b3a0ae5c4102b7d3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_408bb70abfa24785b3a0ae5c4102b7d3", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/408bb70abfa24785b3a0ae5c4102b7d3"}]}] Nov 01 18:59:11.904936 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-896531788 Nov 01 18:59:11.904936 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant-Id: 408bb70abfa24785b3a0ae5c4102b7d3 Nov 01 18:59:11.904936 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-896531788 Nov 01 18:59:11.904936 n-d-863052-2 devstack@n-api.service[121403]: X-User: tempest-ImagesDeleteNegativeTestJSON-896531788-project Nov 01 18:59:11.904936 n-d-863052-2 devstack@n-api.service[121403]: X-User-Domain-Id: default Nov 01 18:59:11.904936 n-d-863052-2 devstack@n-api.service[121403]: X-User-Domain-Name: Default Nov 01 18:59:11.904936 n-d-863052-2 devstack@n-api.service[121403]: X-User-Id: 523bf64c1823446884b018d856fea3fe Nov 01 18:59:11.904936 n-d-863052-2 devstack@n-api.service[121403]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-896531788-project Nov 01 18:59:11.904936 n-d-863052-2 devstack@n-api.service[121403]: method: Nov 01 18:59:11.904936 n-d-863052-2 devstack@n-api.service[121403]: exception: Image not found. Nov 01 18:59:11.904936 n-d-863052-2 devstack@n-api.service[121403]: action_args: {'id': 'tempest-invalid-238144968'} Nov 01 18:59:11.904936 n-d-863052-2 devstack@n-api.service[121403]: {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 01 18:59:11.908176 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:59:11.908176 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Nov 01 18:59:11.908176 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Nov 01 18:59:11.908176 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Nov 01 18:59:11.908176 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Nov 01 18:59:11.908176 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Nov 01 18:59:11.908176 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Nov 01 18:59:11.908176 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Nov 01 18:59:11.908176 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Nov 01 18:59:11.908176 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Nov 01 18:59:11.908176 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Nov 01 18:59:11.908176 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Nov 01 18:59:11.908176 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Nov 01 18:59:11.908176 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Nov 01 18:59:11.908176 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Nov 01 18:59:11.908176 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image tempest-invalid-238144968 to delete Nov 01 18:59:11.908176 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 18:59:11.908176 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 18:59:11.908176 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 18:59:11.909669 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:59:11.909669 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Nov 01 18:59:11.909669 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Nov 01 18:59:11.909669 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Nov 01 18:59:11.909669 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Nov 01 18:59:11.909669 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Nov 01 18:59:11.909669 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Nov 01 18:59:11.909669 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image tempest-invalid-238144968 could not be found. Nov 01 18:59:11.909669 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 18:59:11.909669 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 18:59:11.909669 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 18:59:11.909669 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:59:11.909669 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 18:59:11.909669 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 18:59:11.909669 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 01 18:59:11.909669 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 01 18:59:11.909669 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 01 18:59:11.909669 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 01 18:59:11.909669 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 01 18:59:11.909669 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 01 18:59:11.911630 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Nov 01 18:59:11.911630 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Nov 01 18:59:11.911630 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Nov 01 18:59:11.911630 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 18:59:11.911630 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 18:59:11.911630 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 18:59:11.911630 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:59:11.911630 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 18:59:11.911630 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 18:59:11.911630 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 01 18:59:11.911630 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 01 18:59:11.911630 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Nov 01 18:59:11.911630 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 18:59:11.911630 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-1935b101-0c26-4bba-b983-9b3d40cc74ca tempest-ImagesDeleteNegativeTestJSON-896531788 tempest-ImagesDeleteNegativeTestJSON-896531788-project] Returning 404 to user: Image not found. {{(pid=121403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 01 18:59:11.911630 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-1935b101-0c26-4bba-b983-9b3d40cc74ca tempest-ImagesDeleteNegativeTestJSON-896531788 tempest-ImagesDeleteNegativeTestJSON-896531788-project] 10.222.0.13 "DELETE /compute/v2.1/images/tempest-invalid-238144968" status: 404 len: 62 microversion: 2.1 time: 0.034676 Nov 01 18:59:11.913531 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 673/1391] 10.222.0.13 () {58 vars in 1203 bytes} [Tue Nov 1 18:59:11 2022] DELETE /compute/v2.1/images/tempest-invalid-238144968 => generated 62 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 01 18:59:11.915352 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-9430ba5d-1e4b-4bd6-8e72-13310735baf5 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:59:11.915352 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-9430ba5d-1e4b-4bd6-8e72-13310735baf5 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] [instance: 9249c81d-e57b-4985-a398-8ad97526d5c7] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:59:11.922797 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-9430ba5d-1e4b-4bd6-8e72-13310735baf5 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:59:11.923289 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-9430ba5d-1e4b-4bd6-8e72-13310735baf5 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:59:11.923722 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-9430ba5d-1e4b-4bd6-8e72-13310735baf5 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:59:11.924421 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-9430ba5d-1e4b-4bd6-8e72-13310735baf5 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:59:11.925040 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-9430ba5d-1e4b-4bd6-8e72-13310735baf5 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:59:11.925321 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-9430ba5d-1e4b-4bd6-8e72-13310735baf5 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:59:12.048746 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-e11cddb4-5098-4fb9-975d-d222aedc1250 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0290a6bb8bc24b8988a925327ac0381c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86941784237549838bba63ce88053b88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:59:12.089230 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-e11cddb4-5098-4fb9-975d-d222aedc1250 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] 10.222.0.13 "GET /compute/v2.1/servers/c04ee904-7b1a-4d73-b0c0-eb379c9aa683" status: 200 len: 1318 microversion: 2.1 time: 0.645732 Nov 01 18:59:12.092268 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 719/1392] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:59:11 2022] GET /compute/v2.1/servers/c04ee904-7b1a-4d73-b0c0-eb379c9aa683 => generated 1318 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:59:12.113501 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-d0d363c5-366e-46d7-8c30-9ad28b201b36 tempest-ImagesDeleteNegativeTestJSON-896531788 tempest-ImagesDeleteNegativeTestJSON-896531788-project] Calling method '.version_select at 0x7f0ae2df99d0>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:59:12.156409 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.wsgi [None req-d0d363c5-366e-46d7-8c30-9ad28b201b36 tempest-ImagesDeleteNegativeTestJSON-896531788 tempest-ImagesDeleteNegativeTestJSON-896531788-project] HTTP exception thrown: Image not found. Nov 01 18:59:12.158205 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-d0d363c5-366e-46d7-8c30-9ad28b201b36 tempest-ImagesDeleteNegativeTestJSON-896531788 tempest-ImagesDeleteNegativeTestJSON-896531788-project] Request method failure captured: Nov 01 18:59:12.158205 n-d-863052-2 devstack@n-api.service[121402]: request: DELETE /compute/v2.1/images/5f0588ef-a8cb-4d55-b428-c2b4b2d5128e HTTP/1.1 Nov 01 18:59:12.158205 n-d-863052-2 devstack@n-api.service[121402]: Accept: application/json Nov 01 18:59:12.158205 n-d-863052-2 devstack@n-api.service[121402]: Accept-Encoding: identity Nov 01 18:59:12.158205 n-d-863052-2 devstack@n-api.service[121402]: Connection: close Nov 01 18:59:12.158205 n-d-863052-2 devstack@n-api.service[121402]: Content-Length: 0 Nov 01 18:59:12.158205 n-d-863052-2 devstack@n-api.service[121402]: Content-Type: application/json Nov 01 18:59:12.158205 n-d-863052-2 devstack@n-api.service[121402]: Host: 10.222.0.13 Nov 01 18:59:12.158205 n-d-863052-2 devstack@n-api.service[121402]: Openstack-System-Scope: None Nov 01 18:59:12.158205 n-d-863052-2 devstack@n-api.service[121402]: User-Agent: python-urllib3/1.26.12 Nov 01 18:59:12.158205 n-d-863052-2 devstack@n-api.service[121402]: X-Auth-Token: gAAAAABjYWx7vGVafxvjHTRZzwYiylQTUXiWcc6d3A4DEjUeVYFTKNhgu-k4q79NhoUFeKn5QCBn2JVBgOPsjV-B1YfZ27QZV9Gw77YZvO03MILDOy5HjmI-uus0URNt-H3ytRv52sTBk-IYb_UFRbYJp9-0pxOx-dYdouYUEIyfiVUyH4BFI98 Nov 01 18:59:12.158205 n-d-863052-2 devstack@n-api.service[121402]: X-Domain-Id: None Nov 01 18:59:12.158205 n-d-863052-2 devstack@n-api.service[121402]: X-Domain-Name: None Nov 01 18:59:12.158205 n-d-863052-2 devstack@n-api.service[121402]: X-Identity-Status: Confirmed Nov 01 18:59:12.158205 n-d-863052-2 devstack@n-api.service[121402]: X-Is-Admin-Project: True Nov 01 18:59:12.158205 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Domain-Id: default Nov 01 18:59:12.158205 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Domain-Name: Default Nov 01 18:59:12.158205 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Id: 408bb70abfa24785b3a0ae5c4102b7d3 Nov 01 18:59:12.158205 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-896531788 Nov 01 18:59:12.158205 n-d-863052-2 devstack@n-api.service[121402]: X-Role: member,reader Nov 01 18:59:12.158205 n-d-863052-2 devstack@n-api.service[121402]: X-Roles: member,reader Nov 01 18:59:12.159584 n-d-863052-2 devstack@n-api.service[121402]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/408bb70abfa24785b3a0ae5c4102b7d3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/408bb70abfa24785b3a0ae5c4102b7d3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_408bb70abfa24785b3a0ae5c4102b7d3", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/408bb70abfa24785b3a0ae5c4102b7d3"}]}] Nov 01 18:59:12.159584 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-896531788 Nov 01 18:59:12.159584 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant-Id: 408bb70abfa24785b3a0ae5c4102b7d3 Nov 01 18:59:12.159584 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-896531788 Nov 01 18:59:12.159584 n-d-863052-2 devstack@n-api.service[121402]: X-User: tempest-ImagesDeleteNegativeTestJSON-896531788-project Nov 01 18:59:12.159584 n-d-863052-2 devstack@n-api.service[121402]: X-User-Domain-Id: default Nov 01 18:59:12.159584 n-d-863052-2 devstack@n-api.service[121402]: X-User-Domain-Name: Default Nov 01 18:59:12.159584 n-d-863052-2 devstack@n-api.service[121402]: X-User-Id: 523bf64c1823446884b018d856fea3fe Nov 01 18:59:12.159584 n-d-863052-2 devstack@n-api.service[121402]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-896531788-project Nov 01 18:59:12.159584 n-d-863052-2 devstack@n-api.service[121402]: method: Nov 01 18:59:12.159584 n-d-863052-2 devstack@n-api.service[121402]: exception: Image not found. Nov 01 18:59:12.159584 n-d-863052-2 devstack@n-api.service[121402]: action_args: {'id': '5f0588ef-a8cb-4d55-b428-c2b4b2d5128e'} Nov 01 18:59:12.159584 n-d-863052-2 devstack@n-api.service[121402]: {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 01 18:59:12.160400 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:59:12.160400 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Nov 01 18:59:12.160400 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Nov 01 18:59:12.160400 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Nov 01 18:59:12.160400 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Nov 01 18:59:12.160400 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Nov 01 18:59:12.160400 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Nov 01 18:59:12.160400 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Nov 01 18:59:12.160400 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Nov 01 18:59:12.160400 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Nov 01 18:59:12.160400 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Nov 01 18:59:12.160400 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Nov 01 18:59:12.160400 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Nov 01 18:59:12.160400 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Nov 01 18:59:12.160400 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Nov 01 18:59:12.160400 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 5f0588ef-a8cb-4d55-b428-c2b4b2d5128e to delete Nov 01 18:59:12.160400 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 18:59:12.160400 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 18:59:12.160400 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 18:59:12.161627 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:59:12.161627 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Nov 01 18:59:12.161627 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Nov 01 18:59:12.161627 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Nov 01 18:59:12.161627 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Nov 01 18:59:12.161627 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Nov 01 18:59:12.161627 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Nov 01 18:59:12.161627 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 5f0588ef-a8cb-4d55-b428-c2b4b2d5128e could not be found. Nov 01 18:59:12.161627 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 18:59:12.161627 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 18:59:12.161627 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 18:59:12.161627 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:59:12.161627 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 18:59:12.161627 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 18:59:12.161627 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 01 18:59:12.161627 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 01 18:59:12.161627 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 01 18:59:12.161627 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 01 18:59:12.161627 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 01 18:59:12.161627 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 01 18:59:12.162872 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Nov 01 18:59:12.162872 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Nov 01 18:59:12.162872 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Nov 01 18:59:12.162872 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 18:59:12.162872 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 18:59:12.162872 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 18:59:12.162872 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:59:12.162872 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 18:59:12.162872 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 18:59:12.162872 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 01 18:59:12.162872 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 01 18:59:12.162872 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Nov 01 18:59:12.162872 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 18:59:12.162872 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-d0d363c5-366e-46d7-8c30-9ad28b201b36 tempest-ImagesDeleteNegativeTestJSON-896531788 tempest-ImagesDeleteNegativeTestJSON-896531788-project] Returning 404 to user: Image not found. {{(pid=121402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 01 18:59:12.162872 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-d0d363c5-366e-46d7-8c30-9ad28b201b36 tempest-ImagesDeleteNegativeTestJSON-896531788 tempest-ImagesDeleteNegativeTestJSON-896531788-project] 10.222.0.13 "DELETE /compute/v2.1/images/5f0588ef-a8cb-4d55-b428-c2b4b2d5128e" status: 404 len: 62 microversion: 2.1 time: 0.063022 Nov 01 18:59:12.163823 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 720/1393] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:59:12 2022] DELETE /compute/v2.1/images/5f0588ef-a8cb-4d55-b428-c2b4b2d5128e => generated 62 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 01 18:59:12.165822 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [req-b5410b42-7b3c-46b0-8c0c-bbbd4b7a5ddb req-70434adc-6b93-4def-9d41-09b584ddef82 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9249c81d-e57b-4985-a398-8ad97526d5c7", "tag": "b471dd14-4ce9-4781-a7a0-1bd2ae3a7e55"}]} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 18:59:12.197380 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-b5410b42-7b3c-46b0-8c0c-bbbd4b7a5ddb req-70434adc-6b93-4def-9d41-09b584ddef82 service nova] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:59:12.197884 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-b5410b42-7b3c-46b0-8c0c-bbbd4b7a5ddb req-70434adc-6b93-4def-9d41-09b584ddef82 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:59:12.198327 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-b5410b42-7b3c-46b0-8c0c-bbbd4b7a5ddb req-70434adc-6b93-4def-9d41-09b584ddef82 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:59:12.234960 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.compute.server_external_events [req-b5410b42-7b3c-46b0-8c0c-bbbd4b7a5ddb req-70434adc-6b93-4def-9d41-09b584ddef82 service nova] Creating event network-changed:b471dd14-4ce9-4781-a7a0-1bd2ae3a7e55 for instance 9249c81d-e57b-4985-a398-8ad97526d5c7 on n-h2-863052-2 Nov 01 18:59:12.242876 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [req-b5410b42-7b3c-46b0-8c0c-bbbd4b7a5ddb req-70434adc-6b93-4def-9d41-09b584ddef82 service nova] Instance 9249c81d-e57b-4985-a398-8ad97526d5c7 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-863052-2', 'n-h1-863052-2'} {{(pid=121402) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Nov 01 18:59:12.264118 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [req-b5410b42-7b3c-46b0-8c0c-bbbd4b7a5ddb req-70434adc-6b93-4def-9d41-09b584ddef82 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101545 Nov 01 18:59:12.269000 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 721/1394] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Nov 1 18:59:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 18:59:12.292396 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-7d552ce1-7215-4378-9b9d-735ed2f88145 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:59:12.295075 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-7d552ce1-7215-4378-9b9d-735ed2f88145 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] [instance: 2d525a31-b0be-44cb-8fb7-335075145f08] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:59:12.309543 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-7d552ce1-7215-4378-9b9d-735ed2f88145 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:59:12.316386 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-7d552ce1-7215-4378-9b9d-735ed2f88145 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:59:12.317173 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-7d552ce1-7215-4378-9b9d-735ed2f88145 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:59:12.318284 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-7d552ce1-7215-4378-9b9d-735ed2f88145 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:59:12.319005 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-7d552ce1-7215-4378-9b9d-735ed2f88145 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:59:12.319660 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-7d552ce1-7215-4378-9b9d-735ed2f88145 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:59:12.353610 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-9430ba5d-1e4b-4bd6-8e72-13310735baf5 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72117f17294649d6b8bc16c66c7efab2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45d4c047d3c44324a27a27831236ab0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:59:12.368112 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-9430ba5d-1e4b-4bd6-8e72-13310735baf5 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] 10.222.0.13 "GET /compute/v2.1/servers/9249c81d-e57b-4985-a398-8ad97526d5c7" status: 200 len: 1536 microversion: 2.1 time: 0.460881 Nov 01 18:59:12.371120 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 674/1395] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:59:11 2022] GET /compute/v2.1/servers/9249c81d-e57b-4985-a398-8ad97526d5c7 => generated 1536 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:59:12.389122 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-9df203a1-2eb0-4064-8880-6addbc624290 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:59:12.391027 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-9df203a1-2eb0-4064-8880-6addbc624290 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] [instance: ed4798be-a45e-46f5-8f7e-1165f6479bd1] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:59:12.402169 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-9df203a1-2eb0-4064-8880-6addbc624290 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:59:12.403069 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-9df203a1-2eb0-4064-8880-6addbc624290 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:59:12.404106 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-9df203a1-2eb0-4064-8880-6addbc624290 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:59:12.408307 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-9df203a1-2eb0-4064-8880-6addbc624290 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:59:12.409408 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-9df203a1-2eb0-4064-8880-6addbc624290 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:59:12.410197 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-9df203a1-2eb0-4064-8880-6addbc624290 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:59:13.001074 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-9df203a1-2eb0-4064-8880-6addbc624290 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a63d69c99a546f0af16329cff3ca717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a1bb191cff948e99c008b5e861ce4a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:59:13.016209 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-9df203a1-2eb0-4064-8880-6addbc624290 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] 10.222.0.13 "GET /compute/v2.1/servers/ed4798be-a45e-46f5-8f7e-1165f6479bd1" status: 200 len: 1521 microversion: 2.1 time: 0.643666 Nov 01 18:59:13.017042 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 675/1396] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:59:12 2022] GET /compute/v2.1/servers/ed4798be-a45e-46f5-8f7e-1165f6479bd1 => generated 1521 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:59:13.026016 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-e47fba5c-2424-4d6b-9e60-834c06f99ee1 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:59:13.026949 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-e47fba5c-2424-4d6b-9e60-834c06f99ee1 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] [instance: a7f88d19-08ee-47bf-9240-7d49afd775e2] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:59:13.043752 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-e47fba5c-2424-4d6b-9e60-834c06f99ee1 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:59:13.045218 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-e47fba5c-2424-4d6b-9e60-834c06f99ee1 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:59:13.046878 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-e47fba5c-2424-4d6b-9e60-834c06f99ee1 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:59:13.047888 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-e47fba5c-2424-4d6b-9e60-834c06f99ee1 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:59:13.050249 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-e47fba5c-2424-4d6b-9e60-834c06f99ee1 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:59:13.050895 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-e47fba5c-2424-4d6b-9e60-834c06f99ee1 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:59:13.290759 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-7d552ce1-7215-4378-9b9d-735ed2f88145 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f32f5fba1976432d938e664c7714e52b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b9d4c236b944f9b2e8e502a50a8f8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:59:13.300977 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-7d552ce1-7215-4378-9b9d-735ed2f88145 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] 10.222.0.13 "GET /compute/v2.1/servers/2d525a31-b0be-44cb-8fb7-335075145f08" status: 200 len: 1718 microversion: 2.1 time: 1.030689 Nov 01 18:59:13.312975 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 722/1397] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:59:12 2022] GET /compute/v2.1/servers/2d525a31-b0be-44cb-8fb7-335075145f08 => generated 1718 bytes in 1043 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:59:13.463987 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-e47fba5c-2424-4d6b-9e60-834c06f99ee1 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:59:13.488221 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-e47fba5c-2424-4d6b-9e60-834c06f99ee1 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:59:13.493582 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-e47fba5c-2424-4d6b-9e60-834c06f99ee1 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:59:13.494866 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-e47fba5c-2424-4d6b-9e60-834c06f99ee1 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] 10.222.0.13 "GET /compute/v2.1/servers/a7f88d19-08ee-47bf-9240-7d49afd775e2" status: 200 len: 1812 microversion: 2.25 time: 0.476448 Nov 01 18:59:13.498452 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 676/1398] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 18:59:13 2022] GET /compute/v2.1/servers/a7f88d19-08ee-47bf-9240-7d49afd775e2 => generated 1812 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 18:59:13.509374 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-1e922ef1-486b-4316-b965-5b1fa3ddead3 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:59:13.516828 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-1e922ef1-486b-4316-b965-5b1fa3ddead3 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] [instance: c04ee904-7b1a-4d73-b0c0-eb379c9aa683] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:59:13.528793 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-1e922ef1-486b-4316-b965-5b1fa3ddead3 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:59:13.531567 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-1e922ef1-486b-4316-b965-5b1fa3ddead3 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:59:13.532180 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-1e922ef1-486b-4316-b965-5b1fa3ddead3 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:59:13.534133 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-1e922ef1-486b-4316-b965-5b1fa3ddead3 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:59:13.535388 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-1e922ef1-486b-4316-b965-5b1fa3ddead3 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:59:13.536153 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-1e922ef1-486b-4316-b965-5b1fa3ddead3 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:59:13.670596 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-6923b4b9-88b8-4d88-ab25-9434be701c33 tempest-SecurityGroupsNegativeTestJSON-816380628 tempest-SecurityGroupsNegativeTestJSON-816380628-project] Calling method '.version_select at 0x7f0ae2b52ee0>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:59:13.747328 n-d-863052-2 devstack@n-api.service[121402]: DEBUG neutronclient.v2_0.client [None req-6923b4b9-88b8-4d88-ab25-9434be701c33 tempest-SecurityGroupsNegativeTestJSON-816380628 tempest-SecurityGroupsNegativeTestJSON-816380628-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group d563894d-d557-450e-afce-0d7bf08acee1 does not exist", "detail": ""}} {{(pid=121402) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Nov 01 18:59:13.747945 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.network.security_group_api [None req-6923b4b9-88b8-4d88-ab25-9434be701c33 tempest-SecurityGroupsNegativeTestJSON-816380628 tempest-SecurityGroupsNegativeTestJSON-816380628-project] Neutron security group d563894d-d557-450e-afce-0d7bf08acee1 not found {{(pid=121402) get /opt/stack/nova/nova/network/security_group_api.py:313}} Nov 01 18:59:13.748520 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.wsgi [None req-6923b4b9-88b8-4d88-ab25-9434be701c33 tempest-SecurityGroupsNegativeTestJSON-816380628 tempest-SecurityGroupsNegativeTestJSON-816380628-project] HTTP exception thrown: Security group d563894d-d557-450e-afce-0d7bf08acee1 does not exist Nov 01 18:59:13.748520 n-d-863052-2 devstack@n-api.service[121402]: Neutron server returns request_ids: ['req-8dcdc7a9-27e5-49a0-b568-e3a5f00bcee6'] Nov 01 18:59:13.753375 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-6923b4b9-88b8-4d88-ab25-9434be701c33 tempest-SecurityGroupsNegativeTestJSON-816380628 tempest-SecurityGroupsNegativeTestJSON-816380628-project] Request method failure captured: Nov 01 18:59:13.753375 n-d-863052-2 devstack@n-api.service[121402]: request: DELETE /compute/v2.1/os-security-groups/d563894d-d557-450e-afce-0d7bf08acee1 HTTP/1.1 Nov 01 18:59:13.753375 n-d-863052-2 devstack@n-api.service[121402]: Accept: application/json Nov 01 18:59:13.753375 n-d-863052-2 devstack@n-api.service[121402]: Accept-Encoding: identity Nov 01 18:59:13.753375 n-d-863052-2 devstack@n-api.service[121402]: Connection: close Nov 01 18:59:13.753375 n-d-863052-2 devstack@n-api.service[121402]: Content-Length: 0 Nov 01 18:59:13.753375 n-d-863052-2 devstack@n-api.service[121402]: Content-Type: application/json Nov 01 18:59:13.753375 n-d-863052-2 devstack@n-api.service[121402]: Host: 10.222.0.13 Nov 01 18:59:13.753375 n-d-863052-2 devstack@n-api.service[121402]: Openstack-System-Scope: None Nov 01 18:59:13.753375 n-d-863052-2 devstack@n-api.service[121402]: User-Agent: python-urllib3/1.26.12 Nov 01 18:59:13.753375 n-d-863052-2 devstack@n-api.service[121402]: X-Auth-Token: gAAAAABjYWyAVIT6nghPOpxWrmuRg1XlzmzhQemSsjUlm2xAaKvA4OYM-Mvj9JaaSyJJeQgXqQjxK1tCp4f08-lRTQfL4za0iHqRurXwNmJE6Fo1zdQFhDybKl4NCOfcqzVNVEMkVA3ycDBlU9_IbQtR_D76qq02FcWMJDi3BEWE5GJS3jhpQ2Q Nov 01 18:59:13.753375 n-d-863052-2 devstack@n-api.service[121402]: X-Domain-Id: None Nov 01 18:59:13.753375 n-d-863052-2 devstack@n-api.service[121402]: X-Domain-Name: None Nov 01 18:59:13.753375 n-d-863052-2 devstack@n-api.service[121402]: X-Identity-Status: Confirmed Nov 01 18:59:13.753375 n-d-863052-2 devstack@n-api.service[121402]: X-Is-Admin-Project: True Nov 01 18:59:13.753375 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Domain-Id: default Nov 01 18:59:13.753375 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Domain-Name: Default Nov 01 18:59:13.753375 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Id: 45dd7634ccd9442aaa6171247c0935f3 Nov 01 18:59:13.753375 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-816380628 Nov 01 18:59:13.753375 n-d-863052-2 devstack@n-api.service[121402]: X-Role: member,reader Nov 01 18:59:13.753375 n-d-863052-2 devstack@n-api.service[121402]: X-Roles: member,reader Nov 01 18:59:13.754976 n-d-863052-2 devstack@n-api.service[121402]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/45dd7634ccd9442aaa6171247c0935f3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/45dd7634ccd9442aaa6171247c0935f3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_45dd7634ccd9442aaa6171247c0935f3", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/45dd7634ccd9442aaa6171247c0935f3"}]}] Nov 01 18:59:13.754976 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-816380628 Nov 01 18:59:13.754976 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant-Id: 45dd7634ccd9442aaa6171247c0935f3 Nov 01 18:59:13.754976 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-816380628 Nov 01 18:59:13.754976 n-d-863052-2 devstack@n-api.service[121402]: X-User: tempest-SecurityGroupsNegativeTestJSON-816380628-project Nov 01 18:59:13.754976 n-d-863052-2 devstack@n-api.service[121402]: X-User-Domain-Id: default Nov 01 18:59:13.754976 n-d-863052-2 devstack@n-api.service[121402]: X-User-Domain-Name: Default Nov 01 18:59:13.754976 n-d-863052-2 devstack@n-api.service[121402]: X-User-Id: 0cb59aa6ec564bf88774c591b6b2fb28 Nov 01 18:59:13.754976 n-d-863052-2 devstack@n-api.service[121402]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-816380628-project Nov 01 18:59:13.754976 n-d-863052-2 devstack@n-api.service[121402]: method: Nov 01 18:59:13.754976 n-d-863052-2 devstack@n-api.service[121402]: exception: Security group d563894d-d557-450e-afce-0d7bf08acee1 does not exist Nov 01 18:59:13.754976 n-d-863052-2 devstack@n-api.service[121402]: Neutron server returns request_ids: ['req-8dcdc7a9-27e5-49a0-b568-e3a5f00bcee6'] Nov 01 18:59:13.754976 n-d-863052-2 devstack@n-api.service[121402]: action_args: {'id': 'd563894d-d557-450e-afce-0d7bf08acee1'} Nov 01 18:59:13.755978 n-d-863052-2 devstack@n-api.service[121402]: {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 01 18:59:13.755978 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:59:13.755978 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Nov 01 18:59:13.755978 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Nov 01 18:59:13.755978 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 01 18:59:13.755978 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 01 18:59:13.755978 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Nov 01 18:59:13.755978 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Nov 01 18:59:13.755978 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 01 18:59:13.755978 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 01 18:59:13.755978 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 01 18:59:13.755978 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 01 18:59:13.755978 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 01 18:59:13.755978 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 01 18:59:13.755978 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 01 18:59:13.755978 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 01 18:59:13.755978 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 01 18:59:13.755978 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 01 18:59:13.755978 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Nov 01 18:59:13.757310 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Nov 01 18:59:13.757310 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 01 18:59:13.757310 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 01 18:59:13.757310 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Nov 01 18:59:13.757310 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Nov 01 18:59:13.757310 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Nov 01 18:59:13.757310 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Nov 01 18:59:13.757310 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group d563894d-d557-450e-afce-0d7bf08acee1 does not exist Nov 01 18:59:13.757310 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8dcdc7a9-27e5-49a0-b568-e3a5f00bcee6'] Nov 01 18:59:13.757310 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 18:59:13.757310 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 18:59:13.757310 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 18:59:13.757310 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:59:13.757310 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Nov 01 18:59:13.757310 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Nov 01 18:59:13.757310 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Nov 01 18:59:13.757310 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Nov 01 18:59:13.757310 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group d563894d-d557-450e-afce-0d7bf08acee1 does not exist Nov 01 18:59:13.758447 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8dcdc7a9-27e5-49a0-b568-e3a5f00bcee6'] Nov 01 18:59:13.758447 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 18:59:13.758447 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 18:59:13.758447 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 18:59:13.758447 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:59:13.758447 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 18:59:13.758447 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 18:59:13.758447 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 01 18:59:13.758447 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 01 18:59:13.758447 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 01 18:59:13.758447 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 01 18:59:13.758447 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 01 18:59:13.758447 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 01 18:59:13.758447 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Nov 01 18:59:13.758447 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Nov 01 18:59:13.758447 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group d563894d-d557-450e-afce-0d7bf08acee1 does not exist Nov 01 18:59:13.758447 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8dcdc7a9-27e5-49a0-b568-e3a5f00bcee6'] Nov 01 18:59:13.758447 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 18:59:13.758447 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 18:59:13.758447 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 18:59:13.758447 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:59:13.759879 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 18:59:13.759879 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 18:59:13.759879 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 01 18:59:13.759879 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 01 18:59:13.759879 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group d563894d-d557-450e-afce-0d7bf08acee1 does not exist Nov 01 18:59:13.759879 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8dcdc7a9-27e5-49a0-b568-e3a5f00bcee6'] Nov 01 18:59:13.759879 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 18:59:13.762434 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-6923b4b9-88b8-4d88-ab25-9434be701c33 tempest-SecurityGroupsNegativeTestJSON-816380628 tempest-SecurityGroupsNegativeTestJSON-816380628-project] Returning 404 to user: Security group d563894d-d557-450e-afce-0d7bf08acee1 does not exist Nov 01 18:59:13.762434 n-d-863052-2 devstack@n-api.service[121402]: Neutron server returns request_ids: ['req-8dcdc7a9-27e5-49a0-b568-e3a5f00bcee6'] {{(pid=121402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 01 18:59:13.763861 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-6923b4b9-88b8-4d88-ab25-9434be701c33 tempest-SecurityGroupsNegativeTestJSON-816380628 tempest-SecurityGroupsNegativeTestJSON-816380628-project] 10.222.0.13 "DELETE /compute/v2.1/os-security-groups/d563894d-d557-450e-afce-0d7bf08acee1" status: 404 len: 194 microversion: 2.1 time: 0.449444 Nov 01 18:59:13.770171 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 723/1399] 10.222.0.13 () {58 vars in 1272 bytes} [Tue Nov 1 18:59:13 2022] DELETE /compute/v2.1/os-security-groups/d563894d-d557-450e-afce-0d7bf08acee1 => generated 194 bytes in 456 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 01 18:59:13.775895 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-0b837899-11d3-446c-9745-46b782dfa6e3 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:59:13.777929 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-0b837899-11d3-446c-9745-46b782dfa6e3 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] [instance: 9249c81d-e57b-4985-a398-8ad97526d5c7] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:59:13.794855 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-0b837899-11d3-446c-9745-46b782dfa6e3 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:59:13.796938 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-0b837899-11d3-446c-9745-46b782dfa6e3 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:59:13.797547 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-0b837899-11d3-446c-9745-46b782dfa6e3 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:59:13.798429 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-0b837899-11d3-446c-9745-46b782dfa6e3 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:59:13.799097 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-0b837899-11d3-446c-9745-46b782dfa6e3 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:59:13.799835 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-0b837899-11d3-446c-9745-46b782dfa6e3 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:59:13.952673 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-1e922ef1-486b-4316-b965-5b1fa3ddead3 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0290a6bb8bc24b8988a925327ac0381c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86941784237549838bba63ce88053b88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:59:13.963205 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-1e922ef1-486b-4316-b965-5b1fa3ddead3 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] 10.222.0.13 "GET /compute/v2.1/servers/c04ee904-7b1a-4d73-b0c0-eb379c9aa683" status: 200 len: 1467 microversion: 2.1 time: 0.458029 Nov 01 18:59:13.964278 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 677/1400] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:59:13 2022] GET /compute/v2.1/servers/c04ee904-7b1a-4d73-b0c0-eb379c9aa683 => generated 1467 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:59:13.981144 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-121bfe8c-b08c-43d3-a847-6ff6a8b22c11 tempest-SecurityGroupsNegativeTestJSON-816380628 tempest-SecurityGroupsNegativeTestJSON-816380628-project] 10.222.0.13 "DELETE /compute/v2.1/os-security-groups/" status: 404 len: 112 microversion: - time: 0.015117 Nov 01 18:59:13.981971 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 678/1401] 10.222.0.13 () {58 vars in 1164 bytes} [Tue Nov 1 18:59:13 2022] DELETE /compute/v2.1/os-security-groups/ => generated 112 bytes in 17 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Nov 01 18:59:14.064415 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-7cbe66ef-d211-48eb-a0e7-bdd73795e9de tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Action: 'create', calling method: .version_select at 0x7f0ae66e2790>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-640019102", "description": "tempest-description-464889817"}} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 18:59:14.252626 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-7cbe66ef-d211-48eb-a0e7-bdd73795e9de tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] 10.222.0.13 "POST /compute/v2.1/os-security-groups" status: 200 len: 242 microversion: 2.1 time: 0.269060 Nov 01 18:59:14.253498 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 679/1402] 10.222.0.13 () {60 vars in 1180 bytes} [Tue Nov 1 18:59:13 2022] POST /compute/v2.1/os-security-groups => generated 242 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 18:59:14.268763 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-24289ae5-3668-4967-8f3b-f9934387885f tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:59:14.270518 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-24289ae5-3668-4967-8f3b-f9934387885f tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] [instance: 5e7ed73c-1243-4adf-94a2-09f7bf73f6fd] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:59:14.282803 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-24289ae5-3668-4967-8f3b-f9934387885f tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:59:14.283744 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-24289ae5-3668-4967-8f3b-f9934387885f tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:59:14.284511 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-24289ae5-3668-4967-8f3b-f9934387885f tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:59:14.285840 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-24289ae5-3668-4967-8f3b-f9934387885f tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:59:14.287589 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-24289ae5-3668-4967-8f3b-f9934387885f tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:59:14.288203 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-24289ae5-3668-4967-8f3b-f9934387885f tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:59:14.308361 n-d-863052-2 devstack@n-api.service[121403]: DEBUG dbcounter [-] [121403] Writing DB stats nova_cell1:SELECT=100 {{(pid=121403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 18:59:14.371732 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-0b837899-11d3-446c-9745-46b782dfa6e3 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72117f17294649d6b8bc16c66c7efab2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45d4c047d3c44324a27a27831236ab0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:59:14.387096 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-0b837899-11d3-446c-9745-46b782dfa6e3 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] 10.222.0.13 "GET /compute/v2.1/servers/9249c81d-e57b-4985-a398-8ad97526d5c7" status: 200 len: 1536 microversion: 2.1 time: 0.615635 Nov 01 18:59:14.397708 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 724/1403] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:59:13 2022] GET /compute/v2.1/servers/9249c81d-e57b-4985-a398-8ad97526d5c7 => generated 1536 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:59:14.405496 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-c640b09d-75dd-4567-9f6f-3c747e1093b4 tempest-SecurityGroupsNegativeTestJSON-816380628 tempest-SecurityGroupsNegativeTestJSON-816380628-project] Calling method '.version_select at 0x7f0ae2ccc310>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:59:14.616368 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-24289ae5-3668-4967-8f3b-f9934387885f tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0290a6bb8bc24b8988a925327ac0381c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86941784237549838bba63ce88053b88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:59:14.628799 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-24289ae5-3668-4967-8f3b-f9934387885f tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] 10.222.0.13 "GET /compute/v2.1/servers/5e7ed73c-1243-4adf-94a2-09f7bf73f6fd" status: 200 len: 1318 microversion: 2.1 time: 0.374016 Nov 01 18:59:14.629743 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 680/1404] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:59:14 2022] GET /compute/v2.1/servers/5e7ed73c-1243-4adf-94a2-09f7bf73f6fd => generated 1318 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:59:14.634412 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-e41a57c5-8dce-4e8c-8545-af56b472837e tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:59:14.641315 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-e41a57c5-8dce-4e8c-8545-af56b472837e tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] [instance: ed4798be-a45e-46f5-8f7e-1165f6479bd1] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:59:14.656195 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-e41a57c5-8dce-4e8c-8545-af56b472837e tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:59:14.657933 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-e41a57c5-8dce-4e8c-8545-af56b472837e tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:59:14.658561 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-e41a57c5-8dce-4e8c-8545-af56b472837e tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:59:14.659463 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-e41a57c5-8dce-4e8c-8545-af56b472837e tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:59:14.661502 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-e41a57c5-8dce-4e8c-8545-af56b472837e tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:59:14.662124 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-e41a57c5-8dce-4e8c-8545-af56b472837e tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:59:15.008342 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-e41a57c5-8dce-4e8c-8545-af56b472837e tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a63d69c99a546f0af16329cff3ca717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a1bb191cff948e99c008b5e861ce4a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:59:15.025792 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-e41a57c5-8dce-4e8c-8545-af56b472837e tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] 10.222.0.13 "GET /compute/v2.1/servers/ed4798be-a45e-46f5-8f7e-1165f6479bd1" status: 200 len: 1501 microversion: 2.1 time: 0.394887 Nov 01 18:59:15.026377 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 681/1405] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:59:14 2022] GET /compute/v2.1/servers/ed4798be-a45e-46f5-8f7e-1165f6479bd1 => generated 1501 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:59:15.031923 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-bccc2536-15e7-42cd-ac28-24ce2267381e tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Action: 'create', calling method: .version_select at 0x7f0ae2262ee0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1030282311", "description": "tempest-description-901101431"}} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 18:59:15.222905 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-c640b09d-75dd-4567-9f6f-3c747e1093b4 tempest-SecurityGroupsNegativeTestJSON-816380628 tempest-SecurityGroupsNegativeTestJSON-816380628-project] 10.222.0.13 "GET /compute/v2.1/os-security-groups" status: 200 len: 707 microversion: 2.1 time: 0.823700 Nov 01 18:59:15.223494 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 725/1406] 10.222.0.13 () {58 vars in 1158 bytes} [Tue Nov 1 18:59:14 2022] GET /compute/v2.1/os-security-groups => generated 707 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 18:59:15.240618 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-11c9571e-e5df-483f-bf1a-92599a7ca057 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:59:15.241634 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-11c9571e-e5df-483f-bf1a-92599a7ca057 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] [instance: 2d525a31-b0be-44cb-8fb7-335075145f08] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:59:15.250439 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-11c9571e-e5df-483f-bf1a-92599a7ca057 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:59:15.251205 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-11c9571e-e5df-483f-bf1a-92599a7ca057 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:59:15.251801 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-11c9571e-e5df-483f-bf1a-92599a7ca057 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:59:15.252891 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-11c9571e-e5df-483f-bf1a-92599a7ca057 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:59:15.253574 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-11c9571e-e5df-483f-bf1a-92599a7ca057 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:59:15.254836 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-11c9571e-e5df-483f-bf1a-92599a7ca057 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:59:15.747002 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-11c9571e-e5df-483f-bf1a-92599a7ca057 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f32f5fba1976432d938e664c7714e52b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b9d4c236b944f9b2e8e502a50a8f8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:59:15.763074 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-11c9571e-e5df-483f-bf1a-92599a7ca057 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] 10.222.0.13 "GET /compute/v2.1/servers/2d525a31-b0be-44cb-8fb7-335075145f08" status: 200 len: 1718 microversion: 2.1 time: 0.524511 Nov 01 18:59:15.763714 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 726/1407] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:59:15 2022] GET /compute/v2.1/servers/2d525a31-b0be-44cb-8fb7-335075145f08 => generated 1718 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:59:15.776213 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-cf458836-dbcc-46f8-8cd0-6962b61677fd tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:59:15.776876 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-cf458836-dbcc-46f8-8cd0-6962b61677fd tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] [instance: a7f88d19-08ee-47bf-9240-7d49afd775e2] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:59:15.791355 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-cf458836-dbcc-46f8-8cd0-6962b61677fd tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:59:15.791867 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-cf458836-dbcc-46f8-8cd0-6962b61677fd tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:59:15.794469 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-cf458836-dbcc-46f8-8cd0-6962b61677fd tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:59:15.795222 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-cf458836-dbcc-46f8-8cd0-6962b61677fd tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:59:15.795729 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-cf458836-dbcc-46f8-8cd0-6962b61677fd tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:59:15.796164 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-cf458836-dbcc-46f8-8cd0-6962b61677fd tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:59:15.903123 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-bccc2536-15e7-42cd-ac28-24ce2267381e tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] 10.222.0.13 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.875464 Nov 01 18:59:15.903720 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 682/1408] 10.222.0.13 () {60 vars in 1180 bytes} [Tue Nov 1 18:59:15 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 877 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 18:59:15.922427 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-9397b68e-7a10-4933-9c08-1708a7c10460 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0873c5e7-09ee-4c00-9413-9c8a1ec9fb8b"}} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 18:59:15.926515 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-9397b68e-7a10-4933-9c08-1708a7c10460 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] [instance: ed4798be-a45e-46f5-8f7e-1165f6479bd1] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:59:15.934110 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-9397b68e-7a10-4933-9c08-1708a7c10460 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:59:15.935202 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-9397b68e-7a10-4933-9c08-1708a7c10460 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:59:15.935820 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-9397b68e-7a10-4933-9c08-1708a7c10460 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:59:15.937718 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-9397b68e-7a10-4933-9c08-1708a7c10460 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:59:15.938479 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-9397b68e-7a10-4933-9c08-1708a7c10460 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:59:15.939220 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-9397b68e-7a10-4933-9c08-1708a7c10460 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:59:16.024728 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.wsgi [None req-9397b68e-7a10-4933-9c08-1708a7c10460 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] HTTP exception thrown: Cannot 'attach_volume' instance ed4798be-a45e-46f5-8f7e-1165f6479bd1 while it is in vm_state rescued Nov 01 18:59:16.027659 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-9397b68e-7a10-4933-9c08-1708a7c10460 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Request method failure captured: Nov 01 18:59:16.027659 n-d-863052-2 devstack@n-api.service[121403]: request: POST /compute/v2.1/servers/ed4798be-a45e-46f5-8f7e-1165f6479bd1/os-volume_attachments HTTP/1.1 Nov 01 18:59:16.027659 n-d-863052-2 devstack@n-api.service[121403]: Accept: application/json Nov 01 18:59:16.027659 n-d-863052-2 devstack@n-api.service[121403]: Accept-Encoding: identity Nov 01 18:59:16.027659 n-d-863052-2 devstack@n-api.service[121403]: Connection: close Nov 01 18:59:16.027659 n-d-863052-2 devstack@n-api.service[121403]: Content-Length: 74 Nov 01 18:59:16.027659 n-d-863052-2 devstack@n-api.service[121403]: Content-Type: application/json Nov 01 18:59:16.027659 n-d-863052-2 devstack@n-api.service[121403]: Host: 10.222.0.13 Nov 01 18:59:16.027659 n-d-863052-2 devstack@n-api.service[121403]: Openstack-System-Scope: None Nov 01 18:59:16.027659 n-d-863052-2 devstack@n-api.service[121403]: User-Agent: python-urllib3/1.26.12 Nov 01 18:59:16.027659 n-d-863052-2 devstack@n-api.service[121403]: X-Auth-Token: gAAAAABjYWwgP3kjyQKi9Uf4PP24jmeKCOPNU51FZoHLreZdbFyZPhRW-EeK2Se64f-CjytM5LjMEtkBLCti_PQz0S3BXRBnTu4aanJgpXShIx2i6Yz4YqCrWhQ373B1BFIdgiChyw2k6U5YvJRz35UfhTE-zhCjFxCXYsQplbVOAVzO2wYqVeI Nov 01 18:59:16.027659 n-d-863052-2 devstack@n-api.service[121403]: X-Domain-Id: None Nov 01 18:59:16.027659 n-d-863052-2 devstack@n-api.service[121403]: X-Domain-Name: None Nov 01 18:59:16.027659 n-d-863052-2 devstack@n-api.service[121403]: X-Identity-Status: Confirmed Nov 01 18:59:16.027659 n-d-863052-2 devstack@n-api.service[121403]: X-Is-Admin-Project: True Nov 01 18:59:16.027659 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Domain-Id: default Nov 01 18:59:16.027659 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Domain-Name: Default Nov 01 18:59:16.027659 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Id: 4a1bb191cff948e99c008b5e861ce4a8 Nov 01 18:59:16.027659 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-215636868 Nov 01 18:59:16.027659 n-d-863052-2 devstack@n-api.service[121403]: X-Role: member,reader Nov 01 18:59:16.027659 n-d-863052-2 devstack@n-api.service[121403]: X-Roles: member,reader Nov 01 18:59:16.029365 n-d-863052-2 devstack@n-api.service[121403]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/4a1bb191cff948e99c008b5e861ce4a8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/4a1bb191cff948e99c008b5e861ce4a8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_4a1bb191cff948e99c008b5e861ce4a8", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/4a1bb191cff948e99c008b5e861ce4a8"}]}] Nov 01 18:59:16.029365 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant: tempest-ServerRescueNegativeTestJSON-215636868 Nov 01 18:59:16.029365 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant-Id: 4a1bb191cff948e99c008b5e861ce4a8 Nov 01 18:59:16.029365 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-215636868 Nov 01 18:59:16.029365 n-d-863052-2 devstack@n-api.service[121403]: X-User: tempest-ServerRescueNegativeTestJSON-215636868-project Nov 01 18:59:16.029365 n-d-863052-2 devstack@n-api.service[121403]: X-User-Domain-Id: default Nov 01 18:59:16.029365 n-d-863052-2 devstack@n-api.service[121403]: X-User-Domain-Name: Default Nov 01 18:59:16.029365 n-d-863052-2 devstack@n-api.service[121403]: X-User-Id: 6a63d69c99a546f0af16329cff3ca717 Nov 01 18:59:16.029365 n-d-863052-2 devstack@n-api.service[121403]: X-User-Name: tempest-ServerRescueNegativeTestJSON-215636868-project Nov 01 18:59:16.029365 n-d-863052-2 devstack@n-api.service[121403]: Nov 01 18:59:16.029365 n-d-863052-2 devstack@n-api.service[121403]: {"volumeAttachment": {"volumeId": "0873c5e7-09ee-4c00-9413-9c8a1ec9fb8b"}} Nov 01 18:59:16.029365 n-d-863052-2 devstack@n-api.service[121403]: method: > Nov 01 18:59:16.030318 n-d-863052-2 devstack@n-api.service[121403]: exception: Cannot 'attach_volume' instance ed4798be-a45e-46f5-8f7e-1165f6479bd1 while it is in vm_state rescued Nov 01 18:59:16.030318 n-d-863052-2 devstack@n-api.service[121403]: action_args: {'server_id': 'ed4798be-a45e-46f5-8f7e-1165f6479bd1', 'body': {'volumeAttachment': {'volumeId': '0873c5e7-09ee-4c00-9413-9c8a1ec9fb8b'}}} Nov 01 18:59:16.030318 n-d-863052-2 devstack@n-api.service[121403]: {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 01 18:59:16.030318 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:59:16.030318 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Nov 01 18:59:16.030318 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Nov 01 18:59:16.030318 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Nov 01 18:59:16.030318 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Nov 01 18:59:16.030318 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Nov 01 18:59:16.030318 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Nov 01 18:59:16.030318 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance ed4798be-a45e-46f5-8f7e-1165f6479bd1 in vm_state rescued. Cannot attach_volume while the instance is in this state. Nov 01 18:59:16.030318 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 18:59:16.030318 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 18:59:16.030318 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 18:59:16.030318 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:59:16.030318 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 18:59:16.030318 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 18:59:16.030318 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 01 18:59:16.030318 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 01 18:59:16.031709 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 01 18:59:16.031709 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 01 18:59:16.031709 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 01 18:59:16.031709 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 01 18:59:16.031709 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 01 18:59:16.031709 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 01 18:59:16.031709 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 01 18:59:16.031709 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 01 18:59:16.031709 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Nov 01 18:59:16.031709 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Nov 01 18:59:16.031709 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Nov 01 18:59:16.031709 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Nov 01 18:59:16.031709 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance ed4798be-a45e-46f5-8f7e-1165f6479bd1 while it is in vm_state rescued Nov 01 18:59:16.031709 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 18:59:16.031709 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 18:59:16.031709 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 18:59:16.031709 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:59:16.031709 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 18:59:16.031709 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 18:59:16.033219 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 01 18:59:16.033219 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 01 18:59:16.033219 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance ed4798be-a45e-46f5-8f7e-1165f6479bd1 while it is in vm_state rescued Nov 01 18:59:16.033219 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 18:59:16.044427 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-9397b68e-7a10-4933-9c08-1708a7c10460 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Returning 409 to user: Cannot 'attach_volume' instance ed4798be-a45e-46f5-8f7e-1165f6479bd1 while it is in vm_state rescued {{(pid=121403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 01 18:59:16.047506 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-9397b68e-7a10-4933-9c08-1708a7c10460 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] 10.222.0.13 "POST /compute/v2.1/servers/ed4798be-a45e-46f5-8f7e-1165f6479bd1/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.142538 Nov 01 18:59:16.048254 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 683/1409] 10.222.0.13 () {60 vars in 1323 bytes} [Tue Nov 1 18:59:15 2022] POST /compute/v2.1/servers/ed4798be-a45e-46f5-8f7e-1165f6479bd1/os-volume_attachments => generated 152 bytes in 144 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Nov 01 18:59:16.067063 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-1a070889-82fd-49e4-812d-832edcbea176 tempest-SecurityGroupsNegativeTestJSON-816380628 tempest-SecurityGroupsNegativeTestJSON-816380628-project] Calling method '.version_select at 0x7f0ae2262d30>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:59:16.165547 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-cf458836-dbcc-46f8-8cd0-6962b61677fd tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:59:16.180599 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-cf458836-dbcc-46f8-8cd0-6962b61677fd tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:59:16.184239 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-cf458836-dbcc-46f8-8cd0-6962b61677fd tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:59:16.185732 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-cf458836-dbcc-46f8-8cd0-6962b61677fd tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] 10.222.0.13 "GET /compute/v2.1/servers/a7f88d19-08ee-47bf-9240-7d49afd775e2" status: 200 len: 1812 microversion: 2.25 time: 0.419191 Nov 01 18:59:16.187872 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 727/1410] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 18:59:15 2022] GET /compute/v2.1/servers/a7f88d19-08ee-47bf-9240-7d49afd775e2 => generated 1812 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 18:59:16.196702 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-d01fd054-f74f-4d2c-bba7-c256ad145639 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:59:16.205750 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-d01fd054-f74f-4d2c-bba7-c256ad145639 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] [instance: 9249c81d-e57b-4985-a398-8ad97526d5c7] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:59:16.215539 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-d01fd054-f74f-4d2c-bba7-c256ad145639 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:59:16.216098 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-d01fd054-f74f-4d2c-bba7-c256ad145639 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:59:16.216471 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-d01fd054-f74f-4d2c-bba7-c256ad145639 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:59:16.217510 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-d01fd054-f74f-4d2c-bba7-c256ad145639 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:59:16.218284 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-d01fd054-f74f-4d2c-bba7-c256ad145639 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:59:16.218404 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-d01fd054-f74f-4d2c-bba7-c256ad145639 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:59:16.458033 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-d01fd054-f74f-4d2c-bba7-c256ad145639 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72117f17294649d6b8bc16c66c7efab2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45d4c047d3c44324a27a27831236ab0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:59:16.468849 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-d01fd054-f74f-4d2c-bba7-c256ad145639 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] 10.222.0.13 "GET /compute/v2.1/servers/9249c81d-e57b-4985-a398-8ad97526d5c7" status: 200 len: 1529 microversion: 2.1 time: 0.279512 Nov 01 18:59:16.470179 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 728/1411] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:59:16 2022] GET /compute/v2.1/servers/9249c81d-e57b-4985-a398-8ad97526d5c7 => generated 1529 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:59:16.475996 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-8bb01ce7-1ad4-4fa0-94eb-90b890741f11 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:59:16.476936 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-8bb01ce7-1ad4-4fa0-94eb-90b890741f11 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] [instance: 5e7ed73c-1243-4adf-94a2-09f7bf73f6fd] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:59:16.484432 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-8bb01ce7-1ad4-4fa0-94eb-90b890741f11 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:59:16.485199 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-8bb01ce7-1ad4-4fa0-94eb-90b890741f11 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:59:16.485939 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-8bb01ce7-1ad4-4fa0-94eb-90b890741f11 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:59:16.487273 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-8bb01ce7-1ad4-4fa0-94eb-90b890741f11 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:59:16.488024 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-8bb01ce7-1ad4-4fa0-94eb-90b890741f11 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:59:16.488657 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-8bb01ce7-1ad4-4fa0-94eb-90b890741f11 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:59:16.548302 n-d-863052-2 devstack@n-api.service[121403]: DEBUG neutronclient.v2_0.client [None req-1a070889-82fd-49e4-812d-832edcbea176 tempest-SecurityGroupsNegativeTestJSON-816380628 tempest-SecurityGroupsNegativeTestJSON-816380628-project] Error message: {"NeutronError": {"type": "SecurityGroupCannotRemoveDefault", "message": "Insufficient rights for removing default security group.", "detail": ""}} {{(pid=121403) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Nov 01 18:59:16.549251 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.wsgi [None req-1a070889-82fd-49e4-812d-832edcbea176 tempest-SecurityGroupsNegativeTestJSON-816380628 tempest-SecurityGroupsNegativeTestJSON-816380628-project] HTTP exception thrown: Insufficient rights for removing default security group. Nov 01 18:59:16.549251 n-d-863052-2 devstack@n-api.service[121403]: Neutron server returns request_ids: ['req-9d9ecd7a-9011-4de3-ba46-322aded64c66'] Nov 01 18:59:16.552738 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-1a070889-82fd-49e4-812d-832edcbea176 tempest-SecurityGroupsNegativeTestJSON-816380628 tempest-SecurityGroupsNegativeTestJSON-816380628-project] Request method failure captured: Nov 01 18:59:16.552738 n-d-863052-2 devstack@n-api.service[121403]: request: DELETE /compute/v2.1/os-security-groups/69589586-b430-4682-abfa-56cf32489137 HTTP/1.1 Nov 01 18:59:16.552738 n-d-863052-2 devstack@n-api.service[121403]: Accept: application/json Nov 01 18:59:16.552738 n-d-863052-2 devstack@n-api.service[121403]: Accept-Encoding: identity Nov 01 18:59:16.552738 n-d-863052-2 devstack@n-api.service[121403]: Connection: close Nov 01 18:59:16.552738 n-d-863052-2 devstack@n-api.service[121403]: Content-Length: 0 Nov 01 18:59:16.552738 n-d-863052-2 devstack@n-api.service[121403]: Content-Type: application/json Nov 01 18:59:16.552738 n-d-863052-2 devstack@n-api.service[121403]: Host: 10.222.0.13 Nov 01 18:59:16.552738 n-d-863052-2 devstack@n-api.service[121403]: Openstack-System-Scope: None Nov 01 18:59:16.552738 n-d-863052-2 devstack@n-api.service[121403]: User-Agent: python-urllib3/1.26.12 Nov 01 18:59:16.552738 n-d-863052-2 devstack@n-api.service[121403]: X-Auth-Token: gAAAAABjYWyAVIT6nghPOpxWrmuRg1XlzmzhQemSsjUlm2xAaKvA4OYM-Mvj9JaaSyJJeQgXqQjxK1tCp4f08-lRTQfL4za0iHqRurXwNmJE6Fo1zdQFhDybKl4NCOfcqzVNVEMkVA3ycDBlU9_IbQtR_D76qq02FcWMJDi3BEWE5GJS3jhpQ2Q Nov 01 18:59:16.552738 n-d-863052-2 devstack@n-api.service[121403]: X-Domain-Id: None Nov 01 18:59:16.552738 n-d-863052-2 devstack@n-api.service[121403]: X-Domain-Name: None Nov 01 18:59:16.552738 n-d-863052-2 devstack@n-api.service[121403]: X-Identity-Status: Confirmed Nov 01 18:59:16.552738 n-d-863052-2 devstack@n-api.service[121403]: X-Is-Admin-Project: True Nov 01 18:59:16.552738 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Domain-Id: default Nov 01 18:59:16.552738 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Domain-Name: Default Nov 01 18:59:16.552738 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Id: 45dd7634ccd9442aaa6171247c0935f3 Nov 01 18:59:16.552738 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-816380628 Nov 01 18:59:16.552738 n-d-863052-2 devstack@n-api.service[121403]: X-Role: member,reader Nov 01 18:59:16.552738 n-d-863052-2 devstack@n-api.service[121403]: X-Roles: member,reader Nov 01 18:59:16.554432 n-d-863052-2 devstack@n-api.service[121403]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/45dd7634ccd9442aaa6171247c0935f3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/45dd7634ccd9442aaa6171247c0935f3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_45dd7634ccd9442aaa6171247c0935f3", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/45dd7634ccd9442aaa6171247c0935f3"}]}] Nov 01 18:59:16.554432 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-816380628 Nov 01 18:59:16.554432 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant-Id: 45dd7634ccd9442aaa6171247c0935f3 Nov 01 18:59:16.554432 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-816380628 Nov 01 18:59:16.554432 n-d-863052-2 devstack@n-api.service[121403]: X-User: tempest-SecurityGroupsNegativeTestJSON-816380628-project Nov 01 18:59:16.554432 n-d-863052-2 devstack@n-api.service[121403]: X-User-Domain-Id: default Nov 01 18:59:16.554432 n-d-863052-2 devstack@n-api.service[121403]: X-User-Domain-Name: Default Nov 01 18:59:16.554432 n-d-863052-2 devstack@n-api.service[121403]: X-User-Id: 0cb59aa6ec564bf88774c591b6b2fb28 Nov 01 18:59:16.554432 n-d-863052-2 devstack@n-api.service[121403]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-816380628-project Nov 01 18:59:16.554432 n-d-863052-2 devstack@n-api.service[121403]: method: Nov 01 18:59:16.554432 n-d-863052-2 devstack@n-api.service[121403]: exception: Insufficient rights for removing default security group. Nov 01 18:59:16.554432 n-d-863052-2 devstack@n-api.service[121403]: Neutron server returns request_ids: ['req-9d9ecd7a-9011-4de3-ba46-322aded64c66'] Nov 01 18:59:16.554432 n-d-863052-2 devstack@n-api.service[121403]: action_args: {'id': '69589586-b430-4682-abfa-56cf32489137'} Nov 01 18:59:16.555433 n-d-863052-2 devstack@n-api.service[121403]: {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 01 18:59:16.555433 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:59:16.555433 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Nov 01 18:59:16.555433 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Nov 01 18:59:16.555433 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 01 18:59:16.555433 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 01 18:59:16.555433 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1073, in delete_security_group Nov 01 18:59:16.555433 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Nov 01 18:59:16.555433 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 01 18:59:16.555433 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 01 18:59:16.555433 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Nov 01 18:59:16.555433 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Nov 01 18:59:16.555433 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 01 18:59:16.555433 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 01 18:59:16.555433 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 01 18:59:16.555433 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 01 18:59:16.555433 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 01 18:59:16.555433 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 01 18:59:16.555433 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Nov 01 18:59:16.556870 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Nov 01 18:59:16.556870 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 01 18:59:16.556870 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 01 18:59:16.556870 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Nov 01 18:59:16.556870 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Nov 01 18:59:16.556870 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Nov 01 18:59:16.556870 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Nov 01 18:59:16.556870 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Insufficient rights for removing default security group. Nov 01 18:59:16.556870 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9d9ecd7a-9011-4de3-ba46-322aded64c66'] Nov 01 18:59:16.556870 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 18:59:16.556870 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 18:59:16.556870 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 18:59:16.556870 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:59:16.556870 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Nov 01 18:59:16.556870 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Nov 01 18:59:16.556870 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Nov 01 18:59:16.556870 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Nov 01 18:59:16.556870 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Insufficient rights for removing default security group. Nov 01 18:59:16.556870 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9d9ecd7a-9011-4de3-ba46-322aded64c66'] Nov 01 18:59:16.558267 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 18:59:16.558267 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 18:59:16.558267 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 18:59:16.558267 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:59:16.558267 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 18:59:16.558267 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 18:59:16.558267 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 01 18:59:16.558267 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 01 18:59:16.558267 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 01 18:59:16.558267 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 01 18:59:16.558267 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 01 18:59:16.558267 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 01 18:59:16.558267 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Nov 01 18:59:16.558267 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Nov 01 18:59:16.558267 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Insufficient rights for removing default security group. Nov 01 18:59:16.558267 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9d9ecd7a-9011-4de3-ba46-322aded64c66'] Nov 01 18:59:16.558267 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 18:59:16.558267 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 18:59:16.558267 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 18:59:16.558267 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:59:16.558267 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 18:59:16.559797 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 18:59:16.559797 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 01 18:59:16.559797 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 01 18:59:16.559797 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Insufficient rights for removing default security group. Nov 01 18:59:16.559797 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9d9ecd7a-9011-4de3-ba46-322aded64c66'] Nov 01 18:59:16.559797 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 18:59:16.561120 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-1a070889-82fd-49e4-812d-832edcbea176 tempest-SecurityGroupsNegativeTestJSON-816380628 tempest-SecurityGroupsNegativeTestJSON-816380628-project] Returning 400 to user: Insufficient rights for removing default security group. Nov 01 18:59:16.561120 n-d-863052-2 devstack@n-api.service[121403]: Neutron server returns request_ids: ['req-9d9ecd7a-9011-4de3-ba46-322aded64c66'] {{(pid=121403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 01 18:59:16.563104 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-1a070889-82fd-49e4-812d-832edcbea176 tempest-SecurityGroupsNegativeTestJSON-816380628 tempest-SecurityGroupsNegativeTestJSON-816380628-project] 10.222.0.13 "DELETE /compute/v2.1/os-security-groups/69589586-b430-4682-abfa-56cf32489137" status: 400 len: 182 microversion: 2.1 time: 0.501931 Nov 01 18:59:16.569634 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 684/1412] 10.222.0.13 () {58 vars in 1272 bytes} [Tue Nov 1 18:59:16 2022] DELETE /compute/v2.1/os-security-groups/69589586-b430-4682-abfa-56cf32489137 => generated 182 bytes in 504 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 01 18:59:16.575920 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-319cdc84-2726-4c71-9f4a-4d19bf13bd87 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 18:59:16.576457 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-319cdc84-2726-4c71-9f4a-4d19bf13bd87 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] [instance: ed4798be-a45e-46f5-8f7e-1165f6479bd1] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:59:16.582774 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-319cdc84-2726-4c71-9f4a-4d19bf13bd87 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:59:16.583271 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-319cdc84-2726-4c71-9f4a-4d19bf13bd87 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:59:16.583709 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-319cdc84-2726-4c71-9f4a-4d19bf13bd87 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:59:16.584418 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-319cdc84-2726-4c71-9f4a-4d19bf13bd87 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:59:16.584935 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-319cdc84-2726-4c71-9f4a-4d19bf13bd87 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:59:16.585371 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-319cdc84-2726-4c71-9f4a-4d19bf13bd87 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:59:16.693353 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-319cdc84-2726-4c71-9f4a-4d19bf13bd87 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] 10.222.0.13 "POST /compute/v2.1/servers/ed4798be-a45e-46f5-8f7e-1165f6479bd1/action" status: 202 len: 0 microversion: 2.1 time: 0.127555 Nov 01 18:59:16.694837 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 685/1413] 10.222.0.13 () {60 vars in 1278 bytes} [Tue Nov 1 18:59:16 2022] POST /compute/v2.1/servers/ed4798be-a45e-46f5-8f7e-1165f6479bd1/action => generated 0 bytes in 130 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 01 18:59:16.703506 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-52e2e743-2ad0-4b34-aa5b-c6b89882d3dd tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-1868475637", "imageRef": "2d4a0047-1b9e-445f-8af8-1b5c9d93e881", "flavorRef": "452", "networks": [{"uuid": "18661d90-d433-474a-b0e5-f9a4e975f896"}]}} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 18:59:16.723234 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-8bb01ce7-1ad4-4fa0-94eb-90b890741f11 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0290a6bb8bc24b8988a925327ac0381c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86941784237549838bba63ce88053b88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:59:16.748075 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-8bb01ce7-1ad4-4fa0-94eb-90b890741f11 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] 10.222.0.13 "GET /compute/v2.1/servers/5e7ed73c-1243-4adf-94a2-09f7bf73f6fd" status: 200 len: 1468 microversion: 2.1 time: 0.276342 Nov 01 18:59:16.750355 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 729/1414] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:59:16 2022] GET /compute/v2.1/servers/5e7ed73c-1243-4adf-94a2-09f7bf73f6fd => generated 1468 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:59:16.775579 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.network.neutron [None req-52e2e743-2ad0-4b34-aa5b-c6b89882d3dd tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] validate_networks() for [('18661d90-d433-474a-b0e5-f9a4e975f896', None, None, None, None, None)] {{(pid=121403) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 01 18:59:16.776473 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-742c238b-b0ea-4f3f-907b-82c3ca05a752 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:59:16.779269 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-742c238b-b0ea-4f3f-907b-82c3ca05a752 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] [instance: 9249c81d-e57b-4985-a398-8ad97526d5c7] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:59:16.817543 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-742c238b-b0ea-4f3f-907b-82c3ca05a752 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:59:16.818035 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-742c238b-b0ea-4f3f-907b-82c3ca05a752 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:59:16.818480 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-742c238b-b0ea-4f3f-907b-82c3ca05a752 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:59:16.826333 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-742c238b-b0ea-4f3f-907b-82c3ca05a752 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:59:16.827378 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-742c238b-b0ea-4f3f-907b-82c3ca05a752 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:59:16.827836 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-742c238b-b0ea-4f3f-907b-82c3ca05a752 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:59:17.270759 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-742c238b-b0ea-4f3f-907b-82c3ca05a752 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72117f17294649d6b8bc16c66c7efab2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45d4c047d3c44324a27a27831236ab0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:59:17.284393 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-742c238b-b0ea-4f3f-907b-82c3ca05a752 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] 10.222.0.13 "GET /compute/v2.1/servers/9249c81d-e57b-4985-a398-8ad97526d5c7" status: 200 len: 1529 microversion: 2.1 time: 0.525542 Nov 01 18:59:17.286142 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 730/1415] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:59:16 2022] GET /compute/v2.1/servers/9249c81d-e57b-4985-a398-8ad97526d5c7 => generated 1529 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:59:17.291421 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-7a7f6019-03b0-4e09-8855-4bdc6f662c90 tempest-SecurityGroupsNegativeTestJSON-816380628 tempest-SecurityGroupsNegativeTestJSON-816380628-project] Calling method '.version_select at 0x7f0ae2b77160>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:59:17.347645 n-d-863052-2 devstack@n-api.service[121402]: DEBUG neutronclient.v2_0.client [None req-7a7f6019-03b0-4e09-8855-4bdc6f662c90 tempest-SecurityGroupsNegativeTestJSON-816380628 tempest-SecurityGroupsNegativeTestJSON-816380628-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group dc0f1064-9e4f-4e53-b90e-9fabf2ecae4c does not exist", "detail": ""}} {{(pid=121402) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Nov 01 18:59:17.348248 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.network.security_group_api [None req-7a7f6019-03b0-4e09-8855-4bdc6f662c90 tempest-SecurityGroupsNegativeTestJSON-816380628 tempest-SecurityGroupsNegativeTestJSON-816380628-project] Neutron security group dc0f1064-9e4f-4e53-b90e-9fabf2ecae4c not found {{(pid=121402) get /opt/stack/nova/nova/network/security_group_api.py:313}} Nov 01 18:59:17.348816 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.wsgi [None req-7a7f6019-03b0-4e09-8855-4bdc6f662c90 tempest-SecurityGroupsNegativeTestJSON-816380628 tempest-SecurityGroupsNegativeTestJSON-816380628-project] HTTP exception thrown: Security group dc0f1064-9e4f-4e53-b90e-9fabf2ecae4c does not exist Nov 01 18:59:17.348816 n-d-863052-2 devstack@n-api.service[121402]: Neutron server returns request_ids: ['req-61c4a248-5bd6-4f51-a79a-8282792fc8b5'] Nov 01 18:59:17.351177 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-7a7f6019-03b0-4e09-8855-4bdc6f662c90 tempest-SecurityGroupsNegativeTestJSON-816380628 tempest-SecurityGroupsNegativeTestJSON-816380628-project] Request method failure captured: Nov 01 18:59:17.351177 n-d-863052-2 devstack@n-api.service[121402]: request: GET /compute/v2.1/os-security-groups/dc0f1064-9e4f-4e53-b90e-9fabf2ecae4c HTTP/1.1 Nov 01 18:59:17.351177 n-d-863052-2 devstack@n-api.service[121402]: Accept: application/json Nov 01 18:59:17.351177 n-d-863052-2 devstack@n-api.service[121402]: Accept-Encoding: identity Nov 01 18:59:17.351177 n-d-863052-2 devstack@n-api.service[121402]: Connection: close Nov 01 18:59:17.351177 n-d-863052-2 devstack@n-api.service[121402]: Content-Length: 0 Nov 01 18:59:17.351177 n-d-863052-2 devstack@n-api.service[121402]: Content-Type: application/json Nov 01 18:59:17.351177 n-d-863052-2 devstack@n-api.service[121402]: Host: 10.222.0.13 Nov 01 18:59:17.351177 n-d-863052-2 devstack@n-api.service[121402]: Openstack-System-Scope: None Nov 01 18:59:17.351177 n-d-863052-2 devstack@n-api.service[121402]: User-Agent: python-urllib3/1.26.12 Nov 01 18:59:17.351177 n-d-863052-2 devstack@n-api.service[121402]: X-Auth-Token: gAAAAABjYWyAVIT6nghPOpxWrmuRg1XlzmzhQemSsjUlm2xAaKvA4OYM-Mvj9JaaSyJJeQgXqQjxK1tCp4f08-lRTQfL4za0iHqRurXwNmJE6Fo1zdQFhDybKl4NCOfcqzVNVEMkVA3ycDBlU9_IbQtR_D76qq02FcWMJDi3BEWE5GJS3jhpQ2Q Nov 01 18:59:17.351177 n-d-863052-2 devstack@n-api.service[121402]: X-Domain-Id: None Nov 01 18:59:17.351177 n-d-863052-2 devstack@n-api.service[121402]: X-Domain-Name: None Nov 01 18:59:17.351177 n-d-863052-2 devstack@n-api.service[121402]: X-Identity-Status: Confirmed Nov 01 18:59:17.351177 n-d-863052-2 devstack@n-api.service[121402]: X-Is-Admin-Project: True Nov 01 18:59:17.351177 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Domain-Id: default Nov 01 18:59:17.351177 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Domain-Name: Default Nov 01 18:59:17.351177 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Id: 45dd7634ccd9442aaa6171247c0935f3 Nov 01 18:59:17.351177 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-816380628 Nov 01 18:59:17.351177 n-d-863052-2 devstack@n-api.service[121402]: X-Role: member,reader Nov 01 18:59:17.351177 n-d-863052-2 devstack@n-api.service[121402]: X-Roles: member,reader Nov 01 18:59:17.352832 n-d-863052-2 devstack@n-api.service[121402]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/45dd7634ccd9442aaa6171247c0935f3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/45dd7634ccd9442aaa6171247c0935f3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_45dd7634ccd9442aaa6171247c0935f3", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/45dd7634ccd9442aaa6171247c0935f3"}]}] Nov 01 18:59:17.352832 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-816380628 Nov 01 18:59:17.352832 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant-Id: 45dd7634ccd9442aaa6171247c0935f3 Nov 01 18:59:17.352832 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-816380628 Nov 01 18:59:17.352832 n-d-863052-2 devstack@n-api.service[121402]: X-User: tempest-SecurityGroupsNegativeTestJSON-816380628-project Nov 01 18:59:17.352832 n-d-863052-2 devstack@n-api.service[121402]: X-User-Domain-Id: default Nov 01 18:59:17.352832 n-d-863052-2 devstack@n-api.service[121402]: X-User-Domain-Name: Default Nov 01 18:59:17.352832 n-d-863052-2 devstack@n-api.service[121402]: X-User-Id: 0cb59aa6ec564bf88774c591b6b2fb28 Nov 01 18:59:17.352832 n-d-863052-2 devstack@n-api.service[121402]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-816380628-project Nov 01 18:59:17.352832 n-d-863052-2 devstack@n-api.service[121402]: method: Nov 01 18:59:17.352832 n-d-863052-2 devstack@n-api.service[121402]: exception: Security group dc0f1064-9e4f-4e53-b90e-9fabf2ecae4c does not exist Nov 01 18:59:17.352832 n-d-863052-2 devstack@n-api.service[121402]: Neutron server returns request_ids: ['req-61c4a248-5bd6-4f51-a79a-8282792fc8b5'] Nov 01 18:59:17.352832 n-d-863052-2 devstack@n-api.service[121402]: action_args: {'id': 'dc0f1064-9e4f-4e53-b90e-9fabf2ecae4c'} Nov 01 18:59:17.353665 n-d-863052-2 devstack@n-api.service[121402]: {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 01 18:59:17.353665 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:59:17.353665 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Nov 01 18:59:17.353665 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Nov 01 18:59:17.353665 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 01 18:59:17.353665 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 01 18:59:17.353665 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Nov 01 18:59:17.353665 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Nov 01 18:59:17.353665 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 01 18:59:17.353665 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 01 18:59:17.353665 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 01 18:59:17.353665 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 01 18:59:17.353665 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 01 18:59:17.353665 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 01 18:59:17.353665 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 01 18:59:17.353665 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 01 18:59:17.353665 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 01 18:59:17.353665 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 01 18:59:17.353665 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Nov 01 18:59:17.354810 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Nov 01 18:59:17.354810 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 01 18:59:17.354810 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 01 18:59:17.354810 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Nov 01 18:59:17.354810 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Nov 01 18:59:17.354810 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Nov 01 18:59:17.354810 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Nov 01 18:59:17.354810 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group dc0f1064-9e4f-4e53-b90e-9fabf2ecae4c does not exist Nov 01 18:59:17.354810 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-61c4a248-5bd6-4f51-a79a-8282792fc8b5'] Nov 01 18:59:17.354810 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 18:59:17.354810 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 18:59:17.354810 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 18:59:17.354810 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:59:17.354810 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Nov 01 18:59:17.354810 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Nov 01 18:59:17.354810 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Nov 01 18:59:17.354810 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Nov 01 18:59:17.354810 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group dc0f1064-9e4f-4e53-b90e-9fabf2ecae4c does not exist Nov 01 18:59:17.355898 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-61c4a248-5bd6-4f51-a79a-8282792fc8b5'] Nov 01 18:59:17.355898 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 18:59:17.355898 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 18:59:17.355898 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 18:59:17.355898 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:59:17.355898 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 18:59:17.355898 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 18:59:17.355898 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 01 18:59:17.355898 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 01 18:59:17.355898 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 01 18:59:17.355898 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 01 18:59:17.355898 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 01 18:59:17.355898 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 01 18:59:17.355898 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Nov 01 18:59:17.355898 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Nov 01 18:59:17.355898 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group dc0f1064-9e4f-4e53-b90e-9fabf2ecae4c does not exist Nov 01 18:59:17.355898 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-61c4a248-5bd6-4f51-a79a-8282792fc8b5'] Nov 01 18:59:17.355898 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 18:59:17.355898 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 18:59:17.355898 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 18:59:17.355898 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:59:17.359162 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 18:59:17.359162 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 18:59:17.359162 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 01 18:59:17.359162 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 01 18:59:17.359162 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group dc0f1064-9e4f-4e53-b90e-9fabf2ecae4c does not exist Nov 01 18:59:17.359162 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-61c4a248-5bd6-4f51-a79a-8282792fc8b5'] Nov 01 18:59:17.359162 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 18:59:17.361501 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-7a7f6019-03b0-4e09-8855-4bdc6f662c90 tempest-SecurityGroupsNegativeTestJSON-816380628 tempest-SecurityGroupsNegativeTestJSON-816380628-project] Returning 404 to user: Security group dc0f1064-9e4f-4e53-b90e-9fabf2ecae4c does not exist Nov 01 18:59:17.361501 n-d-863052-2 devstack@n-api.service[121402]: Neutron server returns request_ids: ['req-61c4a248-5bd6-4f51-a79a-8282792fc8b5'] {{(pid=121402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 01 18:59:17.371091 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-7a7f6019-03b0-4e09-8855-4bdc6f662c90 tempest-SecurityGroupsNegativeTestJSON-816380628 tempest-SecurityGroupsNegativeTestJSON-816380628-project] 10.222.0.13 "GET /compute/v2.1/os-security-groups/dc0f1064-9e4f-4e53-b90e-9fabf2ecae4c" status: 404 len: 194 microversion: 2.1 time: 0.082709 Nov 01 18:59:17.385159 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 731/1416] 10.222.0.13 () {58 vars in 1269 bytes} [Tue Nov 1 18:59:17 2022] GET /compute/v2.1/os-security-groups/dc0f1064-9e4f-4e53-b90e-9fabf2ecae4c => generated 194 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 01 18:59:17.393274 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-cb17b6a3-831e-419c-a7b9-2c1d43bd39ad tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:59:17.394217 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-cb17b6a3-831e-419c-a7b9-2c1d43bd39ad tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] [instance: ed4798be-a45e-46f5-8f7e-1165f6479bd1] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:59:17.401423 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-cb17b6a3-831e-419c-a7b9-2c1d43bd39ad tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:59:17.402282 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-cb17b6a3-831e-419c-a7b9-2c1d43bd39ad tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:59:17.403051 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-cb17b6a3-831e-419c-a7b9-2c1d43bd39ad tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:59:17.403993 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-cb17b6a3-831e-419c-a7b9-2c1d43bd39ad tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:59:17.404999 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-cb17b6a3-831e-419c-a7b9-2c1d43bd39ad tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:59:17.405663 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-cb17b6a3-831e-419c-a7b9-2c1d43bd39ad tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:59:17.607577 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-cb17b6a3-831e-419c-a7b9-2c1d43bd39ad tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a63d69c99a546f0af16329cff3ca717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a1bb191cff948e99c008b5e861ce4a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:59:17.621856 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-cb17b6a3-831e-419c-a7b9-2c1d43bd39ad tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] 10.222.0.13 "GET /compute/v2.1/servers/ed4798be-a45e-46f5-8f7e-1165f6479bd1" status: 200 len: 1509 microversion: 2.1 time: 0.233113 Nov 01 18:59:17.623216 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 732/1417] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:59:17 2022] GET /compute/v2.1/servers/ed4798be-a45e-46f5-8f7e-1165f6479bd1 => generated 1509 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:59:17.636907 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-6c421b34-7756-4213-992d-32625a3d1912 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:59:17.645512 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-6c421b34-7756-4213-992d-32625a3d1912 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0290a6bb8bc24b8988a925327ac0381c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86941784237549838bba63ce88053b88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:59:17.657034 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-6c421b34-7756-4213-992d-32625a3d1912 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Searching by: {'reservation_id': 'r-5mogninz', 'deleted': False, 'project_id': '86941784237549838bba63ce88053b88'} {{(pid=121402) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 01 18:59:17.665258 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-6c421b34-7756-4213-992d-32625a3d1912 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:59:17.666096 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-6c421b34-7756-4213-992d-32625a3d1912 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:59:17.666764 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-6c421b34-7756-4213-992d-32625a3d1912 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:59:17.667816 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-6c421b34-7756-4213-992d-32625a3d1912 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:59:17.668728 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-6c421b34-7756-4213-992d-32625a3d1912 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:59:17.669597 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-6c421b34-7756-4213-992d-32625a3d1912 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:59:17.830551 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.multi_cell_list [None req-6c421b34-7756-4213-992d-32625a3d1912 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=121402) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 01 18:59:17.944053 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-6c421b34-7756-4213-992d-32625a3d1912 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0290a6bb8bc24b8988a925327ac0381c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86941784237549838bba63ce88053b88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:59:17.953966 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-6c421b34-7756-4213-992d-32625a3d1912 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:59:17.955677 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-6c421b34-7756-4213-992d-32625a3d1912 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:59:17.956223 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-6c421b34-7756-4213-992d-32625a3d1912 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:59:18.015866 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.virt.hardware [None req-52e2e743-2ad0-4b34-aa5b-c6b89882d3dd tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Flavor limits 0:0:0 {{(pid=121403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 01 18:59:18.017112 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.virt.hardware [None req-52e2e743-2ad0-4b34-aa5b-c6b89882d3dd tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Image limits 0:0:0 {{(pid=121403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 01 18:59:18.017711 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.virt.hardware [None req-52e2e743-2ad0-4b34-aa5b-c6b89882d3dd tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Flavor pref 0:0:0 {{(pid=121403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 01 18:59:18.018229 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.virt.hardware [None req-52e2e743-2ad0-4b34-aa5b-c6b89882d3dd tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Image pref 0:0:0 {{(pid=121403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 01 18:59:18.018751 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.virt.hardware [None req-52e2e743-2ad0-4b34-aa5b-c6b89882d3dd tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 01 18:59:18.029703 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-52e2e743-2ad0-4b34-aa5b-c6b89882d3dd tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:59:18.030963 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-52e2e743-2ad0-4b34-aa5b-c6b89882d3dd tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:59:18.031653 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-52e2e743-2ad0-4b34-aa5b-c6b89882d3dd tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:59:18.032872 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-52e2e743-2ad0-4b34-aa5b-c6b89882d3dd tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:59:18.033650 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-52e2e743-2ad0-4b34-aa5b-c6b89882d3dd tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:59:18.034307 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-52e2e743-2ad0-4b34-aa5b-c6b89882d3dd tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:59:18.054692 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.quota [None req-52e2e743-2ad0-4b34-aa5b-c6b89882d3dd tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Getting quotas for project a9ef08eba0ef431285fd15a2561b4e5d. Resources: {'cores', 'ram', 'instances'} {{(pid=121403) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 01 18:59:18.060954 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.quota [None req-52e2e743-2ad0-4b34-aa5b-c6b89882d3dd tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Getting quotas for user 55a9c3b6a8c34f068caa50dc10d13a85 and project a9ef08eba0ef431285fd15a2561b4e5d. Resources: {'cores', 'ram', 'instances'} {{(pid=121403) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 01 18:59:18.075701 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-52e2e743-2ad0-4b34-aa5b-c6b89882d3dd tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Going to run 1 instances... {{(pid=121403) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 01 18:59:18.078513 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-52e2e743-2ad0-4b34-aa5b-c6b89882d3dd tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] [instance: 495c1822-a615-4da7-a053-227744a46341] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2d4a0047-1b9e-445f-8af8-1b5c9d93e881',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121403) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 01 18:59:18.088976 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-6c421b34-7756-4213-992d-32625a3d1912 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] 10.222.0.13 "GET /compute/v2.1/servers/detail?reservation_id=r-5mogninz" status: 200 len: 2928 microversion: 2.1 time: 0.463722 Nov 01 18:59:18.104608 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 733/1418] 10.222.0.13 () {58 vars in 1197 bytes} [Tue Nov 1 18:59:17 2022] GET /compute/v2.1/servers/detail?reservation_id=r-5mogninz => generated 2928 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:59:18.104608 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-90005eb4-1f74-436c-ab9f-20e8c3a5f383 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:59:18.104608 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-90005eb4-1f74-436c-ab9f-20e8c3a5f383 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] [instance: 2d525a31-b0be-44cb-8fb7-335075145f08] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:59:18.104608 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-90005eb4-1f74-436c-ab9f-20e8c3a5f383 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:59:18.104608 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-90005eb4-1f74-436c-ab9f-20e8c3a5f383 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:59:18.105135 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-90005eb4-1f74-436c-ab9f-20e8c3a5f383 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:59:18.109995 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-90005eb4-1f74-436c-ab9f-20e8c3a5f383 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:59:18.109995 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-90005eb4-1f74-436c-ab9f-20e8c3a5f383 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:59:18.109995 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-90005eb4-1f74-436c-ab9f-20e8c3a5f383 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:59:18.151486 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-52e2e743-2ad0-4b34-aa5b-c6b89882d3dd tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.455159 Nov 01 18:59:18.152133 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 686/1419] 10.222.0.13 () {60 vars in 1147 bytes} [Tue Nov 1 18:59:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 1457 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 01 18:59:18.166282 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-99f1a11b-cadd-4fe2-b26b-528e9ce205f9 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:59:18.166999 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-99f1a11b-cadd-4fe2-b26b-528e9ce205f9 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] [instance: a7f88d19-08ee-47bf-9240-7d49afd775e2] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:59:18.176560 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-99f1a11b-cadd-4fe2-b26b-528e9ce205f9 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:59:18.177077 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-99f1a11b-cadd-4fe2-b26b-528e9ce205f9 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:59:18.177591 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-99f1a11b-cadd-4fe2-b26b-528e9ce205f9 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:59:18.178345 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-99f1a11b-cadd-4fe2-b26b-528e9ce205f9 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:59:18.178979 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-99f1a11b-cadd-4fe2-b26b-528e9ce205f9 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:59:18.185232 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-99f1a11b-cadd-4fe2-b26b-528e9ce205f9 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:59:18.279649 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-90005eb4-1f74-436c-ab9f-20e8c3a5f383 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f32f5fba1976432d938e664c7714e52b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b9d4c236b944f9b2e8e502a50a8f8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:59:18.295504 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-90005eb4-1f74-436c-ab9f-20e8c3a5f383 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] 10.222.0.13 "GET /compute/v2.1/servers/2d525a31-b0be-44cb-8fb7-335075145f08" status: 200 len: 1708 microversion: 2.1 time: 0.204440 Nov 01 18:59:18.296248 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 734/1420] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:59:18 2022] GET /compute/v2.1/servers/2d525a31-b0be-44cb-8fb7-335075145f08 => generated 1708 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:59:18.311284 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-a6f74830-6c9b-446a-b768-b3867b35c3a6 tempest-MigrationsAdminTest-1970194929 tempest-MigrationsAdminTest-1970194929-project-admin] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:59:18.318211 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.wsgi [None req-a6f74830-6c9b-446a-b768-b3867b35c3a6 tempest-MigrationsAdminTest-1970194929 tempest-MigrationsAdminTest-1970194929-project-admin] HTTP exception thrown: Flavor 5ea4b6f0-c10d-445f-be41-707913d8c773 could not be found. Nov 01 18:59:18.320006 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-a6f74830-6c9b-446a-b768-b3867b35c3a6 tempest-MigrationsAdminTest-1970194929 tempest-MigrationsAdminTest-1970194929-project-admin] Request method failure captured: Nov 01 18:59:18.320006 n-d-863052-2 devstack@n-api.service[121402]: request: DELETE /compute/v2.1/flavors/5ea4b6f0-c10d-445f-be41-707913d8c773 HTTP/1.1 Nov 01 18:59:18.320006 n-d-863052-2 devstack@n-api.service[121402]: Accept: application/json Nov 01 18:59:18.320006 n-d-863052-2 devstack@n-api.service[121402]: Accept-Encoding: identity Nov 01 18:59:18.320006 n-d-863052-2 devstack@n-api.service[121402]: Connection: close Nov 01 18:59:18.320006 n-d-863052-2 devstack@n-api.service[121402]: Content-Length: 0 Nov 01 18:59:18.320006 n-d-863052-2 devstack@n-api.service[121402]: Content-Type: application/json Nov 01 18:59:18.320006 n-d-863052-2 devstack@n-api.service[121402]: Host: 10.222.0.13 Nov 01 18:59:18.320006 n-d-863052-2 devstack@n-api.service[121402]: Openstack-System-Scope: None Nov 01 18:59:18.320006 n-d-863052-2 devstack@n-api.service[121402]: User-Agent: python-urllib3/1.26.12 Nov 01 18:59:18.320006 n-d-863052-2 devstack@n-api.service[121402]: X-Auth-Token: gAAAAABjYWu3PeaUv3tcHwKgi-gY_8mj66_tNzDj6pXO48Kf5fa7lGUvm0xRxwXh6RTMLWOaw1oiLK134tf3fHh6DzumZ1S8ftu5ZfsfS33keUnyEvm8bPkkqYNzvMWBmLrhMajHVXC6peBxZvzfO4bjHxamqBE2z9JCVs6uMnk0i4VBJWbSiVg Nov 01 18:59:18.320006 n-d-863052-2 devstack@n-api.service[121402]: X-Domain-Id: None Nov 01 18:59:18.320006 n-d-863052-2 devstack@n-api.service[121402]: X-Domain-Name: None Nov 01 18:59:18.320006 n-d-863052-2 devstack@n-api.service[121402]: X-Identity-Status: Confirmed Nov 01 18:59:18.320006 n-d-863052-2 devstack@n-api.service[121402]: X-Is-Admin-Project: True Nov 01 18:59:18.320006 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Domain-Id: default Nov 01 18:59:18.320006 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Domain-Name: Default Nov 01 18:59:18.320006 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Id: 0a3c26d879564e2d868fe0e73372aa90 Nov 01 18:59:18.320006 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Name: tempest-MigrationsAdminTest-1970194929 Nov 01 18:59:18.320006 n-d-863052-2 devstack@n-api.service[121402]: X-Role: admin,member,reader Nov 01 18:59:18.320006 n-d-863052-2 devstack@n-api.service[121402]: X-Roles: admin,member,reader Nov 01 18:59:18.321527 n-d-863052-2 devstack@n-api.service[121402]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/0a3c26d879564e2d868fe0e73372aa90"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/0a3c26d879564e2d868fe0e73372aa90"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_0a3c26d879564e2d868fe0e73372aa90", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/0a3c26d879564e2d868fe0e73372aa90"}]}] Nov 01 18:59:18.321527 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant: tempest-MigrationsAdminTest-1970194929 Nov 01 18:59:18.321527 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant-Id: 0a3c26d879564e2d868fe0e73372aa90 Nov 01 18:59:18.321527 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant-Name: tempest-MigrationsAdminTest-1970194929 Nov 01 18:59:18.321527 n-d-863052-2 devstack@n-api.service[121402]: X-User: tempest-MigrationsAdminTest-1970194929-project-admin Nov 01 18:59:18.321527 n-d-863052-2 devstack@n-api.service[121402]: X-User-Domain-Id: default Nov 01 18:59:18.321527 n-d-863052-2 devstack@n-api.service[121402]: X-User-Domain-Name: Default Nov 01 18:59:18.321527 n-d-863052-2 devstack@n-api.service[121402]: X-User-Id: 4010ab88bbfe478ab22c6e52e1c2c72f Nov 01 18:59:18.321527 n-d-863052-2 devstack@n-api.service[121402]: X-User-Name: tempest-MigrationsAdminTest-1970194929-project-admin Nov 01 18:59:18.321527 n-d-863052-2 devstack@n-api.service[121402]: method: > Nov 01 18:59:18.321527 n-d-863052-2 devstack@n-api.service[121402]: exception: Flavor 5ea4b6f0-c10d-445f-be41-707913d8c773 could not be found. Nov 01 18:59:18.321527 n-d-863052-2 devstack@n-api.service[121402]: action_args: {'id': '5ea4b6f0-c10d-445f-be41-707913d8c773'} Nov 01 18:59:18.322915 n-d-863052-2 devstack@n-api.service[121402]: {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 01 18:59:18.322915 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:59:18.322915 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_manage.py", line 43, in _delete Nov 01 18:59:18.322915 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi flavor.destroy() Nov 01 18:59:18.322915 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Nov 01 18:59:18.322915 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Nov 01 18:59:18.322915 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 558, in destroy Nov 01 18:59:18.322915 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi db_flavor = self._flavor_destroy(self._context, Nov 01 18:59:18.322915 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 544, in _flavor_destroy Nov 01 18:59:18.322915 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return _flavor_destroy(context, flavor_id=flavor_id, flavorid=flavorid) Nov 01 18:59:18.322915 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Nov 01 18:59:18.322915 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Nov 01 18:59:18.322915 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 185, in _flavor_destroy Nov 01 18:59:18.322915 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=(flavor_id or flavorid)) Nov 01 18:59:18.322915 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 5ea4b6f0-c10d-445f-be41-707913d8c773 could not be found. Nov 01 18:59:18.322915 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 18:59:18.322915 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 18:59:18.322915 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 18:59:18.322915 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:59:18.322915 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 18:59:18.324514 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 18:59:18.324514 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 01 18:59:18.324514 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 01 18:59:18.324514 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 01 18:59:18.324514 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 01 18:59:18.324514 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_manage.py", line 45, in _delete Nov 01 18:59:18.324514 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Nov 01 18:59:18.324514 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 5ea4b6f0-c10d-445f-be41-707913d8c773 could not be found. Nov 01 18:59:18.324514 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 18:59:18.324514 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 18:59:18.324514 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 18:59:18.324514 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:59:18.324514 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 18:59:18.324514 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 18:59:18.324514 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 01 18:59:18.324514 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 01 18:59:18.324514 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 5ea4b6f0-c10d-445f-be41-707913d8c773 could not be found. Nov 01 18:59:18.324514 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 18:59:18.325729 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-a6f74830-6c9b-446a-b768-b3867b35c3a6 tempest-MigrationsAdminTest-1970194929 tempest-MigrationsAdminTest-1970194929-project-admin] Returning 404 to user: Flavor 5ea4b6f0-c10d-445f-be41-707913d8c773 could not be found. {{(pid=121402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 01 18:59:18.325729 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-a6f74830-6c9b-446a-b768-b3867b35c3a6 tempest-MigrationsAdminTest-1970194929 tempest-MigrationsAdminTest-1970194929-project-admin] 10.222.0.13 "DELETE /compute/v2.1/flavors/5ea4b6f0-c10d-445f-be41-707913d8c773" status: 404 len: 109 microversion: 2.1 time: 0.023406 Nov 01 18:59:18.325729 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 735/1421] 10.222.0.13 () {58 vars in 1239 bytes} [Tue Nov 1 18:59:18 2022] DELETE /compute/v2.1/flavors/5ea4b6f0-c10d-445f-be41-707913d8c773 => generated 109 bytes in 25 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 01 18:59:18.336825 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-50522e1e-6caf-4ea4-bd99-79a456498fda tempest-SecurityGroupsNegativeTestJSON-816380628 tempest-SecurityGroupsNegativeTestJSON-816380628-project] Action: 'update', calling method: .version_select at 0x7f0ae2b52ee0>, body: {"security_group": {"name": "tempest-sg-1068166812", "description": "tempest-description-1072616569"}} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 18:59:18.365982 n-d-863052-2 devstack@n-api.service[121402]: DEBUG neutronclient.v2_0.client [None req-50522e1e-6caf-4ea4-bd99-79a456498fda tempest-SecurityGroupsNegativeTestJSON-816380628 tempest-SecurityGroupsNegativeTestJSON-816380628-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 17b9471a-d087-4164-8f6a-0dd19839fc52 does not exist", "detail": ""}} {{(pid=121402) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Nov 01 18:59:18.366565 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.network.security_group_api [None req-50522e1e-6caf-4ea4-bd99-79a456498fda tempest-SecurityGroupsNegativeTestJSON-816380628 tempest-SecurityGroupsNegativeTestJSON-816380628-project] Neutron security group 17b9471a-d087-4164-8f6a-0dd19839fc52 not found {{(pid=121402) get /opt/stack/nova/nova/network/security_group_api.py:313}} Nov 01 18:59:18.367253 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.wsgi [None req-50522e1e-6caf-4ea4-bd99-79a456498fda tempest-SecurityGroupsNegativeTestJSON-816380628 tempest-SecurityGroupsNegativeTestJSON-816380628-project] HTTP exception thrown: Security group 17b9471a-d087-4164-8f6a-0dd19839fc52 does not exist Nov 01 18:59:18.367253 n-d-863052-2 devstack@n-api.service[121402]: Neutron server returns request_ids: ['req-736af34b-292c-4abd-a33d-2286539ac9f1'] Nov 01 18:59:18.369031 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-50522e1e-6caf-4ea4-bd99-79a456498fda tempest-SecurityGroupsNegativeTestJSON-816380628 tempest-SecurityGroupsNegativeTestJSON-816380628-project] Request method failure captured: Nov 01 18:59:18.369031 n-d-863052-2 devstack@n-api.service[121402]: request: PUT /compute/v2.1/os-security-groups/17b9471a-d087-4164-8f6a-0dd19839fc52 HTTP/1.1 Nov 01 18:59:18.369031 n-d-863052-2 devstack@n-api.service[121402]: Accept: application/json Nov 01 18:59:18.369031 n-d-863052-2 devstack@n-api.service[121402]: Accept-Encoding: identity Nov 01 18:59:18.369031 n-d-863052-2 devstack@n-api.service[121402]: Connection: close Nov 01 18:59:18.369031 n-d-863052-2 devstack@n-api.service[121402]: Content-Length: 102 Nov 01 18:59:18.369031 n-d-863052-2 devstack@n-api.service[121402]: Content-Type: application/json Nov 01 18:59:18.369031 n-d-863052-2 devstack@n-api.service[121402]: Host: 10.222.0.13 Nov 01 18:59:18.369031 n-d-863052-2 devstack@n-api.service[121402]: Openstack-System-Scope: None Nov 01 18:59:18.369031 n-d-863052-2 devstack@n-api.service[121402]: User-Agent: python-urllib3/1.26.12 Nov 01 18:59:18.369031 n-d-863052-2 devstack@n-api.service[121402]: X-Auth-Token: gAAAAABjYWyAVIT6nghPOpxWrmuRg1XlzmzhQemSsjUlm2xAaKvA4OYM-Mvj9JaaSyJJeQgXqQjxK1tCp4f08-lRTQfL4za0iHqRurXwNmJE6Fo1zdQFhDybKl4NCOfcqzVNVEMkVA3ycDBlU9_IbQtR_D76qq02FcWMJDi3BEWE5GJS3jhpQ2Q Nov 01 18:59:18.369031 n-d-863052-2 devstack@n-api.service[121402]: X-Domain-Id: None Nov 01 18:59:18.369031 n-d-863052-2 devstack@n-api.service[121402]: X-Domain-Name: None Nov 01 18:59:18.369031 n-d-863052-2 devstack@n-api.service[121402]: X-Identity-Status: Confirmed Nov 01 18:59:18.369031 n-d-863052-2 devstack@n-api.service[121402]: X-Is-Admin-Project: True Nov 01 18:59:18.369031 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Domain-Id: default Nov 01 18:59:18.369031 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Domain-Name: Default Nov 01 18:59:18.369031 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Id: 45dd7634ccd9442aaa6171247c0935f3 Nov 01 18:59:18.369031 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-816380628 Nov 01 18:59:18.369031 n-d-863052-2 devstack@n-api.service[121402]: X-Role: member,reader Nov 01 18:59:18.369031 n-d-863052-2 devstack@n-api.service[121402]: X-Roles: member,reader Nov 01 18:59:18.371004 n-d-863052-2 devstack@n-api.service[121402]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/45dd7634ccd9442aaa6171247c0935f3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/45dd7634ccd9442aaa6171247c0935f3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_45dd7634ccd9442aaa6171247c0935f3", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/45dd7634ccd9442aaa6171247c0935f3"}]}] Nov 01 18:59:18.371004 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-816380628 Nov 01 18:59:18.371004 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant-Id: 45dd7634ccd9442aaa6171247c0935f3 Nov 01 18:59:18.371004 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-816380628 Nov 01 18:59:18.371004 n-d-863052-2 devstack@n-api.service[121402]: X-User: tempest-SecurityGroupsNegativeTestJSON-816380628-project Nov 01 18:59:18.371004 n-d-863052-2 devstack@n-api.service[121402]: X-User-Domain-Id: default Nov 01 18:59:18.371004 n-d-863052-2 devstack@n-api.service[121402]: X-User-Domain-Name: Default Nov 01 18:59:18.371004 n-d-863052-2 devstack@n-api.service[121402]: X-User-Id: 0cb59aa6ec564bf88774c591b6b2fb28 Nov 01 18:59:18.371004 n-d-863052-2 devstack@n-api.service[121402]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-816380628-project Nov 01 18:59:18.371004 n-d-863052-2 devstack@n-api.service[121402]: Nov 01 18:59:18.371004 n-d-863052-2 devstack@n-api.service[121402]: {"security_group": {"name": "tempest-sg-1068166812", "description": "tempest-description-1072616569"}} Nov 01 18:59:18.371004 n-d-863052-2 devstack@n-api.service[121402]: method: Nov 01 18:59:18.371004 n-d-863052-2 devstack@n-api.service[121402]: exception: Security group 17b9471a-d087-4164-8f6a-0dd19839fc52 does not exist Nov 01 18:59:18.372037 n-d-863052-2 devstack@n-api.service[121402]: Neutron server returns request_ids: ['req-736af34b-292c-4abd-a33d-2286539ac9f1'] Nov 01 18:59:18.372037 n-d-863052-2 devstack@n-api.service[121402]: action_args: {'id': '17b9471a-d087-4164-8f6a-0dd19839fc52', 'body': {'security_group': {'name': 'tempest-sg-1068166812', 'description': 'tempest-description-1072616569'}}} Nov 01 18:59:18.372037 n-d-863052-2 devstack@n-api.service[121402]: {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 01 18:59:18.372037 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:59:18.372037 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Nov 01 18:59:18.372037 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Nov 01 18:59:18.372037 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 01 18:59:18.372037 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 01 18:59:18.372037 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Nov 01 18:59:18.372037 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Nov 01 18:59:18.372037 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 01 18:59:18.372037 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 01 18:59:18.372037 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 01 18:59:18.372037 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 01 18:59:18.372037 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 01 18:59:18.372037 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 01 18:59:18.372037 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 01 18:59:18.372037 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 01 18:59:18.373229 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 01 18:59:18.373229 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 01 18:59:18.373229 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Nov 01 18:59:18.373229 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Nov 01 18:59:18.373229 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 01 18:59:18.373229 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 01 18:59:18.373229 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Nov 01 18:59:18.373229 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Nov 01 18:59:18.373229 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Nov 01 18:59:18.373229 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Nov 01 18:59:18.373229 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 17b9471a-d087-4164-8f6a-0dd19839fc52 does not exist Nov 01 18:59:18.373229 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-736af34b-292c-4abd-a33d-2286539ac9f1'] Nov 01 18:59:18.373229 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 18:59:18.373229 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 18:59:18.373229 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 18:59:18.373229 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:59:18.373229 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 246, in update Nov 01 18:59:18.373229 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Nov 01 18:59:18.373229 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Nov 01 18:59:18.375732 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Nov 01 18:59:18.375732 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 17b9471a-d087-4164-8f6a-0dd19839fc52 does not exist Nov 01 18:59:18.375732 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-736af34b-292c-4abd-a33d-2286539ac9f1'] Nov 01 18:59:18.375732 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 18:59:18.375732 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 18:59:18.375732 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 18:59:18.375732 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:59:18.375732 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 18:59:18.375732 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 18:59:18.375732 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 01 18:59:18.375732 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 01 18:59:18.375732 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 01 18:59:18.375732 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 01 18:59:18.375732 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 01 18:59:18.375732 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 01 18:59:18.375732 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 248, in update Nov 01 18:59:18.375732 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Nov 01 18:59:18.375732 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 17b9471a-d087-4164-8f6a-0dd19839fc52 does not exist Nov 01 18:59:18.375732 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-736af34b-292c-4abd-a33d-2286539ac9f1'] Nov 01 18:59:18.375732 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 18:59:18.378264 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 18:59:18.378264 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 18:59:18.378264 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:59:18.378264 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 18:59:18.378264 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 18:59:18.378264 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 01 18:59:18.378264 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 01 18:59:18.378264 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 17b9471a-d087-4164-8f6a-0dd19839fc52 does not exist Nov 01 18:59:18.378264 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-736af34b-292c-4abd-a33d-2286539ac9f1'] Nov 01 18:59:18.378264 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 18:59:18.378264 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-50522e1e-6caf-4ea4-bd99-79a456498fda tempest-SecurityGroupsNegativeTestJSON-816380628 tempest-SecurityGroupsNegativeTestJSON-816380628-project] Returning 404 to user: Security group 17b9471a-d087-4164-8f6a-0dd19839fc52 does not exist Nov 01 18:59:18.378264 n-d-863052-2 devstack@n-api.service[121402]: Neutron server returns request_ids: ['req-736af34b-292c-4abd-a33d-2286539ac9f1'] {{(pid=121402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 01 18:59:18.378264 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-50522e1e-6caf-4ea4-bd99-79a456498fda tempest-SecurityGroupsNegativeTestJSON-816380628 tempest-SecurityGroupsNegativeTestJSON-816380628-project] 10.222.0.13 "PUT /compute/v2.1/os-security-groups/17b9471a-d087-4164-8f6a-0dd19839fc52" status: 404 len: 194 microversion: 2.1 time: 0.047953 Nov 01 18:59:18.380137 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 736/1422] 10.222.0.13 () {60 vars in 1290 bytes} [Tue Nov 1 18:59:18 2022] PUT /compute/v2.1/os-security-groups/17b9471a-d087-4164-8f6a-0dd19839fc52 => generated 194 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 01 18:59:18.380137 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-4fd4e70d-1e99-46de-9b64-c9f79c6d3fcd tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] Calling method '.version_select at 0x7f0ae3029940>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:59:18.475170 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-4fd4e70d-1e99-46de-9b64-c9f79c6d3fcd tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] 10.222.0.13 "GET /compute/v2.1/images/27a7ec4e-8455-4687-bd75-e5c5429c154a" status: 200 len: 661 microversion: 2.1 time: 0.101857 Nov 01 18:59:18.484526 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 737/1423] 10.222.0.13 () {58 vars in 1233 bytes} [Tue Nov 1 18:59:18 2022] GET /compute/v2.1/images/27a7ec4e-8455-4687-bd75-e5c5429c154a => generated 661 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 18:59:18.491557 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [req-272bf179-fffe-42ec-bc60-9a6588bbbeb0 req-e3d77348-6e6e-45f2-bd7f-a5772d1682c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9249c81d-e57b-4985-a398-8ad97526d5c7", "name": "network-vif-plugged", "status": "completed", "tag": "b471dd14-4ce9-4781-a7a0-1bd2ae3a7e55"}]} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 18:59:18.516562 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-272bf179-fffe-42ec-bc60-9a6588bbbeb0 req-e3d77348-6e6e-45f2-bd7f-a5772d1682c1 service nova] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:59:18.517060 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-272bf179-fffe-42ec-bc60-9a6588bbbeb0 req-e3d77348-6e6e-45f2-bd7f-a5772d1682c1 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:59:18.517486 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-272bf179-fffe-42ec-bc60-9a6588bbbeb0 req-e3d77348-6e6e-45f2-bd7f-a5772d1682c1 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:59:18.528694 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-99f1a11b-cadd-4fe2-b26b-528e9ce205f9 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:59:18.538378 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.compute.server_external_events [req-272bf179-fffe-42ec-bc60-9a6588bbbeb0 req-e3d77348-6e6e-45f2-bd7f-a5772d1682c1 service nova] Creating event network-vif-plugged:b471dd14-4ce9-4781-a7a0-1bd2ae3a7e55 for instance 9249c81d-e57b-4985-a398-8ad97526d5c7 on n-h2-863052-2 Nov 01 18:59:18.540715 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-99f1a11b-cadd-4fe2-b26b-528e9ce205f9 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:59:18.548635 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [req-272bf179-fffe-42ec-bc60-9a6588bbbeb0 req-e3d77348-6e6e-45f2-bd7f-a5772d1682c1 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059026 Nov 01 18:59:18.549001 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-99f1a11b-cadd-4fe2-b26b-528e9ce205f9 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:59:18.549001 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-99f1a11b-cadd-4fe2-b26b-528e9ce205f9 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] 10.222.0.13 "GET /compute/v2.1/servers/a7f88d19-08ee-47bf-9240-7d49afd775e2" status: 200 len: 1812 microversion: 2.25 time: 0.385039 Nov 01 18:59:18.549001 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 687/1424] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 18:59:18 2022] GET /compute/v2.1/servers/a7f88d19-08ee-47bf-9240-7d49afd775e2 => generated 1812 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 18:59:18.553476 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-139175b5-14da-40d2-8dd7-4aa4414d2837 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:59:18.564844 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 738/1425] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Nov 1 18:59:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 18:59:18.576227 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-0759e885-4c4b-474d-94ba-c313a235a4b5 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:59:18.577667 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.compute.server_groups [None req-139175b5-14da-40d2-8dd7-4aa4414d2837 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Querying cell 389766af-efe4-4d8b-b2de-e920ed3438ee(cell1) for 2 instances {{(pid=121403) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Nov 01 18:59:18.578525 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-0759e885-4c4b-474d-94ba-c313a235a4b5 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] [instance: 495c1822-a615-4da7-a053-227744a46341] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:59:18.578809 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-139175b5-14da-40d2-8dd7-4aa4414d2837 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:59:18.581064 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-139175b5-14da-40d2-8dd7-4aa4414d2837 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:59:18.582233 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-139175b5-14da-40d2-8dd7-4aa4414d2837 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:59:18.627874 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-139175b5-14da-40d2-8dd7-4aa4414d2837 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] 10.222.0.13 "GET /compute/v2.1/os-server-groups/15337c02-bdef-4487-a865-2768be719697" status: 200 len: 271 microversion: 2.1 time: 0.078206 Nov 01 18:59:18.633434 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 688/1426] 10.222.0.13 () {58 vars in 1263 bytes} [Tue Nov 1 18:59:18 2022] GET /compute/v2.1/os-server-groups/15337c02-bdef-4487-a865-2768be719697 => generated 271 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 18:59:18.639939 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-c6ec914f-05f8-4d2a-95aa-73ba2eee55e7 tempest-LiveMigrationTest-1695240876 tempest-LiveMigrationTest-1695240876-project-admin] Calling method '.version_select at 0x7f0ae67fd820>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:59:18.643610 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-c6ec914f-05f8-4d2a-95aa-73ba2eee55e7 tempest-LiveMigrationTest-1695240876 tempest-LiveMigrationTest-1695240876-project-admin] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:59:18.644299 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-c6ec914f-05f8-4d2a-95aa-73ba2eee55e7 tempest-LiveMigrationTest-1695240876 tempest-LiveMigrationTest-1695240876-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:59:18.645335 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-c6ec914f-05f8-4d2a-95aa-73ba2eee55e7 tempest-LiveMigrationTest-1695240876 tempest-LiveMigrationTest-1695240876-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:59:18.657879 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-c6ec914f-05f8-4d2a-95aa-73ba2eee55e7 tempest-LiveMigrationTest-1695240876 tempest-LiveMigrationTest-1695240876-project-admin] 10.222.0.13 "GET /compute/v2.1/os-migrations" status: 200 len: 3493 microversion: 2.1 time: 0.022151 Nov 01 18:59:18.658820 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 689/1427] 10.222.0.13 () {58 vars in 1143 bytes} [Tue Nov 1 18:59:18 2022] GET /compute/v2.1/os-migrations => generated 3493 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:59:18.663551 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-724de80f-952e-4d79-bceb-26d395c763d8 tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] Calling method '.version_select at 0x7f0ae66f1b80>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:59:18.707024 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-0759e885-4c4b-474d-94ba-c313a235a4b5 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a9c3b6a8c34f068caa50dc10d13a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9ef08eba0ef431285fd15a2561b4e5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:59:18.715886 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-724de80f-952e-4d79-bceb-26d395c763d8 tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] 10.222.0.13 "GET /compute/v2.1/images/27a7ec4e-8455-4687-bd75-e5c5429c154a" status: 200 len: 661 microversion: 2.1 time: 0.055701 Nov 01 18:59:18.716792 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 690/1428] 10.222.0.13 () {58 vars in 1233 bytes} [Tue Nov 1 18:59:18 2022] GET /compute/v2.1/images/27a7ec4e-8455-4687-bd75-e5c5429c154a => generated 661 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 18:59:18.716922 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-0759e885-4c4b-474d-94ba-c313a235a4b5 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] 10.222.0.13 "GET /compute/v2.1/servers/495c1822-a615-4da7-a053-227744a46341" status: 200 len: 1216 microversion: 2.1 time: 0.147512 Nov 01 18:59:18.717500 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 739/1429] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:59:18 2022] GET /compute/v2.1/servers/495c1822-a615-4da7-a053-227744a46341 => generated 1216 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:59:18.721813 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-5f09c706-aa81-499f-915b-cfa32b524d4c tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-1597135977", "imageRef": "2d4a0047-1b9e-445f-8af8-1b5c9d93e881", "flavorRef": "452"}} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 18:59:18.729390 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-7728c81c-13a7-45d9-9ca9-6e5a2878068c tempest-ServersOnMultiNodesTest-1027241392 tempest-ServersOnMultiNodesTest-1027241392-project-admin] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:59:18.730052 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-7728c81c-13a7-45d9-9ca9-6e5a2878068c tempest-ServersOnMultiNodesTest-1027241392 tempest-ServersOnMultiNodesTest-1027241392-project-admin] [instance: c04ee904-7b1a-4d73-b0c0-eb379c9aa683] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:59:18.740676 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-7728c81c-13a7-45d9-9ca9-6e5a2878068c tempest-ServersOnMultiNodesTest-1027241392 tempest-ServersOnMultiNodesTest-1027241392-project-admin] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:59:18.741161 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-7728c81c-13a7-45d9-9ca9-6e5a2878068c tempest-ServersOnMultiNodesTest-1027241392 tempest-ServersOnMultiNodesTest-1027241392-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:59:18.743292 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-7728c81c-13a7-45d9-9ca9-6e5a2878068c tempest-ServersOnMultiNodesTest-1027241392 tempest-ServersOnMultiNodesTest-1027241392-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:59:18.746196 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-7728c81c-13a7-45d9-9ca9-6e5a2878068c tempest-ServersOnMultiNodesTest-1027241392 tempest-ServersOnMultiNodesTest-1027241392-project-admin] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:59:18.755504 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-7728c81c-13a7-45d9-9ca9-6e5a2878068c tempest-ServersOnMultiNodesTest-1027241392 tempest-ServersOnMultiNodesTest-1027241392-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:59:18.756065 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-7728c81c-13a7-45d9-9ca9-6e5a2878068c tempest-ServersOnMultiNodesTest-1027241392 tempest-ServersOnMultiNodesTest-1027241392-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:59:18.830226 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.network.neutron [None req-5f09c706-aa81-499f-915b-cfa32b524d4c tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] validate_networks() for None {{(pid=121403) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 01 18:59:19.040973 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-7728c81c-13a7-45d9-9ca9-6e5a2878068c tempest-ServersOnMultiNodesTest-1027241392 tempest-ServersOnMultiNodesTest-1027241392-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/c04ee904-7b1a-4d73-b0c0-eb379c9aa683" status: 200 len: 1618 microversion: 2.1 time: 0.318021 Nov 01 18:59:19.041788 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 740/1430] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:59:18 2022] GET /compute/v2.1/servers/c04ee904-7b1a-4d73-b0c0-eb379c9aa683 => generated 1618 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:59:19.048438 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-31037b68-9ed8-45db-8d28-cebbaa893089 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:59:19.051483 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-31037b68-9ed8-45db-8d28-cebbaa893089 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] [instance: ed4798be-a45e-46f5-8f7e-1165f6479bd1] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:59:19.062645 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-31037b68-9ed8-45db-8d28-cebbaa893089 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:59:19.069046 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-31037b68-9ed8-45db-8d28-cebbaa893089 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:59:19.069528 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-31037b68-9ed8-45db-8d28-cebbaa893089 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:59:19.070274 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-31037b68-9ed8-45db-8d28-cebbaa893089 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:59:19.070742 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-31037b68-9ed8-45db-8d28-cebbaa893089 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:59:19.071167 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-31037b68-9ed8-45db-8d28-cebbaa893089 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:59:19.081887 n-d-863052-2 devstack@n-api.service[121402]: DEBUG dbcounter [-] [121402] Writing DB stats nova_cell1:SELECT=100 {{(pid=121402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 18:59:19.158697 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.virt.hardware [None req-5f09c706-aa81-499f-915b-cfa32b524d4c tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Flavor limits 0:0:0 {{(pid=121403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 01 18:59:19.159227 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.virt.hardware [None req-5f09c706-aa81-499f-915b-cfa32b524d4c tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Image limits 0:0:0 {{(pid=121403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 01 18:59:19.159569 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.virt.hardware [None req-5f09c706-aa81-499f-915b-cfa32b524d4c tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Flavor pref 0:0:0 {{(pid=121403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 01 18:59:19.159974 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.virt.hardware [None req-5f09c706-aa81-499f-915b-cfa32b524d4c tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Image pref 0:0:0 {{(pid=121403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 01 18:59:19.160855 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.virt.hardware [None req-5f09c706-aa81-499f-915b-cfa32b524d4c tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 01 18:59:19.174614 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-5f09c706-aa81-499f-915b-cfa32b524d4c tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:59:19.175391 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-5f09c706-aa81-499f-915b-cfa32b524d4c tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:59:19.176060 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-5f09c706-aa81-499f-915b-cfa32b524d4c tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:59:19.177223 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-5f09c706-aa81-499f-915b-cfa32b524d4c tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:59:19.177960 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-5f09c706-aa81-499f-915b-cfa32b524d4c tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:59:19.178638 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-5f09c706-aa81-499f-915b-cfa32b524d4c tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:59:19.201070 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.quota [None req-5f09c706-aa81-499f-915b-cfa32b524d4c tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Getting quotas for project 45d4c047d3c44324a27a27831236ab0d. Resources: {'cores', 'ram', 'instances'} {{(pid=121403) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 01 18:59:19.208199 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.quota [None req-5f09c706-aa81-499f-915b-cfa32b524d4c tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Getting quotas for user 72117f17294649d6b8bc16c66c7efab2 and project 45d4c047d3c44324a27a27831236ab0d. Resources: {'cores', 'ram', 'instances'} {{(pid=121403) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 01 18:59:19.222805 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-5f09c706-aa81-499f-915b-cfa32b524d4c tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Going to run 1 instances... {{(pid=121403) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 01 18:59:19.225005 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-5f09c706-aa81-499f-915b-cfa32b524d4c tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] [instance: f6762e10-9d45-47cf-a6b6-d9bfc3404664] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2d4a0047-1b9e-445f-8af8-1b5c9d93e881',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121403) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 01 18:59:19.282830 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-5f09c706-aa81-499f-915b-cfa32b524d4c tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.564635 Nov 01 18:59:19.284131 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 691/1431] 10.222.0.13 () {60 vars in 1147 bytes} [Tue Nov 1 18:59:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 567 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 01 18:59:19.288998 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-caf29383-ce26-48f0-8d9d-5f181549b3ca tempest-LiveMigrationTest-1695240876 tempest-LiveMigrationTest-1695240876-project-admin] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:59:19.289985 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-caf29383-ce26-48f0-8d9d-5f181549b3ca tempest-LiveMigrationTest-1695240876 tempest-LiveMigrationTest-1695240876-project-admin] [instance: 2d525a31-b0be-44cb-8fb7-335075145f08] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:59:19.300644 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-caf29383-ce26-48f0-8d9d-5f181549b3ca tempest-LiveMigrationTest-1695240876 tempest-LiveMigrationTest-1695240876-project-admin] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:59:19.301410 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-caf29383-ce26-48f0-8d9d-5f181549b3ca tempest-LiveMigrationTest-1695240876 tempest-LiveMigrationTest-1695240876-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:59:19.302930 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-caf29383-ce26-48f0-8d9d-5f181549b3ca tempest-LiveMigrationTest-1695240876 tempest-LiveMigrationTest-1695240876-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:59:19.303780 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-caf29383-ce26-48f0-8d9d-5f181549b3ca tempest-LiveMigrationTest-1695240876 tempest-LiveMigrationTest-1695240876-project-admin] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:59:19.304248 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-caf29383-ce26-48f0-8d9d-5f181549b3ca tempest-LiveMigrationTest-1695240876 tempest-LiveMigrationTest-1695240876-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:59:19.304705 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-caf29383-ce26-48f0-8d9d-5f181549b3ca tempest-LiveMigrationTest-1695240876 tempest-LiveMigrationTest-1695240876-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:59:19.373700 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-31037b68-9ed8-45db-8d28-cebbaa893089 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a63d69c99a546f0af16329cff3ca717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a1bb191cff948e99c008b5e861ce4a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:59:19.386011 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-31037b68-9ed8-45db-8d28-cebbaa893089 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] 10.222.0.13 "GET /compute/v2.1/servers/ed4798be-a45e-46f5-8f7e-1165f6479bd1" status: 200 len: 1509 microversion: 2.1 time: 0.342965 Nov 01 18:59:19.386615 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 741/1432] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:59:19 2022] GET /compute/v2.1/servers/ed4798be-a45e-46f5-8f7e-1165f6479bd1 => generated 1509 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:59:19.403223 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-336b2d93-757d-4afc-8d67-30acafe5f460 tempest-ServersOnMultiNodesTest-1027241392 tempest-ServersOnMultiNodesTest-1027241392-project-admin] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:59:19.403981 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-336b2d93-757d-4afc-8d67-30acafe5f460 tempest-ServersOnMultiNodesTest-1027241392 tempest-ServersOnMultiNodesTest-1027241392-project-admin] [instance: 5e7ed73c-1243-4adf-94a2-09f7bf73f6fd] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:59:19.411717 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-336b2d93-757d-4afc-8d67-30acafe5f460 tempest-ServersOnMultiNodesTest-1027241392 tempest-ServersOnMultiNodesTest-1027241392-project-admin] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:59:19.412039 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-336b2d93-757d-4afc-8d67-30acafe5f460 tempest-ServersOnMultiNodesTest-1027241392 tempest-ServersOnMultiNodesTest-1027241392-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:59:19.412678 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-336b2d93-757d-4afc-8d67-30acafe5f460 tempest-ServersOnMultiNodesTest-1027241392 tempest-ServersOnMultiNodesTest-1027241392-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:59:19.413210 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-336b2d93-757d-4afc-8d67-30acafe5f460 tempest-ServersOnMultiNodesTest-1027241392 tempest-ServersOnMultiNodesTest-1027241392-project-admin] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:59:19.413718 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-336b2d93-757d-4afc-8d67-30acafe5f460 tempest-ServersOnMultiNodesTest-1027241392 tempest-ServersOnMultiNodesTest-1027241392-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:59:19.414138 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-336b2d93-757d-4afc-8d67-30acafe5f460 tempest-ServersOnMultiNodesTest-1027241392 tempest-ServersOnMultiNodesTest-1027241392-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:59:19.472906 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-caf29383-ce26-48f0-8d9d-5f181549b3ca tempest-LiveMigrationTest-1695240876 tempest-LiveMigrationTest-1695240876-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/2d525a31-b0be-44cb-8fb7-335075145f08" status: 200 len: 1859 microversion: 2.1 time: 0.187373 Nov 01 18:59:19.485508 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 692/1433] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:59:19 2022] GET /compute/v2.1/servers/2d525a31-b0be-44cb-8fb7-335075145f08 => generated 1859 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:59:19.493090 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-c9177db1-671d-4e2c-b0e2-684bde6f9d97 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:59:19.496865 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-c9177db1-671d-4e2c-b0e2-684bde6f9d97 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] [instance: f6762e10-9d45-47cf-a6b6-d9bfc3404664] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:59:19.606954 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-c9177db1-671d-4e2c-b0e2-684bde6f9d97 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72117f17294649d6b8bc16c66c7efab2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45d4c047d3c44324a27a27831236ab0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:59:19.620396 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-c9177db1-671d-4e2c-b0e2-684bde6f9d97 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] 10.222.0.13 "GET /compute/v2.1/servers/f6762e10-9d45-47cf-a6b6-d9bfc3404664" status: 200 len: 1213 microversion: 2.1 time: 0.131853 Nov 01 18:59:19.621324 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 693/1434] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:59:19 2022] GET /compute/v2.1/servers/f6762e10-9d45-47cf-a6b6-d9bfc3404664 => generated 1213 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:59:19.625734 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-4685562e-3479-4a92-8b5d-69c5f95e7023 tempest-LiveMigrationTest-1695240876 tempest-LiveMigrationTest-1695240876-project-admin] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:59:19.626338 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-4685562e-3479-4a92-8b5d-69c5f95e7023 tempest-LiveMigrationTest-1695240876 tempest-LiveMigrationTest-1695240876-project-admin] [instance: 2d525a31-b0be-44cb-8fb7-335075145f08] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:59:19.635980 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-4685562e-3479-4a92-8b5d-69c5f95e7023 tempest-LiveMigrationTest-1695240876 tempest-LiveMigrationTest-1695240876-project-admin] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:59:19.643076 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-4685562e-3479-4a92-8b5d-69c5f95e7023 tempest-LiveMigrationTest-1695240876 tempest-LiveMigrationTest-1695240876-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:59:19.643534 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-4685562e-3479-4a92-8b5d-69c5f95e7023 tempest-LiveMigrationTest-1695240876 tempest-LiveMigrationTest-1695240876-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:59:19.644331 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-4685562e-3479-4a92-8b5d-69c5f95e7023 tempest-LiveMigrationTest-1695240876 tempest-LiveMigrationTest-1695240876-project-admin] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:59:19.644856 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-4685562e-3479-4a92-8b5d-69c5f95e7023 tempest-LiveMigrationTest-1695240876 tempest-LiveMigrationTest-1695240876-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:59:19.645398 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-4685562e-3479-4a92-8b5d-69c5f95e7023 tempest-LiveMigrationTest-1695240876 tempest-LiveMigrationTest-1695240876-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:59:19.714850 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-336b2d93-757d-4afc-8d67-30acafe5f460 tempest-ServersOnMultiNodesTest-1027241392 tempest-ServersOnMultiNodesTest-1027241392-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/5e7ed73c-1243-4adf-94a2-09f7bf73f6fd" status: 200 len: 1619 microversion: 2.1 time: 0.322847 Nov 01 18:59:19.715436 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 742/1435] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:59:19 2022] GET /compute/v2.1/servers/5e7ed73c-1243-4adf-94a2-09f7bf73f6fd => generated 1619 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:59:19.724032 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-4a57a238-2987-4f87-b67b-478f4eef2231 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:59:19.724790 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-4a57a238-2987-4f87-b67b-478f4eef2231 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] [instance: a7f88d19-08ee-47bf-9240-7d49afd775e2] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:59:19.744434 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-4a57a238-2987-4f87-b67b-478f4eef2231 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:59:19.744967 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-4a57a238-2987-4f87-b67b-478f4eef2231 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:59:19.745403 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-4a57a238-2987-4f87-b67b-478f4eef2231 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:59:19.746114 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-4a57a238-2987-4f87-b67b-478f4eef2231 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:59:19.746571 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-4a57a238-2987-4f87-b67b-478f4eef2231 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:59:19.749130 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-4a57a238-2987-4f87-b67b-478f4eef2231 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:59:19.994089 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-4685562e-3479-4a92-8b5d-69c5f95e7023 tempest-LiveMigrationTest-1695240876 tempest-LiveMigrationTest-1695240876-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/2d525a31-b0be-44cb-8fb7-335075145f08" status: 200 len: 1859 microversion: 2.1 time: 0.370504 Nov 01 18:59:19.999739 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 694/1436] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:59:19 2022] GET /compute/v2.1/servers/2d525a31-b0be-44cb-8fb7-335075145f08 => generated 1859 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:59:20.004893 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-6c0f2634-f28b-4d8b-9213-f61edf7ef43d tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:59:20.005766 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-6c0f2634-f28b-4d8b-9213-f61edf7ef43d tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] [instance: 495c1822-a615-4da7-a053-227744a46341] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:59:20.017140 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-6c0f2634-f28b-4d8b-9213-f61edf7ef43d tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:59:20.019072 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-6c0f2634-f28b-4d8b-9213-f61edf7ef43d tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:59:20.019705 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-6c0f2634-f28b-4d8b-9213-f61edf7ef43d tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:59:20.020608 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-6c0f2634-f28b-4d8b-9213-f61edf7ef43d tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:59:20.021266 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-6c0f2634-f28b-4d8b-9213-f61edf7ef43d tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:59:20.021704 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-6c0f2634-f28b-4d8b-9213-f61edf7ef43d tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:59:20.178029 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-6c0f2634-f28b-4d8b-9213-f61edf7ef43d tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a9c3b6a8c34f068caa50dc10d13a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9ef08eba0ef431285fd15a2561b4e5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:59:20.189620 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-6c0f2634-f28b-4d8b-9213-f61edf7ef43d tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] 10.222.0.13 "GET /compute/v2.1/servers/495c1822-a615-4da7-a053-227744a46341" status: 200 len: 1268 microversion: 2.1 time: 0.188551 Nov 01 18:59:20.194377 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 695/1437] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:59:19 2022] GET /compute/v2.1/servers/495c1822-a615-4da7-a053-227744a46341 => generated 1268 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:59:20.216164 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-aba2d85a-2843-482a-b165-3938e45a9edf tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-78222770", "imageRef": "2d4a0047-1b9e-445f-8af8-1b5c9d93e881", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": "7186700c-1951-4ab3-a872-865dc1a45fa1"}} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 18:59:20.380252 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.network.neutron [None req-aba2d85a-2843-482a-b165-3938e45a9edf tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] validate_networks() for None {{(pid=121403) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 01 18:59:20.493162 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-4a57a238-2987-4f87-b67b-478f4eef2231 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:59:20.507114 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-4a57a238-2987-4f87-b67b-478f4eef2231 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:59:20.508595 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-4a57a238-2987-4f87-b67b-478f4eef2231 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:59:20.513975 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-4a57a238-2987-4f87-b67b-478f4eef2231 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] 10.222.0.13 "GET /compute/v2.1/servers/a7f88d19-08ee-47bf-9240-7d49afd775e2" status: 200 len: 1812 microversion: 2.25 time: 0.797365 Nov 01 18:59:20.517522 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 743/1438] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 18:59:19 2022] GET /compute/v2.1/servers/a7f88d19-08ee-47bf-9240-7d49afd775e2 => generated 1812 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 18:59:20.524166 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-7f1cd5d0-b317-4780-b802-3642caad2548 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:59:20.525109 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-7f1cd5d0-b317-4780-b802-3642caad2548 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] [instance: 2d525a31-b0be-44cb-8fb7-335075145f08] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:59:20.533660 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-7f1cd5d0-b317-4780-b802-3642caad2548 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:59:20.534471 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-7f1cd5d0-b317-4780-b802-3642caad2548 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:59:20.535387 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-7f1cd5d0-b317-4780-b802-3642caad2548 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:59:20.548230 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-7f1cd5d0-b317-4780-b802-3642caad2548 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:59:20.549086 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-7f1cd5d0-b317-4780-b802-3642caad2548 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:59:20.549758 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-7f1cd5d0-b317-4780-b802-3642caad2548 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:59:20.762908 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.objects.instance [None req-7f1cd5d0-b317-4780-b802-3642caad2548 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lazy-loading 'services' on Instance uuid 2d525a31-b0be-44cb-8fb7-335075145f08 {{(pid=121402) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 01 18:59:20.896092 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.virt.hardware [None req-aba2d85a-2843-482a-b165-3938e45a9edf tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Flavor limits 0:0:0 {{(pid=121403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 01 18:59:20.896504 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.virt.hardware [None req-aba2d85a-2843-482a-b165-3938e45a9edf tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Image limits 0:0:0 {{(pid=121403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 01 18:59:20.897009 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.virt.hardware [None req-aba2d85a-2843-482a-b165-3938e45a9edf tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Flavor pref 0:0:0 {{(pid=121403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 01 18:59:20.897417 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.virt.hardware [None req-aba2d85a-2843-482a-b165-3938e45a9edf tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Image pref 0:0:0 {{(pid=121403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 01 18:59:20.897826 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.virt.hardware [None req-aba2d85a-2843-482a-b165-3938e45a9edf tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 01 18:59:20.913901 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-aba2d85a-2843-482a-b165-3938e45a9edf tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:59:20.914398 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-aba2d85a-2843-482a-b165-3938e45a9edf tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:59:20.914827 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-aba2d85a-2843-482a-b165-3938e45a9edf tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:59:20.915544 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-aba2d85a-2843-482a-b165-3938e45a9edf tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:59:20.916026 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-aba2d85a-2843-482a-b165-3938e45a9edf tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:59:20.916447 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-aba2d85a-2843-482a-b165-3938e45a9edf tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:59:20.956848 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.quota [None req-aba2d85a-2843-482a-b165-3938e45a9edf tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Getting quotas for project 86941784237549838bba63ce88053b88. Resources: {'cores', 'ram', 'instances'} {{(pid=121403) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 01 18:59:20.959651 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-7f1cd5d0-b317-4780-b802-3642caad2548 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] 10.222.0.13 "DELETE /compute/v2.1/servers/2d525a31-b0be-44cb-8fb7-335075145f08/os-volume_attachments/7fb968ae-6b31-4687-bc84-4372e9905f0b" status: 202 len: 0 microversion: 2.1 time: 0.440827 Nov 01 18:59:20.963357 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 744/1439] 10.222.0.13 () {58 vars in 1416 bytes} [Tue Nov 1 18:59:20 2022] DELETE /compute/v2.1/servers/2d525a31-b0be-44cb-8fb7-335075145f08/os-volume_attachments/7fb968ae-6b31-4687-bc84-4372e9905f0b => generated 0 bytes in 442 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 01 18:59:20.971398 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-da4c4f08-55c2-439f-81c5-09579a738f89 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:59:20.972105 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-da4c4f08-55c2-439f-81c5-09579a738f89 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] [instance: ed4798be-a45e-46f5-8f7e-1165f6479bd1] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:59:20.985389 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-da4c4f08-55c2-439f-81c5-09579a738f89 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:59:20.986633 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-da4c4f08-55c2-439f-81c5-09579a738f89 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:59:20.991840 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-da4c4f08-55c2-439f-81c5-09579a738f89 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:59:20.992834 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-da4c4f08-55c2-439f-81c5-09579a738f89 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:59:20.993471 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-da4c4f08-55c2-439f-81c5-09579a738f89 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:59:20.994017 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.quota [None req-aba2d85a-2843-482a-b165-3938e45a9edf tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Getting quotas for user 0290a6bb8bc24b8988a925327ac0381c and project 86941784237549838bba63ce88053b88. Resources: {'cores', 'ram', 'instances'} {{(pid=121403) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 01 18:59:20.994215 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-da4c4f08-55c2-439f-81c5-09579a738f89 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:59:21.027059 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-aba2d85a-2843-482a-b165-3938e45a9edf tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Going to run 1 instances... {{(pid=121403) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 01 18:59:21.031243 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-aba2d85a-2843-482a-b165-3938e45a9edf tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] [instance: 3796ef05-cc8e-44d4-8dfc-058b5dbc8cbd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2d4a0047-1b9e-445f-8af8-1b5c9d93e881',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121403) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 01 18:59:21.168235 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-aba2d85a-2843-482a-b165-3938e45a9edf tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.971828 Nov 01 18:59:21.176339 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 696/1440] 10.222.0.13 () {60 vars in 1147 bytes} [Tue Nov 1 18:59:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 974 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 01 18:59:21.211188 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-7e94a69f-4e60-402d-9483-a7783f7b83aa tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] Calling method '.version_select at 0x7f0ae2254160>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:59:21.496943 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-7e94a69f-4e60-402d-9483-a7783f7b83aa tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] 10.222.0.13 "GET /compute/v2.1/images/aae46426-024e-44e4-b4e7-b48a8aa6c27e" status: 200 len: 661 microversion: 2.1 time: 0.326225 Nov 01 18:59:21.500259 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 697/1441] 10.222.0.13 () {58 vars in 1233 bytes} [Tue Nov 1 18:59:21 2022] GET /compute/v2.1/images/aae46426-024e-44e4-b4e7-b48a8aa6c27e => generated 661 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 18:59:21.516262 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-20d00084-e789-4d4d-9950-1992bd663365 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:59:21.526734 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-20d00084-e789-4d4d-9950-1992bd663365 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] [instance: f6762e10-9d45-47cf-a6b6-d9bfc3404664] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:59:21.540742 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-20d00084-e789-4d4d-9950-1992bd663365 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:59:21.544011 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-20d00084-e789-4d4d-9950-1992bd663365 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:59:21.545454 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-20d00084-e789-4d4d-9950-1992bd663365 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:59:21.547179 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-20d00084-e789-4d4d-9950-1992bd663365 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:59:21.549423 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-20d00084-e789-4d4d-9950-1992bd663365 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:59:21.550740 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-20d00084-e789-4d4d-9950-1992bd663365 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:59:21.718429 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-20d00084-e789-4d4d-9950-1992bd663365 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72117f17294649d6b8bc16c66c7efab2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45d4c047d3c44324a27a27831236ab0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:59:21.733771 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-20d00084-e789-4d4d-9950-1992bd663365 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] 10.222.0.13 "GET /compute/v2.1/servers/f6762e10-9d45-47cf-a6b6-d9bfc3404664" status: 200 len: 1265 microversion: 2.1 time: 0.221818 Nov 01 18:59:21.755012 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 698/1442] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:59:21 2022] GET /compute/v2.1/servers/f6762e10-9d45-47cf-a6b6-d9bfc3404664 => generated 1265 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:59:21.767825 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-18b84617-7804-4278-a1eb-001db0d6cbae tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:59:21.795883 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-18b84617-7804-4278-a1eb-001db0d6cbae tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] [instance: 2d525a31-b0be-44cb-8fb7-335075145f08] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:59:21.821384 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-18b84617-7804-4278-a1eb-001db0d6cbae tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:59:21.823352 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-18b84617-7804-4278-a1eb-001db0d6cbae tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:59:21.823986 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-18b84617-7804-4278-a1eb-001db0d6cbae tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:59:21.830436 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-18b84617-7804-4278-a1eb-001db0d6cbae tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:59:21.831452 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-18b84617-7804-4278-a1eb-001db0d6cbae tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:59:21.836081 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-18b84617-7804-4278-a1eb-001db0d6cbae tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:59:21.917277 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-18b84617-7804-4278-a1eb-001db0d6cbae tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] 10.222.0.13 "GET /compute/v2.1/servers/2d525a31-b0be-44cb-8fb7-335075145f08/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.160998 Nov 01 18:59:21.934645 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 699/1443] 10.222.0.13 () {58 vars in 1302 bytes} [Tue Nov 1 18:59:21 2022] GET /compute/v2.1/servers/2d525a31-b0be-44cb-8fb7-335075145f08/os-volume_attachments => generated 197 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 18:59:21.945849 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-2b2950b1-edad-4de2-be9e-359f97533203 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:59:21.946598 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-2b2950b1-edad-4de2-be9e-359f97533203 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] [instance: 3796ef05-cc8e-44d4-8dfc-058b5dbc8cbd] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:59:22.180611 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-2b2950b1-edad-4de2-be9e-359f97533203 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0290a6bb8bc24b8988a925327ac0381c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86941784237549838bba63ce88053b88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:59:22.182807 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-da4c4f08-55c2-439f-81c5-09579a738f89 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a63d69c99a546f0af16329cff3ca717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a1bb191cff948e99c008b5e861ce4a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:59:22.190397 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-2b2950b1-edad-4de2-be9e-359f97533203 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] 10.222.0.13 "GET /compute/v2.1/servers/3796ef05-cc8e-44d4-8dfc-058b5dbc8cbd" status: 200 len: 1215 microversion: 2.1 time: 0.254414 Nov 01 18:59:22.193934 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 700/1444] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:59:21 2022] GET /compute/v2.1/servers/3796ef05-cc8e-44d4-8dfc-058b5dbc8cbd => generated 1215 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:59:22.205722 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-6d2591de-aa5c-42c4-af60-ece307b7a5d1 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:59:22.207665 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-da4c4f08-55c2-439f-81c5-09579a738f89 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] 10.222.0.13 "GET /compute/v2.1/servers/ed4798be-a45e-46f5-8f7e-1165f6479bd1" status: 200 len: 1515 microversion: 2.1 time: 1.242854 Nov 01 18:59:22.208730 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 745/1445] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:59:20 2022] GET /compute/v2.1/servers/ed4798be-a45e-46f5-8f7e-1165f6479bd1 => generated 1515 bytes in 1247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:59:22.220108 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-6d2591de-aa5c-42c4-af60-ece307b7a5d1 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] [instance: 495c1822-a615-4da7-a053-227744a46341] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:59:22.226527 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-acdc06a3-1538-4918-9055-bd2e6943769d tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] Calling method '.version_select at 0x7f0ae1dc53a0>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:59:22.227053 n-d-863052-2 devstack@n-api.service[121403]: DEBUG dbcounter [-] [121403] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=121403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 18:59:22.267245 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-6d2591de-aa5c-42c4-af60-ece307b7a5d1 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:59:22.269075 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-6d2591de-aa5c-42c4-af60-ece307b7a5d1 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:59:22.269696 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-6d2591de-aa5c-42c4-af60-ece307b7a5d1 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:59:22.273628 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-6d2591de-aa5c-42c4-af60-ece307b7a5d1 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:59:22.276031 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-6d2591de-aa5c-42c4-af60-ece307b7a5d1 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:59:22.276755 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-6d2591de-aa5c-42c4-af60-ece307b7a5d1 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:59:22.305362 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-acdc06a3-1538-4918-9055-bd2e6943769d tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] 10.222.0.13 "GET /compute/v2.1/images/aae46426-024e-44e4-b4e7-b48a8aa6c27e" status: 200 len: 661 microversion: 2.1 time: 0.095202 Nov 01 18:59:22.306339 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 746/1446] 10.222.0.13 () {58 vars in 1233 bytes} [Tue Nov 1 18:59:22 2022] GET /compute/v2.1/images/aae46426-024e-44e4-b4e7-b48a8aa6c27e => generated 661 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 18:59:22.315518 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-54c5d1a4-ca95-4402-bc9b-3759b6667f45 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:59:22.318295 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-54c5d1a4-ca95-4402-bc9b-3759b6667f45 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] [instance: a7f88d19-08ee-47bf-9240-7d49afd775e2] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:59:22.341522 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-54c5d1a4-ca95-4402-bc9b-3759b6667f45 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:59:22.346899 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-54c5d1a4-ca95-4402-bc9b-3759b6667f45 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:59:22.349239 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-54c5d1a4-ca95-4402-bc9b-3759b6667f45 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:59:22.353090 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-54c5d1a4-ca95-4402-bc9b-3759b6667f45 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:59:22.355829 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-54c5d1a4-ca95-4402-bc9b-3759b6667f45 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:59:22.359968 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-54c5d1a4-ca95-4402-bc9b-3759b6667f45 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:59:23.100196 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-6d2591de-aa5c-42c4-af60-ece307b7a5d1 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a9c3b6a8c34f068caa50dc10d13a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9ef08eba0ef431285fd15a2561b4e5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:59:23.111656 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-6d2591de-aa5c-42c4-af60-ece307b7a5d1 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] 10.222.0.13 "GET /compute/v2.1/servers/495c1822-a615-4da7-a053-227744a46341" status: 200 len: 1316 microversion: 2.1 time: 0.907952 Nov 01 18:59:23.115175 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 701/1447] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:59:22 2022] GET /compute/v2.1/servers/495c1822-a615-4da7-a053-227744a46341 => generated 1316 bytes in 914 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:59:23.122964 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-d921223f-99eb-4762-9063-d6dcf18b4c3f tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:59:23.126435 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-d921223f-99eb-4762-9063-d6dcf18b4c3f tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] [instance: f6762e10-9d45-47cf-a6b6-d9bfc3404664] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:59:23.142239 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d921223f-99eb-4762-9063-d6dcf18b4c3f tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:59:23.145208 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d921223f-99eb-4762-9063-d6dcf18b4c3f tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:59:23.146533 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d921223f-99eb-4762-9063-d6dcf18b4c3f tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:59:23.148935 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d921223f-99eb-4762-9063-d6dcf18b4c3f tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:59:23.149519 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d921223f-99eb-4762-9063-d6dcf18b4c3f tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:59:23.153095 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d921223f-99eb-4762-9063-d6dcf18b4c3f tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:59:23.204032 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-54c5d1a4-ca95-4402-bc9b-3759b6667f45 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:59:23.225576 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-54c5d1a4-ca95-4402-bc9b-3759b6667f45 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:59:23.228220 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-54c5d1a4-ca95-4402-bc9b-3759b6667f45 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:59:23.233314 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-54c5d1a4-ca95-4402-bc9b-3759b6667f45 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] 10.222.0.13 "GET /compute/v2.1/servers/a7f88d19-08ee-47bf-9240-7d49afd775e2" status: 200 len: 1812 microversion: 2.25 time: 0.923493 Nov 01 18:59:23.235090 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 747/1448] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 18:59:22 2022] GET /compute/v2.1/servers/a7f88d19-08ee-47bf-9240-7d49afd775e2 => generated 1812 bytes in 928 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 18:59:23.245337 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-cd6accc4-627e-4f4b-926f-82837f525cbf tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:59:23.257589 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-cd6accc4-627e-4f4b-926f-82837f525cbf tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] [instance: 2d525a31-b0be-44cb-8fb7-335075145f08] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:59:23.270392 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-cd6accc4-627e-4f4b-926f-82837f525cbf tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:59:23.272152 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-cd6accc4-627e-4f4b-926f-82837f525cbf tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:59:23.272810 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-cd6accc4-627e-4f4b-926f-82837f525cbf tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:59:23.274698 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-cd6accc4-627e-4f4b-926f-82837f525cbf tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:59:23.275568 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-cd6accc4-627e-4f4b-926f-82837f525cbf tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:59:23.276171 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-cd6accc4-627e-4f4b-926f-82837f525cbf tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:59:23.329062 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-cd6accc4-627e-4f4b-926f-82837f525cbf tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] 10.222.0.13 "GET /compute/v2.1/servers/2d525a31-b0be-44cb-8fb7-335075145f08/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.091896 Nov 01 18:59:23.330268 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 748/1449] 10.222.0.13 () {58 vars in 1302 bytes} [Tue Nov 1 18:59:23 2022] GET /compute/v2.1/servers/2d525a31-b0be-44cb-8fb7-335075145f08/os-volume_attachments => generated 197 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 18:59:23.345040 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-926e3a1c-28db-47ae-92d6-97389686f4ba tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:59:23.369094 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-926e3a1c-28db-47ae-92d6-97389686f4ba tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] [instance: 3796ef05-cc8e-44d4-8dfc-058b5dbc8cbd] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:59:23.390074 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-926e3a1c-28db-47ae-92d6-97389686f4ba tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:59:23.391103 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-926e3a1c-28db-47ae-92d6-97389686f4ba tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:59:23.391714 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-926e3a1c-28db-47ae-92d6-97389686f4ba tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:59:23.393462 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-926e3a1c-28db-47ae-92d6-97389686f4ba tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:59:23.394138 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-926e3a1c-28db-47ae-92d6-97389686f4ba tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:59:23.394720 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-926e3a1c-28db-47ae-92d6-97389686f4ba tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:59:23.502214 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-d921223f-99eb-4762-9063-d6dcf18b4c3f tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72117f17294649d6b8bc16c66c7efab2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45d4c047d3c44324a27a27831236ab0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:59:23.520194 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-d921223f-99eb-4762-9063-d6dcf18b4c3f tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] 10.222.0.13 "GET /compute/v2.1/servers/f6762e10-9d45-47cf-a6b6-d9bfc3404664" status: 200 len: 1271 microversion: 2.1 time: 0.402354 Nov 01 18:59:23.521480 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 702/1450] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:59:23 2022] GET /compute/v2.1/servers/f6762e10-9d45-47cf-a6b6-d9bfc3404664 => generated 1271 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:59:24.038886 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-efefe141-7dd1-4563-ac76-262886fcb6aa tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] Calling method '.version_select at 0x7f0ae66f1c10>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:59:24.121859 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-926e3a1c-28db-47ae-92d6-97389686f4ba tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0290a6bb8bc24b8988a925327ac0381c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86941784237549838bba63ce88053b88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:59:24.127409 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-efefe141-7dd1-4563-ac76-262886fcb6aa tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] 10.222.0.13 "GET /compute/v2.1/images/b80251cd-bea9-45d7-af4f-4ef7ffe0bc04" status: 200 len: 661 microversion: 2.1 time: 0.092863 Nov 01 18:59:24.132427 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-926e3a1c-28db-47ae-92d6-97389686f4ba tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] 10.222.0.13 "GET /compute/v2.1/servers/3796ef05-cc8e-44d4-8dfc-058b5dbc8cbd" status: 200 len: 1267 microversion: 2.1 time: 0.800810 Nov 01 18:59:24.133076 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 703/1451] 10.222.0.13 () {58 vars in 1233 bytes} [Tue Nov 1 18:59:24 2022] GET /compute/v2.1/images/b80251cd-bea9-45d7-af4f-4ef7ffe0bc04 => generated 661 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 18:59:24.141509 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-e84ba904-fded-4a52-855b-28ccb8c097d7 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:59:24.142126 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-e84ba904-fded-4a52-855b-28ccb8c097d7 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] [instance: 495c1822-a615-4da7-a053-227744a46341] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:59:24.156608 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 749/1452] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:59:23 2022] GET /compute/v2.1/servers/3796ef05-cc8e-44d4-8dfc-058b5dbc8cbd => generated 1267 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:59:24.156608 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-9dc06b49-d129-4ed8-8d06-df88033cfdc9 tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] Calling method '.version_select at 0x7f0ae1d63820>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:59:24.176031 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-e84ba904-fded-4a52-855b-28ccb8c097d7 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:59:24.177295 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-e84ba904-fded-4a52-855b-28ccb8c097d7 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:59:24.178280 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-e84ba904-fded-4a52-855b-28ccb8c097d7 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:59:24.183853 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-e84ba904-fded-4a52-855b-28ccb8c097d7 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:59:24.183853 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-e84ba904-fded-4a52-855b-28ccb8c097d7 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:59:24.185646 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-e84ba904-fded-4a52-855b-28ccb8c097d7 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:59:24.339651 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-9dc06b49-d129-4ed8-8d06-df88033cfdc9 tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] 10.222.0.13 "GET /compute/v2.1/images/b80251cd-bea9-45d7-af4f-4ef7ffe0bc04" status: 200 len: 661 microversion: 2.1 time: 0.193083 Nov 01 18:59:24.341045 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 750/1453] 10.222.0.13 () {58 vars in 1233 bytes} [Tue Nov 1 18:59:24 2022] GET /compute/v2.1/images/b80251cd-bea9-45d7-af4f-4ef7ffe0bc04 => generated 661 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 18:59:24.372732 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-52416fdb-e5a5-4e77-b60c-5106c1993530 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:59:24.373710 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-52416fdb-e5a5-4e77-b60c-5106c1993530 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] [instance: a7f88d19-08ee-47bf-9240-7d49afd775e2] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:59:24.403111 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-52416fdb-e5a5-4e77-b60c-5106c1993530 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:59:24.403649 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-52416fdb-e5a5-4e77-b60c-5106c1993530 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:59:24.403979 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-52416fdb-e5a5-4e77-b60c-5106c1993530 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:59:24.413723 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-52416fdb-e5a5-4e77-b60c-5106c1993530 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:59:24.414471 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-52416fdb-e5a5-4e77-b60c-5106c1993530 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:59:24.415071 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-52416fdb-e5a5-4e77-b60c-5106c1993530 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:59:24.699002 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-e84ba904-fded-4a52-855b-28ccb8c097d7 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a9c3b6a8c34f068caa50dc10d13a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9ef08eba0ef431285fd15a2561b4e5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:59:24.712290 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-e84ba904-fded-4a52-855b-28ccb8c097d7 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] 10.222.0.13 "GET /compute/v2.1/servers/495c1822-a615-4da7-a053-227744a46341" status: 200 len: 1316 microversion: 2.1 time: 0.577339 Nov 01 18:59:24.729435 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 704/1454] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:59:24 2022] GET /compute/v2.1/servers/495c1822-a615-4da7-a053-227744a46341 => generated 1316 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:59:24.739871 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-8a0c3386-c682-4a8d-ab6f-3e8dc743d392 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:59:24.745763 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-8a0c3386-c682-4a8d-ab6f-3e8dc743d392 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] [instance: 2d525a31-b0be-44cb-8fb7-335075145f08] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:59:24.760063 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-8a0c3386-c682-4a8d-ab6f-3e8dc743d392 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:59:24.760560 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-8a0c3386-c682-4a8d-ab6f-3e8dc743d392 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:59:24.762563 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-8a0c3386-c682-4a8d-ab6f-3e8dc743d392 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:59:24.763488 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-8a0c3386-c682-4a8d-ab6f-3e8dc743d392 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:59:24.765047 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-8a0c3386-c682-4a8d-ab6f-3e8dc743d392 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:59:24.767045 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-8a0c3386-c682-4a8d-ab6f-3e8dc743d392 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:59:24.835040 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-8a0c3386-c682-4a8d-ab6f-3e8dc743d392 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] 10.222.0.13 "GET /compute/v2.1/servers/2d525a31-b0be-44cb-8fb7-335075145f08/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.104346 Nov 01 18:59:24.841019 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 705/1455] 10.222.0.13 () {58 vars in 1302 bytes} [Tue Nov 1 18:59:24 2022] GET /compute/v2.1/servers/2d525a31-b0be-44cb-8fb7-335075145f08/os-volume_attachments => generated 197 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 18:59:24.851691 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-356f1914-2841-4a66-a223-f9971000b84f tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-556743343", "imageRef": "2d4a0047-1b9e-445f-8af8-1b5c9d93e881", "flavorRef": "452"}} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 18:59:24.961756 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.network.neutron [None req-356f1914-2841-4a66-a223-f9971000b84f tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] validate_networks() for None {{(pid=121403) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 01 18:59:25.609594 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.virt.hardware [None req-356f1914-2841-4a66-a223-f9971000b84f tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] Flavor limits 0:0:0 {{(pid=121403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 01 18:59:25.610689 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.virt.hardware [None req-356f1914-2841-4a66-a223-f9971000b84f tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] Image limits 0:0:0 {{(pid=121403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 01 18:59:25.611175 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.virt.hardware [None req-356f1914-2841-4a66-a223-f9971000b84f tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] Flavor pref 0:0:0 {{(pid=121403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 01 18:59:25.611577 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.virt.hardware [None req-356f1914-2841-4a66-a223-f9971000b84f tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] Image pref 0:0:0 {{(pid=121403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 01 18:59:25.612316 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.virt.hardware [None req-356f1914-2841-4a66-a223-f9971000b84f tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 01 18:59:25.631179 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-356f1914-2841-4a66-a223-f9971000b84f tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:59:25.631670 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-356f1914-2841-4a66-a223-f9971000b84f tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:59:25.632750 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-356f1914-2841-4a66-a223-f9971000b84f tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:59:25.633486 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-356f1914-2841-4a66-a223-f9971000b84f tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:59:25.633937 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-356f1914-2841-4a66-a223-f9971000b84f tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:59:25.635101 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-356f1914-2841-4a66-a223-f9971000b84f tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:59:25.661105 n-d-863052-2 devstack@n-api.service[121403]: DEBUG dbcounter [-] [121403] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 18:59:25.686773 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.quota [None req-356f1914-2841-4a66-a223-f9971000b84f tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] Getting quotas for project 280a221575634c6f908d333db769739b. Resources: {'cores', 'ram', 'instances'} {{(pid=121403) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 01 18:59:25.700147 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.quota [None req-356f1914-2841-4a66-a223-f9971000b84f tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] Getting quotas for user 1b0619a8fc6f4fcc9eb5d4f473c595c9 and project 280a221575634c6f908d333db769739b. Resources: {'cores', 'ram', 'instances'} {{(pid=121403) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 01 18:59:25.702333 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-52416fdb-e5a5-4e77-b60c-5106c1993530 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:59:25.726265 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-52416fdb-e5a5-4e77-b60c-5106c1993530 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:59:25.731169 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-52416fdb-e5a5-4e77-b60c-5106c1993530 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:59:25.734591 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-356f1914-2841-4a66-a223-f9971000b84f tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] Going to run 1 instances... {{(pid=121403) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 01 18:59:25.737542 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-356f1914-2841-4a66-a223-f9971000b84f tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] [instance: d8e88b0f-ae97-44a4-8b6b-b94e2c600a83] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2d4a0047-1b9e-445f-8af8-1b5c9d93e881',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121403) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 01 18:59:25.741105 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-52416fdb-e5a5-4e77-b60c-5106c1993530 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] 10.222.0.13 "GET /compute/v2.1/servers/a7f88d19-08ee-47bf-9240-7d49afd775e2" status: 200 len: 1812 microversion: 2.25 time: 1.372033 Nov 01 18:59:25.745032 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 751/1456] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 18:59:24 2022] GET /compute/v2.1/servers/a7f88d19-08ee-47bf-9240-7d49afd775e2 => generated 1812 bytes in 1384 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 18:59:25.751557 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-4156fccc-7eb1-4be4-b1f8-ace1319f8613 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:59:25.752422 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-4156fccc-7eb1-4be4-b1f8-ace1319f8613 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] [instance: f6762e10-9d45-47cf-a6b6-d9bfc3404664] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:59:25.759482 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-4156fccc-7eb1-4be4-b1f8-ace1319f8613 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:59:25.760809 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-4156fccc-7eb1-4be4-b1f8-ace1319f8613 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:59:25.761502 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-4156fccc-7eb1-4be4-b1f8-ace1319f8613 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:59:25.762549 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-4156fccc-7eb1-4be4-b1f8-ace1319f8613 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:59:25.763433 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-4156fccc-7eb1-4be4-b1f8-ace1319f8613 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:59:25.764305 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-4156fccc-7eb1-4be4-b1f8-ace1319f8613 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:59:25.833702 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-356f1914-2841-4a66-a223-f9971000b84f tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.991256 Nov 01 18:59:25.841550 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 706/1457] 10.222.0.13 () {60 vars in 1147 bytes} [Tue Nov 1 18:59:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 1000 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 01 18:59:25.874846 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-1bc315bb-3927-4cd3-94fb-ca774c352c51 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:59:25.875756 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-1bc315bb-3927-4cd3-94fb-ca774c352c51 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] [instance: 3796ef05-cc8e-44d4-8dfc-058b5dbc8cbd] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:59:25.905321 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-1bc315bb-3927-4cd3-94fb-ca774c352c51 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:59:25.918909 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-1bc315bb-3927-4cd3-94fb-ca774c352c51 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:59:25.919529 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-1bc315bb-3927-4cd3-94fb-ca774c352c51 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:59:25.920959 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-1bc315bb-3927-4cd3-94fb-ca774c352c51 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:59:25.923090 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-1bc315bb-3927-4cd3-94fb-ca774c352c51 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:59:25.923624 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-1bc315bb-3927-4cd3-94fb-ca774c352c51 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:59:26.058694 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-1bc315bb-3927-4cd3-94fb-ca774c352c51 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0290a6bb8bc24b8988a925327ac0381c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86941784237549838bba63ce88053b88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:59:26.069977 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-1bc315bb-3927-4cd3-94fb-ca774c352c51 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] 10.222.0.13 "GET /compute/v2.1/servers/3796ef05-cc8e-44d4-8dfc-058b5dbc8cbd" status: 200 len: 1273 microversion: 2.1 time: 0.226478 Nov 01 18:59:26.075259 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 707/1458] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:59:25 2022] GET /compute/v2.1/servers/3796ef05-cc8e-44d4-8dfc-058b5dbc8cbd => generated 1273 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:59:26.098845 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [req-5d5798ba-88f0-4532-9249-5aabcd8ac84a req-85bf904e-d2c9-4387-b635-a04a9ff08514 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "495c1822-a615-4da7-a053-227744a46341", "tag": "7422b34a-996e-4f74-9ae8-e9724a7accf8"}]} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 18:59:26.117169 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-5d5798ba-88f0-4532-9249-5aabcd8ac84a req-85bf904e-d2c9-4387-b635-a04a9ff08514 service nova] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:59:26.117955 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-5d5798ba-88f0-4532-9249-5aabcd8ac84a req-85bf904e-d2c9-4387-b635-a04a9ff08514 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:59:26.121424 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-5d5798ba-88f0-4532-9249-5aabcd8ac84a req-85bf904e-d2c9-4387-b635-a04a9ff08514 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:59:26.144354 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.compute.server_external_events [req-5d5798ba-88f0-4532-9249-5aabcd8ac84a req-85bf904e-d2c9-4387-b635-a04a9ff08514 service nova] Creating event network-changed:7422b34a-996e-4f74-9ae8-e9724a7accf8 for instance 495c1822-a615-4da7-a053-227744a46341 on n-h2-863052-2 Nov 01 18:59:26.149961 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [req-5d5798ba-88f0-4532-9249-5aabcd8ac84a req-85bf904e-d2c9-4387-b635-a04a9ff08514 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073289 Nov 01 18:59:26.155025 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 708/1459] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Nov 1 18:59:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 18:59:26.160273 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-dff365b9-eeca-4cdb-b748-46f79b4556ad tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:59:26.160987 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-dff365b9-eeca-4cdb-b748-46f79b4556ad tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] [instance: 495c1822-a615-4da7-a053-227744a46341] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:59:26.167292 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-dff365b9-eeca-4cdb-b748-46f79b4556ad tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:59:26.167785 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-dff365b9-eeca-4cdb-b748-46f79b4556ad tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:59:26.168268 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-dff365b9-eeca-4cdb-b748-46f79b4556ad tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:59:26.168931 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-dff365b9-eeca-4cdb-b748-46f79b4556ad tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:59:26.169378 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-dff365b9-eeca-4cdb-b748-46f79b4556ad tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:59:26.169797 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-dff365b9-eeca-4cdb-b748-46f79b4556ad tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:59:26.336847 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-dff365b9-eeca-4cdb-b748-46f79b4556ad tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a9c3b6a8c34f068caa50dc10d13a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9ef08eba0ef431285fd15a2561b4e5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:59:26.346909 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-dff365b9-eeca-4cdb-b748-46f79b4556ad tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] 10.222.0.13 "GET /compute/v2.1/servers/495c1822-a615-4da7-a053-227744a46341" status: 200 len: 1316 microversion: 2.1 time: 0.190633 Nov 01 18:59:26.357621 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 709/1460] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:59:26 2022] GET /compute/v2.1/servers/495c1822-a615-4da7-a053-227744a46341 => generated 1316 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:59:26.369562 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-1825e319-ea4a-4221-a876-5ceca4ace900 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:59:26.371917 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-1825e319-ea4a-4221-a876-5ceca4ace900 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] [instance: 2d525a31-b0be-44cb-8fb7-335075145f08] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:59:26.380418 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-1825e319-ea4a-4221-a876-5ceca4ace900 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:59:26.381281 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-1825e319-ea4a-4221-a876-5ceca4ace900 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:59:26.381780 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-1825e319-ea4a-4221-a876-5ceca4ace900 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:59:26.382743 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-1825e319-ea4a-4221-a876-5ceca4ace900 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:59:26.383252 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-1825e319-ea4a-4221-a876-5ceca4ace900 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:59:26.384111 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-1825e319-ea4a-4221-a876-5ceca4ace900 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:59:26.437803 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-1825e319-ea4a-4221-a876-5ceca4ace900 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] 10.222.0.13 "GET /compute/v2.1/servers/2d525a31-b0be-44cb-8fb7-335075145f08/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.077989 Nov 01 18:59:26.442246 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 710/1461] 10.222.0.13 () {58 vars in 1302 bytes} [Tue Nov 1 18:59:26 2022] GET /compute/v2.1/servers/2d525a31-b0be-44cb-8fb7-335075145f08/os-volume_attachments => generated 197 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 18:59:26.453468 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-50550d5f-9fe3-4a8d-b2d9-468a7e9733f7 tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-1057026530", "imageRef": "2d4a0047-1b9e-445f-8af8-1b5c9d93e881", "flavorRef": "452"}} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 18:59:26.462432 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-4156fccc-7eb1-4be4-b1f8-ace1319f8613 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72117f17294649d6b8bc16c66c7efab2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45d4c047d3c44324a27a27831236ab0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:59:26.474082 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-4156fccc-7eb1-4be4-b1f8-ace1319f8613 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] 10.222.0.13 "GET /compute/v2.1/servers/f6762e10-9d45-47cf-a6b6-d9bfc3404664" status: 200 len: 1313 microversion: 2.1 time: 0.727602 Nov 01 18:59:26.474686 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 752/1462] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:59:25 2022] GET /compute/v2.1/servers/f6762e10-9d45-47cf-a6b6-d9bfc3404664 => generated 1313 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:59:26.581993 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.network.neutron [None req-50550d5f-9fe3-4a8d-b2d9-468a7e9733f7 tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] validate_networks() for None {{(pid=121403) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 01 18:59:26.774337 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-3977391b-f268-4287-ba74-b8c82f08effa tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:59:26.774948 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-3977391b-f268-4287-ba74-b8c82f08effa tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] [instance: a7f88d19-08ee-47bf-9240-7d49afd775e2] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:59:26.783776 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-3977391b-f268-4287-ba74-b8c82f08effa tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:59:26.784270 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-3977391b-f268-4287-ba74-b8c82f08effa tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:59:26.784771 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-3977391b-f268-4287-ba74-b8c82f08effa tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:59:26.785479 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-3977391b-f268-4287-ba74-b8c82f08effa tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:59:26.785931 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-3977391b-f268-4287-ba74-b8c82f08effa tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:59:26.786353 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-3977391b-f268-4287-ba74-b8c82f08effa tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:59:26.941261 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.virt.hardware [None req-50550d5f-9fe3-4a8d-b2d9-468a7e9733f7 tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] Flavor limits 0:0:0 {{(pid=121403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 01 18:59:26.942346 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.virt.hardware [None req-50550d5f-9fe3-4a8d-b2d9-468a7e9733f7 tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] Image limits 0:0:0 {{(pid=121403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 01 18:59:26.943055 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.virt.hardware [None req-50550d5f-9fe3-4a8d-b2d9-468a7e9733f7 tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] Flavor pref 0:0:0 {{(pid=121403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 01 18:59:26.943713 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.virt.hardware [None req-50550d5f-9fe3-4a8d-b2d9-468a7e9733f7 tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] Image pref 0:0:0 {{(pid=121403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 01 18:59:26.944692 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.virt.hardware [None req-50550d5f-9fe3-4a8d-b2d9-468a7e9733f7 tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 01 18:59:26.969725 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-50550d5f-9fe3-4a8d-b2d9-468a7e9733f7 tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:59:26.970224 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-50550d5f-9fe3-4a8d-b2d9-468a7e9733f7 tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:59:26.970665 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-50550d5f-9fe3-4a8d-b2d9-468a7e9733f7 tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:59:26.971409 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-50550d5f-9fe3-4a8d-b2d9-468a7e9733f7 tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:59:26.971869 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-50550d5f-9fe3-4a8d-b2d9-468a7e9733f7 tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:59:26.972350 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-50550d5f-9fe3-4a8d-b2d9-468a7e9733f7 tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:59:27.017229 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.quota [None req-50550d5f-9fe3-4a8d-b2d9-468a7e9733f7 tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] Getting quotas for project 280a221575634c6f908d333db769739b. Resources: {'cores', 'ram', 'instances'} {{(pid=121403) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 01 18:59:27.023576 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.quota [None req-50550d5f-9fe3-4a8d-b2d9-468a7e9733f7 tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] Getting quotas for user 1b0619a8fc6f4fcc9eb5d4f473c595c9 and project 280a221575634c6f908d333db769739b. Resources: {'cores', 'ram', 'instances'} {{(pid=121403) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 01 18:59:27.080497 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-50550d5f-9fe3-4a8d-b2d9-468a7e9733f7 tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] Going to run 1 instances... {{(pid=121403) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 01 18:59:27.082918 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-50550d5f-9fe3-4a8d-b2d9-468a7e9733f7 tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] [instance: c34b04e9-a50a-4c58-85ff-ecef0bfc0343] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2d4a0047-1b9e-445f-8af8-1b5c9d93e881',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121403) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 01 18:59:27.183942 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-50550d5f-9fe3-4a8d-b2d9-468a7e9733f7 tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.740564 Nov 01 18:59:27.190906 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 711/1463] 10.222.0.13 () {60 vars in 1147 bytes} [Tue Nov 1 18:59:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 742 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 01 18:59:27.202908 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-1adfb942-1c1f-4c06-ba8c-2bce08340b02 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:59:27.203478 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-1adfb942-1c1f-4c06-ba8c-2bce08340b02 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] [instance: 3796ef05-cc8e-44d4-8dfc-058b5dbc8cbd] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:59:27.210532 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-1adfb942-1c1f-4c06-ba8c-2bce08340b02 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:59:27.211032 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-1adfb942-1c1f-4c06-ba8c-2bce08340b02 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:59:27.211477 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-1adfb942-1c1f-4c06-ba8c-2bce08340b02 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:59:27.213362 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-1adfb942-1c1f-4c06-ba8c-2bce08340b02 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:59:27.214755 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-1adfb942-1c1f-4c06-ba8c-2bce08340b02 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:59:27.214936 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-1adfb942-1c1f-4c06-ba8c-2bce08340b02 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:59:27.625360 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-1adfb942-1c1f-4c06-ba8c-2bce08340b02 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0290a6bb8bc24b8988a925327ac0381c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86941784237549838bba63ce88053b88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:59:27.638654 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-1adfb942-1c1f-4c06-ba8c-2bce08340b02 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] 10.222.0.13 "GET /compute/v2.1/servers/3796ef05-cc8e-44d4-8dfc-058b5dbc8cbd" status: 200 len: 1315 microversion: 2.1 time: 0.450039 Nov 01 18:59:27.650869 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-3977391b-f268-4287-ba74-b8c82f08effa tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:59:27.657311 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 712/1464] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:59:27 2022] GET /compute/v2.1/servers/3796ef05-cc8e-44d4-8dfc-058b5dbc8cbd => generated 1315 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:59:27.664800 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-3977391b-f268-4287-ba74-b8c82f08effa tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:59:27.667901 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-3977391b-f268-4287-ba74-b8c82f08effa tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:59:27.672145 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-3977391b-f268-4287-ba74-b8c82f08effa tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] 10.222.0.13 "GET /compute/v2.1/servers/a7f88d19-08ee-47bf-9240-7d49afd775e2" status: 200 len: 1812 microversion: 2.25 time: 0.901146 Nov 01 18:59:27.677816 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-64164514-42e4-4d69-ad9b-b5a68ce3c02c tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:59:27.678450 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-64164514-42e4-4d69-ad9b-b5a68ce3c02c tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] [instance: c34b04e9-a50a-4c58-85ff-ecef0bfc0343] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:59:27.686765 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 753/1465] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 18:59:26 2022] GET /compute/v2.1/servers/a7f88d19-08ee-47bf-9240-7d49afd775e2 => generated 1812 bytes in 918 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 01 18:59:27.692728 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-481f96e8-9ac4-48cf-9991-d409a92c33b9 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:59:27.693749 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-481f96e8-9ac4-48cf-9991-d409a92c33b9 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] [instance: 495c1822-a615-4da7-a053-227744a46341] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:59:27.703421 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-481f96e8-9ac4-48cf-9991-d409a92c33b9 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:59:27.704140 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-481f96e8-9ac4-48cf-9991-d409a92c33b9 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:59:27.704869 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-481f96e8-9ac4-48cf-9991-d409a92c33b9 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:59:27.706504 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-481f96e8-9ac4-48cf-9991-d409a92c33b9 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:59:27.707176 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-481f96e8-9ac4-48cf-9991-d409a92c33b9 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:59:27.707834 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-481f96e8-9ac4-48cf-9991-d409a92c33b9 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:59:27.745973 n-d-863052-2 devstack@n-api.service[121402]: DEBUG dbcounter [-] [121402] Writing DB stats nova_cell0:SELECT=2 {{(pid=121402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 18:59:27.988393 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-64164514-42e4-4d69-ad9b-b5a68ce3c02c tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b0619a8fc6f4fcc9eb5d4f473c595c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '280a221575634c6f908d333db769739b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:59:28.001560 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-64164514-42e4-4d69-ad9b-b5a68ce3c02c tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] 10.222.0.13 "GET /compute/v2.1/servers/c34b04e9-a50a-4c58-85ff-ecef0bfc0343" status: 200 len: 1218 microversion: 2.1 time: 0.347656 Nov 01 18:59:28.003583 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 713/1466] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:59:27 2022] GET /compute/v2.1/servers/c34b04e9-a50a-4c58-85ff-ecef0bfc0343 => generated 1218 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:59:28.011279 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-8ccd9a2a-c9f5-4ca6-ab2a-b578ba1d9d20 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:59:28.019361 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-8ccd9a2a-c9f5-4ca6-ab2a-b578ba1d9d20 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] [instance: 2d525a31-b0be-44cb-8fb7-335075145f08] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:59:28.034974 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-8ccd9a2a-c9f5-4ca6-ab2a-b578ba1d9d20 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:59:28.038079 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-8ccd9a2a-c9f5-4ca6-ab2a-b578ba1d9d20 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:59:28.038826 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-8ccd9a2a-c9f5-4ca6-ab2a-b578ba1d9d20 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:59:28.040396 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-8ccd9a2a-c9f5-4ca6-ab2a-b578ba1d9d20 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:59:28.041161 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-8ccd9a2a-c9f5-4ca6-ab2a-b578ba1d9d20 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:59:28.043024 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-8ccd9a2a-c9f5-4ca6-ab2a-b578ba1d9d20 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:59:28.117116 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-8ccd9a2a-c9f5-4ca6-ab2a-b578ba1d9d20 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] 10.222.0.13 "GET /compute/v2.1/servers/2d525a31-b0be-44cb-8fb7-335075145f08/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.111855 Nov 01 18:59:28.124623 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 714/1467] 10.222.0.13 () {58 vars in 1302 bytes} [Tue Nov 1 18:59:28 2022] GET /compute/v2.1/servers/2d525a31-b0be-44cb-8fb7-335075145f08/os-volume_attachments => generated 197 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 18:59:28.136119 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-81a3668e-dc1d-4e5f-8e83-753c411a62ab tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:59:28.136661 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-81a3668e-dc1d-4e5f-8e83-753c411a62ab tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] [instance: f6762e10-9d45-47cf-a6b6-d9bfc3404664] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:59:28.147912 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-81a3668e-dc1d-4e5f-8e83-753c411a62ab tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:59:28.151097 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-81a3668e-dc1d-4e5f-8e83-753c411a62ab tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:59:28.151748 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-81a3668e-dc1d-4e5f-8e83-753c411a62ab tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:59:28.153935 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-81a3668e-dc1d-4e5f-8e83-753c411a62ab tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:59:28.157116 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-81a3668e-dc1d-4e5f-8e83-753c411a62ab tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:59:28.157767 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-81a3668e-dc1d-4e5f-8e83-753c411a62ab tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:59:28.512749 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-481f96e8-9ac4-48cf-9991-d409a92c33b9 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a9c3b6a8c34f068caa50dc10d13a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9ef08eba0ef431285fd15a2561b4e5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:59:28.534397 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-481f96e8-9ac4-48cf-9991-d409a92c33b9 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] 10.222.0.13 "GET /compute/v2.1/servers/495c1822-a615-4da7-a053-227744a46341" status: 200 len: 1316 microversion: 2.1 time: 0.846166 Nov 01 18:59:28.563868 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 754/1468] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:59:27 2022] GET /compute/v2.1/servers/495c1822-a615-4da7-a053-227744a46341 => generated 1316 bytes in 876 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:59:28.636251 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-81a3668e-dc1d-4e5f-8e83-753c411a62ab tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72117f17294649d6b8bc16c66c7efab2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45d4c047d3c44324a27a27831236ab0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:59:28.652084 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-81a3668e-dc1d-4e5f-8e83-753c411a62ab tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] 10.222.0.13 "GET /compute/v2.1/servers/f6762e10-9d45-47cf-a6b6-d9bfc3404664" status: 200 len: 1313 microversion: 2.1 time: 0.523872 Nov 01 18:59:28.652792 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 715/1469] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:59:28 2022] GET /compute/v2.1/servers/f6762e10-9d45-47cf-a6b6-d9bfc3404664 => generated 1313 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:59:28.664239 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-2c9a33d8-0b58-4abe-9d3d-e427c1682914 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:59:28.664887 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-2c9a33d8-0b58-4abe-9d3d-e427c1682914 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] [instance: 3796ef05-cc8e-44d4-8dfc-058b5dbc8cbd] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:59:28.688495 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2c9a33d8-0b58-4abe-9d3d-e427c1682914 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:59:28.690174 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2c9a33d8-0b58-4abe-9d3d-e427c1682914 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:59:28.690817 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2c9a33d8-0b58-4abe-9d3d-e427c1682914 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:59:28.692057 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2c9a33d8-0b58-4abe-9d3d-e427c1682914 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:59:28.692415 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2c9a33d8-0b58-4abe-9d3d-e427c1682914 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:59:28.697903 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2c9a33d8-0b58-4abe-9d3d-e427c1682914 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:59:28.705885 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-d010e211-5c1f-497c-85c7-251c34711198 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:59:28.706870 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-d010e211-5c1f-497c-85c7-251c34711198 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] [instance: a7f88d19-08ee-47bf-9240-7d49afd775e2] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:59:28.716141 n-d-863052-2 devstack@n-api.service[121402]: DEBUG dbcounter [-] [121402] Writing DB stats nova_cell0:SELECT=4 {{(pid=121402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 18:59:28.719925 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d010e211-5c1f-497c-85c7-251c34711198 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:59:28.722767 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d010e211-5c1f-497c-85c7-251c34711198 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:59:28.723222 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d010e211-5c1f-497c-85c7-251c34711198 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:59:28.723948 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d010e211-5c1f-497c-85c7-251c34711198 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:59:28.724410 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d010e211-5c1f-497c-85c7-251c34711198 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:59:28.729090 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d010e211-5c1f-497c-85c7-251c34711198 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:59:29.134666 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-2c9a33d8-0b58-4abe-9d3d-e427c1682914 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0290a6bb8bc24b8988a925327ac0381c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86941784237549838bba63ce88053b88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:59:29.146195 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-2c9a33d8-0b58-4abe-9d3d-e427c1682914 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] 10.222.0.13 "GET /compute/v2.1/servers/3796ef05-cc8e-44d4-8dfc-058b5dbc8cbd" status: 200 len: 1315 microversion: 2.1 time: 0.485819 Nov 01 18:59:29.146704 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 755/1470] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:59:28 2022] GET /compute/v2.1/servers/3796ef05-cc8e-44d4-8dfc-058b5dbc8cbd => generated 1315 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:59:29.153853 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-4596a7a0-bb2a-42d0-8d71-24e23f9a3d89 tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:59:29.154513 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-4596a7a0-bb2a-42d0-8d71-24e23f9a3d89 tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] [instance: c34b04e9-a50a-4c58-85ff-ecef0bfc0343] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:59:29.170679 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-4596a7a0-bb2a-42d0-8d71-24e23f9a3d89 tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:59:29.171411 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-4596a7a0-bb2a-42d0-8d71-24e23f9a3d89 tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:59:29.172105 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-4596a7a0-bb2a-42d0-8d71-24e23f9a3d89 tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:59:29.184445 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-4596a7a0-bb2a-42d0-8d71-24e23f9a3d89 tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:59:29.188625 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-4596a7a0-bb2a-42d0-8d71-24e23f9a3d89 tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:59:29.190690 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-4596a7a0-bb2a-42d0-8d71-24e23f9a3d89 tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:59:29.323732 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-4596a7a0-bb2a-42d0-8d71-24e23f9a3d89 tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b0619a8fc6f4fcc9eb5d4f473c595c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '280a221575634c6f908d333db769739b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:59:29.334257 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-4596a7a0-bb2a-42d0-8d71-24e23f9a3d89 tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] 10.222.0.13 "GET /compute/v2.1/servers/c34b04e9-a50a-4c58-85ff-ecef0bfc0343" status: 200 len: 1270 microversion: 2.1 time: 0.184463 Nov 01 18:59:29.335438 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 756/1471] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:59:29 2022] GET /compute/v2.1/servers/c34b04e9-a50a-4c58-85ff-ecef0bfc0343 => generated 1270 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:59:29.340606 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-865d85de-cda8-45c4-9109-bf14d0094f39 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:59:29.343810 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-865d85de-cda8-45c4-9109-bf14d0094f39 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] [instance: 2d525a31-b0be-44cb-8fb7-335075145f08] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:59:29.350331 n-d-863052-2 devstack@n-api.service[121402]: DEBUG dbcounter [-] [121402] Writing DB stats nova_api:SELECT=100 {{(pid=121402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 18:59:29.352153 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-865d85de-cda8-45c4-9109-bf14d0094f39 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:59:29.352848 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-865d85de-cda8-45c4-9109-bf14d0094f39 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:59:29.353909 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-865d85de-cda8-45c4-9109-bf14d0094f39 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:59:29.354834 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-865d85de-cda8-45c4-9109-bf14d0094f39 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:59:29.355440 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-865d85de-cda8-45c4-9109-bf14d0094f39 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:59:29.356004 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-865d85de-cda8-45c4-9109-bf14d0094f39 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:59:29.418270 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-865d85de-cda8-45c4-9109-bf14d0094f39 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] 10.222.0.13 "GET /compute/v2.1/servers/2d525a31-b0be-44cb-8fb7-335075145f08/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.081396 Nov 01 18:59:29.429617 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 757/1472] 10.222.0.13 () {58 vars in 1302 bytes} [Tue Nov 1 18:59:29 2022] GET /compute/v2.1/servers/2d525a31-b0be-44cb-8fb7-335075145f08/os-volume_attachments => generated 197 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 18:59:29.434335 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [req-7b5d30a7-307f-4203-8a92-2639227c5902 req-46f7aae4-1d46-4e56-a8d0-8f7763a486a3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f6762e10-9d45-47cf-a6b6-d9bfc3404664", "tag": "ce9efbc4-25cd-4125-8921-620c35a44e5f"}]} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 18:59:29.477359 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-7b5d30a7-307f-4203-8a92-2639227c5902 req-46f7aae4-1d46-4e56-a8d0-8f7763a486a3 service nova] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:59:29.478238 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-7b5d30a7-307f-4203-8a92-2639227c5902 req-46f7aae4-1d46-4e56-a8d0-8f7763a486a3 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:59:29.478841 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-7b5d30a7-307f-4203-8a92-2639227c5902 req-46f7aae4-1d46-4e56-a8d0-8f7763a486a3 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:59:29.528088 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.compute.server_external_events [req-7b5d30a7-307f-4203-8a92-2639227c5902 req-46f7aae4-1d46-4e56-a8d0-8f7763a486a3 service nova] Creating event network-changed:ce9efbc4-25cd-4125-8921-620c35a44e5f for instance f6762e10-9d45-47cf-a6b6-d9bfc3404664 on n-h1-863052-2 Nov 01 18:59:29.548749 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [req-7b5d30a7-307f-4203-8a92-2639227c5902 req-46f7aae4-1d46-4e56-a8d0-8f7763a486a3 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.111470 Nov 01 18:59:29.549654 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 758/1473] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Nov 1 18:59:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 18:59:29.586892 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-579c65d7-72dd-40b9-bb18-c0b28c1b2d2f tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:59:29.587271 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-579c65d7-72dd-40b9-bb18-c0b28c1b2d2f tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] [instance: 495c1822-a615-4da7-a053-227744a46341] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:59:29.602991 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-579c65d7-72dd-40b9-bb18-c0b28c1b2d2f tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:59:29.605411 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-579c65d7-72dd-40b9-bb18-c0b28c1b2d2f tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:59:29.606410 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-579c65d7-72dd-40b9-bb18-c0b28c1b2d2f tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:59:29.609114 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-579c65d7-72dd-40b9-bb18-c0b28c1b2d2f tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:59:29.612642 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-579c65d7-72dd-40b9-bb18-c0b28c1b2d2f tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:59:29.616061 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-579c65d7-72dd-40b9-bb18-c0b28c1b2d2f tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:59:29.913596 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-d010e211-5c1f-497c-85c7-251c34711198 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:59:29.932907 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-d010e211-5c1f-497c-85c7-251c34711198 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:59:29.944658 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-d010e211-5c1f-497c-85c7-251c34711198 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:59:29.948752 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-d010e211-5c1f-497c-85c7-251c34711198 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] 10.222.0.13 "GET /compute/v2.1/servers/a7f88d19-08ee-47bf-9240-7d49afd775e2" status: 200 len: 1812 microversion: 2.25 time: 1.250291 Nov 01 18:59:29.953162 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 716/1474] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 18:59:28 2022] GET /compute/v2.1/servers/a7f88d19-08ee-47bf-9240-7d49afd775e2 => generated 1812 bytes in 1255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 01 18:59:29.969661 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-cfeb15a8-79f6-40c2-b352-83dadc8c2c0d tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:59:29.970607 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-cfeb15a8-79f6-40c2-b352-83dadc8c2c0d tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] [instance: f6762e10-9d45-47cf-a6b6-d9bfc3404664] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:59:29.985021 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-cfeb15a8-79f6-40c2-b352-83dadc8c2c0d tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:59:29.988792 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-cfeb15a8-79f6-40c2-b352-83dadc8c2c0d tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:59:29.991158 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-cfeb15a8-79f6-40c2-b352-83dadc8c2c0d tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:59:29.994150 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-cfeb15a8-79f6-40c2-b352-83dadc8c2c0d tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:59:29.996017 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-cfeb15a8-79f6-40c2-b352-83dadc8c2c0d tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:59:29.996509 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-cfeb15a8-79f6-40c2-b352-83dadc8c2c0d tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:59:30.405942 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-579c65d7-72dd-40b9-bb18-c0b28c1b2d2f tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a9c3b6a8c34f068caa50dc10d13a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9ef08eba0ef431285fd15a2561b4e5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:59:30.412119 n-d-863052-2 devstack@n-api.service[121402]: DEBUG dbcounter [-] [121402] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=121402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 18:59:30.419404 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-579c65d7-72dd-40b9-bb18-c0b28c1b2d2f tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] 10.222.0.13 "GET /compute/v2.1/servers/495c1822-a615-4da7-a053-227744a46341" status: 200 len: 1316 microversion: 2.1 time: 0.838580 Nov 01 18:59:30.420646 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 759/1475] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:59:29 2022] GET /compute/v2.1/servers/495c1822-a615-4da7-a053-227744a46341 => generated 1316 bytes in 841 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 18:59:30.425381 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-4a11435e-ca0b-47ce-90af-975c7ae69044 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Action: 'create', calling method: .version_select at 0x7f0ae1d165e0>, body: {"keypair": {"name": "tempest-keypair-230221922", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM6QCFoIZ10/nNUclpuAdFwqS+hW6Sj1UfTO4nHA+wUuuUlxDLklhWujexixBuk3tdUnbSnkuV74mEx79Y6D8bm4tpjK5j+zMT+lpbOPMClFEtMLpsvqY+E4v1AY3LM0lw=="}} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 18:59:30.451958 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.quota [None req-4a11435e-ca0b-47ce-90af-975c7ae69044 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Getting quotas for project 4a1bb191cff948e99c008b5e861ce4a8. Resources: {'key_pairs'} {{(pid=121402) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 01 18:59:30.459228 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.quota [None req-4a11435e-ca0b-47ce-90af-975c7ae69044 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Getting quotas for user 6a63d69c99a546f0af16329cff3ca717 and project 4a1bb191cff948e99c008b5e861ce4a8. Resources: {'key_pairs'} {{(pid=121402) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 01 18:59:30.495681 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-4a11435e-ca0b-47ce-90af-975c7ae69044 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.072491 Nov 01 18:59:30.499586 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 760/1476] 10.222.0.13 () {60 vars in 1159 bytes} [Tue Nov 1 18:59:30 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 18:59:30.504676 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-f75b3607-e224-4761-ab03-c4e982e52ad7 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:59:30.507074 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-f75b3607-e224-4761-ab03-c4e982e52ad7 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] [instance: 3796ef05-cc8e-44d4-8dfc-058b5dbc8cbd] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:59:30.528010 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f75b3607-e224-4761-ab03-c4e982e52ad7 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:59:30.529013 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f75b3607-e224-4761-ab03-c4e982e52ad7 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:59:30.531092 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f75b3607-e224-4761-ab03-c4e982e52ad7 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:59:30.532316 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f75b3607-e224-4761-ab03-c4e982e52ad7 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:59:30.534613 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f75b3607-e224-4761-ab03-c4e982e52ad7 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:59:30.535238 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f75b3607-e224-4761-ab03-c4e982e52ad7 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:59:30.658698 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-cfeb15a8-79f6-40c2-b352-83dadc8c2c0d tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72117f17294649d6b8bc16c66c7efab2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45d4c047d3c44324a27a27831236ab0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:59:30.671147 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-cfeb15a8-79f6-40c2-b352-83dadc8c2c0d tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] 10.222.0.13 "GET /compute/v2.1/servers/f6762e10-9d45-47cf-a6b6-d9bfc3404664" status: 200 len: 1313 microversion: 2.1 time: 0.716488 Nov 01 18:59:30.674287 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 717/1477] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:59:29 2022] GET /compute/v2.1/servers/f6762e10-9d45-47cf-a6b6-d9bfc3404664 => generated 1313 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:59:30.686006 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-d2c232d7-8579-4973-85dd-4261e34f816b tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:59:30.687716 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-d2c232d7-8579-4973-85dd-4261e34f816b tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] [instance: c34b04e9-a50a-4c58-85ff-ecef0bfc0343] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:59:30.699301 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d2c232d7-8579-4973-85dd-4261e34f816b tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:59:30.700045 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d2c232d7-8579-4973-85dd-4261e34f816b tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:59:30.700923 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d2c232d7-8579-4973-85dd-4261e34f816b tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:59:30.702534 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d2c232d7-8579-4973-85dd-4261e34f816b tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:59:30.703230 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d2c232d7-8579-4973-85dd-4261e34f816b tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:59:30.704091 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d2c232d7-8579-4973-85dd-4261e34f816b tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:59:30.862556 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-d2c232d7-8579-4973-85dd-4261e34f816b tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b0619a8fc6f4fcc9eb5d4f473c595c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '280a221575634c6f908d333db769739b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:59:30.879180 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-d2c232d7-8579-4973-85dd-4261e34f816b tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] 10.222.0.13 "GET /compute/v2.1/servers/c34b04e9-a50a-4c58-85ff-ecef0bfc0343" status: 200 len: 1276 microversion: 2.1 time: 0.200178 Nov 01 18:59:30.882669 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 718/1478] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:59:30 2022] GET /compute/v2.1/servers/c34b04e9-a50a-4c58-85ff-ecef0bfc0343 => generated 1276 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:59:30.892997 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-9f63018d-df68-48d7-822a-9b35816c4292 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:59:30.897611 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-9f63018d-df68-48d7-822a-9b35816c4292 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] [instance: 2d525a31-b0be-44cb-8fb7-335075145f08] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:59:30.908667 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-9f63018d-df68-48d7-822a-9b35816c4292 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:59:30.910107 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-9f63018d-df68-48d7-822a-9b35816c4292 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:59:30.911508 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-9f63018d-df68-48d7-822a-9b35816c4292 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:59:30.913825 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-9f63018d-df68-48d7-822a-9b35816c4292 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:59:30.915266 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-9f63018d-df68-48d7-822a-9b35816c4292 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:59:30.915934 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-9f63018d-df68-48d7-822a-9b35816c4292 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:59:30.974273 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-9f63018d-df68-48d7-822a-9b35816c4292 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] 10.222.0.13 "GET /compute/v2.1/servers/2d525a31-b0be-44cb-8fb7-335075145f08/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.089647 Nov 01 18:59:30.976027 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 719/1479] 10.222.0.13 () {58 vars in 1302 bytes} [Tue Nov 1 18:59:30 2022] GET /compute/v2.1/servers/2d525a31-b0be-44cb-8fb7-335075145f08/os-volume_attachments => generated 25 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 01 18:59:30.984656 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-5652bd9f-e2e9-42be-abba-31b898374f04 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:59:30.985666 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-5652bd9f-e2e9-42be-abba-31b898374f04 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] [instance: a7f88d19-08ee-47bf-9240-7d49afd775e2] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:59:30.997019 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-5652bd9f-e2e9-42be-abba-31b898374f04 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:59:30.998746 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-5652bd9f-e2e9-42be-abba-31b898374f04 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:59:31.000971 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-5652bd9f-e2e9-42be-abba-31b898374f04 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:59:31.002658 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-5652bd9f-e2e9-42be-abba-31b898374f04 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:59:31.002962 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-5652bd9f-e2e9-42be-abba-31b898374f04 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:59:31.003756 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-5652bd9f-e2e9-42be-abba-31b898374f04 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:59:31.068233 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-f75b3607-e224-4761-ab03-c4e982e52ad7 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0290a6bb8bc24b8988a925327ac0381c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86941784237549838bba63ce88053b88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:59:31.079563 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-f75b3607-e224-4761-ab03-c4e982e52ad7 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] 10.222.0.13 "GET /compute/v2.1/servers/3796ef05-cc8e-44d4-8dfc-058b5dbc8cbd" status: 200 len: 1315 microversion: 2.1 time: 0.578535 Nov 01 18:59:31.089752 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 761/1480] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:59:30 2022] GET /compute/v2.1/servers/3796ef05-cc8e-44d4-8dfc-058b5dbc8cbd => generated 1315 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:59:31.441650 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-5652bd9f-e2e9-42be-abba-31b898374f04 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:59:31.446196 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-21cf0ad3-3c6f-44ff-bd65-84c05090df11 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:59:31.452218 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-21cf0ad3-3c6f-44ff-bd65-84c05090df11 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] [instance: 495c1822-a615-4da7-a053-227744a46341] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:59:31.460749 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-5652bd9f-e2e9-42be-abba-31b898374f04 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:59:31.462203 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-5652bd9f-e2e9-42be-abba-31b898374f04 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:59:31.463373 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-5652bd9f-e2e9-42be-abba-31b898374f04 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] 10.222.0.13 "GET /compute/v2.1/servers/a7f88d19-08ee-47bf-9240-7d49afd775e2" status: 200 len: 1812 microversion: 2.25 time: 0.486048 Nov 01 18:59:31.463927 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 720/1481] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 18:59:30 2022] GET /compute/v2.1/servers/a7f88d19-08ee-47bf-9240-7d49afd775e2 => generated 1812 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 18:59:31.473400 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-21cf0ad3-3c6f-44ff-bd65-84c05090df11 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:59:31.473920 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-21cf0ad3-3c6f-44ff-bd65-84c05090df11 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:59:31.474514 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-21cf0ad3-3c6f-44ff-bd65-84c05090df11 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:59:31.476472 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-21cf0ad3-3c6f-44ff-bd65-84c05090df11 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:59:31.477900 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-21cf0ad3-3c6f-44ff-bd65-84c05090df11 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:59:31.479071 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-21cf0ad3-3c6f-44ff-bd65-84c05090df11 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:59:31.528918 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [req-1b192fed-b6ff-4bf8-8fcc-9a36516446f4 req-a135560d-0d83-471c-8777-1814c5aaed9b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "495c1822-a615-4da7-a053-227744a46341", "name": "network-vif-plugged", "status": "completed", "tag": "7422b34a-996e-4f74-9ae8-e9724a7accf8"}]} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 18:59:31.563418 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-1b192fed-b6ff-4bf8-8fcc-9a36516446f4 req-a135560d-0d83-471c-8777-1814c5aaed9b service nova] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:59:31.563885 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-1b192fed-b6ff-4bf8-8fcc-9a36516446f4 req-a135560d-0d83-471c-8777-1814c5aaed9b service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:59:31.564390 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-1b192fed-b6ff-4bf8-8fcc-9a36516446f4 req-a135560d-0d83-471c-8777-1814c5aaed9b service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:59:31.603274 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.compute.server_external_events [req-1b192fed-b6ff-4bf8-8fcc-9a36516446f4 req-a135560d-0d83-471c-8777-1814c5aaed9b service nova] Creating event network-vif-plugged:7422b34a-996e-4f74-9ae8-e9724a7accf8 for instance 495c1822-a615-4da7-a053-227744a46341 on n-h2-863052-2 Nov 01 18:59:31.624798 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [req-1b192fed-b6ff-4bf8-8fcc-9a36516446f4 req-a135560d-0d83-471c-8777-1814c5aaed9b service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099210 Nov 01 18:59:31.629833 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 721/1482] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Nov 1 18:59:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 01 18:59:31.638387 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [req-29671ab1-5247-47b6-beac-0713ae5a17a7 req-1b46baaa-446e-410f-a27b-27317a825dd9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3796ef05-cc8e-44d4-8dfc-058b5dbc8cbd", "tag": "42ac695b-939d-43c0-9e82-2359f65aad09"}]} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 18:59:31.653898 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-29671ab1-5247-47b6-beac-0713ae5a17a7 req-1b46baaa-446e-410f-a27b-27317a825dd9 service nova] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:59:31.655059 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-29671ab1-5247-47b6-beac-0713ae5a17a7 req-1b46baaa-446e-410f-a27b-27317a825dd9 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:59:31.656892 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-29671ab1-5247-47b6-beac-0713ae5a17a7 req-1b46baaa-446e-410f-a27b-27317a825dd9 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:59:31.679604 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.compute.server_external_events [req-29671ab1-5247-47b6-beac-0713ae5a17a7 req-1b46baaa-446e-410f-a27b-27317a825dd9 service nova] Creating event network-changed:42ac695b-939d-43c0-9e82-2359f65aad09 for instance 3796ef05-cc8e-44d4-8dfc-058b5dbc8cbd on n-h2-863052-2 Nov 01 18:59:31.689502 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [req-29671ab1-5247-47b6-beac-0713ae5a17a7 req-1b46baaa-446e-410f-a27b-27317a825dd9 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057363 Nov 01 18:59:31.692407 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 722/1483] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Nov 1 18:59:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 18:59:31.713206 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-aa261ad4-8c86-43b7-b966-64b5de24ada8 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:59:31.715126 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-aa261ad4-8c86-43b7-b966-64b5de24ada8 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] [instance: f6762e10-9d45-47cf-a6b6-d9bfc3404664] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:59:31.724254 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-aa261ad4-8c86-43b7-b966-64b5de24ada8 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:59:31.725069 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-aa261ad4-8c86-43b7-b966-64b5de24ada8 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:59:31.725581 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-aa261ad4-8c86-43b7-b966-64b5de24ada8 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:59:31.727118 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-aa261ad4-8c86-43b7-b966-64b5de24ada8 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:59:31.727662 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-aa261ad4-8c86-43b7-b966-64b5de24ada8 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:59:31.728269 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-aa261ad4-8c86-43b7-b966-64b5de24ada8 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:59:31.928137 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-21cf0ad3-3c6f-44ff-bd65-84c05090df11 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a9c3b6a8c34f068caa50dc10d13a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9ef08eba0ef431285fd15a2561b4e5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:59:31.946017 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-21cf0ad3-3c6f-44ff-bd65-84c05090df11 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] 10.222.0.13 "GET /compute/v2.1/servers/495c1822-a615-4da7-a053-227744a46341" status: 200 len: 1316 microversion: 2.1 time: 0.504745 Nov 01 18:59:31.946621 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 762/1484] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:59:31 2022] GET /compute/v2.1/servers/495c1822-a615-4da7-a053-227744a46341 => generated 1316 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 18:59:31.967837 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-72b32afa-e7c2-4bca-b805-668c7c9b986e tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:59:31.968915 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-72b32afa-e7c2-4bca-b805-668c7c9b986e tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] [instance: c34b04e9-a50a-4c58-85ff-ecef0bfc0343] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:59:31.975694 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-72b32afa-e7c2-4bca-b805-668c7c9b986e tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:59:31.976513 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-72b32afa-e7c2-4bca-b805-668c7c9b986e tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:59:31.977516 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-72b32afa-e7c2-4bca-b805-668c7c9b986e tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:59:31.978474 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-72b32afa-e7c2-4bca-b805-668c7c9b986e tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:59:31.979147 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-72b32afa-e7c2-4bca-b805-668c7c9b986e tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:59:31.979782 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-72b32afa-e7c2-4bca-b805-668c7c9b986e tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:59:32.033669 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-aa261ad4-8c86-43b7-b966-64b5de24ada8 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72117f17294649d6b8bc16c66c7efab2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45d4c047d3c44324a27a27831236ab0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:59:32.053864 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-aa261ad4-8c86-43b7-b966-64b5de24ada8 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] 10.222.0.13 "GET /compute/v2.1/servers/f6762e10-9d45-47cf-a6b6-d9bfc3404664" status: 200 len: 1313 microversion: 2.1 time: 0.357293 Nov 01 18:59:32.073477 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 723/1485] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:59:31 2022] GET /compute/v2.1/servers/f6762e10-9d45-47cf-a6b6-d9bfc3404664 => generated 1313 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:59:32.085001 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-72b32afa-e7c2-4bca-b805-668c7c9b986e tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b0619a8fc6f4fcc9eb5d4f473c595c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '280a221575634c6f908d333db769739b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:59:32.095743 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-72b32afa-e7c2-4bca-b805-668c7c9b986e tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] 10.222.0.13 "GET /compute/v2.1/servers/c34b04e9-a50a-4c58-85ff-ecef0bfc0343" status: 200 len: 1276 microversion: 2.1 time: 0.135050 Nov 01 18:59:32.096358 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 763/1486] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:59:31 2022] GET /compute/v2.1/servers/c34b04e9-a50a-4c58-85ff-ecef0bfc0343 => generated 1276 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:59:32.117139 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-2c94edab-9fbb-4dcf-a3c6-4ff23815a0cc tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:59:32.117808 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-2c94edab-9fbb-4dcf-a3c6-4ff23815a0cc tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] [instance: 3796ef05-cc8e-44d4-8dfc-058b5dbc8cbd] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:59:32.142998 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-2c94edab-9fbb-4dcf-a3c6-4ff23815a0cc tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:59:32.155145 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-2c94edab-9fbb-4dcf-a3c6-4ff23815a0cc tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:59:32.155722 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-2c94edab-9fbb-4dcf-a3c6-4ff23815a0cc tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:59:32.158524 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-2c94edab-9fbb-4dcf-a3c6-4ff23815a0cc tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:59:32.159008 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-2c94edab-9fbb-4dcf-a3c6-4ff23815a0cc tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:59:32.160735 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-2c94edab-9fbb-4dcf-a3c6-4ff23815a0cc tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:59:32.491952 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-8ff8fd96-c50a-4cd6-b923-bde05968346e tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:59:32.492572 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-8ff8fd96-c50a-4cd6-b923-bde05968346e tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] [instance: a7f88d19-08ee-47bf-9240-7d49afd775e2] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:59:32.504826 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-8ff8fd96-c50a-4cd6-b923-bde05968346e tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:59:32.505351 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-8ff8fd96-c50a-4cd6-b923-bde05968346e tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:59:32.505798 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-8ff8fd96-c50a-4cd6-b923-bde05968346e tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:59:32.506553 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-8ff8fd96-c50a-4cd6-b923-bde05968346e tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:59:32.506958 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-8ff8fd96-c50a-4cd6-b923-bde05968346e tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:59:32.507379 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-8ff8fd96-c50a-4cd6-b923-bde05968346e tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:59:32.595775 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-2c94edab-9fbb-4dcf-a3c6-4ff23815a0cc tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0290a6bb8bc24b8988a925327ac0381c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86941784237549838bba63ce88053b88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:59:32.613615 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-2c94edab-9fbb-4dcf-a3c6-4ff23815a0cc tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] 10.222.0.13 "GET /compute/v2.1/servers/3796ef05-cc8e-44d4-8dfc-058b5dbc8cbd" status: 200 len: 1315 microversion: 2.1 time: 0.508500 Nov 01 18:59:32.614685 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 724/1487] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:59:32 2022] GET /compute/v2.1/servers/3796ef05-cc8e-44d4-8dfc-058b5dbc8cbd => generated 1315 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:59:32.971515 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-2d933b33-7a89-43dc-ba74-e3d7099663c7 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:59:32.975075 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-2d933b33-7a89-43dc-ba74-e3d7099663c7 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] [instance: 495c1822-a615-4da7-a053-227744a46341] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:59:32.983477 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-2d933b33-7a89-43dc-ba74-e3d7099663c7 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:59:32.983946 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-2d933b33-7a89-43dc-ba74-e3d7099663c7 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:59:32.986100 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-2d933b33-7a89-43dc-ba74-e3d7099663c7 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:59:32.992896 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-2d933b33-7a89-43dc-ba74-e3d7099663c7 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:59:32.993387 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-2d933b33-7a89-43dc-ba74-e3d7099663c7 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:59:32.993825 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-2d933b33-7a89-43dc-ba74-e3d7099663c7 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:59:33.379273 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-8ff8fd96-c50a-4cd6-b923-bde05968346e tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:59:33.398914 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-8ff8fd96-c50a-4cd6-b923-bde05968346e tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:59:33.401878 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-8ff8fd96-c50a-4cd6-b923-bde05968346e tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:59:33.403618 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-8ff8fd96-c50a-4cd6-b923-bde05968346e tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] 10.222.0.13 "GET /compute/v2.1/servers/a7f88d19-08ee-47bf-9240-7d49afd775e2" status: 200 len: 1812 microversion: 2.25 time: 0.916085 Nov 01 18:59:33.418039 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 764/1488] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 18:59:32 2022] GET /compute/v2.1/servers/a7f88d19-08ee-47bf-9240-7d49afd775e2 => generated 1812 bytes in 931 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 18:59:33.431343 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-2d933b33-7a89-43dc-ba74-e3d7099663c7 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a9c3b6a8c34f068caa50dc10d13a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9ef08eba0ef431285fd15a2561b4e5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:59:33.432424 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-af794b97-3383-4ebb-aa80-28697fd48128 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:59:33.433308 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-af794b97-3383-4ebb-aa80-28697fd48128 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] [instance: f6762e10-9d45-47cf-a6b6-d9bfc3404664] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:59:33.442029 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-af794b97-3383-4ebb-aa80-28697fd48128 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:59:33.442846 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-af794b97-3383-4ebb-aa80-28697fd48128 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:59:33.443530 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-af794b97-3383-4ebb-aa80-28697fd48128 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:59:33.444495 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-af794b97-3383-4ebb-aa80-28697fd48128 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:59:33.445245 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-af794b97-3383-4ebb-aa80-28697fd48128 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:59:33.446190 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-af794b97-3383-4ebb-aa80-28697fd48128 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:59:33.447755 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-2d933b33-7a89-43dc-ba74-e3d7099663c7 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] 10.222.0.13 "GET /compute/v2.1/servers/495c1822-a615-4da7-a053-227744a46341" status: 200 len: 1316 microversion: 2.1 time: 0.474243 Nov 01 18:59:33.448426 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 725/1489] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:59:32 2022] GET /compute/v2.1/servers/495c1822-a615-4da7-a053-227744a46341 => generated 1316 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 18:59:33.463390 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-908bd007-994a-448c-b5b2-238326ce2dba tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:59:33.464009 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-908bd007-994a-448c-b5b2-238326ce2dba tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] [instance: c34b04e9-a50a-4c58-85ff-ecef0bfc0343] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:59:33.475181 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-908bd007-994a-448c-b5b2-238326ce2dba tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:59:33.475671 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-908bd007-994a-448c-b5b2-238326ce2dba tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:59:33.476102 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-908bd007-994a-448c-b5b2-238326ce2dba tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:59:33.477142 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-908bd007-994a-448c-b5b2-238326ce2dba tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:59:33.477778 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-908bd007-994a-448c-b5b2-238326ce2dba tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:59:33.479016 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-908bd007-994a-448c-b5b2-238326ce2dba tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:59:33.646144 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-908bd007-994a-448c-b5b2-238326ce2dba tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b0619a8fc6f4fcc9eb5d4f473c595c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '280a221575634c6f908d333db769739b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:59:33.665447 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-908bd007-994a-448c-b5b2-238326ce2dba tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] 10.222.0.13 "GET /compute/v2.1/servers/c34b04e9-a50a-4c58-85ff-ecef0bfc0343" status: 200 len: 1276 microversion: 2.1 time: 0.207332 Nov 01 18:59:33.665769 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 726/1490] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:59:33 2022] GET /compute/v2.1/servers/c34b04e9-a50a-4c58-85ff-ecef0bfc0343 => generated 1276 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:59:33.685143 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-f995b286-c768-4e2e-927b-7714162b96c6 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:59:33.686599 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-f995b286-c768-4e2e-927b-7714162b96c6 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] [instance: 3796ef05-cc8e-44d4-8dfc-058b5dbc8cbd] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:59:33.722480 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f995b286-c768-4e2e-927b-7714162b96c6 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:59:33.725172 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f995b286-c768-4e2e-927b-7714162b96c6 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:59:33.726250 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f995b286-c768-4e2e-927b-7714162b96c6 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:59:33.742545 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f995b286-c768-4e2e-927b-7714162b96c6 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:59:33.743761 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f995b286-c768-4e2e-927b-7714162b96c6 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:59:33.745148 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f995b286-c768-4e2e-927b-7714162b96c6 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:59:33.757194 n-d-863052-2 devstack@n-api.service[121403]: DEBUG dbcounter [-] [121403] Writing DB stats nova_cell1:SELECT=100 {{(pid=121403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 18:59:33.817351 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-af794b97-3383-4ebb-aa80-28697fd48128 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72117f17294649d6b8bc16c66c7efab2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45d4c047d3c44324a27a27831236ab0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:59:33.827370 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-af794b97-3383-4ebb-aa80-28697fd48128 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] 10.222.0.13 "GET /compute/v2.1/servers/f6762e10-9d45-47cf-a6b6-d9bfc3404664" status: 200 len: 1313 microversion: 2.1 time: 0.407859 Nov 01 18:59:33.827962 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 765/1491] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:59:33 2022] GET /compute/v2.1/servers/f6762e10-9d45-47cf-a6b6-d9bfc3404664 => generated 1313 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:59:34.435195 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-355413ea-1d16-4469-9578-389f41120e38 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:59:34.437814 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-355413ea-1d16-4469-9578-389f41120e38 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] [instance: a7f88d19-08ee-47bf-9240-7d49afd775e2] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:59:34.447106 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-355413ea-1d16-4469-9578-389f41120e38 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:59:34.450093 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-355413ea-1d16-4469-9578-389f41120e38 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:59:34.453789 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-355413ea-1d16-4469-9578-389f41120e38 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:59:34.454725 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-355413ea-1d16-4469-9578-389f41120e38 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:59:34.455375 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-355413ea-1d16-4469-9578-389f41120e38 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:59:34.455964 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-355413ea-1d16-4469-9578-389f41120e38 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:59:34.722532 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-355413ea-1d16-4469-9578-389f41120e38 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:59:34.735472 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-355413ea-1d16-4469-9578-389f41120e38 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:59:34.737017 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-355413ea-1d16-4469-9578-389f41120e38 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:59:34.738372 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-355413ea-1d16-4469-9578-389f41120e38 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] 10.222.0.13 "GET /compute/v2.1/servers/a7f88d19-08ee-47bf-9240-7d49afd775e2" status: 200 len: 1812 microversion: 2.25 time: 0.307234 Nov 01 18:59:34.752622 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 766/1492] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 18:59:34 2022] GET /compute/v2.1/servers/a7f88d19-08ee-47bf-9240-7d49afd775e2 => generated 1812 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 01 18:59:34.752622 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-832b2259-bcb6-4488-b0b2-70c01011d7c5 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:59:34.752622 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-832b2259-bcb6-4488-b0b2-70c01011d7c5 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] [instance: 495c1822-a615-4da7-a053-227744a46341] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:59:34.760273 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-832b2259-bcb6-4488-b0b2-70c01011d7c5 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:59:34.760273 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-832b2259-bcb6-4488-b0b2-70c01011d7c5 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:59:34.760273 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-832b2259-bcb6-4488-b0b2-70c01011d7c5 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:59:34.760561 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-832b2259-bcb6-4488-b0b2-70c01011d7c5 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:59:34.761411 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-832b2259-bcb6-4488-b0b2-70c01011d7c5 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:59:34.761845 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-832b2259-bcb6-4488-b0b2-70c01011d7c5 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:59:34.789119 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-f995b286-c768-4e2e-927b-7714162b96c6 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0290a6bb8bc24b8988a925327ac0381c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86941784237549838bba63ce88053b88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:59:34.802081 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-f995b286-c768-4e2e-927b-7714162b96c6 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] 10.222.0.13 "GET /compute/v2.1/servers/3796ef05-cc8e-44d4-8dfc-058b5dbc8cbd" status: 200 len: 1315 microversion: 2.1 time: 1.132565 Nov 01 18:59:34.804613 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 727/1493] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:59:33 2022] GET /compute/v2.1/servers/3796ef05-cc8e-44d4-8dfc-058b5dbc8cbd => generated 1315 bytes in 1137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:59:34.813764 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-695d46fa-ac6b-4cd2-9285-828e28c5afb5 tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:59:34.814686 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-695d46fa-ac6b-4cd2-9285-828e28c5afb5 tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] [instance: c34b04e9-a50a-4c58-85ff-ecef0bfc0343] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:59:34.821460 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-695d46fa-ac6b-4cd2-9285-828e28c5afb5 tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:59:34.821942 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-695d46fa-ac6b-4cd2-9285-828e28c5afb5 tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:59:34.822375 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-695d46fa-ac6b-4cd2-9285-828e28c5afb5 tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:59:34.823254 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-695d46fa-ac6b-4cd2-9285-828e28c5afb5 tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:59:34.823868 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-695d46fa-ac6b-4cd2-9285-828e28c5afb5 tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:59:34.825072 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-695d46fa-ac6b-4cd2-9285-828e28c5afb5 tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:59:35.175634 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-832b2259-bcb6-4488-b0b2-70c01011d7c5 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a9c3b6a8c34f068caa50dc10d13a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9ef08eba0ef431285fd15a2561b4e5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:59:35.186619 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-832b2259-bcb6-4488-b0b2-70c01011d7c5 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] 10.222.0.13 "GET /compute/v2.1/servers/495c1822-a615-4da7-a053-227744a46341" status: 200 len: 1504 microversion: 2.1 time: 0.442500 Nov 01 18:59:35.189113 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 767/1494] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:59:34 2022] GET /compute/v2.1/servers/495c1822-a615-4da7-a053-227744a46341 => generated 1504 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:59:35.210525 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-9c35c3ab-0c3c-40ce-b83c-85a6085b9cf6 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:59:35.211377 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-9c35c3ab-0c3c-40ce-b83c-85a6085b9cf6 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] [instance: f6762e10-9d45-47cf-a6b6-d9bfc3404664] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:59:35.218505 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-9c35c3ab-0c3c-40ce-b83c-85a6085b9cf6 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:59:35.218986 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-9c35c3ab-0c3c-40ce-b83c-85a6085b9cf6 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:59:35.221127 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-9c35c3ab-0c3c-40ce-b83c-85a6085b9cf6 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:59:35.222241 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-9c35c3ab-0c3c-40ce-b83c-85a6085b9cf6 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:59:35.222753 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-9c35c3ab-0c3c-40ce-b83c-85a6085b9cf6 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:59:35.225992 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-9c35c3ab-0c3c-40ce-b83c-85a6085b9cf6 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:59:35.454559 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-695d46fa-ac6b-4cd2-9285-828e28c5afb5 tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b0619a8fc6f4fcc9eb5d4f473c595c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '280a221575634c6f908d333db769739b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:59:35.465270 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-695d46fa-ac6b-4cd2-9285-828e28c5afb5 tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] 10.222.0.13 "GET /compute/v2.1/servers/c34b04e9-a50a-4c58-85ff-ecef0bfc0343" status: 200 len: 1318 microversion: 2.1 time: 0.658978 Nov 01 18:59:35.472921 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 728/1495] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:59:34 2022] GET /compute/v2.1/servers/c34b04e9-a50a-4c58-85ff-ecef0bfc0343 => generated 1318 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:59:35.495101 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-ec06ad35-633e-4e61-91f3-17b64053e8e1 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-640019102"}} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 18:59:35.502057 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-9c35c3ab-0c3c-40ce-b83c-85a6085b9cf6 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72117f17294649d6b8bc16c66c7efab2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45d4c047d3c44324a27a27831236ab0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:59:35.503961 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-ec06ad35-633e-4e61-91f3-17b64053e8e1 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] [instance: 495c1822-a615-4da7-a053-227744a46341] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:59:35.512545 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-9c35c3ab-0c3c-40ce-b83c-85a6085b9cf6 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] 10.222.0.13 "GET /compute/v2.1/servers/f6762e10-9d45-47cf-a6b6-d9bfc3404664" status: 200 len: 1313 microversion: 2.1 time: 0.322207 Nov 01 18:59:35.520887 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 768/1496] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:59:35 2022] GET /compute/v2.1/servers/f6762e10-9d45-47cf-a6b6-d9bfc3404664 => generated 1313 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:59:35.537411 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-ec06ad35-633e-4e61-91f3-17b64053e8e1 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:59:35.540261 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-ec06ad35-633e-4e61-91f3-17b64053e8e1 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:59:35.540910 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-ec06ad35-633e-4e61-91f3-17b64053e8e1 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:59:35.544546 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-ec06ad35-633e-4e61-91f3-17b64053e8e1 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:59:35.545300 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-ec06ad35-633e-4e61-91f3-17b64053e8e1 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:59:35.545900 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-ec06ad35-633e-4e61-91f3-17b64053e8e1 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:59:35.768614 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-8b2ef449-1084-437f-b368-77a97a9cc3df tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:59:35.769538 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-8b2ef449-1084-437f-b368-77a97a9cc3df tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] [instance: a7f88d19-08ee-47bf-9240-7d49afd775e2] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:59:35.779658 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-8b2ef449-1084-437f-b368-77a97a9cc3df tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:59:35.786888 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-8b2ef449-1084-437f-b368-77a97a9cc3df tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:59:35.789005 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-8b2ef449-1084-437f-b368-77a97a9cc3df tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:59:35.790176 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-8b2ef449-1084-437f-b368-77a97a9cc3df tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:59:35.792025 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-8b2ef449-1084-437f-b368-77a97a9cc3df tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:59:35.793906 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-8b2ef449-1084-437f-b368-77a97a9cc3df tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:59:36.172477 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-8b2ef449-1084-437f-b368-77a97a9cc3df tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:59:36.188129 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-8b2ef449-1084-437f-b368-77a97a9cc3df tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:59:36.194022 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-8b2ef449-1084-437f-b368-77a97a9cc3df tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:59:36.195533 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-8b2ef449-1084-437f-b368-77a97a9cc3df tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] 10.222.0.13 "GET /compute/v2.1/servers/a7f88d19-08ee-47bf-9240-7d49afd775e2" status: 200 len: 1812 microversion: 2.25 time: 0.431986 Nov 01 18:59:36.196612 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 769/1497] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 18:59:35 2022] GET /compute/v2.1/servers/a7f88d19-08ee-47bf-9240-7d49afd775e2 => generated 1812 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 18:59:36.227044 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.network.security_group_api [None req-ec06ad35-633e-4e61-91f3-17b64053e8e1 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Adding security group cc3ed02e-766a-42e8-9cb4-098318d41ff2 to port 7422b34a-996e-4f74-9ae8-e9724a7accf8 Nov 01 18:59:36.463108 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [req-3c786c23-029f-4b9d-8a38-b600e1e73837 req-279d6b86-9d3c-4235-91da-40d75554217d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c34b04e9-a50a-4c58-85ff-ecef0bfc0343", "tag": "53c384ce-eeca-4b10-9794-84a0d7bc5468"}]} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 18:59:36.484796 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-3c786c23-029f-4b9d-8a38-b600e1e73837 req-279d6b86-9d3c-4235-91da-40d75554217d service nova] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:59:36.486203 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-3c786c23-029f-4b9d-8a38-b600e1e73837 req-279d6b86-9d3c-4235-91da-40d75554217d service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:59:36.488952 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-3c786c23-029f-4b9d-8a38-b600e1e73837 req-279d6b86-9d3c-4235-91da-40d75554217d service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:59:36.511979 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.compute.server_external_events [req-3c786c23-029f-4b9d-8a38-b600e1e73837 req-279d6b86-9d3c-4235-91da-40d75554217d service nova] Creating event network-changed:53c384ce-eeca-4b10-9794-84a0d7bc5468 for instance c34b04e9-a50a-4c58-85ff-ecef0bfc0343 on n-h1-863052-2 Nov 01 18:59:36.520071 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [req-3c786c23-029f-4b9d-8a38-b600e1e73837 req-279d6b86-9d3c-4235-91da-40d75554217d service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.321919 Nov 01 18:59:36.521036 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 770/1498] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Nov 1 18:59:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 18:59:36.526638 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-0204c8f1-0f58-4983-9435-323ca897402c tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:59:36.527356 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-0204c8f1-0f58-4983-9435-323ca897402c tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] [instance: 3796ef05-cc8e-44d4-8dfc-058b5dbc8cbd] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:59:36.535026 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-0204c8f1-0f58-4983-9435-323ca897402c tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:59:36.535516 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-0204c8f1-0f58-4983-9435-323ca897402c tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:59:36.536135 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-0204c8f1-0f58-4983-9435-323ca897402c tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:59:36.537034 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-0204c8f1-0f58-4983-9435-323ca897402c tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:59:36.537931 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-0204c8f1-0f58-4983-9435-323ca897402c tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:59:36.538585 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-0204c8f1-0f58-4983-9435-323ca897402c tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:59:36.792273 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-0204c8f1-0f58-4983-9435-323ca897402c tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0290a6bb8bc24b8988a925327ac0381c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86941784237549838bba63ce88053b88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:59:36.821626 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-0204c8f1-0f58-4983-9435-323ca897402c tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] 10.222.0.13 "GET /compute/v2.1/servers/3796ef05-cc8e-44d4-8dfc-058b5dbc8cbd" status: 200 len: 1315 microversion: 2.1 time: 0.298886 Nov 01 18:59:36.822790 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 771/1499] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:59:36 2022] GET /compute/v2.1/servers/3796ef05-cc8e-44d4-8dfc-058b5dbc8cbd => generated 1315 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:59:36.829292 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [req-6e0040be-a3ca-4f73-9133-b4f54fb02e4f req-c234df1d-9712-4223-a57a-30fb3dc04389 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3796ef05-cc8e-44d4-8dfc-058b5dbc8cbd", "name": "network-vif-plugged", "status": "completed", "tag": "42ac695b-939d-43c0-9e82-2359f65aad09"}]} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 18:59:36.840206 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-6e0040be-a3ca-4f73-9133-b4f54fb02e4f req-c234df1d-9712-4223-a57a-30fb3dc04389 service nova] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:59:36.841020 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-6e0040be-a3ca-4f73-9133-b4f54fb02e4f req-c234df1d-9712-4223-a57a-30fb3dc04389 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:59:36.841987 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-6e0040be-a3ca-4f73-9133-b4f54fb02e4f req-c234df1d-9712-4223-a57a-30fb3dc04389 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:59:36.855621 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.compute.server_external_events [req-6e0040be-a3ca-4f73-9133-b4f54fb02e4f req-c234df1d-9712-4223-a57a-30fb3dc04389 service nova] Creating event network-vif-plugged:42ac695b-939d-43c0-9e82-2359f65aad09 for instance 3796ef05-cc8e-44d4-8dfc-058b5dbc8cbd on n-h2-863052-2 Nov 01 18:59:36.861603 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [req-6e0040be-a3ca-4f73-9133-b4f54fb02e4f req-c234df1d-9712-4223-a57a-30fb3dc04389 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036753 Nov 01 18:59:36.862256 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 772/1500] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Nov 1 18:59:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 18:59:36.868687 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-ad44addb-6b10-4c64-8d6f-d4c5980d97f1 tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:59:36.869655 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-ad44addb-6b10-4c64-8d6f-d4c5980d97f1 tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] [instance: c34b04e9-a50a-4c58-85ff-ecef0bfc0343] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:59:36.877495 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-ad44addb-6b10-4c64-8d6f-d4c5980d97f1 tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:59:36.879272 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-ad44addb-6b10-4c64-8d6f-d4c5980d97f1 tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:59:36.880637 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-ad44addb-6b10-4c64-8d6f-d4c5980d97f1 tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:59:36.881699 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-ad44addb-6b10-4c64-8d6f-d4c5980d97f1 tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:59:36.882350 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-ad44addb-6b10-4c64-8d6f-d4c5980d97f1 tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:59:36.884529 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-ad44addb-6b10-4c64-8d6f-d4c5980d97f1 tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:59:36.993184 n-d-863052-2 devstack@n-api.service[121403]: DEBUG dbcounter [-] [121403] Writing DB stats nova_cell0:SELECT=10 {{(pid=121403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 18:59:37.107888 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-ad44addb-6b10-4c64-8d6f-d4c5980d97f1 tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b0619a8fc6f4fcc9eb5d4f473c595c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '280a221575634c6f908d333db769739b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:59:37.117458 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-ad44addb-6b10-4c64-8d6f-d4c5980d97f1 tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] 10.222.0.13 "GET /compute/v2.1/servers/c34b04e9-a50a-4c58-85ff-ecef0bfc0343" status: 200 len: 1318 microversion: 2.1 time: 0.253736 Nov 01 18:59:37.140283 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 773/1501] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:59:36 2022] GET /compute/v2.1/servers/c34b04e9-a50a-4c58-85ff-ecef0bfc0343 => generated 1318 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:59:37.146094 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-1ce6e14e-4b7b-45eb-8292-6ea098ba7cfa tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1566183443", "imageRef": "2d4a0047-1b9e-445f-8af8-1b5c9d93e881", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "d3f550cf-0d04-4207-acff-a4965931d488"}], "security_groups": [{"name": "tempest-securitygroup--1125539549"}], "key_name": "tempest-keypair-230221922", "user_data": "}} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 18:59:37.315630 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.network.neutron [None req-1ce6e14e-4b7b-45eb-8292-6ea098ba7cfa tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] validate_networks() for [('d3f550cf-0d04-4207-acff-a4965931d488', None, None, None, None, None)] {{(pid=121402) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 01 18:59:37.410806 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-ec06ad35-633e-4e61-91f3-17b64053e8e1 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] 10.222.0.13 "POST /compute/v2.1/servers/495c1822-a615-4da7-a053-227744a46341/action" status: 202 len: 0 microversion: 2.1 time: 1.939480 Nov 01 18:59:37.413555 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 729/1502] 10.222.0.13 () {60 vars in 1278 bytes} [Tue Nov 1 18:59:35 2022] POST /compute/v2.1/servers/495c1822-a615-4da7-a053-227744a46341/action => generated 0 bytes in 1944 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 01 18:59:37.420087 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-a44cbca2-006c-41c7-981c-0eb4a347d12c tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:59:37.422496 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-a44cbca2-006c-41c7-981c-0eb4a347d12c tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] [instance: f6762e10-9d45-47cf-a6b6-d9bfc3404664] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:59:37.436889 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-a44cbca2-006c-41c7-981c-0eb4a347d12c tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:59:37.439826 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-a44cbca2-006c-41c7-981c-0eb4a347d12c tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:59:37.440861 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-a44cbca2-006c-41c7-981c-0eb4a347d12c tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:59:37.443449 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-a44cbca2-006c-41c7-981c-0eb4a347d12c tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:59:37.444922 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-a44cbca2-006c-41c7-981c-0eb4a347d12c tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:59:37.446384 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-a44cbca2-006c-41c7-981c-0eb4a347d12c tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:59:37.824065 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-a44cbca2-006c-41c7-981c-0eb4a347d12c tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72117f17294649d6b8bc16c66c7efab2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45d4c047d3c44324a27a27831236ab0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:59:37.854782 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-a44cbca2-006c-41c7-981c-0eb4a347d12c tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] 10.222.0.13 "GET /compute/v2.1/servers/f6762e10-9d45-47cf-a6b6-d9bfc3404664" status: 200 len: 1313 microversion: 2.1 time: 0.439774 Nov 01 18:59:37.857832 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 730/1503] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:59:37 2022] GET /compute/v2.1/servers/f6762e10-9d45-47cf-a6b6-d9bfc3404664 => generated 1313 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:59:37.870577 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [req-ac416e56-f7ef-4c7f-8414-c759bdefdf1e req-f25eaf07-54a9-466d-bdf7-24bfe6b8df18 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d8e88b0f-ae97-44a4-8b6b-b94e2c600a83", "tag": "91ce416d-c08f-473f-a551-fa3519a6c6c7"}]} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 18:59:37.889467 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-ac416e56-f7ef-4c7f-8414-c759bdefdf1e req-f25eaf07-54a9-466d-bdf7-24bfe6b8df18 service nova] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:59:37.896954 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-ac416e56-f7ef-4c7f-8414-c759bdefdf1e req-f25eaf07-54a9-466d-bdf7-24bfe6b8df18 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:59:37.897715 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-ac416e56-f7ef-4c7f-8414-c759bdefdf1e req-f25eaf07-54a9-466d-bdf7-24bfe6b8df18 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:59:37.932182 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.compute.server_external_events [req-ac416e56-f7ef-4c7f-8414-c759bdefdf1e req-f25eaf07-54a9-466d-bdf7-24bfe6b8df18 service nova] Creating event network-changed:91ce416d-c08f-473f-a551-fa3519a6c6c7 for instance d8e88b0f-ae97-44a4-8b6b-b94e2c600a83 on n-h1-863052-2 Nov 01 18:59:37.946334 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [req-ac416e56-f7ef-4c7f-8414-c759bdefdf1e req-f25eaf07-54a9-466d-bdf7-24bfe6b8df18 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086634 Nov 01 18:59:37.949591 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 731/1504] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Nov 1 18:59:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 18:59:37.961760 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-170787b7-d021-4aac-bd6d-ef3be1aa9f09 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:59:37.962760 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-170787b7-d021-4aac-bd6d-ef3be1aa9f09 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] [instance: a7f88d19-08ee-47bf-9240-7d49afd775e2] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:59:37.974651 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-170787b7-d021-4aac-bd6d-ef3be1aa9f09 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:59:37.975803 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-170787b7-d021-4aac-bd6d-ef3be1aa9f09 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:59:37.976699 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-170787b7-d021-4aac-bd6d-ef3be1aa9f09 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:59:37.977625 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-170787b7-d021-4aac-bd6d-ef3be1aa9f09 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:59:37.978263 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-170787b7-d021-4aac-bd6d-ef3be1aa9f09 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:59:37.978860 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-170787b7-d021-4aac-bd6d-ef3be1aa9f09 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:59:38.017249 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.virt.hardware [None req-1ce6e14e-4b7b-45eb-8292-6ea098ba7cfa tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Flavor limits 0:0:0 {{(pid=121402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 01 18:59:38.018458 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.virt.hardware [None req-1ce6e14e-4b7b-45eb-8292-6ea098ba7cfa tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Image limits 0:0:0 {{(pid=121402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 01 18:59:38.019354 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.virt.hardware [None req-1ce6e14e-4b7b-45eb-8292-6ea098ba7cfa tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Flavor pref 0:0:0 {{(pid=121402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 01 18:59:38.021398 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.virt.hardware [None req-1ce6e14e-4b7b-45eb-8292-6ea098ba7cfa tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Image pref 0:0:0 {{(pid=121402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 01 18:59:38.022068 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.virt.hardware [None req-1ce6e14e-4b7b-45eb-8292-6ea098ba7cfa tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 01 18:59:38.026965 n-d-863052-2 devstack@n-api.service[121403]: DEBUG dbcounter [-] [121403] Writing DB stats nova_cell0:SELECT=36 {{(pid=121403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 18:59:38.046126 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-1ce6e14e-4b7b-45eb-8292-6ea098ba7cfa tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:59:38.046804 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-1ce6e14e-4b7b-45eb-8292-6ea098ba7cfa tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:59:38.048402 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-1ce6e14e-4b7b-45eb-8292-6ea098ba7cfa tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:59:38.049376 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-1ce6e14e-4b7b-45eb-8292-6ea098ba7cfa tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:59:38.053399 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-1ce6e14e-4b7b-45eb-8292-6ea098ba7cfa tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:59:38.054059 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-1ce6e14e-4b7b-45eb-8292-6ea098ba7cfa tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:59:38.102867 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.quota [None req-1ce6e14e-4b7b-45eb-8292-6ea098ba7cfa tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Getting quotas for project 4a1bb191cff948e99c008b5e861ce4a8. Resources: {'cores', 'ram', 'instances'} {{(pid=121402) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 01 18:59:38.116291 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.quota [None req-1ce6e14e-4b7b-45eb-8292-6ea098ba7cfa tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Getting quotas for user 6a63d69c99a546f0af16329cff3ca717 and project 4a1bb191cff948e99c008b5e861ce4a8. Resources: {'cores', 'ram', 'instances'} {{(pid=121402) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 01 18:59:38.149521 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-1ce6e14e-4b7b-45eb-8292-6ea098ba7cfa tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Going to run 1 instances... {{(pid=121402) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 01 18:59:38.169194 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-1ce6e14e-4b7b-45eb-8292-6ea098ba7cfa tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] [instance: 90b353ab-ef97-4d88-b5bc-b355ff576225] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2d4a0047-1b9e-445f-8af8-1b5c9d93e881',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121402) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 01 18:59:38.235674 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-1ce6e14e-4b7b-45eb-8292-6ea098ba7cfa tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 1.093975 Nov 01 18:59:38.237697 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 774/1505] 10.222.0.13 () {60 vars in 1147 bytes} [Tue Nov 1 18:59:37 2022] POST /compute/v2.1/servers => generated 409 bytes in 1097 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 01 18:59:38.248750 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-94967b83-8a8b-44c2-8906-00d1b5a5a373 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1030282311"}} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 18:59:38.249589 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-94967b83-8a8b-44c2-8906-00d1b5a5a373 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] [instance: 495c1822-a615-4da7-a053-227744a46341] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:59:38.258310 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-94967b83-8a8b-44c2-8906-00d1b5a5a373 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:59:38.259072 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-94967b83-8a8b-44c2-8906-00d1b5a5a373 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:59:38.259714 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-94967b83-8a8b-44c2-8906-00d1b5a5a373 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:59:38.261083 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-94967b83-8a8b-44c2-8906-00d1b5a5a373 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:59:38.262112 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-94967b83-8a8b-44c2-8906-00d1b5a5a373 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:59:38.262961 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-94967b83-8a8b-44c2-8906-00d1b5a5a373 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:59:38.456678 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-170787b7-d021-4aac-bd6d-ef3be1aa9f09 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:59:38.468857 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-170787b7-d021-4aac-bd6d-ef3be1aa9f09 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:59:38.476126 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-170787b7-d021-4aac-bd6d-ef3be1aa9f09 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:59:38.482500 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-170787b7-d021-4aac-bd6d-ef3be1aa9f09 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] 10.222.0.13 "GET /compute/v2.1/servers/a7f88d19-08ee-47bf-9240-7d49afd775e2" status: 200 len: 1812 microversion: 2.25 time: 0.526469 Nov 01 18:59:38.483154 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 732/1506] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 18:59:37 2022] GET /compute/v2.1/servers/a7f88d19-08ee-47bf-9240-7d49afd775e2 => generated 1812 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 18:59:38.500151 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-a6ce84dd-0c61-4d11-a779-ceb0e63eb42f tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:59:38.500810 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-a6ce84dd-0c61-4d11-a779-ceb0e63eb42f tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] [instance: 3796ef05-cc8e-44d4-8dfc-058b5dbc8cbd] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:59:38.515562 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-a6ce84dd-0c61-4d11-a779-ceb0e63eb42f tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:59:38.516102 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-a6ce84dd-0c61-4d11-a779-ceb0e63eb42f tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:59:38.516555 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-a6ce84dd-0c61-4d11-a779-ceb0e63eb42f tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:59:38.517830 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-a6ce84dd-0c61-4d11-a779-ceb0e63eb42f tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:59:38.518471 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-a6ce84dd-0c61-4d11-a779-ceb0e63eb42f tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:59:38.519074 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-a6ce84dd-0c61-4d11-a779-ceb0e63eb42f tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:59:38.671953 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.network.security_group_api [None req-94967b83-8a8b-44c2-8906-00d1b5a5a373 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Adding security group ac361b9e-7d39-49f8-9192-66e9c5fe511b to port 7422b34a-996e-4f74-9ae8-e9724a7accf8 Nov 01 18:59:38.963721 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-a6ce84dd-0c61-4d11-a779-ceb0e63eb42f tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0290a6bb8bc24b8988a925327ac0381c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86941784237549838bba63ce88053b88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:59:38.977318 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-a6ce84dd-0c61-4d11-a779-ceb0e63eb42f tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] 10.222.0.13 "GET /compute/v2.1/servers/3796ef05-cc8e-44d4-8dfc-058b5dbc8cbd" status: 200 len: 1315 microversion: 2.1 time: 0.493042 Nov 01 18:59:38.978754 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 733/1507] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:59:38 2022] GET /compute/v2.1/servers/3796ef05-cc8e-44d4-8dfc-058b5dbc8cbd => generated 1315 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:59:38.994724 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-8285b6eb-3a0a-43ef-9a2c-a1e05da64f5f tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:59:38.997185 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-8285b6eb-3a0a-43ef-9a2c-a1e05da64f5f tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] [instance: c34b04e9-a50a-4c58-85ff-ecef0bfc0343] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:59:39.008169 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-8285b6eb-3a0a-43ef-9a2c-a1e05da64f5f tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:59:39.008710 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-8285b6eb-3a0a-43ef-9a2c-a1e05da64f5f tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:59:39.009111 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-8285b6eb-3a0a-43ef-9a2c-a1e05da64f5f tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:59:39.009821 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-8285b6eb-3a0a-43ef-9a2c-a1e05da64f5f tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:59:39.011114 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-8285b6eb-3a0a-43ef-9a2c-a1e05da64f5f tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:59:39.011552 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-8285b6eb-3a0a-43ef-9a2c-a1e05da64f5f tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:59:39.378879 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-8285b6eb-3a0a-43ef-9a2c-a1e05da64f5f tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b0619a8fc6f4fcc9eb5d4f473c595c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '280a221575634c6f908d333db769739b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:59:39.391591 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-8285b6eb-3a0a-43ef-9a2c-a1e05da64f5f tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] 10.222.0.13 "GET /compute/v2.1/servers/c34b04e9-a50a-4c58-85ff-ecef0bfc0343" status: 200 len: 1318 microversion: 2.1 time: 0.411503 Nov 01 18:59:39.406838 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 734/1508] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:59:38 2022] GET /compute/v2.1/servers/c34b04e9-a50a-4c58-85ff-ecef0bfc0343 => generated 1318 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:59:39.406838 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-23ea4a8b-7ad0-490c-82a6-35b1f102ce16 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:59:39.406838 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-23ea4a8b-7ad0-490c-82a6-35b1f102ce16 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] [instance: 90b353ab-ef97-4d88-b5bc-b355ff576225] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:59:39.406838 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-23ea4a8b-7ad0-490c-82a6-35b1f102ce16 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:59:39.407446 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-23ea4a8b-7ad0-490c-82a6-35b1f102ce16 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:59:39.407653 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-23ea4a8b-7ad0-490c-82a6-35b1f102ce16 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:59:39.423939 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-23ea4a8b-7ad0-490c-82a6-35b1f102ce16 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:59:39.424608 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-23ea4a8b-7ad0-490c-82a6-35b1f102ce16 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:59:39.425251 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-23ea4a8b-7ad0-490c-82a6-35b1f102ce16 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:59:39.455186 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-94967b83-8a8b-44c2-8906-00d1b5a5a373 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] 10.222.0.13 "POST /compute/v2.1/servers/495c1822-a615-4da7-a053-227744a46341/action" status: 202 len: 0 microversion: 2.1 time: 1.213832 Nov 01 18:59:39.455812 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 775/1509] 10.222.0.13 () {60 vars in 1278 bytes} [Tue Nov 1 18:59:38 2022] POST /compute/v2.1/servers/495c1822-a615-4da7-a053-227744a46341/action => generated 0 bytes in 1217 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 01 18:59:39.460550 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-c8312f37-8278-4405-9225-98c8addd55ab tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:59:39.461809 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-c8312f37-8278-4405-9225-98c8addd55ab tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] [instance: f6762e10-9d45-47cf-a6b6-d9bfc3404664] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:59:39.486761 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-c8312f37-8278-4405-9225-98c8addd55ab tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:59:39.487564 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-c8312f37-8278-4405-9225-98c8addd55ab tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:59:39.488195 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-c8312f37-8278-4405-9225-98c8addd55ab tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:59:39.489159 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-c8312f37-8278-4405-9225-98c8addd55ab tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:59:39.489858 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-c8312f37-8278-4405-9225-98c8addd55ab tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:59:39.490681 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-c8312f37-8278-4405-9225-98c8addd55ab tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:59:39.603237 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-23ea4a8b-7ad0-490c-82a6-35b1f102ce16 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a63d69c99a546f0af16329cff3ca717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a1bb191cff948e99c008b5e861ce4a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:59:39.644922 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-23ea4a8b-7ad0-490c-82a6-35b1f102ce16 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] 10.222.0.13 "GET /compute/v2.1/servers/90b353ab-ef97-4d88-b5bc-b355ff576225" status: 200 len: 1249 microversion: 2.1 time: 0.251022 Nov 01 18:59:39.646012 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 735/1510] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:59:39 2022] GET /compute/v2.1/servers/90b353ab-ef97-4d88-b5bc-b355ff576225 => generated 1249 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:59:39.663563 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [req-a25b94f0-d5dc-40b3-88ba-6f7463885630 req-b358ff20-64c7-42af-a2e0-a7fae38ac002 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f6762e10-9d45-47cf-a6b6-d9bfc3404664", "name": "network-vif-plugged", "status": "completed", "tag": "ce9efbc4-25cd-4125-8921-620c35a44e5f"}]} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 18:59:39.732079 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-a25b94f0-d5dc-40b3-88ba-6f7463885630 req-b358ff20-64c7-42af-a2e0-a7fae38ac002 service nova] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:59:39.733092 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-a25b94f0-d5dc-40b3-88ba-6f7463885630 req-b358ff20-64c7-42af-a2e0-a7fae38ac002 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:59:39.733573 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-a25b94f0-d5dc-40b3-88ba-6f7463885630 req-b358ff20-64c7-42af-a2e0-a7fae38ac002 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:59:39.759207 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.compute.server_external_events [req-a25b94f0-d5dc-40b3-88ba-6f7463885630 req-b358ff20-64c7-42af-a2e0-a7fae38ac002 service nova] Creating event network-vif-plugged:ce9efbc4-25cd-4125-8921-620c35a44e5f for instance f6762e10-9d45-47cf-a6b6-d9bfc3404664 on n-h1-863052-2 Nov 01 18:59:39.765128 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [req-a25b94f0-d5dc-40b3-88ba-6f7463885630 req-b358ff20-64c7-42af-a2e0-a7fae38ac002 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.116541 Nov 01 18:59:39.765345 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-c8312f37-8278-4405-9225-98c8addd55ab tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72117f17294649d6b8bc16c66c7efab2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45d4c047d3c44324a27a27831236ab0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:59:39.766033 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 736/1511] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Nov 1 18:59:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 18:59:39.771729 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-0061d1bd-802a-4bc1-8075-bd5fd6c54f4e tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:59:39.772681 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-0061d1bd-802a-4bc1-8075-bd5fd6c54f4e tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] [instance: 495c1822-a615-4da7-a053-227744a46341] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:59:39.774622 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-c8312f37-8278-4405-9225-98c8addd55ab tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] 10.222.0.13 "GET /compute/v2.1/servers/f6762e10-9d45-47cf-a6b6-d9bfc3404664" status: 200 len: 1313 microversion: 2.1 time: 0.317760 Nov 01 18:59:39.779653 n-d-863052-2 devstack@n-api.service[121403]: DEBUG dbcounter [-] [121403] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=121403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 18:59:39.782136 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-0061d1bd-802a-4bc1-8075-bd5fd6c54f4e tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:59:39.782906 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-0061d1bd-802a-4bc1-8075-bd5fd6c54f4e tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:59:39.783584 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-0061d1bd-802a-4bc1-8075-bd5fd6c54f4e tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:59:39.784359 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 776/1512] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:59:39 2022] GET /compute/v2.1/servers/f6762e10-9d45-47cf-a6b6-d9bfc3404664 => generated 1313 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:59:39.785229 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-0061d1bd-802a-4bc1-8075-bd5fd6c54f4e tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:59:39.785908 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-0061d1bd-802a-4bc1-8075-bd5fd6c54f4e tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:59:39.786565 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-0061d1bd-802a-4bc1-8075-bd5fd6c54f4e tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:59:39.794061 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [req-75813864-2428-4eee-8897-367ad30b6c8b req-b657a5e6-eaa1-4aff-922e-6d466c6b4f45 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "495c1822-a615-4da7-a053-227744a46341", "tag": "7422b34a-996e-4f74-9ae8-e9724a7accf8"}]} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 18:59:39.846059 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-75813864-2428-4eee-8897-367ad30b6c8b req-b657a5e6-eaa1-4aff-922e-6d466c6b4f45 service nova] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:59:39.846908 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-75813864-2428-4eee-8897-367ad30b6c8b req-b657a5e6-eaa1-4aff-922e-6d466c6b4f45 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:59:39.847399 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-75813864-2428-4eee-8897-367ad30b6c8b req-b657a5e6-eaa1-4aff-922e-6d466c6b4f45 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:59:39.864648 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.compute.server_external_events [req-75813864-2428-4eee-8897-367ad30b6c8b req-b657a5e6-eaa1-4aff-922e-6d466c6b4f45 service nova] Creating event network-changed:7422b34a-996e-4f74-9ae8-e9724a7accf8 for instance 495c1822-a615-4da7-a053-227744a46341 on n-h2-863052-2 Nov 01 18:59:39.871968 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [req-75813864-2428-4eee-8897-367ad30b6c8b req-b657a5e6-eaa1-4aff-922e-6d466c6b4f45 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084856 Nov 01 18:59:39.873621 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 777/1513] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Nov 1 18:59:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 18:59:39.887158 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-0dd075e6-c7cf-4c67-9fac-5a603317f887 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:59:39.888365 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-0dd075e6-c7cf-4c67-9fac-5a603317f887 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] [instance: a7f88d19-08ee-47bf-9240-7d49afd775e2] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:59:39.895527 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-0dd075e6-c7cf-4c67-9fac-5a603317f887 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:59:39.895954 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-0dd075e6-c7cf-4c67-9fac-5a603317f887 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:59:39.896392 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-0dd075e6-c7cf-4c67-9fac-5a603317f887 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:59:39.897192 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-0dd075e6-c7cf-4c67-9fac-5a603317f887 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:59:39.897888 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-0dd075e6-c7cf-4c67-9fac-5a603317f887 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:59:39.898329 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-0dd075e6-c7cf-4c67-9fac-5a603317f887 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:59:40.349278 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-0dd075e6-c7cf-4c67-9fac-5a603317f887 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:59:40.363569 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-0dd075e6-c7cf-4c67-9fac-5a603317f887 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:59:40.365049 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-0dd075e6-c7cf-4c67-9fac-5a603317f887 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:59:40.366240 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-0dd075e6-c7cf-4c67-9fac-5a603317f887 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] 10.222.0.13 "GET /compute/v2.1/servers/a7f88d19-08ee-47bf-9240-7d49afd775e2" status: 200 len: 1812 microversion: 2.25 time: 0.484004 Nov 01 18:59:40.386145 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 778/1514] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 18:59:39 2022] GET /compute/v2.1/servers/a7f88d19-08ee-47bf-9240-7d49afd775e2 => generated 1812 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 18:59:40.402382 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [req-c3dd9706-8127-43ac-975d-a8f1ad6f8789 req-d19f4872-8b81-4e5b-b70c-ec3d908ec09c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "495c1822-a615-4da7-a053-227744a46341", "tag": "7422b34a-996e-4f74-9ae8-e9724a7accf8"}]} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 18:59:40.426947 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-c3dd9706-8127-43ac-975d-a8f1ad6f8789 req-d19f4872-8b81-4e5b-b70c-ec3d908ec09c service nova] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:59:40.428452 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-0061d1bd-802a-4bc1-8075-bd5fd6c54f4e tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] 10.222.0.13 "GET /compute/v2.1/servers/495c1822-a615-4da7-a053-227744a46341/os-security-groups" status: 200 len: 1156 microversion: 2.1 time: 0.660644 Nov 01 18:59:40.429091 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 737/1515] 10.222.0.13 () {58 vars in 1293 bytes} [Tue Nov 1 18:59:39 2022] GET /compute/v2.1/servers/495c1822-a615-4da7-a053-227744a46341/os-security-groups => generated 1156 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:59:40.429500 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-c3dd9706-8127-43ac-975d-a8f1ad6f8789 req-d19f4872-8b81-4e5b-b70c-ec3d908ec09c service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:59:40.430176 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-c3dd9706-8127-43ac-975d-a8f1ad6f8789 req-d19f4872-8b81-4e5b-b70c-ec3d908ec09c service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:59:40.446665 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-f14e2bbc-9664-41f5-b256-454d03d21ccb tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:59:40.447307 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-f14e2bbc-9664-41f5-b256-454d03d21ccb tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] [instance: 3796ef05-cc8e-44d4-8dfc-058b5dbc8cbd] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:59:40.454863 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f14e2bbc-9664-41f5-b256-454d03d21ccb tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:59:40.455785 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f14e2bbc-9664-41f5-b256-454d03d21ccb tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:59:40.456453 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f14e2bbc-9664-41f5-b256-454d03d21ccb tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:59:40.457426 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f14e2bbc-9664-41f5-b256-454d03d21ccb tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:59:40.458096 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f14e2bbc-9664-41f5-b256-454d03d21ccb tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:59:40.459484 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f14e2bbc-9664-41f5-b256-454d03d21ccb tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:59:40.465315 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.compute.server_external_events [req-c3dd9706-8127-43ac-975d-a8f1ad6f8789 req-d19f4872-8b81-4e5b-b70c-ec3d908ec09c service nova] Creating event network-changed:7422b34a-996e-4f74-9ae8-e9724a7accf8 for instance 495c1822-a615-4da7-a053-227744a46341 on n-h2-863052-2 Nov 01 18:59:40.484371 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [req-c3dd9706-8127-43ac-975d-a8f1ad6f8789 req-d19f4872-8b81-4e5b-b70c-ec3d908ec09c service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096759 Nov 01 18:59:40.485300 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 779/1516] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Nov 1 18:59:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 18:59:40.494112 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-688e82ce-366c-4b42-aff4-fd3485f54af7 tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:59:40.497021 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-688e82ce-366c-4b42-aff4-fd3485f54af7 tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] [instance: c34b04e9-a50a-4c58-85ff-ecef0bfc0343] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:59:40.510874 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-688e82ce-366c-4b42-aff4-fd3485f54af7 tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:59:40.512967 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-688e82ce-366c-4b42-aff4-fd3485f54af7 tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:59:40.514246 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-688e82ce-366c-4b42-aff4-fd3485f54af7 tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:59:40.519992 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-688e82ce-366c-4b42-aff4-fd3485f54af7 tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:59:40.520804 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-688e82ce-366c-4b42-aff4-fd3485f54af7 tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:59:40.521422 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-688e82ce-366c-4b42-aff4-fd3485f54af7 tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:59:40.883706 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-f14e2bbc-9664-41f5-b256-454d03d21ccb tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0290a6bb8bc24b8988a925327ac0381c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86941784237549838bba63ce88053b88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:59:40.897373 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-f14e2bbc-9664-41f5-b256-454d03d21ccb tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] 10.222.0.13 "GET /compute/v2.1/servers/3796ef05-cc8e-44d4-8dfc-058b5dbc8cbd" status: 200 len: 1464 microversion: 2.1 time: 0.464545 Nov 01 18:59:40.912765 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 738/1517] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:59:40 2022] GET /compute/v2.1/servers/3796ef05-cc8e-44d4-8dfc-058b5dbc8cbd => generated 1464 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:59:40.922389 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-6de32bf7-1a45-47ed-89eb-53d81314e055 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Action: 'create', calling method: .version_select at 0x7f0ae66e9ee0>, body: {"security_group": {"name": " tempest-securitygroup -1185148279 ", "description": "tempest-description-1241787154"}} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 18:59:41.579043 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-688e82ce-366c-4b42-aff4-fd3485f54af7 tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b0619a8fc6f4fcc9eb5d4f473c595c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '280a221575634c6f908d333db769739b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:59:41.594205 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-688e82ce-366c-4b42-aff4-fd3485f54af7 tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] 10.222.0.13 "GET /compute/v2.1/servers/c34b04e9-a50a-4c58-85ff-ecef0bfc0343" status: 200 len: 1318 microversion: 2.1 time: 1.107406 Nov 01 18:59:41.595068 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 780/1518] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:59:40 2022] GET /compute/v2.1/servers/c34b04e9-a50a-4c58-85ff-ecef0bfc0343 => generated 1318 bytes in 1109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:59:41.613390 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-b87d7792-1e5c-4bad-8fa0-c095ca065410 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:59:41.617045 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-b87d7792-1e5c-4bad-8fa0-c095ca065410 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] [instance: 90b353ab-ef97-4d88-b5bc-b355ff576225] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:59:41.639117 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b87d7792-1e5c-4bad-8fa0-c095ca065410 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:59:41.643620 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b87d7792-1e5c-4bad-8fa0-c095ca065410 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:59:41.649090 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b87d7792-1e5c-4bad-8fa0-c095ca065410 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:59:41.651348 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b87d7792-1e5c-4bad-8fa0-c095ca065410 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:59:41.656300 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b87d7792-1e5c-4bad-8fa0-c095ca065410 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:59:41.657933 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b87d7792-1e5c-4bad-8fa0-c095ca065410 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:59:41.719622 n-d-863052-2 devstack@n-api.service[121402]: DEBUG dbcounter [-] [121402] Writing DB stats nova_cell1:SELECT=100 {{(pid=121402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 18:59:41.786378 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-6de32bf7-1a45-47ed-89eb-53d81314e055 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] 10.222.0.13 "POST /compute/v2.1/os-security-groups" status: 200 len: 224 microversion: 2.1 time: 0.870181 Nov 01 18:59:41.800941 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 739/1519] 10.222.0.13 () {60 vars in 1180 bytes} [Tue Nov 1 18:59:40 2022] POST /compute/v2.1/os-security-groups => generated 224 bytes in 887 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 18:59:41.814623 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-5687c3fc-f11b-4cd1-adc0-d1032f14b59a tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:59:41.815234 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-5687c3fc-f11b-4cd1-adc0-d1032f14b59a tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] [instance: f6762e10-9d45-47cf-a6b6-d9bfc3404664] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:59:41.842186 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-5687c3fc-f11b-4cd1-adc0-d1032f14b59a tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:59:41.845296 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-5687c3fc-f11b-4cd1-adc0-d1032f14b59a tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:59:41.845752 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-5687c3fc-f11b-4cd1-adc0-d1032f14b59a tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:59:41.846495 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-5687c3fc-f11b-4cd1-adc0-d1032f14b59a tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:59:41.851214 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-5687c3fc-f11b-4cd1-adc0-d1032f14b59a tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:59:41.851885 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-5687c3fc-f11b-4cd1-adc0-d1032f14b59a tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:59:41.882479 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-b87d7792-1e5c-4bad-8fa0-c095ca065410 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a63d69c99a546f0af16329cff3ca717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a1bb191cff948e99c008b5e861ce4a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:59:41.914365 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-b87d7792-1e5c-4bad-8fa0-c095ca065410 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] 10.222.0.13 "GET /compute/v2.1/servers/90b353ab-ef97-4d88-b5bc-b355ff576225" status: 200 len: 1297 microversion: 2.1 time: 0.315663 Nov 01 18:59:41.915033 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 781/1520] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:59:41 2022] GET /compute/v2.1/servers/90b353ab-ef97-4d88-b5bc-b355ff576225 => generated 1297 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:59:41.926534 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-259cc71b-798f-4f9a-b950-a6f918da4f13 tempest-ServersOnMultiNodesTest-1027241392 tempest-ServersOnMultiNodesTest-1027241392-project-admin] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:59:41.927181 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-259cc71b-798f-4f9a-b950-a6f918da4f13 tempest-ServersOnMultiNodesTest-1027241392 tempest-ServersOnMultiNodesTest-1027241392-project-admin] [instance: 3796ef05-cc8e-44d4-8dfc-058b5dbc8cbd] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:59:41.953217 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-259cc71b-798f-4f9a-b950-a6f918da4f13 tempest-ServersOnMultiNodesTest-1027241392 tempest-ServersOnMultiNodesTest-1027241392-project-admin] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:59:41.955433 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-259cc71b-798f-4f9a-b950-a6f918da4f13 tempest-ServersOnMultiNodesTest-1027241392 tempest-ServersOnMultiNodesTest-1027241392-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:59:41.956881 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-259cc71b-798f-4f9a-b950-a6f918da4f13 tempest-ServersOnMultiNodesTest-1027241392 tempest-ServersOnMultiNodesTest-1027241392-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:59:41.958136 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-259cc71b-798f-4f9a-b950-a6f918da4f13 tempest-ServersOnMultiNodesTest-1027241392 tempest-ServersOnMultiNodesTest-1027241392-project-admin] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:59:41.959096 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-259cc71b-798f-4f9a-b950-a6f918da4f13 tempest-ServersOnMultiNodesTest-1027241392 tempest-ServersOnMultiNodesTest-1027241392-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:59:41.959901 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-259cc71b-798f-4f9a-b950-a6f918da4f13 tempest-ServersOnMultiNodesTest-1027241392 tempest-ServersOnMultiNodesTest-1027241392-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:59:42.137939 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-259cc71b-798f-4f9a-b950-a6f918da4f13 tempest-ServersOnMultiNodesTest-1027241392 tempest-ServersOnMultiNodesTest-1027241392-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/3796ef05-cc8e-44d4-8dfc-058b5dbc8cbd" status: 200 len: 1615 microversion: 2.1 time: 0.221761 Nov 01 18:59:42.152611 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 782/1521] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:59:41 2022] GET /compute/v2.1/servers/3796ef05-cc8e-44d4-8dfc-058b5dbc8cbd => generated 1615 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:59:42.152611 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-6b64a240-1260-45de-bbf9-f40c2363b756 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:59:42.152611 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-6b64a240-1260-45de-bbf9-f40c2363b756 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] [instance: a7f88d19-08ee-47bf-9240-7d49afd775e2] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:59:42.153015 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-6b64a240-1260-45de-bbf9-f40c2363b756 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:59:42.153344 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-6b64a240-1260-45de-bbf9-f40c2363b756 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:59:42.162109 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-6b64a240-1260-45de-bbf9-f40c2363b756 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:59:42.162109 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-6b64a240-1260-45de-bbf9-f40c2363b756 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:59:42.162109 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-6b64a240-1260-45de-bbf9-f40c2363b756 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:59:42.162109 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-6b64a240-1260-45de-bbf9-f40c2363b756 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:59:42.442423 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-5687c3fc-f11b-4cd1-adc0-d1032f14b59a tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72117f17294649d6b8bc16c66c7efab2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45d4c047d3c44324a27a27831236ab0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:59:42.454936 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-5687c3fc-f11b-4cd1-adc0-d1032f14b59a tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] 10.222.0.13 "GET /compute/v2.1/servers/f6762e10-9d45-47cf-a6b6-d9bfc3404664" status: 200 len: 1463 microversion: 2.1 time: 0.651378 Nov 01 18:59:42.457695 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 740/1522] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:59:41 2022] GET /compute/v2.1/servers/f6762e10-9d45-47cf-a6b6-d9bfc3404664 => generated 1463 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:59:42.476076 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-206c5dff-9ee3-4e2b-8cf6-9975ca0954fc tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Calling method '.version_select at 0x7f0ae6763b80>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:59:42.721187 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-6b64a240-1260-45de-bbf9-f40c2363b756 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:59:42.742736 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-6b64a240-1260-45de-bbf9-f40c2363b756 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:59:42.744566 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-6b64a240-1260-45de-bbf9-f40c2363b756 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:59:42.745845 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-6b64a240-1260-45de-bbf9-f40c2363b756 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] 10.222.0.13 "GET /compute/v2.1/servers/a7f88d19-08ee-47bf-9240-7d49afd775e2" status: 200 len: 1812 microversion: 2.25 time: 0.605341 Nov 01 18:59:42.760607 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 783/1523] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 18:59:42 2022] GET /compute/v2.1/servers/a7f88d19-08ee-47bf-9240-7d49afd775e2 => generated 1812 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 18:59:42.760607 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-77a9de3b-d2bd-4f1f-b88b-b36708fafb47 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1576097850", "imageRef": "2d4a0047-1b9e-445f-8af8-1b5c9d93e881", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": ["7186700c-1951-4ab3-a872-865dc1a45fa1"]}} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 18:59:42.830618 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.network.neutron [None req-77a9de3b-d2bd-4f1f-b88b-b36708fafb47 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] validate_networks() for None {{(pid=121402) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 01 18:59:42.870104 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-206c5dff-9ee3-4e2b-8cf6-9975ca0954fc tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] 10.222.0.13 "GET /compute/v2.1/os-security-groups/3ac82755-05f3-40fb-874c-63e687518273" status: 200 len: 224 microversion: 2.1 time: 0.410784 Nov 01 18:59:42.878614 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 741/1524] 10.222.0.13 () {58 vars in 1269 bytes} [Tue Nov 1 18:59:42 2022] GET /compute/v2.1/os-security-groups/3ac82755-05f3-40fb-874c-63e687518273 => generated 224 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 18:59:42.878614 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-b1666c2e-7aeb-4f58-b8f2-8f4ce03e47db tempest-MigrationsAdminTest-1970194929 tempest-MigrationsAdminTest-1970194929-project-admin] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:59:42.878614 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-b1666c2e-7aeb-4f58-b8f2-8f4ce03e47db tempest-MigrationsAdminTest-1970194929 tempest-MigrationsAdminTest-1970194929-project-admin] [instance: f6762e10-9d45-47cf-a6b6-d9bfc3404664] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:59:42.895184 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-b1666c2e-7aeb-4f58-b8f2-8f4ce03e47db tempest-MigrationsAdminTest-1970194929 tempest-MigrationsAdminTest-1970194929-project-admin] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:59:42.895748 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-b1666c2e-7aeb-4f58-b8f2-8f4ce03e47db tempest-MigrationsAdminTest-1970194929 tempest-MigrationsAdminTest-1970194929-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:59:42.896198 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-b1666c2e-7aeb-4f58-b8f2-8f4ce03e47db tempest-MigrationsAdminTest-1970194929 tempest-MigrationsAdminTest-1970194929-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:59:42.898474 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-b1666c2e-7aeb-4f58-b8f2-8f4ce03e47db tempest-MigrationsAdminTest-1970194929 tempest-MigrationsAdminTest-1970194929-project-admin] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:59:42.899336 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-b1666c2e-7aeb-4f58-b8f2-8f4ce03e47db tempest-MigrationsAdminTest-1970194929 tempest-MigrationsAdminTest-1970194929-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:59:42.899788 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-b1666c2e-7aeb-4f58-b8f2-8f4ce03e47db tempest-MigrationsAdminTest-1970194929 tempest-MigrationsAdminTest-1970194929-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:59:43.291950 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.virt.hardware [None req-77a9de3b-d2bd-4f1f-b88b-b36708fafb47 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Flavor limits 0:0:0 {{(pid=121402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 01 18:59:43.292381 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.virt.hardware [None req-77a9de3b-d2bd-4f1f-b88b-b36708fafb47 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Image limits 0:0:0 {{(pid=121402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 01 18:59:43.293434 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.virt.hardware [None req-77a9de3b-d2bd-4f1f-b88b-b36708fafb47 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Flavor pref 0:0:0 {{(pid=121402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 01 18:59:43.294010 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.virt.hardware [None req-77a9de3b-d2bd-4f1f-b88b-b36708fafb47 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Image pref 0:0:0 {{(pid=121402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 01 18:59:43.294980 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.virt.hardware [None req-77a9de3b-d2bd-4f1f-b88b-b36708fafb47 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 01 18:59:43.324906 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-77a9de3b-d2bd-4f1f-b88b-b36708fafb47 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:59:43.325415 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-77a9de3b-d2bd-4f1f-b88b-b36708fafb47 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:59:43.325904 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-77a9de3b-d2bd-4f1f-b88b-b36708fafb47 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:59:43.326926 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-77a9de3b-d2bd-4f1f-b88b-b36708fafb47 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:59:43.330332 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-77a9de3b-d2bd-4f1f-b88b-b36708fafb47 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:59:43.330782 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-77a9de3b-d2bd-4f1f-b88b-b36708fafb47 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:59:43.376042 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.quota [None req-77a9de3b-d2bd-4f1f-b88b-b36708fafb47 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Getting quotas for project 86941784237549838bba63ce88053b88. Resources: {'cores', 'ram', 'instances'} {{(pid=121402) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 01 18:59:43.393702 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.quota [None req-77a9de3b-d2bd-4f1f-b88b-b36708fafb47 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Getting quotas for user 0290a6bb8bc24b8988a925327ac0381c and project 86941784237549838bba63ce88053b88. Resources: {'cores', 'ram', 'instances'} {{(pid=121402) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 01 18:59:43.415524 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-77a9de3b-d2bd-4f1f-b88b-b36708fafb47 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Going to run 1 instances... {{(pid=121402) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 01 18:59:43.418168 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-77a9de3b-d2bd-4f1f-b88b-b36708fafb47 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] [instance: f35d5fdd-4a95-4b57-a506-665fa3f393c1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2d4a0047-1b9e-445f-8af8-1b5c9d93e881',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121402) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 01 18:59:43.456527 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-b1666c2e-7aeb-4f58-b8f2-8f4ce03e47db tempest-MigrationsAdminTest-1970194929 tempest-MigrationsAdminTest-1970194929-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/f6762e10-9d45-47cf-a6b6-d9bfc3404664" status: 200 len: 1614 microversion: 2.1 time: 0.582041 Nov 01 18:59:43.459549 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 742/1525] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:59:42 2022] GET /compute/v2.1/servers/f6762e10-9d45-47cf-a6b6-d9bfc3404664 => generated 1614 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:59:43.466041 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-40d6e4a4-db77-4e55-8755-27c34a60554a tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:59:43.476073 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-40d6e4a4-db77-4e55-8755-27c34a60554a tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] [instance: c34b04e9-a50a-4c58-85ff-ecef0bfc0343] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:59:43.485145 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-40d6e4a4-db77-4e55-8755-27c34a60554a tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:59:43.485880 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-40d6e4a4-db77-4e55-8755-27c34a60554a tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:59:43.486470 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-40d6e4a4-db77-4e55-8755-27c34a60554a tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:59:43.487835 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-40d6e4a4-db77-4e55-8755-27c34a60554a tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:59:43.488835 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-40d6e4a4-db77-4e55-8755-27c34a60554a tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:59:43.495572 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-40d6e4a4-db77-4e55-8755-27c34a60554a tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:59:43.536220 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-77a9de3b-d2bd-4f1f-b88b-b36708fafb47 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.788210 Nov 01 18:59:43.550872 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 784/1526] 10.222.0.13 () {60 vars in 1147 bytes} [Tue Nov 1 18:59:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 803 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 01 18:59:43.569353 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-d51f1cac-07b3-4363-9dcc-ec6faa2ed598 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Calling method '.version_select at 0x7f0ae1cd6940>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:59:43.952168 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-d51f1cac-07b3-4363-9dcc-ec6faa2ed598 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] 10.222.0.13 "DELETE /compute/v2.1/os-security-groups/3ac82755-05f3-40fb-874c-63e687518273" status: 202 len: 0 microversion: 2.1 time: 0.399972 Nov 01 18:59:43.955758 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 785/1527] 10.222.0.13 () {58 vars in 1272 bytes} [Tue Nov 1 18:59:43 2022] DELETE /compute/v2.1/os-security-groups/3ac82755-05f3-40fb-874c-63e687518273 => generated 0 bytes in 402 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 01 18:59:43.958194 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-5505489b-cfcb-427e-9cb3-a6a5247a18db tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:59:43.958920 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-5505489b-cfcb-427e-9cb3-a6a5247a18db tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] [instance: 90b353ab-ef97-4d88-b5bc-b355ff576225] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:59:43.976013 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-5505489b-cfcb-427e-9cb3-a6a5247a18db tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:59:43.976802 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-5505489b-cfcb-427e-9cb3-a6a5247a18db tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:59:43.981980 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-5505489b-cfcb-427e-9cb3-a6a5247a18db tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:59:43.982780 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-5505489b-cfcb-427e-9cb3-a6a5247a18db tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:59:43.984860 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-5505489b-cfcb-427e-9cb3-a6a5247a18db tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:59:43.988546 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-5505489b-cfcb-427e-9cb3-a6a5247a18db tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:59:44.114461 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-5505489b-cfcb-427e-9cb3-a6a5247a18db tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a63d69c99a546f0af16329cff3ca717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a1bb191cff948e99c008b5e861ce4a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:59:44.128812 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-5505489b-cfcb-427e-9cb3-a6a5247a18db tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] 10.222.0.13 "GET /compute/v2.1/servers/90b353ab-ef97-4d88-b5bc-b355ff576225" status: 200 len: 1303 microversion: 2.1 time: 0.174585 Nov 01 18:59:44.131608 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 786/1528] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:59:43 2022] GET /compute/v2.1/servers/90b353ab-ef97-4d88-b5bc-b355ff576225 => generated 1303 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:59:44.152816 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-565ca02b-fd71-4a8c-98c3-26b1b0d11fac tempest-MigrationsAdminTest-1970194929 tempest-MigrationsAdminTest-1970194929-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 18:59:44.153736 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-565ca02b-fd71-4a8c-98c3-26b1b0d11fac tempest-MigrationsAdminTest-1970194929 tempest-MigrationsAdminTest-1970194929-project-admin] [instance: f6762e10-9d45-47cf-a6b6-d9bfc3404664] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:59:44.160851 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-565ca02b-fd71-4a8c-98c3-26b1b0d11fac tempest-MigrationsAdminTest-1970194929 tempest-MigrationsAdminTest-1970194929-project-admin] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:59:44.161579 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-565ca02b-fd71-4a8c-98c3-26b1b0d11fac tempest-MigrationsAdminTest-1970194929 tempest-MigrationsAdminTest-1970194929-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:59:44.162219 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-565ca02b-fd71-4a8c-98c3-26b1b0d11fac tempest-MigrationsAdminTest-1970194929 tempest-MigrationsAdminTest-1970194929-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:59:44.163525 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-565ca02b-fd71-4a8c-98c3-26b1b0d11fac tempest-MigrationsAdminTest-1970194929 tempest-MigrationsAdminTest-1970194929-project-admin] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:59:44.164180 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-565ca02b-fd71-4a8c-98c3-26b1b0d11fac tempest-MigrationsAdminTest-1970194929 tempest-MigrationsAdminTest-1970194929-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:59:44.164863 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-565ca02b-fd71-4a8c-98c3-26b1b0d11fac tempest-MigrationsAdminTest-1970194929 tempest-MigrationsAdminTest-1970194929-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:59:44.213912 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-565ca02b-fd71-4a8c-98c3-26b1b0d11fac tempest-MigrationsAdminTest-1970194929 tempest-MigrationsAdminTest-1970194929-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '4010ab88bbfe478ab22c6e52e1c2c72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a3c26d879564e2d868fe0e73372aa90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:59:44.214567 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-565ca02b-fd71-4a8c-98c3-26b1b0d11fac tempest-MigrationsAdminTest-1970194929 tempest-MigrationsAdminTest-1970194929-project-admin] [instance: f6762e10-9d45-47cf-a6b6-d9bfc3404664] flavor_id is None. Assuming migration. {{(pid=121402) resize /opt/stack/nova/nova/compute/api.py:4196}} Nov 01 18:59:44.215019 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-565ca02b-fd71-4a8c-98c3-26b1b0d11fac tempest-MigrationsAdminTest-1970194929 tempest-MigrationsAdminTest-1970194929-project-admin] [instance: f6762e10-9d45-47cf-a6b6-d9bfc3404664] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=121402) resize /opt/stack/nova/nova/compute/api.py:4220}} Nov 01 18:59:44.457471 n-d-863052-2 devstack@n-api.service[121402]: DEBUG dbcounter [-] [121402] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=121402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 18:59:44.543209 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-565ca02b-fd71-4a8c-98c3-26b1b0d11fac tempest-MigrationsAdminTest-1970194929 tempest-MigrationsAdminTest-1970194929-project-admin] 10.222.0.13 "POST /compute/v2.1/servers/f6762e10-9d45-47cf-a6b6-d9bfc3404664/action" status: 202 len: 0 microversion: 2.1 time: 0.396828 Nov 01 18:59:44.545398 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 787/1529] 10.222.0.13 () {60 vars in 1278 bytes} [Tue Nov 1 18:59:44 2022] POST /compute/v2.1/servers/f6762e10-9d45-47cf-a6b6-d9bfc3404664/action => generated 0 bytes in 412 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 01 18:59:44.559753 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-896cecbb-8154-407e-b5b8-4948cfbc3c0c tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:59:44.560524 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-896cecbb-8154-407e-b5b8-4948cfbc3c0c tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] [instance: f35d5fdd-4a95-4b57-a506-665fa3f393c1] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:59:44.588518 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-896cecbb-8154-407e-b5b8-4948cfbc3c0c tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:59:44.591130 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-896cecbb-8154-407e-b5b8-4948cfbc3c0c tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:59:44.592666 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-896cecbb-8154-407e-b5b8-4948cfbc3c0c tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:59:44.593411 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-896cecbb-8154-407e-b5b8-4948cfbc3c0c tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:59:44.593883 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-896cecbb-8154-407e-b5b8-4948cfbc3c0c tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:59:44.598687 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-896cecbb-8154-407e-b5b8-4948cfbc3c0c tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:59:44.721945 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-896cecbb-8154-407e-b5b8-4948cfbc3c0c tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0290a6bb8bc24b8988a925327ac0381c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86941784237549838bba63ce88053b88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:59:44.737330 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-896cecbb-8154-407e-b5b8-4948cfbc3c0c tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] 10.222.0.13 "GET /compute/v2.1/servers/f35d5fdd-4a95-4b57-a506-665fa3f393c1" status: 200 len: 1213 microversion: 2.1 time: 0.184471 Nov 01 18:59:44.739302 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 788/1530] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:59:44 2022] GET /compute/v2.1/servers/f35d5fdd-4a95-4b57-a506-665fa3f393c1 => generated 1213 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:59:44.745430 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [req-72cdbc7d-fe7b-4ee3-9345-22eb7f9f8f0c req-74972dfd-c6fa-4e4b-9305-7a60c6e99d83 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c34b04e9-a50a-4c58-85ff-ecef0bfc0343", "name": "network-vif-plugged", "status": "completed", "tag": "53c384ce-eeca-4b10-9794-84a0d7bc5468"}]} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 18:59:44.759105 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-72cdbc7d-fe7b-4ee3-9345-22eb7f9f8f0c req-74972dfd-c6fa-4e4b-9305-7a60c6e99d83 service nova] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:59:44.760293 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-72cdbc7d-fe7b-4ee3-9345-22eb7f9f8f0c req-74972dfd-c6fa-4e4b-9305-7a60c6e99d83 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:59:44.761282 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-72cdbc7d-fe7b-4ee3-9345-22eb7f9f8f0c req-74972dfd-c6fa-4e4b-9305-7a60c6e99d83 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:59:44.779919 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.compute.server_external_events [req-72cdbc7d-fe7b-4ee3-9345-22eb7f9f8f0c req-74972dfd-c6fa-4e4b-9305-7a60c6e99d83 service nova] Creating event network-vif-plugged:53c384ce-eeca-4b10-9794-84a0d7bc5468 for instance c34b04e9-a50a-4c58-85ff-ecef0bfc0343 on n-h1-863052-2 Nov 01 18:59:44.798618 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [req-72cdbc7d-fe7b-4ee3-9345-22eb7f9f8f0c req-74972dfd-c6fa-4e4b-9305-7a60c6e99d83 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057477 Nov 01 18:59:44.799968 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 789/1531] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Nov 1 18:59:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 18:59:44.809131 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-37131dd8-ca63-43d0-b5e0-c69659d251c8 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:59:44.810935 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-37131dd8-ca63-43d0-b5e0-c69659d251c8 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] [instance: a7f88d19-08ee-47bf-9240-7d49afd775e2] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:59:44.820323 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-37131dd8-ca63-43d0-b5e0-c69659d251c8 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:59:44.821062 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-37131dd8-ca63-43d0-b5e0-c69659d251c8 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:59:44.821869 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-37131dd8-ca63-43d0-b5e0-c69659d251c8 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:59:44.823509 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-37131dd8-ca63-43d0-b5e0-c69659d251c8 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:59:44.825175 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-37131dd8-ca63-43d0-b5e0-c69659d251c8 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:59:44.825867 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-37131dd8-ca63-43d0-b5e0-c69659d251c8 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:59:44.827496 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-40d6e4a4-db77-4e55-8755-27c34a60554a tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b0619a8fc6f4fcc9eb5d4f473c595c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '280a221575634c6f908d333db769739b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:59:44.849394 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-40d6e4a4-db77-4e55-8755-27c34a60554a tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] 10.222.0.13 "GET /compute/v2.1/servers/c34b04e9-a50a-4c58-85ff-ecef0bfc0343" status: 200 len: 1318 microversion: 2.1 time: 1.387510 Nov 01 18:59:44.871425 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 743/1532] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:59:43 2022] GET /compute/v2.1/servers/c34b04e9-a50a-4c58-85ff-ecef0bfc0343 => generated 1318 bytes in 1409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:59:44.878719 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [req-8e510145-fe75-4af2-b455-2c9574607d74 req-4a455b67-bd63-4d56-b5a8-cc41b7b5cd8f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a7f88d19-08ee-47bf-9240-7d49afd775e2", "name": "network-vif-unplugged", "status": "completed", "tag": "01aee5f9-544a-4c0f-b9a3-2410eedf25a5"}]} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 18:59:44.893216 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-8e510145-fe75-4af2-b455-2c9574607d74 req-4a455b67-bd63-4d56-b5a8-cc41b7b5cd8f service nova] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:59:44.893973 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-8e510145-fe75-4af2-b455-2c9574607d74 req-4a455b67-bd63-4d56-b5a8-cc41b7b5cd8f service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:59:44.894639 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-8e510145-fe75-4af2-b455-2c9574607d74 req-4a455b67-bd63-4d56-b5a8-cc41b7b5cd8f service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:59:44.925773 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.compute.server_external_events [req-8e510145-fe75-4af2-b455-2c9574607d74 req-4a455b67-bd63-4d56-b5a8-cc41b7b5cd8f service nova] Creating event network-vif-unplugged:01aee5f9-544a-4c0f-b9a3-2410eedf25a5 for instance a7f88d19-08ee-47bf-9240-7d49afd775e2 on n-h1-863052-2 Nov 01 18:59:44.931667 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [req-8e510145-fe75-4af2-b455-2c9574607d74 req-4a455b67-bd63-4d56-b5a8-cc41b7b5cd8f service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.058367 Nov 01 18:59:44.932895 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 744/1533] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Nov 1 18:59:44 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 18:59:44.941913 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-39bc98f8-9dfe-4842-bae5-e47b8ae1b440 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Calling method '.version_select at 0x7f0ae6882280>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:59:45.055388 n-d-863052-2 devstack@n-api.service[121403]: DEBUG neutronclient.v2_0.client [None req-39bc98f8-9dfe-4842-bae5-e47b8ae1b440 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 3ac82755-05f3-40fb-874c-63e687518273 does not exist", "detail": ""}} {{(pid=121403) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Nov 01 18:59:45.055995 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.network.security_group_api [None req-39bc98f8-9dfe-4842-bae5-e47b8ae1b440 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Neutron security group 3ac82755-05f3-40fb-874c-63e687518273 not found {{(pid=121403) get /opt/stack/nova/nova/network/security_group_api.py:313}} Nov 01 18:59:45.056520 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.wsgi [None req-39bc98f8-9dfe-4842-bae5-e47b8ae1b440 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] HTTP exception thrown: Security group 3ac82755-05f3-40fb-874c-63e687518273 does not exist Nov 01 18:59:45.056520 n-d-863052-2 devstack@n-api.service[121403]: Neutron server returns request_ids: ['req-d9218343-e065-4af6-8c3a-dc79856ffb3c'] Nov 01 18:59:45.059677 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-39bc98f8-9dfe-4842-bae5-e47b8ae1b440 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Request method failure captured: Nov 01 18:59:45.059677 n-d-863052-2 devstack@n-api.service[121403]: request: GET /compute/v2.1/os-security-groups/3ac82755-05f3-40fb-874c-63e687518273 HTTP/1.1 Nov 01 18:59:45.059677 n-d-863052-2 devstack@n-api.service[121403]: Accept: application/json Nov 01 18:59:45.059677 n-d-863052-2 devstack@n-api.service[121403]: Accept-Encoding: identity Nov 01 18:59:45.059677 n-d-863052-2 devstack@n-api.service[121403]: Connection: close Nov 01 18:59:45.059677 n-d-863052-2 devstack@n-api.service[121403]: Content-Length: 0 Nov 01 18:59:45.059677 n-d-863052-2 devstack@n-api.service[121403]: Content-Type: application/json Nov 01 18:59:45.059677 n-d-863052-2 devstack@n-api.service[121403]: Host: 10.222.0.13 Nov 01 18:59:45.059677 n-d-863052-2 devstack@n-api.service[121403]: Openstack-System-Scope: None Nov 01 18:59:45.059677 n-d-863052-2 devstack@n-api.service[121403]: User-Agent: python-urllib3/1.26.12 Nov 01 18:59:45.059677 n-d-863052-2 devstack@n-api.service[121403]: X-Auth-Token: gAAAAABjYWyBtiXfeZJIejT83Ksslz2hqDZRAGe29hQVddGupa2qgtVXWeGxqJACkYUk64AE7WNmKMU9sisFWqkZV1B8K0xSz0uDHshwD54pFesORYzaFN_rWLCdcUKPHyx9WACJmd6ZEeb3LBT9WzZa08oHURzA6g0G4BDfSDsuxDk4mdVs9fM Nov 01 18:59:45.059677 n-d-863052-2 devstack@n-api.service[121403]: X-Domain-Id: None Nov 01 18:59:45.059677 n-d-863052-2 devstack@n-api.service[121403]: X-Domain-Name: None Nov 01 18:59:45.059677 n-d-863052-2 devstack@n-api.service[121403]: X-Identity-Status: Confirmed Nov 01 18:59:45.059677 n-d-863052-2 devstack@n-api.service[121403]: X-Is-Admin-Project: True Nov 01 18:59:45.059677 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Domain-Id: default Nov 01 18:59:45.059677 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Domain-Name: Default Nov 01 18:59:45.059677 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Id: a9ef08eba0ef431285fd15a2561b4e5d Nov 01 18:59:45.059677 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Name: tempest-SecurityGroupsTestJSON-1185949800 Nov 01 18:59:45.059677 n-d-863052-2 devstack@n-api.service[121403]: X-Role: member,reader Nov 01 18:59:45.059677 n-d-863052-2 devstack@n-api.service[121403]: X-Roles: member,reader Nov 01 18:59:45.061948 n-d-863052-2 devstack@n-api.service[121403]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/a9ef08eba0ef431285fd15a2561b4e5d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/a9ef08eba0ef431285fd15a2561b4e5d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_a9ef08eba0ef431285fd15a2561b4e5d", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/a9ef08eba0ef431285fd15a2561b4e5d"}]}] Nov 01 18:59:45.061948 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant: tempest-SecurityGroupsTestJSON-1185949800 Nov 01 18:59:45.061948 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant-Id: a9ef08eba0ef431285fd15a2561b4e5d Nov 01 18:59:45.061948 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1185949800 Nov 01 18:59:45.061948 n-d-863052-2 devstack@n-api.service[121403]: X-User: tempest-SecurityGroupsTestJSON-1185949800-project Nov 01 18:59:45.061948 n-d-863052-2 devstack@n-api.service[121403]: X-User-Domain-Id: default Nov 01 18:59:45.061948 n-d-863052-2 devstack@n-api.service[121403]: X-User-Domain-Name: Default Nov 01 18:59:45.061948 n-d-863052-2 devstack@n-api.service[121403]: X-User-Id: 55a9c3b6a8c34f068caa50dc10d13a85 Nov 01 18:59:45.061948 n-d-863052-2 devstack@n-api.service[121403]: X-User-Name: tempest-SecurityGroupsTestJSON-1185949800-project Nov 01 18:59:45.061948 n-d-863052-2 devstack@n-api.service[121403]: method: Nov 01 18:59:45.061948 n-d-863052-2 devstack@n-api.service[121403]: exception: Security group 3ac82755-05f3-40fb-874c-63e687518273 does not exist Nov 01 18:59:45.061948 n-d-863052-2 devstack@n-api.service[121403]: Neutron server returns request_ids: ['req-d9218343-e065-4af6-8c3a-dc79856ffb3c'] Nov 01 18:59:45.061948 n-d-863052-2 devstack@n-api.service[121403]: action_args: {'id': '3ac82755-05f3-40fb-874c-63e687518273'} Nov 01 18:59:45.063357 n-d-863052-2 devstack@n-api.service[121403]: {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 01 18:59:45.063357 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:59:45.063357 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Nov 01 18:59:45.063357 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Nov 01 18:59:45.063357 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 01 18:59:45.063357 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 01 18:59:45.063357 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Nov 01 18:59:45.063357 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Nov 01 18:59:45.063357 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 01 18:59:45.063357 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 01 18:59:45.063357 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 01 18:59:45.063357 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 01 18:59:45.063357 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 01 18:59:45.063357 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 01 18:59:45.063357 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 01 18:59:45.063357 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 01 18:59:45.063357 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 01 18:59:45.063357 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 01 18:59:45.063357 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Nov 01 18:59:45.064921 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Nov 01 18:59:45.064921 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 01 18:59:45.064921 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 01 18:59:45.064921 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Nov 01 18:59:45.064921 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Nov 01 18:59:45.064921 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Nov 01 18:59:45.064921 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Nov 01 18:59:45.064921 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 3ac82755-05f3-40fb-874c-63e687518273 does not exist Nov 01 18:59:45.064921 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d9218343-e065-4af6-8c3a-dc79856ffb3c'] Nov 01 18:59:45.064921 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 18:59:45.064921 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 18:59:45.064921 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 18:59:45.064921 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:59:45.064921 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Nov 01 18:59:45.064921 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Nov 01 18:59:45.064921 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Nov 01 18:59:45.064921 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Nov 01 18:59:45.064921 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 3ac82755-05f3-40fb-874c-63e687518273 does not exist Nov 01 18:59:45.066599 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d9218343-e065-4af6-8c3a-dc79856ffb3c'] Nov 01 18:59:45.066599 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 18:59:45.066599 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 18:59:45.066599 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 18:59:45.066599 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:59:45.066599 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 18:59:45.066599 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 18:59:45.066599 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 01 18:59:45.066599 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 01 18:59:45.066599 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 01 18:59:45.066599 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 01 18:59:45.066599 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 01 18:59:45.066599 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 01 18:59:45.066599 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Nov 01 18:59:45.066599 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Nov 01 18:59:45.066599 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 3ac82755-05f3-40fb-874c-63e687518273 does not exist Nov 01 18:59:45.066599 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d9218343-e065-4af6-8c3a-dc79856ffb3c'] Nov 01 18:59:45.066599 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 18:59:45.066599 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 18:59:45.066599 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 18:59:45.066599 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:59:45.068729 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 18:59:45.068729 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 18:59:45.068729 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 01 18:59:45.068729 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 01 18:59:45.068729 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 3ac82755-05f3-40fb-874c-63e687518273 does not exist Nov 01 18:59:45.068729 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d9218343-e065-4af6-8c3a-dc79856ffb3c'] Nov 01 18:59:45.068729 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 18:59:45.073326 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-39bc98f8-9dfe-4842-bae5-e47b8ae1b440 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Returning 404 to user: Security group 3ac82755-05f3-40fb-874c-63e687518273 does not exist Nov 01 18:59:45.073326 n-d-863052-2 devstack@n-api.service[121403]: Neutron server returns request_ids: ['req-d9218343-e065-4af6-8c3a-dc79856ffb3c'] {{(pid=121403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 01 18:59:45.073326 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-39bc98f8-9dfe-4842-bae5-e47b8ae1b440 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] 10.222.0.13 "GET /compute/v2.1/os-security-groups/3ac82755-05f3-40fb-874c-63e687518273" status: 404 len: 194 microversion: 2.1 time: 0.134782 Nov 01 18:59:45.073326 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 745/1534] 10.222.0.13 () {58 vars in 1269 bytes} [Tue Nov 1 18:59:44 2022] GET /compute/v2.1/os-security-groups/3ac82755-05f3-40fb-874c-63e687518273 => generated 194 bytes in 137 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 01 18:59:45.078835 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-a443d147-0357-4b25-a209-c880fb6d6455 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:59:45.079655 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-a443d147-0357-4b25-a209-c880fb6d6455 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] [instance: f6762e10-9d45-47cf-a6b6-d9bfc3404664] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:59:45.086896 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-a443d147-0357-4b25-a209-c880fb6d6455 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:59:45.087735 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-a443d147-0357-4b25-a209-c880fb6d6455 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:59:45.088421 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-a443d147-0357-4b25-a209-c880fb6d6455 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:59:45.089530 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-a443d147-0357-4b25-a209-c880fb6d6455 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:59:45.090315 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-a443d147-0357-4b25-a209-c880fb6d6455 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:59:45.090965 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-a443d147-0357-4b25-a209-c880fb6d6455 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:59:45.412029 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-37131dd8-ca63-43d0-b5e0-c69659d251c8 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:59:45.443025 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-37131dd8-ca63-43d0-b5e0-c69659d251c8 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:59:45.452360 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-37131dd8-ca63-43d0-b5e0-c69659d251c8 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:59:45.460820 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-37131dd8-ca63-43d0-b5e0-c69659d251c8 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] 10.222.0.13 "GET /compute/v2.1/servers/a7f88d19-08ee-47bf-9240-7d49afd775e2" status: 200 len: 1812 microversion: 2.25 time: 0.656843 Nov 01 18:59:45.462200 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 790/1535] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 18:59:44 2022] GET /compute/v2.1/servers/a7f88d19-08ee-47bf-9240-7d49afd775e2 => generated 1812 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 18:59:45.469821 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-46cb3743-aa46-49c1-9c44-10ea753c24cc tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Action: 'create', calling method: .version_select at 0x7f0ae1dddb80>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-60464903", "description": "tempest-description-616278160"}} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 18:59:45.860426 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-46cb3743-aa46-49c1-9c44-10ea753c24cc tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] 10.222.0.13 "POST /compute/v2.1/os-security-groups" status: 200 len: 241 microversion: 2.1 time: 0.396836 Nov 01 18:59:45.860970 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 791/1536] 10.222.0.13 () {60 vars in 1180 bytes} [Tue Nov 1 18:59:45 2022] POST /compute/v2.1/os-security-groups => generated 241 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 18:59:45.875820 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-4699144d-f11a-430d-a3d1-120d9e60f241 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:59:45.876436 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-4699144d-f11a-430d-a3d1-120d9e60f241 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] [instance: 90b353ab-ef97-4d88-b5bc-b355ff576225] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:59:45.899417 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-a443d147-0357-4b25-a209-c880fb6d6455 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72117f17294649d6b8bc16c66c7efab2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45d4c047d3c44324a27a27831236ab0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:59:45.906384 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-4699144d-f11a-430d-a3d1-120d9e60f241 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:59:45.907159 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-4699144d-f11a-430d-a3d1-120d9e60f241 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:59:45.907761 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-4699144d-f11a-430d-a3d1-120d9e60f241 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:59:45.909444 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-4699144d-f11a-430d-a3d1-120d9e60f241 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:59:45.913747 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-a443d147-0357-4b25-a209-c880fb6d6455 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] 10.222.0.13 "GET /compute/v2.1/servers/f6762e10-9d45-47cf-a6b6-d9bfc3404664" status: 200 len: 1472 microversion: 2.1 time: 0.839954 Nov 01 18:59:45.913969 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-4699144d-f11a-430d-a3d1-120d9e60f241 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:59:45.914346 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 746/1537] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:59:45 2022] GET /compute/v2.1/servers/f6762e10-9d45-47cf-a6b6-d9bfc3404664 => generated 1472 bytes in 842 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:59:45.914883 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-4699144d-f11a-430d-a3d1-120d9e60f241 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:59:45.941881 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-6cf28097-6e60-4129-a538-9119ae0998e9 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:59:45.949211 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-6cf28097-6e60-4129-a538-9119ae0998e9 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] [instance: f35d5fdd-4a95-4b57-a506-665fa3f393c1] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:59:45.982712 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-6cf28097-6e60-4129-a538-9119ae0998e9 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:59:45.983645 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-6cf28097-6e60-4129-a538-9119ae0998e9 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:59:45.984740 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-6cf28097-6e60-4129-a538-9119ae0998e9 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:59:45.986739 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-6cf28097-6e60-4129-a538-9119ae0998e9 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:59:45.987546 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-6cf28097-6e60-4129-a538-9119ae0998e9 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:59:45.988288 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-6cf28097-6e60-4129-a538-9119ae0998e9 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:59:46.521881 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-4699144d-f11a-430d-a3d1-120d9e60f241 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a63d69c99a546f0af16329cff3ca717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a1bb191cff948e99c008b5e861ce4a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:59:46.531179 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-4699144d-f11a-430d-a3d1-120d9e60f241 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] 10.222.0.13 "GET /compute/v2.1/servers/90b353ab-ef97-4d88-b5bc-b355ff576225" status: 200 len: 1371 microversion: 2.1 time: 0.668759 Nov 01 18:59:46.531772 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 792/1538] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:59:45 2022] GET /compute/v2.1/servers/90b353ab-ef97-4d88-b5bc-b355ff576225 => generated 1371 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:59:46.567331 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-f01ea086-b8b6-4c30-a4fb-1a15b16c98f5 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Action: 'create', calling method: .version_select at 0x7f0ae1d75310>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1485417481", "description": "tempest-description-1544115961"}} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 18:59:46.884423 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-6cf28097-6e60-4129-a538-9119ae0998e9 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0290a6bb8bc24b8988a925327ac0381c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86941784237549838bba63ce88053b88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:59:46.902797 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-6cf28097-6e60-4129-a538-9119ae0998e9 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] 10.222.0.13 "GET /compute/v2.1/servers/f35d5fdd-4a95-4b57-a506-665fa3f393c1" status: 200 len: 1277 microversion: 2.1 time: 0.983809 Nov 01 18:59:46.906653 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 747/1539] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:59:45 2022] GET /compute/v2.1/servers/f35d5fdd-4a95-4b57-a506-665fa3f393c1 => generated 1277 bytes in 989 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:59:46.933747 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-956edd20-395d-4160-ac97-44778c51d0fd tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:59:46.935729 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-956edd20-395d-4160-ac97-44778c51d0fd tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] [instance: c34b04e9-a50a-4c58-85ff-ecef0bfc0343] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:59:46.957238 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-956edd20-395d-4160-ac97-44778c51d0fd tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:59:46.960851 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-956edd20-395d-4160-ac97-44778c51d0fd tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:59:46.963505 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-956edd20-395d-4160-ac97-44778c51d0fd tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:59:46.968121 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-956edd20-395d-4160-ac97-44778c51d0fd tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:59:46.969343 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-956edd20-395d-4160-ac97-44778c51d0fd tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:59:46.970992 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-956edd20-395d-4160-ac97-44778c51d0fd tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:59:47.229368 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-f01ea086-b8b6-4c30-a4fb-1a15b16c98f5 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] 10.222.0.13 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 0.687021 Nov 01 18:59:47.235382 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 793/1540] 10.222.0.13 () {60 vars in 1180 bytes} [Tue Nov 1 18:59:46 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 18:59:47.240877 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-98481b6f-a622-471e-9ee8-8f2116256271 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:59:47.241491 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-98481b6f-a622-471e-9ee8-8f2116256271 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] [instance: a7f88d19-08ee-47bf-9240-7d49afd775e2] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:59:47.253027 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-98481b6f-a622-471e-9ee8-8f2116256271 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:59:47.265375 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-98481b6f-a622-471e-9ee8-8f2116256271 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:59:47.265833 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-98481b6f-a622-471e-9ee8-8f2116256271 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:59:47.266618 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-98481b6f-a622-471e-9ee8-8f2116256271 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:59:47.267150 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-98481b6f-a622-471e-9ee8-8f2116256271 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:59:47.267523 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-98481b6f-a622-471e-9ee8-8f2116256271 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:59:47.580265 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-956edd20-395d-4160-ac97-44778c51d0fd tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b0619a8fc6f4fcc9eb5d4f473c595c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '280a221575634c6f908d333db769739b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:59:47.581398 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-98481b6f-a622-471e-9ee8-8f2116256271 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:59:47.592009 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-98481b6f-a622-471e-9ee8-8f2116256271 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:59:47.592730 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-956edd20-395d-4160-ac97-44778c51d0fd tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] 10.222.0.13 "GET /compute/v2.1/servers/c34b04e9-a50a-4c58-85ff-ecef0bfc0343" status: 200 len: 1468 microversion: 2.1 time: 0.684893 Nov 01 18:59:47.593335 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 748/1541] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:59:46 2022] GET /compute/v2.1/servers/c34b04e9-a50a-4c58-85ff-ecef0bfc0343 => generated 1468 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:59:47.594669 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-98481b6f-a622-471e-9ee8-8f2116256271 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:59:47.596472 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-98481b6f-a622-471e-9ee8-8f2116256271 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] 10.222.0.13 "GET /compute/v2.1/servers/a7f88d19-08ee-47bf-9240-7d49afd775e2" status: 200 len: 1812 microversion: 2.25 time: 0.359800 Nov 01 18:59:47.612611 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 794/1542] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 18:59:47 2022] GET /compute/v2.1/servers/a7f88d19-08ee-47bf-9240-7d49afd775e2 => generated 1812 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 18:59:47.612611 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-9c8f1066-13a3-40ab-9d48-8d11e0f94137 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:59:47.612611 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-9c8f1066-13a3-40ab-9d48-8d11e0f94137 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] [instance: f6762e10-9d45-47cf-a6b6-d9bfc3404664] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:59:47.618740 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-9c8f1066-13a3-40ab-9d48-8d11e0f94137 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:59:47.620286 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-9c8f1066-13a3-40ab-9d48-8d11e0f94137 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:59:47.620983 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-9c8f1066-13a3-40ab-9d48-8d11e0f94137 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:59:47.621879 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-9c8f1066-13a3-40ab-9d48-8d11e0f94137 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:59:47.623632 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-9c8f1066-13a3-40ab-9d48-8d11e0f94137 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:59:47.624262 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-9c8f1066-13a3-40ab-9d48-8d11e0f94137 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:59:47.629660 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [req-cbca5b63-d175-42b0-81ef-8f6311c08ebb req-539f42b2-63ec-46a2-a4e5-69632de6b904 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d8e88b0f-ae97-44a4-8b6b-b94e2c600a83", "name": "network-vif-plugged", "status": "completed", "tag": "91ce416d-c08f-473f-a551-fa3519a6c6c7"}]} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 18:59:47.657629 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-cbca5b63-d175-42b0-81ef-8f6311c08ebb req-539f42b2-63ec-46a2-a4e5-69632de6b904 service nova] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:59:47.660638 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-cbca5b63-d175-42b0-81ef-8f6311c08ebb req-539f42b2-63ec-46a2-a4e5-69632de6b904 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:59:47.662921 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-cbca5b63-d175-42b0-81ef-8f6311c08ebb req-539f42b2-63ec-46a2-a4e5-69632de6b904 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:59:47.690012 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.compute.server_external_events [req-cbca5b63-d175-42b0-81ef-8f6311c08ebb req-539f42b2-63ec-46a2-a4e5-69632de6b904 service nova] Creating event network-vif-plugged:91ce416d-c08f-473f-a551-fa3519a6c6c7 for instance d8e88b0f-ae97-44a4-8b6b-b94e2c600a83 on n-h1-863052-2 Nov 01 18:59:47.703652 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [req-cbca5b63-d175-42b0-81ef-8f6311c08ebb req-539f42b2-63ec-46a2-a4e5-69632de6b904 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088429 Nov 01 18:59:47.704268 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 749/1543] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Nov 1 18:59:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 18:59:47.711387 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-f33576e7-8bc9-4815-8f21-4a591ced63e4 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Action: 'create', calling method: .version_select at 0x7f0ae22cd4c0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1869652676", "description": "tempest-description-1984437165"}} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 18:59:48.102578 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-9c8f1066-13a3-40ab-9d48-8d11e0f94137 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72117f17294649d6b8bc16c66c7efab2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45d4c047d3c44324a27a27831236ab0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:59:48.114426 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-9c8f1066-13a3-40ab-9d48-8d11e0f94137 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] 10.222.0.13 "GET /compute/v2.1/servers/f6762e10-9d45-47cf-a6b6-d9bfc3404664" status: 200 len: 1472 microversion: 2.1 time: 0.512151 Nov 01 18:59:48.116277 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 795/1544] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:59:47 2022] GET /compute/v2.1/servers/f6762e10-9d45-47cf-a6b6-d9bfc3404664 => generated 1472 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:59:48.133429 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-89beeaaf-baf5-4090-ad50-8d1bfa5df597 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:59:48.134288 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-89beeaaf-baf5-4090-ad50-8d1bfa5df597 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] [instance: 90b353ab-ef97-4d88-b5bc-b355ff576225] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:59:48.145482 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-89beeaaf-baf5-4090-ad50-8d1bfa5df597 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:59:48.146288 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-89beeaaf-baf5-4090-ad50-8d1bfa5df597 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:59:48.146942 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-89beeaaf-baf5-4090-ad50-8d1bfa5df597 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:59:48.148090 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-89beeaaf-baf5-4090-ad50-8d1bfa5df597 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:59:48.148539 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-89beeaaf-baf5-4090-ad50-8d1bfa5df597 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:59:48.153189 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-89beeaaf-baf5-4090-ad50-8d1bfa5df597 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:59:48.471494 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-f33576e7-8bc9-4815-8f21-4a591ced63e4 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] 10.222.0.13 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 0.765713 Nov 01 18:59:48.472093 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 750/1545] 10.222.0.13 () {60 vars in 1180 bytes} [Tue Nov 1 18:59:47 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 18:59:48.483950 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-e85667b9-f7db-4898-a6d2-8ce6b5df167c tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:59:48.485186 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-e85667b9-f7db-4898-a6d2-8ce6b5df167c tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] [instance: d8e88b0f-ae97-44a4-8b6b-b94e2c600a83] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:59:48.496525 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-e85667b9-f7db-4898-a6d2-8ce6b5df167c tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:59:48.501415 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-e85667b9-f7db-4898-a6d2-8ce6b5df167c tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:59:48.502089 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-e85667b9-f7db-4898-a6d2-8ce6b5df167c tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:59:48.505658 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-e85667b9-f7db-4898-a6d2-8ce6b5df167c tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:59:48.506448 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-e85667b9-f7db-4898-a6d2-8ce6b5df167c tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:59:48.507061 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-e85667b9-f7db-4898-a6d2-8ce6b5df167c tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:59:48.511925 n-d-863052-2 devstack@n-api.service[121403]: DEBUG dbcounter [-] [121403] Writing DB stats nova_cell1:SELECT=100 {{(pid=121403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 18:59:48.599456 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-89beeaaf-baf5-4090-ad50-8d1bfa5df597 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a63d69c99a546f0af16329cff3ca717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a1bb191cff948e99c008b5e861ce4a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:59:48.612984 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-89beeaaf-baf5-4090-ad50-8d1bfa5df597 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] 10.222.0.13 "GET /compute/v2.1/servers/90b353ab-ef97-4d88-b5bc-b355ff576225" status: 200 len: 1371 microversion: 2.1 time: 0.494387 Nov 01 18:59:48.613579 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 796/1546] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:59:48 2022] GET /compute/v2.1/servers/90b353ab-ef97-4d88-b5bc-b355ff576225 => generated 1371 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:59:48.618435 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [req-7925c69d-cdd8-4788-b8fc-4af94d7b2d11 req-1be7b3a2-f3dd-4acc-a44b-83981f3b2d96 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a7f88d19-08ee-47bf-9240-7d49afd775e2", "tag": "01aee5f9-544a-4c0f-b9a3-2410eedf25a5"}]} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 18:59:48.642776 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-7925c69d-cdd8-4788-b8fc-4af94d7b2d11 req-1be7b3a2-f3dd-4acc-a44b-83981f3b2d96 service nova] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:59:48.643272 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-7925c69d-cdd8-4788-b8fc-4af94d7b2d11 req-1be7b3a2-f3dd-4acc-a44b-83981f3b2d96 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:59:48.643709 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-7925c69d-cdd8-4788-b8fc-4af94d7b2d11 req-1be7b3a2-f3dd-4acc-a44b-83981f3b2d96 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:59:48.664200 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.compute.server_external_events [req-7925c69d-cdd8-4788-b8fc-4af94d7b2d11 req-1be7b3a2-f3dd-4acc-a44b-83981f3b2d96 service nova] Creating event network-changed:01aee5f9-544a-4c0f-b9a3-2410eedf25a5 for instance a7f88d19-08ee-47bf-9240-7d49afd775e2 on n-h1-863052-2 Nov 01 18:59:48.680431 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [req-7925c69d-cdd8-4788-b8fc-4af94d7b2d11 req-1be7b3a2-f3dd-4acc-a44b-83981f3b2d96 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065158 Nov 01 18:59:48.681342 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 797/1547] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Nov 1 18:59:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 18:59:48.694788 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-7e2b3ca1-613d-4db8-8c7c-001d849f78d7 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:59:48.695691 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-7e2b3ca1-613d-4db8-8c7c-001d849f78d7 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] [instance: f35d5fdd-4a95-4b57-a506-665fa3f393c1] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:59:48.707551 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-7e2b3ca1-613d-4db8-8c7c-001d849f78d7 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:59:48.708062 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-7e2b3ca1-613d-4db8-8c7c-001d849f78d7 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:59:48.708499 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-7e2b3ca1-613d-4db8-8c7c-001d849f78d7 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:59:48.711916 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-7e2b3ca1-613d-4db8-8c7c-001d849f78d7 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:59:48.712685 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-7e2b3ca1-613d-4db8-8c7c-001d849f78d7 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:59:48.713289 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-7e2b3ca1-613d-4db8-8c7c-001d849f78d7 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:59:48.917840 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-e85667b9-f7db-4898-a6d2-8ce6b5df167c tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b0619a8fc6f4fcc9eb5d4f473c595c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '280a221575634c6f908d333db769739b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:59:48.927775 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-e85667b9-f7db-4898-a6d2-8ce6b5df167c tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] 10.222.0.13 "GET /compute/v2.1/servers/d8e88b0f-ae97-44a4-8b6b-b94e2c600a83" status: 200 len: 1317 microversion: 2.1 time: 0.454235 Nov 01 18:59:48.932046 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 751/1548] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:59:48 2022] GET /compute/v2.1/servers/d8e88b0f-ae97-44a4-8b6b-b94e2c600a83 => generated 1317 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:59:48.937445 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-dc3fe587-8ac2-4269-a802-47a1159ef4bf tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Calling method '.version_select at 0x7f0ae2ebba60>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:59:49.094390 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-7e2b3ca1-613d-4db8-8c7c-001d849f78d7 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0290a6bb8bc24b8988a925327ac0381c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86941784237549838bba63ce88053b88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:59:49.107895 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-7e2b3ca1-613d-4db8-8c7c-001d849f78d7 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] 10.222.0.13 "GET /compute/v2.1/servers/f35d5fdd-4a95-4b57-a506-665fa3f393c1" status: 200 len: 1317 microversion: 2.1 time: 0.425186 Nov 01 18:59:49.114329 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 798/1549] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:59:48 2022] GET /compute/v2.1/servers/f35d5fdd-4a95-4b57-a506-665fa3f393c1 => generated 1317 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:59:49.121186 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-5649e3bc-4747-4172-acdb-25cd409361ae tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:59:49.124930 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-5649e3bc-4747-4172-acdb-25cd409361ae tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] [instance: a7f88d19-08ee-47bf-9240-7d49afd775e2] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:59:49.137744 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-5649e3bc-4747-4172-acdb-25cd409361ae tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:59:49.142796 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-5649e3bc-4747-4172-acdb-25cd409361ae tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:59:49.151179 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-5649e3bc-4747-4172-acdb-25cd409361ae tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:59:49.152787 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-5649e3bc-4747-4172-acdb-25cd409361ae tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:59:49.153523 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-5649e3bc-4747-4172-acdb-25cd409361ae tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:59:49.154600 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-5649e3bc-4747-4172-acdb-25cd409361ae tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:59:49.654533 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-5649e3bc-4747-4172-acdb-25cd409361ae tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:59:49.668917 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-5649e3bc-4747-4172-acdb-25cd409361ae tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:59:49.672230 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-5649e3bc-4747-4172-acdb-25cd409361ae tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:59:49.675930 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-5649e3bc-4747-4172-acdb-25cd409361ae tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] 10.222.0.13 "GET /compute/v2.1/servers/a7f88d19-08ee-47bf-9240-7d49afd775e2" status: 200 len: 1812 microversion: 2.25 time: 0.559749 Nov 01 18:59:49.696639 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 799/1550] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 18:59:49 2022] GET /compute/v2.1/servers/a7f88d19-08ee-47bf-9240-7d49afd775e2 => generated 1812 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 18:59:49.708505 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-ca3a2467-f2d0-4d4e-bc87-d07e8186eb9a tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:59:49.709159 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-ca3a2467-f2d0-4d4e-bc87-d07e8186eb9a tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] [instance: f6762e10-9d45-47cf-a6b6-d9bfc3404664] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:59:49.715562 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-dc3fe587-8ac2-4269-a802-47a1159ef4bf tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] 10.222.0.13 "GET /compute/v2.1/os-security-groups" status: 200 len: 1831 microversion: 2.1 time: 0.781439 Nov 01 18:59:49.717103 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 752/1551] 10.222.0.13 () {58 vars in 1158 bytes} [Tue Nov 1 18:59:48 2022] GET /compute/v2.1/os-security-groups => generated 1831 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:59:49.730120 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-cde1b7c6-8593-41fa-b26b-4bf2b64e3d77 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:59:49.731163 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-cde1b7c6-8593-41fa-b26b-4bf2b64e3d77 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] [instance: 90b353ab-ef97-4d88-b5bc-b355ff576225] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:59:49.736136 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-ca3a2467-f2d0-4d4e-bc87-d07e8186eb9a tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:59:49.736676 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-ca3a2467-f2d0-4d4e-bc87-d07e8186eb9a tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:59:49.738119 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-ca3a2467-f2d0-4d4e-bc87-d07e8186eb9a tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:59:49.738863 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-ca3a2467-f2d0-4d4e-bc87-d07e8186eb9a tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:59:49.741437 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-ca3a2467-f2d0-4d4e-bc87-d07e8186eb9a tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:59:49.741901 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-ca3a2467-f2d0-4d4e-bc87-d07e8186eb9a tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:59:49.751964 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-cde1b7c6-8593-41fa-b26b-4bf2b64e3d77 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:59:49.758302 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-cde1b7c6-8593-41fa-b26b-4bf2b64e3d77 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:59:49.760197 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-cde1b7c6-8593-41fa-b26b-4bf2b64e3d77 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:59:49.761421 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-cde1b7c6-8593-41fa-b26b-4bf2b64e3d77 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:59:49.762231 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-cde1b7c6-8593-41fa-b26b-4bf2b64e3d77 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:59:49.763032 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-cde1b7c6-8593-41fa-b26b-4bf2b64e3d77 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:59:50.189384 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-cde1b7c6-8593-41fa-b26b-4bf2b64e3d77 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a63d69c99a546f0af16329cff3ca717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a1bb191cff948e99c008b5e861ce4a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:59:50.202746 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-cde1b7c6-8593-41fa-b26b-4bf2b64e3d77 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] 10.222.0.13 "GET /compute/v2.1/servers/90b353ab-ef97-4d88-b5bc-b355ff576225" status: 200 len: 1371 microversion: 2.1 time: 0.484407 Nov 01 18:59:50.216811 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 753/1552] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:59:49 2022] GET /compute/v2.1/servers/90b353ab-ef97-4d88-b5bc-b355ff576225 => generated 1371 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:59:50.216811 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-a8a06be4-5942-4e44-8745-bc6bfde07026 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Calling method '.version_select at 0x7f0ae2ebba60>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:59:50.677581 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-a8a06be4-5942-4e44-8745-bc6bfde07026 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] 10.222.0.13 "DELETE /compute/v2.1/os-security-groups/29c1bc9c-328a-4b78-80f4-40bd047ae4d7" status: 202 len: 0 microversion: 2.1 time: 0.472628 Nov 01 18:59:50.678346 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 754/1553] 10.222.0.13 () {58 vars in 1272 bytes} [Tue Nov 1 18:59:50 2022] DELETE /compute/v2.1/os-security-groups/29c1bc9c-328a-4b78-80f4-40bd047ae4d7 => generated 0 bytes in 475 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 01 18:59:50.685491 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-4e808437-8dfe-4cc7-aac0-9a04d6c7ae04 tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:59:50.686368 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-4e808437-8dfe-4cc7-aac0-9a04d6c7ae04 tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] [instance: d8e88b0f-ae97-44a4-8b6b-b94e2c600a83] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:59:50.704278 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-4e808437-8dfe-4cc7-aac0-9a04d6c7ae04 tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:59:50.705368 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-4e808437-8dfe-4cc7-aac0-9a04d6c7ae04 tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:59:50.705997 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-4e808437-8dfe-4cc7-aac0-9a04d6c7ae04 tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:59:50.706970 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-4e808437-8dfe-4cc7-aac0-9a04d6c7ae04 tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:59:50.707697 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-4e808437-8dfe-4cc7-aac0-9a04d6c7ae04 tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:59:50.714807 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-4e808437-8dfe-4cc7-aac0-9a04d6c7ae04 tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:59:50.757375 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-ca3a2467-f2d0-4d4e-bc87-d07e8186eb9a tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72117f17294649d6b8bc16c66c7efab2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45d4c047d3c44324a27a27831236ab0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:59:50.775108 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-ca3a2467-f2d0-4d4e-bc87-d07e8186eb9a tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] 10.222.0.13 "GET /compute/v2.1/servers/f6762e10-9d45-47cf-a6b6-d9bfc3404664" status: 200 len: 1472 microversion: 2.1 time: 1.076782 Nov 01 18:59:50.777042 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 800/1554] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:59:49 2022] GET /compute/v2.1/servers/f6762e10-9d45-47cf-a6b6-d9bfc3404664 => generated 1472 bytes in 1080 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:59:50.805220 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-441b2bca-5c84-41a7-998d-8295d0dd0753 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:59:50.808372 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-441b2bca-5c84-41a7-998d-8295d0dd0753 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] [instance: f35d5fdd-4a95-4b57-a506-665fa3f393c1] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:59:50.827663 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-441b2bca-5c84-41a7-998d-8295d0dd0753 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:59:50.831406 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-441b2bca-5c84-41a7-998d-8295d0dd0753 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:59:50.831862 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-441b2bca-5c84-41a7-998d-8295d0dd0753 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:59:50.832935 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-441b2bca-5c84-41a7-998d-8295d0dd0753 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:59:50.833397 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-441b2bca-5c84-41a7-998d-8295d0dd0753 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:59:50.833823 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-441b2bca-5c84-41a7-998d-8295d0dd0753 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:59:50.849946 n-d-863052-2 devstack@n-api.service[121402]: DEBUG dbcounter [-] [121402] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 18:59:50.941134 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-4e808437-8dfe-4cc7-aac0-9a04d6c7ae04 tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b0619a8fc6f4fcc9eb5d4f473c595c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '280a221575634c6f908d333db769739b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:59:50.950342 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-4e808437-8dfe-4cc7-aac0-9a04d6c7ae04 tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] 10.222.0.13 "GET /compute/v2.1/servers/d8e88b0f-ae97-44a4-8b6b-b94e2c600a83" status: 200 len: 1466 microversion: 2.1 time: 0.270699 Nov 01 18:59:50.951177 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 755/1555] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:59:50 2022] GET /compute/v2.1/servers/d8e88b0f-ae97-44a4-8b6b-b94e2c600a83 => generated 1466 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:59:51.020875 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-f7bbc792-4efd-4f85-b470-c6eacb9d4e68 tempest-ServersTestFqdnHostnames-269349818 tempest-ServersTestFqdnHostnames-269349818-project] Action: 'create', calling method: .version_select at 0x7f0ae2805940>, body: {"keypair": {"name": "tempest-keypair-1693802313", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN+B19VTpqHmbq6OhmAKooq+lEt8/qGNYOBS1QXUw9fVAaKbVUBmgUkvuwYfOMwRxsWKXOkiKYcoIKXOYy1LClwmTQ96aMEXhDqW6PhnVhb2zQ9JqL3rm1bZTzspGPlaYw=="}} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 18:59:51.040053 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.quota [None req-f7bbc792-4efd-4f85-b470-c6eacb9d4e68 tempest-ServersTestFqdnHostnames-269349818 tempest-ServersTestFqdnHostnames-269349818-project] Getting quotas for project cfea57f34b844c77b22619105249d08a. Resources: {'key_pairs'} {{(pid=121403) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 01 18:59:51.047815 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.quota [None req-f7bbc792-4efd-4f85-b470-c6eacb9d4e68 tempest-ServersTestFqdnHostnames-269349818 tempest-ServersTestFqdnHostnames-269349818-project] Getting quotas for user 3d33ca3478b7455dad5094afee57c8b2 and project cfea57f34b844c77b22619105249d08a. Resources: {'key_pairs'} {{(pid=121403) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 01 18:59:51.102409 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-f7bbc792-4efd-4f85-b470-c6eacb9d4e68 tempest-ServersTestFqdnHostnames-269349818 tempest-ServersTestFqdnHostnames-269349818-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.149548 Nov 01 18:59:51.118581 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 756/1556] 10.222.0.13 () {60 vars in 1159 bytes} [Tue Nov 1 18:59:50 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 18:59:51.126459 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-7bda444e-e736-49f1-b3a4-e24df7604973 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Calling method '.version_select at 0x7f0ae68f1af0>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:59:51.167968 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-441b2bca-5c84-41a7-998d-8295d0dd0753 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0290a6bb8bc24b8988a925327ac0381c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86941784237549838bba63ce88053b88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:59:51.181255 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-441b2bca-5c84-41a7-998d-8295d0dd0753 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] 10.222.0.13 "GET /compute/v2.1/servers/f35d5fdd-4a95-4b57-a506-665fa3f393c1" status: 200 len: 1317 microversion: 2.1 time: 0.402465 Nov 01 18:59:51.182155 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 801/1557] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:59:50 2022] GET /compute/v2.1/servers/f35d5fdd-4a95-4b57-a506-665fa3f393c1 => generated 1317 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:59:51.186669 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-2c4b58be-6eae-4a18-b8bc-dfa2c65e20c4 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:59:51.187523 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-2c4b58be-6eae-4a18-b8bc-dfa2c65e20c4 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] [instance: a7f88d19-08ee-47bf-9240-7d49afd775e2] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:59:51.196711 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2c4b58be-6eae-4a18-b8bc-dfa2c65e20c4 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:59:51.197377 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2c4b58be-6eae-4a18-b8bc-dfa2c65e20c4 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:59:51.197970 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2c4b58be-6eae-4a18-b8bc-dfa2c65e20c4 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:59:51.199058 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2c4b58be-6eae-4a18-b8bc-dfa2c65e20c4 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:59:51.199514 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2c4b58be-6eae-4a18-b8bc-dfa2c65e20c4 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:59:51.200063 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2c4b58be-6eae-4a18-b8bc-dfa2c65e20c4 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:59:51.214654 n-d-863052-2 devstack@n-api.service[121403]: DEBUG neutronclient.v2_0.client [None req-7bda444e-e736-49f1-b3a4-e24df7604973 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 29c1bc9c-328a-4b78-80f4-40bd047ae4d7 does not exist", "detail": ""}} {{(pid=121403) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Nov 01 18:59:51.215326 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.network.security_group_api [None req-7bda444e-e736-49f1-b3a4-e24df7604973 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Neutron security group 29c1bc9c-328a-4b78-80f4-40bd047ae4d7 not found {{(pid=121403) get /opt/stack/nova/nova/network/security_group_api.py:313}} Nov 01 18:59:51.216476 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.wsgi [None req-7bda444e-e736-49f1-b3a4-e24df7604973 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] HTTP exception thrown: Security group 29c1bc9c-328a-4b78-80f4-40bd047ae4d7 does not exist Nov 01 18:59:51.216476 n-d-863052-2 devstack@n-api.service[121403]: Neutron server returns request_ids: ['req-599f4ab6-127f-4d3c-85eb-88f3f0dcd99d'] Nov 01 18:59:51.218900 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-7bda444e-e736-49f1-b3a4-e24df7604973 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Request method failure captured: Nov 01 18:59:51.218900 n-d-863052-2 devstack@n-api.service[121403]: request: GET /compute/v2.1/os-security-groups/29c1bc9c-328a-4b78-80f4-40bd047ae4d7 HTTP/1.1 Nov 01 18:59:51.218900 n-d-863052-2 devstack@n-api.service[121403]: Accept: application/json Nov 01 18:59:51.218900 n-d-863052-2 devstack@n-api.service[121403]: Accept-Encoding: identity Nov 01 18:59:51.218900 n-d-863052-2 devstack@n-api.service[121403]: Connection: close Nov 01 18:59:51.218900 n-d-863052-2 devstack@n-api.service[121403]: Content-Length: 0 Nov 01 18:59:51.218900 n-d-863052-2 devstack@n-api.service[121403]: Content-Type: application/json Nov 01 18:59:51.218900 n-d-863052-2 devstack@n-api.service[121403]: Host: 10.222.0.13 Nov 01 18:59:51.218900 n-d-863052-2 devstack@n-api.service[121403]: Openstack-System-Scope: None Nov 01 18:59:51.218900 n-d-863052-2 devstack@n-api.service[121403]: User-Agent: python-urllib3/1.26.12 Nov 01 18:59:51.218900 n-d-863052-2 devstack@n-api.service[121403]: X-Auth-Token: gAAAAABjYWyBtiXfeZJIejT83Ksslz2hqDZRAGe29hQVddGupa2qgtVXWeGxqJACkYUk64AE7WNmKMU9sisFWqkZV1B8K0xSz0uDHshwD54pFesORYzaFN_rWLCdcUKPHyx9WACJmd6ZEeb3LBT9WzZa08oHURzA6g0G4BDfSDsuxDk4mdVs9fM Nov 01 18:59:51.218900 n-d-863052-2 devstack@n-api.service[121403]: X-Domain-Id: None Nov 01 18:59:51.218900 n-d-863052-2 devstack@n-api.service[121403]: X-Domain-Name: None Nov 01 18:59:51.218900 n-d-863052-2 devstack@n-api.service[121403]: X-Identity-Status: Confirmed Nov 01 18:59:51.218900 n-d-863052-2 devstack@n-api.service[121403]: X-Is-Admin-Project: True Nov 01 18:59:51.218900 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Domain-Id: default Nov 01 18:59:51.218900 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Domain-Name: Default Nov 01 18:59:51.218900 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Id: a9ef08eba0ef431285fd15a2561b4e5d Nov 01 18:59:51.218900 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Name: tempest-SecurityGroupsTestJSON-1185949800 Nov 01 18:59:51.218900 n-d-863052-2 devstack@n-api.service[121403]: X-Role: member,reader Nov 01 18:59:51.218900 n-d-863052-2 devstack@n-api.service[121403]: X-Roles: member,reader Nov 01 18:59:51.220270 n-d-863052-2 devstack@n-api.service[121403]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/a9ef08eba0ef431285fd15a2561b4e5d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/a9ef08eba0ef431285fd15a2561b4e5d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_a9ef08eba0ef431285fd15a2561b4e5d", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/a9ef08eba0ef431285fd15a2561b4e5d"}]}] Nov 01 18:59:51.220270 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant: tempest-SecurityGroupsTestJSON-1185949800 Nov 01 18:59:51.220270 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant-Id: a9ef08eba0ef431285fd15a2561b4e5d Nov 01 18:59:51.220270 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1185949800 Nov 01 18:59:51.220270 n-d-863052-2 devstack@n-api.service[121403]: X-User: tempest-SecurityGroupsTestJSON-1185949800-project Nov 01 18:59:51.220270 n-d-863052-2 devstack@n-api.service[121403]: X-User-Domain-Id: default Nov 01 18:59:51.220270 n-d-863052-2 devstack@n-api.service[121403]: X-User-Domain-Name: Default Nov 01 18:59:51.220270 n-d-863052-2 devstack@n-api.service[121403]: X-User-Id: 55a9c3b6a8c34f068caa50dc10d13a85 Nov 01 18:59:51.220270 n-d-863052-2 devstack@n-api.service[121403]: X-User-Name: tempest-SecurityGroupsTestJSON-1185949800-project Nov 01 18:59:51.220270 n-d-863052-2 devstack@n-api.service[121403]: method: Nov 01 18:59:51.220270 n-d-863052-2 devstack@n-api.service[121403]: exception: Security group 29c1bc9c-328a-4b78-80f4-40bd047ae4d7 does not exist Nov 01 18:59:51.220270 n-d-863052-2 devstack@n-api.service[121403]: Neutron server returns request_ids: ['req-599f4ab6-127f-4d3c-85eb-88f3f0dcd99d'] Nov 01 18:59:51.220270 n-d-863052-2 devstack@n-api.service[121403]: action_args: {'id': '29c1bc9c-328a-4b78-80f4-40bd047ae4d7'} Nov 01 18:59:51.221267 n-d-863052-2 devstack@n-api.service[121403]: {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 01 18:59:51.221267 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:59:51.221267 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Nov 01 18:59:51.221267 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Nov 01 18:59:51.221267 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 01 18:59:51.221267 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 01 18:59:51.221267 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Nov 01 18:59:51.221267 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Nov 01 18:59:51.221267 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 01 18:59:51.221267 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 01 18:59:51.221267 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 01 18:59:51.221267 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 01 18:59:51.221267 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 01 18:59:51.221267 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 01 18:59:51.221267 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 01 18:59:51.221267 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 01 18:59:51.221267 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 01 18:59:51.221267 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 01 18:59:51.221267 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Nov 01 18:59:51.222448 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Nov 01 18:59:51.222448 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 01 18:59:51.222448 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 01 18:59:51.222448 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Nov 01 18:59:51.222448 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Nov 01 18:59:51.222448 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Nov 01 18:59:51.222448 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Nov 01 18:59:51.222448 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 29c1bc9c-328a-4b78-80f4-40bd047ae4d7 does not exist Nov 01 18:59:51.222448 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-599f4ab6-127f-4d3c-85eb-88f3f0dcd99d'] Nov 01 18:59:51.222448 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 18:59:51.222448 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 18:59:51.222448 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 18:59:51.222448 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:59:51.222448 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Nov 01 18:59:51.222448 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Nov 01 18:59:51.222448 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Nov 01 18:59:51.222448 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Nov 01 18:59:51.222448 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 29c1bc9c-328a-4b78-80f4-40bd047ae4d7 does not exist Nov 01 18:59:51.224118 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-599f4ab6-127f-4d3c-85eb-88f3f0dcd99d'] Nov 01 18:59:51.224118 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 18:59:51.224118 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 18:59:51.224118 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 18:59:51.224118 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:59:51.224118 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 18:59:51.224118 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 18:59:51.224118 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 01 18:59:51.224118 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 01 18:59:51.224118 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 01 18:59:51.224118 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 01 18:59:51.224118 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 01 18:59:51.224118 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 01 18:59:51.224118 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Nov 01 18:59:51.224118 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Nov 01 18:59:51.224118 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 29c1bc9c-328a-4b78-80f4-40bd047ae4d7 does not exist Nov 01 18:59:51.224118 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-599f4ab6-127f-4d3c-85eb-88f3f0dcd99d'] Nov 01 18:59:51.224118 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 18:59:51.224118 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 18:59:51.224118 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 18:59:51.224118 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:59:51.226519 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 18:59:51.226519 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 18:59:51.226519 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 01 18:59:51.226519 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 01 18:59:51.226519 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 29c1bc9c-328a-4b78-80f4-40bd047ae4d7 does not exist Nov 01 18:59:51.226519 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-599f4ab6-127f-4d3c-85eb-88f3f0dcd99d'] Nov 01 18:59:51.226519 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 18:59:51.226519 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-7bda444e-e736-49f1-b3a4-e24df7604973 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Returning 404 to user: Security group 29c1bc9c-328a-4b78-80f4-40bd047ae4d7 does not exist Nov 01 18:59:51.226519 n-d-863052-2 devstack@n-api.service[121403]: Neutron server returns request_ids: ['req-599f4ab6-127f-4d3c-85eb-88f3f0dcd99d'] {{(pid=121403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 01 18:59:51.226519 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-7bda444e-e736-49f1-b3a4-e24df7604973 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] 10.222.0.13 "GET /compute/v2.1/os-security-groups/29c1bc9c-328a-4b78-80f4-40bd047ae4d7" status: 404 len: 194 microversion: 2.1 time: 0.100104 Nov 01 18:59:51.226519 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 757/1558] 10.222.0.13 () {58 vars in 1269 bytes} [Tue Nov 1 18:59:51 2022] GET /compute/v2.1/os-security-groups/29c1bc9c-328a-4b78-80f4-40bd047ae4d7 => generated 194 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 01 18:59:51.235293 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [req-68a8ae5e-675d-4558-9c67-9f8dd9f586f7 req-16d4a14e-9591-4c47-9404-4ba16e531aae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "90b353ab-ef97-4d88-b5bc-b355ff576225", "tag": "773bb149-e7e8-4592-bede-bd40ac6e3e49"}]} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 18:59:51.257596 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-68a8ae5e-675d-4558-9c67-9f8dd9f586f7 req-16d4a14e-9591-4c47-9404-4ba16e531aae service nova] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:59:51.258198 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-68a8ae5e-675d-4558-9c67-9f8dd9f586f7 req-16d4a14e-9591-4c47-9404-4ba16e531aae service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:59:51.258631 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-68a8ae5e-675d-4558-9c67-9f8dd9f586f7 req-16d4a14e-9591-4c47-9404-4ba16e531aae service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:59:51.289609 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.compute.server_external_events [req-68a8ae5e-675d-4558-9c67-9f8dd9f586f7 req-16d4a14e-9591-4c47-9404-4ba16e531aae service nova] Creating event network-changed:773bb149-e7e8-4592-bede-bd40ac6e3e49 for instance 90b353ab-ef97-4d88-b5bc-b355ff576225 on n-h1-863052-2 Nov 01 18:59:51.297859 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [req-68a8ae5e-675d-4558-9c67-9f8dd9f586f7 req-16d4a14e-9591-4c47-9404-4ba16e531aae service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070928 Nov 01 18:59:51.298758 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 758/1559] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Nov 1 18:59:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 18:59:51.309753 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-dcda4766-d085-4370-b975-736a0c7904b7 tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-543410580"}} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 18:59:51.312436 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-dcda4766-d085-4370-b975-736a0c7904b7 tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] [instance: d8e88b0f-ae97-44a4-8b6b-b94e2c600a83] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:59:51.318720 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-dcda4766-d085-4370-b975-736a0c7904b7 tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:59:51.319204 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-dcda4766-d085-4370-b975-736a0c7904b7 tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:59:51.319641 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-dcda4766-d085-4370-b975-736a0c7904b7 tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:59:51.320338 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-dcda4766-d085-4370-b975-736a0c7904b7 tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:59:51.320837 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-dcda4766-d085-4370-b975-736a0c7904b7 tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:59:51.321261 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-dcda4766-d085-4370-b975-736a0c7904b7 tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:59:51.555657 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-2c4b58be-6eae-4a18-b8bc-dfa2c65e20c4 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:59:51.574346 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-2c4b58be-6eae-4a18-b8bc-dfa2c65e20c4 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:59:51.585868 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-2c4b58be-6eae-4a18-b8bc-dfa2c65e20c4 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:59:51.587292 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-2c4b58be-6eae-4a18-b8bc-dfa2c65e20c4 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] 10.222.0.13 "GET /compute/v2.1/servers/a7f88d19-08ee-47bf-9240-7d49afd775e2" status: 200 len: 1812 microversion: 2.25 time: 0.404203 Nov 01 18:59:51.588699 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 802/1560] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 18:59:51 2022] GET /compute/v2.1/servers/a7f88d19-08ee-47bf-9240-7d49afd775e2 => generated 1812 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 18:59:51.604773 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [req-ca649714-2562-49f5-b579-3cdaaeaf3ba0 req-a6803fa5-73fd-48fa-bc84-34bce22665b0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f35d5fdd-4a95-4b57-a506-665fa3f393c1", "tag": "1eeffe67-2447-4389-aa3b-4c83cc3c9d53"}]} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 18:59:51.627239 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-ca649714-2562-49f5-b579-3cdaaeaf3ba0 req-a6803fa5-73fd-48fa-bc84-34bce22665b0 service nova] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:59:51.628393 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-ca649714-2562-49f5-b579-3cdaaeaf3ba0 req-a6803fa5-73fd-48fa-bc84-34bce22665b0 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:59:51.629038 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-ca649714-2562-49f5-b579-3cdaaeaf3ba0 req-a6803fa5-73fd-48fa-bc84-34bce22665b0 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:59:51.647369 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-dcda4766-d085-4370-b975-736a0c7904b7 tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] 10.222.0.13 "POST /compute/v2.1/servers/d8e88b0f-ae97-44a4-8b6b-b94e2c600a83/action" status: 202 len: 0 microversion: 2.1 time: 0.341628 Nov 01 18:59:51.647939 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 759/1561] 10.222.0.13 () {60 vars in 1278 bytes} [Tue Nov 1 18:59:51 2022] POST /compute/v2.1/servers/d8e88b0f-ae97-44a4-8b6b-b94e2c600a83/action => generated 0 bytes in 349 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 01 18:59:51.658203 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-63cfd78e-a9e4-4921-adbf-1a801fbf81e3 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:59:51.659006 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-63cfd78e-a9e4-4921-adbf-1a801fbf81e3 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] [instance: 90b353ab-ef97-4d88-b5bc-b355ff576225] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:59:51.660867 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.compute.server_external_events [req-ca649714-2562-49f5-b579-3cdaaeaf3ba0 req-a6803fa5-73fd-48fa-bc84-34bce22665b0 service nova] Creating event network-changed:1eeffe67-2447-4389-aa3b-4c83cc3c9d53 for instance f35d5fdd-4a95-4b57-a506-665fa3f393c1 on n-h2-863052-2 Nov 01 18:59:51.670467 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [req-ca649714-2562-49f5-b579-3cdaaeaf3ba0 req-a6803fa5-73fd-48fa-bc84-34bce22665b0 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079498 Nov 01 18:59:51.671681 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 803/1562] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Nov 1 18:59:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 18:59:51.674637 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-63cfd78e-a9e4-4921-adbf-1a801fbf81e3 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:59:51.675142 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-63cfd78e-a9e4-4921-adbf-1a801fbf81e3 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:59:51.678422 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-63cfd78e-a9e4-4921-adbf-1a801fbf81e3 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:59:51.679202 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-63cfd78e-a9e4-4921-adbf-1a801fbf81e3 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:59:51.679840 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-63cfd78e-a9e4-4921-adbf-1a801fbf81e3 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:59:51.680386 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-63cfd78e-a9e4-4921-adbf-1a801fbf81e3 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:59:51.681096 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-6d47fab9-5c67-4e3b-85c9-2ee0b0e3bd47 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Calling method '.version_select at 0x7f0ae1d753a0>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:59:51.949302 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-63cfd78e-a9e4-4921-adbf-1a801fbf81e3 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a63d69c99a546f0af16329cff3ca717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a1bb191cff948e99c008b5e861ce4a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:59:51.962300 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-63cfd78e-a9e4-4921-adbf-1a801fbf81e3 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] 10.222.0.13 "GET /compute/v2.1/servers/90b353ab-ef97-4d88-b5bc-b355ff576225" status: 200 len: 1371 microversion: 2.1 time: 0.313097 Nov 01 18:59:51.962888 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 760/1563] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:59:51 2022] GET /compute/v2.1/servers/90b353ab-ef97-4d88-b5bc-b355ff576225 => generated 1371 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:59:51.967472 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-f66e3d68-12b1-485e-862f-9498aa8074e0 tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] Calling method '.version_select at 0x7f0ae68f1c10>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:59:52.035075 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-f66e3d68-12b1-485e-862f-9498aa8074e0 tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] 10.222.0.13 "GET /compute/v2.1/images/14008a7c-6542-4124-800d-d352127c1bb1" status: 200 len: 1454 microversion: 2.1 time: 0.071096 Nov 01 18:59:52.035868 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 761/1564] 10.222.0.13 () {58 vars in 1233 bytes} [Tue Nov 1 18:59:51 2022] GET /compute/v2.1/images/14008a7c-6542-4124-800d-d352127c1bb1 => generated 1454 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:59:52.050449 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-ed547a86-d538-4cd7-b79a-4f54fd355927 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:59:52.050792 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-6d47fab9-5c67-4e3b-85c9-2ee0b0e3bd47 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] 10.222.0.13 "DELETE /compute/v2.1/os-security-groups/c1b41ef2-7c6f-4327-8e1d-4ef5e045c3e3" status: 202 len: 0 microversion: 2.1 time: 0.377608 Nov 01 18:59:52.051347 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-ed547a86-d538-4cd7-b79a-4f54fd355927 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] [instance: f6762e10-9d45-47cf-a6b6-d9bfc3404664] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:59:52.051705 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 804/1565] 10.222.0.13 () {58 vars in 1272 bytes} [Tue Nov 1 18:59:51 2022] DELETE /compute/v2.1/os-security-groups/c1b41ef2-7c6f-4327-8e1d-4ef5e045c3e3 => generated 0 bytes in 379 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 01 18:59:52.059454 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-e8357e36-c7ac-4416-9681-33825bce9a17 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Calling method '.version_select at 0x7f0ae1cf98b0>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:59:52.070921 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-ed547a86-d538-4cd7-b79a-4f54fd355927 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:59:52.071418 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-ed547a86-d538-4cd7-b79a-4f54fd355927 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:59:52.071856 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-ed547a86-d538-4cd7-b79a-4f54fd355927 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:59:52.072952 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-ed547a86-d538-4cd7-b79a-4f54fd355927 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:59:52.073047 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-ed547a86-d538-4cd7-b79a-4f54fd355927 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:59:52.073426 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-ed547a86-d538-4cd7-b79a-4f54fd355927 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:59:52.119268 n-d-863052-2 devstack@n-api.service[121402]: DEBUG neutronclient.v2_0.client [None req-e8357e36-c7ac-4416-9681-33825bce9a17 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group c1b41ef2-7c6f-4327-8e1d-4ef5e045c3e3 does not exist", "detail": ""}} {{(pid=121402) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Nov 01 18:59:52.120782 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.network.security_group_api [None req-e8357e36-c7ac-4416-9681-33825bce9a17 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Neutron security group c1b41ef2-7c6f-4327-8e1d-4ef5e045c3e3 not found {{(pid=121402) get /opt/stack/nova/nova/network/security_group_api.py:313}} Nov 01 18:59:52.121316 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.wsgi [None req-e8357e36-c7ac-4416-9681-33825bce9a17 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] HTTP exception thrown: Security group c1b41ef2-7c6f-4327-8e1d-4ef5e045c3e3 does not exist Nov 01 18:59:52.121316 n-d-863052-2 devstack@n-api.service[121402]: Neutron server returns request_ids: ['req-355f1e41-ea6a-417e-86ec-ec52ab980ea1'] Nov 01 18:59:52.124128 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-e8357e36-c7ac-4416-9681-33825bce9a17 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Request method failure captured: Nov 01 18:59:52.124128 n-d-863052-2 devstack@n-api.service[121402]: request: GET /compute/v2.1/os-security-groups/c1b41ef2-7c6f-4327-8e1d-4ef5e045c3e3 HTTP/1.1 Nov 01 18:59:52.124128 n-d-863052-2 devstack@n-api.service[121402]: Accept: application/json Nov 01 18:59:52.124128 n-d-863052-2 devstack@n-api.service[121402]: Accept-Encoding: identity Nov 01 18:59:52.124128 n-d-863052-2 devstack@n-api.service[121402]: Connection: close Nov 01 18:59:52.124128 n-d-863052-2 devstack@n-api.service[121402]: Content-Length: 0 Nov 01 18:59:52.124128 n-d-863052-2 devstack@n-api.service[121402]: Content-Type: application/json Nov 01 18:59:52.124128 n-d-863052-2 devstack@n-api.service[121402]: Host: 10.222.0.13 Nov 01 18:59:52.124128 n-d-863052-2 devstack@n-api.service[121402]: Openstack-System-Scope: None Nov 01 18:59:52.124128 n-d-863052-2 devstack@n-api.service[121402]: User-Agent: python-urllib3/1.26.12 Nov 01 18:59:52.124128 n-d-863052-2 devstack@n-api.service[121402]: X-Auth-Token: gAAAAABjYWyBtiXfeZJIejT83Ksslz2hqDZRAGe29hQVddGupa2qgtVXWeGxqJACkYUk64AE7WNmKMU9sisFWqkZV1B8K0xSz0uDHshwD54pFesORYzaFN_rWLCdcUKPHyx9WACJmd6ZEeb3LBT9WzZa08oHURzA6g0G4BDfSDsuxDk4mdVs9fM Nov 01 18:59:52.124128 n-d-863052-2 devstack@n-api.service[121402]: X-Domain-Id: None Nov 01 18:59:52.124128 n-d-863052-2 devstack@n-api.service[121402]: X-Domain-Name: None Nov 01 18:59:52.124128 n-d-863052-2 devstack@n-api.service[121402]: X-Identity-Status: Confirmed Nov 01 18:59:52.124128 n-d-863052-2 devstack@n-api.service[121402]: X-Is-Admin-Project: True Nov 01 18:59:52.124128 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Domain-Id: default Nov 01 18:59:52.124128 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Domain-Name: Default Nov 01 18:59:52.124128 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Id: a9ef08eba0ef431285fd15a2561b4e5d Nov 01 18:59:52.124128 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Name: tempest-SecurityGroupsTestJSON-1185949800 Nov 01 18:59:52.124128 n-d-863052-2 devstack@n-api.service[121402]: X-Role: member,reader Nov 01 18:59:52.124128 n-d-863052-2 devstack@n-api.service[121402]: X-Roles: member,reader Nov 01 18:59:52.125578 n-d-863052-2 devstack@n-api.service[121402]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/a9ef08eba0ef431285fd15a2561b4e5d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/a9ef08eba0ef431285fd15a2561b4e5d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_a9ef08eba0ef431285fd15a2561b4e5d", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/a9ef08eba0ef431285fd15a2561b4e5d"}]}] Nov 01 18:59:52.125578 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant: tempest-SecurityGroupsTestJSON-1185949800 Nov 01 18:59:52.125578 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant-Id: a9ef08eba0ef431285fd15a2561b4e5d Nov 01 18:59:52.125578 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1185949800 Nov 01 18:59:52.125578 n-d-863052-2 devstack@n-api.service[121402]: X-User: tempest-SecurityGroupsTestJSON-1185949800-project Nov 01 18:59:52.125578 n-d-863052-2 devstack@n-api.service[121402]: X-User-Domain-Id: default Nov 01 18:59:52.125578 n-d-863052-2 devstack@n-api.service[121402]: X-User-Domain-Name: Default Nov 01 18:59:52.125578 n-d-863052-2 devstack@n-api.service[121402]: X-User-Id: 55a9c3b6a8c34f068caa50dc10d13a85 Nov 01 18:59:52.125578 n-d-863052-2 devstack@n-api.service[121402]: X-User-Name: tempest-SecurityGroupsTestJSON-1185949800-project Nov 01 18:59:52.125578 n-d-863052-2 devstack@n-api.service[121402]: method: Nov 01 18:59:52.125578 n-d-863052-2 devstack@n-api.service[121402]: exception: Security group c1b41ef2-7c6f-4327-8e1d-4ef5e045c3e3 does not exist Nov 01 18:59:52.125578 n-d-863052-2 devstack@n-api.service[121402]: Neutron server returns request_ids: ['req-355f1e41-ea6a-417e-86ec-ec52ab980ea1'] Nov 01 18:59:52.125578 n-d-863052-2 devstack@n-api.service[121402]: action_args: {'id': 'c1b41ef2-7c6f-4327-8e1d-4ef5e045c3e3'} Nov 01 18:59:52.126588 n-d-863052-2 devstack@n-api.service[121402]: {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 01 18:59:52.126588 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:59:52.126588 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Nov 01 18:59:52.126588 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Nov 01 18:59:52.126588 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 01 18:59:52.126588 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 01 18:59:52.126588 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Nov 01 18:59:52.126588 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Nov 01 18:59:52.126588 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 01 18:59:52.126588 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 01 18:59:52.126588 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 01 18:59:52.126588 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 01 18:59:52.126588 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 01 18:59:52.126588 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 01 18:59:52.126588 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 01 18:59:52.126588 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 01 18:59:52.126588 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 01 18:59:52.126588 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 01 18:59:52.126588 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Nov 01 18:59:52.127819 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Nov 01 18:59:52.127819 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 01 18:59:52.127819 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 01 18:59:52.127819 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Nov 01 18:59:52.127819 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Nov 01 18:59:52.127819 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Nov 01 18:59:52.127819 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Nov 01 18:59:52.127819 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group c1b41ef2-7c6f-4327-8e1d-4ef5e045c3e3 does not exist Nov 01 18:59:52.127819 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-355f1e41-ea6a-417e-86ec-ec52ab980ea1'] Nov 01 18:59:52.127819 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 18:59:52.127819 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 18:59:52.127819 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 18:59:52.127819 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:59:52.127819 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Nov 01 18:59:52.127819 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Nov 01 18:59:52.127819 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Nov 01 18:59:52.127819 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Nov 01 18:59:52.127819 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group c1b41ef2-7c6f-4327-8e1d-4ef5e045c3e3 does not exist Nov 01 18:59:52.129439 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-355f1e41-ea6a-417e-86ec-ec52ab980ea1'] Nov 01 18:59:52.129439 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 18:59:52.129439 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 18:59:52.129439 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 18:59:52.129439 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:59:52.129439 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 18:59:52.129439 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 18:59:52.129439 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 01 18:59:52.129439 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 01 18:59:52.129439 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 01 18:59:52.129439 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 01 18:59:52.129439 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 01 18:59:52.129439 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 01 18:59:52.129439 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Nov 01 18:59:52.129439 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Nov 01 18:59:52.129439 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group c1b41ef2-7c6f-4327-8e1d-4ef5e045c3e3 does not exist Nov 01 18:59:52.129439 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-355f1e41-ea6a-417e-86ec-ec52ab980ea1'] Nov 01 18:59:52.129439 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 18:59:52.129439 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 18:59:52.129439 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 18:59:52.129439 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:59:52.133219 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 18:59:52.133219 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 18:59:52.133219 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 01 18:59:52.133219 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 01 18:59:52.133219 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group c1b41ef2-7c6f-4327-8e1d-4ef5e045c3e3 does not exist Nov 01 18:59:52.133219 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-355f1e41-ea6a-417e-86ec-ec52ab980ea1'] Nov 01 18:59:52.133219 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 18:59:52.135973 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-e8357e36-c7ac-4416-9681-33825bce9a17 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Returning 404 to user: Security group c1b41ef2-7c6f-4327-8e1d-4ef5e045c3e3 does not exist Nov 01 18:59:52.135973 n-d-863052-2 devstack@n-api.service[121402]: Neutron server returns request_ids: ['req-355f1e41-ea6a-417e-86ec-ec52ab980ea1'] {{(pid=121402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 01 18:59:52.136847 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-e8357e36-c7ac-4416-9681-33825bce9a17 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] 10.222.0.13 "GET /compute/v2.1/os-security-groups/c1b41ef2-7c6f-4327-8e1d-4ef5e045c3e3" status: 404 len: 194 microversion: 2.1 time: 0.079985 Nov 01 18:59:52.137761 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 805/1566] 10.222.0.13 () {58 vars in 1269 bytes} [Tue Nov 1 18:59:52 2022] GET /compute/v2.1/os-security-groups/c1b41ef2-7c6f-4327-8e1d-4ef5e045c3e3 => generated 194 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 01 18:59:52.152219 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-13165975-1e4d-4f49-bed1-e63593c90bea tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Calling method '.version_select at 0x7f0ae1d100d0>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:59:52.397349 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-ed547a86-d538-4cd7-b79a-4f54fd355927 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72117f17294649d6b8bc16c66c7efab2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45d4c047d3c44324a27a27831236ab0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:59:52.421515 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-ed547a86-d538-4cd7-b79a-4f54fd355927 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] 10.222.0.13 "GET /compute/v2.1/servers/f6762e10-9d45-47cf-a6b6-d9bfc3404664" status: 200 len: 1472 microversion: 2.1 time: 0.380737 Nov 01 18:59:52.423821 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 762/1567] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:59:52 2022] GET /compute/v2.1/servers/f6762e10-9d45-47cf-a6b6-d9bfc3404664 => generated 1472 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:59:52.431794 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-34f84a5c-6ad6-410a-b5e7-a4245db8ba7a tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:59:52.433403 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-34f84a5c-6ad6-410a-b5e7-a4245db8ba7a tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] [instance: f35d5fdd-4a95-4b57-a506-665fa3f393c1] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:59:52.445321 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-13165975-1e4d-4f49-bed1-e63593c90bea tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] 10.222.0.13 "DELETE /compute/v2.1/os-security-groups/520f4dff-9949-45e0-8c50-c9568059c91c" status: 202 len: 0 microversion: 2.1 time: 0.302362 Nov 01 18:59:52.446316 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 806/1568] 10.222.0.13 () {58 vars in 1272 bytes} [Tue Nov 1 18:59:52 2022] DELETE /compute/v2.1/os-security-groups/520f4dff-9949-45e0-8c50-c9568059c91c => generated 0 bytes in 304 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 01 18:59:52.457989 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-c2335935-d65b-4880-b6ce-cf37a5eb2542 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Calling method '.version_select at 0x7f0ae1d75160>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:59:52.466760 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-34f84a5c-6ad6-410a-b5e7-a4245db8ba7a tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:59:52.467267 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-34f84a5c-6ad6-410a-b5e7-a4245db8ba7a tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:59:52.471232 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-34f84a5c-6ad6-410a-b5e7-a4245db8ba7a tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:59:52.473523 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-34f84a5c-6ad6-410a-b5e7-a4245db8ba7a tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:59:52.477167 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-34f84a5c-6ad6-410a-b5e7-a4245db8ba7a tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:59:52.478259 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-34f84a5c-6ad6-410a-b5e7-a4245db8ba7a tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:59:52.523545 n-d-863052-2 devstack@n-api.service[121402]: DEBUG neutronclient.v2_0.client [None req-c2335935-d65b-4880-b6ce-cf37a5eb2542 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 520f4dff-9949-45e0-8c50-c9568059c91c does not exist", "detail": ""}} {{(pid=121402) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Nov 01 18:59:52.524755 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.network.security_group_api [None req-c2335935-d65b-4880-b6ce-cf37a5eb2542 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Neutron security group 520f4dff-9949-45e0-8c50-c9568059c91c not found {{(pid=121402) get /opt/stack/nova/nova/network/security_group_api.py:313}} Nov 01 18:59:52.525339 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.wsgi [None req-c2335935-d65b-4880-b6ce-cf37a5eb2542 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] HTTP exception thrown: Security group 520f4dff-9949-45e0-8c50-c9568059c91c does not exist Nov 01 18:59:52.525339 n-d-863052-2 devstack@n-api.service[121402]: Neutron server returns request_ids: ['req-1a81702c-a884-47a3-8a4e-234eb51bf48a'] Nov 01 18:59:52.527716 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-c2335935-d65b-4880-b6ce-cf37a5eb2542 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Request method failure captured: Nov 01 18:59:52.527716 n-d-863052-2 devstack@n-api.service[121402]: request: GET /compute/v2.1/os-security-groups/520f4dff-9949-45e0-8c50-c9568059c91c HTTP/1.1 Nov 01 18:59:52.527716 n-d-863052-2 devstack@n-api.service[121402]: Accept: application/json Nov 01 18:59:52.527716 n-d-863052-2 devstack@n-api.service[121402]: Accept-Encoding: identity Nov 01 18:59:52.527716 n-d-863052-2 devstack@n-api.service[121402]: Connection: close Nov 01 18:59:52.527716 n-d-863052-2 devstack@n-api.service[121402]: Content-Length: 0 Nov 01 18:59:52.527716 n-d-863052-2 devstack@n-api.service[121402]: Content-Type: application/json Nov 01 18:59:52.527716 n-d-863052-2 devstack@n-api.service[121402]: Host: 10.222.0.13 Nov 01 18:59:52.527716 n-d-863052-2 devstack@n-api.service[121402]: Openstack-System-Scope: None Nov 01 18:59:52.527716 n-d-863052-2 devstack@n-api.service[121402]: User-Agent: python-urllib3/1.26.12 Nov 01 18:59:52.527716 n-d-863052-2 devstack@n-api.service[121402]: X-Auth-Token: gAAAAABjYWyBtiXfeZJIejT83Ksslz2hqDZRAGe29hQVddGupa2qgtVXWeGxqJACkYUk64AE7WNmKMU9sisFWqkZV1B8K0xSz0uDHshwD54pFesORYzaFN_rWLCdcUKPHyx9WACJmd6ZEeb3LBT9WzZa08oHURzA6g0G4BDfSDsuxDk4mdVs9fM Nov 01 18:59:52.527716 n-d-863052-2 devstack@n-api.service[121402]: X-Domain-Id: None Nov 01 18:59:52.527716 n-d-863052-2 devstack@n-api.service[121402]: X-Domain-Name: None Nov 01 18:59:52.527716 n-d-863052-2 devstack@n-api.service[121402]: X-Identity-Status: Confirmed Nov 01 18:59:52.527716 n-d-863052-2 devstack@n-api.service[121402]: X-Is-Admin-Project: True Nov 01 18:59:52.527716 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Domain-Id: default Nov 01 18:59:52.527716 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Domain-Name: Default Nov 01 18:59:52.527716 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Id: a9ef08eba0ef431285fd15a2561b4e5d Nov 01 18:59:52.527716 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Name: tempest-SecurityGroupsTestJSON-1185949800 Nov 01 18:59:52.527716 n-d-863052-2 devstack@n-api.service[121402]: X-Role: member,reader Nov 01 18:59:52.527716 n-d-863052-2 devstack@n-api.service[121402]: X-Roles: member,reader Nov 01 18:59:52.529543 n-d-863052-2 devstack@n-api.service[121402]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/a9ef08eba0ef431285fd15a2561b4e5d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/a9ef08eba0ef431285fd15a2561b4e5d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_a9ef08eba0ef431285fd15a2561b4e5d", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/a9ef08eba0ef431285fd15a2561b4e5d"}]}] Nov 01 18:59:52.529543 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant: tempest-SecurityGroupsTestJSON-1185949800 Nov 01 18:59:52.529543 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant-Id: a9ef08eba0ef431285fd15a2561b4e5d Nov 01 18:59:52.529543 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1185949800 Nov 01 18:59:52.529543 n-d-863052-2 devstack@n-api.service[121402]: X-User: tempest-SecurityGroupsTestJSON-1185949800-project Nov 01 18:59:52.529543 n-d-863052-2 devstack@n-api.service[121402]: X-User-Domain-Id: default Nov 01 18:59:52.529543 n-d-863052-2 devstack@n-api.service[121402]: X-User-Domain-Name: Default Nov 01 18:59:52.529543 n-d-863052-2 devstack@n-api.service[121402]: X-User-Id: 55a9c3b6a8c34f068caa50dc10d13a85 Nov 01 18:59:52.529543 n-d-863052-2 devstack@n-api.service[121402]: X-User-Name: tempest-SecurityGroupsTestJSON-1185949800-project Nov 01 18:59:52.529543 n-d-863052-2 devstack@n-api.service[121402]: method: Nov 01 18:59:52.529543 n-d-863052-2 devstack@n-api.service[121402]: exception: Security group 520f4dff-9949-45e0-8c50-c9568059c91c does not exist Nov 01 18:59:52.529543 n-d-863052-2 devstack@n-api.service[121402]: Neutron server returns request_ids: ['req-1a81702c-a884-47a3-8a4e-234eb51bf48a'] Nov 01 18:59:52.529543 n-d-863052-2 devstack@n-api.service[121402]: action_args: {'id': '520f4dff-9949-45e0-8c50-c9568059c91c'} Nov 01 18:59:52.530567 n-d-863052-2 devstack@n-api.service[121402]: {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 01 18:59:52.530567 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:59:52.530567 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Nov 01 18:59:52.530567 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Nov 01 18:59:52.530567 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 01 18:59:52.530567 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 01 18:59:52.530567 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Nov 01 18:59:52.530567 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Nov 01 18:59:52.530567 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 01 18:59:52.530567 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 01 18:59:52.530567 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 01 18:59:52.530567 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 01 18:59:52.530567 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 01 18:59:52.530567 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 01 18:59:52.530567 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 01 18:59:52.530567 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 01 18:59:52.530567 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 01 18:59:52.530567 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 01 18:59:52.530567 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Nov 01 18:59:52.531991 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Nov 01 18:59:52.531991 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 01 18:59:52.531991 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 01 18:59:52.531991 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Nov 01 18:59:52.531991 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Nov 01 18:59:52.531991 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Nov 01 18:59:52.531991 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Nov 01 18:59:52.531991 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 520f4dff-9949-45e0-8c50-c9568059c91c does not exist Nov 01 18:59:52.531991 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1a81702c-a884-47a3-8a4e-234eb51bf48a'] Nov 01 18:59:52.531991 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 18:59:52.531991 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 18:59:52.531991 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 18:59:52.531991 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:59:52.531991 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Nov 01 18:59:52.531991 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Nov 01 18:59:52.531991 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Nov 01 18:59:52.531991 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Nov 01 18:59:52.531991 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 520f4dff-9949-45e0-8c50-c9568059c91c does not exist Nov 01 18:59:52.533362 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1a81702c-a884-47a3-8a4e-234eb51bf48a'] Nov 01 18:59:52.533362 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 18:59:52.533362 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 18:59:52.533362 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 18:59:52.533362 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:59:52.533362 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 18:59:52.533362 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 18:59:52.533362 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 01 18:59:52.533362 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 01 18:59:52.533362 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 01 18:59:52.533362 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 01 18:59:52.533362 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 01 18:59:52.533362 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 01 18:59:52.533362 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Nov 01 18:59:52.533362 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Nov 01 18:59:52.533362 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 520f4dff-9949-45e0-8c50-c9568059c91c does not exist Nov 01 18:59:52.533362 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1a81702c-a884-47a3-8a4e-234eb51bf48a'] Nov 01 18:59:52.533362 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 18:59:52.533362 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 18:59:52.533362 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 18:59:52.533362 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 18:59:52.535554 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 18:59:52.535554 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 18:59:52.535554 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 01 18:59:52.535554 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 01 18:59:52.535554 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 520f4dff-9949-45e0-8c50-c9568059c91c does not exist Nov 01 18:59:52.535554 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1a81702c-a884-47a3-8a4e-234eb51bf48a'] Nov 01 18:59:52.535554 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 18:59:52.535554 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-c2335935-d65b-4880-b6ce-cf37a5eb2542 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Returning 404 to user: Security group 520f4dff-9949-45e0-8c50-c9568059c91c does not exist Nov 01 18:59:52.535554 n-d-863052-2 devstack@n-api.service[121402]: Neutron server returns request_ids: ['req-1a81702c-a884-47a3-8a4e-234eb51bf48a'] {{(pid=121402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 01 18:59:52.535554 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-c2335935-d65b-4880-b6ce-cf37a5eb2542 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] 10.222.0.13 "GET /compute/v2.1/os-security-groups/520f4dff-9949-45e0-8c50-c9568059c91c" status: 404 len: 194 microversion: 2.1 time: 0.077390 Nov 01 18:59:52.535554 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 807/1569] 10.222.0.13 () {58 vars in 1269 bytes} [Tue Nov 1 18:59:52 2022] GET /compute/v2.1/os-security-groups/520f4dff-9949-45e0-8c50-c9568059c91c => generated 194 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 01 18:59:52.549603 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-7cacf04a-31f3-4053-8e8b-c25ec63d5b6d tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Calling method '.version_select at 0x7f0ae1d5b550>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:59:52.766871 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-34f84a5c-6ad6-410a-b5e7-a4245db8ba7a tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0290a6bb8bc24b8988a925327ac0381c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86941784237549838bba63ce88053b88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:59:52.786347 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-34f84a5c-6ad6-410a-b5e7-a4245db8ba7a tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] 10.222.0.13 "GET /compute/v2.1/servers/f35d5fdd-4a95-4b57-a506-665fa3f393c1" status: 200 len: 1317 microversion: 2.1 time: 0.357688 Nov 01 18:59:52.786995 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 763/1570] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:59:52 2022] GET /compute/v2.1/servers/f35d5fdd-4a95-4b57-a506-665fa3f393c1 => generated 1317 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:59:52.802212 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-b591a527-8605-473b-90a5-f42b2047d051 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:59:52.805059 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-b591a527-8605-473b-90a5-f42b2047d051 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] [instance: a7f88d19-08ee-47bf-9240-7d49afd775e2] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:59:52.833564 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-b591a527-8605-473b-90a5-f42b2047d051 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:59:52.834348 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-b591a527-8605-473b-90a5-f42b2047d051 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:59:52.834969 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-b591a527-8605-473b-90a5-f42b2047d051 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:59:52.837904 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-b591a527-8605-473b-90a5-f42b2047d051 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:59:52.839897 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-b591a527-8605-473b-90a5-f42b2047d051 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:59:52.840903 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-b591a527-8605-473b-90a5-f42b2047d051 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:59:52.859281 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-7cacf04a-31f3-4053-8e8b-c25ec63d5b6d tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] 10.222.0.13 "GET /compute/v2.1/os-security-groups" status: 200 len: 1156 microversion: 2.1 time: 0.323837 Nov 01 18:59:52.860799 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 808/1571] 10.222.0.13 () {58 vars in 1158 bytes} [Tue Nov 1 18:59:52 2022] GET /compute/v2.1/os-security-groups => generated 1156 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:59:52.880572 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-eb6693e6-00a2-4a19-a8b0-eb211fabd1b4 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Action: 'create', calling method: .version_select at 0x7f0ae1da1280>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-942925666", "description": "tempest-description-1074931004"}} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 18:59:53.188882 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-eb6693e6-00a2-4a19-a8b0-eb211fabd1b4 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] 10.222.0.13 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.311408 Nov 01 18:59:53.191083 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 809/1572] 10.222.0.13 () {60 vars in 1180 bytes} [Tue Nov 1 18:59:52 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 18:59:53.193840 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-b591a527-8605-473b-90a5-f42b2047d051 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:59:53.197551 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-05d73df3-5ecc-49c6-a408-d956dc033e41 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:59:53.199685 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-05d73df3-5ecc-49c6-a408-d956dc033e41 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] [instance: 90b353ab-ef97-4d88-b5bc-b355ff576225] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:59:53.209681 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-b591a527-8605-473b-90a5-f42b2047d051 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:59:53.211262 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-05d73df3-5ecc-49c6-a408-d956dc033e41 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:59:53.211954 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-05d73df3-5ecc-49c6-a408-d956dc033e41 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:59:53.213104 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-05d73df3-5ecc-49c6-a408-d956dc033e41 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:59:53.214712 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-05d73df3-5ecc-49c6-a408-d956dc033e41 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:59:53.216026 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-05d73df3-5ecc-49c6-a408-d956dc033e41 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:59:53.216179 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-b591a527-8605-473b-90a5-f42b2047d051 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:59:53.216854 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-05d73df3-5ecc-49c6-a408-d956dc033e41 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:59:53.217341 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-b591a527-8605-473b-90a5-f42b2047d051 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] 10.222.0.13 "GET /compute/v2.1/servers/a7f88d19-08ee-47bf-9240-7d49afd775e2" status: 200 len: 1812 microversion: 2.25 time: 0.427410 Nov 01 18:59:53.225175 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 764/1573] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 18:59:52 2022] GET /compute/v2.1/servers/a7f88d19-08ee-47bf-9240-7d49afd775e2 => generated 1812 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 18:59:53.225175 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-404a3dca-8616-45a0-a948-0a655f38d2d1 tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] Calling method '.version_select at 0x7f0ae68f1160>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:59:53.282762 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-404a3dca-8616-45a0-a948-0a655f38d2d1 tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] 10.222.0.13 "GET /compute/v2.1/images/14008a7c-6542-4124-800d-d352127c1bb1" status: 200 len: 1454 microversion: 2.1 time: 0.063320 Nov 01 18:59:53.283352 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 765/1574] 10.222.0.13 () {58 vars in 1233 bytes} [Tue Nov 1 18:59:53 2022] GET /compute/v2.1/images/14008a7c-6542-4124-800d-d352127c1bb1 => generated 1454 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:59:53.300477 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-85b33131-85ed-4166-95dd-929da06e387d tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Action: 'create', calling method: .version_select at 0x7f0ae68ec9d0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1109659499", "description": "tempest-description-1640519371"}} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 18:59:53.350141 n-d-863052-2 devstack@n-api.service[121402]: DEBUG dbcounter [-] [121402] Writing DB stats nova_cell0:SELECT=4 {{(pid=121402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 18:59:53.409238 n-d-863052-2 devstack@n-api.service[121402]: DEBUG dbcounter [-] [121402] Writing DB stats nova_cell0:SELECT=16 {{(pid=121402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 18:59:53.462392 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-05d73df3-5ecc-49c6-a408-d956dc033e41 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a63d69c99a546f0af16329cff3ca717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a1bb191cff948e99c008b5e861ce4a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:59:53.476714 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-05d73df3-5ecc-49c6-a408-d956dc033e41 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] 10.222.0.13 "GET /compute/v2.1/servers/90b353ab-ef97-4d88-b5bc-b355ff576225" status: 200 len: 1371 microversion: 2.1 time: 0.282100 Nov 01 18:59:53.480857 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 810/1575] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:59:53 2022] GET /compute/v2.1/servers/90b353ab-ef97-4d88-b5bc-b355ff576225 => generated 1371 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:59:53.493841 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-eb0a19e8-d771-4464-afd6-c0e800205aed tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:59:53.494457 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-eb0a19e8-d771-4464-afd6-c0e800205aed tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] [instance: f6762e10-9d45-47cf-a6b6-d9bfc3404664] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:59:53.519972 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-eb0a19e8-d771-4464-afd6-c0e800205aed tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:59:53.520468 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-eb0a19e8-d771-4464-afd6-c0e800205aed tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:59:53.523100 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-eb0a19e8-d771-4464-afd6-c0e800205aed tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:59:53.523942 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-eb0a19e8-d771-4464-afd6-c0e800205aed tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:59:53.524663 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-eb0a19e8-d771-4464-afd6-c0e800205aed tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:59:53.532186 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-eb0a19e8-d771-4464-afd6-c0e800205aed tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:59:54.025477 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-eb0a19e8-d771-4464-afd6-c0e800205aed tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72117f17294649d6b8bc16c66c7efab2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45d4c047d3c44324a27a27831236ab0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:59:54.042275 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-eb0a19e8-d771-4464-afd6-c0e800205aed tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] 10.222.0.13 "GET /compute/v2.1/servers/f6762e10-9d45-47cf-a6b6-d9bfc3404664" status: 200 len: 1472 microversion: 2.1 time: 0.558025 Nov 01 18:59:54.043485 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 811/1576] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:59:53 2022] GET /compute/v2.1/servers/f6762e10-9d45-47cf-a6b6-d9bfc3404664 => generated 1472 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:59:54.083595 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-ba1cc5b2-190e-404a-b339-3e31dccc3234 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:59:54.085459 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-ba1cc5b2-190e-404a-b339-3e31dccc3234 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] [instance: f35d5fdd-4a95-4b57-a506-665fa3f393c1] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:59:54.094971 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-ba1cc5b2-190e-404a-b339-3e31dccc3234 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:59:54.095506 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-ba1cc5b2-190e-404a-b339-3e31dccc3234 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:59:54.095933 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-ba1cc5b2-190e-404a-b339-3e31dccc3234 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:59:54.096956 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-ba1cc5b2-190e-404a-b339-3e31dccc3234 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:59:54.097570 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-ba1cc5b2-190e-404a-b339-3e31dccc3234 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:59:54.099991 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-ba1cc5b2-190e-404a-b339-3e31dccc3234 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:59:54.237238 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-85b33131-85ed-4166-95dd-929da06e387d tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] 10.222.0.13 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 0.952709 Nov 01 18:59:54.239230 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 766/1577] 10.222.0.13 () {60 vars in 1180 bytes} [Tue Nov 1 18:59:53 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 955 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 18:59:54.249331 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-3b7596af-d114-4394-9bd4-da6e0cfccb7b tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:59:54.250197 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-3b7596af-d114-4394-9bd4-da6e0cfccb7b tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] [instance: a7f88d19-08ee-47bf-9240-7d49afd775e2] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:59:54.268375 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-3b7596af-d114-4394-9bd4-da6e0cfccb7b tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:59:54.276856 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-3b7596af-d114-4394-9bd4-da6e0cfccb7b tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:59:54.277905 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-3b7596af-d114-4394-9bd4-da6e0cfccb7b tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:59:54.279392 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-3b7596af-d114-4394-9bd4-da6e0cfccb7b tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:59:54.280021 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-3b7596af-d114-4394-9bd4-da6e0cfccb7b tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:59:54.280641 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-3b7596af-d114-4394-9bd4-da6e0cfccb7b tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:59:54.529887 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-ba1cc5b2-190e-404a-b339-3e31dccc3234 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0290a6bb8bc24b8988a925327ac0381c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86941784237549838bba63ce88053b88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:59:54.542846 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-ba1cc5b2-190e-404a-b339-3e31dccc3234 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] 10.222.0.13 "GET /compute/v2.1/servers/f35d5fdd-4a95-4b57-a506-665fa3f393c1" status: 200 len: 1317 microversion: 2.1 time: 0.478558 Nov 01 18:59:54.543468 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 812/1578] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:59:54 2022] GET /compute/v2.1/servers/f35d5fdd-4a95-4b57-a506-665fa3f393c1 => generated 1317 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:59:54.553240 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-686f348b-b593-475b-a7c2-82dfd4143c83 tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] Calling method '.version_select at 0x7f0ae1d095e0>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:59:54.632656 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-3b7596af-d114-4394-9bd4-da6e0cfccb7b tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:59:54.632791 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-686f348b-b593-475b-a7c2-82dfd4143c83 tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] 10.222.0.13 "GET /compute/v2.1/images/14008a7c-6542-4124-800d-d352127c1bb1" status: 200 len: 1454 microversion: 2.1 time: 0.085668 Nov 01 18:59:54.632791 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 813/1579] 10.222.0.13 () {58 vars in 1233 bytes} [Tue Nov 1 18:59:54 2022] GET /compute/v2.1/images/14008a7c-6542-4124-800d-d352127c1bb1 => generated 1454 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:59:54.636447 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-21dd7b0a-9a21-4e4e-b5d5-83d14e408459 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-522915641", "imageRef": "2d4a0047-1b9e-445f-8af8-1b5c9d93e881", "flavorRef": "452", "networks": [{"uuid": "18661d90-d433-474a-b0e5-f9a4e975f896"}]}} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 18:59:54.655279 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-3b7596af-d114-4394-9bd4-da6e0cfccb7b tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:59:54.656997 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-3b7596af-d114-4394-9bd4-da6e0cfccb7b tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:59:54.658322 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-3b7596af-d114-4394-9bd4-da6e0cfccb7b tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] 10.222.0.13 "GET /compute/v2.1/servers/a7f88d19-08ee-47bf-9240-7d49afd775e2" status: 200 len: 1812 microversion: 2.25 time: 0.413101 Nov 01 18:59:54.659396 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 767/1580] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 18:59:54 2022] GET /compute/v2.1/servers/a7f88d19-08ee-47bf-9240-7d49afd775e2 => generated 1812 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 18:59:54.681982 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-89bdeb9e-406b-4503-bf64-c94c3c6a7957 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:59:54.682637 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-89bdeb9e-406b-4503-bf64-c94c3c6a7957 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] [instance: 90b353ab-ef97-4d88-b5bc-b355ff576225] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:59:54.690502 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-89bdeb9e-406b-4503-bf64-c94c3c6a7957 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:59:54.691123 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-89bdeb9e-406b-4503-bf64-c94c3c6a7957 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:59:54.691581 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-89bdeb9e-406b-4503-bf64-c94c3c6a7957 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:59:54.692332 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-89bdeb9e-406b-4503-bf64-c94c3c6a7957 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:59:54.692849 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-89bdeb9e-406b-4503-bf64-c94c3c6a7957 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:59:54.693303 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-89bdeb9e-406b-4503-bf64-c94c3c6a7957 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:59:54.717441 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.network.neutron [None req-21dd7b0a-9a21-4e4e-b5d5-83d14e408459 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] validate_networks() for [('18661d90-d433-474a-b0e5-f9a4e975f896', None, None, None, None, None)] {{(pid=121402) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 01 18:59:54.876502 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-89bdeb9e-406b-4503-bf64-c94c3c6a7957 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a63d69c99a546f0af16329cff3ca717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a1bb191cff948e99c008b5e861ce4a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:59:54.884836 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-89bdeb9e-406b-4503-bf64-c94c3c6a7957 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] 10.222.0.13 "GET /compute/v2.1/servers/90b353ab-ef97-4d88-b5bc-b355ff576225" status: 200 len: 1371 microversion: 2.1 time: 0.214806 Nov 01 18:59:54.885450 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 768/1581] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:59:54 2022] GET /compute/v2.1/servers/90b353ab-ef97-4d88-b5bc-b355ff576225 => generated 1371 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:59:54.896035 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-9f333e80-60c4-42bc-b0e3-98589de43683 tempest-ServersTestFqdnHostnames-269349818 tempest-ServersTestFqdnHostnames-269349818-project] Action: 'create', calling method: >, body: {"server": {"name": "guest-instance-1.domain.com", "imageRef": "2d4a0047-1b9e-445f-8af8-1b5c9d93e881", "flavorRef": "452", "adminPass": "***", "accessIPv4": "2.2.2.2", "networks": [{"uuid": "f10f8ea4-ce0f-45ad-af59-64566d944bca"}], "security_groups": [{"name": "tempest-securitygroup--1402933553"}], "key_name": "tempest-keypair-1693802313", "user_data": "}} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 18:59:55.035565 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.network.neutron [None req-9f333e80-60c4-42bc-b0e3-98589de43683 tempest-ServersTestFqdnHostnames-269349818 tempest-ServersTestFqdnHostnames-269349818-project] validate_networks() for [('f10f8ea4-ce0f-45ad-af59-64566d944bca', None, None, None, None, None)] {{(pid=121403) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 01 18:59:55.351327 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.virt.hardware [None req-21dd7b0a-9a21-4e4e-b5d5-83d14e408459 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Flavor limits 0:0:0 {{(pid=121402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 01 18:59:55.351747 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.virt.hardware [None req-21dd7b0a-9a21-4e4e-b5d5-83d14e408459 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Image limits 0:0:0 {{(pid=121402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 01 18:59:55.352220 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.virt.hardware [None req-21dd7b0a-9a21-4e4e-b5d5-83d14e408459 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Flavor pref 0:0:0 {{(pid=121402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 01 18:59:55.352682 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.virt.hardware [None req-21dd7b0a-9a21-4e4e-b5d5-83d14e408459 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Image pref 0:0:0 {{(pid=121402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 01 18:59:55.353377 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.virt.hardware [None req-21dd7b0a-9a21-4e4e-b5d5-83d14e408459 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 01 18:59:55.373020 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-21dd7b0a-9a21-4e4e-b5d5-83d14e408459 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:59:55.373491 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-21dd7b0a-9a21-4e4e-b5d5-83d14e408459 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:59:55.374368 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-21dd7b0a-9a21-4e4e-b5d5-83d14e408459 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:59:55.376416 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-21dd7b0a-9a21-4e4e-b5d5-83d14e408459 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:59:55.377261 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-21dd7b0a-9a21-4e4e-b5d5-83d14e408459 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:59:55.377699 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-21dd7b0a-9a21-4e4e-b5d5-83d14e408459 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:59:55.409289 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.quota [None req-21dd7b0a-9a21-4e4e-b5d5-83d14e408459 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Getting quotas for project a9ef08eba0ef431285fd15a2561b4e5d. Resources: {'cores', 'ram', 'instances'} {{(pid=121402) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 01 18:59:55.414544 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.quota [None req-21dd7b0a-9a21-4e4e-b5d5-83d14e408459 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Getting quotas for user 55a9c3b6a8c34f068caa50dc10d13a85 and project a9ef08eba0ef431285fd15a2561b4e5d. Resources: {'cores', 'ram', 'instances'} {{(pid=121402) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 01 18:59:55.427873 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-21dd7b0a-9a21-4e4e-b5d5-83d14e408459 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Going to run 1 instances... {{(pid=121402) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 01 18:59:55.430210 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-21dd7b0a-9a21-4e4e-b5d5-83d14e408459 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] [instance: 68b54f50-6b4d-4ea3-877f-c7ac79a5bb86] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2d4a0047-1b9e-445f-8af8-1b5c9d93e881',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121402) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 01 18:59:55.483413 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-21dd7b0a-9a21-4e4e-b5d5-83d14e408459 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.850865 Nov 01 18:59:55.484485 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 814/1582] 10.222.0.13 () {60 vars in 1147 bytes} [Tue Nov 1 18:59:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 852 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 01 18:59:55.489236 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-4f5f71d1-24dd-44b1-b965-34cd07fceecf tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:59:55.490147 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-4f5f71d1-24dd-44b1-b965-34cd07fceecf tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] [instance: f6762e10-9d45-47cf-a6b6-d9bfc3404664] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:59:55.497233 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-4f5f71d1-24dd-44b1-b965-34cd07fceecf tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:59:55.497828 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-4f5f71d1-24dd-44b1-b965-34cd07fceecf tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:59:55.498334 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-4f5f71d1-24dd-44b1-b965-34cd07fceecf tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:59:55.499161 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-4f5f71d1-24dd-44b1-b965-34cd07fceecf tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:59:55.499693 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-4f5f71d1-24dd-44b1-b965-34cd07fceecf tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:59:55.500329 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-4f5f71d1-24dd-44b1-b965-34cd07fceecf tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:59:55.579053 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.virt.hardware [None req-9f333e80-60c4-42bc-b0e3-98589de43683 tempest-ServersTestFqdnHostnames-269349818 tempest-ServersTestFqdnHostnames-269349818-project] Flavor limits 0:0:0 {{(pid=121403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 01 18:59:55.579740 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.virt.hardware [None req-9f333e80-60c4-42bc-b0e3-98589de43683 tempest-ServersTestFqdnHostnames-269349818 tempest-ServersTestFqdnHostnames-269349818-project] Image limits 0:0:0 {{(pid=121403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 01 18:59:55.579850 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.virt.hardware [None req-9f333e80-60c4-42bc-b0e3-98589de43683 tempest-ServersTestFqdnHostnames-269349818 tempest-ServersTestFqdnHostnames-269349818-project] Flavor pref 0:0:0 {{(pid=121403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 01 18:59:55.580239 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.virt.hardware [None req-9f333e80-60c4-42bc-b0e3-98589de43683 tempest-ServersTestFqdnHostnames-269349818 tempest-ServersTestFqdnHostnames-269349818-project] Image pref 0:0:0 {{(pid=121403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 01 18:59:55.580670 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.virt.hardware [None req-9f333e80-60c4-42bc-b0e3-98589de43683 tempest-ServersTestFqdnHostnames-269349818 tempest-ServersTestFqdnHostnames-269349818-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 01 18:59:55.591796 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-9f333e80-60c4-42bc-b0e3-98589de43683 tempest-ServersTestFqdnHostnames-269349818 tempest-ServersTestFqdnHostnames-269349818-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:59:55.592387 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-9f333e80-60c4-42bc-b0e3-98589de43683 tempest-ServersTestFqdnHostnames-269349818 tempest-ServersTestFqdnHostnames-269349818-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:59:55.592946 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-9f333e80-60c4-42bc-b0e3-98589de43683 tempest-ServersTestFqdnHostnames-269349818 tempest-ServersTestFqdnHostnames-269349818-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:59:55.593770 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-9f333e80-60c4-42bc-b0e3-98589de43683 tempest-ServersTestFqdnHostnames-269349818 tempest-ServersTestFqdnHostnames-269349818-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:59:55.594343 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-9f333e80-60c4-42bc-b0e3-98589de43683 tempest-ServersTestFqdnHostnames-269349818 tempest-ServersTestFqdnHostnames-269349818-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:59:55.594870 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-9f333e80-60c4-42bc-b0e3-98589de43683 tempest-ServersTestFqdnHostnames-269349818 tempest-ServersTestFqdnHostnames-269349818-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:59:55.616796 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.quota [None req-9f333e80-60c4-42bc-b0e3-98589de43683 tempest-ServersTestFqdnHostnames-269349818 tempest-ServersTestFqdnHostnames-269349818-project] Getting quotas for project cfea57f34b844c77b22619105249d08a. Resources: {'cores', 'ram', 'instances'} {{(pid=121403) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 01 18:59:55.622804 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.quota [None req-9f333e80-60c4-42bc-b0e3-98589de43683 tempest-ServersTestFqdnHostnames-269349818 tempest-ServersTestFqdnHostnames-269349818-project] Getting quotas for user 3d33ca3478b7455dad5094afee57c8b2 and project cfea57f34b844c77b22619105249d08a. Resources: {'cores', 'ram', 'instances'} {{(pid=121403) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 01 18:59:55.637320 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-9f333e80-60c4-42bc-b0e3-98589de43683 tempest-ServersTestFqdnHostnames-269349818 tempest-ServersTestFqdnHostnames-269349818-project] Going to run 1 instances... {{(pid=121403) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 01 18:59:55.640770 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-9f333e80-60c4-42bc-b0e3-98589de43683 tempest-ServersTestFqdnHostnames-269349818 tempest-ServersTestFqdnHostnames-269349818-project] [instance: 04443e90-21e9-4b5e-99e8-350f07e4ea82] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2d4a0047-1b9e-445f-8af8-1b5c9d93e881',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121403) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 01 18:59:55.675014 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-4f5f71d1-24dd-44b1-b965-34cd07fceecf tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72117f17294649d6b8bc16c66c7efab2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45d4c047d3c44324a27a27831236ab0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:59:55.688062 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-4f5f71d1-24dd-44b1-b965-34cd07fceecf tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] 10.222.0.13 "GET /compute/v2.1/servers/f6762e10-9d45-47cf-a6b6-d9bfc3404664" status: 200 len: 1472 microversion: 2.1 time: 0.202200 Nov 01 18:59:55.688862 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 815/1583] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:59:55 2022] GET /compute/v2.1/servers/f6762e10-9d45-47cf-a6b6-d9bfc3404664 => generated 1472 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:59:55.706618 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-9f333e80-60c4-42bc-b0e3-98589de43683 tempest-ServersTestFqdnHostnames-269349818 tempest-ServersTestFqdnHostnames-269349818-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 0.815380 Nov 01 18:59:55.707662 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 769/1584] 10.222.0.13 () {60 vars in 1147 bytes} [Tue Nov 1 18:59:54 2022] POST /compute/v2.1/servers => generated 409 bytes in 817 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 01 18:59:55.713940 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-9abf829e-9d3d-44f1-a9c7-b25b5eeba6ea tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:59:55.714630 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-9abf829e-9d3d-44f1-a9c7-b25b5eeba6ea tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] [instance: 68b54f50-6b4d-4ea3-877f-c7ac79a5bb86] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:59:55.782450 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [req-523d5a9e-ab81-4e2a-a858-f70795ac150a req-faeb9f14-b594-499e-9b92-98dbe605a85a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "90b353ab-ef97-4d88-b5bc-b355ff576225", "name": "network-vif-plugged", "status": "completed", "tag": "773bb149-e7e8-4592-bede-bd40ac6e3e49"}]} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 18:59:55.795187 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-9abf829e-9d3d-44f1-a9c7-b25b5eeba6ea tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a9c3b6a8c34f068caa50dc10d13a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9ef08eba0ef431285fd15a2561b4e5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:59:55.804110 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-9abf829e-9d3d-44f1-a9c7-b25b5eeba6ea tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] 10.222.0.13 "GET /compute/v2.1/servers/68b54f50-6b4d-4ea3-877f-c7ac79a5bb86" status: 200 len: 1215 microversion: 2.1 time: 0.094727 Nov 01 18:59:55.820112 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 770/1585] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:59:55 2022] GET /compute/v2.1/servers/68b54f50-6b4d-4ea3-877f-c7ac79a5bb86 => generated 1215 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:59:55.820643 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-523d5a9e-ab81-4e2a-a858-f70795ac150a req-faeb9f14-b594-499e-9b92-98dbe605a85a service nova] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:59:55.820643 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-523d5a9e-ab81-4e2a-a858-f70795ac150a req-faeb9f14-b594-499e-9b92-98dbe605a85a service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:59:55.820643 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-523d5a9e-ab81-4e2a-a858-f70795ac150a req-faeb9f14-b594-499e-9b92-98dbe605a85a service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:59:55.820880 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-b5fbd32e-c75e-47d0-9400-bcde2884c0b2 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:59:55.820880 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-b5fbd32e-c75e-47d0-9400-bcde2884c0b2 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] [instance: f35d5fdd-4a95-4b57-a506-665fa3f393c1] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:59:55.830963 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-b5fbd32e-c75e-47d0-9400-bcde2884c0b2 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:59:55.831414 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-b5fbd32e-c75e-47d0-9400-bcde2884c0b2 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:59:55.832698 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-b5fbd32e-c75e-47d0-9400-bcde2884c0b2 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:59:55.833468 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-b5fbd32e-c75e-47d0-9400-bcde2884c0b2 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:59:55.835797 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-b5fbd32e-c75e-47d0-9400-bcde2884c0b2 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:59:55.836282 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-b5fbd32e-c75e-47d0-9400-bcde2884c0b2 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:59:55.848550 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.compute.server_external_events [req-523d5a9e-ab81-4e2a-a858-f70795ac150a req-faeb9f14-b594-499e-9b92-98dbe605a85a service nova] Creating event network-vif-plugged:773bb149-e7e8-4592-bede-bd40ac6e3e49 for instance 90b353ab-ef97-4d88-b5bc-b355ff576225 on n-h1-863052-2 Nov 01 18:59:55.862714 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [req-523d5a9e-ab81-4e2a-a858-f70795ac150a req-faeb9f14-b594-499e-9b92-98dbe605a85a service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.172133 Nov 01 18:59:55.868613 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 816/1586] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Nov 1 18:59:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 18:59:55.882154 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-6a259fda-76c4-4f72-aa65-2dadea676b21 tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] Calling method '.version_select at 0x7f0ae1cd6ee0>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:59:55.959734 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-6a259fda-76c4-4f72-aa65-2dadea676b21 tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] 10.222.0.13 "GET /compute/v2.1/images/14008a7c-6542-4124-800d-d352127c1bb1" status: 200 len: 1454 microversion: 2.1 time: 0.089624 Nov 01 18:59:55.964154 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 817/1587] 10.222.0.13 () {58 vars in 1233 bytes} [Tue Nov 1 18:59:55 2022] GET /compute/v2.1/images/14008a7c-6542-4124-800d-d352127c1bb1 => generated 1454 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:59:55.974369 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-a39c856c-d91b-48d3-874c-8247fafc33af tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:59:55.977270 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-a39c856c-d91b-48d3-874c-8247fafc33af tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] [instance: a7f88d19-08ee-47bf-9240-7d49afd775e2] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:59:56.004055 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-a39c856c-d91b-48d3-874c-8247fafc33af tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:59:56.006669 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-a39c856c-d91b-48d3-874c-8247fafc33af tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:59:56.007362 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-a39c856c-d91b-48d3-874c-8247fafc33af tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:59:56.011234 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-a39c856c-d91b-48d3-874c-8247fafc33af tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:59:56.013612 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-a39c856c-d91b-48d3-874c-8247fafc33af tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:59:56.014643 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-a39c856c-d91b-48d3-874c-8247fafc33af tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:59:56.067785 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-b5fbd32e-c75e-47d0-9400-bcde2884c0b2 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0290a6bb8bc24b8988a925327ac0381c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86941784237549838bba63ce88053b88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:59:56.079596 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-b5fbd32e-c75e-47d0-9400-bcde2884c0b2 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] 10.222.0.13 "GET /compute/v2.1/servers/f35d5fdd-4a95-4b57-a506-665fa3f393c1" status: 200 len: 1317 microversion: 2.1 time: 0.271678 Nov 01 18:59:56.080327 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 771/1588] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:59:55 2022] GET /compute/v2.1/servers/f35d5fdd-4a95-4b57-a506-665fa3f393c1 => generated 1317 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:59:56.086209 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-63eb21a1-b0a5-4774-9639-02d3f6cdf756 tempest-ServersTestFqdnHostnames-269349818 tempest-ServersTestFqdnHostnames-269349818-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:59:56.086945 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-63eb21a1-b0a5-4774-9639-02d3f6cdf756 tempest-ServersTestFqdnHostnames-269349818 tempest-ServersTestFqdnHostnames-269349818-project] [instance: 04443e90-21e9-4b5e-99e8-350f07e4ea82] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:59:56.163201 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-63eb21a1-b0a5-4774-9639-02d3f6cdf756 tempest-ServersTestFqdnHostnames-269349818 tempest-ServersTestFqdnHostnames-269349818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d33ca3478b7455dad5094afee57c8b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfea57f34b844c77b22619105249d08a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:59:56.171487 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-63eb21a1-b0a5-4774-9639-02d3f6cdf756 tempest-ServersTestFqdnHostnames-269349818 tempest-ServersTestFqdnHostnames-269349818-project] 10.222.0.13 "GET /compute/v2.1/servers/04443e90-21e9-4b5e-99e8-350f07e4ea82" status: 200 len: 1226 microversion: 2.1 time: 0.089652 Nov 01 18:59:56.172457 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 772/1589] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:59:56 2022] GET /compute/v2.1/servers/04443e90-21e9-4b5e-99e8-350f07e4ea82 => generated 1226 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:59:56.178629 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-038fd7ab-0e97-476f-b3ad-5b0bcf83cf1c tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:59:56.179281 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-038fd7ab-0e97-476f-b3ad-5b0bcf83cf1c tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] [instance: 90b353ab-ef97-4d88-b5bc-b355ff576225] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:59:56.185987 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-038fd7ab-0e97-476f-b3ad-5b0bcf83cf1c tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:59:56.186691 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-038fd7ab-0e97-476f-b3ad-5b0bcf83cf1c tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:59:56.187388 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-038fd7ab-0e97-476f-b3ad-5b0bcf83cf1c tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:59:56.188102 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-038fd7ab-0e97-476f-b3ad-5b0bcf83cf1c tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:59:56.188802 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-038fd7ab-0e97-476f-b3ad-5b0bcf83cf1c tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:59:56.189452 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-038fd7ab-0e97-476f-b3ad-5b0bcf83cf1c tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:59:56.252446 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-a39c856c-d91b-48d3-874c-8247fafc33af tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:59:56.265670 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-a39c856c-d91b-48d3-874c-8247fafc33af tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:59:56.268032 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-a39c856c-d91b-48d3-874c-8247fafc33af tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:59:56.269946 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-a39c856c-d91b-48d3-874c-8247fafc33af tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] 10.222.0.13 "GET /compute/v2.1/servers/a7f88d19-08ee-47bf-9240-7d49afd775e2" status: 200 len: 1812 microversion: 2.25 time: 0.304774 Nov 01 18:59:56.271633 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 818/1590] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 18:59:55 2022] GET /compute/v2.1/servers/a7f88d19-08ee-47bf-9240-7d49afd775e2 => generated 1812 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 18:59:56.427187 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-038fd7ab-0e97-476f-b3ad-5b0bcf83cf1c tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a63d69c99a546f0af16329cff3ca717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a1bb191cff948e99c008b5e861ce4a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:59:56.448891 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-038fd7ab-0e97-476f-b3ad-5b0bcf83cf1c tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] 10.222.0.13 "GET /compute/v2.1/servers/90b353ab-ef97-4d88-b5bc-b355ff576225" status: 200 len: 1371 microversion: 2.1 time: 0.274364 Nov 01 18:59:56.450290 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 773/1591] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:59:56 2022] GET /compute/v2.1/servers/90b353ab-ef97-4d88-b5bc-b355ff576225 => generated 1371 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:59:56.711993 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-59326428-d0e6-4a72-9881-67086477a060 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:59:56.712617 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-59326428-d0e6-4a72-9881-67086477a060 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] [instance: f6762e10-9d45-47cf-a6b6-d9bfc3404664] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:59:56.719276 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-59326428-d0e6-4a72-9881-67086477a060 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:59:56.719770 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-59326428-d0e6-4a72-9881-67086477a060 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:59:56.720360 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-59326428-d0e6-4a72-9881-67086477a060 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:59:56.721170 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-59326428-d0e6-4a72-9881-67086477a060 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:59:56.721626 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-59326428-d0e6-4a72-9881-67086477a060 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:59:56.722049 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-59326428-d0e6-4a72-9881-67086477a060 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:59:56.828672 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-a6b1a9d4-19e7-4dc3-92fd-8fbab0d7319e tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:59:56.830522 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-a6b1a9d4-19e7-4dc3-92fd-8fbab0d7319e tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] [instance: 68b54f50-6b4d-4ea3-877f-c7ac79a5bb86] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:59:56.841523 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-a6b1a9d4-19e7-4dc3-92fd-8fbab0d7319e tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:59:56.842838 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-a6b1a9d4-19e7-4dc3-92fd-8fbab0d7319e tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:59:56.843550 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-a6b1a9d4-19e7-4dc3-92fd-8fbab0d7319e tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:59:56.845142 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-a6b1a9d4-19e7-4dc3-92fd-8fbab0d7319e tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:59:56.846259 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-a6b1a9d4-19e7-4dc3-92fd-8fbab0d7319e tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:59:56.846861 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-a6b1a9d4-19e7-4dc3-92fd-8fbab0d7319e tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:59:56.859171 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-59326428-d0e6-4a72-9881-67086477a060 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72117f17294649d6b8bc16c66c7efab2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45d4c047d3c44324a27a27831236ab0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:59:56.867318 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-59326428-d0e6-4a72-9881-67086477a060 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] 10.222.0.13 "GET /compute/v2.1/servers/f6762e10-9d45-47cf-a6b6-d9bfc3404664" status: 200 len: 1472 microversion: 2.1 time: 0.159100 Nov 01 18:59:56.881308 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 819/1592] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:59:56 2022] GET /compute/v2.1/servers/f6762e10-9d45-47cf-a6b6-d9bfc3404664 => generated 1472 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:59:56.920720 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-a6b1a9d4-19e7-4dc3-92fd-8fbab0d7319e tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a9c3b6a8c34f068caa50dc10d13a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9ef08eba0ef431285fd15a2561b4e5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:59:56.929036 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-a6b1a9d4-19e7-4dc3-92fd-8fbab0d7319e tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] 10.222.0.13 "GET /compute/v2.1/servers/68b54f50-6b4d-4ea3-877f-c7ac79a5bb86" status: 200 len: 1219 microversion: 2.1 time: 0.104857 Nov 01 18:59:56.929613 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 774/1593] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:59:56 2022] GET /compute/v2.1/servers/68b54f50-6b4d-4ea3-877f-c7ac79a5bb86 => generated 1219 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:59:56.978209 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-94fb5047-2ee9-4f6e-b291-42cae3497c49 tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] Calling method '.version_select at 0x7f0ae1cf9d30>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:59:57.023663 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-94fb5047-2ee9-4f6e-b291-42cae3497c49 tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] 10.222.0.13 "GET /compute/v2.1/images/14008a7c-6542-4124-800d-d352127c1bb1" status: 200 len: 1454 microversion: 2.1 time: 0.050608 Nov 01 18:59:57.024287 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 820/1594] 10.222.0.13 () {58 vars in 1233 bytes} [Tue Nov 1 18:59:56 2022] GET /compute/v2.1/images/14008a7c-6542-4124-800d-d352127c1bb1 => generated 1454 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:59:57.108234 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-b54b0c9f-31b4-4e6f-8f24-1efbbe36b8f0 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:59:57.108885 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-b54b0c9f-31b4-4e6f-8f24-1efbbe36b8f0 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] [instance: f35d5fdd-4a95-4b57-a506-665fa3f393c1] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:59:57.114905 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-b54b0c9f-31b4-4e6f-8f24-1efbbe36b8f0 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:59:57.115393 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-b54b0c9f-31b4-4e6f-8f24-1efbbe36b8f0 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:59:57.115834 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-b54b0c9f-31b4-4e6f-8f24-1efbbe36b8f0 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:59:57.116526 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-b54b0c9f-31b4-4e6f-8f24-1efbbe36b8f0 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:59:57.117031 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-b54b0c9f-31b4-4e6f-8f24-1efbbe36b8f0 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:59:57.117441 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-b54b0c9f-31b4-4e6f-8f24-1efbbe36b8f0 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:59:57.201084 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-3c208be5-f4d6-41d3-b998-a2456ae6c5a3 tempest-ServersTestFqdnHostnames-269349818 tempest-ServersTestFqdnHostnames-269349818-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:59:57.202540 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-3c208be5-f4d6-41d3-b998-a2456ae6c5a3 tempest-ServersTestFqdnHostnames-269349818 tempest-ServersTestFqdnHostnames-269349818-project] [instance: 04443e90-21e9-4b5e-99e8-350f07e4ea82] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:59:57.218424 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-3c208be5-f4d6-41d3-b998-a2456ae6c5a3 tempest-ServersTestFqdnHostnames-269349818 tempest-ServersTestFqdnHostnames-269349818-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:59:57.219372 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-3c208be5-f4d6-41d3-b998-a2456ae6c5a3 tempest-ServersTestFqdnHostnames-269349818 tempest-ServersTestFqdnHostnames-269349818-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:59:57.219894 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-3c208be5-f4d6-41d3-b998-a2456ae6c5a3 tempest-ServersTestFqdnHostnames-269349818 tempest-ServersTestFqdnHostnames-269349818-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:59:57.220799 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-3c208be5-f4d6-41d3-b998-a2456ae6c5a3 tempest-ServersTestFqdnHostnames-269349818 tempest-ServersTestFqdnHostnames-269349818-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:59:57.221439 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-3c208be5-f4d6-41d3-b998-a2456ae6c5a3 tempest-ServersTestFqdnHostnames-269349818 tempest-ServersTestFqdnHostnames-269349818-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:59:57.222034 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-3c208be5-f4d6-41d3-b998-a2456ae6c5a3 tempest-ServersTestFqdnHostnames-269349818 tempest-ServersTestFqdnHostnames-269349818-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:59:57.267480 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-b54b0c9f-31b4-4e6f-8f24-1efbbe36b8f0 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0290a6bb8bc24b8988a925327ac0381c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86941784237549838bba63ce88053b88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:59:57.278878 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-b54b0c9f-31b4-4e6f-8f24-1efbbe36b8f0 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] 10.222.0.13 "GET /compute/v2.1/servers/f35d5fdd-4a95-4b57-a506-665fa3f393c1" status: 200 len: 1317 microversion: 2.1 time: 0.175471 Nov 01 18:59:57.280105 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 775/1595] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:59:57 2022] GET /compute/v2.1/servers/f35d5fdd-4a95-4b57-a506-665fa3f393c1 => generated 1317 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:59:57.291998 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-3c208be5-f4d6-41d3-b998-a2456ae6c5a3 tempest-ServersTestFqdnHostnames-269349818 tempest-ServersTestFqdnHostnames-269349818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d33ca3478b7455dad5094afee57c8b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfea57f34b844c77b22619105249d08a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:59:57.300324 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-3c208be5-f4d6-41d3-b998-a2456ae6c5a3 tempest-ServersTestFqdnHostnames-269349818 tempest-ServersTestFqdnHostnames-269349818-project] 10.222.0.13 "GET /compute/v2.1/servers/04443e90-21e9-4b5e-99e8-350f07e4ea82" status: 200 len: 1230 microversion: 2.1 time: 0.103694 Nov 01 18:59:57.300920 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 821/1596] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:59:57 2022] GET /compute/v2.1/servers/04443e90-21e9-4b5e-99e8-350f07e4ea82 => generated 1230 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 18:59:57.301477 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-9aa3d1c1-ddf4-4d66-b93c-ce79cf8b5a4a tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:59:57.302161 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-9aa3d1c1-ddf4-4d66-b93c-ce79cf8b5a4a tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] [instance: a7f88d19-08ee-47bf-9240-7d49afd775e2] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:59:57.308387 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-9aa3d1c1-ddf4-4d66-b93c-ce79cf8b5a4a tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:59:57.308965 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-9aa3d1c1-ddf4-4d66-b93c-ce79cf8b5a4a tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:59:57.309505 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-9aa3d1c1-ddf4-4d66-b93c-ce79cf8b5a4a tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:59:57.310279 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-9aa3d1c1-ddf4-4d66-b93c-ce79cf8b5a4a tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:59:57.310799 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-9aa3d1c1-ddf4-4d66-b93c-ce79cf8b5a4a tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:59:57.311279 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-9aa3d1c1-ddf4-4d66-b93c-ce79cf8b5a4a tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:59:57.451613 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-9aa3d1c1-ddf4-4d66-b93c-ce79cf8b5a4a tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:59:57.454846 n-d-863052-2 devstack@n-api.service[121403]: DEBUG dbcounter [-] [121403] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 18:59:57.466587 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-9aa3d1c1-ddf4-4d66-b93c-ce79cf8b5a4a tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:59:57.467586 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-9aa3d1c1-ddf4-4d66-b93c-ce79cf8b5a4a tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:59:57.468817 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-9aa3d1c1-ddf4-4d66-b93c-ce79cf8b5a4a tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] 10.222.0.13 "GET /compute/v2.1/servers/a7f88d19-08ee-47bf-9240-7d49afd775e2" status: 200 len: 1812 microversion: 2.25 time: 0.171375 Nov 01 18:59:57.469373 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 776/1597] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 18:59:57 2022] GET /compute/v2.1/servers/a7f88d19-08ee-47bf-9240-7d49afd775e2 => generated 1812 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 01 18:59:57.473226 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-8cff4283-b190-4c72-b323-9eacf454b2fb tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:59:57.473226 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-8cff4283-b190-4c72-b323-9eacf454b2fb tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] [instance: 90b353ab-ef97-4d88-b5bc-b355ff576225] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:59:57.484532 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-8cff4283-b190-4c72-b323-9eacf454b2fb tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:59:57.488275 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-8cff4283-b190-4c72-b323-9eacf454b2fb tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:59:57.491014 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-8cff4283-b190-4c72-b323-9eacf454b2fb tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:59:57.491923 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-8cff4283-b190-4c72-b323-9eacf454b2fb tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:59:57.492455 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-8cff4283-b190-4c72-b323-9eacf454b2fb tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:59:57.492990 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-8cff4283-b190-4c72-b323-9eacf454b2fb tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:59:57.629696 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-8cff4283-b190-4c72-b323-9eacf454b2fb tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a63d69c99a546f0af16329cff3ca717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a1bb191cff948e99c008b5e861ce4a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:59:57.637311 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-8cff4283-b190-4c72-b323-9eacf454b2fb tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] 10.222.0.13 "GET /compute/v2.1/servers/90b353ab-ef97-4d88-b5bc-b355ff576225" status: 200 len: 1371 microversion: 2.1 time: 0.169360 Nov 01 18:59:57.638519 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 822/1598] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:59:57 2022] GET /compute/v2.1/servers/90b353ab-ef97-4d88-b5bc-b355ff576225 => generated 1371 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:59:57.895248 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-90cff155-10b2-441b-a503-eaac3a4b4c7f tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:59:57.896148 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-90cff155-10b2-441b-a503-eaac3a4b4c7f tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] [instance: f6762e10-9d45-47cf-a6b6-d9bfc3404664] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:59:57.907030 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-90cff155-10b2-441b-a503-eaac3a4b4c7f tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:59:57.907620 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-90cff155-10b2-441b-a503-eaac3a4b4c7f tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:59:57.908066 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-90cff155-10b2-441b-a503-eaac3a4b4c7f tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:59:57.909090 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-90cff155-10b2-441b-a503-eaac3a4b4c7f tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:59:57.909558 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-90cff155-10b2-441b-a503-eaac3a4b4c7f tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:59:57.910406 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-90cff155-10b2-441b-a503-eaac3a4b4c7f tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:59:57.953254 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-f1afe787-1e08-4630-a0b8-d2ddd23879f0 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:59:57.953853 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-f1afe787-1e08-4630-a0b8-d2ddd23879f0 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] [instance: 68b54f50-6b4d-4ea3-877f-c7ac79a5bb86] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:59:57.960975 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f1afe787-1e08-4630-a0b8-d2ddd23879f0 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:59:57.962005 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f1afe787-1e08-4630-a0b8-d2ddd23879f0 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:59:57.962466 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f1afe787-1e08-4630-a0b8-d2ddd23879f0 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:59:57.963360 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f1afe787-1e08-4630-a0b8-d2ddd23879f0 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:59:57.964012 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f1afe787-1e08-4630-a0b8-d2ddd23879f0 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:59:57.964248 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f1afe787-1e08-4630-a0b8-d2ddd23879f0 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:59:58.047287 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-f1afe787-1e08-4630-a0b8-d2ddd23879f0 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a9c3b6a8c34f068caa50dc10d13a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9ef08eba0ef431285fd15a2561b4e5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:59:58.056950 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-f1afe787-1e08-4630-a0b8-d2ddd23879f0 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] 10.222.0.13 "GET /compute/v2.1/servers/68b54f50-6b4d-4ea3-877f-c7ac79a5bb86" status: 200 len: 1219 microversion: 2.1 time: 0.108645 Nov 01 18:59:58.057925 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 823/1599] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:59:57 2022] GET /compute/v2.1/servers/68b54f50-6b4d-4ea3-877f-c7ac79a5bb86 => generated 1219 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:59:58.064099 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-1ae0f8db-8f62-4420-be86-26127b6155dc tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] Calling method '.version_select at 0x7f0ae1d5bee0>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:59:58.077752 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-90cff155-10b2-441b-a503-eaac3a4b4c7f tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72117f17294649d6b8bc16c66c7efab2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45d4c047d3c44324a27a27831236ab0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:59:58.086571 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-90cff155-10b2-441b-a503-eaac3a4b4c7f tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] 10.222.0.13 "GET /compute/v2.1/servers/f6762e10-9d45-47cf-a6b6-d9bfc3404664" status: 200 len: 1472 microversion: 2.1 time: 0.198436 Nov 01 18:59:58.087463 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 777/1600] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:59:57 2022] GET /compute/v2.1/servers/f6762e10-9d45-47cf-a6b6-d9bfc3404664 => generated 1472 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:59:58.124002 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-1ae0f8db-8f62-4420-be86-26127b6155dc tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] 10.222.0.13 "GET /compute/v2.1/images/14008a7c-6542-4124-800d-d352127c1bb1" status: 200 len: 1454 microversion: 2.1 time: 0.064615 Nov 01 18:59:58.124755 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 824/1601] 10.222.0.13 () {58 vars in 1233 bytes} [Tue Nov 1 18:59:58 2022] GET /compute/v2.1/images/14008a7c-6542-4124-800d-d352127c1bb1 => generated 1454 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:59:58.304416 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-d51d7a4b-b7ea-4655-82bd-0b52ad67372d tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:59:58.307100 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-d51d7a4b-b7ea-4655-82bd-0b52ad67372d tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] [instance: f35d5fdd-4a95-4b57-a506-665fa3f393c1] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:59:58.317726 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d51d7a4b-b7ea-4655-82bd-0b52ad67372d tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:59:58.318326 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d51d7a4b-b7ea-4655-82bd-0b52ad67372d tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:59:58.324130 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-2faea2a3-72b7-4b48-b15a-c3a5c074f992 tempest-ServersTestFqdnHostnames-269349818 tempest-ServersTestFqdnHostnames-269349818-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:59:58.324938 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-2faea2a3-72b7-4b48-b15a-c3a5c074f992 tempest-ServersTestFqdnHostnames-269349818 tempest-ServersTestFqdnHostnames-269349818-project] [instance: 04443e90-21e9-4b5e-99e8-350f07e4ea82] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:59:58.329716 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d51d7a4b-b7ea-4655-82bd-0b52ad67372d tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:59:58.331037 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d51d7a4b-b7ea-4655-82bd-0b52ad67372d tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:59:58.334008 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d51d7a4b-b7ea-4655-82bd-0b52ad67372d tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:59:58.334722 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d51d7a4b-b7ea-4655-82bd-0b52ad67372d tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:59:58.341654 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2faea2a3-72b7-4b48-b15a-c3a5c074f992 tempest-ServersTestFqdnHostnames-269349818 tempest-ServersTestFqdnHostnames-269349818-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:59:58.342639 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2faea2a3-72b7-4b48-b15a-c3a5c074f992 tempest-ServersTestFqdnHostnames-269349818 tempest-ServersTestFqdnHostnames-269349818-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:59:58.345164 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2faea2a3-72b7-4b48-b15a-c3a5c074f992 tempest-ServersTestFqdnHostnames-269349818 tempest-ServersTestFqdnHostnames-269349818-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:59:58.346652 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2faea2a3-72b7-4b48-b15a-c3a5c074f992 tempest-ServersTestFqdnHostnames-269349818 tempest-ServersTestFqdnHostnames-269349818-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:59:58.347370 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2faea2a3-72b7-4b48-b15a-c3a5c074f992 tempest-ServersTestFqdnHostnames-269349818 tempest-ServersTestFqdnHostnames-269349818-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:59:58.348036 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2faea2a3-72b7-4b48-b15a-c3a5c074f992 tempest-ServersTestFqdnHostnames-269349818 tempest-ServersTestFqdnHostnames-269349818-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:59:58.433947 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-2faea2a3-72b7-4b48-b15a-c3a5c074f992 tempest-ServersTestFqdnHostnames-269349818 tempest-ServersTestFqdnHostnames-269349818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d33ca3478b7455dad5094afee57c8b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfea57f34b844c77b22619105249d08a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:59:58.444607 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-2faea2a3-72b7-4b48-b15a-c3a5c074f992 tempest-ServersTestFqdnHostnames-269349818 tempest-ServersTestFqdnHostnames-269349818-project] 10.222.0.13 "GET /compute/v2.1/servers/04443e90-21e9-4b5e-99e8-350f07e4ea82" status: 200 len: 1230 microversion: 2.1 time: 0.124836 Nov 01 18:59:58.445780 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 825/1602] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:59:58 2022] GET /compute/v2.1/servers/04443e90-21e9-4b5e-99e8-350f07e4ea82 => generated 1230 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 18:59:58.450852 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [req-602302f6-062d-490a-b41f-c58b93db58dd req-14337f8a-9df1-4d49-8196-5abeefcd1b28 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f35d5fdd-4a95-4b57-a506-665fa3f393c1", "name": "network-vif-plugged", "status": "completed", "tag": "1eeffe67-2447-4389-aa3b-4c83cc3c9d53"}]} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 18:59:58.460867 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-602302f6-062d-490a-b41f-c58b93db58dd req-14337f8a-9df1-4d49-8196-5abeefcd1b28 service nova] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:59:58.461426 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-602302f6-062d-490a-b41f-c58b93db58dd req-14337f8a-9df1-4d49-8196-5abeefcd1b28 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:59:58.469064 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-602302f6-062d-490a-b41f-c58b93db58dd req-14337f8a-9df1-4d49-8196-5abeefcd1b28 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:59:58.518803 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.compute.server_external_events [req-602302f6-062d-490a-b41f-c58b93db58dd req-14337f8a-9df1-4d49-8196-5abeefcd1b28 service nova] Creating event network-vif-plugged:1eeffe67-2447-4389-aa3b-4c83cc3c9d53 for instance f35d5fdd-4a95-4b57-a506-665fa3f393c1 on n-h2-863052-2 Nov 01 18:59:58.535351 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [req-602302f6-062d-490a-b41f-c58b93db58dd req-14337f8a-9df1-4d49-8196-5abeefcd1b28 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087807 Nov 01 18:59:58.540555 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 826/1603] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Nov 1 18:59:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 18:59:58.563643 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-ce7d5b9a-f65b-4359-b592-bfd8cb7fe644 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:59:58.564380 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-ce7d5b9a-f65b-4359-b592-bfd8cb7fe644 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] [instance: a7f88d19-08ee-47bf-9240-7d49afd775e2] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:59:58.571907 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-ce7d5b9a-f65b-4359-b592-bfd8cb7fe644 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:59:58.572478 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-ce7d5b9a-f65b-4359-b592-bfd8cb7fe644 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:59:58.572872 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-ce7d5b9a-f65b-4359-b592-bfd8cb7fe644 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:59:58.573582 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-ce7d5b9a-f65b-4359-b592-bfd8cb7fe644 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:59:58.574043 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-ce7d5b9a-f65b-4359-b592-bfd8cb7fe644 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:59:58.574505 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-ce7d5b9a-f65b-4359-b592-bfd8cb7fe644 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:59:58.598957 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-d51d7a4b-b7ea-4655-82bd-0b52ad67372d tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0290a6bb8bc24b8988a925327ac0381c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86941784237549838bba63ce88053b88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:59:58.617544 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-d51d7a4b-b7ea-4655-82bd-0b52ad67372d tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] 10.222.0.13 "GET /compute/v2.1/servers/f35d5fdd-4a95-4b57-a506-665fa3f393c1" status: 200 len: 1317 microversion: 2.1 time: 0.317634 Nov 01 18:59:58.620644 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 778/1604] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:59:58 2022] GET /compute/v2.1/servers/f35d5fdd-4a95-4b57-a506-665fa3f393c1 => generated 1317 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:59:58.661388 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-fbc7fa7a-c6cb-4d55-9a09-2cd9897c168d tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:59:58.662029 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-fbc7fa7a-c6cb-4d55-9a09-2cd9897c168d tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] [instance: 90b353ab-ef97-4d88-b5bc-b355ff576225] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:59:58.671950 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-fbc7fa7a-c6cb-4d55-9a09-2cd9897c168d tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:59:58.674507 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-fbc7fa7a-c6cb-4d55-9a09-2cd9897c168d tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:59:58.676942 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-fbc7fa7a-c6cb-4d55-9a09-2cd9897c168d tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:59:58.678588 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-fbc7fa7a-c6cb-4d55-9a09-2cd9897c168d tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:59:58.681441 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-fbc7fa7a-c6cb-4d55-9a09-2cd9897c168d tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:59:58.682147 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-fbc7fa7a-c6cb-4d55-9a09-2cd9897c168d tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:59:59.041246 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-fbc7fa7a-c6cb-4d55-9a09-2cd9897c168d tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a63d69c99a546f0af16329cff3ca717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a1bb191cff948e99c008b5e861ce4a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:59:59.073467 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-fbc7fa7a-c6cb-4d55-9a09-2cd9897c168d tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] 10.222.0.13 "GET /compute/v2.1/servers/90b353ab-ef97-4d88-b5bc-b355ff576225" status: 200 len: 1371 microversion: 2.1 time: 0.416507 Nov 01 18:59:59.075620 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 779/1605] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:59:58 2022] GET /compute/v2.1/servers/90b353ab-ef97-4d88-b5bc-b355ff576225 => generated 1371 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:59:59.094094 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-d06f8526-91c6-42d6-84df-f5483b32e668 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:59:59.094634 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-d06f8526-91c6-42d6-84df-f5483b32e668 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] [instance: 68b54f50-6b4d-4ea3-877f-c7ac79a5bb86] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:59:59.101881 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d06f8526-91c6-42d6-84df-f5483b32e668 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:59:59.102373 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d06f8526-91c6-42d6-84df-f5483b32e668 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:59:59.102814 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d06f8526-91c6-42d6-84df-f5483b32e668 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:59:59.104112 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d06f8526-91c6-42d6-84df-f5483b32e668 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:59:59.104616 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d06f8526-91c6-42d6-84df-f5483b32e668 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:59:59.105116 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d06f8526-91c6-42d6-84df-f5483b32e668 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:59:59.138811 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-ce7d5b9a-f65b-4359-b592-bfd8cb7fe644 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:59:59.161629 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-ce7d5b9a-f65b-4359-b592-bfd8cb7fe644 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:59:59.163124 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-ce7d5b9a-f65b-4359-b592-bfd8cb7fe644 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:59:59.164348 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-ce7d5b9a-f65b-4359-b592-bfd8cb7fe644 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] 10.222.0.13 "GET /compute/v2.1/servers/a7f88d19-08ee-47bf-9240-7d49afd775e2" status: 200 len: 1812 microversion: 2.25 time: 0.622432 Nov 01 18:59:59.164933 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 827/1606] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 18:59:58 2022] GET /compute/v2.1/servers/a7f88d19-08ee-47bf-9240-7d49afd775e2 => generated 1812 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 18:59:59.174787 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-c34abf50-a514-4c68-9be0-cc093725d16a tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:59:59.180995 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-c34abf50-a514-4c68-9be0-cc093725d16a tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] [instance: f6762e10-9d45-47cf-a6b6-d9bfc3404664] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:59:59.194946 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-c34abf50-a514-4c68-9be0-cc093725d16a tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:59:59.197626 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-c34abf50-a514-4c68-9be0-cc093725d16a tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:59:59.200678 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-c34abf50-a514-4c68-9be0-cc093725d16a tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:59:59.201775 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-c34abf50-a514-4c68-9be0-cc093725d16a tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:59:59.204785 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-c34abf50-a514-4c68-9be0-cc093725d16a tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:59:59.205239 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-c34abf50-a514-4c68-9be0-cc093725d16a tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:59:59.261583 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-d06f8526-91c6-42d6-84df-f5483b32e668 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a9c3b6a8c34f068caa50dc10d13a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9ef08eba0ef431285fd15a2561b4e5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:59:59.271495 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-d06f8526-91c6-42d6-84df-f5483b32e668 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] 10.222.0.13 "GET /compute/v2.1/servers/68b54f50-6b4d-4ea3-877f-c7ac79a5bb86" status: 200 len: 1211 microversion: 2.1 time: 0.182789 Nov 01 18:59:59.272842 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 780/1607] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:59:59 2022] GET /compute/v2.1/servers/68b54f50-6b4d-4ea3-877f-c7ac79a5bb86 => generated 1211 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:59:59.280025 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-2bb243ae-3ba7-4703-8d23-6a462cbe9f22 tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] Calling method '.version_select at 0x7f0ae68891f0>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:59:59.332968 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-2bb243ae-3ba7-4703-8d23-6a462cbe9f22 tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] 10.222.0.13 "GET /compute/v2.1/images/14008a7c-6542-4124-800d-d352127c1bb1" status: 200 len: 1454 microversion: 2.1 time: 0.058870 Nov 01 18:59:59.333890 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 781/1608] 10.222.0.13 () {58 vars in 1233 bytes} [Tue Nov 1 18:59:59 2022] GET /compute/v2.1/images/14008a7c-6542-4124-800d-d352127c1bb1 => generated 1454 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:59:59.458115 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-c34abf50-a514-4c68-9be0-cc093725d16a tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72117f17294649d6b8bc16c66c7efab2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45d4c047d3c44324a27a27831236ab0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:59:59.467418 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-c34abf50-a514-4c68-9be0-cc093725d16a tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] 10.222.0.13 "GET /compute/v2.1/servers/f6762e10-9d45-47cf-a6b6-d9bfc3404664" status: 200 len: 1477 microversion: 2.1 time: 0.296184 Nov 01 18:59:59.468222 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 828/1609] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:59:59 2022] GET /compute/v2.1/servers/f6762e10-9d45-47cf-a6b6-d9bfc3404664 => generated 1477 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:59:59.468870 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-53bfc70f-9e2e-44e2-8bad-902bef6ddee9 tempest-ServersTestFqdnHostnames-269349818 tempest-ServersTestFqdnHostnames-269349818-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:59:59.469552 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-53bfc70f-9e2e-44e2-8bad-902bef6ddee9 tempest-ServersTestFqdnHostnames-269349818 tempest-ServersTestFqdnHostnames-269349818-project] [instance: 04443e90-21e9-4b5e-99e8-350f07e4ea82] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:59:59.476056 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-53bfc70f-9e2e-44e2-8bad-902bef6ddee9 tempest-ServersTestFqdnHostnames-269349818 tempest-ServersTestFqdnHostnames-269349818-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:59:59.476671 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-53bfc70f-9e2e-44e2-8bad-902bef6ddee9 tempest-ServersTestFqdnHostnames-269349818 tempest-ServersTestFqdnHostnames-269349818-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:59:59.477268 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-53bfc70f-9e2e-44e2-8bad-902bef6ddee9 tempest-ServersTestFqdnHostnames-269349818 tempest-ServersTestFqdnHostnames-269349818-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:59:59.477907 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-53bfc70f-9e2e-44e2-8bad-902bef6ddee9 tempest-ServersTestFqdnHostnames-269349818 tempest-ServersTestFqdnHostnames-269349818-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:59:59.478384 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-53bfc70f-9e2e-44e2-8bad-902bef6ddee9 tempest-ServersTestFqdnHostnames-269349818 tempest-ServersTestFqdnHostnames-269349818-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:59:59.478820 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-53bfc70f-9e2e-44e2-8bad-902bef6ddee9 tempest-ServersTestFqdnHostnames-269349818 tempest-ServersTestFqdnHostnames-269349818-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:59:59.543926 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-53bfc70f-9e2e-44e2-8bad-902bef6ddee9 tempest-ServersTestFqdnHostnames-269349818 tempest-ServersTestFqdnHostnames-269349818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d33ca3478b7455dad5094afee57c8b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfea57f34b844c77b22619105249d08a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:59:59.552032 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-53bfc70f-9e2e-44e2-8bad-902bef6ddee9 tempest-ServersTestFqdnHostnames-269349818 tempest-ServersTestFqdnHostnames-269349818-project] 10.222.0.13 "GET /compute/v2.1/servers/04443e90-21e9-4b5e-99e8-350f07e4ea82" status: 200 len: 1278 microversion: 2.1 time: 0.088344 Nov 01 18:59:59.552621 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 782/1610] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:59:59 2022] GET /compute/v2.1/servers/04443e90-21e9-4b5e-99e8-350f07e4ea82 => generated 1278 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 18:59:59.644636 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-cfe28697-f098-4e10-aa64-fbd51686abf1 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 18:59:59.645252 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-cfe28697-f098-4e10-aa64-fbd51686abf1 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] [instance: f35d5fdd-4a95-4b57-a506-665fa3f393c1] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 18:59:59.652621 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-cfe28697-f098-4e10-aa64-fbd51686abf1 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:59:59.655241 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-cfe28697-f098-4e10-aa64-fbd51686abf1 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:59:59.655727 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-cfe28697-f098-4e10-aa64-fbd51686abf1 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:59:59.656820 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-cfe28697-f098-4e10-aa64-fbd51686abf1 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 18:59:59.657286 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-cfe28697-f098-4e10-aa64-fbd51686abf1 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 18:59:59.657713 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-cfe28697-f098-4e10-aa64-fbd51686abf1 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 18:59:59.754429 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-50422982-c3ce-469d-90f5-a75377e5d887 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-1496578564", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "a490666d-5de7-4ec8-8f65-f4383cb45da6"}], "block_device_mapping_v2": [{"uuid": "61b45b89-5dd4-4f6e-ae40-51a58039f7c6", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 18:59:59.771563 n-d-863052-2 devstack@n-api.service[121403]: DEBUG dbcounter [-] [121403] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=121403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 18:59:59.852054 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.network.neutron [None req-50422982-c3ce-469d-90f5-a75377e5d887 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] validate_networks() for [('a490666d-5de7-4ec8-8f65-f4383cb45da6', None, None, None, None, None)] {{(pid=121403) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 01 18:59:59.903467 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-cfe28697-f098-4e10-aa64-fbd51686abf1 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0290a6bb8bc24b8988a925327ac0381c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86941784237549838bba63ce88053b88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 18:59:59.926533 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-cfe28697-f098-4e10-aa64-fbd51686abf1 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] 10.222.0.13 "GET /compute/v2.1/servers/f35d5fdd-4a95-4b57-a506-665fa3f393c1" status: 200 len: 1317 microversion: 2.1 time: 0.286620 Nov 01 18:59:59.932040 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 829/1611] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 18:59:59 2022] GET /compute/v2.1/servers/f35d5fdd-4a95-4b57-a506-665fa3f393c1 => generated 1317 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:00:00.096821 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-7db75902-b488-4e7e-8f68-15156aa4a063 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:00:00.097430 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-7db75902-b488-4e7e-8f68-15156aa4a063 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] [instance: 90b353ab-ef97-4d88-b5bc-b355ff576225] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:00:00.103953 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-7db75902-b488-4e7e-8f68-15156aa4a063 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:00.104551 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-7db75902-b488-4e7e-8f68-15156aa4a063 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:00.105101 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-7db75902-b488-4e7e-8f68-15156aa4a063 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:00.105887 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-7db75902-b488-4e7e-8f68-15156aa4a063 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:00.108320 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-7db75902-b488-4e7e-8f68-15156aa4a063 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:00.109051 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-7db75902-b488-4e7e-8f68-15156aa4a063 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:00.131581 n-d-863052-2 devstack@n-api.service[121402]: DEBUG dbcounter [-] [121402] Writing DB stats nova_cell1:SELECT=100 {{(pid=121402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 19:00:00.257412 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-7db75902-b488-4e7e-8f68-15156aa4a063 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a63d69c99a546f0af16329cff3ca717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a1bb191cff948e99c008b5e861ce4a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:00:00.265637 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-7db75902-b488-4e7e-8f68-15156aa4a063 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] 10.222.0.13 "GET /compute/v2.1/servers/90b353ab-ef97-4d88-b5bc-b355ff576225" status: 200 len: 1371 microversion: 2.1 time: 0.173049 Nov 01 19:00:00.266210 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 830/1612] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:00:00 2022] GET /compute/v2.1/servers/90b353ab-ef97-4d88-b5bc-b355ff576225 => generated 1371 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 19:00:00.271069 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-81a1d642-a112-4c3a-aa56-86e0198112d8 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:00:00.271848 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-81a1d642-a112-4c3a-aa56-86e0198112d8 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] [instance: a7f88d19-08ee-47bf-9240-7d49afd775e2] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:00:00.279542 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-81a1d642-a112-4c3a-aa56-86e0198112d8 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:00.280806 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-81a1d642-a112-4c3a-aa56-86e0198112d8 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:00.281437 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-81a1d642-a112-4c3a-aa56-86e0198112d8 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:00.283005 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-81a1d642-a112-4c3a-aa56-86e0198112d8 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:00.283490 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-81a1d642-a112-4c3a-aa56-86e0198112d8 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:00.284085 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-81a1d642-a112-4c3a-aa56-86e0198112d8 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:00.309030 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.virt.hardware [None req-50422982-c3ce-469d-90f5-a75377e5d887 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Flavor limits 0:0:0 {{(pid=121403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 01 19:00:00.310078 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.virt.hardware [None req-50422982-c3ce-469d-90f5-a75377e5d887 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Image limits 0:0:0 {{(pid=121403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 01 19:00:00.310865 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.virt.hardware [None req-50422982-c3ce-469d-90f5-a75377e5d887 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Flavor pref 0:0:0 {{(pid=121403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 01 19:00:00.311348 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.virt.hardware [None req-50422982-c3ce-469d-90f5-a75377e5d887 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Image pref 0:0:0 {{(pid=121403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 01 19:00:00.311828 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.virt.hardware [None req-50422982-c3ce-469d-90f5-a75377e5d887 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 01 19:00:00.321902 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-50422982-c3ce-469d-90f5-a75377e5d887 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:00.322476 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-50422982-c3ce-469d-90f5-a75377e5d887 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:00.323040 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-50422982-c3ce-469d-90f5-a75377e5d887 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:00.323839 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-50422982-c3ce-469d-90f5-a75377e5d887 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:00.324366 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-50422982-c3ce-469d-90f5-a75377e5d887 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:00.324946 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-50422982-c3ce-469d-90f5-a75377e5d887 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:00.342589 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.quota [None req-50422982-c3ce-469d-90f5-a75377e5d887 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Getting quotas for project d9b9d4c236b944f9b2e8e502a50a8f8b. Resources: {'cores', 'ram', 'instances'} {{(pid=121403) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 01 19:00:00.348363 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.quota [None req-50422982-c3ce-469d-90f5-a75377e5d887 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Getting quotas for user f32f5fba1976432d938e664c7714e52b and project d9b9d4c236b944f9b2e8e502a50a8f8b. Resources: {'cores', 'ram', 'instances'} {{(pid=121403) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 01 19:00:00.414903 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-50422982-c3ce-469d-90f5-a75377e5d887 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Going to run 1 instances... {{(pid=121403) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 01 19:00:00.417184 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-50422982-c3ce-469d-90f5-a75377e5d887 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] [instance: 1f499af7-1896-478c-b7d7-d922bf78bd98] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='61b45b89-5dd4-4f6e-ae40-51a58039f7c6',volume_size=None,volume_type=None)] {{(pid=121403) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 01 19:00:00.426369 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-81a1d642-a112-4c3a-aa56-86e0198112d8 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:00:00.436525 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-81a1d642-a112-4c3a-aa56-86e0198112d8 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:00:00.438456 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-81a1d642-a112-4c3a-aa56-86e0198112d8 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:00:00.439855 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-81a1d642-a112-4c3a-aa56-86e0198112d8 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] 10.222.0.13 "GET /compute/v2.1/servers/a7f88d19-08ee-47bf-9240-7d49afd775e2" status: 200 len: 1812 microversion: 2.25 time: 0.172549 Nov 01 19:00:00.440757 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 831/1613] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 19:00:00 2022] GET /compute/v2.1/servers/a7f88d19-08ee-47bf-9240-7d49afd775e2 => generated 1812 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 19:00:00.446370 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-fc7f73cb-0c0a-47bf-99d0-d62df7c6e3e3 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:00:00.447362 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-fc7f73cb-0c0a-47bf-99d0-d62df7c6e3e3 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] [instance: 68b54f50-6b4d-4ea3-877f-c7ac79a5bb86] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:00:00.457765 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-fc7f73cb-0c0a-47bf-99d0-d62df7c6e3e3 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:00.458568 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-fc7f73cb-0c0a-47bf-99d0-d62df7c6e3e3 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:00.459012 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-fc7f73cb-0c0a-47bf-99d0-d62df7c6e3e3 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:00.459729 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-fc7f73cb-0c0a-47bf-99d0-d62df7c6e3e3 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:00.460189 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-fc7f73cb-0c0a-47bf-99d0-d62df7c6e3e3 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:00.460636 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-fc7f73cb-0c0a-47bf-99d0-d62df7c6e3e3 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:00.544084 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-fc7f73cb-0c0a-47bf-99d0-d62df7c6e3e3 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a9c3b6a8c34f068caa50dc10d13a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9ef08eba0ef431285fd15a2561b4e5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:00:00.554008 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-fc7f73cb-0c0a-47bf-99d0-d62df7c6e3e3 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] 10.222.0.13 "GET /compute/v2.1/servers/68b54f50-6b4d-4ea3-877f-c7ac79a5bb86" status: 200 len: 1211 microversion: 2.1 time: 0.111665 Nov 01 19:00:00.555115 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 832/1614] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:00:00 2022] GET /compute/v2.1/servers/68b54f50-6b4d-4ea3-877f-c7ac79a5bb86 => generated 1211 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:00:00.563335 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-6f1a9751-16a8-482c-a6bb-bec16efbbf86 tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] Calling method '.version_select at 0x7f0ae1c931f0>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:00:00.603763 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-50422982-c3ce-469d-90f5-a75377e5d887 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.854979 Nov 01 19:00:00.608698 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 783/1615] 10.222.0.13 () {60 vars in 1147 bytes} [Tue Nov 1 18:59:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 857 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Nov 01 19:00:00.610125 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-6f4f4e08-be8f-4770-b22c-9e1c5bd6f058 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:00:00.613034 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-6f4f4e08-be8f-4770-b22c-9e1c5bd6f058 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] [instance: f6762e10-9d45-47cf-a6b6-d9bfc3404664] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:00:00.618829 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-6f1a9751-16a8-482c-a6bb-bec16efbbf86 tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] 10.222.0.13 "GET /compute/v2.1/images/14008a7c-6542-4124-800d-d352127c1bb1" status: 200 len: 1454 microversion: 2.1 time: 0.060715 Nov 01 19:00:00.619623 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-6f4f4e08-be8f-4770-b22c-9e1c5bd6f058 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:00.620245 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-6f4f4e08-be8f-4770-b22c-9e1c5bd6f058 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:00.621045 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-6f4f4e08-be8f-4770-b22c-9e1c5bd6f058 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:00.622431 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-6f4f4e08-be8f-4770-b22c-9e1c5bd6f058 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:00.623117 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-6f4f4e08-be8f-4770-b22c-9e1c5bd6f058 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:00.623763 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-6f4f4e08-be8f-4770-b22c-9e1c5bd6f058 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:00.628391 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 833/1616] 10.222.0.13 () {58 vars in 1233 bytes} [Tue Nov 1 19:00:00 2022] GET /compute/v2.1/images/14008a7c-6542-4124-800d-d352127c1bb1 => generated 1454 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:00:00.633634 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-793540b6-fa64-4607-a733-175a69e45ebc tempest-ServersTestFqdnHostnames-269349818 tempest-ServersTestFqdnHostnames-269349818-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:00:00.634244 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-793540b6-fa64-4607-a733-175a69e45ebc tempest-ServersTestFqdnHostnames-269349818 tempest-ServersTestFqdnHostnames-269349818-project] [instance: 04443e90-21e9-4b5e-99e8-350f07e4ea82] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:00:00.642967 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-793540b6-fa64-4607-a733-175a69e45ebc tempest-ServersTestFqdnHostnames-269349818 tempest-ServersTestFqdnHostnames-269349818-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:00.643559 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-793540b6-fa64-4607-a733-175a69e45ebc tempest-ServersTestFqdnHostnames-269349818 tempest-ServersTestFqdnHostnames-269349818-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:00.644066 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-793540b6-fa64-4607-a733-175a69e45ebc tempest-ServersTestFqdnHostnames-269349818 tempest-ServersTestFqdnHostnames-269349818-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:00.644825 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-793540b6-fa64-4607-a733-175a69e45ebc tempest-ServersTestFqdnHostnames-269349818 tempest-ServersTestFqdnHostnames-269349818-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:00.645282 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-793540b6-fa64-4607-a733-175a69e45ebc tempest-ServersTestFqdnHostnames-269349818 tempest-ServersTestFqdnHostnames-269349818-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:00.645707 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-793540b6-fa64-4607-a733-175a69e45ebc tempest-ServersTestFqdnHostnames-269349818 tempest-ServersTestFqdnHostnames-269349818-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:00.721189 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-793540b6-fa64-4607-a733-175a69e45ebc tempest-ServersTestFqdnHostnames-269349818 tempest-ServersTestFqdnHostnames-269349818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d33ca3478b7455dad5094afee57c8b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfea57f34b844c77b22619105249d08a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:00:00.729587 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-793540b6-fa64-4607-a733-175a69e45ebc tempest-ServersTestFqdnHostnames-269349818 tempest-ServersTestFqdnHostnames-269349818-project] 10.222.0.13 "GET /compute/v2.1/servers/04443e90-21e9-4b5e-99e8-350f07e4ea82" status: 200 len: 1278 microversion: 2.1 time: 0.099981 Nov 01 19:00:00.744976 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 834/1617] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:00:00 2022] GET /compute/v2.1/servers/04443e90-21e9-4b5e-99e8-350f07e4ea82 => generated 1278 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:00:00.755519 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-aef69ff9-6037-4560-95a3-4e0912553aa0 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:00:00.756239 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-aef69ff9-6037-4560-95a3-4e0912553aa0 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] [instance: 1f499af7-1896-478c-b7d7-d922bf78bd98] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:00:00.810966 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-6f4f4e08-be8f-4770-b22c-9e1c5bd6f058 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72117f17294649d6b8bc16c66c7efab2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45d4c047d3c44324a27a27831236ab0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:00:00.813905 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-aef69ff9-6037-4560-95a3-4e0912553aa0 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f32f5fba1976432d938e664c7714e52b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b9d4c236b944f9b2e8e502a50a8f8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:00:00.820117 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-6f4f4e08-be8f-4770-b22c-9e1c5bd6f058 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] 10.222.0.13 "GET /compute/v2.1/servers/f6762e10-9d45-47cf-a6b6-d9bfc3404664" status: 200 len: 1477 microversion: 2.1 time: 0.214400 Nov 01 19:00:00.822471 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-aef69ff9-6037-4560-95a3-4e0912553aa0 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] 10.222.0.13 "GET /compute/v2.1/servers/1f499af7-1896-478c-b7d7-d922bf78bd98" status: 200 len: 1053 microversion: 2.1 time: 0.076409 Nov 01 19:00:00.823247 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 835/1618] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:00:00 2022] GET /compute/v2.1/servers/1f499af7-1896-478c-b7d7-d922bf78bd98 => generated 1053 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:00:00.841095 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 784/1619] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:00:00 2022] GET /compute/v2.1/servers/f6762e10-9d45-47cf-a6b6-d9bfc3404664 => generated 1477 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:00:00.956396 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-dac73658-ce94-458f-8fd5-bdfb966ebc11 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:00:00.957180 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-dac73658-ce94-458f-8fd5-bdfb966ebc11 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] [instance: f35d5fdd-4a95-4b57-a506-665fa3f393c1] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:00:00.963403 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-dac73658-ce94-458f-8fd5-bdfb966ebc11 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:00.963997 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-dac73658-ce94-458f-8fd5-bdfb966ebc11 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:00.964551 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-dac73658-ce94-458f-8fd5-bdfb966ebc11 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:00.965353 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-dac73658-ce94-458f-8fd5-bdfb966ebc11 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:00.966593 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-dac73658-ce94-458f-8fd5-bdfb966ebc11 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:00.967140 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-dac73658-ce94-458f-8fd5-bdfb966ebc11 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:01.114765 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-dac73658-ce94-458f-8fd5-bdfb966ebc11 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0290a6bb8bc24b8988a925327ac0381c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86941784237549838bba63ce88053b88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:00:01.124410 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-dac73658-ce94-458f-8fd5-bdfb966ebc11 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] 10.222.0.13 "GET /compute/v2.1/servers/f35d5fdd-4a95-4b57-a506-665fa3f393c1" status: 200 len: 1317 microversion: 2.1 time: 0.172204 Nov 01 19:00:01.124945 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 836/1620] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:00:00 2022] GET /compute/v2.1/servers/f35d5fdd-4a95-4b57-a506-665fa3f393c1 => generated 1317 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:00:01.291903 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-94831e15-caaf-4a73-aa9f-88e0de989200 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:00:01.293728 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-94831e15-caaf-4a73-aa9f-88e0de989200 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] [instance: 90b353ab-ef97-4d88-b5bc-b355ff576225] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:00:01.307608 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-94831e15-caaf-4a73-aa9f-88e0de989200 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:01.310492 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-94831e15-caaf-4a73-aa9f-88e0de989200 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:01.313267 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-94831e15-caaf-4a73-aa9f-88e0de989200 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:01.314287 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-94831e15-caaf-4a73-aa9f-88e0de989200 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:01.314992 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-94831e15-caaf-4a73-aa9f-88e0de989200 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:01.315647 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-94831e15-caaf-4a73-aa9f-88e0de989200 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:01.466951 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-f114be9c-6384-4f50-b3ac-1cd53e20e06e tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:00:01.467843 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-f114be9c-6384-4f50-b3ac-1cd53e20e06e tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] [instance: a7f88d19-08ee-47bf-9240-7d49afd775e2] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:00:01.483114 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f114be9c-6384-4f50-b3ac-1cd53e20e06e tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:01.485975 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f114be9c-6384-4f50-b3ac-1cd53e20e06e tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:01.486602 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f114be9c-6384-4f50-b3ac-1cd53e20e06e tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:01.487479 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f114be9c-6384-4f50-b3ac-1cd53e20e06e tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:01.491020 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f114be9c-6384-4f50-b3ac-1cd53e20e06e tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:01.491592 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f114be9c-6384-4f50-b3ac-1cd53e20e06e tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:01.611835 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-94831e15-caaf-4a73-aa9f-88e0de989200 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a63d69c99a546f0af16329cff3ca717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a1bb191cff948e99c008b5e861ce4a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:00:01.623174 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-94831e15-caaf-4a73-aa9f-88e0de989200 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] 10.222.0.13 "GET /compute/v2.1/servers/90b353ab-ef97-4d88-b5bc-b355ff576225" status: 200 len: 1565 microversion: 2.1 time: 0.336836 Nov 01 19:00:01.624405 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 785/1621] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:00:01 2022] GET /compute/v2.1/servers/90b353ab-ef97-4d88-b5bc-b355ff576225 => generated 1565 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:00:01.629498 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-5f590fd5-af85-467a-b0c4-3119d722c0bf tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:00:01.630211 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-5f590fd5-af85-467a-b0c4-3119d722c0bf tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] [instance: 68b54f50-6b4d-4ea3-877f-c7ac79a5bb86] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:00:01.637026 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-5f590fd5-af85-467a-b0c4-3119d722c0bf tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:01.639161 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-5f590fd5-af85-467a-b0c4-3119d722c0bf tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:01.639865 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-5f590fd5-af85-467a-b0c4-3119d722c0bf tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:01.642658 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-5f590fd5-af85-467a-b0c4-3119d722c0bf tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:01.642658 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-5f590fd5-af85-467a-b0c4-3119d722c0bf tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:01.643218 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-5f590fd5-af85-467a-b0c4-3119d722c0bf tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:01.738497 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-5f590fd5-af85-467a-b0c4-3119d722c0bf tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a9c3b6a8c34f068caa50dc10d13a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9ef08eba0ef431285fd15a2561b4e5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:00:01.749044 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-5f590fd5-af85-467a-b0c4-3119d722c0bf tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] 10.222.0.13 "GET /compute/v2.1/servers/68b54f50-6b4d-4ea3-877f-c7ac79a5bb86" status: 200 len: 1267 microversion: 2.1 time: 0.123207 Nov 01 19:00:01.749782 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 786/1622] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:00:01 2022] GET /compute/v2.1/servers/68b54f50-6b4d-4ea3-877f-c7ac79a5bb86 => generated 1267 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:00:01.768511 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-2d426ba1-186c-4cdf-b6d5-840a80fd9c4c tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] Calling method '.version_select at 0x7f0ae21300d0>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:00:01.815794 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-f114be9c-6384-4f50-b3ac-1cd53e20e06e tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:00:01.829178 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-2d426ba1-186c-4cdf-b6d5-840a80fd9c4c tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] 10.222.0.13 "GET /compute/v2.1/images/14008a7c-6542-4124-800d-d352127c1bb1" status: 200 len: 1454 microversion: 2.1 time: 0.068696 Nov 01 19:00:01.830405 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 787/1623] 10.222.0.13 () {58 vars in 1233 bytes} [Tue Nov 1 19:00:01 2022] GET /compute/v2.1/images/14008a7c-6542-4124-800d-d352127c1bb1 => generated 1454 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:00:01.835519 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-1c92d3f7-08fb-41bd-914b-cdb9945c67d7 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:00:01.836262 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-1c92d3f7-08fb-41bd-914b-cdb9945c67d7 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] [instance: 90b353ab-ef97-4d88-b5bc-b355ff576225] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:00:01.837328 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-f114be9c-6384-4f50-b3ac-1cd53e20e06e tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:00:01.842730 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-f114be9c-6384-4f50-b3ac-1cd53e20e06e tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:00:01.844030 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-f114be9c-6384-4f50-b3ac-1cd53e20e06e tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] 10.222.0.13 "GET /compute/v2.1/servers/a7f88d19-08ee-47bf-9240-7d49afd775e2" status: 200 len: 1812 microversion: 2.25 time: 0.381860 Nov 01 19:00:01.847269 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-1c92d3f7-08fb-41bd-914b-cdb9945c67d7 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:01.847394 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 837/1624] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 19:00:01 2022] GET /compute/v2.1/servers/a7f88d19-08ee-47bf-9240-7d49afd775e2 => generated 1812 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 01 19:00:01.847565 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-1c92d3f7-08fb-41bd-914b-cdb9945c67d7 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:01.848178 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-1c92d3f7-08fb-41bd-914b-cdb9945c67d7 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:01.849387 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-1c92d3f7-08fb-41bd-914b-cdb9945c67d7 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:01.850181 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-1c92d3f7-08fb-41bd-914b-cdb9945c67d7 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:01.850711 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-1c92d3f7-08fb-41bd-914b-cdb9945c67d7 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:01.851769 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-264b3170-bfca-454c-a0e6-11480ac24a18 tempest-ServersTestFqdnHostnames-269349818 tempest-ServersTestFqdnHostnames-269349818-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:00:01.852379 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-264b3170-bfca-454c-a0e6-11480ac24a18 tempest-ServersTestFqdnHostnames-269349818 tempest-ServersTestFqdnHostnames-269349818-project] [instance: 04443e90-21e9-4b5e-99e8-350f07e4ea82] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:00:01.859944 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-264b3170-bfca-454c-a0e6-11480ac24a18 tempest-ServersTestFqdnHostnames-269349818 tempest-ServersTestFqdnHostnames-269349818-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:01.860625 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-264b3170-bfca-454c-a0e6-11480ac24a18 tempest-ServersTestFqdnHostnames-269349818 tempest-ServersTestFqdnHostnames-269349818-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:01.861208 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-264b3170-bfca-454c-a0e6-11480ac24a18 tempest-ServersTestFqdnHostnames-269349818 tempest-ServersTestFqdnHostnames-269349818-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:01.862077 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-264b3170-bfca-454c-a0e6-11480ac24a18 tempest-ServersTestFqdnHostnames-269349818 tempest-ServersTestFqdnHostnames-269349818-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:01.862688 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-264b3170-bfca-454c-a0e6-11480ac24a18 tempest-ServersTestFqdnHostnames-269349818 tempest-ServersTestFqdnHostnames-269349818-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:01.863258 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-264b3170-bfca-454c-a0e6-11480ac24a18 tempest-ServersTestFqdnHostnames-269349818 tempest-ServersTestFqdnHostnames-269349818-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:01.958005 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-1c92d3f7-08fb-41bd-914b-cdb9945c67d7 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] 10.222.0.13 "GET /compute/v2.1/servers/90b353ab-ef97-4d88-b5bc-b355ff576225/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.126084 Nov 01 19:00:01.958729 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 788/1625] 10.222.0.13 () {58 vars in 1275 bytes} [Tue Nov 1 19:00:01 2022] GET /compute/v2.1/servers/90b353ab-ef97-4d88-b5bc-b355ff576225/os-interface => generated 285 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:00:01.965648 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-e85d8baf-1a09-44d7-9d6a-8a8b59d44521 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:00:01.967264 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-e85d8baf-1a09-44d7-9d6a-8a8b59d44521 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] [instance: 1f499af7-1896-478c-b7d7-d922bf78bd98] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:00:01.969276 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-264b3170-bfca-454c-a0e6-11480ac24a18 tempest-ServersTestFqdnHostnames-269349818 tempest-ServersTestFqdnHostnames-269349818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d33ca3478b7455dad5094afee57c8b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfea57f34b844c77b22619105249d08a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:00:01.976888 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-e85d8baf-1a09-44d7-9d6a-8a8b59d44521 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:01.977527 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-e85d8baf-1a09-44d7-9d6a-8a8b59d44521 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:01.978659 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-e85d8baf-1a09-44d7-9d6a-8a8b59d44521 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:01.978820 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-264b3170-bfca-454c-a0e6-11480ac24a18 tempest-ServersTestFqdnHostnames-269349818 tempest-ServersTestFqdnHostnames-269349818-project] 10.222.0.13 "GET /compute/v2.1/servers/04443e90-21e9-4b5e-99e8-350f07e4ea82" status: 200 len: 1284 microversion: 2.1 time: 0.130984 Nov 01 19:00:01.979612 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-e85d8baf-1a09-44d7-9d6a-8a8b59d44521 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:01.980178 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-e85d8baf-1a09-44d7-9d6a-8a8b59d44521 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:01.980742 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-e85d8baf-1a09-44d7-9d6a-8a8b59d44521 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:01.984626 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 838/1626] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:00:01 2022] GET /compute/v2.1/servers/04443e90-21e9-4b5e-99e8-350f07e4ea82 => generated 1284 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:00:01.991396 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-31b7ec0a-6107-4b61-badd-34016eedce96 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:00:01.992251 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-31b7ec0a-6107-4b61-badd-34016eedce96 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] [instance: f6762e10-9d45-47cf-a6b6-d9bfc3404664] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:00:01.999423 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-31b7ec0a-6107-4b61-badd-34016eedce96 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:02.000229 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-31b7ec0a-6107-4b61-badd-34016eedce96 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:02.001297 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-31b7ec0a-6107-4b61-badd-34016eedce96 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:02.002674 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-31b7ec0a-6107-4b61-badd-34016eedce96 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:02.003305 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-31b7ec0a-6107-4b61-badd-34016eedce96 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:02.003896 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-31b7ec0a-6107-4b61-badd-34016eedce96 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:02.097429 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-e85d8baf-1a09-44d7-9d6a-8a8b59d44521 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f32f5fba1976432d938e664c7714e52b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b9d4c236b944f9b2e8e502a50a8f8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:00:02.110401 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-e85d8baf-1a09-44d7-9d6a-8a8b59d44521 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] 10.222.0.13 "GET /compute/v2.1/servers/1f499af7-1896-478c-b7d7-d922bf78bd98" status: 200 len: 1095 microversion: 2.1 time: 0.150117 Nov 01 19:00:02.124608 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 789/1627] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:00:01 2022] GET /compute/v2.1/servers/1f499af7-1896-478c-b7d7-d922bf78bd98 => generated 1095 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:00:02.152182 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-0e074eed-93a6-4b87-a966-5ef64bedc0dc tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:00:02.153821 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-0e074eed-93a6-4b87-a966-5ef64bedc0dc tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] [instance: f35d5fdd-4a95-4b57-a506-665fa3f393c1] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:00:02.161932 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-0e074eed-93a6-4b87-a966-5ef64bedc0dc tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:02.162662 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-0e074eed-93a6-4b87-a966-5ef64bedc0dc tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:02.163255 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-0e074eed-93a6-4b87-a966-5ef64bedc0dc tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:02.164352 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-0e074eed-93a6-4b87-a966-5ef64bedc0dc tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:02.165250 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-0e074eed-93a6-4b87-a966-5ef64bedc0dc tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:02.165848 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-0e074eed-93a6-4b87-a966-5ef64bedc0dc tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:02.250594 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-31b7ec0a-6107-4b61-badd-34016eedce96 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72117f17294649d6b8bc16c66c7efab2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45d4c047d3c44324a27a27831236ab0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:00:02.258234 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-31b7ec0a-6107-4b61-badd-34016eedce96 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] 10.222.0.13 "GET /compute/v2.1/servers/f6762e10-9d45-47cf-a6b6-d9bfc3404664" status: 200 len: 1477 microversion: 2.1 time: 0.273898 Nov 01 19:00:02.258806 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 839/1628] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:00:01 2022] GET /compute/v2.1/servers/f6762e10-9d45-47cf-a6b6-d9bfc3404664 => generated 1477 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:00:02.472158 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-0e074eed-93a6-4b87-a966-5ef64bedc0dc tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0290a6bb8bc24b8988a925327ac0381c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86941784237549838bba63ce88053b88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:00:02.508222 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-0e074eed-93a6-4b87-a966-5ef64bedc0dc tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] 10.222.0.13 "GET /compute/v2.1/servers/f35d5fdd-4a95-4b57-a506-665fa3f393c1" status: 200 len: 1317 microversion: 2.1 time: 0.361942 Nov 01 19:00:02.517709 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 790/1629] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:00:02 2022] GET /compute/v2.1/servers/f35d5fdd-4a95-4b57-a506-665fa3f393c1 => generated 1317 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:00:02.772659 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-021eec7d-008f-40b1-8f52-2d6bf8989100 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:00:02.774251 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-021eec7d-008f-40b1-8f52-2d6bf8989100 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] [instance: 68b54f50-6b4d-4ea3-877f-c7ac79a5bb86] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:00:02.782723 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-021eec7d-008f-40b1-8f52-2d6bf8989100 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:02.783464 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-021eec7d-008f-40b1-8f52-2d6bf8989100 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:02.784374 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-021eec7d-008f-40b1-8f52-2d6bf8989100 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:02.792061 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-021eec7d-008f-40b1-8f52-2d6bf8989100 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:02.792916 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-021eec7d-008f-40b1-8f52-2d6bf8989100 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:02.793455 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-021eec7d-008f-40b1-8f52-2d6bf8989100 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:02.844840 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-96a7cff7-9907-4c18-8963-2330fbdc6289 tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] Calling method '.version_select at 0x7f0ae66e4670>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:00:02.906410 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-96a7cff7-9907-4c18-8963-2330fbdc6289 tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] 10.222.0.13 "GET /compute/v2.1/images/14008a7c-6542-4124-800d-d352127c1bb1" status: 200 len: 1454 microversion: 2.1 time: 0.065564 Nov 01 19:00:02.915538 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 791/1630] 10.222.0.13 () {58 vars in 1233 bytes} [Tue Nov 1 19:00:02 2022] GET /compute/v2.1/images/14008a7c-6542-4124-800d-d352127c1bb1 => generated 1454 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 19:00:02.922573 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-753eb550-f14e-4b7d-b7ee-acab3be9eb6d tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:00:02.923461 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-753eb550-f14e-4b7d-b7ee-acab3be9eb6d tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] [instance: a7f88d19-08ee-47bf-9240-7d49afd775e2] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:00:02.930734 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-753eb550-f14e-4b7d-b7ee-acab3be9eb6d tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:02.931370 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-753eb550-f14e-4b7d-b7ee-acab3be9eb6d tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:02.932505 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-753eb550-f14e-4b7d-b7ee-acab3be9eb6d tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:02.933545 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-753eb550-f14e-4b7d-b7ee-acab3be9eb6d tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:02.934775 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-753eb550-f14e-4b7d-b7ee-acab3be9eb6d tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:02.935552 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-753eb550-f14e-4b7d-b7ee-acab3be9eb6d tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:03.120629 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-021eec7d-008f-40b1-8f52-2d6bf8989100 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a9c3b6a8c34f068caa50dc10d13a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9ef08eba0ef431285fd15a2561b4e5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:00:03.140901 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-021eec7d-008f-40b1-8f52-2d6bf8989100 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] 10.222.0.13 "GET /compute/v2.1/servers/68b54f50-6b4d-4ea3-877f-c7ac79a5bb86" status: 200 len: 1285 microversion: 2.1 time: 0.372504 Nov 01 19:00:03.145834 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 840/1631] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:00:02 2022] GET /compute/v2.1/servers/68b54f50-6b4d-4ea3-877f-c7ac79a5bb86 => generated 1285 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:00:03.153265 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-b2c46f45-c63c-4ee3-9841-5a1c2c603352 tempest-ServersTestFqdnHostnames-269349818 tempest-ServersTestFqdnHostnames-269349818-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:00:03.156189 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-b2c46f45-c63c-4ee3-9841-5a1c2c603352 tempest-ServersTestFqdnHostnames-269349818 tempest-ServersTestFqdnHostnames-269349818-project] [instance: 04443e90-21e9-4b5e-99e8-350f07e4ea82] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:00:03.176185 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b2c46f45-c63c-4ee3-9841-5a1c2c603352 tempest-ServersTestFqdnHostnames-269349818 tempest-ServersTestFqdnHostnames-269349818-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:03.176747 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b2c46f45-c63c-4ee3-9841-5a1c2c603352 tempest-ServersTestFqdnHostnames-269349818 tempest-ServersTestFqdnHostnames-269349818-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:03.177189 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b2c46f45-c63c-4ee3-9841-5a1c2c603352 tempest-ServersTestFqdnHostnames-269349818 tempest-ServersTestFqdnHostnames-269349818-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:03.180501 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b2c46f45-c63c-4ee3-9841-5a1c2c603352 tempest-ServersTestFqdnHostnames-269349818 tempest-ServersTestFqdnHostnames-269349818-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:03.182568 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b2c46f45-c63c-4ee3-9841-5a1c2c603352 tempest-ServersTestFqdnHostnames-269349818 tempest-ServersTestFqdnHostnames-269349818-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:03.183201 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b2c46f45-c63c-4ee3-9841-5a1c2c603352 tempest-ServersTestFqdnHostnames-269349818 tempest-ServersTestFqdnHostnames-269349818-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:03.267413 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-753eb550-f14e-4b7d-b7ee-acab3be9eb6d tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:00:03.282032 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-753eb550-f14e-4b7d-b7ee-acab3be9eb6d tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:00:03.286243 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-753eb550-f14e-4b7d-b7ee-acab3be9eb6d tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:00:03.289191 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-753eb550-f14e-4b7d-b7ee-acab3be9eb6d tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] 10.222.0.13 "GET /compute/v2.1/servers/a7f88d19-08ee-47bf-9240-7d49afd775e2" status: 200 len: 1802 microversion: 2.25 time: 0.372191 Nov 01 19:00:03.291877 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 792/1632] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 19:00:02 2022] GET /compute/v2.1/servers/a7f88d19-08ee-47bf-9240-7d49afd775e2 => generated 1802 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 19:00:03.308920 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-897c98df-d46f-4337-afd1-7ef7d56a0331 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:00:03.310111 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-897c98df-d46f-4337-afd1-7ef7d56a0331 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] [instance: 1f499af7-1896-478c-b7d7-d922bf78bd98] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:00:03.319895 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-897c98df-d46f-4337-afd1-7ef7d56a0331 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:03.320387 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-897c98df-d46f-4337-afd1-7ef7d56a0331 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:03.322797 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-897c98df-d46f-4337-afd1-7ef7d56a0331 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:03.323706 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-897c98df-d46f-4337-afd1-7ef7d56a0331 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:03.326424 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-897c98df-d46f-4337-afd1-7ef7d56a0331 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:03.327074 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-897c98df-d46f-4337-afd1-7ef7d56a0331 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:03.433973 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-897c98df-d46f-4337-afd1-7ef7d56a0331 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f32f5fba1976432d938e664c7714e52b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b9d4c236b944f9b2e8e502a50a8f8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:00:03.451131 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-897c98df-d46f-4337-afd1-7ef7d56a0331 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] 10.222.0.13 "GET /compute/v2.1/servers/1f499af7-1896-478c-b7d7-d922bf78bd98" status: 200 len: 1151 microversion: 2.1 time: 0.158077 Nov 01 19:00:03.452341 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 793/1633] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:00:03 2022] GET /compute/v2.1/servers/1f499af7-1896-478c-b7d7-d922bf78bd98 => generated 1151 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:00:03.459241 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-451490b9-654e-40c3-a7f6-0e631f1dec7a tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:00:03.460109 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-451490b9-654e-40c3-a7f6-0e631f1dec7a tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] [instance: f6762e10-9d45-47cf-a6b6-d9bfc3404664] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:00:03.470708 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-451490b9-654e-40c3-a7f6-0e631f1dec7a tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:03.471512 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-451490b9-654e-40c3-a7f6-0e631f1dec7a tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:03.473256 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-451490b9-654e-40c3-a7f6-0e631f1dec7a tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:03.473851 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-451490b9-654e-40c3-a7f6-0e631f1dec7a tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:03.474368 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-451490b9-654e-40c3-a7f6-0e631f1dec7a tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:03.474809 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-451490b9-654e-40c3-a7f6-0e631f1dec7a tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:03.644538 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-b2c46f45-c63c-4ee3-9841-5a1c2c603352 tempest-ServersTestFqdnHostnames-269349818 tempest-ServersTestFqdnHostnames-269349818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d33ca3478b7455dad5094afee57c8b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfea57f34b844c77b22619105249d08a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:00:03.659981 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-b2c46f45-c63c-4ee3-9841-5a1c2c603352 tempest-ServersTestFqdnHostnames-269349818 tempest-ServersTestFqdnHostnames-269349818-project] 10.222.0.13 "GET /compute/v2.1/servers/04443e90-21e9-4b5e-99e8-350f07e4ea82" status: 200 len: 1352 microversion: 2.1 time: 0.512559 Nov 01 19:00:03.660412 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 841/1634] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:00:03 2022] GET /compute/v2.1/servers/04443e90-21e9-4b5e-99e8-350f07e4ea82 => generated 1352 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:00:03.671075 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-a656f4fc-3e23-41d8-908d-b19de2b632d4 tempest-LiveAutoBlockMigrationV225Test-1358532044 tempest-LiveAutoBlockMigrationV225Test-1358532044-project-admin] Calling method '.version_select at 0x7f0ae24a7af0>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:00:03.676725 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-451490b9-654e-40c3-a7f6-0e631f1dec7a tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72117f17294649d6b8bc16c66c7efab2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45d4c047d3c44324a27a27831236ab0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:00:03.678187 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-a656f4fc-3e23-41d8-908d-b19de2b632d4 tempest-LiveAutoBlockMigrationV225Test-1358532044 tempest-LiveAutoBlockMigrationV225Test-1358532044-project-admin] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:03.678395 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-a656f4fc-3e23-41d8-908d-b19de2b632d4 tempest-LiveAutoBlockMigrationV225Test-1358532044 tempest-LiveAutoBlockMigrationV225Test-1358532044-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:03.678837 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-a656f4fc-3e23-41d8-908d-b19de2b632d4 tempest-LiveAutoBlockMigrationV225Test-1358532044 tempest-LiveAutoBlockMigrationV225Test-1358532044-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:03.685703 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-451490b9-654e-40c3-a7f6-0e631f1dec7a tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] 10.222.0.13 "GET /compute/v2.1/servers/f6762e10-9d45-47cf-a6b6-d9bfc3404664" status: 200 len: 1477 microversion: 2.1 time: 0.231682 Nov 01 19:00:03.689218 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 794/1635] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:00:03 2022] GET /compute/v2.1/servers/f6762e10-9d45-47cf-a6b6-d9bfc3404664 => generated 1477 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:00:03.696552 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [req-7acec38f-c67b-42d0-9574-df2702090f14 req-c0cfcf62-b60f-4384-8d89-3a01474da809 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d8e88b0f-ae97-44a4-8b6b-b94e2c600a83", "name": "network-vif-plugged", "status": "completed", "tag": "91ce416d-c08f-473f-a551-fa3519a6c6c7"}]} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:00:03.714281 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-a656f4fc-3e23-41d8-908d-b19de2b632d4 tempest-LiveAutoBlockMigrationV225Test-1358532044 tempest-LiveAutoBlockMigrationV225Test-1358532044-project-admin] 10.222.0.13 "GET /compute/v2.1/os-migrations" status: 200 len: 4223 microversion: 2.25 time: 0.049871 Nov 01 19:00:03.714978 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 842/1636] 10.222.0.13 () {60 vars in 1184 bytes} [Tue Nov 1 19:00:03 2022] GET /compute/v2.1/os-migrations => generated 4223 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 19:00:03.726537 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-ddace11f-2131-4f1f-9c86-4a5a4ebc23c5 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:00:03.733550 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-ddace11f-2131-4f1f-9c86-4a5a4ebc23c5 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] [instance: f35d5fdd-4a95-4b57-a506-665fa3f393c1] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:00:03.739499 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-7acec38f-c67b-42d0-9574-df2702090f14 req-c0cfcf62-b60f-4384-8d89-3a01474da809 service nova] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:03.740143 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-7acec38f-c67b-42d0-9574-df2702090f14 req-c0cfcf62-b60f-4384-8d89-3a01474da809 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:03.740918 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-7acec38f-c67b-42d0-9574-df2702090f14 req-c0cfcf62-b60f-4384-8d89-3a01474da809 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:03.759222 n-d-863052-2 devstack@n-api.service[121402]: DEBUG dbcounter [-] [121402] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=121402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 19:00:03.765077 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-ddace11f-2131-4f1f-9c86-4a5a4ebc23c5 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:03.766033 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-ddace11f-2131-4f1f-9c86-4a5a4ebc23c5 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:03.766704 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-ddace11f-2131-4f1f-9c86-4a5a4ebc23c5 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:03.768282 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-ddace11f-2131-4f1f-9c86-4a5a4ebc23c5 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:03.769030 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-ddace11f-2131-4f1f-9c86-4a5a4ebc23c5 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:03.769722 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-ddace11f-2131-4f1f-9c86-4a5a4ebc23c5 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:03.773356 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.compute.server_external_events [req-7acec38f-c67b-42d0-9574-df2702090f14 req-c0cfcf62-b60f-4384-8d89-3a01474da809 service nova] Creating event network-vif-plugged:91ce416d-c08f-473f-a551-fa3519a6c6c7 for instance d8e88b0f-ae97-44a4-8b6b-b94e2c600a83 on n-h1-863052-2 Nov 01 19:00:03.788934 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [req-7acec38f-c67b-42d0-9574-df2702090f14 req-c0cfcf62-b60f-4384-8d89-3a01474da809 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096548 Nov 01 19:00:03.791810 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 795/1637] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Nov 1 19:00:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:00:03.805156 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [req-5fcd25f8-d25f-4d2c-bdbe-f8f685ce9fb9 req-8d3bba13-a834-4b4d-a12f-7c5002c624af service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "90b353ab-ef97-4d88-b5bc-b355ff576225", "tag": "773bb149-e7e8-4592-bede-bd40ac6e3e49"}]} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:00:03.843554 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-5fcd25f8-d25f-4d2c-bdbe-f8f685ce9fb9 req-8d3bba13-a834-4b4d-a12f-7c5002c624af service nova] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:03.850827 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-5fcd25f8-d25f-4d2c-bdbe-f8f685ce9fb9 req-8d3bba13-a834-4b4d-a12f-7c5002c624af service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:03.851212 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-5fcd25f8-d25f-4d2c-bdbe-f8f685ce9fb9 req-8d3bba13-a834-4b4d-a12f-7c5002c624af service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:03.898539 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.compute.server_external_events [req-5fcd25f8-d25f-4d2c-bdbe-f8f685ce9fb9 req-8d3bba13-a834-4b4d-a12f-7c5002c624af service nova] Creating event network-changed:773bb149-e7e8-4592-bede-bd40ac6e3e49 for instance 90b353ab-ef97-4d88-b5bc-b355ff576225 on n-h1-863052-2 Nov 01 19:00:03.918143 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [req-5fcd25f8-d25f-4d2c-bdbe-f8f685ce9fb9 req-8d3bba13-a834-4b4d-a12f-7c5002c624af service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.124239 Nov 01 19:00:03.919876 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 796/1638] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Nov 1 19:00:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:00:03.943070 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-c6e7dbf5-16d1-4f99-a082-3abaea0d5b0c tempest-LiveAutoBlockMigrationV225Test-1358532044 tempest-LiveAutoBlockMigrationV225Test-1358532044-project-admin] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:00:03.946230 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-c6e7dbf5-16d1-4f99-a082-3abaea0d5b0c tempest-LiveAutoBlockMigrationV225Test-1358532044 tempest-LiveAutoBlockMigrationV225Test-1358532044-project-admin] [instance: a7f88d19-08ee-47bf-9240-7d49afd775e2] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:00:03.958604 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-c6e7dbf5-16d1-4f99-a082-3abaea0d5b0c tempest-LiveAutoBlockMigrationV225Test-1358532044 tempest-LiveAutoBlockMigrationV225Test-1358532044-project-admin] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:03.960612 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-c6e7dbf5-16d1-4f99-a082-3abaea0d5b0c tempest-LiveAutoBlockMigrationV225Test-1358532044 tempest-LiveAutoBlockMigrationV225Test-1358532044-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:03.964055 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-c6e7dbf5-16d1-4f99-a082-3abaea0d5b0c tempest-LiveAutoBlockMigrationV225Test-1358532044 tempest-LiveAutoBlockMigrationV225Test-1358532044-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:03.965009 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-c6e7dbf5-16d1-4f99-a082-3abaea0d5b0c tempest-LiveAutoBlockMigrationV225Test-1358532044 tempest-LiveAutoBlockMigrationV225Test-1358532044-project-admin] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:03.966153 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-c6e7dbf5-16d1-4f99-a082-3abaea0d5b0c tempest-LiveAutoBlockMigrationV225Test-1358532044 tempest-LiveAutoBlockMigrationV225Test-1358532044-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:03.967025 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-c6e7dbf5-16d1-4f99-a082-3abaea0d5b0c tempest-LiveAutoBlockMigrationV225Test-1358532044 tempest-LiveAutoBlockMigrationV225Test-1358532044-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:04.218327 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.objects.instance [None req-c6e7dbf5-16d1-4f99-a082-3abaea0d5b0c tempest-LiveAutoBlockMigrationV225Test-1358532044 tempest-LiveAutoBlockMigrationV225Test-1358532044-project-admin] Lazy-loading 'services' on Instance uuid a7f88d19-08ee-47bf-9240-7d49afd775e2 {{(pid=121403) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 01 19:00:04.257061 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-c6e7dbf5-16d1-4f99-a082-3abaea0d5b0c tempest-LiveAutoBlockMigrationV225Test-1358532044 tempest-LiveAutoBlockMigrationV225Test-1358532044-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/a7f88d19-08ee-47bf-9240-7d49afd775e2" status: 200 len: 2421 microversion: 2.25 time: 0.333824 Nov 01 19:00:04.259877 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 797/1639] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 19:00:03 2022] GET /compute/v2.1/servers/a7f88d19-08ee-47bf-9240-7d49afd775e2 => generated 2421 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 19:00:04.275948 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-3e3b4811-7086-4b93-baad-e06f6c9599fb tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] Calling method '.version_select at 0x7f0ae68ff820>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:00:04.381938 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-3e3b4811-7086-4b93-baad-e06f6c9599fb tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] 10.222.0.13 "GET /compute/v2.1/images/14008a7c-6542-4124-800d-d352127c1bb1" status: 200 len: 1454 microversion: 2.1 time: 0.120150 Nov 01 19:00:04.383844 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 798/1640] 10.222.0.13 () {58 vars in 1233 bytes} [Tue Nov 1 19:00:04 2022] GET /compute/v2.1/images/14008a7c-6542-4124-800d-d352127c1bb1 => generated 1454 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:00:04.405154 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-a188cffc-5fdb-499a-b35d-ed907a4b1968 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:00:04.408055 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-a188cffc-5fdb-499a-b35d-ed907a4b1968 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] [instance: 68b54f50-6b4d-4ea3-877f-c7ac79a5bb86] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:00:04.441360 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-ddace11f-2131-4f1f-9c86-4a5a4ebc23c5 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0290a6bb8bc24b8988a925327ac0381c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86941784237549838bba63ce88053b88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:00:04.444447 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-a188cffc-5fdb-499a-b35d-ed907a4b1968 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:04.453329 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-a188cffc-5fdb-499a-b35d-ed907a4b1968 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:04.454432 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-a188cffc-5fdb-499a-b35d-ed907a4b1968 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:04.454977 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-ddace11f-2131-4f1f-9c86-4a5a4ebc23c5 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] 10.222.0.13 "GET /compute/v2.1/servers/f35d5fdd-4a95-4b57-a506-665fa3f393c1" status: 200 len: 1317 microversion: 2.1 time: 0.736765 Nov 01 19:00:04.455210 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-a188cffc-5fdb-499a-b35d-ed907a4b1968 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:04.455693 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-a188cffc-5fdb-499a-b35d-ed907a4b1968 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:04.456131 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-a188cffc-5fdb-499a-b35d-ed907a4b1968 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:04.456697 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 843/1641] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:00:03 2022] GET /compute/v2.1/servers/f35d5fdd-4a95-4b57-a506-665fa3f393c1 => generated 1317 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:00:04.467783 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-45b72e00-fcb8-479d-a069-40f31e08df25 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:00:04.478407 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-45b72e00-fcb8-479d-a069-40f31e08df25 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] [instance: a7f88d19-08ee-47bf-9240-7d49afd775e2] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:00:04.492130 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-45b72e00-fcb8-479d-a069-40f31e08df25 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:04.495036 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-45b72e00-fcb8-479d-a069-40f31e08df25 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:04.496298 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-45b72e00-fcb8-479d-a069-40f31e08df25 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:04.498991 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-45b72e00-fcb8-479d-a069-40f31e08df25 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:04.500182 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-45b72e00-fcb8-479d-a069-40f31e08df25 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:04.503457 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-45b72e00-fcb8-479d-a069-40f31e08df25 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:04.542824 n-d-863052-2 devstack@n-api.service[121403]: DEBUG dbcounter [-] [121403] Writing DB stats nova_cell1:SELECT=100 {{(pid=121403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 19:00:04.784058 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.objects.instance [None req-45b72e00-fcb8-479d-a069-40f31e08df25 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lazy-loading 'services' on Instance uuid a7f88d19-08ee-47bf-9240-7d49afd775e2 {{(pid=121402) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 01 19:00:04.806594 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-a188cffc-5fdb-499a-b35d-ed907a4b1968 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a9c3b6a8c34f068caa50dc10d13a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9ef08eba0ef431285fd15a2561b4e5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:00:04.817894 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-a188cffc-5fdb-499a-b35d-ed907a4b1968 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] 10.222.0.13 "GET /compute/v2.1/servers/68b54f50-6b4d-4ea3-877f-c7ac79a5bb86" status: 200 len: 1273 microversion: 2.1 time: 0.429745 Nov 01 19:00:04.822104 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 799/1642] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:00:04 2022] GET /compute/v2.1/servers/68b54f50-6b4d-4ea3-877f-c7ac79a5bb86 => generated 1273 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:00:04.832576 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-f8599c50-85a2-4a16-905b-dc33eb445168 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:00:04.836210 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-f8599c50-85a2-4a16-905b-dc33eb445168 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] [instance: 1f499af7-1896-478c-b7d7-d922bf78bd98] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:00:04.851196 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f8599c50-85a2-4a16-905b-dc33eb445168 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:04.851196 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f8599c50-85a2-4a16-905b-dc33eb445168 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:04.851603 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f8599c50-85a2-4a16-905b-dc33eb445168 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:04.858260 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f8599c50-85a2-4a16-905b-dc33eb445168 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:04.858765 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f8599c50-85a2-4a16-905b-dc33eb445168 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:04.862577 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f8599c50-85a2-4a16-905b-dc33eb445168 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:04.981203 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-45b72e00-fcb8-479d-a069-40f31e08df25 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] 10.222.0.13 "DELETE /compute/v2.1/servers/a7f88d19-08ee-47bf-9240-7d49afd775e2/os-volume_attachments/fa605d49-a0c2-49cc-9e9b-f7325776aa31" status: 202 len: 0 microversion: 2.25 time: 0.521224 Nov 01 19:00:04.983710 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 844/1643] 10.222.0.13 () {60 vars in 1457 bytes} [Tue Nov 1 19:00:04 2022] DELETE /compute/v2.1/servers/a7f88d19-08ee-47bf-9240-7d49afd775e2/os-volume_attachments/fa605d49-a0c2-49cc-9e9b-f7325776aa31 => generated 0 bytes in 525 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 01 19:00:04.993286 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-9795a3fc-91c7-4cd2-bc2d-686faeec31a2 tempest-ServersTestFqdnHostnames-269349818 tempest-ServersTestFqdnHostnames-269349818-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:00:04.994423 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-9795a3fc-91c7-4cd2-bc2d-686faeec31a2 tempest-ServersTestFqdnHostnames-269349818 tempest-ServersTestFqdnHostnames-269349818-project] [instance: 04443e90-21e9-4b5e-99e8-350f07e4ea82] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:00:05.005603 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-9795a3fc-91c7-4cd2-bc2d-686faeec31a2 tempest-ServersTestFqdnHostnames-269349818 tempest-ServersTestFqdnHostnames-269349818-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:05.006381 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-9795a3fc-91c7-4cd2-bc2d-686faeec31a2 tempest-ServersTestFqdnHostnames-269349818 tempest-ServersTestFqdnHostnames-269349818-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:05.006982 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-9795a3fc-91c7-4cd2-bc2d-686faeec31a2 tempest-ServersTestFqdnHostnames-269349818 tempest-ServersTestFqdnHostnames-269349818-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:05.008067 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-9795a3fc-91c7-4cd2-bc2d-686faeec31a2 tempest-ServersTestFqdnHostnames-269349818 tempest-ServersTestFqdnHostnames-269349818-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:05.008809 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-9795a3fc-91c7-4cd2-bc2d-686faeec31a2 tempest-ServersTestFqdnHostnames-269349818 tempest-ServersTestFqdnHostnames-269349818-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:05.009419 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-9795a3fc-91c7-4cd2-bc2d-686faeec31a2 tempest-ServersTestFqdnHostnames-269349818 tempest-ServersTestFqdnHostnames-269349818-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:05.311381 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-f8599c50-85a2-4a16-905b-dc33eb445168 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f32f5fba1976432d938e664c7714e52b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b9d4c236b944f9b2e8e502a50a8f8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:00:05.325995 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-f8599c50-85a2-4a16-905b-dc33eb445168 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] 10.222.0.13 "GET /compute/v2.1/servers/1f499af7-1896-478c-b7d7-d922bf78bd98" status: 200 len: 1211 microversion: 2.1 time: 0.501184 Nov 01 19:00:05.342603 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 800/1644] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:00:04 2022] GET /compute/v2.1/servers/1f499af7-1896-478c-b7d7-d922bf78bd98 => generated 1211 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:00:05.351386 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-21f81197-e148-49ea-99c9-490913475293 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:00:05.352699 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-21f81197-e148-49ea-99c9-490913475293 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] [instance: f6762e10-9d45-47cf-a6b6-d9bfc3404664] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:00:05.359918 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-21f81197-e148-49ea-99c9-490913475293 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:05.360543 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-21f81197-e148-49ea-99c9-490913475293 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:05.360943 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-21f81197-e148-49ea-99c9-490913475293 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:05.361678 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-21f81197-e148-49ea-99c9-490913475293 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:05.362117 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-21f81197-e148-49ea-99c9-490913475293 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:05.363030 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-21f81197-e148-49ea-99c9-490913475293 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:05.398487 n-d-863052-2 devstack@n-api.service[121402]: DEBUG dbcounter [-] [121402] Writing DB stats nova_cell0:SELECT=2 {{(pid=121402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 19:00:05.550928 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-9795a3fc-91c7-4cd2-bc2d-686faeec31a2 tempest-ServersTestFqdnHostnames-269349818 tempest-ServersTestFqdnHostnames-269349818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d33ca3478b7455dad5094afee57c8b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfea57f34b844c77b22619105249d08a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:00:05.572148 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-9795a3fc-91c7-4cd2-bc2d-686faeec31a2 tempest-ServersTestFqdnHostnames-269349818 tempest-ServersTestFqdnHostnames-269349818-project] 10.222.0.13 "GET /compute/v2.1/servers/04443e90-21e9-4b5e-99e8-350f07e4ea82" status: 200 len: 1352 microversion: 2.1 time: 0.586532 Nov 01 19:00:05.575866 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 845/1645] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:00:04 2022] GET /compute/v2.1/servers/04443e90-21e9-4b5e-99e8-350f07e4ea82 => generated 1352 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:00:05.588539 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-c94a1fe7-a48a-40ce-ad85-88871754553e tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:00:05.597991 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-c94a1fe7-a48a-40ce-ad85-88871754553e tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] [instance: a7f88d19-08ee-47bf-9240-7d49afd775e2] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:00:05.625494 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-c94a1fe7-a48a-40ce-ad85-88871754553e tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:05.629130 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-c94a1fe7-a48a-40ce-ad85-88871754553e tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:05.629806 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-c94a1fe7-a48a-40ce-ad85-88871754553e tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:05.630748 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-c94a1fe7-a48a-40ce-ad85-88871754553e tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:05.633511 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-c94a1fe7-a48a-40ce-ad85-88871754553e tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:05.634371 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-c94a1fe7-a48a-40ce-ad85-88871754553e tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:05.641335 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-21f81197-e148-49ea-99c9-490913475293 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72117f17294649d6b8bc16c66c7efab2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45d4c047d3c44324a27a27831236ab0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:00:05.668254 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-21f81197-e148-49ea-99c9-490913475293 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] 10.222.0.13 "GET /compute/v2.1/servers/f6762e10-9d45-47cf-a6b6-d9bfc3404664" status: 200 len: 1477 microversion: 2.1 time: 0.324079 Nov 01 19:00:05.687682 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 801/1646] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:00:05 2022] GET /compute/v2.1/servers/f6762e10-9d45-47cf-a6b6-d9bfc3404664 => generated 1477 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:00:05.698443 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-310c823c-c80c-455a-99e6-27621838219c tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] Calling method '.version_select at 0x7f0ae6822f70>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:00:05.719773 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-c94a1fe7-a48a-40ce-ad85-88871754553e tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] 10.222.0.13 "GET /compute/v2.1/servers/a7f88d19-08ee-47bf-9240-7d49afd775e2/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.142341 Nov 01 19:00:05.725518 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 846/1647] 10.222.0.13 () {60 vars in 1343 bytes} [Tue Nov 1 19:00:05 2022] GET /compute/v2.1/servers/a7f88d19-08ee-47bf-9240-7d49afd775e2/os-volume_attachments => generated 197 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 01 19:00:05.732377 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-9b04d095-0a6e-4d5d-981e-433ccd961616 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:00:05.733417 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-9b04d095-0a6e-4d5d-981e-433ccd961616 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] [instance: f35d5fdd-4a95-4b57-a506-665fa3f393c1] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:00:05.753820 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-9b04d095-0a6e-4d5d-981e-433ccd961616 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:05.756724 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-9b04d095-0a6e-4d5d-981e-433ccd961616 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:05.757304 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-9b04d095-0a6e-4d5d-981e-433ccd961616 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:05.761854 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-9b04d095-0a6e-4d5d-981e-433ccd961616 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:05.762391 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-9b04d095-0a6e-4d5d-981e-433ccd961616 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:05.762829 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-9b04d095-0a6e-4d5d-981e-433ccd961616 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:05.773086 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-310c823c-c80c-455a-99e6-27621838219c tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] 10.222.0.13 "GET /compute/v2.1/images/14008a7c-6542-4124-800d-d352127c1bb1" status: 200 len: 1454 microversion: 2.1 time: 0.084098 Nov 01 19:00:05.774054 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 802/1648] 10.222.0.13 () {58 vars in 1233 bytes} [Tue Nov 1 19:00:05 2022] GET /compute/v2.1/images/14008a7c-6542-4124-800d-d352127c1bb1 => generated 1454 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:00:05.847845 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-7235428e-9f77-417d-8eb4-32efd0fec925 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:00:05.848882 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-7235428e-9f77-417d-8eb4-32efd0fec925 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] [instance: 68b54f50-6b4d-4ea3-877f-c7ac79a5bb86] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:00:05.866053 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-7235428e-9f77-417d-8eb4-32efd0fec925 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:05.867988 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-7235428e-9f77-417d-8eb4-32efd0fec925 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:05.869818 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-7235428e-9f77-417d-8eb4-32efd0fec925 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:05.872959 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-7235428e-9f77-417d-8eb4-32efd0fec925 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:05.874107 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-7235428e-9f77-417d-8eb4-32efd0fec925 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:05.876256 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-7235428e-9f77-417d-8eb4-32efd0fec925 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:06.257259 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-7235428e-9f77-417d-8eb4-32efd0fec925 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a9c3b6a8c34f068caa50dc10d13a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9ef08eba0ef431285fd15a2561b4e5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:00:06.269671 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-7235428e-9f77-417d-8eb4-32efd0fec925 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] 10.222.0.13 "GET /compute/v2.1/servers/68b54f50-6b4d-4ea3-877f-c7ac79a5bb86" status: 200 len: 1315 microversion: 2.1 time: 0.426094 Nov 01 19:00:06.272595 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 803/1649] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:00:05 2022] GET /compute/v2.1/servers/68b54f50-6b4d-4ea3-877f-c7ac79a5bb86 => generated 1315 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 19:00:06.355993 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-771819ff-2c92-40fd-90c8-a85f7eedfc94 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:00:06.356983 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-771819ff-2c92-40fd-90c8-a85f7eedfc94 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] [instance: 1f499af7-1896-478c-b7d7-d922bf78bd98] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:00:06.370318 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-771819ff-2c92-40fd-90c8-a85f7eedfc94 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:06.371012 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-771819ff-2c92-40fd-90c8-a85f7eedfc94 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:06.373945 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-771819ff-2c92-40fd-90c8-a85f7eedfc94 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:06.376228 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-771819ff-2c92-40fd-90c8-a85f7eedfc94 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:06.378481 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-771819ff-2c92-40fd-90c8-a85f7eedfc94 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:06.379106 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-771819ff-2c92-40fd-90c8-a85f7eedfc94 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:06.663344 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-771819ff-2c92-40fd-90c8-a85f7eedfc94 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f32f5fba1976432d938e664c7714e52b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b9d4c236b944f9b2e8e502a50a8f8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:00:06.673783 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-771819ff-2c92-40fd-90c8-a85f7eedfc94 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] 10.222.0.13 "GET /compute/v2.1/servers/1f499af7-1896-478c-b7d7-d922bf78bd98" status: 200 len: 1211 microversion: 2.1 time: 0.322724 Nov 01 19:00:06.677523 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 804/1650] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:00:06 2022] GET /compute/v2.1/servers/1f499af7-1896-478c-b7d7-d922bf78bd98 => generated 1211 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 19:00:06.693671 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [req-712a9bb9-e12a-4dd7-8631-ca0c17a8aaad req-ee8a7fd4-6119-4ddc-9b79-90d127740364 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "04443e90-21e9-4b5e-99e8-350f07e4ea82", "tag": "b9e488b8-901e-4fc1-abb5-b279e9c4057a"}]} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:00:06.708318 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-712a9bb9-e12a-4dd7-8631-ca0c17a8aaad req-ee8a7fd4-6119-4ddc-9b79-90d127740364 service nova] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:06.709183 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-712a9bb9-e12a-4dd7-8631-ca0c17a8aaad req-ee8a7fd4-6119-4ddc-9b79-90d127740364 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:06.709795 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-712a9bb9-e12a-4dd7-8631-ca0c17a8aaad req-ee8a7fd4-6119-4ddc-9b79-90d127740364 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:06.724877 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.compute.server_external_events [req-712a9bb9-e12a-4dd7-8631-ca0c17a8aaad req-ee8a7fd4-6119-4ddc-9b79-90d127740364 service nova] Creating event network-changed:b9e488b8-901e-4fc1-abb5-b279e9c4057a for instance 04443e90-21e9-4b5e-99e8-350f07e4ea82 on n-h1-863052-2 Nov 01 19:00:06.734949 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [req-712a9bb9-e12a-4dd7-8631-ca0c17a8aaad req-ee8a7fd4-6119-4ddc-9b79-90d127740364 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055873 Nov 01 19:00:06.735777 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 805/1651] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Nov 1 19:00:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:00:06.741994 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-127a60f2-fdda-4ed1-9d21-e76543670f38 tempest-ServersTestFqdnHostnames-269349818 tempest-ServersTestFqdnHostnames-269349818-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:00:06.742921 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-127a60f2-fdda-4ed1-9d21-e76543670f38 tempest-ServersTestFqdnHostnames-269349818 tempest-ServersTestFqdnHostnames-269349818-project] [instance: 04443e90-21e9-4b5e-99e8-350f07e4ea82] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:00:06.749665 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-127a60f2-fdda-4ed1-9d21-e76543670f38 tempest-ServersTestFqdnHostnames-269349818 tempest-ServersTestFqdnHostnames-269349818-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:06.750383 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-127a60f2-fdda-4ed1-9d21-e76543670f38 tempest-ServersTestFqdnHostnames-269349818 tempest-ServersTestFqdnHostnames-269349818-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:06.753070 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-127a60f2-fdda-4ed1-9d21-e76543670f38 tempest-ServersTestFqdnHostnames-269349818 tempest-ServersTestFqdnHostnames-269349818-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:06.754712 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-127a60f2-fdda-4ed1-9d21-e76543670f38 tempest-ServersTestFqdnHostnames-269349818 tempest-ServersTestFqdnHostnames-269349818-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:06.755390 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-127a60f2-fdda-4ed1-9d21-e76543670f38 tempest-ServersTestFqdnHostnames-269349818 tempest-ServersTestFqdnHostnames-269349818-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:06.756540 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-127a60f2-fdda-4ed1-9d21-e76543670f38 tempest-ServersTestFqdnHostnames-269349818 tempest-ServersTestFqdnHostnames-269349818-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:06.857727 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-9b04d095-0a6e-4d5d-981e-433ccd961616 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0290a6bb8bc24b8988a925327ac0381c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86941784237549838bba63ce88053b88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:00:06.866307 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-9b04d095-0a6e-4d5d-981e-433ccd961616 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] 10.222.0.13 "GET /compute/v2.1/servers/f35d5fdd-4a95-4b57-a506-665fa3f393c1" status: 200 len: 1317 microversion: 2.1 time: 1.139522 Nov 01 19:00:06.867445 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 847/1652] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:00:05 2022] GET /compute/v2.1/servers/f35d5fdd-4a95-4b57-a506-665fa3f393c1 => generated 1317 bytes in 1141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:00:06.874412 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-d45b2501-ff84-4a07-b81e-cf976f70596d tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:00:06.875291 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-d45b2501-ff84-4a07-b81e-cf976f70596d tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] [instance: f6762e10-9d45-47cf-a6b6-d9bfc3404664] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:00:06.882454 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-d45b2501-ff84-4a07-b81e-cf976f70596d tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:06.883274 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-d45b2501-ff84-4a07-b81e-cf976f70596d tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:06.884052 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-d45b2501-ff84-4a07-b81e-cf976f70596d tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:06.885043 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-d45b2501-ff84-4a07-b81e-cf976f70596d tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:06.885723 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-d45b2501-ff84-4a07-b81e-cf976f70596d tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:06.886376 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-d45b2501-ff84-4a07-b81e-cf976f70596d tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:07.424099 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-127a60f2-fdda-4ed1-9d21-e76543670f38 tempest-ServersTestFqdnHostnames-269349818 tempest-ServersTestFqdnHostnames-269349818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d33ca3478b7455dad5094afee57c8b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfea57f34b844c77b22619105249d08a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:00:07.434380 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-127a60f2-fdda-4ed1-9d21-e76543670f38 tempest-ServersTestFqdnHostnames-269349818 tempest-ServersTestFqdnHostnames-269349818-project] 10.222.0.13 "GET /compute/v2.1/servers/04443e90-21e9-4b5e-99e8-350f07e4ea82" status: 200 len: 1352 microversion: 2.1 time: 0.696906 Nov 01 19:00:07.434964 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 806/1653] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:00:06 2022] GET /compute/v2.1/servers/04443e90-21e9-4b5e-99e8-350f07e4ea82 => generated 1352 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:00:07.453624 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-77243b40-a9c1-4207-8509-ebd1d43f5c92 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:00:07.456408 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-77243b40-a9c1-4207-8509-ebd1d43f5c92 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] [instance: a7f88d19-08ee-47bf-9240-7d49afd775e2] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:00:07.467327 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-77243b40-a9c1-4207-8509-ebd1d43f5c92 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:07.468217 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-77243b40-a9c1-4207-8509-ebd1d43f5c92 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:07.468976 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-77243b40-a9c1-4207-8509-ebd1d43f5c92 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:07.470216 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-77243b40-a9c1-4207-8509-ebd1d43f5c92 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:07.470894 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-77243b40-a9c1-4207-8509-ebd1d43f5c92 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:07.471544 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-77243b40-a9c1-4207-8509-ebd1d43f5c92 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:07.588637 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-77243b40-a9c1-4207-8509-ebd1d43f5c92 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] 10.222.0.13 "GET /compute/v2.1/servers/a7f88d19-08ee-47bf-9240-7d49afd775e2/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.146878 Nov 01 19:00:07.589455 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 807/1654] 10.222.0.13 () {60 vars in 1343 bytes} [Tue Nov 1 19:00:07 2022] GET /compute/v2.1/servers/a7f88d19-08ee-47bf-9240-7d49afd775e2/os-volume_attachments => generated 197 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 01 19:00:07.594648 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-f14e0121-0ba8-4ab7-bc83-e625e1fe1756 tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] Calling method '.version_select at 0x7f0ae66e9310>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:00:07.660000 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-f14e0121-0ba8-4ab7-bc83-e625e1fe1756 tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] 10.222.0.13 "GET /compute/v2.1/images/14008a7c-6542-4124-800d-d352127c1bb1" status: 200 len: 1454 microversion: 2.1 time: 0.069587 Nov 01 19:00:07.661493 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 808/1655] 10.222.0.13 () {58 vars in 1233 bytes} [Tue Nov 1 19:00:07 2022] GET /compute/v2.1/images/14008a7c-6542-4124-800d-d352127c1bb1 => generated 1454 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:00:07.673135 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-e8b271af-63f1-4fbf-ae0d-33fa10920be2 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:00:07.674496 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-e8b271af-63f1-4fbf-ae0d-33fa10920be2 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] [instance: 68b54f50-6b4d-4ea3-877f-c7ac79a5bb86] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:00:07.688118 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-e8b271af-63f1-4fbf-ae0d-33fa10920be2 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:07.690523 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-e8b271af-63f1-4fbf-ae0d-33fa10920be2 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:07.693998 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-e8b271af-63f1-4fbf-ae0d-33fa10920be2 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:07.694782 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-e8b271af-63f1-4fbf-ae0d-33fa10920be2 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:07.695260 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-e8b271af-63f1-4fbf-ae0d-33fa10920be2 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:07.695701 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-e8b271af-63f1-4fbf-ae0d-33fa10920be2 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:07.944003 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-e8b271af-63f1-4fbf-ae0d-33fa10920be2 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a9c3b6a8c34f068caa50dc10d13a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9ef08eba0ef431285fd15a2561b4e5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:00:07.954969 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-e8b271af-63f1-4fbf-ae0d-33fa10920be2 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] 10.222.0.13 "GET /compute/v2.1/servers/68b54f50-6b4d-4ea3-877f-c7ac79a5bb86" status: 200 len: 1315 microversion: 2.1 time: 0.292267 Nov 01 19:00:07.956089 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 809/1656] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:00:07 2022] GET /compute/v2.1/servers/68b54f50-6b4d-4ea3-877f-c7ac79a5bb86 => generated 1315 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:00:07.967255 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-457147dd-048c-4541-9832-ba4b5ea83be9 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:00:07.968114 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-457147dd-048c-4541-9832-ba4b5ea83be9 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] [instance: 1f499af7-1896-478c-b7d7-d922bf78bd98] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:00:07.988075 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-457147dd-048c-4541-9832-ba4b5ea83be9 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:07.988881 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-457147dd-048c-4541-9832-ba4b5ea83be9 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:07.989491 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-457147dd-048c-4541-9832-ba4b5ea83be9 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:07.990591 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-457147dd-048c-4541-9832-ba4b5ea83be9 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:07.991218 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-457147dd-048c-4541-9832-ba4b5ea83be9 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:07.991839 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-457147dd-048c-4541-9832-ba4b5ea83be9 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:08.029566 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-d45b2501-ff84-4a07-b81e-cf976f70596d tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72117f17294649d6b8bc16c66c7efab2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45d4c047d3c44324a27a27831236ab0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:00:08.037351 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-d45b2501-ff84-4a07-b81e-cf976f70596d tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] 10.222.0.13 "GET /compute/v2.1/servers/f6762e10-9d45-47cf-a6b6-d9bfc3404664" status: 200 len: 1477 microversion: 2.1 time: 1.168107 Nov 01 19:00:08.037932 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 848/1657] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:00:06 2022] GET /compute/v2.1/servers/f6762e10-9d45-47cf-a6b6-d9bfc3404664 => generated 1477 bytes in 1170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:00:08.054535 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-da0bb50f-938c-4b63-b319-23b99b9cdd30 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:00:08.055147 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-da0bb50f-938c-4b63-b319-23b99b9cdd30 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] [instance: f35d5fdd-4a95-4b57-a506-665fa3f393c1] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:00:08.085310 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-da0bb50f-938c-4b63-b319-23b99b9cdd30 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:08.085814 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-da0bb50f-938c-4b63-b319-23b99b9cdd30 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:08.086249 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-da0bb50f-938c-4b63-b319-23b99b9cdd30 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:08.086959 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-da0bb50f-938c-4b63-b319-23b99b9cdd30 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:08.087409 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-da0bb50f-938c-4b63-b319-23b99b9cdd30 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:08.087829 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-da0bb50f-938c-4b63-b319-23b99b9cdd30 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:08.112151 n-d-863052-2 devstack@n-api.service[121402]: DEBUG dbcounter [-] [121402] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=121402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 19:00:08.448901 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-457147dd-048c-4541-9832-ba4b5ea83be9 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f32f5fba1976432d938e664c7714e52b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b9d4c236b944f9b2e8e502a50a8f8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:00:08.484603 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-457147dd-048c-4541-9832-ba4b5ea83be9 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] 10.222.0.13 "GET /compute/v2.1/servers/1f499af7-1896-478c-b7d7-d922bf78bd98" status: 200 len: 1211 microversion: 2.1 time: 0.526994 Nov 01 19:00:08.490526 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 810/1658] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:00:07 2022] GET /compute/v2.1/servers/1f499af7-1896-478c-b7d7-d922bf78bd98 => generated 1211 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:00:08.498094 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [req-5b4f04f5-0aa4-4ec8-a3a8-d01c5d47127f req-bdf7c613-88f2-492b-8e74-72c9cb079aa1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1f499af7-1896-478c-b7d7-d922bf78bd98", "tag": "a463e9d5-3409-4b7b-97cb-4970df239917"}]} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:00:08.525633 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-5b4f04f5-0aa4-4ec8-a3a8-d01c5d47127f req-bdf7c613-88f2-492b-8e74-72c9cb079aa1 service nova] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:08.526558 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-5b4f04f5-0aa4-4ec8-a3a8-d01c5d47127f req-bdf7c613-88f2-492b-8e74-72c9cb079aa1 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:08.527229 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-5b4f04f5-0aa4-4ec8-a3a8-d01c5d47127f req-bdf7c613-88f2-492b-8e74-72c9cb079aa1 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:08.541273 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.compute.server_external_events [req-5b4f04f5-0aa4-4ec8-a3a8-d01c5d47127f req-bdf7c613-88f2-492b-8e74-72c9cb079aa1 service nova] Creating event network-changed:a463e9d5-3409-4b7b-97cb-4970df239917 for instance 1f499af7-1896-478c-b7d7-d922bf78bd98 on n-h1-863052-2 Nov 01 19:00:08.561632 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [req-5b4f04f5-0aa4-4ec8-a3a8-d01c5d47127f req-bdf7c613-88f2-492b-8e74-72c9cb079aa1 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062155 Nov 01 19:00:08.563270 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 811/1659] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Nov 1 19:00:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:00:08.571173 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-fad59b28-4b26-49f6-b455-ef2a4ef1fbc7 tempest-ServersTestFqdnHostnames-269349818 tempest-ServersTestFqdnHostnames-269349818-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:00:08.572183 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-fad59b28-4b26-49f6-b455-ef2a4ef1fbc7 tempest-ServersTestFqdnHostnames-269349818 tempest-ServersTestFqdnHostnames-269349818-project] [instance: 04443e90-21e9-4b5e-99e8-350f07e4ea82] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:00:08.580697 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-fad59b28-4b26-49f6-b455-ef2a4ef1fbc7 tempest-ServersTestFqdnHostnames-269349818 tempest-ServersTestFqdnHostnames-269349818-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:08.581471 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-fad59b28-4b26-49f6-b455-ef2a4ef1fbc7 tempest-ServersTestFqdnHostnames-269349818 tempest-ServersTestFqdnHostnames-269349818-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:08.582066 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-fad59b28-4b26-49f6-b455-ef2a4ef1fbc7 tempest-ServersTestFqdnHostnames-269349818 tempest-ServersTestFqdnHostnames-269349818-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:08.582976 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-fad59b28-4b26-49f6-b455-ef2a4ef1fbc7 tempest-ServersTestFqdnHostnames-269349818 tempest-ServersTestFqdnHostnames-269349818-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:08.583628 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-fad59b28-4b26-49f6-b455-ef2a4ef1fbc7 tempest-ServersTestFqdnHostnames-269349818 tempest-ServersTestFqdnHostnames-269349818-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:08.584979 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-fad59b28-4b26-49f6-b455-ef2a4ef1fbc7 tempest-ServersTestFqdnHostnames-269349818 tempest-ServersTestFqdnHostnames-269349818-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:08.953085 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-fad59b28-4b26-49f6-b455-ef2a4ef1fbc7 tempest-ServersTestFqdnHostnames-269349818 tempest-ServersTestFqdnHostnames-269349818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d33ca3478b7455dad5094afee57c8b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfea57f34b844c77b22619105249d08a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:00:08.962504 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-fad59b28-4b26-49f6-b455-ef2a4ef1fbc7 tempest-ServersTestFqdnHostnames-269349818 tempest-ServersTestFqdnHostnames-269349818-project] 10.222.0.13 "GET /compute/v2.1/servers/04443e90-21e9-4b5e-99e8-350f07e4ea82" status: 200 len: 1352 microversion: 2.1 time: 0.397623 Nov 01 19:00:08.966414 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 812/1660] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:00:08 2022] GET /compute/v2.1/servers/04443e90-21e9-4b5e-99e8-350f07e4ea82 => generated 1352 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:00:08.983304 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-4b781a5b-2415-448f-82fe-25299229328f tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:00:08.987122 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-4b781a5b-2415-448f-82fe-25299229328f tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] [instance: a7f88d19-08ee-47bf-9240-7d49afd775e2] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:00:08.994150 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-4b781a5b-2415-448f-82fe-25299229328f tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:08.994961 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-4b781a5b-2415-448f-82fe-25299229328f tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:08.995655 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-4b781a5b-2415-448f-82fe-25299229328f tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:08.996947 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-4b781a5b-2415-448f-82fe-25299229328f tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:08.997699 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-4b781a5b-2415-448f-82fe-25299229328f tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:08.998358 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-4b781a5b-2415-448f-82fe-25299229328f tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:09.041620 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-4b781a5b-2415-448f-82fe-25299229328f tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] 10.222.0.13 "GET /compute/v2.1/servers/a7f88d19-08ee-47bf-9240-7d49afd775e2/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.073635 Nov 01 19:00:09.042812 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 813/1661] 10.222.0.13 () {60 vars in 1343 bytes} [Tue Nov 1 19:00:08 2022] GET /compute/v2.1/servers/a7f88d19-08ee-47bf-9240-7d49afd775e2/os-volume_attachments => generated 197 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 01 19:00:09.048976 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-748ef465-af20-424d-af6d-5f39ccc36b23 tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] Calling method '.version_select at 0x7f0ae2a9d280>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:00:09.099308 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-748ef465-af20-424d-af6d-5f39ccc36b23 tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] 10.222.0.13 "GET /compute/v2.1/images/14008a7c-6542-4124-800d-d352127c1bb1" status: 200 len: 1454 microversion: 2.1 time: 0.054363 Nov 01 19:00:09.112073 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 814/1662] 10.222.0.13 () {58 vars in 1233 bytes} [Tue Nov 1 19:00:09 2022] GET /compute/v2.1/images/14008a7c-6542-4124-800d-d352127c1bb1 => generated 1454 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:00:09.122497 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-e7ed0e41-6e79-4ddc-bb7b-a66dde957b76 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:00:09.123398 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-e7ed0e41-6e79-4ddc-bb7b-a66dde957b76 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] [instance: 68b54f50-6b4d-4ea3-877f-c7ac79a5bb86] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:00:09.142655 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-e7ed0e41-6e79-4ddc-bb7b-a66dde957b76 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:09.144980 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-e7ed0e41-6e79-4ddc-bb7b-a66dde957b76 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:09.147268 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-e7ed0e41-6e79-4ddc-bb7b-a66dde957b76 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:09.149055 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-e7ed0e41-6e79-4ddc-bb7b-a66dde957b76 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:09.149832 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-e7ed0e41-6e79-4ddc-bb7b-a66dde957b76 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:09.150538 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-e7ed0e41-6e79-4ddc-bb7b-a66dde957b76 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:09.362102 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-da0bb50f-938c-4b63-b319-23b99b9cdd30 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0290a6bb8bc24b8988a925327ac0381c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86941784237549838bba63ce88053b88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:00:09.378085 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-da0bb50f-938c-4b63-b319-23b99b9cdd30 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] 10.222.0.13 "GET /compute/v2.1/servers/f35d5fdd-4a95-4b57-a506-665fa3f393c1" status: 200 len: 1317 microversion: 2.1 time: 1.339058 Nov 01 19:00:09.398489 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 849/1663] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:00:08 2022] GET /compute/v2.1/servers/f35d5fdd-4a95-4b57-a506-665fa3f393c1 => generated 1317 bytes in 1360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:00:09.407720 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-ee175538-512a-4c92-8aef-d700a7e72fbd tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:00:09.408351 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-ee175538-512a-4c92-8aef-d700a7e72fbd tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] [instance: f6762e10-9d45-47cf-a6b6-d9bfc3404664] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:00:09.442821 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-ee175538-512a-4c92-8aef-d700a7e72fbd tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:09.460755 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-ee175538-512a-4c92-8aef-d700a7e72fbd tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:09.463882 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-ee175538-512a-4c92-8aef-d700a7e72fbd tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:09.467075 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-ee175538-512a-4c92-8aef-d700a7e72fbd tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:09.467588 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-ee175538-512a-4c92-8aef-d700a7e72fbd tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:09.468024 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-ee175538-512a-4c92-8aef-d700a7e72fbd tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:09.709006 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-ee175538-512a-4c92-8aef-d700a7e72fbd tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72117f17294649d6b8bc16c66c7efab2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45d4c047d3c44324a27a27831236ab0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:00:09.709826 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-e7ed0e41-6e79-4ddc-bb7b-a66dde957b76 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a9c3b6a8c34f068caa50dc10d13a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9ef08eba0ef431285fd15a2561b4e5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:00:09.717886 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-ee175538-512a-4c92-8aef-d700a7e72fbd tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] 10.222.0.13 "GET /compute/v2.1/servers/f6762e10-9d45-47cf-a6b6-d9bfc3404664" status: 200 len: 1477 microversion: 2.1 time: 0.318205 Nov 01 19:00:09.718188 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-e7ed0e41-6e79-4ddc-bb7b-a66dde957b76 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] 10.222.0.13 "GET /compute/v2.1/servers/68b54f50-6b4d-4ea3-877f-c7ac79a5bb86" status: 200 len: 1315 microversion: 2.1 time: 0.600413 Nov 01 19:00:09.732607 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 815/1664] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:00:09 2022] GET /compute/v2.1/servers/68b54f50-6b4d-4ea3-877f-c7ac79a5bb86 => generated 1315 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:00:09.732819 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 850/1665] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:00:09 2022] GET /compute/v2.1/servers/f6762e10-9d45-47cf-a6b6-d9bfc3404664 => generated 1477 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:00:09.735088 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-5299fb92-9b0d-4771-ac01-72c47234752d tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:00:09.737270 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-5299fb92-9b0d-4771-ac01-72c47234752d tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] [instance: 1f499af7-1896-478c-b7d7-d922bf78bd98] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:00:09.738893 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [req-56971b42-3f98-4069-b70a-cae109b92cd1 req-88d49794-f240-41c7-a6f6-6eb9e0f4cc26 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "68b54f50-6b4d-4ea3-877f-c7ac79a5bb86", "tag": "07f6f2d6-299c-491b-aa7c-cc5981eba332"}]} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:00:09.749598 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-56971b42-3f98-4069-b70a-cae109b92cd1 req-88d49794-f240-41c7-a6f6-6eb9e0f4cc26 service nova] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:09.750084 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-56971b42-3f98-4069-b70a-cae109b92cd1 req-88d49794-f240-41c7-a6f6-6eb9e0f4cc26 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:09.750599 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-56971b42-3f98-4069-b70a-cae109b92cd1 req-88d49794-f240-41c7-a6f6-6eb9e0f4cc26 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:09.752426 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-5299fb92-9b0d-4771-ac01-72c47234752d tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:09.753200 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-5299fb92-9b0d-4771-ac01-72c47234752d tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:09.753752 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-5299fb92-9b0d-4771-ac01-72c47234752d tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:09.754574 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-5299fb92-9b0d-4771-ac01-72c47234752d tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:09.755133 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-5299fb92-9b0d-4771-ac01-72c47234752d tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:09.755662 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-5299fb92-9b0d-4771-ac01-72c47234752d tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:09.764248 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.compute.server_external_events [req-56971b42-3f98-4069-b70a-cae109b92cd1 req-88d49794-f240-41c7-a6f6-6eb9e0f4cc26 service nova] Creating event network-changed:07f6f2d6-299c-491b-aa7c-cc5981eba332 for instance 68b54f50-6b4d-4ea3-877f-c7ac79a5bb86 on n-h1-863052-2 Nov 01 19:00:09.775881 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [req-56971b42-3f98-4069-b70a-cae109b92cd1 req-88d49794-f240-41c7-a6f6-6eb9e0f4cc26 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055106 Nov 01 19:00:09.776507 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 816/1666] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Nov 1 19:00:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:00:09.994522 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-d22fee63-c05c-4fee-9a17-13981dd3ca5b tempest-ServersTestFqdnHostnames-269349818 tempest-ServersTestFqdnHostnames-269349818-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:00:09.995492 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-d22fee63-c05c-4fee-9a17-13981dd3ca5b tempest-ServersTestFqdnHostnames-269349818 tempest-ServersTestFqdnHostnames-269349818-project] [instance: 04443e90-21e9-4b5e-99e8-350f07e4ea82] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:00:10.008243 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d22fee63-c05c-4fee-9a17-13981dd3ca5b tempest-ServersTestFqdnHostnames-269349818 tempest-ServersTestFqdnHostnames-269349818-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:10.008772 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d22fee63-c05c-4fee-9a17-13981dd3ca5b tempest-ServersTestFqdnHostnames-269349818 tempest-ServersTestFqdnHostnames-269349818-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:10.009218 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d22fee63-c05c-4fee-9a17-13981dd3ca5b tempest-ServersTestFqdnHostnames-269349818 tempest-ServersTestFqdnHostnames-269349818-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:10.009932 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d22fee63-c05c-4fee-9a17-13981dd3ca5b tempest-ServersTestFqdnHostnames-269349818 tempest-ServersTestFqdnHostnames-269349818-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:10.015610 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d22fee63-c05c-4fee-9a17-13981dd3ca5b tempest-ServersTestFqdnHostnames-269349818 tempest-ServersTestFqdnHostnames-269349818-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:10.016187 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d22fee63-c05c-4fee-9a17-13981dd3ca5b tempest-ServersTestFqdnHostnames-269349818 tempest-ServersTestFqdnHostnames-269349818-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:10.094089 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-5299fb92-9b0d-4771-ac01-72c47234752d tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f32f5fba1976432d938e664c7714e52b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b9d4c236b944f9b2e8e502a50a8f8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:00:10.110971 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-5299fb92-9b0d-4771-ac01-72c47234752d tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] 10.222.0.13 "GET /compute/v2.1/servers/1f499af7-1896-478c-b7d7-d922bf78bd98" status: 200 len: 1211 microversion: 2.1 time: 0.380627 Nov 01 19:00:10.111569 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 851/1667] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:00:09 2022] GET /compute/v2.1/servers/1f499af7-1896-478c-b7d7-d922bf78bd98 => generated 1211 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:00:10.118177 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-9ad8bb2c-4c1b-45a1-924a-85151410fa1e tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:00:10.120401 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-9ad8bb2c-4c1b-45a1-924a-85151410fa1e tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] [instance: a7f88d19-08ee-47bf-9240-7d49afd775e2] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:00:10.128796 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-9ad8bb2c-4c1b-45a1-924a-85151410fa1e tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:10.129228 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-9ad8bb2c-4c1b-45a1-924a-85151410fa1e tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:10.129668 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-9ad8bb2c-4c1b-45a1-924a-85151410fa1e tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:10.130382 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-9ad8bb2c-4c1b-45a1-924a-85151410fa1e tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:10.130826 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-9ad8bb2c-4c1b-45a1-924a-85151410fa1e tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:10.131517 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-9ad8bb2c-4c1b-45a1-924a-85151410fa1e tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:10.236805 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-9ad8bb2c-4c1b-45a1-924a-85151410fa1e tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] 10.222.0.13 "GET /compute/v2.1/servers/a7f88d19-08ee-47bf-9240-7d49afd775e2/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.124109 Nov 01 19:00:10.244630 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 852/1668] 10.222.0.13 () {60 vars in 1343 bytes} [Tue Nov 1 19:00:10 2022] GET /compute/v2.1/servers/a7f88d19-08ee-47bf-9240-7d49afd775e2/os-volume_attachments => generated 197 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 01 19:00:10.249799 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-f00133cf-7ad2-45d5-a6df-8a72d50bbae9 tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] Calling method '.version_select at 0x7f0ae1cf9160>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:00:10.285151 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-d22fee63-c05c-4fee-9a17-13981dd3ca5b tempest-ServersTestFqdnHostnames-269349818 tempest-ServersTestFqdnHostnames-269349818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d33ca3478b7455dad5094afee57c8b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfea57f34b844c77b22619105249d08a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:00:10.294483 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-d22fee63-c05c-4fee-9a17-13981dd3ca5b tempest-ServersTestFqdnHostnames-269349818 tempest-ServersTestFqdnHostnames-269349818-project] 10.222.0.13 "GET /compute/v2.1/servers/04443e90-21e9-4b5e-99e8-350f07e4ea82" status: 200 len: 1352 microversion: 2.1 time: 0.303417 Nov 01 19:00:10.295933 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 817/1669] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:00:09 2022] GET /compute/v2.1/servers/04443e90-21e9-4b5e-99e8-350f07e4ea82 => generated 1352 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:00:10.317531 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-f00133cf-7ad2-45d5-a6df-8a72d50bbae9 tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] 10.222.0.13 "GET /compute/v2.1/images/14008a7c-6542-4124-800d-d352127c1bb1" status: 200 len: 1454 microversion: 2.1 time: 0.071467 Nov 01 19:00:10.318531 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 853/1670] 10.222.0.13 () {58 vars in 1233 bytes} [Tue Nov 1 19:00:10 2022] GET /compute/v2.1/images/14008a7c-6542-4124-800d-d352127c1bb1 => generated 1454 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:00:10.401742 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-0fb30075-b95e-4c1f-bddf-af29dca79069 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:00:10.402353 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-0fb30075-b95e-4c1f-bddf-af29dca79069 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] [instance: f35d5fdd-4a95-4b57-a506-665fa3f393c1] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:00:10.418369 n-d-863052-2 devstack@n-api.service[121403]: DEBUG dbcounter [-] [121403] Writing DB stats nova_cell0:SELECT=4 {{(pid=121403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 19:00:10.419089 n-d-863052-2 devstack@n-api.service[121403]: DEBUG dbcounter [-] [121403] Writing DB stats nova_cell0:SELECT=20 {{(pid=121403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 19:00:10.421007 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-0fb30075-b95e-4c1f-bddf-af29dca79069 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:10.421715 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-0fb30075-b95e-4c1f-bddf-af29dca79069 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:10.422127 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-0fb30075-b95e-4c1f-bddf-af29dca79069 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:10.422831 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-0fb30075-b95e-4c1f-bddf-af29dca79069 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:10.423319 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-0fb30075-b95e-4c1f-bddf-af29dca79069 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:10.423756 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-0fb30075-b95e-4c1f-bddf-af29dca79069 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:10.688900 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-0fb30075-b95e-4c1f-bddf-af29dca79069 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0290a6bb8bc24b8988a925327ac0381c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86941784237549838bba63ce88053b88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:00:10.698125 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-0fb30075-b95e-4c1f-bddf-af29dca79069 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] 10.222.0.13 "GET /compute/v2.1/servers/f35d5fdd-4a95-4b57-a506-665fa3f393c1" status: 200 len: 1467 microversion: 2.1 time: 0.300320 Nov 01 19:00:10.700005 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 818/1671] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:00:10 2022] GET /compute/v2.1/servers/f35d5fdd-4a95-4b57-a506-665fa3f393c1 => generated 1467 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:00:10.726032 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-0946fbc0-a712-474c-8ac4-3d4f777c491b tempest-ServersOnMultiNodesTest-1027241392 tempest-ServersOnMultiNodesTest-1027241392-project-admin] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:00:10.726811 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-0946fbc0-a712-474c-8ac4-3d4f777c491b tempest-ServersOnMultiNodesTest-1027241392 tempest-ServersOnMultiNodesTest-1027241392-project-admin] [instance: f35d5fdd-4a95-4b57-a506-665fa3f393c1] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:00:10.736671 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-0946fbc0-a712-474c-8ac4-3d4f777c491b tempest-ServersOnMultiNodesTest-1027241392 tempest-ServersOnMultiNodesTest-1027241392-project-admin] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:10.745542 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-a8e967b1-54f7-4862-8ff2-8e861c93a051 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:00:10.746081 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-a8e967b1-54f7-4862-8ff2-8e861c93a051 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] [instance: 68b54f50-6b4d-4ea3-877f-c7ac79a5bb86] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:00:10.751537 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-0946fbc0-a712-474c-8ac4-3d4f777c491b tempest-ServersOnMultiNodesTest-1027241392 tempest-ServersOnMultiNodesTest-1027241392-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:10.753685 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-0946fbc0-a712-474c-8ac4-3d4f777c491b tempest-ServersOnMultiNodesTest-1027241392 tempest-ServersOnMultiNodesTest-1027241392-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:10.756289 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-0946fbc0-a712-474c-8ac4-3d4f777c491b tempest-ServersOnMultiNodesTest-1027241392 tempest-ServersOnMultiNodesTest-1027241392-project-admin] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:10.757832 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-a8e967b1-54f7-4862-8ff2-8e861c93a051 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:10.760838 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-0946fbc0-a712-474c-8ac4-3d4f777c491b tempest-ServersOnMultiNodesTest-1027241392 tempest-ServersOnMultiNodesTest-1027241392-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:10.763696 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-0946fbc0-a712-474c-8ac4-3d4f777c491b tempest-ServersOnMultiNodesTest-1027241392 tempest-ServersOnMultiNodesTest-1027241392-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:10.765027 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-a8e967b1-54f7-4862-8ff2-8e861c93a051 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:10.766536 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-a8e967b1-54f7-4862-8ff2-8e861c93a051 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:10.774956 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-a8e967b1-54f7-4862-8ff2-8e861c93a051 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:10.776554 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-a8e967b1-54f7-4862-8ff2-8e861c93a051 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:10.778287 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-a8e967b1-54f7-4862-8ff2-8e861c93a051 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:10.854696 n-d-863052-2 devstack@n-api.service[121402]: DEBUG dbcounter [-] [121402] Writing DB stats nova_cell0:SELECT=8 {{(pid=121402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 19:00:11.108801 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-a8e967b1-54f7-4862-8ff2-8e861c93a051 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a9c3b6a8c34f068caa50dc10d13a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9ef08eba0ef431285fd15a2561b4e5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:00:11.119022 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-a8e967b1-54f7-4862-8ff2-8e861c93a051 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] 10.222.0.13 "GET /compute/v2.1/servers/68b54f50-6b4d-4ea3-877f-c7ac79a5bb86" status: 200 len: 1315 microversion: 2.1 time: 0.378269 Nov 01 19:00:11.137514 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 819/1672] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:00:10 2022] GET /compute/v2.1/servers/68b54f50-6b4d-4ea3-877f-c7ac79a5bb86 => generated 1315 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 19:00:11.142620 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-1db3c45d-6a92-41bb-8e51-2b4f20a8a0bd tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:00:11.143246 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-1db3c45d-6a92-41bb-8e51-2b4f20a8a0bd tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] [instance: f6762e10-9d45-47cf-a6b6-d9bfc3404664] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:00:11.149869 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-1db3c45d-6a92-41bb-8e51-2b4f20a8a0bd tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:11.150463 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-1db3c45d-6a92-41bb-8e51-2b4f20a8a0bd tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:11.151074 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-1db3c45d-6a92-41bb-8e51-2b4f20a8a0bd tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:11.152196 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-1db3c45d-6a92-41bb-8e51-2b4f20a8a0bd tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:11.152421 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-1db3c45d-6a92-41bb-8e51-2b4f20a8a0bd tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:11.153279 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-1db3c45d-6a92-41bb-8e51-2b4f20a8a0bd tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:11.686629 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-1db3c45d-6a92-41bb-8e51-2b4f20a8a0bd tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72117f17294649d6b8bc16c66c7efab2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45d4c047d3c44324a27a27831236ab0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:00:11.705177 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-1db3c45d-6a92-41bb-8e51-2b4f20a8a0bd tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] 10.222.0.13 "GET /compute/v2.1/servers/f6762e10-9d45-47cf-a6b6-d9bfc3404664" status: 200 len: 1477 microversion: 2.1 time: 0.566664 Nov 01 19:00:11.709792 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 820/1673] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:00:11 2022] GET /compute/v2.1/servers/f6762e10-9d45-47cf-a6b6-d9bfc3404664 => generated 1477 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:00:11.715280 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-61a86768-466a-45a6-b668-da358485e6de tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:00:11.716004 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-61a86768-466a-45a6-b668-da358485e6de tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] [instance: 1f499af7-1896-478c-b7d7-d922bf78bd98] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:00:11.722212 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-61a86768-466a-45a6-b668-da358485e6de tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:11.722789 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-61a86768-466a-45a6-b668-da358485e6de tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:11.723677 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-61a86768-466a-45a6-b668-da358485e6de tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:11.724237 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-61a86768-466a-45a6-b668-da358485e6de tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:11.724789 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-61a86768-466a-45a6-b668-da358485e6de tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:11.725276 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-61a86768-466a-45a6-b668-da358485e6de tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:11.779923 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-0946fbc0-a712-474c-8ac4-3d4f777c491b tempest-ServersOnMultiNodesTest-1027241392 tempest-ServersOnMultiNodesTest-1027241392-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/f35d5fdd-4a95-4b57-a506-665fa3f393c1" status: 200 len: 1618 microversion: 2.1 time: 1.058711 Nov 01 19:00:11.780511 n-d-863052-2 devstack@n-api.service[121403]: DEBUG dbcounter [-] [121403] Writing DB stats nova_cell1:SELECT=100 {{(pid=121403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 19:00:11.783685 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 854/1674] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:00:10 2022] GET /compute/v2.1/servers/f35d5fdd-4a95-4b57-a506-665fa3f393c1 => generated 1618 bytes in 1063 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:00:11.788767 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-2a08e479-867e-4a17-be9c-2e645597c9e3 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:00:11.803073 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-2a08e479-867e-4a17-be9c-2e645597c9e3 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] [instance: a7f88d19-08ee-47bf-9240-7d49afd775e2] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:00:11.810184 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2a08e479-867e-4a17-be9c-2e645597c9e3 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:11.821333 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2a08e479-867e-4a17-be9c-2e645597c9e3 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:11.821796 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2a08e479-867e-4a17-be9c-2e645597c9e3 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:11.822545 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2a08e479-867e-4a17-be9c-2e645597c9e3 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:11.835095 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2a08e479-867e-4a17-be9c-2e645597c9e3 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:11.835601 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2a08e479-867e-4a17-be9c-2e645597c9e3 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:11.932491 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-2a08e479-867e-4a17-be9c-2e645597c9e3 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] 10.222.0.13 "GET /compute/v2.1/servers/a7f88d19-08ee-47bf-9240-7d49afd775e2/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.127966 Nov 01 19:00:11.933121 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 855/1675] 10.222.0.13 () {60 vars in 1343 bytes} [Tue Nov 1 19:00:11 2022] GET /compute/v2.1/servers/a7f88d19-08ee-47bf-9240-7d49afd775e2/os-volume_attachments => generated 197 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 01 19:00:11.941661 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-e6819afc-2244-40b8-86c1-9c6513bf5b24 tempest-ServersTestFqdnHostnames-269349818 tempest-ServersTestFqdnHostnames-269349818-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:00:11.948258 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-e6819afc-2244-40b8-86c1-9c6513bf5b24 tempest-ServersTestFqdnHostnames-269349818 tempest-ServersTestFqdnHostnames-269349818-project] [instance: 04443e90-21e9-4b5e-99e8-350f07e4ea82] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:00:11.976264 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-61a86768-466a-45a6-b668-da358485e6de tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f32f5fba1976432d938e664c7714e52b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b9d4c236b944f9b2e8e502a50a8f8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:00:11.977154 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e6819afc-2244-40b8-86c1-9c6513bf5b24 tempest-ServersTestFqdnHostnames-269349818 tempest-ServersTestFqdnHostnames-269349818-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:11.977864 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e6819afc-2244-40b8-86c1-9c6513bf5b24 tempest-ServersTestFqdnHostnames-269349818 tempest-ServersTestFqdnHostnames-269349818-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:11.978638 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e6819afc-2244-40b8-86c1-9c6513bf5b24 tempest-ServersTestFqdnHostnames-269349818 tempest-ServersTestFqdnHostnames-269349818-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:11.979545 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e6819afc-2244-40b8-86c1-9c6513bf5b24 tempest-ServersTestFqdnHostnames-269349818 tempest-ServersTestFqdnHostnames-269349818-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:11.985553 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e6819afc-2244-40b8-86c1-9c6513bf5b24 tempest-ServersTestFqdnHostnames-269349818 tempest-ServersTestFqdnHostnames-269349818-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:11.986401 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e6819afc-2244-40b8-86c1-9c6513bf5b24 tempest-ServersTestFqdnHostnames-269349818 tempest-ServersTestFqdnHostnames-269349818-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:11.986888 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-61a86768-466a-45a6-b668-da358485e6de tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] 10.222.0.13 "GET /compute/v2.1/servers/1f499af7-1896-478c-b7d7-d922bf78bd98" status: 200 len: 1211 microversion: 2.1 time: 0.275898 Nov 01 19:00:11.990478 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 821/1676] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:00:11 2022] GET /compute/v2.1/servers/1f499af7-1896-478c-b7d7-d922bf78bd98 => generated 1211 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:00:11.995370 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-9bbc6d01-feb6-4e25-a717-55077e959011 tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] Calling method '.version_select at 0x7f0ae66e9ee0>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:00:12.076204 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-9bbc6d01-feb6-4e25-a717-55077e959011 tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] 10.222.0.13 "GET /compute/v2.1/images/14008a7c-6542-4124-800d-d352127c1bb1" status: 200 len: 1454 microversion: 2.1 time: 0.084574 Nov 01 19:00:12.078377 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 822/1677] 10.222.0.13 () {58 vars in 1233 bytes} [Tue Nov 1 19:00:11 2022] GET /compute/v2.1/images/14008a7c-6542-4124-800d-d352127c1bb1 => generated 1454 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:00:12.086327 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-7f5f6f68-2b36-4640-9611-b5f4173b80af tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-567079149", "imageRef": "2d4a0047-1b9e-445f-8af8-1b5c9d93e881", "flavorRef": "452"}, "os:scheduler_hints": {"same_host": "7186700c-1951-4ab3-a872-865dc1a45fa1"}} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:00:12.158456 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.network.neutron [None req-7f5f6f68-2b36-4640-9611-b5f4173b80af tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] validate_networks() for None {{(pid=121403) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 01 19:00:12.498976 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.virt.hardware [None req-7f5f6f68-2b36-4640-9611-b5f4173b80af tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Flavor limits 0:0:0 {{(pid=121403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 01 19:00:12.499606 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.virt.hardware [None req-7f5f6f68-2b36-4640-9611-b5f4173b80af tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Image limits 0:0:0 {{(pid=121403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 01 19:00:12.500194 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.virt.hardware [None req-7f5f6f68-2b36-4640-9611-b5f4173b80af tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Flavor pref 0:0:0 {{(pid=121403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 01 19:00:12.500740 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.virt.hardware [None req-7f5f6f68-2b36-4640-9611-b5f4173b80af tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Image pref 0:0:0 {{(pid=121403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 01 19:00:12.501259 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.virt.hardware [None req-7f5f6f68-2b36-4640-9611-b5f4173b80af tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 01 19:00:12.527273 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-7f5f6f68-2b36-4640-9611-b5f4173b80af tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:12.528496 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-7f5f6f68-2b36-4640-9611-b5f4173b80af tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:12.530990 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-7f5f6f68-2b36-4640-9611-b5f4173b80af tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:12.532189 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-7f5f6f68-2b36-4640-9611-b5f4173b80af tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:12.537896 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-7f5f6f68-2b36-4640-9611-b5f4173b80af tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:12.538499 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-7f5f6f68-2b36-4640-9611-b5f4173b80af tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:12.594970 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.quota [None req-7f5f6f68-2b36-4640-9611-b5f4173b80af tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Getting quotas for project 86941784237549838bba63ce88053b88. Resources: {'cores', 'ram', 'instances'} {{(pid=121403) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 01 19:00:12.600769 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.quota [None req-7f5f6f68-2b36-4640-9611-b5f4173b80af tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Getting quotas for user 0290a6bb8bc24b8988a925327ac0381c and project 86941784237549838bba63ce88053b88. Resources: {'cores', 'ram', 'instances'} {{(pid=121403) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 01 19:00:12.627524 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-7f5f6f68-2b36-4640-9611-b5f4173b80af tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Going to run 1 instances... {{(pid=121403) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 01 19:00:12.639940 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-7f5f6f68-2b36-4640-9611-b5f4173b80af tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] [instance: 71704d65-40b5-4f2e-8565-22e3b5a55d14] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2d4a0047-1b9e-445f-8af8-1b5c9d93e881',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121403) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 01 19:00:12.740892 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-7f5f6f68-2b36-4640-9611-b5f4173b80af tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.661145 Nov 01 19:00:12.750075 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 823/1678] 10.222.0.13 () {60 vars in 1147 bytes} [Tue Nov 1 19:00:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 671 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 01 19:00:12.755279 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-f16d871f-a3e0-481c-b3ab-5012ddf95bba tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:00:12.756102 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-f16d871f-a3e0-481c-b3ab-5012ddf95bba tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] [instance: 68b54f50-6b4d-4ea3-877f-c7ac79a5bb86] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:00:12.764178 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f16d871f-a3e0-481c-b3ab-5012ddf95bba tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:12.765270 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f16d871f-a3e0-481c-b3ab-5012ddf95bba tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:12.778791 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f16d871f-a3e0-481c-b3ab-5012ddf95bba tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:12.781471 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f16d871f-a3e0-481c-b3ab-5012ddf95bba tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:12.783888 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f16d871f-a3e0-481c-b3ab-5012ddf95bba tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:12.785400 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f16d871f-a3e0-481c-b3ab-5012ddf95bba tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:13.098159 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-f16d871f-a3e0-481c-b3ab-5012ddf95bba tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a9c3b6a8c34f068caa50dc10d13a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9ef08eba0ef431285fd15a2561b4e5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:00:13.109336 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-f16d871f-a3e0-481c-b3ab-5012ddf95bba tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] 10.222.0.13 "GET /compute/v2.1/servers/68b54f50-6b4d-4ea3-877f-c7ac79a5bb86" status: 200 len: 1315 microversion: 2.1 time: 0.357385 Nov 01 19:00:13.110576 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 824/1679] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:00:12 2022] GET /compute/v2.1/servers/68b54f50-6b4d-4ea3-877f-c7ac79a5bb86 => generated 1315 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:00:13.115453 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [req-431bd17e-db45-4e25-9bbc-a406e5c7a27c req-9a6bea76-df09-450a-8adb-722b3ded652f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a7f88d19-08ee-47bf-9240-7d49afd775e2", "tag": "01aee5f9-544a-4c0f-b9a3-2410eedf25a5"}]} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:00:13.126325 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-431bd17e-db45-4e25-9bbc-a406e5c7a27c req-9a6bea76-df09-450a-8adb-722b3ded652f service nova] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:13.127136 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-431bd17e-db45-4e25-9bbc-a406e5c7a27c req-9a6bea76-df09-450a-8adb-722b3ded652f service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:13.127823 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-431bd17e-db45-4e25-9bbc-a406e5c7a27c req-9a6bea76-df09-450a-8adb-722b3ded652f service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:13.140920 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.compute.server_external_events [req-431bd17e-db45-4e25-9bbc-a406e5c7a27c req-9a6bea76-df09-450a-8adb-722b3ded652f service nova] Creating event network-changed:01aee5f9-544a-4c0f-b9a3-2410eedf25a5 for instance a7f88d19-08ee-47bf-9240-7d49afd775e2 on n-h1-863052-2 Nov 01 19:00:13.148103 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [req-431bd17e-db45-4e25-9bbc-a406e5c7a27c req-9a6bea76-df09-450a-8adb-722b3ded652f service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035740 Nov 01 19:00:13.150062 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 825/1680] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Nov 1 19:00:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:00:13.156866 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-e4093ffb-b521-4d58-b9db-8206c4863747 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:00:13.157921 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-e4093ffb-b521-4d58-b9db-8206c4863747 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] [instance: f6762e10-9d45-47cf-a6b6-d9bfc3404664] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:00:13.160617 n-d-863052-2 devstack@n-api.service[121403]: DEBUG dbcounter [-] [121403] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=121403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 19:00:13.167297 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-e4093ffb-b521-4d58-b9db-8206c4863747 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:13.168774 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-e4093ffb-b521-4d58-b9db-8206c4863747 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:13.169463 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-e4093ffb-b521-4d58-b9db-8206c4863747 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:13.170560 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-e4093ffb-b521-4d58-b9db-8206c4863747 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:13.171347 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-e4093ffb-b521-4d58-b9db-8206c4863747 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:13.172083 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-e4093ffb-b521-4d58-b9db-8206c4863747 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:13.460731 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-e6819afc-2244-40b8-86c1-9c6513bf5b24 tempest-ServersTestFqdnHostnames-269349818 tempest-ServersTestFqdnHostnames-269349818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d33ca3478b7455dad5094afee57c8b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfea57f34b844c77b22619105249d08a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:00:13.479807 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-e6819afc-2244-40b8-86c1-9c6513bf5b24 tempest-ServersTestFqdnHostnames-269349818 tempest-ServersTestFqdnHostnames-269349818-project] 10.222.0.13 "GET /compute/v2.1/servers/04443e90-21e9-4b5e-99e8-350f07e4ea82" status: 200 len: 1352 microversion: 2.1 time: 1.544699 Nov 01 19:00:13.492865 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 856/1681] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:00:11 2022] GET /compute/v2.1/servers/04443e90-21e9-4b5e-99e8-350f07e4ea82 => generated 1352 bytes in 1554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:00:13.508363 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-721eec26-5688-48a0-a0de-55ad32db858f tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:00:13.509031 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-721eec26-5688-48a0-a0de-55ad32db858f tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] [instance: 71704d65-40b5-4f2e-8565-22e3b5a55d14] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:00:13.876327 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-721eec26-5688-48a0-a0de-55ad32db858f tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0290a6bb8bc24b8988a925327ac0381c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86941784237549838bba63ce88053b88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:00:13.901081 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-721eec26-5688-48a0-a0de-55ad32db858f tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] 10.222.0.13 "GET /compute/v2.1/servers/71704d65-40b5-4f2e-8565-22e3b5a55d14" status: 200 len: 1216 microversion: 2.1 time: 0.402893 Nov 01 19:00:13.906211 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 857/1682] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:00:13 2022] GET /compute/v2.1/servers/71704d65-40b5-4f2e-8565-22e3b5a55d14 => generated 1216 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:00:13.913406 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-e4093ffb-b521-4d58-b9db-8206c4863747 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72117f17294649d6b8bc16c66c7efab2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45d4c047d3c44324a27a27831236ab0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:00:13.921916 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-561ff944-98c2-4ad3-9440-8c6db6b623b9 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:00:13.930302 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-e4093ffb-b521-4d58-b9db-8206c4863747 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] 10.222.0.13 "GET /compute/v2.1/servers/f6762e10-9d45-47cf-a6b6-d9bfc3404664" status: 200 len: 1477 microversion: 2.1 time: 0.775400 Nov 01 19:00:13.931643 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-561ff944-98c2-4ad3-9440-8c6db6b623b9 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] [instance: a7f88d19-08ee-47bf-9240-7d49afd775e2] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:00:13.933817 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 826/1683] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:00:13 2022] GET /compute/v2.1/servers/f6762e10-9d45-47cf-a6b6-d9bfc3404664 => generated 1477 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:00:13.986283 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-561ff944-98c2-4ad3-9440-8c6db6b623b9 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:13.986903 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-561ff944-98c2-4ad3-9440-8c6db6b623b9 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.024s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:13.990487 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-561ff944-98c2-4ad3-9440-8c6db6b623b9 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:13.996174 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-561ff944-98c2-4ad3-9440-8c6db6b623b9 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:13.996851 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-561ff944-98c2-4ad3-9440-8c6db6b623b9 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:13.997333 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-561ff944-98c2-4ad3-9440-8c6db6b623b9 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:14.167306 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-561ff944-98c2-4ad3-9440-8c6db6b623b9 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] 10.222.0.13 "GET /compute/v2.1/servers/a7f88d19-08ee-47bf-9240-7d49afd775e2/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.256503 Nov 01 19:00:14.168567 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 858/1684] 10.222.0.13 () {60 vars in 1343 bytes} [Tue Nov 1 19:00:13 2022] GET /compute/v2.1/servers/a7f88d19-08ee-47bf-9240-7d49afd775e2/os-volume_attachments => generated 197 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 01 19:00:14.172818 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-19a033de-67f0-4460-bbb5-97bb05eb3aba tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:00:14.173499 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-19a033de-67f0-4460-bbb5-97bb05eb3aba tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] [instance: 1f499af7-1896-478c-b7d7-d922bf78bd98] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:00:14.176709 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-51eaf266-d7b8-4eb3-b0d9-016433063983 tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] Calling method '.version_select at 0x7f0ae1d16670>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:00:14.186534 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-19a033de-67f0-4460-bbb5-97bb05eb3aba tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:14.188491 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-19a033de-67f0-4460-bbb5-97bb05eb3aba tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:14.191923 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-19a033de-67f0-4460-bbb5-97bb05eb3aba tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:14.192953 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-19a033de-67f0-4460-bbb5-97bb05eb3aba tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:14.196203 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-19a033de-67f0-4460-bbb5-97bb05eb3aba tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:14.198811 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-19a033de-67f0-4460-bbb5-97bb05eb3aba tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:14.307355 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-51eaf266-d7b8-4eb3-b0d9-016433063983 tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] 10.222.0.13 "GET /compute/v2.1/images/14008a7c-6542-4124-800d-d352127c1bb1" status: 200 len: 1454 microversion: 2.1 time: 0.136694 Nov 01 19:00:14.307971 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 859/1685] 10.222.0.13 () {58 vars in 1233 bytes} [Tue Nov 1 19:00:14 2022] GET /compute/v2.1/images/14008a7c-6542-4124-800d-d352127c1bb1 => generated 1454 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:00:14.321372 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-17b8db21-0fe6-4083-8bd0-f603fc5349ac tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:00:14.322308 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-17b8db21-0fe6-4083-8bd0-f603fc5349ac tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] [instance: 68b54f50-6b4d-4ea3-877f-c7ac79a5bb86] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:00:14.338954 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-17b8db21-0fe6-4083-8bd0-f603fc5349ac tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:14.339744 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-17b8db21-0fe6-4083-8bd0-f603fc5349ac tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:14.341270 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-17b8db21-0fe6-4083-8bd0-f603fc5349ac tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:14.342875 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-17b8db21-0fe6-4083-8bd0-f603fc5349ac tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:14.344278 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-17b8db21-0fe6-4083-8bd0-f603fc5349ac tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:14.345083 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-17b8db21-0fe6-4083-8bd0-f603fc5349ac tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:14.761043 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-17b8db21-0fe6-4083-8bd0-f603fc5349ac tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a9c3b6a8c34f068caa50dc10d13a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9ef08eba0ef431285fd15a2561b4e5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:00:14.780087 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-19a033de-67f0-4460-bbb5-97bb05eb3aba tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f32f5fba1976432d938e664c7714e52b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b9d4c236b944f9b2e8e502a50a8f8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:00:14.787489 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-17b8db21-0fe6-4083-8bd0-f603fc5349ac tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] 10.222.0.13 "GET /compute/v2.1/servers/68b54f50-6b4d-4ea3-877f-c7ac79a5bb86" status: 200 len: 1315 microversion: 2.1 time: 0.477513 Nov 01 19:00:14.789477 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 860/1686] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:00:14 2022] GET /compute/v2.1/servers/68b54f50-6b4d-4ea3-877f-c7ac79a5bb86 => generated 1315 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:00:14.800839 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [req-b0df4120-f348-4e97-8099-919da267c0b9 req-a3ccdbec-bf3f-484f-b6af-9e746ddda754 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "04443e90-21e9-4b5e-99e8-350f07e4ea82", "name": "network-vif-plugged", "status": "completed", "tag": "b9e488b8-901e-4fc1-abb5-b279e9c4057a"}]} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:00:14.809972 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-19a033de-67f0-4460-bbb5-97bb05eb3aba tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] 10.222.0.13 "GET /compute/v2.1/servers/1f499af7-1896-478c-b7d7-d922bf78bd98" status: 200 len: 1211 microversion: 2.1 time: 0.873453 Nov 01 19:00:14.810740 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 827/1687] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:00:13 2022] GET /compute/v2.1/servers/1f499af7-1896-478c-b7d7-d922bf78bd98 => generated 1211 bytes in 876 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:00:14.817296 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-62c2c023-4982-4d92-9b30-def92e417ca3 tempest-ServersTestFqdnHostnames-269349818 tempest-ServersTestFqdnHostnames-269349818-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:00:14.817920 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-62c2c023-4982-4d92-9b30-def92e417ca3 tempest-ServersTestFqdnHostnames-269349818 tempest-ServersTestFqdnHostnames-269349818-project] [instance: 04443e90-21e9-4b5e-99e8-350f07e4ea82] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:00:14.825363 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-62c2c023-4982-4d92-9b30-def92e417ca3 tempest-ServersTestFqdnHostnames-269349818 tempest-ServersTestFqdnHostnames-269349818-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:14.825850 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-62c2c023-4982-4d92-9b30-def92e417ca3 tempest-ServersTestFqdnHostnames-269349818 tempest-ServersTestFqdnHostnames-269349818-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:14.826297 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-62c2c023-4982-4d92-9b30-def92e417ca3 tempest-ServersTestFqdnHostnames-269349818 tempest-ServersTestFqdnHostnames-269349818-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:14.827059 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-62c2c023-4982-4d92-9b30-def92e417ca3 tempest-ServersTestFqdnHostnames-269349818 tempest-ServersTestFqdnHostnames-269349818-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:14.827488 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-62c2c023-4982-4d92-9b30-def92e417ca3 tempest-ServersTestFqdnHostnames-269349818 tempest-ServersTestFqdnHostnames-269349818-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:14.827989 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-62c2c023-4982-4d92-9b30-def92e417ca3 tempest-ServersTestFqdnHostnames-269349818 tempest-ServersTestFqdnHostnames-269349818-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:14.838002 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-b0df4120-f348-4e97-8099-919da267c0b9 req-a3ccdbec-bf3f-484f-b6af-9e746ddda754 service nova] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:14.841092 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-b0df4120-f348-4e97-8099-919da267c0b9 req-a3ccdbec-bf3f-484f-b6af-9e746ddda754 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:14.841662 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-b0df4120-f348-4e97-8099-919da267c0b9 req-a3ccdbec-bf3f-484f-b6af-9e746ddda754 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:14.878872 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.compute.server_external_events [req-b0df4120-f348-4e97-8099-919da267c0b9 req-a3ccdbec-bf3f-484f-b6af-9e746ddda754 service nova] Creating event network-vif-plugged:b9e488b8-901e-4fc1-abb5-b279e9c4057a for instance 04443e90-21e9-4b5e-99e8-350f07e4ea82 on n-h1-863052-2 Nov 01 19:00:14.892481 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [req-b0df4120-f348-4e97-8099-919da267c0b9 req-a3ccdbec-bf3f-484f-b6af-9e746ddda754 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101654 Nov 01 19:00:14.908303 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 861/1688] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Nov 1 19:00:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:00:14.938064 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-8dacbabf-5a5d-4750-8214-32bb41ee8b9b tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:00:14.947750 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-8dacbabf-5a5d-4750-8214-32bb41ee8b9b tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] [instance: 71704d65-40b5-4f2e-8565-22e3b5a55d14] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:00:14.977611 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-8dacbabf-5a5d-4750-8214-32bb41ee8b9b tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:14.989587 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-8dacbabf-5a5d-4750-8214-32bb41ee8b9b tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:14.991116 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-8dacbabf-5a5d-4750-8214-32bb41ee8b9b tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:14.993478 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-8dacbabf-5a5d-4750-8214-32bb41ee8b9b tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:15.000954 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-8dacbabf-5a5d-4750-8214-32bb41ee8b9b tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:15.001785 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-8dacbabf-5a5d-4750-8214-32bb41ee8b9b tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:15.067069 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-62c2c023-4982-4d92-9b30-def92e417ca3 tempest-ServersTestFqdnHostnames-269349818 tempest-ServersTestFqdnHostnames-269349818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d33ca3478b7455dad5094afee57c8b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfea57f34b844c77b22619105249d08a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:00:15.094171 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-62c2c023-4982-4d92-9b30-def92e417ca3 tempest-ServersTestFqdnHostnames-269349818 tempest-ServersTestFqdnHostnames-269349818-project] 10.222.0.13 "GET /compute/v2.1/servers/04443e90-21e9-4b5e-99e8-350f07e4ea82" status: 200 len: 1352 microversion: 2.1 time: 0.282340 Nov 01 19:00:15.095940 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 828/1689] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:00:14 2022] GET /compute/v2.1/servers/04443e90-21e9-4b5e-99e8-350f07e4ea82 => generated 1352 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:00:15.109781 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-ac081b57-51fe-458e-bda8-1dbda36258e2 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:00:15.110033 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-ac081b57-51fe-458e-bda8-1dbda36258e2 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] [instance: f6762e10-9d45-47cf-a6b6-d9bfc3404664] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:00:15.122240 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-ac081b57-51fe-458e-bda8-1dbda36258e2 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:15.123421 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-ac081b57-51fe-458e-bda8-1dbda36258e2 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:15.123421 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-ac081b57-51fe-458e-bda8-1dbda36258e2 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:15.123933 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-ac081b57-51fe-458e-bda8-1dbda36258e2 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:15.124394 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-ac081b57-51fe-458e-bda8-1dbda36258e2 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:15.125109 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-ac081b57-51fe-458e-bda8-1dbda36258e2 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:15.299612 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-ac081b57-51fe-458e-bda8-1dbda36258e2 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72117f17294649d6b8bc16c66c7efab2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45d4c047d3c44324a27a27831236ab0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:00:15.311006 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-ac081b57-51fe-458e-bda8-1dbda36258e2 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] 10.222.0.13 "GET /compute/v2.1/servers/f6762e10-9d45-47cf-a6b6-d9bfc3404664" status: 200 len: 1477 microversion: 2.1 time: 0.214113 Nov 01 19:00:15.312542 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 829/1690] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:00:15 2022] GET /compute/v2.1/servers/f6762e10-9d45-47cf-a6b6-d9bfc3404664 => generated 1477 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:00:15.319414 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-828dc77e-c24b-4f05-8ef9-b22f99b2354d tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:00:15.323120 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-828dc77e-c24b-4f05-8ef9-b22f99b2354d tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] [instance: a7f88d19-08ee-47bf-9240-7d49afd775e2] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:00:15.330332 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-828dc77e-c24b-4f05-8ef9-b22f99b2354d tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:15.331110 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-828dc77e-c24b-4f05-8ef9-b22f99b2354d tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:15.331820 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-828dc77e-c24b-4f05-8ef9-b22f99b2354d tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:15.332928 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-828dc77e-c24b-4f05-8ef9-b22f99b2354d tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:15.333649 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-828dc77e-c24b-4f05-8ef9-b22f99b2354d tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:15.334322 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-828dc77e-c24b-4f05-8ef9-b22f99b2354d tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:15.338662 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-8dacbabf-5a5d-4750-8214-32bb41ee8b9b tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0290a6bb8bc24b8988a925327ac0381c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86941784237549838bba63ce88053b88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:00:15.350144 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-8dacbabf-5a5d-4750-8214-32bb41ee8b9b tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] 10.222.0.13 "GET /compute/v2.1/servers/71704d65-40b5-4f2e-8565-22e3b5a55d14" status: 200 len: 1268 microversion: 2.1 time: 0.423974 Nov 01 19:00:15.366434 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 862/1691] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:00:14 2022] GET /compute/v2.1/servers/71704d65-40b5-4f2e-8565-22e3b5a55d14 => generated 1268 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:00:15.379822 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-7a5170f1-bf18-4f4c-84ab-959ec14235ae tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] Calling method '.version_select at 0x7f0ae1cad9d0>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:00:15.415859 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-828dc77e-c24b-4f05-8ef9-b22f99b2354d tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] 10.222.0.13 "GET /compute/v2.1/servers/a7f88d19-08ee-47bf-9240-7d49afd775e2/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.101956 Nov 01 19:00:15.417107 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 830/1692] 10.222.0.13 () {60 vars in 1343 bytes} [Tue Nov 1 19:00:15 2022] GET /compute/v2.1/servers/a7f88d19-08ee-47bf-9240-7d49afd775e2/os-volume_attachments => generated 197 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 01 19:00:15.461995 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-7a5170f1-bf18-4f4c-84ab-959ec14235ae tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] 10.222.0.13 "GET /compute/v2.1/images/14008a7c-6542-4124-800d-d352127c1bb1" status: 200 len: 1454 microversion: 2.1 time: 0.094090 Nov 01 19:00:15.469048 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 863/1693] 10.222.0.13 () {58 vars in 1233 bytes} [Tue Nov 1 19:00:15 2022] GET /compute/v2.1/images/14008a7c-6542-4124-800d-d352127c1bb1 => generated 1454 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:00:15.814679 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-f4ef2d7d-5f3c-4ab3-90da-b6784eaf5ac5 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:00:15.815572 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-f4ef2d7d-5f3c-4ab3-90da-b6784eaf5ac5 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] [instance: 68b54f50-6b4d-4ea3-877f-c7ac79a5bb86] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:00:15.824287 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f4ef2d7d-5f3c-4ab3-90da-b6784eaf5ac5 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:15.825089 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f4ef2d7d-5f3c-4ab3-90da-b6784eaf5ac5 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:15.838747 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-0b5417c2-0cad-46cb-be0b-26964f2f3266 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:00:15.840553 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-0b5417c2-0cad-46cb-be0b-26964f2f3266 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] [instance: 1f499af7-1896-478c-b7d7-d922bf78bd98] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:00:15.849892 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f4ef2d7d-5f3c-4ab3-90da-b6784eaf5ac5 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:15.855840 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f4ef2d7d-5f3c-4ab3-90da-b6784eaf5ac5 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:15.857075 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f4ef2d7d-5f3c-4ab3-90da-b6784eaf5ac5 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:15.858975 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-0b5417c2-0cad-46cb-be0b-26964f2f3266 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:15.859675 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f4ef2d7d-5f3c-4ab3-90da-b6784eaf5ac5 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:15.864176 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-0b5417c2-0cad-46cb-be0b-26964f2f3266 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:15.864662 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-0b5417c2-0cad-46cb-be0b-26964f2f3266 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:15.865398 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-0b5417c2-0cad-46cb-be0b-26964f2f3266 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:15.865863 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-0b5417c2-0cad-46cb-be0b-26964f2f3266 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:15.866296 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-0b5417c2-0cad-46cb-be0b-26964f2f3266 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:16.076357 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-0b5417c2-0cad-46cb-be0b-26964f2f3266 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f32f5fba1976432d938e664c7714e52b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b9d4c236b944f9b2e8e502a50a8f8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:00:16.085344 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-0b5417c2-0cad-46cb-be0b-26964f2f3266 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] 10.222.0.13 "GET /compute/v2.1/servers/1f499af7-1896-478c-b7d7-d922bf78bd98" status: 200 len: 1211 microversion: 2.1 time: 0.250559 Nov 01 19:00:16.090688 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 864/1694] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:00:15 2022] GET /compute/v2.1/servers/1f499af7-1896-478c-b7d7-d922bf78bd98 => generated 1211 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:00:16.106672 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-f4ef2d7d-5f3c-4ab3-90da-b6784eaf5ac5 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a9c3b6a8c34f068caa50dc10d13a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9ef08eba0ef431285fd15a2561b4e5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:00:16.118378 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-f4ef2d7d-5f3c-4ab3-90da-b6784eaf5ac5 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] 10.222.0.13 "GET /compute/v2.1/servers/68b54f50-6b4d-4ea3-877f-c7ac79a5bb86" status: 200 len: 1315 microversion: 2.1 time: 0.307972 Nov 01 19:00:16.123528 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-58a6dde3-8ac4-41de-8cd5-349819444f7d tempest-ServersTestFqdnHostnames-269349818 tempest-ServersTestFqdnHostnames-269349818-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:00:16.124156 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-58a6dde3-8ac4-41de-8cd5-349819444f7d tempest-ServersTestFqdnHostnames-269349818 tempest-ServersTestFqdnHostnames-269349818-project] [instance: 04443e90-21e9-4b5e-99e8-350f07e4ea82] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:00:16.126602 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 831/1695] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:00:15 2022] GET /compute/v2.1/servers/68b54f50-6b4d-4ea3-877f-c7ac79a5bb86 => generated 1315 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:00:16.131144 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-58a6dde3-8ac4-41de-8cd5-349819444f7d tempest-ServersTestFqdnHostnames-269349818 tempest-ServersTestFqdnHostnames-269349818-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:16.131638 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-58a6dde3-8ac4-41de-8cd5-349819444f7d tempest-ServersTestFqdnHostnames-269349818 tempest-ServersTestFqdnHostnames-269349818-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:16.132132 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-58a6dde3-8ac4-41de-8cd5-349819444f7d tempest-ServersTestFqdnHostnames-269349818 tempest-ServersTestFqdnHostnames-269349818-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:16.132869 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-58a6dde3-8ac4-41de-8cd5-349819444f7d tempest-ServersTestFqdnHostnames-269349818 tempest-ServersTestFqdnHostnames-269349818-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:16.138645 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-58a6dde3-8ac4-41de-8cd5-349819444f7d tempest-ServersTestFqdnHostnames-269349818 tempest-ServersTestFqdnHostnames-269349818-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:16.139318 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-58a6dde3-8ac4-41de-8cd5-349819444f7d tempest-ServersTestFqdnHostnames-269349818 tempest-ServersTestFqdnHostnames-269349818-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:16.301341 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-58a6dde3-8ac4-41de-8cd5-349819444f7d tempest-ServersTestFqdnHostnames-269349818 tempest-ServersTestFqdnHostnames-269349818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d33ca3478b7455dad5094afee57c8b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfea57f34b844c77b22619105249d08a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:00:16.311577 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-58a6dde3-8ac4-41de-8cd5-349819444f7d tempest-ServersTestFqdnHostnames-269349818 tempest-ServersTestFqdnHostnames-269349818-project] 10.222.0.13 "GET /compute/v2.1/servers/04443e90-21e9-4b5e-99e8-350f07e4ea82" status: 200 len: 1352 microversion: 2.1 time: 0.196628 Nov 01 19:00:16.316597 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 865/1696] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:00:16 2022] GET /compute/v2.1/servers/04443e90-21e9-4b5e-99e8-350f07e4ea82 => generated 1352 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:00:16.335273 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-1c83e978-a0ac-4e17-ab45-40bbd59825ae tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:00:16.335863 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-1c83e978-a0ac-4e17-ab45-40bbd59825ae tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] [instance: f6762e10-9d45-47cf-a6b6-d9bfc3404664] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:00:16.342713 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-1c83e978-a0ac-4e17-ab45-40bbd59825ae tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:16.343208 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-1c83e978-a0ac-4e17-ab45-40bbd59825ae tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:16.343650 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-1c83e978-a0ac-4e17-ab45-40bbd59825ae tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:16.344363 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-1c83e978-a0ac-4e17-ab45-40bbd59825ae tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:16.344945 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-1c83e978-a0ac-4e17-ab45-40bbd59825ae tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:16.345380 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-1c83e978-a0ac-4e17-ab45-40bbd59825ae tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:16.379014 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-b934bb2b-ec6d-404d-ab75-6e18f1b639dd tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:00:16.379535 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-b934bb2b-ec6d-404d-ab75-6e18f1b639dd tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] [instance: 71704d65-40b5-4f2e-8565-22e3b5a55d14] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:00:16.388673 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b934bb2b-ec6d-404d-ab75-6e18f1b639dd tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:16.389171 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b934bb2b-ec6d-404d-ab75-6e18f1b639dd tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:16.389606 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b934bb2b-ec6d-404d-ab75-6e18f1b639dd tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:16.390314 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b934bb2b-ec6d-404d-ab75-6e18f1b639dd tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:16.392113 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b934bb2b-ec6d-404d-ab75-6e18f1b639dd tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:16.395622 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b934bb2b-ec6d-404d-ab75-6e18f1b639dd tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:16.494881 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-b934bb2b-ec6d-404d-ab75-6e18f1b639dd tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0290a6bb8bc24b8988a925327ac0381c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86941784237549838bba63ce88053b88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:00:16.504136 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-b934bb2b-ec6d-404d-ab75-6e18f1b639dd tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] 10.222.0.13 "GET /compute/v2.1/servers/71704d65-40b5-4f2e-8565-22e3b5a55d14" status: 200 len: 1268 microversion: 2.1 time: 0.129020 Nov 01 19:00:16.505568 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 866/1697] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:00:16 2022] GET /compute/v2.1/servers/71704d65-40b5-4f2e-8565-22e3b5a55d14 => generated 1268 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 19:00:16.510504 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-8f79bffc-fe15-47f5-8053-a8c1bccb93d1 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:00:16.513097 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-8f79bffc-fe15-47f5-8053-a8c1bccb93d1 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] [instance: a7f88d19-08ee-47bf-9240-7d49afd775e2] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:00:16.519680 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-8f79bffc-fe15-47f5-8053-a8c1bccb93d1 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:16.520459 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-8f79bffc-fe15-47f5-8053-a8c1bccb93d1 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:16.521097 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-8f79bffc-fe15-47f5-8053-a8c1bccb93d1 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:16.521983 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-8f79bffc-fe15-47f5-8053-a8c1bccb93d1 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:16.522597 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-8f79bffc-fe15-47f5-8053-a8c1bccb93d1 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:16.523179 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-8f79bffc-fe15-47f5-8053-a8c1bccb93d1 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:16.585162 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-8f79bffc-fe15-47f5-8053-a8c1bccb93d1 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] 10.222.0.13 "GET /compute/v2.1/servers/a7f88d19-08ee-47bf-9240-7d49afd775e2/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.076827 Nov 01 19:00:16.585785 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 867/1698] 10.222.0.13 () {60 vars in 1343 bytes} [Tue Nov 1 19:00:16 2022] GET /compute/v2.1/servers/a7f88d19-08ee-47bf-9240-7d49afd775e2/os-volume_attachments => generated 197 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 01 19:00:16.593305 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-1c83e978-a0ac-4e17-ab45-40bbd59825ae tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72117f17294649d6b8bc16c66c7efab2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45d4c047d3c44324a27a27831236ab0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:00:16.604240 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-042f197e-5fb3-4f6c-973b-eba5a6b9d7f4 tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] Calling method '.version_select at 0x7f0ae1cad0d0>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:00:16.606485 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-1c83e978-a0ac-4e17-ab45-40bbd59825ae tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] 10.222.0.13 "GET /compute/v2.1/servers/f6762e10-9d45-47cf-a6b6-d9bfc3404664" status: 200 len: 1477 microversion: 2.1 time: 0.274576 Nov 01 19:00:16.607707 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 832/1699] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:00:16 2022] GET /compute/v2.1/servers/f6762e10-9d45-47cf-a6b6-d9bfc3404664 => generated 1477 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:00:16.674356 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-042f197e-5fb3-4f6c-973b-eba5a6b9d7f4 tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] 10.222.0.13 "GET /compute/v2.1/images/14008a7c-6542-4124-800d-d352127c1bb1" status: 200 len: 1454 microversion: 2.1 time: 0.085995 Nov 01 19:00:16.686295 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 868/1700] 10.222.0.13 () {58 vars in 1233 bytes} [Tue Nov 1 19:00:16 2022] GET /compute/v2.1/images/14008a7c-6542-4124-800d-d352127c1bb1 => generated 1454 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:00:17.118132 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-be7dfd07-a507-433e-b499-ac66e24c292b tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:00:17.119115 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-be7dfd07-a507-433e-b499-ac66e24c292b tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] [instance: 1f499af7-1896-478c-b7d7-d922bf78bd98] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:00:17.127088 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-be7dfd07-a507-433e-b499-ac66e24c292b tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:17.127658 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-be7dfd07-a507-433e-b499-ac66e24c292b tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:17.128159 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-be7dfd07-a507-433e-b499-ac66e24c292b tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:17.128970 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-be7dfd07-a507-433e-b499-ac66e24c292b tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:17.129636 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-be7dfd07-a507-433e-b499-ac66e24c292b tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:17.130254 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-be7dfd07-a507-433e-b499-ac66e24c292b tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:17.151160 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-fd0bf19e-1916-481c-b455-3693db1ffcd3 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:00:17.154415 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-fd0bf19e-1916-481c-b455-3693db1ffcd3 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] [instance: 68b54f50-6b4d-4ea3-877f-c7ac79a5bb86] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:00:17.177306 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-fd0bf19e-1916-481c-b455-3693db1ffcd3 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:17.178115 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-fd0bf19e-1916-481c-b455-3693db1ffcd3 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:17.178731 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-fd0bf19e-1916-481c-b455-3693db1ffcd3 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:17.179623 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-fd0bf19e-1916-481c-b455-3693db1ffcd3 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:17.181585 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-fd0bf19e-1916-481c-b455-3693db1ffcd3 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:17.182209 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-fd0bf19e-1916-481c-b455-3693db1ffcd3 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:17.328810 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-be7dfd07-a507-433e-b499-ac66e24c292b tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f32f5fba1976432d938e664c7714e52b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b9d4c236b944f9b2e8e502a50a8f8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:00:17.349043 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-be7dfd07-a507-433e-b499-ac66e24c292b tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] 10.222.0.13 "GET /compute/v2.1/servers/1f499af7-1896-478c-b7d7-d922bf78bd98" status: 200 len: 1211 microversion: 2.1 time: 0.234413 Nov 01 19:00:17.351319 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 833/1701] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:00:17 2022] GET /compute/v2.1/servers/1f499af7-1896-478c-b7d7-d922bf78bd98 => generated 1211 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:00:17.357621 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-170cff0c-3c0d-4258-a1f2-ee1917ecbe3f tempest-ServersTestFqdnHostnames-269349818 tempest-ServersTestFqdnHostnames-269349818-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:00:17.358745 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-170cff0c-3c0d-4258-a1f2-ee1917ecbe3f tempest-ServersTestFqdnHostnames-269349818 tempest-ServersTestFqdnHostnames-269349818-project] [instance: 04443e90-21e9-4b5e-99e8-350f07e4ea82] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:00:17.366210 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-170cff0c-3c0d-4258-a1f2-ee1917ecbe3f tempest-ServersTestFqdnHostnames-269349818 tempest-ServersTestFqdnHostnames-269349818-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:17.367303 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-170cff0c-3c0d-4258-a1f2-ee1917ecbe3f tempest-ServersTestFqdnHostnames-269349818 tempest-ServersTestFqdnHostnames-269349818-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:17.367954 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-170cff0c-3c0d-4258-a1f2-ee1917ecbe3f tempest-ServersTestFqdnHostnames-269349818 tempest-ServersTestFqdnHostnames-269349818-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:17.368925 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-170cff0c-3c0d-4258-a1f2-ee1917ecbe3f tempest-ServersTestFqdnHostnames-269349818 tempest-ServersTestFqdnHostnames-269349818-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:17.369756 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-170cff0c-3c0d-4258-a1f2-ee1917ecbe3f tempest-ServersTestFqdnHostnames-269349818 tempest-ServersTestFqdnHostnames-269349818-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:17.370405 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-170cff0c-3c0d-4258-a1f2-ee1917ecbe3f tempest-ServersTestFqdnHostnames-269349818 tempest-ServersTestFqdnHostnames-269349818-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:17.463437 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-fd0bf19e-1916-481c-b455-3693db1ffcd3 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a9c3b6a8c34f068caa50dc10d13a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9ef08eba0ef431285fd15a2561b4e5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:00:17.477697 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-fd0bf19e-1916-481c-b455-3693db1ffcd3 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] 10.222.0.13 "GET /compute/v2.1/servers/68b54f50-6b4d-4ea3-877f-c7ac79a5bb86" status: 200 len: 1315 microversion: 2.1 time: 0.330140 Nov 01 19:00:17.478996 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 869/1702] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:00:17 2022] GET /compute/v2.1/servers/68b54f50-6b4d-4ea3-877f-c7ac79a5bb86 => generated 1315 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:00:17.527933 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-5228c728-3b94-4339-9d6c-62c27556b268 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:00:17.529006 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-5228c728-3b94-4339-9d6c-62c27556b268 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] [instance: 71704d65-40b5-4f2e-8565-22e3b5a55d14] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:00:17.538748 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-5228c728-3b94-4339-9d6c-62c27556b268 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:17.542089 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-5228c728-3b94-4339-9d6c-62c27556b268 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:17.543872 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-5228c728-3b94-4339-9d6c-62c27556b268 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:17.545393 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-5228c728-3b94-4339-9d6c-62c27556b268 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:17.551810 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-5228c728-3b94-4339-9d6c-62c27556b268 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:17.552643 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-5228c728-3b94-4339-9d6c-62c27556b268 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:17.705004 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-5228c728-3b94-4339-9d6c-62c27556b268 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0290a6bb8bc24b8988a925327ac0381c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86941784237549838bba63ce88053b88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:00:17.715874 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-5228c728-3b94-4339-9d6c-62c27556b268 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] 10.222.0.13 "GET /compute/v2.1/servers/71704d65-40b5-4f2e-8565-22e3b5a55d14" status: 200 len: 1276 microversion: 2.1 time: 0.192302 Nov 01 19:00:17.717053 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 870/1703] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:00:17 2022] GET /compute/v2.1/servers/71704d65-40b5-4f2e-8565-22e3b5a55d14 => generated 1276 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 19:00:17.722190 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-2a82e52a-ff29-46d2-9d24-747d1ded2806 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:00:17.724844 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-2a82e52a-ff29-46d2-9d24-747d1ded2806 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] [instance: a7f88d19-08ee-47bf-9240-7d49afd775e2] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:00:17.732612 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2a82e52a-ff29-46d2-9d24-747d1ded2806 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:17.733479 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2a82e52a-ff29-46d2-9d24-747d1ded2806 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:17.734158 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2a82e52a-ff29-46d2-9d24-747d1ded2806 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:17.735890 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2a82e52a-ff29-46d2-9d24-747d1ded2806 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:17.736665 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2a82e52a-ff29-46d2-9d24-747d1ded2806 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:17.738056 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2a82e52a-ff29-46d2-9d24-747d1ded2806 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:17.786876 n-d-863052-2 devstack@n-api.service[121402]: DEBUG dbcounter [-] [121402] Writing DB stats nova_cell1:SELECT=100 {{(pid=121402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 19:00:17.818465 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-2a82e52a-ff29-46d2-9d24-747d1ded2806 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] 10.222.0.13 "GET /compute/v2.1/servers/a7f88d19-08ee-47bf-9240-7d49afd775e2/os-volume_attachments" status: 200 len: 25 microversion: 2.25 time: 0.100007 Nov 01 19:00:17.822011 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 871/1704] 10.222.0.13 () {60 vars in 1343 bytes} [Tue Nov 1 19:00:17 2022] GET /compute/v2.1/servers/a7f88d19-08ee-47bf-9240-7d49afd775e2/os-volume_attachments => generated 25 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:00:17.837462 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-28f520d0-d97d-4d8b-aa61-b7e7c257e4c1 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:00:17.839271 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-28f520d0-d97d-4d8b-aa61-b7e7c257e4c1 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] [instance: f6762e10-9d45-47cf-a6b6-d9bfc3404664] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:00:17.852558 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-28f520d0-d97d-4d8b-aa61-b7e7c257e4c1 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:17.856749 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-28f520d0-d97d-4d8b-aa61-b7e7c257e4c1 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:17.857548 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-28f520d0-d97d-4d8b-aa61-b7e7c257e4c1 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:17.859337 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-170cff0c-3c0d-4258-a1f2-ee1917ecbe3f tempest-ServersTestFqdnHostnames-269349818 tempest-ServersTestFqdnHostnames-269349818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d33ca3478b7455dad5094afee57c8b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfea57f34b844c77b22619105249d08a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:00:17.860367 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-28f520d0-d97d-4d8b-aa61-b7e7c257e4c1 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:17.861091 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-28f520d0-d97d-4d8b-aa61-b7e7c257e4c1 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:17.862334 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-28f520d0-d97d-4d8b-aa61-b7e7c257e4c1 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:17.877886 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-170cff0c-3c0d-4258-a1f2-ee1917ecbe3f tempest-ServersTestFqdnHostnames-269349818 tempest-ServersTestFqdnHostnames-269349818-project] 10.222.0.13 "GET /compute/v2.1/servers/04443e90-21e9-4b5e-99e8-350f07e4ea82" status: 200 len: 1352 microversion: 2.1 time: 0.525211 Nov 01 19:00:17.886301 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 834/1705] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:00:17 2022] GET /compute/v2.1/servers/04443e90-21e9-4b5e-99e8-350f07e4ea82 => generated 1352 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:00:17.897022 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-fa636873-23f0-442b-8f68-36b84de0f0f3 tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] Calling method '.version_select at 0x7f0ae2bd4280>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:00:18.018812 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-fa636873-23f0-442b-8f68-36b84de0f0f3 tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] 10.222.0.13 "GET /compute/v2.1/images/14008a7c-6542-4124-800d-d352127c1bb1" status: 200 len: 1454 microversion: 2.1 time: 0.127494 Nov 01 19:00:18.032059 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 835/1706] 10.222.0.13 () {58 vars in 1233 bytes} [Tue Nov 1 19:00:17 2022] GET /compute/v2.1/images/14008a7c-6542-4124-800d-d352127c1bb1 => generated 1454 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:00:18.072944 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-28f520d0-d97d-4d8b-aa61-b7e7c257e4c1 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72117f17294649d6b8bc16c66c7efab2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45d4c047d3c44324a27a27831236ab0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:00:18.082899 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-28f520d0-d97d-4d8b-aa61-b7e7c257e4c1 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] 10.222.0.13 "GET /compute/v2.1/servers/f6762e10-9d45-47cf-a6b6-d9bfc3404664" status: 200 len: 1477 microversion: 2.1 time: 0.255853 Nov 01 19:00:18.084629 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 872/1707] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:00:17 2022] GET /compute/v2.1/servers/f6762e10-9d45-47cf-a6b6-d9bfc3404664 => generated 1477 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:00:18.391161 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-0e483634-8867-45b3-aeb4-b0096a7a2412 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:00:18.392459 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-0e483634-8867-45b3-aeb4-b0096a7a2412 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] [instance: 1f499af7-1896-478c-b7d7-d922bf78bd98] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:00:18.412324 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-0e483634-8867-45b3-aeb4-b0096a7a2412 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:18.424273 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-0e483634-8867-45b3-aeb4-b0096a7a2412 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:18.430642 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-0e483634-8867-45b3-aeb4-b0096a7a2412 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:18.431967 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-0e483634-8867-45b3-aeb4-b0096a7a2412 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:18.433795 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-0e483634-8867-45b3-aeb4-b0096a7a2412 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:18.435321 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-0e483634-8867-45b3-aeb4-b0096a7a2412 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:18.510772 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-7a8fe1e8-105b-4c24-b455-d2587be2ce2c tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:00:18.513043 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-7a8fe1e8-105b-4c24-b455-d2587be2ce2c tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] [instance: 68b54f50-6b4d-4ea3-877f-c7ac79a5bb86] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:00:18.546057 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-7a8fe1e8-105b-4c24-b455-d2587be2ce2c tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:18.548066 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-7a8fe1e8-105b-4c24-b455-d2587be2ce2c tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:18.548988 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-7a8fe1e8-105b-4c24-b455-d2587be2ce2c tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:18.552410 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-7a8fe1e8-105b-4c24-b455-d2587be2ce2c tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:18.557066 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-7a8fe1e8-105b-4c24-b455-d2587be2ce2c tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:18.557822 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-7a8fe1e8-105b-4c24-b455-d2587be2ce2c tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:18.865468 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-0e483634-8867-45b3-aeb4-b0096a7a2412 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f32f5fba1976432d938e664c7714e52b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b9d4c236b944f9b2e8e502a50a8f8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:00:18.874860 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-0e483634-8867-45b3-aeb4-b0096a7a2412 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] 10.222.0.13 "GET /compute/v2.1/servers/1f499af7-1896-478c-b7d7-d922bf78bd98" status: 200 len: 1211 microversion: 2.1 time: 0.497131 Nov 01 19:00:18.892930 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 836/1708] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:00:18 2022] GET /compute/v2.1/servers/1f499af7-1896-478c-b7d7-d922bf78bd98 => generated 1211 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:00:18.922414 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-772608ca-acad-4ab8-be5b-d42ecb419b7c tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:00:18.926943 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-772608ca-acad-4ab8-be5b-d42ecb419b7c tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] [instance: 71704d65-40b5-4f2e-8565-22e3b5a55d14] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:00:18.941085 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-7a8fe1e8-105b-4c24-b455-d2587be2ce2c tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a9c3b6a8c34f068caa50dc10d13a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9ef08eba0ef431285fd15a2561b4e5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:00:18.951106 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-772608ca-acad-4ab8-be5b-d42ecb419b7c tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:18.954443 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-772608ca-acad-4ab8-be5b-d42ecb419b7c tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:18.955720 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-772608ca-acad-4ab8-be5b-d42ecb419b7c tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:18.956946 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-772608ca-acad-4ab8-be5b-d42ecb419b7c tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:18.957721 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-772608ca-acad-4ab8-be5b-d42ecb419b7c tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:18.960023 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-772608ca-acad-4ab8-be5b-d42ecb419b7c tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:18.962486 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-7a8fe1e8-105b-4c24-b455-d2587be2ce2c tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] 10.222.0.13 "GET /compute/v2.1/servers/68b54f50-6b4d-4ea3-877f-c7ac79a5bb86" status: 200 len: 1315 microversion: 2.1 time: 0.453558 Nov 01 19:00:18.963174 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 873/1709] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:00:18 2022] GET /compute/v2.1/servers/68b54f50-6b4d-4ea3-877f-c7ac79a5bb86 => generated 1315 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:00:18.991243 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-58427199-5226-42d4-925d-3e64afa732db tempest-ServersTestFqdnHostnames-269349818 tempest-ServersTestFqdnHostnames-269349818-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:00:18.992105 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-58427199-5226-42d4-925d-3e64afa732db tempest-ServersTestFqdnHostnames-269349818 tempest-ServersTestFqdnHostnames-269349818-project] [instance: 04443e90-21e9-4b5e-99e8-350f07e4ea82] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:00:19.001246 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-58427199-5226-42d4-925d-3e64afa732db tempest-ServersTestFqdnHostnames-269349818 tempest-ServersTestFqdnHostnames-269349818-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:19.001960 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-58427199-5226-42d4-925d-3e64afa732db tempest-ServersTestFqdnHostnames-269349818 tempest-ServersTestFqdnHostnames-269349818-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:19.002573 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-58427199-5226-42d4-925d-3e64afa732db tempest-ServersTestFqdnHostnames-269349818 tempest-ServersTestFqdnHostnames-269349818-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:19.015050 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-58427199-5226-42d4-925d-3e64afa732db tempest-ServersTestFqdnHostnames-269349818 tempest-ServersTestFqdnHostnames-269349818-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:19.015763 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-58427199-5226-42d4-925d-3e64afa732db tempest-ServersTestFqdnHostnames-269349818 tempest-ServersTestFqdnHostnames-269349818-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:19.017749 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-58427199-5226-42d4-925d-3e64afa732db tempest-ServersTestFqdnHostnames-269349818 tempest-ServersTestFqdnHostnames-269349818-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:19.124905 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-772608ca-acad-4ab8-be5b-d42ecb419b7c tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0290a6bb8bc24b8988a925327ac0381c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86941784237549838bba63ce88053b88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:00:19.141949 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-772608ca-acad-4ab8-be5b-d42ecb419b7c tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] 10.222.0.13 "GET /compute/v2.1/servers/71704d65-40b5-4f2e-8565-22e3b5a55d14" status: 200 len: 1274 microversion: 2.1 time: 0.246095 Nov 01 19:00:19.152804 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 837/1710] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:00:18 2022] GET /compute/v2.1/servers/71704d65-40b5-4f2e-8565-22e3b5a55d14 => generated 1274 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:00:19.161607 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-5615bd7c-597f-4f4f-be3c-c904674c295f tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] Calling method '.version_select at 0x7f0ae2999ca0>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:00:19.223032 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-5615bd7c-597f-4f4f-be3c-c904674c295f tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] 10.222.0.13 "GET /compute/v2.1/images/14008a7c-6542-4124-800d-d352127c1bb1" status: 200 len: 1454 microversion: 2.1 time: 0.079414 Nov 01 19:00:19.229577 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 838/1711] 10.222.0.13 () {58 vars in 1233 bytes} [Tue Nov 1 19:00:19 2022] GET /compute/v2.1/images/14008a7c-6542-4124-800d-d352127c1bb1 => generated 1454 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:00:19.241967 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-2936c0c9-ad37-4bf6-8df5-e3b8a0272497 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:00:19.244069 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-2936c0c9-ad37-4bf6-8df5-e3b8a0272497 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] [instance: f6762e10-9d45-47cf-a6b6-d9bfc3404664] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:00:19.261429 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-2936c0c9-ad37-4bf6-8df5-e3b8a0272497 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:19.262543 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-2936c0c9-ad37-4bf6-8df5-e3b8a0272497 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:19.263060 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-2936c0c9-ad37-4bf6-8df5-e3b8a0272497 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:19.263843 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-2936c0c9-ad37-4bf6-8df5-e3b8a0272497 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:19.264755 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-2936c0c9-ad37-4bf6-8df5-e3b8a0272497 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:19.265200 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-2936c0c9-ad37-4bf6-8df5-e3b8a0272497 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:19.321520 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-58427199-5226-42d4-925d-3e64afa732db tempest-ServersTestFqdnHostnames-269349818 tempest-ServersTestFqdnHostnames-269349818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d33ca3478b7455dad5094afee57c8b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfea57f34b844c77b22619105249d08a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:00:19.332472 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-58427199-5226-42d4-925d-3e64afa732db tempest-ServersTestFqdnHostnames-269349818 tempest-ServersTestFqdnHostnames-269349818-project] 10.222.0.13 "GET /compute/v2.1/servers/04443e90-21e9-4b5e-99e8-350f07e4ea82" status: 200 len: 1542 microversion: 2.1 time: 0.348842 Nov 01 19:00:19.335484 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 874/1712] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:00:18 2022] GET /compute/v2.1/servers/04443e90-21e9-4b5e-99e8-350f07e4ea82 => generated 1542 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:00:19.361488 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-21db6282-e4a8-464d-8708-d3de737c8062 tempest-ServersTestFqdnHostnames-269349818 tempest-ServersTestFqdnHostnames-269349818-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:00:19.361995 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-21db6282-e4a8-464d-8708-d3de737c8062 tempest-ServersTestFqdnHostnames-269349818 tempest-ServersTestFqdnHostnames-269349818-project] [instance: 04443e90-21e9-4b5e-99e8-350f07e4ea82] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:00:19.382902 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-21db6282-e4a8-464d-8708-d3de737c8062 tempest-ServersTestFqdnHostnames-269349818 tempest-ServersTestFqdnHostnames-269349818-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:19.383409 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-21db6282-e4a8-464d-8708-d3de737c8062 tempest-ServersTestFqdnHostnames-269349818 tempest-ServersTestFqdnHostnames-269349818-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:19.383845 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-21db6282-e4a8-464d-8708-d3de737c8062 tempest-ServersTestFqdnHostnames-269349818 tempest-ServersTestFqdnHostnames-269349818-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:19.384606 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-21db6282-e4a8-464d-8708-d3de737c8062 tempest-ServersTestFqdnHostnames-269349818 tempest-ServersTestFqdnHostnames-269349818-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:19.396459 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-21db6282-e4a8-464d-8708-d3de737c8062 tempest-ServersTestFqdnHostnames-269349818 tempest-ServersTestFqdnHostnames-269349818-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:19.402526 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-21db6282-e4a8-464d-8708-d3de737c8062 tempest-ServersTestFqdnHostnames-269349818 tempest-ServersTestFqdnHostnames-269349818-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:19.565561 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-21db6282-e4a8-464d-8708-d3de737c8062 tempest-ServersTestFqdnHostnames-269349818 tempest-ServersTestFqdnHostnames-269349818-project] 10.222.0.13 "GET /compute/v2.1/servers/04443e90-21e9-4b5e-99e8-350f07e4ea82/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.208022 Nov 01 19:00:19.567217 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 875/1713] 10.222.0.13 () {58 vars in 1275 bytes} [Tue Nov 1 19:00:19 2022] GET /compute/v2.1/servers/04443e90-21e9-4b5e-99e8-350f07e4ea82/os-interface => generated 284 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 01 19:00:19.607873 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-2936c0c9-ad37-4bf6-8df5-e3b8a0272497 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72117f17294649d6b8bc16c66c7efab2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45d4c047d3c44324a27a27831236ab0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:00:19.619696 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-2936c0c9-ad37-4bf6-8df5-e3b8a0272497 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] 10.222.0.13 "GET /compute/v2.1/servers/f6762e10-9d45-47cf-a6b6-d9bfc3404664" status: 200 len: 1477 microversion: 2.1 time: 0.386311 Nov 01 19:00:19.620673 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 839/1714] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:00:19 2022] GET /compute/v2.1/servers/f6762e10-9d45-47cf-a6b6-d9bfc3404664 => generated 1477 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:00:19.906815 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-e52d7276-3d1c-4a97-9e93-142042d1768e tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:00:19.907433 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-e52d7276-3d1c-4a97-9e93-142042d1768e tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] [instance: 1f499af7-1896-478c-b7d7-d922bf78bd98] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:00:19.920162 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e52d7276-3d1c-4a97-9e93-142042d1768e tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:19.920680 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e52d7276-3d1c-4a97-9e93-142042d1768e tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:19.921126 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e52d7276-3d1c-4a97-9e93-142042d1768e tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:19.936405 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e52d7276-3d1c-4a97-9e93-142042d1768e tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:19.938050 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e52d7276-3d1c-4a97-9e93-142042d1768e tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:19.938678 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e52d7276-3d1c-4a97-9e93-142042d1768e tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:19.996497 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-195a76c7-c8eb-4727-ae03-d6f84ba0f23e tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:00:19.997973 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-195a76c7-c8eb-4727-ae03-d6f84ba0f23e tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] [instance: 68b54f50-6b4d-4ea3-877f-c7ac79a5bb86] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:00:20.016983 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-195a76c7-c8eb-4727-ae03-d6f84ba0f23e tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:20.018331 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-195a76c7-c8eb-4727-ae03-d6f84ba0f23e tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:20.019686 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-195a76c7-c8eb-4727-ae03-d6f84ba0f23e tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:20.021460 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-195a76c7-c8eb-4727-ae03-d6f84ba0f23e tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:20.022750 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-195a76c7-c8eb-4727-ae03-d6f84ba0f23e tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:20.024398 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-195a76c7-c8eb-4727-ae03-d6f84ba0f23e tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:20.453309 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-195a76c7-c8eb-4727-ae03-d6f84ba0f23e tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a9c3b6a8c34f068caa50dc10d13a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9ef08eba0ef431285fd15a2561b4e5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:00:20.467652 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-e52d7276-3d1c-4a97-9e93-142042d1768e tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f32f5fba1976432d938e664c7714e52b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b9d4c236b944f9b2e8e502a50a8f8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:00:20.468020 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-195a76c7-c8eb-4727-ae03-d6f84ba0f23e tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] 10.222.0.13 "GET /compute/v2.1/servers/68b54f50-6b4d-4ea3-877f-c7ac79a5bb86" status: 200 len: 1315 microversion: 2.1 time: 0.481699 Nov 01 19:00:20.468635 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 840/1715] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:00:19 2022] GET /compute/v2.1/servers/68b54f50-6b4d-4ea3-877f-c7ac79a5bb86 => generated 1315 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 19:00:20.481889 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-e52d7276-3d1c-4a97-9e93-142042d1768e tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] 10.222.0.13 "GET /compute/v2.1/servers/1f499af7-1896-478c-b7d7-d922bf78bd98" status: 200 len: 1211 microversion: 2.1 time: 0.580460 Nov 01 19:00:20.483186 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 876/1716] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:00:19 2022] GET /compute/v2.1/servers/1f499af7-1896-478c-b7d7-d922bf78bd98 => generated 1211 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:00:20.490981 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-50c19778-e2d0-4e64-b9a2-7fe3804c770b tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] Calling method '.version_select at 0x7f0ae1cb1700>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:00:20.504800 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-219309b9-fded-42d2-9f4f-a2327a0b3245 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:00:20.506675 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-219309b9-fded-42d2-9f4f-a2327a0b3245 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] [instance: 71704d65-40b5-4f2e-8565-22e3b5a55d14] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:00:20.534566 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-219309b9-fded-42d2-9f4f-a2327a0b3245 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:20.535073 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-219309b9-fded-42d2-9f4f-a2327a0b3245 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:20.535514 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-219309b9-fded-42d2-9f4f-a2327a0b3245 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:20.536238 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-219309b9-fded-42d2-9f4f-a2327a0b3245 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:20.536719 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-219309b9-fded-42d2-9f4f-a2327a0b3245 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:20.537144 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-219309b9-fded-42d2-9f4f-a2327a0b3245 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:20.847857 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-219309b9-fded-42d2-9f4f-a2327a0b3245 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0290a6bb8bc24b8988a925327ac0381c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86941784237549838bba63ce88053b88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:00:20.863933 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-219309b9-fded-42d2-9f4f-a2327a0b3245 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] 10.222.0.13 "GET /compute/v2.1/servers/71704d65-40b5-4f2e-8565-22e3b5a55d14" status: 200 len: 1316 microversion: 2.1 time: 0.385713 Nov 01 19:00:20.867648 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 841/1717] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:00:20 2022] GET /compute/v2.1/servers/71704d65-40b5-4f2e-8565-22e3b5a55d14 => generated 1316 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:00:20.885861 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-9097bbd0-cedb-4f70-9785-e7379a6ba652 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:00:20.897469 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-9097bbd0-cedb-4f70-9785-e7379a6ba652 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] [instance: f6762e10-9d45-47cf-a6b6-d9bfc3404664] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:00:20.921055 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-9097bbd0-cedb-4f70-9785-e7379a6ba652 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:20.923785 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-9097bbd0-cedb-4f70-9785-e7379a6ba652 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:20.924244 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-9097bbd0-cedb-4f70-9785-e7379a6ba652 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:20.925003 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-9097bbd0-cedb-4f70-9785-e7379a6ba652 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:20.925460 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-9097bbd0-cedb-4f70-9785-e7379a6ba652 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:20.931528 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-9097bbd0-cedb-4f70-9785-e7379a6ba652 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:20.992467 n-d-863052-2 devstack@n-api.service[121403]: DEBUG dbcounter [-] [121403] Writing DB stats nova_cell1:SELECT=100 {{(pid=121403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 19:00:21.162772 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-9097bbd0-cedb-4f70-9785-e7379a6ba652 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72117f17294649d6b8bc16c66c7efab2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45d4c047d3c44324a27a27831236ab0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:00:21.175305 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-9097bbd0-cedb-4f70-9785-e7379a6ba652 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] 10.222.0.13 "GET /compute/v2.1/servers/f6762e10-9d45-47cf-a6b6-d9bfc3404664" status: 200 len: 1477 microversion: 2.1 time: 0.302952 Nov 01 19:00:21.177389 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 842/1718] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:00:20 2022] GET /compute/v2.1/servers/f6762e10-9d45-47cf-a6b6-d9bfc3404664 => generated 1477 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:00:21.256732 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [req-ac711d56-c316-486d-ba89-d5de30e12d91 req-4343e9cb-9666-4027-8f87-62bd135ad546 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "68b54f50-6b4d-4ea3-877f-c7ac79a5bb86", "name": "network-vif-plugged", "status": "completed", "tag": "07f6f2d6-299c-491b-aa7c-cc5981eba332"}]} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:00:21.290526 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-ac711d56-c316-486d-ba89-d5de30e12d91 req-4343e9cb-9666-4027-8f87-62bd135ad546 service nova] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:21.292406 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-ac711d56-c316-486d-ba89-d5de30e12d91 req-4343e9cb-9666-4027-8f87-62bd135ad546 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:21.293430 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-ac711d56-c316-486d-ba89-d5de30e12d91 req-4343e9cb-9666-4027-8f87-62bd135ad546 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:21.325804 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.compute.server_external_events [req-ac711d56-c316-486d-ba89-d5de30e12d91 req-4343e9cb-9666-4027-8f87-62bd135ad546 service nova] Creating event network-vif-plugged:07f6f2d6-299c-491b-aa7c-cc5981eba332 for instance 68b54f50-6b4d-4ea3-877f-c7ac79a5bb86 on n-h1-863052-2 Nov 01 19:00:21.338907 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [req-ac711d56-c316-486d-ba89-d5de30e12d91 req-4343e9cb-9666-4027-8f87-62bd135ad546 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093910 Nov 01 19:00:21.340787 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 843/1719] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Nov 1 19:00:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:00:21.493381 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-1c1ff8a2-8877-4e64-8a39-cdcda0b547a7 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:00:21.494106 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-1c1ff8a2-8877-4e64-8a39-cdcda0b547a7 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] [instance: 68b54f50-6b4d-4ea3-877f-c7ac79a5bb86] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:00:21.519396 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-1c1ff8a2-8877-4e64-8a39-cdcda0b547a7 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:21.520104 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-1c1ff8a2-8877-4e64-8a39-cdcda0b547a7 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:21.523365 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-1c1ff8a2-8877-4e64-8a39-cdcda0b547a7 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:21.524619 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-1c1ff8a2-8877-4e64-8a39-cdcda0b547a7 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:21.528001 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-1c1ff8a2-8877-4e64-8a39-cdcda0b547a7 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:21.529029 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-1c1ff8a2-8877-4e64-8a39-cdcda0b547a7 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:22.292479 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-1c1ff8a2-8877-4e64-8a39-cdcda0b547a7 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a9c3b6a8c34f068caa50dc10d13a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9ef08eba0ef431285fd15a2561b4e5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:00:22.303479 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-1c1ff8a2-8877-4e64-8a39-cdcda0b547a7 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] 10.222.0.13 "GET /compute/v2.1/servers/68b54f50-6b4d-4ea3-877f-c7ac79a5bb86" status: 200 len: 1315 microversion: 2.1 time: 0.815419 Nov 01 19:00:22.304084 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 844/1720] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:00:21 2022] GET /compute/v2.1/servers/68b54f50-6b4d-4ea3-877f-c7ac79a5bb86 => generated 1315 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 19:00:22.315122 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-3bbe8d8f-9b17-43a9-8e37-841b707d82b7 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:00:22.315750 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-3bbe8d8f-9b17-43a9-8e37-841b707d82b7 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] [instance: 1f499af7-1896-478c-b7d7-d922bf78bd98] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:00:22.330785 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-3bbe8d8f-9b17-43a9-8e37-841b707d82b7 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:22.331401 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-3bbe8d8f-9b17-43a9-8e37-841b707d82b7 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:22.331751 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-3bbe8d8f-9b17-43a9-8e37-841b707d82b7 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:22.332467 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-3bbe8d8f-9b17-43a9-8e37-841b707d82b7 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:22.333227 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-3bbe8d8f-9b17-43a9-8e37-841b707d82b7 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:22.333859 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-3bbe8d8f-9b17-43a9-8e37-841b707d82b7 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:22.566000 n-d-863052-2 devstack@n-api.service[121403]: DEBUG dbcounter [-] [121403] Writing DB stats nova_cell0:SELECT=2 {{(pid=121403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 19:00:22.613847 n-d-863052-2 devstack@n-api.service[121403]: DEBUG dbcounter [-] [121403] Writing DB stats nova_cell0:SELECT=6 {{(pid=121403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 19:00:22.670788 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-3bbe8d8f-9b17-43a9-8e37-841b707d82b7 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f32f5fba1976432d938e664c7714e52b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b9d4c236b944f9b2e8e502a50a8f8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:00:22.702370 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-3bbe8d8f-9b17-43a9-8e37-841b707d82b7 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] 10.222.0.13 "GET /compute/v2.1/servers/1f499af7-1896-478c-b7d7-d922bf78bd98" status: 200 len: 1199 microversion: 2.1 time: 0.381491 Nov 01 19:00:22.705319 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 845/1721] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:00:22 2022] GET /compute/v2.1/servers/1f499af7-1896-478c-b7d7-d922bf78bd98 => generated 1199 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:00:22.724228 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-8fc4d605-92f9-4359-b8ad-a77a8c253378 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:00:22.725022 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-8fc4d605-92f9-4359-b8ad-a77a8c253378 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] [instance: 71704d65-40b5-4f2e-8565-22e3b5a55d14] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:00:22.733496 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-8fc4d605-92f9-4359-b8ad-a77a8c253378 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:22.737919 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-8fc4d605-92f9-4359-b8ad-a77a8c253378 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:22.741942 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-8fc4d605-92f9-4359-b8ad-a77a8c253378 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:22.742921 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-8fc4d605-92f9-4359-b8ad-a77a8c253378 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:22.745040 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-8fc4d605-92f9-4359-b8ad-a77a8c253378 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:22.746384 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-8fc4d605-92f9-4359-b8ad-a77a8c253378 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:22.971021 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-8fc4d605-92f9-4359-b8ad-a77a8c253378 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0290a6bb8bc24b8988a925327ac0381c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86941784237549838bba63ce88053b88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:00:22.979428 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-8fc4d605-92f9-4359-b8ad-a77a8c253378 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] 10.222.0.13 "GET /compute/v2.1/servers/71704d65-40b5-4f2e-8565-22e3b5a55d14" status: 200 len: 1316 microversion: 2.1 time: 0.270597 Nov 01 19:00:22.981323 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 846/1722] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:00:22 2022] GET /compute/v2.1/servers/71704d65-40b5-4f2e-8565-22e3b5a55d14 => generated 1316 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:00:22.986637 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-3f6cb270-cf7d-495e-bd38-294583042df0 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:00:22.987247 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-3f6cb270-cf7d-495e-bd38-294583042df0 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] [instance: f6762e10-9d45-47cf-a6b6-d9bfc3404664] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:00:22.993212 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-3f6cb270-cf7d-495e-bd38-294583042df0 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:22.993914 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-3f6cb270-cf7d-495e-bd38-294583042df0 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:22.994520 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-3f6cb270-cf7d-495e-bd38-294583042df0 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:22.995406 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-3f6cb270-cf7d-495e-bd38-294583042df0 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:22.996689 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-3f6cb270-cf7d-495e-bd38-294583042df0 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:22.997334 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-3f6cb270-cf7d-495e-bd38-294583042df0 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:23.155563 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-3f6cb270-cf7d-495e-bd38-294583042df0 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72117f17294649d6b8bc16c66c7efab2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45d4c047d3c44324a27a27831236ab0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:00:23.169392 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-3f6cb270-cf7d-495e-bd38-294583042df0 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] 10.222.0.13 "GET /compute/v2.1/servers/f6762e10-9d45-47cf-a6b6-d9bfc3404664" status: 200 len: 1476 microversion: 2.1 time: 0.186137 Nov 01 19:00:23.170592 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 847/1723] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:00:22 2022] GET /compute/v2.1/servers/f6762e10-9d45-47cf-a6b6-d9bfc3404664 => generated 1476 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:00:23.175936 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [req-c29e9886-b3a1-40f5-8c80-251a6b14e696 req-55431454-a490-4dae-903b-966a97a909a6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "04443e90-21e9-4b5e-99e8-350f07e4ea82", "tag": "b9e488b8-901e-4fc1-abb5-b279e9c4057a"}]} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:00:23.186735 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-c29e9886-b3a1-40f5-8c80-251a6b14e696 req-55431454-a490-4dae-903b-966a97a909a6 service nova] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:23.188177 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-c29e9886-b3a1-40f5-8c80-251a6b14e696 req-55431454-a490-4dae-903b-966a97a909a6 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:23.188821 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-c29e9886-b3a1-40f5-8c80-251a6b14e696 req-55431454-a490-4dae-903b-966a97a909a6 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:23.203607 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.compute.server_external_events [req-c29e9886-b3a1-40f5-8c80-251a6b14e696 req-55431454-a490-4dae-903b-966a97a909a6 service nova] Creating event network-changed:b9e488b8-901e-4fc1-abb5-b279e9c4057a for instance 04443e90-21e9-4b5e-99e8-350f07e4ea82 on n-h1-863052-2 Nov 01 19:00:23.209475 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [req-c29e9886-b3a1-40f5-8c80-251a6b14e696 req-55431454-a490-4dae-903b-966a97a909a6 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037426 Nov 01 19:00:23.210722 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 848/1724] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Nov 1 19:00:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:00:23.216981 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [req-0dbdbbde-f111-454a-9122-7923dbdb6cb2 req-e171aef7-2fb1-40c3-9605-b7cc7ac0e229 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "71704d65-40b5-4f2e-8565-22e3b5a55d14", "tag": "d849f3a8-88a0-4bab-8785-39ca8377aac1"}]} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:00:23.231597 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-0dbdbbde-f111-454a-9122-7923dbdb6cb2 req-e171aef7-2fb1-40c3-9605-b7cc7ac0e229 service nova] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:23.232976 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-0dbdbbde-f111-454a-9122-7923dbdb6cb2 req-e171aef7-2fb1-40c3-9605-b7cc7ac0e229 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:23.233605 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-0dbdbbde-f111-454a-9122-7923dbdb6cb2 req-e171aef7-2fb1-40c3-9605-b7cc7ac0e229 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:23.250022 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.compute.server_external_events [req-0dbdbbde-f111-454a-9122-7923dbdb6cb2 req-e171aef7-2fb1-40c3-9605-b7cc7ac0e229 service nova] Creating event network-changed:d849f3a8-88a0-4bab-8785-39ca8377aac1 for instance 71704d65-40b5-4f2e-8565-22e3b5a55d14 on n-h1-863052-2 Nov 01 19:00:23.256350 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [req-0dbdbbde-f111-454a-9122-7923dbdb6cb2 req-e171aef7-2fb1-40c3-9605-b7cc7ac0e229 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044138 Nov 01 19:00:23.257387 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 849/1725] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Nov 1 19:00:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:00:23.328888 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-0a5054ea-3da8-45b2-88f5-f17ace450458 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:00:23.329681 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-0a5054ea-3da8-45b2-88f5-f17ace450458 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] [instance: 68b54f50-6b4d-4ea3-877f-c7ac79a5bb86] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:00:23.342402 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-0a5054ea-3da8-45b2-88f5-f17ace450458 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:23.342891 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-0a5054ea-3da8-45b2-88f5-f17ace450458 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:23.343423 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-0a5054ea-3da8-45b2-88f5-f17ace450458 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:23.344147 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-0a5054ea-3da8-45b2-88f5-f17ace450458 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:23.344939 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-0a5054ea-3da8-45b2-88f5-f17ace450458 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:23.345401 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-0a5054ea-3da8-45b2-88f5-f17ace450458 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:23.556452 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-0a5054ea-3da8-45b2-88f5-f17ace450458 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a9c3b6a8c34f068caa50dc10d13a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9ef08eba0ef431285fd15a2561b4e5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:00:23.565375 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-0a5054ea-3da8-45b2-88f5-f17ace450458 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] 10.222.0.13 "GET /compute/v2.1/servers/68b54f50-6b4d-4ea3-877f-c7ac79a5bb86" status: 200 len: 1315 microversion: 2.1 time: 0.241602 Nov 01 19:00:23.570116 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 850/1726] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:00:23 2022] GET /compute/v2.1/servers/68b54f50-6b4d-4ea3-877f-c7ac79a5bb86 => generated 1315 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:00:23.728194 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-d37462cb-5495-4435-98b2-38149975783b tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:00:23.728417 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-d37462cb-5495-4435-98b2-38149975783b tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] [instance: 1f499af7-1896-478c-b7d7-d922bf78bd98] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:00:23.740892 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d37462cb-5495-4435-98b2-38149975783b tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:23.741991 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d37462cb-5495-4435-98b2-38149975783b tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:23.745314 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d37462cb-5495-4435-98b2-38149975783b tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:23.746146 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d37462cb-5495-4435-98b2-38149975783b tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:23.746653 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d37462cb-5495-4435-98b2-38149975783b tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:23.747091 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d37462cb-5495-4435-98b2-38149975783b tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:23.882295 n-d-863052-2 devstack@n-api.service[121402]: DEBUG dbcounter [-] [121402] Writing DB stats nova_cell0:SELECT=2 {{(pid=121402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 19:00:23.933571 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-d37462cb-5495-4435-98b2-38149975783b tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f32f5fba1976432d938e664c7714e52b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b9d4c236b944f9b2e8e502a50a8f8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:00:23.949275 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-d37462cb-5495-4435-98b2-38149975783b tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] 10.222.0.13 "GET /compute/v2.1/servers/1f499af7-1896-478c-b7d7-d922bf78bd98" status: 200 len: 1199 microversion: 2.1 time: 0.225554 Nov 01 19:00:23.966559 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 851/1727] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:00:23 2022] GET /compute/v2.1/servers/1f499af7-1896-478c-b7d7-d922bf78bd98 => generated 1199 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 19:00:24.007464 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-facf5829-14de-474c-a9c0-9ac3cbdda90a tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:00:24.008096 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-facf5829-14de-474c-a9c0-9ac3cbdda90a tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] [instance: 71704d65-40b5-4f2e-8565-22e3b5a55d14] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:00:24.015346 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-facf5829-14de-474c-a9c0-9ac3cbdda90a tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:24.016166 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-facf5829-14de-474c-a9c0-9ac3cbdda90a tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:24.016811 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-facf5829-14de-474c-a9c0-9ac3cbdda90a tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:24.017744 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-facf5829-14de-474c-a9c0-9ac3cbdda90a tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:24.018389 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-facf5829-14de-474c-a9c0-9ac3cbdda90a tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:24.018981 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-facf5829-14de-474c-a9c0-9ac3cbdda90a tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:24.247443 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-facf5829-14de-474c-a9c0-9ac3cbdda90a tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0290a6bb8bc24b8988a925327ac0381c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86941784237549838bba63ce88053b88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:00:24.257900 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-facf5829-14de-474c-a9c0-9ac3cbdda90a tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] 10.222.0.13 "GET /compute/v2.1/servers/71704d65-40b5-4f2e-8565-22e3b5a55d14" status: 200 len: 1316 microversion: 2.1 time: 0.254341 Nov 01 19:00:24.259807 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 852/1728] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:00:24 2022] GET /compute/v2.1/servers/71704d65-40b5-4f2e-8565-22e3b5a55d14 => generated 1316 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:00:24.265624 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-bd6ef257-5320-4972-9720-e2f6b6790141 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:00:24.266235 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-bd6ef257-5320-4972-9720-e2f6b6790141 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] [instance: f6762e10-9d45-47cf-a6b6-d9bfc3404664] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:00:24.272330 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-bd6ef257-5320-4972-9720-e2f6b6790141 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:24.272931 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-bd6ef257-5320-4972-9720-e2f6b6790141 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:24.273383 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-bd6ef257-5320-4972-9720-e2f6b6790141 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:24.274085 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-bd6ef257-5320-4972-9720-e2f6b6790141 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:24.274577 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-bd6ef257-5320-4972-9720-e2f6b6790141 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:24.275007 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-bd6ef257-5320-4972-9720-e2f6b6790141 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:24.483713 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-bd6ef257-5320-4972-9720-e2f6b6790141 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72117f17294649d6b8bc16c66c7efab2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45d4c047d3c44324a27a27831236ab0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:00:24.498580 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-bd6ef257-5320-4972-9720-e2f6b6790141 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] 10.222.0.13 "GET /compute/v2.1/servers/f6762e10-9d45-47cf-a6b6-d9bfc3404664" status: 200 len: 1476 microversion: 2.1 time: 0.237630 Nov 01 19:00:24.521826 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 853/1729] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:00:24 2022] GET /compute/v2.1/servers/f6762e10-9d45-47cf-a6b6-d9bfc3404664 => generated 1476 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:00:24.593067 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-d15054a7-9346-4f8c-ad16-11f84c3d2140 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:00:24.596029 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-d15054a7-9346-4f8c-ad16-11f84c3d2140 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] [instance: 68b54f50-6b4d-4ea3-877f-c7ac79a5bb86] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:00:24.612500 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d15054a7-9346-4f8c-ad16-11f84c3d2140 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:24.613566 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d15054a7-9346-4f8c-ad16-11f84c3d2140 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:24.614224 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d15054a7-9346-4f8c-ad16-11f84c3d2140 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:24.617413 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d15054a7-9346-4f8c-ad16-11f84c3d2140 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:24.618230 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d15054a7-9346-4f8c-ad16-11f84c3d2140 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:24.619396 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d15054a7-9346-4f8c-ad16-11f84c3d2140 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:24.854978 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-d15054a7-9346-4f8c-ad16-11f84c3d2140 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a9c3b6a8c34f068caa50dc10d13a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9ef08eba0ef431285fd15a2561b4e5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:00:24.865936 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-d15054a7-9346-4f8c-ad16-11f84c3d2140 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] 10.222.0.13 "GET /compute/v2.1/servers/68b54f50-6b4d-4ea3-877f-c7ac79a5bb86" status: 200 len: 1315 microversion: 2.1 time: 0.275479 Nov 01 19:00:24.867054 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 854/1730] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:00:24 2022] GET /compute/v2.1/servers/68b54f50-6b4d-4ea3-877f-c7ac79a5bb86 => generated 1315 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:00:24.973730 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-b4375ccf-1131-4b3a-8519-47618f6c3ff5 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:00:24.974729 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-b4375ccf-1131-4b3a-8519-47618f6c3ff5 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] [instance: 1f499af7-1896-478c-b7d7-d922bf78bd98] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:00:24.982164 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-b4375ccf-1131-4b3a-8519-47618f6c3ff5 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:24.982664 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-b4375ccf-1131-4b3a-8519-47618f6c3ff5 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:24.983277 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-b4375ccf-1131-4b3a-8519-47618f6c3ff5 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:24.984007 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-b4375ccf-1131-4b3a-8519-47618f6c3ff5 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:24.984737 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-b4375ccf-1131-4b3a-8519-47618f6c3ff5 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:24.985203 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-b4375ccf-1131-4b3a-8519-47618f6c3ff5 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:25.171490 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-b4375ccf-1131-4b3a-8519-47618f6c3ff5 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f32f5fba1976432d938e664c7714e52b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b9d4c236b944f9b2e8e502a50a8f8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:00:25.181516 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-50c19778-e2d0-4e64-b9a2-7fe3804c770b tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] 10.222.0.13 "GET /compute/v2.1/images/14008a7c-6542-4124-800d-d352127c1bb1" status: 200 len: 1463 microversion: 2.1 time: 4.697017 Nov 01 19:00:25.182013 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-b4375ccf-1131-4b3a-8519-47618f6c3ff5 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] 10.222.0.13 "GET /compute/v2.1/servers/1f499af7-1896-478c-b7d7-d922bf78bd98" status: 200 len: 1199 microversion: 2.1 time: 0.211891 Nov 01 19:00:25.182652 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 855/1731] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:00:24 2022] GET /compute/v2.1/servers/1f499af7-1896-478c-b7d7-d922bf78bd98 => generated 1199 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 19:00:25.191740 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 877/1732] 10.222.0.13 () {58 vars in 1233 bytes} [Tue Nov 1 19:00:20 2022] GET /compute/v2.1/images/14008a7c-6542-4124-800d-d352127c1bb1 => generated 1463 bytes in 4708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:00:25.196794 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-24a1eba3-fd80-4145-949c-448145b09dd2 tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] Calling method '.version_select at 0x7f0ae21303a0>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:00:25.247292 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-24a1eba3-fd80-4145-949c-448145b09dd2 tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] 10.222.0.13 "GET /compute/v2.1/images/14008a7c-6542-4124-800d-d352127c1bb1" status: 200 len: 1463 microversion: 2.1 time: 0.054251 Nov 01 19:00:25.248143 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 856/1733] 10.222.0.13 () {58 vars in 1233 bytes} [Tue Nov 1 19:00:25 2022] GET /compute/v2.1/images/14008a7c-6542-4124-800d-d352127c1bb1 => generated 1463 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 19:00:25.262940 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [req-5912bef2-e2f9-455b-9f6a-3669bf04a93e req-2169cf7e-b940-4822-8391-0467be2ec1d9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f6762e10-9d45-47cf-a6b6-d9bfc3404664", "name": "network-vif-unplugged", "status": "completed", "tag": "ce9efbc4-25cd-4125-8921-620c35a44e5f"}, {"name": "network-changed", "server_uuid": "f6762e10-9d45-47cf-a6b6-d9bfc3404664", "tag": "ce9efbc4-25cd-4125-8921-620c35a44e5f"}]} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:00:25.263120 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-9ecf1a49-d6b3-4153-9db9-6718a14aae04 tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:00:25.263550 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-9ecf1a49-d6b3-4153-9db9-6718a14aae04 tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] [instance: d8e88b0f-ae97-44a4-8b6b-b94e2c600a83] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:00:25.270012 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-9ecf1a49-d6b3-4153-9db9-6718a14aae04 tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:25.270492 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-9ecf1a49-d6b3-4153-9db9-6718a14aae04 tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:25.270928 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-9ecf1a49-d6b3-4153-9db9-6718a14aae04 tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:25.271793 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-9ecf1a49-d6b3-4153-9db9-6718a14aae04 tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:25.272189 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-9ecf1a49-d6b3-4153-9db9-6718a14aae04 tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:25.272629 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-9ecf1a49-d6b3-4153-9db9-6718a14aae04 tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:25.275832 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-5912bef2-e2f9-455b-9f6a-3669bf04a93e req-2169cf7e-b940-4822-8391-0467be2ec1d9 service nova] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:25.276310 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-5912bef2-e2f9-455b-9f6a-3669bf04a93e req-2169cf7e-b940-4822-8391-0467be2ec1d9 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:25.276772 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-5912bef2-e2f9-455b-9f6a-3669bf04a93e req-2169cf7e-b940-4822-8391-0467be2ec1d9 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:25.290054 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.compute.server_external_events [req-5912bef2-e2f9-455b-9f6a-3669bf04a93e req-2169cf7e-b940-4822-8391-0467be2ec1d9 service nova] Creating event network-vif-unplugged:ce9efbc4-25cd-4125-8921-620c35a44e5f for instance f6762e10-9d45-47cf-a6b6-d9bfc3404664 on n-h2-863052-2 Nov 01 19:00:25.290566 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.compute.server_external_events [req-5912bef2-e2f9-455b-9f6a-3669bf04a93e req-2169cf7e-b940-4822-8391-0467be2ec1d9 service nova] Creating event network-changed:ce9efbc4-25cd-4125-8921-620c35a44e5f for instance f6762e10-9d45-47cf-a6b6-d9bfc3404664 on n-h2-863052-2 Nov 01 19:00:25.299375 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [req-5912bef2-e2f9-455b-9f6a-3669bf04a93e req-2169cf7e-b940-4822-8391-0467be2ec1d9 service nova] Instance f6762e10-9d45-47cf-a6b6-d9bfc3404664 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-863052-2', 'n-h1-863052-2'} {{(pid=121402) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Nov 01 19:00:25.323501 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [req-5912bef2-e2f9-455b-9f6a-3669bf04a93e req-2169cf7e-b940-4822-8391-0467be2ec1d9 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 352 microversion: 2.1 time: 0.064019 Nov 01 19:00:25.325094 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 878/1734] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Nov 1 19:00:25 2022] POST /compute/v2.1/os-server-external-events => generated 352 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:00:25.332375 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-07e06f4b-70b5-40cd-86d8-7bb5d916f506 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:00:25.333942 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-07e06f4b-70b5-40cd-86d8-7bb5d916f506 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] [instance: 71704d65-40b5-4f2e-8565-22e3b5a55d14] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:00:25.341037 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-07e06f4b-70b5-40cd-86d8-7bb5d916f506 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:25.341930 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-07e06f4b-70b5-40cd-86d8-7bb5d916f506 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:25.342523 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-07e06f4b-70b5-40cd-86d8-7bb5d916f506 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:25.344569 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-07e06f4b-70b5-40cd-86d8-7bb5d916f506 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:25.345242 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-07e06f4b-70b5-40cd-86d8-7bb5d916f506 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:25.346238 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-07e06f4b-70b5-40cd-86d8-7bb5d916f506 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:25.443906 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-9ecf1a49-d6b3-4153-9db9-6718a14aae04 tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b0619a8fc6f4fcc9eb5d4f473c595c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '280a221575634c6f908d333db769739b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:00:25.455105 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-9ecf1a49-d6b3-4153-9db9-6718a14aae04 tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] 10.222.0.13 "GET /compute/v2.1/servers/d8e88b0f-ae97-44a4-8b6b-b94e2c600a83" status: 200 len: 1479 microversion: 2.1 time: 0.195903 Nov 01 19:00:25.455833 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 857/1735] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:00:25 2022] GET /compute/v2.1/servers/d8e88b0f-ae97-44a4-8b6b-b94e2c600a83 => generated 1479 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:00:25.526748 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-0731da98-4e7c-4838-8a2a-773f0c9d9b56 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:00:25.528275 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-0731da98-4e7c-4838-8a2a-773f0c9d9b56 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] [instance: f6762e10-9d45-47cf-a6b6-d9bfc3404664] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:00:25.529392 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-07e06f4b-70b5-40cd-86d8-7bb5d916f506 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0290a6bb8bc24b8988a925327ac0381c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86941784237549838bba63ce88053b88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:00:25.535337 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-0731da98-4e7c-4838-8a2a-773f0c9d9b56 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:25.536120 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-0731da98-4e7c-4838-8a2a-773f0c9d9b56 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:25.536874 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-0731da98-4e7c-4838-8a2a-773f0c9d9b56 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:25.537694 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-0731da98-4e7c-4838-8a2a-773f0c9d9b56 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:25.538283 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-0731da98-4e7c-4838-8a2a-773f0c9d9b56 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:25.538574 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-07e06f4b-70b5-40cd-86d8-7bb5d916f506 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] 10.222.0.13 "GET /compute/v2.1/servers/71704d65-40b5-4f2e-8565-22e3b5a55d14" status: 200 len: 1316 microversion: 2.1 time: 0.211407 Nov 01 19:00:25.538917 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-0731da98-4e7c-4838-8a2a-773f0c9d9b56 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:25.539565 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 879/1736] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:00:25 2022] GET /compute/v2.1/servers/71704d65-40b5-4f2e-8565-22e3b5a55d14 => generated 1316 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:00:25.673246 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-0731da98-4e7c-4838-8a2a-773f0c9d9b56 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72117f17294649d6b8bc16c66c7efab2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45d4c047d3c44324a27a27831236ab0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:00:25.681730 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-0731da98-4e7c-4838-8a2a-773f0c9d9b56 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] 10.222.0.13 "GET /compute/v2.1/servers/f6762e10-9d45-47cf-a6b6-d9bfc3404664" status: 200 len: 1474 microversion: 2.1 time: 0.158871 Nov 01 19:00:25.682434 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 858/1737] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:00:25 2022] GET /compute/v2.1/servers/f6762e10-9d45-47cf-a6b6-d9bfc3404664 => generated 1474 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 19:00:25.889965 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-5a8e19f9-b5e8-4df6-816a-1d74456c8e6d tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:00:25.890573 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-5a8e19f9-b5e8-4df6-816a-1d74456c8e6d tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] [instance: 68b54f50-6b4d-4ea3-877f-c7ac79a5bb86] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:00:25.896854 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-5a8e19f9-b5e8-4df6-816a-1d74456c8e6d tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:25.897329 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-5a8e19f9-b5e8-4df6-816a-1d74456c8e6d tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:25.897758 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-5a8e19f9-b5e8-4df6-816a-1d74456c8e6d tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:25.898443 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-5a8e19f9-b5e8-4df6-816a-1d74456c8e6d tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:25.898896 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-5a8e19f9-b5e8-4df6-816a-1d74456c8e6d tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:25.899316 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-5a8e19f9-b5e8-4df6-816a-1d74456c8e6d tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:26.031685 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-5a8e19f9-b5e8-4df6-816a-1d74456c8e6d tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a9c3b6a8c34f068caa50dc10d13a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9ef08eba0ef431285fd15a2561b4e5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:00:26.039493 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-5a8e19f9-b5e8-4df6-816a-1d74456c8e6d tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] 10.222.0.13 "GET /compute/v2.1/servers/68b54f50-6b4d-4ea3-877f-c7ac79a5bb86" status: 200 len: 1503 microversion: 2.1 time: 0.153817 Nov 01 19:00:26.040179 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 880/1738] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:00:25 2022] GET /compute/v2.1/servers/68b54f50-6b4d-4ea3-877f-c7ac79a5bb86 => generated 1503 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:00:26.062522 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-ff6d59f3-5b19-4a1f-8343-510f3be54e10 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-942925666"}} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:00:26.063059 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-ff6d59f3-5b19-4a1f-8343-510f3be54e10 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] [instance: 68b54f50-6b4d-4ea3-877f-c7ac79a5bb86] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:00:26.069315 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-ff6d59f3-5b19-4a1f-8343-510f3be54e10 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:26.069810 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-ff6d59f3-5b19-4a1f-8343-510f3be54e10 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:26.070256 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-ff6d59f3-5b19-4a1f-8343-510f3be54e10 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:26.070994 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-ff6d59f3-5b19-4a1f-8343-510f3be54e10 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:26.071452 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-ff6d59f3-5b19-4a1f-8343-510f3be54e10 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:26.071882 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-ff6d59f3-5b19-4a1f-8343-510f3be54e10 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:26.206872 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-31fcb306-e233-492d-ba77-f4a6e55b7031 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:00:26.207598 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-31fcb306-e233-492d-ba77-f4a6e55b7031 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] [instance: 1f499af7-1896-478c-b7d7-d922bf78bd98] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:00:26.214124 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-31fcb306-e233-492d-ba77-f4a6e55b7031 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:26.214902 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-31fcb306-e233-492d-ba77-f4a6e55b7031 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:26.215519 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-31fcb306-e233-492d-ba77-f4a6e55b7031 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:26.216433 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-31fcb306-e233-492d-ba77-f4a6e55b7031 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:26.217113 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-31fcb306-e233-492d-ba77-f4a6e55b7031 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:26.217537 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-31fcb306-e233-492d-ba77-f4a6e55b7031 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:26.301131 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.network.security_group_api [None req-ff6d59f3-5b19-4a1f-8343-510f3be54e10 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Adding security group 45ff6218-4674-43d3-a758-cc5740dc9eac to port 07f6f2d6-299c-491b-aa7c-cc5981eba332 Nov 01 19:00:26.463954 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-31fcb306-e233-492d-ba77-f4a6e55b7031 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f32f5fba1976432d938e664c7714e52b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b9d4c236b944f9b2e8e502a50a8f8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:00:26.472323 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-31fcb306-e233-492d-ba77-f4a6e55b7031 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] 10.222.0.13 "GET /compute/v2.1/servers/1f499af7-1896-478c-b7d7-d922bf78bd98" status: 200 len: 1199 microversion: 2.1 time: 0.269643 Nov 01 19:00:26.488241 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 881/1739] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:00:26 2022] GET /compute/v2.1/servers/1f499af7-1896-478c-b7d7-d922bf78bd98 => generated 1199 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:00:26.493425 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-822311d2-e3ba-4182-a109-21b8b4dc9849 tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:00:26.494273 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-822311d2-e3ba-4182-a109-21b8b4dc9849 tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] [instance: d8e88b0f-ae97-44a4-8b6b-b94e2c600a83] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:00:26.501227 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-822311d2-e3ba-4182-a109-21b8b4dc9849 tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:26.501960 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-822311d2-e3ba-4182-a109-21b8b4dc9849 tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:26.502751 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-822311d2-e3ba-4182-a109-21b8b4dc9849 tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:26.503633 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-822311d2-e3ba-4182-a109-21b8b4dc9849 tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:26.504364 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-822311d2-e3ba-4182-a109-21b8b4dc9849 tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:26.504795 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-822311d2-e3ba-4182-a109-21b8b4dc9849 tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:26.892884 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-822311d2-e3ba-4182-a109-21b8b4dc9849 tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b0619a8fc6f4fcc9eb5d4f473c595c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '280a221575634c6f908d333db769739b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:00:26.902762 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-822311d2-e3ba-4182-a109-21b8b4dc9849 tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] 10.222.0.13 "GET /compute/v2.1/servers/d8e88b0f-ae97-44a4-8b6b-b94e2c600a83" status: 200 len: 1479 microversion: 2.1 time: 0.412515 Nov 01 19:00:26.903358 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 882/1740] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:00:26 2022] GET /compute/v2.1/servers/d8e88b0f-ae97-44a4-8b6b-b94e2c600a83 => generated 1479 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:00:26.911115 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-36dcd5d8-2fee-4dad-9ce8-1ca1a1c99f4d tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:00:26.911717 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-36dcd5d8-2fee-4dad-9ce8-1ca1a1c99f4d tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] [instance: 71704d65-40b5-4f2e-8565-22e3b5a55d14] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:00:26.918851 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-36dcd5d8-2fee-4dad-9ce8-1ca1a1c99f4d tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:26.919407 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-36dcd5d8-2fee-4dad-9ce8-1ca1a1c99f4d tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:26.919818 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-36dcd5d8-2fee-4dad-9ce8-1ca1a1c99f4d tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:26.920551 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-36dcd5d8-2fee-4dad-9ce8-1ca1a1c99f4d tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:26.921234 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-36dcd5d8-2fee-4dad-9ce8-1ca1a1c99f4d tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:26.921814 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-36dcd5d8-2fee-4dad-9ce8-1ca1a1c99f4d tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:26.978484 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-ff6d59f3-5b19-4a1f-8343-510f3be54e10 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] 10.222.0.13 "POST /compute/v2.1/servers/68b54f50-6b4d-4ea3-877f-c7ac79a5bb86/action" status: 202 len: 0 microversion: 2.1 time: 0.920374 Nov 01 19:00:26.981010 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 859/1741] 10.222.0.13 () {60 vars in 1278 bytes} [Tue Nov 1 19:00:26 2022] POST /compute/v2.1/servers/68b54f50-6b4d-4ea3-877f-c7ac79a5bb86/action => generated 0 bytes in 924 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 01 19:00:26.987473 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-67dd0bdc-34ec-48f5-a5df-12655f47f17d tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:00:26.989243 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-67dd0bdc-34ec-48f5-a5df-12655f47f17d tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] [instance: f6762e10-9d45-47cf-a6b6-d9bfc3404664] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:00:27.000690 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-67dd0bdc-34ec-48f5-a5df-12655f47f17d tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:27.002442 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-67dd0bdc-34ec-48f5-a5df-12655f47f17d tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:27.003681 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-67dd0bdc-34ec-48f5-a5df-12655f47f17d tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:27.004914 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-67dd0bdc-34ec-48f5-a5df-12655f47f17d tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:27.005836 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-67dd0bdc-34ec-48f5-a5df-12655f47f17d tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:27.006516 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-67dd0bdc-34ec-48f5-a5df-12655f47f17d tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:27.196734 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-36dcd5d8-2fee-4dad-9ce8-1ca1a1c99f4d tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0290a6bb8bc24b8988a925327ac0381c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86941784237549838bba63ce88053b88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:00:27.205874 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-36dcd5d8-2fee-4dad-9ce8-1ca1a1c99f4d tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] 10.222.0.13 "GET /compute/v2.1/servers/71704d65-40b5-4f2e-8565-22e3b5a55d14" status: 200 len: 1316 microversion: 2.1 time: 0.298322 Nov 01 19:00:27.206808 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 883/1742] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:00:26 2022] GET /compute/v2.1/servers/71704d65-40b5-4f2e-8565-22e3b5a55d14 => generated 1316 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:00:27.212226 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-9a6dc51f-7395-4a09-89be-2acef03c6959 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Calling method '.version_select at 0x7f0ae1cad310>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:00:27.327065 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-67dd0bdc-34ec-48f5-a5df-12655f47f17d tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72117f17294649d6b8bc16c66c7efab2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45d4c047d3c44324a27a27831236ab0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:00:27.342207 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-67dd0bdc-34ec-48f5-a5df-12655f47f17d tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] 10.222.0.13 "GET /compute/v2.1/servers/f6762e10-9d45-47cf-a6b6-d9bfc3404664" status: 200 len: 1474 microversion: 2.1 time: 0.357398 Nov 01 19:00:27.343203 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 860/1743] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:00:26 2022] GET /compute/v2.1/servers/f6762e10-9d45-47cf-a6b6-d9bfc3404664 => generated 1474 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:00:27.366528 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [req-98fb1e73-824d-4524-bf18-afe809f83290 req-0f982358-7f09-4cf6-99f0-f85209f0bee8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "68b54f50-6b4d-4ea3-877f-c7ac79a5bb86", "tag": "07f6f2d6-299c-491b-aa7c-cc5981eba332"}]} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:00:27.382191 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-98fb1e73-824d-4524-bf18-afe809f83290 req-0f982358-7f09-4cf6-99f0-f85209f0bee8 service nova] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:27.382966 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-98fb1e73-824d-4524-bf18-afe809f83290 req-0f982358-7f09-4cf6-99f0-f85209f0bee8 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:27.383594 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-98fb1e73-824d-4524-bf18-afe809f83290 req-0f982358-7f09-4cf6-99f0-f85209f0bee8 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:27.397331 n-d-863052-2 devstack@n-api.service[121402]: DEBUG neutronclient.v2_0.client [None req-9a6dc51f-7395-4a09-89be-2acef03c6959 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Error message: {"NeutronError": {"type": "SecurityGroupInUse", "message": "Security Group 45ff6218-4674-43d3-a758-cc5740dc9eac in use.", "detail": ""}} {{(pid=121402) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Nov 01 19:00:27.398027 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.wsgi [None req-9a6dc51f-7395-4a09-89be-2acef03c6959 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] HTTP exception thrown: Security Group 45ff6218-4674-43d3-a758-cc5740dc9eac in use. Nov 01 19:00:27.398027 n-d-863052-2 devstack@n-api.service[121402]: Neutron server returns request_ids: ['req-84925226-2425-42e3-9444-f8b9aeec0a9e'] Nov 01 19:00:27.400241 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-9a6dc51f-7395-4a09-89be-2acef03c6959 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Request method failure captured: Nov 01 19:00:27.400241 n-d-863052-2 devstack@n-api.service[121402]: request: DELETE /compute/v2.1/os-security-groups/45ff6218-4674-43d3-a758-cc5740dc9eac HTTP/1.1 Nov 01 19:00:27.400241 n-d-863052-2 devstack@n-api.service[121402]: Accept: application/json Nov 01 19:00:27.400241 n-d-863052-2 devstack@n-api.service[121402]: Accept-Encoding: identity Nov 01 19:00:27.400241 n-d-863052-2 devstack@n-api.service[121402]: Connection: close Nov 01 19:00:27.400241 n-d-863052-2 devstack@n-api.service[121402]: Content-Length: 0 Nov 01 19:00:27.400241 n-d-863052-2 devstack@n-api.service[121402]: Content-Type: application/json Nov 01 19:00:27.400241 n-d-863052-2 devstack@n-api.service[121402]: Host: 10.222.0.13 Nov 01 19:00:27.400241 n-d-863052-2 devstack@n-api.service[121402]: Openstack-System-Scope: None Nov 01 19:00:27.400241 n-d-863052-2 devstack@n-api.service[121402]: User-Agent: python-urllib3/1.26.12 Nov 01 19:00:27.400241 n-d-863052-2 devstack@n-api.service[121402]: X-Auth-Token: gAAAAABjYWyBtiXfeZJIejT83Ksslz2hqDZRAGe29hQVddGupa2qgtVXWeGxqJACkYUk64AE7WNmKMU9sisFWqkZV1B8K0xSz0uDHshwD54pFesORYzaFN_rWLCdcUKPHyx9WACJmd6ZEeb3LBT9WzZa08oHURzA6g0G4BDfSDsuxDk4mdVs9fM Nov 01 19:00:27.400241 n-d-863052-2 devstack@n-api.service[121402]: X-Domain-Id: None Nov 01 19:00:27.400241 n-d-863052-2 devstack@n-api.service[121402]: X-Domain-Name: None Nov 01 19:00:27.400241 n-d-863052-2 devstack@n-api.service[121402]: X-Identity-Status: Confirmed Nov 01 19:00:27.400241 n-d-863052-2 devstack@n-api.service[121402]: X-Is-Admin-Project: True Nov 01 19:00:27.400241 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Domain-Id: default Nov 01 19:00:27.400241 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Domain-Name: Default Nov 01 19:00:27.400241 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Id: a9ef08eba0ef431285fd15a2561b4e5d Nov 01 19:00:27.400241 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Name: tempest-SecurityGroupsTestJSON-1185949800 Nov 01 19:00:27.400241 n-d-863052-2 devstack@n-api.service[121402]: X-Role: member,reader Nov 01 19:00:27.400241 n-d-863052-2 devstack@n-api.service[121402]: X-Roles: member,reader Nov 01 19:00:27.402744 n-d-863052-2 devstack@n-api.service[121402]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/a9ef08eba0ef431285fd15a2561b4e5d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/a9ef08eba0ef431285fd15a2561b4e5d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_a9ef08eba0ef431285fd15a2561b4e5d", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/a9ef08eba0ef431285fd15a2561b4e5d"}]}] Nov 01 19:00:27.402744 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant: tempest-SecurityGroupsTestJSON-1185949800 Nov 01 19:00:27.402744 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant-Id: a9ef08eba0ef431285fd15a2561b4e5d Nov 01 19:00:27.402744 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1185949800 Nov 01 19:00:27.402744 n-d-863052-2 devstack@n-api.service[121402]: X-User: tempest-SecurityGroupsTestJSON-1185949800-project Nov 01 19:00:27.402744 n-d-863052-2 devstack@n-api.service[121402]: X-User-Domain-Id: default Nov 01 19:00:27.402744 n-d-863052-2 devstack@n-api.service[121402]: X-User-Domain-Name: Default Nov 01 19:00:27.402744 n-d-863052-2 devstack@n-api.service[121402]: X-User-Id: 55a9c3b6a8c34f068caa50dc10d13a85 Nov 01 19:00:27.402744 n-d-863052-2 devstack@n-api.service[121402]: X-User-Name: tempest-SecurityGroupsTestJSON-1185949800-project Nov 01 19:00:27.402744 n-d-863052-2 devstack@n-api.service[121402]: method: Nov 01 19:00:27.402744 n-d-863052-2 devstack@n-api.service[121402]: exception: Security Group 45ff6218-4674-43d3-a758-cc5740dc9eac in use. Nov 01 19:00:27.402744 n-d-863052-2 devstack@n-api.service[121402]: Neutron server returns request_ids: ['req-84925226-2425-42e3-9444-f8b9aeec0a9e'] Nov 01 19:00:27.402744 n-d-863052-2 devstack@n-api.service[121402]: action_args: {'id': '45ff6218-4674-43d3-a758-cc5740dc9eac'} Nov 01 19:00:27.403785 n-d-863052-2 devstack@n-api.service[121402]: {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 01 19:00:27.403785 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:00:27.403785 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Nov 01 19:00:27.403785 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Nov 01 19:00:27.403785 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 01 19:00:27.403785 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 01 19:00:27.403785 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1073, in delete_security_group Nov 01 19:00:27.403785 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Nov 01 19:00:27.403785 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 01 19:00:27.403785 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 01 19:00:27.403785 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Nov 01 19:00:27.403785 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Nov 01 19:00:27.403785 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 01 19:00:27.403785 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 01 19:00:27.403785 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 01 19:00:27.403785 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 01 19:00:27.403785 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 01 19:00:27.403785 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 01 19:00:27.403785 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Nov 01 19:00:27.405448 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Nov 01 19:00:27.405448 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 01 19:00:27.405448 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 01 19:00:27.405448 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Nov 01 19:00:27.405448 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Nov 01 19:00:27.405448 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Nov 01 19:00:27.405448 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Nov 01 19:00:27.405448 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Security Group 45ff6218-4674-43d3-a758-cc5740dc9eac in use. Nov 01 19:00:27.405448 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-84925226-2425-42e3-9444-f8b9aeec0a9e'] Nov 01 19:00:27.405448 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:00:27.405448 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:00:27.405448 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:00:27.405448 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:00:27.405448 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Nov 01 19:00:27.405448 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Nov 01 19:00:27.405448 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Nov 01 19:00:27.405448 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Nov 01 19:00:27.405448 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security Group 45ff6218-4674-43d3-a758-cc5740dc9eac in use. Nov 01 19:00:27.405448 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-84925226-2425-42e3-9444-f8b9aeec0a9e'] Nov 01 19:00:27.406991 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:00:27.406991 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:00:27.406991 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:00:27.406991 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:00:27.406991 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:00:27.406991 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:00:27.406991 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 01 19:00:27.406991 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 01 19:00:27.406991 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 01 19:00:27.406991 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 01 19:00:27.406991 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 01 19:00:27.406991 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 01 19:00:27.406991 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Nov 01 19:00:27.406991 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Nov 01 19:00:27.406991 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security Group 45ff6218-4674-43d3-a758-cc5740dc9eac in use. Nov 01 19:00:27.406991 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-84925226-2425-42e3-9444-f8b9aeec0a9e'] Nov 01 19:00:27.406991 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:00:27.406991 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:00:27.406991 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:00:27.406991 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:00:27.406991 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:00:27.408890 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:00:27.408890 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 01 19:00:27.408890 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 01 19:00:27.408890 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security Group 45ff6218-4674-43d3-a758-cc5740dc9eac in use. Nov 01 19:00:27.408890 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-84925226-2425-42e3-9444-f8b9aeec0a9e'] Nov 01 19:00:27.408890 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:00:27.409400 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.compute.server_external_events [req-98fb1e73-824d-4524-bf18-afe809f83290 req-0f982358-7f09-4cf6-99f0-f85209f0bee8 service nova] Creating event network-changed:07f6f2d6-299c-491b-aa7c-cc5981eba332 for instance 68b54f50-6b4d-4ea3-877f-c7ac79a5bb86 on n-h1-863052-2 Nov 01 19:00:27.409400 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [req-98fb1e73-824d-4524-bf18-afe809f83290 req-0f982358-7f09-4cf6-99f0-f85209f0bee8 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047919 Nov 01 19:00:27.409400 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 861/1744] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Nov 1 19:00:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:00:27.415276 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-9a6dc51f-7395-4a09-89be-2acef03c6959 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Returning 400 to user: Security Group 45ff6218-4674-43d3-a758-cc5740dc9eac in use. Nov 01 19:00:27.415276 n-d-863052-2 devstack@n-api.service[121402]: Neutron server returns request_ids: ['req-84925226-2425-42e3-9444-f8b9aeec0a9e'] {{(pid=121402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 01 19:00:27.415276 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-9a6dc51f-7395-4a09-89be-2acef03c6959 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] 10.222.0.13 "DELETE /compute/v2.1/os-security-groups/45ff6218-4674-43d3-a758-cc5740dc9eac" status: 400 len: 185 microversion: 2.1 time: 0.203575 Nov 01 19:00:27.416674 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 884/1745] 10.222.0.13 () {58 vars in 1272 bytes} [Tue Nov 1 19:00:27 2022] DELETE /compute/v2.1/os-security-groups/45ff6218-4674-43d3-a758-cc5740dc9eac => generated 185 bytes in 209 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 01 19:00:27.423070 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-8540f996-f532-4269-873d-bc0e05801b0c tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:00:27.429184 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-8540f996-f532-4269-873d-bc0e05801b0c tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] [instance: 68b54f50-6b4d-4ea3-877f-c7ac79a5bb86] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:00:27.435933 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-8540f996-f532-4269-873d-bc0e05801b0c tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:27.436425 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-8540f996-f532-4269-873d-bc0e05801b0c tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:27.438363 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-8540f996-f532-4269-873d-bc0e05801b0c tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:27.438531 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-8540f996-f532-4269-873d-bc0e05801b0c tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:27.440068 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-8540f996-f532-4269-873d-bc0e05801b0c tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:27.440210 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-8540f996-f532-4269-873d-bc0e05801b0c tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:27.481213 n-d-863052-2 devstack@n-api.service[121403]: DEBUG dbcounter [-] [121403] Writing DB stats nova_cell1:SELECT=100 {{(pid=121403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 19:00:27.497003 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-f9366758-a53c-423f-8cc8-3d26ad3c1506 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:00:27.497744 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-f9366758-a53c-423f-8cc8-3d26ad3c1506 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] [instance: 1f499af7-1896-478c-b7d7-d922bf78bd98] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:00:27.510797 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f9366758-a53c-423f-8cc8-3d26ad3c1506 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:27.520179 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f9366758-a53c-423f-8cc8-3d26ad3c1506 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:27.521108 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f9366758-a53c-423f-8cc8-3d26ad3c1506 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:27.525572 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f9366758-a53c-423f-8cc8-3d26ad3c1506 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:27.526328 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f9366758-a53c-423f-8cc8-3d26ad3c1506 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:27.532299 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f9366758-a53c-423f-8cc8-3d26ad3c1506 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:27.532858 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-8540f996-f532-4269-873d-bc0e05801b0c tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] 10.222.0.13 "POST /compute/v2.1/servers/68b54f50-6b4d-4ea3-877f-c7ac79a5bb86/action" status: 202 len: 0 microversion: 2.1 time: 0.115410 Nov 01 19:00:27.536733 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 862/1746] 10.222.0.13 () {60 vars in 1278 bytes} [Tue Nov 1 19:00:27 2022] POST /compute/v2.1/servers/68b54f50-6b4d-4ea3-877f-c7ac79a5bb86/action => generated 0 bytes in 118 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 01 19:00:27.542935 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-892760f0-4527-4a09-b60f-cbc34a264408 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:00:27.545055 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-892760f0-4527-4a09-b60f-cbc34a264408 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] [instance: 68b54f50-6b4d-4ea3-877f-c7ac79a5bb86] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:00:27.556194 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-892760f0-4527-4a09-b60f-cbc34a264408 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:27.556881 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-892760f0-4527-4a09-b60f-cbc34a264408 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:27.557887 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-892760f0-4527-4a09-b60f-cbc34a264408 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:27.560318 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-892760f0-4527-4a09-b60f-cbc34a264408 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:27.560927 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-892760f0-4527-4a09-b60f-cbc34a264408 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:27.561584 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-892760f0-4527-4a09-b60f-cbc34a264408 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:27.846553 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-892760f0-4527-4a09-b60f-cbc34a264408 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a9c3b6a8c34f068caa50dc10d13a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9ef08eba0ef431285fd15a2561b4e5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:00:27.855431 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-892760f0-4527-4a09-b60f-cbc34a264408 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] 10.222.0.13 "GET /compute/v2.1/servers/68b54f50-6b4d-4ea3-877f-c7ac79a5bb86" status: 200 len: 1573 microversion: 2.1 time: 0.316541 Nov 01 19:00:27.857892 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 863/1747] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:00:27 2022] GET /compute/v2.1/servers/68b54f50-6b4d-4ea3-877f-c7ac79a5bb86 => generated 1573 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:00:27.907844 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-f9366758-a53c-423f-8cc8-3d26ad3c1506 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f32f5fba1976432d938e664c7714e52b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b9d4c236b944f9b2e8e502a50a8f8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:00:27.923310 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-f9366758-a53c-423f-8cc8-3d26ad3c1506 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] 10.222.0.13 "GET /compute/v2.1/servers/1f499af7-1896-478c-b7d7-d922bf78bd98" status: 200 len: 1199 microversion: 2.1 time: 0.431599 Nov 01 19:00:27.929021 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-874872ce-4f82-4968-a63a-a0e032db8c40 tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:00:27.929650 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-874872ce-4f82-4968-a63a-a0e032db8c40 tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] [instance: d8e88b0f-ae97-44a4-8b6b-b94e2c600a83] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:00:27.936783 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 885/1748] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:00:27 2022] GET /compute/v2.1/servers/1f499af7-1896-478c-b7d7-d922bf78bd98 => generated 1199 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:00:27.943003 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-874872ce-4f82-4968-a63a-a0e032db8c40 tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:27.944012 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-874872ce-4f82-4968-a63a-a0e032db8c40 tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:27.945020 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-874872ce-4f82-4968-a63a-a0e032db8c40 tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:27.947278 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-874872ce-4f82-4968-a63a-a0e032db8c40 tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:27.948099 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-874872ce-4f82-4968-a63a-a0e032db8c40 tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:27.950287 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-874872ce-4f82-4968-a63a-a0e032db8c40 tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:28.119674 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-874872ce-4f82-4968-a63a-a0e032db8c40 tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b0619a8fc6f4fcc9eb5d4f473c595c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '280a221575634c6f908d333db769739b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:00:28.128223 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-874872ce-4f82-4968-a63a-a0e032db8c40 tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] 10.222.0.13 "GET /compute/v2.1/servers/d8e88b0f-ae97-44a4-8b6b-b94e2c600a83" status: 200 len: 1466 microversion: 2.1 time: 0.204556 Nov 01 19:00:28.128834 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 864/1749] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:00:27 2022] GET /compute/v2.1/servers/d8e88b0f-ae97-44a4-8b6b-b94e2c600a83 => generated 1466 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 19:00:28.150784 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-55139976-c0f8-41ee-81b8-53d4484ad24e tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-1172993288"}} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:00:28.153238 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-55139976-c0f8-41ee-81b8-53d4484ad24e tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] [instance: c34b04e9-a50a-4c58-85ff-ecef0bfc0343] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:00:28.160302 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-55139976-c0f8-41ee-81b8-53d4484ad24e tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:28.160854 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-55139976-c0f8-41ee-81b8-53d4484ad24e tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:28.161292 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-55139976-c0f8-41ee-81b8-53d4484ad24e tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:28.162189 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-55139976-c0f8-41ee-81b8-53d4484ad24e tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:28.162637 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-55139976-c0f8-41ee-81b8-53d4484ad24e tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:28.163056 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-55139976-c0f8-41ee-81b8-53d4484ad24e tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:28.230460 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-f72c4427-caca-4b27-94da-602619f405bc tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:00:28.231245 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-f72c4427-caca-4b27-94da-602619f405bc tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] [instance: 71704d65-40b5-4f2e-8565-22e3b5a55d14] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:00:28.238892 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f72c4427-caca-4b27-94da-602619f405bc tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:28.239384 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f72c4427-caca-4b27-94da-602619f405bc tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:28.239823 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f72c4427-caca-4b27-94da-602619f405bc tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:28.240527 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f72c4427-caca-4b27-94da-602619f405bc tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:28.241008 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f72c4427-caca-4b27-94da-602619f405bc tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:28.241570 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f72c4427-caca-4b27-94da-602619f405bc tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:28.392199 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-55139976-c0f8-41ee-81b8-53d4484ad24e tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] 10.222.0.13 "POST /compute/v2.1/servers/c34b04e9-a50a-4c58-85ff-ecef0bfc0343/action" status: 202 len: 0 microversion: 2.1 time: 0.244920 Nov 01 19:00:28.394040 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 886/1750] 10.222.0.13 () {60 vars in 1278 bytes} [Tue Nov 1 19:00:28 2022] POST /compute/v2.1/servers/c34b04e9-a50a-4c58-85ff-ecef0bfc0343/action => generated 0 bytes in 248 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 01 19:00:28.404887 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-78bb36d5-6a13-4cfd-9814-bf118212e08b tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:00:28.405841 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-78bb36d5-6a13-4cfd-9814-bf118212e08b tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] [instance: f6762e10-9d45-47cf-a6b6-d9bfc3404664] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:00:28.410024 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-f72c4427-caca-4b27-94da-602619f405bc tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0290a6bb8bc24b8988a925327ac0381c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86941784237549838bba63ce88053b88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:00:28.414874 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-78bb36d5-6a13-4cfd-9814-bf118212e08b tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:28.415847 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-78bb36d5-6a13-4cfd-9814-bf118212e08b tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:28.416839 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-78bb36d5-6a13-4cfd-9814-bf118212e08b tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:28.418499 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-78bb36d5-6a13-4cfd-9814-bf118212e08b tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:28.419453 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-78bb36d5-6a13-4cfd-9814-bf118212e08b tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:28.419715 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-f72c4427-caca-4b27-94da-602619f405bc tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] 10.222.0.13 "GET /compute/v2.1/servers/71704d65-40b5-4f2e-8565-22e3b5a55d14" status: 200 len: 1316 microversion: 2.1 time: 0.193554 Nov 01 19:00:28.433319 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 865/1751] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:00:28 2022] GET /compute/v2.1/servers/71704d65-40b5-4f2e-8565-22e3b5a55d14 => generated 1316 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 19:00:28.435450 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-78bb36d5-6a13-4cfd-9814-bf118212e08b tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:28.440132 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-32776415-fda9-4076-beec-67176aab0c97 tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] Calling method '.version_select at 0x7f0ae2999790>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:00:28.499643 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-32776415-fda9-4076-beec-67176aab0c97 tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] 10.222.0.13 "GET /compute/v2.1/images/ccc79e7f-4589-43b9-a2ca-2a8f13b6602d" status: 200 len: 1455 microversion: 2.1 time: 0.077790 Nov 01 19:00:28.500693 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 866/1752] 10.222.0.13 () {58 vars in 1233 bytes} [Tue Nov 1 19:00:28 2022] GET /compute/v2.1/images/ccc79e7f-4589-43b9-a2ca-2a8f13b6602d => generated 1455 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:00:28.653080 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-78bb36d5-6a13-4cfd-9814-bf118212e08b tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72117f17294649d6b8bc16c66c7efab2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45d4c047d3c44324a27a27831236ab0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:00:28.663873 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-78bb36d5-6a13-4cfd-9814-bf118212e08b tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] 10.222.0.13 "GET /compute/v2.1/servers/f6762e10-9d45-47cf-a6b6-d9bfc3404664" status: 200 len: 1474 microversion: 2.1 time: 0.265100 Nov 01 19:00:28.664817 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 887/1753] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:00:28 2022] GET /compute/v2.1/servers/f6762e10-9d45-47cf-a6b6-d9bfc3404664 => generated 1474 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:00:28.880389 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-b647ebca-bbec-4af1-8aad-9f0d9f558616 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:00:28.881021 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-b647ebca-bbec-4af1-8aad-9f0d9f558616 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] [instance: 68b54f50-6b4d-4ea3-877f-c7ac79a5bb86] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:00:28.888543 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-b647ebca-bbec-4af1-8aad-9f0d9f558616 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:28.889051 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-b647ebca-bbec-4af1-8aad-9f0d9f558616 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:28.889537 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-b647ebca-bbec-4af1-8aad-9f0d9f558616 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:28.890258 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-b647ebca-bbec-4af1-8aad-9f0d9f558616 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:28.890688 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-b647ebca-bbec-4af1-8aad-9f0d9f558616 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:28.891108 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-b647ebca-bbec-4af1-8aad-9f0d9f558616 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:28.950878 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-0ddea555-9edd-4143-9cc4-070a742e9527 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:00:28.952179 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-0ddea555-9edd-4143-9cc4-070a742e9527 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] [instance: 1f499af7-1896-478c-b7d7-d922bf78bd98] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:00:28.958797 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-0ddea555-9edd-4143-9cc4-070a742e9527 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:28.959765 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-0ddea555-9edd-4143-9cc4-070a742e9527 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:28.960402 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-0ddea555-9edd-4143-9cc4-070a742e9527 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:28.962293 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-0ddea555-9edd-4143-9cc4-070a742e9527 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:28.962762 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-0ddea555-9edd-4143-9cc4-070a742e9527 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:28.963552 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-0ddea555-9edd-4143-9cc4-070a742e9527 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:29.125475 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-0ddea555-9edd-4143-9cc4-070a742e9527 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f32f5fba1976432d938e664c7714e52b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b9d4c236b944f9b2e8e502a50a8f8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:00:29.135329 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-0ddea555-9edd-4143-9cc4-070a742e9527 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] 10.222.0.13 "GET /compute/v2.1/servers/1f499af7-1896-478c-b7d7-d922bf78bd98" status: 200 len: 1199 microversion: 2.1 time: 0.188890 Nov 01 19:00:29.137392 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 888/1754] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:00:28 2022] GET /compute/v2.1/servers/1f499af7-1896-478c-b7d7-d922bf78bd98 => generated 1199 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 19:00:29.150714 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-b647ebca-bbec-4af1-8aad-9f0d9f558616 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a9c3b6a8c34f068caa50dc10d13a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9ef08eba0ef431285fd15a2561b4e5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:00:29.161642 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-b647ebca-bbec-4af1-8aad-9f0d9f558616 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] 10.222.0.13 "GET /compute/v2.1/servers/68b54f50-6b4d-4ea3-877f-c7ac79a5bb86" status: 200 len: 1573 microversion: 2.1 time: 0.285928 Nov 01 19:00:29.162649 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 867/1755] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:00:28 2022] GET /compute/v2.1/servers/68b54f50-6b4d-4ea3-877f-c7ac79a5bb86 => generated 1573 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:00:29.447959 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-9b39da1e-7e64-4b86-84d2-8a6c5415a8c1 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:00:29.448884 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-9b39da1e-7e64-4b86-84d2-8a6c5415a8c1 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] [instance: 71704d65-40b5-4f2e-8565-22e3b5a55d14] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:00:29.454998 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-9b39da1e-7e64-4b86-84d2-8a6c5415a8c1 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:29.455480 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-9b39da1e-7e64-4b86-84d2-8a6c5415a8c1 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:29.455910 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-9b39da1e-7e64-4b86-84d2-8a6c5415a8c1 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:29.456613 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-9b39da1e-7e64-4b86-84d2-8a6c5415a8c1 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:29.457062 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-9b39da1e-7e64-4b86-84d2-8a6c5415a8c1 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:29.457485 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-9b39da1e-7e64-4b86-84d2-8a6c5415a8c1 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:29.476261 n-d-863052-2 devstack@n-api.service[121402]: DEBUG dbcounter [-] [121402] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 19:00:29.515354 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-625edfdd-ac2c-4078-836e-b1489af1f774 tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] Calling method '.version_select at 0x7f0ae2864820>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:00:29.563135 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-625edfdd-ac2c-4078-836e-b1489af1f774 tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] 10.222.0.13 "GET /compute/v2.1/images/ccc79e7f-4589-43b9-a2ca-2a8f13b6602d" status: 200 len: 1455 microversion: 2.1 time: 0.051435 Nov 01 19:00:29.564333 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 868/1756] 10.222.0.13 () {58 vars in 1233 bytes} [Tue Nov 1 19:00:29 2022] GET /compute/v2.1/images/ccc79e7f-4589-43b9-a2ca-2a8f13b6602d => generated 1455 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 19:00:29.631341 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-9b39da1e-7e64-4b86-84d2-8a6c5415a8c1 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0290a6bb8bc24b8988a925327ac0381c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86941784237549838bba63ce88053b88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:00:29.639508 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-9b39da1e-7e64-4b86-84d2-8a6c5415a8c1 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] 10.222.0.13 "GET /compute/v2.1/servers/71704d65-40b5-4f2e-8565-22e3b5a55d14" status: 200 len: 1316 microversion: 2.1 time: 0.195979 Nov 01 19:00:29.640498 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 889/1757] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:00:29 2022] GET /compute/v2.1/servers/71704d65-40b5-4f2e-8565-22e3b5a55d14 => generated 1316 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:00:29.690267 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-64cd1cc9-6bd0-479a-813e-fc3bbbf1e5b5 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:00:29.691012 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-64cd1cc9-6bd0-479a-813e-fc3bbbf1e5b5 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] [instance: f6762e10-9d45-47cf-a6b6-d9bfc3404664] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:00:29.697277 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-64cd1cc9-6bd0-479a-813e-fc3bbbf1e5b5 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:29.697770 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-64cd1cc9-6bd0-479a-813e-fc3bbbf1e5b5 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:29.698203 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-64cd1cc9-6bd0-479a-813e-fc3bbbf1e5b5 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:29.698943 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-64cd1cc9-6bd0-479a-813e-fc3bbbf1e5b5 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:29.699393 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-64cd1cc9-6bd0-479a-813e-fc3bbbf1e5b5 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:29.699811 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-64cd1cc9-6bd0-479a-813e-fc3bbbf1e5b5 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:29.909886 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-64cd1cc9-6bd0-479a-813e-fc3bbbf1e5b5 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72117f17294649d6b8bc16c66c7efab2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45d4c047d3c44324a27a27831236ab0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:00:29.919132 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-64cd1cc9-6bd0-479a-813e-fc3bbbf1e5b5 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] 10.222.0.13 "GET /compute/v2.1/servers/f6762e10-9d45-47cf-a6b6-d9bfc3404664" status: 200 len: 1474 microversion: 2.1 time: 0.232976 Nov 01 19:00:29.919705 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 869/1758] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:00:29 2022] GET /compute/v2.1/servers/f6762e10-9d45-47cf-a6b6-d9bfc3404664 => generated 1474 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:00:30.160407 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-02bd0d76-48fc-43ef-960e-1a601939aec8 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:00:30.161059 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-02bd0d76-48fc-43ef-960e-1a601939aec8 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] [instance: 1f499af7-1896-478c-b7d7-d922bf78bd98] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:00:30.169296 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-02bd0d76-48fc-43ef-960e-1a601939aec8 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:30.169782 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-02bd0d76-48fc-43ef-960e-1a601939aec8 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:30.170206 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-02bd0d76-48fc-43ef-960e-1a601939aec8 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:30.170896 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-02bd0d76-48fc-43ef-960e-1a601939aec8 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:30.171840 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-02bd0d76-48fc-43ef-960e-1a601939aec8 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:30.172263 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-02bd0d76-48fc-43ef-960e-1a601939aec8 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:30.185023 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-1136ed11-31c5-46ac-8a79-8f158061d331 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:00:30.186017 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-1136ed11-31c5-46ac-8a79-8f158061d331 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] [instance: 68b54f50-6b4d-4ea3-877f-c7ac79a5bb86] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:00:30.192474 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-1136ed11-31c5-46ac-8a79-8f158061d331 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:30.193245 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-1136ed11-31c5-46ac-8a79-8f158061d331 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:30.193880 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-1136ed11-31c5-46ac-8a79-8f158061d331 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:30.194871 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-1136ed11-31c5-46ac-8a79-8f158061d331 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:30.195511 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-1136ed11-31c5-46ac-8a79-8f158061d331 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:30.195945 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-1136ed11-31c5-46ac-8a79-8f158061d331 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:30.341570 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-02bd0d76-48fc-43ef-960e-1a601939aec8 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f32f5fba1976432d938e664c7714e52b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b9d4c236b944f9b2e8e502a50a8f8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:00:30.351222 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-02bd0d76-48fc-43ef-960e-1a601939aec8 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] 10.222.0.13 "GET /compute/v2.1/servers/1f499af7-1896-478c-b7d7-d922bf78bd98" status: 200 len: 1199 microversion: 2.1 time: 0.195425 Nov 01 19:00:30.365347 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 890/1759] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:00:30 2022] GET /compute/v2.1/servers/1f499af7-1896-478c-b7d7-d922bf78bd98 => generated 1199 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:00:30.385456 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-1136ed11-31c5-46ac-8a79-8f158061d331 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a9c3b6a8c34f068caa50dc10d13a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9ef08eba0ef431285fd15a2561b4e5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:00:30.396165 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-1136ed11-31c5-46ac-8a79-8f158061d331 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] 10.222.0.13 "GET /compute/v2.1/servers/68b54f50-6b4d-4ea3-877f-c7ac79a5bb86" status: 200 len: 1573 microversion: 2.1 time: 0.214788 Nov 01 19:00:30.397051 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 870/1760] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:00:30 2022] GET /compute/v2.1/servers/68b54f50-6b4d-4ea3-877f-c7ac79a5bb86 => generated 1573 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 19:00:30.502572 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [req-01e617ac-48cf-43fb-a3e5-a837608d9381 req-47b74788-8a2b-4fde-8792-8e89d094fb43 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f6762e10-9d45-47cf-a6b6-d9bfc3404664", "name": "network-vif-plugged", "status": "completed", "tag": "ce9efbc4-25cd-4125-8921-620c35a44e5f"}]} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:00:30.514103 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-01e617ac-48cf-43fb-a3e5-a837608d9381 req-47b74788-8a2b-4fde-8792-8e89d094fb43 service nova] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:30.514914 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-01e617ac-48cf-43fb-a3e5-a837608d9381 req-47b74788-8a2b-4fde-8792-8e89d094fb43 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:30.515347 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-01e617ac-48cf-43fb-a3e5-a837608d9381 req-47b74788-8a2b-4fde-8792-8e89d094fb43 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:30.529292 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.compute.server_external_events [req-01e617ac-48cf-43fb-a3e5-a837608d9381 req-47b74788-8a2b-4fde-8792-8e89d094fb43 service nova] Creating event network-vif-plugged:ce9efbc4-25cd-4125-8921-620c35a44e5f for instance f6762e10-9d45-47cf-a6b6-d9bfc3404664 on n-h2-863052-2 Nov 01 19:00:30.535340 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [req-01e617ac-48cf-43fb-a3e5-a837608d9381 req-47b74788-8a2b-4fde-8792-8e89d094fb43 service nova] Instance f6762e10-9d45-47cf-a6b6-d9bfc3404664 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-863052-2', 'n-h1-863052-2'} {{(pid=121402) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Nov 01 19:00:30.551205 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [req-01e617ac-48cf-43fb-a3e5-a837608d9381 req-47b74788-8a2b-4fde-8792-8e89d094fb43 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052659 Nov 01 19:00:30.552976 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 891/1761] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Nov 1 19:00:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:00:30.580130 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-c6842b9d-3f77-4c31-9287-2232db3bcef5 tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] Calling method '.version_select at 0x7f0ae29a5dc0>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:00:30.634856 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-c6842b9d-3f77-4c31-9287-2232db3bcef5 tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] 10.222.0.13 "GET /compute/v2.1/images/ccc79e7f-4589-43b9-a2ca-2a8f13b6602d" status: 200 len: 1455 microversion: 2.1 time: 0.059785 Nov 01 19:00:30.637105 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 871/1762] 10.222.0.13 () {58 vars in 1233 bytes} [Tue Nov 1 19:00:30 2022] GET /compute/v2.1/images/ccc79e7f-4589-43b9-a2ca-2a8f13b6602d => generated 1455 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:00:30.663747 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-0bcb3e4c-bc30-448d-8516-a7e346703499 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:00:30.664447 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-0bcb3e4c-bc30-448d-8516-a7e346703499 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] [instance: 71704d65-40b5-4f2e-8565-22e3b5a55d14] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:00:30.670722 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-0bcb3e4c-bc30-448d-8516-a7e346703499 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:30.671460 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-0bcb3e4c-bc30-448d-8516-a7e346703499 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:30.672078 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-0bcb3e4c-bc30-448d-8516-a7e346703499 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:30.672817 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-0bcb3e4c-bc30-448d-8516-a7e346703499 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:30.673278 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-0bcb3e4c-bc30-448d-8516-a7e346703499 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:30.673700 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-0bcb3e4c-bc30-448d-8516-a7e346703499 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:30.842050 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-0bcb3e4c-bc30-448d-8516-a7e346703499 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0290a6bb8bc24b8988a925327ac0381c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86941784237549838bba63ce88053b88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:00:30.851048 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-0bcb3e4c-bc30-448d-8516-a7e346703499 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] 10.222.0.13 "GET /compute/v2.1/servers/71704d65-40b5-4f2e-8565-22e3b5a55d14" status: 200 len: 1316 microversion: 2.1 time: 0.191455 Nov 01 19:00:30.851641 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 892/1763] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:00:30 2022] GET /compute/v2.1/servers/71704d65-40b5-4f2e-8565-22e3b5a55d14 => generated 1316 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:00:30.944432 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-a6938e37-b603-4aa4-bfa8-8149f2e9b825 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:00:30.945150 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-a6938e37-b603-4aa4-bfa8-8149f2e9b825 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] [instance: f6762e10-9d45-47cf-a6b6-d9bfc3404664] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:00:30.952658 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-a6938e37-b603-4aa4-bfa8-8149f2e9b825 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:30.953431 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-a6938e37-b603-4aa4-bfa8-8149f2e9b825 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:30.954085 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-a6938e37-b603-4aa4-bfa8-8149f2e9b825 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:30.954967 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-a6938e37-b603-4aa4-bfa8-8149f2e9b825 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:30.955413 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-a6938e37-b603-4aa4-bfa8-8149f2e9b825 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:30.956009 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-a6938e37-b603-4aa4-bfa8-8149f2e9b825 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:31.094078 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-a6938e37-b603-4aa4-bfa8-8149f2e9b825 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72117f17294649d6b8bc16c66c7efab2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45d4c047d3c44324a27a27831236ab0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:00:31.102554 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-a6938e37-b603-4aa4-bfa8-8149f2e9b825 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] 10.222.0.13 "GET /compute/v2.1/servers/f6762e10-9d45-47cf-a6b6-d9bfc3404664" status: 200 len: 1474 microversion: 2.1 time: 0.163711 Nov 01 19:00:31.103144 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 872/1764] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:00:30 2022] GET /compute/v2.1/servers/f6762e10-9d45-47cf-a6b6-d9bfc3404664 => generated 1474 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:00:31.374930 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-c0c67961-27f0-401b-92a9-69e057ce5f56 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:00:31.375547 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-c0c67961-27f0-401b-92a9-69e057ce5f56 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] [instance: 1f499af7-1896-478c-b7d7-d922bf78bd98] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:00:31.382699 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-c0c67961-27f0-401b-92a9-69e057ce5f56 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:31.383179 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-c0c67961-27f0-401b-92a9-69e057ce5f56 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:31.383698 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-c0c67961-27f0-401b-92a9-69e057ce5f56 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:31.384449 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-c0c67961-27f0-401b-92a9-69e057ce5f56 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:31.385081 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-c0c67961-27f0-401b-92a9-69e057ce5f56 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:31.385427 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-c0c67961-27f0-401b-92a9-69e057ce5f56 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:31.420253 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-d2348480-f4a5-4aa9-a3ad-c7ae5458ca00 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:00:31.420897 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-d2348480-f4a5-4aa9-a3ad-c7ae5458ca00 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] [instance: 68b54f50-6b4d-4ea3-877f-c7ac79a5bb86] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:00:31.427547 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d2348480-f4a5-4aa9-a3ad-c7ae5458ca00 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:31.428044 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d2348480-f4a5-4aa9-a3ad-c7ae5458ca00 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:31.428495 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d2348480-f4a5-4aa9-a3ad-c7ae5458ca00 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:31.429393 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d2348480-f4a5-4aa9-a3ad-c7ae5458ca00 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:31.429864 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d2348480-f4a5-4aa9-a3ad-c7ae5458ca00 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:31.430338 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d2348480-f4a5-4aa9-a3ad-c7ae5458ca00 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:31.525683 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-c0c67961-27f0-401b-92a9-69e057ce5f56 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f32f5fba1976432d938e664c7714e52b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b9d4c236b944f9b2e8e502a50a8f8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:00:31.534675 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-c0c67961-27f0-401b-92a9-69e057ce5f56 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] 10.222.0.13 "GET /compute/v2.1/servers/1f499af7-1896-478c-b7d7-d922bf78bd98" status: 200 len: 1199 microversion: 2.1 time: 0.163464 Nov 01 19:00:31.535637 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 893/1765] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:00:31 2022] GET /compute/v2.1/servers/1f499af7-1896-478c-b7d7-d922bf78bd98 => generated 1199 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:00:31.587487 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-d2348480-f4a5-4aa9-a3ad-c7ae5458ca00 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a9c3b6a8c34f068caa50dc10d13a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9ef08eba0ef431285fd15a2561b4e5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:00:31.596127 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-d2348480-f4a5-4aa9-a3ad-c7ae5458ca00 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] 10.222.0.13 "GET /compute/v2.1/servers/68b54f50-6b4d-4ea3-877f-c7ac79a5bb86" status: 200 len: 1571 microversion: 2.1 time: 0.180703 Nov 01 19:00:31.597498 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 873/1766] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:00:31 2022] GET /compute/v2.1/servers/68b54f50-6b4d-4ea3-877f-c7ac79a5bb86 => generated 1571 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 19:00:31.619402 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-f13b1a65-b85f-47ef-a8b3-ebe6ca4ea332 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1109659499"}} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:00:31.619853 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-f13b1a65-b85f-47ef-a8b3-ebe6ca4ea332 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] [instance: 68b54f50-6b4d-4ea3-877f-c7ac79a5bb86] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:00:31.626459 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f13b1a65-b85f-47ef-a8b3-ebe6ca4ea332 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:31.626937 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f13b1a65-b85f-47ef-a8b3-ebe6ca4ea332 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:31.627364 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f13b1a65-b85f-47ef-a8b3-ebe6ca4ea332 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:31.628048 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f13b1a65-b85f-47ef-a8b3-ebe6ca4ea332 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:31.628494 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f13b1a65-b85f-47ef-a8b3-ebe6ca4ea332 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:31.628935 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f13b1a65-b85f-47ef-a8b3-ebe6ca4ea332 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:31.651485 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-1894094b-d46d-42ea-a5ba-226111a1c34a tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] Calling method '.version_select at 0x7f0ae2827dc0>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:00:31.699706 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-1894094b-d46d-42ea-a5ba-226111a1c34a tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] 10.222.0.13 "GET /compute/v2.1/images/ccc79e7f-4589-43b9-a2ca-2a8f13b6602d" status: 200 len: 1455 microversion: 2.1 time: 0.052070 Nov 01 19:00:31.700701 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 874/1767] 10.222.0.13 () {58 vars in 1233 bytes} [Tue Nov 1 19:00:31 2022] GET /compute/v2.1/images/ccc79e7f-4589-43b9-a2ca-2a8f13b6602d => generated 1455 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 19:00:31.772300 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.network.security_group_api [None req-f13b1a65-b85f-47ef-a8b3-ebe6ca4ea332 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Adding security group 760cc6e7-5309-477d-b0c6-b136e25aad60 to port 07f6f2d6-299c-491b-aa7c-cc5981eba332 Nov 01 19:00:31.874411 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-f50be468-8a03-4129-b52a-33441d75799e tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:00:31.874953 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-f50be468-8a03-4129-b52a-33441d75799e tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] [instance: 71704d65-40b5-4f2e-8565-22e3b5a55d14] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:00:31.881113 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f50be468-8a03-4129-b52a-33441d75799e tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:31.881603 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f50be468-8a03-4129-b52a-33441d75799e tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:31.882041 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f50be468-8a03-4129-b52a-33441d75799e tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:31.882748 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f50be468-8a03-4129-b52a-33441d75799e tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:31.883205 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f50be468-8a03-4129-b52a-33441d75799e tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:31.883627 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f50be468-8a03-4129-b52a-33441d75799e tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:32.021308 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-f50be468-8a03-4129-b52a-33441d75799e tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0290a6bb8bc24b8988a925327ac0381c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86941784237549838bba63ce88053b88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:00:32.030256 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-f50be468-8a03-4129-b52a-33441d75799e tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] 10.222.0.13 "GET /compute/v2.1/servers/71704d65-40b5-4f2e-8565-22e3b5a55d14" status: 200 len: 1316 microversion: 2.1 time: 0.159788 Nov 01 19:00:32.031761 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 875/1768] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:00:31 2022] GET /compute/v2.1/servers/71704d65-40b5-4f2e-8565-22e3b5a55d14 => generated 1316 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 19:00:32.127384 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-4f8a41cb-acf1-4d7e-bfa0-3bbcd30ba3f3 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:00:32.127651 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-f13b1a65-b85f-47ef-a8b3-ebe6ca4ea332 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] 10.222.0.13 "POST /compute/v2.1/servers/68b54f50-6b4d-4ea3-877f-c7ac79a5bb86/action" status: 202 len: 0 microversion: 2.1 time: 0.511379 Nov 01 19:00:32.128616 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-4f8a41cb-acf1-4d7e-bfa0-3bbcd30ba3f3 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] [instance: f6762e10-9d45-47cf-a6b6-d9bfc3404664] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:00:32.129254 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 894/1769] 10.222.0.13 () {60 vars in 1278 bytes} [Tue Nov 1 19:00:31 2022] POST /compute/v2.1/servers/68b54f50-6b4d-4ea3-877f-c7ac79a5bb86/action => generated 0 bytes in 515 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 01 19:00:32.138902 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-4f8a41cb-acf1-4d7e-bfa0-3bbcd30ba3f3 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:32.139401 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-4f8a41cb-acf1-4d7e-bfa0-3bbcd30ba3f3 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:32.139838 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-4f8a41cb-acf1-4d7e-bfa0-3bbcd30ba3f3 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:32.140723 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-4f8a41cb-acf1-4d7e-bfa0-3bbcd30ba3f3 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:32.141177 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-4f8a41cb-acf1-4d7e-bfa0-3bbcd30ba3f3 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:32.141599 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-4f8a41cb-acf1-4d7e-bfa0-3bbcd30ba3f3 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:32.142281 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-46b1a55a-7fcf-44c5-92be-68c546b0e189 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Calling method '.version_select at 0x7f0ae1cbeca0>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:00:32.316973 n-d-863052-2 devstack@n-api.service[121402]: DEBUG neutronclient.v2_0.client [None req-46b1a55a-7fcf-44c5-92be-68c546b0e189 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Error message: {"NeutronError": {"type": "SecurityGroupInUse", "message": "Security Group 760cc6e7-5309-477d-b0c6-b136e25aad60 in use.", "detail": ""}} {{(pid=121402) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Nov 01 19:00:32.318049 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.wsgi [None req-46b1a55a-7fcf-44c5-92be-68c546b0e189 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] HTTP exception thrown: Security Group 760cc6e7-5309-477d-b0c6-b136e25aad60 in use. Nov 01 19:00:32.318049 n-d-863052-2 devstack@n-api.service[121402]: Neutron server returns request_ids: ['req-377c2f66-0b5c-47d1-87f8-3f3bd3709230'] Nov 01 19:00:32.324140 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-46b1a55a-7fcf-44c5-92be-68c546b0e189 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Request method failure captured: Nov 01 19:00:32.324140 n-d-863052-2 devstack@n-api.service[121402]: request: DELETE /compute/v2.1/os-security-groups/760cc6e7-5309-477d-b0c6-b136e25aad60 HTTP/1.1 Nov 01 19:00:32.324140 n-d-863052-2 devstack@n-api.service[121402]: Accept: application/json Nov 01 19:00:32.324140 n-d-863052-2 devstack@n-api.service[121402]: Accept-Encoding: identity Nov 01 19:00:32.324140 n-d-863052-2 devstack@n-api.service[121402]: Connection: close Nov 01 19:00:32.324140 n-d-863052-2 devstack@n-api.service[121402]: Content-Length: 0 Nov 01 19:00:32.324140 n-d-863052-2 devstack@n-api.service[121402]: Content-Type: application/json Nov 01 19:00:32.324140 n-d-863052-2 devstack@n-api.service[121402]: Host: 10.222.0.13 Nov 01 19:00:32.324140 n-d-863052-2 devstack@n-api.service[121402]: Openstack-System-Scope: None Nov 01 19:00:32.324140 n-d-863052-2 devstack@n-api.service[121402]: User-Agent: python-urllib3/1.26.12 Nov 01 19:00:32.324140 n-d-863052-2 devstack@n-api.service[121402]: X-Auth-Token: gAAAAABjYWyBtiXfeZJIejT83Ksslz2hqDZRAGe29hQVddGupa2qgtVXWeGxqJACkYUk64AE7WNmKMU9sisFWqkZV1B8K0xSz0uDHshwD54pFesORYzaFN_rWLCdcUKPHyx9WACJmd6ZEeb3LBT9WzZa08oHURzA6g0G4BDfSDsuxDk4mdVs9fM Nov 01 19:00:32.324140 n-d-863052-2 devstack@n-api.service[121402]: X-Domain-Id: None Nov 01 19:00:32.324140 n-d-863052-2 devstack@n-api.service[121402]: X-Domain-Name: None Nov 01 19:00:32.324140 n-d-863052-2 devstack@n-api.service[121402]: X-Identity-Status: Confirmed Nov 01 19:00:32.324140 n-d-863052-2 devstack@n-api.service[121402]: X-Is-Admin-Project: True Nov 01 19:00:32.324140 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Domain-Id: default Nov 01 19:00:32.324140 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Domain-Name: Default Nov 01 19:00:32.324140 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Id: a9ef08eba0ef431285fd15a2561b4e5d Nov 01 19:00:32.324140 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Name: tempest-SecurityGroupsTestJSON-1185949800 Nov 01 19:00:32.324140 n-d-863052-2 devstack@n-api.service[121402]: X-Role: member,reader Nov 01 19:00:32.324140 n-d-863052-2 devstack@n-api.service[121402]: X-Roles: member,reader Nov 01 19:00:32.326143 n-d-863052-2 devstack@n-api.service[121402]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/a9ef08eba0ef431285fd15a2561b4e5d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/a9ef08eba0ef431285fd15a2561b4e5d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_a9ef08eba0ef431285fd15a2561b4e5d", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/a9ef08eba0ef431285fd15a2561b4e5d"}]}] Nov 01 19:00:32.326143 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant: tempest-SecurityGroupsTestJSON-1185949800 Nov 01 19:00:32.326143 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant-Id: a9ef08eba0ef431285fd15a2561b4e5d Nov 01 19:00:32.326143 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1185949800 Nov 01 19:00:32.326143 n-d-863052-2 devstack@n-api.service[121402]: X-User: tempest-SecurityGroupsTestJSON-1185949800-project Nov 01 19:00:32.326143 n-d-863052-2 devstack@n-api.service[121402]: X-User-Domain-Id: default Nov 01 19:00:32.326143 n-d-863052-2 devstack@n-api.service[121402]: X-User-Domain-Name: Default Nov 01 19:00:32.326143 n-d-863052-2 devstack@n-api.service[121402]: X-User-Id: 55a9c3b6a8c34f068caa50dc10d13a85 Nov 01 19:00:32.326143 n-d-863052-2 devstack@n-api.service[121402]: X-User-Name: tempest-SecurityGroupsTestJSON-1185949800-project Nov 01 19:00:32.326143 n-d-863052-2 devstack@n-api.service[121402]: method: Nov 01 19:00:32.326143 n-d-863052-2 devstack@n-api.service[121402]: exception: Security Group 760cc6e7-5309-477d-b0c6-b136e25aad60 in use. Nov 01 19:00:32.326143 n-d-863052-2 devstack@n-api.service[121402]: Neutron server returns request_ids: ['req-377c2f66-0b5c-47d1-87f8-3f3bd3709230'] Nov 01 19:00:32.326143 n-d-863052-2 devstack@n-api.service[121402]: action_args: {'id': '760cc6e7-5309-477d-b0c6-b136e25aad60'} Nov 01 19:00:32.327224 n-d-863052-2 devstack@n-api.service[121402]: {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 01 19:00:32.327224 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:00:32.327224 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Nov 01 19:00:32.327224 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Nov 01 19:00:32.327224 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 01 19:00:32.327224 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 01 19:00:32.327224 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1073, in delete_security_group Nov 01 19:00:32.327224 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Nov 01 19:00:32.327224 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 01 19:00:32.327224 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 01 19:00:32.327224 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Nov 01 19:00:32.327224 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Nov 01 19:00:32.327224 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 01 19:00:32.327224 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 01 19:00:32.327224 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 01 19:00:32.327224 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 01 19:00:32.327224 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 01 19:00:32.327224 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 01 19:00:32.327224 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Nov 01 19:00:32.328828 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Nov 01 19:00:32.328828 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 01 19:00:32.328828 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 01 19:00:32.328828 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Nov 01 19:00:32.328828 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Nov 01 19:00:32.328828 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Nov 01 19:00:32.328828 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Nov 01 19:00:32.328828 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Security Group 760cc6e7-5309-477d-b0c6-b136e25aad60 in use. Nov 01 19:00:32.328828 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-377c2f66-0b5c-47d1-87f8-3f3bd3709230'] Nov 01 19:00:32.328828 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:00:32.328828 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:00:32.328828 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:00:32.328828 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:00:32.328828 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Nov 01 19:00:32.328828 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Nov 01 19:00:32.328828 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Nov 01 19:00:32.328828 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Nov 01 19:00:32.328828 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security Group 760cc6e7-5309-477d-b0c6-b136e25aad60 in use. Nov 01 19:00:32.328828 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-377c2f66-0b5c-47d1-87f8-3f3bd3709230'] Nov 01 19:00:32.330593 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:00:32.330593 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:00:32.330593 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:00:32.330593 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:00:32.330593 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:00:32.330593 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:00:32.330593 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 01 19:00:32.330593 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 01 19:00:32.330593 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 01 19:00:32.330593 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 01 19:00:32.330593 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 01 19:00:32.330593 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 01 19:00:32.330593 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Nov 01 19:00:32.330593 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Nov 01 19:00:32.330593 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security Group 760cc6e7-5309-477d-b0c6-b136e25aad60 in use. Nov 01 19:00:32.330593 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-377c2f66-0b5c-47d1-87f8-3f3bd3709230'] Nov 01 19:00:32.330593 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:00:32.330593 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:00:32.330593 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:00:32.330593 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:00:32.330593 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:00:32.332284 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:00:32.332284 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 01 19:00:32.332284 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 01 19:00:32.332284 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security Group 760cc6e7-5309-477d-b0c6-b136e25aad60 in use. Nov 01 19:00:32.332284 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-377c2f66-0b5c-47d1-87f8-3f3bd3709230'] Nov 01 19:00:32.332284 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:00:32.334061 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-46b1a55a-7fcf-44c5-92be-68c546b0e189 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Returning 400 to user: Security Group 760cc6e7-5309-477d-b0c6-b136e25aad60 in use. Nov 01 19:00:32.334061 n-d-863052-2 devstack@n-api.service[121402]: Neutron server returns request_ids: ['req-377c2f66-0b5c-47d1-87f8-3f3bd3709230'] {{(pid=121402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 01 19:00:32.335202 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-46b1a55a-7fcf-44c5-92be-68c546b0e189 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] 10.222.0.13 "DELETE /compute/v2.1/os-security-groups/760cc6e7-5309-477d-b0c6-b136e25aad60" status: 400 len: 185 microversion: 2.1 time: 0.199339 Nov 01 19:00:32.336271 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 895/1770] 10.222.0.13 () {58 vars in 1272 bytes} [Tue Nov 1 19:00:32 2022] DELETE /compute/v2.1/os-security-groups/760cc6e7-5309-477d-b0c6-b136e25aad60 => generated 185 bytes in 201 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 01 19:00:32.344144 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [req-2c1b51a2-6071-4b1c-94d1-e7b0c1e42fd0 req-69020f02-13e7-43a9-818a-f827a4fe9bef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "68b54f50-6b4d-4ea3-877f-c7ac79a5bb86", "tag": "07f6f2d6-299c-491b-aa7c-cc5981eba332"}]} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:00:32.360229 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-2c1b51a2-6071-4b1c-94d1-e7b0c1e42fd0 req-69020f02-13e7-43a9-818a-f827a4fe9bef service nova] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:32.361007 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-2c1b51a2-6071-4b1c-94d1-e7b0c1e42fd0 req-69020f02-13e7-43a9-818a-f827a4fe9bef service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:32.361927 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-2c1b51a2-6071-4b1c-94d1-e7b0c1e42fd0 req-69020f02-13e7-43a9-818a-f827a4fe9bef service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:32.378424 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.compute.server_external_events [req-2c1b51a2-6071-4b1c-94d1-e7b0c1e42fd0 req-69020f02-13e7-43a9-818a-f827a4fe9bef service nova] Creating event network-changed:07f6f2d6-299c-491b-aa7c-cc5981eba332 for instance 68b54f50-6b4d-4ea3-877f-c7ac79a5bb86 on n-h1-863052-2 Nov 01 19:00:32.407458 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-4f8a41cb-acf1-4d7e-bfa0-3bbcd30ba3f3 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72117f17294649d6b8bc16c66c7efab2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45d4c047d3c44324a27a27831236ab0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:00:32.411388 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [req-2c1b51a2-6071-4b1c-94d1-e7b0c1e42fd0 req-69020f02-13e7-43a9-818a-f827a4fe9bef service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072403 Nov 01 19:00:32.417017 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 896/1771] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Nov 1 19:00:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:00:32.424658 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-13ba883f-6fab-47dd-8628-fe4e4a4aa841 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:00:32.425436 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-13ba883f-6fab-47dd-8628-fe4e4a4aa841 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] [instance: 68b54f50-6b4d-4ea3-877f-c7ac79a5bb86] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:00:32.433752 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-13ba883f-6fab-47dd-8628-fe4e4a4aa841 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:32.435204 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-4f8a41cb-acf1-4d7e-bfa0-3bbcd30ba3f3 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] 10.222.0.13 "GET /compute/v2.1/servers/f6762e10-9d45-47cf-a6b6-d9bfc3404664" status: 200 len: 1474 microversion: 2.1 time: 0.312110 Nov 01 19:00:32.436030 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-13ba883f-6fab-47dd-8628-fe4e4a4aa841 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:32.436030 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-13ba883f-6fab-47dd-8628-fe4e4a4aa841 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:32.436804 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 876/1772] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:00:32 2022] GET /compute/v2.1/servers/f6762e10-9d45-47cf-a6b6-d9bfc3404664 => generated 1474 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 19:00:32.441729 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-13ba883f-6fab-47dd-8628-fe4e4a4aa841 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:32.443228 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-13ba883f-6fab-47dd-8628-fe4e4a4aa841 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:32.443931 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-13ba883f-6fab-47dd-8628-fe4e4a4aa841 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:32.487297 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-13ba883f-6fab-47dd-8628-fe4e4a4aa841 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] [instance: 68b54f50-6b4d-4ea3-877f-c7ac79a5bb86] Going to try to terminate instance {{(pid=121402) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 01 19:00:32.563885 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-11484367-84f4-4663-8f48-12b7e27b0328 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:00:32.564862 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-11484367-84f4-4663-8f48-12b7e27b0328 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] [instance: 1f499af7-1896-478c-b7d7-d922bf78bd98] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:00:32.573179 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-11484367-84f4-4663-8f48-12b7e27b0328 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:32.574021 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-11484367-84f4-4663-8f48-12b7e27b0328 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:32.575869 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-11484367-84f4-4663-8f48-12b7e27b0328 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:32.576905 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-11484367-84f4-4663-8f48-12b7e27b0328 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:32.577727 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-11484367-84f4-4663-8f48-12b7e27b0328 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:32.579759 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-11484367-84f4-4663-8f48-12b7e27b0328 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:32.598794 n-d-863052-2 devstack@n-api.service[121402]: DEBUG dbcounter [-] [121402] Writing DB stats nova_api:SELECT=100 {{(pid=121402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 19:00:32.613452 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-13ba883f-6fab-47dd-8628-fe4e4a4aa841 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] 10.222.0.13 "DELETE /compute/v2.1/servers/68b54f50-6b4d-4ea3-877f-c7ac79a5bb86" status: 204 len: 0 microversion: 2.1 time: 0.194239 Nov 01 19:00:32.614134 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 897/1773] 10.222.0.13 () {58 vars in 1239 bytes} [Tue Nov 1 19:00:32 2022] DELETE /compute/v2.1/servers/68b54f50-6b4d-4ea3-877f-c7ac79a5bb86 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 01 19:00:32.620234 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [req-84bb14f7-bc03-417e-bdd4-5827d85f8bf9 req-713fc981-ccba-4088-9e9c-b66bc438eb61 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71704d65-40b5-4f2e-8565-22e3b5a55d14", "name": "network-vif-plugged", "status": "completed", "tag": "d849f3a8-88a0-4bab-8785-39ca8377aac1"}, {"server_uuid": "d8e88b0f-ae97-44a4-8b6b-b94e2c600a83", "name": "network-vif-unplugged", "status": "completed", "tag": "91ce416d-c08f-473f-a551-fa3519a6c6c7"}]} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:00:32.635556 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-84bb14f7-bc03-417e-bdd4-5827d85f8bf9 req-713fc981-ccba-4088-9e9c-b66bc438eb61 service nova] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:32.636312 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-84bb14f7-bc03-417e-bdd4-5827d85f8bf9 req-713fc981-ccba-4088-9e9c-b66bc438eb61 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:32.636934 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-84bb14f7-bc03-417e-bdd4-5827d85f8bf9 req-713fc981-ccba-4088-9e9c-b66bc438eb61 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:32.650946 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.compute.server_external_events [req-84bb14f7-bc03-417e-bdd4-5827d85f8bf9 req-713fc981-ccba-4088-9e9c-b66bc438eb61 service nova] Creating event network-vif-plugged:d849f3a8-88a0-4bab-8785-39ca8377aac1 for instance 71704d65-40b5-4f2e-8565-22e3b5a55d14 on n-h1-863052-2 Nov 01 19:00:32.651805 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.compute.server_external_events [req-84bb14f7-bc03-417e-bdd4-5827d85f8bf9 req-713fc981-ccba-4088-9e9c-b66bc438eb61 service nova] Creating event network-vif-unplugged:91ce416d-c08f-473f-a551-fa3519a6c6c7 for instance d8e88b0f-ae97-44a4-8b6b-b94e2c600a83 on n-h1-863052-2 Nov 01 19:00:32.658813 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [req-84bb14f7-bc03-417e-bdd4-5827d85f8bf9 req-713fc981-ccba-4088-9e9c-b66bc438eb61 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.042690 Nov 01 19:00:32.659942 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 898/1774] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Nov 1 19:00:32 2022] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:00:32.665158 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-19e01908-0844-4d0c-b422-e69792e64383 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:00:32.666081 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-19e01908-0844-4d0c-b422-e69792e64383 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] [instance: 68b54f50-6b4d-4ea3-877f-c7ac79a5bb86] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:00:32.673191 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-19e01908-0844-4d0c-b422-e69792e64383 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:32.673886 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-19e01908-0844-4d0c-b422-e69792e64383 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:32.674488 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-19e01908-0844-4d0c-b422-e69792e64383 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:32.675339 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-19e01908-0844-4d0c-b422-e69792e64383 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:32.676328 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-19e01908-0844-4d0c-b422-e69792e64383 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:32.677441 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-19e01908-0844-4d0c-b422-e69792e64383 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:32.773243 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-11484367-84f4-4663-8f48-12b7e27b0328 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f32f5fba1976432d938e664c7714e52b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b9d4c236b944f9b2e8e502a50a8f8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:00:32.788103 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-11484367-84f4-4663-8f48-12b7e27b0328 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] 10.222.0.13 "GET /compute/v2.1/servers/1f499af7-1896-478c-b7d7-d922bf78bd98" status: 200 len: 1199 microversion: 2.1 time: 0.231595 Nov 01 19:00:32.790012 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 877/1775] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:00:32 2022] GET /compute/v2.1/servers/1f499af7-1896-478c-b7d7-d922bf78bd98 => generated 1199 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:00:32.798769 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-835303f1-7b44-41eb-a267-0e9672abb3c5 tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] Calling method '.version_select at 0x7f0ae2826c10>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:00:32.864407 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-19e01908-0844-4d0c-b422-e69792e64383 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a9c3b6a8c34f068caa50dc10d13a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9ef08eba0ef431285fd15a2561b4e5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:00:32.868655 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-835303f1-7b44-41eb-a267-0e9672abb3c5 tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] 10.222.0.13 "GET /compute/v2.1/images/ccc79e7f-4589-43b9-a2ca-2a8f13b6602d" status: 200 len: 1455 microversion: 2.1 time: 0.073126 Nov 01 19:00:32.869223 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 878/1776] 10.222.0.13 () {58 vars in 1233 bytes} [Tue Nov 1 19:00:32 2022] GET /compute/v2.1/images/ccc79e7f-4589-43b9-a2ca-2a8f13b6602d => generated 1455 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:00:32.875851 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-19e01908-0844-4d0c-b422-e69792e64383 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] 10.222.0.13 "GET /compute/v2.1/servers/68b54f50-6b4d-4ea3-877f-c7ac79a5bb86" status: 200 len: 1646 microversion: 2.1 time: 0.214550 Nov 01 19:00:32.877842 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 899/1777] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:00:32 2022] GET /compute/v2.1/servers/68b54f50-6b4d-4ea3-877f-c7ac79a5bb86 => generated 1646 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:00:33.054527 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-32dc78d1-b6da-46e6-8769-20f93503a99d tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:00:33.055423 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-32dc78d1-b6da-46e6-8769-20f93503a99d tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] [instance: 71704d65-40b5-4f2e-8565-22e3b5a55d14] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:00:33.061608 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-32dc78d1-b6da-46e6-8769-20f93503a99d tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:33.062342 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-32dc78d1-b6da-46e6-8769-20f93503a99d tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:33.062960 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-32dc78d1-b6da-46e6-8769-20f93503a99d tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:33.063822 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-32dc78d1-b6da-46e6-8769-20f93503a99d tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:33.064282 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-32dc78d1-b6da-46e6-8769-20f93503a99d tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:33.064732 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-32dc78d1-b6da-46e6-8769-20f93503a99d tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:33.215546 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-32dc78d1-b6da-46e6-8769-20f93503a99d tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0290a6bb8bc24b8988a925327ac0381c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86941784237549838bba63ce88053b88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:00:33.227420 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-32dc78d1-b6da-46e6-8769-20f93503a99d tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] 10.222.0.13 "GET /compute/v2.1/servers/71704d65-40b5-4f2e-8565-22e3b5a55d14" status: 200 len: 1316 microversion: 2.1 time: 0.177045 Nov 01 19:00:33.228268 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 879/1778] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:00:33 2022] GET /compute/v2.1/servers/71704d65-40b5-4f2e-8565-22e3b5a55d14 => generated 1316 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:00:33.462632 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-49508972-8d50-4fbf-8a48-c36dc05a8956 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:00:33.463502 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-49508972-8d50-4fbf-8a48-c36dc05a8956 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] [instance: f6762e10-9d45-47cf-a6b6-d9bfc3404664] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:00:33.472644 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-49508972-8d50-4fbf-8a48-c36dc05a8956 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:33.473150 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-49508972-8d50-4fbf-8a48-c36dc05a8956 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:33.473648 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-49508972-8d50-4fbf-8a48-c36dc05a8956 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:33.474349 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-49508972-8d50-4fbf-8a48-c36dc05a8956 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:33.474808 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-49508972-8d50-4fbf-8a48-c36dc05a8956 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:33.475236 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-49508972-8d50-4fbf-8a48-c36dc05a8956 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:33.642488 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-49508972-8d50-4fbf-8a48-c36dc05a8956 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72117f17294649d6b8bc16c66c7efab2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45d4c047d3c44324a27a27831236ab0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:00:33.653773 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-49508972-8d50-4fbf-8a48-c36dc05a8956 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] 10.222.0.13 "GET /compute/v2.1/servers/f6762e10-9d45-47cf-a6b6-d9bfc3404664" status: 200 len: 1474 microversion: 2.1 time: 0.196086 Nov 01 19:00:33.654546 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 900/1779] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:00:33 2022] GET /compute/v2.1/servers/f6762e10-9d45-47cf-a6b6-d9bfc3404664 => generated 1474 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:00:33.814236 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-ad383b1e-63f8-43be-acc2-cdc545d66abc tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:00:33.814860 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-ad383b1e-63f8-43be-acc2-cdc545d66abc tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] [instance: 1f499af7-1896-478c-b7d7-d922bf78bd98] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:00:33.823306 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-ad383b1e-63f8-43be-acc2-cdc545d66abc tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:33.824367 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-ad383b1e-63f8-43be-acc2-cdc545d66abc tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:33.825068 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-ad383b1e-63f8-43be-acc2-cdc545d66abc tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:33.825782 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-ad383b1e-63f8-43be-acc2-cdc545d66abc tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:33.826238 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-ad383b1e-63f8-43be-acc2-cdc545d66abc tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:33.826855 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-ad383b1e-63f8-43be-acc2-cdc545d66abc tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:33.883357 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-cd39dcd7-896b-438f-af8d-08b9e7fa0e52 tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] Calling method '.version_select at 0x7f0ae1d09550>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:00:33.934718 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-cd39dcd7-896b-438f-af8d-08b9e7fa0e52 tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] 10.222.0.13 "GET /compute/v2.1/images/ccc79e7f-4589-43b9-a2ca-2a8f13b6602d" status: 200 len: 1455 microversion: 2.1 time: 0.055236 Nov 01 19:00:33.935581 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 901/1780] 10.222.0.13 () {58 vars in 1233 bytes} [Tue Nov 1 19:00:33 2022] GET /compute/v2.1/images/ccc79e7f-4589-43b9-a2ca-2a8f13b6602d => generated 1455 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:00:33.941214 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-b81386a5-9a94-4c6c-af43-51f72e77e062 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:00:33.941824 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-b81386a5-9a94-4c6c-af43-51f72e77e062 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] [instance: 68b54f50-6b4d-4ea3-877f-c7ac79a5bb86] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:00:33.948075 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b81386a5-9a94-4c6c-af43-51f72e77e062 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:33.948638 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b81386a5-9a94-4c6c-af43-51f72e77e062 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:33.949084 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b81386a5-9a94-4c6c-af43-51f72e77e062 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:33.949785 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b81386a5-9a94-4c6c-af43-51f72e77e062 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:33.950240 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b81386a5-9a94-4c6c-af43-51f72e77e062 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:33.950684 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b81386a5-9a94-4c6c-af43-51f72e77e062 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:33.995943 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-ad383b1e-63f8-43be-acc2-cdc545d66abc tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f32f5fba1976432d938e664c7714e52b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b9d4c236b944f9b2e8e502a50a8f8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:00:34.004417 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-ad383b1e-63f8-43be-acc2-cdc545d66abc tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] 10.222.0.13 "GET /compute/v2.1/servers/1f499af7-1896-478c-b7d7-d922bf78bd98" status: 200 len: 1199 microversion: 2.1 time: 0.195174 Nov 01 19:00:34.005593 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 880/1781] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:00:33 2022] GET /compute/v2.1/servers/1f499af7-1896-478c-b7d7-d922bf78bd98 => generated 1199 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 19:00:34.103052 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-b81386a5-9a94-4c6c-af43-51f72e77e062 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a9c3b6a8c34f068caa50dc10d13a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9ef08eba0ef431285fd15a2561b4e5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:00:34.111553 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-b81386a5-9a94-4c6c-af43-51f72e77e062 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] 10.222.0.13 "GET /compute/v2.1/servers/68b54f50-6b4d-4ea3-877f-c7ac79a5bb86" status: 200 len: 1646 microversion: 2.1 time: 0.174838 Nov 01 19:00:34.112133 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 902/1782] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:00:33 2022] GET /compute/v2.1/servers/68b54f50-6b4d-4ea3-877f-c7ac79a5bb86 => generated 1646 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:00:34.250626 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-315c1ec1-2596-4fab-ae04-87a6a9fea6b2 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:00:34.251151 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-315c1ec1-2596-4fab-ae04-87a6a9fea6b2 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] [instance: 71704d65-40b5-4f2e-8565-22e3b5a55d14] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:00:34.257471 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-315c1ec1-2596-4fab-ae04-87a6a9fea6b2 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:34.258006 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-315c1ec1-2596-4fab-ae04-87a6a9fea6b2 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:34.258619 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-315c1ec1-2596-4fab-ae04-87a6a9fea6b2 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:34.259576 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-315c1ec1-2596-4fab-ae04-87a6a9fea6b2 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:34.260197 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-315c1ec1-2596-4fab-ae04-87a6a9fea6b2 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:34.260710 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-315c1ec1-2596-4fab-ae04-87a6a9fea6b2 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:34.446135 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-315c1ec1-2596-4fab-ae04-87a6a9fea6b2 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0290a6bb8bc24b8988a925327ac0381c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86941784237549838bba63ce88053b88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:00:34.454176 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-315c1ec1-2596-4fab-ae04-87a6a9fea6b2 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] 10.222.0.13 "GET /compute/v2.1/servers/71704d65-40b5-4f2e-8565-22e3b5a55d14" status: 200 len: 1316 microversion: 2.1 time: 0.207380 Nov 01 19:00:34.454798 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 881/1783] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:00:34 2022] GET /compute/v2.1/servers/71704d65-40b5-4f2e-8565-22e3b5a55d14 => generated 1316 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:00:34.677256 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-567304c7-119d-40c9-b398-22b7f26b6095 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:00:34.678230 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-567304c7-119d-40c9-b398-22b7f26b6095 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] [instance: f6762e10-9d45-47cf-a6b6-d9bfc3404664] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:00:34.685373 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-567304c7-119d-40c9-b398-22b7f26b6095 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:34.686108 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-567304c7-119d-40c9-b398-22b7f26b6095 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:34.687161 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-567304c7-119d-40c9-b398-22b7f26b6095 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:34.687962 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-567304c7-119d-40c9-b398-22b7f26b6095 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:34.688418 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-567304c7-119d-40c9-b398-22b7f26b6095 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:34.689035 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-567304c7-119d-40c9-b398-22b7f26b6095 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:34.722517 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-567304c7-119d-40c9-b398-22b7f26b6095 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:34.722925 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-567304c7-119d-40c9-b398-22b7f26b6095 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:34.723364 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-567304c7-119d-40c9-b398-22b7f26b6095 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:34.723808 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.objects.instance [None req-567304c7-119d-40c9-b398-22b7f26b6095 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lazy-loading 'fault' on Instance uuid f6762e10-9d45-47cf-a6b6-d9bfc3404664 {{(pid=121402) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 01 19:00:34.878613 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-567304c7-119d-40c9-b398-22b7f26b6095 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72117f17294649d6b8bc16c66c7efab2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45d4c047d3c44324a27a27831236ab0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:00:34.886801 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-567304c7-119d-40c9-b398-22b7f26b6095 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] 10.222.0.13 "GET /compute/v2.1/servers/f6762e10-9d45-47cf-a6b6-d9bfc3404664" status: 200 len: 1779 microversion: 2.1 time: 0.212899 Nov 01 19:00:34.887377 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 903/1784] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:00:34 2022] GET /compute/v2.1/servers/f6762e10-9d45-47cf-a6b6-d9bfc3404664 => generated 1779 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:00:34.916478 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-d14f9eb3-0e22-4b2a-87b9-42baed394086 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:00:34.917067 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-d14f9eb3-0e22-4b2a-87b9-42baed394086 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] [instance: f6762e10-9d45-47cf-a6b6-d9bfc3404664] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:00:34.923641 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d14f9eb3-0e22-4b2a-87b9-42baed394086 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:34.924126 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d14f9eb3-0e22-4b2a-87b9-42baed394086 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:34.924568 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d14f9eb3-0e22-4b2a-87b9-42baed394086 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:34.925364 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d14f9eb3-0e22-4b2a-87b9-42baed394086 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:34.925824 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d14f9eb3-0e22-4b2a-87b9-42baed394086 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:34.926253 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d14f9eb3-0e22-4b2a-87b9-42baed394086 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:34.950463 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-3cad031e-4aff-44ef-801f-26890c6ebacc tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] Calling method '.version_select at 0x7f0ae1d42dc0>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:00:34.953281 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-d14f9eb3-0e22-4b2a-87b9-42baed394086 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] [instance: f6762e10-9d45-47cf-a6b6-d9bfc3404664] Going to try to terminate instance {{(pid=121403) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 01 19:00:34.979444 n-d-863052-2 devstack@n-api.service[121403]: DEBUG dbcounter [-] [121403] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 19:00:35.000191 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-3cad031e-4aff-44ef-801f-26890c6ebacc tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] 10.222.0.13 "GET /compute/v2.1/images/ccc79e7f-4589-43b9-a2ca-2a8f13b6602d" status: 200 len: 1455 microversion: 2.1 time: 0.053963 Nov 01 19:00:35.008157 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 904/1785] 10.222.0.13 () {58 vars in 1233 bytes} [Tue Nov 1 19:00:34 2022] GET /compute/v2.1/images/ccc79e7f-4589-43b9-a2ca-2a8f13b6602d => generated 1455 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:00:35.028756 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-4726702a-2992-4e03-ac9a-f0f3585e7436 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:00:35.029965 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-4726702a-2992-4e03-ac9a-f0f3585e7436 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] [instance: 1f499af7-1896-478c-b7d7-d922bf78bd98] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:00:35.034002 n-d-863052-2 devstack@n-api.service[121403]: DEBUG dbcounter [-] [121403] Writing DB stats nova_api:SELECT=100 {{(pid=121403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 19:00:35.039046 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-4726702a-2992-4e03-ac9a-f0f3585e7436 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:35.041208 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-4726702a-2992-4e03-ac9a-f0f3585e7436 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:35.041808 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-d14f9eb3-0e22-4b2a-87b9-42baed394086 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] 10.222.0.13 "DELETE /compute/v2.1/servers/f6762e10-9d45-47cf-a6b6-d9bfc3404664" status: 204 len: 0 microversion: 2.1 time: 0.129248 Nov 01 19:00:35.042644 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-4726702a-2992-4e03-ac9a-f0f3585e7436 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:35.044077 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-4726702a-2992-4e03-ac9a-f0f3585e7436 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:35.045781 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 882/1786] 10.222.0.13 () {58 vars in 1239 bytes} [Tue Nov 1 19:00:34 2022] DELETE /compute/v2.1/servers/f6762e10-9d45-47cf-a6b6-d9bfc3404664 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 01 19:00:35.046129 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-4726702a-2992-4e03-ac9a-f0f3585e7436 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:35.047039 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-4726702a-2992-4e03-ac9a-f0f3585e7436 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:35.051348 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-6cc8b21b-3925-4992-9955-d544ba091c8f tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:00:35.052077 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-6cc8b21b-3925-4992-9955-d544ba091c8f tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] [instance: f6762e10-9d45-47cf-a6b6-d9bfc3404664] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:00:35.059383 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-6cc8b21b-3925-4992-9955-d544ba091c8f tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:35.059999 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-6cc8b21b-3925-4992-9955-d544ba091c8f tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:35.060458 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-6cc8b21b-3925-4992-9955-d544ba091c8f tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:35.061211 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-6cc8b21b-3925-4992-9955-d544ba091c8f tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:35.061677 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-6cc8b21b-3925-4992-9955-d544ba091c8f tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:35.062359 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-6cc8b21b-3925-4992-9955-d544ba091c8f tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:35.098299 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-6cc8b21b-3925-4992-9955-d544ba091c8f tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:35.098796 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-6cc8b21b-3925-4992-9955-d544ba091c8f tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:35.099265 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-6cc8b21b-3925-4992-9955-d544ba091c8f tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:35.099726 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.objects.instance [None req-6cc8b21b-3925-4992-9955-d544ba091c8f tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lazy-loading 'fault' on Instance uuid f6762e10-9d45-47cf-a6b6-d9bfc3404664 {{(pid=121403) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 01 19:00:35.195439 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-4726702a-2992-4e03-ac9a-f0f3585e7436 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f32f5fba1976432d938e664c7714e52b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b9d4c236b944f9b2e8e502a50a8f8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:00:35.204558 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-4726702a-2992-4e03-ac9a-f0f3585e7436 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] 10.222.0.13 "GET /compute/v2.1/servers/1f499af7-1896-478c-b7d7-d922bf78bd98" status: 200 len: 1199 microversion: 2.1 time: 0.181185 Nov 01 19:00:35.205447 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 905/1787] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:00:35 2022] GET /compute/v2.1/servers/1f499af7-1896-478c-b7d7-d922bf78bd98 => generated 1199 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 19:00:35.210603 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-6ae27a88-ce34-47f3-9377-09f8200f29ff tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:00:35.211437 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-6ae27a88-ce34-47f3-9377-09f8200f29ff tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] [instance: 68b54f50-6b4d-4ea3-877f-c7ac79a5bb86] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:00:35.218175 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-6ae27a88-ce34-47f3-9377-09f8200f29ff tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:35.218904 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-6ae27a88-ce34-47f3-9377-09f8200f29ff tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:35.219530 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-6ae27a88-ce34-47f3-9377-09f8200f29ff tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:35.220556 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-6ae27a88-ce34-47f3-9377-09f8200f29ff tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:35.221211 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-6ae27a88-ce34-47f3-9377-09f8200f29ff tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:35.221806 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-6ae27a88-ce34-47f3-9377-09f8200f29ff tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:35.254266 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-6cc8b21b-3925-4992-9955-d544ba091c8f tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72117f17294649d6b8bc16c66c7efab2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45d4c047d3c44324a27a27831236ab0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:00:35.267511 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-6cc8b21b-3925-4992-9955-d544ba091c8f tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] 10.222.0.13 "GET /compute/v2.1/servers/f6762e10-9d45-47cf-a6b6-d9bfc3404664" status: 200 len: 1785 microversion: 2.1 time: 0.220230 Nov 01 19:00:35.268118 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 883/1788] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:00:35 2022] GET /compute/v2.1/servers/f6762e10-9d45-47cf-a6b6-d9bfc3404664 => generated 1785 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:00:35.478915 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-9ecf5bf6-9714-461c-9ce4-cc52f3cfcc8f tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:00:35.480834 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-9ecf5bf6-9714-461c-9ce4-cc52f3cfcc8f tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] [instance: 71704d65-40b5-4f2e-8565-22e3b5a55d14] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:00:35.489404 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-9ecf5bf6-9714-461c-9ce4-cc52f3cfcc8f tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:35.490256 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-9ecf5bf6-9714-461c-9ce4-cc52f3cfcc8f tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:35.490909 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-9ecf5bf6-9714-461c-9ce4-cc52f3cfcc8f tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:35.491843 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-9ecf5bf6-9714-461c-9ce4-cc52f3cfcc8f tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:35.492499 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-9ecf5bf6-9714-461c-9ce4-cc52f3cfcc8f tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:35.493169 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-9ecf5bf6-9714-461c-9ce4-cc52f3cfcc8f tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:35.653511 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-9ecf5bf6-9714-461c-9ce4-cc52f3cfcc8f tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0290a6bb8bc24b8988a925327ac0381c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86941784237549838bba63ce88053b88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:00:35.662605 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-9ecf5bf6-9714-461c-9ce4-cc52f3cfcc8f tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] 10.222.0.13 "GET /compute/v2.1/servers/71704d65-40b5-4f2e-8565-22e3b5a55d14" status: 200 len: 1316 microversion: 2.1 time: 0.187929 Nov 01 19:00:35.663536 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 884/1789] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:00:35 2022] GET /compute/v2.1/servers/71704d65-40b5-4f2e-8565-22e3b5a55d14 => generated 1316 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 19:00:35.701078 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-6ae27a88-ce34-47f3-9377-09f8200f29ff tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a9c3b6a8c34f068caa50dc10d13a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9ef08eba0ef431285fd15a2561b4e5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:00:35.709247 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-6ae27a88-ce34-47f3-9377-09f8200f29ff tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] 10.222.0.13 "GET /compute/v2.1/servers/68b54f50-6b4d-4ea3-877f-c7ac79a5bb86" status: 200 len: 1646 microversion: 2.1 time: 0.502208 Nov 01 19:00:35.710335 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 906/1790] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:00:35 2022] GET /compute/v2.1/servers/68b54f50-6b4d-4ea3-877f-c7ac79a5bb86 => generated 1646 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:00:36.015861 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-e29e4250-a11a-4a66-a4ab-830cacfab9ad tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] Calling method '.version_select at 0x7f0ae2130040>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:00:36.061237 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-e29e4250-a11a-4a66-a4ab-830cacfab9ad tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] 10.222.0.13 "GET /compute/v2.1/images/ccc79e7f-4589-43b9-a2ca-2a8f13b6602d" status: 200 len: 1455 microversion: 2.1 time: 0.049204 Nov 01 19:00:36.062124 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 885/1791] 10.222.0.13 () {58 vars in 1233 bytes} [Tue Nov 1 19:00:36 2022] GET /compute/v2.1/images/ccc79e7f-4589-43b9-a2ca-2a8f13b6602d => generated 1455 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 19:00:36.231747 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-5bd0fecc-6757-4e4a-8d37-38ea14678c3b tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:00:36.232389 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-5bd0fecc-6757-4e4a-8d37-38ea14678c3b tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] [instance: 1f499af7-1896-478c-b7d7-d922bf78bd98] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:00:36.245987 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-5bd0fecc-6757-4e4a-8d37-38ea14678c3b tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:36.246514 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-5bd0fecc-6757-4e4a-8d37-38ea14678c3b tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:36.246965 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-5bd0fecc-6757-4e4a-8d37-38ea14678c3b tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:36.247693 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-5bd0fecc-6757-4e4a-8d37-38ea14678c3b tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:36.248362 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-5bd0fecc-6757-4e4a-8d37-38ea14678c3b tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:36.248822 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-5bd0fecc-6757-4e4a-8d37-38ea14678c3b tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:36.292107 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-1a9d5002-97a2-49be-9ce5-3dc37767ca2c tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:00:36.293286 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-1a9d5002-97a2-49be-9ce5-3dc37767ca2c tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] [instance: f6762e10-9d45-47cf-a6b6-d9bfc3404664] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:00:36.313070 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-1a9d5002-97a2-49be-9ce5-3dc37767ca2c tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:36.320754 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-1a9d5002-97a2-49be-9ce5-3dc37767ca2c tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:36.322918 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-1a9d5002-97a2-49be-9ce5-3dc37767ca2c tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:36.327386 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-1a9d5002-97a2-49be-9ce5-3dc37767ca2c tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:36.328728 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-1a9d5002-97a2-49be-9ce5-3dc37767ca2c tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:36.333243 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-1a9d5002-97a2-49be-9ce5-3dc37767ca2c tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:36.414043 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-1a9d5002-97a2-49be-9ce5-3dc37767ca2c tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:36.416878 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-1a9d5002-97a2-49be-9ce5-3dc37767ca2c tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:36.417959 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-1a9d5002-97a2-49be-9ce5-3dc37767ca2c tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:36.419944 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.objects.instance [None req-1a9d5002-97a2-49be-9ce5-3dc37767ca2c tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lazy-loading 'fault' on Instance uuid f6762e10-9d45-47cf-a6b6-d9bfc3404664 {{(pid=121403) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 01 19:00:36.662158 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-1a9d5002-97a2-49be-9ce5-3dc37767ca2c tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72117f17294649d6b8bc16c66c7efab2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45d4c047d3c44324a27a27831236ab0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:00:36.671842 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-1a9d5002-97a2-49be-9ce5-3dc37767ca2c tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] 10.222.0.13 "GET /compute/v2.1/servers/f6762e10-9d45-47cf-a6b6-d9bfc3404664" status: 200 len: 1785 microversion: 2.1 time: 0.384437 Nov 01 19:00:36.672771 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 886/1792] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:00:36 2022] GET /compute/v2.1/servers/f6762e10-9d45-47cf-a6b6-d9bfc3404664 => generated 1785 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:00:36.677402 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [req-69eed753-e9a7-4aae-a44e-bc9c78afe4c1 req-4ed218d2-f991-472e-9e07-4127d8e6ada5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f499af7-1896-478c-b7d7-d922bf78bd98", "name": "network-vif-plugged", "status": "completed", "tag": "a463e9d5-3409-4b7b-97cb-4970df239917"}]} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:00:36.688610 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-69eed753-e9a7-4aae-a44e-bc9c78afe4c1 req-4ed218d2-f991-472e-9e07-4127d8e6ada5 service nova] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:36.689120 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-69eed753-e9a7-4aae-a44e-bc9c78afe4c1 req-4ed218d2-f991-472e-9e07-4127d8e6ada5 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:36.689767 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-69eed753-e9a7-4aae-a44e-bc9c78afe4c1 req-4ed218d2-f991-472e-9e07-4127d8e6ada5 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:36.706465 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.compute.server_external_events [req-69eed753-e9a7-4aae-a44e-bc9c78afe4c1 req-4ed218d2-f991-472e-9e07-4127d8e6ada5 service nova] Creating event network-vif-plugged:a463e9d5-3409-4b7b-97cb-4970df239917 for instance 1f499af7-1896-478c-b7d7-d922bf78bd98 on n-h1-863052-2 Nov 01 19:00:36.719819 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [req-69eed753-e9a7-4aae-a44e-bc9c78afe4c1 req-4ed218d2-f991-472e-9e07-4127d8e6ada5 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045685 Nov 01 19:00:36.720464 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 887/1793] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Nov 1 19:00:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:00:36.734191 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-102c191e-11e8-4c13-8a2b-08d86bea7c33 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:00:36.734985 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-102c191e-11e8-4c13-8a2b-08d86bea7c33 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] [instance: 71704d65-40b5-4f2e-8565-22e3b5a55d14] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:00:36.744683 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-102c191e-11e8-4c13-8a2b-08d86bea7c33 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:36.745219 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-102c191e-11e8-4c13-8a2b-08d86bea7c33 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:36.750320 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-102c191e-11e8-4c13-8a2b-08d86bea7c33 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:36.751301 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-102c191e-11e8-4c13-8a2b-08d86bea7c33 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:36.751831 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-102c191e-11e8-4c13-8a2b-08d86bea7c33 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:36.752386 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-102c191e-11e8-4c13-8a2b-08d86bea7c33 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:36.775833 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-5bd0fecc-6757-4e4a-8d37-38ea14678c3b tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f32f5fba1976432d938e664c7714e52b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b9d4c236b944f9b2e8e502a50a8f8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:00:36.797221 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-5bd0fecc-6757-4e4a-8d37-38ea14678c3b tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] 10.222.0.13 "GET /compute/v2.1/servers/1f499af7-1896-478c-b7d7-d922bf78bd98" status: 200 len: 1199 microversion: 2.1 time: 0.569703 Nov 01 19:00:36.798874 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 907/1794] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:00:36 2022] GET /compute/v2.1/servers/1f499af7-1896-478c-b7d7-d922bf78bd98 => generated 1199 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:00:36.806173 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-6a820702-9603-4c9a-bde7-6ed8aae9c901 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:00:36.809174 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-6a820702-9603-4c9a-bde7-6ed8aae9c901 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] [instance: 9249c81d-e57b-4985-a398-8ad97526d5c7] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:00:36.825897 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-6a820702-9603-4c9a-bde7-6ed8aae9c901 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:36.828813 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-6a820702-9603-4c9a-bde7-6ed8aae9c901 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:36.829596 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-6a820702-9603-4c9a-bde7-6ed8aae9c901 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:36.830572 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-6a820702-9603-4c9a-bde7-6ed8aae9c901 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:36.832397 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-6a820702-9603-4c9a-bde7-6ed8aae9c901 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:36.833699 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-6a820702-9603-4c9a-bde7-6ed8aae9c901 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:36.911897 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-6a820702-9603-4c9a-bde7-6ed8aae9c901 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] [instance: 9249c81d-e57b-4985-a398-8ad97526d5c7] Going to try to terminate instance {{(pid=121402) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 01 19:00:37.006915 n-d-863052-2 devstack@n-api.service[121402]: DEBUG dbcounter [-] [121402] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 19:00:37.076364 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-6a820702-9603-4c9a-bde7-6ed8aae9c901 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] 10.222.0.13 "DELETE /compute/v2.1/servers/9249c81d-e57b-4985-a398-8ad97526d5c7" status: 204 len: 0 microversion: 2.1 time: 0.274539 Nov 01 19:00:37.077194 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 908/1795] 10.222.0.13 () {58 vars in 1239 bytes} [Tue Nov 1 19:00:36 2022] DELETE /compute/v2.1/servers/9249c81d-e57b-4985-a398-8ad97526d5c7 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 01 19:00:37.094893 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-d95bb3c2-916e-4363-af00-936fd3bbbd0f tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:00:37.096084 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-d95bb3c2-916e-4363-af00-936fd3bbbd0f tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] [instance: 68b54f50-6b4d-4ea3-877f-c7ac79a5bb86] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:00:37.103082 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-d95bb3c2-916e-4363-af00-936fd3bbbd0f tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:37.104073 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-d95bb3c2-916e-4363-af00-936fd3bbbd0f tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:37.104908 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-d95bb3c2-916e-4363-af00-936fd3bbbd0f tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:37.105872 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-d95bb3c2-916e-4363-af00-936fd3bbbd0f tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:37.106553 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-d95bb3c2-916e-4363-af00-936fd3bbbd0f tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:37.107215 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-d95bb3c2-916e-4363-af00-936fd3bbbd0f tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:37.244657 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-d95bb3c2-916e-4363-af00-936fd3bbbd0f tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a9c3b6a8c34f068caa50dc10d13a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9ef08eba0ef431285fd15a2561b4e5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:00:37.260005 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-d95bb3c2-916e-4363-af00-936fd3bbbd0f tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] 10.222.0.13 "GET /compute/v2.1/servers/68b54f50-6b4d-4ea3-877f-c7ac79a5bb86" status: 200 len: 1300 microversion: 2.1 time: 0.178014 Nov 01 19:00:37.261014 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 909/1796] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:00:37 2022] GET /compute/v2.1/servers/68b54f50-6b4d-4ea3-877f-c7ac79a5bb86 => generated 1300 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:00:37.266850 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [req-2dc284a7-491b-4f02-a642-271c7aed6ec4 req-9c58ff09-86f6-4306-a52f-657a4aae2b2f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "68b54f50-6b4d-4ea3-877f-c7ac79a5bb86", "name": "network-vif-deleted", "tag": "07f6f2d6-299c-491b-aa7c-cc5981eba332"}]} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:00:37.279552 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-2dc284a7-491b-4f02-a642-271c7aed6ec4 req-9c58ff09-86f6-4306-a52f-657a4aae2b2f service nova] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:37.280204 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-2dc284a7-491b-4f02-a642-271c7aed6ec4 req-9c58ff09-86f6-4306-a52f-657a4aae2b2f service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:37.281228 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-2dc284a7-491b-4f02-a642-271c7aed6ec4 req-9c58ff09-86f6-4306-a52f-657a4aae2b2f service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:37.296330 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.compute.server_external_events [req-2dc284a7-491b-4f02-a642-271c7aed6ec4 req-9c58ff09-86f6-4306-a52f-657a4aae2b2f service nova] Creating event network-vif-deleted:07f6f2d6-299c-491b-aa7c-cc5981eba332 for instance 68b54f50-6b4d-4ea3-877f-c7ac79a5bb86 on n-h1-863052-2 Nov 01 19:00:37.301699 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [req-2dc284a7-491b-4f02-a642-271c7aed6ec4 req-9c58ff09-86f6-4306-a52f-657a4aae2b2f service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039269 Nov 01 19:00:37.302792 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 910/1797] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Nov 1 19:00:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:00:37.312248 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-a6d6c7a8-d7a6-427e-a343-3fcd0809e575 tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] Calling method '.version_select at 0x7f0ae1c934c0>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:00:37.324613 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-102c191e-11e8-4c13-8a2b-08d86bea7c33 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0290a6bb8bc24b8988a925327ac0381c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86941784237549838bba63ce88053b88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:00:37.333648 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-102c191e-11e8-4c13-8a2b-08d86bea7c33 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] 10.222.0.13 "GET /compute/v2.1/servers/71704d65-40b5-4f2e-8565-22e3b5a55d14" status: 200 len: 1466 microversion: 2.1 time: 0.611972 Nov 01 19:00:37.334226 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 888/1798] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:00:36 2022] GET /compute/v2.1/servers/71704d65-40b5-4f2e-8565-22e3b5a55d14 => generated 1466 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:00:37.348787 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-b7fb7877-dae8-4161-8b1f-4cb943eb0640 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:00:37.356425 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-b7fb7877-dae8-4161-8b1f-4cb943eb0640 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] [instance: 9249c81d-e57b-4985-a398-8ad97526d5c7] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:00:37.376266 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-b7fb7877-dae8-4161-8b1f-4cb943eb0640 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:37.376527 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-b7fb7877-dae8-4161-8b1f-4cb943eb0640 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:37.378898 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-b7fb7877-dae8-4161-8b1f-4cb943eb0640 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:37.379642 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-b7fb7877-dae8-4161-8b1f-4cb943eb0640 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:37.380110 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-b7fb7877-dae8-4161-8b1f-4cb943eb0640 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:37.380536 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-b7fb7877-dae8-4161-8b1f-4cb943eb0640 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:37.386011 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-a6d6c7a8-d7a6-427e-a343-3fcd0809e575 tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] 10.222.0.13 "GET /compute/v2.1/images/ccc79e7f-4589-43b9-a2ca-2a8f13b6602d" status: 200 len: 1455 microversion: 2.1 time: 0.078686 Nov 01 19:00:37.387379 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 911/1799] 10.222.0.13 () {58 vars in 1233 bytes} [Tue Nov 1 19:00:37 2022] GET /compute/v2.1/images/ccc79e7f-4589-43b9-a2ca-2a8f13b6602d => generated 1455 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:00:37.402431 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-b07f16aa-a013-43b5-a299-82145addeeaa tempest-ServersOnMultiNodesTest-1027241392 tempest-ServersOnMultiNodesTest-1027241392-project-admin] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:00:37.403497 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-b07f16aa-a013-43b5-a299-82145addeeaa tempest-ServersOnMultiNodesTest-1027241392 tempest-ServersOnMultiNodesTest-1027241392-project-admin] [instance: 71704d65-40b5-4f2e-8565-22e3b5a55d14] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:00:37.410285 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b07f16aa-a013-43b5-a299-82145addeeaa tempest-ServersOnMultiNodesTest-1027241392 tempest-ServersOnMultiNodesTest-1027241392-project-admin] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:37.410711 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b07f16aa-a013-43b5-a299-82145addeeaa tempest-ServersOnMultiNodesTest-1027241392 tempest-ServersOnMultiNodesTest-1027241392-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:37.411144 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b07f16aa-a013-43b5-a299-82145addeeaa tempest-ServersOnMultiNodesTest-1027241392 tempest-ServersOnMultiNodesTest-1027241392-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:37.411913 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b07f16aa-a013-43b5-a299-82145addeeaa tempest-ServersOnMultiNodesTest-1027241392 tempest-ServersOnMultiNodesTest-1027241392-project-admin] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:37.412374 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b07f16aa-a013-43b5-a299-82145addeeaa tempest-ServersOnMultiNodesTest-1027241392 tempest-ServersOnMultiNodesTest-1027241392-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:37.412827 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b07f16aa-a013-43b5-a299-82145addeeaa tempest-ServersOnMultiNodesTest-1027241392 tempest-ServersOnMultiNodesTest-1027241392-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:37.606875 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-b07f16aa-a013-43b5-a299-82145addeeaa tempest-ServersOnMultiNodesTest-1027241392 tempest-ServersOnMultiNodesTest-1027241392-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/71704d65-40b5-4f2e-8565-22e3b5a55d14" status: 200 len: 1617 microversion: 2.1 time: 0.209312 Nov 01 19:00:37.614797 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 912/1800] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:00:37 2022] GET /compute/v2.1/servers/71704d65-40b5-4f2e-8565-22e3b5a55d14 => generated 1617 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:00:37.636325 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-36b44403-124e-49e5-b11e-7def0d1ba3a5 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:00:37.636940 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-36b44403-124e-49e5-b11e-7def0d1ba3a5 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] [instance: 71704d65-40b5-4f2e-8565-22e3b5a55d14] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:00:37.648733 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-36b44403-124e-49e5-b11e-7def0d1ba3a5 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:37.649316 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-36b44403-124e-49e5-b11e-7def0d1ba3a5 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:37.654363 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-36b44403-124e-49e5-b11e-7def0d1ba3a5 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:37.655535 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-36b44403-124e-49e5-b11e-7def0d1ba3a5 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:37.656759 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-36b44403-124e-49e5-b11e-7def0d1ba3a5 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:37.657306 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-36b44403-124e-49e5-b11e-7def0d1ba3a5 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:37.659609 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-b7fb7877-dae8-4161-8b1f-4cb943eb0640 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72117f17294649d6b8bc16c66c7efab2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45d4c047d3c44324a27a27831236ab0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:00:37.670321 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-b7fb7877-dae8-4161-8b1f-4cb943eb0640 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] 10.222.0.13 "GET /compute/v2.1/servers/9249c81d-e57b-4985-a398-8ad97526d5c7" status: 200 len: 1535 microversion: 2.1 time: 0.329684 Nov 01 19:00:37.690776 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 889/1801] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:00:37 2022] GET /compute/v2.1/servers/9249c81d-e57b-4985-a398-8ad97526d5c7 => generated 1535 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:00:37.693943 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-36b44403-124e-49e5-b11e-7def0d1ba3a5 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] [instance: 71704d65-40b5-4f2e-8565-22e3b5a55d14] Going to try to terminate instance {{(pid=121402) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 01 19:00:37.818493 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-36b44403-124e-49e5-b11e-7def0d1ba3a5 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] 10.222.0.13 "DELETE /compute/v2.1/servers/71704d65-40b5-4f2e-8565-22e3b5a55d14" status: 204 len: 0 microversion: 2.1 time: 0.185905 Nov 01 19:00:37.819258 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 913/1802] 10.222.0.13 () {58 vars in 1239 bytes} [Tue Nov 1 19:00:37 2022] DELETE /compute/v2.1/servers/71704d65-40b5-4f2e-8565-22e3b5a55d14 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 01 19:00:37.828462 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-91b16167-2ca5-44f5-8839-c9e5d42a6f1b tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:00:37.829311 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-91b16167-2ca5-44f5-8839-c9e5d42a6f1b tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] [instance: 71704d65-40b5-4f2e-8565-22e3b5a55d14] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:00:37.835596 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-91b16167-2ca5-44f5-8839-c9e5d42a6f1b tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:37.836080 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-91b16167-2ca5-44f5-8839-c9e5d42a6f1b tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:37.836544 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-91b16167-2ca5-44f5-8839-c9e5d42a6f1b tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:37.837345 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-91b16167-2ca5-44f5-8839-c9e5d42a6f1b tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:37.837802 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-91b16167-2ca5-44f5-8839-c9e5d42a6f1b tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:37.838415 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-91b16167-2ca5-44f5-8839-c9e5d42a6f1b tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:37.856472 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-591fdeb8-40a5-402d-bc99-1006e813fdbb tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:00:37.859049 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-591fdeb8-40a5-402d-bc99-1006e813fdbb tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] [instance: 1f499af7-1896-478c-b7d7-d922bf78bd98] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:00:37.889674 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-591fdeb8-40a5-402d-bc99-1006e813fdbb tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:37.892971 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-591fdeb8-40a5-402d-bc99-1006e813fdbb tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:37.893583 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-591fdeb8-40a5-402d-bc99-1006e813fdbb tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:37.898508 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-591fdeb8-40a5-402d-bc99-1006e813fdbb tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:37.909316 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-591fdeb8-40a5-402d-bc99-1006e813fdbb tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:37.910036 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-591fdeb8-40a5-402d-bc99-1006e813fdbb tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:38.042518 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-91b16167-2ca5-44f5-8839-c9e5d42a6f1b tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0290a6bb8bc24b8988a925327ac0381c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86941784237549838bba63ce88053b88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:00:38.052668 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-91b16167-2ca5-44f5-8839-c9e5d42a6f1b tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] 10.222.0.13 "GET /compute/v2.1/servers/71704d65-40b5-4f2e-8565-22e3b5a55d14" status: 200 len: 1472 microversion: 2.1 time: 0.228053 Nov 01 19:00:38.068643 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 914/1803] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:00:37 2022] GET /compute/v2.1/servers/71704d65-40b5-4f2e-8565-22e3b5a55d14 => generated 1472 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:00:38.111506 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-591fdeb8-40a5-402d-bc99-1006e813fdbb tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f32f5fba1976432d938e664c7714e52b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b9d4c236b944f9b2e8e502a50a8f8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:00:38.148560 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-591fdeb8-40a5-402d-bc99-1006e813fdbb tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] 10.222.0.13 "GET /compute/v2.1/servers/1f499af7-1896-478c-b7d7-d922bf78bd98" status: 200 len: 1199 microversion: 2.1 time: 0.314739 Nov 01 19:00:38.168230 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 890/1804] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:00:37 2022] GET /compute/v2.1/servers/1f499af7-1896-478c-b7d7-d922bf78bd98 => generated 1199 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:00:38.283118 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-8a5ec4d7-4214-47ae-8af5-853a77844529 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:00:38.283877 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-8a5ec4d7-4214-47ae-8af5-853a77844529 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] [instance: 68b54f50-6b4d-4ea3-877f-c7ac79a5bb86] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:00:38.291512 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-8a5ec4d7-4214-47ae-8af5-853a77844529 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:38.292341 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-8a5ec4d7-4214-47ae-8af5-853a77844529 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:38.293786 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-8a5ec4d7-4214-47ae-8af5-853a77844529 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:38.294630 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-8a5ec4d7-4214-47ae-8af5-853a77844529 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:38.295148 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-8a5ec4d7-4214-47ae-8af5-853a77844529 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:38.295584 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-8a5ec4d7-4214-47ae-8af5-853a77844529 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:38.363393 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-8a5ec4d7-4214-47ae-8af5-853a77844529 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:38.363889 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-8a5ec4d7-4214-47ae-8af5-853a77844529 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:38.364320 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-8a5ec4d7-4214-47ae-8af5-853a77844529 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:38.364811 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.objects.instance [None req-8a5ec4d7-4214-47ae-8af5-853a77844529 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Lazy-loading 'fault' on Instance uuid 68b54f50-6b4d-4ea3-877f-c7ac79a5bb86 {{(pid=121402) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 01 19:00:38.403508 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-baafd0d8-c64f-4d3d-a44f-9f391f30e9e8 tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] Calling method '.version_select at 0x7f0ae2999c10>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:00:38.428382 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-8a5ec4d7-4214-47ae-8af5-853a77844529 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a9c3b6a8c34f068caa50dc10d13a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9ef08eba0ef431285fd15a2561b4e5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:00:38.438525 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-8a5ec4d7-4214-47ae-8af5-853a77844529 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] 10.222.0.13 "GET /compute/v2.1/servers/68b54f50-6b4d-4ea3-877f-c7ac79a5bb86" status: 200 len: 1305 microversion: 2.1 time: 0.159099 Nov 01 19:00:38.439591 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 915/1805] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:00:38 2022] GET /compute/v2.1/servers/68b54f50-6b4d-4ea3-877f-c7ac79a5bb86 => generated 1305 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:00:38.527764 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-baafd0d8-c64f-4d3d-a44f-9f391f30e9e8 tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] 10.222.0.13 "GET /compute/v2.1/images/ccc79e7f-4589-43b9-a2ca-2a8f13b6602d" status: 200 len: 1455 microversion: 2.1 time: 0.127521 Nov 01 19:00:38.528361 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 891/1806] 10.222.0.13 () {58 vars in 1233 bytes} [Tue Nov 1 19:00:38 2022] GET /compute/v2.1/images/ccc79e7f-4589-43b9-a2ca-2a8f13b6602d => generated 1455 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:00:38.697541 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-59d6b9aa-ca84-4414-a0b0-17306b63344e tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:00:38.699049 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-59d6b9aa-ca84-4414-a0b0-17306b63344e tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] [instance: 9249c81d-e57b-4985-a398-8ad97526d5c7] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:00:38.707217 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-59d6b9aa-ca84-4414-a0b0-17306b63344e tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:38.712936 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-59d6b9aa-ca84-4414-a0b0-17306b63344e tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:38.713693 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-59d6b9aa-ca84-4414-a0b0-17306b63344e tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:38.715204 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-59d6b9aa-ca84-4414-a0b0-17306b63344e tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:38.725249 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-59d6b9aa-ca84-4414-a0b0-17306b63344e tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:38.725683 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-59d6b9aa-ca84-4414-a0b0-17306b63344e tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:38.898805 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [req-d0083e6c-f8a7-4f48-aff4-2e95f7560c06 req-c32ee4f2-1144-4361-89da-9952bd9ec0e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c34b04e9-a50a-4c58-85ff-ecef0bfc0343", "name": "network-vif-plugged", "status": "completed", "tag": "53c384ce-eeca-4b10-9794-84a0d7bc5468"}]} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:00:38.916800 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-d0083e6c-f8a7-4f48-aff4-2e95f7560c06 req-c32ee4f2-1144-4361-89da-9952bd9ec0e1 service nova] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:38.928446 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-d0083e6c-f8a7-4f48-aff4-2e95f7560c06 req-c32ee4f2-1144-4361-89da-9952bd9ec0e1 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:38.929086 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-d0083e6c-f8a7-4f48-aff4-2e95f7560c06 req-c32ee4f2-1144-4361-89da-9952bd9ec0e1 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:38.944354 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.compute.server_external_events [req-d0083e6c-f8a7-4f48-aff4-2e95f7560c06 req-c32ee4f2-1144-4361-89da-9952bd9ec0e1 service nova] Creating event network-vif-plugged:53c384ce-eeca-4b10-9794-84a0d7bc5468 for instance c34b04e9-a50a-4c58-85ff-ecef0bfc0343 on n-h1-863052-2 Nov 01 19:00:38.957844 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-59d6b9aa-ca84-4414-a0b0-17306b63344e tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72117f17294649d6b8bc16c66c7efab2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45d4c047d3c44324a27a27831236ab0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:00:38.965972 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [req-d0083e6c-f8a7-4f48-aff4-2e95f7560c06 req-c32ee4f2-1144-4361-89da-9952bd9ec0e1 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066823 Nov 01 19:00:38.966292 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-59d6b9aa-ca84-4414-a0b0-17306b63344e tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] 10.222.0.13 "GET /compute/v2.1/servers/9249c81d-e57b-4985-a398-8ad97526d5c7" status: 200 len: 1535 microversion: 2.1 time: 0.272513 Nov 01 19:00:38.966627 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 892/1807] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Nov 1 19:00:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 01 19:00:38.966958 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 916/1808] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:00:38 2022] GET /compute/v2.1/servers/9249c81d-e57b-4985-a398-8ad97526d5c7 => generated 1535 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:00:39.077810 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-17010334-8fe1-4c07-a8d5-ef0446f2e4bd tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:00:39.078540 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-17010334-8fe1-4c07-a8d5-ef0446f2e4bd tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] [instance: 71704d65-40b5-4f2e-8565-22e3b5a55d14] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:00:39.095558 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-17010334-8fe1-4c07-a8d5-ef0446f2e4bd tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:39.096134 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-17010334-8fe1-4c07-a8d5-ef0446f2e4bd tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:39.096660 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-17010334-8fe1-4c07-a8d5-ef0446f2e4bd tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:39.100262 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-17010334-8fe1-4c07-a8d5-ef0446f2e4bd tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:39.108986 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-17010334-8fe1-4c07-a8d5-ef0446f2e4bd tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:39.109559 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-17010334-8fe1-4c07-a8d5-ef0446f2e4bd tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:39.179207 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-616d8949-4631-44cd-b23a-8948583e89e0 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:00:39.180319 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-616d8949-4631-44cd-b23a-8948583e89e0 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] [instance: 1f499af7-1896-478c-b7d7-d922bf78bd98] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:00:39.208658 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-616d8949-4631-44cd-b23a-8948583e89e0 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:39.209502 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-616d8949-4631-44cd-b23a-8948583e89e0 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:39.210318 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-616d8949-4631-44cd-b23a-8948583e89e0 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:39.212357 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-616d8949-4631-44cd-b23a-8948583e89e0 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:39.213146 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-616d8949-4631-44cd-b23a-8948583e89e0 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:39.215820 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-616d8949-4631-44cd-b23a-8948583e89e0 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:39.483343 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-17010334-8fe1-4c07-a8d5-ef0446f2e4bd tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0290a6bb8bc24b8988a925327ac0381c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86941784237549838bba63ce88053b88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:00:39.493894 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-17010334-8fe1-4c07-a8d5-ef0446f2e4bd tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] 10.222.0.13 "GET /compute/v2.1/servers/71704d65-40b5-4f2e-8565-22e3b5a55d14" status: 200 len: 1472 microversion: 2.1 time: 0.420718 Nov 01 19:00:39.509355 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 917/1809] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:00:39 2022] GET /compute/v2.1/servers/71704d65-40b5-4f2e-8565-22e3b5a55d14 => generated 1472 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:00:39.517582 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [req-edea1676-43b4-41eb-96d3-aa911209b2e3 req-54d07184-5c88-4562-807b-002bd192d785 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f6762e10-9d45-47cf-a6b6-d9bfc3404664", "name": "network-vif-deleted", "tag": "ce9efbc4-25cd-4125-8921-620c35a44e5f"}]} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:00:39.529566 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-edea1676-43b4-41eb-96d3-aa911209b2e3 req-54d07184-5c88-4562-807b-002bd192d785 service nova] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:39.530194 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-edea1676-43b4-41eb-96d3-aa911209b2e3 req-54d07184-5c88-4562-807b-002bd192d785 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:39.530636 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-edea1676-43b4-41eb-96d3-aa911209b2e3 req-54d07184-5c88-4562-807b-002bd192d785 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:39.560464 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.compute.server_external_events [req-edea1676-43b4-41eb-96d3-aa911209b2e3 req-54d07184-5c88-4562-807b-002bd192d785 service nova] Creating event network-vif-deleted:ce9efbc4-25cd-4125-8921-620c35a44e5f for instance f6762e10-9d45-47cf-a6b6-d9bfc3404664 on n-h2-863052-2 Nov 01 19:00:39.580168 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [req-edea1676-43b4-41eb-96d3-aa911209b2e3 req-54d07184-5c88-4562-807b-002bd192d785 service nova] Instance f6762e10-9d45-47cf-a6b6-d9bfc3404664 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-863052-2', 'n-h1-863052-2'} {{(pid=121402) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Nov 01 19:00:39.596538 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [req-edea1676-43b4-41eb-96d3-aa911209b2e3 req-54d07184-5c88-4562-807b-002bd192d785 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083926 Nov 01 19:00:39.598395 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 918/1810] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Nov 1 19:00:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:00:39.609715 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-35129906-3b6a-491d-8c47-dcd31cc5aa92 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:00:39.610699 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-35129906-3b6a-491d-8c47-dcd31cc5aa92 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] [instance: 68b54f50-6b4d-4ea3-877f-c7ac79a5bb86] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:00:39.619172 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-35129906-3b6a-491d-8c47-dcd31cc5aa92 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:39.619757 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-35129906-3b6a-491d-8c47-dcd31cc5aa92 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:39.620346 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-35129906-3b6a-491d-8c47-dcd31cc5aa92 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:39.621306 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-35129906-3b6a-491d-8c47-dcd31cc5aa92 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:39.621915 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-35129906-3b6a-491d-8c47-dcd31cc5aa92 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:39.622442 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-35129906-3b6a-491d-8c47-dcd31cc5aa92 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:39.659731 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-616d8949-4631-44cd-b23a-8948583e89e0 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f32f5fba1976432d938e664c7714e52b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b9d4c236b944f9b2e8e502a50a8f8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:00:39.671565 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-616d8949-4631-44cd-b23a-8948583e89e0 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] 10.222.0.13 "GET /compute/v2.1/servers/1f499af7-1896-478c-b7d7-d922bf78bd98" status: 200 len: 1199 microversion: 2.1 time: 0.500711 Nov 01 19:00:39.674769 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 893/1811] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:00:39 2022] GET /compute/v2.1/servers/1f499af7-1896-478c-b7d7-d922bf78bd98 => generated 1199 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:00:39.706730 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-35129906-3b6a-491d-8c47-dcd31cc5aa92 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:39.720311 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-35129906-3b6a-491d-8c47-dcd31cc5aa92 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:39.720982 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-35129906-3b6a-491d-8c47-dcd31cc5aa92 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:39.721656 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.objects.instance [None req-35129906-3b6a-491d-8c47-dcd31cc5aa92 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Lazy-loading 'fault' on Instance uuid 68b54f50-6b4d-4ea3-877f-c7ac79a5bb86 {{(pid=121402) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 01 19:00:39.785079 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-35129906-3b6a-491d-8c47-dcd31cc5aa92 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a9c3b6a8c34f068caa50dc10d13a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9ef08eba0ef431285fd15a2561b4e5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:00:39.795488 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-35129906-3b6a-491d-8c47-dcd31cc5aa92 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] 10.222.0.13 "GET /compute/v2.1/servers/68b54f50-6b4d-4ea3-877f-c7ac79a5bb86" status: 200 len: 1305 microversion: 2.1 time: 0.190758 Nov 01 19:00:39.796089 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 919/1812] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:00:39 2022] GET /compute/v2.1/servers/68b54f50-6b4d-4ea3-877f-c7ac79a5bb86 => generated 1305 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:00:39.812850 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-f59aa0b5-8428-4259-9683-e1034af351ba tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] Calling method '.version_select at 0x7f0ae1cca310>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:00:39.814694 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [req-f9e0b2ae-a7e9-4f5d-a327-beda5bfd332f req-2741dd04-e936-4db9-bdee-5cee250c2855 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9249c81d-e57b-4985-a398-8ad97526d5c7", "name": "network-vif-deleted", "tag": "b471dd14-4ce9-4781-a7a0-1bd2ae3a7e55"}]} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:00:39.827518 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-f9e0b2ae-a7e9-4f5d-a327-beda5bfd332f req-2741dd04-e936-4db9-bdee-5cee250c2855 service nova] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:39.828216 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-f9e0b2ae-a7e9-4f5d-a327-beda5bfd332f req-2741dd04-e936-4db9-bdee-5cee250c2855 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:39.828953 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-f9e0b2ae-a7e9-4f5d-a327-beda5bfd332f req-2741dd04-e936-4db9-bdee-5cee250c2855 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:39.848752 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.compute.server_external_events [req-f9e0b2ae-a7e9-4f5d-a327-beda5bfd332f req-2741dd04-e936-4db9-bdee-5cee250c2855 service nova] Creating event network-vif-deleted:b471dd14-4ce9-4781-a7a0-1bd2ae3a7e55 for instance 9249c81d-e57b-4985-a398-8ad97526d5c7 on n-h2-863052-2 Nov 01 19:00:39.858162 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [req-f9e0b2ae-a7e9-4f5d-a327-beda5bfd332f req-2741dd04-e936-4db9-bdee-5cee250c2855 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.181077 Nov 01 19:00:39.860027 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 894/1813] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Nov 1 19:00:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:00:39.907242 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-f59aa0b5-8428-4259-9683-e1034af351ba tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] 10.222.0.13 "GET /compute/v2.1/images/ccc79e7f-4589-43b9-a2ca-2a8f13b6602d" status: 200 len: 1455 microversion: 2.1 time: 0.109998 Nov 01 19:00:39.907856 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 920/1814] 10.222.0.13 () {58 vars in 1233 bytes} [Tue Nov 1 19:00:39 2022] GET /compute/v2.1/images/ccc79e7f-4589-43b9-a2ca-2a8f13b6602d => generated 1455 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:00:39.991335 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-682611d0-33aa-4382-bd3e-039927571290 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:00:39.992292 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-682611d0-33aa-4382-bd3e-039927571290 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] [instance: 9249c81d-e57b-4985-a398-8ad97526d5c7] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:00:40.036742 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-682611d0-33aa-4382-bd3e-039927571290 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:40.038121 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-682611d0-33aa-4382-bd3e-039927571290 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:40.039199 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-682611d0-33aa-4382-bd3e-039927571290 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:40.052149 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-682611d0-33aa-4382-bd3e-039927571290 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:40.052973 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-682611d0-33aa-4382-bd3e-039927571290 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:40.053770 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-682611d0-33aa-4382-bd3e-039927571290 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:40.128630 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-682611d0-33aa-4382-bd3e-039927571290 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:40.129984 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-682611d0-33aa-4382-bd3e-039927571290 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:40.130512 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-682611d0-33aa-4382-bd3e-039927571290 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:40.130980 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.objects.instance [None req-682611d0-33aa-4382-bd3e-039927571290 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lazy-loading 'fault' on Instance uuid 9249c81d-e57b-4985-a398-8ad97526d5c7 {{(pid=121403) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 01 19:00:40.199217 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-682611d0-33aa-4382-bd3e-039927571290 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72117f17294649d6b8bc16c66c7efab2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45d4c047d3c44324a27a27831236ab0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:00:40.223044 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-682611d0-33aa-4382-bd3e-039927571290 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] 10.222.0.13 "GET /compute/v2.1/servers/9249c81d-e57b-4985-a398-8ad97526d5c7" status: 200 len: 1369 microversion: 2.1 time: 0.235244 Nov 01 19:00:40.243503 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 895/1815] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:00:39 2022] GET /compute/v2.1/servers/9249c81d-e57b-4985-a398-8ad97526d5c7 => generated 1369 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:00:40.524533 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-19d376b7-c7e5-4651-baee-818506df8a03 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:00:40.528112 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-19d376b7-c7e5-4651-baee-818506df8a03 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] [instance: 71704d65-40b5-4f2e-8565-22e3b5a55d14] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:00:40.548927 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-19d376b7-c7e5-4651-baee-818506df8a03 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:40.549689 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-19d376b7-c7e5-4651-baee-818506df8a03 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:40.550403 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-19d376b7-c7e5-4651-baee-818506df8a03 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:40.551355 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-19d376b7-c7e5-4651-baee-818506df8a03 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:40.552538 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-19d376b7-c7e5-4651-baee-818506df8a03 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:40.554436 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-19d376b7-c7e5-4651-baee-818506df8a03 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:40.696892 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-abab4bd1-2e25-4cab-9283-97a3cbff4674 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:00:40.697556 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-abab4bd1-2e25-4cab-9283-97a3cbff4674 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] [instance: 1f499af7-1896-478c-b7d7-d922bf78bd98] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:00:40.709694 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-abab4bd1-2e25-4cab-9283-97a3cbff4674 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:40.710008 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-abab4bd1-2e25-4cab-9283-97a3cbff4674 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:40.710442 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-abab4bd1-2e25-4cab-9283-97a3cbff4674 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:40.719944 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-abab4bd1-2e25-4cab-9283-97a3cbff4674 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:40.720502 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-abab4bd1-2e25-4cab-9283-97a3cbff4674 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:40.721045 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-abab4bd1-2e25-4cab-9283-97a3cbff4674 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:40.769671 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-19d376b7-c7e5-4651-baee-818506df8a03 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0290a6bb8bc24b8988a925327ac0381c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86941784237549838bba63ce88053b88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:00:40.779551 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-19d376b7-c7e5-4651-baee-818506df8a03 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] 10.222.0.13 "GET /compute/v2.1/servers/71704d65-40b5-4f2e-8565-22e3b5a55d14" status: 200 len: 1472 microversion: 2.1 time: 0.260324 Nov 01 19:00:40.793617 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 921/1816] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:00:40 2022] GET /compute/v2.1/servers/71704d65-40b5-4f2e-8565-22e3b5a55d14 => generated 1472 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:00:40.819811 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-f4d2399a-bcc0-407b-a85e-0a0edc2e269e tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:00:40.820759 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-f4d2399a-bcc0-407b-a85e-0a0edc2e269e tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] [instance: 68b54f50-6b4d-4ea3-877f-c7ac79a5bb86] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:00:40.828856 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f4d2399a-bcc0-407b-a85e-0a0edc2e269e tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:40.829749 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f4d2399a-bcc0-407b-a85e-0a0edc2e269e tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:40.830428 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f4d2399a-bcc0-407b-a85e-0a0edc2e269e tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:40.831431 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f4d2399a-bcc0-407b-a85e-0a0edc2e269e tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:40.832130 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f4d2399a-bcc0-407b-a85e-0a0edc2e269e tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:40.833474 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f4d2399a-bcc0-407b-a85e-0a0edc2e269e tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:40.901107 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f4d2399a-bcc0-407b-a85e-0a0edc2e269e tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:40.903464 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f4d2399a-bcc0-407b-a85e-0a0edc2e269e tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:40.905267 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f4d2399a-bcc0-407b-a85e-0a0edc2e269e tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:40.906420 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.objects.instance [None req-f4d2399a-bcc0-407b-a85e-0a0edc2e269e tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Lazy-loading 'fault' on Instance uuid 68b54f50-6b4d-4ea3-877f-c7ac79a5bb86 {{(pid=121402) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 01 19:00:40.953594 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-abab4bd1-2e25-4cab-9283-97a3cbff4674 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f32f5fba1976432d938e664c7714e52b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b9d4c236b944f9b2e8e502a50a8f8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:00:40.966593 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-abab4bd1-2e25-4cab-9283-97a3cbff4674 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] 10.222.0.13 "GET /compute/v2.1/servers/1f499af7-1896-478c-b7d7-d922bf78bd98" status: 200 len: 1199 microversion: 2.1 time: 0.273898 Nov 01 19:00:40.967412 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 896/1817] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:00:40 2022] GET /compute/v2.1/servers/1f499af7-1896-478c-b7d7-d922bf78bd98 => generated 1199 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 19:00:40.993772 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-f4d2399a-bcc0-407b-a85e-0a0edc2e269e tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a9c3b6a8c34f068caa50dc10d13a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9ef08eba0ef431285fd15a2561b4e5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:00:40.994769 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-d848032a-d61c-4e04-977f-f7cdf06cc909 tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] Calling method '.version_select at 0x7f0ae2999670>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:00:41.004157 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-f4d2399a-bcc0-407b-a85e-0a0edc2e269e tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] 10.222.0.13 "GET /compute/v2.1/servers/68b54f50-6b4d-4ea3-877f-c7ac79a5bb86" status: 200 len: 1305 microversion: 2.1 time: 0.187092 Nov 01 19:00:41.004787 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 922/1818] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:00:40 2022] GET /compute/v2.1/servers/68b54f50-6b4d-4ea3-877f-c7ac79a5bb86 => generated 1305 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:00:41.087835 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-d848032a-d61c-4e04-977f-f7cdf06cc909 tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] 10.222.0.13 "GET /compute/v2.1/images/ccc79e7f-4589-43b9-a2ca-2a8f13b6602d" status: 200 len: 1455 microversion: 2.1 time: 0.118916 Nov 01 19:00:41.092971 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 897/1819] 10.222.0.13 () {58 vars in 1233 bytes} [Tue Nov 1 19:00:40 2022] GET /compute/v2.1/images/ccc79e7f-4589-43b9-a2ca-2a8f13b6602d => generated 1455 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:00:41.247813 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-5e38ec5c-709c-4ffc-b4fe-a95bf713f10e tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:00:41.249044 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-5e38ec5c-709c-4ffc-b4fe-a95bf713f10e tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] [instance: 9249c81d-e57b-4985-a398-8ad97526d5c7] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:00:41.264391 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-5e38ec5c-709c-4ffc-b4fe-a95bf713f10e tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:41.264989 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-5e38ec5c-709c-4ffc-b4fe-a95bf713f10e tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:41.266663 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-5e38ec5c-709c-4ffc-b4fe-a95bf713f10e tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:41.267348 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-5e38ec5c-709c-4ffc-b4fe-a95bf713f10e tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:41.269617 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-5e38ec5c-709c-4ffc-b4fe-a95bf713f10e tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:41.269858 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-5e38ec5c-709c-4ffc-b4fe-a95bf713f10e tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:41.314026 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.wsgi [None req-5e38ec5c-709c-4ffc-b4fe-a95bf713f10e tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] HTTP exception thrown: Instance 9249c81d-e57b-4985-a398-8ad97526d5c7 could not be found. Nov 01 19:00:41.315703 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-5e38ec5c-709c-4ffc-b4fe-a95bf713f10e tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Request method failure captured: Nov 01 19:00:41.315703 n-d-863052-2 devstack@n-api.service[121402]: request: GET /compute/v2.1/servers/9249c81d-e57b-4985-a398-8ad97526d5c7 HTTP/1.1 Nov 01 19:00:41.315703 n-d-863052-2 devstack@n-api.service[121402]: Accept: application/json Nov 01 19:00:41.315703 n-d-863052-2 devstack@n-api.service[121402]: Accept-Encoding: identity Nov 01 19:00:41.315703 n-d-863052-2 devstack@n-api.service[121402]: Connection: close Nov 01 19:00:41.315703 n-d-863052-2 devstack@n-api.service[121402]: Content-Length: 0 Nov 01 19:00:41.315703 n-d-863052-2 devstack@n-api.service[121402]: Content-Type: application/json Nov 01 19:00:41.315703 n-d-863052-2 devstack@n-api.service[121402]: Host: 10.222.0.13 Nov 01 19:00:41.315703 n-d-863052-2 devstack@n-api.service[121402]: Openstack-System-Scope: None Nov 01 19:00:41.315703 n-d-863052-2 devstack@n-api.service[121402]: User-Agent: python-urllib3/1.26.12 Nov 01 19:00:41.315703 n-d-863052-2 devstack@n-api.service[121402]: X-Auth-Token: gAAAAABjYWu1cGHDBxLRMjfy5LV4CzwBbby5Te03nghiWl2YAj4Ezmd18PffZt5qzbLABcrwuhmojlV_K_bvZhDIRPoos5aj6lXnm72mv-YhsVHN9km2tJrzabw39H9HZ1hhBDokeXANnwtfyn136Q1Cru25X1_I6UbFCfvnbjmmRbzWxTIcXPc Nov 01 19:00:41.315703 n-d-863052-2 devstack@n-api.service[121402]: X-Domain-Id: None Nov 01 19:00:41.315703 n-d-863052-2 devstack@n-api.service[121402]: X-Domain-Name: None Nov 01 19:00:41.315703 n-d-863052-2 devstack@n-api.service[121402]: X-Identity-Status: Confirmed Nov 01 19:00:41.315703 n-d-863052-2 devstack@n-api.service[121402]: X-Is-Admin-Project: True Nov 01 19:00:41.315703 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Domain-Id: default Nov 01 19:00:41.315703 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Domain-Name: Default Nov 01 19:00:41.315703 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Id: 45d4c047d3c44324a27a27831236ab0d Nov 01 19:00:41.315703 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Name: tempest-MigrationsAdminTest-2112861741 Nov 01 19:00:41.315703 n-d-863052-2 devstack@n-api.service[121402]: X-Role: member,reader Nov 01 19:00:41.315703 n-d-863052-2 devstack@n-api.service[121402]: X-Roles: member,reader Nov 01 19:00:41.317681 n-d-863052-2 devstack@n-api.service[121402]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/45d4c047d3c44324a27a27831236ab0d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/45d4c047d3c44324a27a27831236ab0d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_45d4c047d3c44324a27a27831236ab0d", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/45d4c047d3c44324a27a27831236ab0d"}]}] Nov 01 19:00:41.317681 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant: tempest-MigrationsAdminTest-2112861741 Nov 01 19:00:41.317681 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant-Id: 45d4c047d3c44324a27a27831236ab0d Nov 01 19:00:41.317681 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant-Name: tempest-MigrationsAdminTest-2112861741 Nov 01 19:00:41.317681 n-d-863052-2 devstack@n-api.service[121402]: X-User: tempest-MigrationsAdminTest-2112861741-project Nov 01 19:00:41.317681 n-d-863052-2 devstack@n-api.service[121402]: X-User-Domain-Id: default Nov 01 19:00:41.317681 n-d-863052-2 devstack@n-api.service[121402]: X-User-Domain-Name: Default Nov 01 19:00:41.317681 n-d-863052-2 devstack@n-api.service[121402]: X-User-Id: 72117f17294649d6b8bc16c66c7efab2 Nov 01 19:00:41.317681 n-d-863052-2 devstack@n-api.service[121402]: X-User-Name: tempest-MigrationsAdminTest-2112861741-project Nov 01 19:00:41.317681 n-d-863052-2 devstack@n-api.service[121402]: method: > Nov 01 19:00:41.317681 n-d-863052-2 devstack@n-api.service[121402]: exception: Instance 9249c81d-e57b-4985-a398-8ad97526d5c7 could not be found. Nov 01 19:00:41.317681 n-d-863052-2 devstack@n-api.service[121402]: action_args: {'id': '9249c81d-e57b-4985-a398-8ad97526d5c7'} Nov 01 19:00:41.318774 n-d-863052-2 devstack@n-api.service[121402]: {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 01 19:00:41.318774 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:00:41.318774 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 01 19:00:41.318774 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 01 19:00:41.318774 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 01 19:00:41.318774 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 01 19:00:41.318774 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 01 19:00:41.318774 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 01 19:00:41.318774 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 01 19:00:41.318774 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 01 19:00:41.318774 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9249c81d-e57b-4985-a398-8ad97526d5c7 could not be found. Nov 01 19:00:41.318774 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:00:41.318774 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:00:41.318774 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:00:41.318774 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:00:41.318774 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:00:41.318774 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:00:41.318774 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 01 19:00:41.318774 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 01 19:00:41.318774 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 01 19:00:41.322194 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 01 19:00:41.322194 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 01 19:00:41.322194 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 01 19:00:41.322194 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 01 19:00:41.322194 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 01 19:00:41.322194 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 01 19:00:41.322194 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 01 19:00:41.322194 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9249c81d-e57b-4985-a398-8ad97526d5c7 could not be found. Nov 01 19:00:41.322194 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:00:41.322194 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:00:41.322194 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:00:41.322194 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:00:41.322194 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:00:41.322194 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:00:41.322194 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 01 19:00:41.322194 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 01 19:00:41.322194 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9249c81d-e57b-4985-a398-8ad97526d5c7 could not be found. Nov 01 19:00:41.322194 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:00:41.324121 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-5e38ec5c-709c-4ffc-b4fe-a95bf713f10e tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Returning 404 to user: Instance 9249c81d-e57b-4985-a398-8ad97526d5c7 could not be found. {{(pid=121402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 01 19:00:41.324121 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-5e38ec5c-709c-4ffc-b4fe-a95bf713f10e tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] 10.222.0.13 "GET /compute/v2.1/servers/9249c81d-e57b-4985-a398-8ad97526d5c7" status: 404 len: 111 microversion: 2.1 time: 0.075694 Nov 01 19:00:41.331784 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-ed7d1f87-0913-4fcd-ab62-fb3ffa50c6a8 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Calling method '.version_select at 0x7f0ae68f1dc0>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:00:41.336183 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 923/1820] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:00:41 2022] GET /compute/v2.1/servers/9249c81d-e57b-4985-a398-8ad97526d5c7 => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 01 19:00:41.384366 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-ed7d1f87-0913-4fcd-ab62-fb3ffa50c6a8 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1522475146" status: 202 len: 0 microversion: 2.1 time: 0.060033 Nov 01 19:00:41.393371 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 898/1821] 10.222.0.13 () {58 vars in 1221 bytes} [Tue Nov 1 19:00:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1522475146 => generated 0 bytes in 67 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 01 19:00:41.805670 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-a4492540-d34a-42cb-ab07-d86e3f18da64 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:00:41.806349 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-a4492540-d34a-42cb-ab07-d86e3f18da64 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] [instance: 71704d65-40b5-4f2e-8565-22e3b5a55d14] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:00:41.821738 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-a4492540-d34a-42cb-ab07-d86e3f18da64 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:41.824215 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-a4492540-d34a-42cb-ab07-d86e3f18da64 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:41.825747 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-a4492540-d34a-42cb-ab07-d86e3f18da64 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:41.827925 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-a4492540-d34a-42cb-ab07-d86e3f18da64 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:41.828569 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-a4492540-d34a-42cb-ab07-d86e3f18da64 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:41.830198 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-a4492540-d34a-42cb-ab07-d86e3f18da64 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:41.932103 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-a4492540-d34a-42cb-ab07-d86e3f18da64 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:41.933152 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-a4492540-d34a-42cb-ab07-d86e3f18da64 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:41.933977 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-a4492540-d34a-42cb-ab07-d86e3f18da64 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:41.934578 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.objects.instance [None req-a4492540-d34a-42cb-ab07-d86e3f18da64 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lazy-loading 'fault' on Instance uuid 71704d65-40b5-4f2e-8565-22e3b5a55d14 {{(pid=121402) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 01 19:00:41.997564 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-5a11f358-df66-4e97-9fec-21d26c7215e3 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:00:41.999902 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-5a11f358-df66-4e97-9fec-21d26c7215e3 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] [instance: 1f499af7-1896-478c-b7d7-d922bf78bd98] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:00:42.006292 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-a4492540-d34a-42cb-ab07-d86e3f18da64 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0290a6bb8bc24b8988a925327ac0381c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86941784237549838bba63ce88053b88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:00:42.012853 n-d-863052-2 devstack@n-api.service[121402]: DEBUG dbcounter [-] [121402] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=121402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 19:00:42.016297 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-5a11f358-df66-4e97-9fec-21d26c7215e3 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:42.017101 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-5a11f358-df66-4e97-9fec-21d26c7215e3 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:42.019094 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-a4492540-d34a-42cb-ab07-d86e3f18da64 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] 10.222.0.13 "GET /compute/v2.1/servers/71704d65-40b5-4f2e-8565-22e3b5a55d14" status: 200 len: 1306 microversion: 2.1 time: 0.218195 Nov 01 19:00:42.027668 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 924/1822] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:00:41 2022] GET /compute/v2.1/servers/71704d65-40b5-4f2e-8565-22e3b5a55d14 => generated 1306 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:00:42.033325 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-36a701ac-f3e5-4fe9-bb4c-a7b63a98cdaf tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:00:42.034148 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-36a701ac-f3e5-4fe9-bb4c-a7b63a98cdaf tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] [instance: 68b54f50-6b4d-4ea3-877f-c7ac79a5bb86] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:00:42.038295 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-5a11f358-df66-4e97-9fec-21d26c7215e3 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:42.039968 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-5a11f358-df66-4e97-9fec-21d26c7215e3 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:42.040498 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-5a11f358-df66-4e97-9fec-21d26c7215e3 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:42.040882 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-5a11f358-df66-4e97-9fec-21d26c7215e3 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:42.049418 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-36a701ac-f3e5-4fe9-bb4c-a7b63a98cdaf tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:42.050641 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-36a701ac-f3e5-4fe9-bb4c-a7b63a98cdaf tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:42.051167 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-36a701ac-f3e5-4fe9-bb4c-a7b63a98cdaf tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:42.053279 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-36a701ac-f3e5-4fe9-bb4c-a7b63a98cdaf tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:42.053757 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-36a701ac-f3e5-4fe9-bb4c-a7b63a98cdaf tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:42.054194 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-36a701ac-f3e5-4fe9-bb4c-a7b63a98cdaf tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:42.085988 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.wsgi [None req-36a701ac-f3e5-4fe9-bb4c-a7b63a98cdaf tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] HTTP exception thrown: Instance 68b54f50-6b4d-4ea3-877f-c7ac79a5bb86 could not be found. Nov 01 19:00:42.089504 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-36a701ac-f3e5-4fe9-bb4c-a7b63a98cdaf tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Request method failure captured: Nov 01 19:00:42.089504 n-d-863052-2 devstack@n-api.service[121402]: request: GET /compute/v2.1/servers/68b54f50-6b4d-4ea3-877f-c7ac79a5bb86 HTTP/1.1 Nov 01 19:00:42.089504 n-d-863052-2 devstack@n-api.service[121402]: Accept: application/json Nov 01 19:00:42.089504 n-d-863052-2 devstack@n-api.service[121402]: Accept-Encoding: identity Nov 01 19:00:42.089504 n-d-863052-2 devstack@n-api.service[121402]: Connection: close Nov 01 19:00:42.089504 n-d-863052-2 devstack@n-api.service[121402]: Content-Length: 0 Nov 01 19:00:42.089504 n-d-863052-2 devstack@n-api.service[121402]: Content-Type: application/json Nov 01 19:00:42.089504 n-d-863052-2 devstack@n-api.service[121402]: Host: 10.222.0.13 Nov 01 19:00:42.089504 n-d-863052-2 devstack@n-api.service[121402]: Openstack-System-Scope: None Nov 01 19:00:42.089504 n-d-863052-2 devstack@n-api.service[121402]: User-Agent: python-urllib3/1.26.12 Nov 01 19:00:42.089504 n-d-863052-2 devstack@n-api.service[121402]: X-Auth-Token: gAAAAABjYWyBtiXfeZJIejT83Ksslz2hqDZRAGe29hQVddGupa2qgtVXWeGxqJACkYUk64AE7WNmKMU9sisFWqkZV1B8K0xSz0uDHshwD54pFesORYzaFN_rWLCdcUKPHyx9WACJmd6ZEeb3LBT9WzZa08oHURzA6g0G4BDfSDsuxDk4mdVs9fM Nov 01 19:00:42.089504 n-d-863052-2 devstack@n-api.service[121402]: X-Domain-Id: None Nov 01 19:00:42.089504 n-d-863052-2 devstack@n-api.service[121402]: X-Domain-Name: None Nov 01 19:00:42.089504 n-d-863052-2 devstack@n-api.service[121402]: X-Identity-Status: Confirmed Nov 01 19:00:42.089504 n-d-863052-2 devstack@n-api.service[121402]: X-Is-Admin-Project: True Nov 01 19:00:42.089504 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Domain-Id: default Nov 01 19:00:42.089504 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Domain-Name: Default Nov 01 19:00:42.089504 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Id: a9ef08eba0ef431285fd15a2561b4e5d Nov 01 19:00:42.089504 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Name: tempest-SecurityGroupsTestJSON-1185949800 Nov 01 19:00:42.089504 n-d-863052-2 devstack@n-api.service[121402]: X-Role: member,reader Nov 01 19:00:42.089504 n-d-863052-2 devstack@n-api.service[121402]: X-Roles: member,reader Nov 01 19:00:42.091096 n-d-863052-2 devstack@n-api.service[121402]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/a9ef08eba0ef431285fd15a2561b4e5d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/a9ef08eba0ef431285fd15a2561b4e5d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_a9ef08eba0ef431285fd15a2561b4e5d", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/a9ef08eba0ef431285fd15a2561b4e5d"}]}] Nov 01 19:00:42.091096 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant: tempest-SecurityGroupsTestJSON-1185949800 Nov 01 19:00:42.091096 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant-Id: a9ef08eba0ef431285fd15a2561b4e5d Nov 01 19:00:42.091096 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1185949800 Nov 01 19:00:42.091096 n-d-863052-2 devstack@n-api.service[121402]: X-User: tempest-SecurityGroupsTestJSON-1185949800-project Nov 01 19:00:42.091096 n-d-863052-2 devstack@n-api.service[121402]: X-User-Domain-Id: default Nov 01 19:00:42.091096 n-d-863052-2 devstack@n-api.service[121402]: X-User-Domain-Name: Default Nov 01 19:00:42.091096 n-d-863052-2 devstack@n-api.service[121402]: X-User-Id: 55a9c3b6a8c34f068caa50dc10d13a85 Nov 01 19:00:42.091096 n-d-863052-2 devstack@n-api.service[121402]: X-User-Name: tempest-SecurityGroupsTestJSON-1185949800-project Nov 01 19:00:42.091096 n-d-863052-2 devstack@n-api.service[121402]: method: > Nov 01 19:00:42.091096 n-d-863052-2 devstack@n-api.service[121402]: exception: Instance 68b54f50-6b4d-4ea3-877f-c7ac79a5bb86 could not be found. Nov 01 19:00:42.091096 n-d-863052-2 devstack@n-api.service[121402]: action_args: {'id': '68b54f50-6b4d-4ea3-877f-c7ac79a5bb86'} Nov 01 19:00:42.092059 n-d-863052-2 devstack@n-api.service[121402]: {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 01 19:00:42.092059 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:00:42.092059 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 01 19:00:42.092059 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 01 19:00:42.092059 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 01 19:00:42.092059 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 01 19:00:42.092059 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 01 19:00:42.092059 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 01 19:00:42.092059 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 01 19:00:42.092059 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 01 19:00:42.092059 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 68b54f50-6b4d-4ea3-877f-c7ac79a5bb86 could not be found. Nov 01 19:00:42.092059 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:00:42.092059 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:00:42.092059 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:00:42.092059 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:00:42.092059 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:00:42.092059 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:00:42.092059 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 01 19:00:42.092059 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 01 19:00:42.092059 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 01 19:00:42.093518 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 01 19:00:42.093518 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 01 19:00:42.093518 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 01 19:00:42.093518 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 01 19:00:42.093518 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 01 19:00:42.093518 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 01 19:00:42.093518 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 01 19:00:42.093518 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 68b54f50-6b4d-4ea3-877f-c7ac79a5bb86 could not be found. Nov 01 19:00:42.093518 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:00:42.093518 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:00:42.093518 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:00:42.093518 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:00:42.093518 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:00:42.093518 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:00:42.093518 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 01 19:00:42.093518 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 01 19:00:42.093518 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 68b54f50-6b4d-4ea3-877f-c7ac79a5bb86 could not be found. Nov 01 19:00:42.093518 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:00:42.102569 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-36a701ac-f3e5-4fe9-bb4c-a7b63a98cdaf tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Returning 404 to user: Instance 68b54f50-6b4d-4ea3-877f-c7ac79a5bb86 could not be found. {{(pid=121402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 01 19:00:42.103726 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-36a701ac-f3e5-4fe9-bb4c-a7b63a98cdaf tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] 10.222.0.13 "GET /compute/v2.1/servers/68b54f50-6b4d-4ea3-877f-c7ac79a5bb86" status: 404 len: 111 microversion: 2.1 time: 0.074573 Nov 01 19:00:42.108257 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 925/1823] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:00:42 2022] GET /compute/v2.1/servers/68b54f50-6b4d-4ea3-877f-c7ac79a5bb86 => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 01 19:00:42.113290 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-557a080b-4b45-4082-b8b4-904989001fc2 tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] Calling method '.version_select at 0x7f0ae1c65820>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:00:42.178657 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-557a080b-4b45-4082-b8b4-904989001fc2 tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] 10.222.0.13 "GET /compute/v2.1/images/ccc79e7f-4589-43b9-a2ca-2a8f13b6602d" status: 200 len: 1455 microversion: 2.1 time: 0.068517 Nov 01 19:00:42.179847 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 926/1824] 10.222.0.13 () {58 vars in 1233 bytes} [Tue Nov 1 19:00:42 2022] GET /compute/v2.1/images/ccc79e7f-4589-43b9-a2ca-2a8f13b6602d => generated 1455 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:00:42.186759 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-2fbff53b-89ae-4146-93b7-77721044432b tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Calling method '.version_select at 0x7f0ae1c5a8b0>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:00:42.493671 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-2fbff53b-89ae-4146-93b7-77721044432b tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] 10.222.0.13 "DELETE /compute/v2.1/os-security-groups/45ff6218-4674-43d3-a758-cc5740dc9eac" status: 202 len: 0 microversion: 2.1 time: 0.312264 Nov 01 19:00:42.494067 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 927/1825] 10.222.0.13 () {58 vars in 1272 bytes} [Tue Nov 1 19:00:42 2022] DELETE /compute/v2.1/os-security-groups/45ff6218-4674-43d3-a758-cc5740dc9eac => generated 0 bytes in 313 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 01 19:00:42.502678 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-d91435fe-700f-4e8b-af7c-123083690182 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-1579827236", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "fca4c402-6e8d-4413-8958-dd7eef1647f7"}], "block_device_mapping_v2": [{"uuid": "cf946b10-459c-4a75-9955-2aecbefc9b20", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:00:42.596826 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.network.neutron [None req-d91435fe-700f-4e8b-af7c-123083690182 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] validate_networks() for [('fca4c402-6e8d-4413-8958-dd7eef1647f7', None, None, None, None, None)] {{(pid=121402) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 01 19:00:42.669499 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-5a11f358-df66-4e97-9fec-21d26c7215e3 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f32f5fba1976432d938e664c7714e52b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b9d4c236b944f9b2e8e502a50a8f8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:00:42.680799 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-5a11f358-df66-4e97-9fec-21d26c7215e3 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] 10.222.0.13 "GET /compute/v2.1/servers/1f499af7-1896-478c-b7d7-d922bf78bd98" status: 200 len: 1381 microversion: 2.1 time: 0.692235 Nov 01 19:00:42.681629 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 899/1826] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:00:41 2022] GET /compute/v2.1/servers/1f499af7-1896-478c-b7d7-d922bf78bd98 => generated 1381 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:00:42.704113 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [req-dde3be2a-0c89-4f01-8b8f-615e55e98eab req-fbc65747-9815-44d6-8c4d-414726e0d1d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71704d65-40b5-4f2e-8565-22e3b5a55d14", "name": "network-vif-deleted", "tag": "d849f3a8-88a0-4bab-8785-39ca8377aac1"}]} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:00:42.715000 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-dde3be2a-0c89-4f01-8b8f-615e55e98eab req-fbc65747-9815-44d6-8c4d-414726e0d1d1 service nova] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:42.715761 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-dde3be2a-0c89-4f01-8b8f-615e55e98eab req-fbc65747-9815-44d6-8c4d-414726e0d1d1 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:42.716724 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-dde3be2a-0c89-4f01-8b8f-615e55e98eab req-fbc65747-9815-44d6-8c4d-414726e0d1d1 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:42.728524 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.compute.server_external_events [req-dde3be2a-0c89-4f01-8b8f-615e55e98eab req-fbc65747-9815-44d6-8c4d-414726e0d1d1 service nova] Creating event network-vif-deleted:d849f3a8-88a0-4bab-8785-39ca8377aac1 for instance 71704d65-40b5-4f2e-8565-22e3b5a55d14 on n-h1-863052-2 Nov 01 19:00:42.735584 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [req-dde3be2a-0c89-4f01-8b8f-615e55e98eab req-fbc65747-9815-44d6-8c4d-414726e0d1d1 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035182 Nov 01 19:00:42.736531 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 900/1827] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Nov 1 19:00:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:00:42.742294 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-ea6f347a-9fab-473a-b0d6-4556c5c37d03 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Calling method '.version_select at 0x7f0ae2e02280>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:00:43.139768 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-ea6f347a-9fab-473a-b0d6-4556c5c37d03 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] 10.222.0.13 "DELETE /compute/v2.1/os-security-groups/760cc6e7-5309-477d-b0c6-b136e25aad60" status: 202 len: 0 microversion: 2.1 time: 0.401718 Nov 01 19:00:43.154757 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 901/1828] 10.222.0.13 () {58 vars in 1272 bytes} [Tue Nov 1 19:00:42 2022] DELETE /compute/v2.1/os-security-groups/760cc6e7-5309-477d-b0c6-b136e25aad60 => generated 0 bytes in 410 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 01 19:00:43.242308 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.virt.hardware [None req-d91435fe-700f-4e8b-af7c-123083690182 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Flavor limits 0:0:0 {{(pid=121402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 01 19:00:43.242808 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.virt.hardware [None req-d91435fe-700f-4e8b-af7c-123083690182 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Image limits 0:0:0 {{(pid=121402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 01 19:00:43.243175 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.virt.hardware [None req-d91435fe-700f-4e8b-af7c-123083690182 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Flavor pref 0:0:0 {{(pid=121402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 01 19:00:43.243608 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.virt.hardware [None req-d91435fe-700f-4e8b-af7c-123083690182 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Image pref 0:0:0 {{(pid=121402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 01 19:00:43.244012 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.virt.hardware [None req-d91435fe-700f-4e8b-af7c-123083690182 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 01 19:00:43.255637 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-d91435fe-700f-4e8b-af7c-123083690182 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:43.256063 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-d91435fe-700f-4e8b-af7c-123083690182 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:43.256492 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-d91435fe-700f-4e8b-af7c-123083690182 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:43.257243 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-d91435fe-700f-4e8b-af7c-123083690182 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:43.257694 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-d91435fe-700f-4e8b-af7c-123083690182 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:43.258111 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-d91435fe-700f-4e8b-af7c-123083690182 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:43.280216 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.quota [None req-d91435fe-700f-4e8b-af7c-123083690182 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Getting quotas for project 75730f90ec924cbebd605d6d6d747efe. Resources: {'cores', 'ram', 'instances'} {{(pid=121402) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 01 19:00:43.286101 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.quota [None req-d91435fe-700f-4e8b-af7c-123083690182 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Getting quotas for user c2ddf0211c374fe2a0db89546beb8e96 and project 75730f90ec924cbebd605d6d6d747efe. Resources: {'cores', 'ram', 'instances'} {{(pid=121402) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 01 19:00:43.360089 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-b28d5894-c18a-4de7-b244-71324bfb5bdb tempest-LiveMigrationTest-1695240876 tempest-LiveMigrationTest-1695240876-project-admin] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:00:43.361086 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-b28d5894-c18a-4de7-b244-71324bfb5bdb tempest-LiveMigrationTest-1695240876 tempest-LiveMigrationTest-1695240876-project-admin] [instance: 1f499af7-1896-478c-b7d7-d922bf78bd98] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:00:43.369477 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-b28d5894-c18a-4de7-b244-71324bfb5bdb tempest-LiveMigrationTest-1695240876 tempest-LiveMigrationTest-1695240876-project-admin] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:43.370915 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-b28d5894-c18a-4de7-b244-71324bfb5bdb tempest-LiveMigrationTest-1695240876 tempest-LiveMigrationTest-1695240876-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:43.371421 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-b28d5894-c18a-4de7-b244-71324bfb5bdb tempest-LiveMigrationTest-1695240876 tempest-LiveMigrationTest-1695240876-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:43.372279 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-b28d5894-c18a-4de7-b244-71324bfb5bdb tempest-LiveMigrationTest-1695240876 tempest-LiveMigrationTest-1695240876-project-admin] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:43.372831 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-b28d5894-c18a-4de7-b244-71324bfb5bdb tempest-LiveMigrationTest-1695240876 tempest-LiveMigrationTest-1695240876-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:43.373502 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-b28d5894-c18a-4de7-b244-71324bfb5bdb tempest-LiveMigrationTest-1695240876 tempest-LiveMigrationTest-1695240876-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:43.393547 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-d91435fe-700f-4e8b-af7c-123083690182 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Going to run 1 instances... {{(pid=121402) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 01 19:00:43.395763 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-d91435fe-700f-4e8b-af7c-123083690182 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] [instance: cd879708-f757-4f88-bc95-38b6cd55363c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='cf946b10-459c-4a75-9955-2aecbefc9b20',volume_size=None,volume_type=None)] {{(pid=121402) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 01 19:00:43.539094 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-b28d5894-c18a-4de7-b244-71324bfb5bdb tempest-LiveMigrationTest-1695240876 tempest-LiveMigrationTest-1695240876-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/1f499af7-1896-478c-b7d7-d922bf78bd98" status: 200 len: 1532 microversion: 2.1 time: 0.382892 Nov 01 19:00:43.540247 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 902/1829] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:00:43 2022] GET /compute/v2.1/servers/1f499af7-1896-478c-b7d7-d922bf78bd98 => generated 1532 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:00:43.544879 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-2adfd833-c7fc-4ebb-aff2-106b5fd35230 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:00:43.545661 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-2adfd833-c7fc-4ebb-aff2-106b5fd35230 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] [instance: 71704d65-40b5-4f2e-8565-22e3b5a55d14] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:00:43.555591 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-2adfd833-c7fc-4ebb-aff2-106b5fd35230 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:43.556321 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-2adfd833-c7fc-4ebb-aff2-106b5fd35230 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:43.557043 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-2adfd833-c7fc-4ebb-aff2-106b5fd35230 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:43.558619 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-2adfd833-c7fc-4ebb-aff2-106b5fd35230 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:43.559063 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-2adfd833-c7fc-4ebb-aff2-106b5fd35230 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:43.559463 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-2adfd833-c7fc-4ebb-aff2-106b5fd35230 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:43.579071 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.wsgi [None req-2adfd833-c7fc-4ebb-aff2-106b5fd35230 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] HTTP exception thrown: Instance 71704d65-40b5-4f2e-8565-22e3b5a55d14 could not be found. Nov 01 19:00:43.581021 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-2adfd833-c7fc-4ebb-aff2-106b5fd35230 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Request method failure captured: Nov 01 19:00:43.581021 n-d-863052-2 devstack@n-api.service[121403]: request: GET /compute/v2.1/servers/71704d65-40b5-4f2e-8565-22e3b5a55d14 HTTP/1.1 Nov 01 19:00:43.581021 n-d-863052-2 devstack@n-api.service[121403]: Accept: application/json Nov 01 19:00:43.581021 n-d-863052-2 devstack@n-api.service[121403]: Accept-Encoding: identity Nov 01 19:00:43.581021 n-d-863052-2 devstack@n-api.service[121403]: Connection: close Nov 01 19:00:43.581021 n-d-863052-2 devstack@n-api.service[121403]: Content-Length: 0 Nov 01 19:00:43.581021 n-d-863052-2 devstack@n-api.service[121403]: Content-Type: application/json Nov 01 19:00:43.581021 n-d-863052-2 devstack@n-api.service[121403]: Host: 10.222.0.13 Nov 01 19:00:43.581021 n-d-863052-2 devstack@n-api.service[121403]: Openstack-System-Scope: None Nov 01 19:00:43.581021 n-d-863052-2 devstack@n-api.service[121403]: User-Agent: python-urllib3/1.26.12 Nov 01 19:00:43.581021 n-d-863052-2 devstack@n-api.service[121403]: X-Auth-Token: gAAAAABjYWw27zVYcT0jiDkpuT1RhWK3v8RIYvgoBAv6JENEEUigh3EWDZBWsWojpv0UuPsP42AoaM4QJ3MvpvySt_jiXJEPPxL0U99qRIuu3QOrQQyEuoWyflobV2EmBrMy9kC-XG8E8wqlSX7W2YY0K8WOiMWq_0tsCeniBBlKBU3a2s3TKIo Nov 01 19:00:43.581021 n-d-863052-2 devstack@n-api.service[121403]: X-Domain-Id: None Nov 01 19:00:43.581021 n-d-863052-2 devstack@n-api.service[121403]: X-Domain-Name: None Nov 01 19:00:43.581021 n-d-863052-2 devstack@n-api.service[121403]: X-Identity-Status: Confirmed Nov 01 19:00:43.581021 n-d-863052-2 devstack@n-api.service[121403]: X-Is-Admin-Project: True Nov 01 19:00:43.581021 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Domain-Id: default Nov 01 19:00:43.581021 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Domain-Name: Default Nov 01 19:00:43.581021 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Id: 86941784237549838bba63ce88053b88 Nov 01 19:00:43.581021 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Name: tempest-ServersOnMultiNodesTest-1928208762 Nov 01 19:00:43.581021 n-d-863052-2 devstack@n-api.service[121403]: X-Role: member,reader Nov 01 19:00:43.581021 n-d-863052-2 devstack@n-api.service[121403]: X-Roles: member,reader Nov 01 19:00:43.582790 n-d-863052-2 devstack@n-api.service[121403]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/86941784237549838bba63ce88053b88"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/86941784237549838bba63ce88053b88"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_86941784237549838bba63ce88053b88", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/86941784237549838bba63ce88053b88"}]}] Nov 01 19:00:43.582790 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant: tempest-ServersOnMultiNodesTest-1928208762 Nov 01 19:00:43.582790 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant-Id: 86941784237549838bba63ce88053b88 Nov 01 19:00:43.582790 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1928208762 Nov 01 19:00:43.582790 n-d-863052-2 devstack@n-api.service[121403]: X-User: tempest-ServersOnMultiNodesTest-1928208762-project Nov 01 19:00:43.582790 n-d-863052-2 devstack@n-api.service[121403]: X-User-Domain-Id: default Nov 01 19:00:43.582790 n-d-863052-2 devstack@n-api.service[121403]: X-User-Domain-Name: Default Nov 01 19:00:43.582790 n-d-863052-2 devstack@n-api.service[121403]: X-User-Id: 0290a6bb8bc24b8988a925327ac0381c Nov 01 19:00:43.582790 n-d-863052-2 devstack@n-api.service[121403]: X-User-Name: tempest-ServersOnMultiNodesTest-1928208762-project Nov 01 19:00:43.582790 n-d-863052-2 devstack@n-api.service[121403]: method: > Nov 01 19:00:43.582790 n-d-863052-2 devstack@n-api.service[121403]: exception: Instance 71704d65-40b5-4f2e-8565-22e3b5a55d14 could not be found. Nov 01 19:00:43.582790 n-d-863052-2 devstack@n-api.service[121403]: action_args: {'id': '71704d65-40b5-4f2e-8565-22e3b5a55d14'} Nov 01 19:00:43.583834 n-d-863052-2 devstack@n-api.service[121403]: {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 01 19:00:43.583834 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:00:43.583834 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 01 19:00:43.583834 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 01 19:00:43.583834 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 01 19:00:43.583834 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 01 19:00:43.583834 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 01 19:00:43.583834 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 01 19:00:43.583834 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 01 19:00:43.583834 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 01 19:00:43.583834 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 71704d65-40b5-4f2e-8565-22e3b5a55d14 could not be found. Nov 01 19:00:43.583834 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:00:43.583834 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:00:43.583834 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:00:43.583834 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:00:43.583834 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:00:43.583834 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:00:43.583834 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 01 19:00:43.583834 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 01 19:00:43.583834 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 01 19:00:43.585456 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 01 19:00:43.585456 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 01 19:00:43.585456 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 01 19:00:43.585456 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 01 19:00:43.585456 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 01 19:00:43.585456 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 01 19:00:43.585456 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 01 19:00:43.585456 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 71704d65-40b5-4f2e-8565-22e3b5a55d14 could not be found. Nov 01 19:00:43.585456 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:00:43.585456 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:00:43.585456 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:00:43.585456 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:00:43.585456 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:00:43.585456 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:00:43.585456 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 01 19:00:43.585456 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 01 19:00:43.585456 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 71704d65-40b5-4f2e-8565-22e3b5a55d14 could not be found. Nov 01 19:00:43.585456 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:00:43.588724 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-2adfd833-c7fc-4ebb-aff2-106b5fd35230 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Returning 404 to user: Instance 71704d65-40b5-4f2e-8565-22e3b5a55d14 could not be found. {{(pid=121403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 01 19:00:43.589737 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-2adfd833-c7fc-4ebb-aff2-106b5fd35230 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] 10.222.0.13 "GET /compute/v2.1/servers/71704d65-40b5-4f2e-8565-22e3b5a55d14" status: 404 len: 111 microversion: 2.1 time: 0.048474 Nov 01 19:00:43.593797 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 903/1830] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:00:43 2022] GET /compute/v2.1/servers/71704d65-40b5-4f2e-8565-22e3b5a55d14 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 01 19:00:43.598850 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-d91435fe-700f-4e8b-af7c-123083690182 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 1.100489 Nov 01 19:00:43.599019 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-94f49b22-d15e-4c94-b977-dbcac883f3e5 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:00:43.606955 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 928/1831] 10.222.0.13 () {62 vars in 1188 bytes} [Tue Nov 1 19:00:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 1105 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Nov 01 19:00:43.607938 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-94f49b22-d15e-4c94-b977-dbcac883f3e5 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] [instance: 7218f99b-b011-4f08-931e-340d47069f6e] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:00:43.609512 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-46ea78f1-a06c-48e1-9415-3833d05d89f7 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Action: 'create', calling method: .version_select at 0x7f0ae1c511f0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-458344517", "description": "tempest-description-178471218"}} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:00:43.614789 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-94f49b22-d15e-4c94-b977-dbcac883f3e5 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:43.615484 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-94f49b22-d15e-4c94-b977-dbcac883f3e5 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:43.616150 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-94f49b22-d15e-4c94-b977-dbcac883f3e5 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:43.617059 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-94f49b22-d15e-4c94-b977-dbcac883f3e5 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:43.617704 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-94f49b22-d15e-4c94-b977-dbcac883f3e5 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:43.618176 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-94f49b22-d15e-4c94-b977-dbcac883f3e5 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:43.660684 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-94f49b22-d15e-4c94-b977-dbcac883f3e5 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] [instance: 7218f99b-b011-4f08-931e-340d47069f6e] Going to try to terminate instance {{(pid=121403) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 01 19:00:43.710880 n-d-863052-2 devstack@n-api.service[121403]: DEBUG dbcounter [-] [121403] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 19:00:43.792934 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-94f49b22-d15e-4c94-b977-dbcac883f3e5 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] 10.222.0.13 "DELETE /compute/v2.1/servers/7218f99b-b011-4f08-931e-340d47069f6e" status: 204 len: 0 microversion: 2.1 time: 0.196872 Nov 01 19:00:43.794276 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 904/1832] 10.222.0.13 () {58 vars in 1239 bytes} [Tue Nov 1 19:00:43 2022] DELETE /compute/v2.1/servers/7218f99b-b011-4f08-931e-340d47069f6e => generated 0 bytes in 200 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 01 19:00:43.801353 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-3d4c29ba-6bf3-4a0a-aa33-aedc114b3467 tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] Calling method '.version_select at 0x7f0ae2d2e550>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:00:43.826860 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-46ea78f1-a06c-48e1-9415-3833d05d89f7 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] 10.222.0.13 "POST /compute/v2.1/os-security-groups" status: 200 len: 242 microversion: 2.1 time: 0.226183 Nov 01 19:00:43.827764 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 929/1833] 10.222.0.13 () {60 vars in 1180 bytes} [Tue Nov 1 19:00:43 2022] POST /compute/v2.1/os-security-groups => generated 242 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:00:43.833552 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-bef9c8ad-04ce-460d-8401-7fcb0dd6c451 tempest-LiveMigrationTest-1695240876 tempest-LiveMigrationTest-1695240876-project-admin] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:00:43.834404 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-bef9c8ad-04ce-460d-8401-7fcb0dd6c451 tempest-LiveMigrationTest-1695240876 tempest-LiveMigrationTest-1695240876-project-admin] [instance: 1f499af7-1896-478c-b7d7-d922bf78bd98] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:00:43.860335 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-bef9c8ad-04ce-460d-8401-7fcb0dd6c451 tempest-LiveMigrationTest-1695240876 tempest-LiveMigrationTest-1695240876-project-admin] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:43.865516 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-bef9c8ad-04ce-460d-8401-7fcb0dd6c451 tempest-LiveMigrationTest-1695240876 tempest-LiveMigrationTest-1695240876-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:43.866232 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-bef9c8ad-04ce-460d-8401-7fcb0dd6c451 tempest-LiveMigrationTest-1695240876 tempest-LiveMigrationTest-1695240876-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:43.867651 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-bef9c8ad-04ce-460d-8401-7fcb0dd6c451 tempest-LiveMigrationTest-1695240876 tempest-LiveMigrationTest-1695240876-project-admin] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:43.868474 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-bef9c8ad-04ce-460d-8401-7fcb0dd6c451 tempest-LiveMigrationTest-1695240876 tempest-LiveMigrationTest-1695240876-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:43.869274 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-bef9c8ad-04ce-460d-8401-7fcb0dd6c451 tempest-LiveMigrationTest-1695240876 tempest-LiveMigrationTest-1695240876-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:43.900199 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-3d4c29ba-6bf3-4a0a-aa33-aedc114b3467 tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] 10.222.0.13 "GET /compute/v2.1/images/ccc79e7f-4589-43b9-a2ca-2a8f13b6602d" status: 200 len: 1455 microversion: 2.1 time: 0.104433 Nov 01 19:00:43.911662 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 905/1834] 10.222.0.13 () {58 vars in 1233 bytes} [Tue Nov 1 19:00:43 2022] GET /compute/v2.1/images/ccc79e7f-4589-43b9-a2ca-2a8f13b6602d => generated 1455 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:00:43.918647 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-5fe0aa13-ffe4-4520-be60-58e62c6167b8 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:00:43.919502 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-5fe0aa13-ffe4-4520-be60-58e62c6167b8 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] [instance: f35d5fdd-4a95-4b57-a506-665fa3f393c1] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:00:43.929571 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-5fe0aa13-ffe4-4520-be60-58e62c6167b8 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:43.930354 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-5fe0aa13-ffe4-4520-be60-58e62c6167b8 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:43.931134 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-5fe0aa13-ffe4-4520-be60-58e62c6167b8 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:43.932030 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-5fe0aa13-ffe4-4520-be60-58e62c6167b8 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:43.933364 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-5fe0aa13-ffe4-4520-be60-58e62c6167b8 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:43.933964 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-5fe0aa13-ffe4-4520-be60-58e62c6167b8 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:43.990622 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-5fe0aa13-ffe4-4520-be60-58e62c6167b8 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] [instance: f35d5fdd-4a95-4b57-a506-665fa3f393c1] Going to try to terminate instance {{(pid=121403) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 01 19:00:44.098866 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-bef9c8ad-04ce-460d-8401-7fcb0dd6c451 tempest-LiveMigrationTest-1695240876 tempest-LiveMigrationTest-1695240876-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/1f499af7-1896-478c-b7d7-d922bf78bd98" status: 200 len: 1532 microversion: 2.1 time: 0.269820 Nov 01 19:00:44.099440 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 930/1835] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:00:43 2022] GET /compute/v2.1/servers/1f499af7-1896-478c-b7d7-d922bf78bd98 => generated 1532 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:00:44.106513 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-384788af-9e37-4797-99b0-3fa7f260bade tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:00:44.107295 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-384788af-9e37-4797-99b0-3fa7f260bade tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] [instance: cd879708-f757-4f88-bc95-38b6cd55363c] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:00:44.127532 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-5fe0aa13-ffe4-4520-be60-58e62c6167b8 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] 10.222.0.13 "DELETE /compute/v2.1/servers/f35d5fdd-4a95-4b57-a506-665fa3f393c1" status: 204 len: 0 microversion: 2.1 time: 0.214243 Nov 01 19:00:44.129246 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 906/1836] 10.222.0.13 () {58 vars in 1239 bytes} [Tue Nov 1 19:00:43 2022] DELETE /compute/v2.1/servers/f35d5fdd-4a95-4b57-a506-665fa3f393c1 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 01 19:00:44.136376 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-2dcb24a4-1c83-4ba4-89e6-9a0ce0ed78d8 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:00:44.138008 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-2dcb24a4-1c83-4ba4-89e6-9a0ce0ed78d8 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] [instance: 7218f99b-b011-4f08-931e-340d47069f6e] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:00:44.145302 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-2dcb24a4-1c83-4ba4-89e6-9a0ce0ed78d8 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:44.146639 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-2dcb24a4-1c83-4ba4-89e6-9a0ce0ed78d8 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:44.147320 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-2dcb24a4-1c83-4ba4-89e6-9a0ce0ed78d8 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:44.148284 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-2dcb24a4-1c83-4ba4-89e6-9a0ce0ed78d8 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:44.149006 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-2dcb24a4-1c83-4ba4-89e6-9a0ce0ed78d8 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:44.149659 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-2dcb24a4-1c83-4ba4-89e6-9a0ce0ed78d8 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:44.214575 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-384788af-9e37-4797-99b0-3fa7f260bade tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:00:44.225794 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-384788af-9e37-4797-99b0-3fa7f260bade tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:00:44.227975 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-384788af-9e37-4797-99b0-3fa7f260bade tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:00:44.230023 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-384788af-9e37-4797-99b0-3fa7f260bade tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] 10.222.0.13 "GET /compute/v2.1/servers/cd879708-f757-4f88-bc95-38b6cd55363c" status: 200 len: 1104 microversion: 2.25 time: 0.127330 Nov 01 19:00:44.243825 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 931/1837] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 19:00:44 2022] GET /compute/v2.1/servers/cd879708-f757-4f88-bc95-38b6cd55363c => generated 1104 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 19:00:44.254278 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-c0dcde3f-e2d1-47e5-bcac-3f6eafd4e4d4 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Action: 'update', calling method: .version_select at 0x7f0ae1c5aa60>, body: {"security_group": {"name": "tempest-sg-hth-817972280", "description": "tempest-description-hth-1953750260"}} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:00:44.322530 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-2dcb24a4-1c83-4ba4-89e6-9a0ce0ed78d8 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72117f17294649d6b8bc16c66c7efab2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45d4c047d3c44324a27a27831236ab0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:00:44.336873 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-2dcb24a4-1c83-4ba4-89e6-9a0ce0ed78d8 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] 10.222.0.13 "GET /compute/v2.1/servers/7218f99b-b011-4f08-931e-340d47069f6e" status: 200 len: 1468 microversion: 2.1 time: 0.203948 Nov 01 19:00:44.336873 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 907/1838] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:00:44 2022] GET /compute/v2.1/servers/7218f99b-b011-4f08-931e-340d47069f6e => generated 1468 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:00:44.341525 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-989c207a-4157-4e61-982b-14958085a640 tempest-LiveMigrationTest-1695240876 tempest-LiveMigrationTest-1695240876-project-admin] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:00:44.345547 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-989c207a-4157-4e61-982b-14958085a640 tempest-LiveMigrationTest-1695240876 tempest-LiveMigrationTest-1695240876-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:44.346239 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-989c207a-4157-4e61-982b-14958085a640 tempest-LiveMigrationTest-1695240876 tempest-LiveMigrationTest-1695240876-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:44.346942 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-989c207a-4157-4e61-982b-14958085a640 tempest-LiveMigrationTest-1695240876 tempest-LiveMigrationTest-1695240876-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:44.347933 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-989c207a-4157-4e61-982b-14958085a640 tempest-LiveMigrationTest-1695240876 tempest-LiveMigrationTest-1695240876-project-admin] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:44.348643 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-989c207a-4157-4e61-982b-14958085a640 tempest-LiveMigrationTest-1695240876 tempest-LiveMigrationTest-1695240876-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:44.349468 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-989c207a-4157-4e61-982b-14958085a640 tempest-LiveMigrationTest-1695240876 tempest-LiveMigrationTest-1695240876-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:44.378728 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-989c207a-4157-4e61-982b-14958085a640 tempest-LiveMigrationTest-1695240876 tempest-LiveMigrationTest-1695240876-project-admin] 10.222.0.13 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.041608 Nov 01 19:00:44.387569 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 908/1839] 10.222.0.13 () {58 vars in 1176 bytes} [Tue Nov 1 19:00:44 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:00:44.392915 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-4f90063e-80c2-44fc-b9bc-e137a58e128f tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:00:44.393938 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-4f90063e-80c2-44fc-b9bc-e137a58e128f tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] [instance: f35d5fdd-4a95-4b57-a506-665fa3f393c1] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:00:44.402657 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-4f90063e-80c2-44fc-b9bc-e137a58e128f tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:44.403347 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-4f90063e-80c2-44fc-b9bc-e137a58e128f tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:44.404061 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-4f90063e-80c2-44fc-b9bc-e137a58e128f tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:44.404976 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-4f90063e-80c2-44fc-b9bc-e137a58e128f tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:44.405603 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-4f90063e-80c2-44fc-b9bc-e137a58e128f tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:44.406216 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-4f90063e-80c2-44fc-b9bc-e137a58e128f tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:44.470433 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-c0dcde3f-e2d1-47e5-bcac-3f6eafd4e4d4 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] 10.222.0.13 "PUT /compute/v2.1/os-security-groups/c2cc7163-2a17-4cea-8d72-0b299e948d89" status: 200 len: 217 microversion: 2.1 time: 0.225059 Nov 01 19:00:44.482938 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 932/1840] 10.222.0.13 () {60 vars in 1290 bytes} [Tue Nov 1 19:00:44 2022] PUT /compute/v2.1/os-security-groups/c2cc7163-2a17-4cea-8d72-0b299e948d89 => generated 217 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:00:44.489304 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-1f027957-15d6-4b05-b246-750666f7d93d tempest-LiveMigrationTest-1695240876 tempest-LiveMigrationTest-1695240876-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-863052-2", "block_migration": false, "disk_over_commit": false}} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:00:44.493934 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-1f027957-15d6-4b05-b246-750666f7d93d tempest-LiveMigrationTest-1695240876 tempest-LiveMigrationTest-1695240876-project-admin] [instance: 1f499af7-1896-478c-b7d7-d922bf78bd98] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:00:44.506249 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-1f027957-15d6-4b05-b246-750666f7d93d tempest-LiveMigrationTest-1695240876 tempest-LiveMigrationTest-1695240876-project-admin] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:44.516828 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-1f027957-15d6-4b05-b246-750666f7d93d tempest-LiveMigrationTest-1695240876 tempest-LiveMigrationTest-1695240876-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:44.517503 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-1f027957-15d6-4b05-b246-750666f7d93d tempest-LiveMigrationTest-1695240876 tempest-LiveMigrationTest-1695240876-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:44.518367 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-1f027957-15d6-4b05-b246-750666f7d93d tempest-LiveMigrationTest-1695240876 tempest-LiveMigrationTest-1695240876-project-admin] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:44.519711 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-1f027957-15d6-4b05-b246-750666f7d93d tempest-LiveMigrationTest-1695240876 tempest-LiveMigrationTest-1695240876-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:44.520234 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-1f027957-15d6-4b05-b246-750666f7d93d tempest-LiveMigrationTest-1695240876 tempest-LiveMigrationTest-1695240876-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:44.556325 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.objects.instance [None req-1f027957-15d6-4b05-b246-750666f7d93d tempest-LiveMigrationTest-1695240876 tempest-LiveMigrationTest-1695240876-project-admin] Lazy-loading 'flavor' on Instance uuid 1f499af7-1896-478c-b7d7-d922bf78bd98 {{(pid=121402) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 01 19:00:44.574919 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-1f027957-15d6-4b05-b246-750666f7d93d tempest-LiveMigrationTest-1695240876 tempest-LiveMigrationTest-1695240876-project-admin] [instance: 1f499af7-1896-478c-b7d7-d922bf78bd98] Going to try to live migrate instance to n-h2-863052-2 {{(pid=121402) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Nov 01 19:00:44.589793 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-4f90063e-80c2-44fc-b9bc-e137a58e128f tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0290a6bb8bc24b8988a925327ac0381c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86941784237549838bba63ce88053b88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:00:44.597939 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-4f90063e-80c2-44fc-b9bc-e137a58e128f tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] 10.222.0.13 "GET /compute/v2.1/servers/f35d5fdd-4a95-4b57-a506-665fa3f393c1" status: 200 len: 1473 microversion: 2.1 time: 0.208923 Nov 01 19:00:44.598750 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 909/1841] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:00:44 2022] GET /compute/v2.1/servers/f35d5fdd-4a95-4b57-a506-665fa3f393c1 => generated 1473 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:00:44.603285 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-172ff1ad-3f94-4569-9c8a-1e33de800f68 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Calling method '.version_select at 0x7f0ae2dd9c10>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:00:44.670046 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-172ff1ad-3f94-4569-9c8a-1e33de800f68 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] 10.222.0.13 "GET /compute/v2.1/os-security-groups/c2cc7163-2a17-4cea-8d72-0b299e948d89" status: 200 len: 217 microversion: 2.1 time: 0.070022 Nov 01 19:00:44.672676 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 910/1842] 10.222.0.13 () {58 vars in 1269 bytes} [Tue Nov 1 19:00:44 2022] GET /compute/v2.1/os-security-groups/c2cc7163-2a17-4cea-8d72-0b299e948d89 => generated 217 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:00:44.686184 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-b7ff5e84-50f3-4b56-b1fb-7517bcb5a9a7 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Calling method '.version_select at 0x7f0ae293fe50>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:00:44.928279 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-b7ff5e84-50f3-4b56-b1fb-7517bcb5a9a7 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] 10.222.0.13 "DELETE /compute/v2.1/os-security-groups/c2cc7163-2a17-4cea-8d72-0b299e948d89" status: 202 len: 0 microversion: 2.1 time: 0.246147 Nov 01 19:00:44.928959 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 911/1843] 10.222.0.13 () {58 vars in 1272 bytes} [Tue Nov 1 19:00:44 2022] DELETE /compute/v2.1/os-security-groups/c2cc7163-2a17-4cea-8d72-0b299e948d89 => generated 0 bytes in 248 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 01 19:00:44.934295 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-804e67b4-22fa-46e2-bfcb-65f78c66fbdf tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] Calling method '.version_select at 0x7f0ae6713670>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:00:45.016786 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-804e67b4-22fa-46e2-bfcb-65f78c66fbdf tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] 10.222.0.13 "GET /compute/v2.1/images/ccc79e7f-4589-43b9-a2ca-2a8f13b6602d" status: 200 len: 1455 microversion: 2.1 time: 0.086641 Nov 01 19:00:45.018018 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 912/1844] 10.222.0.13 () {58 vars in 1233 bytes} [Tue Nov 1 19:00:44 2022] GET /compute/v2.1/images/ccc79e7f-4589-43b9-a2ca-2a8f13b6602d => generated 1455 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:00:45.030414 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-0bb1f73b-4ce3-4108-840a-6dc271bdd381 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:00:45.031261 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-0bb1f73b-4ce3-4108-840a-6dc271bdd381 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] [instance: 68b54f50-6b4d-4ea3-877f-c7ac79a5bb86] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:00:45.040688 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-0bb1f73b-4ce3-4108-840a-6dc271bdd381 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:45.041530 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-0bb1f73b-4ce3-4108-840a-6dc271bdd381 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:45.042377 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-0bb1f73b-4ce3-4108-840a-6dc271bdd381 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:45.043150 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-0bb1f73b-4ce3-4108-840a-6dc271bdd381 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:45.043815 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-0bb1f73b-4ce3-4108-840a-6dc271bdd381 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:45.044253 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-0bb1f73b-4ce3-4108-840a-6dc271bdd381 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:45.064414 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.wsgi [None req-0bb1f73b-4ce3-4108-840a-6dc271bdd381 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] HTTP exception thrown: Instance 68b54f50-6b4d-4ea3-877f-c7ac79a5bb86 could not be found. Nov 01 19:00:45.066299 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-0bb1f73b-4ce3-4108-840a-6dc271bdd381 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Request method failure captured: Nov 01 19:00:45.066299 n-d-863052-2 devstack@n-api.service[121403]: request: DELETE /compute/v2.1/servers/68b54f50-6b4d-4ea3-877f-c7ac79a5bb86 HTTP/1.1 Nov 01 19:00:45.066299 n-d-863052-2 devstack@n-api.service[121403]: Accept: application/json Nov 01 19:00:45.066299 n-d-863052-2 devstack@n-api.service[121403]: Accept-Encoding: identity Nov 01 19:00:45.066299 n-d-863052-2 devstack@n-api.service[121403]: Connection: close Nov 01 19:00:45.066299 n-d-863052-2 devstack@n-api.service[121403]: Content-Length: 0 Nov 01 19:00:45.066299 n-d-863052-2 devstack@n-api.service[121403]: Content-Type: application/json Nov 01 19:00:45.066299 n-d-863052-2 devstack@n-api.service[121403]: Host: 10.222.0.13 Nov 01 19:00:45.066299 n-d-863052-2 devstack@n-api.service[121403]: Openstack-System-Scope: None Nov 01 19:00:45.066299 n-d-863052-2 devstack@n-api.service[121403]: User-Agent: python-urllib3/1.26.12 Nov 01 19:00:45.066299 n-d-863052-2 devstack@n-api.service[121403]: X-Auth-Token: gAAAAABjYWyBtiXfeZJIejT83Ksslz2hqDZRAGe29hQVddGupa2qgtVXWeGxqJACkYUk64AE7WNmKMU9sisFWqkZV1B8K0xSz0uDHshwD54pFesORYzaFN_rWLCdcUKPHyx9WACJmd6ZEeb3LBT9WzZa08oHURzA6g0G4BDfSDsuxDk4mdVs9fM Nov 01 19:00:45.066299 n-d-863052-2 devstack@n-api.service[121403]: X-Domain-Id: None Nov 01 19:00:45.066299 n-d-863052-2 devstack@n-api.service[121403]: X-Domain-Name: None Nov 01 19:00:45.066299 n-d-863052-2 devstack@n-api.service[121403]: X-Identity-Status: Confirmed Nov 01 19:00:45.066299 n-d-863052-2 devstack@n-api.service[121403]: X-Is-Admin-Project: True Nov 01 19:00:45.066299 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Domain-Id: default Nov 01 19:00:45.066299 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Domain-Name: Default Nov 01 19:00:45.066299 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Id: a9ef08eba0ef431285fd15a2561b4e5d Nov 01 19:00:45.066299 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Name: tempest-SecurityGroupsTestJSON-1185949800 Nov 01 19:00:45.066299 n-d-863052-2 devstack@n-api.service[121403]: X-Role: member,reader Nov 01 19:00:45.066299 n-d-863052-2 devstack@n-api.service[121403]: X-Roles: member,reader Nov 01 19:00:45.068121 n-d-863052-2 devstack@n-api.service[121403]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/a9ef08eba0ef431285fd15a2561b4e5d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/a9ef08eba0ef431285fd15a2561b4e5d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_a9ef08eba0ef431285fd15a2561b4e5d", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/a9ef08eba0ef431285fd15a2561b4e5d"}]}] Nov 01 19:00:45.068121 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant: tempest-SecurityGroupsTestJSON-1185949800 Nov 01 19:00:45.068121 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant-Id: a9ef08eba0ef431285fd15a2561b4e5d Nov 01 19:00:45.068121 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1185949800 Nov 01 19:00:45.068121 n-d-863052-2 devstack@n-api.service[121403]: X-User: tempest-SecurityGroupsTestJSON-1185949800-project Nov 01 19:00:45.068121 n-d-863052-2 devstack@n-api.service[121403]: X-User-Domain-Id: default Nov 01 19:00:45.068121 n-d-863052-2 devstack@n-api.service[121403]: X-User-Domain-Name: Default Nov 01 19:00:45.068121 n-d-863052-2 devstack@n-api.service[121403]: X-User-Id: 55a9c3b6a8c34f068caa50dc10d13a85 Nov 01 19:00:45.068121 n-d-863052-2 devstack@n-api.service[121403]: X-User-Name: tempest-SecurityGroupsTestJSON-1185949800-project Nov 01 19:00:45.068121 n-d-863052-2 devstack@n-api.service[121403]: method: > Nov 01 19:00:45.068121 n-d-863052-2 devstack@n-api.service[121403]: exception: Instance 68b54f50-6b4d-4ea3-877f-c7ac79a5bb86 could not be found. Nov 01 19:00:45.068121 n-d-863052-2 devstack@n-api.service[121403]: action_args: {'id': '68b54f50-6b4d-4ea3-877f-c7ac79a5bb86'} Nov 01 19:00:45.069126 n-d-863052-2 devstack@n-api.service[121403]: {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 01 19:00:45.069126 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:00:45.069126 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 01 19:00:45.069126 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 01 19:00:45.069126 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 01 19:00:45.069126 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 01 19:00:45.069126 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 01 19:00:45.069126 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 01 19:00:45.069126 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 01 19:00:45.069126 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 01 19:00:45.069126 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 68b54f50-6b4d-4ea3-877f-c7ac79a5bb86 could not be found. Nov 01 19:00:45.069126 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:00:45.069126 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:00:45.069126 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:00:45.069126 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:00:45.069126 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:00:45.069126 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:00:45.069126 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 01 19:00:45.069126 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 01 19:00:45.069126 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 01 19:00:45.070731 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 01 19:00:45.070731 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 01 19:00:45.070731 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 01 19:00:45.070731 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 01 19:00:45.070731 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 01 19:00:45.070731 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 01 19:00:45.070731 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 01 19:00:45.070731 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 01 19:00:45.070731 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 01 19:00:45.070731 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 68b54f50-6b4d-4ea3-877f-c7ac79a5bb86 could not be found. Nov 01 19:00:45.070731 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:00:45.070731 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:00:45.070731 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:00:45.070731 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:00:45.070731 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:00:45.070731 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:00:45.070731 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 01 19:00:45.070731 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 01 19:00:45.070731 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 68b54f50-6b4d-4ea3-877f-c7ac79a5bb86 could not be found. Nov 01 19:00:45.070731 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:00:45.073581 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-0bb1f73b-4ce3-4108-840a-6dc271bdd381 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Returning 404 to user: Instance 68b54f50-6b4d-4ea3-877f-c7ac79a5bb86 could not be found. {{(pid=121403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 01 19:00:45.074724 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-0bb1f73b-4ce3-4108-840a-6dc271bdd381 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] 10.222.0.13 "DELETE /compute/v2.1/servers/68b54f50-6b4d-4ea3-877f-c7ac79a5bb86" status: 404 len: 111 microversion: 2.1 time: 0.055494 Nov 01 19:00:45.075471 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 913/1845] 10.222.0.13 () {58 vars in 1239 bytes} [Tue Nov 1 19:00:45 2022] DELETE /compute/v2.1/servers/68b54f50-6b4d-4ea3-877f-c7ac79a5bb86 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 01 19:00:45.084418 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-8aae089d-d7e0-4851-ae1e-c49b35d7b921 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:00:45.085424 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-8aae089d-d7e0-4851-ae1e-c49b35d7b921 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] [instance: 68b54f50-6b4d-4ea3-877f-c7ac79a5bb86] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:00:45.092299 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-8aae089d-d7e0-4851-ae1e-c49b35d7b921 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:45.093210 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-8aae089d-d7e0-4851-ae1e-c49b35d7b921 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:45.093816 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-8aae089d-d7e0-4851-ae1e-c49b35d7b921 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:45.094777 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-8aae089d-d7e0-4851-ae1e-c49b35d7b921 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:45.095141 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-8aae089d-d7e0-4851-ae1e-c49b35d7b921 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:45.095709 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-8aae089d-d7e0-4851-ae1e-c49b35d7b921 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:45.113749 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.wsgi [None req-8aae089d-d7e0-4851-ae1e-c49b35d7b921 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] HTTP exception thrown: Instance 68b54f50-6b4d-4ea3-877f-c7ac79a5bb86 could not be found. Nov 01 19:00:45.115345 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-8aae089d-d7e0-4851-ae1e-c49b35d7b921 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Request method failure captured: Nov 01 19:00:45.115345 n-d-863052-2 devstack@n-api.service[121403]: request: GET /compute/v2.1/servers/68b54f50-6b4d-4ea3-877f-c7ac79a5bb86 HTTP/1.1 Nov 01 19:00:45.115345 n-d-863052-2 devstack@n-api.service[121403]: Accept: application/json Nov 01 19:00:45.115345 n-d-863052-2 devstack@n-api.service[121403]: Accept-Encoding: identity Nov 01 19:00:45.115345 n-d-863052-2 devstack@n-api.service[121403]: Connection: close Nov 01 19:00:45.115345 n-d-863052-2 devstack@n-api.service[121403]: Content-Length: 0 Nov 01 19:00:45.115345 n-d-863052-2 devstack@n-api.service[121403]: Content-Type: application/json Nov 01 19:00:45.115345 n-d-863052-2 devstack@n-api.service[121403]: Host: 10.222.0.13 Nov 01 19:00:45.115345 n-d-863052-2 devstack@n-api.service[121403]: Openstack-System-Scope: None Nov 01 19:00:45.115345 n-d-863052-2 devstack@n-api.service[121403]: User-Agent: python-urllib3/1.26.12 Nov 01 19:00:45.115345 n-d-863052-2 devstack@n-api.service[121403]: X-Auth-Token: gAAAAABjYWyBtiXfeZJIejT83Ksslz2hqDZRAGe29hQVddGupa2qgtVXWeGxqJACkYUk64AE7WNmKMU9sisFWqkZV1B8K0xSz0uDHshwD54pFesORYzaFN_rWLCdcUKPHyx9WACJmd6ZEeb3LBT9WzZa08oHURzA6g0G4BDfSDsuxDk4mdVs9fM Nov 01 19:00:45.115345 n-d-863052-2 devstack@n-api.service[121403]: X-Domain-Id: None Nov 01 19:00:45.115345 n-d-863052-2 devstack@n-api.service[121403]: X-Domain-Name: None Nov 01 19:00:45.115345 n-d-863052-2 devstack@n-api.service[121403]: X-Identity-Status: Confirmed Nov 01 19:00:45.115345 n-d-863052-2 devstack@n-api.service[121403]: X-Is-Admin-Project: True Nov 01 19:00:45.115345 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Domain-Id: default Nov 01 19:00:45.115345 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Domain-Name: Default Nov 01 19:00:45.115345 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Id: a9ef08eba0ef431285fd15a2561b4e5d Nov 01 19:00:45.115345 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Name: tempest-SecurityGroupsTestJSON-1185949800 Nov 01 19:00:45.115345 n-d-863052-2 devstack@n-api.service[121403]: X-Role: member,reader Nov 01 19:00:45.115345 n-d-863052-2 devstack@n-api.service[121403]: X-Roles: member,reader Nov 01 19:00:45.116916 n-d-863052-2 devstack@n-api.service[121403]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/a9ef08eba0ef431285fd15a2561b4e5d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/a9ef08eba0ef431285fd15a2561b4e5d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_a9ef08eba0ef431285fd15a2561b4e5d", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/a9ef08eba0ef431285fd15a2561b4e5d"}]}] Nov 01 19:00:45.116916 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant: tempest-SecurityGroupsTestJSON-1185949800 Nov 01 19:00:45.116916 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant-Id: a9ef08eba0ef431285fd15a2561b4e5d Nov 01 19:00:45.116916 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1185949800 Nov 01 19:00:45.116916 n-d-863052-2 devstack@n-api.service[121403]: X-User: tempest-SecurityGroupsTestJSON-1185949800-project Nov 01 19:00:45.116916 n-d-863052-2 devstack@n-api.service[121403]: X-User-Domain-Id: default Nov 01 19:00:45.116916 n-d-863052-2 devstack@n-api.service[121403]: X-User-Domain-Name: Default Nov 01 19:00:45.116916 n-d-863052-2 devstack@n-api.service[121403]: X-User-Id: 55a9c3b6a8c34f068caa50dc10d13a85 Nov 01 19:00:45.116916 n-d-863052-2 devstack@n-api.service[121403]: X-User-Name: tempest-SecurityGroupsTestJSON-1185949800-project Nov 01 19:00:45.116916 n-d-863052-2 devstack@n-api.service[121403]: method: > Nov 01 19:00:45.116916 n-d-863052-2 devstack@n-api.service[121403]: exception: Instance 68b54f50-6b4d-4ea3-877f-c7ac79a5bb86 could not be found. Nov 01 19:00:45.116916 n-d-863052-2 devstack@n-api.service[121403]: action_args: {'id': '68b54f50-6b4d-4ea3-877f-c7ac79a5bb86'} Nov 01 19:00:45.117781 n-d-863052-2 devstack@n-api.service[121403]: {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 01 19:00:45.117781 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:00:45.117781 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 01 19:00:45.117781 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 01 19:00:45.117781 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 01 19:00:45.117781 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 01 19:00:45.117781 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 01 19:00:45.117781 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 01 19:00:45.117781 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 01 19:00:45.117781 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 01 19:00:45.117781 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 68b54f50-6b4d-4ea3-877f-c7ac79a5bb86 could not be found. Nov 01 19:00:45.117781 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:00:45.117781 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:00:45.117781 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:00:45.117781 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:00:45.117781 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:00:45.117781 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:00:45.117781 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 01 19:00:45.117781 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 01 19:00:45.117781 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 01 19:00:45.119727 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 01 19:00:45.119727 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 01 19:00:45.119727 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 01 19:00:45.119727 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 01 19:00:45.119727 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 01 19:00:45.119727 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 01 19:00:45.119727 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 01 19:00:45.119727 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 68b54f50-6b4d-4ea3-877f-c7ac79a5bb86 could not be found. Nov 01 19:00:45.119727 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:00:45.119727 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:00:45.119727 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:00:45.119727 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:00:45.119727 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:00:45.119727 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:00:45.119727 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 01 19:00:45.119727 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 01 19:00:45.119727 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 68b54f50-6b4d-4ea3-877f-c7ac79a5bb86 could not be found. Nov 01 19:00:45.119727 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:00:45.122856 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-8aae089d-d7e0-4851-ae1e-c49b35d7b921 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Returning 404 to user: Instance 68b54f50-6b4d-4ea3-877f-c7ac79a5bb86 could not be found. {{(pid=121403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 01 19:00:45.122856 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-8aae089d-d7e0-4851-ae1e-c49b35d7b921 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] 10.222.0.13 "GET /compute/v2.1/servers/68b54f50-6b4d-4ea3-877f-c7ac79a5bb86" status: 404 len: 111 microversion: 2.1 time: 0.037238 Nov 01 19:00:45.122856 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 914/1846] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:00:45 2022] GET /compute/v2.1/servers/68b54f50-6b4d-4ea3-877f-c7ac79a5bb86 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 01 19:00:45.125749 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-0d646e3b-8f72-42f6-9439-3565660ca23b tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Calling method '.version_select at 0x7f0ae2864820>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:00:45.153458 n-d-863052-2 devstack@n-api.service[121403]: DEBUG neutronclient.v2_0.client [None req-0d646e3b-8f72-42f6-9439-3565660ca23b tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 760cc6e7-5309-477d-b0c6-b136e25aad60 does not exist", "detail": ""}} {{(pid=121403) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Nov 01 19:00:45.154809 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.network.security_group_api [None req-0d646e3b-8f72-42f6-9439-3565660ca23b tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Neutron security group 760cc6e7-5309-477d-b0c6-b136e25aad60 not found {{(pid=121403) get /opt/stack/nova/nova/network/security_group_api.py:313}} Nov 01 19:00:45.155558 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.wsgi [None req-0d646e3b-8f72-42f6-9439-3565660ca23b tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] HTTP exception thrown: Security group 760cc6e7-5309-477d-b0c6-b136e25aad60 does not exist Nov 01 19:00:45.155558 n-d-863052-2 devstack@n-api.service[121403]: Neutron server returns request_ids: ['req-59375bd2-17e6-4e33-be5d-ff008c7ccde8'] Nov 01 19:00:45.158189 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-0d646e3b-8f72-42f6-9439-3565660ca23b tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Request method failure captured: Nov 01 19:00:45.158189 n-d-863052-2 devstack@n-api.service[121403]: request: DELETE /compute/v2.1/os-security-groups/760cc6e7-5309-477d-b0c6-b136e25aad60 HTTP/1.1 Nov 01 19:00:45.158189 n-d-863052-2 devstack@n-api.service[121403]: Accept: application/json Nov 01 19:00:45.158189 n-d-863052-2 devstack@n-api.service[121403]: Accept-Encoding: identity Nov 01 19:00:45.158189 n-d-863052-2 devstack@n-api.service[121403]: Connection: close Nov 01 19:00:45.158189 n-d-863052-2 devstack@n-api.service[121403]: Content-Length: 0 Nov 01 19:00:45.158189 n-d-863052-2 devstack@n-api.service[121403]: Content-Type: application/json Nov 01 19:00:45.158189 n-d-863052-2 devstack@n-api.service[121403]: Host: 10.222.0.13 Nov 01 19:00:45.158189 n-d-863052-2 devstack@n-api.service[121403]: Openstack-System-Scope: None Nov 01 19:00:45.158189 n-d-863052-2 devstack@n-api.service[121403]: User-Agent: python-urllib3/1.26.12 Nov 01 19:00:45.158189 n-d-863052-2 devstack@n-api.service[121403]: X-Auth-Token: gAAAAABjYWyBtiXfeZJIejT83Ksslz2hqDZRAGe29hQVddGupa2qgtVXWeGxqJACkYUk64AE7WNmKMU9sisFWqkZV1B8K0xSz0uDHshwD54pFesORYzaFN_rWLCdcUKPHyx9WACJmd6ZEeb3LBT9WzZa08oHURzA6g0G4BDfSDsuxDk4mdVs9fM Nov 01 19:00:45.158189 n-d-863052-2 devstack@n-api.service[121403]: X-Domain-Id: None Nov 01 19:00:45.158189 n-d-863052-2 devstack@n-api.service[121403]: X-Domain-Name: None Nov 01 19:00:45.158189 n-d-863052-2 devstack@n-api.service[121403]: X-Identity-Status: Confirmed Nov 01 19:00:45.158189 n-d-863052-2 devstack@n-api.service[121403]: X-Is-Admin-Project: True Nov 01 19:00:45.158189 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Domain-Id: default Nov 01 19:00:45.158189 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Domain-Name: Default Nov 01 19:00:45.158189 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Id: a9ef08eba0ef431285fd15a2561b4e5d Nov 01 19:00:45.158189 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Name: tempest-SecurityGroupsTestJSON-1185949800 Nov 01 19:00:45.158189 n-d-863052-2 devstack@n-api.service[121403]: X-Role: member,reader Nov 01 19:00:45.158189 n-d-863052-2 devstack@n-api.service[121403]: X-Roles: member,reader Nov 01 19:00:45.160025 n-d-863052-2 devstack@n-api.service[121403]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/a9ef08eba0ef431285fd15a2561b4e5d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/a9ef08eba0ef431285fd15a2561b4e5d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_a9ef08eba0ef431285fd15a2561b4e5d", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/a9ef08eba0ef431285fd15a2561b4e5d"}]}] Nov 01 19:00:45.160025 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant: tempest-SecurityGroupsTestJSON-1185949800 Nov 01 19:00:45.160025 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant-Id: a9ef08eba0ef431285fd15a2561b4e5d Nov 01 19:00:45.160025 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1185949800 Nov 01 19:00:45.160025 n-d-863052-2 devstack@n-api.service[121403]: X-User: tempest-SecurityGroupsTestJSON-1185949800-project Nov 01 19:00:45.160025 n-d-863052-2 devstack@n-api.service[121403]: X-User-Domain-Id: default Nov 01 19:00:45.160025 n-d-863052-2 devstack@n-api.service[121403]: X-User-Domain-Name: Default Nov 01 19:00:45.160025 n-d-863052-2 devstack@n-api.service[121403]: X-User-Id: 55a9c3b6a8c34f068caa50dc10d13a85 Nov 01 19:00:45.160025 n-d-863052-2 devstack@n-api.service[121403]: X-User-Name: tempest-SecurityGroupsTestJSON-1185949800-project Nov 01 19:00:45.160025 n-d-863052-2 devstack@n-api.service[121403]: method: Nov 01 19:00:45.160025 n-d-863052-2 devstack@n-api.service[121403]: exception: Security group 760cc6e7-5309-477d-b0c6-b136e25aad60 does not exist Nov 01 19:00:45.160025 n-d-863052-2 devstack@n-api.service[121403]: Neutron server returns request_ids: ['req-59375bd2-17e6-4e33-be5d-ff008c7ccde8'] Nov 01 19:00:45.160025 n-d-863052-2 devstack@n-api.service[121403]: action_args: {'id': '760cc6e7-5309-477d-b0c6-b136e25aad60'} Nov 01 19:00:45.161160 n-d-863052-2 devstack@n-api.service[121403]: {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 01 19:00:45.161160 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:00:45.161160 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Nov 01 19:00:45.161160 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Nov 01 19:00:45.161160 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 01 19:00:45.161160 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 01 19:00:45.161160 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Nov 01 19:00:45.161160 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Nov 01 19:00:45.161160 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 01 19:00:45.161160 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 01 19:00:45.161160 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 01 19:00:45.161160 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 01 19:00:45.161160 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 01 19:00:45.161160 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 01 19:00:45.161160 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 01 19:00:45.161160 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 01 19:00:45.161160 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 01 19:00:45.161160 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 01 19:00:45.161160 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Nov 01 19:00:45.162771 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Nov 01 19:00:45.162771 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 01 19:00:45.162771 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 01 19:00:45.162771 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Nov 01 19:00:45.162771 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Nov 01 19:00:45.162771 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Nov 01 19:00:45.162771 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Nov 01 19:00:45.162771 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 760cc6e7-5309-477d-b0c6-b136e25aad60 does not exist Nov 01 19:00:45.162771 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-59375bd2-17e6-4e33-be5d-ff008c7ccde8'] Nov 01 19:00:45.162771 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:00:45.162771 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:00:45.162771 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:00:45.162771 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:00:45.162771 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Nov 01 19:00:45.162771 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Nov 01 19:00:45.162771 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Nov 01 19:00:45.162771 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Nov 01 19:00:45.162771 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 760cc6e7-5309-477d-b0c6-b136e25aad60 does not exist Nov 01 19:00:45.164168 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-59375bd2-17e6-4e33-be5d-ff008c7ccde8'] Nov 01 19:00:45.164168 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:00:45.164168 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:00:45.164168 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:00:45.164168 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:00:45.164168 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:00:45.164168 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:00:45.164168 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 01 19:00:45.164168 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 01 19:00:45.164168 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 01 19:00:45.164168 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 01 19:00:45.164168 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 01 19:00:45.164168 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 01 19:00:45.164168 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Nov 01 19:00:45.164168 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Nov 01 19:00:45.164168 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 760cc6e7-5309-477d-b0c6-b136e25aad60 does not exist Nov 01 19:00:45.164168 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-59375bd2-17e6-4e33-be5d-ff008c7ccde8'] Nov 01 19:00:45.164168 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:00:45.164168 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:00:45.164168 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:00:45.164168 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:00:45.165909 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:00:45.165909 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:00:45.165909 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 01 19:00:45.165909 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 01 19:00:45.165909 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 760cc6e7-5309-477d-b0c6-b136e25aad60 does not exist Nov 01 19:00:45.165909 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-59375bd2-17e6-4e33-be5d-ff008c7ccde8'] Nov 01 19:00:45.165909 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:00:45.168287 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-0d646e3b-8f72-42f6-9439-3565660ca23b tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Returning 404 to user: Security group 760cc6e7-5309-477d-b0c6-b136e25aad60 does not exist Nov 01 19:00:45.168287 n-d-863052-2 devstack@n-api.service[121403]: Neutron server returns request_ids: ['req-59375bd2-17e6-4e33-be5d-ff008c7ccde8'] {{(pid=121403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 01 19:00:45.170327 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-0d646e3b-8f72-42f6-9439-3565660ca23b tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] 10.222.0.13 "DELETE /compute/v2.1/os-security-groups/760cc6e7-5309-477d-b0c6-b136e25aad60" status: 404 len: 194 microversion: 2.1 time: 0.047711 Nov 01 19:00:45.171163 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 915/1847] 10.222.0.13 () {58 vars in 1272 bytes} [Tue Nov 1 19:00:45 2022] DELETE /compute/v2.1/os-security-groups/760cc6e7-5309-477d-b0c6-b136e25aad60 => generated 194 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 01 19:00:45.187925 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-251ce0da-f2f7-4454-823c-9ff1a31dfe21 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Calling method '.version_select at 0x7f0ae2826790>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:00:45.222787 n-d-863052-2 devstack@n-api.service[121403]: DEBUG neutronclient.v2_0.client [None req-251ce0da-f2f7-4454-823c-9ff1a31dfe21 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 45ff6218-4674-43d3-a758-cc5740dc9eac does not exist", "detail": ""}} {{(pid=121403) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Nov 01 19:00:45.223828 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.network.security_group_api [None req-251ce0da-f2f7-4454-823c-9ff1a31dfe21 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Neutron security group 45ff6218-4674-43d3-a758-cc5740dc9eac not found {{(pid=121403) get /opt/stack/nova/nova/network/security_group_api.py:313}} Nov 01 19:00:45.225552 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.wsgi [None req-251ce0da-f2f7-4454-823c-9ff1a31dfe21 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] HTTP exception thrown: Security group 45ff6218-4674-43d3-a758-cc5740dc9eac does not exist Nov 01 19:00:45.225552 n-d-863052-2 devstack@n-api.service[121403]: Neutron server returns request_ids: ['req-f866b213-faed-49a4-8e05-743ff1fb73db'] Nov 01 19:00:45.227367 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-251ce0da-f2f7-4454-823c-9ff1a31dfe21 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Request method failure captured: Nov 01 19:00:45.227367 n-d-863052-2 devstack@n-api.service[121403]: request: DELETE /compute/v2.1/os-security-groups/45ff6218-4674-43d3-a758-cc5740dc9eac HTTP/1.1 Nov 01 19:00:45.227367 n-d-863052-2 devstack@n-api.service[121403]: Accept: application/json Nov 01 19:00:45.227367 n-d-863052-2 devstack@n-api.service[121403]: Accept-Encoding: identity Nov 01 19:00:45.227367 n-d-863052-2 devstack@n-api.service[121403]: Connection: close Nov 01 19:00:45.227367 n-d-863052-2 devstack@n-api.service[121403]: Content-Length: 0 Nov 01 19:00:45.227367 n-d-863052-2 devstack@n-api.service[121403]: Content-Type: application/json Nov 01 19:00:45.227367 n-d-863052-2 devstack@n-api.service[121403]: Host: 10.222.0.13 Nov 01 19:00:45.227367 n-d-863052-2 devstack@n-api.service[121403]: Openstack-System-Scope: None Nov 01 19:00:45.227367 n-d-863052-2 devstack@n-api.service[121403]: User-Agent: python-urllib3/1.26.12 Nov 01 19:00:45.227367 n-d-863052-2 devstack@n-api.service[121403]: X-Auth-Token: gAAAAABjYWyBtiXfeZJIejT83Ksslz2hqDZRAGe29hQVddGupa2qgtVXWeGxqJACkYUk64AE7WNmKMU9sisFWqkZV1B8K0xSz0uDHshwD54pFesORYzaFN_rWLCdcUKPHyx9WACJmd6ZEeb3LBT9WzZa08oHURzA6g0G4BDfSDsuxDk4mdVs9fM Nov 01 19:00:45.227367 n-d-863052-2 devstack@n-api.service[121403]: X-Domain-Id: None Nov 01 19:00:45.227367 n-d-863052-2 devstack@n-api.service[121403]: X-Domain-Name: None Nov 01 19:00:45.227367 n-d-863052-2 devstack@n-api.service[121403]: X-Identity-Status: Confirmed Nov 01 19:00:45.227367 n-d-863052-2 devstack@n-api.service[121403]: X-Is-Admin-Project: True Nov 01 19:00:45.227367 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Domain-Id: default Nov 01 19:00:45.227367 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Domain-Name: Default Nov 01 19:00:45.227367 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Id: a9ef08eba0ef431285fd15a2561b4e5d Nov 01 19:00:45.227367 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Name: tempest-SecurityGroupsTestJSON-1185949800 Nov 01 19:00:45.227367 n-d-863052-2 devstack@n-api.service[121403]: X-Role: member,reader Nov 01 19:00:45.227367 n-d-863052-2 devstack@n-api.service[121403]: X-Roles: member,reader Nov 01 19:00:45.229314 n-d-863052-2 devstack@n-api.service[121403]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/a9ef08eba0ef431285fd15a2561b4e5d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/a9ef08eba0ef431285fd15a2561b4e5d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_a9ef08eba0ef431285fd15a2561b4e5d", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/a9ef08eba0ef431285fd15a2561b4e5d"}]}] Nov 01 19:00:45.229314 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant: tempest-SecurityGroupsTestJSON-1185949800 Nov 01 19:00:45.229314 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant-Id: a9ef08eba0ef431285fd15a2561b4e5d Nov 01 19:00:45.229314 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1185949800 Nov 01 19:00:45.229314 n-d-863052-2 devstack@n-api.service[121403]: X-User: tempest-SecurityGroupsTestJSON-1185949800-project Nov 01 19:00:45.229314 n-d-863052-2 devstack@n-api.service[121403]: X-User-Domain-Id: default Nov 01 19:00:45.229314 n-d-863052-2 devstack@n-api.service[121403]: X-User-Domain-Name: Default Nov 01 19:00:45.229314 n-d-863052-2 devstack@n-api.service[121403]: X-User-Id: 55a9c3b6a8c34f068caa50dc10d13a85 Nov 01 19:00:45.229314 n-d-863052-2 devstack@n-api.service[121403]: X-User-Name: tempest-SecurityGroupsTestJSON-1185949800-project Nov 01 19:00:45.229314 n-d-863052-2 devstack@n-api.service[121403]: method: Nov 01 19:00:45.229314 n-d-863052-2 devstack@n-api.service[121403]: exception: Security group 45ff6218-4674-43d3-a758-cc5740dc9eac does not exist Nov 01 19:00:45.229314 n-d-863052-2 devstack@n-api.service[121403]: Neutron server returns request_ids: ['req-f866b213-faed-49a4-8e05-743ff1fb73db'] Nov 01 19:00:45.229314 n-d-863052-2 devstack@n-api.service[121403]: action_args: {'id': '45ff6218-4674-43d3-a758-cc5740dc9eac'} Nov 01 19:00:45.230554 n-d-863052-2 devstack@n-api.service[121403]: {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 01 19:00:45.230554 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:00:45.230554 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Nov 01 19:00:45.230554 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Nov 01 19:00:45.230554 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 01 19:00:45.230554 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 01 19:00:45.230554 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Nov 01 19:00:45.230554 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Nov 01 19:00:45.230554 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 01 19:00:45.230554 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 01 19:00:45.230554 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 01 19:00:45.230554 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 01 19:00:45.230554 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 01 19:00:45.230554 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 01 19:00:45.230554 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 01 19:00:45.230554 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 01 19:00:45.230554 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 01 19:00:45.230554 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 01 19:00:45.230554 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Nov 01 19:00:45.231862 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Nov 01 19:00:45.231862 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 01 19:00:45.231862 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 01 19:00:45.231862 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Nov 01 19:00:45.231862 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Nov 01 19:00:45.231862 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Nov 01 19:00:45.231862 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Nov 01 19:00:45.231862 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 45ff6218-4674-43d3-a758-cc5740dc9eac does not exist Nov 01 19:00:45.231862 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f866b213-faed-49a4-8e05-743ff1fb73db'] Nov 01 19:00:45.231862 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:00:45.231862 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:00:45.231862 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:00:45.231862 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:00:45.231862 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Nov 01 19:00:45.231862 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Nov 01 19:00:45.231862 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Nov 01 19:00:45.231862 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Nov 01 19:00:45.231862 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 45ff6218-4674-43d3-a758-cc5740dc9eac does not exist Nov 01 19:00:45.233395 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f866b213-faed-49a4-8e05-743ff1fb73db'] Nov 01 19:00:45.233395 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:00:45.233395 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:00:45.233395 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:00:45.233395 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:00:45.233395 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:00:45.233395 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:00:45.233395 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 01 19:00:45.233395 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 01 19:00:45.233395 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 01 19:00:45.233395 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 01 19:00:45.233395 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 01 19:00:45.233395 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 01 19:00:45.233395 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Nov 01 19:00:45.233395 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Nov 01 19:00:45.233395 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 45ff6218-4674-43d3-a758-cc5740dc9eac does not exist Nov 01 19:00:45.233395 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f866b213-faed-49a4-8e05-743ff1fb73db'] Nov 01 19:00:45.233395 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:00:45.233395 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:00:45.233395 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:00:45.233395 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:00:45.234965 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:00:45.234965 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:00:45.234965 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 01 19:00:45.234965 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 01 19:00:45.234965 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 45ff6218-4674-43d3-a758-cc5740dc9eac does not exist Nov 01 19:00:45.234965 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f866b213-faed-49a4-8e05-743ff1fb73db'] Nov 01 19:00:45.234965 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:00:45.234965 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-251ce0da-f2f7-4454-823c-9ff1a31dfe21 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Returning 404 to user: Security group 45ff6218-4674-43d3-a758-cc5740dc9eac does not exist Nov 01 19:00:45.234965 n-d-863052-2 devstack@n-api.service[121403]: Neutron server returns request_ids: ['req-f866b213-faed-49a4-8e05-743ff1fb73db'] {{(pid=121403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 01 19:00:45.234965 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-251ce0da-f2f7-4454-823c-9ff1a31dfe21 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] 10.222.0.13 "DELETE /compute/v2.1/os-security-groups/45ff6218-4674-43d3-a758-cc5740dc9eac" status: 404 len: 194 microversion: 2.1 time: 0.052805 Nov 01 19:00:45.234965 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 916/1848] 10.222.0.13 () {58 vars in 1272 bytes} [Tue Nov 1 19:00:45 2022] DELETE /compute/v2.1/os-security-groups/45ff6218-4674-43d3-a758-cc5740dc9eac => generated 194 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 01 19:00:45.247524 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-b3855c7f-7be2-4c34-b65d-4dcff27e7fa7 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Calling method '.version_select at 0x7f0ae66e9670>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:00:45.282111 n-d-863052-2 devstack@n-api.service[121403]: DEBUG neutronclient.v2_0.client [None req-b3855c7f-7be2-4c34-b65d-4dcff27e7fa7 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 520f4dff-9949-45e0-8c50-c9568059c91c does not exist", "detail": ""}} {{(pid=121403) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Nov 01 19:00:45.282742 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.network.security_group_api [None req-b3855c7f-7be2-4c34-b65d-4dcff27e7fa7 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Neutron security group 520f4dff-9949-45e0-8c50-c9568059c91c not found {{(pid=121403) get /opt/stack/nova/nova/network/security_group_api.py:313}} Nov 01 19:00:45.283270 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.wsgi [None req-b3855c7f-7be2-4c34-b65d-4dcff27e7fa7 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] HTTP exception thrown: Security group 520f4dff-9949-45e0-8c50-c9568059c91c does not exist Nov 01 19:00:45.283270 n-d-863052-2 devstack@n-api.service[121403]: Neutron server returns request_ids: ['req-6bf288a6-9b92-4269-999a-8aac06fcb5f4'] Nov 01 19:00:45.285154 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-b3855c7f-7be2-4c34-b65d-4dcff27e7fa7 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Request method failure captured: Nov 01 19:00:45.285154 n-d-863052-2 devstack@n-api.service[121403]: request: DELETE /compute/v2.1/os-security-groups/520f4dff-9949-45e0-8c50-c9568059c91c HTTP/1.1 Nov 01 19:00:45.285154 n-d-863052-2 devstack@n-api.service[121403]: Accept: application/json Nov 01 19:00:45.285154 n-d-863052-2 devstack@n-api.service[121403]: Accept-Encoding: identity Nov 01 19:00:45.285154 n-d-863052-2 devstack@n-api.service[121403]: Connection: close Nov 01 19:00:45.285154 n-d-863052-2 devstack@n-api.service[121403]: Content-Length: 0 Nov 01 19:00:45.285154 n-d-863052-2 devstack@n-api.service[121403]: Content-Type: application/json Nov 01 19:00:45.285154 n-d-863052-2 devstack@n-api.service[121403]: Host: 10.222.0.13 Nov 01 19:00:45.285154 n-d-863052-2 devstack@n-api.service[121403]: Openstack-System-Scope: None Nov 01 19:00:45.285154 n-d-863052-2 devstack@n-api.service[121403]: User-Agent: python-urllib3/1.26.12 Nov 01 19:00:45.285154 n-d-863052-2 devstack@n-api.service[121403]: X-Auth-Token: gAAAAABjYWyBtiXfeZJIejT83Ksslz2hqDZRAGe29hQVddGupa2qgtVXWeGxqJACkYUk64AE7WNmKMU9sisFWqkZV1B8K0xSz0uDHshwD54pFesORYzaFN_rWLCdcUKPHyx9WACJmd6ZEeb3LBT9WzZa08oHURzA6g0G4BDfSDsuxDk4mdVs9fM Nov 01 19:00:45.285154 n-d-863052-2 devstack@n-api.service[121403]: X-Domain-Id: None Nov 01 19:00:45.285154 n-d-863052-2 devstack@n-api.service[121403]: X-Domain-Name: None Nov 01 19:00:45.285154 n-d-863052-2 devstack@n-api.service[121403]: X-Identity-Status: Confirmed Nov 01 19:00:45.285154 n-d-863052-2 devstack@n-api.service[121403]: X-Is-Admin-Project: True Nov 01 19:00:45.285154 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Domain-Id: default Nov 01 19:00:45.285154 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Domain-Name: Default Nov 01 19:00:45.285154 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Id: a9ef08eba0ef431285fd15a2561b4e5d Nov 01 19:00:45.285154 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Name: tempest-SecurityGroupsTestJSON-1185949800 Nov 01 19:00:45.285154 n-d-863052-2 devstack@n-api.service[121403]: X-Role: member,reader Nov 01 19:00:45.285154 n-d-863052-2 devstack@n-api.service[121403]: X-Roles: member,reader Nov 01 19:00:45.286854 n-d-863052-2 devstack@n-api.service[121403]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/a9ef08eba0ef431285fd15a2561b4e5d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/a9ef08eba0ef431285fd15a2561b4e5d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_a9ef08eba0ef431285fd15a2561b4e5d", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/a9ef08eba0ef431285fd15a2561b4e5d"}]}] Nov 01 19:00:45.286854 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant: tempest-SecurityGroupsTestJSON-1185949800 Nov 01 19:00:45.286854 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant-Id: a9ef08eba0ef431285fd15a2561b4e5d Nov 01 19:00:45.286854 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1185949800 Nov 01 19:00:45.286854 n-d-863052-2 devstack@n-api.service[121403]: X-User: tempest-SecurityGroupsTestJSON-1185949800-project Nov 01 19:00:45.286854 n-d-863052-2 devstack@n-api.service[121403]: X-User-Domain-Id: default Nov 01 19:00:45.286854 n-d-863052-2 devstack@n-api.service[121403]: X-User-Domain-Name: Default Nov 01 19:00:45.286854 n-d-863052-2 devstack@n-api.service[121403]: X-User-Id: 55a9c3b6a8c34f068caa50dc10d13a85 Nov 01 19:00:45.286854 n-d-863052-2 devstack@n-api.service[121403]: X-User-Name: tempest-SecurityGroupsTestJSON-1185949800-project Nov 01 19:00:45.286854 n-d-863052-2 devstack@n-api.service[121403]: method: Nov 01 19:00:45.286854 n-d-863052-2 devstack@n-api.service[121403]: exception: Security group 520f4dff-9949-45e0-8c50-c9568059c91c does not exist Nov 01 19:00:45.286854 n-d-863052-2 devstack@n-api.service[121403]: Neutron server returns request_ids: ['req-6bf288a6-9b92-4269-999a-8aac06fcb5f4'] Nov 01 19:00:45.286854 n-d-863052-2 devstack@n-api.service[121403]: action_args: {'id': '520f4dff-9949-45e0-8c50-c9568059c91c'} Nov 01 19:00:45.288012 n-d-863052-2 devstack@n-api.service[121403]: {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 01 19:00:45.288012 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:00:45.288012 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Nov 01 19:00:45.288012 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Nov 01 19:00:45.288012 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 01 19:00:45.288012 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 01 19:00:45.288012 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Nov 01 19:00:45.288012 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Nov 01 19:00:45.288012 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 01 19:00:45.288012 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 01 19:00:45.288012 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 01 19:00:45.288012 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 01 19:00:45.288012 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 01 19:00:45.288012 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 01 19:00:45.288012 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 01 19:00:45.288012 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 01 19:00:45.288012 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 01 19:00:45.288012 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 01 19:00:45.288012 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Nov 01 19:00:45.291048 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Nov 01 19:00:45.291048 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 01 19:00:45.291048 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 01 19:00:45.291048 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Nov 01 19:00:45.291048 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Nov 01 19:00:45.291048 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Nov 01 19:00:45.291048 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Nov 01 19:00:45.291048 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 520f4dff-9949-45e0-8c50-c9568059c91c does not exist Nov 01 19:00:45.291048 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6bf288a6-9b92-4269-999a-8aac06fcb5f4'] Nov 01 19:00:45.291048 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:00:45.291048 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:00:45.291048 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:00:45.291048 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:00:45.291048 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Nov 01 19:00:45.291048 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Nov 01 19:00:45.291048 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Nov 01 19:00:45.291048 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Nov 01 19:00:45.291048 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 520f4dff-9949-45e0-8c50-c9568059c91c does not exist Nov 01 19:00:45.296263 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6bf288a6-9b92-4269-999a-8aac06fcb5f4'] Nov 01 19:00:45.296263 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:00:45.296263 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:00:45.296263 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:00:45.296263 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:00:45.296263 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:00:45.296263 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:00:45.296263 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 01 19:00:45.296263 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 01 19:00:45.296263 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 01 19:00:45.296263 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 01 19:00:45.296263 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 01 19:00:45.296263 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 01 19:00:45.296263 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Nov 01 19:00:45.296263 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Nov 01 19:00:45.296263 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 520f4dff-9949-45e0-8c50-c9568059c91c does not exist Nov 01 19:00:45.296263 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6bf288a6-9b92-4269-999a-8aac06fcb5f4'] Nov 01 19:00:45.296263 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:00:45.296263 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:00:45.296263 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:00:45.296263 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:00:45.299634 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:00:45.299634 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:00:45.299634 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 01 19:00:45.299634 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 01 19:00:45.299634 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 520f4dff-9949-45e0-8c50-c9568059c91c does not exist Nov 01 19:00:45.299634 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6bf288a6-9b92-4269-999a-8aac06fcb5f4'] Nov 01 19:00:45.299634 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:00:45.299634 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-b3855c7f-7be2-4c34-b65d-4dcff27e7fa7 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Returning 404 to user: Security group 520f4dff-9949-45e0-8c50-c9568059c91c does not exist Nov 01 19:00:45.299634 n-d-863052-2 devstack@n-api.service[121403]: Neutron server returns request_ids: ['req-6bf288a6-9b92-4269-999a-8aac06fcb5f4'] {{(pid=121403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 01 19:00:45.299634 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-b3855c7f-7be2-4c34-b65d-4dcff27e7fa7 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] 10.222.0.13 "DELETE /compute/v2.1/os-security-groups/520f4dff-9949-45e0-8c50-c9568059c91c" status: 404 len: 194 microversion: 2.1 time: 0.044319 Nov 01 19:00:45.299634 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 917/1849] 10.222.0.13 () {58 vars in 1272 bytes} [Tue Nov 1 19:00:45 2022] DELETE /compute/v2.1/os-security-groups/520f4dff-9949-45e0-8c50-c9568059c91c => generated 194 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 01 19:00:45.301869 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-41611371-cbb3-44d4-97da-1cadb502d0d2 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:00:45.301869 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-41611371-cbb3-44d4-97da-1cadb502d0d2 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] [instance: cd879708-f757-4f88-bc95-38b6cd55363c] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:00:45.306134 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-41611371-cbb3-44d4-97da-1cadb502d0d2 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:45.306630 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-41611371-cbb3-44d4-97da-1cadb502d0d2 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:45.307072 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-41611371-cbb3-44d4-97da-1cadb502d0d2 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:45.307814 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-41611371-cbb3-44d4-97da-1cadb502d0d2 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:45.308356 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-41611371-cbb3-44d4-97da-1cadb502d0d2 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:45.308871 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-41611371-cbb3-44d4-97da-1cadb502d0d2 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:45.377707 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-41611371-cbb3-44d4-97da-1cadb502d0d2 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:00:45.388493 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-41611371-cbb3-44d4-97da-1cadb502d0d2 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:00:45.389989 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-41611371-cbb3-44d4-97da-1cadb502d0d2 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:00:45.391611 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-41611371-cbb3-44d4-97da-1cadb502d0d2 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] 10.222.0.13 "GET /compute/v2.1/servers/cd879708-f757-4f88-bc95-38b6cd55363c" status: 200 len: 1185 microversion: 2.25 time: 0.100821 Nov 01 19:00:45.392256 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 918/1850] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 19:00:45 2022] GET /compute/v2.1/servers/cd879708-f757-4f88-bc95-38b6cd55363c => generated 1185 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 19:00:45.398330 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-687a69d6-a2b1-408e-8d5c-5103b03037e2 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Calling method '.version_select at 0x7f0ae2864820>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:00:45.425967 n-d-863052-2 devstack@n-api.service[121403]: DEBUG neutronclient.v2_0.client [None req-687a69d6-a2b1-408e-8d5c-5103b03037e2 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group c1b41ef2-7c6f-4327-8e1d-4ef5e045c3e3 does not exist", "detail": ""}} {{(pid=121403) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Nov 01 19:00:45.426256 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.network.security_group_api [None req-687a69d6-a2b1-408e-8d5c-5103b03037e2 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Neutron security group c1b41ef2-7c6f-4327-8e1d-4ef5e045c3e3 not found {{(pid=121403) get /opt/stack/nova/nova/network/security_group_api.py:313}} Nov 01 19:00:45.426907 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.wsgi [None req-687a69d6-a2b1-408e-8d5c-5103b03037e2 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] HTTP exception thrown: Security group c1b41ef2-7c6f-4327-8e1d-4ef5e045c3e3 does not exist Nov 01 19:00:45.426907 n-d-863052-2 devstack@n-api.service[121403]: Neutron server returns request_ids: ['req-59567b32-edb4-4b95-93bf-f194248a9ec9'] Nov 01 19:00:45.428794 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-687a69d6-a2b1-408e-8d5c-5103b03037e2 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Request method failure captured: Nov 01 19:00:45.428794 n-d-863052-2 devstack@n-api.service[121403]: request: DELETE /compute/v2.1/os-security-groups/c1b41ef2-7c6f-4327-8e1d-4ef5e045c3e3 HTTP/1.1 Nov 01 19:00:45.428794 n-d-863052-2 devstack@n-api.service[121403]: Accept: application/json Nov 01 19:00:45.428794 n-d-863052-2 devstack@n-api.service[121403]: Accept-Encoding: identity Nov 01 19:00:45.428794 n-d-863052-2 devstack@n-api.service[121403]: Connection: close Nov 01 19:00:45.428794 n-d-863052-2 devstack@n-api.service[121403]: Content-Length: 0 Nov 01 19:00:45.428794 n-d-863052-2 devstack@n-api.service[121403]: Content-Type: application/json Nov 01 19:00:45.428794 n-d-863052-2 devstack@n-api.service[121403]: Host: 10.222.0.13 Nov 01 19:00:45.428794 n-d-863052-2 devstack@n-api.service[121403]: Openstack-System-Scope: None Nov 01 19:00:45.428794 n-d-863052-2 devstack@n-api.service[121403]: User-Agent: python-urllib3/1.26.12 Nov 01 19:00:45.428794 n-d-863052-2 devstack@n-api.service[121403]: X-Auth-Token: gAAAAABjYWyBtiXfeZJIejT83Ksslz2hqDZRAGe29hQVddGupa2qgtVXWeGxqJACkYUk64AE7WNmKMU9sisFWqkZV1B8K0xSz0uDHshwD54pFesORYzaFN_rWLCdcUKPHyx9WACJmd6ZEeb3LBT9WzZa08oHURzA6g0G4BDfSDsuxDk4mdVs9fM Nov 01 19:00:45.428794 n-d-863052-2 devstack@n-api.service[121403]: X-Domain-Id: None Nov 01 19:00:45.428794 n-d-863052-2 devstack@n-api.service[121403]: X-Domain-Name: None Nov 01 19:00:45.428794 n-d-863052-2 devstack@n-api.service[121403]: X-Identity-Status: Confirmed Nov 01 19:00:45.428794 n-d-863052-2 devstack@n-api.service[121403]: X-Is-Admin-Project: True Nov 01 19:00:45.428794 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Domain-Id: default Nov 01 19:00:45.428794 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Domain-Name: Default Nov 01 19:00:45.428794 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Id: a9ef08eba0ef431285fd15a2561b4e5d Nov 01 19:00:45.428794 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Name: tempest-SecurityGroupsTestJSON-1185949800 Nov 01 19:00:45.428794 n-d-863052-2 devstack@n-api.service[121403]: X-Role: member,reader Nov 01 19:00:45.428794 n-d-863052-2 devstack@n-api.service[121403]: X-Roles: member,reader Nov 01 19:00:45.430553 n-d-863052-2 devstack@n-api.service[121403]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/a9ef08eba0ef431285fd15a2561b4e5d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/a9ef08eba0ef431285fd15a2561b4e5d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_a9ef08eba0ef431285fd15a2561b4e5d", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/a9ef08eba0ef431285fd15a2561b4e5d"}]}] Nov 01 19:00:45.430553 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant: tempest-SecurityGroupsTestJSON-1185949800 Nov 01 19:00:45.430553 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant-Id: a9ef08eba0ef431285fd15a2561b4e5d Nov 01 19:00:45.430553 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1185949800 Nov 01 19:00:45.430553 n-d-863052-2 devstack@n-api.service[121403]: X-User: tempest-SecurityGroupsTestJSON-1185949800-project Nov 01 19:00:45.430553 n-d-863052-2 devstack@n-api.service[121403]: X-User-Domain-Id: default Nov 01 19:00:45.430553 n-d-863052-2 devstack@n-api.service[121403]: X-User-Domain-Name: Default Nov 01 19:00:45.430553 n-d-863052-2 devstack@n-api.service[121403]: X-User-Id: 55a9c3b6a8c34f068caa50dc10d13a85 Nov 01 19:00:45.430553 n-d-863052-2 devstack@n-api.service[121403]: X-User-Name: tempest-SecurityGroupsTestJSON-1185949800-project Nov 01 19:00:45.430553 n-d-863052-2 devstack@n-api.service[121403]: method: Nov 01 19:00:45.430553 n-d-863052-2 devstack@n-api.service[121403]: exception: Security group c1b41ef2-7c6f-4327-8e1d-4ef5e045c3e3 does not exist Nov 01 19:00:45.430553 n-d-863052-2 devstack@n-api.service[121403]: Neutron server returns request_ids: ['req-59567b32-edb4-4b95-93bf-f194248a9ec9'] Nov 01 19:00:45.430553 n-d-863052-2 devstack@n-api.service[121403]: action_args: {'id': 'c1b41ef2-7c6f-4327-8e1d-4ef5e045c3e3'} Nov 01 19:00:45.434888 n-d-863052-2 devstack@n-api.service[121403]: {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 01 19:00:45.434888 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:00:45.434888 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Nov 01 19:00:45.434888 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Nov 01 19:00:45.434888 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 01 19:00:45.434888 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 01 19:00:45.434888 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Nov 01 19:00:45.434888 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Nov 01 19:00:45.434888 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 01 19:00:45.434888 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 01 19:00:45.434888 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 01 19:00:45.434888 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 01 19:00:45.434888 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 01 19:00:45.434888 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 01 19:00:45.434888 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 01 19:00:45.434888 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 01 19:00:45.434888 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 01 19:00:45.434888 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 01 19:00:45.434888 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Nov 01 19:00:45.436430 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Nov 01 19:00:45.436430 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 01 19:00:45.436430 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 01 19:00:45.436430 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Nov 01 19:00:45.436430 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Nov 01 19:00:45.436430 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Nov 01 19:00:45.436430 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Nov 01 19:00:45.436430 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group c1b41ef2-7c6f-4327-8e1d-4ef5e045c3e3 does not exist Nov 01 19:00:45.436430 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-59567b32-edb4-4b95-93bf-f194248a9ec9'] Nov 01 19:00:45.436430 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:00:45.436430 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:00:45.436430 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:00:45.436430 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:00:45.436430 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Nov 01 19:00:45.436430 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Nov 01 19:00:45.436430 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Nov 01 19:00:45.436430 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Nov 01 19:00:45.436430 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group c1b41ef2-7c6f-4327-8e1d-4ef5e045c3e3 does not exist Nov 01 19:00:45.438224 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-59567b32-edb4-4b95-93bf-f194248a9ec9'] Nov 01 19:00:45.438224 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:00:45.438224 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:00:45.438224 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:00:45.438224 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:00:45.438224 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:00:45.438224 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:00:45.438224 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 01 19:00:45.438224 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 01 19:00:45.438224 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 01 19:00:45.438224 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 01 19:00:45.438224 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 01 19:00:45.438224 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 01 19:00:45.438224 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Nov 01 19:00:45.438224 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Nov 01 19:00:45.438224 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group c1b41ef2-7c6f-4327-8e1d-4ef5e045c3e3 does not exist Nov 01 19:00:45.438224 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-59567b32-edb4-4b95-93bf-f194248a9ec9'] Nov 01 19:00:45.438224 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:00:45.438224 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:00:45.438224 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:00:45.438224 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:00:45.439802 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:00:45.439802 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:00:45.439802 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 01 19:00:45.439802 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 01 19:00:45.439802 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group c1b41ef2-7c6f-4327-8e1d-4ef5e045c3e3 does not exist Nov 01 19:00:45.439802 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-59567b32-edb4-4b95-93bf-f194248a9ec9'] Nov 01 19:00:45.439802 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:00:45.439802 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-687a69d6-a2b1-408e-8d5c-5103b03037e2 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Returning 404 to user: Security group c1b41ef2-7c6f-4327-8e1d-4ef5e045c3e3 does not exist Nov 01 19:00:45.439802 n-d-863052-2 devstack@n-api.service[121403]: Neutron server returns request_ids: ['req-59567b32-edb4-4b95-93bf-f194248a9ec9'] {{(pid=121403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 01 19:00:45.439802 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-687a69d6-a2b1-408e-8d5c-5103b03037e2 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] 10.222.0.13 "DELETE /compute/v2.1/os-security-groups/c1b41ef2-7c6f-4327-8e1d-4ef5e045c3e3" status: 404 len: 194 microversion: 2.1 time: 0.036273 Nov 01 19:00:45.439802 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 919/1851] 10.222.0.13 () {58 vars in 1272 bytes} [Tue Nov 1 19:00:45 2022] DELETE /compute/v2.1/os-security-groups/c1b41ef2-7c6f-4327-8e1d-4ef5e045c3e3 => generated 194 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 01 19:00:45.440671 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-e8116e3e-8e68-41f9-a631-30ef03e5999f tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:00:45.440671 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-e8116e3e-8e68-41f9-a631-30ef03e5999f tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] [instance: 7218f99b-b011-4f08-931e-340d47069f6e] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:00:45.444507 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-e8116e3e-8e68-41f9-a631-30ef03e5999f tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:45.445277 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-e8116e3e-8e68-41f9-a631-30ef03e5999f tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:45.445445 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-e8116e3e-8e68-41f9-a631-30ef03e5999f tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:45.446150 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-e8116e3e-8e68-41f9-a631-30ef03e5999f tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:45.446837 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-e8116e3e-8e68-41f9-a631-30ef03e5999f tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:45.447019 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-e8116e3e-8e68-41f9-a631-30ef03e5999f tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:45.601360 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-e8116e3e-8e68-41f9-a631-30ef03e5999f tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72117f17294649d6b8bc16c66c7efab2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45d4c047d3c44324a27a27831236ab0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:00:45.609634 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-e8116e3e-8e68-41f9-a631-30ef03e5999f tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] 10.222.0.13 "GET /compute/v2.1/servers/7218f99b-b011-4f08-931e-340d47069f6e" status: 200 len: 1468 microversion: 2.1 time: 0.177465 Nov 01 19:00:45.610406 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 920/1852] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:00:45 2022] GET /compute/v2.1/servers/7218f99b-b011-4f08-931e-340d47069f6e => generated 1468 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:00:45.616177 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-332e20d5-ce1a-427d-bbf5-02df6d6b45d5 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Calling method '.version_select at 0x7f0ae293f820>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:00:45.644241 n-d-863052-2 devstack@n-api.service[121403]: DEBUG neutronclient.v2_0.client [None req-332e20d5-ce1a-427d-bbf5-02df6d6b45d5 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 29c1bc9c-328a-4b78-80f4-40bd047ae4d7 does not exist", "detail": ""}} {{(pid=121403) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Nov 01 19:00:45.645186 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.network.security_group_api [None req-332e20d5-ce1a-427d-bbf5-02df6d6b45d5 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Neutron security group 29c1bc9c-328a-4b78-80f4-40bd047ae4d7 not found {{(pid=121403) get /opt/stack/nova/nova/network/security_group_api.py:313}} Nov 01 19:00:45.645805 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.wsgi [None req-332e20d5-ce1a-427d-bbf5-02df6d6b45d5 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] HTTP exception thrown: Security group 29c1bc9c-328a-4b78-80f4-40bd047ae4d7 does not exist Nov 01 19:00:45.645805 n-d-863052-2 devstack@n-api.service[121403]: Neutron server returns request_ids: ['req-248005c6-7092-484a-ab5c-0171aa00e7fc'] Nov 01 19:00:45.647941 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-332e20d5-ce1a-427d-bbf5-02df6d6b45d5 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Request method failure captured: Nov 01 19:00:45.647941 n-d-863052-2 devstack@n-api.service[121403]: request: DELETE /compute/v2.1/os-security-groups/29c1bc9c-328a-4b78-80f4-40bd047ae4d7 HTTP/1.1 Nov 01 19:00:45.647941 n-d-863052-2 devstack@n-api.service[121403]: Accept: application/json Nov 01 19:00:45.647941 n-d-863052-2 devstack@n-api.service[121403]: Accept-Encoding: identity Nov 01 19:00:45.647941 n-d-863052-2 devstack@n-api.service[121403]: Connection: close Nov 01 19:00:45.647941 n-d-863052-2 devstack@n-api.service[121403]: Content-Length: 0 Nov 01 19:00:45.647941 n-d-863052-2 devstack@n-api.service[121403]: Content-Type: application/json Nov 01 19:00:45.647941 n-d-863052-2 devstack@n-api.service[121403]: Host: 10.222.0.13 Nov 01 19:00:45.647941 n-d-863052-2 devstack@n-api.service[121403]: Openstack-System-Scope: None Nov 01 19:00:45.647941 n-d-863052-2 devstack@n-api.service[121403]: User-Agent: python-urllib3/1.26.12 Nov 01 19:00:45.647941 n-d-863052-2 devstack@n-api.service[121403]: X-Auth-Token: gAAAAABjYWyBtiXfeZJIejT83Ksslz2hqDZRAGe29hQVddGupa2qgtVXWeGxqJACkYUk64AE7WNmKMU9sisFWqkZV1B8K0xSz0uDHshwD54pFesORYzaFN_rWLCdcUKPHyx9WACJmd6ZEeb3LBT9WzZa08oHURzA6g0G4BDfSDsuxDk4mdVs9fM Nov 01 19:00:45.647941 n-d-863052-2 devstack@n-api.service[121403]: X-Domain-Id: None Nov 01 19:00:45.647941 n-d-863052-2 devstack@n-api.service[121403]: X-Domain-Name: None Nov 01 19:00:45.647941 n-d-863052-2 devstack@n-api.service[121403]: X-Identity-Status: Confirmed Nov 01 19:00:45.647941 n-d-863052-2 devstack@n-api.service[121403]: X-Is-Admin-Project: True Nov 01 19:00:45.647941 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Domain-Id: default Nov 01 19:00:45.647941 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Domain-Name: Default Nov 01 19:00:45.647941 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Id: a9ef08eba0ef431285fd15a2561b4e5d Nov 01 19:00:45.647941 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Name: tempest-SecurityGroupsTestJSON-1185949800 Nov 01 19:00:45.647941 n-d-863052-2 devstack@n-api.service[121403]: X-Role: member,reader Nov 01 19:00:45.647941 n-d-863052-2 devstack@n-api.service[121403]: X-Roles: member,reader Nov 01 19:00:45.649648 n-d-863052-2 devstack@n-api.service[121403]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/a9ef08eba0ef431285fd15a2561b4e5d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/a9ef08eba0ef431285fd15a2561b4e5d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_a9ef08eba0ef431285fd15a2561b4e5d", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/a9ef08eba0ef431285fd15a2561b4e5d"}]}] Nov 01 19:00:45.649648 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant: tempest-SecurityGroupsTestJSON-1185949800 Nov 01 19:00:45.649648 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant-Id: a9ef08eba0ef431285fd15a2561b4e5d Nov 01 19:00:45.649648 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1185949800 Nov 01 19:00:45.649648 n-d-863052-2 devstack@n-api.service[121403]: X-User: tempest-SecurityGroupsTestJSON-1185949800-project Nov 01 19:00:45.649648 n-d-863052-2 devstack@n-api.service[121403]: X-User-Domain-Id: default Nov 01 19:00:45.649648 n-d-863052-2 devstack@n-api.service[121403]: X-User-Domain-Name: Default Nov 01 19:00:45.649648 n-d-863052-2 devstack@n-api.service[121403]: X-User-Id: 55a9c3b6a8c34f068caa50dc10d13a85 Nov 01 19:00:45.649648 n-d-863052-2 devstack@n-api.service[121403]: X-User-Name: tempest-SecurityGroupsTestJSON-1185949800-project Nov 01 19:00:45.649648 n-d-863052-2 devstack@n-api.service[121403]: method: Nov 01 19:00:45.649648 n-d-863052-2 devstack@n-api.service[121403]: exception: Security group 29c1bc9c-328a-4b78-80f4-40bd047ae4d7 does not exist Nov 01 19:00:45.649648 n-d-863052-2 devstack@n-api.service[121403]: Neutron server returns request_ids: ['req-248005c6-7092-484a-ab5c-0171aa00e7fc'] Nov 01 19:00:45.649648 n-d-863052-2 devstack@n-api.service[121403]: action_args: {'id': '29c1bc9c-328a-4b78-80f4-40bd047ae4d7'} Nov 01 19:00:45.650555 n-d-863052-2 devstack@n-api.service[121403]: {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 01 19:00:45.650555 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:00:45.650555 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Nov 01 19:00:45.650555 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Nov 01 19:00:45.650555 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 01 19:00:45.650555 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 01 19:00:45.650555 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Nov 01 19:00:45.650555 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Nov 01 19:00:45.650555 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 01 19:00:45.650555 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 01 19:00:45.650555 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 01 19:00:45.650555 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 01 19:00:45.650555 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 01 19:00:45.650555 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 01 19:00:45.650555 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 01 19:00:45.650555 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 01 19:00:45.650555 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 01 19:00:45.650555 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 01 19:00:45.650555 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Nov 01 19:00:45.652395 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Nov 01 19:00:45.652395 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 01 19:00:45.652395 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 01 19:00:45.652395 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Nov 01 19:00:45.652395 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Nov 01 19:00:45.652395 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Nov 01 19:00:45.652395 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Nov 01 19:00:45.652395 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 29c1bc9c-328a-4b78-80f4-40bd047ae4d7 does not exist Nov 01 19:00:45.652395 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-248005c6-7092-484a-ab5c-0171aa00e7fc'] Nov 01 19:00:45.652395 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:00:45.652395 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:00:45.652395 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:00:45.652395 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:00:45.652395 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Nov 01 19:00:45.652395 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Nov 01 19:00:45.652395 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Nov 01 19:00:45.652395 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Nov 01 19:00:45.652395 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 29c1bc9c-328a-4b78-80f4-40bd047ae4d7 does not exist Nov 01 19:00:45.653654 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-248005c6-7092-484a-ab5c-0171aa00e7fc'] Nov 01 19:00:45.653654 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:00:45.653654 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:00:45.653654 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:00:45.653654 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:00:45.653654 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:00:45.653654 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:00:45.653654 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 01 19:00:45.653654 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 01 19:00:45.653654 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 01 19:00:45.653654 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 01 19:00:45.653654 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 01 19:00:45.653654 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 01 19:00:45.653654 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Nov 01 19:00:45.653654 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Nov 01 19:00:45.653654 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 29c1bc9c-328a-4b78-80f4-40bd047ae4d7 does not exist Nov 01 19:00:45.653654 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-248005c6-7092-484a-ab5c-0171aa00e7fc'] Nov 01 19:00:45.653654 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:00:45.653654 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:00:45.653654 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:00:45.653654 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:00:45.655147 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:00:45.655147 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:00:45.655147 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 01 19:00:45.655147 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 01 19:00:45.655147 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 29c1bc9c-328a-4b78-80f4-40bd047ae4d7 does not exist Nov 01 19:00:45.655147 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-248005c6-7092-484a-ab5c-0171aa00e7fc'] Nov 01 19:00:45.655147 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:00:45.655147 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-332e20d5-ce1a-427d-bbf5-02df6d6b45d5 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Returning 404 to user: Security group 29c1bc9c-328a-4b78-80f4-40bd047ae4d7 does not exist Nov 01 19:00:45.655147 n-d-863052-2 devstack@n-api.service[121403]: Neutron server returns request_ids: ['req-248005c6-7092-484a-ab5c-0171aa00e7fc'] {{(pid=121403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 01 19:00:45.655147 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-332e20d5-ce1a-427d-bbf5-02df6d6b45d5 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] 10.222.0.13 "DELETE /compute/v2.1/os-security-groups/29c1bc9c-328a-4b78-80f4-40bd047ae4d7" status: 404 len: 194 microversion: 2.1 time: 0.037889 Nov 01 19:00:45.655147 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 921/1853] 10.222.0.13 () {58 vars in 1272 bytes} [Tue Nov 1 19:00:45 2022] DELETE /compute/v2.1/os-security-groups/29c1bc9c-328a-4b78-80f4-40bd047ae4d7 => generated 194 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 01 19:00:45.655910 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-c333ca8e-98d6-44ed-b168-9ff704622b48 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:00:45.656656 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-c333ca8e-98d6-44ed-b168-9ff704622b48 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] [instance: f35d5fdd-4a95-4b57-a506-665fa3f393c1] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:00:45.668200 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-c333ca8e-98d6-44ed-b168-9ff704622b48 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:45.668721 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-c333ca8e-98d6-44ed-b168-9ff704622b48 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:45.669166 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-c333ca8e-98d6-44ed-b168-9ff704622b48 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:45.669873 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-c333ca8e-98d6-44ed-b168-9ff704622b48 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:45.670333 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-c333ca8e-98d6-44ed-b168-9ff704622b48 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:45.670763 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-c333ca8e-98d6-44ed-b168-9ff704622b48 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:45.812903 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-c333ca8e-98d6-44ed-b168-9ff704622b48 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0290a6bb8bc24b8988a925327ac0381c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86941784237549838bba63ce88053b88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:00:45.823020 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-c333ca8e-98d6-44ed-b168-9ff704622b48 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] 10.222.0.13 "GET /compute/v2.1/servers/f35d5fdd-4a95-4b57-a506-665fa3f393c1" status: 200 len: 1473 microversion: 2.1 time: 0.172065 Nov 01 19:00:45.823701 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 922/1854] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:00:45 2022] GET /compute/v2.1/servers/f35d5fdd-4a95-4b57-a506-665fa3f393c1 => generated 1473 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:00:45.828522 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-3fcbce05-9808-478c-ad68-8a0b1bd5b682 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Calling method '.version_select at 0x7f0ae293f820>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:00:45.859754 n-d-863052-2 devstack@n-api.service[121403]: DEBUG neutronclient.v2_0.client [None req-3fcbce05-9808-478c-ad68-8a0b1bd5b682 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 3ac82755-05f3-40fb-874c-63e687518273 does not exist", "detail": ""}} {{(pid=121403) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Nov 01 19:00:45.860351 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.network.security_group_api [None req-3fcbce05-9808-478c-ad68-8a0b1bd5b682 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Neutron security group 3ac82755-05f3-40fb-874c-63e687518273 not found {{(pid=121403) get /opt/stack/nova/nova/network/security_group_api.py:313}} Nov 01 19:00:45.861052 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.wsgi [None req-3fcbce05-9808-478c-ad68-8a0b1bd5b682 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] HTTP exception thrown: Security group 3ac82755-05f3-40fb-874c-63e687518273 does not exist Nov 01 19:00:45.861052 n-d-863052-2 devstack@n-api.service[121403]: Neutron server returns request_ids: ['req-353fa643-2cc1-4019-a871-4c9a9ddaa03d'] Nov 01 19:00:45.864095 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-3fcbce05-9808-478c-ad68-8a0b1bd5b682 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Request method failure captured: Nov 01 19:00:45.864095 n-d-863052-2 devstack@n-api.service[121403]: request: DELETE /compute/v2.1/os-security-groups/3ac82755-05f3-40fb-874c-63e687518273 HTTP/1.1 Nov 01 19:00:45.864095 n-d-863052-2 devstack@n-api.service[121403]: Accept: application/json Nov 01 19:00:45.864095 n-d-863052-2 devstack@n-api.service[121403]: Accept-Encoding: identity Nov 01 19:00:45.864095 n-d-863052-2 devstack@n-api.service[121403]: Connection: close Nov 01 19:00:45.864095 n-d-863052-2 devstack@n-api.service[121403]: Content-Length: 0 Nov 01 19:00:45.864095 n-d-863052-2 devstack@n-api.service[121403]: Content-Type: application/json Nov 01 19:00:45.864095 n-d-863052-2 devstack@n-api.service[121403]: Host: 10.222.0.13 Nov 01 19:00:45.864095 n-d-863052-2 devstack@n-api.service[121403]: Openstack-System-Scope: None Nov 01 19:00:45.864095 n-d-863052-2 devstack@n-api.service[121403]: User-Agent: python-urllib3/1.26.12 Nov 01 19:00:45.864095 n-d-863052-2 devstack@n-api.service[121403]: X-Auth-Token: gAAAAABjYWyBtiXfeZJIejT83Ksslz2hqDZRAGe29hQVddGupa2qgtVXWeGxqJACkYUk64AE7WNmKMU9sisFWqkZV1B8K0xSz0uDHshwD54pFesORYzaFN_rWLCdcUKPHyx9WACJmd6ZEeb3LBT9WzZa08oHURzA6g0G4BDfSDsuxDk4mdVs9fM Nov 01 19:00:45.864095 n-d-863052-2 devstack@n-api.service[121403]: X-Domain-Id: None Nov 01 19:00:45.864095 n-d-863052-2 devstack@n-api.service[121403]: X-Domain-Name: None Nov 01 19:00:45.864095 n-d-863052-2 devstack@n-api.service[121403]: X-Identity-Status: Confirmed Nov 01 19:00:45.864095 n-d-863052-2 devstack@n-api.service[121403]: X-Is-Admin-Project: True Nov 01 19:00:45.864095 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Domain-Id: default Nov 01 19:00:45.864095 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Domain-Name: Default Nov 01 19:00:45.864095 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Id: a9ef08eba0ef431285fd15a2561b4e5d Nov 01 19:00:45.864095 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Name: tempest-SecurityGroupsTestJSON-1185949800 Nov 01 19:00:45.864095 n-d-863052-2 devstack@n-api.service[121403]: X-Role: member,reader Nov 01 19:00:45.864095 n-d-863052-2 devstack@n-api.service[121403]: X-Roles: member,reader Nov 01 19:00:45.865837 n-d-863052-2 devstack@n-api.service[121403]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/a9ef08eba0ef431285fd15a2561b4e5d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/a9ef08eba0ef431285fd15a2561b4e5d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_a9ef08eba0ef431285fd15a2561b4e5d", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/a9ef08eba0ef431285fd15a2561b4e5d"}]}] Nov 01 19:00:45.865837 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant: tempest-SecurityGroupsTestJSON-1185949800 Nov 01 19:00:45.865837 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant-Id: a9ef08eba0ef431285fd15a2561b4e5d Nov 01 19:00:45.865837 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1185949800 Nov 01 19:00:45.865837 n-d-863052-2 devstack@n-api.service[121403]: X-User: tempest-SecurityGroupsTestJSON-1185949800-project Nov 01 19:00:45.865837 n-d-863052-2 devstack@n-api.service[121403]: X-User-Domain-Id: default Nov 01 19:00:45.865837 n-d-863052-2 devstack@n-api.service[121403]: X-User-Domain-Name: Default Nov 01 19:00:45.865837 n-d-863052-2 devstack@n-api.service[121403]: X-User-Id: 55a9c3b6a8c34f068caa50dc10d13a85 Nov 01 19:00:45.865837 n-d-863052-2 devstack@n-api.service[121403]: X-User-Name: tempest-SecurityGroupsTestJSON-1185949800-project Nov 01 19:00:45.865837 n-d-863052-2 devstack@n-api.service[121403]: method: Nov 01 19:00:45.865837 n-d-863052-2 devstack@n-api.service[121403]: exception: Security group 3ac82755-05f3-40fb-874c-63e687518273 does not exist Nov 01 19:00:45.865837 n-d-863052-2 devstack@n-api.service[121403]: Neutron server returns request_ids: ['req-353fa643-2cc1-4019-a871-4c9a9ddaa03d'] Nov 01 19:00:45.865837 n-d-863052-2 devstack@n-api.service[121403]: action_args: {'id': '3ac82755-05f3-40fb-874c-63e687518273'} Nov 01 19:00:45.866767 n-d-863052-2 devstack@n-api.service[121403]: {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 01 19:00:45.866767 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:00:45.866767 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Nov 01 19:00:45.866767 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Nov 01 19:00:45.866767 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 01 19:00:45.866767 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 01 19:00:45.866767 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Nov 01 19:00:45.866767 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Nov 01 19:00:45.866767 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 01 19:00:45.866767 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 01 19:00:45.866767 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 01 19:00:45.866767 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 01 19:00:45.866767 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 01 19:00:45.866767 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 01 19:00:45.866767 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 01 19:00:45.866767 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 01 19:00:45.866767 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 01 19:00:45.866767 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 01 19:00:45.866767 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Nov 01 19:00:45.868064 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Nov 01 19:00:45.868064 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 01 19:00:45.868064 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 01 19:00:45.868064 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Nov 01 19:00:45.868064 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Nov 01 19:00:45.868064 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Nov 01 19:00:45.868064 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Nov 01 19:00:45.868064 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 3ac82755-05f3-40fb-874c-63e687518273 does not exist Nov 01 19:00:45.868064 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-353fa643-2cc1-4019-a871-4c9a9ddaa03d'] Nov 01 19:00:45.868064 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:00:45.868064 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:00:45.868064 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:00:45.868064 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:00:45.868064 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Nov 01 19:00:45.868064 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Nov 01 19:00:45.868064 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Nov 01 19:00:45.868064 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Nov 01 19:00:45.868064 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 3ac82755-05f3-40fb-874c-63e687518273 does not exist Nov 01 19:00:45.872840 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-353fa643-2cc1-4019-a871-4c9a9ddaa03d'] Nov 01 19:00:45.872840 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:00:45.872840 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:00:45.872840 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:00:45.872840 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:00:45.872840 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:00:45.872840 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:00:45.872840 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 01 19:00:45.872840 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 01 19:00:45.872840 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 01 19:00:45.872840 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 01 19:00:45.872840 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 01 19:00:45.872840 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 01 19:00:45.872840 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Nov 01 19:00:45.872840 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Nov 01 19:00:45.872840 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 3ac82755-05f3-40fb-874c-63e687518273 does not exist Nov 01 19:00:45.872840 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-353fa643-2cc1-4019-a871-4c9a9ddaa03d'] Nov 01 19:00:45.872840 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:00:45.872840 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:00:45.872840 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:00:45.872840 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:00:45.874781 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:00:45.874781 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:00:45.874781 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 01 19:00:45.874781 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 01 19:00:45.874781 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 3ac82755-05f3-40fb-874c-63e687518273 does not exist Nov 01 19:00:45.874781 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-353fa643-2cc1-4019-a871-4c9a9ddaa03d'] Nov 01 19:00:45.874781 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:00:45.874781 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-3fcbce05-9808-478c-ad68-8a0b1bd5b682 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Returning 404 to user: Security group 3ac82755-05f3-40fb-874c-63e687518273 does not exist Nov 01 19:00:45.874781 n-d-863052-2 devstack@n-api.service[121403]: Neutron server returns request_ids: ['req-353fa643-2cc1-4019-a871-4c9a9ddaa03d'] {{(pid=121403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 01 19:00:45.874781 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-3fcbce05-9808-478c-ad68-8a0b1bd5b682 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] 10.222.0.13 "DELETE /compute/v2.1/os-security-groups/3ac82755-05f3-40fb-874c-63e687518273" status: 404 len: 194 microversion: 2.1 time: 0.042878 Nov 01 19:00:45.874781 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 923/1855] 10.222.0.13 () {58 vars in 1272 bytes} [Tue Nov 1 19:00:45 2022] DELETE /compute/v2.1/os-security-groups/3ac82755-05f3-40fb-874c-63e687518273 => generated 194 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 01 19:00:45.879691 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-d688bf24-6a5f-44ce-bbbd-7ec670433a8c tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:00:45.880531 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-d688bf24-6a5f-44ce-bbbd-7ec670433a8c tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] [instance: 495c1822-a615-4da7-a053-227744a46341] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:00:45.889821 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d688bf24-6a5f-44ce-bbbd-7ec670433a8c tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:45.890308 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d688bf24-6a5f-44ce-bbbd-7ec670433a8c tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:45.890771 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d688bf24-6a5f-44ce-bbbd-7ec670433a8c tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:45.891467 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d688bf24-6a5f-44ce-bbbd-7ec670433a8c tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:45.891999 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d688bf24-6a5f-44ce-bbbd-7ec670433a8c tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:45.892372 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d688bf24-6a5f-44ce-bbbd-7ec670433a8c tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:45.925549 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-d688bf24-6a5f-44ce-bbbd-7ec670433a8c tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] [instance: 495c1822-a615-4da7-a053-227744a46341] Going to try to terminate instance {{(pid=121403) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 01 19:00:46.013921 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-d688bf24-6a5f-44ce-bbbd-7ec670433a8c tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] 10.222.0.13 "DELETE /compute/v2.1/servers/495c1822-a615-4da7-a053-227744a46341" status: 204 len: 0 microversion: 2.1 time: 0.140805 Nov 01 19:00:46.014670 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 924/1856] 10.222.0.13 () {58 vars in 1239 bytes} [Tue Nov 1 19:00:45 2022] DELETE /compute/v2.1/servers/495c1822-a615-4da7-a053-227744a46341 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 01 19:00:46.023252 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-9e2d6959-cabf-4e9e-b69c-20bab72ddd27 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:00:46.023992 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-9e2d6959-cabf-4e9e-b69c-20bab72ddd27 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] [instance: 495c1822-a615-4da7-a053-227744a46341] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:00:46.031101 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-9e2d6959-cabf-4e9e-b69c-20bab72ddd27 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:46.031625 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-9e2d6959-cabf-4e9e-b69c-20bab72ddd27 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:46.032700 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-9e2d6959-cabf-4e9e-b69c-20bab72ddd27 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:46.033420 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-9e2d6959-cabf-4e9e-b69c-20bab72ddd27 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:46.033879 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-9e2d6959-cabf-4e9e-b69c-20bab72ddd27 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:46.034306 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-9e2d6959-cabf-4e9e-b69c-20bab72ddd27 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:46.234647 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-9e2d6959-cabf-4e9e-b69c-20bab72ddd27 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a9c3b6a8c34f068caa50dc10d13a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9ef08eba0ef431285fd15a2561b4e5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:00:46.248927 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-9e2d6959-cabf-4e9e-b69c-20bab72ddd27 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] 10.222.0.13 "GET /compute/v2.1/servers/495c1822-a615-4da7-a053-227744a46341" status: 200 len: 1647 microversion: 2.1 time: 0.228883 Nov 01 19:00:46.256629 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 925/1857] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:00:46 2022] GET /compute/v2.1/servers/495c1822-a615-4da7-a053-227744a46341 => generated 1647 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:00:46.257988 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-01f351d2-b139-478a-b18e-f76b4af34452 tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] Calling method '.version_select at 0x7f0ae6889b80>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:00:46.316510 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-01f351d2-b139-478a-b18e-f76b4af34452 tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] 10.222.0.13 "GET /compute/v2.1/images/ccc79e7f-4589-43b9-a2ca-2a8f13b6602d" status: 200 len: 1455 microversion: 2.1 time: 0.064777 Nov 01 19:00:46.320914 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 926/1858] 10.222.0.13 () {58 vars in 1233 bytes} [Tue Nov 1 19:00:46 2022] GET /compute/v2.1/images/ccc79e7f-4589-43b9-a2ca-2a8f13b6602d => generated 1455 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:00:46.418823 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-2afe3d8e-23c4-4668-aa63-b538e7f39002 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:00:46.419461 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-2afe3d8e-23c4-4668-aa63-b538e7f39002 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] [instance: cd879708-f757-4f88-bc95-38b6cd55363c] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:00:46.427334 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-2afe3d8e-23c4-4668-aa63-b538e7f39002 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:46.427822 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-2afe3d8e-23c4-4668-aa63-b538e7f39002 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:46.428261 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-2afe3d8e-23c4-4668-aa63-b538e7f39002 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:46.429026 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-2afe3d8e-23c4-4668-aa63-b538e7f39002 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:46.429455 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-2afe3d8e-23c4-4668-aa63-b538e7f39002 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:46.429917 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-2afe3d8e-23c4-4668-aa63-b538e7f39002 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:46.504479 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-2afe3d8e-23c4-4668-aa63-b538e7f39002 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:00:46.513476 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-2afe3d8e-23c4-4668-aa63-b538e7f39002 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:00:46.514938 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-2afe3d8e-23c4-4668-aa63-b538e7f39002 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:00:46.516104 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-2afe3d8e-23c4-4668-aa63-b538e7f39002 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] 10.222.0.13 "GET /compute/v2.1/servers/cd879708-f757-4f88-bc95-38b6cd55363c" status: 200 len: 1177 microversion: 2.25 time: 0.101579 Nov 01 19:00:46.517030 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 927/1859] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 19:00:46 2022] GET /compute/v2.1/servers/cd879708-f757-4f88-bc95-38b6cd55363c => generated 1177 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 01 19:00:46.639278 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-68b9b3a7-84b8-4d02-82f5-f9079781d997 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:00:46.639916 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-68b9b3a7-84b8-4d02-82f5-f9079781d997 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] [instance: 7218f99b-b011-4f08-931e-340d47069f6e] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:00:46.646211 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-68b9b3a7-84b8-4d02-82f5-f9079781d997 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:46.646708 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-68b9b3a7-84b8-4d02-82f5-f9079781d997 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:46.647152 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-68b9b3a7-84b8-4d02-82f5-f9079781d997 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:46.647902 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-68b9b3a7-84b8-4d02-82f5-f9079781d997 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:46.648361 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-68b9b3a7-84b8-4d02-82f5-f9079781d997 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:46.648815 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-68b9b3a7-84b8-4d02-82f5-f9079781d997 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:46.797830 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-68b9b3a7-84b8-4d02-82f5-f9079781d997 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72117f17294649d6b8bc16c66c7efab2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45d4c047d3c44324a27a27831236ab0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:00:46.806489 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-68b9b3a7-84b8-4d02-82f5-f9079781d997 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] 10.222.0.13 "GET /compute/v2.1/servers/7218f99b-b011-4f08-931e-340d47069f6e" status: 200 len: 1468 microversion: 2.1 time: 0.171223 Nov 01 19:00:46.807129 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 928/1860] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:00:46 2022] GET /compute/v2.1/servers/7218f99b-b011-4f08-931e-340d47069f6e => generated 1468 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 19:00:46.850263 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-218fe8c9-4ed4-49f4-90e8-2a38e4bad165 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:00:46.850877 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-218fe8c9-4ed4-49f4-90e8-2a38e4bad165 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] [instance: f35d5fdd-4a95-4b57-a506-665fa3f393c1] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:00:46.857819 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-218fe8c9-4ed4-49f4-90e8-2a38e4bad165 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:46.858320 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-218fe8c9-4ed4-49f4-90e8-2a38e4bad165 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:46.858766 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-218fe8c9-4ed4-49f4-90e8-2a38e4bad165 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:46.859469 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-218fe8c9-4ed4-49f4-90e8-2a38e4bad165 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:46.859925 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-218fe8c9-4ed4-49f4-90e8-2a38e4bad165 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:46.860349 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-218fe8c9-4ed4-49f4-90e8-2a38e4bad165 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:47.008249 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-218fe8c9-4ed4-49f4-90e8-2a38e4bad165 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0290a6bb8bc24b8988a925327ac0381c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86941784237549838bba63ce88053b88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:00:47.017148 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-218fe8c9-4ed4-49f4-90e8-2a38e4bad165 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] 10.222.0.13 "GET /compute/v2.1/servers/f35d5fdd-4a95-4b57-a506-665fa3f393c1" status: 200 len: 1473 microversion: 2.1 time: 0.170752 Nov 01 19:00:47.018165 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 929/1861] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:00:46 2022] GET /compute/v2.1/servers/f35d5fdd-4a95-4b57-a506-665fa3f393c1 => generated 1473 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 19:00:47.275438 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-80ad0f7e-11c0-4589-962a-e7dac4e6cb88 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:00:47.276428 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-80ad0f7e-11c0-4589-962a-e7dac4e6cb88 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] [instance: 495c1822-a615-4da7-a053-227744a46341] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:00:47.284002 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-80ad0f7e-11c0-4589-962a-e7dac4e6cb88 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:47.284942 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-80ad0f7e-11c0-4589-962a-e7dac4e6cb88 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:47.285494 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-80ad0f7e-11c0-4589-962a-e7dac4e6cb88 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:47.286335 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-80ad0f7e-11c0-4589-962a-e7dac4e6cb88 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:47.286847 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-80ad0f7e-11c0-4589-962a-e7dac4e6cb88 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:47.287332 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-80ad0f7e-11c0-4589-962a-e7dac4e6cb88 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:47.304832 n-d-863052-2 devstack@n-api.service[121403]: DEBUG dbcounter [-] [121403] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=121403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 19:00:47.608653 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-80ad0f7e-11c0-4589-962a-e7dac4e6cb88 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a9c3b6a8c34f068caa50dc10d13a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9ef08eba0ef431285fd15a2561b4e5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:00:47.616450 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-80ad0f7e-11c0-4589-962a-e7dac4e6cb88 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] 10.222.0.13 "GET /compute/v2.1/servers/495c1822-a615-4da7-a053-227744a46341" status: 200 len: 1647 microversion: 2.1 time: 0.346064 Nov 01 19:00:47.629021 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 930/1862] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:00:47 2022] GET /compute/v2.1/servers/495c1822-a615-4da7-a053-227744a46341 => generated 1647 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:00:47.634410 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-60f4acdb-05b1-4a54-8434-3686b381fa63 tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] Calling method '.version_select at 0x7f0ae2d2e790>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:00:47.711530 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-60f4acdb-05b1-4a54-8434-3686b381fa63 tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] 10.222.0.13 "GET /compute/v2.1/images/ccc79e7f-4589-43b9-a2ca-2a8f13b6602d" status: 200 len: 1455 microversion: 2.1 time: 0.081317 Nov 01 19:00:47.712633 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 931/1863] 10.222.0.13 () {58 vars in 1233 bytes} [Tue Nov 1 19:00:47 2022] GET /compute/v2.1/images/ccc79e7f-4589-43b9-a2ca-2a8f13b6602d => generated 1455 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:00:47.720826 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-daa08a1f-9743-48df-972b-1b4010f039d8 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:00:47.721506 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-daa08a1f-9743-48df-972b-1b4010f039d8 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] [instance: cd879708-f757-4f88-bc95-38b6cd55363c] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:00:47.733070 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-daa08a1f-9743-48df-972b-1b4010f039d8 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:47.733559 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-daa08a1f-9743-48df-972b-1b4010f039d8 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:47.733993 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-daa08a1f-9743-48df-972b-1b4010f039d8 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:47.734693 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-daa08a1f-9743-48df-972b-1b4010f039d8 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:47.735143 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-daa08a1f-9743-48df-972b-1b4010f039d8 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:47.735560 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-daa08a1f-9743-48df-972b-1b4010f039d8 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:47.896492 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-daa08a1f-9743-48df-972b-1b4010f039d8 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:00:47.907328 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-daa08a1f-9743-48df-972b-1b4010f039d8 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:00:47.908789 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-daa08a1f-9743-48df-972b-1b4010f039d8 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:00:47.921077 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-daa08a1f-9743-48df-972b-1b4010f039d8 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] 10.222.0.13 "GET /compute/v2.1/servers/cd879708-f757-4f88-bc95-38b6cd55363c" status: 200 len: 1233 microversion: 2.25 time: 0.196542 Nov 01 19:00:47.922001 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 932/1864] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 19:00:47 2022] GET /compute/v2.1/servers/cd879708-f757-4f88-bc95-38b6cd55363c => generated 1233 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 19:00:47.945828 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-cb258d3c-4e9c-4abf-9cf2-9e9c8d07d670 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:00:47.946723 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-cb258d3c-4e9c-4abf-9cf2-9e9c8d07d670 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] [instance: 7218f99b-b011-4f08-931e-340d47069f6e] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:00:47.949002 n-d-863052-2 devstack@n-api.service[121403]: DEBUG dbcounter [-] [121403] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=4,nova_api:DELETE=1 {{(pid=121403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 19:00:47.961690 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-cb258d3c-4e9c-4abf-9cf2-9e9c8d07d670 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:47.964660 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-cb258d3c-4e9c-4abf-9cf2-9e9c8d07d670 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:47.965267 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-cb258d3c-4e9c-4abf-9cf2-9e9c8d07d670 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:47.966169 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-cb258d3c-4e9c-4abf-9cf2-9e9c8d07d670 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:47.966790 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-cb258d3c-4e9c-4abf-9cf2-9e9c8d07d670 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:47.974068 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-cb258d3c-4e9c-4abf-9cf2-9e9c8d07d670 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:48.542546 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-cb258d3c-4e9c-4abf-9cf2-9e9c8d07d670 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72117f17294649d6b8bc16c66c7efab2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45d4c047d3c44324a27a27831236ab0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:00:48.556787 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-cb258d3c-4e9c-4abf-9cf2-9e9c8d07d670 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] 10.222.0.13 "GET /compute/v2.1/servers/7218f99b-b011-4f08-931e-340d47069f6e" status: 200 len: 1468 microversion: 2.1 time: 0.618264 Nov 01 19:00:48.577643 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 933/1865] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:00:47 2022] GET /compute/v2.1/servers/7218f99b-b011-4f08-931e-340d47069f6e => generated 1468 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:00:48.582780 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-f608b983-2dc4-4e94-af72-0dd327aec0d9 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:00:48.590179 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-f608b983-2dc4-4e94-af72-0dd327aec0d9 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] [instance: f35d5fdd-4a95-4b57-a506-665fa3f393c1] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:00:48.609482 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f608b983-2dc4-4e94-af72-0dd327aec0d9 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:48.612008 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f608b983-2dc4-4e94-af72-0dd327aec0d9 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:48.615199 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f608b983-2dc4-4e94-af72-0dd327aec0d9 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:48.618456 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f608b983-2dc4-4e94-af72-0dd327aec0d9 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:48.619063 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f608b983-2dc4-4e94-af72-0dd327aec0d9 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:48.620686 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f608b983-2dc4-4e94-af72-0dd327aec0d9 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:48.723738 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f608b983-2dc4-4e94-af72-0dd327aec0d9 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:48.728799 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f608b983-2dc4-4e94-af72-0dd327aec0d9 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:48.729253 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f608b983-2dc4-4e94-af72-0dd327aec0d9 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:48.735497 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.objects.instance [None req-f608b983-2dc4-4e94-af72-0dd327aec0d9 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lazy-loading 'fault' on Instance uuid f35d5fdd-4a95-4b57-a506-665fa3f393c1 {{(pid=121403) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 01 19:00:48.915925 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-f608b983-2dc4-4e94-af72-0dd327aec0d9 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0290a6bb8bc24b8988a925327ac0381c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86941784237549838bba63ce88053b88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:00:48.940662 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-f608b983-2dc4-4e94-af72-0dd327aec0d9 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] 10.222.0.13 "GET /compute/v2.1/servers/f35d5fdd-4a95-4b57-a506-665fa3f393c1" status: 200 len: 1307 microversion: 2.1 time: 0.356752 Nov 01 19:00:48.944611 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 934/1866] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:00:48 2022] GET /compute/v2.1/servers/f35d5fdd-4a95-4b57-a506-665fa3f393c1 => generated 1307 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:00:48.972442 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [req-40756b89-561c-4da8-87f0-2f44eed1f659 req-22f9d706-6406-4a94-ad81-11f7a54cc4a9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f35d5fdd-4a95-4b57-a506-665fa3f393c1", "name": "network-vif-deleted", "tag": "1eeffe67-2447-4389-aa3b-4c83cc3c9d53"}]} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:00:49.044985 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-40756b89-561c-4da8-87f0-2f44eed1f659 req-22f9d706-6406-4a94-ad81-11f7a54cc4a9 service nova] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:49.051971 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-40756b89-561c-4da8-87f0-2f44eed1f659 req-22f9d706-6406-4a94-ad81-11f7a54cc4a9 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:49.052554 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-40756b89-561c-4da8-87f0-2f44eed1f659 req-22f9d706-6406-4a94-ad81-11f7a54cc4a9 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:49.123942 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.compute.server_external_events [req-40756b89-561c-4da8-87f0-2f44eed1f659 req-22f9d706-6406-4a94-ad81-11f7a54cc4a9 service nova] Creating event network-vif-deleted:1eeffe67-2447-4389-aa3b-4c83cc3c9d53 for instance f35d5fdd-4a95-4b57-a506-665fa3f393c1 on n-h2-863052-2 Nov 01 19:00:49.138917 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [req-40756b89-561c-4da8-87f0-2f44eed1f659 req-22f9d706-6406-4a94-ad81-11f7a54cc4a9 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.192567 Nov 01 19:00:49.146295 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 935/1867] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Nov 1 19:00:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:00:49.161630 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-6d56d391-ed6c-4671-8383-e6a425e722c8 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:00:49.166154 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-6d56d391-ed6c-4671-8383-e6a425e722c8 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] [instance: 495c1822-a615-4da7-a053-227744a46341] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:00:49.203187 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-6d56d391-ed6c-4671-8383-e6a425e722c8 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:49.204195 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-6d56d391-ed6c-4671-8383-e6a425e722c8 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:49.204998 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-6d56d391-ed6c-4671-8383-e6a425e722c8 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:49.209408 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-6d56d391-ed6c-4671-8383-e6a425e722c8 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:49.209923 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-6d56d391-ed6c-4671-8383-e6a425e722c8 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:49.210370 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-6d56d391-ed6c-4671-8383-e6a425e722c8 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:49.406387 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-6d56d391-ed6c-4671-8383-e6a425e722c8 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a9c3b6a8c34f068caa50dc10d13a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9ef08eba0ef431285fd15a2561b4e5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:00:49.421535 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-6d56d391-ed6c-4671-8383-e6a425e722c8 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] 10.222.0.13 "GET /compute/v2.1/servers/495c1822-a615-4da7-a053-227744a46341" status: 200 len: 1468 microversion: 2.1 time: 0.267461 Nov 01 19:00:49.422501 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 936/1868] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:00:49 2022] GET /compute/v2.1/servers/495c1822-a615-4da7-a053-227744a46341 => generated 1468 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:00:49.427772 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-01fd3871-000e-4ac5-9e20-762f6ea0911a tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] Calling method '.version_select at 0x7f0ae225bb80>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:00:49.495443 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-01fd3871-000e-4ac5-9e20-762f6ea0911a tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] 10.222.0.13 "GET /compute/v2.1/images/ccc79e7f-4589-43b9-a2ca-2a8f13b6602d" status: 200 len: 1455 microversion: 2.1 time: 0.071756 Nov 01 19:00:49.496308 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 937/1869] 10.222.0.13 () {58 vars in 1233 bytes} [Tue Nov 1 19:00:49 2022] GET /compute/v2.1/images/ccc79e7f-4589-43b9-a2ca-2a8f13b6602d => generated 1455 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:00:49.507734 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-9676e80d-419d-4971-8607-a0019098db76 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:00:49.508703 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-9676e80d-419d-4971-8607-a0019098db76 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] [instance: cd879708-f757-4f88-bc95-38b6cd55363c] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:00:49.527723 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-9676e80d-419d-4971-8607-a0019098db76 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:49.528217 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-9676e80d-419d-4971-8607-a0019098db76 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:49.535145 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-9676e80d-419d-4971-8607-a0019098db76 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:49.538799 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-1f027957-15d6-4b05-b246-750666f7d93d tempest-LiveMigrationTest-1695240876 tempest-LiveMigrationTest-1695240876-project-admin] 10.222.0.13 "POST /compute/v2.1/servers/1f499af7-1896-478c-b7d7-d922bf78bd98/action" status: 202 len: 0 microversion: 2.1 time: 5.054176 Nov 01 19:00:49.540725 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 933/1870] 10.222.0.13 () {60 vars in 1278 bytes} [Tue Nov 1 19:00:44 2022] POST /compute/v2.1/servers/1f499af7-1896-478c-b7d7-d922bf78bd98/action => generated 0 bytes in 5057 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 01 19:00:49.547892 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [req-3ce492a8-3363-46dd-b6de-eca71c8b40b3 req-9bf5cb66-0ec0-4cd8-b20b-10d52dddfd78 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7218f99b-b011-4f08-931e-340d47069f6e", "name": "network-vif-deleted", "tag": "8d7f9336-82a3-4d8c-a178-f498c4931099"}]} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:00:49.549575 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-9676e80d-419d-4971-8607-a0019098db76 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:49.556230 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-9676e80d-419d-4971-8607-a0019098db76 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:49.559494 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-9676e80d-419d-4971-8607-a0019098db76 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:49.583346 n-d-863052-2 devstack@n-api.service[121402]: DEBUG dbcounter [-] [121402] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=3,nova_api:INSERT=3 {{(pid=121402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 19:00:49.597613 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-3ce492a8-3363-46dd-b6de-eca71c8b40b3 req-9bf5cb66-0ec0-4cd8-b20b-10d52dddfd78 service nova] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:49.601439 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-3ce492a8-3363-46dd-b6de-eca71c8b40b3 req-9bf5cb66-0ec0-4cd8-b20b-10d52dddfd78 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:49.604668 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-3ce492a8-3363-46dd-b6de-eca71c8b40b3 req-9bf5cb66-0ec0-4cd8-b20b-10d52dddfd78 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:49.694816 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.compute.server_external_events [req-3ce492a8-3363-46dd-b6de-eca71c8b40b3 req-9bf5cb66-0ec0-4cd8-b20b-10d52dddfd78 service nova] Creating event network-vif-deleted:8d7f9336-82a3-4d8c-a178-f498c4931099 for instance 7218f99b-b011-4f08-931e-340d47069f6e on n-h2-863052-2 Nov 01 19:00:49.717001 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-9676e80d-419d-4971-8607-a0019098db76 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:00:49.719620 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [req-3ce492a8-3363-46dd-b6de-eca71c8b40b3 req-9bf5cb66-0ec0-4cd8-b20b-10d52dddfd78 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.175462 Nov 01 19:00:49.724083 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 934/1871] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Nov 1 19:00:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:00:49.735350 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-9676e80d-419d-4971-8607-a0019098db76 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:00:49.742725 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-9676e80d-419d-4971-8607-a0019098db76 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:00:49.745520 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-9676e80d-419d-4971-8607-a0019098db76 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] 10.222.0.13 "GET /compute/v2.1/servers/cd879708-f757-4f88-bc95-38b6cd55363c" status: 200 len: 1251 microversion: 2.25 time: 0.246820 Nov 01 19:00:49.747361 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 938/1872] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 19:00:49 2022] GET /compute/v2.1/servers/cd879708-f757-4f88-bc95-38b6cd55363c => generated 1251 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 19:00:49.758461 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-decb3f7b-a268-4b6b-be8d-23b3db704a0f tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:00:49.759474 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-decb3f7b-a268-4b6b-be8d-23b3db704a0f tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] [instance: 7218f99b-b011-4f08-931e-340d47069f6e] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:00:49.764463 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-ec62e17f-c75a-4ac2-9e5c-1f8448903147 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:00:49.771533 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-ec62e17f-c75a-4ac2-9e5c-1f8448903147 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] [instance: 1f499af7-1896-478c-b7d7-d922bf78bd98] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:00:49.779012 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-decb3f7b-a268-4b6b-be8d-23b3db704a0f tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:49.782794 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-decb3f7b-a268-4b6b-be8d-23b3db704a0f tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:49.785014 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-decb3f7b-a268-4b6b-be8d-23b3db704a0f tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:49.786085 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-decb3f7b-a268-4b6b-be8d-23b3db704a0f tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:49.791119 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-decb3f7b-a268-4b6b-be8d-23b3db704a0f tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:49.792152 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-decb3f7b-a268-4b6b-be8d-23b3db704a0f tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:49.813525 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-ec62e17f-c75a-4ac2-9e5c-1f8448903147 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:49.817354 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-ec62e17f-c75a-4ac2-9e5c-1f8448903147 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:49.819929 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-ec62e17f-c75a-4ac2-9e5c-1f8448903147 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:49.825277 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-ec62e17f-c75a-4ac2-9e5c-1f8448903147 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:49.828517 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-ec62e17f-c75a-4ac2-9e5c-1f8448903147 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:49.830443 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-ec62e17f-c75a-4ac2-9e5c-1f8448903147 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:49.916136 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-decb3f7b-a268-4b6b-be8d-23b3db704a0f tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:49.922153 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-decb3f7b-a268-4b6b-be8d-23b3db704a0f tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:49.922814 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-decb3f7b-a268-4b6b-be8d-23b3db704a0f tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:49.924656 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.objects.instance [None req-decb3f7b-a268-4b6b-be8d-23b3db704a0f tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lazy-loading 'fault' on Instance uuid 7218f99b-b011-4f08-931e-340d47069f6e {{(pid=121403) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 01 19:00:50.067573 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-decb3f7b-a268-4b6b-be8d-23b3db704a0f tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72117f17294649d6b8bc16c66c7efab2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45d4c047d3c44324a27a27831236ab0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:00:50.089264 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-decb3f7b-a268-4b6b-be8d-23b3db704a0f tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] 10.222.0.13 "GET /compute/v2.1/servers/7218f99b-b011-4f08-931e-340d47069f6e" status: 200 len: 1302 microversion: 2.1 time: 0.338923 Nov 01 19:00:50.094322 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 939/1873] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:00:49 2022] GET /compute/v2.1/servers/7218f99b-b011-4f08-931e-340d47069f6e => generated 1302 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:00:50.099800 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-d0462a90-840e-4085-a7d5-4bd4265f91b2 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:00:50.103563 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-d0462a90-840e-4085-a7d5-4bd4265f91b2 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] [instance: f35d5fdd-4a95-4b57-a506-665fa3f393c1] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:00:50.124213 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d0462a90-840e-4085-a7d5-4bd4265f91b2 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:50.126477 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d0462a90-840e-4085-a7d5-4bd4265f91b2 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:50.127371 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d0462a90-840e-4085-a7d5-4bd4265f91b2 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:50.132494 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d0462a90-840e-4085-a7d5-4bd4265f91b2 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:50.133899 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d0462a90-840e-4085-a7d5-4bd4265f91b2 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:50.136732 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d0462a90-840e-4085-a7d5-4bd4265f91b2 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:50.164238 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.wsgi [None req-d0462a90-840e-4085-a7d5-4bd4265f91b2 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] HTTP exception thrown: Instance f35d5fdd-4a95-4b57-a506-665fa3f393c1 could not be found. Nov 01 19:00:50.172126 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-d0462a90-840e-4085-a7d5-4bd4265f91b2 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Request method failure captured: Nov 01 19:00:50.172126 n-d-863052-2 devstack@n-api.service[121403]: request: GET /compute/v2.1/servers/f35d5fdd-4a95-4b57-a506-665fa3f393c1 HTTP/1.1 Nov 01 19:00:50.172126 n-d-863052-2 devstack@n-api.service[121403]: Accept: application/json Nov 01 19:00:50.172126 n-d-863052-2 devstack@n-api.service[121403]: Accept-Encoding: identity Nov 01 19:00:50.172126 n-d-863052-2 devstack@n-api.service[121403]: Connection: close Nov 01 19:00:50.172126 n-d-863052-2 devstack@n-api.service[121403]: Content-Length: 0 Nov 01 19:00:50.172126 n-d-863052-2 devstack@n-api.service[121403]: Content-Type: application/json Nov 01 19:00:50.172126 n-d-863052-2 devstack@n-api.service[121403]: Host: 10.222.0.13 Nov 01 19:00:50.172126 n-d-863052-2 devstack@n-api.service[121403]: Openstack-System-Scope: None Nov 01 19:00:50.172126 n-d-863052-2 devstack@n-api.service[121403]: User-Agent: python-urllib3/1.26.12 Nov 01 19:00:50.172126 n-d-863052-2 devstack@n-api.service[121403]: X-Auth-Token: gAAAAABjYWw27zVYcT0jiDkpuT1RhWK3v8RIYvgoBAv6JENEEUigh3EWDZBWsWojpv0UuPsP42AoaM4QJ3MvpvySt_jiXJEPPxL0U99qRIuu3QOrQQyEuoWyflobV2EmBrMy9kC-XG8E8wqlSX7W2YY0K8WOiMWq_0tsCeniBBlKBU3a2s3TKIo Nov 01 19:00:50.172126 n-d-863052-2 devstack@n-api.service[121403]: X-Domain-Id: None Nov 01 19:00:50.172126 n-d-863052-2 devstack@n-api.service[121403]: X-Domain-Name: None Nov 01 19:00:50.172126 n-d-863052-2 devstack@n-api.service[121403]: X-Identity-Status: Confirmed Nov 01 19:00:50.172126 n-d-863052-2 devstack@n-api.service[121403]: X-Is-Admin-Project: True Nov 01 19:00:50.172126 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Domain-Id: default Nov 01 19:00:50.172126 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Domain-Name: Default Nov 01 19:00:50.172126 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Id: 86941784237549838bba63ce88053b88 Nov 01 19:00:50.172126 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Name: tempest-ServersOnMultiNodesTest-1928208762 Nov 01 19:00:50.172126 n-d-863052-2 devstack@n-api.service[121403]: X-Role: member,reader Nov 01 19:00:50.172126 n-d-863052-2 devstack@n-api.service[121403]: X-Roles: member,reader Nov 01 19:00:50.173872 n-d-863052-2 devstack@n-api.service[121403]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/86941784237549838bba63ce88053b88"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/86941784237549838bba63ce88053b88"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_86941784237549838bba63ce88053b88", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/86941784237549838bba63ce88053b88"}]}] Nov 01 19:00:50.173872 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant: tempest-ServersOnMultiNodesTest-1928208762 Nov 01 19:00:50.173872 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant-Id: 86941784237549838bba63ce88053b88 Nov 01 19:00:50.173872 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1928208762 Nov 01 19:00:50.173872 n-d-863052-2 devstack@n-api.service[121403]: X-User: tempest-ServersOnMultiNodesTest-1928208762-project Nov 01 19:00:50.173872 n-d-863052-2 devstack@n-api.service[121403]: X-User-Domain-Id: default Nov 01 19:00:50.173872 n-d-863052-2 devstack@n-api.service[121403]: X-User-Domain-Name: Default Nov 01 19:00:50.173872 n-d-863052-2 devstack@n-api.service[121403]: X-User-Id: 0290a6bb8bc24b8988a925327ac0381c Nov 01 19:00:50.173872 n-d-863052-2 devstack@n-api.service[121403]: X-User-Name: tempest-ServersOnMultiNodesTest-1928208762-project Nov 01 19:00:50.173872 n-d-863052-2 devstack@n-api.service[121403]: method: > Nov 01 19:00:50.173872 n-d-863052-2 devstack@n-api.service[121403]: exception: Instance f35d5fdd-4a95-4b57-a506-665fa3f393c1 could not be found. Nov 01 19:00:50.173872 n-d-863052-2 devstack@n-api.service[121403]: action_args: {'id': 'f35d5fdd-4a95-4b57-a506-665fa3f393c1'} Nov 01 19:00:50.174865 n-d-863052-2 devstack@n-api.service[121403]: {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 01 19:00:50.174865 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:00:50.174865 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 01 19:00:50.174865 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 01 19:00:50.174865 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 01 19:00:50.174865 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 01 19:00:50.174865 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 01 19:00:50.174865 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 01 19:00:50.174865 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 01 19:00:50.174865 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 01 19:00:50.174865 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f35d5fdd-4a95-4b57-a506-665fa3f393c1 could not be found. Nov 01 19:00:50.174865 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:00:50.174865 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:00:50.174865 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:00:50.174865 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:00:50.174865 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:00:50.174865 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:00:50.174865 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 01 19:00:50.174865 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 01 19:00:50.174865 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 01 19:00:50.176454 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 01 19:00:50.176454 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 01 19:00:50.176454 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 01 19:00:50.176454 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 01 19:00:50.176454 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 01 19:00:50.176454 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 01 19:00:50.176454 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 01 19:00:50.176454 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f35d5fdd-4a95-4b57-a506-665fa3f393c1 could not be found. Nov 01 19:00:50.176454 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:00:50.176454 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:00:50.176454 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:00:50.176454 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:00:50.176454 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:00:50.176454 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:00:50.176454 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 01 19:00:50.176454 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 01 19:00:50.176454 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f35d5fdd-4a95-4b57-a506-665fa3f393c1 could not be found. Nov 01 19:00:50.176454 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:00:50.180285 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-d0462a90-840e-4085-a7d5-4bd4265f91b2 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Returning 404 to user: Instance f35d5fdd-4a95-4b57-a506-665fa3f393c1 could not be found. {{(pid=121403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 01 19:00:50.181344 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-d0462a90-840e-4085-a7d5-4bd4265f91b2 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] 10.222.0.13 "GET /compute/v2.1/servers/f35d5fdd-4a95-4b57-a506-665fa3f393c1" status: 404 len: 111 microversion: 2.1 time: 0.085901 Nov 01 19:00:50.183705 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 940/1874] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:00:50 2022] GET /compute/v2.1/servers/f35d5fdd-4a95-4b57-a506-665fa3f393c1 => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 01 19:00:50.187535 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-ec62e17f-c75a-4ac2-9e5c-1f8448903147 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f32f5fba1976432d938e664c7714e52b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b9d4c236b944f9b2e8e502a50a8f8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:00:50.199792 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-6624a093-116a-4ec5-bcec-ab8c3cce7e5b tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:00:50.201381 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-6624a093-116a-4ec5-bcec-ab8c3cce7e5b tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] [instance: 3796ef05-cc8e-44d4-8dfc-058b5dbc8cbd] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:00:50.206933 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-ec62e17f-c75a-4ac2-9e5c-1f8448903147 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] 10.222.0.13 "GET /compute/v2.1/servers/1f499af7-1896-478c-b7d7-d922bf78bd98" status: 200 len: 1391 microversion: 2.1 time: 0.477045 Nov 01 19:00:50.207866 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 935/1875] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:00:49 2022] GET /compute/v2.1/servers/1f499af7-1896-478c-b7d7-d922bf78bd98 => generated 1391 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:00:50.223524 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-6624a093-116a-4ec5-bcec-ab8c3cce7e5b tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:50.224305 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-6624a093-116a-4ec5-bcec-ab8c3cce7e5b tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:50.225317 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-6624a093-116a-4ec5-bcec-ab8c3cce7e5b tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:50.226398 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-6624a093-116a-4ec5-bcec-ab8c3cce7e5b tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:50.230566 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-6624a093-116a-4ec5-bcec-ab8c3cce7e5b tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:50.231474 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-6624a093-116a-4ec5-bcec-ab8c3cce7e5b tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:50.267093 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-6624a093-116a-4ec5-bcec-ab8c3cce7e5b tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] [instance: 3796ef05-cc8e-44d4-8dfc-058b5dbc8cbd] Going to try to terminate instance {{(pid=121403) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 01 19:00:50.452505 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-97f0e07b-b78e-4aa2-bbd9-9ffcb127a7d6 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:00:50.453404 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-97f0e07b-b78e-4aa2-bbd9-9ffcb127a7d6 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] [instance: 495c1822-a615-4da7-a053-227744a46341] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:00:50.474350 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-97f0e07b-b78e-4aa2-bbd9-9ffcb127a7d6 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:50.478441 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-97f0e07b-b78e-4aa2-bbd9-9ffcb127a7d6 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:50.482907 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-97f0e07b-b78e-4aa2-bbd9-9ffcb127a7d6 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:50.485165 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-97f0e07b-b78e-4aa2-bbd9-9ffcb127a7d6 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:50.486290 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-97f0e07b-b78e-4aa2-bbd9-9ffcb127a7d6 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:50.487849 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-97f0e07b-b78e-4aa2-bbd9-9ffcb127a7d6 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:50.494144 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-6624a093-116a-4ec5-bcec-ab8c3cce7e5b tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] 10.222.0.13 "DELETE /compute/v2.1/servers/3796ef05-cc8e-44d4-8dfc-058b5dbc8cbd" status: 204 len: 0 microversion: 2.1 time: 0.305568 Nov 01 19:00:50.498992 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 941/1876] 10.222.0.13 () {58 vars in 1239 bytes} [Tue Nov 1 19:00:50 2022] DELETE /compute/v2.1/servers/3796ef05-cc8e-44d4-8dfc-058b5dbc8cbd => generated 0 bytes in 308 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 01 19:00:50.514041 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-4afd0817-d480-40df-9c79-2443d1fe455d tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:00:50.515072 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-4afd0817-d480-40df-9c79-2443d1fe455d tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] [instance: 3796ef05-cc8e-44d4-8dfc-058b5dbc8cbd] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:00:50.534925 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-4afd0817-d480-40df-9c79-2443d1fe455d tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:50.535765 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-4afd0817-d480-40df-9c79-2443d1fe455d tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:50.536373 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-4afd0817-d480-40df-9c79-2443d1fe455d tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:50.539728 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-4afd0817-d480-40df-9c79-2443d1fe455d tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:50.542054 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-4afd0817-d480-40df-9c79-2443d1fe455d tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:50.545887 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-4afd0817-d480-40df-9c79-2443d1fe455d tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:50.573803 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-97f0e07b-b78e-4aa2-bbd9-9ffcb127a7d6 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:50.576375 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-97f0e07b-b78e-4aa2-bbd9-9ffcb127a7d6 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:50.577110 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-97f0e07b-b78e-4aa2-bbd9-9ffcb127a7d6 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:50.581542 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.objects.instance [None req-97f0e07b-b78e-4aa2-bbd9-9ffcb127a7d6 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Lazy-loading 'fault' on Instance uuid 495c1822-a615-4da7-a053-227744a46341 {{(pid=121402) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 01 19:00:50.700260 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-97f0e07b-b78e-4aa2-bbd9-9ffcb127a7d6 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a9c3b6a8c34f068caa50dc10d13a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9ef08eba0ef431285fd15a2561b4e5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:00:50.724681 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-97f0e07b-b78e-4aa2-bbd9-9ffcb127a7d6 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] 10.222.0.13 "GET /compute/v2.1/servers/495c1822-a615-4da7-a053-227744a46341" status: 200 len: 1306 microversion: 2.1 time: 0.278561 Nov 01 19:00:50.725467 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 936/1877] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:00:50 2022] GET /compute/v2.1/servers/495c1822-a615-4da7-a053-227744a46341 => generated 1306 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 19:00:50.740550 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-3e4f83e0-d703-4009-8f62-ab7c996ae537 tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] Calling method '.version_select at 0x7f0ae1c13f70>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:00:50.763126 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-4afd0817-d480-40df-9c79-2443d1fe455d tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0290a6bb8bc24b8988a925327ac0381c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86941784237549838bba63ce88053b88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:00:50.774644 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-4afd0817-d480-40df-9c79-2443d1fe455d tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] 10.222.0.13 "GET /compute/v2.1/servers/3796ef05-cc8e-44d4-8dfc-058b5dbc8cbd" status: 200 len: 1470 microversion: 2.1 time: 0.274031 Nov 01 19:00:50.775656 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 942/1878] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:00:50 2022] GET /compute/v2.1/servers/3796ef05-cc8e-44d4-8dfc-058b5dbc8cbd => generated 1470 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:00:50.794594 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-d21bd81d-4bdb-4b7a-829e-1b93aa39da2f tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:00:50.795428 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-d21bd81d-4bdb-4b7a-829e-1b93aa39da2f tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] [instance: cd879708-f757-4f88-bc95-38b6cd55363c] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:00:50.822805 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d21bd81d-4bdb-4b7a-829e-1b93aa39da2f tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:50.823755 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d21bd81d-4bdb-4b7a-829e-1b93aa39da2f tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:50.825750 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d21bd81d-4bdb-4b7a-829e-1b93aa39da2f tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:50.826710 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d21bd81d-4bdb-4b7a-829e-1b93aa39da2f tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:50.828445 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d21bd81d-4bdb-4b7a-829e-1b93aa39da2f tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:50.830049 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d21bd81d-4bdb-4b7a-829e-1b93aa39da2f tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:50.830204 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-3e4f83e0-d703-4009-8f62-ab7c996ae537 tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] 10.222.0.13 "GET /compute/v2.1/images/ccc79e7f-4589-43b9-a2ca-2a8f13b6602d" status: 200 len: 1455 microversion: 2.1 time: 0.103603 Nov 01 19:00:50.841559 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 937/1879] 10.222.0.13 () {58 vars in 1233 bytes} [Tue Nov 1 19:00:50 2022] GET /compute/v2.1/images/ccc79e7f-4589-43b9-a2ca-2a8f13b6602d => generated 1455 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:00:51.063396 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-d21bd81d-4bdb-4b7a-829e-1b93aa39da2f tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:00:51.073755 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-d21bd81d-4bdb-4b7a-829e-1b93aa39da2f tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:00:51.077364 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-d21bd81d-4bdb-4b7a-829e-1b93aa39da2f tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:00:51.079924 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-d21bd81d-4bdb-4b7a-829e-1b93aa39da2f tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] 10.222.0.13 "GET /compute/v2.1/servers/cd879708-f757-4f88-bc95-38b6cd55363c" status: 200 len: 1293 microversion: 2.25 time: 0.303054 Nov 01 19:00:51.105145 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 943/1880] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 19:00:50 2022] GET /compute/v2.1/servers/cd879708-f757-4f88-bc95-38b6cd55363c => generated 1293 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 19:00:51.116087 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-bac01f23-227b-4992-b4b0-860b147be4a3 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:00:51.116834 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-bac01f23-227b-4992-b4b0-860b147be4a3 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] [instance: 7218f99b-b011-4f08-931e-340d47069f6e] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:00:51.126807 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-bac01f23-227b-4992-b4b0-860b147be4a3 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:51.127559 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-bac01f23-227b-4992-b4b0-860b147be4a3 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:51.128154 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-bac01f23-227b-4992-b4b0-860b147be4a3 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:51.129043 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-bac01f23-227b-4992-b4b0-860b147be4a3 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:51.129657 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-bac01f23-227b-4992-b4b0-860b147be4a3 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:51.130264 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-bac01f23-227b-4992-b4b0-860b147be4a3 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:51.165245 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-bac01f23-227b-4992-b4b0-860b147be4a3 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:51.165993 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-bac01f23-227b-4992-b4b0-860b147be4a3 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:51.167246 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-bac01f23-227b-4992-b4b0-860b147be4a3 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:51.167854 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.objects.instance [None req-bac01f23-227b-4992-b4b0-860b147be4a3 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lazy-loading 'fault' on Instance uuid 7218f99b-b011-4f08-931e-340d47069f6e {{(pid=121402) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 01 19:00:51.214104 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-bac01f23-227b-4992-b4b0-860b147be4a3 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72117f17294649d6b8bc16c66c7efab2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45d4c047d3c44324a27a27831236ab0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:00:51.222032 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-bac01f23-227b-4992-b4b0-860b147be4a3 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] 10.222.0.13 "GET /compute/v2.1/servers/7218f99b-b011-4f08-931e-340d47069f6e" status: 200 len: 1302 microversion: 2.1 time: 0.110667 Nov 01 19:00:51.222845 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 938/1881] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:00:51 2022] GET /compute/v2.1/servers/7218f99b-b011-4f08-931e-340d47069f6e => generated 1302 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:00:51.239593 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-4bc7b7c5-2785-4157-b2c0-38d46c8b3f65 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:00:51.240462 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-4bc7b7c5-2785-4157-b2c0-38d46c8b3f65 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] [instance: 1f499af7-1896-478c-b7d7-d922bf78bd98] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:00:51.247687 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-4bc7b7c5-2785-4157-b2c0-38d46c8b3f65 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:51.248679 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-4bc7b7c5-2785-4157-b2c0-38d46c8b3f65 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:51.249471 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-4bc7b7c5-2785-4157-b2c0-38d46c8b3f65 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:51.250549 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-4bc7b7c5-2785-4157-b2c0-38d46c8b3f65 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:51.251004 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-4bc7b7c5-2785-4157-b2c0-38d46c8b3f65 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:51.251283 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-4bc7b7c5-2785-4157-b2c0-38d46c8b3f65 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:51.406201 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-4bc7b7c5-2785-4157-b2c0-38d46c8b3f65 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f32f5fba1976432d938e664c7714e52b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b9d4c236b944f9b2e8e502a50a8f8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:00:51.415982 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-4bc7b7c5-2785-4157-b2c0-38d46c8b3f65 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] 10.222.0.13 "GET /compute/v2.1/servers/1f499af7-1896-478c-b7d7-d922bf78bd98" status: 200 len: 1391 microversion: 2.1 time: 0.180363 Nov 01 19:00:51.417265 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 944/1882] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:00:51 2022] GET /compute/v2.1/servers/1f499af7-1896-478c-b7d7-d922bf78bd98 => generated 1391 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 19:00:51.738980 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [req-b1da8b54-1be7-419f-a826-83f97014774d req-8b230208-0ce0-4e7b-9776-88291ed6f7ad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "495c1822-a615-4da7-a053-227744a46341", "name": "network-vif-deleted", "tag": "7422b34a-996e-4f74-9ae8-e9724a7accf8"}]} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:00:51.749774 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-4a244f4c-a0f5-4fab-88f8-fa5631ee57d1 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:00:51.750720 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-4a244f4c-a0f5-4fab-88f8-fa5631ee57d1 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] [instance: 495c1822-a615-4da7-a053-227744a46341] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:00:51.766997 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-4a244f4c-a0f5-4fab-88f8-fa5631ee57d1 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:51.772251 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-b1da8b54-1be7-419f-a826-83f97014774d req-8b230208-0ce0-4e7b-9776-88291ed6f7ad service nova] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:51.773225 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-4a244f4c-a0f5-4fab-88f8-fa5631ee57d1 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:51.774657 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-4a244f4c-a0f5-4fab-88f8-fa5631ee57d1 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:51.776233 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-b1da8b54-1be7-419f-a826-83f97014774d req-8b230208-0ce0-4e7b-9776-88291ed6f7ad service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:51.777317 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-b1da8b54-1be7-419f-a826-83f97014774d req-8b230208-0ce0-4e7b-9776-88291ed6f7ad service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:51.777840 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-4a244f4c-a0f5-4fab-88f8-fa5631ee57d1 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:51.778460 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-4a244f4c-a0f5-4fab-88f8-fa5631ee57d1 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:51.783062 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-4a244f4c-a0f5-4fab-88f8-fa5631ee57d1 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:51.817729 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.compute.server_external_events [req-b1da8b54-1be7-419f-a826-83f97014774d req-8b230208-0ce0-4e7b-9776-88291ed6f7ad service nova] Creating event network-vif-deleted:7422b34a-996e-4f74-9ae8-e9724a7accf8 for instance 495c1822-a615-4da7-a053-227744a46341 on n-h2-863052-2 Nov 01 19:00:51.841872 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [req-b1da8b54-1be7-419f-a826-83f97014774d req-8b230208-0ce0-4e7b-9776-88291ed6f7ad service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106678 Nov 01 19:00:51.845308 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 939/1883] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Nov 1 19:00:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:00:51.878993 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-c935ec4f-868b-40be-aa4e-bb006bfed46d tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:00:51.891695 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-c935ec4f-868b-40be-aa4e-bb006bfed46d tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] [instance: 3796ef05-cc8e-44d4-8dfc-058b5dbc8cbd] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:00:51.921397 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-c935ec4f-868b-40be-aa4e-bb006bfed46d tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:51.927964 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-c935ec4f-868b-40be-aa4e-bb006bfed46d tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:51.928733 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-c935ec4f-868b-40be-aa4e-bb006bfed46d tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:51.938896 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-c935ec4f-868b-40be-aa4e-bb006bfed46d tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:51.939481 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-c935ec4f-868b-40be-aa4e-bb006bfed46d tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:51.939978 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-c935ec4f-868b-40be-aa4e-bb006bfed46d tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:51.958839 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-4a244f4c-a0f5-4fab-88f8-fa5631ee57d1 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:51.959325 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-4a244f4c-a0f5-4fab-88f8-fa5631ee57d1 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:51.959752 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-4a244f4c-a0f5-4fab-88f8-fa5631ee57d1 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:51.960203 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.objects.instance [None req-4a244f4c-a0f5-4fab-88f8-fa5631ee57d1 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Lazy-loading 'fault' on Instance uuid 495c1822-a615-4da7-a053-227744a46341 {{(pid=121403) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 01 19:00:52.120237 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-4a244f4c-a0f5-4fab-88f8-fa5631ee57d1 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a9c3b6a8c34f068caa50dc10d13a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9ef08eba0ef431285fd15a2561b4e5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:00:52.133271 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-4a244f4c-a0f5-4fab-88f8-fa5631ee57d1 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] 10.222.0.13 "GET /compute/v2.1/servers/495c1822-a615-4da7-a053-227744a46341" status: 200 len: 1306 microversion: 2.1 time: 0.387110 Nov 01 19:00:52.153416 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 945/1884] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:00:51 2022] GET /compute/v2.1/servers/495c1822-a615-4da7-a053-227744a46341 => generated 1306 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 19:00:52.163303 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-c9f1575f-1b47-4050-8589-1250c2f8daea tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] Calling method '.version_select at 0x7f0ae28bda60>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:00:52.261174 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-c9f1575f-1b47-4050-8589-1250c2f8daea tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] 10.222.0.13 "GET /compute/v2.1/images/ccc79e7f-4589-43b9-a2ca-2a8f13b6602d" status: 200 len: 1455 microversion: 2.1 time: 0.105828 Nov 01 19:00:52.270915 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 946/1885] 10.222.0.13 () {58 vars in 1233 bytes} [Tue Nov 1 19:00:52 2022] GET /compute/v2.1/images/ccc79e7f-4589-43b9-a2ca-2a8f13b6602d => generated 1455 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:00:52.288460 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-e1502154-2bc4-4a40-b92d-2246a3c36d9a tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:00:52.289505 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-e1502154-2bc4-4a40-b92d-2246a3c36d9a tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] [instance: cd879708-f757-4f88-bc95-38b6cd55363c] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:00:52.298255 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-e1502154-2bc4-4a40-b92d-2246a3c36d9a tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:52.300277 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-e1502154-2bc4-4a40-b92d-2246a3c36d9a tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:52.300960 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-e1502154-2bc4-4a40-b92d-2246a3c36d9a tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:52.302900 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-e1502154-2bc4-4a40-b92d-2246a3c36d9a tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:52.311292 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-e1502154-2bc4-4a40-b92d-2246a3c36d9a tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:52.312210 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-e1502154-2bc4-4a40-b92d-2246a3c36d9a tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:52.531665 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-c935ec4f-868b-40be-aa4e-bb006bfed46d tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0290a6bb8bc24b8988a925327ac0381c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86941784237549838bba63ce88053b88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:00:52.566007 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-c935ec4f-868b-40be-aa4e-bb006bfed46d tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] 10.222.0.13 "GET /compute/v2.1/servers/3796ef05-cc8e-44d4-8dfc-058b5dbc8cbd" status: 200 len: 1470 microversion: 2.1 time: 0.718727 Nov 01 19:00:52.569280 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 940/1886] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:00:51 2022] GET /compute/v2.1/servers/3796ef05-cc8e-44d4-8dfc-058b5dbc8cbd => generated 1470 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:00:52.731775 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-e1502154-2bc4-4a40-b92d-2246a3c36d9a tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:00:52.759245 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-e1502154-2bc4-4a40-b92d-2246a3c36d9a tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:00:52.764283 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-e1502154-2bc4-4a40-b92d-2246a3c36d9a tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:00:52.769064 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-e1502154-2bc4-4a40-b92d-2246a3c36d9a tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] 10.222.0.13 "GET /compute/v2.1/servers/cd879708-f757-4f88-bc95-38b6cd55363c" status: 200 len: 1293 microversion: 2.25 time: 0.497206 Nov 01 19:00:52.771030 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 947/1887] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 19:00:52 2022] GET /compute/v2.1/servers/cd879708-f757-4f88-bc95-38b6cd55363c => generated 1293 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 19:00:52.782076 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-5d253232-310d-4724-92b8-b6e8e1b71462 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:00:52.783761 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-5d253232-310d-4724-92b8-b6e8e1b71462 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] [instance: 1f499af7-1896-478c-b7d7-d922bf78bd98] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:00:52.817489 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-5d253232-310d-4724-92b8-b6e8e1b71462 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:52.821863 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-5d253232-310d-4724-92b8-b6e8e1b71462 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:52.823551 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-5d253232-310d-4724-92b8-b6e8e1b71462 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:52.824475 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-5d253232-310d-4724-92b8-b6e8e1b71462 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:52.829305 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-5d253232-310d-4724-92b8-b6e8e1b71462 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:52.830003 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-5d253232-310d-4724-92b8-b6e8e1b71462 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:52.844095 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-a9d0c15a-2367-4592-9230-1e7df5782950 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:00:52.845478 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-a9d0c15a-2367-4592-9230-1e7df5782950 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] [instance: 7218f99b-b011-4f08-931e-340d47069f6e] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:00:52.856993 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-a9d0c15a-2367-4592-9230-1e7df5782950 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:52.857898 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-a9d0c15a-2367-4592-9230-1e7df5782950 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:52.859242 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-a9d0c15a-2367-4592-9230-1e7df5782950 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:52.862061 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-a9d0c15a-2367-4592-9230-1e7df5782950 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:52.862826 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-a9d0c15a-2367-4592-9230-1e7df5782950 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:52.864701 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-a9d0c15a-2367-4592-9230-1e7df5782950 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:52.897570 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.wsgi [None req-a9d0c15a-2367-4592-9230-1e7df5782950 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] HTTP exception thrown: Instance 7218f99b-b011-4f08-931e-340d47069f6e could not be found. Nov 01 19:00:52.901582 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-a9d0c15a-2367-4592-9230-1e7df5782950 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Request method failure captured: Nov 01 19:00:52.901582 n-d-863052-2 devstack@n-api.service[121402]: request: GET /compute/v2.1/servers/7218f99b-b011-4f08-931e-340d47069f6e HTTP/1.1 Nov 01 19:00:52.901582 n-d-863052-2 devstack@n-api.service[121402]: Accept: application/json Nov 01 19:00:52.901582 n-d-863052-2 devstack@n-api.service[121402]: Accept-Encoding: identity Nov 01 19:00:52.901582 n-d-863052-2 devstack@n-api.service[121402]: Connection: close Nov 01 19:00:52.901582 n-d-863052-2 devstack@n-api.service[121402]: Content-Length: 0 Nov 01 19:00:52.901582 n-d-863052-2 devstack@n-api.service[121402]: Content-Type: application/json Nov 01 19:00:52.901582 n-d-863052-2 devstack@n-api.service[121402]: Host: 10.222.0.13 Nov 01 19:00:52.901582 n-d-863052-2 devstack@n-api.service[121402]: Openstack-System-Scope: None Nov 01 19:00:52.901582 n-d-863052-2 devstack@n-api.service[121402]: User-Agent: python-urllib3/1.26.12 Nov 01 19:00:52.901582 n-d-863052-2 devstack@n-api.service[121402]: X-Auth-Token: gAAAAABjYWu1cGHDBxLRMjfy5LV4CzwBbby5Te03nghiWl2YAj4Ezmd18PffZt5qzbLABcrwuhmojlV_K_bvZhDIRPoos5aj6lXnm72mv-YhsVHN9km2tJrzabw39H9HZ1hhBDokeXANnwtfyn136Q1Cru25X1_I6UbFCfvnbjmmRbzWxTIcXPc Nov 01 19:00:52.901582 n-d-863052-2 devstack@n-api.service[121402]: X-Domain-Id: None Nov 01 19:00:52.901582 n-d-863052-2 devstack@n-api.service[121402]: X-Domain-Name: None Nov 01 19:00:52.901582 n-d-863052-2 devstack@n-api.service[121402]: X-Identity-Status: Confirmed Nov 01 19:00:52.901582 n-d-863052-2 devstack@n-api.service[121402]: X-Is-Admin-Project: True Nov 01 19:00:52.901582 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Domain-Id: default Nov 01 19:00:52.901582 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Domain-Name: Default Nov 01 19:00:52.901582 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Id: 45d4c047d3c44324a27a27831236ab0d Nov 01 19:00:52.901582 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Name: tempest-MigrationsAdminTest-2112861741 Nov 01 19:00:52.901582 n-d-863052-2 devstack@n-api.service[121402]: X-Role: member,reader Nov 01 19:00:52.901582 n-d-863052-2 devstack@n-api.service[121402]: X-Roles: member,reader Nov 01 19:00:52.903160 n-d-863052-2 devstack@n-api.service[121402]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/45d4c047d3c44324a27a27831236ab0d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/45d4c047d3c44324a27a27831236ab0d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_45d4c047d3c44324a27a27831236ab0d", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/45d4c047d3c44324a27a27831236ab0d"}]}] Nov 01 19:00:52.903160 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant: tempest-MigrationsAdminTest-2112861741 Nov 01 19:00:52.903160 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant-Id: 45d4c047d3c44324a27a27831236ab0d Nov 01 19:00:52.903160 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant-Name: tempest-MigrationsAdminTest-2112861741 Nov 01 19:00:52.903160 n-d-863052-2 devstack@n-api.service[121402]: X-User: tempest-MigrationsAdminTest-2112861741-project Nov 01 19:00:52.903160 n-d-863052-2 devstack@n-api.service[121402]: X-User-Domain-Id: default Nov 01 19:00:52.903160 n-d-863052-2 devstack@n-api.service[121402]: X-User-Domain-Name: Default Nov 01 19:00:52.903160 n-d-863052-2 devstack@n-api.service[121402]: X-User-Id: 72117f17294649d6b8bc16c66c7efab2 Nov 01 19:00:52.903160 n-d-863052-2 devstack@n-api.service[121402]: X-User-Name: tempest-MigrationsAdminTest-2112861741-project Nov 01 19:00:52.903160 n-d-863052-2 devstack@n-api.service[121402]: method: > Nov 01 19:00:52.903160 n-d-863052-2 devstack@n-api.service[121402]: exception: Instance 7218f99b-b011-4f08-931e-340d47069f6e could not be found. Nov 01 19:00:52.903160 n-d-863052-2 devstack@n-api.service[121402]: action_args: {'id': '7218f99b-b011-4f08-931e-340d47069f6e'} Nov 01 19:00:52.904021 n-d-863052-2 devstack@n-api.service[121402]: {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 01 19:00:52.904021 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:00:52.904021 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 01 19:00:52.904021 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 01 19:00:52.904021 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 01 19:00:52.904021 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 01 19:00:52.904021 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 01 19:00:52.904021 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 01 19:00:52.904021 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 01 19:00:52.904021 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 01 19:00:52.904021 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7218f99b-b011-4f08-931e-340d47069f6e could not be found. Nov 01 19:00:52.904021 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:00:52.904021 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:00:52.904021 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:00:52.904021 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:00:52.904021 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:00:52.904021 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:00:52.904021 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 01 19:00:52.904021 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 01 19:00:52.904021 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 01 19:00:52.905456 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 01 19:00:52.905456 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 01 19:00:52.905456 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 01 19:00:52.905456 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 01 19:00:52.905456 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 01 19:00:52.905456 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 01 19:00:52.905456 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 01 19:00:52.905456 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7218f99b-b011-4f08-931e-340d47069f6e could not be found. Nov 01 19:00:52.905456 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:00:52.905456 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:00:52.905456 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:00:52.905456 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:00:52.905456 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:00:52.905456 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:00:52.905456 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 01 19:00:52.905456 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 01 19:00:52.905456 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7218f99b-b011-4f08-931e-340d47069f6e could not be found. Nov 01 19:00:52.905456 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:00:52.907865 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-a9d0c15a-2367-4592-9230-1e7df5782950 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Returning 404 to user: Instance 7218f99b-b011-4f08-931e-340d47069f6e could not be found. {{(pid=121402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 01 19:00:52.908961 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-a9d0c15a-2367-4592-9230-1e7df5782950 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] 10.222.0.13 "GET /compute/v2.1/servers/7218f99b-b011-4f08-931e-340d47069f6e" status: 404 len: 111 microversion: 2.1 time: 0.311828 Nov 01 19:00:52.910057 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 941/1888] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:00:52 2022] GET /compute/v2.1/servers/7218f99b-b011-4f08-931e-340d47069f6e => generated 111 bytes in 313 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 01 19:00:52.920244 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-af171fe9-7daa-4877-8c99-9dccdc71f4dc tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:00:52.929778 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-af171fe9-7daa-4877-8c99-9dccdc71f4dc tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] [instance: 614eb691-9a9a-4ca0-933d-686d80cc0ef1] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:00:52.940212 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-af171fe9-7daa-4877-8c99-9dccdc71f4dc tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:52.944568 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-af171fe9-7daa-4877-8c99-9dccdc71f4dc tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:52.945248 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-af171fe9-7daa-4877-8c99-9dccdc71f4dc tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:52.946157 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-af171fe9-7daa-4877-8c99-9dccdc71f4dc tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:52.955989 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-af171fe9-7daa-4877-8c99-9dccdc71f4dc tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:52.956662 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-af171fe9-7daa-4877-8c99-9dccdc71f4dc tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:53.026106 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-af171fe9-7daa-4877-8c99-9dccdc71f4dc tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] [instance: 614eb691-9a9a-4ca0-933d-686d80cc0ef1] Going to try to terminate instance {{(pid=121402) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 01 19:00:53.227858 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-af171fe9-7daa-4877-8c99-9dccdc71f4dc tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] 10.222.0.13 "DELETE /compute/v2.1/servers/614eb691-9a9a-4ca0-933d-686d80cc0ef1" status: 204 len: 0 microversion: 2.1 time: 0.313581 Nov 01 19:00:53.233196 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 942/1889] 10.222.0.13 () {58 vars in 1239 bytes} [Tue Nov 1 19:00:52 2022] DELETE /compute/v2.1/servers/614eb691-9a9a-4ca0-933d-686d80cc0ef1 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 01 19:00:53.244934 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-b62d6822-9798-403e-b20b-223cda677dd4 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:00:53.245899 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-b62d6822-9798-403e-b20b-223cda677dd4 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] [instance: 495c1822-a615-4da7-a053-227744a46341] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:00:53.264556 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b62d6822-9798-403e-b20b-223cda677dd4 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:53.265089 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b62d6822-9798-403e-b20b-223cda677dd4 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:53.265529 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b62d6822-9798-403e-b20b-223cda677dd4 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:53.266262 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b62d6822-9798-403e-b20b-223cda677dd4 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:53.266712 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b62d6822-9798-403e-b20b-223cda677dd4 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:53.267452 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b62d6822-9798-403e-b20b-223cda677dd4 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:53.268244 n-d-863052-2 devstack@n-api.service[121402]: DEBUG dbcounter [-] [121402] Writing DB stats nova_cell0:SELECT=2 {{(pid=121402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 19:00:53.298820 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.wsgi [None req-b62d6822-9798-403e-b20b-223cda677dd4 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] HTTP exception thrown: Instance 495c1822-a615-4da7-a053-227744a46341 could not be found. Nov 01 19:00:53.300997 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-b62d6822-9798-403e-b20b-223cda677dd4 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Request method failure captured: Nov 01 19:00:53.300997 n-d-863052-2 devstack@n-api.service[121402]: request: GET /compute/v2.1/servers/495c1822-a615-4da7-a053-227744a46341 HTTP/1.1 Nov 01 19:00:53.300997 n-d-863052-2 devstack@n-api.service[121402]: Accept: application/json Nov 01 19:00:53.300997 n-d-863052-2 devstack@n-api.service[121402]: Accept-Encoding: identity Nov 01 19:00:53.300997 n-d-863052-2 devstack@n-api.service[121402]: Connection: close Nov 01 19:00:53.300997 n-d-863052-2 devstack@n-api.service[121402]: Content-Length: 0 Nov 01 19:00:53.300997 n-d-863052-2 devstack@n-api.service[121402]: Content-Type: application/json Nov 01 19:00:53.300997 n-d-863052-2 devstack@n-api.service[121402]: Host: 10.222.0.13 Nov 01 19:00:53.300997 n-d-863052-2 devstack@n-api.service[121402]: Openstack-System-Scope: None Nov 01 19:00:53.300997 n-d-863052-2 devstack@n-api.service[121402]: User-Agent: python-urllib3/1.26.12 Nov 01 19:00:53.300997 n-d-863052-2 devstack@n-api.service[121402]: X-Auth-Token: gAAAAABjYWyBtiXfeZJIejT83Ksslz2hqDZRAGe29hQVddGupa2qgtVXWeGxqJACkYUk64AE7WNmKMU9sisFWqkZV1B8K0xSz0uDHshwD54pFesORYzaFN_rWLCdcUKPHyx9WACJmd6ZEeb3LBT9WzZa08oHURzA6g0G4BDfSDsuxDk4mdVs9fM Nov 01 19:00:53.300997 n-d-863052-2 devstack@n-api.service[121402]: X-Domain-Id: None Nov 01 19:00:53.300997 n-d-863052-2 devstack@n-api.service[121402]: X-Domain-Name: None Nov 01 19:00:53.300997 n-d-863052-2 devstack@n-api.service[121402]: X-Identity-Status: Confirmed Nov 01 19:00:53.300997 n-d-863052-2 devstack@n-api.service[121402]: X-Is-Admin-Project: True Nov 01 19:00:53.300997 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Domain-Id: default Nov 01 19:00:53.300997 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Domain-Name: Default Nov 01 19:00:53.300997 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Id: a9ef08eba0ef431285fd15a2561b4e5d Nov 01 19:00:53.300997 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Name: tempest-SecurityGroupsTestJSON-1185949800 Nov 01 19:00:53.300997 n-d-863052-2 devstack@n-api.service[121402]: X-Role: member,reader Nov 01 19:00:53.300997 n-d-863052-2 devstack@n-api.service[121402]: X-Roles: member,reader Nov 01 19:00:53.302786 n-d-863052-2 devstack@n-api.service[121402]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/a9ef08eba0ef431285fd15a2561b4e5d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/a9ef08eba0ef431285fd15a2561b4e5d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_a9ef08eba0ef431285fd15a2561b4e5d", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/a9ef08eba0ef431285fd15a2561b4e5d"}]}] Nov 01 19:00:53.302786 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant: tempest-SecurityGroupsTestJSON-1185949800 Nov 01 19:00:53.302786 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant-Id: a9ef08eba0ef431285fd15a2561b4e5d Nov 01 19:00:53.302786 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1185949800 Nov 01 19:00:53.302786 n-d-863052-2 devstack@n-api.service[121402]: X-User: tempest-SecurityGroupsTestJSON-1185949800-project Nov 01 19:00:53.302786 n-d-863052-2 devstack@n-api.service[121402]: X-User-Domain-Id: default Nov 01 19:00:53.302786 n-d-863052-2 devstack@n-api.service[121402]: X-User-Domain-Name: Default Nov 01 19:00:53.302786 n-d-863052-2 devstack@n-api.service[121402]: X-User-Id: 55a9c3b6a8c34f068caa50dc10d13a85 Nov 01 19:00:53.302786 n-d-863052-2 devstack@n-api.service[121402]: X-User-Name: tempest-SecurityGroupsTestJSON-1185949800-project Nov 01 19:00:53.302786 n-d-863052-2 devstack@n-api.service[121402]: method: > Nov 01 19:00:53.302786 n-d-863052-2 devstack@n-api.service[121402]: exception: Instance 495c1822-a615-4da7-a053-227744a46341 could not be found. Nov 01 19:00:53.302786 n-d-863052-2 devstack@n-api.service[121402]: action_args: {'id': '495c1822-a615-4da7-a053-227744a46341'} Nov 01 19:00:53.303629 n-d-863052-2 devstack@n-api.service[121402]: {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 01 19:00:53.303629 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:00:53.303629 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 01 19:00:53.303629 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 01 19:00:53.303629 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 01 19:00:53.303629 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 01 19:00:53.303629 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 01 19:00:53.303629 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 01 19:00:53.303629 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 01 19:00:53.303629 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 01 19:00:53.303629 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 495c1822-a615-4da7-a053-227744a46341 could not be found. Nov 01 19:00:53.303629 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:00:53.303629 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:00:53.303629 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:00:53.303629 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:00:53.303629 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:00:53.303629 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:00:53.303629 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 01 19:00:53.303629 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 01 19:00:53.303629 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 01 19:00:53.305058 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 01 19:00:53.305058 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 01 19:00:53.305058 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 01 19:00:53.305058 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 01 19:00:53.305058 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 01 19:00:53.305058 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 01 19:00:53.305058 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 01 19:00:53.305058 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 495c1822-a615-4da7-a053-227744a46341 could not be found. Nov 01 19:00:53.305058 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:00:53.305058 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:00:53.305058 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:00:53.305058 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:00:53.305058 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:00:53.305058 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:00:53.305058 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 01 19:00:53.305058 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 01 19:00:53.305058 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 495c1822-a615-4da7-a053-227744a46341 could not be found. Nov 01 19:00:53.305058 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:00:53.307909 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-b62d6822-9798-403e-b20b-223cda677dd4 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Returning 404 to user: Instance 495c1822-a615-4da7-a053-227744a46341 could not be found. {{(pid=121402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 01 19:00:53.309003 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-b62d6822-9798-403e-b20b-223cda677dd4 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] 10.222.0.13 "GET /compute/v2.1/servers/495c1822-a615-4da7-a053-227744a46341" status: 404 len: 111 microversion: 2.1 time: 0.077396 Nov 01 19:00:53.319199 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 943/1890] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:00:53 2022] GET /compute/v2.1/servers/495c1822-a615-4da7-a053-227744a46341 => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 01 19:00:53.327591 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-cfd580cf-3b3f-4399-956f-378485a8e837 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:00:53.335572 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-cfd580cf-3b3f-4399-956f-378485a8e837 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] [instance: 614eb691-9a9a-4ca0-933d-686d80cc0ef1] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:00:53.357199 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-cfd580cf-3b3f-4399-956f-378485a8e837 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:53.358041 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-cfd580cf-3b3f-4399-956f-378485a8e837 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:53.358915 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-cfd580cf-3b3f-4399-956f-378485a8e837 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:53.360057 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-cfd580cf-3b3f-4399-956f-378485a8e837 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:53.360892 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-cfd580cf-3b3f-4399-956f-378485a8e837 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:53.362478 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-cfd580cf-3b3f-4399-956f-378485a8e837 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:53.455344 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-5d253232-310d-4724-92b8-b6e8e1b71462 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f32f5fba1976432d938e664c7714e52b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b9d4c236b944f9b2e8e502a50a8f8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:00:53.465596 n-d-863052-2 devstack@n-api.service[121403]: DEBUG dbcounter [-] [121403] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 19:00:53.471298 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-5d253232-310d-4724-92b8-b6e8e1b71462 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] 10.222.0.13 "GET /compute/v2.1/servers/1f499af7-1896-478c-b7d7-d922bf78bd98" status: 200 len: 1391 microversion: 2.1 time: 0.698728 Nov 01 19:00:53.485801 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 948/1891] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:00:52 2022] GET /compute/v2.1/servers/1f499af7-1896-478c-b7d7-d922bf78bd98 => generated 1391 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:00:53.485801 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [req-e9dd6d09-85c1-4abd-a741-fec4f9be6a34 req-f1276840-bee0-46eb-8a19-0475c645505d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cd879708-f757-4f88-bc95-38b6cd55363c", "tag": "5814506e-bf1a-49cf-9169-b3181e825901"}]} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:00:53.489424 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-e9dd6d09-85c1-4abd-a741-fec4f9be6a34 req-f1276840-bee0-46eb-8a19-0475c645505d service nova] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:53.490283 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-e9dd6d09-85c1-4abd-a741-fec4f9be6a34 req-f1276840-bee0-46eb-8a19-0475c645505d service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:53.491389 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-e9dd6d09-85c1-4abd-a741-fec4f9be6a34 req-f1276840-bee0-46eb-8a19-0475c645505d service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:53.506359 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.compute.server_external_events [req-e9dd6d09-85c1-4abd-a741-fec4f9be6a34 req-f1276840-bee0-46eb-8a19-0475c645505d service nova] Creating event network-changed:5814506e-bf1a-49cf-9169-b3181e825901 for instance cd879708-f757-4f88-bc95-38b6cd55363c on n-h2-863052-2 Nov 01 19:00:53.513632 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [req-e9dd6d09-85c1-4abd-a741-fec4f9be6a34 req-f1276840-bee0-46eb-8a19-0475c645505d service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039984 Nov 01 19:00:53.515043 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 949/1892] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Nov 1 19:00:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:00:53.523631 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-becb3af7-0dc1-4dd2-9747-9547c55dd944 tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] Calling method '.version_select at 0x7f0ae225bdc0>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:00:53.638229 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-becb3af7-0dc1-4dd2-9747-9547c55dd944 tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] 10.222.0.13 "GET /compute/v2.1/images/ccc79e7f-4589-43b9-a2ca-2a8f13b6602d" status: 200 len: 1455 microversion: 2.1 time: 0.121671 Nov 01 19:00:53.639122 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 950/1893] 10.222.0.13 () {58 vars in 1233 bytes} [Tue Nov 1 19:00:53 2022] GET /compute/v2.1/images/ccc79e7f-4589-43b9-a2ca-2a8f13b6602d => generated 1455 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:00:53.643826 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-2d73a411-a885-4618-9e5f-327fe6723417 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Calling method '.version_select at 0x7f0ae20ea430>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:00:53.838315 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-cfd580cf-3b3f-4399-956f-378485a8e837 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72117f17294649d6b8bc16c66c7efab2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45d4c047d3c44324a27a27831236ab0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:00:53.847330 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-cfd580cf-3b3f-4399-956f-378485a8e837 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] 10.222.0.13 "GET /compute/v2.1/servers/614eb691-9a9a-4ca0-933d-686d80cc0ef1" status: 200 len: 1467 microversion: 2.1 time: 0.526594 Nov 01 19:00:53.854190 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 944/1894] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:00:53 2022] GET /compute/v2.1/servers/614eb691-9a9a-4ca0-933d-686d80cc0ef1 => generated 1467 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:00:53.873369 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-b22a6f1e-f0ca-4dc1-945d-cafb3c8574de tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:00:53.876512 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-b22a6f1e-f0ca-4dc1-945d-cafb3c8574de tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] [instance: 3796ef05-cc8e-44d4-8dfc-058b5dbc8cbd] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:00:53.890774 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b22a6f1e-f0ca-4dc1-945d-cafb3c8574de tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:53.892462 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b22a6f1e-f0ca-4dc1-945d-cafb3c8574de tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:53.894888 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b22a6f1e-f0ca-4dc1-945d-cafb3c8574de tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:53.895836 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b22a6f1e-f0ca-4dc1-945d-cafb3c8574de tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:53.897117 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b22a6f1e-f0ca-4dc1-945d-cafb3c8574de tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:53.897751 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b22a6f1e-f0ca-4dc1-945d-cafb3c8574de tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:54.045847 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-2d73a411-a885-4618-9e5f-327fe6723417 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] 10.222.0.13 "DELETE /compute/v2.1/os-security-groups/ac361b9e-7d39-49f8-9192-66e9c5fe511b" status: 202 len: 0 microversion: 2.1 time: 0.405636 Nov 01 19:00:54.046633 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 951/1895] 10.222.0.13 () {58 vars in 1272 bytes} [Tue Nov 1 19:00:53 2022] DELETE /compute/v2.1/os-security-groups/ac361b9e-7d39-49f8-9192-66e9c5fe511b => generated 0 bytes in 407 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 01 19:00:54.055778 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-153c79bb-5b0e-42aa-b932-bc84b47f30ae tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:00:54.056837 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-153c79bb-5b0e-42aa-b932-bc84b47f30ae tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] [instance: cd879708-f757-4f88-bc95-38b6cd55363c] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:00:54.082930 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-153c79bb-5b0e-42aa-b932-bc84b47f30ae tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:54.084852 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-153c79bb-5b0e-42aa-b932-bc84b47f30ae tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:54.085732 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-153c79bb-5b0e-42aa-b932-bc84b47f30ae tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:54.087814 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-153c79bb-5b0e-42aa-b932-bc84b47f30ae tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:54.090340 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-153c79bb-5b0e-42aa-b932-bc84b47f30ae tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:54.091127 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-153c79bb-5b0e-42aa-b932-bc84b47f30ae tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:54.223927 n-d-863052-2 devstack@n-api.service[121402]: DEBUG dbcounter [-] [121402] Writing DB stats nova_cell0:SELECT=8 {{(pid=121402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 19:00:54.239949 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-b22a6f1e-f0ca-4dc1-945d-cafb3c8574de tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0290a6bb8bc24b8988a925327ac0381c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86941784237549838bba63ce88053b88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:00:54.251036 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-b22a6f1e-f0ca-4dc1-945d-cafb3c8574de tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] 10.222.0.13 "GET /compute/v2.1/servers/3796ef05-cc8e-44d4-8dfc-058b5dbc8cbd" status: 200 len: 1300 microversion: 2.1 time: 0.395542 Nov 01 19:00:54.251571 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 945/1896] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:00:53 2022] GET /compute/v2.1/servers/3796ef05-cc8e-44d4-8dfc-058b5dbc8cbd => generated 1300 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:00:54.256032 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [req-47c9561a-f578-443b-a48d-12997b89eb9f req-7600e955-f74f-4b05-a820-8abb2707c28e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3796ef05-cc8e-44d4-8dfc-058b5dbc8cbd", "name": "network-vif-deleted", "tag": "42ac695b-939d-43c0-9e82-2359f65aad09"}]} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:00:54.314752 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-47c9561a-f578-443b-a48d-12997b89eb9f req-7600e955-f74f-4b05-a820-8abb2707c28e service nova] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:54.322997 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-47c9561a-f578-443b-a48d-12997b89eb9f req-7600e955-f74f-4b05-a820-8abb2707c28e service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:54.326075 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-47c9561a-f578-443b-a48d-12997b89eb9f req-7600e955-f74f-4b05-a820-8abb2707c28e service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:54.362651 n-d-863052-2 devstack@n-api.service[121403]: DEBUG dbcounter [-] [121403] Writing DB stats nova_cell0:SELECT=2 {{(pid=121403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 19:00:54.383556 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.compute.server_external_events [req-47c9561a-f578-443b-a48d-12997b89eb9f req-7600e955-f74f-4b05-a820-8abb2707c28e service nova] Creating event network-vif-deleted:42ac695b-939d-43c0-9e82-2359f65aad09 for instance 3796ef05-cc8e-44d4-8dfc-058b5dbc8cbd on n-h2-863052-2 Nov 01 19:00:54.398428 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [req-47c9561a-f578-443b-a48d-12997b89eb9f req-7600e955-f74f-4b05-a820-8abb2707c28e service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.145623 Nov 01 19:00:54.401012 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 946/1897] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Nov 1 19:00:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:00:54.409113 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-2205032c-aee2-4f2d-b728-8365105a5706 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] Calling method '.version_select at 0x7f0ae1ccad30>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:00:54.483715 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-153c79bb-5b0e-42aa-b932-bc84b47f30ae tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:00:54.492294 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-153c79bb-5b0e-42aa-b932-bc84b47f30ae tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:00:54.493779 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-153c79bb-5b0e-42aa-b932-bc84b47f30ae tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:00:54.499213 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-153c79bb-5b0e-42aa-b932-bc84b47f30ae tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] 10.222.0.13 "GET /compute/v2.1/servers/cd879708-f757-4f88-bc95-38b6cd55363c" status: 200 len: 1293 microversion: 2.25 time: 0.451592 Nov 01 19:00:54.506320 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 952/1898] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 19:00:54 2022] GET /compute/v2.1/servers/cd879708-f757-4f88-bc95-38b6cd55363c => generated 1293 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 19:00:54.511475 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-990c017c-45fa-4626-b67b-df6456013d31 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:00:54.514264 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-990c017c-45fa-4626-b67b-df6456013d31 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] [instance: 1f499af7-1896-478c-b7d7-d922bf78bd98] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:00:54.530967 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-990c017c-45fa-4626-b67b-df6456013d31 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:54.531800 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-990c017c-45fa-4626-b67b-df6456013d31 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:54.532436 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-990c017c-45fa-4626-b67b-df6456013d31 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:54.533513 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-990c017c-45fa-4626-b67b-df6456013d31 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:54.534298 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-990c017c-45fa-4626-b67b-df6456013d31 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:54.534950 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-990c017c-45fa-4626-b67b-df6456013d31 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:54.853486 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-990c017c-45fa-4626-b67b-df6456013d31 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f32f5fba1976432d938e664c7714e52b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b9d4c236b944f9b2e8e502a50a8f8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:00:54.862308 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-990c017c-45fa-4626-b67b-df6456013d31 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] 10.222.0.13 "GET /compute/v2.1/servers/1f499af7-1896-478c-b7d7-d922bf78bd98" status: 200 len: 1391 microversion: 2.1 time: 0.354470 Nov 01 19:00:54.865823 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 953/1899] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:00:54 2022] GET /compute/v2.1/servers/1f499af7-1896-478c-b7d7-d922bf78bd98 => generated 1391 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:00:54.875836 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-dc27fc82-c1c5-4903-adca-ddccea379719 tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] Calling method '.version_select at 0x7f0ae28641f0>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:00:54.965223 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-dc27fc82-c1c5-4903-adca-ddccea379719 tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] 10.222.0.13 "GET /compute/v2.1/images/ccc79e7f-4589-43b9-a2ca-2a8f13b6602d" status: 200 len: 1455 microversion: 2.1 time: 0.097871 Nov 01 19:00:54.967930 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 954/1900] 10.222.0.13 () {58 vars in 1233 bytes} [Tue Nov 1 19:00:54 2022] GET /compute/v2.1/images/ccc79e7f-4589-43b9-a2ca-2a8f13b6602d => generated 1455 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:00:54.973720 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-d444b116-83a6-4cb1-84b8-76dcacf335d1 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:00:54.974711 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-d444b116-83a6-4cb1-84b8-76dcacf335d1 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] [instance: 614eb691-9a9a-4ca0-933d-686d80cc0ef1] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:00:55.006197 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d444b116-83a6-4cb1-84b8-76dcacf335d1 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:55.017805 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d444b116-83a6-4cb1-84b8-76dcacf335d1 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:55.018792 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d444b116-83a6-4cb1-84b8-76dcacf335d1 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:55.019815 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d444b116-83a6-4cb1-84b8-76dcacf335d1 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:55.021985 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d444b116-83a6-4cb1-84b8-76dcacf335d1 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:55.025112 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d444b116-83a6-4cb1-84b8-76dcacf335d1 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:55.134410 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-2205032c-aee2-4f2d-b728-8365105a5706 tempest-SecurityGroupsTestJSON-1185949800 tempest-SecurityGroupsTestJSON-1185949800-project] 10.222.0.13 "DELETE /compute/v2.1/os-security-groups/cc3ed02e-766a-42e8-9cb4-098318d41ff2" status: 202 len: 0 microversion: 2.1 time: 0.731922 Nov 01 19:00:55.140047 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 947/1901] 10.222.0.13 () {58 vars in 1272 bytes} [Tue Nov 1 19:00:54 2022] DELETE /compute/v2.1/os-security-groups/cc3ed02e-766a-42e8-9cb4-098318d41ff2 => generated 0 bytes in 738 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 01 19:00:55.276467 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-dbcefe5d-3381-4404-9db7-5f1f76320bfa tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:00:55.277547 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-dbcefe5d-3381-4404-9db7-5f1f76320bfa tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] [instance: 3796ef05-cc8e-44d4-8dfc-058b5dbc8cbd] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:00:55.298566 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-dbcefe5d-3381-4404-9db7-5f1f76320bfa tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:55.299995 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-dbcefe5d-3381-4404-9db7-5f1f76320bfa tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:55.300858 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-dbcefe5d-3381-4404-9db7-5f1f76320bfa tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:55.303989 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-dbcefe5d-3381-4404-9db7-5f1f76320bfa tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:55.304528 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-dbcefe5d-3381-4404-9db7-5f1f76320bfa tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:55.308125 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-dbcefe5d-3381-4404-9db7-5f1f76320bfa tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:55.341044 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.wsgi [None req-dbcefe5d-3381-4404-9db7-5f1f76320bfa tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] HTTP exception thrown: Instance 3796ef05-cc8e-44d4-8dfc-058b5dbc8cbd could not be found. Nov 01 19:00:55.349854 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-dbcefe5d-3381-4404-9db7-5f1f76320bfa tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Request method failure captured: Nov 01 19:00:55.349854 n-d-863052-2 devstack@n-api.service[121402]: request: GET /compute/v2.1/servers/3796ef05-cc8e-44d4-8dfc-058b5dbc8cbd HTTP/1.1 Nov 01 19:00:55.349854 n-d-863052-2 devstack@n-api.service[121402]: Accept: application/json Nov 01 19:00:55.349854 n-d-863052-2 devstack@n-api.service[121402]: Accept-Encoding: identity Nov 01 19:00:55.349854 n-d-863052-2 devstack@n-api.service[121402]: Connection: close Nov 01 19:00:55.349854 n-d-863052-2 devstack@n-api.service[121402]: Content-Length: 0 Nov 01 19:00:55.349854 n-d-863052-2 devstack@n-api.service[121402]: Content-Type: application/json Nov 01 19:00:55.349854 n-d-863052-2 devstack@n-api.service[121402]: Host: 10.222.0.13 Nov 01 19:00:55.349854 n-d-863052-2 devstack@n-api.service[121402]: Openstack-System-Scope: None Nov 01 19:00:55.349854 n-d-863052-2 devstack@n-api.service[121402]: User-Agent: python-urllib3/1.26.12 Nov 01 19:00:55.349854 n-d-863052-2 devstack@n-api.service[121402]: X-Auth-Token: gAAAAABjYWw27zVYcT0jiDkpuT1RhWK3v8RIYvgoBAv6JENEEUigh3EWDZBWsWojpv0UuPsP42AoaM4QJ3MvpvySt_jiXJEPPxL0U99qRIuu3QOrQQyEuoWyflobV2EmBrMy9kC-XG8E8wqlSX7W2YY0K8WOiMWq_0tsCeniBBlKBU3a2s3TKIo Nov 01 19:00:55.349854 n-d-863052-2 devstack@n-api.service[121402]: X-Domain-Id: None Nov 01 19:00:55.349854 n-d-863052-2 devstack@n-api.service[121402]: X-Domain-Name: None Nov 01 19:00:55.349854 n-d-863052-2 devstack@n-api.service[121402]: X-Identity-Status: Confirmed Nov 01 19:00:55.349854 n-d-863052-2 devstack@n-api.service[121402]: X-Is-Admin-Project: True Nov 01 19:00:55.349854 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Domain-Id: default Nov 01 19:00:55.349854 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Domain-Name: Default Nov 01 19:00:55.349854 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Id: 86941784237549838bba63ce88053b88 Nov 01 19:00:55.349854 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Name: tempest-ServersOnMultiNodesTest-1928208762 Nov 01 19:00:55.349854 n-d-863052-2 devstack@n-api.service[121402]: X-Role: member,reader Nov 01 19:00:55.349854 n-d-863052-2 devstack@n-api.service[121402]: X-Roles: member,reader Nov 01 19:00:55.351712 n-d-863052-2 devstack@n-api.service[121402]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/86941784237549838bba63ce88053b88"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/86941784237549838bba63ce88053b88"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_86941784237549838bba63ce88053b88", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/86941784237549838bba63ce88053b88"}]}] Nov 01 19:00:55.351712 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant: tempest-ServersOnMultiNodesTest-1928208762 Nov 01 19:00:55.351712 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant-Id: 86941784237549838bba63ce88053b88 Nov 01 19:00:55.351712 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1928208762 Nov 01 19:00:55.351712 n-d-863052-2 devstack@n-api.service[121402]: X-User: tempest-ServersOnMultiNodesTest-1928208762-project Nov 01 19:00:55.351712 n-d-863052-2 devstack@n-api.service[121402]: X-User-Domain-Id: default Nov 01 19:00:55.351712 n-d-863052-2 devstack@n-api.service[121402]: X-User-Domain-Name: Default Nov 01 19:00:55.351712 n-d-863052-2 devstack@n-api.service[121402]: X-User-Id: 0290a6bb8bc24b8988a925327ac0381c Nov 01 19:00:55.351712 n-d-863052-2 devstack@n-api.service[121402]: X-User-Name: tempest-ServersOnMultiNodesTest-1928208762-project Nov 01 19:00:55.351712 n-d-863052-2 devstack@n-api.service[121402]: method: > Nov 01 19:00:55.351712 n-d-863052-2 devstack@n-api.service[121402]: exception: Instance 3796ef05-cc8e-44d4-8dfc-058b5dbc8cbd could not be found. Nov 01 19:00:55.351712 n-d-863052-2 devstack@n-api.service[121402]: action_args: {'id': '3796ef05-cc8e-44d4-8dfc-058b5dbc8cbd'} Nov 01 19:00:55.352781 n-d-863052-2 devstack@n-api.service[121402]: {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 01 19:00:55.352781 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:00:55.352781 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 01 19:00:55.352781 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 01 19:00:55.352781 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 01 19:00:55.352781 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 01 19:00:55.352781 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 01 19:00:55.352781 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 01 19:00:55.352781 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 01 19:00:55.352781 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 01 19:00:55.352781 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3796ef05-cc8e-44d4-8dfc-058b5dbc8cbd could not be found. Nov 01 19:00:55.352781 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:00:55.352781 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:00:55.352781 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:00:55.352781 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:00:55.352781 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:00:55.352781 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:00:55.352781 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 01 19:00:55.352781 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 01 19:00:55.352781 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 01 19:00:55.354440 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 01 19:00:55.354440 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 01 19:00:55.354440 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 01 19:00:55.354440 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 01 19:00:55.354440 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 01 19:00:55.354440 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 01 19:00:55.354440 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 01 19:00:55.354440 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3796ef05-cc8e-44d4-8dfc-058b5dbc8cbd could not be found. Nov 01 19:00:55.354440 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:00:55.354440 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:00:55.354440 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:00:55.354440 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:00:55.354440 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:00:55.354440 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:00:55.354440 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 01 19:00:55.354440 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 01 19:00:55.354440 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3796ef05-cc8e-44d4-8dfc-058b5dbc8cbd could not be found. Nov 01 19:00:55.354440 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:00:55.356027 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-dbcefe5d-3381-4404-9db7-5f1f76320bfa tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Returning 404 to user: Instance 3796ef05-cc8e-44d4-8dfc-058b5dbc8cbd could not be found. {{(pid=121402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 01 19:00:55.356027 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-dbcefe5d-3381-4404-9db7-5f1f76320bfa tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] 10.222.0.13 "GET /compute/v2.1/servers/3796ef05-cc8e-44d4-8dfc-058b5dbc8cbd" status: 404 len: 111 microversion: 2.1 time: 0.080549 Nov 01 19:00:55.358083 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 948/1902] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:00:55 2022] GET /compute/v2.1/servers/3796ef05-cc8e-44d4-8dfc-058b5dbc8cbd => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 01 19:00:55.371006 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-2a41f6e7-0864-430d-8ea7-380aaaf0e0ef tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:00:55.372132 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-2a41f6e7-0864-430d-8ea7-380aaaf0e0ef tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] [instance: 5e7ed73c-1243-4adf-94a2-09f7bf73f6fd] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:00:55.413704 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2a41f6e7-0864-430d-8ea7-380aaaf0e0ef tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:55.415583 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2a41f6e7-0864-430d-8ea7-380aaaf0e0ef tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:55.416102 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2a41f6e7-0864-430d-8ea7-380aaaf0e0ef tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:55.416990 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2a41f6e7-0864-430d-8ea7-380aaaf0e0ef tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:55.419781 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2a41f6e7-0864-430d-8ea7-380aaaf0e0ef tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:55.420387 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2a41f6e7-0864-430d-8ea7-380aaaf0e0ef tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:55.492818 n-d-863052-2 devstack@n-api.service[121402]: DEBUG dbcounter [-] [121402] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=121402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 19:00:55.506593 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-2a41f6e7-0864-430d-8ea7-380aaaf0e0ef tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] [instance: 5e7ed73c-1243-4adf-94a2-09f7bf73f6fd] Going to try to terminate instance {{(pid=121402) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 01 19:00:55.638573 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-2a41f6e7-0864-430d-8ea7-380aaaf0e0ef tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] 10.222.0.13 "DELETE /compute/v2.1/servers/5e7ed73c-1243-4adf-94a2-09f7bf73f6fd" status: 204 len: 0 microversion: 2.1 time: 0.279000 Nov 01 19:00:55.642422 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 949/1903] 10.222.0.13 () {58 vars in 1239 bytes} [Tue Nov 1 19:00:55 2022] DELETE /compute/v2.1/servers/5e7ed73c-1243-4adf-94a2-09f7bf73f6fd => generated 0 bytes in 281 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 01 19:00:55.648705 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-d675d12a-e424-4e7b-bb75-1d7915ce30a3 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:00:55.649621 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-d675d12a-e424-4e7b-bb75-1d7915ce30a3 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] [instance: cd879708-f757-4f88-bc95-38b6cd55363c] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:00:55.656273 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-d675d12a-e424-4e7b-bb75-1d7915ce30a3 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:55.657005 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-d675d12a-e424-4e7b-bb75-1d7915ce30a3 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:55.657770 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-d675d12a-e424-4e7b-bb75-1d7915ce30a3 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:55.658673 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-d675d12a-e424-4e7b-bb75-1d7915ce30a3 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:55.659330 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-d675d12a-e424-4e7b-bb75-1d7915ce30a3 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:55.659918 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-d675d12a-e424-4e7b-bb75-1d7915ce30a3 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:55.827919 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-d444b116-83a6-4cb1-84b8-76dcacf335d1 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72117f17294649d6b8bc16c66c7efab2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45d4c047d3c44324a27a27831236ab0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:00:55.839339 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-d444b116-83a6-4cb1-84b8-76dcacf335d1 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] 10.222.0.13 "GET /compute/v2.1/servers/614eb691-9a9a-4ca0-933d-686d80cc0ef1" status: 200 len: 1467 microversion: 2.1 time: 0.869511 Nov 01 19:00:55.839932 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 955/1904] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:00:54 2022] GET /compute/v2.1/servers/614eb691-9a9a-4ca0-933d-686d80cc0ef1 => generated 1467 bytes in 871 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:00:55.849769 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-922e303c-4c5a-48d9-9a66-474fb1eb0a59 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:00:55.850270 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-922e303c-4c5a-48d9-9a66-474fb1eb0a59 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] [instance: c04ee904-7b1a-4d73-b0c0-eb379c9aa683] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:00:55.870052 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-d675d12a-e424-4e7b-bb75-1d7915ce30a3 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:00:55.879387 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-d675d12a-e424-4e7b-bb75-1d7915ce30a3 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:00:55.880498 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-922e303c-4c5a-48d9-9a66-474fb1eb0a59 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:55.881219 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-922e303c-4c5a-48d9-9a66-474fb1eb0a59 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:55.881635 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-922e303c-4c5a-48d9-9a66-474fb1eb0a59 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:55.882429 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-922e303c-4c5a-48d9-9a66-474fb1eb0a59 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:55.882889 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-922e303c-4c5a-48d9-9a66-474fb1eb0a59 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:55.883315 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-922e303c-4c5a-48d9-9a66-474fb1eb0a59 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:55.886821 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-d675d12a-e424-4e7b-bb75-1d7915ce30a3 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:00:55.890816 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-d675d12a-e424-4e7b-bb75-1d7915ce30a3 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] 10.222.0.13 "GET /compute/v2.1/servers/cd879708-f757-4f88-bc95-38b6cd55363c" status: 200 len: 1293 microversion: 2.25 time: 0.244284 Nov 01 19:00:55.908661 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 950/1905] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 19:00:55 2022] GET /compute/v2.1/servers/cd879708-f757-4f88-bc95-38b6cd55363c => generated 1293 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 19:00:55.912573 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-085c3e7d-061a-4575-84c9-742801bb1ef2 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:00:55.921412 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-085c3e7d-061a-4575-84c9-742801bb1ef2 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] [instance: 1f499af7-1896-478c-b7d7-d922bf78bd98] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:00:55.929241 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-085c3e7d-061a-4575-84c9-742801bb1ef2 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:55.929450 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-085c3e7d-061a-4575-84c9-742801bb1ef2 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:55.929825 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-085c3e7d-061a-4575-84c9-742801bb1ef2 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:55.930539 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-085c3e7d-061a-4575-84c9-742801bb1ef2 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:55.930996 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-085c3e7d-061a-4575-84c9-742801bb1ef2 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:55.931511 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-085c3e7d-061a-4575-84c9-742801bb1ef2 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:55.960099 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-922e303c-4c5a-48d9-9a66-474fb1eb0a59 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] [instance: c04ee904-7b1a-4d73-b0c0-eb379c9aa683] Going to try to terminate instance {{(pid=121403) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 01 19:00:56.078903 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-922e303c-4c5a-48d9-9a66-474fb1eb0a59 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] 10.222.0.13 "DELETE /compute/v2.1/servers/c04ee904-7b1a-4d73-b0c0-eb379c9aa683" status: 204 len: 0 microversion: 2.1 time: 0.236711 Nov 01 19:00:56.084180 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 956/1906] 10.222.0.13 () {58 vars in 1239 bytes} [Tue Nov 1 19:00:55 2022] DELETE /compute/v2.1/servers/c04ee904-7b1a-4d73-b0c0-eb379c9aa683 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 01 19:00:56.095687 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-b13a9a8a-c57f-41c1-b5d6-f73d4f111d7b tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] Calling method '.version_select at 0x7f0ae28bddc0>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:00:56.121306 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-085c3e7d-061a-4575-84c9-742801bb1ef2 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f32f5fba1976432d938e664c7714e52b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b9d4c236b944f9b2e8e502a50a8f8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:00:56.131518 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-085c3e7d-061a-4575-84c9-742801bb1ef2 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] 10.222.0.13 "GET /compute/v2.1/servers/1f499af7-1896-478c-b7d7-d922bf78bd98" status: 200 len: 1391 microversion: 2.1 time: 0.222605 Nov 01 19:00:56.132436 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 951/1907] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:00:55 2022] GET /compute/v2.1/servers/1f499af7-1896-478c-b7d7-d922bf78bd98 => generated 1391 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:00:56.152954 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-6ff555d4-99b8-41c9-905a-826838585b61 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:00:56.155232 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-6ff555d4-99b8-41c9-905a-826838585b61 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] [instance: 5e7ed73c-1243-4adf-94a2-09f7bf73f6fd] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:00:56.158041 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-b13a9a8a-c57f-41c1-b5d6-f73d4f111d7b tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] 10.222.0.13 "GET /compute/v2.1/images/ccc79e7f-4589-43b9-a2ca-2a8f13b6602d" status: 200 len: 1464 microversion: 2.1 time: 0.071196 Nov 01 19:00:56.159319 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 957/1908] 10.222.0.13 () {58 vars in 1233 bytes} [Tue Nov 1 19:00:56 2022] GET /compute/v2.1/images/ccc79e7f-4589-43b9-a2ca-2a8f13b6602d => generated 1464 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:00:56.172520 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-6ff555d4-99b8-41c9-905a-826838585b61 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:56.173342 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-6ff555d4-99b8-41c9-905a-826838585b61 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:56.173979 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-6ff555d4-99b8-41c9-905a-826838585b61 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:56.174840 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-88adf56f-052f-48f2-8044-8dfc5cd09675 tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] Calling method '.version_select at 0x7f0ae6889c10>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:00:56.176166 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-6ff555d4-99b8-41c9-905a-826838585b61 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:56.177045 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-6ff555d4-99b8-41c9-905a-826838585b61 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:56.178379 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-6ff555d4-99b8-41c9-905a-826838585b61 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:56.235167 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-88adf56f-052f-48f2-8044-8dfc5cd09675 tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] 10.222.0.13 "GET /compute/v2.1/images/ccc79e7f-4589-43b9-a2ca-2a8f13b6602d" status: 200 len: 1464 microversion: 2.1 time: 0.065418 Nov 01 19:00:56.235903 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 958/1909] 10.222.0.13 () {58 vars in 1233 bytes} [Tue Nov 1 19:00:56 2022] GET /compute/v2.1/images/ccc79e7f-4589-43b9-a2ca-2a8f13b6602d => generated 1464 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 19:00:56.251625 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-e87450ee-db1a-4288-9a3a-ae3e18585247 tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:00:56.252658 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-e87450ee-db1a-4288-9a3a-ae3e18585247 tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] [instance: c34b04e9-a50a-4c58-85ff-ecef0bfc0343] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:00:56.262130 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-e87450ee-db1a-4288-9a3a-ae3e18585247 tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:56.262918 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-e87450ee-db1a-4288-9a3a-ae3e18585247 tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:56.263625 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-e87450ee-db1a-4288-9a3a-ae3e18585247 tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:56.265048 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-e87450ee-db1a-4288-9a3a-ae3e18585247 tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:56.265775 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-e87450ee-db1a-4288-9a3a-ae3e18585247 tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:56.266400 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-e87450ee-db1a-4288-9a3a-ae3e18585247 tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:56.357165 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-6ff555d4-99b8-41c9-905a-826838585b61 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0290a6bb8bc24b8988a925327ac0381c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86941784237549838bba63ce88053b88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:00:56.371571 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-6ff555d4-99b8-41c9-905a-826838585b61 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] 10.222.0.13 "GET /compute/v2.1/servers/5e7ed73c-1243-4adf-94a2-09f7bf73f6fd" status: 200 len: 1474 microversion: 2.1 time: 0.237074 Nov 01 19:00:56.372675 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 952/1910] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:00:56 2022] GET /compute/v2.1/servers/5e7ed73c-1243-4adf-94a2-09f7bf73f6fd => generated 1474 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:00:56.450136 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [req-bc0ee29c-b2a5-4e5c-8c6e-b97803de9a7f req-268e44d6-c5b0-493d-ad7d-c2f4668e49f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "614eb691-9a9a-4ca0-933d-686d80cc0ef1", "name": "network-vif-deleted", "tag": "1c1a6351-a4fe-4a16-830e-df55738ac180"}]} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:00:56.460739 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-bc0ee29c-b2a5-4e5c-8c6e-b97803de9a7f req-268e44d6-c5b0-493d-ad7d-c2f4668e49f5 service nova] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:56.461401 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-bc0ee29c-b2a5-4e5c-8c6e-b97803de9a7f req-268e44d6-c5b0-493d-ad7d-c2f4668e49f5 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:56.461935 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-bc0ee29c-b2a5-4e5c-8c6e-b97803de9a7f req-268e44d6-c5b0-493d-ad7d-c2f4668e49f5 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:56.476886 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.compute.server_external_events [req-bc0ee29c-b2a5-4e5c-8c6e-b97803de9a7f req-268e44d6-c5b0-493d-ad7d-c2f4668e49f5 service nova] Creating event network-vif-deleted:1c1a6351-a4fe-4a16-830e-df55738ac180 for instance 614eb691-9a9a-4ca0-933d-686d80cc0ef1 on n-h1-863052-2 Nov 01 19:00:56.482529 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [req-bc0ee29c-b2a5-4e5c-8c6e-b97803de9a7f req-268e44d6-c5b0-493d-ad7d-c2f4668e49f5 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036584 Nov 01 19:00:56.483464 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 953/1911] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Nov 1 19:00:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:00:56.574290 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-e87450ee-db1a-4288-9a3a-ae3e18585247 tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b0619a8fc6f4fcc9eb5d4f473c595c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '280a221575634c6f908d333db769739b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:00:56.582264 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-e87450ee-db1a-4288-9a3a-ae3e18585247 tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] 10.222.0.13 "GET /compute/v2.1/servers/c34b04e9-a50a-4c58-85ff-ecef0bfc0343" status: 200 len: 1468 microversion: 2.1 time: 0.335006 Nov 01 19:00:56.582921 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 959/1912] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:00:56 2022] GET /compute/v2.1/servers/c34b04e9-a50a-4c58-85ff-ecef0bfc0343 => generated 1468 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:00:56.608525 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-cde51e88-9050-4c1f-b99b-18ab3ca5f34b tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-1743433368"}} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:00:56.611451 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-cde51e88-9050-4c1f-b99b-18ab3ca5f34b tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] [instance: d8e88b0f-ae97-44a4-8b6b-b94e2c600a83] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:00:56.618701 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-cde51e88-9050-4c1f-b99b-18ab3ca5f34b tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:56.619551 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-cde51e88-9050-4c1f-b99b-18ab3ca5f34b tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:56.620212 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-cde51e88-9050-4c1f-b99b-18ab3ca5f34b tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:56.621202 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-cde51e88-9050-4c1f-b99b-18ab3ca5f34b tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:56.621882 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-cde51e88-9050-4c1f-b99b-18ab3ca5f34b tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:56.622545 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-cde51e88-9050-4c1f-b99b-18ab3ca5f34b tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:56.868821 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-c33a3fe4-ac81-4593-af1b-7fe047b92f5b tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:00:56.869575 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-c33a3fe4-ac81-4593-af1b-7fe047b92f5b tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] [instance: 614eb691-9a9a-4ca0-933d-686d80cc0ef1] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:00:56.887396 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-c33a3fe4-ac81-4593-af1b-7fe047b92f5b tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:56.887886 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-c33a3fe4-ac81-4593-af1b-7fe047b92f5b tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:56.888319 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-c33a3fe4-ac81-4593-af1b-7fe047b92f5b tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:56.901551 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-c33a3fe4-ac81-4593-af1b-7fe047b92f5b tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:56.902172 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-c33a3fe4-ac81-4593-af1b-7fe047b92f5b tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:56.902651 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-c33a3fe4-ac81-4593-af1b-7fe047b92f5b tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:56.942820 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-cde51e88-9050-4c1f-b99b-18ab3ca5f34b tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] 10.222.0.13 "POST /compute/v2.1/servers/d8e88b0f-ae97-44a4-8b6b-b94e2c600a83/action" status: 202 len: 0 microversion: 2.1 time: 0.339983 Nov 01 19:00:56.944179 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 954/1913] 10.222.0.13 () {60 vars in 1278 bytes} [Tue Nov 1 19:00:56 2022] POST /compute/v2.1/servers/d8e88b0f-ae97-44a4-8b6b-b94e2c600a83/action => generated 0 bytes in 343 msecs (HTTP/1.1 202) 10 headers in 450 bytes (2 switches on core 0) Nov 01 19:00:56.955074 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-c066764a-323c-4a37-b98b-d5443bb16a67 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:00:56.955734 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-c066764a-323c-4a37-b98b-d5443bb16a67 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] [instance: cd879708-f757-4f88-bc95-38b6cd55363c] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:00:56.963368 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-c066764a-323c-4a37-b98b-d5443bb16a67 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:56.963879 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-c066764a-323c-4a37-b98b-d5443bb16a67 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:56.964369 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-c066764a-323c-4a37-b98b-d5443bb16a67 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:56.965106 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-c066764a-323c-4a37-b98b-d5443bb16a67 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:56.965555 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-c066764a-323c-4a37-b98b-d5443bb16a67 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:56.965981 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-c066764a-323c-4a37-b98b-d5443bb16a67 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:57.033635 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-c33a3fe4-ac81-4593-af1b-7fe047b92f5b tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72117f17294649d6b8bc16c66c7efab2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45d4c047d3c44324a27a27831236ab0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:00:57.044504 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-c33a3fe4-ac81-4593-af1b-7fe047b92f5b tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] 10.222.0.13 "GET /compute/v2.1/servers/614eb691-9a9a-4ca0-933d-686d80cc0ef1" status: 200 len: 1425 microversion: 2.1 time: 0.179129 Nov 01 19:00:57.045462 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 960/1914] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:00:56 2022] GET /compute/v2.1/servers/614eb691-9a9a-4ca0-933d-686d80cc0ef1 => generated 1425 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:00:57.051951 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-bb2bcdca-0e1b-4dc6-9efb-291975da2ae3 tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] Calling method '.version_select at 0x7f0ae293f670>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:00:57.120553 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-bb2bcdca-0e1b-4dc6-9efb-291975da2ae3 tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] 10.222.0.13 "GET /compute/v2.1/images/52ccd7d5-4eba-4e0d-97f4-a4927c3504a7" status: 200 len: 1455 microversion: 2.1 time: 0.073956 Nov 01 19:00:57.123641 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 961/1915] 10.222.0.13 () {58 vars in 1233 bytes} [Tue Nov 1 19:00:57 2022] GET /compute/v2.1/images/52ccd7d5-4eba-4e0d-97f4-a4927c3504a7 => generated 1455 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:00:57.158949 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-74553a08-4275-4cad-bd64-a2a4209be6fe tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:00:57.159822 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-74553a08-4275-4cad-bd64-a2a4209be6fe tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] [instance: 1f499af7-1896-478c-b7d7-d922bf78bd98] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:00:57.170944 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-74553a08-4275-4cad-bd64-a2a4209be6fe tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:57.171659 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-74553a08-4275-4cad-bd64-a2a4209be6fe tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:57.172292 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-74553a08-4275-4cad-bd64-a2a4209be6fe tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:57.173202 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-74553a08-4275-4cad-bd64-a2a4209be6fe tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:57.173829 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-74553a08-4275-4cad-bd64-a2a4209be6fe tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:57.174476 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-74553a08-4275-4cad-bd64-a2a4209be6fe tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:57.272172 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-c066764a-323c-4a37-b98b-d5443bb16a67 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:00:57.289498 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-c066764a-323c-4a37-b98b-d5443bb16a67 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:00:57.293476 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-c066764a-323c-4a37-b98b-d5443bb16a67 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:00:57.294862 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-c066764a-323c-4a37-b98b-d5443bb16a67 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] 10.222.0.13 "GET /compute/v2.1/servers/cd879708-f757-4f88-bc95-38b6cd55363c" status: 200 len: 1293 microversion: 2.25 time: 0.349536 Nov 01 19:00:57.298985 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 955/1916] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 19:00:56 2022] GET /compute/v2.1/servers/cd879708-f757-4f88-bc95-38b6cd55363c => generated 1293 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 19:00:57.399110 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-c7143236-3296-4e3d-9deb-fd8071c2ba33 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:00:57.400385 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-c7143236-3296-4e3d-9deb-fd8071c2ba33 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] [instance: 5e7ed73c-1243-4adf-94a2-09f7bf73f6fd] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:00:57.414111 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-c7143236-3296-4e3d-9deb-fd8071c2ba33 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:57.414629 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-c7143236-3296-4e3d-9deb-fd8071c2ba33 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:57.415067 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-c7143236-3296-4e3d-9deb-fd8071c2ba33 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:57.415927 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-c7143236-3296-4e3d-9deb-fd8071c2ba33 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:57.416941 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-c7143236-3296-4e3d-9deb-fd8071c2ba33 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:57.417375 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-c7143236-3296-4e3d-9deb-fd8071c2ba33 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:57.467392 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-74553a08-4275-4cad-bd64-a2a4209be6fe tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f32f5fba1976432d938e664c7714e52b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b9d4c236b944f9b2e8e502a50a8f8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:00:57.489814 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-74553a08-4275-4cad-bd64-a2a4209be6fe tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] 10.222.0.13 "GET /compute/v2.1/servers/1f499af7-1896-478c-b7d7-d922bf78bd98" status: 200 len: 1391 microversion: 2.1 time: 0.334973 Nov 01 19:00:57.505976 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 962/1917] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:00:57 2022] GET /compute/v2.1/servers/1f499af7-1896-478c-b7d7-d922bf78bd98 => generated 1391 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:00:57.755698 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-c7143236-3296-4e3d-9deb-fd8071c2ba33 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0290a6bb8bc24b8988a925327ac0381c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86941784237549838bba63ce88053b88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:00:57.770051 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-c7143236-3296-4e3d-9deb-fd8071c2ba33 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] 10.222.0.13 "GET /compute/v2.1/servers/5e7ed73c-1243-4adf-94a2-09f7bf73f6fd" status: 200 len: 1474 microversion: 2.1 time: 0.375804 Nov 01 19:00:57.785637 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 956/1918] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:00:57 2022] GET /compute/v2.1/servers/5e7ed73c-1243-4adf-94a2-09f7bf73f6fd => generated 1474 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:00:57.976839 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-66f9d7e1-ce91-4647-ac0a-18ded4909ab1 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f6f33cc1-4876-46b0-90b4-a7659a320eed"}} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:00:57.979456 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-66f9d7e1-ce91-4647-ac0a-18ded4909ab1 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] [instance: 90b353ab-ef97-4d88-b5bc-b355ff576225] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:00:57.990901 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-66f9d7e1-ce91-4647-ac0a-18ded4909ab1 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:57.996416 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-66f9d7e1-ce91-4647-ac0a-18ded4909ab1 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:57.997211 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-66f9d7e1-ce91-4647-ac0a-18ded4909ab1 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:57.998138 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-66f9d7e1-ce91-4647-ac0a-18ded4909ab1 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:57.998767 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-66f9d7e1-ce91-4647-ac0a-18ded4909ab1 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:57.999382 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-66f9d7e1-ce91-4647-ac0a-18ded4909ab1 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:58.077801 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-f8ab5557-b7ec-4a00-8337-1ec29e9427be tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:00:58.078429 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-f8ab5557-b7ec-4a00-8337-1ec29e9427be tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] [instance: 614eb691-9a9a-4ca0-933d-686d80cc0ef1] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:00:58.101458 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f8ab5557-b7ec-4a00-8337-1ec29e9427be tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:58.103343 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f8ab5557-b7ec-4a00-8337-1ec29e9427be tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:58.122636 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f8ab5557-b7ec-4a00-8337-1ec29e9427be tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:58.128509 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f8ab5557-b7ec-4a00-8337-1ec29e9427be tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:58.132609 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f8ab5557-b7ec-4a00-8337-1ec29e9427be tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:58.132609 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f8ab5557-b7ec-4a00-8337-1ec29e9427be tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:58.228493 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f8ab5557-b7ec-4a00-8337-1ec29e9427be tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:58.229274 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f8ab5557-b7ec-4a00-8337-1ec29e9427be tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:58.229484 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f8ab5557-b7ec-4a00-8337-1ec29e9427be tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:58.229948 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.objects.instance [None req-f8ab5557-b7ec-4a00-8337-1ec29e9427be tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lazy-loading 'fault' on Instance uuid 614eb691-9a9a-4ca0-933d-686d80cc0ef1 {{(pid=121402) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 01 19:00:58.902450 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-f8ab5557-b7ec-4a00-8337-1ec29e9427be tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72117f17294649d6b8bc16c66c7efab2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45d4c047d3c44324a27a27831236ab0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:00:58.910997 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-f8ab5557-b7ec-4a00-8337-1ec29e9427be tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] 10.222.0.13 "GET /compute/v2.1/servers/614eb691-9a9a-4ca0-933d-686d80cc0ef1" status: 200 len: 1302 microversion: 2.1 time: 0.845094 Nov 01 19:00:58.912220 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 957/1919] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:00:58 2022] GET /compute/v2.1/servers/614eb691-9a9a-4ca0-933d-686d80cc0ef1 => generated 1302 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:00:58.935197 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [req-1d8ea480-c508-418e-b5cb-2ccf74ffb734 req-bef91349-8e16-496a-9a36-78600c11e8ca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5e7ed73c-1243-4adf-94a2-09f7bf73f6fd", "name": "network-vif-deleted", "tag": "e54c219d-e64c-46bc-ad98-717d0dfb07e2"}]} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:00:58.961807 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-1d8ea480-c508-418e-b5cb-2ccf74ffb734 req-bef91349-8e16-496a-9a36-78600c11e8ca service nova] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:58.962570 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-1d8ea480-c508-418e-b5cb-2ccf74ffb734 req-bef91349-8e16-496a-9a36-78600c11e8ca service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:58.963234 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-1d8ea480-c508-418e-b5cb-2ccf74ffb734 req-bef91349-8e16-496a-9a36-78600c11e8ca service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:58.988425 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.compute.server_external_events [req-1d8ea480-c508-418e-b5cb-2ccf74ffb734 req-bef91349-8e16-496a-9a36-78600c11e8ca service nova] Creating event network-vif-deleted:e54c219d-e64c-46bc-ad98-717d0dfb07e2 for instance 5e7ed73c-1243-4adf-94a2-09f7bf73f6fd on n-h2-863052-2 Nov 01 19:00:59.002699 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [req-1d8ea480-c508-418e-b5cb-2ccf74ffb734 req-bef91349-8e16-496a-9a36-78600c11e8ca service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089052 Nov 01 19:00:59.011616 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 958/1920] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Nov 1 19:00:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:00:59.020558 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-a155c653-240d-47b4-8c85-5991a443508d tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] Calling method '.version_select at 0x7f0ae1c7ea60>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:00:59.094081 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-a155c653-240d-47b4-8c85-5991a443508d tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] 10.222.0.13 "GET /compute/v2.1/images/52ccd7d5-4eba-4e0d-97f4-a4927c3504a7" status: 200 len: 1455 microversion: 2.1 time: 0.080641 Nov 01 19:00:59.094673 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 959/1921] 10.222.0.13 () {58 vars in 1233 bytes} [Tue Nov 1 19:00:59 2022] GET /compute/v2.1/images/52ccd7d5-4eba-4e0d-97f4-a4927c3504a7 => generated 1455 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:00:59.101360 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-e460792b-3162-465a-97e9-c2ab19acde85 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:00:59.102093 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-e460792b-3162-465a-97e9-c2ab19acde85 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] [instance: cd879708-f757-4f88-bc95-38b6cd55363c] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:00:59.124217 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e460792b-3162-465a-97e9-c2ab19acde85 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:59.128152 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e460792b-3162-465a-97e9-c2ab19acde85 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:59.128733 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e460792b-3162-465a-97e9-c2ab19acde85 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:59.129612 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e460792b-3162-465a-97e9-c2ab19acde85 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:59.130101 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e460792b-3162-465a-97e9-c2ab19acde85 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:59.130538 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e460792b-3162-465a-97e9-c2ab19acde85 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:59.367943 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-e460792b-3162-465a-97e9-c2ab19acde85 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:00:59.380149 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-e460792b-3162-465a-97e9-c2ab19acde85 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:00:59.383624 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-e460792b-3162-465a-97e9-c2ab19acde85 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:00:59.385061 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-e460792b-3162-465a-97e9-c2ab19acde85 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] 10.222.0.13 "GET /compute/v2.1/servers/cd879708-f757-4f88-bc95-38b6cd55363c" status: 200 len: 1293 microversion: 2.25 time: 0.289377 Nov 01 19:00:59.386629 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 960/1922] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 19:00:59 2022] GET /compute/v2.1/servers/cd879708-f757-4f88-bc95-38b6cd55363c => generated 1293 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 19:00:59.392742 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-2f5cbf9e-a351-48ae-842c-d5a3930126b6 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:00:59.393742 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-2f5cbf9e-a351-48ae-842c-d5a3930126b6 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] [instance: 1f499af7-1896-478c-b7d7-d922bf78bd98] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:00:59.402417 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2f5cbf9e-a351-48ae-842c-d5a3930126b6 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:59.403404 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2f5cbf9e-a351-48ae-842c-d5a3930126b6 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:59.405095 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2f5cbf9e-a351-48ae-842c-d5a3930126b6 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:00:59.406137 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2f5cbf9e-a351-48ae-842c-d5a3930126b6 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:00:59.406944 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2f5cbf9e-a351-48ae-842c-d5a3930126b6 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:00:59.407528 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2f5cbf9e-a351-48ae-842c-d5a3930126b6 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:01:00.011570 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-2f5cbf9e-a351-48ae-842c-d5a3930126b6 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f32f5fba1976432d938e664c7714e52b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b9d4c236b944f9b2e8e502a50a8f8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:01:00.028133 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-2f5cbf9e-a351-48ae-842c-d5a3930126b6 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] 10.222.0.13 "GET /compute/v2.1/servers/1f499af7-1896-478c-b7d7-d922bf78bd98" status: 200 len: 1391 microversion: 2.1 time: 0.640208 Nov 01 19:01:00.029004 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 961/1923] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:00:59 2022] GET /compute/v2.1/servers/1f499af7-1896-478c-b7d7-d922bf78bd98 => generated 1391 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:01:00.045987 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [req-86fd6c05-9710-4263-a22d-58dee128a30b req-2b882b9d-489a-469f-bc71-f10cad615dce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c04ee904-7b1a-4d73-b0c0-eb379c9aa683", "name": "network-vif-deleted", "tag": "34fac85b-afb5-42bd-94cb-4c0ee1272b6e"}]} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:01:00.058244 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-86fd6c05-9710-4263-a22d-58dee128a30b req-2b882b9d-489a-469f-bc71-f10cad615dce service nova] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:01:00.059096 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-86fd6c05-9710-4263-a22d-58dee128a30b req-2b882b9d-489a-469f-bc71-f10cad615dce service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:01:00.059808 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-86fd6c05-9710-4263-a22d-58dee128a30b req-2b882b9d-489a-469f-bc71-f10cad615dce service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:01:00.074408 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.compute.server_external_events [req-86fd6c05-9710-4263-a22d-58dee128a30b req-2b882b9d-489a-469f-bc71-f10cad615dce service nova] Creating event network-vif-deleted:34fac85b-afb5-42bd-94cb-4c0ee1272b6e for instance c04ee904-7b1a-4d73-b0c0-eb379c9aa683 on n-h1-863052-2 Nov 01 19:01:00.085164 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [req-86fd6c05-9710-4263-a22d-58dee128a30b req-2b882b9d-489a-469f-bc71-f10cad615dce service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054126 Nov 01 19:01:00.086055 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 962/1924] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Nov 1 19:01:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:01:00.091201 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-d4552c7a-682c-4b61-84c1-7e50163cf419 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:01:00.092058 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-d4552c7a-682c-4b61-84c1-7e50163cf419 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] [instance: 5e7ed73c-1243-4adf-94a2-09f7bf73f6fd] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:01:00.104072 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-d4552c7a-682c-4b61-84c1-7e50163cf419 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:01:00.104797 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-d4552c7a-682c-4b61-84c1-7e50163cf419 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:01:00.105031 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-d4552c7a-682c-4b61-84c1-7e50163cf419 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:01:00.108153 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-d4552c7a-682c-4b61-84c1-7e50163cf419 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:01:00.108679 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-d4552c7a-682c-4b61-84c1-7e50163cf419 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:01:00.109115 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-d4552c7a-682c-4b61-84c1-7e50163cf419 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:01:00.131879 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.wsgi [None req-d4552c7a-682c-4b61-84c1-7e50163cf419 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] HTTP exception thrown: Instance 5e7ed73c-1243-4adf-94a2-09f7bf73f6fd could not be found. Nov 01 19:01:00.131879 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-d4552c7a-682c-4b61-84c1-7e50163cf419 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Request method failure captured: Nov 01 19:01:00.131879 n-d-863052-2 devstack@n-api.service[121402]: request: GET /compute/v2.1/servers/5e7ed73c-1243-4adf-94a2-09f7bf73f6fd HTTP/1.1 Nov 01 19:01:00.131879 n-d-863052-2 devstack@n-api.service[121402]: Accept: application/json Nov 01 19:01:00.131879 n-d-863052-2 devstack@n-api.service[121402]: Accept-Encoding: identity Nov 01 19:01:00.131879 n-d-863052-2 devstack@n-api.service[121402]: Connection: close Nov 01 19:01:00.131879 n-d-863052-2 devstack@n-api.service[121402]: Content-Length: 0 Nov 01 19:01:00.131879 n-d-863052-2 devstack@n-api.service[121402]: Content-Type: application/json Nov 01 19:01:00.131879 n-d-863052-2 devstack@n-api.service[121402]: Host: 10.222.0.13 Nov 01 19:01:00.131879 n-d-863052-2 devstack@n-api.service[121402]: Openstack-System-Scope: None Nov 01 19:01:00.131879 n-d-863052-2 devstack@n-api.service[121402]: User-Agent: python-urllib3/1.26.12 Nov 01 19:01:00.131879 n-d-863052-2 devstack@n-api.service[121402]: X-Auth-Token: gAAAAABjYWw27zVYcT0jiDkpuT1RhWK3v8RIYvgoBAv6JENEEUigh3EWDZBWsWojpv0UuPsP42AoaM4QJ3MvpvySt_jiXJEPPxL0U99qRIuu3QOrQQyEuoWyflobV2EmBrMy9kC-XG8E8wqlSX7W2YY0K8WOiMWq_0tsCeniBBlKBU3a2s3TKIo Nov 01 19:01:00.131879 n-d-863052-2 devstack@n-api.service[121402]: X-Domain-Id: None Nov 01 19:01:00.131879 n-d-863052-2 devstack@n-api.service[121402]: X-Domain-Name: None Nov 01 19:01:00.131879 n-d-863052-2 devstack@n-api.service[121402]: X-Identity-Status: Confirmed Nov 01 19:01:00.131879 n-d-863052-2 devstack@n-api.service[121402]: X-Is-Admin-Project: True Nov 01 19:01:00.131879 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Domain-Id: default Nov 01 19:01:00.131879 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Domain-Name: Default Nov 01 19:01:00.131879 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Id: 86941784237549838bba63ce88053b88 Nov 01 19:01:00.131879 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Name: tempest-ServersOnMultiNodesTest-1928208762 Nov 01 19:01:00.131879 n-d-863052-2 devstack@n-api.service[121402]: X-Role: member,reader Nov 01 19:01:00.131879 n-d-863052-2 devstack@n-api.service[121402]: X-Roles: member,reader Nov 01 19:01:00.134014 n-d-863052-2 devstack@n-api.service[121402]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/86941784237549838bba63ce88053b88"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/86941784237549838bba63ce88053b88"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_86941784237549838bba63ce88053b88", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/86941784237549838bba63ce88053b88"}]}] Nov 01 19:01:00.134014 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant: tempest-ServersOnMultiNodesTest-1928208762 Nov 01 19:01:00.134014 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant-Id: 86941784237549838bba63ce88053b88 Nov 01 19:01:00.134014 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1928208762 Nov 01 19:01:00.134014 n-d-863052-2 devstack@n-api.service[121402]: X-User: tempest-ServersOnMultiNodesTest-1928208762-project Nov 01 19:01:00.134014 n-d-863052-2 devstack@n-api.service[121402]: X-User-Domain-Id: default Nov 01 19:01:00.134014 n-d-863052-2 devstack@n-api.service[121402]: X-User-Domain-Name: Default Nov 01 19:01:00.134014 n-d-863052-2 devstack@n-api.service[121402]: X-User-Id: 0290a6bb8bc24b8988a925327ac0381c Nov 01 19:01:00.134014 n-d-863052-2 devstack@n-api.service[121402]: X-User-Name: tempest-ServersOnMultiNodesTest-1928208762-project Nov 01 19:01:00.134014 n-d-863052-2 devstack@n-api.service[121402]: method: > Nov 01 19:01:00.134014 n-d-863052-2 devstack@n-api.service[121402]: exception: Instance 5e7ed73c-1243-4adf-94a2-09f7bf73f6fd could not be found. Nov 01 19:01:00.134014 n-d-863052-2 devstack@n-api.service[121402]: action_args: {'id': '5e7ed73c-1243-4adf-94a2-09f7bf73f6fd'} Nov 01 19:01:00.135583 n-d-863052-2 devstack@n-api.service[121402]: {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 01 19:01:00.135583 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:01:00.135583 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 01 19:01:00.135583 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 01 19:01:00.135583 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 01 19:01:00.135583 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 01 19:01:00.135583 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 01 19:01:00.135583 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 01 19:01:00.135583 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 01 19:01:00.135583 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 01 19:01:00.135583 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5e7ed73c-1243-4adf-94a2-09f7bf73f6fd could not be found. Nov 01 19:01:00.135583 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:01:00.135583 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:01:00.135583 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:01:00.135583 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:01:00.135583 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:01:00.135583 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:01:00.135583 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 01 19:01:00.135583 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 01 19:01:00.135583 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 01 19:01:00.140704 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 01 19:01:00.140704 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 01 19:01:00.140704 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 01 19:01:00.140704 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 01 19:01:00.140704 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 01 19:01:00.140704 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 01 19:01:00.140704 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 01 19:01:00.140704 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5e7ed73c-1243-4adf-94a2-09f7bf73f6fd could not be found. Nov 01 19:01:00.140704 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:01:00.140704 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:01:00.140704 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:01:00.140704 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:01:00.140704 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:01:00.140704 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:01:00.140704 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 01 19:01:00.140704 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 01 19:01:00.140704 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5e7ed73c-1243-4adf-94a2-09f7bf73f6fd could not be found. Nov 01 19:01:00.140704 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:01:00.143180 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-d4552c7a-682c-4b61-84c1-7e50163cf419 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Returning 404 to user: Instance 5e7ed73c-1243-4adf-94a2-09f7bf73f6fd could not be found. {{(pid=121402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 01 19:01:00.143180 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-d4552c7a-682c-4b61-84c1-7e50163cf419 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] 10.222.0.13 "GET /compute/v2.1/servers/5e7ed73c-1243-4adf-94a2-09f7bf73f6fd" status: 404 len: 111 microversion: 2.1 time: 0.045151 Nov 01 19:01:00.143180 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 963/1925] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:01:00 2022] GET /compute/v2.1/servers/5e7ed73c-1243-4adf-94a2-09f7bf73f6fd => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 01 19:01:00.143180 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [req-3e0cc884-37dc-4173-8217-2ce5f629c16e req-3fae6d35-bb01-4046-b536-9d8cdca827fa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c34b04e9-a50a-4c58-85ff-ecef0bfc0343", "name": "network-vif-unplugged", "status": "completed", "tag": "53c384ce-eeca-4b10-9794-84a0d7bc5468"}]} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:01:00.154362 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-3e0cc884-37dc-4173-8217-2ce5f629c16e req-3fae6d35-bb01-4046-b536-9d8cdca827fa service nova] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:01:00.154921 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-3e0cc884-37dc-4173-8217-2ce5f629c16e req-3fae6d35-bb01-4046-b536-9d8cdca827fa service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:01:00.155416 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-3e0cc884-37dc-4173-8217-2ce5f629c16e req-3fae6d35-bb01-4046-b536-9d8cdca827fa service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:01:00.170921 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.compute.server_external_events [req-3e0cc884-37dc-4173-8217-2ce5f629c16e req-3fae6d35-bb01-4046-b536-9d8cdca827fa service nova] Creating event network-vif-unplugged:53c384ce-eeca-4b10-9794-84a0d7bc5468 for instance c34b04e9-a50a-4c58-85ff-ecef0bfc0343 on n-h1-863052-2 Nov 01 19:01:00.177282 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [req-3e0cc884-37dc-4173-8217-2ce5f629c16e req-3fae6d35-bb01-4046-b536-9d8cdca827fa service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.040439 Nov 01 19:01:00.178326 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 964/1926] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Nov 1 19:01:00 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:01:00.185740 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-cec41743-bd95-4095-8e49-86670df9e5e5 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:01:00.186532 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-cec41743-bd95-4095-8e49-86670df9e5e5 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] [instance: 614eb691-9a9a-4ca0-933d-686d80cc0ef1] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:01:00.193525 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-cec41743-bd95-4095-8e49-86670df9e5e5 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:01:00.194161 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-cec41743-bd95-4095-8e49-86670df9e5e5 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:01:00.194661 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-cec41743-bd95-4095-8e49-86670df9e5e5 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:01:00.195424 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-cec41743-bd95-4095-8e49-86670df9e5e5 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:01:00.195945 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-cec41743-bd95-4095-8e49-86670df9e5e5 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:01:00.196643 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-cec41743-bd95-4095-8e49-86670df9e5e5 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:01:00.216051 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.wsgi [None req-cec41743-bd95-4095-8e49-86670df9e5e5 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] HTTP exception thrown: Instance 614eb691-9a9a-4ca0-933d-686d80cc0ef1 could not be found. Nov 01 19:01:00.218486 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-cec41743-bd95-4095-8e49-86670df9e5e5 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Request method failure captured: Nov 01 19:01:00.218486 n-d-863052-2 devstack@n-api.service[121402]: request: GET /compute/v2.1/servers/614eb691-9a9a-4ca0-933d-686d80cc0ef1 HTTP/1.1 Nov 01 19:01:00.218486 n-d-863052-2 devstack@n-api.service[121402]: Accept: application/json Nov 01 19:01:00.218486 n-d-863052-2 devstack@n-api.service[121402]: Accept-Encoding: identity Nov 01 19:01:00.218486 n-d-863052-2 devstack@n-api.service[121402]: Connection: close Nov 01 19:01:00.218486 n-d-863052-2 devstack@n-api.service[121402]: Content-Length: 0 Nov 01 19:01:00.218486 n-d-863052-2 devstack@n-api.service[121402]: Content-Type: application/json Nov 01 19:01:00.218486 n-d-863052-2 devstack@n-api.service[121402]: Host: 10.222.0.13 Nov 01 19:01:00.218486 n-d-863052-2 devstack@n-api.service[121402]: Openstack-System-Scope: None Nov 01 19:01:00.218486 n-d-863052-2 devstack@n-api.service[121402]: User-Agent: python-urllib3/1.26.12 Nov 01 19:01:00.218486 n-d-863052-2 devstack@n-api.service[121402]: X-Auth-Token: gAAAAABjYWu1cGHDBxLRMjfy5LV4CzwBbby5Te03nghiWl2YAj4Ezmd18PffZt5qzbLABcrwuhmojlV_K_bvZhDIRPoos5aj6lXnm72mv-YhsVHN9km2tJrzabw39H9HZ1hhBDokeXANnwtfyn136Q1Cru25X1_I6UbFCfvnbjmmRbzWxTIcXPc Nov 01 19:01:00.218486 n-d-863052-2 devstack@n-api.service[121402]: X-Domain-Id: None Nov 01 19:01:00.218486 n-d-863052-2 devstack@n-api.service[121402]: X-Domain-Name: None Nov 01 19:01:00.218486 n-d-863052-2 devstack@n-api.service[121402]: X-Identity-Status: Confirmed Nov 01 19:01:00.218486 n-d-863052-2 devstack@n-api.service[121402]: X-Is-Admin-Project: True Nov 01 19:01:00.218486 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Domain-Id: default Nov 01 19:01:00.218486 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Domain-Name: Default Nov 01 19:01:00.218486 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Id: 45d4c047d3c44324a27a27831236ab0d Nov 01 19:01:00.218486 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Name: tempest-MigrationsAdminTest-2112861741 Nov 01 19:01:00.218486 n-d-863052-2 devstack@n-api.service[121402]: X-Role: member,reader Nov 01 19:01:00.218486 n-d-863052-2 devstack@n-api.service[121402]: X-Roles: member,reader Nov 01 19:01:00.220167 n-d-863052-2 devstack@n-api.service[121402]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/45d4c047d3c44324a27a27831236ab0d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/45d4c047d3c44324a27a27831236ab0d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_45d4c047d3c44324a27a27831236ab0d", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/45d4c047d3c44324a27a27831236ab0d"}]}] Nov 01 19:01:00.220167 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant: tempest-MigrationsAdminTest-2112861741 Nov 01 19:01:00.220167 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant-Id: 45d4c047d3c44324a27a27831236ab0d Nov 01 19:01:00.220167 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant-Name: tempest-MigrationsAdminTest-2112861741 Nov 01 19:01:00.220167 n-d-863052-2 devstack@n-api.service[121402]: X-User: tempest-MigrationsAdminTest-2112861741-project Nov 01 19:01:00.220167 n-d-863052-2 devstack@n-api.service[121402]: X-User-Domain-Id: default Nov 01 19:01:00.220167 n-d-863052-2 devstack@n-api.service[121402]: X-User-Domain-Name: Default Nov 01 19:01:00.220167 n-d-863052-2 devstack@n-api.service[121402]: X-User-Id: 72117f17294649d6b8bc16c66c7efab2 Nov 01 19:01:00.220167 n-d-863052-2 devstack@n-api.service[121402]: X-User-Name: tempest-MigrationsAdminTest-2112861741-project Nov 01 19:01:00.220167 n-d-863052-2 devstack@n-api.service[121402]: method: > Nov 01 19:01:00.220167 n-d-863052-2 devstack@n-api.service[121402]: exception: Instance 614eb691-9a9a-4ca0-933d-686d80cc0ef1 could not be found. Nov 01 19:01:00.220167 n-d-863052-2 devstack@n-api.service[121402]: action_args: {'id': '614eb691-9a9a-4ca0-933d-686d80cc0ef1'} Nov 01 19:01:00.221166 n-d-863052-2 devstack@n-api.service[121402]: {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 01 19:01:00.221166 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:01:00.221166 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 01 19:01:00.221166 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 01 19:01:00.221166 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 01 19:01:00.221166 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 01 19:01:00.221166 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 01 19:01:00.221166 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 01 19:01:00.221166 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 01 19:01:00.221166 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 01 19:01:00.221166 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 614eb691-9a9a-4ca0-933d-686d80cc0ef1 could not be found. Nov 01 19:01:00.221166 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:01:00.221166 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:01:00.221166 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:01:00.221166 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:01:00.221166 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:01:00.221166 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:01:00.221166 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 01 19:01:00.221166 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 01 19:01:00.221166 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 01 19:01:00.222636 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 01 19:01:00.222636 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 01 19:01:00.222636 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 01 19:01:00.222636 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 01 19:01:00.222636 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 01 19:01:00.222636 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 01 19:01:00.222636 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 01 19:01:00.222636 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 614eb691-9a9a-4ca0-933d-686d80cc0ef1 could not be found. Nov 01 19:01:00.222636 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:01:00.222636 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:01:00.222636 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:01:00.222636 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:01:00.222636 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:01:00.222636 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:01:00.222636 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 01 19:01:00.222636 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 01 19:01:00.222636 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 614eb691-9a9a-4ca0-933d-686d80cc0ef1 could not be found. Nov 01 19:01:00.222636 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:01:00.223894 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-cec41743-bd95-4095-8e49-86670df9e5e5 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] Returning 404 to user: Instance 614eb691-9a9a-4ca0-933d-686d80cc0ef1 could not be found. {{(pid=121402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 01 19:01:00.223894 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-cec41743-bd95-4095-8e49-86670df9e5e5 tempest-MigrationsAdminTest-2112861741 tempest-MigrationsAdminTest-2112861741-project] 10.222.0.13 "GET /compute/v2.1/servers/614eb691-9a9a-4ca0-933d-686d80cc0ef1" status: 404 len: 111 microversion: 2.1 time: 0.040100 Nov 01 19:01:00.229345 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 965/1927] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:01:00 2022] GET /compute/v2.1/servers/614eb691-9a9a-4ca0-933d-686d80cc0ef1 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 01 19:01:00.235616 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-6a369f00-65ea-4a1e-9fd7-6a4dba392364 tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] Calling method '.version_select at 0x7f0ae1cbe940>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:01:00.288074 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-6a369f00-65ea-4a1e-9fd7-6a4dba392364 tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] 10.222.0.13 "GET /compute/v2.1/images/52ccd7d5-4eba-4e0d-97f4-a4927c3504a7" status: 200 len: 1455 microversion: 2.1 time: 0.057396 Nov 01 19:01:00.296562 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 966/1928] 10.222.0.13 () {58 vars in 1233 bytes} [Tue Nov 1 19:01:00 2022] GET /compute/v2.1/images/52ccd7d5-4eba-4e0d-97f4-a4927c3504a7 => generated 1455 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:01:00.296562 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-e5977269-3357-430c-8db3-132f76d7df47 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:01:00.296562 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-e5977269-3357-430c-8db3-132f76d7df47 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] [instance: c04ee904-7b1a-4d73-b0c0-eb379c9aa683] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:01:00.303285 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e5977269-3357-430c-8db3-132f76d7df47 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:01:00.303887 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e5977269-3357-430c-8db3-132f76d7df47 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:01:00.304449 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e5977269-3357-430c-8db3-132f76d7df47 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:01:00.305304 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e5977269-3357-430c-8db3-132f76d7df47 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:01:00.305941 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e5977269-3357-430c-8db3-132f76d7df47 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:01:00.306473 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e5977269-3357-430c-8db3-132f76d7df47 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:01:00.322554 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.wsgi [None req-e5977269-3357-430c-8db3-132f76d7df47 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] HTTP exception thrown: Instance c04ee904-7b1a-4d73-b0c0-eb379c9aa683 could not be found. Nov 01 19:01:00.324265 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-e5977269-3357-430c-8db3-132f76d7df47 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Request method failure captured: Nov 01 19:01:00.324265 n-d-863052-2 devstack@n-api.service[121402]: request: GET /compute/v2.1/servers/c04ee904-7b1a-4d73-b0c0-eb379c9aa683 HTTP/1.1 Nov 01 19:01:00.324265 n-d-863052-2 devstack@n-api.service[121402]: Accept: application/json Nov 01 19:01:00.324265 n-d-863052-2 devstack@n-api.service[121402]: Accept-Encoding: identity Nov 01 19:01:00.324265 n-d-863052-2 devstack@n-api.service[121402]: Connection: close Nov 01 19:01:00.324265 n-d-863052-2 devstack@n-api.service[121402]: Content-Length: 0 Nov 01 19:01:00.324265 n-d-863052-2 devstack@n-api.service[121402]: Content-Type: application/json Nov 01 19:01:00.324265 n-d-863052-2 devstack@n-api.service[121402]: Host: 10.222.0.13 Nov 01 19:01:00.324265 n-d-863052-2 devstack@n-api.service[121402]: Openstack-System-Scope: None Nov 01 19:01:00.324265 n-d-863052-2 devstack@n-api.service[121402]: User-Agent: python-urllib3/1.26.12 Nov 01 19:01:00.324265 n-d-863052-2 devstack@n-api.service[121402]: X-Auth-Token: gAAAAABjYWw27zVYcT0jiDkpuT1RhWK3v8RIYvgoBAv6JENEEUigh3EWDZBWsWojpv0UuPsP42AoaM4QJ3MvpvySt_jiXJEPPxL0U99qRIuu3QOrQQyEuoWyflobV2EmBrMy9kC-XG8E8wqlSX7W2YY0K8WOiMWq_0tsCeniBBlKBU3a2s3TKIo Nov 01 19:01:00.324265 n-d-863052-2 devstack@n-api.service[121402]: X-Domain-Id: None Nov 01 19:01:00.324265 n-d-863052-2 devstack@n-api.service[121402]: X-Domain-Name: None Nov 01 19:01:00.324265 n-d-863052-2 devstack@n-api.service[121402]: X-Identity-Status: Confirmed Nov 01 19:01:00.324265 n-d-863052-2 devstack@n-api.service[121402]: X-Is-Admin-Project: True Nov 01 19:01:00.324265 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Domain-Id: default Nov 01 19:01:00.324265 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Domain-Name: Default Nov 01 19:01:00.324265 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Id: 86941784237549838bba63ce88053b88 Nov 01 19:01:00.324265 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Name: tempest-ServersOnMultiNodesTest-1928208762 Nov 01 19:01:00.324265 n-d-863052-2 devstack@n-api.service[121402]: X-Role: member,reader Nov 01 19:01:00.324265 n-d-863052-2 devstack@n-api.service[121402]: X-Roles: member,reader Nov 01 19:01:00.326132 n-d-863052-2 devstack@n-api.service[121402]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/86941784237549838bba63ce88053b88"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/86941784237549838bba63ce88053b88"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_86941784237549838bba63ce88053b88", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/86941784237549838bba63ce88053b88"}]}] Nov 01 19:01:00.326132 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant: tempest-ServersOnMultiNodesTest-1928208762 Nov 01 19:01:00.326132 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant-Id: 86941784237549838bba63ce88053b88 Nov 01 19:01:00.326132 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1928208762 Nov 01 19:01:00.326132 n-d-863052-2 devstack@n-api.service[121402]: X-User: tempest-ServersOnMultiNodesTest-1928208762-project Nov 01 19:01:00.326132 n-d-863052-2 devstack@n-api.service[121402]: X-User-Domain-Id: default Nov 01 19:01:00.326132 n-d-863052-2 devstack@n-api.service[121402]: X-User-Domain-Name: Default Nov 01 19:01:00.326132 n-d-863052-2 devstack@n-api.service[121402]: X-User-Id: 0290a6bb8bc24b8988a925327ac0381c Nov 01 19:01:00.326132 n-d-863052-2 devstack@n-api.service[121402]: X-User-Name: tempest-ServersOnMultiNodesTest-1928208762-project Nov 01 19:01:00.326132 n-d-863052-2 devstack@n-api.service[121402]: method: > Nov 01 19:01:00.326132 n-d-863052-2 devstack@n-api.service[121402]: exception: Instance c04ee904-7b1a-4d73-b0c0-eb379c9aa683 could not be found. Nov 01 19:01:00.326132 n-d-863052-2 devstack@n-api.service[121402]: action_args: {'id': 'c04ee904-7b1a-4d73-b0c0-eb379c9aa683'} Nov 01 19:01:00.327131 n-d-863052-2 devstack@n-api.service[121402]: {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 01 19:01:00.327131 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:01:00.327131 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 01 19:01:00.327131 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 01 19:01:00.327131 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 01 19:01:00.327131 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 01 19:01:00.327131 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 01 19:01:00.327131 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 01 19:01:00.327131 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 01 19:01:00.327131 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 01 19:01:00.327131 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c04ee904-7b1a-4d73-b0c0-eb379c9aa683 could not be found. Nov 01 19:01:00.327131 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:01:00.327131 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:01:00.327131 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:01:00.327131 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:01:00.327131 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:01:00.327131 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:01:00.327131 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 01 19:01:00.327131 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 01 19:01:00.327131 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 01 19:01:00.328811 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 01 19:01:00.328811 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 01 19:01:00.328811 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 01 19:01:00.328811 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 01 19:01:00.328811 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 01 19:01:00.328811 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 01 19:01:00.328811 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 01 19:01:00.328811 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c04ee904-7b1a-4d73-b0c0-eb379c9aa683 could not be found. Nov 01 19:01:00.328811 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:01:00.328811 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:01:00.328811 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:01:00.328811 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:01:00.328811 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:01:00.328811 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:01:00.328811 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 01 19:01:00.328811 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 01 19:01:00.328811 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c04ee904-7b1a-4d73-b0c0-eb379c9aa683 could not be found. Nov 01 19:01:00.328811 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:01:00.330599 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-e5977269-3357-430c-8db3-132f76d7df47 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Returning 404 to user: Instance c04ee904-7b1a-4d73-b0c0-eb379c9aa683 could not be found. {{(pid=121402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 01 19:01:00.330935 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-e5977269-3357-430c-8db3-132f76d7df47 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] 10.222.0.13 "GET /compute/v2.1/servers/c04ee904-7b1a-4d73-b0c0-eb379c9aa683" status: 404 len: 111 microversion: 2.1 time: 0.039956 Nov 01 19:01:00.331559 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 967/1929] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:01:00 2022] GET /compute/v2.1/servers/c04ee904-7b1a-4d73-b0c0-eb379c9aa683 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 01 19:01:00.340735 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-0d0d2112-e963-471a-ae11-77390ea69801 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:01:00.382585 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-0d0d2112-e963-471a-ae11-77390ea69801 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] 10.222.0.13 "DELETE /compute/v2.1/os-server-groups/15337c02-bdef-4487-a865-2768be719697" status: 204 len: 0 microversion: 2.1 time: 0.046285 Nov 01 19:01:00.383581 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 968/1930] 10.222.0.13 () {58 vars in 1266 bytes} [Tue Nov 1 19:01:00 2022] DELETE /compute/v2.1/os-server-groups/15337c02-bdef-4487-a865-2768be719697 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 01 19:01:00.406789 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-7f2258c6-71e7-4287-9d82-ac09e35d7a32 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:01:00.407418 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-7f2258c6-71e7-4287-9d82-ac09e35d7a32 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] [instance: efdf10ba-60d4-4fb0-970d-109a8f936808] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:01:00.415216 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-7f2258c6-71e7-4287-9d82-ac09e35d7a32 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:01:00.416925 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-7f2258c6-71e7-4287-9d82-ac09e35d7a32 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:01:00.417618 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-7f2258c6-71e7-4287-9d82-ac09e35d7a32 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:01:00.418648 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-7f2258c6-71e7-4287-9d82-ac09e35d7a32 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:01:00.419356 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-7f2258c6-71e7-4287-9d82-ac09e35d7a32 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:01:00.420069 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-7f2258c6-71e7-4287-9d82-ac09e35d7a32 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:01:00.467221 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-7f2258c6-71e7-4287-9d82-ac09e35d7a32 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] [instance: efdf10ba-60d4-4fb0-970d-109a8f936808] Going to try to terminate instance {{(pid=121402) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 01 19:01:00.511189 n-d-863052-2 devstack@n-api.service[121402]: DEBUG dbcounter [-] [121402] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=121402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 19:01:00.642729 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-7f2258c6-71e7-4287-9d82-ac09e35d7a32 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] 10.222.0.13 "DELETE /compute/v2.1/servers/efdf10ba-60d4-4fb0-970d-109a8f936808" status: 204 len: 0 microversion: 2.1 time: 0.253244 Nov 01 19:01:00.651403 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 969/1931] 10.222.0.13 () {58 vars in 1239 bytes} [Tue Nov 1 19:01:00 2022] DELETE /compute/v2.1/servers/efdf10ba-60d4-4fb0-970d-109a8f936808 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 01 19:01:00.660077 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-867216a0-ea8b-4284-a4b4-4f97fd41b0b6 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:01:00.663149 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-867216a0-ea8b-4284-a4b4-4f97fd41b0b6 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] [instance: cd879708-f757-4f88-bc95-38b6cd55363c] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:01:00.687116 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-867216a0-ea8b-4284-a4b4-4f97fd41b0b6 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:01:00.689946 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-867216a0-ea8b-4284-a4b4-4f97fd41b0b6 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:01:00.693233 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-867216a0-ea8b-4284-a4b4-4f97fd41b0b6 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:01:00.697018 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-867216a0-ea8b-4284-a4b4-4f97fd41b0b6 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:01:00.697754 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-867216a0-ea8b-4284-a4b4-4f97fd41b0b6 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:01:00.699306 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-867216a0-ea8b-4284-a4b4-4f97fd41b0b6 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:01:00.896089 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-867216a0-ea8b-4284-a4b4-4f97fd41b0b6 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:01:00.906427 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-867216a0-ea8b-4284-a4b4-4f97fd41b0b6 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:01:00.907881 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-867216a0-ea8b-4284-a4b4-4f97fd41b0b6 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:01:00.909484 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-867216a0-ea8b-4284-a4b4-4f97fd41b0b6 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] 10.222.0.13 "GET /compute/v2.1/servers/cd879708-f757-4f88-bc95-38b6cd55363c" status: 200 len: 1293 microversion: 2.25 time: 0.256238 Nov 01 19:01:00.910262 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 970/1932] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 19:01:00 2022] GET /compute/v2.1/servers/cd879708-f757-4f88-bc95-38b6cd55363c => generated 1293 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 19:01:00.915608 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-c70445ec-1d59-4a21-8895-05ead5011f64 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:01:00.916821 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-c70445ec-1d59-4a21-8895-05ead5011f64 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] [instance: 9dbe3d05-9fa8-4fd2-8415-52bfe6ee5801] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:01:00.925392 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-c70445ec-1d59-4a21-8895-05ead5011f64 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:01:00.925888 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-c70445ec-1d59-4a21-8895-05ead5011f64 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:01:00.926861 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-c70445ec-1d59-4a21-8895-05ead5011f64 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:01:00.927205 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-c70445ec-1d59-4a21-8895-05ead5011f64 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:01:00.927853 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-c70445ec-1d59-4a21-8895-05ead5011f64 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:01:00.928448 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-c70445ec-1d59-4a21-8895-05ead5011f64 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:01:00.966661 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-c70445ec-1d59-4a21-8895-05ead5011f64 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] [instance: 9dbe3d05-9fa8-4fd2-8415-52bfe6ee5801] Going to try to terminate instance {{(pid=121402) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 01 19:01:01.114878 n-d-863052-2 devstack@n-api.service[121402]: DEBUG dbcounter [-] [121402] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=3,nova_api:DELETE=3 {{(pid=121402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 19:01:01.137220 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-c70445ec-1d59-4a21-8895-05ead5011f64 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] 10.222.0.13 "DELETE /compute/v2.1/servers/9dbe3d05-9fa8-4fd2-8415-52bfe6ee5801" status: 204 len: 0 microversion: 2.1 time: 0.225392 Nov 01 19:01:01.137921 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 971/1933] 10.222.0.13 () {58 vars in 1239 bytes} [Tue Nov 1 19:01:00 2022] DELETE /compute/v2.1/servers/9dbe3d05-9fa8-4fd2-8415-52bfe6ee5801 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 01 19:01:01.147365 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-f715469c-cd00-4fa3-a53a-4b89a172c710 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:01:01.148095 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-f715469c-cd00-4fa3-a53a-4b89a172c710 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] [instance: 1f499af7-1896-478c-b7d7-d922bf78bd98] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:01:01.156173 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f715469c-cd00-4fa3-a53a-4b89a172c710 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:01:01.156857 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f715469c-cd00-4fa3-a53a-4b89a172c710 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:01:01.157301 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f715469c-cd00-4fa3-a53a-4b89a172c710 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:01:01.158087 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f715469c-cd00-4fa3-a53a-4b89a172c710 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:01:01.158549 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f715469c-cd00-4fa3-a53a-4b89a172c710 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:01:01.158982 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f715469c-cd00-4fa3-a53a-4b89a172c710 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:01:01.377516 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-f715469c-cd00-4fa3-a53a-4b89a172c710 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f32f5fba1976432d938e664c7714e52b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b9d4c236b944f9b2e8e502a50a8f8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:01:01.392039 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-f715469c-cd00-4fa3-a53a-4b89a172c710 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] 10.222.0.13 "GET /compute/v2.1/servers/1f499af7-1896-478c-b7d7-d922bf78bd98" status: 200 len: 1391 microversion: 2.1 time: 0.249169 Nov 01 19:01:01.394203 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 972/1934] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:01:01 2022] GET /compute/v2.1/servers/1f499af7-1896-478c-b7d7-d922bf78bd98 => generated 1391 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:01:01.401402 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-9a150937-71bb-465c-a365-989bcc873112 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:01:01.402289 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-9a150937-71bb-465c-a365-989bcc873112 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] [instance: efdf10ba-60d4-4fb0-970d-109a8f936808] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:01:01.411873 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-9a150937-71bb-465c-a365-989bcc873112 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:01:01.412807 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-9a150937-71bb-465c-a365-989bcc873112 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:01:01.413497 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-9a150937-71bb-465c-a365-989bcc873112 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:01:01.414762 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-9a150937-71bb-465c-a365-989bcc873112 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:01:01.416367 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-9a150937-71bb-465c-a365-989bcc873112 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:01:01.417114 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-9a150937-71bb-465c-a365-989bcc873112 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:01:01.658351 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-9a150937-71bb-465c-a365-989bcc873112 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0290a6bb8bc24b8988a925327ac0381c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86941784237549838bba63ce88053b88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:01:01.684249 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-9a150937-71bb-465c-a365-989bcc873112 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] 10.222.0.13 "GET /compute/v2.1/servers/efdf10ba-60d4-4fb0-970d-109a8f936808" status: 200 len: 1475 microversion: 2.1 time: 0.288548 Nov 01 19:01:01.685237 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 973/1935] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:01:01 2022] GET /compute/v2.1/servers/efdf10ba-60d4-4fb0-970d-109a8f936808 => generated 1475 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:01:01.690337 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-609cda73-d195-42d4-a1fd-82dd67c97f54 tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] Calling method '.version_select at 0x7f0ae1cd6160>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:01:01.787414 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-609cda73-d195-42d4-a1fd-82dd67c97f54 tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] 10.222.0.13 "GET /compute/v2.1/images/52ccd7d5-4eba-4e0d-97f4-a4927c3504a7" status: 200 len: 1455 microversion: 2.1 time: 0.100850 Nov 01 19:01:01.790244 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 974/1936] 10.222.0.13 () {58 vars in 1233 bytes} [Tue Nov 1 19:01:01 2022] GET /compute/v2.1/images/52ccd7d5-4eba-4e0d-97f4-a4927c3504a7 => generated 1455 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:01:01.944487 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-632768af-bfe3-42fb-bd08-7fc67faa844f tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:01:01.945870 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-632768af-bfe3-42fb-bd08-7fc67faa844f tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] [instance: cd879708-f757-4f88-bc95-38b6cd55363c] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:01:01.960051 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-632768af-bfe3-42fb-bd08-7fc67faa844f tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:01:01.960771 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-632768af-bfe3-42fb-bd08-7fc67faa844f tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:01:01.963033 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-632768af-bfe3-42fb-bd08-7fc67faa844f tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:01:01.964484 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-632768af-bfe3-42fb-bd08-7fc67faa844f tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:01:01.965724 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-632768af-bfe3-42fb-bd08-7fc67faa844f tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:01:01.967034 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-632768af-bfe3-42fb-bd08-7fc67faa844f tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:01:02.408975 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-632768af-bfe3-42fb-bd08-7fc67faa844f tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:01:02.430103 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-632768af-bfe3-42fb-bd08-7fc67faa844f tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:01:02.434470 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-632768af-bfe3-42fb-bd08-7fc67faa844f tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:01:02.439635 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-632768af-bfe3-42fb-bd08-7fc67faa844f tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] 10.222.0.13 "GET /compute/v2.1/servers/cd879708-f757-4f88-bc95-38b6cd55363c" status: 200 len: 1293 microversion: 2.25 time: 0.500879 Nov 01 19:01:02.449736 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 975/1937] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 19:01:01 2022] GET /compute/v2.1/servers/cd879708-f757-4f88-bc95-38b6cd55363c => generated 1293 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 19:01:02.450975 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-e76d1ece-8829-46f1-a783-99720107a3c4 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:01:02.451720 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-e76d1ece-8829-46f1-a783-99720107a3c4 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] [instance: 1f499af7-1896-478c-b7d7-d922bf78bd98] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:01:02.459794 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e76d1ece-8829-46f1-a783-99720107a3c4 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:01:02.460444 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e76d1ece-8829-46f1-a783-99720107a3c4 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:01:02.462196 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e76d1ece-8829-46f1-a783-99720107a3c4 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:01:02.464152 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e76d1ece-8829-46f1-a783-99720107a3c4 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:01:02.464918 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e76d1ece-8829-46f1-a783-99720107a3c4 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:01:02.465597 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e76d1ece-8829-46f1-a783-99720107a3c4 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:01:02.700907 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-e76d1ece-8829-46f1-a783-99720107a3c4 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f32f5fba1976432d938e664c7714e52b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b9d4c236b944f9b2e8e502a50a8f8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:01:02.712674 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-e76d1ece-8829-46f1-a783-99720107a3c4 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] 10.222.0.13 "GET /compute/v2.1/servers/1f499af7-1896-478c-b7d7-d922bf78bd98" status: 200 len: 1391 microversion: 2.1 time: 0.267018 Nov 01 19:01:02.714538 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 976/1938] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:01:02 2022] GET /compute/v2.1/servers/1f499af7-1896-478c-b7d7-d922bf78bd98 => generated 1391 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:01:02.719769 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-8b201f81-0df0-4c41-9e84-b3d75341d118 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:01:02.721679 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-8b201f81-0df0-4c41-9e84-b3d75341d118 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] [instance: efdf10ba-60d4-4fb0-970d-109a8f936808] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:01:02.730211 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-8b201f81-0df0-4c41-9e84-b3d75341d118 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:01:02.732155 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-8b201f81-0df0-4c41-9e84-b3d75341d118 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:01:02.732610 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-8b201f81-0df0-4c41-9e84-b3d75341d118 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:01:02.733370 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-8b201f81-0df0-4c41-9e84-b3d75341d118 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:01:02.733912 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-8b201f81-0df0-4c41-9e84-b3d75341d118 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:01:02.734501 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-8b201f81-0df0-4c41-9e84-b3d75341d118 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:01:02.947085 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-8b201f81-0df0-4c41-9e84-b3d75341d118 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0290a6bb8bc24b8988a925327ac0381c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86941784237549838bba63ce88053b88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:01:02.955767 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-8b201f81-0df0-4c41-9e84-b3d75341d118 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] 10.222.0.13 "GET /compute/v2.1/servers/efdf10ba-60d4-4fb0-970d-109a8f936808" status: 200 len: 1475 microversion: 2.1 time: 0.240155 Nov 01 19:01:02.970414 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 977/1939] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:01:02 2022] GET /compute/v2.1/servers/efdf10ba-60d4-4fb0-970d-109a8f936808 => generated 1475 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:01:02.981167 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-a280a45b-063a-44e9-9c2c-7258bd3ab7ff tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] Calling method '.version_select at 0x7f0ae1cd6dc0>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:01:03.043917 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-a280a45b-063a-44e9-9c2c-7258bd3ab7ff tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] 10.222.0.13 "GET /compute/v2.1/images/52ccd7d5-4eba-4e0d-97f4-a4927c3504a7" status: 200 len: 1455 microversion: 2.1 time: 0.072166 Nov 01 19:01:03.044977 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 978/1940] 10.222.0.13 () {58 vars in 1233 bytes} [Tue Nov 1 19:01:02 2022] GET /compute/v2.1/images/52ccd7d5-4eba-4e0d-97f4-a4927c3504a7 => generated 1455 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:01:03.471207 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-657a9e79-54e1-40fd-aa2d-2c4098f92b7b tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:01:03.471809 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-657a9e79-54e1-40fd-aa2d-2c4098f92b7b tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] [instance: cd879708-f757-4f88-bc95-38b6cd55363c] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:01:03.491461 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-657a9e79-54e1-40fd-aa2d-2c4098f92b7b tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:01:03.498107 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-657a9e79-54e1-40fd-aa2d-2c4098f92b7b tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:01:03.505326 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-657a9e79-54e1-40fd-aa2d-2c4098f92b7b tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:01:03.506368 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-657a9e79-54e1-40fd-aa2d-2c4098f92b7b tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:01:03.507002 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-657a9e79-54e1-40fd-aa2d-2c4098f92b7b tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:01:03.507597 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-657a9e79-54e1-40fd-aa2d-2c4098f92b7b tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:01:03.619155 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-66f9d7e1-ce91-4647-ac0a-18ded4909ab1 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] 10.222.0.13 "POST /compute/v2.1/servers/90b353ab-ef97-4d88-b5bc-b355ff576225/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 5.645524 Nov 01 19:01:03.630426 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 963/1941] 10.222.0.13 () {60 vars in 1323 bytes} [Tue Nov 1 19:00:57 2022] POST /compute/v2.1/servers/90b353ab-ef97-4d88-b5bc-b355ff576225/os-volume_attachments => generated 194 bytes in 5659 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:01:03.740242 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-c8ff0e5e-ccf1-4c1e-bc85-846e08808b66 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:01:03.741519 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-c8ff0e5e-ccf1-4c1e-bc85-846e08808b66 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] [instance: 1f499af7-1896-478c-b7d7-d922bf78bd98] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:01:03.767968 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-c8ff0e5e-ccf1-4c1e-bc85-846e08808b66 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:01:03.768496 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-c8ff0e5e-ccf1-4c1e-bc85-846e08808b66 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:01:03.768970 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-c8ff0e5e-ccf1-4c1e-bc85-846e08808b66 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:01:03.773734 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-c8ff0e5e-ccf1-4c1e-bc85-846e08808b66 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:01:03.775878 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-c8ff0e5e-ccf1-4c1e-bc85-846e08808b66 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:01:03.783640 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-c8ff0e5e-ccf1-4c1e-bc85-846e08808b66 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:01:04.372749 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-c8ff0e5e-ccf1-4c1e-bc85-846e08808b66 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f32f5fba1976432d938e664c7714e52b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b9d4c236b944f9b2e8e502a50a8f8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:01:04.385765 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-c8ff0e5e-ccf1-4c1e-bc85-846e08808b66 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] 10.222.0.13 "GET /compute/v2.1/servers/1f499af7-1896-478c-b7d7-d922bf78bd98" status: 200 len: 1391 microversion: 2.1 time: 0.651131 Nov 01 19:01:04.388729 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 964/1942] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:01:03 2022] GET /compute/v2.1/servers/1f499af7-1896-478c-b7d7-d922bf78bd98 => generated 1391 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:01:04.394744 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [req-28f5b73b-938c-46c3-a1bd-91fa35b243fd req-44c5ec90-72b1-44ce-9c23-5b26e09a1611 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d8e88b0f-ae97-44a4-8b6b-b94e2c600a83", "name": "network-vif-plugged", "status": "completed", "tag": "91ce416d-c08f-473f-a551-fa3519a6c6c7"}]} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:01:04.413320 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-28f5b73b-938c-46c3-a1bd-91fa35b243fd req-44c5ec90-72b1-44ce-9c23-5b26e09a1611 service nova] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:01:04.414329 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-28f5b73b-938c-46c3-a1bd-91fa35b243fd req-44c5ec90-72b1-44ce-9c23-5b26e09a1611 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:01:04.415588 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-28f5b73b-938c-46c3-a1bd-91fa35b243fd req-44c5ec90-72b1-44ce-9c23-5b26e09a1611 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:01:04.437616 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.compute.server_external_events [req-28f5b73b-938c-46c3-a1bd-91fa35b243fd req-44c5ec90-72b1-44ce-9c23-5b26e09a1611 service nova] Creating event network-vif-plugged:91ce416d-c08f-473f-a551-fa3519a6c6c7 for instance d8e88b0f-ae97-44a4-8b6b-b94e2c600a83 on n-h1-863052-2 Nov 01 19:01:04.444781 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [req-28f5b73b-938c-46c3-a1bd-91fa35b243fd req-44c5ec90-72b1-44ce-9c23-5b26e09a1611 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054552 Nov 01 19:01:04.445998 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 965/1943] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Nov 1 19:01:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:01:04.454691 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-24e07deb-b684-4bd9-8f52-35361b8f1669 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:01:04.456129 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-24e07deb-b684-4bd9-8f52-35361b8f1669 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] [instance: efdf10ba-60d4-4fb0-970d-109a8f936808] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:01:04.457784 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-657a9e79-54e1-40fd-aa2d-2c4098f92b7b tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:01:04.466641 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-24e07deb-b684-4bd9-8f52-35361b8f1669 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:01:04.467503 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-24e07deb-b684-4bd9-8f52-35361b8f1669 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:01:04.468220 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-24e07deb-b684-4bd9-8f52-35361b8f1669 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:01:04.469434 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-24e07deb-b684-4bd9-8f52-35361b8f1669 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:01:04.470195 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-24e07deb-b684-4bd9-8f52-35361b8f1669 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:01:04.470786 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-24e07deb-b684-4bd9-8f52-35361b8f1669 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:01:04.480151 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-657a9e79-54e1-40fd-aa2d-2c4098f92b7b tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:01:04.481551 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-657a9e79-54e1-40fd-aa2d-2c4098f92b7b tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:01:04.482701 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-657a9e79-54e1-40fd-aa2d-2c4098f92b7b tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] 10.222.0.13 "GET /compute/v2.1/servers/cd879708-f757-4f88-bc95-38b6cd55363c" status: 200 len: 1281 microversion: 2.25 time: 1.017536 Nov 01 19:01:04.483267 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 979/1944] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 19:01:03 2022] GET /compute/v2.1/servers/cd879708-f757-4f88-bc95-38b6cd55363c => generated 1281 bytes in 1019 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 19:01:04.525183 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-70eb7f33-2be0-44b6-902a-a47b4b5f9205 tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] Calling method '.version_select at 0x7f0ae1cd6a60>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:01:04.619375 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-70eb7f33-2be0-44b6-902a-a47b4b5f9205 tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] 10.222.0.13 "GET /compute/v2.1/images/52ccd7d5-4eba-4e0d-97f4-a4927c3504a7" status: 200 len: 1455 microversion: 2.1 time: 0.111641 Nov 01 19:01:04.620425 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 980/1945] 10.222.0.13 () {58 vars in 1233 bytes} [Tue Nov 1 19:01:04 2022] GET /compute/v2.1/images/52ccd7d5-4eba-4e0d-97f4-a4927c3504a7 => generated 1455 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:01:04.934328 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [req-b4b98061-ac03-4f22-b807-814efa44b71d req-e1a433fa-efee-4229-9569-57fa4b703e48 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9dbe3d05-9fa8-4fd2-8415-52bfe6ee5801", "name": "network-vif-deleted", "tag": "efd34ee7-e836-43e2-aafc-e8436d0a8065"}]} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:01:04.972949 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-b4b98061-ac03-4f22-b807-814efa44b71d req-e1a433fa-efee-4229-9569-57fa4b703e48 service nova] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:01:04.978128 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-b4b98061-ac03-4f22-b807-814efa44b71d req-e1a433fa-efee-4229-9569-57fa4b703e48 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:01:04.978819 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-b4b98061-ac03-4f22-b807-814efa44b71d req-e1a433fa-efee-4229-9569-57fa4b703e48 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:01:05.036527 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.compute.server_external_events [req-b4b98061-ac03-4f22-b807-814efa44b71d req-e1a433fa-efee-4229-9569-57fa4b703e48 service nova] Creating event network-vif-deleted:efd34ee7-e836-43e2-aafc-e8436d0a8065 for instance 9dbe3d05-9fa8-4fd2-8415-52bfe6ee5801 on n-h1-863052-2 Nov 01 19:01:05.057156 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [req-b4b98061-ac03-4f22-b807-814efa44b71d req-e1a433fa-efee-4229-9569-57fa4b703e48 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.127502 Nov 01 19:01:05.062676 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 981/1946] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Nov 1 19:01:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:01:05.235448 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-24e07deb-b684-4bd9-8f52-35361b8f1669 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0290a6bb8bc24b8988a925327ac0381c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86941784237549838bba63ce88053b88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:01:05.251054 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-24e07deb-b684-4bd9-8f52-35361b8f1669 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] 10.222.0.13 "GET /compute/v2.1/servers/efdf10ba-60d4-4fb0-970d-109a8f936808" status: 200 len: 1475 microversion: 2.1 time: 0.802010 Nov 01 19:01:05.252285 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 966/1947] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:01:04 2022] GET /compute/v2.1/servers/efdf10ba-60d4-4fb0-970d-109a8f936808 => generated 1475 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:01:05.412608 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-47ff6f1e-6dfe-4892-880d-bb4a2054236b tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:01:05.413666 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-47ff6f1e-6dfe-4892-880d-bb4a2054236b tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] [instance: 1f499af7-1896-478c-b7d7-d922bf78bd98] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:01:05.435947 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-47ff6f1e-6dfe-4892-880d-bb4a2054236b tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:01:05.436458 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-47ff6f1e-6dfe-4892-880d-bb4a2054236b tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:01:05.437987 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-47ff6f1e-6dfe-4892-880d-bb4a2054236b tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:01:05.438715 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-47ff6f1e-6dfe-4892-880d-bb4a2054236b tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:01:05.441515 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-47ff6f1e-6dfe-4892-880d-bb4a2054236b tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:01:05.442177 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-47ff6f1e-6dfe-4892-880d-bb4a2054236b tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:01:05.606768 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-5dd63544-639c-4cd4-bdd5-4661bca700bb tempest-QuotaClassesAdmin257Test-756480435 tempest-QuotaClassesAdmin257Test-756480435-project-admin] Calling method '.version_select at 0x7f0ae2b72550>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:01:05.620258 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-5dd63544-639c-4cd4-bdd5-4661bca700bb tempest-QuotaClassesAdmin257Test-756480435 tempest-QuotaClassesAdmin257Test-756480435-project-admin] 10.222.0.13 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 172 microversion: 2.57 time: 0.272207 Nov 01 19:01:05.620896 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 982/1948] 10.222.0.13 () {60 vars in 1226 bytes} [Tue Nov 1 19:01:05 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 172 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 01 19:01:05.625477 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [req-c4fc1861-adc8-446f-a382-baf2e7a8c3f9 req-db62d431-dff0-4c49-8870-19e1098d4057 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "efdf10ba-60d4-4fb0-970d-109a8f936808", "name": "network-vif-deleted", "tag": "d334cfe4-860d-43f2-bb0d-10cd04b6e568"}]} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:01:05.642677 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-c4fc1861-adc8-446f-a382-baf2e7a8c3f9 req-db62d431-dff0-4c49-8870-19e1098d4057 service nova] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:01:05.643156 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-c4fc1861-adc8-446f-a382-baf2e7a8c3f9 req-db62d431-dff0-4c49-8870-19e1098d4057 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:01:05.643924 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-c4fc1861-adc8-446f-a382-baf2e7a8c3f9 req-db62d431-dff0-4c49-8870-19e1098d4057 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:01:05.656492 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.compute.server_external_events [req-c4fc1861-adc8-446f-a382-baf2e7a8c3f9 req-db62d431-dff0-4c49-8870-19e1098d4057 service nova] Creating event network-vif-deleted:d334cfe4-860d-43f2-bb0d-10cd04b6e568 for instance efdf10ba-60d4-4fb0-970d-109a8f936808 on n-h1-863052-2 Nov 01 19:01:05.664905 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [req-c4fc1861-adc8-446f-a382-baf2e7a8c3f9 req-db62d431-dff0-4c49-8870-19e1098d4057 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042653 Nov 01 19:01:05.666064 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 983/1949] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Nov 1 19:01:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:01:05.674089 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-0ccf94aa-d2ea-436d-86e3-a4e822868ab4 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:01:05.675073 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-0ccf94aa-d2ea-436d-86e3-a4e822868ab4 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] [instance: cd879708-f757-4f88-bc95-38b6cd55363c] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:01:05.681828 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-0ccf94aa-d2ea-436d-86e3-a4e822868ab4 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:01:05.682313 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-0ccf94aa-d2ea-436d-86e3-a4e822868ab4 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:01:05.682754 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-0ccf94aa-d2ea-436d-86e3-a4e822868ab4 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:01:05.683454 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-0ccf94aa-d2ea-436d-86e3-a4e822868ab4 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:01:05.683936 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-0ccf94aa-d2ea-436d-86e3-a4e822868ab4 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:01:05.684335 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-0ccf94aa-d2ea-436d-86e3-a4e822868ab4 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:01:05.936258 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-47ff6f1e-6dfe-4892-880d-bb4a2054236b tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f32f5fba1976432d938e664c7714e52b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b9d4c236b944f9b2e8e502a50a8f8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:01:05.946748 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-47ff6f1e-6dfe-4892-880d-bb4a2054236b tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] 10.222.0.13 "GET /compute/v2.1/servers/1f499af7-1896-478c-b7d7-d922bf78bd98" status: 200 len: 1391 microversion: 2.1 time: 0.538798 Nov 01 19:01:05.953948 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 967/1950] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:01:05 2022] GET /compute/v2.1/servers/1f499af7-1896-478c-b7d7-d922bf78bd98 => generated 1391 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:01:05.987976 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-f4785155-ccd0-4ea5-8850-c479cbfc505c tempest-QuotaClassesAdmin257Test-756480435 tempest-QuotaClassesAdmin257Test-756480435-project-admin] Action: 'update', calling method: .version_select at 0x7f0ae20eaca0>, body: {"quota_class_set": {"cores": 120, "instances": 110, "key_pairs": 200, "metadata_items": 228, "ram": 51300, "server_group_members": 110, "server_groups": 110}} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:01:06.077129 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-0ccf94aa-d2ea-436d-86e3-a4e822868ab4 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:01:06.085992 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-0ccf94aa-d2ea-436d-86e3-a4e822868ab4 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:01:06.087451 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-0ccf94aa-d2ea-436d-86e3-a4e822868ab4 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:01:06.101997 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-0ccf94aa-d2ea-436d-86e3-a4e822868ab4 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] 10.222.0.13 "GET /compute/v2.1/servers/cd879708-f757-4f88-bc95-38b6cd55363c" status: 200 len: 1281 microversion: 2.25 time: 0.434437 Nov 01 19:01:06.105814 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 984/1951] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 19:01:05 2022] GET /compute/v2.1/servers/cd879708-f757-4f88-bc95-38b6cd55363c => generated 1281 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 19:01:06.118341 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-04501615-8046-4757-ad33-23195a446fd6 tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] Calling method '.version_select at 0x7f0ae2b3bd30>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:01:06.248114 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-04501615-8046-4757-ad33-23195a446fd6 tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] 10.222.0.13 "GET /compute/v2.1/images/52ccd7d5-4eba-4e0d-97f4-a4927c3504a7" status: 200 len: 1455 microversion: 2.1 time: 0.141165 Nov 01 19:01:06.252190 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 985/1952] 10.222.0.13 () {58 vars in 1233 bytes} [Tue Nov 1 19:01:06 2022] GET /compute/v2.1/images/52ccd7d5-4eba-4e0d-97f4-a4927c3504a7 => generated 1455 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:01:06.281460 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-5e56bd2f-d7ca-4877-9bde-9f3e04615180 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:01:06.281896 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-5e56bd2f-d7ca-4877-9bde-9f3e04615180 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] [instance: efdf10ba-60d4-4fb0-970d-109a8f936808] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:01:06.290238 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-5e56bd2f-d7ca-4877-9bde-9f3e04615180 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:01:06.291452 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-5e56bd2f-d7ca-4877-9bde-9f3e04615180 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:01:06.292105 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-5e56bd2f-d7ca-4877-9bde-9f3e04615180 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:01:06.300531 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-5e56bd2f-d7ca-4877-9bde-9f3e04615180 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:01:06.301762 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-5e56bd2f-d7ca-4877-9bde-9f3e04615180 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:01:06.303529 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-5e56bd2f-d7ca-4877-9bde-9f3e04615180 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:01:06.367063 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-f4785155-ccd0-4ea5-8850-c479cbfc505c tempest-QuotaClassesAdmin257Test-756480435 tempest-QuotaClassesAdmin257Test-756480435-project-admin] 10.222.0.13 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 159 microversion: 2.57 time: 0.411211 Nov 01 19:01:06.370353 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 968/1953] 10.222.0.13 () {62 vars in 1247 bytes} [Tue Nov 1 19:01:05 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 159 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 01 19:01:06.380679 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-8d95352e-b4ca-485f-8382-c6d272190af0 tempest-QuotaClassesAdmin257Test-756480435 tempest-QuotaClassesAdmin257Test-756480435-project-admin] Calling method '.version_select at 0x7f0ae2851160>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:01:06.399193 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-5e56bd2f-d7ca-4877-9bde-9f3e04615180 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:01:06.399734 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-5e56bd2f-d7ca-4877-9bde-9f3e04615180 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:01:06.400240 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-5e56bd2f-d7ca-4877-9bde-9f3e04615180 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:01:06.400797 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.objects.instance [None req-5e56bd2f-d7ca-4877-9bde-9f3e04615180 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lazy-loading 'fault' on Instance uuid efdf10ba-60d4-4fb0-970d-109a8f936808 {{(pid=121402) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 01 19:01:06.409691 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-8d95352e-b4ca-485f-8382-c6d272190af0 tempest-QuotaClassesAdmin257Test-756480435 tempest-QuotaClassesAdmin257Test-756480435-project-admin] 10.222.0.13 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 176 microversion: 2.57 time: 0.031981 Nov 01 19:01:06.413401 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 969/1954] 10.222.0.13 () {60 vars in 1226 bytes} [Tue Nov 1 19:01:06 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 176 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 01 19:01:06.433202 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-f4996f91-423b-46a2-872a-cea0f4439908 tempest-QuotaClassesAdmin257Test-756480435 tempest-QuotaClassesAdmin257Test-756480435-project-admin] Action: 'update', calling method: .version_select at 0x7f0ae285f670>, body: {"quota_class_set": {"cores": 20, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "server_group_members": 10, "server_groups": 10}} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:01:06.480327 n-d-863052-2 devstack@n-api.service[121403]: DEBUG dbcounter [-] [121403] Writing DB stats nova_api:SELECT=87,nova_api:UPDATE=11,nova_api:INSERT=2 {{(pid=121403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 19:01:06.491212 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-5e56bd2f-d7ca-4877-9bde-9f3e04615180 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0290a6bb8bc24b8988a925327ac0381c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86941784237549838bba63ce88053b88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:01:06.504214 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-5e56bd2f-d7ca-4877-9bde-9f3e04615180 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] 10.222.0.13 "GET /compute/v2.1/servers/efdf10ba-60d4-4fb0-970d-109a8f936808" status: 200 len: 1309 microversion: 2.1 time: 0.228954 Nov 01 19:01:06.506064 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 986/1955] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:01:06 2022] GET /compute/v2.1/servers/efdf10ba-60d4-4fb0-970d-109a8f936808 => generated 1309 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 19:01:06.585815 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-f4996f91-423b-46a2-872a-cea0f4439908 tempest-QuotaClassesAdmin257Test-756480435 tempest-QuotaClassesAdmin257Test-756480435-project-admin] 10.222.0.13 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 155 microversion: 2.57 time: 0.161407 Nov 01 19:01:06.586672 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 970/1956] 10.222.0.13 () {62 vars in 1247 bytes} [Tue Nov 1 19:01:06 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 155 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 01 19:01:06.985040 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-2558c7cd-d803-4040-882d-672817d235dd tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:01:06.985610 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-2558c7cd-d803-4040-882d-672817d235dd tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] [instance: 1f499af7-1896-478c-b7d7-d922bf78bd98] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:01:07.005455 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2558c7cd-d803-4040-882d-672817d235dd tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:01:07.008369 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2558c7cd-d803-4040-882d-672817d235dd tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:01:07.012106 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2558c7cd-d803-4040-882d-672817d235dd tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:01:07.014826 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2558c7cd-d803-4040-882d-672817d235dd tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:01:07.016827 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2558c7cd-d803-4040-882d-672817d235dd tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:01:07.019718 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2558c7cd-d803-4040-882d-672817d235dd tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:01:07.132485 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-d0a136d9-aa3b-4cd9-ab61-8d10470856a6 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:01:07.133441 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-d0a136d9-aa3b-4cd9-ab61-8d10470856a6 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] [instance: cd879708-f757-4f88-bc95-38b6cd55363c] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:01:07.142591 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d0a136d9-aa3b-4cd9-ab61-8d10470856a6 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:01:07.153994 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d0a136d9-aa3b-4cd9-ab61-8d10470856a6 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:01:07.154725 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d0a136d9-aa3b-4cd9-ab61-8d10470856a6 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:01:07.155793 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d0a136d9-aa3b-4cd9-ab61-8d10470856a6 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:01:07.156559 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d0a136d9-aa3b-4cd9-ab61-8d10470856a6 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:01:07.157253 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d0a136d9-aa3b-4cd9-ab61-8d10470856a6 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:01:07.500570 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-d0a136d9-aa3b-4cd9-ab61-8d10470856a6 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:01:07.514489 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-d0a136d9-aa3b-4cd9-ab61-8d10470856a6 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:01:07.518644 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-d0a136d9-aa3b-4cd9-ab61-8d10470856a6 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:01:07.521609 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-d0a136d9-aa3b-4cd9-ab61-8d10470856a6 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] 10.222.0.13 "GET /compute/v2.1/servers/cd879708-f757-4f88-bc95-38b6cd55363c" status: 200 len: 1281 microversion: 2.25 time: 0.394089 Nov 01 19:01:07.526551 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 971/1957] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 19:01:07 2022] GET /compute/v2.1/servers/cd879708-f757-4f88-bc95-38b6cd55363c => generated 1281 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 19:01:07.542437 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-ac42ca14-b152-4b60-aead-fecf82d9af28 tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] Calling method '.version_select at 0x7f0ae20f73a0>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:01:07.567166 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-2558c7cd-d803-4040-882d-672817d235dd tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f32f5fba1976432d938e664c7714e52b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b9d4c236b944f9b2e8e502a50a8f8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:01:07.578622 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-2558c7cd-d803-4040-882d-672817d235dd tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] 10.222.0.13 "GET /compute/v2.1/servers/1f499af7-1896-478c-b7d7-d922bf78bd98" status: 200 len: 1391 microversion: 2.1 time: 0.606626 Nov 01 19:01:07.581981 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 987/1958] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:01:06 2022] GET /compute/v2.1/servers/1f499af7-1896-478c-b7d7-d922bf78bd98 => generated 1391 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:01:07.593950 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-ff726603-9dc6-45af-8df9-457d64aeee9e tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:01:07.594834 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-ff726603-9dc6-45af-8df9-457d64aeee9e tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] [instance: efdf10ba-60d4-4fb0-970d-109a8f936808] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:01:07.614370 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-ff726603-9dc6-45af-8df9-457d64aeee9e tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:01:07.615084 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-ff726603-9dc6-45af-8df9-457d64aeee9e tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:01:07.615777 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-ff726603-9dc6-45af-8df9-457d64aeee9e tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:01:07.616680 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-ff726603-9dc6-45af-8df9-457d64aeee9e tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:01:07.617299 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-ff726603-9dc6-45af-8df9-457d64aeee9e tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:01:07.617936 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-ff726603-9dc6-45af-8df9-457d64aeee9e tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:01:07.644523 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-ac42ca14-b152-4b60-aead-fecf82d9af28 tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] 10.222.0.13 "GET /compute/v2.1/images/52ccd7d5-4eba-4e0d-97f4-a4927c3504a7" status: 200 len: 1455 microversion: 2.1 time: 0.115787 Nov 01 19:01:07.645242 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 972/1959] 10.222.0.13 () {58 vars in 1233 bytes} [Tue Nov 1 19:01:07 2022] GET /compute/v2.1/images/52ccd7d5-4eba-4e0d-97f4-a4927c3504a7 => generated 1455 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:01:07.663919 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.wsgi [None req-ff726603-9dc6-45af-8df9-457d64aeee9e tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] HTTP exception thrown: Instance efdf10ba-60d4-4fb0-970d-109a8f936808 could not be found. Nov 01 19:01:07.669869 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-ff726603-9dc6-45af-8df9-457d64aeee9e tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Request method failure captured: Nov 01 19:01:07.669869 n-d-863052-2 devstack@n-api.service[121402]: request: GET /compute/v2.1/servers/efdf10ba-60d4-4fb0-970d-109a8f936808 HTTP/1.1 Nov 01 19:01:07.669869 n-d-863052-2 devstack@n-api.service[121402]: Accept: application/json Nov 01 19:01:07.669869 n-d-863052-2 devstack@n-api.service[121402]: Accept-Encoding: identity Nov 01 19:01:07.669869 n-d-863052-2 devstack@n-api.service[121402]: Connection: close Nov 01 19:01:07.669869 n-d-863052-2 devstack@n-api.service[121402]: Content-Length: 0 Nov 01 19:01:07.669869 n-d-863052-2 devstack@n-api.service[121402]: Content-Type: application/json Nov 01 19:01:07.669869 n-d-863052-2 devstack@n-api.service[121402]: Host: 10.222.0.13 Nov 01 19:01:07.669869 n-d-863052-2 devstack@n-api.service[121402]: Openstack-System-Scope: None Nov 01 19:01:07.669869 n-d-863052-2 devstack@n-api.service[121402]: User-Agent: python-urllib3/1.26.12 Nov 01 19:01:07.669869 n-d-863052-2 devstack@n-api.service[121402]: X-Auth-Token: gAAAAABjYWw27zVYcT0jiDkpuT1RhWK3v8RIYvgoBAv6JENEEUigh3EWDZBWsWojpv0UuPsP42AoaM4QJ3MvpvySt_jiXJEPPxL0U99qRIuu3QOrQQyEuoWyflobV2EmBrMy9kC-XG8E8wqlSX7W2YY0K8WOiMWq_0tsCeniBBlKBU3a2s3TKIo Nov 01 19:01:07.669869 n-d-863052-2 devstack@n-api.service[121402]: X-Domain-Id: None Nov 01 19:01:07.669869 n-d-863052-2 devstack@n-api.service[121402]: X-Domain-Name: None Nov 01 19:01:07.669869 n-d-863052-2 devstack@n-api.service[121402]: X-Identity-Status: Confirmed Nov 01 19:01:07.669869 n-d-863052-2 devstack@n-api.service[121402]: X-Is-Admin-Project: True Nov 01 19:01:07.669869 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Domain-Id: default Nov 01 19:01:07.669869 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Domain-Name: Default Nov 01 19:01:07.669869 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Id: 86941784237549838bba63ce88053b88 Nov 01 19:01:07.669869 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Name: tempest-ServersOnMultiNodesTest-1928208762 Nov 01 19:01:07.669869 n-d-863052-2 devstack@n-api.service[121402]: X-Role: member,reader Nov 01 19:01:07.669869 n-d-863052-2 devstack@n-api.service[121402]: X-Roles: member,reader Nov 01 19:01:07.671760 n-d-863052-2 devstack@n-api.service[121402]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/86941784237549838bba63ce88053b88"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/86941784237549838bba63ce88053b88"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_86941784237549838bba63ce88053b88", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/86941784237549838bba63ce88053b88"}]}] Nov 01 19:01:07.671760 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant: tempest-ServersOnMultiNodesTest-1928208762 Nov 01 19:01:07.671760 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant-Id: 86941784237549838bba63ce88053b88 Nov 01 19:01:07.671760 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1928208762 Nov 01 19:01:07.671760 n-d-863052-2 devstack@n-api.service[121402]: X-User: tempest-ServersOnMultiNodesTest-1928208762-project Nov 01 19:01:07.671760 n-d-863052-2 devstack@n-api.service[121402]: X-User-Domain-Id: default Nov 01 19:01:07.671760 n-d-863052-2 devstack@n-api.service[121402]: X-User-Domain-Name: Default Nov 01 19:01:07.671760 n-d-863052-2 devstack@n-api.service[121402]: X-User-Id: 0290a6bb8bc24b8988a925327ac0381c Nov 01 19:01:07.671760 n-d-863052-2 devstack@n-api.service[121402]: X-User-Name: tempest-ServersOnMultiNodesTest-1928208762-project Nov 01 19:01:07.671760 n-d-863052-2 devstack@n-api.service[121402]: method: > Nov 01 19:01:07.671760 n-d-863052-2 devstack@n-api.service[121402]: exception: Instance efdf10ba-60d4-4fb0-970d-109a8f936808 could not be found. Nov 01 19:01:07.671760 n-d-863052-2 devstack@n-api.service[121402]: action_args: {'id': 'efdf10ba-60d4-4fb0-970d-109a8f936808'} Nov 01 19:01:07.672774 n-d-863052-2 devstack@n-api.service[121402]: {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 01 19:01:07.672774 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:01:07.672774 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 01 19:01:07.672774 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 01 19:01:07.672774 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 01 19:01:07.672774 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 01 19:01:07.672774 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 01 19:01:07.672774 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 01 19:01:07.672774 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 01 19:01:07.672774 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 01 19:01:07.672774 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance efdf10ba-60d4-4fb0-970d-109a8f936808 could not be found. Nov 01 19:01:07.672774 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:01:07.672774 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:01:07.672774 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:01:07.672774 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:01:07.672774 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:01:07.672774 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:01:07.672774 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 01 19:01:07.672774 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 01 19:01:07.672774 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 01 19:01:07.674345 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 01 19:01:07.674345 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 01 19:01:07.674345 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 01 19:01:07.674345 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 01 19:01:07.674345 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 01 19:01:07.674345 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 01 19:01:07.674345 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 01 19:01:07.674345 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance efdf10ba-60d4-4fb0-970d-109a8f936808 could not be found. Nov 01 19:01:07.674345 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:01:07.674345 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:01:07.674345 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:01:07.674345 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:01:07.674345 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:01:07.674345 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:01:07.674345 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 01 19:01:07.674345 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 01 19:01:07.674345 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance efdf10ba-60d4-4fb0-970d-109a8f936808 could not be found. Nov 01 19:01:07.674345 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:01:07.675762 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-ff726603-9dc6-45af-8df9-457d64aeee9e tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Returning 404 to user: Instance efdf10ba-60d4-4fb0-970d-109a8f936808 could not be found. {{(pid=121402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 01 19:01:07.675762 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-ff726603-9dc6-45af-8df9-457d64aeee9e tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] 10.222.0.13 "GET /compute/v2.1/servers/efdf10ba-60d4-4fb0-970d-109a8f936808" status: 404 len: 111 microversion: 2.1 time: 0.088065 Nov 01 19:01:07.680180 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-035419cf-e04b-4f80-b7c2-58c4a5cf965c tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:01:07.680823 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-035419cf-e04b-4f80-b7c2-58c4a5cf965c tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] [instance: 9dbe3d05-9fa8-4fd2-8415-52bfe6ee5801] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:01:07.685373 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 988/1960] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:01:07 2022] GET /compute/v2.1/servers/efdf10ba-60d4-4fb0-970d-109a8f936808 => generated 111 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 01 19:01:07.688709 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-035419cf-e04b-4f80-b7c2-58c4a5cf965c tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:01:07.689401 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-035419cf-e04b-4f80-b7c2-58c4a5cf965c tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:01:07.690000 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-035419cf-e04b-4f80-b7c2-58c4a5cf965c tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:01:07.690872 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-035419cf-e04b-4f80-b7c2-58c4a5cf965c tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:01:07.691483 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-035419cf-e04b-4f80-b7c2-58c4a5cf965c tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:01:07.692065 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-035419cf-e04b-4f80-b7c2-58c4a5cf965c tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:01:07.715147 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.wsgi [None req-035419cf-e04b-4f80-b7c2-58c4a5cf965c tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] HTTP exception thrown: Instance 9dbe3d05-9fa8-4fd2-8415-52bfe6ee5801 could not be found. Nov 01 19:01:07.719420 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-035419cf-e04b-4f80-b7c2-58c4a5cf965c tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Request method failure captured: Nov 01 19:01:07.719420 n-d-863052-2 devstack@n-api.service[121403]: request: GET /compute/v2.1/servers/9dbe3d05-9fa8-4fd2-8415-52bfe6ee5801 HTTP/1.1 Nov 01 19:01:07.719420 n-d-863052-2 devstack@n-api.service[121403]: Accept: application/json Nov 01 19:01:07.719420 n-d-863052-2 devstack@n-api.service[121403]: Accept-Encoding: identity Nov 01 19:01:07.719420 n-d-863052-2 devstack@n-api.service[121403]: Connection: close Nov 01 19:01:07.719420 n-d-863052-2 devstack@n-api.service[121403]: Content-Length: 0 Nov 01 19:01:07.719420 n-d-863052-2 devstack@n-api.service[121403]: Content-Type: application/json Nov 01 19:01:07.719420 n-d-863052-2 devstack@n-api.service[121403]: Host: 10.222.0.13 Nov 01 19:01:07.719420 n-d-863052-2 devstack@n-api.service[121403]: Openstack-System-Scope: None Nov 01 19:01:07.719420 n-d-863052-2 devstack@n-api.service[121403]: User-Agent: python-urllib3/1.26.12 Nov 01 19:01:07.719420 n-d-863052-2 devstack@n-api.service[121403]: X-Auth-Token: gAAAAABjYWw27zVYcT0jiDkpuT1RhWK3v8RIYvgoBAv6JENEEUigh3EWDZBWsWojpv0UuPsP42AoaM4QJ3MvpvySt_jiXJEPPxL0U99qRIuu3QOrQQyEuoWyflobV2EmBrMy9kC-XG8E8wqlSX7W2YY0K8WOiMWq_0tsCeniBBlKBU3a2s3TKIo Nov 01 19:01:07.719420 n-d-863052-2 devstack@n-api.service[121403]: X-Domain-Id: None Nov 01 19:01:07.719420 n-d-863052-2 devstack@n-api.service[121403]: X-Domain-Name: None Nov 01 19:01:07.719420 n-d-863052-2 devstack@n-api.service[121403]: X-Identity-Status: Confirmed Nov 01 19:01:07.719420 n-d-863052-2 devstack@n-api.service[121403]: X-Is-Admin-Project: True Nov 01 19:01:07.719420 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Domain-Id: default Nov 01 19:01:07.719420 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Domain-Name: Default Nov 01 19:01:07.719420 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Id: 86941784237549838bba63ce88053b88 Nov 01 19:01:07.719420 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Name: tempest-ServersOnMultiNodesTest-1928208762 Nov 01 19:01:07.719420 n-d-863052-2 devstack@n-api.service[121403]: X-Role: member,reader Nov 01 19:01:07.719420 n-d-863052-2 devstack@n-api.service[121403]: X-Roles: member,reader Nov 01 19:01:07.724544 n-d-863052-2 devstack@n-api.service[121403]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/86941784237549838bba63ce88053b88"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/86941784237549838bba63ce88053b88"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_86941784237549838bba63ce88053b88", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/86941784237549838bba63ce88053b88"}]}] Nov 01 19:01:07.724544 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant: tempest-ServersOnMultiNodesTest-1928208762 Nov 01 19:01:07.724544 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant-Id: 86941784237549838bba63ce88053b88 Nov 01 19:01:07.724544 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1928208762 Nov 01 19:01:07.724544 n-d-863052-2 devstack@n-api.service[121403]: X-User: tempest-ServersOnMultiNodesTest-1928208762-project Nov 01 19:01:07.724544 n-d-863052-2 devstack@n-api.service[121403]: X-User-Domain-Id: default Nov 01 19:01:07.724544 n-d-863052-2 devstack@n-api.service[121403]: X-User-Domain-Name: Default Nov 01 19:01:07.724544 n-d-863052-2 devstack@n-api.service[121403]: X-User-Id: 0290a6bb8bc24b8988a925327ac0381c Nov 01 19:01:07.724544 n-d-863052-2 devstack@n-api.service[121403]: X-User-Name: tempest-ServersOnMultiNodesTest-1928208762-project Nov 01 19:01:07.724544 n-d-863052-2 devstack@n-api.service[121403]: method: > Nov 01 19:01:07.724544 n-d-863052-2 devstack@n-api.service[121403]: exception: Instance 9dbe3d05-9fa8-4fd2-8415-52bfe6ee5801 could not be found. Nov 01 19:01:07.724544 n-d-863052-2 devstack@n-api.service[121403]: action_args: {'id': '9dbe3d05-9fa8-4fd2-8415-52bfe6ee5801'} Nov 01 19:01:07.725659 n-d-863052-2 devstack@n-api.service[121403]: {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 01 19:01:07.725659 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:01:07.725659 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 01 19:01:07.725659 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 01 19:01:07.725659 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 01 19:01:07.725659 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 01 19:01:07.725659 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 01 19:01:07.725659 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 01 19:01:07.725659 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 01 19:01:07.725659 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 01 19:01:07.725659 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9dbe3d05-9fa8-4fd2-8415-52bfe6ee5801 could not be found. Nov 01 19:01:07.725659 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:01:07.725659 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:01:07.725659 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:01:07.725659 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:01:07.725659 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:01:07.725659 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:01:07.725659 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 01 19:01:07.725659 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 01 19:01:07.725659 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 01 19:01:07.727288 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 01 19:01:07.727288 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 01 19:01:07.727288 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 01 19:01:07.727288 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 01 19:01:07.727288 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 01 19:01:07.727288 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 01 19:01:07.727288 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 01 19:01:07.727288 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9dbe3d05-9fa8-4fd2-8415-52bfe6ee5801 could not be found. Nov 01 19:01:07.727288 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:01:07.727288 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:01:07.727288 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:01:07.727288 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:01:07.727288 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:01:07.727288 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:01:07.727288 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 01 19:01:07.727288 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 01 19:01:07.727288 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9dbe3d05-9fa8-4fd2-8415-52bfe6ee5801 could not be found. Nov 01 19:01:07.727288 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:01:07.749810 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-035419cf-e04b-4f80-b7c2-58c4a5cf965c tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Returning 404 to user: Instance 9dbe3d05-9fa8-4fd2-8415-52bfe6ee5801 could not be found. {{(pid=121403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 01 19:01:07.751868 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-035419cf-e04b-4f80-b7c2-58c4a5cf965c tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] 10.222.0.13 "GET /compute/v2.1/servers/9dbe3d05-9fa8-4fd2-8415-52bfe6ee5801" status: 404 len: 111 microversion: 2.1 time: 0.074955 Nov 01 19:01:07.767238 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-51b0697d-4dd5-41b2-9585-970e6bb2cdfd tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:01:07.773431 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 973/1961] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:01:07 2022] GET /compute/v2.1/servers/9dbe3d05-9fa8-4fd2-8415-52bfe6ee5801 => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 01 19:01:07.845080 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-51b0697d-4dd5-41b2-9585-970e6bb2cdfd tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] 10.222.0.13 "DELETE /compute/v2.1/os-server-groups/0265752b-95c4-4bf0-aec6-cb81e093d2ee" status: 204 len: 0 microversion: 2.1 time: 0.086857 Nov 01 19:01:07.849469 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 989/1962] 10.222.0.13 () {58 vars in 1266 bytes} [Tue Nov 1 19:01:07 2022] DELETE /compute/v2.1/os-server-groups/0265752b-95c4-4bf0-aec6-cb81e093d2ee => generated 0 bytes in 89 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 01 19:01:07.855166 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-939c98bc-125d-4d6b-a04d-10dece728e72 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:01:07.855913 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-939c98bc-125d-4d6b-a04d-10dece728e72 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] [instance: 7186700c-1951-4ab3-a872-865dc1a45fa1] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:01:07.863979 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-939c98bc-125d-4d6b-a04d-10dece728e72 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:01:07.865010 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-939c98bc-125d-4d6b-a04d-10dece728e72 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:01:07.866352 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-939c98bc-125d-4d6b-a04d-10dece728e72 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:01:07.867255 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-939c98bc-125d-4d6b-a04d-10dece728e72 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:01:07.868839 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-939c98bc-125d-4d6b-a04d-10dece728e72 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:01:07.869717 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-939c98bc-125d-4d6b-a04d-10dece728e72 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:01:07.895587 n-d-863052-2 devstack@n-api.service[121403]: DEBUG dbcounter [-] [121403] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=121403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 19:01:07.919143 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-939c98bc-125d-4d6b-a04d-10dece728e72 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] [instance: 7186700c-1951-4ab3-a872-865dc1a45fa1] Going to try to terminate instance {{(pid=121403) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 01 19:01:08.086859 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-939c98bc-125d-4d6b-a04d-10dece728e72 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] 10.222.0.13 "DELETE /compute/v2.1/servers/7186700c-1951-4ab3-a872-865dc1a45fa1" status: 204 len: 0 microversion: 2.1 time: 0.235692 Nov 01 19:01:08.087582 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 974/1963] 10.222.0.13 () {58 vars in 1239 bytes} [Tue Nov 1 19:01:07 2022] DELETE /compute/v2.1/servers/7186700c-1951-4ab3-a872-865dc1a45fa1 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 01 19:01:08.098770 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-255c9d99-6888-4cc1-987e-cbbba02ca51d tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:01:08.100105 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-255c9d99-6888-4cc1-987e-cbbba02ca51d tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] [instance: 7186700c-1951-4ab3-a872-865dc1a45fa1] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:01:08.109539 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-255c9d99-6888-4cc1-987e-cbbba02ca51d tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:01:08.110302 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-255c9d99-6888-4cc1-987e-cbbba02ca51d tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:01:08.110932 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-255c9d99-6888-4cc1-987e-cbbba02ca51d tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:01:08.111919 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-255c9d99-6888-4cc1-987e-cbbba02ca51d tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:01:08.113533 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-255c9d99-6888-4cc1-987e-cbbba02ca51d tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:01:08.114201 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-255c9d99-6888-4cc1-987e-cbbba02ca51d tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:01:08.396737 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-255c9d99-6888-4cc1-987e-cbbba02ca51d tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0290a6bb8bc24b8988a925327ac0381c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86941784237549838bba63ce88053b88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:01:08.410598 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-255c9d99-6888-4cc1-987e-cbbba02ca51d tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] 10.222.0.13 "GET /compute/v2.1/servers/7186700c-1951-4ab3-a872-865dc1a45fa1" status: 200 len: 1473 microversion: 2.1 time: 0.315188 Nov 01 19:01:08.412825 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 990/1964] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:01:08 2022] GET /compute/v2.1/servers/7186700c-1951-4ab3-a872-865dc1a45fa1 => generated 1473 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 19:01:08.552711 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-08c2c21d-a9cc-4fef-9812-e7131676f72b tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:01:08.555976 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-08c2c21d-a9cc-4fef-9812-e7131676f72b tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] [instance: cd879708-f757-4f88-bc95-38b6cd55363c] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:01:08.611508 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-80f58a87-95b0-4016-ad5c-ce1302598626 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:01:08.612414 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-80f58a87-95b0-4016-ad5c-ce1302598626 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] [instance: 1f499af7-1896-478c-b7d7-d922bf78bd98] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:01:08.621661 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-08c2c21d-a9cc-4fef-9812-e7131676f72b tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:01:08.633980 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-08c2c21d-a9cc-4fef-9812-e7131676f72b tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:01:08.635239 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-08c2c21d-a9cc-4fef-9812-e7131676f72b tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:01:08.635598 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-80f58a87-95b0-4016-ad5c-ce1302598626 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:01:08.641795 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-80f58a87-95b0-4016-ad5c-ce1302598626 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:01:08.645045 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-80f58a87-95b0-4016-ad5c-ce1302598626 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:01:08.646401 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-08c2c21d-a9cc-4fef-9812-e7131676f72b tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:01:08.647215 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-08c2c21d-a9cc-4fef-9812-e7131676f72b tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:01:08.648249 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-80f58a87-95b0-4016-ad5c-ce1302598626 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:01:08.651117 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-08c2c21d-a9cc-4fef-9812-e7131676f72b tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:01:08.653496 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-80f58a87-95b0-4016-ad5c-ce1302598626 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:01:08.659627 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-80f58a87-95b0-4016-ad5c-ce1302598626 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:01:08.770732 n-d-863052-2 devstack@n-api.service[121402]: DEBUG dbcounter [-] [121402] Writing DB stats nova_cell1:UPDATE=2,nova_cell1:SELECT=96,nova_cell1:INSERT=2 {{(pid=121402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 19:01:09.112467 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-08c2c21d-a9cc-4fef-9812-e7131676f72b tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:01:09.130919 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-08c2c21d-a9cc-4fef-9812-e7131676f72b tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:01:09.131613 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-80f58a87-95b0-4016-ad5c-ce1302598626 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f32f5fba1976432d938e664c7714e52b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b9d4c236b944f9b2e8e502a50a8f8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:01:09.142799 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-80f58a87-95b0-4016-ad5c-ce1302598626 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] 10.222.0.13 "GET /compute/v2.1/servers/1f499af7-1896-478c-b7d7-d922bf78bd98" status: 200 len: 1391 microversion: 2.1 time: 0.534076 Nov 01 19:01:09.143198 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-08c2c21d-a9cc-4fef-9812-e7131676f72b tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:01:09.143461 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 991/1965] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:01:08 2022] GET /compute/v2.1/servers/1f499af7-1896-478c-b7d7-d922bf78bd98 => generated 1391 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:01:09.145241 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-08c2c21d-a9cc-4fef-9812-e7131676f72b tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] 10.222.0.13 "GET /compute/v2.1/servers/cd879708-f757-4f88-bc95-38b6cd55363c" status: 200 len: 1281 microversion: 2.25 time: 0.598257 Nov 01 19:01:09.170880 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 975/1966] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 19:01:08 2022] GET /compute/v2.1/servers/cd879708-f757-4f88-bc95-38b6cd55363c => generated 1281 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 19:01:09.172499 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-9eea4941-ee18-412e-991c-72177080523e tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] Calling method '.version_select at 0x7f0ae2b771f0>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:01:09.261493 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-9eea4941-ee18-412e-991c-72177080523e tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] 10.222.0.13 "GET /compute/v2.1/images/52ccd7d5-4eba-4e0d-97f4-a4927c3504a7" status: 200 len: 1455 microversion: 2.1 time: 0.098804 Nov 01 19:01:09.262171 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 992/1967] 10.222.0.13 () {58 vars in 1233 bytes} [Tue Nov 1 19:01:09 2022] GET /compute/v2.1/images/52ccd7d5-4eba-4e0d-97f4-a4927c3504a7 => generated 1455 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:01:09.445949 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-657cbbe2-aa02-4780-9af0-14cd9d91e947 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:01:09.447422 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-657cbbe2-aa02-4780-9af0-14cd9d91e947 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] [instance: 7186700c-1951-4ab3-a872-865dc1a45fa1] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:01:09.464282 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-657cbbe2-aa02-4780-9af0-14cd9d91e947 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:01:09.466917 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-657cbbe2-aa02-4780-9af0-14cd9d91e947 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:01:09.469828 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-657cbbe2-aa02-4780-9af0-14cd9d91e947 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:01:09.471273 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-657cbbe2-aa02-4780-9af0-14cd9d91e947 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:01:09.473792 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-657cbbe2-aa02-4780-9af0-14cd9d91e947 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:01:09.476917 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-657cbbe2-aa02-4780-9af0-14cd9d91e947 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:01:10.042571 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-657cbbe2-aa02-4780-9af0-14cd9d91e947 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0290a6bb8bc24b8988a925327ac0381c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86941784237549838bba63ce88053b88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:01:10.058719 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-657cbbe2-aa02-4780-9af0-14cd9d91e947 tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] 10.222.0.13 "GET /compute/v2.1/servers/7186700c-1951-4ab3-a872-865dc1a45fa1" status: 200 len: 1473 microversion: 2.1 time: 0.617172 Nov 01 19:01:10.061085 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 976/1968] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:01:09 2022] GET /compute/v2.1/servers/7186700c-1951-4ab3-a872-865dc1a45fa1 => generated 1473 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:01:10.168360 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-e8d429cb-5149-4b5e-85f2-225510fc6573 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:01:10.169165 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-e8d429cb-5149-4b5e-85f2-225510fc6573 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] [instance: 1f499af7-1896-478c-b7d7-d922bf78bd98] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:01:10.178657 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-321560f3-0e45-4a05-849a-d417f5306780 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:01:10.179258 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-321560f3-0e45-4a05-849a-d417f5306780 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] [instance: cd879708-f757-4f88-bc95-38b6cd55363c] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:01:10.184381 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e8d429cb-5149-4b5e-85f2-225510fc6573 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:01:10.185153 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e8d429cb-5149-4b5e-85f2-225510fc6573 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:01:10.186389 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e8d429cb-5149-4b5e-85f2-225510fc6573 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:01:10.189146 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e8d429cb-5149-4b5e-85f2-225510fc6573 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:01:10.191881 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e8d429cb-5149-4b5e-85f2-225510fc6573 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:01:10.192483 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e8d429cb-5149-4b5e-85f2-225510fc6573 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:01:10.198598 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-321560f3-0e45-4a05-849a-d417f5306780 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:01:10.199109 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-321560f3-0e45-4a05-849a-d417f5306780 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:01:10.199558 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-321560f3-0e45-4a05-849a-d417f5306780 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:01:10.200276 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-321560f3-0e45-4a05-849a-d417f5306780 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:01:10.200818 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-321560f3-0e45-4a05-849a-d417f5306780 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:01:10.209200 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-321560f3-0e45-4a05-849a-d417f5306780 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:01:10.734921 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-321560f3-0e45-4a05-849a-d417f5306780 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:01:10.783557 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-321560f3-0e45-4a05-849a-d417f5306780 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:01:10.796460 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-321560f3-0e45-4a05-849a-d417f5306780 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:01:10.798256 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-321560f3-0e45-4a05-849a-d417f5306780 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] 10.222.0.13 "GET /compute/v2.1/servers/cd879708-f757-4f88-bc95-38b6cd55363c" status: 200 len: 1281 microversion: 2.25 time: 0.623650 Nov 01 19:01:10.807271 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 977/1969] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 19:01:10 2022] GET /compute/v2.1/servers/cd879708-f757-4f88-bc95-38b6cd55363c => generated 1281 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 01 19:01:10.841309 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-d90e05bc-19e8-4056-9ce1-5d9ff2a511bb tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] Calling method '.version_select at 0x7f0ae2106670>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:01:11.000163 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-d90e05bc-19e8-4056-9ce1-5d9ff2a511bb tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] 10.222.0.13 "GET /compute/v2.1/images/52ccd7d5-4eba-4e0d-97f4-a4927c3504a7" status: 200 len: 1455 microversion: 2.1 time: 0.191506 Nov 01 19:01:11.001363 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 978/1970] 10.222.0.13 () {58 vars in 1233 bytes} [Tue Nov 1 19:01:10 2022] GET /compute/v2.1/images/52ccd7d5-4eba-4e0d-97f4-a4927c3504a7 => generated 1455 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:01:11.007525 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-6e467736-1fcd-4b73-a52c-1d6d10e45a49 tempest-ServersTestFqdnHostnames-269349818 tempest-ServersTestFqdnHostnames-269349818-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:01:11.008351 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-6e467736-1fcd-4b73-a52c-1d6d10e45a49 tempest-ServersTestFqdnHostnames-269349818 tempest-ServersTestFqdnHostnames-269349818-project] [instance: 04443e90-21e9-4b5e-99e8-350f07e4ea82] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:01:11.015376 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-6e467736-1fcd-4b73-a52c-1d6d10e45a49 tempest-ServersTestFqdnHostnames-269349818 tempest-ServersTestFqdnHostnames-269349818-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:01:11.016203 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-6e467736-1fcd-4b73-a52c-1d6d10e45a49 tempest-ServersTestFqdnHostnames-269349818 tempest-ServersTestFqdnHostnames-269349818-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:01:11.016867 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-6e467736-1fcd-4b73-a52c-1d6d10e45a49 tempest-ServersTestFqdnHostnames-269349818 tempest-ServersTestFqdnHostnames-269349818-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:01:11.017784 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-6e467736-1fcd-4b73-a52c-1d6d10e45a49 tempest-ServersTestFqdnHostnames-269349818 tempest-ServersTestFqdnHostnames-269349818-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:01:11.018468 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-6e467736-1fcd-4b73-a52c-1d6d10e45a49 tempest-ServersTestFqdnHostnames-269349818 tempest-ServersTestFqdnHostnames-269349818-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:01:11.019821 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-6e467736-1fcd-4b73-a52c-1d6d10e45a49 tempest-ServersTestFqdnHostnames-269349818 tempest-ServersTestFqdnHostnames-269349818-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:01:11.063059 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-6e467736-1fcd-4b73-a52c-1d6d10e45a49 tempest-ServersTestFqdnHostnames-269349818 tempest-ServersTestFqdnHostnames-269349818-project] [instance: 04443e90-21e9-4b5e-99e8-350f07e4ea82] Going to try to terminate instance {{(pid=121403) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 01 19:01:11.239697 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-6e467736-1fcd-4b73-a52c-1d6d10e45a49 tempest-ServersTestFqdnHostnames-269349818 tempest-ServersTestFqdnHostnames-269349818-project] 10.222.0.13 "DELETE /compute/v2.1/servers/04443e90-21e9-4b5e-99e8-350f07e4ea82" status: 204 len: 0 microversion: 2.1 time: 0.235917 Nov 01 19:01:11.240432 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 979/1971] 10.222.0.13 () {58 vars in 1239 bytes} [Tue Nov 1 19:01:11 2022] DELETE /compute/v2.1/servers/04443e90-21e9-4b5e-99e8-350f07e4ea82 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 01 19:01:11.253631 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-4939ca2b-0950-43cc-919b-d423e228d6ec tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:01:11.253631 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-4939ca2b-0950-43cc-919b-d423e228d6ec tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] [instance: 7186700c-1951-4ab3-a872-865dc1a45fa1] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:01:11.259375 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-4939ca2b-0950-43cc-919b-d423e228d6ec tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:01:11.260004 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-4939ca2b-0950-43cc-919b-d423e228d6ec tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:01:11.260697 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-4939ca2b-0950-43cc-919b-d423e228d6ec tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:01:11.261437 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-4939ca2b-0950-43cc-919b-d423e228d6ec tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:01:11.261900 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-4939ca2b-0950-43cc-919b-d423e228d6ec tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:01:11.262595 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-4939ca2b-0950-43cc-919b-d423e228d6ec tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:01:11.567178 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-4939ca2b-0950-43cc-919b-d423e228d6ec tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0290a6bb8bc24b8988a925327ac0381c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86941784237549838bba63ce88053b88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:01:11.576907 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-4939ca2b-0950-43cc-919b-d423e228d6ec tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] 10.222.0.13 "GET /compute/v2.1/servers/7186700c-1951-4ab3-a872-865dc1a45fa1" status: 200 len: 1473 microversion: 2.1 time: 0.331041 Nov 01 19:01:11.577683 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 980/1972] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:01:11 2022] GET /compute/v2.1/servers/7186700c-1951-4ab3-a872-865dc1a45fa1 => generated 1473 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:01:11.590907 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-8877ba7b-0720-4923-82b2-53b6958c0e40 tempest-ServersTestFqdnHostnames-269349818 tempest-ServersTestFqdnHostnames-269349818-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:01:11.593498 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-8877ba7b-0720-4923-82b2-53b6958c0e40 tempest-ServersTestFqdnHostnames-269349818 tempest-ServersTestFqdnHostnames-269349818-project] [instance: 04443e90-21e9-4b5e-99e8-350f07e4ea82] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:01:11.610546 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-8877ba7b-0720-4923-82b2-53b6958c0e40 tempest-ServersTestFqdnHostnames-269349818 tempest-ServersTestFqdnHostnames-269349818-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:01:11.611114 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-8877ba7b-0720-4923-82b2-53b6958c0e40 tempest-ServersTestFqdnHostnames-269349818 tempest-ServersTestFqdnHostnames-269349818-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:01:11.612430 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-8877ba7b-0720-4923-82b2-53b6958c0e40 tempest-ServersTestFqdnHostnames-269349818 tempest-ServersTestFqdnHostnames-269349818-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:01:11.614474 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-8877ba7b-0720-4923-82b2-53b6958c0e40 tempest-ServersTestFqdnHostnames-269349818 tempest-ServersTestFqdnHostnames-269349818-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:01:11.615420 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-8877ba7b-0720-4923-82b2-53b6958c0e40 tempest-ServersTestFqdnHostnames-269349818 tempest-ServersTestFqdnHostnames-269349818-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:01:11.615563 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-8877ba7b-0720-4923-82b2-53b6958c0e40 tempest-ServersTestFqdnHostnames-269349818 tempest-ServersTestFqdnHostnames-269349818-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:01:11.770882 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-e8d429cb-5149-4b5e-85f2-225510fc6573 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f32f5fba1976432d938e664c7714e52b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b9d4c236b944f9b2e8e502a50a8f8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:01:11.782759 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-e8d429cb-5149-4b5e-85f2-225510fc6573 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] 10.222.0.13 "GET /compute/v2.1/servers/1f499af7-1896-478c-b7d7-d922bf78bd98" status: 200 len: 1391 microversion: 2.1 time: 1.619230 Nov 01 19:01:11.789682 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 993/1973] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:01:10 2022] GET /compute/v2.1/servers/1f499af7-1896-478c-b7d7-d922bf78bd98 => generated 1391 bytes in 1627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:01:11.838474 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-8ec7f562-505a-4c49-b4a0-5880ac8f1d14 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:01:11.847940 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-8ec7f562-505a-4c49-b4a0-5880ac8f1d14 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] [instance: cd879708-f757-4f88-bc95-38b6cd55363c] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:01:11.887875 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-8ec7f562-505a-4c49-b4a0-5880ac8f1d14 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:01:11.889218 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-8ec7f562-505a-4c49-b4a0-5880ac8f1d14 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:01:11.894839 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-8ec7f562-505a-4c49-b4a0-5880ac8f1d14 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:01:11.898254 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-8ec7f562-505a-4c49-b4a0-5880ac8f1d14 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:01:11.902004 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-8ec7f562-505a-4c49-b4a0-5880ac8f1d14 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:01:11.905583 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-8ec7f562-505a-4c49-b4a0-5880ac8f1d14 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:01:11.959428 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-8877ba7b-0720-4923-82b2-53b6958c0e40 tempest-ServersTestFqdnHostnames-269349818 tempest-ServersTestFqdnHostnames-269349818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d33ca3478b7455dad5094afee57c8b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfea57f34b844c77b22619105249d08a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:01:11.996504 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-8877ba7b-0720-4923-82b2-53b6958c0e40 tempest-ServersTestFqdnHostnames-269349818 tempest-ServersTestFqdnHostnames-269349818-project] 10.222.0.13 "GET /compute/v2.1/servers/04443e90-21e9-4b5e-99e8-350f07e4ea82" status: 200 len: 1667 microversion: 2.1 time: 0.417440 Nov 01 19:01:11.999690 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 981/1974] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:01:11 2022] GET /compute/v2.1/servers/04443e90-21e9-4b5e-99e8-350f07e4ea82 => generated 1667 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:01:12.023450 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-7d477ad7-3040-4b4d-b8f8-27595db19b7a tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] Calling method '.version_select at 0x7f0ae210a670>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:01:12.200752 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-7d477ad7-3040-4b4d-b8f8-27595db19b7a tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] 10.222.0.13 "GET /compute/v2.1/images/52ccd7d5-4eba-4e0d-97f4-a4927c3504a7" status: 200 len: 1455 microversion: 2.1 time: 0.185821 Nov 01 19:01:12.203468 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 982/1975] 10.222.0.13 () {58 vars in 1233 bytes} [Tue Nov 1 19:01:12 2022] GET /compute/v2.1/images/52ccd7d5-4eba-4e0d-97f4-a4927c3504a7 => generated 1455 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:01:12.604804 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-4a7a27f5-5910-45c5-8e7d-05f88185a29e tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:01:12.605912 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-4a7a27f5-5910-45c5-8e7d-05f88185a29e tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] [instance: 7186700c-1951-4ab3-a872-865dc1a45fa1] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:01:12.652297 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-4a7a27f5-5910-45c5-8e7d-05f88185a29e tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:01:12.656419 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-4a7a27f5-5910-45c5-8e7d-05f88185a29e tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:01:12.660793 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-4a7a27f5-5910-45c5-8e7d-05f88185a29e tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:01:12.666648 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-4a7a27f5-5910-45c5-8e7d-05f88185a29e tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:01:12.667599 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-4a7a27f5-5910-45c5-8e7d-05f88185a29e tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:01:12.673856 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-4a7a27f5-5910-45c5-8e7d-05f88185a29e tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:01:12.948995 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-8ec7f562-505a-4c49-b4a0-5880ac8f1d14 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:01:12.967057 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-8ec7f562-505a-4c49-b4a0-5880ac8f1d14 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:01:12.968936 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-8ec7f562-505a-4c49-b4a0-5880ac8f1d14 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:01:12.970753 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-8ec7f562-505a-4c49-b4a0-5880ac8f1d14 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] 10.222.0.13 "GET /compute/v2.1/servers/cd879708-f757-4f88-bc95-38b6cd55363c" status: 200 len: 1281 microversion: 2.25 time: 1.137861 Nov 01 19:01:12.971351 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 994/1976] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 19:01:11 2022] GET /compute/v2.1/servers/cd879708-f757-4f88-bc95-38b6cd55363c => generated 1281 bytes in 1139 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 01 19:01:12.988296 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-b5fa1272-fd0b-467c-bb4b-74dc3874b474 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:01:12.989507 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-b5fa1272-fd0b-467c-bb4b-74dc3874b474 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] [instance: 1f499af7-1896-478c-b7d7-d922bf78bd98] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:01:13.006973 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b5fa1272-fd0b-467c-bb4b-74dc3874b474 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:01:13.007487 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b5fa1272-fd0b-467c-bb4b-74dc3874b474 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:01:13.007932 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b5fa1272-fd0b-467c-bb4b-74dc3874b474 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:01:13.008673 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b5fa1272-fd0b-467c-bb4b-74dc3874b474 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:01:13.009139 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b5fa1272-fd0b-467c-bb4b-74dc3874b474 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:01:13.013217 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b5fa1272-fd0b-467c-bb4b-74dc3874b474 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:01:13.065096 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-4a7a27f5-5910-45c5-8e7d-05f88185a29e tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0290a6bb8bc24b8988a925327ac0381c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86941784237549838bba63ce88053b88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:01:13.078264 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-4a7a27f5-5910-45c5-8e7d-05f88185a29e tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] 10.222.0.13 "GET /compute/v2.1/servers/7186700c-1951-4ab3-a872-865dc1a45fa1" status: 200 len: 1431 microversion: 2.1 time: 0.478880 Nov 01 19:01:13.087226 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 983/1977] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:01:12 2022] GET /compute/v2.1/servers/7186700c-1951-4ab3-a872-865dc1a45fa1 => generated 1431 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 19:01:13.104574 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-224c9508-2c65-4110-b86e-4d21989cc04d tempest-ServersTestFqdnHostnames-269349818 tempest-ServersTestFqdnHostnames-269349818-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:01:13.105216 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-224c9508-2c65-4110-b86e-4d21989cc04d tempest-ServersTestFqdnHostnames-269349818 tempest-ServersTestFqdnHostnames-269349818-project] [instance: 04443e90-21e9-4b5e-99e8-350f07e4ea82] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:01:13.126495 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-224c9508-2c65-4110-b86e-4d21989cc04d tempest-ServersTestFqdnHostnames-269349818 tempest-ServersTestFqdnHostnames-269349818-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:01:13.127053 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-224c9508-2c65-4110-b86e-4d21989cc04d tempest-ServersTestFqdnHostnames-269349818 tempest-ServersTestFqdnHostnames-269349818-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:01:13.127422 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-224c9508-2c65-4110-b86e-4d21989cc04d tempest-ServersTestFqdnHostnames-269349818 tempest-ServersTestFqdnHostnames-269349818-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:01:13.145565 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-224c9508-2c65-4110-b86e-4d21989cc04d tempest-ServersTestFqdnHostnames-269349818 tempest-ServersTestFqdnHostnames-269349818-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:01:13.148848 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-224c9508-2c65-4110-b86e-4d21989cc04d tempest-ServersTestFqdnHostnames-269349818 tempest-ServersTestFqdnHostnames-269349818-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:01:13.149318 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-224c9508-2c65-4110-b86e-4d21989cc04d tempest-ServersTestFqdnHostnames-269349818 tempest-ServersTestFqdnHostnames-269349818-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:01:14.104647 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-b5fa1272-fd0b-467c-bb4b-74dc3874b474 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f32f5fba1976432d938e664c7714e52b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b9d4c236b944f9b2e8e502a50a8f8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:01:14.121500 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-b5fa1272-fd0b-467c-bb4b-74dc3874b474 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] 10.222.0.13 "GET /compute/v2.1/servers/1f499af7-1896-478c-b7d7-d922bf78bd98" status: 200 len: 1391 microversion: 2.1 time: 1.147250 Nov 01 19:01:14.122394 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 995/1978] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:01:12 2022] GET /compute/v2.1/servers/1f499af7-1896-478c-b7d7-d922bf78bd98 => generated 1391 bytes in 1149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:01:14.132719 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-764649a8-2efd-4bc0-a96e-5e0e9ed6a489 tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] Calling method '.version_select at 0x7f0ae2ae60d0>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:01:14.208196 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-224c9508-2c65-4110-b86e-4d21989cc04d tempest-ServersTestFqdnHostnames-269349818 tempest-ServersTestFqdnHostnames-269349818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d33ca3478b7455dad5094afee57c8b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfea57f34b844c77b22619105249d08a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:01:14.222351 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-224c9508-2c65-4110-b86e-4d21989cc04d tempest-ServersTestFqdnHostnames-269349818 tempest-ServersTestFqdnHostnames-269349818-project] 10.222.0.13 "GET /compute/v2.1/servers/04443e90-21e9-4b5e-99e8-350f07e4ea82" status: 200 len: 1667 microversion: 2.1 time: 1.130657 Nov 01 19:01:14.224407 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 984/1979] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:01:13 2022] GET /compute/v2.1/servers/04443e90-21e9-4b5e-99e8-350f07e4ea82 => generated 1667 bytes in 1137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:01:14.237616 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-764649a8-2efd-4bc0-a96e-5e0e9ed6a489 tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] 10.222.0.13 "GET /compute/v2.1/images/52ccd7d5-4eba-4e0d-97f4-a4927c3504a7" status: 200 len: 1455 microversion: 2.1 time: 0.113459 Nov 01 19:01:14.239425 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 996/1980] 10.222.0.13 () {58 vars in 1233 bytes} [Tue Nov 1 19:01:14 2022] GET /compute/v2.1/images/52ccd7d5-4eba-4e0d-97f4-a4927c3504a7 => generated 1455 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:01:14.258092 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [req-51de1cfa-e084-46e2-91ab-3b742edeb9f3 req-5732f2fc-7546-4cd1-b9a3-974cd36039eb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7186700c-1951-4ab3-a872-865dc1a45fa1", "name": "network-vif-deleted", "tag": "77cc2e93-7bb9-47d9-9c54-7857a7ba35e5"}]} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:01:14.273149 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-adb53424-9210-4834-a22f-197ae7dc7fe8 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:01:14.273783 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-adb53424-9210-4834-a22f-197ae7dc7fe8 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] [instance: cd879708-f757-4f88-bc95-38b6cd55363c] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:01:14.286598 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-51de1cfa-e084-46e2-91ab-3b742edeb9f3 req-5732f2fc-7546-4cd1-b9a3-974cd36039eb service nova] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:01:14.287140 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-51de1cfa-e084-46e2-91ab-3b742edeb9f3 req-5732f2fc-7546-4cd1-b9a3-974cd36039eb service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:01:14.287591 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-51de1cfa-e084-46e2-91ab-3b742edeb9f3 req-5732f2fc-7546-4cd1-b9a3-974cd36039eb service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:01:14.307733 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-adb53424-9210-4834-a22f-197ae7dc7fe8 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:01:14.308276 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-adb53424-9210-4834-a22f-197ae7dc7fe8 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:01:14.308765 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-adb53424-9210-4834-a22f-197ae7dc7fe8 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:01:14.317201 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-adb53424-9210-4834-a22f-197ae7dc7fe8 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:01:14.318171 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-adb53424-9210-4834-a22f-197ae7dc7fe8 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:01:14.318891 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-adb53424-9210-4834-a22f-197ae7dc7fe8 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:01:14.319042 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.compute.server_external_events [req-51de1cfa-e084-46e2-91ab-3b742edeb9f3 req-5732f2fc-7546-4cd1-b9a3-974cd36039eb service nova] Creating event network-vif-deleted:77cc2e93-7bb9-47d9-9c54-7857a7ba35e5 for instance 7186700c-1951-4ab3-a872-865dc1a45fa1 on n-h1-863052-2 Nov 01 19:01:14.332108 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [req-51de1cfa-e084-46e2-91ab-3b742edeb9f3 req-5732f2fc-7546-4cd1-b9a3-974cd36039eb service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084021 Nov 01 19:01:14.335491 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 985/1981] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Nov 1 19:01:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:01:14.655980 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-9ec78d07-442a-4960-9fbd-4cd1972c0edb tempest-QuotasAdminTestV236-828290407 tempest-QuotasAdminTestV236-828290407-project-admin] Action: 'update', calling method: .version_select at 0x7f0ae66e9670>, body: {"quota_set": {"ram": "5120"}} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:01:14.928485 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-9ec78d07-442a-4960-9fbd-4cd1972c0edb tempest-QuotasAdminTestV236-828290407 tempest-QuotasAdminTestV236-828290407-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:01:14.929826 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-9ec78d07-442a-4960-9fbd-4cd1972c0edb tempest-QuotasAdminTestV236-828290407 tempest-QuotasAdminTestV236-828290407-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:01:14.930904 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-9ec78d07-442a-4960-9fbd-4cd1972c0edb tempest-QuotasAdminTestV236-828290407 tempest-QuotasAdminTestV236-828290407-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:01:14.933879 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-9ec78d07-442a-4960-9fbd-4cd1972c0edb tempest-QuotasAdminTestV236-828290407 tempest-QuotasAdminTestV236-828290407-project-admin] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:01:14.935368 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-9ec78d07-442a-4960-9fbd-4cd1972c0edb tempest-QuotasAdminTestV236-828290407 tempest-QuotasAdminTestV236-828290407-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:01:14.935965 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-9ec78d07-442a-4960-9fbd-4cd1972c0edb tempest-QuotasAdminTestV236-828290407 tempest-QuotasAdminTestV236-828290407-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:01:15.046998 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-adb53424-9210-4834-a22f-197ae7dc7fe8 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:01:15.067381 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-adb53424-9210-4834-a22f-197ae7dc7fe8 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:01:15.071766 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-adb53424-9210-4834-a22f-197ae7dc7fe8 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:01:15.074759 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-adb53424-9210-4834-a22f-197ae7dc7fe8 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] 10.222.0.13 "GET /compute/v2.1/servers/cd879708-f757-4f88-bc95-38b6cd55363c" status: 200 len: 1281 microversion: 2.25 time: 0.821460 Nov 01 19:01:15.077051 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 997/1982] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 19:01:14 2022] GET /compute/v2.1/servers/cd879708-f757-4f88-bc95-38b6cd55363c => generated 1281 bytes in 837 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 19:01:15.092139 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-2deee1db-020a-4fa6-88e6-353a67ac2c7d tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:01:15.093839 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-2deee1db-020a-4fa6-88e6-353a67ac2c7d tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] [instance: 7186700c-1951-4ab3-a872-865dc1a45fa1] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:01:15.109212 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2deee1db-020a-4fa6-88e6-353a67ac2c7d tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:01:15.112634 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2deee1db-020a-4fa6-88e6-353a67ac2c7d tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:01:15.116097 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2deee1db-020a-4fa6-88e6-353a67ac2c7d tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:01:15.117240 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2deee1db-020a-4fa6-88e6-353a67ac2c7d tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:01:15.117990 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2deee1db-020a-4fa6-88e6-353a67ac2c7d tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:01:15.119606 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2deee1db-020a-4fa6-88e6-353a67ac2c7d tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:01:15.123896 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-9ec78d07-442a-4960-9fbd-4cd1972c0edb tempest-QuotasAdminTestV236-828290407 tempest-QuotasAdminTestV236-828290407-project-admin] 10.222.0.13 "PUT /compute/v2.1/os-quota-sets/9236c22e9a984591be48344b46d636a7" status: 200 len: 240 microversion: 2.36 time: 0.783979 Nov 01 19:01:15.143908 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 986/1983] 10.222.0.13 () {62 vars in 1303 bytes} [Tue Nov 1 19:01:14 2022] PUT /compute/v2.1/os-quota-sets/9236c22e9a984591be48344b46d636a7 => generated 240 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 01 19:01:15.160030 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.wsgi [None req-2deee1db-020a-4fa6-88e6-353a67ac2c7d tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] HTTP exception thrown: Instance 7186700c-1951-4ab3-a872-865dc1a45fa1 could not be found. Nov 01 19:01:15.162265 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-1b804285-594a-4077-9640-2660efef977f tempest-QuotasAdminTestV236-828290407 tempest-QuotasAdminTestV236-828290407-project-admin] Calling method '.version_select at 0x7f0ae67e3550>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:01:15.165223 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-2deee1db-020a-4fa6-88e6-353a67ac2c7d tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Request method failure captured: Nov 01 19:01:15.165223 n-d-863052-2 devstack@n-api.service[121402]: request: GET /compute/v2.1/servers/7186700c-1951-4ab3-a872-865dc1a45fa1 HTTP/1.1 Nov 01 19:01:15.165223 n-d-863052-2 devstack@n-api.service[121402]: Accept: application/json Nov 01 19:01:15.165223 n-d-863052-2 devstack@n-api.service[121402]: Accept-Encoding: identity Nov 01 19:01:15.165223 n-d-863052-2 devstack@n-api.service[121402]: Connection: close Nov 01 19:01:15.165223 n-d-863052-2 devstack@n-api.service[121402]: Content-Length: 0 Nov 01 19:01:15.165223 n-d-863052-2 devstack@n-api.service[121402]: Content-Type: application/json Nov 01 19:01:15.165223 n-d-863052-2 devstack@n-api.service[121402]: Host: 10.222.0.13 Nov 01 19:01:15.165223 n-d-863052-2 devstack@n-api.service[121402]: Openstack-System-Scope: None Nov 01 19:01:15.165223 n-d-863052-2 devstack@n-api.service[121402]: User-Agent: python-urllib3/1.26.12 Nov 01 19:01:15.165223 n-d-863052-2 devstack@n-api.service[121402]: X-Auth-Token: gAAAAABjYWw27zVYcT0jiDkpuT1RhWK3v8RIYvgoBAv6JENEEUigh3EWDZBWsWojpv0UuPsP42AoaM4QJ3MvpvySt_jiXJEPPxL0U99qRIuu3QOrQQyEuoWyflobV2EmBrMy9kC-XG8E8wqlSX7W2YY0K8WOiMWq_0tsCeniBBlKBU3a2s3TKIo Nov 01 19:01:15.165223 n-d-863052-2 devstack@n-api.service[121402]: X-Domain-Id: None Nov 01 19:01:15.165223 n-d-863052-2 devstack@n-api.service[121402]: X-Domain-Name: None Nov 01 19:01:15.165223 n-d-863052-2 devstack@n-api.service[121402]: X-Identity-Status: Confirmed Nov 01 19:01:15.165223 n-d-863052-2 devstack@n-api.service[121402]: X-Is-Admin-Project: True Nov 01 19:01:15.165223 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Domain-Id: default Nov 01 19:01:15.165223 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Domain-Name: Default Nov 01 19:01:15.165223 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Id: 86941784237549838bba63ce88053b88 Nov 01 19:01:15.165223 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Name: tempest-ServersOnMultiNodesTest-1928208762 Nov 01 19:01:15.165223 n-d-863052-2 devstack@n-api.service[121402]: X-Role: member,reader Nov 01 19:01:15.165223 n-d-863052-2 devstack@n-api.service[121402]: X-Roles: member,reader Nov 01 19:01:15.168287 n-d-863052-2 devstack@n-api.service[121402]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/86941784237549838bba63ce88053b88"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/86941784237549838bba63ce88053b88"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_86941784237549838bba63ce88053b88", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/86941784237549838bba63ce88053b88"}]}] Nov 01 19:01:15.168287 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant: tempest-ServersOnMultiNodesTest-1928208762 Nov 01 19:01:15.168287 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant-Id: 86941784237549838bba63ce88053b88 Nov 01 19:01:15.168287 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1928208762 Nov 01 19:01:15.168287 n-d-863052-2 devstack@n-api.service[121402]: X-User: tempest-ServersOnMultiNodesTest-1928208762-project Nov 01 19:01:15.168287 n-d-863052-2 devstack@n-api.service[121402]: X-User-Domain-Id: default Nov 01 19:01:15.168287 n-d-863052-2 devstack@n-api.service[121402]: X-User-Domain-Name: Default Nov 01 19:01:15.168287 n-d-863052-2 devstack@n-api.service[121402]: X-User-Id: 0290a6bb8bc24b8988a925327ac0381c Nov 01 19:01:15.168287 n-d-863052-2 devstack@n-api.service[121402]: X-User-Name: tempest-ServersOnMultiNodesTest-1928208762-project Nov 01 19:01:15.168287 n-d-863052-2 devstack@n-api.service[121402]: method: > Nov 01 19:01:15.168287 n-d-863052-2 devstack@n-api.service[121402]: exception: Instance 7186700c-1951-4ab3-a872-865dc1a45fa1 could not be found. Nov 01 19:01:15.168287 n-d-863052-2 devstack@n-api.service[121402]: action_args: {'id': '7186700c-1951-4ab3-a872-865dc1a45fa1'} Nov 01 19:01:15.169697 n-d-863052-2 devstack@n-api.service[121402]: {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 01 19:01:15.169697 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:01:15.169697 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 01 19:01:15.169697 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 01 19:01:15.169697 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 01 19:01:15.169697 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 01 19:01:15.169697 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 01 19:01:15.169697 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 01 19:01:15.169697 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 01 19:01:15.169697 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 01 19:01:15.169697 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7186700c-1951-4ab3-a872-865dc1a45fa1 could not be found. Nov 01 19:01:15.169697 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:01:15.169697 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:01:15.169697 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:01:15.169697 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:01:15.169697 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:01:15.169697 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:01:15.169697 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 01 19:01:15.169697 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 01 19:01:15.169697 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 01 19:01:15.172128 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 01 19:01:15.172128 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 01 19:01:15.172128 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 01 19:01:15.172128 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 01 19:01:15.172128 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 01 19:01:15.172128 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 01 19:01:15.172128 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 01 19:01:15.172128 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7186700c-1951-4ab3-a872-865dc1a45fa1 could not be found. Nov 01 19:01:15.172128 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:01:15.172128 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:01:15.172128 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:01:15.172128 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:01:15.172128 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:01:15.172128 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:01:15.172128 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 01 19:01:15.172128 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 01 19:01:15.172128 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7186700c-1951-4ab3-a872-865dc1a45fa1 could not be found. Nov 01 19:01:15.172128 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:01:15.175892 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-2deee1db-020a-4fa6-88e6-353a67ac2c7d tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] Returning 404 to user: Instance 7186700c-1951-4ab3-a872-865dc1a45fa1 could not be found. {{(pid=121402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 01 19:01:15.177039 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-2deee1db-020a-4fa6-88e6-353a67ac2c7d tempest-ServersOnMultiNodesTest-1928208762 tempest-ServersOnMultiNodesTest-1928208762-project] 10.222.0.13 "GET /compute/v2.1/servers/7186700c-1951-4ab3-a872-865dc1a45fa1" status: 404 len: 111 microversion: 2.1 time: 0.098719 Nov 01 19:01:15.178103 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 998/1984] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:01:15 2022] GET /compute/v2.1/servers/7186700c-1951-4ab3-a872-865dc1a45fa1 => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 01 19:01:15.193455 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-e82b66b9-0837-4621-8c64-2958f9b33c83 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:01:15.195891 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-e82b66b9-0837-4621-8c64-2958f9b33c83 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] [instance: 1f499af7-1896-478c-b7d7-d922bf78bd98] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:01:15.240180 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e82b66b9-0837-4621-8c64-2958f9b33c83 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:01:15.240713 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e82b66b9-0837-4621-8c64-2958f9b33c83 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:01:15.252072 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e82b66b9-0837-4621-8c64-2958f9b33c83 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:01:15.256898 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e82b66b9-0837-4621-8c64-2958f9b33c83 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:01:15.259981 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e82b66b9-0837-4621-8c64-2958f9b33c83 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:01:15.263875 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e82b66b9-0837-4621-8c64-2958f9b33c83 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:01:15.402514 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-1b804285-594a-4077-9640-2660efef977f tempest-QuotasAdminTestV236-828290407 tempest-QuotasAdminTestV236-828290407-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:01:15.407001 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-1b804285-594a-4077-9640-2660efef977f tempest-QuotasAdminTestV236-828290407 tempest-QuotasAdminTestV236-828290407-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:01:15.411643 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-1b804285-594a-4077-9640-2660efef977f tempest-QuotasAdminTestV236-828290407 tempest-QuotasAdminTestV236-828290407-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:01:15.412645 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-1b804285-594a-4077-9640-2660efef977f tempest-QuotasAdminTestV236-828290407 tempest-QuotasAdminTestV236-828290407-project-admin] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:01:15.413141 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-1b804285-594a-4077-9640-2660efef977f tempest-QuotasAdminTestV236-828290407 tempest-QuotasAdminTestV236-828290407-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:01:15.420154 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-1b804285-594a-4077-9640-2660efef977f tempest-QuotasAdminTestV236-828290407 tempest-QuotasAdminTestV236-828290407-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:01:15.508836 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-1b804285-594a-4077-9640-2660efef977f tempest-QuotasAdminTestV236-828290407 tempest-QuotasAdminTestV236-828290407-project-admin] 10.222.0.13 "GET /compute/v2.1/os-quota-sets/9236c22e9a984591be48344b46d636a7/detail" status: 200 len: 672 microversion: 2.36 time: 0.354267 Nov 01 19:01:15.518702 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 987/1985] 10.222.0.13 () {60 vars in 1304 bytes} [Tue Nov 1 19:01:15 2022] GET /compute/v2.1/os-quota-sets/9236c22e9a984591be48344b46d636a7/detail => generated 672 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 01 19:01:15.531518 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-1a112b9c-938b-45fa-894d-751bbaab5f26 tempest-ServersTestFqdnHostnames-269349818 tempest-ServersTestFqdnHostnames-269349818-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:01:15.535733 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-1a112b9c-938b-45fa-894d-751bbaab5f26 tempest-ServersTestFqdnHostnames-269349818 tempest-ServersTestFqdnHostnames-269349818-project] [instance: 04443e90-21e9-4b5e-99e8-350f07e4ea82] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:01:15.557807 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-1a112b9c-938b-45fa-894d-751bbaab5f26 tempest-ServersTestFqdnHostnames-269349818 tempest-ServersTestFqdnHostnames-269349818-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:01:15.567427 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-1a112b9c-938b-45fa-894d-751bbaab5f26 tempest-ServersTestFqdnHostnames-269349818 tempest-ServersTestFqdnHostnames-269349818-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:01:15.568437 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-1a112b9c-938b-45fa-894d-751bbaab5f26 tempest-ServersTestFqdnHostnames-269349818 tempest-ServersTestFqdnHostnames-269349818-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:01:15.573507 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-1a112b9c-938b-45fa-894d-751bbaab5f26 tempest-ServersTestFqdnHostnames-269349818 tempest-ServersTestFqdnHostnames-269349818-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:01:15.575704 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-1a112b9c-938b-45fa-894d-751bbaab5f26 tempest-ServersTestFqdnHostnames-269349818 tempest-ServersTestFqdnHostnames-269349818-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:01:15.576420 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-1a112b9c-938b-45fa-894d-751bbaab5f26 tempest-ServersTestFqdnHostnames-269349818 tempest-ServersTestFqdnHostnames-269349818-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:01:15.617544 n-d-863052-2 devstack@n-api.service[121402]: DEBUG dbcounter [-] [121402] Writing DB stats nova_cell0:SELECT=2 {{(pid=121402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 19:01:15.783726 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-1a112b9c-938b-45fa-894d-751bbaab5f26 tempest-ServersTestFqdnHostnames-269349818 tempest-ServersTestFqdnHostnames-269349818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d33ca3478b7455dad5094afee57c8b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfea57f34b844c77b22619105249d08a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:01:15.807931 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-1a112b9c-938b-45fa-894d-751bbaab5f26 tempest-ServersTestFqdnHostnames-269349818 tempest-ServersTestFqdnHostnames-269349818-project] 10.222.0.13 "GET /compute/v2.1/servers/04443e90-21e9-4b5e-99e8-350f07e4ea82" status: 200 len: 1599 microversion: 2.1 time: 0.287595 Nov 01 19:01:15.808922 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 988/1986] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:01:15 2022] GET /compute/v2.1/servers/04443e90-21e9-4b5e-99e8-350f07e4ea82 => generated 1599 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:01:15.819028 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-5aac560b-7799-4610-a37f-38cd65955176 tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] Calling method '.version_select at 0x7f0ae2098d30>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:01:15.920300 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-5aac560b-7799-4610-a37f-38cd65955176 tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] 10.222.0.13 "GET /compute/v2.1/images/52ccd7d5-4eba-4e0d-97f4-a4927c3504a7" status: 200 len: 1455 microversion: 2.1 time: 0.109248 Nov 01 19:01:15.920918 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 989/1987] 10.222.0.13 () {58 vars in 1233 bytes} [Tue Nov 1 19:01:15 2022] GET /compute/v2.1/images/52ccd7d5-4eba-4e0d-97f4-a4927c3504a7 => generated 1455 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:01:15.955024 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [req-2184bb27-24c1-4f7c-9e18-8fe9c1f7d75a req-4b6d1ffe-226f-4372-8d57-3759c0b0b8fc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "04443e90-21e9-4b5e-99e8-350f07e4ea82", "name": "network-vif-deleted", "tag": "b9e488b8-901e-4fc1-abb5-b279e9c4057a"}]} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:01:15.985766 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-2184bb27-24c1-4f7c-9e18-8fe9c1f7d75a req-4b6d1ffe-226f-4372-8d57-3759c0b0b8fc service nova] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:01:15.994938 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-2184bb27-24c1-4f7c-9e18-8fe9c1f7d75a req-4b6d1ffe-226f-4372-8d57-3759c0b0b8fc service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:01:15.995809 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-2184bb27-24c1-4f7c-9e18-8fe9c1f7d75a req-4b6d1ffe-226f-4372-8d57-3759c0b0b8fc service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:01:16.019534 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.compute.server_external_events [req-2184bb27-24c1-4f7c-9e18-8fe9c1f7d75a req-4b6d1ffe-226f-4372-8d57-3759c0b0b8fc service nova] Creating event network-vif-deleted:b9e488b8-901e-4fc1-abb5-b279e9c4057a for instance 04443e90-21e9-4b5e-99e8-350f07e4ea82 on n-h1-863052-2 Nov 01 19:01:16.031210 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [req-2184bb27-24c1-4f7c-9e18-8fe9c1f7d75a req-4b6d1ffe-226f-4372-8d57-3759c0b0b8fc service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077931 Nov 01 19:01:16.040079 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 990/1988] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Nov 1 19:01:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 01 19:01:16.109761 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-4174e2bc-2dde-4475-8ab6-6f98b9702e12 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:01:16.111392 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-4174e2bc-2dde-4475-8ab6-6f98b9702e12 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] [instance: cd879708-f757-4f88-bc95-38b6cd55363c] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:01:16.132041 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-4174e2bc-2dde-4475-8ab6-6f98b9702e12 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:01:16.138471 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-4174e2bc-2dde-4475-8ab6-6f98b9702e12 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:01:16.139289 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-4174e2bc-2dde-4475-8ab6-6f98b9702e12 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:01:16.140216 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-4174e2bc-2dde-4475-8ab6-6f98b9702e12 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:01:16.141297 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-4174e2bc-2dde-4475-8ab6-6f98b9702e12 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:01:16.144061 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-4174e2bc-2dde-4475-8ab6-6f98b9702e12 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:01:16.302802 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-e82b66b9-0837-4621-8c64-2958f9b33c83 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f32f5fba1976432d938e664c7714e52b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b9d4c236b944f9b2e8e502a50a8f8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:01:16.315770 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-e82b66b9-0837-4621-8c64-2958f9b33c83 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] 10.222.0.13 "GET /compute/v2.1/servers/1f499af7-1896-478c-b7d7-d922bf78bd98" status: 200 len: 1391 microversion: 2.1 time: 1.136260 Nov 01 19:01:16.319360 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 999/1989] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:01:15 2022] GET /compute/v2.1/servers/1f499af7-1896-478c-b7d7-d922bf78bd98 => generated 1391 bytes in 1140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:01:16.324390 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-83734a03-0c67-4dd4-bc26-ff09a3a6184a tempest-QuotasAdminTestV236-828290407 tempest-QuotasAdminTestV236-828290407-project-admin] Action: 'update', calling method: .version_select at 0x7f0ae2b3b700>, body: {"quota_set": {"ram": "2048"}} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:01:16.830134 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-83734a03-0c67-4dd4-bc26-ff09a3a6184a tempest-QuotasAdminTestV236-828290407 tempest-QuotasAdminTestV236-828290407-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:01:16.831653 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-83734a03-0c67-4dd4-bc26-ff09a3a6184a tempest-QuotasAdminTestV236-828290407 tempest-QuotasAdminTestV236-828290407-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:01:16.833654 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-83734a03-0c67-4dd4-bc26-ff09a3a6184a tempest-QuotasAdminTestV236-828290407 tempest-QuotasAdminTestV236-828290407-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:01:16.835705 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-83734a03-0c67-4dd4-bc26-ff09a3a6184a tempest-QuotasAdminTestV236-828290407 tempest-QuotasAdminTestV236-828290407-project-admin] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:01:16.840209 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-83734a03-0c67-4dd4-bc26-ff09a3a6184a tempest-QuotasAdminTestV236-828290407 tempest-QuotasAdminTestV236-828290407-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:01:16.841208 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-83734a03-0c67-4dd4-bc26-ff09a3a6184a tempest-QuotasAdminTestV236-828290407 tempest-QuotasAdminTestV236-828290407-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:01:16.981310 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-83734a03-0c67-4dd4-bc26-ff09a3a6184a tempest-QuotasAdminTestV236-828290407 tempest-QuotasAdminTestV236-828290407-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:01:16.982687 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-83734a03-0c67-4dd4-bc26-ff09a3a6184a tempest-QuotasAdminTestV236-828290407 tempest-QuotasAdminTestV236-828290407-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:01:16.984593 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-83734a03-0c67-4dd4-bc26-ff09a3a6184a tempest-QuotasAdminTestV236-828290407 tempest-QuotasAdminTestV236-828290407-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:01:16.987550 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-83734a03-0c67-4dd4-bc26-ff09a3a6184a tempest-QuotasAdminTestV236-828290407 tempest-QuotasAdminTestV236-828290407-project-admin] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:01:16.988052 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-83734a03-0c67-4dd4-bc26-ff09a3a6184a tempest-QuotasAdminTestV236-828290407 tempest-QuotasAdminTestV236-828290407-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:01:16.988720 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-83734a03-0c67-4dd4-bc26-ff09a3a6184a tempest-QuotasAdminTestV236-828290407 tempest-QuotasAdminTestV236-828290407-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:01:17.112683 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-83734a03-0c67-4dd4-bc26-ff09a3a6184a tempest-QuotasAdminTestV236-828290407 tempest-QuotasAdminTestV236-828290407-project-admin] 10.222.0.13 "PUT /compute/v2.1/os-quota-sets/9236c22e9a984591be48344b46d636a7?user_id=96ac61057b884d059999a00416580ff6" status: 200 len: 240 microversion: 2.36 time: 0.791588 Nov 01 19:01:17.114130 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1000/1990] 10.222.0.13 () {62 vars in 1384 bytes} [Tue Nov 1 19:01:16 2022] PUT /compute/v2.1/os-quota-sets/9236c22e9a984591be48344b46d636a7?user_id=96ac61057b884d059999a00416580ff6 => generated 240 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 01 19:01:17.120368 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [req-33910c67-343a-4ee0-8e63-cdc735d76ff0 req-1f28cfc8-4d9e-45ff-824d-74cc87fd0298 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f499af7-1896-478c-b7d7-d922bf78bd98", "name": "network-vif-unplugged", "status": "completed", "tag": "a463e9d5-3409-4b7b-97cb-4970df239917"}]} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:01:17.140358 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-33910c67-343a-4ee0-8e63-cdc735d76ff0 req-1f28cfc8-4d9e-45ff-824d-74cc87fd0298 service nova] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:01:17.141206 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-33910c67-343a-4ee0-8e63-cdc735d76ff0 req-1f28cfc8-4d9e-45ff-824d-74cc87fd0298 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:01:17.141908 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-33910c67-343a-4ee0-8e63-cdc735d76ff0 req-1f28cfc8-4d9e-45ff-824d-74cc87fd0298 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:01:17.161605 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.compute.server_external_events [req-33910c67-343a-4ee0-8e63-cdc735d76ff0 req-1f28cfc8-4d9e-45ff-824d-74cc87fd0298 service nova] Creating event network-vif-unplugged:a463e9d5-3409-4b7b-97cb-4970df239917 for instance 1f499af7-1896-478c-b7d7-d922bf78bd98 on n-h1-863052-2 Nov 01 19:01:17.169838 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [req-33910c67-343a-4ee0-8e63-cdc735d76ff0 req-1f28cfc8-4d9e-45ff-824d-74cc87fd0298 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.054132 Nov 01 19:01:17.171199 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1001/1991] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Nov 1 19:01:17 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:01:17.179880 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [req-784fb5d3-48f7-456d-b954-a24a3c8b8570 req-1c909e1d-bda8-4799-af9d-f64890caa4b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cd879708-f757-4f88-bc95-38b6cd55363c", "name": "network-vif-plugged", "status": "completed", "tag": "5814506e-bf1a-49cf-9169-b3181e825901"}]} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:01:17.195163 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-784fb5d3-48f7-456d-b954-a24a3c8b8570 req-1c909e1d-bda8-4799-af9d-f64890caa4b0 service nova] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:01:17.196476 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-784fb5d3-48f7-456d-b954-a24a3c8b8570 req-1c909e1d-bda8-4799-af9d-f64890caa4b0 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:01:17.197817 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-784fb5d3-48f7-456d-b954-a24a3c8b8570 req-1c909e1d-bda8-4799-af9d-f64890caa4b0 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:01:17.234665 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.compute.server_external_events [req-784fb5d3-48f7-456d-b954-a24a3c8b8570 req-1c909e1d-bda8-4799-af9d-f64890caa4b0 service nova] Creating event network-vif-plugged:5814506e-bf1a-49cf-9169-b3181e825901 for instance cd879708-f757-4f88-bc95-38b6cd55363c on n-h2-863052-2 Nov 01 19:01:17.250827 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [req-784fb5d3-48f7-456d-b954-a24a3c8b8570 req-1c909e1d-bda8-4799-af9d-f64890caa4b0 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077229 Nov 01 19:01:17.251457 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1002/1992] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Nov 1 19:01:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:01:17.274145 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-ca8cd9ec-8ded-4c04-b54e-d726c9514ec7 tempest-ServersTestFqdnHostnames-269349818 tempest-ServersTestFqdnHostnames-269349818-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:01:17.275306 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-ca8cd9ec-8ded-4c04-b54e-d726c9514ec7 tempest-ServersTestFqdnHostnames-269349818 tempest-ServersTestFqdnHostnames-269349818-project] [instance: 04443e90-21e9-4b5e-99e8-350f07e4ea82] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:01:17.295661 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-ca8cd9ec-8ded-4c04-b54e-d726c9514ec7 tempest-ServersTestFqdnHostnames-269349818 tempest-ServersTestFqdnHostnames-269349818-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:01:17.304355 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-ca8cd9ec-8ded-4c04-b54e-d726c9514ec7 tempest-ServersTestFqdnHostnames-269349818 tempest-ServersTestFqdnHostnames-269349818-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:01:17.305732 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-ca8cd9ec-8ded-4c04-b54e-d726c9514ec7 tempest-ServersTestFqdnHostnames-269349818 tempest-ServersTestFqdnHostnames-269349818-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:01:17.308970 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-ca8cd9ec-8ded-4c04-b54e-d726c9514ec7 tempest-ServersTestFqdnHostnames-269349818 tempest-ServersTestFqdnHostnames-269349818-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:01:17.317402 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-4174e2bc-2dde-4475-8ab6-6f98b9702e12 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:01:17.331129 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-ca8cd9ec-8ded-4c04-b54e-d726c9514ec7 tempest-ServersTestFqdnHostnames-269349818 tempest-ServersTestFqdnHostnames-269349818-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:01:17.331683 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-ca8cd9ec-8ded-4c04-b54e-d726c9514ec7 tempest-ServersTestFqdnHostnames-269349818 tempest-ServersTestFqdnHostnames-269349818-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:01:17.351125 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-4174e2bc-2dde-4475-8ab6-6f98b9702e12 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:01:17.352872 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-4174e2bc-2dde-4475-8ab6-6f98b9702e12 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:01:17.361957 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-4174e2bc-2dde-4475-8ab6-6f98b9702e12 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] 10.222.0.13 "GET /compute/v2.1/servers/cd879708-f757-4f88-bc95-38b6cd55363c" status: 200 len: 1281 microversion: 2.25 time: 1.257601 Nov 01 19:01:17.374550 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 991/1993] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 19:01:16 2022] GET /compute/v2.1/servers/cd879708-f757-4f88-bc95-38b6cd55363c => generated 1281 bytes in 1264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 19:01:17.384948 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-bec04ef4-13ee-4c9c-981e-db4cffdac124 tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] Calling method '.version_select at 0x7f0ae6713f70>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:01:17.481543 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-ca8cd9ec-8ded-4c04-b54e-d726c9514ec7 tempest-ServersTestFqdnHostnames-269349818 tempest-ServersTestFqdnHostnames-269349818-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:01:17.482052 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-ca8cd9ec-8ded-4c04-b54e-d726c9514ec7 tempest-ServersTestFqdnHostnames-269349818 tempest-ServersTestFqdnHostnames-269349818-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:01:17.482496 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-ca8cd9ec-8ded-4c04-b54e-d726c9514ec7 tempest-ServersTestFqdnHostnames-269349818 tempest-ServersTestFqdnHostnames-269349818-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:01:17.485688 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.objects.instance [None req-ca8cd9ec-8ded-4c04-b54e-d726c9514ec7 tempest-ServersTestFqdnHostnames-269349818 tempest-ServersTestFqdnHostnames-269349818-project] Lazy-loading 'fault' on Instance uuid 04443e90-21e9-4b5e-99e8-350f07e4ea82 {{(pid=121402) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 01 19:01:17.541331 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-bec04ef4-13ee-4c9c-981e-db4cffdac124 tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] 10.222.0.13 "GET /compute/v2.1/images/52ccd7d5-4eba-4e0d-97f4-a4927c3504a7" status: 200 len: 1455 microversion: 2.1 time: 0.173404 Nov 01 19:01:17.544791 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 992/1994] 10.222.0.13 () {58 vars in 1233 bytes} [Tue Nov 1 19:01:17 2022] GET /compute/v2.1/images/52ccd7d5-4eba-4e0d-97f4-a4927c3504a7 => generated 1455 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:01:17.558359 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-aee2a295-09e0-4c20-a573-db1179153c4e tempest-QuotasAdminTestV236-828290407 tempest-QuotasAdminTestV236-828290407-project-admin] Calling method '.version_select at 0x7f0ae2098790>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:01:17.619414 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-ca8cd9ec-8ded-4c04-b54e-d726c9514ec7 tempest-ServersTestFqdnHostnames-269349818 tempest-ServersTestFqdnHostnames-269349818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d33ca3478b7455dad5094afee57c8b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfea57f34b844c77b22619105249d08a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:01:17.630194 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-ca8cd9ec-8ded-4c04-b54e-d726c9514ec7 tempest-ServersTestFqdnHostnames-269349818 tempest-ServersTestFqdnHostnames-269349818-project] 10.222.0.13 "GET /compute/v2.1/servers/04443e90-21e9-4b5e-99e8-350f07e4ea82" status: 200 len: 1316 microversion: 2.1 time: 0.372785 Nov 01 19:01:17.631347 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1003/1995] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:01:17 2022] GET /compute/v2.1/servers/04443e90-21e9-4b5e-99e8-350f07e4ea82 => generated 1316 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:01:17.637886 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-1d680bb9-20db-481a-a190-f4c0a7e6961c tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:01:17.638767 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-1d680bb9-20db-481a-a190-f4c0a7e6961c tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] [instance: 1f499af7-1896-478c-b7d7-d922bf78bd98] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:01:17.654648 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-1d680bb9-20db-481a-a190-f4c0a7e6961c tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:01:17.655345 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-1d680bb9-20db-481a-a190-f4c0a7e6961c tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:01:17.657062 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-1d680bb9-20db-481a-a190-f4c0a7e6961c tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:01:17.658287 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-1d680bb9-20db-481a-a190-f4c0a7e6961c tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:01:17.658941 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-1d680bb9-20db-481a-a190-f4c0a7e6961c tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:01:17.660168 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-1d680bb9-20db-481a-a190-f4c0a7e6961c tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:01:17.766181 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-aee2a295-09e0-4c20-a573-db1179153c4e tempest-QuotasAdminTestV236-828290407 tempest-QuotasAdminTestV236-828290407-project-admin] 10.222.0.13 "GET /compute/v2.1/os-quota-sets/9236c22e9a984591be48344b46d636a7?user_id=96ac61057b884d059999a00416580ff6" status: 200 len: 282 microversion: 2.36 time: 0.220001 Nov 01 19:01:17.766784 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 993/1996] 10.222.0.13 () {60 vars in 1364 bytes} [Tue Nov 1 19:01:17 2022] GET /compute/v2.1/os-quota-sets/9236c22e9a984591be48344b46d636a7?user_id=96ac61057b884d059999a00416580ff6 => generated 282 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 01 19:01:18.400326 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-05c7d99d-31d1-4266-98e5-1e1dd7d07eb4 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:01:18.401168 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-05c7d99d-31d1-4266-98e5-1e1dd7d07eb4 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] [instance: cd879708-f757-4f88-bc95-38b6cd55363c] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:01:18.423606 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-05c7d99d-31d1-4266-98e5-1e1dd7d07eb4 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:01:18.425449 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-05c7d99d-31d1-4266-98e5-1e1dd7d07eb4 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:01:18.425913 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-05c7d99d-31d1-4266-98e5-1e1dd7d07eb4 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:01:18.426662 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-05c7d99d-31d1-4266-98e5-1e1dd7d07eb4 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:01:18.428993 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-05c7d99d-31d1-4266-98e5-1e1dd7d07eb4 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:01:18.432467 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-05c7d99d-31d1-4266-98e5-1e1dd7d07eb4 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:01:18.584565 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-1d680bb9-20db-481a-a190-f4c0a7e6961c tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f32f5fba1976432d938e664c7714e52b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b9d4c236b944f9b2e8e502a50a8f8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:01:18.594406 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-1d680bb9-20db-481a-a190-f4c0a7e6961c tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] 10.222.0.13 "GET /compute/v2.1/servers/1f499af7-1896-478c-b7d7-d922bf78bd98" status: 200 len: 1391 microversion: 2.1 time: 0.961699 Nov 01 19:01:18.614556 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1004/1997] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:01:17 2022] GET /compute/v2.1/servers/1f499af7-1896-478c-b7d7-d922bf78bd98 => generated 1391 bytes in 982 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:01:18.620520 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-1e32c0a8-617f-4c01-a332-6911af61d0d9 tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] Calling method '.version_select at 0x7f0ae2a84ee0>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:01:18.691041 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-05c7d99d-31d1-4266-98e5-1e1dd7d07eb4 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:01:18.717554 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-05c7d99d-31d1-4266-98e5-1e1dd7d07eb4 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:01:18.719494 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-05c7d99d-31d1-4266-98e5-1e1dd7d07eb4 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:01:18.721286 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-05c7d99d-31d1-4266-98e5-1e1dd7d07eb4 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] 10.222.0.13 "GET /compute/v2.1/servers/cd879708-f757-4f88-bc95-38b6cd55363c" status: 200 len: 1281 microversion: 2.25 time: 0.326485 Nov 01 19:01:18.726180 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 994/1998] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 19:01:18 2022] GET /compute/v2.1/servers/cd879708-f757-4f88-bc95-38b6cd55363c => generated 1281 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 19:01:18.732130 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-5ae7bf53-ae9a-4d6c-a300-24ff346808ad tempest-ServersTestFqdnHostnames-269349818 tempest-ServersTestFqdnHostnames-269349818-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:01:18.733292 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-5ae7bf53-ae9a-4d6c-a300-24ff346808ad tempest-ServersTestFqdnHostnames-269349818 tempest-ServersTestFqdnHostnames-269349818-project] [instance: 04443e90-21e9-4b5e-99e8-350f07e4ea82] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:01:18.736867 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-1e32c0a8-617f-4c01-a332-6911af61d0d9 tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] 10.222.0.13 "GET /compute/v2.1/images/52ccd7d5-4eba-4e0d-97f4-a4927c3504a7" status: 200 len: 1455 microversion: 2.1 time: 0.120775 Nov 01 19:01:18.741167 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1005/1999] 10.222.0.13 () {58 vars in 1233 bytes} [Tue Nov 1 19:01:18 2022] GET /compute/v2.1/images/52ccd7d5-4eba-4e0d-97f4-a4927c3504a7 => generated 1455 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:01:18.744666 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-5ae7bf53-ae9a-4d6c-a300-24ff346808ad tempest-ServersTestFqdnHostnames-269349818 tempest-ServersTestFqdnHostnames-269349818-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:01:18.745173 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-5ae7bf53-ae9a-4d6c-a300-24ff346808ad tempest-ServersTestFqdnHostnames-269349818 tempest-ServersTestFqdnHostnames-269349818-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:01:18.745666 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-5ae7bf53-ae9a-4d6c-a300-24ff346808ad tempest-ServersTestFqdnHostnames-269349818 tempest-ServersTestFqdnHostnames-269349818-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:01:18.746512 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-5ae7bf53-ae9a-4d6c-a300-24ff346808ad tempest-ServersTestFqdnHostnames-269349818 tempest-ServersTestFqdnHostnames-269349818-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:01:18.747031 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-5ae7bf53-ae9a-4d6c-a300-24ff346808ad tempest-ServersTestFqdnHostnames-269349818 tempest-ServersTestFqdnHostnames-269349818-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:01:18.747814 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-5ae7bf53-ae9a-4d6c-a300-24ff346808ad tempest-ServersTestFqdnHostnames-269349818 tempest-ServersTestFqdnHostnames-269349818-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:01:18.786053 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.wsgi [None req-5ae7bf53-ae9a-4d6c-a300-24ff346808ad tempest-ServersTestFqdnHostnames-269349818 tempest-ServersTestFqdnHostnames-269349818-project] HTTP exception thrown: Instance 04443e90-21e9-4b5e-99e8-350f07e4ea82 could not be found. Nov 01 19:01:18.796940 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-5ae7bf53-ae9a-4d6c-a300-24ff346808ad tempest-ServersTestFqdnHostnames-269349818 tempest-ServersTestFqdnHostnames-269349818-project] Request method failure captured: Nov 01 19:01:18.796940 n-d-863052-2 devstack@n-api.service[121403]: request: GET /compute/v2.1/servers/04443e90-21e9-4b5e-99e8-350f07e4ea82 HTTP/1.1 Nov 01 19:01:18.796940 n-d-863052-2 devstack@n-api.service[121403]: Accept: application/json Nov 01 19:01:18.796940 n-d-863052-2 devstack@n-api.service[121403]: Accept-Encoding: identity Nov 01 19:01:18.796940 n-d-863052-2 devstack@n-api.service[121403]: Connection: close Nov 01 19:01:18.796940 n-d-863052-2 devstack@n-api.service[121403]: Content-Length: 0 Nov 01 19:01:18.796940 n-d-863052-2 devstack@n-api.service[121403]: Content-Type: application/json Nov 01 19:01:18.796940 n-d-863052-2 devstack@n-api.service[121403]: Host: 10.222.0.13 Nov 01 19:01:18.796940 n-d-863052-2 devstack@n-api.service[121403]: Openstack-System-Scope: None Nov 01 19:01:18.796940 n-d-863052-2 devstack@n-api.service[121403]: User-Agent: python-urllib3/1.26.12 Nov 01 19:01:18.796940 n-d-863052-2 devstack@n-api.service[121403]: X-Auth-Token: gAAAAABjYWymrAOOaNkwkNQMmTzvLZRi4iw1Xw7nUxJqWSBeyn_4rDpQKUO_XLgdqgkx387zax7OIvpnsRKrRa3LKybArKvk6G7HdVOyz9jmGL2jeO7lWsOkWA-7kHgi0xuNX0ZGeygSmIgSwypcfK7dX_aeefkFBwcFvnxtPYX_cBVNnDSxc6I Nov 01 19:01:18.796940 n-d-863052-2 devstack@n-api.service[121403]: X-Domain-Id: None Nov 01 19:01:18.796940 n-d-863052-2 devstack@n-api.service[121403]: X-Domain-Name: None Nov 01 19:01:18.796940 n-d-863052-2 devstack@n-api.service[121403]: X-Identity-Status: Confirmed Nov 01 19:01:18.796940 n-d-863052-2 devstack@n-api.service[121403]: X-Is-Admin-Project: True Nov 01 19:01:18.796940 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Domain-Id: default Nov 01 19:01:18.796940 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Domain-Name: Default Nov 01 19:01:18.796940 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Id: cfea57f34b844c77b22619105249d08a Nov 01 19:01:18.796940 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Name: tempest-ServersTestFqdnHostnames-269349818 Nov 01 19:01:18.796940 n-d-863052-2 devstack@n-api.service[121403]: X-Role: member,reader Nov 01 19:01:18.796940 n-d-863052-2 devstack@n-api.service[121403]: X-Roles: member,reader Nov 01 19:01:18.799102 n-d-863052-2 devstack@n-api.service[121403]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/cfea57f34b844c77b22619105249d08a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/cfea57f34b844c77b22619105249d08a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_cfea57f34b844c77b22619105249d08a", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/cfea57f34b844c77b22619105249d08a"}]}] Nov 01 19:01:18.799102 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant: tempest-ServersTestFqdnHostnames-269349818 Nov 01 19:01:18.799102 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant-Id: cfea57f34b844c77b22619105249d08a Nov 01 19:01:18.799102 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant-Name: tempest-ServersTestFqdnHostnames-269349818 Nov 01 19:01:18.799102 n-d-863052-2 devstack@n-api.service[121403]: X-User: tempest-ServersTestFqdnHostnames-269349818-project Nov 01 19:01:18.799102 n-d-863052-2 devstack@n-api.service[121403]: X-User-Domain-Id: default Nov 01 19:01:18.799102 n-d-863052-2 devstack@n-api.service[121403]: X-User-Domain-Name: Default Nov 01 19:01:18.799102 n-d-863052-2 devstack@n-api.service[121403]: X-User-Id: 3d33ca3478b7455dad5094afee57c8b2 Nov 01 19:01:18.799102 n-d-863052-2 devstack@n-api.service[121403]: X-User-Name: tempest-ServersTestFqdnHostnames-269349818-project Nov 01 19:01:18.799102 n-d-863052-2 devstack@n-api.service[121403]: method: > Nov 01 19:01:18.799102 n-d-863052-2 devstack@n-api.service[121403]: exception: Instance 04443e90-21e9-4b5e-99e8-350f07e4ea82 could not be found. Nov 01 19:01:18.799102 n-d-863052-2 devstack@n-api.service[121403]: action_args: {'id': '04443e90-21e9-4b5e-99e8-350f07e4ea82'} Nov 01 19:01:18.800189 n-d-863052-2 devstack@n-api.service[121403]: {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 01 19:01:18.800189 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:01:18.800189 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 01 19:01:18.800189 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 01 19:01:18.800189 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 01 19:01:18.800189 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 01 19:01:18.800189 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 01 19:01:18.800189 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 01 19:01:18.800189 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 01 19:01:18.800189 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 01 19:01:18.800189 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 04443e90-21e9-4b5e-99e8-350f07e4ea82 could not be found. Nov 01 19:01:18.800189 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:01:18.800189 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:01:18.800189 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:01:18.800189 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:01:18.800189 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:01:18.800189 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:01:18.800189 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 01 19:01:18.800189 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 01 19:01:18.800189 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 01 19:01:18.801970 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 01 19:01:18.801970 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 01 19:01:18.801970 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 01 19:01:18.801970 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 01 19:01:18.801970 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 01 19:01:18.801970 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 01 19:01:18.801970 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 01 19:01:18.801970 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 04443e90-21e9-4b5e-99e8-350f07e4ea82 could not be found. Nov 01 19:01:18.801970 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:01:18.801970 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:01:18.801970 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:01:18.801970 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:01:18.801970 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:01:18.801970 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:01:18.801970 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 01 19:01:18.801970 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 01 19:01:18.801970 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 04443e90-21e9-4b5e-99e8-350f07e4ea82 could not be found. Nov 01 19:01:18.801970 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:01:18.804220 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-5ae7bf53-ae9a-4d6c-a300-24ff346808ad tempest-ServersTestFqdnHostnames-269349818 tempest-ServersTestFqdnHostnames-269349818-project] Returning 404 to user: Instance 04443e90-21e9-4b5e-99e8-350f07e4ea82 could not be found. {{(pid=121403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 01 19:01:18.804220 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-5ae7bf53-ae9a-4d6c-a300-24ff346808ad tempest-ServersTestFqdnHostnames-269349818 tempest-ServersTestFqdnHostnames-269349818-project] 10.222.0.13 "GET /compute/v2.1/servers/04443e90-21e9-4b5e-99e8-350f07e4ea82" status: 404 len: 111 microversion: 2.1 time: 0.073199 Nov 01 19:01:18.807871 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 995/2000] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:01:18 2022] GET /compute/v2.1/servers/04443e90-21e9-4b5e-99e8-350f07e4ea82 => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 01 19:01:18.816854 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-11d8937b-08c6-4a77-a49f-f6d5a9c142d1 tempest-ServersTestFqdnHostnames-269349818 tempest-ServersTestFqdnHostnames-269349818-project] Calling method '.version_select at 0x7f0ae2a79940>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:01:18.858601 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-11d8937b-08c6-4a77-a49f-f6d5a9c142d1 tempest-ServersTestFqdnHostnames-269349818 tempest-ServersTestFqdnHostnames-269349818-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1693802313" status: 202 len: 0 microversion: 2.1 time: 0.045711 Nov 01 19:01:18.859742 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1006/2001] 10.222.0.13 () {58 vars in 1221 bytes} [Tue Nov 1 19:01:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1693802313 => generated 0 bytes in 48 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 01 19:01:19.420802 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [req-94e61f0c-db57-4c70-8d21-18f6cf31d14e req-315ecfbb-ba6e-40a0-8429-3838328f686c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1f499af7-1896-478c-b7d7-d922bf78bd98", "tag": "a463e9d5-3409-4b7b-97cb-4970df239917"}]} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:01:19.463664 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-94e61f0c-db57-4c70-8d21-18f6cf31d14e req-315ecfbb-ba6e-40a0-8429-3838328f686c service nova] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:01:19.464818 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-94e61f0c-db57-4c70-8d21-18f6cf31d14e req-315ecfbb-ba6e-40a0-8429-3838328f686c service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:01:19.465266 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-94e61f0c-db57-4c70-8d21-18f6cf31d14e req-315ecfbb-ba6e-40a0-8429-3838328f686c service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:01:19.497021 n-d-863052-2 devstack@n-api.service[121403]: DEBUG dbcounter [-] [121403] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=121403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 19:01:19.498072 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.compute.server_external_events [req-94e61f0c-db57-4c70-8d21-18f6cf31d14e req-315ecfbb-ba6e-40a0-8429-3838328f686c service nova] Creating event network-changed:a463e9d5-3409-4b7b-97cb-4970df239917 for instance 1f499af7-1896-478c-b7d7-d922bf78bd98 on n-h1-863052-2 Nov 01 19:01:19.529955 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [req-94e61f0c-db57-4c70-8d21-18f6cf31d14e req-315ecfbb-ba6e-40a0-8429-3838328f686c service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094342 Nov 01 19:01:19.533442 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 996/2002] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Nov 1 19:01:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:01:19.622040 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-b3a2d43d-0c66-4132-9121-26d14de9df8f tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:01:19.622668 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-b3a2d43d-0c66-4132-9121-26d14de9df8f tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] [instance: 1f499af7-1896-478c-b7d7-d922bf78bd98] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:01:19.638497 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b3a2d43d-0c66-4132-9121-26d14de9df8f tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:01:19.647107 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b3a2d43d-0c66-4132-9121-26d14de9df8f tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:01:19.648101 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b3a2d43d-0c66-4132-9121-26d14de9df8f tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:01:19.652741 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b3a2d43d-0c66-4132-9121-26d14de9df8f tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:01:19.654346 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b3a2d43d-0c66-4132-9121-26d14de9df8f tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:01:19.655032 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b3a2d43d-0c66-4132-9121-26d14de9df8f tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:01:19.754301 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-772a65f0-31c4-4d7f-ae51-416160a34449 tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] Calling method '.version_select at 0x7f0ae20f7e50>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:01:19.872678 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-772a65f0-31c4-4d7f-ae51-416160a34449 tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] 10.222.0.13 "GET /compute/v2.1/images/52ccd7d5-4eba-4e0d-97f4-a4927c3504a7" status: 200 len: 1455 microversion: 2.1 time: 0.122936 Nov 01 19:01:19.875625 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 997/2003] 10.222.0.13 () {58 vars in 1233 bytes} [Tue Nov 1 19:01:19 2022] GET /compute/v2.1/images/52ccd7d5-4eba-4e0d-97f4-a4927c3504a7 => generated 1455 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 19:01:19.887424 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-673cf222-220f-4e33-899f-1d17ab4ec2a6 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:01:19.888197 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-673cf222-220f-4e33-899f-1d17ab4ec2a6 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] [instance: cd879708-f757-4f88-bc95-38b6cd55363c] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:01:19.909678 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-673cf222-220f-4e33-899f-1d17ab4ec2a6 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:01:19.910187 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-673cf222-220f-4e33-899f-1d17ab4ec2a6 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:01:19.910732 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-673cf222-220f-4e33-899f-1d17ab4ec2a6 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:01:19.911467 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-673cf222-220f-4e33-899f-1d17ab4ec2a6 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:01:19.912721 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-673cf222-220f-4e33-899f-1d17ab4ec2a6 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:01:19.930029 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-673cf222-220f-4e33-899f-1d17ab4ec2a6 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:01:20.136566 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-b3a2d43d-0c66-4132-9121-26d14de9df8f tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f32f5fba1976432d938e664c7714e52b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b9d4c236b944f9b2e8e502a50a8f8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:01:20.154947 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-b3a2d43d-0c66-4132-9121-26d14de9df8f tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] 10.222.0.13 "GET /compute/v2.1/servers/1f499af7-1896-478c-b7d7-d922bf78bd98" status: 200 len: 1391 microversion: 2.1 time: 0.536002 Nov 01 19:01:20.155901 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1007/2004] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:01:19 2022] GET /compute/v2.1/servers/1f499af7-1896-478c-b7d7-d922bf78bd98 => generated 1391 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:01:20.784380 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-b8897789-3df9-4845-97aa-0338046849f4 tempest-ServersTestBootFromVolume-877599095 tempest-ServersTestBootFromVolume-877599095-project] Action: 'create', calling method: .version_select at 0x7f0ae1d5b4c0>, body: {"keypair": {"name": "tempest-keypair-871595936", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDH0VdDBFWD3UCL/hxo2sSVO7hxiFrc+4JU+cfvu0D+wDlf/8V8IKvav/TPLw8LXuq0w3cVzwvGx7HKJ5JgALIiPKMFUO3O2M9RdorP1PwFHSW9CWbhY/AcIMpHY/YA9JQ=="}} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:01:20.824291 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.quota [None req-b8897789-3df9-4845-97aa-0338046849f4 tempest-ServersTestBootFromVolume-877599095 tempest-ServersTestBootFromVolume-877599095-project] Getting quotas for project 651046528c204df299ca3d14c44b4a7a. Resources: {'key_pairs'} {{(pid=121402) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 01 19:01:20.827553 n-d-863052-2 devstack@n-api.service[121402]: DEBUG dbcounter [-] [121402] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=1,nova_api:DELETE=4,nova_api:INSERT=1 {{(pid=121402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 19:01:20.837489 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.quota [None req-b8897789-3df9-4845-97aa-0338046849f4 tempest-ServersTestBootFromVolume-877599095 tempest-ServersTestBootFromVolume-877599095-project] Getting quotas for user ed2352ce53fc4045adde8cd81b78b3ed and project 651046528c204df299ca3d14c44b4a7a. Resources: {'key_pairs'} {{(pid=121402) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 01 19:01:20.910409 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-b8897789-3df9-4845-97aa-0338046849f4 tempest-ServersTestBootFromVolume-877599095 tempest-ServersTestBootFromVolume-877599095-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.491321 Nov 01 19:01:20.933134 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1008/2005] 10.222.0.13 () {60 vars in 1159 bytes} [Tue Nov 1 19:01:20 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:01:20.941605 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-630b0d56-b3e7-48a1-84be-f3ccb42a3629 tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] Calling method '.version_select at 0x7f0ae1cad4c0>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:01:21.058277 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-630b0d56-b3e7-48a1-84be-f3ccb42a3629 tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] 10.222.0.13 "GET /compute/v2.1/images/52ccd7d5-4eba-4e0d-97f4-a4927c3504a7" status: 200 len: 1455 microversion: 2.1 time: 0.123664 Nov 01 19:01:21.058863 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1009/2006] 10.222.0.13 () {58 vars in 1233 bytes} [Tue Nov 1 19:01:20 2022] GET /compute/v2.1/images/52ccd7d5-4eba-4e0d-97f4-a4927c3504a7 => generated 1455 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:01:21.183525 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-af7c0623-dcc8-4254-92b2-04d0db298a40 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:01:21.184148 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-af7c0623-dcc8-4254-92b2-04d0db298a40 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] [instance: 1f499af7-1896-478c-b7d7-d922bf78bd98] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:01:21.196120 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-af7c0623-dcc8-4254-92b2-04d0db298a40 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:01:21.197182 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-af7c0623-dcc8-4254-92b2-04d0db298a40 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:01:21.197612 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-af7c0623-dcc8-4254-92b2-04d0db298a40 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:01:21.198317 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-af7c0623-dcc8-4254-92b2-04d0db298a40 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:01:21.208190 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-af7c0623-dcc8-4254-92b2-04d0db298a40 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:01:21.217327 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-af7c0623-dcc8-4254-92b2-04d0db298a40 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:01:21.483467 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-673cf222-220f-4e33-899f-1d17ab4ec2a6 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:01:21.498775 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-673cf222-220f-4e33-899f-1d17ab4ec2a6 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:01:21.500221 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-673cf222-220f-4e33-899f-1d17ab4ec2a6 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:01:21.511353 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-673cf222-220f-4e33-899f-1d17ab4ec2a6 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] 10.222.0.13 "GET /compute/v2.1/servers/cd879708-f757-4f88-bc95-38b6cd55363c" status: 200 len: 1281 microversion: 2.25 time: 1.634589 Nov 01 19:01:21.512296 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 998/2007] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 19:01:19 2022] GET /compute/v2.1/servers/cd879708-f757-4f88-bc95-38b6cd55363c => generated 1281 bytes in 1636 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 19:01:21.656146 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-af7c0623-dcc8-4254-92b2-04d0db298a40 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f32f5fba1976432d938e664c7714e52b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b9d4c236b944f9b2e8e502a50a8f8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:01:21.670551 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-af7c0623-dcc8-4254-92b2-04d0db298a40 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] 10.222.0.13 "GET /compute/v2.1/servers/1f499af7-1896-478c-b7d7-d922bf78bd98" status: 200 len: 1391 microversion: 2.1 time: 0.490481 Nov 01 19:01:21.670692 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1010/2008] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:01:21 2022] GET /compute/v2.1/servers/1f499af7-1896-478c-b7d7-d922bf78bd98 => generated 1391 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 19:01:22.083004 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-fa80a24a-62f7-4b10-90dc-803db7df2510 tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] Calling method '.version_select at 0x7f0ae2102d30>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:01:22.177310 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-fa80a24a-62f7-4b10-90dc-803db7df2510 tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] 10.222.0.13 "GET /compute/v2.1/images/52ccd7d5-4eba-4e0d-97f4-a4927c3504a7" status: 200 len: 1455 microversion: 2.1 time: 0.096720 Nov 01 19:01:22.178285 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 999/2009] 10.222.0.13 () {58 vars in 1233 bytes} [Tue Nov 1 19:01:22 2022] GET /compute/v2.1/images/52ccd7d5-4eba-4e0d-97f4-a4927c3504a7 => generated 1455 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:01:22.519937 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-026c7c47-8a76-41ef-9165-7a3c0e01b097 tempest-FlavorsV2NegativeTest-1375055051 tempest-FlavorsV2NegativeTest-1375055051-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:01:22.537304 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-026c7c47-8a76-41ef-9165-7a3c0e01b097 tempest-FlavorsV2NegativeTest-1375055051 tempest-FlavorsV2NegativeTest-1375055051-project] 10.222.0.13 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.266095 Nov 01 19:01:22.544011 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-f8ab833c-cc12-4315-b532-390ed2b73b3f tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:01:22.545269 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-f8ab833c-cc12-4315-b532-390ed2b73b3f tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] [instance: cd879708-f757-4f88-bc95-38b6cd55363c] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:01:22.558628 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1011/2010] 10.222.0.13 () {58 vars in 1137 bytes} [Tue Nov 1 19:01:22 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:01:22.565654 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f8ab833c-cc12-4315-b532-390ed2b73b3f tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:01:22.566157 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f8ab833c-cc12-4315-b532-390ed2b73b3f tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:01:22.566599 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f8ab833c-cc12-4315-b532-390ed2b73b3f tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:01:22.567323 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f8ab833c-cc12-4315-b532-390ed2b73b3f tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:01:22.567904 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f8ab833c-cc12-4315-b532-390ed2b73b3f tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:01:22.568200 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f8ab833c-cc12-4315-b532-390ed2b73b3f tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:01:22.703913 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-029dd3ed-1751-4195-a716-4cb918ac0534 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:01:22.704960 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-029dd3ed-1751-4195-a716-4cb918ac0534 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] [instance: 1f499af7-1896-478c-b7d7-d922bf78bd98] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:01:22.721679 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-029dd3ed-1751-4195-a716-4cb918ac0534 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:01:22.725309 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-029dd3ed-1751-4195-a716-4cb918ac0534 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:01:22.726069 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-029dd3ed-1751-4195-a716-4cb918ac0534 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:01:22.727054 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-029dd3ed-1751-4195-a716-4cb918ac0534 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:01:22.728442 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-029dd3ed-1751-4195-a716-4cb918ac0534 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:01:22.730170 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-029dd3ed-1751-4195-a716-4cb918ac0534 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:01:23.151730 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-029dd3ed-1751-4195-a716-4cb918ac0534 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f32f5fba1976432d938e664c7714e52b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b9d4c236b944f9b2e8e502a50a8f8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:01:23.162859 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-029dd3ed-1751-4195-a716-4cb918ac0534 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] 10.222.0.13 "GET /compute/v2.1/servers/1f499af7-1896-478c-b7d7-d922bf78bd98" status: 200 len: 1391 microversion: 2.1 time: 0.467310 Nov 01 19:01:23.167706 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1012/2011] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:01:22 2022] GET /compute/v2.1/servers/1f499af7-1896-478c-b7d7-d922bf78bd98 => generated 1391 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 19:01:23.179802 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-962abea0-73e3-4090-bae3-56de0f2dce1f tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:01:23.187236 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-962abea0-73e3-4090-bae3-56de0f2dce1f tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] [instance: 90b353ab-ef97-4d88-b5bc-b355ff576225] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:01:23.205909 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-962abea0-73e3-4090-bae3-56de0f2dce1f tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:01:23.209387 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-962abea0-73e3-4090-bae3-56de0f2dce1f tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:01:23.210148 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-962abea0-73e3-4090-bae3-56de0f2dce1f tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:01:23.211345 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-962abea0-73e3-4090-bae3-56de0f2dce1f tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:01:23.213425 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-962abea0-73e3-4090-bae3-56de0f2dce1f tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:01:23.215401 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-962abea0-73e3-4090-bae3-56de0f2dce1f tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:01:23.266466 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.objects.instance [None req-962abea0-73e3-4090-bae3-56de0f2dce1f tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lazy-loading 'flavor' on Instance uuid 90b353ab-ef97-4d88-b5bc-b355ff576225 {{(pid=121402) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 01 19:01:23.295576 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-f8ab833c-cc12-4315-b532-390ed2b73b3f tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:01:23.333883 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-f8ab833c-cc12-4315-b532-390ed2b73b3f tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:01:23.342558 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-f8ab833c-cc12-4315-b532-390ed2b73b3f tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:01:23.361574 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-f8ab833c-cc12-4315-b532-390ed2b73b3f tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] 10.222.0.13 "GET /compute/v2.1/servers/cd879708-f757-4f88-bc95-38b6cd55363c" status: 200 len: 1476 microversion: 2.25 time: 0.808601 Nov 01 19:01:23.386232 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1000/2012] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 19:01:22 2022] GET /compute/v2.1/servers/cd879708-f757-4f88-bc95-38b6cd55363c => generated 1476 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 01 19:01:23.392163 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-d9b7faeb-f627-489e-be20-e84897d152c6 tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] Calling method '.version_select at 0x7f0ae20f7820>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:01:23.716171 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-962abea0-73e3-4090-bae3-56de0f2dce1f tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] 10.222.0.13 "POST /compute/v2.1/servers/90b353ab-ef97-4d88-b5bc-b355ff576225/action" status: 200 len: 32 microversion: 2.1 time: 0.546842 Nov 01 19:01:23.718659 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1013/2013] 10.222.0.13 () {60 vars in 1278 bytes} [Tue Nov 1 19:01:23 2022] POST /compute/v2.1/servers/90b353ab-ef97-4d88-b5bc-b355ff576225/action => generated 32 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 01 19:01:24.065865 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-60f3ff1a-d5ea-41f8-a369-513ddd836ab1 tempest-LiveAutoBlockMigrationV225Test-1358532044 tempest-LiveAutoBlockMigrationV225Test-1358532044-project-admin] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:01:24.067083 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-60f3ff1a-d5ea-41f8-a369-513ddd836ab1 tempest-LiveAutoBlockMigrationV225Test-1358532044 tempest-LiveAutoBlockMigrationV225Test-1358532044-project-admin] [instance: cd879708-f757-4f88-bc95-38b6cd55363c] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:01:24.078941 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-60f3ff1a-d5ea-41f8-a369-513ddd836ab1 tempest-LiveAutoBlockMigrationV225Test-1358532044 tempest-LiveAutoBlockMigrationV225Test-1358532044-project-admin] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:01:24.081597 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-60f3ff1a-d5ea-41f8-a369-513ddd836ab1 tempest-LiveAutoBlockMigrationV225Test-1358532044 tempest-LiveAutoBlockMigrationV225Test-1358532044-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:01:24.082244 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-60f3ff1a-d5ea-41f8-a369-513ddd836ab1 tempest-LiveAutoBlockMigrationV225Test-1358532044 tempest-LiveAutoBlockMigrationV225Test-1358532044-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:01:24.082562 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-d9b7faeb-f627-489e-be20-e84897d152c6 tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] 10.222.0.13 "GET /compute/v2.1/images/52ccd7d5-4eba-4e0d-97f4-a4927c3504a7" status: 200 len: 1455 microversion: 2.1 time: 0.694100 Nov 01 19:01:24.083431 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1001/2014] 10.222.0.13 () {58 vars in 1233 bytes} [Tue Nov 1 19:01:23 2022] GET /compute/v2.1/images/52ccd7d5-4eba-4e0d-97f4-a4927c3504a7 => generated 1455 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:01:24.086255 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-60f3ff1a-d5ea-41f8-a369-513ddd836ab1 tempest-LiveAutoBlockMigrationV225Test-1358532044 tempest-LiveAutoBlockMigrationV225Test-1358532044-project-admin] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:01:24.089686 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-60f3ff1a-d5ea-41f8-a369-513ddd836ab1 tempest-LiveAutoBlockMigrationV225Test-1358532044 tempest-LiveAutoBlockMigrationV225Test-1358532044-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:01:24.090345 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-60f3ff1a-d5ea-41f8-a369-513ddd836ab1 tempest-LiveAutoBlockMigrationV225Test-1358532044 tempest-LiveAutoBlockMigrationV225Test-1358532044-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:01:24.094618 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-90c10931-0bd3-4306-b729-33f86c27fec9 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:01:24.100350 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-90c10931-0bd3-4306-b729-33f86c27fec9 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] [instance: 90b353ab-ef97-4d88-b5bc-b355ff576225] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:01:24.115177 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-90c10931-0bd3-4306-b729-33f86c27fec9 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:01:24.119322 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-90c10931-0bd3-4306-b729-33f86c27fec9 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:01:24.119782 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-90c10931-0bd3-4306-b729-33f86c27fec9 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:01:24.120532 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-90c10931-0bd3-4306-b729-33f86c27fec9 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:01:24.124001 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-90c10931-0bd3-4306-b729-33f86c27fec9 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:01:24.124831 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-90c10931-0bd3-4306-b729-33f86c27fec9 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:01:24.651221 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-90c10931-0bd3-4306-b729-33f86c27fec9 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a63d69c99a546f0af16329cff3ca717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a1bb191cff948e99c008b5e861ce4a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:01:24.677793 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-90c10931-0bd3-4306-b729-33f86c27fec9 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] 10.222.0.13 "GET /compute/v2.1/servers/90b353ab-ef97-4d88-b5bc-b355ff576225" status: 200 len: 1736 microversion: 2.1 time: 0.591821 Nov 01 19:01:24.682185 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1002/2015] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:01:24 2022] GET /compute/v2.1/servers/90b353ab-ef97-4d88-b5bc-b355ff576225 => generated 1736 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:01:24.702746 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-8fe1cd2c-9463-405d-afa7-fdfeb420cd2d tempest-FlavorsV2NegativeTest-1375055051 tempest-FlavorsV2NegativeTest-1375055051-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FlavorsV2NegativeTest-server-1512762141", "imageRef": "11a0d178-e9d0-45a1-8a4e-38a79639ab30", "flavorRef": "452"}} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:01:24.762366 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.objects.instance [None req-60f3ff1a-d5ea-41f8-a369-513ddd836ab1 tempest-LiveAutoBlockMigrationV225Test-1358532044 tempest-LiveAutoBlockMigrationV225Test-1358532044-project-admin] Lazy-loading 'services' on Instance uuid cd879708-f757-4f88-bc95-38b6cd55363c {{(pid=121402) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 01 19:01:24.825271 n-d-863052-2 devstack@n-api.service[121402]: DEBUG dbcounter [-] [121402] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 19:01:24.844511 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-60f3ff1a-d5ea-41f8-a369-513ddd836ab1 tempest-LiveAutoBlockMigrationV225Test-1358532044 tempest-LiveAutoBlockMigrationV225Test-1358532044-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/cd879708-f757-4f88-bc95-38b6cd55363c" status: 200 len: 1969 microversion: 2.25 time: 1.116884 Nov 01 19:01:24.854965 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.network.neutron [None req-8fe1cd2c-9463-405d-afa7-fdfeb420cd2d tempest-FlavorsV2NegativeTest-1375055051 tempest-FlavorsV2NegativeTest-1375055051-project] validate_networks() for None {{(pid=121403) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 01 19:01:24.856428 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1014/2016] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 19:01:23 2022] GET /compute/v2.1/servers/cd879708-f757-4f88-bc95-38b6cd55363c => generated 1969 bytes in 1137 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 19:01:24.878470 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-8114d87e-1f9b-47d2-abff-0431005f98c3 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:01:24.881993 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-8114d87e-1f9b-47d2-abff-0431005f98c3 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] [instance: 1f499af7-1896-478c-b7d7-d922bf78bd98] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:01:24.899852 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-8114d87e-1f9b-47d2-abff-0431005f98c3 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:01:24.903894 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-8114d87e-1f9b-47d2-abff-0431005f98c3 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:01:24.904575 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-8114d87e-1f9b-47d2-abff-0431005f98c3 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:01:24.905781 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-8114d87e-1f9b-47d2-abff-0431005f98c3 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:01:24.908450 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-8114d87e-1f9b-47d2-abff-0431005f98c3 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:01:24.909137 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-8114d87e-1f9b-47d2-abff-0431005f98c3 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:01:25.455247 n-d-863052-2 devstack@n-api.service[121403]: DEBUG dbcounter [-] [121403] Writing DB stats nova_cell0:SELECT=4 {{(pid=121403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 19:01:25.482256 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-8114d87e-1f9b-47d2-abff-0431005f98c3 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f32f5fba1976432d938e664c7714e52b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b9d4c236b944f9b2e8e502a50a8f8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:01:25.490315 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-8114d87e-1f9b-47d2-abff-0431005f98c3 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] 10.222.0.13 "GET /compute/v2.1/servers/1f499af7-1896-478c-b7d7-d922bf78bd98" status: 200 len: 1391 microversion: 2.1 time: 0.632692 Nov 01 19:01:25.504314 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1015/2017] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:01:24 2022] GET /compute/v2.1/servers/1f499af7-1896-478c-b7d7-d922bf78bd98 => generated 1391 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:01:25.510214 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-d44b66d1-0d34-4457-a724-892b30179412 tempest-LiveAutoBlockMigrationV225Test-1358532044 tempest-LiveAutoBlockMigrationV225Test-1358532044-project-admin] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:01:25.511099 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-d44b66d1-0d34-4457-a724-892b30179412 tempest-LiveAutoBlockMigrationV225Test-1358532044 tempest-LiveAutoBlockMigrationV225Test-1358532044-project-admin] [instance: cd879708-f757-4f88-bc95-38b6cd55363c] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:01:25.521785 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-d44b66d1-0d34-4457-a724-892b30179412 tempest-LiveAutoBlockMigrationV225Test-1358532044 tempest-LiveAutoBlockMigrationV225Test-1358532044-project-admin] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:01:25.526704 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-d44b66d1-0d34-4457-a724-892b30179412 tempest-LiveAutoBlockMigrationV225Test-1358532044 tempest-LiveAutoBlockMigrationV225Test-1358532044-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:01:25.527373 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-d44b66d1-0d34-4457-a724-892b30179412 tempest-LiveAutoBlockMigrationV225Test-1358532044 tempest-LiveAutoBlockMigrationV225Test-1358532044-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:01:25.528198 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-d44b66d1-0d34-4457-a724-892b30179412 tempest-LiveAutoBlockMigrationV225Test-1358532044 tempest-LiveAutoBlockMigrationV225Test-1358532044-project-admin] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:01:25.528801 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-d44b66d1-0d34-4457-a724-892b30179412 tempest-LiveAutoBlockMigrationV225Test-1358532044 tempest-LiveAutoBlockMigrationV225Test-1358532044-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:01:25.529341 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-d44b66d1-0d34-4457-a724-892b30179412 tempest-LiveAutoBlockMigrationV225Test-1358532044 tempest-LiveAutoBlockMigrationV225Test-1358532044-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:01:25.787791 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.wsgi [None req-8fe1cd2c-9463-405d-afa7-fdfeb420cd2d tempest-FlavorsV2NegativeTest-1375055051 tempest-FlavorsV2NegativeTest-1375055051-project] HTTP exception thrown: Flavor's memory is too small for requested image. Nov 01 19:01:25.792969 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-8fe1cd2c-9463-405d-afa7-fdfeb420cd2d tempest-FlavorsV2NegativeTest-1375055051 tempest-FlavorsV2NegativeTest-1375055051-project] Request method failure captured: Nov 01 19:01:25.792969 n-d-863052-2 devstack@n-api.service[121403]: request: POST /compute/v2.1/servers HTTP/1.1 Nov 01 19:01:25.792969 n-d-863052-2 devstack@n-api.service[121403]: Accept: application/json Nov 01 19:01:25.792969 n-d-863052-2 devstack@n-api.service[121403]: Accept-Encoding: identity Nov 01 19:01:25.792969 n-d-863052-2 devstack@n-api.service[121403]: Connection: close Nov 01 19:01:25.792969 n-d-863052-2 devstack@n-api.service[121403]: Content-Length: 143 Nov 01 19:01:25.792969 n-d-863052-2 devstack@n-api.service[121403]: Content-Type: application/json Nov 01 19:01:25.792969 n-d-863052-2 devstack@n-api.service[121403]: Host: 10.222.0.13 Nov 01 19:01:25.792969 n-d-863052-2 devstack@n-api.service[121403]: Openstack-System-Scope: None Nov 01 19:01:25.792969 n-d-863052-2 devstack@n-api.service[121403]: User-Agent: python-urllib3/1.26.12 Nov 01 19:01:25.792969 n-d-863052-2 devstack@n-api.service[121403]: X-Auth-Token: gAAAAABjYW0CbztnrdJ_KSoNfTV7XYGBE4A8MMEyzs9tsnkWi2SsK866JJsmnIQAs7G7IeOY5ovtbF3CFOSuV4ZhdSlQqVdo5GT1DPhJXqWYMCivqwLEfsWwqo9R-U_sG8Dmz_2ANXi82oegl6DThytSY-tNIepBB6hiYrhCOvsI3JyXC6OEvrs Nov 01 19:01:25.792969 n-d-863052-2 devstack@n-api.service[121403]: X-Domain-Id: None Nov 01 19:01:25.792969 n-d-863052-2 devstack@n-api.service[121403]: X-Domain-Name: None Nov 01 19:01:25.792969 n-d-863052-2 devstack@n-api.service[121403]: X-Identity-Status: Confirmed Nov 01 19:01:25.792969 n-d-863052-2 devstack@n-api.service[121403]: X-Is-Admin-Project: True Nov 01 19:01:25.792969 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Domain-Id: default Nov 01 19:01:25.792969 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Domain-Name: Default Nov 01 19:01:25.792969 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Id: 099d056b96554ec7b277fbe3b389b658 Nov 01 19:01:25.792969 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Name: tempest-FlavorsV2NegativeTest-1375055051 Nov 01 19:01:25.792969 n-d-863052-2 devstack@n-api.service[121403]: X-Role: member,reader Nov 01 19:01:25.792969 n-d-863052-2 devstack@n-api.service[121403]: X-Roles: member,reader Nov 01 19:01:25.794968 n-d-863052-2 devstack@n-api.service[121403]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/099d056b96554ec7b277fbe3b389b658"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/099d056b96554ec7b277fbe3b389b658"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_099d056b96554ec7b277fbe3b389b658", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/099d056b96554ec7b277fbe3b389b658"}]}] Nov 01 19:01:25.794968 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant: tempest-FlavorsV2NegativeTest-1375055051 Nov 01 19:01:25.794968 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant-Id: 099d056b96554ec7b277fbe3b389b658 Nov 01 19:01:25.794968 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant-Name: tempest-FlavorsV2NegativeTest-1375055051 Nov 01 19:01:25.794968 n-d-863052-2 devstack@n-api.service[121403]: X-User: tempest-FlavorsV2NegativeTest-1375055051-project Nov 01 19:01:25.794968 n-d-863052-2 devstack@n-api.service[121403]: X-User-Domain-Id: default Nov 01 19:01:25.794968 n-d-863052-2 devstack@n-api.service[121403]: X-User-Domain-Name: Default Nov 01 19:01:25.794968 n-d-863052-2 devstack@n-api.service[121403]: X-User-Id: d536b45f2cf0447bbcd9f68e9faa1616 Nov 01 19:01:25.794968 n-d-863052-2 devstack@n-api.service[121403]: X-User-Name: tempest-FlavorsV2NegativeTest-1375055051-project Nov 01 19:01:25.794968 n-d-863052-2 devstack@n-api.service[121403]: Nov 01 19:01:25.794968 n-d-863052-2 devstack@n-api.service[121403]: {"server": {"name": "tempest-FlavorsV2NegativeTest-server-1512762141", "imageRef": "11a0d178-e9d0-45a1-8a4e-38a79639ab30", "flavorRef": "452"}} Nov 01 19:01:25.794968 n-d-863052-2 devstack@n-api.service[121403]: method: > Nov 01 19:01:25.796057 n-d-863052-2 devstack@n-api.service[121403]: exception: Flavor's memory is too small for requested image. Nov 01 19:01:25.796057 n-d-863052-2 devstack@n-api.service[121403]: action_args: {'body': {'server': {'name': 'tempest-FlavorsV2NegativeTest-server-1512762141', 'imageRef': '11a0d178-e9d0-45a1-8a4e-38a79639ab30', 'flavorRef': '452'}}} Nov 01 19:01:25.796057 n-d-863052-2 devstack@n-api.service[121403]: {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 01 19:01:25.796057 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:01:25.796057 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Nov 01 19:01:25.796057 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Nov 01 19:01:25.796057 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Nov 01 19:01:25.796057 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return self._create_instance( Nov 01 19:01:25.796057 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1724, in _create_instance Nov 01 19:01:25.796057 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi self._checks_for_create_and_rebuild(context, image_id, boot_meta, Nov 01 19:01:25.796057 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1019, in _checks_for_create_and_rebuild Nov 01 19:01:25.796057 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi self._validate_flavor_image(context, image_id, image, Nov 01 19:01:25.796057 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 683, in _validate_flavor_image Nov 01 19:01:25.796057 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi self._validate_flavor_image_nostatus( Nov 01 19:01:25.796057 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 751, in _validate_flavor_image_nostatus Nov 01 19:01:25.796057 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise exception.FlavorMemoryTooSmall() Nov 01 19:01:25.796057 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi nova.exception.FlavorMemoryTooSmall: Flavor's memory is too small for requested image. Nov 01 19:01:25.796057 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:01:25.796057 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:01:25.796057 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:01:25.797943 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:01:25.797943 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:01:25.797943 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:01:25.797943 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 01 19:01:25.797943 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 01 19:01:25.797943 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 01 19:01:25.797943 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 01 19:01:25.797943 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 01 19:01:25.797943 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 01 19:01:25.797943 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 01 19:01:25.797943 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 01 19:01:25.797943 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 01 19:01:25.797943 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 01 19:01:25.797943 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Nov 01 19:01:25.797943 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 868, in create Nov 01 19:01:25.797943 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Nov 01 19:01:25.797943 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor's memory is too small for requested image. Nov 01 19:01:25.797943 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:01:25.797943 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:01:25.797943 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:01:25.797943 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:01:25.799905 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:01:25.799905 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:01:25.799905 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 01 19:01:25.799905 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 01 19:01:25.799905 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor's memory is too small for requested image. Nov 01 19:01:25.799905 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:01:25.799905 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-8fe1cd2c-9463-405d-afa7-fdfeb420cd2d tempest-FlavorsV2NegativeTest-1375055051 tempest-FlavorsV2NegativeTest-1375055051-project] Returning 400 to user: Flavor's memory is too small for requested image. {{(pid=121403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 01 19:01:25.799905 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-8fe1cd2c-9463-405d-afa7-fdfeb420cd2d tempest-FlavorsV2NegativeTest-1375055051 tempest-FlavorsV2NegativeTest-1375055051-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 400 len: 93 microversion: 2.1 time: 1.111346 Nov 01 19:01:25.799905 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1003/2018] 10.222.0.13 () {60 vars in 1147 bytes} [Tue Nov 1 19:01:24 2022] POST /compute/v2.1/servers => generated 93 bytes in 1112 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Nov 01 19:01:25.816103 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-c2afb89a-4a47-44bd-86b2-9cc0591be4f4 tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] Calling method '.version_select at 0x7f0ae6713f70>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:01:25.825869 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.objects.instance [None req-d44b66d1-0d34-4457-a724-892b30179412 tempest-LiveAutoBlockMigrationV225Test-1358532044 tempest-LiveAutoBlockMigrationV225Test-1358532044-project-admin] Lazy-loading 'services' on Instance uuid cd879708-f757-4f88-bc95-38b6cd55363c {{(pid=121402) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 01 19:01:25.879727 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-d44b66d1-0d34-4457-a724-892b30179412 tempest-LiveAutoBlockMigrationV225Test-1358532044 tempest-LiveAutoBlockMigrationV225Test-1358532044-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/cd879708-f757-4f88-bc95-38b6cd55363c" status: 200 len: 1969 microversion: 2.25 time: 0.362742 Nov 01 19:01:25.882075 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1016/2019] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 19:01:25 2022] GET /compute/v2.1/servers/cd879708-f757-4f88-bc95-38b6cd55363c => generated 1969 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 19:01:25.918974 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-5d0d7224-4c78-4624-be5c-128de8f589bf tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:01:25.924311 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-5d0d7224-4c78-4624-be5c-128de8f589bf tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] [instance: 90b353ab-ef97-4d88-b5bc-b355ff576225] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:01:25.945903 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-5d0d7224-4c78-4624-be5c-128de8f589bf tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:01:25.952224 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-5d0d7224-4c78-4624-be5c-128de8f589bf tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:01:25.958837 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-5d0d7224-4c78-4624-be5c-128de8f589bf tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:01:25.960970 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-5d0d7224-4c78-4624-be5c-128de8f589bf tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:01:25.964923 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-5d0d7224-4c78-4624-be5c-128de8f589bf tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:01:25.967380 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-5d0d7224-4c78-4624-be5c-128de8f589bf tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:01:26.413789 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-5d0d7224-4c78-4624-be5c-128de8f589bf tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a63d69c99a546f0af16329cff3ca717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a1bb191cff948e99c008b5e861ce4a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:01:26.439304 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-5d0d7224-4c78-4624-be5c-128de8f589bf tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] 10.222.0.13 "GET /compute/v2.1/servers/90b353ab-ef97-4d88-b5bc-b355ff576225" status: 200 len: 1736 microversion: 2.1 time: 0.534448 Nov 01 19:01:26.440218 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1017/2020] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:01:25 2022] GET /compute/v2.1/servers/90b353ab-ef97-4d88-b5bc-b355ff576225 => generated 1736 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:01:26.461728 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-bc645cbb-105c-4eec-ae1d-0676ed441d45 tempest-LiveAutoBlockMigrationV225Test-1358532044 tempest-LiveAutoBlockMigrationV225Test-1358532044-project-admin] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:01:26.472257 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-bc645cbb-105c-4eec-ae1d-0676ed441d45 tempest-LiveAutoBlockMigrationV225Test-1358532044 tempest-LiveAutoBlockMigrationV225Test-1358532044-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:01:26.472890 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-bc645cbb-105c-4eec-ae1d-0676ed441d45 tempest-LiveAutoBlockMigrationV225Test-1358532044 tempest-LiveAutoBlockMigrationV225Test-1358532044-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:01:26.473448 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-bc645cbb-105c-4eec-ae1d-0676ed441d45 tempest-LiveAutoBlockMigrationV225Test-1358532044 tempest-LiveAutoBlockMigrationV225Test-1358532044-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:01:26.489816 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-bc645cbb-105c-4eec-ae1d-0676ed441d45 tempest-LiveAutoBlockMigrationV225Test-1358532044 tempest-LiveAutoBlockMigrationV225Test-1358532044-project-admin] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:01:26.490307 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-bc645cbb-105c-4eec-ae1d-0676ed441d45 tempest-LiveAutoBlockMigrationV225Test-1358532044 tempest-LiveAutoBlockMigrationV225Test-1358532044-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:01:26.490744 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-bc645cbb-105c-4eec-ae1d-0676ed441d45 tempest-LiveAutoBlockMigrationV225Test-1358532044 tempest-LiveAutoBlockMigrationV225Test-1358532044-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:01:26.573516 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-bc645cbb-105c-4eec-ae1d-0676ed441d45 tempest-LiveAutoBlockMigrationV225Test-1358532044 tempest-LiveAutoBlockMigrationV225Test-1358532044-project-admin] 10.222.0.13 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.123294 Nov 01 19:01:26.574696 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1018/2021] 10.222.0.13 () {60 vars in 1217 bytes} [Tue Nov 1 19:01:26 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 01 19:01:26.585515 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-4744a20d-0a26-407c-9615-245a621bf407 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:01:26.589828 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-4744a20d-0a26-407c-9615-245a621bf407 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] [instance: 1f499af7-1896-478c-b7d7-d922bf78bd98] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:01:26.605670 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-4744a20d-0a26-407c-9615-245a621bf407 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:01:26.606680 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-4744a20d-0a26-407c-9615-245a621bf407 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:01:26.607706 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-4744a20d-0a26-407c-9615-245a621bf407 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:01:26.611425 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-4744a20d-0a26-407c-9615-245a621bf407 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:01:26.614491 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-4744a20d-0a26-407c-9615-245a621bf407 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:01:26.615320 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-4744a20d-0a26-407c-9615-245a621bf407 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:01:26.938539 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-c2afb89a-4a47-44bd-86b2-9cc0591be4f4 tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] 10.222.0.13 "GET /compute/v2.1/images/52ccd7d5-4eba-4e0d-97f4-a4927c3504a7" status: 200 len: 1455 microversion: 2.1 time: 1.130599 Nov 01 19:01:26.940241 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1004/2022] 10.222.0.13 () {58 vars in 1233 bytes} [Tue Nov 1 19:01:25 2022] GET /compute/v2.1/images/52ccd7d5-4eba-4e0d-97f4-a4927c3504a7 => generated 1455 bytes in 1144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:01:26.959845 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-c095c94a-17ad-4f85-af02-b5a43b6d900e tempest-LiveAutoBlockMigrationV225Test-1358532044 tempest-LiveAutoBlockMigrationV225Test-1358532044-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-863052-2", "block_migration": "auto"}} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:01:26.976812 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-c095c94a-17ad-4f85-af02-b5a43b6d900e tempest-LiveAutoBlockMigrationV225Test-1358532044 tempest-LiveAutoBlockMigrationV225Test-1358532044-project-admin] [instance: cd879708-f757-4f88-bc95-38b6cd55363c] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:01:26.989509 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-c095c94a-17ad-4f85-af02-b5a43b6d900e tempest-LiveAutoBlockMigrationV225Test-1358532044 tempest-LiveAutoBlockMigrationV225Test-1358532044-project-admin] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:01:26.989999 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-c095c94a-17ad-4f85-af02-b5a43b6d900e tempest-LiveAutoBlockMigrationV225Test-1358532044 tempest-LiveAutoBlockMigrationV225Test-1358532044-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:01:26.993409 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-c095c94a-17ad-4f85-af02-b5a43b6d900e tempest-LiveAutoBlockMigrationV225Test-1358532044 tempest-LiveAutoBlockMigrationV225Test-1358532044-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:01:26.995989 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-c095c94a-17ad-4f85-af02-b5a43b6d900e tempest-LiveAutoBlockMigrationV225Test-1358532044 tempest-LiveAutoBlockMigrationV225Test-1358532044-project-admin] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:01:26.998382 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-c095c94a-17ad-4f85-af02-b5a43b6d900e tempest-LiveAutoBlockMigrationV225Test-1358532044 tempest-LiveAutoBlockMigrationV225Test-1358532044-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:01:26.999364 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-c095c94a-17ad-4f85-af02-b5a43b6d900e tempest-LiveAutoBlockMigrationV225Test-1358532044 tempest-LiveAutoBlockMigrationV225Test-1358532044-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:01:27.071892 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.objects.instance [None req-c095c94a-17ad-4f85-af02-b5a43b6d900e tempest-LiveAutoBlockMigrationV225Test-1358532044 tempest-LiveAutoBlockMigrationV225Test-1358532044-project-admin] Lazy-loading 'flavor' on Instance uuid cd879708-f757-4f88-bc95-38b6cd55363c {{(pid=121403) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 01 19:01:27.138892 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-c095c94a-17ad-4f85-af02-b5a43b6d900e tempest-LiveAutoBlockMigrationV225Test-1358532044 tempest-LiveAutoBlockMigrationV225Test-1358532044-project-admin] [instance: cd879708-f757-4f88-bc95-38b6cd55363c] Going to try to live migrate instance to n-h1-863052-2 {{(pid=121403) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Nov 01 19:01:27.570599 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-4744a20d-0a26-407c-9615-245a621bf407 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f32f5fba1976432d938e664c7714e52b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b9d4c236b944f9b2e8e502a50a8f8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:01:27.581104 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-4744a20d-0a26-407c-9615-245a621bf407 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] 10.222.0.13 "GET /compute/v2.1/servers/1f499af7-1896-478c-b7d7-d922bf78bd98" status: 200 len: 1391 microversion: 2.1 time: 1.004851 Nov 01 19:01:27.595682 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1019/2023] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:01:26 2022] GET /compute/v2.1/servers/1f499af7-1896-478c-b7d7-d922bf78bd98 => generated 1391 bytes in 1020 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:01:27.620173 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-8e5f3e08-a390-454a-b6a7-90ea5751e6ff tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:01:27.621202 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-8e5f3e08-a390-454a-b6a7-90ea5751e6ff tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] [instance: 90b353ab-ef97-4d88-b5bc-b355ff576225] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:01:27.651575 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-8e5f3e08-a390-454a-b6a7-90ea5751e6ff tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:01:27.656093 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-8e5f3e08-a390-454a-b6a7-90ea5751e6ff tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:01:27.658650 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-8e5f3e08-a390-454a-b6a7-90ea5751e6ff tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:01:27.665503 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-8e5f3e08-a390-454a-b6a7-90ea5751e6ff tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:01:27.669100 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-8e5f3e08-a390-454a-b6a7-90ea5751e6ff tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:01:27.674134 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-8e5f3e08-a390-454a-b6a7-90ea5751e6ff tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:01:27.754420 n-d-863052-2 devstack@n-api.service[121403]: DEBUG dbcounter [-] [121403] Writing DB stats nova_cell0:SELECT=26,nova_cell0:UPDATE=2 {{(pid=121403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 19:01:28.667955 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-8e5f3e08-a390-454a-b6a7-90ea5751e6ff tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a63d69c99a546f0af16329cff3ca717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a1bb191cff948e99c008b5e861ce4a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:01:28.690949 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-8e5f3e08-a390-454a-b6a7-90ea5751e6ff tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] 10.222.0.13 "GET /compute/v2.1/servers/90b353ab-ef97-4d88-b5bc-b355ff576225" status: 200 len: 1736 microversion: 2.1 time: 1.093235 Nov 01 19:01:28.698077 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1020/2024] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:01:27 2022] GET /compute/v2.1/servers/90b353ab-ef97-4d88-b5bc-b355ff576225 => generated 1736 bytes in 1101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:01:28.721870 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-20da562a-a18b-4e65-b335-ff186f5439ce tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] Calling method '.version_select at 0x7f0ae1d5b940>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:01:30.867329 n-d-863052-2 devstack@n-api.service[121402]: DEBUG dbcounter [-] [121402] Writing DB stats nova_cell0:SELECT=16 {{(pid=121402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 19:01:31.981517 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-c095c94a-17ad-4f85-af02-b5a43b6d900e tempest-LiveAutoBlockMigrationV225Test-1358532044 tempest-LiveAutoBlockMigrationV225Test-1358532044-project-admin] 10.222.0.13 "POST /compute/v2.1/servers/cd879708-f757-4f88-bc95-38b6cd55363c/action" status: 202 len: 0 microversion: 2.25 time: 5.039249 Nov 01 19:01:31.991734 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1005/2025] 10.222.0.13 () {62 vars in 1319 bytes} [Tue Nov 1 19:01:26 2022] POST /compute/v2.1/servers/cd879708-f757-4f88-bc95-38b6cd55363c/action => generated 0 bytes in 5051 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 01 19:01:31.999225 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-d8a3be73-3340-485d-9977-6bd384471333 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:01:32.001460 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-d8a3be73-3340-485d-9977-6bd384471333 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] [instance: 1f499af7-1896-478c-b7d7-d922bf78bd98] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:01:32.020718 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d8a3be73-3340-485d-9977-6bd384471333 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:01:32.022172 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d8a3be73-3340-485d-9977-6bd384471333 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:01:32.024959 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d8a3be73-3340-485d-9977-6bd384471333 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:01:32.026629 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d8a3be73-3340-485d-9977-6bd384471333 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:01:32.032015 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d8a3be73-3340-485d-9977-6bd384471333 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:01:32.033083 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d8a3be73-3340-485d-9977-6bd384471333 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:01:32.577803 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-d8a3be73-3340-485d-9977-6bd384471333 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f32f5fba1976432d938e664c7714e52b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b9d4c236b944f9b2e8e502a50a8f8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:01:32.591558 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-d8a3be73-3340-485d-9977-6bd384471333 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] 10.222.0.13 "GET /compute/v2.1/servers/1f499af7-1896-478c-b7d7-d922bf78bd98" status: 200 len: 1381 microversion: 2.1 time: 0.598488 Nov 01 19:01:32.614930 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1006/2026] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:01:31 2022] GET /compute/v2.1/servers/1f499af7-1896-478c-b7d7-d922bf78bd98 => generated 1381 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:01:32.622327 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-0ab1975d-d777-422b-baf0-2e2d5dfd050c tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:01:32.623317 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-0ab1975d-d777-422b-baf0-2e2d5dfd050c tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] [instance: 90b353ab-ef97-4d88-b5bc-b355ff576225] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:01:32.633621 n-d-863052-2 devstack@n-api.service[121403]: DEBUG dbcounter [-] [121403] Writing DB stats nova_api:UPDATE=7,nova_api:SELECT=92,nova_api:INSERT=1 {{(pid=121403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 19:01:32.635752 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-0ab1975d-d777-422b-baf0-2e2d5dfd050c tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:01:32.636555 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-0ab1975d-d777-422b-baf0-2e2d5dfd050c tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:01:32.637408 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-0ab1975d-d777-422b-baf0-2e2d5dfd050c tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:01:32.638301 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-0ab1975d-d777-422b-baf0-2e2d5dfd050c tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:01:32.639118 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-0ab1975d-d777-422b-baf0-2e2d5dfd050c tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:01:32.640675 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-0ab1975d-d777-422b-baf0-2e2d5dfd050c tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:01:32.950534 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-0ab1975d-d777-422b-baf0-2e2d5dfd050c tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a63d69c99a546f0af16329cff3ca717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a1bb191cff948e99c008b5e861ce4a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:01:32.960912 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-0ab1975d-d777-422b-baf0-2e2d5dfd050c tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] 10.222.0.13 "GET /compute/v2.1/servers/90b353ab-ef97-4d88-b5bc-b355ff576225" status: 200 len: 1736 microversion: 2.1 time: 0.344448 Nov 01 19:01:32.962354 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1007/2027] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:01:32 2022] GET /compute/v2.1/servers/90b353ab-ef97-4d88-b5bc-b355ff576225 => generated 1736 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:01:32.969529 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-2234d9b7-00bb-4d0b-9e06-b671b66014ed tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:01:32.970410 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-2234d9b7-00bb-4d0b-9e06-b671b66014ed tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] [instance: cd879708-f757-4f88-bc95-38b6cd55363c] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:01:32.983416 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-2234d9b7-00bb-4d0b-9e06-b671b66014ed tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:01:32.985683 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-2234d9b7-00bb-4d0b-9e06-b671b66014ed tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:01:32.986562 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-2234d9b7-00bb-4d0b-9e06-b671b66014ed tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:01:32.987483 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-2234d9b7-00bb-4d0b-9e06-b671b66014ed tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:01:32.988114 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-2234d9b7-00bb-4d0b-9e06-b671b66014ed tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:01:32.988878 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-2234d9b7-00bb-4d0b-9e06-b671b66014ed tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:01:33.205066 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-2234d9b7-00bb-4d0b-9e06-b671b66014ed tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:01:33.217305 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-2234d9b7-00bb-4d0b-9e06-b671b66014ed tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:01:33.218898 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-2234d9b7-00bb-4d0b-9e06-b671b66014ed tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:01:33.222269 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-2234d9b7-00bb-4d0b-9e06-b671b66014ed tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] 10.222.0.13 "GET /compute/v2.1/servers/cd879708-f757-4f88-bc95-38b6cd55363c" status: 200 len: 1486 microversion: 2.25 time: 0.258631 Nov 01 19:01:33.233120 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1008/2028] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 19:01:32 2022] GET /compute/v2.1/servers/cd879708-f757-4f88-bc95-38b6cd55363c => generated 1486 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 19:01:33.262132 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-3006d0e7-51df-4ac7-a437-a99cddd991bc tempest-LiveMigrationTest-1695240876 tempest-LiveMigrationTest-1695240876-project-admin] Calling method '.version_select at 0x7f0ae210e550>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:01:33.277854 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-3006d0e7-51df-4ac7-a437-a99cddd991bc tempest-LiveMigrationTest-1695240876 tempest-LiveMigrationTest-1695240876-project-admin] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:01:33.278611 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-3006d0e7-51df-4ac7-a437-a99cddd991bc tempest-LiveMigrationTest-1695240876 tempest-LiveMigrationTest-1695240876-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:01:33.279749 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-3006d0e7-51df-4ac7-a437-a99cddd991bc tempest-LiveMigrationTest-1695240876 tempest-LiveMigrationTest-1695240876-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:01:33.302377 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-3006d0e7-51df-4ac7-a437-a99cddd991bc tempest-LiveMigrationTest-1695240876 tempest-LiveMigrationTest-1695240876-project-admin] 10.222.0.13 "GET /compute/v2.1/os-migrations" status: 200 len: 3087 microversion: 2.1 time: 0.067365 Nov 01 19:01:33.303042 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1009/2029] 10.222.0.13 () {58 vars in 1143 bytes} [Tue Nov 1 19:01:33 2022] GET /compute/v2.1/os-migrations => generated 3087 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:01:33.575648 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-01b86d61-466d-4fb9-975e-03f32758fa28 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-1716356106", "imageRef": "2d4a0047-1b9e-445f-8af8-1b5c9d93e881", "flavorRef": "452"}} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:01:36.082851 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-20da562a-a18b-4e65-b335-ff186f5439ce tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] 10.222.0.13 "GET /compute/v2.1/images/52ccd7d5-4eba-4e0d-97f4-a4927c3504a7" status: 200 len: 1464 microversion: 2.1 time: 7.383082 Nov 01 19:01:36.093174 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1021/2030] 10.222.0.13 () {58 vars in 1233 bytes} [Tue Nov 1 19:01:28 2022] GET /compute/v2.1/images/52ccd7d5-4eba-4e0d-97f4-a4927c3504a7 => generated 1464 bytes in 7384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:01:36.093174 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-bcc24156-989b-41db-932e-82a98f4ea309 tempest-LiveMigrationTest-1695240876 tempest-LiveMigrationTest-1695240876-project-admin] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:01:36.093174 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-bcc24156-989b-41db-932e-82a98f4ea309 tempest-LiveMigrationTest-1695240876 tempest-LiveMigrationTest-1695240876-project-admin] [instance: 1f499af7-1896-478c-b7d7-d922bf78bd98] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:01:36.109768 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-bcc24156-989b-41db-932e-82a98f4ea309 tempest-LiveMigrationTest-1695240876 tempest-LiveMigrationTest-1695240876-project-admin] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:01:36.110351 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-bcc24156-989b-41db-932e-82a98f4ea309 tempest-LiveMigrationTest-1695240876 tempest-LiveMigrationTest-1695240876-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:01:36.111043 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-bcc24156-989b-41db-932e-82a98f4ea309 tempest-LiveMigrationTest-1695240876 tempest-LiveMigrationTest-1695240876-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:01:36.111771 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-bcc24156-989b-41db-932e-82a98f4ea309 tempest-LiveMigrationTest-1695240876 tempest-LiveMigrationTest-1695240876-project-admin] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:01:36.112435 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-bcc24156-989b-41db-932e-82a98f4ea309 tempest-LiveMigrationTest-1695240876 tempest-LiveMigrationTest-1695240876-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:01:36.114633 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-bcc24156-989b-41db-932e-82a98f4ea309 tempest-LiveMigrationTest-1695240876 tempest-LiveMigrationTest-1695240876-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:01:36.324066 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-bcc24156-989b-41db-932e-82a98f4ea309 tempest-LiveMigrationTest-1695240876 tempest-LiveMigrationTest-1695240876-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/1f499af7-1896-478c-b7d7-d922bf78bd98" status: 200 len: 1532 microversion: 2.1 time: 0.238457 Nov 01 19:01:36.324681 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1022/2031] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:01:36 2022] GET /compute/v2.1/servers/1f499af7-1896-478c-b7d7-d922bf78bd98 => generated 1532 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:01:36.340478 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-bc224a19-e063-492c-a353-c31cffca594a tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:01:36.343033 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-bc224a19-e063-492c-a353-c31cffca594a tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] [instance: 90b353ab-ef97-4d88-b5bc-b355ff576225] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:01:36.366352 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-bc224a19-e063-492c-a353-c31cffca594a tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:01:36.367294 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-bc224a19-e063-492c-a353-c31cffca594a tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:01:36.368407 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-bc224a19-e063-492c-a353-c31cffca594a tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:01:36.369437 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-bc224a19-e063-492c-a353-c31cffca594a tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:01:36.370160 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-bc224a19-e063-492c-a353-c31cffca594a tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:01:36.370814 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-bc224a19-e063-492c-a353-c31cffca594a tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:01:36.527764 n-d-863052-2 devstack@n-api.service[121402]: DEBUG dbcounter [-] [121402] Writing DB stats nova_cell0:SELECT=7 {{(pid=121402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 19:01:36.588433 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-bc224a19-e063-492c-a353-c31cffca594a tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a63d69c99a546f0af16329cff3ca717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a1bb191cff948e99c008b5e861ce4a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:01:36.597587 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-bc224a19-e063-492c-a353-c31cffca594a tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] 10.222.0.13 "GET /compute/v2.1/servers/90b353ab-ef97-4d88-b5bc-b355ff576225" status: 200 len: 1736 microversion: 2.1 time: 0.271877 Nov 01 19:01:36.602261 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1023/2032] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:01:36 2022] GET /compute/v2.1/servers/90b353ab-ef97-4d88-b5bc-b355ff576225 => generated 1736 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:01:36.608756 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-ab9a5aea-1b6b-43e8-aeaa-185d9cf46378 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:01:36.611037 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-ab9a5aea-1b6b-43e8-aeaa-185d9cf46378 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] [instance: cd879708-f757-4f88-bc95-38b6cd55363c] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:01:36.631594 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-ab9a5aea-1b6b-43e8-aeaa-185d9cf46378 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:01:36.632208 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-ab9a5aea-1b6b-43e8-aeaa-185d9cf46378 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:01:36.632853 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-ab9a5aea-1b6b-43e8-aeaa-185d9cf46378 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:01:36.634527 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-ab9a5aea-1b6b-43e8-aeaa-185d9cf46378 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:01:36.635870 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-ab9a5aea-1b6b-43e8-aeaa-185d9cf46378 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:01:36.636576 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-ab9a5aea-1b6b-43e8-aeaa-185d9cf46378 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:01:36.708562 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.network.neutron [None req-01b86d61-466d-4fb9-975e-03f32758fa28 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] validate_networks() for None {{(pid=121403) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 01 19:01:36.917080 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-ab9a5aea-1b6b-43e8-aeaa-185d9cf46378 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:01:36.935715 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-ab9a5aea-1b6b-43e8-aeaa-185d9cf46378 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:01:36.938332 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-ab9a5aea-1b6b-43e8-aeaa-185d9cf46378 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:01:36.939873 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-ab9a5aea-1b6b-43e8-aeaa-185d9cf46378 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] 10.222.0.13 "GET /compute/v2.1/servers/cd879708-f757-4f88-bc95-38b6cd55363c" status: 200 len: 1486 microversion: 2.25 time: 0.336578 Nov 01 19:01:36.940673 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1024/2033] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 19:01:36 2022] GET /compute/v2.1/servers/cd879708-f757-4f88-bc95-38b6cd55363c => generated 1486 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 19:01:36.957681 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-d5812c16-39b7-4070-a02b-98261afd773a tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] Calling method '.version_select at 0x7f0ae2b3ba60>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:01:37.046516 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-d5812c16-39b7-4070-a02b-98261afd773a tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] 10.222.0.13 "GET /compute/v2.1/images/52ccd7d5-4eba-4e0d-97f4-a4927c3504a7" status: 200 len: 1464 microversion: 2.1 time: 0.104332 Nov 01 19:01:37.047688 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1025/2034] 10.222.0.13 () {58 vars in 1233 bytes} [Tue Nov 1 19:01:36 2022] GET /compute/v2.1/images/52ccd7d5-4eba-4e0d-97f4-a4927c3504a7 => generated 1464 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:01:37.052463 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-ecb46b49-8176-435e-9228-ad256c48bc63 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:01:37.053011 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-ecb46b49-8176-435e-9228-ad256c48bc63 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] [instance: 1f499af7-1896-478c-b7d7-d922bf78bd98] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:01:37.067820 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-ecb46b49-8176-435e-9228-ad256c48bc63 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:01:37.070979 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-ecb46b49-8176-435e-9228-ad256c48bc63 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:01:37.072322 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-ecb46b49-8176-435e-9228-ad256c48bc63 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:01:37.073293 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-ecb46b49-8176-435e-9228-ad256c48bc63 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:01:37.073930 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-ecb46b49-8176-435e-9228-ad256c48bc63 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:01:37.074522 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-ecb46b49-8176-435e-9228-ad256c48bc63 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:01:37.105977 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-ecb46b49-8176-435e-9228-ad256c48bc63 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] [instance: 1f499af7-1896-478c-b7d7-d922bf78bd98] Going to try to terminate instance {{(pid=121402) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 01 19:01:37.158553 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.virt.hardware [None req-01b86d61-466d-4fb9-975e-03f32758fa28 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Flavor limits 0:0:0 {{(pid=121403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 01 19:01:37.158971 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.virt.hardware [None req-01b86d61-466d-4fb9-975e-03f32758fa28 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Image limits 0:0:0 {{(pid=121403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 01 19:01:37.159441 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.virt.hardware [None req-01b86d61-466d-4fb9-975e-03f32758fa28 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Flavor pref 0:0:0 {{(pid=121403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 01 19:01:37.159845 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.virt.hardware [None req-01b86d61-466d-4fb9-975e-03f32758fa28 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Image pref 0:0:0 {{(pid=121403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 01 19:01:37.160252 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.virt.hardware [None req-01b86d61-466d-4fb9-975e-03f32758fa28 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 01 19:01:37.183395 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-01b86d61-466d-4fb9-975e-03f32758fa28 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:01:37.184127 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-01b86d61-466d-4fb9-975e-03f32758fa28 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:01:37.185023 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-01b86d61-466d-4fb9-975e-03f32758fa28 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:01:37.185967 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-01b86d61-466d-4fb9-975e-03f32758fa28 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:01:37.186900 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-01b86d61-466d-4fb9-975e-03f32758fa28 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:01:37.187559 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-01b86d61-466d-4fb9-975e-03f32758fa28 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:01:37.208351 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.quota [None req-01b86d61-466d-4fb9-975e-03f32758fa28 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Getting quotas for project 3e2520220d454764b8c139a58d78ac83. Resources: {'cores', 'ram', 'instances'} {{(pid=121403) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 01 19:01:37.214797 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.quota [None req-01b86d61-466d-4fb9-975e-03f32758fa28 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Getting quotas for user bcb496b3faac4abbae73d389f2042e77 and project 3e2520220d454764b8c139a58d78ac83. Resources: {'cores', 'ram', 'instances'} {{(pid=121403) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 01 19:01:37.234599 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-01b86d61-466d-4fb9-975e-03f32758fa28 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Going to run 1 instances... {{(pid=121403) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 01 19:01:37.237527 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-01b86d61-466d-4fb9-975e-03f32758fa28 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] [instance: 992f5ec5-d256-4870-b16d-fc8d9adbd3e7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2d4a0047-1b9e-445f-8af8-1b5c9d93e881',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121403) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 01 19:01:37.239545 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-ecb46b49-8176-435e-9228-ad256c48bc63 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] 10.222.0.13 "DELETE /compute/v2.1/servers/1f499af7-1896-478c-b7d7-d922bf78bd98" status: 204 len: 0 microversion: 2.1 time: 0.190578 Nov 01 19:01:37.240265 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1026/2035] 10.222.0.13 () {58 vars in 1239 bytes} [Tue Nov 1 19:01:37 2022] DELETE /compute/v2.1/servers/1f499af7-1896-478c-b7d7-d922bf78bd98 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 01 19:01:37.260288 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-ff2336f7-1f28-407f-b5ff-46be7b01c181 tempest-ImagesMetadataTestJSON-181442662 tempest-ImagesMetadataTestJSON-181442662-project] Calling method '.version_select at 0x7f0ae2d389d0>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:01:37.325345 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-01b86d61-466d-4fb9-975e-03f32758fa28 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.011224 Nov 01 19:01:37.337137 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-ff2336f7-1f28-407f-b5ff-46be7b01c181 tempest-ImagesMetadataTestJSON-181442662 tempest-ImagesMetadataTestJSON-181442662-project] 10.222.0.13 "GET /compute/v2.1/images/89c8336f-222b-4698-8aa3-6bf840330a13" status: 200 len: 637 microversion: 2.1 time: 0.090657 Nov 01 19:01:37.338364 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1027/2036] 10.222.0.13 () {58 vars in 1233 bytes} [Tue Nov 1 19:01:37 2022] GET /compute/v2.1/images/89c8336f-222b-4698-8aa3-6bf840330a13 => generated 637 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:01:37.339734 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1010/2037] 10.222.0.13 () {60 vars in 1147 bytes} [Tue Nov 1 19:01:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 4035 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 01 19:01:37.351199 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-ea0012d1-1271-4e76-acdb-30be34be70b3 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:01:37.351462 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-f463bb77-d329-4d26-bfeb-0c80b4b83a40 tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:01:37.351821 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-ea0012d1-1271-4e76-acdb-30be34be70b3 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] [instance: 1f499af7-1896-478c-b7d7-d922bf78bd98] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:01:37.357037 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-f463bb77-d329-4d26-bfeb-0c80b4b83a40 tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] [instance: d8e88b0f-ae97-44a4-8b6b-b94e2c600a83] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:01:37.369816 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-ea0012d1-1271-4e76-acdb-30be34be70b3 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:01:37.369816 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-ea0012d1-1271-4e76-acdb-30be34be70b3 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:01:37.369816 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-ea0012d1-1271-4e76-acdb-30be34be70b3 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:01:37.373953 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-ea0012d1-1271-4e76-acdb-30be34be70b3 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:01:37.374445 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-ea0012d1-1271-4e76-acdb-30be34be70b3 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:01:37.374881 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-ea0012d1-1271-4e76-acdb-30be34be70b3 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:01:37.375432 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f463bb77-d329-4d26-bfeb-0c80b4b83a40 tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:01:37.376140 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f463bb77-d329-4d26-bfeb-0c80b4b83a40 tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:01:37.376900 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f463bb77-d329-4d26-bfeb-0c80b4b83a40 tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:01:37.377976 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f463bb77-d329-4d26-bfeb-0c80b4b83a40 tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:01:37.381447 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f463bb77-d329-4d26-bfeb-0c80b4b83a40 tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:01:37.382082 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f463bb77-d329-4d26-bfeb-0c80b4b83a40 tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:01:37.673292 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-f463bb77-d329-4d26-bfeb-0c80b4b83a40 tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b0619a8fc6f4fcc9eb5d4f473c595c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '280a221575634c6f908d333db769739b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:01:37.684621 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-f463bb77-d329-4d26-bfeb-0c80b4b83a40 tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] 10.222.0.13 "GET /compute/v2.1/servers/d8e88b0f-ae97-44a4-8b6b-b94e2c600a83" status: 200 len: 1466 microversion: 2.1 time: 0.344802 Nov 01 19:01:37.687913 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1028/2038] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:01:37 2022] GET /compute/v2.1/servers/d8e88b0f-ae97-44a4-8b6b-b94e2c600a83 => generated 1466 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:01:37.695090 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-4461784c-270f-48b0-b03b-871452c974ca tempest-ImagesMetadataTestJSON-181442662 tempest-ImagesMetadataTestJSON-181442662-project] Action: 'update_all', calling method: .version_select at 0x7f0ae1cadb80>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:01:37.721646 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-ea0012d1-1271-4e76-acdb-30be34be70b3 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f32f5fba1976432d938e664c7714e52b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b9d4c236b944f9b2e8e502a50a8f8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:01:37.734085 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-ea0012d1-1271-4e76-acdb-30be34be70b3 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] 10.222.0.13 "GET /compute/v2.1/servers/1f499af7-1896-478c-b7d7-d922bf78bd98" status: 200 len: 1387 microversion: 2.1 time: 0.392862 Nov 01 19:01:37.735308 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1011/2039] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:01:37 2022] GET /compute/v2.1/servers/1f499af7-1896-478c-b7d7-d922bf78bd98 => generated 1387 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:01:37.746546 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-c167ca17-350d-4bab-990f-7952349f3241 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-896291125", "imageRef": "2d4a0047-1b9e-445f-8af8-1b5c9d93e881", "flavorRef": "452"}} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:01:37.801455 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.quota [None req-4461784c-270f-48b0-b03b-871452c974ca tempest-ImagesMetadataTestJSON-181442662 tempest-ImagesMetadataTestJSON-181442662-project] Getting quotas for project 952ebce7ac214507aa7832df094c375a. Resources: dict_keys(['metadata_items']) {{(pid=121402) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 01 19:01:37.827877 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.quota [None req-4461784c-270f-48b0-b03b-871452c974ca tempest-ImagesMetadataTestJSON-181442662 tempest-ImagesMetadataTestJSON-181442662-project] Getting quotas for user eb78400a7f8c4c59afe2e4d2f514342c and project 952ebce7ac214507aa7832df094c375a. Resources: dict_keys(['metadata_items']) {{(pid=121402) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 01 19:01:37.866444 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.network.neutron [None req-c167ca17-350d-4bab-990f-7952349f3241 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] validate_networks() for None {{(pid=121403) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 01 19:01:38.343213 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.virt.hardware [None req-c167ca17-350d-4bab-990f-7952349f3241 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Flavor limits 0:0:0 {{(pid=121403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 01 19:01:38.344137 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.virt.hardware [None req-c167ca17-350d-4bab-990f-7952349f3241 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Image limits 0:0:0 {{(pid=121403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 01 19:01:38.344934 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.virt.hardware [None req-c167ca17-350d-4bab-990f-7952349f3241 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Flavor pref 0:0:0 {{(pid=121403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 01 19:01:38.345635 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.virt.hardware [None req-c167ca17-350d-4bab-990f-7952349f3241 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Image pref 0:0:0 {{(pid=121403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 01 19:01:38.346421 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.virt.hardware [None req-c167ca17-350d-4bab-990f-7952349f3241 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 01 19:01:38.363105 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-c167ca17-350d-4bab-990f-7952349f3241 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:01:38.363959 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-c167ca17-350d-4bab-990f-7952349f3241 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:01:38.365054 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-c167ca17-350d-4bab-990f-7952349f3241 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:01:38.366036 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-c167ca17-350d-4bab-990f-7952349f3241 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:01:38.368133 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-c167ca17-350d-4bab-990f-7952349f3241 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:01:38.373122 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-c167ca17-350d-4bab-990f-7952349f3241 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:01:38.431484 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.quota [None req-c167ca17-350d-4bab-990f-7952349f3241 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Getting quotas for project 3e2520220d454764b8c139a58d78ac83. Resources: {'cores', 'ram', 'instances'} {{(pid=121403) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 01 19:01:38.444744 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.quota [None req-c167ca17-350d-4bab-990f-7952349f3241 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Getting quotas for user bcb496b3faac4abbae73d389f2042e77 and project 3e2520220d454764b8c139a58d78ac83. Resources: {'cores', 'ram', 'instances'} {{(pid=121403) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 01 19:01:38.454151 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-4461784c-270f-48b0-b03b-871452c974ca tempest-ImagesMetadataTestJSON-181442662 tempest-ImagesMetadataTestJSON-181442662-project] 10.222.0.13 "PUT /compute/v2.1/images/89c8336f-222b-4698-8aa3-6bf840330a13/metadata" status: 200 len: 61 microversion: 2.1 time: 0.765054 Nov 01 19:01:38.455803 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1029/2040] 10.222.0.13 () {60 vars in 1280 bytes} [Tue Nov 1 19:01:37 2022] PUT /compute/v2.1/images/89c8336f-222b-4698-8aa3-6bf840330a13/metadata => generated 61 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 01 19:01:38.460975 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-2fc4a8ca-bc18-4588-971c-b28231646139 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:01:38.462308 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-2fc4a8ca-bc18-4588-971c-b28231646139 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] [instance: 90b353ab-ef97-4d88-b5bc-b355ff576225] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:01:38.492557 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2fc4a8ca-bc18-4588-971c-b28231646139 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:01:38.494248 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2fc4a8ca-bc18-4588-971c-b28231646139 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:01:38.495216 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2fc4a8ca-bc18-4588-971c-b28231646139 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:01:38.498860 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2fc4a8ca-bc18-4588-971c-b28231646139 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:01:38.499573 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2fc4a8ca-bc18-4588-971c-b28231646139 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:01:38.500257 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2fc4a8ca-bc18-4588-971c-b28231646139 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:01:38.502975 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-c167ca17-350d-4bab-990f-7952349f3241 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Going to run 1 instances... {{(pid=121403) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 01 19:01:38.507518 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-c167ca17-350d-4bab-990f-7952349f3241 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] [instance: ac175c18-47f4-4b20-8567-fefb1b701d04] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2d4a0047-1b9e-445f-8af8-1b5c9d93e881',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121403) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 01 19:01:38.639899 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-c167ca17-350d-4bab-990f-7952349f3241 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.903207 Nov 01 19:01:38.641318 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1012/2041] 10.222.0.13 () {60 vars in 1147 bytes} [Tue Nov 1 19:01:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 905 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 01 19:01:38.646511 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-6b6be9a7-c036-4f7e-9aee-5caca0438757 tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] Calling method '.version_select at 0x7f0ae210e550>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:01:38.847512 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-6b6be9a7-c036-4f7e-9aee-5caca0438757 tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] 10.222.0.13 "GET /compute/v2.1/images?changes-since=2022-11-01T18%3A59%3A22Z" status: 200 len: 1902 microversion: 2.1 time: 0.204590 Nov 01 19:01:38.852736 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1013/2042] 10.222.0.13 () {58 vars in 1199 bytes} [Tue Nov 1 19:01:38 2022] GET /compute/v2.1/images?changes-since=2022-11-01T18%3A59%3A22Z => generated 1902 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:01:38.866316 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-8c8cbae8-eef1-4876-ad33-c5ec0e50bb53 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:01:38.868907 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-8c8cbae8-eef1-4876-ad33-c5ec0e50bb53 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] [instance: cd879708-f757-4f88-bc95-38b6cd55363c] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:01:38.877129 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-8c8cbae8-eef1-4876-ad33-c5ec0e50bb53 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:01:38.878084 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-8c8cbae8-eef1-4876-ad33-c5ec0e50bb53 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:01:38.878755 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-8c8cbae8-eef1-4876-ad33-c5ec0e50bb53 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:01:38.880737 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-8c8cbae8-eef1-4876-ad33-c5ec0e50bb53 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:01:38.881302 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-8c8cbae8-eef1-4876-ad33-c5ec0e50bb53 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:01:38.881832 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-8c8cbae8-eef1-4876-ad33-c5ec0e50bb53 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:01:39.062574 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-2fc4a8ca-bc18-4588-971c-b28231646139 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a63d69c99a546f0af16329cff3ca717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a1bb191cff948e99c008b5e861ce4a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:01:39.091908 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-2fc4a8ca-bc18-4588-971c-b28231646139 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] 10.222.0.13 "GET /compute/v2.1/servers/90b353ab-ef97-4d88-b5bc-b355ff576225" status: 200 len: 1736 microversion: 2.1 time: 0.629471 Nov 01 19:01:39.096349 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1030/2043] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:01:38 2022] GET /compute/v2.1/servers/90b353ab-ef97-4d88-b5bc-b355ff576225 => generated 1736 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:01:39.115927 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-64735e15-a03d-4682-81b2-e1e15a36ae3d tempest-ImagesMetadataTestJSON-181442662 tempest-ImagesMetadataTestJSON-181442662-project] Calling method '.version_select at 0x7f0ae2e02700>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:01:39.187492 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-8c8cbae8-eef1-4876-ad33-c5ec0e50bb53 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:01:39.204247 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-8c8cbae8-eef1-4876-ad33-c5ec0e50bb53 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:01:39.209893 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-8c8cbae8-eef1-4876-ad33-c5ec0e50bb53 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:01:39.215470 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-8c8cbae8-eef1-4876-ad33-c5ec0e50bb53 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] 10.222.0.13 "GET /compute/v2.1/servers/cd879708-f757-4f88-bc95-38b6cd55363c" status: 200 len: 1486 microversion: 2.25 time: 0.361374 Nov 01 19:01:39.216394 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1014/2044] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 19:01:38 2022] GET /compute/v2.1/servers/cd879708-f757-4f88-bc95-38b6cd55363c => generated 1486 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 19:01:39.232073 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-84a4a8b6-e783-453e-bfbb-6f3ba2e25bba tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:01:39.247004 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-84a4a8b6-e783-453e-bfbb-6f3ba2e25bba tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] [instance: ac175c18-47f4-4b20-8567-fefb1b701d04] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:01:39.365028 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-84a4a8b6-e783-453e-bfbb-6f3ba2e25bba tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb496b3faac4abbae73d389f2042e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e2520220d454764b8c139a58d78ac83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:01:39.384329 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-84a4a8b6-e783-453e-bfbb-6f3ba2e25bba tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] 10.222.0.13 "GET /compute/v2.1/servers/ac175c18-47f4-4b20-8567-fefb1b701d04" status: 200 len: 1213 microversion: 2.1 time: 0.158471 Nov 01 19:01:39.386519 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1015/2045] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:01:39 2022] GET /compute/v2.1/servers/ac175c18-47f4-4b20-8567-fefb1b701d04 => generated 1213 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:01:39.395222 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-bc6389c3-6879-4a96-b247-7250f645e031 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:01:39.396375 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-bc6389c3-6879-4a96-b247-7250f645e031 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] [instance: 1f499af7-1896-478c-b7d7-d922bf78bd98] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:01:39.407433 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-bc6389c3-6879-4a96-b247-7250f645e031 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:01:39.408561 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-bc6389c3-6879-4a96-b247-7250f645e031 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:01:39.409316 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-bc6389c3-6879-4a96-b247-7250f645e031 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:01:39.410676 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-bc6389c3-6879-4a96-b247-7250f645e031 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:01:39.411384 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-bc6389c3-6879-4a96-b247-7250f645e031 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:01:39.412274 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-bc6389c3-6879-4a96-b247-7250f645e031 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:01:39.641110 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-64735e15-a03d-4682-81b2-e1e15a36ae3d tempest-ImagesMetadataTestJSON-181442662 tempest-ImagesMetadataTestJSON-181442662-project] 10.222.0.13 "DELETE /compute/v2.1/images/89c8336f-222b-4698-8aa3-6bf840330a13/metadata/os_version" status: 204 len: 0 microversion: 2.1 time: 0.536557 Nov 01 19:01:39.642146 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1031/2046] 10.222.0.13 () {58 vars in 1296 bytes} [Tue Nov 1 19:01:39 2022] DELETE /compute/v2.1/images/89c8336f-222b-4698-8aa3-6bf840330a13/metadata/os_version => generated 0 bytes in 545 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 01 19:01:39.649225 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-ba5485f2-efe2-4866-b948-773e4cf7eb69 tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] Calling method '.version_select at 0x7f0ae2c189d0>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:01:39.731621 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-bc6389c3-6879-4a96-b247-7250f645e031 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f32f5fba1976432d938e664c7714e52b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b9d4c236b944f9b2e8e502a50a8f8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:01:39.742996 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-bc6389c3-6879-4a96-b247-7250f645e031 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] 10.222.0.13 "GET /compute/v2.1/servers/1f499af7-1896-478c-b7d7-d922bf78bd98" status: 200 len: 1387 microversion: 2.1 time: 0.354101 Nov 01 19:01:39.744038 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1016/2047] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:01:39 2022] GET /compute/v2.1/servers/1f499af7-1896-478c-b7d7-d922bf78bd98 => generated 1387 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:01:39.749084 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-8e98ebb7-00e3-472e-9ae2-9dd28a7fe776 tempest-ImagesMetadataTestJSON-181442662 tempest-ImagesMetadataTestJSON-181442662-project] Calling method '.version_select at 0x7f0ae210e8b0>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:01:39.891692 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-ba5485f2-efe2-4866-b948-773e4cf7eb69 tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] 10.222.0.13 "GET /compute/v2.1/images?name=tempest-ListImageFiltersTestJSON-image-731092614" status: 200 len: 484 microversion: 2.1 time: 0.248176 Nov 01 19:01:39.897197 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1032/2048] 10.222.0.13 () {58 vars in 1229 bytes} [Tue Nov 1 19:01:39 2022] GET /compute/v2.1/images?name=tempest-ListImageFiltersTestJSON-image-731092614 => generated 484 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:01:39.910099 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-87e528bc-d85f-4355-a9d6-23ef60ce028c tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] Calling method '.version_select at 0x7f0ae1cd60d0>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:01:39.911140 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-8e98ebb7-00e3-472e-9ae2-9dd28a7fe776 tempest-ImagesMetadataTestJSON-181442662 tempest-ImagesMetadataTestJSON-181442662-project] 10.222.0.13 "GET /compute/v2.1/images/89c8336f-222b-4698-8aa3-6bf840330a13/metadata" status: 200 len: 37 microversion: 2.1 time: 0.165653 Nov 01 19:01:39.911719 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1017/2049] 10.222.0.13 () {58 vars in 1260 bytes} [Tue Nov 1 19:01:39 2022] GET /compute/v2.1/images/89c8336f-222b-4698-8aa3-6bf840330a13/metadata => generated 37 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 01 19:01:39.923436 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-ac508349-2e3f-4f8a-9d14-782353ed46eb tempest-ImagesMetadataTestJSON-181442662 tempest-ImagesMetadataTestJSON-181442662-project] Action: 'update_all', calling method: .version_select at 0x7f0ae2097c10>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:01:40.147973 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-87e528bc-d85f-4355-a9d6-23ef60ce028c tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] 10.222.0.13 "GET /compute/v2.1/images?server=d8e88b0f-ae97-44a4-8b6b-b94e2c600a83" status: 200 len: 957 microversion: 2.1 time: 0.235989 Nov 01 19:01:40.151762 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1033/2050] 10.222.0.13 () {58 vars in 1209 bytes} [Tue Nov 1 19:01:39 2022] GET /compute/v2.1/images?server=d8e88b0f-ae97-44a4-8b6b-b94e2c600a83 => generated 957 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:01:40.162863 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.quota [None req-ac508349-2e3f-4f8a-9d14-782353ed46eb tempest-ImagesMetadataTestJSON-181442662 tempest-ImagesMetadataTestJSON-181442662-project] Getting quotas for project 952ebce7ac214507aa7832df094c375a. Resources: dict_keys(['metadata_items']) {{(pid=121403) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 01 19:01:40.165755 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-54b1cb25-f69b-4c70-a8fa-fcfbfd5748f6 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:01:40.167627 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-54b1cb25-f69b-4c70-a8fa-fcfbfd5748f6 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] [instance: 90b353ab-ef97-4d88-b5bc-b355ff576225] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:01:40.181597 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.quota [None req-ac508349-2e3f-4f8a-9d14-782353ed46eb tempest-ImagesMetadataTestJSON-181442662 tempest-ImagesMetadataTestJSON-181442662-project] Getting quotas for user eb78400a7f8c4c59afe2e4d2f514342c and project 952ebce7ac214507aa7832df094c375a. Resources: dict_keys(['metadata_items']) {{(pid=121403) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 01 19:01:40.187634 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-54b1cb25-f69b-4c70-a8fa-fcfbfd5748f6 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:01:40.189017 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-54b1cb25-f69b-4c70-a8fa-fcfbfd5748f6 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:01:40.190260 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-54b1cb25-f69b-4c70-a8fa-fcfbfd5748f6 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:01:40.195577 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-54b1cb25-f69b-4c70-a8fa-fcfbfd5748f6 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:01:40.197565 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-54b1cb25-f69b-4c70-a8fa-fcfbfd5748f6 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:01:40.199330 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-54b1cb25-f69b-4c70-a8fa-fcfbfd5748f6 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:01:40.730011 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-ac508349-2e3f-4f8a-9d14-782353ed46eb tempest-ImagesMetadataTestJSON-181442662 tempest-ImagesMetadataTestJSON-181442662-project] 10.222.0.13 "PUT /compute/v2.1/images/89c8336f-222b-4698-8aa3-6bf840330a13/metadata" status: 200 len: 61 microversion: 2.1 time: 0.810665 Nov 01 19:01:40.733426 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1018/2051] 10.222.0.13 () {60 vars in 1280 bytes} [Tue Nov 1 19:01:39 2022] PUT /compute/v2.1/images/89c8336f-222b-4698-8aa3-6bf840330a13/metadata => generated 61 bytes in 815 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Nov 01 19:01:40.746897 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-0e4075d0-1f50-41d7-a0d7-9c270e5fb5e5 tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] Calling method '.version_select at 0x7f0ae67e3dc0>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:01:40.854810 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-0e4075d0-1f50-41d7-a0d7-9c270e5fb5e5 tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] 10.222.0.13 "GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.13%2Fcompute%2Fv2.1%2Fservers%2Fc34b04e9-a50a-4c58-85ff-ecef0bfc0343" status: 200 len: 485 microversion: 2.1 time: 0.120065 Nov 01 19:01:40.855402 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1019/2052] 10.222.0.13 () {58 vars in 1317 bytes} [Tue Nov 1 19:01:40 2022] GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.13%2Fcompute%2Fv2.1%2Fservers%2Fc34b04e9-a50a-4c58-85ff-ecef0bfc0343 => generated 485 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:01:40.869582 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-f0508b56-4608-44d0-8217-83fe3a6a5ca4 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:01:40.869998 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-f0508b56-4608-44d0-8217-83fe3a6a5ca4 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] [instance: cd879708-f757-4f88-bc95-38b6cd55363c] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:01:40.876463 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f0508b56-4608-44d0-8217-83fe3a6a5ca4 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:01:40.877001 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f0508b56-4608-44d0-8217-83fe3a6a5ca4 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:01:40.877444 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f0508b56-4608-44d0-8217-83fe3a6a5ca4 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:01:40.878149 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f0508b56-4608-44d0-8217-83fe3a6a5ca4 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:01:40.878804 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f0508b56-4608-44d0-8217-83fe3a6a5ca4 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:01:40.879405 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f0508b56-4608-44d0-8217-83fe3a6a5ca4 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:01:40.908108 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-54b1cb25-f69b-4c70-a8fa-fcfbfd5748f6 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a63d69c99a546f0af16329cff3ca717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a1bb191cff948e99c008b5e861ce4a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:01:40.920028 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-54b1cb25-f69b-4c70-a8fa-fcfbfd5748f6 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] 10.222.0.13 "GET /compute/v2.1/servers/90b353ab-ef97-4d88-b5bc-b355ff576225" status: 200 len: 1736 microversion: 2.1 time: 0.766972 Nov 01 19:01:40.925284 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1034/2053] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:01:40 2022] GET /compute/v2.1/servers/90b353ab-ef97-4d88-b5bc-b355ff576225 => generated 1736 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:01:40.941275 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-a2586b85-3966-4a4a-9383-7f026f317e51 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:01:40.942272 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-a2586b85-3966-4a4a-9383-7f026f317e51 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] [instance: ac175c18-47f4-4b20-8567-fefb1b701d04] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:01:40.951947 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-a2586b85-3966-4a4a-9383-7f026f317e51 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:01:40.954291 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-a2586b85-3966-4a4a-9383-7f026f317e51 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:01:40.956606 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-a2586b85-3966-4a4a-9383-7f026f317e51 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:01:40.957786 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-a2586b85-3966-4a4a-9383-7f026f317e51 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:01:40.965363 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-a2586b85-3966-4a4a-9383-7f026f317e51 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:01:40.966044 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-a2586b85-3966-4a4a-9383-7f026f317e51 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:01:41.137401 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-f0508b56-4608-44d0-8217-83fe3a6a5ca4 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:01:41.142036 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-a2586b85-3966-4a4a-9383-7f026f317e51 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb496b3faac4abbae73d389f2042e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e2520220d454764b8c139a58d78ac83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:01:41.155247 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-f0508b56-4608-44d0-8217-83fe3a6a5ca4 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:01:41.159780 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-a2586b85-3966-4a4a-9383-7f026f317e51 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] 10.222.0.13 "GET /compute/v2.1/servers/ac175c18-47f4-4b20-8567-fefb1b701d04" status: 200 len: 1265 microversion: 2.1 time: 0.233087 Nov 01 19:01:41.162168 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1035/2054] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:01:40 2022] GET /compute/v2.1/servers/ac175c18-47f4-4b20-8567-fefb1b701d04 => generated 1265 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:01:41.164999 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-f0508b56-4608-44d0-8217-83fe3a6a5ca4 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:01:41.166213 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-f0508b56-4608-44d0-8217-83fe3a6a5ca4 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] 10.222.0.13 "GET /compute/v2.1/servers/cd879708-f757-4f88-bc95-38b6cd55363c" status: 200 len: 1486 microversion: 2.25 time: 0.309646 Nov 01 19:01:41.180439 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-62114302-744e-48cc-8896-8084da968055 tempest-ImagesMetadataTestJSON-181442662 tempest-ImagesMetadataTestJSON-181442662-project] Calling method '.version_select at 0x7f0ae2659430>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:01:41.184270 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1020/2055] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 19:01:40 2022] GET /compute/v2.1/servers/cd879708-f757-4f88-bc95-38b6cd55363c => generated 1486 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 19:01:41.214925 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-bf5fc6cb-e652-4e66-ad70-8cb11e9ccb42 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:01:41.215548 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-bf5fc6cb-e652-4e66-ad70-8cb11e9ccb42 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] [instance: 1f499af7-1896-478c-b7d7-d922bf78bd98] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:01:41.245244 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-bf5fc6cb-e652-4e66-ad70-8cb11e9ccb42 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:01:41.246035 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-bf5fc6cb-e652-4e66-ad70-8cb11e9ccb42 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:01:41.246711 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-bf5fc6cb-e652-4e66-ad70-8cb11e9ccb42 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:01:41.247600 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-bf5fc6cb-e652-4e66-ad70-8cb11e9ccb42 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:01:41.255240 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-bf5fc6cb-e652-4e66-ad70-8cb11e9ccb42 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:01:41.256002 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-bf5fc6cb-e652-4e66-ad70-8cb11e9ccb42 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:01:41.286718 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-62114302-744e-48cc-8896-8084da968055 tempest-ImagesMetadataTestJSON-181442662 tempest-ImagesMetadataTestJSON-181442662-project] 10.222.0.13 "GET /compute/v2.1/images/89c8336f-222b-4698-8aa3-6bf840330a13/metadata/os_distro" status: 200 len: 33 microversion: 2.1 time: 0.122473 Nov 01 19:01:41.292528 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1036/2056] 10.222.0.13 () {58 vars in 1290 bytes} [Tue Nov 1 19:01:41 2022] GET /compute/v2.1/images/89c8336f-222b-4698-8aa3-6bf840330a13/metadata/os_distro => generated 33 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 01 19:01:41.298877 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-98ad96fa-bcd0-4d80-a424-410a4ce33293 tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] Calling method '.version_select at 0x7f0ae1d75670>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:01:41.413090 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-98ad96fa-bcd0-4d80-a424-410a4ce33293 tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] 10.222.0.13 "GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.13%2Fcompute%2Fservers%2Fc34b04e9-a50a-4c58-85ff-ecef0bfc0343" status: 200 len: 485 microversion: 2.1 time: 0.124323 Nov 01 19:01:41.427534 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1037/2057] 10.222.0.13 () {58 vars in 1303 bytes} [Tue Nov 1 19:01:41 2022] GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.13%2Fcompute%2Fservers%2Fc34b04e9-a50a-4c58-85ff-ecef0bfc0343 => generated 485 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:01:41.449824 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-5ee4643c-d1d0-4bb8-9eb1-d8d2d7c2a4c7 tempest-ImagesMetadataTestJSON-181442662 tempest-ImagesMetadataTestJSON-181442662-project] Action: 'update_all', calling method: .version_select at 0x7f0ae1c7e040>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:01:41.541107 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-bf5fc6cb-e652-4e66-ad70-8cb11e9ccb42 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f32f5fba1976432d938e664c7714e52b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b9d4c236b944f9b2e8e502a50a8f8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:01:41.561506 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-bf5fc6cb-e652-4e66-ad70-8cb11e9ccb42 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] 10.222.0.13 "GET /compute/v2.1/servers/1f499af7-1896-478c-b7d7-d922bf78bd98" status: 200 len: 1345 microversion: 2.1 time: 0.371864 Nov 01 19:01:41.564866 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1021/2058] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:01:41 2022] GET /compute/v2.1/servers/1f499af7-1896-478c-b7d7-d922bf78bd98 => generated 1345 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:01:41.577678 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.quota [None req-5ee4643c-d1d0-4bb8-9eb1-d8d2d7c2a4c7 tempest-ImagesMetadataTestJSON-181442662 tempest-ImagesMetadataTestJSON-181442662-project] Getting quotas for project 952ebce7ac214507aa7832df094c375a. Resources: dict_keys(['metadata_items']) {{(pid=121402) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 01 19:01:41.578108 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-89fba813-c551-4795-91a5-c0debb69e1a3 tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] Calling method '.version_select at 0x7f0ae20a55e0>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:01:41.596415 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.quota [None req-5ee4643c-d1d0-4bb8-9eb1-d8d2d7c2a4c7 tempest-ImagesMetadataTestJSON-181442662 tempest-ImagesMetadataTestJSON-181442662-project] Getting quotas for user eb78400a7f8c4c59afe2e4d2f514342c and project 952ebce7ac214507aa7832df094c375a. Resources: dict_keys(['metadata_items']) {{(pid=121402) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 01 19:01:41.972122 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-89fba813-c551-4795-91a5-c0debb69e1a3 tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] 10.222.0.13 "GET /compute/v2.1/images?status=ACTIVE" status: 200 len: 3279 microversion: 2.1 time: 0.399343 Nov 01 19:01:41.986448 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1022/2059] 10.222.0.13 () {58 vars in 1149 bytes} [Tue Nov 1 19:01:41 2022] GET /compute/v2.1/images?status=ACTIVE => generated 3279 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:01:41.995094 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [req-7a68b9b8-093e-4516-bad7-5cd339cecd02 req-3f54324c-827f-45aa-8535-ea6c97d8910a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f499af7-1896-478c-b7d7-d922bf78bd98", "name": "network-vif-deleted", "tag": "a463e9d5-3409-4b7b-97cb-4970df239917"}]} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:01:42.026069 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-7a68b9b8-093e-4516-bad7-5cd339cecd02 req-3f54324c-827f-45aa-8535-ea6c97d8910a service nova] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:01:42.028446 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-7a68b9b8-093e-4516-bad7-5cd339cecd02 req-3f54324c-827f-45aa-8535-ea6c97d8910a service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:01:42.029195 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-7a68b9b8-093e-4516-bad7-5cd339cecd02 req-3f54324c-827f-45aa-8535-ea6c97d8910a service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:01:42.045212 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.compute.server_external_events [req-7a68b9b8-093e-4516-bad7-5cd339cecd02 req-3f54324c-827f-45aa-8535-ea6c97d8910a service nova] Creating event network-vif-deleted:a463e9d5-3409-4b7b-97cb-4970df239917 for instance 1f499af7-1896-478c-b7d7-d922bf78bd98 on n-h2-863052-2 Nov 01 19:01:42.051396 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [req-7a68b9b8-093e-4516-bad7-5cd339cecd02 req-3f54324c-827f-45aa-8535-ea6c97d8910a service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063626 Nov 01 19:01:42.052920 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1023/2060] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Nov 1 19:01:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:01:42.060081 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-cd5d7e75-8080-4400-a23e-4347a19a5ec3 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:01:42.062642 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-cd5d7e75-8080-4400-a23e-4347a19a5ec3 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] [instance: 90b353ab-ef97-4d88-b5bc-b355ff576225] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:01:42.073650 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-cd5d7e75-8080-4400-a23e-4347a19a5ec3 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:01:42.074529 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-cd5d7e75-8080-4400-a23e-4347a19a5ec3 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:01:42.075390 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-cd5d7e75-8080-4400-a23e-4347a19a5ec3 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:01:42.076468 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-cd5d7e75-8080-4400-a23e-4347a19a5ec3 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:01:42.078411 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-cd5d7e75-8080-4400-a23e-4347a19a5ec3 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:01:42.079105 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-cd5d7e75-8080-4400-a23e-4347a19a5ec3 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:01:42.133261 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-5ee4643c-d1d0-4bb8-9eb1-d8d2d7c2a4c7 tempest-ImagesMetadataTestJSON-181442662 tempest-ImagesMetadataTestJSON-181442662-project] 10.222.0.13 "PUT /compute/v2.1/images/89c8336f-222b-4698-8aa3-6bf840330a13/metadata" status: 200 len: 61 microversion: 2.1 time: 0.703166 Nov 01 19:01:42.133901 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1038/2061] 10.222.0.13 () {60 vars in 1280 bytes} [Tue Nov 1 19:01:41 2022] PUT /compute/v2.1/images/89c8336f-222b-4698-8aa3-6bf840330a13/metadata => generated 61 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 01 19:01:42.144024 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-54a024e2-c946-48fd-a1a8-89723d861d4c tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] Calling method '.version_select at 0x7f0ae26595e0>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:01:42.252411 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-54a024e2-c946-48fd-a1a8-89723d861d4c tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] 10.222.0.13 "GET /compute/v2.1/images?type=snapshot" status: 200 len: 1430 microversion: 2.1 time: 0.112480 Nov 01 19:01:42.253452 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1039/2062] 10.222.0.13 () {58 vars in 1149 bytes} [Tue Nov 1 19:01:42 2022] GET /compute/v2.1/images?type=snapshot => generated 1430 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:01:42.273469 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-f1ab5f38-3a3e-47d7-a649-ed73954302ac tempest-ImagesMetadataTestJSON-181442662 tempest-ImagesMetadataTestJSON-181442662-project] Calling method '.version_select at 0x7f0ae1c449d0>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:01:42.382562 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-f1ab5f38-3a3e-47d7-a649-ed73954302ac tempest-ImagesMetadataTestJSON-181442662 tempest-ImagesMetadataTestJSON-181442662-project] 10.222.0.13 "GET /compute/v2.1/images/89c8336f-222b-4698-8aa3-6bf840330a13/metadata" status: 200 len: 61 microversion: 2.1 time: 0.127861 Nov 01 19:01:42.384307 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1040/2063] 10.222.0.13 () {58 vars in 1260 bytes} [Tue Nov 1 19:01:42 2022] GET /compute/v2.1/images/89c8336f-222b-4698-8aa3-6bf840330a13/metadata => generated 61 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 01 19:01:42.393105 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-ae76d755-138e-4f42-bbdb-a9a9d566237c tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:01:42.393858 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-ae76d755-138e-4f42-bbdb-a9a9d566237c tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] [instance: ac175c18-47f4-4b20-8567-fefb1b701d04] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:01:42.408049 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-ae76d755-138e-4f42-bbdb-a9a9d566237c tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:01:42.408927 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-ae76d755-138e-4f42-bbdb-a9a9d566237c tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:01:42.410399 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-ae76d755-138e-4f42-bbdb-a9a9d566237c tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:01:42.411911 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-ae76d755-138e-4f42-bbdb-a9a9d566237c tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:01:42.412662 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-ae76d755-138e-4f42-bbdb-a9a9d566237c tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:01:42.413957 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-ae76d755-138e-4f42-bbdb-a9a9d566237c tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:01:42.583446 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-ae76d755-138e-4f42-bbdb-a9a9d566237c tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb496b3faac4abbae73d389f2042e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e2520220d454764b8c139a58d78ac83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:01:42.615941 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-ae76d755-138e-4f42-bbdb-a9a9d566237c tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] 10.222.0.13 "GET /compute/v2.1/servers/ac175c18-47f4-4b20-8567-fefb1b701d04" status: 200 len: 1271 microversion: 2.1 time: 0.230437 Nov 01 19:01:42.619233 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1041/2064] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:01:42 2022] GET /compute/v2.1/servers/ac175c18-47f4-4b20-8567-fefb1b701d04 => generated 1271 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:01:42.635021 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-960b1699-4091-43aa-bdd7-8824ce2192f2 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:01:42.636015 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-960b1699-4091-43aa-bdd7-8824ce2192f2 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] [instance: cd879708-f757-4f88-bc95-38b6cd55363c] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:01:42.653469 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-cd5d7e75-8080-4400-a23e-4347a19a5ec3 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a63d69c99a546f0af16329cff3ca717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a1bb191cff948e99c008b5e861ce4a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:01:42.663348 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-cd5d7e75-8080-4400-a23e-4347a19a5ec3 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] 10.222.0.13 "GET /compute/v2.1/servers/90b353ab-ef97-4d88-b5bc-b355ff576225" status: 200 len: 1736 microversion: 2.1 time: 0.608977 Nov 01 19:01:42.664254 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-960b1699-4091-43aa-bdd7-8824ce2192f2 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:01:42.665540 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-960b1699-4091-43aa-bdd7-8824ce2192f2 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:01:42.666112 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-960b1699-4091-43aa-bdd7-8824ce2192f2 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:01:42.667005 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-960b1699-4091-43aa-bdd7-8824ce2192f2 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:01:42.667749 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-960b1699-4091-43aa-bdd7-8824ce2192f2 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:01:42.669964 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-960b1699-4091-43aa-bdd7-8824ce2192f2 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:01:42.684432 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1024/2065] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:01:42 2022] GET /compute/v2.1/servers/90b353ab-ef97-4d88-b5bc-b355ff576225 => generated 1736 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:01:42.701620 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-9f21ecd2-aa0f-4443-81e9-ab0f2c9c7ba4 tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] Calling method '.version_select at 0x7f0ae20a51f0>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:01:42.737767 n-d-863052-2 devstack@n-api.service[121402]: DEBUG dbcounter [-] [121402] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 19:01:42.780849 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-9f21ecd2-aa0f-4443-81e9-ab0f2c9c7ba4 tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] 10.222.0.13 "GET /compute/v2.1/images?limit=1" status: 200 len: 622 microversion: 2.1 time: 0.088030 Nov 01 19:01:42.782043 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1025/2066] 10.222.0.13 () {58 vars in 1137 bytes} [Tue Nov 1 19:01:42 2022] GET /compute/v2.1/images?limit=1 => generated 622 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:01:42.787412 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-6239731f-bcc3-41d7-ab5f-9b2bb964c537 tempest-ImagesMetadataTestJSON-181442662 tempest-ImagesMetadataTestJSON-181442662-project] Action: 'update_all', calling method: .version_select at 0x7f0ae67e34c0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:01:42.871669 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.quota [None req-6239731f-bcc3-41d7-ab5f-9b2bb964c537 tempest-ImagesMetadataTestJSON-181442662 tempest-ImagesMetadataTestJSON-181442662-project] Getting quotas for project 952ebce7ac214507aa7832df094c375a. Resources: dict_keys(['metadata_items']) {{(pid=121403) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 01 19:01:42.888497 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.quota [None req-6239731f-bcc3-41d7-ab5f-9b2bb964c537 tempest-ImagesMetadataTestJSON-181442662 tempest-ImagesMetadataTestJSON-181442662-project] Getting quotas for user eb78400a7f8c4c59afe2e4d2f514342c and project 952ebce7ac214507aa7832df094c375a. Resources: dict_keys(['metadata_items']) {{(pid=121403) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 01 19:01:43.123295 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-6239731f-bcc3-41d7-ab5f-9b2bb964c537 tempest-ImagesMetadataTestJSON-181442662 tempest-ImagesMetadataTestJSON-181442662-project] 10.222.0.13 "PUT /compute/v2.1/images/89c8336f-222b-4698-8aa3-6bf840330a13/metadata" status: 200 len: 61 microversion: 2.1 time: 0.339916 Nov 01 19:01:43.125002 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1026/2067] 10.222.0.13 () {60 vars in 1280 bytes} [Tue Nov 1 19:01:42 2022] PUT /compute/v2.1/images/89c8336f-222b-4698-8aa3-6bf840330a13/metadata => generated 61 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 01 19:01:43.130410 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-8ac19cae-adc6-4eb3-ab06-03030e6b5fac tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:01:43.131312 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-8ac19cae-adc6-4eb3-ab06-03030e6b5fac tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] [instance: 1f499af7-1896-478c-b7d7-d922bf78bd98] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:01:43.138568 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-8ac19cae-adc6-4eb3-ab06-03030e6b5fac tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:01:43.139309 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-8ac19cae-adc6-4eb3-ab06-03030e6b5fac tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:01:43.140307 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-8ac19cae-adc6-4eb3-ab06-03030e6b5fac tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:01:43.141660 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-8ac19cae-adc6-4eb3-ab06-03030e6b5fac tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:01:43.141793 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-960b1699-4091-43aa-bdd7-8824ce2192f2 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:01:43.142886 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-8ac19cae-adc6-4eb3-ab06-03030e6b5fac tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:01:43.143521 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-8ac19cae-adc6-4eb3-ab06-03030e6b5fac tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:01:43.157011 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-960b1699-4091-43aa-bdd7-8824ce2192f2 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:01:43.161422 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-960b1699-4091-43aa-bdd7-8824ce2192f2 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:01:43.165561 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-960b1699-4091-43aa-bdd7-8824ce2192f2 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] 10.222.0.13 "GET /compute/v2.1/servers/cd879708-f757-4f88-bc95-38b6cd55363c" status: 200 len: 1486 microversion: 2.25 time: 0.542403 Nov 01 19:01:43.168722 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1042/2068] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 19:01:42 2022] GET /compute/v2.1/servers/cd879708-f757-4f88-bc95-38b6cd55363c => generated 1486 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 19:01:43.170351 n-d-863052-2 devstack@n-api.service[121403]: DEBUG dbcounter [-] [121403] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 19:01:43.194743 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-1c72c771-240c-4fca-8163-d2fe0ea8b892 tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] Calling method '.version_select at 0x7f0ae1d75790>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:01:43.346716 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-8ac19cae-adc6-4eb3-ab06-03030e6b5fac tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f32f5fba1976432d938e664c7714e52b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b9d4c236b944f9b2e8e502a50a8f8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:01:43.360657 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-8ac19cae-adc6-4eb3-ab06-03030e6b5fac tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] 10.222.0.13 "GET /compute/v2.1/servers/1f499af7-1896-478c-b7d7-d922bf78bd98" status: 200 len: 1184 microversion: 2.1 time: 0.234261 Nov 01 19:01:43.365317 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1027/2069] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:01:43 2022] GET /compute/v2.1/servers/1f499af7-1896-478c-b7d7-d922bf78bd98 => generated 1184 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:01:43.370802 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [req-ca0977b9-0303-40bd-bb22-cd40bf59a6f0 req-69f859f7-d85b-4324-b29c-bbb189b95bc8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d8e88b0f-ae97-44a4-8b6b-b94e2c600a83", "name": "network-vif-unplugged", "status": "completed", "tag": "91ce416d-c08f-473f-a551-fa3519a6c6c7"}]} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:01:43.370986 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-1c72c771-240c-4fca-8163-d2fe0ea8b892 tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] 10.222.0.13 "GET /compute/v2.1/images/detail?changes-since=2022-11-01T18%3A59%3A16Z" status: 200 len: 6332 microversion: 2.1 time: 0.199655 Nov 01 19:01:43.371840 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1043/2070] 10.222.0.13 () {58 vars in 1220 bytes} [Tue Nov 1 19:01:43 2022] GET /compute/v2.1/images/detail?changes-since=2022-11-01T18%3A59%3A16Z => generated 6332 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:01:43.405916 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-ca0977b9-0303-40bd-bb22-cd40bf59a6f0 req-69f859f7-d85b-4324-b29c-bbb189b95bc8 service nova] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:01:43.407713 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-91a974b4-8675-4b7f-8dcc-8e4441a39319 tempest-ImagesMetadataTestJSON-181442662 tempest-ImagesMetadataTestJSON-181442662-project] Action: 'update_all', calling method: .version_select at 0x7f0ae2659ee0>, body: {"metadata": {"os_version": "value2", "architecture": "value3"}} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:01:43.408016 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-ca0977b9-0303-40bd-bb22-cd40bf59a6f0 req-69f859f7-d85b-4324-b29c-bbb189b95bc8 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:01:43.409816 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-ca0977b9-0303-40bd-bb22-cd40bf59a6f0 req-69f859f7-d85b-4324-b29c-bbb189b95bc8 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:01:43.445511 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.compute.server_external_events [req-ca0977b9-0303-40bd-bb22-cd40bf59a6f0 req-69f859f7-d85b-4324-b29c-bbb189b95bc8 service nova] Creating event network-vif-unplugged:91ce416d-c08f-473f-a551-fa3519a6c6c7 for instance d8e88b0f-ae97-44a4-8b6b-b94e2c600a83 on n-h1-863052-2 Nov 01 19:01:43.451871 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [req-ca0977b9-0303-40bd-bb22-cd40bf59a6f0 req-69f859f7-d85b-4324-b29c-bbb189b95bc8 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.084990 Nov 01 19:01:43.453622 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1028/2071] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Nov 1 19:01:43 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:01:43.463999 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-70f7c14a-4390-445b-ba60-7558393ec1a6 tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] Calling method '.version_select at 0x7f0ae2102c10>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:01:43.621879 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.quota [None req-91a974b4-8675-4b7f-8dcc-8e4441a39319 tempest-ImagesMetadataTestJSON-181442662 tempest-ImagesMetadataTestJSON-181442662-project] Getting quotas for project 952ebce7ac214507aa7832df094c375a. Resources: dict_keys(['metadata_items']) {{(pid=121402) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 01 19:01:43.630855 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.quota [None req-91a974b4-8675-4b7f-8dcc-8e4441a39319 tempest-ImagesMetadataTestJSON-181442662 tempest-ImagesMetadataTestJSON-181442662-project] Getting quotas for user eb78400a7f8c4c59afe2e4d2f514342c and project 952ebce7ac214507aa7832df094c375a. Resources: dict_keys(['metadata_items']) {{(pid=121402) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 01 19:01:43.651993 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-70f7c14a-4390-445b-ba60-7558393ec1a6 tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] 10.222.0.13 "GET /compute/v2.1/images/detail?name=tempest-ListImageFiltersTestJSON-image-731092614" status: 200 len: 664 microversion: 2.1 time: 0.184211 Nov 01 19:01:43.651993 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1029/2072] 10.222.0.13 () {58 vars in 1250 bytes} [Tue Nov 1 19:01:43 2022] GET /compute/v2.1/images/detail?name=tempest-ListImageFiltersTestJSON-image-731092614 => generated 664 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:01:43.659871 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-43adda02-6e10-4043-9bcd-5d01647cee95 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:01:43.661257 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-43adda02-6e10-4043-9bcd-5d01647cee95 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] [instance: ac175c18-47f4-4b20-8567-fefb1b701d04] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:01:43.679333 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-43adda02-6e10-4043-9bcd-5d01647cee95 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:01:43.682886 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-43adda02-6e10-4043-9bcd-5d01647cee95 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:01:43.684750 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-43adda02-6e10-4043-9bcd-5d01647cee95 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:01:43.685905 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-43adda02-6e10-4043-9bcd-5d01647cee95 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:01:43.686095 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-43adda02-6e10-4043-9bcd-5d01647cee95 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:01:43.690573 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-43adda02-6e10-4043-9bcd-5d01647cee95 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:01:43.939643 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-43adda02-6e10-4043-9bcd-5d01647cee95 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb496b3faac4abbae73d389f2042e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e2520220d454764b8c139a58d78ac83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:01:43.957708 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-43adda02-6e10-4043-9bcd-5d01647cee95 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] 10.222.0.13 "GET /compute/v2.1/servers/ac175c18-47f4-4b20-8567-fefb1b701d04" status: 200 len: 1271 microversion: 2.1 time: 0.314328 Nov 01 19:01:43.961970 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1030/2073] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:01:43 2022] GET /compute/v2.1/servers/ac175c18-47f4-4b20-8567-fefb1b701d04 => generated 1271 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:01:43.971848 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-77c31c0d-9a7d-4116-a8a7-0e5765cbffa4 tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] Calling method '.version_select at 0x7f0ae6713790>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:01:44.256864 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-91a974b4-8675-4b7f-8dcc-8e4441a39319 tempest-ImagesMetadataTestJSON-181442662 tempest-ImagesMetadataTestJSON-181442662-project] 10.222.0.13 "PUT /compute/v2.1/images/89c8336f-222b-4698-8aa3-6bf840330a13/metadata" status: 200 len: 64 microversion: 2.1 time: 0.861040 Nov 01 19:01:44.257456 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1044/2074] 10.222.0.13 () {60 vars in 1280 bytes} [Tue Nov 1 19:01:43 2022] PUT /compute/v2.1/images/89c8336f-222b-4698-8aa3-6bf840330a13/metadata => generated 64 bytes in 885 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 01 19:01:44.262777 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-0c0ed8b2-b867-466d-9450-4f5261de14f7 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:01:44.265665 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-0c0ed8b2-b867-466d-9450-4f5261de14f7 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] [instance: 90b353ab-ef97-4d88-b5bc-b355ff576225] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:01:44.281027 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-77c31c0d-9a7d-4116-a8a7-0e5765cbffa4 tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] 10.222.0.13 "GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.13%2Fcompute%2Fv2.1%2Fservers%2Fc34b04e9-a50a-4c58-85ff-ecef0bfc0343" status: 200 len: 1467 microversion: 2.1 time: 0.316830 Nov 01 19:01:44.281665 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1031/2075] 10.222.0.13 () {58 vars in 1338 bytes} [Tue Nov 1 19:01:43 2022] GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.13%2Fcompute%2Fv2.1%2Fservers%2Fc34b04e9-a50a-4c58-85ff-ecef0bfc0343 => generated 1467 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:01:44.285982 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-0c0ed8b2-b867-466d-9450-4f5261de14f7 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:01:44.286809 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-0c0ed8b2-b867-466d-9450-4f5261de14f7 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:01:44.287495 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-0c0ed8b2-b867-466d-9450-4f5261de14f7 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:01:44.290019 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-0c0ed8b2-b867-466d-9450-4f5261de14f7 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:01:44.292631 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-0c0ed8b2-b867-466d-9450-4f5261de14f7 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:01:44.295912 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-0c0ed8b2-b867-466d-9450-4f5261de14f7 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:01:44.301572 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-6fab43fd-5708-4a9e-b790-c2aed8c9f7fb tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:01:44.304238 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-6fab43fd-5708-4a9e-b790-c2aed8c9f7fb tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] [instance: cd879708-f757-4f88-bc95-38b6cd55363c] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:01:44.323399 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-6fab43fd-5708-4a9e-b790-c2aed8c9f7fb tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:01:44.324315 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-6fab43fd-5708-4a9e-b790-c2aed8c9f7fb tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:01:44.325034 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-6fab43fd-5708-4a9e-b790-c2aed8c9f7fb tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:01:44.326032 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-6fab43fd-5708-4a9e-b790-c2aed8c9f7fb tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:01:44.326786 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-6fab43fd-5708-4a9e-b790-c2aed8c9f7fb tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:01:44.327470 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-6fab43fd-5708-4a9e-b790-c2aed8c9f7fb tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:01:44.687713 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-6fab43fd-5708-4a9e-b790-c2aed8c9f7fb tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:01:44.698440 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-6fab43fd-5708-4a9e-b790-c2aed8c9f7fb tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:01:44.702517 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-6fab43fd-5708-4a9e-b790-c2aed8c9f7fb tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:01:44.708216 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-6fab43fd-5708-4a9e-b790-c2aed8c9f7fb tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] 10.222.0.13 "GET /compute/v2.1/servers/cd879708-f757-4f88-bc95-38b6cd55363c" status: 200 len: 1486 microversion: 2.25 time: 0.425484 Nov 01 19:01:44.710377 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1032/2076] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 19:01:44 2022] GET /compute/v2.1/servers/cd879708-f757-4f88-bc95-38b6cd55363c => generated 1486 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 19:01:44.725110 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-43c2b115-b581-447b-8819-7a11dd71b4b3 tempest-ImagesMetadataTestJSON-181442662 tempest-ImagesMetadataTestJSON-181442662-project] Calling method '.version_select at 0x7f0ae21024c0>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:01:44.809495 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-43c2b115-b581-447b-8819-7a11dd71b4b3 tempest-ImagesMetadataTestJSON-181442662 tempest-ImagesMetadataTestJSON-181442662-project] 10.222.0.13 "GET /compute/v2.1/images/89c8336f-222b-4698-8aa3-6bf840330a13/metadata" status: 200 len: 64 microversion: 2.1 time: 0.096763 Nov 01 19:01:44.810640 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1033/2077] 10.222.0.13 () {58 vars in 1260 bytes} [Tue Nov 1 19:01:44 2022] GET /compute/v2.1/images/89c8336f-222b-4698-8aa3-6bf840330a13/metadata => generated 64 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 01 19:01:44.819807 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-d4c51de6-6971-4803-b5e4-82875af2e774 tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] Calling method '.version_select at 0x7f0ae20a51f0>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:01:44.903705 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-d4c51de6-6971-4803-b5e4-82875af2e774 tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] 10.222.0.13 "GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.13%2Fcompute%2Fservers%2Fc34b04e9-a50a-4c58-85ff-ecef0bfc0343" status: 200 len: 1467 microversion: 2.1 time: 0.090766 Nov 01 19:01:44.904542 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1034/2078] 10.222.0.13 () {58 vars in 1324 bytes} [Tue Nov 1 19:01:44 2022] GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.13%2Fcompute%2Fservers%2Fc34b04e9-a50a-4c58-85ff-ecef0bfc0343 => generated 1467 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:01:44.910490 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-66bcbafb-01b1-418e-a049-4fb448d90549 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:01:44.911326 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-66bcbafb-01b1-418e-a049-4fb448d90549 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] [instance: 1f499af7-1896-478c-b7d7-d922bf78bd98] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:01:44.923190 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-66bcbafb-01b1-418e-a049-4fb448d90549 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:01:44.924265 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-66bcbafb-01b1-418e-a049-4fb448d90549 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:01:44.925295 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-66bcbafb-01b1-418e-a049-4fb448d90549 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:01:44.926200 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-66bcbafb-01b1-418e-a049-4fb448d90549 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:01:44.926845 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-66bcbafb-01b1-418e-a049-4fb448d90549 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:01:44.928847 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-66bcbafb-01b1-418e-a049-4fb448d90549 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:01:45.026890 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-66bcbafb-01b1-418e-a049-4fb448d90549 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f32f5fba1976432d938e664c7714e52b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b9d4c236b944f9b2e8e502a50a8f8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:01:45.040119 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-66bcbafb-01b1-418e-a049-4fb448d90549 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] 10.222.0.13 "GET /compute/v2.1/servers/1f499af7-1896-478c-b7d7-d922bf78bd98" status: 200 len: 1184 microversion: 2.1 time: 0.133421 Nov 01 19:01:45.046458 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1035/2079] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:01:44 2022] GET /compute/v2.1/servers/1f499af7-1896-478c-b7d7-d922bf78bd98 => generated 1184 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:01:45.055196 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-f8dd5eb3-1593-40cd-9652-18b382560319 tempest-ImagesMetadataTestJSON-181442662 tempest-ImagesMetadataTestJSON-181442662-project] Action: 'update_all', calling method: .version_select at 0x7f0ae2102c10>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:01:45.152829 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.quota [None req-f8dd5eb3-1593-40cd-9652-18b382560319 tempest-ImagesMetadataTestJSON-181442662 tempest-ImagesMetadataTestJSON-181442662-project] Getting quotas for project 952ebce7ac214507aa7832df094c375a. Resources: dict_keys(['metadata_items']) {{(pid=121403) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 01 19:01:45.174732 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.quota [None req-f8dd5eb3-1593-40cd-9652-18b382560319 tempest-ImagesMetadataTestJSON-181442662 tempest-ImagesMetadataTestJSON-181442662-project] Getting quotas for user eb78400a7f8c4c59afe2e4d2f514342c and project 952ebce7ac214507aa7832df094c375a. Resources: dict_keys(['metadata_items']) {{(pid=121403) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 01 19:01:45.280879 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-0c0ed8b2-b867-466d-9450-4f5261de14f7 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a63d69c99a546f0af16329cff3ca717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a1bb191cff948e99c008b5e861ce4a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:01:45.293332 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-0c0ed8b2-b867-466d-9450-4f5261de14f7 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] 10.222.0.13 "GET /compute/v2.1/servers/90b353ab-ef97-4d88-b5bc-b355ff576225" status: 200 len: 1736 microversion: 2.1 time: 1.034664 Nov 01 19:01:45.293986 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1045/2080] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:01:44 2022] GET /compute/v2.1/servers/90b353ab-ef97-4d88-b5bc-b355ff576225 => generated 1736 bytes in 1036 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:01:45.307811 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-117978c7-068b-4f07-a786-a839136dfaf1 tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] Calling method '.version_select at 0x7f0ae2659b80>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:01:45.581777 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-117978c7-068b-4f07-a786-a839136dfaf1 tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] 10.222.0.13 "GET /compute/v2.1/images/detail?status=ACTIVE" status: 200 len: 7107 microversion: 2.1 time: 0.268297 Nov 01 19:01:45.582460 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1046/2081] 10.222.0.13 () {58 vars in 1170 bytes} [Tue Nov 1 19:01:45 2022] GET /compute/v2.1/images/detail?status=ACTIVE => generated 7107 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:01:45.588400 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-88bc147b-08ad-4603-b7af-5236d6507e0d tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:01:45.589035 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-88bc147b-08ad-4603-b7af-5236d6507e0d tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] [instance: ac175c18-47f4-4b20-8567-fefb1b701d04] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:01:45.617639 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-88bc147b-08ad-4603-b7af-5236d6507e0d tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:01:45.618283 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-88bc147b-08ad-4603-b7af-5236d6507e0d tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:01:45.618735 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-88bc147b-08ad-4603-b7af-5236d6507e0d tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:01:45.619459 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-88bc147b-08ad-4603-b7af-5236d6507e0d tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:01:45.621416 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-88bc147b-08ad-4603-b7af-5236d6507e0d tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:01:45.621852 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-88bc147b-08ad-4603-b7af-5236d6507e0d tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:01:45.951300 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-f8dd5eb3-1593-40cd-9652-18b382560319 tempest-ImagesMetadataTestJSON-181442662 tempest-ImagesMetadataTestJSON-181442662-project] 10.222.0.13 "PUT /compute/v2.1/images/89c8336f-222b-4698-8aa3-6bf840330a13/metadata" status: 200 len: 61 microversion: 2.1 time: 0.902725 Nov 01 19:01:45.954349 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1036/2082] 10.222.0.13 () {60 vars in 1280 bytes} [Tue Nov 1 19:01:45 2022] PUT /compute/v2.1/images/89c8336f-222b-4698-8aa3-6bf840330a13/metadata => generated 61 bytes in 907 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 01 19:01:45.960280 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-73129baa-bf7a-4872-959e-dfb19c4199a4 tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] Calling method '.version_select at 0x7f0ae210ea60>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:01:46.049166 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-73129baa-bf7a-4872-959e-dfb19c4199a4 tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] 10.222.0.13 "GET /compute/v2.1/images/detail?type=snapshot" status: 200 len: 4376 microversion: 2.1 time: 0.093208 Nov 01 19:01:46.050651 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1037/2083] 10.222.0.13 () {58 vars in 1170 bytes} [Tue Nov 1 19:01:45 2022] GET /compute/v2.1/images/detail?type=snapshot => generated 4376 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:01:46.055758 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-c5b6d2f1-6261-4a75-ad3f-3e5c90284962 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:01:46.056624 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-c5b6d2f1-6261-4a75-ad3f-3e5c90284962 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] [instance: cd879708-f757-4f88-bc95-38b6cd55363c] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:01:46.068512 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-c5b6d2f1-6261-4a75-ad3f-3e5c90284962 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:01:46.069370 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-c5b6d2f1-6261-4a75-ad3f-3e5c90284962 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:01:46.070007 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-c5b6d2f1-6261-4a75-ad3f-3e5c90284962 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:01:46.071697 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-c5b6d2f1-6261-4a75-ad3f-3e5c90284962 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:01:46.072404 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-c5b6d2f1-6261-4a75-ad3f-3e5c90284962 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:01:46.073099 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-c5b6d2f1-6261-4a75-ad3f-3e5c90284962 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:01:46.285804 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-88bc147b-08ad-4603-b7af-5236d6507e0d tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb496b3faac4abbae73d389f2042e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e2520220d454764b8c139a58d78ac83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:01:46.298855 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-88bc147b-08ad-4603-b7af-5236d6507e0d tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] 10.222.0.13 "GET /compute/v2.1/servers/ac175c18-47f4-4b20-8567-fefb1b701d04" status: 200 len: 1313 microversion: 2.1 time: 0.712415 Nov 01 19:01:46.315476 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1047/2084] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:01:45 2022] GET /compute/v2.1/servers/ac175c18-47f4-4b20-8567-fefb1b701d04 => generated 1313 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:01:46.334594 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-da0306db-6b76-44e4-8b7b-da67da8a0dbb tempest-ImagesMetadataTestJSON-181442662 tempest-ImagesMetadataTestJSON-181442662-project] Action: 'update', calling method: .version_select at 0x7f0ae2db3f70>, body: {"meta": {"os_version": "alt"}} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:01:46.437216 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.quota [None req-da0306db-6b76-44e4-8b7b-da67da8a0dbb tempest-ImagesMetadataTestJSON-181442662 tempest-ImagesMetadataTestJSON-181442662-project] Getting quotas for project 952ebce7ac214507aa7832df094c375a. Resources: dict_keys(['metadata_items']) {{(pid=121402) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 01 19:01:46.454528 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-c5b6d2f1-6261-4a75-ad3f-3e5c90284962 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:01:46.454795 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.quota [None req-da0306db-6b76-44e4-8b7b-da67da8a0dbb tempest-ImagesMetadataTestJSON-181442662 tempest-ImagesMetadataTestJSON-181442662-project] Getting quotas for user eb78400a7f8c4c59afe2e4d2f514342c and project 952ebce7ac214507aa7832df094c375a. Resources: dict_keys(['metadata_items']) {{(pid=121402) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 01 19:01:46.472121 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-c5b6d2f1-6261-4a75-ad3f-3e5c90284962 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:01:46.478341 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-c5b6d2f1-6261-4a75-ad3f-3e5c90284962 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:01:46.484119 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-c5b6d2f1-6261-4a75-ad3f-3e5c90284962 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] 10.222.0.13 "GET /compute/v2.1/servers/cd879708-f757-4f88-bc95-38b6cd55363c" status: 200 len: 1486 microversion: 2.25 time: 0.430796 Nov 01 19:01:46.485129 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1038/2085] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 19:01:46 2022] GET /compute/v2.1/servers/cd879708-f757-4f88-bc95-38b6cd55363c => generated 1486 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 19:01:46.503651 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-4aa50b88-4f97-4b23-b4ee-493fe50523ef tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] Calling method '.version_select at 0x7f0ae67e34c0>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:01:46.653716 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-4aa50b88-4f97-4b23-b4ee-493fe50523ef tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] 10.222.0.13 "GET /compute/v2.1/images/2d4a0047-1b9e-445f-8af8-1b5c9d93e881" status: 200 len: 784 microversion: 2.1 time: 0.166564 Nov 01 19:01:46.654628 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1039/2086] 10.222.0.13 () {58 vars in 1233 bytes} [Tue Nov 1 19:01:46 2022] GET /compute/v2.1/images/2d4a0047-1b9e-445f-8af8-1b5c9d93e881 => generated 784 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:01:46.665854 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-7a9b47da-1c14-43bc-8f7b-a16279fb80e3 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:01:46.667327 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-7a9b47da-1c14-43bc-8f7b-a16279fb80e3 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] [instance: 1f499af7-1896-478c-b7d7-d922bf78bd98] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:01:46.682825 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-7a9b47da-1c14-43bc-8f7b-a16279fb80e3 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:01:46.683403 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-7a9b47da-1c14-43bc-8f7b-a16279fb80e3 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:01:46.683742 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-7a9b47da-1c14-43bc-8f7b-a16279fb80e3 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:01:46.684455 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-7a9b47da-1c14-43bc-8f7b-a16279fb80e3 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:01:46.684932 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-7a9b47da-1c14-43bc-8f7b-a16279fb80e3 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:01:46.685354 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-7a9b47da-1c14-43bc-8f7b-a16279fb80e3 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:01:46.912296 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-7a9b47da-1c14-43bc-8f7b-a16279fb80e3 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f32f5fba1976432d938e664c7714e52b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b9d4c236b944f9b2e8e502a50a8f8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:01:46.926659 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-7a9b47da-1c14-43bc-8f7b-a16279fb80e3 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] 10.222.0.13 "GET /compute/v2.1/servers/1f499af7-1896-478c-b7d7-d922bf78bd98" status: 200 len: 1184 microversion: 2.1 time: 0.270516 Nov 01 19:01:46.927260 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1040/2087] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:01:46 2022] GET /compute/v2.1/servers/1f499af7-1896-478c-b7d7-d922bf78bd98 => generated 1184 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:01:46.967975 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-fa9494ff-5349-4bca-81d7-3999c1c2bcc7 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:01:46.971650 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-fa9494ff-5349-4bca-81d7-3999c1c2bcc7 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] [instance: 90b353ab-ef97-4d88-b5bc-b355ff576225] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:01:46.990484 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-fa9494ff-5349-4bca-81d7-3999c1c2bcc7 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:01:46.991538 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-fa9494ff-5349-4bca-81d7-3999c1c2bcc7 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:01:46.993792 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-fa9494ff-5349-4bca-81d7-3999c1c2bcc7 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:01:46.994775 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-fa9494ff-5349-4bca-81d7-3999c1c2bcc7 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:01:46.997210 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-fa9494ff-5349-4bca-81d7-3999c1c2bcc7 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:01:46.998704 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-fa9494ff-5349-4bca-81d7-3999c1c2bcc7 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:01:47.129713 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-da0306db-6b76-44e4-8b7b-da67da8a0dbb tempest-ImagesMetadataTestJSON-181442662 tempest-ImagesMetadataTestJSON-181442662-project] 10.222.0.13 "PUT /compute/v2.1/images/89c8336f-222b-4698-8aa3-6bf840330a13/metadata/os_version" status: 200 len: 31 microversion: 2.1 time: 0.808110 Nov 01 19:01:47.131178 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1048/2088] 10.222.0.13 () {60 vars in 1313 bytes} [Tue Nov 1 19:01:46 2022] PUT /compute/v2.1/images/89c8336f-222b-4698-8aa3-6bf840330a13/metadata/os_version => generated 31 bytes in 815 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 01 19:01:47.136472 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [req-6515061d-0908-4b74-b915-efb217f0f716 req-1fdcde74-315d-46ad-a7f0-94e0fc1aae82 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "992f5ec5-d256-4870-b16d-fc8d9adbd3e7", "tag": "30841eab-b46a-44ca-adc8-04928cc72ec5"}]} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:01:47.154871 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-6515061d-0908-4b74-b915-efb217f0f716 req-1fdcde74-315d-46ad-a7f0-94e0fc1aae82 service nova] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:01:47.160889 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-6515061d-0908-4b74-b915-efb217f0f716 req-1fdcde74-315d-46ad-a7f0-94e0fc1aae82 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:01:47.163228 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-6515061d-0908-4b74-b915-efb217f0f716 req-1fdcde74-315d-46ad-a7f0-94e0fc1aae82 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:01:47.177878 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.compute.server_external_events [req-6515061d-0908-4b74-b915-efb217f0f716 req-1fdcde74-315d-46ad-a7f0-94e0fc1aae82 service nova] Creating event network-changed:30841eab-b46a-44ca-adc8-04928cc72ec5 for instance 992f5ec5-d256-4870-b16d-fc8d9adbd3e7 on n-h1-863052-2 Nov 01 19:01:47.184033 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [req-6515061d-0908-4b74-b915-efb217f0f716 req-1fdcde74-315d-46ad-a7f0-94e0fc1aae82 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051389 Nov 01 19:01:47.185108 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1049/2089] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Nov 1 19:01:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:01:47.191488 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-d74c8182-653a-4975-98ec-99a69d7f958c tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] Calling method '.version_select at 0x7f0ae1d5b4c0>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:01:47.282830 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-d74c8182-653a-4975-98ec-99a69d7f958c tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] 10.222.0.13 "GET /compute/v2.1/images/detail?limit=1" status: 200 len: 1611 microversion: 2.1 time: 0.093838 Nov 01 19:01:47.283891 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1050/2090] 10.222.0.13 () {58 vars in 1158 bytes} [Tue Nov 1 19:01:47 2022] GET /compute/v2.1/images/detail?limit=1 => generated 1611 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:01:47.291655 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [req-85a9afe7-3131-4916-bc92-43eb79cdbd00 req-e83ced95-4a26-4da7-aa0b-9ac63bc611f9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ac175c18-47f4-4b20-8567-fefb1b701d04", "tag": "fc89caa1-e6b4-4cd2-ae6d-02c9e8d9c421"}]} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:01:47.331121 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-85a9afe7-3131-4916-bc92-43eb79cdbd00 req-e83ced95-4a26-4da7-aa0b-9ac63bc611f9 service nova] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:01:47.334084 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-85a9afe7-3131-4916-bc92-43eb79cdbd00 req-e83ced95-4a26-4da7-aa0b-9ac63bc611f9 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:01:47.334859 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-85a9afe7-3131-4916-bc92-43eb79cdbd00 req-e83ced95-4a26-4da7-aa0b-9ac63bc611f9 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:01:47.350870 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.compute.server_external_events [req-85a9afe7-3131-4916-bc92-43eb79cdbd00 req-e83ced95-4a26-4da7-aa0b-9ac63bc611f9 service nova] Creating event network-changed:fc89caa1-e6b4-4cd2-ae6d-02c9e8d9c421 for instance ac175c18-47f4-4b20-8567-fefb1b701d04 on n-h2-863052-2 Nov 01 19:01:47.362313 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [req-85a9afe7-3131-4916-bc92-43eb79cdbd00 req-e83ced95-4a26-4da7-aa0b-9ac63bc611f9 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077289 Nov 01 19:01:47.370244 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1051/2091] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Nov 1 19:01:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:01:47.375785 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-aef232fa-3991-41fb-9d92-6eb7ccaa3585 tempest-ImagesMetadataTestJSON-181442662 tempest-ImagesMetadataTestJSON-181442662-project] Calling method '.version_select at 0x7f0ae2db3670>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:01:47.447089 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-aef232fa-3991-41fb-9d92-6eb7ccaa3585 tempest-ImagesMetadataTestJSON-181442662 tempest-ImagesMetadataTestJSON-181442662-project] 10.222.0.13 "GET /compute/v2.1/images/89c8336f-222b-4698-8aa3-6bf840330a13/metadata" status: 200 len: 58 microversion: 2.1 time: 0.075423 Nov 01 19:01:47.448016 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1052/2092] 10.222.0.13 () {58 vars in 1260 bytes} [Tue Nov 1 19:01:47 2022] GET /compute/v2.1/images/89c8336f-222b-4698-8aa3-6bf840330a13/metadata => generated 58 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 01 19:01:47.461643 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-446dd85e-5e46-42e7-85f1-044d303d6c0e tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] Calling method '.version_select at 0x7f0ae1d5bf70>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:01:48.379519 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-fa9494ff-5349-4bca-81d7-3999c1c2bcc7 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a63d69c99a546f0af16329cff3ca717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a1bb191cff948e99c008b5e861ce4a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:01:48.391402 n-d-863052-2 devstack@n-api.service[121403]: DEBUG dbcounter [-] [121403] Writing DB stats nova_cell0:SELECT=4 {{(pid=121403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 19:01:48.394847 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-fa9494ff-5349-4bca-81d7-3999c1c2bcc7 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] 10.222.0.13 "GET /compute/v2.1/servers/90b353ab-ef97-4d88-b5bc-b355ff576225" status: 200 len: 1736 microversion: 2.1 time: 1.447557 Nov 01 19:01:48.397074 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-446dd85e-5e46-42e7-85f1-044d303d6c0e tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] 10.222.0.13 "DELETE /compute/v2.1/images/52ccd7d5-4eba-4e0d-97f4-a4927c3504a7" status: 204 len: 0 microversion: 2.1 time: 0.947757 Nov 01 19:01:48.397961 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1053/2093] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:01:47 2022] DELETE /compute/v2.1/images/52ccd7d5-4eba-4e0d-97f4-a4927c3504a7 => generated 0 bytes in 949 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 01 19:01:48.404648 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-de5168fe-4733-48d7-805f-65fd664acce6 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:01:48.405700 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-de5168fe-4733-48d7-805f-65fd664acce6 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] [instance: ac175c18-47f4-4b20-8567-fefb1b701d04] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:01:48.412864 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-de5168fe-4733-48d7-805f-65fd664acce6 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:01:48.413919 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-de5168fe-4733-48d7-805f-65fd664acce6 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:01:48.414747 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-de5168fe-4733-48d7-805f-65fd664acce6 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:01:48.415203 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1041/2094] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:01:46 2022] GET /compute/v2.1/servers/90b353ab-ef97-4d88-b5bc-b355ff576225 => generated 1736 bytes in 1467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:01:48.415884 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-de5168fe-4733-48d7-805f-65fd664acce6 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:01:48.416547 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-de5168fe-4733-48d7-805f-65fd664acce6 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:01:48.417227 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-de5168fe-4733-48d7-805f-65fd664acce6 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:01:48.441179 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-da5a5754-29fc-4088-b690-9c9cf695aa09 tempest-ImagesMetadataTestJSON-181442662 tempest-ImagesMetadataTestJSON-181442662-project] Action: 'update_all', calling method: .version_select at 0x7f0ae20a5310>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:01:48.563023 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.quota [None req-da5a5754-29fc-4088-b690-9c9cf695aa09 tempest-ImagesMetadataTestJSON-181442662 tempest-ImagesMetadataTestJSON-181442662-project] Getting quotas for project 952ebce7ac214507aa7832df094c375a. Resources: dict_keys(['metadata_items']) {{(pid=121403) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 01 19:01:48.581711 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.quota [None req-da5a5754-29fc-4088-b690-9c9cf695aa09 tempest-ImagesMetadataTestJSON-181442662 tempest-ImagesMetadataTestJSON-181442662-project] Getting quotas for user eb78400a7f8c4c59afe2e4d2f514342c and project 952ebce7ac214507aa7832df094c375a. Resources: dict_keys(['metadata_items']) {{(pid=121403) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 01 19:01:48.618493 n-d-863052-2 devstack@n-api.service[121403]: DEBUG dbcounter [-] [121403] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=121403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 19:01:48.785234 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-de5168fe-4733-48d7-805f-65fd664acce6 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb496b3faac4abbae73d389f2042e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e2520220d454764b8c139a58d78ac83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:01:48.807758 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-de5168fe-4733-48d7-805f-65fd664acce6 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] 10.222.0.13 "GET /compute/v2.1/servers/ac175c18-47f4-4b20-8567-fefb1b701d04" status: 200 len: 1313 microversion: 2.1 time: 0.405149 Nov 01 19:01:48.810628 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1054/2095] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:01:48 2022] GET /compute/v2.1/servers/ac175c18-47f4-4b20-8567-fefb1b701d04 => generated 1313 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:01:48.816907 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-a414d033-96d8-4306-970c-96ebaa8e6f5a tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:01:48.817601 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-a414d033-96d8-4306-970c-96ebaa8e6f5a tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] [instance: cd879708-f757-4f88-bc95-38b6cd55363c] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:01:48.821616 n-d-863052-2 devstack@n-api.service[121402]: DEBUG dbcounter [-] [121402] Writing DB stats nova_api:SELECT=98,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=121402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 19:01:48.830003 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-a414d033-96d8-4306-970c-96ebaa8e6f5a tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:01:48.830508 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-a414d033-96d8-4306-970c-96ebaa8e6f5a tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:01:48.830956 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-a414d033-96d8-4306-970c-96ebaa8e6f5a tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:01:48.831913 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-a414d033-96d8-4306-970c-96ebaa8e6f5a tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:01:48.834230 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-a414d033-96d8-4306-970c-96ebaa8e6f5a tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:01:48.834891 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-a414d033-96d8-4306-970c-96ebaa8e6f5a tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:01:48.985229 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-da5a5754-29fc-4088-b690-9c9cf695aa09 tempest-ImagesMetadataTestJSON-181442662 tempest-ImagesMetadataTestJSON-181442662-project] 10.222.0.13 "PUT /compute/v2.1/images/89c8336f-222b-4698-8aa3-6bf840330a13/metadata" status: 200 len: 61 microversion: 2.1 time: 0.568229 Nov 01 19:01:48.986378 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1042/2096] 10.222.0.13 () {60 vars in 1280 bytes} [Tue Nov 1 19:01:48 2022] PUT /compute/v2.1/images/89c8336f-222b-4698-8aa3-6bf840330a13/metadata => generated 61 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 01 19:01:48.995546 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-18a495b8-0727-43d0-940d-c859bde0fe33 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:01:48.997649 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-18a495b8-0727-43d0-940d-c859bde0fe33 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] [instance: 1f499af7-1896-478c-b7d7-d922bf78bd98] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:01:49.023807 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-18a495b8-0727-43d0-940d-c859bde0fe33 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:01:49.031053 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-18a495b8-0727-43d0-940d-c859bde0fe33 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:01:49.031991 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-18a495b8-0727-43d0-940d-c859bde0fe33 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:01:49.036897 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-18a495b8-0727-43d0-940d-c859bde0fe33 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:01:49.037632 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-18a495b8-0727-43d0-940d-c859bde0fe33 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:01:49.038301 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-18a495b8-0727-43d0-940d-c859bde0fe33 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:01:49.127843 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-18a495b8-0727-43d0-940d-c859bde0fe33 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f32f5fba1976432d938e664c7714e52b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b9d4c236b944f9b2e8e502a50a8f8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:01:49.138182 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-18a495b8-0727-43d0-940d-c859bde0fe33 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] 10.222.0.13 "GET /compute/v2.1/servers/1f499af7-1896-478c-b7d7-d922bf78bd98" status: 200 len: 1184 microversion: 2.1 time: 0.150134 Nov 01 19:01:49.139561 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1043/2097] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:01:48 2022] GET /compute/v2.1/servers/1f499af7-1896-478c-b7d7-d922bf78bd98 => generated 1184 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:01:49.145316 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-1bd82c2d-f210-476e-8d68-87962da67278 tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] Calling method '.version_select at 0x7f0ae28bdd30>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:01:49.208443 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-a414d033-96d8-4306-970c-96ebaa8e6f5a tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:01:49.218841 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-a414d033-96d8-4306-970c-96ebaa8e6f5a tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:01:49.224393 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-a414d033-96d8-4306-970c-96ebaa8e6f5a tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:01:49.225892 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-a414d033-96d8-4306-970c-96ebaa8e6f5a tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] 10.222.0.13 "GET /compute/v2.1/servers/cd879708-f757-4f88-bc95-38b6cd55363c" status: 200 len: 1486 microversion: 2.25 time: 0.413696 Nov 01 19:01:49.226970 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1055/2098] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 19:01:48 2022] GET /compute/v2.1/servers/cd879708-f757-4f88-bc95-38b6cd55363c => generated 1486 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 19:01:49.247211 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-540a0151-6c9d-4b68-9176-4f8df7cbe14e tempest-ImagesMetadataTestJSON-181442662 tempest-ImagesMetadataTestJSON-181442662-project] Action: 'create', calling method: .version_select at 0x7f0ae2df9790>, body: {"metadata": {"os_version": "alt1", "architecture": "value3"}} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:01:49.337042 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.quota [None req-540a0151-6c9d-4b68-9176-4f8df7cbe14e tempest-ImagesMetadataTestJSON-181442662 tempest-ImagesMetadataTestJSON-181442662-project] Getting quotas for project 952ebce7ac214507aa7832df094c375a. Resources: dict_keys(['metadata_items']) {{(pid=121402) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 01 19:01:49.367214 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.quota [None req-540a0151-6c9d-4b68-9176-4f8df7cbe14e tempest-ImagesMetadataTestJSON-181442662 tempest-ImagesMetadataTestJSON-181442662-project] Getting quotas for user eb78400a7f8c4c59afe2e4d2f514342c and project 952ebce7ac214507aa7832df094c375a. Resources: dict_keys(['metadata_items']) {{(pid=121402) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 01 19:01:49.967916 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-1bd82c2d-f210-476e-8d68-87962da67278 tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] 10.222.0.13 "DELETE /compute/v2.1/images/ccc79e7f-4589-43b9-a2ca-2a8f13b6602d" status: 204 len: 0 microversion: 2.1 time: 0.826994 Nov 01 19:01:49.968572 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1044/2099] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:01:49 2022] DELETE /compute/v2.1/images/ccc79e7f-4589-43b9-a2ca-2a8f13b6602d => generated 0 bytes in 828 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 01 19:01:49.977299 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-1c6dfdfa-0395-4388-9244-3f0238b43cce tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:01:49.977835 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-1c6dfdfa-0395-4388-9244-3f0238b43cce tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] [instance: 90b353ab-ef97-4d88-b5bc-b355ff576225] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:01:50.000471 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-1c6dfdfa-0395-4388-9244-3f0238b43cce tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:01:50.005745 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-1c6dfdfa-0395-4388-9244-3f0238b43cce tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:01:50.008870 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-1c6dfdfa-0395-4388-9244-3f0238b43cce tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:01:50.013513 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-1c6dfdfa-0395-4388-9244-3f0238b43cce tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:01:50.014583 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-1c6dfdfa-0395-4388-9244-3f0238b43cce tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:01:50.017205 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-1c6dfdfa-0395-4388-9244-3f0238b43cce tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:01:50.087836 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-540a0151-6c9d-4b68-9176-4f8df7cbe14e tempest-ImagesMetadataTestJSON-181442662 tempest-ImagesMetadataTestJSON-181442662-project] 10.222.0.13 "POST /compute/v2.1/images/89c8336f-222b-4698-8aa3-6bf840330a13/metadata" status: 200 len: 85 microversion: 2.1 time: 0.858516 Nov 01 19:01:50.097621 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1056/2100] 10.222.0.13 () {60 vars in 1281 bytes} [Tue Nov 1 19:01:49 2022] POST /compute/v2.1/images/89c8336f-222b-4698-8aa3-6bf840330a13/metadata => generated 85 bytes in 869 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 01 19:01:50.106481 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-a5448f3e-98fd-44bb-9c0a-462061b90810 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:01:50.107105 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-a5448f3e-98fd-44bb-9c0a-462061b90810 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] [instance: ac175c18-47f4-4b20-8567-fefb1b701d04] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:01:50.163479 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-a5448f3e-98fd-44bb-9c0a-462061b90810 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:01:50.164147 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-a5448f3e-98fd-44bb-9c0a-462061b90810 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:01:50.168048 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-a5448f3e-98fd-44bb-9c0a-462061b90810 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:01:50.168916 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-a5448f3e-98fd-44bb-9c0a-462061b90810 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:01:50.169407 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-a5448f3e-98fd-44bb-9c0a-462061b90810 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:01:50.176436 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-a5448f3e-98fd-44bb-9c0a-462061b90810 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:01:50.863104 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-a5448f3e-98fd-44bb-9c0a-462061b90810 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb496b3faac4abbae73d389f2042e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e2520220d454764b8c139a58d78ac83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:01:50.864902 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-1c6dfdfa-0395-4388-9244-3f0238b43cce tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a63d69c99a546f0af16329cff3ca717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a1bb191cff948e99c008b5e861ce4a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:01:50.877231 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-a5448f3e-98fd-44bb-9c0a-462061b90810 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] 10.222.0.13 "GET /compute/v2.1/servers/ac175c18-47f4-4b20-8567-fefb1b701d04" status: 200 len: 1313 microversion: 2.1 time: 0.778345 Nov 01 19:01:50.888613 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1057/2101] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:01:50 2022] GET /compute/v2.1/servers/ac175c18-47f4-4b20-8567-fefb1b701d04 => generated 1313 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:01:50.889263 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-a944ebd2-fbf1-4c84-8321-82ec8ec67717 tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] Calling method '.version_select at 0x7f0ae2df9430>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:01:50.891512 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-1c6dfdfa-0395-4388-9244-3f0238b43cce tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] 10.222.0.13 "GET /compute/v2.1/servers/90b353ab-ef97-4d88-b5bc-b355ff576225" status: 200 len: 1736 microversion: 2.1 time: 0.918510 Nov 01 19:01:50.900646 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1045/2102] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:01:49 2022] GET /compute/v2.1/servers/90b353ab-ef97-4d88-b5bc-b355ff576225 => generated 1736 bytes in 924 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:01:50.912857 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-73263432-3030-47d4-a961-0306791adc38 tempest-ImagesMetadataTestJSON-181442662 tempest-ImagesMetadataTestJSON-181442662-project] Calling method '.version_select at 0x7f0ae209c8b0>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:01:51.008362 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-73263432-3030-47d4-a961-0306791adc38 tempest-ImagesMetadataTestJSON-181442662 tempest-ImagesMetadataTestJSON-181442662-project] 10.222.0.13 "GET /compute/v2.1/images/89c8336f-222b-4698-8aa3-6bf840330a13/metadata" status: 200 len: 85 microversion: 2.1 time: 0.104576 Nov 01 19:01:51.009713 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1046/2103] 10.222.0.13 () {58 vars in 1260 bytes} [Tue Nov 1 19:01:50 2022] GET /compute/v2.1/images/89c8336f-222b-4698-8aa3-6bf840330a13/metadata => generated 85 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 01 19:01:51.028936 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-52fbd5c0-0b88-4220-9d5c-dcfeac980a14 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:01:51.030359 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-52fbd5c0-0b88-4220-9d5c-dcfeac980a14 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] [instance: 1f499af7-1896-478c-b7d7-d922bf78bd98] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:01:51.045862 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-52fbd5c0-0b88-4220-9d5c-dcfeac980a14 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:01:51.048329 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-52fbd5c0-0b88-4220-9d5c-dcfeac980a14 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:01:51.048969 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-52fbd5c0-0b88-4220-9d5c-dcfeac980a14 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:01:51.050415 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-52fbd5c0-0b88-4220-9d5c-dcfeac980a14 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:01:51.052991 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-52fbd5c0-0b88-4220-9d5c-dcfeac980a14 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:01:51.053638 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-52fbd5c0-0b88-4220-9d5c-dcfeac980a14 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:01:51.232181 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-52fbd5c0-0b88-4220-9d5c-dcfeac980a14 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f32f5fba1976432d938e664c7714e52b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b9d4c236b944f9b2e8e502a50a8f8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:01:51.248560 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-52fbd5c0-0b88-4220-9d5c-dcfeac980a14 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] 10.222.0.13 "GET /compute/v2.1/servers/1f499af7-1896-478c-b7d7-d922bf78bd98" status: 200 len: 1184 microversion: 2.1 time: 0.237672 Nov 01 19:01:51.249453 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1047/2104] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:01:51 2022] GET /compute/v2.1/servers/1f499af7-1896-478c-b7d7-d922bf78bd98 => generated 1184 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:01:51.266308 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-b66ab57b-9887-43d9-9423-08cc09f55a20 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:01:51.267349 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-b66ab57b-9887-43d9-9423-08cc09f55a20 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] [instance: cd879708-f757-4f88-bc95-38b6cd55363c] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:01:51.277421 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-b66ab57b-9887-43d9-9423-08cc09f55a20 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:01:51.278847 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-b66ab57b-9887-43d9-9423-08cc09f55a20 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:01:51.279509 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-b66ab57b-9887-43d9-9423-08cc09f55a20 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:01:51.280429 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-b66ab57b-9887-43d9-9423-08cc09f55a20 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:01:51.281262 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-b66ab57b-9887-43d9-9423-08cc09f55a20 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:01:51.281919 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-b66ab57b-9887-43d9-9423-08cc09f55a20 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:01:51.939304 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-a944ebd2-fbf1-4c84-8321-82ec8ec67717 tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] 10.222.0.13 "DELETE /compute/v2.1/images/14008a7c-6542-4124-800d-d352127c1bb1" status: 204 len: 0 microversion: 2.1 time: 1.054824 Nov 01 19:01:51.940440 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1058/2105] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:01:50 2022] DELETE /compute/v2.1/images/14008a7c-6542-4124-800d-d352127c1bb1 => generated 0 bytes in 1061 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 01 19:01:51.947292 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [req-432b18a7-af96-4565-85bf-698557e32e7e req-55afe4c9-a58c-4fce-93ca-d23afcaffebe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cd879708-f757-4f88-bc95-38b6cd55363c", "name": "network-vif-unplugged", "status": "completed", "tag": "5814506e-bf1a-49cf-9169-b3181e825901"}]} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:01:51.980351 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-432b18a7-af96-4565-85bf-698557e32e7e req-55afe4c9-a58c-4fce-93ca-d23afcaffebe service nova] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:01:51.981674 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-432b18a7-af96-4565-85bf-698557e32e7e req-55afe4c9-a58c-4fce-93ca-d23afcaffebe service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:01:51.982109 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-432b18a7-af96-4565-85bf-698557e32e7e req-55afe4c9-a58c-4fce-93ca-d23afcaffebe service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:01:52.025395 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.compute.server_external_events [req-432b18a7-af96-4565-85bf-698557e32e7e req-55afe4c9-a58c-4fce-93ca-d23afcaffebe service nova] Creating event network-vif-unplugged:5814506e-bf1a-49cf-9169-b3181e825901 for instance cd879708-f757-4f88-bc95-38b6cd55363c on n-h2-863052-2 Nov 01 19:01:52.044205 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [req-432b18a7-af96-4565-85bf-698557e32e7e req-55afe4c9-a58c-4fce-93ca-d23afcaffebe service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.097340 Nov 01 19:01:52.045210 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1059/2106] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Nov 1 19:01:51 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:01:52.053329 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-2217efc7-9249-4885-ad2e-27571b1f6d22 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:01:52.054040 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-2217efc7-9249-4885-ad2e-27571b1f6d22 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] [instance: ac175c18-47f4-4b20-8567-fefb1b701d04] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:01:52.070974 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-b66ab57b-9887-43d9-9423-08cc09f55a20 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:01:52.074387 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2217efc7-9249-4885-ad2e-27571b1f6d22 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:01:52.075157 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2217efc7-9249-4885-ad2e-27571b1f6d22 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:01:52.075795 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2217efc7-9249-4885-ad2e-27571b1f6d22 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:01:52.080563 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2217efc7-9249-4885-ad2e-27571b1f6d22 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:01:52.081715 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2217efc7-9249-4885-ad2e-27571b1f6d22 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:01:52.082327 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2217efc7-9249-4885-ad2e-27571b1f6d22 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:01:52.085151 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-b66ab57b-9887-43d9-9423-08cc09f55a20 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:01:52.095328 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-b66ab57b-9887-43d9-9423-08cc09f55a20 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:01:52.101637 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-b66ab57b-9887-43d9-9423-08cc09f55a20 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] 10.222.0.13 "GET /compute/v2.1/servers/cd879708-f757-4f88-bc95-38b6cd55363c" status: 200 len: 1486 microversion: 2.25 time: 0.845170 Nov 01 19:01:52.102539 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1048/2107] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 19:01:51 2022] GET /compute/v2.1/servers/cd879708-f757-4f88-bc95-38b6cd55363c => generated 1486 bytes in 852 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 19:01:52.126127 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-775b358d-6152-46a5-aa44-8c9b1fd3f9cb tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:01:52.129158 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-775b358d-6152-46a5-aa44-8c9b1fd3f9cb tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] [instance: 90b353ab-ef97-4d88-b5bc-b355ff576225] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:01:52.154659 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-775b358d-6152-46a5-aa44-8c9b1fd3f9cb tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:01:52.155125 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-775b358d-6152-46a5-aa44-8c9b1fd3f9cb tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:01:52.155682 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-775b358d-6152-46a5-aa44-8c9b1fd3f9cb tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:01:52.156500 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-775b358d-6152-46a5-aa44-8c9b1fd3f9cb tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:01:52.157012 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-775b358d-6152-46a5-aa44-8c9b1fd3f9cb tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:01:52.157421 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-775b358d-6152-46a5-aa44-8c9b1fd3f9cb tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:01:52.416182 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-2217efc7-9249-4885-ad2e-27571b1f6d22 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb496b3faac4abbae73d389f2042e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e2520220d454764b8c139a58d78ac83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:01:52.447649 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-2217efc7-9249-4885-ad2e-27571b1f6d22 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] 10.222.0.13 "GET /compute/v2.1/servers/ac175c18-47f4-4b20-8567-fefb1b701d04" status: 200 len: 1313 microversion: 2.1 time: 0.401151 Nov 01 19:01:52.467083 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1060/2108] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:01:52 2022] GET /compute/v2.1/servers/ac175c18-47f4-4b20-8567-fefb1b701d04 => generated 1313 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:01:52.488565 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-cbcf0641-1fd0-4724-b98d-e6b7235418b5 tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:01:52.489106 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-cbcf0641-1fd0-4724-b98d-e6b7235418b5 tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] [instance: c34b04e9-a50a-4c58-85ff-ecef0bfc0343] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:01:52.512422 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-cbcf0641-1fd0-4724-b98d-e6b7235418b5 tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:01:52.515463 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-cbcf0641-1fd0-4724-b98d-e6b7235418b5 tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:01:52.516244 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-cbcf0641-1fd0-4724-b98d-e6b7235418b5 tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:01:52.521163 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-cbcf0641-1fd0-4724-b98d-e6b7235418b5 tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:01:52.521860 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-cbcf0641-1fd0-4724-b98d-e6b7235418b5 tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:01:52.522524 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-cbcf0641-1fd0-4724-b98d-e6b7235418b5 tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:01:52.621186 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-cbcf0641-1fd0-4724-b98d-e6b7235418b5 tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] [instance: c34b04e9-a50a-4c58-85ff-ecef0bfc0343] Going to try to terminate instance {{(pid=121402) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 01 19:01:52.887520 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-cbcf0641-1fd0-4724-b98d-e6b7235418b5 tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] 10.222.0.13 "DELETE /compute/v2.1/servers/c34b04e9-a50a-4c58-85ff-ecef0bfc0343" status: 204 len: 0 microversion: 2.1 time: 0.418803 Nov 01 19:01:52.889851 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1061/2109] 10.222.0.13 () {58 vars in 1239 bytes} [Tue Nov 1 19:01:52 2022] DELETE /compute/v2.1/servers/c34b04e9-a50a-4c58-85ff-ecef0bfc0343 => generated 0 bytes in 422 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 01 19:01:52.905669 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-a61edcb9-19ef-4663-b125-82c8ff24810b tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:01:52.907530 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-a61edcb9-19ef-4663-b125-82c8ff24810b tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] [instance: 1f499af7-1896-478c-b7d7-d922bf78bd98] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:01:52.942625 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-a61edcb9-19ef-4663-b125-82c8ff24810b tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:01:52.944088 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-a61edcb9-19ef-4663-b125-82c8ff24810b tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:01:52.944760 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-a61edcb9-19ef-4663-b125-82c8ff24810b tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:01:52.946266 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-a61edcb9-19ef-4663-b125-82c8ff24810b tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:01:52.948132 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-a61edcb9-19ef-4663-b125-82c8ff24810b tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:01:52.948959 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-a61edcb9-19ef-4663-b125-82c8ff24810b tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:01:52.974058 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.wsgi [None req-a61edcb9-19ef-4663-b125-82c8ff24810b tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] HTTP exception thrown: Instance 1f499af7-1896-478c-b7d7-d922bf78bd98 could not be found. Nov 01 19:01:52.976447 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-a61edcb9-19ef-4663-b125-82c8ff24810b tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Request method failure captured: Nov 01 19:01:52.976447 n-d-863052-2 devstack@n-api.service[121402]: request: GET /compute/v2.1/servers/1f499af7-1896-478c-b7d7-d922bf78bd98 HTTP/1.1 Nov 01 19:01:52.976447 n-d-863052-2 devstack@n-api.service[121402]: Accept: application/json Nov 01 19:01:52.976447 n-d-863052-2 devstack@n-api.service[121402]: Accept-Encoding: identity Nov 01 19:01:52.976447 n-d-863052-2 devstack@n-api.service[121402]: Connection: close Nov 01 19:01:52.976447 n-d-863052-2 devstack@n-api.service[121402]: Content-Length: 0 Nov 01 19:01:52.976447 n-d-863052-2 devstack@n-api.service[121402]: Content-Type: application/json Nov 01 19:01:52.976447 n-d-863052-2 devstack@n-api.service[121402]: Host: 10.222.0.13 Nov 01 19:01:52.976447 n-d-863052-2 devstack@n-api.service[121402]: Openstack-System-Scope: None Nov 01 19:01:52.976447 n-d-863052-2 devstack@n-api.service[121402]: User-Agent: python-urllib3/1.26.12 Nov 01 19:01:52.976447 n-d-863052-2 devstack@n-api.service[121402]: X-Auth-Token: gAAAAABjYWt-NQXke2xaT5Zx7jRYabVG4ahAkm8OML59W5vfFJqbwex-J1ZiLL497voaQvk8mxYaO51_Dy7DE73iezGuKz14bZTbSfTjEO0SNQwkG26Td9pn2M3Cq9W9_GYL5mCba8SZ_e1faAE8WJGSrhBj4wfU4ft8jddNlfpfKRiwGV7JCoo Nov 01 19:01:52.976447 n-d-863052-2 devstack@n-api.service[121402]: X-Domain-Id: None Nov 01 19:01:52.976447 n-d-863052-2 devstack@n-api.service[121402]: X-Domain-Name: None Nov 01 19:01:52.976447 n-d-863052-2 devstack@n-api.service[121402]: X-Identity-Status: Confirmed Nov 01 19:01:52.976447 n-d-863052-2 devstack@n-api.service[121402]: X-Is-Admin-Project: True Nov 01 19:01:52.976447 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Domain-Id: default Nov 01 19:01:52.976447 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Domain-Name: Default Nov 01 19:01:52.976447 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Id: d9b9d4c236b944f9b2e8e502a50a8f8b Nov 01 19:01:52.976447 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Name: tempest-LiveMigrationTest-1986167696 Nov 01 19:01:52.976447 n-d-863052-2 devstack@n-api.service[121402]: X-Role: member,reader Nov 01 19:01:52.976447 n-d-863052-2 devstack@n-api.service[121402]: X-Roles: member,reader Nov 01 19:01:52.978448 n-d-863052-2 devstack@n-api.service[121402]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/d9b9d4c236b944f9b2e8e502a50a8f8b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/d9b9d4c236b944f9b2e8e502a50a8f8b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_d9b9d4c236b944f9b2e8e502a50a8f8b", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/d9b9d4c236b944f9b2e8e502a50a8f8b"}]}] Nov 01 19:01:52.978448 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant: tempest-LiveMigrationTest-1986167696 Nov 01 19:01:52.978448 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant-Id: d9b9d4c236b944f9b2e8e502a50a8f8b Nov 01 19:01:52.978448 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant-Name: tempest-LiveMigrationTest-1986167696 Nov 01 19:01:52.978448 n-d-863052-2 devstack@n-api.service[121402]: X-User: tempest-LiveMigrationTest-1986167696-project Nov 01 19:01:52.978448 n-d-863052-2 devstack@n-api.service[121402]: X-User-Domain-Id: default Nov 01 19:01:52.978448 n-d-863052-2 devstack@n-api.service[121402]: X-User-Domain-Name: Default Nov 01 19:01:52.978448 n-d-863052-2 devstack@n-api.service[121402]: X-User-Id: f32f5fba1976432d938e664c7714e52b Nov 01 19:01:52.978448 n-d-863052-2 devstack@n-api.service[121402]: X-User-Name: tempest-LiveMigrationTest-1986167696-project Nov 01 19:01:52.978448 n-d-863052-2 devstack@n-api.service[121402]: method: > Nov 01 19:01:52.978448 n-d-863052-2 devstack@n-api.service[121402]: exception: Instance 1f499af7-1896-478c-b7d7-d922bf78bd98 could not be found. Nov 01 19:01:52.978448 n-d-863052-2 devstack@n-api.service[121402]: action_args: {'id': '1f499af7-1896-478c-b7d7-d922bf78bd98'} Nov 01 19:01:52.979485 n-d-863052-2 devstack@n-api.service[121402]: {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 01 19:01:52.979485 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:01:52.979485 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 01 19:01:52.979485 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 01 19:01:52.979485 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 01 19:01:52.979485 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 01 19:01:52.979485 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 01 19:01:52.979485 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 01 19:01:52.979485 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 01 19:01:52.979485 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 01 19:01:52.979485 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1f499af7-1896-478c-b7d7-d922bf78bd98 could not be found. Nov 01 19:01:52.979485 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:01:52.979485 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:01:52.979485 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:01:52.979485 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:01:52.979485 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:01:52.979485 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:01:52.979485 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 01 19:01:52.979485 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 01 19:01:52.979485 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 01 19:01:52.981279 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 01 19:01:52.981279 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 01 19:01:52.981279 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 01 19:01:52.981279 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 01 19:01:52.981279 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 01 19:01:52.981279 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 01 19:01:52.981279 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 01 19:01:52.981279 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1f499af7-1896-478c-b7d7-d922bf78bd98 could not be found. Nov 01 19:01:52.981279 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:01:52.981279 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:01:52.981279 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:01:52.981279 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:01:52.981279 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:01:52.981279 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:01:52.981279 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 01 19:01:52.981279 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 01 19:01:52.981279 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1f499af7-1896-478c-b7d7-d922bf78bd98 could not be found. Nov 01 19:01:52.981279 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:01:52.983871 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-a61edcb9-19ef-4663-b125-82c8ff24810b tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Returning 404 to user: Instance 1f499af7-1896-478c-b7d7-d922bf78bd98 could not be found. {{(pid=121402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 01 19:01:52.985092 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-a61edcb9-19ef-4663-b125-82c8ff24810b tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] 10.222.0.13 "GET /compute/v2.1/servers/1f499af7-1896-478c-b7d7-d922bf78bd98" status: 404 len: 111 microversion: 2.1 time: 0.091068 Nov 01 19:01:52.989380 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1062/2110] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:01:52 2022] GET /compute/v2.1/servers/1f499af7-1896-478c-b7d7-d922bf78bd98 => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 01 19:01:52.995577 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-e6fc1736-cfee-47b9-81d9-09490c40f085 tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:01:52.996622 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-e6fc1736-cfee-47b9-81d9-09490c40f085 tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] [instance: c34b04e9-a50a-4c58-85ff-ecef0bfc0343] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:01:53.005067 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e6fc1736-cfee-47b9-81d9-09490c40f085 tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:01:53.005826 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e6fc1736-cfee-47b9-81d9-09490c40f085 tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:01:53.006546 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e6fc1736-cfee-47b9-81d9-09490c40f085 tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:01:53.007451 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e6fc1736-cfee-47b9-81d9-09490c40f085 tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:01:53.008795 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e6fc1736-cfee-47b9-81d9-09490c40f085 tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:01:53.009424 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e6fc1736-cfee-47b9-81d9-09490c40f085 tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:01:53.337106 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-775b358d-6152-46a5-aa44-8c9b1fd3f9cb tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a63d69c99a546f0af16329cff3ca717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a1bb191cff948e99c008b5e861ce4a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:01:53.351216 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-775b358d-6152-46a5-aa44-8c9b1fd3f9cb tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] 10.222.0.13 "GET /compute/v2.1/servers/90b353ab-ef97-4d88-b5bc-b355ff576225" status: 200 len: 1736 microversion: 2.1 time: 1.246493 Nov 01 19:01:53.352709 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1049/2111] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:01:52 2022] GET /compute/v2.1/servers/90b353ab-ef97-4d88-b5bc-b355ff576225 => generated 1736 bytes in 1249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:01:53.385815 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-23654ec6-d611-4af9-8810-8d60e53b5f09 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:01:53.400115 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-e6fc1736-cfee-47b9-81d9-09490c40f085 tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b0619a8fc6f4fcc9eb5d4f473c595c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '280a221575634c6f908d333db769739b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:01:53.408522 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-23654ec6-d611-4af9-8810-8d60e53b5f09 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] [instance: cd879708-f757-4f88-bc95-38b6cd55363c] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:01:53.417992 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-e6fc1736-cfee-47b9-81d9-09490c40f085 tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] 10.222.0.13 "GET /compute/v2.1/servers/c34b04e9-a50a-4c58-85ff-ecef0bfc0343" status: 200 len: 1474 microversion: 2.1 time: 0.425480 Nov 01 19:01:53.418597 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1063/2112] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:01:52 2022] GET /compute/v2.1/servers/c34b04e9-a50a-4c58-85ff-ecef0bfc0343 => generated 1474 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:01:53.482074 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-e5e8101b-dad9-4d72-816a-e2f140d4c7ad tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:01:53.482709 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-e5e8101b-dad9-4d72-816a-e2f140d4c7ad tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] [instance: ac175c18-47f4-4b20-8567-fefb1b701d04] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:01:53.496870 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-23654ec6-d611-4af9-8810-8d60e53b5f09 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:01:53.497439 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-23654ec6-d611-4af9-8810-8d60e53b5f09 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:01:53.505399 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-23654ec6-d611-4af9-8810-8d60e53b5f09 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:01:53.506887 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-23654ec6-d611-4af9-8810-8d60e53b5f09 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:01:53.507349 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-23654ec6-d611-4af9-8810-8d60e53b5f09 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:01:53.507860 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-23654ec6-d611-4af9-8810-8d60e53b5f09 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:01:53.509698 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e5e8101b-dad9-4d72-816a-e2f140d4c7ad tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:01:53.510205 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e5e8101b-dad9-4d72-816a-e2f140d4c7ad tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:01:53.510645 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e5e8101b-dad9-4d72-816a-e2f140d4c7ad tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:01:53.521119 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e5e8101b-dad9-4d72-816a-e2f140d4c7ad tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:01:53.521753 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e5e8101b-dad9-4d72-816a-e2f140d4c7ad tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:01:53.527265 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e5e8101b-dad9-4d72-816a-e2f140d4c7ad tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:01:53.958464 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-e5e8101b-dad9-4d72-816a-e2f140d4c7ad tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb496b3faac4abbae73d389f2042e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e2520220d454764b8c139a58d78ac83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:01:53.974128 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-e5e8101b-dad9-4d72-816a-e2f140d4c7ad tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] 10.222.0.13 "GET /compute/v2.1/servers/ac175c18-47f4-4b20-8567-fefb1b701d04" status: 200 len: 1313 microversion: 2.1 time: 0.498880 Nov 01 19:01:53.988922 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1064/2113] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:01:53 2022] GET /compute/v2.1/servers/ac175c18-47f4-4b20-8567-fefb1b701d04 => generated 1313 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 19:01:54.380774 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-843cd257-7cfa-4380-a540-035a98b7c1aa tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:01:54.380774 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-843cd257-7cfa-4380-a540-035a98b7c1aa tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] [instance: 90b353ab-ef97-4d88-b5bc-b355ff576225] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:01:54.399433 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-843cd257-7cfa-4380-a540-035a98b7c1aa tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:01:54.401334 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-843cd257-7cfa-4380-a540-035a98b7c1aa tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:01:54.401802 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-843cd257-7cfa-4380-a540-035a98b7c1aa tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:01:54.402541 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-843cd257-7cfa-4380-a540-035a98b7c1aa tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:01:54.410300 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-843cd257-7cfa-4380-a540-035a98b7c1aa tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:01:54.410849 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-843cd257-7cfa-4380-a540-035a98b7c1aa tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:01:54.640863 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-23654ec6-d611-4af9-8810-8d60e53b5f09 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:01:54.683348 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-23654ec6-d611-4af9-8810-8d60e53b5f09 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:01:54.694781 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-23654ec6-d611-4af9-8810-8d60e53b5f09 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:01:54.698811 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-23654ec6-d611-4af9-8810-8d60e53b5f09 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] 10.222.0.13 "GET /compute/v2.1/servers/cd879708-f757-4f88-bc95-38b6cd55363c" status: 200 len: 1486 microversion: 2.25 time: 1.344352 Nov 01 19:01:54.721836 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1050/2114] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 19:01:53 2022] GET /compute/v2.1/servers/cd879708-f757-4f88-bc95-38b6cd55363c => generated 1486 bytes in 1366 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 19:01:54.742758 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-72ca899a-9acf-4fc7-b05b-502cee0fc1b2 tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:01:54.745801 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-72ca899a-9acf-4fc7-b05b-502cee0fc1b2 tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] [instance: c34b04e9-a50a-4c58-85ff-ecef0bfc0343] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:01:54.770919 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-72ca899a-9acf-4fc7-b05b-502cee0fc1b2 tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:01:54.771876 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-72ca899a-9acf-4fc7-b05b-502cee0fc1b2 tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:01:54.777813 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-72ca899a-9acf-4fc7-b05b-502cee0fc1b2 tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:01:54.780619 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-72ca899a-9acf-4fc7-b05b-502cee0fc1b2 tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:01:54.782752 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-72ca899a-9acf-4fc7-b05b-502cee0fc1b2 tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:01:54.783472 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-72ca899a-9acf-4fc7-b05b-502cee0fc1b2 tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:01:55.018760 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-843cd257-7cfa-4380-a540-035a98b7c1aa tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a63d69c99a546f0af16329cff3ca717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a1bb191cff948e99c008b5e861ce4a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:01:55.033954 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-843cd257-7cfa-4380-a540-035a98b7c1aa tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] 10.222.0.13 "GET /compute/v2.1/servers/90b353ab-ef97-4d88-b5bc-b355ff576225" status: 200 len: 1736 microversion: 2.1 time: 0.657083 Nov 01 19:01:55.050345 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1065/2115] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:01:54 2022] GET /compute/v2.1/servers/90b353ab-ef97-4d88-b5bc-b355ff576225 => generated 1736 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 19:01:55.066622 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [req-0904aa11-fb9c-4425-9cef-d0fcfceaca39 req-e08cf035-aecf-4b55-bf0e-3138ffd26d93 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cd879708-f757-4f88-bc95-38b6cd55363c", "tag": "5814506e-bf1a-49cf-9169-b3181e825901"}]} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:01:55.090515 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-0904aa11-fb9c-4425-9cef-d0fcfceaca39 req-e08cf035-aecf-4b55-bf0e-3138ffd26d93 service nova] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:01:55.092153 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-0904aa11-fb9c-4425-9cef-d0fcfceaca39 req-e08cf035-aecf-4b55-bf0e-3138ffd26d93 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:01:55.094650 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-0904aa11-fb9c-4425-9cef-d0fcfceaca39 req-e08cf035-aecf-4b55-bf0e-3138ffd26d93 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:01:55.131398 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.compute.server_external_events [req-0904aa11-fb9c-4425-9cef-d0fcfceaca39 req-e08cf035-aecf-4b55-bf0e-3138ffd26d93 service nova] Creating event network-changed:5814506e-bf1a-49cf-9169-b3181e825901 for instance cd879708-f757-4f88-bc95-38b6cd55363c on n-h2-863052-2 Nov 01 19:01:55.150708 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [req-0904aa11-fb9c-4425-9cef-d0fcfceaca39 req-e08cf035-aecf-4b55-bf0e-3138ffd26d93 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098701 Nov 01 19:01:55.156491 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1066/2116] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Nov 1 19:01:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:01:55.174983 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-68f54e42-fa36-4d77-9cd3-9ee751fb270d tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:01:55.176043 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-68f54e42-fa36-4d77-9cd3-9ee751fb270d tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] [instance: ac175c18-47f4-4b20-8567-fefb1b701d04] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:01:55.190513 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-68f54e42-fa36-4d77-9cd3-9ee751fb270d tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:01:55.193337 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-68f54e42-fa36-4d77-9cd3-9ee751fb270d tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:01:55.194079 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-68f54e42-fa36-4d77-9cd3-9ee751fb270d tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:01:55.195329 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-68f54e42-fa36-4d77-9cd3-9ee751fb270d tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:01:55.198983 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-68f54e42-fa36-4d77-9cd3-9ee751fb270d tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:01:55.199718 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-68f54e42-fa36-4d77-9cd3-9ee751fb270d tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:01:56.029491 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-72ca899a-9acf-4fc7-b05b-502cee0fc1b2 tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b0619a8fc6f4fcc9eb5d4f473c595c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '280a221575634c6f908d333db769739b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:01:56.037317 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-72ca899a-9acf-4fc7-b05b-502cee0fc1b2 tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] 10.222.0.13 "GET /compute/v2.1/servers/c34b04e9-a50a-4c58-85ff-ecef0bfc0343" status: 200 len: 1474 microversion: 2.1 time: 1.308958 Nov 01 19:01:56.037897 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1051/2117] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:01:54 2022] GET /compute/v2.1/servers/c34b04e9-a50a-4c58-85ff-ecef0bfc0343 => generated 1474 bytes in 1316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:01:56.081886 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-8a38de54-48cb-4b9a-aa84-8a8c164fd77e tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:01:56.081886 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-8a38de54-48cb-4b9a-aa84-8a8c164fd77e tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] [instance: cd879708-f757-4f88-bc95-38b6cd55363c] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:01:56.087518 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-8a38de54-48cb-4b9a-aa84-8a8c164fd77e tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:01:56.099691 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-8a38de54-48cb-4b9a-aa84-8a8c164fd77e tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:01:56.100319 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-8a38de54-48cb-4b9a-aa84-8a8c164fd77e tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:01:56.101788 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-8a38de54-48cb-4b9a-aa84-8a8c164fd77e tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:01:56.102343 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-8a38de54-48cb-4b9a-aa84-8a8c164fd77e tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:01:56.102853 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-8a38de54-48cb-4b9a-aa84-8a8c164fd77e tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:01:56.376314 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-68f54e42-fa36-4d77-9cd3-9ee751fb270d tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb496b3faac4abbae73d389f2042e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e2520220d454764b8c139a58d78ac83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:01:56.401125 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-68f54e42-fa36-4d77-9cd3-9ee751fb270d tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] 10.222.0.13 "GET /compute/v2.1/servers/ac175c18-47f4-4b20-8567-fefb1b701d04" status: 200 len: 1313 microversion: 2.1 time: 1.237849 Nov 01 19:01:56.403136 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1067/2118] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:01:55 2022] GET /compute/v2.1/servers/ac175c18-47f4-4b20-8567-fefb1b701d04 => generated 1313 bytes in 1242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:01:56.444764 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-670dd2ce-9df3-4ad5-adfa-a82cbcba079e tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:01:56.450969 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-670dd2ce-9df3-4ad5-adfa-a82cbcba079e tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] [instance: 90b353ab-ef97-4d88-b5bc-b355ff576225] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:01:56.470157 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-670dd2ce-9df3-4ad5-adfa-a82cbcba079e tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:01:56.473582 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-670dd2ce-9df3-4ad5-adfa-a82cbcba079e tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:01:56.475652 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-670dd2ce-9df3-4ad5-adfa-a82cbcba079e tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:01:56.482628 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-670dd2ce-9df3-4ad5-adfa-a82cbcba079e tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:01:56.483467 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-670dd2ce-9df3-4ad5-adfa-a82cbcba079e tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:01:56.484929 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-670dd2ce-9df3-4ad5-adfa-a82cbcba079e tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:01:56.808357 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-8a38de54-48cb-4b9a-aa84-8a8c164fd77e tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:01:56.824310 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-8a38de54-48cb-4b9a-aa84-8a8c164fd77e tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:01:56.832844 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-8a38de54-48cb-4b9a-aa84-8a8c164fd77e tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:01:56.835994 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-8a38de54-48cb-4b9a-aa84-8a8c164fd77e tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] 10.222.0.13 "GET /compute/v2.1/servers/cd879708-f757-4f88-bc95-38b6cd55363c" status: 200 len: 1486 microversion: 2.25 time: 0.783443 Nov 01 19:01:56.838562 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1052/2119] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 19:01:56 2022] GET /compute/v2.1/servers/cd879708-f757-4f88-bc95-38b6cd55363c => generated 1486 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 19:01:56.850223 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [req-60a0ac9a-2002-4d23-815e-a616ad3ea529 req-0f9101cb-10e2-4eb5-bd3d-a649e3fe039c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c34b04e9-a50a-4c58-85ff-ecef0bfc0343", "name": "network-vif-deleted", "tag": "53c384ce-eeca-4b10-9794-84a0d7bc5468"}]} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:01:56.908028 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-60a0ac9a-2002-4d23-815e-a616ad3ea529 req-0f9101cb-10e2-4eb5-bd3d-a649e3fe039c service nova] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:01:56.908552 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-60a0ac9a-2002-4d23-815e-a616ad3ea529 req-0f9101cb-10e2-4eb5-bd3d-a649e3fe039c service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:01:56.909019 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-60a0ac9a-2002-4d23-815e-a616ad3ea529 req-0f9101cb-10e2-4eb5-bd3d-a649e3fe039c service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:01:56.942582 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.compute.server_external_events [req-60a0ac9a-2002-4d23-815e-a616ad3ea529 req-0f9101cb-10e2-4eb5-bd3d-a649e3fe039c service nova] Creating event network-vif-deleted:53c384ce-eeca-4b10-9794-84a0d7bc5468 for instance c34b04e9-a50a-4c58-85ff-ecef0bfc0343 on n-h1-863052-2 Nov 01 19:01:56.958837 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [req-60a0ac9a-2002-4d23-815e-a616ad3ea529 req-0f9101cb-10e2-4eb5-bd3d-a649e3fe039c service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.115391 Nov 01 19:01:56.961357 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1053/2120] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Nov 1 19:01:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:01:57.022602 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-670dd2ce-9df3-4ad5-adfa-a82cbcba079e tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a63d69c99a546f0af16329cff3ca717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a1bb191cff948e99c008b5e861ce4a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:01:57.040088 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-670dd2ce-9df3-4ad5-adfa-a82cbcba079e tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] 10.222.0.13 "GET /compute/v2.1/servers/90b353ab-ef97-4d88-b5bc-b355ff576225" status: 200 len: 1736 microversion: 2.1 time: 0.634553 Nov 01 19:01:57.042325 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1068/2121] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:01:56 2022] GET /compute/v2.1/servers/90b353ab-ef97-4d88-b5bc-b355ff576225 => generated 1736 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:01:57.066930 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-c44129be-538a-4f74-b569-03c0f07c29b6 tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:01:57.067529 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-c44129be-538a-4f74-b569-03c0f07c29b6 tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] [instance: c34b04e9-a50a-4c58-85ff-ecef0bfc0343] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:01:57.081569 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-c44129be-538a-4f74-b569-03c0f07c29b6 tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:01:57.082116 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-c44129be-538a-4f74-b569-03c0f07c29b6 tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:01:57.084502 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-c44129be-538a-4f74-b569-03c0f07c29b6 tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:01:57.085279 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-c44129be-538a-4f74-b569-03c0f07c29b6 tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:01:57.088484 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-c44129be-538a-4f74-b569-03c0f07c29b6 tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:01:57.089166 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-c44129be-538a-4f74-b569-03c0f07c29b6 tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:01:57.174987 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-c44129be-538a-4f74-b569-03c0f07c29b6 tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:01:57.177210 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-c44129be-538a-4f74-b569-03c0f07c29b6 tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:01:57.177876 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-c44129be-538a-4f74-b569-03c0f07c29b6 tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:01:57.181695 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.objects.instance [None req-c44129be-538a-4f74-b569-03c0f07c29b6 tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] Lazy-loading 'fault' on Instance uuid c34b04e9-a50a-4c58-85ff-ecef0bfc0343 {{(pid=121403) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 01 19:01:57.258058 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-c44129be-538a-4f74-b569-03c0f07c29b6 tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b0619a8fc6f4fcc9eb5d4f473c595c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '280a221575634c6f908d333db769739b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:01:57.266923 n-d-863052-2 devstack@n-api.service[121403]: DEBUG dbcounter [-] [121403] Writing DB stats nova_cell1:SELECT=100 {{(pid=121403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 19:01:57.274932 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-c44129be-538a-4f74-b569-03c0f07c29b6 tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] 10.222.0.13 "GET /compute/v2.1/servers/c34b04e9-a50a-4c58-85ff-ecef0bfc0343" status: 200 len: 1308 microversion: 2.1 time: 0.210883 Nov 01 19:01:57.275560 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1054/2122] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:01:57 2022] GET /compute/v2.1/servers/c34b04e9-a50a-4c58-85ff-ecef0bfc0343 => generated 1308 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:01:57.428086 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-ee5d6952-189c-48fc-9248-071375f424f4 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:01:57.430371 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-ee5d6952-189c-48fc-9248-071375f424f4 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] [instance: ac175c18-47f4-4b20-8567-fefb1b701d04] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:01:57.442165 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-ee5d6952-189c-48fc-9248-071375f424f4 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:01:57.445454 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-ee5d6952-189c-48fc-9248-071375f424f4 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:01:57.448768 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-ee5d6952-189c-48fc-9248-071375f424f4 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:01:57.450722 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-ee5d6952-189c-48fc-9248-071375f424f4 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:01:57.452431 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-ee5d6952-189c-48fc-9248-071375f424f4 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:01:57.453572 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-ee5d6952-189c-48fc-9248-071375f424f4 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:01:57.495004 n-d-863052-2 devstack@n-api.service[121402]: DEBUG dbcounter [-] [121402] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 19:01:57.841743 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-ee5d6952-189c-48fc-9248-071375f424f4 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb496b3faac4abbae73d389f2042e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e2520220d454764b8c139a58d78ac83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:01:57.855864 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-ee5d6952-189c-48fc-9248-071375f424f4 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] 10.222.0.13 "GET /compute/v2.1/servers/ac175c18-47f4-4b20-8567-fefb1b701d04" status: 200 len: 1313 microversion: 2.1 time: 0.428381 Nov 01 19:01:57.867265 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-2bb6ec26-b892-49fa-aac0-0a21df24b6d7 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:01:57.868297 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-2bb6ec26-b892-49fa-aac0-0a21df24b6d7 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] [instance: cd879708-f757-4f88-bc95-38b6cd55363c] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:01:57.880178 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1069/2123] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:01:57 2022] GET /compute/v2.1/servers/ac175c18-47f4-4b20-8567-fefb1b701d04 => generated 1313 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:01:57.886284 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-2bb6ec26-b892-49fa-aac0-0a21df24b6d7 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:01:57.887352 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-2bb6ec26-b892-49fa-aac0-0a21df24b6d7 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:01:57.888482 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-2bb6ec26-b892-49fa-aac0-0a21df24b6d7 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:01:57.890165 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-2bb6ec26-b892-49fa-aac0-0a21df24b6d7 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:01:57.890911 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-2bb6ec26-b892-49fa-aac0-0a21df24b6d7 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:01:57.891501 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-2bb6ec26-b892-49fa-aac0-0a21df24b6d7 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:01:58.068146 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-a3816635-86f4-4adb-9b8e-0fa6a9235853 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:01:58.069738 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-a3816635-86f4-4adb-9b8e-0fa6a9235853 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] [instance: 90b353ab-ef97-4d88-b5bc-b355ff576225] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:01:58.084828 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-a3816635-86f4-4adb-9b8e-0fa6a9235853 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:01:58.085724 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-a3816635-86f4-4adb-9b8e-0fa6a9235853 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:01:58.088341 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-a3816635-86f4-4adb-9b8e-0fa6a9235853 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:01:58.089514 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-a3816635-86f4-4adb-9b8e-0fa6a9235853 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:01:58.093367 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-a3816635-86f4-4adb-9b8e-0fa6a9235853 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:01:58.094107 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-a3816635-86f4-4adb-9b8e-0fa6a9235853 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:01:58.204229 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-2bb6ec26-b892-49fa-aac0-0a21df24b6d7 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:01:58.214202 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-2bb6ec26-b892-49fa-aac0-0a21df24b6d7 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:01:58.217205 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-2bb6ec26-b892-49fa-aac0-0a21df24b6d7 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:01:58.225980 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-2bb6ec26-b892-49fa-aac0-0a21df24b6d7 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] 10.222.0.13 "GET /compute/v2.1/servers/cd879708-f757-4f88-bc95-38b6cd55363c" status: 200 len: 1486 microversion: 2.25 time: 0.363301 Nov 01 19:01:58.231080 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1055/2124] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 19:01:57 2022] GET /compute/v2.1/servers/cd879708-f757-4f88-bc95-38b6cd55363c => generated 1486 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 01 19:01:58.255262 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-c1754304-c3f4-44a1-b30e-47f3963d6ba5 tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-190334596", "imageRef": "2d4a0047-1b9e-445f-8af8-1b5c9d93e881", "flavorRef": "452", "networks": [{"uuid": "5ef8c6d1-3a83-42c9-bfc2-c881c900a4e1"}, {"uuid": "0603353d-17ea-4cbe-95e2-e9641e17dff3"}, {"uuid": "5ef8c6d1-3a83-42c9-bfc2-c881c900a4e1"}]}} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:01:58.377563 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.network.neutron [None req-c1754304-c3f4-44a1-b30e-47f3963d6ba5 tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] validate_networks() for [('5ef8c6d1-3a83-42c9-bfc2-c881c900a4e1', None, None, None, None, None), ('0603353d-17ea-4cbe-95e2-e9641e17dff3', None, None, None, None, None), ('5ef8c6d1-3a83-42c9-bfc2-c881c900a4e1', None, None, None, None, None)] {{(pid=121403) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 01 19:01:58.431970 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-a3816635-86f4-4adb-9b8e-0fa6a9235853 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a63d69c99a546f0af16329cff3ca717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a1bb191cff948e99c008b5e861ce4a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:01:58.446873 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-a3816635-86f4-4adb-9b8e-0fa6a9235853 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] 10.222.0.13 "GET /compute/v2.1/servers/90b353ab-ef97-4d88-b5bc-b355ff576225" status: 200 len: 1736 microversion: 2.1 time: 0.383114 Nov 01 19:01:58.453607 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1070/2125] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:01:58 2022] GET /compute/v2.1/servers/90b353ab-ef97-4d88-b5bc-b355ff576225 => generated 1736 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:01:58.459531 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-15c9b07b-61b1-4121-8964-4f6caadd684d tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:01:58.468663 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-15c9b07b-61b1-4121-8964-4f6caadd684d tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] [instance: c34b04e9-a50a-4c58-85ff-ecef0bfc0343] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:01:58.495423 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-15c9b07b-61b1-4121-8964-4f6caadd684d tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:01:58.496130 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-15c9b07b-61b1-4121-8964-4f6caadd684d tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:01:58.504721 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-15c9b07b-61b1-4121-8964-4f6caadd684d tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:01:58.505748 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-15c9b07b-61b1-4121-8964-4f6caadd684d tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:01:58.506404 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-15c9b07b-61b1-4121-8964-4f6caadd684d tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:01:58.507007 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-15c9b07b-61b1-4121-8964-4f6caadd684d tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:01:58.533076 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.wsgi [None req-15c9b07b-61b1-4121-8964-4f6caadd684d tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] HTTP exception thrown: Instance c34b04e9-a50a-4c58-85ff-ecef0bfc0343 could not be found. Nov 01 19:01:58.538190 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-15c9b07b-61b1-4121-8964-4f6caadd684d tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] Request method failure captured: Nov 01 19:01:58.538190 n-d-863052-2 devstack@n-api.service[121402]: request: GET /compute/v2.1/servers/c34b04e9-a50a-4c58-85ff-ecef0bfc0343 HTTP/1.1 Nov 01 19:01:58.538190 n-d-863052-2 devstack@n-api.service[121402]: Accept: application/json Nov 01 19:01:58.538190 n-d-863052-2 devstack@n-api.service[121402]: Accept-Encoding: identity Nov 01 19:01:58.538190 n-d-863052-2 devstack@n-api.service[121402]: Connection: close Nov 01 19:01:58.538190 n-d-863052-2 devstack@n-api.service[121402]: Content-Length: 0 Nov 01 19:01:58.538190 n-d-863052-2 devstack@n-api.service[121402]: Content-Type: application/json Nov 01 19:01:58.538190 n-d-863052-2 devstack@n-api.service[121402]: Host: 10.222.0.13 Nov 01 19:01:58.538190 n-d-863052-2 devstack@n-api.service[121402]: Openstack-System-Scope: None Nov 01 19:01:58.538190 n-d-863052-2 devstack@n-api.service[121402]: User-Agent: python-urllib3/1.26.12 Nov 01 19:01:58.538190 n-d-863052-2 devstack@n-api.service[121402]: X-Auth-Token: gAAAAABjYWyDJFPRHrmRjRxrHFHWB5TNK04-8Zcrz8_F1t8q5-BM0fwnsZ-hngG7U0RNHbYfHU6U1ISGbzYqyU-2mMWq2KgBi9vN9JNazvXqUzXeN1yRN1THvPYHlTK3OeZGBOAVv6dQARts3POvqHbcOCpEuycXxPQJ5aGoQalt3cgOomjYrEk Nov 01 19:01:58.538190 n-d-863052-2 devstack@n-api.service[121402]: X-Domain-Id: None Nov 01 19:01:58.538190 n-d-863052-2 devstack@n-api.service[121402]: X-Domain-Name: None Nov 01 19:01:58.538190 n-d-863052-2 devstack@n-api.service[121402]: X-Identity-Status: Confirmed Nov 01 19:01:58.538190 n-d-863052-2 devstack@n-api.service[121402]: X-Is-Admin-Project: True Nov 01 19:01:58.538190 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Domain-Id: default Nov 01 19:01:58.538190 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Domain-Name: Default Nov 01 19:01:58.538190 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Id: 280a221575634c6f908d333db769739b Nov 01 19:01:58.538190 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Name: tempest-ListImageFiltersTestJSON-1185829401 Nov 01 19:01:58.538190 n-d-863052-2 devstack@n-api.service[121402]: X-Role: member,reader Nov 01 19:01:58.538190 n-d-863052-2 devstack@n-api.service[121402]: X-Roles: member,reader Nov 01 19:01:58.540560 n-d-863052-2 devstack@n-api.service[121402]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/280a221575634c6f908d333db769739b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/280a221575634c6f908d333db769739b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_280a221575634c6f908d333db769739b", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/280a221575634c6f908d333db769739b"}]}] Nov 01 19:01:58.540560 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant: tempest-ListImageFiltersTestJSON-1185829401 Nov 01 19:01:58.540560 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant-Id: 280a221575634c6f908d333db769739b Nov 01 19:01:58.540560 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant-Name: tempest-ListImageFiltersTestJSON-1185829401 Nov 01 19:01:58.540560 n-d-863052-2 devstack@n-api.service[121402]: X-User: tempest-ListImageFiltersTestJSON-1185829401-project Nov 01 19:01:58.540560 n-d-863052-2 devstack@n-api.service[121402]: X-User-Domain-Id: default Nov 01 19:01:58.540560 n-d-863052-2 devstack@n-api.service[121402]: X-User-Domain-Name: Default Nov 01 19:01:58.540560 n-d-863052-2 devstack@n-api.service[121402]: X-User-Id: 1b0619a8fc6f4fcc9eb5d4f473c595c9 Nov 01 19:01:58.540560 n-d-863052-2 devstack@n-api.service[121402]: X-User-Name: tempest-ListImageFiltersTestJSON-1185829401-project Nov 01 19:01:58.540560 n-d-863052-2 devstack@n-api.service[121402]: method: > Nov 01 19:01:58.540560 n-d-863052-2 devstack@n-api.service[121402]: exception: Instance c34b04e9-a50a-4c58-85ff-ecef0bfc0343 could not be found. Nov 01 19:01:58.540560 n-d-863052-2 devstack@n-api.service[121402]: action_args: {'id': 'c34b04e9-a50a-4c58-85ff-ecef0bfc0343'} Nov 01 19:01:58.541589 n-d-863052-2 devstack@n-api.service[121402]: {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 01 19:01:58.541589 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:01:58.541589 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 01 19:01:58.541589 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 01 19:01:58.541589 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 01 19:01:58.541589 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 01 19:01:58.541589 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 01 19:01:58.541589 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 01 19:01:58.541589 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 01 19:01:58.541589 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 01 19:01:58.541589 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c34b04e9-a50a-4c58-85ff-ecef0bfc0343 could not be found. Nov 01 19:01:58.541589 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:01:58.541589 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:01:58.541589 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:01:58.541589 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:01:58.541589 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:01:58.541589 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:01:58.541589 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 01 19:01:58.541589 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 01 19:01:58.541589 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 01 19:01:58.543209 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 01 19:01:58.543209 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 01 19:01:58.543209 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 01 19:01:58.543209 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 01 19:01:58.543209 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 01 19:01:58.543209 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 01 19:01:58.543209 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 01 19:01:58.543209 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c34b04e9-a50a-4c58-85ff-ecef0bfc0343 could not be found. Nov 01 19:01:58.543209 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:01:58.543209 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:01:58.543209 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:01:58.543209 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:01:58.543209 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:01:58.543209 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:01:58.543209 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 01 19:01:58.543209 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 01 19:01:58.543209 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c34b04e9-a50a-4c58-85ff-ecef0bfc0343 could not be found. Nov 01 19:01:58.543209 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:01:58.545539 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-15c9b07b-61b1-4121-8964-4f6caadd684d tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] Returning 404 to user: Instance c34b04e9-a50a-4c58-85ff-ecef0bfc0343 could not be found. {{(pid=121402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 01 19:01:58.546579 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-15c9b07b-61b1-4121-8964-4f6caadd684d tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] 10.222.0.13 "GET /compute/v2.1/servers/c34b04e9-a50a-4c58-85ff-ecef0bfc0343" status: 404 len: 111 microversion: 2.1 time: 0.091638 Nov 01 19:01:58.554722 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1071/2126] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:01:58 2022] GET /compute/v2.1/servers/c34b04e9-a50a-4c58-85ff-ecef0bfc0343 => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 01 19:01:58.568893 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-ffba8cb0-014e-48b3-adbc-a1a2688c5a8b tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:01:58.569655 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-ffba8cb0-014e-48b3-adbc-a1a2688c5a8b tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] [instance: d8e88b0f-ae97-44a4-8b6b-b94e2c600a83] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:01:58.583523 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-ffba8cb0-014e-48b3-adbc-a1a2688c5a8b tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:01:58.589321 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-ffba8cb0-014e-48b3-adbc-a1a2688c5a8b tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:01:58.590078 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-ffba8cb0-014e-48b3-adbc-a1a2688c5a8b tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:01:58.593072 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-ffba8cb0-014e-48b3-adbc-a1a2688c5a8b tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:01:58.593763 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-ffba8cb0-014e-48b3-adbc-a1a2688c5a8b tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:01:58.595662 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-ffba8cb0-014e-48b3-adbc-a1a2688c5a8b tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:01:58.606098 n-d-863052-2 devstack@n-api.service[121403]: DEBUG dbcounter [-] [121403] Writing DB stats nova_cell0:SELECT=30 {{(pid=121403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 19:01:58.663584 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-ffba8cb0-014e-48b3-adbc-a1a2688c5a8b tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] [instance: d8e88b0f-ae97-44a4-8b6b-b94e2c600a83] Going to try to terminate instance {{(pid=121402) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 01 19:01:58.890806 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-ffba8cb0-014e-48b3-adbc-a1a2688c5a8b tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] 10.222.0.13 "DELETE /compute/v2.1/servers/d8e88b0f-ae97-44a4-8b6b-b94e2c600a83" status: 204 len: 0 microversion: 2.1 time: 0.334435 Nov 01 19:01:58.909334 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1072/2127] 10.222.0.13 () {58 vars in 1239 bytes} [Tue Nov 1 19:01:58 2022] DELETE /compute/v2.1/servers/d8e88b0f-ae97-44a4-8b6b-b94e2c600a83 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 01 19:01:58.953558 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-cced95e3-d52f-475d-b5ac-b56ca207610f tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:01:58.954309 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-cced95e3-d52f-475d-b5ac-b56ca207610f tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] [instance: ac175c18-47f4-4b20-8567-fefb1b701d04] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:01:58.979315 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-cced95e3-d52f-475d-b5ac-b56ca207610f tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:01:58.979827 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-cced95e3-d52f-475d-b5ac-b56ca207610f tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:01:58.980274 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-cced95e3-d52f-475d-b5ac-b56ca207610f tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:01:58.981024 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-cced95e3-d52f-475d-b5ac-b56ca207610f tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:01:58.988738 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-cced95e3-d52f-475d-b5ac-b56ca207610f tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:01:58.989395 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-cced95e3-d52f-475d-b5ac-b56ca207610f tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:01:59.395735 n-d-863052-2 devstack@n-api.service[121402]: DEBUG dbcounter [-] [121402] Writing DB stats nova_cell0:SELECT=20 {{(pid=121402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 19:01:59.928164 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-cced95e3-d52f-475d-b5ac-b56ca207610f tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb496b3faac4abbae73d389f2042e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e2520220d454764b8c139a58d78ac83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:01:59.951906 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-cced95e3-d52f-475d-b5ac-b56ca207610f tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] 10.222.0.13 "GET /compute/v2.1/servers/ac175c18-47f4-4b20-8567-fefb1b701d04" status: 200 len: 1313 microversion: 2.1 time: 1.040763 Nov 01 19:01:59.963455 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1073/2128] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:01:58 2022] GET /compute/v2.1/servers/ac175c18-47f4-4b20-8567-fefb1b701d04 => generated 1313 bytes in 1053 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:01:59.969098 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-1b0a418f-9962-4b71-ab86-1bbd5b600618 tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:01:59.978723 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-1b0a418f-9962-4b71-ab86-1bbd5b600618 tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] [instance: d8e88b0f-ae97-44a4-8b6b-b94e2c600a83] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:02:00.010492 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-1b0a418f-9962-4b71-ab86-1bbd5b600618 tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:00.011114 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-1b0a418f-9962-4b71-ab86-1bbd5b600618 tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:00.013437 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-1b0a418f-9962-4b71-ab86-1bbd5b600618 tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:00.014690 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-1b0a418f-9962-4b71-ab86-1bbd5b600618 tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:00.015207 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-1b0a418f-9962-4b71-ab86-1bbd5b600618 tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:00.016190 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-1b0a418f-9962-4b71-ab86-1bbd5b600618 tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:00.535841 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.virt.hardware [None req-c1754304-c3f4-44a1-b30e-47f3963d6ba5 tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Flavor limits 0:0:0 {{(pid=121403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 01 19:02:00.537173 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.virt.hardware [None req-c1754304-c3f4-44a1-b30e-47f3963d6ba5 tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Image limits 0:0:0 {{(pid=121403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 01 19:02:00.538755 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.virt.hardware [None req-c1754304-c3f4-44a1-b30e-47f3963d6ba5 tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Flavor pref 0:0:0 {{(pid=121403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 01 19:02:00.539462 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.virt.hardware [None req-c1754304-c3f4-44a1-b30e-47f3963d6ba5 tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Image pref 0:0:0 {{(pid=121403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 01 19:02:00.540448 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.virt.hardware [None req-c1754304-c3f4-44a1-b30e-47f3963d6ba5 tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 01 19:02:00.579567 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-c1754304-c3f4-44a1-b30e-47f3963d6ba5 tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:00.580537 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-c1754304-c3f4-44a1-b30e-47f3963d6ba5 tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:00.581237 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-c1754304-c3f4-44a1-b30e-47f3963d6ba5 tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:00.582237 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-c1754304-c3f4-44a1-b30e-47f3963d6ba5 tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:00.582882 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-c1754304-c3f4-44a1-b30e-47f3963d6ba5 tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:00.583786 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-c1754304-c3f4-44a1-b30e-47f3963d6ba5 tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:00.610400 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.quota [None req-c1754304-c3f4-44a1-b30e-47f3963d6ba5 tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Getting quotas for project af51b8733e984c2ca87df2d8163dedf9. Resources: {'cores', 'ram', 'instances'} {{(pid=121403) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 01 19:02:00.635345 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.quota [None req-c1754304-c3f4-44a1-b30e-47f3963d6ba5 tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Getting quotas for user 52acef7992d64d378fd8ac333887fd0e and project af51b8733e984c2ca87df2d8163dedf9. Resources: {'cores', 'ram', 'instances'} {{(pid=121403) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 01 19:02:00.673322 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-c1754304-c3f4-44a1-b30e-47f3963d6ba5 tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Going to run 1 instances... {{(pid=121403) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 01 19:02:00.680818 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-c1754304-c3f4-44a1-b30e-47f3963d6ba5 tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] [instance: 4b9fb909-26f7-40af-bac5-e7d2a6b9fb77] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2d4a0047-1b9e-445f-8af8-1b5c9d93e881',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121403) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 01 19:02:00.715457 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-1b0a418f-9962-4b71-ab86-1bbd5b600618 tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b0619a8fc6f4fcc9eb5d4f473c595c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '280a221575634c6f908d333db769739b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:02:00.751277 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-1b0a418f-9962-4b71-ab86-1bbd5b600618 tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] 10.222.0.13 "GET /compute/v2.1/servers/d8e88b0f-ae97-44a4-8b6b-b94e2c600a83" status: 200 len: 1472 microversion: 2.1 time: 0.777930 Nov 01 19:02:00.752315 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1074/2129] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:01:59 2022] GET /compute/v2.1/servers/d8e88b0f-ae97-44a4-8b6b-b94e2c600a83 => generated 1472 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:02:00.768979 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [req-ae960b50-698e-4b6c-872a-fceb3146537d req-c685a727-9cad-4fd0-bcdf-e80cd1172116 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac175c18-47f4-4b20-8567-fefb1b701d04", "name": "network-vif-plugged", "status": "completed", "tag": "fc89caa1-e6b4-4cd2-ae6d-02c9e8d9c421"}]} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:02:00.803864 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-c1754304-c3f4-44a1-b30e-47f3963d6ba5 tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.572734 Nov 01 19:02:00.806356 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-ae960b50-698e-4b6c-872a-fceb3146537d req-c685a727-9cad-4fd0-bcdf-e80cd1172116 service nova] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:00.806881 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1056/2130] 10.222.0.13 () {60 vars in 1147 bytes} [Tue Nov 1 19:01:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 2576 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 01 19:02:00.809212 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-ae960b50-698e-4b6c-872a-fceb3146537d req-c685a727-9cad-4fd0-bcdf-e80cd1172116 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:00.811350 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-ae960b50-698e-4b6c-872a-fceb3146537d req-c685a727-9cad-4fd0-bcdf-e80cd1172116 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:00.817706 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-d7e3259a-6251-401b-b67a-32c9722c780e tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:02:00.823093 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-d7e3259a-6251-401b-b67a-32c9722c780e tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] [instance: cd879708-f757-4f88-bc95-38b6cd55363c] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:02:00.840103 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d7e3259a-6251-401b-b67a-32c9722c780e tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:00.843492 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d7e3259a-6251-401b-b67a-32c9722c780e tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:00.847114 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d7e3259a-6251-401b-b67a-32c9722c780e tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:00.848439 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d7e3259a-6251-401b-b67a-32c9722c780e tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:00.849945 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d7e3259a-6251-401b-b67a-32c9722c780e tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:00.853412 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d7e3259a-6251-401b-b67a-32c9722c780e tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:00.903558 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.compute.server_external_events [req-ae960b50-698e-4b6c-872a-fceb3146537d req-c685a727-9cad-4fd0-bcdf-e80cd1172116 service nova] Creating event network-vif-plugged:fc89caa1-e6b4-4cd2-ae6d-02c9e8d9c421 for instance ac175c18-47f4-4b20-8567-fefb1b701d04 on n-h2-863052-2 Nov 01 19:02:00.925680 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [req-ae960b50-698e-4b6c-872a-fceb3146537d req-c685a727-9cad-4fd0-bcdf-e80cd1172116 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.170366 Nov 01 19:02:00.927330 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1075/2131] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Nov 1 19:02:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:02:00.939557 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-f22eae11-1af5-4ff8-8b7c-c69ce2023150 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:02:00.944860 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-f22eae11-1af5-4ff8-8b7c-c69ce2023150 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] [instance: 90b353ab-ef97-4d88-b5bc-b355ff576225] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:02:01.000261 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f22eae11-1af5-4ff8-8b7c-c69ce2023150 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:01.000819 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f22eae11-1af5-4ff8-8b7c-c69ce2023150 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:01.008107 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f22eae11-1af5-4ff8-8b7c-c69ce2023150 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:01.009312 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f22eae11-1af5-4ff8-8b7c-c69ce2023150 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:01.009973 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f22eae11-1af5-4ff8-8b7c-c69ce2023150 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:01.010578 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f22eae11-1af5-4ff8-8b7c-c69ce2023150 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:01.962245 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-f22eae11-1af5-4ff8-8b7c-c69ce2023150 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a63d69c99a546f0af16329cff3ca717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a1bb191cff948e99c008b5e861ce4a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:02:01.978261 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-f22eae11-1af5-4ff8-8b7c-c69ce2023150 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] 10.222.0.13 "GET /compute/v2.1/servers/90b353ab-ef97-4d88-b5bc-b355ff576225" status: 200 len: 1736 microversion: 2.1 time: 1.049329 Nov 01 19:02:01.978876 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1076/2132] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:02:00 2022] GET /compute/v2.1/servers/90b353ab-ef97-4d88-b5bc-b355ff576225 => generated 1736 bytes in 1051 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:02:01.998438 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-16816285-6440-4236-b3f9-22b98fe80f06 tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:02:01.999354 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-16816285-6440-4236-b3f9-22b98fe80f06 tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] [instance: 4b9fb909-26f7-40af-bac5-e7d2a6b9fb77] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:02:02.218422 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-d7e3259a-6251-401b-b67a-32c9722c780e tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:02:02.233076 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-d7e3259a-6251-401b-b67a-32c9722c780e tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:02:02.234666 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-d7e3259a-6251-401b-b67a-32c9722c780e tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:02:02.235874 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-d7e3259a-6251-401b-b67a-32c9722c780e tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] 10.222.0.13 "GET /compute/v2.1/servers/cd879708-f757-4f88-bc95-38b6cd55363c" status: 200 len: 1486 microversion: 2.25 time: 1.427749 Nov 01 19:02:02.246336 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1057/2133] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 19:02:00 2022] GET /compute/v2.1/servers/cd879708-f757-4f88-bc95-38b6cd55363c => generated 1486 bytes in 1438 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 19:02:02.267078 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-037d2f7e-a39d-4f51-b542-1e12ae0ca3f5 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:02:02.267785 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-037d2f7e-a39d-4f51-b542-1e12ae0ca3f5 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] [instance: ac175c18-47f4-4b20-8567-fefb1b701d04] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:02:02.289333 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-037d2f7e-a39d-4f51-b542-1e12ae0ca3f5 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:02.292182 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-037d2f7e-a39d-4f51-b542-1e12ae0ca3f5 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:02.292676 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-037d2f7e-a39d-4f51-b542-1e12ae0ca3f5 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:02.299061 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-037d2f7e-a39d-4f51-b542-1e12ae0ca3f5 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:02.300024 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-037d2f7e-a39d-4f51-b542-1e12ae0ca3f5 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:02.300673 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-037d2f7e-a39d-4f51-b542-1e12ae0ca3f5 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:02.596985 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-16816285-6440-4236-b3f9-22b98fe80f06 tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52acef7992d64d378fd8ac333887fd0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af51b8733e984c2ca87df2d8163dedf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:02:02.610033 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-16816285-6440-4236-b3f9-22b98fe80f06 tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] 10.222.0.13 "GET /compute/v2.1/servers/4b9fb909-26f7-40af-bac5-e7d2a6b9fb77" status: 200 len: 1212 microversion: 2.1 time: 0.626814 Nov 01 19:02:02.617196 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1077/2134] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:02:01 2022] GET /compute/v2.1/servers/4b9fb909-26f7-40af-bac5-e7d2a6b9fb77 => generated 1212 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:02:02.622035 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-46e17692-ecd5-4b35-85ca-ad1d00d9efe1 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:02:02.622539 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-46e17692-ecd5-4b35-85ca-ad1d00d9efe1 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] [instance: 2d525a31-b0be-44cb-8fb7-335075145f08] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:02:02.643199 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-037d2f7e-a39d-4f51-b542-1e12ae0ca3f5 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb496b3faac4abbae73d389f2042e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e2520220d454764b8c139a58d78ac83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:02:02.657073 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-46e17692-ecd5-4b35-85ca-ad1d00d9efe1 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:02.657577 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-46e17692-ecd5-4b35-85ca-ad1d00d9efe1 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:02.658014 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-46e17692-ecd5-4b35-85ca-ad1d00d9efe1 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:02.658727 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-46e17692-ecd5-4b35-85ca-ad1d00d9efe1 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:02.659187 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-46e17692-ecd5-4b35-85ca-ad1d00d9efe1 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:02.659717 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-46e17692-ecd5-4b35-85ca-ad1d00d9efe1 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:02.665214 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-037d2f7e-a39d-4f51-b542-1e12ae0ca3f5 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] 10.222.0.13 "GET /compute/v2.1/servers/ac175c18-47f4-4b20-8567-fefb1b701d04" status: 200 len: 1313 microversion: 2.1 time: 0.413731 Nov 01 19:02:02.689061 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1058/2135] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:02:02 2022] GET /compute/v2.1/servers/ac175c18-47f4-4b20-8567-fefb1b701d04 => generated 1313 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:02:02.701725 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-5da5f312-b453-4ce7-9aa1-96b06809db18 tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:02:02.703922 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-5da5f312-b453-4ce7-9aa1-96b06809db18 tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] [instance: d8e88b0f-ae97-44a4-8b6b-b94e2c600a83] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:02:02.720813 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-5da5f312-b453-4ce7-9aa1-96b06809db18 tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:02.721319 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-5da5f312-b453-4ce7-9aa1-96b06809db18 tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:02.722234 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-5da5f312-b453-4ce7-9aa1-96b06809db18 tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:02.723921 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-5da5f312-b453-4ce7-9aa1-96b06809db18 tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:02.724750 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-5da5f312-b453-4ce7-9aa1-96b06809db18 tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:02.727923 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-5da5f312-b453-4ce7-9aa1-96b06809db18 tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:02.739790 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-46e17692-ecd5-4b35-85ca-ad1d00d9efe1 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] [instance: 2d525a31-b0be-44cb-8fb7-335075145f08] Going to try to terminate instance {{(pid=121402) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 01 19:02:02.874916 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-5da5f312-b453-4ce7-9aa1-96b06809db18 tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b0619a8fc6f4fcc9eb5d4f473c595c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '280a221575634c6f908d333db769739b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:02:02.891524 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-5da5f312-b453-4ce7-9aa1-96b06809db18 tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] 10.222.0.13 "GET /compute/v2.1/servers/d8e88b0f-ae97-44a4-8b6b-b94e2c600a83" status: 200 len: 1430 microversion: 2.1 time: 0.193697 Nov 01 19:02:02.892184 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1059/2136] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:02:02 2022] GET /compute/v2.1/servers/d8e88b0f-ae97-44a4-8b6b-b94e2c600a83 => generated 1430 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:02:02.972611 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-46e17692-ecd5-4b35-85ca-ad1d00d9efe1 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] 10.222.0.13 "DELETE /compute/v2.1/servers/2d525a31-b0be-44cb-8fb7-335075145f08" status: 204 len: 0 microversion: 2.1 time: 0.353964 Nov 01 19:02:02.973659 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1078/2137] 10.222.0.13 () {58 vars in 1239 bytes} [Tue Nov 1 19:02:02 2022] DELETE /compute/v2.1/servers/2d525a31-b0be-44cb-8fb7-335075145f08 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 01 19:02:02.986888 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-a3cbb1a1-39e9-43ee-b13f-9d0b70cee9ae tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:02:02.987522 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-a3cbb1a1-39e9-43ee-b13f-9d0b70cee9ae tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] [instance: 2d525a31-b0be-44cb-8fb7-335075145f08] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:02:02.998751 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-a3cbb1a1-39e9-43ee-b13f-9d0b70cee9ae tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:02.999563 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-a3cbb1a1-39e9-43ee-b13f-9d0b70cee9ae tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:03.000342 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-a3cbb1a1-39e9-43ee-b13f-9d0b70cee9ae tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:03.001697 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-a3cbb1a1-39e9-43ee-b13f-9d0b70cee9ae tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:03.003460 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-a3cbb1a1-39e9-43ee-b13f-9d0b70cee9ae tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:03.004141 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-a3cbb1a1-39e9-43ee-b13f-9d0b70cee9ae tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:03.019514 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-c6ca83ce-ebdb-4227-a5b3-fcb1ab341640 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:02:03.020239 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-c6ca83ce-ebdb-4227-a5b3-fcb1ab341640 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] [instance: 90b353ab-ef97-4d88-b5bc-b355ff576225] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:02:03.042535 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-c6ca83ce-ebdb-4227-a5b3-fcb1ab341640 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:03.045349 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-c6ca83ce-ebdb-4227-a5b3-fcb1ab341640 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:03.045804 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-c6ca83ce-ebdb-4227-a5b3-fcb1ab341640 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:03.047590 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-c6ca83ce-ebdb-4227-a5b3-fcb1ab341640 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:03.055852 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-c6ca83ce-ebdb-4227-a5b3-fcb1ab341640 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:03.056661 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-c6ca83ce-ebdb-4227-a5b3-fcb1ab341640 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:03.329512 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-a3cbb1a1-39e9-43ee-b13f-9d0b70cee9ae tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f32f5fba1976432d938e664c7714e52b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b9d4c236b944f9b2e8e502a50a8f8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:02:03.340383 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-a3cbb1a1-39e9-43ee-b13f-9d0b70cee9ae tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] 10.222.0.13 "GET /compute/v2.1/servers/2d525a31-b0be-44cb-8fb7-335075145f08" status: 200 len: 1668 microversion: 2.1 time: 0.362355 Nov 01 19:02:03.367163 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1060/2138] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:02:02 2022] GET /compute/v2.1/servers/2d525a31-b0be-44cb-8fb7-335075145f08 => generated 1668 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:02:03.377800 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [req-8002a35b-b24e-428e-949a-a3f09dc44008 req-b3ed5864-8f93-4d81-a047-7483a8b1945f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d8e88b0f-ae97-44a4-8b6b-b94e2c600a83", "name": "network-vif-deleted", "tag": "91ce416d-c08f-473f-a551-fa3519a6c6c7"}]} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:02:03.401655 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-8002a35b-b24e-428e-949a-a3f09dc44008 req-b3ed5864-8f93-4d81-a047-7483a8b1945f service nova] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:03.402964 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-8002a35b-b24e-428e-949a-a3f09dc44008 req-b3ed5864-8f93-4d81-a047-7483a8b1945f service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:03.403626 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-8002a35b-b24e-428e-949a-a3f09dc44008 req-b3ed5864-8f93-4d81-a047-7483a8b1945f service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:03.435039 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.compute.server_external_events [req-8002a35b-b24e-428e-949a-a3f09dc44008 req-b3ed5864-8f93-4d81-a047-7483a8b1945f service nova] Creating event network-vif-deleted:91ce416d-c08f-473f-a551-fa3519a6c6c7 for instance d8e88b0f-ae97-44a4-8b6b-b94e2c600a83 on n-h1-863052-2 Nov 01 19:02:03.450058 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [req-8002a35b-b24e-428e-949a-a3f09dc44008 req-b3ed5864-8f93-4d81-a047-7483a8b1945f service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081087 Nov 01 19:02:03.451268 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1061/2139] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Nov 1 19:02:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:02:03.464685 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-4fc7dfe9-efd8-460b-a596-e578a4776252 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:02:03.471974 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-4fc7dfe9-efd8-460b-a596-e578a4776252 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] [instance: cd879708-f757-4f88-bc95-38b6cd55363c] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:02:03.503324 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-4fc7dfe9-efd8-460b-a596-e578a4776252 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:03.506424 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-4fc7dfe9-efd8-460b-a596-e578a4776252 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:03.508100 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-4fc7dfe9-efd8-460b-a596-e578a4776252 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:03.509990 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-4fc7dfe9-efd8-460b-a596-e578a4776252 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:03.511710 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-4fc7dfe9-efd8-460b-a596-e578a4776252 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:03.512349 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-4fc7dfe9-efd8-460b-a596-e578a4776252 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:04.072757 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-c6ca83ce-ebdb-4227-a5b3-fcb1ab341640 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a63d69c99a546f0af16329cff3ca717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a1bb191cff948e99c008b5e861ce4a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:02:04.084333 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-c6ca83ce-ebdb-4227-a5b3-fcb1ab341640 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] 10.222.0.13 "GET /compute/v2.1/servers/90b353ab-ef97-4d88-b5bc-b355ff576225" status: 200 len: 1736 microversion: 2.1 time: 1.084615 Nov 01 19:02:04.086849 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1079/2140] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:02:02 2022] GET /compute/v2.1/servers/90b353ab-ef97-4d88-b5bc-b355ff576225 => generated 1736 bytes in 1088 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 19:02:04.097654 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-302c941a-8d3c-4e7a-b0e1-10974d30abd3 tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:02:04.098534 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-302c941a-8d3c-4e7a-b0e1-10974d30abd3 tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] [instance: 4b9fb909-26f7-40af-bac5-e7d2a6b9fb77] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:02:04.114882 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-302c941a-8d3c-4e7a-b0e1-10974d30abd3 tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:04.116015 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-302c941a-8d3c-4e7a-b0e1-10974d30abd3 tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:04.119872 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-302c941a-8d3c-4e7a-b0e1-10974d30abd3 tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:04.121697 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-302c941a-8d3c-4e7a-b0e1-10974d30abd3 tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:04.127873 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-302c941a-8d3c-4e7a-b0e1-10974d30abd3 tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:04.135939 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-302c941a-8d3c-4e7a-b0e1-10974d30abd3 tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:04.143466 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-4fc7dfe9-efd8-460b-a596-e578a4776252 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:02:04.156202 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-4fc7dfe9-efd8-460b-a596-e578a4776252 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:02:04.157729 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-4fc7dfe9-efd8-460b-a596-e578a4776252 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:02:04.161930 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-4fc7dfe9-efd8-460b-a596-e578a4776252 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] 10.222.0.13 "GET /compute/v2.1/servers/cd879708-f757-4f88-bc95-38b6cd55363c" status: 200 len: 1486 microversion: 2.25 time: 0.707304 Nov 01 19:02:04.171975 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1062/2141] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 19:02:03 2022] GET /compute/v2.1/servers/cd879708-f757-4f88-bc95-38b6cd55363c => generated 1486 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 19:02:04.181836 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-18ff8d57-593e-4d69-9e5e-87936ff11007 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:02:04.189052 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-18ff8d57-593e-4d69-9e5e-87936ff11007 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] [instance: ac175c18-47f4-4b20-8567-fefb1b701d04] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:02:04.209023 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-18ff8d57-593e-4d69-9e5e-87936ff11007 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:04.209991 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-18ff8d57-593e-4d69-9e5e-87936ff11007 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:04.211206 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-18ff8d57-593e-4d69-9e5e-87936ff11007 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:04.213198 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-18ff8d57-593e-4d69-9e5e-87936ff11007 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:04.213677 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-18ff8d57-593e-4d69-9e5e-87936ff11007 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:04.214114 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-18ff8d57-593e-4d69-9e5e-87936ff11007 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:04.495446 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-302c941a-8d3c-4e7a-b0e1-10974d30abd3 tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52acef7992d64d378fd8ac333887fd0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af51b8733e984c2ca87df2d8163dedf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:02:04.511544 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-302c941a-8d3c-4e7a-b0e1-10974d30abd3 tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] 10.222.0.13 "GET /compute/v2.1/servers/4b9fb909-26f7-40af-bac5-e7d2a6b9fb77" status: 200 len: 1270 microversion: 2.1 time: 0.421513 Nov 01 19:02:04.512142 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1080/2142] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:02:04 2022] GET /compute/v2.1/servers/4b9fb909-26f7-40af-bac5-e7d2a6b9fb77 => generated 1270 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:02:04.520997 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-18ff8d57-593e-4d69-9e5e-87936ff11007 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb496b3faac4abbae73d389f2042e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e2520220d454764b8c139a58d78ac83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:02:04.528959 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-18ff8d57-593e-4d69-9e5e-87936ff11007 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] 10.222.0.13 "GET /compute/v2.1/servers/ac175c18-47f4-4b20-8567-fefb1b701d04" status: 200 len: 1462 microversion: 2.1 time: 0.355419 Nov 01 19:02:04.531129 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1063/2143] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:02:04 2022] GET /compute/v2.1/servers/ac175c18-47f4-4b20-8567-fefb1b701d04 => generated 1462 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:02:04.536084 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-b2da2eb0-4fd1-44eb-9158-173fcad5954f tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:02:04.536689 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-b2da2eb0-4fd1-44eb-9158-173fcad5954f tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] [instance: d8e88b0f-ae97-44a4-8b6b-b94e2c600a83] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:02:04.570916 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-b9d7a7db-fe04-4008-829a-d07f299ee859 tempest-ServersTestBootFromVolume-877599095 tempest-ServersTestBootFromVolume-877599095-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestBootFromVolume-server-806910151", "imageRef": "", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "f7ef3adf-4427-4912-817e-b9c2c68d47a2"}], "security_groups": [{"name": "tempest-securitygroup--1830193483"}], "key_name": "tempest-keypair-871595936", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "block_device_mapping_v2": [{"uuid": "fe6065c8-0574-4203-9149-9b9f23593b36", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "OS-DCF:diskConfig": "}} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:02:04.581413 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-b2da2eb0-4fd1-44eb-9158-173fcad5954f tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:04.581901 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-b2da2eb0-4fd1-44eb-9158-173fcad5954f tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:04.582362 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-b2da2eb0-4fd1-44eb-9158-173fcad5954f tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:04.588800 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-b2da2eb0-4fd1-44eb-9158-173fcad5954f tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:04.589440 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-b2da2eb0-4fd1-44eb-9158-173fcad5954f tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:04.589885 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-b2da2eb0-4fd1-44eb-9158-173fcad5954f tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:04.627358 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.wsgi [None req-b2da2eb0-4fd1-44eb-9158-173fcad5954f tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] HTTP exception thrown: Instance d8e88b0f-ae97-44a4-8b6b-b94e2c600a83 could not be found. Nov 01 19:02:04.629267 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-b2da2eb0-4fd1-44eb-9158-173fcad5954f tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] Request method failure captured: Nov 01 19:02:04.629267 n-d-863052-2 devstack@n-api.service[121403]: request: GET /compute/v2.1/servers/d8e88b0f-ae97-44a4-8b6b-b94e2c600a83 HTTP/1.1 Nov 01 19:02:04.629267 n-d-863052-2 devstack@n-api.service[121403]: Accept: application/json Nov 01 19:02:04.629267 n-d-863052-2 devstack@n-api.service[121403]: Accept-Encoding: identity Nov 01 19:02:04.629267 n-d-863052-2 devstack@n-api.service[121403]: Connection: close Nov 01 19:02:04.629267 n-d-863052-2 devstack@n-api.service[121403]: Content-Length: 0 Nov 01 19:02:04.629267 n-d-863052-2 devstack@n-api.service[121403]: Content-Type: application/json Nov 01 19:02:04.629267 n-d-863052-2 devstack@n-api.service[121403]: Host: 10.222.0.13 Nov 01 19:02:04.629267 n-d-863052-2 devstack@n-api.service[121403]: Openstack-System-Scope: None Nov 01 19:02:04.629267 n-d-863052-2 devstack@n-api.service[121403]: User-Agent: python-urllib3/1.26.12 Nov 01 19:02:04.629267 n-d-863052-2 devstack@n-api.service[121403]: X-Auth-Token: gAAAAABjYWyDJFPRHrmRjRxrHFHWB5TNK04-8Zcrz8_F1t8q5-BM0fwnsZ-hngG7U0RNHbYfHU6U1ISGbzYqyU-2mMWq2KgBi9vN9JNazvXqUzXeN1yRN1THvPYHlTK3OeZGBOAVv6dQARts3POvqHbcOCpEuycXxPQJ5aGoQalt3cgOomjYrEk Nov 01 19:02:04.629267 n-d-863052-2 devstack@n-api.service[121403]: X-Domain-Id: None Nov 01 19:02:04.629267 n-d-863052-2 devstack@n-api.service[121403]: X-Domain-Name: None Nov 01 19:02:04.629267 n-d-863052-2 devstack@n-api.service[121403]: X-Identity-Status: Confirmed Nov 01 19:02:04.629267 n-d-863052-2 devstack@n-api.service[121403]: X-Is-Admin-Project: True Nov 01 19:02:04.629267 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Domain-Id: default Nov 01 19:02:04.629267 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Domain-Name: Default Nov 01 19:02:04.629267 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Id: 280a221575634c6f908d333db769739b Nov 01 19:02:04.629267 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Name: tempest-ListImageFiltersTestJSON-1185829401 Nov 01 19:02:04.629267 n-d-863052-2 devstack@n-api.service[121403]: X-Role: member,reader Nov 01 19:02:04.629267 n-d-863052-2 devstack@n-api.service[121403]: X-Roles: member,reader Nov 01 19:02:04.631001 n-d-863052-2 devstack@n-api.service[121403]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/280a221575634c6f908d333db769739b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/280a221575634c6f908d333db769739b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_280a221575634c6f908d333db769739b", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/280a221575634c6f908d333db769739b"}]}] Nov 01 19:02:04.631001 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant: tempest-ListImageFiltersTestJSON-1185829401 Nov 01 19:02:04.631001 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant-Id: 280a221575634c6f908d333db769739b Nov 01 19:02:04.631001 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant-Name: tempest-ListImageFiltersTestJSON-1185829401 Nov 01 19:02:04.631001 n-d-863052-2 devstack@n-api.service[121403]: X-User: tempest-ListImageFiltersTestJSON-1185829401-project Nov 01 19:02:04.631001 n-d-863052-2 devstack@n-api.service[121403]: X-User-Domain-Id: default Nov 01 19:02:04.631001 n-d-863052-2 devstack@n-api.service[121403]: X-User-Domain-Name: Default Nov 01 19:02:04.631001 n-d-863052-2 devstack@n-api.service[121403]: X-User-Id: 1b0619a8fc6f4fcc9eb5d4f473c595c9 Nov 01 19:02:04.631001 n-d-863052-2 devstack@n-api.service[121403]: X-User-Name: tempest-ListImageFiltersTestJSON-1185829401-project Nov 01 19:02:04.631001 n-d-863052-2 devstack@n-api.service[121403]: method: > Nov 01 19:02:04.631001 n-d-863052-2 devstack@n-api.service[121403]: exception: Instance d8e88b0f-ae97-44a4-8b6b-b94e2c600a83 could not be found. Nov 01 19:02:04.631001 n-d-863052-2 devstack@n-api.service[121403]: action_args: {'id': 'd8e88b0f-ae97-44a4-8b6b-b94e2c600a83'} Nov 01 19:02:04.631865 n-d-863052-2 devstack@n-api.service[121403]: {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 01 19:02:04.631865 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:02:04.631865 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 01 19:02:04.631865 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 01 19:02:04.631865 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 01 19:02:04.631865 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 01 19:02:04.631865 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 01 19:02:04.631865 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 01 19:02:04.631865 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 01 19:02:04.631865 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 01 19:02:04.631865 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d8e88b0f-ae97-44a4-8b6b-b94e2c600a83 could not be found. Nov 01 19:02:04.631865 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:02:04.631865 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:02:04.631865 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:02:04.631865 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:02:04.631865 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:02:04.631865 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:02:04.631865 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 01 19:02:04.631865 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 01 19:02:04.631865 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 01 19:02:04.641615 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 01 19:02:04.641615 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 01 19:02:04.641615 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 01 19:02:04.641615 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 01 19:02:04.641615 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 01 19:02:04.641615 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 01 19:02:04.641615 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 01 19:02:04.641615 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d8e88b0f-ae97-44a4-8b6b-b94e2c600a83 could not be found. Nov 01 19:02:04.641615 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:02:04.641615 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:02:04.641615 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:02:04.641615 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:02:04.641615 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:02:04.641615 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:02:04.641615 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 01 19:02:04.641615 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 01 19:02:04.641615 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d8e88b0f-ae97-44a4-8b6b-b94e2c600a83 could not be found. Nov 01 19:02:04.641615 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:02:04.644459 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-b2da2eb0-4fd1-44eb-9158-173fcad5954f tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] Returning 404 to user: Instance d8e88b0f-ae97-44a4-8b6b-b94e2c600a83 could not be found. {{(pid=121403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 01 19:02:04.644459 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-b2da2eb0-4fd1-44eb-9158-173fcad5954f tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] 10.222.0.13 "GET /compute/v2.1/servers/d8e88b0f-ae97-44a4-8b6b-b94e2c600a83" status: 404 len: 111 microversion: 2.1 time: 0.098609 Nov 01 19:02:04.644459 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1064/2144] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:02:04 2022] GET /compute/v2.1/servers/d8e88b0f-ae97-44a4-8b6b-b94e2c600a83 => generated 111 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 01 19:02:04.645157 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-ef66d375-6c3d-46ee-8066-3bc0869f8a73 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:02:04.647294 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-ef66d375-6c3d-46ee-8066-3bc0869f8a73 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] [instance: 2d525a31-b0be-44cb-8fb7-335075145f08] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:02:04.656363 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-ef66d375-6c3d-46ee-8066-3bc0869f8a73 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:04.656900 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-ef66d375-6c3d-46ee-8066-3bc0869f8a73 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:04.657339 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-ef66d375-6c3d-46ee-8066-3bc0869f8a73 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:04.658041 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-ef66d375-6c3d-46ee-8066-3bc0869f8a73 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:04.658500 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-ef66d375-6c3d-46ee-8066-3bc0869f8a73 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:04.658981 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-ef66d375-6c3d-46ee-8066-3bc0869f8a73 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:04.974760 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.network.neutron [None req-b9d7a7db-fe04-4008-829a-d07f299ee859 tempest-ServersTestBootFromVolume-877599095 tempest-ServersTestBootFromVolume-877599095-project] validate_networks() for [('f7ef3adf-4427-4912-817e-b9c2c68d47a2', None, None, None, None, None)] {{(pid=121402) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 01 19:02:05.040300 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-ef66d375-6c3d-46ee-8066-3bc0869f8a73 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f32f5fba1976432d938e664c7714e52b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b9d4c236b944f9b2e8e502a50a8f8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:02:05.064495 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-ef66d375-6c3d-46ee-8066-3bc0869f8a73 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] 10.222.0.13 "GET /compute/v2.1/servers/2d525a31-b0be-44cb-8fb7-335075145f08" status: 200 len: 1668 microversion: 2.1 time: 0.423377 Nov 01 19:02:05.066079 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1065/2145] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:02:04 2022] GET /compute/v2.1/servers/2d525a31-b0be-44cb-8fb7-335075145f08 => generated 1668 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:02:05.073947 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-bd9346b4-542a-4811-9185-d2def6fd90cd tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:02:05.074927 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-bd9346b4-542a-4811-9185-d2def6fd90cd tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] [instance: 992f5ec5-d256-4870-b16d-fc8d9adbd3e7] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:02:05.082490 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-bd9346b4-542a-4811-9185-d2def6fd90cd tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:05.083902 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-bd9346b4-542a-4811-9185-d2def6fd90cd tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:05.084619 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-bd9346b4-542a-4811-9185-d2def6fd90cd tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:05.086367 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-bd9346b4-542a-4811-9185-d2def6fd90cd tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:05.087146 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-bd9346b4-542a-4811-9185-d2def6fd90cd tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:05.087814 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-bd9346b4-542a-4811-9185-d2def6fd90cd tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:05.435332 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-bd9346b4-542a-4811-9185-d2def6fd90cd tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb496b3faac4abbae73d389f2042e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e2520220d454764b8c139a58d78ac83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:02:05.454991 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-bd9346b4-542a-4811-9185-d2def6fd90cd tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] 10.222.0.13 "GET /compute/v2.1/servers/992f5ec5-d256-4870-b16d-fc8d9adbd3e7" status: 200 len: 1314 microversion: 2.1 time: 0.387418 Nov 01 19:02:05.458110 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1066/2146] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:02:05 2022] GET /compute/v2.1/servers/992f5ec5-d256-4870-b16d-fc8d9adbd3e7 => generated 1314 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:02:05.466091 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-4f009312-59f2-4b73-986c-75d748b752ff tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] Calling method '.version_select at 0x7f0ae20ab4c0>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:02:06.381027 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-4f009312-59f2-4b73-986c-75d748b752ff tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] 10.222.0.13 "DELETE /compute/v2.1/images/b80251cd-bea9-45d7-af4f-4ef7ffe0bc04" status: 204 len: 0 microversion: 2.1 time: 0.921017 Nov 01 19:02:06.381733 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1067/2147] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:02:05 2022] DELETE /compute/v2.1/images/b80251cd-bea9-45d7-af4f-4ef7ffe0bc04 => generated 0 bytes in 923 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 01 19:02:06.387595 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-ff7be400-01c5-4a75-ae9c-48db60260085 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:02:06.388790 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-ff7be400-01c5-4a75-ae9c-48db60260085 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] [instance: 90b353ab-ef97-4d88-b5bc-b355ff576225] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:02:06.403635 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-ff7be400-01c5-4a75-ae9c-48db60260085 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:06.404473 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-ff7be400-01c5-4a75-ae9c-48db60260085 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:06.406960 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-ff7be400-01c5-4a75-ae9c-48db60260085 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:06.408046 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-ff7be400-01c5-4a75-ae9c-48db60260085 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:06.409068 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-ff7be400-01c5-4a75-ae9c-48db60260085 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:06.409960 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-ff7be400-01c5-4a75-ae9c-48db60260085 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:06.606034 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-ff7be400-01c5-4a75-ae9c-48db60260085 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a63d69c99a546f0af16329cff3ca717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a1bb191cff948e99c008b5e861ce4a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:02:06.619082 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-ff7be400-01c5-4a75-ae9c-48db60260085 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] 10.222.0.13 "GET /compute/v2.1/servers/90b353ab-ef97-4d88-b5bc-b355ff576225" status: 200 len: 1736 microversion: 2.1 time: 0.236227 Nov 01 19:02:06.620098 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1068/2148] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:02:06 2022] GET /compute/v2.1/servers/90b353ab-ef97-4d88-b5bc-b355ff576225 => generated 1736 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:02:06.627012 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-74e81e24-e951-4563-aa5f-6cbdd2825173 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:02:06.629262 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-74e81e24-e951-4563-aa5f-6cbdd2825173 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] [instance: cd879708-f757-4f88-bc95-38b6cd55363c] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:02:06.642900 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-74e81e24-e951-4563-aa5f-6cbdd2825173 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:06.643480 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-74e81e24-e951-4563-aa5f-6cbdd2825173 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:06.643981 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-74e81e24-e951-4563-aa5f-6cbdd2825173 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:06.645000 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-74e81e24-e951-4563-aa5f-6cbdd2825173 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:06.645670 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-74e81e24-e951-4563-aa5f-6cbdd2825173 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:06.646962 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-74e81e24-e951-4563-aa5f-6cbdd2825173 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:06.890663 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-74e81e24-e951-4563-aa5f-6cbdd2825173 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:02:06.901353 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-74e81e24-e951-4563-aa5f-6cbdd2825173 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:02:06.902802 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-74e81e24-e951-4563-aa5f-6cbdd2825173 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:02:06.903968 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-74e81e24-e951-4563-aa5f-6cbdd2825173 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] 10.222.0.13 "GET /compute/v2.1/servers/cd879708-f757-4f88-bc95-38b6cd55363c" status: 200 len: 1476 microversion: 2.25 time: 0.282645 Nov 01 19:02:06.904871 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1069/2149] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 19:02:06 2022] GET /compute/v2.1/servers/cd879708-f757-4f88-bc95-38b6cd55363c => generated 1476 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 19:02:06.909368 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [req-e81e2eba-ff10-4971-8689-93085adf3231 req-89729a46-a925-4c77-a380-5e4d6da61588 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "992f5ec5-d256-4870-b16d-fc8d9adbd3e7", "name": "network-vif-plugged", "status": "completed", "tag": "30841eab-b46a-44ca-adc8-04928cc72ec5"}]} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:02:06.921608 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-e81e2eba-ff10-4971-8689-93085adf3231 req-89729a46-a925-4c77-a380-5e4d6da61588 service nova] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:06.922086 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-e81e2eba-ff10-4971-8689-93085adf3231 req-89729a46-a925-4c77-a380-5e4d6da61588 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:06.922514 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-e81e2eba-ff10-4971-8689-93085adf3231 req-89729a46-a925-4c77-a380-5e4d6da61588 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:06.943894 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.compute.server_external_events [req-e81e2eba-ff10-4971-8689-93085adf3231 req-89729a46-a925-4c77-a380-5e4d6da61588 service nova] Creating event network-vif-plugged:30841eab-b46a-44ca-adc8-04928cc72ec5 for instance 992f5ec5-d256-4870-b16d-fc8d9adbd3e7 on n-h1-863052-2 Nov 01 19:02:06.958819 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [req-e81e2eba-ff10-4971-8689-93085adf3231 req-89729a46-a925-4c77-a380-5e4d6da61588 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052696 Nov 01 19:02:06.960105 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1070/2150] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Nov 1 19:02:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:02:06.966586 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-4e2bb1be-f3fc-4d29-b58b-01aaa8db8f4c tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:02:06.967623 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-4e2bb1be-f3fc-4d29-b58b-01aaa8db8f4c tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] [instance: 4b9fb909-26f7-40af-bac5-e7d2a6b9fb77] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:02:06.975278 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-4e2bb1be-f3fc-4d29-b58b-01aaa8db8f4c tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:06.976141 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-4e2bb1be-f3fc-4d29-b58b-01aaa8db8f4c tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:06.976847 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-4e2bb1be-f3fc-4d29-b58b-01aaa8db8f4c tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:06.977794 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-4e2bb1be-f3fc-4d29-b58b-01aaa8db8f4c tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:06.978466 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-4e2bb1be-f3fc-4d29-b58b-01aaa8db8f4c tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:06.979104 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-4e2bb1be-f3fc-4d29-b58b-01aaa8db8f4c tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:07.096368 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-4e2bb1be-f3fc-4d29-b58b-01aaa8db8f4c tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52acef7992d64d378fd8ac333887fd0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af51b8733e984c2ca87df2d8163dedf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:02:07.110413 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-4e2bb1be-f3fc-4d29-b58b-01aaa8db8f4c tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] 10.222.0.13 "GET /compute/v2.1/servers/4b9fb909-26f7-40af-bac5-e7d2a6b9fb77" status: 200 len: 1270 microversion: 2.1 time: 0.147295 Nov 01 19:02:07.111894 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1071/2151] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:02:06 2022] GET /compute/v2.1/servers/4b9fb909-26f7-40af-bac5-e7d2a6b9fb77 => generated 1270 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:02:07.121794 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-56200429-7699-4b0d-a79a-f2db836f1bd0 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:02:07.122739 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-56200429-7699-4b0d-a79a-f2db836f1bd0 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] [instance: 2d525a31-b0be-44cb-8fb7-335075145f08] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:02:07.130266 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-56200429-7699-4b0d-a79a-f2db836f1bd0 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:07.131191 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-56200429-7699-4b0d-a79a-f2db836f1bd0 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:07.132433 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-56200429-7699-4b0d-a79a-f2db836f1bd0 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:07.133405 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-56200429-7699-4b0d-a79a-f2db836f1bd0 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:07.134159 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-56200429-7699-4b0d-a79a-f2db836f1bd0 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:07.134981 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-56200429-7699-4b0d-a79a-f2db836f1bd0 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:07.256720 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.quota [None req-b9d7a7db-fe04-4008-829a-d07f299ee859 tempest-ServersTestBootFromVolume-877599095 tempest-ServersTestBootFromVolume-877599095-project] Getting quotas for project 651046528c204df299ca3d14c44b4a7a. Resources: dict_keys(['metadata_items']) {{(pid=121402) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 01 19:02:07.273124 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.quota [None req-b9d7a7db-fe04-4008-829a-d07f299ee859 tempest-ServersTestBootFromVolume-877599095 tempest-ServersTestBootFromVolume-877599095-project] Getting quotas for user ed2352ce53fc4045adde8cd81b78b3ed and project 651046528c204df299ca3d14c44b4a7a. Resources: dict_keys(['metadata_items']) {{(pid=121402) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 01 19:02:07.310202 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.virt.hardware [None req-b9d7a7db-fe04-4008-829a-d07f299ee859 tempest-ServersTestBootFromVolume-877599095 tempest-ServersTestBootFromVolume-877599095-project] Flavor limits 0:0:0 {{(pid=121402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 01 19:02:07.316552 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.virt.hardware [None req-b9d7a7db-fe04-4008-829a-d07f299ee859 tempest-ServersTestBootFromVolume-877599095 tempest-ServersTestBootFromVolume-877599095-project] Image limits 0:0:0 {{(pid=121402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 01 19:02:07.318849 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.virt.hardware [None req-b9d7a7db-fe04-4008-829a-d07f299ee859 tempest-ServersTestBootFromVolume-877599095 tempest-ServersTestBootFromVolume-877599095-project] Flavor pref 0:0:0 {{(pid=121402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 01 19:02:07.325468 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.virt.hardware [None req-b9d7a7db-fe04-4008-829a-d07f299ee859 tempest-ServersTestBootFromVolume-877599095 tempest-ServersTestBootFromVolume-877599095-project] Image pref 0:0:0 {{(pid=121402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 01 19:02:07.326209 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.virt.hardware [None req-b9d7a7db-fe04-4008-829a-d07f299ee859 tempest-ServersTestBootFromVolume-877599095 tempest-ServersTestBootFromVolume-877599095-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 01 19:02:07.376155 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b9d7a7db-fe04-4008-829a-d07f299ee859 tempest-ServersTestBootFromVolume-877599095 tempest-ServersTestBootFromVolume-877599095-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:07.377097 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b9d7a7db-fe04-4008-829a-d07f299ee859 tempest-ServersTestBootFromVolume-877599095 tempest-ServersTestBootFromVolume-877599095-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:07.396002 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b9d7a7db-fe04-4008-829a-d07f299ee859 tempest-ServersTestBootFromVolume-877599095 tempest-ServersTestBootFromVolume-877599095-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:07.403581 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b9d7a7db-fe04-4008-829a-d07f299ee859 tempest-ServersTestBootFromVolume-877599095 tempest-ServersTestBootFromVolume-877599095-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:07.405333 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b9d7a7db-fe04-4008-829a-d07f299ee859 tempest-ServersTestBootFromVolume-877599095 tempest-ServersTestBootFromVolume-877599095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:07.406155 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b9d7a7db-fe04-4008-829a-d07f299ee859 tempest-ServersTestBootFromVolume-877599095 tempest-ServersTestBootFromVolume-877599095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:07.438890 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.quota [None req-b9d7a7db-fe04-4008-829a-d07f299ee859 tempest-ServersTestBootFromVolume-877599095 tempest-ServersTestBootFromVolume-877599095-project] Getting quotas for project 651046528c204df299ca3d14c44b4a7a. Resources: {'cores', 'ram', 'instances'} {{(pid=121402) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 01 19:02:07.448099 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.quota [None req-b9d7a7db-fe04-4008-829a-d07f299ee859 tempest-ServersTestBootFromVolume-877599095 tempest-ServersTestBootFromVolume-877599095-project] Getting quotas for user ed2352ce53fc4045adde8cd81b78b3ed and project 651046528c204df299ca3d14c44b4a7a. Resources: {'cores', 'ram', 'instances'} {{(pid=121402) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 01 19:02:07.552248 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-b9d7a7db-fe04-4008-829a-d07f299ee859 tempest-ServersTestBootFromVolume-877599095 tempest-ServersTestBootFromVolume-877599095-project] Going to run 1 instances... {{(pid=121402) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 01 19:02:07.559030 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-b9d7a7db-fe04-4008-829a-d07f299ee859 tempest-ServersTestBootFromVolume-877599095 tempest-ServersTestBootFromVolume-877599095-project] [instance: 44cdf0d8-969b-4149-bb03-6bc390977019] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='fe6065c8-0574-4203-9149-9b9f23593b36',volume_size=None,volume_type=None)] {{(pid=121402) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 01 19:02:07.614442 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-56200429-7699-4b0d-a79a-f2db836f1bd0 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f32f5fba1976432d938e664c7714e52b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b9d4c236b944f9b2e8e502a50a8f8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:02:07.631181 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-56200429-7699-4b0d-a79a-f2db836f1bd0 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] 10.222.0.13 "GET /compute/v2.1/servers/2d525a31-b0be-44cb-8fb7-335075145f08" status: 200 len: 1668 microversion: 2.1 time: 0.517698 Nov 01 19:02:07.652721 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1072/2152] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:02:07 2022] GET /compute/v2.1/servers/2d525a31-b0be-44cb-8fb7-335075145f08 => generated 1668 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:02:07.666140 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-14311359-48d2-4d8d-9082-86dda8558987 tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] Calling method '.version_select at 0x7f0ae20f7af0>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:02:07.826471 n-d-863052-2 devstack@n-api.service[121402]: DEBUG dbcounter [-] [121402] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=3,nova_api:INSERT=3 {{(pid=121402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 19:02:07.889024 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-b9d7a7db-fe04-4008-829a-d07f299ee859 tempest-ServersTestBootFromVolume-877599095 tempest-ServersTestBootFromVolume-877599095-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 3.358265 Nov 01 19:02:07.897542 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1081/2153] 10.222.0.13 () {60 vars in 1147 bytes} [Tue Nov 1 19:02:04 2022] POST /compute/v2.1/servers => generated 407 bytes in 3372 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 01 19:02:07.915394 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-2999912e-b354-4862-970c-4d333b367470 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:02:07.916012 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-2999912e-b354-4862-970c-4d333b367470 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] [instance: 992f5ec5-d256-4870-b16d-fc8d9adbd3e7] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:02:07.947441 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2999912e-b354-4862-970c-4d333b367470 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:07.951835 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2999912e-b354-4862-970c-4d333b367470 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:07.952192 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2999912e-b354-4862-970c-4d333b367470 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:07.957400 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2999912e-b354-4862-970c-4d333b367470 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:07.957885 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2999912e-b354-4862-970c-4d333b367470 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:07.958313 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2999912e-b354-4862-970c-4d333b367470 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:08.075373 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-14311359-48d2-4d8d-9082-86dda8558987 tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] 10.222.0.13 "DELETE /compute/v2.1/images/aae46426-024e-44e4-b4e7-b48a8aa6c27e" status: 204 len: 0 microversion: 2.1 time: 0.415660 Nov 01 19:02:08.076239 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1073/2154] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:02:07 2022] DELETE /compute/v2.1/images/aae46426-024e-44e4-b4e7-b48a8aa6c27e => generated 0 bytes in 423 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 01 19:02:08.081220 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-e0b6aa12-4305-4e8f-95ef-ab27ba778f98 tempest-LiveAutoBlockMigrationV225Test-1358532044 tempest-LiveAutoBlockMigrationV225Test-1358532044-project-admin] Calling method '.version_select at 0x7f0ae20ab940>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:02:08.092753 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-e0b6aa12-4305-4e8f-95ef-ab27ba778f98 tempest-LiveAutoBlockMigrationV225Test-1358532044 tempest-LiveAutoBlockMigrationV225Test-1358532044-project-admin] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:08.093554 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-e0b6aa12-4305-4e8f-95ef-ab27ba778f98 tempest-LiveAutoBlockMigrationV225Test-1358532044 tempest-LiveAutoBlockMigrationV225Test-1358532044-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:08.094167 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-e0b6aa12-4305-4e8f-95ef-ab27ba778f98 tempest-LiveAutoBlockMigrationV225Test-1358532044 tempest-LiveAutoBlockMigrationV225Test-1358532044-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:08.111692 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-e0b6aa12-4305-4e8f-95ef-ab27ba778f98 tempest-LiveAutoBlockMigrationV225Test-1358532044 tempest-LiveAutoBlockMigrationV225Test-1358532044-project-admin] 10.222.0.13 "GET /compute/v2.1/os-migrations" status: 200 len: 3200 microversion: 2.25 time: 0.034201 Nov 01 19:02:08.113554 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1074/2155] 10.222.0.13 () {60 vars in 1184 bytes} [Tue Nov 1 19:02:08 2022] GET /compute/v2.1/os-migrations => generated 3200 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 19:02:08.119065 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-f88e05ff-552a-471f-9c7a-ad2e40347527 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:02:08.119854 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-f88e05ff-552a-471f-9c7a-ad2e40347527 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] [instance: 90b353ab-ef97-4d88-b5bc-b355ff576225] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:02:08.127181 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f88e05ff-552a-471f-9c7a-ad2e40347527 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:08.130519 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f88e05ff-552a-471f-9c7a-ad2e40347527 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:08.131312 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f88e05ff-552a-471f-9c7a-ad2e40347527 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:08.132853 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f88e05ff-552a-471f-9c7a-ad2e40347527 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:08.133310 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f88e05ff-552a-471f-9c7a-ad2e40347527 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:08.134723 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f88e05ff-552a-471f-9c7a-ad2e40347527 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:08.682939 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-2999912e-b354-4862-970c-4d333b367470 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb496b3faac4abbae73d389f2042e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e2520220d454764b8c139a58d78ac83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:02:08.697746 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-2999912e-b354-4862-970c-4d333b367470 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] 10.222.0.13 "GET /compute/v2.1/servers/992f5ec5-d256-4870-b16d-fc8d9adbd3e7" status: 200 len: 1314 microversion: 2.1 time: 0.793230 Nov 01 19:02:08.698345 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1082/2156] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:02:07 2022] GET /compute/v2.1/servers/992f5ec5-d256-4870-b16d-fc8d9adbd3e7 => generated 1314 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:02:08.710828 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-62032974-b61c-4d3c-a1a7-0bd202452b29 tempest-ServersTestBootFromVolume-877599095 tempest-ServersTestBootFromVolume-877599095-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:02:08.711753 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-62032974-b61c-4d3c-a1a7-0bd202452b29 tempest-ServersTestBootFromVolume-877599095 tempest-ServersTestBootFromVolume-877599095-project] [instance: 44cdf0d8-969b-4149-bb03-6bc390977019] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:02:08.853294 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-f88e05ff-552a-471f-9c7a-ad2e40347527 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a63d69c99a546f0af16329cff3ca717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a1bb191cff948e99c008b5e861ce4a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:02:08.863542 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-f88e05ff-552a-471f-9c7a-ad2e40347527 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] 10.222.0.13 "GET /compute/v2.1/servers/90b353ab-ef97-4d88-b5bc-b355ff576225" status: 200 len: 1736 microversion: 2.1 time: 0.748775 Nov 01 19:02:08.869489 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1075/2157] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:02:08 2022] GET /compute/v2.1/servers/90b353ab-ef97-4d88-b5bc-b355ff576225 => generated 1736 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:02:08.880321 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-81aff290-3497-458f-94e8-e45e11743b8c tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] Calling method '.version_select at 0x7f0ae20f7b80>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:02:08.890114 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-62032974-b61c-4d3c-a1a7-0bd202452b29 tempest-ServersTestBootFromVolume-877599095 tempest-ServersTestBootFromVolume-877599095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed2352ce53fc4045adde8cd81b78b3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651046528c204df299ca3d14c44b4a7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:02:08.902412 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-62032974-b61c-4d3c-a1a7-0bd202452b29 tempest-ServersTestBootFromVolume-877599095 tempest-ServersTestBootFromVolume-877599095-project] 10.222.0.13 "GET /compute/v2.1/servers/44cdf0d8-969b-4149-bb03-6bc390977019" status: 200 len: 1120 microversion: 2.1 time: 0.199930 Nov 01 19:02:08.918172 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1083/2158] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:02:08 2022] GET /compute/v2.1/servers/44cdf0d8-969b-4149-bb03-6bc390977019 => generated 1120 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:02:08.924429 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-e1a978b2-5f03-4a04-a968-87b08bb26a05 tempest-LiveAutoBlockMigrationV225Test-1358532044 tempest-LiveAutoBlockMigrationV225Test-1358532044-project-admin] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:02:08.925282 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-e1a978b2-5f03-4a04-a968-87b08bb26a05 tempest-LiveAutoBlockMigrationV225Test-1358532044 tempest-LiveAutoBlockMigrationV225Test-1358532044-project-admin] [instance: cd879708-f757-4f88-bc95-38b6cd55363c] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:02:08.932505 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e1a978b2-5f03-4a04-a968-87b08bb26a05 tempest-LiveAutoBlockMigrationV225Test-1358532044 tempest-LiveAutoBlockMigrationV225Test-1358532044-project-admin] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:08.933271 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e1a978b2-5f03-4a04-a968-87b08bb26a05 tempest-LiveAutoBlockMigrationV225Test-1358532044 tempest-LiveAutoBlockMigrationV225Test-1358532044-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:08.933901 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e1a978b2-5f03-4a04-a968-87b08bb26a05 tempest-LiveAutoBlockMigrationV225Test-1358532044 tempest-LiveAutoBlockMigrationV225Test-1358532044-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:08.934765 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e1a978b2-5f03-4a04-a968-87b08bb26a05 tempest-LiveAutoBlockMigrationV225Test-1358532044 tempest-LiveAutoBlockMigrationV225Test-1358532044-project-admin] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:08.935371 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e1a978b2-5f03-4a04-a968-87b08bb26a05 tempest-LiveAutoBlockMigrationV225Test-1358532044 tempest-LiveAutoBlockMigrationV225Test-1358532044-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:08.936182 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e1a978b2-5f03-4a04-a968-87b08bb26a05 tempest-LiveAutoBlockMigrationV225Test-1358532044 tempest-LiveAutoBlockMigrationV225Test-1358532044-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:09.378954 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.objects.instance [None req-e1a978b2-5f03-4a04-a968-87b08bb26a05 tempest-LiveAutoBlockMigrationV225Test-1358532044 tempest-LiveAutoBlockMigrationV225Test-1358532044-project-admin] Lazy-loading 'services' on Instance uuid cd879708-f757-4f88-bc95-38b6cd55363c {{(pid=121402) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 01 19:02:09.418317 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-e1a978b2-5f03-4a04-a968-87b08bb26a05 tempest-LiveAutoBlockMigrationV225Test-1358532044 tempest-LiveAutoBlockMigrationV225Test-1358532044-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/cd879708-f757-4f88-bc95-38b6cd55363c" status: 200 len: 1969 microversion: 2.25 time: 0.496622 Nov 01 19:02:09.436698 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-81aff290-3497-458f-94e8-e45e11743b8c tempest-ListImageFiltersTestJSON-1185829401 tempest-ListImageFiltersTestJSON-1185829401-project] 10.222.0.13 "DELETE /compute/v2.1/images/27a7ec4e-8455-4687-bd75-e5c5429c154a" status: 204 len: 0 microversion: 2.1 time: 0.558107 Nov 01 19:02:09.436698 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1076/2159] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:02:08 2022] DELETE /compute/v2.1/images/27a7ec4e-8455-4687-bd75-e5c5429c154a => generated 0 bytes in 561 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 01 19:02:09.436698 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-cceafc33-51ee-43e9-b39b-56b2a4c9e604 tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:02:09.437483 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-cceafc33-51ee-43e9-b39b-56b2a4c9e604 tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] [instance: 4b9fb909-26f7-40af-bac5-e7d2a6b9fb77] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:02:09.437806 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1084/2160] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 19:02:08 2022] GET /compute/v2.1/servers/cd879708-f757-4f88-bc95-38b6cd55363c => generated 1969 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 19:02:09.452000 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-72fe0f75-de0c-4488-be20-3b9ed81f38e1 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:02:09.453002 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-72fe0f75-de0c-4488-be20-3b9ed81f38e1 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] [instance: 2d525a31-b0be-44cb-8fb7-335075145f08] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:02:09.459954 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-72fe0f75-de0c-4488-be20-3b9ed81f38e1 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:09.460814 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-72fe0f75-de0c-4488-be20-3b9ed81f38e1 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:09.461611 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-72fe0f75-de0c-4488-be20-3b9ed81f38e1 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:09.462546 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-72fe0f75-de0c-4488-be20-3b9ed81f38e1 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:09.463229 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-72fe0f75-de0c-4488-be20-3b9ed81f38e1 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:09.463889 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-72fe0f75-de0c-4488-be20-3b9ed81f38e1 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:09.468668 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-cceafc33-51ee-43e9-b39b-56b2a4c9e604 tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:09.471720 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-cceafc33-51ee-43e9-b39b-56b2a4c9e604 tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:09.472436 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-cceafc33-51ee-43e9-b39b-56b2a4c9e604 tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:09.476678 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-cceafc33-51ee-43e9-b39b-56b2a4c9e604 tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:09.481045 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-cceafc33-51ee-43e9-b39b-56b2a4c9e604 tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:09.481801 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-cceafc33-51ee-43e9-b39b-56b2a4c9e604 tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:09.616243 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-72fe0f75-de0c-4488-be20-3b9ed81f38e1 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:09.620007 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-72fe0f75-de0c-4488-be20-3b9ed81f38e1 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:09.621184 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-72fe0f75-de0c-4488-be20-3b9ed81f38e1 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:09.624262 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.objects.instance [None req-72fe0f75-de0c-4488-be20-3b9ed81f38e1 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lazy-loading 'fault' on Instance uuid 2d525a31-b0be-44cb-8fb7-335075145f08 {{(pid=121402) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 01 19:02:10.071490 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-72fe0f75-de0c-4488-be20-3b9ed81f38e1 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f32f5fba1976432d938e664c7714e52b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b9d4c236b944f9b2e8e502a50a8f8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:02:10.088164 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-72fe0f75-de0c-4488-be20-3b9ed81f38e1 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] 10.222.0.13 "GET /compute/v2.1/servers/2d525a31-b0be-44cb-8fb7-335075145f08" status: 200 len: 1325 microversion: 2.1 time: 0.648722 Nov 01 19:02:10.100978 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1085/2161] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:02:09 2022] GET /compute/v2.1/servers/2d525a31-b0be-44cb-8fb7-335075145f08 => generated 1325 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:02:10.107558 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [req-70d50f64-fa06-4fe2-9933-03d04f896bee req-a6c07fe0-86b6-4207-b777-197590bd4bc0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d525a31-b0be-44cb-8fb7-335075145f08", "name": "network-vif-deleted", "tag": "3737be69-e488-4046-be48-2027dbcedf12"}]} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:02:10.130193 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-70d50f64-fa06-4fe2-9933-03d04f896bee req-a6c07fe0-86b6-4207-b777-197590bd4bc0 service nova] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:10.132383 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-70d50f64-fa06-4fe2-9933-03d04f896bee req-a6c07fe0-86b6-4207-b777-197590bd4bc0 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:10.132878 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-70d50f64-fa06-4fe2-9933-03d04f896bee req-a6c07fe0-86b6-4207-b777-197590bd4bc0 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:10.163469 n-d-863052-2 devstack@n-api.service[121402]: DEBUG dbcounter [-] [121402] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=121402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 19:02:10.170728 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.compute.server_external_events [req-70d50f64-fa06-4fe2-9933-03d04f896bee req-a6c07fe0-86b6-4207-b777-197590bd4bc0 service nova] Creating event network-vif-deleted:3737be69-e488-4046-be48-2027dbcedf12 for instance 2d525a31-b0be-44cb-8fb7-335075145f08 on n-h2-863052-2 Nov 01 19:02:10.183144 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [req-70d50f64-fa06-4fe2-9933-03d04f896bee req-a6c07fe0-86b6-4207-b777-197590bd4bc0 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089944 Nov 01 19:02:10.187847 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1086/2162] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Nov 1 19:02:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:02:10.199465 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-3bd153bb-4f71-405c-ab5a-5b3f090684b4 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:02:10.200961 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-3bd153bb-4f71-405c-ab5a-5b3f090684b4 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] [instance: cd879708-f757-4f88-bc95-38b6cd55363c] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:02:10.223669 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-3bd153bb-4f71-405c-ab5a-5b3f090684b4 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:10.224251 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-3bd153bb-4f71-405c-ab5a-5b3f090684b4 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:10.226780 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-3bd153bb-4f71-405c-ab5a-5b3f090684b4 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:10.227568 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-3bd153bb-4f71-405c-ab5a-5b3f090684b4 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:10.230056 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-3bd153bb-4f71-405c-ab5a-5b3f090684b4 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:10.233627 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-3bd153bb-4f71-405c-ab5a-5b3f090684b4 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:10.298014 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-3bd153bb-4f71-405c-ab5a-5b3f090684b4 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] [instance: cd879708-f757-4f88-bc95-38b6cd55363c] Going to try to terminate instance {{(pid=121402) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 01 19:02:10.484320 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-3bd153bb-4f71-405c-ab5a-5b3f090684b4 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] 10.222.0.13 "DELETE /compute/v2.1/servers/cd879708-f757-4f88-bc95-38b6cd55363c" status: 204 len: 0 microversion: 2.25 time: 0.293341 Nov 01 19:02:10.490372 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1087/2163] 10.222.0.13 () {60 vars in 1280 bytes} [Tue Nov 1 19:02:10 2022] DELETE /compute/v2.1/servers/cd879708-f757-4f88-bc95-38b6cd55363c => generated 0 bytes in 302 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 01 19:02:10.500283 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-2fd0bc09-2f9d-433e-919e-2e262b2f7642 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:02:10.501744 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-2fd0bc09-2f9d-433e-919e-2e262b2f7642 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] [instance: 992f5ec5-d256-4870-b16d-fc8d9adbd3e7] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:02:10.518168 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2fd0bc09-2f9d-433e-919e-2e262b2f7642 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:10.518993 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2fd0bc09-2f9d-433e-919e-2e262b2f7642 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:10.523706 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2fd0bc09-2f9d-433e-919e-2e262b2f7642 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:10.524803 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2fd0bc09-2f9d-433e-919e-2e262b2f7642 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:10.526580 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2fd0bc09-2f9d-433e-919e-2e262b2f7642 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:10.527244 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2fd0bc09-2f9d-433e-919e-2e262b2f7642 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:10.596741 n-d-863052-2 devstack@n-api.service[121403]: DEBUG dbcounter [-] [121403] Writing DB stats nova_cell0:SELECT=2 {{(pid=121403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 19:02:10.659172 n-d-863052-2 devstack@n-api.service[121403]: DEBUG dbcounter [-] [121403] Writing DB stats nova_cell0:SELECT=6 {{(pid=121403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 19:02:10.709213 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-cceafc33-51ee-43e9-b39b-56b2a4c9e604 tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52acef7992d64d378fd8ac333887fd0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af51b8733e984c2ca87df2d8163dedf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:02:10.719924 n-d-863052-2 devstack@n-api.service[121403]: DEBUG dbcounter [-] [121403] Writing DB stats nova_cell1:SELECT=100 {{(pid=121403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 19:02:10.727720 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-cceafc33-51ee-43e9-b39b-56b2a4c9e604 tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] 10.222.0.13 "GET /compute/v2.1/servers/4b9fb909-26f7-40af-bac5-e7d2a6b9fb77" status: 200 len: 1312 microversion: 2.1 time: 1.292753 Nov 01 19:02:10.736151 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1077/2164] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:02:09 2022] GET /compute/v2.1/servers/4b9fb909-26f7-40af-bac5-e7d2a6b9fb77 => generated 1312 bytes in 1303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:02:10.756165 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-02e29db4-9729-40c2-961c-973d75590150 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:02:10.762245 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-02e29db4-9729-40c2-961c-973d75590150 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] [instance: 90b353ab-ef97-4d88-b5bc-b355ff576225] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:02:10.789917 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-02e29db4-9729-40c2-961c-973d75590150 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:10.790428 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-02e29db4-9729-40c2-961c-973d75590150 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:10.794843 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-02e29db4-9729-40c2-961c-973d75590150 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:10.802569 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-02e29db4-9729-40c2-961c-973d75590150 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:10.803504 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-02e29db4-9729-40c2-961c-973d75590150 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:10.805293 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-02e29db4-9729-40c2-961c-973d75590150 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:10.894499 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-2fd0bc09-2f9d-433e-919e-2e262b2f7642 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb496b3faac4abbae73d389f2042e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e2520220d454764b8c139a58d78ac83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:02:10.905806 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-2fd0bc09-2f9d-433e-919e-2e262b2f7642 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] 10.222.0.13 "GET /compute/v2.1/servers/992f5ec5-d256-4870-b16d-fc8d9adbd3e7" status: 200 len: 1464 microversion: 2.1 time: 0.413149 Nov 01 19:02:10.908530 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1088/2165] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:02:10 2022] GET /compute/v2.1/servers/992f5ec5-d256-4870-b16d-fc8d9adbd3e7 => generated 1464 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:02:10.917741 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-c6b67115-506b-4342-af35-e0b9ad25e14e tempest-ServersTestBootFromVolume-877599095 tempest-ServersTestBootFromVolume-877599095-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:02:10.920937 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-c6b67115-506b-4342-af35-e0b9ad25e14e tempest-ServersTestBootFromVolume-877599095 tempest-ServersTestBootFromVolume-877599095-project] [instance: 44cdf0d8-969b-4149-bb03-6bc390977019] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:02:10.936079 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-c6b67115-506b-4342-af35-e0b9ad25e14e tempest-ServersTestBootFromVolume-877599095 tempest-ServersTestBootFromVolume-877599095-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:10.938989 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-c6b67115-506b-4342-af35-e0b9ad25e14e tempest-ServersTestBootFromVolume-877599095 tempest-ServersTestBootFromVolume-877599095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:10.940348 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-c6b67115-506b-4342-af35-e0b9ad25e14e tempest-ServersTestBootFromVolume-877599095 tempest-ServersTestBootFromVolume-877599095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:10.943914 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-c6b67115-506b-4342-af35-e0b9ad25e14e tempest-ServersTestBootFromVolume-877599095 tempest-ServersTestBootFromVolume-877599095-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:10.946677 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-c6b67115-506b-4342-af35-e0b9ad25e14e tempest-ServersTestBootFromVolume-877599095 tempest-ServersTestBootFromVolume-877599095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:10.948125 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-c6b67115-506b-4342-af35-e0b9ad25e14e tempest-ServersTestBootFromVolume-877599095 tempest-ServersTestBootFromVolume-877599095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:11.127424 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-c6b67115-506b-4342-af35-e0b9ad25e14e tempest-ServersTestBootFromVolume-877599095 tempest-ServersTestBootFromVolume-877599095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed2352ce53fc4045adde8cd81b78b3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651046528c204df299ca3d14c44b4a7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:02:11.135502 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-c6b67115-506b-4342-af35-e0b9ad25e14e tempest-ServersTestBootFromVolume-877599095 tempest-ServersTestBootFromVolume-877599095-project] 10.222.0.13 "GET /compute/v2.1/servers/44cdf0d8-969b-4149-bb03-6bc390977019" status: 200 len: 1218 microversion: 2.1 time: 0.225600 Nov 01 19:02:11.136095 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1089/2166] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:02:10 2022] GET /compute/v2.1/servers/44cdf0d8-969b-4149-bb03-6bc390977019 => generated 1218 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:02:11.142649 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-6dbb0038-ec04-40c3-be67-065d31682480 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:02:11.143750 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-6dbb0038-ec04-40c3-be67-065d31682480 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] [instance: cd879708-f757-4f88-bc95-38b6cd55363c] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:02:11.160982 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-6dbb0038-ec04-40c3-be67-065d31682480 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:11.161902 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-6dbb0038-ec04-40c3-be67-065d31682480 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:11.162839 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-6dbb0038-ec04-40c3-be67-065d31682480 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:11.164517 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-6dbb0038-ec04-40c3-be67-065d31682480 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:11.165305 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-6dbb0038-ec04-40c3-be67-065d31682480 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:11.166024 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-6dbb0038-ec04-40c3-be67-065d31682480 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:11.487007 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-02e29db4-9729-40c2-961c-973d75590150 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a63d69c99a546f0af16329cff3ca717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a1bb191cff948e99c008b5e861ce4a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:02:11.499885 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-02e29db4-9729-40c2-961c-973d75590150 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] 10.222.0.13 "GET /compute/v2.1/servers/90b353ab-ef97-4d88-b5bc-b355ff576225" status: 200 len: 1716 microversion: 2.1 time: 0.760907 Nov 01 19:02:11.509950 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1078/2167] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:02:10 2022] GET /compute/v2.1/servers/90b353ab-ef97-4d88-b5bc-b355ff576225 => generated 1716 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:02:11.525372 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-caf1c91a-40b0-48b7-8317-c7596ee6902d tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:02:11.525998 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-caf1c91a-40b0-48b7-8317-c7596ee6902d tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] [instance: 2d525a31-b0be-44cb-8fb7-335075145f08] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:02:11.535955 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-caf1c91a-40b0-48b7-8317-c7596ee6902d tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:11.536451 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-caf1c91a-40b0-48b7-8317-c7596ee6902d tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:11.536939 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-caf1c91a-40b0-48b7-8317-c7596ee6902d tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:11.537661 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-caf1c91a-40b0-48b7-8317-c7596ee6902d tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:11.538162 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-caf1c91a-40b0-48b7-8317-c7596ee6902d tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:11.538595 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-caf1c91a-40b0-48b7-8317-c7596ee6902d tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:11.621345 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.wsgi [None req-caf1c91a-40b0-48b7-8317-c7596ee6902d tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] HTTP exception thrown: Instance 2d525a31-b0be-44cb-8fb7-335075145f08 could not be found. Nov 01 19:02:11.623220 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-caf1c91a-40b0-48b7-8317-c7596ee6902d tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Request method failure captured: Nov 01 19:02:11.623220 n-d-863052-2 devstack@n-api.service[121403]: request: GET /compute/v2.1/servers/2d525a31-b0be-44cb-8fb7-335075145f08 HTTP/1.1 Nov 01 19:02:11.623220 n-d-863052-2 devstack@n-api.service[121403]: Accept: application/json Nov 01 19:02:11.623220 n-d-863052-2 devstack@n-api.service[121403]: Accept-Encoding: identity Nov 01 19:02:11.623220 n-d-863052-2 devstack@n-api.service[121403]: Connection: close Nov 01 19:02:11.623220 n-d-863052-2 devstack@n-api.service[121403]: Content-Length: 0 Nov 01 19:02:11.623220 n-d-863052-2 devstack@n-api.service[121403]: Content-Type: application/json Nov 01 19:02:11.623220 n-d-863052-2 devstack@n-api.service[121403]: Host: 10.222.0.13 Nov 01 19:02:11.623220 n-d-863052-2 devstack@n-api.service[121403]: Openstack-System-Scope: None Nov 01 19:02:11.623220 n-d-863052-2 devstack@n-api.service[121403]: User-Agent: python-urllib3/1.26.12 Nov 01 19:02:11.623220 n-d-863052-2 devstack@n-api.service[121403]: X-Auth-Token: gAAAAABjYWt-NQXke2xaT5Zx7jRYabVG4ahAkm8OML59W5vfFJqbwex-J1ZiLL497voaQvk8mxYaO51_Dy7DE73iezGuKz14bZTbSfTjEO0SNQwkG26Td9pn2M3Cq9W9_GYL5mCba8SZ_e1faAE8WJGSrhBj4wfU4ft8jddNlfpfKRiwGV7JCoo Nov 01 19:02:11.623220 n-d-863052-2 devstack@n-api.service[121403]: X-Domain-Id: None Nov 01 19:02:11.623220 n-d-863052-2 devstack@n-api.service[121403]: X-Domain-Name: None Nov 01 19:02:11.623220 n-d-863052-2 devstack@n-api.service[121403]: X-Identity-Status: Confirmed Nov 01 19:02:11.623220 n-d-863052-2 devstack@n-api.service[121403]: X-Is-Admin-Project: True Nov 01 19:02:11.623220 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Domain-Id: default Nov 01 19:02:11.623220 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Domain-Name: Default Nov 01 19:02:11.623220 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Id: d9b9d4c236b944f9b2e8e502a50a8f8b Nov 01 19:02:11.623220 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Name: tempest-LiveMigrationTest-1986167696 Nov 01 19:02:11.623220 n-d-863052-2 devstack@n-api.service[121403]: X-Role: member,reader Nov 01 19:02:11.623220 n-d-863052-2 devstack@n-api.service[121403]: X-Roles: member,reader Nov 01 19:02:11.624924 n-d-863052-2 devstack@n-api.service[121403]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/d9b9d4c236b944f9b2e8e502a50a8f8b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/d9b9d4c236b944f9b2e8e502a50a8f8b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_d9b9d4c236b944f9b2e8e502a50a8f8b", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/d9b9d4c236b944f9b2e8e502a50a8f8b"}]}] Nov 01 19:02:11.624924 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant: tempest-LiveMigrationTest-1986167696 Nov 01 19:02:11.624924 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant-Id: d9b9d4c236b944f9b2e8e502a50a8f8b Nov 01 19:02:11.624924 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant-Name: tempest-LiveMigrationTest-1986167696 Nov 01 19:02:11.624924 n-d-863052-2 devstack@n-api.service[121403]: X-User: tempest-LiveMigrationTest-1986167696-project Nov 01 19:02:11.624924 n-d-863052-2 devstack@n-api.service[121403]: X-User-Domain-Id: default Nov 01 19:02:11.624924 n-d-863052-2 devstack@n-api.service[121403]: X-User-Domain-Name: Default Nov 01 19:02:11.624924 n-d-863052-2 devstack@n-api.service[121403]: X-User-Id: f32f5fba1976432d938e664c7714e52b Nov 01 19:02:11.624924 n-d-863052-2 devstack@n-api.service[121403]: X-User-Name: tempest-LiveMigrationTest-1986167696-project Nov 01 19:02:11.624924 n-d-863052-2 devstack@n-api.service[121403]: method: > Nov 01 19:02:11.624924 n-d-863052-2 devstack@n-api.service[121403]: exception: Instance 2d525a31-b0be-44cb-8fb7-335075145f08 could not be found. Nov 01 19:02:11.624924 n-d-863052-2 devstack@n-api.service[121403]: action_args: {'id': '2d525a31-b0be-44cb-8fb7-335075145f08'} Nov 01 19:02:11.625831 n-d-863052-2 devstack@n-api.service[121403]: {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 01 19:02:11.625831 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:02:11.625831 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 01 19:02:11.625831 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 01 19:02:11.625831 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 01 19:02:11.625831 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 01 19:02:11.625831 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 01 19:02:11.625831 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 01 19:02:11.625831 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 01 19:02:11.625831 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 01 19:02:11.625831 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2d525a31-b0be-44cb-8fb7-335075145f08 could not be found. Nov 01 19:02:11.625831 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:02:11.625831 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:02:11.625831 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:02:11.625831 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:02:11.625831 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:02:11.625831 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:02:11.625831 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 01 19:02:11.625831 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 01 19:02:11.625831 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 01 19:02:11.629893 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 01 19:02:11.629893 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 01 19:02:11.629893 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 01 19:02:11.629893 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 01 19:02:11.629893 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 01 19:02:11.629893 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 01 19:02:11.629893 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 01 19:02:11.629893 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2d525a31-b0be-44cb-8fb7-335075145f08 could not be found. Nov 01 19:02:11.629893 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:02:11.629893 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:02:11.629893 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:02:11.629893 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:02:11.629893 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:02:11.629893 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:02:11.629893 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 01 19:02:11.629893 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 01 19:02:11.629893 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2d525a31-b0be-44cb-8fb7-335075145f08 could not be found. Nov 01 19:02:11.629893 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:02:11.633591 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-caf1c91a-40b0-48b7-8317-c7596ee6902d tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Returning 404 to user: Instance 2d525a31-b0be-44cb-8fb7-335075145f08 could not be found. {{(pid=121403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 01 19:02:11.633591 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-caf1c91a-40b0-48b7-8317-c7596ee6902d tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] 10.222.0.13 "GET /compute/v2.1/servers/2d525a31-b0be-44cb-8fb7-335075145f08" status: 404 len: 111 microversion: 2.1 time: 0.113553 Nov 01 19:02:11.633591 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1079/2168] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:02:11 2022] GET /compute/v2.1/servers/2d525a31-b0be-44cb-8fb7-335075145f08 => generated 111 bytes in 115 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 01 19:02:11.677298 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-22495b43-8c2d-4ccb-99e2-7167267f286a tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-1638621875", "imageRef": "2d4a0047-1b9e-445f-8af8-1b5c9d93e881", "flavorRef": "452"}, "os:scheduler_hints": {"same_host": "992f5ec5-d256-4870-b16d-fc8d9adbd3e7"}} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:02:11.775559 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.network.neutron [None req-22495b43-8c2d-4ccb-99e2-7167267f286a tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] validate_networks() for None {{(pid=121403) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 01 19:02:12.319545 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.virt.hardware [None req-22495b43-8c2d-4ccb-99e2-7167267f286a tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Flavor limits 0:0:0 {{(pid=121403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 01 19:02:12.320224 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.virt.hardware [None req-22495b43-8c2d-4ccb-99e2-7167267f286a tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Image limits 0:0:0 {{(pid=121403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 01 19:02:12.321107 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.virt.hardware [None req-22495b43-8c2d-4ccb-99e2-7167267f286a tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Flavor pref 0:0:0 {{(pid=121403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 01 19:02:12.321690 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.virt.hardware [None req-22495b43-8c2d-4ccb-99e2-7167267f286a tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Image pref 0:0:0 {{(pid=121403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 01 19:02:12.322427 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.virt.hardware [None req-22495b43-8c2d-4ccb-99e2-7167267f286a tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 01 19:02:12.339036 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-22495b43-8c2d-4ccb-99e2-7167267f286a tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:12.342216 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-22495b43-8c2d-4ccb-99e2-7167267f286a tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:12.342676 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-22495b43-8c2d-4ccb-99e2-7167267f286a tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:12.347628 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-22495b43-8c2d-4ccb-99e2-7167267f286a tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:12.348430 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-22495b43-8c2d-4ccb-99e2-7167267f286a tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:12.349139 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-22495b43-8c2d-4ccb-99e2-7167267f286a tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:12.390128 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.quota [None req-22495b43-8c2d-4ccb-99e2-7167267f286a tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Getting quotas for project 3e2520220d454764b8c139a58d78ac83. Resources: {'cores', 'ram', 'instances'} {{(pid=121403) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 01 19:02:12.407021 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.quota [None req-22495b43-8c2d-4ccb-99e2-7167267f286a tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Getting quotas for user bcb496b3faac4abbae73d389f2042e77 and project 3e2520220d454764b8c139a58d78ac83. Resources: {'cores', 'ram', 'instances'} {{(pid=121403) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 01 19:02:12.438664 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-22495b43-8c2d-4ccb-99e2-7167267f286a tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Going to run 1 instances... {{(pid=121403) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 01 19:02:12.444392 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-22495b43-8c2d-4ccb-99e2-7167267f286a tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] [instance: 46a040e6-2750-47b4-b8e2-757b92f1adf1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2d4a0047-1b9e-445f-8af8-1b5c9d93e881',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121403) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 01 19:02:12.553239 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-22495b43-8c2d-4ccb-99e2-7167267f286a tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.910360 Nov 01 19:02:12.562801 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1080/2169] 10.222.0.13 () {60 vars in 1147 bytes} [Tue Nov 1 19:02:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 937 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 01 19:02:12.574200 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-a12b567f-e26d-4b00-a5e0-339bb13c127a tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Calling method '.version_select at 0x7f0ae20b20d0>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:02:12.601701 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-a12b567f-e26d-4b00-a5e0-339bb13c127a tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1346805597" status: 202 len: 0 microversion: 2.1 time: 0.033551 Nov 01 19:02:12.604219 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1081/2170] 10.222.0.13 () {58 vars in 1221 bytes} [Tue Nov 1 19:02:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1346805597 => generated 0 bytes in 40 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 01 19:02:12.611228 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-963d99bd-8564-4c4e-9b91-836a0d53c934 tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:02:12.612227 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-963d99bd-8564-4c4e-9b91-836a0d53c934 tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] [instance: 4b9fb909-26f7-40af-bac5-e7d2a6b9fb77] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:02:12.619215 n-d-863052-2 devstack@n-api.service[121403]: DEBUG dbcounter [-] [121403] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:DELETE=1 {{(pid=121403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 19:02:12.635280 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-963d99bd-8564-4c4e-9b91-836a0d53c934 tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:12.636400 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-963d99bd-8564-4c4e-9b91-836a0d53c934 tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:12.637382 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-963d99bd-8564-4c4e-9b91-836a0d53c934 tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:12.638598 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-963d99bd-8564-4c4e-9b91-836a0d53c934 tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:12.639332 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-963d99bd-8564-4c4e-9b91-836a0d53c934 tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:12.640009 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-963d99bd-8564-4c4e-9b91-836a0d53c934 tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:12.885067 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-6dbb0038-ec04-40c3-be67-065d31682480 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:02:12.894919 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-6dbb0038-ec04-40c3-be67-065d31682480 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:02:12.896452 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-6dbb0038-ec04-40c3-be67-065d31682480 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:02:12.912172 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-6dbb0038-ec04-40c3-be67-065d31682480 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] 10.222.0.13 "GET /compute/v2.1/servers/cd879708-f757-4f88-bc95-38b6cd55363c" status: 200 len: 1482 microversion: 2.25 time: 1.774981 Nov 01 19:02:12.912907 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1090/2171] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 19:02:11 2022] GET /compute/v2.1/servers/cd879708-f757-4f88-bc95-38b6cd55363c => generated 1482 bytes in 1776 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 19:02:12.922360 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-6408505b-2048-4eac-b9e7-8cffbf398636 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:02:12.923811 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-6408505b-2048-4eac-b9e7-8cffbf398636 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] [instance: 90b353ab-ef97-4d88-b5bc-b355ff576225] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:02:12.936242 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-6408505b-2048-4eac-b9e7-8cffbf398636 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:12.937035 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-6408505b-2048-4eac-b9e7-8cffbf398636 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:12.951488 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-6408505b-2048-4eac-b9e7-8cffbf398636 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:12.952613 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-6408505b-2048-4eac-b9e7-8cffbf398636 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:12.953282 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-6408505b-2048-4eac-b9e7-8cffbf398636 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:12.953898 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-6408505b-2048-4eac-b9e7-8cffbf398636 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:13.096043 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-963d99bd-8564-4c4e-9b91-836a0d53c934 tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52acef7992d64d378fd8ac333887fd0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af51b8733e984c2ca87df2d8163dedf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:02:13.105529 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-963d99bd-8564-4c4e-9b91-836a0d53c934 tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] 10.222.0.13 "GET /compute/v2.1/servers/4b9fb909-26f7-40af-bac5-e7d2a6b9fb77" status: 200 len: 1333 microversion: 2.1 time: 0.498362 Nov 01 19:02:13.108663 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1082/2172] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:02:12 2022] GET /compute/v2.1/servers/4b9fb909-26f7-40af-bac5-e7d2a6b9fb77 => generated 1333 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:02:13.116257 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-3aa00abd-9b43-45f3-a7aa-2bf8fc7e6c4a tempest-ServersTestBootFromVolume-877599095 tempest-ServersTestBootFromVolume-877599095-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:02:13.121356 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-3aa00abd-9b43-45f3-a7aa-2bf8fc7e6c4a tempest-ServersTestBootFromVolume-877599095 tempest-ServersTestBootFromVolume-877599095-project] [instance: 44cdf0d8-969b-4149-bb03-6bc390977019] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:02:13.135717 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-3aa00abd-9b43-45f3-a7aa-2bf8fc7e6c4a tempest-ServersTestBootFromVolume-877599095 tempest-ServersTestBootFromVolume-877599095-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:13.136510 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-3aa00abd-9b43-45f3-a7aa-2bf8fc7e6c4a tempest-ServersTestBootFromVolume-877599095 tempest-ServersTestBootFromVolume-877599095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:13.139408 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-3aa00abd-9b43-45f3-a7aa-2bf8fc7e6c4a tempest-ServersTestBootFromVolume-877599095 tempest-ServersTestBootFromVolume-877599095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:13.140470 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-3aa00abd-9b43-45f3-a7aa-2bf8fc7e6c4a tempest-ServersTestBootFromVolume-877599095 tempest-ServersTestBootFromVolume-877599095-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:13.141365 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-3aa00abd-9b43-45f3-a7aa-2bf8fc7e6c4a tempest-ServersTestBootFromVolume-877599095 tempest-ServersTestBootFromVolume-877599095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:13.142026 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-3aa00abd-9b43-45f3-a7aa-2bf8fc7e6c4a tempest-ServersTestBootFromVolume-877599095 tempest-ServersTestBootFromVolume-877599095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:13.179634 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.wsgi [None req-6408505b-2048-4eac-b9e7-8cffbf398636 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] HTTP exception thrown: Cannot 'detach_volume' instance 90b353ab-ef97-4d88-b5bc-b355ff576225 while it is in vm_state rescued Nov 01 19:02:13.189742 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-6408505b-2048-4eac-b9e7-8cffbf398636 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Request method failure captured: Nov 01 19:02:13.189742 n-d-863052-2 devstack@n-api.service[121402]: request: DELETE /compute/v2.1/servers/90b353ab-ef97-4d88-b5bc-b355ff576225/os-volume_attachments/f6f33cc1-4876-46b0-90b4-a7659a320eed HTTP/1.1 Nov 01 19:02:13.189742 n-d-863052-2 devstack@n-api.service[121402]: Accept: application/json Nov 01 19:02:13.189742 n-d-863052-2 devstack@n-api.service[121402]: Accept-Encoding: identity Nov 01 19:02:13.189742 n-d-863052-2 devstack@n-api.service[121402]: Connection: close Nov 01 19:02:13.189742 n-d-863052-2 devstack@n-api.service[121402]: Content-Length: 0 Nov 01 19:02:13.189742 n-d-863052-2 devstack@n-api.service[121402]: Content-Type: application/json Nov 01 19:02:13.189742 n-d-863052-2 devstack@n-api.service[121402]: Host: 10.222.0.13 Nov 01 19:02:13.189742 n-d-863052-2 devstack@n-api.service[121402]: Openstack-System-Scope: None Nov 01 19:02:13.189742 n-d-863052-2 devstack@n-api.service[121402]: User-Agent: python-urllib3/1.26.12 Nov 01 19:02:13.189742 n-d-863052-2 devstack@n-api.service[121402]: X-Auth-Token: gAAAAABjYWwgP3kjyQKi9Uf4PP24jmeKCOPNU51FZoHLreZdbFyZPhRW-EeK2Se64f-CjytM5LjMEtkBLCti_PQz0S3BXRBnTu4aanJgpXShIx2i6Yz4YqCrWhQ373B1BFIdgiChyw2k6U5YvJRz35UfhTE-zhCjFxCXYsQplbVOAVzO2wYqVeI Nov 01 19:02:13.189742 n-d-863052-2 devstack@n-api.service[121402]: X-Domain-Id: None Nov 01 19:02:13.189742 n-d-863052-2 devstack@n-api.service[121402]: X-Domain-Name: None Nov 01 19:02:13.189742 n-d-863052-2 devstack@n-api.service[121402]: X-Identity-Status: Confirmed Nov 01 19:02:13.189742 n-d-863052-2 devstack@n-api.service[121402]: X-Is-Admin-Project: True Nov 01 19:02:13.189742 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Domain-Id: default Nov 01 19:02:13.189742 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Domain-Name: Default Nov 01 19:02:13.189742 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Id: 4a1bb191cff948e99c008b5e861ce4a8 Nov 01 19:02:13.189742 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-215636868 Nov 01 19:02:13.189742 n-d-863052-2 devstack@n-api.service[121402]: X-Role: member,reader Nov 01 19:02:13.189742 n-d-863052-2 devstack@n-api.service[121402]: X-Roles: member,reader Nov 01 19:02:13.191620 n-d-863052-2 devstack@n-api.service[121402]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/4a1bb191cff948e99c008b5e861ce4a8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/4a1bb191cff948e99c008b5e861ce4a8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_4a1bb191cff948e99c008b5e861ce4a8", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/4a1bb191cff948e99c008b5e861ce4a8"}]}] Nov 01 19:02:13.191620 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant: tempest-ServerRescueNegativeTestJSON-215636868 Nov 01 19:02:13.191620 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant-Id: 4a1bb191cff948e99c008b5e861ce4a8 Nov 01 19:02:13.191620 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-215636868 Nov 01 19:02:13.191620 n-d-863052-2 devstack@n-api.service[121402]: X-User: tempest-ServerRescueNegativeTestJSON-215636868-project Nov 01 19:02:13.191620 n-d-863052-2 devstack@n-api.service[121402]: X-User-Domain-Id: default Nov 01 19:02:13.191620 n-d-863052-2 devstack@n-api.service[121402]: X-User-Domain-Name: Default Nov 01 19:02:13.191620 n-d-863052-2 devstack@n-api.service[121402]: X-User-Id: 6a63d69c99a546f0af16329cff3ca717 Nov 01 19:02:13.191620 n-d-863052-2 devstack@n-api.service[121402]: X-User-Name: tempest-ServerRescueNegativeTestJSON-215636868-project Nov 01 19:02:13.191620 n-d-863052-2 devstack@n-api.service[121402]: method: > Nov 01 19:02:13.191620 n-d-863052-2 devstack@n-api.service[121402]: exception: Cannot 'detach_volume' instance 90b353ab-ef97-4d88-b5bc-b355ff576225 while it is in vm_state rescued Nov 01 19:02:13.192569 n-d-863052-2 devstack@n-api.service[121402]: action_args: {'server_id': '90b353ab-ef97-4d88-b5bc-b355ff576225', 'id': 'f6f33cc1-4876-46b0-90b4-a7659a320eed'} Nov 01 19:02:13.192569 n-d-863052-2 devstack@n-api.service[121402]: {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 01 19:02:13.192569 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:02:13.192569 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Nov 01 19:02:13.192569 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Nov 01 19:02:13.192569 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Nov 01 19:02:13.192569 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Nov 01 19:02:13.192569 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Nov 01 19:02:13.192569 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Nov 01 19:02:13.192569 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 90b353ab-ef97-4d88-b5bc-b355ff576225 in vm_state rescued. Cannot detach_volume while the instance is in this state. Nov 01 19:02:13.192569 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:02:13.192569 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:02:13.192569 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:02:13.192569 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:02:13.192569 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:02:13.192569 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:02:13.192569 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 01 19:02:13.192569 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 01 19:02:13.192569 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 01 19:02:13.192569 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 01 19:02:13.194836 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Nov 01 19:02:13.194836 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Nov 01 19:02:13.194836 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Nov 01 19:02:13.194836 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Nov 01 19:02:13.194836 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 90b353ab-ef97-4d88-b5bc-b355ff576225 while it is in vm_state rescued Nov 01 19:02:13.194836 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:02:13.194836 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:02:13.194836 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:02:13.194836 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:02:13.194836 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:02:13.194836 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:02:13.194836 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 01 19:02:13.194836 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 01 19:02:13.194836 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 90b353ab-ef97-4d88-b5bc-b355ff576225 while it is in vm_state rescued Nov 01 19:02:13.194836 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:02:13.196104 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-6408505b-2048-4eac-b9e7-8cffbf398636 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Returning 409 to user: Cannot 'detach_volume' instance 90b353ab-ef97-4d88-b5bc-b355ff576225 while it is in vm_state rescued {{(pid=121402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 01 19:02:13.200609 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-6408505b-2048-4eac-b9e7-8cffbf398636 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] 10.222.0.13 "DELETE /compute/v2.1/servers/90b353ab-ef97-4d88-b5bc-b355ff576225/os-volume_attachments/f6f33cc1-4876-46b0-90b4-a7659a320eed" status: 409 len: 152 microversion: 2.1 time: 0.282712 Nov 01 19:02:13.200609 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1091/2173] 10.222.0.13 () {58 vars in 1416 bytes} [Tue Nov 1 19:02:12 2022] DELETE /compute/v2.1/servers/90b353ab-ef97-4d88-b5bc-b355ff576225/os-volume_attachments/f6f33cc1-4876-46b0-90b4-a7659a320eed => generated 152 bytes in 284 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Nov 01 19:02:13.211533 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-675b57b9-1339-4c49-bda4-7e79d3f18512 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:02:13.212159 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-675b57b9-1339-4c49-bda4-7e79d3f18512 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] [instance: 46a040e6-2750-47b4-b8e2-757b92f1adf1] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:02:13.410655 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-3aa00abd-9b43-45f3-a7aa-2bf8fc7e6c4a tempest-ServersTestBootFromVolume-877599095 tempest-ServersTestBootFromVolume-877599095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed2352ce53fc4045adde8cd81b78b3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651046528c204df299ca3d14c44b4a7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:02:13.430646 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-3aa00abd-9b43-45f3-a7aa-2bf8fc7e6c4a tempest-ServersTestBootFromVolume-877599095 tempest-ServersTestBootFromVolume-877599095-project] 10.222.0.13 "GET /compute/v2.1/servers/44cdf0d8-969b-4149-bb03-6bc390977019" status: 200 len: 1236 microversion: 2.1 time: 0.311034 Nov 01 19:02:13.456503 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1083/2174] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:02:13 2022] GET /compute/v2.1/servers/44cdf0d8-969b-4149-bb03-6bc390977019 => generated 1236 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:02:13.472193 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-74ae7d6e-e0c2-46b6-8f4f-091de9af5e11 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:02:13.472839 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-74ae7d6e-e0c2-46b6-8f4f-091de9af5e11 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] [instance: 90b353ab-ef97-4d88-b5bc-b355ff576225] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:02:13.483469 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-74ae7d6e-e0c2-46b6-8f4f-091de9af5e11 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:13.483975 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-74ae7d6e-e0c2-46b6-8f4f-091de9af5e11 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:13.484413 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-74ae7d6e-e0c2-46b6-8f4f-091de9af5e11 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:13.485162 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-74ae7d6e-e0c2-46b6-8f4f-091de9af5e11 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:13.485618 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-74ae7d6e-e0c2-46b6-8f4f-091de9af5e11 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:13.492063 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-74ae7d6e-e0c2-46b6-8f4f-091de9af5e11 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:13.659335 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-675b57b9-1339-4c49-bda4-7e79d3f18512 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb496b3faac4abbae73d389f2042e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e2520220d454764b8c139a58d78ac83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:02:13.669477 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-675b57b9-1339-4c49-bda4-7e79d3f18512 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] 10.222.0.13 "GET /compute/v2.1/servers/46a040e6-2750-47b4-b8e2-757b92f1adf1" status: 200 len: 1214 microversion: 2.1 time: 0.470528 Nov 01 19:02:13.676388 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1092/2175] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:02:13 2022] GET /compute/v2.1/servers/46a040e6-2750-47b4-b8e2-757b92f1adf1 => generated 1214 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:02:13.697009 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-74ae7d6e-e0c2-46b6-8f4f-091de9af5e11 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] 10.222.0.13 "POST /compute/v2.1/servers/90b353ab-ef97-4d88-b5bc-b355ff576225/action" status: 202 len: 0 microversion: 2.1 time: 0.239041 Nov 01 19:02:13.698151 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1084/2176] 10.222.0.13 () {60 vars in 1278 bytes} [Tue Nov 1 19:02:13 2022] POST /compute/v2.1/servers/90b353ab-ef97-4d88-b5bc-b355ff576225/action => generated 0 bytes in 241 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 01 19:02:13.714702 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-6634f333-d1cf-4e7d-9f0f-a8a33c1db45b tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:02:13.729022 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-6634f333-d1cf-4e7d-9f0f-a8a33c1db45b tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] [instance: 90b353ab-ef97-4d88-b5bc-b355ff576225] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:02:13.742755 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-6634f333-d1cf-4e7d-9f0f-a8a33c1db45b tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:13.753984 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-6634f333-d1cf-4e7d-9f0f-a8a33c1db45b tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:13.759147 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-6634f333-d1cf-4e7d-9f0f-a8a33c1db45b tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:13.760206 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-6634f333-d1cf-4e7d-9f0f-a8a33c1db45b tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:13.760887 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-6634f333-d1cf-4e7d-9f0f-a8a33c1db45b tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:13.761493 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-6634f333-d1cf-4e7d-9f0f-a8a33c1db45b tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:14.002807 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-5bb313f5-dbe2-48b0-ad99-208eb6f7ee52 tempest-AbsoluteLimitsNegativeTestJSON-896239188 tempest-AbsoluteLimitsNegativeTestJSON-896239188-project] Calling method '.version_select at 0x7f0ae25b2af0>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:02:14.029469 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-5bb313f5-dbe2-48b0-ad99-208eb6f7ee52 tempest-AbsoluteLimitsNegativeTestJSON-896239188 tempest-AbsoluteLimitsNegativeTestJSON-896239188-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:14.029966 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-5bb313f5-dbe2-48b0-ad99-208eb6f7ee52 tempest-AbsoluteLimitsNegativeTestJSON-896239188 tempest-AbsoluteLimitsNegativeTestJSON-896239188-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:14.034960 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-5bb313f5-dbe2-48b0-ad99-208eb6f7ee52 tempest-AbsoluteLimitsNegativeTestJSON-896239188 tempest-AbsoluteLimitsNegativeTestJSON-896239188-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:14.037472 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-5bb313f5-dbe2-48b0-ad99-208eb6f7ee52 tempest-AbsoluteLimitsNegativeTestJSON-896239188 tempest-AbsoluteLimitsNegativeTestJSON-896239188-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:14.039667 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-5bb313f5-dbe2-48b0-ad99-208eb6f7ee52 tempest-AbsoluteLimitsNegativeTestJSON-896239188 tempest-AbsoluteLimitsNegativeTestJSON-896239188-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:14.040418 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-5bb313f5-dbe2-48b0-ad99-208eb6f7ee52 tempest-AbsoluteLimitsNegativeTestJSON-896239188 tempest-AbsoluteLimitsNegativeTestJSON-896239188-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:14.097783 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-5bb313f5-dbe2-48b0-ad99-208eb6f7ee52 tempest-AbsoluteLimitsNegativeTestJSON-896239188 tempest-AbsoluteLimitsNegativeTestJSON-896239188-project] 10.222.0.13 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 0.419881 Nov 01 19:02:14.101580 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1093/2177] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Nov 1 19:02:13 2022] GET /compute/v2.1/limits => generated 511 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:02:14.114952 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-fd835290-2568-4651-841d-e320c5c07c4f tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:02:14.115666 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-fd835290-2568-4651-841d-e320c5c07c4f tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] [instance: cd879708-f757-4f88-bc95-38b6cd55363c] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:02:14.152286 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-fd835290-2568-4651-841d-e320c5c07c4f tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:14.154321 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-fd835290-2568-4651-841d-e320c5c07c4f tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:14.161746 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-fd835290-2568-4651-841d-e320c5c07c4f tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:14.162535 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-fd835290-2568-4651-841d-e320c5c07c4f tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:14.163643 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-fd835290-2568-4651-841d-e320c5c07c4f tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:14.164082 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-fd835290-2568-4651-841d-e320c5c07c4f tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:15.086401 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-6634f333-d1cf-4e7d-9f0f-a8a33c1db45b tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a63d69c99a546f0af16329cff3ca717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a1bb191cff948e99c008b5e861ce4a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:02:15.103908 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-6634f333-d1cf-4e7d-9f0f-a8a33c1db45b tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] 10.222.0.13 "GET /compute/v2.1/servers/90b353ab-ef97-4d88-b5bc-b355ff576225" status: 200 len: 1724 microversion: 2.1 time: 1.399500 Nov 01 19:02:15.105655 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1085/2178] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:02:13 2022] GET /compute/v2.1/servers/90b353ab-ef97-4d88-b5bc-b355ff576225 => generated 1724 bytes in 1404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 19:02:15.125491 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-59963aac-5441-4e42-9619-6b92f04539be tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:02:15.125491 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-59963aac-5441-4e42-9619-6b92f04539be tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] [instance: 4b9fb909-26f7-40af-bac5-e7d2a6b9fb77] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:02:15.127612 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-fd835290-2568-4651-841d-e320c5c07c4f tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:02:15.133042 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-59963aac-5441-4e42-9619-6b92f04539be tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:15.134649 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-59963aac-5441-4e42-9619-6b92f04539be tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:15.135108 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-59963aac-5441-4e42-9619-6b92f04539be tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:15.136267 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-59963aac-5441-4e42-9619-6b92f04539be tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:15.137006 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-59963aac-5441-4e42-9619-6b92f04539be tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:15.137443 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-59963aac-5441-4e42-9619-6b92f04539be tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:15.137588 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-fd835290-2568-4651-841d-e320c5c07c4f tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:02:15.138976 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-fd835290-2568-4651-841d-e320c5c07c4f tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:02:15.140149 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-fd835290-2568-4651-841d-e320c5c07c4f tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] 10.222.0.13 "GET /compute/v2.1/servers/cd879708-f757-4f88-bc95-38b6cd55363c" status: 200 len: 1482 microversion: 2.25 time: 1.037575 Nov 01 19:02:15.152753 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1094/2179] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 19:02:14 2022] GET /compute/v2.1/servers/cd879708-f757-4f88-bc95-38b6cd55363c => generated 1482 bytes in 1050 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 19:02:15.157661 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-10586a2e-7fda-4195-9ad8-7efa9426d6a8 tempest-ServersTestBootFromVolume-877599095 tempest-ServersTestBootFromVolume-877599095-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:02:15.158480 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-10586a2e-7fda-4195-9ad8-7efa9426d6a8 tempest-ServersTestBootFromVolume-877599095 tempest-ServersTestBootFromVolume-877599095-project] [instance: 44cdf0d8-969b-4149-bb03-6bc390977019] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:02:15.173503 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-10586a2e-7fda-4195-9ad8-7efa9426d6a8 tempest-ServersTestBootFromVolume-877599095 tempest-ServersTestBootFromVolume-877599095-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:15.174003 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-10586a2e-7fda-4195-9ad8-7efa9426d6a8 tempest-ServersTestBootFromVolume-877599095 tempest-ServersTestBootFromVolume-877599095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:15.174448 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-10586a2e-7fda-4195-9ad8-7efa9426d6a8 tempest-ServersTestBootFromVolume-877599095 tempest-ServersTestBootFromVolume-877599095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:15.175162 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-10586a2e-7fda-4195-9ad8-7efa9426d6a8 tempest-ServersTestBootFromVolume-877599095 tempest-ServersTestBootFromVolume-877599095-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:15.175618 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-10586a2e-7fda-4195-9ad8-7efa9426d6a8 tempest-ServersTestBootFromVolume-877599095 tempest-ServersTestBootFromVolume-877599095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:15.176037 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-10586a2e-7fda-4195-9ad8-7efa9426d6a8 tempest-ServersTestBootFromVolume-877599095 tempest-ServersTestBootFromVolume-877599095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:15.389803 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-10586a2e-7fda-4195-9ad8-7efa9426d6a8 tempest-ServersTestBootFromVolume-877599095 tempest-ServersTestBootFromVolume-877599095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed2352ce53fc4045adde8cd81b78b3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651046528c204df299ca3d14c44b4a7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:02:15.425660 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-10586a2e-7fda-4195-9ad8-7efa9426d6a8 tempest-ServersTestBootFromVolume-877599095 tempest-ServersTestBootFromVolume-877599095-project] 10.222.0.13 "GET /compute/v2.1/servers/44cdf0d8-969b-4149-bb03-6bc390977019" status: 200 len: 1236 microversion: 2.1 time: 0.269037 Nov 01 19:02:15.429134 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1095/2180] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:02:15 2022] GET /compute/v2.1/servers/44cdf0d8-969b-4149-bb03-6bc390977019 => generated 1236 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:02:15.458481 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-d710754c-ca3c-4bdb-a700-e7f648943e64 tempest-AbsoluteLimitsNegativeTestJSON-896239188 tempest-AbsoluteLimitsNegativeTestJSON-896239188-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AbsoluteLimitsNegativeTestJSON-server-2026065042", "imageRef": "2d4a0047-1b9e-445f-8af8-1b5c9d93e881", "flavorRef": "452", "metadata": {"0": "0", "1": "1", "2": "2", "3": "3", "4": "4", "5": "5", "6": "6", "7": "7", "8": "8", "9": "9", "10": "10", "11": "11", "12": "12", "13": "13", "14": "14", "15": "15", "16": "16", "17": "17", "18": "18", "19": "19", "20": "20", "21": "21", "22": "22", "23": "23", "24": "24", "25": "25", "26": "26", "27": "27", "28": "28", "29": "29", "30": "30", "31": "31", "32": "32", "33": "33", "34": "34", "35": "35", "36": "36", "37": "37", "38": "38", "39": "39", "40": "40", "41": "41", "42": "42", "43": "43", "44": "44", "45": "45", "46": "46", "47": "47", "48": "48", "49": "49", "50": "50", "51": "51", "52": "52", "53": "53", "54": "54", "55": "55", "56": "56", "57": "57", "58": "58", "59": "59", "60": "60", "61": "61", "62": "62", "63": "63", "64": "64", "65": "65", "66": "66", "67": "67", "68": "68", "69": "69", "70": "70", "71": "71", "72": "72", "73": "73", "74": "74", "75": "75", "76": "76", "77": "77", "78": "78", "79": "79", "80": "80", "81": "81", "82": "82", "83": "83", "84": "84", "85": "85", "86": "86", "87": "87", "88": "88", "89": "89", "90": "90", "91": "91", "92": "92", "93": "93", "94": "94", "95": "95", "96": "96", "97": "97", "98": "98", "99": "99", "100": "100", "101": "101", "102": "102", "103": "103", "104": "104", "105": "105", "106": "106", "107": "107", "108": "108", "109": "109", "110": "110", "111": "111", "112": "112", "113": "113", "114": "114", "115": "115", "116": "116", "117": "117", "118": "118", "119": "119", "120": "120", "121": "121", "122": "122", "123": "123", "124": "124", "125": "125", "126": "126", "127": "127", "128": "128"}}} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:02:15.628348 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.network.neutron [None req-d710754c-ca3c-4bdb-a700-e7f648943e64 tempest-AbsoluteLimitsNegativeTestJSON-896239188 tempest-AbsoluteLimitsNegativeTestJSON-896239188-project] validate_networks() for None {{(pid=121402) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 01 19:02:15.856410 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-59963aac-5441-4e42-9619-6b92f04539be tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52acef7992d64d378fd8ac333887fd0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af51b8733e984c2ca87df2d8163dedf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:02:15.865299 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-59963aac-5441-4e42-9619-6b92f04539be tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] 10.222.0.13 "GET /compute/v2.1/servers/4b9fb909-26f7-40af-bac5-e7d2a6b9fb77" status: 200 len: 1354 microversion: 2.1 time: 0.758263 Nov 01 19:02:15.865922 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1086/2181] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:02:15 2022] GET /compute/v2.1/servers/4b9fb909-26f7-40af-bac5-e7d2a6b9fb77 => generated 1354 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:02:15.885128 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-e2abffc2-f846-46f2-bd42-5a00d82222c0 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:02:15.885752 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-e2abffc2-f846-46f2-bd42-5a00d82222c0 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] [instance: 46a040e6-2750-47b4-b8e2-757b92f1adf1] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:02:15.900848 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-e2abffc2-f846-46f2-bd42-5a00d82222c0 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:15.901350 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-e2abffc2-f846-46f2-bd42-5a00d82222c0 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:15.901799 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-e2abffc2-f846-46f2-bd42-5a00d82222c0 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:15.902515 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-e2abffc2-f846-46f2-bd42-5a00d82222c0 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:15.902973 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-e2abffc2-f846-46f2-bd42-5a00d82222c0 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:15.903402 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-e2abffc2-f846-46f2-bd42-5a00d82222c0 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:16.152258 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-e2abffc2-f846-46f2-bd42-5a00d82222c0 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb496b3faac4abbae73d389f2042e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e2520220d454764b8c139a58d78ac83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:02:16.169530 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-e2abffc2-f846-46f2-bd42-5a00d82222c0 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] 10.222.0.13 "GET /compute/v2.1/servers/46a040e6-2750-47b4-b8e2-757b92f1adf1" status: 200 len: 1272 microversion: 2.1 time: 0.302488 Nov 01 19:02:16.174459 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1087/2182] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:02:15 2022] GET /compute/v2.1/servers/46a040e6-2750-47b4-b8e2-757b92f1adf1 => generated 1272 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:02:16.189887 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [req-157757e2-ee9f-4159-a75f-733ef98bbbe8 req-4737dd6f-35c7-4c31-bf1a-479664684473 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cd879708-f757-4f88-bc95-38b6cd55363c", "name": "network-vif-deleted", "tag": "5814506e-bf1a-49cf-9169-b3181e825901"}]} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:02:16.235740 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-157757e2-ee9f-4159-a75f-733ef98bbbe8 req-4737dd6f-35c7-4c31-bf1a-479664684473 service nova] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:16.238250 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-157757e2-ee9f-4159-a75f-733ef98bbbe8 req-4737dd6f-35c7-4c31-bf1a-479664684473 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:16.242136 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-157757e2-ee9f-4159-a75f-733ef98bbbe8 req-4737dd6f-35c7-4c31-bf1a-479664684473 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:16.290887 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.compute.server_external_events [req-157757e2-ee9f-4159-a75f-733ef98bbbe8 req-4737dd6f-35c7-4c31-bf1a-479664684473 service nova] Creating event network-vif-deleted:5814506e-bf1a-49cf-9169-b3181e825901 for instance cd879708-f757-4f88-bc95-38b6cd55363c on n-h1-863052-2 Nov 01 19:02:16.312211 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [req-157757e2-ee9f-4159-a75f-733ef98bbbe8 req-4737dd6f-35c7-4c31-bf1a-479664684473 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.135023 Nov 01 19:02:16.313168 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1088/2183] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Nov 1 19:02:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:02:16.319650 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-cebab954-2f47-47b6-b988-5302f82d229f tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:02:16.320820 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-cebab954-2f47-47b6-b988-5302f82d229f tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] [instance: 90b353ab-ef97-4d88-b5bc-b355ff576225] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:02:16.328147 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-cebab954-2f47-47b6-b988-5302f82d229f tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:16.328949 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-cebab954-2f47-47b6-b988-5302f82d229f tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:16.329566 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-cebab954-2f47-47b6-b988-5302f82d229f tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:16.330464 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-cebab954-2f47-47b6-b988-5302f82d229f tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:16.331170 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-cebab954-2f47-47b6-b988-5302f82d229f tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:16.331763 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-cebab954-2f47-47b6-b988-5302f82d229f tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:16.477420 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.quota [None req-d710754c-ca3c-4bdb-a700-e7f648943e64 tempest-AbsoluteLimitsNegativeTestJSON-896239188 tempest-AbsoluteLimitsNegativeTestJSON-896239188-project] Getting quotas for project 668c4fa9849b4df8a8720127c477b1df. Resources: dict_keys(['metadata_items']) {{(pid=121402) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 01 19:02:16.505103 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.quota [None req-d710754c-ca3c-4bdb-a700-e7f648943e64 tempest-AbsoluteLimitsNegativeTestJSON-896239188 tempest-AbsoluteLimitsNegativeTestJSON-896239188-project] Getting quotas for user 7095ed26e5a14c979868abf146886e4d and project 668c4fa9849b4df8a8720127c477b1df. Resources: dict_keys(['metadata_items']) {{(pid=121402) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 01 19:02:16.544085 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.wsgi [None req-d710754c-ca3c-4bdb-a700-e7f648943e64 tempest-AbsoluteLimitsNegativeTestJSON-896239188 tempest-AbsoluteLimitsNegativeTestJSON-896239188-project] HTTP exception thrown: Maximum number of metadata items exceeds 128 Nov 01 19:02:16.548431 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-d710754c-ca3c-4bdb-a700-e7f648943e64 tempest-AbsoluteLimitsNegativeTestJSON-896239188 tempest-AbsoluteLimitsNegativeTestJSON-896239188-project] Request method failure captured: Nov 01 19:02:16.548431 n-d-863052-2 devstack@n-api.service[121402]: request: POST /compute/v2.1/servers HTTP/1.1 Nov 01 19:02:16.548431 n-d-863052-2 devstack@n-api.service[121402]: Accept: application/json Nov 01 19:02:16.548431 n-d-863052-2 devstack@n-api.service[121402]: Accept-Encoding: identity Nov 01 19:02:16.548431 n-d-863052-2 devstack@n-api.service[121402]: Connection: close Nov 01 19:02:16.548431 n-d-863052-2 devstack@n-api.service[121402]: Content-Length: 1752 Nov 01 19:02:16.548431 n-d-863052-2 devstack@n-api.service[121402]: Content-Type: application/json Nov 01 19:02:16.548431 n-d-863052-2 devstack@n-api.service[121402]: Host: 10.222.0.13 Nov 01 19:02:16.548431 n-d-863052-2 devstack@n-api.service[121402]: Openstack-System-Scope: None Nov 01 19:02:16.548431 n-d-863052-2 devstack@n-api.service[121402]: User-Agent: python-urllib3/1.26.12 Nov 01 19:02:16.548431 n-d-863052-2 devstack@n-api.service[121402]: X-Auth-Token: gAAAAABjYW01UkgCaggRSOX7GycXBLN_SOVQha6VxzwyQ2BWBxqBbrA1_bmOuC_0bJAsgAl0J4Hv1BiXGjSIbhPUYKU5OrmaXpnOEC0vTD0NSaGNjP7gKvhwuvSuxqU8tDDt_ybEPfrrZAYH6QDuOxCziT--SLQmwF43PdsOjXVsZZjF2mDPzTc Nov 01 19:02:16.548431 n-d-863052-2 devstack@n-api.service[121402]: X-Domain-Id: None Nov 01 19:02:16.548431 n-d-863052-2 devstack@n-api.service[121402]: X-Domain-Name: None Nov 01 19:02:16.548431 n-d-863052-2 devstack@n-api.service[121402]: X-Identity-Status: Confirmed Nov 01 19:02:16.548431 n-d-863052-2 devstack@n-api.service[121402]: X-Is-Admin-Project: True Nov 01 19:02:16.548431 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Domain-Id: default Nov 01 19:02:16.548431 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Domain-Name: Default Nov 01 19:02:16.548431 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Id: 668c4fa9849b4df8a8720127c477b1df Nov 01 19:02:16.548431 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Name: tempest-AbsoluteLimitsNegativeTestJSON-896239188 Nov 01 19:02:16.548431 n-d-863052-2 devstack@n-api.service[121402]: X-Role: member,reader Nov 01 19:02:16.548431 n-d-863052-2 devstack@n-api.service[121402]: X-Roles: member,reader Nov 01 19:02:16.548431 n-d-863052-2 devstack@n-api.service[121402]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/668c4fa9849b4df8a8720127c477b1df"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/668c4fa9849b4df8a8720127c477b1df"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_668c4fa9849b4df8a8720127c477b1df", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/668c4fa9849b4df8a8720127c477b1df"}]}] Nov 01 19:02:16.548431 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant: tempest-AbsoluteLimitsNegativeTestJSON-896239188 Nov 01 19:02:16.548431 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant-Id: 668c4fa9849b4df8a8720127c477b1df Nov 01 19:02:16.548431 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant-Name: tempest-AbsoluteLimitsNegativeTestJSON-896239188 Nov 01 19:02:16.548431 n-d-863052-2 devstack@n-api.service[121402]: X-User: tempest-AbsoluteLimitsNegativeTestJSON-896239188-project Nov 01 19:02:16.548431 n-d-863052-2 devstack@n-api.service[121402]: X-User-Domain-Id: default Nov 01 19:02:16.548431 n-d-863052-2 devstack@n-api.service[121402]: X-User-Domain-Name: Default Nov 01 19:02:16.548431 n-d-863052-2 devstack@n-api.service[121402]: X-User-Id: 7095ed26e5a14c979868abf146886e4d Nov 01 19:02:16.548431 n-d-863052-2 devstack@n-api.service[121402]: X-User-Name: tempest-AbsoluteLimitsNegativeTestJSON-896239188-project Nov 01 19:02:16.548431 n-d-863052-2 devstack@n-api.service[121402]: Nov 01 19:02:16.548431 n-d-863052-2 devstack@n-api.service[121402]: {"server": {"name": "tempest-AbsoluteLimitsNegativeTestJSON-server-2026065042", "imageRef": "2d4a0047-1b9e-445f-8af8-1b5c9d93e881", "flavorRef": "452", "metadata": {"0": "0", "1": "1", "2": "2", "3": "3", "4": "4", "5": "5", "6": "6", "7": "7", "8": "8", "9": "9", "10": "10", "11": "11", "12": "12", "13": "13", "14": "14", "15": "15", "16": "16", "17": "17", "18": "18", "19": "19", "20": "20", "21": "21", "22": "22", "23": "23", "24": "24", "25": "25", "26": "26", "27": "27", "28": "28", "29": "29", "30": "30", "31": "31", "32": "32", "33": "33", "34": "34", "35": "35", "36": "36", "37": "37", "38": "38", "39": "39", "40": "40", "41": "41", "42": "42", "43": "43", "44": "44", "45": "45", "46": "46", "47": "47", "48": "48", "49": "49", "50": "50", "51": "51", "52": "52", "53": "53", "54": "54", "55": "55", "56": "56", "57": "57", "58": "58", "59": "59", "60": "60", "61": "61", "62": "62", "63": "63", "64": "64", "65": "65", "66": "66", "67": "67", "68": "68", "69": "69", "70": "70", "71": "71", "72": "72", "73": "73", "74": "74", "75": "75", "76": "76", "77": "77", "78": "78", "79": "79", "80": "80", "81": "81", "82": "82", "83": "83", "84": "84", "85": "85", "86": "86", "87": "87", "88": "88", "89": "89", "90": "90", "91": "91", "92": "92", "93": "93", "94": "94", "95": "95", "96": "96", "97": "97", "98": "98", "99": "99", "100": "100", "101": "101", "102": "102", "103": "103", "104": "104", "105": "105", "106": "106", "107": "107", "108": "108", "109": "109", "110": "110", "111": "111", "112": "112", "113": "113", "114": "114", "115": "115", "116": "116", "117": "117", "118": "118", "119": "119", "120": "120", "121": "121", "122": "122", "123": "123", "124": "124", "125": "125", "126": "126", "127": "127", "128": "128"}}} Nov 01 19:02:16.548431 n-d-863052-2 devstack@n-api.service[121402]: method: > Nov 01 19:02:16.548431 n-d-863052-2 devstack@n-api.service[121402]: exception: Maximum number of metadata items exceeds 128 Nov 01 19:02:16.551822 n-d-863052-2 devstack@n-api.service[121402]: action_args: {'body': {'server': {'name': 'tempest-AbsoluteLimitsNegativeTestJSON-server-2026065042', 'imageRef': '2d4a0047-1b9e-445f-8af8-1b5c9d93e881', 'flavorRef': '452', 'metadata': {'0': '0', '1': '1', '2': '2', '3': '3', '4': '4', '5': '5', '6': '6', '7': '7', '8': '8', '9': '9', '10': '10', '11': '11', '12': '12', '13': '13', '14': '14', '15': '15', '16': '16', '17': '17', '18': '18', '19': '19', '20': '20', '21': '21', '22': '22', '23': '23', '24': '24', '25': '25', '26': '26', '27': '27', '28': '28', '29': '29', '30': '30', '31': '31', '32': '32', '33': '33', '34': '34', '35': '35', '36': '36', '37': '37', '38': '38', '39': '39', '40': '40', '41': '41', '42': '42', '43': '43', '44': '44', '45': '45', '46': '46', '47': '47', '48': '48', '49': '49', '50': '50', '51': '51', '52': '52', '53': '53', '54': '54', '55': '55', '56': '56', '57': '57', '58': '58', '59': '59', '60': '60', '61': '61', '62': '62', '63': '63', '64': '64', '65': '65', '66': '66', '67': '67', '68': '68', '69': '69', '70': '70', '71': '71', '72': '72', '73': '73', '74': '74', '75': '75', '76': '76', '77': '77', '78': '78', '79': '79', '80': '80', '81': '81', '82': '82', '83': '83', '84': '84', '85': '85', '86': '86', '87': '87', '88': '88', '89': '89', '90': '90', '91': '91', '92': '92', '93': '93', '94': '94', '95': '95', '96': '96', '97': '97', '98': '98', '99': '99', '100': '100', '101': '101', '102': '102', '103': '103', '104': '104', '105': '105', '106': '106', '107': '107', '108': '108', '109': '109', '110': '110', '111': '111', '112': '112', '113': '113', '114': '114', '115': '115', '116': '116', '117': '117', '118': '118', '119': '119', '120': '120', '121': '121', '122': '122', '123': '123', '124': '124', '125': '125', '126': '126', '127': '127', '128': '128'}}}} Nov 01 19:02:16.551822 n-d-863052-2 devstack@n-api.service[121402]: {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 01 19:02:16.551822 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:02:16.551822 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 476, in _check_metadata_properties_quota Nov 01 19:02:16.551822 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi objects.Quotas.limit_check(context, metadata_items=num_metadata) Nov 01 19:02:16.551822 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 01 19:02:16.551822 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 01 19:02:16.551822 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 290, in limit_check Nov 01 19:02:16.551822 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check( Nov 01 19:02:16.551822 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1118, in limit_check Nov 01 19:02:16.551822 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return self._driver.limit_check(context, self._resources, values, Nov 01 19:02:16.551822 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 468, in limit_check Nov 01 19:02:16.551822 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), quotas=quotas, Nov 01 19:02:16.551822 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['metadata_items'] Nov 01 19:02:16.551822 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:02:16.551822 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:02:16.551822 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:02:16.551822 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:02:16.551822 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Nov 01 19:02:16.551822 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Nov 01 19:02:16.551822 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Nov 01 19:02:16.551822 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return self._create_instance( Nov 01 19:02:16.551822 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1724, in _create_instance Nov 01 19:02:16.551822 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi self._checks_for_create_and_rebuild(context, image_id, boot_meta, Nov 01 19:02:16.551822 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1016, in _checks_for_create_and_rebuild Nov 01 19:02:16.551822 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi self._check_metadata_properties_quota(context, metadata) Nov 01 19:02:16.551822 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 483, in _check_metadata_properties_quota Nov 01 19:02:16.551822 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise exception.MetadataLimitExceeded(allowed=quota_metadata) Nov 01 19:02:16.551822 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi nova.exception.MetadataLimitExceeded: Maximum number of metadata items exceeds 128 Nov 01 19:02:16.551822 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:02:16.551822 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:02:16.551822 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:02:16.551822 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:02:16.551822 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:02:16.551822 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:02:16.551822 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 01 19:02:16.551822 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 01 19:02:16.551822 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 01 19:02:16.551822 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 01 19:02:16.551822 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 01 19:02:16.551822 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 01 19:02:16.551822 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 01 19:02:16.551822 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 01 19:02:16.551822 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 01 19:02:16.556428 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 01 19:02:16.556428 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Nov 01 19:02:16.556428 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Nov 01 19:02:16.556428 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Nov 01 19:02:16.556428 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Maximum number of metadata items exceeds 128 Nov 01 19:02:16.556428 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:02:16.556428 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:02:16.556428 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:02:16.556428 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:02:16.556428 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:02:16.556428 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:02:16.556428 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 01 19:02:16.556428 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 01 19:02:16.556428 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Maximum number of metadata items exceeds 128 Nov 01 19:02:16.556428 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:02:16.562490 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-d710754c-ca3c-4bdb-a700-e7f648943e64 tempest-AbsoluteLimitsNegativeTestJSON-896239188 tempest-AbsoluteLimitsNegativeTestJSON-896239188-project] Returning 403 to user: Maximum number of metadata items exceeds 128 {{(pid=121402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 01 19:02:16.566101 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-d710754c-ca3c-4bdb-a700-e7f648943e64 tempest-AbsoluteLimitsNegativeTestJSON-896239188 tempest-AbsoluteLimitsNegativeTestJSON-896239188-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 403 len: 87 microversion: 2.1 time: 1.134154 Nov 01 19:02:16.577554 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1096/2184] 10.222.0.13 () {60 vars in 1148 bytes} [Tue Nov 1 19:02:15 2022] POST /compute/v2.1/servers => generated 87 bytes in 1147 msecs (HTTP/1.1 403) 9 headers in 378 bytes (1 switches on core 0) Nov 01 19:02:16.594442 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-9a85a012-6e88-4840-9734-53d8d52571a6 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:02:16.606772 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-9a85a012-6e88-4840-9734-53d8d52571a6 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] [instance: cd879708-f757-4f88-bc95-38b6cd55363c] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:02:16.629371 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-9a85a012-6e88-4840-9734-53d8d52571a6 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:16.630833 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-9a85a012-6e88-4840-9734-53d8d52571a6 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:16.633527 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-9a85a012-6e88-4840-9734-53d8d52571a6 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:16.637126 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-9a85a012-6e88-4840-9734-53d8d52571a6 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:16.638035 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-9a85a012-6e88-4840-9734-53d8d52571a6 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:16.638597 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-9a85a012-6e88-4840-9734-53d8d52571a6 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:16.853890 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-9a85a012-6e88-4840-9734-53d8d52571a6 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:02:16.865804 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-cebab954-2f47-47b6-b988-5302f82d229f tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a63d69c99a546f0af16329cff3ca717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a1bb191cff948e99c008b5e861ce4a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:02:16.869501 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-9a85a012-6e88-4840-9734-53d8d52571a6 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:02:16.871214 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-9a85a012-6e88-4840-9734-53d8d52571a6 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:02:16.875465 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-9a85a012-6e88-4840-9734-53d8d52571a6 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] 10.222.0.13 "GET /compute/v2.1/servers/cd879708-f757-4f88-bc95-38b6cd55363c" status: 200 len: 1266 microversion: 2.25 time: 0.293222 Nov 01 19:02:16.876290 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1097/2185] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 19:02:16 2022] GET /compute/v2.1/servers/cd879708-f757-4f88-bc95-38b6cd55363c => generated 1266 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 19:02:16.902067 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-cebab954-2f47-47b6-b988-5302f82d229f tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] 10.222.0.13 "GET /compute/v2.1/servers/90b353ab-ef97-4d88-b5bc-b355ff576225" status: 200 len: 1724 microversion: 2.1 time: 0.587507 Nov 01 19:02:16.902656 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1089/2186] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:02:16 2022] GET /compute/v2.1/servers/90b353ab-ef97-4d88-b5bc-b355ff576225 => generated 1724 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:02:16.917702 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-01811b53-fc70-4244-a587-b2f8cae64547 tempest-ServersTestBootFromVolume-877599095 tempest-ServersTestBootFromVolume-877599095-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:02:16.918349 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-01811b53-fc70-4244-a587-b2f8cae64547 tempest-ServersTestBootFromVolume-877599095 tempest-ServersTestBootFromVolume-877599095-project] [instance: 44cdf0d8-969b-4149-bb03-6bc390977019] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:02:16.943038 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-01811b53-fc70-4244-a587-b2f8cae64547 tempest-ServersTestBootFromVolume-877599095 tempest-ServersTestBootFromVolume-877599095-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:16.943523 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-01811b53-fc70-4244-a587-b2f8cae64547 tempest-ServersTestBootFromVolume-877599095 tempest-ServersTestBootFromVolume-877599095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:16.944011 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-01811b53-fc70-4244-a587-b2f8cae64547 tempest-ServersTestBootFromVolume-877599095 tempest-ServersTestBootFromVolume-877599095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:16.944770 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-01811b53-fc70-4244-a587-b2f8cae64547 tempest-ServersTestBootFromVolume-877599095 tempest-ServersTestBootFromVolume-877599095-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:16.949428 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-01811b53-fc70-4244-a587-b2f8cae64547 tempest-ServersTestBootFromVolume-877599095 tempest-ServersTestBootFromVolume-877599095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:16.950005 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-01811b53-fc70-4244-a587-b2f8cae64547 tempest-ServersTestBootFromVolume-877599095 tempest-ServersTestBootFromVolume-877599095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:17.070434 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-01811b53-fc70-4244-a587-b2f8cae64547 tempest-ServersTestBootFromVolume-877599095 tempest-ServersTestBootFromVolume-877599095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed2352ce53fc4045adde8cd81b78b3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651046528c204df299ca3d14c44b4a7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:02:17.083396 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-01811b53-fc70-4244-a587-b2f8cae64547 tempest-ServersTestBootFromVolume-877599095 tempest-ServersTestBootFromVolume-877599095-project] 10.222.0.13 "GET /compute/v2.1/servers/44cdf0d8-969b-4149-bb03-6bc390977019" status: 200 len: 1236 microversion: 2.1 time: 0.173852 Nov 01 19:02:17.085424 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1090/2187] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:02:16 2022] GET /compute/v2.1/servers/44cdf0d8-969b-4149-bb03-6bc390977019 => generated 1236 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:02:17.102413 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-32ad6281-76ac-41b4-b03e-fdf7bbe2d23c tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:02:17.103364 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-32ad6281-76ac-41b4-b03e-fdf7bbe2d23c tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] [instance: 4b9fb909-26f7-40af-bac5-e7d2a6b9fb77] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:02:17.110798 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-32ad6281-76ac-41b4-b03e-fdf7bbe2d23c tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:17.111714 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-32ad6281-76ac-41b4-b03e-fdf7bbe2d23c tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:17.114018 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-32ad6281-76ac-41b4-b03e-fdf7bbe2d23c tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:17.115922 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-32ad6281-76ac-41b4-b03e-fdf7bbe2d23c tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:17.117361 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-32ad6281-76ac-41b4-b03e-fdf7bbe2d23c tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:17.118851 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-32ad6281-76ac-41b4-b03e-fdf7bbe2d23c tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:17.203836 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-2c783638-401c-420a-9854-01e48757ea46 tempest-ImagesNegativeTestJSON-1904451201 tempest-ImagesNegativeTestJSON-1904451201-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesNegativeTestJSON-server-2104938346", "imageRef": "2d4a0047-1b9e-445f-8af8-1b5c9d93e881", "flavorRef": "452", "networks": [{"uuid": "241511bc-4707-4a22-bcd8-d9a352dac161"}]}} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:02:17.290648 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.network.neutron [None req-2c783638-401c-420a-9854-01e48757ea46 tempest-ImagesNegativeTestJSON-1904451201 tempest-ImagesNegativeTestJSON-1904451201-project] validate_networks() for [('241511bc-4707-4a22-bcd8-d9a352dac161', None, None, None, None, None)] {{(pid=121402) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 01 19:02:17.357526 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-32ad6281-76ac-41b4-b03e-fdf7bbe2d23c tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52acef7992d64d378fd8ac333887fd0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af51b8733e984c2ca87df2d8163dedf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:02:17.368405 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-32ad6281-76ac-41b4-b03e-fdf7bbe2d23c tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] 10.222.0.13 "GET /compute/v2.1/servers/4b9fb909-26f7-40af-bac5-e7d2a6b9fb77" status: 200 len: 1354 microversion: 2.1 time: 0.281900 Nov 01 19:02:17.371265 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1091/2188] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:02:17 2022] GET /compute/v2.1/servers/4b9fb909-26f7-40af-bac5-e7d2a6b9fb77 => generated 1354 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:02:17.382351 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-135001a9-3a25-4542-9997-db9ac617a7c1 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:02:17.383330 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-135001a9-3a25-4542-9997-db9ac617a7c1 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] [instance: 58d02dff-26f6-4c2f-b886-cdbdccbfcec9] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:02:17.399182 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-135001a9-3a25-4542-9997-db9ac617a7c1 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:17.402760 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-135001a9-3a25-4542-9997-db9ac617a7c1 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:17.403764 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-135001a9-3a25-4542-9997-db9ac617a7c1 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:17.405985 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-135001a9-3a25-4542-9997-db9ac617a7c1 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:17.408435 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-135001a9-3a25-4542-9997-db9ac617a7c1 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:17.409295 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-135001a9-3a25-4542-9997-db9ac617a7c1 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:17.470486 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-135001a9-3a25-4542-9997-db9ac617a7c1 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] [instance: 58d02dff-26f6-4c2f-b886-cdbdccbfcec9] Going to try to terminate instance {{(pid=121403) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 01 19:02:17.673129 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-135001a9-3a25-4542-9997-db9ac617a7c1 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] 10.222.0.13 "DELETE /compute/v2.1/servers/58d02dff-26f6-4c2f-b886-cdbdccbfcec9" status: 204 len: 0 microversion: 2.1 time: 0.298193 Nov 01 19:02:17.675606 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1092/2189] 10.222.0.13 () {58 vars in 1239 bytes} [Tue Nov 1 19:02:17 2022] DELETE /compute/v2.1/servers/58d02dff-26f6-4c2f-b886-cdbdccbfcec9 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 01 19:02:17.684840 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-4efe8ee8-e152-492b-b83b-8b8055427ff3 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:02:17.685955 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-4efe8ee8-e152-492b-b83b-8b8055427ff3 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] [instance: 46a040e6-2750-47b4-b8e2-757b92f1adf1] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:02:17.705132 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-4efe8ee8-e152-492b-b83b-8b8055427ff3 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:17.706613 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-4efe8ee8-e152-492b-b83b-8b8055427ff3 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:17.708196 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-4efe8ee8-e152-492b-b83b-8b8055427ff3 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:17.711024 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-4efe8ee8-e152-492b-b83b-8b8055427ff3 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:17.714688 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-4efe8ee8-e152-492b-b83b-8b8055427ff3 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:17.715429 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-4efe8ee8-e152-492b-b83b-8b8055427ff3 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:17.815280 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-4efe8ee8-e152-492b-b83b-8b8055427ff3 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb496b3faac4abbae73d389f2042e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e2520220d454764b8c139a58d78ac83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:02:17.831114 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-4efe8ee8-e152-492b-b83b-8b8055427ff3 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] 10.222.0.13 "GET /compute/v2.1/servers/46a040e6-2750-47b4-b8e2-757b92f1adf1" status: 200 len: 1272 microversion: 2.1 time: 0.151030 Nov 01 19:02:17.837815 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1093/2190] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:02:17 2022] GET /compute/v2.1/servers/46a040e6-2750-47b4-b8e2-757b92f1adf1 => generated 1272 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:02:17.850874 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-7694ae1f-d300-426c-a22e-ab098365bfe9 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:02:17.851843 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-7694ae1f-d300-426c-a22e-ab098365bfe9 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] [instance: 58d02dff-26f6-4c2f-b886-cdbdccbfcec9] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:02:17.870780 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-7694ae1f-d300-426c-a22e-ab098365bfe9 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:17.871304 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-7694ae1f-d300-426c-a22e-ab098365bfe9 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:17.871777 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-7694ae1f-d300-426c-a22e-ab098365bfe9 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:17.872515 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-7694ae1f-d300-426c-a22e-ab098365bfe9 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:17.879640 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-7694ae1f-d300-426c-a22e-ab098365bfe9 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:17.880043 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-7694ae1f-d300-426c-a22e-ab098365bfe9 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:18.346388 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-7694ae1f-d300-426c-a22e-ab098365bfe9 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f32f5fba1976432d938e664c7714e52b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b9d4c236b944f9b2e8e502a50a8f8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:02:18.349563 n-d-863052-2 devstack@n-api.service[121403]: DEBUG dbcounter [-] [121403] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=121403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 19:02:18.367631 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-7694ae1f-d300-426c-a22e-ab098365bfe9 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] 10.222.0.13 "GET /compute/v2.1/servers/58d02dff-26f6-4c2f-b886-cdbdccbfcec9" status: 200 len: 1483 microversion: 2.1 time: 0.527744 Nov 01 19:02:18.372829 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1094/2191] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:02:17 2022] GET /compute/v2.1/servers/58d02dff-26f6-4c2f-b886-cdbdccbfcec9 => generated 1483 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:02:18.405586 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-727a2aff-2f56-4492-a2e0-b576cd99a347 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:02:18.415500 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-727a2aff-2f56-4492-a2e0-b576cd99a347 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] [instance: cd879708-f757-4f88-bc95-38b6cd55363c] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:02:18.445513 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-727a2aff-2f56-4492-a2e0-b576cd99a347 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:18.450785 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-727a2aff-2f56-4492-a2e0-b576cd99a347 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:18.451338 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-727a2aff-2f56-4492-a2e0-b576cd99a347 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:18.452165 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-727a2aff-2f56-4492-a2e0-b576cd99a347 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:18.458114 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-727a2aff-2f56-4492-a2e0-b576cd99a347 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:18.458683 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-727a2aff-2f56-4492-a2e0-b576cd99a347 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:18.641344 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-727a2aff-2f56-4492-a2e0-b576cd99a347 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:02:18.670243 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-727a2aff-2f56-4492-a2e0-b576cd99a347 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:02:18.672025 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-727a2aff-2f56-4492-a2e0-b576cd99a347 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:02:18.677856 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-727a2aff-2f56-4492-a2e0-b576cd99a347 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] 10.222.0.13 "GET /compute/v2.1/servers/cd879708-f757-4f88-bc95-38b6cd55363c" status: 200 len: 1266 microversion: 2.25 time: 0.301967 Nov 01 19:02:18.679759 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1095/2192] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 19:02:18 2022] GET /compute/v2.1/servers/cd879708-f757-4f88-bc95-38b6cd55363c => generated 1266 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 19:02:18.694373 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-7766a1e6-491d-4259-9b43-4a779984b3ad tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:02:18.703979 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-7766a1e6-491d-4259-9b43-4a779984b3ad tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] [instance: 90b353ab-ef97-4d88-b5bc-b355ff576225] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:02:18.721806 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-7766a1e6-491d-4259-9b43-4a779984b3ad tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:18.729581 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-7766a1e6-491d-4259-9b43-4a779984b3ad tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:18.733456 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-7766a1e6-491d-4259-9b43-4a779984b3ad tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:18.735262 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-7766a1e6-491d-4259-9b43-4a779984b3ad tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:18.739449 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-7766a1e6-491d-4259-9b43-4a779984b3ad tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:18.740215 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-7766a1e6-491d-4259-9b43-4a779984b3ad tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:19.105440 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-7766a1e6-491d-4259-9b43-4a779984b3ad tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a63d69c99a546f0af16329cff3ca717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a1bb191cff948e99c008b5e861ce4a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:02:19.128799 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-7766a1e6-491d-4259-9b43-4a779984b3ad tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] 10.222.0.13 "GET /compute/v2.1/servers/90b353ab-ef97-4d88-b5bc-b355ff576225" status: 200 len: 1730 microversion: 2.1 time: 0.447218 Nov 01 19:02:19.130262 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1096/2193] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:02:18 2022] GET /compute/v2.1/servers/90b353ab-ef97-4d88-b5bc-b355ff576225 => generated 1730 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:02:19.148823 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-fbb1e6ea-1f97-4bf3-a51c-80a1df9b894d tempest-ServersTestBootFromVolume-877599095 tempest-ServersTestBootFromVolume-877599095-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:02:19.170216 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-fbb1e6ea-1f97-4bf3-a51c-80a1df9b894d tempest-ServersTestBootFromVolume-877599095 tempest-ServersTestBootFromVolume-877599095-project] [instance: 44cdf0d8-969b-4149-bb03-6bc390977019] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:02:19.200746 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-fbb1e6ea-1f97-4bf3-a51c-80a1df9b894d tempest-ServersTestBootFromVolume-877599095 tempest-ServersTestBootFromVolume-877599095-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:19.204304 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-fbb1e6ea-1f97-4bf3-a51c-80a1df9b894d tempest-ServersTestBootFromVolume-877599095 tempest-ServersTestBootFromVolume-877599095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:19.206675 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-fbb1e6ea-1f97-4bf3-a51c-80a1df9b894d tempest-ServersTestBootFromVolume-877599095 tempest-ServersTestBootFromVolume-877599095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:19.208137 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-fbb1e6ea-1f97-4bf3-a51c-80a1df9b894d tempest-ServersTestBootFromVolume-877599095 tempest-ServersTestBootFromVolume-877599095-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:19.212348 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-fbb1e6ea-1f97-4bf3-a51c-80a1df9b894d tempest-ServersTestBootFromVolume-877599095 tempest-ServersTestBootFromVolume-877599095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:19.216402 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-fbb1e6ea-1f97-4bf3-a51c-80a1df9b894d tempest-ServersTestBootFromVolume-877599095 tempest-ServersTestBootFromVolume-877599095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:19.814159 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-fbb1e6ea-1f97-4bf3-a51c-80a1df9b894d tempest-ServersTestBootFromVolume-877599095 tempest-ServersTestBootFromVolume-877599095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed2352ce53fc4045adde8cd81b78b3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651046528c204df299ca3d14c44b4a7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:02:19.827862 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-fbb1e6ea-1f97-4bf3-a51c-80a1df9b894d tempest-ServersTestBootFromVolume-877599095 tempest-ServersTestBootFromVolume-877599095-project] 10.222.0.13 "GET /compute/v2.1/servers/44cdf0d8-969b-4149-bb03-6bc390977019" status: 200 len: 1304 microversion: 2.1 time: 0.695101 Nov 01 19:02:19.839029 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1097/2194] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:02:19 2022] GET /compute/v2.1/servers/44cdf0d8-969b-4149-bb03-6bc390977019 => generated 1304 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:02:19.850837 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-a3470057-a12f-460b-84aa-972f22d2529f tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:02:19.853892 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-a3470057-a12f-460b-84aa-972f22d2529f tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] [instance: 4b9fb909-26f7-40af-bac5-e7d2a6b9fb77] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:02:19.874114 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-a3470057-a12f-460b-84aa-972f22d2529f tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:19.877225 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-a3470057-a12f-460b-84aa-972f22d2529f tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:19.877918 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-a3470057-a12f-460b-84aa-972f22d2529f tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:19.879581 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-a3470057-a12f-460b-84aa-972f22d2529f tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:19.880327 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-a3470057-a12f-460b-84aa-972f22d2529f tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:19.888929 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-a3470057-a12f-460b-84aa-972f22d2529f tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:20.338659 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-a3470057-a12f-460b-84aa-972f22d2529f tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52acef7992d64d378fd8ac333887fd0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af51b8733e984c2ca87df2d8163dedf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:02:20.347892 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-a3470057-a12f-460b-84aa-972f22d2529f tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] 10.222.0.13 "GET /compute/v2.1/servers/4b9fb909-26f7-40af-bac5-e7d2a6b9fb77" status: 200 len: 1354 microversion: 2.1 time: 0.506611 Nov 01 19:02:20.351837 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1098/2195] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:02:19 2022] GET /compute/v2.1/servers/4b9fb909-26f7-40af-bac5-e7d2a6b9fb77 => generated 1354 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:02:20.356838 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [req-62433455-ae56-402e-b26c-80b224c626e3 req-2cbcf70c-8500-4355-a35f-a92a816059a9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4b9fb909-26f7-40af-bac5-e7d2a6b9fb77", "tag": "e5db1a83-8c2c-45e5-8a96-25ed895f1996"}]} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:02:20.389125 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-62433455-ae56-402e-b26c-80b224c626e3 req-2cbcf70c-8500-4355-a35f-a92a816059a9 service nova] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:20.391447 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-62433455-ae56-402e-b26c-80b224c626e3 req-2cbcf70c-8500-4355-a35f-a92a816059a9 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:20.405454 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-62433455-ae56-402e-b26c-80b224c626e3 req-2cbcf70c-8500-4355-a35f-a92a816059a9 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:20.447567 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.compute.server_external_events [req-62433455-ae56-402e-b26c-80b224c626e3 req-2cbcf70c-8500-4355-a35f-a92a816059a9 service nova] Creating event network-changed:e5db1a83-8c2c-45e5-8a96-25ed895f1996 for instance 4b9fb909-26f7-40af-bac5-e7d2a6b9fb77 on n-h1-863052-2 Nov 01 19:02:20.455051 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [req-62433455-ae56-402e-b26c-80b224c626e3 req-2cbcf70c-8500-4355-a35f-a92a816059a9 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101583 Nov 01 19:02:20.458958 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1099/2196] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Nov 1 19:02:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:02:20.473309 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-4e5cdf2c-058e-4f15-b4e6-86d4c3cc75c4 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:02:20.477522 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-4e5cdf2c-058e-4f15-b4e6-86d4c3cc75c4 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] [instance: 46a040e6-2750-47b4-b8e2-757b92f1adf1] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:02:20.488538 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-4e5cdf2c-058e-4f15-b4e6-86d4c3cc75c4 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:20.489078 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-4e5cdf2c-058e-4f15-b4e6-86d4c3cc75c4 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:20.489742 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-4e5cdf2c-058e-4f15-b4e6-86d4c3cc75c4 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:20.490688 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-4e5cdf2c-058e-4f15-b4e6-86d4c3cc75c4 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:20.501263 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-4e5cdf2c-058e-4f15-b4e6-86d4c3cc75c4 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:20.502048 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-4e5cdf2c-058e-4f15-b4e6-86d4c3cc75c4 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:20.960382 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-4e5cdf2c-058e-4f15-b4e6-86d4c3cc75c4 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb496b3faac4abbae73d389f2042e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e2520220d454764b8c139a58d78ac83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:02:20.976483 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-4e5cdf2c-058e-4f15-b4e6-86d4c3cc75c4 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] 10.222.0.13 "GET /compute/v2.1/servers/46a040e6-2750-47b4-b8e2-757b92f1adf1" status: 200 len: 1314 microversion: 2.1 time: 0.515110 Nov 01 19:02:20.977361 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1100/2197] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:02:20 2022] GET /compute/v2.1/servers/46a040e6-2750-47b4-b8e2-757b92f1adf1 => generated 1314 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:02:20.991252 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-802e0af6-9783-4ae4-a126-84af32be4f2f tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:02:20.993223 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-802e0af6-9783-4ae4-a126-84af32be4f2f tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] [instance: 90b353ab-ef97-4d88-b5bc-b355ff576225] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:02:21.004267 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-802e0af6-9783-4ae4-a126-84af32be4f2f tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:21.005739 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-802e0af6-9783-4ae4-a126-84af32be4f2f tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:21.006469 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-802e0af6-9783-4ae4-a126-84af32be4f2f tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:21.007407 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-802e0af6-9783-4ae4-a126-84af32be4f2f tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:21.008023 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-802e0af6-9783-4ae4-a126-84af32be4f2f tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:21.008811 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-802e0af6-9783-4ae4-a126-84af32be4f2f tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:21.027339 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.virt.hardware [None req-2c783638-401c-420a-9854-01e48757ea46 tempest-ImagesNegativeTestJSON-1904451201 tempest-ImagesNegativeTestJSON-1904451201-project] Flavor limits 0:0:0 {{(pid=121402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 01 19:02:21.028276 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.virt.hardware [None req-2c783638-401c-420a-9854-01e48757ea46 tempest-ImagesNegativeTestJSON-1904451201 tempest-ImagesNegativeTestJSON-1904451201-project] Image limits 0:0:0 {{(pid=121402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 01 19:02:21.029177 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.virt.hardware [None req-2c783638-401c-420a-9854-01e48757ea46 tempest-ImagesNegativeTestJSON-1904451201 tempest-ImagesNegativeTestJSON-1904451201-project] Flavor pref 0:0:0 {{(pid=121402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 01 19:02:21.030035 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.virt.hardware [None req-2c783638-401c-420a-9854-01e48757ea46 tempest-ImagesNegativeTestJSON-1904451201 tempest-ImagesNegativeTestJSON-1904451201-project] Image pref 0:0:0 {{(pid=121402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 01 19:02:21.031279 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.virt.hardware [None req-2c783638-401c-420a-9854-01e48757ea46 tempest-ImagesNegativeTestJSON-1904451201 tempest-ImagesNegativeTestJSON-1904451201-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 01 19:02:21.043680 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2c783638-401c-420a-9854-01e48757ea46 tempest-ImagesNegativeTestJSON-1904451201 tempest-ImagesNegativeTestJSON-1904451201-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:21.045602 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2c783638-401c-420a-9854-01e48757ea46 tempest-ImagesNegativeTestJSON-1904451201 tempest-ImagesNegativeTestJSON-1904451201-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:21.046953 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2c783638-401c-420a-9854-01e48757ea46 tempest-ImagesNegativeTestJSON-1904451201 tempest-ImagesNegativeTestJSON-1904451201-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:21.049012 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2c783638-401c-420a-9854-01e48757ea46 tempest-ImagesNegativeTestJSON-1904451201 tempest-ImagesNegativeTestJSON-1904451201-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:21.049698 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2c783638-401c-420a-9854-01e48757ea46 tempest-ImagesNegativeTestJSON-1904451201 tempest-ImagesNegativeTestJSON-1904451201-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:21.050581 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2c783638-401c-420a-9854-01e48757ea46 tempest-ImagesNegativeTestJSON-1904451201 tempest-ImagesNegativeTestJSON-1904451201-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:21.078284 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.quota [None req-2c783638-401c-420a-9854-01e48757ea46 tempest-ImagesNegativeTestJSON-1904451201 tempest-ImagesNegativeTestJSON-1904451201-project] Getting quotas for project 68771d3adba04230a0fc3f69b50cc9b2. Resources: {'cores', 'ram', 'instances'} {{(pid=121402) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 01 19:02:21.084253 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.quota [None req-2c783638-401c-420a-9854-01e48757ea46 tempest-ImagesNegativeTestJSON-1904451201 tempest-ImagesNegativeTestJSON-1904451201-project] Getting quotas for user 1c4a93c606cd4fc98c9b667bfc3d367b and project 68771d3adba04230a0fc3f69b50cc9b2. Resources: {'cores', 'ram', 'instances'} {{(pid=121402) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 01 19:02:21.099032 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-2c783638-401c-420a-9854-01e48757ea46 tempest-ImagesNegativeTestJSON-1904451201 tempest-ImagesNegativeTestJSON-1904451201-project] Going to run 1 instances... {{(pid=121402) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 01 19:02:21.103606 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-2c783638-401c-420a-9854-01e48757ea46 tempest-ImagesNegativeTestJSON-1904451201 tempest-ImagesNegativeTestJSON-1904451201-project] [instance: 077786bf-b9d6-4b7e-9eb5-ce4612dcd945] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2d4a0047-1b9e-445f-8af8-1b5c9d93e881',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121402) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 01 19:02:21.190139 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-2c783638-401c-420a-9854-01e48757ea46 tempest-ImagesNegativeTestJSON-1904451201 tempest-ImagesNegativeTestJSON-1904451201-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.307577 Nov 01 19:02:21.201044 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1098/2198] 10.222.0.13 () {60 vars in 1147 bytes} [Tue Nov 1 19:02:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 4323 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 01 19:02:21.216743 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-bb56565a-b131-4308-85cc-09ae7805af21 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:02:21.217396 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-bb56565a-b131-4308-85cc-09ae7805af21 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] [instance: 58d02dff-26f6-4c2f-b886-cdbdccbfcec9] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:02:21.250264 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-bb56565a-b131-4308-85cc-09ae7805af21 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:21.256005 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-bb56565a-b131-4308-85cc-09ae7805af21 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:21.257187 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-bb56565a-b131-4308-85cc-09ae7805af21 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:21.258119 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-bb56565a-b131-4308-85cc-09ae7805af21 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:21.258755 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-bb56565a-b131-4308-85cc-09ae7805af21 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:21.259576 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-bb56565a-b131-4308-85cc-09ae7805af21 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:21.262825 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-802e0af6-9783-4ae4-a126-84af32be4f2f tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] 10.222.0.13 "GET /compute/v2.1/servers/90b353ab-ef97-4d88-b5bc-b355ff576225/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.283210 Nov 01 19:02:21.263418 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1101/2199] 10.222.0.13 () {58 vars in 1275 bytes} [Tue Nov 1 19:02:20 2022] GET /compute/v2.1/servers/90b353ab-ef97-4d88-b5bc-b355ff576225/os-interface => generated 285 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:02:21.268283 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [req-4aaa3166-6424-4cdc-be71-3a4121dab238 req-68121147-89d2-4661-82dd-73e064a5ea39 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58d02dff-26f6-4c2f-b886-cdbdccbfcec9", "name": "network-vif-deleted", "tag": "8434dc9d-ed20-488e-a620-72caae7c1bd3"}]} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:02:21.288808 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.wsgi [None req-bb56565a-b131-4308-85cc-09ae7805af21 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] HTTP exception thrown: Instance 58d02dff-26f6-4c2f-b886-cdbdccbfcec9 could not be found. Nov 01 19:02:21.294876 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-4aaa3166-6424-4cdc-be71-3a4121dab238 req-68121147-89d2-4661-82dd-73e064a5ea39 service nova] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:21.295360 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-4aaa3166-6424-4cdc-be71-3a4121dab238 req-68121147-89d2-4661-82dd-73e064a5ea39 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:21.295787 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-4aaa3166-6424-4cdc-be71-3a4121dab238 req-68121147-89d2-4661-82dd-73e064a5ea39 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:21.303890 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-bb56565a-b131-4308-85cc-09ae7805af21 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Request method failure captured: Nov 01 19:02:21.303890 n-d-863052-2 devstack@n-api.service[121402]: request: GET /compute/v2.1/servers/58d02dff-26f6-4c2f-b886-cdbdccbfcec9 HTTP/1.1 Nov 01 19:02:21.303890 n-d-863052-2 devstack@n-api.service[121402]: Accept: application/json Nov 01 19:02:21.303890 n-d-863052-2 devstack@n-api.service[121402]: Accept-Encoding: identity Nov 01 19:02:21.303890 n-d-863052-2 devstack@n-api.service[121402]: Connection: close Nov 01 19:02:21.303890 n-d-863052-2 devstack@n-api.service[121402]: Content-Length: 0 Nov 01 19:02:21.303890 n-d-863052-2 devstack@n-api.service[121402]: Content-Type: application/json Nov 01 19:02:21.303890 n-d-863052-2 devstack@n-api.service[121402]: Host: 10.222.0.13 Nov 01 19:02:21.303890 n-d-863052-2 devstack@n-api.service[121402]: Openstack-System-Scope: None Nov 01 19:02:21.303890 n-d-863052-2 devstack@n-api.service[121402]: User-Agent: python-urllib3/1.26.12 Nov 01 19:02:21.303890 n-d-863052-2 devstack@n-api.service[121402]: X-Auth-Token: gAAAAABjYWt-NQXke2xaT5Zx7jRYabVG4ahAkm8OML59W5vfFJqbwex-J1ZiLL497voaQvk8mxYaO51_Dy7DE73iezGuKz14bZTbSfTjEO0SNQwkG26Td9pn2M3Cq9W9_GYL5mCba8SZ_e1faAE8WJGSrhBj4wfU4ft8jddNlfpfKRiwGV7JCoo Nov 01 19:02:21.303890 n-d-863052-2 devstack@n-api.service[121402]: X-Domain-Id: None Nov 01 19:02:21.303890 n-d-863052-2 devstack@n-api.service[121402]: X-Domain-Name: None Nov 01 19:02:21.303890 n-d-863052-2 devstack@n-api.service[121402]: X-Identity-Status: Confirmed Nov 01 19:02:21.303890 n-d-863052-2 devstack@n-api.service[121402]: X-Is-Admin-Project: True Nov 01 19:02:21.303890 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Domain-Id: default Nov 01 19:02:21.303890 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Domain-Name: Default Nov 01 19:02:21.303890 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Id: d9b9d4c236b944f9b2e8e502a50a8f8b Nov 01 19:02:21.303890 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Name: tempest-LiveMigrationTest-1986167696 Nov 01 19:02:21.303890 n-d-863052-2 devstack@n-api.service[121402]: X-Role: member,reader Nov 01 19:02:21.303890 n-d-863052-2 devstack@n-api.service[121402]: X-Roles: member,reader Nov 01 19:02:21.303890 n-d-863052-2 devstack@n-api.service[121402]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/d9b9d4c236b944f9b2e8e502a50a8f8b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/d9b9d4c236b944f9b2e8e502a50a8f8b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_d9b9d4c236b944f9b2e8e502a50a8f8b", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/d9b9d4c236b944f9b2e8e502a50a8f8b"}]}] Nov 01 19:02:21.303890 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant: tempest-LiveMigrationTest-1986167696 Nov 01 19:02:21.303890 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant-Id: d9b9d4c236b944f9b2e8e502a50a8f8b Nov 01 19:02:21.303890 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant-Name: tempest-LiveMigrationTest-1986167696 Nov 01 19:02:21.303890 n-d-863052-2 devstack@n-api.service[121402]: X-User: tempest-LiveMigrationTest-1986167696-project Nov 01 19:02:21.303890 n-d-863052-2 devstack@n-api.service[121402]: X-User-Domain-Id: default Nov 01 19:02:21.303890 n-d-863052-2 devstack@n-api.service[121402]: X-User-Domain-Name: Default Nov 01 19:02:21.303890 n-d-863052-2 devstack@n-api.service[121402]: X-User-Id: f32f5fba1976432d938e664c7714e52b Nov 01 19:02:21.303890 n-d-863052-2 devstack@n-api.service[121402]: X-User-Name: tempest-LiveMigrationTest-1986167696-project Nov 01 19:02:21.303890 n-d-863052-2 devstack@n-api.service[121402]: method: > Nov 01 19:02:21.303890 n-d-863052-2 devstack@n-api.service[121402]: exception: Instance 58d02dff-26f6-4c2f-b886-cdbdccbfcec9 could not be found. Nov 01 19:02:21.303890 n-d-863052-2 devstack@n-api.service[121402]: action_args: {'id': '58d02dff-26f6-4c2f-b886-cdbdccbfcec9'} Nov 01 19:02:21.303890 n-d-863052-2 devstack@n-api.service[121402]: {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 01 19:02:21.303890 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:02:21.303890 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 01 19:02:21.303890 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 01 19:02:21.303890 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 01 19:02:21.303890 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 01 19:02:21.303890 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 01 19:02:21.303890 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 01 19:02:21.303890 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 01 19:02:21.303890 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 01 19:02:21.303890 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 58d02dff-26f6-4c2f-b886-cdbdccbfcec9 could not be found. Nov 01 19:02:21.303890 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:02:21.303890 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:02:21.303890 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:02:21.303890 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:02:21.303890 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:02:21.303890 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:02:21.303890 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 01 19:02:21.303890 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 01 19:02:21.303890 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 01 19:02:21.303890 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 01 19:02:21.303890 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 01 19:02:21.303890 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 01 19:02:21.303890 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 01 19:02:21.303890 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 01 19:02:21.303890 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 01 19:02:21.303890 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 01 19:02:21.303890 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 58d02dff-26f6-4c2f-b886-cdbdccbfcec9 could not be found. Nov 01 19:02:21.303890 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:02:21.303890 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:02:21.303890 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:02:21.308567 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:02:21.308567 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:02:21.308567 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:02:21.308567 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 01 19:02:21.308567 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 01 19:02:21.308567 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 58d02dff-26f6-4c2f-b886-cdbdccbfcec9 could not be found. Nov 01 19:02:21.308567 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:02:21.310513 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-bb56565a-b131-4308-85cc-09ae7805af21 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Returning 404 to user: Instance 58d02dff-26f6-4c2f-b886-cdbdccbfcec9 could not be found. {{(pid=121402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 01 19:02:21.311843 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-bb56565a-b131-4308-85cc-09ae7805af21 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] 10.222.0.13 "GET /compute/v2.1/servers/58d02dff-26f6-4c2f-b886-cdbdccbfcec9" status: 404 len: 111 microversion: 2.1 time: 0.107307 Nov 01 19:02:21.313479 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1099/2200] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:02:21 2022] GET /compute/v2.1/servers/58d02dff-26f6-4c2f-b886-cdbdccbfcec9 => generated 111 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 01 19:02:21.319313 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-31eafeae-f0c3-486c-a0b7-a10c211ab07f tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:02:21.322994 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-31eafeae-f0c3-486c-a0b7-a10c211ab07f tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] [instance: cd879708-f757-4f88-bc95-38b6cd55363c] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:02:21.337777 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-31eafeae-f0c3-486c-a0b7-a10c211ab07f tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:21.338953 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.compute.server_external_events [req-4aaa3166-6424-4cdc-be71-3a4121dab238 req-68121147-89d2-4661-82dd-73e064a5ea39 service nova] Creating event network-vif-deleted:8434dc9d-ed20-488e-a620-72caae7c1bd3 for instance 58d02dff-26f6-4c2f-b886-cdbdccbfcec9 on n-h2-863052-2 Nov 01 19:02:21.342735 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-31eafeae-f0c3-486c-a0b7-a10c211ab07f tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:21.343405 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-31eafeae-f0c3-486c-a0b7-a10c211ab07f tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:21.344096 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [req-4aaa3166-6424-4cdc-be71-3a4121dab238 req-68121147-89d2-4661-82dd-73e064a5ea39 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079301 Nov 01 19:02:21.344522 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-31eafeae-f0c3-486c-a0b7-a10c211ab07f tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:21.345062 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1102/2201] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Nov 1 19:02:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:02:21.345450 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-31eafeae-f0c3-486c-a0b7-a10c211ab07f tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:21.346272 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-31eafeae-f0c3-486c-a0b7-a10c211ab07f tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:21.360008 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-7ea95d20-5c94-4cf4-81ac-f06ce8a3f03f tempest-ServersTestBootFromVolume-877599095 tempest-ServersTestBootFromVolume-877599095-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:02:21.360739 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-7ea95d20-5c94-4cf4-81ac-f06ce8a3f03f tempest-ServersTestBootFromVolume-877599095 tempest-ServersTestBootFromVolume-877599095-project] [instance: 44cdf0d8-969b-4149-bb03-6bc390977019] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:02:21.372059 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-7ea95d20-5c94-4cf4-81ac-f06ce8a3f03f tempest-ServersTestBootFromVolume-877599095 tempest-ServersTestBootFromVolume-877599095-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:21.372555 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-7ea95d20-5c94-4cf4-81ac-f06ce8a3f03f tempest-ServersTestBootFromVolume-877599095 tempest-ServersTestBootFromVolume-877599095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:21.373011 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-7ea95d20-5c94-4cf4-81ac-f06ce8a3f03f tempest-ServersTestBootFromVolume-877599095 tempest-ServersTestBootFromVolume-877599095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:21.373717 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-7ea95d20-5c94-4cf4-81ac-f06ce8a3f03f tempest-ServersTestBootFromVolume-877599095 tempest-ServersTestBootFromVolume-877599095-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:21.374166 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-7ea95d20-5c94-4cf4-81ac-f06ce8a3f03f tempest-ServersTestBootFromVolume-877599095 tempest-ServersTestBootFromVolume-877599095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:21.374585 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-7ea95d20-5c94-4cf4-81ac-f06ce8a3f03f tempest-ServersTestBootFromVolume-877599095 tempest-ServersTestBootFromVolume-877599095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:21.542795 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-31eafeae-f0c3-486c-a0b7-a10c211ab07f tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:02:21.581633 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-31eafeae-f0c3-486c-a0b7-a10c211ab07f tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:02:21.587449 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-31eafeae-f0c3-486c-a0b7-a10c211ab07f tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:02:21.601230 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-31eafeae-f0c3-486c-a0b7-a10c211ab07f tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] 10.222.0.13 "GET /compute/v2.1/servers/cd879708-f757-4f88-bc95-38b6cd55363c" status: 200 len: 1266 microversion: 2.25 time: 0.286388 Nov 01 19:02:21.616924 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1100/2202] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 19:02:21 2022] GET /compute/v2.1/servers/cd879708-f757-4f88-bc95-38b6cd55363c => generated 1266 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 19:02:21.626603 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-8431087a-f76f-4302-bd06-8ae2422de047 tempest-ImagesNegativeTestJSON-1904451201 tempest-ImagesNegativeTestJSON-1904451201-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:02:21.627317 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-8431087a-f76f-4302-bd06-8ae2422de047 tempest-ImagesNegativeTestJSON-1904451201 tempest-ImagesNegativeTestJSON-1904451201-project] [instance: 077786bf-b9d6-4b7e-9eb5-ce4612dcd945] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:02:21.845835 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-8431087a-f76f-4302-bd06-8ae2422de047 tempest-ImagesNegativeTestJSON-1904451201 tempest-ImagesNegativeTestJSON-1904451201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c4a93c606cd4fc98c9b667bfc3d367b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68771d3adba04230a0fc3f69b50cc9b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:02:21.857556 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-8431087a-f76f-4302-bd06-8ae2422de047 tempest-ImagesNegativeTestJSON-1904451201 tempest-ImagesNegativeTestJSON-1904451201-project] 10.222.0.13 "GET /compute/v2.1/servers/077786bf-b9d6-4b7e-9eb5-ce4612dcd945" status: 200 len: 1216 microversion: 2.1 time: 0.245999 Nov 01 19:02:21.858188 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1101/2203] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:02:21 2022] GET /compute/v2.1/servers/077786bf-b9d6-4b7e-9eb5-ce4612dcd945 => generated 1216 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:02:21.885648 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-1cadf1dc-8904-444a-aaf3-7c1c28a1899c tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:02:21.886175 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-1cadf1dc-8904-444a-aaf3-7c1c28a1899c tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] [instance: de2ff806-a2fa-4390-b4d5-11ff24dd27ca] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:02:21.892143 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-1cadf1dc-8904-444a-aaf3-7c1c28a1899c tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:21.892660 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-1cadf1dc-8904-444a-aaf3-7c1c28a1899c tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:21.893105 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-1cadf1dc-8904-444a-aaf3-7c1c28a1899c tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:21.893816 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-1cadf1dc-8904-444a-aaf3-7c1c28a1899c tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:21.894271 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-1cadf1dc-8904-444a-aaf3-7c1c28a1899c tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:21.894909 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-1cadf1dc-8904-444a-aaf3-7c1c28a1899c tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:21.923213 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-1cadf1dc-8904-444a-aaf3-7c1c28a1899c tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] [instance: de2ff806-a2fa-4390-b4d5-11ff24dd27ca] Going to try to terminate instance {{(pid=121402) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 01 19:02:22.051837 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-1cadf1dc-8904-444a-aaf3-7c1c28a1899c tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] 10.222.0.13 "DELETE /compute/v2.1/servers/de2ff806-a2fa-4390-b4d5-11ff24dd27ca" status: 204 len: 0 microversion: 2.1 time: 0.173629 Nov 01 19:02:22.056633 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1102/2204] 10.222.0.13 () {58 vars in 1239 bytes} [Tue Nov 1 19:02:21 2022] DELETE /compute/v2.1/servers/de2ff806-a2fa-4390-b4d5-11ff24dd27ca => generated 0 bytes in 195 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 01 19:02:22.060539 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-535001e7-e014-4d57-8b11-38cb8f9cb064 tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:02:22.062015 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-535001e7-e014-4d57-8b11-38cb8f9cb064 tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] [instance: 4b9fb909-26f7-40af-bac5-e7d2a6b9fb77] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:02:22.069714 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-535001e7-e014-4d57-8b11-38cb8f9cb064 tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:22.070517 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-535001e7-e014-4d57-8b11-38cb8f9cb064 tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:22.071559 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-535001e7-e014-4d57-8b11-38cb8f9cb064 tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:22.073337 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-535001e7-e014-4d57-8b11-38cb8f9cb064 tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:22.074042 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-535001e7-e014-4d57-8b11-38cb8f9cb064 tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:22.074641 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-535001e7-e014-4d57-8b11-38cb8f9cb064 tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:22.363163 n-d-863052-2 devstack@n-api.service[121403]: DEBUG dbcounter [-] [121403] Writing DB stats nova_cell0:SELECT=2 {{(pid=121403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 19:02:22.432870 n-d-863052-2 devstack@n-api.service[121403]: DEBUG dbcounter [-] [121403] Writing DB stats nova_cell0:SELECT=6 {{(pid=121403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 19:02:22.521586 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-7ea95d20-5c94-4cf4-81ac-f06ce8a3f03f tempest-ServersTestBootFromVolume-877599095 tempest-ServersTestBootFromVolume-877599095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed2352ce53fc4045adde8cd81b78b3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651046528c204df299ca3d14c44b4a7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:02:22.555995 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-7ea95d20-5c94-4cf4-81ac-f06ce8a3f03f tempest-ServersTestBootFromVolume-877599095 tempest-ServersTestBootFromVolume-877599095-project] 10.222.0.13 "GET /compute/v2.1/servers/44cdf0d8-969b-4149-bb03-6bc390977019" status: 200 len: 1304 microversion: 2.1 time: 1.209581 Nov 01 19:02:22.557170 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1103/2205] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:02:21 2022] GET /compute/v2.1/servers/44cdf0d8-969b-4149-bb03-6bc390977019 => generated 1304 bytes in 1212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:02:22.572543 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-bcb64780-811f-467c-83dd-f65f3b15fdd3 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:02:22.572543 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-bcb64780-811f-467c-83dd-f65f3b15fdd3 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] [instance: 46a040e6-2750-47b4-b8e2-757b92f1adf1] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:02:22.590660 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-bcb64780-811f-467c-83dd-f65f3b15fdd3 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:22.591163 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-bcb64780-811f-467c-83dd-f65f3b15fdd3 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:22.591610 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-bcb64780-811f-467c-83dd-f65f3b15fdd3 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:22.592327 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-bcb64780-811f-467c-83dd-f65f3b15fdd3 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:22.592873 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-bcb64780-811f-467c-83dd-f65f3b15fdd3 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:22.593319 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-bcb64780-811f-467c-83dd-f65f3b15fdd3 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:22.723385 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-535001e7-e014-4d57-8b11-38cb8f9cb064 tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52acef7992d64d378fd8ac333887fd0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af51b8733e984c2ca87df2d8163dedf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:02:22.739261 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-535001e7-e014-4d57-8b11-38cb8f9cb064 tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] 10.222.0.13 "GET /compute/v2.1/servers/4b9fb909-26f7-40af-bac5-e7d2a6b9fb77" status: 200 len: 1354 microversion: 2.1 time: 0.683557 Nov 01 19:02:22.740443 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1103/2206] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:02:22 2022] GET /compute/v2.1/servers/4b9fb909-26f7-40af-bac5-e7d2a6b9fb77 => generated 1354 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:02:22.759261 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-51213ebf-874f-409f-b0e9-9f6edb3fcc5a tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:02:22.759886 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-51213ebf-874f-409f-b0e9-9f6edb3fcc5a tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] [instance: de2ff806-a2fa-4390-b4d5-11ff24dd27ca] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:02:22.774672 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-51213ebf-874f-409f-b0e9-9f6edb3fcc5a tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:22.775398 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-51213ebf-874f-409f-b0e9-9f6edb3fcc5a tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:22.776040 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-51213ebf-874f-409f-b0e9-9f6edb3fcc5a tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:22.777265 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-51213ebf-874f-409f-b0e9-9f6edb3fcc5a tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:22.778470 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-51213ebf-874f-409f-b0e9-9f6edb3fcc5a tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:22.779074 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-51213ebf-874f-409f-b0e9-9f6edb3fcc5a tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:22.993186 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-bcb64780-811f-467c-83dd-f65f3b15fdd3 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb496b3faac4abbae73d389f2042e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e2520220d454764b8c139a58d78ac83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:02:23.021882 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-bcb64780-811f-467c-83dd-f65f3b15fdd3 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] 10.222.0.13 "GET /compute/v2.1/servers/46a040e6-2750-47b4-b8e2-757b92f1adf1" status: 200 len: 1314 microversion: 2.1 time: 0.453856 Nov 01 19:02:23.027207 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1104/2207] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:02:22 2022] GET /compute/v2.1/servers/46a040e6-2750-47b4-b8e2-757b92f1adf1 => generated 1314 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:02:23.035990 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-d1a9b03c-29ab-483c-b233-8e5f715d5066 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:02:23.036872 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-d1a9b03c-29ab-483c-b233-8e5f715d5066 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] [instance: cd879708-f757-4f88-bc95-38b6cd55363c] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:02:23.047413 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d1a9b03c-29ab-483c-b233-8e5f715d5066 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:23.047994 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d1a9b03c-29ab-483c-b233-8e5f715d5066 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:23.048810 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d1a9b03c-29ab-483c-b233-8e5f715d5066 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:23.049597 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d1a9b03c-29ab-483c-b233-8e5f715d5066 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:23.050129 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d1a9b03c-29ab-483c-b233-8e5f715d5066 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:23.050631 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d1a9b03c-29ab-483c-b233-8e5f715d5066 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:23.227318 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-d1a9b03c-29ab-483c-b233-8e5f715d5066 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:02:23.235851 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-d1a9b03c-29ab-483c-b233-8e5f715d5066 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:02:23.237260 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-d1a9b03c-29ab-483c-b233-8e5f715d5066 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:02:23.238416 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-d1a9b03c-29ab-483c-b233-8e5f715d5066 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] 10.222.0.13 "GET /compute/v2.1/servers/cd879708-f757-4f88-bc95-38b6cd55363c" status: 200 len: 1266 microversion: 2.25 time: 0.210325 Nov 01 19:02:23.238971 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1105/2208] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 19:02:23 2022] GET /compute/v2.1/servers/cd879708-f757-4f88-bc95-38b6cd55363c => generated 1266 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 19:02:23.253031 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [req-97a3cc4b-8d3d-4bc2-b03e-0eff94fc8d10 req-be068e14-399d-4a40-9207-e15d660f86d3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "44cdf0d8-969b-4149-bb03-6bc390977019", "tag": "2ea52276-0a87-4b31-a387-b25b0b2e684c"}]} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:02:23.275106 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-97a3cc4b-8d3d-4bc2-b03e-0eff94fc8d10 req-be068e14-399d-4a40-9207-e15d660f86d3 service nova] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:23.279580 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-97a3cc4b-8d3d-4bc2-b03e-0eff94fc8d10 req-be068e14-399d-4a40-9207-e15d660f86d3 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:23.280405 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-97a3cc4b-8d3d-4bc2-b03e-0eff94fc8d10 req-be068e14-399d-4a40-9207-e15d660f86d3 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:23.310191 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.compute.server_external_events [req-97a3cc4b-8d3d-4bc2-b03e-0eff94fc8d10 req-be068e14-399d-4a40-9207-e15d660f86d3 service nova] Creating event network-changed:2ea52276-0a87-4b31-a387-b25b0b2e684c for instance 44cdf0d8-969b-4149-bb03-6bc390977019 on n-h1-863052-2 Nov 01 19:02:23.317100 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [req-97a3cc4b-8d3d-4bc2-b03e-0eff94fc8d10 req-be068e14-399d-4a40-9207-e15d660f86d3 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069736 Nov 01 19:02:23.318048 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1106/2209] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Nov 1 19:02:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:02:23.331700 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-884ba081-d12e-4681-8739-56f230e361b4 tempest-ImagesNegativeTestJSON-1904451201 tempest-ImagesNegativeTestJSON-1904451201-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:02:23.332792 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-884ba081-d12e-4681-8739-56f230e361b4 tempest-ImagesNegativeTestJSON-1904451201 tempest-ImagesNegativeTestJSON-1904451201-project] [instance: 077786bf-b9d6-4b7e-9eb5-ce4612dcd945] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:02:23.344841 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-884ba081-d12e-4681-8739-56f230e361b4 tempest-ImagesNegativeTestJSON-1904451201 tempest-ImagesNegativeTestJSON-1904451201-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:23.349782 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-884ba081-d12e-4681-8739-56f230e361b4 tempest-ImagesNegativeTestJSON-1904451201 tempest-ImagesNegativeTestJSON-1904451201-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:23.350305 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-884ba081-d12e-4681-8739-56f230e361b4 tempest-ImagesNegativeTestJSON-1904451201 tempest-ImagesNegativeTestJSON-1904451201-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:23.351474 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-884ba081-d12e-4681-8739-56f230e361b4 tempest-ImagesNegativeTestJSON-1904451201 tempest-ImagesNegativeTestJSON-1904451201-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:23.352069 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-884ba081-d12e-4681-8739-56f230e361b4 tempest-ImagesNegativeTestJSON-1904451201 tempest-ImagesNegativeTestJSON-1904451201-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:23.369049 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-884ba081-d12e-4681-8739-56f230e361b4 tempest-ImagesNegativeTestJSON-1904451201 tempest-ImagesNegativeTestJSON-1904451201-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:23.451451 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-51213ebf-874f-409f-b0e9-9f6edb3fcc5a tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f32f5fba1976432d938e664c7714e52b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b9d4c236b944f9b2e8e502a50a8f8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:02:23.471563 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-51213ebf-874f-409f-b0e9-9f6edb3fcc5a tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] 10.222.0.13 "GET /compute/v2.1/servers/de2ff806-a2fa-4390-b4d5-11ff24dd27ca" status: 200 len: 1498 microversion: 2.1 time: 0.729556 Nov 01 19:02:23.472321 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1104/2210] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:02:22 2022] GET /compute/v2.1/servers/de2ff806-a2fa-4390-b4d5-11ff24dd27ca => generated 1498 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:02:23.579636 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-d51a2002-22cf-4c4f-9826-752aa9791989 tempest-ServersTestBootFromVolume-877599095 tempest-ServersTestBootFromVolume-877599095-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:02:23.580634 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-d51a2002-22cf-4c4f-9826-752aa9791989 tempest-ServersTestBootFromVolume-877599095 tempest-ServersTestBootFromVolume-877599095-project] [instance: 44cdf0d8-969b-4149-bb03-6bc390977019] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:02:23.587484 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-d51a2002-22cf-4c4f-9826-752aa9791989 tempest-ServersTestBootFromVolume-877599095 tempest-ServersTestBootFromVolume-877599095-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:23.594376 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-d51a2002-22cf-4c4f-9826-752aa9791989 tempest-ServersTestBootFromVolume-877599095 tempest-ServersTestBootFromVolume-877599095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:23.594859 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-d51a2002-22cf-4c4f-9826-752aa9791989 tempest-ServersTestBootFromVolume-877599095 tempest-ServersTestBootFromVolume-877599095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:23.595635 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-d51a2002-22cf-4c4f-9826-752aa9791989 tempest-ServersTestBootFromVolume-877599095 tempest-ServersTestBootFromVolume-877599095-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:23.596272 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-d51a2002-22cf-4c4f-9826-752aa9791989 tempest-ServersTestBootFromVolume-877599095 tempest-ServersTestBootFromVolume-877599095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:23.596948 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-d51a2002-22cf-4c4f-9826-752aa9791989 tempest-ServersTestBootFromVolume-877599095 tempest-ServersTestBootFromVolume-877599095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:23.600914 n-d-863052-2 devstack@n-api.service[121402]: DEBUG dbcounter [-] [121402] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=121402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 19:02:23.718966 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-884ba081-d12e-4681-8739-56f230e361b4 tempest-ImagesNegativeTestJSON-1904451201 tempest-ImagesNegativeTestJSON-1904451201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c4a93c606cd4fc98c9b667bfc3d367b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68771d3adba04230a0fc3f69b50cc9b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:02:23.732323 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-884ba081-d12e-4681-8739-56f230e361b4 tempest-ImagesNegativeTestJSON-1904451201 tempest-ImagesNegativeTestJSON-1904451201-project] 10.222.0.13 "GET /compute/v2.1/servers/077786bf-b9d6-4b7e-9eb5-ce4612dcd945" status: 200 len: 1268 microversion: 2.1 time: 0.412242 Nov 01 19:02:23.733306 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1107/2211] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:02:23 2022] GET /compute/v2.1/servers/077786bf-b9d6-4b7e-9eb5-ce4612dcd945 => generated 1268 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:02:23.764048 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-4ed34fc9-e1bc-4ffa-b89f-73a6b083a867 tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:02:23.765247 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-4ed34fc9-e1bc-4ffa-b89f-73a6b083a867 tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] [instance: 4b9fb909-26f7-40af-bac5-e7d2a6b9fb77] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:02:23.773349 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-4ed34fc9-e1bc-4ffa-b89f-73a6b083a867 tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:23.774246 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-4ed34fc9-e1bc-4ffa-b89f-73a6b083a867 tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:23.775128 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-4ed34fc9-e1bc-4ffa-b89f-73a6b083a867 tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:23.776098 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-4ed34fc9-e1bc-4ffa-b89f-73a6b083a867 tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:23.776994 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-4ed34fc9-e1bc-4ffa-b89f-73a6b083a867 tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:23.777666 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-4ed34fc9-e1bc-4ffa-b89f-73a6b083a867 tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:24.358234 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-4ed34fc9-e1bc-4ffa-b89f-73a6b083a867 tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52acef7992d64d378fd8ac333887fd0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af51b8733e984c2ca87df2d8163dedf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:02:24.377659 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-4ed34fc9-e1bc-4ffa-b89f-73a6b083a867 tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] 10.222.0.13 "GET /compute/v2.1/servers/4b9fb909-26f7-40af-bac5-e7d2a6b9fb77" status: 200 len: 1354 microversion: 2.1 time: 0.618042 Nov 01 19:02:24.384380 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1108/2212] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:02:23 2022] GET /compute/v2.1/servers/4b9fb909-26f7-40af-bac5-e7d2a6b9fb77 => generated 1354 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:02:24.389167 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-3a5e84e7-1ec5-45d6-b0c2-81906eeebd12 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:02:24.389785 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-3a5e84e7-1ec5-45d6-b0c2-81906eeebd12 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] [instance: 46a040e6-2750-47b4-b8e2-757b92f1adf1] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:02:24.405364 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-3a5e84e7-1ec5-45d6-b0c2-81906eeebd12 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:24.411861 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-3a5e84e7-1ec5-45d6-b0c2-81906eeebd12 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:24.412694 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-3a5e84e7-1ec5-45d6-b0c2-81906eeebd12 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:24.413586 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-3a5e84e7-1ec5-45d6-b0c2-81906eeebd12 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:24.418540 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-3a5e84e7-1ec5-45d6-b0c2-81906eeebd12 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:24.419138 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-3a5e84e7-1ec5-45d6-b0c2-81906eeebd12 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:24.585539 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-d51a2002-22cf-4c4f-9826-752aa9791989 tempest-ServersTestBootFromVolume-877599095 tempest-ServersTestBootFromVolume-877599095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed2352ce53fc4045adde8cd81b78b3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651046528c204df299ca3d14c44b4a7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:02:24.597485 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-d51a2002-22cf-4c4f-9826-752aa9791989 tempest-ServersTestBootFromVolume-877599095 tempest-ServersTestBootFromVolume-877599095-project] 10.222.0.13 "GET /compute/v2.1/servers/44cdf0d8-969b-4149-bb03-6bc390977019" status: 200 len: 1304 microversion: 2.1 time: 1.021777 Nov 01 19:02:24.609229 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1105/2213] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:02:23 2022] GET /compute/v2.1/servers/44cdf0d8-969b-4149-bb03-6bc390977019 => generated 1304 bytes in 1034 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 19:02:24.619133 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-7ffbca55-e900-4da9-9bbf-5b1f022caf36 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:02:24.619972 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-7ffbca55-e900-4da9-9bbf-5b1f022caf36 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] [instance: cd879708-f757-4f88-bc95-38b6cd55363c] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:02:24.626548 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-7ffbca55-e900-4da9-9bbf-5b1f022caf36 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:24.627265 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-7ffbca55-e900-4da9-9bbf-5b1f022caf36 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:24.627882 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-7ffbca55-e900-4da9-9bbf-5b1f022caf36 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:24.628796 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-7ffbca55-e900-4da9-9bbf-5b1f022caf36 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:24.629410 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-7ffbca55-e900-4da9-9bbf-5b1f022caf36 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:24.629994 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-7ffbca55-e900-4da9-9bbf-5b1f022caf36 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:24.782328 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-7ffbca55-e900-4da9-9bbf-5b1f022caf36 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:02:24.805934 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-7ffbca55-e900-4da9-9bbf-5b1f022caf36 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:02:24.806956 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-3a5e84e7-1ec5-45d6-b0c2-81906eeebd12 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb496b3faac4abbae73d389f2042e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e2520220d454764b8c139a58d78ac83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:02:24.812927 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-7ffbca55-e900-4da9-9bbf-5b1f022caf36 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:02:24.818172 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-7ffbca55-e900-4da9-9bbf-5b1f022caf36 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] 10.222.0.13 "GET /compute/v2.1/servers/cd879708-f757-4f88-bc95-38b6cd55363c" status: 200 len: 1266 microversion: 2.25 time: 0.207454 Nov 01 19:02:24.819879 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-3a5e84e7-1ec5-45d6-b0c2-81906eeebd12 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] 10.222.0.13 "GET /compute/v2.1/servers/46a040e6-2750-47b4-b8e2-757b92f1adf1" status: 200 len: 1314 microversion: 2.1 time: 0.434306 Nov 01 19:02:24.821259 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1109/2214] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:02:24 2022] GET /compute/v2.1/servers/46a040e6-2750-47b4-b8e2-757b92f1adf1 => generated 1314 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:02:24.823621 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1106/2215] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 19:02:24 2022] GET /compute/v2.1/servers/cd879708-f757-4f88-bc95-38b6cd55363c => generated 1266 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 19:02:24.829631 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-faa56cb3-31fc-4902-af62-541851c50292 tempest-ImagesNegativeTestJSON-1904451201 tempest-ImagesNegativeTestJSON-1904451201-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:02:24.830469 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-faa56cb3-31fc-4902-af62-541851c50292 tempest-ImagesNegativeTestJSON-1904451201 tempest-ImagesNegativeTestJSON-1904451201-project] [instance: 077786bf-b9d6-4b7e-9eb5-ce4612dcd945] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:02:24.837379 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-7e907820-554d-479a-9f11-60c949ff567a tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:02:24.838223 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-7e907820-554d-479a-9f11-60c949ff567a tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] [instance: de2ff806-a2fa-4390-b4d5-11ff24dd27ca] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:02:24.842334 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-faa56cb3-31fc-4902-af62-541851c50292 tempest-ImagesNegativeTestJSON-1904451201 tempest-ImagesNegativeTestJSON-1904451201-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:24.843989 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-faa56cb3-31fc-4902-af62-541851c50292 tempest-ImagesNegativeTestJSON-1904451201 tempest-ImagesNegativeTestJSON-1904451201-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:24.844839 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-faa56cb3-31fc-4902-af62-541851c50292 tempest-ImagesNegativeTestJSON-1904451201 tempest-ImagesNegativeTestJSON-1904451201-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:24.847786 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-faa56cb3-31fc-4902-af62-541851c50292 tempest-ImagesNegativeTestJSON-1904451201 tempest-ImagesNegativeTestJSON-1904451201-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:24.848610 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-faa56cb3-31fc-4902-af62-541851c50292 tempest-ImagesNegativeTestJSON-1904451201 tempest-ImagesNegativeTestJSON-1904451201-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:24.849493 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-faa56cb3-31fc-4902-af62-541851c50292 tempest-ImagesNegativeTestJSON-1904451201 tempest-ImagesNegativeTestJSON-1904451201-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:24.852844 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-7e907820-554d-479a-9f11-60c949ff567a tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:24.854362 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-7e907820-554d-479a-9f11-60c949ff567a tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:24.855931 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-7e907820-554d-479a-9f11-60c949ff567a tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:24.861285 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-7e907820-554d-479a-9f11-60c949ff567a tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:24.863304 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-7e907820-554d-479a-9f11-60c949ff567a tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:24.864463 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-7e907820-554d-479a-9f11-60c949ff567a tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:25.038785 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-faa56cb3-31fc-4902-af62-541851c50292 tempest-ImagesNegativeTestJSON-1904451201 tempest-ImagesNegativeTestJSON-1904451201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c4a93c606cd4fc98c9b667bfc3d367b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68771d3adba04230a0fc3f69b50cc9b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:02:25.059576 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-faa56cb3-31fc-4902-af62-541851c50292 tempest-ImagesNegativeTestJSON-1904451201 tempest-ImagesNegativeTestJSON-1904451201-project] 10.222.0.13 "GET /compute/v2.1/servers/077786bf-b9d6-4b7e-9eb5-ce4612dcd945" status: 200 len: 1274 microversion: 2.1 time: 0.234282 Nov 01 19:02:25.073006 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1107/2216] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:02:24 2022] GET /compute/v2.1/servers/077786bf-b9d6-4b7e-9eb5-ce4612dcd945 => generated 1274 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:02:25.410509 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-51070140-f1d3-4e90-b975-2f1d6538ed5e tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:02:25.411128 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-51070140-f1d3-4e90-b975-2f1d6538ed5e tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] [instance: 4b9fb909-26f7-40af-bac5-e7d2a6b9fb77] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:02:25.423798 n-d-863052-2 devstack@n-api.service[121402]: DEBUG dbcounter [-] [121402] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=121402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 19:02:25.438214 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-51070140-f1d3-4e90-b975-2f1d6538ed5e tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:25.438717 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-51070140-f1d3-4e90-b975-2f1d6538ed5e tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:25.439157 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-51070140-f1d3-4e90-b975-2f1d6538ed5e tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:25.439882 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-51070140-f1d3-4e90-b975-2f1d6538ed5e tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:25.440338 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-51070140-f1d3-4e90-b975-2f1d6538ed5e tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:25.440799 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-51070140-f1d3-4e90-b975-2f1d6538ed5e tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:25.688093 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-7e907820-554d-479a-9f11-60c949ff567a tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f32f5fba1976432d938e664c7714e52b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b9d4c236b944f9b2e8e502a50a8f8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:02:25.708960 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-7e907820-554d-479a-9f11-60c949ff567a tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] 10.222.0.13 "GET /compute/v2.1/servers/de2ff806-a2fa-4390-b4d5-11ff24dd27ca" status: 200 len: 1498 microversion: 2.1 time: 0.882427 Nov 01 19:02:25.713461 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1110/2217] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:02:24 2022] GET /compute/v2.1/servers/de2ff806-a2fa-4390-b4d5-11ff24dd27ca => generated 1498 bytes in 891 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:02:25.730861 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [req-87c39bd5-aea0-44b6-bded-33e17fac9edf req-40d278af-d4b0-4400-aa9a-9844aa9972c7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "90b353ab-ef97-4d88-b5bc-b355ff576225", "tag": "773bb149-e7e8-4592-bede-bd40ac6e3e49"}]} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:02:25.779594 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-87c39bd5-aea0-44b6-bded-33e17fac9edf req-40d278af-d4b0-4400-aa9a-9844aa9972c7 service nova] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:25.781754 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-87c39bd5-aea0-44b6-bded-33e17fac9edf req-40d278af-d4b0-4400-aa9a-9844aa9972c7 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:25.782419 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-87c39bd5-aea0-44b6-bded-33e17fac9edf req-40d278af-d4b0-4400-aa9a-9844aa9972c7 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:25.815113 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.compute.server_external_events [req-87c39bd5-aea0-44b6-bded-33e17fac9edf req-40d278af-d4b0-4400-aa9a-9844aa9972c7 service nova] Creating event network-changed:773bb149-e7e8-4592-bede-bd40ac6e3e49 for instance 90b353ab-ef97-4d88-b5bc-b355ff576225 on n-h1-863052-2 Nov 01 19:02:25.832264 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [req-87c39bd5-aea0-44b6-bded-33e17fac9edf req-40d278af-d4b0-4400-aa9a-9844aa9972c7 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.116037 Nov 01 19:02:25.836476 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1111/2218] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Nov 1 19:02:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:02:25.865425 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [req-c5036168-72e3-4c7f-a934-6a5a72ee6db9 req-7525e1f4-057c-4f6c-996b-a67e9a69334c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4b9fb909-26f7-40af-bac5-e7d2a6b9fb77", "tag": "ccb0a9e2-46d4-4870-a9da-883c13baeb71"}, {"name": "network-changed", "server_uuid": "46a040e6-2750-47b4-b8e2-757b92f1adf1", "tag": "c8726629-64ec-4a3b-8076-8ad61393df33"}]} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:02:25.892737 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-c5036168-72e3-4c7f-a934-6a5a72ee6db9 req-7525e1f4-057c-4f6c-996b-a67e9a69334c service nova] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:25.898176 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-c5036168-72e3-4c7f-a934-6a5a72ee6db9 req-7525e1f4-057c-4f6c-996b-a67e9a69334c service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:25.898860 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-c5036168-72e3-4c7f-a934-6a5a72ee6db9 req-7525e1f4-057c-4f6c-996b-a67e9a69334c service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:25.930355 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.compute.server_external_events [req-c5036168-72e3-4c7f-a934-6a5a72ee6db9 req-7525e1f4-057c-4f6c-996b-a67e9a69334c service nova] Creating event network-changed:ccb0a9e2-46d4-4870-a9da-883c13baeb71 for instance 4b9fb909-26f7-40af-bac5-e7d2a6b9fb77 on n-h1-863052-2 Nov 01 19:02:25.930879 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.compute.server_external_events [req-c5036168-72e3-4c7f-a934-6a5a72ee6db9 req-7525e1f4-057c-4f6c-996b-a67e9a69334c service nova] Creating event network-changed:c8726629-64ec-4a3b-8076-8ad61393df33 for instance 46a040e6-2750-47b4-b8e2-757b92f1adf1 on n-h1-863052-2 Nov 01 19:02:25.958638 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [req-c5036168-72e3-4c7f-a934-6a5a72ee6db9 req-7525e1f4-057c-4f6c-996b-a67e9a69334c service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.120632 Nov 01 19:02:25.961101 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1112/2219] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Nov 1 19:02:25 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:02:25.971375 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-20761743-205a-4577-8e47-ae0ac1409b86 tempest-ServersTestBootFromVolume-877599095 tempest-ServersTestBootFromVolume-877599095-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:02:25.974312 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-20761743-205a-4577-8e47-ae0ac1409b86 tempest-ServersTestBootFromVolume-877599095 tempest-ServersTestBootFromVolume-877599095-project] [instance: 44cdf0d8-969b-4149-bb03-6bc390977019] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:02:25.993580 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-20761743-205a-4577-8e47-ae0ac1409b86 tempest-ServersTestBootFromVolume-877599095 tempest-ServersTestBootFromVolume-877599095-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:25.994066 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-20761743-205a-4577-8e47-ae0ac1409b86 tempest-ServersTestBootFromVolume-877599095 tempest-ServersTestBootFromVolume-877599095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:26.001653 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-20761743-205a-4577-8e47-ae0ac1409b86 tempest-ServersTestBootFromVolume-877599095 tempest-ServersTestBootFromVolume-877599095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:26.012004 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-20761743-205a-4577-8e47-ae0ac1409b86 tempest-ServersTestBootFromVolume-877599095 tempest-ServersTestBootFromVolume-877599095-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:26.015129 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-20761743-205a-4577-8e47-ae0ac1409b86 tempest-ServersTestBootFromVolume-877599095 tempest-ServersTestBootFromVolume-877599095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:26.018605 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-20761743-205a-4577-8e47-ae0ac1409b86 tempest-ServersTestBootFromVolume-877599095 tempest-ServersTestBootFromVolume-877599095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:26.486697 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-51070140-f1d3-4e90-b975-2f1d6538ed5e tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52acef7992d64d378fd8ac333887fd0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af51b8733e984c2ca87df2d8163dedf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:02:26.500761 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-51070140-f1d3-4e90-b975-2f1d6538ed5e tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] 10.222.0.13 "GET /compute/v2.1/servers/4b9fb909-26f7-40af-bac5-e7d2a6b9fb77" status: 200 len: 1354 microversion: 2.1 time: 1.091967 Nov 01 19:02:26.502687 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1108/2220] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:02:25 2022] GET /compute/v2.1/servers/4b9fb909-26f7-40af-bac5-e7d2a6b9fb77 => generated 1354 bytes in 1097 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 19:02:26.513496 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-dba76a48-2d0d-456e-ae9f-d9e1f9260117 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:02:26.514676 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-dba76a48-2d0d-456e-ae9f-d9e1f9260117 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] [instance: 46a040e6-2750-47b4-b8e2-757b92f1adf1] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:02:26.542782 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-dba76a48-2d0d-456e-ae9f-d9e1f9260117 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:26.548527 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-dba76a48-2d0d-456e-ae9f-d9e1f9260117 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:26.549163 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-dba76a48-2d0d-456e-ae9f-d9e1f9260117 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:26.552243 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-dba76a48-2d0d-456e-ae9f-d9e1f9260117 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:26.557541 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-dba76a48-2d0d-456e-ae9f-d9e1f9260117 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:26.558065 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-dba76a48-2d0d-456e-ae9f-d9e1f9260117 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:27.054059 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-20761743-205a-4577-8e47-ae0ac1409b86 tempest-ServersTestBootFromVolume-877599095 tempest-ServersTestBootFromVolume-877599095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed2352ce53fc4045adde8cd81b78b3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651046528c204df299ca3d14c44b4a7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:02:27.066565 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-20761743-205a-4577-8e47-ae0ac1409b86 tempest-ServersTestBootFromVolume-877599095 tempest-ServersTestBootFromVolume-877599095-project] 10.222.0.13 "GET /compute/v2.1/servers/44cdf0d8-969b-4149-bb03-6bc390977019" status: 200 len: 1304 microversion: 2.1 time: 1.104178 Nov 01 19:02:27.091069 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1113/2221] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:02:25 2022] GET /compute/v2.1/servers/44cdf0d8-969b-4149-bb03-6bc390977019 => generated 1304 bytes in 1128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:02:27.107212 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-9d8e80c1-e393-43a2-a29a-2dfd3e42c717 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:02:27.108797 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-9d8e80c1-e393-43a2-a29a-2dfd3e42c717 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] [instance: cd879708-f757-4f88-bc95-38b6cd55363c] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:02:27.127711 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-9d8e80c1-e393-43a2-a29a-2dfd3e42c717 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:27.128750 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-9d8e80c1-e393-43a2-a29a-2dfd3e42c717 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:27.129463 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-9d8e80c1-e393-43a2-a29a-2dfd3e42c717 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:27.130391 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-9d8e80c1-e393-43a2-a29a-2dfd3e42c717 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:27.131951 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-9d8e80c1-e393-43a2-a29a-2dfd3e42c717 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:27.132610 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-9d8e80c1-e393-43a2-a29a-2dfd3e42c717 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:27.154108 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.wsgi [None req-9d8e80c1-e393-43a2-a29a-2dfd3e42c717 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] HTTP exception thrown: Instance cd879708-f757-4f88-bc95-38b6cd55363c could not be found. Nov 01 19:02:27.156414 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-9d8e80c1-e393-43a2-a29a-2dfd3e42c717 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Request method failure captured: Nov 01 19:02:27.156414 n-d-863052-2 devstack@n-api.service[121403]: request: GET /compute/v2.1/servers/cd879708-f757-4f88-bc95-38b6cd55363c HTTP/1.1 Nov 01 19:02:27.156414 n-d-863052-2 devstack@n-api.service[121403]: Accept: application/json Nov 01 19:02:27.156414 n-d-863052-2 devstack@n-api.service[121403]: Accept-Encoding: identity Nov 01 19:02:27.156414 n-d-863052-2 devstack@n-api.service[121403]: Connection: close Nov 01 19:02:27.156414 n-d-863052-2 devstack@n-api.service[121403]: Content-Length: 0 Nov 01 19:02:27.156414 n-d-863052-2 devstack@n-api.service[121403]: Content-Type: application/json Nov 01 19:02:27.156414 n-d-863052-2 devstack@n-api.service[121403]: Host: 10.222.0.13 Nov 01 19:02:27.156414 n-d-863052-2 devstack@n-api.service[121403]: Openstack-System-Scope: None Nov 01 19:02:27.156414 n-d-863052-2 devstack@n-api.service[121403]: User-Agent: python-urllib3/1.26.12 Nov 01 19:02:27.156414 n-d-863052-2 devstack@n-api.service[121403]: X-Auth-Token: gAAAAABjYWuXbvFs9aS-AI-YunBpI7JW1G7TtGj9lNPX9_m5x7yvx5NDb5_8tZxcZ9OJEVvcArKsi1gBG0i_m2a-mPBO8TJfCOQY2BcBWVVWE6IstJB3B2-12IsAPiHj9lscAGshtM26YMMYwGnt2-cysTVDO07JS8LPF_YKr1_xNELllwy_Puk Nov 01 19:02:27.156414 n-d-863052-2 devstack@n-api.service[121403]: X-Domain-Id: None Nov 01 19:02:27.156414 n-d-863052-2 devstack@n-api.service[121403]: X-Domain-Name: None Nov 01 19:02:27.156414 n-d-863052-2 devstack@n-api.service[121403]: X-Identity-Status: Confirmed Nov 01 19:02:27.156414 n-d-863052-2 devstack@n-api.service[121403]: X-Is-Admin-Project: True Nov 01 19:02:27.156414 n-d-863052-2 devstack@n-api.service[121403]: X-Openstack-Nova-Api-Version: 2.25 Nov 01 19:02:27.156414 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Domain-Id: default Nov 01 19:02:27.156414 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Domain-Name: Default Nov 01 19:02:27.156414 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Id: 75730f90ec924cbebd605d6d6d747efe Nov 01 19:02:27.156414 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-1114814424 Nov 01 19:02:27.156414 n-d-863052-2 devstack@n-api.service[121403]: X-Role: member,reader Nov 01 19:02:27.156414 n-d-863052-2 devstack@n-api.service[121403]: X-Roles: member,reader Nov 01 19:02:27.156414 n-d-863052-2 devstack@n-api.service[121403]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/75730f90ec924cbebd605d6d6d747efe"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/75730f90ec924cbebd605d6d6d747efe"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_75730f90ec924cbebd605d6d6d747efe", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/75730f90ec924cbebd605d6d6d747efe"}]}] Nov 01 19:02:27.156414 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-1114814424 Nov 01 19:02:27.156414 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant-Id: 75730f90ec924cbebd605d6d6d747efe Nov 01 19:02:27.156414 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-1114814424 Nov 01 19:02:27.156414 n-d-863052-2 devstack@n-api.service[121403]: X-User: tempest-LiveAutoBlockMigrationV225Test-1114814424-project Nov 01 19:02:27.156414 n-d-863052-2 devstack@n-api.service[121403]: X-User-Domain-Id: default Nov 01 19:02:27.156414 n-d-863052-2 devstack@n-api.service[121403]: X-User-Domain-Name: Default Nov 01 19:02:27.156414 n-d-863052-2 devstack@n-api.service[121403]: X-User-Id: c2ddf0211c374fe2a0db89546beb8e96 Nov 01 19:02:27.156414 n-d-863052-2 devstack@n-api.service[121403]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-1114814424-project Nov 01 19:02:27.156414 n-d-863052-2 devstack@n-api.service[121403]: method: > Nov 01 19:02:27.156414 n-d-863052-2 devstack@n-api.service[121403]: exception: Instance cd879708-f757-4f88-bc95-38b6cd55363c could not be found. Nov 01 19:02:27.156414 n-d-863052-2 devstack@n-api.service[121403]: action_args: {'id': 'cd879708-f757-4f88-bc95-38b6cd55363c'} Nov 01 19:02:27.156414 n-d-863052-2 devstack@n-api.service[121403]: {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 01 19:02:27.156414 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:02:27.156414 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 01 19:02:27.156414 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 01 19:02:27.156414 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 01 19:02:27.156414 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 01 19:02:27.156414 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 01 19:02:27.156414 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 01 19:02:27.156414 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 01 19:02:27.156414 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 01 19:02:27.156414 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cd879708-f757-4f88-bc95-38b6cd55363c could not be found. Nov 01 19:02:27.156414 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:02:27.156414 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:02:27.156414 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:02:27.156414 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:02:27.156414 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:02:27.156414 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:02:27.156414 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 01 19:02:27.156414 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 01 19:02:27.156414 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 01 19:02:27.156414 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 01 19:02:27.156414 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 01 19:02:27.156414 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 01 19:02:27.156414 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 01 19:02:27.156414 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 01 19:02:27.156414 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 01 19:02:27.156414 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 01 19:02:27.156414 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cd879708-f757-4f88-bc95-38b6cd55363c could not be found. Nov 01 19:02:27.156414 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:02:27.161881 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:02:27.161881 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:02:27.161881 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:02:27.161881 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:02:27.161881 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:02:27.161881 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 01 19:02:27.161881 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 01 19:02:27.161881 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cd879708-f757-4f88-bc95-38b6cd55363c could not be found. Nov 01 19:02:27.161881 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:02:27.163976 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-9d8e80c1-e393-43a2-a29a-2dfd3e42c717 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Returning 404 to user: Instance cd879708-f757-4f88-bc95-38b6cd55363c could not be found. {{(pid=121403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 01 19:02:27.165244 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-9d8e80c1-e393-43a2-a29a-2dfd3e42c717 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] 10.222.0.13 "GET /compute/v2.1/servers/cd879708-f757-4f88-bc95-38b6cd55363c" status: 404 len: 111 microversion: 2.25 time: 0.072055 Nov 01 19:02:27.166600 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1114/2222] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 19:02:27 2022] GET /compute/v2.1/servers/cd879708-f757-4f88-bc95-38b6cd55363c => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 01 19:02:27.172767 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-38b67434-3574-41cd-b4aa-476c22e49e48 tempest-ImagesNegativeTestJSON-1904451201 tempest-ImagesNegativeTestJSON-1904451201-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:02:27.173566 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-38b67434-3574-41cd-b4aa-476c22e49e48 tempest-ImagesNegativeTestJSON-1904451201 tempest-ImagesNegativeTestJSON-1904451201-project] [instance: 077786bf-b9d6-4b7e-9eb5-ce4612dcd945] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:02:27.182914 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-38b67434-3574-41cd-b4aa-476c22e49e48 tempest-ImagesNegativeTestJSON-1904451201 tempest-ImagesNegativeTestJSON-1904451201-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:27.183647 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-38b67434-3574-41cd-b4aa-476c22e49e48 tempest-ImagesNegativeTestJSON-1904451201 tempest-ImagesNegativeTestJSON-1904451201-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:27.184266 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-38b67434-3574-41cd-b4aa-476c22e49e48 tempest-ImagesNegativeTestJSON-1904451201 tempest-ImagesNegativeTestJSON-1904451201-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:27.185667 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-38b67434-3574-41cd-b4aa-476c22e49e48 tempest-ImagesNegativeTestJSON-1904451201 tempest-ImagesNegativeTestJSON-1904451201-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:27.187664 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-38b67434-3574-41cd-b4aa-476c22e49e48 tempest-ImagesNegativeTestJSON-1904451201 tempest-ImagesNegativeTestJSON-1904451201-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:27.188292 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-38b67434-3574-41cd-b4aa-476c22e49e48 tempest-ImagesNegativeTestJSON-1904451201 tempest-ImagesNegativeTestJSON-1904451201-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:27.200609 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-dba76a48-2d0d-456e-ae9f-d9e1f9260117 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb496b3faac4abbae73d389f2042e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e2520220d454764b8c139a58d78ac83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:02:27.217175 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-dba76a48-2d0d-456e-ae9f-d9e1f9260117 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] 10.222.0.13 "GET /compute/v2.1/servers/46a040e6-2750-47b4-b8e2-757b92f1adf1" status: 200 len: 1314 microversion: 2.1 time: 0.712521 Nov 01 19:02:27.217799 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1109/2223] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:02:26 2022] GET /compute/v2.1/servers/46a040e6-2750-47b4-b8e2-757b92f1adf1 => generated 1314 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:02:27.237435 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-e54e2ae9-d320-4b77-a54d-870d7e92ac29 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:02:27.238055 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-e54e2ae9-d320-4b77-a54d-870d7e92ac29 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] [instance: de2ff806-a2fa-4390-b4d5-11ff24dd27ca] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:02:27.261320 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e54e2ae9-d320-4b77-a54d-870d7e92ac29 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:27.263235 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e54e2ae9-d320-4b77-a54d-870d7e92ac29 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:27.263914 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e54e2ae9-d320-4b77-a54d-870d7e92ac29 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:27.265013 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e54e2ae9-d320-4b77-a54d-870d7e92ac29 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:27.267844 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e54e2ae9-d320-4b77-a54d-870d7e92ac29 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:27.268481 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e54e2ae9-d320-4b77-a54d-870d7e92ac29 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:27.290815 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.wsgi [None req-e54e2ae9-d320-4b77-a54d-870d7e92ac29 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] HTTP exception thrown: Instance de2ff806-a2fa-4390-b4d5-11ff24dd27ca could not be found. Nov 01 19:02:27.293031 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-e54e2ae9-d320-4b77-a54d-870d7e92ac29 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Request method failure captured: Nov 01 19:02:27.293031 n-d-863052-2 devstack@n-api.service[121402]: request: GET /compute/v2.1/servers/de2ff806-a2fa-4390-b4d5-11ff24dd27ca HTTP/1.1 Nov 01 19:02:27.293031 n-d-863052-2 devstack@n-api.service[121402]: Accept: application/json Nov 01 19:02:27.293031 n-d-863052-2 devstack@n-api.service[121402]: Accept-Encoding: identity Nov 01 19:02:27.293031 n-d-863052-2 devstack@n-api.service[121402]: Connection: close Nov 01 19:02:27.293031 n-d-863052-2 devstack@n-api.service[121402]: Content-Length: 0 Nov 01 19:02:27.293031 n-d-863052-2 devstack@n-api.service[121402]: Content-Type: application/json Nov 01 19:02:27.293031 n-d-863052-2 devstack@n-api.service[121402]: Host: 10.222.0.13 Nov 01 19:02:27.293031 n-d-863052-2 devstack@n-api.service[121402]: Openstack-System-Scope: None Nov 01 19:02:27.293031 n-d-863052-2 devstack@n-api.service[121402]: User-Agent: python-urllib3/1.26.12 Nov 01 19:02:27.293031 n-d-863052-2 devstack@n-api.service[121402]: X-Auth-Token: gAAAAABjYWt-NQXke2xaT5Zx7jRYabVG4ahAkm8OML59W5vfFJqbwex-J1ZiLL497voaQvk8mxYaO51_Dy7DE73iezGuKz14bZTbSfTjEO0SNQwkG26Td9pn2M3Cq9W9_GYL5mCba8SZ_e1faAE8WJGSrhBj4wfU4ft8jddNlfpfKRiwGV7JCoo Nov 01 19:02:27.293031 n-d-863052-2 devstack@n-api.service[121402]: X-Domain-Id: None Nov 01 19:02:27.293031 n-d-863052-2 devstack@n-api.service[121402]: X-Domain-Name: None Nov 01 19:02:27.293031 n-d-863052-2 devstack@n-api.service[121402]: X-Identity-Status: Confirmed Nov 01 19:02:27.293031 n-d-863052-2 devstack@n-api.service[121402]: X-Is-Admin-Project: True Nov 01 19:02:27.293031 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Domain-Id: default Nov 01 19:02:27.293031 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Domain-Name: Default Nov 01 19:02:27.293031 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Id: d9b9d4c236b944f9b2e8e502a50a8f8b Nov 01 19:02:27.293031 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Name: tempest-LiveMigrationTest-1986167696 Nov 01 19:02:27.293031 n-d-863052-2 devstack@n-api.service[121402]: X-Role: member,reader Nov 01 19:02:27.293031 n-d-863052-2 devstack@n-api.service[121402]: X-Roles: member,reader Nov 01 19:02:27.293031 n-d-863052-2 devstack@n-api.service[121402]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/d9b9d4c236b944f9b2e8e502a50a8f8b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/d9b9d4c236b944f9b2e8e502a50a8f8b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_d9b9d4c236b944f9b2e8e502a50a8f8b", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/d9b9d4c236b944f9b2e8e502a50a8f8b"}]}] Nov 01 19:02:27.293031 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant: tempest-LiveMigrationTest-1986167696 Nov 01 19:02:27.293031 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant-Id: d9b9d4c236b944f9b2e8e502a50a8f8b Nov 01 19:02:27.293031 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant-Name: tempest-LiveMigrationTest-1986167696 Nov 01 19:02:27.293031 n-d-863052-2 devstack@n-api.service[121402]: X-User: tempest-LiveMigrationTest-1986167696-project Nov 01 19:02:27.293031 n-d-863052-2 devstack@n-api.service[121402]: X-User-Domain-Id: default Nov 01 19:02:27.293031 n-d-863052-2 devstack@n-api.service[121402]: X-User-Domain-Name: Default Nov 01 19:02:27.293031 n-d-863052-2 devstack@n-api.service[121402]: X-User-Id: f32f5fba1976432d938e664c7714e52b Nov 01 19:02:27.293031 n-d-863052-2 devstack@n-api.service[121402]: X-User-Name: tempest-LiveMigrationTest-1986167696-project Nov 01 19:02:27.293031 n-d-863052-2 devstack@n-api.service[121402]: method: > Nov 01 19:02:27.293031 n-d-863052-2 devstack@n-api.service[121402]: exception: Instance de2ff806-a2fa-4390-b4d5-11ff24dd27ca could not be found. Nov 01 19:02:27.293031 n-d-863052-2 devstack@n-api.service[121402]: action_args: {'id': 'de2ff806-a2fa-4390-b4d5-11ff24dd27ca'} Nov 01 19:02:27.293031 n-d-863052-2 devstack@n-api.service[121402]: {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 01 19:02:27.293031 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:02:27.293031 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 01 19:02:27.293031 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 01 19:02:27.293031 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 01 19:02:27.293031 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 01 19:02:27.293031 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 01 19:02:27.293031 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 01 19:02:27.293031 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 01 19:02:27.293031 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 01 19:02:27.293031 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance de2ff806-a2fa-4390-b4d5-11ff24dd27ca could not be found. Nov 01 19:02:27.293031 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:02:27.293031 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:02:27.293031 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:02:27.293031 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:02:27.293031 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:02:27.293031 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:02:27.293031 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 01 19:02:27.293031 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 01 19:02:27.293031 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 01 19:02:27.293031 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 01 19:02:27.293031 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 01 19:02:27.293031 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 01 19:02:27.293031 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 01 19:02:27.293031 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 01 19:02:27.293031 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 01 19:02:27.293031 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 01 19:02:27.293031 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance de2ff806-a2fa-4390-b4d5-11ff24dd27ca could not be found. Nov 01 19:02:27.293031 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:02:27.293031 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:02:27.293031 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:02:27.298503 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:02:27.298503 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:02:27.298503 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:02:27.298503 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 01 19:02:27.298503 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 01 19:02:27.298503 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance de2ff806-a2fa-4390-b4d5-11ff24dd27ca could not be found. Nov 01 19:02:27.298503 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:02:27.300557 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-e54e2ae9-d320-4b77-a54d-870d7e92ac29 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] Returning 404 to user: Instance de2ff806-a2fa-4390-b4d5-11ff24dd27ca could not be found. {{(pid=121402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 01 19:02:27.301691 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-e54e2ae9-d320-4b77-a54d-870d7e92ac29 tempest-LiveMigrationTest-1986167696 tempest-LiveMigrationTest-1986167696-project] 10.222.0.13 "GET /compute/v2.1/servers/de2ff806-a2fa-4390-b4d5-11ff24dd27ca" status: 404 len: 111 microversion: 2.1 time: 0.082999 Nov 01 19:02:27.302957 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1110/2224] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:02:27 2022] GET /compute/v2.1/servers/de2ff806-a2fa-4390-b4d5-11ff24dd27ca => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 01 19:02:27.367842 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-38b67434-3574-41cd-b4aa-476c22e49e48 tempest-ImagesNegativeTestJSON-1904451201 tempest-ImagesNegativeTestJSON-1904451201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c4a93c606cd4fc98c9b667bfc3d367b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68771d3adba04230a0fc3f69b50cc9b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:02:27.379839 n-d-863052-2 devstack@n-api.service[121403]: DEBUG dbcounter [-] [121403] Writing DB stats nova_cell1:SELECT=100 {{(pid=121403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 19:02:27.388988 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-38b67434-3574-41cd-b4aa-476c22e49e48 tempest-ImagesNegativeTestJSON-1904451201 tempest-ImagesNegativeTestJSON-1904451201-project] 10.222.0.13 "GET /compute/v2.1/servers/077786bf-b9d6-4b7e-9eb5-ce4612dcd945" status: 200 len: 1274 microversion: 2.1 time: 0.220119 Nov 01 19:02:27.391860 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1115/2225] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:02:27 2022] GET /compute/v2.1/servers/077786bf-b9d6-4b7e-9eb5-ce4612dcd945 => generated 1274 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:02:27.531652 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-e7a376f6-be73-4168-99b6-85982b9fc8fb tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:02:27.534985 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-e7a376f6-be73-4168-99b6-85982b9fc8fb tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] [instance: 4b9fb909-26f7-40af-bac5-e7d2a6b9fb77] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:02:27.560854 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e7a376f6-be73-4168-99b6-85982b9fc8fb tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:27.561615 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e7a376f6-be73-4168-99b6-85982b9fc8fb tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:27.562075 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e7a376f6-be73-4168-99b6-85982b9fc8fb tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:27.562802 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e7a376f6-be73-4168-99b6-85982b9fc8fb tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:27.563261 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e7a376f6-be73-4168-99b6-85982b9fc8fb tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:27.570519 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e7a376f6-be73-4168-99b6-85982b9fc8fb tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:27.989912 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [req-ea8477ab-2389-422c-ac17-2ede8707c264 req-dcb4121d-dc77-4c6f-bbe4-d837cbd81351 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "de2ff806-a2fa-4390-b4d5-11ff24dd27ca", "name": "network-vif-deleted", "tag": "4157a71a-6529-42b5-9194-408c1d22d219"}]} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:02:28.012762 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-ea8477ab-2389-422c-ac17-2ede8707c264 req-dcb4121d-dc77-4c6f-bbe4-d837cbd81351 service nova] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:28.014112 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-ea8477ab-2389-422c-ac17-2ede8707c264 req-dcb4121d-dc77-4c6f-bbe4-d837cbd81351 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:28.015782 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-ea8477ab-2389-422c-ac17-2ede8707c264 req-dcb4121d-dc77-4c6f-bbe4-d837cbd81351 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:28.042158 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.compute.server_external_events [req-ea8477ab-2389-422c-ac17-2ede8707c264 req-dcb4121d-dc77-4c6f-bbe4-d837cbd81351 service nova] Creating event network-vif-deleted:4157a71a-6529-42b5-9194-408c1d22d219 for instance de2ff806-a2fa-4390-b4d5-11ff24dd27ca on n-h2-863052-2 Nov 01 19:02:28.048256 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [req-ea8477ab-2389-422c-ac17-2ede8707c264 req-dcb4121d-dc77-4c6f-bbe4-d837cbd81351 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062336 Nov 01 19:02:28.049824 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1116/2226] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Nov 1 19:02:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:02:28.101288 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-d2f82d71-cad9-4c9c-ba4e-97d77de0ea62 tempest-ServersTestBootFromVolume-877599095 tempest-ServersTestBootFromVolume-877599095-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:02:28.102385 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-d2f82d71-cad9-4c9c-ba4e-97d77de0ea62 tempest-ServersTestBootFromVolume-877599095 tempest-ServersTestBootFromVolume-877599095-project] [instance: 44cdf0d8-969b-4149-bb03-6bc390977019] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:02:28.110603 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d2f82d71-cad9-4c9c-ba4e-97d77de0ea62 tempest-ServersTestBootFromVolume-877599095 tempest-ServersTestBootFromVolume-877599095-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:28.111702 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d2f82d71-cad9-4c9c-ba4e-97d77de0ea62 tempest-ServersTestBootFromVolume-877599095 tempest-ServersTestBootFromVolume-877599095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:28.112154 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d2f82d71-cad9-4c9c-ba4e-97d77de0ea62 tempest-ServersTestBootFromVolume-877599095 tempest-ServersTestBootFromVolume-877599095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:28.113170 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d2f82d71-cad9-4c9c-ba4e-97d77de0ea62 tempest-ServersTestBootFromVolume-877599095 tempest-ServersTestBootFromVolume-877599095-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:28.113901 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d2f82d71-cad9-4c9c-ba4e-97d77de0ea62 tempest-ServersTestBootFromVolume-877599095 tempest-ServersTestBootFromVolume-877599095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:28.114343 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d2f82d71-cad9-4c9c-ba4e-97d77de0ea62 tempest-ServersTestBootFromVolume-877599095 tempest-ServersTestBootFromVolume-877599095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:28.753349 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-e7a376f6-be73-4168-99b6-85982b9fc8fb tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52acef7992d64d378fd8ac333887fd0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af51b8733e984c2ca87df2d8163dedf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:02:28.756648 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-d2f82d71-cad9-4c9c-ba4e-97d77de0ea62 tempest-ServersTestBootFromVolume-877599095 tempest-ServersTestBootFromVolume-877599095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed2352ce53fc4045adde8cd81b78b3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651046528c204df299ca3d14c44b4a7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:02:28.768055 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-e7a376f6-be73-4168-99b6-85982b9fc8fb tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] 10.222.0.13 "GET /compute/v2.1/servers/4b9fb909-26f7-40af-bac5-e7d2a6b9fb77" status: 200 len: 1354 microversion: 2.1 time: 1.241534 Nov 01 19:02:28.769925 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1111/2227] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:02:27 2022] GET /compute/v2.1/servers/4b9fb909-26f7-40af-bac5-e7d2a6b9fb77 => generated 1354 bytes in 1245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:02:28.773782 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-d2f82d71-cad9-4c9c-ba4e-97d77de0ea62 tempest-ServersTestBootFromVolume-877599095 tempest-ServersTestBootFromVolume-877599095-project] 10.222.0.13 "GET /compute/v2.1/servers/44cdf0d8-969b-4149-bb03-6bc390977019" status: 200 len: 1304 microversion: 2.1 time: 0.679758 Nov 01 19:02:28.774367 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1117/2228] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:02:28 2022] GET /compute/v2.1/servers/44cdf0d8-969b-4149-bb03-6bc390977019 => generated 1304 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:02:28.776456 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-98abbca3-5168-459d-84f0-b992fd18a9f4 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:02:28.777590 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-98abbca3-5168-459d-84f0-b992fd18a9f4 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] [instance: 46a040e6-2750-47b4-b8e2-757b92f1adf1] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:02:28.778669 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [req-0d36c968-15fd-4fcb-a2ab-d3d583cdfb69 req-459d95a5-f305-4130-9695-a1f49757b926 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "90b353ab-ef97-4d88-b5bc-b355ff576225", "tag": "773bb149-e7e8-4592-bede-bd40ac6e3e49"}]} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:02:28.788046 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-98abbca3-5168-459d-84f0-b992fd18a9f4 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:28.789909 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-98abbca3-5168-459d-84f0-b992fd18a9f4 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:28.791866 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-98abbca3-5168-459d-84f0-b992fd18a9f4 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:28.792965 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-98abbca3-5168-459d-84f0-b992fd18a9f4 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:28.793592 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-98abbca3-5168-459d-84f0-b992fd18a9f4 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:28.794861 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-98abbca3-5168-459d-84f0-b992fd18a9f4 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:28.800412 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-0d36c968-15fd-4fcb-a2ab-d3d583cdfb69 req-459d95a5-f305-4130-9695-a1f49757b926 service nova] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:28.801180 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-0d36c968-15fd-4fcb-a2ab-d3d583cdfb69 req-459d95a5-f305-4130-9695-a1f49757b926 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:28.801801 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-0d36c968-15fd-4fcb-a2ab-d3d583cdfb69 req-459d95a5-f305-4130-9695-a1f49757b926 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:28.825326 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.compute.server_external_events [req-0d36c968-15fd-4fcb-a2ab-d3d583cdfb69 req-459d95a5-f305-4130-9695-a1f49757b926 service nova] Creating event network-changed:773bb149-e7e8-4592-bede-bd40ac6e3e49 for instance 90b353ab-ef97-4d88-b5bc-b355ff576225 on n-h1-863052-2 Nov 01 19:02:28.832126 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [req-0d36c968-15fd-4fcb-a2ab-d3d583cdfb69 req-459d95a5-f305-4130-9695-a1f49757b926 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056559 Nov 01 19:02:28.833045 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1118/2229] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Nov 1 19:02:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:02:28.839764 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-6cbe1b73-6d0e-42f9-af30-6be46229cca0 tempest-ImagesNegativeTestJSON-1904451201 tempest-ImagesNegativeTestJSON-1904451201-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:02:28.840705 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-6cbe1b73-6d0e-42f9-af30-6be46229cca0 tempest-ImagesNegativeTestJSON-1904451201 tempest-ImagesNegativeTestJSON-1904451201-project] [instance: 077786bf-b9d6-4b7e-9eb5-ce4612dcd945] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:02:28.855261 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-6cbe1b73-6d0e-42f9-af30-6be46229cca0 tempest-ImagesNegativeTestJSON-1904451201 tempest-ImagesNegativeTestJSON-1904451201-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:28.855818 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-6cbe1b73-6d0e-42f9-af30-6be46229cca0 tempest-ImagesNegativeTestJSON-1904451201 tempest-ImagesNegativeTestJSON-1904451201-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:28.856215 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-6cbe1b73-6d0e-42f9-af30-6be46229cca0 tempest-ImagesNegativeTestJSON-1904451201 tempest-ImagesNegativeTestJSON-1904451201-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:28.856989 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-6cbe1b73-6d0e-42f9-af30-6be46229cca0 tempest-ImagesNegativeTestJSON-1904451201 tempest-ImagesNegativeTestJSON-1904451201-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:28.857425 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-6cbe1b73-6d0e-42f9-af30-6be46229cca0 tempest-ImagesNegativeTestJSON-1904451201 tempest-ImagesNegativeTestJSON-1904451201-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:28.865176 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-6cbe1b73-6d0e-42f9-af30-6be46229cca0 tempest-ImagesNegativeTestJSON-1904451201 tempest-ImagesNegativeTestJSON-1904451201-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:29.098187 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-98abbca3-5168-459d-84f0-b992fd18a9f4 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb496b3faac4abbae73d389f2042e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e2520220d454764b8c139a58d78ac83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:02:29.106801 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-98abbca3-5168-459d-84f0-b992fd18a9f4 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] 10.222.0.13 "GET /compute/v2.1/servers/46a040e6-2750-47b4-b8e2-757b92f1adf1" status: 200 len: 1314 microversion: 2.1 time: 0.335149 Nov 01 19:02:29.107395 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1112/2230] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:02:28 2022] GET /compute/v2.1/servers/46a040e6-2750-47b4-b8e2-757b92f1adf1 => generated 1314 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:02:29.197049 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-6cbe1b73-6d0e-42f9-af30-6be46229cca0 tempest-ImagesNegativeTestJSON-1904451201 tempest-ImagesNegativeTestJSON-1904451201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c4a93c606cd4fc98c9b667bfc3d367b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68771d3adba04230a0fc3f69b50cc9b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:02:29.210842 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-6cbe1b73-6d0e-42f9-af30-6be46229cca0 tempest-ImagesNegativeTestJSON-1904451201 tempest-ImagesNegativeTestJSON-1904451201-project] 10.222.0.13 "GET /compute/v2.1/servers/077786bf-b9d6-4b7e-9eb5-ce4612dcd945" status: 200 len: 1316 microversion: 2.1 time: 0.375998 Nov 01 19:02:29.213242 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1119/2231] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:02:28 2022] GET /compute/v2.1/servers/077786bf-b9d6-4b7e-9eb5-ce4612dcd945 => generated 1316 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:02:29.795350 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-0c1709ea-739c-4a5b-abb9-d0a9a3b0d114 tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:02:29.796262 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-0c1709ea-739c-4a5b-abb9-d0a9a3b0d114 tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] [instance: 4b9fb909-26f7-40af-bac5-e7d2a6b9fb77] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:02:29.796761 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-a639dbcf-cfe0-4b37-ad95-7c65452bb7df tempest-ServersTestBootFromVolume-877599095 tempest-ServersTestBootFromVolume-877599095-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:02:29.797383 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-a639dbcf-cfe0-4b37-ad95-7c65452bb7df tempest-ServersTestBootFromVolume-877599095 tempest-ServersTestBootFromVolume-877599095-project] [instance: 44cdf0d8-969b-4149-bb03-6bc390977019] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:02:29.807410 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-0c1709ea-739c-4a5b-abb9-d0a9a3b0d114 tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:29.808326 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-0c1709ea-739c-4a5b-abb9-d0a9a3b0d114 tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:29.808977 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-0c1709ea-739c-4a5b-abb9-d0a9a3b0d114 tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:29.809862 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-0c1709ea-739c-4a5b-abb9-d0a9a3b0d114 tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:29.813020 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-0c1709ea-739c-4a5b-abb9-d0a9a3b0d114 tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:29.813670 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-0c1709ea-739c-4a5b-abb9-d0a9a3b0d114 tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:29.813876 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-a639dbcf-cfe0-4b37-ad95-7c65452bb7df tempest-ServersTestBootFromVolume-877599095 tempest-ServersTestBootFromVolume-877599095-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:29.814417 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-a639dbcf-cfe0-4b37-ad95-7c65452bb7df tempest-ServersTestBootFromVolume-877599095 tempest-ServersTestBootFromVolume-877599095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:29.815013 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-a639dbcf-cfe0-4b37-ad95-7c65452bb7df tempest-ServersTestBootFromVolume-877599095 tempest-ServersTestBootFromVolume-877599095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:29.815755 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-a639dbcf-cfe0-4b37-ad95-7c65452bb7df tempest-ServersTestBootFromVolume-877599095 tempest-ServersTestBootFromVolume-877599095-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:29.816213 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-a639dbcf-cfe0-4b37-ad95-7c65452bb7df tempest-ServersTestBootFromVolume-877599095 tempest-ServersTestBootFromVolume-877599095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:29.816660 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-a639dbcf-cfe0-4b37-ad95-7c65452bb7df tempest-ServersTestBootFromVolume-877599095 tempest-ServersTestBootFromVolume-877599095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:30.310369 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-0c1709ea-739c-4a5b-abb9-d0a9a3b0d114 tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52acef7992d64d378fd8ac333887fd0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af51b8733e984c2ca87df2d8163dedf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:02:30.324219 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-0c1709ea-739c-4a5b-abb9-d0a9a3b0d114 tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] 10.222.0.13 "GET /compute/v2.1/servers/4b9fb909-26f7-40af-bac5-e7d2a6b9fb77" status: 200 len: 1354 microversion: 2.1 time: 0.532592 Nov 01 19:02:30.325345 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1120/2232] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:02:29 2022] GET /compute/v2.1/servers/4b9fb909-26f7-40af-bac5-e7d2a6b9fb77 => generated 1354 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 19:02:30.338218 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-e8064476-8d70-49b4-91e7-5bf7aebb3210 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:02:30.340992 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-e8064476-8d70-49b4-91e7-5bf7aebb3210 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] [instance: 46a040e6-2750-47b4-b8e2-757b92f1adf1] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:02:30.356967 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-e8064476-8d70-49b4-91e7-5bf7aebb3210 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:30.359086 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-e8064476-8d70-49b4-91e7-5bf7aebb3210 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:30.361597 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-e8064476-8d70-49b4-91e7-5bf7aebb3210 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:30.365163 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-e8064476-8d70-49b4-91e7-5bf7aebb3210 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:30.366064 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-e8064476-8d70-49b4-91e7-5bf7aebb3210 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:30.366696 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-e8064476-8d70-49b4-91e7-5bf7aebb3210 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:30.623082 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-a639dbcf-cfe0-4b37-ad95-7c65452bb7df tempest-ServersTestBootFromVolume-877599095 tempest-ServersTestBootFromVolume-877599095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed2352ce53fc4045adde8cd81b78b3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651046528c204df299ca3d14c44b4a7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:02:30.636310 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-a639dbcf-cfe0-4b37-ad95-7c65452bb7df tempest-ServersTestBootFromVolume-877599095 tempest-ServersTestBootFromVolume-877599095-project] 10.222.0.13 "GET /compute/v2.1/servers/44cdf0d8-969b-4149-bb03-6bc390977019" status: 200 len: 1292 microversion: 2.1 time: 0.843842 Nov 01 19:02:30.637116 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1113/2233] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:02:29 2022] GET /compute/v2.1/servers/44cdf0d8-969b-4149-bb03-6bc390977019 => generated 1292 bytes in 846 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:02:30.649819 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-e896460a-707e-4277-b2bb-f3384ed055bf tempest-ImagesNegativeTestJSON-1904451201 tempest-ImagesNegativeTestJSON-1904451201-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:02:30.650721 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-e896460a-707e-4277-b2bb-f3384ed055bf tempest-ImagesNegativeTestJSON-1904451201 tempest-ImagesNegativeTestJSON-1904451201-project] [instance: 077786bf-b9d6-4b7e-9eb5-ce4612dcd945] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:02:30.663883 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e896460a-707e-4277-b2bb-f3384ed055bf tempest-ImagesNegativeTestJSON-1904451201 tempest-ImagesNegativeTestJSON-1904451201-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:30.669422 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e896460a-707e-4277-b2bb-f3384ed055bf tempest-ImagesNegativeTestJSON-1904451201 tempest-ImagesNegativeTestJSON-1904451201-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:30.670139 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e896460a-707e-4277-b2bb-f3384ed055bf tempest-ImagesNegativeTestJSON-1904451201 tempest-ImagesNegativeTestJSON-1904451201-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:30.671075 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e896460a-707e-4277-b2bb-f3384ed055bf tempest-ImagesNegativeTestJSON-1904451201 tempest-ImagesNegativeTestJSON-1904451201-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:30.671709 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e896460a-707e-4277-b2bb-f3384ed055bf tempest-ImagesNegativeTestJSON-1904451201 tempest-ImagesNegativeTestJSON-1904451201-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:30.672320 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e896460a-707e-4277-b2bb-f3384ed055bf tempest-ImagesNegativeTestJSON-1904451201 tempest-ImagesNegativeTestJSON-1904451201-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:31.064780 n-d-863052-2 devstack@n-api.service[121402]: DEBUG dbcounter [-] [121402] Writing DB stats nova_cell0:SELECT=6 {{(pid=121402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 19:02:31.503234 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-e8064476-8d70-49b4-91e7-5bf7aebb3210 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb496b3faac4abbae73d389f2042e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e2520220d454764b8c139a58d78ac83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:02:31.516365 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-e8064476-8d70-49b4-91e7-5bf7aebb3210 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] 10.222.0.13 "GET /compute/v2.1/servers/46a040e6-2750-47b4-b8e2-757b92f1adf1" status: 200 len: 1314 microversion: 2.1 time: 1.189718 Nov 01 19:02:31.558715 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1121/2234] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:02:30 2022] GET /compute/v2.1/servers/46a040e6-2750-47b4-b8e2-757b92f1adf1 => generated 1314 bytes in 1208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:02:31.565631 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [req-c43f8ccd-2764-4646-92c1-0a9cc21cf44c req-36377cc1-0c00-43c2-b01b-8fe3292b8f12 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4b9fb909-26f7-40af-bac5-e7d2a6b9fb77", "tag": "23db407a-d443-468d-a813-719394117719"}]} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:02:31.622269 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-c43f8ccd-2764-4646-92c1-0a9cc21cf44c req-36377cc1-0c00-43c2-b01b-8fe3292b8f12 service nova] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:31.623083 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-c43f8ccd-2764-4646-92c1-0a9cc21cf44c req-36377cc1-0c00-43c2-b01b-8fe3292b8f12 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:31.623651 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-c43f8ccd-2764-4646-92c1-0a9cc21cf44c req-36377cc1-0c00-43c2-b01b-8fe3292b8f12 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:31.668419 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.compute.server_external_events [req-c43f8ccd-2764-4646-92c1-0a9cc21cf44c req-36377cc1-0c00-43c2-b01b-8fe3292b8f12 service nova] Creating event network-changed:23db407a-d443-468d-a813-719394117719 for instance 4b9fb909-26f7-40af-bac5-e7d2a6b9fb77 on n-h1-863052-2 Nov 01 19:02:31.688285 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [req-c43f8ccd-2764-4646-92c1-0a9cc21cf44c req-36377cc1-0c00-43c2-b01b-8fe3292b8f12 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.128112 Nov 01 19:02:31.693158 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1122/2235] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Nov 1 19:02:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:02:31.713164 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [req-e117bd39-a9a9-47dd-bc7c-60fcac717e54 req-03ace655-b737-4465-abf6-8c5a84452af0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "077786bf-b9d6-4b7e-9eb5-ce4612dcd945", "tag": "82fb1de9-5d12-4172-992b-157d50e3e79c"}]} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:02:31.725464 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-e896460a-707e-4277-b2bb-f3384ed055bf tempest-ImagesNegativeTestJSON-1904451201 tempest-ImagesNegativeTestJSON-1904451201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c4a93c606cd4fc98c9b667bfc3d367b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68771d3adba04230a0fc3f69b50cc9b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:02:31.735835 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-e896460a-707e-4277-b2bb-f3384ed055bf tempest-ImagesNegativeTestJSON-1904451201 tempest-ImagesNegativeTestJSON-1904451201-project] 10.222.0.13 "GET /compute/v2.1/servers/077786bf-b9d6-4b7e-9eb5-ce4612dcd945" status: 200 len: 1316 microversion: 2.1 time: 1.096700 Nov 01 19:02:31.741170 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-e117bd39-a9a9-47dd-bc7c-60fcac717e54 req-03ace655-b737-4465-abf6-8c5a84452af0 service nova] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:31.743962 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-e117bd39-a9a9-47dd-bc7c-60fcac717e54 req-03ace655-b737-4465-abf6-8c5a84452af0 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:31.745778 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-e117bd39-a9a9-47dd-bc7c-60fcac717e54 req-03ace655-b737-4465-abf6-8c5a84452af0 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:31.756026 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1114/2236] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:02:30 2022] GET /compute/v2.1/servers/077786bf-b9d6-4b7e-9eb5-ce4612dcd945 => generated 1316 bytes in 1117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:02:31.764148 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-e5763f1d-d441-4472-9c26-a4d80e165869 tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:02:31.776653 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.compute.server_external_events [req-e117bd39-a9a9-47dd-bc7c-60fcac717e54 req-03ace655-b737-4465-abf6-8c5a84452af0 service nova] Creating event network-changed:82fb1de9-5d12-4172-992b-157d50e3e79c for instance 077786bf-b9d6-4b7e-9eb5-ce4612dcd945 on n-h2-863052-2 Nov 01 19:02:31.781547 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-e5763f1d-d441-4472-9c26-a4d80e165869 tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] [instance: 4b9fb909-26f7-40af-bac5-e7d2a6b9fb77] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:02:31.788513 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e5763f1d-d441-4472-9c26-a4d80e165869 tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:31.789049 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e5763f1d-d441-4472-9c26-a4d80e165869 tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:31.789491 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e5763f1d-d441-4472-9c26-a4d80e165869 tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:31.790208 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e5763f1d-d441-4472-9c26-a4d80e165869 tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:31.790669 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e5763f1d-d441-4472-9c26-a4d80e165869 tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:31.791096 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e5763f1d-d441-4472-9c26-a4d80e165869 tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:31.792654 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [req-e117bd39-a9a9-47dd-bc7c-60fcac717e54 req-03ace655-b737-4465-abf6-8c5a84452af0 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094902 Nov 01 19:02:31.796148 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1123/2237] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Nov 1 19:02:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:02:31.812469 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-5e72c7f5-188c-42ab-860a-6d22b4e9b988 tempest-ServersTestBootFromVolume-877599095 tempest-ServersTestBootFromVolume-877599095-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:02:31.815177 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-5e72c7f5-188c-42ab-860a-6d22b4e9b988 tempest-ServersTestBootFromVolume-877599095 tempest-ServersTestBootFromVolume-877599095-project] [instance: 44cdf0d8-969b-4149-bb03-6bc390977019] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:02:31.828977 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-5e72c7f5-188c-42ab-860a-6d22b4e9b988 tempest-ServersTestBootFromVolume-877599095 tempest-ServersTestBootFromVolume-877599095-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:31.831584 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-5e72c7f5-188c-42ab-860a-6d22b4e9b988 tempest-ServersTestBootFromVolume-877599095 tempest-ServersTestBootFromVolume-877599095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:31.833494 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-5e72c7f5-188c-42ab-860a-6d22b4e9b988 tempest-ServersTestBootFromVolume-877599095 tempest-ServersTestBootFromVolume-877599095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:31.836066 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-5e72c7f5-188c-42ab-860a-6d22b4e9b988 tempest-ServersTestBootFromVolume-877599095 tempest-ServersTestBootFromVolume-877599095-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:31.838556 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-5e72c7f5-188c-42ab-860a-6d22b4e9b988 tempest-ServersTestBootFromVolume-877599095 tempest-ServersTestBootFromVolume-877599095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:31.839283 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-5e72c7f5-188c-42ab-860a-6d22b4e9b988 tempest-ServersTestBootFromVolume-877599095 tempest-ServersTestBootFromVolume-877599095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:31.929776 n-d-863052-2 devstack@n-api.service[121402]: DEBUG dbcounter [-] [121402] Writing DB stats nova_cell0:SELECT=30 {{(pid=121402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 19:02:32.306402 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-5e72c7f5-188c-42ab-860a-6d22b4e9b988 tempest-ServersTestBootFromVolume-877599095 tempest-ServersTestBootFromVolume-877599095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed2352ce53fc4045adde8cd81b78b3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651046528c204df299ca3d14c44b4a7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:02:32.321962 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-5e72c7f5-188c-42ab-860a-6d22b4e9b988 tempest-ServersTestBootFromVolume-877599095 tempest-ServersTestBootFromVolume-877599095-project] 10.222.0.13 "GET /compute/v2.1/servers/44cdf0d8-969b-4149-bb03-6bc390977019" status: 200 len: 1292 microversion: 2.1 time: 0.523107 Nov 01 19:02:32.325692 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1124/2238] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:02:31 2022] GET /compute/v2.1/servers/44cdf0d8-969b-4149-bb03-6bc390977019 => generated 1292 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:02:32.540243 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-ac64d7ab-94e0-47a6-8098-f011fb6b8c1d tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:02:32.541830 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-ac64d7ab-94e0-47a6-8098-f011fb6b8c1d tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] [instance: 46a040e6-2750-47b4-b8e2-757b92f1adf1] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:02:32.552348 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-ac64d7ab-94e0-47a6-8098-f011fb6b8c1d tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:32.554943 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-ac64d7ab-94e0-47a6-8098-f011fb6b8c1d tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:32.555465 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-ac64d7ab-94e0-47a6-8098-f011fb6b8c1d tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:32.556354 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-ac64d7ab-94e0-47a6-8098-f011fb6b8c1d tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:32.556844 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-ac64d7ab-94e0-47a6-8098-f011fb6b8c1d tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:32.557840 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-ac64d7ab-94e0-47a6-8098-f011fb6b8c1d tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:32.885998 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-ac64d7ab-94e0-47a6-8098-f011fb6b8c1d tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb496b3faac4abbae73d389f2042e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e2520220d454764b8c139a58d78ac83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:02:32.899454 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-ac64d7ab-94e0-47a6-8098-f011fb6b8c1d tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] 10.222.0.13 "GET /compute/v2.1/servers/46a040e6-2750-47b4-b8e2-757b92f1adf1" status: 200 len: 1314 microversion: 2.1 time: 0.363598 Nov 01 19:02:32.901385 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1125/2239] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:02:32 2022] GET /compute/v2.1/servers/46a040e6-2750-47b4-b8e2-757b92f1adf1 => generated 1314 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:02:32.913066 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-c2580872-68c4-4c9e-9224-614dcd3f0a02 tempest-ImagesNegativeTestJSON-1904451201 tempest-ImagesNegativeTestJSON-1904451201-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:02:32.913707 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-c2580872-68c4-4c9e-9224-614dcd3f0a02 tempest-ImagesNegativeTestJSON-1904451201 tempest-ImagesNegativeTestJSON-1904451201-project] [instance: 077786bf-b9d6-4b7e-9eb5-ce4612dcd945] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:02:32.924299 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-c2580872-68c4-4c9e-9224-614dcd3f0a02 tempest-ImagesNegativeTestJSON-1904451201 tempest-ImagesNegativeTestJSON-1904451201-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:32.924845 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-c2580872-68c4-4c9e-9224-614dcd3f0a02 tempest-ImagesNegativeTestJSON-1904451201 tempest-ImagesNegativeTestJSON-1904451201-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:32.928174 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-c2580872-68c4-4c9e-9224-614dcd3f0a02 tempest-ImagesNegativeTestJSON-1904451201 tempest-ImagesNegativeTestJSON-1904451201-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:32.928984 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-c2580872-68c4-4c9e-9224-614dcd3f0a02 tempest-ImagesNegativeTestJSON-1904451201 tempest-ImagesNegativeTestJSON-1904451201-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:32.931734 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-c2580872-68c4-4c9e-9224-614dcd3f0a02 tempest-ImagesNegativeTestJSON-1904451201 tempest-ImagesNegativeTestJSON-1904451201-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:32.933436 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-c2580872-68c4-4c9e-9224-614dcd3f0a02 tempest-ImagesNegativeTestJSON-1904451201 tempest-ImagesNegativeTestJSON-1904451201-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:32.979693 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-e5763f1d-d441-4472-9c26-a4d80e165869 tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52acef7992d64d378fd8ac333887fd0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af51b8733e984c2ca87df2d8163dedf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:02:32.999460 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-e5763f1d-d441-4472-9c26-a4d80e165869 tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] 10.222.0.13 "GET /compute/v2.1/servers/4b9fb909-26f7-40af-bac5-e7d2a6b9fb77" status: 200 len: 1354 microversion: 2.1 time: 1.242187 Nov 01 19:02:33.000071 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1115/2240] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:02:31 2022] GET /compute/v2.1/servers/4b9fb909-26f7-40af-bac5-e7d2a6b9fb77 => generated 1354 bytes in 1243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:02:33.013244 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [req-d73400ec-fb28-4d96-9301-e05a37f40f41 req-a74c8479-38c7-4f7b-a618-3f32cb4f5ac7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "46a040e6-2750-47b4-b8e2-757b92f1adf1", "name": "network-vif-plugged", "status": "completed", "tag": "c8726629-64ec-4a3b-8076-8ad61393df33"}]} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:02:33.039778 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-d73400ec-fb28-4d96-9301-e05a37f40f41 req-a74c8479-38c7-4f7b-a618-3f32cb4f5ac7 service nova] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:33.055122 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-d73400ec-fb28-4d96-9301-e05a37f40f41 req-a74c8479-38c7-4f7b-a618-3f32cb4f5ac7 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:33.055894 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-d73400ec-fb28-4d96-9301-e05a37f40f41 req-a74c8479-38c7-4f7b-a618-3f32cb4f5ac7 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:33.071868 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.compute.server_external_events [req-d73400ec-fb28-4d96-9301-e05a37f40f41 req-a74c8479-38c7-4f7b-a618-3f32cb4f5ac7 service nova] Creating event network-vif-plugged:c8726629-64ec-4a3b-8076-8ad61393df33 for instance 46a040e6-2750-47b4-b8e2-757b92f1adf1 on n-h1-863052-2 Nov 01 19:02:33.080528 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [req-d73400ec-fb28-4d96-9301-e05a37f40f41 req-a74c8479-38c7-4f7b-a618-3f32cb4f5ac7 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074293 Nov 01 19:02:33.087342 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1116/2241] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Nov 1 19:02:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:02:33.289815 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-c2580872-68c4-4c9e-9224-614dcd3f0a02 tempest-ImagesNegativeTestJSON-1904451201 tempest-ImagesNegativeTestJSON-1904451201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c4a93c606cd4fc98c9b667bfc3d367b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68771d3adba04230a0fc3f69b50cc9b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:02:33.303213 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-c2580872-68c4-4c9e-9224-614dcd3f0a02 tempest-ImagesNegativeTestJSON-1904451201 tempest-ImagesNegativeTestJSON-1904451201-project] 10.222.0.13 "GET /compute/v2.1/servers/077786bf-b9d6-4b7e-9eb5-ce4612dcd945" status: 200 len: 1316 microversion: 2.1 time: 0.400687 Nov 01 19:02:33.303812 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1126/2242] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:02:32 2022] GET /compute/v2.1/servers/077786bf-b9d6-4b7e-9eb5-ce4612dcd945 => generated 1316 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:02:33.347759 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-5e4c46a5-e72a-455f-997a-19297d4e9d4e tempest-ServersTestBootFromVolume-877599095 tempest-ServersTestBootFromVolume-877599095-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:02:33.348861 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-5e4c46a5-e72a-455f-997a-19297d4e9d4e tempest-ServersTestBootFromVolume-877599095 tempest-ServersTestBootFromVolume-877599095-project] [instance: 44cdf0d8-969b-4149-bb03-6bc390977019] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:02:33.355941 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-5e4c46a5-e72a-455f-997a-19297d4e9d4e tempest-ServersTestBootFromVolume-877599095 tempest-ServersTestBootFromVolume-877599095-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:33.356748 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-5e4c46a5-e72a-455f-997a-19297d4e9d4e tempest-ServersTestBootFromVolume-877599095 tempest-ServersTestBootFromVolume-877599095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:33.357362 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-5e4c46a5-e72a-455f-997a-19297d4e9d4e tempest-ServersTestBootFromVolume-877599095 tempest-ServersTestBootFromVolume-877599095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:33.358243 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-5e4c46a5-e72a-455f-997a-19297d4e9d4e tempest-ServersTestBootFromVolume-877599095 tempest-ServersTestBootFromVolume-877599095-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:33.358893 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-5e4c46a5-e72a-455f-997a-19297d4e9d4e tempest-ServersTestBootFromVolume-877599095 tempest-ServersTestBootFromVolume-877599095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:33.359490 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-5e4c46a5-e72a-455f-997a-19297d4e9d4e tempest-ServersTestBootFromVolume-877599095 tempest-ServersTestBootFromVolume-877599095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:33.927093 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-a31683f8-cce5-4aa3-992b-4bffbd2ca232 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:02:33.928287 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-a31683f8-cce5-4aa3-992b-4bffbd2ca232 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] [instance: 46a040e6-2750-47b4-b8e2-757b92f1adf1] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:02:33.944662 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-a31683f8-cce5-4aa3-992b-4bffbd2ca232 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:33.947253 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-a31683f8-cce5-4aa3-992b-4bffbd2ca232 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:33.947715 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-a31683f8-cce5-4aa3-992b-4bffbd2ca232 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:33.948445 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-a31683f8-cce5-4aa3-992b-4bffbd2ca232 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:33.951185 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-a31683f8-cce5-4aa3-992b-4bffbd2ca232 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:33.951656 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-a31683f8-cce5-4aa3-992b-4bffbd2ca232 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:34.112049 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-5e4c46a5-e72a-455f-997a-19297d4e9d4e tempest-ServersTestBootFromVolume-877599095 tempest-ServersTestBootFromVolume-877599095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed2352ce53fc4045adde8cd81b78b3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651046528c204df299ca3d14c44b4a7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:02:34.125903 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-5e4c46a5-e72a-455f-997a-19297d4e9d4e tempest-ServersTestBootFromVolume-877599095 tempest-ServersTestBootFromVolume-877599095-project] 10.222.0.13 "GET /compute/v2.1/servers/44cdf0d8-969b-4149-bb03-6bc390977019" status: 200 len: 1292 microversion: 2.1 time: 0.783304 Nov 01 19:02:34.129289 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1117/2243] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:02:33 2022] GET /compute/v2.1/servers/44cdf0d8-969b-4149-bb03-6bc390977019 => generated 1292 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:02:34.138270 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-e8132d47-9198-46d1-987d-cdd33f0095b4 tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:02:34.140685 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-e8132d47-9198-46d1-987d-cdd33f0095b4 tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] [instance: 4b9fb909-26f7-40af-bac5-e7d2a6b9fb77] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:02:34.159247 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e8132d47-9198-46d1-987d-cdd33f0095b4 tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:34.159759 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e8132d47-9198-46d1-987d-cdd33f0095b4 tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:34.160210 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e8132d47-9198-46d1-987d-cdd33f0095b4 tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:34.161043 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e8132d47-9198-46d1-987d-cdd33f0095b4 tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:34.162460 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e8132d47-9198-46d1-987d-cdd33f0095b4 tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:34.164079 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e8132d47-9198-46d1-987d-cdd33f0095b4 tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:34.453677 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-a31683f8-cce5-4aa3-992b-4bffbd2ca232 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb496b3faac4abbae73d389f2042e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e2520220d454764b8c139a58d78ac83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:02:34.461762 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-a31683f8-cce5-4aa3-992b-4bffbd2ca232 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] 10.222.0.13 "GET /compute/v2.1/servers/46a040e6-2750-47b4-b8e2-757b92f1adf1" status: 200 len: 1314 microversion: 2.1 time: 0.540384 Nov 01 19:02:34.466650 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1127/2244] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:02:33 2022] GET /compute/v2.1/servers/46a040e6-2750-47b4-b8e2-757b92f1adf1 => generated 1314 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 19:02:34.471415 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-f6bb728c-0e57-4ab1-9186-19b1ebd6423b tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:02:34.471922 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-f6bb728c-0e57-4ab1-9186-19b1ebd6423b tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] [instance: a7f88d19-08ee-47bf-9240-7d49afd775e2] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:02:34.495902 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f6bb728c-0e57-4ab1-9186-19b1ebd6423b tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:34.496387 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f6bb728c-0e57-4ab1-9186-19b1ebd6423b tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:34.496850 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f6bb728c-0e57-4ab1-9186-19b1ebd6423b tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:34.504274 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f6bb728c-0e57-4ab1-9186-19b1ebd6423b tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:34.505033 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f6bb728c-0e57-4ab1-9186-19b1ebd6423b tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:34.505645 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f6bb728c-0e57-4ab1-9186-19b1ebd6423b tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:34.556974 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-f6bb728c-0e57-4ab1-9186-19b1ebd6423b tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] [instance: a7f88d19-08ee-47bf-9240-7d49afd775e2] Going to try to terminate instance {{(pid=121403) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 01 19:02:34.657232 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-e8132d47-9198-46d1-987d-cdd33f0095b4 tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52acef7992d64d378fd8ac333887fd0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af51b8733e984c2ca87df2d8163dedf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:02:34.675241 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-e8132d47-9198-46d1-987d-cdd33f0095b4 tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] 10.222.0.13 "GET /compute/v2.1/servers/4b9fb909-26f7-40af-bac5-e7d2a6b9fb77" status: 200 len: 1354 microversion: 2.1 time: 0.544482 Nov 01 19:02:34.676116 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1118/2245] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:02:34 2022] GET /compute/v2.1/servers/4b9fb909-26f7-40af-bac5-e7d2a6b9fb77 => generated 1354 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:02:34.686241 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-66adbdfa-cf3e-414c-aa6f-e05e8732f6c2 tempest-ImagesNegativeTestJSON-1904451201 tempest-ImagesNegativeTestJSON-1904451201-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:02:34.687126 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-66adbdfa-cf3e-414c-aa6f-e05e8732f6c2 tempest-ImagesNegativeTestJSON-1904451201 tempest-ImagesNegativeTestJSON-1904451201-project] [instance: 077786bf-b9d6-4b7e-9eb5-ce4612dcd945] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:02:34.712217 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-66adbdfa-cf3e-414c-aa6f-e05e8732f6c2 tempest-ImagesNegativeTestJSON-1904451201 tempest-ImagesNegativeTestJSON-1904451201-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:34.713208 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-66adbdfa-cf3e-414c-aa6f-e05e8732f6c2 tempest-ImagesNegativeTestJSON-1904451201 tempest-ImagesNegativeTestJSON-1904451201-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:34.713845 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-66adbdfa-cf3e-414c-aa6f-e05e8732f6c2 tempest-ImagesNegativeTestJSON-1904451201 tempest-ImagesNegativeTestJSON-1904451201-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:34.715195 n-d-863052-2 devstack@n-api.service[121403]: DEBUG dbcounter [-] [121403] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=121403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 19:02:34.717348 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-66adbdfa-cf3e-414c-aa6f-e05e8732f6c2 tempest-ImagesNegativeTestJSON-1904451201 tempest-ImagesNegativeTestJSON-1904451201-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:34.717830 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-66adbdfa-cf3e-414c-aa6f-e05e8732f6c2 tempest-ImagesNegativeTestJSON-1904451201 tempest-ImagesNegativeTestJSON-1904451201-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:34.721636 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-66adbdfa-cf3e-414c-aa6f-e05e8732f6c2 tempest-ImagesNegativeTestJSON-1904451201 tempest-ImagesNegativeTestJSON-1904451201-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:34.774547 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-f6bb728c-0e57-4ab1-9186-19b1ebd6423b tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] 10.222.0.13 "DELETE /compute/v2.1/servers/a7f88d19-08ee-47bf-9240-7d49afd775e2" status: 204 len: 0 microversion: 2.25 time: 0.306484 Nov 01 19:02:34.779064 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1128/2246] 10.222.0.13 () {60 vars in 1280 bytes} [Tue Nov 1 19:02:34 2022] DELETE /compute/v2.1/servers/a7f88d19-08ee-47bf-9240-7d49afd775e2 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 01 19:02:34.797529 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-3457c254-a3d1-4f13-8e56-ba3aaac34135 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:02:34.798386 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-3457c254-a3d1-4f13-8e56-ba3aaac34135 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] [instance: a7f88d19-08ee-47bf-9240-7d49afd775e2] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:02:34.814502 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-3457c254-a3d1-4f13-8e56-ba3aaac34135 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:34.822777 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-3457c254-a3d1-4f13-8e56-ba3aaac34135 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:34.823800 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-3457c254-a3d1-4f13-8e56-ba3aaac34135 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:34.825288 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-3457c254-a3d1-4f13-8e56-ba3aaac34135 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:34.825938 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-3457c254-a3d1-4f13-8e56-ba3aaac34135 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:34.827213 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-3457c254-a3d1-4f13-8e56-ba3aaac34135 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:35.060654 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-66adbdfa-cf3e-414c-aa6f-e05e8732f6c2 tempest-ImagesNegativeTestJSON-1904451201 tempest-ImagesNegativeTestJSON-1904451201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c4a93c606cd4fc98c9b667bfc3d367b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68771d3adba04230a0fc3f69b50cc9b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:02:35.071772 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-66adbdfa-cf3e-414c-aa6f-e05e8732f6c2 tempest-ImagesNegativeTestJSON-1904451201 tempest-ImagesNegativeTestJSON-1904451201-project] 10.222.0.13 "GET /compute/v2.1/servers/077786bf-b9d6-4b7e-9eb5-ce4612dcd945" status: 200 len: 1316 microversion: 2.1 time: 0.394300 Nov 01 19:02:35.072370 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1119/2247] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:02:34 2022] GET /compute/v2.1/servers/077786bf-b9d6-4b7e-9eb5-ce4612dcd945 => generated 1316 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:02:35.077022 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-3457c254-a3d1-4f13-8e56-ba3aaac34135 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:02:35.096533 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-3457c254-a3d1-4f13-8e56-ba3aaac34135 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:02:35.098491 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-3457c254-a3d1-4f13-8e56-ba3aaac34135 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:02:35.100151 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-3457c254-a3d1-4f13-8e56-ba3aaac34135 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] 10.222.0.13 "GET /compute/v2.1/servers/a7f88d19-08ee-47bf-9240-7d49afd775e2" status: 200 len: 1730 microversion: 2.25 time: 0.315243 Nov 01 19:02:35.102129 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1129/2248] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 19:02:34 2022] GET /compute/v2.1/servers/a7f88d19-08ee-47bf-9240-7d49afd775e2 => generated 1730 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 19:02:35.147427 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-69e2e447-c211-462d-9bf2-268cbc5049d3 tempest-ServersTestBootFromVolume-877599095 tempest-ServersTestBootFromVolume-877599095-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:02:35.148358 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-69e2e447-c211-462d-9bf2-268cbc5049d3 tempest-ServersTestBootFromVolume-877599095 tempest-ServersTestBootFromVolume-877599095-project] [instance: 44cdf0d8-969b-4149-bb03-6bc390977019] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:02:35.161097 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-69e2e447-c211-462d-9bf2-268cbc5049d3 tempest-ServersTestBootFromVolume-877599095 tempest-ServersTestBootFromVolume-877599095-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:35.164905 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-69e2e447-c211-462d-9bf2-268cbc5049d3 tempest-ServersTestBootFromVolume-877599095 tempest-ServersTestBootFromVolume-877599095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:35.165591 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-69e2e447-c211-462d-9bf2-268cbc5049d3 tempest-ServersTestBootFromVolume-877599095 tempest-ServersTestBootFromVolume-877599095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:35.166552 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-69e2e447-c211-462d-9bf2-268cbc5049d3 tempest-ServersTestBootFromVolume-877599095 tempest-ServersTestBootFromVolume-877599095-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:35.167217 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-69e2e447-c211-462d-9bf2-268cbc5049d3 tempest-ServersTestBootFromVolume-877599095 tempest-ServersTestBootFromVolume-877599095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:35.167857 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-69e2e447-c211-462d-9bf2-268cbc5049d3 tempest-ServersTestBootFromVolume-877599095 tempest-ServersTestBootFromVolume-877599095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:35.489803 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-e374aadc-f3dc-467b-a4f8-e7b54515186c tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:02:35.491661 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-e374aadc-f3dc-467b-a4f8-e7b54515186c tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] [instance: 46a040e6-2750-47b4-b8e2-757b92f1adf1] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:02:35.503600 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-e374aadc-f3dc-467b-a4f8-e7b54515186c tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:35.505421 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-e374aadc-f3dc-467b-a4f8-e7b54515186c tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:35.507532 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-e374aadc-f3dc-467b-a4f8-e7b54515186c tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:35.509693 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-e374aadc-f3dc-467b-a4f8-e7b54515186c tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:35.511741 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-e374aadc-f3dc-467b-a4f8-e7b54515186c tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:35.522363 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-e374aadc-f3dc-467b-a4f8-e7b54515186c tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:35.644092 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-69e2e447-c211-462d-9bf2-268cbc5049d3 tempest-ServersTestBootFromVolume-877599095 tempest-ServersTestBootFromVolume-877599095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed2352ce53fc4045adde8cd81b78b3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651046528c204df299ca3d14c44b4a7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:02:35.657762 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-69e2e447-c211-462d-9bf2-268cbc5049d3 tempest-ServersTestBootFromVolume-877599095 tempest-ServersTestBootFromVolume-877599095-project] 10.222.0.13 "GET /compute/v2.1/servers/44cdf0d8-969b-4149-bb03-6bc390977019" status: 200 len: 1292 microversion: 2.1 time: 0.514126 Nov 01 19:02:35.659784 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1120/2249] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:02:35 2022] GET /compute/v2.1/servers/44cdf0d8-969b-4149-bb03-6bc390977019 => generated 1292 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:02:35.704077 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-20e4bd74-93c4-4d07-8eb0-7302a9bf2346 tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:02:35.704822 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-20e4bd74-93c4-4d07-8eb0-7302a9bf2346 tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] [instance: 4b9fb909-26f7-40af-bac5-e7d2a6b9fb77] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:02:35.717537 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-20e4bd74-93c4-4d07-8eb0-7302a9bf2346 tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:35.718057 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-20e4bd74-93c4-4d07-8eb0-7302a9bf2346 tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:35.718488 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-20e4bd74-93c4-4d07-8eb0-7302a9bf2346 tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:35.719191 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-20e4bd74-93c4-4d07-8eb0-7302a9bf2346 tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:35.719643 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-20e4bd74-93c4-4d07-8eb0-7302a9bf2346 tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:35.720060 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-20e4bd74-93c4-4d07-8eb0-7302a9bf2346 tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:35.955427 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-e374aadc-f3dc-467b-a4f8-e7b54515186c tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb496b3faac4abbae73d389f2042e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e2520220d454764b8c139a58d78ac83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:02:35.968390 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-e374aadc-f3dc-467b-a4f8-e7b54515186c tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] 10.222.0.13 "GET /compute/v2.1/servers/46a040e6-2750-47b4-b8e2-757b92f1adf1" status: 200 len: 1464 microversion: 2.1 time: 0.483161 Nov 01 19:02:35.969324 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1130/2250] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:02:35 2022] GET /compute/v2.1/servers/46a040e6-2750-47b4-b8e2-757b92f1adf1 => generated 1464 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:02:36.153170 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-20e4bd74-93c4-4d07-8eb0-7302a9bf2346 tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52acef7992d64d378fd8ac333887fd0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af51b8733e984c2ca87df2d8163dedf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:02:36.161255 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-20e4bd74-93c4-4d07-8eb0-7302a9bf2346 tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] 10.222.0.13 "GET /compute/v2.1/servers/4b9fb909-26f7-40af-bac5-e7d2a6b9fb77" status: 200 len: 1354 microversion: 2.1 time: 0.462674 Nov 01 19:02:36.161926 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1121/2251] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:02:35 2022] GET /compute/v2.1/servers/4b9fb909-26f7-40af-bac5-e7d2a6b9fb77 => generated 1354 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:02:36.168767 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-57190e4b-8e5e-4496-a8a8-c3f453c247fe tempest-ImagesNegativeTestJSON-1904451201 tempest-ImagesNegativeTestJSON-1904451201-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:02:36.168767 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-57190e4b-8e5e-4496-a8a8-c3f453c247fe tempest-ImagesNegativeTestJSON-1904451201 tempest-ImagesNegativeTestJSON-1904451201-project] [instance: 077786bf-b9d6-4b7e-9eb5-ce4612dcd945] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:02:36.205526 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-57190e4b-8e5e-4496-a8a8-c3f453c247fe tempest-ImagesNegativeTestJSON-1904451201 tempest-ImagesNegativeTestJSON-1904451201-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:36.206170 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-57190e4b-8e5e-4496-a8a8-c3f453c247fe tempest-ImagesNegativeTestJSON-1904451201 tempest-ImagesNegativeTestJSON-1904451201-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:36.206457 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-57190e4b-8e5e-4496-a8a8-c3f453c247fe tempest-ImagesNegativeTestJSON-1904451201 tempest-ImagesNegativeTestJSON-1904451201-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:36.207167 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-57190e4b-8e5e-4496-a8a8-c3f453c247fe tempest-ImagesNegativeTestJSON-1904451201 tempest-ImagesNegativeTestJSON-1904451201-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:36.207624 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-57190e4b-8e5e-4496-a8a8-c3f453c247fe tempest-ImagesNegativeTestJSON-1904451201 tempest-ImagesNegativeTestJSON-1904451201-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:36.208054 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-57190e4b-8e5e-4496-a8a8-c3f453c247fe tempest-ImagesNegativeTestJSON-1904451201 tempest-ImagesNegativeTestJSON-1904451201-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:36.374013 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-fcb5e97c-57da-421d-99db-292dbb7de980 tempest-ServersAdminTestJSON-831008371 tempest-ServersAdminTestJSON-831008371-project-admin] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:02:36.379698 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-fcb5e97c-57da-421d-99db-292dbb7de980 tempest-ServersAdminTestJSON-831008371 tempest-ServersAdminTestJSON-831008371-project-admin] Searching by: {'deleted': False, 'project_id': '04147d3b5e5f4a1a9e3b6a8be9848b50'} {{(pid=121403) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 01 19:02:36.386783 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-fcb5e97c-57da-421d-99db-292dbb7de980 tempest-ServersAdminTestJSON-831008371 tempest-ServersAdminTestJSON-831008371-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:36.387515 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-fcb5e97c-57da-421d-99db-292dbb7de980 tempest-ServersAdminTestJSON-831008371 tempest-ServersAdminTestJSON-831008371-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:36.388118 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-fcb5e97c-57da-421d-99db-292dbb7de980 tempest-ServersAdminTestJSON-831008371 tempest-ServersAdminTestJSON-831008371-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:36.389050 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-fcb5e97c-57da-421d-99db-292dbb7de980 tempest-ServersAdminTestJSON-831008371 tempest-ServersAdminTestJSON-831008371-project-admin] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:36.389703 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-fcb5e97c-57da-421d-99db-292dbb7de980 tempest-ServersAdminTestJSON-831008371 tempest-ServersAdminTestJSON-831008371-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:36.390119 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-fcb5e97c-57da-421d-99db-292dbb7de980 tempest-ServersAdminTestJSON-831008371 tempest-ServersAdminTestJSON-831008371-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:36.531926 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-fcb5e97c-57da-421d-99db-292dbb7de980 tempest-ServersAdminTestJSON-831008371 tempest-ServersAdminTestJSON-831008371-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/detail" status: 200 len: 15 microversion: 2.1 time: 0.538849 Nov 01 19:02:36.549306 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1131/2252] 10.222.0.13 () {58 vars in 1146 bytes} [Tue Nov 1 19:02:35 2022] GET /compute/v2.1/servers/detail => generated 15 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Nov 01 19:02:36.554752 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-bd33329d-1b0a-4e00-88c0-cb6f3a657ca1 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:02:36.555390 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-bd33329d-1b0a-4e00-88c0-cb6f3a657ca1 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] [instance: a7f88d19-08ee-47bf-9240-7d49afd775e2] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:02:36.570518 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-57190e4b-8e5e-4496-a8a8-c3f453c247fe tempest-ImagesNegativeTestJSON-1904451201 tempest-ImagesNegativeTestJSON-1904451201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c4a93c606cd4fc98c9b667bfc3d367b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68771d3adba04230a0fc3f69b50cc9b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:02:36.572758 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-bd33329d-1b0a-4e00-88c0-cb6f3a657ca1 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:36.573259 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-bd33329d-1b0a-4e00-88c0-cb6f3a657ca1 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:36.573782 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-bd33329d-1b0a-4e00-88c0-cb6f3a657ca1 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:36.574677 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-bd33329d-1b0a-4e00-88c0-cb6f3a657ca1 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:36.575133 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-bd33329d-1b0a-4e00-88c0-cb6f3a657ca1 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:36.576175 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-bd33329d-1b0a-4e00-88c0-cb6f3a657ca1 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:36.579096 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-57190e4b-8e5e-4496-a8a8-c3f453c247fe tempest-ImagesNegativeTestJSON-1904451201 tempest-ImagesNegativeTestJSON-1904451201-project] 10.222.0.13 "GET /compute/v2.1/servers/077786bf-b9d6-4b7e-9eb5-ce4612dcd945" status: 200 len: 1316 microversion: 2.1 time: 0.415574 Nov 01 19:02:36.579777 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1122/2253] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:02:36 2022] GET /compute/v2.1/servers/077786bf-b9d6-4b7e-9eb5-ce4612dcd945 => generated 1316 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:02:36.584803 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-603a23df-3666-4da8-8c1f-7b66145a4daa tempest-ServersAdminTestJSON-831008371 tempest-ServersAdminTestJSON-831008371-project-admin] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:02:36.591124 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-603a23df-3666-4da8-8c1f-7b66145a4daa tempest-ServersAdminTestJSON-831008371 tempest-ServersAdminTestJSON-831008371-project-admin] Searching by: {'deleted': False} {{(pid=121402) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 01 19:02:36.597709 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-603a23df-3666-4da8-8c1f-7b66145a4daa tempest-ServersAdminTestJSON-831008371 tempest-ServersAdminTestJSON-831008371-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:36.598519 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-603a23df-3666-4da8-8c1f-7b66145a4daa tempest-ServersAdminTestJSON-831008371 tempest-ServersAdminTestJSON-831008371-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:36.599186 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-603a23df-3666-4da8-8c1f-7b66145a4daa tempest-ServersAdminTestJSON-831008371 tempest-ServersAdminTestJSON-831008371-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:36.601000 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-603a23df-3666-4da8-8c1f-7b66145a4daa tempest-ServersAdminTestJSON-831008371 tempest-ServersAdminTestJSON-831008371-project-admin] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:36.602405 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-603a23df-3666-4da8-8c1f-7b66145a4daa tempest-ServersAdminTestJSON-831008371 tempest-ServersAdminTestJSON-831008371-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:36.603187 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-603a23df-3666-4da8-8c1f-7b66145a4daa tempest-ServersAdminTestJSON-831008371 tempest-ServersAdminTestJSON-831008371-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:36.738305 n-d-863052-2 devstack@n-api.service[121402]: DEBUG dbcounter [-] [121402] Writing DB stats nova_cell1:SELECT=100 {{(pid=121402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 19:02:36.819500 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-bd33329d-1b0a-4e00-88c0-cb6f3a657ca1 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:02:36.828925 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-bd33329d-1b0a-4e00-88c0-cb6f3a657ca1 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:02:36.830290 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-bd33329d-1b0a-4e00-88c0-cb6f3a657ca1 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:02:36.831980 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.multi_cell_list [None req-603a23df-3666-4da8-8c1f-7b66145a4daa tempest-ServersAdminTestJSON-831008371 tempest-ServersAdminTestJSON-831008371-project-admin] Listed batch of 12 results from cell out of 1000 limit. Returned 12 total so far. {{(pid=121402) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 01 19:02:36.835490 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-bd33329d-1b0a-4e00-88c0-cb6f3a657ca1 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] 10.222.0.13 "GET /compute/v2.1/servers/a7f88d19-08ee-47bf-9240-7d49afd775e2" status: 200 len: 1730 microversion: 2.25 time: 0.294917 Nov 01 19:02:36.836081 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1132/2254] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 19:02:36 2022] GET /compute/v2.1/servers/a7f88d19-08ee-47bf-9240-7d49afd775e2 => generated 1730 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 19:02:36.850469 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-18e9ebee-6a86-4282-a5fe-39d86f08dd20 tempest-ServersTestBootFromVolume-877599095 tempest-ServersTestBootFromVolume-877599095-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:02:36.851853 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-18e9ebee-6a86-4282-a5fe-39d86f08dd20 tempest-ServersTestBootFromVolume-877599095 tempest-ServersTestBootFromVolume-877599095-project] [instance: 44cdf0d8-969b-4149-bb03-6bc390977019] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:02:36.868031 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-18e9ebee-6a86-4282-a5fe-39d86f08dd20 tempest-ServersTestBootFromVolume-877599095 tempest-ServersTestBootFromVolume-877599095-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:36.868834 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-18e9ebee-6a86-4282-a5fe-39d86f08dd20 tempest-ServersTestBootFromVolume-877599095 tempest-ServersTestBootFromVolume-877599095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:36.869549 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-18e9ebee-6a86-4282-a5fe-39d86f08dd20 tempest-ServersTestBootFromVolume-877599095 tempest-ServersTestBootFromVolume-877599095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:36.870555 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-18e9ebee-6a86-4282-a5fe-39d86f08dd20 tempest-ServersTestBootFromVolume-877599095 tempest-ServersTestBootFromVolume-877599095-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:36.871812 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-18e9ebee-6a86-4282-a5fe-39d86f08dd20 tempest-ServersTestBootFromVolume-877599095 tempest-ServersTestBootFromVolume-877599095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:36.872453 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-18e9ebee-6a86-4282-a5fe-39d86f08dd20 tempest-ServersTestBootFromVolume-877599095 tempest-ServersTestBootFromVolume-877599095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:36.933852 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-603a23df-3666-4da8-8c1f-7b66145a4daa tempest-ServersAdminTestJSON-831008371 tempest-ServersAdminTestJSON-831008371-project-admin] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:36.934375 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-603a23df-3666-4da8-8c1f-7b66145a4daa tempest-ServersAdminTestJSON-831008371 tempest-ServersAdminTestJSON-831008371-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:36.935015 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-603a23df-3666-4da8-8c1f-7b66145a4daa tempest-ServersAdminTestJSON-831008371 tempest-ServersAdminTestJSON-831008371-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:37.033759 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-18e9ebee-6a86-4282-a5fe-39d86f08dd20 tempest-ServersTestBootFromVolume-877599095 tempest-ServersTestBootFromVolume-877599095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed2352ce53fc4045adde8cd81b78b3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651046528c204df299ca3d14c44b4a7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:02:37.042244 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-18e9ebee-6a86-4282-a5fe-39d86f08dd20 tempest-ServersTestBootFromVolume-877599095 tempest-ServersTestBootFromVolume-877599095-project] 10.222.0.13 "GET /compute/v2.1/servers/44cdf0d8-969b-4149-bb03-6bc390977019" status: 200 len: 1292 microversion: 2.1 time: 0.199922 Nov 01 19:02:37.043561 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1133/2255] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:02:36 2022] GET /compute/v2.1/servers/44cdf0d8-969b-4149-bb03-6bc390977019 => generated 1292 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:02:37.123570 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-673f98fc-1d8d-4a6a-8725-573914a55e3a tempest-ServersTestJSON-675990056 tempest-ServersTestJSON-675990056-project] Action: 'create', calling method: .version_select at 0x7f0ae2051ca0>, body: {"keypair": {"name": "tempest-keypair-80750042", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAGOlMG653rOkCBvi/42b02kAAlSdXH11D6gBVjIt/EBhat43ZkMmU+DWVoCFiIC53J4UlmG6HMITO/0dWafuPFRS2Kq8M/5FWpTbqFdEnJGMLe+0kq0oM7GfipxTypTFw=="}} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:02:37.159640 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.quota [None req-673f98fc-1d8d-4a6a-8725-573914a55e3a tempest-ServersTestJSON-675990056 tempest-ServersTestJSON-675990056-project] Getting quotas for project c3dd3fba10d740c9bc38b10dca3007aa. Resources: {'key_pairs'} {{(pid=121403) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 01 19:02:37.168501 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.quota [None req-673f98fc-1d8d-4a6a-8725-573914a55e3a tempest-ServersTestJSON-675990056 tempest-ServersTestJSON-675990056-project] Getting quotas for user 71d26d92020b4d4aab9f82d174e1ba9d and project c3dd3fba10d740c9bc38b10dca3007aa. Resources: {'key_pairs'} {{(pid=121403) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 01 19:02:37.228619 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-673f98fc-1d8d-4a6a-8725-573914a55e3a tempest-ServersTestJSON-675990056 tempest-ServersTestJSON-675990056-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.183309 Nov 01 19:02:37.230181 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1134/2256] 10.222.0.13 () {60 vars in 1159 bytes} [Tue Nov 1 19:02:37 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:02:37.237681 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-15b48551-9039-431b-bdd3-1039ff1c980d tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:02:37.239068 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-15b48551-9039-431b-bdd3-1039ff1c980d tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] [instance: 4b9fb909-26f7-40af-bac5-e7d2a6b9fb77] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:02:37.249754 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-15b48551-9039-431b-bdd3-1039ff1c980d tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:37.250682 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-15b48551-9039-431b-bdd3-1039ff1c980d tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:37.251712 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-15b48551-9039-431b-bdd3-1039ff1c980d tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:37.252800 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-15b48551-9039-431b-bdd3-1039ff1c980d tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:37.253755 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-15b48551-9039-431b-bdd3-1039ff1c980d tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:37.254456 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-15b48551-9039-431b-bdd3-1039ff1c980d tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:37.286028 n-d-863052-2 devstack@n-api.service[121403]: DEBUG dbcounter [-] [121403] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 19:02:37.495322 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-15b48551-9039-431b-bdd3-1039ff1c980d tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52acef7992d64d378fd8ac333887fd0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af51b8733e984c2ca87df2d8163dedf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:02:37.534208 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-15b48551-9039-431b-bdd3-1039ff1c980d tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] 10.222.0.13 "GET /compute/v2.1/servers/4b9fb909-26f7-40af-bac5-e7d2a6b9fb77" status: 200 len: 1354 microversion: 2.1 time: 0.296348 Nov 01 19:02:37.536689 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1135/2257] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:02:37 2022] GET /compute/v2.1/servers/4b9fb909-26f7-40af-bac5-e7d2a6b9fb77 => generated 1354 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:02:37.606340 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-664c3ab8-9947-4664-bedc-ea85ecf1dbfc tempest-ImagesNegativeTestJSON-1904451201 tempest-ImagesNegativeTestJSON-1904451201-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:02:37.607394 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-664c3ab8-9947-4664-bedc-ea85ecf1dbfc tempest-ImagesNegativeTestJSON-1904451201 tempest-ImagesNegativeTestJSON-1904451201-project] [instance: 077786bf-b9d6-4b7e-9eb5-ce4612dcd945] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:02:37.620785 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-664c3ab8-9947-4664-bedc-ea85ecf1dbfc tempest-ImagesNegativeTestJSON-1904451201 tempest-ImagesNegativeTestJSON-1904451201-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:37.621513 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-664c3ab8-9947-4664-bedc-ea85ecf1dbfc tempest-ImagesNegativeTestJSON-1904451201 tempest-ImagesNegativeTestJSON-1904451201-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:37.622865 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-664c3ab8-9947-4664-bedc-ea85ecf1dbfc tempest-ImagesNegativeTestJSON-1904451201 tempest-ImagesNegativeTestJSON-1904451201-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:37.624920 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-664c3ab8-9947-4664-bedc-ea85ecf1dbfc tempest-ImagesNegativeTestJSON-1904451201 tempest-ImagesNegativeTestJSON-1904451201-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:37.636351 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-664c3ab8-9947-4664-bedc-ea85ecf1dbfc tempest-ImagesNegativeTestJSON-1904451201 tempest-ImagesNegativeTestJSON-1904451201-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:37.638510 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-664c3ab8-9947-4664-bedc-ea85ecf1dbfc tempest-ImagesNegativeTestJSON-1904451201 tempest-ImagesNegativeTestJSON-1904451201-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:37.981575 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-664c3ab8-9947-4664-bedc-ea85ecf1dbfc tempest-ImagesNegativeTestJSON-1904451201 tempest-ImagesNegativeTestJSON-1904451201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c4a93c606cd4fc98c9b667bfc3d367b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68771d3adba04230a0fc3f69b50cc9b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:02:38.000594 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-664c3ab8-9947-4664-bedc-ea85ecf1dbfc tempest-ImagesNegativeTestJSON-1904451201 tempest-ImagesNegativeTestJSON-1904451201-project] 10.222.0.13 "GET /compute/v2.1/servers/077786bf-b9d6-4b7e-9eb5-ce4612dcd945" status: 200 len: 1316 microversion: 2.1 time: 0.401525 Nov 01 19:02:38.017811 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1136/2258] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:02:37 2022] GET /compute/v2.1/servers/077786bf-b9d6-4b7e-9eb5-ce4612dcd945 => generated 1316 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:02:38.027219 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-17df1c62-0655-4642-aaca-22ad207cc42b tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:02:38.029712 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-17df1c62-0655-4642-aaca-22ad207cc42b tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] [instance: a7f88d19-08ee-47bf-9240-7d49afd775e2] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:02:38.053097 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-17df1c62-0655-4642-aaca-22ad207cc42b tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:38.053612 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-17df1c62-0655-4642-aaca-22ad207cc42b tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:38.054042 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-17df1c62-0655-4642-aaca-22ad207cc42b tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:38.054753 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-17df1c62-0655-4642-aaca-22ad207cc42b tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:38.058211 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-17df1c62-0655-4642-aaca-22ad207cc42b tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:38.058904 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-17df1c62-0655-4642-aaca-22ad207cc42b tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:38.375459 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-603a23df-3666-4da8-8c1f-7b66145a4daa tempest-ServersAdminTestJSON-831008371 tempest-ServersAdminTestJSON-831008371-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/detail?all_tenants=" status: 200 len: 19516 microversion: 2.1 time: 1.793666 Nov 01 19:02:38.377681 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1123/2259] 10.222.0.13 () {58 vars in 1171 bytes} [Tue Nov 1 19:02:36 2022] GET /compute/v2.1/servers/detail?all_tenants= => generated 19516 bytes in 1797 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 01 19:02:38.383536 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-3f6ae192-5430-4e47-97fb-05af68672e42 tempest-ServersTestBootFromVolume-877599095 tempest-ServersTestBootFromVolume-877599095-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:02:38.384146 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-3f6ae192-5430-4e47-97fb-05af68672e42 tempest-ServersTestBootFromVolume-877599095 tempest-ServersTestBootFromVolume-877599095-project] [instance: 44cdf0d8-969b-4149-bb03-6bc390977019] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:02:38.405809 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-3f6ae192-5430-4e47-97fb-05af68672e42 tempest-ServersTestBootFromVolume-877599095 tempest-ServersTestBootFromVolume-877599095-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:38.406388 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-3f6ae192-5430-4e47-97fb-05af68672e42 tempest-ServersTestBootFromVolume-877599095 tempest-ServersTestBootFromVolume-877599095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:38.407153 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-3f6ae192-5430-4e47-97fb-05af68672e42 tempest-ServersTestBootFromVolume-877599095 tempest-ServersTestBootFromVolume-877599095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:38.408054 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-3f6ae192-5430-4e47-97fb-05af68672e42 tempest-ServersTestBootFromVolume-877599095 tempest-ServersTestBootFromVolume-877599095-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:38.408888 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-3f6ae192-5430-4e47-97fb-05af68672e42 tempest-ServersTestBootFromVolume-877599095 tempest-ServersTestBootFromVolume-877599095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:38.409504 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-3f6ae192-5430-4e47-97fb-05af68672e42 tempest-ServersTestBootFromVolume-877599095 tempest-ServersTestBootFromVolume-877599095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:38.510333 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-17df1c62-0655-4642-aaca-22ad207cc42b tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:02:38.525665 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-17df1c62-0655-4642-aaca-22ad207cc42b tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:02:38.531578 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-17df1c62-0655-4642-aaca-22ad207cc42b tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:02:38.533262 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-17df1c62-0655-4642-aaca-22ad207cc42b tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] 10.222.0.13 "GET /compute/v2.1/servers/a7f88d19-08ee-47bf-9240-7d49afd775e2" status: 200 len: 1730 microversion: 2.25 time: 0.514534 Nov 01 19:02:38.538034 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1137/2260] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 19:02:38 2022] GET /compute/v2.1/servers/a7f88d19-08ee-47bf-9240-7d49afd775e2 => generated 1730 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 19:02:38.545011 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [req-1b7c7297-f065-42a7-affb-37b9ec43cfbf req-853ebc23-38de-4c9b-b4d2-cf443d051977 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "077786bf-b9d6-4b7e-9eb5-ce4612dcd945", "name": "network-vif-plugged", "status": "completed", "tag": "82fb1de9-5d12-4172-992b-157d50e3e79c"}]} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:02:38.585685 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-1b7c7297-f065-42a7-affb-37b9ec43cfbf req-853ebc23-38de-4c9b-b4d2-cf443d051977 service nova] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:38.586677 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-1b7c7297-f065-42a7-affb-37b9ec43cfbf req-853ebc23-38de-4c9b-b4d2-cf443d051977 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:38.586677 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-1b7c7297-f065-42a7-affb-37b9ec43cfbf req-853ebc23-38de-4c9b-b4d2-cf443d051977 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:38.615623 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.compute.server_external_events [req-1b7c7297-f065-42a7-affb-37b9ec43cfbf req-853ebc23-38de-4c9b-b4d2-cf443d051977 service nova] Creating event network-vif-plugged:82fb1de9-5d12-4172-992b-157d50e3e79c for instance 077786bf-b9d6-4b7e-9eb5-ce4612dcd945 on n-h2-863052-2 Nov 01 19:02:38.639476 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [req-1b7c7297-f065-42a7-affb-37b9ec43cfbf req-853ebc23-38de-4c9b-b4d2-cf443d051977 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100234 Nov 01 19:02:38.640081 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1138/2261] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Nov 1 19:02:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:02:38.654247 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-73d8fd8b-5be2-446f-b159-b4341999edcd tempest-ServersAdminTestJSON-831008371 tempest-ServersAdminTestJSON-831008371-project-admin] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:02:38.664364 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-73d8fd8b-5be2-446f-b159-b4341999edcd tempest-ServersAdminTestJSON-831008371 tempest-ServersAdminTestJSON-831008371-project-admin] Searching by: {'deleted': False, 'project_id': '04147d3b5e5f4a1a9e3b6a8be9848b50'} {{(pid=121403) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 01 19:02:38.679017 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-73d8fd8b-5be2-446f-b159-b4341999edcd tempest-ServersAdminTestJSON-831008371 tempest-ServersAdminTestJSON-831008371-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:38.683491 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-73d8fd8b-5be2-446f-b159-b4341999edcd tempest-ServersAdminTestJSON-831008371 tempest-ServersAdminTestJSON-831008371-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:38.686235 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-73d8fd8b-5be2-446f-b159-b4341999edcd tempest-ServersAdminTestJSON-831008371 tempest-ServersAdminTestJSON-831008371-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:38.688173 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-73d8fd8b-5be2-446f-b159-b4341999edcd tempest-ServersAdminTestJSON-831008371 tempest-ServersAdminTestJSON-831008371-project-admin] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:38.689110 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-73d8fd8b-5be2-446f-b159-b4341999edcd tempest-ServersAdminTestJSON-831008371 tempest-ServersAdminTestJSON-831008371-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:38.692392 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-73d8fd8b-5be2-446f-b159-b4341999edcd tempest-ServersAdminTestJSON-831008371 tempest-ServersAdminTestJSON-831008371-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:38.764459 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-73d8fd8b-5be2-446f-b159-b4341999edcd tempest-ServersAdminTestJSON-831008371 tempest-ServersAdminTestJSON-831008371-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/detail?tenant_id=3e2520220d454764b8c139a58d78ac83" status: 200 len: 15 microversion: 2.1 time: 0.116817 Nov 01 19:02:38.767189 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1139/2262] 10.222.0.13 () {58 vars in 1231 bytes} [Tue Nov 1 19:02:38 2022] GET /compute/v2.1/servers/detail?tenant_id=3e2520220d454764b8c139a58d78ac83 => generated 15 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 01 19:02:38.772144 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-2f9634ee-0d73-49f4-9257-1f958feeaa9d tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:02:38.776533 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-2f9634ee-0d73-49f4-9257-1f958feeaa9d tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] [instance: 4b9fb909-26f7-40af-bac5-e7d2a6b9fb77] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:02:38.783419 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-2f9634ee-0d73-49f4-9257-1f958feeaa9d tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:38.785250 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-2f9634ee-0d73-49f4-9257-1f958feeaa9d tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:38.785779 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-2f9634ee-0d73-49f4-9257-1f958feeaa9d tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:38.787348 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-2f9634ee-0d73-49f4-9257-1f958feeaa9d tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:38.788006 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-2f9634ee-0d73-49f4-9257-1f958feeaa9d tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:38.788713 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-2f9634ee-0d73-49f4-9257-1f958feeaa9d tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:38.818585 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-3f6ae192-5430-4e47-97fb-05af68672e42 tempest-ServersTestBootFromVolume-877599095 tempest-ServersTestBootFromVolume-877599095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed2352ce53fc4045adde8cd81b78b3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651046528c204df299ca3d14c44b4a7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:02:38.828910 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-3f6ae192-5430-4e47-97fb-05af68672e42 tempest-ServersTestBootFromVolume-877599095 tempest-ServersTestBootFromVolume-877599095-project] 10.222.0.13 "GET /compute/v2.1/servers/44cdf0d8-969b-4149-bb03-6bc390977019" status: 200 len: 1292 microversion: 2.1 time: 0.448053 Nov 01 19:02:38.843317 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1124/2263] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:02:38 2022] GET /compute/v2.1/servers/44cdf0d8-969b-4149-bb03-6bc390977019 => generated 1292 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:02:38.876667 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-3e4fa963-a57d-42e9-8222-f60dae8f973c tempest-ServersAdminTestJSON-831008371 tempest-ServersAdminTestJSON-831008371-project-admin] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:02:38.902722 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-3e4fa963-a57d-42e9-8222-f60dae8f973c tempest-ServersAdminTestJSON-831008371 tempest-ServersAdminTestJSON-831008371-project-admin] Searching by: {'tenant_id': '3e2520220d454764b8c139a58d78ac83', 'deleted': False} {{(pid=121402) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 01 19:02:38.909291 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-3e4fa963-a57d-42e9-8222-f60dae8f973c tempest-ServersAdminTestJSON-831008371 tempest-ServersAdminTestJSON-831008371-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:38.910001 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-3e4fa963-a57d-42e9-8222-f60dae8f973c tempest-ServersAdminTestJSON-831008371 tempest-ServersAdminTestJSON-831008371-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:38.911499 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-3e4fa963-a57d-42e9-8222-f60dae8f973c tempest-ServersAdminTestJSON-831008371 tempest-ServersAdminTestJSON-831008371-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:38.913706 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-3e4fa963-a57d-42e9-8222-f60dae8f973c tempest-ServersAdminTestJSON-831008371 tempest-ServersAdminTestJSON-831008371-project-admin] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:38.914362 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-3e4fa963-a57d-42e9-8222-f60dae8f973c tempest-ServersAdminTestJSON-831008371 tempest-ServersAdminTestJSON-831008371-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:38.915067 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-3e4fa963-a57d-42e9-8222-f60dae8f973c tempest-ServersAdminTestJSON-831008371 tempest-ServersAdminTestJSON-831008371-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:39.058301 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.multi_cell_list [None req-3e4fa963-a57d-42e9-8222-f60dae8f973c tempest-ServersAdminTestJSON-831008371 tempest-ServersAdminTestJSON-831008371-project-admin] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=121402) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 01 19:02:39.204953 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-3e4fa963-a57d-42e9-8222-f60dae8f973c tempest-ServersAdminTestJSON-831008371 tempest-ServersAdminTestJSON-831008371-project-admin] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:39.205969 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-3e4fa963-a57d-42e9-8222-f60dae8f973c tempest-ServersAdminTestJSON-831008371 tempest-ServersAdminTestJSON-831008371-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:39.206603 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-3e4fa963-a57d-42e9-8222-f60dae8f973c tempest-ServersAdminTestJSON-831008371 tempest-ServersAdminTestJSON-831008371-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:39.457188 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-3e4fa963-a57d-42e9-8222-f60dae8f973c tempest-ServersAdminTestJSON-831008371 tempest-ServersAdminTestJSON-831008371-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=3e2520220d454764b8c139a58d78ac83" status: 200 len: 4826 microversion: 2.1 time: 0.612426 Nov 01 19:02:39.472998 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1125/2264] 10.222.0.13 () {58 vars in 1257 bytes} [Tue Nov 1 19:02:38 2022] GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=3e2520220d454764b8c139a58d78ac83 => generated 4826 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:02:39.484560 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-c7295cac-60d8-40f8-9320-ddd15cee2521 tempest-ImagesNegativeTestJSON-1904451201 tempest-ImagesNegativeTestJSON-1904451201-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:02:39.485516 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-c7295cac-60d8-40f8-9320-ddd15cee2521 tempest-ImagesNegativeTestJSON-1904451201 tempest-ImagesNegativeTestJSON-1904451201-project] [instance: 077786bf-b9d6-4b7e-9eb5-ce4612dcd945] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:02:39.492214 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-c7295cac-60d8-40f8-9320-ddd15cee2521 tempest-ImagesNegativeTestJSON-1904451201 tempest-ImagesNegativeTestJSON-1904451201-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:39.493095 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-c7295cac-60d8-40f8-9320-ddd15cee2521 tempest-ImagesNegativeTestJSON-1904451201 tempest-ImagesNegativeTestJSON-1904451201-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:39.493802 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-c7295cac-60d8-40f8-9320-ddd15cee2521 tempest-ImagesNegativeTestJSON-1904451201 tempest-ImagesNegativeTestJSON-1904451201-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:39.494740 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-c7295cac-60d8-40f8-9320-ddd15cee2521 tempest-ImagesNegativeTestJSON-1904451201 tempest-ImagesNegativeTestJSON-1904451201-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:39.495422 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-c7295cac-60d8-40f8-9320-ddd15cee2521 tempest-ImagesNegativeTestJSON-1904451201 tempest-ImagesNegativeTestJSON-1904451201-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:39.496077 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-c7295cac-60d8-40f8-9320-ddd15cee2521 tempest-ImagesNegativeTestJSON-1904451201 tempest-ImagesNegativeTestJSON-1904451201-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:39.555958 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-2f9634ee-0d73-49f4-9257-1f958feeaa9d tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52acef7992d64d378fd8ac333887fd0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af51b8733e984c2ca87df2d8163dedf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:02:39.566486 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-2f9634ee-0d73-49f4-9257-1f958feeaa9d tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] 10.222.0.13 "GET /compute/v2.1/servers/4b9fb909-26f7-40af-bac5-e7d2a6b9fb77" status: 200 len: 1354 microversion: 2.1 time: 0.797950 Nov 01 19:02:39.573574 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1140/2265] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:02:38 2022] GET /compute/v2.1/servers/4b9fb909-26f7-40af-bac5-e7d2a6b9fb77 => generated 1354 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:02:39.582521 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [req-8780e647-11c3-42b2-bb0c-72b8fc7d1032 req-37d3df18-af65-4a49-b11b-03b24afd7add service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a7f88d19-08ee-47bf-9240-7d49afd775e2", "name": "network-vif-deleted", "tag": "01aee5f9-544a-4c0f-b9a3-2410eedf25a5"}]} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:02:39.615360 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-8780e647-11c3-42b2-bb0c-72b8fc7d1032 req-37d3df18-af65-4a49-b11b-03b24afd7add service nova] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:39.617563 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-8780e647-11c3-42b2-bb0c-72b8fc7d1032 req-37d3df18-af65-4a49-b11b-03b24afd7add service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:39.621398 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-8780e647-11c3-42b2-bb0c-72b8fc7d1032 req-37d3df18-af65-4a49-b11b-03b24afd7add service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:39.643936 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.compute.server_external_events [req-8780e647-11c3-42b2-bb0c-72b8fc7d1032 req-37d3df18-af65-4a49-b11b-03b24afd7add service nova] Creating event network-vif-deleted:01aee5f9-544a-4c0f-b9a3-2410eedf25a5 for instance a7f88d19-08ee-47bf-9240-7d49afd775e2 on n-h1-863052-2 Nov 01 19:02:39.649628 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [req-8780e647-11c3-42b2-bb0c-72b8fc7d1032 req-37d3df18-af65-4a49-b11b-03b24afd7add service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074524 Nov 01 19:02:39.651050 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1141/2266] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Nov 1 19:02:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:02:39.657678 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-98317fdd-ebbf-4caa-9da9-1a2b1c60da01 tempest-ServersAdminTestJSON-831008371 tempest-ServersAdminTestJSON-831008371-project-admin] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:02:39.673248 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-98317fdd-ebbf-4caa-9da9-1a2b1c60da01 tempest-ServersAdminTestJSON-831008371 tempest-ServersAdminTestJSON-831008371-project-admin] Searching by: {'tenant_id': '04147d3b5e5f4a1a9e3b6a8be9848b50', 'deleted': False} {{(pid=121403) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 01 19:02:39.688845 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-98317fdd-ebbf-4caa-9da9-1a2b1c60da01 tempest-ServersAdminTestJSON-831008371 tempest-ServersAdminTestJSON-831008371-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:39.689295 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-98317fdd-ebbf-4caa-9da9-1a2b1c60da01 tempest-ServersAdminTestJSON-831008371 tempest-ServersAdminTestJSON-831008371-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:39.689801 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-98317fdd-ebbf-4caa-9da9-1a2b1c60da01 tempest-ServersAdminTestJSON-831008371 tempest-ServersAdminTestJSON-831008371-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:39.690588 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-98317fdd-ebbf-4caa-9da9-1a2b1c60da01 tempest-ServersAdminTestJSON-831008371 tempest-ServersAdminTestJSON-831008371-project-admin] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:39.691197 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-98317fdd-ebbf-4caa-9da9-1a2b1c60da01 tempest-ServersAdminTestJSON-831008371 tempest-ServersAdminTestJSON-831008371-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:39.691640 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-98317fdd-ebbf-4caa-9da9-1a2b1c60da01 tempest-ServersAdminTestJSON-831008371 tempest-ServersAdminTestJSON-831008371-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:39.759426 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-98317fdd-ebbf-4caa-9da9-1a2b1c60da01 tempest-ServersAdminTestJSON-831008371 tempest-ServersAdminTestJSON-831008371-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=04147d3b5e5f4a1a9e3b6a8be9848b50" status: 200 len: 15 microversion: 2.1 time: 0.106685 Nov 01 19:02:39.765870 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1142/2267] 10.222.0.13 () {58 vars in 1257 bytes} [Tue Nov 1 19:02:39 2022] GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=04147d3b5e5f4a1a9e3b6a8be9848b50 => generated 15 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 01 19:02:39.773352 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-4045f5eb-ca97-47ea-b4a6-5c44f2a3e891 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:02:39.774420 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-4045f5eb-ca97-47ea-b4a6-5c44f2a3e891 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] [instance: a7f88d19-08ee-47bf-9240-7d49afd775e2] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:02:39.789259 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-4045f5eb-ca97-47ea-b4a6-5c44f2a3e891 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:39.789865 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-4045f5eb-ca97-47ea-b4a6-5c44f2a3e891 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:39.791644 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-4045f5eb-ca97-47ea-b4a6-5c44f2a3e891 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:39.792992 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-4045f5eb-ca97-47ea-b4a6-5c44f2a3e891 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:39.794955 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-4045f5eb-ca97-47ea-b4a6-5c44f2a3e891 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:39.798805 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-4045f5eb-ca97-47ea-b4a6-5c44f2a3e891 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:39.891156 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-4045f5eb-ca97-47ea-b4a6-5c44f2a3e891 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:39.892037 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-4045f5eb-ca97-47ea-b4a6-5c44f2a3e891 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:39.892767 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-4045f5eb-ca97-47ea-b4a6-5c44f2a3e891 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:39.893446 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.objects.instance [None req-4045f5eb-ca97-47ea-b4a6-5c44f2a3e891 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lazy-loading 'fault' on Instance uuid a7f88d19-08ee-47bf-9240-7d49afd775e2 {{(pid=121403) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 01 19:02:39.966400 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-4045f5eb-ca97-47ea-b4a6-5c44f2a3e891 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:02:39.978288 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-4045f5eb-ca97-47ea-b4a6-5c44f2a3e891 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:02:39.979713 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-4045f5eb-ca97-47ea-b4a6-5c44f2a3e891 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:02:39.980905 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-4045f5eb-ca97-47ea-b4a6-5c44f2a3e891 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] 10.222.0.13 "GET /compute/v2.1/servers/a7f88d19-08ee-47bf-9240-7d49afd775e2" status: 200 len: 1375 microversion: 2.25 time: 0.213856 Nov 01 19:02:39.982036 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1143/2268] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 19:02:39 2022] GET /compute/v2.1/servers/a7f88d19-08ee-47bf-9240-7d49afd775e2 => generated 1375 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 19:02:39.986664 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-d5644a0d-71fc-4bef-b769-9d8f122d3c6f tempest-ServersAdminTestJSON-831008371 tempest-ServersAdminTestJSON-831008371-project-admin] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:02:39.993069 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-d5644a0d-71fc-4bef-b769-9d8f122d3c6f tempest-ServersAdminTestJSON-831008371 tempest-ServersAdminTestJSON-831008371-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/detail?status=invalid_status" status: 200 len: 15 microversion: 2.1 time: 0.009599 Nov 01 19:02:39.994367 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1144/2269] 10.222.0.13 () {58 vars in 1189 bytes} [Tue Nov 1 19:02:39 2022] GET /compute/v2.1/servers/detail?status=invalid_status => generated 15 bytes in 11 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 01 19:02:39.999322 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-e7991e38-8c1e-42bf-956c-351f04df7783 tempest-ServersTestBootFromVolume-877599095 tempest-ServersTestBootFromVolume-877599095-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:02:40.000113 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-e7991e38-8c1e-42bf-956c-351f04df7783 tempest-ServersTestBootFromVolume-877599095 tempest-ServersTestBootFromVolume-877599095-project] [instance: 44cdf0d8-969b-4149-bb03-6bc390977019] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:02:40.006735 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-e7991e38-8c1e-42bf-956c-351f04df7783 tempest-ServersTestBootFromVolume-877599095 tempest-ServersTestBootFromVolume-877599095-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:40.007455 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-e7991e38-8c1e-42bf-956c-351f04df7783 tempest-ServersTestBootFromVolume-877599095 tempest-ServersTestBootFromVolume-877599095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:40.008124 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-e7991e38-8c1e-42bf-956c-351f04df7783 tempest-ServersTestBootFromVolume-877599095 tempest-ServersTestBootFromVolume-877599095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:40.009029 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-e7991e38-8c1e-42bf-956c-351f04df7783 tempest-ServersTestBootFromVolume-877599095 tempest-ServersTestBootFromVolume-877599095-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:40.009641 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-e7991e38-8c1e-42bf-956c-351f04df7783 tempest-ServersTestBootFromVolume-877599095 tempest-ServersTestBootFromVolume-877599095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:40.010226 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-e7991e38-8c1e-42bf-956c-351f04df7783 tempest-ServersTestBootFromVolume-877599095 tempest-ServersTestBootFromVolume-877599095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:40.045443 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-c7295cac-60d8-40f8-9320-ddd15cee2521 tempest-ImagesNegativeTestJSON-1904451201 tempest-ImagesNegativeTestJSON-1904451201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c4a93c606cd4fc98c9b667bfc3d367b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68771d3adba04230a0fc3f69b50cc9b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:02:40.054658 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-c7295cac-60d8-40f8-9320-ddd15cee2521 tempest-ImagesNegativeTestJSON-1904451201 tempest-ImagesNegativeTestJSON-1904451201-project] 10.222.0.13 "GET /compute/v2.1/servers/077786bf-b9d6-4b7e-9eb5-ce4612dcd945" status: 200 len: 1316 microversion: 2.1 time: 0.580446 Nov 01 19:02:40.064150 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1126/2270] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:02:39 2022] GET /compute/v2.1/servers/077786bf-b9d6-4b7e-9eb5-ce4612dcd945 => generated 1316 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:02:40.083982 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-0c541e7e-3a25-4668-8ad7-d11869b5ed1c tempest-ServersAdminTestJSON-831008371 tempest-ServersAdminTestJSON-831008371-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:02:40.091019 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-0c541e7e-3a25-4668-8ad7-d11869b5ed1c tempest-ServersAdminTestJSON-831008371 tempest-ServersAdminTestJSON-831008371-project-admin] [instance: 992f5ec5-d256-4870-b16d-fc8d9adbd3e7] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:02:40.110612 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-0c541e7e-3a25-4668-8ad7-d11869b5ed1c tempest-ServersAdminTestJSON-831008371 tempest-ServersAdminTestJSON-831008371-project-admin] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:40.111982 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-0c541e7e-3a25-4668-8ad7-d11869b5ed1c tempest-ServersAdminTestJSON-831008371 tempest-ServersAdminTestJSON-831008371-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:40.112720 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-0c541e7e-3a25-4668-8ad7-d11869b5ed1c tempest-ServersAdminTestJSON-831008371 tempest-ServersAdminTestJSON-831008371-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:40.113898 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-0c541e7e-3a25-4668-8ad7-d11869b5ed1c tempest-ServersAdminTestJSON-831008371 tempest-ServersAdminTestJSON-831008371-project-admin] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:40.117239 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-0c541e7e-3a25-4668-8ad7-d11869b5ed1c tempest-ServersAdminTestJSON-831008371 tempest-ServersAdminTestJSON-831008371-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:40.117965 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-0c541e7e-3a25-4668-8ad7-d11869b5ed1c tempest-ServersAdminTestJSON-831008371 tempest-ServersAdminTestJSON-831008371-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:40.234770 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-0c541e7e-3a25-4668-8ad7-d11869b5ed1c tempest-ServersAdminTestJSON-831008371 tempest-ServersAdminTestJSON-831008371-project-admin] 10.222.0.13 "POST /compute/v2.1/servers/992f5ec5-d256-4870-b16d-fc8d9adbd3e7/action" status: 202 len: 0 microversion: 2.1 time: 0.154366 Nov 01 19:02:40.238967 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1127/2271] 10.222.0.13 () {60 vars in 1278 bytes} [Tue Nov 1 19:02:40 2022] POST /compute/v2.1/servers/992f5ec5-d256-4870-b16d-fc8d9adbd3e7/action => generated 0 bytes in 172 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 01 19:02:40.246320 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-87cc06ad-2395-4dcc-9183-034ec2950d8f tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:02:40.253854 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-87cc06ad-2395-4dcc-9183-034ec2950d8f tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'bcb496b3faac4abbae73d389f2042e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e2520220d454764b8c139a58d78ac83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:02:40.256615 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-87cc06ad-2395-4dcc-9183-034ec2950d8f tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Searching by: {'vm_state': ['error'], 'deleted': False, 'project_id': '3e2520220d454764b8c139a58d78ac83'} {{(pid=121402) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 01 19:02:40.266676 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-87cc06ad-2395-4dcc-9183-034ec2950d8f tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:40.267837 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-87cc06ad-2395-4dcc-9183-034ec2950d8f tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:40.268507 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-87cc06ad-2395-4dcc-9183-034ec2950d8f tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:40.269871 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-87cc06ad-2395-4dcc-9183-034ec2950d8f tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:40.270647 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-87cc06ad-2395-4dcc-9183-034ec2950d8f tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:40.271447 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-87cc06ad-2395-4dcc-9183-034ec2950d8f tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:40.288399 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-e7991e38-8c1e-42bf-956c-351f04df7783 tempest-ServersTestBootFromVolume-877599095 tempest-ServersTestBootFromVolume-877599095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed2352ce53fc4045adde8cd81b78b3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651046528c204df299ca3d14c44b4a7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:02:40.296814 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-e7991e38-8c1e-42bf-956c-351f04df7783 tempest-ServersTestBootFromVolume-877599095 tempest-ServersTestBootFromVolume-877599095-project] 10.222.0.13 "GET /compute/v2.1/servers/44cdf0d8-969b-4149-bb03-6bc390977019" status: 200 len: 1292 microversion: 2.1 time: 0.301122 Nov 01 19:02:40.297405 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1145/2272] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:02:39 2022] GET /compute/v2.1/servers/44cdf0d8-969b-4149-bb03-6bc390977019 => generated 1292 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:02:40.482450 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.multi_cell_list [None req-87cc06ad-2395-4dcc-9183-034ec2950d8f tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=121402) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 01 19:02:40.595430 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-5a3190e0-1378-41d6-85d7-976f0de51c3d tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:02:40.596047 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-5a3190e0-1378-41d6-85d7-976f0de51c3d tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] [instance: 4b9fb909-26f7-40af-bac5-e7d2a6b9fb77] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:02:40.605365 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-5a3190e0-1378-41d6-85d7-976f0de51c3d tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:40.606825 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-5a3190e0-1378-41d6-85d7-976f0de51c3d tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:40.608413 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-5a3190e0-1378-41d6-85d7-976f0de51c3d tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:40.610513 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-5a3190e0-1378-41d6-85d7-976f0de51c3d tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:40.611349 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-5a3190e0-1378-41d6-85d7-976f0de51c3d tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:40.612261 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-5a3190e0-1378-41d6-85d7-976f0de51c3d tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:40.616457 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-87cc06ad-2395-4dcc-9183-034ec2950d8f tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] 10.222.0.13 "GET /compute/v2.1/servers?status=error" status: 200 len: 339 microversion: 2.1 time: 0.376354 Nov 01 19:02:40.617613 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1128/2273] 10.222.0.13 () {58 vars in 1150 bytes} [Tue Nov 1 19:02:40 2022] GET /compute/v2.1/servers?status=error => generated 339 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:02:40.633484 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-56c1c332-4444-43c1-b1c2-d94d1385afaf tempest-ServersAdminTestJSON-831008371 tempest-ServersAdminTestJSON-831008371-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "active"}} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:02:40.638451 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-56c1c332-4444-43c1-b1c2-d94d1385afaf tempest-ServersAdminTestJSON-831008371 tempest-ServersAdminTestJSON-831008371-project-admin] [instance: 992f5ec5-d256-4870-b16d-fc8d9adbd3e7] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:02:40.658034 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-56c1c332-4444-43c1-b1c2-d94d1385afaf tempest-ServersAdminTestJSON-831008371 tempest-ServersAdminTestJSON-831008371-project-admin] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:40.659406 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-56c1c332-4444-43c1-b1c2-d94d1385afaf tempest-ServersAdminTestJSON-831008371 tempest-ServersAdminTestJSON-831008371-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:40.660239 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-56c1c332-4444-43c1-b1c2-d94d1385afaf tempest-ServersAdminTestJSON-831008371 tempest-ServersAdminTestJSON-831008371-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:40.661249 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-56c1c332-4444-43c1-b1c2-d94d1385afaf tempest-ServersAdminTestJSON-831008371 tempest-ServersAdminTestJSON-831008371-project-admin] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:40.663017 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-56c1c332-4444-43c1-b1c2-d94d1385afaf tempest-ServersAdminTestJSON-831008371 tempest-ServersAdminTestJSON-831008371-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:40.663848 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-56c1c332-4444-43c1-b1c2-d94d1385afaf tempest-ServersAdminTestJSON-831008371 tempest-ServersAdminTestJSON-831008371-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:40.773927 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-56c1c332-4444-43c1-b1c2-d94d1385afaf tempest-ServersAdminTestJSON-831008371 tempest-ServersAdminTestJSON-831008371-project-admin] 10.222.0.13 "POST /compute/v2.1/servers/992f5ec5-d256-4870-b16d-fc8d9adbd3e7/action" status: 202 len: 0 microversion: 2.1 time: 0.148677 Nov 01 19:02:40.774964 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1129/2274] 10.222.0.13 () {60 vars in 1278 bytes} [Tue Nov 1 19:02:40 2022] POST /compute/v2.1/servers/992f5ec5-d256-4870-b16d-fc8d9adbd3e7/action => generated 0 bytes in 151 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 01 19:02:40.782977 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-462d659c-f4d4-4158-bc49-e12d9356b41c tempest-ServersAdminTestJSON-831008371 tempest-ServersAdminTestJSON-831008371-project-admin] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:02:40.783599 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-462d659c-f4d4-4158-bc49-e12d9356b41c tempest-ServersAdminTestJSON-831008371 tempest-ServersAdminTestJSON-831008371-project-admin] [instance: 992f5ec5-d256-4870-b16d-fc8d9adbd3e7] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:02:40.790511 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-462d659c-f4d4-4158-bc49-e12d9356b41c tempest-ServersAdminTestJSON-831008371 tempest-ServersAdminTestJSON-831008371-project-admin] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:40.791315 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-462d659c-f4d4-4158-bc49-e12d9356b41c tempest-ServersAdminTestJSON-831008371 tempest-ServersAdminTestJSON-831008371-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:40.792000 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-462d659c-f4d4-4158-bc49-e12d9356b41c tempest-ServersAdminTestJSON-831008371 tempest-ServersAdminTestJSON-831008371-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:40.792789 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-462d659c-f4d4-4158-bc49-e12d9356b41c tempest-ServersAdminTestJSON-831008371 tempest-ServersAdminTestJSON-831008371-project-admin] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:40.793254 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-462d659c-f4d4-4158-bc49-e12d9356b41c tempest-ServersAdminTestJSON-831008371 tempest-ServersAdminTestJSON-831008371-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:40.793680 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-462d659c-f4d4-4158-bc49-e12d9356b41c tempest-ServersAdminTestJSON-831008371 tempest-ServersAdminTestJSON-831008371-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:41.002386 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-462d659c-f4d4-4158-bc49-e12d9356b41c tempest-ServersAdminTestJSON-831008371 tempest-ServersAdminTestJSON-831008371-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/992f5ec5-d256-4870-b16d-fc8d9adbd3e7" status: 200 len: 1615 microversion: 2.1 time: 0.223039 Nov 01 19:02:41.003162 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1130/2275] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:02:40 2022] GET /compute/v2.1/servers/992f5ec5-d256-4870-b16d-fc8d9adbd3e7 => generated 1615 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 19:02:41.022553 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-6ab28409-7c56-4c14-84a7-504b16f56391 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:02:41.023799 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-6ab28409-7c56-4c14-84a7-504b16f56391 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] [instance: a7f88d19-08ee-47bf-9240-7d49afd775e2] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:02:41.030728 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-6ab28409-7c56-4c14-84a7-504b16f56391 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:41.031431 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-6ab28409-7c56-4c14-84a7-504b16f56391 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:41.031937 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-6ab28409-7c56-4c14-84a7-504b16f56391 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:41.032875 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-6ab28409-7c56-4c14-84a7-504b16f56391 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:41.033702 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-6ab28409-7c56-4c14-84a7-504b16f56391 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:41.033883 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-6ab28409-7c56-4c14-84a7-504b16f56391 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:41.048354 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.wsgi [None req-6ab28409-7c56-4c14-84a7-504b16f56391 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] HTTP exception thrown: Instance a7f88d19-08ee-47bf-9240-7d49afd775e2 could not be found. Nov 01 19:02:41.050832 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-6ab28409-7c56-4c14-84a7-504b16f56391 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Request method failure captured: Nov 01 19:02:41.050832 n-d-863052-2 devstack@n-api.service[121402]: request: GET /compute/v2.1/servers/a7f88d19-08ee-47bf-9240-7d49afd775e2 HTTP/1.1 Nov 01 19:02:41.050832 n-d-863052-2 devstack@n-api.service[121402]: Accept: application/json Nov 01 19:02:41.050832 n-d-863052-2 devstack@n-api.service[121402]: Accept-Encoding: identity Nov 01 19:02:41.050832 n-d-863052-2 devstack@n-api.service[121402]: Connection: close Nov 01 19:02:41.050832 n-d-863052-2 devstack@n-api.service[121402]: Content-Length: 0 Nov 01 19:02:41.050832 n-d-863052-2 devstack@n-api.service[121402]: Content-Type: application/json Nov 01 19:02:41.050832 n-d-863052-2 devstack@n-api.service[121402]: Host: 10.222.0.13 Nov 01 19:02:41.050832 n-d-863052-2 devstack@n-api.service[121402]: Openstack-System-Scope: None Nov 01 19:02:41.050832 n-d-863052-2 devstack@n-api.service[121402]: User-Agent: python-urllib3/1.26.12 Nov 01 19:02:41.050832 n-d-863052-2 devstack@n-api.service[121402]: X-Auth-Token: gAAAAABjYWuXbvFs9aS-AI-YunBpI7JW1G7TtGj9lNPX9_m5x7yvx5NDb5_8tZxcZ9OJEVvcArKsi1gBG0i_m2a-mPBO8TJfCOQY2BcBWVVWE6IstJB3B2-12IsAPiHj9lscAGshtM26YMMYwGnt2-cysTVDO07JS8LPF_YKr1_xNELllwy_Puk Nov 01 19:02:41.050832 n-d-863052-2 devstack@n-api.service[121402]: X-Domain-Id: None Nov 01 19:02:41.050832 n-d-863052-2 devstack@n-api.service[121402]: X-Domain-Name: None Nov 01 19:02:41.050832 n-d-863052-2 devstack@n-api.service[121402]: X-Identity-Status: Confirmed Nov 01 19:02:41.050832 n-d-863052-2 devstack@n-api.service[121402]: X-Is-Admin-Project: True Nov 01 19:02:41.050832 n-d-863052-2 devstack@n-api.service[121402]: X-Openstack-Nova-Api-Version: 2.25 Nov 01 19:02:41.050832 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Domain-Id: default Nov 01 19:02:41.050832 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Domain-Name: Default Nov 01 19:02:41.050832 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Id: 75730f90ec924cbebd605d6d6d747efe Nov 01 19:02:41.050832 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-1114814424 Nov 01 19:02:41.050832 n-d-863052-2 devstack@n-api.service[121402]: X-Role: member,reader Nov 01 19:02:41.050832 n-d-863052-2 devstack@n-api.service[121402]: X-Roles: member,reader Nov 01 19:02:41.050832 n-d-863052-2 devstack@n-api.service[121402]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/75730f90ec924cbebd605d6d6d747efe"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/75730f90ec924cbebd605d6d6d747efe"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_75730f90ec924cbebd605d6d6d747efe", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/75730f90ec924cbebd605d6d6d747efe"}]}] Nov 01 19:02:41.050832 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-1114814424 Nov 01 19:02:41.050832 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant-Id: 75730f90ec924cbebd605d6d6d747efe Nov 01 19:02:41.050832 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-1114814424 Nov 01 19:02:41.050832 n-d-863052-2 devstack@n-api.service[121402]: X-User: tempest-LiveAutoBlockMigrationV225Test-1114814424-project Nov 01 19:02:41.050832 n-d-863052-2 devstack@n-api.service[121402]: X-User-Domain-Id: default Nov 01 19:02:41.050832 n-d-863052-2 devstack@n-api.service[121402]: X-User-Domain-Name: Default Nov 01 19:02:41.050832 n-d-863052-2 devstack@n-api.service[121402]: X-User-Id: c2ddf0211c374fe2a0db89546beb8e96 Nov 01 19:02:41.050832 n-d-863052-2 devstack@n-api.service[121402]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-1114814424-project Nov 01 19:02:41.050832 n-d-863052-2 devstack@n-api.service[121402]: method: > Nov 01 19:02:41.050832 n-d-863052-2 devstack@n-api.service[121402]: exception: Instance a7f88d19-08ee-47bf-9240-7d49afd775e2 could not be found. Nov 01 19:02:41.050832 n-d-863052-2 devstack@n-api.service[121402]: action_args: {'id': 'a7f88d19-08ee-47bf-9240-7d49afd775e2'} Nov 01 19:02:41.050832 n-d-863052-2 devstack@n-api.service[121402]: {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 01 19:02:41.050832 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:02:41.050832 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 01 19:02:41.050832 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 01 19:02:41.050832 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 01 19:02:41.050832 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 01 19:02:41.050832 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 01 19:02:41.050832 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 01 19:02:41.050832 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 01 19:02:41.050832 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 01 19:02:41.050832 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a7f88d19-08ee-47bf-9240-7d49afd775e2 could not be found. Nov 01 19:02:41.050832 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:02:41.050832 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:02:41.050832 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:02:41.050832 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:02:41.050832 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:02:41.050832 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:02:41.050832 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 01 19:02:41.050832 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 01 19:02:41.050832 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 01 19:02:41.050832 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 01 19:02:41.050832 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 01 19:02:41.050832 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 01 19:02:41.050832 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 01 19:02:41.050832 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 01 19:02:41.050832 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 01 19:02:41.050832 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 01 19:02:41.050832 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a7f88d19-08ee-47bf-9240-7d49afd775e2 could not be found. Nov 01 19:02:41.050832 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:02:41.057156 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:02:41.057156 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:02:41.057156 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:02:41.057156 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:02:41.057156 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:02:41.057156 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 01 19:02:41.057156 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 01 19:02:41.057156 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a7f88d19-08ee-47bf-9240-7d49afd775e2 could not be found. Nov 01 19:02:41.057156 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:02:41.057156 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-6ab28409-7c56-4c14-84a7-504b16f56391 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Returning 404 to user: Instance a7f88d19-08ee-47bf-9240-7d49afd775e2 could not be found. {{(pid=121402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 01 19:02:41.057156 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-6ab28409-7c56-4c14-84a7-504b16f56391 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] 10.222.0.13 "GET /compute/v2.1/servers/a7f88d19-08ee-47bf-9240-7d49afd775e2" status: 404 len: 111 microversion: 2.25 time: 0.039470 Nov 01 19:02:41.057156 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1131/2276] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 19:02:41 2022] GET /compute/v2.1/servers/a7f88d19-08ee-47bf-9240-7d49afd775e2 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Nov 01 19:02:41.062677 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-3f20e66f-4e15-46a9-8b1f-5ba1f4660fe2 tempest-ServersAdminTestJSON-831008371 tempest-ServersAdminTestJSON-831008371-project-admin] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:02:41.063455 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-3f20e66f-4e15-46a9-8b1f-5ba1f4660fe2 tempest-ServersAdminTestJSON-831008371 tempest-ServersAdminTestJSON-831008371-project-admin] [instance: 992f5ec5-d256-4870-b16d-fc8d9adbd3e7] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:02:41.070344 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-3f20e66f-4e15-46a9-8b1f-5ba1f4660fe2 tempest-ServersAdminTestJSON-831008371 tempest-ServersAdminTestJSON-831008371-project-admin] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:41.070935 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-3f20e66f-4e15-46a9-8b1f-5ba1f4660fe2 tempest-ServersAdminTestJSON-831008371 tempest-ServersAdminTestJSON-831008371-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:41.071434 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-3f20e66f-4e15-46a9-8b1f-5ba1f4660fe2 tempest-ServersAdminTestJSON-831008371 tempest-ServersAdminTestJSON-831008371-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:41.072206 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-3f20e66f-4e15-46a9-8b1f-5ba1f4660fe2 tempest-ServersAdminTestJSON-831008371 tempest-ServersAdminTestJSON-831008371-project-admin] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:41.072761 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-3f20e66f-4e15-46a9-8b1f-5ba1f4660fe2 tempest-ServersAdminTestJSON-831008371 tempest-ServersAdminTestJSON-831008371-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:41.073249 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-3f20e66f-4e15-46a9-8b1f-5ba1f4660fe2 tempest-ServersAdminTestJSON-831008371 tempest-ServersAdminTestJSON-831008371-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:41.215404 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-3f20e66f-4e15-46a9-8b1f-5ba1f4660fe2 tempest-ServersAdminTestJSON-831008371 tempest-ServersAdminTestJSON-831008371-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/992f5ec5-d256-4870-b16d-fc8d9adbd3e7" status: 200 len: 1615 microversion: 2.1 time: 0.157255 Nov 01 19:02:41.226552 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1132/2277] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:02:41 2022] GET /compute/v2.1/servers/992f5ec5-d256-4870-b16d-fc8d9adbd3e7 => generated 1615 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:02:41.226552 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-86faf838-8b6f-4984-ac07-dac8f7bf6052 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Calling method '.version_select at 0x7f0ae255eb80>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:02:41.247129 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-86faf838-8b6f-4984-ac07-dac8f7bf6052 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-608263486" status: 204 len: 0 microversion: 2.25 time: 0.029468 Nov 01 19:02:41.247861 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1133/2278] 10.222.0.13 () {60 vars in 1259 bytes} [Tue Nov 1 19:02:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-608263486 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 01 19:02:41.255131 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-dfbe3afb-76a1-4c9a-a529-a187585c6eb5 tempest-ImagesNegativeTestJSON-1904451201 tempest-ImagesNegativeTestJSON-1904451201-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:02:41.256768 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-dfbe3afb-76a1-4c9a-a529-a187585c6eb5 tempest-ImagesNegativeTestJSON-1904451201 tempest-ImagesNegativeTestJSON-1904451201-project] [instance: 077786bf-b9d6-4b7e-9eb5-ce4612dcd945] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:02:41.264785 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-dfbe3afb-76a1-4c9a-a529-a187585c6eb5 tempest-ImagesNegativeTestJSON-1904451201 tempest-ImagesNegativeTestJSON-1904451201-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:41.265675 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-dfbe3afb-76a1-4c9a-a529-a187585c6eb5 tempest-ImagesNegativeTestJSON-1904451201 tempest-ImagesNegativeTestJSON-1904451201-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:41.266351 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-dfbe3afb-76a1-4c9a-a529-a187585c6eb5 tempest-ImagesNegativeTestJSON-1904451201 tempest-ImagesNegativeTestJSON-1904451201-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:41.267255 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-dfbe3afb-76a1-4c9a-a529-a187585c6eb5 tempest-ImagesNegativeTestJSON-1904451201 tempest-ImagesNegativeTestJSON-1904451201-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:41.268847 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-dfbe3afb-76a1-4c9a-a529-a187585c6eb5 tempest-ImagesNegativeTestJSON-1904451201 tempest-ImagesNegativeTestJSON-1904451201-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:41.269296 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-dfbe3afb-76a1-4c9a-a529-a187585c6eb5 tempest-ImagesNegativeTestJSON-1904451201 tempest-ImagesNegativeTestJSON-1904451201-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:41.379684 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-5a3190e0-1378-41d6-85d7-976f0de51c3d tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52acef7992d64d378fd8ac333887fd0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af51b8733e984c2ca87df2d8163dedf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:02:41.393352 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-5a3190e0-1378-41d6-85d7-976f0de51c3d tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] 10.222.0.13 "GET /compute/v2.1/servers/4b9fb909-26f7-40af-bac5-e7d2a6b9fb77" status: 200 len: 1354 microversion: 2.1 time: 0.800715 Nov 01 19:02:41.395226 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1146/2279] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:02:40 2022] GET /compute/v2.1/servers/4b9fb909-26f7-40af-bac5-e7d2a6b9fb77 => generated 1354 bytes in 804 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 19:02:41.402541 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-5bb399a2-ffac-4b89-89a2-6eb5c5e5dc32 tempest-ServersAdminTestJSON-831008371 tempest-ServersAdminTestJSON-831008371-project-admin] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:02:41.418228 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-5bb399a2-ffac-4b89-89a2-6eb5c5e5dc32 tempest-ServersAdminTestJSON-831008371 tempest-ServersAdminTestJSON-831008371-project-admin] Searching by: {'host': 'n-h1-863052-2', 'deleted': False} {{(pid=121403) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 01 19:02:41.424792 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-5bb399a2-ffac-4b89-89a2-6eb5c5e5dc32 tempest-ServersAdminTestJSON-831008371 tempest-ServersAdminTestJSON-831008371-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:41.425632 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-5bb399a2-ffac-4b89-89a2-6eb5c5e5dc32 tempest-ServersAdminTestJSON-831008371 tempest-ServersAdminTestJSON-831008371-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:41.426606 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-5bb399a2-ffac-4b89-89a2-6eb5c5e5dc32 tempest-ServersAdminTestJSON-831008371 tempest-ServersAdminTestJSON-831008371-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:41.428482 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-5bb399a2-ffac-4b89-89a2-6eb5c5e5dc32 tempest-ServersAdminTestJSON-831008371 tempest-ServersAdminTestJSON-831008371-project-admin] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:41.429070 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-5bb399a2-ffac-4b89-89a2-6eb5c5e5dc32 tempest-ServersAdminTestJSON-831008371 tempest-ServersAdminTestJSON-831008371-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:41.429736 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-5bb399a2-ffac-4b89-89a2-6eb5c5e5dc32 tempest-ServersAdminTestJSON-831008371 tempest-ServersAdminTestJSON-831008371-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:41.517293 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-dfbe3afb-76a1-4c9a-a529-a187585c6eb5 tempest-ImagesNegativeTestJSON-1904451201 tempest-ImagesNegativeTestJSON-1904451201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c4a93c606cd4fc98c9b667bfc3d367b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68771d3adba04230a0fc3f69b50cc9b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:02:41.527442 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-dfbe3afb-76a1-4c9a-a529-a187585c6eb5 tempest-ImagesNegativeTestJSON-1904451201 tempest-ImagesNegativeTestJSON-1904451201-project] 10.222.0.13 "GET /compute/v2.1/servers/077786bf-b9d6-4b7e-9eb5-ce4612dcd945" status: 200 len: 1505 microversion: 2.1 time: 0.278506 Nov 01 19:02:41.532645 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1134/2280] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:02:41 2022] GET /compute/v2.1/servers/077786bf-b9d6-4b7e-9eb5-ce4612dcd945 => generated 1505 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:02:41.538837 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-26d6f9bc-331f-4a3d-9d60-a49ff73607cc tempest-ServersTestBootFromVolume-877599095 tempest-ServersTestBootFromVolume-877599095-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:02:41.564864 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-26d6f9bc-331f-4a3d-9d60-a49ff73607cc tempest-ServersTestBootFromVolume-877599095 tempest-ServersTestBootFromVolume-877599095-project] [instance: 44cdf0d8-969b-4149-bb03-6bc390977019] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:02:41.575804 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-26d6f9bc-331f-4a3d-9d60-a49ff73607cc tempest-ServersTestBootFromVolume-877599095 tempest-ServersTestBootFromVolume-877599095-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:41.576538 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-26d6f9bc-331f-4a3d-9d60-a49ff73607cc tempest-ServersTestBootFromVolume-877599095 tempest-ServersTestBootFromVolume-877599095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:41.577337 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-26d6f9bc-331f-4a3d-9d60-a49ff73607cc tempest-ServersTestBootFromVolume-877599095 tempest-ServersTestBootFromVolume-877599095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:41.578236 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-26d6f9bc-331f-4a3d-9d60-a49ff73607cc tempest-ServersTestBootFromVolume-877599095 tempest-ServersTestBootFromVolume-877599095-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:41.578879 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-26d6f9bc-331f-4a3d-9d60-a49ff73607cc tempest-ServersTestBootFromVolume-877599095 tempest-ServersTestBootFromVolume-877599095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:41.579478 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-26d6f9bc-331f-4a3d-9d60-a49ff73607cc tempest-ServersTestBootFromVolume-877599095 tempest-ServersTestBootFromVolume-877599095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:41.581482 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.multi_cell_list [None req-5bb399a2-ffac-4b89-89a2-6eb5c5e5dc32 tempest-ServersAdminTestJSON-831008371 tempest-ServersAdminTestJSON-831008371-project-admin] Listed batch of 6 results from cell out of 1000 limit. Returned 6 total so far. {{(pid=121403) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 01 19:02:41.709638 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-5bb399a2-ffac-4b89-89a2-6eb5c5e5dc32 tempest-ServersAdminTestJSON-831008371 tempest-ServersAdminTestJSON-831008371-project-admin] 10.222.0.13 "GET /compute/v2.1/servers?host=n-h1-863052-2&all_tenants=1" status: 200 len: 1986 microversion: 2.1 time: 0.311975 Nov 01 19:02:41.711065 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1147/2281] 10.222.0.13 () {58 vars in 1190 bytes} [Tue Nov 1 19:02:41 2022] GET /compute/v2.1/servers?host=n-h1-863052-2&all_tenants=1 => generated 1986 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:02:41.720503 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-89af1b2b-b164-4626-ab54-1677ba4ec564 tempest-ImagesNegativeTestJSON-1904451201 tempest-ImagesNegativeTestJSON-1904451201-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:02:41.721627 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-89af1b2b-b164-4626-ab54-1677ba4ec564 tempest-ImagesNegativeTestJSON-1904451201 tempest-ImagesNegativeTestJSON-1904451201-project] [instance: 077786bf-b9d6-4b7e-9eb5-ce4612dcd945] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:02:41.729289 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-89af1b2b-b164-4626-ab54-1677ba4ec564 tempest-ImagesNegativeTestJSON-1904451201 tempest-ImagesNegativeTestJSON-1904451201-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:41.729820 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-89af1b2b-b164-4626-ab54-1677ba4ec564 tempest-ImagesNegativeTestJSON-1904451201 tempest-ImagesNegativeTestJSON-1904451201-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:41.730342 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-89af1b2b-b164-4626-ab54-1677ba4ec564 tempest-ImagesNegativeTestJSON-1904451201 tempest-ImagesNegativeTestJSON-1904451201-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:41.731242 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-89af1b2b-b164-4626-ab54-1677ba4ec564 tempest-ImagesNegativeTestJSON-1904451201 tempest-ImagesNegativeTestJSON-1904451201-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:41.731876 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-89af1b2b-b164-4626-ab54-1677ba4ec564 tempest-ImagesNegativeTestJSON-1904451201 tempest-ImagesNegativeTestJSON-1904451201-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:41.732463 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-89af1b2b-b164-4626-ab54-1677ba4ec564 tempest-ImagesNegativeTestJSON-1904451201 tempest-ImagesNegativeTestJSON-1904451201-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:41.769211 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-89af1b2b-b164-4626-ab54-1677ba4ec564 tempest-ImagesNegativeTestJSON-1904451201 tempest-ImagesNegativeTestJSON-1904451201-project] [instance: 077786bf-b9d6-4b7e-9eb5-ce4612dcd945] Going to try to terminate instance {{(pid=121403) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 01 19:02:41.924819 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-89af1b2b-b164-4626-ab54-1677ba4ec564 tempest-ImagesNegativeTestJSON-1904451201 tempest-ImagesNegativeTestJSON-1904451201-project] 10.222.0.13 "DELETE /compute/v2.1/servers/077786bf-b9d6-4b7e-9eb5-ce4612dcd945" status: 204 len: 0 microversion: 2.1 time: 0.204307 Nov 01 19:02:41.926095 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1148/2282] 10.222.0.13 () {58 vars in 1239 bytes} [Tue Nov 1 19:02:41 2022] DELETE /compute/v2.1/servers/077786bf-b9d6-4b7e-9eb5-ce4612dcd945 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 01 19:02:41.942934 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-103ffb9e-a6bf-46b5-bddc-8a2d121a1ae2 tempest-ServersAdminTestJSON-831008371 tempest-ServersAdminTestJSON-831008371-project-admin] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:02:41.951456 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-103ffb9e-a6bf-46b5-bddc-8a2d121a1ae2 tempest-ServersAdminTestJSON-831008371 tempest-ServersAdminTestJSON-831008371-project-admin] Searching by: {'host': 'nonexistent_host', 'deleted': False} {{(pid=121403) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 01 19:02:41.958582 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-103ffb9e-a6bf-46b5-bddc-8a2d121a1ae2 tempest-ServersAdminTestJSON-831008371 tempest-ServersAdminTestJSON-831008371-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:41.959326 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-103ffb9e-a6bf-46b5-bddc-8a2d121a1ae2 tempest-ServersAdminTestJSON-831008371 tempest-ServersAdminTestJSON-831008371-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:41.960461 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-103ffb9e-a6bf-46b5-bddc-8a2d121a1ae2 tempest-ServersAdminTestJSON-831008371 tempest-ServersAdminTestJSON-831008371-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:41.961553 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-103ffb9e-a6bf-46b5-bddc-8a2d121a1ae2 tempest-ServersAdminTestJSON-831008371 tempest-ServersAdminTestJSON-831008371-project-admin] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:41.962193 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-103ffb9e-a6bf-46b5-bddc-8a2d121a1ae2 tempest-ServersAdminTestJSON-831008371 tempest-ServersAdminTestJSON-831008371-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:41.962789 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-103ffb9e-a6bf-46b5-bddc-8a2d121a1ae2 tempest-ServersAdminTestJSON-831008371 tempest-ServersAdminTestJSON-831008371-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:41.988153 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-103ffb9e-a6bf-46b5-bddc-8a2d121a1ae2 tempest-ServersAdminTestJSON-831008371 tempest-ServersAdminTestJSON-831008371-project-admin] 10.222.0.13 "GET /compute/v2.1/servers?host=nonexistent_host&all_tenants=1" status: 200 len: 15 microversion: 2.1 time: 0.058288 Nov 01 19:02:41.999059 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1149/2283] 10.222.0.13 () {58 vars in 1196 bytes} [Tue Nov 1 19:02:41 2022] GET /compute/v2.1/servers?host=nonexistent_host&all_tenants=1 => generated 15 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 01 19:02:42.006894 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-26d6f9bc-331f-4a3d-9d60-a49ff73607cc tempest-ServersTestBootFromVolume-877599095 tempest-ServersTestBootFromVolume-877599095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed2352ce53fc4045adde8cd81b78b3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651046528c204df299ca3d14c44b4a7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:02:42.012462 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-9a4e212d-33b1-4145-bc45-844ebb432406 tempest-ServersTestJSON-675990056 tempest-ServersTestJSON-675990056-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-660503865", "imageRef": "2d4a0047-1b9e-445f-8af8-1b5c9d93e881", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "dfb2cc53-0c05-4ad1-9e1c-b226787e9d3a"}], "security_groups": [{"name": "tempest-securitygroup--1737941785"}], "key_name": "tempest-keypair-80750042", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "}} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:02:42.021162 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-26d6f9bc-331f-4a3d-9d60-a49ff73607cc tempest-ServersTestBootFromVolume-877599095 tempest-ServersTestBootFromVolume-877599095-project] 10.222.0.13 "GET /compute/v2.1/servers/44cdf0d8-969b-4149-bb03-6bc390977019" status: 200 len: 1292 microversion: 2.1 time: 0.486363 Nov 01 19:02:42.023210 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1135/2284] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:02:41 2022] GET /compute/v2.1/servers/44cdf0d8-969b-4149-bb03-6bc390977019 => generated 1292 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:02:42.036831 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-eac8b7a2-c659-4090-9b14-0fb00e19e3c1 tempest-ImagesNegativeTestJSON-1904451201 tempest-ImagesNegativeTestJSON-1904451201-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:02:42.036831 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-eac8b7a2-c659-4090-9b14-0fb00e19e3c1 tempest-ImagesNegativeTestJSON-1904451201 tempest-ImagesNegativeTestJSON-1904451201-project] [instance: 077786bf-b9d6-4b7e-9eb5-ce4612dcd945] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:02:42.058968 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-eac8b7a2-c659-4090-9b14-0fb00e19e3c1 tempest-ImagesNegativeTestJSON-1904451201 tempest-ImagesNegativeTestJSON-1904451201-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:42.060000 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-eac8b7a2-c659-4090-9b14-0fb00e19e3c1 tempest-ImagesNegativeTestJSON-1904451201 tempest-ImagesNegativeTestJSON-1904451201-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:42.060466 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-eac8b7a2-c659-4090-9b14-0fb00e19e3c1 tempest-ImagesNegativeTestJSON-1904451201 tempest-ImagesNegativeTestJSON-1904451201-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:42.061922 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-eac8b7a2-c659-4090-9b14-0fb00e19e3c1 tempest-ImagesNegativeTestJSON-1904451201 tempest-ImagesNegativeTestJSON-1904451201-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:42.062373 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-eac8b7a2-c659-4090-9b14-0fb00e19e3c1 tempest-ImagesNegativeTestJSON-1904451201 tempest-ImagesNegativeTestJSON-1904451201-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:42.062795 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-eac8b7a2-c659-4090-9b14-0fb00e19e3c1 tempest-ImagesNegativeTestJSON-1904451201 tempest-ImagesNegativeTestJSON-1904451201-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:42.308325 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-eac8b7a2-c659-4090-9b14-0fb00e19e3c1 tempest-ImagesNegativeTestJSON-1904451201 tempest-ImagesNegativeTestJSON-1904451201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c4a93c606cd4fc98c9b667bfc3d367b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68771d3adba04230a0fc3f69b50cc9b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:02:42.310982 n-d-863052-2 devstack@n-api.service[121402]: DEBUG dbcounter [-] [121402] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=121402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 19:02:42.320137 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-eac8b7a2-c659-4090-9b14-0fb00e19e3c1 tempest-ImagesNegativeTestJSON-1904451201 tempest-ImagesNegativeTestJSON-1904451201-project] 10.222.0.13 "GET /compute/v2.1/servers/077786bf-b9d6-4b7e-9eb5-ce4612dcd945" status: 200 len: 1511 microversion: 2.1 time: 0.295329 Nov 01 19:02:42.335826 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1136/2285] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:02:42 2022] GET /compute/v2.1/servers/077786bf-b9d6-4b7e-9eb5-ce4612dcd945 => generated 1511 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:02:42.335826 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-d4d665da-e2c3-48b7-a64d-48c6c524b935 tempest-ServersAdminTestJSON-831008371 tempest-ServersAdminTestJSON-831008371-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:02:42.335826 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-d4d665da-e2c3-48b7-a64d-48c6c524b935 tempest-ServersAdminTestJSON-831008371 tempest-ServersAdminTestJSON-831008371-project-admin] [instance: 992f5ec5-d256-4870-b16d-fc8d9adbd3e7] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:02:42.365353 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-d4d665da-e2c3-48b7-a64d-48c6c524b935 tempest-ServersAdminTestJSON-831008371 tempest-ServersAdminTestJSON-831008371-project-admin] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:42.366659 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-d4d665da-e2c3-48b7-a64d-48c6c524b935 tempest-ServersAdminTestJSON-831008371 tempest-ServersAdminTestJSON-831008371-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:42.367880 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-d4d665da-e2c3-48b7-a64d-48c6c524b935 tempest-ServersAdminTestJSON-831008371 tempest-ServersAdminTestJSON-831008371-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:42.370153 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-d4d665da-e2c3-48b7-a64d-48c6c524b935 tempest-ServersAdminTestJSON-831008371 tempest-ServersAdminTestJSON-831008371-project-admin] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:42.370633 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-d4d665da-e2c3-48b7-a64d-48c6c524b935 tempest-ServersAdminTestJSON-831008371 tempest-ServersAdminTestJSON-831008371-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:42.371681 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-d4d665da-e2c3-48b7-a64d-48c6c524b935 tempest-ServersAdminTestJSON-831008371 tempest-ServersAdminTestJSON-831008371-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:42.433585 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.network.neutron [None req-9a4e212d-33b1-4145-bc45-844ebb432406 tempest-ServersTestJSON-675990056 tempest-ServersTestJSON-675990056-project] validate_networks() for [('dfb2cc53-0c05-4ad1-9e1c-b226787e9d3a', None, None, None, None, None)] {{(pid=121403) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 01 19:02:42.540882 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-d4d665da-e2c3-48b7-a64d-48c6c524b935 tempest-ServersAdminTestJSON-831008371 tempest-ServersAdminTestJSON-831008371-project-admin] 10.222.0.13 "POST /compute/v2.1/servers/992f5ec5-d256-4870-b16d-fc8d9adbd3e7/action" status: 202 len: 0 microversion: 2.1 time: 0.218210 Nov 01 19:02:42.545038 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1137/2286] 10.222.0.13 () {60 vars in 1278 bytes} [Tue Nov 1 19:02:42 2022] POST /compute/v2.1/servers/992f5ec5-d256-4870-b16d-fc8d9adbd3e7/action => generated 0 bytes in 223 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 01 19:02:42.551974 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-30c6f68f-dbdd-4a72-88ef-fa80959f4d44 tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:02:42.553698 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-30c6f68f-dbdd-4a72-88ef-fa80959f4d44 tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] [instance: 4b9fb909-26f7-40af-bac5-e7d2a6b9fb77] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:02:42.561013 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-30c6f68f-dbdd-4a72-88ef-fa80959f4d44 tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:42.565255 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-30c6f68f-dbdd-4a72-88ef-fa80959f4d44 tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:42.565255 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-30c6f68f-dbdd-4a72-88ef-fa80959f4d44 tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:42.569868 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-30c6f68f-dbdd-4a72-88ef-fa80959f4d44 tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:42.570629 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-30c6f68f-dbdd-4a72-88ef-fa80959f4d44 tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:42.571696 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-30c6f68f-dbdd-4a72-88ef-fa80959f4d44 tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:42.749489 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-30c6f68f-dbdd-4a72-88ef-fa80959f4d44 tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52acef7992d64d378fd8ac333887fd0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af51b8733e984c2ca87df2d8163dedf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:02:42.758485 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-30c6f68f-dbdd-4a72-88ef-fa80959f4d44 tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] 10.222.0.13 "GET /compute/v2.1/servers/4b9fb909-26f7-40af-bac5-e7d2a6b9fb77" status: 200 len: 1354 microversion: 2.1 time: 0.211992 Nov 01 19:02:42.772610 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1138/2287] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:02:42 2022] GET /compute/v2.1/servers/4b9fb909-26f7-40af-bac5-e7d2a6b9fb77 => generated 1354 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:02:42.772610 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-333ee98e-9e42-4c3e-9782-ed678f9df69d tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "2d4a0047-1b9e-445f-8af8-1b5c9d93e881"}} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:02:42.772610 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-333ee98e-9e42-4c3e-9782-ed678f9df69d tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] [instance: 992f5ec5-d256-4870-b16d-fc8d9adbd3e7] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:02:42.779737 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-333ee98e-9e42-4c3e-9782-ed678f9df69d tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:42.779737 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-333ee98e-9e42-4c3e-9782-ed678f9df69d tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:42.779737 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-333ee98e-9e42-4c3e-9782-ed678f9df69d tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:42.779737 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-333ee98e-9e42-4c3e-9782-ed678f9df69d tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:42.779737 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-333ee98e-9e42-4c3e-9782-ed678f9df69d tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:42.780316 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-333ee98e-9e42-4c3e-9782-ed678f9df69d tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:42.865375 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.virt.hardware [None req-333ee98e-9e42-4c3e-9782-ed678f9df69d tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Flavor limits 0:0:0 {{(pid=121402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 01 19:02:42.865878 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.virt.hardware [None req-333ee98e-9e42-4c3e-9782-ed678f9df69d tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Image limits 0:0:0 {{(pid=121402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 01 19:02:42.866423 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.virt.hardware [None req-333ee98e-9e42-4c3e-9782-ed678f9df69d tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Flavor pref 0:0:0 {{(pid=121402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 01 19:02:42.866945 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.virt.hardware [None req-333ee98e-9e42-4c3e-9782-ed678f9df69d tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Image pref 0:0:0 {{(pid=121402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 01 19:02:42.867430 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.virt.hardware [None req-333ee98e-9e42-4c3e-9782-ed678f9df69d tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 01 19:02:42.940513 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-333ee98e-9e42-4c3e-9782-ed678f9df69d tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] [instance: 992f5ec5-d256-4870-b16d-fc8d9adbd3e7] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:02:42.947325 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-333ee98e-9e42-4c3e-9782-ed678f9df69d tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:42.948207 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-333ee98e-9e42-4c3e-9782-ed678f9df69d tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:42.948677 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-333ee98e-9e42-4c3e-9782-ed678f9df69d tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:42.949398 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-333ee98e-9e42-4c3e-9782-ed678f9df69d tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:42.949850 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-333ee98e-9e42-4c3e-9782-ed678f9df69d tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:42.950278 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-333ee98e-9e42-4c3e-9782-ed678f9df69d tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:42.993445 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-333ee98e-9e42-4c3e-9782-ed678f9df69d tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] 10.222.0.13 "POST /compute/v2.1/servers/992f5ec5-d256-4870-b16d-fc8d9adbd3e7/action" status: 202 len: 1068 microversion: 2.1 time: 0.232604 Nov 01 19:02:43.010974 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1139/2288] 10.222.0.13 () {60 vars in 1278 bytes} [Tue Nov 1 19:02:42 2022] POST /compute/v2.1/servers/992f5ec5-d256-4870-b16d-fc8d9adbd3e7/action => generated 1068 bytes in 250 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Nov 01 19:02:43.017655 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-be919f00-bd9d-4b97-b22e-318cf568a443 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:02:43.018160 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-be919f00-bd9d-4b97-b22e-318cf568a443 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] [instance: bee52bae-2df5-46a3-9aa9-f6b24bea11e3] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:02:43.025804 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-be919f00-bd9d-4b97-b22e-318cf568a443 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:43.025804 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-be919f00-bd9d-4b97-b22e-318cf568a443 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:43.026141 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-be919f00-bd9d-4b97-b22e-318cf568a443 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:43.026826 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-be919f00-bd9d-4b97-b22e-318cf568a443 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:43.027282 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-be919f00-bd9d-4b97-b22e-318cf568a443 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:43.027705 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-be919f00-bd9d-4b97-b22e-318cf568a443 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:43.058653 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-be919f00-bd9d-4b97-b22e-318cf568a443 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] [instance: bee52bae-2df5-46a3-9aa9-f6b24bea11e3] Going to try to terminate instance {{(pid=121402) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 01 19:02:43.172439 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-be919f00-bd9d-4b97-b22e-318cf568a443 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] 10.222.0.13 "DELETE /compute/v2.1/servers/bee52bae-2df5-46a3-9aa9-f6b24bea11e3" status: 204 len: 0 microversion: 2.25 time: 0.156910 Nov 01 19:02:43.175928 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1140/2289] 10.222.0.13 () {60 vars in 1280 bytes} [Tue Nov 1 19:02:43 2022] DELETE /compute/v2.1/servers/bee52bae-2df5-46a3-9aa9-f6b24bea11e3 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 01 19:02:43.179966 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-dbab235c-c65c-4591-80f9-17d14123c435 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:02:43.180728 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-dbab235c-c65c-4591-80f9-17d14123c435 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] [instance: 992f5ec5-d256-4870-b16d-fc8d9adbd3e7] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:02:43.188870 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-dbab235c-c65c-4591-80f9-17d14123c435 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:43.189566 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-dbab235c-c65c-4591-80f9-17d14123c435 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:43.190002 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-dbab235c-c65c-4591-80f9-17d14123c435 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:43.190714 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-dbab235c-c65c-4591-80f9-17d14123c435 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:43.191175 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-dbab235c-c65c-4591-80f9-17d14123c435 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:43.192215 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-dbab235c-c65c-4591-80f9-17d14123c435 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:43.324217 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.quota [None req-9a4e212d-33b1-4145-bc45-844ebb432406 tempest-ServersTestJSON-675990056 tempest-ServersTestJSON-675990056-project] Getting quotas for project c3dd3fba10d740c9bc38b10dca3007aa. Resources: dict_keys(['metadata_items']) {{(pid=121403) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 01 19:02:43.335409 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.quota [None req-9a4e212d-33b1-4145-bc45-844ebb432406 tempest-ServersTestJSON-675990056 tempest-ServersTestJSON-675990056-project] Getting quotas for user 71d26d92020b4d4aab9f82d174e1ba9d and project c3dd3fba10d740c9bc38b10dca3007aa. Resources: dict_keys(['metadata_items']) {{(pid=121403) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 01 19:02:43.364405 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.virt.hardware [None req-9a4e212d-33b1-4145-bc45-844ebb432406 tempest-ServersTestJSON-675990056 tempest-ServersTestJSON-675990056-project] Flavor limits 0:0:0 {{(pid=121403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 01 19:02:43.364966 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.virt.hardware [None req-9a4e212d-33b1-4145-bc45-844ebb432406 tempest-ServersTestJSON-675990056 tempest-ServersTestJSON-675990056-project] Image limits 0:0:0 {{(pid=121403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 01 19:02:43.365445 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.virt.hardware [None req-9a4e212d-33b1-4145-bc45-844ebb432406 tempest-ServersTestJSON-675990056 tempest-ServersTestJSON-675990056-project] Flavor pref 0:0:0 {{(pid=121403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 01 19:02:43.365853 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.virt.hardware [None req-9a4e212d-33b1-4145-bc45-844ebb432406 tempest-ServersTestJSON-675990056 tempest-ServersTestJSON-675990056-project] Image pref 0:0:0 {{(pid=121403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 01 19:02:43.366261 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.virt.hardware [None req-9a4e212d-33b1-4145-bc45-844ebb432406 tempest-ServersTestJSON-675990056 tempest-ServersTestJSON-675990056-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 01 19:02:43.386183 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-9a4e212d-33b1-4145-bc45-844ebb432406 tempest-ServersTestJSON-675990056 tempest-ServersTestJSON-675990056-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:43.386671 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-9a4e212d-33b1-4145-bc45-844ebb432406 tempest-ServersTestJSON-675990056 tempest-ServersTestJSON-675990056-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:43.387111 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-9a4e212d-33b1-4145-bc45-844ebb432406 tempest-ServersTestJSON-675990056 tempest-ServersTestJSON-675990056-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:43.387834 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-9a4e212d-33b1-4145-bc45-844ebb432406 tempest-ServersTestJSON-675990056 tempest-ServersTestJSON-675990056-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:43.388290 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-9a4e212d-33b1-4145-bc45-844ebb432406 tempest-ServersTestJSON-675990056 tempest-ServersTestJSON-675990056-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:43.388743 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-9a4e212d-33b1-4145-bc45-844ebb432406 tempest-ServersTestJSON-675990056 tempest-ServersTestJSON-675990056-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:43.393889 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-dbab235c-c65c-4591-80f9-17d14123c435 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb496b3faac4abbae73d389f2042e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e2520220d454764b8c139a58d78ac83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:02:43.406296 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-dbab235c-c65c-4591-80f9-17d14123c435 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] 10.222.0.13 "GET /compute/v2.1/servers/992f5ec5-d256-4870-b16d-fc8d9adbd3e7" status: 200 len: 1472 microversion: 2.1 time: 0.231768 Nov 01 19:02:43.409624 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1141/2290] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:02:43 2022] GET /compute/v2.1/servers/992f5ec5-d256-4870-b16d-fc8d9adbd3e7 => generated 1472 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:02:43.421374 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.quota [None req-9a4e212d-33b1-4145-bc45-844ebb432406 tempest-ServersTestJSON-675990056 tempest-ServersTestJSON-675990056-project] Getting quotas for project c3dd3fba10d740c9bc38b10dca3007aa. Resources: {'cores', 'ram', 'instances'} {{(pid=121403) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 01 19:02:43.436918 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-270d8ca0-f1e5-4642-823a-98910657a8f8 tempest-ServersTestBootFromVolume-877599095 tempest-ServersTestBootFromVolume-877599095-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:02:43.439225 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-270d8ca0-f1e5-4642-823a-98910657a8f8 tempest-ServersTestBootFromVolume-877599095 tempest-ServersTestBootFromVolume-877599095-project] [instance: 44cdf0d8-969b-4149-bb03-6bc390977019] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:02:43.442492 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.quota [None req-9a4e212d-33b1-4145-bc45-844ebb432406 tempest-ServersTestJSON-675990056 tempest-ServersTestJSON-675990056-project] Getting quotas for user 71d26d92020b4d4aab9f82d174e1ba9d and project c3dd3fba10d740c9bc38b10dca3007aa. Resources: {'cores', 'ram', 'instances'} {{(pid=121403) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 01 19:02:43.446605 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-270d8ca0-f1e5-4642-823a-98910657a8f8 tempest-ServersTestBootFromVolume-877599095 tempest-ServersTestBootFromVolume-877599095-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:43.447349 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-270d8ca0-f1e5-4642-823a-98910657a8f8 tempest-ServersTestBootFromVolume-877599095 tempest-ServersTestBootFromVolume-877599095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:43.447926 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-270d8ca0-f1e5-4642-823a-98910657a8f8 tempest-ServersTestBootFromVolume-877599095 tempest-ServersTestBootFromVolume-877599095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:43.448834 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-270d8ca0-f1e5-4642-823a-98910657a8f8 tempest-ServersTestBootFromVolume-877599095 tempest-ServersTestBootFromVolume-877599095-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:43.449338 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-270d8ca0-f1e5-4642-823a-98910657a8f8 tempest-ServersTestBootFromVolume-877599095 tempest-ServersTestBootFromVolume-877599095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:43.449893 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-270d8ca0-f1e5-4642-823a-98910657a8f8 tempest-ServersTestBootFromVolume-877599095 tempest-ServersTestBootFromVolume-877599095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:43.469525 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-9a4e212d-33b1-4145-bc45-844ebb432406 tempest-ServersTestJSON-675990056 tempest-ServersTestJSON-675990056-project] Going to run 1 instances... {{(pid=121403) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 01 19:02:43.472500 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-9a4e212d-33b1-4145-bc45-844ebb432406 tempest-ServersTestJSON-675990056 tempest-ServersTestJSON-675990056-project] [instance: 6e82d040-bcc6-473e-b202-bf13829baf2c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2d4a0047-1b9e-445f-8af8-1b5c9d93e881',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121403) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 01 19:02:43.627877 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-9a4e212d-33b1-4145-bc45-844ebb432406 tempest-ServersTestJSON-675990056 tempest-ServersTestJSON-675990056-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 1.627566 Nov 01 19:02:43.629246 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1150/2291] 10.222.0.13 () {60 vars in 1147 bytes} [Tue Nov 1 19:02:41 2022] POST /compute/v2.1/servers => generated 407 bytes in 1629 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 01 19:02:43.636518 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-6fb7cad2-9209-44a1-92e6-8fca36a6cfa8 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:02:43.637448 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-6fb7cad2-9209-44a1-92e6-8fca36a6cfa8 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] [instance: bee52bae-2df5-46a3-9aa9-f6b24bea11e3] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:02:43.649824 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-6fb7cad2-9209-44a1-92e6-8fca36a6cfa8 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:43.650642 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-6fb7cad2-9209-44a1-92e6-8fca36a6cfa8 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:43.651564 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-6fb7cad2-9209-44a1-92e6-8fca36a6cfa8 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:43.652685 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-6fb7cad2-9209-44a1-92e6-8fca36a6cfa8 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:43.653541 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-6fb7cad2-9209-44a1-92e6-8fca36a6cfa8 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:43.654404 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-6fb7cad2-9209-44a1-92e6-8fca36a6cfa8 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:44.088322 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-6fb7cad2-9209-44a1-92e6-8fca36a6cfa8 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:02:44.102839 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-6fb7cad2-9209-44a1-92e6-8fca36a6cfa8 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:02:44.107203 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-6fb7cad2-9209-44a1-92e6-8fca36a6cfa8 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:02:44.109052 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-6fb7cad2-9209-44a1-92e6-8fca36a6cfa8 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] 10.222.0.13 "GET /compute/v2.1/servers/bee52bae-2df5-46a3-9aa9-f6b24bea11e3" status: 200 len: 1547 microversion: 2.25 time: 0.477733 Nov 01 19:02:44.112132 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1151/2292] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 19:02:43 2022] GET /compute/v2.1/servers/bee52bae-2df5-46a3-9aa9-f6b24bea11e3 => generated 1547 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 19:02:44.121540 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-b7237983-8c46-4164-80ef-5789e37dab4b tempest-ImagesNegativeTestJSON-1904451201 tempest-ImagesNegativeTestJSON-1904451201-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:02:44.125235 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-b7237983-8c46-4164-80ef-5789e37dab4b tempest-ImagesNegativeTestJSON-1904451201 tempest-ImagesNegativeTestJSON-1904451201-project] [instance: 077786bf-b9d6-4b7e-9eb5-ce4612dcd945] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:02:44.141861 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-b7237983-8c46-4164-80ef-5789e37dab4b tempest-ImagesNegativeTestJSON-1904451201 tempest-ImagesNegativeTestJSON-1904451201-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:44.142640 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-b7237983-8c46-4164-80ef-5789e37dab4b tempest-ImagesNegativeTestJSON-1904451201 tempest-ImagesNegativeTestJSON-1904451201-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:44.143251 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-b7237983-8c46-4164-80ef-5789e37dab4b tempest-ImagesNegativeTestJSON-1904451201 tempest-ImagesNegativeTestJSON-1904451201-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:44.145640 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-b7237983-8c46-4164-80ef-5789e37dab4b tempest-ImagesNegativeTestJSON-1904451201 tempest-ImagesNegativeTestJSON-1904451201-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:44.146664 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-270d8ca0-f1e5-4642-823a-98910657a8f8 tempest-ServersTestBootFromVolume-877599095 tempest-ServersTestBootFromVolume-877599095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed2352ce53fc4045adde8cd81b78b3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651046528c204df299ca3d14c44b4a7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:02:44.147259 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-b7237983-8c46-4164-80ef-5789e37dab4b tempest-ImagesNegativeTestJSON-1904451201 tempest-ImagesNegativeTestJSON-1904451201-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:44.147259 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-b7237983-8c46-4164-80ef-5789e37dab4b tempest-ImagesNegativeTestJSON-1904451201 tempest-ImagesNegativeTestJSON-1904451201-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:44.158278 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-270d8ca0-f1e5-4642-823a-98910657a8f8 tempest-ServersTestBootFromVolume-877599095 tempest-ServersTestBootFromVolume-877599095-project] 10.222.0.13 "GET /compute/v2.1/servers/44cdf0d8-969b-4149-bb03-6bc390977019" status: 200 len: 1292 microversion: 2.1 time: 0.723630 Nov 01 19:02:44.158916 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1142/2293] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:02:43 2022] GET /compute/v2.1/servers/44cdf0d8-969b-4149-bb03-6bc390977019 => generated 1292 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:02:44.198928 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-edb9ee91-0308-4492-9c95-bcc312729f91 tempest-ServersTestJSON-675990056 tempest-ServersTestJSON-675990056-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:02:44.199549 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-edb9ee91-0308-4492-9c95-bcc312729f91 tempest-ServersTestJSON-675990056 tempest-ServersTestJSON-675990056-project] [instance: 6e82d040-bcc6-473e-b202-bf13829baf2c] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:02:44.405901 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-b7237983-8c46-4164-80ef-5789e37dab4b tempest-ImagesNegativeTestJSON-1904451201 tempest-ImagesNegativeTestJSON-1904451201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c4a93c606cd4fc98c9b667bfc3d367b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68771d3adba04230a0fc3f69b50cc9b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:02:44.415536 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-b7237983-8c46-4164-80ef-5789e37dab4b tempest-ImagesNegativeTestJSON-1904451201 tempest-ImagesNegativeTestJSON-1904451201-project] 10.222.0.13 "GET /compute/v2.1/servers/077786bf-b9d6-4b7e-9eb5-ce4612dcd945" status: 200 len: 1511 microversion: 2.1 time: 0.302171 Nov 01 19:02:44.416085 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1152/2294] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:02:44 2022] GET /compute/v2.1/servers/077786bf-b9d6-4b7e-9eb5-ce4612dcd945 => generated 1511 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:02:44.421846 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-6eafc84c-dba0-4064-b192-6744139e42f9 tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:02:44.422732 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-6eafc84c-dba0-4064-b192-6744139e42f9 tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] [instance: 4b9fb909-26f7-40af-bac5-e7d2a6b9fb77] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:02:44.429014 n-d-863052-2 devstack@n-api.service[121403]: DEBUG dbcounter [-] [121403] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=2,nova_api:INSERT=4 {{(pid=121403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 19:02:44.443744 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-6eafc84c-dba0-4064-b192-6744139e42f9 tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:44.446048 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-6eafc84c-dba0-4064-b192-6744139e42f9 tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:44.447517 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-6eafc84c-dba0-4064-b192-6744139e42f9 tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:44.448348 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-6eafc84c-dba0-4064-b192-6744139e42f9 tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:44.452195 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-6eafc84c-dba0-4064-b192-6744139e42f9 tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:44.452672 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-6eafc84c-dba0-4064-b192-6744139e42f9 tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:44.535225 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-edb9ee91-0308-4492-9c95-bcc312729f91 tempest-ServersTestJSON-675990056 tempest-ServersTestJSON-675990056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71d26d92020b4d4aab9f82d174e1ba9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3dd3fba10d740c9bc38b10dca3007aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:02:44.544900 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-edb9ee91-0308-4492-9c95-bcc312729f91 tempest-ServersTestJSON-675990056 tempest-ServersTestJSON-675990056-project] 10.222.0.13 "GET /compute/v2.1/servers/6e82d040-bcc6-473e-b202-bf13829baf2c" status: 200 len: 1267 microversion: 2.1 time: 0.371612 Nov 01 19:02:44.560839 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1143/2295] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:02:44 2022] GET /compute/v2.1/servers/6e82d040-bcc6-473e-b202-bf13829baf2c => generated 1267 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:02:44.574823 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [req-19aecfa8-7e29-4fb0-8ef7-ca5246b4bb22 req-742441d2-a6ed-4c54-960d-603818b19220 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "44cdf0d8-969b-4149-bb03-6bc390977019", "name": "network-vif-plugged", "status": "completed", "tag": "2ea52276-0a87-4b31-a387-b25b0b2e684c"}]} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:02:44.587313 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-19aecfa8-7e29-4fb0-8ef7-ca5246b4bb22 req-742441d2-a6ed-4c54-960d-603818b19220 service nova] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:44.588065 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-19aecfa8-7e29-4fb0-8ef7-ca5246b4bb22 req-742441d2-a6ed-4c54-960d-603818b19220 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:44.588949 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-19aecfa8-7e29-4fb0-8ef7-ca5246b4bb22 req-742441d2-a6ed-4c54-960d-603818b19220 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:44.604018 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.compute.server_external_events [req-19aecfa8-7e29-4fb0-8ef7-ca5246b4bb22 req-742441d2-a6ed-4c54-960d-603818b19220 service nova] Creating event network-vif-plugged:2ea52276-0a87-4b31-a387-b25b0b2e684c for instance 44cdf0d8-969b-4149-bb03-6bc390977019 on n-h1-863052-2 Nov 01 19:02:44.616727 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [req-19aecfa8-7e29-4fb0-8ef7-ca5246b4bb22 req-742441d2-a6ed-4c54-960d-603818b19220 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053301 Nov 01 19:02:44.617917 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1144/2296] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Nov 1 19:02:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:02:44.624724 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-de3a6de2-a590-4d0c-a59a-8ab0d0b9f14b tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:02:44.625998 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-de3a6de2-a590-4d0c-a59a-8ab0d0b9f14b tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] [instance: 992f5ec5-d256-4870-b16d-fc8d9adbd3e7] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:02:44.633945 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-de3a6de2-a590-4d0c-a59a-8ab0d0b9f14b tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:44.634726 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-de3a6de2-a590-4d0c-a59a-8ab0d0b9f14b tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:44.635373 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-de3a6de2-a590-4d0c-a59a-8ab0d0b9f14b tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:44.636270 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-de3a6de2-a590-4d0c-a59a-8ab0d0b9f14b tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:44.636918 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-de3a6de2-a590-4d0c-a59a-8ab0d0b9f14b tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:44.637529 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-de3a6de2-a590-4d0c-a59a-8ab0d0b9f14b tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:44.827852 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-6eafc84c-dba0-4064-b192-6744139e42f9 tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52acef7992d64d378fd8ac333887fd0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af51b8733e984c2ca87df2d8163dedf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:02:44.827852 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-6eafc84c-dba0-4064-b192-6744139e42f9 tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] 10.222.0.13 "GET /compute/v2.1/servers/4b9fb909-26f7-40af-bac5-e7d2a6b9fb77" status: 200 len: 1354 microversion: 2.1 time: 0.373861 Nov 01 19:02:44.827852 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1153/2297] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:02:44 2022] GET /compute/v2.1/servers/4b9fb909-26f7-40af-bac5-e7d2a6b9fb77 => generated 1354 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:02:44.827852 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [req-3bd2c787-9bd9-423f-a86b-57a3f5828050 req-eabeb1b4-1453-4f90-8e1c-54b61bdf5f5a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "077786bf-b9d6-4b7e-9eb5-ce4612dcd945", "name": "network-vif-deleted", "tag": "82fb1de9-5d12-4172-992b-157d50e3e79c"}]} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:02:44.842616 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-3bd2c787-9bd9-423f-a86b-57a3f5828050 req-eabeb1b4-1453-4f90-8e1c-54b61bdf5f5a service nova] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:44.843232 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-3bd2c787-9bd9-423f-a86b-57a3f5828050 req-eabeb1b4-1453-4f90-8e1c-54b61bdf5f5a service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:44.843841 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-3bd2c787-9bd9-423f-a86b-57a3f5828050 req-eabeb1b4-1453-4f90-8e1c-54b61bdf5f5a service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:44.862145 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.compute.server_external_events [req-3bd2c787-9bd9-423f-a86b-57a3f5828050 req-eabeb1b4-1453-4f90-8e1c-54b61bdf5f5a service nova] Creating event network-vif-deleted:82fb1de9-5d12-4172-992b-157d50e3e79c for instance 077786bf-b9d6-4b7e-9eb5-ce4612dcd945 on n-h2-863052-2 Nov 01 19:02:44.867817 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [req-3bd2c787-9bd9-423f-a86b-57a3f5828050 req-eabeb1b4-1453-4f90-8e1c-54b61bdf5f5a service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072306 Nov 01 19:02:44.872236 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1154/2298] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Nov 1 19:02:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:02:45.139514 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-067d46e4-a3aa-41c7-bea1-cc56262d66bd tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:02:45.140421 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-067d46e4-a3aa-41c7-bea1-cc56262d66bd tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] [instance: bee52bae-2df5-46a3-9aa9-f6b24bea11e3] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:02:45.147233 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-067d46e4-a3aa-41c7-bea1-cc56262d66bd tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:45.148079 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-067d46e4-a3aa-41c7-bea1-cc56262d66bd tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:45.148682 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-067d46e4-a3aa-41c7-bea1-cc56262d66bd tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:45.149584 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-067d46e4-a3aa-41c7-bea1-cc56262d66bd tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:45.150140 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-067d46e4-a3aa-41c7-bea1-cc56262d66bd tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:45.150698 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-067d46e4-a3aa-41c7-bea1-cc56262d66bd tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:45.155899 n-d-863052-2 devstack@n-api.service[121403]: DEBUG dbcounter [-] [121403] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 19:02:45.306774 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-067d46e4-a3aa-41c7-bea1-cc56262d66bd tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:02:45.324055 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-067d46e4-a3aa-41c7-bea1-cc56262d66bd tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:02:45.324801 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-de3a6de2-a590-4d0c-a59a-8ab0d0b9f14b tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb496b3faac4abbae73d389f2042e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e2520220d454764b8c139a58d78ac83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:02:45.326070 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-067d46e4-a3aa-41c7-bea1-cc56262d66bd tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:02:45.327714 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-067d46e4-a3aa-41c7-bea1-cc56262d66bd tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] 10.222.0.13 "GET /compute/v2.1/servers/bee52bae-2df5-46a3-9aa9-f6b24bea11e3" status: 200 len: 1547 microversion: 2.25 time: 0.193657 Nov 01 19:02:45.328340 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1155/2299] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 19:02:45 2022] GET /compute/v2.1/servers/bee52bae-2df5-46a3-9aa9-f6b24bea11e3 => generated 1547 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 01 19:02:45.334527 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-37a10f2a-4e44-4452-9cae-938fb5777e52 tempest-ServersTestBootFromVolume-877599095 tempest-ServersTestBootFromVolume-877599095-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:02:45.335668 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-37a10f2a-4e44-4452-9cae-938fb5777e52 tempest-ServersTestBootFromVolume-877599095 tempest-ServersTestBootFromVolume-877599095-project] [instance: 44cdf0d8-969b-4149-bb03-6bc390977019] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:02:45.344093 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-37a10f2a-4e44-4452-9cae-938fb5777e52 tempest-ServersTestBootFromVolume-877599095 tempest-ServersTestBootFromVolume-877599095-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:45.345523 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-37a10f2a-4e44-4452-9cae-938fb5777e52 tempest-ServersTestBootFromVolume-877599095 tempest-ServersTestBootFromVolume-877599095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:45.346083 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-37a10f2a-4e44-4452-9cae-938fb5777e52 tempest-ServersTestBootFromVolume-877599095 tempest-ServersTestBootFromVolume-877599095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:45.347183 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-37a10f2a-4e44-4452-9cae-938fb5777e52 tempest-ServersTestBootFromVolume-877599095 tempest-ServersTestBootFromVolume-877599095-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:45.347984 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-37a10f2a-4e44-4452-9cae-938fb5777e52 tempest-ServersTestBootFromVolume-877599095 tempest-ServersTestBootFromVolume-877599095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:45.348558 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-37a10f2a-4e44-4452-9cae-938fb5777e52 tempest-ServersTestBootFromVolume-877599095 tempest-ServersTestBootFromVolume-877599095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:45.353192 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-de3a6de2-a590-4d0c-a59a-8ab0d0b9f14b tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] 10.222.0.13 "GET /compute/v2.1/servers/992f5ec5-d256-4870-b16d-fc8d9adbd3e7" status: 200 len: 1472 microversion: 2.1 time: 0.733337 Nov 01 19:02:45.353994 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1145/2300] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:02:44 2022] GET /compute/v2.1/servers/992f5ec5-d256-4870-b16d-fc8d9adbd3e7 => generated 1472 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:02:45.442454 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-586ffe25-7f21-49e6-a237-6c56b2125386 tempest-ImagesNegativeTestJSON-1904451201 tempest-ImagesNegativeTestJSON-1904451201-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:02:45.443106 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-586ffe25-7f21-49e6-a237-6c56b2125386 tempest-ImagesNegativeTestJSON-1904451201 tempest-ImagesNegativeTestJSON-1904451201-project] [instance: 077786bf-b9d6-4b7e-9eb5-ce4612dcd945] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:02:45.454963 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-586ffe25-7f21-49e6-a237-6c56b2125386 tempest-ImagesNegativeTestJSON-1904451201 tempest-ImagesNegativeTestJSON-1904451201-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:45.458386 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-586ffe25-7f21-49e6-a237-6c56b2125386 tempest-ImagesNegativeTestJSON-1904451201 tempest-ImagesNegativeTestJSON-1904451201-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:45.458857 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-586ffe25-7f21-49e6-a237-6c56b2125386 tempest-ImagesNegativeTestJSON-1904451201 tempest-ImagesNegativeTestJSON-1904451201-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:45.461505 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-586ffe25-7f21-49e6-a237-6c56b2125386 tempest-ImagesNegativeTestJSON-1904451201 tempest-ImagesNegativeTestJSON-1904451201-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:45.461985 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-586ffe25-7f21-49e6-a237-6c56b2125386 tempest-ImagesNegativeTestJSON-1904451201 tempest-ImagesNegativeTestJSON-1904451201-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:45.462418 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-586ffe25-7f21-49e6-a237-6c56b2125386 tempest-ImagesNegativeTestJSON-1904451201 tempest-ImagesNegativeTestJSON-1904451201-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:45.544017 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-586ffe25-7f21-49e6-a237-6c56b2125386 tempest-ImagesNegativeTestJSON-1904451201 tempest-ImagesNegativeTestJSON-1904451201-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:45.544483 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-586ffe25-7f21-49e6-a237-6c56b2125386 tempest-ImagesNegativeTestJSON-1904451201 tempest-ImagesNegativeTestJSON-1904451201-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:45.547707 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-37a10f2a-4e44-4452-9cae-938fb5777e52 tempest-ServersTestBootFromVolume-877599095 tempest-ServersTestBootFromVolume-877599095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed2352ce53fc4045adde8cd81b78b3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651046528c204df299ca3d14c44b4a7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:02:45.548148 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-586ffe25-7f21-49e6-a237-6c56b2125386 tempest-ImagesNegativeTestJSON-1904451201 tempest-ImagesNegativeTestJSON-1904451201-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:45.548243 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.objects.instance [None req-586ffe25-7f21-49e6-a237-6c56b2125386 tempest-ImagesNegativeTestJSON-1904451201 tempest-ImagesNegativeTestJSON-1904451201-project] Lazy-loading 'fault' on Instance uuid 077786bf-b9d6-4b7e-9eb5-ce4612dcd945 {{(pid=121402) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 01 19:02:45.559352 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-37a10f2a-4e44-4452-9cae-938fb5777e52 tempest-ServersTestBootFromVolume-877599095 tempest-ServersTestBootFromVolume-877599095-project] 10.222.0.13 "GET /compute/v2.1/servers/44cdf0d8-969b-4149-bb03-6bc390977019" status: 200 len: 1292 microversion: 2.1 time: 0.228661 Nov 01 19:02:45.573512 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1156/2301] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:02:45 2022] GET /compute/v2.1/servers/44cdf0d8-969b-4149-bb03-6bc390977019 => generated 1292 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:02:45.582620 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-bb8f7881-3351-4be2-b5a8-5f6f85b5369e tempest-ServersTestJSON-675990056 tempest-ServersTestJSON-675990056-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:02:45.584249 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-bb8f7881-3351-4be2-b5a8-5f6f85b5369e tempest-ServersTestJSON-675990056 tempest-ServersTestJSON-675990056-project] [instance: 6e82d040-bcc6-473e-b202-bf13829baf2c] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:02:45.599878 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-bb8f7881-3351-4be2-b5a8-5f6f85b5369e tempest-ServersTestJSON-675990056 tempest-ServersTestJSON-675990056-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:45.604803 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-bb8f7881-3351-4be2-b5a8-5f6f85b5369e tempest-ServersTestJSON-675990056 tempest-ServersTestJSON-675990056-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:45.609815 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-bb8f7881-3351-4be2-b5a8-5f6f85b5369e tempest-ServersTestJSON-675990056 tempest-ServersTestJSON-675990056-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:45.616452 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-bb8f7881-3351-4be2-b5a8-5f6f85b5369e tempest-ServersTestJSON-675990056 tempest-ServersTestJSON-675990056-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:45.617428 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-bb8f7881-3351-4be2-b5a8-5f6f85b5369e tempest-ServersTestJSON-675990056 tempest-ServersTestJSON-675990056-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:45.618155 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-bb8f7881-3351-4be2-b5a8-5f6f85b5369e tempest-ServersTestJSON-675990056 tempest-ServersTestJSON-675990056-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:45.706800 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-bb8f7881-3351-4be2-b5a8-5f6f85b5369e tempest-ServersTestJSON-675990056 tempest-ServersTestJSON-675990056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71d26d92020b4d4aab9f82d174e1ba9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3dd3fba10d740c9bc38b10dca3007aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:02:45.728676 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-bb8f7881-3351-4be2-b5a8-5f6f85b5369e tempest-ServersTestJSON-675990056 tempest-ServersTestJSON-675990056-project] 10.222.0.13 "GET /compute/v2.1/servers/6e82d040-bcc6-473e-b202-bf13829baf2c" status: 200 len: 1319 microversion: 2.1 time: 0.153862 Nov 01 19:02:45.729326 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1157/2302] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:02:45 2022] GET /compute/v2.1/servers/6e82d040-bcc6-473e-b202-bf13829baf2c => generated 1319 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:02:45.759962 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-586ffe25-7f21-49e6-a237-6c56b2125386 tempest-ImagesNegativeTestJSON-1904451201 tempest-ImagesNegativeTestJSON-1904451201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c4a93c606cd4fc98c9b667bfc3d367b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68771d3adba04230a0fc3f69b50cc9b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:02:45.767586 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-586ffe25-7f21-49e6-a237-6c56b2125386 tempest-ImagesNegativeTestJSON-1904451201 tempest-ImagesNegativeTestJSON-1904451201-project] 10.222.0.13 "GET /compute/v2.1/servers/077786bf-b9d6-4b7e-9eb5-ce4612dcd945" status: 200 len: 1306 microversion: 2.1 time: 0.330066 Nov 01 19:02:45.768501 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [req-a471c233-9804-4769-be97-53bc9bd79f7f req-c3d3bb02-caad-4479-a7c5-a3ac21026904 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bee52bae-2df5-46a3-9aa9-f6b24bea11e3", "name": "network-vif-deleted", "tag": "8f917f95-25be-4ada-95ec-6e61439ce94b"}]} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:02:45.771669 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1146/2303] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:02:45 2022] GET /compute/v2.1/servers/077786bf-b9d6-4b7e-9eb5-ce4612dcd945 => generated 1306 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 19:02:45.792464 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-a471c233-9804-4769-be97-53bc9bd79f7f req-c3d3bb02-caad-4479-a7c5-a3ac21026904 service nova] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:45.792906 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-a471c233-9804-4769-be97-53bc9bd79f7f req-c3d3bb02-caad-4479-a7c5-a3ac21026904 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:45.794846 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-a471c233-9804-4769-be97-53bc9bd79f7f req-c3d3bb02-caad-4479-a7c5-a3ac21026904 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:45.824522 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-ce4cae50-8b85-4e24-9472-908058d44882 tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:02:45.825219 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-ce4cae50-8b85-4e24-9472-908058d44882 tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] [instance: 4b9fb909-26f7-40af-bac5-e7d2a6b9fb77] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:02:45.832367 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.compute.server_external_events [req-a471c233-9804-4769-be97-53bc9bd79f7f req-c3d3bb02-caad-4479-a7c5-a3ac21026904 service nova] Creating event network-vif-deleted:8f917f95-25be-4ada-95ec-6e61439ce94b for instance bee52bae-2df5-46a3-9aa9-f6b24bea11e3 on n-h2-863052-2 Nov 01 19:02:45.836459 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-ce4cae50-8b85-4e24-9472-908058d44882 tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:45.836869 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-ce4cae50-8b85-4e24-9472-908058d44882 tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:45.837298 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-ce4cae50-8b85-4e24-9472-908058d44882 tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:45.844379 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-ce4cae50-8b85-4e24-9472-908058d44882 tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:45.844888 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-ce4cae50-8b85-4e24-9472-908058d44882 tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:45.847135 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [req-a471c233-9804-4769-be97-53bc9bd79f7f req-c3d3bb02-caad-4479-a7c5-a3ac21026904 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088130 Nov 01 19:02:45.847360 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-ce4cae50-8b85-4e24-9472-908058d44882 tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:45.858498 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1158/2304] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Nov 1 19:02:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:02:46.142467 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-ce4cae50-8b85-4e24-9472-908058d44882 tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52acef7992d64d378fd8ac333887fd0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af51b8733e984c2ca87df2d8163dedf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:02:46.154713 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-ce4cae50-8b85-4e24-9472-908058d44882 tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] 10.222.0.13 "GET /compute/v2.1/servers/4b9fb909-26f7-40af-bac5-e7d2a6b9fb77" status: 200 len: 1354 microversion: 2.1 time: 0.334010 Nov 01 19:02:46.166005 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1147/2305] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:02:45 2022] GET /compute/v2.1/servers/4b9fb909-26f7-40af-bac5-e7d2a6b9fb77 => generated 1354 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:02:46.355177 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-6607d579-2099-4c87-bf4f-61842267d62a tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:02:46.355948 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-6607d579-2099-4c87-bf4f-61842267d62a tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] [instance: bee52bae-2df5-46a3-9aa9-f6b24bea11e3] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:02:46.366777 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-6607d579-2099-4c87-bf4f-61842267d62a tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:46.367545 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-6607d579-2099-4c87-bf4f-61842267d62a tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:46.368105 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-6607d579-2099-4c87-bf4f-61842267d62a tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:46.369018 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-6607d579-2099-4c87-bf4f-61842267d62a tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:46.369785 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-6607d579-2099-4c87-bf4f-61842267d62a tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:46.370672 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-6607d579-2099-4c87-bf4f-61842267d62a tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:46.379699 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-130f7779-4389-472c-a6cf-3415bad33daf tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:02:46.382287 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-130f7779-4389-472c-a6cf-3415bad33daf tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] [instance: 992f5ec5-d256-4870-b16d-fc8d9adbd3e7] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:02:46.388410 n-d-863052-2 devstack@n-api.service[121402]: DEBUG dbcounter [-] [121402] Writing DB stats nova_api:SELECT=98,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=121402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 19:02:46.390360 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-130f7779-4389-472c-a6cf-3415bad33daf tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:46.391026 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-130f7779-4389-472c-a6cf-3415bad33daf tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:46.391687 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-130f7779-4389-472c-a6cf-3415bad33daf tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:46.392971 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-130f7779-4389-472c-a6cf-3415bad33daf tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:46.393662 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-130f7779-4389-472c-a6cf-3415bad33daf tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:46.394359 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-130f7779-4389-472c-a6cf-3415bad33daf tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:46.408431 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-6607d579-2099-4c87-bf4f-61842267d62a tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:46.408940 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-6607d579-2099-4c87-bf4f-61842267d62a tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:46.409435 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-6607d579-2099-4c87-bf4f-61842267d62a tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:46.410100 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.objects.instance [None req-6607d579-2099-4c87-bf4f-61842267d62a tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lazy-loading 'fault' on Instance uuid bee52bae-2df5-46a3-9aa9-f6b24bea11e3 {{(pid=121403) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 01 19:02:46.467497 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-6607d579-2099-4c87-bf4f-61842267d62a tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:02:46.477691 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-6607d579-2099-4c87-bf4f-61842267d62a tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:02:46.480142 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-6607d579-2099-4c87-bf4f-61842267d62a tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:02:46.482579 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-6607d579-2099-4c87-bf4f-61842267d62a tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] 10.222.0.13 "GET /compute/v2.1/servers/bee52bae-2df5-46a3-9aa9-f6b24bea11e3" status: 200 len: 1351 microversion: 2.25 time: 0.132511 Nov 01 19:02:46.490276 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1159/2306] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 19:02:46 2022] GET /compute/v2.1/servers/bee52bae-2df5-46a3-9aa9-f6b24bea11e3 => generated 1351 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 19:02:46.587434 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-c350c03f-3183-4c86-a391-78066699018b tempest-ServersTestBootFromVolume-877599095 tempest-ServersTestBootFromVolume-877599095-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:02:46.588990 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-c350c03f-3183-4c86-a391-78066699018b tempest-ServersTestBootFromVolume-877599095 tempest-ServersTestBootFromVolume-877599095-project] [instance: 44cdf0d8-969b-4149-bb03-6bc390977019] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:02:46.605854 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-c350c03f-3183-4c86-a391-78066699018b tempest-ServersTestBootFromVolume-877599095 tempest-ServersTestBootFromVolume-877599095-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:46.609328 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-c350c03f-3183-4c86-a391-78066699018b tempest-ServersTestBootFromVolume-877599095 tempest-ServersTestBootFromVolume-877599095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:46.609533 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-130f7779-4389-472c-a6cf-3415bad33daf tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb496b3faac4abbae73d389f2042e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e2520220d454764b8c139a58d78ac83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:02:46.610144 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-c350c03f-3183-4c86-a391-78066699018b tempest-ServersTestBootFromVolume-877599095 tempest-ServersTestBootFromVolume-877599095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:46.611141 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-c350c03f-3183-4c86-a391-78066699018b tempest-ServersTestBootFromVolume-877599095 tempest-ServersTestBootFromVolume-877599095-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:46.617703 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-c350c03f-3183-4c86-a391-78066699018b tempest-ServersTestBootFromVolume-877599095 tempest-ServersTestBootFromVolume-877599095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:46.618409 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-c350c03f-3183-4c86-a391-78066699018b tempest-ServersTestBootFromVolume-877599095 tempest-ServersTestBootFromVolume-877599095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:46.645057 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-130f7779-4389-472c-a6cf-3415bad33daf tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] 10.222.0.13 "GET /compute/v2.1/servers/992f5ec5-d256-4870-b16d-fc8d9adbd3e7" status: 200 len: 1472 microversion: 2.1 time: 0.271142 Nov 01 19:02:46.678717 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1148/2307] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:02:46 2022] GET /compute/v2.1/servers/992f5ec5-d256-4870-b16d-fc8d9adbd3e7 => generated 1472 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:02:46.752107 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-cc500677-886c-457f-9cd6-de7ff49e2070 tempest-ServersTestJSON-675990056 tempest-ServersTestJSON-675990056-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:02:46.752825 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-cc500677-886c-457f-9cd6-de7ff49e2070 tempest-ServersTestJSON-675990056 tempest-ServersTestJSON-675990056-project] [instance: 6e82d040-bcc6-473e-b202-bf13829baf2c] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:02:46.772209 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-cc500677-886c-457f-9cd6-de7ff49e2070 tempest-ServersTestJSON-675990056 tempest-ServersTestJSON-675990056-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:46.772780 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-cc500677-886c-457f-9cd6-de7ff49e2070 tempest-ServersTestJSON-675990056 tempest-ServersTestJSON-675990056-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:46.773235 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-cc500677-886c-457f-9cd6-de7ff49e2070 tempest-ServersTestJSON-675990056 tempest-ServersTestJSON-675990056-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:46.777156 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-cc500677-886c-457f-9cd6-de7ff49e2070 tempest-ServersTestJSON-675990056 tempest-ServersTestJSON-675990056-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:46.777750 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-cc500677-886c-457f-9cd6-de7ff49e2070 tempest-ServersTestJSON-675990056 tempest-ServersTestJSON-675990056-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:46.780716 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-cc500677-886c-457f-9cd6-de7ff49e2070 tempest-ServersTestJSON-675990056 tempest-ServersTestJSON-675990056-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:46.836270 n-d-863052-2 devstack@n-api.service[121402]: DEBUG dbcounter [-] [121402] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=121402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 19:02:46.918598 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-cc500677-886c-457f-9cd6-de7ff49e2070 tempest-ServersTestJSON-675990056 tempest-ServersTestJSON-675990056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71d26d92020b4d4aab9f82d174e1ba9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3dd3fba10d740c9bc38b10dca3007aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:02:46.935190 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-cc500677-886c-457f-9cd6-de7ff49e2070 tempest-ServersTestJSON-675990056 tempest-ServersTestJSON-675990056-project] 10.222.0.13 "GET /compute/v2.1/servers/6e82d040-bcc6-473e-b202-bf13829baf2c" status: 200 len: 1325 microversion: 2.1 time: 0.185303 Nov 01 19:02:46.935998 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1149/2308] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:02:46 2022] GET /compute/v2.1/servers/6e82d040-bcc6-473e-b202-bf13829baf2c => generated 1325 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 19:02:46.950167 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [req-1ae014bc-674f-4a3b-a600-4cc9e6d9f123 req-f9fec1de-4e7c-4259-bcdd-eafb62e9e50a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b9fb909-26f7-40af-bac5-e7d2a6b9fb77", "name": "network-vif-plugged", "status": "completed", "tag": "e5db1a83-8c2c-45e5-8a96-25ed895f1996"}, {"server_uuid": "4b9fb909-26f7-40af-bac5-e7d2a6b9fb77", "name": "network-vif-plugged", "status": "completed", "tag": "23db407a-d443-468d-a813-719394117719"}]} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:02:46.971291 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-1ae014bc-674f-4a3b-a600-4cc9e6d9f123 req-f9fec1de-4e7c-4259-bcdd-eafb62e9e50a service nova] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:46.972039 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-1ae014bc-674f-4a3b-a600-4cc9e6d9f123 req-f9fec1de-4e7c-4259-bcdd-eafb62e9e50a service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:46.972747 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-1ae014bc-674f-4a3b-a600-4cc9e6d9f123 req-f9fec1de-4e7c-4259-bcdd-eafb62e9e50a service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:46.987383 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.compute.server_external_events [req-1ae014bc-674f-4a3b-a600-4cc9e6d9f123 req-f9fec1de-4e7c-4259-bcdd-eafb62e9e50a service nova] Creating event network-vif-plugged:e5db1a83-8c2c-45e5-8a96-25ed895f1996 for instance 4b9fb909-26f7-40af-bac5-e7d2a6b9fb77 on n-h1-863052-2 Nov 01 19:02:46.987986 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.compute.server_external_events [req-1ae014bc-674f-4a3b-a600-4cc9e6d9f123 req-f9fec1de-4e7c-4259-bcdd-eafb62e9e50a service nova] Creating event network-vif-plugged:23db407a-d443-468d-a813-719394117719 for instance 4b9fb909-26f7-40af-bac5-e7d2a6b9fb77 on n-h1-863052-2 Nov 01 19:02:46.994286 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [req-1ae014bc-674f-4a3b-a600-4cc9e6d9f123 req-f9fec1de-4e7c-4259-bcdd-eafb62e9e50a service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.054613 Nov 01 19:02:46.995314 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1150/2309] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Nov 1 19:02:46 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:02:47.008614 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-5df87270-2256-4a03-b7dc-4aa9db506805 tempest-ImagesNegativeTestJSON-1904451201 tempest-ImagesNegativeTestJSON-1904451201-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:02:47.009510 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-5df87270-2256-4a03-b7dc-4aa9db506805 tempest-ImagesNegativeTestJSON-1904451201 tempest-ImagesNegativeTestJSON-1904451201-project] [instance: 077786bf-b9d6-4b7e-9eb5-ce4612dcd945] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:02:47.016968 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-5df87270-2256-4a03-b7dc-4aa9db506805 tempest-ImagesNegativeTestJSON-1904451201 tempest-ImagesNegativeTestJSON-1904451201-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:47.017695 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-5df87270-2256-4a03-b7dc-4aa9db506805 tempest-ImagesNegativeTestJSON-1904451201 tempest-ImagesNegativeTestJSON-1904451201-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:47.018461 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-5df87270-2256-4a03-b7dc-4aa9db506805 tempest-ImagesNegativeTestJSON-1904451201 tempest-ImagesNegativeTestJSON-1904451201-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:47.019363 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-5df87270-2256-4a03-b7dc-4aa9db506805 tempest-ImagesNegativeTestJSON-1904451201 tempest-ImagesNegativeTestJSON-1904451201-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:47.020008 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-5df87270-2256-4a03-b7dc-4aa9db506805 tempest-ImagesNegativeTestJSON-1904451201 tempest-ImagesNegativeTestJSON-1904451201-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:47.020667 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-5df87270-2256-4a03-b7dc-4aa9db506805 tempest-ImagesNegativeTestJSON-1904451201 tempest-ImagesNegativeTestJSON-1904451201-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:47.037023 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.wsgi [None req-5df87270-2256-4a03-b7dc-4aa9db506805 tempest-ImagesNegativeTestJSON-1904451201 tempest-ImagesNegativeTestJSON-1904451201-project] HTTP exception thrown: Instance 077786bf-b9d6-4b7e-9eb5-ce4612dcd945 could not be found. Nov 01 19:02:47.039351 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-5df87270-2256-4a03-b7dc-4aa9db506805 tempest-ImagesNegativeTestJSON-1904451201 tempest-ImagesNegativeTestJSON-1904451201-project] Request method failure captured: Nov 01 19:02:47.039351 n-d-863052-2 devstack@n-api.service[121402]: request: GET /compute/v2.1/servers/077786bf-b9d6-4b7e-9eb5-ce4612dcd945 HTTP/1.1 Nov 01 19:02:47.039351 n-d-863052-2 devstack@n-api.service[121402]: Accept: application/json Nov 01 19:02:47.039351 n-d-863052-2 devstack@n-api.service[121402]: Accept-Encoding: identity Nov 01 19:02:47.039351 n-d-863052-2 devstack@n-api.service[121402]: Connection: close Nov 01 19:02:47.039351 n-d-863052-2 devstack@n-api.service[121402]: Content-Length: 0 Nov 01 19:02:47.039351 n-d-863052-2 devstack@n-api.service[121402]: Content-Type: application/json Nov 01 19:02:47.039351 n-d-863052-2 devstack@n-api.service[121402]: Host: 10.222.0.13 Nov 01 19:02:47.039351 n-d-863052-2 devstack@n-api.service[121402]: Openstack-System-Scope: None Nov 01 19:02:47.039351 n-d-863052-2 devstack@n-api.service[121402]: User-Agent: python-urllib3/1.26.12 Nov 01 19:02:47.039351 n-d-863052-2 devstack@n-api.service[121402]: X-Auth-Token: gAAAAABjYW03VNR-pJjM6QDt1ENE6pVyLjj8nJ6NZOTYTI1JOfjsfFIcz_V4DXkawdzn9vSiLtmQngNG5s5yWVtzYKaipqyalLtMLVEDPL7o_JiuS-X6djXnLEwedyG166WSIFOhAed7kaHRAAunjeIwpl_aIliXm6y4J2ke9JrIAiRBST8gWgc Nov 01 19:02:47.039351 n-d-863052-2 devstack@n-api.service[121402]: X-Domain-Id: None Nov 01 19:02:47.039351 n-d-863052-2 devstack@n-api.service[121402]: X-Domain-Name: None Nov 01 19:02:47.039351 n-d-863052-2 devstack@n-api.service[121402]: X-Identity-Status: Confirmed Nov 01 19:02:47.039351 n-d-863052-2 devstack@n-api.service[121402]: X-Is-Admin-Project: True Nov 01 19:02:47.039351 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Domain-Id: default Nov 01 19:02:47.039351 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Domain-Name: Default Nov 01 19:02:47.039351 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Id: 68771d3adba04230a0fc3f69b50cc9b2 Nov 01 19:02:47.039351 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Name: tempest-ImagesNegativeTestJSON-1904451201 Nov 01 19:02:47.039351 n-d-863052-2 devstack@n-api.service[121402]: X-Role: member,reader Nov 01 19:02:47.039351 n-d-863052-2 devstack@n-api.service[121402]: X-Roles: member,reader Nov 01 19:02:47.039351 n-d-863052-2 devstack@n-api.service[121402]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/68771d3adba04230a0fc3f69b50cc9b2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/68771d3adba04230a0fc3f69b50cc9b2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_68771d3adba04230a0fc3f69b50cc9b2", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/68771d3adba04230a0fc3f69b50cc9b2"}]}] Nov 01 19:02:47.039351 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant: tempest-ImagesNegativeTestJSON-1904451201 Nov 01 19:02:47.039351 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant-Id: 68771d3adba04230a0fc3f69b50cc9b2 Nov 01 19:02:47.039351 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1904451201 Nov 01 19:02:47.039351 n-d-863052-2 devstack@n-api.service[121402]: X-User: tempest-ImagesNegativeTestJSON-1904451201-project Nov 01 19:02:47.039351 n-d-863052-2 devstack@n-api.service[121402]: X-User-Domain-Id: default Nov 01 19:02:47.039351 n-d-863052-2 devstack@n-api.service[121402]: X-User-Domain-Name: Default Nov 01 19:02:47.039351 n-d-863052-2 devstack@n-api.service[121402]: X-User-Id: 1c4a93c606cd4fc98c9b667bfc3d367b Nov 01 19:02:47.039351 n-d-863052-2 devstack@n-api.service[121402]: X-User-Name: tempest-ImagesNegativeTestJSON-1904451201-project Nov 01 19:02:47.039351 n-d-863052-2 devstack@n-api.service[121402]: method: > Nov 01 19:02:47.039351 n-d-863052-2 devstack@n-api.service[121402]: exception: Instance 077786bf-b9d6-4b7e-9eb5-ce4612dcd945 could not be found. Nov 01 19:02:47.039351 n-d-863052-2 devstack@n-api.service[121402]: action_args: {'id': '077786bf-b9d6-4b7e-9eb5-ce4612dcd945'} Nov 01 19:02:47.039351 n-d-863052-2 devstack@n-api.service[121402]: {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 01 19:02:47.039351 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:02:47.039351 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 01 19:02:47.039351 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 01 19:02:47.039351 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 01 19:02:47.039351 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 01 19:02:47.039351 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 01 19:02:47.039351 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 01 19:02:47.039351 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 01 19:02:47.039351 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 01 19:02:47.039351 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 077786bf-b9d6-4b7e-9eb5-ce4612dcd945 could not be found. Nov 01 19:02:47.039351 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:02:47.039351 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:02:47.039351 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:02:47.039351 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:02:47.039351 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:02:47.039351 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:02:47.039351 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 01 19:02:47.039351 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 01 19:02:47.039351 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 01 19:02:47.039351 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 01 19:02:47.039351 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 01 19:02:47.039351 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 01 19:02:47.039351 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 01 19:02:47.039351 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 01 19:02:47.039351 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 01 19:02:47.039351 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 01 19:02:47.039351 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 077786bf-b9d6-4b7e-9eb5-ce4612dcd945 could not be found. Nov 01 19:02:47.039351 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:02:47.039351 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:02:47.039351 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:02:47.042392 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:02:47.042392 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:02:47.042392 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:02:47.042392 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 01 19:02:47.042392 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 01 19:02:47.042392 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 077786bf-b9d6-4b7e-9eb5-ce4612dcd945 could not be found. Nov 01 19:02:47.042392 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:02:47.044854 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-5df87270-2256-4a03-b7dc-4aa9db506805 tempest-ImagesNegativeTestJSON-1904451201 tempest-ImagesNegativeTestJSON-1904451201-project] Returning 404 to user: Instance 077786bf-b9d6-4b7e-9eb5-ce4612dcd945 could not be found. {{(pid=121402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 01 19:02:47.046486 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-5df87270-2256-4a03-b7dc-4aa9db506805 tempest-ImagesNegativeTestJSON-1904451201 tempest-ImagesNegativeTestJSON-1904451201-project] 10.222.0.13 "GET /compute/v2.1/servers/077786bf-b9d6-4b7e-9eb5-ce4612dcd945" status: 404 len: 111 microversion: 2.1 time: 0.049315 Nov 01 19:02:47.053217 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1151/2310] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:02:46 2022] GET /compute/v2.1/servers/077786bf-b9d6-4b7e-9eb5-ce4612dcd945 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 01 19:02:47.058532 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-c176385b-170d-40af-9afd-74c75562fa33 tempest-ImagesNegativeTestJSON-1904451201 tempest-ImagesNegativeTestJSON-1904451201-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-782683424", "metadata": {"image_type": "test"}}} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:02:47.062478 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-c176385b-170d-40af-9afd-74c75562fa33 tempest-ImagesNegativeTestJSON-1904451201 tempest-ImagesNegativeTestJSON-1904451201-project] [instance: 077786bf-b9d6-4b7e-9eb5-ce4612dcd945] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:02:47.070920 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-c176385b-170d-40af-9afd-74c75562fa33 tempest-ImagesNegativeTestJSON-1904451201 tempest-ImagesNegativeTestJSON-1904451201-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:47.071524 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-c176385b-170d-40af-9afd-74c75562fa33 tempest-ImagesNegativeTestJSON-1904451201 tempest-ImagesNegativeTestJSON-1904451201-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:47.072204 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-c176385b-170d-40af-9afd-74c75562fa33 tempest-ImagesNegativeTestJSON-1904451201 tempest-ImagesNegativeTestJSON-1904451201-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:47.073900 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-c176385b-170d-40af-9afd-74c75562fa33 tempest-ImagesNegativeTestJSON-1904451201 tempest-ImagesNegativeTestJSON-1904451201-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:47.074806 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-c176385b-170d-40af-9afd-74c75562fa33 tempest-ImagesNegativeTestJSON-1904451201 tempest-ImagesNegativeTestJSON-1904451201-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:47.075321 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-c176385b-170d-40af-9afd-74c75562fa33 tempest-ImagesNegativeTestJSON-1904451201 tempest-ImagesNegativeTestJSON-1904451201-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:47.075417 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-c350c03f-3183-4c86-a391-78066699018b tempest-ServersTestBootFromVolume-877599095 tempest-ServersTestBootFromVolume-877599095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed2352ce53fc4045adde8cd81b78b3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651046528c204df299ca3d14c44b4a7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:02:47.083780 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-c350c03f-3183-4c86-a391-78066699018b tempest-ServersTestBootFromVolume-877599095 tempest-ServersTestBootFromVolume-877599095-project] 10.222.0.13 "GET /compute/v2.1/servers/44cdf0d8-969b-4149-bb03-6bc390977019" status: 200 len: 1292 microversion: 2.1 time: 0.499831 Nov 01 19:02:47.092999 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1160/2311] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:02:46 2022] GET /compute/v2.1/servers/44cdf0d8-969b-4149-bb03-6bc390977019 => generated 1292 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 19:02:47.105521 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.wsgi [None req-c176385b-170d-40af-9afd-74c75562fa33 tempest-ImagesNegativeTestJSON-1904451201 tempest-ImagesNegativeTestJSON-1904451201-project] HTTP exception thrown: Instance 077786bf-b9d6-4b7e-9eb5-ce4612dcd945 could not be found. Nov 01 19:02:47.107287 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-c176385b-170d-40af-9afd-74c75562fa33 tempest-ImagesNegativeTestJSON-1904451201 tempest-ImagesNegativeTestJSON-1904451201-project] Request method failure captured: Nov 01 19:02:47.107287 n-d-863052-2 devstack@n-api.service[121402]: request: POST /compute/v2.1/servers/077786bf-b9d6-4b7e-9eb5-ce4612dcd945/action HTTP/1.1 Nov 01 19:02:47.107287 n-d-863052-2 devstack@n-api.service[121402]: Accept: application/json Nov 01 19:02:47.107287 n-d-863052-2 devstack@n-api.service[121402]: Accept-Encoding: identity Nov 01 19:02:47.107287 n-d-863052-2 devstack@n-api.service[121402]: Connection: close Nov 01 19:02:47.107287 n-d-863052-2 devstack@n-api.service[121402]: Content-Length: 111 Nov 01 19:02:47.107287 n-d-863052-2 devstack@n-api.service[121402]: Content-Type: application/json Nov 01 19:02:47.107287 n-d-863052-2 devstack@n-api.service[121402]: Host: 10.222.0.13 Nov 01 19:02:47.107287 n-d-863052-2 devstack@n-api.service[121402]: Openstack-System-Scope: None Nov 01 19:02:47.107287 n-d-863052-2 devstack@n-api.service[121402]: User-Agent: python-urllib3/1.26.12 Nov 01 19:02:47.107287 n-d-863052-2 devstack@n-api.service[121402]: X-Auth-Token: gAAAAABjYW03VNR-pJjM6QDt1ENE6pVyLjj8nJ6NZOTYTI1JOfjsfFIcz_V4DXkawdzn9vSiLtmQngNG5s5yWVtzYKaipqyalLtMLVEDPL7o_JiuS-X6djXnLEwedyG166WSIFOhAed7kaHRAAunjeIwpl_aIliXm6y4J2ke9JrIAiRBST8gWgc Nov 01 19:02:47.107287 n-d-863052-2 devstack@n-api.service[121402]: X-Domain-Id: None Nov 01 19:02:47.107287 n-d-863052-2 devstack@n-api.service[121402]: X-Domain-Name: None Nov 01 19:02:47.107287 n-d-863052-2 devstack@n-api.service[121402]: X-Identity-Status: Confirmed Nov 01 19:02:47.107287 n-d-863052-2 devstack@n-api.service[121402]: X-Is-Admin-Project: True Nov 01 19:02:47.107287 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Domain-Id: default Nov 01 19:02:47.107287 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Domain-Name: Default Nov 01 19:02:47.107287 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Id: 68771d3adba04230a0fc3f69b50cc9b2 Nov 01 19:02:47.107287 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Name: tempest-ImagesNegativeTestJSON-1904451201 Nov 01 19:02:47.107287 n-d-863052-2 devstack@n-api.service[121402]: X-Role: member,reader Nov 01 19:02:47.107287 n-d-863052-2 devstack@n-api.service[121402]: X-Roles: member,reader Nov 01 19:02:47.107287 n-d-863052-2 devstack@n-api.service[121402]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/68771d3adba04230a0fc3f69b50cc9b2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/68771d3adba04230a0fc3f69b50cc9b2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_68771d3adba04230a0fc3f69b50cc9b2", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/68771d3adba04230a0fc3f69b50cc9b2"}]}] Nov 01 19:02:47.107287 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant: tempest-ImagesNegativeTestJSON-1904451201 Nov 01 19:02:47.107287 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant-Id: 68771d3adba04230a0fc3f69b50cc9b2 Nov 01 19:02:47.107287 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1904451201 Nov 01 19:02:47.107287 n-d-863052-2 devstack@n-api.service[121402]: X-User: tempest-ImagesNegativeTestJSON-1904451201-project Nov 01 19:02:47.107287 n-d-863052-2 devstack@n-api.service[121402]: X-User-Domain-Id: default Nov 01 19:02:47.107287 n-d-863052-2 devstack@n-api.service[121402]: X-User-Domain-Name: Default Nov 01 19:02:47.107287 n-d-863052-2 devstack@n-api.service[121402]: X-User-Id: 1c4a93c606cd4fc98c9b667bfc3d367b Nov 01 19:02:47.107287 n-d-863052-2 devstack@n-api.service[121402]: X-User-Name: tempest-ImagesNegativeTestJSON-1904451201-project Nov 01 19:02:47.107287 n-d-863052-2 devstack@n-api.service[121402]: Nov 01 19:02:47.107287 n-d-863052-2 devstack@n-api.service[121402]: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-782683424", "metadata": {"image_type": "test"}}} Nov 01 19:02:47.107287 n-d-863052-2 devstack@n-api.service[121402]: method: > Nov 01 19:02:47.107287 n-d-863052-2 devstack@n-api.service[121402]: exception: Instance 077786bf-b9d6-4b7e-9eb5-ce4612dcd945 could not be found. Nov 01 19:02:47.107287 n-d-863052-2 devstack@n-api.service[121402]: action_args: {'id': '077786bf-b9d6-4b7e-9eb5-ce4612dcd945', 'body': {'createImage': {'name': 'tempest-ImagesNegativeTestJSON-image-782683424', 'metadata': {'image_type': 'test'}}}} Nov 01 19:02:47.107287 n-d-863052-2 devstack@n-api.service[121402]: {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 01 19:02:47.107287 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:02:47.107287 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 01 19:02:47.107287 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 01 19:02:47.107287 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 01 19:02:47.107287 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 01 19:02:47.107287 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 01 19:02:47.107287 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 01 19:02:47.107287 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 01 19:02:47.107287 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 01 19:02:47.107287 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 077786bf-b9d6-4b7e-9eb5-ce4612dcd945 could not be found. Nov 01 19:02:47.107287 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:02:47.107287 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:02:47.107287 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:02:47.107287 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:02:47.107287 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:02:47.107287 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:02:47.107287 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 01 19:02:47.107287 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 01 19:02:47.107287 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 01 19:02:47.107287 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 01 19:02:47.107287 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 01 19:02:47.107287 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 01 19:02:47.107287 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 01 19:02:47.107287 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 01 19:02:47.107287 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1319, in _action_create_image Nov 01 19:02:47.107287 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Nov 01 19:02:47.110139 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 01 19:02:47.110139 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 01 19:02:47.110139 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 01 19:02:47.110139 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 01 19:02:47.110139 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 077786bf-b9d6-4b7e-9eb5-ce4612dcd945 could not be found. Nov 01 19:02:47.110139 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:02:47.110139 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:02:47.110139 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:02:47.110139 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:02:47.110139 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:02:47.110139 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:02:47.110139 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 01 19:02:47.110139 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 01 19:02:47.110139 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 077786bf-b9d6-4b7e-9eb5-ce4612dcd945 could not be found. Nov 01 19:02:47.110139 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:02:47.110139 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-c176385b-170d-40af-9afd-74c75562fa33 tempest-ImagesNegativeTestJSON-1904451201 tempest-ImagesNegativeTestJSON-1904451201-project] Returning 404 to user: Instance 077786bf-b9d6-4b7e-9eb5-ce4612dcd945 could not be found. {{(pid=121402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 01 19:02:47.112519 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-c176385b-170d-40af-9afd-74c75562fa33 tempest-ImagesNegativeTestJSON-1904451201 tempest-ImagesNegativeTestJSON-1904451201-project] 10.222.0.13 "POST /compute/v2.1/servers/077786bf-b9d6-4b7e-9eb5-ce4612dcd945/action" status: 404 len: 111 microversion: 2.1 time: 0.054260 Nov 01 19:02:47.114437 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1152/2312] 10.222.0.13 () {60 vars in 1279 bytes} [Tue Nov 1 19:02:47 2022] POST /compute/v2.1/servers/077786bf-b9d6-4b7e-9eb5-ce4612dcd945/action => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 01 19:02:47.125983 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-ca39095a-cdb1-4c25-a1b2-8c51e9a6296c tempest-ImagesNegativeTestJSON-1904451201 tempest-ImagesNegativeTestJSON-1904451201-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-1385939794", "metadata": {"image_type": "test"}}} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:02:47.128432 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-ca39095a-cdb1-4c25-a1b2-8c51e9a6296c tempest-ImagesNegativeTestJSON-1904451201 tempest-ImagesNegativeTestJSON-1904451201-project] Failed to fetch instance by id tempest-invalid-1187914356 {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2981}} Nov 01 19:02:47.129300 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.wsgi [None req-ca39095a-cdb1-4c25-a1b2-8c51e9a6296c tempest-ImagesNegativeTestJSON-1904451201 tempest-ImagesNegativeTestJSON-1904451201-project] HTTP exception thrown: Instance tempest-invalid-1187914356 could not be found. Nov 01 19:02:47.132270 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-ca39095a-cdb1-4c25-a1b2-8c51e9a6296c tempest-ImagesNegativeTestJSON-1904451201 tempest-ImagesNegativeTestJSON-1904451201-project] Request method failure captured: Nov 01 19:02:47.132270 n-d-863052-2 devstack@n-api.service[121403]: request: POST /compute/v2.1/servers/tempest-invalid-1187914356/action HTTP/1.1 Nov 01 19:02:47.132270 n-d-863052-2 devstack@n-api.service[121403]: Accept: application/json Nov 01 19:02:47.132270 n-d-863052-2 devstack@n-api.service[121403]: Accept-Encoding: identity Nov 01 19:02:47.132270 n-d-863052-2 devstack@n-api.service[121403]: Connection: close Nov 01 19:02:47.132270 n-d-863052-2 devstack@n-api.service[121403]: Content-Length: 112 Nov 01 19:02:47.132270 n-d-863052-2 devstack@n-api.service[121403]: Content-Type: application/json Nov 01 19:02:47.132270 n-d-863052-2 devstack@n-api.service[121403]: Host: 10.222.0.13 Nov 01 19:02:47.132270 n-d-863052-2 devstack@n-api.service[121403]: Openstack-System-Scope: None Nov 01 19:02:47.132270 n-d-863052-2 devstack@n-api.service[121403]: User-Agent: python-urllib3/1.26.12 Nov 01 19:02:47.132270 n-d-863052-2 devstack@n-api.service[121403]: X-Auth-Token: gAAAAABjYW03VNR-pJjM6QDt1ENE6pVyLjj8nJ6NZOTYTI1JOfjsfFIcz_V4DXkawdzn9vSiLtmQngNG5s5yWVtzYKaipqyalLtMLVEDPL7o_JiuS-X6djXnLEwedyG166WSIFOhAed7kaHRAAunjeIwpl_aIliXm6y4J2ke9JrIAiRBST8gWgc Nov 01 19:02:47.132270 n-d-863052-2 devstack@n-api.service[121403]: X-Domain-Id: None Nov 01 19:02:47.132270 n-d-863052-2 devstack@n-api.service[121403]: X-Domain-Name: None Nov 01 19:02:47.132270 n-d-863052-2 devstack@n-api.service[121403]: X-Identity-Status: Confirmed Nov 01 19:02:47.132270 n-d-863052-2 devstack@n-api.service[121403]: X-Is-Admin-Project: True Nov 01 19:02:47.132270 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Domain-Id: default Nov 01 19:02:47.132270 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Domain-Name: Default Nov 01 19:02:47.132270 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Id: 68771d3adba04230a0fc3f69b50cc9b2 Nov 01 19:02:47.132270 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Name: tempest-ImagesNegativeTestJSON-1904451201 Nov 01 19:02:47.132270 n-d-863052-2 devstack@n-api.service[121403]: X-Role: member,reader Nov 01 19:02:47.132270 n-d-863052-2 devstack@n-api.service[121403]: X-Roles: member,reader Nov 01 19:02:47.132270 n-d-863052-2 devstack@n-api.service[121403]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/68771d3adba04230a0fc3f69b50cc9b2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/68771d3adba04230a0fc3f69b50cc9b2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_68771d3adba04230a0fc3f69b50cc9b2", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/68771d3adba04230a0fc3f69b50cc9b2"}]}] Nov 01 19:02:47.132270 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant: tempest-ImagesNegativeTestJSON-1904451201 Nov 01 19:02:47.132270 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant-Id: 68771d3adba04230a0fc3f69b50cc9b2 Nov 01 19:02:47.132270 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1904451201 Nov 01 19:02:47.132270 n-d-863052-2 devstack@n-api.service[121403]: X-User: tempest-ImagesNegativeTestJSON-1904451201-project Nov 01 19:02:47.132270 n-d-863052-2 devstack@n-api.service[121403]: X-User-Domain-Id: default Nov 01 19:02:47.132270 n-d-863052-2 devstack@n-api.service[121403]: X-User-Domain-Name: Default Nov 01 19:02:47.132270 n-d-863052-2 devstack@n-api.service[121403]: X-User-Id: 1c4a93c606cd4fc98c9b667bfc3d367b Nov 01 19:02:47.132270 n-d-863052-2 devstack@n-api.service[121403]: X-User-Name: tempest-ImagesNegativeTestJSON-1904451201-project Nov 01 19:02:47.132270 n-d-863052-2 devstack@n-api.service[121403]: Nov 01 19:02:47.132270 n-d-863052-2 devstack@n-api.service[121403]: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-1385939794", "metadata": {"image_type": "test"}}} Nov 01 19:02:47.132270 n-d-863052-2 devstack@n-api.service[121403]: method: > Nov 01 19:02:47.132270 n-d-863052-2 devstack@n-api.service[121403]: exception: Instance tempest-invalid-1187914356 could not be found. Nov 01 19:02:47.132270 n-d-863052-2 devstack@n-api.service[121403]: action_args: {'id': 'tempest-invalid-1187914356', 'body': {'createImage': {'name': 'tempest-ImagesNegativeTestJSON-image-1385939794', 'metadata': {'image_type': 'test'}}}} Nov 01 19:02:47.132270 n-d-863052-2 devstack@n-api.service[121403]: {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 01 19:02:47.132270 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:02:47.132270 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 01 19:02:47.132270 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 01 19:02:47.132270 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Nov 01 19:02:47.132270 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Nov 01 19:02:47.132270 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance tempest-invalid-1187914356 could not be found. Nov 01 19:02:47.132270 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:02:47.132270 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:02:47.132270 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:02:47.132270 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:02:47.132270 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:02:47.132270 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:02:47.132270 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 01 19:02:47.132270 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 01 19:02:47.132270 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 01 19:02:47.132270 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 01 19:02:47.132270 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 01 19:02:47.132270 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 01 19:02:47.132270 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 01 19:02:47.132270 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 01 19:02:47.132270 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1319, in _action_create_image Nov 01 19:02:47.132270 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Nov 01 19:02:47.132270 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 01 19:02:47.132270 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 01 19:02:47.132270 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 01 19:02:47.132270 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 01 19:02:47.132270 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance tempest-invalid-1187914356 could not be found. Nov 01 19:02:47.135205 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:02:47.135205 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:02:47.135205 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:02:47.135205 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:02:47.135205 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:02:47.135205 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:02:47.135205 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 01 19:02:47.135205 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 01 19:02:47.135205 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance tempest-invalid-1187914356 could not be found. Nov 01 19:02:47.135205 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:02:47.137595 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-ca39095a-cdb1-4c25-a1b2-8c51e9a6296c tempest-ImagesNegativeTestJSON-1904451201 tempest-ImagesNegativeTestJSON-1904451201-project] Returning 404 to user: Instance tempest-invalid-1187914356 could not be found. {{(pid=121403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 01 19:02:47.138638 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-ca39095a-cdb1-4c25-a1b2-8c51e9a6296c tempest-ImagesNegativeTestJSON-1904451201 tempest-ImagesNegativeTestJSON-1904451201-project] 10.222.0.13 "POST /compute/v2.1/servers/tempest-invalid-1187914356/action" status: 404 len: 101 microversion: 2.1 time: 0.016910 Nov 01 19:02:47.140330 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1161/2313] 10.222.0.13 () {60 vars in 1249 bytes} [Tue Nov 1 19:02:47 2022] POST /compute/v2.1/servers/tempest-invalid-1187914356/action => generated 101 bytes in 19 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 01 19:02:47.151092 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-edea33e5-8b4a-4d40-b712-0f21fd6e8cc8 tempest-ImagesNegativeTestJSON-1904451201 tempest-ImagesNegativeTestJSON-1904451201-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1065496007"}} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:02:47.153496 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-edea33e5-8b4a-4d40-b712-0f21fd6e8cc8 tempest-ImagesNegativeTestJSON-1904451201 tempest-ImagesNegativeTestJSON-1904451201-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2981}} Nov 01 19:02:47.154008 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.wsgi [None req-edea33e5-8b4a-4d40-b712-0f21fd6e8cc8 tempest-ImagesNegativeTestJSON-1904451201 tempest-ImagesNegativeTestJSON-1904451201-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Nov 01 19:02:47.155507 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-edea33e5-8b4a-4d40-b712-0f21fd6e8cc8 tempest-ImagesNegativeTestJSON-1904451201 tempest-ImagesNegativeTestJSON-1904451201-project] Request method failure captured: Nov 01 19:02:47.155507 n-d-863052-2 devstack@n-api.service[121402]: request: POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action HTTP/1.1 Nov 01 19:02:47.155507 n-d-863052-2 devstack@n-api.service[121402]: Accept: application/json Nov 01 19:02:47.155507 n-d-863052-2 devstack@n-api.service[121402]: Accept-Encoding: identity Nov 01 19:02:47.155507 n-d-863052-2 devstack@n-api.service[121402]: Connection: close Nov 01 19:02:47.155507 n-d-863052-2 devstack@n-api.service[121402]: Content-Length: 57 Nov 01 19:02:47.155507 n-d-863052-2 devstack@n-api.service[121402]: Content-Type: application/json Nov 01 19:02:47.155507 n-d-863052-2 devstack@n-api.service[121402]: Host: 10.222.0.13 Nov 01 19:02:47.155507 n-d-863052-2 devstack@n-api.service[121402]: Openstack-System-Scope: None Nov 01 19:02:47.155507 n-d-863052-2 devstack@n-api.service[121402]: User-Agent: python-urllib3/1.26.12 Nov 01 19:02:47.155507 n-d-863052-2 devstack@n-api.service[121402]: X-Auth-Token: gAAAAABjYW03VNR-pJjM6QDt1ENE6pVyLjj8nJ6NZOTYTI1JOfjsfFIcz_V4DXkawdzn9vSiLtmQngNG5s5yWVtzYKaipqyalLtMLVEDPL7o_JiuS-X6djXnLEwedyG166WSIFOhAed7kaHRAAunjeIwpl_aIliXm6y4J2ke9JrIAiRBST8gWgc Nov 01 19:02:47.155507 n-d-863052-2 devstack@n-api.service[121402]: X-Domain-Id: None Nov 01 19:02:47.155507 n-d-863052-2 devstack@n-api.service[121402]: X-Domain-Name: None Nov 01 19:02:47.155507 n-d-863052-2 devstack@n-api.service[121402]: X-Identity-Status: Confirmed Nov 01 19:02:47.155507 n-d-863052-2 devstack@n-api.service[121402]: X-Is-Admin-Project: True Nov 01 19:02:47.155507 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Domain-Id: default Nov 01 19:02:47.155507 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Domain-Name: Default Nov 01 19:02:47.155507 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Id: 68771d3adba04230a0fc3f69b50cc9b2 Nov 01 19:02:47.155507 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Name: tempest-ImagesNegativeTestJSON-1904451201 Nov 01 19:02:47.155507 n-d-863052-2 devstack@n-api.service[121402]: X-Role: member,reader Nov 01 19:02:47.155507 n-d-863052-2 devstack@n-api.service[121402]: X-Roles: member,reader Nov 01 19:02:47.155507 n-d-863052-2 devstack@n-api.service[121402]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/68771d3adba04230a0fc3f69b50cc9b2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/68771d3adba04230a0fc3f69b50cc9b2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_68771d3adba04230a0fc3f69b50cc9b2", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/68771d3adba04230a0fc3f69b50cc9b2"}]}] Nov 01 19:02:47.155507 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant: tempest-ImagesNegativeTestJSON-1904451201 Nov 01 19:02:47.155507 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant-Id: 68771d3adba04230a0fc3f69b50cc9b2 Nov 01 19:02:47.155507 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1904451201 Nov 01 19:02:47.155507 n-d-863052-2 devstack@n-api.service[121402]: X-User: tempest-ImagesNegativeTestJSON-1904451201-project Nov 01 19:02:47.155507 n-d-863052-2 devstack@n-api.service[121402]: X-User-Domain-Id: default Nov 01 19:02:47.155507 n-d-863052-2 devstack@n-api.service[121402]: X-User-Domain-Name: Default Nov 01 19:02:47.155507 n-d-863052-2 devstack@n-api.service[121402]: X-User-Id: 1c4a93c606cd4fc98c9b667bfc3d367b Nov 01 19:02:47.155507 n-d-863052-2 devstack@n-api.service[121402]: X-User-Name: tempest-ImagesNegativeTestJSON-1904451201-project Nov 01 19:02:47.155507 n-d-863052-2 devstack@n-api.service[121402]: Nov 01 19:02:47.155507 n-d-863052-2 devstack@n-api.service[121402]: {"createImage": {"name": "tempest-test-snap-1065496007"}} Nov 01 19:02:47.155507 n-d-863052-2 devstack@n-api.service[121402]: method: > Nov 01 19:02:47.155507 n-d-863052-2 devstack@n-api.service[121402]: exception: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Nov 01 19:02:47.155507 n-d-863052-2 devstack@n-api.service[121402]: action_args: {'id': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'body': {'createImage': {'name': 'tempest-test-snap-1065496007'}}} Nov 01 19:02:47.155507 n-d-863052-2 devstack@n-api.service[121402]: {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 01 19:02:47.155507 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:02:47.155507 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 01 19:02:47.155507 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 01 19:02:47.155507 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Nov 01 19:02:47.155507 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Nov 01 19:02:47.155507 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Nov 01 19:02:47.155507 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:02:47.155507 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:02:47.155507 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:02:47.155507 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:02:47.155507 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:02:47.155507 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:02:47.155507 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 01 19:02:47.155507 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 01 19:02:47.155507 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 01 19:02:47.155507 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 01 19:02:47.155507 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 01 19:02:47.155507 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 01 19:02:47.155507 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 01 19:02:47.155507 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 01 19:02:47.155507 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1319, in _action_create_image Nov 01 19:02:47.155507 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Nov 01 19:02:47.155507 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 01 19:02:47.155507 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 01 19:02:47.155507 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 01 19:02:47.155507 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 01 19:02:47.155507 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Nov 01 19:02:47.155507 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:02:47.158813 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:02:47.158813 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:02:47.158813 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:02:47.158813 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:02:47.158813 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:02:47.158813 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 01 19:02:47.158813 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 01 19:02:47.158813 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Nov 01 19:02:47.158813 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:02:47.158813 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-edea33e5-8b4a-4d40-b712-0f21fd6e8cc8 tempest-ImagesNegativeTestJSON-1904451201 tempest-ImagesNegativeTestJSON-1904451201-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=121402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 01 19:02:47.160476 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-edea33e5-8b4a-4d40-b712-0f21fd6e8cc8 tempest-ImagesNegativeTestJSON-1904451201 tempest-ImagesNegativeTestJSON-1904451201-project] 10.222.0.13 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 110 microversion: 2.1 time: 0.009914 Nov 01 19:02:47.162005 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1153/2314] 10.222.0.13 () {60 vars in 1275 bytes} [Tue Nov 1 19:02:47 2022] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 110 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 01 19:02:47.172373 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-7e7f9e8e-88f0-43ea-9734-8e7218c0d9e5 tempest-ImagesNegativeTestJSON-1904451201 tempest-ImagesNegativeTestJSON-1904451201-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-2037004013"}} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:02:47.175037 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-7e7f9e8e-88f0-43ea-9734-8e7218c0d9e5 tempest-ImagesNegativeTestJSON-1904451201 tempest-ImagesNegativeTestJSON-1904451201-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2981}} Nov 01 19:02:47.176102 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.wsgi [None req-7e7f9e8e-88f0-43ea-9734-8e7218c0d9e5 tempest-ImagesNegativeTestJSON-1904451201 tempest-ImagesNegativeTestJSON-1904451201-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Nov 01 19:02:47.178089 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-62fdb979-9da1-4f9a-ad85-33d08aa2de2e tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:02:47.178204 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-7e7f9e8e-88f0-43ea-9734-8e7218c0d9e5 tempest-ImagesNegativeTestJSON-1904451201 tempest-ImagesNegativeTestJSON-1904451201-project] Request method failure captured: Nov 01 19:02:47.178204 n-d-863052-2 devstack@n-api.service[121403]: request: POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action HTTP/1.1 Nov 01 19:02:47.178204 n-d-863052-2 devstack@n-api.service[121403]: Accept: application/json Nov 01 19:02:47.178204 n-d-863052-2 devstack@n-api.service[121403]: Accept-Encoding: identity Nov 01 19:02:47.178204 n-d-863052-2 devstack@n-api.service[121403]: Connection: close Nov 01 19:02:47.178204 n-d-863052-2 devstack@n-api.service[121403]: Content-Length: 57 Nov 01 19:02:47.178204 n-d-863052-2 devstack@n-api.service[121403]: Content-Type: application/json Nov 01 19:02:47.178204 n-d-863052-2 devstack@n-api.service[121403]: Host: 10.222.0.13 Nov 01 19:02:47.178204 n-d-863052-2 devstack@n-api.service[121403]: Openstack-System-Scope: None Nov 01 19:02:47.178204 n-d-863052-2 devstack@n-api.service[121403]: User-Agent: python-urllib3/1.26.12 Nov 01 19:02:47.178204 n-d-863052-2 devstack@n-api.service[121403]: X-Auth-Token: gAAAAABjYW03VNR-pJjM6QDt1ENE6pVyLjj8nJ6NZOTYTI1JOfjsfFIcz_V4DXkawdzn9vSiLtmQngNG5s5yWVtzYKaipqyalLtMLVEDPL7o_JiuS-X6djXnLEwedyG166WSIFOhAed7kaHRAAunjeIwpl_aIliXm6y4J2ke9JrIAiRBST8gWgc Nov 01 19:02:47.178204 n-d-863052-2 devstack@n-api.service[121403]: X-Domain-Id: None Nov 01 19:02:47.178204 n-d-863052-2 devstack@n-api.service[121403]: X-Domain-Name: None Nov 01 19:02:47.178204 n-d-863052-2 devstack@n-api.service[121403]: X-Identity-Status: Confirmed Nov 01 19:02:47.178204 n-d-863052-2 devstack@n-api.service[121403]: X-Is-Admin-Project: True Nov 01 19:02:47.178204 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Domain-Id: default Nov 01 19:02:47.178204 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Domain-Name: Default Nov 01 19:02:47.178204 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Id: 68771d3adba04230a0fc3f69b50cc9b2 Nov 01 19:02:47.178204 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Name: tempest-ImagesNegativeTestJSON-1904451201 Nov 01 19:02:47.178204 n-d-863052-2 devstack@n-api.service[121403]: X-Role: member,reader Nov 01 19:02:47.178204 n-d-863052-2 devstack@n-api.service[121403]: X-Roles: member,reader Nov 01 19:02:47.178204 n-d-863052-2 devstack@n-api.service[121403]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/68771d3adba04230a0fc3f69b50cc9b2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/68771d3adba04230a0fc3f69b50cc9b2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_68771d3adba04230a0fc3f69b50cc9b2", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/68771d3adba04230a0fc3f69b50cc9b2"}]}] Nov 01 19:02:47.178204 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant: tempest-ImagesNegativeTestJSON-1904451201 Nov 01 19:02:47.178204 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant-Id: 68771d3adba04230a0fc3f69b50cc9b2 Nov 01 19:02:47.178204 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1904451201 Nov 01 19:02:47.178204 n-d-863052-2 devstack@n-api.service[121403]: X-User: tempest-ImagesNegativeTestJSON-1904451201-project Nov 01 19:02:47.178204 n-d-863052-2 devstack@n-api.service[121403]: X-User-Domain-Id: default Nov 01 19:02:47.178204 n-d-863052-2 devstack@n-api.service[121403]: X-User-Domain-Name: Default Nov 01 19:02:47.178204 n-d-863052-2 devstack@n-api.service[121403]: X-User-Id: 1c4a93c606cd4fc98c9b667bfc3d367b Nov 01 19:02:47.178204 n-d-863052-2 devstack@n-api.service[121403]: X-User-Name: tempest-ImagesNegativeTestJSON-1904451201-project Nov 01 19:02:47.178204 n-d-863052-2 devstack@n-api.service[121403]: Nov 01 19:02:47.178204 n-d-863052-2 devstack@n-api.service[121403]: {"createImage": {"name": "tempest-test-snap-2037004013"}} Nov 01 19:02:47.178204 n-d-863052-2 devstack@n-api.service[121403]: method: > Nov 01 19:02:47.178204 n-d-863052-2 devstack@n-api.service[121403]: exception: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Nov 01 19:02:47.178204 n-d-863052-2 devstack@n-api.service[121403]: action_args: {'id': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'body': {'createImage': {'name': 'tempest-test-snap-2037004013'}}} Nov 01 19:02:47.178204 n-d-863052-2 devstack@n-api.service[121403]: {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 01 19:02:47.178204 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:02:47.178204 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 01 19:02:47.178204 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 01 19:02:47.178204 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Nov 01 19:02:47.178204 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Nov 01 19:02:47.178204 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Nov 01 19:02:47.178204 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:02:47.178204 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:02:47.178204 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:02:47.178204 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:02:47.178204 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:02:47.178204 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:02:47.178204 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 01 19:02:47.178204 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 01 19:02:47.178204 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 01 19:02:47.178204 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 01 19:02:47.178204 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 01 19:02:47.178204 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 01 19:02:47.178204 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 01 19:02:47.178204 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 01 19:02:47.178204 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1319, in _action_create_image Nov 01 19:02:47.178204 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Nov 01 19:02:47.178204 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 01 19:02:47.178204 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 01 19:02:47.178204 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 01 19:02:47.178204 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 01 19:02:47.178204 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Nov 01 19:02:47.178204 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:02:47.181245 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:02:47.181245 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:02:47.181245 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:02:47.181245 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:02:47.181245 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:02:47.181245 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 01 19:02:47.181245 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 01 19:02:47.181245 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Nov 01 19:02:47.181245 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:02:47.181245 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-7e7f9e8e-88f0-43ea-9734-8e7218c0d9e5 tempest-ImagesNegativeTestJSON-1904451201 tempest-ImagesNegativeTestJSON-1904451201-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=121403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 01 19:02:47.182199 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-62fdb979-9da1-4f9a-ad85-33d08aa2de2e tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] [instance: 4b9fb909-26f7-40af-bac5-e7d2a6b9fb77] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:02:47.182444 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-7e7f9e8e-88f0-43ea-9734-8e7218c0d9e5 tempest-ImagesNegativeTestJSON-1904451201 tempest-ImagesNegativeTestJSON-1904451201-project] 10.222.0.13 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 112 microversion: 2.1 time: 0.011899 Nov 01 19:02:47.182444 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1162/2315] 10.222.0.13 () {60 vars in 1281 bytes} [Tue Nov 1 19:02:47 2022] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 112 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 01 19:02:47.191880 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-62fdb979-9da1-4f9a-ad85-33d08aa2de2e tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:47.192682 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-62fdb979-9da1-4f9a-ad85-33d08aa2de2e tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:47.193788 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-62fdb979-9da1-4f9a-ad85-33d08aa2de2e tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:47.195461 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-62fdb979-9da1-4f9a-ad85-33d08aa2de2e tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:47.196272 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-62fdb979-9da1-4f9a-ad85-33d08aa2de2e tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:47.197582 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-62fdb979-9da1-4f9a-ad85-33d08aa2de2e tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:47.197886 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-fd83a82c-6cce-4b42-8d99-0183b80d8e27 tempest-ImagesNegativeTestJSON-1904451201 tempest-ImagesNegativeTestJSON-1904451201-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:02:47.200604 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-fd83a82c-6cce-4b42-8d99-0183b80d8e27 tempest-ImagesNegativeTestJSON-1904451201 tempest-ImagesNegativeTestJSON-1904451201-project] [instance: 077786bf-b9d6-4b7e-9eb5-ce4612dcd945] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:02:47.212440 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-fd83a82c-6cce-4b42-8d99-0183b80d8e27 tempest-ImagesNegativeTestJSON-1904451201 tempest-ImagesNegativeTestJSON-1904451201-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:47.215594 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-fd83a82c-6cce-4b42-8d99-0183b80d8e27 tempest-ImagesNegativeTestJSON-1904451201 tempest-ImagesNegativeTestJSON-1904451201-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:47.219881 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-fd83a82c-6cce-4b42-8d99-0183b80d8e27 tempest-ImagesNegativeTestJSON-1904451201 tempest-ImagesNegativeTestJSON-1904451201-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:47.220942 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-fd83a82c-6cce-4b42-8d99-0183b80d8e27 tempest-ImagesNegativeTestJSON-1904451201 tempest-ImagesNegativeTestJSON-1904451201-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:47.221674 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-fd83a82c-6cce-4b42-8d99-0183b80d8e27 tempest-ImagesNegativeTestJSON-1904451201 tempest-ImagesNegativeTestJSON-1904451201-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:47.222246 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-fd83a82c-6cce-4b42-8d99-0183b80d8e27 tempest-ImagesNegativeTestJSON-1904451201 tempest-ImagesNegativeTestJSON-1904451201-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:47.253532 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.wsgi [None req-fd83a82c-6cce-4b42-8d99-0183b80d8e27 tempest-ImagesNegativeTestJSON-1904451201 tempest-ImagesNegativeTestJSON-1904451201-project] HTTP exception thrown: Instance 077786bf-b9d6-4b7e-9eb5-ce4612dcd945 could not be found. Nov 01 19:02:47.256319 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-fd83a82c-6cce-4b42-8d99-0183b80d8e27 tempest-ImagesNegativeTestJSON-1904451201 tempest-ImagesNegativeTestJSON-1904451201-project] Request method failure captured: Nov 01 19:02:47.256319 n-d-863052-2 devstack@n-api.service[121403]: request: DELETE /compute/v2.1/servers/077786bf-b9d6-4b7e-9eb5-ce4612dcd945 HTTP/1.1 Nov 01 19:02:47.256319 n-d-863052-2 devstack@n-api.service[121403]: Accept: application/json Nov 01 19:02:47.256319 n-d-863052-2 devstack@n-api.service[121403]: Accept-Encoding: identity Nov 01 19:02:47.256319 n-d-863052-2 devstack@n-api.service[121403]: Connection: close Nov 01 19:02:47.256319 n-d-863052-2 devstack@n-api.service[121403]: Content-Length: 0 Nov 01 19:02:47.256319 n-d-863052-2 devstack@n-api.service[121403]: Content-Type: application/json Nov 01 19:02:47.256319 n-d-863052-2 devstack@n-api.service[121403]: Host: 10.222.0.13 Nov 01 19:02:47.256319 n-d-863052-2 devstack@n-api.service[121403]: Openstack-System-Scope: None Nov 01 19:02:47.256319 n-d-863052-2 devstack@n-api.service[121403]: User-Agent: python-urllib3/1.26.12 Nov 01 19:02:47.256319 n-d-863052-2 devstack@n-api.service[121403]: X-Auth-Token: gAAAAABjYW03VNR-pJjM6QDt1ENE6pVyLjj8nJ6NZOTYTI1JOfjsfFIcz_V4DXkawdzn9vSiLtmQngNG5s5yWVtzYKaipqyalLtMLVEDPL7o_JiuS-X6djXnLEwedyG166WSIFOhAed7kaHRAAunjeIwpl_aIliXm6y4J2ke9JrIAiRBST8gWgc Nov 01 19:02:47.256319 n-d-863052-2 devstack@n-api.service[121403]: X-Domain-Id: None Nov 01 19:02:47.256319 n-d-863052-2 devstack@n-api.service[121403]: X-Domain-Name: None Nov 01 19:02:47.256319 n-d-863052-2 devstack@n-api.service[121403]: X-Identity-Status: Confirmed Nov 01 19:02:47.256319 n-d-863052-2 devstack@n-api.service[121403]: X-Is-Admin-Project: True Nov 01 19:02:47.256319 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Domain-Id: default Nov 01 19:02:47.256319 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Domain-Name: Default Nov 01 19:02:47.256319 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Id: 68771d3adba04230a0fc3f69b50cc9b2 Nov 01 19:02:47.256319 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Name: tempest-ImagesNegativeTestJSON-1904451201 Nov 01 19:02:47.256319 n-d-863052-2 devstack@n-api.service[121403]: X-Role: member,reader Nov 01 19:02:47.256319 n-d-863052-2 devstack@n-api.service[121403]: X-Roles: member,reader Nov 01 19:02:47.256319 n-d-863052-2 devstack@n-api.service[121403]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/68771d3adba04230a0fc3f69b50cc9b2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/68771d3adba04230a0fc3f69b50cc9b2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_68771d3adba04230a0fc3f69b50cc9b2", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/68771d3adba04230a0fc3f69b50cc9b2"}]}] Nov 01 19:02:47.256319 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant: tempest-ImagesNegativeTestJSON-1904451201 Nov 01 19:02:47.256319 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant-Id: 68771d3adba04230a0fc3f69b50cc9b2 Nov 01 19:02:47.256319 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1904451201 Nov 01 19:02:47.256319 n-d-863052-2 devstack@n-api.service[121403]: X-User: tempest-ImagesNegativeTestJSON-1904451201-project Nov 01 19:02:47.256319 n-d-863052-2 devstack@n-api.service[121403]: X-User-Domain-Id: default Nov 01 19:02:47.256319 n-d-863052-2 devstack@n-api.service[121403]: X-User-Domain-Name: Default Nov 01 19:02:47.256319 n-d-863052-2 devstack@n-api.service[121403]: X-User-Id: 1c4a93c606cd4fc98c9b667bfc3d367b Nov 01 19:02:47.256319 n-d-863052-2 devstack@n-api.service[121403]: X-User-Name: tempest-ImagesNegativeTestJSON-1904451201-project Nov 01 19:02:47.256319 n-d-863052-2 devstack@n-api.service[121403]: method: > Nov 01 19:02:47.256319 n-d-863052-2 devstack@n-api.service[121403]: exception: Instance 077786bf-b9d6-4b7e-9eb5-ce4612dcd945 could not be found. Nov 01 19:02:47.256319 n-d-863052-2 devstack@n-api.service[121403]: action_args: {'id': '077786bf-b9d6-4b7e-9eb5-ce4612dcd945'} Nov 01 19:02:47.256319 n-d-863052-2 devstack@n-api.service[121403]: {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 01 19:02:47.256319 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:02:47.256319 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 01 19:02:47.256319 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 01 19:02:47.256319 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 01 19:02:47.256319 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 01 19:02:47.256319 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 01 19:02:47.256319 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 01 19:02:47.256319 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 01 19:02:47.256319 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 01 19:02:47.256319 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 077786bf-b9d6-4b7e-9eb5-ce4612dcd945 could not be found. Nov 01 19:02:47.256319 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:02:47.256319 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:02:47.256319 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:02:47.256319 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:02:47.256319 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:02:47.256319 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:02:47.256319 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 01 19:02:47.256319 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 01 19:02:47.256319 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 01 19:02:47.256319 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 01 19:02:47.256319 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 01 19:02:47.256319 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 01 19:02:47.256319 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 01 19:02:47.256319 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 01 19:02:47.256319 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 01 19:02:47.256319 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 01 19:02:47.256319 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 01 19:02:47.256319 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 01 19:02:47.259384 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 077786bf-b9d6-4b7e-9eb5-ce4612dcd945 could not be found. Nov 01 19:02:47.259384 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:02:47.259384 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:02:47.259384 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:02:47.259384 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:02:47.259384 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:02:47.259384 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:02:47.259384 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 01 19:02:47.259384 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 01 19:02:47.259384 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 077786bf-b9d6-4b7e-9eb5-ce4612dcd945 could not be found. Nov 01 19:02:47.259384 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:02:47.259384 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-fd83a82c-6cce-4b42-8d99-0183b80d8e27 tempest-ImagesNegativeTestJSON-1904451201 tempest-ImagesNegativeTestJSON-1904451201-project] Returning 404 to user: Instance 077786bf-b9d6-4b7e-9eb5-ce4612dcd945 could not be found. {{(pid=121403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 01 19:02:47.259384 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-fd83a82c-6cce-4b42-8d99-0183b80d8e27 tempest-ImagesNegativeTestJSON-1904451201 tempest-ImagesNegativeTestJSON-1904451201-project] 10.222.0.13 "DELETE /compute/v2.1/servers/077786bf-b9d6-4b7e-9eb5-ce4612dcd945" status: 404 len: 111 microversion: 2.1 time: 0.072537 Nov 01 19:02:47.260297 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1163/2316] 10.222.0.13 () {58 vars in 1239 bytes} [Tue Nov 1 19:02:47 2022] DELETE /compute/v2.1/servers/077786bf-b9d6-4b7e-9eb5-ce4612dcd945 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 01 19:02:47.269139 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-98c1c4ff-7cd9-440b-abd2-57914f34ff5b tempest-ImagesNegativeTestJSON-1904451201 tempest-ImagesNegativeTestJSON-1904451201-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:02:47.270010 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-98c1c4ff-7cd9-440b-abd2-57914f34ff5b tempest-ImagesNegativeTestJSON-1904451201 tempest-ImagesNegativeTestJSON-1904451201-project] [instance: 077786bf-b9d6-4b7e-9eb5-ce4612dcd945] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:02:47.278695 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-98c1c4ff-7cd9-440b-abd2-57914f34ff5b tempest-ImagesNegativeTestJSON-1904451201 tempest-ImagesNegativeTestJSON-1904451201-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:47.279187 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-98c1c4ff-7cd9-440b-abd2-57914f34ff5b tempest-ImagesNegativeTestJSON-1904451201 tempest-ImagesNegativeTestJSON-1904451201-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:47.279623 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-98c1c4ff-7cd9-440b-abd2-57914f34ff5b tempest-ImagesNegativeTestJSON-1904451201 tempest-ImagesNegativeTestJSON-1904451201-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:47.280481 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-98c1c4ff-7cd9-440b-abd2-57914f34ff5b tempest-ImagesNegativeTestJSON-1904451201 tempest-ImagesNegativeTestJSON-1904451201-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:47.280959 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-98c1c4ff-7cd9-440b-abd2-57914f34ff5b tempest-ImagesNegativeTestJSON-1904451201 tempest-ImagesNegativeTestJSON-1904451201-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:47.281431 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-98c1c4ff-7cd9-440b-abd2-57914f34ff5b tempest-ImagesNegativeTestJSON-1904451201 tempest-ImagesNegativeTestJSON-1904451201-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:47.302914 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.wsgi [None req-98c1c4ff-7cd9-440b-abd2-57914f34ff5b tempest-ImagesNegativeTestJSON-1904451201 tempest-ImagesNegativeTestJSON-1904451201-project] HTTP exception thrown: Instance 077786bf-b9d6-4b7e-9eb5-ce4612dcd945 could not be found. Nov 01 19:02:47.306162 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-98c1c4ff-7cd9-440b-abd2-57914f34ff5b tempest-ImagesNegativeTestJSON-1904451201 tempest-ImagesNegativeTestJSON-1904451201-project] Request method failure captured: Nov 01 19:02:47.306162 n-d-863052-2 devstack@n-api.service[121403]: request: GET /compute/v2.1/servers/077786bf-b9d6-4b7e-9eb5-ce4612dcd945 HTTP/1.1 Nov 01 19:02:47.306162 n-d-863052-2 devstack@n-api.service[121403]: Accept: application/json Nov 01 19:02:47.306162 n-d-863052-2 devstack@n-api.service[121403]: Accept-Encoding: identity Nov 01 19:02:47.306162 n-d-863052-2 devstack@n-api.service[121403]: Connection: close Nov 01 19:02:47.306162 n-d-863052-2 devstack@n-api.service[121403]: Content-Length: 0 Nov 01 19:02:47.306162 n-d-863052-2 devstack@n-api.service[121403]: Content-Type: application/json Nov 01 19:02:47.306162 n-d-863052-2 devstack@n-api.service[121403]: Host: 10.222.0.13 Nov 01 19:02:47.306162 n-d-863052-2 devstack@n-api.service[121403]: Openstack-System-Scope: None Nov 01 19:02:47.306162 n-d-863052-2 devstack@n-api.service[121403]: User-Agent: python-urllib3/1.26.12 Nov 01 19:02:47.306162 n-d-863052-2 devstack@n-api.service[121403]: X-Auth-Token: gAAAAABjYW03VNR-pJjM6QDt1ENE6pVyLjj8nJ6NZOTYTI1JOfjsfFIcz_V4DXkawdzn9vSiLtmQngNG5s5yWVtzYKaipqyalLtMLVEDPL7o_JiuS-X6djXnLEwedyG166WSIFOhAed7kaHRAAunjeIwpl_aIliXm6y4J2ke9JrIAiRBST8gWgc Nov 01 19:02:47.306162 n-d-863052-2 devstack@n-api.service[121403]: X-Domain-Id: None Nov 01 19:02:47.306162 n-d-863052-2 devstack@n-api.service[121403]: X-Domain-Name: None Nov 01 19:02:47.306162 n-d-863052-2 devstack@n-api.service[121403]: X-Identity-Status: Confirmed Nov 01 19:02:47.306162 n-d-863052-2 devstack@n-api.service[121403]: X-Is-Admin-Project: True Nov 01 19:02:47.306162 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Domain-Id: default Nov 01 19:02:47.306162 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Domain-Name: Default Nov 01 19:02:47.306162 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Id: 68771d3adba04230a0fc3f69b50cc9b2 Nov 01 19:02:47.306162 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Name: tempest-ImagesNegativeTestJSON-1904451201 Nov 01 19:02:47.306162 n-d-863052-2 devstack@n-api.service[121403]: X-Role: member,reader Nov 01 19:02:47.306162 n-d-863052-2 devstack@n-api.service[121403]: X-Roles: member,reader Nov 01 19:02:47.306162 n-d-863052-2 devstack@n-api.service[121403]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/68771d3adba04230a0fc3f69b50cc9b2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/68771d3adba04230a0fc3f69b50cc9b2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_68771d3adba04230a0fc3f69b50cc9b2", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/68771d3adba04230a0fc3f69b50cc9b2"}]}] Nov 01 19:02:47.306162 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant: tempest-ImagesNegativeTestJSON-1904451201 Nov 01 19:02:47.306162 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant-Id: 68771d3adba04230a0fc3f69b50cc9b2 Nov 01 19:02:47.306162 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1904451201 Nov 01 19:02:47.306162 n-d-863052-2 devstack@n-api.service[121403]: X-User: tempest-ImagesNegativeTestJSON-1904451201-project Nov 01 19:02:47.306162 n-d-863052-2 devstack@n-api.service[121403]: X-User-Domain-Id: default Nov 01 19:02:47.306162 n-d-863052-2 devstack@n-api.service[121403]: X-User-Domain-Name: Default Nov 01 19:02:47.306162 n-d-863052-2 devstack@n-api.service[121403]: X-User-Id: 1c4a93c606cd4fc98c9b667bfc3d367b Nov 01 19:02:47.306162 n-d-863052-2 devstack@n-api.service[121403]: X-User-Name: tempest-ImagesNegativeTestJSON-1904451201-project Nov 01 19:02:47.306162 n-d-863052-2 devstack@n-api.service[121403]: method: > Nov 01 19:02:47.306162 n-d-863052-2 devstack@n-api.service[121403]: exception: Instance 077786bf-b9d6-4b7e-9eb5-ce4612dcd945 could not be found. Nov 01 19:02:47.306162 n-d-863052-2 devstack@n-api.service[121403]: action_args: {'id': '077786bf-b9d6-4b7e-9eb5-ce4612dcd945'} Nov 01 19:02:47.306162 n-d-863052-2 devstack@n-api.service[121403]: {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 01 19:02:47.306162 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:02:47.306162 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 01 19:02:47.306162 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 01 19:02:47.306162 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 01 19:02:47.306162 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 01 19:02:47.306162 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 01 19:02:47.306162 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 01 19:02:47.306162 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 01 19:02:47.306162 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 01 19:02:47.306162 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 077786bf-b9d6-4b7e-9eb5-ce4612dcd945 could not be found. Nov 01 19:02:47.306162 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:02:47.306162 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:02:47.306162 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:02:47.306162 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:02:47.306162 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:02:47.306162 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:02:47.306162 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 01 19:02:47.306162 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 01 19:02:47.306162 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 01 19:02:47.306162 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 01 19:02:47.306162 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 01 19:02:47.306162 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 01 19:02:47.306162 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 01 19:02:47.306162 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 01 19:02:47.306162 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 01 19:02:47.306162 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 01 19:02:47.306162 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 077786bf-b9d6-4b7e-9eb5-ce4612dcd945 could not be found. Nov 01 19:02:47.306162 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:02:47.306162 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:02:47.306162 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:02:47.309521 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:02:47.309521 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:02:47.309521 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:02:47.309521 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 01 19:02:47.309521 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 01 19:02:47.309521 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 077786bf-b9d6-4b7e-9eb5-ce4612dcd945 could not be found. Nov 01 19:02:47.309521 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:02:47.309521 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-98c1c4ff-7cd9-440b-abd2-57914f34ff5b tempest-ImagesNegativeTestJSON-1904451201 tempest-ImagesNegativeTestJSON-1904451201-project] Returning 404 to user: Instance 077786bf-b9d6-4b7e-9eb5-ce4612dcd945 could not be found. {{(pid=121403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 01 19:02:47.309521 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-98c1c4ff-7cd9-440b-abd2-57914f34ff5b tempest-ImagesNegativeTestJSON-1904451201 tempest-ImagesNegativeTestJSON-1904451201-project] 10.222.0.13 "GET /compute/v2.1/servers/077786bf-b9d6-4b7e-9eb5-ce4612dcd945" status: 404 len: 111 microversion: 2.1 time: 0.044166 Nov 01 19:02:47.310157 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1164/2317] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:02:47 2022] GET /compute/v2.1/servers/077786bf-b9d6-4b7e-9eb5-ce4612dcd945 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 01 19:02:47.511349 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-0daed30d-c611-485d-bcd3-d3054bf03c20 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:02:47.511956 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-0daed30d-c611-485d-bcd3-d3054bf03c20 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] [instance: bee52bae-2df5-46a3-9aa9-f6b24bea11e3] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:02:47.519601 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-0daed30d-c611-485d-bcd3-d3054bf03c20 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:47.520100 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-0daed30d-c611-485d-bcd3-d3054bf03c20 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:47.520517 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-0daed30d-c611-485d-bcd3-d3054bf03c20 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:47.521792 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-0daed30d-c611-485d-bcd3-d3054bf03c20 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:47.522452 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-0daed30d-c611-485d-bcd3-d3054bf03c20 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:47.523049 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-0daed30d-c611-485d-bcd3-d3054bf03c20 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:47.532157 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-62fdb979-9da1-4f9a-ad85-33d08aa2de2e tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52acef7992d64d378fd8ac333887fd0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af51b8733e984c2ca87df2d8163dedf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:02:47.538272 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.wsgi [None req-0daed30d-c611-485d-bcd3-d3054bf03c20 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] HTTP exception thrown: Instance bee52bae-2df5-46a3-9aa9-f6b24bea11e3 could not be found. Nov 01 19:02:47.540008 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-0daed30d-c611-485d-bcd3-d3054bf03c20 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Request method failure captured: Nov 01 19:02:47.540008 n-d-863052-2 devstack@n-api.service[121403]: request: GET /compute/v2.1/servers/bee52bae-2df5-46a3-9aa9-f6b24bea11e3 HTTP/1.1 Nov 01 19:02:47.540008 n-d-863052-2 devstack@n-api.service[121403]: Accept: application/json Nov 01 19:02:47.540008 n-d-863052-2 devstack@n-api.service[121403]: Accept-Encoding: identity Nov 01 19:02:47.540008 n-d-863052-2 devstack@n-api.service[121403]: Connection: close Nov 01 19:02:47.540008 n-d-863052-2 devstack@n-api.service[121403]: Content-Length: 0 Nov 01 19:02:47.540008 n-d-863052-2 devstack@n-api.service[121403]: Content-Type: application/json Nov 01 19:02:47.540008 n-d-863052-2 devstack@n-api.service[121403]: Host: 10.222.0.13 Nov 01 19:02:47.540008 n-d-863052-2 devstack@n-api.service[121403]: Openstack-System-Scope: None Nov 01 19:02:47.540008 n-d-863052-2 devstack@n-api.service[121403]: User-Agent: python-urllib3/1.26.12 Nov 01 19:02:47.540008 n-d-863052-2 devstack@n-api.service[121403]: X-Auth-Token: gAAAAABjYWuXbvFs9aS-AI-YunBpI7JW1G7TtGj9lNPX9_m5x7yvx5NDb5_8tZxcZ9OJEVvcArKsi1gBG0i_m2a-mPBO8TJfCOQY2BcBWVVWE6IstJB3B2-12IsAPiHj9lscAGshtM26YMMYwGnt2-cysTVDO07JS8LPF_YKr1_xNELllwy_Puk Nov 01 19:02:47.540008 n-d-863052-2 devstack@n-api.service[121403]: X-Domain-Id: None Nov 01 19:02:47.540008 n-d-863052-2 devstack@n-api.service[121403]: X-Domain-Name: None Nov 01 19:02:47.540008 n-d-863052-2 devstack@n-api.service[121403]: X-Identity-Status: Confirmed Nov 01 19:02:47.540008 n-d-863052-2 devstack@n-api.service[121403]: X-Is-Admin-Project: True Nov 01 19:02:47.540008 n-d-863052-2 devstack@n-api.service[121403]: X-Openstack-Nova-Api-Version: 2.25 Nov 01 19:02:47.540008 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Domain-Id: default Nov 01 19:02:47.540008 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Domain-Name: Default Nov 01 19:02:47.540008 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Id: 75730f90ec924cbebd605d6d6d747efe Nov 01 19:02:47.540008 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-1114814424 Nov 01 19:02:47.540008 n-d-863052-2 devstack@n-api.service[121403]: X-Role: member,reader Nov 01 19:02:47.540008 n-d-863052-2 devstack@n-api.service[121403]: X-Roles: member,reader Nov 01 19:02:47.540008 n-d-863052-2 devstack@n-api.service[121403]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/75730f90ec924cbebd605d6d6d747efe"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/75730f90ec924cbebd605d6d6d747efe"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_75730f90ec924cbebd605d6d6d747efe", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/75730f90ec924cbebd605d6d6d747efe"}]}] Nov 01 19:02:47.540008 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-1114814424 Nov 01 19:02:47.540008 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant-Id: 75730f90ec924cbebd605d6d6d747efe Nov 01 19:02:47.540008 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-1114814424 Nov 01 19:02:47.540008 n-d-863052-2 devstack@n-api.service[121403]: X-User: tempest-LiveAutoBlockMigrationV225Test-1114814424-project Nov 01 19:02:47.540008 n-d-863052-2 devstack@n-api.service[121403]: X-User-Domain-Id: default Nov 01 19:02:47.540008 n-d-863052-2 devstack@n-api.service[121403]: X-User-Domain-Name: Default Nov 01 19:02:47.540008 n-d-863052-2 devstack@n-api.service[121403]: X-User-Id: c2ddf0211c374fe2a0db89546beb8e96 Nov 01 19:02:47.540008 n-d-863052-2 devstack@n-api.service[121403]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-1114814424-project Nov 01 19:02:47.540008 n-d-863052-2 devstack@n-api.service[121403]: method: > Nov 01 19:02:47.540008 n-d-863052-2 devstack@n-api.service[121403]: exception: Instance bee52bae-2df5-46a3-9aa9-f6b24bea11e3 could not be found. Nov 01 19:02:47.540008 n-d-863052-2 devstack@n-api.service[121403]: action_args: {'id': 'bee52bae-2df5-46a3-9aa9-f6b24bea11e3'} Nov 01 19:02:47.540008 n-d-863052-2 devstack@n-api.service[121403]: {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 01 19:02:47.540008 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:02:47.540008 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 01 19:02:47.540008 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 01 19:02:47.540008 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 01 19:02:47.540008 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 01 19:02:47.540008 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 01 19:02:47.540008 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 01 19:02:47.540008 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 01 19:02:47.540008 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 01 19:02:47.540008 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bee52bae-2df5-46a3-9aa9-f6b24bea11e3 could not be found. Nov 01 19:02:47.540008 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:02:47.540008 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:02:47.540008 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:02:47.540008 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:02:47.540008 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:02:47.540008 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:02:47.540008 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 01 19:02:47.540008 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 01 19:02:47.540008 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 01 19:02:47.540008 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 01 19:02:47.540008 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 01 19:02:47.540008 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 01 19:02:47.540008 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 01 19:02:47.540008 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 01 19:02:47.540008 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 01 19:02:47.540008 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 01 19:02:47.540008 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bee52bae-2df5-46a3-9aa9-f6b24bea11e3 could not be found. Nov 01 19:02:47.540008 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:02:47.543045 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:02:47.543045 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:02:47.543045 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:02:47.543045 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:02:47.543045 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:02:47.543045 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 01 19:02:47.543045 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 01 19:02:47.543045 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bee52bae-2df5-46a3-9aa9-f6b24bea11e3 could not be found. Nov 01 19:02:47.543045 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:02:47.543491 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-62fdb979-9da1-4f9a-ad85-33d08aa2de2e tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] 10.222.0.13 "GET /compute/v2.1/servers/4b9fb909-26f7-40af-bac5-e7d2a6b9fb77" status: 200 len: 1354 microversion: 2.1 time: 0.367149 Nov 01 19:02:47.543567 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-0daed30d-c611-485d-bcd3-d3054bf03c20 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Returning 404 to user: Instance bee52bae-2df5-46a3-9aa9-f6b24bea11e3 could not be found. {{(pid=121403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 01 19:02:47.543567 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-0daed30d-c611-485d-bcd3-d3054bf03c20 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] 10.222.0.13 "GET /compute/v2.1/servers/bee52bae-2df5-46a3-9aa9-f6b24bea11e3" status: 404 len: 111 microversion: 2.25 time: 0.035429 Nov 01 19:02:47.547891 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1165/2318] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 19:02:47 2022] GET /compute/v2.1/servers/bee52bae-2df5-46a3-9aa9-f6b24bea11e3 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Nov 01 19:02:47.557112 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1154/2319] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:02:47 2022] GET /compute/v2.1/servers/4b9fb909-26f7-40af-bac5-e7d2a6b9fb77 => generated 1354 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 19:02:47.563796 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-bea2c966-a6f7-46df-aaf8-cf812f850f3a tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:02:47.564439 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-bea2c966-a6f7-46df-aaf8-cf812f850f3a tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] [instance: 2d3a927e-a478-40b1-8c92-80396c82f76c] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:02:47.588976 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-bea2c966-a6f7-46df-aaf8-cf812f850f3a tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:47.589607 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-bea2c966-a6f7-46df-aaf8-cf812f850f3a tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:47.589912 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-bea2c966-a6f7-46df-aaf8-cf812f850f3a tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:47.590621 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-bea2c966-a6f7-46df-aaf8-cf812f850f3a tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:47.591072 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-bea2c966-a6f7-46df-aaf8-cf812f850f3a tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:47.591493 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-bea2c966-a6f7-46df-aaf8-cf812f850f3a tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:47.631045 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-bea2c966-a6f7-46df-aaf8-cf812f850f3a tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] [instance: 2d3a927e-a478-40b1-8c92-80396c82f76c] Going to try to terminate instance {{(pid=121403) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 01 19:02:47.686905 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-e5090a4d-85fc-47b8-bea3-05dc30a3ce81 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:02:47.687565 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-e5090a4d-85fc-47b8-bea3-05dc30a3ce81 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] [instance: 992f5ec5-d256-4870-b16d-fc8d9adbd3e7] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:02:47.722146 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e5090a4d-85fc-47b8-bea3-05dc30a3ce81 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:47.722766 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e5090a4d-85fc-47b8-bea3-05dc30a3ce81 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:47.723215 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e5090a4d-85fc-47b8-bea3-05dc30a3ce81 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:47.724146 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e5090a4d-85fc-47b8-bea3-05dc30a3ce81 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:47.724769 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e5090a4d-85fc-47b8-bea3-05dc30a3ce81 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:47.725203 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e5090a4d-85fc-47b8-bea3-05dc30a3ce81 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:47.821290 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-bea2c966-a6f7-46df-aaf8-cf812f850f3a tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] 10.222.0.13 "DELETE /compute/v2.1/servers/2d3a927e-a478-40b1-8c92-80396c82f76c" status: 204 len: 0 microversion: 2.25 time: 0.271596 Nov 01 19:02:47.825667 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1166/2320] 10.222.0.13 () {60 vars in 1280 bytes} [Tue Nov 1 19:02:47 2022] DELETE /compute/v2.1/servers/2d3a927e-a478-40b1-8c92-80396c82f76c => generated 0 bytes in 274 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 01 19:02:47.838043 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-c0b3411f-3e89-4565-b8b0-3cd0b7eb8579 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:02:47.839099 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-c0b3411f-3e89-4565-b8b0-3cd0b7eb8579 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] [instance: 2d3a927e-a478-40b1-8c92-80396c82f76c] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:02:47.846110 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-c0b3411f-3e89-4565-b8b0-3cd0b7eb8579 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:47.846861 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-c0b3411f-3e89-4565-b8b0-3cd0b7eb8579 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:47.847451 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-c0b3411f-3e89-4565-b8b0-3cd0b7eb8579 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:47.849029 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-c0b3411f-3e89-4565-b8b0-3cd0b7eb8579 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:47.849627 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-c0b3411f-3e89-4565-b8b0-3cd0b7eb8579 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:47.850333 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-c0b3411f-3e89-4565-b8b0-3cd0b7eb8579 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:48.136521 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-e5090a4d-85fc-47b8-bea3-05dc30a3ce81 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb496b3faac4abbae73d389f2042e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e2520220d454764b8c139a58d78ac83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:02:48.146811 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-e5090a4d-85fc-47b8-bea3-05dc30a3ce81 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] 10.222.0.13 "GET /compute/v2.1/servers/992f5ec5-d256-4870-b16d-fc8d9adbd3e7" status: 200 len: 1472 microversion: 2.1 time: 0.475506 Nov 01 19:02:48.158253 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1155/2321] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:02:47 2022] GET /compute/v2.1/servers/992f5ec5-d256-4870-b16d-fc8d9adbd3e7 => generated 1472 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:02:48.171768 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-ddbf14bc-89b6-4991-a399-a2b73b753a9c tempest-ServersTestJSON-675990056 tempest-ServersTestJSON-675990056-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:02:48.172987 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-ddbf14bc-89b6-4991-a399-a2b73b753a9c tempest-ServersTestJSON-675990056 tempest-ServersTestJSON-675990056-project] [instance: 6e82d040-bcc6-473e-b202-bf13829baf2c] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:02:48.181580 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-ddbf14bc-89b6-4991-a399-a2b73b753a9c tempest-ServersTestJSON-675990056 tempest-ServersTestJSON-675990056-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:48.182744 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-ddbf14bc-89b6-4991-a399-a2b73b753a9c tempest-ServersTestJSON-675990056 tempest-ServersTestJSON-675990056-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:48.183424 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-ddbf14bc-89b6-4991-a399-a2b73b753a9c tempest-ServersTestJSON-675990056 tempest-ServersTestJSON-675990056-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:48.184355 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-ddbf14bc-89b6-4991-a399-a2b73b753a9c tempest-ServersTestJSON-675990056 tempest-ServersTestJSON-675990056-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:48.185101 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-ddbf14bc-89b6-4991-a399-a2b73b753a9c tempest-ServersTestJSON-675990056 tempest-ServersTestJSON-675990056-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:48.185969 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-ddbf14bc-89b6-4991-a399-a2b73b753a9c tempest-ServersTestJSON-675990056 tempest-ServersTestJSON-675990056-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:48.474371 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-ddbf14bc-89b6-4991-a399-a2b73b753a9c tempest-ServersTestJSON-675990056 tempest-ServersTestJSON-675990056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71d26d92020b4d4aab9f82d174e1ba9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3dd3fba10d740c9bc38b10dca3007aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:02:48.482814 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-ddbf14bc-89b6-4991-a399-a2b73b753a9c tempest-ServersTestJSON-675990056 tempest-ServersTestJSON-675990056-project] 10.222.0.13 "GET /compute/v2.1/servers/6e82d040-bcc6-473e-b202-bf13829baf2c" status: 200 len: 1393 microversion: 2.1 time: 0.322990 Nov 01 19:02:48.483649 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1156/2322] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:02:48 2022] GET /compute/v2.1/servers/6e82d040-bcc6-473e-b202-bf13829baf2c => generated 1393 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:02:48.490143 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-708ca324-d86b-498a-b28a-a708a83ee887 tempest-ServersTestBootFromVolume-877599095 tempest-ServersTestBootFromVolume-877599095-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:02:48.491018 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-708ca324-d86b-498a-b28a-a708a83ee887 tempest-ServersTestBootFromVolume-877599095 tempest-ServersTestBootFromVolume-877599095-project] [instance: 44cdf0d8-969b-4149-bb03-6bc390977019] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:02:48.495842 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-c0b3411f-3e89-4565-b8b0-3cd0b7eb8579 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:02:48.497701 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-708ca324-d86b-498a-b28a-a708a83ee887 tempest-ServersTestBootFromVolume-877599095 tempest-ServersTestBootFromVolume-877599095-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:48.498606 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-708ca324-d86b-498a-b28a-a708a83ee887 tempest-ServersTestBootFromVolume-877599095 tempest-ServersTestBootFromVolume-877599095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:48.499238 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-708ca324-d86b-498a-b28a-a708a83ee887 tempest-ServersTestBootFromVolume-877599095 tempest-ServersTestBootFromVolume-877599095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:48.500126 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-708ca324-d86b-498a-b28a-a708a83ee887 tempest-ServersTestBootFromVolume-877599095 tempest-ServersTestBootFromVolume-877599095-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:48.500838 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-708ca324-d86b-498a-b28a-a708a83ee887 tempest-ServersTestBootFromVolume-877599095 tempest-ServersTestBootFromVolume-877599095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:48.501527 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-708ca324-d86b-498a-b28a-a708a83ee887 tempest-ServersTestBootFromVolume-877599095 tempest-ServersTestBootFromVolume-877599095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:48.518240 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-c0b3411f-3e89-4565-b8b0-3cd0b7eb8579 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:02:48.520718 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-c0b3411f-3e89-4565-b8b0-3cd0b7eb8579 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:02:48.524517 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-c0b3411f-3e89-4565-b8b0-3cd0b7eb8579 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] 10.222.0.13 "GET /compute/v2.1/servers/2d3a927e-a478-40b1-8c92-80396c82f76c" status: 200 len: 1563 microversion: 2.25 time: 0.694890 Nov 01 19:02:48.526170 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1167/2323] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 19:02:47 2022] GET /compute/v2.1/servers/2d3a927e-a478-40b1-8c92-80396c82f76c => generated 1563 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 19:02:48.566142 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-bad97444-926f-4fbc-9e9e-ed49892bb3b3 tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:02:48.566779 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-bad97444-926f-4fbc-9e9e-ed49892bb3b3 tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] [instance: 4b9fb909-26f7-40af-bac5-e7d2a6b9fb77] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:02:48.574191 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-bad97444-926f-4fbc-9e9e-ed49892bb3b3 tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:48.574677 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-bad97444-926f-4fbc-9e9e-ed49892bb3b3 tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:48.575718 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-bad97444-926f-4fbc-9e9e-ed49892bb3b3 tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:48.576417 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-bad97444-926f-4fbc-9e9e-ed49892bb3b3 tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:48.577055 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-bad97444-926f-4fbc-9e9e-ed49892bb3b3 tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:48.577457 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-bad97444-926f-4fbc-9e9e-ed49892bb3b3 tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:48.854664 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-708ca324-d86b-498a-b28a-a708a83ee887 tempest-ServersTestBootFromVolume-877599095 tempest-ServersTestBootFromVolume-877599095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed2352ce53fc4045adde8cd81b78b3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651046528c204df299ca3d14c44b4a7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:02:48.866164 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-708ca324-d86b-498a-b28a-a708a83ee887 tempest-ServersTestBootFromVolume-877599095 tempest-ServersTestBootFromVolume-877599095-project] 10.222.0.13 "GET /compute/v2.1/servers/44cdf0d8-969b-4149-bb03-6bc390977019" status: 200 len: 1482 microversion: 2.1 time: 0.381261 Nov 01 19:02:48.866978 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1157/2324] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:02:48 2022] GET /compute/v2.1/servers/44cdf0d8-969b-4149-bb03-6bc390977019 => generated 1482 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:02:48.892170 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-3c9beccc-d8b2-45e1-ac88-529a5350a998 tempest-ServersTestBootFromVolume-877599095 tempest-ServersTestBootFromVolume-877599095-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:02:48.892932 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-3c9beccc-d8b2-45e1-ac88-529a5350a998 tempest-ServersTestBootFromVolume-877599095 tempest-ServersTestBootFromVolume-877599095-project] [instance: 44cdf0d8-969b-4149-bb03-6bc390977019] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:02:48.901139 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-3c9beccc-d8b2-45e1-ac88-529a5350a998 tempest-ServersTestBootFromVolume-877599095 tempest-ServersTestBootFromVolume-877599095-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:48.901953 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-3c9beccc-d8b2-45e1-ac88-529a5350a998 tempest-ServersTestBootFromVolume-877599095 tempest-ServersTestBootFromVolume-877599095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:48.902571 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-3c9beccc-d8b2-45e1-ac88-529a5350a998 tempest-ServersTestBootFromVolume-877599095 tempest-ServersTestBootFromVolume-877599095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:48.903456 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-3c9beccc-d8b2-45e1-ac88-529a5350a998 tempest-ServersTestBootFromVolume-877599095 tempest-ServersTestBootFromVolume-877599095-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:48.904088 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-3c9beccc-d8b2-45e1-ac88-529a5350a998 tempest-ServersTestBootFromVolume-877599095 tempest-ServersTestBootFromVolume-877599095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:48.905242 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-3c9beccc-d8b2-45e1-ac88-529a5350a998 tempest-ServersTestBootFromVolume-877599095 tempest-ServersTestBootFromVolume-877599095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:48.912772 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-bad97444-926f-4fbc-9e9e-ed49892bb3b3 tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52acef7992d64d378fd8ac333887fd0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af51b8733e984c2ca87df2d8163dedf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:02:48.924948 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-bad97444-926f-4fbc-9e9e-ed49892bb3b3 tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] 10.222.0.13 "GET /compute/v2.1/servers/4b9fb909-26f7-40af-bac5-e7d2a6b9fb77" status: 200 len: 1354 microversion: 2.1 time: 0.361492 Nov 01 19:02:48.927807 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1168/2325] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:02:48 2022] GET /compute/v2.1/servers/4b9fb909-26f7-40af-bac5-e7d2a6b9fb77 => generated 1354 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:02:49.018518 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-3c9beccc-d8b2-45e1-ac88-529a5350a998 tempest-ServersTestBootFromVolume-877599095 tempest-ServersTestBootFromVolume-877599095-project] 10.222.0.13 "GET /compute/v2.1/servers/44cdf0d8-969b-4149-bb03-6bc390977019/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.131564 Nov 01 19:02:49.019853 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1158/2326] 10.222.0.13 () {58 vars in 1275 bytes} [Tue Nov 1 19:02:48 2022] GET /compute/v2.1/servers/44cdf0d8-969b-4149-bb03-6bc390977019/os-interface => generated 284 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 01 19:02:49.064517 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [req-2475af29-8778-4d07-ab37-3b4b542d3a1a req-667bbe46-692d-4b6e-8658-19d406e6a76c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b9fb909-26f7-40af-bac5-e7d2a6b9fb77", "name": "network-vif-plugged", "status": "completed", "tag": "ccb0a9e2-46d4-4870-a9da-883c13baeb71"}]} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:02:49.076602 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-2475af29-8778-4d07-ab37-3b4b542d3a1a req-667bbe46-692d-4b6e-8658-19d406e6a76c service nova] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:49.077340 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-2475af29-8778-4d07-ab37-3b4b542d3a1a req-667bbe46-692d-4b6e-8658-19d406e6a76c service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:49.077775 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-2475af29-8778-4d07-ab37-3b4b542d3a1a req-667bbe46-692d-4b6e-8658-19d406e6a76c service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:49.092559 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.compute.server_external_events [req-2475af29-8778-4d07-ab37-3b4b542d3a1a req-667bbe46-692d-4b6e-8658-19d406e6a76c service nova] Creating event network-vif-plugged:ccb0a9e2-46d4-4870-a9da-883c13baeb71 for instance 4b9fb909-26f7-40af-bac5-e7d2a6b9fb77 on n-h1-863052-2 Nov 01 19:02:49.098898 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [req-2475af29-8778-4d07-ab37-3b4b542d3a1a req-667bbe46-692d-4b6e-8658-19d406e6a76c service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039293 Nov 01 19:02:49.100041 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1169/2327] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Nov 1 19:02:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:02:49.170558 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [req-14f97a00-2537-4249-a9f3-0baa4fe5f49d req-51425707-4317-44f9-9b27-ba28e6b95183 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6e82d040-bcc6-473e-b202-bf13829baf2c", "tag": "41d8c6fe-f524-41af-9f6e-4b23fdeb1e57"}]} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:02:49.179957 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-be35f72c-c48a-4833-9a05-88af61f7e59a tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:02:49.180886 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-be35f72c-c48a-4833-9a05-88af61f7e59a tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] [instance: 992f5ec5-d256-4870-b16d-fc8d9adbd3e7] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:02:49.196127 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-be35f72c-c48a-4833-9a05-88af61f7e59a tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:49.197841 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-14f97a00-2537-4249-a9f3-0baa4fe5f49d req-51425707-4317-44f9-9b27-ba28e6b95183 service nova] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:49.198414 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-be35f72c-c48a-4833-9a05-88af61f7e59a tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:49.199184 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-be35f72c-c48a-4833-9a05-88af61f7e59a tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:49.199892 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-be35f72c-c48a-4833-9a05-88af61f7e59a tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:49.200435 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-be35f72c-c48a-4833-9a05-88af61f7e59a tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:49.200886 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-be35f72c-c48a-4833-9a05-88af61f7e59a tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:49.205578 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-14f97a00-2537-4249-a9f3-0baa4fe5f49d req-51425707-4317-44f9-9b27-ba28e6b95183 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:49.206295 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-14f97a00-2537-4249-a9f3-0baa4fe5f49d req-51425707-4317-44f9-9b27-ba28e6b95183 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:49.228567 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.compute.server_external_events [req-14f97a00-2537-4249-a9f3-0baa4fe5f49d req-51425707-4317-44f9-9b27-ba28e6b95183 service nova] Creating event network-changed:41d8c6fe-f524-41af-9f6e-4b23fdeb1e57 for instance 6e82d040-bcc6-473e-b202-bf13829baf2c on n-h2-863052-2 Nov 01 19:02:49.236720 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [req-14f97a00-2537-4249-a9f3-0baa4fe5f49d req-51425707-4317-44f9-9b27-ba28e6b95183 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069735 Nov 01 19:02:49.238380 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1159/2328] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Nov 1 19:02:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:02:49.509107 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-2a5eeb58-927f-4489-a002-38e9fca7b134 tempest-ServersTestJSON-675990056 tempest-ServersTestJSON-675990056-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:02:49.511984 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-2a5eeb58-927f-4489-a002-38e9fca7b134 tempest-ServersTestJSON-675990056 tempest-ServersTestJSON-675990056-project] [instance: 6e82d040-bcc6-473e-b202-bf13829baf2c] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:02:49.519149 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2a5eeb58-927f-4489-a002-38e9fca7b134 tempest-ServersTestJSON-675990056 tempest-ServersTestJSON-675990056-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:49.519700 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2a5eeb58-927f-4489-a002-38e9fca7b134 tempest-ServersTestJSON-675990056 tempest-ServersTestJSON-675990056-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:49.520197 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2a5eeb58-927f-4489-a002-38e9fca7b134 tempest-ServersTestJSON-675990056 tempest-ServersTestJSON-675990056-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:49.520999 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2a5eeb58-927f-4489-a002-38e9fca7b134 tempest-ServersTestJSON-675990056 tempest-ServersTestJSON-675990056-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:49.521678 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2a5eeb58-927f-4489-a002-38e9fca7b134 tempest-ServersTestJSON-675990056 tempest-ServersTestJSON-675990056-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:49.522302 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2a5eeb58-927f-4489-a002-38e9fca7b134 tempest-ServersTestJSON-675990056 tempest-ServersTestJSON-675990056-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:49.702278 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-be35f72c-c48a-4833-9a05-88af61f7e59a tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb496b3faac4abbae73d389f2042e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e2520220d454764b8c139a58d78ac83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:02:49.716082 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-be35f72c-c48a-4833-9a05-88af61f7e59a tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] 10.222.0.13 "GET /compute/v2.1/servers/992f5ec5-d256-4870-b16d-fc8d9adbd3e7" status: 200 len: 1472 microversion: 2.1 time: 0.540477 Nov 01 19:02:49.725050 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1170/2329] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:02:49 2022] GET /compute/v2.1/servers/992f5ec5-d256-4870-b16d-fc8d9adbd3e7 => generated 1472 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 19:02:49.731283 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-b04cfe5c-2c3e-410e-a5ea-224730cf2109 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:02:49.732139 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-b04cfe5c-2c3e-410e-a5ea-224730cf2109 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] [instance: 2d3a927e-a478-40b1-8c92-80396c82f76c] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:02:49.749434 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-b04cfe5c-2c3e-410e-a5ea-224730cf2109 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:49.750218 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-b04cfe5c-2c3e-410e-a5ea-224730cf2109 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:49.758628 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-b04cfe5c-2c3e-410e-a5ea-224730cf2109 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:49.759765 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-b04cfe5c-2c3e-410e-a5ea-224730cf2109 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:49.760439 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-b04cfe5c-2c3e-410e-a5ea-224730cf2109 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:49.761086 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-b04cfe5c-2c3e-410e-a5ea-224730cf2109 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:49.866101 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-b04cfe5c-2c3e-410e-a5ea-224730cf2109 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:02:49.881439 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-b04cfe5c-2c3e-410e-a5ea-224730cf2109 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:02:49.883506 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-b04cfe5c-2c3e-410e-a5ea-224730cf2109 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:02:49.884917 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-b04cfe5c-2c3e-410e-a5ea-224730cf2109 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] 10.222.0.13 "GET /compute/v2.1/servers/2d3a927e-a478-40b1-8c92-80396c82f76c" status: 200 len: 1346 microversion: 2.25 time: 0.158593 Nov 01 19:02:49.885642 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1171/2330] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 19:02:49 2022] GET /compute/v2.1/servers/2d3a927e-a478-40b1-8c92-80396c82f76c => generated 1346 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 19:02:49.891855 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [req-234cf5a2-a641-48d5-9666-e31b8a238e52 req-4db0aec2-c548-4b65-aae2-0f3b32b7d961 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d3a927e-a478-40b1-8c92-80396c82f76c", "name": "network-vif-deleted", "tag": "9765089c-d945-4fd6-a621-1f90f70e4416"}]} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:02:49.906630 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-234cf5a2-a641-48d5-9666-e31b8a238e52 req-4db0aec2-c548-4b65-aae2-0f3b32b7d961 service nova] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:49.907716 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-234cf5a2-a641-48d5-9666-e31b8a238e52 req-4db0aec2-c548-4b65-aae2-0f3b32b7d961 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:49.908290 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-234cf5a2-a641-48d5-9666-e31b8a238e52 req-4db0aec2-c548-4b65-aae2-0f3b32b7d961 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:49.921338 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.compute.server_external_events [req-234cf5a2-a641-48d5-9666-e31b8a238e52 req-4db0aec2-c548-4b65-aae2-0f3b32b7d961 service nova] Creating event network-vif-deleted:9765089c-d945-4fd6-a621-1f90f70e4416 for instance 2d3a927e-a478-40b1-8c92-80396c82f76c on n-h2-863052-2 Nov 01 19:02:49.936777 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [req-234cf5a2-a641-48d5-9666-e31b8a238e52 req-4db0aec2-c548-4b65-aae2-0f3b32b7d961 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045531 Nov 01 19:02:49.937760 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1172/2331] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Nov 1 19:02:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:02:49.955176 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-e162dc98-3fc3-4089-8f31-401c4e3d9889 tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:02:49.961935 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-e162dc98-3fc3-4089-8f31-401c4e3d9889 tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] [instance: 4b9fb909-26f7-40af-bac5-e7d2a6b9fb77] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:02:49.969244 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-e162dc98-3fc3-4089-8f31-401c4e3d9889 tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:49.969946 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-e162dc98-3fc3-4089-8f31-401c4e3d9889 tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:49.970793 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-e162dc98-3fc3-4089-8f31-401c4e3d9889 tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:49.971920 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-e162dc98-3fc3-4089-8f31-401c4e3d9889 tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:49.972611 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-e162dc98-3fc3-4089-8f31-401c4e3d9889 tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:49.973227 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-e162dc98-3fc3-4089-8f31-401c4e3d9889 tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:49.974630 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-2a5eeb58-927f-4489-a002-38e9fca7b134 tempest-ServersTestJSON-675990056 tempest-ServersTestJSON-675990056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71d26d92020b4d4aab9f82d174e1ba9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3dd3fba10d740c9bc38b10dca3007aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:02:49.982593 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-2a5eeb58-927f-4489-a002-38e9fca7b134 tempest-ServersTestJSON-675990056 tempest-ServersTestJSON-675990056-project] 10.222.0.13 "GET /compute/v2.1/servers/6e82d040-bcc6-473e-b202-bf13829baf2c" status: 200 len: 1393 microversion: 2.1 time: 0.479240 Nov 01 19:02:49.983172 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1160/2332] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:02:49 2022] GET /compute/v2.1/servers/6e82d040-bcc6-473e-b202-bf13829baf2c => generated 1393 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 19:02:50.428791 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-e162dc98-3fc3-4089-8f31-401c4e3d9889 tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52acef7992d64d378fd8ac333887fd0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af51b8733e984c2ca87df2d8163dedf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:02:50.437888 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-e162dc98-3fc3-4089-8f31-401c4e3d9889 tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] 10.222.0.13 "GET /compute/v2.1/servers/4b9fb909-26f7-40af-bac5-e7d2a6b9fb77" status: 200 len: 1354 microversion: 2.1 time: 0.487109 Nov 01 19:02:50.448604 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1173/2333] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:02:49 2022] GET /compute/v2.1/servers/4b9fb909-26f7-40af-bac5-e7d2a6b9fb77 => generated 1354 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:02:50.747212 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-799320cf-38f1-4196-92ef-8ec4218a4f18 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:02:50.747971 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-799320cf-38f1-4196-92ef-8ec4218a4f18 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] [instance: 992f5ec5-d256-4870-b16d-fc8d9adbd3e7] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:02:50.754348 n-d-863052-2 devstack@n-api.service[121402]: DEBUG dbcounter [-] [121402] Writing DB stats nova_cell0:SELECT=6 {{(pid=121402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 19:02:50.757330 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-799320cf-38f1-4196-92ef-8ec4218a4f18 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:50.758106 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-799320cf-38f1-4196-92ef-8ec4218a4f18 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:50.758730 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-799320cf-38f1-4196-92ef-8ec4218a4f18 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:50.760011 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-799320cf-38f1-4196-92ef-8ec4218a4f18 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:50.760691 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-799320cf-38f1-4196-92ef-8ec4218a4f18 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:50.761293 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-799320cf-38f1-4196-92ef-8ec4218a4f18 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:50.915697 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-e1a8dff1-7796-461e-a1b9-02289c2b763f tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:02:50.916322 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-e1a8dff1-7796-461e-a1b9-02289c2b763f tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] [instance: 2d3a927e-a478-40b1-8c92-80396c82f76c] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:02:50.929948 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-e1a8dff1-7796-461e-a1b9-02289c2b763f tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:50.930479 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-e1a8dff1-7796-461e-a1b9-02289c2b763f tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:50.931037 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-e1a8dff1-7796-461e-a1b9-02289c2b763f tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:50.932798 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-e1a8dff1-7796-461e-a1b9-02289c2b763f tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:50.933504 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-799320cf-38f1-4196-92ef-8ec4218a4f18 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb496b3faac4abbae73d389f2042e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e2520220d454764b8c139a58d78ac83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:02:50.935473 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-e1a8dff1-7796-461e-a1b9-02289c2b763f tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:50.935997 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-e1a8dff1-7796-461e-a1b9-02289c2b763f tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:50.950722 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-799320cf-38f1-4196-92ef-8ec4218a4f18 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] 10.222.0.13 "GET /compute/v2.1/servers/992f5ec5-d256-4870-b16d-fc8d9adbd3e7" status: 200 len: 1472 microversion: 2.1 time: 0.207294 Nov 01 19:02:50.965552 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1161/2334] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:02:50 2022] GET /compute/v2.1/servers/992f5ec5-d256-4870-b16d-fc8d9adbd3e7 => generated 1472 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:02:51.000370 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-e1a8dff1-7796-461e-a1b9-02289c2b763f tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:51.002741 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-e1a8dff1-7796-461e-a1b9-02289c2b763f tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:51.003355 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-e1a8dff1-7796-461e-a1b9-02289c2b763f tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:51.004090 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.objects.instance [None req-e1a8dff1-7796-461e-a1b9-02289c2b763f tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lazy-loading 'fault' on Instance uuid 2d3a927e-a478-40b1-8c92-80396c82f76c {{(pid=121403) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 01 19:02:51.007345 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-3f331822-d939-44d5-8ce3-900e2f9253da tempest-ServersTestJSON-675990056 tempest-ServersTestJSON-675990056-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:02:51.008691 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-3f331822-d939-44d5-8ce3-900e2f9253da tempest-ServersTestJSON-675990056 tempest-ServersTestJSON-675990056-project] [instance: 6e82d040-bcc6-473e-b202-bf13829baf2c] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:02:51.016871 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-3f331822-d939-44d5-8ce3-900e2f9253da tempest-ServersTestJSON-675990056 tempest-ServersTestJSON-675990056-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:51.017372 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-3f331822-d939-44d5-8ce3-900e2f9253da tempest-ServersTestJSON-675990056 tempest-ServersTestJSON-675990056-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:51.017810 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-3f331822-d939-44d5-8ce3-900e2f9253da tempest-ServersTestJSON-675990056 tempest-ServersTestJSON-675990056-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:51.019224 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-3f331822-d939-44d5-8ce3-900e2f9253da tempest-ServersTestJSON-675990056 tempest-ServersTestJSON-675990056-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:51.019846 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-3f331822-d939-44d5-8ce3-900e2f9253da tempest-ServersTestJSON-675990056 tempest-ServersTestJSON-675990056-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:51.020276 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-3f331822-d939-44d5-8ce3-900e2f9253da tempest-ServersTestJSON-675990056 tempest-ServersTestJSON-675990056-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:51.114835 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-e1a8dff1-7796-461e-a1b9-02289c2b763f tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:02:51.133568 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-e1a8dff1-7796-461e-a1b9-02289c2b763f tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:02:51.139465 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-e1a8dff1-7796-461e-a1b9-02289c2b763f tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2ddf0211c374fe2a0db89546beb8e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75730f90ec924cbebd605d6d6d747efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:02:51.142045 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-e1a8dff1-7796-461e-a1b9-02289c2b763f tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] 10.222.0.13 "GET /compute/v2.1/servers/2d3a927e-a478-40b1-8c92-80396c82f76c" status: 200 len: 1351 microversion: 2.25 time: 0.232038 Nov 01 19:02:51.158217 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1174/2335] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 19:02:50 2022] GET /compute/v2.1/servers/2d3a927e-a478-40b1-8c92-80396c82f76c => generated 1351 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 01 19:02:51.310123 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-3f331822-d939-44d5-8ce3-900e2f9253da tempest-ServersTestJSON-675990056 tempest-ServersTestJSON-675990056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71d26d92020b4d4aab9f82d174e1ba9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3dd3fba10d740c9bc38b10dca3007aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:02:51.340124 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-3f331822-d939-44d5-8ce3-900e2f9253da tempest-ServersTestJSON-675990056 tempest-ServersTestJSON-675990056-project] 10.222.0.13 "GET /compute/v2.1/servers/6e82d040-bcc6-473e-b202-bf13829baf2c" status: 200 len: 1393 microversion: 2.1 time: 0.334633 Nov 01 19:02:51.346296 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1162/2336] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:02:51 2022] GET /compute/v2.1/servers/6e82d040-bcc6-473e-b202-bf13829baf2c => generated 1393 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:02:51.462362 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-ffdbe74e-acf9-4c69-8cc9-e44f0274ffa6 tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:02:51.462977 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-ffdbe74e-acf9-4c69-8cc9-e44f0274ffa6 tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] [instance: 4b9fb909-26f7-40af-bac5-e7d2a6b9fb77] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:02:51.482433 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-ffdbe74e-acf9-4c69-8cc9-e44f0274ffa6 tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:51.483249 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-ffdbe74e-acf9-4c69-8cc9-e44f0274ffa6 tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:51.484227 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-ffdbe74e-acf9-4c69-8cc9-e44f0274ffa6 tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:51.485397 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-ffdbe74e-acf9-4c69-8cc9-e44f0274ffa6 tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:51.486078 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-ffdbe74e-acf9-4c69-8cc9-e44f0274ffa6 tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:51.486783 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-ffdbe74e-acf9-4c69-8cc9-e44f0274ffa6 tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:51.513862 n-d-863052-2 devstack@n-api.service[121403]: DEBUG dbcounter [-] [121403] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 19:02:51.791425 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-ffdbe74e-acf9-4c69-8cc9-e44f0274ffa6 tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52acef7992d64d378fd8ac333887fd0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af51b8733e984c2ca87df2d8163dedf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:02:51.807083 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-ffdbe74e-acf9-4c69-8cc9-e44f0274ffa6 tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] 10.222.0.13 "GET /compute/v2.1/servers/4b9fb909-26f7-40af-bac5-e7d2a6b9fb77" status: 200 len: 1803 microversion: 2.1 time: 0.349215 Nov 01 19:02:51.816729 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1175/2337] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:02:51 2022] GET /compute/v2.1/servers/4b9fb909-26f7-40af-bac5-e7d2a6b9fb77 => generated 1803 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:02:51.842634 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-01b84475-8c21-4736-b980-c578829108f8 tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:02:51.843446 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-01b84475-8c21-4736-b980-c578829108f8 tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] [instance: 4b9fb909-26f7-40af-bac5-e7d2a6b9fb77] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:02:51.851619 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-01b84475-8c21-4736-b980-c578829108f8 tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:51.852354 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-01b84475-8c21-4736-b980-c578829108f8 tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:51.853291 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-01b84475-8c21-4736-b980-c578829108f8 tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:51.854154 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-01b84475-8c21-4736-b980-c578829108f8 tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:51.854787 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-01b84475-8c21-4736-b980-c578829108f8 tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:51.855358 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-01b84475-8c21-4736-b980-c578829108f8 tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:51.863697 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-5c9bc109-0e12-421f-aa0b-73a007a124f7 tempest-ServersTestBootFromVolume-877599095 tempest-ServersTestBootFromVolume-877599095-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:02:51.864849 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-5c9bc109-0e12-421f-aa0b-73a007a124f7 tempest-ServersTestBootFromVolume-877599095 tempest-ServersTestBootFromVolume-877599095-project] [instance: 44cdf0d8-969b-4149-bb03-6bc390977019] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:02:51.875795 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-5c9bc109-0e12-421f-aa0b-73a007a124f7 tempest-ServersTestBootFromVolume-877599095 tempest-ServersTestBootFromVolume-877599095-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:51.876291 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-5c9bc109-0e12-421f-aa0b-73a007a124f7 tempest-ServersTestBootFromVolume-877599095 tempest-ServersTestBootFromVolume-877599095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:51.876766 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-5c9bc109-0e12-421f-aa0b-73a007a124f7 tempest-ServersTestBootFromVolume-877599095 tempest-ServersTestBootFromVolume-877599095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:51.879667 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-5c9bc109-0e12-421f-aa0b-73a007a124f7 tempest-ServersTestBootFromVolume-877599095 tempest-ServersTestBootFromVolume-877599095-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:51.880218 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-5c9bc109-0e12-421f-aa0b-73a007a124f7 tempest-ServersTestBootFromVolume-877599095 tempest-ServersTestBootFromVolume-877599095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:51.880677 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-5c9bc109-0e12-421f-aa0b-73a007a124f7 tempest-ServersTestBootFromVolume-877599095 tempest-ServersTestBootFromVolume-877599095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:51.888184 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-01b84475-8c21-4736-b980-c578829108f8 tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] 10.222.0.13 "GET /compute/v2.1/servers/4b9fb909-26f7-40af-bac5-e7d2a6b9fb77/ips" status: 200 len: 217 microversion: 2.1 time: 0.055034 Nov 01 19:02:51.889144 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1163/2338] 10.222.0.13 () {58 vars in 1248 bytes} [Tue Nov 1 19:02:51 2022] GET /compute/v2.1/servers/4b9fb909-26f7-40af-bac5-e7d2a6b9fb77/ips => generated 217 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:02:51.906068 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-d6f42827-8690-45a6-943d-f9c632a4d666 tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:02:51.906731 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-d6f42827-8690-45a6-943d-f9c632a4d666 tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] [instance: 4b9fb909-26f7-40af-bac5-e7d2a6b9fb77] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:02:51.922779 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-d6f42827-8690-45a6-943d-f9c632a4d666 tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:51.925639 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-d6f42827-8690-45a6-943d-f9c632a4d666 tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:51.926303 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-d6f42827-8690-45a6-943d-f9c632a4d666 tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:51.927323 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-d6f42827-8690-45a6-943d-f9c632a4d666 tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:51.931805 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-d6f42827-8690-45a6-943d-f9c632a4d666 tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:51.932508 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-d6f42827-8690-45a6-943d-f9c632a4d666 tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:51.989003 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-d6f42827-8690-45a6-943d-f9c632a4d666 tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] [instance: 4b9fb909-26f7-40af-bac5-e7d2a6b9fb77] Going to try to terminate instance {{(pid=121402) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 01 19:02:52.142143 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-d6f42827-8690-45a6-943d-f9c632a4d666 tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] 10.222.0.13 "DELETE /compute/v2.1/servers/4b9fb909-26f7-40af-bac5-e7d2a6b9fb77" status: 204 len: 0 microversion: 2.1 time: 0.243814 Nov 01 19:02:52.145280 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1164/2339] 10.222.0.13 () {58 vars in 1239 bytes} [Tue Nov 1 19:02:51 2022] DELETE /compute/v2.1/servers/4b9fb909-26f7-40af-bac5-e7d2a6b9fb77 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 01 19:02:52.154332 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [req-745a2267-1d94-4987-97fb-592620a3a51f req-34efc741-ddc7-40ad-afdc-80c72ecabeff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "44cdf0d8-969b-4149-bb03-6bc390977019", "tag": "2ea52276-0a87-4b31-a387-b25b0b2e684c"}]} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:02:52.171747 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-5c9bc109-0e12-421f-aa0b-73a007a124f7 tempest-ServersTestBootFromVolume-877599095 tempest-ServersTestBootFromVolume-877599095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed2352ce53fc4045adde8cd81b78b3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651046528c204df299ca3d14c44b4a7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:02:52.180847 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-5c9bc109-0e12-421f-aa0b-73a007a124f7 tempest-ServersTestBootFromVolume-877599095 tempest-ServersTestBootFromVolume-877599095-project] 10.222.0.13 "GET /compute/v2.1/servers/44cdf0d8-969b-4149-bb03-6bc390977019" status: 200 len: 1482 microversion: 2.1 time: 0.321313 Nov 01 19:02:52.193386 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-745a2267-1d94-4987-97fb-592620a3a51f req-34efc741-ddc7-40ad-afdc-80c72ecabeff service nova] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:52.193386 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-745a2267-1d94-4987-97fb-592620a3a51f req-34efc741-ddc7-40ad-afdc-80c72ecabeff service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:52.193386 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-745a2267-1d94-4987-97fb-592620a3a51f req-34efc741-ddc7-40ad-afdc-80c72ecabeff service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:52.200716 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1176/2340] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:02:51 2022] GET /compute/v2.1/servers/44cdf0d8-969b-4149-bb03-6bc390977019 => generated 1482 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:02:52.200716 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-131ebb4b-16f2-4f6a-b5bf-b97a847f079a tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:02:52.200716 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-131ebb4b-16f2-4f6a-b5bf-b97a847f079a tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] [instance: 992f5ec5-d256-4870-b16d-fc8d9adbd3e7] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:02:52.210537 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-131ebb4b-16f2-4f6a-b5bf-b97a847f079a tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:52.211040 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-131ebb4b-16f2-4f6a-b5bf-b97a847f079a tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:52.211477 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-131ebb4b-16f2-4f6a-b5bf-b97a847f079a tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:52.212190 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-131ebb4b-16f2-4f6a-b5bf-b97a847f079a tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:52.212683 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-131ebb4b-16f2-4f6a-b5bf-b97a847f079a tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:52.213110 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-131ebb4b-16f2-4f6a-b5bf-b97a847f079a tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:52.217752 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.compute.server_external_events [req-745a2267-1d94-4987-97fb-592620a3a51f req-34efc741-ddc7-40ad-afdc-80c72ecabeff service nova] Creating event network-changed:2ea52276-0a87-4b31-a387-b25b0b2e684c for instance 44cdf0d8-969b-4149-bb03-6bc390977019 on n-h1-863052-2 Nov 01 19:02:52.228552 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [req-745a2267-1d94-4987-97fb-592620a3a51f req-34efc741-ddc7-40ad-afdc-80c72ecabeff service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080266 Nov 01 19:02:52.229524 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1165/2341] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Nov 1 19:02:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:02:52.237961 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-8594551d-fdf7-498e-8380-0e304f7d2e7b tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:02:52.240382 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-8594551d-fdf7-498e-8380-0e304f7d2e7b tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] [instance: 4b9fb909-26f7-40af-bac5-e7d2a6b9fb77] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:02:52.253010 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-8594551d-fdf7-498e-8380-0e304f7d2e7b tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:52.253559 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-8594551d-fdf7-498e-8380-0e304f7d2e7b tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:52.254011 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-8594551d-fdf7-498e-8380-0e304f7d2e7b tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:52.255788 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-8594551d-fdf7-498e-8380-0e304f7d2e7b tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:52.256245 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-8594551d-fdf7-498e-8380-0e304f7d2e7b tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:52.256706 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-8594551d-fdf7-498e-8380-0e304f7d2e7b tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:52.369999 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-131ebb4b-16f2-4f6a-b5bf-b97a847f079a tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb496b3faac4abbae73d389f2042e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e2520220d454764b8c139a58d78ac83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:02:52.378824 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-131ebb4b-16f2-4f6a-b5bf-b97a847f079a tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] 10.222.0.13 "GET /compute/v2.1/servers/992f5ec5-d256-4870-b16d-fc8d9adbd3e7" status: 200 len: 1472 microversion: 2.1 time: 0.192762 Nov 01 19:02:52.380324 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1177/2342] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:02:52 2022] GET /compute/v2.1/servers/992f5ec5-d256-4870-b16d-fc8d9adbd3e7 => generated 1472 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:02:52.385346 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-000ce7ad-1e76-47b1-a60d-8b2ac77ea2c6 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:02:52.386098 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-000ce7ad-1e76-47b1-a60d-8b2ac77ea2c6 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] [instance: 2d3a927e-a478-40b1-8c92-80396c82f76c] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:02:52.392670 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-000ce7ad-1e76-47b1-a60d-8b2ac77ea2c6 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:52.397361 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-000ce7ad-1e76-47b1-a60d-8b2ac77ea2c6 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:52.398012 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-000ce7ad-1e76-47b1-a60d-8b2ac77ea2c6 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:52.398926 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-000ce7ad-1e76-47b1-a60d-8b2ac77ea2c6 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:52.399536 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-000ce7ad-1e76-47b1-a60d-8b2ac77ea2c6 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:52.401226 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-000ce7ad-1e76-47b1-a60d-8b2ac77ea2c6 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:52.420120 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.wsgi [None req-000ce7ad-1e76-47b1-a60d-8b2ac77ea2c6 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] HTTP exception thrown: Instance 2d3a927e-a478-40b1-8c92-80396c82f76c could not be found. Nov 01 19:02:52.423136 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-000ce7ad-1e76-47b1-a60d-8b2ac77ea2c6 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Request method failure captured: Nov 01 19:02:52.423136 n-d-863052-2 devstack@n-api.service[121403]: request: GET /compute/v2.1/servers/2d3a927e-a478-40b1-8c92-80396c82f76c HTTP/1.1 Nov 01 19:02:52.423136 n-d-863052-2 devstack@n-api.service[121403]: Accept: application/json Nov 01 19:02:52.423136 n-d-863052-2 devstack@n-api.service[121403]: Accept-Encoding: identity Nov 01 19:02:52.423136 n-d-863052-2 devstack@n-api.service[121403]: Connection: close Nov 01 19:02:52.423136 n-d-863052-2 devstack@n-api.service[121403]: Content-Length: 0 Nov 01 19:02:52.423136 n-d-863052-2 devstack@n-api.service[121403]: Content-Type: application/json Nov 01 19:02:52.423136 n-d-863052-2 devstack@n-api.service[121403]: Host: 10.222.0.13 Nov 01 19:02:52.423136 n-d-863052-2 devstack@n-api.service[121403]: Openstack-System-Scope: None Nov 01 19:02:52.423136 n-d-863052-2 devstack@n-api.service[121403]: User-Agent: python-urllib3/1.26.12 Nov 01 19:02:52.423136 n-d-863052-2 devstack@n-api.service[121403]: X-Auth-Token: gAAAAABjYWuXbvFs9aS-AI-YunBpI7JW1G7TtGj9lNPX9_m5x7yvx5NDb5_8tZxcZ9OJEVvcArKsi1gBG0i_m2a-mPBO8TJfCOQY2BcBWVVWE6IstJB3B2-12IsAPiHj9lscAGshtM26YMMYwGnt2-cysTVDO07JS8LPF_YKr1_xNELllwy_Puk Nov 01 19:02:52.423136 n-d-863052-2 devstack@n-api.service[121403]: X-Domain-Id: None Nov 01 19:02:52.423136 n-d-863052-2 devstack@n-api.service[121403]: X-Domain-Name: None Nov 01 19:02:52.423136 n-d-863052-2 devstack@n-api.service[121403]: X-Identity-Status: Confirmed Nov 01 19:02:52.423136 n-d-863052-2 devstack@n-api.service[121403]: X-Is-Admin-Project: True Nov 01 19:02:52.423136 n-d-863052-2 devstack@n-api.service[121403]: X-Openstack-Nova-Api-Version: 2.25 Nov 01 19:02:52.423136 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Domain-Id: default Nov 01 19:02:52.423136 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Domain-Name: Default Nov 01 19:02:52.423136 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Id: 75730f90ec924cbebd605d6d6d747efe Nov 01 19:02:52.423136 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-1114814424 Nov 01 19:02:52.423136 n-d-863052-2 devstack@n-api.service[121403]: X-Role: member,reader Nov 01 19:02:52.423136 n-d-863052-2 devstack@n-api.service[121403]: X-Roles: member,reader Nov 01 19:02:52.423136 n-d-863052-2 devstack@n-api.service[121403]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/75730f90ec924cbebd605d6d6d747efe"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/75730f90ec924cbebd605d6d6d747efe"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_75730f90ec924cbebd605d6d6d747efe", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/75730f90ec924cbebd605d6d6d747efe"}]}] Nov 01 19:02:52.423136 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-1114814424 Nov 01 19:02:52.423136 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant-Id: 75730f90ec924cbebd605d6d6d747efe Nov 01 19:02:52.423136 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-1114814424 Nov 01 19:02:52.423136 n-d-863052-2 devstack@n-api.service[121403]: X-User: tempest-LiveAutoBlockMigrationV225Test-1114814424-project Nov 01 19:02:52.423136 n-d-863052-2 devstack@n-api.service[121403]: X-User-Domain-Id: default Nov 01 19:02:52.423136 n-d-863052-2 devstack@n-api.service[121403]: X-User-Domain-Name: Default Nov 01 19:02:52.423136 n-d-863052-2 devstack@n-api.service[121403]: X-User-Id: c2ddf0211c374fe2a0db89546beb8e96 Nov 01 19:02:52.423136 n-d-863052-2 devstack@n-api.service[121403]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-1114814424-project Nov 01 19:02:52.423136 n-d-863052-2 devstack@n-api.service[121403]: method: > Nov 01 19:02:52.423136 n-d-863052-2 devstack@n-api.service[121403]: exception: Instance 2d3a927e-a478-40b1-8c92-80396c82f76c could not be found. Nov 01 19:02:52.423136 n-d-863052-2 devstack@n-api.service[121403]: action_args: {'id': '2d3a927e-a478-40b1-8c92-80396c82f76c'} Nov 01 19:02:52.423136 n-d-863052-2 devstack@n-api.service[121403]: {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 01 19:02:52.423136 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:02:52.423136 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 01 19:02:52.423136 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 01 19:02:52.423136 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 01 19:02:52.423136 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 01 19:02:52.423136 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 01 19:02:52.423136 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 01 19:02:52.423136 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 01 19:02:52.423136 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 01 19:02:52.423136 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2d3a927e-a478-40b1-8c92-80396c82f76c could not be found. Nov 01 19:02:52.423136 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:02:52.423136 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:02:52.423136 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:02:52.423136 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:02:52.423136 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:02:52.423136 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:02:52.423136 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 01 19:02:52.423136 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 01 19:02:52.423136 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 01 19:02:52.423136 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 01 19:02:52.423136 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 01 19:02:52.423136 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 01 19:02:52.423136 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 01 19:02:52.423136 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 01 19:02:52.423136 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 01 19:02:52.423136 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 01 19:02:52.423136 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2d3a927e-a478-40b1-8c92-80396c82f76c could not be found. Nov 01 19:02:52.423136 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:02:52.427549 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:02:52.427549 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:02:52.427549 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:02:52.427549 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:02:52.427549 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:02:52.427549 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 01 19:02:52.427549 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 01 19:02:52.427549 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2d3a927e-a478-40b1-8c92-80396c82f76c could not be found. Nov 01 19:02:52.427549 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:02:52.430737 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-000ce7ad-1e76-47b1-a60d-8b2ac77ea2c6 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] Returning 404 to user: Instance 2d3a927e-a478-40b1-8c92-80396c82f76c could not be found. {{(pid=121403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 01 19:02:52.433183 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-000ce7ad-1e76-47b1-a60d-8b2ac77ea2c6 tempest-LiveAutoBlockMigrationV225Test-1114814424 tempest-LiveAutoBlockMigrationV225Test-1114814424-project] 10.222.0.13 "GET /compute/v2.1/servers/2d3a927e-a478-40b1-8c92-80396c82f76c" status: 404 len: 111 microversion: 2.25 time: 0.050711 Nov 01 19:02:52.434371 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1178/2343] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 19:02:52 2022] GET /compute/v2.1/servers/2d3a927e-a478-40b1-8c92-80396c82f76c => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 01 19:02:52.728287 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-5737c702-0856-484f-9397-20abbc579460 tempest-LiveMigrationNegativeTest-570155948 tempest-LiveMigrationNegativeTest-570155948-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-1813987830", "imageRef": "2d4a0047-1b9e-445f-8af8-1b5c9d93e881", "flavorRef": "452"}} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:02:52.846867 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.network.neutron [None req-5737c702-0856-484f-9397-20abbc579460 tempest-LiveMigrationNegativeTest-570155948 tempest-LiveMigrationNegativeTest-570155948-project] validate_networks() for None {{(pid=121403) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 01 19:02:52.857161 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-8594551d-fdf7-498e-8380-0e304f7d2e7b tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52acef7992d64d378fd8ac333887fd0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af51b8733e984c2ca87df2d8163dedf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:02:52.870924 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-8594551d-fdf7-498e-8380-0e304f7d2e7b tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] 10.222.0.13 "GET /compute/v2.1/servers/4b9fb909-26f7-40af-bac5-e7d2a6b9fb77" status: 200 len: 1809 microversion: 2.1 time: 0.639688 Nov 01 19:02:52.884682 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1166/2344] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:02:52 2022] GET /compute/v2.1/servers/4b9fb909-26f7-40af-bac5-e7d2a6b9fb77 => generated 1809 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:02:52.884682 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-6d9ccd34-7746-4ed8-83b7-c36f7d152ca6 tempest-ServersTestJSON-675990056 tempest-ServersTestJSON-675990056-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:02:52.884682 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-6d9ccd34-7746-4ed8-83b7-c36f7d152ca6 tempest-ServersTestJSON-675990056 tempest-ServersTestJSON-675990056-project] [instance: 6e82d040-bcc6-473e-b202-bf13829baf2c] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:02:52.887041 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-6d9ccd34-7746-4ed8-83b7-c36f7d152ca6 tempest-ServersTestJSON-675990056 tempest-ServersTestJSON-675990056-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:52.890781 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-6d9ccd34-7746-4ed8-83b7-c36f7d152ca6 tempest-ServersTestJSON-675990056 tempest-ServersTestJSON-675990056-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:52.890781 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-6d9ccd34-7746-4ed8-83b7-c36f7d152ca6 tempest-ServersTestJSON-675990056 tempest-ServersTestJSON-675990056-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:52.890781 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-6d9ccd34-7746-4ed8-83b7-c36f7d152ca6 tempest-ServersTestJSON-675990056 tempest-ServersTestJSON-675990056-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:52.890781 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-6d9ccd34-7746-4ed8-83b7-c36f7d152ca6 tempest-ServersTestJSON-675990056 tempest-ServersTestJSON-675990056-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:52.890781 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-6d9ccd34-7746-4ed8-83b7-c36f7d152ca6 tempest-ServersTestJSON-675990056 tempest-ServersTestJSON-675990056-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:53.142959 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-6d9ccd34-7746-4ed8-83b7-c36f7d152ca6 tempest-ServersTestJSON-675990056 tempest-ServersTestJSON-675990056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71d26d92020b4d4aab9f82d174e1ba9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3dd3fba10d740c9bc38b10dca3007aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:02:53.155128 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-6d9ccd34-7746-4ed8-83b7-c36f7d152ca6 tempest-ServersTestJSON-675990056 tempest-ServersTestJSON-675990056-project] 10.222.0.13 "GET /compute/v2.1/servers/6e82d040-bcc6-473e-b202-bf13829baf2c" status: 200 len: 1393 microversion: 2.1 time: 0.281754 Nov 01 19:02:53.155904 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1167/2345] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:02:52 2022] GET /compute/v2.1/servers/6e82d040-bcc6-473e-b202-bf13829baf2c => generated 1393 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:02:53.232852 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.virt.hardware [None req-5737c702-0856-484f-9397-20abbc579460 tempest-LiveMigrationNegativeTest-570155948 tempest-LiveMigrationNegativeTest-570155948-project] Flavor limits 0:0:0 {{(pid=121403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 01 19:02:53.236014 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.virt.hardware [None req-5737c702-0856-484f-9397-20abbc579460 tempest-LiveMigrationNegativeTest-570155948 tempest-LiveMigrationNegativeTest-570155948-project] Image limits 0:0:0 {{(pid=121403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 01 19:02:53.237450 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.virt.hardware [None req-5737c702-0856-484f-9397-20abbc579460 tempest-LiveMigrationNegativeTest-570155948 tempest-LiveMigrationNegativeTest-570155948-project] Flavor pref 0:0:0 {{(pid=121403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 01 19:02:53.238290 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.virt.hardware [None req-5737c702-0856-484f-9397-20abbc579460 tempest-LiveMigrationNegativeTest-570155948 tempest-LiveMigrationNegativeTest-570155948-project] Image pref 0:0:0 {{(pid=121403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 01 19:02:53.239194 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.virt.hardware [None req-5737c702-0856-484f-9397-20abbc579460 tempest-LiveMigrationNegativeTest-570155948 tempest-LiveMigrationNegativeTest-570155948-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 01 19:02:53.273578 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-5737c702-0856-484f-9397-20abbc579460 tempest-LiveMigrationNegativeTest-570155948 tempest-LiveMigrationNegativeTest-570155948-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:53.274093 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-5737c702-0856-484f-9397-20abbc579460 tempest-LiveMigrationNegativeTest-570155948 tempest-LiveMigrationNegativeTest-570155948-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:53.275001 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-5737c702-0856-484f-9397-20abbc579460 tempest-LiveMigrationNegativeTest-570155948 tempest-LiveMigrationNegativeTest-570155948-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:53.276415 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-5737c702-0856-484f-9397-20abbc579460 tempest-LiveMigrationNegativeTest-570155948 tempest-LiveMigrationNegativeTest-570155948-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:53.276913 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-5737c702-0856-484f-9397-20abbc579460 tempest-LiveMigrationNegativeTest-570155948 tempest-LiveMigrationNegativeTest-570155948-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:53.277351 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-5737c702-0856-484f-9397-20abbc579460 tempest-LiveMigrationNegativeTest-570155948 tempest-LiveMigrationNegativeTest-570155948-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:53.317492 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.quota [None req-5737c702-0856-484f-9397-20abbc579460 tempest-LiveMigrationNegativeTest-570155948 tempest-LiveMigrationNegativeTest-570155948-project] Getting quotas for project faa1bc7c9d564b0ebc9ecf0a2994f2d8. Resources: {'cores', 'ram', 'instances'} {{(pid=121403) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 01 19:02:53.341564 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.quota [None req-5737c702-0856-484f-9397-20abbc579460 tempest-LiveMigrationNegativeTest-570155948 tempest-LiveMigrationNegativeTest-570155948-project] Getting quotas for user 4c14605afbc5445d9763db185a1305d4 and project faa1bc7c9d564b0ebc9ecf0a2994f2d8. Resources: {'cores', 'ram', 'instances'} {{(pid=121403) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 01 19:02:53.396792 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-5737c702-0856-484f-9397-20abbc579460 tempest-LiveMigrationNegativeTest-570155948 tempest-LiveMigrationNegativeTest-570155948-project] Going to run 1 instances... {{(pid=121403) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 01 19:02:53.406366 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-e67df877-b707-48ee-b121-2469ee042e35 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:02:53.407195 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-e67df877-b707-48ee-b121-2469ee042e35 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] [instance: 992f5ec5-d256-4870-b16d-fc8d9adbd3e7] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:02:53.408533 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-5737c702-0856-484f-9397-20abbc579460 tempest-LiveMigrationNegativeTest-570155948 tempest-LiveMigrationNegativeTest-570155948-project] [instance: c4f1d50d-c833-4efe-9a6b-15064fbf5b58] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2d4a0047-1b9e-445f-8af8-1b5c9d93e881',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121403) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 01 19:02:53.418759 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e67df877-b707-48ee-b121-2469ee042e35 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:53.420473 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e67df877-b707-48ee-b121-2469ee042e35 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:53.422477 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e67df877-b707-48ee-b121-2469ee042e35 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:53.423990 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e67df877-b707-48ee-b121-2469ee042e35 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:53.426428 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e67df877-b707-48ee-b121-2469ee042e35 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:53.428754 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e67df877-b707-48ee-b121-2469ee042e35 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:53.517391 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-5737c702-0856-484f-9397-20abbc579460 tempest-LiveMigrationNegativeTest-570155948 tempest-LiveMigrationNegativeTest-570155948-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.081519 Nov 01 19:02:53.528690 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1179/2346] 10.222.0.13 () {60 vars in 1147 bytes} [Tue Nov 1 19:02:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 1089 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 01 19:02:53.538178 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-ff5111c6-043a-4a51-8db5-e6cb2717a542 tempest-LiveMigrationNegativeTest-570155948 tempest-LiveMigrationNegativeTest-570155948-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:02:53.538812 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-ff5111c6-043a-4a51-8db5-e6cb2717a542 tempest-LiveMigrationNegativeTest-570155948 tempest-LiveMigrationNegativeTest-570155948-project] [instance: c4f1d50d-c833-4efe-9a6b-15064fbf5b58] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:02:53.646746 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-ff5111c6-043a-4a51-8db5-e6cb2717a542 tempest-LiveMigrationNegativeTest-570155948 tempest-LiveMigrationNegativeTest-570155948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c14605afbc5445d9763db185a1305d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faa1bc7c9d564b0ebc9ecf0a2994f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:02:53.654747 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-ff5111c6-043a-4a51-8db5-e6cb2717a542 tempest-LiveMigrationNegativeTest-570155948 tempest-LiveMigrationNegativeTest-570155948-project] 10.222.0.13 "GET /compute/v2.1/servers/c4f1d50d-c833-4efe-9a6b-15064fbf5b58" status: 200 len: 1219 microversion: 2.1 time: 0.124092 Nov 01 19:02:53.672208 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1180/2347] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:02:53 2022] GET /compute/v2.1/servers/c4f1d50d-c833-4efe-9a6b-15064fbf5b58 => generated 1219 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:02:53.915618 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-cd59f59f-d90a-4b72-a0a9-ad0927a1627e tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:02:53.916448 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-cd59f59f-d90a-4b72-a0a9-ad0927a1627e tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] [instance: 4b9fb909-26f7-40af-bac5-e7d2a6b9fb77] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:02:53.923784 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-cd59f59f-d90a-4b72-a0a9-ad0927a1627e tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:53.927739 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-cd59f59f-d90a-4b72-a0a9-ad0927a1627e tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:53.930821 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-cd59f59f-d90a-4b72-a0a9-ad0927a1627e tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:53.931596 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-cd59f59f-d90a-4b72-a0a9-ad0927a1627e tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:53.932071 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-cd59f59f-d90a-4b72-a0a9-ad0927a1627e tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:53.932512 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-cd59f59f-d90a-4b72-a0a9-ad0927a1627e tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:53.968211 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-e67df877-b707-48ee-b121-2469ee042e35 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb496b3faac4abbae73d389f2042e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e2520220d454764b8c139a58d78ac83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:02:53.985384 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-e67df877-b707-48ee-b121-2469ee042e35 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] 10.222.0.13 "GET /compute/v2.1/servers/992f5ec5-d256-4870-b16d-fc8d9adbd3e7" status: 200 len: 1472 microversion: 2.1 time: 0.578266 Nov 01 19:02:53.987759 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1168/2348] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:02:53 2022] GET /compute/v2.1/servers/992f5ec5-d256-4870-b16d-fc8d9adbd3e7 => generated 1472 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:02:54.182863 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-fc94e335-29cf-4f58-b8ac-d0b4a20c97fe tempest-ServersTestJSON-675990056 tempest-ServersTestJSON-675990056-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:02:54.183706 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-fc94e335-29cf-4f58-b8ac-d0b4a20c97fe tempest-ServersTestJSON-675990056 tempest-ServersTestJSON-675990056-project] [instance: 6e82d040-bcc6-473e-b202-bf13829baf2c] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:02:54.200296 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-fc94e335-29cf-4f58-b8ac-d0b4a20c97fe tempest-ServersTestJSON-675990056 tempest-ServersTestJSON-675990056-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:54.206433 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-fc94e335-29cf-4f58-b8ac-d0b4a20c97fe tempest-ServersTestJSON-675990056 tempest-ServersTestJSON-675990056-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:54.207271 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-fc94e335-29cf-4f58-b8ac-d0b4a20c97fe tempest-ServersTestJSON-675990056 tempest-ServersTestJSON-675990056-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:54.209386 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-fc94e335-29cf-4f58-b8ac-d0b4a20c97fe tempest-ServersTestJSON-675990056 tempest-ServersTestJSON-675990056-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:54.210187 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-fc94e335-29cf-4f58-b8ac-d0b4a20c97fe tempest-ServersTestJSON-675990056 tempest-ServersTestJSON-675990056-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:54.218484 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-fc94e335-29cf-4f58-b8ac-d0b4a20c97fe tempest-ServersTestJSON-675990056 tempest-ServersTestJSON-675990056-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:54.284071 n-d-863052-2 devstack@n-api.service[121402]: DEBUG dbcounter [-] [121402] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 19:02:54.542815 n-d-863052-2 devstack@n-api.service[121402]: DEBUG dbcounter [-] [121402] Writing DB stats nova_cell0:SELECT=6 {{(pid=121402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 19:02:55.037344 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-fc94e335-29cf-4f58-b8ac-d0b4a20c97fe tempest-ServersTestJSON-675990056 tempest-ServersTestJSON-675990056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71d26d92020b4d4aab9f82d174e1ba9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3dd3fba10d740c9bc38b10dca3007aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:02:55.048112 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-fc94e335-29cf-4f58-b8ac-d0b4a20c97fe tempest-ServersTestJSON-675990056 tempest-ServersTestJSON-675990056-project] 10.222.0.13 "GET /compute/v2.1/servers/6e82d040-bcc6-473e-b202-bf13829baf2c" status: 200 len: 1393 microversion: 2.1 time: 0.870911 Nov 01 19:02:55.048734 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1169/2349] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:02:54 2022] GET /compute/v2.1/servers/6e82d040-bcc6-473e-b202-bf13829baf2c => generated 1393 bytes in 874 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 19:02:55.063945 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [req-a2a53866-74a7-48c7-b919-a49fcec4c479 req-36f22b1d-8f4d-4c02-9d11-40a144c4b4bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e82d040-bcc6-473e-b202-bf13829baf2c", "name": "network-vif-plugged", "status": "completed", "tag": "41d8c6fe-f524-41af-9f6e-4b23fdeb1e57"}]} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:02:55.066645 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-cd59f59f-d90a-4b72-a0a9-ad0927a1627e tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52acef7992d64d378fd8ac333887fd0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af51b8733e984c2ca87df2d8163dedf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:02:55.084545 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-cd59f59f-d90a-4b72-a0a9-ad0927a1627e tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] 10.222.0.13 "GET /compute/v2.1/servers/4b9fb909-26f7-40af-bac5-e7d2a6b9fb77" status: 200 len: 1809 microversion: 2.1 time: 1.187827 Nov 01 19:02:55.096989 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1181/2350] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:02:53 2022] GET /compute/v2.1/servers/4b9fb909-26f7-40af-bac5-e7d2a6b9fb77 => generated 1809 bytes in 1193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:02:55.096989 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-a2a97a96-2fff-44f3-8304-6f09df81bc20 tempest-LiveMigrationNegativeTest-570155948 tempest-LiveMigrationNegativeTest-570155948-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:02:55.096989 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-a2a97a96-2fff-44f3-8304-6f09df81bc20 tempest-LiveMigrationNegativeTest-570155948 tempest-LiveMigrationNegativeTest-570155948-project] [instance: c4f1d50d-c833-4efe-9a6b-15064fbf5b58] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:02:55.102804 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-a2a53866-74a7-48c7-b919-a49fcec4c479 req-36f22b1d-8f4d-4c02-9d11-40a144c4b4bf service nova] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:55.102804 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-a2a53866-74a7-48c7-b919-a49fcec4c479 req-36f22b1d-8f4d-4c02-9d11-40a144c4b4bf service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:55.108066 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-a2a53866-74a7-48c7-b919-a49fcec4c479 req-36f22b1d-8f4d-4c02-9d11-40a144c4b4bf service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:55.117817 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-a2a97a96-2fff-44f3-8304-6f09df81bc20 tempest-LiveMigrationNegativeTest-570155948 tempest-LiveMigrationNegativeTest-570155948-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:55.118341 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-a2a97a96-2fff-44f3-8304-6f09df81bc20 tempest-LiveMigrationNegativeTest-570155948 tempest-LiveMigrationNegativeTest-570155948-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:55.119526 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-a2a97a96-2fff-44f3-8304-6f09df81bc20 tempest-LiveMigrationNegativeTest-570155948 tempest-LiveMigrationNegativeTest-570155948-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:55.120424 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-a2a97a96-2fff-44f3-8304-6f09df81bc20 tempest-LiveMigrationNegativeTest-570155948 tempest-LiveMigrationNegativeTest-570155948-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:55.120916 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-a2a97a96-2fff-44f3-8304-6f09df81bc20 tempest-LiveMigrationNegativeTest-570155948 tempest-LiveMigrationNegativeTest-570155948-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:55.124844 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-a2a97a96-2fff-44f3-8304-6f09df81bc20 tempest-LiveMigrationNegativeTest-570155948 tempest-LiveMigrationNegativeTest-570155948-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:55.149425 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.compute.server_external_events [req-a2a53866-74a7-48c7-b919-a49fcec4c479 req-36f22b1d-8f4d-4c02-9d11-40a144c4b4bf service nova] Creating event network-vif-plugged:41d8c6fe-f524-41af-9f6e-4b23fdeb1e57 for instance 6e82d040-bcc6-473e-b202-bf13829baf2c on n-h2-863052-2 Nov 01 19:02:55.199842 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [req-a2a53866-74a7-48c7-b919-a49fcec4c479 req-36f22b1d-8f4d-4c02-9d11-40a144c4b4bf service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.137311 Nov 01 19:02:55.210210 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1170/2351] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Nov 1 19:02:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:02:55.226617 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-2ab841d3-1303-4327-abde-cf17dada276e tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:02:55.239867 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-2ab841d3-1303-4327-abde-cf17dada276e tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] [instance: 992f5ec5-d256-4870-b16d-fc8d9adbd3e7] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:02:55.261024 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2ab841d3-1303-4327-abde-cf17dada276e tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:55.266773 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2ab841d3-1303-4327-abde-cf17dada276e tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:55.267321 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2ab841d3-1303-4327-abde-cf17dada276e tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:55.268082 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2ab841d3-1303-4327-abde-cf17dada276e tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:55.268557 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2ab841d3-1303-4327-abde-cf17dada276e tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:55.269007 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2ab841d3-1303-4327-abde-cf17dada276e tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:55.379522 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-a2a97a96-2fff-44f3-8304-6f09df81bc20 tempest-LiveMigrationNegativeTest-570155948 tempest-LiveMigrationNegativeTest-570155948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c14605afbc5445d9763db185a1305d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faa1bc7c9d564b0ebc9ecf0a2994f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:02:55.390467 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-a2a97a96-2fff-44f3-8304-6f09df81bc20 tempest-LiveMigrationNegativeTest-570155948 tempest-LiveMigrationNegativeTest-570155948-project] 10.222.0.13 "GET /compute/v2.1/servers/c4f1d50d-c833-4efe-9a6b-15064fbf5b58" status: 200 len: 1271 microversion: 2.1 time: 0.301231 Nov 01 19:02:55.391479 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1182/2352] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:02:55 2022] GET /compute/v2.1/servers/c4f1d50d-c833-4efe-9a6b-15064fbf5b58 => generated 1271 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:02:55.445677 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-1bdaaca3-621f-490a-9527-770f5c1ecc7b tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:02:55.447179 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-1bdaaca3-621f-490a-9527-770f5c1ecc7b tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] [instance: 90b353ab-ef97-4d88-b5bc-b355ff576225] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:02:55.458906 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-1bdaaca3-621f-490a-9527-770f5c1ecc7b tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:55.459753 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-1bdaaca3-621f-490a-9527-770f5c1ecc7b tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:55.460346 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-1bdaaca3-621f-490a-9527-770f5c1ecc7b tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:55.462613 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-1bdaaca3-621f-490a-9527-770f5c1ecc7b tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:55.463237 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-1bdaaca3-621f-490a-9527-770f5c1ecc7b tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:55.463826 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-1bdaaca3-621f-490a-9527-770f5c1ecc7b tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:55.690670 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.objects.instance [None req-1bdaaca3-621f-490a-9527-770f5c1ecc7b tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lazy-loading 'services' on Instance uuid 90b353ab-ef97-4d88-b5bc-b355ff576225 {{(pid=121403) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 01 19:02:55.847987 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-2ab841d3-1303-4327-abde-cf17dada276e tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb496b3faac4abbae73d389f2042e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e2520220d454764b8c139a58d78ac83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:02:55.861912 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-2ab841d3-1303-4327-abde-cf17dada276e tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] 10.222.0.13 "GET /compute/v2.1/servers/992f5ec5-d256-4870-b16d-fc8d9adbd3e7" status: 200 len: 1472 microversion: 2.1 time: 0.648701 Nov 01 19:02:55.863502 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1171/2353] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:02:55 2022] GET /compute/v2.1/servers/992f5ec5-d256-4870-b16d-fc8d9adbd3e7 => generated 1472 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:02:55.949264 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-1bdaaca3-621f-490a-9527-770f5c1ecc7b tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] 10.222.0.13 "DELETE /compute/v2.1/servers/90b353ab-ef97-4d88-b5bc-b355ff576225/os-volume_attachments/f6f33cc1-4876-46b0-90b4-a7659a320eed" status: 202 len: 0 microversion: 2.1 time: 0.507663 Nov 01 19:02:55.949992 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1183/2354] 10.222.0.13 () {58 vars in 1416 bytes} [Tue Nov 1 19:02:55 2022] DELETE /compute/v2.1/servers/90b353ab-ef97-4d88-b5bc-b355ff576225/os-volume_attachments/f6f33cc1-4876-46b0-90b4-a7659a320eed => generated 0 bytes in 509 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 01 19:02:55.959365 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-b4fa1737-f4f6-475e-8b12-e4806978dab7 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:02:55.962107 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-b4fa1737-f4f6-475e-8b12-e4806978dab7 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] [instance: 90b353ab-ef97-4d88-b5bc-b355ff576225] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:02:55.979763 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b4fa1737-f4f6-475e-8b12-e4806978dab7 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:55.993599 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b4fa1737-f4f6-475e-8b12-e4806978dab7 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:55.994088 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b4fa1737-f4f6-475e-8b12-e4806978dab7 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:55.995135 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b4fa1737-f4f6-475e-8b12-e4806978dab7 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:55.995905 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b4fa1737-f4f6-475e-8b12-e4806978dab7 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:55.996328 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b4fa1737-f4f6-475e-8b12-e4806978dab7 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:56.054843 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-b4fa1737-f4f6-475e-8b12-e4806978dab7 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] 10.222.0.13 "GET /compute/v2.1/servers/90b353ab-ef97-4d88-b5bc-b355ff576225/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.100410 Nov 01 19:02:56.056055 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1172/2355] 10.222.0.13 () {58 vars in 1302 bytes} [Tue Nov 1 19:02:55 2022] GET /compute/v2.1/servers/90b353ab-ef97-4d88-b5bc-b355ff576225/os-volume_attachments => generated 197 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:02:56.074440 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-8be8f43b-42e0-44aa-95da-933dc619ccb2 tempest-ServersTestJSON-675990056 tempest-ServersTestJSON-675990056-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:02:56.075858 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-8be8f43b-42e0-44aa-95da-933dc619ccb2 tempest-ServersTestJSON-675990056 tempest-ServersTestJSON-675990056-project] [instance: 6e82d040-bcc6-473e-b202-bf13829baf2c] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:02:56.089422 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-8be8f43b-42e0-44aa-95da-933dc619ccb2 tempest-ServersTestJSON-675990056 tempest-ServersTestJSON-675990056-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:56.090173 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-8be8f43b-42e0-44aa-95da-933dc619ccb2 tempest-ServersTestJSON-675990056 tempest-ServersTestJSON-675990056-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:56.090793 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-8be8f43b-42e0-44aa-95da-933dc619ccb2 tempest-ServersTestJSON-675990056 tempest-ServersTestJSON-675990056-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:56.091744 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-8be8f43b-42e0-44aa-95da-933dc619ccb2 tempest-ServersTestJSON-675990056 tempest-ServersTestJSON-675990056-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:56.092519 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-8be8f43b-42e0-44aa-95da-933dc619ccb2 tempest-ServersTestJSON-675990056 tempest-ServersTestJSON-675990056-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:56.093193 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-8be8f43b-42e0-44aa-95da-933dc619ccb2 tempest-ServersTestJSON-675990056 tempest-ServersTestJSON-675990056-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:56.117656 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-959623a2-4a09-4591-bfc8-4c2aba6f8bda tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:02:56.118645 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-959623a2-4a09-4591-bfc8-4c2aba6f8bda tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] [instance: 4b9fb909-26f7-40af-bac5-e7d2a6b9fb77] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:02:56.134212 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-959623a2-4a09-4591-bfc8-4c2aba6f8bda tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:56.135132 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-959623a2-4a09-4591-bfc8-4c2aba6f8bda tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:56.137010 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-959623a2-4a09-4591-bfc8-4c2aba6f8bda tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:56.138426 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-959623a2-4a09-4591-bfc8-4c2aba6f8bda tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:56.140012 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-959623a2-4a09-4591-bfc8-4c2aba6f8bda tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:56.141404 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-959623a2-4a09-4591-bfc8-4c2aba6f8bda tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:56.559342 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-959623a2-4a09-4591-bfc8-4c2aba6f8bda tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52acef7992d64d378fd8ac333887fd0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af51b8733e984c2ca87df2d8163dedf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:02:56.561500 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-8be8f43b-42e0-44aa-95da-933dc619ccb2 tempest-ServersTestJSON-675990056 tempest-ServersTestJSON-675990056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71d26d92020b4d4aab9f82d174e1ba9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3dd3fba10d740c9bc38b10dca3007aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:02:56.573155 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-8be8f43b-42e0-44aa-95da-933dc619ccb2 tempest-ServersTestJSON-675990056 tempest-ServersTestJSON-675990056-project] 10.222.0.13 "GET /compute/v2.1/servers/6e82d040-bcc6-473e-b202-bf13829baf2c" status: 200 len: 1393 microversion: 2.1 time: 0.502279 Nov 01 19:02:56.574145 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1184/2356] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:02:56 2022] GET /compute/v2.1/servers/6e82d040-bcc6-473e-b202-bf13829baf2c => generated 1393 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:02:56.577037 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-959623a2-4a09-4591-bfc8-4c2aba6f8bda tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] 10.222.0.13 "GET /compute/v2.1/servers/4b9fb909-26f7-40af-bac5-e7d2a6b9fb77" status: 200 len: 1788 microversion: 2.1 time: 0.465142 Nov 01 19:02:56.578262 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1173/2357] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:02:56 2022] GET /compute/v2.1/servers/4b9fb909-26f7-40af-bac5-e7d2a6b9fb77 => generated 1788 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:02:56.584227 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [req-89545928-6c35-4512-85df-66e695be2db5 req-f6165ced-91e0-4078-8f41-a3372ebb3bc7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b9fb909-26f7-40af-bac5-e7d2a6b9fb77", "name": "network-vif-deleted", "tag": "23db407a-d443-468d-a813-719394117719"}]} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:02:56.584764 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-68e402d3-0bc5-4e02-9d12-c8d955665175 tempest-LiveMigrationNegativeTest-570155948 tempest-LiveMigrationNegativeTest-570155948-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:02:56.596285 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-68e402d3-0bc5-4e02-9d12-c8d955665175 tempest-LiveMigrationNegativeTest-570155948 tempest-LiveMigrationNegativeTest-570155948-project] [instance: c4f1d50d-c833-4efe-9a6b-15064fbf5b58] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:02:56.606647 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-89545928-6c35-4512-85df-66e695be2db5 req-f6165ced-91e0-4078-8f41-a3372ebb3bc7 service nova] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:56.607554 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-89545928-6c35-4512-85df-66e695be2db5 req-f6165ced-91e0-4078-8f41-a3372ebb3bc7 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:56.608957 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-89545928-6c35-4512-85df-66e695be2db5 req-f6165ced-91e0-4078-8f41-a3372ebb3bc7 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:56.611039 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-68e402d3-0bc5-4e02-9d12-c8d955665175 tempest-LiveMigrationNegativeTest-570155948 tempest-LiveMigrationNegativeTest-570155948-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:56.612215 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-68e402d3-0bc5-4e02-9d12-c8d955665175 tempest-LiveMigrationNegativeTest-570155948 tempest-LiveMigrationNegativeTest-570155948-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:56.616109 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-68e402d3-0bc5-4e02-9d12-c8d955665175 tempest-LiveMigrationNegativeTest-570155948 tempest-LiveMigrationNegativeTest-570155948-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:56.616902 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-68e402d3-0bc5-4e02-9d12-c8d955665175 tempest-LiveMigrationNegativeTest-570155948 tempest-LiveMigrationNegativeTest-570155948-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:56.617376 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-68e402d3-0bc5-4e02-9d12-c8d955665175 tempest-LiveMigrationNegativeTest-570155948 tempest-LiveMigrationNegativeTest-570155948-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:56.617808 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-68e402d3-0bc5-4e02-9d12-c8d955665175 tempest-LiveMigrationNegativeTest-570155948 tempest-LiveMigrationNegativeTest-570155948-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:56.655608 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.compute.server_external_events [req-89545928-6c35-4512-85df-66e695be2db5 req-f6165ced-91e0-4078-8f41-a3372ebb3bc7 service nova] Creating event network-vif-deleted:23db407a-d443-468d-a813-719394117719 for instance 4b9fb909-26f7-40af-bac5-e7d2a6b9fb77 on n-h1-863052-2 Nov 01 19:02:56.674348 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [req-89545928-6c35-4512-85df-66e695be2db5 req-f6165ced-91e0-4078-8f41-a3372ebb3bc7 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097511 Nov 01 19:02:56.678383 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1185/2358] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Nov 1 19:02:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:02:56.774004 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-68e402d3-0bc5-4e02-9d12-c8d955665175 tempest-LiveMigrationNegativeTest-570155948 tempest-LiveMigrationNegativeTest-570155948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c14605afbc5445d9763db185a1305d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faa1bc7c9d564b0ebc9ecf0a2994f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:02:56.789431 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-68e402d3-0bc5-4e02-9d12-c8d955665175 tempest-LiveMigrationNegativeTest-570155948 tempest-LiveMigrationNegativeTest-570155948-project] 10.222.0.13 "GET /compute/v2.1/servers/c4f1d50d-c833-4efe-9a6b-15064fbf5b58" status: 200 len: 1277 microversion: 2.1 time: 0.209921 Nov 01 19:02:56.790280 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1174/2359] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:02:56 2022] GET /compute/v2.1/servers/c4f1d50d-c833-4efe-9a6b-15064fbf5b58 => generated 1277 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:02:56.890735 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-c593460c-72f3-41ef-9fd0-d3b4b806636f tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:02:56.891880 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-c593460c-72f3-41ef-9fd0-d3b4b806636f tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] [instance: 992f5ec5-d256-4870-b16d-fc8d9adbd3e7] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:02:56.900464 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-c593460c-72f3-41ef-9fd0-d3b4b806636f tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:56.901495 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-c593460c-72f3-41ef-9fd0-d3b4b806636f tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:56.903386 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-c593460c-72f3-41ef-9fd0-d3b4b806636f tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:56.904666 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-c593460c-72f3-41ef-9fd0-d3b4b806636f tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:56.905570 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-c593460c-72f3-41ef-9fd0-d3b4b806636f tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:56.906330 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-c593460c-72f3-41ef-9fd0-d3b4b806636f tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:57.067838 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-b790ea4a-cbb0-4572-ba0a-1d36de89f0c6 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:02:57.070370 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-b790ea4a-cbb0-4572-ba0a-1d36de89f0c6 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] [instance: 90b353ab-ef97-4d88-b5bc-b355ff576225] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:02:57.092289 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b790ea4a-cbb0-4572-ba0a-1d36de89f0c6 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:57.093063 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b790ea4a-cbb0-4572-ba0a-1d36de89f0c6 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:57.093684 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b790ea4a-cbb0-4572-ba0a-1d36de89f0c6 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:57.094548 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b790ea4a-cbb0-4572-ba0a-1d36de89f0c6 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:57.095152 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b790ea4a-cbb0-4572-ba0a-1d36de89f0c6 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:57.095722 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b790ea4a-cbb0-4572-ba0a-1d36de89f0c6 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:57.153764 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-b790ea4a-cbb0-4572-ba0a-1d36de89f0c6 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] 10.222.0.13 "GET /compute/v2.1/servers/90b353ab-ef97-4d88-b5bc-b355ff576225/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.089837 Nov 01 19:02:57.162356 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1175/2360] 10.222.0.13 () {58 vars in 1302 bytes} [Tue Nov 1 19:02:57 2022] GET /compute/v2.1/servers/90b353ab-ef97-4d88-b5bc-b355ff576225/os-volume_attachments => generated 197 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 01 19:02:57.601325 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-887c80a1-498f-4f9c-b8ef-9e727a978415 tempest-ServersTestJSON-675990056 tempest-ServersTestJSON-675990056-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:02:57.603935 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-887c80a1-498f-4f9c-b8ef-9e727a978415 tempest-ServersTestJSON-675990056 tempest-ServersTestJSON-675990056-project] [instance: 6e82d040-bcc6-473e-b202-bf13829baf2c] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:02:57.617985 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-887c80a1-498f-4f9c-b8ef-9e727a978415 tempest-ServersTestJSON-675990056 tempest-ServersTestJSON-675990056-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:57.620682 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-887c80a1-498f-4f9c-b8ef-9e727a978415 tempest-ServersTestJSON-675990056 tempest-ServersTestJSON-675990056-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:57.621368 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-887c80a1-498f-4f9c-b8ef-9e727a978415 tempest-ServersTestJSON-675990056 tempest-ServersTestJSON-675990056-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:57.623659 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-887c80a1-498f-4f9c-b8ef-9e727a978415 tempest-ServersTestJSON-675990056 tempest-ServersTestJSON-675990056-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:57.625915 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-887c80a1-498f-4f9c-b8ef-9e727a978415 tempest-ServersTestJSON-675990056 tempest-ServersTestJSON-675990056-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:57.626604 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-887c80a1-498f-4f9c-b8ef-9e727a978415 tempest-ServersTestJSON-675990056 tempest-ServersTestJSON-675990056-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:57.758834 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-c593460c-72f3-41ef-9fd0-d3b4b806636f tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb496b3faac4abbae73d389f2042e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e2520220d454764b8c139a58d78ac83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:02:57.774417 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-c593460c-72f3-41ef-9fd0-d3b4b806636f tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] 10.222.0.13 "GET /compute/v2.1/servers/992f5ec5-d256-4870-b16d-fc8d9adbd3e7" status: 200 len: 1472 microversion: 2.1 time: 0.889001 Nov 01 19:02:57.775950 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1186/2361] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:02:56 2022] GET /compute/v2.1/servers/992f5ec5-d256-4870-b16d-fc8d9adbd3e7 => generated 1472 bytes in 892 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:02:57.782837 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-bd287479-34d2-49ed-b89e-a49e94dd4cdb tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:02:57.784144 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-bd287479-34d2-49ed-b89e-a49e94dd4cdb tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] [instance: 4b9fb909-26f7-40af-bac5-e7d2a6b9fb77] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:02:57.800455 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-bd287479-34d2-49ed-b89e-a49e94dd4cdb tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:57.801247 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-bd287479-34d2-49ed-b89e-a49e94dd4cdb tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:57.802787 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-bd287479-34d2-49ed-b89e-a49e94dd4cdb tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:57.805124 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-bd287479-34d2-49ed-b89e-a49e94dd4cdb tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:57.805787 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-bd287479-34d2-49ed-b89e-a49e94dd4cdb tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:57.806398 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-bd287479-34d2-49ed-b89e-a49e94dd4cdb tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:58.234105 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-887c80a1-498f-4f9c-b8ef-9e727a978415 tempest-ServersTestJSON-675990056 tempest-ServersTestJSON-675990056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71d26d92020b4d4aab9f82d174e1ba9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3dd3fba10d740c9bc38b10dca3007aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:02:58.246929 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-887c80a1-498f-4f9c-b8ef-9e727a978415 tempest-ServersTestJSON-675990056 tempest-ServersTestJSON-675990056-project] 10.222.0.13 "GET /compute/v2.1/servers/6e82d040-bcc6-473e-b202-bf13829baf2c" status: 200 len: 1575 microversion: 2.1 time: 0.650692 Nov 01 19:02:58.262060 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1176/2362] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:02:57 2022] GET /compute/v2.1/servers/6e82d040-bcc6-473e-b202-bf13829baf2c => generated 1575 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:02:58.267365 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-4749f878-ec57-44c6-b15b-55a967f7c20f tempest-LiveMigrationNegativeTest-570155948 tempest-LiveMigrationNegativeTest-570155948-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:02:58.267981 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-4749f878-ec57-44c6-b15b-55a967f7c20f tempest-LiveMigrationNegativeTest-570155948 tempest-LiveMigrationNegativeTest-570155948-project] [instance: c4f1d50d-c833-4efe-9a6b-15064fbf5b58] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:02:58.279013 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-4749f878-ec57-44c6-b15b-55a967f7c20f tempest-LiveMigrationNegativeTest-570155948 tempest-LiveMigrationNegativeTest-570155948-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:58.280113 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-4749f878-ec57-44c6-b15b-55a967f7c20f tempest-LiveMigrationNegativeTest-570155948 tempest-LiveMigrationNegativeTest-570155948-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:58.280558 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-4749f878-ec57-44c6-b15b-55a967f7c20f tempest-LiveMigrationNegativeTest-570155948 tempest-LiveMigrationNegativeTest-570155948-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:58.281350 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-4749f878-ec57-44c6-b15b-55a967f7c20f tempest-LiveMigrationNegativeTest-570155948 tempest-LiveMigrationNegativeTest-570155948-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:58.281742 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-4749f878-ec57-44c6-b15b-55a967f7c20f tempest-LiveMigrationNegativeTest-570155948 tempest-LiveMigrationNegativeTest-570155948-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:58.282593 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-4749f878-ec57-44c6-b15b-55a967f7c20f tempest-LiveMigrationNegativeTest-570155948 tempest-LiveMigrationNegativeTest-570155948-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:58.290449 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-bd287479-34d2-49ed-b89e-a49e94dd4cdb tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52acef7992d64d378fd8ac333887fd0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af51b8733e984c2ca87df2d8163dedf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:02:58.300122 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-bd287479-34d2-49ed-b89e-a49e94dd4cdb tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] 10.222.0.13 "GET /compute/v2.1/servers/4b9fb909-26f7-40af-bac5-e7d2a6b9fb77" status: 200 len: 1652 microversion: 2.1 time: 0.521965 Nov 01 19:02:58.305920 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1187/2363] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:02:57 2022] GET /compute/v2.1/servers/4b9fb909-26f7-40af-bac5-e7d2a6b9fb77 => generated 1652 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:02:58.311642 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [req-c9da3bab-a89a-46fe-9482-f53b7e605bbc req-4119c31e-7b9d-46ba-8225-551d136186bc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b9fb909-26f7-40af-bac5-e7d2a6b9fb77", "name": "network-vif-unplugged", "status": "completed", "tag": "ccb0a9e2-46d4-4870-a9da-883c13baeb71"}]} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:02:58.340216 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-c9da3bab-a89a-46fe-9482-f53b7e605bbc req-4119c31e-7b9d-46ba-8225-551d136186bc service nova] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:58.341022 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-c9da3bab-a89a-46fe-9482-f53b7e605bbc req-4119c31e-7b9d-46ba-8225-551d136186bc service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:58.341606 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-c9da3bab-a89a-46fe-9482-f53b7e605bbc req-4119c31e-7b9d-46ba-8225-551d136186bc service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:58.358659 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.compute.server_external_events [req-c9da3bab-a89a-46fe-9482-f53b7e605bbc req-4119c31e-7b9d-46ba-8225-551d136186bc service nova] Creating event network-vif-unplugged:ccb0a9e2-46d4-4870-a9da-883c13baeb71 for instance 4b9fb909-26f7-40af-bac5-e7d2a6b9fb77 on n-h1-863052-2 Nov 01 19:02:58.365702 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [req-c9da3bab-a89a-46fe-9482-f53b7e605bbc req-4119c31e-7b9d-46ba-8225-551d136186bc service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.058279 Nov 01 19:02:58.366869 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1188/2364] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Nov 1 19:02:58 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:02:58.374266 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-e4ea87f4-7419-4ea5-ad1c-0f0be210bc86 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:02:58.377352 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-e4ea87f4-7419-4ea5-ad1c-0f0be210bc86 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] [instance: 90b353ab-ef97-4d88-b5bc-b355ff576225] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:02:58.384985 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-e4ea87f4-7419-4ea5-ad1c-0f0be210bc86 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:58.385700 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-e4ea87f4-7419-4ea5-ad1c-0f0be210bc86 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:58.386352 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-e4ea87f4-7419-4ea5-ad1c-0f0be210bc86 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:58.387248 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-e4ea87f4-7419-4ea5-ad1c-0f0be210bc86 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:58.404169 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-e4ea87f4-7419-4ea5-ad1c-0f0be210bc86 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:58.404967 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-e4ea87f4-7419-4ea5-ad1c-0f0be210bc86 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:58.466959 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-e4ea87f4-7419-4ea5-ad1c-0f0be210bc86 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] 10.222.0.13 "GET /compute/v2.1/servers/90b353ab-ef97-4d88-b5bc-b355ff576225/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.096901 Nov 01 19:02:58.468759 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1189/2365] 10.222.0.13 () {58 vars in 1302 bytes} [Tue Nov 1 19:02:58 2022] GET /compute/v2.1/servers/90b353ab-ef97-4d88-b5bc-b355ff576225/os-volume_attachments => generated 197 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:02:58.483405 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-1f359169-c53f-4c57-ae98-0c206d8eb343 tempest-ServersTestJSON-675990056 tempest-ServersTestJSON-675990056-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:02:58.501508 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-1f359169-c53f-4c57-ae98-0c206d8eb343 tempest-ServersTestJSON-675990056 tempest-ServersTestJSON-675990056-project] [instance: 6e82d040-bcc6-473e-b202-bf13829baf2c] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:02:58.515703 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-1f359169-c53f-4c57-ae98-0c206d8eb343 tempest-ServersTestJSON-675990056 tempest-ServersTestJSON-675990056-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:58.517421 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-1f359169-c53f-4c57-ae98-0c206d8eb343 tempest-ServersTestJSON-675990056 tempest-ServersTestJSON-675990056-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:58.517889 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-1f359169-c53f-4c57-ae98-0c206d8eb343 tempest-ServersTestJSON-675990056 tempest-ServersTestJSON-675990056-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:58.519809 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-1f359169-c53f-4c57-ae98-0c206d8eb343 tempest-ServersTestJSON-675990056 tempest-ServersTestJSON-675990056-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:58.521192 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-1f359169-c53f-4c57-ae98-0c206d8eb343 tempest-ServersTestJSON-675990056 tempest-ServersTestJSON-675990056-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:58.522531 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-1f359169-c53f-4c57-ae98-0c206d8eb343 tempest-ServersTestJSON-675990056 tempest-ServersTestJSON-675990056-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:58.791700 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-1f359169-c53f-4c57-ae98-0c206d8eb343 tempest-ServersTestJSON-675990056 tempest-ServersTestJSON-675990056-project] 10.222.0.13 "GET /compute/v2.1/servers/6e82d040-bcc6-473e-b202-bf13829baf2c/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.321658 Nov 01 19:02:58.792297 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1190/2366] 10.222.0.13 () {58 vars in 1275 bytes} [Tue Nov 1 19:02:58 2022] GET /compute/v2.1/servers/6e82d040-bcc6-473e-b202-bf13829baf2c/os-interface => generated 285 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:02:58.807015 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [req-ad30ac74-27d6-42d9-8d73-89cea6ee3b77 req-56c37941-b8d9-49da-9003-376b41da612d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b9fb909-26f7-40af-bac5-e7d2a6b9fb77", "name": "network-vif-deleted", "tag": "e5db1a83-8c2c-45e5-8a96-25ed895f1996"}]} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:02:58.832251 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-ad30ac74-27d6-42d9-8d73-89cea6ee3b77 req-56c37941-b8d9-49da-9003-376b41da612d service nova] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:58.834922 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-ad30ac74-27d6-42d9-8d73-89cea6ee3b77 req-56c37941-b8d9-49da-9003-376b41da612d service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:58.838243 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-ad30ac74-27d6-42d9-8d73-89cea6ee3b77 req-56c37941-b8d9-49da-9003-376b41da612d service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:58.885359 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.compute.server_external_events [req-ad30ac74-27d6-42d9-8d73-89cea6ee3b77 req-56c37941-b8d9-49da-9003-376b41da612d service nova] Creating event network-vif-deleted:e5db1a83-8c2c-45e5-8a96-25ed895f1996 for instance 4b9fb909-26f7-40af-bac5-e7d2a6b9fb77 on n-h1-863052-2 Nov 01 19:02:58.893889 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [req-ad30ac74-27d6-42d9-8d73-89cea6ee3b77 req-56c37941-b8d9-49da-9003-376b41da612d service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092142 Nov 01 19:02:58.897755 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1191/2367] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Nov 1 19:02:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:02:58.911749 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-d4210969-0b44-4496-9a99-2315fcf0e0a0 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:02:58.913148 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-d4210969-0b44-4496-9a99-2315fcf0e0a0 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] [instance: 992f5ec5-d256-4870-b16d-fc8d9adbd3e7] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:02:58.932844 n-d-863052-2 devstack@n-api.service[121403]: DEBUG dbcounter [-] [121403] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=121403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 19:02:58.935258 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d4210969-0b44-4496-9a99-2315fcf0e0a0 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:58.936032 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d4210969-0b44-4496-9a99-2315fcf0e0a0 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:58.936977 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d4210969-0b44-4496-9a99-2315fcf0e0a0 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:58.938300 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d4210969-0b44-4496-9a99-2315fcf0e0a0 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:58.939405 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d4210969-0b44-4496-9a99-2315fcf0e0a0 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:58.940264 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d4210969-0b44-4496-9a99-2315fcf0e0a0 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:59.377980 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-4749f878-ec57-44c6-b15b-55a967f7c20f tempest-LiveMigrationNegativeTest-570155948 tempest-LiveMigrationNegativeTest-570155948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c14605afbc5445d9763db185a1305d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faa1bc7c9d564b0ebc9ecf0a2994f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:02:59.386832 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-4749f878-ec57-44c6-b15b-55a967f7c20f tempest-LiveMigrationNegativeTest-570155948 tempest-LiveMigrationNegativeTest-570155948-project] 10.222.0.13 "GET /compute/v2.1/servers/c4f1d50d-c833-4efe-9a6b-15064fbf5b58" status: 200 len: 1319 microversion: 2.1 time: 1.126172 Nov 01 19:02:59.393382 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1177/2368] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:02:58 2022] GET /compute/v2.1/servers/c4f1d50d-c833-4efe-9a6b-15064fbf5b58 => generated 1319 bytes in 1137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:02:59.398186 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-9701d372-1e39-4122-9908-8eec3278320e tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:02:59.403191 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-9701d372-1e39-4122-9908-8eec3278320e tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] [instance: 4b9fb909-26f7-40af-bac5-e7d2a6b9fb77] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:02:59.414523 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-9701d372-1e39-4122-9908-8eec3278320e tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:59.417006 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-9701d372-1e39-4122-9908-8eec3278320e tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:59.417539 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-9701d372-1e39-4122-9908-8eec3278320e tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:59.418335 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-9701d372-1e39-4122-9908-8eec3278320e tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:59.418807 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-9701d372-1e39-4122-9908-8eec3278320e tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:59.419231 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-9701d372-1e39-4122-9908-8eec3278320e tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:59.643244 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-d4210969-0b44-4496-9a99-2315fcf0e0a0 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb496b3faac4abbae73d389f2042e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e2520220d454764b8c139a58d78ac83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:02:59.669221 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-d4210969-0b44-4496-9a99-2315fcf0e0a0 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] 10.222.0.13 "GET /compute/v2.1/servers/992f5ec5-d256-4870-b16d-fc8d9adbd3e7" status: 200 len: 1472 microversion: 2.1 time: 0.768799 Nov 01 19:02:59.669221 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1192/2369] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:02:58 2022] GET /compute/v2.1/servers/992f5ec5-d256-4870-b16d-fc8d9adbd3e7 => generated 1472 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:02:59.685545 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-37375612-d5b7-41f4-abff-e6626240756d tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:02:59.688348 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-37375612-d5b7-41f4-abff-e6626240756d tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] [instance: 90b353ab-ef97-4d88-b5bc-b355ff576225] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:02:59.717786 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-37375612-d5b7-41f4-abff-e6626240756d tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:59.726229 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-37375612-d5b7-41f4-abff-e6626240756d tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:59.727452 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-37375612-d5b7-41f4-abff-e6626240756d tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:59.729254 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-37375612-d5b7-41f4-abff-e6626240756d tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:02:59.730738 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-37375612-d5b7-41f4-abff-e6626240756d tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:02:59.732208 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-37375612-d5b7-41f4-abff-e6626240756d tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:02:59.806044 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-37375612-d5b7-41f4-abff-e6626240756d tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] 10.222.0.13 "GET /compute/v2.1/servers/90b353ab-ef97-4d88-b5bc-b355ff576225/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.134252 Nov 01 19:02:59.812990 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1193/2370] 10.222.0.13 () {58 vars in 1302 bytes} [Tue Nov 1 19:02:59 2022] GET /compute/v2.1/servers/90b353ab-ef97-4d88-b5bc-b355ff576225/os-volume_attachments => generated 197 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:02:59.953357 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-9701d372-1e39-4122-9908-8eec3278320e tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52acef7992d64d378fd8ac333887fd0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af51b8733e984c2ca87df2d8163dedf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:02:59.961956 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-9701d372-1e39-4122-9908-8eec3278320e tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] 10.222.0.13 "GET /compute/v2.1/servers/4b9fb909-26f7-40af-bac5-e7d2a6b9fb77" status: 200 len: 1652 microversion: 2.1 time: 0.567406 Nov 01 19:02:59.962545 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1178/2371] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:02:59 2022] GET /compute/v2.1/servers/4b9fb909-26f7-40af-bac5-e7d2a6b9fb77 => generated 1652 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:03:00.427402 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-c152615c-eaf0-4fa4-a7bd-f86e54d20368 tempest-LiveMigrationNegativeTest-570155948 tempest-LiveMigrationNegativeTest-570155948-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:03:00.428770 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-c152615c-eaf0-4fa4-a7bd-f86e54d20368 tempest-LiveMigrationNegativeTest-570155948 tempest-LiveMigrationNegativeTest-570155948-project] [instance: c4f1d50d-c833-4efe-9a6b-15064fbf5b58] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:03:00.453922 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-c152615c-eaf0-4fa4-a7bd-f86e54d20368 tempest-LiveMigrationNegativeTest-570155948 tempest-LiveMigrationNegativeTest-570155948-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:03:00.469006 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-c152615c-eaf0-4fa4-a7bd-f86e54d20368 tempest-LiveMigrationNegativeTest-570155948 tempest-LiveMigrationNegativeTest-570155948-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:03:00.469665 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-c152615c-eaf0-4fa4-a7bd-f86e54d20368 tempest-LiveMigrationNegativeTest-570155948 tempest-LiveMigrationNegativeTest-570155948-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:03:00.471321 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-c152615c-eaf0-4fa4-a7bd-f86e54d20368 tempest-LiveMigrationNegativeTest-570155948 tempest-LiveMigrationNegativeTest-570155948-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:03:00.473405 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-c152615c-eaf0-4fa4-a7bd-f86e54d20368 tempest-LiveMigrationNegativeTest-570155948 tempest-LiveMigrationNegativeTest-570155948-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:03:00.474029 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-c152615c-eaf0-4fa4-a7bd-f86e54d20368 tempest-LiveMigrationNegativeTest-570155948 tempest-LiveMigrationNegativeTest-570155948-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:03:00.564463 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [req-b99c9526-57db-4eb2-b8bd-a4e7967538ea req-04422248-4c84-4646-ab10-f2df8afdcb97 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c4f1d50d-c833-4efe-9a6b-15064fbf5b58", "tag": "a0c4450f-3a0d-4ab5-ae2d-70ce39e68852"}]} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:03:00.597067 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-b99c9526-57db-4eb2-b8bd-a4e7967538ea req-04422248-4c84-4646-ab10-f2df8afdcb97 service nova] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:03:00.598455 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-b99c9526-57db-4eb2-b8bd-a4e7967538ea req-04422248-4c84-4646-ab10-f2df8afdcb97 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:03:00.599067 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-b99c9526-57db-4eb2-b8bd-a4e7967538ea req-04422248-4c84-4646-ab10-f2df8afdcb97 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:03:00.614934 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.compute.server_external_events [req-b99c9526-57db-4eb2-b8bd-a4e7967538ea req-04422248-4c84-4646-ab10-f2df8afdcb97 service nova] Creating event network-changed:a0c4450f-3a0d-4ab5-ae2d-70ce39e68852 for instance c4f1d50d-c833-4efe-9a6b-15064fbf5b58 on n-h2-863052-2 Nov 01 19:03:00.621356 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [req-b99c9526-57db-4eb2-b8bd-a4e7967538ea req-04422248-4c84-4646-ab10-f2df8afdcb97 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073736 Nov 01 19:03:00.625299 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1179/2372] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Nov 1 19:03:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:03:00.693389 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-562708ae-0483-4d53-ae71-bc12762a5137 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:03:00.694422 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-562708ae-0483-4d53-ae71-bc12762a5137 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] [instance: 992f5ec5-d256-4870-b16d-fc8d9adbd3e7] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:03:00.706727 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-562708ae-0483-4d53-ae71-bc12762a5137 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:03:00.707513 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-562708ae-0483-4d53-ae71-bc12762a5137 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:03:00.709050 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-562708ae-0483-4d53-ae71-bc12762a5137 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:03:00.710220 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-562708ae-0483-4d53-ae71-bc12762a5137 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:03:00.710955 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-562708ae-0483-4d53-ae71-bc12762a5137 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:03:00.711891 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-562708ae-0483-4d53-ae71-bc12762a5137 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:03:01.080932 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-562708ae-0483-4d53-ae71-bc12762a5137 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb496b3faac4abbae73d389f2042e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e2520220d454764b8c139a58d78ac83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:03:01.083579 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-c152615c-eaf0-4fa4-a7bd-f86e54d20368 tempest-LiveMigrationNegativeTest-570155948 tempest-LiveMigrationNegativeTest-570155948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c14605afbc5445d9763db185a1305d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faa1bc7c9d564b0ebc9ecf0a2994f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:03:01.095511 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-c152615c-eaf0-4fa4-a7bd-f86e54d20368 tempest-LiveMigrationNegativeTest-570155948 tempest-LiveMigrationNegativeTest-570155948-project] 10.222.0.13 "GET /compute/v2.1/servers/c4f1d50d-c833-4efe-9a6b-15064fbf5b58" status: 200 len: 1319 microversion: 2.1 time: 0.679116 Nov 01 19:03:01.109585 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-562708ae-0483-4d53-ae71-bc12762a5137 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] 10.222.0.13 "GET /compute/v2.1/servers/992f5ec5-d256-4870-b16d-fc8d9adbd3e7" status: 200 len: 1478 microversion: 2.1 time: 0.406538 Nov 01 19:03:01.109585 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1180/2373] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:03:00 2022] GET /compute/v2.1/servers/992f5ec5-d256-4870-b16d-fc8d9adbd3e7 => generated 1478 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 19:03:01.118645 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-375908d3-4f21-456c-bfd7-364bfd4cd6f7 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:03:01.132260 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-375908d3-4f21-456c-bfd7-364bfd4cd6f7 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] [instance: 90b353ab-ef97-4d88-b5bc-b355ff576225] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:03:01.133857 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1194/2374] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:03:00 2022] GET /compute/v2.1/servers/c4f1d50d-c833-4efe-9a6b-15064fbf5b58 => generated 1319 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:03:01.139371 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-375908d3-4f21-456c-bfd7-364bfd4cd6f7 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:03:01.140041 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-375908d3-4f21-456c-bfd7-364bfd4cd6f7 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:03:01.140309 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-818c5cd7-50cf-4e01-a999-8348c63b7640 tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:03:01.140481 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-375908d3-4f21-456c-bfd7-364bfd4cd6f7 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:03:01.141268 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-375908d3-4f21-456c-bfd7-364bfd4cd6f7 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:03:01.141722 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-375908d3-4f21-456c-bfd7-364bfd4cd6f7 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:03:01.142824 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-818c5cd7-50cf-4e01-a999-8348c63b7640 tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] [instance: 4b9fb909-26f7-40af-bac5-e7d2a6b9fb77] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:03:01.145494 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-375908d3-4f21-456c-bfd7-364bfd4cd6f7 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:03:01.150445 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-818c5cd7-50cf-4e01-a999-8348c63b7640 tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:03:01.151836 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-818c5cd7-50cf-4e01-a999-8348c63b7640 tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:03:01.152507 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-818c5cd7-50cf-4e01-a999-8348c63b7640 tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:03:01.153457 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-818c5cd7-50cf-4e01-a999-8348c63b7640 tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:03:01.154170 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-818c5cd7-50cf-4e01-a999-8348c63b7640 tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:03:01.154911 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-818c5cd7-50cf-4e01-a999-8348c63b7640 tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:03:01.198524 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-818c5cd7-50cf-4e01-a999-8348c63b7640 tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:03:01.199595 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-818c5cd7-50cf-4e01-a999-8348c63b7640 tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:03:01.200312 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-818c5cd7-50cf-4e01-a999-8348c63b7640 tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:03:01.201812 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.objects.instance [None req-818c5cd7-50cf-4e01-a999-8348c63b7640 tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Lazy-loading 'fault' on Instance uuid 4b9fb909-26f7-40af-bac5-e7d2a6b9fb77 {{(pid=121403) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 01 19:03:01.220019 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-375908d3-4f21-456c-bfd7-364bfd4cd6f7 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] 10.222.0.13 "GET /compute/v2.1/servers/90b353ab-ef97-4d88-b5bc-b355ff576225/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.118514 Nov 01 19:03:01.225812 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1181/2375] 10.222.0.13 () {58 vars in 1302 bytes} [Tue Nov 1 19:03:01 2022] GET /compute/v2.1/servers/90b353ab-ef97-4d88-b5bc-b355ff576225/os-volume_attachments => generated 197 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:03:01.244471 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [req-b4101a4c-63c7-49cb-9475-4bece23b506a req-1031cbb0-110f-4057-b5ad-da658971f5f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b9fb909-26f7-40af-bac5-e7d2a6b9fb77", "name": "network-vif-deleted", "tag": "ccb0a9e2-46d4-4870-a9da-883c13baeb71"}]} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:03:01.268094 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-b4101a4c-63c7-49cb-9475-4bece23b506a req-1031cbb0-110f-4057-b5ad-da658971f5f6 service nova] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:03:01.268632 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-b4101a4c-63c7-49cb-9475-4bece23b506a req-1031cbb0-110f-4057-b5ad-da658971f5f6 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:03:01.272439 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-b4101a4c-63c7-49cb-9475-4bece23b506a req-1031cbb0-110f-4057-b5ad-da658971f5f6 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:03:01.293318 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.compute.server_external_events [req-b4101a4c-63c7-49cb-9475-4bece23b506a req-1031cbb0-110f-4057-b5ad-da658971f5f6 service nova] Creating event network-vif-deleted:ccb0a9e2-46d4-4870-a9da-883c13baeb71 for instance 4b9fb909-26f7-40af-bac5-e7d2a6b9fb77 on n-h1-863052-2 Nov 01 19:03:01.303448 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [req-b4101a4c-63c7-49cb-9475-4bece23b506a req-1031cbb0-110f-4057-b5ad-da658971f5f6 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076185 Nov 01 19:03:01.304711 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1182/2376] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Nov 1 19:03:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:03:01.312906 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-0087c938-ea38-4444-87f3-23d1d4f73880 tempest-ServersTestJSON-675990056 tempest-ServersTestJSON-675990056-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:03:01.313953 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-0087c938-ea38-4444-87f3-23d1d4f73880 tempest-ServersTestJSON-675990056 tempest-ServersTestJSON-675990056-project] [instance: 6e82d040-bcc6-473e-b202-bf13829baf2c] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:03:01.321602 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-0087c938-ea38-4444-87f3-23d1d4f73880 tempest-ServersTestJSON-675990056 tempest-ServersTestJSON-675990056-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:03:01.322468 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-0087c938-ea38-4444-87f3-23d1d4f73880 tempest-ServersTestJSON-675990056 tempest-ServersTestJSON-675990056-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:03:01.323176 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-0087c938-ea38-4444-87f3-23d1d4f73880 tempest-ServersTestJSON-675990056 tempest-ServersTestJSON-675990056-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:03:01.324170 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-0087c938-ea38-4444-87f3-23d1d4f73880 tempest-ServersTestJSON-675990056 tempest-ServersTestJSON-675990056-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:03:01.324936 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-0087c938-ea38-4444-87f3-23d1d4f73880 tempest-ServersTestJSON-675990056 tempest-ServersTestJSON-675990056-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:03:01.325621 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-0087c938-ea38-4444-87f3-23d1d4f73880 tempest-ServersTestJSON-675990056 tempest-ServersTestJSON-675990056-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:03:01.419156 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-818c5cd7-50cf-4e01-a999-8348c63b7640 tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52acef7992d64d378fd8ac333887fd0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af51b8733e984c2ca87df2d8163dedf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:03:01.428089 n-d-863052-2 devstack@n-api.service[121403]: DEBUG dbcounter [-] [121403] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=121403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 19:03:01.444476 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-818c5cd7-50cf-4e01-a999-8348c63b7640 tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] 10.222.0.13 "GET /compute/v2.1/servers/4b9fb909-26f7-40af-bac5-e7d2a6b9fb77" status: 200 len: 1302 microversion: 2.1 time: 0.309116 Nov 01 19:03:01.445409 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1195/2377] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:03:01 2022] GET /compute/v2.1/servers/4b9fb909-26f7-40af-bac5-e7d2a6b9fb77 => generated 1302 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:03:01.482999 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-0087c938-ea38-4444-87f3-23d1d4f73880 tempest-ServersTestJSON-675990056 tempest-ServersTestJSON-675990056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71d26d92020b4d4aab9f82d174e1ba9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3dd3fba10d740c9bc38b10dca3007aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:03:01.492314 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-0087c938-ea38-4444-87f3-23d1d4f73880 tempest-ServersTestJSON-675990056 tempest-ServersTestJSON-675990056-project] 10.222.0.13 "GET /compute/v2.1/servers/6e82d040-bcc6-473e-b202-bf13829baf2c" status: 200 len: 1575 microversion: 2.1 time: 0.186055 Nov 01 19:03:01.493508 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1183/2378] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:03:01 2022] GET /compute/v2.1/servers/6e82d040-bcc6-473e-b202-bf13829baf2c => generated 1575 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:03:02.133200 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-510f527e-cfb2-4b11-8f20-a445080695d8 tempest-LiveMigrationNegativeTest-570155948 tempest-LiveMigrationNegativeTest-570155948-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:03:02.133827 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-510f527e-cfb2-4b11-8f20-a445080695d8 tempest-LiveMigrationNegativeTest-570155948 tempest-LiveMigrationNegativeTest-570155948-project] [instance: c4f1d50d-c833-4efe-9a6b-15064fbf5b58] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:03:02.134846 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-4ef71634-7854-417b-ba09-bca00636b561 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:03:02.135949 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-4ef71634-7854-417b-ba09-bca00636b561 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] [instance: 992f5ec5-d256-4870-b16d-fc8d9adbd3e7] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:03:02.160133 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-510f527e-cfb2-4b11-8f20-a445080695d8 tempest-LiveMigrationNegativeTest-570155948 tempest-LiveMigrationNegativeTest-570155948-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:03:02.161750 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-510f527e-cfb2-4b11-8f20-a445080695d8 tempest-LiveMigrationNegativeTest-570155948 tempest-LiveMigrationNegativeTest-570155948-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:03:02.162202 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-510f527e-cfb2-4b11-8f20-a445080695d8 tempest-LiveMigrationNegativeTest-570155948 tempest-LiveMigrationNegativeTest-570155948-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:03:02.162931 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-510f527e-cfb2-4b11-8f20-a445080695d8 tempest-LiveMigrationNegativeTest-570155948 tempest-LiveMigrationNegativeTest-570155948-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:03:02.166842 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-4ef71634-7854-417b-ba09-bca00636b561 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:03:02.167459 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-4ef71634-7854-417b-ba09-bca00636b561 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:03:02.168970 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-4ef71634-7854-417b-ba09-bca00636b561 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:03:02.169734 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-4ef71634-7854-417b-ba09-bca00636b561 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:03:02.170425 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-510f527e-cfb2-4b11-8f20-a445080695d8 tempest-LiveMigrationNegativeTest-570155948 tempest-LiveMigrationNegativeTest-570155948-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:03:02.173391 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-4ef71634-7854-417b-ba09-bca00636b561 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:03:02.173934 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-510f527e-cfb2-4b11-8f20-a445080695d8 tempest-LiveMigrationNegativeTest-570155948 tempest-LiveMigrationNegativeTest-570155948-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:03:02.175301 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-4ef71634-7854-417b-ba09-bca00636b561 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:03:02.576615 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-4ef71634-7854-417b-ba09-bca00636b561 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb496b3faac4abbae73d389f2042e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e2520220d454764b8c139a58d78ac83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:03:02.591397 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-4ef71634-7854-417b-ba09-bca00636b561 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] 10.222.0.13 "GET /compute/v2.1/servers/992f5ec5-d256-4870-b16d-fc8d9adbd3e7" status: 200 len: 1478 microversion: 2.1 time: 0.467642 Nov 01 19:03:02.613530 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1184/2379] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:03:02 2022] GET /compute/v2.1/servers/992f5ec5-d256-4870-b16d-fc8d9adbd3e7 => generated 1478 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:03:02.625732 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-fa7db55c-142f-4ae9-bbe2-9029a770d423 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:03:02.631959 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-fa7db55c-142f-4ae9-bbe2-9029a770d423 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] [instance: 90b353ab-ef97-4d88-b5bc-b355ff576225] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:03:02.642618 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-fa7db55c-142f-4ae9-bbe2-9029a770d423 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:03:02.643542 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-fa7db55c-142f-4ae9-bbe2-9029a770d423 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:03:02.644148 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-fa7db55c-142f-4ae9-bbe2-9029a770d423 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:03:02.645404 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-fa7db55c-142f-4ae9-bbe2-9029a770d423 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:03:02.646023 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-fa7db55c-142f-4ae9-bbe2-9029a770d423 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:03:02.647999 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-fa7db55c-142f-4ae9-bbe2-9029a770d423 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:03:02.701240 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-fa7db55c-142f-4ae9-bbe2-9029a770d423 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] 10.222.0.13 "GET /compute/v2.1/servers/90b353ab-ef97-4d88-b5bc-b355ff576225/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.085104 Nov 01 19:03:02.703066 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1185/2380] 10.222.0.13 () {58 vars in 1302 bytes} [Tue Nov 1 19:03:02 2022] GET /compute/v2.1/servers/90b353ab-ef97-4d88-b5bc-b355ff576225/os-volume_attachments => generated 197 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:03:02.710622 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-e97e535e-6ba1-4f92-8133-38e6fc367255 tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:03:02.717499 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-e97e535e-6ba1-4f92-8133-38e6fc367255 tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] [instance: 4b9fb909-26f7-40af-bac5-e7d2a6b9fb77] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:03:02.730153 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e97e535e-6ba1-4f92-8133-38e6fc367255 tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:03:02.730883 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e97e535e-6ba1-4f92-8133-38e6fc367255 tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:03:02.731478 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e97e535e-6ba1-4f92-8133-38e6fc367255 tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:03:02.733136 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e97e535e-6ba1-4f92-8133-38e6fc367255 tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:03:02.733788 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e97e535e-6ba1-4f92-8133-38e6fc367255 tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:03:02.734427 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e97e535e-6ba1-4f92-8133-38e6fc367255 tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:03:02.760503 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.wsgi [None req-e97e535e-6ba1-4f92-8133-38e6fc367255 tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] HTTP exception thrown: Instance 4b9fb909-26f7-40af-bac5-e7d2a6b9fb77 could not be found. Nov 01 19:03:02.765349 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-e97e535e-6ba1-4f92-8133-38e6fc367255 tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Request method failure captured: Nov 01 19:03:02.765349 n-d-863052-2 devstack@n-api.service[121402]: request: GET /compute/v2.1/servers/4b9fb909-26f7-40af-bac5-e7d2a6b9fb77 HTTP/1.1 Nov 01 19:03:02.765349 n-d-863052-2 devstack@n-api.service[121402]: Accept: application/json Nov 01 19:03:02.765349 n-d-863052-2 devstack@n-api.service[121402]: Accept-Encoding: identity Nov 01 19:03:02.765349 n-d-863052-2 devstack@n-api.service[121402]: Connection: close Nov 01 19:03:02.765349 n-d-863052-2 devstack@n-api.service[121402]: Content-Length: 0 Nov 01 19:03:02.765349 n-d-863052-2 devstack@n-api.service[121402]: Content-Type: application/json Nov 01 19:03:02.765349 n-d-863052-2 devstack@n-api.service[121402]: Host: 10.222.0.13 Nov 01 19:03:02.765349 n-d-863052-2 devstack@n-api.service[121402]: Openstack-System-Scope: None Nov 01 19:03:02.765349 n-d-863052-2 devstack@n-api.service[121402]: User-Agent: python-urllib3/1.26.12 Nov 01 19:03:02.765349 n-d-863052-2 devstack@n-api.service[121402]: X-Auth-Token: gAAAAABjYW0ddbnkYhOv8dLUJr-s5oH-dqF8JRJhXex73L-70UBvGh-wlHGeiVgebbsv3kTSqtfLslhVEpqMdlQQA96JiyxVJnEafUgqXH5jyE8gVjuXRsGq0rdb8we_rfE2pVa3h17Ja5Q5u3LZ-1m6KGdglxKoD8H2n0P3G62fb2rWNjcrlYs Nov 01 19:03:02.765349 n-d-863052-2 devstack@n-api.service[121402]: X-Domain-Id: None Nov 01 19:03:02.765349 n-d-863052-2 devstack@n-api.service[121402]: X-Domain-Name: None Nov 01 19:03:02.765349 n-d-863052-2 devstack@n-api.service[121402]: X-Identity-Status: Confirmed Nov 01 19:03:02.765349 n-d-863052-2 devstack@n-api.service[121402]: X-Is-Admin-Project: True Nov 01 19:03:02.765349 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Domain-Id: default Nov 01 19:03:02.765349 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Domain-Name: Default Nov 01 19:03:02.765349 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Id: af51b8733e984c2ca87df2d8163dedf9 Nov 01 19:03:02.765349 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Name: tempest-ServersTestMultiNic-330497003 Nov 01 19:03:02.765349 n-d-863052-2 devstack@n-api.service[121402]: X-Role: member,reader Nov 01 19:03:02.765349 n-d-863052-2 devstack@n-api.service[121402]: X-Roles: member,reader Nov 01 19:03:02.765349 n-d-863052-2 devstack@n-api.service[121402]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/af51b8733e984c2ca87df2d8163dedf9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/af51b8733e984c2ca87df2d8163dedf9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_af51b8733e984c2ca87df2d8163dedf9", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/af51b8733e984c2ca87df2d8163dedf9"}]}] Nov 01 19:03:02.765349 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant: tempest-ServersTestMultiNic-330497003 Nov 01 19:03:02.765349 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant-Id: af51b8733e984c2ca87df2d8163dedf9 Nov 01 19:03:02.765349 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant-Name: tempest-ServersTestMultiNic-330497003 Nov 01 19:03:02.765349 n-d-863052-2 devstack@n-api.service[121402]: X-User: tempest-ServersTestMultiNic-330497003-project Nov 01 19:03:02.765349 n-d-863052-2 devstack@n-api.service[121402]: X-User-Domain-Id: default Nov 01 19:03:02.765349 n-d-863052-2 devstack@n-api.service[121402]: X-User-Domain-Name: Default Nov 01 19:03:02.765349 n-d-863052-2 devstack@n-api.service[121402]: X-User-Id: 52acef7992d64d378fd8ac333887fd0e Nov 01 19:03:02.765349 n-d-863052-2 devstack@n-api.service[121402]: X-User-Name: tempest-ServersTestMultiNic-330497003-project Nov 01 19:03:02.765349 n-d-863052-2 devstack@n-api.service[121402]: method: > Nov 01 19:03:02.765349 n-d-863052-2 devstack@n-api.service[121402]: exception: Instance 4b9fb909-26f7-40af-bac5-e7d2a6b9fb77 could not be found. Nov 01 19:03:02.765349 n-d-863052-2 devstack@n-api.service[121402]: action_args: {'id': '4b9fb909-26f7-40af-bac5-e7d2a6b9fb77'} Nov 01 19:03:02.765349 n-d-863052-2 devstack@n-api.service[121402]: {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 01 19:03:02.765349 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:03:02.765349 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 01 19:03:02.765349 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 01 19:03:02.765349 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 01 19:03:02.765349 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 01 19:03:02.765349 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 01 19:03:02.765349 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 01 19:03:02.765349 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 01 19:03:02.765349 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 01 19:03:02.765349 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4b9fb909-26f7-40af-bac5-e7d2a6b9fb77 could not be found. Nov 01 19:03:02.765349 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:03:02.765349 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:03:02.765349 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:03:02.765349 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:03:02.765349 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:03:02.765349 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:03:02.765349 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 01 19:03:02.765349 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 01 19:03:02.765349 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 01 19:03:02.765349 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 01 19:03:02.765349 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 01 19:03:02.765349 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 01 19:03:02.765349 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 01 19:03:02.765349 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 01 19:03:02.765349 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 01 19:03:02.765349 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 01 19:03:02.765349 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4b9fb909-26f7-40af-bac5-e7d2a6b9fb77 could not be found. Nov 01 19:03:02.765349 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:03:02.765349 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:03:02.765349 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:03:02.770350 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:03:02.770350 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:03:02.770350 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:03:02.770350 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 01 19:03:02.770350 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 01 19:03:02.770350 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4b9fb909-26f7-40af-bac5-e7d2a6b9fb77 could not be found. Nov 01 19:03:02.770350 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:03:02.771885 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-e97e535e-6ba1-4f92-8133-38e6fc367255 tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Returning 404 to user: Instance 4b9fb909-26f7-40af-bac5-e7d2a6b9fb77 could not be found. {{(pid=121402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 01 19:03:02.773011 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-e97e535e-6ba1-4f92-8133-38e6fc367255 tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] 10.222.0.13 "GET /compute/v2.1/servers/4b9fb909-26f7-40af-bac5-e7d2a6b9fb77" status: 404 len: 111 microversion: 2.1 time: 0.068696 Nov 01 19:03:02.774725 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1186/2381] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:03:02 2022] GET /compute/v2.1/servers/4b9fb909-26f7-40af-bac5-e7d2a6b9fb77 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 01 19:03:03.086800 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-510f527e-cfb2-4b11-8f20-a445080695d8 tempest-LiveMigrationNegativeTest-570155948 tempest-LiveMigrationNegativeTest-570155948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c14605afbc5445d9763db185a1305d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faa1bc7c9d564b0ebc9ecf0a2994f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:03:03.099269 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-510f527e-cfb2-4b11-8f20-a445080695d8 tempest-LiveMigrationNegativeTest-570155948 tempest-LiveMigrationNegativeTest-570155948-project] 10.222.0.13 "GET /compute/v2.1/servers/c4f1d50d-c833-4efe-9a6b-15064fbf5b58" status: 200 len: 1319 microversion: 2.1 time: 0.974671 Nov 01 19:03:03.100206 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1196/2382] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:03:02 2022] GET /compute/v2.1/servers/c4f1d50d-c833-4efe-9a6b-15064fbf5b58 => generated 1319 bytes in 979 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:03:03.358277 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [req-e47b8029-7dca-47f6-9e32-3cf0b1aead47 req-44726f6b-7108-4b4f-879c-ecf9d9aa453b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6e82d040-bcc6-473e-b202-bf13829baf2c", "tag": "41d8c6fe-f524-41af-9f6e-4b23fdeb1e57"}]} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:03:03.393506 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-e47b8029-7dca-47f6-9e32-3cf0b1aead47 req-44726f6b-7108-4b4f-879c-ecf9d9aa453b service nova] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:03:03.394627 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-e47b8029-7dca-47f6-9e32-3cf0b1aead47 req-44726f6b-7108-4b4f-879c-ecf9d9aa453b service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:03:03.406928 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-e47b8029-7dca-47f6-9e32-3cf0b1aead47 req-44726f6b-7108-4b4f-879c-ecf9d9aa453b service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:03:03.439159 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.compute.server_external_events [req-e47b8029-7dca-47f6-9e32-3cf0b1aead47 req-44726f6b-7108-4b4f-879c-ecf9d9aa453b service nova] Creating event network-changed:41d8c6fe-f524-41af-9f6e-4b23fdeb1e57 for instance 6e82d040-bcc6-473e-b202-bf13829baf2c on n-h2-863052-2 Nov 01 19:03:03.449148 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [req-e47b8029-7dca-47f6-9e32-3cf0b1aead47 req-44726f6b-7108-4b4f-879c-ecf9d9aa453b service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.126424 Nov 01 19:03:03.450775 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1187/2383] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Nov 1 19:03:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:03:03.621333 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-3ce1e86f-9c14-4073-9cda-d65dab47e93b tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:03:03.622155 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-3ce1e86f-9c14-4073-9cda-d65dab47e93b tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] [instance: 992f5ec5-d256-4870-b16d-fc8d9adbd3e7] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:03:03.624447 n-d-863052-2 devstack@n-api.service[121403]: DEBUG dbcounter [-] [121403] Writing DB stats nova_cell0:SELECT=14 {{(pid=121403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 19:03:03.648231 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-3ce1e86f-9c14-4073-9cda-d65dab47e93b tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:03:03.648760 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-3ce1e86f-9c14-4073-9cda-d65dab47e93b tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:03:03.649207 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-3ce1e86f-9c14-4073-9cda-d65dab47e93b tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:03:03.650122 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-3ce1e86f-9c14-4073-9cda-d65dab47e93b tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:03:03.650743 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-3ce1e86f-9c14-4073-9cda-d65dab47e93b tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:03:03.651174 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-3ce1e86f-9c14-4073-9cda-d65dab47e93b tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:03:03.656172 n-d-863052-2 devstack@n-api.service[121403]: DEBUG dbcounter [-] [121403] Writing DB stats nova_cell0:SELECT=22 {{(pid=121403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 19:03:03.715168 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-caa19c0f-e637-4a8c-8122-c663611a21b4 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:03:03.718497 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-caa19c0f-e637-4a8c-8122-c663611a21b4 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] [instance: 90b353ab-ef97-4d88-b5bc-b355ff576225] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:03:03.734079 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-caa19c0f-e637-4a8c-8122-c663611a21b4 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:03:03.735911 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-caa19c0f-e637-4a8c-8122-c663611a21b4 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:03:03.737954 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-caa19c0f-e637-4a8c-8122-c663611a21b4 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:03:03.739393 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-caa19c0f-e637-4a8c-8122-c663611a21b4 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:03:03.743912 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-caa19c0f-e637-4a8c-8122-c663611a21b4 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:03:03.744622 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-caa19c0f-e637-4a8c-8122-c663611a21b4 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:03:03.831393 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-caa19c0f-e637-4a8c-8122-c663611a21b4 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] 10.222.0.13 "GET /compute/v2.1/servers/90b353ab-ef97-4d88-b5bc-b355ff576225/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.120896 Nov 01 19:03:03.833871 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1188/2384] 10.222.0.13 () {58 vars in 1302 bytes} [Tue Nov 1 19:03:03 2022] GET /compute/v2.1/servers/90b353ab-ef97-4d88-b5bc-b355ff576225/os-volume_attachments => generated 25 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Nov 01 19:03:03.927509 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-4f80c989-85c5-40ad-ba59-0083eea80709 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:03:03.930600 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-4f80c989-85c5-40ad-ba59-0083eea80709 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] [instance: 869ca597-f199-474f-a680-59b0a75512c7] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:03:03.942664 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-4f80c989-85c5-40ad-ba59-0083eea80709 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:03:03.949870 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-4f80c989-85c5-40ad-ba59-0083eea80709 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:03:03.952749 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-4f80c989-85c5-40ad-ba59-0083eea80709 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:03:03.954666 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-4f80c989-85c5-40ad-ba59-0083eea80709 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:03:03.955824 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-4f80c989-85c5-40ad-ba59-0083eea80709 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:03:03.956700 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-4f80c989-85c5-40ad-ba59-0083eea80709 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:03:03.997082 n-d-863052-2 devstack@n-api.service[121402]: DEBUG dbcounter [-] [121402] Writing DB stats nova_cell1:SELECT=100 {{(pid=121402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 19:03:04.010113 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.wsgi [None req-4f80c989-85c5-40ad-ba59-0083eea80709 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] HTTP exception thrown: Cannot 'reboot' instance 869ca597-f199-474f-a680-59b0a75512c7 while it is in vm_state rescued Nov 01 19:03:04.012434 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-4f80c989-85c5-40ad-ba59-0083eea80709 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Request method failure captured: Nov 01 19:03:04.012434 n-d-863052-2 devstack@n-api.service[121402]: request: POST /compute/v2.1/servers/869ca597-f199-474f-a680-59b0a75512c7/action HTTP/1.1 Nov 01 19:03:04.012434 n-d-863052-2 devstack@n-api.service[121402]: Accept: application/json Nov 01 19:03:04.012434 n-d-863052-2 devstack@n-api.service[121402]: Accept-Encoding: identity Nov 01 19:03:04.012434 n-d-863052-2 devstack@n-api.service[121402]: Connection: close Nov 01 19:03:04.012434 n-d-863052-2 devstack@n-api.service[121402]: Content-Length: 28 Nov 01 19:03:04.012434 n-d-863052-2 devstack@n-api.service[121402]: Content-Type: application/json Nov 01 19:03:04.012434 n-d-863052-2 devstack@n-api.service[121402]: Host: 10.222.0.13 Nov 01 19:03:04.012434 n-d-863052-2 devstack@n-api.service[121402]: Openstack-System-Scope: None Nov 01 19:03:04.012434 n-d-863052-2 devstack@n-api.service[121402]: User-Agent: python-urllib3/1.26.12 Nov 01 19:03:04.012434 n-d-863052-2 devstack@n-api.service[121402]: X-Auth-Token: gAAAAABjYWwgP3kjyQKi9Uf4PP24jmeKCOPNU51FZoHLreZdbFyZPhRW-EeK2Se64f-CjytM5LjMEtkBLCti_PQz0S3BXRBnTu4aanJgpXShIx2i6Yz4YqCrWhQ373B1BFIdgiChyw2k6U5YvJRz35UfhTE-zhCjFxCXYsQplbVOAVzO2wYqVeI Nov 01 19:03:04.012434 n-d-863052-2 devstack@n-api.service[121402]: X-Domain-Id: None Nov 01 19:03:04.012434 n-d-863052-2 devstack@n-api.service[121402]: X-Domain-Name: None Nov 01 19:03:04.012434 n-d-863052-2 devstack@n-api.service[121402]: X-Identity-Status: Confirmed Nov 01 19:03:04.012434 n-d-863052-2 devstack@n-api.service[121402]: X-Is-Admin-Project: True Nov 01 19:03:04.012434 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Domain-Id: default Nov 01 19:03:04.012434 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Domain-Name: Default Nov 01 19:03:04.012434 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Id: 4a1bb191cff948e99c008b5e861ce4a8 Nov 01 19:03:04.012434 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-215636868 Nov 01 19:03:04.012434 n-d-863052-2 devstack@n-api.service[121402]: X-Role: member,reader Nov 01 19:03:04.012434 n-d-863052-2 devstack@n-api.service[121402]: X-Roles: member,reader Nov 01 19:03:04.012434 n-d-863052-2 devstack@n-api.service[121402]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/4a1bb191cff948e99c008b5e861ce4a8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/4a1bb191cff948e99c008b5e861ce4a8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_4a1bb191cff948e99c008b5e861ce4a8", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/4a1bb191cff948e99c008b5e861ce4a8"}]}] Nov 01 19:03:04.012434 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant: tempest-ServerRescueNegativeTestJSON-215636868 Nov 01 19:03:04.012434 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant-Id: 4a1bb191cff948e99c008b5e861ce4a8 Nov 01 19:03:04.012434 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-215636868 Nov 01 19:03:04.012434 n-d-863052-2 devstack@n-api.service[121402]: X-User: tempest-ServerRescueNegativeTestJSON-215636868-project Nov 01 19:03:04.012434 n-d-863052-2 devstack@n-api.service[121402]: X-User-Domain-Id: default Nov 01 19:03:04.012434 n-d-863052-2 devstack@n-api.service[121402]: X-User-Domain-Name: Default Nov 01 19:03:04.012434 n-d-863052-2 devstack@n-api.service[121402]: X-User-Id: 6a63d69c99a546f0af16329cff3ca717 Nov 01 19:03:04.012434 n-d-863052-2 devstack@n-api.service[121402]: X-User-Name: tempest-ServerRescueNegativeTestJSON-215636868-project Nov 01 19:03:04.012434 n-d-863052-2 devstack@n-api.service[121402]: Nov 01 19:03:04.012434 n-d-863052-2 devstack@n-api.service[121402]: {"reboot": {"type": "HARD"}} Nov 01 19:03:04.012434 n-d-863052-2 devstack@n-api.service[121402]: method: > Nov 01 19:03:04.012434 n-d-863052-2 devstack@n-api.service[121402]: exception: Cannot 'reboot' instance 869ca597-f199-474f-a680-59b0a75512c7 while it is in vm_state rescued Nov 01 19:03:04.012434 n-d-863052-2 devstack@n-api.service[121402]: action_args: {'id': '869ca597-f199-474f-a680-59b0a75512c7', 'body': {'reboot': {'type': 'HARD'}}} Nov 01 19:03:04.012434 n-d-863052-2 devstack@n-api.service[121402]: {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 01 19:03:04.012434 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:03:04.012434 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1036, in _action_reboot Nov 01 19:03:04.012434 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi self.compute_api.reboot(context, instance, reboot_type) Nov 01 19:03:04.012434 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Nov 01 19:03:04.012434 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Nov 01 19:03:04.012434 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3552, in reboot Nov 01 19:03:04.012434 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi self._hard_reboot(context, instance) Nov 01 19:03:04.012434 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Nov 01 19:03:04.012434 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Nov 01 19:03:04.012434 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 869ca597-f199-474f-a680-59b0a75512c7 in vm_state rescued. Cannot _hard_reboot while the instance is in this state. Nov 01 19:03:04.012434 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:03:04.012434 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:03:04.012434 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:03:04.012434 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:03:04.012434 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:03:04.012434 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:03:04.012434 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 01 19:03:04.012434 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 01 19:03:04.012434 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 01 19:03:04.012434 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 01 19:03:04.012434 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 01 19:03:04.012434 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 01 19:03:04.012434 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1040, in _action_reboot Nov 01 19:03:04.012434 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Nov 01 19:03:04.012434 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Nov 01 19:03:04.012434 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Nov 01 19:03:04.015610 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'reboot' instance 869ca597-f199-474f-a680-59b0a75512c7 while it is in vm_state rescued Nov 01 19:03:04.015610 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:03:04.015610 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:03:04.015610 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:03:04.015610 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:03:04.015610 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:03:04.015610 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:03:04.015610 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 01 19:03:04.015610 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 01 19:03:04.015610 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'reboot' instance 869ca597-f199-474f-a680-59b0a75512c7 while it is in vm_state rescued Nov 01 19:03:04.015610 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:03:04.018571 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-4f80c989-85c5-40ad-ba59-0083eea80709 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Returning 409 to user: Cannot 'reboot' instance 869ca597-f199-474f-a680-59b0a75512c7 while it is in vm_state rescued {{(pid=121402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 01 19:03:04.019521 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-4f80c989-85c5-40ad-ba59-0083eea80709 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] 10.222.0.13 "POST /compute/v2.1/servers/869ca597-f199-474f-a680-59b0a75512c7/action" status: 409 len: 145 microversion: 2.1 time: 0.098120 Nov 01 19:03:04.020167 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1189/2385] 10.222.0.13 () {60 vars in 1278 bytes} [Tue Nov 1 19:03:03 2022] POST /compute/v2.1/servers/869ca597-f199-474f-a680-59b0a75512c7/action => generated 145 bytes in 100 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Nov 01 19:03:04.031133 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-f2291c01-586f-4388-b6ef-993f40d48915 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "2d4a0047-1b9e-445f-8af8-1b5c9d93e881"}} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:03:04.033954 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-f2291c01-586f-4388-b6ef-993f40d48915 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] [instance: 869ca597-f199-474f-a680-59b0a75512c7] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:03:04.045196 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f2291c01-586f-4388-b6ef-993f40d48915 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:03:04.045927 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f2291c01-586f-4388-b6ef-993f40d48915 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:03:04.047107 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f2291c01-586f-4388-b6ef-993f40d48915 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:03:04.048079 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f2291c01-586f-4388-b6ef-993f40d48915 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:03:04.048776 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f2291c01-586f-4388-b6ef-993f40d48915 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:03:04.049347 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f2291c01-586f-4388-b6ef-993f40d48915 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:03:04.105624 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.wsgi [None req-f2291c01-586f-4388-b6ef-993f40d48915 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] HTTP exception thrown: Cannot 'rebuild' instance 869ca597-f199-474f-a680-59b0a75512c7 while it is in vm_state rescued Nov 01 19:03:04.107653 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-f2291c01-586f-4388-b6ef-993f40d48915 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Request method failure captured: Nov 01 19:03:04.107653 n-d-863052-2 devstack@n-api.service[121402]: request: POST /compute/v2.1/servers/869ca597-f199-474f-a680-59b0a75512c7/action HTTP/1.1 Nov 01 19:03:04.107653 n-d-863052-2 devstack@n-api.service[121402]: Accept: application/json Nov 01 19:03:04.107653 n-d-863052-2 devstack@n-api.service[121402]: Accept-Encoding: identity Nov 01 19:03:04.107653 n-d-863052-2 devstack@n-api.service[121402]: Connection: close Nov 01 19:03:04.107653 n-d-863052-2 devstack@n-api.service[121402]: Content-Length: 65 Nov 01 19:03:04.107653 n-d-863052-2 devstack@n-api.service[121402]: Content-Type: application/json Nov 01 19:03:04.107653 n-d-863052-2 devstack@n-api.service[121402]: Host: 10.222.0.13 Nov 01 19:03:04.107653 n-d-863052-2 devstack@n-api.service[121402]: Openstack-System-Scope: None Nov 01 19:03:04.107653 n-d-863052-2 devstack@n-api.service[121402]: User-Agent: python-urllib3/1.26.12 Nov 01 19:03:04.107653 n-d-863052-2 devstack@n-api.service[121402]: X-Auth-Token: gAAAAABjYWwgP3kjyQKi9Uf4PP24jmeKCOPNU51FZoHLreZdbFyZPhRW-EeK2Se64f-CjytM5LjMEtkBLCti_PQz0S3BXRBnTu4aanJgpXShIx2i6Yz4YqCrWhQ373B1BFIdgiChyw2k6U5YvJRz35UfhTE-zhCjFxCXYsQplbVOAVzO2wYqVeI Nov 01 19:03:04.107653 n-d-863052-2 devstack@n-api.service[121402]: X-Domain-Id: None Nov 01 19:03:04.107653 n-d-863052-2 devstack@n-api.service[121402]: X-Domain-Name: None Nov 01 19:03:04.107653 n-d-863052-2 devstack@n-api.service[121402]: X-Identity-Status: Confirmed Nov 01 19:03:04.107653 n-d-863052-2 devstack@n-api.service[121402]: X-Is-Admin-Project: True Nov 01 19:03:04.107653 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Domain-Id: default Nov 01 19:03:04.107653 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Domain-Name: Default Nov 01 19:03:04.107653 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Id: 4a1bb191cff948e99c008b5e861ce4a8 Nov 01 19:03:04.107653 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-215636868 Nov 01 19:03:04.107653 n-d-863052-2 devstack@n-api.service[121402]: X-Role: member,reader Nov 01 19:03:04.107653 n-d-863052-2 devstack@n-api.service[121402]: X-Roles: member,reader Nov 01 19:03:04.107653 n-d-863052-2 devstack@n-api.service[121402]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/4a1bb191cff948e99c008b5e861ce4a8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/4a1bb191cff948e99c008b5e861ce4a8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_4a1bb191cff948e99c008b5e861ce4a8", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/4a1bb191cff948e99c008b5e861ce4a8"}]}] Nov 01 19:03:04.107653 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant: tempest-ServerRescueNegativeTestJSON-215636868 Nov 01 19:03:04.107653 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant-Id: 4a1bb191cff948e99c008b5e861ce4a8 Nov 01 19:03:04.107653 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-215636868 Nov 01 19:03:04.107653 n-d-863052-2 devstack@n-api.service[121402]: X-User: tempest-ServerRescueNegativeTestJSON-215636868-project Nov 01 19:03:04.107653 n-d-863052-2 devstack@n-api.service[121402]: X-User-Domain-Id: default Nov 01 19:03:04.107653 n-d-863052-2 devstack@n-api.service[121402]: X-User-Domain-Name: Default Nov 01 19:03:04.107653 n-d-863052-2 devstack@n-api.service[121402]: X-User-Id: 6a63d69c99a546f0af16329cff3ca717 Nov 01 19:03:04.107653 n-d-863052-2 devstack@n-api.service[121402]: X-User-Name: tempest-ServerRescueNegativeTestJSON-215636868-project Nov 01 19:03:04.107653 n-d-863052-2 devstack@n-api.service[121402]: Nov 01 19:03:04.107653 n-d-863052-2 devstack@n-api.service[121402]: {"rebuild": {"imageRef": "2d4a0047-1b9e-445f-8af8-1b5c9d93e881"}} Nov 01 19:03:04.107653 n-d-863052-2 devstack@n-api.service[121402]: method: > Nov 01 19:03:04.107653 n-d-863052-2 devstack@n-api.service[121402]: exception: Cannot 'rebuild' instance 869ca597-f199-474f-a680-59b0a75512c7 while it is in vm_state rescued Nov 01 19:03:04.107653 n-d-863052-2 devstack@n-api.service[121402]: action_args: {'id': '869ca597-f199-474f-a680-59b0a75512c7', 'body': {'rebuild': {'imageRef': '2d4a0047-1b9e-445f-8af8-1b5c9d93e881'}}} Nov 01 19:03:04.107653 n-d-863052-2 devstack@n-api.service[121402]: {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 01 19:03:04.107653 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:03:04.107653 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1223, in _action_rebuild Nov 01 19:03:04.107653 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi self.compute_api.rebuild(context, Nov 01 19:03:04.107653 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Nov 01 19:03:04.107653 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Nov 01 19:03:04.107653 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Nov 01 19:03:04.107653 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Nov 01 19:03:04.107653 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Nov 01 19:03:04.107653 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Nov 01 19:03:04.107653 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Nov 01 19:03:04.107653 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Nov 01 19:03:04.107653 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 869ca597-f199-474f-a680-59b0a75512c7 in vm_state rescued. Cannot rebuild while the instance is in this state. Nov 01 19:03:04.107653 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:03:04.107653 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:03:04.107653 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:03:04.107653 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:03:04.107653 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:03:04.107653 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:03:04.107653 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 01 19:03:04.107653 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 01 19:03:04.107653 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 01 19:03:04.107653 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 01 19:03:04.107653 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 01 19:03:04.107653 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 01 19:03:04.107653 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 01 19:03:04.107653 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 01 19:03:04.107653 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 01 19:03:04.110813 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 01 19:03:04.110813 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Nov 01 19:03:04.110813 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1231, in _action_rebuild Nov 01 19:03:04.110813 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Nov 01 19:03:04.110813 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Nov 01 19:03:04.110813 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Nov 01 19:03:04.110813 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'rebuild' instance 869ca597-f199-474f-a680-59b0a75512c7 while it is in vm_state rescued Nov 01 19:03:04.110813 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:03:04.110813 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:03:04.110813 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:03:04.110813 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:03:04.110813 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:03:04.110813 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:03:04.110813 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 01 19:03:04.110813 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 01 19:03:04.110813 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'rebuild' instance 869ca597-f199-474f-a680-59b0a75512c7 while it is in vm_state rescued Nov 01 19:03:04.110813 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:03:04.113409 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-f2291c01-586f-4388-b6ef-993f40d48915 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Returning 409 to user: Cannot 'rebuild' instance 869ca597-f199-474f-a680-59b0a75512c7 while it is in vm_state rescued {{(pid=121402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 01 19:03:04.119872 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-f2291c01-586f-4388-b6ef-993f40d48915 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] 10.222.0.13 "POST /compute/v2.1/servers/869ca597-f199-474f-a680-59b0a75512c7/action" status: 409 len: 146 microversion: 2.1 time: 0.092559 Nov 01 19:03:04.120743 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1190/2386] 10.222.0.13 () {60 vars in 1278 bytes} [Tue Nov 1 19:03:04 2022] POST /compute/v2.1/servers/869ca597-f199-474f-a680-59b0a75512c7/action => generated 146 bytes in 94 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Nov 01 19:03:04.130198 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-7d5f3b60-fef8-472a-bee7-47be105f4127 tempest-LiveMigrationNegativeTest-570155948 tempest-LiveMigrationNegativeTest-570155948-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:03:04.131183 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-7d5f3b60-fef8-472a-bee7-47be105f4127 tempest-LiveMigrationNegativeTest-570155948 tempest-LiveMigrationNegativeTest-570155948-project] [instance: c4f1d50d-c833-4efe-9a6b-15064fbf5b58] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:03:04.144281 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-7d5f3b60-fef8-472a-bee7-47be105f4127 tempest-LiveMigrationNegativeTest-570155948 tempest-LiveMigrationNegativeTest-570155948-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:03:04.144845 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-7d5f3b60-fef8-472a-bee7-47be105f4127 tempest-LiveMigrationNegativeTest-570155948 tempest-LiveMigrationNegativeTest-570155948-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:03:04.145343 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-7d5f3b60-fef8-472a-bee7-47be105f4127 tempest-LiveMigrationNegativeTest-570155948 tempest-LiveMigrationNegativeTest-570155948-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:03:04.146057 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-7d5f3b60-fef8-472a-bee7-47be105f4127 tempest-LiveMigrationNegativeTest-570155948 tempest-LiveMigrationNegativeTest-570155948-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:03:04.146535 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-7d5f3b60-fef8-472a-bee7-47be105f4127 tempest-LiveMigrationNegativeTest-570155948 tempest-LiveMigrationNegativeTest-570155948-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:03:04.146941 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-7d5f3b60-fef8-472a-bee7-47be105f4127 tempest-LiveMigrationNegativeTest-570155948 tempest-LiveMigrationNegativeTest-570155948-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:03:04.413922 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-3ce1e86f-9c14-4073-9cda-d65dab47e93b tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb496b3faac4abbae73d389f2042e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e2520220d454764b8c139a58d78ac83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:03:04.435277 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-3ce1e86f-9c14-4073-9cda-d65dab47e93b tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] 10.222.0.13 "GET /compute/v2.1/servers/992f5ec5-d256-4870-b16d-fc8d9adbd3e7" status: 200 len: 1478 microversion: 2.1 time: 0.817883 Nov 01 19:03:04.435879 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1197/2387] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:03:03 2022] GET /compute/v2.1/servers/992f5ec5-d256-4870-b16d-fc8d9adbd3e7 => generated 1478 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:03:04.441512 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-2d0e10ea-5376-4194-9c81-f013e89b497b tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:03:04.442218 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-2d0e10ea-5376-4194-9c81-f013e89b497b tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] [instance: 90b353ab-ef97-4d88-b5bc-b355ff576225] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:03:04.454449 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-2d0e10ea-5376-4194-9c81-f013e89b497b tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:03:04.457460 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-2d0e10ea-5376-4194-9c81-f013e89b497b tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:03:04.459227 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-2d0e10ea-5376-4194-9c81-f013e89b497b tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:03:04.460510 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-2d0e10ea-5376-4194-9c81-f013e89b497b tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:03:04.461566 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-2d0e10ea-5376-4194-9c81-f013e89b497b tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:03:04.462280 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-2d0e10ea-5376-4194-9c81-f013e89b497b tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:03:04.563384 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-2d0e10ea-5376-4194-9c81-f013e89b497b tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] [instance: 90b353ab-ef97-4d88-b5bc-b355ff576225] Going to try to terminate instance {{(pid=121403) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 01 19:03:04.710773 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-2d0e10ea-5376-4194-9c81-f013e89b497b tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] 10.222.0.13 "DELETE /compute/v2.1/servers/90b353ab-ef97-4d88-b5bc-b355ff576225" status: 204 len: 0 microversion: 2.1 time: 0.273120 Nov 01 19:03:04.712104 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1198/2388] 10.222.0.13 () {58 vars in 1239 bytes} [Tue Nov 1 19:03:04 2022] DELETE /compute/v2.1/servers/90b353ab-ef97-4d88-b5bc-b355ff576225 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 01 19:03:04.719827 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [req-8b5fe199-3432-4497-b2c7-baf192252abf req-34a3e315-1ac2-4110-91ba-7ae0ca4465ba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "992f5ec5-d256-4870-b16d-fc8d9adbd3e7", "name": "network-vif-unplugged", "status": "completed", "tag": "30841eab-b46a-44ca-adc8-04928cc72ec5"}]} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:03:04.733944 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-8b5fe199-3432-4497-b2c7-baf192252abf req-34a3e315-1ac2-4110-91ba-7ae0ca4465ba service nova] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:03:04.734838 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-8b5fe199-3432-4497-b2c7-baf192252abf req-34a3e315-1ac2-4110-91ba-7ae0ca4465ba service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:03:04.735503 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-8b5fe199-3432-4497-b2c7-baf192252abf req-34a3e315-1ac2-4110-91ba-7ae0ca4465ba service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:03:04.754147 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-7d5f3b60-fef8-472a-bee7-47be105f4127 tempest-LiveMigrationNegativeTest-570155948 tempest-LiveMigrationNegativeTest-570155948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c14605afbc5445d9763db185a1305d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faa1bc7c9d564b0ebc9ecf0a2994f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:03:04.755945 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.compute.server_external_events [req-8b5fe199-3432-4497-b2c7-baf192252abf req-34a3e315-1ac2-4110-91ba-7ae0ca4465ba service nova] Creating event network-vif-unplugged:30841eab-b46a-44ca-adc8-04928cc72ec5 for instance 992f5ec5-d256-4870-b16d-fc8d9adbd3e7 on n-h1-863052-2 Nov 01 19:03:04.762474 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [req-8b5fe199-3432-4497-b2c7-baf192252abf req-34a3e315-1ac2-4110-91ba-7ae0ca4465ba service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.048529 Nov 01 19:03:04.763279 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1199/2389] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Nov 1 19:03:04 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:03:04.769185 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-bdd2de9b-007a-406e-bb40-bbef6c7003d9 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:03:04.769793 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-7d5f3b60-fef8-472a-bee7-47be105f4127 tempest-LiveMigrationNegativeTest-570155948 tempest-LiveMigrationNegativeTest-570155948-project] 10.222.0.13 "GET /compute/v2.1/servers/c4f1d50d-c833-4efe-9a6b-15064fbf5b58" status: 200 len: 1319 microversion: 2.1 time: 0.647813 Nov 01 19:03:04.769955 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-bdd2de9b-007a-406e-bb40-bbef6c7003d9 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] [instance: 90b353ab-ef97-4d88-b5bc-b355ff576225] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:03:04.770997 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1191/2390] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:03:04 2022] GET /compute/v2.1/servers/c4f1d50d-c833-4efe-9a6b-15064fbf5b58 => generated 1319 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:03:04.788152 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-bdd2de9b-007a-406e-bb40-bbef6c7003d9 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:03:04.788849 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-bdd2de9b-007a-406e-bb40-bbef6c7003d9 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:03:04.789396 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-bdd2de9b-007a-406e-bb40-bbef6c7003d9 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:03:04.790263 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-bdd2de9b-007a-406e-bb40-bbef6c7003d9 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:03:04.790847 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-bdd2de9b-007a-406e-bb40-bbef6c7003d9 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:03:04.791373 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-bdd2de9b-007a-406e-bb40-bbef6c7003d9 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:03:05.224481 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-bdd2de9b-007a-406e-bb40-bbef6c7003d9 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a63d69c99a546f0af16329cff3ca717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a1bb191cff948e99c008b5e861ce4a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:03:05.234849 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-bdd2de9b-007a-406e-bb40-bbef6c7003d9 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] 10.222.0.13 "GET /compute/v2.1/servers/90b353ab-ef97-4d88-b5bc-b355ff576225" status: 200 len: 1690 microversion: 2.1 time: 0.469978 Nov 01 19:03:05.236962 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1200/2391] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:03:04 2022] GET /compute/v2.1/servers/90b353ab-ef97-4d88-b5bc-b355ff576225 => generated 1690 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:03:05.461446 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-7fa6a1f0-7fcc-43ee-af31-7cf6ee0c3c2a tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:03:05.462289 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-7fa6a1f0-7fcc-43ee-af31-7cf6ee0c3c2a tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] [instance: 992f5ec5-d256-4870-b16d-fc8d9adbd3e7] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:03:05.475570 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-7fa6a1f0-7fcc-43ee-af31-7cf6ee0c3c2a tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:03:05.476796 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-7fa6a1f0-7fcc-43ee-af31-7cf6ee0c3c2a tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:03:05.477418 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-7fa6a1f0-7fcc-43ee-af31-7cf6ee0c3c2a tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:03:05.480680 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-7fa6a1f0-7fcc-43ee-af31-7cf6ee0c3c2a tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:03:05.481511 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-7fa6a1f0-7fcc-43ee-af31-7cf6ee0c3c2a tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:03:05.482086 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-7fa6a1f0-7fcc-43ee-af31-7cf6ee0c3c2a tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:03:05.734965 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-7fa6a1f0-7fcc-43ee-af31-7cf6ee0c3c2a tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb496b3faac4abbae73d389f2042e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e2520220d454764b8c139a58d78ac83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:03:05.744328 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-7fa6a1f0-7fcc-43ee-af31-7cf6ee0c3c2a tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] 10.222.0.13 "GET /compute/v2.1/servers/992f5ec5-d256-4870-b16d-fc8d9adbd3e7" status: 200 len: 1478 microversion: 2.1 time: 0.287119 Nov 01 19:03:05.766156 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1192/2392] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:03:05 2022] GET /compute/v2.1/servers/992f5ec5-d256-4870-b16d-fc8d9adbd3e7 => generated 1478 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:03:05.797375 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-1ba4a9ae-f76d-4bfa-b9e7-d71a008883b6 tempest-LiveMigrationNegativeTest-570155948 tempest-LiveMigrationNegativeTest-570155948-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:03:05.798156 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-1ba4a9ae-f76d-4bfa-b9e7-d71a008883b6 tempest-LiveMigrationNegativeTest-570155948 tempest-LiveMigrationNegativeTest-570155948-project] [instance: c4f1d50d-c833-4efe-9a6b-15064fbf5b58] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:03:05.811599 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-1ba4a9ae-f76d-4bfa-b9e7-d71a008883b6 tempest-LiveMigrationNegativeTest-570155948 tempest-LiveMigrationNegativeTest-570155948-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:03:05.816198 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-1ba4a9ae-f76d-4bfa-b9e7-d71a008883b6 tempest-LiveMigrationNegativeTest-570155948 tempest-LiveMigrationNegativeTest-570155948-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:03:05.817059 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-1ba4a9ae-f76d-4bfa-b9e7-d71a008883b6 tempest-LiveMigrationNegativeTest-570155948 tempest-LiveMigrationNegativeTest-570155948-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:03:05.818037 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-1ba4a9ae-f76d-4bfa-b9e7-d71a008883b6 tempest-LiveMigrationNegativeTest-570155948 tempest-LiveMigrationNegativeTest-570155948-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:03:05.818717 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-1ba4a9ae-f76d-4bfa-b9e7-d71a008883b6 tempest-LiveMigrationNegativeTest-570155948 tempest-LiveMigrationNegativeTest-570155948-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:03:05.819342 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-1ba4a9ae-f76d-4bfa-b9e7-d71a008883b6 tempest-LiveMigrationNegativeTest-570155948 tempest-LiveMigrationNegativeTest-570155948-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:03:06.245521 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-1ba4a9ae-f76d-4bfa-b9e7-d71a008883b6 tempest-LiveMigrationNegativeTest-570155948 tempest-LiveMigrationNegativeTest-570155948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c14605afbc5445d9763db185a1305d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faa1bc7c9d564b0ebc9ecf0a2994f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:03:06.260648 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-a81e5cb4-dd0d-44a1-8641-3048b646c4fe tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:03:06.261612 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-a81e5cb4-dd0d-44a1-8641-3048b646c4fe tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] [instance: 90b353ab-ef97-4d88-b5bc-b355ff576225] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:03:06.272865 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-1ba4a9ae-f76d-4bfa-b9e7-d71a008883b6 tempest-LiveMigrationNegativeTest-570155948 tempest-LiveMigrationNegativeTest-570155948-project] 10.222.0.13 "GET /compute/v2.1/servers/c4f1d50d-c833-4efe-9a6b-15064fbf5b58" status: 200 len: 1319 microversion: 2.1 time: 0.473614 Nov 01 19:03:06.275400 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1201/2393] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:03:05 2022] GET /compute/v2.1/servers/c4f1d50d-c833-4efe-9a6b-15064fbf5b58 => generated 1319 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:03:06.276545 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-a81e5cb4-dd0d-44a1-8641-3048b646c4fe tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:03:06.279253 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-a81e5cb4-dd0d-44a1-8641-3048b646c4fe tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:03:06.279976 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-a81e5cb4-dd0d-44a1-8641-3048b646c4fe tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:03:06.283757 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-a81e5cb4-dd0d-44a1-8641-3048b646c4fe tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:03:06.285073 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-a81e5cb4-dd0d-44a1-8641-3048b646c4fe tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:03:06.285867 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-a81e5cb4-dd0d-44a1-8641-3048b646c4fe tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:03:06.657341 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-a81e5cb4-dd0d-44a1-8641-3048b646c4fe tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a63d69c99a546f0af16329cff3ca717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a1bb191cff948e99c008b5e861ce4a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:03:06.668519 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-a81e5cb4-dd0d-44a1-8641-3048b646c4fe tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] 10.222.0.13 "GET /compute/v2.1/servers/90b353ab-ef97-4d88-b5bc-b355ff576225" status: 200 len: 1690 microversion: 2.1 time: 0.412150 Nov 01 19:03:06.670387 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1193/2394] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:03:06 2022] GET /compute/v2.1/servers/90b353ab-ef97-4d88-b5bc-b355ff576225 => generated 1690 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:03:06.773230 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-65a17223-0a00-4dd3-9f14-d06e5eee74a9 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:03:06.774181 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-65a17223-0a00-4dd3-9f14-d06e5eee74a9 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] [instance: 992f5ec5-d256-4870-b16d-fc8d9adbd3e7] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:03:06.785340 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-65a17223-0a00-4dd3-9f14-d06e5eee74a9 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:03:06.786390 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-65a17223-0a00-4dd3-9f14-d06e5eee74a9 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:03:06.787044 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-65a17223-0a00-4dd3-9f14-d06e5eee74a9 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:03:06.788052 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-65a17223-0a00-4dd3-9f14-d06e5eee74a9 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:03:06.788770 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-65a17223-0a00-4dd3-9f14-d06e5eee74a9 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:03:06.789412 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-65a17223-0a00-4dd3-9f14-d06e5eee74a9 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:03:07.029439 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [req-d412c9cc-610e-4f73-91fc-6f6bee61c441 req-2c8fadd3-641c-4cf7-a590-59fec052189f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c4f1d50d-c833-4efe-9a6b-15064fbf5b58", "name": "network-vif-plugged", "status": "completed", "tag": "a0c4450f-3a0d-4ab5-ae2d-70ce39e68852"}]} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:03:07.047928 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-d412c9cc-610e-4f73-91fc-6f6bee61c441 req-2c8fadd3-641c-4cf7-a590-59fec052189f service nova] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:03:07.048430 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-d412c9cc-610e-4f73-91fc-6f6bee61c441 req-2c8fadd3-641c-4cf7-a590-59fec052189f service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:03:07.048997 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-d412c9cc-610e-4f73-91fc-6f6bee61c441 req-2c8fadd3-641c-4cf7-a590-59fec052189f service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:03:07.078291 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.compute.server_external_events [req-d412c9cc-610e-4f73-91fc-6f6bee61c441 req-2c8fadd3-641c-4cf7-a590-59fec052189f service nova] Creating event network-vif-plugged:a0c4450f-3a0d-4ab5-ae2d-70ce39e68852 for instance c4f1d50d-c833-4efe-9a6b-15064fbf5b58 on n-h2-863052-2 Nov 01 19:03:07.083573 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [req-d412c9cc-610e-4f73-91fc-6f6bee61c441 req-2c8fadd3-641c-4cf7-a590-59fec052189f service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058973 Nov 01 19:03:07.085045 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1194/2395] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Nov 1 19:03:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 01 19:03:07.303463 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-f199ee70-f8c3-4987-b800-3400a3891a9c tempest-LiveMigrationNegativeTest-570155948 tempest-LiveMigrationNegativeTest-570155948-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:03:07.304176 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-f199ee70-f8c3-4987-b800-3400a3891a9c tempest-LiveMigrationNegativeTest-570155948 tempest-LiveMigrationNegativeTest-570155948-project] [instance: c4f1d50d-c833-4efe-9a6b-15064fbf5b58] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:03:07.319516 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f199ee70-f8c3-4987-b800-3400a3891a9c tempest-LiveMigrationNegativeTest-570155948 tempest-LiveMigrationNegativeTest-570155948-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:03:07.319928 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f199ee70-f8c3-4987-b800-3400a3891a9c tempest-LiveMigrationNegativeTest-570155948 tempest-LiveMigrationNegativeTest-570155948-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:03:07.320708 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f199ee70-f8c3-4987-b800-3400a3891a9c tempest-LiveMigrationNegativeTest-570155948 tempest-LiveMigrationNegativeTest-570155948-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:03:07.321606 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f199ee70-f8c3-4987-b800-3400a3891a9c tempest-LiveMigrationNegativeTest-570155948 tempest-LiveMigrationNegativeTest-570155948-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:03:07.324338 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f199ee70-f8c3-4987-b800-3400a3891a9c tempest-LiveMigrationNegativeTest-570155948 tempest-LiveMigrationNegativeTest-570155948-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:03:07.325012 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f199ee70-f8c3-4987-b800-3400a3891a9c tempest-LiveMigrationNegativeTest-570155948 tempest-LiveMigrationNegativeTest-570155948-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:03:07.485394 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-65a17223-0a00-4dd3-9f14-d06e5eee74a9 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb496b3faac4abbae73d389f2042e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e2520220d454764b8c139a58d78ac83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:03:07.498659 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-65a17223-0a00-4dd3-9f14-d06e5eee74a9 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] 10.222.0.13 "GET /compute/v2.1/servers/992f5ec5-d256-4870-b16d-fc8d9adbd3e7" status: 200 len: 1478 microversion: 2.1 time: 0.729858 Nov 01 19:03:07.503306 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1202/2396] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:03:06 2022] GET /compute/v2.1/servers/992f5ec5-d256-4870-b16d-fc8d9adbd3e7 => generated 1478 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:03:07.698132 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-a45223ac-f02e-4cc6-b4fd-9a1f69f9ae8e tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:03:07.699359 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-a45223ac-f02e-4cc6-b4fd-9a1f69f9ae8e tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] [instance: 90b353ab-ef97-4d88-b5bc-b355ff576225] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:03:07.716329 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-a45223ac-f02e-4cc6-b4fd-9a1f69f9ae8e tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:03:07.716975 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-a45223ac-f02e-4cc6-b4fd-9a1f69f9ae8e tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:03:07.721574 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-a45223ac-f02e-4cc6-b4fd-9a1f69f9ae8e tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:03:07.722515 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-a45223ac-f02e-4cc6-b4fd-9a1f69f9ae8e tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:03:07.723261 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-a45223ac-f02e-4cc6-b4fd-9a1f69f9ae8e tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:03:07.724084 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-a45223ac-f02e-4cc6-b4fd-9a1f69f9ae8e tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:03:07.822229 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-f199ee70-f8c3-4987-b800-3400a3891a9c tempest-LiveMigrationNegativeTest-570155948 tempest-LiveMigrationNegativeTest-570155948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c14605afbc5445d9763db185a1305d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faa1bc7c9d564b0ebc9ecf0a2994f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:03:07.835135 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-f199ee70-f8c3-4987-b800-3400a3891a9c tempest-LiveMigrationNegativeTest-570155948 tempest-LiveMigrationNegativeTest-570155948-project] 10.222.0.13 "GET /compute/v2.1/servers/c4f1d50d-c833-4efe-9a6b-15064fbf5b58" status: 200 len: 1319 microversion: 2.1 time: 0.535915 Nov 01 19:03:07.837736 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1195/2397] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:03:07 2022] GET /compute/v2.1/servers/c4f1d50d-c833-4efe-9a6b-15064fbf5b58 => generated 1319 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 19:03:08.526513 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-7cf6ba5d-de05-4231-aac6-9b60a287e7f6 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:03:08.527241 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-7cf6ba5d-de05-4231-aac6-9b60a287e7f6 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] [instance: 992f5ec5-d256-4870-b16d-fc8d9adbd3e7] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:03:08.543743 n-d-863052-2 devstack@n-api.service[121402]: DEBUG dbcounter [-] [121402] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=121402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 19:03:08.545702 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-7cf6ba5d-de05-4231-aac6-9b60a287e7f6 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:03:08.546347 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-7cf6ba5d-de05-4231-aac6-9b60a287e7f6 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:03:08.546928 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-7cf6ba5d-de05-4231-aac6-9b60a287e7f6 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:03:08.547818 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-7cf6ba5d-de05-4231-aac6-9b60a287e7f6 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:03:08.548423 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-7cf6ba5d-de05-4231-aac6-9b60a287e7f6 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:03:08.552573 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-7cf6ba5d-de05-4231-aac6-9b60a287e7f6 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:03:08.745869 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-a45223ac-f02e-4cc6-b4fd-9a1f69f9ae8e tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a63d69c99a546f0af16329cff3ca717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a1bb191cff948e99c008b5e861ce4a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:03:08.767041 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-a45223ac-f02e-4cc6-b4fd-9a1f69f9ae8e tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] 10.222.0.13 "GET /compute/v2.1/servers/90b353ab-ef97-4d88-b5bc-b355ff576225" status: 200 len: 1690 microversion: 2.1 time: 1.074996 Nov 01 19:03:08.768305 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1203/2398] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:03:07 2022] GET /compute/v2.1/servers/90b353ab-ef97-4d88-b5bc-b355ff576225 => generated 1690 bytes in 1077 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:03:08.862578 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-dadd17c4-0c88-4ad5-baaa-84fb35e10a3f tempest-LiveMigrationNegativeTest-570155948 tempest-LiveMigrationNegativeTest-570155948-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:03:08.864233 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-dadd17c4-0c88-4ad5-baaa-84fb35e10a3f tempest-LiveMigrationNegativeTest-570155948 tempest-LiveMigrationNegativeTest-570155948-project] [instance: c4f1d50d-c833-4efe-9a6b-15064fbf5b58] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:03:08.887829 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-dadd17c4-0c88-4ad5-baaa-84fb35e10a3f tempest-LiveMigrationNegativeTest-570155948 tempest-LiveMigrationNegativeTest-570155948-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:03:08.888348 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-dadd17c4-0c88-4ad5-baaa-84fb35e10a3f tempest-LiveMigrationNegativeTest-570155948 tempest-LiveMigrationNegativeTest-570155948-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:03:08.891209 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-dadd17c4-0c88-4ad5-baaa-84fb35e10a3f tempest-LiveMigrationNegativeTest-570155948 tempest-LiveMigrationNegativeTest-570155948-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:03:08.899731 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-dadd17c4-0c88-4ad5-baaa-84fb35e10a3f tempest-LiveMigrationNegativeTest-570155948 tempest-LiveMigrationNegativeTest-570155948-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:03:08.901860 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-dadd17c4-0c88-4ad5-baaa-84fb35e10a3f tempest-LiveMigrationNegativeTest-570155948 tempest-LiveMigrationNegativeTest-570155948-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:03:08.907856 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-dadd17c4-0c88-4ad5-baaa-84fb35e10a3f tempest-LiveMigrationNegativeTest-570155948 tempest-LiveMigrationNegativeTest-570155948-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:03:09.165978 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-7cf6ba5d-de05-4231-aac6-9b60a287e7f6 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb496b3faac4abbae73d389f2042e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e2520220d454764b8c139a58d78ac83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:03:09.179269 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-7cf6ba5d-de05-4231-aac6-9b60a287e7f6 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] 10.222.0.13 "GET /compute/v2.1/servers/992f5ec5-d256-4870-b16d-fc8d9adbd3e7" status: 200 len: 1478 microversion: 2.1 time: 0.653967 Nov 01 19:03:09.183022 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1196/2399] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:03:08 2022] GET /compute/v2.1/servers/992f5ec5-d256-4870-b16d-fc8d9adbd3e7 => generated 1478 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 19:03:09.188508 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [req-48a63513-c035-4d62-a594-692a8cb34fe8 req-18b5c490-b890-4959-9b2c-3cef0c7c2b69 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "992f5ec5-d256-4870-b16d-fc8d9adbd3e7", "name": "network-vif-plugged", "status": "completed", "tag": "30841eab-b46a-44ca-adc8-04928cc72ec5"}]} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:03:09.217953 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-48a63513-c035-4d62-a594-692a8cb34fe8 req-18b5c490-b890-4959-9b2c-3cef0c7c2b69 service nova] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:03:09.218666 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-48a63513-c035-4d62-a594-692a8cb34fe8 req-18b5c490-b890-4959-9b2c-3cef0c7c2b69 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:03:09.219244 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-48a63513-c035-4d62-a594-692a8cb34fe8 req-18b5c490-b890-4959-9b2c-3cef0c7c2b69 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:03:09.225192 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-dadd17c4-0c88-4ad5-baaa-84fb35e10a3f tempest-LiveMigrationNegativeTest-570155948 tempest-LiveMigrationNegativeTest-570155948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c14605afbc5445d9763db185a1305d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faa1bc7c9d564b0ebc9ecf0a2994f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:03:09.237077 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-dadd17c4-0c88-4ad5-baaa-84fb35e10a3f tempest-LiveMigrationNegativeTest-570155948 tempest-LiveMigrationNegativeTest-570155948-project] 10.222.0.13 "GET /compute/v2.1/servers/c4f1d50d-c833-4efe-9a6b-15064fbf5b58" status: 200 len: 1319 microversion: 2.1 time: 0.378117 Nov 01 19:03:09.238039 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1204/2400] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:03:08 2022] GET /compute/v2.1/servers/c4f1d50d-c833-4efe-9a6b-15064fbf5b58 => generated 1319 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:03:09.240273 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.compute.server_external_events [req-48a63513-c035-4d62-a594-692a8cb34fe8 req-18b5c490-b890-4959-9b2c-3cef0c7c2b69 service nova] Creating event network-vif-plugged:30841eab-b46a-44ca-adc8-04928cc72ec5 for instance 992f5ec5-d256-4870-b16d-fc8d9adbd3e7 on n-h1-863052-2 Nov 01 19:03:09.251060 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [req-48a63513-c035-4d62-a594-692a8cb34fe8 req-18b5c490-b890-4959-9b2c-3cef0c7c2b69 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066403 Nov 01 19:03:09.252041 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1197/2401] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Nov 1 19:03:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:03:09.796297 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-83617eeb-9212-4041-9609-d1d20bdf13f0 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:03:09.797351 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-83617eeb-9212-4041-9609-d1d20bdf13f0 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] [instance: 90b353ab-ef97-4d88-b5bc-b355ff576225] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:03:09.803355 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-83617eeb-9212-4041-9609-d1d20bdf13f0 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:03:09.804285 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-83617eeb-9212-4041-9609-d1d20bdf13f0 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:03:09.804285 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-83617eeb-9212-4041-9609-d1d20bdf13f0 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:03:09.805020 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-83617eeb-9212-4041-9609-d1d20bdf13f0 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:03:09.806600 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-83617eeb-9212-4041-9609-d1d20bdf13f0 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:03:09.807419 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-83617eeb-9212-4041-9609-d1d20bdf13f0 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:03:10.108152 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-83617eeb-9212-4041-9609-d1d20bdf13f0 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a63d69c99a546f0af16329cff3ca717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a1bb191cff948e99c008b5e861ce4a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:03:10.118395 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-83617eeb-9212-4041-9609-d1d20bdf13f0 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] 10.222.0.13 "GET /compute/v2.1/servers/90b353ab-ef97-4d88-b5bc-b355ff576225" status: 200 len: 1690 microversion: 2.1 time: 0.325369 Nov 01 19:03:10.133621 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1205/2402] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:03:09 2022] GET /compute/v2.1/servers/90b353ab-ef97-4d88-b5bc-b355ff576225 => generated 1690 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:03:10.210741 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-8349a5d4-b939-4514-b127-e2e6e70459a9 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:03:10.211646 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-8349a5d4-b939-4514-b127-e2e6e70459a9 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] [instance: 992f5ec5-d256-4870-b16d-fc8d9adbd3e7] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:03:10.222317 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-8349a5d4-b939-4514-b127-e2e6e70459a9 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:03:10.223124 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-8349a5d4-b939-4514-b127-e2e6e70459a9 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:03:10.223570 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-8349a5d4-b939-4514-b127-e2e6e70459a9 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:03:10.224312 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-8349a5d4-b939-4514-b127-e2e6e70459a9 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:03:10.224864 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-8349a5d4-b939-4514-b127-e2e6e70459a9 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:03:10.225279 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-8349a5d4-b939-4514-b127-e2e6e70459a9 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:03:10.265835 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-de9a42c5-2b9e-4af3-8a9f-3ed5f71add06 tempest-LiveMigrationNegativeTest-570155948 tempest-LiveMigrationNegativeTest-570155948-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:03:10.266450 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-de9a42c5-2b9e-4af3-8a9f-3ed5f71add06 tempest-LiveMigrationNegativeTest-570155948 tempest-LiveMigrationNegativeTest-570155948-project] [instance: c4f1d50d-c833-4efe-9a6b-15064fbf5b58] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:03:10.273274 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-de9a42c5-2b9e-4af3-8a9f-3ed5f71add06 tempest-LiveMigrationNegativeTest-570155948 tempest-LiveMigrationNegativeTest-570155948-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:03:10.273954 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-de9a42c5-2b9e-4af3-8a9f-3ed5f71add06 tempest-LiveMigrationNegativeTest-570155948 tempest-LiveMigrationNegativeTest-570155948-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:03:10.274405 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-de9a42c5-2b9e-4af3-8a9f-3ed5f71add06 tempest-LiveMigrationNegativeTest-570155948 tempest-LiveMigrationNegativeTest-570155948-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:03:10.277542 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-de9a42c5-2b9e-4af3-8a9f-3ed5f71add06 tempest-LiveMigrationNegativeTest-570155948 tempest-LiveMigrationNegativeTest-570155948-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:03:10.278061 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-de9a42c5-2b9e-4af3-8a9f-3ed5f71add06 tempest-LiveMigrationNegativeTest-570155948 tempest-LiveMigrationNegativeTest-570155948-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:03:10.278510 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-de9a42c5-2b9e-4af3-8a9f-3ed5f71add06 tempest-LiveMigrationNegativeTest-570155948 tempest-LiveMigrationNegativeTest-570155948-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:03:10.534665 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-de9a42c5-2b9e-4af3-8a9f-3ed5f71add06 tempest-LiveMigrationNegativeTest-570155948 tempest-LiveMigrationNegativeTest-570155948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c14605afbc5445d9763db185a1305d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faa1bc7c9d564b0ebc9ecf0a2994f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:03:10.556509 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-de9a42c5-2b9e-4af3-8a9f-3ed5f71add06 tempest-LiveMigrationNegativeTest-570155948 tempest-LiveMigrationNegativeTest-570155948-project] 10.222.0.13 "GET /compute/v2.1/servers/c4f1d50d-c833-4efe-9a6b-15064fbf5b58" status: 200 len: 1469 microversion: 2.1 time: 0.296272 Nov 01 19:03:10.560218 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1206/2403] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:03:10 2022] GET /compute/v2.1/servers/c4f1d50d-c833-4efe-9a6b-15064fbf5b58 => generated 1469 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:03:10.981537 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-be03cc0e-5389-4b3a-b407-daa042ab7e71 tempest-LiveMigrationNegativeTest-1857188272 tempest-LiveMigrationNegativeTest-1857188272-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "tempest-host-69673671", "block_migration": true, "disk_over_commit": false}} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:03:10.984854 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-be03cc0e-5389-4b3a-b407-daa042ab7e71 tempest-LiveMigrationNegativeTest-1857188272 tempest-LiveMigrationNegativeTest-1857188272-project-admin] [instance: c4f1d50d-c833-4efe-9a6b-15064fbf5b58] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:03:10.996975 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-8349a5d4-b939-4514-b127-e2e6e70459a9 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb496b3faac4abbae73d389f2042e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e2520220d454764b8c139a58d78ac83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:03:11.006501 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-be03cc0e-5389-4b3a-b407-daa042ab7e71 tempest-LiveMigrationNegativeTest-1857188272 tempest-LiveMigrationNegativeTest-1857188272-project-admin] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:03:11.007869 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-be03cc0e-5389-4b3a-b407-daa042ab7e71 tempest-LiveMigrationNegativeTest-1857188272 tempest-LiveMigrationNegativeTest-1857188272-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:03:11.008500 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-be03cc0e-5389-4b3a-b407-daa042ab7e71 tempest-LiveMigrationNegativeTest-1857188272 tempest-LiveMigrationNegativeTest-1857188272-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:03:11.009398 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-be03cc0e-5389-4b3a-b407-daa042ab7e71 tempest-LiveMigrationNegativeTest-1857188272 tempest-LiveMigrationNegativeTest-1857188272-project-admin] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:03:11.010015 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-be03cc0e-5389-4b3a-b407-daa042ab7e71 tempest-LiveMigrationNegativeTest-1857188272 tempest-LiveMigrationNegativeTest-1857188272-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:03:11.010602 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-be03cc0e-5389-4b3a-b407-daa042ab7e71 tempest-LiveMigrationNegativeTest-1857188272 tempest-LiveMigrationNegativeTest-1857188272-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:03:11.013646 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-8349a5d4-b939-4514-b127-e2e6e70459a9 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] 10.222.0.13 "GET /compute/v2.1/servers/992f5ec5-d256-4870-b16d-fc8d9adbd3e7" status: 200 len: 1478 microversion: 2.1 time: 0.806798 Nov 01 19:03:11.015845 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1198/2404] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:03:10 2022] GET /compute/v2.1/servers/992f5ec5-d256-4870-b16d-fc8d9adbd3e7 => generated 1478 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:03:11.047974 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.objects.instance [None req-be03cc0e-5389-4b3a-b407-daa042ab7e71 tempest-LiveMigrationNegativeTest-1857188272 tempest-LiveMigrationNegativeTest-1857188272-project-admin] Lazy-loading 'flavor' on Instance uuid c4f1d50d-c833-4efe-9a6b-15064fbf5b58 {{(pid=121403) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 01 19:03:11.081057 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-be03cc0e-5389-4b3a-b407-daa042ab7e71 tempest-LiveMigrationNegativeTest-1857188272 tempest-LiveMigrationNegativeTest-1857188272-project-admin] [instance: c4f1d50d-c833-4efe-9a6b-15064fbf5b58] Going to try to live migrate instance to tempest-host-69673671 {{(pid=121403) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Nov 01 19:03:11.111740 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.wsgi [None req-be03cc0e-5389-4b3a-b407-daa042ab7e71 tempest-LiveMigrationNegativeTest-1857188272 tempest-LiveMigrationNegativeTest-1857188272-project-admin] HTTP exception thrown: Compute host tempest-host-69673671 could not be found. Nov 01 19:03:11.131813 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-1262f1ef-28d9-44a1-aeba-c9ab4915acc1 tempest-SecurityGroupRulesNegativeTestJSON-1578314603 tempest-SecurityGroupRulesNegativeTestJSON-1578314603-project] Action: 'create', calling method: .version_select at 0x7f0ae1a9e040>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-2105547192", "description": "tempest-description-367411987"}} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:03:11.135349 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-be03cc0e-5389-4b3a-b407-daa042ab7e71 tempest-LiveMigrationNegativeTest-1857188272 tempest-LiveMigrationNegativeTest-1857188272-project-admin] Request method failure captured: Nov 01 19:03:11.135349 n-d-863052-2 devstack@n-api.service[121403]: request: POST /compute/v2.1/servers/c4f1d50d-c833-4efe-9a6b-15064fbf5b58/action HTTP/1.1 Nov 01 19:03:11.135349 n-d-863052-2 devstack@n-api.service[121403]: Accept: application/json Nov 01 19:03:11.135349 n-d-863052-2 devstack@n-api.service[121403]: Accept-Encoding: identity Nov 01 19:03:11.135349 n-d-863052-2 devstack@n-api.service[121403]: Connection: close Nov 01 19:03:11.135349 n-d-863052-2 devstack@n-api.service[121403]: Content-Length: 105 Nov 01 19:03:11.135349 n-d-863052-2 devstack@n-api.service[121403]: Content-Type: application/json Nov 01 19:03:11.135349 n-d-863052-2 devstack@n-api.service[121403]: Host: 10.222.0.13 Nov 01 19:03:11.135349 n-d-863052-2 devstack@n-api.service[121403]: Openstack-System-Scope: None Nov 01 19:03:11.135349 n-d-863052-2 devstack@n-api.service[121403]: User-Agent: python-urllib3/1.26.12 Nov 01 19:03:11.135349 n-d-863052-2 devstack@n-api.service[121403]: X-Auth-Token: gAAAAABjYW1buKV8fCcyjwAEXBOl4IVt6Czsvyl0_veri8Ax8WRMMi1ZoqKCmDrRaeZ9jKURU6F8QH3y2GQ1fUIzyp_qVjK2NYQGXC1AqlqUEtp4V1THaP6z2-SU6Hw44YoPQBXkgLrXNXAqudpy-5C1yzCPH3g9-HadD_x4cidDO-ykxaWCI8M Nov 01 19:03:11.135349 n-d-863052-2 devstack@n-api.service[121403]: X-Domain-Id: None Nov 01 19:03:11.135349 n-d-863052-2 devstack@n-api.service[121403]: X-Domain-Name: None Nov 01 19:03:11.135349 n-d-863052-2 devstack@n-api.service[121403]: X-Identity-Status: Confirmed Nov 01 19:03:11.135349 n-d-863052-2 devstack@n-api.service[121403]: X-Is-Admin-Project: True Nov 01 19:03:11.135349 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Domain-Id: default Nov 01 19:03:11.135349 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Domain-Name: Default Nov 01 19:03:11.135349 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Id: 2dac8ac7538d4f2da805ed4f1d1ff0c9 Nov 01 19:03:11.135349 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Name: tempest-LiveMigrationNegativeTest-1857188272 Nov 01 19:03:11.135349 n-d-863052-2 devstack@n-api.service[121403]: X-Role: admin,member,reader Nov 01 19:03:11.135349 n-d-863052-2 devstack@n-api.service[121403]: X-Roles: admin,member,reader Nov 01 19:03:11.135349 n-d-863052-2 devstack@n-api.service[121403]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/2dac8ac7538d4f2da805ed4f1d1ff0c9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/2dac8ac7538d4f2da805ed4f1d1ff0c9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_2dac8ac7538d4f2da805ed4f1d1ff0c9", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/2dac8ac7538d4f2da805ed4f1d1ff0c9"}]}] Nov 01 19:03:11.135349 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant: tempest-LiveMigrationNegativeTest-1857188272 Nov 01 19:03:11.135349 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant-Id: 2dac8ac7538d4f2da805ed4f1d1ff0c9 Nov 01 19:03:11.135349 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-1857188272 Nov 01 19:03:11.135349 n-d-863052-2 devstack@n-api.service[121403]: X-User: tempest-LiveMigrationNegativeTest-1857188272-project-admin Nov 01 19:03:11.135349 n-d-863052-2 devstack@n-api.service[121403]: X-User-Domain-Id: default Nov 01 19:03:11.135349 n-d-863052-2 devstack@n-api.service[121403]: X-User-Domain-Name: Default Nov 01 19:03:11.135349 n-d-863052-2 devstack@n-api.service[121403]: X-User-Id: 59f947a0c76b47868755a6b2c2eba70f Nov 01 19:03:11.135349 n-d-863052-2 devstack@n-api.service[121403]: X-User-Name: tempest-LiveMigrationNegativeTest-1857188272-project-admin Nov 01 19:03:11.135349 n-d-863052-2 devstack@n-api.service[121403]: Nov 01 19:03:11.135349 n-d-863052-2 devstack@n-api.service[121403]: {"os-migrateLive": {"host": "tempest-host-69673671", "block_migration": true, "disk_over_commit": false}} Nov 01 19:03:11.135349 n-d-863052-2 devstack@n-api.service[121403]: method: > Nov 01 19:03:11.135349 n-d-863052-2 devstack@n-api.service[121403]: exception: Compute host tempest-host-69673671 could not be found. Nov 01 19:03:11.135349 n-d-863052-2 devstack@n-api.service[121403]: action_args: {'id': 'c4f1d50d-c833-4efe-9a6b-15064fbf5b58', 'body': {'os-migrateLive': {'host': 'tempest-host-69673671', 'block_migration': True, 'disk_over_commit': False}}} Nov 01 19:03:11.135349 n-d-863052-2 devstack@n-api.service[121403]: {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 01 19:03:11.135349 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:03:11.135349 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 123, in _migrate_live Nov 01 19:03:11.135349 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi self.compute_api.live_migrate(context, instance, block_migration, Nov 01 19:03:11.135349 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Nov 01 19:03:11.135349 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Nov 01 19:03:11.135349 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Nov 01 19:03:11.135349 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Nov 01 19:03:11.135349 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Nov 01 19:03:11.135349 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Nov 01 19:03:11.135349 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Nov 01 19:03:11.135349 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Nov 01 19:03:11.135349 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Nov 01 19:03:11.135349 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Nov 01 19:03:11.135349 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 259, in inner Nov 01 19:03:11.135349 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Nov 01 19:03:11.135349 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Nov 01 19:03:11.135349 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Nov 01 19:03:11.135349 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Nov 01 19:03:11.135349 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Nov 01 19:03:11.135349 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5488, in live_migrate Nov 01 19:03:11.135349 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi nodes = objects.ComputeNodeList.get_all_by_host(context, host_name) Nov 01 19:03:11.135349 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 01 19:03:11.135349 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 01 19:03:11.135349 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/compute_node.py", line 476, in get_all_by_host Nov 01 19:03:11.135349 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi db_computes = cls._db_compute_node_get_all_by_host(context, host, Nov 01 19:03:11.138717 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 179, in wrapper Nov 01 19:03:11.138717 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 01 19:03:11.138717 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/compute_node.py", line 472, in _db_compute_node_get_all_by_host Nov 01 19:03:11.138717 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return db.compute_node_get_all_by_host(context, host) Nov 01 19:03:11.138717 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 241, in wrapper Nov 01 19:03:11.138717 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return f(context, *args, **kwargs) Nov 01 19:03:11.138717 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 740, in compute_node_get_all_by_host Nov 01 19:03:11.138717 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host) Nov 01 19:03:11.138717 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host tempest-host-69673671 could not be found. Nov 01 19:03:11.138717 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:03:11.138717 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:03:11.138717 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:03:11.138717 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:03:11.138717 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:03:11.138717 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:03:11.138717 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 01 19:03:11.138717 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 01 19:03:11.138717 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 01 19:03:11.138717 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 01 19:03:11.138717 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 01 19:03:11.138717 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 01 19:03:11.138717 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 01 19:03:11.138717 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 01 19:03:11.138717 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 01 19:03:11.138717 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 01 19:03:11.138717 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Nov 01 19:03:11.138717 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 150, in _migrate_live Nov 01 19:03:11.138717 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Nov 01 19:03:11.138717 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Compute host tempest-host-69673671 could not be found. Nov 01 19:03:11.138717 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:03:11.138717 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:03:11.138717 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:03:11.138717 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:03:11.138717 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:03:11.138717 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:03:11.138717 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 01 19:03:11.138717 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 01 19:03:11.138717 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Compute host tempest-host-69673671 could not be found. Nov 01 19:03:11.138717 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:03:11.142377 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-be03cc0e-5389-4b3a-b407-daa042ab7e71 tempest-LiveMigrationNegativeTest-1857188272 tempest-LiveMigrationNegativeTest-1857188272-project-admin] Returning 400 to user: Compute host tempest-host-69673671 could not be found. {{(pid=121403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 01 19:03:11.144301 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-be03cc0e-5389-4b3a-b407-daa042ab7e71 tempest-LiveMigrationNegativeTest-1857188272 tempest-LiveMigrationNegativeTest-1857188272-project-admin] 10.222.0.13 "POST /compute/v2.1/servers/c4f1d50d-c833-4efe-9a6b-15064fbf5b58/action" status: 400 len: 98 microversion: 2.1 time: 0.562281 Nov 01 19:03:11.146219 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1207/2405] 10.222.0.13 () {60 vars in 1279 bytes} [Tue Nov 1 19:03:10 2022] POST /compute/v2.1/servers/c4f1d50d-c833-4efe-9a6b-15064fbf5b58/action => generated 98 bytes in 565 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Nov 01 19:03:11.151092 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-21c96b4b-04e1-4802-9f29-5b1ad4cf9f99 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:03:11.155831 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-21c96b4b-04e1-4802-9f29-5b1ad4cf9f99 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] [instance: 90b353ab-ef97-4d88-b5bc-b355ff576225] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:03:11.163784 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-21c96b4b-04e1-4802-9f29-5b1ad4cf9f99 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:03:11.164279 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-21c96b4b-04e1-4802-9f29-5b1ad4cf9f99 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:03:11.164763 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-21c96b4b-04e1-4802-9f29-5b1ad4cf9f99 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:03:11.165474 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-21c96b4b-04e1-4802-9f29-5b1ad4cf9f99 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:03:11.168121 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-21c96b4b-04e1-4802-9f29-5b1ad4cf9f99 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:03:11.168603 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-21c96b4b-04e1-4802-9f29-5b1ad4cf9f99 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:03:11.286922 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-21c96b4b-04e1-4802-9f29-5b1ad4cf9f99 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a63d69c99a546f0af16329cff3ca717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a1bb191cff948e99c008b5e861ce4a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:03:11.307184 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-21c96b4b-04e1-4802-9f29-5b1ad4cf9f99 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] 10.222.0.13 "GET /compute/v2.1/servers/90b353ab-ef97-4d88-b5bc-b355ff576225" status: 200 len: 1622 microversion: 2.1 time: 0.159714 Nov 01 19:03:11.317000 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1208/2406] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:03:11 2022] GET /compute/v2.1/servers/90b353ab-ef97-4d88-b5bc-b355ff576225 => generated 1622 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:03:11.328341 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-7022afd5-f008-40a6-97c2-855b32ad6116 tempest-LiveMigrationNegativeTest-570155948 tempest-LiveMigrationNegativeTest-570155948-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:03:11.328999 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-7022afd5-f008-40a6-97c2-855b32ad6116 tempest-LiveMigrationNegativeTest-570155948 tempest-LiveMigrationNegativeTest-570155948-project] [instance: c4f1d50d-c833-4efe-9a6b-15064fbf5b58] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:03:11.347433 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-7022afd5-f008-40a6-97c2-855b32ad6116 tempest-LiveMigrationNegativeTest-570155948 tempest-LiveMigrationNegativeTest-570155948-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:03:11.348494 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-7022afd5-f008-40a6-97c2-855b32ad6116 tempest-LiveMigrationNegativeTest-570155948 tempest-LiveMigrationNegativeTest-570155948-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:03:11.348975 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-7022afd5-f008-40a6-97c2-855b32ad6116 tempest-LiveMigrationNegativeTest-570155948 tempest-LiveMigrationNegativeTest-570155948-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:03:11.349701 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-7022afd5-f008-40a6-97c2-855b32ad6116 tempest-LiveMigrationNegativeTest-570155948 tempest-LiveMigrationNegativeTest-570155948-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:03:11.350166 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-7022afd5-f008-40a6-97c2-855b32ad6116 tempest-LiveMigrationNegativeTest-570155948 tempest-LiveMigrationNegativeTest-570155948-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:03:11.350601 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-7022afd5-f008-40a6-97c2-855b32ad6116 tempest-LiveMigrationNegativeTest-570155948 tempest-LiveMigrationNegativeTest-570155948-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:03:11.590807 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-7022afd5-f008-40a6-97c2-855b32ad6116 tempest-LiveMigrationNegativeTest-570155948 tempest-LiveMigrationNegativeTest-570155948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c14605afbc5445d9763db185a1305d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faa1bc7c9d564b0ebc9ecf0a2994f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:03:11.617180 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-7022afd5-f008-40a6-97c2-855b32ad6116 tempest-LiveMigrationNegativeTest-570155948 tempest-LiveMigrationNegativeTest-570155948-project] 10.222.0.13 "GET /compute/v2.1/servers/c4f1d50d-c833-4efe-9a6b-15064fbf5b58" status: 200 len: 1469 microversion: 2.1 time: 0.299219 Nov 01 19:03:11.621809 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1209/2407] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:03:11 2022] GET /compute/v2.1/servers/c4f1d50d-c833-4efe-9a6b-15064fbf5b58 => generated 1469 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:03:11.841342 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-1262f1ef-28d9-44a1-aeba-c9ab4915acc1 tempest-SecurityGroupRulesNegativeTestJSON-1578314603 tempest-SecurityGroupRulesNegativeTestJSON-1578314603-project] 10.222.0.13 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 0.821659 Nov 01 19:03:11.842871 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1199/2408] 10.222.0.13 () {60 vars in 1180 bytes} [Tue Nov 1 19:03:11 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:03:11.849860 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-f4cc0278-d3af-4748-9dc2-c938961c9010 tempest-LiveMigrationNegativeTest-570155948 tempest-LiveMigrationNegativeTest-570155948-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-1797036552", "imageRef": "2d4a0047-1b9e-445f-8af8-1b5c9d93e881", "flavorRef": "452"}} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:03:11.861214 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-0ba378b6-5571-4ea9-9b4b-98c3f93136ce tempest-SecurityGroupRulesNegativeTestJSON-1578314603 tempest-SecurityGroupRulesNegativeTestJSON-1578314603-project] Action: 'create', calling method: .version_select at 0x7f0ae1a80c10>, body: {"security_group_rule": {"parent_group_id": "87ec7808-53a2-462b-857c-45b140389011", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:03:11.960989 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.network.neutron [None req-f4cc0278-d3af-4748-9dc2-c938961c9010 tempest-LiveMigrationNegativeTest-570155948 tempest-LiveMigrationNegativeTest-570155948-project] validate_networks() for None {{(pid=121403) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 01 19:03:12.396910 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.virt.hardware [None req-f4cc0278-d3af-4748-9dc2-c938961c9010 tempest-LiveMigrationNegativeTest-570155948 tempest-LiveMigrationNegativeTest-570155948-project] Flavor limits 0:0:0 {{(pid=121403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 01 19:03:12.397502 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.virt.hardware [None req-f4cc0278-d3af-4748-9dc2-c938961c9010 tempest-LiveMigrationNegativeTest-570155948 tempest-LiveMigrationNegativeTest-570155948-project] Image limits 0:0:0 {{(pid=121403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 01 19:03:12.403167 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.virt.hardware [None req-f4cc0278-d3af-4748-9dc2-c938961c9010 tempest-LiveMigrationNegativeTest-570155948 tempest-LiveMigrationNegativeTest-570155948-project] Flavor pref 0:0:0 {{(pid=121403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 01 19:03:12.403634 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.virt.hardware [None req-f4cc0278-d3af-4748-9dc2-c938961c9010 tempest-LiveMigrationNegativeTest-570155948 tempest-LiveMigrationNegativeTest-570155948-project] Image pref 0:0:0 {{(pid=121403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 01 19:03:12.404062 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.virt.hardware [None req-f4cc0278-d3af-4748-9dc2-c938961c9010 tempest-LiveMigrationNegativeTest-570155948 tempest-LiveMigrationNegativeTest-570155948-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 01 19:03:12.433719 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f4cc0278-d3af-4748-9dc2-c938961c9010 tempest-LiveMigrationNegativeTest-570155948 tempest-LiveMigrationNegativeTest-570155948-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:03:12.434581 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f4cc0278-d3af-4748-9dc2-c938961c9010 tempest-LiveMigrationNegativeTest-570155948 tempest-LiveMigrationNegativeTest-570155948-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:03:12.435580 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f4cc0278-d3af-4748-9dc2-c938961c9010 tempest-LiveMigrationNegativeTest-570155948 tempest-LiveMigrationNegativeTest-570155948-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:03:12.437726 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f4cc0278-d3af-4748-9dc2-c938961c9010 tempest-LiveMigrationNegativeTest-570155948 tempest-LiveMigrationNegativeTest-570155948-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:03:12.439109 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f4cc0278-d3af-4748-9dc2-c938961c9010 tempest-LiveMigrationNegativeTest-570155948 tempest-LiveMigrationNegativeTest-570155948-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:03:12.440130 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f4cc0278-d3af-4748-9dc2-c938961c9010 tempest-LiveMigrationNegativeTest-570155948 tempest-LiveMigrationNegativeTest-570155948-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:03:12.487847 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.quota [None req-f4cc0278-d3af-4748-9dc2-c938961c9010 tempest-LiveMigrationNegativeTest-570155948 tempest-LiveMigrationNegativeTest-570155948-project] Getting quotas for project faa1bc7c9d564b0ebc9ecf0a2994f2d8. Resources: {'cores', 'ram', 'instances'} {{(pid=121403) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 01 19:03:12.507231 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.quota [None req-f4cc0278-d3af-4748-9dc2-c938961c9010 tempest-LiveMigrationNegativeTest-570155948 tempest-LiveMigrationNegativeTest-570155948-project] Getting quotas for user 4c14605afbc5445d9763db185a1305d4 and project faa1bc7c9d564b0ebc9ecf0a2994f2d8. Resources: {'cores', 'ram', 'instances'} {{(pid=121403) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 01 19:03:12.526418 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-f4cc0278-d3af-4748-9dc2-c938961c9010 tempest-LiveMigrationNegativeTest-570155948 tempest-LiveMigrationNegativeTest-570155948-project] Going to run 1 instances... {{(pid=121403) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 01 19:03:12.529064 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-f4cc0278-d3af-4748-9dc2-c938961c9010 tempest-LiveMigrationNegativeTest-570155948 tempest-LiveMigrationNegativeTest-570155948-project] [instance: d405fb5d-9aed-4363-a898-cbdfbef5b82a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2d4a0047-1b9e-445f-8af8-1b5c9d93e881',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121403) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 01 19:03:12.630073 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-f4cc0278-d3af-4748-9dc2-c938961c9010 tempest-LiveMigrationNegativeTest-570155948 tempest-LiveMigrationNegativeTest-570155948-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.782394 Nov 01 19:03:12.633352 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1210/2409] 10.222.0.13 () {60 vars in 1147 bytes} [Tue Nov 1 19:03:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 789 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 01 19:03:12.643175 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [req-8794abd7-eeb5-46c5-91f0-18bc0bd259a1 req-f6944e45-701f-4c29-8d9c-9562273259b7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "90b353ab-ef97-4d88-b5bc-b355ff576225", "name": "network-vif-deleted", "tag": "773bb149-e7e8-4592-bede-bd40ac6e3e49"}]} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:03:12.674654 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-8794abd7-eeb5-46c5-91f0-18bc0bd259a1 req-f6944e45-701f-4c29-8d9c-9562273259b7 service nova] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:03:12.675170 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-8794abd7-eeb5-46c5-91f0-18bc0bd259a1 req-f6944e45-701f-4c29-8d9c-9562273259b7 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:03:12.675610 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-8794abd7-eeb5-46c5-91f0-18bc0bd259a1 req-f6944e45-701f-4c29-8d9c-9562273259b7 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:03:12.707786 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.compute.server_external_events [req-8794abd7-eeb5-46c5-91f0-18bc0bd259a1 req-f6944e45-701f-4c29-8d9c-9562273259b7 service nova] Creating event network-vif-deleted:773bb149-e7e8-4592-bede-bd40ac6e3e49 for instance 90b353ab-ef97-4d88-b5bc-b355ff576225 on n-h1-863052-2 Nov 01 19:03:12.718653 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [req-8794abd7-eeb5-46c5-91f0-18bc0bd259a1 req-f6944e45-701f-4c29-8d9c-9562273259b7 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083175 Nov 01 19:03:12.722054 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1211/2410] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Nov 1 19:03:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:03:12.739421 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-b106335c-a7de-4203-823a-03c6f0cee030 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:03:12.742640 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-b106335c-a7de-4203-823a-03c6f0cee030 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] [instance: 992f5ec5-d256-4870-b16d-fc8d9adbd3e7] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:03:12.756159 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-b106335c-a7de-4203-823a-03c6f0cee030 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:03:12.760001 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-b106335c-a7de-4203-823a-03c6f0cee030 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:03:12.760719 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-b106335c-a7de-4203-823a-03c6f0cee030 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:03:12.762540 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-b106335c-a7de-4203-823a-03c6f0cee030 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:03:12.764848 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-b106335c-a7de-4203-823a-03c6f0cee030 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:03:12.765539 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-b106335c-a7de-4203-823a-03c6f0cee030 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:03:12.807352 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-0ba378b6-5571-4ea9-9b4b-98c3f93136ce tempest-SecurityGroupRulesNegativeTestJSON-1578314603 tempest-SecurityGroupRulesNegativeTestJSON-1578314603-project] 10.222.0.13 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.954981 Nov 01 19:03:12.808413 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1200/2411] 10.222.0.13 () {60 vars in 1195 bytes} [Tue Nov 1 19:03:11 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 957 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:03:12.814111 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-8a1096c4-cd1b-467e-b632-2a987b9c4020 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:03:12.815422 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-8a1096c4-cd1b-467e-b632-2a987b9c4020 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] [instance: 90b353ab-ef97-4d88-b5bc-b355ff576225] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:03:12.821658 n-d-863052-2 devstack@n-api.service[121403]: DEBUG dbcounter [-] [121403] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 19:03:12.845935 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-8a1096c4-cd1b-467e-b632-2a987b9c4020 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:03:12.851693 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-8a1096c4-cd1b-467e-b632-2a987b9c4020 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:03:12.853300 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-8a1096c4-cd1b-467e-b632-2a987b9c4020 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:03:12.856823 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-8a1096c4-cd1b-467e-b632-2a987b9c4020 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:03:12.859868 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-8a1096c4-cd1b-467e-b632-2a987b9c4020 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:03:12.863884 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-8a1096c4-cd1b-467e-b632-2a987b9c4020 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:03:12.952442 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-8a1096c4-cd1b-467e-b632-2a987b9c4020 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:03:12.958752 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-8a1096c4-cd1b-467e-b632-2a987b9c4020 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:03:12.959493 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-8a1096c4-cd1b-467e-b632-2a987b9c4020 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:03:12.962129 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.objects.instance [None req-8a1096c4-cd1b-467e-b632-2a987b9c4020 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lazy-loading 'fault' on Instance uuid 90b353ab-ef97-4d88-b5bc-b355ff576225 {{(pid=121402) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 01 19:03:13.173060 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-8a1096c4-cd1b-467e-b632-2a987b9c4020 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a63d69c99a546f0af16329cff3ca717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a1bb191cff948e99c008b5e861ce4a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:03:13.203277 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-8a1096c4-cd1b-467e-b632-2a987b9c4020 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] 10.222.0.13 "GET /compute/v2.1/servers/90b353ab-ef97-4d88-b5bc-b355ff576225" status: 200 len: 1335 microversion: 2.1 time: 0.393300 Nov 01 19:03:13.220609 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1201/2412] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:03:12 2022] GET /compute/v2.1/servers/90b353ab-ef97-4d88-b5bc-b355ff576225 => generated 1335 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:03:13.220609 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-53cecf54-497f-4e9a-aabe-a931d5085edb tempest-LiveMigrationNegativeTest-570155948 tempest-LiveMigrationNegativeTest-570155948-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:03:13.220878 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-53cecf54-497f-4e9a-aabe-a931d5085edb tempest-LiveMigrationNegativeTest-570155948 tempest-LiveMigrationNegativeTest-570155948-project] [instance: d405fb5d-9aed-4363-a898-cbdfbef5b82a] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:03:13.241304 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-b106335c-a7de-4203-823a-03c6f0cee030 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb496b3faac4abbae73d389f2042e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e2520220d454764b8c139a58d78ac83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:03:13.253988 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-b106335c-a7de-4203-823a-03c6f0cee030 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] 10.222.0.13 "GET /compute/v2.1/servers/992f5ec5-d256-4870-b16d-fc8d9adbd3e7" status: 200 len: 1464 microversion: 2.1 time: 0.526525 Nov 01 19:03:13.254957 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1212/2413] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:03:12 2022] GET /compute/v2.1/servers/992f5ec5-d256-4870-b16d-fc8d9adbd3e7 => generated 1464 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:03:13.288353 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-70c64260-dfa9-4e89-82ac-eb92e1e29db6 tempest-SecurityGroupRulesNegativeTestJSON-1578314603 tempest-SecurityGroupRulesNegativeTestJSON-1578314603-project] Action: 'create', calling method: .version_select at 0x7f0ae1f29430>, body: {"security_group_rule": {"parent_group_id": "87ec7808-53a2-462b-857c-45b140389011", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:03:13.340881 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-53cecf54-497f-4e9a-aabe-a931d5085edb tempest-LiveMigrationNegativeTest-570155948 tempest-LiveMigrationNegativeTest-570155948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c14605afbc5445d9763db185a1305d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faa1bc7c9d564b0ebc9ecf0a2994f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:03:13.379103 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-53cecf54-497f-4e9a-aabe-a931d5085edb tempest-LiveMigrationNegativeTest-570155948 tempest-LiveMigrationNegativeTest-570155948-project] 10.222.0.13 "GET /compute/v2.1/servers/d405fb5d-9aed-4363-a898-cbdfbef5b82a" status: 200 len: 1219 microversion: 2.1 time: 0.170874 Nov 01 19:03:13.405305 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1202/2414] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:03:13 2022] GET /compute/v2.1/servers/d405fb5d-9aed-4363-a898-cbdfbef5b82a => generated 1219 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:03:13.419848 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-3304a0e3-7da8-4b6a-b739-2bb072c630fb tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:03:13.421363 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-3304a0e3-7da8-4b6a-b739-2bb072c630fb tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] [instance: 992f5ec5-d256-4870-b16d-fc8d9adbd3e7] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:03:13.455036 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-3304a0e3-7da8-4b6a-b739-2bb072c630fb tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:03:13.455415 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-3304a0e3-7da8-4b6a-b739-2bb072c630fb tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:03:13.455853 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-3304a0e3-7da8-4b6a-b739-2bb072c630fb tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:03:13.459428 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-3304a0e3-7da8-4b6a-b739-2bb072c630fb tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:03:13.460184 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-3304a0e3-7da8-4b6a-b739-2bb072c630fb tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:03:13.463289 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-3304a0e3-7da8-4b6a-b739-2bb072c630fb tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:03:13.479872 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.wsgi [None req-70c64260-dfa9-4e89-82ac-eb92e1e29db6 tempest-SecurityGroupRulesNegativeTestJSON-1578314603 tempest-SecurityGroupRulesNegativeTestJSON-1578314603-project] HTTP exception thrown: This rule already exists in group 87ec7808-53a2-462b-857c-45b140389011 Nov 01 19:03:13.483216 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-70c64260-dfa9-4e89-82ac-eb92e1e29db6 tempest-SecurityGroupRulesNegativeTestJSON-1578314603 tempest-SecurityGroupRulesNegativeTestJSON-1578314603-project] Request method failure captured: Nov 01 19:03:13.483216 n-d-863052-2 devstack@n-api.service[121403]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Nov 01 19:03:13.483216 n-d-863052-2 devstack@n-api.service[121403]: Accept: application/json Nov 01 19:03:13.483216 n-d-863052-2 devstack@n-api.service[121403]: Accept-Encoding: identity Nov 01 19:03:13.483216 n-d-863052-2 devstack@n-api.service[121403]: Connection: close Nov 01 19:03:13.483216 n-d-863052-2 devstack@n-api.service[121403]: Content-Length: 138 Nov 01 19:03:13.483216 n-d-863052-2 devstack@n-api.service[121403]: Content-Type: application/json Nov 01 19:03:13.483216 n-d-863052-2 devstack@n-api.service[121403]: Host: 10.222.0.13 Nov 01 19:03:13.483216 n-d-863052-2 devstack@n-api.service[121403]: Openstack-System-Scope: None Nov 01 19:03:13.483216 n-d-863052-2 devstack@n-api.service[121403]: User-Agent: python-urllib3/1.26.12 Nov 01 19:03:13.483216 n-d-863052-2 devstack@n-api.service[121403]: X-Auth-Token: gAAAAABjYW1uxf1htA0w1sG-JFTkY5H02lsh6-_gb3t9yr-OpcxSaHLA0r3LfSxEAMJ7kwaKtT8vSsgSOyDG4ObX7ixw7sfDFURK-NsHShLFJncT0cGKl13woV71dMUAkGa_YY8ozc_cn9Ldzuh58b5Y1ZyjBTBx32CgZlgJvoIHyaJUkSFLKKo Nov 01 19:03:13.483216 n-d-863052-2 devstack@n-api.service[121403]: X-Domain-Id: None Nov 01 19:03:13.483216 n-d-863052-2 devstack@n-api.service[121403]: X-Domain-Name: None Nov 01 19:03:13.483216 n-d-863052-2 devstack@n-api.service[121403]: X-Identity-Status: Confirmed Nov 01 19:03:13.483216 n-d-863052-2 devstack@n-api.service[121403]: X-Is-Admin-Project: True Nov 01 19:03:13.483216 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Domain-Id: default Nov 01 19:03:13.483216 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Domain-Name: Default Nov 01 19:03:13.483216 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Id: a195cb437f714b9290f2f1f99b9bdc2d Nov 01 19:03:13.483216 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1578314603 Nov 01 19:03:13.483216 n-d-863052-2 devstack@n-api.service[121403]: X-Role: member,reader Nov 01 19:03:13.483216 n-d-863052-2 devstack@n-api.service[121403]: X-Roles: member,reader Nov 01 19:03:13.483216 n-d-863052-2 devstack@n-api.service[121403]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/a195cb437f714b9290f2f1f99b9bdc2d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/a195cb437f714b9290f2f1f99b9bdc2d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_a195cb437f714b9290f2f1f99b9bdc2d", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/a195cb437f714b9290f2f1f99b9bdc2d"}]}] Nov 01 19:03:13.483216 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1578314603 Nov 01 19:03:13.483216 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant-Id: a195cb437f714b9290f2f1f99b9bdc2d Nov 01 19:03:13.483216 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1578314603 Nov 01 19:03:13.483216 n-d-863052-2 devstack@n-api.service[121403]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1578314603-project Nov 01 19:03:13.483216 n-d-863052-2 devstack@n-api.service[121403]: X-User-Domain-Id: default Nov 01 19:03:13.483216 n-d-863052-2 devstack@n-api.service[121403]: X-User-Domain-Name: Default Nov 01 19:03:13.483216 n-d-863052-2 devstack@n-api.service[121403]: X-User-Id: c324b901e66146d0a9adfb788e0569fb Nov 01 19:03:13.483216 n-d-863052-2 devstack@n-api.service[121403]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1578314603-project Nov 01 19:03:13.483216 n-d-863052-2 devstack@n-api.service[121403]: Nov 01 19:03:13.483216 n-d-863052-2 devstack@n-api.service[121403]: {"security_group_rule": {"parent_group_id": "87ec7808-53a2-462b-857c-45b140389011", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Nov 01 19:03:13.483216 n-d-863052-2 devstack@n-api.service[121403]: method: Nov 01 19:03:13.483216 n-d-863052-2 devstack@n-api.service[121403]: exception: This rule already exists in group 87ec7808-53a2-462b-857c-45b140389011 Nov 01 19:03:13.483216 n-d-863052-2 devstack@n-api.service[121403]: action_args: {'body': {'security_group_rule': {'parent_group_id': '87ec7808-53a2-462b-857c-45b140389011', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Nov 01 19:03:13.483216 n-d-863052-2 devstack@n-api.service[121403]: {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 01 19:03:13.483216 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:03:13.483216 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 324, in create Nov 01 19:03:13.483216 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi security_group_api.create_security_group_rule( Nov 01 19:03:13.483216 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 186, in create_security_group_rule Nov 01 19:03:13.483216 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise exception.Invalid(msg) Nov 01 19:03:13.483216 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: This rule already exists in group 87ec7808-53a2-462b-857c-45b140389011 Nov 01 19:03:13.483216 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:03:13.483216 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:03:13.483216 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:03:13.483216 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:03:13.483216 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:03:13.483216 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:03:13.483216 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 01 19:03:13.483216 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 01 19:03:13.483216 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 01 19:03:13.483216 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 01 19:03:13.483216 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 01 19:03:13.483216 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 01 19:03:13.483216 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 327, in create Nov 01 19:03:13.483216 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Nov 01 19:03:13.483216 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: This rule already exists in group 87ec7808-53a2-462b-857c-45b140389011 Nov 01 19:03:13.483216 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:03:13.483216 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:03:13.483216 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:03:13.483216 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:03:13.483216 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:03:13.483216 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:03:13.486532 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 01 19:03:13.486532 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 01 19:03:13.486532 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: This rule already exists in group 87ec7808-53a2-462b-857c-45b140389011 Nov 01 19:03:13.486532 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:03:13.487600 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-70c64260-dfa9-4e89-82ac-eb92e1e29db6 tempest-SecurityGroupRulesNegativeTestJSON-1578314603 tempest-SecurityGroupRulesNegativeTestJSON-1578314603-project] Returning 400 to user: This rule already exists in group 87ec7808-53a2-462b-857c-45b140389011 {{(pid=121403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 01 19:03:13.489171 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-70c64260-dfa9-4e89-82ac-eb92e1e29db6 tempest-SecurityGroupRulesNegativeTestJSON-1578314603 tempest-SecurityGroupRulesNegativeTestJSON-1578314603-project] 10.222.0.13 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 114 microversion: 2.1 time: 0.227194 Nov 01 19:03:13.490291 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1213/2415] 10.222.0.13 () {60 vars in 1195 bytes} [Tue Nov 1 19:03:13 2022] POST /compute/v2.1/os-security-group-rules => generated 114 bytes in 232 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 01 19:03:13.503967 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-30009ca9-f00a-478d-b108-2bfd73c5ad06 tempest-SecurityGroupRulesNegativeTestJSON-1578314603 tempest-SecurityGroupRulesNegativeTestJSON-1578314603-project] Calling method '.version_select at 0x7f0ae2069040>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:03:13.761029 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-30009ca9-f00a-478d-b108-2bfd73c5ad06 tempest-SecurityGroupRulesNegativeTestJSON-1578314603 tempest-SecurityGroupRulesNegativeTestJSON-1578314603-project] 10.222.0.13 "DELETE /compute/v2.1/os-security-group-rules/52aaed5b-befd-4a02-9dcd-4e0b50c0951e" status: 202 len: 0 microversion: 2.1 time: 0.265638 Nov 01 19:03:13.762846 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1214/2416] 10.222.0.13 () {58 vars in 1287 bytes} [Tue Nov 1 19:03:13 2022] DELETE /compute/v2.1/os-security-group-rules/52aaed5b-befd-4a02-9dcd-4e0b50c0951e => generated 0 bytes in 269 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 01 19:03:13.776277 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-6d2b77f8-db0d-46e5-b9cc-7905de1b113c tempest-SecurityGroupRulesNegativeTestJSON-1578314603 tempest-SecurityGroupRulesNegativeTestJSON-1578314603-project] Action: 'create', calling method: .version_select at 0x7f0ae20fb280>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-158216259", "description": "tempest-description-62051825"}} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:03:14.057766 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-3304a0e3-7da8-4b6a-b739-2bb072c630fb tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb496b3faac4abbae73d389f2042e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e2520220d454764b8c139a58d78ac83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:03:14.091548 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-3304a0e3-7da8-4b6a-b739-2bb072c630fb tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] 10.222.0.13 "GET /compute/v2.1/servers/992f5ec5-d256-4870-b16d-fc8d9adbd3e7" status: 200 len: 1464 microversion: 2.1 time: 0.684842 Nov 01 19:03:14.097290 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1203/2417] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:03:13 2022] GET /compute/v2.1/servers/992f5ec5-d256-4870-b16d-fc8d9adbd3e7 => generated 1464 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:03:14.131517 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-2e386428-c891-4aa7-8c73-fdd414b69fed tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "2d4a0047-1b9e-445f-8af8-1b5c9d93e881"}} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:03:14.143224 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-6d2b77f8-db0d-46e5-b9cc-7905de1b113c tempest-SecurityGroupRulesNegativeTestJSON-1578314603 tempest-SecurityGroupRulesNegativeTestJSON-1578314603-project] 10.222.0.13 "POST /compute/v2.1/os-security-groups" status: 200 len: 253 microversion: 2.1 time: 0.372437 Nov 01 19:03:14.144135 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1215/2418] 10.222.0.13 () {60 vars in 1180 bytes} [Tue Nov 1 19:03:13 2022] POST /compute/v2.1/os-security-groups => generated 253 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 01 19:03:14.157644 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-e4c1fd97-60e4-4540-9bbe-222d99fe4d96 tempest-SecurityGroupRulesNegativeTestJSON-1578314603 tempest-SecurityGroupRulesNegativeTestJSON-1578314603-project] Action: 'create', calling method: .version_select at 0x7f0ae67e38b0>, body: {"security_group_rule": {"parent_group_id": "a0cffbb9-c2ed-4018-aafe-2d3811b9603e", "ip_protocol": "tcp", "from_port": 1474641089, "to_port": 22}} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:03:14.158246 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-2e386428-c891-4aa7-8c73-fdd414b69fed tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] [instance: 992f5ec5-d256-4870-b16d-fc8d9adbd3e7] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:03:14.179864 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2e386428-c891-4aa7-8c73-fdd414b69fed tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:03:14.182764 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2e386428-c891-4aa7-8c73-fdd414b69fed tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:03:14.183895 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2e386428-c891-4aa7-8c73-fdd414b69fed tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:03:14.200890 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2e386428-c891-4aa7-8c73-fdd414b69fed tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:03:14.201572 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2e386428-c891-4aa7-8c73-fdd414b69fed tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:03:14.203846 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2e386428-c891-4aa7-8c73-fdd414b69fed tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:03:14.311735 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.wsgi [None req-e4c1fd97-60e4-4540-9bbe-222d99fe4d96 tempest-SecurityGroupRulesNegativeTestJSON-1578314603 tempest-SecurityGroupRulesNegativeTestJSON-1578314603-project] HTTP exception thrown: Invalid port range 1474641089:22. Former value cannot be greater than the later Nov 01 19:03:14.314271 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-e4c1fd97-60e4-4540-9bbe-222d99fe4d96 tempest-SecurityGroupRulesNegativeTestJSON-1578314603 tempest-SecurityGroupRulesNegativeTestJSON-1578314603-project] Request method failure captured: Nov 01 19:03:14.314271 n-d-863052-2 devstack@n-api.service[121403]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Nov 01 19:03:14.314271 n-d-863052-2 devstack@n-api.service[121403]: Accept: application/json Nov 01 19:03:14.314271 n-d-863052-2 devstack@n-api.service[121403]: Accept-Encoding: identity Nov 01 19:03:14.314271 n-d-863052-2 devstack@n-api.service[121403]: Connection: close Nov 01 19:03:14.314271 n-d-863052-2 devstack@n-api.service[121403]: Content-Length: 146 Nov 01 19:03:14.314271 n-d-863052-2 devstack@n-api.service[121403]: Content-Type: application/json Nov 01 19:03:14.314271 n-d-863052-2 devstack@n-api.service[121403]: Host: 10.222.0.13 Nov 01 19:03:14.314271 n-d-863052-2 devstack@n-api.service[121403]: Openstack-System-Scope: None Nov 01 19:03:14.314271 n-d-863052-2 devstack@n-api.service[121403]: User-Agent: python-urllib3/1.26.12 Nov 01 19:03:14.314271 n-d-863052-2 devstack@n-api.service[121403]: X-Auth-Token: gAAAAABjYW1uxf1htA0w1sG-JFTkY5H02lsh6-_gb3t9yr-OpcxSaHLA0r3LfSxEAMJ7kwaKtT8vSsgSOyDG4ObX7ixw7sfDFURK-NsHShLFJncT0cGKl13woV71dMUAkGa_YY8ozc_cn9Ldzuh58b5Y1ZyjBTBx32CgZlgJvoIHyaJUkSFLKKo Nov 01 19:03:14.314271 n-d-863052-2 devstack@n-api.service[121403]: X-Domain-Id: None Nov 01 19:03:14.314271 n-d-863052-2 devstack@n-api.service[121403]: X-Domain-Name: None Nov 01 19:03:14.314271 n-d-863052-2 devstack@n-api.service[121403]: X-Identity-Status: Confirmed Nov 01 19:03:14.314271 n-d-863052-2 devstack@n-api.service[121403]: X-Is-Admin-Project: True Nov 01 19:03:14.314271 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Domain-Id: default Nov 01 19:03:14.314271 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Domain-Name: Default Nov 01 19:03:14.314271 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Id: a195cb437f714b9290f2f1f99b9bdc2d Nov 01 19:03:14.314271 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1578314603 Nov 01 19:03:14.314271 n-d-863052-2 devstack@n-api.service[121403]: X-Role: member,reader Nov 01 19:03:14.314271 n-d-863052-2 devstack@n-api.service[121403]: X-Roles: member,reader Nov 01 19:03:14.314271 n-d-863052-2 devstack@n-api.service[121403]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/a195cb437f714b9290f2f1f99b9bdc2d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/a195cb437f714b9290f2f1f99b9bdc2d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_a195cb437f714b9290f2f1f99b9bdc2d", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/a195cb437f714b9290f2f1f99b9bdc2d"}]}] Nov 01 19:03:14.314271 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1578314603 Nov 01 19:03:14.314271 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant-Id: a195cb437f714b9290f2f1f99b9bdc2d Nov 01 19:03:14.314271 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1578314603 Nov 01 19:03:14.314271 n-d-863052-2 devstack@n-api.service[121403]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1578314603-project Nov 01 19:03:14.314271 n-d-863052-2 devstack@n-api.service[121403]: X-User-Domain-Id: default Nov 01 19:03:14.314271 n-d-863052-2 devstack@n-api.service[121403]: X-User-Domain-Name: Default Nov 01 19:03:14.314271 n-d-863052-2 devstack@n-api.service[121403]: X-User-Id: c324b901e66146d0a9adfb788e0569fb Nov 01 19:03:14.314271 n-d-863052-2 devstack@n-api.service[121403]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1578314603-project Nov 01 19:03:14.314271 n-d-863052-2 devstack@n-api.service[121403]: Nov 01 19:03:14.314271 n-d-863052-2 devstack@n-api.service[121403]: {"security_group_rule": {"parent_group_id": "a0cffbb9-c2ed-4018-aafe-2d3811b9603e", "ip_protocol": "tcp", "from_port": 1474641089, "to_port": 22}} Nov 01 19:03:14.314271 n-d-863052-2 devstack@n-api.service[121403]: method: Nov 01 19:03:14.314271 n-d-863052-2 devstack@n-api.service[121403]: exception: Invalid port range 1474641089:22. Former value cannot be greater than the later Nov 01 19:03:14.314271 n-d-863052-2 devstack@n-api.service[121403]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'a0cffbb9-c2ed-4018-aafe-2d3811b9603e', 'ip_protocol': 'tcp', 'from_port': 1474641089, 'to_port': 22}}} Nov 01 19:03:14.314271 n-d-863052-2 devstack@n-api.service[121403]: {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 01 19:03:14.314271 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:03:14.314271 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Nov 01 19:03:14.314271 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Nov 01 19:03:14.314271 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Nov 01 19:03:14.314271 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Nov 01 19:03:14.314271 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Nov 01 19:03:14.314271 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Nov 01 19:03:14.314271 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 150, in _new_ingress_rule Nov 01 19:03:14.314271 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Nov 01 19:03:14.314271 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 1474641089:22. Former value cannot be greater than the later Nov 01 19:03:14.314271 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:03:14.314271 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:03:14.314271 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:03:14.314271 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:03:14.314271 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:03:14.314271 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:03:14.314271 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 01 19:03:14.314271 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 01 19:03:14.314271 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 01 19:03:14.314271 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 01 19:03:14.314271 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 01 19:03:14.314271 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 01 19:03:14.314271 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Nov 01 19:03:14.314271 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Nov 01 19:03:14.314271 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 1474641089:22. Former value cannot be greater than the later Nov 01 19:03:14.314271 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:03:14.318110 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:03:14.318110 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:03:14.318110 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:03:14.318110 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:03:14.318110 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:03:14.318110 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 01 19:03:14.318110 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 01 19:03:14.318110 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 1474641089:22. Former value cannot be greater than the later Nov 01 19:03:14.318110 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:03:14.319808 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-e4c1fd97-60e4-4540-9bbe-222d99fe4d96 tempest-SecurityGroupRulesNegativeTestJSON-1578314603 tempest-SecurityGroupRulesNegativeTestJSON-1578314603-project] Returning 400 to user: Invalid port range 1474641089:22. Former value cannot be greater than the later {{(pid=121403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 01 19:03:14.321159 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-e4c1fd97-60e4-4540-9bbe-222d99fe4d96 tempest-SecurityGroupRulesNegativeTestJSON-1578314603 tempest-SecurityGroupRulesNegativeTestJSON-1578314603-project] 10.222.0.13 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 123 microversion: 2.1 time: 0.168089 Nov 01 19:03:14.322516 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1216/2419] 10.222.0.13 () {60 vars in 1195 bytes} [Tue Nov 1 19:03:14 2022] POST /compute/v2.1/os-security-group-rules => generated 123 bytes in 170 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Nov 01 19:03:14.327550 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-9f3e7927-b897-441e-978c-d0487a0b9dce tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:03:14.329770 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-9f3e7927-b897-441e-978c-d0487a0b9dce tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] [instance: 90b353ab-ef97-4d88-b5bc-b355ff576225] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:03:14.338562 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-9f3e7927-b897-441e-978c-d0487a0b9dce tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:03:14.339262 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-9f3e7927-b897-441e-978c-d0487a0b9dce tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:03:14.340204 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-9f3e7927-b897-441e-978c-d0487a0b9dce tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:03:14.341363 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-9f3e7927-b897-441e-978c-d0487a0b9dce tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:03:14.342936 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-9f3e7927-b897-441e-978c-d0487a0b9dce tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:03:14.343778 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-9f3e7927-b897-441e-978c-d0487a0b9dce tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:03:14.351525 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.virt.hardware [None req-2e386428-c891-4aa7-8c73-fdd414b69fed tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Flavor limits 0:0:0 {{(pid=121402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 01 19:03:14.351757 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.virt.hardware [None req-2e386428-c891-4aa7-8c73-fdd414b69fed tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Image limits 0:0:0 {{(pid=121402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 01 19:03:14.352690 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.virt.hardware [None req-2e386428-c891-4aa7-8c73-fdd414b69fed tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Flavor pref 0:0:0 {{(pid=121402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 01 19:03:14.353253 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.virt.hardware [None req-2e386428-c891-4aa7-8c73-fdd414b69fed tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Image pref 0:0:0 {{(pid=121402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 01 19:03:14.354629 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.virt.hardware [None req-2e386428-c891-4aa7-8c73-fdd414b69fed tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 01 19:03:14.362115 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.wsgi [None req-9f3e7927-b897-441e-978c-d0487a0b9dce tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] HTTP exception thrown: Instance 90b353ab-ef97-4d88-b5bc-b355ff576225 could not be found. Nov 01 19:03:14.364933 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-9f3e7927-b897-441e-978c-d0487a0b9dce tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Request method failure captured: Nov 01 19:03:14.364933 n-d-863052-2 devstack@n-api.service[121403]: request: GET /compute/v2.1/servers/90b353ab-ef97-4d88-b5bc-b355ff576225 HTTP/1.1 Nov 01 19:03:14.364933 n-d-863052-2 devstack@n-api.service[121403]: Accept: application/json Nov 01 19:03:14.364933 n-d-863052-2 devstack@n-api.service[121403]: Accept-Encoding: identity Nov 01 19:03:14.364933 n-d-863052-2 devstack@n-api.service[121403]: Connection: close Nov 01 19:03:14.364933 n-d-863052-2 devstack@n-api.service[121403]: Content-Length: 0 Nov 01 19:03:14.364933 n-d-863052-2 devstack@n-api.service[121403]: Content-Type: application/json Nov 01 19:03:14.364933 n-d-863052-2 devstack@n-api.service[121403]: Host: 10.222.0.13 Nov 01 19:03:14.364933 n-d-863052-2 devstack@n-api.service[121403]: Openstack-System-Scope: None Nov 01 19:03:14.364933 n-d-863052-2 devstack@n-api.service[121403]: User-Agent: python-urllib3/1.26.12 Nov 01 19:03:14.364933 n-d-863052-2 devstack@n-api.service[121403]: X-Auth-Token: gAAAAABjYWwgP3kjyQKi9Uf4PP24jmeKCOPNU51FZoHLreZdbFyZPhRW-EeK2Se64f-CjytM5LjMEtkBLCti_PQz0S3BXRBnTu4aanJgpXShIx2i6Yz4YqCrWhQ373B1BFIdgiChyw2k6U5YvJRz35UfhTE-zhCjFxCXYsQplbVOAVzO2wYqVeI Nov 01 19:03:14.364933 n-d-863052-2 devstack@n-api.service[121403]: X-Domain-Id: None Nov 01 19:03:14.364933 n-d-863052-2 devstack@n-api.service[121403]: X-Domain-Name: None Nov 01 19:03:14.364933 n-d-863052-2 devstack@n-api.service[121403]: X-Identity-Status: Confirmed Nov 01 19:03:14.364933 n-d-863052-2 devstack@n-api.service[121403]: X-Is-Admin-Project: True Nov 01 19:03:14.364933 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Domain-Id: default Nov 01 19:03:14.364933 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Domain-Name: Default Nov 01 19:03:14.364933 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Id: 4a1bb191cff948e99c008b5e861ce4a8 Nov 01 19:03:14.364933 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-215636868 Nov 01 19:03:14.364933 n-d-863052-2 devstack@n-api.service[121403]: X-Role: member,reader Nov 01 19:03:14.364933 n-d-863052-2 devstack@n-api.service[121403]: X-Roles: member,reader Nov 01 19:03:14.364933 n-d-863052-2 devstack@n-api.service[121403]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/4a1bb191cff948e99c008b5e861ce4a8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/4a1bb191cff948e99c008b5e861ce4a8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_4a1bb191cff948e99c008b5e861ce4a8", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/4a1bb191cff948e99c008b5e861ce4a8"}]}] Nov 01 19:03:14.364933 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant: tempest-ServerRescueNegativeTestJSON-215636868 Nov 01 19:03:14.364933 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant-Id: 4a1bb191cff948e99c008b5e861ce4a8 Nov 01 19:03:14.364933 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-215636868 Nov 01 19:03:14.364933 n-d-863052-2 devstack@n-api.service[121403]: X-User: tempest-ServerRescueNegativeTestJSON-215636868-project Nov 01 19:03:14.364933 n-d-863052-2 devstack@n-api.service[121403]: X-User-Domain-Id: default Nov 01 19:03:14.364933 n-d-863052-2 devstack@n-api.service[121403]: X-User-Domain-Name: Default Nov 01 19:03:14.364933 n-d-863052-2 devstack@n-api.service[121403]: X-User-Id: 6a63d69c99a546f0af16329cff3ca717 Nov 01 19:03:14.364933 n-d-863052-2 devstack@n-api.service[121403]: X-User-Name: tempest-ServerRescueNegativeTestJSON-215636868-project Nov 01 19:03:14.364933 n-d-863052-2 devstack@n-api.service[121403]: method: > Nov 01 19:03:14.364933 n-d-863052-2 devstack@n-api.service[121403]: exception: Instance 90b353ab-ef97-4d88-b5bc-b355ff576225 could not be found. Nov 01 19:03:14.364933 n-d-863052-2 devstack@n-api.service[121403]: action_args: {'id': '90b353ab-ef97-4d88-b5bc-b355ff576225'} Nov 01 19:03:14.364933 n-d-863052-2 devstack@n-api.service[121403]: {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 01 19:03:14.364933 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:03:14.364933 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 01 19:03:14.364933 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 01 19:03:14.364933 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 01 19:03:14.364933 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 01 19:03:14.364933 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 01 19:03:14.364933 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 01 19:03:14.364933 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 01 19:03:14.364933 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 01 19:03:14.364933 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 90b353ab-ef97-4d88-b5bc-b355ff576225 could not be found. Nov 01 19:03:14.364933 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:03:14.364933 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:03:14.364933 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:03:14.364933 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:03:14.364933 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:03:14.364933 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:03:14.364933 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 01 19:03:14.364933 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 01 19:03:14.364933 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 01 19:03:14.364933 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 01 19:03:14.364933 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 01 19:03:14.364933 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 01 19:03:14.364933 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 01 19:03:14.364933 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 01 19:03:14.364933 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 01 19:03:14.364933 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 01 19:03:14.364933 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 90b353ab-ef97-4d88-b5bc-b355ff576225 could not be found. Nov 01 19:03:14.364933 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:03:14.364933 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:03:14.368955 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:03:14.368955 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:03:14.368955 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:03:14.368955 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:03:14.368955 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 01 19:03:14.368955 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 01 19:03:14.368955 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 90b353ab-ef97-4d88-b5bc-b355ff576225 could not be found. Nov 01 19:03:14.368955 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:03:14.371072 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-9f3e7927-b897-441e-978c-d0487a0b9dce tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Returning 404 to user: Instance 90b353ab-ef97-4d88-b5bc-b355ff576225 could not be found. {{(pid=121403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 01 19:03:14.372562 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-9f3e7927-b897-441e-978c-d0487a0b9dce tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] 10.222.0.13 "GET /compute/v2.1/servers/90b353ab-ef97-4d88-b5bc-b355ff576225" status: 404 len: 111 microversion: 2.1 time: 0.048632 Nov 01 19:03:14.373736 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1217/2420] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:03:14 2022] GET /compute/v2.1/servers/90b353ab-ef97-4d88-b5bc-b355ff576225 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 01 19:03:14.383142 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-c397078a-f6c4-447f-968a-05284d4e1be5 tempest-SecurityGroupRulesNegativeTestJSON-1578314603 tempest-SecurityGroupRulesNegativeTestJSON-1578314603-project] Action: 'create', calling method: .version_select at 0x7f0ae2817700>, body: {"security_group_rule": {"parent_group_id": "tempest-non_int_id-1639346232", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:03:14.385897 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.wsgi [None req-c397078a-f6c4-447f-968a-05284d4e1be5 tempest-SecurityGroupRulesNegativeTestJSON-1578314603 tempest-SecurityGroupRulesNegativeTestJSON-1578314603-project] HTTP exception thrown: Security group id should be uuid Nov 01 19:03:14.387630 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-c397078a-f6c4-447f-968a-05284d4e1be5 tempest-SecurityGroupRulesNegativeTestJSON-1578314603 tempest-SecurityGroupRulesNegativeTestJSON-1578314603-project] Request method failure captured: Nov 01 19:03:14.387630 n-d-863052-2 devstack@n-api.service[121403]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Nov 01 19:03:14.387630 n-d-863052-2 devstack@n-api.service[121403]: Accept: application/json Nov 01 19:03:14.387630 n-d-863052-2 devstack@n-api.service[121403]: Accept-Encoding: identity Nov 01 19:03:14.387630 n-d-863052-2 devstack@n-api.service[121403]: Connection: close Nov 01 19:03:14.387630 n-d-863052-2 devstack@n-api.service[121403]: Content-Length: 131 Nov 01 19:03:14.387630 n-d-863052-2 devstack@n-api.service[121403]: Content-Type: application/json Nov 01 19:03:14.387630 n-d-863052-2 devstack@n-api.service[121403]: Host: 10.222.0.13 Nov 01 19:03:14.387630 n-d-863052-2 devstack@n-api.service[121403]: Openstack-System-Scope: None Nov 01 19:03:14.387630 n-d-863052-2 devstack@n-api.service[121403]: User-Agent: python-urllib3/1.26.12 Nov 01 19:03:14.387630 n-d-863052-2 devstack@n-api.service[121403]: X-Auth-Token: gAAAAABjYW1uxf1htA0w1sG-JFTkY5H02lsh6-_gb3t9yr-OpcxSaHLA0r3LfSxEAMJ7kwaKtT8vSsgSOyDG4ObX7ixw7sfDFURK-NsHShLFJncT0cGKl13woV71dMUAkGa_YY8ozc_cn9Ldzuh58b5Y1ZyjBTBx32CgZlgJvoIHyaJUkSFLKKo Nov 01 19:03:14.387630 n-d-863052-2 devstack@n-api.service[121403]: X-Domain-Id: None Nov 01 19:03:14.387630 n-d-863052-2 devstack@n-api.service[121403]: X-Domain-Name: None Nov 01 19:03:14.387630 n-d-863052-2 devstack@n-api.service[121403]: X-Identity-Status: Confirmed Nov 01 19:03:14.387630 n-d-863052-2 devstack@n-api.service[121403]: X-Is-Admin-Project: True Nov 01 19:03:14.387630 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Domain-Id: default Nov 01 19:03:14.387630 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Domain-Name: Default Nov 01 19:03:14.387630 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Id: a195cb437f714b9290f2f1f99b9bdc2d Nov 01 19:03:14.387630 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1578314603 Nov 01 19:03:14.387630 n-d-863052-2 devstack@n-api.service[121403]: X-Role: member,reader Nov 01 19:03:14.387630 n-d-863052-2 devstack@n-api.service[121403]: X-Roles: member,reader Nov 01 19:03:14.387630 n-d-863052-2 devstack@n-api.service[121403]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/a195cb437f714b9290f2f1f99b9bdc2d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/a195cb437f714b9290f2f1f99b9bdc2d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_a195cb437f714b9290f2f1f99b9bdc2d", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/a195cb437f714b9290f2f1f99b9bdc2d"}]}] Nov 01 19:03:14.387630 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1578314603 Nov 01 19:03:14.387630 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant-Id: a195cb437f714b9290f2f1f99b9bdc2d Nov 01 19:03:14.387630 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1578314603 Nov 01 19:03:14.387630 n-d-863052-2 devstack@n-api.service[121403]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1578314603-project Nov 01 19:03:14.387630 n-d-863052-2 devstack@n-api.service[121403]: X-User-Domain-Id: default Nov 01 19:03:14.387630 n-d-863052-2 devstack@n-api.service[121403]: X-User-Domain-Name: Default Nov 01 19:03:14.387630 n-d-863052-2 devstack@n-api.service[121403]: X-User-Id: c324b901e66146d0a9adfb788e0569fb Nov 01 19:03:14.387630 n-d-863052-2 devstack@n-api.service[121403]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1578314603-project Nov 01 19:03:14.387630 n-d-863052-2 devstack@n-api.service[121403]: Nov 01 19:03:14.387630 n-d-863052-2 devstack@n-api.service[121403]: {"security_group_rule": {"parent_group_id": "tempest-non_int_id-1639346232", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Nov 01 19:03:14.387630 n-d-863052-2 devstack@n-api.service[121403]: method: Nov 01 19:03:14.387630 n-d-863052-2 devstack@n-api.service[121403]: exception: Security group id should be uuid Nov 01 19:03:14.387630 n-d-863052-2 devstack@n-api.service[121403]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'tempest-non_int_id-1639346232', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Nov 01 19:03:14.387630 n-d-863052-2 devstack@n-api.service[121403]: {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 01 19:03:14.387630 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:03:14.387630 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 285, in create Nov 01 19:03:14.387630 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi parent_group_id = security_group_api.validate_id( Nov 01 19:03:14.387630 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 51, in validate_id Nov 01 19:03:14.387630 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise exception.Invalid(msg) Nov 01 19:03:14.387630 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security group id should be uuid Nov 01 19:03:14.387630 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:03:14.387630 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:03:14.387630 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:03:14.387630 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:03:14.387630 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:03:14.387630 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:03:14.387630 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 01 19:03:14.387630 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 01 19:03:14.387630 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 01 19:03:14.387630 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 01 19:03:14.387630 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 01 19:03:14.387630 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 01 19:03:14.387630 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Nov 01 19:03:14.387630 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Nov 01 19:03:14.387630 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security group id should be uuid Nov 01 19:03:14.387630 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:03:14.387630 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:03:14.387630 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:03:14.387630 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:03:14.387630 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:03:14.387630 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:03:14.387630 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 01 19:03:14.387630 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 01 19:03:14.392261 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group id should be uuid Nov 01 19:03:14.392261 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:03:14.394487 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-c397078a-f6c4-447f-968a-05284d4e1be5 tempest-SecurityGroupRulesNegativeTestJSON-1578314603 tempest-SecurityGroupRulesNegativeTestJSON-1578314603-project] Returning 400 to user: Security group id should be uuid {{(pid=121403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 01 19:03:14.396492 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-c397078a-f6c4-447f-968a-05284d4e1be5 tempest-SecurityGroupRulesNegativeTestJSON-1578314603 tempest-SecurityGroupRulesNegativeTestJSON-1578314603-project] 10.222.0.13 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 76 microversion: 2.1 time: 0.021435 Nov 01 19:03:14.398732 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1218/2421] 10.222.0.13 () {60 vars in 1195 bytes} [Tue Nov 1 19:03:14 2022] POST /compute/v2.1/os-security-group-rules => generated 76 bytes in 24 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Nov 01 19:03:14.404383 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-9bbf2635-dff3-4a11-a490-22aa8832fc3a tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Calling method '.version_select at 0x7f0ae20bbb80>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:03:14.442372 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-9bbf2635-dff3-4a11-a490-22aa8832fc3a tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-230221922" status: 202 len: 0 microversion: 2.1 time: 0.041292 Nov 01 19:03:14.445955 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1219/2422] 10.222.0.13 () {58 vars in 1218 bytes} [Tue Nov 1 19:03:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-230221922 => generated 0 bytes in 46 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 01 19:03:14.475332 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-2e386428-c891-4aa7-8c73-fdd414b69fed tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] [instance: 992f5ec5-d256-4870-b16d-fc8d9adbd3e7] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:03:14.483313 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-3264cebd-f40b-497f-bae1-619a7d9a3c59 tempest-SecurityGroupRulesNegativeTestJSON-1578314603 tempest-SecurityGroupRulesNegativeTestJSON-1578314603-project] Action: 'create', calling method: .version_select at 0x7f0ae2817670>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1476985421", "description": "tempest-description-1389523187"}} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:03:14.486461 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2e386428-c891-4aa7-8c73-fdd414b69fed tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:03:14.487339 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2e386428-c891-4aa7-8c73-fdd414b69fed tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:03:14.488061 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2e386428-c891-4aa7-8c73-fdd414b69fed tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:03:14.489450 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2e386428-c891-4aa7-8c73-fdd414b69fed tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:03:14.490194 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2e386428-c891-4aa7-8c73-fdd414b69fed tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:03:14.491523 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2e386428-c891-4aa7-8c73-fdd414b69fed tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:03:14.535876 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-2e386428-c891-4aa7-8c73-fdd414b69fed tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] 10.222.0.13 "POST /compute/v2.1/servers/992f5ec5-d256-4870-b16d-fc8d9adbd3e7/action" status: 202 len: 1068 microversion: 2.1 time: 0.415353 Nov 01 19:03:14.537587 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1204/2423] 10.222.0.13 () {60 vars in 1278 bytes} [Tue Nov 1 19:03:14 2022] POST /compute/v2.1/servers/992f5ec5-d256-4870-b16d-fc8d9adbd3e7/action => generated 1068 bytes in 418 msecs (HTTP/1.1 202) 10 headers in 452 bytes (2 switches on core 0) Nov 01 19:03:14.544439 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-0259bef4-c613-4526-8708-c54c755990f1 tempest-LiveMigrationNegativeTest-570155948 tempest-LiveMigrationNegativeTest-570155948-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:03:14.545607 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-0259bef4-c613-4526-8708-c54c755990f1 tempest-LiveMigrationNegativeTest-570155948 tempest-LiveMigrationNegativeTest-570155948-project] [instance: d405fb5d-9aed-4363-a898-cbdfbef5b82a] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:03:14.555809 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-0259bef4-c613-4526-8708-c54c755990f1 tempest-LiveMigrationNegativeTest-570155948 tempest-LiveMigrationNegativeTest-570155948-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:03:14.556974 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-0259bef4-c613-4526-8708-c54c755990f1 tempest-LiveMigrationNegativeTest-570155948 tempest-LiveMigrationNegativeTest-570155948-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:03:14.558456 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-0259bef4-c613-4526-8708-c54c755990f1 tempest-LiveMigrationNegativeTest-570155948 tempest-LiveMigrationNegativeTest-570155948-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:03:14.559459 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-0259bef4-c613-4526-8708-c54c755990f1 tempest-LiveMigrationNegativeTest-570155948 tempest-LiveMigrationNegativeTest-570155948-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:03:14.560897 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-0259bef4-c613-4526-8708-c54c755990f1 tempest-LiveMigrationNegativeTest-570155948 tempest-LiveMigrationNegativeTest-570155948-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:03:14.564201 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-0259bef4-c613-4526-8708-c54c755990f1 tempest-LiveMigrationNegativeTest-570155948 tempest-LiveMigrationNegativeTest-570155948-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:03:14.684388 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-0259bef4-c613-4526-8708-c54c755990f1 tempest-LiveMigrationNegativeTest-570155948 tempest-LiveMigrationNegativeTest-570155948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c14605afbc5445d9763db185a1305d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faa1bc7c9d564b0ebc9ecf0a2994f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:03:14.730708 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-0259bef4-c613-4526-8708-c54c755990f1 tempest-LiveMigrationNegativeTest-570155948 tempest-LiveMigrationNegativeTest-570155948-project] 10.222.0.13 "GET /compute/v2.1/servers/d405fb5d-9aed-4363-a898-cbdfbef5b82a" status: 200 len: 1271 microversion: 2.1 time: 0.191350 Nov 01 19:03:14.732066 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1205/2424] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:03:14 2022] GET /compute/v2.1/servers/d405fb5d-9aed-4363-a898-cbdfbef5b82a => generated 1271 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:03:14.754904 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-78664938-266b-41c3-a3f7-36cdda012cf5 tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-213809168", "imageRef": "2d4a0047-1b9e-445f-8af8-1b5c9d93e881", "flavorRef": "452", "networks": [{"uuid": "1ed4474a-44aa-4486-abda-82dbb3f933cb"}, {"uuid": "c6826e94-4032-4ccc-89b4-1c135535194a"}]}} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:03:14.851888 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.network.neutron [None req-78664938-266b-41c3-a3f7-36cdda012cf5 tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] validate_networks() for [('1ed4474a-44aa-4486-abda-82dbb3f933cb', None, None, None, None, None), ('c6826e94-4032-4ccc-89b4-1c135535194a', None, None, None, None, None)] {{(pid=121402) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 01 19:03:15.210887 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-3264cebd-f40b-497f-bae1-619a7d9a3c59 tempest-SecurityGroupRulesNegativeTestJSON-1578314603 tempest-SecurityGroupRulesNegativeTestJSON-1578314603-project] 10.222.0.13 "POST /compute/v2.1/os-security-groups" status: 200 len: 256 microversion: 2.1 time: 0.739799 Nov 01 19:03:15.211881 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1220/2425] 10.222.0.13 () {60 vars in 1180 bytes} [Tue Nov 1 19:03:14 2022] POST /compute/v2.1/os-security-groups => generated 256 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:03:15.227033 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-505ae89a-25ad-4cb1-8c04-b44942c14712 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:03:15.228722 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-505ae89a-25ad-4cb1-8c04-b44942c14712 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] [instance: 992f5ec5-d256-4870-b16d-fc8d9adbd3e7] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:03:15.251038 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-505ae89a-25ad-4cb1-8c04-b44942c14712 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:03:15.257379 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-505ae89a-25ad-4cb1-8c04-b44942c14712 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:03:15.257913 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-505ae89a-25ad-4cb1-8c04-b44942c14712 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:03:15.260404 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-505ae89a-25ad-4cb1-8c04-b44942c14712 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:03:15.260979 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-505ae89a-25ad-4cb1-8c04-b44942c14712 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:03:15.261445 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-505ae89a-25ad-4cb1-8c04-b44942c14712 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:03:15.663546 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-505ae89a-25ad-4cb1-8c04-b44942c14712 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb496b3faac4abbae73d389f2042e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e2520220d454764b8c139a58d78ac83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:03:15.678458 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-505ae89a-25ad-4cb1-8c04-b44942c14712 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] 10.222.0.13 "GET /compute/v2.1/servers/992f5ec5-d256-4870-b16d-fc8d9adbd3e7" status: 200 len: 1473 microversion: 2.1 time: 0.465089 Nov 01 19:03:15.679700 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1221/2426] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:03:15 2022] GET /compute/v2.1/servers/992f5ec5-d256-4870-b16d-fc8d9adbd3e7 => generated 1473 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:03:15.697881 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-e91bbb6e-a558-42af-9710-cff88d76b391 tempest-SecurityGroupRulesNegativeTestJSON-1578314603 tempest-SecurityGroupRulesNegativeTestJSON-1578314603-project] Action: 'create', calling method: .version_select at 0x7f0ae2106b80>, body: {"security_group_rule": {"parent_group_id": "abf224b0-9dcb-4a33-a103-72a9a33b174d", "ip_protocol": "tempest-999-2097175807", "from_port": 22, "to_port": 22}} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:03:15.862724 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.wsgi [None req-e91bbb6e-a558-42af-9710-cff88d76b391 tempest-SecurityGroupRulesNegativeTestJSON-1578314603 tempest-SecurityGroupRulesNegativeTestJSON-1578314603-project] HTTP exception thrown: Invalid IP protocol tempest-999-2097175807. Nov 01 19:03:15.865200 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-e91bbb6e-a558-42af-9710-cff88d76b391 tempest-SecurityGroupRulesNegativeTestJSON-1578314603 tempest-SecurityGroupRulesNegativeTestJSON-1578314603-project] Request method failure captured: Nov 01 19:03:15.865200 n-d-863052-2 devstack@n-api.service[121403]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Nov 01 19:03:15.865200 n-d-863052-2 devstack@n-api.service[121403]: Accept: application/json Nov 01 19:03:15.865200 n-d-863052-2 devstack@n-api.service[121403]: Accept-Encoding: identity Nov 01 19:03:15.865200 n-d-863052-2 devstack@n-api.service[121403]: Connection: close Nov 01 19:03:15.865200 n-d-863052-2 devstack@n-api.service[121403]: Content-Length: 157 Nov 01 19:03:15.865200 n-d-863052-2 devstack@n-api.service[121403]: Content-Type: application/json Nov 01 19:03:15.865200 n-d-863052-2 devstack@n-api.service[121403]: Host: 10.222.0.13 Nov 01 19:03:15.865200 n-d-863052-2 devstack@n-api.service[121403]: Openstack-System-Scope: None Nov 01 19:03:15.865200 n-d-863052-2 devstack@n-api.service[121403]: User-Agent: python-urllib3/1.26.12 Nov 01 19:03:15.865200 n-d-863052-2 devstack@n-api.service[121403]: X-Auth-Token: gAAAAABjYW1uxf1htA0w1sG-JFTkY5H02lsh6-_gb3t9yr-OpcxSaHLA0r3LfSxEAMJ7kwaKtT8vSsgSOyDG4ObX7ixw7sfDFURK-NsHShLFJncT0cGKl13woV71dMUAkGa_YY8ozc_cn9Ldzuh58b5Y1ZyjBTBx32CgZlgJvoIHyaJUkSFLKKo Nov 01 19:03:15.865200 n-d-863052-2 devstack@n-api.service[121403]: X-Domain-Id: None Nov 01 19:03:15.865200 n-d-863052-2 devstack@n-api.service[121403]: X-Domain-Name: None Nov 01 19:03:15.865200 n-d-863052-2 devstack@n-api.service[121403]: X-Identity-Status: Confirmed Nov 01 19:03:15.865200 n-d-863052-2 devstack@n-api.service[121403]: X-Is-Admin-Project: True Nov 01 19:03:15.865200 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Domain-Id: default Nov 01 19:03:15.865200 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Domain-Name: Default Nov 01 19:03:15.865200 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Id: a195cb437f714b9290f2f1f99b9bdc2d Nov 01 19:03:15.865200 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1578314603 Nov 01 19:03:15.865200 n-d-863052-2 devstack@n-api.service[121403]: X-Role: member,reader Nov 01 19:03:15.865200 n-d-863052-2 devstack@n-api.service[121403]: X-Roles: member,reader Nov 01 19:03:15.865200 n-d-863052-2 devstack@n-api.service[121403]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/a195cb437f714b9290f2f1f99b9bdc2d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/a195cb437f714b9290f2f1f99b9bdc2d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_a195cb437f714b9290f2f1f99b9bdc2d", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/a195cb437f714b9290f2f1f99b9bdc2d"}]}] Nov 01 19:03:15.865200 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1578314603 Nov 01 19:03:15.865200 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant-Id: a195cb437f714b9290f2f1f99b9bdc2d Nov 01 19:03:15.865200 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1578314603 Nov 01 19:03:15.865200 n-d-863052-2 devstack@n-api.service[121403]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1578314603-project Nov 01 19:03:15.865200 n-d-863052-2 devstack@n-api.service[121403]: X-User-Domain-Id: default Nov 01 19:03:15.865200 n-d-863052-2 devstack@n-api.service[121403]: X-User-Domain-Name: Default Nov 01 19:03:15.865200 n-d-863052-2 devstack@n-api.service[121403]: X-User-Id: c324b901e66146d0a9adfb788e0569fb Nov 01 19:03:15.865200 n-d-863052-2 devstack@n-api.service[121403]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1578314603-project Nov 01 19:03:15.865200 n-d-863052-2 devstack@n-api.service[121403]: Nov 01 19:03:15.865200 n-d-863052-2 devstack@n-api.service[121403]: {"security_group_rule": {"parent_group_id": "abf224b0-9dcb-4a33-a103-72a9a33b174d", "ip_protocol": "tempest-999-2097175807", "from_port": 22, "to_port": 22}} Nov 01 19:03:15.865200 n-d-863052-2 devstack@n-api.service[121403]: method: Nov 01 19:03:15.865200 n-d-863052-2 devstack@n-api.service[121403]: exception: Invalid IP protocol tempest-999-2097175807. Nov 01 19:03:15.865200 n-d-863052-2 devstack@n-api.service[121403]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'abf224b0-9dcb-4a33-a103-72a9a33b174d', 'ip_protocol': 'tempest-999-2097175807', 'from_port': 22, 'to_port': 22}}} Nov 01 19:03:15.865200 n-d-863052-2 devstack@n-api.service[121403]: {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 01 19:03:15.865200 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:03:15.865200 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Nov 01 19:03:15.865200 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Nov 01 19:03:15.865200 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Nov 01 19:03:15.865200 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Nov 01 19:03:15.865200 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Nov 01 19:03:15.865200 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Nov 01 19:03:15.865200 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 144, in _new_ingress_rule Nov 01 19:03:15.865200 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise exception.InvalidIpProtocol(protocol=ip_protocol) Nov 01 19:03:15.865200 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi nova.exception.InvalidIpProtocol: Invalid IP protocol tempest-999-2097175807. Nov 01 19:03:15.865200 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:03:15.865200 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:03:15.865200 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:03:15.865200 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:03:15.865200 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:03:15.865200 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:03:15.865200 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 01 19:03:15.865200 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 01 19:03:15.865200 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 01 19:03:15.865200 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 01 19:03:15.865200 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 01 19:03:15.865200 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 01 19:03:15.865200 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Nov 01 19:03:15.865200 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Nov 01 19:03:15.865200 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid IP protocol tempest-999-2097175807. Nov 01 19:03:15.865200 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:03:15.865200 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:03:15.873341 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:03:15.873341 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:03:15.873341 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:03:15.873341 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:03:15.873341 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 01 19:03:15.873341 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 01 19:03:15.873341 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid IP protocol tempest-999-2097175807. Nov 01 19:03:15.873341 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:03:15.873341 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-e91bbb6e-a558-42af-9710-cff88d76b391 tempest-SecurityGroupRulesNegativeTestJSON-1578314603 tempest-SecurityGroupRulesNegativeTestJSON-1578314603-project] Returning 400 to user: Invalid IP protocol tempest-999-2097175807. {{(pid=121403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 01 19:03:15.873341 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-e91bbb6e-a558-42af-9710-cff88d76b391 tempest-SecurityGroupRulesNegativeTestJSON-1578314603 tempest-SecurityGroupRulesNegativeTestJSON-1578314603-project] 10.222.0.13 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 87 microversion: 2.1 time: 0.186039 Nov 01 19:03:15.873341 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1222/2427] 10.222.0.13 () {60 vars in 1195 bytes} [Tue Nov 1 19:03:15 2022] POST /compute/v2.1/os-security-group-rules => generated 87 bytes in 187 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Nov 01 19:03:15.878909 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-529e23c5-4347-4966-905b-dcd34521f448 tempest-LiveMigrationNegativeTest-570155948 tempest-LiveMigrationNegativeTest-570155948-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:03:15.878909 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-529e23c5-4347-4966-905b-dcd34521f448 tempest-LiveMigrationNegativeTest-570155948 tempest-LiveMigrationNegativeTest-570155948-project] [instance: d405fb5d-9aed-4363-a898-cbdfbef5b82a] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:03:15.904488 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-529e23c5-4347-4966-905b-dcd34521f448 tempest-LiveMigrationNegativeTest-570155948 tempest-LiveMigrationNegativeTest-570155948-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:03:15.905143 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-529e23c5-4347-4966-905b-dcd34521f448 tempest-LiveMigrationNegativeTest-570155948 tempest-LiveMigrationNegativeTest-570155948-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:03:15.905581 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-529e23c5-4347-4966-905b-dcd34521f448 tempest-LiveMigrationNegativeTest-570155948 tempest-LiveMigrationNegativeTest-570155948-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:03:15.906343 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-529e23c5-4347-4966-905b-dcd34521f448 tempest-LiveMigrationNegativeTest-570155948 tempest-LiveMigrationNegativeTest-570155948-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:03:15.906797 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-529e23c5-4347-4966-905b-dcd34521f448 tempest-LiveMigrationNegativeTest-570155948 tempest-LiveMigrationNegativeTest-570155948-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:03:15.907268 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-529e23c5-4347-4966-905b-dcd34521f448 tempest-LiveMigrationNegativeTest-570155948 tempest-LiveMigrationNegativeTest-570155948-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:03:16.049480 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-529e23c5-4347-4966-905b-dcd34521f448 tempest-LiveMigrationNegativeTest-570155948 tempest-LiveMigrationNegativeTest-570155948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c14605afbc5445d9763db185a1305d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faa1bc7c9d564b0ebc9ecf0a2994f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:03:16.063304 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-529e23c5-4347-4966-905b-dcd34521f448 tempest-LiveMigrationNegativeTest-570155948 tempest-LiveMigrationNegativeTest-570155948-project] 10.222.0.13 "GET /compute/v2.1/servers/d405fb5d-9aed-4363-a898-cbdfbef5b82a" status: 200 len: 1277 microversion: 2.1 time: 0.194355 Nov 01 19:03:16.064131 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1223/2428] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:03:15 2022] GET /compute/v2.1/servers/d405fb5d-9aed-4363-a898-cbdfbef5b82a => generated 1277 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:03:16.071018 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-f5bff8fc-9193-447e-a361-d3e157fdb456 tempest-SecurityGroupRulesNegativeTestJSON-1578314603 tempest-SecurityGroupRulesNegativeTestJSON-1578314603-project] Action: 'create', calling method: .version_select at 0x7f0ae225bdc0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-692444499", "description": "tempest-description-1077674735"}} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:03:16.363051 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-f5bff8fc-9193-447e-a361-d3e157fdb456 tempest-SecurityGroupRulesNegativeTestJSON-1578314603 tempest-SecurityGroupRulesNegativeTestJSON-1578314603-project] 10.222.0.13 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 0.296776 Nov 01 19:03:16.363780 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1224/2429] 10.222.0.13 () {60 vars in 1180 bytes} [Tue Nov 1 19:03:16 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:03:16.629622 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-013faf0e-14a0-483a-9d7d-5250c2652b84 tempest-SecurityGroupsTestAdminJSON-1525942917 tempest-SecurityGroupsTestAdminJSON-1525942917-project] Action: 'create', calling method: .version_select at 0x7f0ae225b5e0>, body: {"security_group": {"name": "tempest-securitygroup-532029532", "description": "tempest-description-835466107"}} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:03:17.039255 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.virt.hardware [None req-78664938-266b-41c3-a3f7-36cdda012cf5 tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Flavor limits 0:0:0 {{(pid=121402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 01 19:03:17.039688 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.virt.hardware [None req-78664938-266b-41c3-a3f7-36cdda012cf5 tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Image limits 0:0:0 {{(pid=121402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 01 19:03:17.040243 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.virt.hardware [None req-78664938-266b-41c3-a3f7-36cdda012cf5 tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Flavor pref 0:0:0 {{(pid=121402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 01 19:03:17.040820 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.virt.hardware [None req-78664938-266b-41c3-a3f7-36cdda012cf5 tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Image pref 0:0:0 {{(pid=121402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 01 19:03:17.041312 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.virt.hardware [None req-78664938-266b-41c3-a3f7-36cdda012cf5 tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 01 19:03:17.059608 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-78664938-266b-41c3-a3f7-36cdda012cf5 tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:03:17.060219 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-78664938-266b-41c3-a3f7-36cdda012cf5 tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:03:17.060636 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-78664938-266b-41c3-a3f7-36cdda012cf5 tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:03:17.061639 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-78664938-266b-41c3-a3f7-36cdda012cf5 tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:03:17.062054 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-78664938-266b-41c3-a3f7-36cdda012cf5 tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:03:17.062480 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-78664938-266b-41c3-a3f7-36cdda012cf5 tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:03:17.070096 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-013faf0e-14a0-483a-9d7d-5250c2652b84 tempest-SecurityGroupsTestAdminJSON-1525942917 tempest-SecurityGroupsTestAdminJSON-1525942917-project] 10.222.0.13 "POST /compute/v2.1/os-security-groups" status: 200 len: 219 microversion: 2.1 time: 0.705043 Nov 01 19:03:17.070704 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1225/2430] 10.222.0.13 () {60 vars in 1180 bytes} [Tue Nov 1 19:03:16 2022] POST /compute/v2.1/os-security-groups => generated 219 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:03:17.092744 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-4cead9a6-d038-4f00-b9cd-7e75cb12977b tempest-SecurityGroupRulesNegativeTestJSON-1578314603 tempest-SecurityGroupRulesNegativeTestJSON-1578314603-project] Action: 'create', calling method: .version_select at 0x7f0ae285faf0>, body: {"security_group_rule": {"parent_group_id": "7de8c1e9-fab5-4c38-b28f-a1770e53f584", "ip_protocol": "tcp", "from_port": 22, "to_port": 21}} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:03:17.162470 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.quota [None req-78664938-266b-41c3-a3f7-36cdda012cf5 tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Getting quotas for project af51b8733e984c2ca87df2d8163dedf9. Resources: {'cores', 'ram', 'instances'} {{(pid=121402) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 01 19:03:17.170653 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.quota [None req-78664938-266b-41c3-a3f7-36cdda012cf5 tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Getting quotas for user 52acef7992d64d378fd8ac333887fd0e and project af51b8733e984c2ca87df2d8163dedf9. Resources: {'cores', 'ram', 'instances'} {{(pid=121402) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 01 19:03:17.208123 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.wsgi [None req-4cead9a6-d038-4f00-b9cd-7e75cb12977b tempest-SecurityGroupRulesNegativeTestJSON-1578314603 tempest-SecurityGroupRulesNegativeTestJSON-1578314603-project] HTTP exception thrown: Invalid port range 22:21. Former value cannot be greater than the later Nov 01 19:03:17.209920 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-4cead9a6-d038-4f00-b9cd-7e75cb12977b tempest-SecurityGroupRulesNegativeTestJSON-1578314603 tempest-SecurityGroupRulesNegativeTestJSON-1578314603-project] Request method failure captured: Nov 01 19:03:17.209920 n-d-863052-2 devstack@n-api.service[121403]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Nov 01 19:03:17.209920 n-d-863052-2 devstack@n-api.service[121403]: Accept: application/json Nov 01 19:03:17.209920 n-d-863052-2 devstack@n-api.service[121403]: Accept-Encoding: identity Nov 01 19:03:17.209920 n-d-863052-2 devstack@n-api.service[121403]: Connection: close Nov 01 19:03:17.209920 n-d-863052-2 devstack@n-api.service[121403]: Content-Length: 138 Nov 01 19:03:17.209920 n-d-863052-2 devstack@n-api.service[121403]: Content-Type: application/json Nov 01 19:03:17.209920 n-d-863052-2 devstack@n-api.service[121403]: Host: 10.222.0.13 Nov 01 19:03:17.209920 n-d-863052-2 devstack@n-api.service[121403]: Openstack-System-Scope: None Nov 01 19:03:17.209920 n-d-863052-2 devstack@n-api.service[121403]: User-Agent: python-urllib3/1.26.12 Nov 01 19:03:17.209920 n-d-863052-2 devstack@n-api.service[121403]: X-Auth-Token: gAAAAABjYW1uxf1htA0w1sG-JFTkY5H02lsh6-_gb3t9yr-OpcxSaHLA0r3LfSxEAMJ7kwaKtT8vSsgSOyDG4ObX7ixw7sfDFURK-NsHShLFJncT0cGKl13woV71dMUAkGa_YY8ozc_cn9Ldzuh58b5Y1ZyjBTBx32CgZlgJvoIHyaJUkSFLKKo Nov 01 19:03:17.209920 n-d-863052-2 devstack@n-api.service[121403]: X-Domain-Id: None Nov 01 19:03:17.209920 n-d-863052-2 devstack@n-api.service[121403]: X-Domain-Name: None Nov 01 19:03:17.209920 n-d-863052-2 devstack@n-api.service[121403]: X-Identity-Status: Confirmed Nov 01 19:03:17.209920 n-d-863052-2 devstack@n-api.service[121403]: X-Is-Admin-Project: True Nov 01 19:03:17.209920 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Domain-Id: default Nov 01 19:03:17.209920 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Domain-Name: Default Nov 01 19:03:17.209920 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Id: a195cb437f714b9290f2f1f99b9bdc2d Nov 01 19:03:17.209920 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1578314603 Nov 01 19:03:17.209920 n-d-863052-2 devstack@n-api.service[121403]: X-Role: member,reader Nov 01 19:03:17.209920 n-d-863052-2 devstack@n-api.service[121403]: X-Roles: member,reader Nov 01 19:03:17.209920 n-d-863052-2 devstack@n-api.service[121403]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/a195cb437f714b9290f2f1f99b9bdc2d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/a195cb437f714b9290f2f1f99b9bdc2d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_a195cb437f714b9290f2f1f99b9bdc2d", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/a195cb437f714b9290f2f1f99b9bdc2d"}]}] Nov 01 19:03:17.209920 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1578314603 Nov 01 19:03:17.209920 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant-Id: a195cb437f714b9290f2f1f99b9bdc2d Nov 01 19:03:17.209920 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1578314603 Nov 01 19:03:17.209920 n-d-863052-2 devstack@n-api.service[121403]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1578314603-project Nov 01 19:03:17.209920 n-d-863052-2 devstack@n-api.service[121403]: X-User-Domain-Id: default Nov 01 19:03:17.209920 n-d-863052-2 devstack@n-api.service[121403]: X-User-Domain-Name: Default Nov 01 19:03:17.209920 n-d-863052-2 devstack@n-api.service[121403]: X-User-Id: c324b901e66146d0a9adfb788e0569fb Nov 01 19:03:17.209920 n-d-863052-2 devstack@n-api.service[121403]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1578314603-project Nov 01 19:03:17.209920 n-d-863052-2 devstack@n-api.service[121403]: Nov 01 19:03:17.209920 n-d-863052-2 devstack@n-api.service[121403]: {"security_group_rule": {"parent_group_id": "7de8c1e9-fab5-4c38-b28f-a1770e53f584", "ip_protocol": "tcp", "from_port": 22, "to_port": 21}} Nov 01 19:03:17.209920 n-d-863052-2 devstack@n-api.service[121403]: method: Nov 01 19:03:17.209920 n-d-863052-2 devstack@n-api.service[121403]: exception: Invalid port range 22:21. Former value cannot be greater than the later Nov 01 19:03:17.209920 n-d-863052-2 devstack@n-api.service[121403]: action_args: {'body': {'security_group_rule': {'parent_group_id': '7de8c1e9-fab5-4c38-b28f-a1770e53f584', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 21}}} Nov 01 19:03:17.209920 n-d-863052-2 devstack@n-api.service[121403]: {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 01 19:03:17.209920 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:03:17.209920 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Nov 01 19:03:17.209920 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Nov 01 19:03:17.209920 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Nov 01 19:03:17.209920 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Nov 01 19:03:17.209920 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Nov 01 19:03:17.209920 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Nov 01 19:03:17.209920 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 150, in _new_ingress_rule Nov 01 19:03:17.209920 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Nov 01 19:03:17.209920 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 22:21. Former value cannot be greater than the later Nov 01 19:03:17.209920 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:03:17.209920 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:03:17.209920 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:03:17.209920 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:03:17.209920 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:03:17.209920 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:03:17.209920 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 01 19:03:17.209920 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 01 19:03:17.209920 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 01 19:03:17.209920 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 01 19:03:17.209920 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 01 19:03:17.209920 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 01 19:03:17.209920 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Nov 01 19:03:17.209920 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Nov 01 19:03:17.209920 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 22:21. Former value cannot be greater than the later Nov 01 19:03:17.209920 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:03:17.213938 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:03:17.213938 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:03:17.213938 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:03:17.213938 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:03:17.213938 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:03:17.213938 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 01 19:03:17.213938 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 01 19:03:17.213938 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 22:21. Former value cannot be greater than the later Nov 01 19:03:17.213938 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:03:17.215155 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-4cead9a6-d038-4f00-b9cd-7e75cb12977b tempest-SecurityGroupRulesNegativeTestJSON-1578314603 tempest-SecurityGroupRulesNegativeTestJSON-1578314603-project] Returning 400 to user: Invalid port range 22:21. Former value cannot be greater than the later {{(pid=121403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 01 19:03:17.216166 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-4cead9a6-d038-4f00-b9cd-7e75cb12977b tempest-SecurityGroupRulesNegativeTestJSON-1578314603 tempest-SecurityGroupRulesNegativeTestJSON-1578314603-project] 10.222.0.13 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 115 microversion: 2.1 time: 0.143806 Nov 01 19:03:17.217242 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1226/2431] 10.222.0.13 () {60 vars in 1195 bytes} [Tue Nov 1 19:03:17 2022] POST /compute/v2.1/os-security-group-rules => generated 115 bytes in 145 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 01 19:03:17.223174 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-04aa2c6a-fa52-4c64-9990-c5de08dabec5 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:03:17.233860 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-04aa2c6a-fa52-4c64-9990-c5de08dabec5 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] [instance: 992f5ec5-d256-4870-b16d-fc8d9adbd3e7] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:03:17.241061 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-78664938-266b-41c3-a3f7-36cdda012cf5 tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Going to run 1 instances... {{(pid=121402) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 01 19:03:17.243681 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-78664938-266b-41c3-a3f7-36cdda012cf5 tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] [instance: 12b6a241-81e5-4cb3-b138-ca28f4018732] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2d4a0047-1b9e-445f-8af8-1b5c9d93e881',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121402) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 01 19:03:17.262580 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-04aa2c6a-fa52-4c64-9990-c5de08dabec5 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:03:17.263084 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-04aa2c6a-fa52-4c64-9990-c5de08dabec5 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:03:17.269366 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-04aa2c6a-fa52-4c64-9990-c5de08dabec5 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:03:17.271825 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-04aa2c6a-fa52-4c64-9990-c5de08dabec5 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:03:17.272367 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-04aa2c6a-fa52-4c64-9990-c5de08dabec5 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:03:17.272780 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-04aa2c6a-fa52-4c64-9990-c5de08dabec5 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:03:17.416049 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-78664938-266b-41c3-a3f7-36cdda012cf5 tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.682563 Nov 01 19:03:17.417069 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1206/2432] 10.222.0.13 () {60 vars in 1147 bytes} [Tue Nov 1 19:03:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 2684 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 01 19:03:17.427582 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-d45a82f3-d96d-408b-8917-5463daf470ba tempest-SecurityGroupsTestAdminJSON-1525942917 tempest-SecurityGroupsTestAdminJSON-1525942917-project] Action: 'create', calling method: .version_select at 0x7f0ae24e1820>, body: {"security_group": {"name": "tempest-securitygroup-893993040", "description": "tempest-description-670331228"}} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:03:17.645104 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-04aa2c6a-fa52-4c64-9990-c5de08dabec5 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb496b3faac4abbae73d389f2042e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e2520220d454764b8c139a58d78ac83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:03:17.653780 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-04aa2c6a-fa52-4c64-9990-c5de08dabec5 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] 10.222.0.13 "GET /compute/v2.1/servers/992f5ec5-d256-4870-b16d-fc8d9adbd3e7" status: 200 len: 1473 microversion: 2.1 time: 0.435337 Nov 01 19:03:17.667558 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1227/2433] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:03:17 2022] GET /compute/v2.1/servers/992f5ec5-d256-4870-b16d-fc8d9adbd3e7 => generated 1473 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:03:17.696165 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-b4f6e562-655f-4522-b0b5-5cb82041d9b2 tempest-LiveMigrationNegativeTest-570155948 tempest-LiveMigrationNegativeTest-570155948-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:03:17.699390 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-b4f6e562-655f-4522-b0b5-5cb82041d9b2 tempest-LiveMigrationNegativeTest-570155948 tempest-LiveMigrationNegativeTest-570155948-project] [instance: d405fb5d-9aed-4363-a898-cbdfbef5b82a] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:03:17.715917 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-b4f6e562-655f-4522-b0b5-5cb82041d9b2 tempest-LiveMigrationNegativeTest-570155948 tempest-LiveMigrationNegativeTest-570155948-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:03:17.716475 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-b4f6e562-655f-4522-b0b5-5cb82041d9b2 tempest-LiveMigrationNegativeTest-570155948 tempest-LiveMigrationNegativeTest-570155948-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:03:17.716948 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-b4f6e562-655f-4522-b0b5-5cb82041d9b2 tempest-LiveMigrationNegativeTest-570155948 tempest-LiveMigrationNegativeTest-570155948-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:03:17.720687 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-b4f6e562-655f-4522-b0b5-5cb82041d9b2 tempest-LiveMigrationNegativeTest-570155948 tempest-LiveMigrationNegativeTest-570155948-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:03:17.721353 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-b4f6e562-655f-4522-b0b5-5cb82041d9b2 tempest-LiveMigrationNegativeTest-570155948 tempest-LiveMigrationNegativeTest-570155948-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:03:17.725152 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-b4f6e562-655f-4522-b0b5-5cb82041d9b2 tempest-LiveMigrationNegativeTest-570155948 tempest-LiveMigrationNegativeTest-570155948-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:03:17.992984 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-d45a82f3-d96d-408b-8917-5463daf470ba tempest-SecurityGroupsTestAdminJSON-1525942917 tempest-SecurityGroupsTestAdminJSON-1525942917-project] 10.222.0.13 "POST /compute/v2.1/os-security-groups" status: 200 len: 219 microversion: 2.1 time: 0.574734 Nov 01 19:03:17.995133 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1207/2434] 10.222.0.13 () {60 vars in 1180 bytes} [Tue Nov 1 19:03:17 2022] POST /compute/v2.1/os-security-groups => generated 219 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:03:18.006713 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-1e7bb3f6-28be-4930-8ed5-95bb43d9f9a7 tempest-SecurityGroupRulesNegativeTestJSON-1578314603 tempest-SecurityGroupRulesNegativeTestJSON-1578314603-project] Action: 'create', calling method: .version_select at 0x7f0ae1a1f160>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1486963622", "description": "tempest-description-1045953755"}} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:03:18.123504 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-b4f6e562-655f-4522-b0b5-5cb82041d9b2 tempest-LiveMigrationNegativeTest-570155948 tempest-LiveMigrationNegativeTest-570155948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c14605afbc5445d9763db185a1305d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faa1bc7c9d564b0ebc9ecf0a2994f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:03:18.135947 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-b4f6e562-655f-4522-b0b5-5cb82041d9b2 tempest-LiveMigrationNegativeTest-570155948 tempest-LiveMigrationNegativeTest-570155948-project] 10.222.0.13 "GET /compute/v2.1/servers/d405fb5d-9aed-4363-a898-cbdfbef5b82a" status: 200 len: 1319 microversion: 2.1 time: 0.456603 Nov 01 19:03:18.138679 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1228/2435] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:03:17 2022] GET /compute/v2.1/servers/d405fb5d-9aed-4363-a898-cbdfbef5b82a => generated 1319 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:03:18.149770 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-4cbf6b06-b507-4546-8139-95ac459f7c4f tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:03:18.151903 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-4cbf6b06-b507-4546-8139-95ac459f7c4f tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] [instance: 12b6a241-81e5-4cb3-b138-ca28f4018732] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:03:18.320417 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-4cbf6b06-b507-4546-8139-95ac459f7c4f tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52acef7992d64d378fd8ac333887fd0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af51b8733e984c2ca87df2d8163dedf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:03:18.344554 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-4cbf6b06-b507-4546-8139-95ac459f7c4f tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] 10.222.0.13 "GET /compute/v2.1/servers/12b6a241-81e5-4cb3-b138-ca28f4018732" status: 200 len: 1212 microversion: 2.1 time: 0.202989 Nov 01 19:03:18.345634 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1229/2436] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:03:18 2022] GET /compute/v2.1/servers/12b6a241-81e5-4cb3-b138-ca28f4018732 => generated 1212 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:03:18.457902 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-5365051c-87e6-4ace-9f31-876128b85140 tempest-SecurityGroupsTestAdminJSON-446909888 tempest-SecurityGroupsTestAdminJSON-446909888-project-admin] Action: 'create', calling method: .version_select at 0x7f0ae225b310>, body: {"security_group": {"name": "tempest-securitygroup-1922932719", "description": "tempest-description-707179966"}} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:03:18.761541 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-1e7bb3f6-28be-4930-8ed5-95bb43d9f9a7 tempest-SecurityGroupRulesNegativeTestJSON-1578314603 tempest-SecurityGroupRulesNegativeTestJSON-1578314603-project] 10.222.0.13 "POST /compute/v2.1/os-security-groups" status: 200 len: 256 microversion: 2.1 time: 0.765127 Nov 01 19:03:18.762747 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1208/2437] 10.222.0.13 () {60 vars in 1180 bytes} [Tue Nov 1 19:03:17 2022] POST /compute/v2.1/os-security-groups => generated 256 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:03:18.775503 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-c8e6fd71-737b-46e4-a3a9-f4fcf4e6914f tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:03:18.776418 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-c8e6fd71-737b-46e4-a3a9-f4fcf4e6914f tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] [instance: 992f5ec5-d256-4870-b16d-fc8d9adbd3e7] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:03:18.796643 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-c8e6fd71-737b-46e4-a3a9-f4fcf4e6914f tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:03:18.797199 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-c8e6fd71-737b-46e4-a3a9-f4fcf4e6914f tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:03:18.797677 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-c8e6fd71-737b-46e4-a3a9-f4fcf4e6914f tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:03:18.801867 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-c8e6fd71-737b-46e4-a3a9-f4fcf4e6914f tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:03:18.806553 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-c8e6fd71-737b-46e4-a3a9-f4fcf4e6914f tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:03:18.807359 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-c8e6fd71-737b-46e4-a3a9-f4fcf4e6914f tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:03:19.423504 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-c8e6fd71-737b-46e4-a3a9-f4fcf4e6914f tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb496b3faac4abbae73d389f2042e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e2520220d454764b8c139a58d78ac83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:03:19.484375 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-c8e6fd71-737b-46e4-a3a9-f4fcf4e6914f tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] 10.222.0.13 "GET /compute/v2.1/servers/992f5ec5-d256-4870-b16d-fc8d9adbd3e7" status: 200 len: 1473 microversion: 2.1 time: 0.720188 Nov 01 19:03:19.508141 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1209/2438] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:03:18 2022] GET /compute/v2.1/servers/992f5ec5-d256-4870-b16d-fc8d9adbd3e7 => generated 1473 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:03:19.514254 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-56df4a2c-85dc-4394-b553-2889db44edd4 tempest-SecurityGroupRulesNegativeTestJSON-1578314603 tempest-SecurityGroupRulesNegativeTestJSON-1578314603-project] Action: 'create', calling method: .version_select at 0x7f0ae1a9e3a0>, body: {"security_group_rule": {"parent_group_id": "2ceee7d3-3c83-4092-97ef-8ef36fcb52f0", "ip_protocol": "tcp", "from_port": 22, "to_port": 826036336}} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:03:19.527676 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-5365051c-87e6-4ace-9f31-876128b85140 tempest-SecurityGroupsTestAdminJSON-446909888 tempest-SecurityGroupsTestAdminJSON-446909888-project-admin] 10.222.0.13 "POST /compute/v2.1/os-security-groups" status: 200 len: 220 microversion: 2.1 time: 1.180070 Nov 01 19:03:19.528384 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1230/2439] 10.222.0.13 () {60 vars in 1180 bytes} [Tue Nov 1 19:03:18 2022] POST /compute/v2.1/os-security-groups => generated 220 bytes in 1182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:03:19.533502 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-90c52bce-bb99-446b-a061-2badcb627f2a tempest-LiveMigrationNegativeTest-570155948 tempest-LiveMigrationNegativeTest-570155948-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:03:19.534378 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-90c52bce-bb99-446b-a061-2badcb627f2a tempest-LiveMigrationNegativeTest-570155948 tempest-LiveMigrationNegativeTest-570155948-project] [instance: d405fb5d-9aed-4363-a898-cbdfbef5b82a] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:03:19.590234 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-90c52bce-bb99-446b-a061-2badcb627f2a tempest-LiveMigrationNegativeTest-570155948 tempest-LiveMigrationNegativeTest-570155948-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:03:19.592215 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-90c52bce-bb99-446b-a061-2badcb627f2a tempest-LiveMigrationNegativeTest-570155948 tempest-LiveMigrationNegativeTest-570155948-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:03:19.592793 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-90c52bce-bb99-446b-a061-2badcb627f2a tempest-LiveMigrationNegativeTest-570155948 tempest-LiveMigrationNegativeTest-570155948-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:03:19.594558 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-90c52bce-bb99-446b-a061-2badcb627f2a tempest-LiveMigrationNegativeTest-570155948 tempest-LiveMigrationNegativeTest-570155948-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:03:19.598809 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-90c52bce-bb99-446b-a061-2badcb627f2a tempest-LiveMigrationNegativeTest-570155948 tempest-LiveMigrationNegativeTest-570155948-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:03:19.600820 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-90c52bce-bb99-446b-a061-2badcb627f2a tempest-LiveMigrationNegativeTest-570155948 tempest-LiveMigrationNegativeTest-570155948-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:03:20.007979 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-90c52bce-bb99-446b-a061-2badcb627f2a tempest-LiveMigrationNegativeTest-570155948 tempest-LiveMigrationNegativeTest-570155948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c14605afbc5445d9763db185a1305d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faa1bc7c9d564b0ebc9ecf0a2994f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:03:20.018795 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-90c52bce-bb99-446b-a061-2badcb627f2a tempest-LiveMigrationNegativeTest-570155948 tempest-LiveMigrationNegativeTest-570155948-project] 10.222.0.13 "GET /compute/v2.1/servers/d405fb5d-9aed-4363-a898-cbdfbef5b82a" status: 200 len: 1319 microversion: 2.1 time: 0.488070 Nov 01 19:03:20.021463 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1231/2440] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:03:19 2022] GET /compute/v2.1/servers/d405fb5d-9aed-4363-a898-cbdfbef5b82a => generated 1319 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:03:20.032750 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [req-f4d3b667-f2a8-4859-82d2-f2f2fbd10ceb req-d5f8a53f-847b-45f0-847a-0516a0459431 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d405fb5d-9aed-4363-a898-cbdfbef5b82a", "tag": "3ec6380d-47fe-4dd4-83d7-85d66e3dca96"}]} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:03:20.062362 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-f4d3b667-f2a8-4859-82d2-f2f2fbd10ceb req-d5f8a53f-847b-45f0-847a-0516a0459431 service nova] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:03:20.064061 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-f4d3b667-f2a8-4859-82d2-f2f2fbd10ceb req-d5f8a53f-847b-45f0-847a-0516a0459431 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:03:20.066109 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-f4d3b667-f2a8-4859-82d2-f2f2fbd10ceb req-d5f8a53f-847b-45f0-847a-0516a0459431 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:03:20.107761 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.compute.server_external_events [req-f4d3b667-f2a8-4859-82d2-f2f2fbd10ceb req-d5f8a53f-847b-45f0-847a-0516a0459431 service nova] Creating event network-changed:3ec6380d-47fe-4dd4-83d7-85d66e3dca96 for instance d405fb5d-9aed-4363-a898-cbdfbef5b82a on n-h2-863052-2 Nov 01 19:03:20.121379 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [req-f4d3b667-f2a8-4859-82d2-f2f2fbd10ceb req-d5f8a53f-847b-45f0-847a-0516a0459431 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098352 Nov 01 19:03:20.126678 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1232/2441] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Nov 1 19:03:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:03:20.143775 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-8e5052af-aa17-4bc1-a704-3da4fd4c340c tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:03:20.145653 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-8e5052af-aa17-4bc1-a704-3da4fd4c340c tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] [instance: 12b6a241-81e5-4cb3-b138-ca28f4018732] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:03:20.168036 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-8e5052af-aa17-4bc1-a704-3da4fd4c340c tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:03:20.170555 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-8e5052af-aa17-4bc1-a704-3da4fd4c340c tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:03:20.172570 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-8e5052af-aa17-4bc1-a704-3da4fd4c340c tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:03:20.173840 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-8e5052af-aa17-4bc1-a704-3da4fd4c340c tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:03:20.176727 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-8e5052af-aa17-4bc1-a704-3da4fd4c340c tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:03:20.177273 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-8e5052af-aa17-4bc1-a704-3da4fd4c340c tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:03:20.190727 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.wsgi [None req-56df4a2c-85dc-4394-b553-2889db44edd4 tempest-SecurityGroupRulesNegativeTestJSON-1578314603 tempest-SecurityGroupRulesNegativeTestJSON-1578314603-project] HTTP exception thrown: Invalid port range 22:826036336. Valid TCP ports should be between 1-65535 Nov 01 19:03:20.193080 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-56df4a2c-85dc-4394-b553-2889db44edd4 tempest-SecurityGroupRulesNegativeTestJSON-1578314603 tempest-SecurityGroupRulesNegativeTestJSON-1578314603-project] Request method failure captured: Nov 01 19:03:20.193080 n-d-863052-2 devstack@n-api.service[121402]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Nov 01 19:03:20.193080 n-d-863052-2 devstack@n-api.service[121402]: Accept: application/json Nov 01 19:03:20.193080 n-d-863052-2 devstack@n-api.service[121402]: Accept-Encoding: identity Nov 01 19:03:20.193080 n-d-863052-2 devstack@n-api.service[121402]: Connection: close Nov 01 19:03:20.193080 n-d-863052-2 devstack@n-api.service[121402]: Content-Length: 145 Nov 01 19:03:20.193080 n-d-863052-2 devstack@n-api.service[121402]: Content-Type: application/json Nov 01 19:03:20.193080 n-d-863052-2 devstack@n-api.service[121402]: Host: 10.222.0.13 Nov 01 19:03:20.193080 n-d-863052-2 devstack@n-api.service[121402]: Openstack-System-Scope: None Nov 01 19:03:20.193080 n-d-863052-2 devstack@n-api.service[121402]: User-Agent: python-urllib3/1.26.12 Nov 01 19:03:20.193080 n-d-863052-2 devstack@n-api.service[121402]: X-Auth-Token: gAAAAABjYW1uxf1htA0w1sG-JFTkY5H02lsh6-_gb3t9yr-OpcxSaHLA0r3LfSxEAMJ7kwaKtT8vSsgSOyDG4ObX7ixw7sfDFURK-NsHShLFJncT0cGKl13woV71dMUAkGa_YY8ozc_cn9Ldzuh58b5Y1ZyjBTBx32CgZlgJvoIHyaJUkSFLKKo Nov 01 19:03:20.193080 n-d-863052-2 devstack@n-api.service[121402]: X-Domain-Id: None Nov 01 19:03:20.193080 n-d-863052-2 devstack@n-api.service[121402]: X-Domain-Name: None Nov 01 19:03:20.193080 n-d-863052-2 devstack@n-api.service[121402]: X-Identity-Status: Confirmed Nov 01 19:03:20.193080 n-d-863052-2 devstack@n-api.service[121402]: X-Is-Admin-Project: True Nov 01 19:03:20.193080 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Domain-Id: default Nov 01 19:03:20.193080 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Domain-Name: Default Nov 01 19:03:20.193080 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Id: a195cb437f714b9290f2f1f99b9bdc2d Nov 01 19:03:20.193080 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1578314603 Nov 01 19:03:20.193080 n-d-863052-2 devstack@n-api.service[121402]: X-Role: member,reader Nov 01 19:03:20.193080 n-d-863052-2 devstack@n-api.service[121402]: X-Roles: member,reader Nov 01 19:03:20.193080 n-d-863052-2 devstack@n-api.service[121402]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/a195cb437f714b9290f2f1f99b9bdc2d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/a195cb437f714b9290f2f1f99b9bdc2d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_a195cb437f714b9290f2f1f99b9bdc2d", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/a195cb437f714b9290f2f1f99b9bdc2d"}]}] Nov 01 19:03:20.193080 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1578314603 Nov 01 19:03:20.193080 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant-Id: a195cb437f714b9290f2f1f99b9bdc2d Nov 01 19:03:20.193080 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1578314603 Nov 01 19:03:20.193080 n-d-863052-2 devstack@n-api.service[121402]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1578314603-project Nov 01 19:03:20.193080 n-d-863052-2 devstack@n-api.service[121402]: X-User-Domain-Id: default Nov 01 19:03:20.193080 n-d-863052-2 devstack@n-api.service[121402]: X-User-Domain-Name: Default Nov 01 19:03:20.193080 n-d-863052-2 devstack@n-api.service[121402]: X-User-Id: c324b901e66146d0a9adfb788e0569fb Nov 01 19:03:20.193080 n-d-863052-2 devstack@n-api.service[121402]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1578314603-project Nov 01 19:03:20.193080 n-d-863052-2 devstack@n-api.service[121402]: Nov 01 19:03:20.193080 n-d-863052-2 devstack@n-api.service[121402]: {"security_group_rule": {"parent_group_id": "2ceee7d3-3c83-4092-97ef-8ef36fcb52f0", "ip_protocol": "tcp", "from_port": 22, "to_port": 826036336}} Nov 01 19:03:20.193080 n-d-863052-2 devstack@n-api.service[121402]: method: Nov 01 19:03:20.193080 n-d-863052-2 devstack@n-api.service[121402]: exception: Invalid port range 22:826036336. Valid TCP ports should be between 1-65535 Nov 01 19:03:20.193080 n-d-863052-2 devstack@n-api.service[121402]: action_args: {'body': {'security_group_rule': {'parent_group_id': '2ceee7d3-3c83-4092-97ef-8ef36fcb52f0', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 826036336}}} Nov 01 19:03:20.193080 n-d-863052-2 devstack@n-api.service[121402]: {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 01 19:03:20.193080 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:03:20.193080 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Nov 01 19:03:20.193080 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Nov 01 19:03:20.193080 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Nov 01 19:03:20.193080 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Nov 01 19:03:20.193080 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Nov 01 19:03:20.193080 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Nov 01 19:03:20.193080 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 157, in _new_ingress_rule Nov 01 19:03:20.193080 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Nov 01 19:03:20.193080 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 22:826036336. Valid TCP ports should be between 1-65535 Nov 01 19:03:20.193080 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:03:20.193080 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:03:20.193080 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:03:20.193080 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:03:20.193080 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:03:20.193080 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:03:20.193080 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 01 19:03:20.193080 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 01 19:03:20.193080 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 01 19:03:20.193080 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 01 19:03:20.193080 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 01 19:03:20.193080 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 01 19:03:20.193080 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Nov 01 19:03:20.193080 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Nov 01 19:03:20.193080 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 22:826036336. Valid TCP ports should be between 1-65535 Nov 01 19:03:20.193080 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:03:20.197823 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:03:20.197823 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:03:20.197823 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:03:20.197823 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:03:20.197823 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:03:20.197823 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 01 19:03:20.197823 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 01 19:03:20.197823 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 22:826036336. Valid TCP ports should be between 1-65535 Nov 01 19:03:20.197823 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:03:20.197823 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-56df4a2c-85dc-4394-b553-2889db44edd4 tempest-SecurityGroupRulesNegativeTestJSON-1578314603 tempest-SecurityGroupRulesNegativeTestJSON-1578314603-project] Returning 400 to user: Invalid port range 22:826036336. Valid TCP ports should be between 1-65535 {{(pid=121402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 01 19:03:20.197823 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-56df4a2c-85dc-4394-b553-2889db44edd4 tempest-SecurityGroupRulesNegativeTestJSON-1578314603 tempest-SecurityGroupRulesNegativeTestJSON-1578314603-project] 10.222.0.13 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 118 microversion: 2.1 time: 0.684909 Nov 01 19:03:20.200185 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1210/2442] 10.222.0.13 () {60 vars in 1195 bytes} [Tue Nov 1 19:03:19 2022] POST /compute/v2.1/os-security-group-rules => generated 118 bytes in 691 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 01 19:03:20.205032 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-e47fb9a9-0ae7-407a-8413-2075b0cbe0ba tempest-SecurityGroupsTestAdminJSON-446909888 tempest-SecurityGroupsTestAdminJSON-446909888-project-admin] Action: 'create', calling method: .version_select at 0x7f0ae1aa80d0>, body: {"security_group": {"name": "tempest-securitygroup-1193600158", "description": "tempest-description-1715885410"}} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:03:20.280688 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-8e5052af-aa17-4bc1-a704-3da4fd4c340c tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52acef7992d64d378fd8ac333887fd0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af51b8733e984c2ca87df2d8163dedf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:03:20.292909 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-8e5052af-aa17-4bc1-a704-3da4fd4c340c tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] 10.222.0.13 "GET /compute/v2.1/servers/12b6a241-81e5-4cb3-b138-ca28f4018732" status: 200 len: 1270 microversion: 2.1 time: 0.164640 Nov 01 19:03:20.294068 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1233/2443] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:03:20 2022] GET /compute/v2.1/servers/12b6a241-81e5-4cb3-b138-ca28f4018732 => generated 1270 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:03:20.300347 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-161a0bd3-7f48-4bf3-8d9e-cda3d6301bec tempest-SecurityGroupRulesNegativeTestJSON-1578314603 tempest-SecurityGroupRulesNegativeTestJSON-1578314603-project] Action: 'create', calling method: .version_select at 0x7f0ae1f29280>, body: {"security_group_rule": {"parent_group_id": "c8c5f939-aaa8-4e79-95c4-1f4b6f03183a", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:03:20.335179 n-d-863052-2 devstack@n-api.service[121403]: DEBUG neutronclient.v2_0.client [None req-161a0bd3-7f48-4bf3-8d9e-cda3d6301bec tempest-SecurityGroupRulesNegativeTestJSON-1578314603 tempest-SecurityGroupRulesNegativeTestJSON-1578314603-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group c8c5f939-aaa8-4e79-95c4-1f4b6f03183a does not exist", "detail": ""}} {{(pid=121403) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Nov 01 19:03:20.335974 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.network.security_group_api [None req-161a0bd3-7f48-4bf3-8d9e-cda3d6301bec tempest-SecurityGroupRulesNegativeTestJSON-1578314603 tempest-SecurityGroupRulesNegativeTestJSON-1578314603-project] Neutron security group c8c5f939-aaa8-4e79-95c4-1f4b6f03183a not found {{(pid=121403) get /opt/stack/nova/nova/network/security_group_api.py:313}} Nov 01 19:03:20.336756 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.wsgi [None req-161a0bd3-7f48-4bf3-8d9e-cda3d6301bec tempest-SecurityGroupRulesNegativeTestJSON-1578314603 tempest-SecurityGroupRulesNegativeTestJSON-1578314603-project] HTTP exception thrown: Security group c8c5f939-aaa8-4e79-95c4-1f4b6f03183a does not exist Nov 01 19:03:20.336756 n-d-863052-2 devstack@n-api.service[121403]: Neutron server returns request_ids: ['req-8496e0f8-e479-43d4-a53c-6f7b5bb6f52a'] Nov 01 19:03:20.339378 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-161a0bd3-7f48-4bf3-8d9e-cda3d6301bec tempest-SecurityGroupRulesNegativeTestJSON-1578314603 tempest-SecurityGroupRulesNegativeTestJSON-1578314603-project] Request method failure captured: Nov 01 19:03:20.339378 n-d-863052-2 devstack@n-api.service[121403]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Nov 01 19:03:20.339378 n-d-863052-2 devstack@n-api.service[121403]: Accept: application/json Nov 01 19:03:20.339378 n-d-863052-2 devstack@n-api.service[121403]: Accept-Encoding: identity Nov 01 19:03:20.339378 n-d-863052-2 devstack@n-api.service[121403]: Connection: close Nov 01 19:03:20.339378 n-d-863052-2 devstack@n-api.service[121403]: Content-Length: 138 Nov 01 19:03:20.339378 n-d-863052-2 devstack@n-api.service[121403]: Content-Type: application/json Nov 01 19:03:20.339378 n-d-863052-2 devstack@n-api.service[121403]: Host: 10.222.0.13 Nov 01 19:03:20.339378 n-d-863052-2 devstack@n-api.service[121403]: Openstack-System-Scope: None Nov 01 19:03:20.339378 n-d-863052-2 devstack@n-api.service[121403]: User-Agent: python-urllib3/1.26.12 Nov 01 19:03:20.339378 n-d-863052-2 devstack@n-api.service[121403]: X-Auth-Token: gAAAAABjYW1uxf1htA0w1sG-JFTkY5H02lsh6-_gb3t9yr-OpcxSaHLA0r3LfSxEAMJ7kwaKtT8vSsgSOyDG4ObX7ixw7sfDFURK-NsHShLFJncT0cGKl13woV71dMUAkGa_YY8ozc_cn9Ldzuh58b5Y1ZyjBTBx32CgZlgJvoIHyaJUkSFLKKo Nov 01 19:03:20.339378 n-d-863052-2 devstack@n-api.service[121403]: X-Domain-Id: None Nov 01 19:03:20.339378 n-d-863052-2 devstack@n-api.service[121403]: X-Domain-Name: None Nov 01 19:03:20.339378 n-d-863052-2 devstack@n-api.service[121403]: X-Identity-Status: Confirmed Nov 01 19:03:20.339378 n-d-863052-2 devstack@n-api.service[121403]: X-Is-Admin-Project: True Nov 01 19:03:20.339378 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Domain-Id: default Nov 01 19:03:20.339378 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Domain-Name: Default Nov 01 19:03:20.339378 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Id: a195cb437f714b9290f2f1f99b9bdc2d Nov 01 19:03:20.339378 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1578314603 Nov 01 19:03:20.339378 n-d-863052-2 devstack@n-api.service[121403]: X-Role: member,reader Nov 01 19:03:20.339378 n-d-863052-2 devstack@n-api.service[121403]: X-Roles: member,reader Nov 01 19:03:20.339378 n-d-863052-2 devstack@n-api.service[121403]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/a195cb437f714b9290f2f1f99b9bdc2d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/a195cb437f714b9290f2f1f99b9bdc2d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_a195cb437f714b9290f2f1f99b9bdc2d", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/a195cb437f714b9290f2f1f99b9bdc2d"}]}] Nov 01 19:03:20.339378 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1578314603 Nov 01 19:03:20.339378 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant-Id: a195cb437f714b9290f2f1f99b9bdc2d Nov 01 19:03:20.339378 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1578314603 Nov 01 19:03:20.339378 n-d-863052-2 devstack@n-api.service[121403]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1578314603-project Nov 01 19:03:20.339378 n-d-863052-2 devstack@n-api.service[121403]: X-User-Domain-Id: default Nov 01 19:03:20.339378 n-d-863052-2 devstack@n-api.service[121403]: X-User-Domain-Name: Default Nov 01 19:03:20.339378 n-d-863052-2 devstack@n-api.service[121403]: X-User-Id: c324b901e66146d0a9adfb788e0569fb Nov 01 19:03:20.339378 n-d-863052-2 devstack@n-api.service[121403]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1578314603-project Nov 01 19:03:20.339378 n-d-863052-2 devstack@n-api.service[121403]: Nov 01 19:03:20.339378 n-d-863052-2 devstack@n-api.service[121403]: {"security_group_rule": {"parent_group_id": "c8c5f939-aaa8-4e79-95c4-1f4b6f03183a", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Nov 01 19:03:20.339378 n-d-863052-2 devstack@n-api.service[121403]: method: Nov 01 19:03:20.339378 n-d-863052-2 devstack@n-api.service[121403]: exception: Security group c8c5f939-aaa8-4e79-95c4-1f4b6f03183a does not exist Nov 01 19:03:20.339378 n-d-863052-2 devstack@n-api.service[121403]: Neutron server returns request_ids: ['req-8496e0f8-e479-43d4-a53c-6f7b5bb6f52a'] Nov 01 19:03:20.339378 n-d-863052-2 devstack@n-api.service[121403]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'c8c5f939-aaa8-4e79-95c4-1f4b6f03183a', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Nov 01 19:03:20.339378 n-d-863052-2 devstack@n-api.service[121403]: {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 01 19:03:20.339378 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:03:20.339378 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Nov 01 19:03:20.339378 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Nov 01 19:03:20.339378 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 01 19:03:20.339378 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 01 19:03:20.339378 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Nov 01 19:03:20.339378 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Nov 01 19:03:20.339378 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 01 19:03:20.339378 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 01 19:03:20.339378 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 01 19:03:20.339378 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 01 19:03:20.339378 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 01 19:03:20.339378 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 01 19:03:20.339378 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 01 19:03:20.339378 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 01 19:03:20.339378 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 01 19:03:20.339378 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 01 19:03:20.339378 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Nov 01 19:03:20.339378 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Nov 01 19:03:20.339378 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 01 19:03:20.339378 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 01 19:03:20.339378 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Nov 01 19:03:20.339378 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Nov 01 19:03:20.339378 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Nov 01 19:03:20.343982 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Nov 01 19:03:20.343982 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group c8c5f939-aaa8-4e79-95c4-1f4b6f03183a does not exist Nov 01 19:03:20.343982 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8496e0f8-e479-43d4-a53c-6f7b5bb6f52a'] Nov 01 19:03:20.343982 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:03:20.343982 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:03:20.343982 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:03:20.343982 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:03:20.343982 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 287, in create Nov 01 19:03:20.343982 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get( Nov 01 19:03:20.343982 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Nov 01 19:03:20.343982 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Nov 01 19:03:20.343982 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group c8c5f939-aaa8-4e79-95c4-1f4b6f03183a does not exist Nov 01 19:03:20.343982 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8496e0f8-e479-43d4-a53c-6f7b5bb6f52a'] Nov 01 19:03:20.343982 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:03:20.343982 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:03:20.343982 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:03:20.343982 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:03:20.343982 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:03:20.343982 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:03:20.343982 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 01 19:03:20.343982 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 01 19:03:20.343982 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 01 19:03:20.343982 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 01 19:03:20.343982 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 01 19:03:20.343982 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 01 19:03:20.343982 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 303, in create Nov 01 19:03:20.343982 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Nov 01 19:03:20.343982 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group c8c5f939-aaa8-4e79-95c4-1f4b6f03183a does not exist Nov 01 19:03:20.343982 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8496e0f8-e479-43d4-a53c-6f7b5bb6f52a'] Nov 01 19:03:20.343982 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:03:20.343982 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:03:20.343982 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:03:20.343982 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:03:20.343982 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:03:20.343982 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:03:20.343982 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 01 19:03:20.343982 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 01 19:03:20.343982 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group c8c5f939-aaa8-4e79-95c4-1f4b6f03183a does not exist Nov 01 19:03:20.343982 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8496e0f8-e479-43d4-a53c-6f7b5bb6f52a'] Nov 01 19:03:20.343982 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:03:20.347825 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-161a0bd3-7f48-4bf3-8d9e-cda3d6301bec tempest-SecurityGroupRulesNegativeTestJSON-1578314603 tempest-SecurityGroupRulesNegativeTestJSON-1578314603-project] Returning 404 to user: Security group c8c5f939-aaa8-4e79-95c4-1f4b6f03183a does not exist Nov 01 19:03:20.347825 n-d-863052-2 devstack@n-api.service[121403]: Neutron server returns request_ids: ['req-8496e0f8-e479-43d4-a53c-6f7b5bb6f52a'] {{(pid=121403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 01 19:03:20.350310 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-161a0bd3-7f48-4bf3-8d9e-cda3d6301bec tempest-SecurityGroupRulesNegativeTestJSON-1578314603 tempest-SecurityGroupRulesNegativeTestJSON-1578314603-project] 10.222.0.13 "POST /compute/v2.1/os-security-group-rules" status: 404 len: 194 microversion: 2.1 time: 0.053746 Nov 01 19:03:20.351666 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1234/2444] 10.222.0.13 () {60 vars in 1195 bytes} [Tue Nov 1 19:03:20 2022] POST /compute/v2.1/os-security-group-rules => generated 194 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 01 19:03:20.362106 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-7b60b3fe-7cf6-4f12-b4a4-0a009b2af14c tempest-SecurityGroupRulesNegativeTestJSON-1578314603 tempest-SecurityGroupRulesNegativeTestJSON-1578314603-project] Calling method '.version_select at 0x7f0ae225bc10>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:03:20.393513 n-d-863052-2 devstack@n-api.service[121403]: DEBUG neutronclient.v2_0.client [None req-7b60b3fe-7cf6-4f12-b4a4-0a009b2af14c tempest-SecurityGroupRulesNegativeTestJSON-1578314603 tempest-SecurityGroupRulesNegativeTestJSON-1578314603-project] Error message: {"NeutronError": {"type": "SecurityGroupRuleNotFound", "message": "Security group rule 042c3a8b-eb3d-40d6-a389-368ab82177ec does not exist", "detail": ""}} {{(pid=121403) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Nov 01 19:03:20.395016 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.network.security_group_api [None req-7b60b3fe-7cf6-4f12-b4a4-0a009b2af14c tempest-SecurityGroupRulesNegativeTestJSON-1578314603 tempest-SecurityGroupRulesNegativeTestJSON-1578314603-project] Neutron security group rule 042c3a8b-eb3d-40d6-a389-368ab82177ec not found {{(pid=121403) get_rule /opt/stack/nova/nova/network/security_group_api.py:463}} Nov 01 19:03:20.397325 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.wsgi [None req-7b60b3fe-7cf6-4f12-b4a4-0a009b2af14c tempest-SecurityGroupRulesNegativeTestJSON-1578314603 tempest-SecurityGroupRulesNegativeTestJSON-1578314603-project] HTTP exception thrown: Security group rule 042c3a8b-eb3d-40d6-a389-368ab82177ec does not exist Nov 01 19:03:20.397325 n-d-863052-2 devstack@n-api.service[121403]: Neutron server returns request_ids: ['req-2f637ec6-3853-4852-823d-27f2b7f09530'] Nov 01 19:03:20.403744 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-7b60b3fe-7cf6-4f12-b4a4-0a009b2af14c tempest-SecurityGroupRulesNegativeTestJSON-1578314603 tempest-SecurityGroupRulesNegativeTestJSON-1578314603-project] Request method failure captured: Nov 01 19:03:20.403744 n-d-863052-2 devstack@n-api.service[121403]: request: DELETE /compute/v2.1/os-security-group-rules/042c3a8b-eb3d-40d6-a389-368ab82177ec HTTP/1.1 Nov 01 19:03:20.403744 n-d-863052-2 devstack@n-api.service[121403]: Accept: application/json Nov 01 19:03:20.403744 n-d-863052-2 devstack@n-api.service[121403]: Accept-Encoding: identity Nov 01 19:03:20.403744 n-d-863052-2 devstack@n-api.service[121403]: Connection: close Nov 01 19:03:20.403744 n-d-863052-2 devstack@n-api.service[121403]: Content-Length: 0 Nov 01 19:03:20.403744 n-d-863052-2 devstack@n-api.service[121403]: Content-Type: application/json Nov 01 19:03:20.403744 n-d-863052-2 devstack@n-api.service[121403]: Host: 10.222.0.13 Nov 01 19:03:20.403744 n-d-863052-2 devstack@n-api.service[121403]: Openstack-System-Scope: None Nov 01 19:03:20.403744 n-d-863052-2 devstack@n-api.service[121403]: User-Agent: python-urllib3/1.26.12 Nov 01 19:03:20.403744 n-d-863052-2 devstack@n-api.service[121403]: X-Auth-Token: gAAAAABjYW1uxf1htA0w1sG-JFTkY5H02lsh6-_gb3t9yr-OpcxSaHLA0r3LfSxEAMJ7kwaKtT8vSsgSOyDG4ObX7ixw7sfDFURK-NsHShLFJncT0cGKl13woV71dMUAkGa_YY8ozc_cn9Ldzuh58b5Y1ZyjBTBx32CgZlgJvoIHyaJUkSFLKKo Nov 01 19:03:20.403744 n-d-863052-2 devstack@n-api.service[121403]: X-Domain-Id: None Nov 01 19:03:20.403744 n-d-863052-2 devstack@n-api.service[121403]: X-Domain-Name: None Nov 01 19:03:20.403744 n-d-863052-2 devstack@n-api.service[121403]: X-Identity-Status: Confirmed Nov 01 19:03:20.403744 n-d-863052-2 devstack@n-api.service[121403]: X-Is-Admin-Project: True Nov 01 19:03:20.403744 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Domain-Id: default Nov 01 19:03:20.403744 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Domain-Name: Default Nov 01 19:03:20.403744 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Id: a195cb437f714b9290f2f1f99b9bdc2d Nov 01 19:03:20.403744 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1578314603 Nov 01 19:03:20.403744 n-d-863052-2 devstack@n-api.service[121403]: X-Role: member,reader Nov 01 19:03:20.403744 n-d-863052-2 devstack@n-api.service[121403]: X-Roles: member,reader Nov 01 19:03:20.403744 n-d-863052-2 devstack@n-api.service[121403]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/a195cb437f714b9290f2f1f99b9bdc2d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/a195cb437f714b9290f2f1f99b9bdc2d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_a195cb437f714b9290f2f1f99b9bdc2d", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/a195cb437f714b9290f2f1f99b9bdc2d"}]}] Nov 01 19:03:20.403744 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1578314603 Nov 01 19:03:20.403744 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant-Id: a195cb437f714b9290f2f1f99b9bdc2d Nov 01 19:03:20.403744 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1578314603 Nov 01 19:03:20.403744 n-d-863052-2 devstack@n-api.service[121403]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1578314603-project Nov 01 19:03:20.403744 n-d-863052-2 devstack@n-api.service[121403]: X-User-Domain-Id: default Nov 01 19:03:20.403744 n-d-863052-2 devstack@n-api.service[121403]: X-User-Domain-Name: Default Nov 01 19:03:20.403744 n-d-863052-2 devstack@n-api.service[121403]: X-User-Id: c324b901e66146d0a9adfb788e0569fb Nov 01 19:03:20.403744 n-d-863052-2 devstack@n-api.service[121403]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1578314603-project Nov 01 19:03:20.403744 n-d-863052-2 devstack@n-api.service[121403]: method: Nov 01 19:03:20.403744 n-d-863052-2 devstack@n-api.service[121403]: exception: Security group rule 042c3a8b-eb3d-40d6-a389-368ab82177ec does not exist Nov 01 19:03:20.403744 n-d-863052-2 devstack@n-api.service[121403]: Neutron server returns request_ids: ['req-2f637ec6-3853-4852-823d-27f2b7f09530'] Nov 01 19:03:20.403744 n-d-863052-2 devstack@n-api.service[121403]: action_args: {'id': '042c3a8b-eb3d-40d6-a389-368ab82177ec'} Nov 01 19:03:20.403744 n-d-863052-2 devstack@n-api.service[121403]: {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 01 19:03:20.403744 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:03:20.403744 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 459, in get_rule Nov 01 19:03:20.403744 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi rule = neutron.show_security_group_rule( Nov 01 19:03:20.403744 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 01 19:03:20.403744 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 01 19:03:20.403744 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1092, in show_security_group_rule Nov 01 19:03:20.403744 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_rule_path % (security_group_rule), Nov 01 19:03:20.403744 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 01 19:03:20.403744 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 01 19:03:20.403744 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 01 19:03:20.403744 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 01 19:03:20.403744 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 01 19:03:20.403744 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 01 19:03:20.403744 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 01 19:03:20.403744 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 01 19:03:20.403744 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 01 19:03:20.403744 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 01 19:03:20.403744 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Nov 01 19:03:20.403744 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Nov 01 19:03:20.403744 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 01 19:03:20.403744 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 01 19:03:20.403744 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Nov 01 19:03:20.403744 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Nov 01 19:03:20.403744 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Nov 01 19:03:20.403744 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Nov 01 19:03:20.408682 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group rule 042c3a8b-eb3d-40d6-a389-368ab82177ec does not exist Nov 01 19:03:20.408682 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2f637ec6-3853-4852-823d-27f2b7f09530'] Nov 01 19:03:20.408682 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:03:20.408682 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:03:20.408682 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:03:20.408682 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:03:20.408682 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 359, in delete Nov 01 19:03:20.408682 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi rule = security_group_api.get_rule(context, id) Nov 01 19:03:20.408682 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 464, in get_rule Nov 01 19:03:20.408682 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Nov 01 19:03:20.408682 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group rule 042c3a8b-eb3d-40d6-a389-368ab82177ec does not exist Nov 01 19:03:20.408682 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2f637ec6-3853-4852-823d-27f2b7f09530'] Nov 01 19:03:20.408682 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:03:20.408682 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:03:20.408682 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:03:20.408682 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:03:20.408682 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:03:20.408682 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:03:20.408682 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 01 19:03:20.408682 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 01 19:03:20.408682 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 01 19:03:20.408682 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 01 19:03:20.408682 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 01 19:03:20.408682 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 01 19:03:20.408682 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 365, in delete Nov 01 19:03:20.408682 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Nov 01 19:03:20.408682 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group rule 042c3a8b-eb3d-40d6-a389-368ab82177ec does not exist Nov 01 19:03:20.408682 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2f637ec6-3853-4852-823d-27f2b7f09530'] Nov 01 19:03:20.408682 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:03:20.408682 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:03:20.408682 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:03:20.408682 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:03:20.408682 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:03:20.408682 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:03:20.408682 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 01 19:03:20.408682 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 01 19:03:20.408682 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group rule 042c3a8b-eb3d-40d6-a389-368ab82177ec does not exist Nov 01 19:03:20.408682 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2f637ec6-3853-4852-823d-27f2b7f09530'] Nov 01 19:03:20.408682 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:03:20.408682 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-7b60b3fe-7cf6-4f12-b4a4-0a009b2af14c tempest-SecurityGroupRulesNegativeTestJSON-1578314603 tempest-SecurityGroupRulesNegativeTestJSON-1578314603-project] Returning 404 to user: Security group rule 042c3a8b-eb3d-40d6-a389-368ab82177ec does not exist Nov 01 19:03:20.408682 n-d-863052-2 devstack@n-api.service[121403]: Neutron server returns request_ids: ['req-2f637ec6-3853-4852-823d-27f2b7f09530'] {{(pid=121403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 01 19:03:20.415048 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-7b60b3fe-7cf6-4f12-b4a4-0a009b2af14c tempest-SecurityGroupRulesNegativeTestJSON-1578314603 tempest-SecurityGroupRulesNegativeTestJSON-1578314603-project] 10.222.0.13 "DELETE /compute/v2.1/os-security-group-rules/042c3a8b-eb3d-40d6-a389-368ab82177ec" status: 404 len: 199 microversion: 2.1 time: 0.051091 Nov 01 19:03:20.415383 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1235/2445] 10.222.0.13 () {58 vars in 1287 bytes} [Tue Nov 1 19:03:20 2022] DELETE /compute/v2.1/os-security-group-rules/042c3a8b-eb3d-40d6-a389-368ab82177ec => generated 199 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 01 19:03:20.423388 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-fea824e5-1ae8-4d7a-99c8-8b68b0a0343e tempest-SecurityGroupRulesNegativeTestJSON-1578314603 tempest-SecurityGroupRulesNegativeTestJSON-1578314603-project] Calling method '.version_select at 0x7f0ae1f29550>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:03:20.693253 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-fea824e5-1ae8-4d7a-99c8-8b68b0a0343e tempest-SecurityGroupRulesNegativeTestJSON-1578314603 tempest-SecurityGroupRulesNegativeTestJSON-1578314603-project] 10.222.0.13 "DELETE /compute/v2.1/os-security-groups/2ceee7d3-3c83-4092-97ef-8ef36fcb52f0" status: 202 len: 0 microversion: 2.1 time: 0.274848 Nov 01 19:03:20.694403 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1236/2446] 10.222.0.13 () {58 vars in 1272 bytes} [Tue Nov 1 19:03:20 2022] DELETE /compute/v2.1/os-security-groups/2ceee7d3-3c83-4092-97ef-8ef36fcb52f0 => generated 0 bytes in 278 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 01 19:03:20.700933 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-110c4b44-1f91-4124-80a9-4a14b811623b tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:03:20.702416 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-110c4b44-1f91-4124-80a9-4a14b811623b tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] [instance: 992f5ec5-d256-4870-b16d-fc8d9adbd3e7] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:03:20.720022 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-110c4b44-1f91-4124-80a9-4a14b811623b tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:03:20.722165 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-110c4b44-1f91-4124-80a9-4a14b811623b tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:03:20.724003 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-110c4b44-1f91-4124-80a9-4a14b811623b tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:03:20.726401 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-110c4b44-1f91-4124-80a9-4a14b811623b tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:03:20.727661 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-110c4b44-1f91-4124-80a9-4a14b811623b tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:03:20.731398 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-110c4b44-1f91-4124-80a9-4a14b811623b tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:03:20.976464 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-110c4b44-1f91-4124-80a9-4a14b811623b tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb496b3faac4abbae73d389f2042e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e2520220d454764b8c139a58d78ac83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:03:20.991725 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-110c4b44-1f91-4124-80a9-4a14b811623b tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] 10.222.0.13 "GET /compute/v2.1/servers/992f5ec5-d256-4870-b16d-fc8d9adbd3e7" status: 200 len: 1473 microversion: 2.1 time: 0.295448 Nov 01 19:03:20.992934 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1237/2447] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:03:20 2022] GET /compute/v2.1/servers/992f5ec5-d256-4870-b16d-fc8d9adbd3e7 => generated 1473 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:03:20.999529 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-a3533cbc-e74c-4855-9f56-34d59b7ad54d tempest-SecurityGroupRulesNegativeTestJSON-1578314603 tempest-SecurityGroupRulesNegativeTestJSON-1578314603-project] Calling method '.version_select at 0x7f0ae28260d0>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:03:21.105162 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-e47fb9a9-0ae7-407a-8413-2075b0cbe0ba tempest-SecurityGroupsTestAdminJSON-446909888 tempest-SecurityGroupsTestAdminJSON-446909888-project-admin] 10.222.0.13 "POST /compute/v2.1/os-security-groups" status: 200 len: 221 microversion: 2.1 time: 0.903169 Nov 01 19:03:21.106309 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1211/2448] 10.222.0.13 () {60 vars in 1180 bytes} [Tue Nov 1 19:03:20 2022] POST /compute/v2.1/os-security-groups => generated 221 bytes in 906 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:03:21.121374 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-1a1f8e5f-1dd4-41d8-8fb9-93bf26a1affe tempest-LiveMigrationNegativeTest-570155948 tempest-LiveMigrationNegativeTest-570155948-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:03:21.122334 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-1a1f8e5f-1dd4-41d8-8fb9-93bf26a1affe tempest-LiveMigrationNegativeTest-570155948 tempest-LiveMigrationNegativeTest-570155948-project] [instance: d405fb5d-9aed-4363-a898-cbdfbef5b82a] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:03:21.130036 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-1a1f8e5f-1dd4-41d8-8fb9-93bf26a1affe tempest-LiveMigrationNegativeTest-570155948 tempest-LiveMigrationNegativeTest-570155948-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:03:21.130776 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-1a1f8e5f-1dd4-41d8-8fb9-93bf26a1affe tempest-LiveMigrationNegativeTest-570155948 tempest-LiveMigrationNegativeTest-570155948-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:03:21.131378 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-1a1f8e5f-1dd4-41d8-8fb9-93bf26a1affe tempest-LiveMigrationNegativeTest-570155948 tempest-LiveMigrationNegativeTest-570155948-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:03:21.132375 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-1a1f8e5f-1dd4-41d8-8fb9-93bf26a1affe tempest-LiveMigrationNegativeTest-570155948 tempest-LiveMigrationNegativeTest-570155948-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:03:21.134098 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-1a1f8e5f-1dd4-41d8-8fb9-93bf26a1affe tempest-LiveMigrationNegativeTest-570155948 tempest-LiveMigrationNegativeTest-570155948-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:03:21.135259 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-1a1f8e5f-1dd4-41d8-8fb9-93bf26a1affe tempest-LiveMigrationNegativeTest-570155948 tempest-LiveMigrationNegativeTest-570155948-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:03:21.261787 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-a3533cbc-e74c-4855-9f56-34d59b7ad54d tempest-SecurityGroupRulesNegativeTestJSON-1578314603 tempest-SecurityGroupRulesNegativeTestJSON-1578314603-project] 10.222.0.13 "DELETE /compute/v2.1/os-security-groups/7de8c1e9-fab5-4c38-b28f-a1770e53f584" status: 202 len: 0 microversion: 2.1 time: 0.267101 Nov 01 19:03:21.262680 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1238/2449] 10.222.0.13 () {58 vars in 1272 bytes} [Tue Nov 1 19:03:20 2022] DELETE /compute/v2.1/os-security-groups/7de8c1e9-fab5-4c38-b28f-a1770e53f584 => generated 0 bytes in 269 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 01 19:03:21.267778 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-63331f0c-af05-4d92-af09-62edbfa8214b tempest-SecurityGroupsTestAdminJSON-446909888 tempest-SecurityGroupsTestAdminJSON-446909888-project-admin] Calling method '.version_select at 0x7f0ae2106700>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:03:21.505804 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-1a1f8e5f-1dd4-41d8-8fb9-93bf26a1affe tempest-LiveMigrationNegativeTest-570155948 tempest-LiveMigrationNegativeTest-570155948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c14605afbc5445d9763db185a1305d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faa1bc7c9d564b0ebc9ecf0a2994f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:03:21.520178 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-1a1f8e5f-1dd4-41d8-8fb9-93bf26a1affe tempest-LiveMigrationNegativeTest-570155948 tempest-LiveMigrationNegativeTest-570155948-project] 10.222.0.13 "GET /compute/v2.1/servers/d405fb5d-9aed-4363-a898-cbdfbef5b82a" status: 200 len: 1319 microversion: 2.1 time: 0.401617 Nov 01 19:03:21.521060 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1212/2450] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:03:21 2022] GET /compute/v2.1/servers/d405fb5d-9aed-4363-a898-cbdfbef5b82a => generated 1319 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:03:21.537579 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-6e55c7bf-295e-41ae-84df-6d6ae2d8d4d8 tempest-SecurityGroupRulesNegativeTestJSON-1578314603 tempest-SecurityGroupRulesNegativeTestJSON-1578314603-project] Calling method '.version_select at 0x7f0ae1ac0c10>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:03:21.952881 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-6e55c7bf-295e-41ae-84df-6d6ae2d8d4d8 tempest-SecurityGroupRulesNegativeTestJSON-1578314603 tempest-SecurityGroupRulesNegativeTestJSON-1578314603-project] 10.222.0.13 "DELETE /compute/v2.1/os-security-groups/abf224b0-9dcb-4a33-a103-72a9a33b174d" status: 202 len: 0 microversion: 2.1 time: 0.430061 Nov 01 19:03:21.955866 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1213/2451] 10.222.0.13 () {58 vars in 1272 bytes} [Tue Nov 1 19:03:21 2022] DELETE /compute/v2.1/os-security-groups/abf224b0-9dcb-4a33-a103-72a9a33b174d => generated 0 bytes in 432 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 01 19:03:21.962576 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-2a44f0b9-777f-46ce-9b66-90fff6a1e140 tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:03:21.965111 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-2a44f0b9-777f-46ce-9b66-90fff6a1e140 tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] [instance: 12b6a241-81e5-4cb3-b138-ca28f4018732] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:03:21.983278 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2a44f0b9-777f-46ce-9b66-90fff6a1e140 tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:03:21.985849 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2a44f0b9-777f-46ce-9b66-90fff6a1e140 tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:03:21.987611 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2a44f0b9-777f-46ce-9b66-90fff6a1e140 tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:03:21.990625 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2a44f0b9-777f-46ce-9b66-90fff6a1e140 tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:03:21.992071 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2a44f0b9-777f-46ce-9b66-90fff6a1e140 tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:03:21.994343 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2a44f0b9-777f-46ce-9b66-90fff6a1e140 tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:03:22.055426 n-d-863052-2 devstack@n-api.service[121402]: DEBUG dbcounter [-] [121402] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 19:03:22.378425 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-2a44f0b9-777f-46ce-9b66-90fff6a1e140 tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52acef7992d64d378fd8ac333887fd0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af51b8733e984c2ca87df2d8163dedf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:03:22.388555 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-2a44f0b9-777f-46ce-9b66-90fff6a1e140 tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] 10.222.0.13 "GET /compute/v2.1/servers/12b6a241-81e5-4cb3-b138-ca28f4018732" status: 200 len: 1312 microversion: 2.1 time: 0.431133 Nov 01 19:03:22.389365 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1214/2452] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:03:21 2022] GET /compute/v2.1/servers/12b6a241-81e5-4cb3-b138-ca28f4018732 => generated 1312 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:03:22.395220 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-74828f01-35c1-4117-84a3-fc402e5d35a7 tempest-SecurityGroupRulesNegativeTestJSON-1578314603 tempest-SecurityGroupRulesNegativeTestJSON-1578314603-project] Calling method '.version_select at 0x7f0ae1ac0550>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:03:22.452401 n-d-863052-2 devstack@n-api.service[121403]: DEBUG dbcounter [-] [121403] Writing DB stats nova_cell0:SELECT=2 {{(pid=121403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 19:03:23.079796 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-74828f01-35c1-4117-84a3-fc402e5d35a7 tempest-SecurityGroupRulesNegativeTestJSON-1578314603 tempest-SecurityGroupRulesNegativeTestJSON-1578314603-project] 10.222.0.13 "DELETE /compute/v2.1/os-security-groups/a0cffbb9-c2ed-4018-aafe-2d3811b9603e" status: 202 len: 0 microversion: 2.1 time: 0.686565 Nov 01 19:03:23.083221 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1215/2453] 10.222.0.13 () {58 vars in 1272 bytes} [Tue Nov 1 19:03:22 2022] DELETE /compute/v2.1/os-security-groups/a0cffbb9-c2ed-4018-aafe-2d3811b9603e => generated 0 bytes in 693 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 01 19:03:23.100470 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-9a8430f8-92d6-44c3-94d5-2d7b83fc0928 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:03:23.102770 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-9a8430f8-92d6-44c3-94d5-2d7b83fc0928 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] [instance: 992f5ec5-d256-4870-b16d-fc8d9adbd3e7] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:03:23.125409 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-9a8430f8-92d6-44c3-94d5-2d7b83fc0928 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:03:23.129622 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-9a8430f8-92d6-44c3-94d5-2d7b83fc0928 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:03:23.130469 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-9a8430f8-92d6-44c3-94d5-2d7b83fc0928 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:03:23.131514 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-9a8430f8-92d6-44c3-94d5-2d7b83fc0928 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:03:23.133799 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-9a8430f8-92d6-44c3-94d5-2d7b83fc0928 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:03:23.134691 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-9a8430f8-92d6-44c3-94d5-2d7b83fc0928 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:03:23.447797 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-63331f0c-af05-4d92-af09-62edbfa8214b tempest-SecurityGroupsTestAdminJSON-446909888 tempest-SecurityGroupsTestAdminJSON-446909888-project-admin] 10.222.0.13 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 11699 microversion: 2.1 time: 2.183325 Nov 01 19:03:23.449577 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1239/2454] 10.222.0.13 () {58 vars in 1191 bytes} [Tue Nov 1 19:03:21 2022] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 11699 bytes in 2186 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 01 19:03:23.456169 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-21fec173-18ac-4a9c-b05f-a43b168f7039 tempest-LiveMigrationNegativeTest-570155948 tempest-LiveMigrationNegativeTest-570155948-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:03:23.458121 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-21fec173-18ac-4a9c-b05f-a43b168f7039 tempest-LiveMigrationNegativeTest-570155948 tempest-LiveMigrationNegativeTest-570155948-project] [instance: d405fb5d-9aed-4363-a898-cbdfbef5b82a] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:03:23.466093 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-21fec173-18ac-4a9c-b05f-a43b168f7039 tempest-LiveMigrationNegativeTest-570155948 tempest-LiveMigrationNegativeTest-570155948-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:03:23.466986 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-21fec173-18ac-4a9c-b05f-a43b168f7039 tempest-LiveMigrationNegativeTest-570155948 tempest-LiveMigrationNegativeTest-570155948-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:03:23.467678 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-21fec173-18ac-4a9c-b05f-a43b168f7039 tempest-LiveMigrationNegativeTest-570155948 tempest-LiveMigrationNegativeTest-570155948-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:03:23.468544 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-21fec173-18ac-4a9c-b05f-a43b168f7039 tempest-LiveMigrationNegativeTest-570155948 tempest-LiveMigrationNegativeTest-570155948-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:03:23.469040 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-21fec173-18ac-4a9c-b05f-a43b168f7039 tempest-LiveMigrationNegativeTest-570155948 tempest-LiveMigrationNegativeTest-570155948-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:03:23.469741 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-21fec173-18ac-4a9c-b05f-a43b168f7039 tempest-LiveMigrationNegativeTest-570155948 tempest-LiveMigrationNegativeTest-570155948-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:03:23.568899 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-9a8430f8-92d6-44c3-94d5-2d7b83fc0928 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb496b3faac4abbae73d389f2042e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e2520220d454764b8c139a58d78ac83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:03:23.578301 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-9a8430f8-92d6-44c3-94d5-2d7b83fc0928 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] 10.222.0.13 "GET /compute/v2.1/servers/992f5ec5-d256-4870-b16d-fc8d9adbd3e7" status: 200 len: 1473 microversion: 2.1 time: 0.493200 Nov 01 19:03:23.579405 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1216/2455] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:03:23 2022] GET /compute/v2.1/servers/992f5ec5-d256-4870-b16d-fc8d9adbd3e7 => generated 1473 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:03:23.585781 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-583a0f65-6536-48b3-a3c2-6b9055af248e tempest-SecurityGroupRulesNegativeTestJSON-1578314603 tempest-SecurityGroupRulesNegativeTestJSON-1578314603-project] Calling method '.version_select at 0x7f0ae1a19040>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:03:23.672779 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-21fec173-18ac-4a9c-b05f-a43b168f7039 tempest-LiveMigrationNegativeTest-570155948 tempest-LiveMigrationNegativeTest-570155948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c14605afbc5445d9763db185a1305d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faa1bc7c9d564b0ebc9ecf0a2994f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:03:23.681610 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-21fec173-18ac-4a9c-b05f-a43b168f7039 tempest-LiveMigrationNegativeTest-570155948 tempest-LiveMigrationNegativeTest-570155948-project] 10.222.0.13 "GET /compute/v2.1/servers/d405fb5d-9aed-4363-a898-cbdfbef5b82a" status: 200 len: 1319 microversion: 2.1 time: 0.230746 Nov 01 19:03:23.696607 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1240/2456] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:03:23 2022] GET /compute/v2.1/servers/d405fb5d-9aed-4363-a898-cbdfbef5b82a => generated 1319 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:03:23.696607 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-96943d1b-894b-4709-8988-0b1516363b5b tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:03:23.696607 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-96943d1b-894b-4709-8988-0b1516363b5b tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] [instance: 12b6a241-81e5-4cb3-b138-ca28f4018732] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:03:23.697272 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-96943d1b-894b-4709-8988-0b1516363b5b tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:03:23.698065 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-96943d1b-894b-4709-8988-0b1516363b5b tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:03:23.698669 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-96943d1b-894b-4709-8988-0b1516363b5b tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:03:23.699880 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-96943d1b-894b-4709-8988-0b1516363b5b tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:03:23.700543 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-96943d1b-894b-4709-8988-0b1516363b5b tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:03:23.701160 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-96943d1b-894b-4709-8988-0b1516363b5b tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:03:23.876993 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-96943d1b-894b-4709-8988-0b1516363b5b tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52acef7992d64d378fd8ac333887fd0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af51b8733e984c2ca87df2d8163dedf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:03:23.886339 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-96943d1b-894b-4709-8988-0b1516363b5b tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] 10.222.0.13 "GET /compute/v2.1/servers/12b6a241-81e5-4cb3-b138-ca28f4018732" status: 200 len: 1333 microversion: 2.1 time: 0.201542 Nov 01 19:03:23.887481 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1241/2457] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:03:23 2022] GET /compute/v2.1/servers/12b6a241-81e5-4cb3-b138-ca28f4018732 => generated 1333 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:03:23.892617 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-ce83098d-6b62-4adf-85d1-8d6e9f62bceb tempest-SecurityGroupsTestAdminJSON-1525942917 tempest-SecurityGroupsTestAdminJSON-1525942917-project] Calling method '.version_select at 0x7f0ae2069af0>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:03:24.057853 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-583a0f65-6536-48b3-a3c2-6b9055af248e tempest-SecurityGroupRulesNegativeTestJSON-1578314603 tempest-SecurityGroupRulesNegativeTestJSON-1578314603-project] 10.222.0.13 "DELETE /compute/v2.1/os-security-groups/87ec7808-53a2-462b-857c-45b140389011" status: 202 len: 0 microversion: 2.1 time: 0.476833 Nov 01 19:03:24.058446 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1217/2458] 10.222.0.13 () {58 vars in 1272 bytes} [Tue Nov 1 19:03:23 2022] DELETE /compute/v2.1/os-security-groups/87ec7808-53a2-462b-857c-45b140389011 => generated 0 bytes in 478 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 01 19:03:24.107141 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-ce83098d-6b62-4adf-85d1-8d6e9f62bceb tempest-SecurityGroupsTestAdminJSON-1525942917 tempest-SecurityGroupsTestAdminJSON-1525942917-project] 10.222.0.13 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 1109 microversion: 2.1 time: 0.218573 Nov 01 19:03:24.107738 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1242/2459] 10.222.0.13 () {58 vars in 1191 bytes} [Tue Nov 1 19:03:23 2022] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 1109 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:03:24.123302 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-7ab0269b-9ae8-4b5e-ad55-2755b980c88e tempest-SecurityGroupsTestAdminJSON-446909888 tempest-SecurityGroupsTestAdminJSON-446909888-project-admin] Calling method '.version_select at 0x7f0ae1a19550>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:03:24.604174 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-9bb99415-41d4-4467-b348-01d1df02d522 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:03:24.604838 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-9bb99415-41d4-4467-b348-01d1df02d522 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] [instance: 992f5ec5-d256-4870-b16d-fc8d9adbd3e7] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:03:24.612807 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-9bb99415-41d4-4467-b348-01d1df02d522 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:03:24.613366 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-9bb99415-41d4-4467-b348-01d1df02d522 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:03:24.613807 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-9bb99415-41d4-4467-b348-01d1df02d522 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:03:24.614539 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-9bb99415-41d4-4467-b348-01d1df02d522 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:03:24.614998 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-9bb99415-41d4-4467-b348-01d1df02d522 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:03:24.615425 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-9bb99415-41d4-4467-b348-01d1df02d522 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:03:24.801162 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-9bb99415-41d4-4467-b348-01d1df02d522 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb496b3faac4abbae73d389f2042e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e2520220d454764b8c139a58d78ac83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:03:24.812976 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-9bb99415-41d4-4467-b348-01d1df02d522 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] 10.222.0.13 "GET /compute/v2.1/servers/992f5ec5-d256-4870-b16d-fc8d9adbd3e7" status: 200 len: 1473 microversion: 2.1 time: 0.212932 Nov 01 19:03:24.813642 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1243/2460] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:03:24 2022] GET /compute/v2.1/servers/992f5ec5-d256-4870-b16d-fc8d9adbd3e7 => generated 1473 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 19:03:24.820140 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-5b662c9b-7ed2-4a14-8e61-5fb365151874 tempest-LiveMigrationNegativeTest-570155948 tempest-LiveMigrationNegativeTest-570155948-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:03:24.820950 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-5b662c9b-7ed2-4a14-8e61-5fb365151874 tempest-LiveMigrationNegativeTest-570155948 tempest-LiveMigrationNegativeTest-570155948-project] [instance: d405fb5d-9aed-4363-a898-cbdfbef5b82a] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:03:24.828129 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-5b662c9b-7ed2-4a14-8e61-5fb365151874 tempest-LiveMigrationNegativeTest-570155948 tempest-LiveMigrationNegativeTest-570155948-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:03:24.828915 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-5b662c9b-7ed2-4a14-8e61-5fb365151874 tempest-LiveMigrationNegativeTest-570155948 tempest-LiveMigrationNegativeTest-570155948-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:03:24.829532 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-5b662c9b-7ed2-4a14-8e61-5fb365151874 tempest-LiveMigrationNegativeTest-570155948 tempest-LiveMigrationNegativeTest-570155948-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:03:24.830597 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-5b662c9b-7ed2-4a14-8e61-5fb365151874 tempest-LiveMigrationNegativeTest-570155948 tempest-LiveMigrationNegativeTest-570155948-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:03:24.831220 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-5b662c9b-7ed2-4a14-8e61-5fb365151874 tempest-LiveMigrationNegativeTest-570155948 tempest-LiveMigrationNegativeTest-570155948-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:03:24.832470 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-5b662c9b-7ed2-4a14-8e61-5fb365151874 tempest-LiveMigrationNegativeTest-570155948 tempest-LiveMigrationNegativeTest-570155948-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:03:24.987527 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-5b662c9b-7ed2-4a14-8e61-5fb365151874 tempest-LiveMigrationNegativeTest-570155948 tempest-LiveMigrationNegativeTest-570155948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c14605afbc5445d9763db185a1305d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faa1bc7c9d564b0ebc9ecf0a2994f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:03:24.997344 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-5b662c9b-7ed2-4a14-8e61-5fb365151874 tempest-LiveMigrationNegativeTest-570155948 tempest-LiveMigrationNegativeTest-570155948-project] 10.222.0.13 "GET /compute/v2.1/servers/d405fb5d-9aed-4363-a898-cbdfbef5b82a" status: 200 len: 1319 microversion: 2.1 time: 0.181766 Nov 01 19:03:24.998959 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1244/2461] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:03:24 2022] GET /compute/v2.1/servers/d405fb5d-9aed-4363-a898-cbdfbef5b82a => generated 1319 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:03:25.004634 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-bedaf583-031d-4710-b629-ead709008f2e tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:03:25.005616 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-bedaf583-031d-4710-b629-ead709008f2e tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] [instance: 12b6a241-81e5-4cb3-b138-ca28f4018732] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:03:25.016052 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-bedaf583-031d-4710-b629-ead709008f2e tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:03:25.016681 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-bedaf583-031d-4710-b629-ead709008f2e tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:03:25.017241 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-bedaf583-031d-4710-b629-ead709008f2e tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:03:25.025744 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-bedaf583-031d-4710-b629-ead709008f2e tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:03:25.026467 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-bedaf583-031d-4710-b629-ead709008f2e tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:03:25.027013 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-bedaf583-031d-4710-b629-ead709008f2e tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:03:25.110600 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-7ab0269b-9ae8-4b5e-ad55-2755b980c88e tempest-SecurityGroupsTestAdminJSON-446909888 tempest-SecurityGroupsTestAdminJSON-446909888-project-admin] 10.222.0.13 "DELETE /compute/v2.1/os-security-groups/199eaaa4-1f42-46df-b0c1-263c314a4538" status: 202 len: 0 microversion: 2.1 time: 0.991298 Nov 01 19:03:25.113400 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1218/2462] 10.222.0.13 () {58 vars in 1272 bytes} [Tue Nov 1 19:03:24 2022] DELETE /compute/v2.1/os-security-groups/199eaaa4-1f42-46df-b0c1-263c314a4538 => generated 0 bytes in 995 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 01 19:03:25.121905 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-b67a1351-189b-488b-9ed1-965eb029cd76 tempest-SecurityGroupsTestAdminJSON-446909888 tempest-SecurityGroupsTestAdminJSON-446909888-project-admin] Calling method '.version_select at 0x7f0ae1a19280>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:03:25.205134 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-bedaf583-031d-4710-b629-ead709008f2e tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52acef7992d64d378fd8ac333887fd0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af51b8733e984c2ca87df2d8163dedf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:03:25.214478 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-bedaf583-031d-4710-b629-ead709008f2e tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] 10.222.0.13 "GET /compute/v2.1/servers/12b6a241-81e5-4cb3-b138-ca28f4018732" status: 200 len: 1333 microversion: 2.1 time: 0.214195 Nov 01 19:03:25.215150 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1245/2463] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:03:24 2022] GET /compute/v2.1/servers/12b6a241-81e5-4cb3-b138-ca28f4018732 => generated 1333 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:03:25.401699 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-32fd7895-074a-4ca6-840d-0faaf89b81c6 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:03:25.402210 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-32fd7895-074a-4ca6-840d-0faaf89b81c6 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] [instance: 869ca597-f199-474f-a680-59b0a75512c7] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:03:25.405332 n-d-863052-2 devstack@n-api.service[121403]: DEBUG dbcounter [-] [121403] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=121403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 19:03:25.409238 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-32fd7895-074a-4ca6-840d-0faaf89b81c6 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:03:25.409826 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-32fd7895-074a-4ca6-840d-0faaf89b81c6 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:03:25.410371 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-32fd7895-074a-4ca6-840d-0faaf89b81c6 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:03:25.411092 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-32fd7895-074a-4ca6-840d-0faaf89b81c6 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:03:25.411551 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-32fd7895-074a-4ca6-840d-0faaf89b81c6 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:03:25.411981 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-32fd7895-074a-4ca6-840d-0faaf89b81c6 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:03:25.455479 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-32fd7895-074a-4ca6-840d-0faaf89b81c6 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] [instance: 869ca597-f199-474f-a680-59b0a75512c7] Going to try to terminate instance {{(pid=121403) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 01 19:03:25.560017 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-32fd7895-074a-4ca6-840d-0faaf89b81c6 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] 10.222.0.13 "DELETE /compute/v2.1/servers/869ca597-f199-474f-a680-59b0a75512c7" status: 204 len: 0 microversion: 2.1 time: 0.161448 Nov 01 19:03:25.560903 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1246/2464] 10.222.0.13 () {58 vars in 1239 bytes} [Tue Nov 1 19:03:25 2022] DELETE /compute/v2.1/servers/869ca597-f199-474f-a680-59b0a75512c7 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 01 19:03:25.569965 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-d1938e3f-2582-44ba-b6a2-7e73130b2b1d tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:03:25.570773 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-d1938e3f-2582-44ba-b6a2-7e73130b2b1d tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] [instance: 869ca597-f199-474f-a680-59b0a75512c7] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:03:25.577193 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d1938e3f-2582-44ba-b6a2-7e73130b2b1d tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:03:25.577838 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d1938e3f-2582-44ba-b6a2-7e73130b2b1d tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:03:25.578677 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d1938e3f-2582-44ba-b6a2-7e73130b2b1d tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:03:25.580096 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d1938e3f-2582-44ba-b6a2-7e73130b2b1d tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:03:25.580910 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d1938e3f-2582-44ba-b6a2-7e73130b2b1d tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:03:25.581278 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d1938e3f-2582-44ba-b6a2-7e73130b2b1d tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:03:25.681831 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-b67a1351-189b-488b-9ed1-965eb029cd76 tempest-SecurityGroupsTestAdminJSON-446909888 tempest-SecurityGroupsTestAdminJSON-446909888-project-admin] 10.222.0.13 "DELETE /compute/v2.1/os-security-groups/21be7bda-9c3a-4160-b0b9-b3b69db95858" status: 202 len: 0 microversion: 2.1 time: 0.563719 Nov 01 19:03:25.687229 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1219/2465] 10.222.0.13 () {58 vars in 1272 bytes} [Tue Nov 1 19:03:25 2022] DELETE /compute/v2.1/os-security-groups/21be7bda-9c3a-4160-b0b9-b3b69db95858 => generated 0 bytes in 570 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 01 19:03:25.696216 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-b0d9ebc1-c49e-47a3-ab37-c6289852b912 tempest-SecurityGroupsTestAdminJSON-1525942917 tempest-SecurityGroupsTestAdminJSON-1525942917-project] Calling method '.version_select at 0x7f0ae1ac0430>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:03:25.764186 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-d1938e3f-2582-44ba-b6a2-7e73130b2b1d tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a63d69c99a546f0af16329cff3ca717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a1bb191cff948e99c008b5e861ce4a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:03:25.775472 n-d-863052-2 devstack@n-api.service[121403]: DEBUG dbcounter [-] [121403] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 19:03:25.780133 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-d1938e3f-2582-44ba-b6a2-7e73130b2b1d tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] 10.222.0.13 "GET /compute/v2.1/servers/869ca597-f199-474f-a680-59b0a75512c7" status: 200 len: 1506 microversion: 2.1 time: 0.213900 Nov 01 19:03:25.781598 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1247/2466] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:03:25 2022] GET /compute/v2.1/servers/869ca597-f199-474f-a680-59b0a75512c7 => generated 1506 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:03:25.787163 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [req-5489a5a0-efd0-4209-abb8-ea0bb3ac6448 req-16d9fe50-5838-4807-8a40-dfd855aa06a3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "12b6a241-81e5-4cb3-b138-ca28f4018732", "tag": "28796d98-68e6-44c9-aee9-9383b8f25e1e"}]} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:03:25.799535 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-5489a5a0-efd0-4209-abb8-ea0bb3ac6448 req-16d9fe50-5838-4807-8a40-dfd855aa06a3 service nova] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:03:25.800318 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-5489a5a0-efd0-4209-abb8-ea0bb3ac6448 req-16d9fe50-5838-4807-8a40-dfd855aa06a3 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:03:25.801934 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-5489a5a0-efd0-4209-abb8-ea0bb3ac6448 req-16d9fe50-5838-4807-8a40-dfd855aa06a3 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:03:25.816175 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.compute.server_external_events [req-5489a5a0-efd0-4209-abb8-ea0bb3ac6448 req-16d9fe50-5838-4807-8a40-dfd855aa06a3 service nova] Creating event network-changed:28796d98-68e6-44c9-aee9-9383b8f25e1e for instance 12b6a241-81e5-4cb3-b138-ca28f4018732 on n-h1-863052-2 Nov 01 19:03:25.821404 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [req-5489a5a0-efd0-4209-abb8-ea0bb3ac6448 req-16d9fe50-5838-4807-8a40-dfd855aa06a3 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038454 Nov 01 19:03:25.822446 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1248/2467] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Nov 1 19:03:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:03:25.842757 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-c07d1dfd-14e5-4122-99e3-1cafb6913831 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:03:25.849221 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-c07d1dfd-14e5-4122-99e3-1cafb6913831 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] [instance: 992f5ec5-d256-4870-b16d-fc8d9adbd3e7] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:03:25.857719 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-c07d1dfd-14e5-4122-99e3-1cafb6913831 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:03:25.858460 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-c07d1dfd-14e5-4122-99e3-1cafb6913831 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:03:25.859022 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-c07d1dfd-14e5-4122-99e3-1cafb6913831 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:03:25.859841 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-c07d1dfd-14e5-4122-99e3-1cafb6913831 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:03:25.860439 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-c07d1dfd-14e5-4122-99e3-1cafb6913831 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:03:25.861515 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-c07d1dfd-14e5-4122-99e3-1cafb6913831 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:03:26.017952 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-c07d1dfd-14e5-4122-99e3-1cafb6913831 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb496b3faac4abbae73d389f2042e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e2520220d454764b8c139a58d78ac83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:03:26.027990 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-c07d1dfd-14e5-4122-99e3-1cafb6913831 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] 10.222.0.13 "GET /compute/v2.1/servers/992f5ec5-d256-4870-b16d-fc8d9adbd3e7" status: 200 len: 1473 microversion: 2.1 time: 0.194734 Nov 01 19:03:26.028952 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1249/2468] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:03:25 2022] GET /compute/v2.1/servers/992f5ec5-d256-4870-b16d-fc8d9adbd3e7 => generated 1473 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:03:26.050080 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-1e6d2fe1-e443-4efa-815d-802939c7bd02 tempest-LiveMigrationNegativeTest-570155948 tempest-LiveMigrationNegativeTest-570155948-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:03:26.051747 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-1e6d2fe1-e443-4efa-815d-802939c7bd02 tempest-LiveMigrationNegativeTest-570155948 tempest-LiveMigrationNegativeTest-570155948-project] [instance: d405fb5d-9aed-4363-a898-cbdfbef5b82a] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:03:26.060778 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-1e6d2fe1-e443-4efa-815d-802939c7bd02 tempest-LiveMigrationNegativeTest-570155948 tempest-LiveMigrationNegativeTest-570155948-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:03:26.061906 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-1e6d2fe1-e443-4efa-815d-802939c7bd02 tempest-LiveMigrationNegativeTest-570155948 tempest-LiveMigrationNegativeTest-570155948-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:03:26.062456 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-1e6d2fe1-e443-4efa-815d-802939c7bd02 tempest-LiveMigrationNegativeTest-570155948 tempest-LiveMigrationNegativeTest-570155948-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:03:26.063213 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-1e6d2fe1-e443-4efa-815d-802939c7bd02 tempest-LiveMigrationNegativeTest-570155948 tempest-LiveMigrationNegativeTest-570155948-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:03:26.064289 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-1e6d2fe1-e443-4efa-815d-802939c7bd02 tempest-LiveMigrationNegativeTest-570155948 tempest-LiveMigrationNegativeTest-570155948-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:03:26.064745 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-1e6d2fe1-e443-4efa-815d-802939c7bd02 tempest-LiveMigrationNegativeTest-570155948 tempest-LiveMigrationNegativeTest-570155948-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:03:26.256745 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-1e6d2fe1-e443-4efa-815d-802939c7bd02 tempest-LiveMigrationNegativeTest-570155948 tempest-LiveMigrationNegativeTest-570155948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c14605afbc5445d9763db185a1305d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faa1bc7c9d564b0ebc9ecf0a2994f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:03:26.264842 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-1e6d2fe1-e443-4efa-815d-802939c7bd02 tempest-LiveMigrationNegativeTest-570155948 tempest-LiveMigrationNegativeTest-570155948-project] 10.222.0.13 "GET /compute/v2.1/servers/d405fb5d-9aed-4363-a898-cbdfbef5b82a" status: 200 len: 1319 microversion: 2.1 time: 0.220180 Nov 01 19:03:26.275290 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1250/2469] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:03:26 2022] GET /compute/v2.1/servers/d405fb5d-9aed-4363-a898-cbdfbef5b82a => generated 1319 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:03:26.280930 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [req-0342a8f8-a7ec-42f4-b381-c883d4957cef req-614af25d-c7ae-4261-a31d-987971179d2b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d405fb5d-9aed-4363-a898-cbdfbef5b82a", "name": "network-vif-plugged", "status": "completed", "tag": "3ec6380d-47fe-4dd4-83d7-85d66e3dca96"}]} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:03:26.291395 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-0342a8f8-a7ec-42f4-b381-c883d4957cef req-614af25d-c7ae-4261-a31d-987971179d2b service nova] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:03:26.291882 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-0342a8f8-a7ec-42f4-b381-c883d4957cef req-614af25d-c7ae-4261-a31d-987971179d2b service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:03:26.292315 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-0342a8f8-a7ec-42f4-b381-c883d4957cef req-614af25d-c7ae-4261-a31d-987971179d2b service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:03:26.304552 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.compute.server_external_events [req-0342a8f8-a7ec-42f4-b381-c883d4957cef req-614af25d-c7ae-4261-a31d-987971179d2b service nova] Creating event network-vif-plugged:3ec6380d-47fe-4dd4-83d7-85d66e3dca96 for instance d405fb5d-9aed-4363-a898-cbdfbef5b82a on n-h2-863052-2 Nov 01 19:03:26.309940 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [req-0342a8f8-a7ec-42f4-b381-c883d4957cef req-614af25d-c7ae-4261-a31d-987971179d2b service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032673 Nov 01 19:03:26.310605 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1251/2470] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Nov 1 19:03:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:03:26.317046 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-565aa891-feeb-4cb2-948b-b3722061c521 tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:03:26.318020 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-565aa891-feeb-4cb2-948b-b3722061c521 tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] [instance: 12b6a241-81e5-4cb3-b138-ca28f4018732] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:03:26.324103 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-565aa891-feeb-4cb2-948b-b3722061c521 tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:03:26.324788 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-565aa891-feeb-4cb2-948b-b3722061c521 tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:03:26.325065 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-565aa891-feeb-4cb2-948b-b3722061c521 tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:03:26.325760 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-565aa891-feeb-4cb2-948b-b3722061c521 tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:03:26.326215 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-565aa891-feeb-4cb2-948b-b3722061c521 tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:03:26.326636 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-565aa891-feeb-4cb2-948b-b3722061c521 tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:03:26.699056 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-b0d9ebc1-c49e-47a3-ab37-c6289852b912 tempest-SecurityGroupsTestAdminJSON-1525942917 tempest-SecurityGroupsTestAdminJSON-1525942917-project] 10.222.0.13 "DELETE /compute/v2.1/os-security-groups/306f73b5-6466-4d85-8295-2ad21dac639d" status: 202 len: 0 microversion: 2.1 time: 1.009242 Nov 01 19:03:26.706116 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1220/2471] 10.222.0.13 () {58 vars in 1272 bytes} [Tue Nov 1 19:03:25 2022] DELETE /compute/v2.1/os-security-groups/306f73b5-6466-4d85-8295-2ad21dac639d => generated 0 bytes in 1017 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 01 19:03:26.715256 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-e1022ff8-890f-454c-a482-b047cdc0bd71 tempest-SecurityGroupsTestAdminJSON-1525942917 tempest-SecurityGroupsTestAdminJSON-1525942917-project] Calling method '.version_select at 0x7f0ae1ac01f0>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:03:26.772002 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-565aa891-feeb-4cb2-948b-b3722061c521 tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52acef7992d64d378fd8ac333887fd0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af51b8733e984c2ca87df2d8163dedf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:03:26.781010 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-565aa891-feeb-4cb2-948b-b3722061c521 tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] 10.222.0.13 "GET /compute/v2.1/servers/12b6a241-81e5-4cb3-b138-ca28f4018732" status: 200 len: 1333 microversion: 2.1 time: 0.468712 Nov 01 19:03:26.781709 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1252/2472] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:03:26 2022] GET /compute/v2.1/servers/12b6a241-81e5-4cb3-b138-ca28f4018732 => generated 1333 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:03:26.808575 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-358500db-a9ce-4c94-9329-2379906f9fc5 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:03:26.809269 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-358500db-a9ce-4c94-9329-2379906f9fc5 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] [instance: 869ca597-f199-474f-a680-59b0a75512c7] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:03:26.816031 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-358500db-a9ce-4c94-9329-2379906f9fc5 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:03:26.816512 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-358500db-a9ce-4c94-9329-2379906f9fc5 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:03:26.816985 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-358500db-a9ce-4c94-9329-2379906f9fc5 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:03:26.817676 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-358500db-a9ce-4c94-9329-2379906f9fc5 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:03:26.818137 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-358500db-a9ce-4c94-9329-2379906f9fc5 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:03:26.818601 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-358500db-a9ce-4c94-9329-2379906f9fc5 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:03:27.048085 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-358500db-a9ce-4c94-9329-2379906f9fc5 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a63d69c99a546f0af16329cff3ca717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a1bb191cff948e99c008b5e861ce4a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:03:27.066774 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-358500db-a9ce-4c94-9329-2379906f9fc5 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] 10.222.0.13 "GET /compute/v2.1/servers/869ca597-f199-474f-a680-59b0a75512c7" status: 200 len: 1506 microversion: 2.1 time: 0.261822 Nov 01 19:03:27.068319 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1253/2473] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:03:26 2022] GET /compute/v2.1/servers/869ca597-f199-474f-a680-59b0a75512c7 => generated 1506 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 19:03:27.073783 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-f7cf20d4-39bb-4909-911d-1a42c5d59b7e tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:03:27.075246 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-f7cf20d4-39bb-4909-911d-1a42c5d59b7e tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] [instance: 992f5ec5-d256-4870-b16d-fc8d9adbd3e7] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:03:27.083796 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f7cf20d4-39bb-4909-911d-1a42c5d59b7e tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:03:27.085605 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f7cf20d4-39bb-4909-911d-1a42c5d59b7e tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:03:27.086228 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f7cf20d4-39bb-4909-911d-1a42c5d59b7e tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:03:27.087501 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f7cf20d4-39bb-4909-911d-1a42c5d59b7e tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:03:27.088137 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f7cf20d4-39bb-4909-911d-1a42c5d59b7e tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:03:27.088820 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f7cf20d4-39bb-4909-911d-1a42c5d59b7e tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:03:27.127151 n-d-863052-2 devstack@n-api.service[121402]: DEBUG dbcounter [-] [121402] Writing DB stats nova_cell0:SELECT=2 {{(pid=121402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 19:03:27.198245 n-d-863052-2 devstack@n-api.service[121402]: DEBUG dbcounter [-] [121402] Writing DB stats nova_cell0:SELECT=8 {{(pid=121402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 19:03:27.314921 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-f7cf20d4-39bb-4909-911d-1a42c5d59b7e tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb496b3faac4abbae73d389f2042e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e2520220d454764b8c139a58d78ac83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:03:27.324756 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-f7cf20d4-39bb-4909-911d-1a42c5d59b7e tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] 10.222.0.13 "GET /compute/v2.1/servers/992f5ec5-d256-4870-b16d-fc8d9adbd3e7" status: 200 len: 1473 microversion: 2.1 time: 0.254539 Nov 01 19:03:27.325604 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1254/2474] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:03:27 2022] GET /compute/v2.1/servers/992f5ec5-d256-4870-b16d-fc8d9adbd3e7 => generated 1473 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:03:27.331505 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-a257f724-3769-4117-b486-b4315e706f93 tempest-LiveMigrationNegativeTest-570155948 tempest-LiveMigrationNegativeTest-570155948-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:03:27.333202 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-a257f724-3769-4117-b486-b4315e706f93 tempest-LiveMigrationNegativeTest-570155948 tempest-LiveMigrationNegativeTest-570155948-project] [instance: d405fb5d-9aed-4363-a898-cbdfbef5b82a] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:03:27.339644 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-a257f724-3769-4117-b486-b4315e706f93 tempest-LiveMigrationNegativeTest-570155948 tempest-LiveMigrationNegativeTest-570155948-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:03:27.340367 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-a257f724-3769-4117-b486-b4315e706f93 tempest-LiveMigrationNegativeTest-570155948 tempest-LiveMigrationNegativeTest-570155948-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:03:27.341012 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-a257f724-3769-4117-b486-b4315e706f93 tempest-LiveMigrationNegativeTest-570155948 tempest-LiveMigrationNegativeTest-570155948-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:03:27.341900 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-a257f724-3769-4117-b486-b4315e706f93 tempest-LiveMigrationNegativeTest-570155948 tempest-LiveMigrationNegativeTest-570155948-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:03:27.342730 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-a257f724-3769-4117-b486-b4315e706f93 tempest-LiveMigrationNegativeTest-570155948 tempest-LiveMigrationNegativeTest-570155948-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:03:27.343365 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-a257f724-3769-4117-b486-b4315e706f93 tempest-LiveMigrationNegativeTest-570155948 tempest-LiveMigrationNegativeTest-570155948-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:03:27.390615 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-e1022ff8-890f-454c-a482-b047cdc0bd71 tempest-SecurityGroupsTestAdminJSON-1525942917 tempest-SecurityGroupsTestAdminJSON-1525942917-project] 10.222.0.13 "DELETE /compute/v2.1/os-security-groups/34c3435a-b19d-4582-b46c-509f98b2d8b1" status: 202 len: 0 microversion: 2.1 time: 0.683001 Nov 01 19:03:27.392076 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1221/2475] 10.222.0.13 () {58 vars in 1272 bytes} [Tue Nov 1 19:03:26 2022] DELETE /compute/v2.1/os-security-groups/34c3435a-b19d-4582-b46c-509f98b2d8b1 => generated 0 bytes in 685 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 01 19:03:27.634781 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-a257f724-3769-4117-b486-b4315e706f93 tempest-LiveMigrationNegativeTest-570155948 tempest-LiveMigrationNegativeTest-570155948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c14605afbc5445d9763db185a1305d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faa1bc7c9d564b0ebc9ecf0a2994f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:03:27.652168 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-a257f724-3769-4117-b486-b4315e706f93 tempest-LiveMigrationNegativeTest-570155948 tempest-LiveMigrationNegativeTest-570155948-project] 10.222.0.13 "GET /compute/v2.1/servers/d405fb5d-9aed-4363-a898-cbdfbef5b82a" status: 200 len: 1319 microversion: 2.1 time: 0.325191 Nov 01 19:03:27.672607 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1255/2476] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:03:27 2022] GET /compute/v2.1/servers/d405fb5d-9aed-4363-a898-cbdfbef5b82a => generated 1319 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:03:27.805531 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-28f9680f-25e0-4f5c-bfa2-92a55db518be tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:03:27.806242 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-28f9680f-25e0-4f5c-bfa2-92a55db518be tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] [instance: 12b6a241-81e5-4cb3-b138-ca28f4018732] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:03:27.820973 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-28f9680f-25e0-4f5c-bfa2-92a55db518be tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:03:27.821799 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-28f9680f-25e0-4f5c-bfa2-92a55db518be tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:03:27.822546 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-28f9680f-25e0-4f5c-bfa2-92a55db518be tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:03:27.824182 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-28f9680f-25e0-4f5c-bfa2-92a55db518be tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:03:27.824860 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-28f9680f-25e0-4f5c-bfa2-92a55db518be tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:03:27.825456 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-28f9680f-25e0-4f5c-bfa2-92a55db518be tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:03:27.825890 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [req-a25524f4-5abf-41cc-b7d7-1a48e653759d req-868e8325-73c0-473e-8193-16e7acda89d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "869ca597-f199-474f-a680-59b0a75512c7", "name": "network-vif-deleted", "tag": "97110a86-c3fd-48ee-9f17-518284b372d0"}]} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:03:27.844544 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-a25524f4-5abf-41cc-b7d7-1a48e653759d req-868e8325-73c0-473e-8193-16e7acda89d1 service nova] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:03:27.845072 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-a25524f4-5abf-41cc-b7d7-1a48e653759d req-868e8325-73c0-473e-8193-16e7acda89d1 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:03:27.845659 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-a25524f4-5abf-41cc-b7d7-1a48e653759d req-868e8325-73c0-473e-8193-16e7acda89d1 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:03:27.867097 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.compute.server_external_events [req-a25524f4-5abf-41cc-b7d7-1a48e653759d req-868e8325-73c0-473e-8193-16e7acda89d1 service nova] Creating event network-vif-deleted:97110a86-c3fd-48ee-9f17-518284b372d0 for instance 869ca597-f199-474f-a680-59b0a75512c7 on n-h2-863052-2 Nov 01 19:03:27.874317 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [req-a25524f4-5abf-41cc-b7d7-1a48e653759d req-868e8325-73c0-473e-8193-16e7acda89d1 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052705 Nov 01 19:03:27.883413 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1256/2477] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Nov 1 19:03:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 01 19:03:28.094131 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-bdded4b4-85d3-44b8-9473-9944a0656b45 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:03:28.105961 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-bdded4b4-85d3-44b8-9473-9944a0656b45 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] [instance: 869ca597-f199-474f-a680-59b0a75512c7] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:03:28.114602 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-bdded4b4-85d3-44b8-9473-9944a0656b45 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:03:28.115173 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-bdded4b4-85d3-44b8-9473-9944a0656b45 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:03:28.115618 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-bdded4b4-85d3-44b8-9473-9944a0656b45 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:03:28.116515 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-bdded4b4-85d3-44b8-9473-9944a0656b45 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:03:28.117002 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-bdded4b4-85d3-44b8-9473-9944a0656b45 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:03:28.117434 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-bdded4b4-85d3-44b8-9473-9944a0656b45 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:03:28.151856 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-bdded4b4-85d3-44b8-9473-9944a0656b45 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:03:28.152467 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-bdded4b4-85d3-44b8-9473-9944a0656b45 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:03:28.153027 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-bdded4b4-85d3-44b8-9473-9944a0656b45 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:03:28.153593 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.objects.instance [None req-bdded4b4-85d3-44b8-9473-9944a0656b45 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lazy-loading 'fault' on Instance uuid 869ca597-f199-474f-a680-59b0a75512c7 {{(pid=121403) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 01 19:03:28.203313 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-bdded4b4-85d3-44b8-9473-9944a0656b45 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a63d69c99a546f0af16329cff3ca717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a1bb191cff948e99c008b5e861ce4a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:03:28.212091 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-bdded4b4-85d3-44b8-9473-9944a0656b45 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] 10.222.0.13 "GET /compute/v2.1/servers/869ca597-f199-474f-a680-59b0a75512c7" status: 200 len: 1311 microversion: 2.1 time: 0.122264 Nov 01 19:03:28.216677 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1257/2478] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:03:28 2022] GET /compute/v2.1/servers/869ca597-f199-474f-a680-59b0a75512c7 => generated 1311 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 19:03:28.248069 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [req-20b6e4d0-159a-40e8-b028-cfee75a851f6 req-9377ff2e-9b7c-4176-977c-1d8bbc20fb51 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "12b6a241-81e5-4cb3-b138-ca28f4018732", "tag": "83ab684c-8cbd-40cd-8ab7-9ad6c84fb96d"}]} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:03:28.265325 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-20b6e4d0-159a-40e8-b028-cfee75a851f6 req-9377ff2e-9b7c-4176-977c-1d8bbc20fb51 service nova] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:03:28.268607 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-20b6e4d0-159a-40e8-b028-cfee75a851f6 req-9377ff2e-9b7c-4176-977c-1d8bbc20fb51 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:03:28.269442 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-20b6e4d0-159a-40e8-b028-cfee75a851f6 req-9377ff2e-9b7c-4176-977c-1d8bbc20fb51 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:03:28.285195 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.compute.server_external_events [req-20b6e4d0-159a-40e8-b028-cfee75a851f6 req-9377ff2e-9b7c-4176-977c-1d8bbc20fb51 service nova] Creating event network-changed:83ab684c-8cbd-40cd-8ab7-9ad6c84fb96d for instance 12b6a241-81e5-4cb3-b138-ca28f4018732 on n-h1-863052-2 Nov 01 19:03:28.290802 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [req-20b6e4d0-159a-40e8-b028-cfee75a851f6 req-9377ff2e-9b7c-4176-977c-1d8bbc20fb51 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055109 Nov 01 19:03:28.292325 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1258/2479] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Nov 1 19:03:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:03:28.351431 n-d-863052-2 devstack@n-api.service[121403]: DEBUG dbcounter [-] [121403] Writing DB stats nova_cell0:SELECT=8 {{(pid=121403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 19:03:28.357162 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-85d4fc12-e70e-4d47-997e-0be0f5592f10 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:03:28.358102 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-85d4fc12-e70e-4d47-997e-0be0f5592f10 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] [instance: 992f5ec5-d256-4870-b16d-fc8d9adbd3e7] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:03:28.369318 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-85d4fc12-e70e-4d47-997e-0be0f5592f10 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:03:28.371431 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-85d4fc12-e70e-4d47-997e-0be0f5592f10 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:03:28.373832 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-85d4fc12-e70e-4d47-997e-0be0f5592f10 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:03:28.374571 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-85d4fc12-e70e-4d47-997e-0be0f5592f10 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:03:28.375082 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-85d4fc12-e70e-4d47-997e-0be0f5592f10 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:03:28.375596 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-85d4fc12-e70e-4d47-997e-0be0f5592f10 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:03:28.618998 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-28f9680f-25e0-4f5c-bfa2-92a55db518be tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52acef7992d64d378fd8ac333887fd0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af51b8733e984c2ca87df2d8163dedf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:03:28.633708 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-28f9680f-25e0-4f5c-bfa2-92a55db518be tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] 10.222.0.13 "GET /compute/v2.1/servers/12b6a241-81e5-4cb3-b138-ca28f4018732" status: 200 len: 1333 microversion: 2.1 time: 0.832531 Nov 01 19:03:28.635368 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1222/2480] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:03:27 2022] GET /compute/v2.1/servers/12b6a241-81e5-4cb3-b138-ca28f4018732 => generated 1333 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:03:28.636560 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-85d4fc12-e70e-4d47-997e-0be0f5592f10 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb496b3faac4abbae73d389f2042e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e2520220d454764b8c139a58d78ac83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:03:28.650228 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-85d4fc12-e70e-4d47-997e-0be0f5592f10 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] 10.222.0.13 "GET /compute/v2.1/servers/992f5ec5-d256-4870-b16d-fc8d9adbd3e7" status: 200 len: 1473 microversion: 2.1 time: 0.298184 Nov 01 19:03:28.655320 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1259/2481] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:03:28 2022] GET /compute/v2.1/servers/992f5ec5-d256-4870-b16d-fc8d9adbd3e7 => generated 1473 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 19:03:28.687984 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-7c4f6a91-7619-4333-8464-0b9875bfe83d tempest-LiveMigrationNegativeTest-570155948 tempest-LiveMigrationNegativeTest-570155948-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:03:28.696154 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-7c4f6a91-7619-4333-8464-0b9875bfe83d tempest-LiveMigrationNegativeTest-570155948 tempest-LiveMigrationNegativeTest-570155948-project] [instance: d405fb5d-9aed-4363-a898-cbdfbef5b82a] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:03:28.709027 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-7c4f6a91-7619-4333-8464-0b9875bfe83d tempest-LiveMigrationNegativeTest-570155948 tempest-LiveMigrationNegativeTest-570155948-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:03:28.709827 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-7c4f6a91-7619-4333-8464-0b9875bfe83d tempest-LiveMigrationNegativeTest-570155948 tempest-LiveMigrationNegativeTest-570155948-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:03:28.711966 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-7c4f6a91-7619-4333-8464-0b9875bfe83d tempest-LiveMigrationNegativeTest-570155948 tempest-LiveMigrationNegativeTest-570155948-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:03:28.713642 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-7c4f6a91-7619-4333-8464-0b9875bfe83d tempest-LiveMigrationNegativeTest-570155948 tempest-LiveMigrationNegativeTest-570155948-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:03:28.715243 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-7c4f6a91-7619-4333-8464-0b9875bfe83d tempest-LiveMigrationNegativeTest-570155948 tempest-LiveMigrationNegativeTest-570155948-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:03:28.716034 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-7c4f6a91-7619-4333-8464-0b9875bfe83d tempest-LiveMigrationNegativeTest-570155948 tempest-LiveMigrationNegativeTest-570155948-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:03:29.094943 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-7c4f6a91-7619-4333-8464-0b9875bfe83d tempest-LiveMigrationNegativeTest-570155948 tempest-LiveMigrationNegativeTest-570155948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c14605afbc5445d9763db185a1305d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faa1bc7c9d564b0ebc9ecf0a2994f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:03:29.113430 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-7c4f6a91-7619-4333-8464-0b9875bfe83d tempest-LiveMigrationNegativeTest-570155948 tempest-LiveMigrationNegativeTest-570155948-project] 10.222.0.13 "GET /compute/v2.1/servers/d405fb5d-9aed-4363-a898-cbdfbef5b82a" status: 200 len: 1469 microversion: 2.1 time: 0.436965 Nov 01 19:03:29.129000 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1223/2482] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:03:28 2022] GET /compute/v2.1/servers/d405fb5d-9aed-4363-a898-cbdfbef5b82a => generated 1469 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:03:29.144730 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-2221f5a9-f23e-4091-b0ec-1eadf3cbba99 tempest-LiveMigrationNegativeTest-1857188272 tempest-LiveMigrationNegativeTest-1857188272-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:03:29.145958 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-2221f5a9-f23e-4091-b0ec-1eadf3cbba99 tempest-LiveMigrationNegativeTest-1857188272 tempest-LiveMigrationNegativeTest-1857188272-project-admin] [instance: d405fb5d-9aed-4363-a898-cbdfbef5b82a] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:03:29.161391 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-2221f5a9-f23e-4091-b0ec-1eadf3cbba99 tempest-LiveMigrationNegativeTest-1857188272 tempest-LiveMigrationNegativeTest-1857188272-project-admin] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:03:29.163421 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-2221f5a9-f23e-4091-b0ec-1eadf3cbba99 tempest-LiveMigrationNegativeTest-1857188272 tempest-LiveMigrationNegativeTest-1857188272-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:03:29.166912 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-2221f5a9-f23e-4091-b0ec-1eadf3cbba99 tempest-LiveMigrationNegativeTest-1857188272 tempest-LiveMigrationNegativeTest-1857188272-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:03:29.167688 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-2221f5a9-f23e-4091-b0ec-1eadf3cbba99 tempest-LiveMigrationNegativeTest-1857188272 tempest-LiveMigrationNegativeTest-1857188272-project-admin] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:03:29.168171 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-2221f5a9-f23e-4091-b0ec-1eadf3cbba99 tempest-LiveMigrationNegativeTest-1857188272 tempest-LiveMigrationNegativeTest-1857188272-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:03:29.168645 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-2221f5a9-f23e-4091-b0ec-1eadf3cbba99 tempest-LiveMigrationNegativeTest-1857188272 tempest-LiveMigrationNegativeTest-1857188272-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:03:29.211178 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.objects.instance [None req-2221f5a9-f23e-4091-b0ec-1eadf3cbba99 tempest-LiveMigrationNegativeTest-1857188272 tempest-LiveMigrationNegativeTest-1857188272-project-admin] Lazy-loading 'flavor' on Instance uuid d405fb5d-9aed-4363-a898-cbdfbef5b82a {{(pid=121403) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 01 19:03:29.240296 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-fb8cc186-e5c5-4f04-8731-608a15717d67 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:03:29.241174 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-fb8cc186-e5c5-4f04-8731-608a15717d67 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] [instance: 869ca597-f199-474f-a680-59b0a75512c7] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:03:29.251311 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-fb8cc186-e5c5-4f04-8731-608a15717d67 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:03:29.253516 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-fb8cc186-e5c5-4f04-8731-608a15717d67 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:03:29.254984 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-fb8cc186-e5c5-4f04-8731-608a15717d67 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:03:29.260644 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-fb8cc186-e5c5-4f04-8731-608a15717d67 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:03:29.261360 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-fb8cc186-e5c5-4f04-8731-608a15717d67 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:03:29.261967 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-fb8cc186-e5c5-4f04-8731-608a15717d67 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:03:29.278890 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.wsgi [None req-fb8cc186-e5c5-4f04-8731-608a15717d67 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] HTTP exception thrown: Instance 869ca597-f199-474f-a680-59b0a75512c7 could not be found. Nov 01 19:03:29.282073 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-fb8cc186-e5c5-4f04-8731-608a15717d67 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Request method failure captured: Nov 01 19:03:29.282073 n-d-863052-2 devstack@n-api.service[121402]: request: GET /compute/v2.1/servers/869ca597-f199-474f-a680-59b0a75512c7 HTTP/1.1 Nov 01 19:03:29.282073 n-d-863052-2 devstack@n-api.service[121402]: Accept: application/json Nov 01 19:03:29.282073 n-d-863052-2 devstack@n-api.service[121402]: Accept-Encoding: identity Nov 01 19:03:29.282073 n-d-863052-2 devstack@n-api.service[121402]: Connection: close Nov 01 19:03:29.282073 n-d-863052-2 devstack@n-api.service[121402]: Content-Length: 0 Nov 01 19:03:29.282073 n-d-863052-2 devstack@n-api.service[121402]: Content-Type: application/json Nov 01 19:03:29.282073 n-d-863052-2 devstack@n-api.service[121402]: Host: 10.222.0.13 Nov 01 19:03:29.282073 n-d-863052-2 devstack@n-api.service[121402]: Openstack-System-Scope: None Nov 01 19:03:29.282073 n-d-863052-2 devstack@n-api.service[121402]: User-Agent: python-urllib3/1.26.12 Nov 01 19:03:29.282073 n-d-863052-2 devstack@n-api.service[121402]: X-Auth-Token: gAAAAABjYWwgP3kjyQKi9Uf4PP24jmeKCOPNU51FZoHLreZdbFyZPhRW-EeK2Se64f-CjytM5LjMEtkBLCti_PQz0S3BXRBnTu4aanJgpXShIx2i6Yz4YqCrWhQ373B1BFIdgiChyw2k6U5YvJRz35UfhTE-zhCjFxCXYsQplbVOAVzO2wYqVeI Nov 01 19:03:29.282073 n-d-863052-2 devstack@n-api.service[121402]: X-Domain-Id: None Nov 01 19:03:29.282073 n-d-863052-2 devstack@n-api.service[121402]: X-Domain-Name: None Nov 01 19:03:29.282073 n-d-863052-2 devstack@n-api.service[121402]: X-Identity-Status: Confirmed Nov 01 19:03:29.282073 n-d-863052-2 devstack@n-api.service[121402]: X-Is-Admin-Project: True Nov 01 19:03:29.282073 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Domain-Id: default Nov 01 19:03:29.282073 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Domain-Name: Default Nov 01 19:03:29.282073 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Id: 4a1bb191cff948e99c008b5e861ce4a8 Nov 01 19:03:29.282073 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-215636868 Nov 01 19:03:29.282073 n-d-863052-2 devstack@n-api.service[121402]: X-Role: member,reader Nov 01 19:03:29.282073 n-d-863052-2 devstack@n-api.service[121402]: X-Roles: member,reader Nov 01 19:03:29.282073 n-d-863052-2 devstack@n-api.service[121402]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/4a1bb191cff948e99c008b5e861ce4a8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/4a1bb191cff948e99c008b5e861ce4a8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_4a1bb191cff948e99c008b5e861ce4a8", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/4a1bb191cff948e99c008b5e861ce4a8"}]}] Nov 01 19:03:29.282073 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant: tempest-ServerRescueNegativeTestJSON-215636868 Nov 01 19:03:29.282073 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant-Id: 4a1bb191cff948e99c008b5e861ce4a8 Nov 01 19:03:29.282073 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-215636868 Nov 01 19:03:29.282073 n-d-863052-2 devstack@n-api.service[121402]: X-User: tempest-ServerRescueNegativeTestJSON-215636868-project Nov 01 19:03:29.282073 n-d-863052-2 devstack@n-api.service[121402]: X-User-Domain-Id: default Nov 01 19:03:29.282073 n-d-863052-2 devstack@n-api.service[121402]: X-User-Domain-Name: Default Nov 01 19:03:29.282073 n-d-863052-2 devstack@n-api.service[121402]: X-User-Id: 6a63d69c99a546f0af16329cff3ca717 Nov 01 19:03:29.282073 n-d-863052-2 devstack@n-api.service[121402]: X-User-Name: tempest-ServerRescueNegativeTestJSON-215636868-project Nov 01 19:03:29.282073 n-d-863052-2 devstack@n-api.service[121402]: method: > Nov 01 19:03:29.282073 n-d-863052-2 devstack@n-api.service[121402]: exception: Instance 869ca597-f199-474f-a680-59b0a75512c7 could not be found. Nov 01 19:03:29.282073 n-d-863052-2 devstack@n-api.service[121402]: action_args: {'id': '869ca597-f199-474f-a680-59b0a75512c7'} Nov 01 19:03:29.282073 n-d-863052-2 devstack@n-api.service[121402]: {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 01 19:03:29.282073 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:03:29.282073 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 01 19:03:29.282073 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 01 19:03:29.282073 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 01 19:03:29.282073 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 01 19:03:29.282073 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 01 19:03:29.282073 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 01 19:03:29.282073 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 01 19:03:29.282073 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 01 19:03:29.282073 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 869ca597-f199-474f-a680-59b0a75512c7 could not be found. Nov 01 19:03:29.282073 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:03:29.282073 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:03:29.282073 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:03:29.282073 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:03:29.282073 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:03:29.282073 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:03:29.282073 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 01 19:03:29.282073 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 01 19:03:29.282073 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 01 19:03:29.282073 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 01 19:03:29.282073 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 01 19:03:29.282073 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 01 19:03:29.282073 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 01 19:03:29.282073 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 01 19:03:29.282073 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 01 19:03:29.282073 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 01 19:03:29.282073 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 869ca597-f199-474f-a680-59b0a75512c7 could not be found. Nov 01 19:03:29.282073 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:03:29.282073 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:03:29.286157 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:03:29.286157 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:03:29.286157 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:03:29.286157 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:03:29.286157 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 01 19:03:29.286157 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 01 19:03:29.286157 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 869ca597-f199-474f-a680-59b0a75512c7 could not be found. Nov 01 19:03:29.286157 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:03:29.288566 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-fb8cc186-e5c5-4f04-8731-608a15717d67 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Returning 404 to user: Instance 869ca597-f199-474f-a680-59b0a75512c7 could not be found. {{(pid=121402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 01 19:03:29.290034 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-fb8cc186-e5c5-4f04-8731-608a15717d67 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] 10.222.0.13 "GET /compute/v2.1/servers/869ca597-f199-474f-a680-59b0a75512c7" status: 404 len: 111 microversion: 2.1 time: 0.054576 Nov 01 19:03:29.291429 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1224/2483] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:03:29 2022] GET /compute/v2.1/servers/869ca597-f199-474f-a680-59b0a75512c7 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 01 19:03:29.306973 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-cb46e0ee-58b8-4a0c-9820-221c92d40ab6 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:03:29.307480 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-cb46e0ee-58b8-4a0c-9820-221c92d40ab6 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] [instance: ed4798be-a45e-46f5-8f7e-1165f6479bd1] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:03:29.327513 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-cb46e0ee-58b8-4a0c-9820-221c92d40ab6 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:03:29.327996 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-cb46e0ee-58b8-4a0c-9820-221c92d40ab6 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:03:29.330941 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-cb46e0ee-58b8-4a0c-9820-221c92d40ab6 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:03:29.332423 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-2221f5a9-f23e-4091-b0ec-1eadf3cbba99 tempest-LiveMigrationNegativeTest-1857188272 tempest-LiveMigrationNegativeTest-1857188272-project-admin] 10.222.0.13 "POST /compute/v2.1/servers/d405fb5d-9aed-4363-a898-cbdfbef5b82a/action" status: 202 len: 0 microversion: 2.1 time: 0.190499 Nov 01 19:03:29.336069 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1260/2484] 10.222.0.13 () {60 vars in 1278 bytes} [Tue Nov 1 19:03:29 2022] POST /compute/v2.1/servers/d405fb5d-9aed-4363-a898-cbdfbef5b82a/action => generated 0 bytes in 194 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 01 19:03:29.337070 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-cb46e0ee-58b8-4a0c-9820-221c92d40ab6 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:03:29.337801 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-cb46e0ee-58b8-4a0c-9820-221c92d40ab6 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:03:29.341049 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-cb46e0ee-58b8-4a0c-9820-221c92d40ab6 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:03:29.351615 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-77bcab89-3cfe-4382-834f-7548a385fc55 tempest-LiveMigrationNegativeTest-570155948 tempest-LiveMigrationNegativeTest-570155948-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:03:29.355270 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-77bcab89-3cfe-4382-834f-7548a385fc55 tempest-LiveMigrationNegativeTest-570155948 tempest-LiveMigrationNegativeTest-570155948-project] [instance: d405fb5d-9aed-4363-a898-cbdfbef5b82a] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:03:29.373993 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-77bcab89-3cfe-4382-834f-7548a385fc55 tempest-LiveMigrationNegativeTest-570155948 tempest-LiveMigrationNegativeTest-570155948-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:03:29.375079 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-77bcab89-3cfe-4382-834f-7548a385fc55 tempest-LiveMigrationNegativeTest-570155948 tempest-LiveMigrationNegativeTest-570155948-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:03:29.375697 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-77bcab89-3cfe-4382-834f-7548a385fc55 tempest-LiveMigrationNegativeTest-570155948 tempest-LiveMigrationNegativeTest-570155948-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:03:29.376768 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-77bcab89-3cfe-4382-834f-7548a385fc55 tempest-LiveMigrationNegativeTest-570155948 tempest-LiveMigrationNegativeTest-570155948-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:03:29.377802 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-77bcab89-3cfe-4382-834f-7548a385fc55 tempest-LiveMigrationNegativeTest-570155948 tempest-LiveMigrationNegativeTest-570155948-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:03:29.379882 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-77bcab89-3cfe-4382-834f-7548a385fc55 tempest-LiveMigrationNegativeTest-570155948 tempest-LiveMigrationNegativeTest-570155948-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:03:29.426694 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-cb46e0ee-58b8-4a0c-9820-221c92d40ab6 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] [instance: ed4798be-a45e-46f5-8f7e-1165f6479bd1] Going to try to terminate instance {{(pid=121402) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 01 19:03:29.616471 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-cb46e0ee-58b8-4a0c-9820-221c92d40ab6 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] 10.222.0.13 "DELETE /compute/v2.1/servers/ed4798be-a45e-46f5-8f7e-1165f6479bd1" status: 204 len: 0 microversion: 2.1 time: 0.318707 Nov 01 19:03:29.623517 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1225/2485] 10.222.0.13 () {58 vars in 1239 bytes} [Tue Nov 1 19:03:29 2022] DELETE /compute/v2.1/servers/ed4798be-a45e-46f5-8f7e-1165f6479bd1 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 01 19:03:29.634381 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-5e2e1ca2-6087-4f32-b41a-a7d522b9ba56 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:03:29.635656 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-5e2e1ca2-6087-4f32-b41a-a7d522b9ba56 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] [instance: ed4798be-a45e-46f5-8f7e-1165f6479bd1] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:03:29.644897 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-5e2e1ca2-6087-4f32-b41a-a7d522b9ba56 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:03:29.645414 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-5e2e1ca2-6087-4f32-b41a-a7d522b9ba56 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:03:29.646004 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-5e2e1ca2-6087-4f32-b41a-a7d522b9ba56 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:03:29.646768 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-5e2e1ca2-6087-4f32-b41a-a7d522b9ba56 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:03:29.647238 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-5e2e1ca2-6087-4f32-b41a-a7d522b9ba56 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:03:29.648454 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-5e2e1ca2-6087-4f32-b41a-a7d522b9ba56 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:03:29.725944 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-77bcab89-3cfe-4382-834f-7548a385fc55 tempest-LiveMigrationNegativeTest-570155948 tempest-LiveMigrationNegativeTest-570155948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c14605afbc5445d9763db185a1305d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faa1bc7c9d564b0ebc9ecf0a2994f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:03:29.734116 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-77bcab89-3cfe-4382-834f-7548a385fc55 tempest-LiveMigrationNegativeTest-570155948 tempest-LiveMigrationNegativeTest-570155948-project] 10.222.0.13 "GET /compute/v2.1/servers/d405fb5d-9aed-4363-a898-cbdfbef5b82a" status: 200 len: 1477 microversion: 2.1 time: 0.394876 Nov 01 19:03:29.735106 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1261/2486] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:03:29 2022] GET /compute/v2.1/servers/d405fb5d-9aed-4363-a898-cbdfbef5b82a => generated 1477 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:03:29.740463 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-a27ae247-76fb-4fb2-b6f6-fd5fc53ad5c8 tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:03:29.741178 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-a27ae247-76fb-4fb2-b6f6-fd5fc53ad5c8 tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] [instance: 12b6a241-81e5-4cb3-b138-ca28f4018732] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:03:29.753097 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-a27ae247-76fb-4fb2-b6f6-fd5fc53ad5c8 tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:03:29.754377 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-a27ae247-76fb-4fb2-b6f6-fd5fc53ad5c8 tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:03:29.755015 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-a27ae247-76fb-4fb2-b6f6-fd5fc53ad5c8 tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:03:29.755933 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-a27ae247-76fb-4fb2-b6f6-fd5fc53ad5c8 tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:03:29.756767 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-a27ae247-76fb-4fb2-b6f6-fd5fc53ad5c8 tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:03:29.757391 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-a27ae247-76fb-4fb2-b6f6-fd5fc53ad5c8 tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:03:29.879815 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-5e2e1ca2-6087-4f32-b41a-a7d522b9ba56 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a63d69c99a546f0af16329cff3ca717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a1bb191cff948e99c008b5e861ce4a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:03:29.896196 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-5e2e1ca2-6087-4f32-b41a-a7d522b9ba56 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] 10.222.0.13 "GET /compute/v2.1/servers/ed4798be-a45e-46f5-8f7e-1165f6479bd1" status: 200 len: 1521 microversion: 2.1 time: 0.268993 Nov 01 19:03:29.912823 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1226/2487] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:03:29 2022] GET /compute/v2.1/servers/ed4798be-a45e-46f5-8f7e-1165f6479bd1 => generated 1521 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:03:29.945670 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-0b307495-ad36-4932-8709-4eb6c27ce3b6 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:03:29.948188 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-0b307495-ad36-4932-8709-4eb6c27ce3b6 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] [instance: 992f5ec5-d256-4870-b16d-fc8d9adbd3e7] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:03:29.961887 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-0b307495-ad36-4932-8709-4eb6c27ce3b6 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:03:29.962838 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-0b307495-ad36-4932-8709-4eb6c27ce3b6 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:03:29.963491 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-0b307495-ad36-4932-8709-4eb6c27ce3b6 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:03:29.964941 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-0b307495-ad36-4932-8709-4eb6c27ce3b6 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:03:29.965620 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-0b307495-ad36-4932-8709-4eb6c27ce3b6 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:03:29.966337 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-0b307495-ad36-4932-8709-4eb6c27ce3b6 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:03:30.004704 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-a27ae247-76fb-4fb2-b6f6-fd5fc53ad5c8 tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52acef7992d64d378fd8ac333887fd0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af51b8733e984c2ca87df2d8163dedf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:03:30.013634 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-a27ae247-76fb-4fb2-b6f6-fd5fc53ad5c8 tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] 10.222.0.13 "GET /compute/v2.1/servers/12b6a241-81e5-4cb3-b138-ca28f4018732" status: 200 len: 1333 microversion: 2.1 time: 0.277542 Nov 01 19:03:30.029610 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1262/2488] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:03:29 2022] GET /compute/v2.1/servers/12b6a241-81e5-4cb3-b138-ca28f4018732 => generated 1333 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:03:30.268427 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-0b307495-ad36-4932-8709-4eb6c27ce3b6 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb496b3faac4abbae73d389f2042e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e2520220d454764b8c139a58d78ac83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:03:30.278873 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-0b307495-ad36-4932-8709-4eb6c27ce3b6 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] 10.222.0.13 "GET /compute/v2.1/servers/992f5ec5-d256-4870-b16d-fc8d9adbd3e7" status: 200 len: 1473 microversion: 2.1 time: 0.363975 Nov 01 19:03:30.279456 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1227/2489] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:03:29 2022] GET /compute/v2.1/servers/992f5ec5-d256-4870-b16d-fc8d9adbd3e7 => generated 1473 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:03:30.761990 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-be3cbc99-f811-47a3-8ebd-825460930a96 tempest-LiveMigrationNegativeTest-570155948 tempest-LiveMigrationNegativeTest-570155948-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:03:30.763874 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-be3cbc99-f811-47a3-8ebd-825460930a96 tempest-LiveMigrationNegativeTest-570155948 tempest-LiveMigrationNegativeTest-570155948-project] [instance: d405fb5d-9aed-4363-a898-cbdfbef5b82a] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:03:30.774819 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-be3cbc99-f811-47a3-8ebd-825460930a96 tempest-LiveMigrationNegativeTest-570155948 tempest-LiveMigrationNegativeTest-570155948-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:03:30.775466 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-be3cbc99-f811-47a3-8ebd-825460930a96 tempest-LiveMigrationNegativeTest-570155948 tempest-LiveMigrationNegativeTest-570155948-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:03:30.776508 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-be3cbc99-f811-47a3-8ebd-825460930a96 tempest-LiveMigrationNegativeTest-570155948 tempest-LiveMigrationNegativeTest-570155948-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:03:30.777420 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-be3cbc99-f811-47a3-8ebd-825460930a96 tempest-LiveMigrationNegativeTest-570155948 tempest-LiveMigrationNegativeTest-570155948-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:03:30.778333 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-be3cbc99-f811-47a3-8ebd-825460930a96 tempest-LiveMigrationNegativeTest-570155948 tempest-LiveMigrationNegativeTest-570155948-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:03:30.779228 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-be3cbc99-f811-47a3-8ebd-825460930a96 tempest-LiveMigrationNegativeTest-570155948 tempest-LiveMigrationNegativeTest-570155948-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:03:30.933833 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-e5b4c6a0-a7bb-4844-9621-c9e5e2757556 tempest-ServersTestBootFromVolume-877599095 tempest-ServersTestBootFromVolume-877599095-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:03:30.938956 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-e5b4c6a0-a7bb-4844-9621-c9e5e2757556 tempest-ServersTestBootFromVolume-877599095 tempest-ServersTestBootFromVolume-877599095-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ed2352ce53fc4045adde8cd81b78b3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651046528c204df299ca3d14c44b4a7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:03:30.940014 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-e5b4c6a0-a7bb-4844-9621-c9e5e2757556 tempest-ServersTestBootFromVolume-877599095 tempest-ServersTestBootFromVolume-877599095-project] Searching by: {'deleted': False, 'project_id': '651046528c204df299ca3d14c44b4a7a'} {{(pid=121402) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 01 19:03:30.947815 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e5b4c6a0-a7bb-4844-9621-c9e5e2757556 tempest-ServersTestBootFromVolume-877599095 tempest-ServersTestBootFromVolume-877599095-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:03:30.948621 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e5b4c6a0-a7bb-4844-9621-c9e5e2757556 tempest-ServersTestBootFromVolume-877599095 tempest-ServersTestBootFromVolume-877599095-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:03:30.949263 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e5b4c6a0-a7bb-4844-9621-c9e5e2757556 tempest-ServersTestBootFromVolume-877599095 tempest-ServersTestBootFromVolume-877599095-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:03:30.950299 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e5b4c6a0-a7bb-4844-9621-c9e5e2757556 tempest-ServersTestBootFromVolume-877599095 tempest-ServersTestBootFromVolume-877599095-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:03:30.950994 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e5b4c6a0-a7bb-4844-9621-c9e5e2757556 tempest-ServersTestBootFromVolume-877599095 tempest-ServersTestBootFromVolume-877599095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:03:30.951491 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e5b4c6a0-a7bb-4844-9621-c9e5e2757556 tempest-ServersTestBootFromVolume-877599095 tempest-ServersTestBootFromVolume-877599095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:03:30.983367 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.multi_cell_list [None req-e5b4c6a0-a7bb-4844-9621-c9e5e2757556 tempest-ServersTestBootFromVolume-877599095 tempest-ServersTestBootFromVolume-877599095-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=121402) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 01 19:03:31.022863 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-e5b4c6a0-a7bb-4844-9621-c9e5e2757556 tempest-ServersTestBootFromVolume-877599095 tempest-ServersTestBootFromVolume-877599095-project] 10.222.0.13 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.093876 Nov 01 19:03:31.024926 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1228/2490] 10.222.0.13 () {58 vars in 1125 bytes} [Tue Nov 1 19:03:30 2022] GET /compute/v2.1/servers => generated 343 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 01 19:03:31.031949 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-2ad98116-2570-4c88-9584-0ea7684e8bc3 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:03:31.033156 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-2ad98116-2570-4c88-9584-0ea7684e8bc3 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] [instance: ed4798be-a45e-46f5-8f7e-1165f6479bd1] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:03:31.040405 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2ad98116-2570-4c88-9584-0ea7684e8bc3 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:03:31.041450 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2ad98116-2570-4c88-9584-0ea7684e8bc3 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:03:31.042062 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2ad98116-2570-4c88-9584-0ea7684e8bc3 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:03:31.042906 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2ad98116-2570-4c88-9584-0ea7684e8bc3 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:03:31.043531 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2ad98116-2570-4c88-9584-0ea7684e8bc3 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:03:31.044101 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2ad98116-2570-4c88-9584-0ea7684e8bc3 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:03:31.071086 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-be3cbc99-f811-47a3-8ebd-825460930a96 tempest-LiveMigrationNegativeTest-570155948 tempest-LiveMigrationNegativeTest-570155948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c14605afbc5445d9763db185a1305d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faa1bc7c9d564b0ebc9ecf0a2994f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:03:31.079383 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-be3cbc99-f811-47a3-8ebd-825460930a96 tempest-LiveMigrationNegativeTest-570155948 tempest-LiveMigrationNegativeTest-570155948-project] 10.222.0.13 "GET /compute/v2.1/servers/d405fb5d-9aed-4363-a898-cbdfbef5b82a" status: 200 len: 1460 microversion: 2.1 time: 0.321281 Nov 01 19:03:31.080160 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1263/2491] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:03:30 2022] GET /compute/v2.1/servers/d405fb5d-9aed-4363-a898-cbdfbef5b82a => generated 1460 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:03:31.085894 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-4cbed6ca-9e12-4d06-b404-03f11d98c9b3 tempest-ServersTestBootFromVolume-877599095 tempest-ServersTestBootFromVolume-877599095-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:03:31.091353 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-4cbed6ca-9e12-4d06-b404-03f11d98c9b3 tempest-ServersTestBootFromVolume-877599095 tempest-ServersTestBootFromVolume-877599095-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ed2352ce53fc4045adde8cd81b78b3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651046528c204df299ca3d14c44b4a7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:03:31.092523 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-4cbed6ca-9e12-4d06-b404-03f11d98c9b3 tempest-ServersTestBootFromVolume-877599095 tempest-ServersTestBootFromVolume-877599095-project] Searching by: {'deleted': False, 'project_id': '651046528c204df299ca3d14c44b4a7a'} {{(pid=121403) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 01 19:03:31.098403 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-4cbed6ca-9e12-4d06-b404-03f11d98c9b3 tempest-ServersTestBootFromVolume-877599095 tempest-ServersTestBootFromVolume-877599095-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:03:31.098898 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-4cbed6ca-9e12-4d06-b404-03f11d98c9b3 tempest-ServersTestBootFromVolume-877599095 tempest-ServersTestBootFromVolume-877599095-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:03:31.099330 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-4cbed6ca-9e12-4d06-b404-03f11d98c9b3 tempest-ServersTestBootFromVolume-877599095 tempest-ServersTestBootFromVolume-877599095-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:03:31.100051 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-4cbed6ca-9e12-4d06-b404-03f11d98c9b3 tempest-ServersTestBootFromVolume-877599095 tempest-ServersTestBootFromVolume-877599095-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:03:31.100729 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-4cbed6ca-9e12-4d06-b404-03f11d98c9b3 tempest-ServersTestBootFromVolume-877599095 tempest-ServersTestBootFromVolume-877599095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:03:31.101306 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-4cbed6ca-9e12-4d06-b404-03f11d98c9b3 tempest-ServersTestBootFromVolume-877599095 tempest-ServersTestBootFromVolume-877599095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:03:31.132073 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.multi_cell_list [None req-4cbed6ca-9e12-4d06-b404-03f11d98c9b3 tempest-ServersTestBootFromVolume-877599095 tempest-ServersTestBootFromVolume-877599095-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=121403) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 01 19:03:31.158722 n-d-863052-2 devstack@n-api.service[121403]: DEBUG dbcounter [-] [121403] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 19:03:31.222765 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-4cbed6ca-9e12-4d06-b404-03f11d98c9b3 tempest-ServersTestBootFromVolume-877599095 tempest-ServersTestBootFromVolume-877599095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed2352ce53fc4045adde8cd81b78b3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651046528c204df299ca3d14c44b4a7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:03:31.222949 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-2ad98116-2570-4c88-9584-0ea7684e8bc3 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a63d69c99a546f0af16329cff3ca717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a1bb191cff948e99c008b5e861ce4a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:03:31.230356 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-4cbed6ca-9e12-4d06-b404-03f11d98c9b3 tempest-ServersTestBootFromVolume-877599095 tempest-ServersTestBootFromVolume-877599095-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:03:31.231089 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-4cbed6ca-9e12-4d06-b404-03f11d98c9b3 tempest-ServersTestBootFromVolume-877599095 tempest-ServersTestBootFromVolume-877599095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:03:31.231831 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-4cbed6ca-9e12-4d06-b404-03f11d98c9b3 tempest-ServersTestBootFromVolume-877599095 tempest-ServersTestBootFromVolume-877599095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:03:31.232063 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-2ad98116-2570-4c88-9584-0ea7684e8bc3 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] 10.222.0.13 "GET /compute/v2.1/servers/ed4798be-a45e-46f5-8f7e-1165f6479bd1" status: 200 len: 1521 microversion: 2.1 time: 0.205319 Nov 01 19:03:31.237676 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1229/2492] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:03:31 2022] GET /compute/v2.1/servers/ed4798be-a45e-46f5-8f7e-1165f6479bd1 => generated 1521 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:03:31.253934 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-863f72ed-f435-45d4-8132-b69995a89188 tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:03:31.254544 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-863f72ed-f435-45d4-8132-b69995a89188 tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] [instance: 12b6a241-81e5-4cb3-b138-ca28f4018732] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:03:31.263556 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-863f72ed-f435-45d4-8132-b69995a89188 tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:03:31.264047 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-863f72ed-f435-45d4-8132-b69995a89188 tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:03:31.264486 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-863f72ed-f435-45d4-8132-b69995a89188 tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:03:31.265214 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-863f72ed-f435-45d4-8132-b69995a89188 tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:03:31.265805 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-863f72ed-f435-45d4-8132-b69995a89188 tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:03:31.266154 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-863f72ed-f435-45d4-8132-b69995a89188 tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:03:31.385810 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-4cbed6ca-9e12-4d06-b404-03f11d98c9b3 tempest-ServersTestBootFromVolume-877599095 tempest-ServersTestBootFromVolume-877599095-project] 10.222.0.13 "GET /compute/v2.1/servers/detail" status: 200 len: 1602 microversion: 2.1 time: 0.303931 Nov 01 19:03:31.404927 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1264/2493] 10.222.0.13 () {58 vars in 1146 bytes} [Tue Nov 1 19:03:31 2022] GET /compute/v2.1/servers/detail => generated 1602 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:03:31.413476 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-a550036e-b550-4995-a166-658ce42b8dda tempest-LiveMigrationNegativeTest-1857188272 tempest-LiveMigrationNegativeTest-1857188272-project-admin] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:03:31.414515 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-a550036e-b550-4995-a166-658ce42b8dda tempest-LiveMigrationNegativeTest-1857188272 tempest-LiveMigrationNegativeTest-1857188272-project-admin] [instance: d405fb5d-9aed-4363-a898-cbdfbef5b82a] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:03:31.425399 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-a550036e-b550-4995-a166-658ce42b8dda tempest-LiveMigrationNegativeTest-1857188272 tempest-LiveMigrationNegativeTest-1857188272-project-admin] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:03:31.426416 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-a550036e-b550-4995-a166-658ce42b8dda tempest-LiveMigrationNegativeTest-1857188272 tempest-LiveMigrationNegativeTest-1857188272-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:03:31.426850 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-a550036e-b550-4995-a166-658ce42b8dda tempest-LiveMigrationNegativeTest-1857188272 tempest-LiveMigrationNegativeTest-1857188272-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:03:31.427745 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-a550036e-b550-4995-a166-658ce42b8dda tempest-LiveMigrationNegativeTest-1857188272 tempest-LiveMigrationNegativeTest-1857188272-project-admin] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:03:31.428343 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-a550036e-b550-4995-a166-658ce42b8dda tempest-LiveMigrationNegativeTest-1857188272 tempest-LiveMigrationNegativeTest-1857188272-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:03:31.428961 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-a550036e-b550-4995-a166-658ce42b8dda tempest-LiveMigrationNegativeTest-1857188272 tempest-LiveMigrationNegativeTest-1857188272-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:03:31.469590 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-863f72ed-f435-45d4-8132-b69995a89188 tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52acef7992d64d378fd8ac333887fd0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af51b8733e984c2ca87df2d8163dedf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:03:31.478712 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-863f72ed-f435-45d4-8132-b69995a89188 tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] 10.222.0.13 "GET /compute/v2.1/servers/12b6a241-81e5-4cb3-b138-ca28f4018732" status: 200 len: 1333 microversion: 2.1 time: 0.237781 Nov 01 19:03:31.479565 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1230/2494] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:03:31 2022] GET /compute/v2.1/servers/12b6a241-81e5-4cb3-b138-ca28f4018732 => generated 1333 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:03:31.489210 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-a79f40bd-ba22-4cf6-97fc-bdb182fca663 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:03:31.489925 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-a79f40bd-ba22-4cf6-97fc-bdb182fca663 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] [instance: 992f5ec5-d256-4870-b16d-fc8d9adbd3e7] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:03:31.504245 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-a79f40bd-ba22-4cf6-97fc-bdb182fca663 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:03:31.505161 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-a79f40bd-ba22-4cf6-97fc-bdb182fca663 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:03:31.505300 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-a79f40bd-ba22-4cf6-97fc-bdb182fca663 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:03:31.506061 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-a79f40bd-ba22-4cf6-97fc-bdb182fca663 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:03:31.506540 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-a79f40bd-ba22-4cf6-97fc-bdb182fca663 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:03:31.507061 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-a79f40bd-ba22-4cf6-97fc-bdb182fca663 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:03:31.716889 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-a79f40bd-ba22-4cf6-97fc-bdb182fca663 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb496b3faac4abbae73d389f2042e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e2520220d454764b8c139a58d78ac83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:03:31.732694 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-a79f40bd-ba22-4cf6-97fc-bdb182fca663 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] 10.222.0.13 "GET /compute/v2.1/servers/992f5ec5-d256-4870-b16d-fc8d9adbd3e7" status: 200 len: 1473 microversion: 2.1 time: 0.251768 Nov 01 19:03:31.744776 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1231/2495] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:03:31 2022] GET /compute/v2.1/servers/992f5ec5-d256-4870-b16d-fc8d9adbd3e7 => generated 1473 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:03:31.760182 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-c6b75a75-e5d2-4ce7-a1d9-52fab3856032 tempest-ServersTestBootFromVolume-877599095 tempest-ServersTestBootFromVolume-877599095-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:03:31.773190 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-c6b75a75-e5d2-4ce7-a1d9-52fab3856032 tempest-ServersTestBootFromVolume-877599095 tempest-ServersTestBootFromVolume-877599095-project] 10.222.0.13 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.026926 Nov 01 19:03:31.773757 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1232/2496] 10.222.0.13 () {58 vars in 1137 bytes} [Tue Nov 1 19:03:31 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:03:31.846570 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-a550036e-b550-4995-a166-658ce42b8dda tempest-LiveMigrationNegativeTest-1857188272 tempest-LiveMigrationNegativeTest-1857188272-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/d405fb5d-9aed-4363-a898-cbdfbef5b82a" status: 200 len: 1611 microversion: 2.1 time: 0.439544 Nov 01 19:03:31.863532 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1265/2497] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:03:31 2022] GET /compute/v2.1/servers/d405fb5d-9aed-4363-a898-cbdfbef5b82a => generated 1611 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:03:31.870097 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-4d373bc5-98b2-4b58-884b-7b79db102ac0 tempest-LiveMigrationNegativeTest-1857188272 tempest-LiveMigrationNegativeTest-1857188272-project-admin] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:03:31.873945 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-4d373bc5-98b2-4b58-884b-7b79db102ac0 tempest-LiveMigrationNegativeTest-1857188272 tempest-LiveMigrationNegativeTest-1857188272-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:03:31.874491 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-4d373bc5-98b2-4b58-884b-7b79db102ac0 tempest-LiveMigrationNegativeTest-1857188272 tempest-LiveMigrationNegativeTest-1857188272-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:03:31.874929 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-4d373bc5-98b2-4b58-884b-7b79db102ac0 tempest-LiveMigrationNegativeTest-1857188272 tempest-LiveMigrationNegativeTest-1857188272-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:03:31.875639 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-4d373bc5-98b2-4b58-884b-7b79db102ac0 tempest-LiveMigrationNegativeTest-1857188272 tempest-LiveMigrationNegativeTest-1857188272-project-admin] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:03:31.876090 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-4d373bc5-98b2-4b58-884b-7b79db102ac0 tempest-LiveMigrationNegativeTest-1857188272 tempest-LiveMigrationNegativeTest-1857188272-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:03:31.876510 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-4d373bc5-98b2-4b58-884b-7b79db102ac0 tempest-LiveMigrationNegativeTest-1857188272 tempest-LiveMigrationNegativeTest-1857188272-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:03:31.908455 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-4d373bc5-98b2-4b58-884b-7b79db102ac0 tempest-LiveMigrationNegativeTest-1857188272 tempest-LiveMigrationNegativeTest-1857188272-project-admin] 10.222.0.13 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.042344 Nov 01 19:03:31.910290 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1233/2498] 10.222.0.13 () {58 vars in 1176 bytes} [Tue Nov 1 19:03:31 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:03:31.922545 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-b6d26be2-1c74-4f3a-9fe1-db2ed52bcec1 tempest-LiveMigrationNegativeTest-1857188272 tempest-LiveMigrationNegativeTest-1857188272-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-863052-2", "block_migration": true, "disk_over_commit": false}} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:03:31.926018 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-b6d26be2-1c74-4f3a-9fe1-db2ed52bcec1 tempest-LiveMigrationNegativeTest-1857188272 tempest-LiveMigrationNegativeTest-1857188272-project-admin] [instance: d405fb5d-9aed-4363-a898-cbdfbef5b82a] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:03:31.933264 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-b6d26be2-1c74-4f3a-9fe1-db2ed52bcec1 tempest-LiveMigrationNegativeTest-1857188272 tempest-LiveMigrationNegativeTest-1857188272-project-admin] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:03:31.934167 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-b6d26be2-1c74-4f3a-9fe1-db2ed52bcec1 tempest-LiveMigrationNegativeTest-1857188272 tempest-LiveMigrationNegativeTest-1857188272-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:03:31.934812 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-b6d26be2-1c74-4f3a-9fe1-db2ed52bcec1 tempest-LiveMigrationNegativeTest-1857188272 tempest-LiveMigrationNegativeTest-1857188272-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:03:31.935731 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-b6d26be2-1c74-4f3a-9fe1-db2ed52bcec1 tempest-LiveMigrationNegativeTest-1857188272 tempest-LiveMigrationNegativeTest-1857188272-project-admin] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:03:31.938317 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-b6d26be2-1c74-4f3a-9fe1-db2ed52bcec1 tempest-LiveMigrationNegativeTest-1857188272 tempest-LiveMigrationNegativeTest-1857188272-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:03:31.939108 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-b6d26be2-1c74-4f3a-9fe1-db2ed52bcec1 tempest-LiveMigrationNegativeTest-1857188272 tempest-LiveMigrationNegativeTest-1857188272-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:03:31.974756 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.objects.instance [None req-b6d26be2-1c74-4f3a-9fe1-db2ed52bcec1 tempest-LiveMigrationNegativeTest-1857188272 tempest-LiveMigrationNegativeTest-1857188272-project-admin] Lazy-loading 'flavor' on Instance uuid d405fb5d-9aed-4363-a898-cbdfbef5b82a {{(pid=121403) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 01 19:03:31.987024 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.wsgi [None req-b6d26be2-1c74-4f3a-9fe1-db2ed52bcec1 tempest-LiveMigrationNegativeTest-1857188272 tempest-LiveMigrationNegativeTest-1857188272-project-admin] HTTP exception thrown: Cannot 'os-migrateLive' instance d405fb5d-9aed-4363-a898-cbdfbef5b82a while it is in vm_state suspended Nov 01 19:03:31.989591 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-b6d26be2-1c74-4f3a-9fe1-db2ed52bcec1 tempest-LiveMigrationNegativeTest-1857188272 tempest-LiveMigrationNegativeTest-1857188272-project-admin] Request method failure captured: Nov 01 19:03:31.989591 n-d-863052-2 devstack@n-api.service[121403]: request: POST /compute/v2.1/servers/d405fb5d-9aed-4363-a898-cbdfbef5b82a/action HTTP/1.1 Nov 01 19:03:31.989591 n-d-863052-2 devstack@n-api.service[121403]: Accept: application/json Nov 01 19:03:31.989591 n-d-863052-2 devstack@n-api.service[121403]: Accept-Encoding: identity Nov 01 19:03:31.989591 n-d-863052-2 devstack@n-api.service[121403]: Connection: close Nov 01 19:03:31.989591 n-d-863052-2 devstack@n-api.service[121403]: Content-Length: 97 Nov 01 19:03:31.989591 n-d-863052-2 devstack@n-api.service[121403]: Content-Type: application/json Nov 01 19:03:31.989591 n-d-863052-2 devstack@n-api.service[121403]: Host: 10.222.0.13 Nov 01 19:03:31.989591 n-d-863052-2 devstack@n-api.service[121403]: Openstack-System-Scope: None Nov 01 19:03:31.989591 n-d-863052-2 devstack@n-api.service[121403]: User-Agent: python-urllib3/1.26.12 Nov 01 19:03:31.989591 n-d-863052-2 devstack@n-api.service[121403]: X-Auth-Token: gAAAAABjYW1buKV8fCcyjwAEXBOl4IVt6Czsvyl0_veri8Ax8WRMMi1ZoqKCmDrRaeZ9jKURU6F8QH3y2GQ1fUIzyp_qVjK2NYQGXC1AqlqUEtp4V1THaP6z2-SU6Hw44YoPQBXkgLrXNXAqudpy-5C1yzCPH3g9-HadD_x4cidDO-ykxaWCI8M Nov 01 19:03:31.989591 n-d-863052-2 devstack@n-api.service[121403]: X-Domain-Id: None Nov 01 19:03:31.989591 n-d-863052-2 devstack@n-api.service[121403]: X-Domain-Name: None Nov 01 19:03:31.989591 n-d-863052-2 devstack@n-api.service[121403]: X-Identity-Status: Confirmed Nov 01 19:03:31.989591 n-d-863052-2 devstack@n-api.service[121403]: X-Is-Admin-Project: True Nov 01 19:03:31.989591 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Domain-Id: default Nov 01 19:03:31.989591 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Domain-Name: Default Nov 01 19:03:31.989591 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Id: 2dac8ac7538d4f2da805ed4f1d1ff0c9 Nov 01 19:03:31.989591 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Name: tempest-LiveMigrationNegativeTest-1857188272 Nov 01 19:03:31.989591 n-d-863052-2 devstack@n-api.service[121403]: X-Role: admin,member,reader Nov 01 19:03:31.989591 n-d-863052-2 devstack@n-api.service[121403]: X-Roles: admin,member,reader Nov 01 19:03:31.989591 n-d-863052-2 devstack@n-api.service[121403]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/2dac8ac7538d4f2da805ed4f1d1ff0c9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/2dac8ac7538d4f2da805ed4f1d1ff0c9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_2dac8ac7538d4f2da805ed4f1d1ff0c9", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/2dac8ac7538d4f2da805ed4f1d1ff0c9"}]}] Nov 01 19:03:31.989591 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant: tempest-LiveMigrationNegativeTest-1857188272 Nov 01 19:03:31.989591 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant-Id: 2dac8ac7538d4f2da805ed4f1d1ff0c9 Nov 01 19:03:31.989591 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-1857188272 Nov 01 19:03:31.989591 n-d-863052-2 devstack@n-api.service[121403]: X-User: tempest-LiveMigrationNegativeTest-1857188272-project-admin Nov 01 19:03:31.989591 n-d-863052-2 devstack@n-api.service[121403]: X-User-Domain-Id: default Nov 01 19:03:31.989591 n-d-863052-2 devstack@n-api.service[121403]: X-User-Domain-Name: Default Nov 01 19:03:31.989591 n-d-863052-2 devstack@n-api.service[121403]: X-User-Id: 59f947a0c76b47868755a6b2c2eba70f Nov 01 19:03:31.989591 n-d-863052-2 devstack@n-api.service[121403]: X-User-Name: tempest-LiveMigrationNegativeTest-1857188272-project-admin Nov 01 19:03:31.989591 n-d-863052-2 devstack@n-api.service[121403]: Nov 01 19:03:31.989591 n-d-863052-2 devstack@n-api.service[121403]: {"os-migrateLive": {"host": "n-h1-863052-2", "block_migration": true, "disk_over_commit": false}} Nov 01 19:03:31.989591 n-d-863052-2 devstack@n-api.service[121403]: method: > Nov 01 19:03:31.989591 n-d-863052-2 devstack@n-api.service[121403]: exception: Cannot 'os-migrateLive' instance d405fb5d-9aed-4363-a898-cbdfbef5b82a while it is in vm_state suspended Nov 01 19:03:31.989591 n-d-863052-2 devstack@n-api.service[121403]: action_args: {'id': 'd405fb5d-9aed-4363-a898-cbdfbef5b82a', 'body': {'os-migrateLive': {'host': 'n-h1-863052-2', 'block_migration': True, 'disk_over_commit': False}}} Nov 01 19:03:31.989591 n-d-863052-2 devstack@n-api.service[121403]: {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 01 19:03:31.989591 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:03:31.989591 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 123, in _migrate_live Nov 01 19:03:31.989591 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi self.compute_api.live_migrate(context, instance, block_migration, Nov 01 19:03:31.989591 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Nov 01 19:03:31.989591 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Nov 01 19:03:31.989591 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Nov 01 19:03:31.989591 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Nov 01 19:03:31.989591 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Nov 01 19:03:31.989591 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Nov 01 19:03:31.989591 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Nov 01 19:03:31.989591 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Nov 01 19:03:31.989591 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Nov 01 19:03:31.989591 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Nov 01 19:03:31.989591 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 259, in inner Nov 01 19:03:31.989591 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Nov 01 19:03:31.989591 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Nov 01 19:03:31.989591 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Nov 01 19:03:31.989591 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Nov 01 19:03:31.989591 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Nov 01 19:03:31.989591 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance d405fb5d-9aed-4363-a898-cbdfbef5b82a in vm_state suspended. Cannot live_migrate while the instance is in this state. Nov 01 19:03:31.989591 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:03:31.989591 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:03:31.989591 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:03:31.989591 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:03:31.989591 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:03:31.993039 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:03:31.993039 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 01 19:03:31.993039 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 01 19:03:31.993039 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 01 19:03:31.993039 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 01 19:03:31.993039 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 01 19:03:31.993039 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 01 19:03:31.993039 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 01 19:03:31.993039 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 01 19:03:31.993039 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 01 19:03:31.993039 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 01 19:03:31.993039 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Nov 01 19:03:31.993039 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 152, in _migrate_live Nov 01 19:03:31.993039 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Nov 01 19:03:31.993039 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Nov 01 19:03:31.993039 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Nov 01 19:03:31.993039 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'os-migrateLive' instance d405fb5d-9aed-4363-a898-cbdfbef5b82a while it is in vm_state suspended Nov 01 19:03:31.993039 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:03:31.993039 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:03:31.993039 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:03:31.993039 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:03:31.993039 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:03:31.993039 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:03:31.993039 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 01 19:03:31.993039 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 01 19:03:31.993039 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'os-migrateLive' instance d405fb5d-9aed-4363-a898-cbdfbef5b82a while it is in vm_state suspended Nov 01 19:03:31.993039 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:03:31.993039 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-b6d26be2-1c74-4f3a-9fe1-db2ed52bcec1 tempest-LiveMigrationNegativeTest-1857188272 tempest-LiveMigrationNegativeTest-1857188272-project-admin] Returning 409 to user: Cannot 'os-migrateLive' instance d405fb5d-9aed-4363-a898-cbdfbef5b82a while it is in vm_state suspended {{(pid=121403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 01 19:03:31.993039 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-b6d26be2-1c74-4f3a-9fe1-db2ed52bcec1 tempest-LiveMigrationNegativeTest-1857188272 tempest-LiveMigrationNegativeTest-1857188272-project-admin] 10.222.0.13 "POST /compute/v2.1/servers/d405fb5d-9aed-4363-a898-cbdfbef5b82a/action" status: 409 len: 155 microversion: 2.1 time: 0.072432 Nov 01 19:03:31.993039 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1266/2499] 10.222.0.13 () {60 vars in 1278 bytes} [Tue Nov 1 19:03:31 2022] POST /compute/v2.1/servers/d405fb5d-9aed-4363-a898-cbdfbef5b82a/action => generated 155 bytes in 74 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Nov 01 19:03:32.004443 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-160de2e5-ec2f-4e8d-ad24-22e7d426be4f tempest-LiveMigrationNegativeTest-570155948 tempest-LiveMigrationNegativeTest-570155948-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:03:32.004971 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-160de2e5-ec2f-4e8d-ad24-22e7d426be4f tempest-LiveMigrationNegativeTest-570155948 tempest-LiveMigrationNegativeTest-570155948-project] [instance: d405fb5d-9aed-4363-a898-cbdfbef5b82a] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:03:32.011639 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-160de2e5-ec2f-4e8d-ad24-22e7d426be4f tempest-LiveMigrationNegativeTest-570155948 tempest-LiveMigrationNegativeTest-570155948-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:03:32.012129 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-160de2e5-ec2f-4e8d-ad24-22e7d426be4f tempest-LiveMigrationNegativeTest-570155948 tempest-LiveMigrationNegativeTest-570155948-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:03:32.012563 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-160de2e5-ec2f-4e8d-ad24-22e7d426be4f tempest-LiveMigrationNegativeTest-570155948 tempest-LiveMigrationNegativeTest-570155948-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:03:32.013312 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-160de2e5-ec2f-4e8d-ad24-22e7d426be4f tempest-LiveMigrationNegativeTest-570155948 tempest-LiveMigrationNegativeTest-570155948-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:03:32.013895 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-160de2e5-ec2f-4e8d-ad24-22e7d426be4f tempest-LiveMigrationNegativeTest-570155948 tempest-LiveMigrationNegativeTest-570155948-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:03:32.014415 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-160de2e5-ec2f-4e8d-ad24-22e7d426be4f tempest-LiveMigrationNegativeTest-570155948 tempest-LiveMigrationNegativeTest-570155948-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:03:32.041740 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-160de2e5-ec2f-4e8d-ad24-22e7d426be4f tempest-LiveMigrationNegativeTest-570155948 tempest-LiveMigrationNegativeTest-570155948-project] [instance: d405fb5d-9aed-4363-a898-cbdfbef5b82a] Going to try to terminate instance {{(pid=121402) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 01 19:03:32.137014 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-160de2e5-ec2f-4e8d-ad24-22e7d426be4f tempest-LiveMigrationNegativeTest-570155948 tempest-LiveMigrationNegativeTest-570155948-project] 10.222.0.13 "DELETE /compute/v2.1/servers/d405fb5d-9aed-4363-a898-cbdfbef5b82a" status: 204 len: 0 microversion: 2.1 time: 0.136305 Nov 01 19:03:32.137735 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1234/2500] 10.222.0.13 () {58 vars in 1239 bytes} [Tue Nov 1 19:03:31 2022] DELETE /compute/v2.1/servers/d405fb5d-9aed-4363-a898-cbdfbef5b82a => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 01 19:03:32.147456 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-2be8f360-a5bf-4c31-90f3-72feb9d09132 tempest-LiveMigrationNegativeTest-570155948 tempest-LiveMigrationNegativeTest-570155948-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:03:32.148067 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-2be8f360-a5bf-4c31-90f3-72feb9d09132 tempest-LiveMigrationNegativeTest-570155948 tempest-LiveMigrationNegativeTest-570155948-project] [instance: d405fb5d-9aed-4363-a898-cbdfbef5b82a] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:03:32.155605 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-2be8f360-a5bf-4c31-90f3-72feb9d09132 tempest-LiveMigrationNegativeTest-570155948 tempest-LiveMigrationNegativeTest-570155948-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:03:32.156098 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-2be8f360-a5bf-4c31-90f3-72feb9d09132 tempest-LiveMigrationNegativeTest-570155948 tempest-LiveMigrationNegativeTest-570155948-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:03:32.156538 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-2be8f360-a5bf-4c31-90f3-72feb9d09132 tempest-LiveMigrationNegativeTest-570155948 tempest-LiveMigrationNegativeTest-570155948-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:03:32.157260 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-2be8f360-a5bf-4c31-90f3-72feb9d09132 tempest-LiveMigrationNegativeTest-570155948 tempest-LiveMigrationNegativeTest-570155948-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:03:32.157892 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-2be8f360-a5bf-4c31-90f3-72feb9d09132 tempest-LiveMigrationNegativeTest-570155948 tempest-LiveMigrationNegativeTest-570155948-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:03:32.158467 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-2be8f360-a5bf-4c31-90f3-72feb9d09132 tempest-LiveMigrationNegativeTest-570155948 tempest-LiveMigrationNegativeTest-570155948-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:03:32.258368 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-dfa4e542-3a5d-489a-bf5a-a22971d59688 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:03:32.269759 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-dfa4e542-3a5d-489a-bf5a-a22971d59688 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] [instance: ed4798be-a45e-46f5-8f7e-1165f6479bd1] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:03:32.275956 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-dfa4e542-3a5d-489a-bf5a-a22971d59688 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:03:32.276438 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-dfa4e542-3a5d-489a-bf5a-a22971d59688 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:03:32.276909 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-dfa4e542-3a5d-489a-bf5a-a22971d59688 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:03:32.277608 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-dfa4e542-3a5d-489a-bf5a-a22971d59688 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:03:32.278061 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-dfa4e542-3a5d-489a-bf5a-a22971d59688 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:03:32.278490 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-dfa4e542-3a5d-489a-bf5a-a22971d59688 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:03:32.314109 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-2be8f360-a5bf-4c31-90f3-72feb9d09132 tempest-LiveMigrationNegativeTest-570155948 tempest-LiveMigrationNegativeTest-570155948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c14605afbc5445d9763db185a1305d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faa1bc7c9d564b0ebc9ecf0a2994f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:03:32.322687 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-2be8f360-a5bf-4c31-90f3-72feb9d09132 tempest-LiveMigrationNegativeTest-570155948 tempest-LiveMigrationNegativeTest-570155948-project] 10.222.0.13 "GET /compute/v2.1/servers/d405fb5d-9aed-4363-a898-cbdfbef5b82a" status: 200 len: 1466 microversion: 2.1 time: 0.180088 Nov 01 19:03:32.323469 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1267/2501] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:03:32 2022] GET /compute/v2.1/servers/d405fb5d-9aed-4363-a898-cbdfbef5b82a => generated 1466 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:03:32.438332 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-dfa4e542-3a5d-489a-bf5a-a22971d59688 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a63d69c99a546f0af16329cff3ca717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a1bb191cff948e99c008b5e861ce4a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:03:32.442426 n-d-863052-2 devstack@n-api.service[121402]: DEBUG dbcounter [-] [121402] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=121402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 19:03:32.448150 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-dfa4e542-3a5d-489a-bf5a-a22971d59688 tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] 10.222.0.13 "GET /compute/v2.1/servers/ed4798be-a45e-46f5-8f7e-1165f6479bd1" status: 200 len: 1521 microversion: 2.1 time: 0.194124 Nov 01 19:03:32.449040 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1235/2502] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:03:32 2022] GET /compute/v2.1/servers/ed4798be-a45e-46f5-8f7e-1165f6479bd1 => generated 1521 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 19:03:32.506769 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-517e6585-f4db-4486-9ca5-9d893b6a26c9 tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:03:32.507499 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-517e6585-f4db-4486-9ca5-9d893b6a26c9 tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] [instance: 12b6a241-81e5-4cb3-b138-ca28f4018732] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:03:32.513888 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-517e6585-f4db-4486-9ca5-9d893b6a26c9 tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:03:32.514361 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-517e6585-f4db-4486-9ca5-9d893b6a26c9 tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:03:32.514790 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-517e6585-f4db-4486-9ca5-9d893b6a26c9 tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:03:32.515476 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-517e6585-f4db-4486-9ca5-9d893b6a26c9 tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:03:32.515922 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-517e6585-f4db-4486-9ca5-9d893b6a26c9 tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:03:32.516335 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-517e6585-f4db-4486-9ca5-9d893b6a26c9 tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:03:32.625144 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-8e8a0115-daf7-449b-bb53-55c5d14a09cf tempest-ServersAdminNegativeTestJSON-824756592 tempest-ServersAdminNegativeTestJSON-824756592-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-471518527", "imageRef": "2d4a0047-1b9e-445f-8af8-1b5c9d93e881", "flavorRef": "452"}} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:03:32.666993 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-517e6585-f4db-4486-9ca5-9d893b6a26c9 tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52acef7992d64d378fd8ac333887fd0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af51b8733e984c2ca87df2d8163dedf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:03:32.678242 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-517e6585-f4db-4486-9ca5-9d893b6a26c9 tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] 10.222.0.13 "GET /compute/v2.1/servers/12b6a241-81e5-4cb3-b138-ca28f4018732" status: 200 len: 1333 microversion: 2.1 time: 0.176157 Nov 01 19:03:32.678680 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1236/2503] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:03:32 2022] GET /compute/v2.1/servers/12b6a241-81e5-4cb3-b138-ca28f4018732 => generated 1333 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 19:03:32.683294 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-75b51940-ee4d-44ac-b909-a4faa327922e tempest-ServersTestBootFromVolume-877599095 tempest-ServersTestBootFromVolume-877599095-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:03:32.683780 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-75b51940-ee4d-44ac-b909-a4faa327922e tempest-ServersTestBootFromVolume-877599095 tempest-ServersTestBootFromVolume-877599095-project] [instance: 44cdf0d8-969b-4149-bb03-6bc390977019] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:03:32.689910 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-75b51940-ee4d-44ac-b909-a4faa327922e tempest-ServersTestBootFromVolume-877599095 tempest-ServersTestBootFromVolume-877599095-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:03:32.690395 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-75b51940-ee4d-44ac-b909-a4faa327922e tempest-ServersTestBootFromVolume-877599095 tempest-ServersTestBootFromVolume-877599095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:03:32.691350 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-75b51940-ee4d-44ac-b909-a4faa327922e tempest-ServersTestBootFromVolume-877599095 tempest-ServersTestBootFromVolume-877599095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:03:32.692093 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-75b51940-ee4d-44ac-b909-a4faa327922e tempest-ServersTestBootFromVolume-877599095 tempest-ServersTestBootFromVolume-877599095-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:03:32.692545 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-75b51940-ee4d-44ac-b909-a4faa327922e tempest-ServersTestBootFromVolume-877599095 tempest-ServersTestBootFromVolume-877599095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:03:32.693059 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-75b51940-ee4d-44ac-b909-a4faa327922e tempest-ServersTestBootFromVolume-877599095 tempest-ServersTestBootFromVolume-877599095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:03:32.695476 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.network.neutron [None req-8e8a0115-daf7-449b-bb53-55c5d14a09cf tempest-ServersAdminNegativeTestJSON-824756592 tempest-ServersAdminNegativeTestJSON-824756592-project] validate_networks() for None {{(pid=121403) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 01 19:03:32.719045 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-75b51940-ee4d-44ac-b909-a4faa327922e tempest-ServersTestBootFromVolume-877599095 tempest-ServersTestBootFromVolume-877599095-project] [instance: 44cdf0d8-969b-4149-bb03-6bc390977019] Going to try to terminate instance {{(pid=121402) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 01 19:03:32.795156 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-75b51940-ee4d-44ac-b909-a4faa327922e tempest-ServersTestBootFromVolume-877599095 tempest-ServersTestBootFromVolume-877599095-project] 10.222.0.13 "DELETE /compute/v2.1/servers/44cdf0d8-969b-4149-bb03-6bc390977019" status: 204 len: 0 microversion: 2.1 time: 0.115103 Nov 01 19:03:32.795859 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1237/2504] 10.222.0.13 () {58 vars in 1239 bytes} [Tue Nov 1 19:03:32 2022] DELETE /compute/v2.1/servers/44cdf0d8-969b-4149-bb03-6bc390977019 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 01 19:03:32.802083 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-261f7387-7b46-4be3-8622-09c031b257d7 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:03:32.802821 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-261f7387-7b46-4be3-8622-09c031b257d7 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] [instance: 992f5ec5-d256-4870-b16d-fc8d9adbd3e7] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:03:32.805729 n-d-863052-2 devstack@n-api.service[121402]: DEBUG dbcounter [-] [121402] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=3,nova_api:UPDATE=3 {{(pid=121402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 19:03:32.809862 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-261f7387-7b46-4be3-8622-09c031b257d7 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:03:32.810353 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-261f7387-7b46-4be3-8622-09c031b257d7 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:03:32.810858 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-261f7387-7b46-4be3-8622-09c031b257d7 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:03:32.811817 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-261f7387-7b46-4be3-8622-09c031b257d7 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:03:32.812361 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-261f7387-7b46-4be3-8622-09c031b257d7 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:03:32.812827 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-261f7387-7b46-4be3-8622-09c031b257d7 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:03:32.956089 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-261f7387-7b46-4be3-8622-09c031b257d7 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb496b3faac4abbae73d389f2042e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e2520220d454764b8c139a58d78ac83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:03:32.964350 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-261f7387-7b46-4be3-8622-09c031b257d7 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] 10.222.0.13 "GET /compute/v2.1/servers/992f5ec5-d256-4870-b16d-fc8d9adbd3e7" status: 200 len: 1473 microversion: 2.1 time: 0.167361 Nov 01 19:03:32.965190 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1238/2505] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:03:32 2022] GET /compute/v2.1/servers/992f5ec5-d256-4870-b16d-fc8d9adbd3e7 => generated 1473 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:03:32.969423 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-5d152660-5890-4564-96de-f87fa6575598 tempest-ServersTestBootFromVolume-877599095 tempest-ServersTestBootFromVolume-877599095-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:03:32.970016 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-5d152660-5890-4564-96de-f87fa6575598 tempest-ServersTestBootFromVolume-877599095 tempest-ServersTestBootFromVolume-877599095-project] [instance: 44cdf0d8-969b-4149-bb03-6bc390977019] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:03:32.976167 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-5d152660-5890-4564-96de-f87fa6575598 tempest-ServersTestBootFromVolume-877599095 tempest-ServersTestBootFromVolume-877599095-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:03:32.976685 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-5d152660-5890-4564-96de-f87fa6575598 tempest-ServersTestBootFromVolume-877599095 tempest-ServersTestBootFromVolume-877599095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:03:32.977117 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-5d152660-5890-4564-96de-f87fa6575598 tempest-ServersTestBootFromVolume-877599095 tempest-ServersTestBootFromVolume-877599095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:03:32.978194 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-5d152660-5890-4564-96de-f87fa6575598 tempest-ServersTestBootFromVolume-877599095 tempest-ServersTestBootFromVolume-877599095-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:03:32.978306 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-5d152660-5890-4564-96de-f87fa6575598 tempest-ServersTestBootFromVolume-877599095 tempest-ServersTestBootFromVolume-877599095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:03:32.978647 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-5d152660-5890-4564-96de-f87fa6575598 tempest-ServersTestBootFromVolume-877599095 tempest-ServersTestBootFromVolume-877599095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:03:32.983676 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.virt.hardware [None req-8e8a0115-daf7-449b-bb53-55c5d14a09cf tempest-ServersAdminNegativeTestJSON-824756592 tempest-ServersAdminNegativeTestJSON-824756592-project] Flavor limits 0:0:0 {{(pid=121403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 01 19:03:32.984680 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.virt.hardware [None req-8e8a0115-daf7-449b-bb53-55c5d14a09cf tempest-ServersAdminNegativeTestJSON-824756592 tempest-ServersAdminNegativeTestJSON-824756592-project] Image limits 0:0:0 {{(pid=121403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 01 19:03:32.985537 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.virt.hardware [None req-8e8a0115-daf7-449b-bb53-55c5d14a09cf tempest-ServersAdminNegativeTestJSON-824756592 tempest-ServersAdminNegativeTestJSON-824756592-project] Flavor pref 0:0:0 {{(pid=121403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 01 19:03:32.986027 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.virt.hardware [None req-8e8a0115-daf7-449b-bb53-55c5d14a09cf tempest-ServersAdminNegativeTestJSON-824756592 tempest-ServersAdminNegativeTestJSON-824756592-project] Image pref 0:0:0 {{(pid=121403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 01 19:03:32.986580 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.virt.hardware [None req-8e8a0115-daf7-449b-bb53-55c5d14a09cf tempest-ServersAdminNegativeTestJSON-824756592 tempest-ServersAdminNegativeTestJSON-824756592-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 01 19:03:33.001043 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-8e8a0115-daf7-449b-bb53-55c5d14a09cf tempest-ServersAdminNegativeTestJSON-824756592 tempest-ServersAdminNegativeTestJSON-824756592-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:03:33.001935 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-8e8a0115-daf7-449b-bb53-55c5d14a09cf tempest-ServersAdminNegativeTestJSON-824756592 tempest-ServersAdminNegativeTestJSON-824756592-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:03:33.002557 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-8e8a0115-daf7-449b-bb53-55c5d14a09cf tempest-ServersAdminNegativeTestJSON-824756592 tempest-ServersAdminNegativeTestJSON-824756592-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:03:33.003377 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-8e8a0115-daf7-449b-bb53-55c5d14a09cf tempest-ServersAdminNegativeTestJSON-824756592 tempest-ServersAdminNegativeTestJSON-824756592-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:03:33.003852 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-8e8a0115-daf7-449b-bb53-55c5d14a09cf tempest-ServersAdminNegativeTestJSON-824756592 tempest-ServersAdminNegativeTestJSON-824756592-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:03:33.004276 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-8e8a0115-daf7-449b-bb53-55c5d14a09cf tempest-ServersAdminNegativeTestJSON-824756592 tempest-ServersAdminNegativeTestJSON-824756592-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:03:33.024166 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.quota [None req-8e8a0115-daf7-449b-bb53-55c5d14a09cf tempest-ServersAdminNegativeTestJSON-824756592 tempest-ServersAdminNegativeTestJSON-824756592-project] Getting quotas for project 232745bfe2f3445987fedb91098c84eb. Resources: {'cores', 'ram', 'instances'} {{(pid=121403) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 01 19:03:33.030244 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.quota [None req-8e8a0115-daf7-449b-bb53-55c5d14a09cf tempest-ServersAdminNegativeTestJSON-824756592 tempest-ServersAdminNegativeTestJSON-824756592-project] Getting quotas for user 0708fb2fc1df4aa9a9697cbc94acf921 and project 232745bfe2f3445987fedb91098c84eb. Resources: {'cores', 'ram', 'instances'} {{(pid=121403) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 01 19:03:33.045304 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-8e8a0115-daf7-449b-bb53-55c5d14a09cf tempest-ServersAdminNegativeTestJSON-824756592 tempest-ServersAdminNegativeTestJSON-824756592-project] Going to run 1 instances... {{(pid=121403) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 01 19:03:33.047634 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-8e8a0115-daf7-449b-bb53-55c5d14a09cf tempest-ServersAdminNegativeTestJSON-824756592 tempest-ServersAdminNegativeTestJSON-824756592-project] [instance: 51f5bec0-bd00-4ef2-9424-0dad025c8e29] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2d4a0047-1b9e-445f-8af8-1b5c9d93e881',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121403) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 01 19:03:33.107981 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-8e8a0115-daf7-449b-bb53-55c5d14a09cf tempest-ServersAdminNegativeTestJSON-824756592 tempest-ServersAdminNegativeTestJSON-824756592-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.768601 Nov 01 19:03:33.115524 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1268/2506] 10.222.0.13 () {60 vars in 1147 bytes} [Tue Nov 1 19:03:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 777 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 01 19:03:33.121904 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-07c2fff5-cccd-4bfe-8c12-1421d1742742 tempest-ServersAdminNegativeTestJSON-824756592 tempest-ServersAdminNegativeTestJSON-824756592-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:03:33.122789 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-07c2fff5-cccd-4bfe-8c12-1421d1742742 tempest-ServersAdminNegativeTestJSON-824756592 tempest-ServersAdminNegativeTestJSON-824756592-project] [instance: 51f5bec0-bd00-4ef2-9424-0dad025c8e29] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:03:33.209899 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-5d152660-5890-4564-96de-f87fa6575598 tempest-ServersTestBootFromVolume-877599095 tempest-ServersTestBootFromVolume-877599095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed2352ce53fc4045adde8cd81b78b3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651046528c204df299ca3d14c44b4a7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:03:33.219976 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-5d152660-5890-4564-96de-f87fa6575598 tempest-ServersTestBootFromVolume-877599095 tempest-ServersTestBootFromVolume-877599095-project] 10.222.0.13 "GET /compute/v2.1/servers/44cdf0d8-969b-4149-bb03-6bc390977019" status: 200 len: 1605 microversion: 2.1 time: 0.253518 Nov 01 19:03:33.220602 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1239/2507] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:03:32 2022] GET /compute/v2.1/servers/44cdf0d8-969b-4149-bb03-6bc390977019 => generated 1605 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:03:33.233894 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-07c2fff5-cccd-4bfe-8c12-1421d1742742 tempest-ServersAdminNegativeTestJSON-824756592 tempest-ServersAdminNegativeTestJSON-824756592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0708fb2fc1df4aa9a9697cbc94acf921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '232745bfe2f3445987fedb91098c84eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:03:33.233894 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-07c2fff5-cccd-4bfe-8c12-1421d1742742 tempest-ServersAdminNegativeTestJSON-824756592 tempest-ServersAdminNegativeTestJSON-824756592-project] 10.222.0.13 "GET /compute/v2.1/servers/51f5bec0-bd00-4ef2-9424-0dad025c8e29" status: 200 len: 1221 microversion: 2.1 time: 0.116941 Nov 01 19:03:33.234510 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1269/2508] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:03:33 2022] GET /compute/v2.1/servers/51f5bec0-bd00-4ef2-9424-0dad025c8e29 => generated 1221 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:03:33.354870 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-afbb0248-0a36-4961-8e59-0b0371bb6f4f tempest-LiveMigrationNegativeTest-570155948 tempest-LiveMigrationNegativeTest-570155948-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:03:33.355493 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-afbb0248-0a36-4961-8e59-0b0371bb6f4f tempest-LiveMigrationNegativeTest-570155948 tempest-LiveMigrationNegativeTest-570155948-project] [instance: d405fb5d-9aed-4363-a898-cbdfbef5b82a] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:03:33.361526 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-afbb0248-0a36-4961-8e59-0b0371bb6f4f tempest-LiveMigrationNegativeTest-570155948 tempest-LiveMigrationNegativeTest-570155948-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:03:33.362192 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-afbb0248-0a36-4961-8e59-0b0371bb6f4f tempest-LiveMigrationNegativeTest-570155948 tempest-LiveMigrationNegativeTest-570155948-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:03:33.362763 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-afbb0248-0a36-4961-8e59-0b0371bb6f4f tempest-LiveMigrationNegativeTest-570155948 tempest-LiveMigrationNegativeTest-570155948-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:03:33.363710 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-afbb0248-0a36-4961-8e59-0b0371bb6f4f tempest-LiveMigrationNegativeTest-570155948 tempest-LiveMigrationNegativeTest-570155948-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:03:33.364499 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-afbb0248-0a36-4961-8e59-0b0371bb6f4f tempest-LiveMigrationNegativeTest-570155948 tempest-LiveMigrationNegativeTest-570155948-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:03:33.365136 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-afbb0248-0a36-4961-8e59-0b0371bb6f4f tempest-LiveMigrationNegativeTest-570155948 tempest-LiveMigrationNegativeTest-570155948-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:03:33.471519 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-574dfb7f-cadd-40e0-9b98-27543b79cabd tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:03:33.472264 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-574dfb7f-cadd-40e0-9b98-27543b79cabd tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] [instance: ed4798be-a45e-46f5-8f7e-1165f6479bd1] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:03:33.478279 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-574dfb7f-cadd-40e0-9b98-27543b79cabd tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:03:33.478834 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-574dfb7f-cadd-40e0-9b98-27543b79cabd tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:03:33.479364 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-574dfb7f-cadd-40e0-9b98-27543b79cabd tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:03:33.480140 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-574dfb7f-cadd-40e0-9b98-27543b79cabd tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:03:33.480706 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-574dfb7f-cadd-40e0-9b98-27543b79cabd tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:03:33.481291 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-574dfb7f-cadd-40e0-9b98-27543b79cabd tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:03:33.620839 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-afbb0248-0a36-4961-8e59-0b0371bb6f4f tempest-LiveMigrationNegativeTest-570155948 tempest-LiveMigrationNegativeTest-570155948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c14605afbc5445d9763db185a1305d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faa1bc7c9d564b0ebc9ecf0a2994f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:03:33.636848 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-574dfb7f-cadd-40e0-9b98-27543b79cabd tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a63d69c99a546f0af16329cff3ca717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a1bb191cff948e99c008b5e861ce4a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:03:33.646227 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-afbb0248-0a36-4961-8e59-0b0371bb6f4f tempest-LiveMigrationNegativeTest-570155948 tempest-LiveMigrationNegativeTest-570155948-project] 10.222.0.13 "GET /compute/v2.1/servers/d405fb5d-9aed-4363-a898-cbdfbef5b82a" status: 200 len: 1466 microversion: 2.1 time: 0.296962 Nov 01 19:03:33.647687 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-574dfb7f-cadd-40e0-9b98-27543b79cabd tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] 10.222.0.13 "GET /compute/v2.1/servers/ed4798be-a45e-46f5-8f7e-1165f6479bd1" status: 200 len: 1521 microversion: 2.1 time: 0.179902 Nov 01 19:03:33.648917 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1270/2509] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:03:33 2022] GET /compute/v2.1/servers/ed4798be-a45e-46f5-8f7e-1165f6479bd1 => generated 1521 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 19:03:33.662442 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1240/2510] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:03:33 2022] GET /compute/v2.1/servers/d405fb5d-9aed-4363-a898-cbdfbef5b82a => generated 1466 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:03:33.702501 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-1248b9ef-6664-40b2-b2aa-4af1f76b34ff tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:03:33.703037 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-1248b9ef-6664-40b2-b2aa-4af1f76b34ff tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] [instance: 12b6a241-81e5-4cb3-b138-ca28f4018732] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:03:33.712411 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-1248b9ef-6664-40b2-b2aa-4af1f76b34ff tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:03:33.712949 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-1248b9ef-6664-40b2-b2aa-4af1f76b34ff tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:03:33.713393 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-1248b9ef-6664-40b2-b2aa-4af1f76b34ff tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:03:33.714290 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-1248b9ef-6664-40b2-b2aa-4af1f76b34ff tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:03:33.715263 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-1248b9ef-6664-40b2-b2aa-4af1f76b34ff tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:03:33.716054 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-1248b9ef-6664-40b2-b2aa-4af1f76b34ff tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:03:33.989170 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-7046d557-5ad1-429d-8cee-aecdb2965909 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:03:33.990213 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-7046d557-5ad1-429d-8cee-aecdb2965909 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] [instance: 992f5ec5-d256-4870-b16d-fc8d9adbd3e7] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:03:33.997728 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-7046d557-5ad1-429d-8cee-aecdb2965909 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:03:33.998537 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-7046d557-5ad1-429d-8cee-aecdb2965909 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:03:33.999187 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-7046d557-5ad1-429d-8cee-aecdb2965909 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:03:34.000939 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-7046d557-5ad1-429d-8cee-aecdb2965909 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:03:34.001607 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-7046d557-5ad1-429d-8cee-aecdb2965909 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:03:34.002357 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-7046d557-5ad1-429d-8cee-aecdb2965909 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:03:34.006581 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-1248b9ef-6664-40b2-b2aa-4af1f76b34ff tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52acef7992d64d378fd8ac333887fd0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af51b8733e984c2ca87df2d8163dedf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:03:34.018467 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-1248b9ef-6664-40b2-b2aa-4af1f76b34ff tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] 10.222.0.13 "GET /compute/v2.1/servers/12b6a241-81e5-4cb3-b138-ca28f4018732" status: 200 len: 1333 microversion: 2.1 time: 0.319848 Nov 01 19:03:34.035545 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1271/2511] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:03:33 2022] GET /compute/v2.1/servers/12b6a241-81e5-4cb3-b138-ca28f4018732 => generated 1333 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:03:34.245209 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-5dbb9a9b-55e9-42aa-ad34-37d13cd053b3 tempest-ServersTestBootFromVolume-877599095 tempest-ServersTestBootFromVolume-877599095-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:03:34.246472 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-5dbb9a9b-55e9-42aa-ad34-37d13cd053b3 tempest-ServersTestBootFromVolume-877599095 tempest-ServersTestBootFromVolume-877599095-project] [instance: 44cdf0d8-969b-4149-bb03-6bc390977019] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:03:34.252123 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-5dbb9a9b-55e9-42aa-ad34-37d13cd053b3 tempest-ServersTestBootFromVolume-877599095 tempest-ServersTestBootFromVolume-877599095-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:03:34.253029 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-5dbb9a9b-55e9-42aa-ad34-37d13cd053b3 tempest-ServersTestBootFromVolume-877599095 tempest-ServersTestBootFromVolume-877599095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:03:34.254196 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-5dbb9a9b-55e9-42aa-ad34-37d13cd053b3 tempest-ServersTestBootFromVolume-877599095 tempest-ServersTestBootFromVolume-877599095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:03:34.255206 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-5dbb9a9b-55e9-42aa-ad34-37d13cd053b3 tempest-ServersTestBootFromVolume-877599095 tempest-ServersTestBootFromVolume-877599095-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:03:34.255876 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-5dbb9a9b-55e9-42aa-ad34-37d13cd053b3 tempest-ServersTestBootFromVolume-877599095 tempest-ServersTestBootFromVolume-877599095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:03:34.256505 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-5dbb9a9b-55e9-42aa-ad34-37d13cd053b3 tempest-ServersTestBootFromVolume-877599095 tempest-ServersTestBootFromVolume-877599095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:03:34.496684 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-5dbb9a9b-55e9-42aa-ad34-37d13cd053b3 tempest-ServersTestBootFromVolume-877599095 tempest-ServersTestBootFromVolume-877599095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed2352ce53fc4045adde8cd81b78b3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651046528c204df299ca3d14c44b4a7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:03:34.517364 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-5dbb9a9b-55e9-42aa-ad34-37d13cd053b3 tempest-ServersTestBootFromVolume-877599095 tempest-ServersTestBootFromVolume-877599095-project] 10.222.0.13 "GET /compute/v2.1/servers/44cdf0d8-969b-4149-bb03-6bc390977019" status: 200 len: 1605 microversion: 2.1 time: 0.276013 Nov 01 19:03:34.518642 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1272/2512] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:03:34 2022] GET /compute/v2.1/servers/44cdf0d8-969b-4149-bb03-6bc390977019 => generated 1605 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 19:03:34.523366 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-ec30ef0b-1e64-4568-9ad1-c8477d5bf4d7 tempest-ServersAdminNegativeTestJSON-824756592 tempest-ServersAdminNegativeTestJSON-824756592-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:03:34.523979 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-ec30ef0b-1e64-4568-9ad1-c8477d5bf4d7 tempest-ServersAdminNegativeTestJSON-824756592 tempest-ServersAdminNegativeTestJSON-824756592-project] [instance: 51f5bec0-bd00-4ef2-9424-0dad025c8e29] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:03:34.538889 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-ec30ef0b-1e64-4568-9ad1-c8477d5bf4d7 tempest-ServersAdminNegativeTestJSON-824756592 tempest-ServersAdminNegativeTestJSON-824756592-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:03:34.539393 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-ec30ef0b-1e64-4568-9ad1-c8477d5bf4d7 tempest-ServersAdminNegativeTestJSON-824756592 tempest-ServersAdminNegativeTestJSON-824756592-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:03:34.539834 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-ec30ef0b-1e64-4568-9ad1-c8477d5bf4d7 tempest-ServersAdminNegativeTestJSON-824756592 tempest-ServersAdminNegativeTestJSON-824756592-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:03:34.540547 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-ec30ef0b-1e64-4568-9ad1-c8477d5bf4d7 tempest-ServersAdminNegativeTestJSON-824756592 tempest-ServersAdminNegativeTestJSON-824756592-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:03:34.546162 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-ec30ef0b-1e64-4568-9ad1-c8477d5bf4d7 tempest-ServersAdminNegativeTestJSON-824756592 tempest-ServersAdminNegativeTestJSON-824756592-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:03:34.546617 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-ec30ef0b-1e64-4568-9ad1-c8477d5bf4d7 tempest-ServersAdminNegativeTestJSON-824756592 tempest-ServersAdminNegativeTestJSON-824756592-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:03:34.671880 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-7046d557-5ad1-429d-8cee-aecdb2965909 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb496b3faac4abbae73d389f2042e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e2520220d454764b8c139a58d78ac83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:03:34.687140 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-7046d557-5ad1-429d-8cee-aecdb2965909 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] 10.222.0.13 "GET /compute/v2.1/servers/992f5ec5-d256-4870-b16d-fc8d9adbd3e7" status: 200 len: 1473 microversion: 2.1 time: 0.702782 Nov 01 19:03:34.687754 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1241/2513] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:03:33 2022] GET /compute/v2.1/servers/992f5ec5-d256-4870-b16d-fc8d9adbd3e7 => generated 1473 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 19:03:34.699659 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [req-380cdb02-37d8-4305-8f91-33a01258d54e req-a67875d6-0fe5-468f-9226-ff814a2c87f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d405fb5d-9aed-4363-a898-cbdfbef5b82a", "name": "network-vif-deleted", "tag": "3ec6380d-47fe-4dd4-83d7-85d66e3dca96"}]} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:03:34.708442 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-ec30ef0b-1e64-4568-9ad1-c8477d5bf4d7 tempest-ServersAdminNegativeTestJSON-824756592 tempest-ServersAdminNegativeTestJSON-824756592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0708fb2fc1df4aa9a9697cbc94acf921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '232745bfe2f3445987fedb91098c84eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:03:34.731035 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-ec30ef0b-1e64-4568-9ad1-c8477d5bf4d7 tempest-ServersAdminNegativeTestJSON-824756592 tempest-ServersAdminNegativeTestJSON-824756592-project] 10.222.0.13 "GET /compute/v2.1/servers/51f5bec0-bd00-4ef2-9424-0dad025c8e29" status: 200 len: 1281 microversion: 2.1 time: 0.207394 Nov 01 19:03:34.733873 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1273/2514] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:03:34 2022] GET /compute/v2.1/servers/51f5bec0-bd00-4ef2-9424-0dad025c8e29 => generated 1281 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:03:34.754487 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-cd9d1c4a-0089-48d7-aab2-b7ea432452ad tempest-LiveMigrationNegativeTest-570155948 tempest-LiveMigrationNegativeTest-570155948-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:03:34.755104 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-380cdb02-37d8-4305-8f91-33a01258d54e req-a67875d6-0fe5-468f-9226-ff814a2c87f5 service nova] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:03:34.755594 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-380cdb02-37d8-4305-8f91-33a01258d54e req-a67875d6-0fe5-468f-9226-ff814a2c87f5 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:03:34.756016 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-cd9d1c4a-0089-48d7-aab2-b7ea432452ad tempest-LiveMigrationNegativeTest-570155948 tempest-LiveMigrationNegativeTest-570155948-project] [instance: d405fb5d-9aed-4363-a898-cbdfbef5b82a] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:03:34.758099 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-380cdb02-37d8-4305-8f91-33a01258d54e req-a67875d6-0fe5-468f-9226-ff814a2c87f5 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:03:34.762559 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-cd9d1c4a-0089-48d7-aab2-b7ea432452ad tempest-LiveMigrationNegativeTest-570155948 tempest-LiveMigrationNegativeTest-570155948-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:03:34.763827 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-cd9d1c4a-0089-48d7-aab2-b7ea432452ad tempest-LiveMigrationNegativeTest-570155948 tempest-LiveMigrationNegativeTest-570155948-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:03:34.764443 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-cd9d1c4a-0089-48d7-aab2-b7ea432452ad tempest-LiveMigrationNegativeTest-570155948 tempest-LiveMigrationNegativeTest-570155948-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:03:34.765315 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-cd9d1c4a-0089-48d7-aab2-b7ea432452ad tempest-LiveMigrationNegativeTest-570155948 tempest-LiveMigrationNegativeTest-570155948-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:03:34.766439 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-cd9d1c4a-0089-48d7-aab2-b7ea432452ad tempest-LiveMigrationNegativeTest-570155948 tempest-LiveMigrationNegativeTest-570155948-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:03:34.767077 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-cd9d1c4a-0089-48d7-aab2-b7ea432452ad tempest-LiveMigrationNegativeTest-570155948 tempest-LiveMigrationNegativeTest-570155948-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:03:34.785200 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.compute.server_external_events [req-380cdb02-37d8-4305-8f91-33a01258d54e req-a67875d6-0fe5-468f-9226-ff814a2c87f5 service nova] Creating event network-vif-deleted:3ec6380d-47fe-4dd4-83d7-85d66e3dca96 for instance d405fb5d-9aed-4363-a898-cbdfbef5b82a on n-h2-863052-2 Nov 01 19:03:34.795808 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [req-380cdb02-37d8-4305-8f91-33a01258d54e req-a67875d6-0fe5-468f-9226-ff814a2c87f5 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103619 Nov 01 19:03:34.797010 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1242/2515] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Nov 1 19:03:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:03:34.803748 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-f23a80c8-fb23-49c4-a78a-e742f7a7691d tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:03:34.804733 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-f23a80c8-fb23-49c4-a78a-e742f7a7691d tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] [instance: ed4798be-a45e-46f5-8f7e-1165f6479bd1] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:03:34.810801 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-cd9d1c4a-0089-48d7-aab2-b7ea432452ad tempest-LiveMigrationNegativeTest-570155948 tempest-LiveMigrationNegativeTest-570155948-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:03:34.811548 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f23a80c8-fb23-49c4-a78a-e742f7a7691d tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:03:34.811696 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-cd9d1c4a-0089-48d7-aab2-b7ea432452ad tempest-LiveMigrationNegativeTest-570155948 tempest-LiveMigrationNegativeTest-570155948-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:03:34.812563 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f23a80c8-fb23-49c4-a78a-e742f7a7691d tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:03:34.813940 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f23a80c8-fb23-49c4-a78a-e742f7a7691d tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:03:34.814791 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f23a80c8-fb23-49c4-a78a-e742f7a7691d tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:03:34.815408 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f23a80c8-fb23-49c4-a78a-e742f7a7691d tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:03:34.816036 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f23a80c8-fb23-49c4-a78a-e742f7a7691d tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:03:34.825020 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-cd9d1c4a-0089-48d7-aab2-b7ea432452ad tempest-LiveMigrationNegativeTest-570155948 tempest-LiveMigrationNegativeTest-570155948-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:03:34.825579 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.objects.instance [None req-cd9d1c4a-0089-48d7-aab2-b7ea432452ad tempest-LiveMigrationNegativeTest-570155948 tempest-LiveMigrationNegativeTest-570155948-project] Lazy-loading 'fault' on Instance uuid d405fb5d-9aed-4363-a898-cbdfbef5b82a {{(pid=121403) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 01 19:03:34.937055 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-cd9d1c4a-0089-48d7-aab2-b7ea432452ad tempest-LiveMigrationNegativeTest-570155948 tempest-LiveMigrationNegativeTest-570155948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c14605afbc5445d9763db185a1305d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faa1bc7c9d564b0ebc9ecf0a2994f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:03:34.948348 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-cd9d1c4a-0089-48d7-aab2-b7ea432452ad tempest-LiveMigrationNegativeTest-570155948 tempest-LiveMigrationNegativeTest-570155948-project] 10.222.0.13 "GET /compute/v2.1/servers/d405fb5d-9aed-4363-a898-cbdfbef5b82a" status: 200 len: 1309 microversion: 2.1 time: 0.211417 Nov 01 19:03:34.949029 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1274/2516] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:03:34 2022] GET /compute/v2.1/servers/d405fb5d-9aed-4363-a898-cbdfbef5b82a => generated 1309 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:03:35.043036 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-9c1130d4-118f-4982-939e-e5f72370f5f3 tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:03:35.043723 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-9c1130d4-118f-4982-939e-e5f72370f5f3 tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] [instance: 12b6a241-81e5-4cb3-b138-ca28f4018732] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:03:35.052290 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-9c1130d4-118f-4982-939e-e5f72370f5f3 tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:03:35.058166 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-9c1130d4-118f-4982-939e-e5f72370f5f3 tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:03:35.058749 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-9c1130d4-118f-4982-939e-e5f72370f5f3 tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:03:35.059564 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-9c1130d4-118f-4982-939e-e5f72370f5f3 tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:03:35.060792 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-9c1130d4-118f-4982-939e-e5f72370f5f3 tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:03:35.061648 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-9c1130d4-118f-4982-939e-e5f72370f5f3 tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:03:35.361821 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-f23a80c8-fb23-49c4-a78a-e742f7a7691d tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a63d69c99a546f0af16329cff3ca717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a1bb191cff948e99c008b5e861ce4a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:03:35.372038 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-f23a80c8-fb23-49c4-a78a-e742f7a7691d tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] 10.222.0.13 "GET /compute/v2.1/servers/ed4798be-a45e-46f5-8f7e-1165f6479bd1" status: 200 len: 1521 microversion: 2.1 time: 0.573572 Nov 01 19:03:35.372942 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1243/2517] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:03:34 2022] GET /compute/v2.1/servers/ed4798be-a45e-46f5-8f7e-1165f6479bd1 => generated 1521 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:03:35.471887 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-9c1130d4-118f-4982-939e-e5f72370f5f3 tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52acef7992d64d378fd8ac333887fd0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af51b8733e984c2ca87df2d8163dedf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:03:35.513151 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-9c1130d4-118f-4982-939e-e5f72370f5f3 tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] 10.222.0.13 "GET /compute/v2.1/servers/12b6a241-81e5-4cb3-b138-ca28f4018732" status: 200 len: 1333 microversion: 2.1 time: 0.474779 Nov 01 19:03:35.520730 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1275/2518] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:03:35 2022] GET /compute/v2.1/servers/12b6a241-81e5-4cb3-b138-ca28f4018732 => generated 1333 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 19:03:35.540524 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-86627a56-7673-4189-b78e-441c6a6f12fa tempest-ServersTestBootFromVolume-877599095 tempest-ServersTestBootFromVolume-877599095-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:03:35.541516 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-86627a56-7673-4189-b78e-441c6a6f12fa tempest-ServersTestBootFromVolume-877599095 tempest-ServersTestBootFromVolume-877599095-project] [instance: 44cdf0d8-969b-4149-bb03-6bc390977019] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:03:35.558517 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-86627a56-7673-4189-b78e-441c6a6f12fa tempest-ServersTestBootFromVolume-877599095 tempest-ServersTestBootFromVolume-877599095-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:03:35.559711 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-86627a56-7673-4189-b78e-441c6a6f12fa tempest-ServersTestBootFromVolume-877599095 tempest-ServersTestBootFromVolume-877599095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:03:35.560307 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-86627a56-7673-4189-b78e-441c6a6f12fa tempest-ServersTestBootFromVolume-877599095 tempest-ServersTestBootFromVolume-877599095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:03:35.561467 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-86627a56-7673-4189-b78e-441c6a6f12fa tempest-ServersTestBootFromVolume-877599095 tempest-ServersTestBootFromVolume-877599095-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:03:35.565723 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-86627a56-7673-4189-b78e-441c6a6f12fa tempest-ServersTestBootFromVolume-877599095 tempest-ServersTestBootFromVolume-877599095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:03:35.566547 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-86627a56-7673-4189-b78e-441c6a6f12fa tempest-ServersTestBootFromVolume-877599095 tempest-ServersTestBootFromVolume-877599095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:03:35.726921 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-878bb7be-6eed-4b09-ab0c-5dcb617fbbb3 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:03:35.730373 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-878bb7be-6eed-4b09-ab0c-5dcb617fbbb3 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] [instance: 992f5ec5-d256-4870-b16d-fc8d9adbd3e7] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:03:35.758307 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-878bb7be-6eed-4b09-ab0c-5dcb617fbbb3 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:03:35.759234 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-878bb7be-6eed-4b09-ab0c-5dcb617fbbb3 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:03:35.760062 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-878bb7be-6eed-4b09-ab0c-5dcb617fbbb3 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:03:35.761573 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-878bb7be-6eed-4b09-ab0c-5dcb617fbbb3 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:03:35.762411 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-878bb7be-6eed-4b09-ab0c-5dcb617fbbb3 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:03:35.762939 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-878bb7be-6eed-4b09-ab0c-5dcb617fbbb3 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:03:36.375913 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-86627a56-7673-4189-b78e-441c6a6f12fa tempest-ServersTestBootFromVolume-877599095 tempest-ServersTestBootFromVolume-877599095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed2352ce53fc4045adde8cd81b78b3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651046528c204df299ca3d14c44b4a7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:03:36.408558 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-86627a56-7673-4189-b78e-441c6a6f12fa tempest-ServersTestBootFromVolume-877599095 tempest-ServersTestBootFromVolume-877599095-project] 10.222.0.13 "GET /compute/v2.1/servers/44cdf0d8-969b-4149-bb03-6bc390977019" status: 200 len: 1605 microversion: 2.1 time: 0.869538 Nov 01 19:03:36.409710 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1244/2519] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:03:35 2022] GET /compute/v2.1/servers/44cdf0d8-969b-4149-bb03-6bc390977019 => generated 1605 bytes in 874 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:03:36.418865 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-e2aa31a3-8372-484f-8cc3-11642dddf17d tempest-ServersAdminNegativeTestJSON-824756592 tempest-ServersAdminNegativeTestJSON-824756592-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:03:36.419705 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-e2aa31a3-8372-484f-8cc3-11642dddf17d tempest-ServersAdminNegativeTestJSON-824756592 tempest-ServersAdminNegativeTestJSON-824756592-project] [instance: 51f5bec0-bd00-4ef2-9424-0dad025c8e29] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:03:36.429952 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e2aa31a3-8372-484f-8cc3-11642dddf17d tempest-ServersAdminNegativeTestJSON-824756592 tempest-ServersAdminNegativeTestJSON-824756592-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:03:36.430699 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e2aa31a3-8372-484f-8cc3-11642dddf17d tempest-ServersAdminNegativeTestJSON-824756592 tempest-ServersAdminNegativeTestJSON-824756592-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:03:36.431366 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e2aa31a3-8372-484f-8cc3-11642dddf17d tempest-ServersAdminNegativeTestJSON-824756592 tempest-ServersAdminNegativeTestJSON-824756592-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:03:36.432373 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e2aa31a3-8372-484f-8cc3-11642dddf17d tempest-ServersAdminNegativeTestJSON-824756592 tempest-ServersAdminNegativeTestJSON-824756592-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:03:36.434825 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e2aa31a3-8372-484f-8cc3-11642dddf17d tempest-ServersAdminNegativeTestJSON-824756592 tempest-ServersAdminNegativeTestJSON-824756592-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:03:36.435468 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e2aa31a3-8372-484f-8cc3-11642dddf17d tempest-ServersAdminNegativeTestJSON-824756592 tempest-ServersAdminNegativeTestJSON-824756592-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:03:36.518356 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-878bb7be-6eed-4b09-ab0c-5dcb617fbbb3 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb496b3faac4abbae73d389f2042e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e2520220d454764b8c139a58d78ac83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:03:36.540022 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-878bb7be-6eed-4b09-ab0c-5dcb617fbbb3 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] 10.222.0.13 "GET /compute/v2.1/servers/992f5ec5-d256-4870-b16d-fc8d9adbd3e7" status: 200 len: 1473 microversion: 2.1 time: 0.828212 Nov 01 19:03:36.541244 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1276/2520] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:03:35 2022] GET /compute/v2.1/servers/992f5ec5-d256-4870-b16d-fc8d9adbd3e7 => generated 1473 bytes in 831 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:03:36.577113 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-71e31303-982a-499c-ad59-363d557294ac tempest-LiveMigrationNegativeTest-570155948 tempest-LiveMigrationNegativeTest-570155948-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:03:36.579520 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-71e31303-982a-499c-ad59-363d557294ac tempest-LiveMigrationNegativeTest-570155948 tempest-LiveMigrationNegativeTest-570155948-project] [instance: d405fb5d-9aed-4363-a898-cbdfbef5b82a] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:03:36.587654 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-71e31303-982a-499c-ad59-363d557294ac tempest-LiveMigrationNegativeTest-570155948 tempest-LiveMigrationNegativeTest-570155948-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:03:36.588515 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-71e31303-982a-499c-ad59-363d557294ac tempest-LiveMigrationNegativeTest-570155948 tempest-LiveMigrationNegativeTest-570155948-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:03:36.589136 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-71e31303-982a-499c-ad59-363d557294ac tempest-LiveMigrationNegativeTest-570155948 tempest-LiveMigrationNegativeTest-570155948-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:03:36.590187 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-71e31303-982a-499c-ad59-363d557294ac tempest-LiveMigrationNegativeTest-570155948 tempest-LiveMigrationNegativeTest-570155948-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:03:36.590807 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-71e31303-982a-499c-ad59-363d557294ac tempest-LiveMigrationNegativeTest-570155948 tempest-LiveMigrationNegativeTest-570155948-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:03:36.591388 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-71e31303-982a-499c-ad59-363d557294ac tempest-LiveMigrationNegativeTest-570155948 tempest-LiveMigrationNegativeTest-570155948-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:03:36.615429 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.wsgi [None req-71e31303-982a-499c-ad59-363d557294ac tempest-LiveMigrationNegativeTest-570155948 tempest-LiveMigrationNegativeTest-570155948-project] HTTP exception thrown: Instance d405fb5d-9aed-4363-a898-cbdfbef5b82a could not be found. Nov 01 19:03:36.617300 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-71e31303-982a-499c-ad59-363d557294ac tempest-LiveMigrationNegativeTest-570155948 tempest-LiveMigrationNegativeTest-570155948-project] Request method failure captured: Nov 01 19:03:36.617300 n-d-863052-2 devstack@n-api.service[121403]: request: GET /compute/v2.1/servers/d405fb5d-9aed-4363-a898-cbdfbef5b82a HTTP/1.1 Nov 01 19:03:36.617300 n-d-863052-2 devstack@n-api.service[121403]: Accept: application/json Nov 01 19:03:36.617300 n-d-863052-2 devstack@n-api.service[121403]: Accept-Encoding: identity Nov 01 19:03:36.617300 n-d-863052-2 devstack@n-api.service[121403]: Connection: close Nov 01 19:03:36.617300 n-d-863052-2 devstack@n-api.service[121403]: Content-Length: 0 Nov 01 19:03:36.617300 n-d-863052-2 devstack@n-api.service[121403]: Content-Type: application/json Nov 01 19:03:36.617300 n-d-863052-2 devstack@n-api.service[121403]: Host: 10.222.0.13 Nov 01 19:03:36.617300 n-d-863052-2 devstack@n-api.service[121403]: Openstack-System-Scope: None Nov 01 19:03:36.617300 n-d-863052-2 devstack@n-api.service[121403]: User-Agent: python-urllib3/1.26.12 Nov 01 19:03:36.617300 n-d-863052-2 devstack@n-api.service[121403]: X-Auth-Token: gAAAAABjYW1abh9uWgLRBp0RGhICYgBlcywfvjtZ9unCfEL527uEcne4hGyN9N7iUxaQBE2A78GzMhYn29zsvmBwa_d8_ZMXbOoQG20uujCprJiIhvLN7LdznscNc03mCcgep5BrQXlxNjrYlkLSP89Y54fYsPO5DS2B7tFDiW9iINjzcYsOb10 Nov 01 19:03:36.617300 n-d-863052-2 devstack@n-api.service[121403]: X-Domain-Id: None Nov 01 19:03:36.617300 n-d-863052-2 devstack@n-api.service[121403]: X-Domain-Name: None Nov 01 19:03:36.617300 n-d-863052-2 devstack@n-api.service[121403]: X-Identity-Status: Confirmed Nov 01 19:03:36.617300 n-d-863052-2 devstack@n-api.service[121403]: X-Is-Admin-Project: True Nov 01 19:03:36.617300 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Domain-Id: default Nov 01 19:03:36.617300 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Domain-Name: Default Nov 01 19:03:36.617300 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Id: faa1bc7c9d564b0ebc9ecf0a2994f2d8 Nov 01 19:03:36.617300 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Name: tempest-LiveMigrationNegativeTest-570155948 Nov 01 19:03:36.617300 n-d-863052-2 devstack@n-api.service[121403]: X-Role: member,reader Nov 01 19:03:36.617300 n-d-863052-2 devstack@n-api.service[121403]: X-Roles: member,reader Nov 01 19:03:36.617300 n-d-863052-2 devstack@n-api.service[121403]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/faa1bc7c9d564b0ebc9ecf0a2994f2d8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/faa1bc7c9d564b0ebc9ecf0a2994f2d8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_faa1bc7c9d564b0ebc9ecf0a2994f2d8", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/faa1bc7c9d564b0ebc9ecf0a2994f2d8"}]}] Nov 01 19:03:36.617300 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant: tempest-LiveMigrationNegativeTest-570155948 Nov 01 19:03:36.617300 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant-Id: faa1bc7c9d564b0ebc9ecf0a2994f2d8 Nov 01 19:03:36.617300 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-570155948 Nov 01 19:03:36.617300 n-d-863052-2 devstack@n-api.service[121403]: X-User: tempest-LiveMigrationNegativeTest-570155948-project Nov 01 19:03:36.617300 n-d-863052-2 devstack@n-api.service[121403]: X-User-Domain-Id: default Nov 01 19:03:36.617300 n-d-863052-2 devstack@n-api.service[121403]: X-User-Domain-Name: Default Nov 01 19:03:36.617300 n-d-863052-2 devstack@n-api.service[121403]: X-User-Id: 4c14605afbc5445d9763db185a1305d4 Nov 01 19:03:36.617300 n-d-863052-2 devstack@n-api.service[121403]: X-User-Name: tempest-LiveMigrationNegativeTest-570155948-project Nov 01 19:03:36.617300 n-d-863052-2 devstack@n-api.service[121403]: method: > Nov 01 19:03:36.617300 n-d-863052-2 devstack@n-api.service[121403]: exception: Instance d405fb5d-9aed-4363-a898-cbdfbef5b82a could not be found. Nov 01 19:03:36.617300 n-d-863052-2 devstack@n-api.service[121403]: action_args: {'id': 'd405fb5d-9aed-4363-a898-cbdfbef5b82a'} Nov 01 19:03:36.617300 n-d-863052-2 devstack@n-api.service[121403]: {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 01 19:03:36.617300 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:03:36.617300 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 01 19:03:36.617300 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 01 19:03:36.617300 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 01 19:03:36.617300 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 01 19:03:36.617300 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 01 19:03:36.617300 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 01 19:03:36.617300 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 01 19:03:36.617300 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 01 19:03:36.617300 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d405fb5d-9aed-4363-a898-cbdfbef5b82a could not be found. Nov 01 19:03:36.617300 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:03:36.617300 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:03:36.617300 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:03:36.617300 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:03:36.617300 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:03:36.617300 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:03:36.617300 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 01 19:03:36.617300 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 01 19:03:36.617300 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 01 19:03:36.617300 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 01 19:03:36.617300 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 01 19:03:36.617300 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 01 19:03:36.617300 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 01 19:03:36.617300 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 01 19:03:36.617300 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 01 19:03:36.617300 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 01 19:03:36.617300 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d405fb5d-9aed-4363-a898-cbdfbef5b82a could not be found. Nov 01 19:03:36.617300 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:03:36.617300 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:03:36.617300 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:03:36.622190 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:03:36.622190 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:03:36.622190 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:03:36.622190 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 01 19:03:36.622190 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 01 19:03:36.622190 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d405fb5d-9aed-4363-a898-cbdfbef5b82a could not be found. Nov 01 19:03:36.622190 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:03:36.623554 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-71e31303-982a-499c-ad59-363d557294ac tempest-LiveMigrationNegativeTest-570155948 tempest-LiveMigrationNegativeTest-570155948-project] Returning 404 to user: Instance d405fb5d-9aed-4363-a898-cbdfbef5b82a could not be found. {{(pid=121403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 01 19:03:36.624710 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-71e31303-982a-499c-ad59-363d557294ac tempest-LiveMigrationNegativeTest-570155948 tempest-LiveMigrationNegativeTest-570155948-project] 10.222.0.13 "GET /compute/v2.1/servers/d405fb5d-9aed-4363-a898-cbdfbef5b82a" status: 404 len: 111 microversion: 2.1 time: 0.082150 Nov 01 19:03:36.625756 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1277/2521] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:03:36 2022] GET /compute/v2.1/servers/d405fb5d-9aed-4363-a898-cbdfbef5b82a => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 01 19:03:36.632336 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [req-af4e3ead-1740-4eef-a86e-f6e19b96d6e6 req-e2e2718b-417b-40bc-bf13-f4b7d2a996c3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "12b6a241-81e5-4cb3-b138-ca28f4018732", "name": "network-vif-plugged", "status": "completed", "tag": "28796d98-68e6-44c9-aee9-9383b8f25e1e"}]} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:03:36.646004 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-af4e3ead-1740-4eef-a86e-f6e19b96d6e6 req-e2e2718b-417b-40bc-bf13-f4b7d2a996c3 service nova] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:03:36.646699 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-af4e3ead-1740-4eef-a86e-f6e19b96d6e6 req-e2e2718b-417b-40bc-bf13-f4b7d2a996c3 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:03:36.647290 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-af4e3ead-1740-4eef-a86e-f6e19b96d6e6 req-e2e2718b-417b-40bc-bf13-f4b7d2a996c3 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:03:36.664965 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.compute.server_external_events [req-af4e3ead-1740-4eef-a86e-f6e19b96d6e6 req-e2e2718b-417b-40bc-bf13-f4b7d2a996c3 service nova] Creating event network-vif-plugged:28796d98-68e6-44c9-aee9-9383b8f25e1e for instance 12b6a241-81e5-4cb3-b138-ca28f4018732 on n-h1-863052-2 Nov 01 19:03:36.670948 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [req-af4e3ead-1740-4eef-a86e-f6e19b96d6e6 req-e2e2718b-417b-40bc-bf13-f4b7d2a996c3 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043745 Nov 01 19:03:36.672093 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1278/2522] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Nov 1 19:03:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:03:36.678186 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-1ec6cc3b-b801-4942-ae72-b0b1f404921b tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:03:36.680076 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-1ec6cc3b-b801-4942-ae72-b0b1f404921b tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] [instance: ed4798be-a45e-46f5-8f7e-1165f6479bd1] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:03:36.688057 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-1ec6cc3b-b801-4942-ae72-b0b1f404921b tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:03:36.688924 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-1ec6cc3b-b801-4942-ae72-b0b1f404921b tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:03:36.689527 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-1ec6cc3b-b801-4942-ae72-b0b1f404921b tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:03:36.690404 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-1ec6cc3b-b801-4942-ae72-b0b1f404921b tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:03:36.691615 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-1ec6cc3b-b801-4942-ae72-b0b1f404921b tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:03:36.692203 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-1ec6cc3b-b801-4942-ae72-b0b1f404921b tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:03:36.774730 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-e2aa31a3-8372-484f-8cc3-11642dddf17d tempest-ServersAdminNegativeTestJSON-824756592 tempest-ServersAdminNegativeTestJSON-824756592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0708fb2fc1df4aa9a9697cbc94acf921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '232745bfe2f3445987fedb91098c84eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:03:36.789147 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-e2aa31a3-8372-484f-8cc3-11642dddf17d tempest-ServersAdminNegativeTestJSON-824756592 tempest-ServersAdminNegativeTestJSON-824756592-project] 10.222.0.13 "GET /compute/v2.1/servers/51f5bec0-bd00-4ef2-9424-0dad025c8e29" status: 200 len: 1279 microversion: 2.1 time: 0.373766 Nov 01 19:03:36.789768 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1245/2523] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:03:36 2022] GET /compute/v2.1/servers/51f5bec0-bd00-4ef2-9424-0dad025c8e29 => generated 1279 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:03:36.796669 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-7fe6c2a5-487b-42a6-ad86-e8a7b8689ef5 tempest-ServersTestJSON-675990056 tempest-ServersTestJSON-675990056-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:03:36.805824 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-1ec6cc3b-b801-4942-ae72-b0b1f404921b tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a63d69c99a546f0af16329cff3ca717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a1bb191cff948e99c008b5e861ce4a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:03:36.820359 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-7fe6c2a5-487b-42a6-ad86-e8a7b8689ef5 tempest-ServersTestJSON-675990056 tempest-ServersTestJSON-675990056-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '71d26d92020b4d4aab9f82d174e1ba9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3dd3fba10d740c9bc38b10dca3007aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:03:36.822067 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-7fe6c2a5-487b-42a6-ad86-e8a7b8689ef5 tempest-ServersTestJSON-675990056 tempest-ServersTestJSON-675990056-project] Searching by: {'deleted': False, 'project_id': 'c3dd3fba10d740c9bc38b10dca3007aa'} {{(pid=121402) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 01 19:03:36.827232 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-1ec6cc3b-b801-4942-ae72-b0b1f404921b tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] 10.222.0.13 "GET /compute/v2.1/servers/ed4798be-a45e-46f5-8f7e-1165f6479bd1" status: 200 len: 1479 microversion: 2.1 time: 0.150214 Nov 01 19:03:36.842943 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1279/2524] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:03:36 2022] GET /compute/v2.1/servers/ed4798be-a45e-46f5-8f7e-1165f6479bd1 => generated 1479 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:03:36.854204 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-7fe6c2a5-487b-42a6-ad86-e8a7b8689ef5 tempest-ServersTestJSON-675990056 tempest-ServersTestJSON-675990056-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:03:36.854824 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-7fe6c2a5-487b-42a6-ad86-e8a7b8689ef5 tempest-ServersTestJSON-675990056 tempest-ServersTestJSON-675990056-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:03:36.855235 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-db29210d-0e60-43be-8c57-b75c0ae6c45b tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:03:36.855859 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-db29210d-0e60-43be-8c57-b75c0ae6c45b tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] [instance: 12b6a241-81e5-4cb3-b138-ca28f4018732] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:03:36.856025 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-7fe6c2a5-487b-42a6-ad86-e8a7b8689ef5 tempest-ServersTestJSON-675990056 tempest-ServersTestJSON-675990056-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:03:36.858435 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-7fe6c2a5-487b-42a6-ad86-e8a7b8689ef5 tempest-ServersTestJSON-675990056 tempest-ServersTestJSON-675990056-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:03:36.859131 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-7fe6c2a5-487b-42a6-ad86-e8a7b8689ef5 tempest-ServersTestJSON-675990056 tempest-ServersTestJSON-675990056-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:03:36.860441 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-7fe6c2a5-487b-42a6-ad86-e8a7b8689ef5 tempest-ServersTestJSON-675990056 tempest-ServersTestJSON-675990056-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:03:36.891687 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-db29210d-0e60-43be-8c57-b75c0ae6c45b tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:03:36.892193 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-db29210d-0e60-43be-8c57-b75c0ae6c45b tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:03:36.892677 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-db29210d-0e60-43be-8c57-b75c0ae6c45b tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:03:36.893402 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-db29210d-0e60-43be-8c57-b75c0ae6c45b tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:03:36.897665 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-db29210d-0e60-43be-8c57-b75c0ae6c45b tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:03:36.902812 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.multi_cell_list [None req-7fe6c2a5-487b-42a6-ad86-e8a7b8689ef5 tempest-ServersTestJSON-675990056 tempest-ServersTestJSON-675990056-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=121402) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 01 19:03:36.906466 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-db29210d-0e60-43be-8c57-b75c0ae6c45b tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:03:36.971053 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-7fe6c2a5-487b-42a6-ad86-e8a7b8689ef5 tempest-ServersTestJSON-675990056 tempest-ServersTestJSON-675990056-project] 10.222.0.13 "GET /compute/v2.1/servers" status: 200 len: 333 microversion: 2.1 time: 0.180049 Nov 01 19:03:36.972482 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1246/2525] 10.222.0.13 () {58 vars in 1125 bytes} [Tue Nov 1 19:03:36 2022] GET /compute/v2.1/servers => generated 333 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:03:36.986600 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-f43e5bd4-0b94-41be-9ede-fc3cd811871e tempest-LiveMigrationNegativeTest-570155948 tempest-LiveMigrationNegativeTest-570155948-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:03:36.990309 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-f43e5bd4-0b94-41be-9ede-fc3cd811871e tempest-LiveMigrationNegativeTest-570155948 tempest-LiveMigrationNegativeTest-570155948-project] [instance: c4f1d50d-c833-4efe-9a6b-15064fbf5b58] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:03:36.997542 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f43e5bd4-0b94-41be-9ede-fc3cd811871e tempest-LiveMigrationNegativeTest-570155948 tempest-LiveMigrationNegativeTest-570155948-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:03:36.997874 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f43e5bd4-0b94-41be-9ede-fc3cd811871e tempest-LiveMigrationNegativeTest-570155948 tempest-LiveMigrationNegativeTest-570155948-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:03:37.013053 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f43e5bd4-0b94-41be-9ede-fc3cd811871e tempest-LiveMigrationNegativeTest-570155948 tempest-LiveMigrationNegativeTest-570155948-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:03:37.019652 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f43e5bd4-0b94-41be-9ede-fc3cd811871e tempest-LiveMigrationNegativeTest-570155948 tempest-LiveMigrationNegativeTest-570155948-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:03:37.020517 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f43e5bd4-0b94-41be-9ede-fc3cd811871e tempest-LiveMigrationNegativeTest-570155948 tempest-LiveMigrationNegativeTest-570155948-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:03:37.021042 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f43e5bd4-0b94-41be-9ede-fc3cd811871e tempest-LiveMigrationNegativeTest-570155948 tempest-LiveMigrationNegativeTest-570155948-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:03:37.092282 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-f43e5bd4-0b94-41be-9ede-fc3cd811871e tempest-LiveMigrationNegativeTest-570155948 tempest-LiveMigrationNegativeTest-570155948-project] [instance: c4f1d50d-c833-4efe-9a6b-15064fbf5b58] Going to try to terminate instance {{(pid=121402) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 01 19:03:37.283105 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-f43e5bd4-0b94-41be-9ede-fc3cd811871e tempest-LiveMigrationNegativeTest-570155948 tempest-LiveMigrationNegativeTest-570155948-project] 10.222.0.13 "DELETE /compute/v2.1/servers/c4f1d50d-c833-4efe-9a6b-15064fbf5b58" status: 204 len: 0 microversion: 2.1 time: 0.304315 Nov 01 19:03:37.288241 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1247/2526] 10.222.0.13 () {58 vars in 1239 bytes} [Tue Nov 1 19:03:36 2022] DELETE /compute/v2.1/servers/c4f1d50d-c833-4efe-9a6b-15064fbf5b58 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 01 19:03:37.299757 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [req-ab7d6e74-a8ae-4bca-897e-ed202294745c req-e6b5cb02-1a16-40b8-b2d3-a96d5592d464 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed4798be-a45e-46f5-8f7e-1165f6479bd1", "name": "network-vif-deleted", "tag": "0dfdc28e-1bcb-444f-bd33-acd74444c684"}]} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:03:37.327489 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-ab7d6e74-a8ae-4bca-897e-ed202294745c req-e6b5cb02-1a16-40b8-b2d3-a96d5592d464 service nova] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:03:37.328205 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-ab7d6e74-a8ae-4bca-897e-ed202294745c req-e6b5cb02-1a16-40b8-b2d3-a96d5592d464 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:03:37.329933 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-ab7d6e74-a8ae-4bca-897e-ed202294745c req-e6b5cb02-1a16-40b8-b2d3-a96d5592d464 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:03:37.362425 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.compute.server_external_events [req-ab7d6e74-a8ae-4bca-897e-ed202294745c req-e6b5cb02-1a16-40b8-b2d3-a96d5592d464 service nova] Creating event network-vif-deleted:0dfdc28e-1bcb-444f-bd33-acd74444c684 for instance ed4798be-a45e-46f5-8f7e-1165f6479bd1 on n-h1-863052-2 Nov 01 19:03:37.373197 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [req-ab7d6e74-a8ae-4bca-897e-ed202294745c req-e6b5cb02-1a16-40b8-b2d3-a96d5592d464 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083362 Nov 01 19:03:37.376439 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1248/2527] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Nov 1 19:03:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:03:37.407392 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-b1c97565-9c0b-4044-8b50-90d8677d3415 tempest-ServersTestJSON-675990056 tempest-ServersTestJSON-675990056-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:03:37.431620 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-b1c97565-9c0b-4044-8b50-90d8677d3415 tempest-ServersTestJSON-675990056 tempest-ServersTestJSON-675990056-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '71d26d92020b4d4aab9f82d174e1ba9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3dd3fba10d740c9bc38b10dca3007aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:03:37.435341 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-b1c97565-9c0b-4044-8b50-90d8677d3415 tempest-ServersTestJSON-675990056 tempest-ServersTestJSON-675990056-project] Searching by: {'deleted': False, 'project_id': 'c3dd3fba10d740c9bc38b10dca3007aa'} {{(pid=121402) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 01 19:03:37.458824 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b1c97565-9c0b-4044-8b50-90d8677d3415 tempest-ServersTestJSON-675990056 tempest-ServersTestJSON-675990056-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:03:37.459319 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b1c97565-9c0b-4044-8b50-90d8677d3415 tempest-ServersTestJSON-675990056 tempest-ServersTestJSON-675990056-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:03:37.462020 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b1c97565-9c0b-4044-8b50-90d8677d3415 tempest-ServersTestJSON-675990056 tempest-ServersTestJSON-675990056-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:03:37.465103 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b1c97565-9c0b-4044-8b50-90d8677d3415 tempest-ServersTestJSON-675990056 tempest-ServersTestJSON-675990056-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:03:37.465595 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b1c97565-9c0b-4044-8b50-90d8677d3415 tempest-ServersTestJSON-675990056 tempest-ServersTestJSON-675990056-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:03:37.466031 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b1c97565-9c0b-4044-8b50-90d8677d3415 tempest-ServersTestJSON-675990056 tempest-ServersTestJSON-675990056-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:03:37.531886 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.multi_cell_list [None req-b1c97565-9c0b-4044-8b50-90d8677d3415 tempest-ServersTestJSON-675990056 tempest-ServersTestJSON-675990056-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=121402) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 01 19:03:37.588882 n-d-863052-2 devstack@n-api.service[121402]: DEBUG dbcounter [-] [121402] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=121402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 19:03:37.627472 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-b1c97565-9c0b-4044-8b50-90d8677d3415 tempest-ServersTestJSON-675990056 tempest-ServersTestJSON-675990056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71d26d92020b4d4aab9f82d174e1ba9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3dd3fba10d740c9bc38b10dca3007aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:03:37.643069 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b1c97565-9c0b-4044-8b50-90d8677d3415 tempest-ServersTestJSON-675990056 tempest-ServersTestJSON-675990056-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:03:37.644720 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b1c97565-9c0b-4044-8b50-90d8677d3415 tempest-ServersTestJSON-675990056 tempest-ServersTestJSON-675990056-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:03:37.645846 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b1c97565-9c0b-4044-8b50-90d8677d3415 tempest-ServersTestJSON-675990056 tempest-ServersTestJSON-675990056-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:03:37.742524 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-db29210d-0e60-43be-8c57-b75c0ae6c45b tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52acef7992d64d378fd8ac333887fd0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af51b8733e984c2ca87df2d8163dedf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:03:37.760222 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-db29210d-0e60-43be-8c57-b75c0ae6c45b tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] 10.222.0.13 "GET /compute/v2.1/servers/12b6a241-81e5-4cb3-b138-ca28f4018732" status: 200 len: 1333 microversion: 2.1 time: 0.911614 Nov 01 19:03:37.763178 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1280/2528] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:03:36 2022] GET /compute/v2.1/servers/12b6a241-81e5-4cb3-b138-ca28f4018732 => generated 1333 bytes in 920 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:03:37.783121 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-3eeb9b70-b5ea-494b-a7cc-d75ec93e5a5a tempest-LiveMigrationNegativeTest-570155948 tempest-LiveMigrationNegativeTest-570155948-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:03:37.787652 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-3eeb9b70-b5ea-494b-a7cc-d75ec93e5a5a tempest-LiveMigrationNegativeTest-570155948 tempest-LiveMigrationNegativeTest-570155948-project] [instance: c4f1d50d-c833-4efe-9a6b-15064fbf5b58] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:03:37.806888 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-3eeb9b70-b5ea-494b-a7cc-d75ec93e5a5a tempest-LiveMigrationNegativeTest-570155948 tempest-LiveMigrationNegativeTest-570155948-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:03:37.808271 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-3eeb9b70-b5ea-494b-a7cc-d75ec93e5a5a tempest-LiveMigrationNegativeTest-570155948 tempest-LiveMigrationNegativeTest-570155948-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:03:37.810490 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-3eeb9b70-b5ea-494b-a7cc-d75ec93e5a5a tempest-LiveMigrationNegativeTest-570155948 tempest-LiveMigrationNegativeTest-570155948-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:03:37.811702 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-3eeb9b70-b5ea-494b-a7cc-d75ec93e5a5a tempest-LiveMigrationNegativeTest-570155948 tempest-LiveMigrationNegativeTest-570155948-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:03:37.813421 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-3eeb9b70-b5ea-494b-a7cc-d75ec93e5a5a tempest-LiveMigrationNegativeTest-570155948 tempest-LiveMigrationNegativeTest-570155948-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:03:37.815382 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-3eeb9b70-b5ea-494b-a7cc-d75ec93e5a5a tempest-LiveMigrationNegativeTest-570155948 tempest-LiveMigrationNegativeTest-570155948-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:03:37.912343 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-b1c97565-9c0b-4044-8b50-90d8677d3415 tempest-ServersTestJSON-675990056 tempest-ServersTestJSON-675990056-project] 10.222.0.13 "GET /compute/v2.1/servers/detail" status: 200 len: 1696 microversion: 2.1 time: 0.530826 Nov 01 19:03:37.913411 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1249/2529] 10.222.0.13 () {58 vars in 1146 bytes} [Tue Nov 1 19:03:37 2022] GET /compute/v2.1/servers/detail => generated 1696 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:03:37.929282 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [req-d8e0398e-bdc3-4a78-8bb9-4ef48b1e86e9 req-9a0467b2-a877-4234-8698-a63e7119b5e8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "44cdf0d8-969b-4149-bb03-6bc390977019", "name": "network-vif-deleted", "tag": "2ea52276-0a87-4b31-a387-b25b0b2e684c"}]} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:03:37.949103 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-d8e0398e-bdc3-4a78-8bb9-4ef48b1e86e9 req-9a0467b2-a877-4234-8698-a63e7119b5e8 service nova] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:03:37.951104 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-d8e0398e-bdc3-4a78-8bb9-4ef48b1e86e9 req-9a0467b2-a877-4234-8698-a63e7119b5e8 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:03:37.957417 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-d8e0398e-bdc3-4a78-8bb9-4ef48b1e86e9 req-9a0467b2-a877-4234-8698-a63e7119b5e8 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:03:37.985357 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.compute.server_external_events [req-d8e0398e-bdc3-4a78-8bb9-4ef48b1e86e9 req-9a0467b2-a877-4234-8698-a63e7119b5e8 service nova] Creating event network-vif-deleted:2ea52276-0a87-4b31-a387-b25b0b2e684c for instance 44cdf0d8-969b-4149-bb03-6bc390977019 on n-h1-863052-2 Nov 01 19:03:38.001469 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [req-d8e0398e-bdc3-4a78-8bb9-4ef48b1e86e9 req-9a0467b2-a877-4234-8698-a63e7119b5e8 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083499 Nov 01 19:03:38.004517 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1250/2530] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Nov 1 19:03:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:03:38.017190 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-1292e266-c098-401b-8ea4-3335c55715cf tempest-ServersTestBootFromVolume-877599095 tempest-ServersTestBootFromVolume-877599095-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:03:38.023697 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-1292e266-c098-401b-8ea4-3335c55715cf tempest-ServersTestBootFromVolume-877599095 tempest-ServersTestBootFromVolume-877599095-project] [instance: 44cdf0d8-969b-4149-bb03-6bc390977019] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:03:38.051142 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-1292e266-c098-401b-8ea4-3335c55715cf tempest-ServersTestBootFromVolume-877599095 tempest-ServersTestBootFromVolume-877599095-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:03:38.052280 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-1292e266-c098-401b-8ea4-3335c55715cf tempest-ServersTestBootFromVolume-877599095 tempest-ServersTestBootFromVolume-877599095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:03:38.053168 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-1292e266-c098-401b-8ea4-3335c55715cf tempest-ServersTestBootFromVolume-877599095 tempest-ServersTestBootFromVolume-877599095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:03:38.054094 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-1292e266-c098-401b-8ea4-3335c55715cf tempest-ServersTestBootFromVolume-877599095 tempest-ServersTestBootFromVolume-877599095-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:03:38.054733 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-1292e266-c098-401b-8ea4-3335c55715cf tempest-ServersTestBootFromVolume-877599095 tempest-ServersTestBootFromVolume-877599095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:03:38.055359 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-1292e266-c098-401b-8ea4-3335c55715cf tempest-ServersTestBootFromVolume-877599095 tempest-ServersTestBootFromVolume-877599095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:03:38.249684 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-1292e266-c098-401b-8ea4-3335c55715cf tempest-ServersTestBootFromVolume-877599095 tempest-ServersTestBootFromVolume-877599095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed2352ce53fc4045adde8cd81b78b3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651046528c204df299ca3d14c44b4a7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:03:38.260831 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-1292e266-c098-401b-8ea4-3335c55715cf tempest-ServersTestBootFromVolume-877599095 tempest-ServersTestBootFromVolume-877599095-project] 10.222.0.13 "GET /compute/v2.1/servers/44cdf0d8-969b-4149-bb03-6bc390977019" status: 200 len: 1251 microversion: 2.1 time: 0.254792 Nov 01 19:03:38.270379 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1251/2531] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:03:38 2022] GET /compute/v2.1/servers/44cdf0d8-969b-4149-bb03-6bc390977019 => generated 1251 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:03:38.294807 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-fc19617f-4301-494d-bcb6-c2c02bca4f77 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:03:38.296509 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-fc19617f-4301-494d-bcb6-c2c02bca4f77 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] [instance: 992f5ec5-d256-4870-b16d-fc8d9adbd3e7] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:03:38.313476 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-fc19617f-4301-494d-bcb6-c2c02bca4f77 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:03:38.315711 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-fc19617f-4301-494d-bcb6-c2c02bca4f77 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:03:38.316253 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-fc19617f-4301-494d-bcb6-c2c02bca4f77 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:03:38.319466 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-fc19617f-4301-494d-bcb6-c2c02bca4f77 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:03:38.320201 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-fc19617f-4301-494d-bcb6-c2c02bca4f77 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:03:38.321192 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-fc19617f-4301-494d-bcb6-c2c02bca4f77 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:03:38.486477 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-3eeb9b70-b5ea-494b-a7cc-d75ec93e5a5a tempest-LiveMigrationNegativeTest-570155948 tempest-LiveMigrationNegativeTest-570155948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c14605afbc5445d9763db185a1305d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faa1bc7c9d564b0ebc9ecf0a2994f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:03:38.496820 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-3eeb9b70-b5ea-494b-a7cc-d75ec93e5a5a tempest-LiveMigrationNegativeTest-570155948 tempest-LiveMigrationNegativeTest-570155948-project] 10.222.0.13 "GET /compute/v2.1/servers/c4f1d50d-c833-4efe-9a6b-15064fbf5b58" status: 200 len: 1475 microversion: 2.1 time: 0.731181 Nov 01 19:03:38.499419 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1281/2532] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:03:37 2022] GET /compute/v2.1/servers/c4f1d50d-c833-4efe-9a6b-15064fbf5b58 => generated 1475 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:03:38.509365 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-d0babdb6-153f-443f-a89c-c64638953d58 tempest-ServersAdminNegativeTestJSON-824756592 tempest-ServersAdminNegativeTestJSON-824756592-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:03:38.510250 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-d0babdb6-153f-443f-a89c-c64638953d58 tempest-ServersAdminNegativeTestJSON-824756592 tempest-ServersAdminNegativeTestJSON-824756592-project] [instance: 51f5bec0-bd00-4ef2-9424-0dad025c8e29] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:03:38.531199 n-d-863052-2 devstack@n-api.service[121403]: DEBUG dbcounter [-] [121403] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=121403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 19:03:38.533048 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d0babdb6-153f-443f-a89c-c64638953d58 tempest-ServersAdminNegativeTestJSON-824756592 tempest-ServersAdminNegativeTestJSON-824756592-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:03:38.533863 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d0babdb6-153f-443f-a89c-c64638953d58 tempest-ServersAdminNegativeTestJSON-824756592 tempest-ServersAdminNegativeTestJSON-824756592-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:03:38.534624 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d0babdb6-153f-443f-a89c-c64638953d58 tempest-ServersAdminNegativeTestJSON-824756592 tempest-ServersAdminNegativeTestJSON-824756592-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:03:38.535556 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d0babdb6-153f-443f-a89c-c64638953d58 tempest-ServersAdminNegativeTestJSON-824756592 tempest-ServersAdminNegativeTestJSON-824756592-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:03:38.536219 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d0babdb6-153f-443f-a89c-c64638953d58 tempest-ServersAdminNegativeTestJSON-824756592 tempest-ServersAdminNegativeTestJSON-824756592-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:03:38.536952 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d0babdb6-153f-443f-a89c-c64638953d58 tempest-ServersAdminNegativeTestJSON-824756592 tempest-ServersAdminNegativeTestJSON-824756592-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:03:38.803141 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-fc19617f-4301-494d-bcb6-c2c02bca4f77 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb496b3faac4abbae73d389f2042e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e2520220d454764b8c139a58d78ac83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:03:38.811952 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-fc19617f-4301-494d-bcb6-c2c02bca4f77 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] 10.222.0.13 "GET /compute/v2.1/servers/992f5ec5-d256-4870-b16d-fc8d9adbd3e7" status: 200 len: 1473 microversion: 2.1 time: 0.539984 Nov 01 19:03:38.833773 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1252/2533] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:03:38 2022] GET /compute/v2.1/servers/992f5ec5-d256-4870-b16d-fc8d9adbd3e7 => generated 1473 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:03:38.847334 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-48dcf9e7-8e22-4bc4-80e6-571e6894be4a tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:03:38.848186 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-48dcf9e7-8e22-4bc4-80e6-571e6894be4a tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] [instance: ed4798be-a45e-46f5-8f7e-1165f6479bd1] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:03:38.867975 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-48dcf9e7-8e22-4bc4-80e6-571e6894be4a tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:03:38.873140 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-48dcf9e7-8e22-4bc4-80e6-571e6894be4a tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:03:38.873302 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-48dcf9e7-8e22-4bc4-80e6-571e6894be4a tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:03:38.876657 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-48dcf9e7-8e22-4bc4-80e6-571e6894be4a tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:03:38.877223 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-48dcf9e7-8e22-4bc4-80e6-571e6894be4a tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:03:38.886313 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-48dcf9e7-8e22-4bc4-80e6-571e6894be4a tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:03:38.920156 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.wsgi [None req-48dcf9e7-8e22-4bc4-80e6-571e6894be4a tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] HTTP exception thrown: Instance ed4798be-a45e-46f5-8f7e-1165f6479bd1 could not be found. Nov 01 19:03:38.922551 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-48dcf9e7-8e22-4bc4-80e6-571e6894be4a tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Request method failure captured: Nov 01 19:03:38.922551 n-d-863052-2 devstack@n-api.service[121402]: request: GET /compute/v2.1/servers/ed4798be-a45e-46f5-8f7e-1165f6479bd1 HTTP/1.1 Nov 01 19:03:38.922551 n-d-863052-2 devstack@n-api.service[121402]: Accept: application/json Nov 01 19:03:38.922551 n-d-863052-2 devstack@n-api.service[121402]: Accept-Encoding: identity Nov 01 19:03:38.922551 n-d-863052-2 devstack@n-api.service[121402]: Connection: close Nov 01 19:03:38.922551 n-d-863052-2 devstack@n-api.service[121402]: Content-Length: 0 Nov 01 19:03:38.922551 n-d-863052-2 devstack@n-api.service[121402]: Content-Type: application/json Nov 01 19:03:38.922551 n-d-863052-2 devstack@n-api.service[121402]: Host: 10.222.0.13 Nov 01 19:03:38.922551 n-d-863052-2 devstack@n-api.service[121402]: Openstack-System-Scope: None Nov 01 19:03:38.922551 n-d-863052-2 devstack@n-api.service[121402]: User-Agent: python-urllib3/1.26.12 Nov 01 19:03:38.922551 n-d-863052-2 devstack@n-api.service[121402]: X-Auth-Token: gAAAAABjYWwgP3kjyQKi9Uf4PP24jmeKCOPNU51FZoHLreZdbFyZPhRW-EeK2Se64f-CjytM5LjMEtkBLCti_PQz0S3BXRBnTu4aanJgpXShIx2i6Yz4YqCrWhQ373B1BFIdgiChyw2k6U5YvJRz35UfhTE-zhCjFxCXYsQplbVOAVzO2wYqVeI Nov 01 19:03:38.922551 n-d-863052-2 devstack@n-api.service[121402]: X-Domain-Id: None Nov 01 19:03:38.922551 n-d-863052-2 devstack@n-api.service[121402]: X-Domain-Name: None Nov 01 19:03:38.922551 n-d-863052-2 devstack@n-api.service[121402]: X-Identity-Status: Confirmed Nov 01 19:03:38.922551 n-d-863052-2 devstack@n-api.service[121402]: X-Is-Admin-Project: True Nov 01 19:03:38.922551 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Domain-Id: default Nov 01 19:03:38.922551 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Domain-Name: Default Nov 01 19:03:38.922551 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Id: 4a1bb191cff948e99c008b5e861ce4a8 Nov 01 19:03:38.922551 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-215636868 Nov 01 19:03:38.922551 n-d-863052-2 devstack@n-api.service[121402]: X-Role: member,reader Nov 01 19:03:38.922551 n-d-863052-2 devstack@n-api.service[121402]: X-Roles: member,reader Nov 01 19:03:38.922551 n-d-863052-2 devstack@n-api.service[121402]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/4a1bb191cff948e99c008b5e861ce4a8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/4a1bb191cff948e99c008b5e861ce4a8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_4a1bb191cff948e99c008b5e861ce4a8", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/4a1bb191cff948e99c008b5e861ce4a8"}]}] Nov 01 19:03:38.922551 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant: tempest-ServerRescueNegativeTestJSON-215636868 Nov 01 19:03:38.922551 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant-Id: 4a1bb191cff948e99c008b5e861ce4a8 Nov 01 19:03:38.922551 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-215636868 Nov 01 19:03:38.922551 n-d-863052-2 devstack@n-api.service[121402]: X-User: tempest-ServerRescueNegativeTestJSON-215636868-project Nov 01 19:03:38.922551 n-d-863052-2 devstack@n-api.service[121402]: X-User-Domain-Id: default Nov 01 19:03:38.922551 n-d-863052-2 devstack@n-api.service[121402]: X-User-Domain-Name: Default Nov 01 19:03:38.922551 n-d-863052-2 devstack@n-api.service[121402]: X-User-Id: 6a63d69c99a546f0af16329cff3ca717 Nov 01 19:03:38.922551 n-d-863052-2 devstack@n-api.service[121402]: X-User-Name: tempest-ServerRescueNegativeTestJSON-215636868-project Nov 01 19:03:38.922551 n-d-863052-2 devstack@n-api.service[121402]: method: > Nov 01 19:03:38.922551 n-d-863052-2 devstack@n-api.service[121402]: exception: Instance ed4798be-a45e-46f5-8f7e-1165f6479bd1 could not be found. Nov 01 19:03:38.922551 n-d-863052-2 devstack@n-api.service[121402]: action_args: {'id': 'ed4798be-a45e-46f5-8f7e-1165f6479bd1'} Nov 01 19:03:38.922551 n-d-863052-2 devstack@n-api.service[121402]: {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 01 19:03:38.922551 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:03:38.922551 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 01 19:03:38.922551 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 01 19:03:38.922551 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 01 19:03:38.922551 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 01 19:03:38.922551 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 01 19:03:38.922551 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 01 19:03:38.922551 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 01 19:03:38.922551 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 01 19:03:38.922551 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ed4798be-a45e-46f5-8f7e-1165f6479bd1 could not be found. Nov 01 19:03:38.922551 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:03:38.922551 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:03:38.922551 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:03:38.922551 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:03:38.922551 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:03:38.922551 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:03:38.922551 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 01 19:03:38.922551 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 01 19:03:38.922551 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 01 19:03:38.922551 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 01 19:03:38.922551 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 01 19:03:38.922551 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 01 19:03:38.922551 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 01 19:03:38.922551 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 01 19:03:38.922551 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 01 19:03:38.922551 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 01 19:03:38.922551 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ed4798be-a45e-46f5-8f7e-1165f6479bd1 could not be found. Nov 01 19:03:38.922551 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:03:38.922551 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:03:38.926550 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:03:38.926550 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:03:38.926550 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:03:38.926550 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:03:38.926550 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 01 19:03:38.926550 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 01 19:03:38.926550 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ed4798be-a45e-46f5-8f7e-1165f6479bd1 could not be found. Nov 01 19:03:38.926550 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:03:38.926550 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-48dcf9e7-8e22-4bc4-80e6-571e6894be4a tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] Returning 404 to user: Instance ed4798be-a45e-46f5-8f7e-1165f6479bd1 could not be found. {{(pid=121402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 01 19:03:38.926550 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-48dcf9e7-8e22-4bc4-80e6-571e6894be4a tempest-ServerRescueNegativeTestJSON-215636868 tempest-ServerRescueNegativeTestJSON-215636868-project] 10.222.0.13 "GET /compute/v2.1/servers/ed4798be-a45e-46f5-8f7e-1165f6479bd1" status: 404 len: 111 microversion: 2.1 time: 0.089209 Nov 01 19:03:38.928800 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1253/2534] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:03:38 2022] GET /compute/v2.1/servers/ed4798be-a45e-46f5-8f7e-1165f6479bd1 => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 01 19:03:38.937054 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-7312716c-8f32-4a9e-b9f1-c291ec231d13 tempest-ServersTestJSON-675990056 tempest-ServersTestJSON-675990056-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:03:38.956871 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-7312716c-8f32-4a9e-b9f1-c291ec231d13 tempest-ServersTestJSON-675990056 tempest-ServersTestJSON-675990056-project] 10.222.0.13 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.026828 Nov 01 19:03:38.981450 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1254/2535] 10.222.0.13 () {58 vars in 1137 bytes} [Tue Nov 1 19:03:38 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:03:38.989508 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-df1e24bf-9ec6-40ad-838d-f9d7eec76397 tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:03:39.004405 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-df1e24bf-9ec6-40ad-838d-f9d7eec76397 tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] [instance: 12b6a241-81e5-4cb3-b138-ca28f4018732] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:03:39.026355 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-df1e24bf-9ec6-40ad-838d-f9d7eec76397 tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:03:39.031620 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-df1e24bf-9ec6-40ad-838d-f9d7eec76397 tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:03:39.032198 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-df1e24bf-9ec6-40ad-838d-f9d7eec76397 tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:03:39.038781 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-df1e24bf-9ec6-40ad-838d-f9d7eec76397 tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:03:39.040764 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-df1e24bf-9ec6-40ad-838d-f9d7eec76397 tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:03:39.041397 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-df1e24bf-9ec6-40ad-838d-f9d7eec76397 tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:03:39.403111 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-d0babdb6-153f-443f-a89c-c64638953d58 tempest-ServersAdminNegativeTestJSON-824756592 tempest-ServersAdminNegativeTestJSON-824756592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0708fb2fc1df4aa9a9697cbc94acf921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '232745bfe2f3445987fedb91098c84eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:03:39.417119 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-d0babdb6-153f-443f-a89c-c64638953d58 tempest-ServersAdminNegativeTestJSON-824756592 tempest-ServersAdminNegativeTestJSON-824756592-project] 10.222.0.13 "GET /compute/v2.1/servers/51f5bec0-bd00-4ef2-9424-0dad025c8e29" status: 200 len: 1321 microversion: 2.1 time: 0.916343 Nov 01 19:03:39.421919 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1282/2536] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:03:38 2022] GET /compute/v2.1/servers/51f5bec0-bd00-4ef2-9424-0dad025c8e29 => generated 1321 bytes in 921 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:03:39.429948 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [req-976a6cd5-0e70-4499-9cee-0b1b06b74802 req-1fd4d9b7-c253-442f-99c8-638c40a54510 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "12b6a241-81e5-4cb3-b138-ca28f4018732", "name": "network-vif-plugged", "status": "completed", "tag": "83ab684c-8cbd-40cd-8ab7-9ad6c84fb96d"}]} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:03:39.455049 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-976a6cd5-0e70-4499-9cee-0b1b06b74802 req-1fd4d9b7-c253-442f-99c8-638c40a54510 service nova] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:03:39.463677 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-976a6cd5-0e70-4499-9cee-0b1b06b74802 req-1fd4d9b7-c253-442f-99c8-638c40a54510 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:03:39.464375 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-976a6cd5-0e70-4499-9cee-0b1b06b74802 req-1fd4d9b7-c253-442f-99c8-638c40a54510 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:03:39.470540 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-df1e24bf-9ec6-40ad-838d-f9d7eec76397 tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52acef7992d64d378fd8ac333887fd0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af51b8733e984c2ca87df2d8163dedf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:03:39.482271 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-df1e24bf-9ec6-40ad-838d-f9d7eec76397 tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] 10.222.0.13 "GET /compute/v2.1/servers/12b6a241-81e5-4cb3-b138-ca28f4018732" status: 200 len: 1333 microversion: 2.1 time: 0.502140 Nov 01 19:03:39.482872 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1255/2537] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:03:38 2022] GET /compute/v2.1/servers/12b6a241-81e5-4cb3-b138-ca28f4018732 => generated 1333 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:03:39.485307 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.compute.server_external_events [req-976a6cd5-0e70-4499-9cee-0b1b06b74802 req-1fd4d9b7-c253-442f-99c8-638c40a54510 service nova] Creating event network-vif-plugged:83ab684c-8cbd-40cd-8ab7-9ad6c84fb96d for instance 12b6a241-81e5-4cb3-b138-ca28f4018732 on n-h1-863052-2 Nov 01 19:03:39.503402 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [req-976a6cd5-0e70-4499-9cee-0b1b06b74802 req-1fd4d9b7-c253-442f-99c8-638c40a54510 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079879 Nov 01 19:03:39.504331 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1283/2538] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Nov 1 19:03:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:03:39.508355 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-6c7f637d-1ba8-4a76-85dd-c2e472b59160 tempest-ServersTestBootFromVolume-877599095 tempest-ServersTestBootFromVolume-877599095-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:03:39.509014 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-6c7f637d-1ba8-4a76-85dd-c2e472b59160 tempest-ServersTestBootFromVolume-877599095 tempest-ServersTestBootFromVolume-877599095-project] [instance: 44cdf0d8-969b-4149-bb03-6bc390977019] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:03:39.512697 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-df80d803-e324-4a89-98ba-1ee7c4188a26 tempest-ServersTestJSON-675990056 tempest-ServersTestJSON-675990056-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:03:39.518109 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-df80d803-e324-4a89-98ba-1ee7c4188a26 tempest-ServersTestJSON-675990056 tempest-ServersTestJSON-675990056-project] [instance: 6e82d040-bcc6-473e-b202-bf13829baf2c] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:03:39.540718 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-6c7f637d-1ba8-4a76-85dd-c2e472b59160 tempest-ServersTestBootFromVolume-877599095 tempest-ServersTestBootFromVolume-877599095-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:03:39.541232 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-6c7f637d-1ba8-4a76-85dd-c2e472b59160 tempest-ServersTestBootFromVolume-877599095 tempest-ServersTestBootFromVolume-877599095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:03:39.545084 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-6c7f637d-1ba8-4a76-85dd-c2e472b59160 tempest-ServersTestBootFromVolume-877599095 tempest-ServersTestBootFromVolume-877599095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:03:39.547363 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-6c7f637d-1ba8-4a76-85dd-c2e472b59160 tempest-ServersTestBootFromVolume-877599095 tempest-ServersTestBootFromVolume-877599095-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:03:39.549210 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-6c7f637d-1ba8-4a76-85dd-c2e472b59160 tempest-ServersTestBootFromVolume-877599095 tempest-ServersTestBootFromVolume-877599095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:03:39.553993 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-6c7f637d-1ba8-4a76-85dd-c2e472b59160 tempest-ServersTestBootFromVolume-877599095 tempest-ServersTestBootFromVolume-877599095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:03:39.562721 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-df80d803-e324-4a89-98ba-1ee7c4188a26 tempest-ServersTestJSON-675990056 tempest-ServersTestJSON-675990056-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:03:39.564561 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-df80d803-e324-4a89-98ba-1ee7c4188a26 tempest-ServersTestJSON-675990056 tempest-ServersTestJSON-675990056-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.024s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:03:39.569539 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-df80d803-e324-4a89-98ba-1ee7c4188a26 tempest-ServersTestJSON-675990056 tempest-ServersTestJSON-675990056-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:03:39.570739 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-df80d803-e324-4a89-98ba-1ee7c4188a26 tempest-ServersTestJSON-675990056 tempest-ServersTestJSON-675990056-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:03:39.571372 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-df80d803-e324-4a89-98ba-1ee7c4188a26 tempest-ServersTestJSON-675990056 tempest-ServersTestJSON-675990056-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:03:39.572350 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-df80d803-e324-4a89-98ba-1ee7c4188a26 tempest-ServersTestJSON-675990056 tempest-ServersTestJSON-675990056-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:03:39.626178 n-d-863052-2 devstack@n-api.service[121403]: DEBUG dbcounter [-] [121403] Writing DB stats nova_cell1:SELECT=100 {{(pid=121403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 19:03:39.633958 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-df80d803-e324-4a89-98ba-1ee7c4188a26 tempest-ServersTestJSON-675990056 tempest-ServersTestJSON-675990056-project] [instance: 6e82d040-bcc6-473e-b202-bf13829baf2c] Going to try to terminate instance {{(pid=121403) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 01 19:03:39.804140 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-6c7f637d-1ba8-4a76-85dd-c2e472b59160 tempest-ServersTestBootFromVolume-877599095 tempest-ServersTestBootFromVolume-877599095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed2352ce53fc4045adde8cd81b78b3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651046528c204df299ca3d14c44b4a7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:03:39.827679 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-6c7f637d-1ba8-4a76-85dd-c2e472b59160 tempest-ServersTestBootFromVolume-877599095 tempest-ServersTestBootFromVolume-877599095-project] 10.222.0.13 "GET /compute/v2.1/servers/44cdf0d8-969b-4149-bb03-6bc390977019" status: 200 len: 1251 microversion: 2.1 time: 0.342948 Nov 01 19:03:39.829338 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1256/2539] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:03:39 2022] GET /compute/v2.1/servers/44cdf0d8-969b-4149-bb03-6bc390977019 => generated 1251 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:03:39.834955 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-df80d803-e324-4a89-98ba-1ee7c4188a26 tempest-ServersTestJSON-675990056 tempest-ServersTestJSON-675990056-project] 10.222.0.13 "DELETE /compute/v2.1/servers/6e82d040-bcc6-473e-b202-bf13829baf2c" status: 204 len: 0 microversion: 2.1 time: 0.328735 Nov 01 19:03:39.839969 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1284/2540] 10.222.0.13 () {58 vars in 1239 bytes} [Tue Nov 1 19:03:39 2022] DELETE /compute/v2.1/servers/6e82d040-bcc6-473e-b202-bf13829baf2c => generated 0 bytes in 331 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 01 19:03:39.849001 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-0107041c-0209-4d73-a957-7f8dd3ee7423 tempest-LiveMigrationNegativeTest-570155948 tempest-LiveMigrationNegativeTest-570155948-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:03:39.849359 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-d92a6b28-894e-436a-9fe5-22f272b5134d tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:03:39.850501 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-0107041c-0209-4d73-a957-7f8dd3ee7423 tempest-LiveMigrationNegativeTest-570155948 tempest-LiveMigrationNegativeTest-570155948-project] [instance: c4f1d50d-c833-4efe-9a6b-15064fbf5b58] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:03:39.852183 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-d92a6b28-894e-436a-9fe5-22f272b5134d tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] [instance: 992f5ec5-d256-4870-b16d-fc8d9adbd3e7] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:03:39.867202 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d92a6b28-894e-436a-9fe5-22f272b5134d tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:03:39.867733 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d92a6b28-894e-436a-9fe5-22f272b5134d tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:03:39.870254 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d92a6b28-894e-436a-9fe5-22f272b5134d tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:03:39.872278 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d92a6b28-894e-436a-9fe5-22f272b5134d tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:03:39.874484 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-0107041c-0209-4d73-a957-7f8dd3ee7423 tempest-LiveMigrationNegativeTest-570155948 tempest-LiveMigrationNegativeTest-570155948-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:03:39.874910 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-0107041c-0209-4d73-a957-7f8dd3ee7423 tempest-LiveMigrationNegativeTest-570155948 tempest-LiveMigrationNegativeTest-570155948-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:03:39.875234 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d92a6b28-894e-436a-9fe5-22f272b5134d tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:03:39.876775 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d92a6b28-894e-436a-9fe5-22f272b5134d tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:03:39.877454 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-0107041c-0209-4d73-a957-7f8dd3ee7423 tempest-LiveMigrationNegativeTest-570155948 tempest-LiveMigrationNegativeTest-570155948-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:03:39.882955 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-0107041c-0209-4d73-a957-7f8dd3ee7423 tempest-LiveMigrationNegativeTest-570155948 tempest-LiveMigrationNegativeTest-570155948-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:03:39.883883 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-0107041c-0209-4d73-a957-7f8dd3ee7423 tempest-LiveMigrationNegativeTest-570155948 tempest-LiveMigrationNegativeTest-570155948-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:03:39.884371 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-0107041c-0209-4d73-a957-7f8dd3ee7423 tempest-LiveMigrationNegativeTest-570155948 tempest-LiveMigrationNegativeTest-570155948-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:03:40.113392 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-0107041c-0209-4d73-a957-7f8dd3ee7423 tempest-LiveMigrationNegativeTest-570155948 tempest-LiveMigrationNegativeTest-570155948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c14605afbc5445d9763db185a1305d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faa1bc7c9d564b0ebc9ecf0a2994f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:03:40.124235 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-0107041c-0209-4d73-a957-7f8dd3ee7423 tempest-LiveMigrationNegativeTest-570155948 tempest-LiveMigrationNegativeTest-570155948-project] 10.222.0.13 "GET /compute/v2.1/servers/c4f1d50d-c833-4efe-9a6b-15064fbf5b58" status: 200 len: 1433 microversion: 2.1 time: 0.292645 Nov 01 19:03:40.126121 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1257/2541] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:03:39 2022] GET /compute/v2.1/servers/c4f1d50d-c833-4efe-9a6b-15064fbf5b58 => generated 1433 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:03:40.136239 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-2cc65ca7-5683-4dd7-84c1-665489701b5e tempest-ServersTestJSON-675990056 tempest-ServersTestJSON-675990056-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:03:40.137210 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-2cc65ca7-5683-4dd7-84c1-665489701b5e tempest-ServersTestJSON-675990056 tempest-ServersTestJSON-675990056-project] [instance: 6e82d040-bcc6-473e-b202-bf13829baf2c] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:03:40.154144 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2cc65ca7-5683-4dd7-84c1-665489701b5e tempest-ServersTestJSON-675990056 tempest-ServersTestJSON-675990056-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:03:40.155050 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2cc65ca7-5683-4dd7-84c1-665489701b5e tempest-ServersTestJSON-675990056 tempest-ServersTestJSON-675990056-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:03:40.155691 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2cc65ca7-5683-4dd7-84c1-665489701b5e tempest-ServersTestJSON-675990056 tempest-ServersTestJSON-675990056-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:03:40.156634 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2cc65ca7-5683-4dd7-84c1-665489701b5e tempest-ServersTestJSON-675990056 tempest-ServersTestJSON-675990056-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:03:40.157312 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2cc65ca7-5683-4dd7-84c1-665489701b5e tempest-ServersTestJSON-675990056 tempest-ServersTestJSON-675990056-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:03:40.157939 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2cc65ca7-5683-4dd7-84c1-665489701b5e tempest-ServersTestJSON-675990056 tempest-ServersTestJSON-675990056-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:03:40.435361 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-d92a6b28-894e-436a-9fe5-22f272b5134d tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb496b3faac4abbae73d389f2042e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e2520220d454764b8c139a58d78ac83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:03:40.448239 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-2cc65ca7-5683-4dd7-84c1-665489701b5e tempest-ServersTestJSON-675990056 tempest-ServersTestJSON-675990056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71d26d92020b4d4aab9f82d174e1ba9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3dd3fba10d740c9bc38b10dca3007aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:03:40.458063 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-d92a6b28-894e-436a-9fe5-22f272b5134d tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] 10.222.0.13 "GET /compute/v2.1/servers/992f5ec5-d256-4870-b16d-fc8d9adbd3e7" status: 200 len: 1473 microversion: 2.1 time: 0.616545 Nov 01 19:03:40.460037 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-2cc65ca7-5683-4dd7-84c1-665489701b5e tempest-ServersTestJSON-675990056 tempest-ServersTestJSON-675990056-project] 10.222.0.13 "GET /compute/v2.1/servers/6e82d040-bcc6-473e-b202-bf13829baf2c" status: 200 len: 1699 microversion: 2.1 time: 0.332789 Nov 01 19:03:40.460638 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1258/2542] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:03:40 2022] GET /compute/v2.1/servers/6e82d040-bcc6-473e-b202-bf13829baf2c => generated 1699 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:03:40.465041 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1285/2543] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:03:39 2022] GET /compute/v2.1/servers/992f5ec5-d256-4870-b16d-fc8d9adbd3e7 => generated 1473 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:03:40.482201 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [req-e6ccef46-989a-4eb9-b8d7-db07ca3e8aa4 req-fa8d63c3-4a63-4236-84b5-9cc8bad2329d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c4f1d50d-c833-4efe-9a6b-15064fbf5b58", "name": "network-vif-deleted", "tag": "a0c4450f-3a0d-4ab5-ae2d-70ce39e68852"}]} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:03:40.488819 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [req-9dbeee78-0186-474d-8eb4-f9142531caff req-4451a0bb-5572-45e8-9ea1-ce946791892c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "51f5bec0-bd00-4ef2-9424-0dad025c8e29", "tag": "2ea05588-365b-4212-a081-271d3bee0810"}]} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:03:40.516724 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-e6ccef46-989a-4eb9-b8d7-db07ca3e8aa4 req-fa8d63c3-4a63-4236-84b5-9cc8bad2329d service nova] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:03:40.517487 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-e6ccef46-989a-4eb9-b8d7-db07ca3e8aa4 req-fa8d63c3-4a63-4236-84b5-9cc8bad2329d service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:03:40.518107 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-e6ccef46-989a-4eb9-b8d7-db07ca3e8aa4 req-fa8d63c3-4a63-4236-84b5-9cc8bad2329d service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:03:40.521528 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-9dbeee78-0186-474d-8eb4-f9142531caff req-4451a0bb-5572-45e8-9ea1-ce946791892c service nova] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:03:40.523638 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-9dbeee78-0186-474d-8eb4-f9142531caff req-4451a0bb-5572-45e8-9ea1-ce946791892c service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:03:40.525364 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-9dbeee78-0186-474d-8eb4-f9142531caff req-4451a0bb-5572-45e8-9ea1-ce946791892c service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:03:40.568354 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.compute.server_external_events [req-e6ccef46-989a-4eb9-b8d7-db07ca3e8aa4 req-fa8d63c3-4a63-4236-84b5-9cc8bad2329d service nova] Creating event network-vif-deleted:a0c4450f-3a0d-4ab5-ae2d-70ce39e68852 for instance c4f1d50d-c833-4efe-9a6b-15064fbf5b58 on n-h2-863052-2 Nov 01 19:03:40.569289 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.compute.server_external_events [req-9dbeee78-0186-474d-8eb4-f9142531caff req-4451a0bb-5572-45e8-9ea1-ce946791892c service nova] Creating event network-changed:2ea05588-365b-4212-a081-271d3bee0810 for instance 51f5bec0-bd00-4ef2-9424-0dad025c8e29 on n-h2-863052-2 Nov 01 19:03:40.574259 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [req-e6ccef46-989a-4eb9-b8d7-db07ca3e8aa4 req-fa8d63c3-4a63-4236-84b5-9cc8bad2329d service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109555 Nov 01 19:03:40.574872 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1259/2544] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Nov 1 19:03:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:03:40.582549 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-ce25abc6-05bf-4598-8fec-ed4417c5d7a5 tempest-ServersAdminNegativeTestJSON-824756592 tempest-ServersAdminNegativeTestJSON-824756592-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:03:40.583573 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-ce25abc6-05bf-4598-8fec-ed4417c5d7a5 tempest-ServersAdminNegativeTestJSON-824756592 tempest-ServersAdminNegativeTestJSON-824756592-project] [instance: 51f5bec0-bd00-4ef2-9424-0dad025c8e29] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:03:40.585679 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [req-9dbeee78-0186-474d-8eb4-f9142531caff req-4451a0bb-5572-45e8-9ea1-ce946791892c service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.119170 Nov 01 19:03:40.589229 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1286/2545] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Nov 1 19:03:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:03:40.591401 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-ce25abc6-05bf-4598-8fec-ed4417c5d7a5 tempest-ServersAdminNegativeTestJSON-824756592 tempest-ServersAdminNegativeTestJSON-824756592-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:03:40.592078 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-ce25abc6-05bf-4598-8fec-ed4417c5d7a5 tempest-ServersAdminNegativeTestJSON-824756592 tempest-ServersAdminNegativeTestJSON-824756592-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:03:40.593335 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-ce25abc6-05bf-4598-8fec-ed4417c5d7a5 tempest-ServersAdminNegativeTestJSON-824756592 tempest-ServersAdminNegativeTestJSON-824756592-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:03:40.594225 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-ce25abc6-05bf-4598-8fec-ed4417c5d7a5 tempest-ServersAdminNegativeTestJSON-824756592 tempest-ServersAdminNegativeTestJSON-824756592-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:03:40.594843 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-ce25abc6-05bf-4598-8fec-ed4417c5d7a5 tempest-ServersAdminNegativeTestJSON-824756592 tempest-ServersAdminNegativeTestJSON-824756592-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:03:40.595424 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-ce25abc6-05bf-4598-8fec-ed4417c5d7a5 tempest-ServersAdminNegativeTestJSON-824756592 tempest-ServersAdminNegativeTestJSON-824756592-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:03:40.602852 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-b39e037a-983d-4bab-814c-e3c683caaca8 tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:03:40.603563 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-b39e037a-983d-4bab-814c-e3c683caaca8 tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] [instance: 12b6a241-81e5-4cb3-b138-ca28f4018732] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:03:40.622658 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-b39e037a-983d-4bab-814c-e3c683caaca8 tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:03:40.623540 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-b39e037a-983d-4bab-814c-e3c683caaca8 tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:03:40.624132 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-b39e037a-983d-4bab-814c-e3c683caaca8 tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:03:40.625103 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-b39e037a-983d-4bab-814c-e3c683caaca8 tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:03:40.625707 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-b39e037a-983d-4bab-814c-e3c683caaca8 tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:03:40.626270 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-b39e037a-983d-4bab-814c-e3c683caaca8 tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:03:40.989907 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-b39e037a-983d-4bab-814c-e3c683caaca8 tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52acef7992d64d378fd8ac333887fd0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af51b8733e984c2ca87df2d8163dedf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:03:40.997264 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-ce25abc6-05bf-4598-8fec-ed4417c5d7a5 tempest-ServersAdminNegativeTestJSON-824756592 tempest-ServersAdminNegativeTestJSON-824756592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0708fb2fc1df4aa9a9697cbc94acf921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '232745bfe2f3445987fedb91098c84eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:03:41.000552 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-b39e037a-983d-4bab-814c-e3c683caaca8 tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] 10.222.0.13 "GET /compute/v2.1/servers/12b6a241-81e5-4cb3-b138-ca28f4018732" status: 200 len: 1333 microversion: 2.1 time: 0.409175 Nov 01 19:03:41.004439 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1287/2546] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:03:40 2022] GET /compute/v2.1/servers/12b6a241-81e5-4cb3-b138-ca28f4018732 => generated 1333 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:03:41.010987 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-ce25abc6-05bf-4598-8fec-ed4417c5d7a5 tempest-ServersAdminNegativeTestJSON-824756592 tempest-ServersAdminNegativeTestJSON-824756592-project] 10.222.0.13 "GET /compute/v2.1/servers/51f5bec0-bd00-4ef2-9424-0dad025c8e29" status: 200 len: 1321 microversion: 2.1 time: 0.430814 Nov 01 19:03:41.012233 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1260/2547] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:03:40 2022] GET /compute/v2.1/servers/51f5bec0-bd00-4ef2-9424-0dad025c8e29 => generated 1321 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:03:41.020536 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-0cee4eb6-84e6-44b4-b24a-fdf88366ab98 tempest-ServersTestBootFromVolume-877599095 tempest-ServersTestBootFromVolume-877599095-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:03:41.022851 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-0cee4eb6-84e6-44b4-b24a-fdf88366ab98 tempest-ServersTestBootFromVolume-877599095 tempest-ServersTestBootFromVolume-877599095-project] [instance: 44cdf0d8-969b-4149-bb03-6bc390977019] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:03:41.036396 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-0cee4eb6-84e6-44b4-b24a-fdf88366ab98 tempest-ServersTestBootFromVolume-877599095 tempest-ServersTestBootFromVolume-877599095-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:03:41.042967 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-0cee4eb6-84e6-44b4-b24a-fdf88366ab98 tempest-ServersTestBootFromVolume-877599095 tempest-ServersTestBootFromVolume-877599095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:03:41.043692 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-0cee4eb6-84e6-44b4-b24a-fdf88366ab98 tempest-ServersTestBootFromVolume-877599095 tempest-ServersTestBootFromVolume-877599095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:03:41.044606 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-0cee4eb6-84e6-44b4-b24a-fdf88366ab98 tempest-ServersTestBootFromVolume-877599095 tempest-ServersTestBootFromVolume-877599095-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:03:41.049693 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-0cee4eb6-84e6-44b4-b24a-fdf88366ab98 tempest-ServersTestBootFromVolume-877599095 tempest-ServersTestBootFromVolume-877599095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:03:41.050890 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-0cee4eb6-84e6-44b4-b24a-fdf88366ab98 tempest-ServersTestBootFromVolume-877599095 tempest-ServersTestBootFromVolume-877599095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:03:41.148959 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-03bb0cf2-02b6-482f-a2b5-ef69ec2ac67a tempest-LiveMigrationNegativeTest-570155948 tempest-LiveMigrationNegativeTest-570155948-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:03:41.150306 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-03bb0cf2-02b6-482f-a2b5-ef69ec2ac67a tempest-LiveMigrationNegativeTest-570155948 tempest-LiveMigrationNegativeTest-570155948-project] [instance: c4f1d50d-c833-4efe-9a6b-15064fbf5b58] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:03:41.161904 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-03bb0cf2-02b6-482f-a2b5-ef69ec2ac67a tempest-LiveMigrationNegativeTest-570155948 tempest-LiveMigrationNegativeTest-570155948-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:03:41.169076 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-03bb0cf2-02b6-482f-a2b5-ef69ec2ac67a tempest-LiveMigrationNegativeTest-570155948 tempest-LiveMigrationNegativeTest-570155948-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:03:41.169771 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-03bb0cf2-02b6-482f-a2b5-ef69ec2ac67a tempest-LiveMigrationNegativeTest-570155948 tempest-LiveMigrationNegativeTest-570155948-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:03:41.171310 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-03bb0cf2-02b6-482f-a2b5-ef69ec2ac67a tempest-LiveMigrationNegativeTest-570155948 tempest-LiveMigrationNegativeTest-570155948-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:03:41.172009 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-03bb0cf2-02b6-482f-a2b5-ef69ec2ac67a tempest-LiveMigrationNegativeTest-570155948 tempest-LiveMigrationNegativeTest-570155948-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:03:41.179412 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-03bb0cf2-02b6-482f-a2b5-ef69ec2ac67a tempest-LiveMigrationNegativeTest-570155948 tempest-LiveMigrationNegativeTest-570155948-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:03:41.254376 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-0cee4eb6-84e6-44b4-b24a-fdf88366ab98 tempest-ServersTestBootFromVolume-877599095 tempest-ServersTestBootFromVolume-877599095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed2352ce53fc4045adde8cd81b78b3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651046528c204df299ca3d14c44b4a7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:03:41.259039 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-03bb0cf2-02b6-482f-a2b5-ef69ec2ac67a tempest-LiveMigrationNegativeTest-570155948 tempest-LiveMigrationNegativeTest-570155948-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:03:41.260061 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-03bb0cf2-02b6-482f-a2b5-ef69ec2ac67a tempest-LiveMigrationNegativeTest-570155948 tempest-LiveMigrationNegativeTest-570155948-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:03:41.264163 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-0cee4eb6-84e6-44b4-b24a-fdf88366ab98 tempest-ServersTestBootFromVolume-877599095 tempest-ServersTestBootFromVolume-877599095-project] 10.222.0.13 "GET /compute/v2.1/servers/44cdf0d8-969b-4149-bb03-6bc390977019" status: 200 len: 1251 microversion: 2.1 time: 0.258449 Nov 01 19:03:41.265000 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-03bb0cf2-02b6-482f-a2b5-ef69ec2ac67a tempest-LiveMigrationNegativeTest-570155948 tempest-LiveMigrationNegativeTest-570155948-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:03:41.265696 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.objects.instance [None req-03bb0cf2-02b6-482f-a2b5-ef69ec2ac67a tempest-LiveMigrationNegativeTest-570155948 tempest-LiveMigrationNegativeTest-570155948-project] Lazy-loading 'fault' on Instance uuid c4f1d50d-c833-4efe-9a6b-15064fbf5b58 {{(pid=121402) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 01 19:03:41.285353 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1288/2548] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:03:41 2022] GET /compute/v2.1/servers/44cdf0d8-969b-4149-bb03-6bc390977019 => generated 1251 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:03:41.387252 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-03bb0cf2-02b6-482f-a2b5-ef69ec2ac67a tempest-LiveMigrationNegativeTest-570155948 tempest-LiveMigrationNegativeTest-570155948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c14605afbc5445d9763db185a1305d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faa1bc7c9d564b0ebc9ecf0a2994f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:03:41.396841 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-03bb0cf2-02b6-482f-a2b5-ef69ec2ac67a tempest-LiveMigrationNegativeTest-570155948 tempest-LiveMigrationNegativeTest-570155948-project] 10.222.0.13 "GET /compute/v2.1/servers/c4f1d50d-c833-4efe-9a6b-15064fbf5b58" status: 200 len: 1309 microversion: 2.1 time: 0.252863 Nov 01 19:03:41.400307 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1261/2549] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:03:41 2022] GET /compute/v2.1/servers/c4f1d50d-c833-4efe-9a6b-15064fbf5b58 => generated 1309 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:03:41.483907 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-71ca1632-180b-48b2-b2a4-38e4770e8b00 tempest-ServersTestJSON-675990056 tempest-ServersTestJSON-675990056-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:03:41.484041 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-e60d994b-7f70-4e7c-8e40-19f0bcfcd875 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:03:41.484933 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-71ca1632-180b-48b2-b2a4-38e4770e8b00 tempest-ServersTestJSON-675990056 tempest-ServersTestJSON-675990056-project] [instance: 6e82d040-bcc6-473e-b202-bf13829baf2c] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:03:41.485358 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-e60d994b-7f70-4e7c-8e40-19f0bcfcd875 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] [instance: 992f5ec5-d256-4870-b16d-fc8d9adbd3e7] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:03:41.497123 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-e60d994b-7f70-4e7c-8e40-19f0bcfcd875 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:03:41.497815 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-e60d994b-7f70-4e7c-8e40-19f0bcfcd875 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:03:41.499016 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-e60d994b-7f70-4e7c-8e40-19f0bcfcd875 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:03:41.500430 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-e60d994b-7f70-4e7c-8e40-19f0bcfcd875 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:03:41.502410 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-e60d994b-7f70-4e7c-8e40-19f0bcfcd875 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:03:41.504747 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-e60d994b-7f70-4e7c-8e40-19f0bcfcd875 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:03:41.517171 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-71ca1632-180b-48b2-b2a4-38e4770e8b00 tempest-ServersTestJSON-675990056 tempest-ServersTestJSON-675990056-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:03:41.521272 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-71ca1632-180b-48b2-b2a4-38e4770e8b00 tempest-ServersTestJSON-675990056 tempest-ServersTestJSON-675990056-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:03:41.522065 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-71ca1632-180b-48b2-b2a4-38e4770e8b00 tempest-ServersTestJSON-675990056 tempest-ServersTestJSON-675990056-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:03:41.524948 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-71ca1632-180b-48b2-b2a4-38e4770e8b00 tempest-ServersTestJSON-675990056 tempest-ServersTestJSON-675990056-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:03:41.528262 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-71ca1632-180b-48b2-b2a4-38e4770e8b00 tempest-ServersTestJSON-675990056 tempest-ServersTestJSON-675990056-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:03:41.529433 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-71ca1632-180b-48b2-b2a4-38e4770e8b00 tempest-ServersTestJSON-675990056 tempest-ServersTestJSON-675990056-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:03:41.910334 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-e60d994b-7f70-4e7c-8e40-19f0bcfcd875 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb496b3faac4abbae73d389f2042e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e2520220d454764b8c139a58d78ac83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:03:41.926684 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-e60d994b-7f70-4e7c-8e40-19f0bcfcd875 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] 10.222.0.13 "GET /compute/v2.1/servers/992f5ec5-d256-4870-b16d-fc8d9adbd3e7" status: 200 len: 1473 microversion: 2.1 time: 0.447154 Nov 01 19:03:41.927891 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1289/2550] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:03:41 2022] GET /compute/v2.1/servers/992f5ec5-d256-4870-b16d-fc8d9adbd3e7 => generated 1473 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:03:41.975227 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-71ca1632-180b-48b2-b2a4-38e4770e8b00 tempest-ServersTestJSON-675990056 tempest-ServersTestJSON-675990056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71d26d92020b4d4aab9f82d174e1ba9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3dd3fba10d740c9bc38b10dca3007aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:03:41.989947 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-71ca1632-180b-48b2-b2a4-38e4770e8b00 tempest-ServersTestJSON-675990056 tempest-ServersTestJSON-675990056-project] 10.222.0.13 "GET /compute/v2.1/servers/6e82d040-bcc6-473e-b202-bf13829baf2c" status: 200 len: 1699 microversion: 2.1 time: 0.510455 Nov 01 19:03:41.990861 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1262/2551] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:03:41 2022] GET /compute/v2.1/servers/6e82d040-bcc6-473e-b202-bf13829baf2c => generated 1699 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:03:42.026986 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-64c889e7-9cec-4839-b2fc-6224d6b12659 tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:03:42.027495 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-64c889e7-9cec-4839-b2fc-6224d6b12659 tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] [instance: 12b6a241-81e5-4cb3-b138-ca28f4018732] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:03:42.034321 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-2230d750-6545-478f-86bb-315253ea8069 tempest-ServersAdminNegativeTestJSON-824756592 tempest-ServersAdminNegativeTestJSON-824756592-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:03:42.034932 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-2230d750-6545-478f-86bb-315253ea8069 tempest-ServersAdminNegativeTestJSON-824756592 tempest-ServersAdminNegativeTestJSON-824756592-project] [instance: 51f5bec0-bd00-4ef2-9424-0dad025c8e29] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:03:42.057005 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2230d750-6545-478f-86bb-315253ea8069 tempest-ServersAdminNegativeTestJSON-824756592 tempest-ServersAdminNegativeTestJSON-824756592-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:03:42.057557 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2230d750-6545-478f-86bb-315253ea8069 tempest-ServersAdminNegativeTestJSON-824756592 tempest-ServersAdminNegativeTestJSON-824756592-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:03:42.057997 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2230d750-6545-478f-86bb-315253ea8069 tempest-ServersAdminNegativeTestJSON-824756592 tempest-ServersAdminNegativeTestJSON-824756592-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:03:42.058728 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2230d750-6545-478f-86bb-315253ea8069 tempest-ServersAdminNegativeTestJSON-824756592 tempest-ServersAdminNegativeTestJSON-824756592-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:03:42.059193 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2230d750-6545-478f-86bb-315253ea8069 tempest-ServersAdminNegativeTestJSON-824756592 tempest-ServersAdminNegativeTestJSON-824756592-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:03:42.059601 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2230d750-6545-478f-86bb-315253ea8069 tempest-ServersAdminNegativeTestJSON-824756592 tempest-ServersAdminNegativeTestJSON-824756592-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:03:42.060122 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-64c889e7-9cec-4839-b2fc-6224d6b12659 tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:03:42.061045 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-64c889e7-9cec-4839-b2fc-6224d6b12659 tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:03:42.063181 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-64c889e7-9cec-4839-b2fc-6224d6b12659 tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:03:42.064088 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-64c889e7-9cec-4839-b2fc-6224d6b12659 tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:03:42.089493 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-64c889e7-9cec-4839-b2fc-6224d6b12659 tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.024s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:03:42.089493 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-64c889e7-9cec-4839-b2fc-6224d6b12659 tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:03:43.013145 n-d-863052-2 devstack@n-api.service[121403]: DEBUG dbcounter [-] [121403] Writing DB stats nova_cell0:SELECT=4 {{(pid=121403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 19:03:43.024498 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-64c889e7-9cec-4839-b2fc-6224d6b12659 tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52acef7992d64d378fd8ac333887fd0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af51b8733e984c2ca87df2d8163dedf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:03:43.036512 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-64c889e7-9cec-4839-b2fc-6224d6b12659 tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] 10.222.0.13 "GET /compute/v2.1/servers/12b6a241-81e5-4cb3-b138-ca28f4018732" status: 200 len: 1333 microversion: 2.1 time: 1.011912 Nov 01 19:03:43.038218 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1290/2552] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:03:42 2022] GET /compute/v2.1/servers/12b6a241-81e5-4cb3-b138-ca28f4018732 => generated 1333 bytes in 1015 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:03:43.046505 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-65fdc4e9-3132-4244-a35d-60b41c09e67a tempest-ServersTestBootFromVolume-877599095 tempest-ServersTestBootFromVolume-877599095-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:03:43.047684 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-65fdc4e9-3132-4244-a35d-60b41c09e67a tempest-ServersTestBootFromVolume-877599095 tempest-ServersTestBootFromVolume-877599095-project] [instance: 44cdf0d8-969b-4149-bb03-6bc390977019] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:03:43.058952 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-65fdc4e9-3132-4244-a35d-60b41c09e67a tempest-ServersTestBootFromVolume-877599095 tempest-ServersTestBootFromVolume-877599095-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:03:43.059789 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-65fdc4e9-3132-4244-a35d-60b41c09e67a tempest-ServersTestBootFromVolume-877599095 tempest-ServersTestBootFromVolume-877599095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:03:43.061498 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-65fdc4e9-3132-4244-a35d-60b41c09e67a tempest-ServersTestBootFromVolume-877599095 tempest-ServersTestBootFromVolume-877599095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:03:43.062701 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-65fdc4e9-3132-4244-a35d-60b41c09e67a tempest-ServersTestBootFromVolume-877599095 tempest-ServersTestBootFromVolume-877599095-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:03:43.063441 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-65fdc4e9-3132-4244-a35d-60b41c09e67a tempest-ServersTestBootFromVolume-877599095 tempest-ServersTestBootFromVolume-877599095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:03:43.065070 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-65fdc4e9-3132-4244-a35d-60b41c09e67a tempest-ServersTestBootFromVolume-877599095 tempest-ServersTestBootFromVolume-877599095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:03:43.097336 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-2230d750-6545-478f-86bb-315253ea8069 tempest-ServersAdminNegativeTestJSON-824756592 tempest-ServersAdminNegativeTestJSON-824756592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0708fb2fc1df4aa9a9697cbc94acf921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '232745bfe2f3445987fedb91098c84eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:03:43.123437 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-2230d750-6545-478f-86bb-315253ea8069 tempest-ServersAdminNegativeTestJSON-824756592 tempest-ServersAdminNegativeTestJSON-824756592-project] 10.222.0.13 "GET /compute/v2.1/servers/51f5bec0-bd00-4ef2-9424-0dad025c8e29" status: 200 len: 1321 microversion: 2.1 time: 1.092126 Nov 01 19:03:43.126801 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1263/2553] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:03:42 2022] GET /compute/v2.1/servers/51f5bec0-bd00-4ef2-9424-0dad025c8e29 => generated 1321 bytes in 1097 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:03:43.148822 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-f216ed45-223a-4522-88be-23397b6c1ee9 tempest-LiveMigrationNegativeTest-570155948 tempest-LiveMigrationNegativeTest-570155948-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:03:43.167658 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-f216ed45-223a-4522-88be-23397b6c1ee9 tempest-LiveMigrationNegativeTest-570155948 tempest-LiveMigrationNegativeTest-570155948-project] [instance: c4f1d50d-c833-4efe-9a6b-15064fbf5b58] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:03:43.202465 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f216ed45-223a-4522-88be-23397b6c1ee9 tempest-LiveMigrationNegativeTest-570155948 tempest-LiveMigrationNegativeTest-570155948-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:03:43.203995 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f216ed45-223a-4522-88be-23397b6c1ee9 tempest-LiveMigrationNegativeTest-570155948 tempest-LiveMigrationNegativeTest-570155948-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:03:43.206747 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f216ed45-223a-4522-88be-23397b6c1ee9 tempest-LiveMigrationNegativeTest-570155948 tempest-LiveMigrationNegativeTest-570155948-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:03:43.208388 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f216ed45-223a-4522-88be-23397b6c1ee9 tempest-LiveMigrationNegativeTest-570155948 tempest-LiveMigrationNegativeTest-570155948-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:03:43.208960 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f216ed45-223a-4522-88be-23397b6c1ee9 tempest-LiveMigrationNegativeTest-570155948 tempest-LiveMigrationNegativeTest-570155948-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:03:43.209398 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f216ed45-223a-4522-88be-23397b6c1ee9 tempest-LiveMigrationNegativeTest-570155948 tempest-LiveMigrationNegativeTest-570155948-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:03:43.231731 n-d-863052-2 devstack@n-api.service[121403]: DEBUG dbcounter [-] [121403] Writing DB stats nova_cell0:SELECT=10 {{(pid=121403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 19:03:43.240640 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.wsgi [None req-f216ed45-223a-4522-88be-23397b6c1ee9 tempest-LiveMigrationNegativeTest-570155948 tempest-LiveMigrationNegativeTest-570155948-project] HTTP exception thrown: Instance c4f1d50d-c833-4efe-9a6b-15064fbf5b58 could not be found. Nov 01 19:03:43.242305 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-f216ed45-223a-4522-88be-23397b6c1ee9 tempest-LiveMigrationNegativeTest-570155948 tempest-LiveMigrationNegativeTest-570155948-project] Request method failure captured: Nov 01 19:03:43.242305 n-d-863052-2 devstack@n-api.service[121402]: request: GET /compute/v2.1/servers/c4f1d50d-c833-4efe-9a6b-15064fbf5b58 HTTP/1.1 Nov 01 19:03:43.242305 n-d-863052-2 devstack@n-api.service[121402]: Accept: application/json Nov 01 19:03:43.242305 n-d-863052-2 devstack@n-api.service[121402]: Accept-Encoding: identity Nov 01 19:03:43.242305 n-d-863052-2 devstack@n-api.service[121402]: Connection: close Nov 01 19:03:43.242305 n-d-863052-2 devstack@n-api.service[121402]: Content-Length: 0 Nov 01 19:03:43.242305 n-d-863052-2 devstack@n-api.service[121402]: Content-Type: application/json Nov 01 19:03:43.242305 n-d-863052-2 devstack@n-api.service[121402]: Host: 10.222.0.13 Nov 01 19:03:43.242305 n-d-863052-2 devstack@n-api.service[121402]: Openstack-System-Scope: None Nov 01 19:03:43.242305 n-d-863052-2 devstack@n-api.service[121402]: User-Agent: python-urllib3/1.26.12 Nov 01 19:03:43.242305 n-d-863052-2 devstack@n-api.service[121402]: X-Auth-Token: gAAAAABjYW1abh9uWgLRBp0RGhICYgBlcywfvjtZ9unCfEL527uEcne4hGyN9N7iUxaQBE2A78GzMhYn29zsvmBwa_d8_ZMXbOoQG20uujCprJiIhvLN7LdznscNc03mCcgep5BrQXlxNjrYlkLSP89Y54fYsPO5DS2B7tFDiW9iINjzcYsOb10 Nov 01 19:03:43.242305 n-d-863052-2 devstack@n-api.service[121402]: X-Domain-Id: None Nov 01 19:03:43.242305 n-d-863052-2 devstack@n-api.service[121402]: X-Domain-Name: None Nov 01 19:03:43.242305 n-d-863052-2 devstack@n-api.service[121402]: X-Identity-Status: Confirmed Nov 01 19:03:43.242305 n-d-863052-2 devstack@n-api.service[121402]: X-Is-Admin-Project: True Nov 01 19:03:43.242305 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Domain-Id: default Nov 01 19:03:43.242305 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Domain-Name: Default Nov 01 19:03:43.242305 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Id: faa1bc7c9d564b0ebc9ecf0a2994f2d8 Nov 01 19:03:43.242305 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Name: tempest-LiveMigrationNegativeTest-570155948 Nov 01 19:03:43.242305 n-d-863052-2 devstack@n-api.service[121402]: X-Role: member,reader Nov 01 19:03:43.242305 n-d-863052-2 devstack@n-api.service[121402]: X-Roles: member,reader Nov 01 19:03:43.242305 n-d-863052-2 devstack@n-api.service[121402]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/faa1bc7c9d564b0ebc9ecf0a2994f2d8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/faa1bc7c9d564b0ebc9ecf0a2994f2d8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_faa1bc7c9d564b0ebc9ecf0a2994f2d8", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/faa1bc7c9d564b0ebc9ecf0a2994f2d8"}]}] Nov 01 19:03:43.242305 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant: tempest-LiveMigrationNegativeTest-570155948 Nov 01 19:03:43.242305 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant-Id: faa1bc7c9d564b0ebc9ecf0a2994f2d8 Nov 01 19:03:43.242305 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-570155948 Nov 01 19:03:43.242305 n-d-863052-2 devstack@n-api.service[121402]: X-User: tempest-LiveMigrationNegativeTest-570155948-project Nov 01 19:03:43.242305 n-d-863052-2 devstack@n-api.service[121402]: X-User-Domain-Id: default Nov 01 19:03:43.242305 n-d-863052-2 devstack@n-api.service[121402]: X-User-Domain-Name: Default Nov 01 19:03:43.242305 n-d-863052-2 devstack@n-api.service[121402]: X-User-Id: 4c14605afbc5445d9763db185a1305d4 Nov 01 19:03:43.242305 n-d-863052-2 devstack@n-api.service[121402]: X-User-Name: tempest-LiveMigrationNegativeTest-570155948-project Nov 01 19:03:43.242305 n-d-863052-2 devstack@n-api.service[121402]: method: > Nov 01 19:03:43.242305 n-d-863052-2 devstack@n-api.service[121402]: exception: Instance c4f1d50d-c833-4efe-9a6b-15064fbf5b58 could not be found. Nov 01 19:03:43.242305 n-d-863052-2 devstack@n-api.service[121402]: action_args: {'id': 'c4f1d50d-c833-4efe-9a6b-15064fbf5b58'} Nov 01 19:03:43.242305 n-d-863052-2 devstack@n-api.service[121402]: {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 01 19:03:43.242305 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:03:43.242305 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 01 19:03:43.242305 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 01 19:03:43.242305 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 01 19:03:43.242305 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 01 19:03:43.242305 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 01 19:03:43.242305 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 01 19:03:43.242305 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 01 19:03:43.242305 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 01 19:03:43.242305 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c4f1d50d-c833-4efe-9a6b-15064fbf5b58 could not be found. Nov 01 19:03:43.242305 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:03:43.242305 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:03:43.242305 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:03:43.242305 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:03:43.242305 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:03:43.242305 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:03:43.242305 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 01 19:03:43.242305 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 01 19:03:43.242305 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 01 19:03:43.242305 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 01 19:03:43.242305 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 01 19:03:43.242305 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 01 19:03:43.242305 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 01 19:03:43.242305 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 01 19:03:43.242305 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 01 19:03:43.242305 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 01 19:03:43.242305 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c4f1d50d-c833-4efe-9a6b-15064fbf5b58 could not be found. Nov 01 19:03:43.242305 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:03:43.242305 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:03:43.242305 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:03:43.245795 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:03:43.245795 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:03:43.245795 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:03:43.245795 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 01 19:03:43.245795 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 01 19:03:43.245795 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c4f1d50d-c833-4efe-9a6b-15064fbf5b58 could not be found. Nov 01 19:03:43.245795 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:03:43.245795 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-f216ed45-223a-4522-88be-23397b6c1ee9 tempest-LiveMigrationNegativeTest-570155948 tempest-LiveMigrationNegativeTest-570155948-project] Returning 404 to user: Instance c4f1d50d-c833-4efe-9a6b-15064fbf5b58 could not be found. {{(pid=121402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 01 19:03:43.245795 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-f216ed45-223a-4522-88be-23397b6c1ee9 tempest-LiveMigrationNegativeTest-570155948 tempest-LiveMigrationNegativeTest-570155948-project] 10.222.0.13 "GET /compute/v2.1/servers/c4f1d50d-c833-4efe-9a6b-15064fbf5b58" status: 404 len: 111 microversion: 2.1 time: 0.114524 Nov 01 19:03:43.245795 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1264/2554] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:03:43 2022] GET /compute/v2.1/servers/c4f1d50d-c833-4efe-9a6b-15064fbf5b58 => generated 111 bytes in 117 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 01 19:03:43.282708 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-8d876e35-daf1-41d8-b4fa-272158285272 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:03:43.290178 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-8d876e35-daf1-41d8-b4fa-272158285272 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] [instance: 992f5ec5-d256-4870-b16d-fc8d9adbd3e7] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:03:43.307170 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-8d876e35-daf1-41d8-b4fa-272158285272 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:03:43.307981 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-8d876e35-daf1-41d8-b4fa-272158285272 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:03:43.308416 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-8d876e35-daf1-41d8-b4fa-272158285272 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:03:43.310122 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-8d876e35-daf1-41d8-b4fa-272158285272 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:03:43.311067 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-8d876e35-daf1-41d8-b4fa-272158285272 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:03:43.313036 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-8d876e35-daf1-41d8-b4fa-272158285272 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:03:43.394506 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-65fdc4e9-3132-4244-a35d-60b41c09e67a tempest-ServersTestBootFromVolume-877599095 tempest-ServersTestBootFromVolume-877599095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed2352ce53fc4045adde8cd81b78b3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651046528c204df299ca3d14c44b4a7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:03:43.409709 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-65fdc4e9-3132-4244-a35d-60b41c09e67a tempest-ServersTestBootFromVolume-877599095 tempest-ServersTestBootFromVolume-877599095-project] 10.222.0.13 "GET /compute/v2.1/servers/44cdf0d8-969b-4149-bb03-6bc390977019" status: 200 len: 1251 microversion: 2.1 time: 0.369094 Nov 01 19:03:43.411653 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1291/2555] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:03:43 2022] GET /compute/v2.1/servers/44cdf0d8-969b-4149-bb03-6bc390977019 => generated 1251 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:03:43.424170 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-0afda66d-d6c7-4b93-b929-91deb09de8d9 tempest-ServersTestJSON-675990056 tempest-ServersTestJSON-675990056-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:03:43.426325 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-0afda66d-d6c7-4b93-b929-91deb09de8d9 tempest-ServersTestJSON-675990056 tempest-ServersTestJSON-675990056-project] [instance: 6e82d040-bcc6-473e-b202-bf13829baf2c] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:03:43.443378 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-0afda66d-d6c7-4b93-b929-91deb09de8d9 tempest-ServersTestJSON-675990056 tempest-ServersTestJSON-675990056-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:03:43.444244 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-0afda66d-d6c7-4b93-b929-91deb09de8d9 tempest-ServersTestJSON-675990056 tempest-ServersTestJSON-675990056-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:03:43.445181 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-0afda66d-d6c7-4b93-b929-91deb09de8d9 tempest-ServersTestJSON-675990056 tempest-ServersTestJSON-675990056-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:03:43.447807 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-0afda66d-d6c7-4b93-b929-91deb09de8d9 tempest-ServersTestJSON-675990056 tempest-ServersTestJSON-675990056-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:03:43.448528 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-0afda66d-d6c7-4b93-b929-91deb09de8d9 tempest-ServersTestJSON-675990056 tempest-ServersTestJSON-675990056-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:03:43.451425 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-0afda66d-d6c7-4b93-b929-91deb09de8d9 tempest-ServersTestJSON-675990056 tempest-ServersTestJSON-675990056-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:03:43.788257 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-8d876e35-daf1-41d8-b4fa-272158285272 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb496b3faac4abbae73d389f2042e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e2520220d454764b8c139a58d78ac83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:03:43.796705 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-8d876e35-daf1-41d8-b4fa-272158285272 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] 10.222.0.13 "GET /compute/v2.1/servers/992f5ec5-d256-4870-b16d-fc8d9adbd3e7" status: 200 len: 1479 microversion: 2.1 time: 0.518924 Nov 01 19:03:43.797280 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1265/2556] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:03:43 2022] GET /compute/v2.1/servers/992f5ec5-d256-4870-b16d-fc8d9adbd3e7 => generated 1479 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:03:44.077458 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-17fb6016-6776-410f-b683-1c6ae6e7a9d8 tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:03:44.078623 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-17fb6016-6776-410f-b683-1c6ae6e7a9d8 tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] [instance: 12b6a241-81e5-4cb3-b138-ca28f4018732] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:03:44.090196 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-17fb6016-6776-410f-b683-1c6ae6e7a9d8 tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:03:44.092704 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-17fb6016-6776-410f-b683-1c6ae6e7a9d8 tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:03:44.093535 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-17fb6016-6776-410f-b683-1c6ae6e7a9d8 tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:03:44.094865 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-17fb6016-6776-410f-b683-1c6ae6e7a9d8 tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:03:44.099874 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-17fb6016-6776-410f-b683-1c6ae6e7a9d8 tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:03:44.100988 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-17fb6016-6776-410f-b683-1c6ae6e7a9d8 tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:03:44.181450 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-0afda66d-d6c7-4b93-b929-91deb09de8d9 tempest-ServersTestJSON-675990056 tempest-ServersTestJSON-675990056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71d26d92020b4d4aab9f82d174e1ba9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3dd3fba10d740c9bc38b10dca3007aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:03:44.192277 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-0afda66d-d6c7-4b93-b929-91deb09de8d9 tempest-ServersTestJSON-675990056 tempest-ServersTestJSON-675990056-project] 10.222.0.13 "GET /compute/v2.1/servers/6e82d040-bcc6-473e-b202-bf13829baf2c" status: 200 len: 1699 microversion: 2.1 time: 0.779126 Nov 01 19:03:44.193901 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1292/2557] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:03:43 2022] GET /compute/v2.1/servers/6e82d040-bcc6-473e-b202-bf13829baf2c => generated 1699 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:03:44.202841 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-2874ee72-9223-4810-b1d6-1d4d1fa23eab tempest-ServersAdminNegativeTestJSON-824756592 tempest-ServersAdminNegativeTestJSON-824756592-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:03:44.203464 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-2874ee72-9223-4810-b1d6-1d4d1fa23eab tempest-ServersAdminNegativeTestJSON-824756592 tempest-ServersAdminNegativeTestJSON-824756592-project] [instance: 51f5bec0-bd00-4ef2-9424-0dad025c8e29] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:03:44.228365 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-2874ee72-9223-4810-b1d6-1d4d1fa23eab tempest-ServersAdminNegativeTestJSON-824756592 tempest-ServersAdminNegativeTestJSON-824756592-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:03:44.228897 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-2874ee72-9223-4810-b1d6-1d4d1fa23eab tempest-ServersAdminNegativeTestJSON-824756592 tempest-ServersAdminNegativeTestJSON-824756592-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:03:44.229344 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-2874ee72-9223-4810-b1d6-1d4d1fa23eab tempest-ServersAdminNegativeTestJSON-824756592 tempest-ServersAdminNegativeTestJSON-824756592-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:03:44.230066 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-2874ee72-9223-4810-b1d6-1d4d1fa23eab tempest-ServersAdminNegativeTestJSON-824756592 tempest-ServersAdminNegativeTestJSON-824756592-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:03:44.237066 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-2874ee72-9223-4810-b1d6-1d4d1fa23eab tempest-ServersAdminNegativeTestJSON-824756592 tempest-ServersAdminNegativeTestJSON-824756592-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:03:44.237519 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-2874ee72-9223-4810-b1d6-1d4d1fa23eab tempest-ServersAdminNegativeTestJSON-824756592 tempest-ServersAdminNegativeTestJSON-824756592-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:03:44.609787 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-17fb6016-6776-410f-b683-1c6ae6e7a9d8 tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52acef7992d64d378fd8ac333887fd0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af51b8733e984c2ca87df2d8163dedf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:03:44.620463 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-17fb6016-6776-410f-b683-1c6ae6e7a9d8 tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] 10.222.0.13 "GET /compute/v2.1/servers/12b6a241-81e5-4cb3-b138-ca28f4018732" status: 200 len: 1669 microversion: 2.1 time: 0.556338 Nov 01 19:03:44.621287 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1266/2558] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:03:44 2022] GET /compute/v2.1/servers/12b6a241-81e5-4cb3-b138-ca28f4018732 => generated 1669 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 19:03:44.627316 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-a8de2492-33a9-4b6d-a72d-b37483a86eb1 tempest-ServersTestBootFromVolume-877599095 tempest-ServersTestBootFromVolume-877599095-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:03:44.629839 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-a8de2492-33a9-4b6d-a72d-b37483a86eb1 tempest-ServersTestBootFromVolume-877599095 tempest-ServersTestBootFromVolume-877599095-project] [instance: 44cdf0d8-969b-4149-bb03-6bc390977019] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:03:44.655769 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-a8de2492-33a9-4b6d-a72d-b37483a86eb1 tempest-ServersTestBootFromVolume-877599095 tempest-ServersTestBootFromVolume-877599095-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:03:44.656654 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-a8de2492-33a9-4b6d-a72d-b37483a86eb1 tempest-ServersTestBootFromVolume-877599095 tempest-ServersTestBootFromVolume-877599095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:03:44.658096 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-a8de2492-33a9-4b6d-a72d-b37483a86eb1 tempest-ServersTestBootFromVolume-877599095 tempest-ServersTestBootFromVolume-877599095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:03:44.662308 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-a8de2492-33a9-4b6d-a72d-b37483a86eb1 tempest-ServersTestBootFromVolume-877599095 tempest-ServersTestBootFromVolume-877599095-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:03:44.664659 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-a8de2492-33a9-4b6d-a72d-b37483a86eb1 tempest-ServersTestBootFromVolume-877599095 tempest-ServersTestBootFromVolume-877599095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:03:44.675081 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-a8de2492-33a9-4b6d-a72d-b37483a86eb1 tempest-ServersTestBootFromVolume-877599095 tempest-ServersTestBootFromVolume-877599095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:03:44.825543 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-a8de2492-33a9-4b6d-a72d-b37483a86eb1 tempest-ServersTestBootFromVolume-877599095 tempest-ServersTestBootFromVolume-877599095-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:03:44.825850 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-a8de2492-33a9-4b6d-a72d-b37483a86eb1 tempest-ServersTestBootFromVolume-877599095 tempest-ServersTestBootFromVolume-877599095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:03:44.826395 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-a8de2492-33a9-4b6d-a72d-b37483a86eb1 tempest-ServersTestBootFromVolume-877599095 tempest-ServersTestBootFromVolume-877599095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:03:44.831851 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.objects.instance [None req-a8de2492-33a9-4b6d-a72d-b37483a86eb1 tempest-ServersTestBootFromVolume-877599095 tempest-ServersTestBootFromVolume-877599095-project] Lazy-loading 'fault' on Instance uuid 44cdf0d8-969b-4149-bb03-6bc390977019 {{(pid=121402) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 01 19:03:44.899055 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-2874ee72-9223-4810-b1d6-1d4d1fa23eab tempest-ServersAdminNegativeTestJSON-824756592 tempest-ServersAdminNegativeTestJSON-824756592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0708fb2fc1df4aa9a9697cbc94acf921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '232745bfe2f3445987fedb91098c84eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:03:44.912734 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-2874ee72-9223-4810-b1d6-1d4d1fa23eab tempest-ServersAdminNegativeTestJSON-824756592 tempest-ServersAdminNegativeTestJSON-824756592-project] 10.222.0.13 "GET /compute/v2.1/servers/51f5bec0-bd00-4ef2-9424-0dad025c8e29" status: 200 len: 1321 microversion: 2.1 time: 0.717366 Nov 01 19:03:44.913747 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1293/2559] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:03:44 2022] GET /compute/v2.1/servers/51f5bec0-bd00-4ef2-9424-0dad025c8e29 => generated 1321 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:03:44.929420 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-d4647802-c1e0-4591-bf91-0c0665f74270 tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:03:44.930001 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-d4647802-c1e0-4591-bf91-0c0665f74270 tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] [instance: 12b6a241-81e5-4cb3-b138-ca28f4018732] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:03:44.946826 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d4647802-c1e0-4591-bf91-0c0665f74270 tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:03:44.952101 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d4647802-c1e0-4591-bf91-0c0665f74270 tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:03:44.952844 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d4647802-c1e0-4591-bf91-0c0665f74270 tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:03:44.954621 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d4647802-c1e0-4591-bf91-0c0665f74270 tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:03:44.960055 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d4647802-c1e0-4591-bf91-0c0665f74270 tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:03:44.963698 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d4647802-c1e0-4591-bf91-0c0665f74270 tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:03:44.995192 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-a8de2492-33a9-4b6d-a72d-b37483a86eb1 tempest-ServersTestBootFromVolume-877599095 tempest-ServersTestBootFromVolume-877599095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed2352ce53fc4045adde8cd81b78b3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651046528c204df299ca3d14c44b4a7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:03:45.011732 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-a8de2492-33a9-4b6d-a72d-b37483a86eb1 tempest-ServersTestBootFromVolume-877599095 tempest-ServersTestBootFromVolume-877599095-project] 10.222.0.13 "GET /compute/v2.1/servers/44cdf0d8-969b-4149-bb03-6bc390977019" status: 200 len: 1256 microversion: 2.1 time: 0.386541 Nov 01 19:03:45.012998 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1267/2560] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:03:44 2022] GET /compute/v2.1/servers/44cdf0d8-969b-4149-bb03-6bc390977019 => generated 1256 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:03:45.025029 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-62d680c7-8007-4302-9acc-034a127b7a79 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:03:45.025626 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-62d680c7-8007-4302-9acc-034a127b7a79 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] [instance: 992f5ec5-d256-4870-b16d-fc8d9adbd3e7] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:03:45.042106 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-62d680c7-8007-4302-9acc-034a127b7a79 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:03:45.043881 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-62d680c7-8007-4302-9acc-034a127b7a79 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:03:45.044478 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-62d680c7-8007-4302-9acc-034a127b7a79 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:03:45.045233 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-d4647802-c1e0-4591-bf91-0c0665f74270 tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] 10.222.0.13 "GET /compute/v2.1/servers/12b6a241-81e5-4cb3-b138-ca28f4018732/ips" status: 200 len: 180 microversion: 2.1 time: 0.130141 Nov 01 19:03:45.045834 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1294/2561] 10.222.0.13 () {58 vars in 1248 bytes} [Tue Nov 1 19:03:44 2022] GET /compute/v2.1/servers/12b6a241-81e5-4cb3-b138-ca28f4018732/ips => generated 180 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:03:45.046953 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-62d680c7-8007-4302-9acc-034a127b7a79 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:03:45.049512 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-62d680c7-8007-4302-9acc-034a127b7a79 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:03:45.051132 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-62d680c7-8007-4302-9acc-034a127b7a79 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:03:45.063028 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-98b2a0ab-7cce-40a7-adf9-6b6d8c5f9709 tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:03:45.063520 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-98b2a0ab-7cce-40a7-adf9-6b6d8c5f9709 tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] [instance: 12b6a241-81e5-4cb3-b138-ca28f4018732] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:03:45.084621 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-98b2a0ab-7cce-40a7-adf9-6b6d8c5f9709 tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:03:45.085295 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-98b2a0ab-7cce-40a7-adf9-6b6d8c5f9709 tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:03:45.087950 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-98b2a0ab-7cce-40a7-adf9-6b6d8c5f9709 tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:03:45.088984 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-98b2a0ab-7cce-40a7-adf9-6b6d8c5f9709 tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:03:45.089619 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-98b2a0ab-7cce-40a7-adf9-6b6d8c5f9709 tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:03:45.091641 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-98b2a0ab-7cce-40a7-adf9-6b6d8c5f9709 tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:03:45.222572 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-98b2a0ab-7cce-40a7-adf9-6b6d8c5f9709 tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] [instance: 12b6a241-81e5-4cb3-b138-ca28f4018732] Going to try to terminate instance {{(pid=121403) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 01 19:03:45.447521 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-98b2a0ab-7cce-40a7-adf9-6b6d8c5f9709 tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] 10.222.0.13 "DELETE /compute/v2.1/servers/12b6a241-81e5-4cb3-b138-ca28f4018732" status: 204 len: 0 microversion: 2.1 time: 0.388427 Nov 01 19:03:45.448464 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1295/2562] 10.222.0.13 () {58 vars in 1239 bytes} [Tue Nov 1 19:03:45 2022] DELETE /compute/v2.1/servers/12b6a241-81e5-4cb3-b138-ca28f4018732 => generated 0 bytes in 390 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 01 19:03:45.458209 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-4aa57162-1734-4900-a70d-aa00f74b3931 tempest-ServersTestJSON-675990056 tempest-ServersTestJSON-675990056-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:03:45.461170 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-4aa57162-1734-4900-a70d-aa00f74b3931 tempest-ServersTestJSON-675990056 tempest-ServersTestJSON-675990056-project] [instance: 6e82d040-bcc6-473e-b202-bf13829baf2c] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:03:45.482976 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-4aa57162-1734-4900-a70d-aa00f74b3931 tempest-ServersTestJSON-675990056 tempest-ServersTestJSON-675990056-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:03:45.484668 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-4aa57162-1734-4900-a70d-aa00f74b3931 tempest-ServersTestJSON-675990056 tempest-ServersTestJSON-675990056-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:03:45.485118 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-4aa57162-1734-4900-a70d-aa00f74b3931 tempest-ServersTestJSON-675990056 tempest-ServersTestJSON-675990056-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:03:45.489711 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-4aa57162-1734-4900-a70d-aa00f74b3931 tempest-ServersTestJSON-675990056 tempest-ServersTestJSON-675990056-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:03:45.491059 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-4aa57162-1734-4900-a70d-aa00f74b3931 tempest-ServersTestJSON-675990056 tempest-ServersTestJSON-675990056-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:03:45.491513 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-4aa57162-1734-4900-a70d-aa00f74b3931 tempest-ServersTestJSON-675990056 tempest-ServersTestJSON-675990056-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:03:45.721799 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-4aa57162-1734-4900-a70d-aa00f74b3931 tempest-ServersTestJSON-675990056 tempest-ServersTestJSON-675990056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71d26d92020b4d4aab9f82d174e1ba9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3dd3fba10d740c9bc38b10dca3007aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:03:45.759888 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-4aa57162-1734-4900-a70d-aa00f74b3931 tempest-ServersTestJSON-675990056 tempest-ServersTestJSON-675990056-project] 10.222.0.13 "GET /compute/v2.1/servers/6e82d040-bcc6-473e-b202-bf13829baf2c" status: 200 len: 1631 microversion: 2.1 time: 0.309920 Nov 01 19:03:45.764422 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1296/2563] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:03:45 2022] GET /compute/v2.1/servers/6e82d040-bcc6-473e-b202-bf13829baf2c => generated 1631 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:03:45.774653 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-332dc3f2-c1b6-4542-832e-7226429a98f8 tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:03:45.775266 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-332dc3f2-c1b6-4542-832e-7226429a98f8 tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] [instance: 12b6a241-81e5-4cb3-b138-ca28f4018732] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:03:45.812947 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-332dc3f2-c1b6-4542-832e-7226429a98f8 tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:03:45.819233 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-62d680c7-8007-4302-9acc-034a127b7a79 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb496b3faac4abbae73d389f2042e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e2520220d454764b8c139a58d78ac83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:03:45.823777 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-332dc3f2-c1b6-4542-832e-7226429a98f8 tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:03:45.830657 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-332dc3f2-c1b6-4542-832e-7226429a98f8 tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:03:45.832512 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-332dc3f2-c1b6-4542-832e-7226429a98f8 tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:03:45.835064 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-62d680c7-8007-4302-9acc-034a127b7a79 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] 10.222.0.13 "GET /compute/v2.1/servers/992f5ec5-d256-4870-b16d-fc8d9adbd3e7" status: 200 len: 1479 microversion: 2.1 time: 0.820979 Nov 01 19:03:45.835866 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-332dc3f2-c1b6-4542-832e-7226429a98f8 tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:03:45.837247 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-332dc3f2-c1b6-4542-832e-7226429a98f8 tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:03:45.855962 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1268/2564] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:03:45 2022] GET /compute/v2.1/servers/992f5ec5-d256-4870-b16d-fc8d9adbd3e7 => generated 1479 bytes in 842 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:03:45.873401 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [req-c17edac3-24e8-40c5-b990-7a2e1ff83a64 req-114439d8-2458-4905-9c63-75f5ca261346 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e82d040-bcc6-473e-b202-bf13829baf2c", "name": "network-vif-deleted", "tag": "41d8c6fe-f524-41af-9f6e-4b23fdeb1e57"}]} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:03:45.908198 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-c17edac3-24e8-40c5-b990-7a2e1ff83a64 req-114439d8-2458-4905-9c63-75f5ca261346 service nova] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:03:45.908855 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-c17edac3-24e8-40c5-b990-7a2e1ff83a64 req-114439d8-2458-4905-9c63-75f5ca261346 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:03:45.909888 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-c17edac3-24e8-40c5-b990-7a2e1ff83a64 req-114439d8-2458-4905-9c63-75f5ca261346 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:03:45.915397 n-d-863052-2 devstack@n-api.service[121402]: DEBUG dbcounter [-] [121402] Writing DB stats nova_cell1:SELECT=100 {{(pid=121402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 19:03:45.930047 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.compute.server_external_events [req-c17edac3-24e8-40c5-b990-7a2e1ff83a64 req-114439d8-2458-4905-9c63-75f5ca261346 service nova] Creating event network-vif-deleted:41d8c6fe-f524-41af-9f6e-4b23fdeb1e57 for instance 6e82d040-bcc6-473e-b202-bf13829baf2c on n-h2-863052-2 Nov 01 19:03:45.950988 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [req-c17edac3-24e8-40c5-b990-7a2e1ff83a64 req-114439d8-2458-4905-9c63-75f5ca261346 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086706 Nov 01 19:03:45.952798 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1269/2565] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Nov 1 19:03:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:03:45.958815 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-b868c50a-a550-4724-b736-3b09f43728ad tempest-ServersAdminNegativeTestJSON-824756592 tempest-ServersAdminNegativeTestJSON-824756592-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:03:45.961360 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-b868c50a-a550-4724-b736-3b09f43728ad tempest-ServersAdminNegativeTestJSON-824756592 tempest-ServersAdminNegativeTestJSON-824756592-project] [instance: 51f5bec0-bd00-4ef2-9424-0dad025c8e29] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:03:45.978121 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b868c50a-a550-4724-b736-3b09f43728ad tempest-ServersAdminNegativeTestJSON-824756592 tempest-ServersAdminNegativeTestJSON-824756592-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:03:45.978896 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b868c50a-a550-4724-b736-3b09f43728ad tempest-ServersAdminNegativeTestJSON-824756592 tempest-ServersAdminNegativeTestJSON-824756592-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:03:45.979494 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b868c50a-a550-4724-b736-3b09f43728ad tempest-ServersAdminNegativeTestJSON-824756592 tempest-ServersAdminNegativeTestJSON-824756592-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:03:45.980349 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b868c50a-a550-4724-b736-3b09f43728ad tempest-ServersAdminNegativeTestJSON-824756592 tempest-ServersAdminNegativeTestJSON-824756592-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:03:45.980983 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b868c50a-a550-4724-b736-3b09f43728ad tempest-ServersAdminNegativeTestJSON-824756592 tempest-ServersAdminNegativeTestJSON-824756592-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:03:45.988722 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b868c50a-a550-4724-b736-3b09f43728ad tempest-ServersAdminNegativeTestJSON-824756592 tempest-ServersAdminNegativeTestJSON-824756592-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:03:46.315525 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-332dc3f2-c1b6-4542-832e-7226429a98f8 tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52acef7992d64d378fd8ac333887fd0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af51b8733e984c2ca87df2d8163dedf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:03:46.338045 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-332dc3f2-c1b6-4542-832e-7226429a98f8 tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] 10.222.0.13 "GET /compute/v2.1/servers/12b6a241-81e5-4cb3-b138-ca28f4018732" status: 200 len: 1675 microversion: 2.1 time: 0.572379 Nov 01 19:03:46.339370 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1297/2566] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:03:45 2022] GET /compute/v2.1/servers/12b6a241-81e5-4cb3-b138-ca28f4018732 => generated 1675 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:03:46.351368 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-16c757cc-7d6a-4bd1-b9d0-69cbaec99fe0 tempest-ServersTestBootFromVolume-877599095 tempest-ServersTestBootFromVolume-877599095-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:03:46.352430 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-16c757cc-7d6a-4bd1-b9d0-69cbaec99fe0 tempest-ServersTestBootFromVolume-877599095 tempest-ServersTestBootFromVolume-877599095-project] [instance: 44cdf0d8-969b-4149-bb03-6bc390977019] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:03:46.361320 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-16c757cc-7d6a-4bd1-b9d0-69cbaec99fe0 tempest-ServersTestBootFromVolume-877599095 tempest-ServersTestBootFromVolume-877599095-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:03:46.362815 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-16c757cc-7d6a-4bd1-b9d0-69cbaec99fe0 tempest-ServersTestBootFromVolume-877599095 tempest-ServersTestBootFromVolume-877599095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:03:46.363480 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-16c757cc-7d6a-4bd1-b9d0-69cbaec99fe0 tempest-ServersTestBootFromVolume-877599095 tempest-ServersTestBootFromVolume-877599095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:03:46.365454 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-16c757cc-7d6a-4bd1-b9d0-69cbaec99fe0 tempest-ServersTestBootFromVolume-877599095 tempest-ServersTestBootFromVolume-877599095-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:03:46.366173 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-16c757cc-7d6a-4bd1-b9d0-69cbaec99fe0 tempest-ServersTestBootFromVolume-877599095 tempest-ServersTestBootFromVolume-877599095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:03:46.366860 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-16c757cc-7d6a-4bd1-b9d0-69cbaec99fe0 tempest-ServersTestBootFromVolume-877599095 tempest-ServersTestBootFromVolume-877599095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:03:46.427377 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.wsgi [None req-16c757cc-7d6a-4bd1-b9d0-69cbaec99fe0 tempest-ServersTestBootFromVolume-877599095 tempest-ServersTestBootFromVolume-877599095-project] HTTP exception thrown: Instance 44cdf0d8-969b-4149-bb03-6bc390977019 could not be found. Nov 01 19:03:46.433518 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-16c757cc-7d6a-4bd1-b9d0-69cbaec99fe0 tempest-ServersTestBootFromVolume-877599095 tempest-ServersTestBootFromVolume-877599095-project] Request method failure captured: Nov 01 19:03:46.433518 n-d-863052-2 devstack@n-api.service[121403]: request: GET /compute/v2.1/servers/44cdf0d8-969b-4149-bb03-6bc390977019 HTTP/1.1 Nov 01 19:03:46.433518 n-d-863052-2 devstack@n-api.service[121403]: Accept: application/json Nov 01 19:03:46.433518 n-d-863052-2 devstack@n-api.service[121403]: Accept-Encoding: identity Nov 01 19:03:46.433518 n-d-863052-2 devstack@n-api.service[121403]: Connection: close Nov 01 19:03:46.433518 n-d-863052-2 devstack@n-api.service[121403]: Content-Length: 0 Nov 01 19:03:46.433518 n-d-863052-2 devstack@n-api.service[121403]: Content-Type: application/json Nov 01 19:03:46.433518 n-d-863052-2 devstack@n-api.service[121403]: Host: 10.222.0.13 Nov 01 19:03:46.433518 n-d-863052-2 devstack@n-api.service[121403]: Openstack-System-Scope: None Nov 01 19:03:46.433518 n-d-863052-2 devstack@n-api.service[121403]: User-Agent: python-urllib3/1.26.12 Nov 01 19:03:46.433518 n-d-863052-2 devstack@n-api.service[121403]: X-Auth-Token: gAAAAABjYW0AsST3do2Xhsxzj3hnJyGJkZStqbbaCt63Ek02WOA352koI-YNON9pQTecVAG23fy5PXaze0w0C2q2xqymO6dR3DDMkx5Kl0ad5_-Bh1lDbIa1s1V4ZIP6f6MKFju8TX6jnP3JHoicHZtBqNxdxo75M6bJ7cFCFBjVFnQ4EkjIiiw Nov 01 19:03:46.433518 n-d-863052-2 devstack@n-api.service[121403]: X-Domain-Id: None Nov 01 19:03:46.433518 n-d-863052-2 devstack@n-api.service[121403]: X-Domain-Name: None Nov 01 19:03:46.433518 n-d-863052-2 devstack@n-api.service[121403]: X-Identity-Status: Confirmed Nov 01 19:03:46.433518 n-d-863052-2 devstack@n-api.service[121403]: X-Is-Admin-Project: True Nov 01 19:03:46.433518 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Domain-Id: default Nov 01 19:03:46.433518 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Domain-Name: Default Nov 01 19:03:46.433518 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Id: 651046528c204df299ca3d14c44b4a7a Nov 01 19:03:46.433518 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Name: tempest-ServersTestBootFromVolume-877599095 Nov 01 19:03:46.433518 n-d-863052-2 devstack@n-api.service[121403]: X-Role: member,reader Nov 01 19:03:46.433518 n-d-863052-2 devstack@n-api.service[121403]: X-Roles: member,reader Nov 01 19:03:46.433518 n-d-863052-2 devstack@n-api.service[121403]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/651046528c204df299ca3d14c44b4a7a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/651046528c204df299ca3d14c44b4a7a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_651046528c204df299ca3d14c44b4a7a", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/651046528c204df299ca3d14c44b4a7a"}]}] Nov 01 19:03:46.433518 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant: tempest-ServersTestBootFromVolume-877599095 Nov 01 19:03:46.433518 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant-Id: 651046528c204df299ca3d14c44b4a7a Nov 01 19:03:46.433518 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant-Name: tempest-ServersTestBootFromVolume-877599095 Nov 01 19:03:46.433518 n-d-863052-2 devstack@n-api.service[121403]: X-User: tempest-ServersTestBootFromVolume-877599095-project Nov 01 19:03:46.433518 n-d-863052-2 devstack@n-api.service[121403]: X-User-Domain-Id: default Nov 01 19:03:46.433518 n-d-863052-2 devstack@n-api.service[121403]: X-User-Domain-Name: Default Nov 01 19:03:46.433518 n-d-863052-2 devstack@n-api.service[121403]: X-User-Id: ed2352ce53fc4045adde8cd81b78b3ed Nov 01 19:03:46.433518 n-d-863052-2 devstack@n-api.service[121403]: X-User-Name: tempest-ServersTestBootFromVolume-877599095-project Nov 01 19:03:46.433518 n-d-863052-2 devstack@n-api.service[121403]: method: > Nov 01 19:03:46.433518 n-d-863052-2 devstack@n-api.service[121403]: exception: Instance 44cdf0d8-969b-4149-bb03-6bc390977019 could not be found. Nov 01 19:03:46.433518 n-d-863052-2 devstack@n-api.service[121403]: action_args: {'id': '44cdf0d8-969b-4149-bb03-6bc390977019'} Nov 01 19:03:46.433518 n-d-863052-2 devstack@n-api.service[121403]: {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 01 19:03:46.433518 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:03:46.433518 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 01 19:03:46.433518 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 01 19:03:46.433518 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 01 19:03:46.433518 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 01 19:03:46.433518 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 01 19:03:46.433518 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 01 19:03:46.433518 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 01 19:03:46.433518 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 01 19:03:46.433518 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 44cdf0d8-969b-4149-bb03-6bc390977019 could not be found. Nov 01 19:03:46.433518 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:03:46.433518 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:03:46.433518 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:03:46.433518 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:03:46.433518 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:03:46.433518 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:03:46.433518 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 01 19:03:46.433518 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 01 19:03:46.433518 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 01 19:03:46.433518 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 01 19:03:46.433518 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 01 19:03:46.433518 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 01 19:03:46.433518 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 01 19:03:46.433518 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 01 19:03:46.433518 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 01 19:03:46.433518 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 01 19:03:46.433518 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 44cdf0d8-969b-4149-bb03-6bc390977019 could not be found. Nov 01 19:03:46.433518 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:03:46.433518 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:03:46.433518 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:03:46.438117 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:03:46.438117 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:03:46.438117 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:03:46.438117 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 01 19:03:46.438117 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 01 19:03:46.438117 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 44cdf0d8-969b-4149-bb03-6bc390977019 could not be found. Nov 01 19:03:46.438117 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:03:46.438117 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-16c757cc-7d6a-4bd1-b9d0-69cbaec99fe0 tempest-ServersTestBootFromVolume-877599095 tempest-ServersTestBootFromVolume-877599095-project] Returning 404 to user: Instance 44cdf0d8-969b-4149-bb03-6bc390977019 could not be found. {{(pid=121403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 01 19:03:46.438817 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-16c757cc-7d6a-4bd1-b9d0-69cbaec99fe0 tempest-ServersTestBootFromVolume-877599095 tempest-ServersTestBootFromVolume-877599095-project] 10.222.0.13 "GET /compute/v2.1/servers/44cdf0d8-969b-4149-bb03-6bc390977019" status: 404 len: 111 microversion: 2.1 time: 0.095448 Nov 01 19:03:46.439283 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1298/2567] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:03:46 2022] GET /compute/v2.1/servers/44cdf0d8-969b-4149-bb03-6bc390977019 => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 01 19:03:46.449615 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-2cf3649d-18ea-4fa8-bfcb-eb8ffae302b5 tempest-ServersTestBootFromVolume-877599095 tempest-ServersTestBootFromVolume-877599095-project] Calling method '.version_select at 0x7f0ae2827160>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:03:46.491302 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-2cf3649d-18ea-4fa8-bfcb-eb8ffae302b5 tempest-ServersTestBootFromVolume-877599095 tempest-ServersTestBootFromVolume-877599095-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-871595936" status: 202 len: 0 microversion: 2.1 time: 0.045262 Nov 01 19:03:46.493822 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1299/2568] 10.222.0.13 () {58 vars in 1218 bytes} [Tue Nov 1 19:03:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-871595936 => generated 0 bytes in 49 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 01 19:03:46.712528 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-b868c50a-a550-4724-b736-3b09f43728ad tempest-ServersAdminNegativeTestJSON-824756592 tempest-ServersAdminNegativeTestJSON-824756592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0708fb2fc1df4aa9a9697cbc94acf921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '232745bfe2f3445987fedb91098c84eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:03:46.725604 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-b868c50a-a550-4724-b736-3b09f43728ad tempest-ServersAdminNegativeTestJSON-824756592 tempest-ServersAdminNegativeTestJSON-824756592-project] 10.222.0.13 "GET /compute/v2.1/servers/51f5bec0-bd00-4ef2-9424-0dad025c8e29" status: 200 len: 1321 microversion: 2.1 time: 0.768719 Nov 01 19:03:46.740609 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1270/2569] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:03:45 2022] GET /compute/v2.1/servers/51f5bec0-bd00-4ef2-9424-0dad025c8e29 => generated 1321 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:03:46.788253 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-06dd5110-680b-459f-aa26-bab41f7c561a tempest-ServersTestJSON-675990056 tempest-ServersTestJSON-675990056-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:03:46.789058 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-06dd5110-680b-459f-aa26-bab41f7c561a tempest-ServersTestJSON-675990056 tempest-ServersTestJSON-675990056-project] [instance: 6e82d040-bcc6-473e-b202-bf13829baf2c] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:03:46.805445 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-06dd5110-680b-459f-aa26-bab41f7c561a tempest-ServersTestJSON-675990056 tempest-ServersTestJSON-675990056-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:03:46.809246 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-06dd5110-680b-459f-aa26-bab41f7c561a tempest-ServersTestJSON-675990056 tempest-ServersTestJSON-675990056-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:03:46.809890 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-06dd5110-680b-459f-aa26-bab41f7c561a tempest-ServersTestJSON-675990056 tempest-ServersTestJSON-675990056-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:03:46.810812 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-06dd5110-680b-459f-aa26-bab41f7c561a tempest-ServersTestJSON-675990056 tempest-ServersTestJSON-675990056-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:03:46.815108 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-06dd5110-680b-459f-aa26-bab41f7c561a tempest-ServersTestJSON-675990056 tempest-ServersTestJSON-675990056-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:03:46.816190 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-06dd5110-680b-459f-aa26-bab41f7c561a tempest-ServersTestJSON-675990056 tempest-ServersTestJSON-675990056-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:03:46.840975 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.wsgi [None req-06dd5110-680b-459f-aa26-bab41f7c561a tempest-ServersTestJSON-675990056 tempest-ServersTestJSON-675990056-project] HTTP exception thrown: Instance 6e82d040-bcc6-473e-b202-bf13829baf2c could not be found. Nov 01 19:03:46.842673 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-06dd5110-680b-459f-aa26-bab41f7c561a tempest-ServersTestJSON-675990056 tempest-ServersTestJSON-675990056-project] Request method failure captured: Nov 01 19:03:46.842673 n-d-863052-2 devstack@n-api.service[121403]: request: GET /compute/v2.1/servers/6e82d040-bcc6-473e-b202-bf13829baf2c HTTP/1.1 Nov 01 19:03:46.842673 n-d-863052-2 devstack@n-api.service[121403]: Accept: application/json Nov 01 19:03:46.842673 n-d-863052-2 devstack@n-api.service[121403]: Accept-Encoding: identity Nov 01 19:03:46.842673 n-d-863052-2 devstack@n-api.service[121403]: Connection: close Nov 01 19:03:46.842673 n-d-863052-2 devstack@n-api.service[121403]: Content-Length: 0 Nov 01 19:03:46.842673 n-d-863052-2 devstack@n-api.service[121403]: Content-Type: application/json Nov 01 19:03:46.842673 n-d-863052-2 devstack@n-api.service[121403]: Host: 10.222.0.13 Nov 01 19:03:46.842673 n-d-863052-2 devstack@n-api.service[121403]: Openstack-System-Scope: None Nov 01 19:03:46.842673 n-d-863052-2 devstack@n-api.service[121403]: User-Agent: python-urllib3/1.26.12 Nov 01 19:03:46.842673 n-d-863052-2 devstack@n-api.service[121403]: X-Auth-Token: gAAAAABjYW1MCcA0fMhPb6MAneRSiRkjfHR306_8GpFaXJD4cL-HOL_wJhoW24JDzfNbkc6JuKs-FBblkjYjrGnhSFzZbiW9dnFOictJNEAjl8NeIpDLqPhw7-CFgdYLfCJr3dBjj2xfH979oRnLWrX68n1rG695g-4vZX2h5yjkLPsv8QonyaE Nov 01 19:03:46.842673 n-d-863052-2 devstack@n-api.service[121403]: X-Domain-Id: None Nov 01 19:03:46.842673 n-d-863052-2 devstack@n-api.service[121403]: X-Domain-Name: None Nov 01 19:03:46.842673 n-d-863052-2 devstack@n-api.service[121403]: X-Identity-Status: Confirmed Nov 01 19:03:46.842673 n-d-863052-2 devstack@n-api.service[121403]: X-Is-Admin-Project: True Nov 01 19:03:46.842673 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Domain-Id: default Nov 01 19:03:46.842673 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Domain-Name: Default Nov 01 19:03:46.842673 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Id: c3dd3fba10d740c9bc38b10dca3007aa Nov 01 19:03:46.842673 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Name: tempest-ServersTestJSON-675990056 Nov 01 19:03:46.842673 n-d-863052-2 devstack@n-api.service[121403]: X-Role: member,reader Nov 01 19:03:46.842673 n-d-863052-2 devstack@n-api.service[121403]: X-Roles: member,reader Nov 01 19:03:46.842673 n-d-863052-2 devstack@n-api.service[121403]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/c3dd3fba10d740c9bc38b10dca3007aa"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/c3dd3fba10d740c9bc38b10dca3007aa"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_c3dd3fba10d740c9bc38b10dca3007aa", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/c3dd3fba10d740c9bc38b10dca3007aa"}]}] Nov 01 19:03:46.842673 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant: tempest-ServersTestJSON-675990056 Nov 01 19:03:46.842673 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant-Id: c3dd3fba10d740c9bc38b10dca3007aa Nov 01 19:03:46.842673 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant-Name: tempest-ServersTestJSON-675990056 Nov 01 19:03:46.842673 n-d-863052-2 devstack@n-api.service[121403]: X-User: tempest-ServersTestJSON-675990056-project Nov 01 19:03:46.842673 n-d-863052-2 devstack@n-api.service[121403]: X-User-Domain-Id: default Nov 01 19:03:46.842673 n-d-863052-2 devstack@n-api.service[121403]: X-User-Domain-Name: Default Nov 01 19:03:46.842673 n-d-863052-2 devstack@n-api.service[121403]: X-User-Id: 71d26d92020b4d4aab9f82d174e1ba9d Nov 01 19:03:46.842673 n-d-863052-2 devstack@n-api.service[121403]: X-User-Name: tempest-ServersTestJSON-675990056-project Nov 01 19:03:46.842673 n-d-863052-2 devstack@n-api.service[121403]: method: > Nov 01 19:03:46.842673 n-d-863052-2 devstack@n-api.service[121403]: exception: Instance 6e82d040-bcc6-473e-b202-bf13829baf2c could not be found. Nov 01 19:03:46.842673 n-d-863052-2 devstack@n-api.service[121403]: action_args: {'id': '6e82d040-bcc6-473e-b202-bf13829baf2c'} Nov 01 19:03:46.842673 n-d-863052-2 devstack@n-api.service[121403]: {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 01 19:03:46.842673 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:03:46.842673 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 01 19:03:46.842673 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 01 19:03:46.842673 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 01 19:03:46.842673 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 01 19:03:46.842673 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 01 19:03:46.842673 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 01 19:03:46.842673 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 01 19:03:46.842673 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 01 19:03:46.842673 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6e82d040-bcc6-473e-b202-bf13829baf2c could not be found. Nov 01 19:03:46.842673 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:03:46.842673 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:03:46.842673 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:03:46.842673 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:03:46.842673 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:03:46.842673 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:03:46.842673 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 01 19:03:46.842673 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 01 19:03:46.842673 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 01 19:03:46.842673 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 01 19:03:46.842673 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 01 19:03:46.842673 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 01 19:03:46.842673 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 01 19:03:46.842673 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 01 19:03:46.842673 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 01 19:03:46.842673 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 01 19:03:46.842673 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6e82d040-bcc6-473e-b202-bf13829baf2c could not be found. Nov 01 19:03:46.842673 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:03:46.842673 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:03:46.842673 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:03:46.842673 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:03:46.846324 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:03:46.846324 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:03:46.846324 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 01 19:03:46.846324 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 01 19:03:46.846324 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6e82d040-bcc6-473e-b202-bf13829baf2c could not be found. Nov 01 19:03:46.846324 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:03:46.848618 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-06dd5110-680b-459f-aa26-bab41f7c561a tempest-ServersTestJSON-675990056 tempest-ServersTestJSON-675990056-project] Returning 404 to user: Instance 6e82d040-bcc6-473e-b202-bf13829baf2c could not be found. {{(pid=121403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 01 19:03:46.849703 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-06dd5110-680b-459f-aa26-bab41f7c561a tempest-ServersTestJSON-675990056 tempest-ServersTestJSON-675990056-project] 10.222.0.13 "GET /compute/v2.1/servers/6e82d040-bcc6-473e-b202-bf13829baf2c" status: 404 len: 111 microversion: 2.1 time: 0.066203 Nov 01 19:03:46.850765 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1300/2570] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:03:46 2022] GET /compute/v2.1/servers/6e82d040-bcc6-473e-b202-bf13829baf2c => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 01 19:03:46.859416 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-1891c8d8-6549-4a96-8314-7afbd5659dd6 tempest-ServersTestJSON-675990056 tempest-ServersTestJSON-675990056-project] Calling method '.version_select at 0x7f0ae1aa8280>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:03:46.879221 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-b6422327-657d-442a-9a97-788479e1dbe1 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:03:46.888920 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-b6422327-657d-442a-9a97-788479e1dbe1 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] [instance: 992f5ec5-d256-4870-b16d-fc8d9adbd3e7] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:03:46.911986 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-b6422327-657d-442a-9a97-788479e1dbe1 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:03:46.912492 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-b6422327-657d-442a-9a97-788479e1dbe1 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:03:46.913060 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-b6422327-657d-442a-9a97-788479e1dbe1 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:03:46.918306 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-1891c8d8-6549-4a96-8314-7afbd5659dd6 tempest-ServersTestJSON-675990056 tempest-ServersTestJSON-675990056-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-80750042" status: 202 len: 0 microversion: 2.1 time: 0.063329 Nov 01 19:03:46.921971 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1271/2571] 10.222.0.13 () {58 vars in 1215 bytes} [Tue Nov 1 19:03:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-80750042 => generated 0 bytes in 65 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 01 19:03:46.922116 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-b6422327-657d-442a-9a97-788479e1dbe1 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:03:46.925340 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-b6422327-657d-442a-9a97-788479e1dbe1 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:03:46.927647 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-b6422327-657d-442a-9a97-788479e1dbe1 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:03:46.939692 n-d-863052-2 devstack@n-api.service[121403]: DEBUG dbcounter [-] [121403] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=121403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 19:03:47.369837 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-e1cf96c4-fb11-458d-a7fb-dc59ce0a105b tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:03:47.370595 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-e1cf96c4-fb11-458d-a7fb-dc59ce0a105b tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] [instance: 12b6a241-81e5-4cb3-b138-ca28f4018732] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:03:47.388566 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e1cf96c4-fb11-458d-a7fb-dc59ce0a105b tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:03:47.389140 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e1cf96c4-fb11-458d-a7fb-dc59ce0a105b tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:03:47.389880 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e1cf96c4-fb11-458d-a7fb-dc59ce0a105b tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:03:47.390695 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e1cf96c4-fb11-458d-a7fb-dc59ce0a105b tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:03:47.391300 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e1cf96c4-fb11-458d-a7fb-dc59ce0a105b tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:03:47.391800 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e1cf96c4-fb11-458d-a7fb-dc59ce0a105b tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:03:47.481413 n-d-863052-2 devstack@n-api.service[121402]: DEBUG dbcounter [-] [121402] Writing DB stats nova_cell0:SELECT=8 {{(pid=121402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 19:03:47.609430 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-b6422327-657d-442a-9a97-788479e1dbe1 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb496b3faac4abbae73d389f2042e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e2520220d454764b8c139a58d78ac83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:03:47.621383 n-d-863052-2 devstack@n-api.service[121402]: DEBUG dbcounter [-] [121402] Writing DB stats nova_cell0:SELECT=2 {{(pid=121402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 19:03:47.623410 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-b6422327-657d-442a-9a97-788479e1dbe1 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] 10.222.0.13 "GET /compute/v2.1/servers/992f5ec5-d256-4870-b16d-fc8d9adbd3e7" status: 200 len: 1479 microversion: 2.1 time: 0.754864 Nov 01 19:03:47.626104 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1301/2572] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:03:46 2022] GET /compute/v2.1/servers/992f5ec5-d256-4870-b16d-fc8d9adbd3e7 => generated 1479 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:03:47.754380 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-d2e9d001-41ab-46f1-bd09-e32b5da19fb3 tempest-ServersAdminNegativeTestJSON-824756592 tempest-ServersAdminNegativeTestJSON-824756592-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:03:47.755898 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-d2e9d001-41ab-46f1-bd09-e32b5da19fb3 tempest-ServersAdminNegativeTestJSON-824756592 tempest-ServersAdminNegativeTestJSON-824756592-project] [instance: 51f5bec0-bd00-4ef2-9424-0dad025c8e29] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:03:47.772461 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d2e9d001-41ab-46f1-bd09-e32b5da19fb3 tempest-ServersAdminNegativeTestJSON-824756592 tempest-ServersAdminNegativeTestJSON-824756592-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:03:47.773969 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d2e9d001-41ab-46f1-bd09-e32b5da19fb3 tempest-ServersAdminNegativeTestJSON-824756592 tempest-ServersAdminNegativeTestJSON-824756592-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:03:47.776067 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d2e9d001-41ab-46f1-bd09-e32b5da19fb3 tempest-ServersAdminNegativeTestJSON-824756592 tempest-ServersAdminNegativeTestJSON-824756592-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:03:47.780442 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d2e9d001-41ab-46f1-bd09-e32b5da19fb3 tempest-ServersAdminNegativeTestJSON-824756592 tempest-ServersAdminNegativeTestJSON-824756592-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:03:47.781456 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d2e9d001-41ab-46f1-bd09-e32b5da19fb3 tempest-ServersAdminNegativeTestJSON-824756592 tempest-ServersAdminNegativeTestJSON-824756592-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:03:47.783257 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d2e9d001-41ab-46f1-bd09-e32b5da19fb3 tempest-ServersAdminNegativeTestJSON-824756592 tempest-ServersAdminNegativeTestJSON-824756592-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:03:47.989217 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-e1cf96c4-fb11-458d-a7fb-dc59ce0a105b tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52acef7992d64d378fd8ac333887fd0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af51b8733e984c2ca87df2d8163dedf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:03:47.998860 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-e1cf96c4-fb11-458d-a7fb-dc59ce0a105b tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] 10.222.0.13 "GET /compute/v2.1/servers/12b6a241-81e5-4cb3-b138-ca28f4018732" status: 200 len: 1675 microversion: 2.1 time: 0.636909 Nov 01 19:03:48.004877 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1272/2573] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:03:47 2022] GET /compute/v2.1/servers/12b6a241-81e5-4cb3-b138-ca28f4018732 => generated 1675 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 19:03:48.067779 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [req-116678be-5256-407a-9069-554d9811a0ee req-6888a503-bcb9-4e2f-b865-1c1c61dc07c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "992f5ec5-d256-4870-b16d-fc8d9adbd3e7", "name": "network-vif-unplugged", "status": "completed", "tag": "30841eab-b46a-44ca-adc8-04928cc72ec5"}]} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:03:48.101860 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-116678be-5256-407a-9069-554d9811a0ee req-6888a503-bcb9-4e2f-b865-1c1c61dc07c8 service nova] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:03:48.102498 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-116678be-5256-407a-9069-554d9811a0ee req-6888a503-bcb9-4e2f-b865-1c1c61dc07c8 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:03:48.104257 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-116678be-5256-407a-9069-554d9811a0ee req-6888a503-bcb9-4e2f-b865-1c1c61dc07c8 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:03:48.130430 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.compute.server_external_events [req-116678be-5256-407a-9069-554d9811a0ee req-6888a503-bcb9-4e2f-b865-1c1c61dc07c8 service nova] Creating event network-vif-unplugged:30841eab-b46a-44ca-adc8-04928cc72ec5 for instance 992f5ec5-d256-4870-b16d-fc8d9adbd3e7 on n-h1-863052-2 Nov 01 19:03:48.145276 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-d2e9d001-41ab-46f1-bd09-e32b5da19fb3 tempest-ServersAdminNegativeTestJSON-824756592 tempest-ServersAdminNegativeTestJSON-824756592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0708fb2fc1df4aa9a9697cbc94acf921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '232745bfe2f3445987fedb91098c84eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:03:48.150119 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [req-116678be-5256-407a-9069-554d9811a0ee req-6888a503-bcb9-4e2f-b865-1c1c61dc07c8 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.085792 Nov 01 19:03:48.153011 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1273/2574] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Nov 1 19:03:48 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:03:48.162803 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-d2e9d001-41ab-46f1-bd09-e32b5da19fb3 tempest-ServersAdminNegativeTestJSON-824756592 tempest-ServersAdminNegativeTestJSON-824756592-project] 10.222.0.13 "GET /compute/v2.1/servers/51f5bec0-bd00-4ef2-9424-0dad025c8e29" status: 200 len: 1321 microversion: 2.1 time: 0.407689 Nov 01 19:03:48.164862 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1302/2575] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:03:47 2022] GET /compute/v2.1/servers/51f5bec0-bd00-4ef2-9424-0dad025c8e29 => generated 1321 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 19:03:48.529745 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [req-18e4853f-6ca7-4391-ad85-f18d3936ed36 req-085557e0-06d9-40bc-a4d2-907ffa1467d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "12b6a241-81e5-4cb3-b138-ca28f4018732", "name": "network-vif-deleted", "tag": "83ab684c-8cbd-40cd-8ab7-9ad6c84fb96d"}]} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:03:48.554070 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-18e4853f-6ca7-4391-ad85-f18d3936ed36 req-085557e0-06d9-40bc-a4d2-907ffa1467d5 service nova] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:03:48.554559 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-18e4853f-6ca7-4391-ad85-f18d3936ed36 req-085557e0-06d9-40bc-a4d2-907ffa1467d5 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:03:48.554996 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-18e4853f-6ca7-4391-ad85-f18d3936ed36 req-085557e0-06d9-40bc-a4d2-907ffa1467d5 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:03:48.590939 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.compute.server_external_events [req-18e4853f-6ca7-4391-ad85-f18d3936ed36 req-085557e0-06d9-40bc-a4d2-907ffa1467d5 service nova] Creating event network-vif-deleted:83ab684c-8cbd-40cd-8ab7-9ad6c84fb96d for instance 12b6a241-81e5-4cb3-b138-ca28f4018732 on n-h1-863052-2 Nov 01 19:03:48.599927 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [req-18e4853f-6ca7-4391-ad85-f18d3936ed36 req-085557e0-06d9-40bc-a4d2-907ffa1467d5 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077548 Nov 01 19:03:48.603116 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1274/2576] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Nov 1 19:03:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:03:48.655560 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-2a5c5648-aa3f-4a8b-b55e-6bc692ec3ccd tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:03:48.656909 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-2a5c5648-aa3f-4a8b-b55e-6bc692ec3ccd tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] [instance: 992f5ec5-d256-4870-b16d-fc8d9adbd3e7] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:03:48.667610 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-2a5c5648-aa3f-4a8b-b55e-6bc692ec3ccd tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:03:48.668119 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-2a5c5648-aa3f-4a8b-b55e-6bc692ec3ccd tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:03:48.668566 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-2a5c5648-aa3f-4a8b-b55e-6bc692ec3ccd tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:03:48.673603 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-2a5c5648-aa3f-4a8b-b55e-6bc692ec3ccd tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:03:48.674132 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-2a5c5648-aa3f-4a8b-b55e-6bc692ec3ccd tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:03:48.674625 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-2a5c5648-aa3f-4a8b-b55e-6bc692ec3ccd tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:03:49.120393 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-2a5c5648-aa3f-4a8b-b55e-6bc692ec3ccd tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb496b3faac4abbae73d389f2042e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e2520220d454764b8c139a58d78ac83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:03:49.133165 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-2a5c5648-aa3f-4a8b-b55e-6bc692ec3ccd tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] 10.222.0.13 "GET /compute/v2.1/servers/992f5ec5-d256-4870-b16d-fc8d9adbd3e7" status: 200 len: 1479 microversion: 2.1 time: 0.485291 Nov 01 19:03:49.133775 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1303/2577] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:03:48 2022] GET /compute/v2.1/servers/992f5ec5-d256-4870-b16d-fc8d9adbd3e7 => generated 1479 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 19:03:49.145238 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-55db16c6-9ce9-4552-b1b8-c06fc15c940f tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:03:49.145793 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-55db16c6-9ce9-4552-b1b8-c06fc15c940f tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] [instance: 12b6a241-81e5-4cb3-b138-ca28f4018732] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:03:49.160794 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-55db16c6-9ce9-4552-b1b8-c06fc15c940f tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:03:49.162621 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-55db16c6-9ce9-4552-b1b8-c06fc15c940f tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:03:49.165952 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-55db16c6-9ce9-4552-b1b8-c06fc15c940f tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:03:49.166957 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-55db16c6-9ce9-4552-b1b8-c06fc15c940f tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:03:49.167707 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-55db16c6-9ce9-4552-b1b8-c06fc15c940f tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:03:49.169376 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-55db16c6-9ce9-4552-b1b8-c06fc15c940f tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:03:49.274772 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-b09e0087-260b-47db-b4a8-8957df8ebcc7 tempest-TenantUsagesTestJSON-700278909 tempest-TenantUsagesTestJSON-700278909-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TenantUsagesTestJSON-server-1092215834", "imageRef": "2d4a0047-1b9e-445f-8af8-1b5c9d93e881", "flavorRef": "452"}} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:03:49.359110 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.network.neutron [None req-b09e0087-260b-47db-b4a8-8957df8ebcc7 tempest-TenantUsagesTestJSON-700278909 tempest-TenantUsagesTestJSON-700278909-project] validate_networks() for None {{(pid=121402) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 01 19:03:49.550323 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-55db16c6-9ce9-4552-b1b8-c06fc15c940f tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52acef7992d64d378fd8ac333887fd0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af51b8733e984c2ca87df2d8163dedf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:03:49.570515 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-55db16c6-9ce9-4552-b1b8-c06fc15c940f tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] 10.222.0.13 "GET /compute/v2.1/servers/12b6a241-81e5-4cb3-b138-ca28f4018732" status: 200 len: 1495 microversion: 2.1 time: 0.432013 Nov 01 19:03:49.573048 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1304/2578] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:03:49 2022] GET /compute/v2.1/servers/12b6a241-81e5-4cb3-b138-ca28f4018732 => generated 1495 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:03:49.579081 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-81ee875c-124a-42c0-9c28-58bb590be436 tempest-ServersAdminNegativeTestJSON-824756592 tempest-ServersAdminNegativeTestJSON-824756592-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:03:49.579959 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-81ee875c-124a-42c0-9c28-58bb590be436 tempest-ServersAdminNegativeTestJSON-824756592 tempest-ServersAdminNegativeTestJSON-824756592-project] [instance: 51f5bec0-bd00-4ef2-9424-0dad025c8e29] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:03:49.618326 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-81ee875c-124a-42c0-9c28-58bb590be436 tempest-ServersAdminNegativeTestJSON-824756592 tempest-ServersAdminNegativeTestJSON-824756592-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:03:49.619032 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-81ee875c-124a-42c0-9c28-58bb590be436 tempest-ServersAdminNegativeTestJSON-824756592 tempest-ServersAdminNegativeTestJSON-824756592-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:03:49.620112 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-81ee875c-124a-42c0-9c28-58bb590be436 tempest-ServersAdminNegativeTestJSON-824756592 tempest-ServersAdminNegativeTestJSON-824756592-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:03:49.621060 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-81ee875c-124a-42c0-9c28-58bb590be436 tempest-ServersAdminNegativeTestJSON-824756592 tempest-ServersAdminNegativeTestJSON-824756592-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:03:49.622282 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-81ee875c-124a-42c0-9c28-58bb590be436 tempest-ServersAdminNegativeTestJSON-824756592 tempest-ServersAdminNegativeTestJSON-824756592-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:03:49.623028 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-81ee875c-124a-42c0-9c28-58bb590be436 tempest-ServersAdminNegativeTestJSON-824756592 tempest-ServersAdminNegativeTestJSON-824756592-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:03:50.054491 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-81ee875c-124a-42c0-9c28-58bb590be436 tempest-ServersAdminNegativeTestJSON-824756592 tempest-ServersAdminNegativeTestJSON-824756592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0708fb2fc1df4aa9a9697cbc94acf921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '232745bfe2f3445987fedb91098c84eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:03:50.067365 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-81ee875c-124a-42c0-9c28-58bb590be436 tempest-ServersAdminNegativeTestJSON-824756592 tempest-ServersAdminNegativeTestJSON-824756592-project] 10.222.0.13 "GET /compute/v2.1/servers/51f5bec0-bd00-4ef2-9424-0dad025c8e29" status: 200 len: 1321 microversion: 2.1 time: 0.492844 Nov 01 19:03:50.089444 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1305/2579] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:03:49 2022] GET /compute/v2.1/servers/51f5bec0-bd00-4ef2-9424-0dad025c8e29 => generated 1321 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:03:50.169968 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-ef13f9dc-c16e-48de-92b9-cc2e6814a439 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:03:50.172129 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-ef13f9dc-c16e-48de-92b9-cc2e6814a439 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] [instance: 992f5ec5-d256-4870-b16d-fc8d9adbd3e7] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:03:50.191237 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-ef13f9dc-c16e-48de-92b9-cc2e6814a439 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:03:50.191853 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-ef13f9dc-c16e-48de-92b9-cc2e6814a439 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:03:50.194933 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-ef13f9dc-c16e-48de-92b9-cc2e6814a439 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:03:50.197074 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-ef13f9dc-c16e-48de-92b9-cc2e6814a439 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:03:50.198266 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-ef13f9dc-c16e-48de-92b9-cc2e6814a439 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:03:50.199465 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-ef13f9dc-c16e-48de-92b9-cc2e6814a439 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:03:50.564500 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.virt.hardware [None req-b09e0087-260b-47db-b4a8-8957df8ebcc7 tempest-TenantUsagesTestJSON-700278909 tempest-TenantUsagesTestJSON-700278909-project] Flavor limits 0:0:0 {{(pid=121402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 01 19:03:50.566072 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.virt.hardware [None req-b09e0087-260b-47db-b4a8-8957df8ebcc7 tempest-TenantUsagesTestJSON-700278909 tempest-TenantUsagesTestJSON-700278909-project] Image limits 0:0:0 {{(pid=121402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 01 19:03:50.566741 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.virt.hardware [None req-b09e0087-260b-47db-b4a8-8957df8ebcc7 tempest-TenantUsagesTestJSON-700278909 tempest-TenantUsagesTestJSON-700278909-project] Flavor pref 0:0:0 {{(pid=121402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 01 19:03:50.567303 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.virt.hardware [None req-b09e0087-260b-47db-b4a8-8957df8ebcc7 tempest-TenantUsagesTestJSON-700278909 tempest-TenantUsagesTestJSON-700278909-project] Image pref 0:0:0 {{(pid=121402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 01 19:03:50.567896 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.virt.hardware [None req-b09e0087-260b-47db-b4a8-8957df8ebcc7 tempest-TenantUsagesTestJSON-700278909 tempest-TenantUsagesTestJSON-700278909-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 01 19:03:50.592398 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b09e0087-260b-47db-b4a8-8957df8ebcc7 tempest-TenantUsagesTestJSON-700278909 tempest-TenantUsagesTestJSON-700278909-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:03:50.596968 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b09e0087-260b-47db-b4a8-8957df8ebcc7 tempest-TenantUsagesTestJSON-700278909 tempest-TenantUsagesTestJSON-700278909-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:03:50.598011 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b09e0087-260b-47db-b4a8-8957df8ebcc7 tempest-TenantUsagesTestJSON-700278909 tempest-TenantUsagesTestJSON-700278909-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:03:50.599096 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b09e0087-260b-47db-b4a8-8957df8ebcc7 tempest-TenantUsagesTestJSON-700278909 tempest-TenantUsagesTestJSON-700278909-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:03:50.599581 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b09e0087-260b-47db-b4a8-8957df8ebcc7 tempest-TenantUsagesTestJSON-700278909 tempest-TenantUsagesTestJSON-700278909-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:03:50.601397 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b09e0087-260b-47db-b4a8-8957df8ebcc7 tempest-TenantUsagesTestJSON-700278909 tempest-TenantUsagesTestJSON-700278909-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:03:50.655312 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.quota [None req-b09e0087-260b-47db-b4a8-8957df8ebcc7 tempest-TenantUsagesTestJSON-700278909 tempest-TenantUsagesTestJSON-700278909-project] Getting quotas for project 6a58c7ae460f4022b5d50651df0a486f. Resources: {'cores', 'ram', 'instances'} {{(pid=121402) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 01 19:03:50.669157 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.quota [None req-b09e0087-260b-47db-b4a8-8957df8ebcc7 tempest-TenantUsagesTestJSON-700278909 tempest-TenantUsagesTestJSON-700278909-project] Getting quotas for user 556f6f7b8d3745a38734001133ecd70d and project 6a58c7ae460f4022b5d50651df0a486f. Resources: {'cores', 'ram', 'instances'} {{(pid=121402) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 01 19:03:50.719658 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-b09e0087-260b-47db-b4a8-8957df8ebcc7 tempest-TenantUsagesTestJSON-700278909 tempest-TenantUsagesTestJSON-700278909-project] Going to run 1 instances... {{(pid=121402) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 01 19:03:50.722266 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-b09e0087-260b-47db-b4a8-8957df8ebcc7 tempest-TenantUsagesTestJSON-700278909 tempest-TenantUsagesTestJSON-700278909-project] [instance: 763f688c-9976-4d91-b9cd-c22a9e168086] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2d4a0047-1b9e-445f-8af8-1b5c9d93e881',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121402) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 01 19:03:50.758369 n-d-863052-2 devstack@n-api.service[121402]: DEBUG dbcounter [-] [121402] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=121402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 19:03:50.787649 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-b09e0087-260b-47db-b4a8-8957df8ebcc7 tempest-TenantUsagesTestJSON-700278909 tempest-TenantUsagesTestJSON-700278909-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.805652 Nov 01 19:03:50.795165 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1275/2580] 10.222.0.13 () {60 vars in 1147 bytes} [Tue Nov 1 19:03:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 1812 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 01 19:03:50.797643 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-2b278488-1c9b-4bbc-bb54-47a6bc84509b tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:03:50.798251 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-2b278488-1c9b-4bbc-bb54-47a6bc84509b tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] [instance: 12b6a241-81e5-4cb3-b138-ca28f4018732] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:03:50.836540 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2b278488-1c9b-4bbc-bb54-47a6bc84509b tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:03:50.837001 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2b278488-1c9b-4bbc-bb54-47a6bc84509b tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:03:50.846702 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2b278488-1c9b-4bbc-bb54-47a6bc84509b tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:03:50.847489 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2b278488-1c9b-4bbc-bb54-47a6bc84509b tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:03:50.847968 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2b278488-1c9b-4bbc-bb54-47a6bc84509b tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:03:50.848396 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2b278488-1c9b-4bbc-bb54-47a6bc84509b tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:03:50.879964 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.wsgi [None req-2b278488-1c9b-4bbc-bb54-47a6bc84509b tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] HTTP exception thrown: Instance 12b6a241-81e5-4cb3-b138-ca28f4018732 could not be found. Nov 01 19:03:50.882810 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-2b278488-1c9b-4bbc-bb54-47a6bc84509b tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Request method failure captured: Nov 01 19:03:50.882810 n-d-863052-2 devstack@n-api.service[121402]: request: GET /compute/v2.1/servers/12b6a241-81e5-4cb3-b138-ca28f4018732 HTTP/1.1 Nov 01 19:03:50.882810 n-d-863052-2 devstack@n-api.service[121402]: Accept: application/json Nov 01 19:03:50.882810 n-d-863052-2 devstack@n-api.service[121402]: Accept-Encoding: identity Nov 01 19:03:50.882810 n-d-863052-2 devstack@n-api.service[121402]: Connection: close Nov 01 19:03:50.882810 n-d-863052-2 devstack@n-api.service[121402]: Content-Length: 0 Nov 01 19:03:50.882810 n-d-863052-2 devstack@n-api.service[121402]: Content-Type: application/json Nov 01 19:03:50.882810 n-d-863052-2 devstack@n-api.service[121402]: Host: 10.222.0.13 Nov 01 19:03:50.882810 n-d-863052-2 devstack@n-api.service[121402]: Openstack-System-Scope: None Nov 01 19:03:50.882810 n-d-863052-2 devstack@n-api.service[121402]: User-Agent: python-urllib3/1.26.12 Nov 01 19:03:50.882810 n-d-863052-2 devstack@n-api.service[121402]: X-Auth-Token: gAAAAABjYW0ddbnkYhOv8dLUJr-s5oH-dqF8JRJhXex73L-70UBvGh-wlHGeiVgebbsv3kTSqtfLslhVEpqMdlQQA96JiyxVJnEafUgqXH5jyE8gVjuXRsGq0rdb8we_rfE2pVa3h17Ja5Q5u3LZ-1m6KGdglxKoD8H2n0P3G62fb2rWNjcrlYs Nov 01 19:03:50.882810 n-d-863052-2 devstack@n-api.service[121402]: X-Domain-Id: None Nov 01 19:03:50.882810 n-d-863052-2 devstack@n-api.service[121402]: X-Domain-Name: None Nov 01 19:03:50.882810 n-d-863052-2 devstack@n-api.service[121402]: X-Identity-Status: Confirmed Nov 01 19:03:50.882810 n-d-863052-2 devstack@n-api.service[121402]: X-Is-Admin-Project: True Nov 01 19:03:50.882810 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Domain-Id: default Nov 01 19:03:50.882810 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Domain-Name: Default Nov 01 19:03:50.882810 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Id: af51b8733e984c2ca87df2d8163dedf9 Nov 01 19:03:50.882810 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Name: tempest-ServersTestMultiNic-330497003 Nov 01 19:03:50.882810 n-d-863052-2 devstack@n-api.service[121402]: X-Role: member,reader Nov 01 19:03:50.882810 n-d-863052-2 devstack@n-api.service[121402]: X-Roles: member,reader Nov 01 19:03:50.882810 n-d-863052-2 devstack@n-api.service[121402]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/af51b8733e984c2ca87df2d8163dedf9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/af51b8733e984c2ca87df2d8163dedf9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_af51b8733e984c2ca87df2d8163dedf9", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/af51b8733e984c2ca87df2d8163dedf9"}]}] Nov 01 19:03:50.882810 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant: tempest-ServersTestMultiNic-330497003 Nov 01 19:03:50.882810 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant-Id: af51b8733e984c2ca87df2d8163dedf9 Nov 01 19:03:50.882810 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant-Name: tempest-ServersTestMultiNic-330497003 Nov 01 19:03:50.882810 n-d-863052-2 devstack@n-api.service[121402]: X-User: tempest-ServersTestMultiNic-330497003-project Nov 01 19:03:50.882810 n-d-863052-2 devstack@n-api.service[121402]: X-User-Domain-Id: default Nov 01 19:03:50.882810 n-d-863052-2 devstack@n-api.service[121402]: X-User-Domain-Name: Default Nov 01 19:03:50.882810 n-d-863052-2 devstack@n-api.service[121402]: X-User-Id: 52acef7992d64d378fd8ac333887fd0e Nov 01 19:03:50.882810 n-d-863052-2 devstack@n-api.service[121402]: X-User-Name: tempest-ServersTestMultiNic-330497003-project Nov 01 19:03:50.882810 n-d-863052-2 devstack@n-api.service[121402]: method: > Nov 01 19:03:50.882810 n-d-863052-2 devstack@n-api.service[121402]: exception: Instance 12b6a241-81e5-4cb3-b138-ca28f4018732 could not be found. Nov 01 19:03:50.882810 n-d-863052-2 devstack@n-api.service[121402]: action_args: {'id': '12b6a241-81e5-4cb3-b138-ca28f4018732'} Nov 01 19:03:50.882810 n-d-863052-2 devstack@n-api.service[121402]: {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 01 19:03:50.882810 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:03:50.882810 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 01 19:03:50.882810 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 01 19:03:50.882810 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 01 19:03:50.882810 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 01 19:03:50.882810 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 01 19:03:50.882810 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 01 19:03:50.882810 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 01 19:03:50.882810 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 01 19:03:50.882810 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 12b6a241-81e5-4cb3-b138-ca28f4018732 could not be found. Nov 01 19:03:50.882810 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:03:50.882810 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:03:50.882810 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:03:50.882810 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:03:50.882810 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:03:50.882810 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:03:50.882810 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 01 19:03:50.882810 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 01 19:03:50.882810 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 01 19:03:50.882810 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 01 19:03:50.882810 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 01 19:03:50.882810 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 01 19:03:50.882810 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 01 19:03:50.882810 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 01 19:03:50.882810 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 01 19:03:50.882810 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 01 19:03:50.882810 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 12b6a241-81e5-4cb3-b138-ca28f4018732 could not be found. Nov 01 19:03:50.882810 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:03:50.882810 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:03:50.882810 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:03:50.886962 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:03:50.886962 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:03:50.886962 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:03:50.886962 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 01 19:03:50.886962 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 01 19:03:50.886962 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 12b6a241-81e5-4cb3-b138-ca28f4018732 could not be found. Nov 01 19:03:50.886962 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:03:50.888505 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-2b278488-1c9b-4bbc-bb54-47a6bc84509b tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Returning 404 to user: Instance 12b6a241-81e5-4cb3-b138-ca28f4018732 could not be found. {{(pid=121402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 01 19:03:50.889585 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-2b278488-1c9b-4bbc-bb54-47a6bc84509b tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] 10.222.0.13 "GET /compute/v2.1/servers/12b6a241-81e5-4cb3-b138-ca28f4018732" status: 404 len: 111 microversion: 2.1 time: 0.095828 Nov 01 19:03:50.891212 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1276/2581] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:03:50 2022] GET /compute/v2.1/servers/12b6a241-81e5-4cb3-b138-ca28f4018732 => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 01 19:03:50.902427 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [req-d2c8c78a-4502-406e-8e84-2b82db0f5a3d req-dd1328d0-7a05-496b-8f06-e61511d1904f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "12b6a241-81e5-4cb3-b138-ca28f4018732", "name": "network-vif-deleted", "tag": "28796d98-68e6-44c9-aee9-9383b8f25e1e"}]} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:03:50.923405 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-d2c8c78a-4502-406e-8e84-2b82db0f5a3d req-dd1328d0-7a05-496b-8f06-e61511d1904f service nova] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:03:50.923980 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-d2c8c78a-4502-406e-8e84-2b82db0f5a3d req-dd1328d0-7a05-496b-8f06-e61511d1904f service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:03:50.927726 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-d2c8c78a-4502-406e-8e84-2b82db0f5a3d req-dd1328d0-7a05-496b-8f06-e61511d1904f service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:03:50.946942 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.compute.server_external_events [req-d2c8c78a-4502-406e-8e84-2b82db0f5a3d req-dd1328d0-7a05-496b-8f06-e61511d1904f service nova] Creating event network-vif-deleted:28796d98-68e6-44c9-aee9-9383b8f25e1e for instance 12b6a241-81e5-4cb3-b138-ca28f4018732 on n-h1-863052-2 Nov 01 19:03:50.954450 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [req-d2c8c78a-4502-406e-8e84-2b82db0f5a3d req-dd1328d0-7a05-496b-8f06-e61511d1904f service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061847 Nov 01 19:03:50.956839 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1277/2582] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Nov 1 19:03:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:03:50.967419 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-1f3ef53d-10de-46e7-84ff-fef9bb4abd47 tempest-TenantUsagesTestJSON-700278909 tempest-TenantUsagesTestJSON-700278909-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:03:50.973591 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-1f3ef53d-10de-46e7-84ff-fef9bb4abd47 tempest-TenantUsagesTestJSON-700278909 tempest-TenantUsagesTestJSON-700278909-project] [instance: 763f688c-9976-4d91-b9cd-c22a9e168086] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:03:51.135422 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-ef13f9dc-c16e-48de-92b9-cc2e6814a439 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb496b3faac4abbae73d389f2042e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e2520220d454764b8c139a58d78ac83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:03:51.145095 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-ef13f9dc-c16e-48de-92b9-cc2e6814a439 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] 10.222.0.13 "GET /compute/v2.1/servers/992f5ec5-d256-4870-b16d-fc8d9adbd3e7" status: 200 len: 1479 microversion: 2.1 time: 0.987155 Nov 01 19:03:51.150195 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1306/2583] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:03:50 2022] GET /compute/v2.1/servers/992f5ec5-d256-4870-b16d-fc8d9adbd3e7 => generated 1479 bytes in 993 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:03:51.169756 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-f76b74c0-322e-4759-97cb-dc144ece293a tempest-ServersAdminNegativeTestJSON-824756592 tempest-ServersAdminNegativeTestJSON-824756592-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:03:51.171999 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-f76b74c0-322e-4759-97cb-dc144ece293a tempest-ServersAdminNegativeTestJSON-824756592 tempest-ServersAdminNegativeTestJSON-824756592-project] [instance: 51f5bec0-bd00-4ef2-9424-0dad025c8e29] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:03:51.184413 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f76b74c0-322e-4759-97cb-dc144ece293a tempest-ServersAdminNegativeTestJSON-824756592 tempest-ServersAdminNegativeTestJSON-824756592-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:03:51.184931 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f76b74c0-322e-4759-97cb-dc144ece293a tempest-ServersAdminNegativeTestJSON-824756592 tempest-ServersAdminNegativeTestJSON-824756592-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:03:51.185365 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f76b74c0-322e-4759-97cb-dc144ece293a tempest-ServersAdminNegativeTestJSON-824756592 tempest-ServersAdminNegativeTestJSON-824756592-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:03:51.186511 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f76b74c0-322e-4759-97cb-dc144ece293a tempest-ServersAdminNegativeTestJSON-824756592 tempest-ServersAdminNegativeTestJSON-824756592-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:03:51.186758 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f76b74c0-322e-4759-97cb-dc144ece293a tempest-ServersAdminNegativeTestJSON-824756592 tempest-ServersAdminNegativeTestJSON-824756592-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:03:51.193450 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f76b74c0-322e-4759-97cb-dc144ece293a tempest-ServersAdminNegativeTestJSON-824756592 tempest-ServersAdminNegativeTestJSON-824756592-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:03:51.505554 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-1f3ef53d-10de-46e7-84ff-fef9bb4abd47 tempest-TenantUsagesTestJSON-700278909 tempest-TenantUsagesTestJSON-700278909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '556f6f7b8d3745a38734001133ecd70d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a58c7ae460f4022b5d50651df0a486f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:03:51.512883 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-1f3ef53d-10de-46e7-84ff-fef9bb4abd47 tempest-TenantUsagesTestJSON-700278909 tempest-TenantUsagesTestJSON-700278909-project] 10.222.0.13 "GET /compute/v2.1/servers/763f688c-9976-4d91-b9cd-c22a9e168086" status: 200 len: 1214 microversion: 2.1 time: 0.554549 Nov 01 19:03:51.533454 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1278/2584] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:03:50 2022] GET /compute/v2.1/servers/763f688c-9976-4d91-b9cd-c22a9e168086 => generated 1214 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:03:51.720675 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-f76b74c0-322e-4759-97cb-dc144ece293a tempest-ServersAdminNegativeTestJSON-824756592 tempest-ServersAdminNegativeTestJSON-824756592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0708fb2fc1df4aa9a9697cbc94acf921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '232745bfe2f3445987fedb91098c84eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:03:51.736974 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-f76b74c0-322e-4759-97cb-dc144ece293a tempest-ServersAdminNegativeTestJSON-824756592 tempest-ServersAdminNegativeTestJSON-824756592-project] 10.222.0.13 "GET /compute/v2.1/servers/51f5bec0-bd00-4ef2-9424-0dad025c8e29" status: 200 len: 1321 microversion: 2.1 time: 0.585524 Nov 01 19:03:51.749379 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1307/2585] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:03:51 2022] GET /compute/v2.1/servers/51f5bec0-bd00-4ef2-9424-0dad025c8e29 => generated 1321 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:03:52.169185 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-cd169092-5e14-410f-8d6e-dcdabb8e005c tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:03:52.170558 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-cd169092-5e14-410f-8d6e-dcdabb8e005c tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] [instance: 992f5ec5-d256-4870-b16d-fc8d9adbd3e7] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:03:52.188123 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-cd169092-5e14-410f-8d6e-dcdabb8e005c tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:03:52.188663 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-cd169092-5e14-410f-8d6e-dcdabb8e005c tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:03:52.189086 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-cd169092-5e14-410f-8d6e-dcdabb8e005c tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:03:52.189792 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-cd169092-5e14-410f-8d6e-dcdabb8e005c tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:03:52.190786 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-cd169092-5e14-410f-8d6e-dcdabb8e005c tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:03:52.191206 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-cd169092-5e14-410f-8d6e-dcdabb8e005c tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:03:52.541802 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-56f29313-ef76-4a85-8b8a-8048a08dee3f tempest-TenantUsagesTestJSON-700278909 tempest-TenantUsagesTestJSON-700278909-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:03:52.543320 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-56f29313-ef76-4a85-8b8a-8048a08dee3f tempest-TenantUsagesTestJSON-700278909 tempest-TenantUsagesTestJSON-700278909-project] [instance: 763f688c-9976-4d91-b9cd-c22a9e168086] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:03:52.566497 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-56f29313-ef76-4a85-8b8a-8048a08dee3f tempest-TenantUsagesTestJSON-700278909 tempest-TenantUsagesTestJSON-700278909-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:03:52.571486 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-56f29313-ef76-4a85-8b8a-8048a08dee3f tempest-TenantUsagesTestJSON-700278909 tempest-TenantUsagesTestJSON-700278909-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:03:52.572413 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-56f29313-ef76-4a85-8b8a-8048a08dee3f tempest-TenantUsagesTestJSON-700278909 tempest-TenantUsagesTestJSON-700278909-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:03:52.574059 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-56f29313-ef76-4a85-8b8a-8048a08dee3f tempest-TenantUsagesTestJSON-700278909 tempest-TenantUsagesTestJSON-700278909-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:03:52.574910 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-56f29313-ef76-4a85-8b8a-8048a08dee3f tempest-TenantUsagesTestJSON-700278909 tempest-TenantUsagesTestJSON-700278909-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:03:52.575981 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-56f29313-ef76-4a85-8b8a-8048a08dee3f tempest-TenantUsagesTestJSON-700278909 tempest-TenantUsagesTestJSON-700278909-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:03:52.685011 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-cd169092-5e14-410f-8d6e-dcdabb8e005c tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb496b3faac4abbae73d389f2042e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e2520220d454764b8c139a58d78ac83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:03:52.694878 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-cd169092-5e14-410f-8d6e-dcdabb8e005c tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] 10.222.0.13 "GET /compute/v2.1/servers/992f5ec5-d256-4870-b16d-fc8d9adbd3e7" status: 200 len: 1479 microversion: 2.1 time: 0.530023 Nov 01 19:03:52.705427 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1279/2586] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:03:52 2022] GET /compute/v2.1/servers/992f5ec5-d256-4870-b16d-fc8d9adbd3e7 => generated 1479 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:03:52.765000 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-669ee61a-d322-4114-98b9-3ae0bd6652a5 tempest-ServersAdminNegativeTestJSON-824756592 tempest-ServersAdminNegativeTestJSON-824756592-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:03:52.765960 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-669ee61a-d322-4114-98b9-3ae0bd6652a5 tempest-ServersAdminNegativeTestJSON-824756592 tempest-ServersAdminNegativeTestJSON-824756592-project] [instance: 51f5bec0-bd00-4ef2-9424-0dad025c8e29] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:03:52.780979 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-669ee61a-d322-4114-98b9-3ae0bd6652a5 tempest-ServersAdminNegativeTestJSON-824756592 tempest-ServersAdminNegativeTestJSON-824756592-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:03:52.781614 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-669ee61a-d322-4114-98b9-3ae0bd6652a5 tempest-ServersAdminNegativeTestJSON-824756592 tempest-ServersAdminNegativeTestJSON-824756592-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:03:52.782152 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-669ee61a-d322-4114-98b9-3ae0bd6652a5 tempest-ServersAdminNegativeTestJSON-824756592 tempest-ServersAdminNegativeTestJSON-824756592-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:03:52.782956 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-669ee61a-d322-4114-98b9-3ae0bd6652a5 tempest-ServersAdminNegativeTestJSON-824756592 tempest-ServersAdminNegativeTestJSON-824756592-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:03:52.783520 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-669ee61a-d322-4114-98b9-3ae0bd6652a5 tempest-ServersAdminNegativeTestJSON-824756592 tempest-ServersAdminNegativeTestJSON-824756592-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:03:52.784569 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-669ee61a-d322-4114-98b9-3ae0bd6652a5 tempest-ServersAdminNegativeTestJSON-824756592 tempest-ServersAdminNegativeTestJSON-824756592-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:03:53.126683 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-56f29313-ef76-4a85-8b8a-8048a08dee3f tempest-TenantUsagesTestJSON-700278909 tempest-TenantUsagesTestJSON-700278909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '556f6f7b8d3745a38734001133ecd70d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a58c7ae460f4022b5d50651df0a486f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:03:53.138625 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-56f29313-ef76-4a85-8b8a-8048a08dee3f tempest-TenantUsagesTestJSON-700278909 tempest-TenantUsagesTestJSON-700278909-project] 10.222.0.13 "GET /compute/v2.1/servers/763f688c-9976-4d91-b9cd-c22a9e168086" status: 200 len: 1274 microversion: 2.1 time: 0.599354 Nov 01 19:03:53.162809 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1308/2587] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:03:52 2022] GET /compute/v2.1/servers/763f688c-9976-4d91-b9cd-c22a9e168086 => generated 1274 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 19:03:53.317966 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-669ee61a-d322-4114-98b9-3ae0bd6652a5 tempest-ServersAdminNegativeTestJSON-824756592 tempest-ServersAdminNegativeTestJSON-824756592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0708fb2fc1df4aa9a9697cbc94acf921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '232745bfe2f3445987fedb91098c84eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:03:53.329238 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-669ee61a-d322-4114-98b9-3ae0bd6652a5 tempest-ServersAdminNegativeTestJSON-824756592 tempest-ServersAdminNegativeTestJSON-824756592-project] 10.222.0.13 "GET /compute/v2.1/servers/51f5bec0-bd00-4ef2-9424-0dad025c8e29" status: 200 len: 1321 microversion: 2.1 time: 0.567822 Nov 01 19:03:53.338537 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1280/2588] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:03:52 2022] GET /compute/v2.1/servers/51f5bec0-bd00-4ef2-9424-0dad025c8e29 => generated 1321 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:03:53.732240 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-c195ec94-8599-43e5-8dc9-7502ba86ffcb tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:03:53.733484 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-c195ec94-8599-43e5-8dc9-7502ba86ffcb tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] [instance: 992f5ec5-d256-4870-b16d-fc8d9adbd3e7] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:03:53.743200 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-c195ec94-8599-43e5-8dc9-7502ba86ffcb tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:03:53.752073 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-c195ec94-8599-43e5-8dc9-7502ba86ffcb tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:03:53.753357 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-c195ec94-8599-43e5-8dc9-7502ba86ffcb tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:03:53.754283 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-c195ec94-8599-43e5-8dc9-7502ba86ffcb tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:03:53.754942 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-c195ec94-8599-43e5-8dc9-7502ba86ffcb tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:03:53.755551 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-c195ec94-8599-43e5-8dc9-7502ba86ffcb tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:03:54.088470 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [req-d9781256-a40e-422e-8aea-ba3176b60d21 req-13280503-36c4-4fc1-ba15-c67531385fe0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "992f5ec5-d256-4870-b16d-fc8d9adbd3e7", "name": "network-vif-plugged", "status": "completed", "tag": "30841eab-b46a-44ca-adc8-04928cc72ec5"}]} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:03:54.104102 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-d9781256-a40e-422e-8aea-ba3176b60d21 req-13280503-36c4-4fc1-ba15-c67531385fe0 service nova] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:03:54.107550 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-d9781256-a40e-422e-8aea-ba3176b60d21 req-13280503-36c4-4fc1-ba15-c67531385fe0 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:03:54.108052 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-d9781256-a40e-422e-8aea-ba3176b60d21 req-13280503-36c4-4fc1-ba15-c67531385fe0 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:03:54.152203 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.compute.server_external_events [req-d9781256-a40e-422e-8aea-ba3176b60d21 req-13280503-36c4-4fc1-ba15-c67531385fe0 service nova] Creating event network-vif-plugged:30841eab-b46a-44ca-adc8-04928cc72ec5 for instance 992f5ec5-d256-4870-b16d-fc8d9adbd3e7 on n-h1-863052-2 Nov 01 19:03:54.166564 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [req-d9781256-a40e-422e-8aea-ba3176b60d21 req-13280503-36c4-4fc1-ba15-c67531385fe0 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080848 Nov 01 19:03:54.167518 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1281/2589] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Nov 1 19:03:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 01 19:03:54.181403 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-e2106c42-28a5-435e-a8f2-704e619572a3 tempest-TenantUsagesTestJSON-700278909 tempest-TenantUsagesTestJSON-700278909-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:03:54.182131 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-e2106c42-28a5-435e-a8f2-704e619572a3 tempest-TenantUsagesTestJSON-700278909 tempest-TenantUsagesTestJSON-700278909-project] [instance: 763f688c-9976-4d91-b9cd-c22a9e168086] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:03:54.199479 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e2106c42-28a5-435e-a8f2-704e619572a3 tempest-TenantUsagesTestJSON-700278909 tempest-TenantUsagesTestJSON-700278909-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:03:54.199974 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e2106c42-28a5-435e-a8f2-704e619572a3 tempest-TenantUsagesTestJSON-700278909 tempest-TenantUsagesTestJSON-700278909-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:03:54.200410 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e2106c42-28a5-435e-a8f2-704e619572a3 tempest-TenantUsagesTestJSON-700278909 tempest-TenantUsagesTestJSON-700278909-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:03:54.201153 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e2106c42-28a5-435e-a8f2-704e619572a3 tempest-TenantUsagesTestJSON-700278909 tempest-TenantUsagesTestJSON-700278909-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:03:54.201603 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e2106c42-28a5-435e-a8f2-704e619572a3 tempest-TenantUsagesTestJSON-700278909 tempest-TenantUsagesTestJSON-700278909-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:03:54.209880 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e2106c42-28a5-435e-a8f2-704e619572a3 tempest-TenantUsagesTestJSON-700278909 tempest-TenantUsagesTestJSON-700278909-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:03:54.575684 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-e2106c42-28a5-435e-a8f2-704e619572a3 tempest-TenantUsagesTestJSON-700278909 tempest-TenantUsagesTestJSON-700278909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '556f6f7b8d3745a38734001133ecd70d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a58c7ae460f4022b5d50651df0a486f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:03:54.582344 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-c195ec94-8599-43e5-8dc9-7502ba86ffcb tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb496b3faac4abbae73d389f2042e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e2520220d454764b8c139a58d78ac83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:03:54.587327 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-e2106c42-28a5-435e-a8f2-704e619572a3 tempest-TenantUsagesTestJSON-700278909 tempest-TenantUsagesTestJSON-700278909-project] 10.222.0.13 "GET /compute/v2.1/servers/763f688c-9976-4d91-b9cd-c22a9e168086" status: 200 len: 1272 microversion: 2.1 time: 0.418131 Nov 01 19:03:54.604608 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1282/2590] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:03:54 2022] GET /compute/v2.1/servers/763f688c-9976-4d91-b9cd-c22a9e168086 => generated 1272 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:03:54.604608 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-ab34cf8c-59c7-4a20-bdf5-478b73c14634 tempest-ServersAdminNegativeTestJSON-824756592 tempest-ServersAdminNegativeTestJSON-824756592-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:03:54.604608 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-ab34cf8c-59c7-4a20-bdf5-478b73c14634 tempest-ServersAdminNegativeTestJSON-824756592 tempest-ServersAdminNegativeTestJSON-824756592-project] [instance: 51f5bec0-bd00-4ef2-9424-0dad025c8e29] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:03:54.616737 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-ab34cf8c-59c7-4a20-bdf5-478b73c14634 tempest-ServersAdminNegativeTestJSON-824756592 tempest-ServersAdminNegativeTestJSON-824756592-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:03:54.620389 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-ab34cf8c-59c7-4a20-bdf5-478b73c14634 tempest-ServersAdminNegativeTestJSON-824756592 tempest-ServersAdminNegativeTestJSON-824756592-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:03:54.620984 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-ab34cf8c-59c7-4a20-bdf5-478b73c14634 tempest-ServersAdminNegativeTestJSON-824756592 tempest-ServersAdminNegativeTestJSON-824756592-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:03:54.621818 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-ab34cf8c-59c7-4a20-bdf5-478b73c14634 tempest-ServersAdminNegativeTestJSON-824756592 tempest-ServersAdminNegativeTestJSON-824756592-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:03:54.624315 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-ab34cf8c-59c7-4a20-bdf5-478b73c14634 tempest-ServersAdminNegativeTestJSON-824756592 tempest-ServersAdminNegativeTestJSON-824756592-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:03:54.625345 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-ab34cf8c-59c7-4a20-bdf5-478b73c14634 tempest-ServersAdminNegativeTestJSON-824756592 tempest-ServersAdminNegativeTestJSON-824756592-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:03:54.626477 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-c195ec94-8599-43e5-8dc9-7502ba86ffcb tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] 10.222.0.13 "GET /compute/v2.1/servers/992f5ec5-d256-4870-b16d-fc8d9adbd3e7" status: 200 len: 1479 microversion: 2.1 time: 0.898332 Nov 01 19:03:54.637315 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1309/2591] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:03:53 2022] GET /compute/v2.1/servers/992f5ec5-d256-4870-b16d-fc8d9adbd3e7 => generated 1479 bytes in 911 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:03:55.343714 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-ab34cf8c-59c7-4a20-bdf5-478b73c14634 tempest-ServersAdminNegativeTestJSON-824756592 tempest-ServersAdminNegativeTestJSON-824756592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0708fb2fc1df4aa9a9697cbc94acf921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '232745bfe2f3445987fedb91098c84eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:03:55.357758 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-ab34cf8c-59c7-4a20-bdf5-478b73c14634 tempest-ServersAdminNegativeTestJSON-824756592 tempest-ServersAdminNegativeTestJSON-824756592-project] 10.222.0.13 "GET /compute/v2.1/servers/51f5bec0-bd00-4ef2-9424-0dad025c8e29" status: 200 len: 1321 microversion: 2.1 time: 0.764932 Nov 01 19:03:55.358403 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1283/2592] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:03:54 2022] GET /compute/v2.1/servers/51f5bec0-bd00-4ef2-9424-0dad025c8e29 => generated 1321 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:03:55.620813 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-8b788f9f-90c9-42ef-8ca6-206b5815f67e tempest-TenantUsagesTestJSON-700278909 tempest-TenantUsagesTestJSON-700278909-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:03:55.621580 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-8b788f9f-90c9-42ef-8ca6-206b5815f67e tempest-TenantUsagesTestJSON-700278909 tempest-TenantUsagesTestJSON-700278909-project] [instance: 763f688c-9976-4d91-b9cd-c22a9e168086] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:03:55.640231 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-8b788f9f-90c9-42ef-8ca6-206b5815f67e tempest-TenantUsagesTestJSON-700278909 tempest-TenantUsagesTestJSON-700278909-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:03:55.640762 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-8b788f9f-90c9-42ef-8ca6-206b5815f67e tempest-TenantUsagesTestJSON-700278909 tempest-TenantUsagesTestJSON-700278909-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:03:55.641213 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-8b788f9f-90c9-42ef-8ca6-206b5815f67e tempest-TenantUsagesTestJSON-700278909 tempest-TenantUsagesTestJSON-700278909-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:03:55.641934 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-8b788f9f-90c9-42ef-8ca6-206b5815f67e tempest-TenantUsagesTestJSON-700278909 tempest-TenantUsagesTestJSON-700278909-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:03:55.642396 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-8b788f9f-90c9-42ef-8ca6-206b5815f67e tempest-TenantUsagesTestJSON-700278909 tempest-TenantUsagesTestJSON-700278909-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:03:55.642884 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-8b788f9f-90c9-42ef-8ca6-206b5815f67e tempest-TenantUsagesTestJSON-700278909 tempest-TenantUsagesTestJSON-700278909-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:03:55.651177 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-e6fe30ad-f66e-4931-b968-49cb0e538a96 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:03:55.651921 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-e6fe30ad-f66e-4931-b968-49cb0e538a96 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] [instance: 992f5ec5-d256-4870-b16d-fc8d9adbd3e7] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:03:55.663799 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e6fe30ad-f66e-4931-b968-49cb0e538a96 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:03:55.664390 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e6fe30ad-f66e-4931-b968-49cb0e538a96 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:03:55.664871 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e6fe30ad-f66e-4931-b968-49cb0e538a96 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:03:55.665552 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e6fe30ad-f66e-4931-b968-49cb0e538a96 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:03:55.673476 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e6fe30ad-f66e-4931-b968-49cb0e538a96 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:03:55.676852 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e6fe30ad-f66e-4931-b968-49cb0e538a96 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:03:55.912910 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-8b788f9f-90c9-42ef-8ca6-206b5815f67e tempest-TenantUsagesTestJSON-700278909 tempest-TenantUsagesTestJSON-700278909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '556f6f7b8d3745a38734001133ecd70d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a58c7ae460f4022b5d50651df0a486f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:03:55.936175 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-8b788f9f-90c9-42ef-8ca6-206b5815f67e tempest-TenantUsagesTestJSON-700278909 tempest-TenantUsagesTestJSON-700278909-project] 10.222.0.13 "GET /compute/v2.1/servers/763f688c-9976-4d91-b9cd-c22a9e168086" status: 200 len: 1272 microversion: 2.1 time: 0.319791 Nov 01 19:03:55.943651 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1310/2593] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:03:55 2022] GET /compute/v2.1/servers/763f688c-9976-4d91-b9cd-c22a9e168086 => generated 1272 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:03:55.983778 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-e6fe30ad-f66e-4931-b968-49cb0e538a96 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb496b3faac4abbae73d389f2042e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e2520220d454764b8c139a58d78ac83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:03:55.998851 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-e6fe30ad-f66e-4931-b968-49cb0e538a96 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] 10.222.0.13 "GET /compute/v2.1/servers/992f5ec5-d256-4870-b16d-fc8d9adbd3e7" status: 200 len: 1479 microversion: 2.1 time: 0.351460 Nov 01 19:03:56.000134 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1284/2594] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:03:55 2022] GET /compute/v2.1/servers/992f5ec5-d256-4870-b16d-fc8d9adbd3e7 => generated 1479 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:03:56.384057 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-713a4e96-e6d9-4b2c-b06a-358f2e24babd tempest-ServersAdminNegativeTestJSON-824756592 tempest-ServersAdminNegativeTestJSON-824756592-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:03:56.384874 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-713a4e96-e6d9-4b2c-b06a-358f2e24babd tempest-ServersAdminNegativeTestJSON-824756592 tempest-ServersAdminNegativeTestJSON-824756592-project] [instance: 51f5bec0-bd00-4ef2-9424-0dad025c8e29] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:03:56.400304 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-713a4e96-e6d9-4b2c-b06a-358f2e24babd tempest-ServersAdminNegativeTestJSON-824756592 tempest-ServersAdminNegativeTestJSON-824756592-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:03:56.401401 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-713a4e96-e6d9-4b2c-b06a-358f2e24babd tempest-ServersAdminNegativeTestJSON-824756592 tempest-ServersAdminNegativeTestJSON-824756592-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:03:56.404208 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-713a4e96-e6d9-4b2c-b06a-358f2e24babd tempest-ServersAdminNegativeTestJSON-824756592 tempest-ServersAdminNegativeTestJSON-824756592-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:03:56.405621 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-713a4e96-e6d9-4b2c-b06a-358f2e24babd tempest-ServersAdminNegativeTestJSON-824756592 tempest-ServersAdminNegativeTestJSON-824756592-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:03:56.410058 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-713a4e96-e6d9-4b2c-b06a-358f2e24babd tempest-ServersAdminNegativeTestJSON-824756592 tempest-ServersAdminNegativeTestJSON-824756592-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:03:56.411050 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-713a4e96-e6d9-4b2c-b06a-358f2e24babd tempest-ServersAdminNegativeTestJSON-824756592 tempest-ServersAdminNegativeTestJSON-824756592-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:03:56.541924 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [req-c7ca70b6-a946-4f9e-b327-720c54619671 req-aa6edf35-a448-4621-9031-fba7bbb52ab2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "51f5bec0-bd00-4ef2-9424-0dad025c8e29", "name": "network-vif-plugged", "status": "completed", "tag": "2ea05588-365b-4212-a081-271d3bee0810"}]} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:03:56.579162 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-c7ca70b6-a946-4f9e-b327-720c54619671 req-aa6edf35-a448-4621-9031-fba7bbb52ab2 service nova] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:03:56.580726 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-c7ca70b6-a946-4f9e-b327-720c54619671 req-aa6edf35-a448-4621-9031-fba7bbb52ab2 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:03:56.581385 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-c7ca70b6-a946-4f9e-b327-720c54619671 req-aa6edf35-a448-4621-9031-fba7bbb52ab2 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:03:56.603729 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.compute.server_external_events [req-c7ca70b6-a946-4f9e-b327-720c54619671 req-aa6edf35-a448-4621-9031-fba7bbb52ab2 service nova] Creating event network-vif-plugged:2ea05588-365b-4212-a081-271d3bee0810 for instance 51f5bec0-bd00-4ef2-9424-0dad025c8e29 on n-h2-863052-2 Nov 01 19:03:56.613559 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [req-c7ca70b6-a946-4f9e-b327-720c54619671 req-aa6edf35-a448-4621-9031-fba7bbb52ab2 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077041 Nov 01 19:03:56.615792 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1285/2595] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Nov 1 19:03:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:03:56.973582 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-fdb3d499-106a-481b-91e6-5e27412e8995 tempest-TenantUsagesTestJSON-700278909 tempest-TenantUsagesTestJSON-700278909-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:03:56.975499 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-fdb3d499-106a-481b-91e6-5e27412e8995 tempest-TenantUsagesTestJSON-700278909 tempest-TenantUsagesTestJSON-700278909-project] [instance: 763f688c-9976-4d91-b9cd-c22a9e168086] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:03:56.985813 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-fdb3d499-106a-481b-91e6-5e27412e8995 tempest-TenantUsagesTestJSON-700278909 tempest-TenantUsagesTestJSON-700278909-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:03:56.986587 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-fdb3d499-106a-481b-91e6-5e27412e8995 tempest-TenantUsagesTestJSON-700278909 tempest-TenantUsagesTestJSON-700278909-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:03:56.987247 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-fdb3d499-106a-481b-91e6-5e27412e8995 tempest-TenantUsagesTestJSON-700278909 tempest-TenantUsagesTestJSON-700278909-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:03:56.989678 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-fdb3d499-106a-481b-91e6-5e27412e8995 tempest-TenantUsagesTestJSON-700278909 tempest-TenantUsagesTestJSON-700278909-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:03:56.992571 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-fdb3d499-106a-481b-91e6-5e27412e8995 tempest-TenantUsagesTestJSON-700278909 tempest-TenantUsagesTestJSON-700278909-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:03:56.993447 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-fdb3d499-106a-481b-91e6-5e27412e8995 tempest-TenantUsagesTestJSON-700278909 tempest-TenantUsagesTestJSON-700278909-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:03:57.168009 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-fdb3d499-106a-481b-91e6-5e27412e8995 tempest-TenantUsagesTestJSON-700278909 tempest-TenantUsagesTestJSON-700278909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '556f6f7b8d3745a38734001133ecd70d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a58c7ae460f4022b5d50651df0a486f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:03:57.178875 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-fdb3d499-106a-481b-91e6-5e27412e8995 tempest-TenantUsagesTestJSON-700278909 tempest-TenantUsagesTestJSON-700278909-project] 10.222.0.13 "GET /compute/v2.1/servers/763f688c-9976-4d91-b9cd-c22a9e168086" status: 200 len: 1272 microversion: 2.1 time: 0.212528 Nov 01 19:03:57.185440 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1286/2596] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:03:56 2022] GET /compute/v2.1/servers/763f688c-9976-4d91-b9cd-c22a9e168086 => generated 1272 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:03:57.202105 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-74152d6e-e561-4b56-bd89-5194c02b4164 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:03:57.202934 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-74152d6e-e561-4b56-bd89-5194c02b4164 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] [instance: 992f5ec5-d256-4870-b16d-fc8d9adbd3e7] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:03:57.214913 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-74152d6e-e561-4b56-bd89-5194c02b4164 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:03:57.215650 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-74152d6e-e561-4b56-bd89-5194c02b4164 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:03:57.216270 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-74152d6e-e561-4b56-bd89-5194c02b4164 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:03:57.217358 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-74152d6e-e561-4b56-bd89-5194c02b4164 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:03:57.218018 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-74152d6e-e561-4b56-bd89-5194c02b4164 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:03:57.221491 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-74152d6e-e561-4b56-bd89-5194c02b4164 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:03:57.656701 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-74152d6e-e561-4b56-bd89-5194c02b4164 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb496b3faac4abbae73d389f2042e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e2520220d454764b8c139a58d78ac83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:03:57.667352 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-74152d6e-e561-4b56-bd89-5194c02b4164 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] 10.222.0.13 "GET /compute/v2.1/servers/992f5ec5-d256-4870-b16d-fc8d9adbd3e7" status: 200 len: 1464 microversion: 2.1 time: 0.480349 Nov 01 19:03:57.668258 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1287/2597] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:03:57 2022] GET /compute/v2.1/servers/992f5ec5-d256-4870-b16d-fc8d9adbd3e7 => generated 1464 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:03:57.669474 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-74152d6e-e561-4b56-bd89-5194c02b4164 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:03:57.670511 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-74152d6e-e561-4b56-bd89-5194c02b4164 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] 10.222.0.13 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001254 Nov 01 19:03:57.671230 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1288/2598] 10.222.0.13 () {56 vars in 886 bytes} [Tue Nov 1 19:03:57 2022] GET /compute/ => generated 377 bytes in 2 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Nov 01 19:03:57.679781 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-74152d6e-e561-4b56-bd89-5194c02b4164 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:03:57.681228 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-74152d6e-e561-4b56-bd89-5194c02b4164 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] 10.222.0.13 "GET /compute/v2/" status: 200 len: 379 microversion: 2.1 time: 0.001868 Nov 01 19:03:57.694820 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1289/2599] 10.222.0.13 () {54 vars in 1035 bytes} [Tue Nov 1 19:03:57 2022] GET /compute/v2/ => generated 379 bytes in 16 msecs (HTTP/1.1 200) 5 headers in 221 bytes (1 switches on core 0) Nov 01 19:03:57.696421 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-74152d6e-e561-4b56-bd89-5194c02b4164 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:03:57.697703 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-74152d6e-e561-4b56-bd89-5194c02b4164 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] 10.222.0.13 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001709 Nov 01 19:03:57.706127 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1290/2600] 10.222.0.13 () {54 vars in 1041 bytes} [Tue Nov 1 19:03:57 2022] GET /compute/v2.1/ => generated 388 bytes in 10 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:03:57.707786 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-74152d6e-e561-4b56-bd89-5194c02b4164 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:03:57.709052 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-74152d6e-e561-4b56-bd89-5194c02b4164 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] 10.222.0.13 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001501 Nov 01 19:03:57.710869 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1291/2601] 10.222.0.13 () {56 vars in 886 bytes} [Tue Nov 1 19:03:57 2022] GET /compute/ => generated 377 bytes in 4 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Nov 01 19:03:57.732081 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-5b3670bf-856e-4061-8855-bee4bd899431 tempest-ServersAdminTestJSON-831008371 tempest-ServersAdminTestJSON-831008371-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:03:57.759788 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-5b3670bf-856e-4061-8855-bee4bd899431 tempest-ServersAdminTestJSON-831008371 tempest-ServersAdminTestJSON-831008371-project-admin] [instance: 992f5ec5-d256-4870-b16d-fc8d9adbd3e7] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:03:57.787456 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-5b3670bf-856e-4061-8855-bee4bd899431 tempest-ServersAdminTestJSON-831008371 tempest-ServersAdminTestJSON-831008371-project-admin] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:03:57.790040 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-5b3670bf-856e-4061-8855-bee4bd899431 tempest-ServersAdminTestJSON-831008371 tempest-ServersAdminTestJSON-831008371-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:03:57.792905 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-5b3670bf-856e-4061-8855-bee4bd899431 tempest-ServersAdminTestJSON-831008371 tempest-ServersAdminTestJSON-831008371-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:03:57.794465 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-5b3670bf-856e-4061-8855-bee4bd899431 tempest-ServersAdminTestJSON-831008371 tempest-ServersAdminTestJSON-831008371-project-admin] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:03:57.797071 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-5b3670bf-856e-4061-8855-bee4bd899431 tempest-ServersAdminTestJSON-831008371 tempest-ServersAdminTestJSON-831008371-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:03:57.800339 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-5b3670bf-856e-4061-8855-bee4bd899431 tempest-ServersAdminTestJSON-831008371 tempest-ServersAdminTestJSON-831008371-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:03:57.923802 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-713a4e96-e6d9-4b2c-b06a-358f2e24babd tempest-ServersAdminNegativeTestJSON-824756592 tempest-ServersAdminNegativeTestJSON-824756592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0708fb2fc1df4aa9a9697cbc94acf921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '232745bfe2f3445987fedb91098c84eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:03:57.958818 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-713a4e96-e6d9-4b2c-b06a-358f2e24babd tempest-ServersAdminNegativeTestJSON-824756592 tempest-ServersAdminNegativeTestJSON-824756592-project] 10.222.0.13 "GET /compute/v2.1/servers/51f5bec0-bd00-4ef2-9424-0dad025c8e29" status: 200 len: 1321 microversion: 2.1 time: 1.579370 Nov 01 19:03:57.975100 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1311/2602] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:03:56 2022] GET /compute/v2.1/servers/51f5bec0-bd00-4ef2-9424-0dad025c8e29 => generated 1321 bytes in 1592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:03:57.985158 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-5b3670bf-856e-4061-8855-bee4bd899431 tempest-ServersAdminTestJSON-831008371 tempest-ServersAdminTestJSON-831008371-project-admin] 10.222.0.13 "POST /compute/v2.1/servers/992f5ec5-d256-4870-b16d-fc8d9adbd3e7/action" status: 202 len: 0 microversion: 2.1 time: 0.266107 Nov 01 19:03:57.986250 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1292/2603] 10.222.0.13 () {60 vars in 1278 bytes} [Tue Nov 1 19:03:57 2022] POST /compute/v2.1/servers/992f5ec5-d256-4870-b16d-fc8d9adbd3e7/action => generated 0 bytes in 275 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 01 19:03:57.998338 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-e3efd3db-a9db-403d-b7f4-d1d6a9a4cebc tempest-ServersAdminTestJSON-831008371 tempest-ServersAdminTestJSON-831008371-project-admin] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:03:57.999174 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-e3efd3db-a9db-403d-b7f4-d1d6a9a4cebc tempest-ServersAdminTestJSON-831008371 tempest-ServersAdminTestJSON-831008371-project-admin] [instance: 992f5ec5-d256-4870-b16d-fc8d9adbd3e7] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:03:58.012599 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-e3efd3db-a9db-403d-b7f4-d1d6a9a4cebc tempest-ServersAdminTestJSON-831008371 tempest-ServersAdminTestJSON-831008371-project-admin] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:03:58.013265 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-e3efd3db-a9db-403d-b7f4-d1d6a9a4cebc tempest-ServersAdminTestJSON-831008371 tempest-ServersAdminTestJSON-831008371-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:03:58.014417 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-e3efd3db-a9db-403d-b7f4-d1d6a9a4cebc tempest-ServersAdminTestJSON-831008371 tempest-ServersAdminTestJSON-831008371-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:03:58.015776 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-e3efd3db-a9db-403d-b7f4-d1d6a9a4cebc tempest-ServersAdminTestJSON-831008371 tempest-ServersAdminTestJSON-831008371-project-admin] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:03:58.019515 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-e3efd3db-a9db-403d-b7f4-d1d6a9a4cebc tempest-ServersAdminTestJSON-831008371 tempest-ServersAdminTestJSON-831008371-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:03:58.020991 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-e3efd3db-a9db-403d-b7f4-d1d6a9a4cebc tempest-ServersAdminTestJSON-831008371 tempest-ServersAdminTestJSON-831008371-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:03:58.124915 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-e3efd3db-a9db-403d-b7f4-d1d6a9a4cebc tempest-ServersAdminTestJSON-831008371 tempest-ServersAdminTestJSON-831008371-project-admin] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:03:58.125416 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-e3efd3db-a9db-403d-b7f4-d1d6a9a4cebc tempest-ServersAdminTestJSON-831008371 tempest-ServersAdminTestJSON-831008371-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:03:58.125866 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-e3efd3db-a9db-403d-b7f4-d1d6a9a4cebc tempest-ServersAdminTestJSON-831008371 tempest-ServersAdminTestJSON-831008371-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:03:58.128828 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.objects.instance [None req-e3efd3db-a9db-403d-b7f4-d1d6a9a4cebc tempest-ServersAdminTestJSON-831008371 tempest-ServersAdminTestJSON-831008371-project-admin] Lazy-loading 'fault' on Instance uuid 992f5ec5-d256-4870-b16d-fc8d9adbd3e7 {{(pid=121403) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 01 19:03:58.212175 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-51d9b6b9-7255-4841-b35f-cb2602c7ae52 tempest-TenantUsagesTestJSON-700278909 tempest-TenantUsagesTestJSON-700278909-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:03:58.212836 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-51d9b6b9-7255-4841-b35f-cb2602c7ae52 tempest-TenantUsagesTestJSON-700278909 tempest-TenantUsagesTestJSON-700278909-project] [instance: 763f688c-9976-4d91-b9cd-c22a9e168086] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:03:58.226014 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-51d9b6b9-7255-4841-b35f-cb2602c7ae52 tempest-TenantUsagesTestJSON-700278909 tempest-TenantUsagesTestJSON-700278909-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:03:58.226919 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-51d9b6b9-7255-4841-b35f-cb2602c7ae52 tempest-TenantUsagesTestJSON-700278909 tempest-TenantUsagesTestJSON-700278909-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:03:58.228608 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-51d9b6b9-7255-4841-b35f-cb2602c7ae52 tempest-TenantUsagesTestJSON-700278909 tempest-TenantUsagesTestJSON-700278909-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:03:58.229534 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-51d9b6b9-7255-4841-b35f-cb2602c7ae52 tempest-TenantUsagesTestJSON-700278909 tempest-TenantUsagesTestJSON-700278909-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:03:58.232612 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-51d9b6b9-7255-4841-b35f-cb2602c7ae52 tempest-TenantUsagesTestJSON-700278909 tempest-TenantUsagesTestJSON-700278909-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:03:58.233280 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-51d9b6b9-7255-4841-b35f-cb2602c7ae52 tempest-TenantUsagesTestJSON-700278909 tempest-TenantUsagesTestJSON-700278909-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:03:58.566891 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-51d9b6b9-7255-4841-b35f-cb2602c7ae52 tempest-TenantUsagesTestJSON-700278909 tempest-TenantUsagesTestJSON-700278909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '556f6f7b8d3745a38734001133ecd70d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a58c7ae460f4022b5d50651df0a486f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:03:58.596790 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-51d9b6b9-7255-4841-b35f-cb2602c7ae52 tempest-TenantUsagesTestJSON-700278909 tempest-TenantUsagesTestJSON-700278909-project] 10.222.0.13 "GET /compute/v2.1/servers/763f688c-9976-4d91-b9cd-c22a9e168086" status: 200 len: 1314 microversion: 2.1 time: 0.388139 Nov 01 19:03:58.617327 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1293/2604] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:03:58 2022] GET /compute/v2.1/servers/763f688c-9976-4d91-b9cd-c22a9e168086 => generated 1314 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 19:03:58.989790 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-2ea53521-7661-49ed-8111-991b7aa55b8f tempest-ServersAdminNegativeTestJSON-824756592 tempest-ServersAdminNegativeTestJSON-824756592-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:03:58.990493 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-2ea53521-7661-49ed-8111-991b7aa55b8f tempest-ServersAdminNegativeTestJSON-824756592 tempest-ServersAdminNegativeTestJSON-824756592-project] [instance: 51f5bec0-bd00-4ef2-9424-0dad025c8e29] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:03:59.003021 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-e3efd3db-a9db-403d-b7f4-d1d6a9a4cebc tempest-ServersAdminTestJSON-831008371 tempest-ServersAdminTestJSON-831008371-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/992f5ec5-d256-4870-b16d-fc8d9adbd3e7" status: 200 len: 1598 microversion: 2.1 time: 1.009814 Nov 01 19:03:59.008128 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2ea53521-7661-49ed-8111-991b7aa55b8f tempest-ServersAdminNegativeTestJSON-824756592 tempest-ServersAdminNegativeTestJSON-824756592-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:03:59.028113 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2ea53521-7661-49ed-8111-991b7aa55b8f tempest-ServersAdminNegativeTestJSON-824756592 tempest-ServersAdminNegativeTestJSON-824756592-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:03:59.036684 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1312/2605] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:03:57 2022] GET /compute/v2.1/servers/992f5ec5-d256-4870-b16d-fc8d9adbd3e7 => generated 1598 bytes in 1046 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:03:59.038218 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2ea53521-7661-49ed-8111-991b7aa55b8f tempest-ServersAdminNegativeTestJSON-824756592 tempest-ServersAdminNegativeTestJSON-824756592-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.027s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:03:59.040812 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2ea53521-7661-49ed-8111-991b7aa55b8f tempest-ServersAdminNegativeTestJSON-824756592 tempest-ServersAdminNegativeTestJSON-824756592-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:03:59.044192 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2ea53521-7661-49ed-8111-991b7aa55b8f tempest-ServersAdminNegativeTestJSON-824756592 tempest-ServersAdminNegativeTestJSON-824756592-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:03:59.046496 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2ea53521-7661-49ed-8111-991b7aa55b8f tempest-ServersAdminNegativeTestJSON-824756592 tempest-ServersAdminNegativeTestJSON-824756592-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:03:59.072672 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-564dd666-bd7b-4533-913a-48334c93f951 tempest-ServersAdminTestJSON-831008371 tempest-ServersAdminTestJSON-831008371-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "active"}} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:03:59.091480 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-564dd666-bd7b-4533-913a-48334c93f951 tempest-ServersAdminTestJSON-831008371 tempest-ServersAdminTestJSON-831008371-project-admin] [instance: 992f5ec5-d256-4870-b16d-fc8d9adbd3e7] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:03:59.124115 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-564dd666-bd7b-4533-913a-48334c93f951 tempest-ServersAdminTestJSON-831008371 tempest-ServersAdminTestJSON-831008371-project-admin] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:03:59.129024 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-564dd666-bd7b-4533-913a-48334c93f951 tempest-ServersAdminTestJSON-831008371 tempest-ServersAdminTestJSON-831008371-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:03:59.130102 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-564dd666-bd7b-4533-913a-48334c93f951 tempest-ServersAdminTestJSON-831008371 tempest-ServersAdminTestJSON-831008371-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:03:59.131364 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-564dd666-bd7b-4533-913a-48334c93f951 tempest-ServersAdminTestJSON-831008371 tempest-ServersAdminTestJSON-831008371-project-admin] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:03:59.132831 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-564dd666-bd7b-4533-913a-48334c93f951 tempest-ServersAdminTestJSON-831008371 tempest-ServersAdminTestJSON-831008371-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:03:59.134951 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-564dd666-bd7b-4533-913a-48334c93f951 tempest-ServersAdminTestJSON-831008371 tempest-ServersAdminTestJSON-831008371-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:03:59.287574 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-564dd666-bd7b-4533-913a-48334c93f951 tempest-ServersAdminTestJSON-831008371 tempest-ServersAdminTestJSON-831008371-project-admin] 10.222.0.13 "POST /compute/v2.1/servers/992f5ec5-d256-4870-b16d-fc8d9adbd3e7/action" status: 202 len: 0 microversion: 2.1 time: 0.248896 Nov 01 19:03:59.288736 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1313/2606] 10.222.0.13 () {60 vars in 1278 bytes} [Tue Nov 1 19:03:59 2022] POST /compute/v2.1/servers/992f5ec5-d256-4870-b16d-fc8d9adbd3e7/action => generated 0 bytes in 251 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 01 19:03:59.307654 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-759e0eaf-097c-4716-83e3-10f301beaad2 tempest-ServersAdminTestJSON-831008371 tempest-ServersAdminTestJSON-831008371-project-admin] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:03:59.308927 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-759e0eaf-097c-4716-83e3-10f301beaad2 tempest-ServersAdminTestJSON-831008371 tempest-ServersAdminTestJSON-831008371-project-admin] [instance: 992f5ec5-d256-4870-b16d-fc8d9adbd3e7] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:03:59.320749 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-759e0eaf-097c-4716-83e3-10f301beaad2 tempest-ServersAdminTestJSON-831008371 tempest-ServersAdminTestJSON-831008371-project-admin] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:03:59.322167 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-759e0eaf-097c-4716-83e3-10f301beaad2 tempest-ServersAdminTestJSON-831008371 tempest-ServersAdminTestJSON-831008371-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:03:59.322999 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-759e0eaf-097c-4716-83e3-10f301beaad2 tempest-ServersAdminTestJSON-831008371 tempest-ServersAdminTestJSON-831008371-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:03:59.324047 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-759e0eaf-097c-4716-83e3-10f301beaad2 tempest-ServersAdminTestJSON-831008371 tempest-ServersAdminTestJSON-831008371-project-admin] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:03:59.324757 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-759e0eaf-097c-4716-83e3-10f301beaad2 tempest-ServersAdminTestJSON-831008371 tempest-ServersAdminTestJSON-831008371-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:03:59.325380 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-759e0eaf-097c-4716-83e3-10f301beaad2 tempest-ServersAdminTestJSON-831008371 tempest-ServersAdminTestJSON-831008371-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:03:59.500077 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-2ea53521-7661-49ed-8111-991b7aa55b8f tempest-ServersAdminNegativeTestJSON-824756592 tempest-ServersAdminNegativeTestJSON-824756592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0708fb2fc1df4aa9a9697cbc94acf921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '232745bfe2f3445987fedb91098c84eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:03:59.513583 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-2ea53521-7661-49ed-8111-991b7aa55b8f tempest-ServersAdminNegativeTestJSON-824756592 tempest-ServersAdminNegativeTestJSON-824756592-project] 10.222.0.13 "GET /compute/v2.1/servers/51f5bec0-bd00-4ef2-9424-0dad025c8e29" status: 200 len: 1470 microversion: 2.1 time: 0.528699 Nov 01 19:03:59.523051 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1294/2607] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:03:58 2022] GET /compute/v2.1/servers/51f5bec0-bd00-4ef2-9424-0dad025c8e29 => generated 1470 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:03:59.962950 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-f41691d7-69f2-487c-8b9a-237d2bf338c5 tempest-ServersAdminNegativeTestJSON-309505279 tempest-ServersAdminNegativeTestJSON-309505279-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:03:59.963692 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-f41691d7-69f2-487c-8b9a-237d2bf338c5 tempest-ServersAdminNegativeTestJSON-309505279 tempest-ServersAdminNegativeTestJSON-309505279-project-admin] [instance: be0557d1-a2b6-45fb-8924-1f3234609161] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:03:59.973351 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.wsgi [None req-f41691d7-69f2-487c-8b9a-237d2bf338c5 tempest-ServersAdminNegativeTestJSON-309505279 tempest-ServersAdminNegativeTestJSON-309505279-project-admin] HTTP exception thrown: Instance be0557d1-a2b6-45fb-8924-1f3234609161 could not be found. Nov 01 19:03:59.979410 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-f41691d7-69f2-487c-8b9a-237d2bf338c5 tempest-ServersAdminNegativeTestJSON-309505279 tempest-ServersAdminNegativeTestJSON-309505279-project-admin] Request method failure captured: Nov 01 19:03:59.979410 n-d-863052-2 devstack@n-api.service[121402]: request: POST /compute/v2.1/servers/be0557d1-a2b6-45fb-8924-1f3234609161/action HTTP/1.1 Nov 01 19:03:59.979410 n-d-863052-2 devstack@n-api.service[121402]: Accept: application/json Nov 01 19:03:59.979410 n-d-863052-2 devstack@n-api.service[121402]: Accept-Encoding: identity Nov 01 19:03:59.979410 n-d-863052-2 devstack@n-api.service[121402]: Connection: close Nov 01 19:03:59.979410 n-d-863052-2 devstack@n-api.service[121402]: Content-Length: 15 Nov 01 19:03:59.979410 n-d-863052-2 devstack@n-api.service[121402]: Content-Type: application/json Nov 01 19:03:59.979410 n-d-863052-2 devstack@n-api.service[121402]: Host: 10.222.0.13 Nov 01 19:03:59.979410 n-d-863052-2 devstack@n-api.service[121402]: Openstack-System-Scope: None Nov 01 19:03:59.979410 n-d-863052-2 devstack@n-api.service[121402]: User-Agent: python-urllib3/1.26.12 Nov 01 19:03:59.979410 n-d-863052-2 devstack@n-api.service[121402]: X-Auth-Token: gAAAAABjYW2EGKFpU-QpwVEirr69WVI6bYHwk0Kede96n4su2iijiKcQ1zb6bOyaCtgjZMaJ-Q59prhyqCJnJbM-X-w1iT8LpCZShjaOUpv--KpdOnG1rh0eIANi18nn0sY3ibxUMsuchBSD7QijJY2ZLVCZnKN-GRyWrrcRDzoqeFEIfm4P8Qc Nov 01 19:03:59.979410 n-d-863052-2 devstack@n-api.service[121402]: X-Domain-Id: None Nov 01 19:03:59.979410 n-d-863052-2 devstack@n-api.service[121402]: X-Domain-Name: None Nov 01 19:03:59.979410 n-d-863052-2 devstack@n-api.service[121402]: X-Identity-Status: Confirmed Nov 01 19:03:59.979410 n-d-863052-2 devstack@n-api.service[121402]: X-Is-Admin-Project: True Nov 01 19:03:59.979410 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Domain-Id: default Nov 01 19:03:59.979410 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Domain-Name: Default Nov 01 19:03:59.979410 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Id: 0537b78b4b8c472da96058fbbb155aaf Nov 01 19:03:59.979410 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-309505279 Nov 01 19:03:59.979410 n-d-863052-2 devstack@n-api.service[121402]: X-Role: admin,member,reader Nov 01 19:03:59.979410 n-d-863052-2 devstack@n-api.service[121402]: X-Roles: admin,member,reader Nov 01 19:03:59.979410 n-d-863052-2 devstack@n-api.service[121402]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/0537b78b4b8c472da96058fbbb155aaf"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/0537b78b4b8c472da96058fbbb155aaf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_0537b78b4b8c472da96058fbbb155aaf", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/0537b78b4b8c472da96058fbbb155aaf"}]}] Nov 01 19:03:59.979410 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant: tempest-ServersAdminNegativeTestJSON-309505279 Nov 01 19:03:59.979410 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant-Id: 0537b78b4b8c472da96058fbbb155aaf Nov 01 19:03:59.979410 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-309505279 Nov 01 19:03:59.979410 n-d-863052-2 devstack@n-api.service[121402]: X-User: tempest-ServersAdminNegativeTestJSON-309505279-project-admin Nov 01 19:03:59.979410 n-d-863052-2 devstack@n-api.service[121402]: X-User-Domain-Id: default Nov 01 19:03:59.979410 n-d-863052-2 devstack@n-api.service[121402]: X-User-Domain-Name: Default Nov 01 19:03:59.979410 n-d-863052-2 devstack@n-api.service[121402]: X-User-Id: 25c5f90c12734504bf38a75d337b276d Nov 01 19:03:59.979410 n-d-863052-2 devstack@n-api.service[121402]: X-User-Name: tempest-ServersAdminNegativeTestJSON-309505279-project-admin Nov 01 19:03:59.979410 n-d-863052-2 devstack@n-api.service[121402]: Nov 01 19:03:59.979410 n-d-863052-2 devstack@n-api.service[121402]: {"migrate": {}} Nov 01 19:03:59.979410 n-d-863052-2 devstack@n-api.service[121402]: method: > Nov 01 19:03:59.979410 n-d-863052-2 devstack@n-api.service[121402]: exception: Instance be0557d1-a2b6-45fb-8924-1f3234609161 could not be found. Nov 01 19:03:59.979410 n-d-863052-2 devstack@n-api.service[121402]: action_args: {'id': 'be0557d1-a2b6-45fb-8924-1f3234609161', 'body': {'migrate': {}}} Nov 01 19:03:59.979410 n-d-863052-2 devstack@n-api.service[121402]: {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 01 19:03:59.979410 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:03:59.979410 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 01 19:03:59.979410 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 01 19:03:59.979410 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 01 19:03:59.979410 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 01 19:03:59.979410 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Nov 01 19:03:59.979410 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Nov 01 19:03:59.979410 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance be0557d1-a2b6-45fb-8924-1f3234609161 could not be found. Nov 01 19:03:59.979410 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:03:59.979410 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:03:59.979410 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:03:59.979410 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:03:59.979410 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:03:59.979410 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:03:59.979410 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 01 19:03:59.979410 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 01 19:03:59.979410 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 01 19:03:59.979410 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 01 19:03:59.979410 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 01 19:03:59.979410 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 01 19:03:59.979410 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 47, in _migrate Nov 01 19:03:59.979410 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id, Nov 01 19:03:59.979410 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 01 19:03:59.979410 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 01 19:03:59.979410 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance be0557d1-a2b6-45fb-8924-1f3234609161 could not be found. Nov 01 19:03:59.979410 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:03:59.979410 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:03:59.979410 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:03:59.979410 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:03:59.983696 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:03:59.983696 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:03:59.983696 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 01 19:03:59.983696 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 01 19:03:59.983696 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance be0557d1-a2b6-45fb-8924-1f3234609161 could not be found. Nov 01 19:03:59.983696 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:03:59.986204 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-f41691d7-69f2-487c-8b9a-237d2bf338c5 tempest-ServersAdminNegativeTestJSON-309505279 tempest-ServersAdminNegativeTestJSON-309505279-project-admin] Returning 404 to user: Instance be0557d1-a2b6-45fb-8924-1f3234609161 could not be found. {{(pid=121402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 01 19:03:59.987325 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-f41691d7-69f2-487c-8b9a-237d2bf338c5 tempest-ServersAdminNegativeTestJSON-309505279 tempest-ServersAdminNegativeTestJSON-309505279-project-admin] 10.222.0.13 "POST /compute/v2.1/servers/be0557d1-a2b6-45fb-8924-1f3234609161/action" status: 404 len: 111 microversion: 2.1 time: 0.441921 Nov 01 19:03:59.998067 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1295/2608] 10.222.0.13 () {60 vars in 1278 bytes} [Tue Nov 1 19:03:59 2022] POST /compute/v2.1/servers/be0557d1-a2b6-45fb-8924-1f3234609161/action => generated 111 bytes in 453 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 01 19:04:00.004370 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-e07e235e-3649-45ae-b0ca-5d0863b08cce tempest-TenantUsagesTestJSON-700278909 tempest-TenantUsagesTestJSON-700278909-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:04:00.005187 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-e07e235e-3649-45ae-b0ca-5d0863b08cce tempest-TenantUsagesTestJSON-700278909 tempest-TenantUsagesTestJSON-700278909-project] [instance: 763f688c-9976-4d91-b9cd-c22a9e168086] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:04:00.013923 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e07e235e-3649-45ae-b0ca-5d0863b08cce tempest-TenantUsagesTestJSON-700278909 tempest-TenantUsagesTestJSON-700278909-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:04:00.014675 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e07e235e-3649-45ae-b0ca-5d0863b08cce tempest-TenantUsagesTestJSON-700278909 tempest-TenantUsagesTestJSON-700278909-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:04:00.015308 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e07e235e-3649-45ae-b0ca-5d0863b08cce tempest-TenantUsagesTestJSON-700278909 tempest-TenantUsagesTestJSON-700278909-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:04:00.016160 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e07e235e-3649-45ae-b0ca-5d0863b08cce tempest-TenantUsagesTestJSON-700278909 tempest-TenantUsagesTestJSON-700278909-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:04:00.016813 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e07e235e-3649-45ae-b0ca-5d0863b08cce tempest-TenantUsagesTestJSON-700278909 tempest-TenantUsagesTestJSON-700278909-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:04:00.017393 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e07e235e-3649-45ae-b0ca-5d0863b08cce tempest-TenantUsagesTestJSON-700278909 tempest-TenantUsagesTestJSON-700278909-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:04:00.061553 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-759e0eaf-097c-4716-83e3-10f301beaad2 tempest-ServersAdminTestJSON-831008371 tempest-ServersAdminTestJSON-831008371-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/992f5ec5-d256-4870-b16d-fc8d9adbd3e7" status: 200 len: 1615 microversion: 2.1 time: 0.759004 Nov 01 19:04:00.062141 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1314/2609] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:03:59 2022] GET /compute/v2.1/servers/992f5ec5-d256-4870-b16d-fc8d9adbd3e7 => generated 1615 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:04:00.090497 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-64f84846-5642-4b4f-9ac0-5418bfed7932 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:04:00.093387 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-64f84846-5642-4b4f-9ac0-5418bfed7932 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] [instance: 46a040e6-2750-47b4-b8e2-757b92f1adf1] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:04:00.103461 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-64f84846-5642-4b4f-9ac0-5418bfed7932 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:04:00.106759 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-64f84846-5642-4b4f-9ac0-5418bfed7932 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:04:00.107544 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-64f84846-5642-4b4f-9ac0-5418bfed7932 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:04:00.109407 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-64f84846-5642-4b4f-9ac0-5418bfed7932 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:04:00.111002 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-64f84846-5642-4b4f-9ac0-5418bfed7932 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:04:00.111583 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-64f84846-5642-4b4f-9ac0-5418bfed7932 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:04:00.170651 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-64f84846-5642-4b4f-9ac0-5418bfed7932 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] [instance: 46a040e6-2750-47b4-b8e2-757b92f1adf1] Going to try to terminate instance {{(pid=121403) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 01 19:04:00.173747 n-d-863052-2 devstack@n-api.service[121403]: DEBUG dbcounter [-] [121403] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=1,nova_cell1:UPDATE=2 {{(pid=121403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 19:04:00.349280 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-64f84846-5642-4b4f-9ac0-5418bfed7932 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] 10.222.0.13 "DELETE /compute/v2.1/servers/46a040e6-2750-47b4-b8e2-757b92f1adf1" status: 204 len: 0 microversion: 2.1 time: 0.262358 Nov 01 19:04:00.353339 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1315/2610] 10.222.0.13 () {58 vars in 1239 bytes} [Tue Nov 1 19:04:00 2022] DELETE /compute/v2.1/servers/46a040e6-2750-47b4-b8e2-757b92f1adf1 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 01 19:04:00.359341 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-1a435ed7-11b4-4e33-a171-789e4054447e tempest-ServersAdminNegativeTestJSON-824756592 tempest-ServersAdminNegativeTestJSON-824756592-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-1351701064", "imageRef": "2d4a0047-1b9e-445f-8af8-1b5c9d93e881", "flavorRef": "452"}} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:04:00.426276 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-e07e235e-3649-45ae-b0ca-5d0863b08cce tempest-TenantUsagesTestJSON-700278909 tempest-TenantUsagesTestJSON-700278909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '556f6f7b8d3745a38734001133ecd70d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a58c7ae460f4022b5d50651df0a486f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:04:00.442863 n-d-863052-2 devstack@n-api.service[121402]: DEBUG dbcounter [-] [121402] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=1,nova_cell1:UPDATE=2 {{(pid=121402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 19:04:00.444734 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.network.neutron [None req-1a435ed7-11b4-4e33-a171-789e4054447e tempest-ServersAdminNegativeTestJSON-824756592 tempest-ServersAdminNegativeTestJSON-824756592-project] validate_networks() for None {{(pid=121403) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 01 19:04:00.447272 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-e07e235e-3649-45ae-b0ca-5d0863b08cce tempest-TenantUsagesTestJSON-700278909 tempest-TenantUsagesTestJSON-700278909-project] 10.222.0.13 "GET /compute/v2.1/servers/763f688c-9976-4d91-b9cd-c22a9e168086" status: 200 len: 1314 microversion: 2.1 time: 0.446573 Nov 01 19:04:00.460373 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1296/2611] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:03:59 2022] GET /compute/v2.1/servers/763f688c-9976-4d91-b9cd-c22a9e168086 => generated 1314 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:04:00.481149 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-301dcc88-b13d-4d0c-af3b-eb3809d09f1f tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:04:00.482483 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-301dcc88-b13d-4d0c-af3b-eb3809d09f1f tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] [instance: 46a040e6-2750-47b4-b8e2-757b92f1adf1] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:04:00.492092 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-301dcc88-b13d-4d0c-af3b-eb3809d09f1f tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:04:00.492885 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-301dcc88-b13d-4d0c-af3b-eb3809d09f1f tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:04:00.493538 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-301dcc88-b13d-4d0c-af3b-eb3809d09f1f tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:04:00.497830 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-301dcc88-b13d-4d0c-af3b-eb3809d09f1f tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:04:00.498558 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-301dcc88-b13d-4d0c-af3b-eb3809d09f1f tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:04:00.499211 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-301dcc88-b13d-4d0c-af3b-eb3809d09f1f tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:04:00.624478 n-d-863052-2 devstack@n-api.service[121402]: DEBUG dbcounter [-] [121402] Writing DB stats nova_cell0:SELECT=2 {{(pid=121402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 19:04:01.084894 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-301dcc88-b13d-4d0c-af3b-eb3809d09f1f tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb496b3faac4abbae73d389f2042e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e2520220d454764b8c139a58d78ac83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:04:01.101880 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-301dcc88-b13d-4d0c-af3b-eb3809d09f1f tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] 10.222.0.13 "GET /compute/v2.1/servers/46a040e6-2750-47b4-b8e2-757b92f1adf1" status: 200 len: 1470 microversion: 2.1 time: 0.639199 Nov 01 19:04:01.102782 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1297/2612] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:04:00 2022] GET /compute/v2.1/servers/46a040e6-2750-47b4-b8e2-757b92f1adf1 => generated 1470 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:04:01.480969 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-4ec1dbbd-9899-48dc-ac72-9f5671d1243e tempest-TenantUsagesTestJSON-700278909 tempest-TenantUsagesTestJSON-700278909-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:04:01.483090 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-4ec1dbbd-9899-48dc-ac72-9f5671d1243e tempest-TenantUsagesTestJSON-700278909 tempest-TenantUsagesTestJSON-700278909-project] [instance: 763f688c-9976-4d91-b9cd-c22a9e168086] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:04:01.503069 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-4ec1dbbd-9899-48dc-ac72-9f5671d1243e tempest-TenantUsagesTestJSON-700278909 tempest-TenantUsagesTestJSON-700278909-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:04:01.503963 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-4ec1dbbd-9899-48dc-ac72-9f5671d1243e tempest-TenantUsagesTestJSON-700278909 tempest-TenantUsagesTestJSON-700278909-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:04:01.504702 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-4ec1dbbd-9899-48dc-ac72-9f5671d1243e tempest-TenantUsagesTestJSON-700278909 tempest-TenantUsagesTestJSON-700278909-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:04:01.505633 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-4ec1dbbd-9899-48dc-ac72-9f5671d1243e tempest-TenantUsagesTestJSON-700278909 tempest-TenantUsagesTestJSON-700278909-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:04:01.507563 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-4ec1dbbd-9899-48dc-ac72-9f5671d1243e tempest-TenantUsagesTestJSON-700278909 tempest-TenantUsagesTestJSON-700278909-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:04:01.508491 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-4ec1dbbd-9899-48dc-ac72-9f5671d1243e tempest-TenantUsagesTestJSON-700278909 tempest-TenantUsagesTestJSON-700278909-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:04:01.514212 n-d-863052-2 devstack@n-api.service[121402]: DEBUG dbcounter [-] [121402] Writing DB stats nova_cell0:SELECT=8 {{(pid=121402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 19:04:01.858739 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-4ec1dbbd-9899-48dc-ac72-9f5671d1243e tempest-TenantUsagesTestJSON-700278909 tempest-TenantUsagesTestJSON-700278909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '556f6f7b8d3745a38734001133ecd70d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a58c7ae460f4022b5d50651df0a486f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:04:01.868848 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-4ec1dbbd-9899-48dc-ac72-9f5671d1243e tempest-TenantUsagesTestJSON-700278909 tempest-TenantUsagesTestJSON-700278909-project] 10.222.0.13 "GET /compute/v2.1/servers/763f688c-9976-4d91-b9cd-c22a9e168086" status: 200 len: 1314 microversion: 2.1 time: 0.395495 Nov 01 19:04:01.873636 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1298/2613] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:04:01 2022] GET /compute/v2.1/servers/763f688c-9976-4d91-b9cd-c22a9e168086 => generated 1314 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:04:02.088337 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.virt.hardware [None req-1a435ed7-11b4-4e33-a171-789e4054447e tempest-ServersAdminNegativeTestJSON-824756592 tempest-ServersAdminNegativeTestJSON-824756592-project] Flavor limits 0:0:0 {{(pid=121403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 01 19:04:02.089263 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.virt.hardware [None req-1a435ed7-11b4-4e33-a171-789e4054447e tempest-ServersAdminNegativeTestJSON-824756592 tempest-ServersAdminNegativeTestJSON-824756592-project] Image limits 0:0:0 {{(pid=121403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 01 19:04:02.090032 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.virt.hardware [None req-1a435ed7-11b4-4e33-a171-789e4054447e tempest-ServersAdminNegativeTestJSON-824756592 tempest-ServersAdminNegativeTestJSON-824756592-project] Flavor pref 0:0:0 {{(pid=121403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 01 19:04:02.091292 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.virt.hardware [None req-1a435ed7-11b4-4e33-a171-789e4054447e tempest-ServersAdminNegativeTestJSON-824756592 tempest-ServersAdminNegativeTestJSON-824756592-project] Image pref 0:0:0 {{(pid=121403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 01 19:04:02.092325 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.virt.hardware [None req-1a435ed7-11b4-4e33-a171-789e4054447e tempest-ServersAdminNegativeTestJSON-824756592 tempest-ServersAdminNegativeTestJSON-824756592-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 01 19:04:02.107817 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-1a435ed7-11b4-4e33-a171-789e4054447e tempest-ServersAdminNegativeTestJSON-824756592 tempest-ServersAdminNegativeTestJSON-824756592-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:04:02.110786 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-1a435ed7-11b4-4e33-a171-789e4054447e tempest-ServersAdminNegativeTestJSON-824756592 tempest-ServersAdminNegativeTestJSON-824756592-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:04:02.112461 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-1a435ed7-11b4-4e33-a171-789e4054447e tempest-ServersAdminNegativeTestJSON-824756592 tempest-ServersAdminNegativeTestJSON-824756592-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:04:02.115434 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-1a435ed7-11b4-4e33-a171-789e4054447e tempest-ServersAdminNegativeTestJSON-824756592 tempest-ServersAdminNegativeTestJSON-824756592-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:04:02.115914 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-1a435ed7-11b4-4e33-a171-789e4054447e tempest-ServersAdminNegativeTestJSON-824756592 tempest-ServersAdminNegativeTestJSON-824756592-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:04:02.116349 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-1a435ed7-11b4-4e33-a171-789e4054447e tempest-ServersAdminNegativeTestJSON-824756592 tempest-ServersAdminNegativeTestJSON-824756592-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:04:02.126274 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-9505d9c7-e6e6-4bff-814c-444f2b58e493 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:04:02.128247 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-9505d9c7-e6e6-4bff-814c-444f2b58e493 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] [instance: 46a040e6-2750-47b4-b8e2-757b92f1adf1] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:04:02.148818 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-9505d9c7-e6e6-4bff-814c-444f2b58e493 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:04:02.148818 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-9505d9c7-e6e6-4bff-814c-444f2b58e493 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:04:02.148818 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-9505d9c7-e6e6-4bff-814c-444f2b58e493 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:04:02.156500 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-9505d9c7-e6e6-4bff-814c-444f2b58e493 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:04:02.157210 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-9505d9c7-e6e6-4bff-814c-444f2b58e493 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:04:02.157662 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-9505d9c7-e6e6-4bff-814c-444f2b58e493 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:04:02.195592 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.quota [None req-1a435ed7-11b4-4e33-a171-789e4054447e tempest-ServersAdminNegativeTestJSON-824756592 tempest-ServersAdminNegativeTestJSON-824756592-project] Getting quotas for project 232745bfe2f3445987fedb91098c84eb. Resources: {'cores', 'ram', 'instances'} {{(pid=121403) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 01 19:04:02.208857 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.quota [None req-1a435ed7-11b4-4e33-a171-789e4054447e tempest-ServersAdminNegativeTestJSON-824756592 tempest-ServersAdminNegativeTestJSON-824756592-project] Getting quotas for user 0708fb2fc1df4aa9a9697cbc94acf921 and project 232745bfe2f3445987fedb91098c84eb. Resources: {'cores', 'ram', 'instances'} {{(pid=121403) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 01 19:04:02.242539 n-d-863052-2 devstack@n-api.service[121403]: DEBUG dbcounter [-] [121403] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=3,nova_api:DELETE=1 {{(pid=121403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 19:04:02.244777 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-1a435ed7-11b4-4e33-a171-789e4054447e tempest-ServersAdminNegativeTestJSON-824756592 tempest-ServersAdminNegativeTestJSON-824756592-project] Going to run 1 instances... {{(pid=121403) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 01 19:04:02.259920 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-1a435ed7-11b4-4e33-a171-789e4054447e tempest-ServersAdminNegativeTestJSON-824756592 tempest-ServersAdminNegativeTestJSON-824756592-project] [instance: 7048952a-103c-44f4-a16b-645dc2294787] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2d4a0047-1b9e-445f-8af8-1b5c9d93e881',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121403) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 01 19:04:02.354937 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-1a435ed7-11b4-4e33-a171-789e4054447e tempest-ServersAdminNegativeTestJSON-824756592 tempest-ServersAdminNegativeTestJSON-824756592-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.998137 Nov 01 19:04:02.364907 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1316/2614] 10.222.0.13 () {60 vars in 1147 bytes} [Tue Nov 1 19:04:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 2011 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 01 19:04:02.411898 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-5310b96f-9a9c-4e7c-9cfd-3178e1338258 tempest-ServersAdminNegativeTestJSON-824756592 tempest-ServersAdminNegativeTestJSON-824756592-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:04:02.417104 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-5310b96f-9a9c-4e7c-9cfd-3178e1338258 tempest-ServersAdminNegativeTestJSON-824756592 tempest-ServersAdminNegativeTestJSON-824756592-project] [instance: 7048952a-103c-44f4-a16b-645dc2294787] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:04:03.318005 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-9505d9c7-e6e6-4bff-814c-444f2b58e493 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb496b3faac4abbae73d389f2042e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e2520220d454764b8c139a58d78ac83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:04:03.335722 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-9505d9c7-e6e6-4bff-814c-444f2b58e493 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] 10.222.0.13 "GET /compute/v2.1/servers/46a040e6-2750-47b4-b8e2-757b92f1adf1" status: 200 len: 1470 microversion: 2.1 time: 1.212174 Nov 01 19:04:03.337274 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1299/2615] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:04:02 2022] GET /compute/v2.1/servers/46a040e6-2750-47b4-b8e2-757b92f1adf1 => generated 1470 bytes in 1216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 19:04:03.355529 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-fdb7c7b4-7081-49a9-8cf2-a1c4fb4e7eb7 tempest-TenantUsagesTestJSON-700278909 tempest-TenantUsagesTestJSON-700278909-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:04:03.361045 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-fdb7c7b4-7081-49a9-8cf2-a1c4fb4e7eb7 tempest-TenantUsagesTestJSON-700278909 tempest-TenantUsagesTestJSON-700278909-project] [instance: 763f688c-9976-4d91-b9cd-c22a9e168086] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:04:03.388913 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-fdb7c7b4-7081-49a9-8cf2-a1c4fb4e7eb7 tempest-TenantUsagesTestJSON-700278909 tempest-TenantUsagesTestJSON-700278909-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:04:03.389740 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-fdb7c7b4-7081-49a9-8cf2-a1c4fb4e7eb7 tempest-TenantUsagesTestJSON-700278909 tempest-TenantUsagesTestJSON-700278909-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:04:03.393696 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-fdb7c7b4-7081-49a9-8cf2-a1c4fb4e7eb7 tempest-TenantUsagesTestJSON-700278909 tempest-TenantUsagesTestJSON-700278909-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:04:03.396540 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-fdb7c7b4-7081-49a9-8cf2-a1c4fb4e7eb7 tempest-TenantUsagesTestJSON-700278909 tempest-TenantUsagesTestJSON-700278909-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:04:03.398074 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-fdb7c7b4-7081-49a9-8cf2-a1c4fb4e7eb7 tempest-TenantUsagesTestJSON-700278909 tempest-TenantUsagesTestJSON-700278909-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:04:03.403255 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-fdb7c7b4-7081-49a9-8cf2-a1c4fb4e7eb7 tempest-TenantUsagesTestJSON-700278909 tempest-TenantUsagesTestJSON-700278909-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:04:03.795387 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-5310b96f-9a9c-4e7c-9cfd-3178e1338258 tempest-ServersAdminNegativeTestJSON-824756592 tempest-ServersAdminNegativeTestJSON-824756592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0708fb2fc1df4aa9a9697cbc94acf921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '232745bfe2f3445987fedb91098c84eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:04:03.812074 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-fdb7c7b4-7081-49a9-8cf2-a1c4fb4e7eb7 tempest-TenantUsagesTestJSON-700278909 tempest-TenantUsagesTestJSON-700278909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '556f6f7b8d3745a38734001133ecd70d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a58c7ae460f4022b5d50651df0a486f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:04:03.817460 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-5310b96f-9a9c-4e7c-9cfd-3178e1338258 tempest-ServersAdminNegativeTestJSON-824756592 tempest-ServersAdminNegativeTestJSON-824756592-project] 10.222.0.13 "GET /compute/v2.1/servers/7048952a-103c-44f4-a16b-645dc2294787" status: 200 len: 1222 microversion: 2.1 time: 1.421842 Nov 01 19:04:03.823626 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1317/2616] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:04:02 2022] GET /compute/v2.1/servers/7048952a-103c-44f4-a16b-645dc2294787 => generated 1222 bytes in 1458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:04:03.825891 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-fdb7c7b4-7081-49a9-8cf2-a1c4fb4e7eb7 tempest-TenantUsagesTestJSON-700278909 tempest-TenantUsagesTestJSON-700278909-project] 10.222.0.13 "GET /compute/v2.1/servers/763f688c-9976-4d91-b9cd-c22a9e168086" status: 200 len: 1314 microversion: 2.1 time: 0.487456 Nov 01 19:04:03.827759 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1300/2617] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:04:03 2022] GET /compute/v2.1/servers/763f688c-9976-4d91-b9cd-c22a9e168086 => generated 1314 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:04:04.045302 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-35d9cca7-341d-4fe9-a896-677a3fafb506 tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:04:04.046032 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-35d9cca7-341d-4fe9-a896-677a3fafb506 tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] [instance: 12b6a241-81e5-4cb3-b138-ca28f4018732] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:04:04.069931 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-35d9cca7-341d-4fe9-a896-677a3fafb506 tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:04:04.071596 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-35d9cca7-341d-4fe9-a896-677a3fafb506 tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:04:04.072240 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-35d9cca7-341d-4fe9-a896-677a3fafb506 tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:04:04.075030 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-35d9cca7-341d-4fe9-a896-677a3fafb506 tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:04:04.077964 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-35d9cca7-341d-4fe9-a896-677a3fafb506 tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:04:04.079728 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-35d9cca7-341d-4fe9-a896-677a3fafb506 tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:04:04.134393 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.wsgi [None req-35d9cca7-341d-4fe9-a896-677a3fafb506 tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] HTTP exception thrown: Instance 12b6a241-81e5-4cb3-b138-ca28f4018732 could not be found. Nov 01 19:04:04.163705 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-35d9cca7-341d-4fe9-a896-677a3fafb506 tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Request method failure captured: Nov 01 19:04:04.163705 n-d-863052-2 devstack@n-api.service[121403]: request: DELETE /compute/v2.1/servers/12b6a241-81e5-4cb3-b138-ca28f4018732 HTTP/1.1 Nov 01 19:04:04.163705 n-d-863052-2 devstack@n-api.service[121403]: Accept: application/json Nov 01 19:04:04.163705 n-d-863052-2 devstack@n-api.service[121403]: Accept-Encoding: identity Nov 01 19:04:04.163705 n-d-863052-2 devstack@n-api.service[121403]: Connection: close Nov 01 19:04:04.163705 n-d-863052-2 devstack@n-api.service[121403]: Content-Length: 0 Nov 01 19:04:04.163705 n-d-863052-2 devstack@n-api.service[121403]: Content-Type: application/json Nov 01 19:04:04.163705 n-d-863052-2 devstack@n-api.service[121403]: Host: 10.222.0.13 Nov 01 19:04:04.163705 n-d-863052-2 devstack@n-api.service[121403]: Openstack-System-Scope: None Nov 01 19:04:04.163705 n-d-863052-2 devstack@n-api.service[121403]: User-Agent: python-urllib3/1.26.12 Nov 01 19:04:04.163705 n-d-863052-2 devstack@n-api.service[121403]: X-Auth-Token: gAAAAABjYW0ddbnkYhOv8dLUJr-s5oH-dqF8JRJhXex73L-70UBvGh-wlHGeiVgebbsv3kTSqtfLslhVEpqMdlQQA96JiyxVJnEafUgqXH5jyE8gVjuXRsGq0rdb8we_rfE2pVa3h17Ja5Q5u3LZ-1m6KGdglxKoD8H2n0P3G62fb2rWNjcrlYs Nov 01 19:04:04.163705 n-d-863052-2 devstack@n-api.service[121403]: X-Domain-Id: None Nov 01 19:04:04.163705 n-d-863052-2 devstack@n-api.service[121403]: X-Domain-Name: None Nov 01 19:04:04.163705 n-d-863052-2 devstack@n-api.service[121403]: X-Identity-Status: Confirmed Nov 01 19:04:04.163705 n-d-863052-2 devstack@n-api.service[121403]: X-Is-Admin-Project: True Nov 01 19:04:04.163705 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Domain-Id: default Nov 01 19:04:04.163705 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Domain-Name: Default Nov 01 19:04:04.163705 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Id: af51b8733e984c2ca87df2d8163dedf9 Nov 01 19:04:04.163705 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Name: tempest-ServersTestMultiNic-330497003 Nov 01 19:04:04.163705 n-d-863052-2 devstack@n-api.service[121403]: X-Role: member,reader Nov 01 19:04:04.163705 n-d-863052-2 devstack@n-api.service[121403]: X-Roles: member,reader Nov 01 19:04:04.163705 n-d-863052-2 devstack@n-api.service[121403]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/af51b8733e984c2ca87df2d8163dedf9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/af51b8733e984c2ca87df2d8163dedf9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_af51b8733e984c2ca87df2d8163dedf9", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/af51b8733e984c2ca87df2d8163dedf9"}]}] Nov 01 19:04:04.163705 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant: tempest-ServersTestMultiNic-330497003 Nov 01 19:04:04.163705 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant-Id: af51b8733e984c2ca87df2d8163dedf9 Nov 01 19:04:04.163705 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant-Name: tempest-ServersTestMultiNic-330497003 Nov 01 19:04:04.163705 n-d-863052-2 devstack@n-api.service[121403]: X-User: tempest-ServersTestMultiNic-330497003-project Nov 01 19:04:04.163705 n-d-863052-2 devstack@n-api.service[121403]: X-User-Domain-Id: default Nov 01 19:04:04.163705 n-d-863052-2 devstack@n-api.service[121403]: X-User-Domain-Name: Default Nov 01 19:04:04.163705 n-d-863052-2 devstack@n-api.service[121403]: X-User-Id: 52acef7992d64d378fd8ac333887fd0e Nov 01 19:04:04.163705 n-d-863052-2 devstack@n-api.service[121403]: X-User-Name: tempest-ServersTestMultiNic-330497003-project Nov 01 19:04:04.163705 n-d-863052-2 devstack@n-api.service[121403]: method: > Nov 01 19:04:04.163705 n-d-863052-2 devstack@n-api.service[121403]: exception: Instance 12b6a241-81e5-4cb3-b138-ca28f4018732 could not be found. Nov 01 19:04:04.163705 n-d-863052-2 devstack@n-api.service[121403]: action_args: {'id': '12b6a241-81e5-4cb3-b138-ca28f4018732'} Nov 01 19:04:04.163705 n-d-863052-2 devstack@n-api.service[121403]: {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 01 19:04:04.163705 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:04:04.163705 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 01 19:04:04.163705 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 01 19:04:04.163705 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 01 19:04:04.163705 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 01 19:04:04.163705 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 01 19:04:04.163705 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 01 19:04:04.163705 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 01 19:04:04.163705 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 01 19:04:04.163705 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 12b6a241-81e5-4cb3-b138-ca28f4018732 could not be found. Nov 01 19:04:04.163705 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:04:04.163705 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:04:04.163705 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:04:04.163705 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:04:04.163705 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:04:04.163705 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:04:04.163705 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 01 19:04:04.163705 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 01 19:04:04.163705 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 01 19:04:04.163705 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 01 19:04:04.163705 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 01 19:04:04.163705 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 01 19:04:04.163705 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 01 19:04:04.163705 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 01 19:04:04.163705 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 01 19:04:04.163705 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 01 19:04:04.163705 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 01 19:04:04.163705 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 01 19:04:04.168694 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 12b6a241-81e5-4cb3-b138-ca28f4018732 could not be found. Nov 01 19:04:04.168694 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:04:04.168694 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:04:04.168694 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:04:04.168694 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:04:04.168694 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:04:04.168694 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:04:04.168694 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 01 19:04:04.168694 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 01 19:04:04.168694 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 12b6a241-81e5-4cb3-b138-ca28f4018732 could not be found. Nov 01 19:04:04.168694 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:04:04.171621 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-35d9cca7-341d-4fe9-a896-677a3fafb506 tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Returning 404 to user: Instance 12b6a241-81e5-4cb3-b138-ca28f4018732 could not be found. {{(pid=121403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 01 19:04:04.173595 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-35d9cca7-341d-4fe9-a896-677a3fafb506 tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] 10.222.0.13 "DELETE /compute/v2.1/servers/12b6a241-81e5-4cb3-b138-ca28f4018732" status: 404 len: 111 microversion: 2.1 time: 0.135478 Nov 01 19:04:04.183816 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1318/2618] 10.222.0.13 () {58 vars in 1239 bytes} [Tue Nov 1 19:04:04 2022] DELETE /compute/v2.1/servers/12b6a241-81e5-4cb3-b138-ca28f4018732 => generated 111 bytes in 147 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 01 19:04:04.195259 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-e8f819f7-b9dc-4a3f-ac12-e59050fd2c50 tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:04:04.195872 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-e8f819f7-b9dc-4a3f-ac12-e59050fd2c50 tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] [instance: 12b6a241-81e5-4cb3-b138-ca28f4018732] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:04:04.205547 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e8f819f7-b9dc-4a3f-ac12-e59050fd2c50 tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:04:04.207418 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e8f819f7-b9dc-4a3f-ac12-e59050fd2c50 tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:04:04.209476 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e8f819f7-b9dc-4a3f-ac12-e59050fd2c50 tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:04:04.210226 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e8f819f7-b9dc-4a3f-ac12-e59050fd2c50 tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:04:04.210690 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e8f819f7-b9dc-4a3f-ac12-e59050fd2c50 tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:04:04.213039 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e8f819f7-b9dc-4a3f-ac12-e59050fd2c50 tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:04:04.249676 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.wsgi [None req-e8f819f7-b9dc-4a3f-ac12-e59050fd2c50 tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] HTTP exception thrown: Instance 12b6a241-81e5-4cb3-b138-ca28f4018732 could not be found. Nov 01 19:04:04.254839 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-e8f819f7-b9dc-4a3f-ac12-e59050fd2c50 tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Request method failure captured: Nov 01 19:04:04.254839 n-d-863052-2 devstack@n-api.service[121402]: request: GET /compute/v2.1/servers/12b6a241-81e5-4cb3-b138-ca28f4018732 HTTP/1.1 Nov 01 19:04:04.254839 n-d-863052-2 devstack@n-api.service[121402]: Accept: application/json Nov 01 19:04:04.254839 n-d-863052-2 devstack@n-api.service[121402]: Accept-Encoding: identity Nov 01 19:04:04.254839 n-d-863052-2 devstack@n-api.service[121402]: Connection: close Nov 01 19:04:04.254839 n-d-863052-2 devstack@n-api.service[121402]: Content-Length: 0 Nov 01 19:04:04.254839 n-d-863052-2 devstack@n-api.service[121402]: Content-Type: application/json Nov 01 19:04:04.254839 n-d-863052-2 devstack@n-api.service[121402]: Host: 10.222.0.13 Nov 01 19:04:04.254839 n-d-863052-2 devstack@n-api.service[121402]: Openstack-System-Scope: None Nov 01 19:04:04.254839 n-d-863052-2 devstack@n-api.service[121402]: User-Agent: python-urllib3/1.26.12 Nov 01 19:04:04.254839 n-d-863052-2 devstack@n-api.service[121402]: X-Auth-Token: gAAAAABjYW0ddbnkYhOv8dLUJr-s5oH-dqF8JRJhXex73L-70UBvGh-wlHGeiVgebbsv3kTSqtfLslhVEpqMdlQQA96JiyxVJnEafUgqXH5jyE8gVjuXRsGq0rdb8we_rfE2pVa3h17Ja5Q5u3LZ-1m6KGdglxKoD8H2n0P3G62fb2rWNjcrlYs Nov 01 19:04:04.254839 n-d-863052-2 devstack@n-api.service[121402]: X-Domain-Id: None Nov 01 19:04:04.254839 n-d-863052-2 devstack@n-api.service[121402]: X-Domain-Name: None Nov 01 19:04:04.254839 n-d-863052-2 devstack@n-api.service[121402]: X-Identity-Status: Confirmed Nov 01 19:04:04.254839 n-d-863052-2 devstack@n-api.service[121402]: X-Is-Admin-Project: True Nov 01 19:04:04.254839 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Domain-Id: default Nov 01 19:04:04.254839 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Domain-Name: Default Nov 01 19:04:04.254839 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Id: af51b8733e984c2ca87df2d8163dedf9 Nov 01 19:04:04.254839 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Name: tempest-ServersTestMultiNic-330497003 Nov 01 19:04:04.254839 n-d-863052-2 devstack@n-api.service[121402]: X-Role: member,reader Nov 01 19:04:04.254839 n-d-863052-2 devstack@n-api.service[121402]: X-Roles: member,reader Nov 01 19:04:04.254839 n-d-863052-2 devstack@n-api.service[121402]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/af51b8733e984c2ca87df2d8163dedf9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/af51b8733e984c2ca87df2d8163dedf9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_af51b8733e984c2ca87df2d8163dedf9", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/af51b8733e984c2ca87df2d8163dedf9"}]}] Nov 01 19:04:04.254839 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant: tempest-ServersTestMultiNic-330497003 Nov 01 19:04:04.254839 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant-Id: af51b8733e984c2ca87df2d8163dedf9 Nov 01 19:04:04.254839 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant-Name: tempest-ServersTestMultiNic-330497003 Nov 01 19:04:04.254839 n-d-863052-2 devstack@n-api.service[121402]: X-User: tempest-ServersTestMultiNic-330497003-project Nov 01 19:04:04.254839 n-d-863052-2 devstack@n-api.service[121402]: X-User-Domain-Id: default Nov 01 19:04:04.254839 n-d-863052-2 devstack@n-api.service[121402]: X-User-Domain-Name: Default Nov 01 19:04:04.254839 n-d-863052-2 devstack@n-api.service[121402]: X-User-Id: 52acef7992d64d378fd8ac333887fd0e Nov 01 19:04:04.254839 n-d-863052-2 devstack@n-api.service[121402]: X-User-Name: tempest-ServersTestMultiNic-330497003-project Nov 01 19:04:04.254839 n-d-863052-2 devstack@n-api.service[121402]: method: > Nov 01 19:04:04.254839 n-d-863052-2 devstack@n-api.service[121402]: exception: Instance 12b6a241-81e5-4cb3-b138-ca28f4018732 could not be found. Nov 01 19:04:04.254839 n-d-863052-2 devstack@n-api.service[121402]: action_args: {'id': '12b6a241-81e5-4cb3-b138-ca28f4018732'} Nov 01 19:04:04.254839 n-d-863052-2 devstack@n-api.service[121402]: {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 01 19:04:04.254839 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:04:04.254839 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 01 19:04:04.254839 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 01 19:04:04.254839 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 01 19:04:04.254839 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 01 19:04:04.254839 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 01 19:04:04.254839 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 01 19:04:04.254839 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 01 19:04:04.254839 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 01 19:04:04.254839 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 12b6a241-81e5-4cb3-b138-ca28f4018732 could not be found. Nov 01 19:04:04.254839 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:04:04.254839 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:04:04.254839 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:04:04.254839 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:04:04.254839 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:04:04.254839 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:04:04.254839 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 01 19:04:04.254839 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 01 19:04:04.254839 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 01 19:04:04.254839 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 01 19:04:04.254839 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 01 19:04:04.254839 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 01 19:04:04.254839 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 01 19:04:04.254839 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 01 19:04:04.254839 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 01 19:04:04.254839 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 01 19:04:04.254839 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 12b6a241-81e5-4cb3-b138-ca28f4018732 could not be found. Nov 01 19:04:04.254839 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:04:04.254839 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:04:04.254839 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:04:04.258900 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:04:04.258900 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:04:04.258900 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:04:04.258900 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 01 19:04:04.258900 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 01 19:04:04.258900 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 12b6a241-81e5-4cb3-b138-ca28f4018732 could not be found. Nov 01 19:04:04.258900 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:04:04.263398 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-e8f819f7-b9dc-4a3f-ac12-e59050fd2c50 tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Returning 404 to user: Instance 12b6a241-81e5-4cb3-b138-ca28f4018732 could not be found. {{(pid=121402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 01 19:04:04.267080 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-e8f819f7-b9dc-4a3f-ac12-e59050fd2c50 tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] 10.222.0.13 "GET /compute/v2.1/servers/12b6a241-81e5-4cb3-b138-ca28f4018732" status: 404 len: 111 microversion: 2.1 time: 0.076507 Nov 01 19:04:04.269506 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1301/2619] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:04:04 2022] GET /compute/v2.1/servers/12b6a241-81e5-4cb3-b138-ca28f4018732 => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 01 19:04:04.278608 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-505aedb6-9a2c-45b4-bd24-921d9e92a1e3 tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:04:04.280411 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-505aedb6-9a2c-45b4-bd24-921d9e92a1e3 tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] [instance: 4b9fb909-26f7-40af-bac5-e7d2a6b9fb77] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:04:04.293341 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-505aedb6-9a2c-45b4-bd24-921d9e92a1e3 tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:04:04.293794 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-505aedb6-9a2c-45b4-bd24-921d9e92a1e3 tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:04:04.294267 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-505aedb6-9a2c-45b4-bd24-921d9e92a1e3 tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:04:04.294999 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-505aedb6-9a2c-45b4-bd24-921d9e92a1e3 tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:04:04.295877 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-505aedb6-9a2c-45b4-bd24-921d9e92a1e3 tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:04:04.295877 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-505aedb6-9a2c-45b4-bd24-921d9e92a1e3 tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:04:04.356071 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.wsgi [None req-505aedb6-9a2c-45b4-bd24-921d9e92a1e3 tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] HTTP exception thrown: Instance 4b9fb909-26f7-40af-bac5-e7d2a6b9fb77 could not be found. Nov 01 19:04:04.364003 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-fae4c5a2-25cc-4fa8-8561-d78731169a27 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:04:04.366237 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-fae4c5a2-25cc-4fa8-8561-d78731169a27 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] [instance: 46a040e6-2750-47b4-b8e2-757b92f1adf1] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:04:04.379867 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-505aedb6-9a2c-45b4-bd24-921d9e92a1e3 tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Request method failure captured: Nov 01 19:04:04.379867 n-d-863052-2 devstack@n-api.service[121403]: request: DELETE /compute/v2.1/servers/4b9fb909-26f7-40af-bac5-e7d2a6b9fb77 HTTP/1.1 Nov 01 19:04:04.379867 n-d-863052-2 devstack@n-api.service[121403]: Accept: application/json Nov 01 19:04:04.379867 n-d-863052-2 devstack@n-api.service[121403]: Accept-Encoding: identity Nov 01 19:04:04.379867 n-d-863052-2 devstack@n-api.service[121403]: Connection: close Nov 01 19:04:04.379867 n-d-863052-2 devstack@n-api.service[121403]: Content-Length: 0 Nov 01 19:04:04.379867 n-d-863052-2 devstack@n-api.service[121403]: Content-Type: application/json Nov 01 19:04:04.379867 n-d-863052-2 devstack@n-api.service[121403]: Host: 10.222.0.13 Nov 01 19:04:04.379867 n-d-863052-2 devstack@n-api.service[121403]: Openstack-System-Scope: None Nov 01 19:04:04.379867 n-d-863052-2 devstack@n-api.service[121403]: User-Agent: python-urllib3/1.26.12 Nov 01 19:04:04.379867 n-d-863052-2 devstack@n-api.service[121403]: X-Auth-Token: gAAAAABjYW0ddbnkYhOv8dLUJr-s5oH-dqF8JRJhXex73L-70UBvGh-wlHGeiVgebbsv3kTSqtfLslhVEpqMdlQQA96JiyxVJnEafUgqXH5jyE8gVjuXRsGq0rdb8we_rfE2pVa3h17Ja5Q5u3LZ-1m6KGdglxKoD8H2n0P3G62fb2rWNjcrlYs Nov 01 19:04:04.379867 n-d-863052-2 devstack@n-api.service[121403]: X-Domain-Id: None Nov 01 19:04:04.379867 n-d-863052-2 devstack@n-api.service[121403]: X-Domain-Name: None Nov 01 19:04:04.379867 n-d-863052-2 devstack@n-api.service[121403]: X-Identity-Status: Confirmed Nov 01 19:04:04.379867 n-d-863052-2 devstack@n-api.service[121403]: X-Is-Admin-Project: True Nov 01 19:04:04.379867 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Domain-Id: default Nov 01 19:04:04.379867 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Domain-Name: Default Nov 01 19:04:04.379867 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Id: af51b8733e984c2ca87df2d8163dedf9 Nov 01 19:04:04.379867 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Name: tempest-ServersTestMultiNic-330497003 Nov 01 19:04:04.379867 n-d-863052-2 devstack@n-api.service[121403]: X-Role: member,reader Nov 01 19:04:04.379867 n-d-863052-2 devstack@n-api.service[121403]: X-Roles: member,reader Nov 01 19:04:04.379867 n-d-863052-2 devstack@n-api.service[121403]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/af51b8733e984c2ca87df2d8163dedf9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/af51b8733e984c2ca87df2d8163dedf9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_af51b8733e984c2ca87df2d8163dedf9", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/af51b8733e984c2ca87df2d8163dedf9"}]}] Nov 01 19:04:04.379867 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant: tempest-ServersTestMultiNic-330497003 Nov 01 19:04:04.379867 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant-Id: af51b8733e984c2ca87df2d8163dedf9 Nov 01 19:04:04.379867 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant-Name: tempest-ServersTestMultiNic-330497003 Nov 01 19:04:04.379867 n-d-863052-2 devstack@n-api.service[121403]: X-User: tempest-ServersTestMultiNic-330497003-project Nov 01 19:04:04.379867 n-d-863052-2 devstack@n-api.service[121403]: X-User-Domain-Id: default Nov 01 19:04:04.379867 n-d-863052-2 devstack@n-api.service[121403]: X-User-Domain-Name: Default Nov 01 19:04:04.379867 n-d-863052-2 devstack@n-api.service[121403]: X-User-Id: 52acef7992d64d378fd8ac333887fd0e Nov 01 19:04:04.379867 n-d-863052-2 devstack@n-api.service[121403]: X-User-Name: tempest-ServersTestMultiNic-330497003-project Nov 01 19:04:04.379867 n-d-863052-2 devstack@n-api.service[121403]: method: > Nov 01 19:04:04.379867 n-d-863052-2 devstack@n-api.service[121403]: exception: Instance 4b9fb909-26f7-40af-bac5-e7d2a6b9fb77 could not be found. Nov 01 19:04:04.379867 n-d-863052-2 devstack@n-api.service[121403]: action_args: {'id': '4b9fb909-26f7-40af-bac5-e7d2a6b9fb77'} Nov 01 19:04:04.379867 n-d-863052-2 devstack@n-api.service[121403]: {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 01 19:04:04.379867 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:04:04.379867 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 01 19:04:04.379867 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 01 19:04:04.379867 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 01 19:04:04.379867 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 01 19:04:04.379867 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 01 19:04:04.379867 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 01 19:04:04.379867 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 01 19:04:04.379867 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 01 19:04:04.379867 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4b9fb909-26f7-40af-bac5-e7d2a6b9fb77 could not be found. Nov 01 19:04:04.379867 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:04:04.379867 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:04:04.379867 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:04:04.379867 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:04:04.379867 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:04:04.379867 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:04:04.379867 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 01 19:04:04.379867 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 01 19:04:04.379867 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 01 19:04:04.379867 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 01 19:04:04.379867 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 01 19:04:04.379867 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 01 19:04:04.379867 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 01 19:04:04.379867 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 01 19:04:04.379867 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 01 19:04:04.379867 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 01 19:04:04.379867 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 01 19:04:04.379867 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 01 19:04:04.383324 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4b9fb909-26f7-40af-bac5-e7d2a6b9fb77 could not be found. Nov 01 19:04:04.383324 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:04:04.383324 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:04:04.383324 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:04:04.383324 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:04:04.383324 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:04:04.383324 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:04:04.383324 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 01 19:04:04.383324 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 01 19:04:04.383324 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4b9fb909-26f7-40af-bac5-e7d2a6b9fb77 could not be found. Nov 01 19:04:04.383324 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:04:04.385826 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-fae4c5a2-25cc-4fa8-8561-d78731169a27 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:04:04.386471 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-fae4c5a2-25cc-4fa8-8561-d78731169a27 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:04:04.389658 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-505aedb6-9a2c-45b4-bd24-921d9e92a1e3 tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Returning 404 to user: Instance 4b9fb909-26f7-40af-bac5-e7d2a6b9fb77 could not be found. {{(pid=121403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 01 19:04:04.390330 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-fae4c5a2-25cc-4fa8-8561-d78731169a27 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:04:04.395505 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-fae4c5a2-25cc-4fa8-8561-d78731169a27 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:04:04.396846 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-505aedb6-9a2c-45b4-bd24-921d9e92a1e3 tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] 10.222.0.13 "DELETE /compute/v2.1/servers/4b9fb909-26f7-40af-bac5-e7d2a6b9fb77" status: 404 len: 111 microversion: 2.1 time: 0.122926 Nov 01 19:04:04.397496 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-fae4c5a2-25cc-4fa8-8561-d78731169a27 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:04:04.399610 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-fae4c5a2-25cc-4fa8-8561-d78731169a27 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:04:04.399762 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1319/2620] 10.222.0.13 () {58 vars in 1239 bytes} [Tue Nov 1 19:04:04 2022] DELETE /compute/v2.1/servers/4b9fb909-26f7-40af-bac5-e7d2a6b9fb77 => generated 111 bytes in 126 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 01 19:04:04.411564 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-5ce672aa-6894-46ba-8858-50b6dc3c0a9d tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:04:04.425802 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-5ce672aa-6894-46ba-8858-50b6dc3c0a9d tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] [instance: 4b9fb909-26f7-40af-bac5-e7d2a6b9fb77] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:04:04.432381 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-5ce672aa-6894-46ba-8858-50b6dc3c0a9d tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:04:04.433128 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-5ce672aa-6894-46ba-8858-50b6dc3c0a9d tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:04:04.433722 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-5ce672aa-6894-46ba-8858-50b6dc3c0a9d tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:04:04.438598 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-5ce672aa-6894-46ba-8858-50b6dc3c0a9d tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:04:04.439634 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-5ce672aa-6894-46ba-8858-50b6dc3c0a9d tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:04:04.441130 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-5ce672aa-6894-46ba-8858-50b6dc3c0a9d tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:04:04.471588 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.wsgi [None req-5ce672aa-6894-46ba-8858-50b6dc3c0a9d tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] HTTP exception thrown: Instance 4b9fb909-26f7-40af-bac5-e7d2a6b9fb77 could not be found. Nov 01 19:04:04.473432 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-5ce672aa-6894-46ba-8858-50b6dc3c0a9d tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Request method failure captured: Nov 01 19:04:04.473432 n-d-863052-2 devstack@n-api.service[121403]: request: GET /compute/v2.1/servers/4b9fb909-26f7-40af-bac5-e7d2a6b9fb77 HTTP/1.1 Nov 01 19:04:04.473432 n-d-863052-2 devstack@n-api.service[121403]: Accept: application/json Nov 01 19:04:04.473432 n-d-863052-2 devstack@n-api.service[121403]: Accept-Encoding: identity Nov 01 19:04:04.473432 n-d-863052-2 devstack@n-api.service[121403]: Connection: close Nov 01 19:04:04.473432 n-d-863052-2 devstack@n-api.service[121403]: Content-Length: 0 Nov 01 19:04:04.473432 n-d-863052-2 devstack@n-api.service[121403]: Content-Type: application/json Nov 01 19:04:04.473432 n-d-863052-2 devstack@n-api.service[121403]: Host: 10.222.0.13 Nov 01 19:04:04.473432 n-d-863052-2 devstack@n-api.service[121403]: Openstack-System-Scope: None Nov 01 19:04:04.473432 n-d-863052-2 devstack@n-api.service[121403]: User-Agent: python-urllib3/1.26.12 Nov 01 19:04:04.473432 n-d-863052-2 devstack@n-api.service[121403]: X-Auth-Token: gAAAAABjYW0ddbnkYhOv8dLUJr-s5oH-dqF8JRJhXex73L-70UBvGh-wlHGeiVgebbsv3kTSqtfLslhVEpqMdlQQA96JiyxVJnEafUgqXH5jyE8gVjuXRsGq0rdb8we_rfE2pVa3h17Ja5Q5u3LZ-1m6KGdglxKoD8H2n0P3G62fb2rWNjcrlYs Nov 01 19:04:04.473432 n-d-863052-2 devstack@n-api.service[121403]: X-Domain-Id: None Nov 01 19:04:04.473432 n-d-863052-2 devstack@n-api.service[121403]: X-Domain-Name: None Nov 01 19:04:04.473432 n-d-863052-2 devstack@n-api.service[121403]: X-Identity-Status: Confirmed Nov 01 19:04:04.473432 n-d-863052-2 devstack@n-api.service[121403]: X-Is-Admin-Project: True Nov 01 19:04:04.473432 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Domain-Id: default Nov 01 19:04:04.473432 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Domain-Name: Default Nov 01 19:04:04.473432 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Id: af51b8733e984c2ca87df2d8163dedf9 Nov 01 19:04:04.473432 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Name: tempest-ServersTestMultiNic-330497003 Nov 01 19:04:04.473432 n-d-863052-2 devstack@n-api.service[121403]: X-Role: member,reader Nov 01 19:04:04.473432 n-d-863052-2 devstack@n-api.service[121403]: X-Roles: member,reader Nov 01 19:04:04.473432 n-d-863052-2 devstack@n-api.service[121403]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/af51b8733e984c2ca87df2d8163dedf9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/af51b8733e984c2ca87df2d8163dedf9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_af51b8733e984c2ca87df2d8163dedf9", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/af51b8733e984c2ca87df2d8163dedf9"}]}] Nov 01 19:04:04.473432 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant: tempest-ServersTestMultiNic-330497003 Nov 01 19:04:04.473432 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant-Id: af51b8733e984c2ca87df2d8163dedf9 Nov 01 19:04:04.473432 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant-Name: tempest-ServersTestMultiNic-330497003 Nov 01 19:04:04.473432 n-d-863052-2 devstack@n-api.service[121403]: X-User: tempest-ServersTestMultiNic-330497003-project Nov 01 19:04:04.473432 n-d-863052-2 devstack@n-api.service[121403]: X-User-Domain-Id: default Nov 01 19:04:04.473432 n-d-863052-2 devstack@n-api.service[121403]: X-User-Domain-Name: Default Nov 01 19:04:04.473432 n-d-863052-2 devstack@n-api.service[121403]: X-User-Id: 52acef7992d64d378fd8ac333887fd0e Nov 01 19:04:04.473432 n-d-863052-2 devstack@n-api.service[121403]: X-User-Name: tempest-ServersTestMultiNic-330497003-project Nov 01 19:04:04.473432 n-d-863052-2 devstack@n-api.service[121403]: method: > Nov 01 19:04:04.473432 n-d-863052-2 devstack@n-api.service[121403]: exception: Instance 4b9fb909-26f7-40af-bac5-e7d2a6b9fb77 could not be found. Nov 01 19:04:04.473432 n-d-863052-2 devstack@n-api.service[121403]: action_args: {'id': '4b9fb909-26f7-40af-bac5-e7d2a6b9fb77'} Nov 01 19:04:04.473432 n-d-863052-2 devstack@n-api.service[121403]: {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 01 19:04:04.473432 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:04:04.473432 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 01 19:04:04.473432 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 01 19:04:04.473432 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 01 19:04:04.473432 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 01 19:04:04.473432 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 01 19:04:04.473432 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 01 19:04:04.473432 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 01 19:04:04.473432 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 01 19:04:04.473432 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4b9fb909-26f7-40af-bac5-e7d2a6b9fb77 could not be found. Nov 01 19:04:04.473432 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:04:04.473432 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:04:04.473432 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:04:04.473432 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:04:04.473432 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:04:04.473432 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:04:04.473432 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 01 19:04:04.473432 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 01 19:04:04.473432 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 01 19:04:04.473432 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 01 19:04:04.473432 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 01 19:04:04.473432 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 01 19:04:04.473432 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 01 19:04:04.473432 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 01 19:04:04.473432 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 01 19:04:04.473432 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 01 19:04:04.473432 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4b9fb909-26f7-40af-bac5-e7d2a6b9fb77 could not be found. Nov 01 19:04:04.473432 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:04:04.473432 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:04:04.473432 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:04:04.477243 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:04:04.477243 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:04:04.477243 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:04:04.477243 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 01 19:04:04.477243 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 01 19:04:04.477243 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4b9fb909-26f7-40af-bac5-e7d2a6b9fb77 could not be found. Nov 01 19:04:04.477243 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:04:04.487147 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-5ce672aa-6894-46ba-8858-50b6dc3c0a9d tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] Returning 404 to user: Instance 4b9fb909-26f7-40af-bac5-e7d2a6b9fb77 could not be found. {{(pid=121403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 01 19:04:04.488413 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-5ce672aa-6894-46ba-8858-50b6dc3c0a9d tempest-ServersTestMultiNic-330497003 tempest-ServersTestMultiNic-330497003-project] 10.222.0.13 "GET /compute/v2.1/servers/4b9fb909-26f7-40af-bac5-e7d2a6b9fb77" status: 404 len: 111 microversion: 2.1 time: 0.084531 Nov 01 19:04:04.489760 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1320/2621] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:04:04 2022] GET /compute/v2.1/servers/4b9fb909-26f7-40af-bac5-e7d2a6b9fb77 => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 01 19:04:04.767752 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-fae4c5a2-25cc-4fa8-8561-d78731169a27 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb496b3faac4abbae73d389f2042e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e2520220d454764b8c139a58d78ac83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:04:04.787596 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-fae4c5a2-25cc-4fa8-8561-d78731169a27 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] 10.222.0.13 "GET /compute/v2.1/servers/46a040e6-2750-47b4-b8e2-757b92f1adf1" status: 200 len: 1428 microversion: 2.1 time: 0.425008 Nov 01 19:04:04.789494 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1302/2622] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:04:04 2022] GET /compute/v2.1/servers/46a040e6-2750-47b4-b8e2-757b92f1adf1 => generated 1428 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:04:04.811091 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [req-5c5d6bd3-7a11-425a-b9ee-58f4db887334 req-0892f686-073b-4132-b80f-d0e1f8dd2ead service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "763f688c-9976-4d91-b9cd-c22a9e168086", "tag": "baa1feb5-723e-4631-8588-8a93e79c5750"}]} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:04:04.823612 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [req-34ebce85-5400-43e2-a355-0a9ddbc27096 req-7d7cca1b-6193-446b-af59-b9c8c71650d4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "46a040e6-2750-47b4-b8e2-757b92f1adf1", "name": "network-vif-deleted", "tag": "c8726629-64ec-4a3b-8076-8ad61393df33"}]} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:04:04.846508 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-34ebce85-5400-43e2-a355-0a9ddbc27096 req-7d7cca1b-6193-446b-af59-b9c8c71650d4 service nova] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:04:04.847001 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-34ebce85-5400-43e2-a355-0a9ddbc27096 req-7d7cca1b-6193-446b-af59-b9c8c71650d4 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:04:04.847646 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-34ebce85-5400-43e2-a355-0a9ddbc27096 req-7d7cca1b-6193-446b-af59-b9c8c71650d4 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:04:04.867157 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-5c5d6bd3-7a11-425a-b9ee-58f4db887334 req-0892f686-073b-4132-b80f-d0e1f8dd2ead service nova] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:04:04.869460 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-5c5d6bd3-7a11-425a-b9ee-58f4db887334 req-0892f686-073b-4132-b80f-d0e1f8dd2ead service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:04:04.872410 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-5c5d6bd3-7a11-425a-b9ee-58f4db887334 req-0892f686-073b-4132-b80f-d0e1f8dd2ead service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:04:04.873428 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.compute.server_external_events [req-34ebce85-5400-43e2-a355-0a9ddbc27096 req-7d7cca1b-6193-446b-af59-b9c8c71650d4 service nova] Creating event network-vif-deleted:c8726629-64ec-4a3b-8076-8ad61393df33 for instance 46a040e6-2750-47b4-b8e2-757b92f1adf1 on n-h1-863052-2 Nov 01 19:04:04.882799 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [req-34ebce85-5400-43e2-a355-0a9ddbc27096 req-7d7cca1b-6193-446b-af59-b9c8c71650d4 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063297 Nov 01 19:04:04.887513 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1303/2623] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Nov 1 19:04:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:04:04.901110 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-99a95c3a-ead2-4721-979e-013e7fcaf61b tempest-ServersAdminNegativeTestJSON-824756592 tempest-ServersAdminNegativeTestJSON-824756592-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:04:04.902627 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-99a95c3a-ead2-4721-979e-013e7fcaf61b tempest-ServersAdminNegativeTestJSON-824756592 tempest-ServersAdminNegativeTestJSON-824756592-project] [instance: 7048952a-103c-44f4-a16b-645dc2294787] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:04:04.903446 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.compute.server_external_events [req-5c5d6bd3-7a11-425a-b9ee-58f4db887334 req-0892f686-073b-4132-b80f-d0e1f8dd2ead service nova] Creating event network-changed:baa1feb5-723e-4631-8588-8a93e79c5750 for instance 763f688c-9976-4d91-b9cd-c22a9e168086 on n-h1-863052-2 Nov 01 19:04:04.919977 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-99a95c3a-ead2-4721-979e-013e7fcaf61b tempest-ServersAdminNegativeTestJSON-824756592 tempest-ServersAdminNegativeTestJSON-824756592-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:04:04.920382 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [req-5c5d6bd3-7a11-425a-b9ee-58f4db887334 req-0892f686-073b-4132-b80f-d0e1f8dd2ead service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.134012 Nov 01 19:04:04.921362 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-99a95c3a-ead2-4721-979e-013e7fcaf61b tempest-ServersAdminNegativeTestJSON-824756592 tempest-ServersAdminNegativeTestJSON-824756592-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:04:04.921551 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1321/2624] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Nov 1 19:04:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 01 19:04:04.922135 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-99a95c3a-ead2-4721-979e-013e7fcaf61b tempest-ServersAdminNegativeTestJSON-824756592 tempest-ServersAdminNegativeTestJSON-824756592-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:04:04.928089 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-99a95c3a-ead2-4721-979e-013e7fcaf61b tempest-ServersAdminNegativeTestJSON-824756592 tempest-ServersAdminNegativeTestJSON-824756592-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:04:04.932051 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-99a95c3a-ead2-4721-979e-013e7fcaf61b tempest-ServersAdminNegativeTestJSON-824756592 tempest-ServersAdminNegativeTestJSON-824756592-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:04:04.932741 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-99a95c3a-ead2-4721-979e-013e7fcaf61b tempest-ServersAdminNegativeTestJSON-824756592 tempest-ServersAdminNegativeTestJSON-824756592-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:04:04.934927 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-cfb296eb-5fa7-4504-b0b3-1a26c689392d tempest-TenantUsagesTestJSON-700278909 tempest-TenantUsagesTestJSON-700278909-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:04:04.939135 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-cfb296eb-5fa7-4504-b0b3-1a26c689392d tempest-TenantUsagesTestJSON-700278909 tempest-TenantUsagesTestJSON-700278909-project] [instance: 763f688c-9976-4d91-b9cd-c22a9e168086] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:04:04.950742 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-cfb296eb-5fa7-4504-b0b3-1a26c689392d tempest-TenantUsagesTestJSON-700278909 tempest-TenantUsagesTestJSON-700278909-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:04:04.957760 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-cfb296eb-5fa7-4504-b0b3-1a26c689392d tempest-TenantUsagesTestJSON-700278909 tempest-TenantUsagesTestJSON-700278909-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:04:04.958272 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-cfb296eb-5fa7-4504-b0b3-1a26c689392d tempest-TenantUsagesTestJSON-700278909 tempest-TenantUsagesTestJSON-700278909-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:04:04.959038 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-cfb296eb-5fa7-4504-b0b3-1a26c689392d tempest-TenantUsagesTestJSON-700278909 tempest-TenantUsagesTestJSON-700278909-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:04:04.959523 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-cfb296eb-5fa7-4504-b0b3-1a26c689392d tempest-TenantUsagesTestJSON-700278909 tempest-TenantUsagesTestJSON-700278909-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:04:04.959957 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-cfb296eb-5fa7-4504-b0b3-1a26c689392d tempest-TenantUsagesTestJSON-700278909 tempest-TenantUsagesTestJSON-700278909-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:04:05.340384 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-99a95c3a-ead2-4721-979e-013e7fcaf61b tempest-ServersAdminNegativeTestJSON-824756592 tempest-ServersAdminNegativeTestJSON-824756592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0708fb2fc1df4aa9a9697cbc94acf921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '232745bfe2f3445987fedb91098c84eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:04:05.354312 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-99a95c3a-ead2-4721-979e-013e7fcaf61b tempest-ServersAdminNegativeTestJSON-824756592 tempest-ServersAdminNegativeTestJSON-824756592-project] 10.222.0.13 "GET /compute/v2.1/servers/7048952a-103c-44f4-a16b-645dc2294787" status: 200 len: 1280 microversion: 2.1 time: 0.464870 Nov 01 19:04:05.358846 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1304/2625] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:04:04 2022] GET /compute/v2.1/servers/7048952a-103c-44f4-a16b-645dc2294787 => generated 1280 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:04:05.542922 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-cfb296eb-5fa7-4504-b0b3-1a26c689392d tempest-TenantUsagesTestJSON-700278909 tempest-TenantUsagesTestJSON-700278909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '556f6f7b8d3745a38734001133ecd70d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a58c7ae460f4022b5d50651df0a486f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:04:05.572726 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-cfb296eb-5fa7-4504-b0b3-1a26c689392d tempest-TenantUsagesTestJSON-700278909 tempest-TenantUsagesTestJSON-700278909-project] 10.222.0.13 "GET /compute/v2.1/servers/763f688c-9976-4d91-b9cd-c22a9e168086" status: 200 len: 1314 microversion: 2.1 time: 0.646180 Nov 01 19:04:05.574634 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1322/2626] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:04:04 2022] GET /compute/v2.1/servers/763f688c-9976-4d91-b9cd-c22a9e168086 => generated 1314 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:04:05.813745 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-ef3de874-6298-4f20-8985-0d43d683ed4e tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:04:05.815554 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-ef3de874-6298-4f20-8985-0d43d683ed4e tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] [instance: 46a040e6-2750-47b4-b8e2-757b92f1adf1] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:04:05.854706 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-ef3de874-6298-4f20-8985-0d43d683ed4e tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:04:05.855800 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-ef3de874-6298-4f20-8985-0d43d683ed4e tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:04:05.860573 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-ef3de874-6298-4f20-8985-0d43d683ed4e tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:04:05.865352 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-ef3de874-6298-4f20-8985-0d43d683ed4e tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:04:05.871599 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-ef3de874-6298-4f20-8985-0d43d683ed4e tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:04:05.872919 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-ef3de874-6298-4f20-8985-0d43d683ed4e tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:04:05.899324 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.wsgi [None req-ef3de874-6298-4f20-8985-0d43d683ed4e tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] HTTP exception thrown: Instance 46a040e6-2750-47b4-b8e2-757b92f1adf1 could not be found. Nov 01 19:04:05.901313 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-ef3de874-6298-4f20-8985-0d43d683ed4e tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Request method failure captured: Nov 01 19:04:05.901313 n-d-863052-2 devstack@n-api.service[121402]: request: GET /compute/v2.1/servers/46a040e6-2750-47b4-b8e2-757b92f1adf1 HTTP/1.1 Nov 01 19:04:05.901313 n-d-863052-2 devstack@n-api.service[121402]: Accept: application/json Nov 01 19:04:05.901313 n-d-863052-2 devstack@n-api.service[121402]: Accept-Encoding: identity Nov 01 19:04:05.901313 n-d-863052-2 devstack@n-api.service[121402]: Connection: close Nov 01 19:04:05.901313 n-d-863052-2 devstack@n-api.service[121402]: Content-Length: 0 Nov 01 19:04:05.901313 n-d-863052-2 devstack@n-api.service[121402]: Content-Type: application/json Nov 01 19:04:05.901313 n-d-863052-2 devstack@n-api.service[121402]: Host: 10.222.0.13 Nov 01 19:04:05.901313 n-d-863052-2 devstack@n-api.service[121402]: Openstack-System-Scope: None Nov 01 19:04:05.901313 n-d-863052-2 devstack@n-api.service[121402]: User-Agent: python-urllib3/1.26.12 Nov 01 19:04:05.901313 n-d-863052-2 devstack@n-api.service[121402]: X-Auth-Token: gAAAAABjYW0KvKIsQ5yNuH1CirZscDHdVwR62XXP2pHr0THUOA1-YzUZh7LWrRRAp-FTHEQ1bC4Sk-0OgSJf3KzR1P_vE0tAn9Q-jY2vnWbJXZZ2pkUvZlTPq8DTHCXBzSyDvwVIOlTE_wddSbkQ0gLoMgk4r70-gVye8ayGLfneFV3MHXrqhJE Nov 01 19:04:05.901313 n-d-863052-2 devstack@n-api.service[121402]: X-Domain-Id: None Nov 01 19:04:05.901313 n-d-863052-2 devstack@n-api.service[121402]: X-Domain-Name: None Nov 01 19:04:05.901313 n-d-863052-2 devstack@n-api.service[121402]: X-Identity-Status: Confirmed Nov 01 19:04:05.901313 n-d-863052-2 devstack@n-api.service[121402]: X-Is-Admin-Project: True Nov 01 19:04:05.901313 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Domain-Id: default Nov 01 19:04:05.901313 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Domain-Name: Default Nov 01 19:04:05.901313 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Id: 3e2520220d454764b8c139a58d78ac83 Nov 01 19:04:05.901313 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Name: tempest-ServersAdminTestJSON-1380417766 Nov 01 19:04:05.901313 n-d-863052-2 devstack@n-api.service[121402]: X-Role: member,reader Nov 01 19:04:05.901313 n-d-863052-2 devstack@n-api.service[121402]: X-Roles: member,reader Nov 01 19:04:05.901313 n-d-863052-2 devstack@n-api.service[121402]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/3e2520220d454764b8c139a58d78ac83"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/3e2520220d454764b8c139a58d78ac83"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_3e2520220d454764b8c139a58d78ac83", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/3e2520220d454764b8c139a58d78ac83"}]}] Nov 01 19:04:05.901313 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant: tempest-ServersAdminTestJSON-1380417766 Nov 01 19:04:05.901313 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant-Id: 3e2520220d454764b8c139a58d78ac83 Nov 01 19:04:05.901313 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant-Name: tempest-ServersAdminTestJSON-1380417766 Nov 01 19:04:05.901313 n-d-863052-2 devstack@n-api.service[121402]: X-User: tempest-ServersAdminTestJSON-1380417766-project Nov 01 19:04:05.901313 n-d-863052-2 devstack@n-api.service[121402]: X-User-Domain-Id: default Nov 01 19:04:05.901313 n-d-863052-2 devstack@n-api.service[121402]: X-User-Domain-Name: Default Nov 01 19:04:05.901313 n-d-863052-2 devstack@n-api.service[121402]: X-User-Id: bcb496b3faac4abbae73d389f2042e77 Nov 01 19:04:05.901313 n-d-863052-2 devstack@n-api.service[121402]: X-User-Name: tempest-ServersAdminTestJSON-1380417766-project Nov 01 19:04:05.901313 n-d-863052-2 devstack@n-api.service[121402]: method: > Nov 01 19:04:05.901313 n-d-863052-2 devstack@n-api.service[121402]: exception: Instance 46a040e6-2750-47b4-b8e2-757b92f1adf1 could not be found. Nov 01 19:04:05.901313 n-d-863052-2 devstack@n-api.service[121402]: action_args: {'id': '46a040e6-2750-47b4-b8e2-757b92f1adf1'} Nov 01 19:04:05.901313 n-d-863052-2 devstack@n-api.service[121402]: {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 01 19:04:05.901313 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:04:05.901313 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 01 19:04:05.901313 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 01 19:04:05.901313 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 01 19:04:05.901313 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 01 19:04:05.901313 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 01 19:04:05.901313 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 01 19:04:05.901313 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 01 19:04:05.901313 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 01 19:04:05.901313 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 46a040e6-2750-47b4-b8e2-757b92f1adf1 could not be found. Nov 01 19:04:05.901313 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:04:05.901313 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:04:05.901313 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:04:05.901313 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:04:05.901313 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:04:05.901313 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:04:05.901313 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 01 19:04:05.901313 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 01 19:04:05.901313 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 01 19:04:05.901313 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 01 19:04:05.901313 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 01 19:04:05.901313 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 01 19:04:05.901313 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 01 19:04:05.901313 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 01 19:04:05.901313 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 01 19:04:05.901313 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 01 19:04:05.901313 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 46a040e6-2750-47b4-b8e2-757b92f1adf1 could not be found. Nov 01 19:04:05.901313 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:04:05.901313 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:04:05.901313 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:04:05.905123 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:04:05.905123 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:04:05.905123 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:04:05.905123 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 01 19:04:05.905123 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 01 19:04:05.905123 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 46a040e6-2750-47b4-b8e2-757b92f1adf1 could not be found. Nov 01 19:04:05.905123 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:04:05.908231 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-ef3de874-6298-4f20-8985-0d43d683ed4e tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Returning 404 to user: Instance 46a040e6-2750-47b4-b8e2-757b92f1adf1 could not be found. {{(pid=121402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 01 19:04:05.912530 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-ef3de874-6298-4f20-8985-0d43d683ed4e tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] 10.222.0.13 "GET /compute/v2.1/servers/46a040e6-2750-47b4-b8e2-757b92f1adf1" status: 404 len: 111 microversion: 2.1 time: 0.102515 Nov 01 19:04:05.913349 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1305/2627] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:04:05 2022] GET /compute/v2.1/servers/46a040e6-2750-47b4-b8e2-757b92f1adf1 => generated 111 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 01 19:04:05.922821 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-fd93f0cb-e319-4ab4-8995-8f6c698ac938 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:04:05.923564 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-fd93f0cb-e319-4ab4-8995-8f6c698ac938 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] [instance: ac175c18-47f4-4b20-8567-fefb1b701d04] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:04:05.937081 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-fd93f0cb-e319-4ab4-8995-8f6c698ac938 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:04:05.937262 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-fd93f0cb-e319-4ab4-8995-8f6c698ac938 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:04:05.937952 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-fd93f0cb-e319-4ab4-8995-8f6c698ac938 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:04:05.944061 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-fd93f0cb-e319-4ab4-8995-8f6c698ac938 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:04:05.945429 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-fd93f0cb-e319-4ab4-8995-8f6c698ac938 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:04:05.946976 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-fd93f0cb-e319-4ab4-8995-8f6c698ac938 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:04:06.014303 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-fd93f0cb-e319-4ab4-8995-8f6c698ac938 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] [instance: ac175c18-47f4-4b20-8567-fefb1b701d04] Going to try to terminate instance {{(pid=121403) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 01 19:04:06.193591 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-fd93f0cb-e319-4ab4-8995-8f6c698ac938 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] 10.222.0.13 "DELETE /compute/v2.1/servers/ac175c18-47f4-4b20-8567-fefb1b701d04" status: 204 len: 0 microversion: 2.1 time: 0.275823 Nov 01 19:04:06.196802 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1323/2628] 10.222.0.13 () {58 vars in 1239 bytes} [Tue Nov 1 19:04:05 2022] DELETE /compute/v2.1/servers/ac175c18-47f4-4b20-8567-fefb1b701d04 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 01 19:04:06.209090 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-4db26a6d-49ca-433a-833b-f687a3aa8d6e tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:04:06.209882 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-4db26a6d-49ca-433a-833b-f687a3aa8d6e tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] [instance: ac175c18-47f4-4b20-8567-fefb1b701d04] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:04:06.224225 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-4db26a6d-49ca-433a-833b-f687a3aa8d6e tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:04:06.225115 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-4db26a6d-49ca-433a-833b-f687a3aa8d6e tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:04:06.225707 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-4db26a6d-49ca-433a-833b-f687a3aa8d6e tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:04:06.227692 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-4db26a6d-49ca-433a-833b-f687a3aa8d6e tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:04:06.230119 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-4db26a6d-49ca-433a-833b-f687a3aa8d6e tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:04:06.230741 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-4db26a6d-49ca-433a-833b-f687a3aa8d6e tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:04:06.388573 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-a260c1a4-dfd7-4a66-ae93-f8904d351145 tempest-ServersAdminNegativeTestJSON-824756592 tempest-ServersAdminNegativeTestJSON-824756592-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:04:06.390400 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-a260c1a4-dfd7-4a66-ae93-f8904d351145 tempest-ServersAdminNegativeTestJSON-824756592 tempest-ServersAdminNegativeTestJSON-824756592-project] [instance: 7048952a-103c-44f4-a16b-645dc2294787] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:04:06.408071 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-a260c1a4-dfd7-4a66-ae93-f8904d351145 tempest-ServersAdminNegativeTestJSON-824756592 tempest-ServersAdminNegativeTestJSON-824756592-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:04:06.410571 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-a260c1a4-dfd7-4a66-ae93-f8904d351145 tempest-ServersAdminNegativeTestJSON-824756592 tempest-ServersAdminNegativeTestJSON-824756592-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:04:06.412515 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-a260c1a4-dfd7-4a66-ae93-f8904d351145 tempest-ServersAdminNegativeTestJSON-824756592 tempest-ServersAdminNegativeTestJSON-824756592-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:04:06.414861 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-a260c1a4-dfd7-4a66-ae93-f8904d351145 tempest-ServersAdminNegativeTestJSON-824756592 tempest-ServersAdminNegativeTestJSON-824756592-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:04:06.418347 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-a260c1a4-dfd7-4a66-ae93-f8904d351145 tempest-ServersAdminNegativeTestJSON-824756592 tempest-ServersAdminNegativeTestJSON-824756592-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:04:06.418820 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-a260c1a4-dfd7-4a66-ae93-f8904d351145 tempest-ServersAdminNegativeTestJSON-824756592 tempest-ServersAdminNegativeTestJSON-824756592-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:04:06.664484 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-a260c1a4-dfd7-4a66-ae93-f8904d351145 tempest-ServersAdminNegativeTestJSON-824756592 tempest-ServersAdminNegativeTestJSON-824756592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0708fb2fc1df4aa9a9697cbc94acf921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '232745bfe2f3445987fedb91098c84eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:04:06.676551 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-a260c1a4-dfd7-4a66-ae93-f8904d351145 tempest-ServersAdminNegativeTestJSON-824756592 tempest-ServersAdminNegativeTestJSON-824756592-project] 10.222.0.13 "GET /compute/v2.1/servers/7048952a-103c-44f4-a16b-645dc2294787" status: 200 len: 1322 microversion: 2.1 time: 0.293312 Nov 01 19:04:06.677176 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1324/2629] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:04:06 2022] GET /compute/v2.1/servers/7048952a-103c-44f4-a16b-645dc2294787 => generated 1322 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:04:06.686741 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-b96f1ca4-0d21-4163-8783-72bda6e4f5ba tempest-TenantUsagesTestJSON-700278909 tempest-TenantUsagesTestJSON-700278909-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:04:06.687353 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-b96f1ca4-0d21-4163-8783-72bda6e4f5ba tempest-TenantUsagesTestJSON-700278909 tempest-TenantUsagesTestJSON-700278909-project] [instance: 763f688c-9976-4d91-b9cd-c22a9e168086] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:04:06.702692 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-b96f1ca4-0d21-4163-8783-72bda6e4f5ba tempest-TenantUsagesTestJSON-700278909 tempest-TenantUsagesTestJSON-700278909-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:04:06.707114 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-b96f1ca4-0d21-4163-8783-72bda6e4f5ba tempest-TenantUsagesTestJSON-700278909 tempest-TenantUsagesTestJSON-700278909-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:04:06.711117 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-b96f1ca4-0d21-4163-8783-72bda6e4f5ba tempest-TenantUsagesTestJSON-700278909 tempest-TenantUsagesTestJSON-700278909-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:04:06.714445 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-b96f1ca4-0d21-4163-8783-72bda6e4f5ba tempest-TenantUsagesTestJSON-700278909 tempest-TenantUsagesTestJSON-700278909-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:04:06.715864 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-b96f1ca4-0d21-4163-8783-72bda6e4f5ba tempest-TenantUsagesTestJSON-700278909 tempest-TenantUsagesTestJSON-700278909-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:04:06.717684 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-b96f1ca4-0d21-4163-8783-72bda6e4f5ba tempest-TenantUsagesTestJSON-700278909 tempest-TenantUsagesTestJSON-700278909-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:04:06.899258 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-b96f1ca4-0d21-4163-8783-72bda6e4f5ba tempest-TenantUsagesTestJSON-700278909 tempest-TenantUsagesTestJSON-700278909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '556f6f7b8d3745a38734001133ecd70d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a58c7ae460f4022b5d50651df0a486f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:04:06.909530 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-b96f1ca4-0d21-4163-8783-72bda6e4f5ba tempest-TenantUsagesTestJSON-700278909 tempest-TenantUsagesTestJSON-700278909-project] 10.222.0.13 "GET /compute/v2.1/servers/763f688c-9976-4d91-b9cd-c22a9e168086" status: 200 len: 1314 microversion: 2.1 time: 0.225306 Nov 01 19:04:06.911142 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1325/2630] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:04:06 2022] GET /compute/v2.1/servers/763f688c-9976-4d91-b9cd-c22a9e168086 => generated 1314 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:04:06.945648 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-4db26a6d-49ca-433a-833b-f687a3aa8d6e tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb496b3faac4abbae73d389f2042e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e2520220d454764b8c139a58d78ac83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:04:06.956354 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-4db26a6d-49ca-433a-833b-f687a3aa8d6e tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] 10.222.0.13 "GET /compute/v2.1/servers/ac175c18-47f4-4b20-8567-fefb1b701d04" status: 200 len: 1468 microversion: 2.1 time: 0.755721 Nov 01 19:04:06.961619 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1306/2631] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:04:06 2022] GET /compute/v2.1/servers/ac175c18-47f4-4b20-8567-fefb1b701d04 => generated 1468 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:04:07.707587 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-b717427f-b86f-4593-9517-406f6555d0b4 tempest-ServersAdminNegativeTestJSON-824756592 tempest-ServersAdminNegativeTestJSON-824756592-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:04:07.709133 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-b717427f-b86f-4593-9517-406f6555d0b4 tempest-ServersAdminNegativeTestJSON-824756592 tempest-ServersAdminNegativeTestJSON-824756592-project] [instance: 7048952a-103c-44f4-a16b-645dc2294787] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:04:07.726352 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-b717427f-b86f-4593-9517-406f6555d0b4 tempest-ServersAdminNegativeTestJSON-824756592 tempest-ServersAdminNegativeTestJSON-824756592-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:04:07.729549 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-b717427f-b86f-4593-9517-406f6555d0b4 tempest-ServersAdminNegativeTestJSON-824756592 tempest-ServersAdminNegativeTestJSON-824756592-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:04:07.735331 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-b717427f-b86f-4593-9517-406f6555d0b4 tempest-ServersAdminNegativeTestJSON-824756592 tempest-ServersAdminNegativeTestJSON-824756592-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:04:07.739832 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-b717427f-b86f-4593-9517-406f6555d0b4 tempest-ServersAdminNegativeTestJSON-824756592 tempest-ServersAdminNegativeTestJSON-824756592-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:04:07.743728 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-b717427f-b86f-4593-9517-406f6555d0b4 tempest-ServersAdminNegativeTestJSON-824756592 tempest-ServersAdminNegativeTestJSON-824756592-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:04:07.745583 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-b717427f-b86f-4593-9517-406f6555d0b4 tempest-ServersAdminNegativeTestJSON-824756592 tempest-ServersAdminNegativeTestJSON-824756592-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:04:07.936126 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-e645e967-b2c4-4822-a334-16bf8415cc53 tempest-TenantUsagesTestJSON-700278909 tempest-TenantUsagesTestJSON-700278909-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:04:07.937448 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-e645e967-b2c4-4822-a334-16bf8415cc53 tempest-TenantUsagesTestJSON-700278909 tempest-TenantUsagesTestJSON-700278909-project] [instance: 763f688c-9976-4d91-b9cd-c22a9e168086] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:04:07.950140 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e645e967-b2c4-4822-a334-16bf8415cc53 tempest-TenantUsagesTestJSON-700278909 tempest-TenantUsagesTestJSON-700278909-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:04:07.954207 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e645e967-b2c4-4822-a334-16bf8415cc53 tempest-TenantUsagesTestJSON-700278909 tempest-TenantUsagesTestJSON-700278909-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:04:07.954881 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e645e967-b2c4-4822-a334-16bf8415cc53 tempest-TenantUsagesTestJSON-700278909 tempest-TenantUsagesTestJSON-700278909-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:04:07.957553 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e645e967-b2c4-4822-a334-16bf8415cc53 tempest-TenantUsagesTestJSON-700278909 tempest-TenantUsagesTestJSON-700278909-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:04:07.960496 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e645e967-b2c4-4822-a334-16bf8415cc53 tempest-TenantUsagesTestJSON-700278909 tempest-TenantUsagesTestJSON-700278909-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:04:07.962017 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e645e967-b2c4-4822-a334-16bf8415cc53 tempest-TenantUsagesTestJSON-700278909 tempest-TenantUsagesTestJSON-700278909-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:04:08.615411 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-b717427f-b86f-4593-9517-406f6555d0b4 tempest-ServersAdminNegativeTestJSON-824756592 tempest-ServersAdminNegativeTestJSON-824756592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0708fb2fc1df4aa9a9697cbc94acf921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '232745bfe2f3445987fedb91098c84eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:04:08.628522 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-b717427f-b86f-4593-9517-406f6555d0b4 tempest-ServersAdminNegativeTestJSON-824756592 tempest-ServersAdminNegativeTestJSON-824756592-project] 10.222.0.13 "GET /compute/v2.1/servers/7048952a-103c-44f4-a16b-645dc2294787" status: 200 len: 1322 microversion: 2.1 time: 0.930170 Nov 01 19:04:08.645750 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1326/2632] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:04:07 2022] GET /compute/v2.1/servers/7048952a-103c-44f4-a16b-645dc2294787 => generated 1322 bytes in 948 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:04:08.652220 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-dc6c951d-97b2-403d-943c-6fc2f2a7674f tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:04:08.663903 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-dc6c951d-97b2-403d-943c-6fc2f2a7674f tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] [instance: ac175c18-47f4-4b20-8567-fefb1b701d04] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:04:08.677215 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-dc6c951d-97b2-403d-943c-6fc2f2a7674f tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:04:08.678141 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-dc6c951d-97b2-403d-943c-6fc2f2a7674f tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:04:08.678806 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-dc6c951d-97b2-403d-943c-6fc2f2a7674f tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:04:08.679700 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-dc6c951d-97b2-403d-943c-6fc2f2a7674f tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:04:08.681652 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-dc6c951d-97b2-403d-943c-6fc2f2a7674f tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:04:08.682295 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-dc6c951d-97b2-403d-943c-6fc2f2a7674f tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:04:08.729577 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-e645e967-b2c4-4822-a334-16bf8415cc53 tempest-TenantUsagesTestJSON-700278909 tempest-TenantUsagesTestJSON-700278909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '556f6f7b8d3745a38734001133ecd70d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a58c7ae460f4022b5d50651df0a486f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:04:08.755460 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-e645e967-b2c4-4822-a334-16bf8415cc53 tempest-TenantUsagesTestJSON-700278909 tempest-TenantUsagesTestJSON-700278909-project] 10.222.0.13 "GET /compute/v2.1/servers/763f688c-9976-4d91-b9cd-c22a9e168086" status: 200 len: 1314 microversion: 2.1 time: 0.823452 Nov 01 19:04:08.776233 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1307/2633] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:04:07 2022] GET /compute/v2.1/servers/763f688c-9976-4d91-b9cd-c22a9e168086 => generated 1314 bytes in 845 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:04:09.312362 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-dc6c951d-97b2-403d-943c-6fc2f2a7674f tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb496b3faac4abbae73d389f2042e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e2520220d454764b8c139a58d78ac83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:04:09.327822 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-dc6c951d-97b2-403d-943c-6fc2f2a7674f tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] 10.222.0.13 "GET /compute/v2.1/servers/ac175c18-47f4-4b20-8567-fefb1b701d04" status: 200 len: 1468 microversion: 2.1 time: 0.679261 Nov 01 19:04:09.328424 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1327/2634] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:04:08 2022] GET /compute/v2.1/servers/ac175c18-47f4-4b20-8567-fefb1b701d04 => generated 1468 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:04:09.407963 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [req-bf523368-beee-44e1-bc3e-58e955d6ffda req-505ca947-8034-47a1-b133-aed449b259e5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac175c18-47f4-4b20-8567-fefb1b701d04", "name": "network-vif-deleted", "tag": "fc89caa1-e6b4-4cd2-ae6d-02c9e8d9c421"}]} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:04:09.464208 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-bf523368-beee-44e1-bc3e-58e955d6ffda req-505ca947-8034-47a1-b133-aed449b259e5 service nova] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:04:09.464790 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-bf523368-beee-44e1-bc3e-58e955d6ffda req-505ca947-8034-47a1-b133-aed449b259e5 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:04:09.465232 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-bf523368-beee-44e1-bc3e-58e955d6ffda req-505ca947-8034-47a1-b133-aed449b259e5 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:04:09.494514 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.compute.server_external_events [req-bf523368-beee-44e1-bc3e-58e955d6ffda req-505ca947-8034-47a1-b133-aed449b259e5 service nova] Creating event network-vif-deleted:fc89caa1-e6b4-4cd2-ae6d-02c9e8d9c421 for instance ac175c18-47f4-4b20-8567-fefb1b701d04 on n-h2-863052-2 Nov 01 19:04:09.513408 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [req-bf523368-beee-44e1-bc3e-58e955d6ffda req-505ca947-8034-47a1-b133-aed449b259e5 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111585 Nov 01 19:04:09.515235 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1308/2635] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Nov 1 19:04:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:04:09.669107 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [req-95417c18-f161-42be-96b5-89f0307c42fa req-5985b5e4-fa28-4269-824f-2b4600fff40a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7048952a-103c-44f4-a16b-645dc2294787", "tag": "70550865-daf8-414c-9f82-ba55ae791576"}]} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:04:09.678041 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-3d78419b-a451-4652-be5f-fdd1fbc80c7c tempest-ServersAdminNegativeTestJSON-824756592 tempest-ServersAdminNegativeTestJSON-824756592-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:04:09.680047 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-3d78419b-a451-4652-be5f-fdd1fbc80c7c tempest-ServersAdminNegativeTestJSON-824756592 tempest-ServersAdminNegativeTestJSON-824756592-project] [instance: 7048952a-103c-44f4-a16b-645dc2294787] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:04:09.693658 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-3d78419b-a451-4652-be5f-fdd1fbc80c7c tempest-ServersAdminNegativeTestJSON-824756592 tempest-ServersAdminNegativeTestJSON-824756592-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:04:09.696543 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-3d78419b-a451-4652-be5f-fdd1fbc80c7c tempest-ServersAdminNegativeTestJSON-824756592 tempest-ServersAdminNegativeTestJSON-824756592-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:04:09.697409 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-3d78419b-a451-4652-be5f-fdd1fbc80c7c tempest-ServersAdminNegativeTestJSON-824756592 tempest-ServersAdminNegativeTestJSON-824756592-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:04:09.698345 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-3d78419b-a451-4652-be5f-fdd1fbc80c7c tempest-ServersAdminNegativeTestJSON-824756592 tempest-ServersAdminNegativeTestJSON-824756592-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:04:09.699928 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-3d78419b-a451-4652-be5f-fdd1fbc80c7c tempest-ServersAdminNegativeTestJSON-824756592 tempest-ServersAdminNegativeTestJSON-824756592-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:04:09.701998 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-95417c18-f161-42be-96b5-89f0307c42fa req-5985b5e4-fa28-4269-824f-2b4600fff40a service nova] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:04:09.702355 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-3d78419b-a451-4652-be5f-fdd1fbc80c7c tempest-ServersAdminNegativeTestJSON-824756592 tempest-ServersAdminNegativeTestJSON-824756592-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:04:09.702612 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-95417c18-f161-42be-96b5-89f0307c42fa req-5985b5e4-fa28-4269-824f-2b4600fff40a service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:04:09.703064 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-95417c18-f161-42be-96b5-89f0307c42fa req-5985b5e4-fa28-4269-824f-2b4600fff40a service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:04:09.771173 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.compute.server_external_events [req-95417c18-f161-42be-96b5-89f0307c42fa req-5985b5e4-fa28-4269-824f-2b4600fff40a service nova] Creating event network-changed:70550865-daf8-414c-9f82-ba55ae791576 for instance 7048952a-103c-44f4-a16b-645dc2294787 on n-h2-863052-2 Nov 01 19:04:09.790039 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [req-95417c18-f161-42be-96b5-89f0307c42fa req-5985b5e4-fa28-4269-824f-2b4600fff40a service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.127214 Nov 01 19:04:09.811060 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1328/2636] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Nov 1 19:04:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:04:09.837111 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-61a6a105-b4d3-4902-849b-59b7a5432406 tempest-TenantUsagesTestJSON-700278909 tempest-TenantUsagesTestJSON-700278909-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:04:09.840481 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-61a6a105-b4d3-4902-849b-59b7a5432406 tempest-TenantUsagesTestJSON-700278909 tempest-TenantUsagesTestJSON-700278909-project] [instance: 763f688c-9976-4d91-b9cd-c22a9e168086] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:04:09.859387 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-61a6a105-b4d3-4902-849b-59b7a5432406 tempest-TenantUsagesTestJSON-700278909 tempest-TenantUsagesTestJSON-700278909-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:04:09.859876 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-61a6a105-b4d3-4902-849b-59b7a5432406 tempest-TenantUsagesTestJSON-700278909 tempest-TenantUsagesTestJSON-700278909-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:04:09.880441 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-61a6a105-b4d3-4902-849b-59b7a5432406 tempest-TenantUsagesTestJSON-700278909 tempest-TenantUsagesTestJSON-700278909-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:04:09.881561 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-61a6a105-b4d3-4902-849b-59b7a5432406 tempest-TenantUsagesTestJSON-700278909 tempest-TenantUsagesTestJSON-700278909-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:04:09.904132 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-61a6a105-b4d3-4902-849b-59b7a5432406 tempest-TenantUsagesTestJSON-700278909 tempest-TenantUsagesTestJSON-700278909-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:04:09.904729 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-61a6a105-b4d3-4902-849b-59b7a5432406 tempest-TenantUsagesTestJSON-700278909 tempest-TenantUsagesTestJSON-700278909-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:04:10.683679 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-3d78419b-a451-4652-be5f-fdd1fbc80c7c tempest-ServersAdminNegativeTestJSON-824756592 tempest-ServersAdminNegativeTestJSON-824756592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0708fb2fc1df4aa9a9697cbc94acf921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '232745bfe2f3445987fedb91098c84eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:04:10.697824 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-3d78419b-a451-4652-be5f-fdd1fbc80c7c tempest-ServersAdminNegativeTestJSON-824756592 tempest-ServersAdminNegativeTestJSON-824756592-project] 10.222.0.13 "GET /compute/v2.1/servers/7048952a-103c-44f4-a16b-645dc2294787" status: 200 len: 1322 microversion: 2.1 time: 1.025562 Nov 01 19:04:10.705932 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1309/2637] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:04:09 2022] GET /compute/v2.1/servers/7048952a-103c-44f4-a16b-645dc2294787 => generated 1322 bytes in 1034 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:04:10.733658 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-8733bd23-629d-4af2-ae3e-ae83c7a1015e tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:04:10.738736 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-8733bd23-629d-4af2-ae3e-ae83c7a1015e tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] [instance: ac175c18-47f4-4b20-8567-fefb1b701d04] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:04:10.779466 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-8733bd23-629d-4af2-ae3e-ae83c7a1015e tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:04:10.779982 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-8733bd23-629d-4af2-ae3e-ae83c7a1015e tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:04:10.780425 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-8733bd23-629d-4af2-ae3e-ae83c7a1015e tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:04:10.787887 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-8733bd23-629d-4af2-ae3e-ae83c7a1015e tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:04:10.789591 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-8733bd23-629d-4af2-ae3e-ae83c7a1015e tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:04:10.790053 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-8733bd23-629d-4af2-ae3e-ae83c7a1015e tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:04:10.848294 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.wsgi [None req-8733bd23-629d-4af2-ae3e-ae83c7a1015e tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] HTTP exception thrown: Instance ac175c18-47f4-4b20-8567-fefb1b701d04 could not be found. Nov 01 19:04:10.850042 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-8733bd23-629d-4af2-ae3e-ae83c7a1015e tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Request method failure captured: Nov 01 19:04:10.850042 n-d-863052-2 devstack@n-api.service[121402]: request: GET /compute/v2.1/servers/ac175c18-47f4-4b20-8567-fefb1b701d04 HTTP/1.1 Nov 01 19:04:10.850042 n-d-863052-2 devstack@n-api.service[121402]: Accept: application/json Nov 01 19:04:10.850042 n-d-863052-2 devstack@n-api.service[121402]: Accept-Encoding: identity Nov 01 19:04:10.850042 n-d-863052-2 devstack@n-api.service[121402]: Connection: close Nov 01 19:04:10.850042 n-d-863052-2 devstack@n-api.service[121402]: Content-Length: 0 Nov 01 19:04:10.850042 n-d-863052-2 devstack@n-api.service[121402]: Content-Type: application/json Nov 01 19:04:10.850042 n-d-863052-2 devstack@n-api.service[121402]: Host: 10.222.0.13 Nov 01 19:04:10.850042 n-d-863052-2 devstack@n-api.service[121402]: Openstack-System-Scope: None Nov 01 19:04:10.850042 n-d-863052-2 devstack@n-api.service[121402]: User-Agent: python-urllib3/1.26.12 Nov 01 19:04:10.850042 n-d-863052-2 devstack@n-api.service[121402]: X-Auth-Token: gAAAAABjYW0KvKIsQ5yNuH1CirZscDHdVwR62XXP2pHr0THUOA1-YzUZh7LWrRRAp-FTHEQ1bC4Sk-0OgSJf3KzR1P_vE0tAn9Q-jY2vnWbJXZZ2pkUvZlTPq8DTHCXBzSyDvwVIOlTE_wddSbkQ0gLoMgk4r70-gVye8ayGLfneFV3MHXrqhJE Nov 01 19:04:10.850042 n-d-863052-2 devstack@n-api.service[121402]: X-Domain-Id: None Nov 01 19:04:10.850042 n-d-863052-2 devstack@n-api.service[121402]: X-Domain-Name: None Nov 01 19:04:10.850042 n-d-863052-2 devstack@n-api.service[121402]: X-Identity-Status: Confirmed Nov 01 19:04:10.850042 n-d-863052-2 devstack@n-api.service[121402]: X-Is-Admin-Project: True Nov 01 19:04:10.850042 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Domain-Id: default Nov 01 19:04:10.850042 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Domain-Name: Default Nov 01 19:04:10.850042 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Id: 3e2520220d454764b8c139a58d78ac83 Nov 01 19:04:10.850042 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Name: tempest-ServersAdminTestJSON-1380417766 Nov 01 19:04:10.850042 n-d-863052-2 devstack@n-api.service[121402]: X-Role: member,reader Nov 01 19:04:10.850042 n-d-863052-2 devstack@n-api.service[121402]: X-Roles: member,reader Nov 01 19:04:10.850042 n-d-863052-2 devstack@n-api.service[121402]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/3e2520220d454764b8c139a58d78ac83"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/3e2520220d454764b8c139a58d78ac83"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_3e2520220d454764b8c139a58d78ac83", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/3e2520220d454764b8c139a58d78ac83"}]}] Nov 01 19:04:10.850042 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant: tempest-ServersAdminTestJSON-1380417766 Nov 01 19:04:10.850042 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant-Id: 3e2520220d454764b8c139a58d78ac83 Nov 01 19:04:10.850042 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant-Name: tempest-ServersAdminTestJSON-1380417766 Nov 01 19:04:10.850042 n-d-863052-2 devstack@n-api.service[121402]: X-User: tempest-ServersAdminTestJSON-1380417766-project Nov 01 19:04:10.850042 n-d-863052-2 devstack@n-api.service[121402]: X-User-Domain-Id: default Nov 01 19:04:10.850042 n-d-863052-2 devstack@n-api.service[121402]: X-User-Domain-Name: Default Nov 01 19:04:10.850042 n-d-863052-2 devstack@n-api.service[121402]: X-User-Id: bcb496b3faac4abbae73d389f2042e77 Nov 01 19:04:10.850042 n-d-863052-2 devstack@n-api.service[121402]: X-User-Name: tempest-ServersAdminTestJSON-1380417766-project Nov 01 19:04:10.850042 n-d-863052-2 devstack@n-api.service[121402]: method: > Nov 01 19:04:10.850042 n-d-863052-2 devstack@n-api.service[121402]: exception: Instance ac175c18-47f4-4b20-8567-fefb1b701d04 could not be found. Nov 01 19:04:10.850042 n-d-863052-2 devstack@n-api.service[121402]: action_args: {'id': 'ac175c18-47f4-4b20-8567-fefb1b701d04'} Nov 01 19:04:10.850042 n-d-863052-2 devstack@n-api.service[121402]: {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 01 19:04:10.850042 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:04:10.850042 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 01 19:04:10.850042 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 01 19:04:10.850042 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 01 19:04:10.850042 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 01 19:04:10.850042 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 01 19:04:10.850042 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 01 19:04:10.850042 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 01 19:04:10.850042 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 01 19:04:10.850042 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ac175c18-47f4-4b20-8567-fefb1b701d04 could not be found. Nov 01 19:04:10.850042 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:04:10.850042 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:04:10.850042 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:04:10.850042 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:04:10.850042 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:04:10.850042 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:04:10.850042 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 01 19:04:10.850042 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 01 19:04:10.850042 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 01 19:04:10.850042 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 01 19:04:10.850042 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 01 19:04:10.850042 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 01 19:04:10.850042 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 01 19:04:10.850042 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 01 19:04:10.850042 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 01 19:04:10.850042 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 01 19:04:10.850042 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ac175c18-47f4-4b20-8567-fefb1b701d04 could not be found. Nov 01 19:04:10.850042 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:04:10.850042 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:04:10.850042 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:04:10.853575 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:04:10.853575 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:04:10.853575 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:04:10.853575 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 01 19:04:10.853575 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 01 19:04:10.853575 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ac175c18-47f4-4b20-8567-fefb1b701d04 could not be found. Nov 01 19:04:10.853575 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:04:10.853575 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-8733bd23-629d-4af2-ae3e-ae83c7a1015e tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Returning 404 to user: Instance ac175c18-47f4-4b20-8567-fefb1b701d04 could not be found. {{(pid=121402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 01 19:04:10.853575 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-8733bd23-629d-4af2-ae3e-ae83c7a1015e tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] 10.222.0.13 "GET /compute/v2.1/servers/ac175c18-47f4-4b20-8567-fefb1b701d04" status: 404 len: 111 microversion: 2.1 time: 0.144345 Nov 01 19:04:10.863028 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1310/2638] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:04:10 2022] GET /compute/v2.1/servers/ac175c18-47f4-4b20-8567-fefb1b701d04 => generated 111 bytes in 156 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 01 19:04:10.879812 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-3b42638d-6420-44af-b8b5-379a030dd627 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:04:10.880343 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-3b42638d-6420-44af-b8b5-379a030dd627 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] [instance: 992f5ec5-d256-4870-b16d-fc8d9adbd3e7] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:04:10.905137 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-3b42638d-6420-44af-b8b5-379a030dd627 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:04:10.906484 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-3b42638d-6420-44af-b8b5-379a030dd627 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:04:10.906944 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-3b42638d-6420-44af-b8b5-379a030dd627 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:04:10.909734 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-3b42638d-6420-44af-b8b5-379a030dd627 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:04:10.910532 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-3b42638d-6420-44af-b8b5-379a030dd627 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:04:10.912406 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-3b42638d-6420-44af-b8b5-379a030dd627 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:04:10.994291 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-3b42638d-6420-44af-b8b5-379a030dd627 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] [instance: 992f5ec5-d256-4870-b16d-fc8d9adbd3e7] Going to try to terminate instance {{(pid=121402) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 01 19:04:11.309766 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-3b42638d-6420-44af-b8b5-379a030dd627 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] 10.222.0.13 "DELETE /compute/v2.1/servers/992f5ec5-d256-4870-b16d-fc8d9adbd3e7" status: 204 len: 0 microversion: 2.1 time: 0.443222 Nov 01 19:04:11.310714 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1311/2639] 10.222.0.13 () {58 vars in 1239 bytes} [Tue Nov 1 19:04:10 2022] DELETE /compute/v2.1/servers/992f5ec5-d256-4870-b16d-fc8d9adbd3e7 => generated 0 bytes in 447 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 01 19:04:11.325740 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-12089c6a-9db9-4463-9f49-a45d5086d442 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:04:11.328285 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-12089c6a-9db9-4463-9f49-a45d5086d442 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] [instance: 992f5ec5-d256-4870-b16d-fc8d9adbd3e7] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:04:11.348286 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-12089c6a-9db9-4463-9f49-a45d5086d442 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:04:11.349249 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-12089c6a-9db9-4463-9f49-a45d5086d442 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:04:11.350138 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-12089c6a-9db9-4463-9f49-a45d5086d442 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:04:11.352509 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-12089c6a-9db9-4463-9f49-a45d5086d442 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:04:11.354869 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-12089c6a-9db9-4463-9f49-a45d5086d442 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:04:11.357191 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-12089c6a-9db9-4463-9f49-a45d5086d442 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:04:11.811144 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-61a6a105-b4d3-4902-849b-59b7a5432406 tempest-TenantUsagesTestJSON-700278909 tempest-TenantUsagesTestJSON-700278909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '556f6f7b8d3745a38734001133ecd70d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a58c7ae460f4022b5d50651df0a486f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:04:11.822715 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-61a6a105-b4d3-4902-849b-59b7a5432406 tempest-TenantUsagesTestJSON-700278909 tempest-TenantUsagesTestJSON-700278909-project] 10.222.0.13 "GET /compute/v2.1/servers/763f688c-9976-4d91-b9cd-c22a9e168086" status: 200 len: 1314 microversion: 2.1 time: 2.007631 Nov 01 19:04:11.826160 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1329/2640] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:04:09 2022] GET /compute/v2.1/servers/763f688c-9976-4d91-b9cd-c22a9e168086 => generated 1314 bytes in 2012 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:04:11.837196 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-b1aad7b6-1610-40ed-98a6-dc49b79cb094 tempest-ServersAdminNegativeTestJSON-824756592 tempest-ServersAdminNegativeTestJSON-824756592-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:04:11.838439 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-b1aad7b6-1610-40ed-98a6-dc49b79cb094 tempest-ServersAdminNegativeTestJSON-824756592 tempest-ServersAdminNegativeTestJSON-824756592-project] [instance: 7048952a-103c-44f4-a16b-645dc2294787] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:04:11.854200 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-b1aad7b6-1610-40ed-98a6-dc49b79cb094 tempest-ServersAdminNegativeTestJSON-824756592 tempest-ServersAdminNegativeTestJSON-824756592-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:04:11.858917 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-b1aad7b6-1610-40ed-98a6-dc49b79cb094 tempest-ServersAdminNegativeTestJSON-824756592 tempest-ServersAdminNegativeTestJSON-824756592-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:04:11.860087 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-b1aad7b6-1610-40ed-98a6-dc49b79cb094 tempest-ServersAdminNegativeTestJSON-824756592 tempest-ServersAdminNegativeTestJSON-824756592-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:04:11.860877 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-b1aad7b6-1610-40ed-98a6-dc49b79cb094 tempest-ServersAdminNegativeTestJSON-824756592 tempest-ServersAdminNegativeTestJSON-824756592-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:04:11.861404 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-b1aad7b6-1610-40ed-98a6-dc49b79cb094 tempest-ServersAdminNegativeTestJSON-824756592 tempest-ServersAdminNegativeTestJSON-824756592-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:04:11.861840 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-b1aad7b6-1610-40ed-98a6-dc49b79cb094 tempest-ServersAdminNegativeTestJSON-824756592 tempest-ServersAdminNegativeTestJSON-824756592-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:04:11.982408 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-12089c6a-9db9-4463-9f49-a45d5086d442 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb496b3faac4abbae73d389f2042e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e2520220d454764b8c139a58d78ac83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:04:11.998577 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-12089c6a-9db9-4463-9f49-a45d5086d442 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] 10.222.0.13 "GET /compute/v2.1/servers/992f5ec5-d256-4870-b16d-fc8d9adbd3e7" status: 200 len: 1470 microversion: 2.1 time: 0.677353 Nov 01 19:04:11.999223 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1312/2641] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:04:11 2022] GET /compute/v2.1/servers/992f5ec5-d256-4870-b16d-fc8d9adbd3e7 => generated 1470 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:04:12.132949 n-d-863052-2 devstack@n-api.service[121403]: DEBUG dbcounter [-] [121403] Writing DB stats nova_cell0:SELECT=2 {{(pid=121403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 19:04:12.849225 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-479cc797-1e04-4078-882a-96c8a00e3858 tempest-TenantUsagesTestJSON-700278909 tempest-TenantUsagesTestJSON-700278909-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:04:12.850096 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-479cc797-1e04-4078-882a-96c8a00e3858 tempest-TenantUsagesTestJSON-700278909 tempest-TenantUsagesTestJSON-700278909-project] [instance: 763f688c-9976-4d91-b9cd-c22a9e168086] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:04:12.863664 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-479cc797-1e04-4078-882a-96c8a00e3858 tempest-TenantUsagesTestJSON-700278909 tempest-TenantUsagesTestJSON-700278909-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:04:12.864152 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-479cc797-1e04-4078-882a-96c8a00e3858 tempest-TenantUsagesTestJSON-700278909 tempest-TenantUsagesTestJSON-700278909-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:04:12.864640 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-479cc797-1e04-4078-882a-96c8a00e3858 tempest-TenantUsagesTestJSON-700278909 tempest-TenantUsagesTestJSON-700278909-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:04:12.870004 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-479cc797-1e04-4078-882a-96c8a00e3858 tempest-TenantUsagesTestJSON-700278909 tempest-TenantUsagesTestJSON-700278909-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:04:12.870608 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-479cc797-1e04-4078-882a-96c8a00e3858 tempest-TenantUsagesTestJSON-700278909 tempest-TenantUsagesTestJSON-700278909-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:04:12.871058 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-479cc797-1e04-4078-882a-96c8a00e3858 tempest-TenantUsagesTestJSON-700278909 tempest-TenantUsagesTestJSON-700278909-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:04:13.093525 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-b1aad7b6-1610-40ed-98a6-dc49b79cb094 tempest-ServersAdminNegativeTestJSON-824756592 tempest-ServersAdminNegativeTestJSON-824756592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0708fb2fc1df4aa9a9697cbc94acf921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '232745bfe2f3445987fedb91098c84eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:04:13.113539 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-b1aad7b6-1610-40ed-98a6-dc49b79cb094 tempest-ServersAdminNegativeTestJSON-824756592 tempest-ServersAdminNegativeTestJSON-824756592-project] 10.222.0.13 "GET /compute/v2.1/servers/7048952a-103c-44f4-a16b-645dc2294787" status: 200 len: 1322 microversion: 2.1 time: 1.285133 Nov 01 19:04:13.117301 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1330/2642] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:04:11 2022] GET /compute/v2.1/servers/7048952a-103c-44f4-a16b-645dc2294787 => generated 1322 bytes in 1290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:04:13.125689 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-3d7206de-ebb2-4428-a437-cdfb400d81b1 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:04:13.129285 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-3d7206de-ebb2-4428-a437-cdfb400d81b1 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] [instance: 992f5ec5-d256-4870-b16d-fc8d9adbd3e7] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:04:13.143570 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-3d7206de-ebb2-4428-a437-cdfb400d81b1 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:04:13.147225 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-3d7206de-ebb2-4428-a437-cdfb400d81b1 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:04:13.147911 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-3d7206de-ebb2-4428-a437-cdfb400d81b1 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:04:13.148944 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-3d7206de-ebb2-4428-a437-cdfb400d81b1 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:04:13.149830 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-3d7206de-ebb2-4428-a437-cdfb400d81b1 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:04:13.151552 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-3d7206de-ebb2-4428-a437-cdfb400d81b1 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:04:13.805460 n-d-863052-2 devstack@n-api.service[121403]: DEBUG dbcounter [-] [121403] Writing DB stats nova_cell0:SELECT=8 {{(pid=121403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 19:04:13.832501 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-3d7206de-ebb2-4428-a437-cdfb400d81b1 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb496b3faac4abbae73d389f2042e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e2520220d454764b8c139a58d78ac83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:04:13.842301 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-3d7206de-ebb2-4428-a437-cdfb400d81b1 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] 10.222.0.13 "GET /compute/v2.1/servers/992f5ec5-d256-4870-b16d-fc8d9adbd3e7" status: 200 len: 1470 microversion: 2.1 time: 0.723550 Nov 01 19:04:13.845177 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1331/2643] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:04:13 2022] GET /compute/v2.1/servers/992f5ec5-d256-4870-b16d-fc8d9adbd3e7 => generated 1470 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:04:13.867772 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [req-39f15aeb-d750-4c15-b692-bf8c4de02eb4 req-47918fd6-d1d8-4d10-bdae-3461c16410dc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "763f688c-9976-4d91-b9cd-c22a9e168086", "name": "network-vif-plugged", "status": "completed", "tag": "baa1feb5-723e-4631-8588-8a93e79c5750"}]} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:04:13.887625 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-39f15aeb-d750-4c15-b692-bf8c4de02eb4 req-47918fd6-d1d8-4d10-bdae-3461c16410dc service nova] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:04:13.892257 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-39f15aeb-d750-4c15-b692-bf8c4de02eb4 req-47918fd6-d1d8-4d10-bdae-3461c16410dc service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:04:13.893427 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-39f15aeb-d750-4c15-b692-bf8c4de02eb4 req-47918fd6-d1d8-4d10-bdae-3461c16410dc service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:04:13.919422 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.compute.server_external_events [req-39f15aeb-d750-4c15-b692-bf8c4de02eb4 req-47918fd6-d1d8-4d10-bdae-3461c16410dc service nova] Creating event network-vif-plugged:baa1feb5-723e-4631-8588-8a93e79c5750 for instance 763f688c-9976-4d91-b9cd-c22a9e168086 on n-h1-863052-2 Nov 01 19:04:13.925068 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [req-39f15aeb-d750-4c15-b692-bf8c4de02eb4 req-47918fd6-d1d8-4d10-bdae-3461c16410dc service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078547 Nov 01 19:04:13.930428 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1332/2644] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Nov 1 19:04:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:04:14.125448 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-479cc797-1e04-4078-882a-96c8a00e3858 tempest-TenantUsagesTestJSON-700278909 tempest-TenantUsagesTestJSON-700278909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '556f6f7b8d3745a38734001133ecd70d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a58c7ae460f4022b5d50651df0a486f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:04:14.143311 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-d619256d-2017-4f95-96da-0711ffce8f82 tempest-ServersAdminNegativeTestJSON-824756592 tempest-ServersAdminNegativeTestJSON-824756592-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:04:14.143954 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-d619256d-2017-4f95-96da-0711ffce8f82 tempest-ServersAdminNegativeTestJSON-824756592 tempest-ServersAdminNegativeTestJSON-824756592-project] [instance: 7048952a-103c-44f4-a16b-645dc2294787] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:04:14.148989 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-479cc797-1e04-4078-882a-96c8a00e3858 tempest-TenantUsagesTestJSON-700278909 tempest-TenantUsagesTestJSON-700278909-project] 10.222.0.13 "GET /compute/v2.1/servers/763f688c-9976-4d91-b9cd-c22a9e168086" status: 200 len: 1314 microversion: 2.1 time: 1.304926 Nov 01 19:04:14.160620 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d619256d-2017-4f95-96da-0711ffce8f82 tempest-ServersAdminNegativeTestJSON-824756592 tempest-ServersAdminNegativeTestJSON-824756592-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:04:14.160826 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1313/2645] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:04:12 2022] GET /compute/v2.1/servers/763f688c-9976-4d91-b9cd-c22a9e168086 => generated 1314 bytes in 1309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 19:04:14.195873 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d619256d-2017-4f95-96da-0711ffce8f82 tempest-ServersAdminNegativeTestJSON-824756592 tempest-ServersAdminNegativeTestJSON-824756592-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.044s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:04:14.196679 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d619256d-2017-4f95-96da-0711ffce8f82 tempest-ServersAdminNegativeTestJSON-824756592 tempest-ServersAdminNegativeTestJSON-824756592-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:04:14.203933 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d619256d-2017-4f95-96da-0711ffce8f82 tempest-ServersAdminNegativeTestJSON-824756592 tempest-ServersAdminNegativeTestJSON-824756592-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:04:14.204914 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d619256d-2017-4f95-96da-0711ffce8f82 tempest-ServersAdminNegativeTestJSON-824756592 tempest-ServersAdminNegativeTestJSON-824756592-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:04:14.208600 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d619256d-2017-4f95-96da-0711ffce8f82 tempest-ServersAdminNegativeTestJSON-824756592 tempest-ServersAdminNegativeTestJSON-824756592-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:04:14.808071 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-d619256d-2017-4f95-96da-0711ffce8f82 tempest-ServersAdminNegativeTestJSON-824756592 tempest-ServersAdminNegativeTestJSON-824756592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0708fb2fc1df4aa9a9697cbc94acf921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '232745bfe2f3445987fedb91098c84eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:04:14.823761 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-d619256d-2017-4f95-96da-0711ffce8f82 tempest-ServersAdminNegativeTestJSON-824756592 tempest-ServersAdminNegativeTestJSON-824756592-project] 10.222.0.13 "GET /compute/v2.1/servers/7048952a-103c-44f4-a16b-645dc2294787" status: 200 len: 1322 microversion: 2.1 time: 0.684787 Nov 01 19:04:14.831151 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1333/2646] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:04:14 2022] GET /compute/v2.1/servers/7048952a-103c-44f4-a16b-645dc2294787 => generated 1322 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:04:14.872164 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-95a4864e-857b-4ee2-adcb-60d88cdb226c tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:04:14.872987 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-95a4864e-857b-4ee2-adcb-60d88cdb226c tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] [instance: 992f5ec5-d256-4870-b16d-fc8d9adbd3e7] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:04:14.897134 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-95a4864e-857b-4ee2-adcb-60d88cdb226c tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:04:14.898854 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-95a4864e-857b-4ee2-adcb-60d88cdb226c tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:04:14.901854 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-95a4864e-857b-4ee2-adcb-60d88cdb226c tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:04:14.904000 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-95a4864e-857b-4ee2-adcb-60d88cdb226c tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:04:14.905891 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-95a4864e-857b-4ee2-adcb-60d88cdb226c tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:04:14.908699 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-95a4864e-857b-4ee2-adcb-60d88cdb226c tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:04:15.178962 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-f869aa44-5f1f-4d99-b630-0ab455323f42 tempest-TenantUsagesTestJSON-700278909 tempest-TenantUsagesTestJSON-700278909-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:04:15.185108 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-f869aa44-5f1f-4d99-b630-0ab455323f42 tempest-TenantUsagesTestJSON-700278909 tempest-TenantUsagesTestJSON-700278909-project] [instance: 763f688c-9976-4d91-b9cd-c22a9e168086] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:04:15.198243 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f869aa44-5f1f-4d99-b630-0ab455323f42 tempest-TenantUsagesTestJSON-700278909 tempest-TenantUsagesTestJSON-700278909-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:04:15.200165 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f869aa44-5f1f-4d99-b630-0ab455323f42 tempest-TenantUsagesTestJSON-700278909 tempest-TenantUsagesTestJSON-700278909-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:04:15.202249 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f869aa44-5f1f-4d99-b630-0ab455323f42 tempest-TenantUsagesTestJSON-700278909 tempest-TenantUsagesTestJSON-700278909-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:04:15.203188 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f869aa44-5f1f-4d99-b630-0ab455323f42 tempest-TenantUsagesTestJSON-700278909 tempest-TenantUsagesTestJSON-700278909-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:04:15.203798 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f869aa44-5f1f-4d99-b630-0ab455323f42 tempest-TenantUsagesTestJSON-700278909 tempest-TenantUsagesTestJSON-700278909-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:04:15.205425 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f869aa44-5f1f-4d99-b630-0ab455323f42 tempest-TenantUsagesTestJSON-700278909 tempest-TenantUsagesTestJSON-700278909-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:04:15.308614 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-95a4864e-857b-4ee2-adcb-60d88cdb226c tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb496b3faac4abbae73d389f2042e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e2520220d454764b8c139a58d78ac83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:04:15.317097 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-95a4864e-857b-4ee2-adcb-60d88cdb226c tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] 10.222.0.13 "GET /compute/v2.1/servers/992f5ec5-d256-4870-b16d-fc8d9adbd3e7" status: 200 len: 1428 microversion: 2.1 time: 0.452570 Nov 01 19:04:15.320906 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1314/2647] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:04:14 2022] GET /compute/v2.1/servers/992f5ec5-d256-4870-b16d-fc8d9adbd3e7 => generated 1428 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:04:15.330912 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [req-10e43c56-d298-4e14-a6ae-56800c032c6e req-63803457-a223-4588-bcef-52f2c662aab1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "992f5ec5-d256-4870-b16d-fc8d9adbd3e7", "name": "network-vif-deleted", "tag": "30841eab-b46a-44ca-adc8-04928cc72ec5"}]} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:04:15.359508 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-10e43c56-d298-4e14-a6ae-56800c032c6e req-63803457-a223-4588-bcef-52f2c662aab1 service nova] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:04:15.360234 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-10e43c56-d298-4e14-a6ae-56800c032c6e req-63803457-a223-4588-bcef-52f2c662aab1 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:04:15.360852 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-10e43c56-d298-4e14-a6ae-56800c032c6e req-63803457-a223-4588-bcef-52f2c662aab1 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:04:15.367642 n-d-863052-2 devstack@n-api.service[121402]: DEBUG dbcounter [-] [121402] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 19:04:15.393086 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.compute.server_external_events [req-10e43c56-d298-4e14-a6ae-56800c032c6e req-63803457-a223-4588-bcef-52f2c662aab1 service nova] Creating event network-vif-deleted:30841eab-b46a-44ca-adc8-04928cc72ec5 for instance 992f5ec5-d256-4870-b16d-fc8d9adbd3e7 on n-h1-863052-2 Nov 01 19:04:15.406758 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [req-10e43c56-d298-4e14-a6ae-56800c032c6e req-63803457-a223-4588-bcef-52f2c662aab1 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084326 Nov 01 19:04:15.414375 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1315/2648] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Nov 1 19:04:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:04:15.863166 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-403a6892-0db9-4bd3-a1d9-523dbcd6f1ec tempest-ServersAdminNegativeTestJSON-824756592 tempest-ServersAdminNegativeTestJSON-824756592-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:04:15.864238 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-403a6892-0db9-4bd3-a1d9-523dbcd6f1ec tempest-ServersAdminNegativeTestJSON-824756592 tempest-ServersAdminNegativeTestJSON-824756592-project] [instance: 7048952a-103c-44f4-a16b-645dc2294787] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:04:15.865524 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-f869aa44-5f1f-4d99-b630-0ab455323f42 tempest-TenantUsagesTestJSON-700278909 tempest-TenantUsagesTestJSON-700278909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '556f6f7b8d3745a38734001133ecd70d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a58c7ae460f4022b5d50651df0a486f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:04:15.869624 n-d-863052-2 devstack@n-api.service[121403]: DEBUG dbcounter [-] [121403] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=121403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 19:04:15.872244 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-403a6892-0db9-4bd3-a1d9-523dbcd6f1ec tempest-ServersAdminNegativeTestJSON-824756592 tempest-ServersAdminNegativeTestJSON-824756592-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:04:15.873378 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-403a6892-0db9-4bd3-a1d9-523dbcd6f1ec tempest-ServersAdminNegativeTestJSON-824756592 tempest-ServersAdminNegativeTestJSON-824756592-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:04:15.874079 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-403a6892-0db9-4bd3-a1d9-523dbcd6f1ec tempest-ServersAdminNegativeTestJSON-824756592 tempest-ServersAdminNegativeTestJSON-824756592-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:04:15.875053 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-403a6892-0db9-4bd3-a1d9-523dbcd6f1ec tempest-ServersAdminNegativeTestJSON-824756592 tempest-ServersAdminNegativeTestJSON-824756592-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:04:15.875746 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-403a6892-0db9-4bd3-a1d9-523dbcd6f1ec tempest-ServersAdminNegativeTestJSON-824756592 tempest-ServersAdminNegativeTestJSON-824756592-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:04:15.875995 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-f869aa44-5f1f-4d99-b630-0ab455323f42 tempest-TenantUsagesTestJSON-700278909 tempest-TenantUsagesTestJSON-700278909-project] 10.222.0.13 "GET /compute/v2.1/servers/763f688c-9976-4d91-b9cd-c22a9e168086" status: 200 len: 1314 microversion: 2.1 time: 0.701493 Nov 01 19:04:15.876681 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-403a6892-0db9-4bd3-a1d9-523dbcd6f1ec tempest-ServersAdminNegativeTestJSON-824756592 tempest-ServersAdminNegativeTestJSON-824756592-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:04:15.888996 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1334/2649] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:04:15 2022] GET /compute/v2.1/servers/763f688c-9976-4d91-b9cd-c22a9e168086 => generated 1314 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 19:04:16.129194 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-403a6892-0db9-4bd3-a1d9-523dbcd6f1ec tempest-ServersAdminNegativeTestJSON-824756592 tempest-ServersAdminNegativeTestJSON-824756592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0708fb2fc1df4aa9a9697cbc94acf921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '232745bfe2f3445987fedb91098c84eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:04:16.138240 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-403a6892-0db9-4bd3-a1d9-523dbcd6f1ec tempest-ServersAdminNegativeTestJSON-824756592 tempest-ServersAdminNegativeTestJSON-824756592-project] 10.222.0.13 "GET /compute/v2.1/servers/7048952a-103c-44f4-a16b-645dc2294787" status: 200 len: 1322 microversion: 2.1 time: 0.281318 Nov 01 19:04:16.148895 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1316/2650] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:04:15 2022] GET /compute/v2.1/servers/7048952a-103c-44f4-a16b-645dc2294787 => generated 1322 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:04:16.345342 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-0aa39dd8-f979-4381-ace4-3049a96b8c32 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:04:16.347600 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-0aa39dd8-f979-4381-ace4-3049a96b8c32 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] [instance: 992f5ec5-d256-4870-b16d-fc8d9adbd3e7] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:04:16.372079 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-0aa39dd8-f979-4381-ace4-3049a96b8c32 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:04:16.372673 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-0aa39dd8-f979-4381-ace4-3049a96b8c32 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:04:16.373278 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-0aa39dd8-f979-4381-ace4-3049a96b8c32 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:04:16.373998 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-0aa39dd8-f979-4381-ace4-3049a96b8c32 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:04:16.374447 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-0aa39dd8-f979-4381-ace4-3049a96b8c32 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:04:16.375059 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-0aa39dd8-f979-4381-ace4-3049a96b8c32 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:04:16.410265 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.wsgi [None req-0aa39dd8-f979-4381-ace4-3049a96b8c32 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] HTTP exception thrown: Instance 992f5ec5-d256-4870-b16d-fc8d9adbd3e7 could not be found. Nov 01 19:04:16.412146 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-0aa39dd8-f979-4381-ace4-3049a96b8c32 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Request method failure captured: Nov 01 19:04:16.412146 n-d-863052-2 devstack@n-api.service[121403]: request: GET /compute/v2.1/servers/992f5ec5-d256-4870-b16d-fc8d9adbd3e7 HTTP/1.1 Nov 01 19:04:16.412146 n-d-863052-2 devstack@n-api.service[121403]: Accept: application/json Nov 01 19:04:16.412146 n-d-863052-2 devstack@n-api.service[121403]: Accept-Encoding: identity Nov 01 19:04:16.412146 n-d-863052-2 devstack@n-api.service[121403]: Connection: close Nov 01 19:04:16.412146 n-d-863052-2 devstack@n-api.service[121403]: Content-Length: 0 Nov 01 19:04:16.412146 n-d-863052-2 devstack@n-api.service[121403]: Content-Type: application/json Nov 01 19:04:16.412146 n-d-863052-2 devstack@n-api.service[121403]: Host: 10.222.0.13 Nov 01 19:04:16.412146 n-d-863052-2 devstack@n-api.service[121403]: Openstack-System-Scope: None Nov 01 19:04:16.412146 n-d-863052-2 devstack@n-api.service[121403]: User-Agent: python-urllib3/1.26.12 Nov 01 19:04:16.412146 n-d-863052-2 devstack@n-api.service[121403]: X-Auth-Token: gAAAAABjYW0KvKIsQ5yNuH1CirZscDHdVwR62XXP2pHr0THUOA1-YzUZh7LWrRRAp-FTHEQ1bC4Sk-0OgSJf3KzR1P_vE0tAn9Q-jY2vnWbJXZZ2pkUvZlTPq8DTHCXBzSyDvwVIOlTE_wddSbkQ0gLoMgk4r70-gVye8ayGLfneFV3MHXrqhJE Nov 01 19:04:16.412146 n-d-863052-2 devstack@n-api.service[121403]: X-Domain-Id: None Nov 01 19:04:16.412146 n-d-863052-2 devstack@n-api.service[121403]: X-Domain-Name: None Nov 01 19:04:16.412146 n-d-863052-2 devstack@n-api.service[121403]: X-Identity-Status: Confirmed Nov 01 19:04:16.412146 n-d-863052-2 devstack@n-api.service[121403]: X-Is-Admin-Project: True Nov 01 19:04:16.412146 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Domain-Id: default Nov 01 19:04:16.412146 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Domain-Name: Default Nov 01 19:04:16.412146 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Id: 3e2520220d454764b8c139a58d78ac83 Nov 01 19:04:16.412146 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Name: tempest-ServersAdminTestJSON-1380417766 Nov 01 19:04:16.412146 n-d-863052-2 devstack@n-api.service[121403]: X-Role: member,reader Nov 01 19:04:16.412146 n-d-863052-2 devstack@n-api.service[121403]: X-Roles: member,reader Nov 01 19:04:16.412146 n-d-863052-2 devstack@n-api.service[121403]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/3e2520220d454764b8c139a58d78ac83"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/3e2520220d454764b8c139a58d78ac83"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_3e2520220d454764b8c139a58d78ac83", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/3e2520220d454764b8c139a58d78ac83"}]}] Nov 01 19:04:16.412146 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant: tempest-ServersAdminTestJSON-1380417766 Nov 01 19:04:16.412146 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant-Id: 3e2520220d454764b8c139a58d78ac83 Nov 01 19:04:16.412146 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant-Name: tempest-ServersAdminTestJSON-1380417766 Nov 01 19:04:16.412146 n-d-863052-2 devstack@n-api.service[121403]: X-User: tempest-ServersAdminTestJSON-1380417766-project Nov 01 19:04:16.412146 n-d-863052-2 devstack@n-api.service[121403]: X-User-Domain-Id: default Nov 01 19:04:16.412146 n-d-863052-2 devstack@n-api.service[121403]: X-User-Domain-Name: Default Nov 01 19:04:16.412146 n-d-863052-2 devstack@n-api.service[121403]: X-User-Id: bcb496b3faac4abbae73d389f2042e77 Nov 01 19:04:16.412146 n-d-863052-2 devstack@n-api.service[121403]: X-User-Name: tempest-ServersAdminTestJSON-1380417766-project Nov 01 19:04:16.412146 n-d-863052-2 devstack@n-api.service[121403]: method: > Nov 01 19:04:16.412146 n-d-863052-2 devstack@n-api.service[121403]: exception: Instance 992f5ec5-d256-4870-b16d-fc8d9adbd3e7 could not be found. Nov 01 19:04:16.412146 n-d-863052-2 devstack@n-api.service[121403]: action_args: {'id': '992f5ec5-d256-4870-b16d-fc8d9adbd3e7'} Nov 01 19:04:16.412146 n-d-863052-2 devstack@n-api.service[121403]: {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 01 19:04:16.412146 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:04:16.412146 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 01 19:04:16.412146 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 01 19:04:16.412146 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 01 19:04:16.412146 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 01 19:04:16.412146 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 01 19:04:16.412146 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 01 19:04:16.412146 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 01 19:04:16.412146 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 01 19:04:16.412146 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 992f5ec5-d256-4870-b16d-fc8d9adbd3e7 could not be found. Nov 01 19:04:16.412146 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:04:16.412146 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:04:16.412146 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:04:16.412146 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:04:16.412146 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:04:16.412146 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:04:16.412146 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 01 19:04:16.412146 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 01 19:04:16.412146 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 01 19:04:16.412146 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 01 19:04:16.412146 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 01 19:04:16.412146 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 01 19:04:16.412146 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 01 19:04:16.412146 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 01 19:04:16.412146 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 01 19:04:16.412146 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 01 19:04:16.412146 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 992f5ec5-d256-4870-b16d-fc8d9adbd3e7 could not be found. Nov 01 19:04:16.412146 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:04:16.412146 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:04:16.412146 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:04:16.416311 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:04:16.416311 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:04:16.416311 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:04:16.416311 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 01 19:04:16.416311 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 01 19:04:16.416311 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 992f5ec5-d256-4870-b16d-fc8d9adbd3e7 could not be found. Nov 01 19:04:16.416311 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:04:16.423353 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-0aa39dd8-f979-4381-ace4-3049a96b8c32 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] Returning 404 to user: Instance 992f5ec5-d256-4870-b16d-fc8d9adbd3e7 could not be found. {{(pid=121403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 01 19:04:16.424730 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-0aa39dd8-f979-4381-ace4-3049a96b8c32 tempest-ServersAdminTestJSON-1380417766 tempest-ServersAdminTestJSON-1380417766-project] 10.222.0.13 "GET /compute/v2.1/servers/992f5ec5-d256-4870-b16d-fc8d9adbd3e7" status: 404 len: 111 microversion: 2.1 time: 0.086869 Nov 01 19:04:16.426318 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1335/2651] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:04:16 2022] GET /compute/v2.1/servers/992f5ec5-d256-4870-b16d-fc8d9adbd3e7 => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 01 19:04:16.905143 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-4efa7007-97c6-4263-a80d-22645d6bf848 tempest-TenantUsagesTestJSON-700278909 tempest-TenantUsagesTestJSON-700278909-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:04:16.906971 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-4efa7007-97c6-4263-a80d-22645d6bf848 tempest-TenantUsagesTestJSON-700278909 tempest-TenantUsagesTestJSON-700278909-project] [instance: 763f688c-9976-4d91-b9cd-c22a9e168086] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:04:16.921052 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-4efa7007-97c6-4263-a80d-22645d6bf848 tempest-TenantUsagesTestJSON-700278909 tempest-TenantUsagesTestJSON-700278909-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:04:16.926836 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-4efa7007-97c6-4263-a80d-22645d6bf848 tempest-TenantUsagesTestJSON-700278909 tempest-TenantUsagesTestJSON-700278909-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:04:16.928905 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-4efa7007-97c6-4263-a80d-22645d6bf848 tempest-TenantUsagesTestJSON-700278909 tempest-TenantUsagesTestJSON-700278909-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:04:16.930602 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-4efa7007-97c6-4263-a80d-22645d6bf848 tempest-TenantUsagesTestJSON-700278909 tempest-TenantUsagesTestJSON-700278909-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:04:16.932412 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-4efa7007-97c6-4263-a80d-22645d6bf848 tempest-TenantUsagesTestJSON-700278909 tempest-TenantUsagesTestJSON-700278909-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:04:16.933145 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-4efa7007-97c6-4263-a80d-22645d6bf848 tempest-TenantUsagesTestJSON-700278909 tempest-TenantUsagesTestJSON-700278909-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:04:17.163773 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-bc39235d-db2c-444a-a6bf-caeca50f4a75 tempest-ServersAdminNegativeTestJSON-824756592 tempest-ServersAdminNegativeTestJSON-824756592-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:04:17.164396 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-bc39235d-db2c-444a-a6bf-caeca50f4a75 tempest-ServersAdminNegativeTestJSON-824756592 tempest-ServersAdminNegativeTestJSON-824756592-project] [instance: 7048952a-103c-44f4-a16b-645dc2294787] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:04:17.176895 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-bc39235d-db2c-444a-a6bf-caeca50f4a75 tempest-ServersAdminNegativeTestJSON-824756592 tempest-ServersAdminNegativeTestJSON-824756592-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:04:17.177386 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-bc39235d-db2c-444a-a6bf-caeca50f4a75 tempest-ServersAdminNegativeTestJSON-824756592 tempest-ServersAdminNegativeTestJSON-824756592-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:04:17.177822 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-bc39235d-db2c-444a-a6bf-caeca50f4a75 tempest-ServersAdminNegativeTestJSON-824756592 tempest-ServersAdminNegativeTestJSON-824756592-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:04:17.178548 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-bc39235d-db2c-444a-a6bf-caeca50f4a75 tempest-ServersAdminNegativeTestJSON-824756592 tempest-ServersAdminNegativeTestJSON-824756592-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:04:17.178986 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-bc39235d-db2c-444a-a6bf-caeca50f4a75 tempest-ServersAdminNegativeTestJSON-824756592 tempest-ServersAdminNegativeTestJSON-824756592-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:04:17.184642 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-bc39235d-db2c-444a-a6bf-caeca50f4a75 tempest-ServersAdminNegativeTestJSON-824756592 tempest-ServersAdminNegativeTestJSON-824756592-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:04:17.618731 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-4efa7007-97c6-4263-a80d-22645d6bf848 tempest-TenantUsagesTestJSON-700278909 tempest-TenantUsagesTestJSON-700278909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '556f6f7b8d3745a38734001133ecd70d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a58c7ae460f4022b5d50651df0a486f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:04:17.632548 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-4efa7007-97c6-4263-a80d-22645d6bf848 tempest-TenantUsagesTestJSON-700278909 tempest-TenantUsagesTestJSON-700278909-project] 10.222.0.13 "GET /compute/v2.1/servers/763f688c-9976-4d91-b9cd-c22a9e168086" status: 200 len: 1464 microversion: 2.1 time: 0.727534 Nov 01 19:04:17.649297 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1317/2652] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:04:16 2022] GET /compute/v2.1/servers/763f688c-9976-4d91-b9cd-c22a9e168086 => generated 1464 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:04:17.978229 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-bc39235d-db2c-444a-a6bf-caeca50f4a75 tempest-ServersAdminNegativeTestJSON-824756592 tempest-ServersAdminNegativeTestJSON-824756592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0708fb2fc1df4aa9a9697cbc94acf921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '232745bfe2f3445987fedb91098c84eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:04:17.989762 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-bc39235d-db2c-444a-a6bf-caeca50f4a75 tempest-ServersAdminNegativeTestJSON-824756592 tempest-ServersAdminNegativeTestJSON-824756592-project] 10.222.0.13 "GET /compute/v2.1/servers/7048952a-103c-44f4-a16b-645dc2294787" status: 200 len: 1322 microversion: 2.1 time: 0.827482 Nov 01 19:04:17.992720 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1336/2653] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:04:17 2022] GET /compute/v2.1/servers/7048952a-103c-44f4-a16b-645dc2294787 => generated 1322 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:04:18.011514 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-361d4b68-c2ba-4092-9ba2-e8284c324e40 tempest-TenantUsagesTestJSON-9436999 tempest-TenantUsagesTestJSON-9436999-project-admin] Calling method '.version_select at 0x7f0ae1992af0>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:04:18.028158 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-361d4b68-c2ba-4092-9ba2-e8284c324e40 tempest-TenantUsagesTestJSON-9436999 tempest-TenantUsagesTestJSON-9436999-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:04:18.028828 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-361d4b68-c2ba-4092-9ba2-e8284c324e40 tempest-TenantUsagesTestJSON-9436999 tempest-TenantUsagesTestJSON-9436999-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:04:18.029269 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-361d4b68-c2ba-4092-9ba2-e8284c324e40 tempest-TenantUsagesTestJSON-9436999 tempest-TenantUsagesTestJSON-9436999-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:04:18.054255 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-361d4b68-c2ba-4092-9ba2-e8284c324e40 tempest-TenantUsagesTestJSON-9436999 tempest-TenantUsagesTestJSON-9436999-project-admin] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:04:18.054894 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-361d4b68-c2ba-4092-9ba2-e8284c324e40 tempest-TenantUsagesTestJSON-9436999 tempest-TenantUsagesTestJSON-9436999-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:04:18.056074 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-361d4b68-c2ba-4092-9ba2-e8284c324e40 tempest-TenantUsagesTestJSON-9436999 tempest-TenantUsagesTestJSON-9436999-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:04:18.079316 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-361d4b68-c2ba-4092-9ba2-e8284c324e40 tempest-TenantUsagesTestJSON-9436999 tempest-TenantUsagesTestJSON-9436999-project-admin] 10.222.0.13 "GET /compute/v2.1/os-simple-tenant-usage/6a58c7ae460f4022b5d50651df0a486f?start=2022-10-31T19%3A04%3A17.648515&end=2022-11-02T19%3A04%3A17.648515" status: 200 len: 695 microversion: 2.1 time: 0.421760 Nov 01 19:04:18.081411 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1318/2654] 10.222.0.13 () {58 vars in 1412 bytes} [Tue Nov 1 19:04:17 2022] GET /compute/v2.1/os-simple-tenant-usage/6a58c7ae460f4022b5d50651df0a486f?start=2022-10-31T19%3A04%3A17.648515&end=2022-11-02T19%3A04%3A17.648515 => generated 695 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:04:18.098357 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-9b6a214d-baf5-4b86-ab09-9e9cf7429cf9 tempest-TenantUsagesTestJSON-700278909 tempest-TenantUsagesTestJSON-700278909-project] Calling method '.version_select at 0x7f0ae2accca0>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:04:18.118455 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-9b6a214d-baf5-4b86-ab09-9e9cf7429cf9 tempest-TenantUsagesTestJSON-700278909 tempest-TenantUsagesTestJSON-700278909-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:04:18.120558 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-9b6a214d-baf5-4b86-ab09-9e9cf7429cf9 tempest-TenantUsagesTestJSON-700278909 tempest-TenantUsagesTestJSON-700278909-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:04:18.125366 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-9b6a214d-baf5-4b86-ab09-9e9cf7429cf9 tempest-TenantUsagesTestJSON-700278909 tempest-TenantUsagesTestJSON-700278909-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:04:18.159532 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-9b6a214d-baf5-4b86-ab09-9e9cf7429cf9 tempest-TenantUsagesTestJSON-700278909 tempest-TenantUsagesTestJSON-700278909-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:04:18.160158 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-9b6a214d-baf5-4b86-ab09-9e9cf7429cf9 tempest-TenantUsagesTestJSON-700278909 tempest-TenantUsagesTestJSON-700278909-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:04:18.163210 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-9b6a214d-baf5-4b86-ab09-9e9cf7429cf9 tempest-TenantUsagesTestJSON-700278909 tempest-TenantUsagesTestJSON-700278909-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:04:18.238855 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-9b6a214d-baf5-4b86-ab09-9e9cf7429cf9 tempest-TenantUsagesTestJSON-700278909 tempest-TenantUsagesTestJSON-700278909-project] 10.222.0.13 "GET /compute/v2.1/os-simple-tenant-usage/6a58c7ae460f4022b5d50651df0a486f?start=2022-10-31T19%3A04%3A17.648515&end=2022-11-02T19%3A04%3A17.648515" status: 200 len: 695 microversion: 2.1 time: 0.140993 Nov 01 19:04:18.244797 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1337/2655] 10.222.0.13 () {58 vars in 1412 bytes} [Tue Nov 1 19:04:18 2022] GET /compute/v2.1/os-simple-tenant-usage/6a58c7ae460f4022b5d50651df0a486f?start=2022-10-31T19%3A04%3A17.648515&end=2022-11-02T19%3A04%3A17.648515 => generated 695 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:04:18.257014 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-a761ff45-7113-4900-b38d-34caea191696 tempest-TenantUsagesTestJSON-9436999 tempest-TenantUsagesTestJSON-9436999-project-admin] Calling method '.version_select at 0x7f0ae19cb820>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:04:18.277408 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-a761ff45-7113-4900-b38d-34caea191696 tempest-TenantUsagesTestJSON-9436999 tempest-TenantUsagesTestJSON-9436999-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:04:18.287236 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-a761ff45-7113-4900-b38d-34caea191696 tempest-TenantUsagesTestJSON-9436999 tempest-TenantUsagesTestJSON-9436999-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:04:18.288052 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-a761ff45-7113-4900-b38d-34caea191696 tempest-TenantUsagesTestJSON-9436999 tempest-TenantUsagesTestJSON-9436999-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:04:18.344894 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-a761ff45-7113-4900-b38d-34caea191696 tempest-TenantUsagesTestJSON-9436999 tempest-TenantUsagesTestJSON-9436999-project-admin] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:04:18.345932 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-a761ff45-7113-4900-b38d-34caea191696 tempest-TenantUsagesTestJSON-9436999 tempest-TenantUsagesTestJSON-9436999-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:04:18.346371 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-a761ff45-7113-4900-b38d-34caea191696 tempest-TenantUsagesTestJSON-9436999 tempest-TenantUsagesTestJSON-9436999-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:04:18.626934 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-a761ff45-7113-4900-b38d-34caea191696 tempest-TenantUsagesTestJSON-9436999 tempest-TenantUsagesTestJSON-9436999-project-admin] 10.222.0.13 "GET /compute/v2.1/os-simple-tenant-usage?start=2022-10-31T19%3A04%3A17.648515&end=2022-11-02T19%3A04%3A17.648515&detailed=1" status: 200 len: 28482 microversion: 2.1 time: 0.372445 Nov 01 19:04:18.627753 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1319/2656] 10.222.0.13 () {58 vars in 1335 bytes} [Tue Nov 1 19:04:18 2022] GET /compute/v2.1/os-simple-tenant-usage?start=2022-10-31T19%3A04%3A17.648515&end=2022-11-02T19%3A04%3A17.648515&detailed=1 => generated 28482 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 01 19:04:18.677243 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-2b590418-0fd0-41f8-8c97-df68d811d265 tempest-TenantUsagesTestJSON-700278909 tempest-TenantUsagesTestJSON-700278909-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:04:18.677754 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-2b590418-0fd0-41f8-8c97-df68d811d265 tempest-TenantUsagesTestJSON-700278909 tempest-TenantUsagesTestJSON-700278909-project] [instance: 763f688c-9976-4d91-b9cd-c22a9e168086] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:04:18.688094 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-2b590418-0fd0-41f8-8c97-df68d811d265 tempest-TenantUsagesTestJSON-700278909 tempest-TenantUsagesTestJSON-700278909-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:04:18.688611 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-2b590418-0fd0-41f8-8c97-df68d811d265 tempest-TenantUsagesTestJSON-700278909 tempest-TenantUsagesTestJSON-700278909-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:04:18.692298 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-2b590418-0fd0-41f8-8c97-df68d811d265 tempest-TenantUsagesTestJSON-700278909 tempest-TenantUsagesTestJSON-700278909-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:04:18.693289 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-2b590418-0fd0-41f8-8c97-df68d811d265 tempest-TenantUsagesTestJSON-700278909 tempest-TenantUsagesTestJSON-700278909-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:04:18.700169 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-2b590418-0fd0-41f8-8c97-df68d811d265 tempest-TenantUsagesTestJSON-700278909 tempest-TenantUsagesTestJSON-700278909-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:04:18.700880 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-2b590418-0fd0-41f8-8c97-df68d811d265 tempest-TenantUsagesTestJSON-700278909 tempest-TenantUsagesTestJSON-700278909-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:04:18.767084 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-2b590418-0fd0-41f8-8c97-df68d811d265 tempest-TenantUsagesTestJSON-700278909 tempest-TenantUsagesTestJSON-700278909-project] [instance: 763f688c-9976-4d91-b9cd-c22a9e168086] Going to try to terminate instance {{(pid=121403) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 01 19:04:18.995526 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-2b590418-0fd0-41f8-8c97-df68d811d265 tempest-TenantUsagesTestJSON-700278909 tempest-TenantUsagesTestJSON-700278909-project] 10.222.0.13 "DELETE /compute/v2.1/servers/763f688c-9976-4d91-b9cd-c22a9e168086" status: 204 len: 0 microversion: 2.1 time: 0.323460 Nov 01 19:04:18.999793 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1338/2657] 10.222.0.13 () {58 vars in 1239 bytes} [Tue Nov 1 19:04:18 2022] DELETE /compute/v2.1/servers/763f688c-9976-4d91-b9cd-c22a9e168086 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 01 19:04:19.008706 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-f11b1557-7740-4f65-8b08-9bc3c954ccec tempest-TenantUsagesTestJSON-700278909 tempest-TenantUsagesTestJSON-700278909-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:04:19.009411 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-f11b1557-7740-4f65-8b08-9bc3c954ccec tempest-TenantUsagesTestJSON-700278909 tempest-TenantUsagesTestJSON-700278909-project] [instance: 763f688c-9976-4d91-b9cd-c22a9e168086] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:04:19.021961 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-548d40ab-3363-48f1-af5b-61aa6fc3cabd tempest-ServersAdminNegativeTestJSON-824756592 tempest-ServersAdminNegativeTestJSON-824756592-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:04:19.023675 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-548d40ab-3363-48f1-af5b-61aa6fc3cabd tempest-ServersAdminNegativeTestJSON-824756592 tempest-ServersAdminNegativeTestJSON-824756592-project] [instance: 7048952a-103c-44f4-a16b-645dc2294787] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:04:19.033469 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f11b1557-7740-4f65-8b08-9bc3c954ccec tempest-TenantUsagesTestJSON-700278909 tempest-TenantUsagesTestJSON-700278909-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:04:19.035573 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f11b1557-7740-4f65-8b08-9bc3c954ccec tempest-TenantUsagesTestJSON-700278909 tempest-TenantUsagesTestJSON-700278909-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:04:19.039353 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f11b1557-7740-4f65-8b08-9bc3c954ccec tempest-TenantUsagesTestJSON-700278909 tempest-TenantUsagesTestJSON-700278909-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:04:19.043572 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-548d40ab-3363-48f1-af5b-61aa6fc3cabd tempest-ServersAdminNegativeTestJSON-824756592 tempest-ServersAdminNegativeTestJSON-824756592-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:04:19.044345 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-548d40ab-3363-48f1-af5b-61aa6fc3cabd tempest-ServersAdminNegativeTestJSON-824756592 tempest-ServersAdminNegativeTestJSON-824756592-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:04:19.044888 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f11b1557-7740-4f65-8b08-9bc3c954ccec tempest-TenantUsagesTestJSON-700278909 tempest-TenantUsagesTestJSON-700278909-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:04:19.045711 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-548d40ab-3363-48f1-af5b-61aa6fc3cabd tempest-ServersAdminNegativeTestJSON-824756592 tempest-ServersAdminNegativeTestJSON-824756592-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:04:19.047171 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-548d40ab-3363-48f1-af5b-61aa6fc3cabd tempest-ServersAdminNegativeTestJSON-824756592 tempest-ServersAdminNegativeTestJSON-824756592-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:04:19.048129 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-548d40ab-3363-48f1-af5b-61aa6fc3cabd tempest-ServersAdminNegativeTestJSON-824756592 tempest-ServersAdminNegativeTestJSON-824756592-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:04:19.048471 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f11b1557-7740-4f65-8b08-9bc3c954ccec tempest-TenantUsagesTestJSON-700278909 tempest-TenantUsagesTestJSON-700278909-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:04:19.049012 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-548d40ab-3363-48f1-af5b-61aa6fc3cabd tempest-ServersAdminNegativeTestJSON-824756592 tempest-ServersAdminNegativeTestJSON-824756592-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:04:19.050323 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f11b1557-7740-4f65-8b08-9bc3c954ccec tempest-TenantUsagesTestJSON-700278909 tempest-TenantUsagesTestJSON-700278909-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:04:19.815424 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-f11b1557-7740-4f65-8b08-9bc3c954ccec tempest-TenantUsagesTestJSON-700278909 tempest-TenantUsagesTestJSON-700278909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '556f6f7b8d3745a38734001133ecd70d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a58c7ae460f4022b5d50651df0a486f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:04:19.823118 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-f11b1557-7740-4f65-8b08-9bc3c954ccec tempest-TenantUsagesTestJSON-700278909 tempest-TenantUsagesTestJSON-700278909-project] 10.222.0.13 "GET /compute/v2.1/servers/763f688c-9976-4d91-b9cd-c22a9e168086" status: 200 len: 1470 microversion: 2.1 time: 0.820100 Nov 01 19:04:19.843454 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1320/2658] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:04:19 2022] GET /compute/v2.1/servers/763f688c-9976-4d91-b9cd-c22a9e168086 => generated 1470 bytes in 838 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:04:19.860489 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [req-881b8f29-c554-4921-be66-e5ac18843f3c req-778e3919-60e5-437f-8a39-5f67d705f878 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7048952a-103c-44f4-a16b-645dc2294787", "name": "network-vif-plugged", "status": "completed", "tag": "70550865-daf8-414c-9f82-ba55ae791576"}]} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:04:19.892942 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-881b8f29-c554-4921-be66-e5ac18843f3c req-778e3919-60e5-437f-8a39-5f67d705f878 service nova] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:04:19.896977 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-881b8f29-c554-4921-be66-e5ac18843f3c req-778e3919-60e5-437f-8a39-5f67d705f878 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:04:19.897446 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-881b8f29-c554-4921-be66-e5ac18843f3c req-778e3919-60e5-437f-8a39-5f67d705f878 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:04:19.935639 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.compute.server_external_events [req-881b8f29-c554-4921-be66-e5ac18843f3c req-778e3919-60e5-437f-8a39-5f67d705f878 service nova] Creating event network-vif-plugged:70550865-daf8-414c-9f82-ba55ae791576 for instance 7048952a-103c-44f4-a16b-645dc2294787 on n-h2-863052-2 Nov 01 19:04:19.956564 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [req-881b8f29-c554-4921-be66-e5ac18843f3c req-778e3919-60e5-437f-8a39-5f67d705f878 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107067 Nov 01 19:04:19.958518 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1321/2659] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Nov 1 19:04:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:04:20.046080 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-548d40ab-3363-48f1-af5b-61aa6fc3cabd tempest-ServersAdminNegativeTestJSON-824756592 tempest-ServersAdminNegativeTestJSON-824756592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0708fb2fc1df4aa9a9697cbc94acf921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '232745bfe2f3445987fedb91098c84eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:04:20.068919 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-548d40ab-3363-48f1-af5b-61aa6fc3cabd tempest-ServersAdminNegativeTestJSON-824756592 tempest-ServersAdminNegativeTestJSON-824756592-project] 10.222.0.13 "GET /compute/v2.1/servers/7048952a-103c-44f4-a16b-645dc2294787" status: 200 len: 1322 microversion: 2.1 time: 1.043870 Nov 01 19:04:20.071218 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1339/2660] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:04:19 2022] GET /compute/v2.1/servers/7048952a-103c-44f4-a16b-645dc2294787 => generated 1322 bytes in 1058 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:04:20.851336 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-f9de5459-390a-4713-a69c-01433ea250d6 tempest-TenantUsagesTestJSON-700278909 tempest-TenantUsagesTestJSON-700278909-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:04:20.852161 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-f9de5459-390a-4713-a69c-01433ea250d6 tempest-TenantUsagesTestJSON-700278909 tempest-TenantUsagesTestJSON-700278909-project] [instance: 763f688c-9976-4d91-b9cd-c22a9e168086] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:04:20.864498 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f9de5459-390a-4713-a69c-01433ea250d6 tempest-TenantUsagesTestJSON-700278909 tempest-TenantUsagesTestJSON-700278909-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:04:20.865515 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f9de5459-390a-4713-a69c-01433ea250d6 tempest-TenantUsagesTestJSON-700278909 tempest-TenantUsagesTestJSON-700278909-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:04:20.867991 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f9de5459-390a-4713-a69c-01433ea250d6 tempest-TenantUsagesTestJSON-700278909 tempest-TenantUsagesTestJSON-700278909-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:04:20.869577 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f9de5459-390a-4713-a69c-01433ea250d6 tempest-TenantUsagesTestJSON-700278909 tempest-TenantUsagesTestJSON-700278909-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:04:20.871837 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f9de5459-390a-4713-a69c-01433ea250d6 tempest-TenantUsagesTestJSON-700278909 tempest-TenantUsagesTestJSON-700278909-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:04:20.873872 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f9de5459-390a-4713-a69c-01433ea250d6 tempest-TenantUsagesTestJSON-700278909 tempest-TenantUsagesTestJSON-700278909-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:04:21.105903 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-fb6dba7e-824c-4928-bfa8-eacf394a7a3d tempest-ServersAdminNegativeTestJSON-824756592 tempest-ServersAdminNegativeTestJSON-824756592-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:04:21.108216 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-fb6dba7e-824c-4928-bfa8-eacf394a7a3d tempest-ServersAdminNegativeTestJSON-824756592 tempest-ServersAdminNegativeTestJSON-824756592-project] [instance: 7048952a-103c-44f4-a16b-645dc2294787] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:04:21.118830 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-fb6dba7e-824c-4928-bfa8-eacf394a7a3d tempest-ServersAdminNegativeTestJSON-824756592 tempest-ServersAdminNegativeTestJSON-824756592-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:04:21.119813 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-fb6dba7e-824c-4928-bfa8-eacf394a7a3d tempest-ServersAdminNegativeTestJSON-824756592 tempest-ServersAdminNegativeTestJSON-824756592-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:04:21.120608 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-fb6dba7e-824c-4928-bfa8-eacf394a7a3d tempest-ServersAdminNegativeTestJSON-824756592 tempest-ServersAdminNegativeTestJSON-824756592-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:04:21.121593 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-fb6dba7e-824c-4928-bfa8-eacf394a7a3d tempest-ServersAdminNegativeTestJSON-824756592 tempest-ServersAdminNegativeTestJSON-824756592-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:04:21.122493 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-fb6dba7e-824c-4928-bfa8-eacf394a7a3d tempest-ServersAdminNegativeTestJSON-824756592 tempest-ServersAdminNegativeTestJSON-824756592-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:04:21.123211 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-fb6dba7e-824c-4928-bfa8-eacf394a7a3d tempest-ServersAdminNegativeTestJSON-824756592 tempest-ServersAdminNegativeTestJSON-824756592-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:04:22.346272 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-f9de5459-390a-4713-a69c-01433ea250d6 tempest-TenantUsagesTestJSON-700278909 tempest-TenantUsagesTestJSON-700278909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '556f6f7b8d3745a38734001133ecd70d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a58c7ae460f4022b5d50651df0a486f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:04:22.359128 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-f9de5459-390a-4713-a69c-01433ea250d6 tempest-TenantUsagesTestJSON-700278909 tempest-TenantUsagesTestJSON-700278909-project] 10.222.0.13 "GET /compute/v2.1/servers/763f688c-9976-4d91-b9cd-c22a9e168086" status: 200 len: 1470 microversion: 2.1 time: 1.511694 Nov 01 19:04:22.364915 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1322/2661] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:04:20 2022] GET /compute/v2.1/servers/763f688c-9976-4d91-b9cd-c22a9e168086 => generated 1470 bytes in 1519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:04:22.734424 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [req-ec23de58-16ef-450f-aea7-2c5843ead980 req-6c571281-4003-4cc3-8e38-493ed36840dc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "763f688c-9976-4d91-b9cd-c22a9e168086", "name": "network-vif-deleted", "tag": "baa1feb5-723e-4631-8588-8a93e79c5750"}]} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:04:22.740109 n-d-863052-2 devstack@n-api.service[121402]: DEBUG dbcounter [-] [121402] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=94,nova_api:UPDATE=1 {{(pid=121402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 19:04:22.761480 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-ec23de58-16ef-450f-aea7-2c5843ead980 req-6c571281-4003-4cc3-8e38-493ed36840dc service nova] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:04:22.761480 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-ec23de58-16ef-450f-aea7-2c5843ead980 req-6c571281-4003-4cc3-8e38-493ed36840dc service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:04:22.761884 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-ec23de58-16ef-450f-aea7-2c5843ead980 req-6c571281-4003-4cc3-8e38-493ed36840dc service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:04:22.795012 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.compute.server_external_events [req-ec23de58-16ef-450f-aea7-2c5843ead980 req-6c571281-4003-4cc3-8e38-493ed36840dc service nova] Creating event network-vif-deleted:baa1feb5-723e-4631-8588-8a93e79c5750 for instance 763f688c-9976-4d91-b9cd-c22a9e168086 on n-h1-863052-2 Nov 01 19:04:22.803896 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [req-ec23de58-16ef-450f-aea7-2c5843ead980 req-6c571281-4003-4cc3-8e38-493ed36840dc service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074197 Nov 01 19:04:22.807672 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1323/2662] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Nov 1 19:04:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 01 19:04:23.093579 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-fb6dba7e-824c-4928-bfa8-eacf394a7a3d tempest-ServersAdminNegativeTestJSON-824756592 tempest-ServersAdminNegativeTestJSON-824756592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0708fb2fc1df4aa9a9697cbc94acf921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '232745bfe2f3445987fedb91098c84eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:04:23.120568 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-fb6dba7e-824c-4928-bfa8-eacf394a7a3d tempest-ServersAdminNegativeTestJSON-824756592 tempest-ServersAdminNegativeTestJSON-824756592-project] 10.222.0.13 "GET /compute/v2.1/servers/7048952a-103c-44f4-a16b-645dc2294787" status: 200 len: 1322 microversion: 2.1 time: 2.018418 Nov 01 19:04:23.121578 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1340/2663] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:04:21 2022] GET /compute/v2.1/servers/7048952a-103c-44f4-a16b-645dc2294787 => generated 1322 bytes in 2023 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 19:04:23.393455 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-ebec093d-05e7-4808-b91b-e6d4880c3a25 tempest-TenantUsagesTestJSON-700278909 tempest-TenantUsagesTestJSON-700278909-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:04:23.394236 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-ebec093d-05e7-4808-b91b-e6d4880c3a25 tempest-TenantUsagesTestJSON-700278909 tempest-TenantUsagesTestJSON-700278909-project] [instance: 763f688c-9976-4d91-b9cd-c22a9e168086] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:04:23.412069 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-ebec093d-05e7-4808-b91b-e6d4880c3a25 tempest-TenantUsagesTestJSON-700278909 tempest-TenantUsagesTestJSON-700278909-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:04:23.412570 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-ebec093d-05e7-4808-b91b-e6d4880c3a25 tempest-TenantUsagesTestJSON-700278909 tempest-TenantUsagesTestJSON-700278909-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:04:23.413041 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-ebec093d-05e7-4808-b91b-e6d4880c3a25 tempest-TenantUsagesTestJSON-700278909 tempest-TenantUsagesTestJSON-700278909-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:04:23.413761 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-ebec093d-05e7-4808-b91b-e6d4880c3a25 tempest-TenantUsagesTestJSON-700278909 tempest-TenantUsagesTestJSON-700278909-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:04:23.414222 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-ebec093d-05e7-4808-b91b-e6d4880c3a25 tempest-TenantUsagesTestJSON-700278909 tempest-TenantUsagesTestJSON-700278909-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:04:23.414650 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-ebec093d-05e7-4808-b91b-e6d4880c3a25 tempest-TenantUsagesTestJSON-700278909 tempest-TenantUsagesTestJSON-700278909-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:04:23.581977 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-ebec093d-05e7-4808-b91b-e6d4880c3a25 tempest-TenantUsagesTestJSON-700278909 tempest-TenantUsagesTestJSON-700278909-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:04:23.583892 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-ebec093d-05e7-4808-b91b-e6d4880c3a25 tempest-TenantUsagesTestJSON-700278909 tempest-TenantUsagesTestJSON-700278909-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:04:23.585528 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-ebec093d-05e7-4808-b91b-e6d4880c3a25 tempest-TenantUsagesTestJSON-700278909 tempest-TenantUsagesTestJSON-700278909-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:04:23.586163 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.objects.instance [None req-ebec093d-05e7-4808-b91b-e6d4880c3a25 tempest-TenantUsagesTestJSON-700278909 tempest-TenantUsagesTestJSON-700278909-project] Lazy-loading 'fault' on Instance uuid 763f688c-9976-4d91-b9cd-c22a9e168086 {{(pid=121402) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 01 19:04:23.741123 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-ebec093d-05e7-4808-b91b-e6d4880c3a25 tempest-TenantUsagesTestJSON-700278909 tempest-TenantUsagesTestJSON-700278909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '556f6f7b8d3745a38734001133ecd70d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a58c7ae460f4022b5d50651df0a486f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:04:23.749269 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-ebec093d-05e7-4808-b91b-e6d4880c3a25 tempest-TenantUsagesTestJSON-700278909 tempest-TenantUsagesTestJSON-700278909-project] 10.222.0.13 "GET /compute/v2.1/servers/763f688c-9976-4d91-b9cd-c22a9e168086" status: 200 len: 1304 microversion: 2.1 time: 0.369001 Nov 01 19:04:23.754832 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1324/2664] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:04:23 2022] GET /compute/v2.1/servers/763f688c-9976-4d91-b9cd-c22a9e168086 => generated 1304 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:04:24.062575 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-a682149b-9ea5-4db4-ae18-c63289c2734a tempest-KeyPairsV2TestJSON-423945871 tempest-KeyPairsV2TestJSON-423945871-project] Action: 'create', calling method: .version_select at 0x7f0ae2c05dc0>, body: {"keypair": {"name": "tempest-keypair-193011488", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEYqvxq622IOOBddjRI8CRlHwlgibMDTFFR7zhVDnvGhA7oqL5689aXyX5vd2opgDtPlu01ppsgo/9I2zGCpoIZvs527BQyVqfOiaS+sdP3xrNKU2mWkZAGeWCXoJQgh5Q=="}} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:04:24.104031 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.quota [None req-a682149b-9ea5-4db4-ae18-c63289c2734a tempest-KeyPairsV2TestJSON-423945871 tempest-KeyPairsV2TestJSON-423945871-project] Getting quotas for project 372d629fc9c44cbb89b1417b8092444c. Resources: {'key_pairs'} {{(pid=121403) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 01 19:04:24.121842 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.quota [None req-a682149b-9ea5-4db4-ae18-c63289c2734a tempest-KeyPairsV2TestJSON-423945871 tempest-KeyPairsV2TestJSON-423945871-project] Getting quotas for user fe136857bf144347b2649f69b03e29a0 and project 372d629fc9c44cbb89b1417b8092444c. Resources: {'key_pairs'} {{(pid=121403) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 01 19:04:24.143312 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-4706a60f-8275-4978-bc52-2f0c19b5ad3b tempest-ServersAdminNegativeTestJSON-824756592 tempest-ServersAdminNegativeTestJSON-824756592-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:04:24.143931 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-4706a60f-8275-4978-bc52-2f0c19b5ad3b tempest-ServersAdminNegativeTestJSON-824756592 tempest-ServersAdminNegativeTestJSON-824756592-project] [instance: 7048952a-103c-44f4-a16b-645dc2294787] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:04:24.162609 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-4706a60f-8275-4978-bc52-2f0c19b5ad3b tempest-ServersAdminNegativeTestJSON-824756592 tempest-ServersAdminNegativeTestJSON-824756592-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:04:24.163027 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-4706a60f-8275-4978-bc52-2f0c19b5ad3b tempest-ServersAdminNegativeTestJSON-824756592 tempest-ServersAdminNegativeTestJSON-824756592-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:04:24.163543 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-4706a60f-8275-4978-bc52-2f0c19b5ad3b tempest-ServersAdminNegativeTestJSON-824756592 tempest-ServersAdminNegativeTestJSON-824756592-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:04:24.164263 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-4706a60f-8275-4978-bc52-2f0c19b5ad3b tempest-ServersAdminNegativeTestJSON-824756592 tempest-ServersAdminNegativeTestJSON-824756592-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:04:24.164759 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-4706a60f-8275-4978-bc52-2f0c19b5ad3b tempest-ServersAdminNegativeTestJSON-824756592 tempest-ServersAdminNegativeTestJSON-824756592-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:04:24.165188 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-4706a60f-8275-4978-bc52-2f0c19b5ad3b tempest-ServersAdminNegativeTestJSON-824756592 tempest-ServersAdminNegativeTestJSON-824756592-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:04:24.200673 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-a682149b-9ea5-4db4-ae18-c63289c2734a tempest-KeyPairsV2TestJSON-423945871 tempest-KeyPairsV2TestJSON-423945871-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.382255 Nov 01 19:04:24.202467 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1341/2665] 10.222.0.13 () {60 vars in 1159 bytes} [Tue Nov 1 19:04:23 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:04:24.212726 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-0227f14c-e3dc-4940-93b3-167a994541f8 tempest-KeyPairsV2TestJSON-423945871 tempest-KeyPairsV2TestJSON-423945871-project] Calling method '.version_select at 0x7f0ae29d1820>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:04:24.240922 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-0227f14c-e3dc-4940-93b3-167a994541f8 tempest-KeyPairsV2TestJSON-423945871 tempest-KeyPairsV2TestJSON-423945871-project] 10.222.0.13 "GET /compute/v2.1/os-keypairs/tempest-keypair-193011488" status: 200 len: 497 microversion: 2.1 time: 0.031012 Nov 01 19:04:24.243280 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1342/2666] 10.222.0.13 () {58 vars in 1215 bytes} [Tue Nov 1 19:04:24 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-193011488 => generated 497 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 01 19:04:24.257655 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-8796c8b9-ba6c-44c9-b7de-c021c0d8e464 tempest-KeyPairsV2TestJSON-423945871 tempest-KeyPairsV2TestJSON-423945871-project] Calling method '.version_select at 0x7f0ae687c8b0>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:04:24.309737 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-8796c8b9-ba6c-44c9-b7de-c021c0d8e464 tempest-KeyPairsV2TestJSON-423945871 tempest-KeyPairsV2TestJSON-423945871-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-193011488" status: 202 len: 0 microversion: 2.1 time: 0.058616 Nov 01 19:04:24.311826 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1343/2667] 10.222.0.13 () {58 vars in 1218 bytes} [Tue Nov 1 19:04:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-193011488 => generated 0 bytes in 61 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 01 19:04:24.326101 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-b090de9f-9b4d-4eaa-8270-ad6019f73e3c tempest-KeyPairsV2TestJSON-423945871 tempest-KeyPairsV2TestJSON-423945871-project] Action: 'create', calling method: .version_select at 0x7f0ae2d2e550>, body: {"keypair": {"name": "tempest-keypair-531669995", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIy+dCPPKgRy+MMWBoUyWeE88T+JO/1NQ1yRuGJ9BAjX9DhIPgUQjDSiqOxzKAjJpG/WZYr0cKyQYL3E+EBBDrn14FHXAGRxtCgb19At7uD0AjHFIQM6OKd6S6ynTz5jSQ=="}} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:04:24.369528 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.quota [None req-b090de9f-9b4d-4eaa-8270-ad6019f73e3c tempest-KeyPairsV2TestJSON-423945871 tempest-KeyPairsV2TestJSON-423945871-project] Getting quotas for project 372d629fc9c44cbb89b1417b8092444c. Resources: {'key_pairs'} {{(pid=121403) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 01 19:04:24.381490 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.quota [None req-b090de9f-9b4d-4eaa-8270-ad6019f73e3c tempest-KeyPairsV2TestJSON-423945871 tempest-KeyPairsV2TestJSON-423945871-project] Getting quotas for user fe136857bf144347b2649f69b03e29a0 and project 372d629fc9c44cbb89b1417b8092444c. Resources: {'key_pairs'} {{(pid=121403) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 01 19:04:24.441459 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-b090de9f-9b4d-4eaa-8270-ad6019f73e3c tempest-KeyPairsV2TestJSON-423945871 tempest-KeyPairsV2TestJSON-423945871-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.122801 Nov 01 19:04:24.442119 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1344/2668] 10.222.0.13 () {60 vars in 1159 bytes} [Tue Nov 1 19:04:24 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 01 19:04:24.453414 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-2bd6e2a3-a6c5-45e9-96a9-204ef9c9e799 tempest-KeyPairsV2TestJSON-423945871 tempest-KeyPairsV2TestJSON-423945871-project] Calling method '.version_select at 0x7f0ae68f1160>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:04:24.484258 n-d-863052-2 devstack@n-api.service[121403]: DEBUG dbcounter [-] [121403] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=5,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=121403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 19:04:24.496431 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-2bd6e2a3-a6c5-45e9-96a9-204ef9c9e799 tempest-KeyPairsV2TestJSON-423945871 tempest-KeyPairsV2TestJSON-423945871-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-531669995" status: 202 len: 0 microversion: 2.1 time: 0.047655 Nov 01 19:04:24.501803 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1345/2669] 10.222.0.13 () {58 vars in 1218 bytes} [Tue Nov 1 19:04:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-531669995 => generated 0 bytes in 54 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 01 19:04:24.511092 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-e31c460f-18ba-43aa-baf1-4c6d22a86239 tempest-KeyPairsV2TestJSON-423945871 tempest-KeyPairsV2TestJSON-423945871-project] Action: 'create', calling method: .version_select at 0x7f0ae2a94a60>, body: {"keypair": {"name": "tempest-keypair-555215332", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:04:24.568737 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.quota [None req-e31c460f-18ba-43aa-baf1-4c6d22a86239 tempest-KeyPairsV2TestJSON-423945871 tempest-KeyPairsV2TestJSON-423945871-project] Getting quotas for project 372d629fc9c44cbb89b1417b8092444c. Resources: {'key_pairs'} {{(pid=121403) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 01 19:04:24.582067 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.quota [None req-e31c460f-18ba-43aa-baf1-4c6d22a86239 tempest-KeyPairsV2TestJSON-423945871 tempest-KeyPairsV2TestJSON-423945871-project] Getting quotas for user fe136857bf144347b2649f69b03e29a0 and project 372d629fc9c44cbb89b1417b8092444c. Resources: {'key_pairs'} {{(pid=121403) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 01 19:04:24.648257 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-e31c460f-18ba-43aa-baf1-4c6d22a86239 tempest-KeyPairsV2TestJSON-423945871 tempest-KeyPairsV2TestJSON-423945871-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 573 microversion: 2.1 time: 0.140826 Nov 01 19:04:24.649646 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1346/2670] 10.222.0.13 () {60 vars in 1159 bytes} [Tue Nov 1 19:04:24 2022] POST /compute/v2.1/os-keypairs => generated 573 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:04:24.664269 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-7b7e2ac1-968c-48a0-b6fc-cd1f1b1c6e22 tempest-KeyPairsV2TestJSON-423945871 tempest-KeyPairsV2TestJSON-423945871-project] Calling method '.version_select at 0x7f0ae2c051f0>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:04:24.718224 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-7b7e2ac1-968c-48a0-b6fc-cd1f1b1c6e22 tempest-KeyPairsV2TestJSON-423945871 tempest-KeyPairsV2TestJSON-423945871-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-555215332" status: 202 len: 0 microversion: 2.1 time: 0.061652 Nov 01 19:04:24.722012 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1347/2671] 10.222.0.13 () {58 vars in 1218 bytes} [Tue Nov 1 19:04:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-555215332 => generated 0 bytes in 66 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 01 19:04:24.736778 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-42017ed1-3feb-49c9-9777-199030fa7880 tempest-KeyPairsV2TestJSON-423945871 tempest-KeyPairsV2TestJSON-423945871-project] Action: 'create', calling method: .version_select at 0x7f0ae29a5b80>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-621508177", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHQY2Tevr2EudYPupO7qbqeb6vTRgSTa6ldLW7FriTiHu2XfPf5d4XgEYUto9jCE244+XYNsJPGRuNpd442oJMfKJBnIB8Cjp2oLPszqcSnmzMBD5RO3BCYFOAb/Agfgcw=="}} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:04:24.776124 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.quota [None req-42017ed1-3feb-49c9-9777-199030fa7880 tempest-KeyPairsV2TestJSON-423945871 tempest-KeyPairsV2TestJSON-423945871-project] Getting quotas for project 372d629fc9c44cbb89b1417b8092444c. Resources: {'key_pairs'} {{(pid=121403) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 01 19:04:24.794352 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.quota [None req-42017ed1-3feb-49c9-9777-199030fa7880 tempest-KeyPairsV2TestJSON-423945871 tempest-KeyPairsV2TestJSON-423945871-project] Getting quotas for user fe136857bf144347b2649f69b03e29a0 and project 372d629fc9c44cbb89b1417b8092444c. Resources: {'key_pairs'} {{(pid=121403) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 01 19:04:24.857072 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-42017ed1-3feb-49c9-9777-199030fa7880 tempest-KeyPairsV2TestJSON-423945871 tempest-KeyPairsV2TestJSON-423945871-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.125410 Nov 01 19:04:24.857747 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1348/2672] 10.222.0.13 () {60 vars in 1159 bytes} [Tue Nov 1 19:04:24 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:04:24.874487 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-16433fa5-5bb9-46d7-928c-047a1cfad99a tempest-TenantUsagesTestJSON-700278909 tempest-TenantUsagesTestJSON-700278909-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:04:24.880400 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-16433fa5-5bb9-46d7-928c-047a1cfad99a tempest-TenantUsagesTestJSON-700278909 tempest-TenantUsagesTestJSON-700278909-project] [instance: 763f688c-9976-4d91-b9cd-c22a9e168086] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:04:24.899440 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-16433fa5-5bb9-46d7-928c-047a1cfad99a tempest-TenantUsagesTestJSON-700278909 tempest-TenantUsagesTestJSON-700278909-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:04:24.899945 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-16433fa5-5bb9-46d7-928c-047a1cfad99a tempest-TenantUsagesTestJSON-700278909 tempest-TenantUsagesTestJSON-700278909-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:04:24.902730 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-16433fa5-5bb9-46d7-928c-047a1cfad99a tempest-TenantUsagesTestJSON-700278909 tempest-TenantUsagesTestJSON-700278909-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:04:24.906234 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-16433fa5-5bb9-46d7-928c-047a1cfad99a tempest-TenantUsagesTestJSON-700278909 tempest-TenantUsagesTestJSON-700278909-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:04:24.907348 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-16433fa5-5bb9-46d7-928c-047a1cfad99a tempest-TenantUsagesTestJSON-700278909 tempest-TenantUsagesTestJSON-700278909-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:04:24.908571 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-16433fa5-5bb9-46d7-928c-047a1cfad99a tempest-TenantUsagesTestJSON-700278909 tempest-TenantUsagesTestJSON-700278909-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:04:24.909928 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-4706a60f-8275-4978-bc52-2f0c19b5ad3b tempest-ServersAdminNegativeTestJSON-824756592 tempest-ServersAdminNegativeTestJSON-824756592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0708fb2fc1df4aa9a9697cbc94acf921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '232745bfe2f3445987fedb91098c84eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:04:24.925975 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-4706a60f-8275-4978-bc52-2f0c19b5ad3b tempest-ServersAdminNegativeTestJSON-824756592 tempest-ServersAdminNegativeTestJSON-824756592-project] 10.222.0.13 "GET /compute/v2.1/servers/7048952a-103c-44f4-a16b-645dc2294787" status: 200 len: 1472 microversion: 2.1 time: 0.786458 Nov 01 19:04:24.942499 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1325/2673] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:04:24 2022] GET /compute/v2.1/servers/7048952a-103c-44f4-a16b-645dc2294787 => generated 1472 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 19:04:24.947388 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-4b99b40c-f9e4-47e1-b45d-a68b4b4203db tempest-KeyPairsV2TestJSON-423945871 tempest-KeyPairsV2TestJSON-423945871-project] Action: 'create', calling method: .version_select at 0x7f0ae19b8a60>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-1034088259", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIg3CVpDWWJg4Z86Pr1BcIRpRUtA5YpkveWZz5Qfl7+zCilAtDQS5UvYpz4+FGEZ32V2+6D79l0rf4OOMPVkQRQHmm1fw5X78g2b6pCOZLFHkyYMvUzrcKxgvdreYaWxYQ=="}} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:04:24.959097 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.wsgi [None req-16433fa5-5bb9-46d7-928c-047a1cfad99a tempest-TenantUsagesTestJSON-700278909 tempest-TenantUsagesTestJSON-700278909-project] HTTP exception thrown: Instance 763f688c-9976-4d91-b9cd-c22a9e168086 could not be found. Nov 01 19:04:24.960657 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-16433fa5-5bb9-46d7-928c-047a1cfad99a tempest-TenantUsagesTestJSON-700278909 tempest-TenantUsagesTestJSON-700278909-project] Request method failure captured: Nov 01 19:04:24.960657 n-d-863052-2 devstack@n-api.service[121403]: request: GET /compute/v2.1/servers/763f688c-9976-4d91-b9cd-c22a9e168086 HTTP/1.1 Nov 01 19:04:24.960657 n-d-863052-2 devstack@n-api.service[121403]: Accept: application/json Nov 01 19:04:24.960657 n-d-863052-2 devstack@n-api.service[121403]: Accept-Encoding: identity Nov 01 19:04:24.960657 n-d-863052-2 devstack@n-api.service[121403]: Connection: close Nov 01 19:04:24.960657 n-d-863052-2 devstack@n-api.service[121403]: Content-Length: 0 Nov 01 19:04:24.960657 n-d-863052-2 devstack@n-api.service[121403]: Content-Type: application/json Nov 01 19:04:24.960657 n-d-863052-2 devstack@n-api.service[121403]: Host: 10.222.0.13 Nov 01 19:04:24.960657 n-d-863052-2 devstack@n-api.service[121403]: Openstack-System-Scope: None Nov 01 19:04:24.960657 n-d-863052-2 devstack@n-api.service[121403]: User-Agent: python-urllib3/1.26.12 Nov 01 19:04:24.960657 n-d-863052-2 devstack@n-api.service[121403]: X-Auth-Token: gAAAAABjYW2Tf3LDJuW33-FiNPcjy41i_yhcOPR7-0ciHj7-i9U0zxLOXsBOZzz3mfM3oN5sDnfrMP-xg3T-qaD9aIsWUX0N0J0lqr7Qyg5fmtcpeGgkZ6pWoVRetPDN_lk3N2H-sgCEVNLCDIIyxPqiP21loa8C8rAfMmQD-C9fuL0cfCSpkeg Nov 01 19:04:24.960657 n-d-863052-2 devstack@n-api.service[121403]: X-Domain-Id: None Nov 01 19:04:24.960657 n-d-863052-2 devstack@n-api.service[121403]: X-Domain-Name: None Nov 01 19:04:24.960657 n-d-863052-2 devstack@n-api.service[121403]: X-Identity-Status: Confirmed Nov 01 19:04:24.960657 n-d-863052-2 devstack@n-api.service[121403]: X-Is-Admin-Project: True Nov 01 19:04:24.960657 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Domain-Id: default Nov 01 19:04:24.960657 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Domain-Name: Default Nov 01 19:04:24.960657 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Id: 6a58c7ae460f4022b5d50651df0a486f Nov 01 19:04:24.960657 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Name: tempest-TenantUsagesTestJSON-700278909 Nov 01 19:04:24.960657 n-d-863052-2 devstack@n-api.service[121403]: X-Role: member,reader Nov 01 19:04:24.960657 n-d-863052-2 devstack@n-api.service[121403]: X-Roles: member,reader Nov 01 19:04:24.960657 n-d-863052-2 devstack@n-api.service[121403]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/6a58c7ae460f4022b5d50651df0a486f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/6a58c7ae460f4022b5d50651df0a486f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_6a58c7ae460f4022b5d50651df0a486f", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/6a58c7ae460f4022b5d50651df0a486f"}]}] Nov 01 19:04:24.960657 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant: tempest-TenantUsagesTestJSON-700278909 Nov 01 19:04:24.960657 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant-Id: 6a58c7ae460f4022b5d50651df0a486f Nov 01 19:04:24.960657 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant-Name: tempest-TenantUsagesTestJSON-700278909 Nov 01 19:04:24.960657 n-d-863052-2 devstack@n-api.service[121403]: X-User: tempest-TenantUsagesTestJSON-700278909-project Nov 01 19:04:24.960657 n-d-863052-2 devstack@n-api.service[121403]: X-User-Domain-Id: default Nov 01 19:04:24.960657 n-d-863052-2 devstack@n-api.service[121403]: X-User-Domain-Name: Default Nov 01 19:04:24.960657 n-d-863052-2 devstack@n-api.service[121403]: X-User-Id: 556f6f7b8d3745a38734001133ecd70d Nov 01 19:04:24.960657 n-d-863052-2 devstack@n-api.service[121403]: X-User-Name: tempest-TenantUsagesTestJSON-700278909-project Nov 01 19:04:24.960657 n-d-863052-2 devstack@n-api.service[121403]: method: > Nov 01 19:04:24.960657 n-d-863052-2 devstack@n-api.service[121403]: exception: Instance 763f688c-9976-4d91-b9cd-c22a9e168086 could not be found. Nov 01 19:04:24.960657 n-d-863052-2 devstack@n-api.service[121403]: action_args: {'id': '763f688c-9976-4d91-b9cd-c22a9e168086'} Nov 01 19:04:24.960657 n-d-863052-2 devstack@n-api.service[121403]: {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 01 19:04:24.960657 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:04:24.960657 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 01 19:04:24.960657 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 01 19:04:24.960657 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 01 19:04:24.960657 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 01 19:04:24.960657 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 01 19:04:24.960657 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 01 19:04:24.960657 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 01 19:04:24.960657 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 01 19:04:24.960657 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 763f688c-9976-4d91-b9cd-c22a9e168086 could not be found. Nov 01 19:04:24.960657 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:04:24.960657 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:04:24.960657 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:04:24.960657 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:04:24.960657 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:04:24.960657 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:04:24.960657 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 01 19:04:24.960657 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 01 19:04:24.960657 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 01 19:04:24.960657 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 01 19:04:24.960657 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 01 19:04:24.960657 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 01 19:04:24.960657 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 01 19:04:24.960657 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 01 19:04:24.960657 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 01 19:04:24.960657 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 01 19:04:24.960657 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 763f688c-9976-4d91-b9cd-c22a9e168086 could not be found. Nov 01 19:04:24.960657 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:04:24.960657 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:04:24.960657 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:04:24.964454 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:04:24.964454 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:04:24.964454 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:04:24.964454 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 01 19:04:24.964454 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 01 19:04:24.964454 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 763f688c-9976-4d91-b9cd-c22a9e168086 could not be found. Nov 01 19:04:24.964454 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:04:24.964454 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-16433fa5-5bb9-46d7-928c-047a1cfad99a tempest-TenantUsagesTestJSON-700278909 tempest-TenantUsagesTestJSON-700278909-project] Returning 404 to user: Instance 763f688c-9976-4d91-b9cd-c22a9e168086 could not be found. {{(pid=121403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 01 19:04:24.967870 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-16433fa5-5bb9-46d7-928c-047a1cfad99a tempest-TenantUsagesTestJSON-700278909 tempest-TenantUsagesTestJSON-700278909-project] 10.222.0.13 "GET /compute/v2.1/servers/763f688c-9976-4d91-b9cd-c22a9e168086" status: 404 len: 111 microversion: 2.1 time: 0.103064 Nov 01 19:04:24.968481 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1349/2674] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:04:24 2022] GET /compute/v2.1/servers/763f688c-9976-4d91-b9cd-c22a9e168086 => generated 111 bytes in 110 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 01 19:04:24.969010 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.quota [None req-4b99b40c-f9e4-47e1-b45d-a68b4b4203db tempest-KeyPairsV2TestJSON-423945871 tempest-KeyPairsV2TestJSON-423945871-project] Getting quotas for project 372d629fc9c44cbb89b1417b8092444c. Resources: {'key_pairs'} {{(pid=121402) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 01 19:04:24.975925 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.quota [None req-4b99b40c-f9e4-47e1-b45d-a68b4b4203db tempest-KeyPairsV2TestJSON-423945871 tempest-KeyPairsV2TestJSON-423945871-project] Getting quotas for user fe136857bf144347b2649f69b03e29a0 and project 372d629fc9c44cbb89b1417b8092444c. Resources: {'key_pairs'} {{(pid=121402) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 01 19:04:24.987223 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-ef575004-a3ea-45dc-b8dc-823fa59fc7f9 tempest-ServersAdminNegativeTestJSON-309505279 tempest-ServersAdminNegativeTestJSON-309505279-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:04:24.993159 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-ef575004-a3ea-45dc-b8dc-823fa59fc7f9 tempest-ServersAdminNegativeTestJSON-309505279 tempest-ServersAdminNegativeTestJSON-309505279-project-admin] [instance: 7048952a-103c-44f4-a16b-645dc2294787] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:04:25.022316 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-ef575004-a3ea-45dc-b8dc-823fa59fc7f9 tempest-ServersAdminNegativeTestJSON-309505279 tempest-ServersAdminNegativeTestJSON-309505279-project-admin] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:04:25.022925 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-ef575004-a3ea-45dc-b8dc-823fa59fc7f9 tempest-ServersAdminNegativeTestJSON-309505279 tempest-ServersAdminNegativeTestJSON-309505279-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:04:25.026387 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-ef575004-a3ea-45dc-b8dc-823fa59fc7f9 tempest-ServersAdminNegativeTestJSON-309505279 tempest-ServersAdminNegativeTestJSON-309505279-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:04:25.027786 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-4b99b40c-f9e4-47e1-b45d-a68b4b4203db tempest-KeyPairsV2TestJSON-423945871 tempest-KeyPairsV2TestJSON-423945871-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.084194 Nov 01 19:04:25.028570 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-ef575004-a3ea-45dc-b8dc-823fa59fc7f9 tempest-ServersAdminNegativeTestJSON-309505279 tempest-ServersAdminNegativeTestJSON-309505279-project-admin] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:04:25.029028 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1326/2675] 10.222.0.13 () {60 vars in 1159 bytes} [Tue Nov 1 19:04:24 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:04:25.030288 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-ef575004-a3ea-45dc-b8dc-823fa59fc7f9 tempest-ServersAdminNegativeTestJSON-309505279 tempest-ServersAdminNegativeTestJSON-309505279-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:04:25.030747 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-ef575004-a3ea-45dc-b8dc-823fa59fc7f9 tempest-ServersAdminNegativeTestJSON-309505279 tempest-ServersAdminNegativeTestJSON-309505279-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:04:25.043355 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-6dd24942-ec91-4afb-b64b-26ab42ef20c6 tempest-KeyPairsV2TestJSON-423945871 tempest-KeyPairsV2TestJSON-423945871-project] Action: 'create', calling method: .version_select at 0x7f0ae192a160>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-2102875850", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNpaAzw7xIGBLyCl5XyafvquD/MKjTE7YS90PPnY3AfF6fd7bkk21+6M68PcqMss7Eevz5WvDpcj+Vi85AGsF9M77yhiaI1IPqC+XlzAUKBC0bY4Q10qy3u/b8R0EDUJ5A=="}} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:04:25.067675 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.objects.instance [None req-ef575004-a3ea-45dc-b8dc-823fa59fc7f9 tempest-ServersAdminNegativeTestJSON-309505279 tempest-ServersAdminNegativeTestJSON-309505279-project-admin] Lazy-loading 'flavor' on Instance uuid 7048952a-103c-44f4-a16b-645dc2294787 {{(pid=121403) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 01 19:04:25.083000 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.quota [None req-6dd24942-ec91-4afb-b64b-26ab42ef20c6 tempest-KeyPairsV2TestJSON-423945871 tempest-KeyPairsV2TestJSON-423945871-project] Getting quotas for project 372d629fc9c44cbb89b1417b8092444c. Resources: {'key_pairs'} {{(pid=121402) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 01 19:04:25.095140 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.quota [None req-6dd24942-ec91-4afb-b64b-26ab42ef20c6 tempest-KeyPairsV2TestJSON-423945871 tempest-KeyPairsV2TestJSON-423945871-project] Getting quotas for user fe136857bf144347b2649f69b03e29a0 and project 372d629fc9c44cbb89b1417b8092444c. Resources: {'key_pairs'} {{(pid=121402) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 01 19:04:25.147510 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-6dd24942-ec91-4afb-b64b-26ab42ef20c6 tempest-KeyPairsV2TestJSON-423945871 tempest-KeyPairsV2TestJSON-423945871-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.109735 Nov 01 19:04:25.153393 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1327/2676] 10.222.0.13 () {60 vars in 1159 bytes} [Tue Nov 1 19:04:25 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 01 19:04:25.169699 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-577ec692-a5f0-46a4-a3d8-2500e1a4534a tempest-KeyPairsV2TestJSON-423945871 tempest-KeyPairsV2TestJSON-423945871-project] Calling method '.version_select at 0x7f0ae192a940>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:04:25.181296 n-d-863052-2 devstack@n-api.service[121402]: WARNING oslo_db.sqlalchemy.utils [None req-577ec692-a5f0-46a4-a3d8-2500e1a4534a tempest-KeyPairsV2TestJSON-423945871 tempest-KeyPairsV2TestJSON-423945871-project] Unique keys not in sort_keys. The sorting order may be unstable. Nov 01 19:04:25.200073 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-577ec692-a5f0-46a4-a3d8-2500e1a4534a tempest-KeyPairsV2TestJSON-423945871 tempest-KeyPairsV2TestJSON-423945871-project] 10.222.0.13 "GET /compute/v2.1/os-keypairs" status: 200 len: 1093 microversion: 2.1 time: 0.045030 Nov 01 19:04:25.208364 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1328/2677] 10.222.0.13 () {58 vars in 1137 bytes} [Tue Nov 1 19:04:25 2022] GET /compute/v2.1/os-keypairs => generated 1093 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:04:25.219936 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-0a43e8a7-0c63-4ea3-8ea3-eabecbd12d94 tempest-KeyPairsV2TestJSON-423945871 tempest-KeyPairsV2TestJSON-423945871-project] Calling method '.version_select at 0x7f0ae1981310>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:04:25.221283 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-ef575004-a3ea-45dc-b8dc-823fa59fc7f9 tempest-ServersAdminNegativeTestJSON-309505279 tempest-ServersAdminNegativeTestJSON-309505279-project-admin] 10.222.0.13 "POST /compute/v2.1/servers/7048952a-103c-44f4-a16b-645dc2294787/action" status: 202 len: 0 microversion: 2.1 time: 0.244090 Nov 01 19:04:25.225326 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1350/2678] 10.222.0.13 () {60 vars in 1278 bytes} [Tue Nov 1 19:04:24 2022] POST /compute/v2.1/servers/7048952a-103c-44f4-a16b-645dc2294787/action => generated 0 bytes in 256 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 01 19:04:25.243708 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-a9633f9b-a23c-4320-a1d2-277b60fc0b34 tempest-ServersAdminNegativeTestJSON-309505279 tempest-ServersAdminNegativeTestJSON-309505279-project-admin] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:04:25.246085 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-a9633f9b-a23c-4320-a1d2-277b60fc0b34 tempest-ServersAdminNegativeTestJSON-309505279 tempest-ServersAdminNegativeTestJSON-309505279-project-admin] [instance: 7048952a-103c-44f4-a16b-645dc2294787] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:04:25.260959 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-0a43e8a7-0c63-4ea3-8ea3-eabecbd12d94 tempest-KeyPairsV2TestJSON-423945871 tempest-KeyPairsV2TestJSON-423945871-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-2102875850" status: 202 len: 0 microversion: 2.1 time: 0.051320 Nov 01 19:04:25.261650 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1329/2679] 10.222.0.13 () {58 vars in 1278 bytes} [Tue Nov 1 19:04:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-2102875850 => generated 0 bytes in 53 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 01 19:04:25.270693 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-25c7bc9f-81e4-432c-bf70-1da0b3555d98 tempest-KeyPairsV2TestJSON-423945871 tempest-KeyPairsV2TestJSON-423945871-project] Calling method '.version_select at 0x7f0ae19b8670>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:04:25.275744 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-a9633f9b-a23c-4320-a1d2-277b60fc0b34 tempest-ServersAdminNegativeTestJSON-309505279 tempest-ServersAdminNegativeTestJSON-309505279-project-admin] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:04:25.276263 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-a9633f9b-a23c-4320-a1d2-277b60fc0b34 tempest-ServersAdminNegativeTestJSON-309505279 tempest-ServersAdminNegativeTestJSON-309505279-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:04:25.276880 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-a9633f9b-a23c-4320-a1d2-277b60fc0b34 tempest-ServersAdminNegativeTestJSON-309505279 tempest-ServersAdminNegativeTestJSON-309505279-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:04:25.279724 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-a9633f9b-a23c-4320-a1d2-277b60fc0b34 tempest-ServersAdminNegativeTestJSON-309505279 tempest-ServersAdminNegativeTestJSON-309505279-project-admin] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:04:25.280572 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-a9633f9b-a23c-4320-a1d2-277b60fc0b34 tempest-ServersAdminNegativeTestJSON-309505279 tempest-ServersAdminNegativeTestJSON-309505279-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:04:25.281038 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-a9633f9b-a23c-4320-a1d2-277b60fc0b34 tempest-ServersAdminNegativeTestJSON-309505279 tempest-ServersAdminNegativeTestJSON-309505279-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:04:25.318032 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-25c7bc9f-81e4-432c-bf70-1da0b3555d98 tempest-KeyPairsV2TestJSON-423945871 tempest-KeyPairsV2TestJSON-423945871-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1034088259" status: 202 len: 0 microversion: 2.1 time: 0.051851 Nov 01 19:04:25.319276 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1330/2680] 10.222.0.13 () {58 vars in 1278 bytes} [Tue Nov 1 19:04:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1034088259 => generated 0 bytes in 54 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 01 19:04:25.327941 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-0bab5664-421a-40d8-a454-7518db0abc8b tempest-KeyPairsV2TestJSON-423945871 tempest-KeyPairsV2TestJSON-423945871-project] Calling method '.version_select at 0x7f0ae19209d0>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:04:25.365352 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-0bab5664-421a-40d8-a454-7518db0abc8b tempest-KeyPairsV2TestJSON-423945871 tempest-KeyPairsV2TestJSON-423945871-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-621508177" status: 202 len: 0 microversion: 2.1 time: 0.041958 Nov 01 19:04:25.366100 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1331/2681] 10.222.0.13 () {58 vars in 1275 bytes} [Tue Nov 1 19:04:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-621508177 => generated 0 bytes in 43 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 01 19:04:26.091316 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-a9633f9b-a23c-4320-a1d2-277b60fc0b34 tempest-ServersAdminNegativeTestJSON-309505279 tempest-ServersAdminNegativeTestJSON-309505279-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/7048952a-103c-44f4-a16b-645dc2294787" status: 200 len: 1631 microversion: 2.1 time: 0.861091 Nov 01 19:04:26.094388 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1351/2682] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:04:25 2022] GET /compute/v2.1/servers/7048952a-103c-44f4-a16b-645dc2294787 => generated 1631 bytes in 865 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:04:26.557147 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-a239a6d1-d2ec-4d92-819f-54d4ec866690 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Action: 'create', calling method: .version_select at 0x7f0ae1972670>, body: {"keypair": {"name": "tempest-keypair-834671170", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA8YYnNNlaMe0yhXhazYn1yC9SKgiSS6B40xk2LU3lqZTg57LN476Pz9Soak1aJY38sKyu6ojtOAll7mW+WesUdFd3DLqWMscgdtZUez4GnsO/krkEoL1+jkX46e/r9XDA=="}} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:04:26.599144 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.quota [None req-a239a6d1-d2ec-4d92-819f-54d4ec866690 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Getting quotas for project 33e3d319293c46b6af2f728a50586906. Resources: {'key_pairs'} {{(pid=121402) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 01 19:04:26.607102 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.quota [None req-a239a6d1-d2ec-4d92-819f-54d4ec866690 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Getting quotas for user 790f3f1566b7464aaca19d4d05c0942e and project 33e3d319293c46b6af2f728a50586906. Resources: {'key_pairs'} {{(pid=121402) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 01 19:04:26.640469 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-a239a6d1-d2ec-4d92-819f-54d4ec866690 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.382718 Nov 01 19:04:26.655923 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1332/2683] 10.222.0.13 () {60 vars in 1159 bytes} [Tue Nov 1 19:04:26 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:04:27.115549 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-6a60d6db-962d-41dc-bcd5-8f8d3dcbe0fe tempest-ServersAdminNegativeTestJSON-309505279 tempest-ServersAdminNegativeTestJSON-309505279-project-admin] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:04:27.116255 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-6a60d6db-962d-41dc-bcd5-8f8d3dcbe0fe tempest-ServersAdminNegativeTestJSON-309505279 tempest-ServersAdminNegativeTestJSON-309505279-project-admin] [instance: 7048952a-103c-44f4-a16b-645dc2294787] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:04:27.130350 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-6a60d6db-962d-41dc-bcd5-8f8d3dcbe0fe tempest-ServersAdminNegativeTestJSON-309505279 tempest-ServersAdminNegativeTestJSON-309505279-project-admin] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:04:27.130841 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-6a60d6db-962d-41dc-bcd5-8f8d3dcbe0fe tempest-ServersAdminNegativeTestJSON-309505279 tempest-ServersAdminNegativeTestJSON-309505279-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:04:27.131282 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-6a60d6db-962d-41dc-bcd5-8f8d3dcbe0fe tempest-ServersAdminNegativeTestJSON-309505279 tempest-ServersAdminNegativeTestJSON-309505279-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:04:27.131988 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-6a60d6db-962d-41dc-bcd5-8f8d3dcbe0fe tempest-ServersAdminNegativeTestJSON-309505279 tempest-ServersAdminNegativeTestJSON-309505279-project-admin] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:04:27.132439 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-6a60d6db-962d-41dc-bcd5-8f8d3dcbe0fe tempest-ServersAdminNegativeTestJSON-309505279 tempest-ServersAdminNegativeTestJSON-309505279-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:04:27.143601 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-6a60d6db-962d-41dc-bcd5-8f8d3dcbe0fe tempest-ServersAdminNegativeTestJSON-309505279 tempest-ServersAdminNegativeTestJSON-309505279-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:04:27.685449 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-6a60d6db-962d-41dc-bcd5-8f8d3dcbe0fe tempest-ServersAdminNegativeTestJSON-309505279 tempest-ServersAdminNegativeTestJSON-309505279-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/7048952a-103c-44f4-a16b-645dc2294787" status: 200 len: 1614 microversion: 2.1 time: 0.573655 Nov 01 19:04:27.688912 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1352/2684] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:04:27 2022] GET /compute/v2.1/servers/7048952a-103c-44f4-a16b-645dc2294787 => generated 1614 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:04:27.717403 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-e20d1b16-f55b-4255-8716-7ac36fb425b9 tempest-ServersAdminNegativeTestJSON-309505279 tempest-ServersAdminNegativeTestJSON-309505279-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:04:27.717975 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-e20d1b16-f55b-4255-8716-7ac36fb425b9 tempest-ServersAdminNegativeTestJSON-309505279 tempest-ServersAdminNegativeTestJSON-309505279-project-admin] [instance: 7048952a-103c-44f4-a16b-645dc2294787] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:04:27.728539 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e20d1b16-f55b-4255-8716-7ac36fb425b9 tempest-ServersAdminNegativeTestJSON-309505279 tempest-ServersAdminNegativeTestJSON-309505279-project-admin] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:04:27.743276 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e20d1b16-f55b-4255-8716-7ac36fb425b9 tempest-ServersAdminNegativeTestJSON-309505279 tempest-ServersAdminNegativeTestJSON-309505279-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:04:27.744935 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e20d1b16-f55b-4255-8716-7ac36fb425b9 tempest-ServersAdminNegativeTestJSON-309505279 tempest-ServersAdminNegativeTestJSON-309505279-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:04:27.749460 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e20d1b16-f55b-4255-8716-7ac36fb425b9 tempest-ServersAdminNegativeTestJSON-309505279 tempest-ServersAdminNegativeTestJSON-309505279-project-admin] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:04:27.754293 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e20d1b16-f55b-4255-8716-7ac36fb425b9 tempest-ServersAdminNegativeTestJSON-309505279 tempest-ServersAdminNegativeTestJSON-309505279-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:04:27.755271 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e20d1b16-f55b-4255-8716-7ac36fb425b9 tempest-ServersAdminNegativeTestJSON-309505279 tempest-ServersAdminNegativeTestJSON-309505279-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:04:27.859217 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.wsgi [None req-e20d1b16-f55b-4255-8716-7ac36fb425b9 tempest-ServersAdminNegativeTestJSON-309505279 tempest-ServersAdminNegativeTestJSON-309505279-project-admin] HTTP exception thrown: Cannot 'migrate' instance 7048952a-103c-44f4-a16b-645dc2294787 while it is in vm_state suspended Nov 01 19:04:27.861585 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-e20d1b16-f55b-4255-8716-7ac36fb425b9 tempest-ServersAdminNegativeTestJSON-309505279 tempest-ServersAdminNegativeTestJSON-309505279-project-admin] Request method failure captured: Nov 01 19:04:27.861585 n-d-863052-2 devstack@n-api.service[121402]: request: POST /compute/v2.1/servers/7048952a-103c-44f4-a16b-645dc2294787/action HTTP/1.1 Nov 01 19:04:27.861585 n-d-863052-2 devstack@n-api.service[121402]: Accept: application/json Nov 01 19:04:27.861585 n-d-863052-2 devstack@n-api.service[121402]: Accept-Encoding: identity Nov 01 19:04:27.861585 n-d-863052-2 devstack@n-api.service[121402]: Connection: close Nov 01 19:04:27.861585 n-d-863052-2 devstack@n-api.service[121402]: Content-Length: 15 Nov 01 19:04:27.861585 n-d-863052-2 devstack@n-api.service[121402]: Content-Type: application/json Nov 01 19:04:27.861585 n-d-863052-2 devstack@n-api.service[121402]: Host: 10.222.0.13 Nov 01 19:04:27.861585 n-d-863052-2 devstack@n-api.service[121402]: Openstack-System-Scope: None Nov 01 19:04:27.861585 n-d-863052-2 devstack@n-api.service[121402]: User-Agent: python-urllib3/1.26.12 Nov 01 19:04:27.861585 n-d-863052-2 devstack@n-api.service[121402]: X-Auth-Token: gAAAAABjYW2EGKFpU-QpwVEirr69WVI6bYHwk0Kede96n4su2iijiKcQ1zb6bOyaCtgjZMaJ-Q59prhyqCJnJbM-X-w1iT8LpCZShjaOUpv--KpdOnG1rh0eIANi18nn0sY3ibxUMsuchBSD7QijJY2ZLVCZnKN-GRyWrrcRDzoqeFEIfm4P8Qc Nov 01 19:04:27.861585 n-d-863052-2 devstack@n-api.service[121402]: X-Domain-Id: None Nov 01 19:04:27.861585 n-d-863052-2 devstack@n-api.service[121402]: X-Domain-Name: None Nov 01 19:04:27.861585 n-d-863052-2 devstack@n-api.service[121402]: X-Identity-Status: Confirmed Nov 01 19:04:27.861585 n-d-863052-2 devstack@n-api.service[121402]: X-Is-Admin-Project: True Nov 01 19:04:27.861585 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Domain-Id: default Nov 01 19:04:27.861585 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Domain-Name: Default Nov 01 19:04:27.861585 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Id: 0537b78b4b8c472da96058fbbb155aaf Nov 01 19:04:27.861585 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-309505279 Nov 01 19:04:27.861585 n-d-863052-2 devstack@n-api.service[121402]: X-Role: admin,member,reader Nov 01 19:04:27.861585 n-d-863052-2 devstack@n-api.service[121402]: X-Roles: admin,member,reader Nov 01 19:04:27.861585 n-d-863052-2 devstack@n-api.service[121402]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/0537b78b4b8c472da96058fbbb155aaf"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/0537b78b4b8c472da96058fbbb155aaf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_0537b78b4b8c472da96058fbbb155aaf", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/0537b78b4b8c472da96058fbbb155aaf"}]}] Nov 01 19:04:27.861585 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant: tempest-ServersAdminNegativeTestJSON-309505279 Nov 01 19:04:27.861585 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant-Id: 0537b78b4b8c472da96058fbbb155aaf Nov 01 19:04:27.861585 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-309505279 Nov 01 19:04:27.861585 n-d-863052-2 devstack@n-api.service[121402]: X-User: tempest-ServersAdminNegativeTestJSON-309505279-project-admin Nov 01 19:04:27.861585 n-d-863052-2 devstack@n-api.service[121402]: X-User-Domain-Id: default Nov 01 19:04:27.861585 n-d-863052-2 devstack@n-api.service[121402]: X-User-Domain-Name: Default Nov 01 19:04:27.861585 n-d-863052-2 devstack@n-api.service[121402]: X-User-Id: 25c5f90c12734504bf38a75d337b276d Nov 01 19:04:27.861585 n-d-863052-2 devstack@n-api.service[121402]: X-User-Name: tempest-ServersAdminNegativeTestJSON-309505279-project-admin Nov 01 19:04:27.861585 n-d-863052-2 devstack@n-api.service[121402]: Nov 01 19:04:27.861585 n-d-863052-2 devstack@n-api.service[121402]: {"migrate": {}} Nov 01 19:04:27.861585 n-d-863052-2 devstack@n-api.service[121402]: method: > Nov 01 19:04:27.861585 n-d-863052-2 devstack@n-api.service[121402]: exception: Cannot 'migrate' instance 7048952a-103c-44f4-a16b-645dc2294787 while it is in vm_state suspended Nov 01 19:04:27.861585 n-d-863052-2 devstack@n-api.service[121402]: action_args: {'id': '7048952a-103c-44f4-a16b-645dc2294787', 'body': {'migrate': {}}} Nov 01 19:04:27.861585 n-d-863052-2 devstack@n-api.service[121402]: {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 01 19:04:27.861585 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:04:27.861585 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 58, in _migrate Nov 01 19:04:27.861585 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi self.compute_api.resize(req.environ['nova.context'], instance, Nov 01 19:04:27.861585 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Nov 01 19:04:27.861585 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Nov 01 19:04:27.861585 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Nov 01 19:04:27.861585 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Nov 01 19:04:27.861585 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Nov 01 19:04:27.861585 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Nov 01 19:04:27.861585 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Nov 01 19:04:27.861585 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Nov 01 19:04:27.861585 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Nov 01 19:04:27.861585 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Nov 01 19:04:27.861585 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 7048952a-103c-44f4-a16b-645dc2294787 in vm_state suspended. Cannot resize while the instance is in this state. Nov 01 19:04:27.861585 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:04:27.861585 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:04:27.861585 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:04:27.861585 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:04:27.861585 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:04:27.861585 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:04:27.861585 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 01 19:04:27.861585 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 01 19:04:27.861585 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 01 19:04:27.861585 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 01 19:04:27.861585 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 01 19:04:27.861585 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 01 19:04:27.861585 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 69, in _migrate Nov 01 19:04:27.865863 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Nov 01 19:04:27.865863 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Nov 01 19:04:27.865863 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Nov 01 19:04:27.865863 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'migrate' instance 7048952a-103c-44f4-a16b-645dc2294787 while it is in vm_state suspended Nov 01 19:04:27.865863 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:04:27.865863 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:04:27.865863 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:04:27.865863 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:04:27.865863 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:04:27.865863 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:04:27.865863 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 01 19:04:27.865863 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 01 19:04:27.865863 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'migrate' instance 7048952a-103c-44f4-a16b-645dc2294787 while it is in vm_state suspended Nov 01 19:04:27.865863 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:04:27.870954 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-e20d1b16-f55b-4255-8716-7ac36fb425b9 tempest-ServersAdminNegativeTestJSON-309505279 tempest-ServersAdminNegativeTestJSON-309505279-project-admin] Returning 409 to user: Cannot 'migrate' instance 7048952a-103c-44f4-a16b-645dc2294787 while it is in vm_state suspended {{(pid=121402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 01 19:04:27.871994 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-e20d1b16-f55b-4255-8716-7ac36fb425b9 tempest-ServersAdminNegativeTestJSON-309505279 tempest-ServersAdminNegativeTestJSON-309505279-project-admin] 10.222.0.13 "POST /compute/v2.1/servers/7048952a-103c-44f4-a16b-645dc2294787/action" status: 409 len: 148 microversion: 2.1 time: 0.159227 Nov 01 19:04:27.876017 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1333/2685] 10.222.0.13 () {60 vars in 1278 bytes} [Tue Nov 1 19:04:27 2022] POST /compute/v2.1/servers/7048952a-103c-44f4-a16b-645dc2294787/action => generated 148 bytes in 164 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Nov 01 19:04:27.886615 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-c1f7bf03-7c48-4aa7-b2da-098be76a61c1 tempest-ServersAdminNegativeTestJSON-309505279 tempest-ServersAdminNegativeTestJSON-309505279-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "invalid"}} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:04:27.892612 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-c1f7bf03-7c48-4aa7-b2da-098be76a61c1 tempest-ServersAdminNegativeTestJSON-309505279 tempest-ServersAdminNegativeTestJSON-309505279-project-admin] Request method failure captured: Nov 01 19:04:27.892612 n-d-863052-2 devstack@n-api.service[121403]: request: POST /compute/v2.1/servers/51f5bec0-bd00-4ef2-9424-0dad025c8e29/action HTTP/1.1 Nov 01 19:04:27.892612 n-d-863052-2 devstack@n-api.service[121403]: Accept: application/json Nov 01 19:04:27.892612 n-d-863052-2 devstack@n-api.service[121403]: Accept-Encoding: identity Nov 01 19:04:27.892612 n-d-863052-2 devstack@n-api.service[121403]: Connection: close Nov 01 19:04:27.892612 n-d-863052-2 devstack@n-api.service[121403]: Content-Length: 39 Nov 01 19:04:27.892612 n-d-863052-2 devstack@n-api.service[121403]: Content-Type: application/json Nov 01 19:04:27.892612 n-d-863052-2 devstack@n-api.service[121403]: Host: 10.222.0.13 Nov 01 19:04:27.892612 n-d-863052-2 devstack@n-api.service[121403]: Openstack-System-Scope: None Nov 01 19:04:27.892612 n-d-863052-2 devstack@n-api.service[121403]: User-Agent: python-urllib3/1.26.12 Nov 01 19:04:27.892612 n-d-863052-2 devstack@n-api.service[121403]: X-Auth-Token: gAAAAABjYW2EGKFpU-QpwVEirr69WVI6bYHwk0Kede96n4su2iijiKcQ1zb6bOyaCtgjZMaJ-Q59prhyqCJnJbM-X-w1iT8LpCZShjaOUpv--KpdOnG1rh0eIANi18nn0sY3ibxUMsuchBSD7QijJY2ZLVCZnKN-GRyWrrcRDzoqeFEIfm4P8Qc Nov 01 19:04:27.892612 n-d-863052-2 devstack@n-api.service[121403]: X-Domain-Id: None Nov 01 19:04:27.892612 n-d-863052-2 devstack@n-api.service[121403]: X-Domain-Name: None Nov 01 19:04:27.892612 n-d-863052-2 devstack@n-api.service[121403]: X-Identity-Status: Confirmed Nov 01 19:04:27.892612 n-d-863052-2 devstack@n-api.service[121403]: X-Is-Admin-Project: True Nov 01 19:04:27.892612 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Domain-Id: default Nov 01 19:04:27.892612 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Domain-Name: Default Nov 01 19:04:27.892612 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Id: 0537b78b4b8c472da96058fbbb155aaf Nov 01 19:04:27.892612 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-309505279 Nov 01 19:04:27.892612 n-d-863052-2 devstack@n-api.service[121403]: X-Role: admin,member,reader Nov 01 19:04:27.892612 n-d-863052-2 devstack@n-api.service[121403]: X-Roles: admin,member,reader Nov 01 19:04:27.892612 n-d-863052-2 devstack@n-api.service[121403]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/0537b78b4b8c472da96058fbbb155aaf"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/0537b78b4b8c472da96058fbbb155aaf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_0537b78b4b8c472da96058fbbb155aaf", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/0537b78b4b8c472da96058fbbb155aaf"}]}] Nov 01 19:04:27.892612 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant: tempest-ServersAdminNegativeTestJSON-309505279 Nov 01 19:04:27.892612 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant-Id: 0537b78b4b8c472da96058fbbb155aaf Nov 01 19:04:27.892612 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-309505279 Nov 01 19:04:27.892612 n-d-863052-2 devstack@n-api.service[121403]: X-User: tempest-ServersAdminNegativeTestJSON-309505279-project-admin Nov 01 19:04:27.892612 n-d-863052-2 devstack@n-api.service[121403]: X-User-Domain-Id: default Nov 01 19:04:27.892612 n-d-863052-2 devstack@n-api.service[121403]: X-User-Domain-Name: Default Nov 01 19:04:27.892612 n-d-863052-2 devstack@n-api.service[121403]: X-User-Id: 25c5f90c12734504bf38a75d337b276d Nov 01 19:04:27.892612 n-d-863052-2 devstack@n-api.service[121403]: X-User-Name: tempest-ServersAdminNegativeTestJSON-309505279-project-admin Nov 01 19:04:27.892612 n-d-863052-2 devstack@n-api.service[121403]: Nov 01 19:04:27.892612 n-d-863052-2 devstack@n-api.service[121403]: {"os-resetState": {"state": "invalid"}} Nov 01 19:04:27.892612 n-d-863052-2 devstack@n-api.service[121403]: method: > Nov 01 19:04:27.892612 n-d-863052-2 devstack@n-api.service[121403]: exception: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Nov 01 19:04:27.892612 n-d-863052-2 devstack@n-api.service[121403]: action_args: {'id': '51f5bec0-bd00-4ef2-9424-0dad025c8e29', 'body': {'os-resetState': {'state': 'invalid'}}} Nov 01 19:04:27.892612 n-d-863052-2 devstack@n-api.service[121403]: {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 01 19:04:27.892612 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:04:27.892612 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Nov 01 19:04:27.892612 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Nov 01 19:04:27.892612 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Nov 01 19:04:27.892612 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise error Nov 01 19:04:27.892612 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['active', 'error'] Nov 01 19:04:27.892612 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:04:27.892612 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['os-resetState']['properties']['state']: Nov 01 19:04:27.892612 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi {'enum': ['active', 'error'], 'type': 'string'} Nov 01 19:04:27.892612 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:04:27.892612 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi On instance['os-resetState']: Nov 01 19:04:27.892612 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi 'invalid' Nov 01 19:04:27.892612 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:04:27.892612 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:04:27.892612 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:04:27.892612 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:04:27.892612 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:04:27.892612 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:04:27.892612 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 01 19:04:27.892612 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 01 19:04:27.892612 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 01 19:04:27.892612 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 01 19:04:27.892612 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Nov 01 19:04:27.892612 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Nov 01 19:04:27.892612 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Nov 01 19:04:27.892612 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Nov 01 19:04:27.892612 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Nov 01 19:04:27.892612 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Nov 01 19:04:27.896506 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Nov 01 19:04:27.896506 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:04:27.896506 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:04:27.896506 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:04:27.896506 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:04:27.896506 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:04:27.896506 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:04:27.896506 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Nov 01 19:04:27.896506 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Nov 01 19:04:27.896506 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Nov 01 19:04:27.896506 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:04:27.899369 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-c1f7bf03-7c48-4aa7-b2da-098be76a61c1 tempest-ServersAdminNegativeTestJSON-309505279 tempest-ServersAdminNegativeTestJSON-309505279-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] {{(pid=121403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 01 19:04:27.900441 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-c1f7bf03-7c48-4aa7-b2da-098be76a61c1 tempest-ServersAdminNegativeTestJSON-309505279 tempest-ServersAdminNegativeTestJSON-309505279-project-admin] 10.222.0.13 "POST /compute/v2.1/servers/51f5bec0-bd00-4ef2-9424-0dad025c8e29/action" status: 400 len: 144 microversion: 2.1 time: 0.017897 Nov 01 19:04:27.911198 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1353/2686] 10.222.0.13 () {60 vars in 1278 bytes} [Tue Nov 1 19:04:27 2022] POST /compute/v2.1/servers/51f5bec0-bd00-4ef2-9424-0dad025c8e29/action => generated 144 bytes in 24 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 01 19:04:27.914902 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-6150b486-daa4-469e-901c-bb25eb4dce62 tempest-ServersAdminNegativeTestJSON-309505279 tempest-ServersAdminNegativeTestJSON-309505279-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": 1}} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:04:27.926851 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-6150b486-daa4-469e-901c-bb25eb4dce62 tempest-ServersAdminNegativeTestJSON-309505279 tempest-ServersAdminNegativeTestJSON-309505279-project-admin] Request method failure captured: Nov 01 19:04:27.926851 n-d-863052-2 devstack@n-api.service[121402]: request: POST /compute/v2.1/servers/51f5bec0-bd00-4ef2-9424-0dad025c8e29/action HTTP/1.1 Nov 01 19:04:27.926851 n-d-863052-2 devstack@n-api.service[121402]: Accept: application/json Nov 01 19:04:27.926851 n-d-863052-2 devstack@n-api.service[121402]: Accept-Encoding: identity Nov 01 19:04:27.926851 n-d-863052-2 devstack@n-api.service[121402]: Connection: close Nov 01 19:04:27.926851 n-d-863052-2 devstack@n-api.service[121402]: Content-Length: 31 Nov 01 19:04:27.926851 n-d-863052-2 devstack@n-api.service[121402]: Content-Type: application/json Nov 01 19:04:27.926851 n-d-863052-2 devstack@n-api.service[121402]: Host: 10.222.0.13 Nov 01 19:04:27.926851 n-d-863052-2 devstack@n-api.service[121402]: Openstack-System-Scope: None Nov 01 19:04:27.926851 n-d-863052-2 devstack@n-api.service[121402]: User-Agent: python-urllib3/1.26.12 Nov 01 19:04:27.926851 n-d-863052-2 devstack@n-api.service[121402]: X-Auth-Token: gAAAAABjYW2EGKFpU-QpwVEirr69WVI6bYHwk0Kede96n4su2iijiKcQ1zb6bOyaCtgjZMaJ-Q59prhyqCJnJbM-X-w1iT8LpCZShjaOUpv--KpdOnG1rh0eIANi18nn0sY3ibxUMsuchBSD7QijJY2ZLVCZnKN-GRyWrrcRDzoqeFEIfm4P8Qc Nov 01 19:04:27.926851 n-d-863052-2 devstack@n-api.service[121402]: X-Domain-Id: None Nov 01 19:04:27.926851 n-d-863052-2 devstack@n-api.service[121402]: X-Domain-Name: None Nov 01 19:04:27.926851 n-d-863052-2 devstack@n-api.service[121402]: X-Identity-Status: Confirmed Nov 01 19:04:27.926851 n-d-863052-2 devstack@n-api.service[121402]: X-Is-Admin-Project: True Nov 01 19:04:27.926851 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Domain-Id: default Nov 01 19:04:27.926851 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Domain-Name: Default Nov 01 19:04:27.926851 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Id: 0537b78b4b8c472da96058fbbb155aaf Nov 01 19:04:27.926851 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-309505279 Nov 01 19:04:27.926851 n-d-863052-2 devstack@n-api.service[121402]: X-Role: admin,member,reader Nov 01 19:04:27.926851 n-d-863052-2 devstack@n-api.service[121402]: X-Roles: admin,member,reader Nov 01 19:04:27.926851 n-d-863052-2 devstack@n-api.service[121402]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/0537b78b4b8c472da96058fbbb155aaf"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/0537b78b4b8c472da96058fbbb155aaf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_0537b78b4b8c472da96058fbbb155aaf", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/0537b78b4b8c472da96058fbbb155aaf"}]}] Nov 01 19:04:27.926851 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant: tempest-ServersAdminNegativeTestJSON-309505279 Nov 01 19:04:27.926851 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant-Id: 0537b78b4b8c472da96058fbbb155aaf Nov 01 19:04:27.926851 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-309505279 Nov 01 19:04:27.926851 n-d-863052-2 devstack@n-api.service[121402]: X-User: tempest-ServersAdminNegativeTestJSON-309505279-project-admin Nov 01 19:04:27.926851 n-d-863052-2 devstack@n-api.service[121402]: X-User-Domain-Id: default Nov 01 19:04:27.926851 n-d-863052-2 devstack@n-api.service[121402]: X-User-Domain-Name: Default Nov 01 19:04:27.926851 n-d-863052-2 devstack@n-api.service[121402]: X-User-Id: 25c5f90c12734504bf38a75d337b276d Nov 01 19:04:27.926851 n-d-863052-2 devstack@n-api.service[121402]: X-User-Name: tempest-ServersAdminNegativeTestJSON-309505279-project-admin Nov 01 19:04:27.926851 n-d-863052-2 devstack@n-api.service[121402]: Nov 01 19:04:27.926851 n-d-863052-2 devstack@n-api.service[121402]: {"os-resetState": {"state": 1}} Nov 01 19:04:27.926851 n-d-863052-2 devstack@n-api.service[121402]: method: > Nov 01 19:04:27.926851 n-d-863052-2 devstack@n-api.service[121402]: exception: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Nov 01 19:04:27.926851 n-d-863052-2 devstack@n-api.service[121402]: action_args: {'id': '51f5bec0-bd00-4ef2-9424-0dad025c8e29', 'body': {'os-resetState': {'state': 1}}} Nov 01 19:04:27.926851 n-d-863052-2 devstack@n-api.service[121402]: {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 01 19:04:27.926851 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:04:27.926851 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Nov 01 19:04:27.926851 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Nov 01 19:04:27.926851 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Nov 01 19:04:27.926851 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise error Nov 01 19:04:27.926851 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 1 is not of type 'string' Nov 01 19:04:27.926851 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:04:27.926851 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['os-resetState']['properties']['state']: Nov 01 19:04:27.926851 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi {'enum': ['active', 'error'], 'type': 'string'} Nov 01 19:04:27.926851 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:04:27.926851 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi On instance['os-resetState']: Nov 01 19:04:27.926851 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi 1 Nov 01 19:04:27.926851 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:04:27.926851 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:04:27.926851 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:04:27.926851 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:04:27.926851 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:04:27.926851 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:04:27.926851 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 01 19:04:27.926851 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 01 19:04:27.926851 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 01 19:04:27.926851 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 01 19:04:27.926851 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Nov 01 19:04:27.926851 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Nov 01 19:04:27.926851 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Nov 01 19:04:27.926851 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Nov 01 19:04:27.926851 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Nov 01 19:04:27.926851 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Nov 01 19:04:27.926851 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Nov 01 19:04:27.926851 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:04:27.930646 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:04:27.930646 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:04:27.930646 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:04:27.930646 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:04:27.930646 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:04:27.930646 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Nov 01 19:04:27.930646 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Nov 01 19:04:27.930646 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Nov 01 19:04:27.930646 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:04:27.934186 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-6150b486-daa4-469e-901c-bb25eb4dce62 tempest-ServersAdminNegativeTestJSON-309505279 tempest-ServersAdminNegativeTestJSON-309505279-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' {{(pid=121402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 01 19:04:27.938096 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-6150b486-daa4-469e-901c-bb25eb4dce62 tempest-ServersAdminNegativeTestJSON-309505279 tempest-ServersAdminNegativeTestJSON-309505279-project-admin] 10.222.0.13 "POST /compute/v2.1/servers/51f5bec0-bd00-4ef2-9424-0dad025c8e29/action" status: 400 len: 120 microversion: 2.1 time: 0.029155 Nov 01 19:04:27.952454 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-6bbff11f-cb32-40be-8133-ac247b71c115 tempest-ServersAdminNegativeTestJSON-309505279 tempest-ServersAdminNegativeTestJSON-309505279-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:04:27.955805 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-6bbff11f-cb32-40be-8133-ac247b71c115 tempest-ServersAdminNegativeTestJSON-309505279 tempest-ServersAdminNegativeTestJSON-309505279-project-admin] Failed to fetch instance by id 999 {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2981}} Nov 01 19:04:27.956613 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.wsgi [None req-6bbff11f-cb32-40be-8133-ac247b71c115 tempest-ServersAdminNegativeTestJSON-309505279 tempest-ServersAdminNegativeTestJSON-309505279-project-admin] HTTP exception thrown: Instance 999 could not be found. Nov 01 19:04:27.958277 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1334/2687] 10.222.0.13 () {60 vars in 1278 bytes} [Tue Nov 1 19:04:27 2022] POST /compute/v2.1/servers/51f5bec0-bd00-4ef2-9424-0dad025c8e29/action => generated 120 bytes in 51 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 01 19:04:27.967732 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-6bbff11f-cb32-40be-8133-ac247b71c115 tempest-ServersAdminNegativeTestJSON-309505279 tempest-ServersAdminNegativeTestJSON-309505279-project-admin] Request method failure captured: Nov 01 19:04:27.967732 n-d-863052-2 devstack@n-api.service[121403]: request: POST /compute/v2.1/servers/999/action HTTP/1.1 Nov 01 19:04:27.967732 n-d-863052-2 devstack@n-api.service[121403]: Accept: application/json Nov 01 19:04:27.967732 n-d-863052-2 devstack@n-api.service[121403]: Accept-Encoding: identity Nov 01 19:04:27.967732 n-d-863052-2 devstack@n-api.service[121403]: Connection: close Nov 01 19:04:27.967732 n-d-863052-2 devstack@n-api.service[121403]: Content-Length: 37 Nov 01 19:04:27.967732 n-d-863052-2 devstack@n-api.service[121403]: Content-Type: application/json Nov 01 19:04:27.967732 n-d-863052-2 devstack@n-api.service[121403]: Host: 10.222.0.13 Nov 01 19:04:27.967732 n-d-863052-2 devstack@n-api.service[121403]: Openstack-System-Scope: None Nov 01 19:04:27.967732 n-d-863052-2 devstack@n-api.service[121403]: User-Agent: python-urllib3/1.26.12 Nov 01 19:04:27.967732 n-d-863052-2 devstack@n-api.service[121403]: X-Auth-Token: gAAAAABjYW2EGKFpU-QpwVEirr69WVI6bYHwk0Kede96n4su2iijiKcQ1zb6bOyaCtgjZMaJ-Q59prhyqCJnJbM-X-w1iT8LpCZShjaOUpv--KpdOnG1rh0eIANi18nn0sY3ibxUMsuchBSD7QijJY2ZLVCZnKN-GRyWrrcRDzoqeFEIfm4P8Qc Nov 01 19:04:27.967732 n-d-863052-2 devstack@n-api.service[121403]: X-Domain-Id: None Nov 01 19:04:27.967732 n-d-863052-2 devstack@n-api.service[121403]: X-Domain-Name: None Nov 01 19:04:27.967732 n-d-863052-2 devstack@n-api.service[121403]: X-Identity-Status: Confirmed Nov 01 19:04:27.967732 n-d-863052-2 devstack@n-api.service[121403]: X-Is-Admin-Project: True Nov 01 19:04:27.967732 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Domain-Id: default Nov 01 19:04:27.967732 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Domain-Name: Default Nov 01 19:04:27.967732 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Id: 0537b78b4b8c472da96058fbbb155aaf Nov 01 19:04:27.967732 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-309505279 Nov 01 19:04:27.967732 n-d-863052-2 devstack@n-api.service[121403]: X-Role: admin,member,reader Nov 01 19:04:27.967732 n-d-863052-2 devstack@n-api.service[121403]: X-Roles: admin,member,reader Nov 01 19:04:27.967732 n-d-863052-2 devstack@n-api.service[121403]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/0537b78b4b8c472da96058fbbb155aaf"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/0537b78b4b8c472da96058fbbb155aaf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_0537b78b4b8c472da96058fbbb155aaf", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/0537b78b4b8c472da96058fbbb155aaf"}]}] Nov 01 19:04:27.967732 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant: tempest-ServersAdminNegativeTestJSON-309505279 Nov 01 19:04:27.967732 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant-Id: 0537b78b4b8c472da96058fbbb155aaf Nov 01 19:04:27.967732 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-309505279 Nov 01 19:04:27.967732 n-d-863052-2 devstack@n-api.service[121403]: X-User: tempest-ServersAdminNegativeTestJSON-309505279-project-admin Nov 01 19:04:27.967732 n-d-863052-2 devstack@n-api.service[121403]: X-User-Domain-Id: default Nov 01 19:04:27.967732 n-d-863052-2 devstack@n-api.service[121403]: X-User-Domain-Name: Default Nov 01 19:04:27.967732 n-d-863052-2 devstack@n-api.service[121403]: X-User-Id: 25c5f90c12734504bf38a75d337b276d Nov 01 19:04:27.967732 n-d-863052-2 devstack@n-api.service[121403]: X-User-Name: tempest-ServersAdminNegativeTestJSON-309505279-project-admin Nov 01 19:04:27.967732 n-d-863052-2 devstack@n-api.service[121403]: Nov 01 19:04:27.967732 n-d-863052-2 devstack@n-api.service[121403]: {"os-resetState": {"state": "error"}} Nov 01 19:04:27.967732 n-d-863052-2 devstack@n-api.service[121403]: method: > Nov 01 19:04:27.967732 n-d-863052-2 devstack@n-api.service[121403]: exception: Instance 999 could not be found. Nov 01 19:04:27.967732 n-d-863052-2 devstack@n-api.service[121403]: action_args: {'id': '999', 'body': {'os-resetState': {'state': 'error'}}} Nov 01 19:04:27.967732 n-d-863052-2 devstack@n-api.service[121403]: {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 01 19:04:27.967732 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:04:27.967732 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 01 19:04:27.967732 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 01 19:04:27.967732 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Nov 01 19:04:27.967732 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Nov 01 19:04:27.967732 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 999 could not be found. Nov 01 19:04:27.967732 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:04:27.967732 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:04:27.967732 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:04:27.967732 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:04:27.967732 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:04:27.967732 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:04:27.967732 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 01 19:04:27.967732 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 01 19:04:27.967732 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 01 19:04:27.967732 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 01 19:04:27.967732 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 01 19:04:27.967732 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 01 19:04:27.967732 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/admin_actions.py", line 66, in _reset_state Nov 01 19:04:27.967732 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Nov 01 19:04:27.967732 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 01 19:04:27.967732 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 01 19:04:27.967732 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 999 could not be found. Nov 01 19:04:27.967732 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:04:27.967732 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:04:27.967732 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:04:27.967732 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:04:27.967732 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:04:27.967732 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:04:27.967732 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 01 19:04:27.971726 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 01 19:04:27.971726 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 999 could not be found. Nov 01 19:04:27.971726 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:04:27.974240 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-6bbff11f-cb32-40be-8133-ac247b71c115 tempest-ServersAdminNegativeTestJSON-309505279 tempest-ServersAdminNegativeTestJSON-309505279-project-admin] Returning 404 to user: Instance 999 could not be found. {{(pid=121403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 01 19:04:27.975315 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-6bbff11f-cb32-40be-8133-ac247b71c115 tempest-ServersAdminNegativeTestJSON-309505279 tempest-ServersAdminNegativeTestJSON-309505279-project-admin] 10.222.0.13 "POST /compute/v2.1/servers/999/action" status: 404 len: 78 microversion: 2.1 time: 0.029034 Nov 01 19:04:27.985181 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1354/2688] 10.222.0.13 () {60 vars in 1179 bytes} [Tue Nov 1 19:04:27 2022] POST /compute/v2.1/servers/999/action => generated 78 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 01 19:04:27.989132 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-7159ff8a-da56-4ba8-9ac9-2aa045374c47 tempest-ServersAdminNegativeTestJSON-824756592 tempest-ServersAdminNegativeTestJSON-824756592-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:04:27.989902 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-7159ff8a-da56-4ba8-9ac9-2aa045374c47 tempest-ServersAdminNegativeTestJSON-824756592 tempest-ServersAdminNegativeTestJSON-824756592-project] [instance: 7048952a-103c-44f4-a16b-645dc2294787] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:04:28.007190 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-7159ff8a-da56-4ba8-9ac9-2aa045374c47 tempest-ServersAdminNegativeTestJSON-824756592 tempest-ServersAdminNegativeTestJSON-824756592-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:04:28.009388 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-7159ff8a-da56-4ba8-9ac9-2aa045374c47 tempest-ServersAdminNegativeTestJSON-824756592 tempest-ServersAdminNegativeTestJSON-824756592-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:04:28.011068 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-7159ff8a-da56-4ba8-9ac9-2aa045374c47 tempest-ServersAdminNegativeTestJSON-824756592 tempest-ServersAdminNegativeTestJSON-824756592-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:04:28.012018 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-7159ff8a-da56-4ba8-9ac9-2aa045374c47 tempest-ServersAdminNegativeTestJSON-824756592 tempest-ServersAdminNegativeTestJSON-824756592-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:04:28.015595 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-7159ff8a-da56-4ba8-9ac9-2aa045374c47 tempest-ServersAdminNegativeTestJSON-824756592 tempest-ServersAdminNegativeTestJSON-824756592-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:04:28.018775 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-7159ff8a-da56-4ba8-9ac9-2aa045374c47 tempest-ServersAdminNegativeTestJSON-824756592 tempest-ServersAdminNegativeTestJSON-824756592-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:04:28.134867 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-7159ff8a-da56-4ba8-9ac9-2aa045374c47 tempest-ServersAdminNegativeTestJSON-824756592 tempest-ServersAdminNegativeTestJSON-824756592-project] [instance: 7048952a-103c-44f4-a16b-645dc2294787] Going to try to terminate instance {{(pid=121402) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 01 19:04:28.374018 n-d-863052-2 devstack@n-api.service[121402]: DEBUG dbcounter [-] [121402] Writing DB stats nova_cell0:SELECT=4 {{(pid=121402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 19:04:28.429745 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-7159ff8a-da56-4ba8-9ac9-2aa045374c47 tempest-ServersAdminNegativeTestJSON-824756592 tempest-ServersAdminNegativeTestJSON-824756592-project] 10.222.0.13 "DELETE /compute/v2.1/servers/7048952a-103c-44f4-a16b-645dc2294787" status: 204 len: 0 microversion: 2.1 time: 0.441058 Nov 01 19:04:28.435469 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1335/2689] 10.222.0.13 () {58 vars in 1239 bytes} [Tue Nov 1 19:04:27 2022] DELETE /compute/v2.1/servers/7048952a-103c-44f4-a16b-645dc2294787 => generated 0 bytes in 454 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 01 19:04:28.452108 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-075cf8a8-f227-4fd2-9fb1-209b5084ddff tempest-ServersAdminNegativeTestJSON-824756592 tempest-ServersAdminNegativeTestJSON-824756592-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:04:28.475031 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-075cf8a8-f227-4fd2-9fb1-209b5084ddff tempest-ServersAdminNegativeTestJSON-824756592 tempest-ServersAdminNegativeTestJSON-824756592-project] [instance: 7048952a-103c-44f4-a16b-645dc2294787] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:04:28.507766 n-d-863052-2 devstack@n-api.service[121403]: DEBUG dbcounter [-] [121403] Writing DB stats nova_cell0:SELECT=2 {{(pid=121403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 19:04:28.514090 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-075cf8a8-f227-4fd2-9fb1-209b5084ddff tempest-ServersAdminNegativeTestJSON-824756592 tempest-ServersAdminNegativeTestJSON-824756592-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:04:28.517493 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-075cf8a8-f227-4fd2-9fb1-209b5084ddff tempest-ServersAdminNegativeTestJSON-824756592 tempest-ServersAdminNegativeTestJSON-824756592-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:04:28.519600 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-075cf8a8-f227-4fd2-9fb1-209b5084ddff tempest-ServersAdminNegativeTestJSON-824756592 tempest-ServersAdminNegativeTestJSON-824756592-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:04:28.524547 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-075cf8a8-f227-4fd2-9fb1-209b5084ddff tempest-ServersAdminNegativeTestJSON-824756592 tempest-ServersAdminNegativeTestJSON-824756592-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:04:28.527006 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-075cf8a8-f227-4fd2-9fb1-209b5084ddff tempest-ServersAdminNegativeTestJSON-824756592 tempest-ServersAdminNegativeTestJSON-824756592-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:04:28.527883 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-075cf8a8-f227-4fd2-9fb1-209b5084ddff tempest-ServersAdminNegativeTestJSON-824756592 tempest-ServersAdminNegativeTestJSON-824756592-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:04:29.333138 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-075cf8a8-f227-4fd2-9fb1-209b5084ddff tempest-ServersAdminNegativeTestJSON-824756592 tempest-ServersAdminNegativeTestJSON-824756592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0708fb2fc1df4aa9a9697cbc94acf921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '232745bfe2f3445987fedb91098c84eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:04:29.345060 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-075cf8a8-f227-4fd2-9fb1-209b5084ddff tempest-ServersAdminNegativeTestJSON-824756592 tempest-ServersAdminNegativeTestJSON-824756592-project] 10.222.0.13 "GET /compute/v2.1/servers/7048952a-103c-44f4-a16b-645dc2294787" status: 200 len: 1469 microversion: 2.1 time: 0.902904 Nov 01 19:04:29.348291 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1355/2690] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:04:28 2022] GET /compute/v2.1/servers/7048952a-103c-44f4-a16b-645dc2294787 => generated 1469 bytes in 907 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:04:30.247205 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-02f05fab-c3b8-4cd4-b730-7af9b89c74b6 tempest-KeyPairsV22TestJSON-1669229943 tempest-KeyPairsV22TestJSON-1669229943-project] Action: 'create', calling method: .version_select at 0x7f0ae1992820>, body: {"keypair": {"name": "tempest-keypair-386375243", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKEy2IYtJyuPiozUls11B9HWLphdjSVrj6lm7Wq2ibmdOzHpcyaFpFZS+ql3LDSG1EKOKvJ8OnzI+b+6mtUu85XidZ1aZNqjbLxPnnu53/il/oQli+zmJQkX9bj3X4KH3g=="}} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:04:30.291422 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.quota [None req-02f05fab-c3b8-4cd4-b730-7af9b89c74b6 tempest-KeyPairsV22TestJSON-1669229943 tempest-KeyPairsV22TestJSON-1669229943-project] Getting quotas for project 95650ff85b7a441c9de2b1544c9e837c. Resources: {'key_pairs'} {{(pid=121402) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 01 19:04:30.308304 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.quota [None req-02f05fab-c3b8-4cd4-b730-7af9b89c74b6 tempest-KeyPairsV22TestJSON-1669229943 tempest-KeyPairsV22TestJSON-1669229943-project] Getting quotas for user 1e9c1164bb27436fa084f20fd84054d8 and project 95650ff85b7a441c9de2b1544c9e837c. Resources: {'key_pairs'} {{(pid=121402) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 01 19:04:30.374090 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-02f05fab-c3b8-4cd4-b730-7af9b89c74b6 tempest-KeyPairsV22TestJSON-1669229943 tempest-KeyPairsV22TestJSON-1669229943-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.2 time: 0.467129 Nov 01 19:04:30.376227 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-16b58c5e-bf04-4485-924a-b8c26cecf629 tempest-ServersAdminNegativeTestJSON-824756592 tempest-ServersAdminNegativeTestJSON-824756592-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:04:30.378665 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1336/2691] 10.222.0.13 () {62 vars in 1199 bytes} [Tue Nov 1 19:04:29 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 473 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Nov 01 19:04:30.379108 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-16b58c5e-bf04-4485-924a-b8c26cecf629 tempest-ServersAdminNegativeTestJSON-824756592 tempest-ServersAdminNegativeTestJSON-824756592-project] [instance: 7048952a-103c-44f4-a16b-645dc2294787] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:04:30.397363 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-9a713742-b074-4f71-9d01-c0d07a01e2cf tempest-KeyPairsV22TestJSON-1669229943 tempest-KeyPairsV22TestJSON-1669229943-project] Calling method '.version_select at 0x7f0ae1981550>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:04:30.399858 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-16b58c5e-bf04-4485-924a-b8c26cecf629 tempest-ServersAdminNegativeTestJSON-824756592 tempest-ServersAdminNegativeTestJSON-824756592-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:04:30.402329 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-16b58c5e-bf04-4485-924a-b8c26cecf629 tempest-ServersAdminNegativeTestJSON-824756592 tempest-ServersAdminNegativeTestJSON-824756592-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:04:30.402950 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-16b58c5e-bf04-4485-924a-b8c26cecf629 tempest-ServersAdminNegativeTestJSON-824756592 tempest-ServersAdminNegativeTestJSON-824756592-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:04:30.406420 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-16b58c5e-bf04-4485-924a-b8c26cecf629 tempest-ServersAdminNegativeTestJSON-824756592 tempest-ServersAdminNegativeTestJSON-824756592-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:04:30.407107 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-16b58c5e-bf04-4485-924a-b8c26cecf629 tempest-ServersAdminNegativeTestJSON-824756592 tempest-ServersAdminNegativeTestJSON-824756592-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:04:30.408381 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-16b58c5e-bf04-4485-924a-b8c26cecf629 tempest-ServersAdminNegativeTestJSON-824756592 tempest-ServersAdminNegativeTestJSON-824756592-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:04:30.448861 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-9a713742-b074-4f71-9d01-c0d07a01e2cf tempest-KeyPairsV22TestJSON-1669229943 tempest-KeyPairsV22TestJSON-1669229943-project] 10.222.0.13 "GET /compute/v2.1/os-keypairs/tempest-keypair-386375243" status: 200 len: 512 microversion: 2.2 time: 0.062941 Nov 01 19:04:30.452350 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1337/2692] 10.222.0.13 () {60 vars in 1255 bytes} [Tue Nov 1 19:04:30 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-386375243 => generated 512 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:04:30.469347 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-d6b0aabf-b096-4431-bec3-47ee77fd57fc tempest-KeyPairsV22TestJSON-1669229943 tempest-KeyPairsV22TestJSON-1669229943-project] Calling method '.version_select at 0x7f0ae19b8280>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:04:30.545727 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-d6b0aabf-b096-4431-bec3-47ee77fd57fc tempest-KeyPairsV22TestJSON-1669229943 tempest-KeyPairsV22TestJSON-1669229943-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-386375243" status: 204 len: 0 microversion: 2.2 time: 0.084868 Nov 01 19:04:30.553624 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1338/2693] 10.222.0.13 () {60 vars in 1258 bytes} [Tue Nov 1 19:04:30 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-386375243 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 01 19:04:30.571636 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-435d0acc-a6f7-4491-a179-2cd3aac58df5 tempest-KeyPairsV22TestJSON-1669229943 tempest-KeyPairsV22TestJSON-1669229943-project] Action: 'create', calling method: .version_select at 0x7f0ae19af9d0>, body: {"keypair": {"name": "tempest-keypair-265711622", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD8hxdEYWoIr4r2FlTi6HvSPHGqH1ryGiGMF2hOsx5Ufj4favgzquhVpSSAQjySWLZkXvhiG46+7MHgng1WNnmpuNh+VPy/8wIfXpKR2nUENUyhuz3ENDFQlbFrPu2mmPQ=="}} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:04:30.669863 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.quota [None req-435d0acc-a6f7-4491-a179-2cd3aac58df5 tempest-KeyPairsV22TestJSON-1669229943 tempest-KeyPairsV22TestJSON-1669229943-project] Getting quotas for project 95650ff85b7a441c9de2b1544c9e837c. Resources: {'key_pairs'} {{(pid=121402) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 01 19:04:30.698754 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.quota [None req-435d0acc-a6f7-4491-a179-2cd3aac58df5 tempest-KeyPairsV22TestJSON-1669229943 tempest-KeyPairsV22TestJSON-1669229943-project] Getting quotas for user 1e9c1164bb27436fa084f20fd84054d8 and project 95650ff85b7a441c9de2b1544c9e837c. Resources: {'key_pairs'} {{(pid=121402) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 01 19:04:30.809426 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-435d0acc-a6f7-4491-a179-2cd3aac58df5 tempest-KeyPairsV22TestJSON-1669229943 tempest-KeyPairsV22TestJSON-1669229943-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.2 time: 0.248707 Nov 01 19:04:30.812782 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1339/2694] 10.222.0.13 () {62 vars in 1199 bytes} [Tue Nov 1 19:04:30 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 255 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Nov 01 19:04:30.834684 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-10532968-be2c-40d3-af05-712bcf816280 tempest-KeyPairsV22TestJSON-1669229943 tempest-KeyPairsV22TestJSON-1669229943-project] Calling method '.version_select at 0x7f0ae1a493a0>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:04:30.882380 n-d-863052-2 devstack@n-api.service[121402]: DEBUG dbcounter [-] [121402] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=5,nova_api:DELETE=4,nova_api:UPDATE=1 {{(pid=121402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 19:04:30.897091 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-10532968-be2c-40d3-af05-712bcf816280 tempest-KeyPairsV22TestJSON-1669229943 tempest-KeyPairsV22TestJSON-1669229943-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-265711622" status: 204 len: 0 microversion: 2.2 time: 0.075705 Nov 01 19:04:30.899027 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1340/2695] 10.222.0.13 () {60 vars in 1258 bytes} [Tue Nov 1 19:04:30 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-265711622 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 01 19:04:30.916163 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-ba9d98df-4991-4df3-b42f-9a7b553c274c tempest-KeyPairsV22TestJSON-1669229943 tempest-KeyPairsV22TestJSON-1669229943-project] Action: 'create', calling method: .version_select at 0x7f0ae19afc10>, body: {"keypair": {"name": "tempest-keypair-1099266136", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:04:30.928127 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-16b58c5e-bf04-4485-924a-b8c26cecf629 tempest-ServersAdminNegativeTestJSON-824756592 tempest-ServersAdminNegativeTestJSON-824756592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0708fb2fc1df4aa9a9697cbc94acf921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '232745bfe2f3445987fedb91098c84eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:04:30.947246 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-16b58c5e-bf04-4485-924a-b8c26cecf629 tempest-ServersAdminNegativeTestJSON-824756592 tempest-ServersAdminNegativeTestJSON-824756592-project] 10.222.0.13 "GET /compute/v2.1/servers/7048952a-103c-44f4-a16b-645dc2294787" status: 200 len: 1469 microversion: 2.1 time: 0.573233 Nov 01 19:04:30.948939 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1356/2696] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:04:30 2022] GET /compute/v2.1/servers/7048952a-103c-44f4-a16b-645dc2294787 => generated 1469 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 19:04:30.976736 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.quota [None req-ba9d98df-4991-4df3-b42f-9a7b553c274c tempest-KeyPairsV22TestJSON-1669229943 tempest-KeyPairsV22TestJSON-1669229943-project] Getting quotas for project 95650ff85b7a441c9de2b1544c9e837c. Resources: {'key_pairs'} {{(pid=121402) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 01 19:04:30.998851 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.quota [None req-ba9d98df-4991-4df3-b42f-9a7b553c274c tempest-KeyPairsV22TestJSON-1669229943 tempest-KeyPairsV22TestJSON-1669229943-project] Getting quotas for user 1e9c1164bb27436fa084f20fd84054d8 and project 95650ff85b7a441c9de2b1544c9e837c. Resources: {'key_pairs'} {{(pid=121402) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 01 19:04:31.053639 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-ba9d98df-4991-4df3-b42f-9a7b553c274c tempest-KeyPairsV22TestJSON-1669229943 tempest-KeyPairsV22TestJSON-1669229943-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 201 len: 589 microversion: 2.2 time: 0.148787 Nov 01 19:04:31.056368 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1341/2697] 10.222.0.13 () {62 vars in 1199 bytes} [Tue Nov 1 19:04:30 2022] POST /compute/v2.1/os-keypairs => generated 589 bytes in 152 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Nov 01 19:04:31.068009 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-5ef02566-ba4c-4027-9bdb-44c9d3cfd276 tempest-KeyPairsV22TestJSON-1669229943 tempest-KeyPairsV22TestJSON-1669229943-project] Calling method '.version_select at 0x7f0ae28dfee0>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:04:31.116718 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-5ef02566-ba4c-4027-9bdb-44c9d3cfd276 tempest-KeyPairsV22TestJSON-1669229943 tempest-KeyPairsV22TestJSON-1669229943-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1099266136" status: 204 len: 0 microversion: 2.2 time: 0.053865 Nov 01 19:04:31.122955 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1357/2698] 10.222.0.13 () {60 vars in 1261 bytes} [Tue Nov 1 19:04:31 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1099266136 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 01 19:04:31.131829 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-94cde543-f6e5-40de-9c04-b9df4fd0a7e6 tempest-KeyPairsV22TestJSON-1669229943 tempest-KeyPairsV22TestJSON-1669229943-project] Action: 'create', calling method: .version_select at 0x7f0ae24a7af0>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-732566297", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFWvtsnFTdWcAfFHFgcFYiHYNn1pMZdgBPC1j1NWOqVBxHHWqNGNrOwxoeglyU2jSJ3bFBG6ZyIrQYCdcDYan1HHPnsQ2tbOiw3FsWHvZXB0w2ivwltf0sennDxb+Hvfrg=="}} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:04:31.160034 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.quota [None req-94cde543-f6e5-40de-9c04-b9df4fd0a7e6 tempest-KeyPairsV22TestJSON-1669229943 tempest-KeyPairsV22TestJSON-1669229943-project] Getting quotas for project 95650ff85b7a441c9de2b1544c9e837c. Resources: {'key_pairs'} {{(pid=121402) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 01 19:04:31.178699 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.quota [None req-94cde543-f6e5-40de-9c04-b9df4fd0a7e6 tempest-KeyPairsV22TestJSON-1669229943 tempest-KeyPairsV22TestJSON-1669229943-project] Getting quotas for user 1e9c1164bb27436fa084f20fd84054d8 and project 95650ff85b7a441c9de2b1544c9e837c. Resources: {'key_pairs'} {{(pid=121402) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 01 19:04:31.245810 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-94cde543-f6e5-40de-9c04-b9df4fd0a7e6 tempest-KeyPairsV22TestJSON-1669229943 tempest-KeyPairsV22TestJSON-1669229943-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 201 len: 420 microversion: 2.2 time: 0.119114 Nov 01 19:04:31.246777 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1342/2699] 10.222.0.13 () {62 vars in 1199 bytes} [Tue Nov 1 19:04:31 2022] POST /compute/v2.1/os-keypairs => generated 420 bytes in 121 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Nov 01 19:04:31.260682 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-8aa681bc-a748-4e7c-8514-7de4542d9fac tempest-KeyPairsV22TestJSON-1669229943 tempest-KeyPairsV22TestJSON-1669229943-project] Action: 'create', calling method: .version_select at 0x7f0ae2d290d0>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-568590819", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH9wCUib1OBbsM0EaPIhOprTGUkESymSntwn3Kp9msjTZD7hdPb3mcFProKbI/WCE1IXnePYM4iYtsH4ZFn9r1ZNTYYXuoizQmtPqw/s47giror9BgiOZUl0Kwrxr9d55A=="}} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:04:31.314681 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.quota [None req-8aa681bc-a748-4e7c-8514-7de4542d9fac tempest-KeyPairsV22TestJSON-1669229943 tempest-KeyPairsV22TestJSON-1669229943-project] Getting quotas for project 95650ff85b7a441c9de2b1544c9e837c. Resources: {'key_pairs'} {{(pid=121403) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 01 19:04:31.334317 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.quota [None req-8aa681bc-a748-4e7c-8514-7de4542d9fac tempest-KeyPairsV22TestJSON-1669229943 tempest-KeyPairsV22TestJSON-1669229943-project] Getting quotas for user 1e9c1164bb27436fa084f20fd84054d8 and project 95650ff85b7a441c9de2b1544c9e837c. Resources: {'key_pairs'} {{(pid=121403) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 01 19:04:31.397443 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-8aa681bc-a748-4e7c-8514-7de4542d9fac tempest-KeyPairsV22TestJSON-1669229943 tempest-KeyPairsV22TestJSON-1669229943-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 201 len: 420 microversion: 2.2 time: 0.140798 Nov 01 19:04:31.398504 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1358/2700] 10.222.0.13 () {62 vars in 1199 bytes} [Tue Nov 1 19:04:31 2022] POST /compute/v2.1/os-keypairs => generated 420 bytes in 142 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Nov 01 19:04:31.412733 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-591fe521-992b-42a8-beb6-55e4dc3ee9f7 tempest-KeyPairsV22TestJSON-1669229943 tempest-KeyPairsV22TestJSON-1669229943-project] Action: 'create', calling method: .version_select at 0x7f0ae19afee0>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-519707762", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGUm0bS6WM8Xl67jghXUenih34gMsOhOFcn01SGYakMsL3lhU6JjYC1s1+X+4GCAF/3gMdb6ADnBuU3Bi76M05pYfwtURruFsTUdK0u3deQ+rbTmYZiqoapRneKyPqZarA=="}} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:04:31.452327 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.quota [None req-591fe521-992b-42a8-beb6-55e4dc3ee9f7 tempest-KeyPairsV22TestJSON-1669229943 tempest-KeyPairsV22TestJSON-1669229943-project] Getting quotas for project 95650ff85b7a441c9de2b1544c9e837c. Resources: {'key_pairs'} {{(pid=121402) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 01 19:04:31.467876 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.quota [None req-591fe521-992b-42a8-beb6-55e4dc3ee9f7 tempest-KeyPairsV22TestJSON-1669229943 tempest-KeyPairsV22TestJSON-1669229943-project] Getting quotas for user 1e9c1164bb27436fa084f20fd84054d8 and project 95650ff85b7a441c9de2b1544c9e837c. Resources: {'key_pairs'} {{(pid=121402) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 01 19:04:31.517239 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-591fe521-992b-42a8-beb6-55e4dc3ee9f7 tempest-KeyPairsV22TestJSON-1669229943 tempest-KeyPairsV22TestJSON-1669229943-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 201 len: 420 microversion: 2.2 time: 0.108886 Nov 01 19:04:31.519077 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1343/2701] 10.222.0.13 () {62 vars in 1199 bytes} [Tue Nov 1 19:04:31 2022] POST /compute/v2.1/os-keypairs => generated 420 bytes in 112 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Nov 01 19:04:31.532007 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-73d26096-dbad-4ff3-96ce-70f7a035890c tempest-KeyPairsV22TestJSON-1669229943 tempest-KeyPairsV22TestJSON-1669229943-project] Calling method '.version_select at 0x7f0ae6822160>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:04:31.541448 n-d-863052-2 devstack@n-api.service[121403]: WARNING oslo_db.sqlalchemy.utils [None req-73d26096-dbad-4ff3-96ce-70f7a035890c tempest-KeyPairsV22TestJSON-1669229943 tempest-KeyPairsV22TestJSON-1669229943-project] Unique keys not in sort_keys. The sorting order may be unstable. Nov 01 19:04:31.553649 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-73d26096-dbad-4ff3-96ce-70f7a035890c tempest-KeyPairsV22TestJSON-1669229943 tempest-KeyPairsV22TestJSON-1669229943-project] 10.222.0.13 "GET /compute/v2.1/os-keypairs" status: 200 len: 1139 microversion: 2.2 time: 0.026733 Nov 01 19:04:31.556276 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1359/2702] 10.222.0.13 () {60 vars in 1177 bytes} [Tue Nov 1 19:04:31 2022] GET /compute/v2.1/os-keypairs => generated 1139 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:04:31.568610 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-a8dfc8bd-8ce7-4863-8b3d-838c04926089 tempest-KeyPairsV22TestJSON-1669229943 tempest-KeyPairsV22TestJSON-1669229943-project] Calling method '.version_select at 0x7f0ae1a49280>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:04:31.609187 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-a8dfc8bd-8ce7-4863-8b3d-838c04926089 tempest-KeyPairsV22TestJSON-1669229943 tempest-KeyPairsV22TestJSON-1669229943-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-519707762" status: 204 len: 0 microversion: 2.2 time: 0.044409 Nov 01 19:04:31.609502 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1344/2703] 10.222.0.13 () {60 vars in 1318 bytes} [Tue Nov 1 19:04:31 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-519707762 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 01 19:04:31.618779 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-656ff610-be8d-41ca-8699-92c8c9985770 tempest-KeyPairsV22TestJSON-1669229943 tempest-KeyPairsV22TestJSON-1669229943-project] Calling method '.version_select at 0x7f0ae29d11f0>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:04:31.659345 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-656ff610-be8d-41ca-8699-92c8c9985770 tempest-KeyPairsV22TestJSON-1669229943 tempest-KeyPairsV22TestJSON-1669229943-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-568590819" status: 204 len: 0 microversion: 2.2 time: 0.044872 Nov 01 19:04:31.663229 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1360/2704] 10.222.0.13 () {60 vars in 1318 bytes} [Tue Nov 1 19:04:31 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-568590819 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 01 19:04:31.669172 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-861c119a-a77e-4f2e-bb41-07de422bebc9 tempest-KeyPairsV22TestJSON-1669229943 tempest-KeyPairsV22TestJSON-1669229943-project] Calling method '.version_select at 0x7f0ae19fe670>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:04:31.709837 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-861c119a-a77e-4f2e-bb41-07de422bebc9 tempest-KeyPairsV22TestJSON-1669229943 tempest-KeyPairsV22TestJSON-1669229943-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-732566297" status: 204 len: 0 microversion: 2.2 time: 0.044936 Nov 01 19:04:31.710821 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1345/2705] 10.222.0.13 () {60 vars in 1318 bytes} [Tue Nov 1 19:04:31 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-732566297 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 01 19:04:31.722651 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-59994621-5f52-469c-8ca2-271466734145 tempest-KeyPairsV22TestJSON-1669229943 tempest-KeyPairsV22TestJSON-1669229943-project] Action: 'create', calling method: .version_select at 0x7f0ae67ff550>, body: {"keypair": {"name": "tempest-keypair-815071388", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMBmdTnUxWeIEb5HKNSQzhpmek3Se7LZgB279Yc2uNWlF8J347Wwh7DlR2TrDoDPK+JwMUDaUlm1/JVVW/Px5pdI26mKKvBCcWaErvAfGihSgk8Ns8fs+306+XAa0DiE1A=="}} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:04:31.769307 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.quota [None req-59994621-5f52-469c-8ca2-271466734145 tempest-KeyPairsV22TestJSON-1669229943 tempest-KeyPairsV22TestJSON-1669229943-project] Getting quotas for project 95650ff85b7a441c9de2b1544c9e837c. Resources: {'key_pairs'} {{(pid=121403) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 01 19:04:31.785684 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.quota [None req-59994621-5f52-469c-8ca2-271466734145 tempest-KeyPairsV22TestJSON-1669229943 tempest-KeyPairsV22TestJSON-1669229943-project] Getting quotas for user 1e9c1164bb27436fa084f20fd84054d8 and project 95650ff85b7a441c9de2b1544c9e837c. Resources: {'key_pairs'} {{(pid=121403) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 01 19:04:31.837757 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-59994621-5f52-469c-8ca2-271466734145 tempest-KeyPairsV22TestJSON-1669229943 tempest-KeyPairsV22TestJSON-1669229943-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.2 time: 0.119069 Nov 01 19:04:31.838887 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1361/2706] 10.222.0.13 () {62 vars in 1199 bytes} [Tue Nov 1 19:04:31 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 121 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Nov 01 19:04:31.849708 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-5dc4ef16-d79e-46f0-a933-89cda541809a tempest-KeyPairsV22TestJSON-1669229943 tempest-KeyPairsV22TestJSON-1669229943-project] Calling method '.version_select at 0x7f0ae1992af0>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:04:31.872037 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-5dc4ef16-d79e-46f0-a933-89cda541809a tempest-KeyPairsV22TestJSON-1669229943 tempest-KeyPairsV22TestJSON-1669229943-project] 10.222.0.13 "GET /compute/v2.1/os-keypairs/tempest-keypair-815071388" status: 200 len: 512 microversion: 2.2 time: 0.026136 Nov 01 19:04:31.877196 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1346/2707] 10.222.0.13 () {60 vars in 1255 bytes} [Tue Nov 1 19:04:31 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-815071388 => generated 512 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:04:31.885318 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-f3c89c4e-84be-40c3-a79b-f812274b887a tempest-KeyPairsV22TestJSON-1669229943 tempest-KeyPairsV22TestJSON-1669229943-project] Calling method '.version_select at 0x7f0ae67ff700>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:04:31.889885 n-d-863052-2 devstack@n-api.service[121403]: WARNING oslo_db.sqlalchemy.utils [None req-f3c89c4e-84be-40c3-a79b-f812274b887a tempest-KeyPairsV22TestJSON-1669229943 tempest-KeyPairsV22TestJSON-1669229943-project] Unique keys not in sort_keys. The sorting order may be unstable. Nov 01 19:04:31.917424 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-f3c89c4e-84be-40c3-a79b-f812274b887a tempest-KeyPairsV22TestJSON-1669229943 tempest-KeyPairsV22TestJSON-1669229943-project] 10.222.0.13 "GET /compute/v2.1/os-keypairs" status: 200 len: 369 microversion: 2.2 time: 0.035949 Nov 01 19:04:31.917984 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1362/2708] 10.222.0.13 () {60 vars in 1177 bytes} [Tue Nov 1 19:04:31 2022] GET /compute/v2.1/os-keypairs => generated 369 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:04:31.930075 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-1200e304-8fcb-4540-92b1-cecaa43edd8e tempest-KeyPairsV22TestJSON-1669229943 tempest-KeyPairsV22TestJSON-1669229943-project] Calling method '.version_select at 0x7f0ae19cbd30>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:04:31.975572 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-8e422282-0a2a-4af6-8b15-4584e64599f9 tempest-ServersAdminNegativeTestJSON-824756592 tempest-ServersAdminNegativeTestJSON-824756592-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:04:31.976329 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-8e422282-0a2a-4af6-8b15-4584e64599f9 tempest-ServersAdminNegativeTestJSON-824756592 tempest-ServersAdminNegativeTestJSON-824756592-project] [instance: 7048952a-103c-44f4-a16b-645dc2294787] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:04:31.988632 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-8e422282-0a2a-4af6-8b15-4584e64599f9 tempest-ServersAdminNegativeTestJSON-824756592 tempest-ServersAdminNegativeTestJSON-824756592-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:04:31.994485 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-8e422282-0a2a-4af6-8b15-4584e64599f9 tempest-ServersAdminNegativeTestJSON-824756592 tempest-ServersAdminNegativeTestJSON-824756592-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:04:31.995090 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-8e422282-0a2a-4af6-8b15-4584e64599f9 tempest-ServersAdminNegativeTestJSON-824756592 tempest-ServersAdminNegativeTestJSON-824756592-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:04:31.995695 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-1200e304-8fcb-4540-92b1-cecaa43edd8e tempest-KeyPairsV22TestJSON-1669229943 tempest-KeyPairsV22TestJSON-1669229943-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-815071388" status: 204 len: 0 microversion: 2.2 time: 0.068415 Nov 01 19:04:31.997595 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1347/2709] 10.222.0.13 () {60 vars in 1258 bytes} [Tue Nov 1 19:04:31 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-815071388 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 01 19:04:32.000920 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-8e422282-0a2a-4af6-8b15-4584e64599f9 tempest-ServersAdminNegativeTestJSON-824756592 tempest-ServersAdminNegativeTestJSON-824756592-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:04:32.002110 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-8e422282-0a2a-4af6-8b15-4584e64599f9 tempest-ServersAdminNegativeTestJSON-824756592 tempest-ServersAdminNegativeTestJSON-824756592-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:04:32.002661 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-8e422282-0a2a-4af6-8b15-4584e64599f9 tempest-ServersAdminNegativeTestJSON-824756592 tempest-ServersAdminNegativeTestJSON-824756592-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:04:32.012643 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-20e72784-7a86-4761-aeb9-d8c2420ecd41 tempest-KeyPairsV22TestJSON-1669229943 tempest-KeyPairsV22TestJSON-1669229943-project] Action: 'create', calling method: .version_select at 0x7f0ae19b8f70>, body: {"keypair": {"name": "tempest-keypair-521003707", "type": "x509"}} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:04:32.081318 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.quota [None req-20e72784-7a86-4761-aeb9-d8c2420ecd41 tempest-KeyPairsV22TestJSON-1669229943 tempest-KeyPairsV22TestJSON-1669229943-project] Getting quotas for project 95650ff85b7a441c9de2b1544c9e837c. Resources: {'key_pairs'} {{(pid=121402) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 01 19:04:32.104524 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.quota [None req-20e72784-7a86-4761-aeb9-d8c2420ecd41 tempest-KeyPairsV22TestJSON-1669229943 tempest-KeyPairsV22TestJSON-1669229943-project] Getting quotas for user 1e9c1164bb27436fa084f20fd84054d8 and project 95650ff85b7a441c9de2b1544c9e837c. Resources: {'key_pairs'} {{(pid=121402) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 01 19:04:32.171445 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.processutils [None req-20e72784-7a86-4761-aeb9-d8c2420ecd41 tempest-KeyPairsV22TestJSON-1669229943 tempest-KeyPairsV22TestJSON-1669229943-project] Running cmd (subprocess): openssl req -x509 -nodes -days 3650 -config /tmp/tmp4u4ggr5a/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmp4u4ggr5a/temp.key -subj /CN=1e9c1164bb27436fa084f20fd84054d8 -extensions v3_req_client {{(pid=121402) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Nov 01 19:04:32.479917 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-8e422282-0a2a-4af6-8b15-4584e64599f9 tempest-ServersAdminNegativeTestJSON-824756592 tempest-ServersAdminNegativeTestJSON-824756592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0708fb2fc1df4aa9a9697cbc94acf921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '232745bfe2f3445987fedb91098c84eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:04:32.504973 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-8e422282-0a2a-4af6-8b15-4584e64599f9 tempest-ServersAdminNegativeTestJSON-824756592 tempest-ServersAdminNegativeTestJSON-824756592-project] 10.222.0.13 "GET /compute/v2.1/servers/7048952a-103c-44f4-a16b-645dc2294787" status: 200 len: 1427 microversion: 2.1 time: 0.532173 Nov 01 19:04:32.507215 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1363/2710] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:04:31 2022] GET /compute/v2.1/servers/7048952a-103c-44f4-a16b-645dc2294787 => generated 1427 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:04:32.568907 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.processutils [None req-20e72784-7a86-4761-aeb9-d8c2420ecd41 tempest-KeyPairsV22TestJSON-1669229943 tempest-KeyPairsV22TestJSON-1669229943-project] CMD "openssl req -x509 -nodes -days 3650 -config /tmp/tmp4u4ggr5a/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmp4u4ggr5a/temp.key -subj /CN=1e9c1164bb27436fa084f20fd84054d8 -extensions v3_req_client" returned: 0 in 0.395s {{(pid=121402) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Nov 01 19:04:32.570821 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.processutils [None req-20e72784-7a86-4761-aeb9-d8c2420ecd41 tempest-KeyPairsV22TestJSON-1669229943 tempest-KeyPairsV22TestJSON-1669229943-project] Running cmd (subprocess): openssl pkcs12 -export -inkey /tmp/tmp4u4ggr5a/temp.key -password pass: {{(pid=121402) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Nov 01 19:04:32.642475 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.processutils [None req-20e72784-7a86-4761-aeb9-d8c2420ecd41 tempest-KeyPairsV22TestJSON-1669229943 tempest-KeyPairsV22TestJSON-1669229943-project] CMD "openssl pkcs12 -export -inkey /tmp/tmp4u4ggr5a/temp.key -password pass:" returned: 0 in 0.071s {{(pid=121402) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Nov 01 19:04:32.761730 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.quota [None req-20e72784-7a86-4761-aeb9-d8c2420ecd41 tempest-KeyPairsV22TestJSON-1669229943 tempest-KeyPairsV22TestJSON-1669229943-project] Getting quotas for project 95650ff85b7a441c9de2b1544c9e837c. Resources: {'key_pairs'} {{(pid=121402) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 01 19:04:32.761970 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [req-c4ffa4c0-d491-4dd0-973f-e597383acbfd req-490efdec-caf0-42fd-875e-4b367f06e746 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7048952a-103c-44f4-a16b-645dc2294787", "name": "network-vif-deleted", "tag": "70550865-daf8-414c-9f82-ba55ae791576"}]} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:04:32.787516 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.quota [None req-20e72784-7a86-4761-aeb9-d8c2420ecd41 tempest-KeyPairsV22TestJSON-1669229943 tempest-KeyPairsV22TestJSON-1669229943-project] Getting quotas for user 1e9c1164bb27436fa084f20fd84054d8 and project 95650ff85b7a441c9de2b1544c9e837c. Resources: {'key_pairs'} {{(pid=121402) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 01 19:04:32.794151 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-c4ffa4c0-d491-4dd0-973f-e597383acbfd req-490efdec-caf0-42fd-875e-4b367f06e746 service nova] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:04:32.795162 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-c4ffa4c0-d491-4dd0-973f-e597383acbfd req-490efdec-caf0-42fd-875e-4b367f06e746 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:04:32.795813 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-c4ffa4c0-d491-4dd0-973f-e597383acbfd req-490efdec-caf0-42fd-875e-4b367f06e746 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:04:32.855196 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.compute.server_external_events [req-c4ffa4c0-d491-4dd0-973f-e597383acbfd req-490efdec-caf0-42fd-875e-4b367f06e746 service nova] Creating event network-vif-deleted:70550865-daf8-414c-9f82-ba55ae791576 for instance 7048952a-103c-44f4-a16b-645dc2294787 on n-h2-863052-2 Nov 01 19:04:32.871897 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-20e72784-7a86-4761-aeb9-d8c2420ecd41 tempest-KeyPairsV22TestJSON-1669229943 tempest-KeyPairsV22TestJSON-1669229943-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 201 len: 4692 microversion: 2.2 time: 0.860178 Nov 01 19:04:32.881689 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [req-c4ffa4c0-d491-4dd0-973f-e597383acbfd req-490efdec-caf0-42fd-875e-4b367f06e746 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.124050 Nov 01 19:04:32.884498 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1348/2711] 10.222.0.13 () {62 vars in 1198 bytes} [Tue Nov 1 19:04:32 2022] POST /compute/v2.1/os-keypairs => generated 4692 bytes in 881 msecs (HTTP/1.1 201) 9 headers in 363 bytes (1 switches on core 0) Nov 01 19:04:32.885420 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1364/2712] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Nov 1 19:04:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 01 19:04:32.920259 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-70a2996a-f2c5-4aed-aa92-1e338470bb7d tempest-KeyPairsV22TestJSON-1669229943 tempest-KeyPairsV22TestJSON-1669229943-project] Calling method '.version_select at 0x7f0ae1ac0d30>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:04:32.997143 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-70a2996a-f2c5-4aed-aa92-1e338470bb7d tempest-KeyPairsV22TestJSON-1669229943 tempest-KeyPairsV22TestJSON-1669229943-project] 10.222.0.13 "GET /compute/v2.1/os-keypairs/tempest-keypair-521003707" status: 200 len: 1533 microversion: 2.2 time: 0.094547 Nov 01 19:04:33.006509 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1349/2713] 10.222.0.13 () {60 vars in 1255 bytes} [Tue Nov 1 19:04:32 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-521003707 => generated 1533 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:04:33.023650 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-3d36ddd0-8c54-4b2e-854a-9aa5d4b8a4f7 tempest-KeyPairsV22TestJSON-1669229943 tempest-KeyPairsV22TestJSON-1669229943-project] Calling method '.version_select at 0x7f0ae282aee0>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:04:33.034822 n-d-863052-2 devstack@n-api.service[121403]: WARNING oslo_db.sqlalchemy.utils [None req-3d36ddd0-8c54-4b2e-854a-9aa5d4b8a4f7 tempest-KeyPairsV22TestJSON-1669229943 tempest-KeyPairsV22TestJSON-1669229943-project] Unique keys not in sort_keys. The sorting order may be unstable. Nov 01 19:04:33.060245 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-3d36ddd0-8c54-4b2e-854a-9aa5d4b8a4f7 tempest-KeyPairsV22TestJSON-1669229943 tempest-KeyPairsV22TestJSON-1669229943-project] 10.222.0.13 "GET /compute/v2.1/os-keypairs" status: 200 len: 1390 microversion: 2.2 time: 0.051843 Nov 01 19:04:33.061515 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1365/2714] 10.222.0.13 () {60 vars in 1177 bytes} [Tue Nov 1 19:04:33 2022] GET /compute/v2.1/os-keypairs => generated 1390 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:04:33.075126 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-06a90177-28a6-4fe1-acdc-e7842cfb0d0a tempest-KeyPairsV22TestJSON-1669229943 tempest-KeyPairsV22TestJSON-1669229943-project] Calling method '.version_select at 0x7f0ae1920790>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:04:33.131719 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-06a90177-28a6-4fe1-acdc-e7842cfb0d0a tempest-KeyPairsV22TestJSON-1669229943 tempest-KeyPairsV22TestJSON-1669229943-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-521003707" status: 204 len: 0 microversion: 2.2 time: 0.062249 Nov 01 19:04:33.136848 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1350/2715] 10.222.0.13 () {60 vars in 1258 bytes} [Tue Nov 1 19:04:33 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-521003707 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 01 19:04:33.539778 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-aee6aa2b-d4c4-406a-b2f6-59e058b6ba9d tempest-ServersAdminNegativeTestJSON-824756592 tempest-ServersAdminNegativeTestJSON-824756592-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:04:33.544245 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-aee6aa2b-d4c4-406a-b2f6-59e058b6ba9d tempest-ServersAdminNegativeTestJSON-824756592 tempest-ServersAdminNegativeTestJSON-824756592-project] [instance: 7048952a-103c-44f4-a16b-645dc2294787] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:04:33.567726 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-aee6aa2b-d4c4-406a-b2f6-59e058b6ba9d tempest-ServersAdminNegativeTestJSON-824756592 tempest-ServersAdminNegativeTestJSON-824756592-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:04:33.575400 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-aee6aa2b-d4c4-406a-b2f6-59e058b6ba9d tempest-ServersAdminNegativeTestJSON-824756592 tempest-ServersAdminNegativeTestJSON-824756592-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:04:33.576851 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-aee6aa2b-d4c4-406a-b2f6-59e058b6ba9d tempest-ServersAdminNegativeTestJSON-824756592 tempest-ServersAdminNegativeTestJSON-824756592-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:04:33.578218 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-aee6aa2b-d4c4-406a-b2f6-59e058b6ba9d tempest-ServersAdminNegativeTestJSON-824756592 tempest-ServersAdminNegativeTestJSON-824756592-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:04:33.580810 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-aee6aa2b-d4c4-406a-b2f6-59e058b6ba9d tempest-ServersAdminNegativeTestJSON-824756592 tempest-ServersAdminNegativeTestJSON-824756592-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:04:33.581558 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-aee6aa2b-d4c4-406a-b2f6-59e058b6ba9d tempest-ServersAdminNegativeTestJSON-824756592 tempest-ServersAdminNegativeTestJSON-824756592-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:04:33.668293 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-aee6aa2b-d4c4-406a-b2f6-59e058b6ba9d tempest-ServersAdminNegativeTestJSON-824756592 tempest-ServersAdminNegativeTestJSON-824756592-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:04:33.668966 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-aee6aa2b-d4c4-406a-b2f6-59e058b6ba9d tempest-ServersAdminNegativeTestJSON-824756592 tempest-ServersAdminNegativeTestJSON-824756592-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:04:33.669743 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-aee6aa2b-d4c4-406a-b2f6-59e058b6ba9d tempest-ServersAdminNegativeTestJSON-824756592 tempest-ServersAdminNegativeTestJSON-824756592-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:04:33.671718 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.objects.instance [None req-aee6aa2b-d4c4-406a-b2f6-59e058b6ba9d tempest-ServersAdminNegativeTestJSON-824756592 tempest-ServersAdminNegativeTestJSON-824756592-project] Lazy-loading 'fault' on Instance uuid 7048952a-103c-44f4-a16b-645dc2294787 {{(pid=121403) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 01 19:04:33.834043 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-aee6aa2b-d4c4-406a-b2f6-59e058b6ba9d tempest-ServersAdminNegativeTestJSON-824756592 tempest-ServersAdminNegativeTestJSON-824756592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0708fb2fc1df4aa9a9697cbc94acf921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '232745bfe2f3445987fedb91098c84eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:04:33.844203 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-aee6aa2b-d4c4-406a-b2f6-59e058b6ba9d tempest-ServersAdminNegativeTestJSON-824756592 tempest-ServersAdminNegativeTestJSON-824756592-project] 10.222.0.13 "GET /compute/v2.1/servers/7048952a-103c-44f4-a16b-645dc2294787" status: 200 len: 1312 microversion: 2.1 time: 0.314394 Nov 01 19:04:33.849566 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1366/2716] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:04:33 2022] GET /compute/v2.1/servers/7048952a-103c-44f4-a16b-645dc2294787 => generated 1312 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:04:34.698963 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-3552538a-5092-4006-a8de-59e481a3735c tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1107511805", "imageRef": "2d4a0047-1b9e-445f-8af8-1b5c9d93e881", "flavorRef": "452", "networks": [{"uuid": "6da1da8d-6719-4a9a-851f-308df797b88a"}]}} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:04:34.747145 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-8c1e4cc5-b08b-4c28-8b5c-6d98df5580b0 tempest-TenantUsagesNegativeTestJSON-1074982219 tempest-TenantUsagesNegativeTestJSON-1074982219-project-admin] 10.222.0.13 "GET /compute/v2.1/os-simple-tenant-usage/?start=2022-10-31T19%3A04%3A34.364325&end=2022-11-02T19%3A04%3A34.364325" status: 404 len: 112 microversion: - time: 0.379030 Nov 01 19:04:34.750217 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1367/2717] 10.222.0.13 () {58 vars in 1316 bytes} [Tue Nov 1 19:04:34 2022] GET /compute/v2.1/os-simple-tenant-usage/?start=2022-10-31T19%3A04%3A34.364325&end=2022-11-02T19%3A04%3A34.364325 => generated 112 bytes in 383 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Nov 01 19:04:34.771312 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-9d7c7bfc-8dc4-4040-bdb6-4fb33e31fe15 tempest-TenantUsagesNegativeTestJSON-1074982219 tempest-TenantUsagesNegativeTestJSON-1074982219-project-admin] Calling method '.version_select at 0x7f0ae282a9d0>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:04:34.781582 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.wsgi [None req-9d7c7bfc-8dc4-4040-bdb6-4fb33e31fe15 tempest-TenantUsagesNegativeTestJSON-1074982219 tempest-TenantUsagesNegativeTestJSON-1074982219-project-admin] HTTP exception thrown: Invalid start time. The start time cannot occur after the end time. Nov 01 19:04:34.799539 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-9d7c7bfc-8dc4-4040-bdb6-4fb33e31fe15 tempest-TenantUsagesNegativeTestJSON-1074982219 tempest-TenantUsagesNegativeTestJSON-1074982219-project-admin] Request method failure captured: Nov 01 19:04:34.799539 n-d-863052-2 devstack@n-api.service[121403]: request: GET /compute/v2.1/os-simple-tenant-usage/468a458578894e0293b7bf6a50a952a3?start=2022-11-02T19%3A04%3A34.364325&end=2022-10-31T19%3A04%3A34.364325 HTTP/1.1 Nov 01 19:04:34.799539 n-d-863052-2 devstack@n-api.service[121403]: Accept: application/json Nov 01 19:04:34.799539 n-d-863052-2 devstack@n-api.service[121403]: Accept-Encoding: identity Nov 01 19:04:34.799539 n-d-863052-2 devstack@n-api.service[121403]: Connection: close Nov 01 19:04:34.799539 n-d-863052-2 devstack@n-api.service[121403]: Content-Length: 0 Nov 01 19:04:34.799539 n-d-863052-2 devstack@n-api.service[121403]: Content-Type: application/json Nov 01 19:04:34.799539 n-d-863052-2 devstack@n-api.service[121403]: Host: 10.222.0.13 Nov 01 19:04:34.799539 n-d-863052-2 devstack@n-api.service[121403]: Openstack-System-Scope: None Nov 01 19:04:34.799539 n-d-863052-2 devstack@n-api.service[121403]: User-Agent: python-urllib3/1.26.12 Nov 01 19:04:34.799539 n-d-863052-2 devstack@n-api.service[121403]: X-Auth-Token: gAAAAABjYW3CC51Ihm1tbYoMJENqM3WrXmtIt3xZ_7LXbw08zC-BPbaI70UXmt4xTbYd4--Fo76KYef0RjLOQyDFVcMLrdgsTHFoYHKPhQOwom0wFff1NaktGK5aEqnxP3DmCyNzZW4Okyh7vMscv84Qorp582RDqAxld6uOHKDYOKy7aH67v78 Nov 01 19:04:34.799539 n-d-863052-2 devstack@n-api.service[121403]: X-Domain-Id: None Nov 01 19:04:34.799539 n-d-863052-2 devstack@n-api.service[121403]: X-Domain-Name: None Nov 01 19:04:34.799539 n-d-863052-2 devstack@n-api.service[121403]: X-Identity-Status: Confirmed Nov 01 19:04:34.799539 n-d-863052-2 devstack@n-api.service[121403]: X-Is-Admin-Project: True Nov 01 19:04:34.799539 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Domain-Id: default Nov 01 19:04:34.799539 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Domain-Name: Default Nov 01 19:04:34.799539 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Id: e4722b00a59c4a03b1f4b189d8aa1efb Nov 01 19:04:34.799539 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Name: tempest-TenantUsagesNegativeTestJSON-1074982219 Nov 01 19:04:34.799539 n-d-863052-2 devstack@n-api.service[121403]: X-Role: admin,member,reader Nov 01 19:04:34.799539 n-d-863052-2 devstack@n-api.service[121403]: X-Roles: admin,member,reader Nov 01 19:04:34.799539 n-d-863052-2 devstack@n-api.service[121403]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/e4722b00a59c4a03b1f4b189d8aa1efb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/e4722b00a59c4a03b1f4b189d8aa1efb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_e4722b00a59c4a03b1f4b189d8aa1efb", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/e4722b00a59c4a03b1f4b189d8aa1efb"}]}] Nov 01 19:04:34.799539 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant: tempest-TenantUsagesNegativeTestJSON-1074982219 Nov 01 19:04:34.799539 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant-Id: e4722b00a59c4a03b1f4b189d8aa1efb Nov 01 19:04:34.799539 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant-Name: tempest-TenantUsagesNegativeTestJSON-1074982219 Nov 01 19:04:34.799539 n-d-863052-2 devstack@n-api.service[121403]: X-User: tempest-TenantUsagesNegativeTestJSON-1074982219-project-admin Nov 01 19:04:34.799539 n-d-863052-2 devstack@n-api.service[121403]: X-User-Domain-Id: default Nov 01 19:04:34.799539 n-d-863052-2 devstack@n-api.service[121403]: X-User-Domain-Name: Default Nov 01 19:04:34.799539 n-d-863052-2 devstack@n-api.service[121403]: X-User-Id: f84d4daf1cba4cc59dc18e4d1bce23c2 Nov 01 19:04:34.799539 n-d-863052-2 devstack@n-api.service[121403]: X-User-Name: tempest-TenantUsagesNegativeTestJSON-1074982219-project-admin Nov 01 19:04:34.799539 n-d-863052-2 devstack@n-api.service[121403]: method: Nov 01 19:04:34.799539 n-d-863052-2 devstack@n-api.service[121403]: exception: Invalid start time. The start time cannot occur after the end time. Nov 01 19:04:34.799539 n-d-863052-2 devstack@n-api.service[121403]: action_args: {'id': '468a458578894e0293b7bf6a50a952a3'} Nov 01 19:04:34.799539 n-d-863052-2 devstack@n-api.service[121403]: {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 01 19:04:34.799539 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:04:34.799539 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:04:34.799539 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:04:34.799539 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 01 19:04:34.799539 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 01 19:04:34.799539 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 01 19:04:34.799539 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 01 19:04:34.799539 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Nov 01 19:04:34.799539 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 01 19:04:34.799539 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 01 19:04:34.799539 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 01 19:04:34.799539 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 292, in show Nov 01 19:04:34.799539 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return self._show(req, id) Nov 01 19:04:34.799539 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 338, in _show Nov 01 19:04:34.799539 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi (period_start, period_stop, ignore) = self._get_datetime_range( Nov 01 19:04:34.799539 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 259, in _get_datetime_range Nov 01 19:04:34.799539 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Nov 01 19:04:34.799539 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid start time. The start time cannot occur after the end time. Nov 01 19:04:34.799539 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:04:34.799539 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:04:34.799539 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:04:34.799539 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:04:34.799539 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:04:34.799539 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:04:34.799539 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 01 19:04:34.799539 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 01 19:04:34.799539 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid start time. The start time cannot occur after the end time. Nov 01 19:04:34.799539 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:04:34.807236 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-9d7c7bfc-8dc4-4040-bdb6-4fb33e31fe15 tempest-TenantUsagesNegativeTestJSON-1074982219 tempest-TenantUsagesNegativeTestJSON-1074982219-project-admin] Returning 400 to user: Invalid start time. The start time cannot occur after the end time. {{(pid=121403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 01 19:04:34.814146 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-9d7c7bfc-8dc4-4040-bdb6-4fb33e31fe15 tempest-TenantUsagesNegativeTestJSON-1074982219 tempest-TenantUsagesNegativeTestJSON-1074982219-project-admin] 10.222.0.13 "GET /compute/v2.1/os-simple-tenant-usage/468a458578894e0293b7bf6a50a952a3?start=2022-11-02T19%3A04%3A34.364325&end=2022-10-31T19%3A04%3A34.364325" status: 400 len: 111 microversion: 2.1 time: 0.057517 Nov 01 19:04:34.815028 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1368/2718] 10.222.0.13 () {58 vars in 1412 bytes} [Tue Nov 1 19:04:34 2022] GET /compute/v2.1/os-simple-tenant-usage/468a458578894e0293b7bf6a50a952a3?start=2022-11-02T19%3A04%3A34.364325&end=2022-10-31T19%3A04%3A34.364325 => generated 111 bytes in 59 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 01 19:04:34.854606 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.network.neutron [None req-3552538a-5092-4006-a8de-59e481a3735c tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] validate_networks() for [('6da1da8d-6719-4a9a-851f-308df797b88a', None, None, None, None, None)] {{(pid=121402) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 01 19:04:35.090095 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-303f9248-fca7-40b4-86ef-34c4de75c2d3 tempest-TenantUsagesNegativeTestJSON-2065622972 tempest-TenantUsagesNegativeTestJSON-2065622972-project] Calling method '.version_select at 0x7f0ae2a948b0>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:04:35.112447 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-303f9248-fca7-40b4-86ef-34c4de75c2d3 tempest-TenantUsagesNegativeTestJSON-2065622972 tempest-TenantUsagesNegativeTestJSON-2065622972-project] Policy check for os_compute_api:os-simple-tenant-usage:list failed with credentials {'is_admin': False, 'user_id': '57e68773d5c74e8b8c262843a6f8e440', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '468a458578894e0293b7bf6a50a952a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:04:35.126316 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-303f9248-fca7-40b4-86ef-34c4de75c2d3 tempest-TenantUsagesNegativeTestJSON-2065622972 tempest-TenantUsagesNegativeTestJSON-2065622972-project] Request method failure captured: Nov 01 19:04:35.126316 n-d-863052-2 devstack@n-api.service[121403]: request: GET /compute/v2.1/os-simple-tenant-usage?start=2022-10-31T19%3A04%3A34.364325&end=2022-11-02T19%3A04%3A34.364325&detailed=1 HTTP/1.1 Nov 01 19:04:35.126316 n-d-863052-2 devstack@n-api.service[121403]: Accept: application/json Nov 01 19:04:35.126316 n-d-863052-2 devstack@n-api.service[121403]: Accept-Encoding: identity Nov 01 19:04:35.126316 n-d-863052-2 devstack@n-api.service[121403]: Connection: close Nov 01 19:04:35.126316 n-d-863052-2 devstack@n-api.service[121403]: Content-Length: 0 Nov 01 19:04:35.126316 n-d-863052-2 devstack@n-api.service[121403]: Content-Type: application/json Nov 01 19:04:35.126316 n-d-863052-2 devstack@n-api.service[121403]: Host: 10.222.0.13 Nov 01 19:04:35.126316 n-d-863052-2 devstack@n-api.service[121403]: Openstack-System-Scope: None Nov 01 19:04:35.126316 n-d-863052-2 devstack@n-api.service[121403]: User-Agent: python-urllib3/1.26.12 Nov 01 19:04:35.126316 n-d-863052-2 devstack@n-api.service[121403]: X-Auth-Token: gAAAAABjYW3AN25wzhxIewSDXzmeoL_XdZQ2BlBVg9omQGlmdt6tUL3BetoWfyxSfL-ONu4Qw74Rc3IaGjs1bkjAZJo-HCgh9WMo5C-SCOBpsGKEqNyytBNZiOwTGs0yNPtgSLAGc5kiX1ETLW1zm54Yd19XYTnJh8RKYyIJQcDpwQvVwRPv09s Nov 01 19:04:35.126316 n-d-863052-2 devstack@n-api.service[121403]: X-Domain-Id: None Nov 01 19:04:35.126316 n-d-863052-2 devstack@n-api.service[121403]: X-Domain-Name: None Nov 01 19:04:35.126316 n-d-863052-2 devstack@n-api.service[121403]: X-Identity-Status: Confirmed Nov 01 19:04:35.126316 n-d-863052-2 devstack@n-api.service[121403]: X-Is-Admin-Project: True Nov 01 19:04:35.126316 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Domain-Id: default Nov 01 19:04:35.126316 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Domain-Name: Default Nov 01 19:04:35.126316 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Id: 468a458578894e0293b7bf6a50a952a3 Nov 01 19:04:35.126316 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Name: tempest-TenantUsagesNegativeTestJSON-2065622972 Nov 01 19:04:35.126316 n-d-863052-2 devstack@n-api.service[121403]: X-Role: member,reader Nov 01 19:04:35.126316 n-d-863052-2 devstack@n-api.service[121403]: X-Roles: member,reader Nov 01 19:04:35.126316 n-d-863052-2 devstack@n-api.service[121403]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/468a458578894e0293b7bf6a50a952a3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/468a458578894e0293b7bf6a50a952a3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_468a458578894e0293b7bf6a50a952a3", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/468a458578894e0293b7bf6a50a952a3"}]}] Nov 01 19:04:35.126316 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant: tempest-TenantUsagesNegativeTestJSON-2065622972 Nov 01 19:04:35.126316 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant-Id: 468a458578894e0293b7bf6a50a952a3 Nov 01 19:04:35.126316 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant-Name: tempest-TenantUsagesNegativeTestJSON-2065622972 Nov 01 19:04:35.126316 n-d-863052-2 devstack@n-api.service[121403]: X-User: tempest-TenantUsagesNegativeTestJSON-2065622972-project Nov 01 19:04:35.126316 n-d-863052-2 devstack@n-api.service[121403]: X-User-Domain-Id: default Nov 01 19:04:35.126316 n-d-863052-2 devstack@n-api.service[121403]: X-User-Domain-Name: Default Nov 01 19:04:35.126316 n-d-863052-2 devstack@n-api.service[121403]: X-User-Id: 57e68773d5c74e8b8c262843a6f8e440 Nov 01 19:04:35.126316 n-d-863052-2 devstack@n-api.service[121403]: X-User-Name: tempest-TenantUsagesNegativeTestJSON-2065622972-project Nov 01 19:04:35.126316 n-d-863052-2 devstack@n-api.service[121403]: method: Nov 01 19:04:35.126316 n-d-863052-2 devstack@n-api.service[121403]: exception: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Nov 01 19:04:35.126316 n-d-863052-2 devstack@n-api.service[121403]: action_args: {} Nov 01 19:04:35.126316 n-d-863052-2 devstack@n-api.service[121403]: {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 01 19:04:35.126316 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:04:35.126316 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:04:35.126316 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:04:35.126316 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 01 19:04:35.126316 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 01 19:04:35.126316 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 01 19:04:35.126316 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 01 19:04:35.126316 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Nov 01 19:04:35.126316 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 01 19:04:35.126316 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 01 19:04:35.126316 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 01 19:04:35.126316 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 277, in index Nov 01 19:04:35.126316 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return self._index(req) Nov 01 19:04:35.126316 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 297, in _index Nov 01 19:04:35.126316 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi context.can(stu_policies.POLICY_ROOT % 'list') Nov 01 19:04:35.126316 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Nov 01 19:04:35.126316 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Nov 01 19:04:35.126316 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Nov 01 19:04:35.126316 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Nov 01 19:04:35.126316 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 01 19:04:35.126316 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 01 19:04:35.126316 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 01 19:04:35.126316 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise self.value Nov 01 19:04:35.126316 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Nov 01 19:04:35.126316 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Nov 01 19:04:35.126316 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Nov 01 19:04:35.126316 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return self.enforce( Nov 01 19:04:35.126316 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Nov 01 19:04:35.130706 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Nov 01 19:04:35.130706 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Nov 01 19:04:35.130706 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:04:35.130706 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:04:35.130706 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:04:35.130706 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:04:35.130706 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:04:35.130706 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:04:35.130706 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Nov 01 19:04:35.130706 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Nov 01 19:04:35.130706 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Nov 01 19:04:35.130706 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:04:35.130706 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-303f9248-fca7-40b4-86ef-34c4de75c2d3 tempest-TenantUsagesNegativeTestJSON-2065622972 tempest-TenantUsagesNegativeTestJSON-2065622972-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. {{(pid=121403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 01 19:04:35.133039 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-303f9248-fca7-40b4-86ef-34c4de75c2d3 tempest-TenantUsagesNegativeTestJSON-2065622972 tempest-TenantUsagesNegativeTestJSON-2065622972-project] 10.222.0.13 "GET /compute/v2.1/os-simple-tenant-usage?start=2022-10-31T19%3A04%3A34.364325&end=2022-11-02T19%3A04%3A34.364325&detailed=1" status: 403 len: 123 microversion: 2.1 time: 0.300586 Nov 01 19:04:35.139605 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1369/2719] 10.222.0.13 () {58 vars in 1335 bytes} [Tue Nov 1 19:04:34 2022] GET /compute/v2.1/os-simple-tenant-usage?start=2022-10-31T19%3A04%3A34.364325&end=2022-11-02T19%3A04%3A34.364325&detailed=1 => generated 123 bytes in 316 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Nov 01 19:04:35.152402 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-e7342117-face-482b-bfda-9e6475c992c0 tempest-ServersAdminNegativeTestJSON-824756592 tempest-ServersAdminNegativeTestJSON-824756592-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:04:35.153392 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-e7342117-face-482b-bfda-9e6475c992c0 tempest-ServersAdminNegativeTestJSON-824756592 tempest-ServersAdminNegativeTestJSON-824756592-project] [instance: 7048952a-103c-44f4-a16b-645dc2294787] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:04:35.171218 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-e7342117-face-482b-bfda-9e6475c992c0 tempest-ServersAdminNegativeTestJSON-824756592 tempest-ServersAdminNegativeTestJSON-824756592-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:04:35.173390 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-e7342117-face-482b-bfda-9e6475c992c0 tempest-ServersAdminNegativeTestJSON-824756592 tempest-ServersAdminNegativeTestJSON-824756592-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:04:35.176111 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-e7342117-face-482b-bfda-9e6475c992c0 tempest-ServersAdminNegativeTestJSON-824756592 tempest-ServersAdminNegativeTestJSON-824756592-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:04:35.180419 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-e7342117-face-482b-bfda-9e6475c992c0 tempest-ServersAdminNegativeTestJSON-824756592 tempest-ServersAdminNegativeTestJSON-824756592-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:04:35.190943 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-e7342117-face-482b-bfda-9e6475c992c0 tempest-ServersAdminNegativeTestJSON-824756592 tempest-ServersAdminNegativeTestJSON-824756592-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:04:35.192071 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-e7342117-face-482b-bfda-9e6475c992c0 tempest-ServersAdminNegativeTestJSON-824756592 tempest-ServersAdminNegativeTestJSON-824756592-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:04:35.277256 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.wsgi [None req-e7342117-face-482b-bfda-9e6475c992c0 tempest-ServersAdminNegativeTestJSON-824756592 tempest-ServersAdminNegativeTestJSON-824756592-project] HTTP exception thrown: Instance 7048952a-103c-44f4-a16b-645dc2294787 could not be found. Nov 01 19:04:35.287028 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-e7342117-face-482b-bfda-9e6475c992c0 tempest-ServersAdminNegativeTestJSON-824756592 tempest-ServersAdminNegativeTestJSON-824756592-project] Request method failure captured: Nov 01 19:04:35.287028 n-d-863052-2 devstack@n-api.service[121403]: request: GET /compute/v2.1/servers/7048952a-103c-44f4-a16b-645dc2294787 HTTP/1.1 Nov 01 19:04:35.287028 n-d-863052-2 devstack@n-api.service[121403]: Accept: application/json Nov 01 19:04:35.287028 n-d-863052-2 devstack@n-api.service[121403]: Accept-Encoding: identity Nov 01 19:04:35.287028 n-d-863052-2 devstack@n-api.service[121403]: Connection: close Nov 01 19:04:35.287028 n-d-863052-2 devstack@n-api.service[121403]: Content-Length: 0 Nov 01 19:04:35.287028 n-d-863052-2 devstack@n-api.service[121403]: Content-Type: application/json Nov 01 19:04:35.287028 n-d-863052-2 devstack@n-api.service[121403]: Host: 10.222.0.13 Nov 01 19:04:35.287028 n-d-863052-2 devstack@n-api.service[121403]: Openstack-System-Scope: None Nov 01 19:04:35.287028 n-d-863052-2 devstack@n-api.service[121403]: User-Agent: python-urllib3/1.26.12 Nov 01 19:04:35.287028 n-d-863052-2 devstack@n-api.service[121403]: X-Auth-Token: gAAAAABjYW2DhT5udq9nXc_vFUu8mA45GQB9kOs8urcBG5ncfEIhgIEnS-dfeEejHq8v4ZJdBxQ_wtbAjc9Ji3poRK8GQCMuTaPeSyi3MegDr4vPRgdLHV-gNMLvFE3NLyZ313ZsgHc7MWonZS5jYQLpgAIvpm1K-C4OEn8xOGFxQ_IeAIVw3ok Nov 01 19:04:35.287028 n-d-863052-2 devstack@n-api.service[121403]: X-Domain-Id: None Nov 01 19:04:35.287028 n-d-863052-2 devstack@n-api.service[121403]: X-Domain-Name: None Nov 01 19:04:35.287028 n-d-863052-2 devstack@n-api.service[121403]: X-Identity-Status: Confirmed Nov 01 19:04:35.287028 n-d-863052-2 devstack@n-api.service[121403]: X-Is-Admin-Project: True Nov 01 19:04:35.287028 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Domain-Id: default Nov 01 19:04:35.287028 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Domain-Name: Default Nov 01 19:04:35.287028 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Id: 232745bfe2f3445987fedb91098c84eb Nov 01 19:04:35.287028 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-824756592 Nov 01 19:04:35.287028 n-d-863052-2 devstack@n-api.service[121403]: X-Role: member,reader Nov 01 19:04:35.287028 n-d-863052-2 devstack@n-api.service[121403]: X-Roles: member,reader Nov 01 19:04:35.287028 n-d-863052-2 devstack@n-api.service[121403]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/232745bfe2f3445987fedb91098c84eb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/232745bfe2f3445987fedb91098c84eb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_232745bfe2f3445987fedb91098c84eb", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/232745bfe2f3445987fedb91098c84eb"}]}] Nov 01 19:04:35.287028 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant: tempest-ServersAdminNegativeTestJSON-824756592 Nov 01 19:04:35.287028 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant-Id: 232745bfe2f3445987fedb91098c84eb Nov 01 19:04:35.287028 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-824756592 Nov 01 19:04:35.287028 n-d-863052-2 devstack@n-api.service[121403]: X-User: tempest-ServersAdminNegativeTestJSON-824756592-project Nov 01 19:04:35.287028 n-d-863052-2 devstack@n-api.service[121403]: X-User-Domain-Id: default Nov 01 19:04:35.287028 n-d-863052-2 devstack@n-api.service[121403]: X-User-Domain-Name: Default Nov 01 19:04:35.287028 n-d-863052-2 devstack@n-api.service[121403]: X-User-Id: 0708fb2fc1df4aa9a9697cbc94acf921 Nov 01 19:04:35.287028 n-d-863052-2 devstack@n-api.service[121403]: X-User-Name: tempest-ServersAdminNegativeTestJSON-824756592-project Nov 01 19:04:35.287028 n-d-863052-2 devstack@n-api.service[121403]: method: > Nov 01 19:04:35.287028 n-d-863052-2 devstack@n-api.service[121403]: exception: Instance 7048952a-103c-44f4-a16b-645dc2294787 could not be found. Nov 01 19:04:35.287028 n-d-863052-2 devstack@n-api.service[121403]: action_args: {'id': '7048952a-103c-44f4-a16b-645dc2294787'} Nov 01 19:04:35.287028 n-d-863052-2 devstack@n-api.service[121403]: {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 01 19:04:35.287028 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:04:35.287028 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 01 19:04:35.287028 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 01 19:04:35.287028 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 01 19:04:35.287028 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 01 19:04:35.287028 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 01 19:04:35.287028 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 01 19:04:35.287028 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 01 19:04:35.287028 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 01 19:04:35.287028 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7048952a-103c-44f4-a16b-645dc2294787 could not be found. Nov 01 19:04:35.287028 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:04:35.287028 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:04:35.287028 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:04:35.287028 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:04:35.287028 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:04:35.287028 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:04:35.287028 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 01 19:04:35.287028 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 01 19:04:35.287028 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 01 19:04:35.287028 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 01 19:04:35.287028 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 01 19:04:35.287028 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 01 19:04:35.287028 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 01 19:04:35.287028 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 01 19:04:35.287028 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 01 19:04:35.287028 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 01 19:04:35.287028 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7048952a-103c-44f4-a16b-645dc2294787 could not be found. Nov 01 19:04:35.287028 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:04:35.287028 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:04:35.291100 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:04:35.291100 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:04:35.291100 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:04:35.291100 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:04:35.291100 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 01 19:04:35.291100 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 01 19:04:35.291100 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7048952a-103c-44f4-a16b-645dc2294787 could not be found. Nov 01 19:04:35.291100 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:04:35.291100 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-e7342117-face-482b-bfda-9e6475c992c0 tempest-ServersAdminNegativeTestJSON-824756592 tempest-ServersAdminNegativeTestJSON-824756592-project] Returning 404 to user: Instance 7048952a-103c-44f4-a16b-645dc2294787 could not be found. {{(pid=121403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 01 19:04:35.291100 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-e7342117-face-482b-bfda-9e6475c992c0 tempest-ServersAdminNegativeTestJSON-824756592 tempest-ServersAdminNegativeTestJSON-824756592-project] 10.222.0.13 "GET /compute/v2.1/servers/7048952a-103c-44f4-a16b-645dc2294787" status: 404 len: 111 microversion: 2.1 time: 0.151827 Nov 01 19:04:35.291100 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1370/2720] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:04:35 2022] GET /compute/v2.1/servers/7048952a-103c-44f4-a16b-645dc2294787 => generated 111 bytes in 153 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 01 19:04:35.317526 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-326e335e-762e-4253-9c7a-dc2f5c3c1406 tempest-ServersAdminNegativeTestJSON-824756592 tempest-ServersAdminNegativeTestJSON-824756592-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:04:35.318492 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-326e335e-762e-4253-9c7a-dc2f5c3c1406 tempest-ServersAdminNegativeTestJSON-824756592 tempest-ServersAdminNegativeTestJSON-824756592-project] [instance: 51f5bec0-bd00-4ef2-9424-0dad025c8e29] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:04:35.331376 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-326e335e-762e-4253-9c7a-dc2f5c3c1406 tempest-ServersAdminNegativeTestJSON-824756592 tempest-ServersAdminNegativeTestJSON-824756592-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:04:35.332561 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-326e335e-762e-4253-9c7a-dc2f5c3c1406 tempest-ServersAdminNegativeTestJSON-824756592 tempest-ServersAdminNegativeTestJSON-824756592-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:04:35.333693 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-326e335e-762e-4253-9c7a-dc2f5c3c1406 tempest-ServersAdminNegativeTestJSON-824756592 tempest-ServersAdminNegativeTestJSON-824756592-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:04:35.334666 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-326e335e-762e-4253-9c7a-dc2f5c3c1406 tempest-ServersAdminNegativeTestJSON-824756592 tempest-ServersAdminNegativeTestJSON-824756592-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:04:35.335351 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-326e335e-762e-4253-9c7a-dc2f5c3c1406 tempest-ServersAdminNegativeTestJSON-824756592 tempest-ServersAdminNegativeTestJSON-824756592-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:04:35.336288 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-326e335e-762e-4253-9c7a-dc2f5c3c1406 tempest-ServersAdminNegativeTestJSON-824756592 tempest-ServersAdminNegativeTestJSON-824756592-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:04:35.349962 n-d-863052-2 devstack@n-api.service[121403]: DEBUG dbcounter [-] [121403] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=121403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 19:04:35.395078 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-326e335e-762e-4253-9c7a-dc2f5c3c1406 tempest-ServersAdminNegativeTestJSON-824756592 tempest-ServersAdminNegativeTestJSON-824756592-project] [instance: 51f5bec0-bd00-4ef2-9424-0dad025c8e29] Going to try to terminate instance {{(pid=121403) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 01 19:04:35.577577 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-326e335e-762e-4253-9c7a-dc2f5c3c1406 tempest-ServersAdminNegativeTestJSON-824756592 tempest-ServersAdminNegativeTestJSON-824756592-project] 10.222.0.13 "DELETE /compute/v2.1/servers/51f5bec0-bd00-4ef2-9424-0dad025c8e29" status: 204 len: 0 microversion: 2.1 time: 0.277246 Nov 01 19:04:35.581976 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1371/2721] 10.222.0.13 () {58 vars in 1239 bytes} [Tue Nov 1 19:04:35 2022] DELETE /compute/v2.1/servers/51f5bec0-bd00-4ef2-9424-0dad025c8e29 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 01 19:04:35.593100 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-0863fc40-442a-4f35-ba1b-aae17dbf0bf1 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-622138477", "imageRef": "2d4a0047-1b9e-445f-8af8-1b5c9d93e881", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f519283e-0b16-42bb-b3ce-8665b5719c87"}], "security_groups": [{"name": "tempest-securitygroup--1871334630"}], "key_name": "tempest-keypair-834671170", "user_data": "}} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:04:35.855323 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.network.neutron [None req-0863fc40-442a-4f35-ba1b-aae17dbf0bf1 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] validate_networks() for [('f519283e-0b16-42bb-b3ce-8665b5719c87', None, None, None, None, None)] {{(pid=121403) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 01 19:04:36.220394 n-d-863052-2 devstack@n-api.service[121403]: DEBUG dbcounter [-] [121403] Writing DB stats nova_api:DELETE=4,nova_api:SELECT=91,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=121403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 19:04:37.735081 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.virt.hardware [None req-0863fc40-442a-4f35-ba1b-aae17dbf0bf1 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Flavor limits 0:0:0 {{(pid=121403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 01 19:04:37.736243 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.virt.hardware [None req-0863fc40-442a-4f35-ba1b-aae17dbf0bf1 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Image limits 0:0:0 {{(pid=121403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 01 19:04:37.737016 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.virt.hardware [None req-0863fc40-442a-4f35-ba1b-aae17dbf0bf1 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Flavor pref 0:0:0 {{(pid=121403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 01 19:04:37.737424 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.virt.hardware [None req-0863fc40-442a-4f35-ba1b-aae17dbf0bf1 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Image pref 0:0:0 {{(pid=121403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 01 19:04:37.737830 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.virt.hardware [None req-0863fc40-442a-4f35-ba1b-aae17dbf0bf1 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 01 19:04:37.755171 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-0863fc40-442a-4f35-ba1b-aae17dbf0bf1 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:04:37.756983 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-0863fc40-442a-4f35-ba1b-aae17dbf0bf1 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:04:37.757586 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-0863fc40-442a-4f35-ba1b-aae17dbf0bf1 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:04:37.760500 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-0863fc40-442a-4f35-ba1b-aae17dbf0bf1 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:04:37.761252 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-0863fc40-442a-4f35-ba1b-aae17dbf0bf1 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:04:37.762344 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-0863fc40-442a-4f35-ba1b-aae17dbf0bf1 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:04:37.839349 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.quota [None req-0863fc40-442a-4f35-ba1b-aae17dbf0bf1 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Getting quotas for project 33e3d319293c46b6af2f728a50586906. Resources: {'cores', 'ram', 'instances'} {{(pid=121403) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 01 19:04:37.873916 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.quota [None req-0863fc40-442a-4f35-ba1b-aae17dbf0bf1 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Getting quotas for user 790f3f1566b7464aaca19d4d05c0942e and project 33e3d319293c46b6af2f728a50586906. Resources: {'cores', 'ram', 'instances'} {{(pid=121403) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 01 19:04:37.926196 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-0863fc40-442a-4f35-ba1b-aae17dbf0bf1 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Going to run 1 instances... {{(pid=121403) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 01 19:04:37.929348 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-0863fc40-442a-4f35-ba1b-aae17dbf0bf1 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] [instance: 3029f3c1-4f32-4f6b-963c-16f65b6dff3c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2d4a0047-1b9e-445f-8af8-1b5c9d93e881',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121403) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 01 19:04:38.098785 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-0863fc40-442a-4f35-ba1b-aae17dbf0bf1 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.495441 Nov 01 19:04:38.099539 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1372/2722] 10.222.0.13 () {60 vars in 1147 bytes} [Tue Nov 1 19:04:35 2022] POST /compute/v2.1/servers => generated 402 bytes in 2517 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 01 19:04:38.133298 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-cd0ae0ee-47d5-4bc3-81a7-3b909e1c9605 tempest-ServersAdminNegativeTestJSON-824756592 tempest-ServersAdminNegativeTestJSON-824756592-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:04:38.137361 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-cd0ae0ee-47d5-4bc3-81a7-3b909e1c9605 tempest-ServersAdminNegativeTestJSON-824756592 tempest-ServersAdminNegativeTestJSON-824756592-project] [instance: 51f5bec0-bd00-4ef2-9424-0dad025c8e29] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:04:38.165247 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-cd0ae0ee-47d5-4bc3-81a7-3b909e1c9605 tempest-ServersAdminNegativeTestJSON-824756592 tempest-ServersAdminNegativeTestJSON-824756592-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:04:38.165766 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-cd0ae0ee-47d5-4bc3-81a7-3b909e1c9605 tempest-ServersAdminNegativeTestJSON-824756592 tempest-ServersAdminNegativeTestJSON-824756592-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:04:38.171058 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-cd0ae0ee-47d5-4bc3-81a7-3b909e1c9605 tempest-ServersAdminNegativeTestJSON-824756592 tempest-ServersAdminNegativeTestJSON-824756592-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:04:38.171963 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-cd0ae0ee-47d5-4bc3-81a7-3b909e1c9605 tempest-ServersAdminNegativeTestJSON-824756592 tempest-ServersAdminNegativeTestJSON-824756592-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:04:38.175921 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-cd0ae0ee-47d5-4bc3-81a7-3b909e1c9605 tempest-ServersAdminNegativeTestJSON-824756592 tempest-ServersAdminNegativeTestJSON-824756592-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:04:38.176281 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-cd0ae0ee-47d5-4bc3-81a7-3b909e1c9605 tempest-ServersAdminNegativeTestJSON-824756592 tempest-ServersAdminNegativeTestJSON-824756592-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:04:38.282795 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.virt.hardware [None req-3552538a-5092-4006-a8de-59e481a3735c tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Flavor limits 0:0:0 {{(pid=121402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 01 19:04:38.284008 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.virt.hardware [None req-3552538a-5092-4006-a8de-59e481a3735c tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Image limits 0:0:0 {{(pid=121402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 01 19:04:38.284685 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.virt.hardware [None req-3552538a-5092-4006-a8de-59e481a3735c tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Flavor pref 0:0:0 {{(pid=121402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 01 19:04:38.285818 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.virt.hardware [None req-3552538a-5092-4006-a8de-59e481a3735c tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Image pref 0:0:0 {{(pid=121402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 01 19:04:38.286400 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.virt.hardware [None req-3552538a-5092-4006-a8de-59e481a3735c tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 01 19:04:38.301728 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-3552538a-5092-4006-a8de-59e481a3735c tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:04:38.302447 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-3552538a-5092-4006-a8de-59e481a3735c tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:04:38.303520 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-3552538a-5092-4006-a8de-59e481a3735c tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:04:38.305303 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-3552538a-5092-4006-a8de-59e481a3735c tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:04:38.306567 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-3552538a-5092-4006-a8de-59e481a3735c tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:04:38.307729 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-3552538a-5092-4006-a8de-59e481a3735c tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:04:38.354732 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.quota [None req-3552538a-5092-4006-a8de-59e481a3735c tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Getting quotas for project 1ee9dc49b89143f781e4ab30296e4d01. Resources: {'cores', 'ram', 'instances'} {{(pid=121402) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 01 19:04:38.365424 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.quota [None req-3552538a-5092-4006-a8de-59e481a3735c tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Getting quotas for user 058480d92c9b4ab4af6815d0438a65c7 and project 1ee9dc49b89143f781e4ab30296e4d01. Resources: {'cores', 'ram', 'instances'} {{(pid=121402) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 01 19:04:38.394188 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-3552538a-5092-4006-a8de-59e481a3735c tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Going to run 1 instances... {{(pid=121402) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 01 19:04:38.397412 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-3552538a-5092-4006-a8de-59e481a3735c tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] [instance: e760fc87-dcc8-47ae-8bf1-014248a1c1b4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2d4a0047-1b9e-445f-8af8-1b5c9d93e881',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121402) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 01 19:04:38.569724 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-3552538a-5092-4006-a8de-59e481a3735c tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.514857 Nov 01 19:04:38.634079 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1351/2723] 10.222.0.13 () {60 vars in 1147 bytes} [Tue Nov 1 19:04:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 4574 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 01 19:04:38.654174 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-5ab0fe59-fd09-47e6-ab66-875d007361fe tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:04:38.656200 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-5ab0fe59-fd09-47e6-ab66-875d007361fe tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] [instance: 3029f3c1-4f32-4f6b-963c-16f65b6dff3c] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:04:38.808980 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-cd0ae0ee-47d5-4bc3-81a7-3b909e1c9605 tempest-ServersAdminNegativeTestJSON-824756592 tempest-ServersAdminNegativeTestJSON-824756592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0708fb2fc1df4aa9a9697cbc94acf921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '232745bfe2f3445987fedb91098c84eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:04:38.814084 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-5ab0fe59-fd09-47e6-ab66-875d007361fe tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '790f3f1566b7464aaca19d4d05c0942e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33e3d319293c46b6af2f728a50586906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:04:38.818399 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-cd0ae0ee-47d5-4bc3-81a7-3b909e1c9605 tempest-ServersAdminNegativeTestJSON-824756592 tempest-ServersAdminNegativeTestJSON-824756592-project] 10.222.0.13 "GET /compute/v2.1/servers/51f5bec0-bd00-4ef2-9424-0dad025c8e29" status: 200 len: 1476 microversion: 2.1 time: 0.717800 Nov 01 19:04:38.821879 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-5ab0fe59-fd09-47e6-ab66-875d007361fe tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] 10.222.0.13 "GET /compute/v2.1/servers/3029f3c1-4f32-4f6b-963c-16f65b6dff3c" status: 200 len: 1240 microversion: 2.1 time: 0.182405 Nov 01 19:04:38.822479 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1352/2724] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:04:38 2022] GET /compute/v2.1/servers/3029f3c1-4f32-4f6b-963c-16f65b6dff3c => generated 1240 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:04:38.824456 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1373/2725] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:04:38 2022] GET /compute/v2.1/servers/51f5bec0-bd00-4ef2-9424-0dad025c8e29 => generated 1476 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:04:38.841729 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-8753397e-bad4-425d-8eac-a59f67aa77b5 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:04:38.845645 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-8753397e-bad4-425d-8eac-a59f67aa77b5 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] [instance: e760fc87-dcc8-47ae-8bf1-014248a1c1b4] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:04:39.013524 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-8753397e-bad4-425d-8eac-a59f67aa77b5 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '058480d92c9b4ab4af6815d0438a65c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee9dc49b89143f781e4ab30296e4d01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:04:39.024030 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-8753397e-bad4-425d-8eac-a59f67aa77b5 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] 10.222.0.13 "GET /compute/v2.1/servers/e760fc87-dcc8-47ae-8bf1-014248a1c1b4" status: 200 len: 1215 microversion: 2.1 time: 0.190291 Nov 01 19:04:39.045767 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1374/2726] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:04:38 2022] GET /compute/v2.1/servers/e760fc87-dcc8-47ae-8bf1-014248a1c1b4 => generated 1215 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:04:39.121241 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-06cdf46b-03a0-4f61-a1ad-846661a68eb2 tempest-ServersAaction247Test-833529606 tempest-ServersAaction247Test-833529606-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAaction247Test-server-747127507", "imageRef": "2d4a0047-1b9e-445f-8af8-1b5c9d93e881", "flavorRef": "452", "networks": "none"}} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:04:39.184504 n-d-863052-2 devstack@n-api.service[121402]: DEBUG dbcounter [-] [121402] Writing DB stats nova_api:DELETE=5,nova_api:SELECT=88,nova_api:INSERT=7 {{(pid=121402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 19:04:39.271035 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.virt.hardware [None req-06cdf46b-03a0-4f61-a1ad-846661a68eb2 tempest-ServersAaction247Test-833529606 tempest-ServersAaction247Test-833529606-project] Flavor limits 0:0:0 {{(pid=121402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 01 19:04:39.271466 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.virt.hardware [None req-06cdf46b-03a0-4f61-a1ad-846661a68eb2 tempest-ServersAaction247Test-833529606 tempest-ServersAaction247Test-833529606-project] Image limits 0:0:0 {{(pid=121402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 01 19:04:39.275244 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.virt.hardware [None req-06cdf46b-03a0-4f61-a1ad-846661a68eb2 tempest-ServersAaction247Test-833529606 tempest-ServersAaction247Test-833529606-project] Flavor pref 0:0:0 {{(pid=121402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 01 19:04:39.275891 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.virt.hardware [None req-06cdf46b-03a0-4f61-a1ad-846661a68eb2 tempest-ServersAaction247Test-833529606 tempest-ServersAaction247Test-833529606-project] Image pref 0:0:0 {{(pid=121402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 01 19:04:39.276399 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.virt.hardware [None req-06cdf46b-03a0-4f61-a1ad-846661a68eb2 tempest-ServersAaction247Test-833529606 tempest-ServersAaction247Test-833529606-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 01 19:04:39.305549 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-06cdf46b-03a0-4f61-a1ad-846661a68eb2 tempest-ServersAaction247Test-833529606 tempest-ServersAaction247Test-833529606-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:04:39.306123 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-06cdf46b-03a0-4f61-a1ad-846661a68eb2 tempest-ServersAaction247Test-833529606 tempest-ServersAaction247Test-833529606-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:04:39.310675 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-06cdf46b-03a0-4f61-a1ad-846661a68eb2 tempest-ServersAaction247Test-833529606 tempest-ServersAaction247Test-833529606-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:04:39.312558 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-06cdf46b-03a0-4f61-a1ad-846661a68eb2 tempest-ServersAaction247Test-833529606 tempest-ServersAaction247Test-833529606-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:04:39.314635 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-06cdf46b-03a0-4f61-a1ad-846661a68eb2 tempest-ServersAaction247Test-833529606 tempest-ServersAaction247Test-833529606-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:04:39.317415 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-06cdf46b-03a0-4f61-a1ad-846661a68eb2 tempest-ServersAaction247Test-833529606 tempest-ServersAaction247Test-833529606-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:04:39.373584 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.quota [None req-06cdf46b-03a0-4f61-a1ad-846661a68eb2 tempest-ServersAaction247Test-833529606 tempest-ServersAaction247Test-833529606-project] Getting quotas for project b0d45c12d3114f499215931518794ea2. Resources: {'cores', 'ram', 'instances'} {{(pid=121402) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 01 19:04:39.381088 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.quota [None req-06cdf46b-03a0-4f61-a1ad-846661a68eb2 tempest-ServersAaction247Test-833529606 tempest-ServersAaction247Test-833529606-project] Getting quotas for user 7dd5e9050cec406da21f51f0e0e6c81f and project b0d45c12d3114f499215931518794ea2. Resources: {'cores', 'ram', 'instances'} {{(pid=121402) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 01 19:04:39.419584 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-06cdf46b-03a0-4f61-a1ad-846661a68eb2 tempest-ServersAaction247Test-833529606 tempest-ServersAaction247Test-833529606-project] Going to run 1 instances... {{(pid=121402) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 01 19:04:39.422973 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-06cdf46b-03a0-4f61-a1ad-846661a68eb2 tempest-ServersAaction247Test-833529606 tempest-ServersAaction247Test-833529606-project] [instance: 7e5516b1-da8c-450d-8fb3-cabb5a5f873f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2d4a0047-1b9e-445f-8af8-1b5c9d93e881',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121402) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 01 19:04:39.582206 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-06cdf46b-03a0-4f61-a1ad-846661a68eb2 tempest-ServersAaction247Test-833529606 tempest-ServersAaction247Test-833529606-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.738088 Nov 01 19:04:39.584978 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1353/2727] 10.222.0.13 () {62 vars in 1188 bytes} [Tue Nov 1 19:04:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 762 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Nov 01 19:04:39.598141 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-e3ef5661-5172-48b3-8db1-a8f39cf61d0a tempest-ServersAaction247Test-833529606 tempest-ServersAaction247Test-833529606-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:04:39.599237 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-e3ef5661-5172-48b3-8db1-a8f39cf61d0a tempest-ServersAaction247Test-833529606 tempest-ServersAaction247Test-833529606-project] [instance: 7e5516b1-da8c-450d-8fb3-cabb5a5f873f] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:04:39.862457 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-8eb255d0-7afa-4d81-abc0-9e3f3a595779 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:04:39.863965 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-8eb255d0-7afa-4d81-abc0-9e3f3a595779 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] [instance: 3029f3c1-4f32-4f6b-963c-16f65b6dff3c] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:04:39.901013 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-e3ef5661-5172-48b3-8db1-a8f39cf61d0a tempest-ServersAaction247Test-833529606 tempest-ServersAaction247Test-833529606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dd5e9050cec406da21f51f0e0e6c81f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d45c12d3114f499215931518794ea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:04:39.915045 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-e3ef5661-5172-48b3-8db1-a8f39cf61d0a tempest-ServersAaction247Test-833529606 tempest-ServersAaction247Test-833529606-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7dd5e9050cec406da21f51f0e0e6c81f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d45c12d3114f499215931518794ea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:04:39.926821 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-e3ef5661-5172-48b3-8db1-a8f39cf61d0a tempest-ServersAaction247Test-833529606 tempest-ServersAaction247Test-833529606-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7dd5e9050cec406da21f51f0e0e6c81f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d45c12d3114f499215931518794ea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:04:39.933291 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-e3ef5661-5172-48b3-8db1-a8f39cf61d0a tempest-ServersAaction247Test-833529606 tempest-ServersAaction247Test-833529606-project] 10.222.0.13 "GET /compute/v2.1/servers/7e5516b1-da8c-450d-8fb3-cabb5a5f873f" status: 200 len: 1280 microversion: 2.47 time: 0.340600 Nov 01 19:04:39.944381 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1375/2728] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 19:04:39 2022] GET /compute/v2.1/servers/7e5516b1-da8c-450d-8fb3-cabb5a5f873f => generated 1280 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 19:04:39.959645 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-f36a476a-4327-4072-acba-99a10ebec362 tempest-ServersAdminNegativeTestJSON-824756592 tempest-ServersAdminNegativeTestJSON-824756592-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:04:39.970968 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-f36a476a-4327-4072-acba-99a10ebec362 tempest-ServersAdminNegativeTestJSON-824756592 tempest-ServersAdminNegativeTestJSON-824756592-project] [instance: 51f5bec0-bd00-4ef2-9424-0dad025c8e29] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:04:39.994560 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f36a476a-4327-4072-acba-99a10ebec362 tempest-ServersAdminNegativeTestJSON-824756592 tempest-ServersAdminNegativeTestJSON-824756592-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:04:39.996841 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f36a476a-4327-4072-acba-99a10ebec362 tempest-ServersAdminNegativeTestJSON-824756592 tempest-ServersAdminNegativeTestJSON-824756592-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:04:39.997557 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f36a476a-4327-4072-acba-99a10ebec362 tempest-ServersAdminNegativeTestJSON-824756592 tempest-ServersAdminNegativeTestJSON-824756592-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:04:39.998531 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f36a476a-4327-4072-acba-99a10ebec362 tempest-ServersAdminNegativeTestJSON-824756592 tempest-ServersAdminNegativeTestJSON-824756592-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:04:40.000413 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f36a476a-4327-4072-acba-99a10ebec362 tempest-ServersAdminNegativeTestJSON-824756592 tempest-ServersAdminNegativeTestJSON-824756592-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:04:40.001155 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f36a476a-4327-4072-acba-99a10ebec362 tempest-ServersAdminNegativeTestJSON-824756592 tempest-ServersAdminNegativeTestJSON-824756592-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:04:40.214115 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-8eb255d0-7afa-4d81-abc0-9e3f3a595779 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '790f3f1566b7464aaca19d4d05c0942e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33e3d319293c46b6af2f728a50586906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:04:40.228806 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-8eb255d0-7afa-4d81-abc0-9e3f3a595779 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] 10.222.0.13 "GET /compute/v2.1/servers/3029f3c1-4f32-4f6b-963c-16f65b6dff3c" status: 200 len: 1240 microversion: 2.1 time: 0.368489 Nov 01 19:04:40.231016 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1354/2729] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:04:39 2022] GET /compute/v2.1/servers/3029f3c1-4f32-4f6b-963c-16f65b6dff3c => generated 1240 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:04:40.255129 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-4c0934da-abb0-448e-bc08-da43206c8d25 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:04:40.256071 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-4c0934da-abb0-448e-bc08-da43206c8d25 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] [instance: e760fc87-dcc8-47ae-8bf1-014248a1c1b4] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:04:40.271940 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-4c0934da-abb0-448e-bc08-da43206c8d25 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:04:40.274756 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-4c0934da-abb0-448e-bc08-da43206c8d25 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:04:40.275334 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-4c0934da-abb0-448e-bc08-da43206c8d25 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:04:40.278926 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-4c0934da-abb0-448e-bc08-da43206c8d25 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:04:40.279576 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-4c0934da-abb0-448e-bc08-da43206c8d25 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:04:40.281239 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-4c0934da-abb0-448e-bc08-da43206c8d25 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:04:40.471188 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-4c0934da-abb0-448e-bc08-da43206c8d25 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '058480d92c9b4ab4af6815d0438a65c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee9dc49b89143f781e4ab30296e4d01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:04:40.485823 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-4c0934da-abb0-448e-bc08-da43206c8d25 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] 10.222.0.13 "GET /compute/v2.1/servers/e760fc87-dcc8-47ae-8bf1-014248a1c1b4" status: 200 len: 1219 microversion: 2.1 time: 0.253381 Nov 01 19:04:40.491873 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1355/2730] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:04:40 2022] GET /compute/v2.1/servers/e760fc87-dcc8-47ae-8bf1-014248a1c1b4 => generated 1219 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:04:41.421928 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-f36a476a-4327-4072-acba-99a10ebec362 tempest-ServersAdminNegativeTestJSON-824756592 tempest-ServersAdminNegativeTestJSON-824756592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0708fb2fc1df4aa9a9697cbc94acf921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '232745bfe2f3445987fedb91098c84eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:04:41.450556 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-f36a476a-4327-4072-acba-99a10ebec362 tempest-ServersAdminNegativeTestJSON-824756592 tempest-ServersAdminNegativeTestJSON-824756592-project] 10.222.0.13 "GET /compute/v2.1/servers/51f5bec0-bd00-4ef2-9424-0dad025c8e29" status: 200 len: 1476 microversion: 2.1 time: 1.494007 Nov 01 19:04:41.465084 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1376/2731] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:04:39 2022] GET /compute/v2.1/servers/51f5bec0-bd00-4ef2-9424-0dad025c8e29 => generated 1476 bytes in 1520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:04:41.496509 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-91a0612f-36df-401c-b058-bb53d73f191e tempest-ServersAaction247Test-833529606 tempest-ServersAaction247Test-833529606-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:04:41.497350 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-91a0612f-36df-401c-b058-bb53d73f191e tempest-ServersAaction247Test-833529606 tempest-ServersAaction247Test-833529606-project] [instance: 7e5516b1-da8c-450d-8fb3-cabb5a5f873f] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:04:41.510625 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-91a0612f-36df-401c-b058-bb53d73f191e tempest-ServersAaction247Test-833529606 tempest-ServersAaction247Test-833529606-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:04:41.524751 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [req-84ae7267-4ee4-4dd6-b3aa-bf1a07fdbce9 req-ffa890de-32bb-489f-954a-e4ecd1a2f4cd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "51f5bec0-bd00-4ef2-9424-0dad025c8e29", "name": "network-vif-deleted", "tag": "2ea05588-365b-4212-a081-271d3bee0810"}]} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:04:41.539164 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-91a0612f-36df-401c-b058-bb53d73f191e tempest-ServersAaction247Test-833529606 tempest-ServersAaction247Test-833529606-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:04:41.543003 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-91a0612f-36df-401c-b058-bb53d73f191e tempest-ServersAaction247Test-833529606 tempest-ServersAaction247Test-833529606-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.024s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:04:41.544178 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-91a0612f-36df-401c-b058-bb53d73f191e tempest-ServersAaction247Test-833529606 tempest-ServersAaction247Test-833529606-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:04:41.548594 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-91a0612f-36df-401c-b058-bb53d73f191e tempest-ServersAaction247Test-833529606 tempest-ServersAaction247Test-833529606-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:04:41.549415 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-91a0612f-36df-401c-b058-bb53d73f191e tempest-ServersAaction247Test-833529606 tempest-ServersAaction247Test-833529606-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:04:41.577541 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-84ae7267-4ee4-4dd6-b3aa-bf1a07fdbce9 req-ffa890de-32bb-489f-954a-e4ecd1a2f4cd service nova] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:04:41.578100 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-84ae7267-4ee4-4dd6-b3aa-bf1a07fdbce9 req-ffa890de-32bb-489f-954a-e4ecd1a2f4cd service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:04:41.580816 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-84ae7267-4ee4-4dd6-b3aa-bf1a07fdbce9 req-ffa890de-32bb-489f-954a-e4ecd1a2f4cd service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:04:41.634971 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.compute.server_external_events [req-84ae7267-4ee4-4dd6-b3aa-bf1a07fdbce9 req-ffa890de-32bb-489f-954a-e4ecd1a2f4cd service nova] Creating event network-vif-deleted:2ea05588-365b-4212-a081-271d3bee0810 for instance 51f5bec0-bd00-4ef2-9424-0dad025c8e29 on n-h2-863052-2 Nov 01 19:04:41.656559 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [req-84ae7267-4ee4-4dd6-b3aa-bf1a07fdbce9 req-ffa890de-32bb-489f-954a-e4ecd1a2f4cd service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.858548 Nov 01 19:04:41.662979 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1356/2732] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Nov 1 19:04:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 867 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:04:41.685237 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-54261dcc-e3a7-4539-8768-62eb6b3d5e97 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:04:41.688294 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-54261dcc-e3a7-4539-8768-62eb6b3d5e97 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] [instance: 3029f3c1-4f32-4f6b-963c-16f65b6dff3c] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:04:41.728759 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-54261dcc-e3a7-4539-8768-62eb6b3d5e97 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:04:41.730466 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-54261dcc-e3a7-4539-8768-62eb6b3d5e97 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:04:41.731722 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-54261dcc-e3a7-4539-8768-62eb6b3d5e97 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:04:41.732467 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-54261dcc-e3a7-4539-8768-62eb6b3d5e97 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:04:41.733109 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-54261dcc-e3a7-4539-8768-62eb6b3d5e97 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:04:41.733534 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-54261dcc-e3a7-4539-8768-62eb6b3d5e97 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:04:41.955197 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-91a0612f-36df-401c-b058-bb53d73f191e tempest-ServersAaction247Test-833529606 tempest-ServersAaction247Test-833529606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dd5e9050cec406da21f51f0e0e6c81f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d45c12d3114f499215931518794ea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:04:41.967266 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-91a0612f-36df-401c-b058-bb53d73f191e tempest-ServersAaction247Test-833529606 tempest-ServersAaction247Test-833529606-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7dd5e9050cec406da21f51f0e0e6c81f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d45c12d3114f499215931518794ea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:04:41.976155 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-91a0612f-36df-401c-b058-bb53d73f191e tempest-ServersAaction247Test-833529606 tempest-ServersAaction247Test-833529606-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7dd5e9050cec406da21f51f0e0e6c81f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d45c12d3114f499215931518794ea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:04:41.977693 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-91a0612f-36df-401c-b058-bb53d73f191e tempest-ServersAaction247Test-833529606 tempest-ServersAaction247Test-833529606-project] 10.222.0.13 "GET /compute/v2.1/servers/7e5516b1-da8c-450d-8fb3-cabb5a5f873f" status: 200 len: 1276 microversion: 2.47 time: 0.510116 Nov 01 19:04:41.978451 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1377/2733] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 19:04:41 2022] GET /compute/v2.1/servers/7e5516b1-da8c-450d-8fb3-cabb5a5f873f => generated 1276 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 19:04:41.992497 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-9fc8049b-6de0-4b5b-b79c-73ea40fd0905 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:04:41.993489 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-9fc8049b-6de0-4b5b-b79c-73ea40fd0905 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] [instance: e760fc87-dcc8-47ae-8bf1-014248a1c1b4] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:04:42.005707 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-9fc8049b-6de0-4b5b-b79c-73ea40fd0905 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:04:42.007110 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-9fc8049b-6de0-4b5b-b79c-73ea40fd0905 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:04:42.007937 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-9fc8049b-6de0-4b5b-b79c-73ea40fd0905 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:04:42.009051 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-9fc8049b-6de0-4b5b-b79c-73ea40fd0905 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:04:42.009696 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-9fc8049b-6de0-4b5b-b79c-73ea40fd0905 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:04:42.011581 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-9fc8049b-6de0-4b5b-b79c-73ea40fd0905 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:04:42.161841 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-9fc8049b-6de0-4b5b-b79c-73ea40fd0905 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '058480d92c9b4ab4af6815d0438a65c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee9dc49b89143f781e4ab30296e4d01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:04:42.174787 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-9fc8049b-6de0-4b5b-b79c-73ea40fd0905 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] 10.222.0.13 "GET /compute/v2.1/servers/e760fc87-dcc8-47ae-8bf1-014248a1c1b4" status: 200 len: 1285 microversion: 2.1 time: 0.184428 Nov 01 19:04:42.188832 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1378/2734] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:04:41 2022] GET /compute/v2.1/servers/e760fc87-dcc8-47ae-8bf1-014248a1c1b4 => generated 1285 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:04:42.301474 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-54261dcc-e3a7-4539-8768-62eb6b3d5e97 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '790f3f1566b7464aaca19d4d05c0942e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33e3d319293c46b6af2f728a50586906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:04:42.312567 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-54261dcc-e3a7-4539-8768-62eb6b3d5e97 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] 10.222.0.13 "GET /compute/v2.1/servers/3029f3c1-4f32-4f6b-963c-16f65b6dff3c" status: 200 len: 1292 microversion: 2.1 time: 0.648040 Nov 01 19:04:42.314550 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1357/2735] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:04:41 2022] GET /compute/v2.1/servers/3029f3c1-4f32-4f6b-963c-16f65b6dff3c => generated 1292 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:04:42.494892 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-82590475-5de3-40de-81cc-b5ff30ac8fbd tempest-ServersAdminNegativeTestJSON-824756592 tempest-ServersAdminNegativeTestJSON-824756592-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:04:42.496836 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-82590475-5de3-40de-81cc-b5ff30ac8fbd tempest-ServersAdminNegativeTestJSON-824756592 tempest-ServersAdminNegativeTestJSON-824756592-project] [instance: 51f5bec0-bd00-4ef2-9424-0dad025c8e29] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:04:42.515728 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-82590475-5de3-40de-81cc-b5ff30ac8fbd tempest-ServersAdminNegativeTestJSON-824756592 tempest-ServersAdminNegativeTestJSON-824756592-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:04:42.521837 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-82590475-5de3-40de-81cc-b5ff30ac8fbd tempest-ServersAdminNegativeTestJSON-824756592 tempest-ServersAdminNegativeTestJSON-824756592-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:04:42.527119 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-82590475-5de3-40de-81cc-b5ff30ac8fbd tempest-ServersAdminNegativeTestJSON-824756592 tempest-ServersAdminNegativeTestJSON-824756592-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:04:42.528284 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-82590475-5de3-40de-81cc-b5ff30ac8fbd tempest-ServersAdminNegativeTestJSON-824756592 tempest-ServersAdminNegativeTestJSON-824756592-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:04:42.529120 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-82590475-5de3-40de-81cc-b5ff30ac8fbd tempest-ServersAdminNegativeTestJSON-824756592 tempest-ServersAdminNegativeTestJSON-824756592-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:04:42.529732 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-82590475-5de3-40de-81cc-b5ff30ac8fbd tempest-ServersAdminNegativeTestJSON-824756592 tempest-ServersAdminNegativeTestJSON-824756592-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:04:42.583275 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.wsgi [None req-82590475-5de3-40de-81cc-b5ff30ac8fbd tempest-ServersAdminNegativeTestJSON-824756592 tempest-ServersAdminNegativeTestJSON-824756592-project] HTTP exception thrown: Instance 51f5bec0-bd00-4ef2-9424-0dad025c8e29 could not be found. Nov 01 19:04:42.588344 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-82590475-5de3-40de-81cc-b5ff30ac8fbd tempest-ServersAdminNegativeTestJSON-824756592 tempest-ServersAdminNegativeTestJSON-824756592-project] Request method failure captured: Nov 01 19:04:42.588344 n-d-863052-2 devstack@n-api.service[121403]: request: GET /compute/v2.1/servers/51f5bec0-bd00-4ef2-9424-0dad025c8e29 HTTP/1.1 Nov 01 19:04:42.588344 n-d-863052-2 devstack@n-api.service[121403]: Accept: application/json Nov 01 19:04:42.588344 n-d-863052-2 devstack@n-api.service[121403]: Accept-Encoding: identity Nov 01 19:04:42.588344 n-d-863052-2 devstack@n-api.service[121403]: Connection: close Nov 01 19:04:42.588344 n-d-863052-2 devstack@n-api.service[121403]: Content-Length: 0 Nov 01 19:04:42.588344 n-d-863052-2 devstack@n-api.service[121403]: Content-Type: application/json Nov 01 19:04:42.588344 n-d-863052-2 devstack@n-api.service[121403]: Host: 10.222.0.13 Nov 01 19:04:42.588344 n-d-863052-2 devstack@n-api.service[121403]: Openstack-System-Scope: None Nov 01 19:04:42.588344 n-d-863052-2 devstack@n-api.service[121403]: User-Agent: python-urllib3/1.26.12 Nov 01 19:04:42.588344 n-d-863052-2 devstack@n-api.service[121403]: X-Auth-Token: gAAAAABjYW2DhT5udq9nXc_vFUu8mA45GQB9kOs8urcBG5ncfEIhgIEnS-dfeEejHq8v4ZJdBxQ_wtbAjc9Ji3poRK8GQCMuTaPeSyi3MegDr4vPRgdLHV-gNMLvFE3NLyZ313ZsgHc7MWonZS5jYQLpgAIvpm1K-C4OEn8xOGFxQ_IeAIVw3ok Nov 01 19:04:42.588344 n-d-863052-2 devstack@n-api.service[121403]: X-Domain-Id: None Nov 01 19:04:42.588344 n-d-863052-2 devstack@n-api.service[121403]: X-Domain-Name: None Nov 01 19:04:42.588344 n-d-863052-2 devstack@n-api.service[121403]: X-Identity-Status: Confirmed Nov 01 19:04:42.588344 n-d-863052-2 devstack@n-api.service[121403]: X-Is-Admin-Project: True Nov 01 19:04:42.588344 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Domain-Id: default Nov 01 19:04:42.588344 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Domain-Name: Default Nov 01 19:04:42.588344 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Id: 232745bfe2f3445987fedb91098c84eb Nov 01 19:04:42.588344 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-824756592 Nov 01 19:04:42.588344 n-d-863052-2 devstack@n-api.service[121403]: X-Role: member,reader Nov 01 19:04:42.588344 n-d-863052-2 devstack@n-api.service[121403]: X-Roles: member,reader Nov 01 19:04:42.588344 n-d-863052-2 devstack@n-api.service[121403]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/232745bfe2f3445987fedb91098c84eb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/232745bfe2f3445987fedb91098c84eb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_232745bfe2f3445987fedb91098c84eb", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/232745bfe2f3445987fedb91098c84eb"}]}] Nov 01 19:04:42.588344 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant: tempest-ServersAdminNegativeTestJSON-824756592 Nov 01 19:04:42.588344 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant-Id: 232745bfe2f3445987fedb91098c84eb Nov 01 19:04:42.588344 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-824756592 Nov 01 19:04:42.588344 n-d-863052-2 devstack@n-api.service[121403]: X-User: tempest-ServersAdminNegativeTestJSON-824756592-project Nov 01 19:04:42.588344 n-d-863052-2 devstack@n-api.service[121403]: X-User-Domain-Id: default Nov 01 19:04:42.588344 n-d-863052-2 devstack@n-api.service[121403]: X-User-Domain-Name: Default Nov 01 19:04:42.588344 n-d-863052-2 devstack@n-api.service[121403]: X-User-Id: 0708fb2fc1df4aa9a9697cbc94acf921 Nov 01 19:04:42.588344 n-d-863052-2 devstack@n-api.service[121403]: X-User-Name: tempest-ServersAdminNegativeTestJSON-824756592-project Nov 01 19:04:42.588344 n-d-863052-2 devstack@n-api.service[121403]: method: > Nov 01 19:04:42.588344 n-d-863052-2 devstack@n-api.service[121403]: exception: Instance 51f5bec0-bd00-4ef2-9424-0dad025c8e29 could not be found. Nov 01 19:04:42.588344 n-d-863052-2 devstack@n-api.service[121403]: action_args: {'id': '51f5bec0-bd00-4ef2-9424-0dad025c8e29'} Nov 01 19:04:42.588344 n-d-863052-2 devstack@n-api.service[121403]: {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 01 19:04:42.588344 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:04:42.588344 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 01 19:04:42.588344 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 01 19:04:42.588344 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 01 19:04:42.588344 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 01 19:04:42.588344 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 01 19:04:42.588344 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 01 19:04:42.588344 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 01 19:04:42.588344 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 01 19:04:42.588344 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 51f5bec0-bd00-4ef2-9424-0dad025c8e29 could not be found. Nov 01 19:04:42.588344 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:04:42.588344 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:04:42.588344 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:04:42.588344 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:04:42.588344 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:04:42.588344 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:04:42.588344 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 01 19:04:42.588344 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 01 19:04:42.588344 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 01 19:04:42.588344 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 01 19:04:42.588344 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 01 19:04:42.588344 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 01 19:04:42.588344 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 01 19:04:42.588344 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 01 19:04:42.588344 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 01 19:04:42.588344 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 01 19:04:42.588344 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 51f5bec0-bd00-4ef2-9424-0dad025c8e29 could not be found. Nov 01 19:04:42.588344 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:04:42.588344 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:04:42.591781 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:04:42.591781 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:04:42.591781 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:04:42.591781 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:04:42.591781 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 01 19:04:42.591781 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 01 19:04:42.591781 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 51f5bec0-bd00-4ef2-9424-0dad025c8e29 could not be found. Nov 01 19:04:42.591781 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:04:42.600318 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-82590475-5de3-40de-81cc-b5ff30ac8fbd tempest-ServersAdminNegativeTestJSON-824756592 tempest-ServersAdminNegativeTestJSON-824756592-project] Returning 404 to user: Instance 51f5bec0-bd00-4ef2-9424-0dad025c8e29 could not be found. {{(pid=121403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 01 19:04:42.602885 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-82590475-5de3-40de-81cc-b5ff30ac8fbd tempest-ServersAdminNegativeTestJSON-824756592 tempest-ServersAdminNegativeTestJSON-824756592-project] 10.222.0.13 "GET /compute/v2.1/servers/51f5bec0-bd00-4ef2-9424-0dad025c8e29" status: 404 len: 111 microversion: 2.1 time: 0.114579 Nov 01 19:04:42.607597 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1379/2736] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:04:42 2022] GET /compute/v2.1/servers/51f5bec0-bd00-4ef2-9424-0dad025c8e29 => generated 111 bytes in 119 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 01 19:04:43.006810 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-75a5bc9e-ab4f-4297-95e3-c6dd2e81e13f tempest-ServersAaction247Test-833529606 tempest-ServersAaction247Test-833529606-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:04:43.008196 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-75a5bc9e-ab4f-4297-95e3-c6dd2e81e13f tempest-ServersAaction247Test-833529606 tempest-ServersAaction247Test-833529606-project] [instance: 7e5516b1-da8c-450d-8fb3-cabb5a5f873f] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:04:43.029509 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-75a5bc9e-ab4f-4297-95e3-c6dd2e81e13f tempest-ServersAaction247Test-833529606 tempest-ServersAaction247Test-833529606-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:04:43.031619 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-75a5bc9e-ab4f-4297-95e3-c6dd2e81e13f tempest-ServersAaction247Test-833529606 tempest-ServersAaction247Test-833529606-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:04:43.033815 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-75a5bc9e-ab4f-4297-95e3-c6dd2e81e13f tempest-ServersAaction247Test-833529606 tempest-ServersAaction247Test-833529606-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:04:43.036087 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-75a5bc9e-ab4f-4297-95e3-c6dd2e81e13f tempest-ServersAaction247Test-833529606 tempest-ServersAaction247Test-833529606-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:04:43.037584 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-75a5bc9e-ab4f-4297-95e3-c6dd2e81e13f tempest-ServersAaction247Test-833529606 tempest-ServersAaction247Test-833529606-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:04:43.039539 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-75a5bc9e-ab4f-4297-95e3-c6dd2e81e13f tempest-ServersAaction247Test-833529606 tempest-ServersAaction247Test-833529606-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:04:43.203595 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-c3493346-4990-4fd4-8dd6-1f38badc9e69 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:04:43.204491 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-c3493346-4990-4fd4-8dd6-1f38badc9e69 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] [instance: e760fc87-dcc8-47ae-8bf1-014248a1c1b4] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:04:43.228922 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-c3493346-4990-4fd4-8dd6-1f38badc9e69 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:04:43.231957 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-c3493346-4990-4fd4-8dd6-1f38badc9e69 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:04:43.232498 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-c3493346-4990-4fd4-8dd6-1f38badc9e69 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:04:43.239259 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-c3493346-4990-4fd4-8dd6-1f38badc9e69 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:04:43.239808 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-c3493346-4990-4fd4-8dd6-1f38badc9e69 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:04:43.247519 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-c3493346-4990-4fd4-8dd6-1f38badc9e69 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:04:43.636665 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-c3493346-4990-4fd4-8dd6-1f38badc9e69 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '058480d92c9b4ab4af6815d0438a65c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee9dc49b89143f781e4ab30296e4d01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:04:43.649637 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-c3493346-4990-4fd4-8dd6-1f38badc9e69 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] 10.222.0.13 "GET /compute/v2.1/servers/e760fc87-dcc8-47ae-8bf1-014248a1c1b4" status: 200 len: 1273 microversion: 2.1 time: 0.450392 Nov 01 19:04:43.668612 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1380/2737] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:04:43 2022] GET /compute/v2.1/servers/e760fc87-dcc8-47ae-8bf1-014248a1c1b4 => generated 1273 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:04:43.675772 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-f7abba18-85c5-40ea-9964-acfcc1046ed5 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:04:43.675772 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-f7abba18-85c5-40ea-9964-acfcc1046ed5 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] [instance: 3029f3c1-4f32-4f6b-963c-16f65b6dff3c] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:04:43.705305 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f7abba18-85c5-40ea-9964-acfcc1046ed5 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:04:43.713320 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f7abba18-85c5-40ea-9964-acfcc1046ed5 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:04:43.713940 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f7abba18-85c5-40ea-9964-acfcc1046ed5 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:04:43.715987 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f7abba18-85c5-40ea-9964-acfcc1046ed5 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:04:43.717582 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f7abba18-85c5-40ea-9964-acfcc1046ed5 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:04:43.718436 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f7abba18-85c5-40ea-9964-acfcc1046ed5 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:04:43.730538 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-75a5bc9e-ab4f-4297-95e3-c6dd2e81e13f tempest-ServersAaction247Test-833529606 tempest-ServersAaction247Test-833529606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dd5e9050cec406da21f51f0e0e6c81f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d45c12d3114f499215931518794ea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:04:43.746056 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-75a5bc9e-ab4f-4297-95e3-c6dd2e81e13f tempest-ServersAaction247Test-833529606 tempest-ServersAaction247Test-833529606-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7dd5e9050cec406da21f51f0e0e6c81f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d45c12d3114f499215931518794ea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:04:43.751165 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-75a5bc9e-ab4f-4297-95e3-c6dd2e81e13f tempest-ServersAaction247Test-833529606 tempest-ServersAaction247Test-833529606-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7dd5e9050cec406da21f51f0e0e6c81f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d45c12d3114f499215931518794ea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:04:43.759008 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-75a5bc9e-ab4f-4297-95e3-c6dd2e81e13f tempest-ServersAaction247Test-833529606 tempest-ServersAaction247Test-833529606-project] 10.222.0.13 "GET /compute/v2.1/servers/7e5516b1-da8c-450d-8fb3-cabb5a5f873f" status: 200 len: 1332 microversion: 2.47 time: 0.756617 Nov 01 19:04:43.763032 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1358/2738] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 19:04:43 2022] GET /compute/v2.1/servers/7e5516b1-da8c-450d-8fb3-cabb5a5f873f => generated 1332 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 19:04:43.899428 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-f7abba18-85c5-40ea-9964-acfcc1046ed5 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '790f3f1566b7464aaca19d4d05c0942e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33e3d319293c46b6af2f728a50586906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:04:43.911446 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-f7abba18-85c5-40ea-9964-acfcc1046ed5 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] 10.222.0.13 "GET /compute/v2.1/servers/3029f3c1-4f32-4f6b-963c-16f65b6dff3c" status: 200 len: 1298 microversion: 2.1 time: 0.252723 Nov 01 19:04:43.929259 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1381/2739] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:04:43 2022] GET /compute/v2.1/servers/3029f3c1-4f32-4f6b-963c-16f65b6dff3c => generated 1298 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:04:44.690125 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-cb5032d1-ed22-4ee8-8c5b-65635f017dc8 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:04:44.695539 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-cb5032d1-ed22-4ee8-8c5b-65635f017dc8 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] [instance: e760fc87-dcc8-47ae-8bf1-014248a1c1b4] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:04:44.730244 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-cb5032d1-ed22-4ee8-8c5b-65635f017dc8 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:04:44.731160 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-cb5032d1-ed22-4ee8-8c5b-65635f017dc8 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:04:44.733115 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-cb5032d1-ed22-4ee8-8c5b-65635f017dc8 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:04:44.734165 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-cb5032d1-ed22-4ee8-8c5b-65635f017dc8 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:04:44.737310 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-cb5032d1-ed22-4ee8-8c5b-65635f017dc8 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:04:44.739102 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-cb5032d1-ed22-4ee8-8c5b-65635f017dc8 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:04:44.790797 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-31f5cd3a-bbb0-43b5-8566-ac8d82360848 tempest-ServersAaction247Test-833529606 tempest-ServersAaction247Test-833529606-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:04:44.791996 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-31f5cd3a-bbb0-43b5-8566-ac8d82360848 tempest-ServersAaction247Test-833529606 tempest-ServersAaction247Test-833529606-project] [instance: 7e5516b1-da8c-450d-8fb3-cabb5a5f873f] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:04:44.816044 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-31f5cd3a-bbb0-43b5-8566-ac8d82360848 tempest-ServersAaction247Test-833529606 tempest-ServersAaction247Test-833529606-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:04:44.816987 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-31f5cd3a-bbb0-43b5-8566-ac8d82360848 tempest-ServersAaction247Test-833529606 tempest-ServersAaction247Test-833529606-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:04:44.817680 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-31f5cd3a-bbb0-43b5-8566-ac8d82360848 tempest-ServersAaction247Test-833529606 tempest-ServersAaction247Test-833529606-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:04:44.818667 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-31f5cd3a-bbb0-43b5-8566-ac8d82360848 tempest-ServersAaction247Test-833529606 tempest-ServersAaction247Test-833529606-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:04:44.820493 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-31f5cd3a-bbb0-43b5-8566-ac8d82360848 tempest-ServersAaction247Test-833529606 tempest-ServersAaction247Test-833529606-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:04:44.821185 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-31f5cd3a-bbb0-43b5-8566-ac8d82360848 tempest-ServersAaction247Test-833529606 tempest-ServersAaction247Test-833529606-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:04:45.028102 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-31f5cd3a-bbb0-43b5-8566-ac8d82360848 tempest-ServersAaction247Test-833529606 tempest-ServersAaction247Test-833529606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dd5e9050cec406da21f51f0e0e6c81f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d45c12d3114f499215931518794ea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:04:45.043361 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-31f5cd3a-bbb0-43b5-8566-ac8d82360848 tempest-ServersAaction247Test-833529606 tempest-ServersAaction247Test-833529606-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7dd5e9050cec406da21f51f0e0e6c81f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d45c12d3114f499215931518794ea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:04:45.044862 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-31f5cd3a-bbb0-43b5-8566-ac8d82360848 tempest-ServersAaction247Test-833529606 tempest-ServersAaction247Test-833529606-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7dd5e9050cec406da21f51f0e0e6c81f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d45c12d3114f499215931518794ea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:04:45.054107 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-31f5cd3a-bbb0-43b5-8566-ac8d82360848 tempest-ServersAaction247Test-833529606 tempest-ServersAaction247Test-833529606-project] 10.222.0.13 "GET /compute/v2.1/servers/7e5516b1-da8c-450d-8fb3-cabb5a5f873f" status: 200 len: 1338 microversion: 2.47 time: 0.259952 Nov 01 19:04:45.054789 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1382/2740] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 19:04:44 2022] GET /compute/v2.1/servers/7e5516b1-da8c-450d-8fb3-cabb5a5f873f => generated 1338 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 01 19:04:45.064301 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-cf16c0d0-9628-49c1-a9d2-24a2ebf51563 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:04:45.064984 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-cf16c0d0-9628-49c1-a9d2-24a2ebf51563 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] [instance: 3029f3c1-4f32-4f6b-963c-16f65b6dff3c] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:04:45.092650 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-cf16c0d0-9628-49c1-a9d2-24a2ebf51563 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:04:45.096283 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-cf16c0d0-9628-49c1-a9d2-24a2ebf51563 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:04:45.097400 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-cf16c0d0-9628-49c1-a9d2-24a2ebf51563 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:04:45.098465 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-cf16c0d0-9628-49c1-a9d2-24a2ebf51563 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:04:45.099104 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-cf16c0d0-9628-49c1-a9d2-24a2ebf51563 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:04:45.099695 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-cf16c0d0-9628-49c1-a9d2-24a2ebf51563 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:04:45.286987 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-cb5032d1-ed22-4ee8-8c5b-65635f017dc8 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '058480d92c9b4ab4af6815d0438a65c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee9dc49b89143f781e4ab30296e4d01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:04:45.297211 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-cb5032d1-ed22-4ee8-8c5b-65635f017dc8 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] 10.222.0.13 "GET /compute/v2.1/servers/e760fc87-dcc8-47ae-8bf1-014248a1c1b4" status: 200 len: 1273 microversion: 2.1 time: 0.617741 Nov 01 19:04:45.304264 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1359/2741] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:04:44 2022] GET /compute/v2.1/servers/e760fc87-dcc8-47ae-8bf1-014248a1c1b4 => generated 1273 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:04:45.391897 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-cf16c0d0-9628-49c1-a9d2-24a2ebf51563 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '790f3f1566b7464aaca19d4d05c0942e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33e3d319293c46b6af2f728a50586906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:04:45.452684 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-cf16c0d0-9628-49c1-a9d2-24a2ebf51563 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] 10.222.0.13 "GET /compute/v2.1/servers/3029f3c1-4f32-4f6b-963c-16f65b6dff3c" status: 200 len: 1298 microversion: 2.1 time: 0.390852 Nov 01 19:04:45.453369 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1383/2742] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:04:45 2022] GET /compute/v2.1/servers/3029f3c1-4f32-4f6b-963c-16f65b6dff3c => generated 1298 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:04:46.083641 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-da05ead6-be6b-43df-9e4c-934ebdfb62db tempest-ServersAaction247Test-833529606 tempest-ServersAaction247Test-833529606-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:04:46.084247 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-da05ead6-be6b-43df-9e4c-934ebdfb62db tempest-ServersAaction247Test-833529606 tempest-ServersAaction247Test-833529606-project] [instance: 7e5516b1-da8c-450d-8fb3-cabb5a5f873f] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:04:46.094929 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-da05ead6-be6b-43df-9e4c-934ebdfb62db tempest-ServersAaction247Test-833529606 tempest-ServersAaction247Test-833529606-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:04:46.101361 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-da05ead6-be6b-43df-9e4c-934ebdfb62db tempest-ServersAaction247Test-833529606 tempest-ServersAaction247Test-833529606-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:04:46.101826 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-da05ead6-be6b-43df-9e4c-934ebdfb62db tempest-ServersAaction247Test-833529606 tempest-ServersAaction247Test-833529606-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:04:46.102599 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-da05ead6-be6b-43df-9e4c-934ebdfb62db tempest-ServersAaction247Test-833529606 tempest-ServersAaction247Test-833529606-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:04:46.110784 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-da05ead6-be6b-43df-9e4c-934ebdfb62db tempest-ServersAaction247Test-833529606 tempest-ServersAaction247Test-833529606-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:04:46.111520 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-da05ead6-be6b-43df-9e4c-934ebdfb62db tempest-ServersAaction247Test-833529606 tempest-ServersAaction247Test-833529606-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:04:46.193395 n-d-863052-2 devstack@n-api.service[121402]: DEBUG dbcounter [-] [121402] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 19:04:46.331063 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-298db60c-b212-466c-8da3-8e959e5edd3f tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:04:46.332249 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-298db60c-b212-466c-8da3-8e959e5edd3f tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] [instance: e760fc87-dcc8-47ae-8bf1-014248a1c1b4] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:04:46.358308 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-298db60c-b212-466c-8da3-8e959e5edd3f tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:04:46.359874 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-298db60c-b212-466c-8da3-8e959e5edd3f tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:04:46.361039 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-298db60c-b212-466c-8da3-8e959e5edd3f tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:04:46.366960 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-298db60c-b212-466c-8da3-8e959e5edd3f tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:04:46.371019 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-298db60c-b212-466c-8da3-8e959e5edd3f tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:04:46.371872 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-298db60c-b212-466c-8da3-8e959e5edd3f tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:04:46.592475 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-da05ead6-be6b-43df-9e4c-934ebdfb62db tempest-ServersAaction247Test-833529606 tempest-ServersAaction247Test-833529606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dd5e9050cec406da21f51f0e0e6c81f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d45c12d3114f499215931518794ea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:04:46.602921 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-da05ead6-be6b-43df-9e4c-934ebdfb62db tempest-ServersAaction247Test-833529606 tempest-ServersAaction247Test-833529606-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7dd5e9050cec406da21f51f0e0e6c81f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d45c12d3114f499215931518794ea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:04:46.604669 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-da05ead6-be6b-43df-9e4c-934ebdfb62db tempest-ServersAaction247Test-833529606 tempest-ServersAaction247Test-833529606-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7dd5e9050cec406da21f51f0e0e6c81f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d45c12d3114f499215931518794ea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:04:46.605895 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-da05ead6-be6b-43df-9e4c-934ebdfb62db tempest-ServersAaction247Test-833529606 tempest-ServersAaction247Test-833529606-project] 10.222.0.13 "GET /compute/v2.1/servers/7e5516b1-da8c-450d-8fb3-cabb5a5f873f" status: 200 len: 1338 microversion: 2.47 time: 0.526204 Nov 01 19:04:46.606485 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1360/2743] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 19:04:46 2022] GET /compute/v2.1/servers/7e5516b1-da8c-450d-8fb3-cabb5a5f873f => generated 1338 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 19:04:46.636151 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-9457fd68-e433-427b-a256-0c3722394f52 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:04:46.637220 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-9457fd68-e433-427b-a256-0c3722394f52 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] [instance: 3029f3c1-4f32-4f6b-963c-16f65b6dff3c] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:04:46.650998 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-9457fd68-e433-427b-a256-0c3722394f52 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:04:46.653317 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-9457fd68-e433-427b-a256-0c3722394f52 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:04:46.654036 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-9457fd68-e433-427b-a256-0c3722394f52 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:04:46.654972 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-9457fd68-e433-427b-a256-0c3722394f52 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:04:46.655646 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-9457fd68-e433-427b-a256-0c3722394f52 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:04:46.656274 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-9457fd68-e433-427b-a256-0c3722394f52 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:04:46.909316 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-9457fd68-e433-427b-a256-0c3722394f52 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '790f3f1566b7464aaca19d4d05c0942e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33e3d319293c46b6af2f728a50586906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:04:46.927326 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-9457fd68-e433-427b-a256-0c3722394f52 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] 10.222.0.13 "GET /compute/v2.1/servers/3029f3c1-4f32-4f6b-963c-16f65b6dff3c" status: 200 len: 1298 microversion: 2.1 time: 0.303018 Nov 01 19:04:46.928028 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1361/2744] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:04:46 2022] GET /compute/v2.1/servers/3029f3c1-4f32-4f6b-963c-16f65b6dff3c => generated 1298 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:04:47.168757 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-298db60c-b212-466c-8da3-8e959e5edd3f tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '058480d92c9b4ab4af6815d0438a65c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee9dc49b89143f781e4ab30296e4d01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:04:47.197499 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-298db60c-b212-466c-8da3-8e959e5edd3f tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] 10.222.0.13 "GET /compute/v2.1/servers/e760fc87-dcc8-47ae-8bf1-014248a1c1b4" status: 200 len: 1315 microversion: 2.1 time: 0.869025 Nov 01 19:04:47.198135 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1384/2745] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:04:46 2022] GET /compute/v2.1/servers/e760fc87-dcc8-47ae-8bf1-014248a1c1b4 => generated 1315 bytes in 872 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:04:47.632885 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-b7cf3c6d-38b8-4989-b024-d5dd5acb6e84 tempest-ServersAaction247Test-833529606 tempest-ServersAaction247Test-833529606-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:04:47.634288 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-b7cf3c6d-38b8-4989-b024-d5dd5acb6e84 tempest-ServersAaction247Test-833529606 tempest-ServersAaction247Test-833529606-project] [instance: 7e5516b1-da8c-450d-8fb3-cabb5a5f873f] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:04:47.642954 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b7cf3c6d-38b8-4989-b024-d5dd5acb6e84 tempest-ServersAaction247Test-833529606 tempest-ServersAaction247Test-833529606-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:04:47.649067 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b7cf3c6d-38b8-4989-b024-d5dd5acb6e84 tempest-ServersAaction247Test-833529606 tempest-ServersAaction247Test-833529606-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:04:47.649867 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b7cf3c6d-38b8-4989-b024-d5dd5acb6e84 tempest-ServersAaction247Test-833529606 tempest-ServersAaction247Test-833529606-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:04:47.651225 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b7cf3c6d-38b8-4989-b024-d5dd5acb6e84 tempest-ServersAaction247Test-833529606 tempest-ServersAaction247Test-833529606-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:04:47.652105 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b7cf3c6d-38b8-4989-b024-d5dd5acb6e84 tempest-ServersAaction247Test-833529606 tempest-ServersAaction247Test-833529606-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:04:47.654645 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b7cf3c6d-38b8-4989-b024-d5dd5acb6e84 tempest-ServersAaction247Test-833529606 tempest-ServersAaction247Test-833529606-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:04:47.913505 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-b7cf3c6d-38b8-4989-b024-d5dd5acb6e84 tempest-ServersAaction247Test-833529606 tempest-ServersAaction247Test-833529606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dd5e9050cec406da21f51f0e0e6c81f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d45c12d3114f499215931518794ea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:04:47.956954 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-0c1b7371-1493-49fe-b154-e630b7ba531b tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:04:47.957738 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-0c1b7371-1493-49fe-b154-e630b7ba531b tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] [instance: 3029f3c1-4f32-4f6b-963c-16f65b6dff3c] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:04:47.961798 n-d-863052-2 devstack@n-api.service[121403]: DEBUG dbcounter [-] [121403] Writing DB stats nova_cell0:SELECT=2 {{(pid=121403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 19:04:47.979359 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-b7cf3c6d-38b8-4989-b024-d5dd5acb6e84 tempest-ServersAaction247Test-833529606 tempest-ServersAaction247Test-833529606-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7dd5e9050cec406da21f51f0e0e6c81f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d45c12d3114f499215931518794ea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:04:47.987083 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-b7cf3c6d-38b8-4989-b024-d5dd5acb6e84 tempest-ServersAaction247Test-833529606 tempest-ServersAaction247Test-833529606-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7dd5e9050cec406da21f51f0e0e6c81f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d45c12d3114f499215931518794ea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:04:48.013594 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-b7cf3c6d-38b8-4989-b024-d5dd5acb6e84 tempest-ServersAaction247Test-833529606 tempest-ServersAaction247Test-833529606-project] 10.222.0.13 "GET /compute/v2.1/servers/7e5516b1-da8c-450d-8fb3-cabb5a5f873f" status: 200 len: 1359 microversion: 2.47 time: 0.383672 Nov 01 19:04:48.020081 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-0c1b7371-1493-49fe-b154-e630b7ba531b tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:04:48.030580 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1362/2746] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 19:04:47 2022] GET /compute/v2.1/servers/7e5516b1-da8c-450d-8fb3-cabb5a5f873f => generated 1359 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 19:04:48.040029 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-0c1b7371-1493-49fe-b154-e630b7ba531b tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:04:48.041971 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-0c1b7371-1493-49fe-b154-e630b7ba531b tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:04:48.045691 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-0c1b7371-1493-49fe-b154-e630b7ba531b tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:04:48.051503 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-0c1b7371-1493-49fe-b154-e630b7ba531b tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:04:48.052272 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-0c1b7371-1493-49fe-b154-e630b7ba531b tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:04:48.054619 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-37d4be50-0895-44c9-bfc3-c76c2f7d87e9 tempest-ServersAaction247Test-833529606 tempest-ServersAaction247Test-833529606-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-1-2063212929"}} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:04:48.059781 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-37d4be50-0895-44c9-bfc3-c76c2f7d87e9 tempest-ServersAaction247Test-833529606 tempest-ServersAaction247Test-833529606-project] [instance: 7e5516b1-da8c-450d-8fb3-cabb5a5f873f] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:04:48.084563 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-37d4be50-0895-44c9-bfc3-c76c2f7d87e9 tempest-ServersAaction247Test-833529606 tempest-ServersAaction247Test-833529606-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:04:48.086356 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-37d4be50-0895-44c9-bfc3-c76c2f7d87e9 tempest-ServersAaction247Test-833529606 tempest-ServersAaction247Test-833529606-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:04:48.087025 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-37d4be50-0895-44c9-bfc3-c76c2f7d87e9 tempest-ServersAaction247Test-833529606 tempest-ServersAaction247Test-833529606-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:04:48.089646 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-37d4be50-0895-44c9-bfc3-c76c2f7d87e9 tempest-ServersAaction247Test-833529606 tempest-ServersAaction247Test-833529606-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:04:48.090767 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-37d4be50-0895-44c9-bfc3-c76c2f7d87e9 tempest-ServersAaction247Test-833529606 tempest-ServersAaction247Test-833529606-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:04:48.092124 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-37d4be50-0895-44c9-bfc3-c76c2f7d87e9 tempest-ServersAaction247Test-833529606 tempest-ServersAaction247Test-833529606-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:04:48.670246 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-37d4be50-0895-44c9-bfc3-c76c2f7d87e9 tempest-ServersAaction247Test-833529606 tempest-ServersAaction247Test-833529606-project] 10.222.0.13 "POST /compute/v2.1/servers/7e5516b1-da8c-450d-8fb3-cabb5a5f873f/action" status: 202 len: 52 microversion: 2.47 time: 0.622336 Nov 01 19:04:48.682288 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1363/2747] 10.222.0.13 () {62 vars in 1319 bytes} [Tue Nov 1 19:04:48 2022] POST /compute/v2.1/servers/7e5516b1-da8c-450d-8fb3-cabb5a5f873f/action => generated 52 bytes in 637 msecs (HTTP/1.1 202) 9 headers in 364 bytes (2 switches on core 0) Nov 01 19:04:48.706506 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-ca501fe3-432b-4f53-b06d-7b4aed145ed0 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:04:48.708621 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-ca501fe3-432b-4f53-b06d-7b4aed145ed0 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] [instance: e760fc87-dcc8-47ae-8bf1-014248a1c1b4] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:04:48.730662 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-ca501fe3-432b-4f53-b06d-7b4aed145ed0 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:04:48.746775 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-ca501fe3-432b-4f53-b06d-7b4aed145ed0 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:04:48.747304 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-ca501fe3-432b-4f53-b06d-7b4aed145ed0 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:04:48.748066 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-ca501fe3-432b-4f53-b06d-7b4aed145ed0 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:04:48.748545 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-ca501fe3-432b-4f53-b06d-7b4aed145ed0 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:04:48.755746 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-ca501fe3-432b-4f53-b06d-7b4aed145ed0 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:04:48.971149 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-0c1b7371-1493-49fe-b154-e630b7ba531b tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '790f3f1566b7464aaca19d4d05c0942e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33e3d319293c46b6af2f728a50586906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:04:49.008212 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-0c1b7371-1493-49fe-b154-e630b7ba531b tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] 10.222.0.13 "GET /compute/v2.1/servers/3029f3c1-4f32-4f6b-963c-16f65b6dff3c" status: 200 len: 1366 microversion: 2.1 time: 1.059564 Nov 01 19:04:49.009252 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1385/2748] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:04:47 2022] GET /compute/v2.1/servers/3029f3c1-4f32-4f6b-963c-16f65b6dff3c => generated 1366 bytes in 1062 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:04:49.509102 n-d-863052-2 devstack@n-api.service[121402]: DEBUG dbcounter [-] [121402] Writing DB stats nova_cell0:SELECT=4 {{(pid=121402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 19:04:49.747434 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-5df1efea-cb89-417e-b13b-1b89da10c357 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1994954118", "imageRef": "2d4a0047-1b9e-445f-8af8-1b5c9d93e881", "flavorRef": "452", "networks": [{"uuid": "3869a194-2d1b-4c2a-b413-fb6893096e26"}]}} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:04:49.848702 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.network.neutron [None req-5df1efea-cb89-417e-b13b-1b89da10c357 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] validate_networks() for [('3869a194-2d1b-4c2a-b413-fb6893096e26', None, None, None, None, None)] {{(pid=121403) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 01 19:04:49.907240 n-d-863052-2 devstack@n-api.service[121403]: DEBUG dbcounter [-] [121403] Writing DB stats nova_cell0:SELECT=34 {{(pid=121403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 19:04:50.218733 n-d-863052-2 devstack@n-api.service[121402]: DEBUG dbcounter [-] [121402] Writing DB stats nova_cell0:SELECT=56 {{(pid=121402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 19:04:50.708906 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-ca501fe3-432b-4f53-b06d-7b4aed145ed0 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '058480d92c9b4ab4af6815d0438a65c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee9dc49b89143f781e4ab30296e4d01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:04:50.717903 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-ca501fe3-432b-4f53-b06d-7b4aed145ed0 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] 10.222.0.13 "GET /compute/v2.1/servers/e760fc87-dcc8-47ae-8bf1-014248a1c1b4" status: 200 len: 1315 microversion: 2.1 time: 2.033082 Nov 01 19:04:50.734148 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1364/2749] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:04:48 2022] GET /compute/v2.1/servers/e760fc87-dcc8-47ae-8bf1-014248a1c1b4 => generated 1315 bytes in 2051 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:04:50.744270 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-2611e210-c8b6-47d4-8ac3-b2c31d0b5e8e tempest-ServersAaction247Test-833529606 tempest-ServersAaction247Test-833529606-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:04:50.745037 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-2611e210-c8b6-47d4-8ac3-b2c31d0b5e8e tempest-ServersAaction247Test-833529606 tempest-ServersAaction247Test-833529606-project] [instance: 7e5516b1-da8c-450d-8fb3-cabb5a5f873f] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:04:50.753540 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2611e210-c8b6-47d4-8ac3-b2c31d0b5e8e tempest-ServersAaction247Test-833529606 tempest-ServersAaction247Test-833529606-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:04:50.754736 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2611e210-c8b6-47d4-8ac3-b2c31d0b5e8e tempest-ServersAaction247Test-833529606 tempest-ServersAaction247Test-833529606-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:04:50.755333 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2611e210-c8b6-47d4-8ac3-b2c31d0b5e8e tempest-ServersAaction247Test-833529606 tempest-ServersAaction247Test-833529606-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:04:50.757042 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2611e210-c8b6-47d4-8ac3-b2c31d0b5e8e tempest-ServersAaction247Test-833529606 tempest-ServersAaction247Test-833529606-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:04:50.757822 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2611e210-c8b6-47d4-8ac3-b2c31d0b5e8e tempest-ServersAaction247Test-833529606 tempest-ServersAaction247Test-833529606-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:04:50.758454 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2611e210-c8b6-47d4-8ac3-b2c31d0b5e8e tempest-ServersAaction247Test-833529606 tempest-ServersAaction247Test-833529606-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:04:50.793976 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-2611e210-c8b6-47d4-8ac3-b2c31d0b5e8e tempest-ServersAaction247Test-833529606 tempest-ServersAaction247Test-833529606-project] [instance: 7e5516b1-da8c-450d-8fb3-cabb5a5f873f] Going to try to terminate instance {{(pid=121402) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 01 19:04:50.961311 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-2611e210-c8b6-47d4-8ac3-b2c31d0b5e8e tempest-ServersAaction247Test-833529606 tempest-ServersAaction247Test-833529606-project] 10.222.0.13 "DELETE /compute/v2.1/servers/7e5516b1-da8c-450d-8fb3-cabb5a5f873f" status: 204 len: 0 microversion: 2.47 time: 0.221283 Nov 01 19:04:50.962804 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1365/2750] 10.222.0.13 () {60 vars in 1280 bytes} [Tue Nov 1 19:04:50 2022] DELETE /compute/v2.1/servers/7e5516b1-da8c-450d-8fb3-cabb5a5f873f => generated 0 bytes in 228 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 01 19:04:50.976476 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-40e62d11-0363-4919-8f9b-1dc353531395 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:04:50.977882 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-40e62d11-0363-4919-8f9b-1dc353531395 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] [instance: 3029f3c1-4f32-4f6b-963c-16f65b6dff3c] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:04:51.027800 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-40e62d11-0363-4919-8f9b-1dc353531395 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:04:51.028345 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-40e62d11-0363-4919-8f9b-1dc353531395 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:04:51.028861 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-40e62d11-0363-4919-8f9b-1dc353531395 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:04:51.032561 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-40e62d11-0363-4919-8f9b-1dc353531395 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:04:51.033482 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-40e62d11-0363-4919-8f9b-1dc353531395 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:04:51.033947 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-40e62d11-0363-4919-8f9b-1dc353531395 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:04:51.643835 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.virt.hardware [None req-5df1efea-cb89-417e-b13b-1b89da10c357 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Flavor limits 0:0:0 {{(pid=121403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 01 19:04:51.644939 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.virt.hardware [None req-5df1efea-cb89-417e-b13b-1b89da10c357 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Image limits 0:0:0 {{(pid=121403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 01 19:04:51.645593 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.virt.hardware [None req-5df1efea-cb89-417e-b13b-1b89da10c357 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Flavor pref 0:0:0 {{(pid=121403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 01 19:04:51.646160 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.virt.hardware [None req-5df1efea-cb89-417e-b13b-1b89da10c357 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Image pref 0:0:0 {{(pid=121403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 01 19:04:51.646741 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.virt.hardware [None req-5df1efea-cb89-417e-b13b-1b89da10c357 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 01 19:04:51.662944 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-5df1efea-cb89-417e-b13b-1b89da10c357 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:04:51.663440 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-5df1efea-cb89-417e-b13b-1b89da10c357 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:04:51.663887 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-5df1efea-cb89-417e-b13b-1b89da10c357 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:04:51.664654 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-5df1efea-cb89-417e-b13b-1b89da10c357 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:04:51.665122 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-5df1efea-cb89-417e-b13b-1b89da10c357 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:04:51.665556 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-5df1efea-cb89-417e-b13b-1b89da10c357 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:04:51.706881 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.quota [None req-5df1efea-cb89-417e-b13b-1b89da10c357 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Getting quotas for project 07b5d812eff94e2f89d4705d7e7d5f3d. Resources: {'cores', 'ram', 'instances'} {{(pid=121403) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 01 19:04:51.720336 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.quota [None req-5df1efea-cb89-417e-b13b-1b89da10c357 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Getting quotas for user 05d6a1722dfa4e959aeb14d601e43b93 and project 07b5d812eff94e2f89d4705d7e7d5f3d. Resources: {'cores', 'ram', 'instances'} {{(pid=121403) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 01 19:04:51.749080 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-5df1efea-cb89-417e-b13b-1b89da10c357 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Going to run 1 instances... {{(pid=121403) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 01 19:04:51.754907 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-5df1efea-cb89-417e-b13b-1b89da10c357 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] [instance: b58b3cb6-ebdc-4705-b308-4e804cd52bce] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2d4a0047-1b9e-445f-8af8-1b5c9d93e881',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121403) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 01 19:04:51.856043 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-5df1efea-cb89-417e-b13b-1b89da10c357 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.843745 Nov 01 19:04:51.858778 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1386/2751] 10.222.0.13 () {60 vars in 1147 bytes} [Tue Nov 1 19:04:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 2848 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 01 19:04:51.901278 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-40e62d11-0363-4919-8f9b-1dc353531395 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '790f3f1566b7464aaca19d4d05c0942e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33e3d319293c46b6af2f728a50586906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:04:51.912262 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-40e62d11-0363-4919-8f9b-1dc353531395 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] 10.222.0.13 "GET /compute/v2.1/servers/3029f3c1-4f32-4f6b-963c-16f65b6dff3c" status: 200 len: 1366 microversion: 2.1 time: 0.947496 Nov 01 19:04:51.913562 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1366/2752] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:04:50 2022] GET /compute/v2.1/servers/3029f3c1-4f32-4f6b-963c-16f65b6dff3c => generated 1366 bytes in 950 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:04:51.920871 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-b537b964-a596-48c9-803f-0734f18d2406 tempest-ServersAaction247Test-833529606 tempest-ServersAaction247Test-833529606-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:04:51.923434 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-b537b964-a596-48c9-803f-0734f18d2406 tempest-ServersAaction247Test-833529606 tempest-ServersAaction247Test-833529606-project] [instance: 7e5516b1-da8c-450d-8fb3-cabb5a5f873f] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:04:51.931026 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b537b964-a596-48c9-803f-0734f18d2406 tempest-ServersAaction247Test-833529606 tempest-ServersAaction247Test-833529606-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:04:51.932005 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b537b964-a596-48c9-803f-0734f18d2406 tempest-ServersAaction247Test-833529606 tempest-ServersAaction247Test-833529606-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:04:51.932613 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b537b964-a596-48c9-803f-0734f18d2406 tempest-ServersAaction247Test-833529606 tempest-ServersAaction247Test-833529606-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:04:51.933481 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b537b964-a596-48c9-803f-0734f18d2406 tempest-ServersAaction247Test-833529606 tempest-ServersAaction247Test-833529606-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:04:51.934362 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b537b964-a596-48c9-803f-0734f18d2406 tempest-ServersAaction247Test-833529606 tempest-ServersAaction247Test-833529606-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:04:51.934946 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b537b964-a596-48c9-803f-0734f18d2406 tempest-ServersAaction247Test-833529606 tempest-ServersAaction247Test-833529606-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:04:52.106585 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-6d0ad838-c3fc-4160-b880-9947bd2976bd tempest-ServicesAdminNegativeTestJSON-2140076876 tempest-ServicesAdminNegativeTestJSON-2140076876-project-admin] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:04:52.112460 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-6d0ad838-c3fc-4160-b880-9947bd2976bd tempest-ServicesAdminNegativeTestJSON-2140076876 tempest-ServicesAdminNegativeTestJSON-2140076876-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:04:52.114102 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-6d0ad838-c3fc-4160-b880-9947bd2976bd tempest-ServicesAdminNegativeTestJSON-2140076876 tempest-ServicesAdminNegativeTestJSON-2140076876-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:04:52.116455 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-6d0ad838-c3fc-4160-b880-9947bd2976bd tempest-ServicesAdminNegativeTestJSON-2140076876 tempest-ServicesAdminNegativeTestJSON-2140076876-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:04:52.117291 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-6d0ad838-c3fc-4160-b880-9947bd2976bd tempest-ServicesAdminNegativeTestJSON-2140076876 tempest-ServicesAdminNegativeTestJSON-2140076876-project-admin] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:04:52.119347 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-6d0ad838-c3fc-4160-b880-9947bd2976bd tempest-ServicesAdminNegativeTestJSON-2140076876 tempest-ServicesAdminNegativeTestJSON-2140076876-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:04:52.119796 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-6d0ad838-c3fc-4160-b880-9947bd2976bd tempest-ServicesAdminNegativeTestJSON-2140076876 tempest-ServicesAdminNegativeTestJSON-2140076876-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:04:52.146046 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-b537b964-a596-48c9-803f-0734f18d2406 tempest-ServersAaction247Test-833529606 tempest-ServersAaction247Test-833529606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dd5e9050cec406da21f51f0e0e6c81f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d45c12d3114f499215931518794ea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:04:52.159685 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-b537b964-a596-48c9-803f-0734f18d2406 tempest-ServersAaction247Test-833529606 tempest-ServersAaction247Test-833529606-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7dd5e9050cec406da21f51f0e0e6c81f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d45c12d3114f499215931518794ea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:04:52.161300 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-b537b964-a596-48c9-803f-0734f18d2406 tempest-ServersAaction247Test-833529606 tempest-ServersAaction247Test-833529606-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7dd5e9050cec406da21f51f0e0e6c81f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d45c12d3114f499215931518794ea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:04:52.167572 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-b537b964-a596-48c9-803f-0734f18d2406 tempest-ServersAaction247Test-833529606 tempest-ServersAaction247Test-833529606-project] 10.222.0.13 "GET /compute/v2.1/servers/7e5516b1-da8c-450d-8fb3-cabb5a5f873f" status: 200 len: 1365 microversion: 2.47 time: 0.249338 Nov 01 19:04:52.180730 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1367/2753] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 19:04:51 2022] GET /compute/v2.1/servers/7e5516b1-da8c-450d-8fb3-cabb5a5f873f => generated 1365 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 19:04:52.196422 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-27e89cc6-de30-42fa-a913-fc95d3d2d2f9 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:04:52.214050 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-27e89cc6-de30-42fa-a913-fc95d3d2d2f9 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] [instance: e760fc87-dcc8-47ae-8bf1-014248a1c1b4] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:04:52.222289 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-6d0ad838-c3fc-4160-b880-9947bd2976bd tempest-ServicesAdminNegativeTestJSON-2140076876 tempest-ServicesAdminNegativeTestJSON-2140076876-project-admin] 10.222.0.13 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.360055 Nov 01 19:04:52.228062 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1387/2754] 10.222.0.13 () {58 vars in 1137 bytes} [Tue Nov 1 19:04:51 2022] GET /compute/v2.1/os-services => generated 944 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:04:52.229899 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-27e89cc6-de30-42fa-a913-fc95d3d2d2f9 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:04:52.230405 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-27e89cc6-de30-42fa-a913-fc95d3d2d2f9 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:04:52.230850 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-27e89cc6-de30-42fa-a913-fc95d3d2d2f9 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:04:52.231563 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-27e89cc6-de30-42fa-a913-fc95d3d2d2f9 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:04:52.232023 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-27e89cc6-de30-42fa-a913-fc95d3d2d2f9 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:04:52.232447 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-27e89cc6-de30-42fa-a913-fc95d3d2d2f9 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:04:52.243154 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-180a0c9e-9bbe-4e5c-977d-71f0bb2dcc3f tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:04:52.244271 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-180a0c9e-9bbe-4e5c-977d-71f0bb2dcc3f tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] [instance: b58b3cb6-ebdc-4705-b308-4e804cd52bce] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:04:52.392236 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-180a0c9e-9bbe-4e5c-977d-71f0bb2dcc3f tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05d6a1722dfa4e959aeb14d601e43b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b5d812eff94e2f89d4705d7e7d5f3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:04:52.401555 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-180a0c9e-9bbe-4e5c-977d-71f0bb2dcc3f tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] 10.222.0.13 "GET /compute/v2.1/servers/b58b3cb6-ebdc-4705-b308-4e804cd52bce" status: 200 len: 1218 microversion: 2.1 time: 0.171279 Nov 01 19:04:52.402537 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1388/2755] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:04:52 2022] GET /compute/v2.1/servers/b58b3cb6-ebdc-4705-b308-4e804cd52bce => generated 1218 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:04:52.420706 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-23b28d7e-eba9-4d42-bb08-e9ada5a55cbc tempest-ServicesAdminNegativeTestJSON-2140076876 tempest-ServicesAdminNegativeTestJSON-2140076876-project-admin] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:04:52.425178 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-23b28d7e-eba9-4d42-bb08-e9ada5a55cbc tempest-ServicesAdminNegativeTestJSON-2140076876 tempest-ServicesAdminNegativeTestJSON-2140076876-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:04:52.425915 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-23b28d7e-eba9-4d42-bb08-e9ada5a55cbc tempest-ServicesAdminNegativeTestJSON-2140076876 tempest-ServicesAdminNegativeTestJSON-2140076876-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:04:52.426725 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-23b28d7e-eba9-4d42-bb08-e9ada5a55cbc tempest-ServicesAdminNegativeTestJSON-2140076876 tempest-ServicesAdminNegativeTestJSON-2140076876-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:04:52.427687 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-23b28d7e-eba9-4d42-bb08-e9ada5a55cbc tempest-ServicesAdminNegativeTestJSON-2140076876 tempest-ServicesAdminNegativeTestJSON-2140076876-project-admin] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:04:52.428332 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-23b28d7e-eba9-4d42-bb08-e9ada5a55cbc tempest-ServicesAdminNegativeTestJSON-2140076876 tempest-ServicesAdminNegativeTestJSON-2140076876-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:04:52.429070 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-23b28d7e-eba9-4d42-bb08-e9ada5a55cbc tempest-ServicesAdminNegativeTestJSON-2140076876 tempest-ServicesAdminNegativeTestJSON-2140076876-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:04:52.528452 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-23b28d7e-eba9-4d42-bb08-e9ada5a55cbc tempest-ServicesAdminNegativeTestJSON-2140076876 tempest-ServicesAdminNegativeTestJSON-2140076876-project-admin] 10.222.0.13 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.117773 Nov 01 19:04:52.529569 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1389/2756] 10.222.0.13 () {58 vars in 1170 bytes} [Tue Nov 1 19:04:52 2022] GET /compute/v2.1/os-services?xxx=nova-compute => generated 944 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:04:52.566746 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-ce05a1de-34ec-403a-b3ce-e2be76348c33 tempest-ServicesAdminNegativeTestJSON-2140076876 tempest-ServicesAdminNegativeTestJSON-2140076876-project-admin] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:04:52.571379 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-ce05a1de-34ec-403a-b3ce-e2be76348c33 tempest-ServicesAdminNegativeTestJSON-2140076876 tempest-ServicesAdminNegativeTestJSON-2140076876-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:04:52.571966 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-ce05a1de-34ec-403a-b3ce-e2be76348c33 tempest-ServicesAdminNegativeTestJSON-2140076876 tempest-ServicesAdminNegativeTestJSON-2140076876-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:04:52.573170 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-ce05a1de-34ec-403a-b3ce-e2be76348c33 tempest-ServicesAdminNegativeTestJSON-2140076876 tempest-ServicesAdminNegativeTestJSON-2140076876-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:04:52.574014 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-ce05a1de-34ec-403a-b3ce-e2be76348c33 tempest-ServicesAdminNegativeTestJSON-2140076876 tempest-ServicesAdminNegativeTestJSON-2140076876-project-admin] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:04:52.574639 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-ce05a1de-34ec-403a-b3ce-e2be76348c33 tempest-ServicesAdminNegativeTestJSON-2140076876 tempest-ServicesAdminNegativeTestJSON-2140076876-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:04:52.575142 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-ce05a1de-34ec-403a-b3ce-e2be76348c33 tempest-ServicesAdminNegativeTestJSON-2140076876 tempest-ServicesAdminNegativeTestJSON-2140076876-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:04:52.632712 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-ce05a1de-34ec-403a-b3ce-e2be76348c33 tempest-ServicesAdminNegativeTestJSON-2140076876 tempest-ServicesAdminNegativeTestJSON-2140076876-project-admin] 10.222.0.13 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.089350 Nov 01 19:04:52.642410 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1390/2757] 10.222.0.13 () {58 vars in 1137 bytes} [Tue Nov 1 19:04:52 2022] GET /compute/v2.1/os-services => generated 944 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 01 19:04:52.647233 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-8f2fab50-b0a5-4ea5-b2a2-9b60735e6d97 tempest-ServicesAdminNegativeTestJSON-2140076876 tempest-ServicesAdminNegativeTestJSON-2140076876-project-admin] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:04:52.655223 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-8f2fab50-b0a5-4ea5-b2a2-9b60735e6d97 tempest-ServicesAdminNegativeTestJSON-2140076876 tempest-ServicesAdminNegativeTestJSON-2140076876-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:04:52.656246 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-8f2fab50-b0a5-4ea5-b2a2-9b60735e6d97 tempest-ServicesAdminNegativeTestJSON-2140076876 tempest-ServicesAdminNegativeTestJSON-2140076876-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:04:52.657657 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-8f2fab50-b0a5-4ea5-b2a2-9b60735e6d97 tempest-ServicesAdminNegativeTestJSON-2140076876 tempest-ServicesAdminNegativeTestJSON-2140076876-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:04:52.658963 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-8f2fab50-b0a5-4ea5-b2a2-9b60735e6d97 tempest-ServicesAdminNegativeTestJSON-2140076876 tempest-ServicesAdminNegativeTestJSON-2140076876-project-admin] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:04:52.660705 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-8f2fab50-b0a5-4ea5-b2a2-9b60735e6d97 tempest-ServicesAdminNegativeTestJSON-2140076876 tempest-ServicesAdminNegativeTestJSON-2140076876-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:04:52.661371 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-8f2fab50-b0a5-4ea5-b2a2-9b60735e6d97 tempest-ServicesAdminNegativeTestJSON-2140076876 tempest-ServicesAdminNegativeTestJSON-2140076876-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:04:52.700148 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-8f2fab50-b0a5-4ea5-b2a2-9b60735e6d97 tempest-ServicesAdminNegativeTestJSON-2140076876 tempest-ServicesAdminNegativeTestJSON-2140076876-project-admin] 10.222.0.13 "GET /compute/v2.1/os-services?host=n-d-863052-2&binary=xxx" status: 200 len: 16 microversion: 2.1 time: 0.056461 Nov 01 19:04:52.710264 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1391/2758] 10.222.0.13 () {58 vars in 1194 bytes} [Tue Nov 1 19:04:52 2022] GET /compute/v2.1/os-services?host=n-d-863052-2&binary=xxx => generated 16 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 01 19:04:52.717298 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-43872825-7886-40f9-8ee6-7bd1c0345e92 tempest-ServicesAdminNegativeTestJSON-2140076876 tempest-ServicesAdminNegativeTestJSON-2140076876-project-admin] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:04:52.722513 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-43872825-7886-40f9-8ee6-7bd1c0345e92 tempest-ServicesAdminNegativeTestJSON-2140076876 tempest-ServicesAdminNegativeTestJSON-2140076876-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:04:52.723470 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-43872825-7886-40f9-8ee6-7bd1c0345e92 tempest-ServicesAdminNegativeTestJSON-2140076876 tempest-ServicesAdminNegativeTestJSON-2140076876-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:04:52.724194 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-43872825-7886-40f9-8ee6-7bd1c0345e92 tempest-ServicesAdminNegativeTestJSON-2140076876 tempest-ServicesAdminNegativeTestJSON-2140076876-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:04:52.725230 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-43872825-7886-40f9-8ee6-7bd1c0345e92 tempest-ServicesAdminNegativeTestJSON-2140076876 tempest-ServicesAdminNegativeTestJSON-2140076876-project-admin] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:04:52.726221 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-43872825-7886-40f9-8ee6-7bd1c0345e92 tempest-ServicesAdminNegativeTestJSON-2140076876 tempest-ServicesAdminNegativeTestJSON-2140076876-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:04:52.727288 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-43872825-7886-40f9-8ee6-7bd1c0345e92 tempest-ServicesAdminNegativeTestJSON-2140076876 tempest-ServicesAdminNegativeTestJSON-2140076876-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:04:52.762397 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-43872825-7886-40f9-8ee6-7bd1c0345e92 tempest-ServicesAdminNegativeTestJSON-2140076876 tempest-ServicesAdminNegativeTestJSON-2140076876-project-admin] 10.222.0.13 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.050014 Nov 01 19:04:52.763427 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1392/2759] 10.222.0.13 () {58 vars in 1137 bytes} [Tue Nov 1 19:04:52 2022] GET /compute/v2.1/os-services => generated 944 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:04:52.785920 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-47d01c54-3ea6-4f6e-9ffd-19ce2bf9caf1 tempest-ServicesAdminNegativeTestJSON-2140076876 tempest-ServicesAdminNegativeTestJSON-2140076876-project-admin] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:04:52.797987 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-47d01c54-3ea6-4f6e-9ffd-19ce2bf9caf1 tempest-ServicesAdminNegativeTestJSON-2140076876 tempest-ServicesAdminNegativeTestJSON-2140076876-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:04:52.798624 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-47d01c54-3ea6-4f6e-9ffd-19ce2bf9caf1 tempest-ServicesAdminNegativeTestJSON-2140076876 tempest-ServicesAdminNegativeTestJSON-2140076876-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:04:52.799083 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-47d01c54-3ea6-4f6e-9ffd-19ce2bf9caf1 tempest-ServicesAdminNegativeTestJSON-2140076876 tempest-ServicesAdminNegativeTestJSON-2140076876-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:04:52.800075 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-47d01c54-3ea6-4f6e-9ffd-19ce2bf9caf1 tempest-ServicesAdminNegativeTestJSON-2140076876 tempest-ServicesAdminNegativeTestJSON-2140076876-project-admin] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:04:52.801416 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-47d01c54-3ea6-4f6e-9ffd-19ce2bf9caf1 tempest-ServicesAdminNegativeTestJSON-2140076876 tempest-ServicesAdminNegativeTestJSON-2140076876-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:04:52.802927 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-47d01c54-3ea6-4f6e-9ffd-19ce2bf9caf1 tempest-ServicesAdminNegativeTestJSON-2140076876 tempest-ServicesAdminNegativeTestJSON-2140076876-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:04:52.875236 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-47d01c54-3ea6-4f6e-9ffd-19ce2bf9caf1 tempest-ServicesAdminNegativeTestJSON-2140076876 tempest-ServicesAdminNegativeTestJSON-2140076876-project-admin] 10.222.0.13 "GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler" status: 200 len: 16 microversion: 2.1 time: 0.101448 Nov 01 19:04:52.876971 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1393/2760] 10.222.0.13 () {58 vars in 1198 bytes} [Tue Nov 1 19:04:52 2022] GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler => generated 16 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 01 19:04:53.131718 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-96dadf68-f442-45a7-bd55-cd56058bae1a tempest-ServicesAdminNegativeTestJSON-611076768 tempest-ServicesAdminNegativeTestJSON-611076768-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:04:53.139490 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-96dadf68-f442-45a7-bd55-cd56058bae1a tempest-ServicesAdminNegativeTestJSON-611076768 tempest-ServicesAdminNegativeTestJSON-611076768-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': 'dec4fd56817e45bf8cff334f294c9f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a127ffbd2c3940debcffd4ca03e34c73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:04:53.144665 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-96dadf68-f442-45a7-bd55-cd56058bae1a tempest-ServicesAdminNegativeTestJSON-611076768 tempest-ServicesAdminNegativeTestJSON-611076768-project] Request method failure captured: Nov 01 19:04:53.144665 n-d-863052-2 devstack@n-api.service[121403]: request: GET /compute/v2.1/os-services HTTP/1.1 Nov 01 19:04:53.144665 n-d-863052-2 devstack@n-api.service[121403]: Accept: application/json Nov 01 19:04:53.144665 n-d-863052-2 devstack@n-api.service[121403]: Accept-Encoding: identity Nov 01 19:04:53.144665 n-d-863052-2 devstack@n-api.service[121403]: Connection: close Nov 01 19:04:53.144665 n-d-863052-2 devstack@n-api.service[121403]: Content-Length: 0 Nov 01 19:04:53.144665 n-d-863052-2 devstack@n-api.service[121403]: Content-Type: application/json Nov 01 19:04:53.144665 n-d-863052-2 devstack@n-api.service[121403]: Host: 10.222.0.13 Nov 01 19:04:53.144665 n-d-863052-2 devstack@n-api.service[121403]: Openstack-System-Scope: None Nov 01 19:04:53.144665 n-d-863052-2 devstack@n-api.service[121403]: User-Agent: python-urllib3/1.26.12 Nov 01 19:04:53.144665 n-d-863052-2 devstack@n-api.service[121403]: X-Auth-Token: gAAAAABjYW3Roc3bSwFhA1OI6rM3NiM3RdOGJMgVZbqVrOdfU4RxrWcp7V-a_pZRs8FnlLx8dp4WqYITx2asgaWFfZp-vQR0Y2M6R4Oj-5St4GZ9wZ5I-hxnaMocaWSxRqKroL7-lECjq-Ady0MP8sqYYAHux4iyfZz-u1XPUAk6WBtg7qVi7TU Nov 01 19:04:53.144665 n-d-863052-2 devstack@n-api.service[121403]: X-Domain-Id: None Nov 01 19:04:53.144665 n-d-863052-2 devstack@n-api.service[121403]: X-Domain-Name: None Nov 01 19:04:53.144665 n-d-863052-2 devstack@n-api.service[121403]: X-Identity-Status: Confirmed Nov 01 19:04:53.144665 n-d-863052-2 devstack@n-api.service[121403]: X-Is-Admin-Project: True Nov 01 19:04:53.144665 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Domain-Id: default Nov 01 19:04:53.144665 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Domain-Name: Default Nov 01 19:04:53.144665 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Id: a127ffbd2c3940debcffd4ca03e34c73 Nov 01 19:04:53.144665 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Name: tempest-ServicesAdminNegativeTestJSON-611076768 Nov 01 19:04:53.144665 n-d-863052-2 devstack@n-api.service[121403]: X-Role: member,reader Nov 01 19:04:53.144665 n-d-863052-2 devstack@n-api.service[121403]: X-Roles: member,reader Nov 01 19:04:53.144665 n-d-863052-2 devstack@n-api.service[121403]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/a127ffbd2c3940debcffd4ca03e34c73"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/a127ffbd2c3940debcffd4ca03e34c73"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_a127ffbd2c3940debcffd4ca03e34c73", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/a127ffbd2c3940debcffd4ca03e34c73"}]}] Nov 01 19:04:53.144665 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant: tempest-ServicesAdminNegativeTestJSON-611076768 Nov 01 19:04:53.144665 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant-Id: a127ffbd2c3940debcffd4ca03e34c73 Nov 01 19:04:53.144665 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant-Name: tempest-ServicesAdminNegativeTestJSON-611076768 Nov 01 19:04:53.144665 n-d-863052-2 devstack@n-api.service[121403]: X-User: tempest-ServicesAdminNegativeTestJSON-611076768-project Nov 01 19:04:53.144665 n-d-863052-2 devstack@n-api.service[121403]: X-User-Domain-Id: default Nov 01 19:04:53.144665 n-d-863052-2 devstack@n-api.service[121403]: X-User-Domain-Name: Default Nov 01 19:04:53.144665 n-d-863052-2 devstack@n-api.service[121403]: X-User-Id: dec4fd56817e45bf8cff334f294c9f1b Nov 01 19:04:53.144665 n-d-863052-2 devstack@n-api.service[121403]: X-User-Name: tempest-ServicesAdminNegativeTestJSON-611076768-project Nov 01 19:04:53.144665 n-d-863052-2 devstack@n-api.service[121403]: method: > Nov 01 19:04:53.144665 n-d-863052-2 devstack@n-api.service[121403]: exception: Policy doesn't allow os_compute_api:os-services:list to be performed. Nov 01 19:04:53.144665 n-d-863052-2 devstack@n-api.service[121403]: action_args: {} Nov 01 19:04:53.144665 n-d-863052-2 devstack@n-api.service[121403]: {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 01 19:04:53.144665 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:04:53.144665 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:04:53.144665 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:04:53.144665 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 01 19:04:53.144665 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 01 19:04:53.144665 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Nov 01 19:04:53.144665 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 01 19:04:53.144665 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Nov 01 19:04:53.144665 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 01 19:04:53.144665 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 01 19:04:53.144665 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 01 19:04:53.144665 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 384, in index Nov 01 19:04:53.144665 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi context.can(services_policies.BASE_POLICY_NAME % 'list', target={}) Nov 01 19:04:53.144665 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Nov 01 19:04:53.144665 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Nov 01 19:04:53.144665 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Nov 01 19:04:53.144665 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Nov 01 19:04:53.144665 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 01 19:04:53.144665 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 01 19:04:53.144665 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 01 19:04:53.144665 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise self.value Nov 01 19:04:53.144665 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Nov 01 19:04:53.144665 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Nov 01 19:04:53.144665 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Nov 01 19:04:53.144665 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return self.enforce( Nov 01 19:04:53.144665 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Nov 01 19:04:53.144665 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Nov 01 19:04:53.144665 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-services:list to be performed. Nov 01 19:04:53.144665 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:04:53.149023 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:04:53.149023 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:04:53.149023 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:04:53.149023 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:04:53.149023 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:04:53.149023 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Nov 01 19:04:53.149023 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Nov 01 19:04:53.149023 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-services:list to be performed. Nov 01 19:04:53.149023 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:04:53.154623 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-96dadf68-f442-45a7-bd55-cd56058bae1a tempest-ServicesAdminNegativeTestJSON-611076768 tempest-ServicesAdminNegativeTestJSON-611076768-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=121403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 01 19:04:53.159973 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-96dadf68-f442-45a7-bd55-cd56058bae1a tempest-ServicesAdminNegativeTestJSON-611076768 tempest-ServicesAdminNegativeTestJSON-611076768-project] 10.222.0.13 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.1 time: 0.272431 Nov 01 19:04:53.162751 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1394/2761] 10.222.0.13 () {58 vars in 1137 bytes} [Tue Nov 1 19:04:52 2022] GET /compute/v2.1/os-services => generated 112 bytes in 278 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Nov 01 19:04:53.201466 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-3b812691-5f3a-4852-9995-3c72d83a8f5a tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:04:53.205797 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-3b812691-5f3a-4852-9995-3c72d83a8f5a tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] [instance: 3029f3c1-4f32-4f6b-963c-16f65b6dff3c] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:04:53.265785 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-3b812691-5f3a-4852-9995-3c72d83a8f5a tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:04:53.273350 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-3b812691-5f3a-4852-9995-3c72d83a8f5a tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:04:53.277218 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-3b812691-5f3a-4852-9995-3c72d83a8f5a tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:04:53.280302 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-3b812691-5f3a-4852-9995-3c72d83a8f5a tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:04:53.280884 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-3b812691-5f3a-4852-9995-3c72d83a8f5a tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:04:53.282633 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-3b812691-5f3a-4852-9995-3c72d83a8f5a tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:04:54.491707 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-3b812691-5f3a-4852-9995-3c72d83a8f5a tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '790f3f1566b7464aaca19d4d05c0942e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33e3d319293c46b6af2f728a50586906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:04:54.503289 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-3b812691-5f3a-4852-9995-3c72d83a8f5a tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] 10.222.0.13 "GET /compute/v2.1/servers/3029f3c1-4f32-4f6b-963c-16f65b6dff3c" status: 200 len: 1366 microversion: 2.1 time: 1.335732 Nov 01 19:04:54.507870 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1395/2762] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:04:53 2022] GET /compute/v2.1/servers/3029f3c1-4f32-4f6b-963c-16f65b6dff3c => generated 1366 bytes in 1344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:04:54.518625 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [req-7bee6fc1-9d67-400d-9ca5-a911ef0a42f6 req-5f52c621-c96b-4705-adaa-c31e5fe1b58c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e760fc87-dcc8-47ae-8bf1-014248a1c1b4", "tag": "5094f8e9-8282-4248-bab9-4fe9dd2f7e98"}]} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:04:54.540451 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-7bee6fc1-9d67-400d-9ca5-a911ef0a42f6 req-5f52c621-c96b-4705-adaa-c31e5fe1b58c service nova] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:04:54.541768 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-7bee6fc1-9d67-400d-9ca5-a911ef0a42f6 req-5f52c621-c96b-4705-adaa-c31e5fe1b58c service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:04:54.543970 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-7bee6fc1-9d67-400d-9ca5-a911ef0a42f6 req-5f52c621-c96b-4705-adaa-c31e5fe1b58c service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:04:54.551550 n-d-863052-2 devstack@n-api.service[121403]: DEBUG dbcounter [-] [121403] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 19:04:54.576339 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.compute.server_external_events [req-7bee6fc1-9d67-400d-9ca5-a911ef0a42f6 req-5f52c621-c96b-4705-adaa-c31e5fe1b58c service nova] Creating event network-changed:5094f8e9-8282-4248-bab9-4fe9dd2f7e98 for instance e760fc87-dcc8-47ae-8bf1-014248a1c1b4 on n-h1-863052-2 Nov 01 19:04:54.587411 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [req-7bee6fc1-9d67-400d-9ca5-a911ef0a42f6 req-5f52c621-c96b-4705-adaa-c31e5fe1b58c service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077450 Nov 01 19:04:54.595819 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1396/2763] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Nov 1 19:04:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:04:54.605995 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-e61b2e27-9cdb-4fd3-9677-098f859def89 tempest-ServersAaction247Test-833529606 tempest-ServersAaction247Test-833529606-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:04:54.606716 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-e61b2e27-9cdb-4fd3-9677-098f859def89 tempest-ServersAaction247Test-833529606 tempest-ServersAaction247Test-833529606-project] [instance: 7e5516b1-da8c-450d-8fb3-cabb5a5f873f] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:04:54.619976 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-e61b2e27-9cdb-4fd3-9677-098f859def89 tempest-ServersAaction247Test-833529606 tempest-ServersAaction247Test-833529606-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:04:54.621667 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-e61b2e27-9cdb-4fd3-9677-098f859def89 tempest-ServersAaction247Test-833529606 tempest-ServersAaction247Test-833529606-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:04:54.622304 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-e61b2e27-9cdb-4fd3-9677-098f859def89 tempest-ServersAaction247Test-833529606 tempest-ServersAaction247Test-833529606-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:04:54.623403 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-e61b2e27-9cdb-4fd3-9677-098f859def89 tempest-ServersAaction247Test-833529606 tempest-ServersAaction247Test-833529606-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:04:54.624021 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-e61b2e27-9cdb-4fd3-9677-098f859def89 tempest-ServersAaction247Test-833529606 tempest-ServersAaction247Test-833529606-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:04:54.624868 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-e61b2e27-9cdb-4fd3-9677-098f859def89 tempest-ServersAaction247Test-833529606 tempest-ServersAaction247Test-833529606-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:04:54.691245 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-e61b2e27-9cdb-4fd3-9677-098f859def89 tempest-ServersAaction247Test-833529606 tempest-ServersAaction247Test-833529606-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:04:54.691984 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-e61b2e27-9cdb-4fd3-9677-098f859def89 tempest-ServersAaction247Test-833529606 tempest-ServersAaction247Test-833529606-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:04:54.692568 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-e61b2e27-9cdb-4fd3-9677-098f859def89 tempest-ServersAaction247Test-833529606 tempest-ServersAaction247Test-833529606-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:04:54.693610 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.objects.instance [None req-e61b2e27-9cdb-4fd3-9677-098f859def89 tempest-ServersAaction247Test-833529606 tempest-ServersAaction247Test-833529606-project] Lazy-loading 'fault' on Instance uuid 7e5516b1-da8c-450d-8fb3-cabb5a5f873f {{(pid=121403) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 01 19:04:54.777205 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-e61b2e27-9cdb-4fd3-9677-098f859def89 tempest-ServersAaction247Test-833529606 tempest-ServersAaction247Test-833529606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dd5e9050cec406da21f51f0e0e6c81f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d45c12d3114f499215931518794ea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:04:54.790819 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-e61b2e27-9cdb-4fd3-9677-098f859def89 tempest-ServersAaction247Test-833529606 tempest-ServersAaction247Test-833529606-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7dd5e9050cec406da21f51f0e0e6c81f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d45c12d3114f499215931518794ea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:04:54.798576 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-e61b2e27-9cdb-4fd3-9677-098f859def89 tempest-ServersAaction247Test-833529606 tempest-ServersAaction247Test-833529606-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7dd5e9050cec406da21f51f0e0e6c81f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d45c12d3114f499215931518794ea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:04:54.802490 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-e61b2e27-9cdb-4fd3-9677-098f859def89 tempest-ServersAaction247Test-833529606 tempest-ServersAaction247Test-833529606-project] 10.222.0.13 "GET /compute/v2.1/servers/7e5516b1-da8c-450d-8fb3-cabb5a5f873f" status: 200 len: 1370 microversion: 2.47 time: 0.202816 Nov 01 19:04:54.803089 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1397/2764] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 19:04:54 2022] GET /compute/v2.1/servers/7e5516b1-da8c-450d-8fb3-cabb5a5f873f => generated 1370 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 19:04:54.827794 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-5ecbb798-30ef-4b8b-93cf-2a53a34434ef tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:04:54.829036 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-5ecbb798-30ef-4b8b-93cf-2a53a34434ef tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] [instance: b58b3cb6-ebdc-4705-b308-4e804cd52bce] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:04:54.852245 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-5ecbb798-30ef-4b8b-93cf-2a53a34434ef tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:04:54.852831 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-5ecbb798-30ef-4b8b-93cf-2a53a34434ef tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:04:54.853291 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-5ecbb798-30ef-4b8b-93cf-2a53a34434ef tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:04:54.854237 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-5ecbb798-30ef-4b8b-93cf-2a53a34434ef tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:04:54.857310 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-5ecbb798-30ef-4b8b-93cf-2a53a34434ef tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:04:54.858244 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-5ecbb798-30ef-4b8b-93cf-2a53a34434ef tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:04:55.015945 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-5ecbb798-30ef-4b8b-93cf-2a53a34434ef tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05d6a1722dfa4e959aeb14d601e43b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b5d812eff94e2f89d4705d7e7d5f3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:04:55.029290 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-5ecbb798-30ef-4b8b-93cf-2a53a34434ef tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] 10.222.0.13 "GET /compute/v2.1/servers/b58b3cb6-ebdc-4705-b308-4e804cd52bce" status: 200 len: 1276 microversion: 2.1 time: 0.224805 Nov 01 19:04:55.030220 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1398/2765] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:04:54 2022] GET /compute/v2.1/servers/b58b3cb6-ebdc-4705-b308-4e804cd52bce => generated 1276 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:04:55.132373 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-27e89cc6-de30-42fa-a913-fc95d3d2d2f9 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '058480d92c9b4ab4af6815d0438a65c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee9dc49b89143f781e4ab30296e4d01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:04:55.142219 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-27e89cc6-de30-42fa-a913-fc95d3d2d2f9 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] 10.222.0.13 "GET /compute/v2.1/servers/e760fc87-dcc8-47ae-8bf1-014248a1c1b4" status: 200 len: 1315 microversion: 2.1 time: 2.953571 Nov 01 19:04:55.150725 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1368/2766] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:04:52 2022] GET /compute/v2.1/servers/e760fc87-dcc8-47ae-8bf1-014248a1c1b4 => generated 1315 bytes in 2963 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:04:55.540886 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-bff2cc66-f3b0-4831-adc5-5945fa5a7a65 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:04:55.541551 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-bff2cc66-f3b0-4831-adc5-5945fa5a7a65 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] [instance: 3029f3c1-4f32-4f6b-963c-16f65b6dff3c] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:04:55.559526 n-d-863052-2 devstack@n-api.service[121403]: DEBUG dbcounter [-] [121403] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=121403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 19:04:55.570550 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-bff2cc66-f3b0-4831-adc5-5945fa5a7a65 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:04:55.571491 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-bff2cc66-f3b0-4831-adc5-5945fa5a7a65 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:04:55.571934 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-bff2cc66-f3b0-4831-adc5-5945fa5a7a65 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:04:55.572843 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-bff2cc66-f3b0-4831-adc5-5945fa5a7a65 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:04:55.576052 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-bff2cc66-f3b0-4831-adc5-5945fa5a7a65 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:04:55.576515 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-bff2cc66-f3b0-4831-adc5-5945fa5a7a65 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:04:55.832418 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-af8839be-7d0e-46f2-b48b-5b0f7977683f tempest-ServersAaction247Test-833529606 tempest-ServersAaction247Test-833529606-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:04:55.833344 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-af8839be-7d0e-46f2-b48b-5b0f7977683f tempest-ServersAaction247Test-833529606 tempest-ServersAaction247Test-833529606-project] [instance: 7e5516b1-da8c-450d-8fb3-cabb5a5f873f] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:04:55.864616 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-af8839be-7d0e-46f2-b48b-5b0f7977683f tempest-ServersAaction247Test-833529606 tempest-ServersAaction247Test-833529606-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:04:55.872890 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-af8839be-7d0e-46f2-b48b-5b0f7977683f tempest-ServersAaction247Test-833529606 tempest-ServersAaction247Test-833529606-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:04:55.873699 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-af8839be-7d0e-46f2-b48b-5b0f7977683f tempest-ServersAaction247Test-833529606 tempest-ServersAaction247Test-833529606-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:04:55.874630 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-af8839be-7d0e-46f2-b48b-5b0f7977683f tempest-ServersAaction247Test-833529606 tempest-ServersAaction247Test-833529606-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:04:55.875869 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-af8839be-7d0e-46f2-b48b-5b0f7977683f tempest-ServersAaction247Test-833529606 tempest-ServersAaction247Test-833529606-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:04:55.876847 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-af8839be-7d0e-46f2-b48b-5b0f7977683f tempest-ServersAaction247Test-833529606 tempest-ServersAaction247Test-833529606-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:04:55.918713 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.wsgi [None req-af8839be-7d0e-46f2-b48b-5b0f7977683f tempest-ServersAaction247Test-833529606 tempest-ServersAaction247Test-833529606-project] HTTP exception thrown: Instance 7e5516b1-da8c-450d-8fb3-cabb5a5f873f could not be found. Nov 01 19:04:55.921529 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-af8839be-7d0e-46f2-b48b-5b0f7977683f tempest-ServersAaction247Test-833529606 tempest-ServersAaction247Test-833529606-project] Request method failure captured: Nov 01 19:04:55.921529 n-d-863052-2 devstack@n-api.service[121402]: request: GET /compute/v2.1/servers/7e5516b1-da8c-450d-8fb3-cabb5a5f873f HTTP/1.1 Nov 01 19:04:55.921529 n-d-863052-2 devstack@n-api.service[121402]: Accept: application/json Nov 01 19:04:55.921529 n-d-863052-2 devstack@n-api.service[121402]: Accept-Encoding: identity Nov 01 19:04:55.921529 n-d-863052-2 devstack@n-api.service[121402]: Connection: close Nov 01 19:04:55.921529 n-d-863052-2 devstack@n-api.service[121402]: Content-Length: 0 Nov 01 19:04:55.921529 n-d-863052-2 devstack@n-api.service[121402]: Content-Type: application/json Nov 01 19:04:55.921529 n-d-863052-2 devstack@n-api.service[121402]: Host: 10.222.0.13 Nov 01 19:04:55.921529 n-d-863052-2 devstack@n-api.service[121402]: Openstack-System-Scope: None Nov 01 19:04:55.921529 n-d-863052-2 devstack@n-api.service[121402]: User-Agent: python-urllib3/1.26.12 Nov 01 19:04:55.921529 n-d-863052-2 devstack@n-api.service[121402]: X-Auth-Token: gAAAAABjYW3Fb3W_S1N71DIP6NMOA9wwdcjedkIkcjWVTSOIyvbhkTfuzRSLTEmMSzASiepiWlrfMlArGKGZ3HA-FRR6zQZFY5CRpWAGXSJsK5-alpixAb-2_ERKlI0YROLsqmMmLADPae5PZFF06bdnxXXETZrRytkNAqJTuMrWRhMNc_WVU9g Nov 01 19:04:55.921529 n-d-863052-2 devstack@n-api.service[121402]: X-Domain-Id: None Nov 01 19:04:55.921529 n-d-863052-2 devstack@n-api.service[121402]: X-Domain-Name: None Nov 01 19:04:55.921529 n-d-863052-2 devstack@n-api.service[121402]: X-Identity-Status: Confirmed Nov 01 19:04:55.921529 n-d-863052-2 devstack@n-api.service[121402]: X-Is-Admin-Project: True Nov 01 19:04:55.921529 n-d-863052-2 devstack@n-api.service[121402]: X-Openstack-Nova-Api-Version: 2.47 Nov 01 19:04:55.921529 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Domain-Id: default Nov 01 19:04:55.921529 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Domain-Name: Default Nov 01 19:04:55.921529 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Id: b0d45c12d3114f499215931518794ea2 Nov 01 19:04:55.921529 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Name: tempest-ServersAaction247Test-833529606 Nov 01 19:04:55.921529 n-d-863052-2 devstack@n-api.service[121402]: X-Role: member,reader Nov 01 19:04:55.921529 n-d-863052-2 devstack@n-api.service[121402]: X-Roles: member,reader Nov 01 19:04:55.921529 n-d-863052-2 devstack@n-api.service[121402]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/b0d45c12d3114f499215931518794ea2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/b0d45c12d3114f499215931518794ea2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_b0d45c12d3114f499215931518794ea2", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/b0d45c12d3114f499215931518794ea2"}]}] Nov 01 19:04:55.921529 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant: tempest-ServersAaction247Test-833529606 Nov 01 19:04:55.921529 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant-Id: b0d45c12d3114f499215931518794ea2 Nov 01 19:04:55.921529 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant-Name: tempest-ServersAaction247Test-833529606 Nov 01 19:04:55.921529 n-d-863052-2 devstack@n-api.service[121402]: X-User: tempest-ServersAaction247Test-833529606-project Nov 01 19:04:55.921529 n-d-863052-2 devstack@n-api.service[121402]: X-User-Domain-Id: default Nov 01 19:04:55.921529 n-d-863052-2 devstack@n-api.service[121402]: X-User-Domain-Name: Default Nov 01 19:04:55.921529 n-d-863052-2 devstack@n-api.service[121402]: X-User-Id: 7dd5e9050cec406da21f51f0e0e6c81f Nov 01 19:04:55.921529 n-d-863052-2 devstack@n-api.service[121402]: X-User-Name: tempest-ServersAaction247Test-833529606-project Nov 01 19:04:55.921529 n-d-863052-2 devstack@n-api.service[121402]: method: > Nov 01 19:04:55.921529 n-d-863052-2 devstack@n-api.service[121402]: exception: Instance 7e5516b1-da8c-450d-8fb3-cabb5a5f873f could not be found. Nov 01 19:04:55.921529 n-d-863052-2 devstack@n-api.service[121402]: action_args: {'id': '7e5516b1-da8c-450d-8fb3-cabb5a5f873f'} Nov 01 19:04:55.921529 n-d-863052-2 devstack@n-api.service[121402]: {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 01 19:04:55.921529 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:04:55.921529 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 01 19:04:55.921529 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 01 19:04:55.921529 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 01 19:04:55.921529 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 01 19:04:55.921529 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 01 19:04:55.921529 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 01 19:04:55.921529 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 01 19:04:55.921529 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 01 19:04:55.921529 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7e5516b1-da8c-450d-8fb3-cabb5a5f873f could not be found. Nov 01 19:04:55.921529 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:04:55.921529 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:04:55.921529 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:04:55.921529 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:04:55.921529 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:04:55.921529 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:04:55.921529 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 01 19:04:55.921529 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 01 19:04:55.921529 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 01 19:04:55.921529 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 01 19:04:55.921529 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 01 19:04:55.921529 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 01 19:04:55.921529 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 01 19:04:55.921529 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 01 19:04:55.921529 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 01 19:04:55.921529 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 01 19:04:55.921529 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7e5516b1-da8c-450d-8fb3-cabb5a5f873f could not be found. Nov 01 19:04:55.921529 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:04:55.921529 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:04:55.921529 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:04:55.926681 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:04:55.926681 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:04:55.926681 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:04:55.926681 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 01 19:04:55.926681 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 01 19:04:55.926681 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7e5516b1-da8c-450d-8fb3-cabb5a5f873f could not be found. Nov 01 19:04:55.926681 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:04:55.928207 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-af8839be-7d0e-46f2-b48b-5b0f7977683f tempest-ServersAaction247Test-833529606 tempest-ServersAaction247Test-833529606-project] Returning 404 to user: Instance 7e5516b1-da8c-450d-8fb3-cabb5a5f873f could not be found. {{(pid=121402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 01 19:04:55.930607 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-af8839be-7d0e-46f2-b48b-5b0f7977683f tempest-ServersAaction247Test-833529606 tempest-ServersAaction247Test-833529606-project] 10.222.0.13 "GET /compute/v2.1/servers/7e5516b1-da8c-450d-8fb3-cabb5a5f873f" status: 404 len: 111 microversion: 2.47 time: 0.104351 Nov 01 19:04:55.949412 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1369/2767] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 19:04:55 2022] GET /compute/v2.1/servers/7e5516b1-da8c-450d-8fb3-cabb5a5f873f => generated 111 bytes in 116 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 01 19:04:56.067321 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-19c1cf89-4c4c-481f-a7df-51d77c0a328f tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:04:56.067321 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-19c1cf89-4c4c-481f-a7df-51d77c0a328f tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] [instance: b58b3cb6-ebdc-4705-b308-4e804cd52bce] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:04:56.088510 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-19c1cf89-4c4c-481f-a7df-51d77c0a328f tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:04:56.093360 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-19c1cf89-4c4c-481f-a7df-51d77c0a328f tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:04:56.095290 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-19c1cf89-4c4c-481f-a7df-51d77c0a328f tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:04:56.097409 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-19c1cf89-4c4c-481f-a7df-51d77c0a328f tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:04:56.103554 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-19c1cf89-4c4c-481f-a7df-51d77c0a328f tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:04:56.104880 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-19c1cf89-4c4c-481f-a7df-51d77c0a328f tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:04:56.359807 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-bff2cc66-f3b0-4831-adc5-5945fa5a7a65 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '790f3f1566b7464aaca19d4d05c0942e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33e3d319293c46b6af2f728a50586906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:04:56.372447 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-bff2cc66-f3b0-4831-adc5-5945fa5a7a65 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] 10.222.0.13 "GET /compute/v2.1/servers/3029f3c1-4f32-4f6b-963c-16f65b6dff3c" status: 200 len: 1366 microversion: 2.1 time: 0.844810 Nov 01 19:04:56.393614 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1399/2768] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:04:55 2022] GET /compute/v2.1/servers/3029f3c1-4f32-4f6b-963c-16f65b6dff3c => generated 1366 bytes in 866 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:04:56.416665 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-5906b300-f8ec-49f4-b730-b2e2f008a5e2 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:04:56.421314 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-5906b300-f8ec-49f4-b730-b2e2f008a5e2 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] [instance: e760fc87-dcc8-47ae-8bf1-014248a1c1b4] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:04:56.447396 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-5906b300-f8ec-49f4-b730-b2e2f008a5e2 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:04:56.447787 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-5906b300-f8ec-49f4-b730-b2e2f008a5e2 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:04:56.448451 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-5906b300-f8ec-49f4-b730-b2e2f008a5e2 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:04:56.449381 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-5906b300-f8ec-49f4-b730-b2e2f008a5e2 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:04:56.450116 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-5906b300-f8ec-49f4-b730-b2e2f008a5e2 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:04:56.450914 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-5906b300-f8ec-49f4-b730-b2e2f008a5e2 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:04:56.591940 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-19c1cf89-4c4c-481f-a7df-51d77c0a328f tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05d6a1722dfa4e959aeb14d601e43b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b5d812eff94e2f89d4705d7e7d5f3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:04:56.601283 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-19c1cf89-4c4c-481f-a7df-51d77c0a328f tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] 10.222.0.13 "GET /compute/v2.1/servers/b58b3cb6-ebdc-4705-b308-4e804cd52bce" status: 200 len: 1276 microversion: 2.1 time: 0.545632 Nov 01 19:04:56.605757 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1370/2769] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:04:56 2022] GET /compute/v2.1/servers/b58b3cb6-ebdc-4705-b308-4e804cd52bce => generated 1276 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:04:56.663766 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [req-9e55a7bf-25d1-4b73-8117-85c9ff2300c9 req-f52da221-3a9b-4034-b52c-fca5540eee28 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3029f3c1-4f32-4f6b-963c-16f65b6dff3c", "tag": "840ef8a7-6bc6-4d48-932b-14a3209a45e7"}]} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:04:56.696141 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-9e55a7bf-25d1-4b73-8117-85c9ff2300c9 req-f52da221-3a9b-4034-b52c-fca5540eee28 service nova] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:04:56.696847 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-9e55a7bf-25d1-4b73-8117-85c9ff2300c9 req-f52da221-3a9b-4034-b52c-fca5540eee28 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:04:56.697389 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-9e55a7bf-25d1-4b73-8117-85c9ff2300c9 req-f52da221-3a9b-4034-b52c-fca5540eee28 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:04:56.729840 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.compute.server_external_events [req-9e55a7bf-25d1-4b73-8117-85c9ff2300c9 req-f52da221-3a9b-4034-b52c-fca5540eee28 service nova] Creating event network-changed:840ef8a7-6bc6-4d48-932b-14a3209a45e7 for instance 3029f3c1-4f32-4f6b-963c-16f65b6dff3c on n-h1-863052-2 Nov 01 19:04:56.746394 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [req-9e55a7bf-25d1-4b73-8117-85c9ff2300c9 req-f52da221-3a9b-4034-b52c-fca5540eee28 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093232 Nov 01 19:04:56.748271 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1371/2770] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Nov 1 19:04:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 01 19:04:57.097007 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-5906b300-f8ec-49f4-b730-b2e2f008a5e2 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '058480d92c9b4ab4af6815d0438a65c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee9dc49b89143f781e4ab30296e4d01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:04:57.107306 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-5906b300-f8ec-49f4-b730-b2e2f008a5e2 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] 10.222.0.13 "GET /compute/v2.1/servers/e760fc87-dcc8-47ae-8bf1-014248a1c1b4" status: 200 len: 1315 microversion: 2.1 time: 0.709934 Nov 01 19:04:57.121766 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1400/2771] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:04:56 2022] GET /compute/v2.1/servers/e760fc87-dcc8-47ae-8bf1-014248a1c1b4 => generated 1315 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:04:57.400825 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-17d87c2a-1307-4cc7-9fe4-a94615f32864 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:04:57.401877 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-17d87c2a-1307-4cc7-9fe4-a94615f32864 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] [instance: 3029f3c1-4f32-4f6b-963c-16f65b6dff3c] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:04:57.415188 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-17d87c2a-1307-4cc7-9fe4-a94615f32864 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:04:57.415684 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-17d87c2a-1307-4cc7-9fe4-a94615f32864 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:04:57.426464 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-17d87c2a-1307-4cc7-9fe4-a94615f32864 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:04:57.431743 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-17d87c2a-1307-4cc7-9fe4-a94615f32864 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:04:57.432377 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-17d87c2a-1307-4cc7-9fe4-a94615f32864 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:04:57.438863 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-17d87c2a-1307-4cc7-9fe4-a94615f32864 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:04:57.629375 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-b49d0c21-7aa1-4920-8d6a-4098835f9ca7 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:04:57.630420 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-b49d0c21-7aa1-4920-8d6a-4098835f9ca7 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] [instance: b58b3cb6-ebdc-4705-b308-4e804cd52bce] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:04:57.643457 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-b49d0c21-7aa1-4920-8d6a-4098835f9ca7 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:04:57.645655 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-b49d0c21-7aa1-4920-8d6a-4098835f9ca7 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:04:57.646618 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-b49d0c21-7aa1-4920-8d6a-4098835f9ca7 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:04:57.647572 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-b49d0c21-7aa1-4920-8d6a-4098835f9ca7 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:04:57.650637 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-b49d0c21-7aa1-4920-8d6a-4098835f9ca7 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:04:57.651387 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-b49d0c21-7aa1-4920-8d6a-4098835f9ca7 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:04:57.944114 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-b49d0c21-7aa1-4920-8d6a-4098835f9ca7 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05d6a1722dfa4e959aeb14d601e43b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b5d812eff94e2f89d4705d7e7d5f3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:04:57.955569 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-b49d0c21-7aa1-4920-8d6a-4098835f9ca7 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] 10.222.0.13 "GET /compute/v2.1/servers/b58b3cb6-ebdc-4705-b308-4e804cd52bce" status: 200 len: 1276 microversion: 2.1 time: 0.329780 Nov 01 19:04:57.976437 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1401/2772] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:04:57 2022] GET /compute/v2.1/servers/b58b3cb6-ebdc-4705-b308-4e804cd52bce => generated 1276 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:04:58.032791 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-17d87c2a-1307-4cc7-9fe4-a94615f32864 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '790f3f1566b7464aaca19d4d05c0942e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33e3d319293c46b6af2f728a50586906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:04:58.051668 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-17d87c2a-1307-4cc7-9fe4-a94615f32864 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] 10.222.0.13 "GET /compute/v2.1/servers/3029f3c1-4f32-4f6b-963c-16f65b6dff3c" status: 200 len: 1366 microversion: 2.1 time: 0.655932 Nov 01 19:04:58.053172 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1372/2773] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:04:57 2022] GET /compute/v2.1/servers/3029f3c1-4f32-4f6b-963c-16f65b6dff3c => generated 1366 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:04:58.133079 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-18b049de-c81c-437b-944b-d8853a106721 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:04:58.133801 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-18b049de-c81c-437b-944b-d8853a106721 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] [instance: e760fc87-dcc8-47ae-8bf1-014248a1c1b4] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:04:58.148294 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-18b049de-c81c-437b-944b-d8853a106721 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:04:58.148984 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-18b049de-c81c-437b-944b-d8853a106721 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:04:58.149435 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-18b049de-c81c-437b-944b-d8853a106721 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:04:58.150169 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-18b049de-c81c-437b-944b-d8853a106721 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:04:58.150631 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-18b049de-c81c-437b-944b-d8853a106721 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:04:58.151056 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-18b049de-c81c-437b-944b-d8853a106721 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:04:58.791281 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-18b049de-c81c-437b-944b-d8853a106721 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '058480d92c9b4ab4af6815d0438a65c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee9dc49b89143f781e4ab30296e4d01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:04:58.817801 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-18b049de-c81c-437b-944b-d8853a106721 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] 10.222.0.13 "GET /compute/v2.1/servers/e760fc87-dcc8-47ae-8bf1-014248a1c1b4" status: 200 len: 1315 microversion: 2.1 time: 0.677538 Nov 01 19:04:58.828847 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1402/2774] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:04:58 2022] GET /compute/v2.1/servers/e760fc87-dcc8-47ae-8bf1-014248a1c1b4 => generated 1315 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:04:59.000909 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-9032a502-898b-4dcc-9657-23038af7d13d tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:04:59.001780 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-9032a502-898b-4dcc-9657-23038af7d13d tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] [instance: b58b3cb6-ebdc-4705-b308-4e804cd52bce] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:04:59.018953 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-9032a502-898b-4dcc-9657-23038af7d13d tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:04:59.021643 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-9032a502-898b-4dcc-9657-23038af7d13d tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:04:59.022421 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-9032a502-898b-4dcc-9657-23038af7d13d tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:04:59.025078 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-9032a502-898b-4dcc-9657-23038af7d13d tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:04:59.026089 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-9032a502-898b-4dcc-9657-23038af7d13d tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:04:59.027496 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-9032a502-898b-4dcc-9657-23038af7d13d tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:04:59.081030 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-70289169-9a0a-4aa0-a5cf-379baf9d4ef4 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:04:59.082149 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-70289169-9a0a-4aa0-a5cf-379baf9d4ef4 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] [instance: 3029f3c1-4f32-4f6b-963c-16f65b6dff3c] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:04:59.099710 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-70289169-9a0a-4aa0-a5cf-379baf9d4ef4 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:04:59.101162 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-70289169-9a0a-4aa0-a5cf-379baf9d4ef4 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:04:59.105848 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-70289169-9a0a-4aa0-a5cf-379baf9d4ef4 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:04:59.111711 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-70289169-9a0a-4aa0-a5cf-379baf9d4ef4 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:04:59.112347 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-70289169-9a0a-4aa0-a5cf-379baf9d4ef4 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:04:59.112868 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-70289169-9a0a-4aa0-a5cf-379baf9d4ef4 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:04:59.446537 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-70289169-9a0a-4aa0-a5cf-379baf9d4ef4 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '790f3f1566b7464aaca19d4d05c0942e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33e3d319293c46b6af2f728a50586906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:04:59.456599 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-70289169-9a0a-4aa0-a5cf-379baf9d4ef4 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] 10.222.0.13 "GET /compute/v2.1/servers/3029f3c1-4f32-4f6b-963c-16f65b6dff3c" status: 200 len: 1366 microversion: 2.1 time: 0.384081 Nov 01 19:04:59.473850 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1403/2775] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:04:59 2022] GET /compute/v2.1/servers/3029f3c1-4f32-4f6b-963c-16f65b6dff3c => generated 1366 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:04:59.843448 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-b89e68fc-4e81-42fe-a4b4-4116b996e345 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:04:59.844599 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-b89e68fc-4e81-42fe-a4b4-4116b996e345 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] [instance: e760fc87-dcc8-47ae-8bf1-014248a1c1b4] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:04:59.857834 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-b89e68fc-4e81-42fe-a4b4-4116b996e345 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:04:59.858567 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-b89e68fc-4e81-42fe-a4b4-4116b996e345 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:04:59.859464 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-b89e68fc-4e81-42fe-a4b4-4116b996e345 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:04:59.861010 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-b89e68fc-4e81-42fe-a4b4-4116b996e345 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:04:59.869326 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-b89e68fc-4e81-42fe-a4b4-4116b996e345 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:04:59.869782 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-b89e68fc-4e81-42fe-a4b4-4116b996e345 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:05:00.077954 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-9032a502-898b-4dcc-9657-23038af7d13d tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05d6a1722dfa4e959aeb14d601e43b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b5d812eff94e2f89d4705d7e7d5f3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:05:00.095017 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-9032a502-898b-4dcc-9657-23038af7d13d tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] 10.222.0.13 "GET /compute/v2.1/servers/b58b3cb6-ebdc-4705-b308-4e804cd52bce" status: 200 len: 1318 microversion: 2.1 time: 1.098737 Nov 01 19:05:00.097159 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1373/2776] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:04:58 2022] GET /compute/v2.1/servers/b58b3cb6-ebdc-4705-b308-4e804cd52bce => generated 1318 bytes in 1103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:05:00.138933 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-b89e68fc-4e81-42fe-a4b4-4116b996e345 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '058480d92c9b4ab4af6815d0438a65c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee9dc49b89143f781e4ab30296e4d01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:05:00.149426 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-b89e68fc-4e81-42fe-a4b4-4116b996e345 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] 10.222.0.13 "GET /compute/v2.1/servers/e760fc87-dcc8-47ae-8bf1-014248a1c1b4" status: 200 len: 1315 microversion: 2.1 time: 0.309362 Nov 01 19:05:00.150438 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1404/2777] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:04:59 2022] GET /compute/v2.1/servers/e760fc87-dcc8-47ae-8bf1-014248a1c1b4 => generated 1315 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 19:05:00.486967 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-2a79f8d4-4d79-447a-a723-4d9d7e7b3a97 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:05:00.487594 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-2a79f8d4-4d79-447a-a723-4d9d7e7b3a97 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] [instance: 3029f3c1-4f32-4f6b-963c-16f65b6dff3c] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:05:00.495272 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2a79f8d4-4d79-447a-a723-4d9d7e7b3a97 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:05:00.496320 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2a79f8d4-4d79-447a-a723-4d9d7e7b3a97 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:05:00.497067 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2a79f8d4-4d79-447a-a723-4d9d7e7b3a97 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:05:00.498623 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2a79f8d4-4d79-447a-a723-4d9d7e7b3a97 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:05:00.499263 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2a79f8d4-4d79-447a-a723-4d9d7e7b3a97 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:05:00.499881 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2a79f8d4-4d79-447a-a723-4d9d7e7b3a97 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:05:01.133989 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-2a79f8d4-4d79-447a-a723-4d9d7e7b3a97 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '790f3f1566b7464aaca19d4d05c0942e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33e3d319293c46b6af2f728a50586906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:05:01.137842 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-1eb137f6-0665-47ec-b76e-e11008efac47 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:05:01.140165 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-1eb137f6-0665-47ec-b76e-e11008efac47 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] [instance: b58b3cb6-ebdc-4705-b308-4e804cd52bce] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:05:01.151033 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-1eb137f6-0665-47ec-b76e-e11008efac47 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:05:01.152103 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-1eb137f6-0665-47ec-b76e-e11008efac47 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:05:01.154975 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-1eb137f6-0665-47ec-b76e-e11008efac47 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:05:01.157037 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-1eb137f6-0665-47ec-b76e-e11008efac47 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:05:01.157977 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-1eb137f6-0665-47ec-b76e-e11008efac47 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:05:01.159584 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-1eb137f6-0665-47ec-b76e-e11008efac47 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:05:01.179897 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-2a79f8d4-4d79-447a-a723-4d9d7e7b3a97 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] 10.222.0.13 "GET /compute/v2.1/servers/3029f3c1-4f32-4f6b-963c-16f65b6dff3c" status: 200 len: 1366 microversion: 2.1 time: 0.697416 Nov 01 19:05:01.180507 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1374/2778] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:05:00 2022] GET /compute/v2.1/servers/3029f3c1-4f32-4f6b-963c-16f65b6dff3c => generated 1366 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:05:01.226946 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-4561343c-e2c6-4bec-a906-7e7b216f4584 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:05:01.232907 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-4561343c-e2c6-4bec-a906-7e7b216f4584 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] [instance: e760fc87-dcc8-47ae-8bf1-014248a1c1b4] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:05:01.257864 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-4561343c-e2c6-4bec-a906-7e7b216f4584 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:05:01.258371 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-4561343c-e2c6-4bec-a906-7e7b216f4584 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:05:01.258816 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-4561343c-e2c6-4bec-a906-7e7b216f4584 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:05:01.259535 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-4561343c-e2c6-4bec-a906-7e7b216f4584 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:05:01.263724 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-4561343c-e2c6-4bec-a906-7e7b216f4584 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:05:01.264279 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-4561343c-e2c6-4bec-a906-7e7b216f4584 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:05:01.275284 n-d-863052-2 devstack@n-api.service[121402]: DEBUG dbcounter [-] [121402] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=121402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 19:05:01.814094 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-1eb137f6-0665-47ec-b76e-e11008efac47 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05d6a1722dfa4e959aeb14d601e43b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b5d812eff94e2f89d4705d7e7d5f3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:05:01.827847 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-1eb137f6-0665-47ec-b76e-e11008efac47 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] 10.222.0.13 "GET /compute/v2.1/servers/b58b3cb6-ebdc-4705-b308-4e804cd52bce" status: 200 len: 1318 microversion: 2.1 time: 0.703543 Nov 01 19:05:01.831235 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1405/2779] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:05:01 2022] GET /compute/v2.1/servers/b58b3cb6-ebdc-4705-b308-4e804cd52bce => generated 1318 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:05:02.208749 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-5a7b316f-a9c6-4f3c-a1d5-c1201c9d2727 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:05:02.210017 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-5a7b316f-a9c6-4f3c-a1d5-c1201c9d2727 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] [instance: 3029f3c1-4f32-4f6b-963c-16f65b6dff3c] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:05:02.229450 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-5a7b316f-a9c6-4f3c-a1d5-c1201c9d2727 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:05:02.231045 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-5a7b316f-a9c6-4f3c-a1d5-c1201c9d2727 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:05:02.232045 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-5a7b316f-a9c6-4f3c-a1d5-c1201c9d2727 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:05:02.237916 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-5a7b316f-a9c6-4f3c-a1d5-c1201c9d2727 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:05:02.238365 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-5a7b316f-a9c6-4f3c-a1d5-c1201c9d2727 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:05:02.240116 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-5a7b316f-a9c6-4f3c-a1d5-c1201c9d2727 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:05:02.399761 n-d-863052-2 devstack@n-api.service[121403]: DEBUG dbcounter [-] [121403] Writing DB stats nova_cell0:SELECT=8 {{(pid=121403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 19:05:02.814769 n-d-863052-2 devstack@n-api.service[121403]: DEBUG dbcounter [-] [121403] Writing DB stats nova_cell0:SELECT=14 {{(pid=121403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 19:05:02.833995 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-5a7b316f-a9c6-4f3c-a1d5-c1201c9d2727 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '790f3f1566b7464aaca19d4d05c0942e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33e3d319293c46b6af2f728a50586906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:05:02.853067 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-5a7b316f-a9c6-4f3c-a1d5-c1201c9d2727 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] 10.222.0.13 "GET /compute/v2.1/servers/3029f3c1-4f32-4f6b-963c-16f65b6dff3c" status: 200 len: 1366 microversion: 2.1 time: 0.648644 Nov 01 19:05:02.854392 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1406/2780] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:05:02 2022] GET /compute/v2.1/servers/3029f3c1-4f32-4f6b-963c-16f65b6dff3c => generated 1366 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 19:05:02.865564 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-df2f8d8f-5d10-4978-ba0c-9e3f3c55f7a7 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:05:02.888322 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-df2f8d8f-5d10-4978-ba0c-9e3f3c55f7a7 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] [instance: b58b3cb6-ebdc-4705-b308-4e804cd52bce] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:05:02.917477 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-df2f8d8f-5d10-4978-ba0c-9e3f3c55f7a7 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:05:02.919909 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-df2f8d8f-5d10-4978-ba0c-9e3f3c55f7a7 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:05:02.921641 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-df2f8d8f-5d10-4978-ba0c-9e3f3c55f7a7 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:05:02.923529 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-df2f8d8f-5d10-4978-ba0c-9e3f3c55f7a7 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:05:02.924524 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-df2f8d8f-5d10-4978-ba0c-9e3f3c55f7a7 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:05:02.925231 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-df2f8d8f-5d10-4978-ba0c-9e3f3c55f7a7 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:05:03.574252 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-4561343c-e2c6-4bec-a906-7e7b216f4584 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '058480d92c9b4ab4af6815d0438a65c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee9dc49b89143f781e4ab30296e4d01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:05:03.588438 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-4561343c-e2c6-4bec-a906-7e7b216f4584 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] 10.222.0.13 "GET /compute/v2.1/servers/e760fc87-dcc8-47ae-8bf1-014248a1c1b4" status: 200 len: 1315 microversion: 2.1 time: 2.399749 Nov 01 19:05:03.591443 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1375/2781] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:05:01 2022] GET /compute/v2.1/servers/e760fc87-dcc8-47ae-8bf1-014248a1c1b4 => generated 1315 bytes in 2410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:05:03.723423 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [req-250227a6-c544-49f3-9449-b4d9ae4431c8 req-7de39d4b-ce23-411a-b507-108aabcf6ca6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b58b3cb6-ebdc-4705-b308-4e804cd52bce", "tag": "83daf795-a40d-4ba1-ae59-903b534c7eb0"}]} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:05:03.762622 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-250227a6-c544-49f3-9449-b4d9ae4431c8 req-7de39d4b-ce23-411a-b507-108aabcf6ca6 service nova] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:05:03.764924 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-250227a6-c544-49f3-9449-b4d9ae4431c8 req-7de39d4b-ce23-411a-b507-108aabcf6ca6 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:05:03.768020 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-250227a6-c544-49f3-9449-b4d9ae4431c8 req-7de39d4b-ce23-411a-b507-108aabcf6ca6 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:05:03.818934 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.compute.server_external_events [req-250227a6-c544-49f3-9449-b4d9ae4431c8 req-7de39d4b-ce23-411a-b507-108aabcf6ca6 service nova] Creating event network-changed:83daf795-a40d-4ba1-ae59-903b534c7eb0 for instance b58b3cb6-ebdc-4705-b308-4e804cd52bce on n-h2-863052-2 Nov 01 19:05:03.838071 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [req-250227a6-c544-49f3-9449-b4d9ae4431c8 req-7de39d4b-ce23-411a-b507-108aabcf6ca6 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.119810 Nov 01 19:05:03.840158 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1376/2782] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Nov 1 19:05:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 01 19:05:03.884251 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-2c020a9f-ac20-4e88-a67b-63a9de440d8e tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:05:03.885342 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-2c020a9f-ac20-4e88-a67b-63a9de440d8e tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] [instance: 3029f3c1-4f32-4f6b-963c-16f65b6dff3c] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:05:03.901159 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2c020a9f-ac20-4e88-a67b-63a9de440d8e tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:05:03.901949 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2c020a9f-ac20-4e88-a67b-63a9de440d8e tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:05:03.903469 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2c020a9f-ac20-4e88-a67b-63a9de440d8e tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:05:03.906195 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2c020a9f-ac20-4e88-a67b-63a9de440d8e tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:05:03.910152 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2c020a9f-ac20-4e88-a67b-63a9de440d8e tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:05:03.910824 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2c020a9f-ac20-4e88-a67b-63a9de440d8e tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:05:04.765197 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-df2f8d8f-5d10-4978-ba0c-9e3f3c55f7a7 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05d6a1722dfa4e959aeb14d601e43b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b5d812eff94e2f89d4705d7e7d5f3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:05:04.789383 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-df2f8d8f-5d10-4978-ba0c-9e3f3c55f7a7 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] 10.222.0.13 "GET /compute/v2.1/servers/b58b3cb6-ebdc-4705-b308-4e804cd52bce" status: 200 len: 1318 microversion: 2.1 time: 1.930315 Nov 01 19:05:04.790406 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1407/2783] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:05:02 2022] GET /compute/v2.1/servers/b58b3cb6-ebdc-4705-b308-4e804cd52bce => generated 1318 bytes in 1935 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:05:04.796157 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-23564011-8afa-4183-80b0-7adb529d66c9 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:05:04.797856 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-23564011-8afa-4183-80b0-7adb529d66c9 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] [instance: e760fc87-dcc8-47ae-8bf1-014248a1c1b4] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:05:04.806090 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-23564011-8afa-4183-80b0-7adb529d66c9 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:05:04.807069 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-23564011-8afa-4183-80b0-7adb529d66c9 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:05:04.808171 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-23564011-8afa-4183-80b0-7adb529d66c9 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:05:04.809489 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-23564011-8afa-4183-80b0-7adb529d66c9 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:05:04.810297 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-23564011-8afa-4183-80b0-7adb529d66c9 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:05:04.811279 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-23564011-8afa-4183-80b0-7adb529d66c9 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:05:04.926658 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-2c020a9f-ac20-4e88-a67b-63a9de440d8e tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '790f3f1566b7464aaca19d4d05c0942e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33e3d319293c46b6af2f728a50586906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:05:04.943859 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-2c020a9f-ac20-4e88-a67b-63a9de440d8e tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] 10.222.0.13 "GET /compute/v2.1/servers/3029f3c1-4f32-4f6b-963c-16f65b6dff3c" status: 200 len: 1366 microversion: 2.1 time: 1.064737 Nov 01 19:05:04.952673 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1377/2784] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:05:03 2022] GET /compute/v2.1/servers/3029f3c1-4f32-4f6b-963c-16f65b6dff3c => generated 1366 bytes in 1068 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:05:05.481922 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-23564011-8afa-4183-80b0-7adb529d66c9 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '058480d92c9b4ab4af6815d0438a65c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee9dc49b89143f781e4ab30296e4d01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:05:05.502543 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-23564011-8afa-4183-80b0-7adb529d66c9 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] 10.222.0.13 "GET /compute/v2.1/servers/e760fc87-dcc8-47ae-8bf1-014248a1c1b4" status: 200 len: 1315 microversion: 2.1 time: 0.709863 Nov 01 19:05:05.503270 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1408/2785] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:05:04 2022] GET /compute/v2.1/servers/e760fc87-dcc8-47ae-8bf1-014248a1c1b4 => generated 1315 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:05:05.822075 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-e410d21f-a148-46b8-b08c-cd74f9a308b1 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:05:05.825135 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-e410d21f-a148-46b8-b08c-cd74f9a308b1 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] [instance: b58b3cb6-ebdc-4705-b308-4e804cd52bce] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:05:05.837988 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-e410d21f-a148-46b8-b08c-cd74f9a308b1 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:05:05.838729 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-e410d21f-a148-46b8-b08c-cd74f9a308b1 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:05:05.839405 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-e410d21f-a148-46b8-b08c-cd74f9a308b1 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:05:05.840468 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-e410d21f-a148-46b8-b08c-cd74f9a308b1 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:05:05.841441 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-e410d21f-a148-46b8-b08c-cd74f9a308b1 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:05:05.842053 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-e410d21f-a148-46b8-b08c-cd74f9a308b1 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:05:05.903857 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [req-00add501-6469-4723-92eb-f6a0abf3773d req-6a192b41-7c16-40a8-ad01-1e898db696c5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e760fc87-dcc8-47ae-8bf1-014248a1c1b4", "name": "network-vif-plugged", "status": "completed", "tag": "5094f8e9-8282-4248-bab9-4fe9dd2f7e98"}]} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:05:05.941990 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-00add501-6469-4723-92eb-f6a0abf3773d req-6a192b41-7c16-40a8-ad01-1e898db696c5 service nova] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:05:05.942638 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-00add501-6469-4723-92eb-f6a0abf3773d req-6a192b41-7c16-40a8-ad01-1e898db696c5 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:05:05.942896 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-00add501-6469-4723-92eb-f6a0abf3773d req-6a192b41-7c16-40a8-ad01-1e898db696c5 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:05:05.982512 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.compute.server_external_events [req-00add501-6469-4723-92eb-f6a0abf3773d req-6a192b41-7c16-40a8-ad01-1e898db696c5 service nova] Creating event network-vif-plugged:5094f8e9-8282-4248-bab9-4fe9dd2f7e98 for instance e760fc87-dcc8-47ae-8bf1-014248a1c1b4 on n-h1-863052-2 Nov 01 19:05:05.995661 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [req-00add501-6469-4723-92eb-f6a0abf3773d req-6a192b41-7c16-40a8-ad01-1e898db696c5 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.378827 Nov 01 19:05:05.997307 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1378/2786] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Nov 1 19:05:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:05:06.020846 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-6b3e5c29-e3be-4f7d-b9e0-a81a7d40bc69 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:05:06.022163 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-6b3e5c29-e3be-4f7d-b9e0-a81a7d40bc69 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] [instance: 3029f3c1-4f32-4f6b-963c-16f65b6dff3c] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:05:06.037907 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-6b3e5c29-e3be-4f7d-b9e0-a81a7d40bc69 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:05:06.038425 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-6b3e5c29-e3be-4f7d-b9e0-a81a7d40bc69 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:05:06.038880 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-6b3e5c29-e3be-4f7d-b9e0-a81a7d40bc69 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:05:06.043581 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-6b3e5c29-e3be-4f7d-b9e0-a81a7d40bc69 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:05:06.044128 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-6b3e5c29-e3be-4f7d-b9e0-a81a7d40bc69 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:05:06.044659 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-6b3e5c29-e3be-4f7d-b9e0-a81a7d40bc69 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:05:06.424709 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-6b3e5c29-e3be-4f7d-b9e0-a81a7d40bc69 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '790f3f1566b7464aaca19d4d05c0942e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33e3d319293c46b6af2f728a50586906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:05:06.436662 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-6b3e5c29-e3be-4f7d-b9e0-a81a7d40bc69 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] 10.222.0.13 "GET /compute/v2.1/servers/3029f3c1-4f32-4f6b-963c-16f65b6dff3c" status: 200 len: 1366 microversion: 2.1 time: 0.431210 Nov 01 19:05:06.438162 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1379/2787] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:05:05 2022] GET /compute/v2.1/servers/3029f3c1-4f32-4f6b-963c-16f65b6dff3c => generated 1366 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:05:06.533914 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-fb040e83-9d69-49f3-a489-4b14cfe3a7a2 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:05:06.534527 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-fb040e83-9d69-49f3-a489-4b14cfe3a7a2 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] [instance: e760fc87-dcc8-47ae-8bf1-014248a1c1b4] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:05:06.549190 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-fb040e83-9d69-49f3-a489-4b14cfe3a7a2 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:05:06.551494 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-fb040e83-9d69-49f3-a489-4b14cfe3a7a2 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:05:06.557201 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-fb040e83-9d69-49f3-a489-4b14cfe3a7a2 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:05:06.558251 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-fb040e83-9d69-49f3-a489-4b14cfe3a7a2 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:05:06.564142 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-fb040e83-9d69-49f3-a489-4b14cfe3a7a2 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:05:06.565438 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-fb040e83-9d69-49f3-a489-4b14cfe3a7a2 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:05:07.047250 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-fb040e83-9d69-49f3-a489-4b14cfe3a7a2 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '058480d92c9b4ab4af6815d0438a65c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee9dc49b89143f781e4ab30296e4d01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:05:07.070064 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-fb040e83-9d69-49f3-a489-4b14cfe3a7a2 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] 10.222.0.13 "GET /compute/v2.1/servers/e760fc87-dcc8-47ae-8bf1-014248a1c1b4" status: 200 len: 1315 microversion: 2.1 time: 0.541872 Nov 01 19:05:07.070609 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1380/2788] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:05:06 2022] GET /compute/v2.1/servers/e760fc87-dcc8-47ae-8bf1-014248a1c1b4 => generated 1315 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:05:07.264105 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-e410d21f-a148-46b8-b08c-cd74f9a308b1 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05d6a1722dfa4e959aeb14d601e43b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b5d812eff94e2f89d4705d7e7d5f3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:05:07.306982 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-e410d21f-a148-46b8-b08c-cd74f9a308b1 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] 10.222.0.13 "GET /compute/v2.1/servers/b58b3cb6-ebdc-4705-b308-4e804cd52bce" status: 200 len: 1318 microversion: 2.1 time: 1.489708 Nov 01 19:05:07.312883 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1409/2789] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:05:05 2022] GET /compute/v2.1/servers/b58b3cb6-ebdc-4705-b308-4e804cd52bce => generated 1318 bytes in 1498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:05:07.460434 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-f027bdb6-1d39-43dc-b296-f1a3f450a0ca tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:05:07.461862 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-f027bdb6-1d39-43dc-b296-f1a3f450a0ca tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] [instance: 3029f3c1-4f32-4f6b-963c-16f65b6dff3c] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:05:07.473423 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f027bdb6-1d39-43dc-b296-f1a3f450a0ca tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:05:07.473937 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f027bdb6-1d39-43dc-b296-f1a3f450a0ca tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:05:07.474388 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f027bdb6-1d39-43dc-b296-f1a3f450a0ca tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:05:07.475129 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f027bdb6-1d39-43dc-b296-f1a3f450a0ca tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:05:07.475601 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f027bdb6-1d39-43dc-b296-f1a3f450a0ca tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:05:07.476041 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f027bdb6-1d39-43dc-b296-f1a3f450a0ca tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:05:07.658718 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-babeea6d-73f6-4ee1-9109-69a9e137bde4 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Action: 'create', calling method: .version_select at 0x7f0ae2a9d790>, body: {"keypair": {"name": "tempest-keypair-1185576951", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCHe4NbvGi/T+Vw/OyGR5WzeJGEUQ67SbeeXy6wZF7ohfX3gD8+dWRYIhl48smHcM0ewCy6KfuipNNVpcCACZbO9wZYtIZEegAtEY3aJIAXPpBo/GECw3YGMNRm4YJPrWA=="}} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:05:07.743094 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.quota [None req-babeea6d-73f6-4ee1-9109-69a9e137bde4 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Getting quotas for project 8807757227574c828dca1947af76659d. Resources: {'key_pairs'} {{(pid=121403) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 01 19:05:07.760472 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.quota [None req-babeea6d-73f6-4ee1-9109-69a9e137bde4 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Getting quotas for user 301ed3b9c37449bc9ade378f3c73a768 and project 8807757227574c828dca1947af76659d. Resources: {'key_pairs'} {{(pid=121403) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 01 19:05:07.862500 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-babeea6d-73f6-4ee1-9109-69a9e137bde4 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.42 time: 0.215441 Nov 01 19:05:07.869020 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1410/2790] 10.222.0.13 () {62 vars in 1200 bytes} [Tue Nov 1 19:05:07 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 223 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Nov 01 19:05:08.099536 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-e3f6188e-67e3-4620-bbf0-c732e8b1bc0b tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:05:08.100361 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-e3f6188e-67e3-4620-bbf0-c732e8b1bc0b tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] [instance: e760fc87-dcc8-47ae-8bf1-014248a1c1b4] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:05:08.125550 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-e3f6188e-67e3-4620-bbf0-c732e8b1bc0b tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:05:08.128799 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-e3f6188e-67e3-4620-bbf0-c732e8b1bc0b tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:05:08.129440 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-e3f6188e-67e3-4620-bbf0-c732e8b1bc0b tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:05:08.130764 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-e3f6188e-67e3-4620-bbf0-c732e8b1bc0b tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:05:08.132614 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-e3f6188e-67e3-4620-bbf0-c732e8b1bc0b tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:05:08.133862 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-e3f6188e-67e3-4620-bbf0-c732e8b1bc0b tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:05:08.323595 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-f027bdb6-1d39-43dc-b296-f1a3f450a0ca tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '790f3f1566b7464aaca19d4d05c0942e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33e3d319293c46b6af2f728a50586906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:05:08.339511 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-f027bdb6-1d39-43dc-b296-f1a3f450a0ca tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] 10.222.0.13 "GET /compute/v2.1/servers/3029f3c1-4f32-4f6b-963c-16f65b6dff3c" status: 200 len: 1366 microversion: 2.1 time: 0.878467 Nov 01 19:05:08.355173 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1381/2791] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:05:07 2022] GET /compute/v2.1/servers/3029f3c1-4f32-4f6b-963c-16f65b6dff3c => generated 1366 bytes in 900 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:05:08.373410 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-84fd8dcf-f165-42e9-b12c-8aff56a596fb tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:05:08.374769 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-84fd8dcf-f165-42e9-b12c-8aff56a596fb tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] [instance: b58b3cb6-ebdc-4705-b308-4e804cd52bce] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:05:08.386671 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-84fd8dcf-f165-42e9-b12c-8aff56a596fb tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:05:08.387449 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-84fd8dcf-f165-42e9-b12c-8aff56a596fb tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:05:08.388065 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-84fd8dcf-f165-42e9-b12c-8aff56a596fb tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:05:08.389013 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-84fd8dcf-f165-42e9-b12c-8aff56a596fb tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:05:08.390914 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-84fd8dcf-f165-42e9-b12c-8aff56a596fb tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:05:08.394401 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-84fd8dcf-f165-42e9-b12c-8aff56a596fb tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:05:08.694390 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-e3f6188e-67e3-4620-bbf0-c732e8b1bc0b tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '058480d92c9b4ab4af6815d0438a65c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee9dc49b89143f781e4ab30296e4d01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:05:08.725917 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-e3f6188e-67e3-4620-bbf0-c732e8b1bc0b tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] 10.222.0.13 "GET /compute/v2.1/servers/e760fc87-dcc8-47ae-8bf1-014248a1c1b4" status: 200 len: 1502 microversion: 2.1 time: 0.632150 Nov 01 19:05:08.731078 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1411/2792] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:05:08 2022] GET /compute/v2.1/servers/e760fc87-dcc8-47ae-8bf1-014248a1c1b4 => generated 1502 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 19:05:08.738779 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [req-c161aa2a-75cd-4fbb-b76a-3b75b377d57b req-5d7f1f4c-5062-4141-b6b5-4d8f1686b2f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3029f3c1-4f32-4f6b-963c-16f65b6dff3c", "name": "network-vif-plugged", "status": "completed", "tag": "840ef8a7-6bc6-4d48-932b-14a3209a45e7"}]} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:05:08.790831 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-c161aa2a-75cd-4fbb-b76a-3b75b377d57b req-5d7f1f4c-5062-4141-b6b5-4d8f1686b2f1 service nova] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:05:08.791319 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-c161aa2a-75cd-4fbb-b76a-3b75b377d57b req-5d7f1f4c-5062-4141-b6b5-4d8f1686b2f1 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:05:08.791748 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-c161aa2a-75cd-4fbb-b76a-3b75b377d57b req-5d7f1f4c-5062-4141-b6b5-4d8f1686b2f1 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:05:08.810943 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.compute.server_external_events [req-c161aa2a-75cd-4fbb-b76a-3b75b377d57b req-5d7f1f4c-5062-4141-b6b5-4d8f1686b2f1 service nova] Creating event network-vif-plugged:840ef8a7-6bc6-4d48-932b-14a3209a45e7 for instance 3029f3c1-4f32-4f6b-963c-16f65b6dff3c on n-h1-863052-2 Nov 01 19:05:08.827246 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [req-c161aa2a-75cd-4fbb-b76a-3b75b377d57b req-5d7f1f4c-5062-4141-b6b5-4d8f1686b2f1 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094600 Nov 01 19:05:08.827898 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1412/2793] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Nov 1 19:05:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:05:08.833035 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-e42f0a6a-a3cf-429d-89cd-a51120265d73 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:05:08.833629 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-e42f0a6a-a3cf-429d-89cd-a51120265d73 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] [instance: e760fc87-dcc8-47ae-8bf1-014248a1c1b4] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:05:08.867782 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-e42f0a6a-a3cf-429d-89cd-a51120265d73 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:05:08.868283 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-e42f0a6a-a3cf-429d-89cd-a51120265d73 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:05:08.868759 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-e42f0a6a-a3cf-429d-89cd-a51120265d73 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:05:08.869479 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-e42f0a6a-a3cf-429d-89cd-a51120265d73 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:05:08.869946 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-e42f0a6a-a3cf-429d-89cd-a51120265d73 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:05:08.870355 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-e42f0a6a-a3cf-429d-89cd-a51120265d73 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:05:08.937219 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-e42f0a6a-a3cf-429d-89cd-a51120265d73 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] [instance: e760fc87-dcc8-47ae-8bf1-014248a1c1b4] Going to try to terminate instance {{(pid=121403) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 01 19:05:09.058589 n-d-863052-2 devstack@n-api.service[121403]: DEBUG dbcounter [-] [121403] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=121403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 19:05:09.267183 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-e42f0a6a-a3cf-429d-89cd-a51120265d73 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] 10.222.0.13 "DELETE /compute/v2.1/servers/e760fc87-dcc8-47ae-8bf1-014248a1c1b4" status: 204 len: 0 microversion: 2.1 time: 0.437837 Nov 01 19:05:09.268513 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1413/2794] 10.222.0.13 () {58 vars in 1239 bytes} [Tue Nov 1 19:05:08 2022] DELETE /compute/v2.1/servers/e760fc87-dcc8-47ae-8bf1-014248a1c1b4 => generated 0 bytes in 440 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 01 19:05:09.290124 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-b4084ea0-e407-4f70-8f2f-81b5b183a6ef tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:05:09.292173 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-b4084ea0-e407-4f70-8f2f-81b5b183a6ef tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] [instance: e760fc87-dcc8-47ae-8bf1-014248a1c1b4] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:05:09.316072 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-b4084ea0-e407-4f70-8f2f-81b5b183a6ef tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:05:09.324336 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-b4084ea0-e407-4f70-8f2f-81b5b183a6ef tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:05:09.325674 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-b4084ea0-e407-4f70-8f2f-81b5b183a6ef tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:05:09.328177 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-b4084ea0-e407-4f70-8f2f-81b5b183a6ef tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:05:09.329532 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-b4084ea0-e407-4f70-8f2f-81b5b183a6ef tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:05:09.330784 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-b4084ea0-e407-4f70-8f2f-81b5b183a6ef tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:05:10.067827 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-84fd8dcf-f165-42e9-b12c-8aff56a596fb tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05d6a1722dfa4e959aeb14d601e43b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b5d812eff94e2f89d4705d7e7d5f3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:05:10.076572 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-84fd8dcf-f165-42e9-b12c-8aff56a596fb tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] 10.222.0.13 "GET /compute/v2.1/servers/b58b3cb6-ebdc-4705-b308-4e804cd52bce" status: 200 len: 1318 microversion: 2.1 time: 1.719882 Nov 01 19:05:10.077177 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1382/2795] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:05:08 2022] GET /compute/v2.1/servers/b58b3cb6-ebdc-4705-b308-4e804cd52bce => generated 1318 bytes in 1721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:05:10.086980 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-059be270-7327-4d02-a581-87f208597f4f tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:05:10.087595 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-059be270-7327-4d02-a581-87f208597f4f tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] [instance: 3029f3c1-4f32-4f6b-963c-16f65b6dff3c] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:05:10.103519 n-d-863052-2 devstack@n-api.service[121402]: DEBUG dbcounter [-] [121402] Writing DB stats nova_api:SELECT=78,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=121402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 19:05:10.107489 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-059be270-7327-4d02-a581-87f208597f4f tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:05:10.109927 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-059be270-7327-4d02-a581-87f208597f4f tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:05:10.110324 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-059be270-7327-4d02-a581-87f208597f4f tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:05:10.113115 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-059be270-7327-4d02-a581-87f208597f4f tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:05:10.113598 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-059be270-7327-4d02-a581-87f208597f4f tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:05:10.114053 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-059be270-7327-4d02-a581-87f208597f4f tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:05:10.497375 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-059be270-7327-4d02-a581-87f208597f4f tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '790f3f1566b7464aaca19d4d05c0942e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33e3d319293c46b6af2f728a50586906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:05:10.514215 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-059be270-7327-4d02-a581-87f208597f4f tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] 10.222.0.13 "GET /compute/v2.1/servers/3029f3c1-4f32-4f6b-963c-16f65b6dff3c" status: 200 len: 1366 microversion: 2.1 time: 0.428752 Nov 01 19:05:10.514882 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1383/2796] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:05:10 2022] GET /compute/v2.1/servers/3029f3c1-4f32-4f6b-963c-16f65b6dff3c => generated 1366 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:05:10.690815 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-0886ff60-40ce-48ef-9b71-3c0b1291bdf5 tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationTestJSON-server-1251113526", "imageRef": "2d4a0047-1b9e-445f-8af8-1b5c9d93e881", "flavorRef": "452", "networks": [{"uuid": "5b808c64-bf01-4ded-bf6b-0b3fd18d2f1c"}]}} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:05:10.835726 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.network.neutron [None req-0886ff60-40ce-48ef-9b71-3c0b1291bdf5 tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] validate_networks() for [('5b808c64-bf01-4ded-bf6b-0b3fd18d2f1c', None, None, None, None, None)] {{(pid=121402) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 01 19:05:10.960311 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-b4084ea0-e407-4f70-8f2f-81b5b183a6ef tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '058480d92c9b4ab4af6815d0438a65c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee9dc49b89143f781e4ab30296e4d01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:05:10.970563 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-b4084ea0-e407-4f70-8f2f-81b5b183a6ef tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] 10.222.0.13 "GET /compute/v2.1/servers/e760fc87-dcc8-47ae-8bf1-014248a1c1b4" status: 200 len: 1508 microversion: 2.1 time: 1.696793 Nov 01 19:05:10.989266 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1414/2797] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:05:09 2022] GET /compute/v2.1/servers/e760fc87-dcc8-47ae-8bf1-014248a1c1b4 => generated 1508 bytes in 1716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:05:11.100022 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-44522852-2768-498f-9e46-e609bea69b39 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:05:11.102909 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-44522852-2768-498f-9e46-e609bea69b39 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] [instance: b58b3cb6-ebdc-4705-b308-4e804cd52bce] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:05:11.118346 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-44522852-2768-498f-9e46-e609bea69b39 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:05:11.121103 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-44522852-2768-498f-9e46-e609bea69b39 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:05:11.126350 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-44522852-2768-498f-9e46-e609bea69b39 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:05:11.127428 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-44522852-2768-498f-9e46-e609bea69b39 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:05:11.128117 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-44522852-2768-498f-9e46-e609bea69b39 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:05:11.130697 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-44522852-2768-498f-9e46-e609bea69b39 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:05:12.054899 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-44522852-2768-498f-9e46-e609bea69b39 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05d6a1722dfa4e959aeb14d601e43b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b5d812eff94e2f89d4705d7e7d5f3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:05:12.070159 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-44522852-2768-498f-9e46-e609bea69b39 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] 10.222.0.13 "GET /compute/v2.1/servers/b58b3cb6-ebdc-4705-b308-4e804cd52bce" status: 200 len: 1318 microversion: 2.1 time: 0.970847 Nov 01 19:05:12.087620 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1415/2798] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:05:11 2022] GET /compute/v2.1/servers/b58b3cb6-ebdc-4705-b308-4e804cd52bce => generated 1318 bytes in 990 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:05:12.106718 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-e8269c07-b78d-4a09-952d-9f1ce6026ffb tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:05:12.108382 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-e8269c07-b78d-4a09-952d-9f1ce6026ffb tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] [instance: 3029f3c1-4f32-4f6b-963c-16f65b6dff3c] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:05:12.123333 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-e8269c07-b78d-4a09-952d-9f1ce6026ffb tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:05:12.124804 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-e8269c07-b78d-4a09-952d-9f1ce6026ffb tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:05:12.129579 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-e8269c07-b78d-4a09-952d-9f1ce6026ffb tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:05:12.134399 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-e8269c07-b78d-4a09-952d-9f1ce6026ffb tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:05:12.135784 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-e8269c07-b78d-4a09-952d-9f1ce6026ffb tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:05:12.138772 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-e8269c07-b78d-4a09-952d-9f1ce6026ffb tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:05:12.842322 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.virt.hardware [None req-0886ff60-40ce-48ef-9b71-3c0b1291bdf5 tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] Flavor limits 0:0:0 {{(pid=121402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 01 19:05:12.842899 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.virt.hardware [None req-0886ff60-40ce-48ef-9b71-3c0b1291bdf5 tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] Image limits 0:0:0 {{(pid=121402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 01 19:05:12.843286 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.virt.hardware [None req-0886ff60-40ce-48ef-9b71-3c0b1291bdf5 tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] Flavor pref 0:0:0 {{(pid=121402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 01 19:05:12.843755 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.virt.hardware [None req-0886ff60-40ce-48ef-9b71-3c0b1291bdf5 tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] Image pref 0:0:0 {{(pid=121402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 01 19:05:12.844375 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.virt.hardware [None req-0886ff60-40ce-48ef-9b71-3c0b1291bdf5 tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 01 19:05:12.861590 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-0886ff60-40ce-48ef-9b71-3c0b1291bdf5 tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:05:12.862085 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-0886ff60-40ce-48ef-9b71-3c0b1291bdf5 tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:05:12.862800 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-0886ff60-40ce-48ef-9b71-3c0b1291bdf5 tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:05:12.863713 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-0886ff60-40ce-48ef-9b71-3c0b1291bdf5 tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:05:12.864355 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-0886ff60-40ce-48ef-9b71-3c0b1291bdf5 tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:05:12.865643 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-0886ff60-40ce-48ef-9b71-3c0b1291bdf5 tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:05:12.892557 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.quota [None req-0886ff60-40ce-48ef-9b71-3c0b1291bdf5 tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] Getting quotas for project eda6511ea24c4c19a7c5d91535c7288d. Resources: {'cores', 'ram', 'instances'} {{(pid=121402) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 01 19:05:12.903471 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.quota [None req-0886ff60-40ce-48ef-9b71-3c0b1291bdf5 tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] Getting quotas for user cb87e6147a6f470391921ac3b7a62f8d and project eda6511ea24c4c19a7c5d91535c7288d. Resources: {'cores', 'ram', 'instances'} {{(pid=121402) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 01 19:05:12.942265 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-0886ff60-40ce-48ef-9b71-3c0b1291bdf5 tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] Going to run 1 instances... {{(pid=121402) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 01 19:05:12.945606 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-0886ff60-40ce-48ef-9b71-3c0b1291bdf5 tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] [instance: 307ee785-a01d-401c-8be2-b17558e735f3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2d4a0047-1b9e-445f-8af8-1b5c9d93e881',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121402) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 01 19:05:12.951017 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-e8269c07-b78d-4a09-952d-9f1ce6026ffb tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '790f3f1566b7464aaca19d4d05c0942e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33e3d319293c46b6af2f728a50586906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:05:12.968080 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-e8269c07-b78d-4a09-952d-9f1ce6026ffb tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] 10.222.0.13 "GET /compute/v2.1/servers/3029f3c1-4f32-4f6b-963c-16f65b6dff3c" status: 200 len: 1556 microversion: 2.1 time: 0.876707 Nov 01 19:05:12.969908 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1416/2799] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:05:12 2022] GET /compute/v2.1/servers/3029f3c1-4f32-4f6b-963c-16f65b6dff3c => generated 1556 bytes in 881 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:05:12.981979 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-439e7aae-2ea3-4ffe-b49a-6e31bbdb0ab8 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:05:12.983100 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-439e7aae-2ea3-4ffe-b49a-6e31bbdb0ab8 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] [instance: e760fc87-dcc8-47ae-8bf1-014248a1c1b4] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:05:13.000725 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-439e7aae-2ea3-4ffe-b49a-6e31bbdb0ab8 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:05:13.003093 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-439e7aae-2ea3-4ffe-b49a-6e31bbdb0ab8 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:05:13.003812 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-439e7aae-2ea3-4ffe-b49a-6e31bbdb0ab8 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:05:13.005735 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-439e7aae-2ea3-4ffe-b49a-6e31bbdb0ab8 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:05:13.009156 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-439e7aae-2ea3-4ffe-b49a-6e31bbdb0ab8 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:05:13.009986 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-439e7aae-2ea3-4ffe-b49a-6e31bbdb0ab8 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:05:13.099388 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-0886ff60-40ce-48ef-9b71-3c0b1291bdf5 tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.576827 Nov 01 19:05:13.101556 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1384/2800] 10.222.0.13 () {60 vars in 1147 bytes} [Tue Nov 1 19:05:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 2586 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 01 19:05:13.118883 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-846d58e1-a2b1-4d66-a1fb-e330eff81c94 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:05:13.122087 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-846d58e1-a2b1-4d66-a1fb-e330eff81c94 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] [instance: 3029f3c1-4f32-4f6b-963c-16f65b6dff3c] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:05:13.149774 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-846d58e1-a2b1-4d66-a1fb-e330eff81c94 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:05:13.150486 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-846d58e1-a2b1-4d66-a1fb-e330eff81c94 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:05:13.151139 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-846d58e1-a2b1-4d66-a1fb-e330eff81c94 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:05:13.164512 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-846d58e1-a2b1-4d66-a1fb-e330eff81c94 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:05:13.165415 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-846d58e1-a2b1-4d66-a1fb-e330eff81c94 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:05:13.166312 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-846d58e1-a2b1-4d66-a1fb-e330eff81c94 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:05:13.689610 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-439e7aae-2ea3-4ffe-b49a-6e31bbdb0ab8 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '058480d92c9b4ab4af6815d0438a65c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee9dc49b89143f781e4ab30296e4d01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:05:13.707039 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-439e7aae-2ea3-4ffe-b49a-6e31bbdb0ab8 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] 10.222.0.13 "GET /compute/v2.1/servers/e760fc87-dcc8-47ae-8bf1-014248a1c1b4" status: 200 len: 1508 microversion: 2.1 time: 0.735511 Nov 01 19:05:13.707800 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1417/2801] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:05:12 2022] GET /compute/v2.1/servers/e760fc87-dcc8-47ae-8bf1-014248a1c1b4 => generated 1508 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:05:13.724637 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-42be19a5-61bf-4539-a8d6-8bc2bc47ab51 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:05:13.731918 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-42be19a5-61bf-4539-a8d6-8bc2bc47ab51 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] [instance: b58b3cb6-ebdc-4705-b308-4e804cd52bce] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:05:13.742930 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-42be19a5-61bf-4539-a8d6-8bc2bc47ab51 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:05:13.747754 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-42be19a5-61bf-4539-a8d6-8bc2bc47ab51 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:05:13.750933 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-42be19a5-61bf-4539-a8d6-8bc2bc47ab51 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:05:13.755371 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-42be19a5-61bf-4539-a8d6-8bc2bc47ab51 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:05:13.756046 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-42be19a5-61bf-4539-a8d6-8bc2bc47ab51 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:05:13.756682 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-42be19a5-61bf-4539-a8d6-8bc2bc47ab51 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:05:13.842047 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-846d58e1-a2b1-4d66-a1fb-e330eff81c94 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] 10.222.0.13 "GET /compute/v2.1/servers/3029f3c1-4f32-4f6b-963c-16f65b6dff3c/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.735316 Nov 01 19:05:13.844391 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1385/2802] 10.222.0.13 () {58 vars in 1275 bytes} [Tue Nov 1 19:05:13 2022] GET /compute/v2.1/servers/3029f3c1-4f32-4f6b-963c-16f65b6dff3c/os-interface => generated 285 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:05:13.851284 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-d615d168-04f8-4c25-971e-39d8337868d1 tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:05:13.852173 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-d615d168-04f8-4c25-971e-39d8337868d1 tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] [instance: 307ee785-a01d-401c-8be2-b17558e735f3] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:05:14.006207 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-d615d168-04f8-4c25-971e-39d8337868d1 tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb87e6147a6f470391921ac3b7a62f8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6511ea24c4c19a7c5d91535c7288d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:05:14.022195 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-d615d168-04f8-4c25-971e-39d8337868d1 tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] 10.222.0.13 "GET /compute/v2.1/servers/307ee785-a01d-401c-8be2-b17558e735f3" status: 200 len: 1224 microversion: 2.1 time: 0.174598 Nov 01 19:05:14.023269 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1386/2803] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:05:13 2022] GET /compute/v2.1/servers/307ee785-a01d-401c-8be2-b17558e735f3 => generated 1224 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:05:14.365592 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [req-c7dbbe92-c0c4-4fad-bdfc-291f42a94638 req-b4852d41-b7bc-417e-9ddf-391d0a1db37d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e760fc87-dcc8-47ae-8bf1-014248a1c1b4", "name": "network-vif-deleted", "tag": "5094f8e9-8282-4248-bab9-4fe9dd2f7e98"}]} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:05:14.394392 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-c7dbbe92-c0c4-4fad-bdfc-291f42a94638 req-b4852d41-b7bc-417e-9ddf-391d0a1db37d service nova] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:05:14.397071 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-c7dbbe92-c0c4-4fad-bdfc-291f42a94638 req-b4852d41-b7bc-417e-9ddf-391d0a1db37d service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:05:14.398947 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-c7dbbe92-c0c4-4fad-bdfc-291f42a94638 req-b4852d41-b7bc-417e-9ddf-391d0a1db37d service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:05:14.426558 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.compute.server_external_events [req-c7dbbe92-c0c4-4fad-bdfc-291f42a94638 req-b4852d41-b7bc-417e-9ddf-391d0a1db37d service nova] Creating event network-vif-deleted:5094f8e9-8282-4248-bab9-4fe9dd2f7e98 for instance e760fc87-dcc8-47ae-8bf1-014248a1c1b4 on n-h1-863052-2 Nov 01 19:05:14.446215 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [req-c7dbbe92-c0c4-4fad-bdfc-291f42a94638 req-b4852d41-b7bc-417e-9ddf-391d0a1db37d service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080910 Nov 01 19:05:14.447412 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1387/2804] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Nov 1 19:05:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 01 19:05:14.740662 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-12470dbd-838d-4217-b9f0-f7bda1e36ce5 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:05:14.742400 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-12470dbd-838d-4217-b9f0-f7bda1e36ce5 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] [instance: e760fc87-dcc8-47ae-8bf1-014248a1c1b4] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:05:14.798756 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-12470dbd-838d-4217-b9f0-f7bda1e36ce5 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:05:14.802278 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-12470dbd-838d-4217-b9f0-f7bda1e36ce5 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:05:14.809133 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-12470dbd-838d-4217-b9f0-f7bda1e36ce5 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:05:14.818943 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-12470dbd-838d-4217-b9f0-f7bda1e36ce5 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:05:14.819859 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-12470dbd-838d-4217-b9f0-f7bda1e36ce5 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:05:14.822803 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-12470dbd-838d-4217-b9f0-f7bda1e36ce5 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:05:14.946711 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-12470dbd-838d-4217-b9f0-f7bda1e36ce5 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:05:14.948444 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-12470dbd-838d-4217-b9f0-f7bda1e36ce5 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:05:14.948923 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-12470dbd-838d-4217-b9f0-f7bda1e36ce5 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:05:14.949395 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.objects.instance [None req-12470dbd-838d-4217-b9f0-f7bda1e36ce5 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lazy-loading 'fault' on Instance uuid e760fc87-dcc8-47ae-8bf1-014248a1c1b4 {{(pid=121402) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 01 19:05:14.965057 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-42be19a5-61bf-4539-a8d6-8bc2bc47ab51 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05d6a1722dfa4e959aeb14d601e43b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b5d812eff94e2f89d4705d7e7d5f3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:05:14.979517 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-42be19a5-61bf-4539-a8d6-8bc2bc47ab51 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] 10.222.0.13 "GET /compute/v2.1/servers/b58b3cb6-ebdc-4705-b308-4e804cd52bce" status: 200 len: 1318 microversion: 2.1 time: 1.264642 Nov 01 19:05:14.980123 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1418/2805] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:05:13 2022] GET /compute/v2.1/servers/b58b3cb6-ebdc-4705-b308-4e804cd52bce => generated 1318 bytes in 1272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:05:15.050466 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-fd5fe9b0-7770-484e-8637-1c3e62367ba6 tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:05:15.051323 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-fd5fe9b0-7770-484e-8637-1c3e62367ba6 tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] [instance: 307ee785-a01d-401c-8be2-b17558e735f3] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:05:15.071342 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-12470dbd-838d-4217-b9f0-f7bda1e36ce5 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '058480d92c9b4ab4af6815d0438a65c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee9dc49b89143f781e4ab30296e4d01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:05:15.075044 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-fd5fe9b0-7770-484e-8637-1c3e62367ba6 tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:05:15.079447 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-fd5fe9b0-7770-484e-8637-1c3e62367ba6 tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:05:15.080843 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-fd5fe9b0-7770-484e-8637-1c3e62367ba6 tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:05:15.082848 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-fd5fe9b0-7770-484e-8637-1c3e62367ba6 tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:05:15.084883 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-fd5fe9b0-7770-484e-8637-1c3e62367ba6 tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:05:15.085758 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-fd5fe9b0-7770-484e-8637-1c3e62367ba6 tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:05:15.102007 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-12470dbd-838d-4217-b9f0-f7bda1e36ce5 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] 10.222.0.13 "GET /compute/v2.1/servers/e760fc87-dcc8-47ae-8bf1-014248a1c1b4" status: 200 len: 1305 microversion: 2.1 time: 0.370003 Nov 01 19:05:15.107343 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1388/2806] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:05:14 2022] GET /compute/v2.1/servers/e760fc87-dcc8-47ae-8bf1-014248a1c1b4 => generated 1305 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 19:05:15.330920 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-fd5fe9b0-7770-484e-8637-1c3e62367ba6 tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb87e6147a6f470391921ac3b7a62f8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6511ea24c4c19a7c5d91535c7288d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:05:15.350786 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-fd5fe9b0-7770-484e-8637-1c3e62367ba6 tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] 10.222.0.13 "GET /compute/v2.1/servers/307ee785-a01d-401c-8be2-b17558e735f3" status: 200 len: 1276 microversion: 2.1 time: 0.305204 Nov 01 19:05:15.355124 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1419/2807] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:05:15 2022] GET /compute/v2.1/servers/307ee785-a01d-401c-8be2-b17558e735f3 => generated 1276 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:05:15.490893 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [req-57d05f2a-5cd7-479d-acd5-fee6d1363502 req-2b515811-3035-4ccd-bdda-0defdaab8f78 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b58b3cb6-ebdc-4705-b308-4e804cd52bce", "name": "network-vif-plugged", "status": "completed", "tag": "83daf795-a40d-4ba1-ae59-903b534c7eb0"}]} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:05:15.508643 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-57d05f2a-5cd7-479d-acd5-fee6d1363502 req-2b515811-3035-4ccd-bdda-0defdaab8f78 service nova] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:05:15.508956 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-57d05f2a-5cd7-479d-acd5-fee6d1363502 req-2b515811-3035-4ccd-bdda-0defdaab8f78 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:05:15.509439 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-57d05f2a-5cd7-479d-acd5-fee6d1363502 req-2b515811-3035-4ccd-bdda-0defdaab8f78 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:05:15.564050 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.compute.server_external_events [req-57d05f2a-5cd7-479d-acd5-fee6d1363502 req-2b515811-3035-4ccd-bdda-0defdaab8f78 service nova] Creating event network-vif-plugged:83daf795-a40d-4ba1-ae59-903b534c7eb0 for instance b58b3cb6-ebdc-4705-b308-4e804cd52bce on n-h2-863052-2 Nov 01 19:05:15.594850 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [req-57d05f2a-5cd7-479d-acd5-fee6d1363502 req-2b515811-3035-4ccd-bdda-0defdaab8f78 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107764 Nov 01 19:05:15.601066 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1389/2808] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Nov 1 19:05:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:05:16.008637 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-b9ae2fb8-0f0c-450a-9ad6-6415920ae5af tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:05:16.010903 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-b9ae2fb8-0f0c-450a-9ad6-6415920ae5af tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] [instance: b58b3cb6-ebdc-4705-b308-4e804cd52bce] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:05:16.022941 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-b9ae2fb8-0f0c-450a-9ad6-6415920ae5af tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:05:16.023712 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-b9ae2fb8-0f0c-450a-9ad6-6415920ae5af tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:05:16.025534 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-b9ae2fb8-0f0c-450a-9ad6-6415920ae5af tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:05:16.026491 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-b9ae2fb8-0f0c-450a-9ad6-6415920ae5af tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:05:16.029078 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-b9ae2fb8-0f0c-450a-9ad6-6415920ae5af tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:05:16.029725 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-b9ae2fb8-0f0c-450a-9ad6-6415920ae5af tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:05:16.135864 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-359c1b22-50f3-4bea-98ce-ac81c11051d9 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:05:16.137294 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-359c1b22-50f3-4bea-98ce-ac81c11051d9 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] [instance: e760fc87-dcc8-47ae-8bf1-014248a1c1b4] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:05:16.156936 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-359c1b22-50f3-4bea-98ce-ac81c11051d9 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:05:16.160884 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-359c1b22-50f3-4bea-98ce-ac81c11051d9 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:05:16.160884 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-359c1b22-50f3-4bea-98ce-ac81c11051d9 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:05:16.162168 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-359c1b22-50f3-4bea-98ce-ac81c11051d9 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:05:16.162638 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-359c1b22-50f3-4bea-98ce-ac81c11051d9 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:05:16.172999 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-359c1b22-50f3-4bea-98ce-ac81c11051d9 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:05:16.191126 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.wsgi [None req-359c1b22-50f3-4bea-98ce-ac81c11051d9 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] HTTP exception thrown: Instance e760fc87-dcc8-47ae-8bf1-014248a1c1b4 could not be found. Nov 01 19:05:16.197200 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-359c1b22-50f3-4bea-98ce-ac81c11051d9 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Request method failure captured: Nov 01 19:05:16.197200 n-d-863052-2 devstack@n-api.service[121402]: request: GET /compute/v2.1/servers/e760fc87-dcc8-47ae-8bf1-014248a1c1b4 HTTP/1.1 Nov 01 19:05:16.197200 n-d-863052-2 devstack@n-api.service[121402]: Accept: application/json Nov 01 19:05:16.197200 n-d-863052-2 devstack@n-api.service[121402]: Accept-Encoding: identity Nov 01 19:05:16.197200 n-d-863052-2 devstack@n-api.service[121402]: Connection: close Nov 01 19:05:16.197200 n-d-863052-2 devstack@n-api.service[121402]: Content-Length: 0 Nov 01 19:05:16.197200 n-d-863052-2 devstack@n-api.service[121402]: Content-Type: application/json Nov 01 19:05:16.197200 n-d-863052-2 devstack@n-api.service[121402]: Host: 10.222.0.13 Nov 01 19:05:16.197200 n-d-863052-2 devstack@n-api.service[121402]: Openstack-System-Scope: None Nov 01 19:05:16.197200 n-d-863052-2 devstack@n-api.service[121402]: User-Agent: python-urllib3/1.26.12 Nov 01 19:05:16.197200 n-d-863052-2 devstack@n-api.service[121402]: X-Auth-Token: gAAAAABjYW3ByfBI9VCjWikZSFUz_hPClqqMancoCxnwBX6xqaMeeugycqMQyEPQybXqoeO46TFhJ9TITtoJFiSbS9Ry6pB9Kueb-hoVnQBV0e7qQWXwvcx4eB_AomP3ogOCXvqhfUnxVmmooBEoQbpvBIMsXQEjVVdPObNP8WS9oGjTsTTTO4o Nov 01 19:05:16.197200 n-d-863052-2 devstack@n-api.service[121402]: X-Domain-Id: None Nov 01 19:05:16.197200 n-d-863052-2 devstack@n-api.service[121402]: X-Domain-Name: None Nov 01 19:05:16.197200 n-d-863052-2 devstack@n-api.service[121402]: X-Identity-Status: Confirmed Nov 01 19:05:16.197200 n-d-863052-2 devstack@n-api.service[121402]: X-Is-Admin-Project: True Nov 01 19:05:16.197200 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Domain-Id: default Nov 01 19:05:16.197200 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Domain-Name: Default Nov 01 19:05:16.197200 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Id: 1ee9dc49b89143f781e4ab30296e4d01 Nov 01 19:05:16.197200 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Name: tempest-DeleteServersTestJSON-412339701 Nov 01 19:05:16.197200 n-d-863052-2 devstack@n-api.service[121402]: X-Role: member,reader Nov 01 19:05:16.197200 n-d-863052-2 devstack@n-api.service[121402]: X-Roles: member,reader Nov 01 19:05:16.197200 n-d-863052-2 devstack@n-api.service[121402]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/1ee9dc49b89143f781e4ab30296e4d01"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/1ee9dc49b89143f781e4ab30296e4d01"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_1ee9dc49b89143f781e4ab30296e4d01", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/1ee9dc49b89143f781e4ab30296e4d01"}]}] Nov 01 19:05:16.197200 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant: tempest-DeleteServersTestJSON-412339701 Nov 01 19:05:16.197200 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant-Id: 1ee9dc49b89143f781e4ab30296e4d01 Nov 01 19:05:16.197200 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant-Name: tempest-DeleteServersTestJSON-412339701 Nov 01 19:05:16.197200 n-d-863052-2 devstack@n-api.service[121402]: X-User: tempest-DeleteServersTestJSON-412339701-project Nov 01 19:05:16.197200 n-d-863052-2 devstack@n-api.service[121402]: X-User-Domain-Id: default Nov 01 19:05:16.197200 n-d-863052-2 devstack@n-api.service[121402]: X-User-Domain-Name: Default Nov 01 19:05:16.197200 n-d-863052-2 devstack@n-api.service[121402]: X-User-Id: 058480d92c9b4ab4af6815d0438a65c7 Nov 01 19:05:16.197200 n-d-863052-2 devstack@n-api.service[121402]: X-User-Name: tempest-DeleteServersTestJSON-412339701-project Nov 01 19:05:16.197200 n-d-863052-2 devstack@n-api.service[121402]: method: > Nov 01 19:05:16.197200 n-d-863052-2 devstack@n-api.service[121402]: exception: Instance e760fc87-dcc8-47ae-8bf1-014248a1c1b4 could not be found. Nov 01 19:05:16.197200 n-d-863052-2 devstack@n-api.service[121402]: action_args: {'id': 'e760fc87-dcc8-47ae-8bf1-014248a1c1b4'} Nov 01 19:05:16.197200 n-d-863052-2 devstack@n-api.service[121402]: {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 01 19:05:16.197200 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:05:16.197200 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 01 19:05:16.197200 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 01 19:05:16.197200 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 01 19:05:16.197200 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 01 19:05:16.197200 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 01 19:05:16.197200 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 01 19:05:16.197200 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 01 19:05:16.197200 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 01 19:05:16.197200 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e760fc87-dcc8-47ae-8bf1-014248a1c1b4 could not be found. Nov 01 19:05:16.197200 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:05:16.197200 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:05:16.197200 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:05:16.197200 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:05:16.197200 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:05:16.197200 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:05:16.197200 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 01 19:05:16.197200 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 01 19:05:16.197200 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 01 19:05:16.197200 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 01 19:05:16.197200 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 01 19:05:16.197200 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 01 19:05:16.197200 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 01 19:05:16.197200 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 01 19:05:16.197200 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 01 19:05:16.197200 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 01 19:05:16.197200 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e760fc87-dcc8-47ae-8bf1-014248a1c1b4 could not be found. Nov 01 19:05:16.197200 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:05:16.197200 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:05:16.197200 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:05:16.201361 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:05:16.201361 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:05:16.201361 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:05:16.201361 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 01 19:05:16.201361 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 01 19:05:16.201361 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e760fc87-dcc8-47ae-8bf1-014248a1c1b4 could not be found. Nov 01 19:05:16.201361 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:05:16.206589 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-359c1b22-50f3-4bea-98ce-ac81c11051d9 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Returning 404 to user: Instance e760fc87-dcc8-47ae-8bf1-014248a1c1b4 could not be found. {{(pid=121402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 01 19:05:16.209290 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-359c1b22-50f3-4bea-98ce-ac81c11051d9 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] 10.222.0.13 "GET /compute/v2.1/servers/e760fc87-dcc8-47ae-8bf1-014248a1c1b4" status: 404 len: 111 microversion: 2.1 time: 0.078152 Nov 01 19:05:16.210523 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1390/2809] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:05:16 2022] GET /compute/v2.1/servers/e760fc87-dcc8-47ae-8bf1-014248a1c1b4 => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 01 19:05:16.377976 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-8468bb07-548f-4fed-89b2-ef6ae430dcb0 tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:05:16.378868 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-8468bb07-548f-4fed-89b2-ef6ae430dcb0 tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] [instance: 307ee785-a01d-401c-8be2-b17558e735f3] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:05:16.389545 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-8468bb07-548f-4fed-89b2-ef6ae430dcb0 tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:05:16.392312 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-8468bb07-548f-4fed-89b2-ef6ae430dcb0 tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:05:16.392996 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-8468bb07-548f-4fed-89b2-ef6ae430dcb0 tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:05:16.398166 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-8468bb07-548f-4fed-89b2-ef6ae430dcb0 tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:05:16.398762 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-8468bb07-548f-4fed-89b2-ef6ae430dcb0 tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:05:16.399276 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-8468bb07-548f-4fed-89b2-ef6ae430dcb0 tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:05:16.970938 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-b9ae2fb8-0f0c-450a-9ad6-6415920ae5af tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05d6a1722dfa4e959aeb14d601e43b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b5d812eff94e2f89d4705d7e7d5f3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:05:16.982668 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-b9ae2fb8-0f0c-450a-9ad6-6415920ae5af tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] 10.222.0.13 "GET /compute/v2.1/servers/b58b3cb6-ebdc-4705-b308-4e804cd52bce" status: 200 len: 1318 microversion: 2.1 time: 0.978523 Nov 01 19:05:16.983282 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1420/2810] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:05:16 2022] GET /compute/v2.1/servers/b58b3cb6-ebdc-4705-b308-4e804cd52bce => generated 1318 bytes in 982 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:05:17.010935 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-13101621-a7a6-4d69-8b58-b15427473934 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-288964259", "imageRef": "2d4a0047-1b9e-445f-8af8-1b5c9d93e881", "flavorRef": "452", "networks": [{"uuid": "6da1da8d-6719-4a9a-851f-308df797b88a"}]}} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:05:17.117879 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.network.neutron [None req-13101621-a7a6-4d69-8b58-b15427473934 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] validate_networks() for [('6da1da8d-6719-4a9a-851f-308df797b88a', None, None, None, None, None)] {{(pid=121403) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 01 19:05:17.487606 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-8468bb07-548f-4fed-89b2-ef6ae430dcb0 tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb87e6147a6f470391921ac3b7a62f8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6511ea24c4c19a7c5d91535c7288d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:05:17.497259 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-8468bb07-548f-4fed-89b2-ef6ae430dcb0 tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] 10.222.0.13 "GET /compute/v2.1/servers/307ee785-a01d-401c-8be2-b17558e735f3" status: 200 len: 1324 microversion: 2.1 time: 1.123381 Nov 01 19:05:17.517399 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1391/2811] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:05:16 2022] GET /compute/v2.1/servers/307ee785-a01d-401c-8be2-b17558e735f3 => generated 1324 bytes in 1144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 19:05:17.526743 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-ecedbab0-9c50-4844-bb43-715bb9371c26 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-1943651809", "imageRef": "2d4a0047-1b9e-445f-8af8-1b5c9d93e881", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "d08a2f66-dbb5-431c-9cfe-f0258d22c804"}, {"port": "dfd99717-c078-4f2f-8d17-1602cd9ea3ae", "tag": "port-1"}, {"port": "a5bd9833-1398-4c45-bb02-ef165982e99c", "tag": "port-2"}, {"uuid": "7b574426-7b66-4219-9be3-d0cecd74dbde", "tag": "net-1"}, {"uuid": "7b574426-7b66-4219-9be3-d0cecd74dbde"}, {"uuid": "b2b87e03-00a2-479d-9578-abc0dcd1643c", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "b2b87e03-00a2-479d-9578-abc0dcd1643c", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "d3bb98ab-c202-4923-835b-600b057f4a4c", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "454961c7-8e2d-4736-9d50-c40c42aaa316", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "9dc75250-c065-4276-a636-54b94bace3e0", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--1247594704"}], "key_name": "tempest-keypair-1185576951", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:05:17.792397 n-d-863052-2 devstack@n-api.service[121403]: DEBUG dbcounter [-] [121403] Writing DB stats nova_cell0:SELECT=4 {{(pid=121403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 19:05:17.994044 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.network.neutron [None req-ecedbab0-9c50-4844-bb43-715bb9371c26 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] validate_networks() for [('d08a2f66-dbb5-431c-9cfe-f0258d22c804', None, None, None, None, None), (None, None, 'dfd99717-c078-4f2f-8d17-1602cd9ea3ae', None, None, None), (None, None, 'a5bd9833-1398-4c45-bb02-ef165982e99c', None, None, None), ('7b574426-7b66-4219-9be3-d0cecd74dbde', None, None, None, None, None), ('7b574426-7b66-4219-9be3-d0cecd74dbde', None, None, None, None, None), ('b2b87e03-00a2-479d-9578-abc0dcd1643c', '10.2.2.100', None, None, None, None), ('b2b87e03-00a2-479d-9578-abc0dcd1643c', '10.2.2.200', None, None, None, None)] {{(pid=121402) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 01 19:05:18.927226 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.virt.hardware [None req-13101621-a7a6-4d69-8b58-b15427473934 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Flavor limits 0:0:0 {{(pid=121403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 01 19:05:18.928430 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.virt.hardware [None req-13101621-a7a6-4d69-8b58-b15427473934 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Image limits 0:0:0 {{(pid=121403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 01 19:05:18.929164 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.virt.hardware [None req-13101621-a7a6-4d69-8b58-b15427473934 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Flavor pref 0:0:0 {{(pid=121403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 01 19:05:18.929930 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.virt.hardware [None req-13101621-a7a6-4d69-8b58-b15427473934 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Image pref 0:0:0 {{(pid=121403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 01 19:05:18.930562 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.virt.hardware [None req-13101621-a7a6-4d69-8b58-b15427473934 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 01 19:05:18.962382 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-13101621-a7a6-4d69-8b58-b15427473934 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:05:18.963253 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-13101621-a7a6-4d69-8b58-b15427473934 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:05:18.963936 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-13101621-a7a6-4d69-8b58-b15427473934 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:05:18.965921 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-13101621-a7a6-4d69-8b58-b15427473934 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:05:18.969460 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-13101621-a7a6-4d69-8b58-b15427473934 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:05:18.969917 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-13101621-a7a6-4d69-8b58-b15427473934 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:05:19.027331 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.quota [None req-13101621-a7a6-4d69-8b58-b15427473934 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Getting quotas for project 1ee9dc49b89143f781e4ab30296e4d01. Resources: {'cores', 'ram', 'instances'} {{(pid=121403) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 01 19:05:19.045559 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.quota [None req-13101621-a7a6-4d69-8b58-b15427473934 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Getting quotas for user 058480d92c9b4ab4af6815d0438a65c7 and project 1ee9dc49b89143f781e4ab30296e4d01. Resources: {'cores', 'ram', 'instances'} {{(pid=121403) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 01 19:05:19.099728 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-13101621-a7a6-4d69-8b58-b15427473934 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Going to run 1 instances... {{(pid=121403) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 01 19:05:19.099728 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-13101621-a7a6-4d69-8b58-b15427473934 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] [instance: 990f3535-a5c4-4f62-bed9-b310a77293c8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2d4a0047-1b9e-445f-8af8-1b5c9d93e881',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121403) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 01 19:05:19.243091 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-13101621-a7a6-4d69-8b58-b15427473934 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.249086 Nov 01 19:05:19.244098 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1421/2812] 10.222.0.13 () {60 vars in 1147 bytes} [Tue Nov 1 19:05:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 2260 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 01 19:05:19.253663 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-3bbadc79-2d94-4bc0-9b64-2c8694554ec0 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:05:19.254286 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-3bbadc79-2d94-4bc0-9b64-2c8694554ec0 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] [instance: b58b3cb6-ebdc-4705-b308-4e804cd52bce] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:05:19.273441 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-3bbadc79-2d94-4bc0-9b64-2c8694554ec0 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:05:19.273952 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-3bbadc79-2d94-4bc0-9b64-2c8694554ec0 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:05:19.274392 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-3bbadc79-2d94-4bc0-9b64-2c8694554ec0 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:05:19.275112 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-3bbadc79-2d94-4bc0-9b64-2c8694554ec0 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:05:19.275825 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-3bbadc79-2d94-4bc0-9b64-2c8694554ec0 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:05:19.276420 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-3bbadc79-2d94-4bc0-9b64-2c8694554ec0 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:05:20.542056 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-3bbadc79-2d94-4bc0-9b64-2c8694554ec0 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05d6a1722dfa4e959aeb14d601e43b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b5d812eff94e2f89d4705d7e7d5f3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:05:20.553775 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-3bbadc79-2d94-4bc0-9b64-2c8694554ec0 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] 10.222.0.13 "GET /compute/v2.1/servers/b58b3cb6-ebdc-4705-b308-4e804cd52bce" status: 200 len: 1508 microversion: 2.1 time: 1.308520 Nov 01 19:05:20.567811 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1422/2813] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:05:19 2022] GET /compute/v2.1/servers/b58b3cb6-ebdc-4705-b308-4e804cd52bce => generated 1508 bytes in 1323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:05:20.615104 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-d11ff059-5009-4d02-af80-ccb0e5bb0384 tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:05:20.615913 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-d11ff059-5009-4d02-af80-ccb0e5bb0384 tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] [instance: 307ee785-a01d-401c-8be2-b17558e735f3] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:05:20.664691 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d11ff059-5009-4d02-af80-ccb0e5bb0384 tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:05:20.666767 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d11ff059-5009-4d02-af80-ccb0e5bb0384 tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:05:20.670112 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d11ff059-5009-4d02-af80-ccb0e5bb0384 tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:05:20.672484 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d11ff059-5009-4d02-af80-ccb0e5bb0384 tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:05:20.673272 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d11ff059-5009-4d02-af80-ccb0e5bb0384 tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:05:20.676300 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d11ff059-5009-4d02-af80-ccb0e5bb0384 tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:05:21.532302 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-d11ff059-5009-4d02-af80-ccb0e5bb0384 tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb87e6147a6f470391921ac3b7a62f8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6511ea24c4c19a7c5d91535c7288d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:05:21.544898 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-d11ff059-5009-4d02-af80-ccb0e5bb0384 tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] 10.222.0.13 "GET /compute/v2.1/servers/307ee785-a01d-401c-8be2-b17558e735f3" status: 200 len: 1324 microversion: 2.1 time: 0.973837 Nov 01 19:05:21.546807 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1423/2814] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:05:20 2022] GET /compute/v2.1/servers/307ee785-a01d-401c-8be2-b17558e735f3 => generated 1324 bytes in 979 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:05:21.568774 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-1f8002ac-475a-4949-8498-7f1154fdf44e tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:05:21.569821 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-1f8002ac-475a-4949-8498-7f1154fdf44e tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] [instance: 990f3535-a5c4-4f62-bed9-b310a77293c8] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:05:21.590395 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-1f8002ac-475a-4949-8498-7f1154fdf44e tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:05:21.592344 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-1f8002ac-475a-4949-8498-7f1154fdf44e tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:05:21.594276 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-1f8002ac-475a-4949-8498-7f1154fdf44e tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:05:21.599133 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-1f8002ac-475a-4949-8498-7f1154fdf44e tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:05:21.611803 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-1f8002ac-475a-4949-8498-7f1154fdf44e tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:05:21.612793 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-1f8002ac-475a-4949-8498-7f1154fdf44e tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:05:21.848044 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-1f8002ac-475a-4949-8498-7f1154fdf44e tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '058480d92c9b4ab4af6815d0438a65c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee9dc49b89143f781e4ab30296e4d01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:05:21.860976 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-1f8002ac-475a-4949-8498-7f1154fdf44e tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] 10.222.0.13 "GET /compute/v2.1/servers/990f3535-a5c4-4f62-bed9-b310a77293c8" status: 200 len: 1274 microversion: 2.1 time: 0.307123 Nov 01 19:05:21.862933 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1424/2815] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:05:21 2022] GET /compute/v2.1/servers/990f3535-a5c4-4f62-bed9-b310a77293c8 => generated 1274 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:05:21.871048 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [req-dfa5e28e-c253-4950-9851-33c6e5ff4653 req-2f455b59-cab3-4f6a-8ddf-90ca2e9a3fa9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3029f3c1-4f32-4f6b-963c-16f65b6dff3c", "tag": "840ef8a7-6bc6-4d48-932b-14a3209a45e7"}]} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:05:21.882266 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-dfa5e28e-c253-4950-9851-33c6e5ff4653 req-2f455b59-cab3-4f6a-8ddf-90ca2e9a3fa9 service nova] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:05:21.882891 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-dfa5e28e-c253-4950-9851-33c6e5ff4653 req-2f455b59-cab3-4f6a-8ddf-90ca2e9a3fa9 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:05:21.883426 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-dfa5e28e-c253-4950-9851-33c6e5ff4653 req-2f455b59-cab3-4f6a-8ddf-90ca2e9a3fa9 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:05:21.902723 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.compute.server_external_events [req-dfa5e28e-c253-4950-9851-33c6e5ff4653 req-2f455b59-cab3-4f6a-8ddf-90ca2e9a3fa9 service nova] Creating event network-changed:840ef8a7-6bc6-4d48-932b-14a3209a45e7 for instance 3029f3c1-4f32-4f6b-963c-16f65b6dff3c on n-h1-863052-2 Nov 01 19:05:21.908748 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [req-dfa5e28e-c253-4950-9851-33c6e5ff4653 req-2f455b59-cab3-4f6a-8ddf-90ca2e9a3fa9 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043991 Nov 01 19:05:21.909760 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1425/2816] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Nov 1 19:05:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:05:21.917184 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-f7521515-0564-4bfb-bf54-e3e3e525737c tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:05:21.918230 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-f7521515-0564-4bfb-bf54-e3e3e525737c tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] [instance: b58b3cb6-ebdc-4705-b308-4e804cd52bce] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:05:21.929236 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f7521515-0564-4bfb-bf54-e3e3e525737c tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:05:21.930096 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f7521515-0564-4bfb-bf54-e3e3e525737c tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:05:21.930763 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f7521515-0564-4bfb-bf54-e3e3e525737c tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:05:21.931714 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f7521515-0564-4bfb-bf54-e3e3e525737c tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:05:21.932655 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f7521515-0564-4bfb-bf54-e3e3e525737c tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:05:21.933301 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f7521515-0564-4bfb-bf54-e3e3e525737c tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:05:22.372823 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-f7521515-0564-4bfb-bf54-e3e3e525737c tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05d6a1722dfa4e959aeb14d601e43b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b5d812eff94e2f89d4705d7e7d5f3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:05:22.384133 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-f7521515-0564-4bfb-bf54-e3e3e525737c tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] 10.222.0.13 "GET /compute/v2.1/servers/b58b3cb6-ebdc-4705-b308-4e804cd52bce" status: 200 len: 1508 microversion: 2.1 time: 0.472823 Nov 01 19:05:22.386028 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1426/2817] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:05:21 2022] GET /compute/v2.1/servers/b58b3cb6-ebdc-4705-b308-4e804cd52bce => generated 1508 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:05:22.549789 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-e0975b8d-8f90-487f-b591-add03961b18a tempest-ServerGroupTestJSON-2134213834 tempest-ServerGroupTestJSON-2134213834-project] Action: 'create', calling method: .version_select at 0x7f0ae66e24c0>, body: {"server_group": {"name": "tempest-ServerGroupTestJSON-Server-Group-1448865459", "policies": ["affinity"]}} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:05:22.570364 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.quota [None req-e0975b8d-8f90-487f-b591-add03961b18a tempest-ServerGroupTestJSON-2134213834 tempest-ServerGroupTestJSON-2134213834-project] Getting quotas for project 6b6c42eec3544f3c820c0b0ce6f2f1f9. Resources: {'server_groups'} {{(pid=121403) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 01 19:05:22.575868 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.quota [None req-e0975b8d-8f90-487f-b591-add03961b18a tempest-ServerGroupTestJSON-2134213834 tempest-ServerGroupTestJSON-2134213834-project] Getting quotas for user b0ef831ef96b4e5a983061fc8c7cf13d and project 6b6c42eec3544f3c820c0b0ce6f2f1f9. Resources: {'server_groups'} {{(pid=121403) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 01 19:05:22.614454 n-d-863052-2 devstack@n-api.service[121403]: DEBUG dbcounter [-] [121403] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=121403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 19:05:22.661894 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.quota [None req-e0975b8d-8f90-487f-b591-add03961b18a tempest-ServerGroupTestJSON-2134213834 tempest-ServerGroupTestJSON-2134213834-project] Getting quotas for project 6b6c42eec3544f3c820c0b0ce6f2f1f9. Resources: {'server_groups'} {{(pid=121403) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 01 19:05:22.674105 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.quota [None req-e0975b8d-8f90-487f-b591-add03961b18a tempest-ServerGroupTestJSON-2134213834 tempest-ServerGroupTestJSON-2134213834-project] Getting quotas for user b0ef831ef96b4e5a983061fc8c7cf13d and project 6b6c42eec3544f3c820c0b0ce6f2f1f9. Resources: {'server_groups'} {{(pid=121403) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 01 19:05:22.701223 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-e0975b8d-8f90-487f-b591-add03961b18a tempest-ServerGroupTestJSON-2134213834 tempest-ServerGroupTestJSON-2134213834-project] 10.222.0.13 "POST /compute/v2.1/os-server-groups" status: 200 len: 184 microversion: 2.1 time: 0.313101 Nov 01 19:05:22.703282 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1427/2818] 10.222.0.13 () {60 vars in 1174 bytes} [Tue Nov 1 19:05:22 2022] POST /compute/v2.1/os-server-groups => generated 184 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:05:22.709394 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-7c611021-1c27-40a7-9634-902068f69430 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "2d4a0047-1b9e-445f-8af8-1b5c9d93e881", "OS-DCF:diskConfig": "AUTO"}} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:05:22.713825 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-7c611021-1c27-40a7-9634-902068f69430 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] [instance: b58b3cb6-ebdc-4705-b308-4e804cd52bce] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:05:22.722744 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-7c611021-1c27-40a7-9634-902068f69430 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:05:22.723790 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-7c611021-1c27-40a7-9634-902068f69430 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:05:22.724396 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-7c611021-1c27-40a7-9634-902068f69430 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:05:22.725430 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-7c611021-1c27-40a7-9634-902068f69430 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:05:22.726058 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-7c611021-1c27-40a7-9634-902068f69430 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:05:22.726664 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-7c611021-1c27-40a7-9634-902068f69430 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:05:22.866279 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.virt.hardware [None req-7c611021-1c27-40a7-9634-902068f69430 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Flavor limits 0:0:0 {{(pid=121403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 01 19:05:22.866950 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.virt.hardware [None req-7c611021-1c27-40a7-9634-902068f69430 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Image limits 0:0:0 {{(pid=121403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 01 19:05:22.867442 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.virt.hardware [None req-7c611021-1c27-40a7-9634-902068f69430 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Flavor pref 0:0:0 {{(pid=121403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 01 19:05:22.868025 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.virt.hardware [None req-7c611021-1c27-40a7-9634-902068f69430 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Image pref 0:0:0 {{(pid=121403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 01 19:05:22.868454 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.virt.hardware [None req-7c611021-1c27-40a7-9634-902068f69430 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 01 19:05:22.879818 n-d-863052-2 devstack@n-api.service[121402]: DEBUG dbcounter [-] [121402] Writing DB stats nova_cell0:SELECT=2 {{(pid=121402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 19:05:23.023085 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-7c611021-1c27-40a7-9634-902068f69430 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] [instance: b58b3cb6-ebdc-4705-b308-4e804cd52bce] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:05:23.035846 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-7c611021-1c27-40a7-9634-902068f69430 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:05:23.036359 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-7c611021-1c27-40a7-9634-902068f69430 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:05:23.036841 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-7c611021-1c27-40a7-9634-902068f69430 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:05:23.037592 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-7c611021-1c27-40a7-9634-902068f69430 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:05:23.038063 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-7c611021-1c27-40a7-9634-902068f69430 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:05:23.038499 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-7c611021-1c27-40a7-9634-902068f69430 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:05:23.151719 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-7c611021-1c27-40a7-9634-902068f69430 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] 10.222.0.13 "POST /compute/v2.1/servers/b58b3cb6-ebdc-4705-b308-4e804cd52bce/action" status: 202 len: 1110 microversion: 2.1 time: 0.447125 Nov 01 19:05:23.170482 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1428/2819] 10.222.0.13 () {60 vars in 1278 bytes} [Tue Nov 1 19:05:22 2022] POST /compute/v2.1/servers/b58b3cb6-ebdc-4705-b308-4e804cd52bce/action => generated 1110 bytes in 466 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Nov 01 19:05:23.194971 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-d0eebe07-320a-4582-bffd-39bb644d0ef8 tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:05:23.213539 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-d0eebe07-320a-4582-bffd-39bb644d0ef8 tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] [instance: 307ee785-a01d-401c-8be2-b17558e735f3] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:05:23.242927 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d0eebe07-320a-4582-bffd-39bb644d0ef8 tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:05:23.243426 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d0eebe07-320a-4582-bffd-39bb644d0ef8 tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:05:23.243876 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d0eebe07-320a-4582-bffd-39bb644d0ef8 tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:05:23.248247 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d0eebe07-320a-4582-bffd-39bb644d0ef8 tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:05:23.248247 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d0eebe07-320a-4582-bffd-39bb644d0ef8 tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:05:23.248548 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d0eebe07-320a-4582-bffd-39bb644d0ef8 tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:05:23.738137 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-d0eebe07-320a-4582-bffd-39bb644d0ef8 tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb87e6147a6f470391921ac3b7a62f8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6511ea24c4c19a7c5d91535c7288d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:05:23.750331 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-d0eebe07-320a-4582-bffd-39bb644d0ef8 tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] 10.222.0.13 "GET /compute/v2.1/servers/307ee785-a01d-401c-8be2-b17558e735f3" status: 200 len: 1324 microversion: 2.1 time: 0.577427 Nov 01 19:05:23.752430 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1429/2820] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:05:23 2022] GET /compute/v2.1/servers/307ee785-a01d-401c-8be2-b17558e735f3 => generated 1324 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:05:23.778979 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [req-b13c5e57-151b-4a74-b8d2-440b51e7a334 req-7d5f852f-89f2-49df-af4e-c0ee828f9f66 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "307ee785-a01d-401c-8be2-b17558e735f3", "tag": "d65b5fcd-5bb6-4feb-b4bf-95734bcb3072"}]} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:05:23.801389 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-b13c5e57-151b-4a74-b8d2-440b51e7a334 req-7d5f852f-89f2-49df-af4e-c0ee828f9f66 service nova] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:05:23.801877 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-b13c5e57-151b-4a74-b8d2-440b51e7a334 req-7d5f852f-89f2-49df-af4e-c0ee828f9f66 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:05:23.802317 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-b13c5e57-151b-4a74-b8d2-440b51e7a334 req-7d5f852f-89f2-49df-af4e-c0ee828f9f66 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:05:23.815247 n-d-863052-2 devstack@n-api.service[121403]: DEBUG dbcounter [-] [121403] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=121403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 19:05:23.839432 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.compute.server_external_events [req-b13c5e57-151b-4a74-b8d2-440b51e7a334 req-7d5f852f-89f2-49df-af4e-c0ee828f9f66 service nova] Creating event network-changed:d65b5fcd-5bb6-4feb-b4bf-95734bcb3072 for instance 307ee785-a01d-401c-8be2-b17558e735f3 on n-h2-863052-2 Nov 01 19:05:23.850487 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [req-b13c5e57-151b-4a74-b8d2-440b51e7a334 req-7d5f852f-89f2-49df-af4e-c0ee828f9f66 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083094 Nov 01 19:05:23.851361 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1430/2821] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Nov 1 19:05:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:05:23.862943 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-77beec54-a50a-41df-b502-ba0d829da910 tempest-ServerGroupTestJSON-2134213834 tempest-ServerGroupTestJSON-2134213834-project] Action: 'create', calling method: .version_select at 0x7f0ae2051b80>, body: {"server_group": {"name": "tempest-server-group-406321398", "policies": ["affinity"]}} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:05:23.884449 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.quota [None req-77beec54-a50a-41df-b502-ba0d829da910 tempest-ServerGroupTestJSON-2134213834 tempest-ServerGroupTestJSON-2134213834-project] Getting quotas for project 6b6c42eec3544f3c820c0b0ce6f2f1f9. Resources: {'server_groups'} {{(pid=121403) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 01 19:05:23.892944 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.quota [None req-77beec54-a50a-41df-b502-ba0d829da910 tempest-ServerGroupTestJSON-2134213834 tempest-ServerGroupTestJSON-2134213834-project] Getting quotas for user b0ef831ef96b4e5a983061fc8c7cf13d and project 6b6c42eec3544f3c820c0b0ce6f2f1f9. Resources: {'server_groups'} {{(pid=121403) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 01 19:05:23.990166 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.quota [None req-77beec54-a50a-41df-b502-ba0d829da910 tempest-ServerGroupTestJSON-2134213834 tempest-ServerGroupTestJSON-2134213834-project] Getting quotas for project 6b6c42eec3544f3c820c0b0ce6f2f1f9. Resources: {'server_groups'} {{(pid=121403) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 01 19:05:23.996642 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.quota [None req-77beec54-a50a-41df-b502-ba0d829da910 tempest-ServerGroupTestJSON-2134213834 tempest-ServerGroupTestJSON-2134213834-project] Getting quotas for user b0ef831ef96b4e5a983061fc8c7cf13d and project 6b6c42eec3544f3c820c0b0ce6f2f1f9. Resources: {'server_groups'} {{(pid=121403) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 01 19:05:24.013395 n-d-863052-2 devstack@n-api.service[121402]: DEBUG dbcounter [-] [121402] Writing DB stats nova_cell0:SELECT=8 {{(pid=121402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 19:05:24.017949 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-77beec54-a50a-41df-b502-ba0d829da910 tempest-ServerGroupTestJSON-2134213834 tempest-ServerGroupTestJSON-2134213834-project] 10.222.0.13 "POST /compute/v2.1/os-server-groups" status: 200 len: 163 microversion: 2.1 time: 0.165189 Nov 01 19:05:24.019105 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1431/2822] 10.222.0.13 () {60 vars in 1173 bytes} [Tue Nov 1 19:05:23 2022] POST /compute/v2.1/os-server-groups => generated 163 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:05:24.027692 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-cbd0a150-9a59-41d7-8255-31dfd9a2471b tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:05:24.029185 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-cbd0a150-9a59-41d7-8255-31dfd9a2471b tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] [instance: 990f3535-a5c4-4f62-bed9-b310a77293c8] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:05:24.037812 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-cbd0a150-9a59-41d7-8255-31dfd9a2471b tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:05:24.038631 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-cbd0a150-9a59-41d7-8255-31dfd9a2471b tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:05:24.039102 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-cbd0a150-9a59-41d7-8255-31dfd9a2471b tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:05:24.039860 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-cbd0a150-9a59-41d7-8255-31dfd9a2471b tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:05:24.040346 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-cbd0a150-9a59-41d7-8255-31dfd9a2471b tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:05:24.040895 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-cbd0a150-9a59-41d7-8255-31dfd9a2471b tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:05:24.140240 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-cbd0a150-9a59-41d7-8255-31dfd9a2471b tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '058480d92c9b4ab4af6815d0438a65c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee9dc49b89143f781e4ab30296e4d01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:05:24.149562 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-cbd0a150-9a59-41d7-8255-31dfd9a2471b tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] 10.222.0.13 "GET /compute/v2.1/servers/990f3535-a5c4-4f62-bed9-b310a77293c8" status: 200 len: 1272 microversion: 2.1 time: 0.127810 Nov 01 19:05:24.152437 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1432/2823] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:05:24 2022] GET /compute/v2.1/servers/990f3535-a5c4-4f62-bed9-b310a77293c8 => generated 1272 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:05:24.157575 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-c9506870-5e4d-420d-9f4b-b12d9e57e8b8 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:05:24.158181 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-c9506870-5e4d-420d-9f4b-b12d9e57e8b8 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] [instance: b58b3cb6-ebdc-4705-b308-4e804cd52bce] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:05:24.167253 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-c9506870-5e4d-420d-9f4b-b12d9e57e8b8 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:05:24.167813 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-c9506870-5e4d-420d-9f4b-b12d9e57e8b8 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:05:24.168366 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-c9506870-5e4d-420d-9f4b-b12d9e57e8b8 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:05:24.169012 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-c9506870-5e4d-420d-9f4b-b12d9e57e8b8 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:05:24.169462 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-c9506870-5e4d-420d-9f4b-b12d9e57e8b8 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:05:24.169880 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-c9506870-5e4d-420d-9f4b-b12d9e57e8b8 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:05:24.372429 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-c9506870-5e4d-420d-9f4b-b12d9e57e8b8 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05d6a1722dfa4e959aeb14d601e43b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b5d812eff94e2f89d4705d7e7d5f3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:05:24.381814 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-c9506870-5e4d-420d-9f4b-b12d9e57e8b8 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] 10.222.0.13 "GET /compute/v2.1/servers/b58b3cb6-ebdc-4705-b308-4e804cd52bce" status: 200 len: 1515 microversion: 2.1 time: 0.228722 Nov 01 19:05:24.382482 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1433/2824] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:05:24 2022] GET /compute/v2.1/servers/b58b3cb6-ebdc-4705-b308-4e804cd52bce => generated 1515 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:05:24.387262 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-ded20a5d-8a7a-43cf-8f8d-fe7265404ea9 tempest-ServerGroupTestJSON-2134213834 tempest-ServerGroupTestJSON-2134213834-project] Action: 'create', calling method: .version_select at 0x7f0ae66e44c0>, body: {"server_group": {"name": "tempest-server-group-406321398", "policies": ["affinity"]}} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:05:24.406482 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.quota [None req-ded20a5d-8a7a-43cf-8f8d-fe7265404ea9 tempest-ServerGroupTestJSON-2134213834 tempest-ServerGroupTestJSON-2134213834-project] Getting quotas for project 6b6c42eec3544f3c820c0b0ce6f2f1f9. Resources: {'server_groups'} {{(pid=121403) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 01 19:05:24.414144 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.quota [None req-ded20a5d-8a7a-43cf-8f8d-fe7265404ea9 tempest-ServerGroupTestJSON-2134213834 tempest-ServerGroupTestJSON-2134213834-project] Getting quotas for user b0ef831ef96b4e5a983061fc8c7cf13d and project 6b6c42eec3544f3c820c0b0ce6f2f1f9. Resources: {'server_groups'} {{(pid=121403) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 01 19:05:24.467323 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.quota [None req-ded20a5d-8a7a-43cf-8f8d-fe7265404ea9 tempest-ServerGroupTestJSON-2134213834 tempest-ServerGroupTestJSON-2134213834-project] Getting quotas for project 6b6c42eec3544f3c820c0b0ce6f2f1f9. Resources: {'server_groups'} {{(pid=121403) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 01 19:05:24.476907 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.quota [None req-ded20a5d-8a7a-43cf-8f8d-fe7265404ea9 tempest-ServerGroupTestJSON-2134213834 tempest-ServerGroupTestJSON-2134213834-project] Getting quotas for user b0ef831ef96b4e5a983061fc8c7cf13d and project 6b6c42eec3544f3c820c0b0ce6f2f1f9. Resources: {'server_groups'} {{(pid=121403) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 01 19:05:24.496379 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-ded20a5d-8a7a-43cf-8f8d-fe7265404ea9 tempest-ServerGroupTestJSON-2134213834 tempest-ServerGroupTestJSON-2134213834-project] 10.222.0.13 "POST /compute/v2.1/os-server-groups" status: 200 len: 163 microversion: 2.1 time: 0.112744 Nov 01 19:05:24.497224 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1434/2825] 10.222.0.13 () {60 vars in 1173 bytes} [Tue Nov 1 19:05:24 2022] POST /compute/v2.1/os-server-groups => generated 163 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:05:24.508441 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-7ab5e817-ad42-468c-b2c3-3315dda815a9 tempest-ServerGroupTestJSON-2134213834 tempest-ServerGroupTestJSON-2134213834-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:05:24.541830 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-7ab5e817-ad42-468c-b2c3-3315dda815a9 tempest-ServerGroupTestJSON-2134213834 tempest-ServerGroupTestJSON-2134213834-project] 10.222.0.13 "DELETE /compute/v2.1/os-server-groups/b4fe75e0-0209-4676-bc7e-5fc9018514a8" status: 204 len: 0 microversion: 2.1 time: 0.037246 Nov 01 19:05:24.542800 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1435/2826] 10.222.0.13 () {58 vars in 1266 bytes} [Tue Nov 1 19:05:24 2022] DELETE /compute/v2.1/os-server-groups/b4fe75e0-0209-4676-bc7e-5fc9018514a8 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 01 19:05:24.564721 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-77b8b6b1-31a5-473b-b6e2-bfa9b1b7f3ad tempest-ServerGroupTestJSON-2134213834 tempest-ServerGroupTestJSON-2134213834-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:05:24.582213 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-77b8b6b1-31a5-473b-b6e2-bfa9b1b7f3ad tempest-ServerGroupTestJSON-2134213834 tempest-ServerGroupTestJSON-2134213834-project] 10.222.0.13 "GET /compute/v2.1/os-server-groups" status: 200 len: 334 microversion: 2.1 time: 0.033580 Nov 01 19:05:24.583291 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1436/2827] 10.222.0.13 () {58 vars in 1152 bytes} [Tue Nov 1 19:05:24 2022] GET /compute/v2.1/os-server-groups => generated 334 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 01 19:05:24.594446 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-42dc29e7-4374-4e2b-b237-85ee16ffae3d tempest-ServerGroupTestJSON-2134213834 tempest-ServerGroupTestJSON-2134213834-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:05:24.627480 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-42dc29e7-4374-4e2b-b237-85ee16ffae3d tempest-ServerGroupTestJSON-2134213834 tempest-ServerGroupTestJSON-2134213834-project] 10.222.0.13 "DELETE /compute/v2.1/os-server-groups/a2a13889-6b5d-42d0-ac8c-866c6c092080" status: 204 len: 0 microversion: 2.1 time: 0.036933 Nov 01 19:05:24.628564 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1437/2828] 10.222.0.13 () {58 vars in 1266 bytes} [Tue Nov 1 19:05:24 2022] DELETE /compute/v2.1/os-server-groups/a2a13889-6b5d-42d0-ac8c-866c6c092080 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 01 19:05:24.638070 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-ed8a5aff-2d2b-4b8d-84c0-3f0274c1eaf0 tempest-ServerGroupTestJSON-2134213834 tempest-ServerGroupTestJSON-2134213834-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:05:24.650390 n-d-863052-2 devstack@n-api.service[121403]: DEBUG dbcounter [-] [121403] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=4,nova_api:DELETE=6 {{(pid=121403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 19:05:24.654410 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-ed8a5aff-2d2b-4b8d-84c0-3f0274c1eaf0 tempest-ServerGroupTestJSON-2134213834 tempest-ServerGroupTestJSON-2134213834-project] 10.222.0.13 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.020669 Nov 01 19:05:24.655154 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1438/2829] 10.222.0.13 () {58 vars in 1152 bytes} [Tue Nov 1 19:05:24 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 01 19:05:24.670601 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-00fcd610-e320-4022-a8ac-44e1838d2e58 tempest-ServerGroupTestJSON-2134213834 tempest-ServerGroupTestJSON-2134213834-project] Action: 'create', calling method: .version_select at 0x7f0ae66e4d30>, body: {"server_group": {"name": "tempest-server-group-728813896", "policies": ["affinity"]}} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:05:24.695956 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.quota [None req-00fcd610-e320-4022-a8ac-44e1838d2e58 tempest-ServerGroupTestJSON-2134213834 tempest-ServerGroupTestJSON-2134213834-project] Getting quotas for project 6b6c42eec3544f3c820c0b0ce6f2f1f9. Resources: {'server_groups'} {{(pid=121403) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 01 19:05:24.702526 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.quota [None req-00fcd610-e320-4022-a8ac-44e1838d2e58 tempest-ServerGroupTestJSON-2134213834 tempest-ServerGroupTestJSON-2134213834-project] Getting quotas for user b0ef831ef96b4e5a983061fc8c7cf13d and project 6b6c42eec3544f3c820c0b0ce6f2f1f9. Resources: {'server_groups'} {{(pid=121403) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 01 19:05:24.756887 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.quota [None req-00fcd610-e320-4022-a8ac-44e1838d2e58 tempest-ServerGroupTestJSON-2134213834 tempest-ServerGroupTestJSON-2134213834-project] Getting quotas for project 6b6c42eec3544f3c820c0b0ce6f2f1f9. Resources: {'server_groups'} {{(pid=121403) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 01 19:05:24.762395 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.quota [None req-00fcd610-e320-4022-a8ac-44e1838d2e58 tempest-ServerGroupTestJSON-2134213834 tempest-ServerGroupTestJSON-2134213834-project] Getting quotas for user b0ef831ef96b4e5a983061fc8c7cf13d and project 6b6c42eec3544f3c820c0b0ce6f2f1f9. Resources: {'server_groups'} {{(pid=121403) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 01 19:05:24.777769 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-00fcd610-e320-4022-a8ac-44e1838d2e58 tempest-ServerGroupTestJSON-2134213834 tempest-ServerGroupTestJSON-2134213834-project] 10.222.0.13 "POST /compute/v2.1/os-server-groups" status: 200 len: 163 microversion: 2.1 time: 0.110849 Nov 01 19:05:24.784867 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1439/2830] 10.222.0.13 () {60 vars in 1173 bytes} [Tue Nov 1 19:05:24 2022] POST /compute/v2.1/os-server-groups => generated 163 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 01 19:05:24.790112 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-79f96bca-a1e0-4d55-927e-f84327f531c4 tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:05:24.790922 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-79f96bca-a1e0-4d55-927e-f84327f531c4 tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] [instance: 307ee785-a01d-401c-8be2-b17558e735f3] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:05:24.799886 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-79f96bca-a1e0-4d55-927e-f84327f531c4 tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:05:24.800520 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-79f96bca-a1e0-4d55-927e-f84327f531c4 tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:05:24.801106 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-79f96bca-a1e0-4d55-927e-f84327f531c4 tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:05:24.801913 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-79f96bca-a1e0-4d55-927e-f84327f531c4 tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:05:24.802490 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-79f96bca-a1e0-4d55-927e-f84327f531c4 tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:05:24.803016 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-79f96bca-a1e0-4d55-927e-f84327f531c4 tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:05:24.968042 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-79f96bca-a1e0-4d55-927e-f84327f531c4 tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb87e6147a6f470391921ac3b7a62f8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6511ea24c4c19a7c5d91535c7288d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:05:24.976892 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-79f96bca-a1e0-4d55-927e-f84327f531c4 tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] 10.222.0.13 "GET /compute/v2.1/servers/307ee785-a01d-401c-8be2-b17558e735f3" status: 200 len: 1324 microversion: 2.1 time: 0.190448 Nov 01 19:05:24.978752 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1440/2831] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:05:24 2022] GET /compute/v2.1/servers/307ee785-a01d-401c-8be2-b17558e735f3 => generated 1324 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:05:24.983733 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-abb1c817-375d-4f1b-83a3-14128c17daba tempest-ServerGroupTestJSON-2134213834 tempest-ServerGroupTestJSON-2134213834-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:05:25.022397 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-abb1c817-375d-4f1b-83a3-14128c17daba tempest-ServerGroupTestJSON-2134213834 tempest-ServerGroupTestJSON-2134213834-project] 10.222.0.13 "DELETE /compute/v2.1/os-server-groups/e893833d-69d6-43ee-ab33-162c45a738b5" status: 204 len: 0 microversion: 2.1 time: 0.041715 Nov 01 19:05:25.025947 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1441/2832] 10.222.0.13 () {58 vars in 1266 bytes} [Tue Nov 1 19:05:24 2022] DELETE /compute/v2.1/os-server-groups/e893833d-69d6-43ee-ab33-162c45a738b5 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 01 19:05:25.033454 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-db65c7a8-4b0f-4e8e-8451-3ddd402dc98f tempest-ServerGroupTestJSON-2134213834 tempest-ServerGroupTestJSON-2134213834-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:05:25.062507 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-db65c7a8-4b0f-4e8e-8451-3ddd402dc98f tempest-ServerGroupTestJSON-2134213834 tempest-ServerGroupTestJSON-2134213834-project] 10.222.0.13 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.034266 Nov 01 19:05:25.070930 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1442/2833] 10.222.0.13 () {58 vars in 1152 bytes} [Tue Nov 1 19:05:25 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:05:25.090236 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-006c5f5f-b2f1-49c7-b026-8787fce9e2ed tempest-ServerGroupTestJSON-2134213834 tempest-ServerGroupTestJSON-2134213834-project] Action: 'create', calling method: .version_select at 0x7f0ae66e4700>, body: {"server_group": {"name": "tempest-server-group-784107939", "policies": ["anti-affinity"]}} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:05:25.143775 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.quota [None req-006c5f5f-b2f1-49c7-b026-8787fce9e2ed tempest-ServerGroupTestJSON-2134213834 tempest-ServerGroupTestJSON-2134213834-project] Getting quotas for project 6b6c42eec3544f3c820c0b0ce6f2f1f9. Resources: {'server_groups'} {{(pid=121403) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 01 19:05:25.166022 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.quota [None req-006c5f5f-b2f1-49c7-b026-8787fce9e2ed tempest-ServerGroupTestJSON-2134213834 tempest-ServerGroupTestJSON-2134213834-project] Getting quotas for user b0ef831ef96b4e5a983061fc8c7cf13d and project 6b6c42eec3544f3c820c0b0ce6f2f1f9. Resources: {'server_groups'} {{(pid=121403) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 01 19:05:25.283252 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.quota [None req-006c5f5f-b2f1-49c7-b026-8787fce9e2ed tempest-ServerGroupTestJSON-2134213834 tempest-ServerGroupTestJSON-2134213834-project] Getting quotas for project 6b6c42eec3544f3c820c0b0ce6f2f1f9. Resources: {'server_groups'} {{(pid=121403) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 01 19:05:25.318430 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.quota [None req-006c5f5f-b2f1-49c7-b026-8787fce9e2ed tempest-ServerGroupTestJSON-2134213834 tempest-ServerGroupTestJSON-2134213834-project] Getting quotas for user b0ef831ef96b4e5a983061fc8c7cf13d and project 6b6c42eec3544f3c820c0b0ce6f2f1f9. Resources: {'server_groups'} {{(pid=121403) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 01 19:05:25.345490 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-006c5f5f-b2f1-49c7-b026-8787fce9e2ed tempest-ServerGroupTestJSON-2134213834 tempest-ServerGroupTestJSON-2134213834-project] 10.222.0.13 "POST /compute/v2.1/os-server-groups" status: 200 len: 168 microversion: 2.1 time: 0.265748 Nov 01 19:05:25.347185 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1443/2834] 10.222.0.13 () {60 vars in 1173 bytes} [Tue Nov 1 19:05:25 2022] POST /compute/v2.1/os-server-groups => generated 168 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:05:25.354729 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-935baf0d-e5ea-4080-943a-edb0649e2b23 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:05:25.358308 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-935baf0d-e5ea-4080-943a-edb0649e2b23 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] [instance: 990f3535-a5c4-4f62-bed9-b310a77293c8] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:05:25.368686 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-935baf0d-e5ea-4080-943a-edb0649e2b23 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:05:25.368881 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-935baf0d-e5ea-4080-943a-edb0649e2b23 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:05:25.369423 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-935baf0d-e5ea-4080-943a-edb0649e2b23 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:05:25.370252 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-935baf0d-e5ea-4080-943a-edb0649e2b23 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:05:25.370780 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-935baf0d-e5ea-4080-943a-edb0649e2b23 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:05:25.371277 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-935baf0d-e5ea-4080-943a-edb0649e2b23 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:05:25.581646 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-935baf0d-e5ea-4080-943a-edb0649e2b23 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '058480d92c9b4ab4af6815d0438a65c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee9dc49b89143f781e4ab30296e4d01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:05:25.588865 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-935baf0d-e5ea-4080-943a-edb0649e2b23 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] 10.222.0.13 "GET /compute/v2.1/servers/990f3535-a5c4-4f62-bed9-b310a77293c8" status: 200 len: 1314 microversion: 2.1 time: 0.240155 Nov 01 19:05:25.601885 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1444/2835] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:05:25 2022] GET /compute/v2.1/servers/990f3535-a5c4-4f62-bed9-b310a77293c8 => generated 1314 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:05:25.620075 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-3f6daae1-a5c3-4c48-a815-e67bdb958b3b tempest-ServerGroupTestJSON-2134213834 tempest-ServerGroupTestJSON-2134213834-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:05:25.678179 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-3f6daae1-a5c3-4c48-a815-e67bdb958b3b tempest-ServerGroupTestJSON-2134213834 tempest-ServerGroupTestJSON-2134213834-project] 10.222.0.13 "DELETE /compute/v2.1/os-server-groups/d2ba106f-49ea-431e-8b20-b7c8d4d49353" status: 204 len: 0 microversion: 2.1 time: 0.074947 Nov 01 19:05:25.679165 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1445/2836] 10.222.0.13 () {58 vars in 1266 bytes} [Tue Nov 1 19:05:25 2022] DELETE /compute/v2.1/os-server-groups/d2ba106f-49ea-431e-8b20-b7c8d4d49353 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 01 19:05:25.688867 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-06f5f32f-19ea-4b8a-b3a1-723f8507ea68 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:05:25.689416 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-06f5f32f-19ea-4b8a-b3a1-723f8507ea68 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] [instance: b58b3cb6-ebdc-4705-b308-4e804cd52bce] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:05:25.704644 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-06f5f32f-19ea-4b8a-b3a1-723f8507ea68 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:05:25.705144 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-06f5f32f-19ea-4b8a-b3a1-723f8507ea68 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:05:25.708349 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-06f5f32f-19ea-4b8a-b3a1-723f8507ea68 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:05:25.709133 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-06f5f32f-19ea-4b8a-b3a1-723f8507ea68 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:05:25.709602 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-06f5f32f-19ea-4b8a-b3a1-723f8507ea68 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:05:25.710038 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-06f5f32f-19ea-4b8a-b3a1-723f8507ea68 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:05:25.981655 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-06f5f32f-19ea-4b8a-b3a1-723f8507ea68 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05d6a1722dfa4e959aeb14d601e43b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b5d812eff94e2f89d4705d7e7d5f3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:05:25.991440 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-06f5f32f-19ea-4b8a-b3a1-723f8507ea68 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] 10.222.0.13 "GET /compute/v2.1/servers/b58b3cb6-ebdc-4705-b308-4e804cd52bce" status: 200 len: 1515 microversion: 2.1 time: 0.311111 Nov 01 19:05:25.992858 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1446/2837] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:05:25 2022] GET /compute/v2.1/servers/b58b3cb6-ebdc-4705-b308-4e804cd52bce => generated 1515 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:05:25.997276 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-20d01e36-2d93-4afb-a114-3d4840f1cdcf tempest-ServerGroupTestJSON-2134213834 tempest-ServerGroupTestJSON-2134213834-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:05:26.009463 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-20d01e36-2d93-4afb-a114-3d4840f1cdcf tempest-ServerGroupTestJSON-2134213834 tempest-ServerGroupTestJSON-2134213834-project] 10.222.0.13 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.015730 Nov 01 19:05:26.017758 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1447/2838] 10.222.0.13 () {58 vars in 1152 bytes} [Tue Nov 1 19:05:25 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:05:26.017758 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-227cfa9f-495a-4ca4-bcef-484242592935 tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:05:26.017758 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-227cfa9f-495a-4ca4-bcef-484242592935 tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] [instance: 307ee785-a01d-401c-8be2-b17558e735f3] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:05:26.024149 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-227cfa9f-495a-4ca4-bcef-484242592935 tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:05:26.025668 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-227cfa9f-495a-4ca4-bcef-484242592935 tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:05:26.026280 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-227cfa9f-495a-4ca4-bcef-484242592935 tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:05:26.027145 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-227cfa9f-495a-4ca4-bcef-484242592935 tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:05:26.027769 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-227cfa9f-495a-4ca4-bcef-484242592935 tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:05:26.028345 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-227cfa9f-495a-4ca4-bcef-484242592935 tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:05:26.202941 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-227cfa9f-495a-4ca4-bcef-484242592935 tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb87e6147a6f470391921ac3b7a62f8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6511ea24c4c19a7c5d91535c7288d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:05:26.211296 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-227cfa9f-495a-4ca4-bcef-484242592935 tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] 10.222.0.13 "GET /compute/v2.1/servers/307ee785-a01d-401c-8be2-b17558e735f3" status: 200 len: 1324 microversion: 2.1 time: 0.199611 Nov 01 19:05:26.211885 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1448/2839] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:05:26 2022] GET /compute/v2.1/servers/307ee785-a01d-401c-8be2-b17558e735f3 => generated 1324 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:05:26.219659 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-7ed7306a-0a7f-4168-a37c-f1239a4ce78b tempest-ServerGroupTestJSON-2134213834 tempest-ServerGroupTestJSON-2134213834-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerGroupTestJSON-server-2025377132", "imageRef": "2d4a0047-1b9e-445f-8af8-1b5c9d93e881", "flavorRef": "452", "networks": [{"uuid": "3cce6078-f930-42fe-91e7-a021e63a5ae4"}]}, "os:scheduler_hints": {"group": "39db9570-eff7-4e8a-acae-6e2d59add751"}} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:05:26.288978 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.network.neutron [None req-7ed7306a-0a7f-4168-a37c-f1239a4ce78b tempest-ServerGroupTestJSON-2134213834 tempest-ServerGroupTestJSON-2134213834-project] validate_networks() for [('3cce6078-f930-42fe-91e7-a021e63a5ae4', None, None, None, None, None)] {{(pid=121403) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 01 19:05:26.917542 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.virt.hardware [None req-7ed7306a-0a7f-4168-a37c-f1239a4ce78b tempest-ServerGroupTestJSON-2134213834 tempest-ServerGroupTestJSON-2134213834-project] Flavor limits 0:0:0 {{(pid=121403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 01 19:05:26.918269 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.virt.hardware [None req-7ed7306a-0a7f-4168-a37c-f1239a4ce78b tempest-ServerGroupTestJSON-2134213834 tempest-ServerGroupTestJSON-2134213834-project] Image limits 0:0:0 {{(pid=121403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 01 19:05:26.918866 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.virt.hardware [None req-7ed7306a-0a7f-4168-a37c-f1239a4ce78b tempest-ServerGroupTestJSON-2134213834 tempest-ServerGroupTestJSON-2134213834-project] Flavor pref 0:0:0 {{(pid=121403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 01 19:05:26.919593 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.virt.hardware [None req-7ed7306a-0a7f-4168-a37c-f1239a4ce78b tempest-ServerGroupTestJSON-2134213834 tempest-ServerGroupTestJSON-2134213834-project] Image pref 0:0:0 {{(pid=121403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 01 19:05:26.923280 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.virt.hardware [None req-7ed7306a-0a7f-4168-a37c-f1239a4ce78b tempest-ServerGroupTestJSON-2134213834 tempest-ServerGroupTestJSON-2134213834-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 01 19:05:26.941769 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-7ed7306a-0a7f-4168-a37c-f1239a4ce78b tempest-ServerGroupTestJSON-2134213834 tempest-ServerGroupTestJSON-2134213834-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:05:26.942126 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-7ed7306a-0a7f-4168-a37c-f1239a4ce78b tempest-ServerGroupTestJSON-2134213834 tempest-ServerGroupTestJSON-2134213834-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:05:26.943004 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-7ed7306a-0a7f-4168-a37c-f1239a4ce78b tempest-ServerGroupTestJSON-2134213834 tempest-ServerGroupTestJSON-2134213834-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:05:26.944182 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-7ed7306a-0a7f-4168-a37c-f1239a4ce78b tempest-ServerGroupTestJSON-2134213834 tempest-ServerGroupTestJSON-2134213834-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:05:26.944899 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-7ed7306a-0a7f-4168-a37c-f1239a4ce78b tempest-ServerGroupTestJSON-2134213834 tempest-ServerGroupTestJSON-2134213834-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:05:26.945579 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-7ed7306a-0a7f-4168-a37c-f1239a4ce78b tempest-ServerGroupTestJSON-2134213834 tempest-ServerGroupTestJSON-2134213834-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:05:26.974039 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.quota [None req-7ed7306a-0a7f-4168-a37c-f1239a4ce78b tempest-ServerGroupTestJSON-2134213834 tempest-ServerGroupTestJSON-2134213834-project] Getting quotas for project 6b6c42eec3544f3c820c0b0ce6f2f1f9. Resources: {'cores', 'ram', 'instances'} {{(pid=121403) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 01 19:05:26.980110 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.virt.hardware [None req-ecedbab0-9c50-4844-bb43-715bb9371c26 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Flavor limits 0:0:0 {{(pid=121402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 01 19:05:26.980721 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.quota [None req-7ed7306a-0a7f-4168-a37c-f1239a4ce78b tempest-ServerGroupTestJSON-2134213834 tempest-ServerGroupTestJSON-2134213834-project] Getting quotas for user b0ef831ef96b4e5a983061fc8c7cf13d and project 6b6c42eec3544f3c820c0b0ce6f2f1f9. Resources: {'cores', 'ram', 'instances'} {{(pid=121403) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 01 19:05:26.981491 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.virt.hardware [None req-ecedbab0-9c50-4844-bb43-715bb9371c26 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Image limits 0:0:0 {{(pid=121402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 01 19:05:26.982133 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.virt.hardware [None req-ecedbab0-9c50-4844-bb43-715bb9371c26 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Flavor pref 0:0:0 {{(pid=121402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 01 19:05:26.982816 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.virt.hardware [None req-ecedbab0-9c50-4844-bb43-715bb9371c26 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Image pref 0:0:0 {{(pid=121402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 01 19:05:26.984253 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.virt.hardware [None req-ecedbab0-9c50-4844-bb43-715bb9371c26 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 01 19:05:27.005927 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-7ed7306a-0a7f-4168-a37c-f1239a4ce78b tempest-ServerGroupTestJSON-2134213834 tempest-ServerGroupTestJSON-2134213834-project] Going to run 1 instances... {{(pid=121403) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 01 19:05:27.007944 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-ecedbab0-9c50-4844-bb43-715bb9371c26 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:05:27.008940 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-ecedbab0-9c50-4844-bb43-715bb9371c26 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:05:27.009554 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-ecedbab0-9c50-4844-bb43-715bb9371c26 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:05:27.011383 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-ecedbab0-9c50-4844-bb43-715bb9371c26 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:05:27.012222 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-ecedbab0-9c50-4844-bb43-715bb9371c26 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:05:27.012836 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-ecedbab0-9c50-4844-bb43-715bb9371c26 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:05:27.013705 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-7ed7306a-0a7f-4168-a37c-f1239a4ce78b tempest-ServerGroupTestJSON-2134213834 tempest-ServerGroupTestJSON-2134213834-project] [instance: 083a5a87-288b-48e0-8cda-d802774c372a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2d4a0047-1b9e-445f-8af8-1b5c9d93e881',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121403) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 01 19:05:27.036341 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.quota [None req-ecedbab0-9c50-4844-bb43-715bb9371c26 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Getting quotas for project 8807757227574c828dca1947af76659d. Resources: {'cores', 'ram', 'instances'} {{(pid=121402) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 01 19:05:27.042833 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.quota [None req-ecedbab0-9c50-4844-bb43-715bb9371c26 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Getting quotas for user 301ed3b9c37449bc9ade378f3c73a768 and project 8807757227574c828dca1947af76659d. Resources: {'cores', 'ram', 'instances'} {{(pid=121402) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 01 19:05:27.096386 n-d-863052-2 devstack@n-api.service[121403]: DEBUG dbcounter [-] [121403] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=6,nova_api:DELETE=6 {{(pid=121403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 19:05:27.177715 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.quota [None req-7ed7306a-0a7f-4168-a37c-f1239a4ce78b tempest-ServerGroupTestJSON-2134213834 tempest-ServerGroupTestJSON-2134213834-project] Getting quotas for project 6b6c42eec3544f3c820c0b0ce6f2f1f9. Resources: {'server_group_members'} {{(pid=121403) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 01 19:05:27.194404 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.quota [None req-7ed7306a-0a7f-4168-a37c-f1239a4ce78b tempest-ServerGroupTestJSON-2134213834 tempest-ServerGroupTestJSON-2134213834-project] Getting quotas for user b0ef831ef96b4e5a983061fc8c7cf13d and project 6b6c42eec3544f3c820c0b0ce6f2f1f9. Resources: {'server_group_members'} {{(pid=121403) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 01 19:05:27.275426 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.quota [None req-7ed7306a-0a7f-4168-a37c-f1239a4ce78b tempest-ServerGroupTestJSON-2134213834 tempest-ServerGroupTestJSON-2134213834-project] Getting quotas for project 6b6c42eec3544f3c820c0b0ce6f2f1f9. Resources: {'server_group_members'} {{(pid=121403) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 01 19:05:27.295068 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.quota [None req-7ed7306a-0a7f-4168-a37c-f1239a4ce78b tempest-ServerGroupTestJSON-2134213834 tempest-ServerGroupTestJSON-2134213834-project] Getting quotas for user b0ef831ef96b4e5a983061fc8c7cf13d and project 6b6c42eec3544f3c820c0b0ce6f2f1f9. Resources: {'server_group_members'} {{(pid=121403) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 01 19:05:27.386807 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-7ed7306a-0a7f-4168-a37c-f1239a4ce78b tempest-ServerGroupTestJSON-2134213834 tempest-ServerGroupTestJSON-2134213834-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.171484 Nov 01 19:05:27.395876 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1449/2840] 10.222.0.13 () {60 vars in 1147 bytes} [Tue Nov 1 19:05:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 1177 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 01 19:05:27.401044 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-2ab567bd-7b05-46c7-a820-240b0eb1c2b9 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:05:27.402203 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-2ab567bd-7b05-46c7-a820-240b0eb1c2b9 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] [instance: 990f3535-a5c4-4f62-bed9-b310a77293c8] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:05:27.417591 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-ecedbab0-9c50-4844-bb43-715bb9371c26 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Going to run 1 instances... {{(pid=121402) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 01 19:05:27.419433 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-2ab567bd-7b05-46c7-a820-240b0eb1c2b9 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:05:27.420117 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-2ab567bd-7b05-46c7-a820-240b0eb1c2b9 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:05:27.420398 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-ecedbab0-9c50-4844-bb43-715bb9371c26 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] [instance: af1071a8-a090-44c9-890c-123ca3ff39f1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='d3bb98ab-c202-4923-835b-600b057f4a4c',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='454961c7-8e2d-4736-9d50-c40c42aaa316',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='9dc75250-c065-4276-a636-54b94bace3e0',volume_size=None,volume_type=None)] {{(pid=121402) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 01 19:05:27.420853 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-2ab567bd-7b05-46c7-a820-240b0eb1c2b9 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:05:27.421706 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-2ab567bd-7b05-46c7-a820-240b0eb1c2b9 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:05:27.422496 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-2ab567bd-7b05-46c7-a820-240b0eb1c2b9 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:05:27.423038 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-2ab567bd-7b05-46c7-a820-240b0eb1c2b9 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:05:27.855380 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-2ab567bd-7b05-46c7-a820-240b0eb1c2b9 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '058480d92c9b4ab4af6815d0438a65c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee9dc49b89143f781e4ab30296e4d01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:05:27.879945 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-2ab567bd-7b05-46c7-a820-240b0eb1c2b9 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] 10.222.0.13 "GET /compute/v2.1/servers/990f3535-a5c4-4f62-bed9-b310a77293c8" status: 200 len: 1314 microversion: 2.1 time: 0.479464 Nov 01 19:05:27.880663 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1450/2841] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:05:27 2022] GET /compute/v2.1/servers/990f3535-a5c4-4f62-bed9-b310a77293c8 => generated 1314 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:05:27.910174 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-dc7694fb-8f22-4153-9113-546599bedd54 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:05:27.912618 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-dc7694fb-8f22-4153-9113-546599bedd54 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] [instance: b58b3cb6-ebdc-4705-b308-4e804cd52bce] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:05:27.933903 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-dc7694fb-8f22-4153-9113-546599bedd54 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:05:27.944505 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-dc7694fb-8f22-4153-9113-546599bedd54 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:05:27.945053 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-dc7694fb-8f22-4153-9113-546599bedd54 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:05:27.947296 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-dc7694fb-8f22-4153-9113-546599bedd54 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:05:27.950569 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-dc7694fb-8f22-4153-9113-546599bedd54 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:05:27.951155 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-dc7694fb-8f22-4153-9113-546599bedd54 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:05:28.220252 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-ecedbab0-9c50-4844-bb43-715bb9371c26 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.42 time: 10.701347 Nov 01 19:05:28.223825 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1392/2842] 10.222.0.13 () {62 vars in 1189 bytes} [Tue Nov 1 19:05:17 2022] POST /compute/v2.1/servers => generated 406 bytes in 10705 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Nov 01 19:05:28.234440 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-fe960971-5028-4eed-9c24-e474a5b7915d tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:05:28.247620 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-fe960971-5028-4eed-9c24-e474a5b7915d tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] [instance: 307ee785-a01d-401c-8be2-b17558e735f3] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:05:28.268732 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-fe960971-5028-4eed-9c24-e474a5b7915d tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:05:28.274312 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-fe960971-5028-4eed-9c24-e474a5b7915d tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:05:28.275412 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-fe960971-5028-4eed-9c24-e474a5b7915d tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:05:28.276716 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-fe960971-5028-4eed-9c24-e474a5b7915d tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:05:28.277695 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-fe960971-5028-4eed-9c24-e474a5b7915d tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:05:28.278382 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-fe960971-5028-4eed-9c24-e474a5b7915d tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:05:28.299822 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-dc7694fb-8f22-4153-9113-546599bedd54 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05d6a1722dfa4e959aeb14d601e43b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b5d812eff94e2f89d4705d7e7d5f3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:05:28.309287 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-dc7694fb-8f22-4153-9113-546599bedd54 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] 10.222.0.13 "GET /compute/v2.1/servers/b58b3cb6-ebdc-4705-b308-4e804cd52bce" status: 200 len: 1515 microversion: 2.1 time: 0.423506 Nov 01 19:05:28.309883 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1451/2843] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:05:27 2022] GET /compute/v2.1/servers/b58b3cb6-ebdc-4705-b308-4e804cd52bce => generated 1515 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:05:28.320427 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-b71321a5-f8b0-4e7c-88fc-f833b66fb167 tempest-ServerGroupTestJSON-2134213834 tempest-ServerGroupTestJSON-2134213834-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:05:28.321332 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-b71321a5-f8b0-4e7c-88fc-f833b66fb167 tempest-ServerGroupTestJSON-2134213834 tempest-ServerGroupTestJSON-2134213834-project] [instance: 083a5a87-288b-48e0-8cda-d802774c372a] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:05:28.454997 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-b71321a5-f8b0-4e7c-88fc-f833b66fb167 tempest-ServerGroupTestJSON-2134213834 tempest-ServerGroupTestJSON-2134213834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0ef831ef96b4e5a983061fc8c7cf13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b6c42eec3544f3c820c0b0ce6f2f1f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:05:28.466958 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-b71321a5-f8b0-4e7c-88fc-f833b66fb167 tempest-ServerGroupTestJSON-2134213834 tempest-ServerGroupTestJSON-2134213834-project] 10.222.0.13 "GET /compute/v2.1/servers/083a5a87-288b-48e0-8cda-d802774c372a" status: 200 len: 1213 microversion: 2.1 time: 0.149090 Nov 01 19:05:28.482278 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1452/2844] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:05:28 2022] GET /compute/v2.1/servers/083a5a87-288b-48e0-8cda-d802774c372a => generated 1213 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:05:28.492925 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [req-474606ec-43b7-457f-b35f-11bcaf22afae req-cface802-1d22-4a5d-bfcc-3a8d0221605e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "990f3535-a5c4-4f62-bed9-b310a77293c8", "tag": "28a32cc7-6861-459e-b63a-b5e5fdb67572"}]} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:05:28.504847 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-474606ec-43b7-457f-b35f-11bcaf22afae req-cface802-1d22-4a5d-bfcc-3a8d0221605e service nova] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:05:28.505459 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-474606ec-43b7-457f-b35f-11bcaf22afae req-cface802-1d22-4a5d-bfcc-3a8d0221605e service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:05:28.505992 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-474606ec-43b7-457f-b35f-11bcaf22afae req-cface802-1d22-4a5d-bfcc-3a8d0221605e service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:05:28.518208 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.compute.server_external_events [req-474606ec-43b7-457f-b35f-11bcaf22afae req-cface802-1d22-4a5d-bfcc-3a8d0221605e service nova] Creating event network-changed:28a32cc7-6861-459e-b63a-b5e5fdb67572 for instance 990f3535-a5c4-4f62-bed9-b310a77293c8 on n-h1-863052-2 Nov 01 19:05:28.524687 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [req-474606ec-43b7-457f-b35f-11bcaf22afae req-cface802-1d22-4a5d-bfcc-3a8d0221605e service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040870 Nov 01 19:05:28.525778 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1453/2845] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Nov 1 19:05:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:05:28.533201 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-3ecbe295-03fc-464d-a862-b40962af3c0a tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:05:28.534389 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-3ecbe295-03fc-464d-a862-b40962af3c0a tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] [instance: af1071a8-a090-44c9-890c-123ca3ff39f1] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:05:28.661673 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-3ecbe295-03fc-464d-a862-b40962af3c0a tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '301ed3b9c37449bc9ade378f3c73a768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8807757227574c828dca1947af76659d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:05:28.674132 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-3ecbe295-03fc-464d-a862-b40962af3c0a tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '301ed3b9c37449bc9ade378f3c73a768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8807757227574c828dca1947af76659d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:05:28.682010 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-3ecbe295-03fc-464d-a862-b40962af3c0a tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '301ed3b9c37449bc9ade378f3c73a768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8807757227574c828dca1947af76659d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:05:28.689416 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-3ecbe295-03fc-464d-a862-b40962af3c0a tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] 10.222.0.13 "GET /compute/v2.1/servers/af1071a8-a090-44c9-890c-123ca3ff39f1" status: 200 len: 1286 microversion: 2.42 time: 0.159759 Nov 01 19:05:28.694252 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1454/2846] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 19:05:28 2022] GET /compute/v2.1/servers/af1071a8-a090-44c9-890c-123ca3ff39f1 => generated 1286 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 19:05:28.903850 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-d31566fe-d1cd-42f1-893e-35bf28fc6533 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:05:28.904755 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-d31566fe-d1cd-42f1-893e-35bf28fc6533 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] [instance: 990f3535-a5c4-4f62-bed9-b310a77293c8] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:05:28.919313 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d31566fe-d1cd-42f1-893e-35bf28fc6533 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:05:28.920472 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d31566fe-d1cd-42f1-893e-35bf28fc6533 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:05:28.923910 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d31566fe-d1cd-42f1-893e-35bf28fc6533 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:05:28.926472 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d31566fe-d1cd-42f1-893e-35bf28fc6533 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:05:28.928125 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d31566fe-d1cd-42f1-893e-35bf28fc6533 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:05:28.929610 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d31566fe-d1cd-42f1-893e-35bf28fc6533 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:05:29.147189 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-fe960971-5028-4eed-9c24-e474a5b7915d tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb87e6147a6f470391921ac3b7a62f8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6511ea24c4c19a7c5d91535c7288d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:05:29.165008 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-fe960971-5028-4eed-9c24-e474a5b7915d tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] 10.222.0.13 "GET /compute/v2.1/servers/307ee785-a01d-401c-8be2-b17558e735f3" status: 200 len: 1324 microversion: 2.1 time: 0.938680 Nov 01 19:05:29.165529 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1393/2847] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:05:28 2022] GET /compute/v2.1/servers/307ee785-a01d-401c-8be2-b17558e735f3 => generated 1324 bytes in 941 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:05:29.335912 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-ed36b5c5-2940-424a-b232-89d5921cc976 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:05:29.337256 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-ed36b5c5-2940-424a-b232-89d5921cc976 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] [instance: b58b3cb6-ebdc-4705-b308-4e804cd52bce] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:05:29.348221 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-ed36b5c5-2940-424a-b232-89d5921cc976 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:05:29.351439 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-ed36b5c5-2940-424a-b232-89d5921cc976 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:05:29.353454 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-ed36b5c5-2940-424a-b232-89d5921cc976 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:05:29.356273 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-ed36b5c5-2940-424a-b232-89d5921cc976 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:05:29.357998 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-ed36b5c5-2940-424a-b232-89d5921cc976 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:05:29.358757 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-ed36b5c5-2940-424a-b232-89d5921cc976 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:05:29.494460 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-d31566fe-d1cd-42f1-893e-35bf28fc6533 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '058480d92c9b4ab4af6815d0438a65c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee9dc49b89143f781e4ab30296e4d01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:05:29.516991 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-d31566fe-d1cd-42f1-893e-35bf28fc6533 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] 10.222.0.13 "GET /compute/v2.1/servers/990f3535-a5c4-4f62-bed9-b310a77293c8" status: 200 len: 1314 microversion: 2.1 time: 0.617045 Nov 01 19:05:29.518174 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1455/2848] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:05:28 2022] GET /compute/v2.1/servers/990f3535-a5c4-4f62-bed9-b310a77293c8 => generated 1314 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 19:05:29.546656 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-6ae5d3ef-b69d-4314-acc0-b1538c1ffdd2 tempest-ServerGroupTestJSON-2134213834 tempest-ServerGroupTestJSON-2134213834-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:05:29.549734 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-6ae5d3ef-b69d-4314-acc0-b1538c1ffdd2 tempest-ServerGroupTestJSON-2134213834 tempest-ServerGroupTestJSON-2134213834-project] [instance: 083a5a87-288b-48e0-8cda-d802774c372a] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:05:29.572263 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-6ae5d3ef-b69d-4314-acc0-b1538c1ffdd2 tempest-ServerGroupTestJSON-2134213834 tempest-ServerGroupTestJSON-2134213834-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:05:29.573195 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-6ae5d3ef-b69d-4314-acc0-b1538c1ffdd2 tempest-ServerGroupTestJSON-2134213834 tempest-ServerGroupTestJSON-2134213834-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:05:29.575343 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-6ae5d3ef-b69d-4314-acc0-b1538c1ffdd2 tempest-ServerGroupTestJSON-2134213834 tempest-ServerGroupTestJSON-2134213834-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:05:29.580811 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-6ae5d3ef-b69d-4314-acc0-b1538c1ffdd2 tempest-ServerGroupTestJSON-2134213834 tempest-ServerGroupTestJSON-2134213834-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:05:29.590124 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-6ae5d3ef-b69d-4314-acc0-b1538c1ffdd2 tempest-ServerGroupTestJSON-2134213834 tempest-ServerGroupTestJSON-2134213834-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:05:29.590930 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-6ae5d3ef-b69d-4314-acc0-b1538c1ffdd2 tempest-ServerGroupTestJSON-2134213834 tempest-ServerGroupTestJSON-2134213834-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:05:29.744001 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-6ae5d3ef-b69d-4314-acc0-b1538c1ffdd2 tempest-ServerGroupTestJSON-2134213834 tempest-ServerGroupTestJSON-2134213834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0ef831ef96b4e5a983061fc8c7cf13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b6c42eec3544f3c820c0b0ce6f2f1f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:05:29.764424 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-6ae5d3ef-b69d-4314-acc0-b1538c1ffdd2 tempest-ServerGroupTestJSON-2134213834 tempest-ServerGroupTestJSON-2134213834-project] 10.222.0.13 "GET /compute/v2.1/servers/083a5a87-288b-48e0-8cda-d802774c372a" status: 200 len: 1273 microversion: 2.1 time: 0.235834 Nov 01 19:05:29.766877 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1456/2849] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:05:29 2022] GET /compute/v2.1/servers/083a5a87-288b-48e0-8cda-d802774c372a => generated 1273 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:05:29.776845 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-8e9874b5-ef5d-4de0-91eb-a234c7af9d53 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:05:29.776845 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-8e9874b5-ef5d-4de0-91eb-a234c7af9d53 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] [instance: af1071a8-a090-44c9-890c-123ca3ff39f1] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:05:29.882420 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-ed36b5c5-2940-424a-b232-89d5921cc976 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05d6a1722dfa4e959aeb14d601e43b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b5d812eff94e2f89d4705d7e7d5f3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:05:29.893679 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-ed36b5c5-2940-424a-b232-89d5921cc976 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] 10.222.0.13 "GET /compute/v2.1/servers/b58b3cb6-ebdc-4705-b308-4e804cd52bce" status: 200 len: 1515 microversion: 2.1 time: 0.561723 Nov 01 19:05:29.894828 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1394/2850] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:05:29 2022] GET /compute/v2.1/servers/b58b3cb6-ebdc-4705-b308-4e804cd52bce => generated 1515 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 19:05:29.922502 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-8e9874b5-ef5d-4de0-91eb-a234c7af9d53 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '301ed3b9c37449bc9ade378f3c73a768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8807757227574c828dca1947af76659d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:05:29.937397 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-8e9874b5-ef5d-4de0-91eb-a234c7af9d53 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '301ed3b9c37449bc9ade378f3c73a768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8807757227574c828dca1947af76659d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:05:29.940721 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-8e9874b5-ef5d-4de0-91eb-a234c7af9d53 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '301ed3b9c37449bc9ade378f3c73a768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8807757227574c828dca1947af76659d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:05:29.942110 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-8e9874b5-ef5d-4de0-91eb-a234c7af9d53 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] 10.222.0.13 "GET /compute/v2.1/servers/af1071a8-a090-44c9-890c-123ca3ff39f1" status: 200 len: 1286 microversion: 2.42 time: 0.174044 Nov 01 19:05:29.943342 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1457/2851] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 19:05:29 2022] GET /compute/v2.1/servers/af1071a8-a090-44c9-890c-123ca3ff39f1 => generated 1286 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 19:05:30.193258 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-b4474ca4-ddcd-4231-befb-e3411df1b2d1 tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:05:30.193890 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-b4474ca4-ddcd-4231-befb-e3411df1b2d1 tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] [instance: 307ee785-a01d-401c-8be2-b17558e735f3] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:05:30.204959 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b4474ca4-ddcd-4231-befb-e3411df1b2d1 tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:05:30.205458 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b4474ca4-ddcd-4231-befb-e3411df1b2d1 tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:05:30.205898 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b4474ca4-ddcd-4231-befb-e3411df1b2d1 tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:05:30.206607 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b4474ca4-ddcd-4231-befb-e3411df1b2d1 tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:05:30.207067 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b4474ca4-ddcd-4231-befb-e3411df1b2d1 tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:05:30.207493 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b4474ca4-ddcd-4231-befb-e3411df1b2d1 tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:05:30.538370 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-b4474ca4-ddcd-4231-befb-e3411df1b2d1 tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb87e6147a6f470391921ac3b7a62f8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6511ea24c4c19a7c5d91535c7288d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:05:30.542552 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-5260afc2-78af-4da3-968b-91ef62ba8d5a tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:05:30.543758 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-5260afc2-78af-4da3-968b-91ef62ba8d5a tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] [instance: 990f3535-a5c4-4f62-bed9-b310a77293c8] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:05:30.554614 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-5260afc2-78af-4da3-968b-91ef62ba8d5a tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:05:30.558039 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-5260afc2-78af-4da3-968b-91ef62ba8d5a tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:05:30.558594 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-5260afc2-78af-4da3-968b-91ef62ba8d5a tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:05:30.560695 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-5260afc2-78af-4da3-968b-91ef62ba8d5a tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:05:30.561706 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-5260afc2-78af-4da3-968b-91ef62ba8d5a tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:05:30.563959 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-b4474ca4-ddcd-4231-befb-e3411df1b2d1 tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] 10.222.0.13 "GET /compute/v2.1/servers/307ee785-a01d-401c-8be2-b17558e735f3" status: 200 len: 1324 microversion: 2.1 time: 0.374485 Nov 01 19:05:30.565404 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-5260afc2-78af-4da3-968b-91ef62ba8d5a tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:05:30.578285 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1395/2852] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:05:30 2022] GET /compute/v2.1/servers/307ee785-a01d-401c-8be2-b17558e735f3 => generated 1324 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:05:30.791799 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-a640a234-cc82-4c97-93bc-e1a7445858f3 tempest-ServerGroupTestJSON-2134213834 tempest-ServerGroupTestJSON-2134213834-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:05:30.792409 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-a640a234-cc82-4c97-93bc-e1a7445858f3 tempest-ServerGroupTestJSON-2134213834 tempest-ServerGroupTestJSON-2134213834-project] [instance: 083a5a87-288b-48e0-8cda-d802774c372a] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:05:30.807775 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-a640a234-cc82-4c97-93bc-e1a7445858f3 tempest-ServerGroupTestJSON-2134213834 tempest-ServerGroupTestJSON-2134213834-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:05:30.808275 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-a640a234-cc82-4c97-93bc-e1a7445858f3 tempest-ServerGroupTestJSON-2134213834 tempest-ServerGroupTestJSON-2134213834-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:05:30.808741 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-a640a234-cc82-4c97-93bc-e1a7445858f3 tempest-ServerGroupTestJSON-2134213834 tempest-ServerGroupTestJSON-2134213834-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:05:30.809460 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-a640a234-cc82-4c97-93bc-e1a7445858f3 tempest-ServerGroupTestJSON-2134213834 tempest-ServerGroupTestJSON-2134213834-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:05:30.809921 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-a640a234-cc82-4c97-93bc-e1a7445858f3 tempest-ServerGroupTestJSON-2134213834 tempest-ServerGroupTestJSON-2134213834-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:05:30.810347 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-a640a234-cc82-4c97-93bc-e1a7445858f3 tempest-ServerGroupTestJSON-2134213834 tempest-ServerGroupTestJSON-2134213834-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:05:30.946226 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-a640a234-cc82-4c97-93bc-e1a7445858f3 tempest-ServerGroupTestJSON-2134213834 tempest-ServerGroupTestJSON-2134213834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0ef831ef96b4e5a983061fc8c7cf13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b6c42eec3544f3c820c0b0ce6f2f1f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:05:30.954861 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-a640a234-cc82-4c97-93bc-e1a7445858f3 tempest-ServerGroupTestJSON-2134213834 tempest-ServerGroupTestJSON-2134213834-project] 10.222.0.13 "GET /compute/v2.1/servers/083a5a87-288b-48e0-8cda-d802774c372a" status: 200 len: 1271 microversion: 2.1 time: 0.166940 Nov 01 19:05:30.961423 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1396/2853] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:05:30 2022] GET /compute/v2.1/servers/083a5a87-288b-48e0-8cda-d802774c372a => generated 1271 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 19:05:30.981321 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-0014f46e-ae13-4f3f-9a03-a728308f87cb tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:05:30.982862 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-0014f46e-ae13-4f3f-9a03-a728308f87cb tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] [instance: b58b3cb6-ebdc-4705-b308-4e804cd52bce] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:05:30.992910 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-0014f46e-ae13-4f3f-9a03-a728308f87cb tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:05:30.993680 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-0014f46e-ae13-4f3f-9a03-a728308f87cb tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:05:30.994577 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-0014f46e-ae13-4f3f-9a03-a728308f87cb tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:05:30.996122 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-0014f46e-ae13-4f3f-9a03-a728308f87cb tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:05:30.997145 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-0014f46e-ae13-4f3f-9a03-a728308f87cb tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:05:30.999706 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-0014f46e-ae13-4f3f-9a03-a728308f87cb tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:05:31.039181 n-d-863052-2 devstack@n-api.service[121402]: DEBUG dbcounter [-] [121402] Writing DB stats nova_cell1:SELECT=100 {{(pid=121402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 19:05:31.048556 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-5260afc2-78af-4da3-968b-91ef62ba8d5a tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '058480d92c9b4ab4af6815d0438a65c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee9dc49b89143f781e4ab30296e4d01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:05:31.065065 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-5260afc2-78af-4da3-968b-91ef62ba8d5a tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] 10.222.0.13 "GET /compute/v2.1/servers/990f3535-a5c4-4f62-bed9-b310a77293c8" status: 200 len: 1314 microversion: 2.1 time: 0.527370 Nov 01 19:05:31.066410 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1458/2854] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:05:30 2022] GET /compute/v2.1/servers/990f3535-a5c4-4f62-bed9-b310a77293c8 => generated 1314 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:05:31.073152 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-55b26056-4102-4079-8fd7-8a806d762f2f tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:05:31.074191 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-55b26056-4102-4079-8fd7-8a806d762f2f tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] [instance: af1071a8-a090-44c9-890c-123ca3ff39f1] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:05:31.085261 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-55b26056-4102-4079-8fd7-8a806d762f2f tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:05:31.086158 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-55b26056-4102-4079-8fd7-8a806d762f2f tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:05:31.086625 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-55b26056-4102-4079-8fd7-8a806d762f2f tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:05:31.087711 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-55b26056-4102-4079-8fd7-8a806d762f2f tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:05:31.088745 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-55b26056-4102-4079-8fd7-8a806d762f2f tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:05:31.089475 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-55b26056-4102-4079-8fd7-8a806d762f2f tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:05:31.275709 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-55b26056-4102-4079-8fd7-8a806d762f2f tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '301ed3b9c37449bc9ade378f3c73a768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8807757227574c828dca1947af76659d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:05:31.303000 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-55b26056-4102-4079-8fd7-8a806d762f2f tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '301ed3b9c37449bc9ade378f3c73a768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8807757227574c828dca1947af76659d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:05:31.308916 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-55b26056-4102-4079-8fd7-8a806d762f2f tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '301ed3b9c37449bc9ade378f3c73a768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8807757227574c828dca1947af76659d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:05:31.312405 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-55b26056-4102-4079-8fd7-8a806d762f2f tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] 10.222.0.13 "GET /compute/v2.1/servers/af1071a8-a090-44c9-890c-123ca3ff39f1" status: 200 len: 1576 microversion: 2.42 time: 0.242573 Nov 01 19:05:31.313306 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1459/2855] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 19:05:31 2022] GET /compute/v2.1/servers/af1071a8-a090-44c9-890c-123ca3ff39f1 => generated 1576 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 19:05:31.472823 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-0014f46e-ae13-4f3f-9a03-a728308f87cb tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05d6a1722dfa4e959aeb14d601e43b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b5d812eff94e2f89d4705d7e7d5f3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:05:31.484704 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-0014f46e-ae13-4f3f-9a03-a728308f87cb tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] 10.222.0.13 "GET /compute/v2.1/servers/b58b3cb6-ebdc-4705-b308-4e804cd52bce" status: 200 len: 1515 microversion: 2.1 time: 0.521755 Nov 01 19:05:31.486325 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1397/2856] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:05:30 2022] GET /compute/v2.1/servers/b58b3cb6-ebdc-4705-b308-4e804cd52bce => generated 1515 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:05:31.591095 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-0c71c6dc-ac2c-43f0-bd64-4e79f2d3b7bb tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:05:31.593206 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-0c71c6dc-ac2c-43f0-bd64-4e79f2d3b7bb tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] [instance: 307ee785-a01d-401c-8be2-b17558e735f3] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:05:31.609191 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-0c71c6dc-ac2c-43f0-bd64-4e79f2d3b7bb tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:05:31.610059 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-0c71c6dc-ac2c-43f0-bd64-4e79f2d3b7bb tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:05:31.611805 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-0c71c6dc-ac2c-43f0-bd64-4e79f2d3b7bb tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:05:31.616364 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-0c71c6dc-ac2c-43f0-bd64-4e79f2d3b7bb tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:05:31.617593 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-0c71c6dc-ac2c-43f0-bd64-4e79f2d3b7bb tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:05:31.618192 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-0c71c6dc-ac2c-43f0-bd64-4e79f2d3b7bb tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:05:31.988466 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-54e7e756-e993-4846-831c-22a7d05ae931 tempest-ServerGroupTestJSON-2134213834 tempest-ServerGroupTestJSON-2134213834-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:05:31.989120 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-54e7e756-e993-4846-831c-22a7d05ae931 tempest-ServerGroupTestJSON-2134213834 tempest-ServerGroupTestJSON-2134213834-project] [instance: 083a5a87-288b-48e0-8cda-d802774c372a] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:05:31.997189 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-54e7e756-e993-4846-831c-22a7d05ae931 tempest-ServerGroupTestJSON-2134213834 tempest-ServerGroupTestJSON-2134213834-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:05:31.997682 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-54e7e756-e993-4846-831c-22a7d05ae931 tempest-ServerGroupTestJSON-2134213834 tempest-ServerGroupTestJSON-2134213834-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:05:31.998121 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-54e7e756-e993-4846-831c-22a7d05ae931 tempest-ServerGroupTestJSON-2134213834 tempest-ServerGroupTestJSON-2134213834-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:05:31.999418 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-54e7e756-e993-4846-831c-22a7d05ae931 tempest-ServerGroupTestJSON-2134213834 tempest-ServerGroupTestJSON-2134213834-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:05:31.999949 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-54e7e756-e993-4846-831c-22a7d05ae931 tempest-ServerGroupTestJSON-2134213834 tempest-ServerGroupTestJSON-2134213834-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:05:32.000378 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-54e7e756-e993-4846-831c-22a7d05ae931 tempest-ServerGroupTestJSON-2134213834 tempest-ServerGroupTestJSON-2134213834-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:05:32.599009 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-54e7e756-e993-4846-831c-22a7d05ae931 tempest-ServerGroupTestJSON-2134213834 tempest-ServerGroupTestJSON-2134213834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0ef831ef96b4e5a983061fc8c7cf13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b6c42eec3544f3c820c0b0ce6f2f1f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:05:32.610933 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-54e7e756-e993-4846-831c-22a7d05ae931 tempest-ServerGroupTestJSON-2134213834 tempest-ServerGroupTestJSON-2134213834-project] 10.222.0.13 "GET /compute/v2.1/servers/083a5a87-288b-48e0-8cda-d802774c372a" status: 200 len: 1313 microversion: 2.1 time: 0.626949 Nov 01 19:05:32.622849 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1398/2857] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:05:31 2022] GET /compute/v2.1/servers/083a5a87-288b-48e0-8cda-d802774c372a => generated 1313 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 19:05:32.628081 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-5243b3cf-3acb-47e4-880c-a22d126be8fe tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:05:32.628925 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-5243b3cf-3acb-47e4-880c-a22d126be8fe tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] [instance: 990f3535-a5c4-4f62-bed9-b310a77293c8] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:05:32.642593 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-5243b3cf-3acb-47e4-880c-a22d126be8fe tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:05:32.643539 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-5243b3cf-3acb-47e4-880c-a22d126be8fe tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:05:32.644147 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-5243b3cf-3acb-47e4-880c-a22d126be8fe tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:05:32.645092 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-5243b3cf-3acb-47e4-880c-a22d126be8fe tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:05:32.645717 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-5243b3cf-3acb-47e4-880c-a22d126be8fe tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:05:32.646310 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-5243b3cf-3acb-47e4-880c-a22d126be8fe tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:05:32.926638 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-0c71c6dc-ac2c-43f0-bd64-4e79f2d3b7bb tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb87e6147a6f470391921ac3b7a62f8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6511ea24c4c19a7c5d91535c7288d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:05:32.946849 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-0c71c6dc-ac2c-43f0-bd64-4e79f2d3b7bb tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] 10.222.0.13 "GET /compute/v2.1/servers/307ee785-a01d-401c-8be2-b17558e735f3" status: 200 len: 1324 microversion: 2.1 time: 1.358920 Nov 01 19:05:32.949321 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1460/2858] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:05:31 2022] GET /compute/v2.1/servers/307ee785-a01d-401c-8be2-b17558e735f3 => generated 1324 bytes in 1364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:05:32.958508 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-18690901-b640-4096-ac2a-86263aa57ac9 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:05:32.959563 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-18690901-b640-4096-ac2a-86263aa57ac9 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] [instance: af1071a8-a090-44c9-890c-123ca3ff39f1] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:05:32.969540 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-18690901-b640-4096-ac2a-86263aa57ac9 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:05:32.970142 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-18690901-b640-4096-ac2a-86263aa57ac9 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:05:32.972525 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-18690901-b640-4096-ac2a-86263aa57ac9 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:05:32.974084 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-18690901-b640-4096-ac2a-86263aa57ac9 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:05:32.976158 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-18690901-b640-4096-ac2a-86263aa57ac9 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:05:32.976979 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-18690901-b640-4096-ac2a-86263aa57ac9 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:05:33.282839 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-5243b3cf-3acb-47e4-880c-a22d126be8fe tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '058480d92c9b4ab4af6815d0438a65c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee9dc49b89143f781e4ab30296e4d01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:05:33.300350 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-5243b3cf-3acb-47e4-880c-a22d126be8fe tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] 10.222.0.13 "GET /compute/v2.1/servers/990f3535-a5c4-4f62-bed9-b310a77293c8" status: 200 len: 1314 microversion: 2.1 time: 0.675911 Nov 01 19:05:33.302146 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1399/2859] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:05:32 2022] GET /compute/v2.1/servers/990f3535-a5c4-4f62-bed9-b310a77293c8 => generated 1314 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:05:33.315684 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-2efd261b-b404-491a-9976-ea412f9a3e21 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:05:33.320179 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-2efd261b-b404-491a-9976-ea412f9a3e21 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] [instance: b58b3cb6-ebdc-4705-b308-4e804cd52bce] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:05:33.338943 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2efd261b-b404-491a-9976-ea412f9a3e21 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:05:33.349288 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2efd261b-b404-491a-9976-ea412f9a3e21 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:05:33.351725 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2efd261b-b404-491a-9976-ea412f9a3e21 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:05:33.352620 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2efd261b-b404-491a-9976-ea412f9a3e21 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:05:33.355242 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2efd261b-b404-491a-9976-ea412f9a3e21 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:05:33.355790 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2efd261b-b404-491a-9976-ea412f9a3e21 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:05:33.471082 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-18690901-b640-4096-ac2a-86263aa57ac9 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '301ed3b9c37449bc9ade378f3c73a768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8807757227574c828dca1947af76659d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:05:33.490145 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-18690901-b640-4096-ac2a-86263aa57ac9 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '301ed3b9c37449bc9ade378f3c73a768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8807757227574c828dca1947af76659d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:05:33.505440 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-18690901-b640-4096-ac2a-86263aa57ac9 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '301ed3b9c37449bc9ade378f3c73a768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8807757227574c828dca1947af76659d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:05:33.510074 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-18690901-b640-4096-ac2a-86263aa57ac9 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] 10.222.0.13 "GET /compute/v2.1/servers/af1071a8-a090-44c9-890c-123ca3ff39f1" status: 200 len: 1594 microversion: 2.42 time: 0.558918 Nov 01 19:05:33.510701 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1461/2860] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 19:05:32 2022] GET /compute/v2.1/servers/af1071a8-a090-44c9-890c-123ca3ff39f1 => generated 1594 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 19:05:33.516187 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [req-92c5e97c-3365-4275-ae0c-272e3841b198 req-1271b890-eef8-426b-a5a7-ed3f92e3c72d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "307ee785-a01d-401c-8be2-b17558e735f3", "name": "network-vif-plugged", "status": "completed", "tag": "d65b5fcd-5bb6-4feb-b4bf-95734bcb3072"}]} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:05:33.541544 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-92c5e97c-3365-4275-ae0c-272e3841b198 req-1271b890-eef8-426b-a5a7-ed3f92e3c72d service nova] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:05:33.549610 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-92c5e97c-3365-4275-ae0c-272e3841b198 req-1271b890-eef8-426b-a5a7-ed3f92e3c72d service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:05:33.550742 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-92c5e97c-3365-4275-ae0c-272e3841b198 req-1271b890-eef8-426b-a5a7-ed3f92e3c72d service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:05:33.588791 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.compute.server_external_events [req-92c5e97c-3365-4275-ae0c-272e3841b198 req-1271b890-eef8-426b-a5a7-ed3f92e3c72d service nova] Creating event network-vif-plugged:d65b5fcd-5bb6-4feb-b4bf-95734bcb3072 for instance 307ee785-a01d-401c-8be2-b17558e735f3 on n-h2-863052-2 Nov 01 19:05:33.607425 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [req-92c5e97c-3365-4275-ae0c-272e3841b198 req-1271b890-eef8-426b-a5a7-ed3f92e3c72d service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095412 Nov 01 19:05:33.609262 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1462/2861] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Nov 1 19:05:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:05:33.640767 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-58ac5479-f35d-42b8-a78f-50152dfebf52 tempest-ServerGroupTestJSON-2134213834 tempest-ServerGroupTestJSON-2134213834-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:05:33.643506 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-58ac5479-f35d-42b8-a78f-50152dfebf52 tempest-ServerGroupTestJSON-2134213834 tempest-ServerGroupTestJSON-2134213834-project] [instance: 083a5a87-288b-48e0-8cda-d802774c372a] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:05:33.663714 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-58ac5479-f35d-42b8-a78f-50152dfebf52 tempest-ServerGroupTestJSON-2134213834 tempest-ServerGroupTestJSON-2134213834-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:05:33.664482 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-58ac5479-f35d-42b8-a78f-50152dfebf52 tempest-ServerGroupTestJSON-2134213834 tempest-ServerGroupTestJSON-2134213834-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:05:33.665228 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-58ac5479-f35d-42b8-a78f-50152dfebf52 tempest-ServerGroupTestJSON-2134213834 tempest-ServerGroupTestJSON-2134213834-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:05:33.666133 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-58ac5479-f35d-42b8-a78f-50152dfebf52 tempest-ServerGroupTestJSON-2134213834 tempest-ServerGroupTestJSON-2134213834-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:05:33.666902 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-58ac5479-f35d-42b8-a78f-50152dfebf52 tempest-ServerGroupTestJSON-2134213834 tempest-ServerGroupTestJSON-2134213834-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:05:33.667494 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-58ac5479-f35d-42b8-a78f-50152dfebf52 tempest-ServerGroupTestJSON-2134213834 tempest-ServerGroupTestJSON-2134213834-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:05:33.835302 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-2efd261b-b404-491a-9976-ea412f9a3e21 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05d6a1722dfa4e959aeb14d601e43b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b5d812eff94e2f89d4705d7e7d5f3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:05:33.844489 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-2efd261b-b404-491a-9976-ea412f9a3e21 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] 10.222.0.13 "GET /compute/v2.1/servers/b58b3cb6-ebdc-4705-b308-4e804cd52bce" status: 200 len: 1515 microversion: 2.1 time: 0.539787 Nov 01 19:05:33.846019 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1400/2862] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:05:33 2022] GET /compute/v2.1/servers/b58b3cb6-ebdc-4705-b308-4e804cd52bce => generated 1515 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:05:33.974532 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-db68a0db-e1f3-40a3-a4ff-c6eab11e9c2a tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:05:33.976343 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-db68a0db-e1f3-40a3-a4ff-c6eab11e9c2a tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] [instance: 307ee785-a01d-401c-8be2-b17558e735f3] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:05:33.986686 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-db68a0db-e1f3-40a3-a4ff-c6eab11e9c2a tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:05:33.987523 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-db68a0db-e1f3-40a3-a4ff-c6eab11e9c2a tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:05:33.988208 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-db68a0db-e1f3-40a3-a4ff-c6eab11e9c2a tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:05:33.989482 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-db68a0db-e1f3-40a3-a4ff-c6eab11e9c2a tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:05:33.990391 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-db68a0db-e1f3-40a3-a4ff-c6eab11e9c2a tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:05:33.995408 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-db68a0db-e1f3-40a3-a4ff-c6eab11e9c2a tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:05:34.263729 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-db68a0db-e1f3-40a3-a4ff-c6eab11e9c2a tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb87e6147a6f470391921ac3b7a62f8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6511ea24c4c19a7c5d91535c7288d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:05:34.281016 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-db68a0db-e1f3-40a3-a4ff-c6eab11e9c2a tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] 10.222.0.13 "GET /compute/v2.1/servers/307ee785-a01d-401c-8be2-b17558e735f3" status: 200 len: 1324 microversion: 2.1 time: 0.310807 Nov 01 19:05:34.283331 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1401/2863] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:05:33 2022] GET /compute/v2.1/servers/307ee785-a01d-401c-8be2-b17558e735f3 => generated 1324 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:05:34.332175 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-a79509e8-0a3a-49a8-aaf9-e66a93576973 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:05:34.332907 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-a79509e8-0a3a-49a8-aaf9-e66a93576973 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] [instance: 990f3535-a5c4-4f62-bed9-b310a77293c8] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:05:34.334785 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-58ac5479-f35d-42b8-a78f-50152dfebf52 tempest-ServerGroupTestJSON-2134213834 tempest-ServerGroupTestJSON-2134213834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0ef831ef96b4e5a983061fc8c7cf13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b6c42eec3544f3c820c0b0ce6f2f1f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:05:34.345649 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-a79509e8-0a3a-49a8-aaf9-e66a93576973 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:05:34.346793 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-a79509e8-0a3a-49a8-aaf9-e66a93576973 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:05:34.347904 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-58ac5479-f35d-42b8-a78f-50152dfebf52 tempest-ServerGroupTestJSON-2134213834 tempest-ServerGroupTestJSON-2134213834-project] 10.222.0.13 "GET /compute/v2.1/servers/083a5a87-288b-48e0-8cda-d802774c372a" status: 200 len: 1313 microversion: 2.1 time: 0.712547 Nov 01 19:05:34.349026 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1463/2864] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:05:33 2022] GET /compute/v2.1/servers/083a5a87-288b-48e0-8cda-d802774c372a => generated 1313 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:05:34.350015 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-a79509e8-0a3a-49a8-aaf9-e66a93576973 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:05:34.350811 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-a79509e8-0a3a-49a8-aaf9-e66a93576973 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:05:34.351299 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-a79509e8-0a3a-49a8-aaf9-e66a93576973 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:05:34.351737 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-a79509e8-0a3a-49a8-aaf9-e66a93576973 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:05:34.546817 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-fb7b7264-f377-4ba9-99cc-ae618102f653 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:05:34.549472 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-fb7b7264-f377-4ba9-99cc-ae618102f653 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] [instance: af1071a8-a090-44c9-890c-123ca3ff39f1] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:05:34.560184 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-fb7b7264-f377-4ba9-99cc-ae618102f653 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:05:34.561106 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-fb7b7264-f377-4ba9-99cc-ae618102f653 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:05:34.562484 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-fb7b7264-f377-4ba9-99cc-ae618102f653 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:05:34.564528 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-fb7b7264-f377-4ba9-99cc-ae618102f653 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:05:34.565465 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-fb7b7264-f377-4ba9-99cc-ae618102f653 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:05:34.566207 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-fb7b7264-f377-4ba9-99cc-ae618102f653 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:05:34.595425 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-a79509e8-0a3a-49a8-aaf9-e66a93576973 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '058480d92c9b4ab4af6815d0438a65c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee9dc49b89143f781e4ab30296e4d01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:05:34.613507 n-d-863052-2 devstack@n-api.service[121403]: DEBUG dbcounter [-] [121403] Writing DB stats nova_cell1:SELECT=100 {{(pid=121403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 19:05:34.614787 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-a79509e8-0a3a-49a8-aaf9-e66a93576973 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] 10.222.0.13 "GET /compute/v2.1/servers/990f3535-a5c4-4f62-bed9-b310a77293c8" status: 200 len: 1314 microversion: 2.1 time: 0.288898 Nov 01 19:05:34.616154 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1402/2865] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:05:34 2022] GET /compute/v2.1/servers/990f3535-a5c4-4f62-bed9-b310a77293c8 => generated 1314 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 19:05:34.873628 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-c9b5a30e-5edc-4484-b012-0d69b8f320f1 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:05:34.874964 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-c9b5a30e-5edc-4484-b012-0d69b8f320f1 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] [instance: b58b3cb6-ebdc-4705-b308-4e804cd52bce] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:05:34.883119 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-c9b5a30e-5edc-4484-b012-0d69b8f320f1 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:05:34.885250 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-c9b5a30e-5edc-4484-b012-0d69b8f320f1 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:05:34.887946 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-c9b5a30e-5edc-4484-b012-0d69b8f320f1 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:05:34.891462 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-c9b5a30e-5edc-4484-b012-0d69b8f320f1 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:05:34.892175 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-c9b5a30e-5edc-4484-b012-0d69b8f320f1 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:05:34.893143 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-c9b5a30e-5edc-4484-b012-0d69b8f320f1 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:05:34.943083 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-fb7b7264-f377-4ba9-99cc-ae618102f653 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '301ed3b9c37449bc9ade378f3c73a768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8807757227574c828dca1947af76659d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:05:34.953022 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-fb7b7264-f377-4ba9-99cc-ae618102f653 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '301ed3b9c37449bc9ade378f3c73a768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8807757227574c828dca1947af76659d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:05:34.954450 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-fb7b7264-f377-4ba9-99cc-ae618102f653 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '301ed3b9c37449bc9ade378f3c73a768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8807757227574c828dca1947af76659d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:05:34.962477 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-fb7b7264-f377-4ba9-99cc-ae618102f653 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] 10.222.0.13 "GET /compute/v2.1/servers/af1071a8-a090-44c9-890c-123ca3ff39f1" status: 200 len: 1662 microversion: 2.42 time: 0.424697 Nov 01 19:05:34.969975 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1464/2866] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 19:05:34 2022] GET /compute/v2.1/servers/af1071a8-a090-44c9-890c-123ca3ff39f1 => generated 1662 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 01 19:05:35.310267 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-97309e6b-59d9-4e9c-bac6-2e123f9bcb0b tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:05:35.310893 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-97309e6b-59d9-4e9c-bac6-2e123f9bcb0b tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] [instance: 307ee785-a01d-401c-8be2-b17558e735f3] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:05:35.327775 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-97309e6b-59d9-4e9c-bac6-2e123f9bcb0b tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:05:35.329671 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-97309e6b-59d9-4e9c-bac6-2e123f9bcb0b tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:05:35.333524 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-97309e6b-59d9-4e9c-bac6-2e123f9bcb0b tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:05:35.334302 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-97309e6b-59d9-4e9c-bac6-2e123f9bcb0b tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:05:35.334773 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-97309e6b-59d9-4e9c-bac6-2e123f9bcb0b tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:05:35.335368 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-97309e6b-59d9-4e9c-bac6-2e123f9bcb0b tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:05:35.505657 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-c9b5a30e-5edc-4484-b012-0d69b8f320f1 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05d6a1722dfa4e959aeb14d601e43b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b5d812eff94e2f89d4705d7e7d5f3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:05:35.520652 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-c9b5a30e-5edc-4484-b012-0d69b8f320f1 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] 10.222.0.13 "GET /compute/v2.1/servers/b58b3cb6-ebdc-4705-b308-4e804cd52bce" status: 200 len: 1515 microversion: 2.1 time: 0.652641 Nov 01 19:05:35.540679 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1403/2867] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:05:34 2022] GET /compute/v2.1/servers/b58b3cb6-ebdc-4705-b308-4e804cd52bce => generated 1515 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 19:05:35.548673 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-029f0122-d639-4689-836a-e02637c7d35a tempest-ServerGroupTestJSON-2134213834 tempest-ServerGroupTestJSON-2134213834-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:05:35.560247 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-029f0122-d639-4689-836a-e02637c7d35a tempest-ServerGroupTestJSON-2134213834 tempest-ServerGroupTestJSON-2134213834-project] [instance: 083a5a87-288b-48e0-8cda-d802774c372a] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:05:35.573792 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-029f0122-d639-4689-836a-e02637c7d35a tempest-ServerGroupTestJSON-2134213834 tempest-ServerGroupTestJSON-2134213834-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:05:35.574553 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-029f0122-d639-4689-836a-e02637c7d35a tempest-ServerGroupTestJSON-2134213834 tempest-ServerGroupTestJSON-2134213834-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:05:35.575912 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-029f0122-d639-4689-836a-e02637c7d35a tempest-ServerGroupTestJSON-2134213834 tempest-ServerGroupTestJSON-2134213834-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:05:35.580046 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-029f0122-d639-4689-836a-e02637c7d35a tempest-ServerGroupTestJSON-2134213834 tempest-ServerGroupTestJSON-2134213834-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:05:35.580764 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-029f0122-d639-4689-836a-e02637c7d35a tempest-ServerGroupTestJSON-2134213834 tempest-ServerGroupTestJSON-2134213834-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:05:35.581372 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-029f0122-d639-4689-836a-e02637c7d35a tempest-ServerGroupTestJSON-2134213834 tempest-ServerGroupTestJSON-2134213834-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:05:36.000718 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-029f0122-d639-4689-836a-e02637c7d35a tempest-ServerGroupTestJSON-2134213834 tempest-ServerGroupTestJSON-2134213834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0ef831ef96b4e5a983061fc8c7cf13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b6c42eec3544f3c820c0b0ce6f2f1f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:05:36.013668 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-029f0122-d639-4689-836a-e02637c7d35a tempest-ServerGroupTestJSON-2134213834 tempest-ServerGroupTestJSON-2134213834-project] 10.222.0.13 "GET /compute/v2.1/servers/083a5a87-288b-48e0-8cda-d802774c372a" status: 200 len: 1313 microversion: 2.1 time: 0.468652 Nov 01 19:05:36.016994 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1404/2868] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:05:35 2022] GET /compute/v2.1/servers/083a5a87-288b-48e0-8cda-d802774c372a => generated 1313 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:05:36.027514 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [req-7993b6a3-84a2-40d6-9630-d393f489792b req-b40203c3-eee8-44aa-8728-eec0240f8991 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "990f3535-a5c4-4f62-bed9-b310a77293c8", "name": "network-vif-plugged", "status": "completed", "tag": "28a32cc7-6861-459e-b63a-b5e5fdb67572"}]} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:05:36.052519 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-7993b6a3-84a2-40d6-9630-d393f489792b req-b40203c3-eee8-44aa-8728-eec0240f8991 service nova] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:05:36.055737 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-7993b6a3-84a2-40d6-9630-d393f489792b req-b40203c3-eee8-44aa-8728-eec0240f8991 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:05:36.056937 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-7993b6a3-84a2-40d6-9630-d393f489792b req-b40203c3-eee8-44aa-8728-eec0240f8991 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:05:36.087008 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.compute.server_external_events [req-7993b6a3-84a2-40d6-9630-d393f489792b req-b40203c3-eee8-44aa-8728-eec0240f8991 service nova] Creating event network-vif-plugged:28a32cc7-6861-459e-b63a-b5e5fdb67572 for instance 990f3535-a5c4-4f62-bed9-b310a77293c8 on n-h1-863052-2 Nov 01 19:05:36.109031 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [req-7993b6a3-84a2-40d6-9630-d393f489792b req-b40203c3-eee8-44aa-8728-eec0240f8991 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089045 Nov 01 19:05:36.112512 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1405/2869] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Nov 1 19:05:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:05:36.135203 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-1bbf460d-fd6e-4def-bce9-f7b8f2fe9cd2 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:05:36.136290 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-1bbf460d-fd6e-4def-bce9-f7b8f2fe9cd2 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] [instance: 990f3535-a5c4-4f62-bed9-b310a77293c8] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:05:36.138954 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-97309e6b-59d9-4e9c-bac6-2e123f9bcb0b tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb87e6147a6f470391921ac3b7a62f8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6511ea24c4c19a7c5d91535c7288d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:05:36.148324 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-97309e6b-59d9-4e9c-bac6-2e123f9bcb0b tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] 10.222.0.13 "GET /compute/v2.1/servers/307ee785-a01d-401c-8be2-b17558e735f3" status: 200 len: 1519 microversion: 2.1 time: 0.842240 Nov 01 19:05:36.154421 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-1bbf460d-fd6e-4def-bce9-f7b8f2fe9cd2 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:05:36.156427 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-1bbf460d-fd6e-4def-bce9-f7b8f2fe9cd2 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:05:36.157627 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1465/2870] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:05:35 2022] GET /compute/v2.1/servers/307ee785-a01d-401c-8be2-b17558e735f3 => generated 1519 bytes in 852 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:05:36.169452 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-1bbf460d-fd6e-4def-bce9-f7b8f2fe9cd2 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:05:36.169452 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-1bbf460d-fd6e-4def-bce9-f7b8f2fe9cd2 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:05:36.169452 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-1bbf460d-fd6e-4def-bce9-f7b8f2fe9cd2 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:05:36.169452 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-1bbf460d-fd6e-4def-bce9-f7b8f2fe9cd2 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:05:36.206987 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-04006ffd-9e22-4121-a561-c5abe835320a tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:05:36.208036 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-04006ffd-9e22-4121-a561-c5abe835320a tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] [instance: af1071a8-a090-44c9-890c-123ca3ff39f1] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:05:36.235229 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-04006ffd-9e22-4121-a561-c5abe835320a tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:05:36.235983 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-04006ffd-9e22-4121-a561-c5abe835320a tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:05:36.236599 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-04006ffd-9e22-4121-a561-c5abe835320a tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:05:36.238287 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-04006ffd-9e22-4121-a561-c5abe835320a tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:05:36.238915 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-04006ffd-9e22-4121-a561-c5abe835320a tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:05:36.239527 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-04006ffd-9e22-4121-a561-c5abe835320a tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:05:36.567704 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-1bbf460d-fd6e-4def-bce9-f7b8f2fe9cd2 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '058480d92c9b4ab4af6815d0438a65c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee9dc49b89143f781e4ab30296e4d01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:05:36.591426 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-1bbf460d-fd6e-4def-bce9-f7b8f2fe9cd2 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] 10.222.0.13 "GET /compute/v2.1/servers/990f3535-a5c4-4f62-bed9-b310a77293c8" status: 200 len: 1314 microversion: 2.1 time: 0.477322 Nov 01 19:05:36.596720 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1406/2871] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:05:36 2022] GET /compute/v2.1/servers/990f3535-a5c4-4f62-bed9-b310a77293c8 => generated 1314 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:05:36.605174 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [req-70150df2-599c-434c-b48a-bacd12b0f583 req-a743c3db-d45b-4004-b4f8-a065477c3b21 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "083a5a87-288b-48e0-8cda-d802774c372a", "tag": "c70af547-f1c8-4388-bad0-a7add263f5a0"}]} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:05:36.633477 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-70150df2-599c-434c-b48a-bacd12b0f583 req-a743c3db-d45b-4004-b4f8-a065477c3b21 service nova] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:05:36.637030 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-70150df2-599c-434c-b48a-bacd12b0f583 req-a743c3db-d45b-4004-b4f8-a065477c3b21 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:05:36.637881 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-70150df2-599c-434c-b48a-bacd12b0f583 req-a743c3db-d45b-4004-b4f8-a065477c3b21 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:05:36.666619 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.compute.server_external_events [req-70150df2-599c-434c-b48a-bacd12b0f583 req-a743c3db-d45b-4004-b4f8-a065477c3b21 service nova] Creating event network-changed:c70af547-f1c8-4388-bad0-a7add263f5a0 for instance 083a5a87-288b-48e0-8cda-d802774c372a on n-h1-863052-2 Nov 01 19:05:36.675586 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [req-70150df2-599c-434c-b48a-bacd12b0f583 req-a743c3db-d45b-4004-b4f8-a065477c3b21 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077303 Nov 01 19:05:36.682381 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1407/2872] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Nov 1 19:05:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:05:36.692981 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-c5126f76-d5f9-4210-b498-07eb9d0ce46c tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] Action: 'create', calling method: .version_select at 0x7f0ae1a0d4c0>, body: {"pool": null} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:05:36.955638 n-d-863052-2 devstack@n-api.service[121403]: DEBUG dbcounter [-] [121403] Writing DB stats nova_cell0:SELECT=4 {{(pid=121403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 19:05:37.024995 n-d-863052-2 devstack@n-api.service[121402]: DEBUG dbcounter [-] [121402] Writing DB stats nova_cell0:SELECT=2 {{(pid=121402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 19:05:37.076075 n-d-863052-2 devstack@n-api.service[121402]: DEBUG dbcounter [-] [121402] Writing DB stats nova_cell0:SELECT=6 {{(pid=121402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 19:05:37.985878 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-04006ffd-9e22-4121-a561-c5abe835320a tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '301ed3b9c37449bc9ade378f3c73a768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8807757227574c828dca1947af76659d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:05:37.997637 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-04006ffd-9e22-4121-a561-c5abe835320a tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '301ed3b9c37449bc9ade378f3c73a768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8807757227574c828dca1947af76659d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:05:38.016796 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-04006ffd-9e22-4121-a561-c5abe835320a tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '301ed3b9c37449bc9ade378f3c73a768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8807757227574c828dca1947af76659d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:05:38.018662 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-04006ffd-9e22-4121-a561-c5abe835320a tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] 10.222.0.13 "GET /compute/v2.1/servers/af1071a8-a090-44c9-890c-123ca3ff39f1" status: 200 len: 1756 microversion: 2.42 time: 1.838758 Nov 01 19:05:38.019817 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1466/2873] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 19:05:36 2022] GET /compute/v2.1/servers/af1071a8-a090-44c9-890c-123ca3ff39f1 => generated 1756 bytes in 1840 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 19:05:38.024751 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-41acce03-5c4a-4a33-af23-d8048dcebad3 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:05:38.025650 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-41acce03-5c4a-4a33-af23-d8048dcebad3 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] [instance: b58b3cb6-ebdc-4705-b308-4e804cd52bce] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:05:38.033371 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-41acce03-5c4a-4a33-af23-d8048dcebad3 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:05:38.034195 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-41acce03-5c4a-4a33-af23-d8048dcebad3 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:05:38.034933 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-41acce03-5c4a-4a33-af23-d8048dcebad3 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:05:38.035890 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-41acce03-5c4a-4a33-af23-d8048dcebad3 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:05:38.036749 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-41acce03-5c4a-4a33-af23-d8048dcebad3 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:05:38.037404 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-41acce03-5c4a-4a33-af23-d8048dcebad3 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:05:38.530385 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-41acce03-5c4a-4a33-af23-d8048dcebad3 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05d6a1722dfa4e959aeb14d601e43b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b5d812eff94e2f89d4705d7e7d5f3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:05:38.553248 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-41acce03-5c4a-4a33-af23-d8048dcebad3 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] 10.222.0.13 "GET /compute/v2.1/servers/b58b3cb6-ebdc-4705-b308-4e804cd52bce" status: 200 len: 1515 microversion: 2.1 time: 0.531996 Nov 01 19:05:38.563690 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1467/2874] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:05:38 2022] GET /compute/v2.1/servers/b58b3cb6-ebdc-4705-b308-4e804cd52bce => generated 1515 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:05:38.581123 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-1d6a53c8-6aca-4d0c-9af3-8058d67fbf34 tempest-ServerGroupTestJSON-2134213834 tempest-ServerGroupTestJSON-2134213834-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:05:38.585335 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-1d6a53c8-6aca-4d0c-9af3-8058d67fbf34 tempest-ServerGroupTestJSON-2134213834 tempest-ServerGroupTestJSON-2134213834-project] [instance: 083a5a87-288b-48e0-8cda-d802774c372a] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:05:38.605427 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-1d6a53c8-6aca-4d0c-9af3-8058d67fbf34 tempest-ServerGroupTestJSON-2134213834 tempest-ServerGroupTestJSON-2134213834-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:05:38.606275 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-1d6a53c8-6aca-4d0c-9af3-8058d67fbf34 tempest-ServerGroupTestJSON-2134213834 tempest-ServerGroupTestJSON-2134213834-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:05:38.607112 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-1d6a53c8-6aca-4d0c-9af3-8058d67fbf34 tempest-ServerGroupTestJSON-2134213834 tempest-ServerGroupTestJSON-2134213834-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:05:38.608162 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-1d6a53c8-6aca-4d0c-9af3-8058d67fbf34 tempest-ServerGroupTestJSON-2134213834 tempest-ServerGroupTestJSON-2134213834-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:05:38.609000 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-1d6a53c8-6aca-4d0c-9af3-8058d67fbf34 tempest-ServerGroupTestJSON-2134213834 tempest-ServerGroupTestJSON-2134213834-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:05:38.609694 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-1d6a53c8-6aca-4d0c-9af3-8058d67fbf34 tempest-ServerGroupTestJSON-2134213834 tempest-ServerGroupTestJSON-2134213834-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:05:39.091356 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-1d6a53c8-6aca-4d0c-9af3-8058d67fbf34 tempest-ServerGroupTestJSON-2134213834 tempest-ServerGroupTestJSON-2134213834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0ef831ef96b4e5a983061fc8c7cf13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b6c42eec3544f3c820c0b0ce6f2f1f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:05:39.100441 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-1d6a53c8-6aca-4d0c-9af3-8058d67fbf34 tempest-ServerGroupTestJSON-2134213834 tempest-ServerGroupTestJSON-2134213834-project] 10.222.0.13 "GET /compute/v2.1/servers/083a5a87-288b-48e0-8cda-d802774c372a" status: 200 len: 1313 microversion: 2.1 time: 0.526652 Nov 01 19:05:39.112691 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1468/2875] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:05:38 2022] GET /compute/v2.1/servers/083a5a87-288b-48e0-8cda-d802774c372a => generated 1313 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:05:39.112691 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-b8e4e848-a006-4bb5-be17-5b2eed9e409e tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:05:39.112691 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-b8e4e848-a006-4bb5-be17-5b2eed9e409e tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] [instance: 990f3535-a5c4-4f62-bed9-b310a77293c8] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:05:39.145691 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-b8e4e848-a006-4bb5-be17-5b2eed9e409e tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:05:39.148086 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-b8e4e848-a006-4bb5-be17-5b2eed9e409e tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:05:39.148718 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-b8e4e848-a006-4bb5-be17-5b2eed9e409e tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:05:39.153539 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-b8e4e848-a006-4bb5-be17-5b2eed9e409e tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:05:39.154179 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-b8e4e848-a006-4bb5-be17-5b2eed9e409e tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:05:39.155252 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-b8e4e848-a006-4bb5-be17-5b2eed9e409e tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:05:39.660545 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-b8e4e848-a006-4bb5-be17-5b2eed9e409e tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '058480d92c9b4ab4af6815d0438a65c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee9dc49b89143f781e4ab30296e4d01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:05:39.668966 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-b8e4e848-a006-4bb5-be17-5b2eed9e409e tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] 10.222.0.13 "GET /compute/v2.1/servers/990f3535-a5c4-4f62-bed9-b310a77293c8" status: 200 len: 1502 microversion: 2.1 time: 0.561552 Nov 01 19:05:39.675293 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1469/2876] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:05:39 2022] GET /compute/v2.1/servers/990f3535-a5c4-4f62-bed9-b310a77293c8 => generated 1502 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:05:39.703268 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-a65d0743-845d-48ed-8786-823f5a8ebe25 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:05:39.703958 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-a65d0743-845d-48ed-8786-823f5a8ebe25 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] [instance: af1071a8-a090-44c9-890c-123ca3ff39f1] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:05:39.720429 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-a65d0743-845d-48ed-8786-823f5a8ebe25 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:05:39.721081 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-a65d0743-845d-48ed-8786-823f5a8ebe25 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:05:39.723676 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-a65d0743-845d-48ed-8786-823f5a8ebe25 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:05:39.724647 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-a65d0743-845d-48ed-8786-823f5a8ebe25 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:05:39.725292 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-a65d0743-845d-48ed-8786-823f5a8ebe25 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:05:39.727721 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-a65d0743-845d-48ed-8786-823f5a8ebe25 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:05:39.930081 n-d-863052-2 devstack@n-api.service[121403]: DEBUG dbcounter [-] [121403] Writing DB stats nova_cell0:SELECT=66 {{(pid=121403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 19:05:40.386376 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-a65d0743-845d-48ed-8786-823f5a8ebe25 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '301ed3b9c37449bc9ade378f3c73a768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8807757227574c828dca1947af76659d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:05:40.396753 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-a65d0743-845d-48ed-8786-823f5a8ebe25 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '301ed3b9c37449bc9ade378f3c73a768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8807757227574c828dca1947af76659d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:05:40.404547 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-a65d0743-845d-48ed-8786-823f5a8ebe25 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '301ed3b9c37449bc9ade378f3c73a768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8807757227574c828dca1947af76659d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:05:40.410936 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-a65d0743-845d-48ed-8786-823f5a8ebe25 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] 10.222.0.13 "GET /compute/v2.1/servers/af1071a8-a090-44c9-890c-123ca3ff39f1" status: 200 len: 1756 microversion: 2.42 time: 0.731353 Nov 01 19:05:40.411885 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1470/2877] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 19:05:39 2022] GET /compute/v2.1/servers/af1071a8-a090-44c9-890c-123ca3ff39f1 => generated 1756 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 19:05:40.418803 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-0ed69a6f-eba5-46c3-8e7e-80572165ffc9 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:05:40.428093 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-0ed69a6f-eba5-46c3-8e7e-80572165ffc9 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] [instance: b58b3cb6-ebdc-4705-b308-4e804cd52bce] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:05:40.445611 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-0ed69a6f-eba5-46c3-8e7e-80572165ffc9 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:05:40.446101 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-0ed69a6f-eba5-46c3-8e7e-80572165ffc9 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:05:40.446641 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-0ed69a6f-eba5-46c3-8e7e-80572165ffc9 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:05:40.447231 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-0ed69a6f-eba5-46c3-8e7e-80572165ffc9 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:05:40.447704 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-0ed69a6f-eba5-46c3-8e7e-80572165ffc9 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:05:40.448091 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-0ed69a6f-eba5-46c3-8e7e-80572165ffc9 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:05:41.428153 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-0ed69a6f-eba5-46c3-8e7e-80572165ffc9 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05d6a1722dfa4e959aeb14d601e43b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b5d812eff94e2f89d4705d7e7d5f3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:05:41.440388 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-0ed69a6f-eba5-46c3-8e7e-80572165ffc9 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] 10.222.0.13 "GET /compute/v2.1/servers/b58b3cb6-ebdc-4705-b308-4e804cd52bce" status: 200 len: 1521 microversion: 2.1 time: 1.021259 Nov 01 19:05:41.443066 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1471/2878] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:05:40 2022] GET /compute/v2.1/servers/b58b3cb6-ebdc-4705-b308-4e804cd52bce => generated 1521 bytes in 1028 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:05:41.454147 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-1116235e-0305-4d5e-b1ec-57f2f34ad3ab tempest-ServerGroupTestJSON-2134213834 tempest-ServerGroupTestJSON-2134213834-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:05:41.455320 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-1116235e-0305-4d5e-b1ec-57f2f34ad3ab tempest-ServerGroupTestJSON-2134213834 tempest-ServerGroupTestJSON-2134213834-project] [instance: 083a5a87-288b-48e0-8cda-d802774c372a] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:05:41.470400 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-1116235e-0305-4d5e-b1ec-57f2f34ad3ab tempest-ServerGroupTestJSON-2134213834 tempest-ServerGroupTestJSON-2134213834-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:05:41.470899 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-1116235e-0305-4d5e-b1ec-57f2f34ad3ab tempest-ServerGroupTestJSON-2134213834 tempest-ServerGroupTestJSON-2134213834-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:05:41.471585 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-1116235e-0305-4d5e-b1ec-57f2f34ad3ab tempest-ServerGroupTestJSON-2134213834 tempest-ServerGroupTestJSON-2134213834-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:05:41.472556 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-1116235e-0305-4d5e-b1ec-57f2f34ad3ab tempest-ServerGroupTestJSON-2134213834 tempest-ServerGroupTestJSON-2134213834-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:05:41.473334 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-1116235e-0305-4d5e-b1ec-57f2f34ad3ab tempest-ServerGroupTestJSON-2134213834 tempest-ServerGroupTestJSON-2134213834-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:05:41.476392 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-1116235e-0305-4d5e-b1ec-57f2f34ad3ab tempest-ServerGroupTestJSON-2134213834 tempest-ServerGroupTestJSON-2134213834-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:05:41.931404 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-1116235e-0305-4d5e-b1ec-57f2f34ad3ab tempest-ServerGroupTestJSON-2134213834 tempest-ServerGroupTestJSON-2134213834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0ef831ef96b4e5a983061fc8c7cf13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b6c42eec3544f3c820c0b0ce6f2f1f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:05:41.947616 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-1116235e-0305-4d5e-b1ec-57f2f34ad3ab tempest-ServerGroupTestJSON-2134213834 tempest-ServerGroupTestJSON-2134213834-project] 10.222.0.13 "GET /compute/v2.1/servers/083a5a87-288b-48e0-8cda-d802774c372a" status: 200 len: 1313 microversion: 2.1 time: 0.499215 Nov 01 19:05:41.949155 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1472/2879] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:05:41 2022] GET /compute/v2.1/servers/083a5a87-288b-48e0-8cda-d802774c372a => generated 1313 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:05:41.956206 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-10ce98e3-f310-4799-92a3-357c40810543 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:05:41.961431 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-10ce98e3-f310-4799-92a3-357c40810543 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] [instance: af1071a8-a090-44c9-890c-123ca3ff39f1] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:05:41.975852 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-10ce98e3-f310-4799-92a3-357c40810543 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:05:41.976792 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-10ce98e3-f310-4799-92a3-357c40810543 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:05:41.977444 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-10ce98e3-f310-4799-92a3-357c40810543 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:05:41.978583 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-10ce98e3-f310-4799-92a3-357c40810543 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:05:41.979316 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-10ce98e3-f310-4799-92a3-357c40810543 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:05:41.979957 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-10ce98e3-f310-4799-92a3-357c40810543 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:05:42.359333 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-10ce98e3-f310-4799-92a3-357c40810543 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '301ed3b9c37449bc9ade378f3c73a768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8807757227574c828dca1947af76659d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:05:42.398020 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-10ce98e3-f310-4799-92a3-357c40810543 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '301ed3b9c37449bc9ade378f3c73a768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8807757227574c828dca1947af76659d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:05:42.399567 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-10ce98e3-f310-4799-92a3-357c40810543 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '301ed3b9c37449bc9ade378f3c73a768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8807757227574c828dca1947af76659d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:05:42.408930 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-10ce98e3-f310-4799-92a3-357c40810543 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] 10.222.0.13 "GET /compute/v2.1/servers/af1071a8-a090-44c9-890c-123ca3ff39f1" status: 200 len: 1803 microversion: 2.42 time: 0.458281 Nov 01 19:05:42.409545 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1473/2880] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 19:05:41 2022] GET /compute/v2.1/servers/af1071a8-a090-44c9-890c-123ca3ff39f1 => generated 1803 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 19:05:42.466856 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-4db4ea14-3e80-4a6a-abc9-0e3dabf3bfc8 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:05:42.472965 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-4db4ea14-3e80-4a6a-abc9-0e3dabf3bfc8 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] [instance: b58b3cb6-ebdc-4705-b308-4e804cd52bce] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:05:42.491829 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-4db4ea14-3e80-4a6a-abc9-0e3dabf3bfc8 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:05:42.492888 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-4db4ea14-3e80-4a6a-abc9-0e3dabf3bfc8 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:05:42.493549 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-4db4ea14-3e80-4a6a-abc9-0e3dabf3bfc8 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:05:42.494515 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-4db4ea14-3e80-4a6a-abc9-0e3dabf3bfc8 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:05:42.495184 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-4db4ea14-3e80-4a6a-abc9-0e3dabf3bfc8 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:05:42.495819 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-4db4ea14-3e80-4a6a-abc9-0e3dabf3bfc8 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:05:42.907083 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-4db4ea14-3e80-4a6a-abc9-0e3dabf3bfc8 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05d6a1722dfa4e959aeb14d601e43b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b5d812eff94e2f89d4705d7e7d5f3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:05:42.934891 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-4db4ea14-3e80-4a6a-abc9-0e3dabf3bfc8 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] 10.222.0.13 "GET /compute/v2.1/servers/b58b3cb6-ebdc-4705-b308-4e804cd52bce" status: 200 len: 1521 microversion: 2.1 time: 0.469097 Nov 01 19:05:42.966838 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1474/2881] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:05:42 2022] GET /compute/v2.1/servers/b58b3cb6-ebdc-4705-b308-4e804cd52bce => generated 1521 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:05:42.996352 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-e0cd86d2-7f3c-4167-9dc0-e6ad32f8ab19 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "64073458-3335-463c-8d1d-d36e8dc429f9"}} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:05:43.000775 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-e0cd86d2-7f3c-4167-9dc0-e6ad32f8ab19 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] [instance: 990f3535-a5c4-4f62-bed9-b310a77293c8] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:05:43.008020 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-e0cd86d2-7f3c-4167-9dc0-e6ad32f8ab19 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:05:43.009139 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-e0cd86d2-7f3c-4167-9dc0-e6ad32f8ab19 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:05:43.009686 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-e0cd86d2-7f3c-4167-9dc0-e6ad32f8ab19 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:05:43.010693 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-e0cd86d2-7f3c-4167-9dc0-e6ad32f8ab19 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:05:43.011222 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-e0cd86d2-7f3c-4167-9dc0-e6ad32f8ab19 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:05:43.011719 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-e0cd86d2-7f3c-4167-9dc0-e6ad32f8ab19 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:05:43.493270 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-e0cd86d2-7f3c-4167-9dc0-e6ad32f8ab19 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] 10.222.0.13 "POST /compute/v2.1/servers/990f3535-a5c4-4f62-bed9-b310a77293c8/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.501609 Nov 01 19:05:43.496698 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1475/2882] 10.222.0.13 () {60 vars in 1323 bytes} [Tue Nov 1 19:05:42 2022] POST /compute/v2.1/servers/990f3535-a5c4-4f62-bed9-b310a77293c8/os-volume_attachments => generated 194 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:05:43.513528 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-b96a3302-ca98-4ebe-a3a0-2d6fdade1298 tempest-ServerGroupTestJSON-2134213834 tempest-ServerGroupTestJSON-2134213834-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:05:43.515735 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-b96a3302-ca98-4ebe-a3a0-2d6fdade1298 tempest-ServerGroupTestJSON-2134213834 tempest-ServerGroupTestJSON-2134213834-project] [instance: 083a5a87-288b-48e0-8cda-d802774c372a] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:05:43.535147 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-b96a3302-ca98-4ebe-a3a0-2d6fdade1298 tempest-ServerGroupTestJSON-2134213834 tempest-ServerGroupTestJSON-2134213834-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:05:43.536446 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-b96a3302-ca98-4ebe-a3a0-2d6fdade1298 tempest-ServerGroupTestJSON-2134213834 tempest-ServerGroupTestJSON-2134213834-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:05:43.537346 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-b96a3302-ca98-4ebe-a3a0-2d6fdade1298 tempest-ServerGroupTestJSON-2134213834 tempest-ServerGroupTestJSON-2134213834-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:05:43.538301 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-b96a3302-ca98-4ebe-a3a0-2d6fdade1298 tempest-ServerGroupTestJSON-2134213834 tempest-ServerGroupTestJSON-2134213834-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:05:43.539780 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-b96a3302-ca98-4ebe-a3a0-2d6fdade1298 tempest-ServerGroupTestJSON-2134213834 tempest-ServerGroupTestJSON-2134213834-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:05:43.541152 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-b96a3302-ca98-4ebe-a3a0-2d6fdade1298 tempest-ServerGroupTestJSON-2134213834 tempest-ServerGroupTestJSON-2134213834-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:05:43.638728 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-c5126f76-d5f9-4210-b498-07eb9d0ce46c tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] 10.222.0.13 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 6.954738 Nov 01 19:05:43.653072 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1408/2883] 10.222.0.13 () {60 vars in 1170 bytes} [Tue Nov 1 19:05:36 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 6970 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:05:43.691363 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-049a5a08-520b-4828-955c-2155cf020a6d tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:05:43.714835 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-049a5a08-520b-4828-955c-2155cf020a6d tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] [instance: af1071a8-a090-44c9-890c-123ca3ff39f1] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:05:43.824303 n-d-863052-2 devstack@n-api.service[121402]: DEBUG dbcounter [-] [121402] Writing DB stats nova_api:SELECT=78,nova_api:INSERT=6 {{(pid=121402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 19:05:43.829814 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-049a5a08-520b-4828-955c-2155cf020a6d tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:05:43.834716 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-049a5a08-520b-4828-955c-2155cf020a6d tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:05:43.836225 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-049a5a08-520b-4828-955c-2155cf020a6d tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:05:43.839999 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-049a5a08-520b-4828-955c-2155cf020a6d tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:05:43.844749 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-049a5a08-520b-4828-955c-2155cf020a6d tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:05:43.845205 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-049a5a08-520b-4828-955c-2155cf020a6d tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:05:44.151887 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-b96a3302-ca98-4ebe-a3a0-2d6fdade1298 tempest-ServerGroupTestJSON-2134213834 tempest-ServerGroupTestJSON-2134213834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0ef831ef96b4e5a983061fc8c7cf13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b6c42eec3544f3c820c0b0ce6f2f1f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:05:44.160738 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-b96a3302-ca98-4ebe-a3a0-2d6fdade1298 tempest-ServerGroupTestJSON-2134213834 tempest-ServerGroupTestJSON-2134213834-project] 10.222.0.13 "GET /compute/v2.1/servers/083a5a87-288b-48e0-8cda-d802774c372a" status: 200 len: 1313 microversion: 2.1 time: 0.660516 Nov 01 19:05:44.173326 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1476/2884] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:05:43 2022] GET /compute/v2.1/servers/083a5a87-288b-48e0-8cda-d802774c372a => generated 1313 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:05:44.184750 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-ba9d9723-2e9f-45f1-9248-a5df136dcad3 tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationTestJSON-server-143340081", "imageRef": "2d4a0047-1b9e-445f-8af8-1b5c9d93e881", "flavorRef": "452", "networks": [{"uuid": "5b808c64-bf01-4ded-bf6b-0b3fd18d2f1c"}]}} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:05:44.255459 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.network.neutron [None req-ba9d9723-2e9f-45f1-9248-a5df136dcad3 tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] validate_networks() for [('5b808c64-bf01-4ded-bf6b-0b3fd18d2f1c', None, None, None, None, None)] {{(pid=121403) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 01 19:05:44.445414 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-049a5a08-520b-4828-955c-2155cf020a6d tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '301ed3b9c37449bc9ade378f3c73a768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8807757227574c828dca1947af76659d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:05:44.455792 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-049a5a08-520b-4828-955c-2155cf020a6d tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '301ed3b9c37449bc9ade378f3c73a768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8807757227574c828dca1947af76659d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:05:44.464075 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-049a5a08-520b-4828-955c-2155cf020a6d tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '301ed3b9c37449bc9ade378f3c73a768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8807757227574c828dca1947af76659d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:05:44.466261 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-049a5a08-520b-4828-955c-2155cf020a6d tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] 10.222.0.13 "GET /compute/v2.1/servers/af1071a8-a090-44c9-890c-123ca3ff39f1" status: 200 len: 1850 microversion: 2.42 time: 0.810230 Nov 01 19:05:44.484110 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1409/2885] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 19:05:43 2022] GET /compute/v2.1/servers/af1071a8-a090-44c9-890c-123ca3ff39f1 => generated 1850 bytes in 830 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 19:05:44.507694 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-5819d90d-7af3-4fdb-bd97-dfe3e14b63c3 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:05:44.508626 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-5819d90d-7af3-4fdb-bd97-dfe3e14b63c3 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] [instance: b58b3cb6-ebdc-4705-b308-4e804cd52bce] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:05:44.521962 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-5819d90d-7af3-4fdb-bd97-dfe3e14b63c3 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:05:44.524401 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-5819d90d-7af3-4fdb-bd97-dfe3e14b63c3 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:05:44.527287 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-5819d90d-7af3-4fdb-bd97-dfe3e14b63c3 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:05:44.528699 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-5819d90d-7af3-4fdb-bd97-dfe3e14b63c3 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:05:44.531478 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-5819d90d-7af3-4fdb-bd97-dfe3e14b63c3 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:05:44.532138 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-5819d90d-7af3-4fdb-bd97-dfe3e14b63c3 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:05:45.044036 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-5819d90d-7af3-4fdb-bd97-dfe3e14b63c3 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05d6a1722dfa4e959aeb14d601e43b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b5d812eff94e2f89d4705d7e7d5f3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:05:45.056993 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-5819d90d-7af3-4fdb-bd97-dfe3e14b63c3 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] 10.222.0.13 "GET /compute/v2.1/servers/b58b3cb6-ebdc-4705-b308-4e804cd52bce" status: 200 len: 1506 microversion: 2.1 time: 0.558757 Nov 01 19:05:45.064641 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1410/2886] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:05:44 2022] GET /compute/v2.1/servers/b58b3cb6-ebdc-4705-b308-4e804cd52bce => generated 1506 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:05:45.098217 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-4d54ad6c-7831-4859-9e4e-12dcaa7e79ea tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:05:45.104036 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-4d54ad6c-7831-4859-9e4e-12dcaa7e79ea tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] [instance: b58b3cb6-ebdc-4705-b308-4e804cd52bce] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:05:45.130821 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-4d54ad6c-7831-4859-9e4e-12dcaa7e79ea tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:05:45.131917 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-4d54ad6c-7831-4859-9e4e-12dcaa7e79ea tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:05:45.132800 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-4d54ad6c-7831-4859-9e4e-12dcaa7e79ea tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:05:45.133748 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-4d54ad6c-7831-4859-9e4e-12dcaa7e79ea tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:05:45.134421 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-4d54ad6c-7831-4859-9e4e-12dcaa7e79ea tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:05:45.135241 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-4d54ad6c-7831-4859-9e4e-12dcaa7e79ea tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:05:45.149900 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.virt.hardware [None req-ba9d9723-2e9f-45f1-9248-a5df136dcad3 tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] Flavor limits 0:0:0 {{(pid=121403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 01 19:05:45.150479 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.virt.hardware [None req-ba9d9723-2e9f-45f1-9248-a5df136dcad3 tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] Image limits 0:0:0 {{(pid=121403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 01 19:05:45.150794 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.virt.hardware [None req-ba9d9723-2e9f-45f1-9248-a5df136dcad3 tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] Flavor pref 0:0:0 {{(pid=121403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 01 19:05:45.151209 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.virt.hardware [None req-ba9d9723-2e9f-45f1-9248-a5df136dcad3 tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] Image pref 0:0:0 {{(pid=121403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 01 19:05:45.151625 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.virt.hardware [None req-ba9d9723-2e9f-45f1-9248-a5df136dcad3 tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 01 19:05:45.169333 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-ba9d9723-2e9f-45f1-9248-a5df136dcad3 tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:05:45.169827 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-ba9d9723-2e9f-45f1-9248-a5df136dcad3 tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:05:45.178984 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-ba9d9723-2e9f-45f1-9248-a5df136dcad3 tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:05:45.179823 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-ba9d9723-2e9f-45f1-9248-a5df136dcad3 tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:05:45.184939 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-ba9d9723-2e9f-45f1-9248-a5df136dcad3 tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:05:45.185719 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-ba9d9723-2e9f-45f1-9248-a5df136dcad3 tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:05:45.243035 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.quota [None req-ba9d9723-2e9f-45f1-9248-a5df136dcad3 tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] Getting quotas for project eda6511ea24c4c19a7c5d91535c7288d. Resources: {'cores', 'ram', 'instances'} {{(pid=121403) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 01 19:05:45.260610 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.quota [None req-ba9d9723-2e9f-45f1-9248-a5df136dcad3 tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] Getting quotas for user cb87e6147a6f470391921ac3b7a62f8d and project eda6511ea24c4c19a7c5d91535c7288d. Resources: {'cores', 'ram', 'instances'} {{(pid=121403) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 01 19:05:45.290140 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-ba9d9723-2e9f-45f1-9248-a5df136dcad3 tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] Going to run 1 instances... {{(pid=121403) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 01 19:05:45.293607 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-ba9d9723-2e9f-45f1-9248-a5df136dcad3 tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] [instance: 86162175-5f45-4aa7-9825-f1a3b4a699ff] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2d4a0047-1b9e-445f-8af8-1b5c9d93e881',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121403) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 01 19:05:45.364064 n-d-863052-2 devstack@n-api.service[121403]: DEBUG dbcounter [-] [121403] Writing DB stats nova_api:INSERT=5,nova_api:SELECT=95 {{(pid=121403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 19:05:45.409355 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-ba9d9723-2e9f-45f1-9248-a5df136dcad3 tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.234445 Nov 01 19:05:45.412869 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1477/2887] 10.222.0.13 () {60 vars in 1147 bytes} [Tue Nov 1 19:05:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 1239 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 01 19:05:45.422061 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-d2c6639c-bee1-42ae-95a6-ce99916fbeb1 tempest-ServerGroupTestJSON-2134213834 tempest-ServerGroupTestJSON-2134213834-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:05:45.427042 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-d2c6639c-bee1-42ae-95a6-ce99916fbeb1 tempest-ServerGroupTestJSON-2134213834 tempest-ServerGroupTestJSON-2134213834-project] [instance: 083a5a87-288b-48e0-8cda-d802774c372a] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:05:45.439132 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d2c6639c-bee1-42ae-95a6-ce99916fbeb1 tempest-ServerGroupTestJSON-2134213834 tempest-ServerGroupTestJSON-2134213834-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:05:45.441002 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d2c6639c-bee1-42ae-95a6-ce99916fbeb1 tempest-ServerGroupTestJSON-2134213834 tempest-ServerGroupTestJSON-2134213834-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:05:45.444719 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d2c6639c-bee1-42ae-95a6-ce99916fbeb1 tempest-ServerGroupTestJSON-2134213834 tempest-ServerGroupTestJSON-2134213834-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:05:45.446632 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d2c6639c-bee1-42ae-95a6-ce99916fbeb1 tempest-ServerGroupTestJSON-2134213834 tempest-ServerGroupTestJSON-2134213834-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:05:45.447781 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d2c6639c-bee1-42ae-95a6-ce99916fbeb1 tempest-ServerGroupTestJSON-2134213834 tempest-ServerGroupTestJSON-2134213834-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:05:45.450327 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d2c6639c-bee1-42ae-95a6-ce99916fbeb1 tempest-ServerGroupTestJSON-2134213834 tempest-ServerGroupTestJSON-2134213834-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:05:45.855051 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-d2c6639c-bee1-42ae-95a6-ce99916fbeb1 tempest-ServerGroupTestJSON-2134213834 tempest-ServerGroupTestJSON-2134213834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0ef831ef96b4e5a983061fc8c7cf13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b6c42eec3544f3c820c0b0ce6f2f1f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:05:45.868180 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-d2c6639c-bee1-42ae-95a6-ce99916fbeb1 tempest-ServerGroupTestJSON-2134213834 tempest-ServerGroupTestJSON-2134213834-project] 10.222.0.13 "GET /compute/v2.1/servers/083a5a87-288b-48e0-8cda-d802774c372a" status: 200 len: 1313 microversion: 2.1 time: 0.453681 Nov 01 19:05:45.881933 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1478/2888] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:05:45 2022] GET /compute/v2.1/servers/083a5a87-288b-48e0-8cda-d802774c372a => generated 1313 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:05:45.897476 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-b3039855-0bc3-43bc-a6f0-c0f7e35b40aa tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:05:45.901074 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-b3039855-0bc3-43bc-a6f0-c0f7e35b40aa tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] [instance: 86162175-5f45-4aa7-9825-f1a3b4a699ff] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:05:45.990552 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-b3039855-0bc3-43bc-a6f0-c0f7e35b40aa tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb87e6147a6f470391921ac3b7a62f8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6511ea24c4c19a7c5d91535c7288d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:05:45.998558 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-b3039855-0bc3-43bc-a6f0-c0f7e35b40aa tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] 10.222.0.13 "GET /compute/v2.1/servers/86162175-5f45-4aa7-9825-f1a3b4a699ff" status: 200 len: 1223 microversion: 2.1 time: 0.115240 Nov 01 19:05:46.001112 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1479/2889] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:05:45 2022] GET /compute/v2.1/servers/86162175-5f45-4aa7-9825-f1a3b4a699ff => generated 1223 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:05:46.006286 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-0cc9f967-e27b-4e1b-9742-cde6e9bb79ed tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:05:46.007196 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-0cc9f967-e27b-4e1b-9742-cde6e9bb79ed tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] [instance: af1071a8-a090-44c9-890c-123ca3ff39f1] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:05:46.013905 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-0cc9f967-e27b-4e1b-9742-cde6e9bb79ed tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:05:46.014698 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-0cc9f967-e27b-4e1b-9742-cde6e9bb79ed tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:05:46.015360 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-0cc9f967-e27b-4e1b-9742-cde6e9bb79ed tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:05:46.016318 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-0cc9f967-e27b-4e1b-9742-cde6e9bb79ed tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:05:46.017019 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-0cc9f967-e27b-4e1b-9742-cde6e9bb79ed tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:05:46.017668 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-0cc9f967-e27b-4e1b-9742-cde6e9bb79ed tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:05:46.390666 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-0cc9f967-e27b-4e1b-9742-cde6e9bb79ed tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '301ed3b9c37449bc9ade378f3c73a768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8807757227574c828dca1947af76659d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:05:46.416225 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-0cc9f967-e27b-4e1b-9742-cde6e9bb79ed tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '301ed3b9c37449bc9ade378f3c73a768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8807757227574c828dca1947af76659d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:05:46.423652 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-0cc9f967-e27b-4e1b-9742-cde6e9bb79ed tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '301ed3b9c37449bc9ade378f3c73a768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8807757227574c828dca1947af76659d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:05:46.425786 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-0cc9f967-e27b-4e1b-9742-cde6e9bb79ed tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] 10.222.0.13 "GET /compute/v2.1/servers/af1071a8-a090-44c9-890c-123ca3ff39f1" status: 200 len: 1850 microversion: 2.42 time: 0.423440 Nov 01 19:05:46.437330 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-4d54ad6c-7831-4859-9e4e-12dcaa7e79ea tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05d6a1722dfa4e959aeb14d601e43b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b5d812eff94e2f89d4705d7e7d5f3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:05:46.442526 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1480/2890] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 19:05:46 2022] GET /compute/v2.1/servers/af1071a8-a090-44c9-890c-123ca3ff39f1 => generated 1850 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 19:05:46.457651 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-4d54ad6c-7831-4859-9e4e-12dcaa7e79ea tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] 10.222.0.13 "GET /compute/v2.1/servers/b58b3cb6-ebdc-4705-b308-4e804cd52bce" status: 200 len: 1506 microversion: 2.1 time: 1.365725 Nov 01 19:05:46.458286 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1411/2891] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:05:45 2022] GET /compute/v2.1/servers/b58b3cb6-ebdc-4705-b308-4e804cd52bce => generated 1506 bytes in 1369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:05:46.468258 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [req-cf62430e-662c-414d-8090-6e57827c458d req-1f2b3bbf-9212-415f-90c8-bc14824074a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b58b3cb6-ebdc-4705-b308-4e804cd52bce", "name": "network-vif-unplugged", "status": "completed", "tag": "83daf795-a40d-4ba1-ae59-903b534c7eb0"}]} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:05:46.479258 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-59f97441-4fd6-46f5-b0e2-0fcd8386f184 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:05:46.483831 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-59f97441-4fd6-46f5-b0e2-0fcd8386f184 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] [instance: 3029f3c1-4f32-4f6b-963c-16f65b6dff3c] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:05:46.488463 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-cf62430e-662c-414d-8090-6e57827c458d req-1f2b3bbf-9212-415f-90c8-bc14824074a4 service nova] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:05:46.490588 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-cf62430e-662c-414d-8090-6e57827c458d req-1f2b3bbf-9212-415f-90c8-bc14824074a4 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:05:46.491173 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-cf62430e-662c-414d-8090-6e57827c458d req-1f2b3bbf-9212-415f-90c8-bc14824074a4 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:05:46.511686 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.compute.server_external_events [req-cf62430e-662c-414d-8090-6e57827c458d req-1f2b3bbf-9212-415f-90c8-bc14824074a4 service nova] Creating event network-vif-unplugged:83daf795-a40d-4ba1-ae59-903b534c7eb0 for instance b58b3cb6-ebdc-4705-b308-4e804cd52bce on n-h2-863052-2 Nov 01 19:05:46.515991 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-59f97441-4fd6-46f5-b0e2-0fcd8386f184 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:05:46.516650 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-59f97441-4fd6-46f5-b0e2-0fcd8386f184 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:05:46.518520 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-59f97441-4fd6-46f5-b0e2-0fcd8386f184 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:05:46.521349 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [req-cf62430e-662c-414d-8090-6e57827c458d req-1f2b3bbf-9212-415f-90c8-bc14824074a4 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.058493 Nov 01 19:05:46.522290 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-59f97441-4fd6-46f5-b0e2-0fcd8386f184 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:05:46.522423 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1412/2892] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Nov 1 19:05:46 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:05:46.522988 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-59f97441-4fd6-46f5-b0e2-0fcd8386f184 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:05:46.525131 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-59f97441-4fd6-46f5-b0e2-0fcd8386f184 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:05:46.530819 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-85c34eec-665c-49a3-9105-c0b1a9439217 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Action: 'create', calling method: .version_select at 0x7f0ae1ac0940>, body: {"keypair": {"name": "tempest-keypair-1545214518", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBa7gMUgFTlC6bwplIeWs9nOjFJZHF8atdSKJ0mDKws1WaRmPae6sNHa1ITm9t7Wg7quOqTMpIw74RJ5OJe/9UFuv4sa5w6ZzJHbFFU5J3N+BoZJJj6Tn68u3RELpwc7zQ=="}} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:05:46.556913 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.quota [None req-85c34eec-665c-49a3-9105-c0b1a9439217 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Getting quotas for project adf4adda91364dab94830347c06e3957. Resources: {'key_pairs'} {{(pid=121402) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 01 19:05:46.567886 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.quota [None req-85c34eec-665c-49a3-9105-c0b1a9439217 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Getting quotas for user cd2105b0264b48d084d0e79cabff8bc4 and project adf4adda91364dab94830347c06e3957. Resources: {'key_pairs'} {{(pid=121402) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 01 19:05:46.598778 n-d-863052-2 devstack@n-api.service[121403]: DEBUG dbcounter [-] [121403] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 19:05:46.608131 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-85c34eec-665c-49a3-9105-c0b1a9439217 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.32 time: 0.084138 Nov 01 19:05:46.611257 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1413/2893] 10.222.0.13 () {62 vars in 1200 bytes} [Tue Nov 1 19:05:46 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 88 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Nov 01 19:05:46.622872 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-d40a4793-e062-47e2-af42-b9ba0e5c68f7 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:05:46.624052 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-d40a4793-e062-47e2-af42-b9ba0e5c68f7 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] [instance: b58b3cb6-ebdc-4705-b308-4e804cd52bce] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:05:46.631988 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-d40a4793-e062-47e2-af42-b9ba0e5c68f7 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:05:46.632767 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-d40a4793-e062-47e2-af42-b9ba0e5c68f7 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:05:46.635366 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-d40a4793-e062-47e2-af42-b9ba0e5c68f7 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:05:46.636423 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-d40a4793-e062-47e2-af42-b9ba0e5c68f7 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:05:46.637070 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-d40a4793-e062-47e2-af42-b9ba0e5c68f7 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:05:46.638332 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-d40a4793-e062-47e2-af42-b9ba0e5c68f7 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:05:46.648560 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-59f97441-4fd6-46f5-b0e2-0fcd8386f184 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] 10.222.0.13 "GET /compute/v2.1/servers/3029f3c1-4f32-4f6b-963c-16f65b6dff3c/ips" status: 200 len: 149 microversion: 2.1 time: 0.204357 Nov 01 19:05:46.652471 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1481/2894] 10.222.0.13 () {58 vars in 1248 bytes} [Tue Nov 1 19:05:46 2022] GET /compute/v2.1/servers/3029f3c1-4f32-4f6b-963c-16f65b6dff3c/ips => generated 149 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:05:46.681531 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-d40a4793-e062-47e2-af42-b9ba0e5c68f7 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] [instance: b58b3cb6-ebdc-4705-b308-4e804cd52bce] Going to try to terminate instance {{(pid=121402) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 01 19:05:46.830601 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-d40a4793-e062-47e2-af42-b9ba0e5c68f7 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] 10.222.0.13 "DELETE /compute/v2.1/servers/b58b3cb6-ebdc-4705-b308-4e804cd52bce" status: 204 len: 0 microversion: 2.1 time: 0.216743 Nov 01 19:05:46.844643 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1414/2895] 10.222.0.13 () {58 vars in 1239 bytes} [Tue Nov 1 19:05:46 2022] DELETE /compute/v2.1/servers/b58b3cb6-ebdc-4705-b308-4e804cd52bce => generated 0 bytes in 219 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 01 19:05:46.899161 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-8f7c1205-9122-49ac-ab2d-6ff7b180134c tempest-ServerGroupTestJSON-2134213834 tempest-ServerGroupTestJSON-2134213834-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:05:46.900183 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-8f7c1205-9122-49ac-ab2d-6ff7b180134c tempest-ServerGroupTestJSON-2134213834 tempest-ServerGroupTestJSON-2134213834-project] [instance: 083a5a87-288b-48e0-8cda-d802774c372a] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:05:46.911383 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-8f7c1205-9122-49ac-ab2d-6ff7b180134c tempest-ServerGroupTestJSON-2134213834 tempest-ServerGroupTestJSON-2134213834-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:05:46.922510 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-8f7c1205-9122-49ac-ab2d-6ff7b180134c tempest-ServerGroupTestJSON-2134213834 tempest-ServerGroupTestJSON-2134213834-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:05:46.924635 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-8f7c1205-9122-49ac-ab2d-6ff7b180134c tempest-ServerGroupTestJSON-2134213834 tempest-ServerGroupTestJSON-2134213834-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:05:46.925508 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-8f7c1205-9122-49ac-ab2d-6ff7b180134c tempest-ServerGroupTestJSON-2134213834 tempest-ServerGroupTestJSON-2134213834-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:05:46.930780 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-8f7c1205-9122-49ac-ab2d-6ff7b180134c tempest-ServerGroupTestJSON-2134213834 tempest-ServerGroupTestJSON-2134213834-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:05:46.931398 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-8f7c1205-9122-49ac-ab2d-6ff7b180134c tempest-ServerGroupTestJSON-2134213834 tempest-ServerGroupTestJSON-2134213834-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:05:47.020845 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-6298e264-291b-4acc-b0d5-c132a33129ab tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-62494019", "imageRef": "2d4a0047-1b9e-445f-8af8-1b5c9d93e881", "flavorRef": "452", "networks": [{"uuid": "3869a194-2d1b-4c2a-b413-fb6893096e26"}]}} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:05:47.161115 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.network.neutron [None req-6298e264-291b-4acc-b0d5-c132a33129ab tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] validate_networks() for [('3869a194-2d1b-4c2a-b413-fb6893096e26', None, None, None, None, None)] {{(pid=121402) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 01 19:05:47.282245 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-8f7c1205-9122-49ac-ab2d-6ff7b180134c tempest-ServerGroupTestJSON-2134213834 tempest-ServerGroupTestJSON-2134213834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0ef831ef96b4e5a983061fc8c7cf13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b6c42eec3544f3c820c0b0ce6f2f1f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:05:47.291717 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-8f7c1205-9122-49ac-ab2d-6ff7b180134c tempest-ServerGroupTestJSON-2134213834 tempest-ServerGroupTestJSON-2134213834-project] 10.222.0.13 "GET /compute/v2.1/servers/083a5a87-288b-48e0-8cda-d802774c372a" status: 200 len: 1313 microversion: 2.1 time: 0.396734 Nov 01 19:05:47.292322 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1482/2896] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:05:46 2022] GET /compute/v2.1/servers/083a5a87-288b-48e0-8cda-d802774c372a => generated 1313 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:05:47.305584 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-227a1aad-77b0-4233-92c9-68d22f2e397d tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:05:47.310912 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-227a1aad-77b0-4233-92c9-68d22f2e397d tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] [instance: 86162175-5f45-4aa7-9825-f1a3b4a699ff] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:05:47.330083 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-227a1aad-77b0-4233-92c9-68d22f2e397d tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:05:47.335322 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-227a1aad-77b0-4233-92c9-68d22f2e397d tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:05:47.336011 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-227a1aad-77b0-4233-92c9-68d22f2e397d tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:05:47.336967 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-227a1aad-77b0-4233-92c9-68d22f2e397d tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:05:47.337589 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-227a1aad-77b0-4233-92c9-68d22f2e397d tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:05:47.341646 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-227a1aad-77b0-4233-92c9-68d22f2e397d tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:05:47.553880 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-227a1aad-77b0-4233-92c9-68d22f2e397d tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb87e6147a6f470391921ac3b7a62f8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6511ea24c4c19a7c5d91535c7288d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:05:47.581774 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-227a1aad-77b0-4233-92c9-68d22f2e397d tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] 10.222.0.13 "GET /compute/v2.1/servers/86162175-5f45-4aa7-9825-f1a3b4a699ff" status: 200 len: 1275 microversion: 2.1 time: 0.286514 Nov 01 19:05:47.591136 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1483/2897] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:05:47 2022] GET /compute/v2.1/servers/86162175-5f45-4aa7-9825-f1a3b4a699ff => generated 1275 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:05:47.625144 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-7c8bacb9-b14f-40d2-a8ce-cec73190ec77 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:05:47.629400 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-7c8bacb9-b14f-40d2-a8ce-cec73190ec77 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] [instance: af1071a8-a090-44c9-890c-123ca3ff39f1] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:05:47.651034 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-7c8bacb9-b14f-40d2-a8ce-cec73190ec77 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:05:47.651549 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-7c8bacb9-b14f-40d2-a8ce-cec73190ec77 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:05:47.652397 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-7c8bacb9-b14f-40d2-a8ce-cec73190ec77 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:05:47.653882 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-7c8bacb9-b14f-40d2-a8ce-cec73190ec77 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:05:47.669429 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-7c8bacb9-b14f-40d2-a8ce-cec73190ec77 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:05:47.670158 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-7c8bacb9-b14f-40d2-a8ce-cec73190ec77 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:05:48.330142 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.virt.hardware [None req-6298e264-291b-4acc-b0d5-c132a33129ab tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Flavor limits 0:0:0 {{(pid=121402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 01 19:05:48.331662 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.virt.hardware [None req-6298e264-291b-4acc-b0d5-c132a33129ab tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Image limits 0:0:0 {{(pid=121402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 01 19:05:48.332308 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.virt.hardware [None req-6298e264-291b-4acc-b0d5-c132a33129ab tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Flavor pref 0:0:0 {{(pid=121402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 01 19:05:48.332888 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.virt.hardware [None req-6298e264-291b-4acc-b0d5-c132a33129ab tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Image pref 0:0:0 {{(pid=121402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 01 19:05:48.333304 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.virt.hardware [None req-6298e264-291b-4acc-b0d5-c132a33129ab tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 01 19:05:48.353305 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-6298e264-291b-4acc-b0d5-c132a33129ab tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:05:48.355005 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-6298e264-291b-4acc-b0d5-c132a33129ab tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:05:48.355473 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-6298e264-291b-4acc-b0d5-c132a33129ab tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:05:48.357488 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-6298e264-291b-4acc-b0d5-c132a33129ab tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:05:48.361345 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-6298e264-291b-4acc-b0d5-c132a33129ab tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:05:48.362656 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-6298e264-291b-4acc-b0d5-c132a33129ab tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:05:48.414943 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.quota [None req-6298e264-291b-4acc-b0d5-c132a33129ab tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Getting quotas for project 07b5d812eff94e2f89d4705d7e7d5f3d. Resources: {'cores', 'ram', 'instances'} {{(pid=121402) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 01 19:05:48.441710 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.quota [None req-6298e264-291b-4acc-b0d5-c132a33129ab tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Getting quotas for user 05d6a1722dfa4e959aeb14d601e43b93 and project 07b5d812eff94e2f89d4705d7e7d5f3d. Resources: {'cores', 'ram', 'instances'} {{(pid=121402) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 01 19:05:48.478926 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-6298e264-291b-4acc-b0d5-c132a33129ab tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Going to run 1 instances... {{(pid=121402) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 01 19:05:48.488095 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-6298e264-291b-4acc-b0d5-c132a33129ab tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] [instance: 0b57b50d-1ec4-4ee1-ac3a-f6f44d68a2c3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2d4a0047-1b9e-445f-8af8-1b5c9d93e881',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121402) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 01 19:05:48.577849 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-6298e264-291b-4acc-b0d5-c132a33129ab tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.561201 Nov 01 19:05:48.585423 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1415/2898] 10.222.0.13 () {60 vars in 1147 bytes} [Tue Nov 1 19:05:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 1570 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 01 19:05:48.596234 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [req-1582951a-0af1-4340-a537-32cbe9854681 req-e9d0847c-cf1b-44ef-9cf4-0161aec7341b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "af1071a8-a090-44c9-890c-123ca3ff39f1", "tag": "203b8604-944e-4dd3-b782-489109f7158b"}]} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:05:48.609616 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-1582951a-0af1-4340-a537-32cbe9854681 req-e9d0847c-cf1b-44ef-9cf4-0161aec7341b service nova] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:05:48.610390 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-1582951a-0af1-4340-a537-32cbe9854681 req-e9d0847c-cf1b-44ef-9cf4-0161aec7341b service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:05:48.612851 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-1582951a-0af1-4340-a537-32cbe9854681 req-e9d0847c-cf1b-44ef-9cf4-0161aec7341b service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:05:48.628034 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.compute.server_external_events [req-1582951a-0af1-4340-a537-32cbe9854681 req-e9d0847c-cf1b-44ef-9cf4-0161aec7341b service nova] Creating event network-changed:203b8604-944e-4dd3-b782-489109f7158b for instance af1071a8-a090-44c9-890c-123ca3ff39f1 on n-h2-863052-2 Nov 01 19:05:48.634039 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [req-1582951a-0af1-4340-a537-32cbe9854681 req-e9d0847c-cf1b-44ef-9cf4-0161aec7341b service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047185 Nov 01 19:05:48.635282 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1416/2899] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Nov 1 19:05:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:05:48.643689 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-93f57275-f365-40d2-a5ba-3fb11cd4a6ce tempest-ServerGroupTestJSON-2134213834 tempest-ServerGroupTestJSON-2134213834-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:05:48.644836 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-93f57275-f365-40d2-a5ba-3fb11cd4a6ce tempest-ServerGroupTestJSON-2134213834 tempest-ServerGroupTestJSON-2134213834-project] [instance: 083a5a87-288b-48e0-8cda-d802774c372a] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:05:48.659117 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-93f57275-f365-40d2-a5ba-3fb11cd4a6ce tempest-ServerGroupTestJSON-2134213834 tempest-ServerGroupTestJSON-2134213834-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:05:48.660370 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-93f57275-f365-40d2-a5ba-3fb11cd4a6ce tempest-ServerGroupTestJSON-2134213834 tempest-ServerGroupTestJSON-2134213834-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:05:48.661158 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-93f57275-f365-40d2-a5ba-3fb11cd4a6ce tempest-ServerGroupTestJSON-2134213834 tempest-ServerGroupTestJSON-2134213834-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:05:48.662310 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-93f57275-f365-40d2-a5ba-3fb11cd4a6ce tempest-ServerGroupTestJSON-2134213834 tempest-ServerGroupTestJSON-2134213834-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:05:48.662957 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-93f57275-f365-40d2-a5ba-3fb11cd4a6ce tempest-ServerGroupTestJSON-2134213834 tempest-ServerGroupTestJSON-2134213834-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:05:48.663549 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-93f57275-f365-40d2-a5ba-3fb11cd4a6ce tempest-ServerGroupTestJSON-2134213834 tempest-ServerGroupTestJSON-2134213834-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:05:49.327880 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-93f57275-f365-40d2-a5ba-3fb11cd4a6ce tempest-ServerGroupTestJSON-2134213834 tempest-ServerGroupTestJSON-2134213834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0ef831ef96b4e5a983061fc8c7cf13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b6c42eec3544f3c820c0b0ce6f2f1f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:05:49.330592 n-d-863052-2 devstack@n-api.service[121402]: DEBUG dbcounter [-] [121402] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 19:05:49.339281 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-93f57275-f365-40d2-a5ba-3fb11cd4a6ce tempest-ServerGroupTestJSON-2134213834 tempest-ServerGroupTestJSON-2134213834-project] 10.222.0.13 "GET /compute/v2.1/servers/083a5a87-288b-48e0-8cda-d802774c372a" status: 200 len: 1313 microversion: 2.1 time: 0.701834 Nov 01 19:05:49.353252 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1417/2900] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:05:48 2022] GET /compute/v2.1/servers/083a5a87-288b-48e0-8cda-d802774c372a => generated 1313 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:05:49.372233 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-7a83903b-a164-4413-a0b6-d8f06799c413 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:05:49.373300 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-7a83903b-a164-4413-a0b6-d8f06799c413 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] [instance: 0b57b50d-1ec4-4ee1-ac3a-f6f44d68a2c3] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:05:49.546047 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-7a83903b-a164-4413-a0b6-d8f06799c413 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05d6a1722dfa4e959aeb14d601e43b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b5d812eff94e2f89d4705d7e7d5f3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:05:49.566665 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-7a83903b-a164-4413-a0b6-d8f06799c413 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] 10.222.0.13 "GET /compute/v2.1/servers/0b57b50d-1ec4-4ee1-ac3a-f6f44d68a2c3" status: 200 len: 1216 microversion: 2.1 time: 0.210630 Nov 01 19:05:49.568061 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1418/2901] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:05:49 2022] GET /compute/v2.1/servers/0b57b50d-1ec4-4ee1-ac3a-f6f44d68a2c3 => generated 1216 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:05:49.587574 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [req-f9d35673-f4f6-4391-b82e-1764bcd7c9e1 req-0fe0aad6-24ab-4c94-b87f-f11bfcc8c45c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "083a5a87-288b-48e0-8cda-d802774c372a", "name": "network-vif-plugged", "status": "completed", "tag": "c70af547-f1c8-4388-bad0-a7add263f5a0"}]} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:05:49.614685 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-f9d35673-f4f6-4391-b82e-1764bcd7c9e1 req-0fe0aad6-24ab-4c94-b87f-f11bfcc8c45c service nova] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:05:49.615675 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-f9d35673-f4f6-4391-b82e-1764bcd7c9e1 req-0fe0aad6-24ab-4c94-b87f-f11bfcc8c45c service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:05:49.616389 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-f9d35673-f4f6-4391-b82e-1764bcd7c9e1 req-0fe0aad6-24ab-4c94-b87f-f11bfcc8c45c service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:05:49.649610 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.compute.server_external_events [req-f9d35673-f4f6-4391-b82e-1764bcd7c9e1 req-0fe0aad6-24ab-4c94-b87f-f11bfcc8c45c service nova] Creating event network-vif-plugged:c70af547-f1c8-4388-bad0-a7add263f5a0 for instance 083a5a87-288b-48e0-8cda-d802774c372a on n-h1-863052-2 Nov 01 19:05:49.680930 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [req-f9d35673-f4f6-4391-b82e-1764bcd7c9e1 req-0fe0aad6-24ab-4c94-b87f-f11bfcc8c45c service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108006 Nov 01 19:05:49.682001 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1419/2902] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Nov 1 19:05:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:05:49.703663 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-5ce1a440-cc2d-412c-8838-f672bcb07fc1 tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:05:49.705889 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-5ce1a440-cc2d-412c-8838-f672bcb07fc1 tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] [instance: 86162175-5f45-4aa7-9825-f1a3b4a699ff] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:05:49.724466 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-5ce1a440-cc2d-412c-8838-f672bcb07fc1 tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:05:49.725420 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-5ce1a440-cc2d-412c-8838-f672bcb07fc1 tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:05:49.726158 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-5ce1a440-cc2d-412c-8838-f672bcb07fc1 tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:05:49.727320 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-5ce1a440-cc2d-412c-8838-f672bcb07fc1 tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:05:49.728277 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-5ce1a440-cc2d-412c-8838-f672bcb07fc1 tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:05:49.729903 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-5ce1a440-cc2d-412c-8838-f672bcb07fc1 tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:05:49.815565 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-7c8bacb9-b14f-40d2-a8ce-cec73190ec77 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '301ed3b9c37449bc9ade378f3c73a768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8807757227574c828dca1947af76659d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:05:49.838121 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-7c8bacb9-b14f-40d2-a8ce-cec73190ec77 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '301ed3b9c37449bc9ade378f3c73a768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8807757227574c828dca1947af76659d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:05:49.844899 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-7c8bacb9-b14f-40d2-a8ce-cec73190ec77 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '301ed3b9c37449bc9ade378f3c73a768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8807757227574c828dca1947af76659d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:05:49.847623 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-7c8bacb9-b14f-40d2-a8ce-cec73190ec77 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] 10.222.0.13 "GET /compute/v2.1/servers/af1071a8-a090-44c9-890c-123ca3ff39f1" status: 200 len: 1850 microversion: 2.42 time: 2.254404 Nov 01 19:05:49.853259 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1484/2903] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 19:05:47 2022] GET /compute/v2.1/servers/af1071a8-a090-44c9-890c-123ca3ff39f1 => generated 1850 bytes in 2261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 19:05:50.318717 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-5ce1a440-cc2d-412c-8838-f672bcb07fc1 tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb87e6147a6f470391921ac3b7a62f8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6511ea24c4c19a7c5d91535c7288d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:05:50.335030 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-5ce1a440-cc2d-412c-8838-f672bcb07fc1 tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] 10.222.0.13 "GET /compute/v2.1/servers/86162175-5f45-4aa7-9825-f1a3b4a699ff" status: 200 len: 1281 microversion: 2.1 time: 0.651386 Nov 01 19:05:50.344553 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1420/2904] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:05:49 2022] GET /compute/v2.1/servers/86162175-5f45-4aa7-9825-f1a3b4a699ff => generated 1281 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:05:50.392314 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-701e102b-3d63-4b05-9f3a-54f9db59a9ba tempest-ServerGroupTestJSON-2134213834 tempest-ServerGroupTestJSON-2134213834-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:05:50.393214 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-701e102b-3d63-4b05-9f3a-54f9db59a9ba tempest-ServerGroupTestJSON-2134213834 tempest-ServerGroupTestJSON-2134213834-project] [instance: 083a5a87-288b-48e0-8cda-d802774c372a] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:05:50.412438 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-701e102b-3d63-4b05-9f3a-54f9db59a9ba tempest-ServerGroupTestJSON-2134213834 tempest-ServerGroupTestJSON-2134213834-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:05:50.413003 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-701e102b-3d63-4b05-9f3a-54f9db59a9ba tempest-ServerGroupTestJSON-2134213834 tempest-ServerGroupTestJSON-2134213834-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:05:50.415912 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-701e102b-3d63-4b05-9f3a-54f9db59a9ba tempest-ServerGroupTestJSON-2134213834 tempest-ServerGroupTestJSON-2134213834-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:05:50.417066 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-701e102b-3d63-4b05-9f3a-54f9db59a9ba tempest-ServerGroupTestJSON-2134213834 tempest-ServerGroupTestJSON-2134213834-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:05:50.419637 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-701e102b-3d63-4b05-9f3a-54f9db59a9ba tempest-ServerGroupTestJSON-2134213834 tempest-ServerGroupTestJSON-2134213834-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:05:50.420191 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-701e102b-3d63-4b05-9f3a-54f9db59a9ba tempest-ServerGroupTestJSON-2134213834 tempest-ServerGroupTestJSON-2134213834-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:05:50.615661 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-bd164fc0-50ce-44af-999d-08abda993da5 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:05:50.616728 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-bd164fc0-50ce-44af-999d-08abda993da5 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] [instance: 0b57b50d-1ec4-4ee1-ac3a-f6f44d68a2c3] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:05:50.639842 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-bd164fc0-50ce-44af-999d-08abda993da5 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:05:50.643419 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-bd164fc0-50ce-44af-999d-08abda993da5 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:05:50.645903 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-bd164fc0-50ce-44af-999d-08abda993da5 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:05:50.651471 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-bd164fc0-50ce-44af-999d-08abda993da5 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:05:50.652933 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-bd164fc0-50ce-44af-999d-08abda993da5 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:05:50.653977 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-bd164fc0-50ce-44af-999d-08abda993da5 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:05:50.990831 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-701e102b-3d63-4b05-9f3a-54f9db59a9ba tempest-ServerGroupTestJSON-2134213834 tempest-ServerGroupTestJSON-2134213834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0ef831ef96b4e5a983061fc8c7cf13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b6c42eec3544f3c820c0b0ce6f2f1f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:05:51.012551 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-701e102b-3d63-4b05-9f3a-54f9db59a9ba tempest-ServerGroupTestJSON-2134213834 tempest-ServerGroupTestJSON-2134213834-project] 10.222.0.13 "GET /compute/v2.1/servers/083a5a87-288b-48e0-8cda-d802774c372a" status: 200 len: 1313 microversion: 2.1 time: 0.628689 Nov 01 19:05:51.020620 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1485/2905] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:05:50 2022] GET /compute/v2.1/servers/083a5a87-288b-48e0-8cda-d802774c372a => generated 1313 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:05:51.026573 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-e0d1eefa-5396-4759-a2a2-d38fec34b404 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:05:51.028268 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-e0d1eefa-5396-4759-a2a2-d38fec34b404 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] [instance: af1071a8-a090-44c9-890c-123ca3ff39f1] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:05:51.043154 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-e0d1eefa-5396-4759-a2a2-d38fec34b404 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:05:51.046660 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-e0d1eefa-5396-4759-a2a2-d38fec34b404 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:05:51.047363 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-e0d1eefa-5396-4759-a2a2-d38fec34b404 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:05:51.048313 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-e0d1eefa-5396-4759-a2a2-d38fec34b404 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:05:51.050749 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-e0d1eefa-5396-4759-a2a2-d38fec34b404 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:05:51.051429 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-e0d1eefa-5396-4759-a2a2-d38fec34b404 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:05:51.064729 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-bd164fc0-50ce-44af-999d-08abda993da5 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05d6a1722dfa4e959aeb14d601e43b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b5d812eff94e2f89d4705d7e7d5f3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:05:51.086070 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-bd164fc0-50ce-44af-999d-08abda993da5 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] 10.222.0.13 "GET /compute/v2.1/servers/0b57b50d-1ec4-4ee1-ac3a-f6f44d68a2c3" status: 200 len: 1268 microversion: 2.1 time: 0.481450 Nov 01 19:05:51.095977 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1421/2906] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:05:50 2022] GET /compute/v2.1/servers/0b57b50d-1ec4-4ee1-ac3a-f6f44d68a2c3 => generated 1268 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:05:51.370583 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-f8f790a7-56ea-4c30-a73f-232ed4f720cd tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:05:51.371944 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-f8f790a7-56ea-4c30-a73f-232ed4f720cd tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] [instance: 86162175-5f45-4aa7-9825-f1a3b4a699ff] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:05:51.381524 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f8f790a7-56ea-4c30-a73f-232ed4f720cd tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:05:51.388305 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f8f790a7-56ea-4c30-a73f-232ed4f720cd tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:05:51.389633 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f8f790a7-56ea-4c30-a73f-232ed4f720cd tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:05:51.401836 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f8f790a7-56ea-4c30-a73f-232ed4f720cd tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:05:51.405464 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f8f790a7-56ea-4c30-a73f-232ed4f720cd tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:05:51.406131 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f8f790a7-56ea-4c30-a73f-232ed4f720cd tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:05:51.886629 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-e0d1eefa-5396-4759-a2a2-d38fec34b404 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '301ed3b9c37449bc9ade378f3c73a768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8807757227574c828dca1947af76659d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:05:51.914838 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-e0d1eefa-5396-4759-a2a2-d38fec34b404 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '301ed3b9c37449bc9ade378f3c73a768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8807757227574c828dca1947af76659d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:05:51.925427 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-e0d1eefa-5396-4759-a2a2-d38fec34b404 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '301ed3b9c37449bc9ade378f3c73a768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8807757227574c828dca1947af76659d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:05:51.928367 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-e0d1eefa-5396-4759-a2a2-d38fec34b404 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] 10.222.0.13 "GET /compute/v2.1/servers/af1071a8-a090-44c9-890c-123ca3ff39f1" status: 200 len: 1871 microversion: 2.42 time: 0.909402 Nov 01 19:05:51.936023 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1486/2907] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 19:05:51 2022] GET /compute/v2.1/servers/af1071a8-a090-44c9-890c-123ca3ff39f1 => generated 1871 bytes in 919 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 19:05:51.945369 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-f8f790a7-56ea-4c30-a73f-232ed4f720cd tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb87e6147a6f470391921ac3b7a62f8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6511ea24c4c19a7c5d91535c7288d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:05:51.962614 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-f8f790a7-56ea-4c30-a73f-232ed4f720cd tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] 10.222.0.13 "GET /compute/v2.1/servers/86162175-5f45-4aa7-9825-f1a3b4a699ff" status: 200 len: 1281 microversion: 2.1 time: 0.597023 Nov 01 19:05:51.985244 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1422/2908] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:05:51 2022] GET /compute/v2.1/servers/86162175-5f45-4aa7-9825-f1a3b4a699ff => generated 1281 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 19:05:52.049626 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-d48568dd-f5f1-498e-8a19-a4848415af77 tempest-ServerGroupTestJSON-2134213834 tempest-ServerGroupTestJSON-2134213834-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:05:52.050610 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-d48568dd-f5f1-498e-8a19-a4848415af77 tempest-ServerGroupTestJSON-2134213834 tempest-ServerGroupTestJSON-2134213834-project] [instance: 083a5a87-288b-48e0-8cda-d802774c372a] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:05:52.066591 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-d48568dd-f5f1-498e-8a19-a4848415af77 tempest-ServerGroupTestJSON-2134213834 tempest-ServerGroupTestJSON-2134213834-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:05:52.071834 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-d48568dd-f5f1-498e-8a19-a4848415af77 tempest-ServerGroupTestJSON-2134213834 tempest-ServerGroupTestJSON-2134213834-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:05:52.072596 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-d48568dd-f5f1-498e-8a19-a4848415af77 tempest-ServerGroupTestJSON-2134213834 tempest-ServerGroupTestJSON-2134213834-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:05:52.075767 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-d48568dd-f5f1-498e-8a19-a4848415af77 tempest-ServerGroupTestJSON-2134213834 tempest-ServerGroupTestJSON-2134213834-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:05:52.077168 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-d48568dd-f5f1-498e-8a19-a4848415af77 tempest-ServerGroupTestJSON-2134213834 tempest-ServerGroupTestJSON-2134213834-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:05:52.079462 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-d48568dd-f5f1-498e-8a19-a4848415af77 tempest-ServerGroupTestJSON-2134213834 tempest-ServerGroupTestJSON-2134213834-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:05:52.206652 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [req-b1722cb0-8d1c-4083-b154-b3cf31760d97 req-b37deb3e-28e6-4e82-9354-49992b3b2dee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b58b3cb6-ebdc-4705-b308-4e804cd52bce", "name": "network-vif-deleted", "tag": "83daf795-a40d-4ba1-ae59-903b534c7eb0"}]} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:05:52.224694 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-b1722cb0-8d1c-4083-b154-b3cf31760d97 req-b37deb3e-28e6-4e82-9354-49992b3b2dee service nova] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:05:52.227078 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-b1722cb0-8d1c-4083-b154-b3cf31760d97 req-b37deb3e-28e6-4e82-9354-49992b3b2dee service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:05:52.227777 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-b1722cb0-8d1c-4083-b154-b3cf31760d97 req-b37deb3e-28e6-4e82-9354-49992b3b2dee service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:05:52.255482 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.compute.server_external_events [req-b1722cb0-8d1c-4083-b154-b3cf31760d97 req-b37deb3e-28e6-4e82-9354-49992b3b2dee service nova] Creating event network-vif-deleted:83daf795-a40d-4ba1-ae59-903b534c7eb0 for instance b58b3cb6-ebdc-4705-b308-4e804cd52bce on n-h2-863052-2 Nov 01 19:05:52.268044 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [req-b1722cb0-8d1c-4083-b154-b3cf31760d97 req-b37deb3e-28e6-4e82-9354-49992b3b2dee service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.318336 Nov 01 19:05:52.273919 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1487/2909] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Nov 1 19:05:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:05:52.287285 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-c8d39b40-73f5-49eb-97c3-3d41aba9fae1 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:05:52.293794 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-c8d39b40-73f5-49eb-97c3-3d41aba9fae1 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] [instance: 0b57b50d-1ec4-4ee1-ac3a-f6f44d68a2c3] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:05:52.323986 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-c8d39b40-73f5-49eb-97c3-3d41aba9fae1 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:05:52.324484 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-c8d39b40-73f5-49eb-97c3-3d41aba9fae1 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:05:52.324942 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-c8d39b40-73f5-49eb-97c3-3d41aba9fae1 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:05:52.325787 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-c8d39b40-73f5-49eb-97c3-3d41aba9fae1 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:05:52.326100 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-c8d39b40-73f5-49eb-97c3-3d41aba9fae1 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:05:52.327035 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-c8d39b40-73f5-49eb-97c3-3d41aba9fae1 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:05:52.567009 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-c8d39b40-73f5-49eb-97c3-3d41aba9fae1 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05d6a1722dfa4e959aeb14d601e43b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b5d812eff94e2f89d4705d7e7d5f3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:05:52.581343 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-c8d39b40-73f5-49eb-97c3-3d41aba9fae1 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] 10.222.0.13 "GET /compute/v2.1/servers/0b57b50d-1ec4-4ee1-ac3a-f6f44d68a2c3" status: 200 len: 1274 microversion: 2.1 time: 0.303405 Nov 01 19:05:52.586138 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1488/2910] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:05:52 2022] GET /compute/v2.1/servers/0b57b50d-1ec4-4ee1-ac3a-f6f44d68a2c3 => generated 1274 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:05:52.979729 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-2f2ce446-7338-4247-a1e1-567d8af594ca tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:05:52.980659 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-2f2ce446-7338-4247-a1e1-567d8af594ca tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] [instance: af1071a8-a090-44c9-890c-123ca3ff39f1] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:05:52.995920 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-2f2ce446-7338-4247-a1e1-567d8af594ca tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:05:52.998467 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-2f2ce446-7338-4247-a1e1-567d8af594ca tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:05:53.000550 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-2f2ce446-7338-4247-a1e1-567d8af594ca tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:05:53.003641 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-2f2ce446-7338-4247-a1e1-567d8af594ca tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:05:53.006128 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-2f2ce446-7338-4247-a1e1-567d8af594ca tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:05:53.009143 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-2f2ce446-7338-4247-a1e1-567d8af594ca tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:05:53.400842 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-d48568dd-f5f1-498e-8a19-a4848415af77 tempest-ServerGroupTestJSON-2134213834 tempest-ServerGroupTestJSON-2134213834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0ef831ef96b4e5a983061fc8c7cf13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b6c42eec3544f3c820c0b0ce6f2f1f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:05:53.423713 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-d48568dd-f5f1-498e-8a19-a4848415af77 tempest-ServerGroupTestJSON-2134213834 tempest-ServerGroupTestJSON-2134213834-project] 10.222.0.13 "GET /compute/v2.1/servers/083a5a87-288b-48e0-8cda-d802774c372a" status: 200 len: 1498 microversion: 2.1 time: 1.375246 Nov 01 19:05:53.431524 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1423/2911] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:05:52 2022] GET /compute/v2.1/servers/083a5a87-288b-48e0-8cda-d802774c372a => generated 1498 bytes in 1387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:05:53.460806 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-b06abede-7470-44d0-802d-5e93e75761e4 tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:05:53.462168 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-b06abede-7470-44d0-802d-5e93e75761e4 tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] [instance: 86162175-5f45-4aa7-9825-f1a3b4a699ff] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:05:53.472459 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b06abede-7470-44d0-802d-5e93e75761e4 tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:05:53.473264 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b06abede-7470-44d0-802d-5e93e75761e4 tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:05:53.473890 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b06abede-7470-44d0-802d-5e93e75761e4 tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:05:53.474959 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b06abede-7470-44d0-802d-5e93e75761e4 tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:05:53.475675 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b06abede-7470-44d0-802d-5e93e75761e4 tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:05:53.476259 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b06abede-7470-44d0-802d-5e93e75761e4 tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:05:54.171440 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-2f2ce446-7338-4247-a1e1-567d8af594ca tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '301ed3b9c37449bc9ade378f3c73a768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8807757227574c828dca1947af76659d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:05:54.197190 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-2f2ce446-7338-4247-a1e1-567d8af594ca tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '301ed3b9c37449bc9ade378f3c73a768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8807757227574c828dca1947af76659d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:05:54.200714 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-2f2ce446-7338-4247-a1e1-567d8af594ca tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '301ed3b9c37449bc9ade378f3c73a768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8807757227574c828dca1947af76659d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:05:54.207069 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-2f2ce446-7338-4247-a1e1-567d8af594ca tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] 10.222.0.13 "GET /compute/v2.1/servers/af1071a8-a090-44c9-890c-123ca3ff39f1" status: 200 len: 1871 microversion: 2.42 time: 1.231484 Nov 01 19:05:54.208339 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1489/2912] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 19:05:52 2022] GET /compute/v2.1/servers/af1071a8-a090-44c9-890c-123ca3ff39f1 => generated 1871 bytes in 1233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 19:05:54.236021 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-b470ab97-0cd1-4a57-a85a-8c932b022a64 tempest-ServerGroupTestJSON-2134213834 tempest-ServerGroupTestJSON-2134213834-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:05:54.265520 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.compute.server_groups [None req-b470ab97-0cd1-4a57-a85a-8c932b022a64 tempest-ServerGroupTestJSON-2134213834 tempest-ServerGroupTestJSON-2134213834-project] Querying cell 389766af-efe4-4d8b-b2de-e920ed3438ee(cell1) for 1 instances {{(pid=121403) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Nov 01 19:05:54.266261 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-b470ab97-0cd1-4a57-a85a-8c932b022a64 tempest-ServerGroupTestJSON-2134213834 tempest-ServerGroupTestJSON-2134213834-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:05:54.266756 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-b470ab97-0cd1-4a57-a85a-8c932b022a64 tempest-ServerGroupTestJSON-2134213834 tempest-ServerGroupTestJSON-2134213834-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:05:54.267201 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-b470ab97-0cd1-4a57-a85a-8c932b022a64 tempest-ServerGroupTestJSON-2134213834 tempest-ServerGroupTestJSON-2134213834-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:05:54.296840 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-b470ab97-0cd1-4a57-a85a-8c932b022a64 tempest-ServerGroupTestJSON-2134213834 tempest-ServerGroupTestJSON-2134213834-project] 10.222.0.13 "GET /compute/v2.1/os-server-groups/39db9570-eff7-4e8a-acae-6e2d59add751" status: 200 len: 222 microversion: 2.1 time: 0.086468 Nov 01 19:05:54.297708 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1490/2913] 10.222.0.13 () {58 vars in 1263 bytes} [Tue Nov 1 19:05:54 2022] GET /compute/v2.1/os-server-groups/39db9570-eff7-4e8a-acae-6e2d59add751 => generated 222 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:05:54.309129 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-5b6d0025-a79f-4dac-a26e-d943b4cf3b31 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:05:54.310184 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-5b6d0025-a79f-4dac-a26e-d943b4cf3b31 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] [instance: 0b57b50d-1ec4-4ee1-ac3a-f6f44d68a2c3] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:05:54.318036 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-5b6d0025-a79f-4dac-a26e-d943b4cf3b31 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:05:54.318818 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-5b6d0025-a79f-4dac-a26e-d943b4cf3b31 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:05:54.319399 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-5b6d0025-a79f-4dac-a26e-d943b4cf3b31 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:05:54.320388 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-5b6d0025-a79f-4dac-a26e-d943b4cf3b31 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:05:54.321172 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-5b6d0025-a79f-4dac-a26e-d943b4cf3b31 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:05:54.321742 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-5b6d0025-a79f-4dac-a26e-d943b4cf3b31 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:05:54.491790 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-5b6d0025-a79f-4dac-a26e-d943b4cf3b31 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05d6a1722dfa4e959aeb14d601e43b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b5d812eff94e2f89d4705d7e7d5f3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:05:54.504017 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-5b6d0025-a79f-4dac-a26e-d943b4cf3b31 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] 10.222.0.13 "GET /compute/v2.1/servers/0b57b50d-1ec4-4ee1-ac3a-f6f44d68a2c3" status: 200 len: 1274 microversion: 2.1 time: 0.198563 Nov 01 19:05:54.507347 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1491/2914] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:05:54 2022] GET /compute/v2.1/servers/0b57b50d-1ec4-4ee1-ac3a-f6f44d68a2c3 => generated 1274 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:05:54.519276 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [req-9006f8dd-e8c4-47ec-a922-bb3d09947a98 req-a87a53f4-430d-4edb-89fd-b78a5743cdb5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "af1071a8-a090-44c9-890c-123ca3ff39f1", "tag": "dfd99717-c078-4f2f-8d17-1602cd9ea3ae"}]} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:05:54.543873 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-9006f8dd-e8c4-47ec-a922-bb3d09947a98 req-a87a53f4-430d-4edb-89fd-b78a5743cdb5 service nova] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:05:54.544732 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-9006f8dd-e8c4-47ec-a922-bb3d09947a98 req-a87a53f4-430d-4edb-89fd-b78a5743cdb5 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:05:54.545983 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-9006f8dd-e8c4-47ec-a922-bb3d09947a98 req-a87a53f4-430d-4edb-89fd-b78a5743cdb5 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:05:54.575515 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.compute.server_external_events [req-9006f8dd-e8c4-47ec-a922-bb3d09947a98 req-a87a53f4-430d-4edb-89fd-b78a5743cdb5 service nova] Creating event network-changed:dfd99717-c078-4f2f-8d17-1602cd9ea3ae for instance af1071a8-a090-44c9-890c-123ca3ff39f1 on n-h2-863052-2 Nov 01 19:05:54.589143 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [req-9006f8dd-e8c4-47ec-a922-bb3d09947a98 req-a87a53f4-430d-4edb-89fd-b78a5743cdb5 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080328 Nov 01 19:05:54.590109 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1492/2915] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Nov 1 19:05:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:05:54.600273 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-35b23ce7-c65a-46d1-a543-00a7ae3a9299 tempest-ServerGroupTestJSON-2134213834 tempest-ServerGroupTestJSON-2134213834-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:05:54.604120 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-35b23ce7-c65a-46d1-a543-00a7ae3a9299 tempest-ServerGroupTestJSON-2134213834 tempest-ServerGroupTestJSON-2134213834-project] [instance: 083a5a87-288b-48e0-8cda-d802774c372a] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:05:54.628877 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-35b23ce7-c65a-46d1-a543-00a7ae3a9299 tempest-ServerGroupTestJSON-2134213834 tempest-ServerGroupTestJSON-2134213834-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:05:54.654551 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-35b23ce7-c65a-46d1-a543-00a7ae3a9299 tempest-ServerGroupTestJSON-2134213834 tempest-ServerGroupTestJSON-2134213834-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.026s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:05:54.655241 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-35b23ce7-c65a-46d1-a543-00a7ae3a9299 tempest-ServerGroupTestJSON-2134213834 tempest-ServerGroupTestJSON-2134213834-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:05:54.663506 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-35b23ce7-c65a-46d1-a543-00a7ae3a9299 tempest-ServerGroupTestJSON-2134213834 tempest-ServerGroupTestJSON-2134213834-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:05:54.666136 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-35b23ce7-c65a-46d1-a543-00a7ae3a9299 tempest-ServerGroupTestJSON-2134213834 tempest-ServerGroupTestJSON-2134213834-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:05:54.671481 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-35b23ce7-c65a-46d1-a543-00a7ae3a9299 tempest-ServerGroupTestJSON-2134213834 tempest-ServerGroupTestJSON-2134213834-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:05:54.723857 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-35b23ce7-c65a-46d1-a543-00a7ae3a9299 tempest-ServerGroupTestJSON-2134213834 tempest-ServerGroupTestJSON-2134213834-project] [instance: 083a5a87-288b-48e0-8cda-d802774c372a] Going to try to terminate instance {{(pid=121403) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 01 19:05:54.850853 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-35b23ce7-c65a-46d1-a543-00a7ae3a9299 tempest-ServerGroupTestJSON-2134213834 tempest-ServerGroupTestJSON-2134213834-project] 10.222.0.13 "DELETE /compute/v2.1/servers/083a5a87-288b-48e0-8cda-d802774c372a" status: 204 len: 0 microversion: 2.1 time: 0.256100 Nov 01 19:05:54.854721 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1493/2916] 10.222.0.13 () {58 vars in 1239 bytes} [Tue Nov 1 19:05:54 2022] DELETE /compute/v2.1/servers/083a5a87-288b-48e0-8cda-d802774c372a => generated 0 bytes in 258 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 01 19:05:54.867228 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-8081fffe-b5d4-47a5-a435-cc4813afb3e9 tempest-ServerGroupTestJSON-2134213834 tempest-ServerGroupTestJSON-2134213834-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:05:54.868105 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-8081fffe-b5d4-47a5-a435-cc4813afb3e9 tempest-ServerGroupTestJSON-2134213834 tempest-ServerGroupTestJSON-2134213834-project] [instance: 083a5a87-288b-48e0-8cda-d802774c372a] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:05:54.875070 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-8081fffe-b5d4-47a5-a435-cc4813afb3e9 tempest-ServerGroupTestJSON-2134213834 tempest-ServerGroupTestJSON-2134213834-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:05:54.875561 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-8081fffe-b5d4-47a5-a435-cc4813afb3e9 tempest-ServerGroupTestJSON-2134213834 tempest-ServerGroupTestJSON-2134213834-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:05:54.875997 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-8081fffe-b5d4-47a5-a435-cc4813afb3e9 tempest-ServerGroupTestJSON-2134213834 tempest-ServerGroupTestJSON-2134213834-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:05:54.884162 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-8081fffe-b5d4-47a5-a435-cc4813afb3e9 tempest-ServerGroupTestJSON-2134213834 tempest-ServerGroupTestJSON-2134213834-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:05:54.884837 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-8081fffe-b5d4-47a5-a435-cc4813afb3e9 tempest-ServerGroupTestJSON-2134213834 tempest-ServerGroupTestJSON-2134213834-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:05:54.885281 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-8081fffe-b5d4-47a5-a435-cc4813afb3e9 tempest-ServerGroupTestJSON-2134213834 tempest-ServerGroupTestJSON-2134213834-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:05:55.208015 n-d-863052-2 devstack@n-api.service[121403]: DEBUG dbcounter [-] [121403] Writing DB stats nova_cell0:SELECT=2 {{(pid=121403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 19:05:55.270074 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-b06abede-7470-44d0-802d-5e93e75761e4 tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb87e6147a6f470391921ac3b7a62f8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6511ea24c4c19a7c5d91535c7288d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:05:55.280821 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-b06abede-7470-44d0-802d-5e93e75761e4 tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] 10.222.0.13 "GET /compute/v2.1/servers/86162175-5f45-4aa7-9825-f1a3b4a699ff" status: 200 len: 1323 microversion: 2.1 time: 1.846571 Nov 01 19:05:55.295484 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1424/2917] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:05:53 2022] GET /compute/v2.1/servers/86162175-5f45-4aa7-9825-f1a3b4a699ff => generated 1323 bytes in 1862 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:05:55.315790 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-311b07e9-9a0f-4546-8b46-2ecf0af13189 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:05:55.321301 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-311b07e9-9a0f-4546-8b46-2ecf0af13189 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] [instance: af1071a8-a090-44c9-890c-123ca3ff39f1] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:05:55.353654 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-311b07e9-9a0f-4546-8b46-2ecf0af13189 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:05:55.356566 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-311b07e9-9a0f-4546-8b46-2ecf0af13189 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:05:55.358725 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-311b07e9-9a0f-4546-8b46-2ecf0af13189 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:05:55.360032 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-311b07e9-9a0f-4546-8b46-2ecf0af13189 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:05:55.364059 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-311b07e9-9a0f-4546-8b46-2ecf0af13189 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:05:55.367906 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-311b07e9-9a0f-4546-8b46-2ecf0af13189 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:05:55.569213 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-8081fffe-b5d4-47a5-a435-cc4813afb3e9 tempest-ServerGroupTestJSON-2134213834 tempest-ServerGroupTestJSON-2134213834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0ef831ef96b4e5a983061fc8c7cf13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b6c42eec3544f3c820c0b0ce6f2f1f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:05:55.578973 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-8081fffe-b5d4-47a5-a435-cc4813afb3e9 tempest-ServerGroupTestJSON-2134213834 tempest-ServerGroupTestJSON-2134213834-project] 10.222.0.13 "GET /compute/v2.1/servers/083a5a87-288b-48e0-8cda-d802774c372a" status: 200 len: 1504 microversion: 2.1 time: 0.722752 Nov 01 19:05:55.584957 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1494/2918] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:05:54 2022] GET /compute/v2.1/servers/083a5a87-288b-48e0-8cda-d802774c372a => generated 1504 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:05:55.610572 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-11b61e6e-507b-47d9-8dcb-0fb2800f1e2d tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-1006397519", "imageRef": "2d4a0047-1b9e-445f-8af8-1b5c9d93e881", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "b75ef89a-2f97-4b24-84b8-10bc0db028cf"}, {"port": "b7614985-399c-4722-b5a8-66eda94e4a8f", "tag": "port-1"}, {"port": "edf5ed24-0e25-44d3-8ab2-d626304020a6", "tag": "port-2"}, {"uuid": "7bf77862-973b-4171-ba81-ee86b2258cf9", "tag": "net-1"}, {"uuid": "7bf77862-973b-4171-ba81-ee86b2258cf9"}, {"uuid": "53e4dc1b-2245-40ec-943d-a6c47e376713", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "53e4dc1b-2245-40ec-943d-a6c47e376713", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "d2a0fc3f-a650-449b-80ea-a7df3aa1f11b", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "cced0681-fb87-408b-8c8a-7e9cb41e7fde", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "c5448dc1-99e4-430c-a40c-6ea776d11908", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--462300733"}], "key_name": "tempest-keypair-1545214518", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:05:55.878520 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.network.neutron [None req-11b61e6e-507b-47d9-8dcb-0fb2800f1e2d tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] validate_networks() for [('b75ef89a-2f97-4b24-84b8-10bc0db028cf', None, None, None, None, None), (None, None, 'b7614985-399c-4722-b5a8-66eda94e4a8f', None, None, None), (None, None, 'edf5ed24-0e25-44d3-8ab2-d626304020a6', None, None, None), ('7bf77862-973b-4171-ba81-ee86b2258cf9', None, None, None, None, None), ('7bf77862-973b-4171-ba81-ee86b2258cf9', None, None, None, None, None), ('53e4dc1b-2245-40ec-943d-a6c47e376713', '10.2.2.100', None, None, None, None), ('53e4dc1b-2245-40ec-943d-a6c47e376713', '10.2.2.200', None, None, None, None)] {{(pid=121403) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 01 19:05:55.999317 n-d-863052-2 devstack@n-api.service[121403]: DEBUG dbcounter [-] [121403] Writing DB stats nova_cell0:SELECT=8 {{(pid=121403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 19:05:56.080714 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-311b07e9-9a0f-4546-8b46-2ecf0af13189 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '301ed3b9c37449bc9ade378f3c73a768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8807757227574c828dca1947af76659d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:05:56.090718 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-311b07e9-9a0f-4546-8b46-2ecf0af13189 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '301ed3b9c37449bc9ade378f3c73a768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8807757227574c828dca1947af76659d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:05:56.092232 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-311b07e9-9a0f-4546-8b46-2ecf0af13189 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '301ed3b9c37449bc9ade378f3c73a768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8807757227574c828dca1947af76659d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:05:56.098349 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-311b07e9-9a0f-4546-8b46-2ecf0af13189 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] 10.222.0.13 "GET /compute/v2.1/servers/af1071a8-a090-44c9-890c-123ca3ff39f1" status: 200 len: 1871 microversion: 2.42 time: 0.801267 Nov 01 19:05:56.098950 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1425/2919] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 19:05:55 2022] GET /compute/v2.1/servers/af1071a8-a090-44c9-890c-123ca3ff39f1 => generated 1871 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 19:05:56.151649 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [req-495126d5-966f-43a7-92f3-28fb6a61acee req-14ed7d7d-ec79-487c-8bc4-fc46d7211133 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "86162175-5f45-4aa7-9825-f1a3b4a699ff", "tag": "e985c4cd-3aee-4c89-a53f-f69bb65a4339"}]} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:05:56.180217 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-495126d5-966f-43a7-92f3-28fb6a61acee req-14ed7d7d-ec79-487c-8bc4-fc46d7211133 service nova] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:05:56.180961 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-495126d5-966f-43a7-92f3-28fb6a61acee req-14ed7d7d-ec79-487c-8bc4-fc46d7211133 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:05:56.181580 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-495126d5-966f-43a7-92f3-28fb6a61acee req-14ed7d7d-ec79-487c-8bc4-fc46d7211133 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:05:56.211000 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.compute.server_external_events [req-495126d5-966f-43a7-92f3-28fb6a61acee req-14ed7d7d-ec79-487c-8bc4-fc46d7211133 service nova] Creating event network-changed:e985c4cd-3aee-4c89-a53f-f69bb65a4339 for instance 86162175-5f45-4aa7-9825-f1a3b4a699ff on n-h1-863052-2 Nov 01 19:05:56.220626 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [req-495126d5-966f-43a7-92f3-28fb6a61acee req-14ed7d7d-ec79-487c-8bc4-fc46d7211133 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095957 Nov 01 19:05:56.221519 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1426/2920] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Nov 1 19:05:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:05:56.227634 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-f40acd73-3e39-4099-ab3a-0c105e5bbdc6 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:05:56.228766 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-f40acd73-3e39-4099-ab3a-0c105e5bbdc6 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] [instance: 0b57b50d-1ec4-4ee1-ac3a-f6f44d68a2c3] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:05:56.242313 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f40acd73-3e39-4099-ab3a-0c105e5bbdc6 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:05:56.242843 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f40acd73-3e39-4099-ab3a-0c105e5bbdc6 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:05:56.243292 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f40acd73-3e39-4099-ab3a-0c105e5bbdc6 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:05:56.244087 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f40acd73-3e39-4099-ab3a-0c105e5bbdc6 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:05:56.244553 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f40acd73-3e39-4099-ab3a-0c105e5bbdc6 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:05:56.245006 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f40acd73-3e39-4099-ab3a-0c105e5bbdc6 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:05:56.706100 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-f40acd73-3e39-4099-ab3a-0c105e5bbdc6 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05d6a1722dfa4e959aeb14d601e43b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b5d812eff94e2f89d4705d7e7d5f3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:05:56.714139 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-f40acd73-3e39-4099-ab3a-0c105e5bbdc6 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] 10.222.0.13 "GET /compute/v2.1/servers/0b57b50d-1ec4-4ee1-ac3a-f6f44d68a2c3" status: 200 len: 1316 microversion: 2.1 time: 0.490644 Nov 01 19:05:56.725175 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1427/2921] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:05:56 2022] GET /compute/v2.1/servers/0b57b50d-1ec4-4ee1-ac3a-f6f44d68a2c3 => generated 1316 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:05:56.737210 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-4eb98bc0-a2a1-4670-ba69-e1599f6d5031 tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:05:56.738117 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-4eb98bc0-a2a1-4670-ba69-e1599f6d5031 tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] [instance: 86162175-5f45-4aa7-9825-f1a3b4a699ff] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:05:56.753920 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-4eb98bc0-a2a1-4670-ba69-e1599f6d5031 tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:05:56.760149 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-4eb98bc0-a2a1-4670-ba69-e1599f6d5031 tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:05:56.760920 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-4eb98bc0-a2a1-4670-ba69-e1599f6d5031 tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:05:56.761974 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-4eb98bc0-a2a1-4670-ba69-e1599f6d5031 tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:05:56.762605 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-4eb98bc0-a2a1-4670-ba69-e1599f6d5031 tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:05:56.763195 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-4eb98bc0-a2a1-4670-ba69-e1599f6d5031 tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:05:57.370497 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-4eb98bc0-a2a1-4670-ba69-e1599f6d5031 tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb87e6147a6f470391921ac3b7a62f8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6511ea24c4c19a7c5d91535c7288d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:05:57.383675 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-4eb98bc0-a2a1-4670-ba69-e1599f6d5031 tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] 10.222.0.13 "GET /compute/v2.1/servers/86162175-5f45-4aa7-9825-f1a3b4a699ff" status: 200 len: 1323 microversion: 2.1 time: 0.653373 Nov 01 19:05:57.384519 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1428/2922] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:05:56 2022] GET /compute/v2.1/servers/86162175-5f45-4aa7-9825-f1a3b4a699ff => generated 1323 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:05:57.389837 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-9fe5bfe5-de2c-4809-960a-827caf41b2e1 tempest-ServerGroupTestJSON-2134213834 tempest-ServerGroupTestJSON-2134213834-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:05:57.390456 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-9fe5bfe5-de2c-4809-960a-827caf41b2e1 tempest-ServerGroupTestJSON-2134213834 tempest-ServerGroupTestJSON-2134213834-project] [instance: 083a5a87-288b-48e0-8cda-d802774c372a] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:05:57.405014 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-9fe5bfe5-de2c-4809-960a-827caf41b2e1 tempest-ServerGroupTestJSON-2134213834 tempest-ServerGroupTestJSON-2134213834-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:05:57.405807 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-9fe5bfe5-de2c-4809-960a-827caf41b2e1 tempest-ServerGroupTestJSON-2134213834 tempest-ServerGroupTestJSON-2134213834-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:05:57.406428 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-9fe5bfe5-de2c-4809-960a-827caf41b2e1 tempest-ServerGroupTestJSON-2134213834 tempest-ServerGroupTestJSON-2134213834-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:05:57.407318 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-9fe5bfe5-de2c-4809-960a-827caf41b2e1 tempest-ServerGroupTestJSON-2134213834 tempest-ServerGroupTestJSON-2134213834-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:05:57.407935 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-9fe5bfe5-de2c-4809-960a-827caf41b2e1 tempest-ServerGroupTestJSON-2134213834 tempest-ServerGroupTestJSON-2134213834-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:05:57.408520 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-9fe5bfe5-de2c-4809-960a-827caf41b2e1 tempest-ServerGroupTestJSON-2134213834 tempest-ServerGroupTestJSON-2134213834-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:05:57.867504 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-9fe5bfe5-de2c-4809-960a-827caf41b2e1 tempest-ServerGroupTestJSON-2134213834 tempest-ServerGroupTestJSON-2134213834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0ef831ef96b4e5a983061fc8c7cf13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b6c42eec3544f3c820c0b0ce6f2f1f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:05:57.879454 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-9fe5bfe5-de2c-4809-960a-827caf41b2e1 tempest-ServerGroupTestJSON-2134213834 tempest-ServerGroupTestJSON-2134213834-project] 10.222.0.13 "GET /compute/v2.1/servers/083a5a87-288b-48e0-8cda-d802774c372a" status: 200 len: 1504 microversion: 2.1 time: 0.493781 Nov 01 19:05:57.880542 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1429/2923] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:05:57 2022] GET /compute/v2.1/servers/083a5a87-288b-48e0-8cda-d802774c372a => generated 1504 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:05:57.896288 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-6a43adcd-dc2f-459f-8a3b-c79b60b22ba7 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:05:57.897187 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-6a43adcd-dc2f-459f-8a3b-c79b60b22ba7 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] [instance: af1071a8-a090-44c9-890c-123ca3ff39f1] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:05:57.908187 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-6a43adcd-dc2f-459f-8a3b-c79b60b22ba7 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:05:57.910740 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-6a43adcd-dc2f-459f-8a3b-c79b60b22ba7 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:05:57.913728 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-6a43adcd-dc2f-459f-8a3b-c79b60b22ba7 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:05:57.914655 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-6a43adcd-dc2f-459f-8a3b-c79b60b22ba7 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:05:57.916881 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-6a43adcd-dc2f-459f-8a3b-c79b60b22ba7 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:05:57.919280 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-6a43adcd-dc2f-459f-8a3b-c79b60b22ba7 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:05:58.398269 n-d-863052-2 devstack@n-api.service[121402]: DEBUG dbcounter [-] [121402] Writing DB stats nova_cell0:SELECT=2 {{(pid=121402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 19:05:58.729980 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-6a43adcd-dc2f-459f-8a3b-c79b60b22ba7 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '301ed3b9c37449bc9ade378f3c73a768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8807757227574c828dca1947af76659d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:05:58.748338 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-6a43adcd-dc2f-459f-8a3b-c79b60b22ba7 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '301ed3b9c37449bc9ade378f3c73a768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8807757227574c828dca1947af76659d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:05:58.750188 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-6a43adcd-dc2f-459f-8a3b-c79b60b22ba7 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '301ed3b9c37449bc9ade378f3c73a768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8807757227574c828dca1947af76659d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:05:58.762545 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-6a43adcd-dc2f-459f-8a3b-c79b60b22ba7 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] 10.222.0.13 "GET /compute/v2.1/servers/af1071a8-a090-44c9-890c-123ca3ff39f1" status: 200 len: 1892 microversion: 2.42 time: 0.880599 Nov 01 19:05:58.764339 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1430/2924] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 19:05:57 2022] GET /compute/v2.1/servers/af1071a8-a090-44c9-890c-123ca3ff39f1 => generated 1892 bytes in 883 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 19:05:58.769576 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [req-ac96cd48-1e4e-4fae-bd2a-89aecdd07cf6 req-aa407248-c4f4-4f9a-83e3-6d18670c8c20 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "af1071a8-a090-44c9-890c-123ca3ff39f1", "tag": "a5bd9833-1398-4c45-bb02-ef165982e99c"}]} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:05:58.780750 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-ac96cd48-1e4e-4fae-bd2a-89aecdd07cf6 req-aa407248-c4f4-4f9a-83e3-6d18670c8c20 service nova] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:05:58.781741 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-ac96cd48-1e4e-4fae-bd2a-89aecdd07cf6 req-aa407248-c4f4-4f9a-83e3-6d18670c8c20 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:05:58.782424 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-ac96cd48-1e4e-4fae-bd2a-89aecdd07cf6 req-aa407248-c4f4-4f9a-83e3-6d18670c8c20 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:05:58.795631 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.compute.server_external_events [req-ac96cd48-1e4e-4fae-bd2a-89aecdd07cf6 req-aa407248-c4f4-4f9a-83e3-6d18670c8c20 service nova] Creating event network-changed:a5bd9833-1398-4c45-bb02-ef165982e99c for instance af1071a8-a090-44c9-890c-123ca3ff39f1 on n-h2-863052-2 Nov 01 19:05:58.802024 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [req-ac96cd48-1e4e-4fae-bd2a-89aecdd07cf6 req-aa407248-c4f4-4f9a-83e3-6d18670c8c20 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035804 Nov 01 19:05:58.803498 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1431/2925] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Nov 1 19:05:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:05:58.814741 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-e1197df4-efe6-4449-9b14-ec033bc49643 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:05:58.818891 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-e1197df4-efe6-4449-9b14-ec033bc49643 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] [instance: 0b57b50d-1ec4-4ee1-ac3a-f6f44d68a2c3] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:05:58.833138 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e1197df4-efe6-4449-9b14-ec033bc49643 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:05:58.834161 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e1197df4-efe6-4449-9b14-ec033bc49643 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:05:58.834998 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e1197df4-efe6-4449-9b14-ec033bc49643 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:05:58.836084 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e1197df4-efe6-4449-9b14-ec033bc49643 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:05:58.836859 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e1197df4-efe6-4449-9b14-ec033bc49643 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:05:58.838521 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e1197df4-efe6-4449-9b14-ec033bc49643 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:05:59.554418 n-d-863052-2 devstack@n-api.service[121402]: DEBUG dbcounter [-] [121402] Writing DB stats nova_cell0:SELECT=12 {{(pid=121402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 19:05:59.771630 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-e1197df4-efe6-4449-9b14-ec033bc49643 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05d6a1722dfa4e959aeb14d601e43b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b5d812eff94e2f89d4705d7e7d5f3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:05:59.782099 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-e1197df4-efe6-4449-9b14-ec033bc49643 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] 10.222.0.13 "GET /compute/v2.1/servers/0b57b50d-1ec4-4ee1-ac3a-f6f44d68a2c3" status: 200 len: 1316 microversion: 2.1 time: 0.974957 Nov 01 19:05:59.785563 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1432/2926] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:05:58 2022] GET /compute/v2.1/servers/0b57b50d-1ec4-4ee1-ac3a-f6f44d68a2c3 => generated 1316 bytes in 981 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:05:59.827523 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-c8e21938-d814-4707-aac0-58d5e6243308 tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:05:59.831851 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-c8e21938-d814-4707-aac0-58d5e6243308 tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] [instance: 86162175-5f45-4aa7-9825-f1a3b4a699ff] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:05:59.856240 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-c8e21938-d814-4707-aac0-58d5e6243308 tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:05:59.866558 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-c8e21938-d814-4707-aac0-58d5e6243308 tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:05:59.870117 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-c8e21938-d814-4707-aac0-58d5e6243308 tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:05:59.871034 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-c8e21938-d814-4707-aac0-58d5e6243308 tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:05:59.878919 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-c8e21938-d814-4707-aac0-58d5e6243308 tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:05:59.879507 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-c8e21938-d814-4707-aac0-58d5e6243308 tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:06:00.478385 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-c8e21938-d814-4707-aac0-58d5e6243308 tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb87e6147a6f470391921ac3b7a62f8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6511ea24c4c19a7c5d91535c7288d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:06:00.490581 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-c8e21938-d814-4707-aac0-58d5e6243308 tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] 10.222.0.13 "GET /compute/v2.1/servers/86162175-5f45-4aa7-9825-f1a3b4a699ff" status: 200 len: 1323 microversion: 2.1 time: 0.682109 Nov 01 19:06:00.491098 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1433/2927] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:05:59 2022] GET /compute/v2.1/servers/86162175-5f45-4aa7-9825-f1a3b4a699ff => generated 1323 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:06:00.519339 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-88b05805-de99-4ecc-8d80-59985fd465fd tempest-ServerGroupTestJSON-2134213834 tempest-ServerGroupTestJSON-2134213834-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:06:00.528399 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-88b05805-de99-4ecc-8d80-59985fd465fd tempest-ServerGroupTestJSON-2134213834 tempest-ServerGroupTestJSON-2134213834-project] [instance: 083a5a87-288b-48e0-8cda-d802774c372a] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:06:00.564647 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-88b05805-de99-4ecc-8d80-59985fd465fd tempest-ServerGroupTestJSON-2134213834 tempest-ServerGroupTestJSON-2134213834-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:06:00.568143 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-88b05805-de99-4ecc-8d80-59985fd465fd tempest-ServerGroupTestJSON-2134213834 tempest-ServerGroupTestJSON-2134213834-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:06:00.569087 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-88b05805-de99-4ecc-8d80-59985fd465fd tempest-ServerGroupTestJSON-2134213834 tempest-ServerGroupTestJSON-2134213834-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:06:00.572382 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-88b05805-de99-4ecc-8d80-59985fd465fd tempest-ServerGroupTestJSON-2134213834 tempest-ServerGroupTestJSON-2134213834-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:06:00.573171 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-88b05805-de99-4ecc-8d80-59985fd465fd tempest-ServerGroupTestJSON-2134213834 tempest-ServerGroupTestJSON-2134213834-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:06:00.574528 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-88b05805-de99-4ecc-8d80-59985fd465fd tempest-ServerGroupTestJSON-2134213834 tempest-ServerGroupTestJSON-2134213834-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:06:00.628000 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.wsgi [None req-88b05805-de99-4ecc-8d80-59985fd465fd tempest-ServerGroupTestJSON-2134213834 tempest-ServerGroupTestJSON-2134213834-project] HTTP exception thrown: Instance 083a5a87-288b-48e0-8cda-d802774c372a could not be found. Nov 01 19:06:00.634337 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-88b05805-de99-4ecc-8d80-59985fd465fd tempest-ServerGroupTestJSON-2134213834 tempest-ServerGroupTestJSON-2134213834-project] Request method failure captured: Nov 01 19:06:00.634337 n-d-863052-2 devstack@n-api.service[121402]: request: GET /compute/v2.1/servers/083a5a87-288b-48e0-8cda-d802774c372a HTTP/1.1 Nov 01 19:06:00.634337 n-d-863052-2 devstack@n-api.service[121402]: Accept: application/json Nov 01 19:06:00.634337 n-d-863052-2 devstack@n-api.service[121402]: Accept-Encoding: identity Nov 01 19:06:00.634337 n-d-863052-2 devstack@n-api.service[121402]: Connection: close Nov 01 19:06:00.634337 n-d-863052-2 devstack@n-api.service[121402]: Content-Length: 0 Nov 01 19:06:00.634337 n-d-863052-2 devstack@n-api.service[121402]: Content-Type: application/json Nov 01 19:06:00.634337 n-d-863052-2 devstack@n-api.service[121402]: Host: 10.222.0.13 Nov 01 19:06:00.634337 n-d-863052-2 devstack@n-api.service[121402]: Openstack-System-Scope: None Nov 01 19:06:00.634337 n-d-863052-2 devstack@n-api.service[121402]: User-Agent: python-urllib3/1.26.12 Nov 01 19:06:00.634337 n-d-863052-2 devstack@n-api.service[121402]: X-Auth-Token: gAAAAABjYW3xEAnoJ5CDkbTdk4Yw5CxOFmyIN8TUXXhJfFxLKoEWyvxhCNBqFhhUWS831Si4d1MW8i6sV5Nb_tsg8WNO3jR17U2LC00uksL3QKQiq96omqm2q1EPdzvzu2k99iYLrDCEFm8ot_lvHXlTFST2p6oJVCpOKcVc-dcBOCdHBiIzOh4 Nov 01 19:06:00.634337 n-d-863052-2 devstack@n-api.service[121402]: X-Domain-Id: None Nov 01 19:06:00.634337 n-d-863052-2 devstack@n-api.service[121402]: X-Domain-Name: None Nov 01 19:06:00.634337 n-d-863052-2 devstack@n-api.service[121402]: X-Identity-Status: Confirmed Nov 01 19:06:00.634337 n-d-863052-2 devstack@n-api.service[121402]: X-Is-Admin-Project: True Nov 01 19:06:00.634337 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Domain-Id: default Nov 01 19:06:00.634337 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Domain-Name: Default Nov 01 19:06:00.634337 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Id: 6b6c42eec3544f3c820c0b0ce6f2f1f9 Nov 01 19:06:00.634337 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Name: tempest-ServerGroupTestJSON-2134213834 Nov 01 19:06:00.634337 n-d-863052-2 devstack@n-api.service[121402]: X-Role: member,reader Nov 01 19:06:00.634337 n-d-863052-2 devstack@n-api.service[121402]: X-Roles: member,reader Nov 01 19:06:00.634337 n-d-863052-2 devstack@n-api.service[121402]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/6b6c42eec3544f3c820c0b0ce6f2f1f9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/6b6c42eec3544f3c820c0b0ce6f2f1f9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_6b6c42eec3544f3c820c0b0ce6f2f1f9", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/6b6c42eec3544f3c820c0b0ce6f2f1f9"}]}] Nov 01 19:06:00.634337 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant: tempest-ServerGroupTestJSON-2134213834 Nov 01 19:06:00.634337 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant-Id: 6b6c42eec3544f3c820c0b0ce6f2f1f9 Nov 01 19:06:00.634337 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant-Name: tempest-ServerGroupTestJSON-2134213834 Nov 01 19:06:00.634337 n-d-863052-2 devstack@n-api.service[121402]: X-User: tempest-ServerGroupTestJSON-2134213834-project Nov 01 19:06:00.634337 n-d-863052-2 devstack@n-api.service[121402]: X-User-Domain-Id: default Nov 01 19:06:00.634337 n-d-863052-2 devstack@n-api.service[121402]: X-User-Domain-Name: Default Nov 01 19:06:00.634337 n-d-863052-2 devstack@n-api.service[121402]: X-User-Id: b0ef831ef96b4e5a983061fc8c7cf13d Nov 01 19:06:00.634337 n-d-863052-2 devstack@n-api.service[121402]: X-User-Name: tempest-ServerGroupTestJSON-2134213834-project Nov 01 19:06:00.634337 n-d-863052-2 devstack@n-api.service[121402]: method: > Nov 01 19:06:00.634337 n-d-863052-2 devstack@n-api.service[121402]: exception: Instance 083a5a87-288b-48e0-8cda-d802774c372a could not be found. Nov 01 19:06:00.634337 n-d-863052-2 devstack@n-api.service[121402]: action_args: {'id': '083a5a87-288b-48e0-8cda-d802774c372a'} Nov 01 19:06:00.634337 n-d-863052-2 devstack@n-api.service[121402]: {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 01 19:06:00.634337 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:06:00.634337 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 01 19:06:00.634337 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 01 19:06:00.634337 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 01 19:06:00.634337 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 01 19:06:00.634337 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 01 19:06:00.634337 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 01 19:06:00.634337 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 01 19:06:00.634337 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 01 19:06:00.634337 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 083a5a87-288b-48e0-8cda-d802774c372a could not be found. Nov 01 19:06:00.634337 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:06:00.634337 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:06:00.634337 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:06:00.634337 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:06:00.634337 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:06:00.634337 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:06:00.634337 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 01 19:06:00.634337 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 01 19:06:00.634337 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 01 19:06:00.634337 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 01 19:06:00.634337 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 01 19:06:00.634337 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 01 19:06:00.634337 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 01 19:06:00.634337 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 01 19:06:00.634337 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 01 19:06:00.634337 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 01 19:06:00.634337 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 083a5a87-288b-48e0-8cda-d802774c372a could not be found. Nov 01 19:06:00.634337 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:06:00.634337 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:06:00.634337 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:06:00.639941 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:06:00.639941 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:06:00.639941 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:06:00.639941 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 01 19:06:00.639941 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 01 19:06:00.639941 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 083a5a87-288b-48e0-8cda-d802774c372a could not be found. Nov 01 19:06:00.639941 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:06:00.643460 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-88b05805-de99-4ecc-8d80-59985fd465fd tempest-ServerGroupTestJSON-2134213834 tempest-ServerGroupTestJSON-2134213834-project] Returning 404 to user: Instance 083a5a87-288b-48e0-8cda-d802774c372a could not be found. {{(pid=121402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 01 19:06:00.645830 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-88b05805-de99-4ecc-8d80-59985fd465fd tempest-ServerGroupTestJSON-2134213834 tempest-ServerGroupTestJSON-2134213834-project] 10.222.0.13 "GET /compute/v2.1/servers/083a5a87-288b-48e0-8cda-d802774c372a" status: 404 len: 111 microversion: 2.1 time: 0.144495 Nov 01 19:06:00.647690 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1434/2928] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:06:00 2022] GET /compute/v2.1/servers/083a5a87-288b-48e0-8cda-d802774c372a => generated 111 bytes in 156 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 01 19:06:00.662632 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-e67ceee1-e35f-4dca-83f7-e6db629233d9 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:06:00.669716 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-e67ceee1-e35f-4dca-83f7-e6db629233d9 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] [instance: af1071a8-a090-44c9-890c-123ca3ff39f1] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:06:00.692406 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e67ceee1-e35f-4dca-83f7-e6db629233d9 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:06:00.693105 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e67ceee1-e35f-4dca-83f7-e6db629233d9 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:06:00.695683 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e67ceee1-e35f-4dca-83f7-e6db629233d9 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:06:00.696953 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e67ceee1-e35f-4dca-83f7-e6db629233d9 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:06:00.702106 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e67ceee1-e35f-4dca-83f7-e6db629233d9 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:06:00.702695 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e67ceee1-e35f-4dca-83f7-e6db629233d9 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:06:01.890435 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-e67ceee1-e35f-4dca-83f7-e6db629233d9 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '301ed3b9c37449bc9ade378f3c73a768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8807757227574c828dca1947af76659d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:06:01.900782 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-e67ceee1-e35f-4dca-83f7-e6db629233d9 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '301ed3b9c37449bc9ade378f3c73a768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8807757227574c828dca1947af76659d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:06:01.907005 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-e67ceee1-e35f-4dca-83f7-e6db629233d9 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '301ed3b9c37449bc9ade378f3c73a768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8807757227574c828dca1947af76659d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:06:01.912260 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-e67ceee1-e35f-4dca-83f7-e6db629233d9 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] 10.222.0.13 "GET /compute/v2.1/servers/af1071a8-a090-44c9-890c-123ca3ff39f1" status: 200 len: 1892 microversion: 2.42 time: 1.258646 Nov 01 19:06:01.936669 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1435/2929] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 19:06:00 2022] GET /compute/v2.1/servers/af1071a8-a090-44c9-890c-123ca3ff39f1 => generated 1892 bytes in 1274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 19:06:01.941100 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.virt.hardware [None req-11b61e6e-507b-47d9-8dcb-0fb2800f1e2d tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Flavor limits 0:0:0 {{(pid=121403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 01 19:06:01.942097 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.virt.hardware [None req-11b61e6e-507b-47d9-8dcb-0fb2800f1e2d tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Image limits 0:0:0 {{(pid=121403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 01 19:06:01.942724 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.virt.hardware [None req-11b61e6e-507b-47d9-8dcb-0fb2800f1e2d tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Flavor pref 0:0:0 {{(pid=121403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 01 19:06:01.943292 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.virt.hardware [None req-11b61e6e-507b-47d9-8dcb-0fb2800f1e2d tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Image pref 0:0:0 {{(pid=121403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 01 19:06:01.943896 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.virt.hardware [None req-11b61e6e-507b-47d9-8dcb-0fb2800f1e2d tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 01 19:06:01.946318 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-d4242ea4-f6b5-4935-92e3-c0914bbf3814 tempest-ServerGroupTestJSON-2134213834 tempest-ServerGroupTestJSON-2134213834-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:06:01.958207 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-11b61e6e-507b-47d9-8dcb-0fb2800f1e2d tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:06:01.958695 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-11b61e6e-507b-47d9-8dcb-0fb2800f1e2d tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:06:01.959135 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-11b61e6e-507b-47d9-8dcb-0fb2800f1e2d tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:06:01.959853 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-11b61e6e-507b-47d9-8dcb-0fb2800f1e2d tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:06:01.964468 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-11b61e6e-507b-47d9-8dcb-0fb2800f1e2d tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:06:01.964942 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-11b61e6e-507b-47d9-8dcb-0fb2800f1e2d tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:06:01.970003 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.compute.server_groups [None req-d4242ea4-f6b5-4935-92e3-c0914bbf3814 tempest-ServerGroupTestJSON-2134213834 tempest-ServerGroupTestJSON-2134213834-project] Querying cell 389766af-efe4-4d8b-b2de-e920ed3438ee(cell1) for 1 instances {{(pid=121402) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Nov 01 19:06:01.971097 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-d4242ea4-f6b5-4935-92e3-c0914bbf3814 tempest-ServerGroupTestJSON-2134213834 tempest-ServerGroupTestJSON-2134213834-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:06:01.971793 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-d4242ea4-f6b5-4935-92e3-c0914bbf3814 tempest-ServerGroupTestJSON-2134213834 tempest-ServerGroupTestJSON-2134213834-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:06:01.972438 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-d4242ea4-f6b5-4935-92e3-c0914bbf3814 tempest-ServerGroupTestJSON-2134213834 tempest-ServerGroupTestJSON-2134213834-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:06:01.983794 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-d4242ea4-f6b5-4935-92e3-c0914bbf3814 tempest-ServerGroupTestJSON-2134213834 tempest-ServerGroupTestJSON-2134213834-project] 10.222.0.13 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.045398 Nov 01 19:06:01.985627 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1436/2930] 10.222.0.13 () {58 vars in 1152 bytes} [Tue Nov 1 19:06:01 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:06:01.990783 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-fcb36049-935d-49c0-8162-adf8fd2bd2b1 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:06:01.991733 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-fcb36049-935d-49c0-8162-adf8fd2bd2b1 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] [instance: 0b57b50d-1ec4-4ee1-ac3a-f6f44d68a2c3] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:06:01.998439 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-fcb36049-935d-49c0-8162-adf8fd2bd2b1 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:06:01.999314 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-fcb36049-935d-49c0-8162-adf8fd2bd2b1 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:06:01.999973 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-fcb36049-935d-49c0-8162-adf8fd2bd2b1 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:06:02.000974 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-fcb36049-935d-49c0-8162-adf8fd2bd2b1 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:06:02.002676 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-fcb36049-935d-49c0-8162-adf8fd2bd2b1 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:06:02.003332 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-fcb36049-935d-49c0-8162-adf8fd2bd2b1 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:06:02.008889 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.quota [None req-11b61e6e-507b-47d9-8dcb-0fb2800f1e2d tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Getting quotas for project adf4adda91364dab94830347c06e3957. Resources: {'cores', 'ram', 'instances'} {{(pid=121403) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 01 19:06:02.024754 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.quota [None req-11b61e6e-507b-47d9-8dcb-0fb2800f1e2d tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Getting quotas for user cd2105b0264b48d084d0e79cabff8bc4 and project adf4adda91364dab94830347c06e3957. Resources: {'cores', 'ram', 'instances'} {{(pid=121403) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 01 19:06:02.503959 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-fcb36049-935d-49c0-8162-adf8fd2bd2b1 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05d6a1722dfa4e959aeb14d601e43b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b5d812eff94e2f89d4705d7e7d5f3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:06:02.517275 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-fcb36049-935d-49c0-8162-adf8fd2bd2b1 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] 10.222.0.13 "GET /compute/v2.1/servers/0b57b50d-1ec4-4ee1-ac3a-f6f44d68a2c3" status: 200 len: 1316 microversion: 2.1 time: 0.530333 Nov 01 19:06:02.520743 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1437/2931] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:06:01 2022] GET /compute/v2.1/servers/0b57b50d-1ec4-4ee1-ac3a-f6f44d68a2c3 => generated 1316 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:06:02.527405 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-85554f0b-69e6-4239-b8c3-994b0b102000 tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:06:02.532094 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-85554f0b-69e6-4239-b8c3-994b0b102000 tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] [instance: 86162175-5f45-4aa7-9825-f1a3b4a699ff] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:06:02.546165 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-85554f0b-69e6-4239-b8c3-994b0b102000 tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:06:02.549029 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-85554f0b-69e6-4239-b8c3-994b0b102000 tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:06:02.549724 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-85554f0b-69e6-4239-b8c3-994b0b102000 tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:06:02.551656 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-85554f0b-69e6-4239-b8c3-994b0b102000 tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:06:02.553424 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-85554f0b-69e6-4239-b8c3-994b0b102000 tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:06:02.555424 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-85554f0b-69e6-4239-b8c3-994b0b102000 tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:06:02.764140 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-85554f0b-69e6-4239-b8c3-994b0b102000 tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb87e6147a6f470391921ac3b7a62f8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6511ea24c4c19a7c5d91535c7288d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:06:02.770946 n-d-863052-2 devstack@n-api.service[121402]: DEBUG dbcounter [-] [121402] Writing DB stats nova_cell1:SELECT=100 {{(pid=121402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 19:06:02.773783 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-85554f0b-69e6-4239-b8c3-994b0b102000 tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] 10.222.0.13 "GET /compute/v2.1/servers/86162175-5f45-4aa7-9825-f1a3b4a699ff" status: 200 len: 1323 microversion: 2.1 time: 0.251624 Nov 01 19:06:02.780886 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1438/2932] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:06:02 2022] GET /compute/v2.1/servers/86162175-5f45-4aa7-9825-f1a3b4a699ff => generated 1323 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:06:02.786817 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [req-1eadb22e-5b65-4c01-9b96-de6df8edbe39 req-ffddd39e-ea14-4122-a54b-ab034b1aba0c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "083a5a87-288b-48e0-8cda-d802774c372a", "name": "network-vif-deleted", "tag": "c70af547-f1c8-4388-bad0-a7add263f5a0"}, {"name": "network-changed", "server_uuid": "0b57b50d-1ec4-4ee1-ac3a-f6f44d68a2c3", "tag": "4032ee0a-a429-4780-a678-83209caf97b1"}, {"name": "network-changed", "server_uuid": "af1071a8-a090-44c9-890c-123ca3ff39f1", "tag": "5bf6bd76-de52-44ac-88f4-a18e9dd144b7"}]} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:06:02.814541 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-1eadb22e-5b65-4c01-9b96-de6df8edbe39 req-ffddd39e-ea14-4122-a54b-ab034b1aba0c service nova] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:06:02.819089 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-1eadb22e-5b65-4c01-9b96-de6df8edbe39 req-ffddd39e-ea14-4122-a54b-ab034b1aba0c service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:06:02.819816 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-1eadb22e-5b65-4c01-9b96-de6df8edbe39 req-ffddd39e-ea14-4122-a54b-ab034b1aba0c service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:06:02.854276 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.compute.server_external_events [req-1eadb22e-5b65-4c01-9b96-de6df8edbe39 req-ffddd39e-ea14-4122-a54b-ab034b1aba0c service nova] Creating event network-vif-deleted:c70af547-f1c8-4388-bad0-a7add263f5a0 for instance 083a5a87-288b-48e0-8cda-d802774c372a on n-h1-863052-2 Nov 01 19:06:02.855508 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.compute.server_external_events [req-1eadb22e-5b65-4c01-9b96-de6df8edbe39 req-ffddd39e-ea14-4122-a54b-ab034b1aba0c service nova] Creating event network-changed:4032ee0a-a429-4780-a678-83209caf97b1 for instance 0b57b50d-1ec4-4ee1-ac3a-f6f44d68a2c3 on n-h2-863052-2 Nov 01 19:06:02.857676 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.compute.server_external_events [req-1eadb22e-5b65-4c01-9b96-de6df8edbe39 req-ffddd39e-ea14-4122-a54b-ab034b1aba0c service nova] Creating event network-changed:5bf6bd76-de52-44ac-88f4-a18e9dd144b7 for instance af1071a8-a090-44c9-890c-123ca3ff39f1 on n-h2-863052-2 Nov 01 19:06:02.879112 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [req-1eadb22e-5b65-4c01-9b96-de6df8edbe39 req-ffddd39e-ea14-4122-a54b-ab034b1aba0c service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 517 microversion: 2.1 time: 0.096389 Nov 01 19:06:02.882053 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1439/2933] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Nov 1 19:06:02 2022] POST /compute/v2.1/os-server-external-events => generated 517 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:06:02.895395 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-0228e826-c418-482a-be8f-2721f8af694b tempest-ServerGroupTestJSON-2134213834 tempest-ServerGroupTestJSON-2134213834-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:06:02.930096 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.compute.server_groups [None req-0228e826-c418-482a-be8f-2721f8af694b tempest-ServerGroupTestJSON-2134213834 tempest-ServerGroupTestJSON-2134213834-project] Querying cell 389766af-efe4-4d8b-b2de-e920ed3438ee(cell1) for 1 instances {{(pid=121402) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Nov 01 19:06:02.933883 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-0228e826-c418-482a-be8f-2721f8af694b tempest-ServerGroupTestJSON-2134213834 tempest-ServerGroupTestJSON-2134213834-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:06:02.934619 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-0228e826-c418-482a-be8f-2721f8af694b tempest-ServerGroupTestJSON-2134213834 tempest-ServerGroupTestJSON-2134213834-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:06:02.938766 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-0228e826-c418-482a-be8f-2721f8af694b tempest-ServerGroupTestJSON-2134213834 tempest-ServerGroupTestJSON-2134213834-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:06:02.960917 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-0228e826-c418-482a-be8f-2721f8af694b tempest-ServerGroupTestJSON-2134213834 tempest-ServerGroupTestJSON-2134213834-project] 10.222.0.13 "GET /compute/v2.1/os-server-groups/39db9570-eff7-4e8a-acae-6e2d59add751" status: 200 len: 184 microversion: 2.1 time: 0.077156 Nov 01 19:06:02.966732 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1440/2934] 10.222.0.13 () {58 vars in 1263 bytes} [Tue Nov 1 19:06:02 2022] GET /compute/v2.1/os-server-groups/39db9570-eff7-4e8a-acae-6e2d59add751 => generated 184 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:06:02.974553 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [req-3133098f-6b94-43d9-8825-e1036adbee79 req-96b14077-c931-4ab5-866e-1090988939f4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "86162175-5f45-4aa7-9825-f1a3b4a699ff", "name": "network-vif-plugged", "status": "completed", "tag": "e985c4cd-3aee-4c89-a53f-f69bb65a4339"}]} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:06:02.984547 n-d-863052-2 devstack@n-api.service[121402]: DEBUG dbcounter [-] [121402] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=121402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 19:06:02.991050 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-3133098f-6b94-43d9-8825-e1036adbee79 req-96b14077-c931-4ab5-866e-1090988939f4 service nova] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:06:02.991640 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-3133098f-6b94-43d9-8825-e1036adbee79 req-96b14077-c931-4ab5-866e-1090988939f4 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:06:02.992153 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-3133098f-6b94-43d9-8825-e1036adbee79 req-96b14077-c931-4ab5-866e-1090988939f4 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:06:03.019920 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.compute.server_external_events [req-3133098f-6b94-43d9-8825-e1036adbee79 req-96b14077-c931-4ab5-866e-1090988939f4 service nova] Creating event network-vif-plugged:e985c4cd-3aee-4c89-a53f-f69bb65a4339 for instance 86162175-5f45-4aa7-9825-f1a3b4a699ff on n-h1-863052-2 Nov 01 19:06:03.028070 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [req-3133098f-6b94-43d9-8825-e1036adbee79 req-96b14077-c931-4ab5-866e-1090988939f4 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058056 Nov 01 19:06:03.035079 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1441/2935] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Nov 1 19:06:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:06:03.044021 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-5d344dd0-0086-47e1-9606-2946c9dc2083 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "570e6f6f-08f1-4533-80b2-d91dfc64c54a"}} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:06:03.057411 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-11b61e6e-507b-47d9-8dcb-0fb2800f1e2d tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Going to run 1 instances... {{(pid=121403) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 01 19:06:03.064320 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-11b61e6e-507b-47d9-8dcb-0fb2800f1e2d tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] [instance: ba6ffc5c-84a4-40f1-bdc7-f87dde2c99df] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='d2a0fc3f-a650-449b-80ea-a7df3aa1f11b',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='cced0681-fb87-408b-8c8a-7e9cb41e7fde',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='c5448dc1-99e4-430c-a40c-6ea776d11908',volume_size=None,volume_type=None)] {{(pid=121403) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 01 19:06:03.072770 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-5d344dd0-0086-47e1-9606-2946c9dc2083 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] [instance: 3029f3c1-4f32-4f6b-963c-16f65b6dff3c] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:06:03.099467 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-5d344dd0-0086-47e1-9606-2946c9dc2083 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:06:03.100160 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-5d344dd0-0086-47e1-9606-2946c9dc2083 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:06:03.100816 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-5d344dd0-0086-47e1-9606-2946c9dc2083 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:06:03.101871 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-5d344dd0-0086-47e1-9606-2946c9dc2083 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:06:03.102627 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-5d344dd0-0086-47e1-9606-2946c9dc2083 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:06:03.103213 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-5d344dd0-0086-47e1-9606-2946c9dc2083 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:06:03.760342 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-11b61e6e-507b-47d9-8dcb-0fb2800f1e2d tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.32 time: 8.172910 Nov 01 19:06:03.761277 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1495/2936] 10.222.0.13 () {62 vars in 1189 bytes} [Tue Nov 1 19:05:55 2022] POST /compute/v2.1/servers => generated 405 bytes in 8175 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Nov 01 19:06:03.784354 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-038198e9-0090-4f93-8d31-fd1a8117f889 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:06:03.785121 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-038198e9-0090-4f93-8d31-fd1a8117f889 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] [instance: af1071a8-a090-44c9-890c-123ca3ff39f1] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:06:03.807432 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-038198e9-0090-4f93-8d31-fd1a8117f889 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:06:03.807966 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-038198e9-0090-4f93-8d31-fd1a8117f889 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:06:03.808397 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-038198e9-0090-4f93-8d31-fd1a8117f889 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:06:03.809186 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-038198e9-0090-4f93-8d31-fd1a8117f889 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:06:03.809656 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-038198e9-0090-4f93-8d31-fd1a8117f889 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:06:03.810152 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-038198e9-0090-4f93-8d31-fd1a8117f889 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:06:03.856281 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-5d344dd0-0086-47e1-9606-2946c9dc2083 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] 10.222.0.13 "POST /compute/v2.1/servers/3029f3c1-4f32-4f6b-963c-16f65b6dff3c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.818665 Nov 01 19:06:03.862596 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1442/2937] 10.222.0.13 () {60 vars in 1323 bytes} [Tue Nov 1 19:06:03 2022] POST /compute/v2.1/servers/3029f3c1-4f32-4f6b-963c-16f65b6dff3c/os-volume_attachments => generated 194 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:06:03.871405 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-df0c7b1e-72c6-43a0-805e-5a65609b864f tempest-ServerGroupTestJSON-2134213834 tempest-ServerGroupTestJSON-2134213834-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:06:03.876244 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-df0c7b1e-72c6-43a0-805e-5a65609b864f tempest-ServerGroupTestJSON-2134213834 tempest-ServerGroupTestJSON-2134213834-project] [instance: 083a5a87-288b-48e0-8cda-d802774c372a] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:06:03.887783 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-df0c7b1e-72c6-43a0-805e-5a65609b864f tempest-ServerGroupTestJSON-2134213834 tempest-ServerGroupTestJSON-2134213834-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:06:03.890559 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-df0c7b1e-72c6-43a0-805e-5a65609b864f tempest-ServerGroupTestJSON-2134213834 tempest-ServerGroupTestJSON-2134213834-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:06:03.891024 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-df0c7b1e-72c6-43a0-805e-5a65609b864f tempest-ServerGroupTestJSON-2134213834 tempest-ServerGroupTestJSON-2134213834-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:06:03.891756 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-df0c7b1e-72c6-43a0-805e-5a65609b864f tempest-ServerGroupTestJSON-2134213834 tempest-ServerGroupTestJSON-2134213834-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:06:03.892227 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-df0c7b1e-72c6-43a0-805e-5a65609b864f tempest-ServerGroupTestJSON-2134213834 tempest-ServerGroupTestJSON-2134213834-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:06:03.902985 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-df0c7b1e-72c6-43a0-805e-5a65609b864f tempest-ServerGroupTestJSON-2134213834 tempest-ServerGroupTestJSON-2134213834-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:06:03.949858 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.wsgi [None req-df0c7b1e-72c6-43a0-805e-5a65609b864f tempest-ServerGroupTestJSON-2134213834 tempest-ServerGroupTestJSON-2134213834-project] HTTP exception thrown: Instance 083a5a87-288b-48e0-8cda-d802774c372a could not be found. Nov 01 19:06:03.956623 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-df0c7b1e-72c6-43a0-805e-5a65609b864f tempest-ServerGroupTestJSON-2134213834 tempest-ServerGroupTestJSON-2134213834-project] Request method failure captured: Nov 01 19:06:03.956623 n-d-863052-2 devstack@n-api.service[121402]: request: DELETE /compute/v2.1/servers/083a5a87-288b-48e0-8cda-d802774c372a HTTP/1.1 Nov 01 19:06:03.956623 n-d-863052-2 devstack@n-api.service[121402]: Accept: application/json Nov 01 19:06:03.956623 n-d-863052-2 devstack@n-api.service[121402]: Accept-Encoding: identity Nov 01 19:06:03.956623 n-d-863052-2 devstack@n-api.service[121402]: Connection: close Nov 01 19:06:03.956623 n-d-863052-2 devstack@n-api.service[121402]: Content-Length: 0 Nov 01 19:06:03.956623 n-d-863052-2 devstack@n-api.service[121402]: Content-Type: application/json Nov 01 19:06:03.956623 n-d-863052-2 devstack@n-api.service[121402]: Host: 10.222.0.13 Nov 01 19:06:03.956623 n-d-863052-2 devstack@n-api.service[121402]: Openstack-System-Scope: None Nov 01 19:06:03.956623 n-d-863052-2 devstack@n-api.service[121402]: User-Agent: python-urllib3/1.26.12 Nov 01 19:06:03.956623 n-d-863052-2 devstack@n-api.service[121402]: X-Auth-Token: gAAAAABjYW3xEAnoJ5CDkbTdk4Yw5CxOFmyIN8TUXXhJfFxLKoEWyvxhCNBqFhhUWS831Si4d1MW8i6sV5Nb_tsg8WNO3jR17U2LC00uksL3QKQiq96omqm2q1EPdzvzu2k99iYLrDCEFm8ot_lvHXlTFST2p6oJVCpOKcVc-dcBOCdHBiIzOh4 Nov 01 19:06:03.956623 n-d-863052-2 devstack@n-api.service[121402]: X-Domain-Id: None Nov 01 19:06:03.956623 n-d-863052-2 devstack@n-api.service[121402]: X-Domain-Name: None Nov 01 19:06:03.956623 n-d-863052-2 devstack@n-api.service[121402]: X-Identity-Status: Confirmed Nov 01 19:06:03.956623 n-d-863052-2 devstack@n-api.service[121402]: X-Is-Admin-Project: True Nov 01 19:06:03.956623 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Domain-Id: default Nov 01 19:06:03.956623 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Domain-Name: Default Nov 01 19:06:03.956623 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Id: 6b6c42eec3544f3c820c0b0ce6f2f1f9 Nov 01 19:06:03.956623 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Name: tempest-ServerGroupTestJSON-2134213834 Nov 01 19:06:03.956623 n-d-863052-2 devstack@n-api.service[121402]: X-Role: member,reader Nov 01 19:06:03.956623 n-d-863052-2 devstack@n-api.service[121402]: X-Roles: member,reader Nov 01 19:06:03.956623 n-d-863052-2 devstack@n-api.service[121402]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/6b6c42eec3544f3c820c0b0ce6f2f1f9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/6b6c42eec3544f3c820c0b0ce6f2f1f9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_6b6c42eec3544f3c820c0b0ce6f2f1f9", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/6b6c42eec3544f3c820c0b0ce6f2f1f9"}]}] Nov 01 19:06:03.956623 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant: tempest-ServerGroupTestJSON-2134213834 Nov 01 19:06:03.956623 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant-Id: 6b6c42eec3544f3c820c0b0ce6f2f1f9 Nov 01 19:06:03.956623 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant-Name: tempest-ServerGroupTestJSON-2134213834 Nov 01 19:06:03.956623 n-d-863052-2 devstack@n-api.service[121402]: X-User: tempest-ServerGroupTestJSON-2134213834-project Nov 01 19:06:03.956623 n-d-863052-2 devstack@n-api.service[121402]: X-User-Domain-Id: default Nov 01 19:06:03.956623 n-d-863052-2 devstack@n-api.service[121402]: X-User-Domain-Name: Default Nov 01 19:06:03.956623 n-d-863052-2 devstack@n-api.service[121402]: X-User-Id: b0ef831ef96b4e5a983061fc8c7cf13d Nov 01 19:06:03.956623 n-d-863052-2 devstack@n-api.service[121402]: X-User-Name: tempest-ServerGroupTestJSON-2134213834-project Nov 01 19:06:03.956623 n-d-863052-2 devstack@n-api.service[121402]: method: > Nov 01 19:06:03.956623 n-d-863052-2 devstack@n-api.service[121402]: exception: Instance 083a5a87-288b-48e0-8cda-d802774c372a could not be found. Nov 01 19:06:03.956623 n-d-863052-2 devstack@n-api.service[121402]: action_args: {'id': '083a5a87-288b-48e0-8cda-d802774c372a'} Nov 01 19:06:03.956623 n-d-863052-2 devstack@n-api.service[121402]: {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 01 19:06:03.956623 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:06:03.956623 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 01 19:06:03.956623 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 01 19:06:03.956623 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 01 19:06:03.956623 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 01 19:06:03.956623 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 01 19:06:03.956623 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 01 19:06:03.956623 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 01 19:06:03.956623 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 01 19:06:03.956623 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 083a5a87-288b-48e0-8cda-d802774c372a could not be found. Nov 01 19:06:03.956623 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:06:03.956623 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:06:03.956623 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:06:03.956623 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:06:03.956623 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:06:03.956623 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:06:03.956623 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 01 19:06:03.956623 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 01 19:06:03.956623 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 01 19:06:03.956623 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 01 19:06:03.956623 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 01 19:06:03.956623 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 01 19:06:03.956623 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 01 19:06:03.956623 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 01 19:06:03.956623 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 01 19:06:03.956623 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 01 19:06:03.956623 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 01 19:06:03.956623 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 01 19:06:03.961819 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 083a5a87-288b-48e0-8cda-d802774c372a could not be found. Nov 01 19:06:03.961819 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:06:03.961819 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:06:03.961819 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:06:03.961819 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:06:03.961819 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:06:03.961819 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:06:03.961819 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 01 19:06:03.961819 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 01 19:06:03.961819 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 083a5a87-288b-48e0-8cda-d802774c372a could not be found. Nov 01 19:06:03.961819 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:06:03.961819 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-df0c7b1e-72c6-43a0-805e-5a65609b864f tempest-ServerGroupTestJSON-2134213834 tempest-ServerGroupTestJSON-2134213834-project] Returning 404 to user: Instance 083a5a87-288b-48e0-8cda-d802774c372a could not be found. {{(pid=121402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 01 19:06:03.961819 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-df0c7b1e-72c6-43a0-805e-5a65609b864f tempest-ServerGroupTestJSON-2134213834 tempest-ServerGroupTestJSON-2134213834-project] 10.222.0.13 "DELETE /compute/v2.1/servers/083a5a87-288b-48e0-8cda-d802774c372a" status: 404 len: 111 microversion: 2.1 time: 0.094394 Nov 01 19:06:03.966851 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1443/2938] 10.222.0.13 () {58 vars in 1239 bytes} [Tue Nov 1 19:06:03 2022] DELETE /compute/v2.1/servers/083a5a87-288b-48e0-8cda-d802774c372a => generated 111 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 01 19:06:03.979050 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-fb5a2e50-66ca-4a99-9e8b-babdbfad061e tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:06:03.979823 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-fb5a2e50-66ca-4a99-9e8b-babdbfad061e tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] [instance: 0b57b50d-1ec4-4ee1-ac3a-f6f44d68a2c3] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:06:03.992507 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-fb5a2e50-66ca-4a99-9e8b-babdbfad061e tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:06:03.995782 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-fb5a2e50-66ca-4a99-9e8b-babdbfad061e tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:06:03.996249 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-fb5a2e50-66ca-4a99-9e8b-babdbfad061e tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:06:03.997039 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-fb5a2e50-66ca-4a99-9e8b-babdbfad061e tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:06:03.998102 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-fb5a2e50-66ca-4a99-9e8b-babdbfad061e tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:06:03.998513 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-fb5a2e50-66ca-4a99-9e8b-babdbfad061e tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:06:04.332085 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-038198e9-0090-4f93-8d31-fd1a8117f889 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '301ed3b9c37449bc9ade378f3c73a768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8807757227574c828dca1947af76659d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:06:04.389543 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-038198e9-0090-4f93-8d31-fd1a8117f889 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '301ed3b9c37449bc9ade378f3c73a768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8807757227574c828dca1947af76659d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:06:04.404664 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-038198e9-0090-4f93-8d31-fd1a8117f889 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '301ed3b9c37449bc9ade378f3c73a768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8807757227574c828dca1947af76659d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:06:04.408339 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-038198e9-0090-4f93-8d31-fd1a8117f889 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] 10.222.0.13 "GET /compute/v2.1/servers/af1071a8-a090-44c9-890c-123ca3ff39f1" status: 200 len: 1892 microversion: 2.42 time: 0.637774 Nov 01 19:06:04.420659 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1496/2939] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 19:06:03 2022] GET /compute/v2.1/servers/af1071a8-a090-44c9-890c-123ca3ff39f1 => generated 1892 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 19:06:04.421435 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-873bf534-0e50-4432-9b26-ce4ed760c9b9 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:06:04.422069 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-873bf534-0e50-4432-9b26-ce4ed760c9b9 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] [instance: ba6ffc5c-84a4-40f1-bdc7-f87dde2c99df] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:06:04.489279 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-fb5a2e50-66ca-4a99-9e8b-babdbfad061e tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05d6a1722dfa4e959aeb14d601e43b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b5d812eff94e2f89d4705d7e7d5f3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:06:04.498846 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-fb5a2e50-66ca-4a99-9e8b-babdbfad061e tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] 10.222.0.13 "GET /compute/v2.1/servers/0b57b50d-1ec4-4ee1-ac3a-f6f44d68a2c3" status: 200 len: 1316 microversion: 2.1 time: 0.530822 Nov 01 19:06:04.499442 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1444/2940] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:06:03 2022] GET /compute/v2.1/servers/0b57b50d-1ec4-4ee1-ac3a-f6f44d68a2c3 => generated 1316 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:06:04.531567 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-428fb5ab-fd8c-4c15-90c3-748244438878 tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:06:04.532171 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-428fb5ab-fd8c-4c15-90c3-748244438878 tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] [instance: 86162175-5f45-4aa7-9825-f1a3b4a699ff] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:06:04.554348 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-428fb5ab-fd8c-4c15-90c3-748244438878 tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:06:04.554866 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-428fb5ab-fd8c-4c15-90c3-748244438878 tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:06:04.555316 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-428fb5ab-fd8c-4c15-90c3-748244438878 tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:06:04.556040 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-428fb5ab-fd8c-4c15-90c3-748244438878 tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:06:04.556507 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-428fb5ab-fd8c-4c15-90c3-748244438878 tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:06:04.556976 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-428fb5ab-fd8c-4c15-90c3-748244438878 tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:06:04.574375 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-873bf534-0e50-4432-9b26-ce4ed760c9b9 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd2105b0264b48d084d0e79cabff8bc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf4adda91364dab94830347c06e3957', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:06:04.584484 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-873bf534-0e50-4432-9b26-ce4ed760c9b9 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd2105b0264b48d084d0e79cabff8bc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf4adda91364dab94830347c06e3957', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:06:04.586280 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-873bf534-0e50-4432-9b26-ce4ed760c9b9 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd2105b0264b48d084d0e79cabff8bc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf4adda91364dab94830347c06e3957', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:06:04.587727 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-873bf534-0e50-4432-9b26-ce4ed760c9b9 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] 10.222.0.13 "GET /compute/v2.1/servers/ba6ffc5c-84a4-40f1-bdc7-f87dde2c99df" status: 200 len: 1286 microversion: 2.32 time: 0.170964 Nov 01 19:06:04.588484 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1497/2941] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 19:06:04 2022] GET /compute/v2.1/servers/ba6ffc5c-84a4-40f1-bdc7-f87dde2c99df => generated 1286 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 19:06:04.593963 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-8a6378c6-d1f6-4e64-a8ac-6ced8958ad77 tempest-ServerGroupTestJSON-2134213834 tempest-ServerGroupTestJSON-2134213834-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:06:04.594703 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-8a6378c6-d1f6-4e64-a8ac-6ced8958ad77 tempest-ServerGroupTestJSON-2134213834 tempest-ServerGroupTestJSON-2134213834-project] [instance: 083a5a87-288b-48e0-8cda-d802774c372a] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:06:04.602621 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-8a6378c6-d1f6-4e64-a8ac-6ced8958ad77 tempest-ServerGroupTestJSON-2134213834 tempest-ServerGroupTestJSON-2134213834-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:06:04.603447 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-8a6378c6-d1f6-4e64-a8ac-6ced8958ad77 tempest-ServerGroupTestJSON-2134213834 tempest-ServerGroupTestJSON-2134213834-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:06:04.604133 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-8a6378c6-d1f6-4e64-a8ac-6ced8958ad77 tempest-ServerGroupTestJSON-2134213834 tempest-ServerGroupTestJSON-2134213834-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:06:04.605112 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-8a6378c6-d1f6-4e64-a8ac-6ced8958ad77 tempest-ServerGroupTestJSON-2134213834 tempest-ServerGroupTestJSON-2134213834-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:06:04.605832 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-8a6378c6-d1f6-4e64-a8ac-6ced8958ad77 tempest-ServerGroupTestJSON-2134213834 tempest-ServerGroupTestJSON-2134213834-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:06:04.606503 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-8a6378c6-d1f6-4e64-a8ac-6ced8958ad77 tempest-ServerGroupTestJSON-2134213834 tempest-ServerGroupTestJSON-2134213834-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:06:04.624209 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.wsgi [None req-8a6378c6-d1f6-4e64-a8ac-6ced8958ad77 tempest-ServerGroupTestJSON-2134213834 tempest-ServerGroupTestJSON-2134213834-project] HTTP exception thrown: Instance 083a5a87-288b-48e0-8cda-d802774c372a could not be found. Nov 01 19:06:04.626420 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-8a6378c6-d1f6-4e64-a8ac-6ced8958ad77 tempest-ServerGroupTestJSON-2134213834 tempest-ServerGroupTestJSON-2134213834-project] Request method failure captured: Nov 01 19:06:04.626420 n-d-863052-2 devstack@n-api.service[121403]: request: GET /compute/v2.1/servers/083a5a87-288b-48e0-8cda-d802774c372a HTTP/1.1 Nov 01 19:06:04.626420 n-d-863052-2 devstack@n-api.service[121403]: Accept: application/json Nov 01 19:06:04.626420 n-d-863052-2 devstack@n-api.service[121403]: Accept-Encoding: identity Nov 01 19:06:04.626420 n-d-863052-2 devstack@n-api.service[121403]: Connection: close Nov 01 19:06:04.626420 n-d-863052-2 devstack@n-api.service[121403]: Content-Length: 0 Nov 01 19:06:04.626420 n-d-863052-2 devstack@n-api.service[121403]: Content-Type: application/json Nov 01 19:06:04.626420 n-d-863052-2 devstack@n-api.service[121403]: Host: 10.222.0.13 Nov 01 19:06:04.626420 n-d-863052-2 devstack@n-api.service[121403]: Openstack-System-Scope: None Nov 01 19:06:04.626420 n-d-863052-2 devstack@n-api.service[121403]: User-Agent: python-urllib3/1.26.12 Nov 01 19:06:04.626420 n-d-863052-2 devstack@n-api.service[121403]: X-Auth-Token: gAAAAABjYW3xEAnoJ5CDkbTdk4Yw5CxOFmyIN8TUXXhJfFxLKoEWyvxhCNBqFhhUWS831Si4d1MW8i6sV5Nb_tsg8WNO3jR17U2LC00uksL3QKQiq96omqm2q1EPdzvzu2k99iYLrDCEFm8ot_lvHXlTFST2p6oJVCpOKcVc-dcBOCdHBiIzOh4 Nov 01 19:06:04.626420 n-d-863052-2 devstack@n-api.service[121403]: X-Domain-Id: None Nov 01 19:06:04.626420 n-d-863052-2 devstack@n-api.service[121403]: X-Domain-Name: None Nov 01 19:06:04.626420 n-d-863052-2 devstack@n-api.service[121403]: X-Identity-Status: Confirmed Nov 01 19:06:04.626420 n-d-863052-2 devstack@n-api.service[121403]: X-Is-Admin-Project: True Nov 01 19:06:04.626420 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Domain-Id: default Nov 01 19:06:04.626420 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Domain-Name: Default Nov 01 19:06:04.626420 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Id: 6b6c42eec3544f3c820c0b0ce6f2f1f9 Nov 01 19:06:04.626420 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Name: tempest-ServerGroupTestJSON-2134213834 Nov 01 19:06:04.626420 n-d-863052-2 devstack@n-api.service[121403]: X-Role: member,reader Nov 01 19:06:04.626420 n-d-863052-2 devstack@n-api.service[121403]: X-Roles: member,reader Nov 01 19:06:04.626420 n-d-863052-2 devstack@n-api.service[121403]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/6b6c42eec3544f3c820c0b0ce6f2f1f9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/6b6c42eec3544f3c820c0b0ce6f2f1f9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_6b6c42eec3544f3c820c0b0ce6f2f1f9", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/6b6c42eec3544f3c820c0b0ce6f2f1f9"}]}] Nov 01 19:06:04.626420 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant: tempest-ServerGroupTestJSON-2134213834 Nov 01 19:06:04.626420 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant-Id: 6b6c42eec3544f3c820c0b0ce6f2f1f9 Nov 01 19:06:04.626420 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant-Name: tempest-ServerGroupTestJSON-2134213834 Nov 01 19:06:04.626420 n-d-863052-2 devstack@n-api.service[121403]: X-User: tempest-ServerGroupTestJSON-2134213834-project Nov 01 19:06:04.626420 n-d-863052-2 devstack@n-api.service[121403]: X-User-Domain-Id: default Nov 01 19:06:04.626420 n-d-863052-2 devstack@n-api.service[121403]: X-User-Domain-Name: Default Nov 01 19:06:04.626420 n-d-863052-2 devstack@n-api.service[121403]: X-User-Id: b0ef831ef96b4e5a983061fc8c7cf13d Nov 01 19:06:04.626420 n-d-863052-2 devstack@n-api.service[121403]: X-User-Name: tempest-ServerGroupTestJSON-2134213834-project Nov 01 19:06:04.626420 n-d-863052-2 devstack@n-api.service[121403]: method: > Nov 01 19:06:04.626420 n-d-863052-2 devstack@n-api.service[121403]: exception: Instance 083a5a87-288b-48e0-8cda-d802774c372a could not be found. Nov 01 19:06:04.626420 n-d-863052-2 devstack@n-api.service[121403]: action_args: {'id': '083a5a87-288b-48e0-8cda-d802774c372a'} Nov 01 19:06:04.626420 n-d-863052-2 devstack@n-api.service[121403]: {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 01 19:06:04.626420 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:06:04.626420 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 01 19:06:04.626420 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 01 19:06:04.626420 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 01 19:06:04.626420 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 01 19:06:04.626420 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 01 19:06:04.626420 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 01 19:06:04.626420 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 01 19:06:04.626420 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 01 19:06:04.626420 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 083a5a87-288b-48e0-8cda-d802774c372a could not be found. Nov 01 19:06:04.626420 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:06:04.626420 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:06:04.626420 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:06:04.626420 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:06:04.626420 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:06:04.626420 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:06:04.626420 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 01 19:06:04.626420 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 01 19:06:04.626420 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 01 19:06:04.626420 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 01 19:06:04.626420 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 01 19:06:04.626420 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 01 19:06:04.626420 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 01 19:06:04.626420 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 01 19:06:04.626420 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 01 19:06:04.626420 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 01 19:06:04.626420 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 083a5a87-288b-48e0-8cda-d802774c372a could not be found. Nov 01 19:06:04.626420 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:06:04.626420 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:06:04.626420 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:06:04.630257 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:06:04.630257 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:06:04.630257 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:06:04.630257 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 01 19:06:04.630257 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 01 19:06:04.630257 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 083a5a87-288b-48e0-8cda-d802774c372a could not be found. Nov 01 19:06:04.630257 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:06:04.647129 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-8a6378c6-d1f6-4e64-a8ac-6ced8958ad77 tempest-ServerGroupTestJSON-2134213834 tempest-ServerGroupTestJSON-2134213834-project] Returning 404 to user: Instance 083a5a87-288b-48e0-8cda-d802774c372a could not be found. {{(pid=121403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 01 19:06:04.650521 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-8a6378c6-d1f6-4e64-a8ac-6ced8958ad77 tempest-ServerGroupTestJSON-2134213834 tempest-ServerGroupTestJSON-2134213834-project] 10.222.0.13 "GET /compute/v2.1/servers/083a5a87-288b-48e0-8cda-d802774c372a" status: 404 len: 111 microversion: 2.1 time: 0.060887 Nov 01 19:06:04.652812 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1498/2942] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:06:04 2022] GET /compute/v2.1/servers/083a5a87-288b-48e0-8cda-d802774c372a => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 01 19:06:04.663149 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-1417db91-cff3-40a2-98d6-8d782a7470f8 tempest-ServerGroupTestJSON-2134213834 tempest-ServerGroupTestJSON-2134213834-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:06:04.676710 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.wsgi [None req-1417db91-cff3-40a2-98d6-8d782a7470f8 tempest-ServerGroupTestJSON-2134213834 tempest-ServerGroupTestJSON-2134213834-project] HTTP exception thrown: Instance group d2ba106f-49ea-431e-8b20-b7c8d4d49353 could not be found. Nov 01 19:06:04.688348 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-1417db91-cff3-40a2-98d6-8d782a7470f8 tempest-ServerGroupTestJSON-2134213834 tempest-ServerGroupTestJSON-2134213834-project] Request method failure captured: Nov 01 19:06:04.688348 n-d-863052-2 devstack@n-api.service[121403]: request: DELETE /compute/v2.1/os-server-groups/d2ba106f-49ea-431e-8b20-b7c8d4d49353 HTTP/1.1 Nov 01 19:06:04.688348 n-d-863052-2 devstack@n-api.service[121403]: Accept: application/json Nov 01 19:06:04.688348 n-d-863052-2 devstack@n-api.service[121403]: Accept-Encoding: identity Nov 01 19:06:04.688348 n-d-863052-2 devstack@n-api.service[121403]: Connection: close Nov 01 19:06:04.688348 n-d-863052-2 devstack@n-api.service[121403]: Content-Length: 0 Nov 01 19:06:04.688348 n-d-863052-2 devstack@n-api.service[121403]: Content-Type: application/json Nov 01 19:06:04.688348 n-d-863052-2 devstack@n-api.service[121403]: Host: 10.222.0.13 Nov 01 19:06:04.688348 n-d-863052-2 devstack@n-api.service[121403]: Openstack-System-Scope: None Nov 01 19:06:04.688348 n-d-863052-2 devstack@n-api.service[121403]: User-Agent: python-urllib3/1.26.12 Nov 01 19:06:04.688348 n-d-863052-2 devstack@n-api.service[121403]: X-Auth-Token: gAAAAABjYW3xEAnoJ5CDkbTdk4Yw5CxOFmyIN8TUXXhJfFxLKoEWyvxhCNBqFhhUWS831Si4d1MW8i6sV5Nb_tsg8WNO3jR17U2LC00uksL3QKQiq96omqm2q1EPdzvzu2k99iYLrDCEFm8ot_lvHXlTFST2p6oJVCpOKcVc-dcBOCdHBiIzOh4 Nov 01 19:06:04.688348 n-d-863052-2 devstack@n-api.service[121403]: X-Domain-Id: None Nov 01 19:06:04.688348 n-d-863052-2 devstack@n-api.service[121403]: X-Domain-Name: None Nov 01 19:06:04.688348 n-d-863052-2 devstack@n-api.service[121403]: X-Identity-Status: Confirmed Nov 01 19:06:04.688348 n-d-863052-2 devstack@n-api.service[121403]: X-Is-Admin-Project: True Nov 01 19:06:04.688348 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Domain-Id: default Nov 01 19:06:04.688348 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Domain-Name: Default Nov 01 19:06:04.688348 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Id: 6b6c42eec3544f3c820c0b0ce6f2f1f9 Nov 01 19:06:04.688348 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Name: tempest-ServerGroupTestJSON-2134213834 Nov 01 19:06:04.688348 n-d-863052-2 devstack@n-api.service[121403]: X-Role: member,reader Nov 01 19:06:04.688348 n-d-863052-2 devstack@n-api.service[121403]: X-Roles: member,reader Nov 01 19:06:04.688348 n-d-863052-2 devstack@n-api.service[121403]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/6b6c42eec3544f3c820c0b0ce6f2f1f9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/6b6c42eec3544f3c820c0b0ce6f2f1f9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_6b6c42eec3544f3c820c0b0ce6f2f1f9", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/6b6c42eec3544f3c820c0b0ce6f2f1f9"}]}] Nov 01 19:06:04.688348 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant: tempest-ServerGroupTestJSON-2134213834 Nov 01 19:06:04.688348 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant-Id: 6b6c42eec3544f3c820c0b0ce6f2f1f9 Nov 01 19:06:04.688348 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant-Name: tempest-ServerGroupTestJSON-2134213834 Nov 01 19:06:04.688348 n-d-863052-2 devstack@n-api.service[121403]: X-User: tempest-ServerGroupTestJSON-2134213834-project Nov 01 19:06:04.688348 n-d-863052-2 devstack@n-api.service[121403]: X-User-Domain-Id: default Nov 01 19:06:04.688348 n-d-863052-2 devstack@n-api.service[121403]: X-User-Domain-Name: Default Nov 01 19:06:04.688348 n-d-863052-2 devstack@n-api.service[121403]: X-User-Id: b0ef831ef96b4e5a983061fc8c7cf13d Nov 01 19:06:04.688348 n-d-863052-2 devstack@n-api.service[121403]: X-User-Name: tempest-ServerGroupTestJSON-2134213834-project Nov 01 19:06:04.688348 n-d-863052-2 devstack@n-api.service[121403]: method: > Nov 01 19:06:04.688348 n-d-863052-2 devstack@n-api.service[121403]: exception: Instance group d2ba106f-49ea-431e-8b20-b7c8d4d49353 could not be found. Nov 01 19:06:04.688348 n-d-863052-2 devstack@n-api.service[121403]: action_args: {'id': 'd2ba106f-49ea-431e-8b20-b7c8d4d49353'} Nov 01 19:06:04.688348 n-d-863052-2 devstack@n-api.service[121403]: {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 01 19:06:04.688348 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:06:04.688348 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Nov 01 19:06:04.688348 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Nov 01 19:06:04.688348 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 01 19:06:04.688348 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 01 19:06:04.688348 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Nov 01 19:06:04.688348 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Nov 01 19:06:04.688348 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Nov 01 19:06:04.688348 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Nov 01 19:06:04.688348 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Nov 01 19:06:04.688348 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Nov 01 19:06:04.688348 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group d2ba106f-49ea-431e-8b20-b7c8d4d49353 could not be found. Nov 01 19:06:04.688348 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:06:04.688348 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:06:04.688348 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:06:04.688348 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:06:04.688348 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:06:04.688348 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:06:04.688348 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 01 19:06:04.688348 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 01 19:06:04.688348 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 01 19:06:04.688348 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 01 19:06:04.688348 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Nov 01 19:06:04.688348 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Nov 01 19:06:04.688348 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group d2ba106f-49ea-431e-8b20-b7c8d4d49353 could not be found. Nov 01 19:06:04.688348 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:06:04.688348 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:06:04.688348 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:06:04.688348 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:06:04.692492 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:06:04.692492 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:06:04.692492 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 01 19:06:04.692492 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 01 19:06:04.692492 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group d2ba106f-49ea-431e-8b20-b7c8d4d49353 could not be found. Nov 01 19:06:04.692492 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:06:04.697476 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-1417db91-cff3-40a2-98d6-8d782a7470f8 tempest-ServerGroupTestJSON-2134213834 tempest-ServerGroupTestJSON-2134213834-project] Returning 404 to user: Instance group d2ba106f-49ea-431e-8b20-b7c8d4d49353 could not be found. {{(pid=121403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 01 19:06:04.698598 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-1417db91-cff3-40a2-98d6-8d782a7470f8 tempest-ServerGroupTestJSON-2134213834 tempest-ServerGroupTestJSON-2134213834-project] 10.222.0.13 "DELETE /compute/v2.1/os-server-groups/d2ba106f-49ea-431e-8b20-b7c8d4d49353" status: 404 len: 117 microversion: 2.1 time: 0.040537 Nov 01 19:06:04.699711 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1499/2943] 10.222.0.13 () {58 vars in 1266 bytes} [Tue Nov 1 19:06:04 2022] DELETE /compute/v2.1/os-server-groups/d2ba106f-49ea-431e-8b20-b7c8d4d49353 => generated 117 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 01 19:06:04.709949 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-78e11b56-4da6-4594-82c7-0173a4d9c476 tempest-ServerGroupTestJSON-2134213834 tempest-ServerGroupTestJSON-2134213834-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:06:04.729590 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.wsgi [None req-78e11b56-4da6-4594-82c7-0173a4d9c476 tempest-ServerGroupTestJSON-2134213834 tempest-ServerGroupTestJSON-2134213834-project] HTTP exception thrown: Instance group e893833d-69d6-43ee-ab33-162c45a738b5 could not be found. Nov 01 19:06:04.731198 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-78e11b56-4da6-4594-82c7-0173a4d9c476 tempest-ServerGroupTestJSON-2134213834 tempest-ServerGroupTestJSON-2134213834-project] Request method failure captured: Nov 01 19:06:04.731198 n-d-863052-2 devstack@n-api.service[121403]: request: DELETE /compute/v2.1/os-server-groups/e893833d-69d6-43ee-ab33-162c45a738b5 HTTP/1.1 Nov 01 19:06:04.731198 n-d-863052-2 devstack@n-api.service[121403]: Accept: application/json Nov 01 19:06:04.731198 n-d-863052-2 devstack@n-api.service[121403]: Accept-Encoding: identity Nov 01 19:06:04.731198 n-d-863052-2 devstack@n-api.service[121403]: Connection: close Nov 01 19:06:04.731198 n-d-863052-2 devstack@n-api.service[121403]: Content-Length: 0 Nov 01 19:06:04.731198 n-d-863052-2 devstack@n-api.service[121403]: Content-Type: application/json Nov 01 19:06:04.731198 n-d-863052-2 devstack@n-api.service[121403]: Host: 10.222.0.13 Nov 01 19:06:04.731198 n-d-863052-2 devstack@n-api.service[121403]: Openstack-System-Scope: None Nov 01 19:06:04.731198 n-d-863052-2 devstack@n-api.service[121403]: User-Agent: python-urllib3/1.26.12 Nov 01 19:06:04.731198 n-d-863052-2 devstack@n-api.service[121403]: X-Auth-Token: gAAAAABjYW3xEAnoJ5CDkbTdk4Yw5CxOFmyIN8TUXXhJfFxLKoEWyvxhCNBqFhhUWS831Si4d1MW8i6sV5Nb_tsg8WNO3jR17U2LC00uksL3QKQiq96omqm2q1EPdzvzu2k99iYLrDCEFm8ot_lvHXlTFST2p6oJVCpOKcVc-dcBOCdHBiIzOh4 Nov 01 19:06:04.731198 n-d-863052-2 devstack@n-api.service[121403]: X-Domain-Id: None Nov 01 19:06:04.731198 n-d-863052-2 devstack@n-api.service[121403]: X-Domain-Name: None Nov 01 19:06:04.731198 n-d-863052-2 devstack@n-api.service[121403]: X-Identity-Status: Confirmed Nov 01 19:06:04.731198 n-d-863052-2 devstack@n-api.service[121403]: X-Is-Admin-Project: True Nov 01 19:06:04.731198 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Domain-Id: default Nov 01 19:06:04.731198 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Domain-Name: Default Nov 01 19:06:04.731198 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Id: 6b6c42eec3544f3c820c0b0ce6f2f1f9 Nov 01 19:06:04.731198 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Name: tempest-ServerGroupTestJSON-2134213834 Nov 01 19:06:04.731198 n-d-863052-2 devstack@n-api.service[121403]: X-Role: member,reader Nov 01 19:06:04.731198 n-d-863052-2 devstack@n-api.service[121403]: X-Roles: member,reader Nov 01 19:06:04.731198 n-d-863052-2 devstack@n-api.service[121403]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/6b6c42eec3544f3c820c0b0ce6f2f1f9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/6b6c42eec3544f3c820c0b0ce6f2f1f9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_6b6c42eec3544f3c820c0b0ce6f2f1f9", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/6b6c42eec3544f3c820c0b0ce6f2f1f9"}]}] Nov 01 19:06:04.731198 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant: tempest-ServerGroupTestJSON-2134213834 Nov 01 19:06:04.731198 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant-Id: 6b6c42eec3544f3c820c0b0ce6f2f1f9 Nov 01 19:06:04.731198 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant-Name: tempest-ServerGroupTestJSON-2134213834 Nov 01 19:06:04.731198 n-d-863052-2 devstack@n-api.service[121403]: X-User: tempest-ServerGroupTestJSON-2134213834-project Nov 01 19:06:04.731198 n-d-863052-2 devstack@n-api.service[121403]: X-User-Domain-Id: default Nov 01 19:06:04.731198 n-d-863052-2 devstack@n-api.service[121403]: X-User-Domain-Name: Default Nov 01 19:06:04.731198 n-d-863052-2 devstack@n-api.service[121403]: X-User-Id: b0ef831ef96b4e5a983061fc8c7cf13d Nov 01 19:06:04.731198 n-d-863052-2 devstack@n-api.service[121403]: X-User-Name: tempest-ServerGroupTestJSON-2134213834-project Nov 01 19:06:04.731198 n-d-863052-2 devstack@n-api.service[121403]: method: > Nov 01 19:06:04.731198 n-d-863052-2 devstack@n-api.service[121403]: exception: Instance group e893833d-69d6-43ee-ab33-162c45a738b5 could not be found. Nov 01 19:06:04.731198 n-d-863052-2 devstack@n-api.service[121403]: action_args: {'id': 'e893833d-69d6-43ee-ab33-162c45a738b5'} Nov 01 19:06:04.731198 n-d-863052-2 devstack@n-api.service[121403]: {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 01 19:06:04.731198 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:06:04.731198 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Nov 01 19:06:04.731198 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Nov 01 19:06:04.731198 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 01 19:06:04.731198 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 01 19:06:04.731198 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Nov 01 19:06:04.731198 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Nov 01 19:06:04.731198 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Nov 01 19:06:04.731198 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Nov 01 19:06:04.731198 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Nov 01 19:06:04.731198 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Nov 01 19:06:04.731198 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group e893833d-69d6-43ee-ab33-162c45a738b5 could not be found. Nov 01 19:06:04.731198 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:06:04.731198 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:06:04.731198 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:06:04.731198 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:06:04.731198 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:06:04.731198 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:06:04.731198 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 01 19:06:04.731198 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 01 19:06:04.731198 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 01 19:06:04.731198 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 01 19:06:04.731198 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Nov 01 19:06:04.731198 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Nov 01 19:06:04.731198 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group e893833d-69d6-43ee-ab33-162c45a738b5 could not be found. Nov 01 19:06:04.731198 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:06:04.731198 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:06:04.731198 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:06:04.731198 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:06:04.735720 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:06:04.735720 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:06:04.735720 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 01 19:06:04.735720 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 01 19:06:04.735720 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group e893833d-69d6-43ee-ab33-162c45a738b5 could not be found. Nov 01 19:06:04.735720 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:06:04.736081 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-78e11b56-4da6-4594-82c7-0173a4d9c476 tempest-ServerGroupTestJSON-2134213834 tempest-ServerGroupTestJSON-2134213834-project] Returning 404 to user: Instance group e893833d-69d6-43ee-ab33-162c45a738b5 could not be found. {{(pid=121403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 01 19:06:04.737048 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-78e11b56-4da6-4594-82c7-0173a4d9c476 tempest-ServerGroupTestJSON-2134213834 tempest-ServerGroupTestJSON-2134213834-project] 10.222.0.13 "DELETE /compute/v2.1/os-server-groups/e893833d-69d6-43ee-ab33-162c45a738b5" status: 404 len: 117 microversion: 2.1 time: 0.031630 Nov 01 19:06:04.744344 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1500/2944] 10.222.0.13 () {58 vars in 1266 bytes} [Tue Nov 1 19:06:04 2022] DELETE /compute/v2.1/os-server-groups/e893833d-69d6-43ee-ab33-162c45a738b5 => generated 117 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 01 19:06:04.749624 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-b7c40af1-eab7-49bf-b2ee-1e86ca6b64d2 tempest-ServerGroupTestJSON-2134213834 tempest-ServerGroupTestJSON-2134213834-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:06:04.766989 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.wsgi [None req-b7c40af1-eab7-49bf-b2ee-1e86ca6b64d2 tempest-ServerGroupTestJSON-2134213834 tempest-ServerGroupTestJSON-2134213834-project] HTTP exception thrown: Instance group a2a13889-6b5d-42d0-ac8c-866c6c092080 could not be found. Nov 01 19:06:04.768953 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-b7c40af1-eab7-49bf-b2ee-1e86ca6b64d2 tempest-ServerGroupTestJSON-2134213834 tempest-ServerGroupTestJSON-2134213834-project] Request method failure captured: Nov 01 19:06:04.768953 n-d-863052-2 devstack@n-api.service[121403]: request: DELETE /compute/v2.1/os-server-groups/a2a13889-6b5d-42d0-ac8c-866c6c092080 HTTP/1.1 Nov 01 19:06:04.768953 n-d-863052-2 devstack@n-api.service[121403]: Accept: application/json Nov 01 19:06:04.768953 n-d-863052-2 devstack@n-api.service[121403]: Accept-Encoding: identity Nov 01 19:06:04.768953 n-d-863052-2 devstack@n-api.service[121403]: Connection: close Nov 01 19:06:04.768953 n-d-863052-2 devstack@n-api.service[121403]: Content-Length: 0 Nov 01 19:06:04.768953 n-d-863052-2 devstack@n-api.service[121403]: Content-Type: application/json Nov 01 19:06:04.768953 n-d-863052-2 devstack@n-api.service[121403]: Host: 10.222.0.13 Nov 01 19:06:04.768953 n-d-863052-2 devstack@n-api.service[121403]: Openstack-System-Scope: None Nov 01 19:06:04.768953 n-d-863052-2 devstack@n-api.service[121403]: User-Agent: python-urllib3/1.26.12 Nov 01 19:06:04.768953 n-d-863052-2 devstack@n-api.service[121403]: X-Auth-Token: gAAAAABjYW3xEAnoJ5CDkbTdk4Yw5CxOFmyIN8TUXXhJfFxLKoEWyvxhCNBqFhhUWS831Si4d1MW8i6sV5Nb_tsg8WNO3jR17U2LC00uksL3QKQiq96omqm2q1EPdzvzu2k99iYLrDCEFm8ot_lvHXlTFST2p6oJVCpOKcVc-dcBOCdHBiIzOh4 Nov 01 19:06:04.768953 n-d-863052-2 devstack@n-api.service[121403]: X-Domain-Id: None Nov 01 19:06:04.768953 n-d-863052-2 devstack@n-api.service[121403]: X-Domain-Name: None Nov 01 19:06:04.768953 n-d-863052-2 devstack@n-api.service[121403]: X-Identity-Status: Confirmed Nov 01 19:06:04.768953 n-d-863052-2 devstack@n-api.service[121403]: X-Is-Admin-Project: True Nov 01 19:06:04.768953 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Domain-Id: default Nov 01 19:06:04.768953 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Domain-Name: Default Nov 01 19:06:04.768953 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Id: 6b6c42eec3544f3c820c0b0ce6f2f1f9 Nov 01 19:06:04.768953 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Name: tempest-ServerGroupTestJSON-2134213834 Nov 01 19:06:04.768953 n-d-863052-2 devstack@n-api.service[121403]: X-Role: member,reader Nov 01 19:06:04.768953 n-d-863052-2 devstack@n-api.service[121403]: X-Roles: member,reader Nov 01 19:06:04.768953 n-d-863052-2 devstack@n-api.service[121403]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/6b6c42eec3544f3c820c0b0ce6f2f1f9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/6b6c42eec3544f3c820c0b0ce6f2f1f9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_6b6c42eec3544f3c820c0b0ce6f2f1f9", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/6b6c42eec3544f3c820c0b0ce6f2f1f9"}]}] Nov 01 19:06:04.768953 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant: tempest-ServerGroupTestJSON-2134213834 Nov 01 19:06:04.768953 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant-Id: 6b6c42eec3544f3c820c0b0ce6f2f1f9 Nov 01 19:06:04.768953 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant-Name: tempest-ServerGroupTestJSON-2134213834 Nov 01 19:06:04.768953 n-d-863052-2 devstack@n-api.service[121403]: X-User: tempest-ServerGroupTestJSON-2134213834-project Nov 01 19:06:04.768953 n-d-863052-2 devstack@n-api.service[121403]: X-User-Domain-Id: default Nov 01 19:06:04.768953 n-d-863052-2 devstack@n-api.service[121403]: X-User-Domain-Name: Default Nov 01 19:06:04.768953 n-d-863052-2 devstack@n-api.service[121403]: X-User-Id: b0ef831ef96b4e5a983061fc8c7cf13d Nov 01 19:06:04.768953 n-d-863052-2 devstack@n-api.service[121403]: X-User-Name: tempest-ServerGroupTestJSON-2134213834-project Nov 01 19:06:04.768953 n-d-863052-2 devstack@n-api.service[121403]: method: > Nov 01 19:06:04.768953 n-d-863052-2 devstack@n-api.service[121403]: exception: Instance group a2a13889-6b5d-42d0-ac8c-866c6c092080 could not be found. Nov 01 19:06:04.768953 n-d-863052-2 devstack@n-api.service[121403]: action_args: {'id': 'a2a13889-6b5d-42d0-ac8c-866c6c092080'} Nov 01 19:06:04.768953 n-d-863052-2 devstack@n-api.service[121403]: {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 01 19:06:04.768953 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:06:04.768953 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Nov 01 19:06:04.768953 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Nov 01 19:06:04.768953 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 01 19:06:04.768953 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 01 19:06:04.768953 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Nov 01 19:06:04.768953 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Nov 01 19:06:04.768953 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Nov 01 19:06:04.768953 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Nov 01 19:06:04.768953 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Nov 01 19:06:04.768953 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Nov 01 19:06:04.768953 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group a2a13889-6b5d-42d0-ac8c-866c6c092080 could not be found. Nov 01 19:06:04.768953 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:06:04.768953 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:06:04.768953 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:06:04.768953 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:06:04.768953 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:06:04.768953 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:06:04.768953 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 01 19:06:04.768953 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 01 19:06:04.768953 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 01 19:06:04.768953 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 01 19:06:04.768953 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Nov 01 19:06:04.768953 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Nov 01 19:06:04.768953 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group a2a13889-6b5d-42d0-ac8c-866c6c092080 could not be found. Nov 01 19:06:04.768953 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:06:04.768953 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:06:04.768953 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:06:04.768953 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:06:04.774324 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:06:04.774324 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:06:04.774324 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 01 19:06:04.774324 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 01 19:06:04.774324 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group a2a13889-6b5d-42d0-ac8c-866c6c092080 could not be found. Nov 01 19:06:04.774324 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:06:04.775176 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-b7c40af1-eab7-49bf-b2ee-1e86ca6b64d2 tempest-ServerGroupTestJSON-2134213834 tempest-ServerGroupTestJSON-2134213834-project] Returning 404 to user: Instance group a2a13889-6b5d-42d0-ac8c-866c6c092080 could not be found. {{(pid=121403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 01 19:06:04.775602 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-b7c40af1-eab7-49bf-b2ee-1e86ca6b64d2 tempest-ServerGroupTestJSON-2134213834 tempest-ServerGroupTestJSON-2134213834-project] 10.222.0.13 "DELETE /compute/v2.1/os-server-groups/a2a13889-6b5d-42d0-ac8c-866c6c092080" status: 404 len: 117 microversion: 2.1 time: 0.029973 Nov 01 19:06:04.778105 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1501/2945] 10.222.0.13 () {58 vars in 1266 bytes} [Tue Nov 1 19:06:04 2022] DELETE /compute/v2.1/os-server-groups/a2a13889-6b5d-42d0-ac8c-866c6c092080 => generated 117 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 01 19:06:04.798663 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-710afe6b-a997-49eb-841a-43318c7c4cc9 tempest-ServerGroupTestJSON-2134213834 tempest-ServerGroupTestJSON-2134213834-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:06:04.816935 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.wsgi [None req-710afe6b-a997-49eb-841a-43318c7c4cc9 tempest-ServerGroupTestJSON-2134213834 tempest-ServerGroupTestJSON-2134213834-project] HTTP exception thrown: Instance group b4fe75e0-0209-4676-bc7e-5fc9018514a8 could not be found. Nov 01 19:06:04.819005 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-710afe6b-a997-49eb-841a-43318c7c4cc9 tempest-ServerGroupTestJSON-2134213834 tempest-ServerGroupTestJSON-2134213834-project] Request method failure captured: Nov 01 19:06:04.819005 n-d-863052-2 devstack@n-api.service[121403]: request: DELETE /compute/v2.1/os-server-groups/b4fe75e0-0209-4676-bc7e-5fc9018514a8 HTTP/1.1 Nov 01 19:06:04.819005 n-d-863052-2 devstack@n-api.service[121403]: Accept: application/json Nov 01 19:06:04.819005 n-d-863052-2 devstack@n-api.service[121403]: Accept-Encoding: identity Nov 01 19:06:04.819005 n-d-863052-2 devstack@n-api.service[121403]: Connection: close Nov 01 19:06:04.819005 n-d-863052-2 devstack@n-api.service[121403]: Content-Length: 0 Nov 01 19:06:04.819005 n-d-863052-2 devstack@n-api.service[121403]: Content-Type: application/json Nov 01 19:06:04.819005 n-d-863052-2 devstack@n-api.service[121403]: Host: 10.222.0.13 Nov 01 19:06:04.819005 n-d-863052-2 devstack@n-api.service[121403]: Openstack-System-Scope: None Nov 01 19:06:04.819005 n-d-863052-2 devstack@n-api.service[121403]: User-Agent: python-urllib3/1.26.12 Nov 01 19:06:04.819005 n-d-863052-2 devstack@n-api.service[121403]: X-Auth-Token: gAAAAABjYW3xEAnoJ5CDkbTdk4Yw5CxOFmyIN8TUXXhJfFxLKoEWyvxhCNBqFhhUWS831Si4d1MW8i6sV5Nb_tsg8WNO3jR17U2LC00uksL3QKQiq96omqm2q1EPdzvzu2k99iYLrDCEFm8ot_lvHXlTFST2p6oJVCpOKcVc-dcBOCdHBiIzOh4 Nov 01 19:06:04.819005 n-d-863052-2 devstack@n-api.service[121403]: X-Domain-Id: None Nov 01 19:06:04.819005 n-d-863052-2 devstack@n-api.service[121403]: X-Domain-Name: None Nov 01 19:06:04.819005 n-d-863052-2 devstack@n-api.service[121403]: X-Identity-Status: Confirmed Nov 01 19:06:04.819005 n-d-863052-2 devstack@n-api.service[121403]: X-Is-Admin-Project: True Nov 01 19:06:04.819005 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Domain-Id: default Nov 01 19:06:04.819005 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Domain-Name: Default Nov 01 19:06:04.819005 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Id: 6b6c42eec3544f3c820c0b0ce6f2f1f9 Nov 01 19:06:04.819005 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Name: tempest-ServerGroupTestJSON-2134213834 Nov 01 19:06:04.819005 n-d-863052-2 devstack@n-api.service[121403]: X-Role: member,reader Nov 01 19:06:04.819005 n-d-863052-2 devstack@n-api.service[121403]: X-Roles: member,reader Nov 01 19:06:04.819005 n-d-863052-2 devstack@n-api.service[121403]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/6b6c42eec3544f3c820c0b0ce6f2f1f9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/6b6c42eec3544f3c820c0b0ce6f2f1f9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_6b6c42eec3544f3c820c0b0ce6f2f1f9", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/6b6c42eec3544f3c820c0b0ce6f2f1f9"}]}] Nov 01 19:06:04.819005 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant: tempest-ServerGroupTestJSON-2134213834 Nov 01 19:06:04.819005 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant-Id: 6b6c42eec3544f3c820c0b0ce6f2f1f9 Nov 01 19:06:04.819005 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant-Name: tempest-ServerGroupTestJSON-2134213834 Nov 01 19:06:04.819005 n-d-863052-2 devstack@n-api.service[121403]: X-User: tempest-ServerGroupTestJSON-2134213834-project Nov 01 19:06:04.819005 n-d-863052-2 devstack@n-api.service[121403]: X-User-Domain-Id: default Nov 01 19:06:04.819005 n-d-863052-2 devstack@n-api.service[121403]: X-User-Domain-Name: Default Nov 01 19:06:04.819005 n-d-863052-2 devstack@n-api.service[121403]: X-User-Id: b0ef831ef96b4e5a983061fc8c7cf13d Nov 01 19:06:04.819005 n-d-863052-2 devstack@n-api.service[121403]: X-User-Name: tempest-ServerGroupTestJSON-2134213834-project Nov 01 19:06:04.819005 n-d-863052-2 devstack@n-api.service[121403]: method: > Nov 01 19:06:04.819005 n-d-863052-2 devstack@n-api.service[121403]: exception: Instance group b4fe75e0-0209-4676-bc7e-5fc9018514a8 could not be found. Nov 01 19:06:04.819005 n-d-863052-2 devstack@n-api.service[121403]: action_args: {'id': 'b4fe75e0-0209-4676-bc7e-5fc9018514a8'} Nov 01 19:06:04.819005 n-d-863052-2 devstack@n-api.service[121403]: {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 01 19:06:04.819005 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:06:04.819005 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Nov 01 19:06:04.819005 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Nov 01 19:06:04.819005 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 01 19:06:04.819005 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 01 19:06:04.819005 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Nov 01 19:06:04.819005 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Nov 01 19:06:04.819005 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Nov 01 19:06:04.819005 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Nov 01 19:06:04.819005 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Nov 01 19:06:04.819005 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Nov 01 19:06:04.819005 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group b4fe75e0-0209-4676-bc7e-5fc9018514a8 could not be found. Nov 01 19:06:04.819005 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:06:04.819005 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:06:04.819005 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:06:04.819005 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:06:04.819005 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:06:04.819005 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:06:04.819005 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 01 19:06:04.819005 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 01 19:06:04.819005 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 01 19:06:04.819005 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 01 19:06:04.819005 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Nov 01 19:06:04.819005 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Nov 01 19:06:04.819005 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group b4fe75e0-0209-4676-bc7e-5fc9018514a8 could not be found. Nov 01 19:06:04.819005 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:06:04.819005 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:06:04.819005 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:06:04.819005 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:06:04.822869 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:06:04.822869 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:06:04.822869 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 01 19:06:04.822869 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 01 19:06:04.822869 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group b4fe75e0-0209-4676-bc7e-5fc9018514a8 could not be found. Nov 01 19:06:04.822869 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:06:04.827506 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-710afe6b-a997-49eb-841a-43318c7c4cc9 tempest-ServerGroupTestJSON-2134213834 tempest-ServerGroupTestJSON-2134213834-project] Returning 404 to user: Instance group b4fe75e0-0209-4676-bc7e-5fc9018514a8 could not be found. {{(pid=121403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 01 19:06:04.828670 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-710afe6b-a997-49eb-841a-43318c7c4cc9 tempest-ServerGroupTestJSON-2134213834 tempest-ServerGroupTestJSON-2134213834-project] 10.222.0.13 "DELETE /compute/v2.1/os-server-groups/b4fe75e0-0209-4676-bc7e-5fc9018514a8" status: 404 len: 117 microversion: 2.1 time: 0.045120 Nov 01 19:06:04.829526 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1502/2946] 10.222.0.13 () {58 vars in 1266 bytes} [Tue Nov 1 19:06:04 2022] DELETE /compute/v2.1/os-server-groups/b4fe75e0-0209-4676-bc7e-5fc9018514a8 => generated 117 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 01 19:06:04.843991 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-fcb0d651-1182-4a09-b415-cc8452207aef tempest-ServerGroupTestJSON-2134213834 tempest-ServerGroupTestJSON-2134213834-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:06:04.891932 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-fcb0d651-1182-4a09-b415-cc8452207aef tempest-ServerGroupTestJSON-2134213834 tempest-ServerGroupTestJSON-2134213834-project] 10.222.0.13 "DELETE /compute/v2.1/os-server-groups/39db9570-eff7-4e8a-acae-6e2d59add751" status: 204 len: 0 microversion: 2.1 time: 0.057612 Nov 01 19:06:04.896603 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1503/2947] 10.222.0.13 () {58 vars in 1266 bytes} [Tue Nov 1 19:06:04 2022] DELETE /compute/v2.1/os-server-groups/39db9570-eff7-4e8a-acae-6e2d59add751 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 01 19:06:04.997305 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [req-14fa83f9-7f9d-4785-b697-104d870ce936 req-45a5b776-99b0-4a98-b61b-d90b2b7c74c9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "af1071a8-a090-44c9-890c-123ca3ff39f1", "tag": "b02cdf3d-b259-4361-af25-d77a93946fa4"}]} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:06:05.027238 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-14fa83f9-7f9d-4785-b697-104d870ce936 req-45a5b776-99b0-4a98-b61b-d90b2b7c74c9 service nova] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:06:05.028057 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-14fa83f9-7f9d-4785-b697-104d870ce936 req-45a5b776-99b0-4a98-b61b-d90b2b7c74c9 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:06:05.031012 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-14fa83f9-7f9d-4785-b697-104d870ce936 req-45a5b776-99b0-4a98-b61b-d90b2b7c74c9 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:06:05.059719 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.compute.server_external_events [req-14fa83f9-7f9d-4785-b697-104d870ce936 req-45a5b776-99b0-4a98-b61b-d90b2b7c74c9 service nova] Creating event network-changed:b02cdf3d-b259-4361-af25-d77a93946fa4 for instance af1071a8-a090-44c9-890c-123ca3ff39f1 on n-h2-863052-2 Nov 01 19:06:05.076632 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [req-14fa83f9-7f9d-4785-b697-104d870ce936 req-45a5b776-99b0-4a98-b61b-d90b2b7c74c9 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083109 Nov 01 19:06:05.092671 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1504/2948] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Nov 1 19:06:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 01 19:06:05.262245 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-428fb5ab-fd8c-4c15-90c3-748244438878 tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb87e6147a6f470391921ac3b7a62f8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6511ea24c4c19a7c5d91535c7288d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:06:05.277525 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-428fb5ab-fd8c-4c15-90c3-748244438878 tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] 10.222.0.13 "GET /compute/v2.1/servers/86162175-5f45-4aa7-9825-f1a3b4a699ff" status: 200 len: 1323 microversion: 2.1 time: 0.754305 Nov 01 19:06:05.297769 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1445/2949] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:06:04 2022] GET /compute/v2.1/servers/86162175-5f45-4aa7-9825-f1a3b4a699ff => generated 1323 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:06:05.444025 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-6f12025d-d657-4a52-8965-4069730a6bce tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:06:05.445372 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-6f12025d-d657-4a52-8965-4069730a6bce tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] [instance: af1071a8-a090-44c9-890c-123ca3ff39f1] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:06:05.467010 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-6f12025d-d657-4a52-8965-4069730a6bce tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:06:05.469194 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-6f12025d-d657-4a52-8965-4069730a6bce tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:06:05.470467 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-6f12025d-d657-4a52-8965-4069730a6bce tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:06:05.473466 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-6f12025d-d657-4a52-8965-4069730a6bce tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:06:05.476814 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-6f12025d-d657-4a52-8965-4069730a6bce tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:06:05.478862 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-6f12025d-d657-4a52-8965-4069730a6bce tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:06:05.536471 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-5ae1779d-9d5f-4f04-a1a3-3d104d7ce5dc tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:06:05.542559 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-5ae1779d-9d5f-4f04-a1a3-3d104d7ce5dc tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] [instance: 0b57b50d-1ec4-4ee1-ac3a-f6f44d68a2c3] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:06:05.572169 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-5ae1779d-9d5f-4f04-a1a3-3d104d7ce5dc tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:06:05.574559 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-5ae1779d-9d5f-4f04-a1a3-3d104d7ce5dc tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:06:05.577170 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-5ae1779d-9d5f-4f04-a1a3-3d104d7ce5dc tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:06:05.577930 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-5ae1779d-9d5f-4f04-a1a3-3d104d7ce5dc tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:06:05.582217 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-5ae1779d-9d5f-4f04-a1a3-3d104d7ce5dc tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:06:05.585281 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-5ae1779d-9d5f-4f04-a1a3-3d104d7ce5dc tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:06:05.945556 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-6f12025d-d657-4a52-8965-4069730a6bce tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '301ed3b9c37449bc9ade378f3c73a768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8807757227574c828dca1947af76659d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:06:05.962232 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-6f12025d-d657-4a52-8965-4069730a6bce tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '301ed3b9c37449bc9ade378f3c73a768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8807757227574c828dca1947af76659d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:06:05.968259 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-6f12025d-d657-4a52-8965-4069730a6bce tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '301ed3b9c37449bc9ade378f3c73a768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8807757227574c828dca1947af76659d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:06:05.975396 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-6f12025d-d657-4a52-8965-4069730a6bce tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] 10.222.0.13 "GET /compute/v2.1/servers/af1071a8-a090-44c9-890c-123ca3ff39f1" status: 200 len: 1892 microversion: 2.42 time: 0.532863 Nov 01 19:06:05.977943 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1505/2950] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 19:06:05 2022] GET /compute/v2.1/servers/af1071a8-a090-44c9-890c-123ca3ff39f1 => generated 1892 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 19:06:05.989986 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-ed3a5fb9-ac26-492b-b3fa-9bf43c36f702 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:06:05.998909 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-ed3a5fb9-ac26-492b-b3fa-9bf43c36f702 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] [instance: ba6ffc5c-84a4-40f1-bdc7-f87dde2c99df] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:06:06.012507 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-ed3a5fb9-ac26-492b-b3fa-9bf43c36f702 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:06:06.016884 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-ed3a5fb9-ac26-492b-b3fa-9bf43c36f702 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:06:06.020381 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-ed3a5fb9-ac26-492b-b3fa-9bf43c36f702 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:06:06.021333 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-ed3a5fb9-ac26-492b-b3fa-9bf43c36f702 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:06:06.023789 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-ed3a5fb9-ac26-492b-b3fa-9bf43c36f702 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:06:06.026341 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-ed3a5fb9-ac26-492b-b3fa-9bf43c36f702 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:06:06.093642 n-d-863052-2 devstack@n-api.service[121403]: DEBUG dbcounter [-] [121403] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 19:06:06.233277 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-5ae1779d-9d5f-4f04-a1a3-3d104d7ce5dc tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05d6a1722dfa4e959aeb14d601e43b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b5d812eff94e2f89d4705d7e7d5f3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:06:06.250519 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-5ae1779d-9d5f-4f04-a1a3-3d104d7ce5dc tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] 10.222.0.13 "GET /compute/v2.1/servers/0b57b50d-1ec4-4ee1-ac3a-f6f44d68a2c3" status: 200 len: 1316 microversion: 2.1 time: 0.721749 Nov 01 19:06:06.251545 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1446/2951] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:06:05 2022] GET /compute/v2.1/servers/0b57b50d-1ec4-4ee1-ac3a-f6f44d68a2c3 => generated 1316 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:06:06.274351 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-ed3a5fb9-ac26-492b-b3fa-9bf43c36f702 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd2105b0264b48d084d0e79cabff8bc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf4adda91364dab94830347c06e3957', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:06:06.301053 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-ed3a5fb9-ac26-492b-b3fa-9bf43c36f702 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd2105b0264b48d084d0e79cabff8bc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf4adda91364dab94830347c06e3957', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:06:06.303054 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-ed3a5fb9-ac26-492b-b3fa-9bf43c36f702 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd2105b0264b48d084d0e79cabff8bc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf4adda91364dab94830347c06e3957', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:06:06.306149 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-ed3a5fb9-ac26-492b-b3fa-9bf43c36f702 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] 10.222.0.13 "GET /compute/v2.1/servers/ba6ffc5c-84a4-40f1-bdc7-f87dde2c99df" status: 200 len: 1576 microversion: 2.32 time: 0.326937 Nov 01 19:06:06.310410 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-180a57f7-11e2-4ea0-9487-79f8593a93dd tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:06:06.311816 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-180a57f7-11e2-4ea0-9487-79f8593a93dd tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] [instance: 86162175-5f45-4aa7-9825-f1a3b4a699ff] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:06:06.321384 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1506/2952] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 19:06:05 2022] GET /compute/v2.1/servers/ba6ffc5c-84a4-40f1-bdc7-f87dde2c99df => generated 1576 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 19:06:06.322845 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-180a57f7-11e2-4ea0-9487-79f8593a93dd tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:06:06.323682 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-180a57f7-11e2-4ea0-9487-79f8593a93dd tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:06:06.325107 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-180a57f7-11e2-4ea0-9487-79f8593a93dd tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:06:06.326884 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-180a57f7-11e2-4ea0-9487-79f8593a93dd tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:06:06.333609 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-180a57f7-11e2-4ea0-9487-79f8593a93dd tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:06:06.334330 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-180a57f7-11e2-4ea0-9487-79f8593a93dd tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:06:06.629388 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-180a57f7-11e2-4ea0-9487-79f8593a93dd tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb87e6147a6f470391921ac3b7a62f8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6511ea24c4c19a7c5d91535c7288d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:06:06.643690 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-180a57f7-11e2-4ea0-9487-79f8593a93dd tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] 10.222.0.13 "GET /compute/v2.1/servers/86162175-5f45-4aa7-9825-f1a3b4a699ff" status: 200 len: 1519 microversion: 2.1 time: 0.337233 Nov 01 19:06:06.667447 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1447/2953] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:06:06 2022] GET /compute/v2.1/servers/86162175-5f45-4aa7-9825-f1a3b4a699ff => generated 1519 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 19:06:06.674692 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-16367ffd-c85e-4caa-85b6-01cadee62e20 tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.8.254"}} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:06:06.678153 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-16367ffd-c85e-4caa-85b6-01cadee62e20 tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] [instance: 307ee785-a01d-401c-8be2-b17558e735f3] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:06:06.685027 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-16367ffd-c85e-4caa-85b6-01cadee62e20 tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:06:06.685839 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-16367ffd-c85e-4caa-85b6-01cadee62e20 tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:06:06.686792 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-16367ffd-c85e-4caa-85b6-01cadee62e20 tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:06:06.688003 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-16367ffd-c85e-4caa-85b6-01cadee62e20 tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:06:06.688771 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-16367ffd-c85e-4caa-85b6-01cadee62e20 tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:06:06.698215 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-16367ffd-c85e-4caa-85b6-01cadee62e20 tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:06:06.743897 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-16367ffd-c85e-4caa-85b6-01cadee62e20 tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] Acquiring lock "refresh_cache-307ee785-a01d-401c-8be2-b17558e735f3" {{(pid=121403) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Nov 01 19:06:06.744543 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-16367ffd-c85e-4caa-85b6-01cadee62e20 tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] Acquired lock "refresh_cache-307ee785-a01d-401c-8be2-b17558e735f3" {{(pid=121403) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Nov 01 19:06:07.005185 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-8a2d1eff-fa7b-4307-962d-c29a5ff51c73 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:06:07.006172 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-8a2d1eff-fa7b-4307-962d-c29a5ff51c73 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] [instance: af1071a8-a090-44c9-890c-123ca3ff39f1] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:06:07.013755 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-8a2d1eff-fa7b-4307-962d-c29a5ff51c73 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:06:07.014559 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-8a2d1eff-fa7b-4307-962d-c29a5ff51c73 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:06:07.015239 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-8a2d1eff-fa7b-4307-962d-c29a5ff51c73 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:06:07.016167 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-8a2d1eff-fa7b-4307-962d-c29a5ff51c73 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:06:07.016881 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-8a2d1eff-fa7b-4307-962d-c29a5ff51c73 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:06:07.017530 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-8a2d1eff-fa7b-4307-962d-c29a5ff51c73 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:06:07.295630 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-8a2d1eff-fa7b-4307-962d-c29a5ff51c73 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '301ed3b9c37449bc9ade378f3c73a768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8807757227574c828dca1947af76659d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:06:07.307006 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-8a2d1eff-fa7b-4307-962d-c29a5ff51c73 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '301ed3b9c37449bc9ade378f3c73a768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8807757227574c828dca1947af76659d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:06:07.308458 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-8a2d1eff-fa7b-4307-962d-c29a5ff51c73 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '301ed3b9c37449bc9ade378f3c73a768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8807757227574c828dca1947af76659d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:06:07.309671 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-8a2d1eff-fa7b-4307-962d-c29a5ff51c73 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] 10.222.0.13 "GET /compute/v2.1/servers/af1071a8-a090-44c9-890c-123ca3ff39f1" status: 200 len: 1892 microversion: 2.42 time: 0.308533 Nov 01 19:06:07.311041 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1448/2954] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 19:06:06 2022] GET /compute/v2.1/servers/af1071a8-a090-44c9-890c-123ca3ff39f1 => generated 1892 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 19:06:07.316089 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [req-ca68b506-07e9-4701-be4f-48372656f0c6 req-90851dad-f951-4685-9c4d-d0312426ea03 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "af1071a8-a090-44c9-890c-123ca3ff39f1", "tag": "647aec31-8971-4e83-9e8f-4dfc4202c174"}]} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:06:07.327608 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-ca68b506-07e9-4701-be4f-48372656f0c6 req-90851dad-f951-4685-9c4d-d0312426ea03 service nova] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:06:07.328090 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-ca68b506-07e9-4701-be4f-48372656f0c6 req-90851dad-f951-4685-9c4d-d0312426ea03 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:06:07.328528 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-ca68b506-07e9-4701-be4f-48372656f0c6 req-90851dad-f951-4685-9c4d-d0312426ea03 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:06:07.357979 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.compute.server_external_events [req-ca68b506-07e9-4701-be4f-48372656f0c6 req-90851dad-f951-4685-9c4d-d0312426ea03 service nova] Creating event network-changed:647aec31-8971-4e83-9e8f-4dfc4202c174 for instance af1071a8-a090-44c9-890c-123ca3ff39f1 on n-h2-863052-2 Nov 01 19:06:07.367642 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [req-ca68b506-07e9-4701-be4f-48372656f0c6 req-90851dad-f951-4685-9c4d-d0312426ea03 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055052 Nov 01 19:06:07.368268 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1449/2955] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Nov 1 19:06:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:06:07.380534 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-6f3e2666-bf45-4e8c-81d4-bc45fbd22dcf tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:06:07.387191 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-6f3e2666-bf45-4e8c-81d4-bc45fbd22dcf tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] [instance: 0b57b50d-1ec4-4ee1-ac3a-f6f44d68a2c3] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:06:07.403279 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-6f3e2666-bf45-4e8c-81d4-bc45fbd22dcf tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:06:07.404749 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-6f3e2666-bf45-4e8c-81d4-bc45fbd22dcf tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:06:07.405368 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-6f3e2666-bf45-4e8c-81d4-bc45fbd22dcf tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:06:07.406299 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-6f3e2666-bf45-4e8c-81d4-bc45fbd22dcf tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:06:07.411132 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-6f3e2666-bf45-4e8c-81d4-bc45fbd22dcf tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:06:07.411768 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-6f3e2666-bf45-4e8c-81d4-bc45fbd22dcf tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:06:07.727407 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-6f3e2666-bf45-4e8c-81d4-bc45fbd22dcf tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05d6a1722dfa4e959aeb14d601e43b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b5d812eff94e2f89d4705d7e7d5f3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:06:07.737742 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-6f3e2666-bf45-4e8c-81d4-bc45fbd22dcf tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] 10.222.0.13 "GET /compute/v2.1/servers/0b57b50d-1ec4-4ee1-ac3a-f6f44d68a2c3" status: 200 len: 1316 microversion: 2.1 time: 0.361312 Nov 01 19:06:07.743614 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1450/2956] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:06:07 2022] GET /compute/v2.1/servers/0b57b50d-1ec4-4ee1-ac3a-f6f44d68a2c3 => generated 1316 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:06:07.754802 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-c58089ca-a4d1-4e5b-8f99-294a9fe98459 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:06:07.762421 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-c58089ca-a4d1-4e5b-8f99-294a9fe98459 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] [instance: ba6ffc5c-84a4-40f1-bdc7-f87dde2c99df] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:06:07.770883 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-c58089ca-a4d1-4e5b-8f99-294a9fe98459 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:06:07.774955 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-c58089ca-a4d1-4e5b-8f99-294a9fe98459 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:06:07.775683 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-c58089ca-a4d1-4e5b-8f99-294a9fe98459 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:06:07.777467 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-c58089ca-a4d1-4e5b-8f99-294a9fe98459 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:06:07.783119 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-c58089ca-a4d1-4e5b-8f99-294a9fe98459 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:06:07.784024 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-c58089ca-a4d1-4e5b-8f99-294a9fe98459 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:06:07.994898 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-c58089ca-a4d1-4e5b-8f99-294a9fe98459 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd2105b0264b48d084d0e79cabff8bc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf4adda91364dab94830347c06e3957', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:06:08.016035 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-c58089ca-a4d1-4e5b-8f99-294a9fe98459 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd2105b0264b48d084d0e79cabff8bc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf4adda91364dab94830347c06e3957', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:06:08.018206 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-c58089ca-a4d1-4e5b-8f99-294a9fe98459 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd2105b0264b48d084d0e79cabff8bc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf4adda91364dab94830347c06e3957', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:06:08.024777 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-c58089ca-a4d1-4e5b-8f99-294a9fe98459 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] 10.222.0.13 "GET /compute/v2.1/servers/ba6ffc5c-84a4-40f1-bdc7-f87dde2c99df" status: 200 len: 1594 microversion: 2.32 time: 0.279649 Nov 01 19:06:08.030553 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1451/2957] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 19:06:07 2022] GET /compute/v2.1/servers/ba6ffc5c-84a4-40f1-bdc7-f87dde2c99df => generated 1594 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 19:06:08.048783 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [req-6b172e93-f3d0-4dcd-a65d-a69527ea36d5 req-bde85681-7ab2-48c6-acd0-f53ad6777069 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0b57b50d-1ec4-4ee1-ac3a-f6f44d68a2c3", "name": "network-vif-plugged", "status": "completed", "tag": "4032ee0a-a429-4780-a678-83209caf97b1"}]} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:06:08.088394 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-6b172e93-f3d0-4dcd-a65d-a69527ea36d5 req-bde85681-7ab2-48c6-acd0-f53ad6777069 service nova] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:06:08.089291 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-6b172e93-f3d0-4dcd-a65d-a69527ea36d5 req-bde85681-7ab2-48c6-acd0-f53ad6777069 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:06:08.091853 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-6b172e93-f3d0-4dcd-a65d-a69527ea36d5 req-bde85681-7ab2-48c6-acd0-f53ad6777069 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:06:08.112956 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.compute.server_external_events [req-6b172e93-f3d0-4dcd-a65d-a69527ea36d5 req-bde85681-7ab2-48c6-acd0-f53ad6777069 service nova] Creating event network-vif-plugged:4032ee0a-a429-4780-a678-83209caf97b1 for instance 0b57b50d-1ec4-4ee1-ac3a-f6f44d68a2c3 on n-h2-863052-2 Nov 01 19:06:08.122092 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [req-6b172e93-f3d0-4dcd-a65d-a69527ea36d5 req-bde85681-7ab2-48c6-acd0-f53ad6777069 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089201 Nov 01 19:06:08.123846 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1452/2958] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Nov 1 19:06:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:06:08.342489 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-4bee791b-90d8-4cf5-908c-82ae87ef555d tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:06:08.344097 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-4bee791b-90d8-4cf5-908c-82ae87ef555d tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] [instance: af1071a8-a090-44c9-890c-123ca3ff39f1] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:06:08.357724 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-4bee791b-90d8-4cf5-908c-82ae87ef555d tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:06:08.366061 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-4bee791b-90d8-4cf5-908c-82ae87ef555d tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:06:08.366963 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-4bee791b-90d8-4cf5-908c-82ae87ef555d tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:06:08.370027 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-4bee791b-90d8-4cf5-908c-82ae87ef555d tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:06:08.375158 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-4bee791b-90d8-4cf5-908c-82ae87ef555d tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:06:08.381098 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-4bee791b-90d8-4cf5-908c-82ae87ef555d tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:06:08.643897 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-4bee791b-90d8-4cf5-908c-82ae87ef555d tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '301ed3b9c37449bc9ade378f3c73a768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8807757227574c828dca1947af76659d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:06:08.653564 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-4bee791b-90d8-4cf5-908c-82ae87ef555d tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '301ed3b9c37449bc9ade378f3c73a768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8807757227574c828dca1947af76659d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:06:08.655572 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-4bee791b-90d8-4cf5-908c-82ae87ef555d tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '301ed3b9c37449bc9ade378f3c73a768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8807757227574c828dca1947af76659d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:06:08.656771 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-4bee791b-90d8-4cf5-908c-82ae87ef555d tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] 10.222.0.13 "GET /compute/v2.1/servers/af1071a8-a090-44c9-890c-123ca3ff39f1" status: 200 len: 1892 microversion: 2.42 time: 0.318640 Nov 01 19:06:08.671731 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1453/2959] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 19:06:08 2022] GET /compute/v2.1/servers/af1071a8-a090-44c9-890c-123ca3ff39f1 => generated 1892 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 01 19:06:08.771878 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-310d9248-6d4d-4f75-ba7c-6f6b13c940b6 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:06:08.772492 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-310d9248-6d4d-4f75-ba7c-6f6b13c940b6 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] [instance: 0b57b50d-1ec4-4ee1-ac3a-f6f44d68a2c3] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:06:08.789509 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-310d9248-6d4d-4f75-ba7c-6f6b13c940b6 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:06:08.789509 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-310d9248-6d4d-4f75-ba7c-6f6b13c940b6 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:06:08.789794 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-310d9248-6d4d-4f75-ba7c-6f6b13c940b6 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:06:08.790533 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-310d9248-6d4d-4f75-ba7c-6f6b13c940b6 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:06:08.791418 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-310d9248-6d4d-4f75-ba7c-6f6b13c940b6 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:06:08.791418 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-310d9248-6d4d-4f75-ba7c-6f6b13c940b6 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:06:08.993383 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-310d9248-6d4d-4f75-ba7c-6f6b13c940b6 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05d6a1722dfa4e959aeb14d601e43b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b5d812eff94e2f89d4705d7e7d5f3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:06:09.005187 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-310d9248-6d4d-4f75-ba7c-6f6b13c940b6 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] 10.222.0.13 "GET /compute/v2.1/servers/0b57b50d-1ec4-4ee1-ac3a-f6f44d68a2c3" status: 200 len: 1316 microversion: 2.1 time: 0.236790 Nov 01 19:06:09.006117 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1454/2960] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:06:08 2022] GET /compute/v2.1/servers/0b57b50d-1ec4-4ee1-ac3a-f6f44d68a2c3 => generated 1316 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:06:09.059384 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-68989828-7898-4375-9b2d-fec4ff4bad75 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:06:09.060430 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-68989828-7898-4375-9b2d-fec4ff4bad75 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] [instance: ba6ffc5c-84a4-40f1-bdc7-f87dde2c99df] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:06:09.071652 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-68989828-7898-4375-9b2d-fec4ff4bad75 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:06:09.072413 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-68989828-7898-4375-9b2d-fec4ff4bad75 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:06:09.073124 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-68989828-7898-4375-9b2d-fec4ff4bad75 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:06:09.073990 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-68989828-7898-4375-9b2d-fec4ff4bad75 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:06:09.074839 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-68989828-7898-4375-9b2d-fec4ff4bad75 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:06:09.076544 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-68989828-7898-4375-9b2d-fec4ff4bad75 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:06:09.285656 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-68989828-7898-4375-9b2d-fec4ff4bad75 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd2105b0264b48d084d0e79cabff8bc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf4adda91364dab94830347c06e3957', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:06:09.305956 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-68989828-7898-4375-9b2d-fec4ff4bad75 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd2105b0264b48d084d0e79cabff8bc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf4adda91364dab94830347c06e3957', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:06:09.307438 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-68989828-7898-4375-9b2d-fec4ff4bad75 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd2105b0264b48d084d0e79cabff8bc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf4adda91364dab94830347c06e3957', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:06:09.308652 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-68989828-7898-4375-9b2d-fec4ff4bad75 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] 10.222.0.13 "GET /compute/v2.1/servers/ba6ffc5c-84a4-40f1-bdc7-f87dde2c99df" status: 200 len: 1594 microversion: 2.32 time: 0.253248 Nov 01 19:06:09.328717 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1455/2961] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 19:06:09 2022] GET /compute/v2.1/servers/ba6ffc5c-84a4-40f1-bdc7-f87dde2c99df => generated 1594 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 01 19:06:09.692629 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-79d37065-0e37-4598-a286-91db03efe417 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:06:09.694008 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-79d37065-0e37-4598-a286-91db03efe417 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] [instance: af1071a8-a090-44c9-890c-123ca3ff39f1] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:06:09.701147 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-79d37065-0e37-4598-a286-91db03efe417 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:06:09.701873 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-79d37065-0e37-4598-a286-91db03efe417 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:06:09.702489 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-79d37065-0e37-4598-a286-91db03efe417 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:06:09.703356 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-79d37065-0e37-4598-a286-91db03efe417 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:06:09.703971 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-79d37065-0e37-4598-a286-91db03efe417 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:06:09.704573 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-79d37065-0e37-4598-a286-91db03efe417 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:06:10.048852 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-79d37065-0e37-4598-a286-91db03efe417 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '301ed3b9c37449bc9ade378f3c73a768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8807757227574c828dca1947af76659d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:06:10.059511 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-79d37065-0e37-4598-a286-91db03efe417 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '301ed3b9c37449bc9ade378f3c73a768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8807757227574c828dca1947af76659d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:06:10.061229 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-79d37065-0e37-4598-a286-91db03efe417 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '301ed3b9c37449bc9ade378f3c73a768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8807757227574c828dca1947af76659d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:06:10.063149 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-79d37065-0e37-4598-a286-91db03efe417 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] 10.222.0.13 "GET /compute/v2.1/servers/af1071a8-a090-44c9-890c-123ca3ff39f1" status: 200 len: 1892 microversion: 2.42 time: 0.374519 Nov 01 19:06:10.064232 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1456/2962] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 19:06:09 2022] GET /compute/v2.1/servers/af1071a8-a090-44c9-890c-123ca3ff39f1 => generated 1892 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 01 19:06:10.069375 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [req-68fe08fd-e4be-4f1f-bacd-094b2e7b2bf2 req-9e5951bf-345b-4b09-b3e9-58dd7b18c560 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "af1071a8-a090-44c9-890c-123ca3ff39f1", "tag": "47e5170e-02f3-496f-b886-a133bae1b952"}]} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:06:10.084772 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-68fe08fd-e4be-4f1f-bacd-094b2e7b2bf2 req-9e5951bf-345b-4b09-b3e9-58dd7b18c560 service nova] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:06:10.085386 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-68fe08fd-e4be-4f1f-bacd-094b2e7b2bf2 req-9e5951bf-345b-4b09-b3e9-58dd7b18c560 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:06:10.085829 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-68fe08fd-e4be-4f1f-bacd-094b2e7b2bf2 req-9e5951bf-345b-4b09-b3e9-58dd7b18c560 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:06:10.099901 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.compute.server_external_events [req-68fe08fd-e4be-4f1f-bacd-094b2e7b2bf2 req-9e5951bf-345b-4b09-b3e9-58dd7b18c560 service nova] Creating event network-changed:47e5170e-02f3-496f-b886-a133bae1b952 for instance af1071a8-a090-44c9-890c-123ca3ff39f1 on n-h2-863052-2 Nov 01 19:06:10.107758 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [req-68fe08fd-e4be-4f1f-bacd-094b2e7b2bf2 req-9e5951bf-345b-4b09-b3e9-58dd7b18c560 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040933 Nov 01 19:06:10.108867 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1457/2963] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Nov 1 19:06:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:06:10.115496 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-ff489ce0-d88a-4648-9e2d-617120eba9ef tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:06:10.116273 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-ff489ce0-d88a-4648-9e2d-617120eba9ef tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] [instance: 0b57b50d-1ec4-4ee1-ac3a-f6f44d68a2c3] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:06:10.124481 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-ff489ce0-d88a-4648-9e2d-617120eba9ef tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:06:10.125062 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-ff489ce0-d88a-4648-9e2d-617120eba9ef tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:06:10.125506 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-ff489ce0-d88a-4648-9e2d-617120eba9ef tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:06:10.126642 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-ff489ce0-d88a-4648-9e2d-617120eba9ef tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:06:10.127121 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-ff489ce0-d88a-4648-9e2d-617120eba9ef tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:06:10.127555 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-ff489ce0-d88a-4648-9e2d-617120eba9ef tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:06:10.321626 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-ff489ce0-d88a-4648-9e2d-617120eba9ef tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05d6a1722dfa4e959aeb14d601e43b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b5d812eff94e2f89d4705d7e7d5f3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:06:10.323949 n-d-863052-2 devstack@n-api.service[121402]: DEBUG dbcounter [-] [121402] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 19:06:10.335872 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-ff489ce0-d88a-4648-9e2d-617120eba9ef tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] 10.222.0.13 "GET /compute/v2.1/servers/0b57b50d-1ec4-4ee1-ac3a-f6f44d68a2c3" status: 200 len: 1506 microversion: 2.1 time: 0.225617 Nov 01 19:06:10.348623 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1458/2964] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:06:10 2022] GET /compute/v2.1/servers/0b57b50d-1ec4-4ee1-ac3a-f6f44d68a2c3 => generated 1506 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:06:10.348623 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-867e4eaf-4100-4ec6-966d-8a491cd1f0a9 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:06:10.348623 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-867e4eaf-4100-4ec6-966d-8a491cd1f0a9 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] [instance: ba6ffc5c-84a4-40f1-bdc7-f87dde2c99df] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:06:10.353247 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-867e4eaf-4100-4ec6-966d-8a491cd1f0a9 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:06:10.353800 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-867e4eaf-4100-4ec6-966d-8a491cd1f0a9 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:06:10.354244 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-867e4eaf-4100-4ec6-966d-8a491cd1f0a9 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:06:10.355047 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-867e4eaf-4100-4ec6-966d-8a491cd1f0a9 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:06:10.357153 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-867e4eaf-4100-4ec6-966d-8a491cd1f0a9 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:06:10.357609 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-867e4eaf-4100-4ec6-966d-8a491cd1f0a9 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:06:10.646174 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-867e4eaf-4100-4ec6-966d-8a491cd1f0a9 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd2105b0264b48d084d0e79cabff8bc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf4adda91364dab94830347c06e3957', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:06:10.665346 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-867e4eaf-4100-4ec6-966d-8a491cd1f0a9 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd2105b0264b48d084d0e79cabff8bc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf4adda91364dab94830347c06e3957', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:06:10.666957 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-867e4eaf-4100-4ec6-966d-8a491cd1f0a9 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd2105b0264b48d084d0e79cabff8bc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf4adda91364dab94830347c06e3957', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:06:10.670043 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-867e4eaf-4100-4ec6-966d-8a491cd1f0a9 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] 10.222.0.13 "GET /compute/v2.1/servers/ba6ffc5c-84a4-40f1-bdc7-f87dde2c99df" status: 200 len: 1661 microversion: 2.32 time: 0.331811 Nov 01 19:06:10.680964 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1459/2965] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 19:06:10 2022] GET /compute/v2.1/servers/ba6ffc5c-84a4-40f1-bdc7-f87dde2c99df => generated 1661 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 19:06:10.695368 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-55b0a054-caca-433e-ab3f-474ea9ce5b42 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:06:10.696111 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-55b0a054-caca-433e-ab3f-474ea9ce5b42 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] [instance: 0b57b50d-1ec4-4ee1-ac3a-f6f44d68a2c3] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:06:10.729625 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-55b0a054-caca-433e-ab3f-474ea9ce5b42 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:06:10.730145 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-55b0a054-caca-433e-ab3f-474ea9ce5b42 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:06:10.730589 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-55b0a054-caca-433e-ab3f-474ea9ce5b42 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:06:10.735933 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-55b0a054-caca-433e-ab3f-474ea9ce5b42 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:06:10.736435 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-55b0a054-caca-433e-ab3f-474ea9ce5b42 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:06:10.736914 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-55b0a054-caca-433e-ab3f-474ea9ce5b42 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:06:11.126825 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-55b0a054-caca-433e-ab3f-474ea9ce5b42 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05d6a1722dfa4e959aeb14d601e43b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b5d812eff94e2f89d4705d7e7d5f3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:06:11.138809 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-55b0a054-caca-433e-ab3f-474ea9ce5b42 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] 10.222.0.13 "GET /compute/v2.1/servers/0b57b50d-1ec4-4ee1-ac3a-f6f44d68a2c3" status: 200 len: 1506 microversion: 2.1 time: 0.456673 Nov 01 19:06:11.142875 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1460/2966] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:06:10 2022] GET /compute/v2.1/servers/0b57b50d-1ec4-4ee1-ac3a-f6f44d68a2c3 => generated 1506 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:06:11.154560 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-df3b2698-6481-42d8-be65-443c5a26c4c2 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:06:11.157182 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-df3b2698-6481-42d8-be65-443c5a26c4c2 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] [instance: af1071a8-a090-44c9-890c-123ca3ff39f1] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:06:11.179055 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-df3b2698-6481-42d8-be65-443c5a26c4c2 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:06:11.183219 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-df3b2698-6481-42d8-be65-443c5a26c4c2 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:06:11.188998 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-df3b2698-6481-42d8-be65-443c5a26c4c2 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:06:11.189838 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-df3b2698-6481-42d8-be65-443c5a26c4c2 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:06:11.190327 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-df3b2698-6481-42d8-be65-443c5a26c4c2 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:06:11.201384 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-df3b2698-6481-42d8-be65-443c5a26c4c2 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:06:11.655088 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-df3b2698-6481-42d8-be65-443c5a26c4c2 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '301ed3b9c37449bc9ade378f3c73a768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8807757227574c828dca1947af76659d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:06:11.668834 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-df3b2698-6481-42d8-be65-443c5a26c4c2 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '301ed3b9c37449bc9ade378f3c73a768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8807757227574c828dca1947af76659d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:06:11.677302 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-df3b2698-6481-42d8-be65-443c5a26c4c2 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '301ed3b9c37449bc9ade378f3c73a768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8807757227574c828dca1947af76659d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:06:11.678687 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-df3b2698-6481-42d8-be65-443c5a26c4c2 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] 10.222.0.13 "GET /compute/v2.1/servers/af1071a8-a090-44c9-890c-123ca3ff39f1" status: 200 len: 1892 microversion: 2.42 time: 0.534446 Nov 01 19:06:11.700859 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1461/2967] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 19:06:11 2022] GET /compute/v2.1/servers/af1071a8-a090-44c9-890c-123ca3ff39f1 => generated 1892 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 19:06:11.714026 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-c9f9a3ed-4c28-4a3b-bb7d-985921d10d7b tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:06:11.717867 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-c9f9a3ed-4c28-4a3b-bb7d-985921d10d7b tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] [instance: 0b57b50d-1ec4-4ee1-ac3a-f6f44d68a2c3] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:06:11.744387 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-c9f9a3ed-4c28-4a3b-bb7d-985921d10d7b tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:06:11.745249 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-c9f9a3ed-4c28-4a3b-bb7d-985921d10d7b tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:06:11.745911 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-c9f9a3ed-4c28-4a3b-bb7d-985921d10d7b tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:06:11.746827 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-c9f9a3ed-4c28-4a3b-bb7d-985921d10d7b tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:06:11.747534 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-c9f9a3ed-4c28-4a3b-bb7d-985921d10d7b tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:06:11.748159 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-c9f9a3ed-4c28-4a3b-bb7d-985921d10d7b tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:06:11.861304 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-c9f9a3ed-4c28-4a3b-bb7d-985921d10d7b tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] 10.222.0.13 "PUT /compute/v2.1/servers/0b57b50d-1ec4-4ee1-ac3a-f6f44d68a2c3" status: 200 len: 1078 microversion: 2.1 time: 0.155262 Nov 01 19:06:11.871224 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1462/2968] 10.222.0.13 () {60 vars in 1256 bytes} [Tue Nov 1 19:06:11 2022] PUT /compute/v2.1/servers/0b57b50d-1ec4-4ee1-ac3a-f6f44d68a2c3 => generated 1078 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:06:11.883965 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-3384b2a4-9e15-463f-9cfa-bbbd349ad5e2 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:06:11.886656 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-3384b2a4-9e15-463f-9cfa-bbbd349ad5e2 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] [instance: ba6ffc5c-84a4-40f1-bdc7-f87dde2c99df] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:06:11.899812 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-3384b2a4-9e15-463f-9cfa-bbbd349ad5e2 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:06:11.900552 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-3384b2a4-9e15-463f-9cfa-bbbd349ad5e2 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:06:11.901200 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-3384b2a4-9e15-463f-9cfa-bbbd349ad5e2 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:06:11.902598 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-3384b2a4-9e15-463f-9cfa-bbbd349ad5e2 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:06:11.903251 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-3384b2a4-9e15-463f-9cfa-bbbd349ad5e2 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:06:11.904429 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-3384b2a4-9e15-463f-9cfa-bbbd349ad5e2 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:06:11.992317 n-d-863052-2 devstack@n-api.service[121403]: DEBUG dbcounter [-] [121403] Writing DB stats nova_cell0:SELECT=2 {{(pid=121403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 19:06:12.131224 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-3384b2a4-9e15-463f-9cfa-bbbd349ad5e2 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd2105b0264b48d084d0e79cabff8bc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf4adda91364dab94830347c06e3957', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:06:12.152788 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-3384b2a4-9e15-463f-9cfa-bbbd349ad5e2 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd2105b0264b48d084d0e79cabff8bc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf4adda91364dab94830347c06e3957', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:06:12.155011 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-3384b2a4-9e15-463f-9cfa-bbbd349ad5e2 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd2105b0264b48d084d0e79cabff8bc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf4adda91364dab94830347c06e3957', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:06:12.156668 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-3384b2a4-9e15-463f-9cfa-bbbd349ad5e2 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] 10.222.0.13 "GET /compute/v2.1/servers/ba6ffc5c-84a4-40f1-bdc7-f87dde2c99df" status: 200 len: 1661 microversion: 2.32 time: 0.282923 Nov 01 19:06:12.157436 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1463/2969] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 19:06:11 2022] GET /compute/v2.1/servers/ba6ffc5c-84a4-40f1-bdc7-f87dde2c99df => generated 1661 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 19:06:12.165843 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-ca0942ae-63a7-4803-842e-3087876aeefa tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:06:12.166514 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-ca0942ae-63a7-4803-842e-3087876aeefa tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] [instance: 0b57b50d-1ec4-4ee1-ac3a-f6f44d68a2c3] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:06:12.183100 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-ca0942ae-63a7-4803-842e-3087876aeefa tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:06:12.183621 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-ca0942ae-63a7-4803-842e-3087876aeefa tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:06:12.184071 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-ca0942ae-63a7-4803-842e-3087876aeefa tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:06:12.185441 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-ca0942ae-63a7-4803-842e-3087876aeefa tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:06:12.193005 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-ca0942ae-63a7-4803-842e-3087876aeefa tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:06:12.193595 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-ca0942ae-63a7-4803-842e-3087876aeefa tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:06:12.802666 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-ca0942ae-63a7-4803-842e-3087876aeefa tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05d6a1722dfa4e959aeb14d601e43b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b5d812eff94e2f89d4705d7e7d5f3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:06:12.815523 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-ca0942ae-63a7-4803-842e-3087876aeefa tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] 10.222.0.13 "GET /compute/v2.1/servers/0b57b50d-1ec4-4ee1-ac3a-f6f44d68a2c3" status: 200 len: 1504 microversion: 2.1 time: 0.656816 Nov 01 19:06:12.816116 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1464/2970] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:06:12 2022] GET /compute/v2.1/servers/0b57b50d-1ec4-4ee1-ac3a-f6f44d68a2c3 => generated 1504 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:06:12.839797 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-f4ada384-2c5f-4a61-8409-958b3bce6aaa tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:06:12.840567 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-f4ada384-2c5f-4a61-8409-958b3bce6aaa tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] [instance: af1071a8-a090-44c9-890c-123ca3ff39f1] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:06:12.846943 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f4ada384-2c5f-4a61-8409-958b3bce6aaa tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:06:12.847444 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f4ada384-2c5f-4a61-8409-958b3bce6aaa tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:06:12.847888 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f4ada384-2c5f-4a61-8409-958b3bce6aaa tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:06:12.848722 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f4ada384-2c5f-4a61-8409-958b3bce6aaa tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:06:12.849264 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f4ada384-2c5f-4a61-8409-958b3bce6aaa tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:06:12.849923 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f4ada384-2c5f-4a61-8409-958b3bce6aaa tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:06:13.155142 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-f4ada384-2c5f-4a61-8409-958b3bce6aaa tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '301ed3b9c37449bc9ade378f3c73a768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8807757227574c828dca1947af76659d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:06:13.178490 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-f4ada384-2c5f-4a61-8409-958b3bce6aaa tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '301ed3b9c37449bc9ade378f3c73a768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8807757227574c828dca1947af76659d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:06:13.185576 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-f4ada384-2c5f-4a61-8409-958b3bce6aaa tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '301ed3b9c37449bc9ade378f3c73a768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8807757227574c828dca1947af76659d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:06:13.187336 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-f4ada384-2c5f-4a61-8409-958b3bce6aaa tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] 10.222.0.13 "GET /compute/v2.1/servers/af1071a8-a090-44c9-890c-123ca3ff39f1" status: 200 len: 1892 microversion: 2.42 time: 0.351725 Nov 01 19:06:13.197732 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1465/2971] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 19:06:12 2022] GET /compute/v2.1/servers/af1071a8-a090-44c9-890c-123ca3ff39f1 => generated 1892 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 19:06:13.211201 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-8ac81d75-a9fd-48da-8f00-e499e063fe5f tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:06:13.217036 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-8ac81d75-a9fd-48da-8f00-e499e063fe5f tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] [instance: 0b57b50d-1ec4-4ee1-ac3a-f6f44d68a2c3] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:06:13.243989 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-8ac81d75-a9fd-48da-8f00-e499e063fe5f tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:06:13.244507 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-8ac81d75-a9fd-48da-8f00-e499e063fe5f tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:06:13.244982 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-8ac81d75-a9fd-48da-8f00-e499e063fe5f tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:06:13.245763 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-8ac81d75-a9fd-48da-8f00-e499e063fe5f tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:06:13.246289 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-8ac81d75-a9fd-48da-8f00-e499e063fe5f tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:06:13.246736 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-8ac81d75-a9fd-48da-8f00-e499e063fe5f tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:06:13.525385 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.network.neutron [None req-16367ffd-c85e-4caa-85b6-01cadee62e20 tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] [instance: 307ee785-a01d-401c-8be2-b17558e735f3] Building network info cache for instance {{(pid=121403) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Nov 01 19:06:13.971823 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-8ac81d75-a9fd-48da-8f00-e499e063fe5f tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05d6a1722dfa4e959aeb14d601e43b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b5d812eff94e2f89d4705d7e7d5f3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:06:13.992978 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-8ac81d75-a9fd-48da-8f00-e499e063fe5f tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] 10.222.0.13 "GET /compute/v2.1/servers/0b57b50d-1ec4-4ee1-ac3a-f6f44d68a2c3" status: 200 len: 1504 microversion: 2.1 time: 0.791607 Nov 01 19:06:14.015203 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1466/2972] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:06:13 2022] GET /compute/v2.1/servers/0b57b50d-1ec4-4ee1-ac3a-f6f44d68a2c3 => generated 1504 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:06:14.033724 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-50352f4b-8292-4050-908f-10d21e7aab4f tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:06:14.037418 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-50352f4b-8292-4050-908f-10d21e7aab4f tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] [instance: ba6ffc5c-84a4-40f1-bdc7-f87dde2c99df] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:06:14.060686 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-50352f4b-8292-4050-908f-10d21e7aab4f tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:06:14.065493 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-50352f4b-8292-4050-908f-10d21e7aab4f tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:06:14.067618 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-50352f4b-8292-4050-908f-10d21e7aab4f tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:06:14.071902 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-50352f4b-8292-4050-908f-10d21e7aab4f tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:06:14.074694 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-50352f4b-8292-4050-908f-10d21e7aab4f tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:06:14.075539 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-50352f4b-8292-4050-908f-10d21e7aab4f tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:06:14.479681 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-50352f4b-8292-4050-908f-10d21e7aab4f tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd2105b0264b48d084d0e79cabff8bc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf4adda91364dab94830347c06e3957', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:06:14.491139 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-50352f4b-8292-4050-908f-10d21e7aab4f tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd2105b0264b48d084d0e79cabff8bc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf4adda91364dab94830347c06e3957', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:06:14.492952 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-50352f4b-8292-4050-908f-10d21e7aab4f tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd2105b0264b48d084d0e79cabff8bc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf4adda91364dab94830347c06e3957', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:06:14.495263 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-50352f4b-8292-4050-908f-10d21e7aab4f tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] 10.222.0.13 "GET /compute/v2.1/servers/ba6ffc5c-84a4-40f1-bdc7-f87dde2c99df" status: 200 len: 1707 microversion: 2.32 time: 0.478804 Nov 01 19:06:14.497707 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1467/2973] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 19:06:14 2022] GET /compute/v2.1/servers/ba6ffc5c-84a4-40f1-bdc7-f87dde2c99df => generated 1707 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 19:06:14.505392 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [req-4003ee74-b70e-48c2-82b6-caccc30bcce5 req-b35fb1a9-3873-4f31-b8a3-ff27aa3834ae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "307ee785-a01d-401c-8be2-b17558e735f3", "tag": "d65b5fcd-5bb6-4feb-b4bf-95734bcb3072"}]} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:06:14.571643 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-4003ee74-b70e-48c2-82b6-caccc30bcce5 req-b35fb1a9-3873-4f31-b8a3-ff27aa3834ae service nova] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:06:14.572190 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-4003ee74-b70e-48c2-82b6-caccc30bcce5 req-b35fb1a9-3873-4f31-b8a3-ff27aa3834ae service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:06:14.572666 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-4003ee74-b70e-48c2-82b6-caccc30bcce5 req-b35fb1a9-3873-4f31-b8a3-ff27aa3834ae service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:06:14.582449 n-d-863052-2 devstack@n-api.service[121403]: DEBUG dbcounter [-] [121403] Writing DB stats nova_cell0:SELECT=8 {{(pid=121403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 19:06:14.629778 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.compute.server_external_events [req-4003ee74-b70e-48c2-82b6-caccc30bcce5 req-b35fb1a9-3873-4f31-b8a3-ff27aa3834ae service nova] Creating event network-changed:d65b5fcd-5bb6-4feb-b4bf-95734bcb3072 for instance 307ee785-a01d-401c-8be2-b17558e735f3 on n-h2-863052-2 Nov 01 19:06:14.643326 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [req-4003ee74-b70e-48c2-82b6-caccc30bcce5 req-b35fb1a9-3873-4f31-b8a3-ff27aa3834ae service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.143195 Nov 01 19:06:14.648830 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1468/2974] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Nov 1 19:06:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:06:14.662413 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-a891f69c-568c-4f4c-a084-9137c1f90b47 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "2d4a0047-1b9e-445f-8af8-1b5c9d93e881", "OS-DCF:diskConfig": "MANUAL"}} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:06:14.671323 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-a891f69c-568c-4f4c-a084-9137c1f90b47 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] [instance: 0b57b50d-1ec4-4ee1-ac3a-f6f44d68a2c3] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:06:14.686906 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-a891f69c-568c-4f4c-a084-9137c1f90b47 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:06:14.687429 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-a891f69c-568c-4f4c-a084-9137c1f90b47 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:06:14.687857 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-a891f69c-568c-4f4c-a084-9137c1f90b47 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:06:14.688607 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-a891f69c-568c-4f4c-a084-9137c1f90b47 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:06:14.691333 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-a891f69c-568c-4f4c-a084-9137c1f90b47 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:06:14.691781 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-a891f69c-568c-4f4c-a084-9137c1f90b47 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:06:14.936798 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.virt.hardware [None req-a891f69c-568c-4f4c-a084-9137c1f90b47 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Flavor limits 0:0:0 {{(pid=121402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 01 19:06:14.938080 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.virt.hardware [None req-a891f69c-568c-4f4c-a084-9137c1f90b47 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Image limits 0:0:0 {{(pid=121402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 01 19:06:14.938747 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.virt.hardware [None req-a891f69c-568c-4f4c-a084-9137c1f90b47 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Flavor pref 0:0:0 {{(pid=121402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 01 19:06:14.939172 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.virt.hardware [None req-a891f69c-568c-4f4c-a084-9137c1f90b47 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Image pref 0:0:0 {{(pid=121402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 01 19:06:14.941129 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.virt.hardware [None req-a891f69c-568c-4f4c-a084-9137c1f90b47 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 01 19:06:15.101343 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-a891f69c-568c-4f4c-a084-9137c1f90b47 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] [instance: 0b57b50d-1ec4-4ee1-ac3a-f6f44d68a2c3] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:06:15.129983 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-a891f69c-568c-4f4c-a084-9137c1f90b47 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:06:15.132123 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-a891f69c-568c-4f4c-a084-9137c1f90b47 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:06:15.133438 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-a891f69c-568c-4f4c-a084-9137c1f90b47 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:06:15.135641 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-a891f69c-568c-4f4c-a084-9137c1f90b47 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:06:15.138377 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-a891f69c-568c-4f4c-a084-9137c1f90b47 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:06:15.138974 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-a891f69c-568c-4f4c-a084-9137c1f90b47 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:06:15.226644 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-a891f69c-568c-4f4c-a084-9137c1f90b47 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] 10.222.0.13 "POST /compute/v2.1/servers/0b57b50d-1ec4-4ee1-ac3a-f6f44d68a2c3/action" status: 202 len: 1110 microversion: 2.1 time: 0.576432 Nov 01 19:06:15.241500 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1469/2975] 10.222.0.13 () {60 vars in 1278 bytes} [Tue Nov 1 19:06:14 2022] POST /compute/v2.1/servers/0b57b50d-1ec4-4ee1-ac3a-f6f44d68a2c3/action => generated 1110 bytes in 592 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Nov 01 19:06:15.262045 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-ca14840f-b9f8-48dd-9583-8ad4d163359e tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:06:15.269012 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-ca14840f-b9f8-48dd-9583-8ad4d163359e tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] [instance: af1071a8-a090-44c9-890c-123ca3ff39f1] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:06:15.306446 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-ca14840f-b9f8-48dd-9583-8ad4d163359e tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:06:15.308808 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-ca14840f-b9f8-48dd-9583-8ad4d163359e tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:06:15.309311 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-ca14840f-b9f8-48dd-9583-8ad4d163359e tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:06:15.310587 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-ca14840f-b9f8-48dd-9583-8ad4d163359e tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:06:15.311063 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-ca14840f-b9f8-48dd-9583-8ad4d163359e tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:06:15.324618 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-ca14840f-b9f8-48dd-9583-8ad4d163359e tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:06:16.285990 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-ca14840f-b9f8-48dd-9583-8ad4d163359e tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '301ed3b9c37449bc9ade378f3c73a768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8807757227574c828dca1947af76659d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:06:16.300667 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-ca14840f-b9f8-48dd-9583-8ad4d163359e tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '301ed3b9c37449bc9ade378f3c73a768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8807757227574c828dca1947af76659d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:06:16.306196 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-ca14840f-b9f8-48dd-9583-8ad4d163359e tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '301ed3b9c37449bc9ade378f3c73a768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8807757227574c828dca1947af76659d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:06:16.307628 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-ca14840f-b9f8-48dd-9583-8ad4d163359e tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] 10.222.0.13 "GET /compute/v2.1/servers/af1071a8-a090-44c9-890c-123ca3ff39f1" status: 200 len: 1880 microversion: 2.42 time: 1.064893 Nov 01 19:06:16.310970 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.network.neutron [None req-16367ffd-c85e-4caa-85b6-01cadee62e20 tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] [instance: 307ee785-a01d-401c-8be2-b17558e735f3] Updating instance_info_cache with network_info: [{"id": "d65b5fcd-5bb6-4feb-b4bf-95734bcb3072", "address": "fa:16:3e:8e:cf:5c", "network": {"id": "5b808c64-bf01-4ded-bf6b-0b3fd18d2f1c", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-768163193-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.8.254", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "eda6511ea24c4c19a7c5d91535c7288d", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapd65b5fcd-5b", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=121403) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Nov 01 19:06:16.331971 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-16367ffd-c85e-4caa-85b6-01cadee62e20 tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] Releasing lock "refresh_cache-307ee785-a01d-401c-8be2-b17558e735f3" {{(pid=121403) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Nov 01 19:06:16.357669 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-16367ffd-c85e-4caa-85b6-01cadee62e20 tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] 10.222.0.13 "POST /compute/v2.1/servers/307ee785-a01d-401c-8be2-b17558e735f3/action" status: 202 len: 0 microversion: 2.1 time: 9.662655 Nov 01 19:06:16.357669 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1507/2977] 10.222.0.13 () {60 vars in 1278 bytes} [Tue Nov 1 19:06:06 2022] POST /compute/v2.1/servers/307ee785-a01d-401c-8be2-b17558e735f3/action => generated 0 bytes in 9664 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Nov 01 19:06:16.357908 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1470/2977] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 19:06:15 2022] GET /compute/v2.1/servers/af1071a8-a090-44c9-890c-123ca3ff39f1 => generated 1880 bytes in 1093 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 19:06:16.357908 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-02573c50-2d8e-4752-96ab-0aa05c322385 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:06:16.357908 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-02573c50-2d8e-4752-96ab-0aa05c322385 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] [instance: ba6ffc5c-84a4-40f1-bdc7-f87dde2c99df] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:06:16.357908 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-02573c50-2d8e-4752-96ab-0aa05c322385 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:06:16.357908 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-02573c50-2d8e-4752-96ab-0aa05c322385 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:06:16.357908 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-02573c50-2d8e-4752-96ab-0aa05c322385 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:06:16.358535 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-02573c50-2d8e-4752-96ab-0aa05c322385 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:06:16.358535 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-02573c50-2d8e-4752-96ab-0aa05c322385 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:06:16.358951 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-02573c50-2d8e-4752-96ab-0aa05c322385 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:06:16.361033 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-4e3e4b92-f1b3-43c4-a3fe-67b8e1989758 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:06:16.361669 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-4e3e4b92-f1b3-43c4-a3fe-67b8e1989758 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] [instance: 0b57b50d-1ec4-4ee1-ac3a-f6f44d68a2c3] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:06:16.387070 n-d-863052-2 devstack@n-api.service[121403]: DEBUG dbcounter [-] [121403] Writing DB stats nova_api:SELECT=88,nova_api:UPDATE=1,nova_api:INSERT=3,nova_api:DELETE=3 {{(pid=121403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 19:06:16.392832 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-4e3e4b92-f1b3-43c4-a3fe-67b8e1989758 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:06:16.393350 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-4e3e4b92-f1b3-43c4-a3fe-67b8e1989758 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:06:16.393796 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-4e3e4b92-f1b3-43c4-a3fe-67b8e1989758 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:06:16.394525 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-4e3e4b92-f1b3-43c4-a3fe-67b8e1989758 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:06:16.394987 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-4e3e4b92-f1b3-43c4-a3fe-67b8e1989758 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:06:16.395415 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-4e3e4b92-f1b3-43c4-a3fe-67b8e1989758 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:06:16.797801 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-02573c50-2d8e-4752-96ab-0aa05c322385 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd2105b0264b48d084d0e79cabff8bc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf4adda91364dab94830347c06e3957', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:06:16.815406 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-02573c50-2d8e-4752-96ab-0aa05c322385 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd2105b0264b48d084d0e79cabff8bc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf4adda91364dab94830347c06e3957', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:06:16.821470 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-02573c50-2d8e-4752-96ab-0aa05c322385 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd2105b0264b48d084d0e79cabff8bc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf4adda91364dab94830347c06e3957', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:06:16.823033 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-02573c50-2d8e-4752-96ab-0aa05c322385 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] 10.222.0.13 "GET /compute/v2.1/servers/ba6ffc5c-84a4-40f1-bdc7-f87dde2c99df" status: 200 len: 1707 microversion: 2.32 time: 0.483453 Nov 01 19:06:16.825965 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1471/2978] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 19:06:16 2022] GET /compute/v2.1/servers/ba6ffc5c-84a4-40f1-bdc7-f87dde2c99df => generated 1707 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 19:06:16.837655 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-38fa6870-a1f1-4d10-8c53-09524beaeeec tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.8.254"}} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:06:16.843953 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-38fa6870-a1f1-4d10-8c53-09524beaeeec tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] [instance: 86162175-5f45-4aa7-9825-f1a3b4a699ff] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:06:16.857137 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-38fa6870-a1f1-4d10-8c53-09524beaeeec tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:06:16.857643 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-38fa6870-a1f1-4d10-8c53-09524beaeeec tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:06:16.858125 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-38fa6870-a1f1-4d10-8c53-09524beaeeec tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:06:16.858838 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-38fa6870-a1f1-4d10-8c53-09524beaeeec tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:06:16.859343 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-38fa6870-a1f1-4d10-8c53-09524beaeeec tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:06:16.859953 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-38fa6870-a1f1-4d10-8c53-09524beaeeec tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:06:16.933197 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-38fa6870-a1f1-4d10-8c53-09524beaeeec tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] Acquiring lock "refresh_cache-86162175-5f45-4aa7-9825-f1a3b4a699ff" {{(pid=121402) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Nov 01 19:06:16.933764 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-38fa6870-a1f1-4d10-8c53-09524beaeeec tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] Acquired lock "refresh_cache-86162175-5f45-4aa7-9825-f1a3b4a699ff" {{(pid=121402) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Nov 01 19:06:17.084911 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-4e3e4b92-f1b3-43c4-a3fe-67b8e1989758 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05d6a1722dfa4e959aeb14d601e43b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b5d812eff94e2f89d4705d7e7d5f3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:06:17.094064 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-4e3e4b92-f1b3-43c4-a3fe-67b8e1989758 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] 10.222.0.13 "GET /compute/v2.1/servers/0b57b50d-1ec4-4ee1-ac3a-f6f44d68a2c3" status: 200 len: 1515 microversion: 2.1 time: 0.755047 Nov 01 19:06:17.097723 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1508/2979] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:06:16 2022] GET /compute/v2.1/servers/0b57b50d-1ec4-4ee1-ac3a-f6f44d68a2c3 => generated 1515 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:06:17.347349 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-51ce1257-1c7a-42f0-aa57-19a3beb43e68 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:06:17.349016 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-51ce1257-1c7a-42f0-aa57-19a3beb43e68 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] [instance: af1071a8-a090-44c9-890c-123ca3ff39f1] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:06:17.363709 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-51ce1257-1c7a-42f0-aa57-19a3beb43e68 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:06:17.364313 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-51ce1257-1c7a-42f0-aa57-19a3beb43e68 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:06:17.365089 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-51ce1257-1c7a-42f0-aa57-19a3beb43e68 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:06:17.367531 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-51ce1257-1c7a-42f0-aa57-19a3beb43e68 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:06:17.368261 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-51ce1257-1c7a-42f0-aa57-19a3beb43e68 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:06:17.371166 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-51ce1257-1c7a-42f0-aa57-19a3beb43e68 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:06:18.627953 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-51ce1257-1c7a-42f0-aa57-19a3beb43e68 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '301ed3b9c37449bc9ade378f3c73a768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8807757227574c828dca1947af76659d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:06:18.638605 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-51ce1257-1c7a-42f0-aa57-19a3beb43e68 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '301ed3b9c37449bc9ade378f3c73a768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8807757227574c828dca1947af76659d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:06:18.650178 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-51ce1257-1c7a-42f0-aa57-19a3beb43e68 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '301ed3b9c37449bc9ade378f3c73a768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8807757227574c828dca1947af76659d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:06:18.651899 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-51ce1257-1c7a-42f0-aa57-19a3beb43e68 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] 10.222.0.13 "GET /compute/v2.1/servers/af1071a8-a090-44c9-890c-123ca3ff39f1" status: 200 len: 1880 microversion: 2.42 time: 1.308964 Nov 01 19:06:18.655461 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1509/2980] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 19:06:17 2022] GET /compute/v2.1/servers/af1071a8-a090-44c9-890c-123ca3ff39f1 => generated 1880 bytes in 1313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 01 19:06:18.665403 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-c5f4dcf3-d667-463d-8291-d52af168b80a tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:06:18.667831 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-c5f4dcf3-d667-463d-8291-d52af168b80a tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] [instance: 990f3535-a5c4-4f62-bed9-b310a77293c8] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:06:18.702694 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-c5f4dcf3-d667-463d-8291-d52af168b80a tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:06:18.705366 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-c5f4dcf3-d667-463d-8291-d52af168b80a tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:06:18.706043 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-c5f4dcf3-d667-463d-8291-d52af168b80a tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:06:18.706974 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-c5f4dcf3-d667-463d-8291-d52af168b80a tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:06:18.711535 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-c5f4dcf3-d667-463d-8291-d52af168b80a tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:06:18.712224 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-c5f4dcf3-d667-463d-8291-d52af168b80a tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:06:18.783270 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-c5f4dcf3-d667-463d-8291-d52af168b80a tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] [instance: 990f3535-a5c4-4f62-bed9-b310a77293c8] Going to try to terminate instance {{(pid=121403) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 01 19:06:18.917915 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-c5f4dcf3-d667-463d-8291-d52af168b80a tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] 10.222.0.13 "DELETE /compute/v2.1/servers/990f3535-a5c4-4f62-bed9-b310a77293c8" status: 204 len: 0 microversion: 2.1 time: 0.260922 Nov 01 19:06:18.918613 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1510/2981] 10.222.0.13 () {58 vars in 1239 bytes} [Tue Nov 1 19:06:18 2022] DELETE /compute/v2.1/servers/990f3535-a5c4-4f62-bed9-b310a77293c8 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 01 19:06:18.929126 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-0bdbe7a9-24ec-4533-ba78-da89c7e08390 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:06:18.929994 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-0bdbe7a9-24ec-4533-ba78-da89c7e08390 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] [instance: ba6ffc5c-84a4-40f1-bdc7-f87dde2c99df] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:06:18.954133 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-0bdbe7a9-24ec-4533-ba78-da89c7e08390 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:06:18.955091 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-0bdbe7a9-24ec-4533-ba78-da89c7e08390 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:06:18.955557 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-0bdbe7a9-24ec-4533-ba78-da89c7e08390 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:06:18.960050 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-0bdbe7a9-24ec-4533-ba78-da89c7e08390 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:06:18.960050 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-0bdbe7a9-24ec-4533-ba78-da89c7e08390 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:06:18.962099 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-0bdbe7a9-24ec-4533-ba78-da89c7e08390 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:06:20.188421 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-0bdbe7a9-24ec-4533-ba78-da89c7e08390 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd2105b0264b48d084d0e79cabff8bc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf4adda91364dab94830347c06e3957', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:06:20.201856 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-0bdbe7a9-24ec-4533-ba78-da89c7e08390 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd2105b0264b48d084d0e79cabff8bc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf4adda91364dab94830347c06e3957', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:06:20.204285 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-0bdbe7a9-24ec-4533-ba78-da89c7e08390 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd2105b0264b48d084d0e79cabff8bc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf4adda91364dab94830347c06e3957', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:06:20.205922 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-0bdbe7a9-24ec-4533-ba78-da89c7e08390 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] 10.222.0.13 "GET /compute/v2.1/servers/ba6ffc5c-84a4-40f1-bdc7-f87dde2c99df" status: 200 len: 1753 microversion: 2.32 time: 1.286042 Nov 01 19:06:20.226352 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1511/2982] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 19:06:18 2022] GET /compute/v2.1/servers/ba6ffc5c-84a4-40f1-bdc7-f87dde2c99df => generated 1753 bytes in 1298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 19:06:20.232539 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-8b5f6f9e-f025-408e-aaf4-506af3e4129f tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:06:20.233246 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-8b5f6f9e-f025-408e-aaf4-506af3e4129f tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] [instance: 0b57b50d-1ec4-4ee1-ac3a-f6f44d68a2c3] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:06:20.239271 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-8b5f6f9e-f025-408e-aaf4-506af3e4129f tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:06:20.239717 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-8b5f6f9e-f025-408e-aaf4-506af3e4129f tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:06:20.240158 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-8b5f6f9e-f025-408e-aaf4-506af3e4129f tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:06:20.240905 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-8b5f6f9e-f025-408e-aaf4-506af3e4129f tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:06:20.241360 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-8b5f6f9e-f025-408e-aaf4-506af3e4129f tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:06:20.241782 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-8b5f6f9e-f025-408e-aaf4-506af3e4129f tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:06:20.837360 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-8b5f6f9e-f025-408e-aaf4-506af3e4129f tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05d6a1722dfa4e959aeb14d601e43b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b5d812eff94e2f89d4705d7e7d5f3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:06:20.848018 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-8b5f6f9e-f025-408e-aaf4-506af3e4129f tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] 10.222.0.13 "GET /compute/v2.1/servers/0b57b50d-1ec4-4ee1-ac3a-f6f44d68a2c3" status: 200 len: 1515 microversion: 2.1 time: 0.619624 Nov 01 19:06:20.859982 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1512/2983] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:06:20 2022] GET /compute/v2.1/servers/0b57b50d-1ec4-4ee1-ac3a-f6f44d68a2c3 => generated 1515 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:06:20.883493 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-224d8ccb-ce6b-4099-b185-16fa38d19bad tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:06:20.892824 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-224d8ccb-ce6b-4099-b185-16fa38d19bad tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] [instance: 990f3535-a5c4-4f62-bed9-b310a77293c8] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:06:20.913717 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-224d8ccb-ce6b-4099-b185-16fa38d19bad tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:06:20.926903 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-224d8ccb-ce6b-4099-b185-16fa38d19bad tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:06:20.927342 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-224d8ccb-ce6b-4099-b185-16fa38d19bad tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:06:20.931186 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-224d8ccb-ce6b-4099-b185-16fa38d19bad tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:06:20.931662 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-224d8ccb-ce6b-4099-b185-16fa38d19bad tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:06:20.932097 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-224d8ccb-ce6b-4099-b185-16fa38d19bad tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:06:21.765652 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-224d8ccb-ce6b-4099-b185-16fa38d19bad tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '058480d92c9b4ab4af6815d0438a65c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee9dc49b89143f781e4ab30296e4d01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:06:21.786848 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-224d8ccb-ce6b-4099-b185-16fa38d19bad tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] 10.222.0.13 "GET /compute/v2.1/servers/990f3535-a5c4-4f62-bed9-b310a77293c8" status: 200 len: 1554 microversion: 2.1 time: 0.925355 Nov 01 19:06:21.810125 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1513/2984] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:06:20 2022] GET /compute/v2.1/servers/990f3535-a5c4-4f62-bed9-b310a77293c8 => generated 1554 bytes in 927 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:06:21.810125 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-6501ab9e-6cf3-464b-8eef-7e2758d366d6 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:06:21.810125 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-6501ab9e-6cf3-464b-8eef-7e2758d366d6 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] [instance: af1071a8-a090-44c9-890c-123ca3ff39f1] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:06:21.838156 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-6501ab9e-6cf3-464b-8eef-7e2758d366d6 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:06:21.839907 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-6501ab9e-6cf3-464b-8eef-7e2758d366d6 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:06:21.842872 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-6501ab9e-6cf3-464b-8eef-7e2758d366d6 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:06:21.845374 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-6501ab9e-6cf3-464b-8eef-7e2758d366d6 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:06:21.847610 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-6501ab9e-6cf3-464b-8eef-7e2758d366d6 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:06:21.849781 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-6501ab9e-6cf3-464b-8eef-7e2758d366d6 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:06:22.397640 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-6501ab9e-6cf3-464b-8eef-7e2758d366d6 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '301ed3b9c37449bc9ade378f3c73a768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8807757227574c828dca1947af76659d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:06:22.419544 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-6501ab9e-6cf3-464b-8eef-7e2758d366d6 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '301ed3b9c37449bc9ade378f3c73a768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8807757227574c828dca1947af76659d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:06:22.440424 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-6501ab9e-6cf3-464b-8eef-7e2758d366d6 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '301ed3b9c37449bc9ade378f3c73a768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8807757227574c828dca1947af76659d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:06:22.441748 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-6501ab9e-6cf3-464b-8eef-7e2758d366d6 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] 10.222.0.13 "GET /compute/v2.1/servers/af1071a8-a090-44c9-890c-123ca3ff39f1" status: 200 len: 1880 microversion: 2.42 time: 0.647412 Nov 01 19:06:22.442693 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1514/2985] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 19:06:21 2022] GET /compute/v2.1/servers/af1071a8-a090-44c9-890c-123ca3ff39f1 => generated 1880 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 19:06:22.454622 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-cdc766c9-26e8-4111-bb3d-a2261e74586b tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:06:22.463351 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-cdc766c9-26e8-4111-bb3d-a2261e74586b tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] [instance: ba6ffc5c-84a4-40f1-bdc7-f87dde2c99df] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:06:22.484820 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-cdc766c9-26e8-4111-bb3d-a2261e74586b tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:06:22.485305 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-cdc766c9-26e8-4111-bb3d-a2261e74586b tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:06:22.485733 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-cdc766c9-26e8-4111-bb3d-a2261e74586b tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:06:22.486429 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-cdc766c9-26e8-4111-bb3d-a2261e74586b tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:06:22.486999 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-cdc766c9-26e8-4111-bb3d-a2261e74586b tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:06:22.487292 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-cdc766c9-26e8-4111-bb3d-a2261e74586b tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:06:22.616049 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.network.neutron [None req-38fa6870-a1f1-4d10-8c53-09524beaeeec tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] [instance: 86162175-5f45-4aa7-9825-f1a3b4a699ff] re-assign floating IP 172.25.8.254 from instance 307ee785-a01d-401c-8be2-b17558e735f3 Nov 01 19:06:22.732781 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.network.neutron [None req-38fa6870-a1f1-4d10-8c53-09524beaeeec tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] [instance: 307ee785-a01d-401c-8be2-b17558e735f3] Building network info cache for instance {{(pid=121402) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Nov 01 19:06:23.050136 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-cdc766c9-26e8-4111-bb3d-a2261e74586b tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd2105b0264b48d084d0e79cabff8bc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf4adda91364dab94830347c06e3957', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:06:23.066592 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-cdc766c9-26e8-4111-bb3d-a2261e74586b tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd2105b0264b48d084d0e79cabff8bc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf4adda91364dab94830347c06e3957', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:06:23.071978 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-cdc766c9-26e8-4111-bb3d-a2261e74586b tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd2105b0264b48d084d0e79cabff8bc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf4adda91364dab94830347c06e3957', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:06:23.083811 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-cdc766c9-26e8-4111-bb3d-a2261e74586b tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] 10.222.0.13 "GET /compute/v2.1/servers/ba6ffc5c-84a4-40f1-bdc7-f87dde2c99df" status: 200 len: 1845 microversion: 2.32 time: 0.631061 Nov 01 19:06:23.085016 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1515/2986] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 19:06:22 2022] GET /compute/v2.1/servers/ba6ffc5c-84a4-40f1-bdc7-f87dde2c99df => generated 1845 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 19:06:23.090346 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-0aa750e7-83f9-4342-a11f-bbb0bebb0caa tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:06:23.092221 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-0aa750e7-83f9-4342-a11f-bbb0bebb0caa tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] [instance: 0b57b50d-1ec4-4ee1-ac3a-f6f44d68a2c3] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:06:23.123727 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-0aa750e7-83f9-4342-a11f-bbb0bebb0caa tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:06:23.131868 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-0aa750e7-83f9-4342-a11f-bbb0bebb0caa tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:06:23.135070 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-0aa750e7-83f9-4342-a11f-bbb0bebb0caa tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:06:23.136307 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-0aa750e7-83f9-4342-a11f-bbb0bebb0caa tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:06:23.137101 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-0aa750e7-83f9-4342-a11f-bbb0bebb0caa tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:06:23.143118 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-0aa750e7-83f9-4342-a11f-bbb0bebb0caa tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:06:24.167018 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.network.neutron [None req-38fa6870-a1f1-4d10-8c53-09524beaeeec tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] [instance: 307ee785-a01d-401c-8be2-b17558e735f3] Updating instance_info_cache with network_info: [{"id": "d65b5fcd-5bb6-4feb-b4bf-95734bcb3072", "address": "fa:16:3e:8e:cf:5c", "network": {"id": "5b808c64-bf01-4ded-bf6b-0b3fd18d2f1c", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-768163193-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "eda6511ea24c4c19a7c5d91535c7288d", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapd65b5fcd-5b", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=121402) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Nov 01 19:06:24.180878 n-d-863052-2 devstack@n-api.service[121402]: DEBUG dbcounter [-] [121402] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 19:06:24.183640 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.network.neutron [None req-38fa6870-a1f1-4d10-8c53-09524beaeeec tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] [instance: 86162175-5f45-4aa7-9825-f1a3b4a699ff] Building network info cache for instance {{(pid=121402) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Nov 01 19:06:24.196834 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-0aa750e7-83f9-4342-a11f-bbb0bebb0caa tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05d6a1722dfa4e959aeb14d601e43b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b5d812eff94e2f89d4705d7e7d5f3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:06:24.219841 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-0aa750e7-83f9-4342-a11f-bbb0bebb0caa tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] 10.222.0.13 "GET /compute/v2.1/servers/0b57b50d-1ec4-4ee1-ac3a-f6f44d68a2c3" status: 200 len: 1515 microversion: 2.1 time: 1.133558 Nov 01 19:06:24.222054 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1516/2987] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:06:23 2022] GET /compute/v2.1/servers/0b57b50d-1ec4-4ee1-ac3a-f6f44d68a2c3 => generated 1515 bytes in 1136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:06:24.667152 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-0eef33ca-414e-4201-8e56-076ab4fb3c63 tempest-AttachSCSIVolumeTestJSON-356336257 tempest-AttachSCSIVolumeTestJSON-356336257-project] Action: 'create', calling method: .version_select at 0x7f0ae1d7c550>, body: {"keypair": {"name": "tempest-keypair-1984786559", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPtoYbAV2us3C720P5llPTAZRjY3JNyRtgxD+dXrlLoDRhfcMYqR/0cmGL9lMvXZlJJfSHfmA0Wfqk57UQLcxqmwiYrrW65pOTy74yT9M4BsBZElZx5mjvtp6Oar/O9Y2g=="}} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:06:24.689850 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.quota [None req-0eef33ca-414e-4201-8e56-076ab4fb3c63 tempest-AttachSCSIVolumeTestJSON-356336257 tempest-AttachSCSIVolumeTestJSON-356336257-project] Getting quotas for project 7b14142c34d54977ac9eb59962f2a9e1. Resources: {'key_pairs'} {{(pid=121403) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 01 19:06:24.696306 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.quota [None req-0eef33ca-414e-4201-8e56-076ab4fb3c63 tempest-AttachSCSIVolumeTestJSON-356336257 tempest-AttachSCSIVolumeTestJSON-356336257-project] Getting quotas for user cde7667dbbfd4864a5b0ca8d8b291406 and project 7b14142c34d54977ac9eb59962f2a9e1. Resources: {'key_pairs'} {{(pid=121403) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 01 19:06:24.743552 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-0eef33ca-414e-4201-8e56-076ab4fb3c63 tempest-AttachSCSIVolumeTestJSON-356336257 tempest-AttachSCSIVolumeTestJSON-356336257-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.519720 Nov 01 19:06:24.745490 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1517/2988] 10.222.0.13 () {60 vars in 1159 bytes} [Tue Nov 1 19:06:24 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:06:24.755002 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [req-3bd1b661-55c5-4a25-9e56-658298e71bc9 req-7d6bc21a-1842-4d90-aa03-6dc1705514d0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "307ee785-a01d-401c-8be2-b17558e735f3", "tag": "d65b5fcd-5bb6-4feb-b4bf-95734bcb3072"}]} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:06:24.768538 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-3bd1b661-55c5-4a25-9e56-658298e71bc9 req-7d6bc21a-1842-4d90-aa03-6dc1705514d0 service nova] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:06:24.769235 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-3bd1b661-55c5-4a25-9e56-658298e71bc9 req-7d6bc21a-1842-4d90-aa03-6dc1705514d0 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:06:24.769683 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-3bd1b661-55c5-4a25-9e56-658298e71bc9 req-7d6bc21a-1842-4d90-aa03-6dc1705514d0 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:06:24.783617 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.compute.server_external_events [req-3bd1b661-55c5-4a25-9e56-658298e71bc9 req-7d6bc21a-1842-4d90-aa03-6dc1705514d0 service nova] Creating event network-changed:d65b5fcd-5bb6-4feb-b4bf-95734bcb3072 for instance 307ee785-a01d-401c-8be2-b17558e735f3 on n-h2-863052-2 Nov 01 19:06:24.790420 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [req-3bd1b661-55c5-4a25-9e56-658298e71bc9 req-7d6bc21a-1842-4d90-aa03-6dc1705514d0 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043621 Nov 01 19:06:24.791709 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1518/2989] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Nov 1 19:06:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:06:24.797644 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-3e1c7ac3-0b68-465d-8d50-4cd9c280b47c tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:06:24.806448 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-3e1c7ac3-0b68-465d-8d50-4cd9c280b47c tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] [instance: 990f3535-a5c4-4f62-bed9-b310a77293c8] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:06:24.819141 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-3e1c7ac3-0b68-465d-8d50-4cd9c280b47c tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:06:24.819645 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-3e1c7ac3-0b68-465d-8d50-4cd9c280b47c tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:06:24.820479 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-3e1c7ac3-0b68-465d-8d50-4cd9c280b47c tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:06:24.822163 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-3e1c7ac3-0b68-465d-8d50-4cd9c280b47c tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:06:24.823620 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-3e1c7ac3-0b68-465d-8d50-4cd9c280b47c tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:06:24.824218 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-3e1c7ac3-0b68-465d-8d50-4cd9c280b47c tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:06:24.953352 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-3e1c7ac3-0b68-465d-8d50-4cd9c280b47c tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '058480d92c9b4ab4af6815d0438a65c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee9dc49b89143f781e4ab30296e4d01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:06:24.965722 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-3e1c7ac3-0b68-465d-8d50-4cd9c280b47c tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] 10.222.0.13 "GET /compute/v2.1/servers/990f3535-a5c4-4f62-bed9-b310a77293c8" status: 200 len: 1345 microversion: 2.1 time: 0.172554 Nov 01 19:06:24.980613 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1519/2990] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:06:24 2022] GET /compute/v2.1/servers/990f3535-a5c4-4f62-bed9-b310a77293c8 => generated 1345 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:06:24.985256 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-60890b7e-4fc2-4b4b-8f84-383223d74287 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:06:24.986199 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-60890b7e-4fc2-4b4b-8f84-383223d74287 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] [instance: af1071a8-a090-44c9-890c-123ca3ff39f1] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:06:24.996109 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-60890b7e-4fc2-4b4b-8f84-383223d74287 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:06:24.997587 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-60890b7e-4fc2-4b4b-8f84-383223d74287 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:06:24.998262 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-60890b7e-4fc2-4b4b-8f84-383223d74287 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:06:25.006060 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-60890b7e-4fc2-4b4b-8f84-383223d74287 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:06:25.006867 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-60890b7e-4fc2-4b4b-8f84-383223d74287 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:06:25.007522 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-60890b7e-4fc2-4b4b-8f84-383223d74287 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:06:25.081878 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.network.neutron [None req-38fa6870-a1f1-4d10-8c53-09524beaeeec tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] [instance: 86162175-5f45-4aa7-9825-f1a3b4a699ff] Updating instance_info_cache with network_info: [{"id": "e985c4cd-3aee-4c89-a53f-f69bb65a4339", "address": "fa:16:3e:c2:86:d5", "network": {"id": "5b808c64-bf01-4ded-bf6b-0b3fd18d2f1c", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-768163193-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.8.254", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "eda6511ea24c4c19a7c5d91535c7288d", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tape985c4cd-3a", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=121402) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Nov 01 19:06:25.109131 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-38fa6870-a1f1-4d10-8c53-09524beaeeec tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] Releasing lock "refresh_cache-86162175-5f45-4aa7-9825-f1a3b4a699ff" {{(pid=121402) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Nov 01 19:06:25.111298 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-38fa6870-a1f1-4d10-8c53-09524beaeeec tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] 10.222.0.13 "POST /compute/v2.1/servers/86162175-5f45-4aa7-9825-f1a3b4a699ff/action" status: 202 len: 0 microversion: 2.1 time: 8.283899 Nov 01 19:06:25.114824 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1472/2991] 10.222.0.13 () {60 vars in 1278 bytes} [Tue Nov 1 19:06:16 2022] POST /compute/v2.1/servers/86162175-5f45-4aa7-9825-f1a3b4a699ff/action => generated 0 bytes in 8288 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Nov 01 19:06:25.124366 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-20f8eb3d-6d17-4f43-a7c7-a4b35fe58e51 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:06:25.144252 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-20f8eb3d-6d17-4f43-a7c7-a4b35fe58e51 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] [instance: ba6ffc5c-84a4-40f1-bdc7-f87dde2c99df] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:06:25.152886 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-20f8eb3d-6d17-4f43-a7c7-a4b35fe58e51 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:06:25.153834 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-20f8eb3d-6d17-4f43-a7c7-a4b35fe58e51 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:06:25.154511 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-20f8eb3d-6d17-4f43-a7c7-a4b35fe58e51 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:06:25.155761 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-20f8eb3d-6d17-4f43-a7c7-a4b35fe58e51 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:06:25.156483 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-20f8eb3d-6d17-4f43-a7c7-a4b35fe58e51 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:06:25.157230 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-20f8eb3d-6d17-4f43-a7c7-a4b35fe58e51 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:06:25.517604 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-60890b7e-4fc2-4b4b-8f84-383223d74287 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '301ed3b9c37449bc9ade378f3c73a768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8807757227574c828dca1947af76659d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:06:25.531651 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-60890b7e-4fc2-4b4b-8f84-383223d74287 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '301ed3b9c37449bc9ade378f3c73a768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8807757227574c828dca1947af76659d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:06:25.533138 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-60890b7e-4fc2-4b4b-8f84-383223d74287 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '301ed3b9c37449bc9ade378f3c73a768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8807757227574c828dca1947af76659d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:06:25.538186 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-60890b7e-4fc2-4b4b-8f84-383223d74287 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] 10.222.0.13 "GET /compute/v2.1/servers/af1071a8-a090-44c9-890c-123ca3ff39f1" status: 200 len: 1880 microversion: 2.42 time: 0.564148 Nov 01 19:06:25.539610 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1520/2992] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 19:06:24 2022] GET /compute/v2.1/servers/af1071a8-a090-44c9-890c-123ca3ff39f1 => generated 1880 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 19:06:25.556738 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-d04cdae8-9982-4d6a-b00e-9941890d1e00 tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.8.254"}} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:06:25.647352 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-20f8eb3d-6d17-4f43-a7c7-a4b35fe58e51 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd2105b0264b48d084d0e79cabff8bc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf4adda91364dab94830347c06e3957', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:06:25.663939 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-20f8eb3d-6d17-4f43-a7c7-a4b35fe58e51 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd2105b0264b48d084d0e79cabff8bc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf4adda91364dab94830347c06e3957', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:06:25.670394 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-20f8eb3d-6d17-4f43-a7c7-a4b35fe58e51 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd2105b0264b48d084d0e79cabff8bc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf4adda91364dab94830347c06e3957', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:06:25.672814 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-20f8eb3d-6d17-4f43-a7c7-a4b35fe58e51 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] 10.222.0.13 "GET /compute/v2.1/servers/ba6ffc5c-84a4-40f1-bdc7-f87dde2c99df" status: 200 len: 1845 microversion: 2.32 time: 0.556636 Nov 01 19:06:25.675871 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1473/2993] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 19:06:25 2022] GET /compute/v2.1/servers/ba6ffc5c-84a4-40f1-bdc7-f87dde2c99df => generated 1845 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 19:06:25.681348 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-eae591a0-ddd5-41bb-a27f-0251205b2793 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:06:25.692408 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-eae591a0-ddd5-41bb-a27f-0251205b2793 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] [instance: 0b57b50d-1ec4-4ee1-ac3a-f6f44d68a2c3] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:06:25.706850 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-eae591a0-ddd5-41bb-a27f-0251205b2793 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:06:25.707599 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-eae591a0-ddd5-41bb-a27f-0251205b2793 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:06:25.713269 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-eae591a0-ddd5-41bb-a27f-0251205b2793 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:06:25.714033 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-eae591a0-ddd5-41bb-a27f-0251205b2793 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:06:25.714528 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-eae591a0-ddd5-41bb-a27f-0251205b2793 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:06:25.714959 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-eae591a0-ddd5-41bb-a27f-0251205b2793 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:06:26.058199 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-d04cdae8-9982-4d6a-b00e-9941890d1e00 tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] [instance: 86162175-5f45-4aa7-9825-f1a3b4a699ff] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:06:26.065493 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d04cdae8-9982-4d6a-b00e-9941890d1e00 tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:06:26.066085 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d04cdae8-9982-4d6a-b00e-9941890d1e00 tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:06:26.066777 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d04cdae8-9982-4d6a-b00e-9941890d1e00 tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:06:26.067954 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d04cdae8-9982-4d6a-b00e-9941890d1e00 tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:06:26.069495 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d04cdae8-9982-4d6a-b00e-9941890d1e00 tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:06:26.070809 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d04cdae8-9982-4d6a-b00e-9941890d1e00 tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:06:26.193318 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-eae591a0-ddd5-41bb-a27f-0251205b2793 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05d6a1722dfa4e959aeb14d601e43b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b5d812eff94e2f89d4705d7e7d5f3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:06:26.205030 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-eae591a0-ddd5-41bb-a27f-0251205b2793 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] 10.222.0.13 "GET /compute/v2.1/servers/0b57b50d-1ec4-4ee1-ac3a-f6f44d68a2c3" status: 200 len: 1515 microversion: 2.1 time: 0.527445 Nov 01 19:06:26.206207 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1474/2994] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:06:25 2022] GET /compute/v2.1/servers/0b57b50d-1ec4-4ee1-ac3a-f6f44d68a2c3 => generated 1515 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:06:26.217453 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [req-b8090230-4bbb-45a6-a946-1d7a8971e750 req-8229a6f4-bd8b-4b6f-b161-1e08861ec666 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ba6ffc5c-84a4-40f1-bdc7-f87dde2c99df", "tag": "df21a011-7bab-4ed2-bd70-fb0e2d704b1f"}]} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:06:26.229883 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-b8090230-4bbb-45a6-a946-1d7a8971e750 req-8229a6f4-bd8b-4b6f-b161-1e08861ec666 service nova] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:06:26.230583 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-b8090230-4bbb-45a6-a946-1d7a8971e750 req-8229a6f4-bd8b-4b6f-b161-1e08861ec666 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:06:26.231375 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-b8090230-4bbb-45a6-a946-1d7a8971e750 req-8229a6f4-bd8b-4b6f-b161-1e08861ec666 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:06:26.243257 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.compute.server_external_events [req-b8090230-4bbb-45a6-a946-1d7a8971e750 req-8229a6f4-bd8b-4b6f-b161-1e08861ec666 service nova] Creating event network-changed:df21a011-7bab-4ed2-bd70-fb0e2d704b1f for instance ba6ffc5c-84a4-40f1-bdc7-f87dde2c99df on n-h1-863052-2 Nov 01 19:06:26.248629 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [req-b8090230-4bbb-45a6-a946-1d7a8971e750 req-8229a6f4-bd8b-4b6f-b161-1e08861ec666 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040863 Nov 01 19:06:26.249755 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1475/2995] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Nov 1 19:06:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:06:26.255804 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-64103967-5db1-4258-b7d2-62ede8131e8e tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Action: 'create', calling method: .version_select at 0x7f0ae1aa8430>, body: {"keypair": {"name": "tempest-keypair-1262518302", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJe4DdAEHUQfpEZdUGQhYxzCQ//bJAPzJLVgOxmmJOmwwxl0q0tTqwUwaTnLXkhFedfJTRWcUrpbyVx3g1IcmIRcB5PRbf39JKpz6cMjtK+EoHq2UBQVrKIhL0woGElcqw=="}} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:06:26.295836 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.quota [None req-64103967-5db1-4258-b7d2-62ede8131e8e tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Getting quotas for project 33e3d319293c46b6af2f728a50586906. Resources: {'key_pairs'} {{(pid=121402) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 01 19:06:26.302473 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.quota [None req-64103967-5db1-4258-b7d2-62ede8131e8e tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Getting quotas for user 790f3f1566b7464aaca19d4d05c0942e and project 33e3d319293c46b6af2f728a50586906. Resources: {'key_pairs'} {{(pid=121402) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 01 19:06:26.353333 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-64103967-5db1-4258-b7d2-62ede8131e8e tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.101474 Nov 01 19:06:26.355331 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1476/2996] 10.222.0.13 () {60 vars in 1159 bytes} [Tue Nov 1 19:06:26 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:06:26.361979 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-6a2f8b1c-e58e-4b8c-933d-b1fcaada38b0 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:06:26.362726 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-6a2f8b1c-e58e-4b8c-933d-b1fcaada38b0 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] [instance: 990f3535-a5c4-4f62-bed9-b310a77293c8] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:06:26.374319 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-6a2f8b1c-e58e-4b8c-933d-b1fcaada38b0 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:06:26.374865 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-6a2f8b1c-e58e-4b8c-933d-b1fcaada38b0 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:06:26.375629 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-6a2f8b1c-e58e-4b8c-933d-b1fcaada38b0 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:06:26.376400 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-6a2f8b1c-e58e-4b8c-933d-b1fcaada38b0 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:06:26.378279 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-6a2f8b1c-e58e-4b8c-933d-b1fcaada38b0 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:06:26.379785 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-6a2f8b1c-e58e-4b8c-933d-b1fcaada38b0 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:06:26.615927 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-6a2f8b1c-e58e-4b8c-933d-b1fcaada38b0 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '058480d92c9b4ab4af6815d0438a65c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee9dc49b89143f781e4ab30296e4d01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:06:26.627684 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-6a2f8b1c-e58e-4b8c-933d-b1fcaada38b0 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] 10.222.0.13 "GET /compute/v2.1/servers/990f3535-a5c4-4f62-bed9-b310a77293c8" status: 200 len: 1345 microversion: 2.1 time: 0.271219 Nov 01 19:06:26.629019 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1477/2997] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:06:26 2022] GET /compute/v2.1/servers/990f3535-a5c4-4f62-bed9-b310a77293c8 => generated 1345 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:06:26.652500 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-25272b74-a435-40f0-a3d2-cffccaacbfb5 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:06:26.654706 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-25272b74-a435-40f0-a3d2-cffccaacbfb5 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] [instance: af1071a8-a090-44c9-890c-123ca3ff39f1] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:06:26.663626 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-25272b74-a435-40f0-a3d2-cffccaacbfb5 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:06:26.664950 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-25272b74-a435-40f0-a3d2-cffccaacbfb5 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:06:26.665658 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-25272b74-a435-40f0-a3d2-cffccaacbfb5 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:06:26.667183 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-25272b74-a435-40f0-a3d2-cffccaacbfb5 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:06:26.668358 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-25272b74-a435-40f0-a3d2-cffccaacbfb5 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:06:26.669062 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-25272b74-a435-40f0-a3d2-cffccaacbfb5 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:06:26.834245 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.wsgi [None req-d04cdae8-9982-4d6a-b00e-9941890d1e00 tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] HTTP exception thrown: Floating IP 172.25.8.254 is not associated with instance 307ee785-a01d-401c-8be2-b17558e735f3. Nov 01 19:06:26.837878 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-d04cdae8-9982-4d6a-b00e-9941890d1e00 tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] Request method failure captured: Nov 01 19:06:26.837878 n-d-863052-2 devstack@n-api.service[121403]: request: POST /compute/v2.1/servers/307ee785-a01d-401c-8be2-b17558e735f3/action HTTP/1.1 Nov 01 19:06:26.837878 n-d-863052-2 devstack@n-api.service[121403]: Accept: application/json Nov 01 19:06:26.837878 n-d-863052-2 devstack@n-api.service[121403]: Accept-Encoding: identity Nov 01 19:06:26.837878 n-d-863052-2 devstack@n-api.service[121403]: Connection: close Nov 01 19:06:26.837878 n-d-863052-2 devstack@n-api.service[121403]: Content-Length: 49 Nov 01 19:06:26.837878 n-d-863052-2 devstack@n-api.service[121403]: Content-Type: application/json Nov 01 19:06:26.837878 n-d-863052-2 devstack@n-api.service[121403]: Host: 10.222.0.13 Nov 01 19:06:26.837878 n-d-863052-2 devstack@n-api.service[121403]: Openstack-System-Scope: None Nov 01 19:06:26.837878 n-d-863052-2 devstack@n-api.service[121403]: User-Agent: python-urllib3/1.26.12 Nov 01 19:06:26.837878 n-d-863052-2 devstack@n-api.service[121403]: X-Auth-Token: gAAAAABjYW3l1zjt15tpRvy62ZUmUnf-XZxpbSJaR0Dz3soyrlzi86jlPzPKEooclquc3opw_GKrdbXdSeyzKLo3vUIm9CiW9UDiYVDmVEaSOvihx8IsbHZQB9Keg8pxW47Z9w5HYtZDEK-2NPCONnIEl4lawojb3pMdAC01mBceYWT19W8flDo Nov 01 19:06:26.837878 n-d-863052-2 devstack@n-api.service[121403]: X-Domain-Id: None Nov 01 19:06:26.837878 n-d-863052-2 devstack@n-api.service[121403]: X-Domain-Name: None Nov 01 19:06:26.837878 n-d-863052-2 devstack@n-api.service[121403]: X-Identity-Status: Confirmed Nov 01 19:06:26.837878 n-d-863052-2 devstack@n-api.service[121403]: X-Is-Admin-Project: True Nov 01 19:06:26.837878 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Domain-Id: default Nov 01 19:06:26.837878 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Domain-Name: Default Nov 01 19:06:26.837878 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Id: eda6511ea24c4c19a7c5d91535c7288d Nov 01 19:06:26.837878 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-1224240465 Nov 01 19:06:26.837878 n-d-863052-2 devstack@n-api.service[121403]: X-Role: member,reader Nov 01 19:06:26.837878 n-d-863052-2 devstack@n-api.service[121403]: X-Roles: member,reader Nov 01 19:06:26.837878 n-d-863052-2 devstack@n-api.service[121403]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/eda6511ea24c4c19a7c5d91535c7288d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/eda6511ea24c4c19a7c5d91535c7288d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_eda6511ea24c4c19a7c5d91535c7288d", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/eda6511ea24c4c19a7c5d91535c7288d"}]}] Nov 01 19:06:26.837878 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-1224240465 Nov 01 19:06:26.837878 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant-Id: eda6511ea24c4c19a7c5d91535c7288d Nov 01 19:06:26.837878 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-1224240465 Nov 01 19:06:26.837878 n-d-863052-2 devstack@n-api.service[121403]: X-User: tempest-FloatingIPsAssociationTestJSON-1224240465-project Nov 01 19:06:26.837878 n-d-863052-2 devstack@n-api.service[121403]: X-User-Domain-Id: default Nov 01 19:06:26.837878 n-d-863052-2 devstack@n-api.service[121403]: X-User-Domain-Name: Default Nov 01 19:06:26.837878 n-d-863052-2 devstack@n-api.service[121403]: X-User-Id: cb87e6147a6f470391921ac3b7a62f8d Nov 01 19:06:26.837878 n-d-863052-2 devstack@n-api.service[121403]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-1224240465-project Nov 01 19:06:26.837878 n-d-863052-2 devstack@n-api.service[121403]: Nov 01 19:06:26.837878 n-d-863052-2 devstack@n-api.service[121403]: {"removeFloatingIp": {"address": "172.25.8.254"}} Nov 01 19:06:26.837878 n-d-863052-2 devstack@n-api.service[121403]: method: Nov 01 19:06:26.837878 n-d-863052-2 devstack@n-api.service[121403]: exception: Floating IP 172.25.8.254 is not associated with instance 307ee785-a01d-401c-8be2-b17558e735f3. Nov 01 19:06:26.837878 n-d-863052-2 devstack@n-api.service[121403]: action_args: {'id': '307ee785-a01d-401c-8be2-b17558e735f3', 'body': {'removeFloatingIp': {'address': '172.25.8.254'}}} Nov 01 19:06:26.837878 n-d-863052-2 devstack@n-api.service[121403]: {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 01 19:06:26.837878 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:06:26.837878 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:06:26.837878 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:06:26.837878 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 01 19:06:26.837878 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 01 19:06:26.837878 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 01 19:06:26.837878 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 01 19:06:26.837878 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 01 19:06:26.837878 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 01 19:06:26.837878 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 01 19:06:26.837878 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 01 19:06:26.837878 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 300, in _remove_floating_ip Nov 01 19:06:26.837878 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Nov 01 19:06:26.837878 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Floating IP 172.25.8.254 is not associated with instance 307ee785-a01d-401c-8be2-b17558e735f3. Nov 01 19:06:26.837878 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:06:26.837878 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:06:26.837878 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:06:26.837878 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:06:26.837878 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:06:26.837878 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:06:26.837878 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 01 19:06:26.837878 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 01 19:06:26.837878 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP 172.25.8.254 is not associated with instance 307ee785-a01d-401c-8be2-b17558e735f3. Nov 01 19:06:26.837878 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:06:26.847784 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-d04cdae8-9982-4d6a-b00e-9941890d1e00 tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] Returning 409 to user: Floating IP 172.25.8.254 is not associated with instance 307ee785-a01d-401c-8be2-b17558e735f3. {{(pid=121403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 01 19:06:26.849186 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-d04cdae8-9982-4d6a-b00e-9941890d1e00 tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] 10.222.0.13 "POST /compute/v2.1/servers/307ee785-a01d-401c-8be2-b17558e735f3/action" status: 409 len: 146 microversion: 2.1 time: 1.307536 Nov 01 19:06:26.851659 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1521/2998] 10.222.0.13 () {60 vars in 1278 bytes} [Tue Nov 1 19:06:25 2022] POST /compute/v2.1/servers/307ee785-a01d-401c-8be2-b17558e735f3/action => generated 146 bytes in 1311 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Nov 01 19:06:26.863194 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-303239a5-5b0d-4b9e-aa25-900442f9a6b7 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:06:26.864297 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-303239a5-5b0d-4b9e-aa25-900442f9a6b7 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] [instance: ba6ffc5c-84a4-40f1-bdc7-f87dde2c99df] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:06:26.874403 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-303239a5-5b0d-4b9e-aa25-900442f9a6b7 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:06:26.875761 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-303239a5-5b0d-4b9e-aa25-900442f9a6b7 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:06:26.876750 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-303239a5-5b0d-4b9e-aa25-900442f9a6b7 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:06:26.878352 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-303239a5-5b0d-4b9e-aa25-900442f9a6b7 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:06:26.879018 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-303239a5-5b0d-4b9e-aa25-900442f9a6b7 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:06:26.879756 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-303239a5-5b0d-4b9e-aa25-900442f9a6b7 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:06:26.926424 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-25272b74-a435-40f0-a3d2-cffccaacbfb5 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '301ed3b9c37449bc9ade378f3c73a768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8807757227574c828dca1947af76659d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:06:26.951811 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-25272b74-a435-40f0-a3d2-cffccaacbfb5 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '301ed3b9c37449bc9ade378f3c73a768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8807757227574c828dca1947af76659d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:06:26.955926 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-25272b74-a435-40f0-a3d2-cffccaacbfb5 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '301ed3b9c37449bc9ade378f3c73a768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8807757227574c828dca1947af76659d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:06:26.957414 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-25272b74-a435-40f0-a3d2-cffccaacbfb5 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] 10.222.0.13 "GET /compute/v2.1/servers/af1071a8-a090-44c9-890c-123ca3ff39f1" status: 200 len: 1880 microversion: 2.42 time: 0.313788 Nov 01 19:06:26.957978 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1478/2999] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 19:06:26 2022] GET /compute/v2.1/servers/af1071a8-a090-44c9-890c-123ca3ff39f1 => generated 1880 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 19:06:26.982940 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [req-fa1337ed-55b8-4521-b1f9-5c3aaf270ff8 req-91409a66-98dc-45f1-b375-fd2d4bfd5d65 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "990f3535-a5c4-4f62-bed9-b310a77293c8", "name": "network-vif-deleted", "tag": "28a32cc7-6861-459e-b63a-b5e5fdb67572"}, {"name": "network-changed", "server_uuid": "86162175-5f45-4aa7-9825-f1a3b4a699ff", "tag": "e985c4cd-3aee-4c89-a53f-f69bb65a4339"}]} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:06:27.001670 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-fa1337ed-55b8-4521-b1f9-5c3aaf270ff8 req-91409a66-98dc-45f1-b375-fd2d4bfd5d65 service nova] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:06:27.003330 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-fa1337ed-55b8-4521-b1f9-5c3aaf270ff8 req-91409a66-98dc-45f1-b375-fd2d4bfd5d65 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:06:27.004071 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-fa1337ed-55b8-4521-b1f9-5c3aaf270ff8 req-91409a66-98dc-45f1-b375-fd2d4bfd5d65 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:06:27.024508 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.compute.server_external_events [req-fa1337ed-55b8-4521-b1f9-5c3aaf270ff8 req-91409a66-98dc-45f1-b375-fd2d4bfd5d65 service nova] Creating event network-vif-deleted:28a32cc7-6861-459e-b63a-b5e5fdb67572 for instance 990f3535-a5c4-4f62-bed9-b310a77293c8 on n-h1-863052-2 Nov 01 19:06:27.025435 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.compute.server_external_events [req-fa1337ed-55b8-4521-b1f9-5c3aaf270ff8 req-91409a66-98dc-45f1-b375-fd2d4bfd5d65 service nova] Creating event network-changed:e985c4cd-3aee-4c89-a53f-f69bb65a4339 for instance 86162175-5f45-4aa7-9825-f1a3b4a699ff on n-h1-863052-2 Nov 01 19:06:27.033482 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [req-fa1337ed-55b8-4521-b1f9-5c3aaf270ff8 req-91409a66-98dc-45f1-b375-fd2d4bfd5d65 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.072102 Nov 01 19:06:27.034525 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1479/3000] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Nov 1 19:06:26 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:06:27.040311 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-2d7e6d7e-8f28-46f8-b16a-692bc6323f31 tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.8.254"}} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:06:27.315569 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-2d7e6d7e-8f28-46f8-b16a-692bc6323f31 tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] [instance: 86162175-5f45-4aa7-9825-f1a3b4a699ff] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:06:27.321899 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2d7e6d7e-8f28-46f8-b16a-692bc6323f31 tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:06:27.322599 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2d7e6d7e-8f28-46f8-b16a-692bc6323f31 tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:06:27.323229 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2d7e6d7e-8f28-46f8-b16a-692bc6323f31 tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:06:27.324105 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2d7e6d7e-8f28-46f8-b16a-692bc6323f31 tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:06:27.324800 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2d7e6d7e-8f28-46f8-b16a-692bc6323f31 tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:06:27.325386 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2d7e6d7e-8f28-46f8-b16a-692bc6323f31 tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:06:27.399829 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-303239a5-5b0d-4b9e-aa25-900442f9a6b7 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd2105b0264b48d084d0e79cabff8bc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf4adda91364dab94830347c06e3957', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:06:27.410117 n-d-863052-2 devstack@n-api.service[121403]: DEBUG dbcounter [-] [121403] Writing DB stats nova_cell1:SELECT=95,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=2,nova_cell1:RELEASE=1,nova_cell1:INSERT=1 {{(pid=121403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 19:06:27.417507 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-303239a5-5b0d-4b9e-aa25-900442f9a6b7 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd2105b0264b48d084d0e79cabff8bc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf4adda91364dab94830347c06e3957', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:06:27.420328 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-303239a5-5b0d-4b9e-aa25-900442f9a6b7 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd2105b0264b48d084d0e79cabff8bc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf4adda91364dab94830347c06e3957', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:06:27.422405 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-303239a5-5b0d-4b9e-aa25-900442f9a6b7 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] 10.222.0.13 "GET /compute/v2.1/servers/ba6ffc5c-84a4-40f1-bdc7-f87dde2c99df" status: 200 len: 1866 microversion: 2.32 time: 0.569588 Nov 01 19:06:27.424230 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1522/3001] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 19:06:26 2022] GET /compute/v2.1/servers/ba6ffc5c-84a4-40f1-bdc7-f87dde2c99df => generated 1866 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 19:06:27.429849 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-dd90745c-a828-41a4-a50c-91c856974d0e tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:06:27.430813 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-dd90745c-a828-41a4-a50c-91c856974d0e tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] [instance: 0b57b50d-1ec4-4ee1-ac3a-f6f44d68a2c3] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:06:27.440738 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-dd90745c-a828-41a4-a50c-91c856974d0e tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:06:27.441880 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-dd90745c-a828-41a4-a50c-91c856974d0e tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:06:27.442672 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-dd90745c-a828-41a4-a50c-91c856974d0e tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:06:27.443702 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-dd90745c-a828-41a4-a50c-91c856974d0e tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:06:27.444395 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-dd90745c-a828-41a4-a50c-91c856974d0e tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:06:27.445263 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-dd90745c-a828-41a4-a50c-91c856974d0e tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:06:27.837916 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-dd90745c-a828-41a4-a50c-91c856974d0e tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05d6a1722dfa4e959aeb14d601e43b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b5d812eff94e2f89d4705d7e7d5f3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:06:27.851232 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-dd90745c-a828-41a4-a50c-91c856974d0e tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] 10.222.0.13 "GET /compute/v2.1/servers/0b57b50d-1ec4-4ee1-ac3a-f6f44d68a2c3" status: 200 len: 1515 microversion: 2.1 time: 0.420976 Nov 01 19:06:27.856184 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1523/3002] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:06:27 2022] GET /compute/v2.1/servers/0b57b50d-1ec4-4ee1-ac3a-f6f44d68a2c3 => generated 1515 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:06:27.866890 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-b2a69850-8763-48c4-9244-8637ce05b242 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:06:27.868417 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-b2a69850-8763-48c4-9244-8637ce05b242 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] [instance: 990f3535-a5c4-4f62-bed9-b310a77293c8] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:06:27.883315 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-b2a69850-8763-48c4-9244-8637ce05b242 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:06:27.889983 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-b2a69850-8763-48c4-9244-8637ce05b242 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:06:27.893072 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-b2a69850-8763-48c4-9244-8637ce05b242 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:06:27.894110 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-b2a69850-8763-48c4-9244-8637ce05b242 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:06:27.895948 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-b2a69850-8763-48c4-9244-8637ce05b242 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:06:27.898690 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-b2a69850-8763-48c4-9244-8637ce05b242 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:06:28.187430 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2d7e6d7e-8f28-46f8-b16a-692bc6323f31 tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] Acquiring lock "refresh_cache-86162175-5f45-4aa7-9825-f1a3b4a699ff" {{(pid=121402) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Nov 01 19:06:28.187816 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2d7e6d7e-8f28-46f8-b16a-692bc6323f31 tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] Acquired lock "refresh_cache-86162175-5f45-4aa7-9825-f1a3b4a699ff" {{(pid=121402) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Nov 01 19:06:28.498289 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-b2a69850-8763-48c4-9244-8637ce05b242 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '058480d92c9b4ab4af6815d0438a65c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee9dc49b89143f781e4ab30296e4d01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:06:28.514871 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-b2a69850-8763-48c4-9244-8637ce05b242 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] 10.222.0.13 "GET /compute/v2.1/servers/990f3535-a5c4-4f62-bed9-b310a77293c8" status: 200 len: 1345 microversion: 2.1 time: 0.657373 Nov 01 19:06:28.528617 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1524/3003] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:06:27 2022] GET /compute/v2.1/servers/990f3535-a5c4-4f62-bed9-b310a77293c8 => generated 1345 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:06:28.528617 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-86950a0d-a96d-48b1-8011-11b9e10628a1 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:06:28.528617 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-86950a0d-a96d-48b1-8011-11b9e10628a1 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] [instance: af1071a8-a090-44c9-890c-123ca3ff39f1] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:06:28.550161 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-86950a0d-a96d-48b1-8011-11b9e10628a1 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:06:28.550161 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-86950a0d-a96d-48b1-8011-11b9e10628a1 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:06:28.550161 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-86950a0d-a96d-48b1-8011-11b9e10628a1 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:06:28.552105 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-86950a0d-a96d-48b1-8011-11b9e10628a1 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:06:28.553641 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-86950a0d-a96d-48b1-8011-11b9e10628a1 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:06:28.555084 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-86950a0d-a96d-48b1-8011-11b9e10628a1 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:06:29.265592 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-86950a0d-a96d-48b1-8011-11b9e10628a1 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '301ed3b9c37449bc9ade378f3c73a768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8807757227574c828dca1947af76659d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:06:29.275734 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-86950a0d-a96d-48b1-8011-11b9e10628a1 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '301ed3b9c37449bc9ade378f3c73a768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8807757227574c828dca1947af76659d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:06:29.277482 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-86950a0d-a96d-48b1-8011-11b9e10628a1 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '301ed3b9c37449bc9ade378f3c73a768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8807757227574c828dca1947af76659d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:06:29.279548 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-86950a0d-a96d-48b1-8011-11b9e10628a1 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] 10.222.0.13 "GET /compute/v2.1/servers/af1071a8-a090-44c9-890c-123ca3ff39f1" status: 200 len: 1880 microversion: 2.42 time: 0.761479 Nov 01 19:06:29.293137 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1525/3004] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 19:06:28 2022] GET /compute/v2.1/servers/af1071a8-a090-44c9-890c-123ca3ff39f1 => generated 1880 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 19:06:29.305058 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-7459a2a4-64db-4f74-9027-73884f09587a tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:06:29.306093 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-7459a2a4-64db-4f74-9027-73884f09587a tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] [instance: ba6ffc5c-84a4-40f1-bdc7-f87dde2c99df] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:06:29.312960 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-7459a2a4-64db-4f74-9027-73884f09587a tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:06:29.313817 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-7459a2a4-64db-4f74-9027-73884f09587a tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:06:29.314489 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-7459a2a4-64db-4f74-9027-73884f09587a tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:06:29.315458 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-7459a2a4-64db-4f74-9027-73884f09587a tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:06:29.316144 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-7459a2a4-64db-4f74-9027-73884f09587a tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:06:29.316830 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-7459a2a4-64db-4f74-9027-73884f09587a tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:06:29.746421 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-7459a2a4-64db-4f74-9027-73884f09587a tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd2105b0264b48d084d0e79cabff8bc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf4adda91364dab94830347c06e3957', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:06:29.760952 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-7459a2a4-64db-4f74-9027-73884f09587a tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd2105b0264b48d084d0e79cabff8bc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf4adda91364dab94830347c06e3957', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:06:29.766686 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-7459a2a4-64db-4f74-9027-73884f09587a tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd2105b0264b48d084d0e79cabff8bc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf4adda91364dab94830347c06e3957', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:06:29.770085 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-7459a2a4-64db-4f74-9027-73884f09587a tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] 10.222.0.13 "GET /compute/v2.1/servers/ba6ffc5c-84a4-40f1-bdc7-f87dde2c99df" status: 200 len: 1866 microversion: 2.32 time: 0.475287 Nov 01 19:06:29.771909 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1526/3005] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 19:06:29 2022] GET /compute/v2.1/servers/ba6ffc5c-84a4-40f1-bdc7-f87dde2c99df => generated 1866 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 19:06:29.777853 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [req-b69c6d2b-8519-4722-bb49-9fbd01bc17ed req-ae4c5522-8d5e-48a7-be95-26879436b7aa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ba6ffc5c-84a4-40f1-bdc7-f87dde2c99df", "tag": "b7614985-399c-4722-b5a8-66eda94e4a8f"}]} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:06:29.801753 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-b69c6d2b-8519-4722-bb49-9fbd01bc17ed req-ae4c5522-8d5e-48a7-be95-26879436b7aa service nova] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:06:29.802236 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-b69c6d2b-8519-4722-bb49-9fbd01bc17ed req-ae4c5522-8d5e-48a7-be95-26879436b7aa service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:06:29.802660 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-b69c6d2b-8519-4722-bb49-9fbd01bc17ed req-ae4c5522-8d5e-48a7-be95-26879436b7aa service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:06:29.817895 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.compute.server_external_events [req-b69c6d2b-8519-4722-bb49-9fbd01bc17ed req-ae4c5522-8d5e-48a7-be95-26879436b7aa service nova] Creating event network-changed:b7614985-399c-4722-b5a8-66eda94e4a8f for instance ba6ffc5c-84a4-40f1-bdc7-f87dde2c99df on n-h1-863052-2 Nov 01 19:06:29.823256 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [req-b69c6d2b-8519-4722-bb49-9fbd01bc17ed req-ae4c5522-8d5e-48a7-be95-26879436b7aa service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048872 Nov 01 19:06:29.824393 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1527/3006] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Nov 1 19:06:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:06:29.831148 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-74569929-c4f4-4530-9625-cb7784eb6fd3 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:06:29.832147 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-74569929-c4f4-4530-9625-cb7784eb6fd3 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] [instance: 0b57b50d-1ec4-4ee1-ac3a-f6f44d68a2c3] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:06:29.844036 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-74569929-c4f4-4530-9625-cb7784eb6fd3 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:06:29.846789 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-74569929-c4f4-4530-9625-cb7784eb6fd3 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:06:29.847379 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-74569929-c4f4-4530-9625-cb7784eb6fd3 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:06:29.848175 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-74569929-c4f4-4530-9625-cb7784eb6fd3 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:06:29.849065 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-74569929-c4f4-4530-9625-cb7784eb6fd3 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:06:29.851264 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-74569929-c4f4-4530-9625-cb7784eb6fd3 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:06:30.283813 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.network.neutron [None req-2d7e6d7e-8f28-46f8-b16a-692bc6323f31 tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] [instance: 86162175-5f45-4aa7-9825-f1a3b4a699ff] Building network info cache for instance {{(pid=121402) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Nov 01 19:06:30.395052 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-74569929-c4f4-4530-9625-cb7784eb6fd3 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05d6a1722dfa4e959aeb14d601e43b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b5d812eff94e2f89d4705d7e7d5f3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:06:30.405313 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-74569929-c4f4-4530-9625-cb7784eb6fd3 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] 10.222.0.13 "GET /compute/v2.1/servers/0b57b50d-1ec4-4ee1-ac3a-f6f44d68a2c3" status: 200 len: 1515 microversion: 2.1 time: 0.579249 Nov 01 19:06:30.406025 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1528/3007] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:06:29 2022] GET /compute/v2.1/servers/0b57b50d-1ec4-4ee1-ac3a-f6f44d68a2c3 => generated 1515 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:06:30.427477 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-28254ed4-29bf-44c5-8a6b-7e8a49654d83 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:06:30.428419 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-28254ed4-29bf-44c5-8a6b-7e8a49654d83 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] [instance: 990f3535-a5c4-4f62-bed9-b310a77293c8] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:06:30.444230 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-28254ed4-29bf-44c5-8a6b-7e8a49654d83 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:06:30.445057 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-28254ed4-29bf-44c5-8a6b-7e8a49654d83 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:06:30.445718 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-28254ed4-29bf-44c5-8a6b-7e8a49654d83 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:06:30.446616 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-28254ed4-29bf-44c5-8a6b-7e8a49654d83 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:06:30.453426 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-28254ed4-29bf-44c5-8a6b-7e8a49654d83 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:06:30.454185 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-28254ed4-29bf-44c5-8a6b-7e8a49654d83 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:06:30.567419 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-28254ed4-29bf-44c5-8a6b-7e8a49654d83 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '058480d92c9b4ab4af6815d0438a65c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee9dc49b89143f781e4ab30296e4d01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:06:30.576419 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-28254ed4-29bf-44c5-8a6b-7e8a49654d83 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] 10.222.0.13 "GET /compute/v2.1/servers/990f3535-a5c4-4f62-bed9-b310a77293c8" status: 200 len: 1345 microversion: 2.1 time: 0.168652 Nov 01 19:06:30.582121 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1529/3008] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:06:30 2022] GET /compute/v2.1/servers/990f3535-a5c4-4f62-bed9-b310a77293c8 => generated 1345 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:06:30.592306 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-0ba7b928-bfd9-433f-abed-79ee08fd0f05 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:06:30.598724 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-0ba7b928-bfd9-433f-abed-79ee08fd0f05 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] [instance: af1071a8-a090-44c9-890c-123ca3ff39f1] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:06:30.605690 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-0ba7b928-bfd9-433f-abed-79ee08fd0f05 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:06:30.617447 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-0ba7b928-bfd9-433f-abed-79ee08fd0f05 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:06:30.618306 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-0ba7b928-bfd9-433f-abed-79ee08fd0f05 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:06:30.619318 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-0ba7b928-bfd9-433f-abed-79ee08fd0f05 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:06:30.620027 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-0ba7b928-bfd9-433f-abed-79ee08fd0f05 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:06:30.620739 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-0ba7b928-bfd9-433f-abed-79ee08fd0f05 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:06:30.947210 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-0ba7b928-bfd9-433f-abed-79ee08fd0f05 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '301ed3b9c37449bc9ade378f3c73a768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8807757227574c828dca1947af76659d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:06:30.964053 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-0ba7b928-bfd9-433f-abed-79ee08fd0f05 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '301ed3b9c37449bc9ade378f3c73a768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8807757227574c828dca1947af76659d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:06:30.966667 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-0ba7b928-bfd9-433f-abed-79ee08fd0f05 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '301ed3b9c37449bc9ade378f3c73a768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8807757227574c828dca1947af76659d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:06:30.967869 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-0ba7b928-bfd9-433f-abed-79ee08fd0f05 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] 10.222.0.13 "GET /compute/v2.1/servers/af1071a8-a090-44c9-890c-123ca3ff39f1" status: 200 len: 1880 microversion: 2.42 time: 0.384608 Nov 01 19:06:30.989119 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1530/3009] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 19:06:30 2022] GET /compute/v2.1/servers/af1071a8-a090-44c9-890c-123ca3ff39f1 => generated 1880 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 19:06:31.000696 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [req-2ff334fb-fbfc-484e-8e44-28a9b6204348 req-a25c4e2f-a0cf-4a0b-ae77-3435b9c0d9a1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "86162175-5f45-4aa7-9825-f1a3b4a699ff", "tag": "e985c4cd-3aee-4c89-a53f-f69bb65a4339"}]} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:06:31.026981 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-2ff334fb-fbfc-484e-8e44-28a9b6204348 req-a25c4e2f-a0cf-4a0b-ae77-3435b9c0d9a1 service nova] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:06:31.027469 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-2ff334fb-fbfc-484e-8e44-28a9b6204348 req-a25c4e2f-a0cf-4a0b-ae77-3435b9c0d9a1 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:06:31.028438 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-2ff334fb-fbfc-484e-8e44-28a9b6204348 req-a25c4e2f-a0cf-4a0b-ae77-3435b9c0d9a1 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:06:31.048038 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.compute.server_external_events [req-2ff334fb-fbfc-484e-8e44-28a9b6204348 req-a25c4e2f-a0cf-4a0b-ae77-3435b9c0d9a1 service nova] Creating event network-changed:e985c4cd-3aee-4c89-a53f-f69bb65a4339 for instance 86162175-5f45-4aa7-9825-f1a3b4a699ff on n-h1-863052-2 Nov 01 19:06:31.062512 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [req-2ff334fb-fbfc-484e-8e44-28a9b6204348 req-a25c4e2f-a0cf-4a0b-ae77-3435b9c0d9a1 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072065 Nov 01 19:06:31.063699 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1531/3010] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Nov 1 19:06:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:06:31.072039 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-c4bfdbce-ae0c-4652-bf78-f818b01c9d40 tempest-AttachSCSIVolumeTestJSON-356336257 tempest-AttachSCSIVolumeTestJSON-356336257-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachSCSIVolumeTestJSON-server-1410307912", "imageRef": "58e2e065-d653-465f-8b19-b60dd872b4e4", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "6b596088-8a76-4a7a-988a-8a29419c27a2"}], "security_groups": [{"name": "tempest-securitygroup--1720383331"}], "key_name": "tempest-keypair-1984786559", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:06:31.392241 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.network.neutron [None req-c4bfdbce-ae0c-4652-bf78-f818b01c9d40 tempest-AttachSCSIVolumeTestJSON-356336257 tempest-AttachSCSIVolumeTestJSON-356336257-project] validate_networks() for [('6b596088-8a76-4a7a-988a-8a29419c27a2', None, None, None, None, None)] {{(pid=121403) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 01 19:06:32.263159 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.virt.hardware [None req-c4bfdbce-ae0c-4652-bf78-f818b01c9d40 tempest-AttachSCSIVolumeTestJSON-356336257 tempest-AttachSCSIVolumeTestJSON-356336257-project] Flavor limits 0:0:0 {{(pid=121403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 01 19:06:32.263712 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.virt.hardware [None req-c4bfdbce-ae0c-4652-bf78-f818b01c9d40 tempest-AttachSCSIVolumeTestJSON-356336257 tempest-AttachSCSIVolumeTestJSON-356336257-project] Image limits 0:0:0 {{(pid=121403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 01 19:06:32.263984 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.virt.hardware [None req-c4bfdbce-ae0c-4652-bf78-f818b01c9d40 tempest-AttachSCSIVolumeTestJSON-356336257 tempest-AttachSCSIVolumeTestJSON-356336257-project] Flavor pref 0:0:0 {{(pid=121403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 01 19:06:32.264394 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.virt.hardware [None req-c4bfdbce-ae0c-4652-bf78-f818b01c9d40 tempest-AttachSCSIVolumeTestJSON-356336257 tempest-AttachSCSIVolumeTestJSON-356336257-project] Image pref 0:0:0 {{(pid=121403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 01 19:06:32.264833 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.virt.hardware [None req-c4bfdbce-ae0c-4652-bf78-f818b01c9d40 tempest-AttachSCSIVolumeTestJSON-356336257 tempest-AttachSCSIVolumeTestJSON-356336257-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 01 19:06:32.279913 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-c4bfdbce-ae0c-4652-bf78-f818b01c9d40 tempest-AttachSCSIVolumeTestJSON-356336257 tempest-AttachSCSIVolumeTestJSON-356336257-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:06:32.280411 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-c4bfdbce-ae0c-4652-bf78-f818b01c9d40 tempest-AttachSCSIVolumeTestJSON-356336257 tempest-AttachSCSIVolumeTestJSON-356336257-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:06:32.280879 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-c4bfdbce-ae0c-4652-bf78-f818b01c9d40 tempest-AttachSCSIVolumeTestJSON-356336257 tempest-AttachSCSIVolumeTestJSON-356336257-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:06:32.283469 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-c4bfdbce-ae0c-4652-bf78-f818b01c9d40 tempest-AttachSCSIVolumeTestJSON-356336257 tempest-AttachSCSIVolumeTestJSON-356336257-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:06:32.283948 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-c4bfdbce-ae0c-4652-bf78-f818b01c9d40 tempest-AttachSCSIVolumeTestJSON-356336257 tempest-AttachSCSIVolumeTestJSON-356336257-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:06:32.284384 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-c4bfdbce-ae0c-4652-bf78-f818b01c9d40 tempest-AttachSCSIVolumeTestJSON-356336257 tempest-AttachSCSIVolumeTestJSON-356336257-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:06:32.331037 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.quota [None req-c4bfdbce-ae0c-4652-bf78-f818b01c9d40 tempest-AttachSCSIVolumeTestJSON-356336257 tempest-AttachSCSIVolumeTestJSON-356336257-project] Getting quotas for project 7b14142c34d54977ac9eb59962f2a9e1. Resources: {'cores', 'ram', 'instances'} {{(pid=121403) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 01 19:06:32.336869 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.quota [None req-c4bfdbce-ae0c-4652-bf78-f818b01c9d40 tempest-AttachSCSIVolumeTestJSON-356336257 tempest-AttachSCSIVolumeTestJSON-356336257-project] Getting quotas for user cde7667dbbfd4864a5b0ca8d8b291406 and project 7b14142c34d54977ac9eb59962f2a9e1. Resources: {'cores', 'ram', 'instances'} {{(pid=121403) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 01 19:06:32.368498 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-c4bfdbce-ae0c-4652-bf78-f818b01c9d40 tempest-AttachSCSIVolumeTestJSON-356336257 tempest-AttachSCSIVolumeTestJSON-356336257-project] Going to run 1 instances... {{(pid=121403) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 01 19:06:32.371014 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-c4bfdbce-ae0c-4652-bf78-f818b01c9d40 tempest-AttachSCSIVolumeTestJSON-356336257 tempest-AttachSCSIVolumeTestJSON-356336257-project] [instance: 8a378b79-bd92-4ade-b034-1aaf5c87b74b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='58e2e065-d653-465f-8b19-b60dd872b4e4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121403) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 01 19:06:32.467597 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-c4bfdbce-ae0c-4652-bf78-f818b01c9d40 tempest-AttachSCSIVolumeTestJSON-356336257 tempest-AttachSCSIVolumeTestJSON-356336257-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.402484 Nov 01 19:06:32.472242 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1532/3011] 10.222.0.13 () {60 vars in 1147 bytes} [Tue Nov 1 19:06:31 2022] POST /compute/v2.1/servers => generated 406 bytes in 1408 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 01 19:06:32.477331 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-dfb120fd-be27-4d5c-9445-9029d657e592 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:06:32.489509 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-dfb120fd-be27-4d5c-9445-9029d657e592 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] [instance: ba6ffc5c-84a4-40f1-bdc7-f87dde2c99df] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:06:32.502897 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-dfb120fd-be27-4d5c-9445-9029d657e592 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:06:32.503634 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-dfb120fd-be27-4d5c-9445-9029d657e592 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:06:32.504257 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-dfb120fd-be27-4d5c-9445-9029d657e592 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:06:32.505173 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-dfb120fd-be27-4d5c-9445-9029d657e592 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:06:32.505622 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-dfb120fd-be27-4d5c-9445-9029d657e592 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:06:32.506207 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-dfb120fd-be27-4d5c-9445-9029d657e592 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:06:33.152785 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.network.neutron [None req-2d7e6d7e-8f28-46f8-b16a-692bc6323f31 tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] [instance: 86162175-5f45-4aa7-9825-f1a3b4a699ff] Updating instance_info_cache with network_info: [{"id": "e985c4cd-3aee-4c89-a53f-f69bb65a4339", "address": "fa:16:3e:c2:86:d5", "network": {"id": "5b808c64-bf01-4ded-bf6b-0b3fd18d2f1c", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-768163193-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "eda6511ea24c4c19a7c5d91535c7288d", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tape985c4cd-3a", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=121402) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Nov 01 19:06:33.175299 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2d7e6d7e-8f28-46f8-b16a-692bc6323f31 tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] Releasing lock "refresh_cache-86162175-5f45-4aa7-9825-f1a3b4a699ff" {{(pid=121402) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Nov 01 19:06:33.176718 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-2d7e6d7e-8f28-46f8-b16a-692bc6323f31 tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] 10.222.0.13 "POST /compute/v2.1/servers/86162175-5f45-4aa7-9825-f1a3b4a699ff/action" status: 202 len: 0 microversion: 2.1 time: 6.140789 Nov 01 19:06:33.177986 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1480/3012] 10.222.0.13 () {60 vars in 1278 bytes} [Tue Nov 1 19:06:27 2022] POST /compute/v2.1/servers/86162175-5f45-4aa7-9825-f1a3b4a699ff/action => generated 0 bytes in 6143 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Nov 01 19:06:33.191093 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-57ecf36e-73b2-4028-a17b-30bf159da8af tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:06:33.193054 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-57ecf36e-73b2-4028-a17b-30bf159da8af tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] [instance: 0b57b50d-1ec4-4ee1-ac3a-f6f44d68a2c3] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:06:33.202715 n-d-863052-2 devstack@n-api.service[121402]: DEBUG dbcounter [-] [121402] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=1 {{(pid=121402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 19:06:33.230716 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-57ecf36e-73b2-4028-a17b-30bf159da8af tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:06:33.231583 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-57ecf36e-73b2-4028-a17b-30bf159da8af tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:06:33.232204 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-57ecf36e-73b2-4028-a17b-30bf159da8af tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:06:33.233743 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-57ecf36e-73b2-4028-a17b-30bf159da8af tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:06:33.234422 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-57ecf36e-73b2-4028-a17b-30bf159da8af tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:06:33.235019 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-57ecf36e-73b2-4028-a17b-30bf159da8af tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:06:33.606850 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-dfb120fd-be27-4d5c-9445-9029d657e592 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd2105b0264b48d084d0e79cabff8bc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf4adda91364dab94830347c06e3957', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:06:33.626716 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-dfb120fd-be27-4d5c-9445-9029d657e592 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd2105b0264b48d084d0e79cabff8bc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf4adda91364dab94830347c06e3957', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:06:33.631837 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-dfb120fd-be27-4d5c-9445-9029d657e592 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd2105b0264b48d084d0e79cabff8bc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf4adda91364dab94830347c06e3957', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:06:33.634440 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-dfb120fd-be27-4d5c-9445-9029d657e592 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] 10.222.0.13 "GET /compute/v2.1/servers/ba6ffc5c-84a4-40f1-bdc7-f87dde2c99df" status: 200 len: 1887 microversion: 2.32 time: 1.160665 Nov 01 19:06:33.654281 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1533/3013] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 19:06:32 2022] GET /compute/v2.1/servers/ba6ffc5c-84a4-40f1-bdc7-f87dde2c99df => generated 1887 bytes in 1180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 19:06:33.667801 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-bd99dbae-47fa-425d-a204-f8518d99e936 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:06:33.670602 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-bd99dbae-47fa-425d-a204-f8518d99e936 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] [instance: 990f3535-a5c4-4f62-bed9-b310a77293c8] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:06:33.677071 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-57ecf36e-73b2-4028-a17b-30bf159da8af tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05d6a1722dfa4e959aeb14d601e43b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b5d812eff94e2f89d4705d7e7d5f3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:06:33.682713 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-bd99dbae-47fa-425d-a204-f8518d99e936 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:06:33.683207 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-bd99dbae-47fa-425d-a204-f8518d99e936 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:06:33.683642 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-bd99dbae-47fa-425d-a204-f8518d99e936 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:06:33.693248 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-bd99dbae-47fa-425d-a204-f8518d99e936 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:06:33.698173 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-bd99dbae-47fa-425d-a204-f8518d99e936 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:06:33.701223 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-bd99dbae-47fa-425d-a204-f8518d99e936 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:06:33.725622 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-57ecf36e-73b2-4028-a17b-30bf159da8af tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] 10.222.0.13 "GET /compute/v2.1/servers/0b57b50d-1ec4-4ee1-ac3a-f6f44d68a2c3" status: 200 len: 1521 microversion: 2.1 time: 0.515148 Nov 01 19:06:33.726631 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1481/3014] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:06:33 2022] GET /compute/v2.1/servers/0b57b50d-1ec4-4ee1-ac3a-f6f44d68a2c3 => generated 1521 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:06:33.737033 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [req-b862360e-db29-44fb-bd2c-754c6b252ebd req-f439d05e-66e3-4930-baf0-1c249630206c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ba6ffc5c-84a4-40f1-bdc7-f87dde2c99df", "tag": "edf5ed24-0e25-44d3-8ab2-d626304020a6"}]} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:06:33.740550 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.wsgi [None req-bd99dbae-47fa-425d-a204-f8518d99e936 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] HTTP exception thrown: Instance 990f3535-a5c4-4f62-bed9-b310a77293c8 could not be found. Nov 01 19:06:33.744900 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-bd99dbae-47fa-425d-a204-f8518d99e936 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Request method failure captured: Nov 01 19:06:33.744900 n-d-863052-2 devstack@n-api.service[121403]: request: GET /compute/v2.1/servers/990f3535-a5c4-4f62-bed9-b310a77293c8 HTTP/1.1 Nov 01 19:06:33.744900 n-d-863052-2 devstack@n-api.service[121403]: Accept: application/json Nov 01 19:06:33.744900 n-d-863052-2 devstack@n-api.service[121403]: Accept-Encoding: identity Nov 01 19:06:33.744900 n-d-863052-2 devstack@n-api.service[121403]: Connection: close Nov 01 19:06:33.744900 n-d-863052-2 devstack@n-api.service[121403]: Content-Length: 0 Nov 01 19:06:33.744900 n-d-863052-2 devstack@n-api.service[121403]: Content-Type: application/json Nov 01 19:06:33.744900 n-d-863052-2 devstack@n-api.service[121403]: Host: 10.222.0.13 Nov 01 19:06:33.744900 n-d-863052-2 devstack@n-api.service[121403]: Openstack-System-Scope: None Nov 01 19:06:33.744900 n-d-863052-2 devstack@n-api.service[121403]: User-Agent: python-urllib3/1.26.12 Nov 01 19:06:33.744900 n-d-863052-2 devstack@n-api.service[121403]: X-Auth-Token: gAAAAABjYW3ByfBI9VCjWikZSFUz_hPClqqMancoCxnwBX6xqaMeeugycqMQyEPQybXqoeO46TFhJ9TITtoJFiSbS9Ry6pB9Kueb-hoVnQBV0e7qQWXwvcx4eB_AomP3ogOCXvqhfUnxVmmooBEoQbpvBIMsXQEjVVdPObNP8WS9oGjTsTTTO4o Nov 01 19:06:33.744900 n-d-863052-2 devstack@n-api.service[121403]: X-Domain-Id: None Nov 01 19:06:33.744900 n-d-863052-2 devstack@n-api.service[121403]: X-Domain-Name: None Nov 01 19:06:33.744900 n-d-863052-2 devstack@n-api.service[121403]: X-Identity-Status: Confirmed Nov 01 19:06:33.744900 n-d-863052-2 devstack@n-api.service[121403]: X-Is-Admin-Project: True Nov 01 19:06:33.744900 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Domain-Id: default Nov 01 19:06:33.744900 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Domain-Name: Default Nov 01 19:06:33.744900 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Id: 1ee9dc49b89143f781e4ab30296e4d01 Nov 01 19:06:33.744900 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Name: tempest-DeleteServersTestJSON-412339701 Nov 01 19:06:33.744900 n-d-863052-2 devstack@n-api.service[121403]: X-Role: member,reader Nov 01 19:06:33.744900 n-d-863052-2 devstack@n-api.service[121403]: X-Roles: member,reader Nov 01 19:06:33.744900 n-d-863052-2 devstack@n-api.service[121403]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/1ee9dc49b89143f781e4ab30296e4d01"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/1ee9dc49b89143f781e4ab30296e4d01"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_1ee9dc49b89143f781e4ab30296e4d01", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/1ee9dc49b89143f781e4ab30296e4d01"}]}] Nov 01 19:06:33.744900 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant: tempest-DeleteServersTestJSON-412339701 Nov 01 19:06:33.744900 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant-Id: 1ee9dc49b89143f781e4ab30296e4d01 Nov 01 19:06:33.744900 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant-Name: tempest-DeleteServersTestJSON-412339701 Nov 01 19:06:33.744900 n-d-863052-2 devstack@n-api.service[121403]: X-User: tempest-DeleteServersTestJSON-412339701-project Nov 01 19:06:33.744900 n-d-863052-2 devstack@n-api.service[121403]: X-User-Domain-Id: default Nov 01 19:06:33.744900 n-d-863052-2 devstack@n-api.service[121403]: X-User-Domain-Name: Default Nov 01 19:06:33.744900 n-d-863052-2 devstack@n-api.service[121403]: X-User-Id: 058480d92c9b4ab4af6815d0438a65c7 Nov 01 19:06:33.744900 n-d-863052-2 devstack@n-api.service[121403]: X-User-Name: tempest-DeleteServersTestJSON-412339701-project Nov 01 19:06:33.744900 n-d-863052-2 devstack@n-api.service[121403]: method: > Nov 01 19:06:33.744900 n-d-863052-2 devstack@n-api.service[121403]: exception: Instance 990f3535-a5c4-4f62-bed9-b310a77293c8 could not be found. Nov 01 19:06:33.744900 n-d-863052-2 devstack@n-api.service[121403]: action_args: {'id': '990f3535-a5c4-4f62-bed9-b310a77293c8'} Nov 01 19:06:33.744900 n-d-863052-2 devstack@n-api.service[121403]: {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 01 19:06:33.744900 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:06:33.744900 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 01 19:06:33.744900 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 01 19:06:33.744900 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 01 19:06:33.744900 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 01 19:06:33.744900 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 01 19:06:33.744900 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 01 19:06:33.744900 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 01 19:06:33.744900 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 01 19:06:33.744900 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 990f3535-a5c4-4f62-bed9-b310a77293c8 could not be found. Nov 01 19:06:33.744900 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:06:33.744900 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:06:33.744900 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:06:33.744900 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:06:33.744900 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:06:33.744900 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:06:33.744900 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 01 19:06:33.744900 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 01 19:06:33.744900 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 01 19:06:33.744900 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 01 19:06:33.744900 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 01 19:06:33.744900 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 01 19:06:33.744900 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 01 19:06:33.744900 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 01 19:06:33.744900 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 01 19:06:33.744900 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 01 19:06:33.744900 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 990f3535-a5c4-4f62-bed9-b310a77293c8 could not be found. Nov 01 19:06:33.744900 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:06:33.744900 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:06:33.744900 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:06:33.751685 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:06:33.751685 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:06:33.751685 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:06:33.751685 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 01 19:06:33.751685 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 01 19:06:33.751685 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 990f3535-a5c4-4f62-bed9-b310a77293c8 could not be found. Nov 01 19:06:33.751685 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:06:33.756161 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-bd99dbae-47fa-425d-a204-f8518d99e936 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Returning 404 to user: Instance 990f3535-a5c4-4f62-bed9-b310a77293c8 could not be found. {{(pid=121403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 01 19:06:33.757263 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-bd99dbae-47fa-425d-a204-f8518d99e936 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] 10.222.0.13 "GET /compute/v2.1/servers/990f3535-a5c4-4f62-bed9-b310a77293c8" status: 404 len: 111 microversion: 2.1 time: 0.100744 Nov 01 19:06:33.758063 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1534/3015] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:06:33 2022] GET /compute/v2.1/servers/990f3535-a5c4-4f62-bed9-b310a77293c8 => generated 111 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 01 19:06:33.758965 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-b862360e-db29-44fb-bd2c-754c6b252ebd req-f439d05e-66e3-4930-baf0-1c249630206c service nova] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:06:33.759603 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-b862360e-db29-44fb-bd2c-754c6b252ebd req-f439d05e-66e3-4930-baf0-1c249630206c service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:06:33.760795 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-b862360e-db29-44fb-bd2c-754c6b252ebd req-f439d05e-66e3-4930-baf0-1c249630206c service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:06:33.773322 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-7b842de8-8ded-49ba-92f4-ad0dadf4f129 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:06:33.775811 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-7b842de8-8ded-49ba-92f4-ad0dadf4f129 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] [instance: af1071a8-a090-44c9-890c-123ca3ff39f1] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:06:33.776668 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.compute.server_external_events [req-b862360e-db29-44fb-bd2c-754c6b252ebd req-f439d05e-66e3-4930-baf0-1c249630206c service nova] Creating event network-changed:edf5ed24-0e25-44d3-8ab2-d626304020a6 for instance ba6ffc5c-84a4-40f1-bdc7-f87dde2c99df on n-h1-863052-2 Nov 01 19:06:33.789196 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [req-b862360e-db29-44fb-bd2c-754c6b252ebd req-f439d05e-66e3-4930-baf0-1c249630206c service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060587 Nov 01 19:06:33.790720 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1482/3016] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Nov 1 19:06:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:06:33.798263 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-7b842de8-8ded-49ba-92f4-ad0dadf4f129 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:06:33.799292 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-7b842de8-8ded-49ba-92f4-ad0dadf4f129 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:06:33.800161 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-7b842de8-8ded-49ba-92f4-ad0dadf4f129 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:06:33.801301 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-7b842de8-8ded-49ba-92f4-ad0dadf4f129 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:06:33.802189 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-7b842de8-8ded-49ba-92f4-ad0dadf4f129 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:06:33.802787 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-7b842de8-8ded-49ba-92f4-ad0dadf4f129 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:06:33.816135 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-291fb465-155f-4f6a-9df9-a88455fa206f tempest-AttachSCSIVolumeTestJSON-356336257 tempest-AttachSCSIVolumeTestJSON-356336257-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:06:33.818197 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-291fb465-155f-4f6a-9df9-a88455fa206f tempest-AttachSCSIVolumeTestJSON-356336257 tempest-AttachSCSIVolumeTestJSON-356336257-project] [instance: 8a378b79-bd92-4ade-b034-1aaf5c87b74b] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:06:33.836304 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-291fb465-155f-4f6a-9df9-a88455fa206f tempest-AttachSCSIVolumeTestJSON-356336257 tempest-AttachSCSIVolumeTestJSON-356336257-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:06:33.837314 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-291fb465-155f-4f6a-9df9-a88455fa206f tempest-AttachSCSIVolumeTestJSON-356336257 tempest-AttachSCSIVolumeTestJSON-356336257-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:06:33.838148 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-291fb465-155f-4f6a-9df9-a88455fa206f tempest-AttachSCSIVolumeTestJSON-356336257 tempest-AttachSCSIVolumeTestJSON-356336257-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:06:33.840457 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-291fb465-155f-4f6a-9df9-a88455fa206f tempest-AttachSCSIVolumeTestJSON-356336257 tempest-AttachSCSIVolumeTestJSON-356336257-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:06:33.841329 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-291fb465-155f-4f6a-9df9-a88455fa206f tempest-AttachSCSIVolumeTestJSON-356336257 tempest-AttachSCSIVolumeTestJSON-356336257-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:06:33.843409 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-291fb465-155f-4f6a-9df9-a88455fa206f tempest-AttachSCSIVolumeTestJSON-356336257 tempest-AttachSCSIVolumeTestJSON-356336257-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:06:34.072550 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-291fb465-155f-4f6a-9df9-a88455fa206f tempest-AttachSCSIVolumeTestJSON-356336257 tempest-AttachSCSIVolumeTestJSON-356336257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde7667dbbfd4864a5b0ca8d8b291406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b14142c34d54977ac9eb59962f2a9e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:06:34.081612 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-291fb465-155f-4f6a-9df9-a88455fa206f tempest-AttachSCSIVolumeTestJSON-356336257 tempest-AttachSCSIVolumeTestJSON-356336257-project] 10.222.0.13 "GET /compute/v2.1/servers/8a378b79-bd92-4ade-b034-1aaf5c87b74b" status: 200 len: 1242 microversion: 2.1 time: 0.289037 Nov 01 19:06:34.082191 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1483/3017] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:06:33 2022] GET /compute/v2.1/servers/8a378b79-bd92-4ade-b034-1aaf5c87b74b => generated 1242 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:06:34.103664 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-e04334f9-fef2-4422-80ba-a8b280a7583f tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:06:34.104422 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-e04334f9-fef2-4422-80ba-a8b280a7583f tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] [instance: 86162175-5f45-4aa7-9825-f1a3b4a699ff] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:06:34.112496 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e04334f9-fef2-4422-80ba-a8b280a7583f tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:06:34.113752 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e04334f9-fef2-4422-80ba-a8b280a7583f tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:06:34.114683 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e04334f9-fef2-4422-80ba-a8b280a7583f tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:06:34.115711 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e04334f9-fef2-4422-80ba-a8b280a7583f tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:06:34.116696 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e04334f9-fef2-4422-80ba-a8b280a7583f tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:06:34.117347 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e04334f9-fef2-4422-80ba-a8b280a7583f tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:06:34.145721 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-e04334f9-fef2-4422-80ba-a8b280a7583f tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] [instance: 86162175-5f45-4aa7-9825-f1a3b4a699ff] Going to try to terminate instance {{(pid=121402) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 01 19:06:34.227042 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-7b842de8-8ded-49ba-92f4-ad0dadf4f129 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '301ed3b9c37449bc9ade378f3c73a768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8807757227574c828dca1947af76659d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:06:34.236997 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-7b842de8-8ded-49ba-92f4-ad0dadf4f129 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '301ed3b9c37449bc9ade378f3c73a768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8807757227574c828dca1947af76659d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:06:34.238438 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-7b842de8-8ded-49ba-92f4-ad0dadf4f129 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '301ed3b9c37449bc9ade378f3c73a768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8807757227574c828dca1947af76659d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:06:34.239601 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-7b842de8-8ded-49ba-92f4-ad0dadf4f129 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] 10.222.0.13 "GET /compute/v2.1/servers/af1071a8-a090-44c9-890c-123ca3ff39f1" status: 200 len: 1880 microversion: 2.42 time: 0.479045 Nov 01 19:06:34.263527 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1535/3018] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 19:06:33 2022] GET /compute/v2.1/servers/af1071a8-a090-44c9-890c-123ca3ff39f1 => generated 1880 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 19:06:34.273234 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-f075230e-dd49-41e1-b297-0c457672f157 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-429549283", "imageRef": "2d4a0047-1b9e-445f-8af8-1b5c9d93e881", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f519283e-0b16-42bb-b3ce-8665b5719c87"}], "security_groups": [{"name": "tempest-securitygroup--1230778337"}], "key_name": "tempest-keypair-1262518302", "user_data": "}} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:06:34.282677 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-e04334f9-fef2-4422-80ba-a8b280a7583f tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] 10.222.0.13 "DELETE /compute/v2.1/servers/86162175-5f45-4aa7-9825-f1a3b4a699ff" status: 204 len: 0 microversion: 2.1 time: 0.188161 Nov 01 19:06:34.283565 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1484/3019] 10.222.0.13 () {58 vars in 1239 bytes} [Tue Nov 1 19:06:34 2022] DELETE /compute/v2.1/servers/86162175-5f45-4aa7-9825-f1a3b4a699ff => generated 0 bytes in 201 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 01 19:06:34.297060 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-4c2e15fb-e678-4485-b0e7-fd289902b776 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:06:34.299874 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-4c2e15fb-e678-4485-b0e7-fd289902b776 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] [instance: 990f3535-a5c4-4f62-bed9-b310a77293c8] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:06:34.314437 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-4c2e15fb-e678-4485-b0e7-fd289902b776 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:06:34.315244 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-4c2e15fb-e678-4485-b0e7-fd289902b776 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:06:34.317768 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-4c2e15fb-e678-4485-b0e7-fd289902b776 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:06:34.318766 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-4c2e15fb-e678-4485-b0e7-fd289902b776 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:06:34.320441 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-4c2e15fb-e678-4485-b0e7-fd289902b776 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:06:34.321088 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-4c2e15fb-e678-4485-b0e7-fd289902b776 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:06:34.348046 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.wsgi [None req-4c2e15fb-e678-4485-b0e7-fd289902b776 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] HTTP exception thrown: Instance 990f3535-a5c4-4f62-bed9-b310a77293c8 could not be found. Nov 01 19:06:34.351537 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-4c2e15fb-e678-4485-b0e7-fd289902b776 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Request method failure captured: Nov 01 19:06:34.351537 n-d-863052-2 devstack@n-api.service[121402]: request: GET /compute/v2.1/servers/990f3535-a5c4-4f62-bed9-b310a77293c8/os-volume_attachments HTTP/1.1 Nov 01 19:06:34.351537 n-d-863052-2 devstack@n-api.service[121402]: Accept: application/json Nov 01 19:06:34.351537 n-d-863052-2 devstack@n-api.service[121402]: Accept-Encoding: identity Nov 01 19:06:34.351537 n-d-863052-2 devstack@n-api.service[121402]: Connection: close Nov 01 19:06:34.351537 n-d-863052-2 devstack@n-api.service[121402]: Content-Length: 0 Nov 01 19:06:34.351537 n-d-863052-2 devstack@n-api.service[121402]: Content-Type: application/json Nov 01 19:06:34.351537 n-d-863052-2 devstack@n-api.service[121402]: Host: 10.222.0.13 Nov 01 19:06:34.351537 n-d-863052-2 devstack@n-api.service[121402]: Openstack-System-Scope: None Nov 01 19:06:34.351537 n-d-863052-2 devstack@n-api.service[121402]: User-Agent: python-urllib3/1.26.12 Nov 01 19:06:34.351537 n-d-863052-2 devstack@n-api.service[121402]: X-Auth-Token: gAAAAABjYW3ByfBI9VCjWikZSFUz_hPClqqMancoCxnwBX6xqaMeeugycqMQyEPQybXqoeO46TFhJ9TITtoJFiSbS9Ry6pB9Kueb-hoVnQBV0e7qQWXwvcx4eB_AomP3ogOCXvqhfUnxVmmooBEoQbpvBIMsXQEjVVdPObNP8WS9oGjTsTTTO4o Nov 01 19:06:34.351537 n-d-863052-2 devstack@n-api.service[121402]: X-Domain-Id: None Nov 01 19:06:34.351537 n-d-863052-2 devstack@n-api.service[121402]: X-Domain-Name: None Nov 01 19:06:34.351537 n-d-863052-2 devstack@n-api.service[121402]: X-Identity-Status: Confirmed Nov 01 19:06:34.351537 n-d-863052-2 devstack@n-api.service[121402]: X-Is-Admin-Project: True Nov 01 19:06:34.351537 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Domain-Id: default Nov 01 19:06:34.351537 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Domain-Name: Default Nov 01 19:06:34.351537 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Id: 1ee9dc49b89143f781e4ab30296e4d01 Nov 01 19:06:34.351537 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Name: tempest-DeleteServersTestJSON-412339701 Nov 01 19:06:34.351537 n-d-863052-2 devstack@n-api.service[121402]: X-Role: member,reader Nov 01 19:06:34.351537 n-d-863052-2 devstack@n-api.service[121402]: X-Roles: member,reader Nov 01 19:06:34.351537 n-d-863052-2 devstack@n-api.service[121402]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/1ee9dc49b89143f781e4ab30296e4d01"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/1ee9dc49b89143f781e4ab30296e4d01"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_1ee9dc49b89143f781e4ab30296e4d01", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/1ee9dc49b89143f781e4ab30296e4d01"}]}] Nov 01 19:06:34.351537 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant: tempest-DeleteServersTestJSON-412339701 Nov 01 19:06:34.351537 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant-Id: 1ee9dc49b89143f781e4ab30296e4d01 Nov 01 19:06:34.351537 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant-Name: tempest-DeleteServersTestJSON-412339701 Nov 01 19:06:34.351537 n-d-863052-2 devstack@n-api.service[121402]: X-User: tempest-DeleteServersTestJSON-412339701-project Nov 01 19:06:34.351537 n-d-863052-2 devstack@n-api.service[121402]: X-User-Domain-Id: default Nov 01 19:06:34.351537 n-d-863052-2 devstack@n-api.service[121402]: X-User-Domain-Name: Default Nov 01 19:06:34.351537 n-d-863052-2 devstack@n-api.service[121402]: X-User-Id: 058480d92c9b4ab4af6815d0438a65c7 Nov 01 19:06:34.351537 n-d-863052-2 devstack@n-api.service[121402]: X-User-Name: tempest-DeleteServersTestJSON-412339701-project Nov 01 19:06:34.351537 n-d-863052-2 devstack@n-api.service[121402]: method: > Nov 01 19:06:34.351537 n-d-863052-2 devstack@n-api.service[121402]: exception: Instance 990f3535-a5c4-4f62-bed9-b310a77293c8 could not be found. Nov 01 19:06:34.351537 n-d-863052-2 devstack@n-api.service[121402]: action_args: {'server_id': '990f3535-a5c4-4f62-bed9-b310a77293c8'} Nov 01 19:06:34.351537 n-d-863052-2 devstack@n-api.service[121402]: {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 01 19:06:34.351537 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:06:34.351537 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 01 19:06:34.351537 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 01 19:06:34.351537 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 01 19:06:34.351537 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 01 19:06:34.351537 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 01 19:06:34.351537 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 01 19:06:34.351537 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 01 19:06:34.351537 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 01 19:06:34.351537 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 990f3535-a5c4-4f62-bed9-b310a77293c8 could not be found. Nov 01 19:06:34.351537 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:06:34.351537 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:06:34.351537 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:06:34.351537 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:06:34.351537 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:06:34.351537 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:06:34.351537 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 01 19:06:34.351537 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 01 19:06:34.351537 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 01 19:06:34.351537 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 01 19:06:34.351537 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Nov 01 19:06:34.351537 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 01 19:06:34.351537 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Nov 01 19:06:34.351537 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 01 19:06:34.351537 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Nov 01 19:06:34.351537 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Nov 01 19:06:34.351537 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 01 19:06:34.351537 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 01 19:06:34.355372 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 990f3535-a5c4-4f62-bed9-b310a77293c8 could not be found. Nov 01 19:06:34.355372 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:06:34.355372 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:06:34.355372 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:06:34.355372 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:06:34.355372 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:06:34.355372 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:06:34.355372 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 01 19:06:34.355372 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 01 19:06:34.355372 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 990f3535-a5c4-4f62-bed9-b310a77293c8 could not be found. Nov 01 19:06:34.355372 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:06:34.355372 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-4c2e15fb-e678-4485-b0e7-fd289902b776 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Returning 404 to user: Instance 990f3535-a5c4-4f62-bed9-b310a77293c8 could not be found. {{(pid=121402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 01 19:06:34.358705 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-4c2e15fb-e678-4485-b0e7-fd289902b776 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] 10.222.0.13 "GET /compute/v2.1/servers/990f3535-a5c4-4f62-bed9-b310a77293c8/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.067816 Nov 01 19:06:34.376986 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1485/3020] 10.222.0.13 () {58 vars in 1302 bytes} [Tue Nov 1 19:06:34 2022] GET /compute/v2.1/servers/990f3535-a5c4-4f62-bed9-b310a77293c8/os-volume_attachments => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 01 19:06:34.400248 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-5748107a-3389-47dd-9f0f-4018ded06b87 tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.8.254"}} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:06:34.403361 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-5748107a-3389-47dd-9f0f-4018ded06b87 tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] [instance: 307ee785-a01d-401c-8be2-b17558e735f3] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:06:34.440666 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-5748107a-3389-47dd-9f0f-4018ded06b87 tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:06:34.441186 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-5748107a-3389-47dd-9f0f-4018ded06b87 tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:06:34.441601 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-5748107a-3389-47dd-9f0f-4018ded06b87 tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:06:34.442322 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-5748107a-3389-47dd-9f0f-4018ded06b87 tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:06:34.442779 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-5748107a-3389-47dd-9f0f-4018ded06b87 tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:06:34.443204 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-5748107a-3389-47dd-9f0f-4018ded06b87 tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:06:34.517843 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-5748107a-3389-47dd-9f0f-4018ded06b87 tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] Acquiring lock "refresh_cache-307ee785-a01d-401c-8be2-b17558e735f3" {{(pid=121402) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Nov 01 19:06:34.518270 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-5748107a-3389-47dd-9f0f-4018ded06b87 tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] Acquired lock "refresh_cache-307ee785-a01d-401c-8be2-b17558e735f3" {{(pid=121402) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Nov 01 19:06:34.642381 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.network.neutron [None req-f075230e-dd49-41e1-b297-0c457672f157 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] validate_networks() for [('f519283e-0b16-42bb-b3ce-8665b5719c87', None, None, None, None, None)] {{(pid=121403) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 01 19:06:35.968558 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.virt.hardware [None req-f075230e-dd49-41e1-b297-0c457672f157 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Flavor limits 0:0:0 {{(pid=121403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 01 19:06:35.969728 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.virt.hardware [None req-f075230e-dd49-41e1-b297-0c457672f157 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Image limits 0:0:0 {{(pid=121403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 01 19:06:35.970446 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.virt.hardware [None req-f075230e-dd49-41e1-b297-0c457672f157 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Flavor pref 0:0:0 {{(pid=121403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 01 19:06:35.971178 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.virt.hardware [None req-f075230e-dd49-41e1-b297-0c457672f157 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Image pref 0:0:0 {{(pid=121403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 01 19:06:35.971895 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.virt.hardware [None req-f075230e-dd49-41e1-b297-0c457672f157 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 01 19:06:35.986760 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f075230e-dd49-41e1-b297-0c457672f157 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:06:35.989809 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f075230e-dd49-41e1-b297-0c457672f157 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:06:35.990596 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f075230e-dd49-41e1-b297-0c457672f157 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:06:36.002269 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f075230e-dd49-41e1-b297-0c457672f157 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:06:36.008465 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f075230e-dd49-41e1-b297-0c457672f157 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:06:36.009386 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f075230e-dd49-41e1-b297-0c457672f157 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:06:36.075741 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.quota [None req-f075230e-dd49-41e1-b297-0c457672f157 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Getting quotas for project 33e3d319293c46b6af2f728a50586906. Resources: {'cores', 'ram', 'instances'} {{(pid=121403) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 01 19:06:36.088028 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.quota [None req-f075230e-dd49-41e1-b297-0c457672f157 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Getting quotas for user 790f3f1566b7464aaca19d4d05c0942e and project 33e3d319293c46b6af2f728a50586906. Resources: {'cores', 'ram', 'instances'} {{(pid=121403) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 01 19:06:36.131191 n-d-863052-2 devstack@n-api.service[121403]: DEBUG dbcounter [-] [121403] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=121403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 19:06:36.135824 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-f075230e-dd49-41e1-b297-0c457672f157 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Going to run 1 instances... {{(pid=121403) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 01 19:06:36.140158 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-f075230e-dd49-41e1-b297-0c457672f157 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] [instance: 674f7fae-6219-4e5e-b85a-2647b948807e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2d4a0047-1b9e-445f-8af8-1b5c9d93e881',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121403) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 01 19:06:36.311245 n-d-863052-2 devstack@n-api.service[121402]: DEBUG dbcounter [-] [121402] Writing DB stats nova_cell0:SELECT=4 {{(pid=121402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 19:06:36.323649 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-f075230e-dd49-41e1-b297-0c457672f157 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.058667 Nov 01 19:06:36.325826 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1536/3021] 10.222.0.13 () {60 vars in 1147 bytes} [Tue Nov 1 19:06:34 2022] POST /compute/v2.1/servers => generated 402 bytes in 2062 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 01 19:06:36.335146 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-92893c1b-104e-4c4a-bf69-4afad3406dca tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:06:36.336213 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-92893c1b-104e-4c4a-bf69-4afad3406dca tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] [instance: ba6ffc5c-84a4-40f1-bdc7-f87dde2c99df] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:06:36.343371 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-92893c1b-104e-4c4a-bf69-4afad3406dca tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:06:36.344295 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-92893c1b-104e-4c4a-bf69-4afad3406dca tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:06:36.344985 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-92893c1b-104e-4c4a-bf69-4afad3406dca tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:06:36.345956 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-92893c1b-104e-4c4a-bf69-4afad3406dca tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:06:36.346632 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-92893c1b-104e-4c4a-bf69-4afad3406dca tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:06:36.347272 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-92893c1b-104e-4c4a-bf69-4afad3406dca tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:06:37.003394 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-92893c1b-104e-4c4a-bf69-4afad3406dca tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd2105b0264b48d084d0e79cabff8bc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf4adda91364dab94830347c06e3957', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:06:37.020642 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-92893c1b-104e-4c4a-bf69-4afad3406dca tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd2105b0264b48d084d0e79cabff8bc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf4adda91364dab94830347c06e3957', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:06:37.039616 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-92893c1b-104e-4c4a-bf69-4afad3406dca tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd2105b0264b48d084d0e79cabff8bc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf4adda91364dab94830347c06e3957', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:06:37.041131 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-92893c1b-104e-4c4a-bf69-4afad3406dca tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] 10.222.0.13 "GET /compute/v2.1/servers/ba6ffc5c-84a4-40f1-bdc7-f87dde2c99df" status: 200 len: 1887 microversion: 2.32 time: 0.713877 Nov 01 19:06:37.065215 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1537/3022] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 19:06:36 2022] GET /compute/v2.1/servers/ba6ffc5c-84a4-40f1-bdc7-f87dde2c99df => generated 1887 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 19:06:37.070762 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-f34af7f0-89e6-4a06-b973-cedab4578a8f tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-2142420997", "imageRef": "2d4a0047-1b9e-445f-8af8-1b5c9d93e881", "flavorRef": "452", "networks": [{"uuid": "6da1da8d-6719-4a9a-851f-308df797b88a"}]}} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:06:37.271615 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.network.neutron [None req-f34af7f0-89e6-4a06-b973-cedab4578a8f tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] validate_networks() for [('6da1da8d-6719-4a9a-851f-308df797b88a', None, None, None, None, None)] {{(pid=121403) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 01 19:06:39.536775 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.virt.hardware [None req-f34af7f0-89e6-4a06-b973-cedab4578a8f tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Flavor limits 0:0:0 {{(pid=121403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 01 19:06:39.537436 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.virt.hardware [None req-f34af7f0-89e6-4a06-b973-cedab4578a8f tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Image limits 0:0:0 {{(pid=121403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 01 19:06:39.537951 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.virt.hardware [None req-f34af7f0-89e6-4a06-b973-cedab4578a8f tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Flavor pref 0:0:0 {{(pid=121403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 01 19:06:39.538508 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.virt.hardware [None req-f34af7f0-89e6-4a06-b973-cedab4578a8f tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Image pref 0:0:0 {{(pid=121403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 01 19:06:39.540768 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.virt.hardware [None req-f34af7f0-89e6-4a06-b973-cedab4578a8f tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 01 19:06:39.552927 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f34af7f0-89e6-4a06-b973-cedab4578a8f tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:06:39.554099 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f34af7f0-89e6-4a06-b973-cedab4578a8f tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:06:39.554603 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f34af7f0-89e6-4a06-b973-cedab4578a8f tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:06:39.555587 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f34af7f0-89e6-4a06-b973-cedab4578a8f tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:06:39.556044 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f34af7f0-89e6-4a06-b973-cedab4578a8f tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:06:39.557652 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f34af7f0-89e6-4a06-b973-cedab4578a8f tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:06:39.580322 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.quota [None req-f34af7f0-89e6-4a06-b973-cedab4578a8f tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Getting quotas for project 1ee9dc49b89143f781e4ab30296e4d01. Resources: {'cores', 'ram', 'instances'} {{(pid=121403) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 01 19:06:39.588134 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.quota [None req-f34af7f0-89e6-4a06-b973-cedab4578a8f tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Getting quotas for user 058480d92c9b4ab4af6815d0438a65c7 and project 1ee9dc49b89143f781e4ab30296e4d01. Resources: {'cores', 'ram', 'instances'} {{(pid=121403) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 01 19:06:39.609073 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-f34af7f0-89e6-4a06-b973-cedab4578a8f tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Going to run 1 instances... {{(pid=121403) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 01 19:06:39.612418 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-f34af7f0-89e6-4a06-b973-cedab4578a8f tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] [instance: 3a13d400-ebab-4430-bba5-4b5339199be4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2d4a0047-1b9e-445f-8af8-1b5c9d93e881',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121403) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 01 19:06:39.730903 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-f34af7f0-89e6-4a06-b973-cedab4578a8f tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.664199 Nov 01 19:06:39.732456 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1538/3023] 10.222.0.13 () {60 vars in 1147 bytes} [Tue Nov 1 19:06:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 2666 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 01 19:06:39.739179 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-4e7eb34f-492c-4d54-9668-6e65b5633b95 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:06:39.740153 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-4e7eb34f-492c-4d54-9668-6e65b5633b95 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] [instance: 0b57b50d-1ec4-4ee1-ac3a-f6f44d68a2c3] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:06:39.776452 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-4e7eb34f-492c-4d54-9668-6e65b5633b95 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:06:39.777345 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-4e7eb34f-492c-4d54-9668-6e65b5633b95 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.029s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:06:39.778347 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-4e7eb34f-492c-4d54-9668-6e65b5633b95 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:06:39.781642 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-4e7eb34f-492c-4d54-9668-6e65b5633b95 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:06:39.786940 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-4e7eb34f-492c-4d54-9668-6e65b5633b95 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:06:39.789531 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-4e7eb34f-492c-4d54-9668-6e65b5633b95 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:06:40.075728 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-4e7eb34f-492c-4d54-9668-6e65b5633b95 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05d6a1722dfa4e959aeb14d601e43b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b5d812eff94e2f89d4705d7e7d5f3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:06:40.085350 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-4e7eb34f-492c-4d54-9668-6e65b5633b95 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] 10.222.0.13 "GET /compute/v2.1/servers/0b57b50d-1ec4-4ee1-ac3a-f6f44d68a2c3" status: 200 len: 1521 microversion: 2.1 time: 0.351000 Nov 01 19:06:40.101885 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1539/3024] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:06:39 2022] GET /compute/v2.1/servers/0b57b50d-1ec4-4ee1-ac3a-f6f44d68a2c3 => generated 1521 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:06:40.101885 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [req-a9ef958c-7c07-4c6e-aac5-581143f81681 req-283c7ced-681a-4ea2-9985-d9d65e4a6bbc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ba6ffc5c-84a4-40f1-bdc7-f87dde2c99df", "tag": "5505ddf1-841a-456c-b4c2-811d7146122d"}]} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:06:40.118859 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-a9ef958c-7c07-4c6e-aac5-581143f81681 req-283c7ced-681a-4ea2-9985-d9d65e4a6bbc service nova] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:06:40.119415 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-a9ef958c-7c07-4c6e-aac5-581143f81681 req-283c7ced-681a-4ea2-9985-d9d65e4a6bbc service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:06:40.126072 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-a9ef958c-7c07-4c6e-aac5-581143f81681 req-283c7ced-681a-4ea2-9985-d9d65e4a6bbc service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:06:40.148659 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.compute.server_external_events [req-a9ef958c-7c07-4c6e-aac5-581143f81681 req-283c7ced-681a-4ea2-9985-d9d65e4a6bbc service nova] Creating event network-changed:5505ddf1-841a-456c-b4c2-811d7146122d for instance ba6ffc5c-84a4-40f1-bdc7-f87dde2c99df on n-h1-863052-2 Nov 01 19:06:40.161429 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [req-a9ef958c-7c07-4c6e-aac5-581143f81681 req-283c7ced-681a-4ea2-9985-d9d65e4a6bbc service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072841 Nov 01 19:06:40.165434 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1540/3025] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Nov 1 19:06:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:06:40.171483 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-1c7ad1cb-352b-4f83-9426-f7732836a2a6 tempest-AttachSCSIVolumeTestJSON-356336257 tempest-AttachSCSIVolumeTestJSON-356336257-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:06:40.177709 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-1c7ad1cb-352b-4f83-9426-f7732836a2a6 tempest-AttachSCSIVolumeTestJSON-356336257 tempest-AttachSCSIVolumeTestJSON-356336257-project] [instance: 8a378b79-bd92-4ade-b034-1aaf5c87b74b] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:06:40.191415 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-1c7ad1cb-352b-4f83-9426-f7732836a2a6 tempest-AttachSCSIVolumeTestJSON-356336257 tempest-AttachSCSIVolumeTestJSON-356336257-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:06:40.197034 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-1c7ad1cb-352b-4f83-9426-f7732836a2a6 tempest-AttachSCSIVolumeTestJSON-356336257 tempest-AttachSCSIVolumeTestJSON-356336257-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:06:40.197801 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-1c7ad1cb-352b-4f83-9426-f7732836a2a6 tempest-AttachSCSIVolumeTestJSON-356336257 tempest-AttachSCSIVolumeTestJSON-356336257-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:06:40.198626 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-1c7ad1cb-352b-4f83-9426-f7732836a2a6 tempest-AttachSCSIVolumeTestJSON-356336257 tempest-AttachSCSIVolumeTestJSON-356336257-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:06:40.199160 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-1c7ad1cb-352b-4f83-9426-f7732836a2a6 tempest-AttachSCSIVolumeTestJSON-356336257 tempest-AttachSCSIVolumeTestJSON-356336257-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:06:40.200267 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-1c7ad1cb-352b-4f83-9426-f7732836a2a6 tempest-AttachSCSIVolumeTestJSON-356336257 tempest-AttachSCSIVolumeTestJSON-356336257-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:06:40.348701 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.network.neutron [None req-5748107a-3389-47dd-9f0f-4018ded06b87 tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] [instance: 307ee785-a01d-401c-8be2-b17558e735f3] Building network info cache for instance {{(pid=121402) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Nov 01 19:06:40.943026 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-1c7ad1cb-352b-4f83-9426-f7732836a2a6 tempest-AttachSCSIVolumeTestJSON-356336257 tempest-AttachSCSIVolumeTestJSON-356336257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde7667dbbfd4864a5b0ca8d8b291406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b14142c34d54977ac9eb59962f2a9e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:06:40.958505 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-1c7ad1cb-352b-4f83-9426-f7732836a2a6 tempest-AttachSCSIVolumeTestJSON-356336257 tempest-AttachSCSIVolumeTestJSON-356336257-project] 10.222.0.13 "GET /compute/v2.1/servers/8a378b79-bd92-4ade-b034-1aaf5c87b74b" status: 200 len: 1372 microversion: 2.1 time: 0.791665 Nov 01 19:06:40.959138 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1541/3026] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:06:40 2022] GET /compute/v2.1/servers/8a378b79-bd92-4ade-b034-1aaf5c87b74b => generated 1372 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:06:40.974089 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-1b2ec28c-637f-49e1-9f5d-275645cf618e tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:06:40.987353 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-1b2ec28c-637f-49e1-9f5d-275645cf618e tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] [instance: af1071a8-a090-44c9-890c-123ca3ff39f1] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:06:41.011786 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-1b2ec28c-637f-49e1-9f5d-275645cf618e tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:06:41.012723 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-1b2ec28c-637f-49e1-9f5d-275645cf618e tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:06:41.013169 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-1b2ec28c-637f-49e1-9f5d-275645cf618e tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:06:41.013892 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-1b2ec28c-637f-49e1-9f5d-275645cf618e tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:06:41.014358 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-1b2ec28c-637f-49e1-9f5d-275645cf618e tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:06:41.014781 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-1b2ec28c-637f-49e1-9f5d-275645cf618e tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:06:41.884128 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-1b2ec28c-637f-49e1-9f5d-275645cf618e tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '301ed3b9c37449bc9ade378f3c73a768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8807757227574c828dca1947af76659d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:06:41.909141 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-1b2ec28c-637f-49e1-9f5d-275645cf618e tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '301ed3b9c37449bc9ade378f3c73a768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8807757227574c828dca1947af76659d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:06:41.912443 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-1b2ec28c-637f-49e1-9f5d-275645cf618e tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '301ed3b9c37449bc9ade378f3c73a768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8807757227574c828dca1947af76659d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:06:41.913705 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-1b2ec28c-637f-49e1-9f5d-275645cf618e tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] 10.222.0.13 "GET /compute/v2.1/servers/af1071a8-a090-44c9-890c-123ca3ff39f1" status: 200 len: 1880 microversion: 2.42 time: 0.947572 Nov 01 19:06:41.920129 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1542/3027] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 19:06:40 2022] GET /compute/v2.1/servers/af1071a8-a090-44c9-890c-123ca3ff39f1 => generated 1880 bytes in 954 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 19:06:41.934660 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-565ab74b-45f2-44b3-a22f-fbf3e77b53a7 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:06:41.935294 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-565ab74b-45f2-44b3-a22f-fbf3e77b53a7 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] [instance: 674f7fae-6219-4e5e-b85a-2647b948807e] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:06:41.957696 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-565ab74b-45f2-44b3-a22f-fbf3e77b53a7 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:06:41.958255 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-565ab74b-45f2-44b3-a22f-fbf3e77b53a7 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:06:41.962009 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-565ab74b-45f2-44b3-a22f-fbf3e77b53a7 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:06:41.966890 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-565ab74b-45f2-44b3-a22f-fbf3e77b53a7 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:06:41.969262 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-565ab74b-45f2-44b3-a22f-fbf3e77b53a7 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:06:41.969734 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-565ab74b-45f2-44b3-a22f-fbf3e77b53a7 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:06:42.151445 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-565ab74b-45f2-44b3-a22f-fbf3e77b53a7 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '790f3f1566b7464aaca19d4d05c0942e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33e3d319293c46b6af2f728a50586906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:06:42.160251 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-565ab74b-45f2-44b3-a22f-fbf3e77b53a7 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] 10.222.0.13 "GET /compute/v2.1/servers/674f7fae-6219-4e5e-b85a-2647b948807e" status: 200 len: 1299 microversion: 2.1 time: 0.238085 Nov 01 19:06:42.171431 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1543/3028] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:06:41 2022] GET /compute/v2.1/servers/674f7fae-6219-4e5e-b85a-2647b948807e => generated 1299 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:06:42.179767 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [req-9934750d-da99-46b4-85e9-947bbfc0a9d3 req-1f8b3b4e-d668-4767-966e-51d31b68d6de service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0b57b50d-1ec4-4ee1-ac3a-f6f44d68a2c3", "name": "network-vif-unplugged", "status": "completed", "tag": "4032ee0a-a429-4780-a678-83209caf97b1"}]} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:06:42.212118 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-9934750d-da99-46b4-85e9-947bbfc0a9d3 req-1f8b3b4e-d668-4767-966e-51d31b68d6de service nova] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:06:42.212750 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-9934750d-da99-46b4-85e9-947bbfc0a9d3 req-1f8b3b4e-d668-4767-966e-51d31b68d6de service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:06:42.213205 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-9934750d-da99-46b4-85e9-947bbfc0a9d3 req-1f8b3b4e-d668-4767-966e-51d31b68d6de service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:06:42.260181 n-d-863052-2 devstack@n-api.service[121403]: DEBUG dbcounter [-] [121403] Writing DB stats nova_cell1:SELECT=100 {{(pid=121403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 19:06:42.310832 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.compute.server_external_events [req-9934750d-da99-46b4-85e9-947bbfc0a9d3 req-1f8b3b4e-d668-4767-966e-51d31b68d6de service nova] Creating event network-vif-unplugged:4032ee0a-a429-4780-a678-83209caf97b1 for instance 0b57b50d-1ec4-4ee1-ac3a-f6f44d68a2c3 on n-h2-863052-2 Nov 01 19:06:42.332540 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [req-9934750d-da99-46b4-85e9-947bbfc0a9d3 req-1f8b3b4e-d668-4767-966e-51d31b68d6de service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.159611 Nov 01 19:06:42.334000 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1544/3029] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Nov 1 19:06:42 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:06:42.347522 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-afa81c4a-4dea-4e3c-930b-b217cc7633e9 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:06:42.349233 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-afa81c4a-4dea-4e3c-930b-b217cc7633e9 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] [instance: ba6ffc5c-84a4-40f1-bdc7-f87dde2c99df] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:06:42.371809 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-afa81c4a-4dea-4e3c-930b-b217cc7633e9 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:06:42.372701 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-afa81c4a-4dea-4e3c-930b-b217cc7633e9 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:06:42.373492 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-afa81c4a-4dea-4e3c-930b-b217cc7633e9 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:06:42.374916 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-afa81c4a-4dea-4e3c-930b-b217cc7633e9 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:06:42.375890 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-afa81c4a-4dea-4e3c-930b-b217cc7633e9 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:06:42.376773 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-afa81c4a-4dea-4e3c-930b-b217cc7633e9 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:06:43.596135 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-afa81c4a-4dea-4e3c-930b-b217cc7633e9 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd2105b0264b48d084d0e79cabff8bc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf4adda91364dab94830347c06e3957', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:06:43.625731 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-afa81c4a-4dea-4e3c-930b-b217cc7633e9 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd2105b0264b48d084d0e79cabff8bc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf4adda91364dab94830347c06e3957', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:06:43.627196 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-afa81c4a-4dea-4e3c-930b-b217cc7633e9 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd2105b0264b48d084d0e79cabff8bc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf4adda91364dab94830347c06e3957', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:06:43.643778 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-afa81c4a-4dea-4e3c-930b-b217cc7633e9 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] 10.222.0.13 "GET /compute/v2.1/servers/ba6ffc5c-84a4-40f1-bdc7-f87dde2c99df" status: 200 len: 1887 microversion: 2.32 time: 1.308368 Nov 01 19:06:43.644995 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1545/3030] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 19:06:42 2022] GET /compute/v2.1/servers/ba6ffc5c-84a4-40f1-bdc7-f87dde2c99df => generated 1887 bytes in 1310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 19:06:43.649790 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [req-b4c1a5f0-2bf6-4994-9691-3108f39507b9 req-8b04b980-f6be-47fa-978d-d9876c1670a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "86162175-5f45-4aa7-9825-f1a3b4a699ff", "name": "network-vif-deleted", "tag": "e985c4cd-3aee-4c89-a53f-f69bb65a4339"}]} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:06:43.705443 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-b4c1a5f0-2bf6-4994-9691-3108f39507b9 req-8b04b980-f6be-47fa-978d-d9876c1670a6 service nova] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:06:43.705924 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-b4c1a5f0-2bf6-4994-9691-3108f39507b9 req-8b04b980-f6be-47fa-978d-d9876c1670a6 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:06:43.707378 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-b4c1a5f0-2bf6-4994-9691-3108f39507b9 req-8b04b980-f6be-47fa-978d-d9876c1670a6 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:06:43.738335 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.compute.server_external_events [req-b4c1a5f0-2bf6-4994-9691-3108f39507b9 req-8b04b980-f6be-47fa-978d-d9876c1670a6 service nova] Creating event network-vif-deleted:e985c4cd-3aee-4c89-a53f-f69bb65a4339 for instance 86162175-5f45-4aa7-9825-f1a3b4a699ff on n-h1-863052-2 Nov 01 19:06:43.766637 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [req-b4c1a5f0-2bf6-4994-9691-3108f39507b9 req-8b04b980-f6be-47fa-978d-d9876c1670a6 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.117506 Nov 01 19:06:43.767585 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1546/3031] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Nov 1 19:06:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:06:43.778540 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-36df31de-e199-46c5-899e-8bd23f6bac3d tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:06:43.787808 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-36df31de-e199-46c5-899e-8bd23f6bac3d tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] [instance: 3a13d400-ebab-4430-bba5-4b5339199be4] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:06:43.816294 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-36df31de-e199-46c5-899e-8bd23f6bac3d tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:06:43.818497 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-36df31de-e199-46c5-899e-8bd23f6bac3d tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:06:43.819979 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-36df31de-e199-46c5-899e-8bd23f6bac3d tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:06:43.823267 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-36df31de-e199-46c5-899e-8bd23f6bac3d tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:06:43.823829 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-36df31de-e199-46c5-899e-8bd23f6bac3d tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:06:43.825153 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-36df31de-e199-46c5-899e-8bd23f6bac3d tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:06:44.018370 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-36df31de-e199-46c5-899e-8bd23f6bac3d tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '058480d92c9b4ab4af6815d0438a65c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee9dc49b89143f781e4ab30296e4d01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:06:44.032878 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-36df31de-e199-46c5-899e-8bd23f6bac3d tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] 10.222.0.13 "GET /compute/v2.1/servers/3a13d400-ebab-4430-bba5-4b5339199be4" status: 200 len: 1273 microversion: 2.1 time: 0.256598 Nov 01 19:06:44.034043 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1547/3032] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:06:43 2022] GET /compute/v2.1/servers/3a13d400-ebab-4430-bba5-4b5339199be4 => generated 1273 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:06:44.181372 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-306ef5c7-4172-4526-8757-55b05e3ce40f tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-\u20a1-184690580", "imageRef": "2d4a0047-1b9e-445f-8af8-1b5c9d93e881", "flavorRef": "452", "networks": [{"uuid": "346d9303-d6bc-4555-85be-95ee31a2d9cd"}]}} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:06:44.336237 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.network.neutron [None req-306ef5c7-4172-4526-8757-55b05e3ce40f tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] validate_networks() for [('346d9303-d6bc-4555-85be-95ee31a2d9cd', None, None, None, None, None)] {{(pid=121403) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 01 19:06:44.424700 n-d-863052-2 devstack@n-api.service[121402]: DEBUG dbcounter [-] [121402] Writing DB stats nova_api:SELECT=16,nova_api:UPDATE=1 {{(pid=121402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 19:06:45.617413 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.network.neutron [None req-5748107a-3389-47dd-9f0f-4018ded06b87 tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] [instance: 307ee785-a01d-401c-8be2-b17558e735f3] Updating instance_info_cache with network_info: [{"id": "d65b5fcd-5bb6-4feb-b4bf-95734bcb3072", "address": "fa:16:3e:8e:cf:5c", "network": {"id": "5b808c64-bf01-4ded-bf6b-0b3fd18d2f1c", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-768163193-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.8.254", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "eda6511ea24c4c19a7c5d91535c7288d", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapd65b5fcd-5b", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=121402) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Nov 01 19:06:45.635712 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-5748107a-3389-47dd-9f0f-4018ded06b87 tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] Releasing lock "refresh_cache-307ee785-a01d-401c-8be2-b17558e735f3" {{(pid=121402) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Nov 01 19:06:45.645199 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-5748107a-3389-47dd-9f0f-4018ded06b87 tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] 10.222.0.13 "POST /compute/v2.1/servers/307ee785-a01d-401c-8be2-b17558e735f3/action" status: 202 len: 0 microversion: 2.1 time: 11.258623 Nov 01 19:06:45.649116 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1486/3033] 10.222.0.13 () {60 vars in 1278 bytes} [Tue Nov 1 19:06:34 2022] POST /compute/v2.1/servers/307ee785-a01d-401c-8be2-b17558e735f3/action => generated 0 bytes in 11271 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Nov 01 19:06:45.692534 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-92788329-c232-42a4-b278-083814be5525 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:06:45.696940 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-92788329-c232-42a4-b278-083814be5525 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] [instance: 0b57b50d-1ec4-4ee1-ac3a-f6f44d68a2c3] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:06:45.721547 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-92788329-c232-42a4-b278-083814be5525 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:06:45.722836 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-92788329-c232-42a4-b278-083814be5525 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:06:45.725804 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-92788329-c232-42a4-b278-083814be5525 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:06:45.729284 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-92788329-c232-42a4-b278-083814be5525 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:06:45.729959 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-92788329-c232-42a4-b278-083814be5525 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:06:45.732742 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-92788329-c232-42a4-b278-083814be5525 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:06:46.301958 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.virt.hardware [None req-306ef5c7-4172-4526-8757-55b05e3ce40f tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Flavor limits 0:0:0 {{(pid=121403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 01 19:06:46.303157 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.virt.hardware [None req-306ef5c7-4172-4526-8757-55b05e3ce40f tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Image limits 0:0:0 {{(pid=121403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 01 19:06:46.303879 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.virt.hardware [None req-306ef5c7-4172-4526-8757-55b05e3ce40f tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Flavor pref 0:0:0 {{(pid=121403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 01 19:06:46.304537 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.virt.hardware [None req-306ef5c7-4172-4526-8757-55b05e3ce40f tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Image pref 0:0:0 {{(pid=121403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 01 19:06:46.305147 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.virt.hardware [None req-306ef5c7-4172-4526-8757-55b05e3ce40f tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 01 19:06:46.334439 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-306ef5c7-4172-4526-8757-55b05e3ce40f tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:06:46.335352 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-306ef5c7-4172-4526-8757-55b05e3ce40f tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:06:46.336066 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-306ef5c7-4172-4526-8757-55b05e3ce40f tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:06:46.339063 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-306ef5c7-4172-4526-8757-55b05e3ce40f tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:06:46.341181 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-306ef5c7-4172-4526-8757-55b05e3ce40f tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:06:46.344902 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-306ef5c7-4172-4526-8757-55b05e3ce40f tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:06:46.412848 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.quota [None req-306ef5c7-4172-4526-8757-55b05e3ce40f tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Getting quotas for project 851785a5f76548898a77d67792888504. Resources: {'cores', 'ram', 'instances'} {{(pid=121403) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 01 19:06:46.437601 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.quota [None req-306ef5c7-4172-4526-8757-55b05e3ce40f tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Getting quotas for user 113bd8c844ee490b86a68bc7e1e75da3 and project 851785a5f76548898a77d67792888504. Resources: {'cores', 'ram', 'instances'} {{(pid=121403) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 01 19:06:46.484798 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-306ef5c7-4172-4526-8757-55b05e3ce40f tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Going to run 1 instances... {{(pid=121403) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 01 19:06:46.491662 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-306ef5c7-4172-4526-8757-55b05e3ce40f tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] [instance: f5d5dfa8-4516-428f-bcf5-f0a1174bd14e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2d4a0047-1b9e-445f-8af8-1b5c9d93e881',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121403) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 01 19:06:46.610264 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-306ef5c7-4172-4526-8757-55b05e3ce40f tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.574837 Nov 01 19:06:46.615920 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1548/3034] 10.222.0.13 () {60 vars in 1147 bytes} [Tue Nov 1 19:06:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 2581 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 01 19:06:46.633800 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-f552df65-685b-46c7-8497-857b6d65991a tempest-AttachSCSIVolumeTestJSON-356336257 tempest-AttachSCSIVolumeTestJSON-356336257-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:06:46.634638 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-f552df65-685b-46c7-8497-857b6d65991a tempest-AttachSCSIVolumeTestJSON-356336257 tempest-AttachSCSIVolumeTestJSON-356336257-project] [instance: 8a378b79-bd92-4ade-b034-1aaf5c87b74b] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:06:46.665557 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f552df65-685b-46c7-8497-857b6d65991a tempest-AttachSCSIVolumeTestJSON-356336257 tempest-AttachSCSIVolumeTestJSON-356336257-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:06:46.666094 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f552df65-685b-46c7-8497-857b6d65991a tempest-AttachSCSIVolumeTestJSON-356336257 tempest-AttachSCSIVolumeTestJSON-356336257-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:06:46.666550 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f552df65-685b-46c7-8497-857b6d65991a tempest-AttachSCSIVolumeTestJSON-356336257 tempest-AttachSCSIVolumeTestJSON-356336257-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:06:46.667290 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f552df65-685b-46c7-8497-857b6d65991a tempest-AttachSCSIVolumeTestJSON-356336257 tempest-AttachSCSIVolumeTestJSON-356336257-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:06:46.667799 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f552df65-685b-46c7-8497-857b6d65991a tempest-AttachSCSIVolumeTestJSON-356336257 tempest-AttachSCSIVolumeTestJSON-356336257-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:06:46.668776 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f552df65-685b-46c7-8497-857b6d65991a tempest-AttachSCSIVolumeTestJSON-356336257 tempest-AttachSCSIVolumeTestJSON-356336257-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:06:47.149426 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-92788329-c232-42a4-b278-083814be5525 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05d6a1722dfa4e959aeb14d601e43b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b5d812eff94e2f89d4705d7e7d5f3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:06:47.167824 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-92788329-c232-42a4-b278-083814be5525 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] 10.222.0.13 "GET /compute/v2.1/servers/0b57b50d-1ec4-4ee1-ac3a-f6f44d68a2c3" status: 200 len: 1521 microversion: 2.1 time: 1.515427 Nov 01 19:06:47.168575 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1487/3035] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:06:45 2022] GET /compute/v2.1/servers/0b57b50d-1ec4-4ee1-ac3a-f6f44d68a2c3 => generated 1521 bytes in 1519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:06:47.199870 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [req-fe20d282-d6fb-49be-abc1-55078e9725a1 req-f515e209-4155-4b60-b934-8572591d2939 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "307ee785-a01d-401c-8be2-b17558e735f3", "tag": "d65b5fcd-5bb6-4feb-b4bf-95734bcb3072"}]} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:06:47.237889 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-fe20d282-d6fb-49be-abc1-55078e9725a1 req-f515e209-4155-4b60-b934-8572591d2939 service nova] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:06:47.238518 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-fe20d282-d6fb-49be-abc1-55078e9725a1 req-f515e209-4155-4b60-b934-8572591d2939 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:06:47.238955 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-fe20d282-d6fb-49be-abc1-55078e9725a1 req-f515e209-4155-4b60-b934-8572591d2939 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:06:47.279328 n-d-863052-2 devstack@n-api.service[121402]: DEBUG dbcounter [-] [121402] Writing DB stats nova_cell1:SELECT=87,nova_cell1:SAVEPOINT=4,nova_cell1:RELEASE=4,nova_cell1:UPDATE=4,nova_cell1:INSERT=1 {{(pid=121402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 19:06:47.285337 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.compute.server_external_events [req-fe20d282-d6fb-49be-abc1-55078e9725a1 req-f515e209-4155-4b60-b934-8572591d2939 service nova] Creating event network-changed:d65b5fcd-5bb6-4feb-b4bf-95734bcb3072 for instance 307ee785-a01d-401c-8be2-b17558e735f3 on n-h2-863052-2 Nov 01 19:06:47.301283 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [req-fe20d282-d6fb-49be-abc1-55078e9725a1 req-f515e209-4155-4b60-b934-8572591d2939 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.108985 Nov 01 19:06:47.307436 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1488/3036] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Nov 1 19:06:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:06:47.327444 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-cab5fce4-c94f-42a7-aeae-d8d26fbadcca tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:06:47.327444 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-cab5fce4-c94f-42a7-aeae-d8d26fbadcca tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] [instance: af1071a8-a090-44c9-890c-123ca3ff39f1] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:06:47.347637 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-f552df65-685b-46c7-8497-857b6d65991a tempest-AttachSCSIVolumeTestJSON-356336257 tempest-AttachSCSIVolumeTestJSON-356336257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde7667dbbfd4864a5b0ca8d8b291406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b14142c34d54977ac9eb59962f2a9e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:06:47.348524 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-cab5fce4-c94f-42a7-aeae-d8d26fbadcca tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:06:47.349248 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-cab5fce4-c94f-42a7-aeae-d8d26fbadcca tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:06:47.349946 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-cab5fce4-c94f-42a7-aeae-d8d26fbadcca tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:06:47.350900 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-cab5fce4-c94f-42a7-aeae-d8d26fbadcca tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:06:47.354989 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-cab5fce4-c94f-42a7-aeae-d8d26fbadcca tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:06:47.356214 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-cab5fce4-c94f-42a7-aeae-d8d26fbadcca tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:06:47.357208 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-f552df65-685b-46c7-8497-857b6d65991a tempest-AttachSCSIVolumeTestJSON-356336257 tempest-AttachSCSIVolumeTestJSON-356336257-project] 10.222.0.13 "GET /compute/v2.1/servers/8a378b79-bd92-4ade-b034-1aaf5c87b74b" status: 200 len: 1372 microversion: 2.1 time: 0.739436 Nov 01 19:06:47.357805 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1549/3037] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:06:46 2022] GET /compute/v2.1/servers/8a378b79-bd92-4ade-b034-1aaf5c87b74b => generated 1372 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:06:47.410759 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-b65665a9-2626-48ef-b974-78d3ea857efe tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:06:47.411519 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-b65665a9-2626-48ef-b974-78d3ea857efe tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] [instance: 674f7fae-6219-4e5e-b85a-2647b948807e] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:06:47.439517 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-b65665a9-2626-48ef-b974-78d3ea857efe tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:06:47.442205 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-b65665a9-2626-48ef-b974-78d3ea857efe tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:06:47.442645 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-b65665a9-2626-48ef-b974-78d3ea857efe tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:06:47.452051 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-b65665a9-2626-48ef-b974-78d3ea857efe tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:06:47.452991 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-b65665a9-2626-48ef-b974-78d3ea857efe tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:06:47.453722 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-b65665a9-2626-48ef-b974-78d3ea857efe tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:06:48.223029 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-b65665a9-2626-48ef-b974-78d3ea857efe tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '790f3f1566b7464aaca19d4d05c0942e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33e3d319293c46b6af2f728a50586906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:06:48.234656 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-b65665a9-2626-48ef-b974-78d3ea857efe tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] 10.222.0.13 "GET /compute/v2.1/servers/674f7fae-6219-4e5e-b85a-2647b948807e" status: 200 len: 1367 microversion: 2.1 time: 0.875714 Nov 01 19:06:48.239035 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1550/3038] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:06:47 2022] GET /compute/v2.1/servers/674f7fae-6219-4e5e-b85a-2647b948807e => generated 1367 bytes in 880 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:06:48.247271 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-882604ae-c640-42ff-ab2f-948f747b8490 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:06:48.248053 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-882604ae-c640-42ff-ab2f-948f747b8490 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] [instance: 3a13d400-ebab-4430-bba5-4b5339199be4] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:06:48.255274 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-882604ae-c640-42ff-ab2f-948f747b8490 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:06:48.256096 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-882604ae-c640-42ff-ab2f-948f747b8490 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:06:48.257004 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-882604ae-c640-42ff-ab2f-948f747b8490 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:06:48.258025 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-882604ae-c640-42ff-ab2f-948f747b8490 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:06:48.258799 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-882604ae-c640-42ff-ab2f-948f747b8490 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:06:48.259452 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-882604ae-c640-42ff-ab2f-948f747b8490 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:06:48.305920 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-882604ae-c640-42ff-ab2f-948f747b8490 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] [instance: 3a13d400-ebab-4430-bba5-4b5339199be4] Going to try to terminate instance {{(pid=121403) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 01 19:06:48.338234 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-cab5fce4-c94f-42a7-aeae-d8d26fbadcca tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '301ed3b9c37449bc9ade378f3c73a768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8807757227574c828dca1947af76659d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:06:48.359502 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-cab5fce4-c94f-42a7-aeae-d8d26fbadcca tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '301ed3b9c37449bc9ade378f3c73a768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8807757227574c828dca1947af76659d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:06:48.360996 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-cab5fce4-c94f-42a7-aeae-d8d26fbadcca tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '301ed3b9c37449bc9ade378f3c73a768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8807757227574c828dca1947af76659d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:06:48.362199 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-cab5fce4-c94f-42a7-aeae-d8d26fbadcca tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] 10.222.0.13 "GET /compute/v2.1/servers/af1071a8-a090-44c9-890c-123ca3ff39f1" status: 200 len: 1880 microversion: 2.42 time: 1.045648 Nov 01 19:06:48.362870 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1489/3039] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 19:06:47 2022] GET /compute/v2.1/servers/af1071a8-a090-44c9-890c-123ca3ff39f1 => generated 1880 bytes in 1055 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 19:06:48.385483 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [req-dade35e1-e478-4519-8944-ef995431e522 req-351189d8-81da-46ba-9df5-159c65194857 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0b57b50d-1ec4-4ee1-ac3a-f6f44d68a2c3", "name": "network-vif-plugged", "status": "completed", "tag": "4032ee0a-a429-4780-a678-83209caf97b1"}]} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:06:48.422594 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-dade35e1-e478-4519-8944-ef995431e522 req-351189d8-81da-46ba-9df5-159c65194857 service nova] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:06:48.423602 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-dade35e1-e478-4519-8944-ef995431e522 req-351189d8-81da-46ba-9df5-159c65194857 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:06:48.430388 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-dade35e1-e478-4519-8944-ef995431e522 req-351189d8-81da-46ba-9df5-159c65194857 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:06:48.453938 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.compute.server_external_events [req-dade35e1-e478-4519-8944-ef995431e522 req-351189d8-81da-46ba-9df5-159c65194857 service nova] Creating event network-vif-plugged:4032ee0a-a429-4780-a678-83209caf97b1 for instance 0b57b50d-1ec4-4ee1-ac3a-f6f44d68a2c3 on n-h2-863052-2 Nov 01 19:06:48.475185 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-882604ae-c640-42ff-ab2f-948f747b8490 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] 10.222.0.13 "DELETE /compute/v2.1/servers/3a13d400-ebab-4430-bba5-4b5339199be4" status: 204 len: 0 microversion: 2.1 time: 0.234522 Nov 01 19:06:48.477987 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [req-dade35e1-e478-4519-8944-ef995431e522 req-351189d8-81da-46ba-9df5-159c65194857 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097383 Nov 01 19:06:48.478495 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1551/3040] 10.222.0.13 () {58 vars in 1239 bytes} [Tue Nov 1 19:06:48 2022] DELETE /compute/v2.1/servers/3a13d400-ebab-4430-bba5-4b5339199be4 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 01 19:06:48.485166 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1490/3041] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Nov 1 19:06:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:06:48.490784 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-b2717eb0-1aa6-43a0-bd60-4d6fa3f3db6e tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] Calling method '.version_select at 0x7f0ae1afb430>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:06:48.500651 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-e7a2bd4f-30f7-472b-b949-28118d4ef67e tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:06:48.502653 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-e7a2bd4f-30f7-472b-b949-28118d4ef67e tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] [instance: ba6ffc5c-84a4-40f1-bdc7-f87dde2c99df] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:06:48.524147 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-e7a2bd4f-30f7-472b-b949-28118d4ef67e tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:06:48.524895 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-e7a2bd4f-30f7-472b-b949-28118d4ef67e tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:06:48.525658 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-e7a2bd4f-30f7-472b-b949-28118d4ef67e tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:06:48.526607 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-e7a2bd4f-30f7-472b-b949-28118d4ef67e tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:06:48.527297 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-e7a2bd4f-30f7-472b-b949-28118d4ef67e tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:06:48.527932 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-e7a2bd4f-30f7-472b-b949-28118d4ef67e tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:06:49.195525 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-e7a2bd4f-30f7-472b-b949-28118d4ef67e tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd2105b0264b48d084d0e79cabff8bc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf4adda91364dab94830347c06e3957', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:06:49.217240 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-e7a2bd4f-30f7-472b-b949-28118d4ef67e tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd2105b0264b48d084d0e79cabff8bc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf4adda91364dab94830347c06e3957', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:06:49.219362 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-e7a2bd4f-30f7-472b-b949-28118d4ef67e tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd2105b0264b48d084d0e79cabff8bc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf4adda91364dab94830347c06e3957', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:06:49.222142 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-e7a2bd4f-30f7-472b-b949-28118d4ef67e tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] 10.222.0.13 "GET /compute/v2.1/servers/ba6ffc5c-84a4-40f1-bdc7-f87dde2c99df" status: 200 len: 1887 microversion: 2.32 time: 0.740940 Nov 01 19:06:49.225848 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1552/3042] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 19:06:48 2022] GET /compute/v2.1/servers/ba6ffc5c-84a4-40f1-bdc7-f87dde2c99df => generated 1887 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 19:06:49.235511 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-12c19062-b082-413e-a245-aed8de2b3b36 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:06:49.250815 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-12c19062-b082-413e-a245-aed8de2b3b36 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] [instance: f5d5dfa8-4516-428f-bcf5-f0a1174bd14e] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:06:49.273584 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-12c19062-b082-413e-a245-aed8de2b3b36 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:06:49.274201 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-12c19062-b082-413e-a245-aed8de2b3b36 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:06:49.274642 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-12c19062-b082-413e-a245-aed8de2b3b36 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:06:49.275510 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-12c19062-b082-413e-a245-aed8de2b3b36 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:06:49.275887 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-12c19062-b082-413e-a245-aed8de2b3b36 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:06:49.276323 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-12c19062-b082-413e-a245-aed8de2b3b36 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:06:49.514933 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-12c19062-b082-413e-a245-aed8de2b3b36 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113bd8c844ee490b86a68bc7e1e75da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '851785a5f76548898a77d67792888504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:06:49.528272 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-12c19062-b082-413e-a245-aed8de2b3b36 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] 10.222.0.13 "GET /compute/v2.1/servers/f5d5dfa8-4516-428f-bcf5-f0a1174bd14e" status: 200 len: 1244 microversion: 2.1 time: 0.301042 Nov 01 19:06:49.529885 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1553/3043] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:06:49 2022] GET /compute/v2.1/servers/f5d5dfa8-4516-428f-bcf5-f0a1174bd14e => generated 1244 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:06:49.535551 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-3e7702c4-0f53-4f7e-ab8e-083d7cce3ca3 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:06:49.536743 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-3e7702c4-0f53-4f7e-ab8e-083d7cce3ca3 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] [instance: 0b57b50d-1ec4-4ee1-ac3a-f6f44d68a2c3] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:06:49.544364 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-3e7702c4-0f53-4f7e-ab8e-083d7cce3ca3 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:06:49.545604 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-3e7702c4-0f53-4f7e-ab8e-083d7cce3ca3 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:06:49.546446 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-3e7702c4-0f53-4f7e-ab8e-083d7cce3ca3 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:06:49.547498 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-3e7702c4-0f53-4f7e-ab8e-083d7cce3ca3 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:06:49.548815 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-3e7702c4-0f53-4f7e-ab8e-083d7cce3ca3 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:06:49.549452 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-3e7702c4-0f53-4f7e-ab8e-083d7cce3ca3 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:06:49.673204 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-b2717eb0-1aa6-43a0-bd60-4d6fa3f3db6e tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] 10.222.0.13 "GET /compute/v2.1/os-floating-ips/a2efedf2-0f48-407e-8190-a5f40a969b10" status: 200 len: 184 microversion: 2.1 time: 1.186452 Nov 01 19:06:49.674577 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1491/3044] 10.222.0.13 () {58 vars in 1260 bytes} [Tue Nov 1 19:06:48 2022] GET /compute/v2.1/os-floating-ips/a2efedf2-0f48-407e-8190-a5f40a969b10 => generated 184 bytes in 1189 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:06:49.679303 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-3b9709eb-4c13-42ac-8419-a0f73032293b tempest-AttachSCSIVolumeTestJSON-356336257 tempest-AttachSCSIVolumeTestJSON-356336257-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:06:49.680281 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-3b9709eb-4c13-42ac-8419-a0f73032293b tempest-AttachSCSIVolumeTestJSON-356336257 tempest-AttachSCSIVolumeTestJSON-356336257-project] [instance: 8a378b79-bd92-4ade-b034-1aaf5c87b74b] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:06:49.701631 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-3b9709eb-4c13-42ac-8419-a0f73032293b tempest-AttachSCSIVolumeTestJSON-356336257 tempest-AttachSCSIVolumeTestJSON-356336257-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:06:49.702155 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-3b9709eb-4c13-42ac-8419-a0f73032293b tempest-AttachSCSIVolumeTestJSON-356336257 tempest-AttachSCSIVolumeTestJSON-356336257-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:06:49.702671 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-3b9709eb-4c13-42ac-8419-a0f73032293b tempest-AttachSCSIVolumeTestJSON-356336257 tempest-AttachSCSIVolumeTestJSON-356336257-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:06:49.703408 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-3b9709eb-4c13-42ac-8419-a0f73032293b tempest-AttachSCSIVolumeTestJSON-356336257 tempest-AttachSCSIVolumeTestJSON-356336257-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:06:49.704063 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-3b9709eb-4c13-42ac-8419-a0f73032293b tempest-AttachSCSIVolumeTestJSON-356336257 tempest-AttachSCSIVolumeTestJSON-356336257-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:06:49.704680 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-3b9709eb-4c13-42ac-8419-a0f73032293b tempest-AttachSCSIVolumeTestJSON-356336257 tempest-AttachSCSIVolumeTestJSON-356336257-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:06:49.849827 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-3e7702c4-0f53-4f7e-ab8e-083d7cce3ca3 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05d6a1722dfa4e959aeb14d601e43b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b5d812eff94e2f89d4705d7e7d5f3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:06:49.858782 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-3e7702c4-0f53-4f7e-ab8e-083d7cce3ca3 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] 10.222.0.13 "GET /compute/v2.1/servers/0b57b50d-1ec4-4ee1-ac3a-f6f44d68a2c3" status: 200 len: 1521 microversion: 2.1 time: 0.327643 Nov 01 19:06:49.872112 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1554/3045] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:06:49 2022] GET /compute/v2.1/servers/0b57b50d-1ec4-4ee1-ac3a-f6f44d68a2c3 => generated 1521 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:06:49.872112 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-b4faa8cb-63ab-4d28-b172-1fab13d7061c tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:06:49.872112 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-b4faa8cb-63ab-4d28-b172-1fab13d7061c tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] [instance: 3a13d400-ebab-4430-bba5-4b5339199be4] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:06:49.888082 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-b4faa8cb-63ab-4d28-b172-1fab13d7061c tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:06:49.888831 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-b4faa8cb-63ab-4d28-b172-1fab13d7061c tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:06:49.890206 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-b4faa8cb-63ab-4d28-b172-1fab13d7061c tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:06:49.890936 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-b4faa8cb-63ab-4d28-b172-1fab13d7061c tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:06:49.891277 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-b4faa8cb-63ab-4d28-b172-1fab13d7061c tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:06:49.891713 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-b4faa8cb-63ab-4d28-b172-1fab13d7061c tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:06:50.459508 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-3b9709eb-4c13-42ac-8419-a0f73032293b tempest-AttachSCSIVolumeTestJSON-356336257 tempest-AttachSCSIVolumeTestJSON-356336257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde7667dbbfd4864a5b0ca8d8b291406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b14142c34d54977ac9eb59962f2a9e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:06:50.465670 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-b4faa8cb-63ab-4d28-b172-1fab13d7061c tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '058480d92c9b4ab4af6815d0438a65c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee9dc49b89143f781e4ab30296e4d01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:06:50.483485 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-3b9709eb-4c13-42ac-8419-a0f73032293b tempest-AttachSCSIVolumeTestJSON-356336257 tempest-AttachSCSIVolumeTestJSON-356336257-project] 10.222.0.13 "GET /compute/v2.1/servers/8a378b79-bd92-4ade-b034-1aaf5c87b74b" status: 200 len: 1372 microversion: 2.1 time: 0.806740 Nov 01 19:06:50.485010 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1492/3046] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:06:49 2022] GET /compute/v2.1/servers/8a378b79-bd92-4ade-b034-1aaf5c87b74b => generated 1372 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:06:50.501170 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-b4faa8cb-63ab-4d28-b172-1fab13d7061c tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] 10.222.0.13 "GET /compute/v2.1/servers/3a13d400-ebab-4430-bba5-4b5339199be4" status: 200 len: 1315 microversion: 2.1 time: 0.621164 Nov 01 19:06:50.501170 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1555/3047] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:06:49 2022] GET /compute/v2.1/servers/3a13d400-ebab-4430-bba5-4b5339199be4 => generated 1315 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:06:50.507486 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-10d44639-00c8-47a4-9da0-adeb69a84a07 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:06:50.508359 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-10d44639-00c8-47a4-9da0-adeb69a84a07 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] [instance: af1071a8-a090-44c9-890c-123ca3ff39f1] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:06:50.512806 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-589159bb-da28-49df-a1aa-713725fa50c7 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:06:50.515197 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-589159bb-da28-49df-a1aa-713725fa50c7 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] [instance: 674f7fae-6219-4e5e-b85a-2647b948807e] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:06:50.520433 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-10d44639-00c8-47a4-9da0-adeb69a84a07 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:06:50.521174 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-10d44639-00c8-47a4-9da0-adeb69a84a07 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:06:50.522193 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-10d44639-00c8-47a4-9da0-adeb69a84a07 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:06:50.523081 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-10d44639-00c8-47a4-9da0-adeb69a84a07 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:06:50.524798 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-10d44639-00c8-47a4-9da0-adeb69a84a07 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:06:50.525408 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-10d44639-00c8-47a4-9da0-adeb69a84a07 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:06:50.530886 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-589159bb-da28-49df-a1aa-713725fa50c7 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:06:50.531385 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-589159bb-da28-49df-a1aa-713725fa50c7 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:06:50.531836 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-589159bb-da28-49df-a1aa-713725fa50c7 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:06:50.533930 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-589159bb-da28-49df-a1aa-713725fa50c7 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:06:50.535433 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-589159bb-da28-49df-a1aa-713725fa50c7 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:06:50.535936 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-589159bb-da28-49df-a1aa-713725fa50c7 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:06:50.736343 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-589159bb-da28-49df-a1aa-713725fa50c7 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '790f3f1566b7464aaca19d4d05c0942e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33e3d319293c46b6af2f728a50586906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:06:50.749484 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-589159bb-da28-49df-a1aa-713725fa50c7 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] 10.222.0.13 "GET /compute/v2.1/servers/674f7fae-6219-4e5e-b85a-2647b948807e" status: 200 len: 1367 microversion: 2.1 time: 0.254715 Nov 01 19:06:50.750919 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1556/3048] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:06:50 2022] GET /compute/v2.1/servers/674f7fae-6219-4e5e-b85a-2647b948807e => generated 1367 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:06:50.757505 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [req-f1e0ef91-4d87-4439-8eb4-6a4c8a9c5a17 req-d8cd2835-859a-4bb3-b7cc-0957d1673ef5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3a13d400-ebab-4430-bba5-4b5339199be4", "tag": "d41182e2-e6f3-405a-a20f-6d8f80e3c0a1"}]} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:06:50.769831 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-f1e0ef91-4d87-4439-8eb4-6a4c8a9c5a17 req-d8cd2835-859a-4bb3-b7cc-0957d1673ef5 service nova] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:06:50.770619 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-f1e0ef91-4d87-4439-8eb4-6a4c8a9c5a17 req-d8cd2835-859a-4bb3-b7cc-0957d1673ef5 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:06:50.771199 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-f1e0ef91-4d87-4439-8eb4-6a4c8a9c5a17 req-d8cd2835-859a-4bb3-b7cc-0957d1673ef5 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:06:50.785792 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.compute.server_external_events [req-f1e0ef91-4d87-4439-8eb4-6a4c8a9c5a17 req-d8cd2835-859a-4bb3-b7cc-0957d1673ef5 service nova] Creating event network-changed:d41182e2-e6f3-405a-a20f-6d8f80e3c0a1 for instance 3a13d400-ebab-4430-bba5-4b5339199be4 on n-h1-863052-2 Nov 01 19:06:50.791343 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [req-f1e0ef91-4d87-4439-8eb4-6a4c8a9c5a17 req-d8cd2835-859a-4bb3-b7cc-0957d1673ef5 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038208 Nov 01 19:06:50.793392 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1557/3049] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Nov 1 19:06:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:06:50.800215 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [req-1f4bf5a6-3c32-4774-922a-d6de899eaaf8 req-f0a3871b-4f05-4891-b586-dc322d0598f1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ba6ffc5c-84a4-40f1-bdc7-f87dde2c99df", "tag": "9d41a73a-8bec-4fb0-8fe8-9b112c925078"}, {"name": "network-changed", "server_uuid": "8a378b79-bd92-4ade-b034-1aaf5c87b74b", "tag": "7351786b-bb68-489c-a92f-36e1f62d4e9a"}]} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:06:50.814242 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-1f4bf5a6-3c32-4774-922a-d6de899eaaf8 req-f0a3871b-4f05-4891-b586-dc322d0598f1 service nova] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:06:50.816864 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-1f4bf5a6-3c32-4774-922a-d6de899eaaf8 req-f0a3871b-4f05-4891-b586-dc322d0598f1 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:06:50.820683 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-1f4bf5a6-3c32-4774-922a-d6de899eaaf8 req-f0a3871b-4f05-4891-b586-dc322d0598f1 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:06:50.834292 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.compute.server_external_events [req-1f4bf5a6-3c32-4774-922a-d6de899eaaf8 req-f0a3871b-4f05-4891-b586-dc322d0598f1 service nova] Creating event network-changed:9d41a73a-8bec-4fb0-8fe8-9b112c925078 for instance ba6ffc5c-84a4-40f1-bdc7-f87dde2c99df on n-h1-863052-2 Nov 01 19:06:50.835152 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.compute.server_external_events [req-1f4bf5a6-3c32-4774-922a-d6de899eaaf8 req-f0a3871b-4f05-4891-b586-dc322d0598f1 service nova] Creating event network-changed:7351786b-bb68-489c-a92f-36e1f62d4e9a for instance 8a378b79-bd92-4ade-b034-1aaf5c87b74b on n-h2-863052-2 Nov 01 19:06:50.844620 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [req-1f4bf5a6-3c32-4774-922a-d6de899eaaf8 req-f0a3871b-4f05-4891-b586-dc322d0598f1 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.049258 Nov 01 19:06:50.845860 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1558/3050] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Nov 1 19:06:50 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:06:50.852383 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-b1019b54-79ab-4e3f-b147-a5b27a7769d0 tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.8.254"}} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:06:50.921000 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-10d44639-00c8-47a4-9da0-adeb69a84a07 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '301ed3b9c37449bc9ade378f3c73a768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8807757227574c828dca1947af76659d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:06:50.932346 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-10d44639-00c8-47a4-9da0-adeb69a84a07 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '301ed3b9c37449bc9ade378f3c73a768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8807757227574c828dca1947af76659d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:06:50.934386 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-10d44639-00c8-47a4-9da0-adeb69a84a07 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '301ed3b9c37449bc9ade378f3c73a768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8807757227574c828dca1947af76659d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:06:50.935831 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-10d44639-00c8-47a4-9da0-adeb69a84a07 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] 10.222.0.13 "GET /compute/v2.1/servers/af1071a8-a090-44c9-890c-123ca3ff39f1" status: 200 len: 1880 microversion: 2.42 time: 0.435464 Nov 01 19:06:50.944692 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1493/3051] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 19:06:50 2022] GET /compute/v2.1/servers/af1071a8-a090-44c9-890c-123ca3ff39f1 => generated 1880 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 19:06:50.944692 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-1912c948-3449-4846-b040-68816f9e729b tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:06:50.944692 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-1912c948-3449-4846-b040-68816f9e729b tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] [instance: ba6ffc5c-84a4-40f1-bdc7-f87dde2c99df] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:06:50.950547 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-1912c948-3449-4846-b040-68816f9e729b tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:06:50.951045 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-1912c948-3449-4846-b040-68816f9e729b tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:06:50.951802 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-1912c948-3449-4846-b040-68816f9e729b tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:06:50.952520 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-1912c948-3449-4846-b040-68816f9e729b tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:06:50.953199 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-1912c948-3449-4846-b040-68816f9e729b tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:06:50.953645 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-1912c948-3449-4846-b040-68816f9e729b tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:06:50.993756 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-b1019b54-79ab-4e3f-b147-a5b27a7769d0 tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] [instance: 307ee785-a01d-401c-8be2-b17558e735f3] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:06:51.003379 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-b1019b54-79ab-4e3f-b147-a5b27a7769d0 tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:06:51.003962 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-b1019b54-79ab-4e3f-b147-a5b27a7769d0 tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:06:51.004474 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-b1019b54-79ab-4e3f-b147-a5b27a7769d0 tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:06:51.005268 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-b1019b54-79ab-4e3f-b147-a5b27a7769d0 tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:06:51.005794 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-b1019b54-79ab-4e3f-b147-a5b27a7769d0 tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:06:51.006295 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-b1019b54-79ab-4e3f-b147-a5b27a7769d0 tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:06:51.146420 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-1912c948-3449-4846-b040-68816f9e729b tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd2105b0264b48d084d0e79cabff8bc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf4adda91364dab94830347c06e3957', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:06:51.158510 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-1912c948-3449-4846-b040-68816f9e729b tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd2105b0264b48d084d0e79cabff8bc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf4adda91364dab94830347c06e3957', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:06:51.160223 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-1912c948-3449-4846-b040-68816f9e729b tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd2105b0264b48d084d0e79cabff8bc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf4adda91364dab94830347c06e3957', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:06:51.161640 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-1912c948-3449-4846-b040-68816f9e729b tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] 10.222.0.13 "GET /compute/v2.1/servers/ba6ffc5c-84a4-40f1-bdc7-f87dde2c99df" status: 200 len: 1887 microversion: 2.32 time: 0.223488 Nov 01 19:06:51.172753 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1494/3052] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 19:06:50 2022] GET /compute/v2.1/servers/ba6ffc5c-84a4-40f1-bdc7-f87dde2c99df => generated 1887 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 19:06:51.172753 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-bd8836a3-1e0d-49ff-b6d5-1b292fb14206 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:06:51.172753 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-bd8836a3-1e0d-49ff-b6d5-1b292fb14206 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] [instance: f5d5dfa8-4516-428f-bcf5-f0a1174bd14e] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:06:51.175151 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-bd8836a3-1e0d-49ff-b6d5-1b292fb14206 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:06:51.175692 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-bd8836a3-1e0d-49ff-b6d5-1b292fb14206 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:06:51.176200 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-bd8836a3-1e0d-49ff-b6d5-1b292fb14206 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:06:51.177079 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-bd8836a3-1e0d-49ff-b6d5-1b292fb14206 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:06:51.177772 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-bd8836a3-1e0d-49ff-b6d5-1b292fb14206 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:06:51.178150 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-bd8836a3-1e0d-49ff-b6d5-1b292fb14206 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:06:51.255315 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-bd8836a3-1e0d-49ff-b6d5-1b292fb14206 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113bd8c844ee490b86a68bc7e1e75da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '851785a5f76548898a77d67792888504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:06:51.257437 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-b1019b54-79ab-4e3f-b147-a5b27a7769d0 tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] Acquiring lock "refresh_cache-307ee785-a01d-401c-8be2-b17558e735f3" {{(pid=121403) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Nov 01 19:06:51.257914 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-b1019b54-79ab-4e3f-b147-a5b27a7769d0 tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] Acquired lock "refresh_cache-307ee785-a01d-401c-8be2-b17558e735f3" {{(pid=121403) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Nov 01 19:06:51.264534 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-bd8836a3-1e0d-49ff-b6d5-1b292fb14206 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] 10.222.0.13 "GET /compute/v2.1/servers/f5d5dfa8-4516-428f-bcf5-f0a1174bd14e" status: 200 len: 1250 microversion: 2.1 time: 0.100762 Nov 01 19:06:51.265372 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1495/3053] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:06:51 2022] GET /compute/v2.1/servers/f5d5dfa8-4516-428f-bcf5-f0a1174bd14e => generated 1250 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:06:51.270260 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-c0fd585d-c62e-48fd-9bde-17278aaa8968 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:06:51.271056 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-c0fd585d-c62e-48fd-9bde-17278aaa8968 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] [instance: 0b57b50d-1ec4-4ee1-ac3a-f6f44d68a2c3] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:06:51.277352 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-c0fd585d-c62e-48fd-9bde-17278aaa8968 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:06:51.277857 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-c0fd585d-c62e-48fd-9bde-17278aaa8968 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:06:51.278298 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-c0fd585d-c62e-48fd-9bde-17278aaa8968 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:06:51.279018 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-c0fd585d-c62e-48fd-9bde-17278aaa8968 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:06:51.279630 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-c0fd585d-c62e-48fd-9bde-17278aaa8968 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:06:51.280070 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-c0fd585d-c62e-48fd-9bde-17278aaa8968 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:06:51.784105 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-c0fd585d-c62e-48fd-9bde-17278aaa8968 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05d6a1722dfa4e959aeb14d601e43b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b5d812eff94e2f89d4705d7e7d5f3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:06:51.793406 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-c0fd585d-c62e-48fd-9bde-17278aaa8968 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] 10.222.0.13 "GET /compute/v2.1/servers/0b57b50d-1ec4-4ee1-ac3a-f6f44d68a2c3" status: 200 len: 1521 microversion: 2.1 time: 0.526382 Nov 01 19:06:51.794568 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1496/3054] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:06:51 2022] GET /compute/v2.1/servers/0b57b50d-1ec4-4ee1-ac3a-f6f44d68a2c3 => generated 1521 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:06:51.800169 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-4dcfdfe0-b594-401e-a3d0-c4489719cec6 tempest-AttachSCSIVolumeTestJSON-356336257 tempest-AttachSCSIVolumeTestJSON-356336257-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:06:51.801287 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-4dcfdfe0-b594-401e-a3d0-c4489719cec6 tempest-AttachSCSIVolumeTestJSON-356336257 tempest-AttachSCSIVolumeTestJSON-356336257-project] [instance: 8a378b79-bd92-4ade-b034-1aaf5c87b74b] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:06:51.809278 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-4dcfdfe0-b594-401e-a3d0-c4489719cec6 tempest-AttachSCSIVolumeTestJSON-356336257 tempest-AttachSCSIVolumeTestJSON-356336257-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:06:51.810161 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-4dcfdfe0-b594-401e-a3d0-c4489719cec6 tempest-AttachSCSIVolumeTestJSON-356336257 tempest-AttachSCSIVolumeTestJSON-356336257-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:06:51.810818 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-4dcfdfe0-b594-401e-a3d0-c4489719cec6 tempest-AttachSCSIVolumeTestJSON-356336257 tempest-AttachSCSIVolumeTestJSON-356336257-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:06:51.812051 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-4dcfdfe0-b594-401e-a3d0-c4489719cec6 tempest-AttachSCSIVolumeTestJSON-356336257 tempest-AttachSCSIVolumeTestJSON-356336257-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:06:51.812809 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-4dcfdfe0-b594-401e-a3d0-c4489719cec6 tempest-AttachSCSIVolumeTestJSON-356336257 tempest-AttachSCSIVolumeTestJSON-356336257-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:06:51.813492 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-4dcfdfe0-b594-401e-a3d0-c4489719cec6 tempest-AttachSCSIVolumeTestJSON-356336257 tempest-AttachSCSIVolumeTestJSON-356336257-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:06:52.773993 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-4dcfdfe0-b594-401e-a3d0-c4489719cec6 tempest-AttachSCSIVolumeTestJSON-356336257 tempest-AttachSCSIVolumeTestJSON-356336257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde7667dbbfd4864a5b0ca8d8b291406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b14142c34d54977ac9eb59962f2a9e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:06:52.783381 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-4dcfdfe0-b594-401e-a3d0-c4489719cec6 tempest-AttachSCSIVolumeTestJSON-356336257 tempest-AttachSCSIVolumeTestJSON-356336257-project] 10.222.0.13 "GET /compute/v2.1/servers/8a378b79-bd92-4ade-b034-1aaf5c87b74b" status: 200 len: 1372 microversion: 2.1 time: 0.987448 Nov 01 19:06:52.783984 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1497/3055] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:06:51 2022] GET /compute/v2.1/servers/8a378b79-bd92-4ade-b034-1aaf5c87b74b => generated 1372 bytes in 989 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:06:52.789114 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-a452a22d-683f-4028-bc93-73d14ab5578f tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:06:52.798608 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-a452a22d-683f-4028-bc93-73d14ab5578f tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] [instance: 3a13d400-ebab-4430-bba5-4b5339199be4] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:06:52.804928 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-a452a22d-683f-4028-bc93-73d14ab5578f tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:06:52.805646 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-a452a22d-683f-4028-bc93-73d14ab5578f tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:06:52.806250 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-a452a22d-683f-4028-bc93-73d14ab5578f tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:06:52.807125 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-a452a22d-683f-4028-bc93-73d14ab5578f tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:06:52.807770 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-a452a22d-683f-4028-bc93-73d14ab5578f tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:06:52.808877 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-a452a22d-683f-4028-bc93-73d14ab5578f tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:06:53.213666 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-a452a22d-683f-4028-bc93-73d14ab5578f tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '058480d92c9b4ab4af6815d0438a65c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee9dc49b89143f781e4ab30296e4d01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:06:53.221478 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-a452a22d-683f-4028-bc93-73d14ab5578f tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] 10.222.0.13 "GET /compute/v2.1/servers/3a13d400-ebab-4430-bba5-4b5339199be4" status: 200 len: 1315 microversion: 2.1 time: 0.435956 Nov 01 19:06:53.233136 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1498/3056] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:06:52 2022] GET /compute/v2.1/servers/3a13d400-ebab-4430-bba5-4b5339199be4 => generated 1315 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:06:53.242896 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.network.neutron [None req-b1019b54-79ab-4e3f-b147-a5b27a7769d0 tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] [instance: 307ee785-a01d-401c-8be2-b17558e735f3] Building network info cache for instance {{(pid=121403) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Nov 01 19:06:53.257545 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-cfe5c466-a704-49a0-a4f4-930e189d1d08 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:06:53.263802 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-cfe5c466-a704-49a0-a4f4-930e189d1d08 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] [instance: 674f7fae-6219-4e5e-b85a-2647b948807e] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:06:53.274525 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-cfe5c466-a704-49a0-a4f4-930e189d1d08 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:06:53.275254 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-cfe5c466-a704-49a0-a4f4-930e189d1d08 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:06:53.275910 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-cfe5c466-a704-49a0-a4f4-930e189d1d08 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:06:53.277262 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-cfe5c466-a704-49a0-a4f4-930e189d1d08 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:06:53.278141 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-cfe5c466-a704-49a0-a4f4-930e189d1d08 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:06:53.278786 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-cfe5c466-a704-49a0-a4f4-930e189d1d08 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:06:53.580921 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-cfe5c466-a704-49a0-a4f4-930e189d1d08 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '790f3f1566b7464aaca19d4d05c0942e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33e3d319293c46b6af2f728a50586906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:06:53.593889 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-cfe5c466-a704-49a0-a4f4-930e189d1d08 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] 10.222.0.13 "GET /compute/v2.1/servers/674f7fae-6219-4e5e-b85a-2647b948807e" status: 200 len: 1367 microversion: 2.1 time: 0.359456 Nov 01 19:06:53.601941 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1499/3057] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:06:53 2022] GET /compute/v2.1/servers/674f7fae-6219-4e5e-b85a-2647b948807e => generated 1367 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:06:53.607568 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-3b2cb2ea-5237-4480-aeb1-873c082e1632 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:06:53.608185 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-3b2cb2ea-5237-4480-aeb1-873c082e1632 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] [instance: af1071a8-a090-44c9-890c-123ca3ff39f1] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:06:53.637754 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-3b2cb2ea-5237-4480-aeb1-873c082e1632 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:06:53.638155 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-3b2cb2ea-5237-4480-aeb1-873c082e1632 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:06:53.638603 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-3b2cb2ea-5237-4480-aeb1-873c082e1632 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:06:53.639311 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-3b2cb2ea-5237-4480-aeb1-873c082e1632 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:06:53.639956 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-3b2cb2ea-5237-4480-aeb1-873c082e1632 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:06:53.640545 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-3b2cb2ea-5237-4480-aeb1-873c082e1632 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:06:53.993170 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-3b2cb2ea-5237-4480-aeb1-873c082e1632 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '301ed3b9c37449bc9ade378f3c73a768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8807757227574c828dca1947af76659d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:06:54.014809 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-3b2cb2ea-5237-4480-aeb1-873c082e1632 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '301ed3b9c37449bc9ade378f3c73a768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8807757227574c828dca1947af76659d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:06:54.018534 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-3b2cb2ea-5237-4480-aeb1-873c082e1632 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '301ed3b9c37449bc9ade378f3c73a768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8807757227574c828dca1947af76659d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:06:54.021142 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-3b2cb2ea-5237-4480-aeb1-873c082e1632 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] 10.222.0.13 "GET /compute/v2.1/servers/af1071a8-a090-44c9-890c-123ca3ff39f1" status: 200 len: 1880 microversion: 2.42 time: 0.418118 Nov 01 19:06:54.021912 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1500/3058] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 19:06:53 2022] GET /compute/v2.1/servers/af1071a8-a090-44c9-890c-123ca3ff39f1 => generated 1880 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 19:06:54.047711 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-23cf4f71-1966-4693-8ecc-7a983f248c28 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:06:54.048632 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-23cf4f71-1966-4693-8ecc-7a983f248c28 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] [instance: ba6ffc5c-84a4-40f1-bdc7-f87dde2c99df] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:06:54.055230 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-23cf4f71-1966-4693-8ecc-7a983f248c28 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:06:54.055942 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-23cf4f71-1966-4693-8ecc-7a983f248c28 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:06:54.056978 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-23cf4f71-1966-4693-8ecc-7a983f248c28 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:06:54.057316 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-23cf4f71-1966-4693-8ecc-7a983f248c28 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:06:54.057777 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-23cf4f71-1966-4693-8ecc-7a983f248c28 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:06:54.058245 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-23cf4f71-1966-4693-8ecc-7a983f248c28 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:06:54.353388 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-23cf4f71-1966-4693-8ecc-7a983f248c28 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd2105b0264b48d084d0e79cabff8bc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf4adda91364dab94830347c06e3957', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:06:54.367680 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-23cf4f71-1966-4693-8ecc-7a983f248c28 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd2105b0264b48d084d0e79cabff8bc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf4adda91364dab94830347c06e3957', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:06:54.372648 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-23cf4f71-1966-4693-8ecc-7a983f248c28 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd2105b0264b48d084d0e79cabff8bc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf4adda91364dab94830347c06e3957', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:06:54.376359 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-23cf4f71-1966-4693-8ecc-7a983f248c28 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] 10.222.0.13 "GET /compute/v2.1/servers/ba6ffc5c-84a4-40f1-bdc7-f87dde2c99df" status: 200 len: 1875 microversion: 2.32 time: 0.340837 Nov 01 19:06:54.377322 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1501/3059] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 19:06:54 2022] GET /compute/v2.1/servers/ba6ffc5c-84a4-40f1-bdc7-f87dde2c99df => generated 1875 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 19:06:54.394087 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-74de62be-995b-4068-9221-f3095172bafb tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:06:54.395026 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-74de62be-995b-4068-9221-f3095172bafb tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] [instance: f5d5dfa8-4516-428f-bcf5-f0a1174bd14e] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:06:54.407067 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-74de62be-995b-4068-9221-f3095172bafb tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:06:54.408350 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-74de62be-995b-4068-9221-f3095172bafb tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:06:54.410766 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-74de62be-995b-4068-9221-f3095172bafb tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:06:54.411676 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-74de62be-995b-4068-9221-f3095172bafb tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:06:54.413435 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-74de62be-995b-4068-9221-f3095172bafb tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:06:54.414111 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-74de62be-995b-4068-9221-f3095172bafb tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:06:54.648910 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.network.neutron [None req-b1019b54-79ab-4e3f-b147-a5b27a7769d0 tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] [instance: 307ee785-a01d-401c-8be2-b17558e735f3] Updating instance_info_cache with network_info: [{"id": "d65b5fcd-5bb6-4feb-b4bf-95734bcb3072", "address": "fa:16:3e:8e:cf:5c", "network": {"id": "5b808c64-bf01-4ded-bf6b-0b3fd18d2f1c", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-768163193-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "eda6511ea24c4c19a7c5d91535c7288d", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapd65b5fcd-5b", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=121403) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Nov 01 19:06:54.661155 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-74de62be-995b-4068-9221-f3095172bafb tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113bd8c844ee490b86a68bc7e1e75da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '851785a5f76548898a77d67792888504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:06:54.665401 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-b1019b54-79ab-4e3f-b147-a5b27a7769d0 tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] Releasing lock "refresh_cache-307ee785-a01d-401c-8be2-b17558e735f3" {{(pid=121403) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Nov 01 19:06:54.666174 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-b1019b54-79ab-4e3f-b147-a5b27a7769d0 tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] 10.222.0.13 "POST /compute/v2.1/servers/307ee785-a01d-401c-8be2-b17558e735f3/action" status: 202 len: 0 microversion: 2.1 time: 3.818953 Nov 01 19:06:54.671618 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1559/3060] 10.222.0.13 () {60 vars in 1278 bytes} [Tue Nov 1 19:06:50 2022] POST /compute/v2.1/servers/307ee785-a01d-401c-8be2-b17558e735f3/action => generated 0 bytes in 3820 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Nov 01 19:06:54.681890 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-74de62be-995b-4068-9221-f3095172bafb tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] 10.222.0.13 "GET /compute/v2.1/servers/f5d5dfa8-4516-428f-bcf5-f0a1174bd14e" status: 200 len: 1292 microversion: 2.1 time: 0.300977 Nov 01 19:06:54.682191 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-6479ed08-16e0-417e-bb45-b18f735dfedf tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:06:54.683020 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-6479ed08-16e0-417e-bb45-b18f735dfedf tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] [instance: 0b57b50d-1ec4-4ee1-ac3a-f6f44d68a2c3] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:06:54.684150 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1502/3061] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:06:54 2022] GET /compute/v2.1/servers/f5d5dfa8-4516-428f-bcf5-f0a1174bd14e => generated 1292 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:06:54.689171 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [req-aff1952b-fe53-4cca-9c21-b57c24e76199 req-1441edfa-570a-482a-94fb-479a9fccd2cf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "674f7fae-6219-4e5e-b85a-2647b948807e", "tag": "e78f185e-94a2-461b-9824-b0b788dd62e1"}, {"name": "network-changed", "server_uuid": "ba6ffc5c-84a4-40f1-bdc7-f87dde2c99df", "tag": "b830d6f3-9de8-4e86-9f65-0eb5d53f68f7"}]} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:06:54.709366 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-6479ed08-16e0-417e-bb45-b18f735dfedf tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:06:54.710125 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-6479ed08-16e0-417e-bb45-b18f735dfedf tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:06:54.710812 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-6479ed08-16e0-417e-bb45-b18f735dfedf tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:06:54.712235 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-6479ed08-16e0-417e-bb45-b18f735dfedf tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:06:54.712949 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-6479ed08-16e0-417e-bb45-b18f735dfedf tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:06:54.713615 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-6479ed08-16e0-417e-bb45-b18f735dfedf tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:06:54.719894 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-aff1952b-fe53-4cca-9c21-b57c24e76199 req-1441edfa-570a-482a-94fb-479a9fccd2cf service nova] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:06:54.720396 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-aff1952b-fe53-4cca-9c21-b57c24e76199 req-1441edfa-570a-482a-94fb-479a9fccd2cf service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:06:54.721088 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-aff1952b-fe53-4cca-9c21-b57c24e76199 req-1441edfa-570a-482a-94fb-479a9fccd2cf service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:06:54.745594 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.compute.server_external_events [req-aff1952b-fe53-4cca-9c21-b57c24e76199 req-1441edfa-570a-482a-94fb-479a9fccd2cf service nova] Creating event network-changed:e78f185e-94a2-461b-9824-b0b788dd62e1 for instance 674f7fae-6219-4e5e-b85a-2647b948807e on n-h1-863052-2 Nov 01 19:06:54.746400 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.compute.server_external_events [req-aff1952b-fe53-4cca-9c21-b57c24e76199 req-1441edfa-570a-482a-94fb-479a9fccd2cf service nova] Creating event network-changed:b830d6f3-9de8-4e86-9f65-0eb5d53f68f7 for instance ba6ffc5c-84a4-40f1-bdc7-f87dde2c99df on n-h1-863052-2 Nov 01 19:06:54.762737 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [req-aff1952b-fe53-4cca-9c21-b57c24e76199 req-1441edfa-570a-482a-94fb-479a9fccd2cf service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.077002 Nov 01 19:06:54.763938 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1503/3062] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Nov 1 19:06:54 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:06:54.771086 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [req-7e995679-e94a-4e00-8464-a84646b9842c req-eadd3207-c545-4a08-b8ff-e9906f8063c9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "307ee785-a01d-401c-8be2-b17558e735f3", "tag": "d65b5fcd-5bb6-4feb-b4bf-95734bcb3072"}]} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:06:54.789316 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-7e995679-e94a-4e00-8464-a84646b9842c req-eadd3207-c545-4a08-b8ff-e9906f8063c9 service nova] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:06:54.789993 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-7e995679-e94a-4e00-8464-a84646b9842c req-eadd3207-c545-4a08-b8ff-e9906f8063c9 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:06:54.790532 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-7e995679-e94a-4e00-8464-a84646b9842c req-eadd3207-c545-4a08-b8ff-e9906f8063c9 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:06:54.815844 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.compute.server_external_events [req-7e995679-e94a-4e00-8464-a84646b9842c req-eadd3207-c545-4a08-b8ff-e9906f8063c9 service nova] Creating event network-changed:d65b5fcd-5bb6-4feb-b4bf-95734bcb3072 for instance 307ee785-a01d-401c-8be2-b17558e735f3 on n-h2-863052-2 Nov 01 19:06:54.826997 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [req-7e995679-e94a-4e00-8464-a84646b9842c req-eadd3207-c545-4a08-b8ff-e9906f8063c9 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058403 Nov 01 19:06:54.829401 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1504/3063] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Nov 1 19:06:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:06:54.848993 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-6ae9105d-c94c-4cbe-9ea1-3abd30cdb6a2 tempest-AttachSCSIVolumeTestJSON-356336257 tempest-AttachSCSIVolumeTestJSON-356336257-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:06:54.850591 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-6ae9105d-c94c-4cbe-9ea1-3abd30cdb6a2 tempest-AttachSCSIVolumeTestJSON-356336257 tempest-AttachSCSIVolumeTestJSON-356336257-project] [instance: 8a378b79-bd92-4ade-b034-1aaf5c87b74b] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:06:54.864472 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-6ae9105d-c94c-4cbe-9ea1-3abd30cdb6a2 tempest-AttachSCSIVolumeTestJSON-356336257 tempest-AttachSCSIVolumeTestJSON-356336257-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:06:54.865448 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-6ae9105d-c94c-4cbe-9ea1-3abd30cdb6a2 tempest-AttachSCSIVolumeTestJSON-356336257 tempest-AttachSCSIVolumeTestJSON-356336257-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:06:54.866103 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-6ae9105d-c94c-4cbe-9ea1-3abd30cdb6a2 tempest-AttachSCSIVolumeTestJSON-356336257 tempest-AttachSCSIVolumeTestJSON-356336257-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:06:54.868002 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-6ae9105d-c94c-4cbe-9ea1-3abd30cdb6a2 tempest-AttachSCSIVolumeTestJSON-356336257 tempest-AttachSCSIVolumeTestJSON-356336257-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:06:54.868677 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-6ae9105d-c94c-4cbe-9ea1-3abd30cdb6a2 tempest-AttachSCSIVolumeTestJSON-356336257 tempest-AttachSCSIVolumeTestJSON-356336257-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:06:54.869273 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-6ae9105d-c94c-4cbe-9ea1-3abd30cdb6a2 tempest-AttachSCSIVolumeTestJSON-356336257 tempest-AttachSCSIVolumeTestJSON-356336257-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:06:55.222523 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-6ae9105d-c94c-4cbe-9ea1-3abd30cdb6a2 tempest-AttachSCSIVolumeTestJSON-356336257 tempest-AttachSCSIVolumeTestJSON-356336257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde7667dbbfd4864a5b0ca8d8b291406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b14142c34d54977ac9eb59962f2a9e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:06:55.231662 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-6ae9105d-c94c-4cbe-9ea1-3abd30cdb6a2 tempest-AttachSCSIVolumeTestJSON-356336257 tempest-AttachSCSIVolumeTestJSON-356336257-project] 10.222.0.13 "GET /compute/v2.1/servers/8a378b79-bd92-4ade-b034-1aaf5c87b74b" status: 200 len: 1372 microversion: 2.1 time: 0.390765 Nov 01 19:06:55.251477 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1505/3064] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:06:54 2022] GET /compute/v2.1/servers/8a378b79-bd92-4ade-b034-1aaf5c87b74b => generated 1372 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:06:55.262942 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-7fe98572-9b55-4fa3-918e-f2012bc34a41 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:06:55.263830 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-7fe98572-9b55-4fa3-918e-f2012bc34a41 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] [instance: 3a13d400-ebab-4430-bba5-4b5339199be4] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:06:55.274648 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-7fe98572-9b55-4fa3-918e-f2012bc34a41 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:06:55.275336 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-7fe98572-9b55-4fa3-918e-f2012bc34a41 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:06:55.276124 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-7fe98572-9b55-4fa3-918e-f2012bc34a41 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:06:55.277712 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-7fe98572-9b55-4fa3-918e-f2012bc34a41 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:06:55.278323 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-7fe98572-9b55-4fa3-918e-f2012bc34a41 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:06:55.278899 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-7fe98572-9b55-4fa3-918e-f2012bc34a41 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:06:55.280034 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-6479ed08-16e0-417e-bb45-b18f735dfedf tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05d6a1722dfa4e959aeb14d601e43b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b5d812eff94e2f89d4705d7e7d5f3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:06:55.289955 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-6479ed08-16e0-417e-bb45-b18f735dfedf tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] 10.222.0.13 "GET /compute/v2.1/servers/0b57b50d-1ec4-4ee1-ac3a-f6f44d68a2c3" status: 200 len: 1506 microversion: 2.1 time: 0.621611 Nov 01 19:06:55.294015 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1560/3065] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:06:54 2022] GET /compute/v2.1/servers/0b57b50d-1ec4-4ee1-ac3a-f6f44d68a2c3 => generated 1506 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:06:55.307147 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [req-b652c029-699e-4de8-be64-980d603460c2 req-18840c5f-a90f-4cc3-986c-9216b55f06bc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "af1071a8-a090-44c9-890c-123ca3ff39f1", "name": "network-vif-plugged", "status": "completed", "tag": "a5bd9833-1398-4c45-bb02-ef165982e99c"}]} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:06:55.328651 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-b652c029-699e-4de8-be64-980d603460c2 req-18840c5f-a90f-4cc3-986c-9216b55f06bc service nova] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:06:55.329230 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-b652c029-699e-4de8-be64-980d603460c2 req-18840c5f-a90f-4cc3-986c-9216b55f06bc service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:06:55.336864 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-b652c029-699e-4de8-be64-980d603460c2 req-18840c5f-a90f-4cc3-986c-9216b55f06bc service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:06:55.350173 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.compute.server_external_events [req-b652c029-699e-4de8-be64-980d603460c2 req-18840c5f-a90f-4cc3-986c-9216b55f06bc service nova] Creating event network-vif-plugged:a5bd9833-1398-4c45-bb02-ef165982e99c for instance af1071a8-a090-44c9-890c-123ca3ff39f1 on n-h2-863052-2 Nov 01 19:06:55.357108 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [req-b652c029-699e-4de8-be64-980d603460c2 req-18840c5f-a90f-4cc3-986c-9216b55f06bc service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061649 Nov 01 19:06:55.358196 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1561/3066] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Nov 1 19:06:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:06:55.364640 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-49b28f38-3e9f-4455-965b-010f84243d89 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:06:55.365767 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-49b28f38-3e9f-4455-965b-010f84243d89 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] [instance: 674f7fae-6219-4e5e-b85a-2647b948807e] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:06:55.372787 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-49b28f38-3e9f-4455-965b-010f84243d89 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:06:55.373607 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-49b28f38-3e9f-4455-965b-010f84243d89 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:06:55.374685 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-49b28f38-3e9f-4455-965b-010f84243d89 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:06:55.375659 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-49b28f38-3e9f-4455-965b-010f84243d89 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:06:55.376336 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-49b28f38-3e9f-4455-965b-010f84243d89 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:06:55.377002 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-49b28f38-3e9f-4455-965b-010f84243d89 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:06:55.406333 n-d-863052-2 devstack@n-api.service[121403]: DEBUG dbcounter [-] [121403] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=1,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=121403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 19:06:55.660925 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-7fe98572-9b55-4fa3-918e-f2012bc34a41 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '058480d92c9b4ab4af6815d0438a65c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee9dc49b89143f781e4ab30296e4d01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:06:55.677941 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-49b28f38-3e9f-4455-965b-010f84243d89 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '790f3f1566b7464aaca19d4d05c0942e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33e3d319293c46b6af2f728a50586906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:06:55.678985 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-7fe98572-9b55-4fa3-918e-f2012bc34a41 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] 10.222.0.13 "GET /compute/v2.1/servers/3a13d400-ebab-4430-bba5-4b5339199be4" status: 200 len: 1315 microversion: 2.1 time: 0.425883 Nov 01 19:06:55.688614 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-49b28f38-3e9f-4455-965b-010f84243d89 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] 10.222.0.13 "GET /compute/v2.1/servers/674f7fae-6219-4e5e-b85a-2647b948807e" status: 200 len: 1367 microversion: 2.1 time: 0.328904 Nov 01 19:06:55.689452 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1562/3067] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:06:55 2022] GET /compute/v2.1/servers/674f7fae-6219-4e5e-b85a-2647b948807e => generated 1367 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:06:55.694244 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-8461c387-76a6-4807-923b-fefde1c90c99 tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:06:55.694915 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-8461c387-76a6-4807-923b-fefde1c90c99 tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] [instance: 86162175-5f45-4aa7-9825-f1a3b4a699ff] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:06:55.695871 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1506/3068] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:06:55 2022] GET /compute/v2.1/servers/3a13d400-ebab-4430-bba5-4b5339199be4 => generated 1315 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:06:55.702465 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-8461c387-76a6-4807-923b-fefde1c90c99 tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:06:55.703135 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-8461c387-76a6-4807-923b-fefde1c90c99 tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:06:55.703746 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-8461c387-76a6-4807-923b-fefde1c90c99 tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:06:55.709415 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-8461c387-76a6-4807-923b-fefde1c90c99 tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:06:55.710081 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-8461c387-76a6-4807-923b-fefde1c90c99 tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:06:55.713086 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-8461c387-76a6-4807-923b-fefde1c90c99 tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:06:55.718736 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-b40ead05-7c99-4d33-b01f-d9ce5cbb4f39 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:06:55.723648 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-b40ead05-7c99-4d33-b01f-d9ce5cbb4f39 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] [instance: af1071a8-a090-44c9-890c-123ca3ff39f1] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:06:55.737746 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b40ead05-7c99-4d33-b01f-d9ce5cbb4f39 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:06:55.739165 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b40ead05-7c99-4d33-b01f-d9ce5cbb4f39 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:06:55.741718 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b40ead05-7c99-4d33-b01f-d9ce5cbb4f39 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:06:55.750870 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b40ead05-7c99-4d33-b01f-d9ce5cbb4f39 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:06:55.753152 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.wsgi [None req-8461c387-76a6-4807-923b-fefde1c90c99 tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] HTTP exception thrown: Instance 86162175-5f45-4aa7-9825-f1a3b4a699ff could not be found. Nov 01 19:06:55.754133 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b40ead05-7c99-4d33-b01f-d9ce5cbb4f39 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:06:55.754772 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b40ead05-7c99-4d33-b01f-d9ce5cbb4f39 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:06:55.756394 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-8461c387-76a6-4807-923b-fefde1c90c99 tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] Request method failure captured: Nov 01 19:06:55.756394 n-d-863052-2 devstack@n-api.service[121403]: request: DELETE /compute/v2.1/servers/86162175-5f45-4aa7-9825-f1a3b4a699ff HTTP/1.1 Nov 01 19:06:55.756394 n-d-863052-2 devstack@n-api.service[121403]: Accept: application/json Nov 01 19:06:55.756394 n-d-863052-2 devstack@n-api.service[121403]: Accept-Encoding: identity Nov 01 19:06:55.756394 n-d-863052-2 devstack@n-api.service[121403]: Connection: close Nov 01 19:06:55.756394 n-d-863052-2 devstack@n-api.service[121403]: Content-Length: 0 Nov 01 19:06:55.756394 n-d-863052-2 devstack@n-api.service[121403]: Content-Type: application/json Nov 01 19:06:55.756394 n-d-863052-2 devstack@n-api.service[121403]: Host: 10.222.0.13 Nov 01 19:06:55.756394 n-d-863052-2 devstack@n-api.service[121403]: Openstack-System-Scope: None Nov 01 19:06:55.756394 n-d-863052-2 devstack@n-api.service[121403]: User-Agent: python-urllib3/1.26.12 Nov 01 19:06:55.756394 n-d-863052-2 devstack@n-api.service[121403]: X-Auth-Token: gAAAAABjYW3l1zjt15tpRvy62ZUmUnf-XZxpbSJaR0Dz3soyrlzi86jlPzPKEooclquc3opw_GKrdbXdSeyzKLo3vUIm9CiW9UDiYVDmVEaSOvihx8IsbHZQB9Keg8pxW47Z9w5HYtZDEK-2NPCONnIEl4lawojb3pMdAC01mBceYWT19W8flDo Nov 01 19:06:55.756394 n-d-863052-2 devstack@n-api.service[121403]: X-Domain-Id: None Nov 01 19:06:55.756394 n-d-863052-2 devstack@n-api.service[121403]: X-Domain-Name: None Nov 01 19:06:55.756394 n-d-863052-2 devstack@n-api.service[121403]: X-Identity-Status: Confirmed Nov 01 19:06:55.756394 n-d-863052-2 devstack@n-api.service[121403]: X-Is-Admin-Project: True Nov 01 19:06:55.756394 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Domain-Id: default Nov 01 19:06:55.756394 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Domain-Name: Default Nov 01 19:06:55.756394 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Id: eda6511ea24c4c19a7c5d91535c7288d Nov 01 19:06:55.756394 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-1224240465 Nov 01 19:06:55.756394 n-d-863052-2 devstack@n-api.service[121403]: X-Role: member,reader Nov 01 19:06:55.756394 n-d-863052-2 devstack@n-api.service[121403]: X-Roles: member,reader Nov 01 19:06:55.756394 n-d-863052-2 devstack@n-api.service[121403]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/eda6511ea24c4c19a7c5d91535c7288d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/eda6511ea24c4c19a7c5d91535c7288d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_eda6511ea24c4c19a7c5d91535c7288d", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/eda6511ea24c4c19a7c5d91535c7288d"}]}] Nov 01 19:06:55.756394 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-1224240465 Nov 01 19:06:55.756394 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant-Id: eda6511ea24c4c19a7c5d91535c7288d Nov 01 19:06:55.756394 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-1224240465 Nov 01 19:06:55.756394 n-d-863052-2 devstack@n-api.service[121403]: X-User: tempest-FloatingIPsAssociationTestJSON-1224240465-project Nov 01 19:06:55.756394 n-d-863052-2 devstack@n-api.service[121403]: X-User-Domain-Id: default Nov 01 19:06:55.756394 n-d-863052-2 devstack@n-api.service[121403]: X-User-Domain-Name: Default Nov 01 19:06:55.756394 n-d-863052-2 devstack@n-api.service[121403]: X-User-Id: cb87e6147a6f470391921ac3b7a62f8d Nov 01 19:06:55.756394 n-d-863052-2 devstack@n-api.service[121403]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-1224240465-project Nov 01 19:06:55.756394 n-d-863052-2 devstack@n-api.service[121403]: method: > Nov 01 19:06:55.756394 n-d-863052-2 devstack@n-api.service[121403]: exception: Instance 86162175-5f45-4aa7-9825-f1a3b4a699ff could not be found. Nov 01 19:06:55.756394 n-d-863052-2 devstack@n-api.service[121403]: action_args: {'id': '86162175-5f45-4aa7-9825-f1a3b4a699ff'} Nov 01 19:06:55.756394 n-d-863052-2 devstack@n-api.service[121403]: {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 01 19:06:55.756394 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:06:55.756394 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 01 19:06:55.756394 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 01 19:06:55.756394 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 01 19:06:55.756394 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 01 19:06:55.756394 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 01 19:06:55.756394 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 01 19:06:55.756394 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 01 19:06:55.756394 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 01 19:06:55.756394 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 86162175-5f45-4aa7-9825-f1a3b4a699ff could not be found. Nov 01 19:06:55.756394 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:06:55.756394 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:06:55.756394 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:06:55.756394 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:06:55.756394 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:06:55.756394 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:06:55.756394 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 01 19:06:55.756394 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 01 19:06:55.756394 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 01 19:06:55.756394 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 01 19:06:55.756394 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 01 19:06:55.756394 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 01 19:06:55.756394 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 01 19:06:55.756394 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 01 19:06:55.756394 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 01 19:06:55.756394 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 01 19:06:55.756394 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 01 19:06:55.756394 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 01 19:06:55.761066 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 86162175-5f45-4aa7-9825-f1a3b4a699ff could not be found. Nov 01 19:06:55.761066 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:06:55.761066 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:06:55.761066 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:06:55.761066 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:06:55.761066 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:06:55.761066 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:06:55.761066 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 01 19:06:55.761066 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 01 19:06:55.761066 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 86162175-5f45-4aa7-9825-f1a3b4a699ff could not be found. Nov 01 19:06:55.761066 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:06:55.765880 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-8461c387-76a6-4807-923b-fefde1c90c99 tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] Returning 404 to user: Instance 86162175-5f45-4aa7-9825-f1a3b4a699ff could not be found. {{(pid=121403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 01 19:06:55.767594 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-8461c387-76a6-4807-923b-fefde1c90c99 tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] 10.222.0.13 "DELETE /compute/v2.1/servers/86162175-5f45-4aa7-9825-f1a3b4a699ff" status: 404 len: 111 microversion: 2.1 time: 0.076849 Nov 01 19:06:55.769368 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1563/3069] 10.222.0.13 () {58 vars in 1239 bytes} [Tue Nov 1 19:06:55 2022] DELETE /compute/v2.1/servers/86162175-5f45-4aa7-9825-f1a3b4a699ff => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 01 19:06:55.775254 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-a12dbd6f-86e9-4727-a11b-015d49ff186e tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:06:55.776128 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-a12dbd6f-86e9-4727-a11b-015d49ff186e tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] [instance: 0b57b50d-1ec4-4ee1-ac3a-f6f44d68a2c3] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:06:55.783910 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-a12dbd6f-86e9-4727-a11b-015d49ff186e tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:06:55.784685 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-a12dbd6f-86e9-4727-a11b-015d49ff186e tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:06:55.785299 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-a12dbd6f-86e9-4727-a11b-015d49ff186e tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:06:55.786162 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-a12dbd6f-86e9-4727-a11b-015d49ff186e tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:06:55.786838 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-a12dbd6f-86e9-4727-a11b-015d49ff186e tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:06:55.789301 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-a12dbd6f-86e9-4727-a11b-015d49ff186e tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:06:56.185167 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-b40ead05-7c99-4d33-b01f-d9ce5cbb4f39 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '301ed3b9c37449bc9ade378f3c73a768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8807757227574c828dca1947af76659d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:06:56.196453 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-b40ead05-7c99-4d33-b01f-d9ce5cbb4f39 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '301ed3b9c37449bc9ade378f3c73a768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8807757227574c828dca1947af76659d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:06:56.198218 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-b40ead05-7c99-4d33-b01f-d9ce5cbb4f39 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '301ed3b9c37449bc9ade378f3c73a768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8807757227574c828dca1947af76659d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:06:56.200080 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-b40ead05-7c99-4d33-b01f-d9ce5cbb4f39 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] 10.222.0.13 "GET /compute/v2.1/servers/af1071a8-a090-44c9-890c-123ca3ff39f1" status: 200 len: 1880 microversion: 2.42 time: 0.492188 Nov 01 19:06:56.201284 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1507/3070] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 19:06:55 2022] GET /compute/v2.1/servers/af1071a8-a090-44c9-890c-123ca3ff39f1 => generated 1880 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 19:06:56.207463 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-7bafa612-c413-4e0c-a5a0-767615fd92b1 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:06:56.208461 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-7bafa612-c413-4e0c-a5a0-767615fd92b1 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] [instance: ba6ffc5c-84a4-40f1-bdc7-f87dde2c99df] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:06:56.216879 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-7bafa612-c413-4e0c-a5a0-767615fd92b1 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:06:56.217765 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-7bafa612-c413-4e0c-a5a0-767615fd92b1 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:06:56.218472 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-7bafa612-c413-4e0c-a5a0-767615fd92b1 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:06:56.219436 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-7bafa612-c413-4e0c-a5a0-767615fd92b1 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:06:56.220142 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-7bafa612-c413-4e0c-a5a0-767615fd92b1 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:06:56.221066 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-7bafa612-c413-4e0c-a5a0-767615fd92b1 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:06:56.243227 n-d-863052-2 devstack@n-api.service[121402]: DEBUG dbcounter [-] [121402] Writing DB stats nova_cell1:SELECT=100 {{(pid=121402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 19:06:56.387173 n-d-863052-2 devstack@n-api.service[121403]: DEBUG dbcounter [-] [121403] Writing DB stats nova_cell0:SELECT=8 {{(pid=121403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 19:06:56.462790 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-7bafa612-c413-4e0c-a5a0-767615fd92b1 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd2105b0264b48d084d0e79cabff8bc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf4adda91364dab94830347c06e3957', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:06:56.471612 n-d-863052-2 devstack@n-api.service[121403]: DEBUG dbcounter [-] [121403] Writing DB stats nova_cell0:SELECT=28 {{(pid=121403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 19:06:56.473098 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-7bafa612-c413-4e0c-a5a0-767615fd92b1 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd2105b0264b48d084d0e79cabff8bc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf4adda91364dab94830347c06e3957', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:06:56.474785 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-7bafa612-c413-4e0c-a5a0-767615fd92b1 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd2105b0264b48d084d0e79cabff8bc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf4adda91364dab94830347c06e3957', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:06:56.476074 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-7bafa612-c413-4e0c-a5a0-767615fd92b1 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] 10.222.0.13 "GET /compute/v2.1/servers/ba6ffc5c-84a4-40f1-bdc7-f87dde2c99df" status: 200 len: 1875 microversion: 2.32 time: 0.273434 Nov 01 19:06:56.478143 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1508/3071] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 19:06:56 2022] GET /compute/v2.1/servers/ba6ffc5c-84a4-40f1-bdc7-f87dde2c99df => generated 1875 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 19:06:56.483351 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-96fb91ce-415a-46ec-8862-1abccb6f2e43 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:06:56.484234 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-96fb91ce-415a-46ec-8862-1abccb6f2e43 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] [instance: f5d5dfa8-4516-428f-bcf5-f0a1174bd14e] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:06:56.491155 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-96fb91ce-415a-46ec-8862-1abccb6f2e43 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:06:56.491944 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-96fb91ce-415a-46ec-8862-1abccb6f2e43 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:06:56.492711 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-96fb91ce-415a-46ec-8862-1abccb6f2e43 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:06:56.493651 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-96fb91ce-415a-46ec-8862-1abccb6f2e43 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:06:56.494319 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-96fb91ce-415a-46ec-8862-1abccb6f2e43 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:06:56.495004 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-96fb91ce-415a-46ec-8862-1abccb6f2e43 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:06:56.522603 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-a12dbd6f-86e9-4727-a11b-015d49ff186e tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05d6a1722dfa4e959aeb14d601e43b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b5d812eff94e2f89d4705d7e7d5f3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:06:56.532785 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-a12dbd6f-86e9-4727-a11b-015d49ff186e tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] 10.222.0.13 "GET /compute/v2.1/servers/0b57b50d-1ec4-4ee1-ac3a-f6f44d68a2c3" status: 200 len: 1506 microversion: 2.1 time: 0.761869 Nov 01 19:06:56.534032 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1564/3072] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:06:55 2022] GET /compute/v2.1/servers/0b57b50d-1ec4-4ee1-ac3a-f6f44d68a2c3 => generated 1506 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:06:56.541616 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-5c6fed86-cac4-48f1-92d4-ddddbc23411a tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:06:56.543271 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-5c6fed86-cac4-48f1-92d4-ddddbc23411a tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] [instance: 86162175-5f45-4aa7-9825-f1a3b4a699ff] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:06:56.552415 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-5c6fed86-cac4-48f1-92d4-ddddbc23411a tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:06:56.553306 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-5c6fed86-cac4-48f1-92d4-ddddbc23411a tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:06:56.553906 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-5c6fed86-cac4-48f1-92d4-ddddbc23411a tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:06:56.555041 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-5c6fed86-cac4-48f1-92d4-ddddbc23411a tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:06:56.556432 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-5c6fed86-cac4-48f1-92d4-ddddbc23411a tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:06:56.557103 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-5c6fed86-cac4-48f1-92d4-ddddbc23411a tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:06:56.575352 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.wsgi [None req-5c6fed86-cac4-48f1-92d4-ddddbc23411a tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] HTTP exception thrown: Instance 86162175-5f45-4aa7-9825-f1a3b4a699ff could not be found. Nov 01 19:06:56.577284 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-5c6fed86-cac4-48f1-92d4-ddddbc23411a tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] Request method failure captured: Nov 01 19:06:56.577284 n-d-863052-2 devstack@n-api.service[121403]: request: GET /compute/v2.1/servers/86162175-5f45-4aa7-9825-f1a3b4a699ff HTTP/1.1 Nov 01 19:06:56.577284 n-d-863052-2 devstack@n-api.service[121403]: Accept: application/json Nov 01 19:06:56.577284 n-d-863052-2 devstack@n-api.service[121403]: Accept-Encoding: identity Nov 01 19:06:56.577284 n-d-863052-2 devstack@n-api.service[121403]: Connection: close Nov 01 19:06:56.577284 n-d-863052-2 devstack@n-api.service[121403]: Content-Length: 0 Nov 01 19:06:56.577284 n-d-863052-2 devstack@n-api.service[121403]: Content-Type: application/json Nov 01 19:06:56.577284 n-d-863052-2 devstack@n-api.service[121403]: Host: 10.222.0.13 Nov 01 19:06:56.577284 n-d-863052-2 devstack@n-api.service[121403]: Openstack-System-Scope: None Nov 01 19:06:56.577284 n-d-863052-2 devstack@n-api.service[121403]: User-Agent: python-urllib3/1.26.12 Nov 01 19:06:56.577284 n-d-863052-2 devstack@n-api.service[121403]: X-Auth-Token: gAAAAABjYW3l1zjt15tpRvy62ZUmUnf-XZxpbSJaR0Dz3soyrlzi86jlPzPKEooclquc3opw_GKrdbXdSeyzKLo3vUIm9CiW9UDiYVDmVEaSOvihx8IsbHZQB9Keg8pxW47Z9w5HYtZDEK-2NPCONnIEl4lawojb3pMdAC01mBceYWT19W8flDo Nov 01 19:06:56.577284 n-d-863052-2 devstack@n-api.service[121403]: X-Domain-Id: None Nov 01 19:06:56.577284 n-d-863052-2 devstack@n-api.service[121403]: X-Domain-Name: None Nov 01 19:06:56.577284 n-d-863052-2 devstack@n-api.service[121403]: X-Identity-Status: Confirmed Nov 01 19:06:56.577284 n-d-863052-2 devstack@n-api.service[121403]: X-Is-Admin-Project: True Nov 01 19:06:56.577284 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Domain-Id: default Nov 01 19:06:56.577284 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Domain-Name: Default Nov 01 19:06:56.577284 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Id: eda6511ea24c4c19a7c5d91535c7288d Nov 01 19:06:56.577284 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-1224240465 Nov 01 19:06:56.577284 n-d-863052-2 devstack@n-api.service[121403]: X-Role: member,reader Nov 01 19:06:56.577284 n-d-863052-2 devstack@n-api.service[121403]: X-Roles: member,reader Nov 01 19:06:56.577284 n-d-863052-2 devstack@n-api.service[121403]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/eda6511ea24c4c19a7c5d91535c7288d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/eda6511ea24c4c19a7c5d91535c7288d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_eda6511ea24c4c19a7c5d91535c7288d", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/eda6511ea24c4c19a7c5d91535c7288d"}]}] Nov 01 19:06:56.577284 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-1224240465 Nov 01 19:06:56.577284 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant-Id: eda6511ea24c4c19a7c5d91535c7288d Nov 01 19:06:56.577284 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-1224240465 Nov 01 19:06:56.577284 n-d-863052-2 devstack@n-api.service[121403]: X-User: tempest-FloatingIPsAssociationTestJSON-1224240465-project Nov 01 19:06:56.577284 n-d-863052-2 devstack@n-api.service[121403]: X-User-Domain-Id: default Nov 01 19:06:56.577284 n-d-863052-2 devstack@n-api.service[121403]: X-User-Domain-Name: Default Nov 01 19:06:56.577284 n-d-863052-2 devstack@n-api.service[121403]: X-User-Id: cb87e6147a6f470391921ac3b7a62f8d Nov 01 19:06:56.577284 n-d-863052-2 devstack@n-api.service[121403]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-1224240465-project Nov 01 19:06:56.577284 n-d-863052-2 devstack@n-api.service[121403]: method: > Nov 01 19:06:56.577284 n-d-863052-2 devstack@n-api.service[121403]: exception: Instance 86162175-5f45-4aa7-9825-f1a3b4a699ff could not be found. Nov 01 19:06:56.577284 n-d-863052-2 devstack@n-api.service[121403]: action_args: {'id': '86162175-5f45-4aa7-9825-f1a3b4a699ff'} Nov 01 19:06:56.577284 n-d-863052-2 devstack@n-api.service[121403]: {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 01 19:06:56.577284 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:06:56.577284 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 01 19:06:56.577284 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 01 19:06:56.577284 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 01 19:06:56.577284 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 01 19:06:56.577284 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 01 19:06:56.577284 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 01 19:06:56.577284 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 01 19:06:56.577284 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 01 19:06:56.577284 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 86162175-5f45-4aa7-9825-f1a3b4a699ff could not be found. Nov 01 19:06:56.577284 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:06:56.577284 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:06:56.577284 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:06:56.577284 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:06:56.577284 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:06:56.577284 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:06:56.577284 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 01 19:06:56.577284 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 01 19:06:56.577284 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 01 19:06:56.577284 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 01 19:06:56.577284 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 01 19:06:56.577284 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 01 19:06:56.577284 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 01 19:06:56.577284 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 01 19:06:56.577284 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 01 19:06:56.577284 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 01 19:06:56.577284 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 86162175-5f45-4aa7-9825-f1a3b4a699ff could not be found. Nov 01 19:06:56.577284 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:06:56.577284 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:06:56.581487 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:06:56.581487 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:06:56.581487 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:06:56.581487 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:06:56.581487 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 01 19:06:56.581487 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 01 19:06:56.581487 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 86162175-5f45-4aa7-9825-f1a3b4a699ff could not be found. Nov 01 19:06:56.581487 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:06:56.582652 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-5c6fed86-cac4-48f1-92d4-ddddbc23411a tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] Returning 404 to user: Instance 86162175-5f45-4aa7-9825-f1a3b4a699ff could not be found. {{(pid=121403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 01 19:06:56.583697 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-5c6fed86-cac4-48f1-92d4-ddddbc23411a tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] 10.222.0.13 "GET /compute/v2.1/servers/86162175-5f45-4aa7-9825-f1a3b4a699ff" status: 404 len: 111 microversion: 2.1 time: 0.046874 Nov 01 19:06:56.584418 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1565/3073] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:06:56 2022] GET /compute/v2.1/servers/86162175-5f45-4aa7-9825-f1a3b4a699ff => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 01 19:06:56.589419 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-ebd8e1c7-95ca-448b-944a-777c756a8953 tempest-AttachSCSIVolumeTestJSON-356336257 tempest-AttachSCSIVolumeTestJSON-356336257-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:06:56.590238 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-ebd8e1c7-95ca-448b-944a-777c756a8953 tempest-AttachSCSIVolumeTestJSON-356336257 tempest-AttachSCSIVolumeTestJSON-356336257-project] [instance: 8a378b79-bd92-4ade-b034-1aaf5c87b74b] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:06:56.597715 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-ebd8e1c7-95ca-448b-944a-777c756a8953 tempest-AttachSCSIVolumeTestJSON-356336257 tempest-AttachSCSIVolumeTestJSON-356336257-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:06:56.598434 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-ebd8e1c7-95ca-448b-944a-777c756a8953 tempest-AttachSCSIVolumeTestJSON-356336257 tempest-AttachSCSIVolumeTestJSON-356336257-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:06:56.599043 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-ebd8e1c7-95ca-448b-944a-777c756a8953 tempest-AttachSCSIVolumeTestJSON-356336257 tempest-AttachSCSIVolumeTestJSON-356336257-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:06:56.599920 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-ebd8e1c7-95ca-448b-944a-777c756a8953 tempest-AttachSCSIVolumeTestJSON-356336257 tempest-AttachSCSIVolumeTestJSON-356336257-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:06:56.600527 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-ebd8e1c7-95ca-448b-944a-777c756a8953 tempest-AttachSCSIVolumeTestJSON-356336257 tempest-AttachSCSIVolumeTestJSON-356336257-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:06:56.601142 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-ebd8e1c7-95ca-448b-944a-777c756a8953 tempest-AttachSCSIVolumeTestJSON-356336257 tempest-AttachSCSIVolumeTestJSON-356336257-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:06:56.669491 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-96fb91ce-415a-46ec-8862-1abccb6f2e43 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113bd8c844ee490b86a68bc7e1e75da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '851785a5f76548898a77d67792888504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:06:56.677220 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-96fb91ce-415a-46ec-8862-1abccb6f2e43 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] 10.222.0.13 "GET /compute/v2.1/servers/f5d5dfa8-4516-428f-bcf5-f0a1174bd14e" status: 200 len: 1292 microversion: 2.1 time: 0.197707 Nov 01 19:06:56.688536 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1509/3074] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:06:56 2022] GET /compute/v2.1/servers/f5d5dfa8-4516-428f-bcf5-f0a1174bd14e => generated 1292 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:06:56.696353 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-36692b73-9cf7-4d30-a17d-a8ff3956f83a tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:06:56.696948 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-36692b73-9cf7-4d30-a17d-a8ff3956f83a tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] [instance: 0b57b50d-1ec4-4ee1-ac3a-f6f44d68a2c3] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:06:56.703760 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-36692b73-9cf7-4d30-a17d-a8ff3956f83a tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:06:56.704324 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-36692b73-9cf7-4d30-a17d-a8ff3956f83a tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:06:56.704855 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-36692b73-9cf7-4d30-a17d-a8ff3956f83a tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:06:56.705732 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-36692b73-9cf7-4d30-a17d-a8ff3956f83a tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:06:56.706427 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-36692b73-9cf7-4d30-a17d-a8ff3956f83a tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:06:56.707017 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-36692b73-9cf7-4d30-a17d-a8ff3956f83a tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:06:56.736061 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-36692b73-9cf7-4d30-a17d-a8ff3956f83a tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] [instance: 0b57b50d-1ec4-4ee1-ac3a-f6f44d68a2c3] Going to try to terminate instance {{(pid=121402) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 01 19:06:56.828289 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-36692b73-9cf7-4d30-a17d-a8ff3956f83a tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] 10.222.0.13 "DELETE /compute/v2.1/servers/0b57b50d-1ec4-4ee1-ac3a-f6f44d68a2c3" status: 204 len: 0 microversion: 2.1 time: 0.137980 Nov 01 19:06:56.829438 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1510/3075] 10.222.0.13 () {58 vars in 1239 bytes} [Tue Nov 1 19:06:56 2022] DELETE /compute/v2.1/servers/0b57b50d-1ec4-4ee1-ac3a-f6f44d68a2c3 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 01 19:06:56.835842 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-39696001-41cc-43d2-a548-f80cbab35399 tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] Calling method '.version_select at 0x7f0ae1d75f70>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:06:56.929933 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-ebd8e1c7-95ca-448b-944a-777c756a8953 tempest-AttachSCSIVolumeTestJSON-356336257 tempest-AttachSCSIVolumeTestJSON-356336257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde7667dbbfd4864a5b0ca8d8b291406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b14142c34d54977ac9eb59962f2a9e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:06:56.946153 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-ebd8e1c7-95ca-448b-944a-777c756a8953 tempest-AttachSCSIVolumeTestJSON-356336257 tempest-AttachSCSIVolumeTestJSON-356336257-project] 10.222.0.13 "GET /compute/v2.1/servers/8a378b79-bd92-4ade-b034-1aaf5c87b74b" status: 200 len: 1372 microversion: 2.1 time: 0.358362 Nov 01 19:06:56.947886 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1566/3076] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:06:56 2022] GET /compute/v2.1/servers/8a378b79-bd92-4ade-b034-1aaf5c87b74b => generated 1372 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:06:56.954685 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-6fd877fd-db74-4418-a6c0-3a6bd0fbe028 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:06:56.955580 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-6fd877fd-db74-4418-a6c0-3a6bd0fbe028 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] [instance: 3a13d400-ebab-4430-bba5-4b5339199be4] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:06:56.963076 n-d-863052-2 devstack@n-api.service[121403]: DEBUG dbcounter [-] [121403] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=9,nova_api:UPDATE=1 {{(pid=121403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 19:06:56.969409 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-6fd877fd-db74-4418-a6c0-3a6bd0fbe028 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:06:56.969920 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-6fd877fd-db74-4418-a6c0-3a6bd0fbe028 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:06:56.970535 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-6fd877fd-db74-4418-a6c0-3a6bd0fbe028 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:06:56.971435 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-6fd877fd-db74-4418-a6c0-3a6bd0fbe028 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:06:56.972103 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-6fd877fd-db74-4418-a6c0-3a6bd0fbe028 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:06:56.972722 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-6fd877fd-db74-4418-a6c0-3a6bd0fbe028 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:06:57.163250 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-6fd877fd-db74-4418-a6c0-3a6bd0fbe028 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '058480d92c9b4ab4af6815d0438a65c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee9dc49b89143f781e4ab30296e4d01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:06:57.173464 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-6fd877fd-db74-4418-a6c0-3a6bd0fbe028 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] 10.222.0.13 "GET /compute/v2.1/servers/3a13d400-ebab-4430-bba5-4b5339199be4" status: 200 len: 1315 microversion: 2.1 time: 0.223916 Nov 01 19:06:57.174169 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1567/3077] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:06:56 2022] GET /compute/v2.1/servers/3a13d400-ebab-4430-bba5-4b5339199be4 => generated 1315 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:06:57.179465 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-c7af3dee-2fbb-47a5-ba52-3b27622abe77 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:06:57.180389 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-c7af3dee-2fbb-47a5-ba52-3b27622abe77 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] [instance: 674f7fae-6219-4e5e-b85a-2647b948807e] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:06:57.195840 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-c7af3dee-2fbb-47a5-ba52-3b27622abe77 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:06:57.196695 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-c7af3dee-2fbb-47a5-ba52-3b27622abe77 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:06:57.197363 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-c7af3dee-2fbb-47a5-ba52-3b27622abe77 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:06:57.199131 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-c7af3dee-2fbb-47a5-ba52-3b27622abe77 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:06:57.199836 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-c7af3dee-2fbb-47a5-ba52-3b27622abe77 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:06:57.200487 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-c7af3dee-2fbb-47a5-ba52-3b27622abe77 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:06:57.421905 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-c7af3dee-2fbb-47a5-ba52-3b27622abe77 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '790f3f1566b7464aaca19d4d05c0942e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33e3d319293c46b6af2f728a50586906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:06:57.433526 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-c7af3dee-2fbb-47a5-ba52-3b27622abe77 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] 10.222.0.13 "GET /compute/v2.1/servers/674f7fae-6219-4e5e-b85a-2647b948807e" status: 200 len: 1367 microversion: 2.1 time: 0.256259 Nov 01 19:06:57.451217 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1568/3078] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:06:57 2022] GET /compute/v2.1/servers/674f7fae-6219-4e5e-b85a-2647b948807e => generated 1367 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:06:57.456684 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [req-4bccaf44-7e75-447e-b44b-e41e57c6f0f4 req-703ebbe6-9e78-417c-acea-94fd8148763c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ba6ffc5c-84a4-40f1-bdc7-f87dde2c99df", "tag": "50c047f7-0828-439d-8aac-50370fc1454f"}]} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:06:57.468173 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-4bccaf44-7e75-447e-b44b-e41e57c6f0f4 req-703ebbe6-9e78-417c-acea-94fd8148763c service nova] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:06:57.469106 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-4bccaf44-7e75-447e-b44b-e41e57c6f0f4 req-703ebbe6-9e78-417c-acea-94fd8148763c service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:06:57.469732 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-4bccaf44-7e75-447e-b44b-e41e57c6f0f4 req-703ebbe6-9e78-417c-acea-94fd8148763c service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:06:57.485537 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.compute.server_external_events [req-4bccaf44-7e75-447e-b44b-e41e57c6f0f4 req-703ebbe6-9e78-417c-acea-94fd8148763c service nova] Creating event network-changed:50c047f7-0828-439d-8aac-50370fc1454f for instance ba6ffc5c-84a4-40f1-bdc7-f87dde2c99df on n-h1-863052-2 Nov 01 19:06:57.493651 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [req-4bccaf44-7e75-447e-b44b-e41e57c6f0f4 req-703ebbe6-9e78-417c-acea-94fd8148763c service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038372 Nov 01 19:06:57.495692 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1569/3079] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Nov 1 19:06:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:06:57.502907 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [req-ed33996a-5cbf-4c87-bdce-6728cbf704b4 req-1e6fd5e0-5d7d-4e29-a1aa-be25849dcdcb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f5d5dfa8-4516-428f-bcf5-f0a1174bd14e", "tag": "4db67a8c-a091-40b4-adb0-8c3b246af143"}]} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:06:57.520774 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-ed33996a-5cbf-4c87-bdce-6728cbf704b4 req-1e6fd5e0-5d7d-4e29-a1aa-be25849dcdcb service nova] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:06:57.521263 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-ed33996a-5cbf-4c87-bdce-6728cbf704b4 req-1e6fd5e0-5d7d-4e29-a1aa-be25849dcdcb service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:06:57.521690 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-ed33996a-5cbf-4c87-bdce-6728cbf704b4 req-1e6fd5e0-5d7d-4e29-a1aa-be25849dcdcb service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:06:57.536639 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.compute.server_external_events [req-ed33996a-5cbf-4c87-bdce-6728cbf704b4 req-1e6fd5e0-5d7d-4e29-a1aa-be25849dcdcb service nova] Creating event network-changed:4db67a8c-a091-40b4-adb0-8c3b246af143 for instance f5d5dfa8-4516-428f-bcf5-f0a1174bd14e on n-h2-863052-2 Nov 01 19:06:57.544387 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [req-ed33996a-5cbf-4c87-bdce-6728cbf704b4 req-1e6fd5e0-5d7d-4e29-a1aa-be25849dcdcb service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047285 Nov 01 19:06:57.546019 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1570/3080] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Nov 1 19:06:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:06:57.553211 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-9e7cb96c-58a7-4c83-805c-496077ec9c17 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1484422693", "imageRef": "2d4a0047-1b9e-445f-8af8-1b5c9d93e881", "flavorRef": "452", "networks": [{"uuid": "3869a194-2d1b-4c2a-b413-fb6893096e26"}]}} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:06:57.630384 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.network.neutron [None req-9e7cb96c-58a7-4c83-805c-496077ec9c17 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] validate_networks() for [('3869a194-2d1b-4c2a-b413-fb6893096e26', None, None, None, None, None)] {{(pid=121403) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 01 19:06:57.782762 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-39696001-41cc-43d2-a548-f80cbab35399 tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] 10.222.0.13 "DELETE /compute/v2.1/os-floating-ips/a2efedf2-0f48-407e-8190-a5f40a969b10" status: 202 len: 0 microversion: 2.1 time: 0.951734 Nov 01 19:06:57.783433 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1511/3081] 10.222.0.13 () {58 vars in 1263 bytes} [Tue Nov 1 19:06:56 2022] DELETE /compute/v2.1/os-floating-ips/a2efedf2-0f48-407e-8190-a5f40a969b10 => generated 0 bytes in 953 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 01 19:06:57.792095 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-dd5c4c28-5a4a-437d-8237-07201ea70c48 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:06:57.792967 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-dd5c4c28-5a4a-437d-8237-07201ea70c48 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] [instance: af1071a8-a090-44c9-890c-123ca3ff39f1] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:06:57.801236 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-dd5c4c28-5a4a-437d-8237-07201ea70c48 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:06:57.801372 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-dd5c4c28-5a4a-437d-8237-07201ea70c48 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:06:57.801771 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-dd5c4c28-5a4a-437d-8237-07201ea70c48 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:06:57.802467 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-dd5c4c28-5a4a-437d-8237-07201ea70c48 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:06:57.802924 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-dd5c4c28-5a4a-437d-8237-07201ea70c48 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:06:57.803346 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-dd5c4c28-5a4a-437d-8237-07201ea70c48 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:06:58.014087 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-dd5c4c28-5a4a-437d-8237-07201ea70c48 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '301ed3b9c37449bc9ade378f3c73a768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8807757227574c828dca1947af76659d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:06:58.024017 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-dd5c4c28-5a4a-437d-8237-07201ea70c48 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '301ed3b9c37449bc9ade378f3c73a768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8807757227574c828dca1947af76659d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:06:58.025504 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-dd5c4c28-5a4a-437d-8237-07201ea70c48 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '301ed3b9c37449bc9ade378f3c73a768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8807757227574c828dca1947af76659d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:06:58.026770 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-dd5c4c28-5a4a-437d-8237-07201ea70c48 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] 10.222.0.13 "GET /compute/v2.1/servers/af1071a8-a090-44c9-890c-123ca3ff39f1" status: 200 len: 1880 microversion: 2.42 time: 0.238524 Nov 01 19:06:58.027342 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1512/3082] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 19:06:57 2022] GET /compute/v2.1/servers/af1071a8-a090-44c9-890c-123ca3ff39f1 => generated 1880 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 19:06:58.031784 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [req-8dd5d8fd-0ac2-4f7a-8dee-b27bab8b048e req-c89e1856-6e6c-4553-b1f8-6d1cf49b7cb6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3a13d400-ebab-4430-bba5-4b5339199be4", "name": "network-vif-plugged", "status": "completed", "tag": "d41182e2-e6f3-405a-a20f-6d8f80e3c0a1"}, {"server_uuid": "af1071a8-a090-44c9-890c-123ca3ff39f1", "name": "network-vif-plugged", "status": "completed", "tag": "b02cdf3d-b259-4361-af25-d77a93946fa4"}, {"server_uuid": "af1071a8-a090-44c9-890c-123ca3ff39f1", "name": "network-vif-plugged", "status": "completed", "tag": "203b8604-944e-4dd3-b782-489109f7158b"}, {"server_uuid": "af1071a8-a090-44c9-890c-123ca3ff39f1", "name": "network-vif-plugged", "status": "completed", "tag": "647aec31-8971-4e83-9e8f-4dfc4202c174"}, {"server_uuid": "674f7fae-6219-4e5e-b85a-2647b948807e", "name": "network-vif-plugged", "status": "completed", "tag": "e78f185e-94a2-461b-9824-b0b788dd62e1"}, {"server_uuid": "af1071a8-a090-44c9-890c-123ca3ff39f1", "name": "network-vif-plugged", "status": "completed", "tag": "dfd99717-c078-4f2f-8d17-1602cd9ea3ae"}]} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:06:58.043309 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-8dd5d8fd-0ac2-4f7a-8dee-b27bab8b048e req-c89e1856-6e6c-4553-b1f8-6d1cf49b7cb6 service nova] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:06:58.044033 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-8dd5d8fd-0ac2-4f7a-8dee-b27bab8b048e req-c89e1856-6e6c-4553-b1f8-6d1cf49b7cb6 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:06:58.044472 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-8dd5d8fd-0ac2-4f7a-8dee-b27bab8b048e req-c89e1856-6e6c-4553-b1f8-6d1cf49b7cb6 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:06:58.059603 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.compute.server_external_events [req-8dd5d8fd-0ac2-4f7a-8dee-b27bab8b048e req-c89e1856-6e6c-4553-b1f8-6d1cf49b7cb6 service nova] Creating event network-vif-plugged:d41182e2-e6f3-405a-a20f-6d8f80e3c0a1 for instance 3a13d400-ebab-4430-bba5-4b5339199be4 on n-h1-863052-2 Nov 01 19:06:58.060115 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.compute.server_external_events [req-8dd5d8fd-0ac2-4f7a-8dee-b27bab8b048e req-c89e1856-6e6c-4553-b1f8-6d1cf49b7cb6 service nova] Creating event network-vif-plugged:b02cdf3d-b259-4361-af25-d77a93946fa4 for instance af1071a8-a090-44c9-890c-123ca3ff39f1 on n-h2-863052-2 Nov 01 19:06:58.060645 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.compute.server_external_events [req-8dd5d8fd-0ac2-4f7a-8dee-b27bab8b048e req-c89e1856-6e6c-4553-b1f8-6d1cf49b7cb6 service nova] Creating event network-vif-plugged:203b8604-944e-4dd3-b782-489109f7158b for instance af1071a8-a090-44c9-890c-123ca3ff39f1 on n-h2-863052-2 Nov 01 19:06:58.061143 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.compute.server_external_events [req-8dd5d8fd-0ac2-4f7a-8dee-b27bab8b048e req-c89e1856-6e6c-4553-b1f8-6d1cf49b7cb6 service nova] Creating event network-vif-plugged:647aec31-8971-4e83-9e8f-4dfc4202c174 for instance af1071a8-a090-44c9-890c-123ca3ff39f1 on n-h2-863052-2 Nov 01 19:06:58.061914 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.compute.server_external_events [req-8dd5d8fd-0ac2-4f7a-8dee-b27bab8b048e req-c89e1856-6e6c-4553-b1f8-6d1cf49b7cb6 service nova] Creating event network-vif-plugged:e78f185e-94a2-461b-9824-b0b788dd62e1 for instance 674f7fae-6219-4e5e-b85a-2647b948807e on n-h1-863052-2 Nov 01 19:06:58.062408 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.compute.server_external_events [req-8dd5d8fd-0ac2-4f7a-8dee-b27bab8b048e req-c89e1856-6e6c-4553-b1f8-6d1cf49b7cb6 service nova] Creating event network-vif-plugged:dfd99717-c078-4f2f-8d17-1602cd9ea3ae for instance af1071a8-a090-44c9-890c-123ca3ff39f1 on n-h2-863052-2 Nov 01 19:06:58.072829 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [req-8dd5d8fd-0ac2-4f7a-8dee-b27bab8b048e req-c89e1856-6e6c-4553-b1f8-6d1cf49b7cb6 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 1038 microversion: 2.1 time: 0.044280 Nov 01 19:06:58.073670 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1513/3083] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Nov 1 19:06:58 2022] POST /compute/v2.1/os-server-external-events => generated 1038 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:06:58.079319 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-1d5a3743-2ace-4d05-9b86-928d0e707ead tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:06:58.080072 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-1d5a3743-2ace-4d05-9b86-928d0e707ead tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] [instance: ba6ffc5c-84a4-40f1-bdc7-f87dde2c99df] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:06:58.086360 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-1d5a3743-2ace-4d05-9b86-928d0e707ead tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:06:58.086850 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-1d5a3743-2ace-4d05-9b86-928d0e707ead tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:06:58.087602 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-1d5a3743-2ace-4d05-9b86-928d0e707ead tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:06:58.088475 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-1d5a3743-2ace-4d05-9b86-928d0e707ead tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:06:58.089124 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-1d5a3743-2ace-4d05-9b86-928d0e707ead tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:06:58.089745 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-1d5a3743-2ace-4d05-9b86-928d0e707ead tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:06:58.489859 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.virt.hardware [None req-9e7cb96c-58a7-4c83-805c-496077ec9c17 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Flavor limits 0:0:0 {{(pid=121403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 01 19:06:58.491332 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.virt.hardware [None req-9e7cb96c-58a7-4c83-805c-496077ec9c17 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Image limits 0:0:0 {{(pid=121403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 01 19:06:58.492194 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.virt.hardware [None req-9e7cb96c-58a7-4c83-805c-496077ec9c17 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Flavor pref 0:0:0 {{(pid=121403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 01 19:06:58.495156 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.virt.hardware [None req-9e7cb96c-58a7-4c83-805c-496077ec9c17 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Image pref 0:0:0 {{(pid=121403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 01 19:06:58.497181 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.virt.hardware [None req-9e7cb96c-58a7-4c83-805c-496077ec9c17 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 01 19:06:58.513467 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-9e7cb96c-58a7-4c83-805c-496077ec9c17 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:06:58.514439 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-9e7cb96c-58a7-4c83-805c-496077ec9c17 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:06:58.528352 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-9e7cb96c-58a7-4c83-805c-496077ec9c17 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:06:58.530962 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-9e7cb96c-58a7-4c83-805c-496077ec9c17 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:06:58.533323 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-9e7cb96c-58a7-4c83-805c-496077ec9c17 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:06:58.534051 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-9e7cb96c-58a7-4c83-805c-496077ec9c17 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:06:58.570022 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.quota [None req-9e7cb96c-58a7-4c83-805c-496077ec9c17 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Getting quotas for project 07b5d812eff94e2f89d4705d7e7d5f3d. Resources: {'cores', 'ram', 'instances'} {{(pid=121403) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 01 19:06:58.576785 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.quota [None req-9e7cb96c-58a7-4c83-805c-496077ec9c17 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Getting quotas for user 05d6a1722dfa4e959aeb14d601e43b93 and project 07b5d812eff94e2f89d4705d7e7d5f3d. Resources: {'cores', 'ram', 'instances'} {{(pid=121403) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 01 19:06:58.593872 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-9e7cb96c-58a7-4c83-805c-496077ec9c17 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Going to run 1 instances... {{(pid=121403) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 01 19:06:58.596992 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-9e7cb96c-58a7-4c83-805c-496077ec9c17 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] [instance: 50bf9fd1-c4c6-4d58-80a1-4ce30f50f9bb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2d4a0047-1b9e-445f-8af8-1b5c9d93e881',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121403) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 01 19:06:58.662626 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-9e7cb96c-58a7-4c83-805c-496077ec9c17 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.114887 Nov 01 19:06:58.663479 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1571/3084] 10.222.0.13 () {60 vars in 1147 bytes} [Tue Nov 1 19:06:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 1117 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 01 19:06:58.675977 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-a658743c-157f-4249-8ce0-d15f77c3f4fc tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:06:58.676783 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-a658743c-157f-4249-8ce0-d15f77c3f4fc tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] [instance: f5d5dfa8-4516-428f-bcf5-f0a1174bd14e] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:06:58.684699 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-a658743c-157f-4249-8ce0-d15f77c3f4fc tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:06:58.685195 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-a658743c-157f-4249-8ce0-d15f77c3f4fc tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:06:58.685667 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-a658743c-157f-4249-8ce0-d15f77c3f4fc tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:06:58.686563 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-a658743c-157f-4249-8ce0-d15f77c3f4fc tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:06:58.687081 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-a658743c-157f-4249-8ce0-d15f77c3f4fc tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:06:58.687502 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-a658743c-157f-4249-8ce0-d15f77c3f4fc tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:06:58.831519 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-1d5a3743-2ace-4d05-9b86-928d0e707ead tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd2105b0264b48d084d0e79cabff8bc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf4adda91364dab94830347c06e3957', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:06:58.845667 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-1d5a3743-2ace-4d05-9b86-928d0e707ead tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd2105b0264b48d084d0e79cabff8bc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf4adda91364dab94830347c06e3957', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:06:58.849055 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-1d5a3743-2ace-4d05-9b86-928d0e707ead tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd2105b0264b48d084d0e79cabff8bc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf4adda91364dab94830347c06e3957', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:06:58.851207 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-1d5a3743-2ace-4d05-9b86-928d0e707ead tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] 10.222.0.13 "GET /compute/v2.1/servers/ba6ffc5c-84a4-40f1-bdc7-f87dde2c99df" status: 200 len: 1875 microversion: 2.32 time: 0.775818 Nov 01 19:06:58.852233 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1514/3085] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 19:06:58 2022] GET /compute/v2.1/servers/ba6ffc5c-84a4-40f1-bdc7-f87dde2c99df => generated 1875 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 19:06:58.859329 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-97166761-4843-4150-a0d7-e33cfb23c4b5 tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:06:58.859920 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-97166761-4843-4150-a0d7-e33cfb23c4b5 tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] [instance: 307ee785-a01d-401c-8be2-b17558e735f3] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:06:58.866725 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-97166761-4843-4150-a0d7-e33cfb23c4b5 tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:06:58.867273 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-97166761-4843-4150-a0d7-e33cfb23c4b5 tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:06:58.867840 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-97166761-4843-4150-a0d7-e33cfb23c4b5 tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:06:58.869092 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-97166761-4843-4150-a0d7-e33cfb23c4b5 tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:06:58.869645 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-97166761-4843-4150-a0d7-e33cfb23c4b5 tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:06:58.870217 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-97166761-4843-4150-a0d7-e33cfb23c4b5 tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:06:58.886923 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-a658743c-157f-4249-8ce0-d15f77c3f4fc tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113bd8c844ee490b86a68bc7e1e75da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '851785a5f76548898a77d67792888504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:06:58.896543 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-a658743c-157f-4249-8ce0-d15f77c3f4fc tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] 10.222.0.13 "GET /compute/v2.1/servers/f5d5dfa8-4516-428f-bcf5-f0a1174bd14e" status: 200 len: 1292 microversion: 2.1 time: 0.231831 Nov 01 19:06:58.897369 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1572/3086] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:06:58 2022] GET /compute/v2.1/servers/f5d5dfa8-4516-428f-bcf5-f0a1174bd14e => generated 1292 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:06:58.902982 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-b5646996-7e9f-41e0-a570-bc5590a9d572 tempest-AttachSCSIVolumeTestJSON-356336257 tempest-AttachSCSIVolumeTestJSON-356336257-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:06:58.903684 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-b5646996-7e9f-41e0-a570-bc5590a9d572 tempest-AttachSCSIVolumeTestJSON-356336257 tempest-AttachSCSIVolumeTestJSON-356336257-project] [instance: 8a378b79-bd92-4ade-b034-1aaf5c87b74b] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:06:58.906698 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-97166761-4843-4150-a0d7-e33cfb23c4b5 tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] [instance: 307ee785-a01d-401c-8be2-b17558e735f3] Going to try to terminate instance {{(pid=121402) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 01 19:06:58.915968 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-b5646996-7e9f-41e0-a570-bc5590a9d572 tempest-AttachSCSIVolumeTestJSON-356336257 tempest-AttachSCSIVolumeTestJSON-356336257-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:06:58.916574 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-b5646996-7e9f-41e0-a570-bc5590a9d572 tempest-AttachSCSIVolumeTestJSON-356336257 tempest-AttachSCSIVolumeTestJSON-356336257-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:06:58.917138 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-b5646996-7e9f-41e0-a570-bc5590a9d572 tempest-AttachSCSIVolumeTestJSON-356336257 tempest-AttachSCSIVolumeTestJSON-356336257-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:06:58.918638 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-b5646996-7e9f-41e0-a570-bc5590a9d572 tempest-AttachSCSIVolumeTestJSON-356336257 tempest-AttachSCSIVolumeTestJSON-356336257-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:06:58.919234 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-b5646996-7e9f-41e0-a570-bc5590a9d572 tempest-AttachSCSIVolumeTestJSON-356336257 tempest-AttachSCSIVolumeTestJSON-356336257-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:06:58.919862 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-b5646996-7e9f-41e0-a570-bc5590a9d572 tempest-AttachSCSIVolumeTestJSON-356336257 tempest-AttachSCSIVolumeTestJSON-356336257-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:06:58.995539 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-97166761-4843-4150-a0d7-e33cfb23c4b5 tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] 10.222.0.13 "DELETE /compute/v2.1/servers/307ee785-a01d-401c-8be2-b17558e735f3" status: 204 len: 0 microversion: 2.1 time: 0.141641 Nov 01 19:06:58.996359 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1515/3087] 10.222.0.13 () {58 vars in 1239 bytes} [Tue Nov 1 19:06:58 2022] DELETE /compute/v2.1/servers/307ee785-a01d-401c-8be2-b17558e735f3 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 01 19:06:59.001955 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-3ed1d644-de65-4a8e-9c83-89b3a92378ec tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:06:59.002948 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-3ed1d644-de65-4a8e-9c83-89b3a92378ec tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] [instance: 3a13d400-ebab-4430-bba5-4b5339199be4] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:06:59.009066 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-3ed1d644-de65-4a8e-9c83-89b3a92378ec tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:06:59.009735 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-3ed1d644-de65-4a8e-9c83-89b3a92378ec tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:06:59.010177 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-3ed1d644-de65-4a8e-9c83-89b3a92378ec tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:06:59.010881 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-3ed1d644-de65-4a8e-9c83-89b3a92378ec tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:06:59.011413 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-3ed1d644-de65-4a8e-9c83-89b3a92378ec tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:06:59.011839 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-3ed1d644-de65-4a8e-9c83-89b3a92378ec tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:06:59.072901 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-b5646996-7e9f-41e0-a570-bc5590a9d572 tempest-AttachSCSIVolumeTestJSON-356336257 tempest-AttachSCSIVolumeTestJSON-356336257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde7667dbbfd4864a5b0ca8d8b291406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b14142c34d54977ac9eb59962f2a9e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:06:59.081793 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-b5646996-7e9f-41e0-a570-bc5590a9d572 tempest-AttachSCSIVolumeTestJSON-356336257 tempest-AttachSCSIVolumeTestJSON-356336257-project] 10.222.0.13 "GET /compute/v2.1/servers/8a378b79-bd92-4ade-b034-1aaf5c87b74b" status: 200 len: 1372 microversion: 2.1 time: 0.182980 Nov 01 19:06:59.082436 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1573/3088] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:06:58 2022] GET /compute/v2.1/servers/8a378b79-bd92-4ade-b034-1aaf5c87b74b => generated 1372 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:06:59.103005 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-42de7a3c-bfc7-4058-bf3d-3bc6ba7c78fb tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:06:59.103625 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-42de7a3c-bfc7-4058-bf3d-3bc6ba7c78fb tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] [instance: 674f7fae-6219-4e5e-b85a-2647b948807e] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:06:59.111616 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-42de7a3c-bfc7-4058-bf3d-3bc6ba7c78fb tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:06:59.112111 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-42de7a3c-bfc7-4058-bf3d-3bc6ba7c78fb tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:06:59.112550 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-42de7a3c-bfc7-4058-bf3d-3bc6ba7c78fb tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:06:59.113327 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-42de7a3c-bfc7-4058-bf3d-3bc6ba7c78fb tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:06:59.113781 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-42de7a3c-bfc7-4058-bf3d-3bc6ba7c78fb tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:06:59.114208 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-42de7a3c-bfc7-4058-bf3d-3bc6ba7c78fb tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:06:59.175721 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-3ed1d644-de65-4a8e-9c83-89b3a92378ec tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '058480d92c9b4ab4af6815d0438a65c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee9dc49b89143f781e4ab30296e4d01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:06:59.183984 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-3ed1d644-de65-4a8e-9c83-89b3a92378ec tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] 10.222.0.13 "GET /compute/v2.1/servers/3a13d400-ebab-4430-bba5-4b5339199be4" status: 200 len: 1315 microversion: 2.1 time: 0.186365 Nov 01 19:06:59.188107 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1516/3089] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:06:58 2022] GET /compute/v2.1/servers/3a13d400-ebab-4430-bba5-4b5339199be4 => generated 1315 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:06:59.192908 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-cfbfd99a-551c-491b-9df5-c9f03fd3eb5d tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:06:59.193766 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-cfbfd99a-551c-491b-9df5-c9f03fd3eb5d tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] [instance: 50bf9fd1-c4c6-4d58-80a1-4ce30f50f9bb] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:06:59.199885 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-cfbfd99a-551c-491b-9df5-c9f03fd3eb5d tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:06:59.200377 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-cfbfd99a-551c-491b-9df5-c9f03fd3eb5d tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:06:59.201028 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-cfbfd99a-551c-491b-9df5-c9f03fd3eb5d tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:06:59.201750 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-cfbfd99a-551c-491b-9df5-c9f03fd3eb5d tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:06:59.202214 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-cfbfd99a-551c-491b-9df5-c9f03fd3eb5d tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:06:59.202724 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-cfbfd99a-551c-491b-9df5-c9f03fd3eb5d tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:06:59.267271 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-cfbfd99a-551c-491b-9df5-c9f03fd3eb5d tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05d6a1722dfa4e959aeb14d601e43b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b5d812eff94e2f89d4705d7e7d5f3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:06:59.274888 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-cfbfd99a-551c-491b-9df5-c9f03fd3eb5d tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] 10.222.0.13 "GET /compute/v2.1/servers/50bf9fd1-c4c6-4d58-80a1-4ce30f50f9bb" status: 200 len: 1222 microversion: 2.1 time: 0.085600 Nov 01 19:06:59.289340 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1517/3090] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:06:59 2022] GET /compute/v2.1/servers/50bf9fd1-c4c6-4d58-80a1-4ce30f50f9bb => generated 1222 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:06:59.289340 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-beffed53-fb9d-4bce-986c-bbb7a5d31510 tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:06:59.289340 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-beffed53-fb9d-4bce-986c-bbb7a5d31510 tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] [instance: 307ee785-a01d-401c-8be2-b17558e735f3] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:06:59.289340 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-beffed53-fb9d-4bce-986c-bbb7a5d31510 tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:06:59.289340 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-beffed53-fb9d-4bce-986c-bbb7a5d31510 tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:06:59.289340 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-beffed53-fb9d-4bce-986c-bbb7a5d31510 tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:06:59.289340 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-beffed53-fb9d-4bce-986c-bbb7a5d31510 tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:06:59.289340 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-beffed53-fb9d-4bce-986c-bbb7a5d31510 tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:06:59.289340 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-beffed53-fb9d-4bce-986c-bbb7a5d31510 tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:06:59.316121 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-42de7a3c-bfc7-4058-bf3d-3bc6ba7c78fb tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '790f3f1566b7464aaca19d4d05c0942e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33e3d319293c46b6af2f728a50586906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:06:59.324413 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-42de7a3c-bfc7-4058-bf3d-3bc6ba7c78fb tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] 10.222.0.13 "GET /compute/v2.1/servers/674f7fae-6219-4e5e-b85a-2647b948807e" status: 200 len: 1367 microversion: 2.1 time: 0.225182 Nov 01 19:06:59.325030 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1574/3091] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:06:59 2022] GET /compute/v2.1/servers/674f7fae-6219-4e5e-b85a-2647b948807e => generated 1367 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:06:59.336682 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-3a6dc9c3-25cc-466b-bef5-a30e9947c370 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:06:59.337301 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-3a6dc9c3-25cc-466b-bef5-a30e9947c370 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] [instance: af1071a8-a090-44c9-890c-123ca3ff39f1] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:06:59.343306 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-3a6dc9c3-25cc-466b-bef5-a30e9947c370 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:06:59.343792 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-3a6dc9c3-25cc-466b-bef5-a30e9947c370 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:06:59.344233 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-3a6dc9c3-25cc-466b-bef5-a30e9947c370 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:06:59.344957 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-3a6dc9c3-25cc-466b-bef5-a30e9947c370 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:06:59.345420 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-3a6dc9c3-25cc-466b-bef5-a30e9947c370 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:06:59.345845 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-3a6dc9c3-25cc-466b-bef5-a30e9947c370 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:06:59.523366 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-beffed53-fb9d-4bce-986c-bbb7a5d31510 tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb87e6147a6f470391921ac3b7a62f8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6511ea24c4c19a7c5d91535c7288d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:06:59.535040 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-beffed53-fb9d-4bce-986c-bbb7a5d31510 tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] 10.222.0.13 "GET /compute/v2.1/servers/307ee785-a01d-401c-8be2-b17558e735f3" status: 200 len: 1525 microversion: 2.1 time: 0.258281 Nov 01 19:06:59.536650 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1518/3092] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:06:59 2022] GET /compute/v2.1/servers/307ee785-a01d-401c-8be2-b17558e735f3 => generated 1525 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:06:59.572881 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-3a6dc9c3-25cc-466b-bef5-a30e9947c370 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '301ed3b9c37449bc9ade378f3c73a768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8807757227574c828dca1947af76659d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:06:59.582029 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-3a6dc9c3-25cc-466b-bef5-a30e9947c370 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '301ed3b9c37449bc9ade378f3c73a768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8807757227574c828dca1947af76659d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:06:59.583474 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-3a6dc9c3-25cc-466b-bef5-a30e9947c370 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '301ed3b9c37449bc9ade378f3c73a768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8807757227574c828dca1947af76659d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:06:59.584632 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-3a6dc9c3-25cc-466b-bef5-a30e9947c370 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] 10.222.0.13 "GET /compute/v2.1/servers/af1071a8-a090-44c9-890c-123ca3ff39f1" status: 200 len: 1880 microversion: 2.42 time: 0.258665 Nov 01 19:06:59.585196 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1575/3093] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 19:06:59 2022] GET /compute/v2.1/servers/af1071a8-a090-44c9-890c-123ca3ff39f1 => generated 1880 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 19:06:59.842929 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [req-cba88c56-e205-4b24-8c9b-e847be9c64dc req-706a9873-3db1-4d47-903e-d2f2d6b08b07 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0b57b50d-1ec4-4ee1-ac3a-f6f44d68a2c3", "name": "network-vif-deleted", "tag": "4032ee0a-a429-4780-a678-83209caf97b1"}]} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:06:59.852921 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-cba88c56-e205-4b24-8c9b-e847be9c64dc req-706a9873-3db1-4d47-903e-d2f2d6b08b07 service nova] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:06:59.853539 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-cba88c56-e205-4b24-8c9b-e847be9c64dc req-706a9873-3db1-4d47-903e-d2f2d6b08b07 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:06:59.854135 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-cba88c56-e205-4b24-8c9b-e847be9c64dc req-706a9873-3db1-4d47-903e-d2f2d6b08b07 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:06:59.867206 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.compute.server_external_events [req-cba88c56-e205-4b24-8c9b-e847be9c64dc req-706a9873-3db1-4d47-903e-d2f2d6b08b07 service nova] Creating event network-vif-deleted:4032ee0a-a429-4780-a678-83209caf97b1 for instance 0b57b50d-1ec4-4ee1-ac3a-f6f44d68a2c3 on n-h2-863052-2 Nov 01 19:06:59.874662 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [req-cba88c56-e205-4b24-8c9b-e847be9c64dc req-706a9873-3db1-4d47-903e-d2f2d6b08b07 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035405 Nov 01 19:06:59.875476 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1519/3094] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Nov 1 19:06:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:06:59.878406 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-ea56c5cf-aa59-414d-9032-8a1898842a17 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:06:59.879049 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-ea56c5cf-aa59-414d-9032-8a1898842a17 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] [instance: ba6ffc5c-84a4-40f1-bdc7-f87dde2c99df] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:06:59.886172 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-ea56c5cf-aa59-414d-9032-8a1898842a17 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:06:59.886672 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-ea56c5cf-aa59-414d-9032-8a1898842a17 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:06:59.887112 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-ea56c5cf-aa59-414d-9032-8a1898842a17 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:06:59.887821 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-ea56c5cf-aa59-414d-9032-8a1898842a17 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:06:59.888281 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-ea56c5cf-aa59-414d-9032-8a1898842a17 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:06:59.888756 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-ea56c5cf-aa59-414d-9032-8a1898842a17 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:06:59.922098 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-f9b7a832-c056-43cd-8327-8d06c9d5b33c tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:06:59.922717 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-f9b7a832-c056-43cd-8327-8d06c9d5b33c tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] [instance: f5d5dfa8-4516-428f-bcf5-f0a1174bd14e] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:06:59.937254 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f9b7a832-c056-43cd-8327-8d06c9d5b33c tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:06:59.937755 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f9b7a832-c056-43cd-8327-8d06c9d5b33c tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:06:59.938195 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f9b7a832-c056-43cd-8327-8d06c9d5b33c tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:06:59.939086 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f9b7a832-c056-43cd-8327-8d06c9d5b33c tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:06:59.939542 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f9b7a832-c056-43cd-8327-8d06c9d5b33c tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:06:59.940153 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f9b7a832-c056-43cd-8327-8d06c9d5b33c tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:00.088187 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-f9b7a832-c056-43cd-8327-8d06c9d5b33c tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113bd8c844ee490b86a68bc7e1e75da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '851785a5f76548898a77d67792888504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:07:00.097115 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-f9b7a832-c056-43cd-8327-8d06c9d5b33c tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] 10.222.0.13 "GET /compute/v2.1/servers/f5d5dfa8-4516-428f-bcf5-f0a1174bd14e" status: 200 len: 1292 microversion: 2.1 time: 0.179626 Nov 01 19:07:00.108978 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1520/3095] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:06:59 2022] GET /compute/v2.1/servers/f5d5dfa8-4516-428f-bcf5-f0a1174bd14e => generated 1292 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 19:07:00.119113 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [req-d010b467-36cd-4306-a532-2c397e822ccf req-d568b0a0-6313-4cb1-8c13-a379153bec8c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "af1071a8-a090-44c9-890c-123ca3ff39f1", "name": "network-vif-plugged", "status": "completed", "tag": "5bf6bd76-de52-44ac-88f4-a18e9dd144b7"}, {"server_uuid": "af1071a8-a090-44c9-890c-123ca3ff39f1", "name": "network-vif-plugged", "status": "completed", "tag": "47e5170e-02f3-496f-b886-a133bae1b952"}, {"server_uuid": "8a378b79-bd92-4ade-b034-1aaf5c87b74b", "name": "network-vif-plugged", "status": "completed", "tag": "7351786b-bb68-489c-a92f-36e1f62d4e9a"}]} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:07:00.131831 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-d010b467-36cd-4306-a532-2c397e822ccf req-d568b0a0-6313-4cb1-8c13-a379153bec8c service nova] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:00.132318 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-d010b467-36cd-4306-a532-2c397e822ccf req-d568b0a0-6313-4cb1-8c13-a379153bec8c service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:00.132984 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-d010b467-36cd-4306-a532-2c397e822ccf req-d568b0a0-6313-4cb1-8c13-a379153bec8c service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:00.150987 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.compute.server_external_events [req-d010b467-36cd-4306-a532-2c397e822ccf req-d568b0a0-6313-4cb1-8c13-a379153bec8c service nova] Creating event network-vif-plugged:5bf6bd76-de52-44ac-88f4-a18e9dd144b7 for instance af1071a8-a090-44c9-890c-123ca3ff39f1 on n-h2-863052-2 Nov 01 19:07:00.151504 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.compute.server_external_events [req-d010b467-36cd-4306-a532-2c397e822ccf req-d568b0a0-6313-4cb1-8c13-a379153bec8c service nova] Creating event network-vif-plugged:47e5170e-02f3-496f-b886-a133bae1b952 for instance af1071a8-a090-44c9-890c-123ca3ff39f1 on n-h2-863052-2 Nov 01 19:07:00.153299 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.compute.server_external_events [req-d010b467-36cd-4306-a532-2c397e822ccf req-d568b0a0-6313-4cb1-8c13-a379153bec8c service nova] Creating event network-vif-plugged:7351786b-bb68-489c-a92f-36e1f62d4e9a for instance 8a378b79-bd92-4ade-b034-1aaf5c87b74b on n-h2-863052-2 Nov 01 19:07:00.154008 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-ea56c5cf-aa59-414d-9032-8a1898842a17 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd2105b0264b48d084d0e79cabff8bc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf4adda91364dab94830347c06e3957', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:07:00.160619 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [req-d010b467-36cd-4306-a532-2c397e822ccf req-d568b0a0-6313-4cb1-8c13-a379153bec8c service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.050090 Nov 01 19:07:00.161645 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1521/3096] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Nov 1 19:07:00 2022] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:07:00.166913 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-ea56c5cf-aa59-414d-9032-8a1898842a17 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd2105b0264b48d084d0e79cabff8bc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf4adda91364dab94830347c06e3957', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:07:00.169216 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-ea56c5cf-aa59-414d-9032-8a1898842a17 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd2105b0264b48d084d0e79cabff8bc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf4adda91364dab94830347c06e3957', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:07:00.169408 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-bc6a4c83-f33d-4ab7-9b1d-3576e5f27ad1 tempest-AttachSCSIVolumeTestJSON-356336257 tempest-AttachSCSIVolumeTestJSON-356336257-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:07:00.170036 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-bc6a4c83-f33d-4ab7-9b1d-3576e5f27ad1 tempest-AttachSCSIVolumeTestJSON-356336257 tempest-AttachSCSIVolumeTestJSON-356336257-project] [instance: 8a378b79-bd92-4ade-b034-1aaf5c87b74b] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:07:00.170719 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-ea56c5cf-aa59-414d-9032-8a1898842a17 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] 10.222.0.13 "GET /compute/v2.1/servers/ba6ffc5c-84a4-40f1-bdc7-f87dde2c99df" status: 200 len: 1875 microversion: 2.32 time: 0.296384 Nov 01 19:07:00.171689 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1576/3097] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 19:06:59 2022] GET /compute/v2.1/servers/ba6ffc5c-84a4-40f1-bdc7-f87dde2c99df => generated 1875 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 01 19:07:00.177765 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-bc6a4c83-f33d-4ab7-9b1d-3576e5f27ad1 tempest-AttachSCSIVolumeTestJSON-356336257 tempest-AttachSCSIVolumeTestJSON-356336257-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:00.178195 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-bc6a4c83-f33d-4ab7-9b1d-3576e5f27ad1 tempest-AttachSCSIVolumeTestJSON-356336257 tempest-AttachSCSIVolumeTestJSON-356336257-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:00.178643 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-bc6a4c83-f33d-4ab7-9b1d-3576e5f27ad1 tempest-AttachSCSIVolumeTestJSON-356336257 tempest-AttachSCSIVolumeTestJSON-356336257-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:00.179319 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-bc6a4c83-f33d-4ab7-9b1d-3576e5f27ad1 tempest-AttachSCSIVolumeTestJSON-356336257 tempest-AttachSCSIVolumeTestJSON-356336257-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:00.179778 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-bc6a4c83-f33d-4ab7-9b1d-3576e5f27ad1 tempest-AttachSCSIVolumeTestJSON-356336257 tempest-AttachSCSIVolumeTestJSON-356336257-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:00.180202 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-bc6a4c83-f33d-4ab7-9b1d-3576e5f27ad1 tempest-AttachSCSIVolumeTestJSON-356336257 tempest-AttachSCSIVolumeTestJSON-356336257-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:00.206909 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-6e99b2bf-33ba-411d-bab1-f0027d9f0264 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:07:00.207646 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-6e99b2bf-33ba-411d-bab1-f0027d9f0264 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] [instance: 3a13d400-ebab-4430-bba5-4b5339199be4] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:07:00.213741 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-6e99b2bf-33ba-411d-bab1-f0027d9f0264 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:00.214828 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-6e99b2bf-33ba-411d-bab1-f0027d9f0264 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:00.215358 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-6e99b2bf-33ba-411d-bab1-f0027d9f0264 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:00.216121 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-6e99b2bf-33ba-411d-bab1-f0027d9f0264 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:00.216675 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-6e99b2bf-33ba-411d-bab1-f0027d9f0264 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:00.217333 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-6e99b2bf-33ba-411d-bab1-f0027d9f0264 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:00.397195 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-bc6a4c83-f33d-4ab7-9b1d-3576e5f27ad1 tempest-AttachSCSIVolumeTestJSON-356336257 tempest-AttachSCSIVolumeTestJSON-356336257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde7667dbbfd4864a5b0ca8d8b291406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b14142c34d54977ac9eb59962f2a9e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:07:00.406297 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-bc6a4c83-f33d-4ab7-9b1d-3576e5f27ad1 tempest-AttachSCSIVolumeTestJSON-356336257 tempest-AttachSCSIVolumeTestJSON-356336257-project] 10.222.0.13 "GET /compute/v2.1/servers/8a378b79-bd92-4ade-b034-1aaf5c87b74b" status: 200 len: 1372 microversion: 2.1 time: 0.243444 Nov 01 19:07:00.411006 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1522/3098] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:07:00 2022] GET /compute/v2.1/servers/8a378b79-bd92-4ade-b034-1aaf5c87b74b => generated 1372 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:07:00.427238 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-7b1807f4-c06c-47a2-9b51-007c6daeaa84 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:07:00.427923 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-7b1807f4-c06c-47a2-9b51-007c6daeaa84 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] [instance: 50bf9fd1-c4c6-4d58-80a1-4ce30f50f9bb] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:07:00.436168 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-7b1807f4-c06c-47a2-9b51-007c6daeaa84 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:00.436942 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-7b1807f4-c06c-47a2-9b51-007c6daeaa84 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:00.437377 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-7b1807f4-c06c-47a2-9b51-007c6daeaa84 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:00.438088 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-7b1807f4-c06c-47a2-9b51-007c6daeaa84 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:00.438533 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-7b1807f4-c06c-47a2-9b51-007c6daeaa84 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:00.438950 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-7b1807f4-c06c-47a2-9b51-007c6daeaa84 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:00.521990 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-6e99b2bf-33ba-411d-bab1-f0027d9f0264 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '058480d92c9b4ab4af6815d0438a65c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee9dc49b89143f781e4ab30296e4d01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:07:00.531679 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-6e99b2bf-33ba-411d-bab1-f0027d9f0264 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] 10.222.0.13 "GET /compute/v2.1/servers/3a13d400-ebab-4430-bba5-4b5339199be4" status: 200 len: 1315 microversion: 2.1 time: 0.328505 Nov 01 19:07:00.533229 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1577/3099] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:07:00 2022] GET /compute/v2.1/servers/3a13d400-ebab-4430-bba5-4b5339199be4 => generated 1315 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:07:00.546045 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-16b35413-9779-47a0-aa46-6f8f25a6f834 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:07:00.546933 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-16b35413-9779-47a0-aa46-6f8f25a6f834 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] [instance: 674f7fae-6219-4e5e-b85a-2647b948807e] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:07:00.567300 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-7b1807f4-c06c-47a2-9b51-007c6daeaa84 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05d6a1722dfa4e959aeb14d601e43b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b5d812eff94e2f89d4705d7e7d5f3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:07:00.576171 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-16b35413-9779-47a0-aa46-6f8f25a6f834 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:00.579088 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-7b1807f4-c06c-47a2-9b51-007c6daeaa84 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] 10.222.0.13 "GET /compute/v2.1/servers/50bf9fd1-c4c6-4d58-80a1-4ce30f50f9bb" status: 200 len: 1270 microversion: 2.1 time: 0.166560 Nov 01 19:07:00.579582 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-16b35413-9779-47a0-aa46-6f8f25a6f834 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:00.580164 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-16b35413-9779-47a0-aa46-6f8f25a6f834 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:00.581005 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-16b35413-9779-47a0-aa46-6f8f25a6f834 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:00.593233 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1523/3100] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:07:00 2022] GET /compute/v2.1/servers/50bf9fd1-c4c6-4d58-80a1-4ce30f50f9bb => generated 1270 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:07:00.601503 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-16b35413-9779-47a0-aa46-6f8f25a6f834 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:00.602336 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-16b35413-9779-47a0-aa46-6f8f25a6f834 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:00.606469 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-a3efa685-fddc-431f-8c47-5dba52115852 tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:07:00.611654 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-a3efa685-fddc-431f-8c47-5dba52115852 tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] [instance: 307ee785-a01d-401c-8be2-b17558e735f3] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:07:00.621150 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-a3efa685-fddc-431f-8c47-5dba52115852 tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:00.623359 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-a3efa685-fddc-431f-8c47-5dba52115852 tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:00.623911 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-a3efa685-fddc-431f-8c47-5dba52115852 tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:00.625209 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-a3efa685-fddc-431f-8c47-5dba52115852 tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:00.625989 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-a3efa685-fddc-431f-8c47-5dba52115852 tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:00.626652 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-a3efa685-fddc-431f-8c47-5dba52115852 tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:01.044813 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-16b35413-9779-47a0-aa46-6f8f25a6f834 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '790f3f1566b7464aaca19d4d05c0942e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33e3d319293c46b6af2f728a50586906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:07:01.057618 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-16b35413-9779-47a0-aa46-6f8f25a6f834 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] 10.222.0.13 "GET /compute/v2.1/servers/674f7fae-6219-4e5e-b85a-2647b948807e" status: 200 len: 1556 microversion: 2.1 time: 0.522851 Nov 01 19:07:01.062423 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1578/3101] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:07:00 2022] GET /compute/v2.1/servers/674f7fae-6219-4e5e-b85a-2647b948807e => generated 1556 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:07:01.067679 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-3926f8b0-f06f-414a-8dd6-ec522265245c tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:07:01.070665 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-3926f8b0-f06f-414a-8dd6-ec522265245c tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] [instance: af1071a8-a090-44c9-890c-123ca3ff39f1] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:07:01.083957 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-3926f8b0-f06f-414a-8dd6-ec522265245c tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:01.084609 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-3926f8b0-f06f-414a-8dd6-ec522265245c tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:01.086119 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-3926f8b0-f06f-414a-8dd6-ec522265245c tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:01.086966 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-3926f8b0-f06f-414a-8dd6-ec522265245c tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:01.087426 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-3926f8b0-f06f-414a-8dd6-ec522265245c tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:01.087960 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-3926f8b0-f06f-414a-8dd6-ec522265245c tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:01.187424 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-a3efa685-fddc-431f-8c47-5dba52115852 tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb87e6147a6f470391921ac3b7a62f8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6511ea24c4c19a7c5d91535c7288d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:07:01.194193 n-d-863052-2 devstack@n-api.service[121402]: DEBUG dbcounter [-] [121402] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=121402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 19:07:01.197088 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-a3efa685-fddc-431f-8c47-5dba52115852 tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] 10.222.0.13 "GET /compute/v2.1/servers/307ee785-a01d-401c-8be2-b17558e735f3" status: 200 len: 1525 microversion: 2.1 time: 0.602369 Nov 01 19:07:01.197679 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1524/3102] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:07:00 2022] GET /compute/v2.1/servers/307ee785-a01d-401c-8be2-b17558e735f3 => generated 1525 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:07:01.203501 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-3703761a-c6c2-4ef1-a1b0-316c7416f5bd tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:07:01.204352 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-3703761a-c6c2-4ef1-a1b0-316c7416f5bd tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] [instance: 674f7fae-6219-4e5e-b85a-2647b948807e] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:07:01.211264 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-3703761a-c6c2-4ef1-a1b0-316c7416f5bd tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:01.212050 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-3703761a-c6c2-4ef1-a1b0-316c7416f5bd tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:01.212663 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-3703761a-c6c2-4ef1-a1b0-316c7416f5bd tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:01.213527 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-3703761a-c6c2-4ef1-a1b0-316c7416f5bd tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:01.214127 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-3703761a-c6c2-4ef1-a1b0-316c7416f5bd tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:01.215052 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-3703761a-c6c2-4ef1-a1b0-316c7416f5bd tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:01.291656 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-3926f8b0-f06f-414a-8dd6-ec522265245c tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '301ed3b9c37449bc9ade378f3c73a768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8807757227574c828dca1947af76659d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:07:01.301794 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-3926f8b0-f06f-414a-8dd6-ec522265245c tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '301ed3b9c37449bc9ade378f3c73a768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8807757227574c828dca1947af76659d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:07:01.303260 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-3926f8b0-f06f-414a-8dd6-ec522265245c tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '301ed3b9c37449bc9ade378f3c73a768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8807757227574c828dca1947af76659d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:07:01.304445 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-3926f8b0-f06f-414a-8dd6-ec522265245c tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] 10.222.0.13 "GET /compute/v2.1/servers/af1071a8-a090-44c9-890c-123ca3ff39f1" status: 200 len: 1880 microversion: 2.42 time: 0.240824 Nov 01 19:07:01.306501 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1579/3103] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 19:07:01 2022] GET /compute/v2.1/servers/af1071a8-a090-44c9-890c-123ca3ff39f1 => generated 1880 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 19:07:01.310667 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-275eca6c-2853-45f8-9510-8dd0e15aeda8 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:07:01.311734 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-275eca6c-2853-45f8-9510-8dd0e15aeda8 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] [instance: f5d5dfa8-4516-428f-bcf5-f0a1174bd14e] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:07:01.317663 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-275eca6c-2853-45f8-9510-8dd0e15aeda8 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:01.318151 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-275eca6c-2853-45f8-9510-8dd0e15aeda8 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:01.318585 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-275eca6c-2853-45f8-9510-8dd0e15aeda8 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:01.319267 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-275eca6c-2853-45f8-9510-8dd0e15aeda8 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:01.320341 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-275eca6c-2853-45f8-9510-8dd0e15aeda8 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:01.320911 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-275eca6c-2853-45f8-9510-8dd0e15aeda8 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:01.358860 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-3703761a-c6c2-4ef1-a1b0-316c7416f5bd tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] 10.222.0.13 "GET /compute/v2.1/servers/674f7fae-6219-4e5e-b85a-2647b948807e/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.159243 Nov 01 19:07:01.359510 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1525/3104] 10.222.0.13 () {58 vars in 1275 bytes} [Tue Nov 1 19:07:01 2022] GET /compute/v2.1/servers/674f7fae-6219-4e5e-b85a-2647b948807e/os-interface => generated 284 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:07:01.364469 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-baf99206-1b04-41ea-9afb-b90deeb4d3c1 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:07:01.365118 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-baf99206-1b04-41ea-9afb-b90deeb4d3c1 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] [instance: ba6ffc5c-84a4-40f1-bdc7-f87dde2c99df] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:07:01.372147 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-baf99206-1b04-41ea-9afb-b90deeb4d3c1 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:01.372784 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-baf99206-1b04-41ea-9afb-b90deeb4d3c1 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:01.373298 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-baf99206-1b04-41ea-9afb-b90deeb4d3c1 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:01.374080 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-baf99206-1b04-41ea-9afb-b90deeb4d3c1 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:01.374615 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-baf99206-1b04-41ea-9afb-b90deeb4d3c1 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:01.375106 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-baf99206-1b04-41ea-9afb-b90deeb4d3c1 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:01.467912 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-275eca6c-2853-45f8-9510-8dd0e15aeda8 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113bd8c844ee490b86a68bc7e1e75da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '851785a5f76548898a77d67792888504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:07:01.475651 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-275eca6c-2853-45f8-9510-8dd0e15aeda8 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] 10.222.0.13 "GET /compute/v2.1/servers/f5d5dfa8-4516-428f-bcf5-f0a1174bd14e" status: 200 len: 1292 microversion: 2.1 time: 0.169443 Nov 01 19:07:01.476315 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1580/3105] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:07:01 2022] GET /compute/v2.1/servers/f5d5dfa8-4516-428f-bcf5-f0a1174bd14e => generated 1292 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:07:01.481522 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-5bc6db46-6bcf-4a1f-b43e-5396ef8523c3 tempest-AttachSCSIVolumeTestJSON-356336257 tempest-AttachSCSIVolumeTestJSON-356336257-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:07:01.482121 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-5bc6db46-6bcf-4a1f-b43e-5396ef8523c3 tempest-AttachSCSIVolumeTestJSON-356336257 tempest-AttachSCSIVolumeTestJSON-356336257-project] [instance: 8a378b79-bd92-4ade-b034-1aaf5c87b74b] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:07:01.488098 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-5bc6db46-6bcf-4a1f-b43e-5396ef8523c3 tempest-AttachSCSIVolumeTestJSON-356336257 tempest-AttachSCSIVolumeTestJSON-356336257-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:01.488601 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-5bc6db46-6bcf-4a1f-b43e-5396ef8523c3 tempest-AttachSCSIVolumeTestJSON-356336257 tempest-AttachSCSIVolumeTestJSON-356336257-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:01.489267 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-5bc6db46-6bcf-4a1f-b43e-5396ef8523c3 tempest-AttachSCSIVolumeTestJSON-356336257 tempest-AttachSCSIVolumeTestJSON-356336257-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:01.490196 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-5bc6db46-6bcf-4a1f-b43e-5396ef8523c3 tempest-AttachSCSIVolumeTestJSON-356336257 tempest-AttachSCSIVolumeTestJSON-356336257-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:01.490865 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-5bc6db46-6bcf-4a1f-b43e-5396ef8523c3 tempest-AttachSCSIVolumeTestJSON-356336257 tempest-AttachSCSIVolumeTestJSON-356336257-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:01.491518 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-5bc6db46-6bcf-4a1f-b43e-5396ef8523c3 tempest-AttachSCSIVolumeTestJSON-356336257 tempest-AttachSCSIVolumeTestJSON-356336257-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:02.070148 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-baf99206-1b04-41ea-9afb-b90deeb4d3c1 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd2105b0264b48d084d0e79cabff8bc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf4adda91364dab94830347c06e3957', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:07:02.078634 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-5bc6db46-6bcf-4a1f-b43e-5396ef8523c3 tempest-AttachSCSIVolumeTestJSON-356336257 tempest-AttachSCSIVolumeTestJSON-356336257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde7667dbbfd4864a5b0ca8d8b291406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b14142c34d54977ac9eb59962f2a9e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:07:02.086344 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-baf99206-1b04-41ea-9afb-b90deeb4d3c1 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd2105b0264b48d084d0e79cabff8bc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf4adda91364dab94830347c06e3957', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:07:02.088658 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-baf99206-1b04-41ea-9afb-b90deeb4d3c1 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd2105b0264b48d084d0e79cabff8bc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf4adda91364dab94830347c06e3957', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:07:02.090977 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-baf99206-1b04-41ea-9afb-b90deeb4d3c1 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] 10.222.0.13 "GET /compute/v2.1/servers/ba6ffc5c-84a4-40f1-bdc7-f87dde2c99df" status: 200 len: 1875 microversion: 2.32 time: 0.730526 Nov 01 19:07:02.091968 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1526/3106] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 19:07:01 2022] GET /compute/v2.1/servers/ba6ffc5c-84a4-40f1-bdc7-f87dde2c99df => generated 1875 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 19:07:02.093323 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-5bc6db46-6bcf-4a1f-b43e-5396ef8523c3 tempest-AttachSCSIVolumeTestJSON-356336257 tempest-AttachSCSIVolumeTestJSON-356336257-project] 10.222.0.13 "GET /compute/v2.1/servers/8a378b79-bd92-4ade-b034-1aaf5c87b74b" status: 200 len: 1372 microversion: 2.1 time: 0.614641 Nov 01 19:07:02.094948 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1581/3107] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:07:01 2022] GET /compute/v2.1/servers/8a378b79-bd92-4ade-b034-1aaf5c87b74b => generated 1372 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:07:02.098769 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-542775cc-bf9f-4876-a829-c09ce36560d8 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:07:02.099624 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-542775cc-bf9f-4876-a829-c09ce36560d8 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] [instance: 3a13d400-ebab-4430-bba5-4b5339199be4] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:07:02.101409 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-1f34d72a-910e-4ea3-b117-247f0ea7d56d tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:07:02.102653 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-1f34d72a-910e-4ea3-b117-247f0ea7d56d tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] [instance: 50bf9fd1-c4c6-4d58-80a1-4ce30f50f9bb] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:07:02.106887 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-542775cc-bf9f-4876-a829-c09ce36560d8 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:02.107684 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-542775cc-bf9f-4876-a829-c09ce36560d8 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:02.108342 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-542775cc-bf9f-4876-a829-c09ce36560d8 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:02.109294 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-542775cc-bf9f-4876-a829-c09ce36560d8 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:02.109955 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-542775cc-bf9f-4876-a829-c09ce36560d8 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:02.110577 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-542775cc-bf9f-4876-a829-c09ce36560d8 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:02.117861 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-1f34d72a-910e-4ea3-b117-247f0ea7d56d tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:02.119481 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-1f34d72a-910e-4ea3-b117-247f0ea7d56d tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:02.120310 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-1f34d72a-910e-4ea3-b117-247f0ea7d56d tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:02.122205 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-1f34d72a-910e-4ea3-b117-247f0ea7d56d tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:02.123059 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-1f34d72a-910e-4ea3-b117-247f0ea7d56d tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:02.123612 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-1f34d72a-910e-4ea3-b117-247f0ea7d56d tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:02.162291 n-d-863052-2 devstack@n-api.service[121403]: DEBUG dbcounter [-] [121403] Writing DB stats nova_cell1:SELECT=100 {{(pid=121403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 19:07:02.263792 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-1f34d72a-910e-4ea3-b117-247f0ea7d56d tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05d6a1722dfa4e959aeb14d601e43b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b5d812eff94e2f89d4705d7e7d5f3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:07:02.272391 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-1f34d72a-910e-4ea3-b117-247f0ea7d56d tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] 10.222.0.13 "GET /compute/v2.1/servers/50bf9fd1-c4c6-4d58-80a1-4ce30f50f9bb" status: 200 len: 1276 microversion: 2.1 time: 0.176246 Nov 01 19:07:02.273656 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1582/3108] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:07:02 2022] GET /compute/v2.1/servers/50bf9fd1-c4c6-4d58-80a1-4ce30f50f9bb => generated 1276 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:07:02.279177 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [req-98d5239d-8bed-49be-81ac-090f889704a8 req-2b71d4b1-0738-428b-bc21-71a07bb438a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3a13d400-ebab-4430-bba5-4b5339199be4", "name": "network-vif-deleted", "tag": "d41182e2-e6f3-405a-a20f-6d8f80e3c0a1"}]} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:07:02.289090 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-98d5239d-8bed-49be-81ac-090f889704a8 req-2b71d4b1-0738-428b-bc21-71a07bb438a8 service nova] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:02.289956 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-98d5239d-8bed-49be-81ac-090f889704a8 req-2b71d4b1-0738-428b-bc21-71a07bb438a8 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:02.290611 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-98d5239d-8bed-49be-81ac-090f889704a8 req-2b71d4b1-0738-428b-bc21-71a07bb438a8 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:02.302117 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.compute.server_external_events [req-98d5239d-8bed-49be-81ac-090f889704a8 req-2b71d4b1-0738-428b-bc21-71a07bb438a8 service nova] Creating event network-vif-deleted:d41182e2-e6f3-405a-a20f-6d8f80e3c0a1 for instance 3a13d400-ebab-4430-bba5-4b5339199be4 on n-h1-863052-2 Nov 01 19:07:02.308058 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [req-98d5239d-8bed-49be-81ac-090f889704a8 req-2b71d4b1-0738-428b-bc21-71a07bb438a8 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032835 Nov 01 19:07:02.309336 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1583/3109] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Nov 1 19:07:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:07:02.315188 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-9fa90bec-1dc0-4df1-80d0-267490235f44 tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:07:02.316227 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-9fa90bec-1dc0-4df1-80d0-267490235f44 tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] [instance: 307ee785-a01d-401c-8be2-b17558e735f3] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:07:02.323031 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-9fa90bec-1dc0-4df1-80d0-267490235f44 tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:02.324263 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-9fa90bec-1dc0-4df1-80d0-267490235f44 tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:02.324846 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-9fa90bec-1dc0-4df1-80d0-267490235f44 tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:02.325639 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-9fa90bec-1dc0-4df1-80d0-267490235f44 tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:02.326188 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-9fa90bec-1dc0-4df1-80d0-267490235f44 tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:02.327984 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-9fa90bec-1dc0-4df1-80d0-267490235f44 tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:02.348871 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-542775cc-bf9f-4876-a829-c09ce36560d8 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '058480d92c9b4ab4af6815d0438a65c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee9dc49b89143f781e4ab30296e4d01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:07:02.356621 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-542775cc-bf9f-4876-a829-c09ce36560d8 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] 10.222.0.13 "GET /compute/v2.1/servers/3a13d400-ebab-4430-bba5-4b5339199be4" status: 200 len: 1294 microversion: 2.1 time: 0.263337 Nov 01 19:07:02.357209 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1527/3110] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:07:02 2022] GET /compute/v2.1/servers/3a13d400-ebab-4430-bba5-4b5339199be4 => generated 1294 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:07:02.370275 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-8a116357-6f92-4bf8-a990-f3e8a02347cf tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:07:02.370891 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-8a116357-6f92-4bf8-a990-f3e8a02347cf tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] [instance: af1071a8-a090-44c9-890c-123ca3ff39f1] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:07:02.391997 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-8a116357-6f92-4bf8-a990-f3e8a02347cf tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:02.392798 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-8a116357-6f92-4bf8-a990-f3e8a02347cf tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:02.393164 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-8a116357-6f92-4bf8-a990-f3e8a02347cf tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:02.394082 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-8a116357-6f92-4bf8-a990-f3e8a02347cf tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:02.398444 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-8a116357-6f92-4bf8-a990-f3e8a02347cf tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:02.399112 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-8a116357-6f92-4bf8-a990-f3e8a02347cf tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:02.463041 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-9fa90bec-1dc0-4df1-80d0-267490235f44 tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb87e6147a6f470391921ac3b7a62f8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6511ea24c4c19a7c5d91535c7288d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:07:02.476129 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-9fa90bec-1dc0-4df1-80d0-267490235f44 tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] 10.222.0.13 "GET /compute/v2.1/servers/307ee785-a01d-401c-8be2-b17558e735f3" status: 200 len: 1483 microversion: 2.1 time: 0.165255 Nov 01 19:07:02.476884 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1584/3111] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:07:02 2022] GET /compute/v2.1/servers/307ee785-a01d-401c-8be2-b17558e735f3 => generated 1483 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:07:02.503711 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-f91695fa-0d09-4dff-b23a-65b96d8324a6 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:07:02.504786 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-f91695fa-0d09-4dff-b23a-65b96d8324a6 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] [instance: f5d5dfa8-4516-428f-bcf5-f0a1174bd14e] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:07:02.515931 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f91695fa-0d09-4dff-b23a-65b96d8324a6 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:02.516728 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f91695fa-0d09-4dff-b23a-65b96d8324a6 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:02.517411 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f91695fa-0d09-4dff-b23a-65b96d8324a6 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:02.518287 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f91695fa-0d09-4dff-b23a-65b96d8324a6 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:02.518904 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f91695fa-0d09-4dff-b23a-65b96d8324a6 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:02.519528 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f91695fa-0d09-4dff-b23a-65b96d8324a6 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:02.949045 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-f91695fa-0d09-4dff-b23a-65b96d8324a6 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113bd8c844ee490b86a68bc7e1e75da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '851785a5f76548898a77d67792888504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:07:02.959890 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-f91695fa-0d09-4dff-b23a-65b96d8324a6 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] 10.222.0.13 "GET /compute/v2.1/servers/f5d5dfa8-4516-428f-bcf5-f0a1174bd14e" status: 200 len: 1292 microversion: 2.1 time: 0.461044 Nov 01 19:07:02.960912 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1585/3112] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:07:02 2022] GET /compute/v2.1/servers/f5d5dfa8-4516-428f-bcf5-f0a1174bd14e => generated 1292 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:07:03.132074 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-45532c86-19d8-45fa-a947-e6ada9a2f48d tempest-AttachSCSIVolumeTestJSON-356336257 tempest-AttachSCSIVolumeTestJSON-356336257-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:07:03.133580 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-45532c86-19d8-45fa-a947-e6ada9a2f48d tempest-AttachSCSIVolumeTestJSON-356336257 tempest-AttachSCSIVolumeTestJSON-356336257-project] [instance: 8a378b79-bd92-4ade-b034-1aaf5c87b74b] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:07:03.146313 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-45532c86-19d8-45fa-a947-e6ada9a2f48d tempest-AttachSCSIVolumeTestJSON-356336257 tempest-AttachSCSIVolumeTestJSON-356336257-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:03.146874 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-45532c86-19d8-45fa-a947-e6ada9a2f48d tempest-AttachSCSIVolumeTestJSON-356336257 tempest-AttachSCSIVolumeTestJSON-356336257-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:03.147317 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-45532c86-19d8-45fa-a947-e6ada9a2f48d tempest-AttachSCSIVolumeTestJSON-356336257 tempest-AttachSCSIVolumeTestJSON-356336257-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:03.148018 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-45532c86-19d8-45fa-a947-e6ada9a2f48d tempest-AttachSCSIVolumeTestJSON-356336257 tempest-AttachSCSIVolumeTestJSON-356336257-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:03.148466 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-45532c86-19d8-45fa-a947-e6ada9a2f48d tempest-AttachSCSIVolumeTestJSON-356336257 tempest-AttachSCSIVolumeTestJSON-356336257-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:03.148906 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-45532c86-19d8-45fa-a947-e6ada9a2f48d tempest-AttachSCSIVolumeTestJSON-356336257 tempest-AttachSCSIVolumeTestJSON-356336257-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:03.385907 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-8a116357-6f92-4bf8-a990-f3e8a02347cf tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '301ed3b9c37449bc9ade378f3c73a768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8807757227574c828dca1947af76659d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:07:03.392286 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-45532c86-19d8-45fa-a947-e6ada9a2f48d tempest-AttachSCSIVolumeTestJSON-356336257 tempest-AttachSCSIVolumeTestJSON-356336257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde7667dbbfd4864a5b0ca8d8b291406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b14142c34d54977ac9eb59962f2a9e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:07:03.410454 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-45532c86-19d8-45fa-a947-e6ada9a2f48d tempest-AttachSCSIVolumeTestJSON-356336257 tempest-AttachSCSIVolumeTestJSON-356336257-project] 10.222.0.13 "GET /compute/v2.1/servers/8a378b79-bd92-4ade-b034-1aaf5c87b74b" status: 200 len: 1558 microversion: 2.1 time: 0.282441 Nov 01 19:07:03.412364 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-8a116357-6f92-4bf8-a990-f3e8a02347cf tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '301ed3b9c37449bc9ade378f3c73a768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8807757227574c828dca1947af76659d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:07:03.424806 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1586/3113] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:07:03 2022] GET /compute/v2.1/servers/8a378b79-bd92-4ade-b034-1aaf5c87b74b => generated 1558 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 19:07:03.425962 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-a6433d83-bf38-4506-bbf1-4699e60707ae tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:07:03.426964 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-a6433d83-bf38-4506-bbf1-4699e60707ae tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] [instance: ba6ffc5c-84a4-40f1-bdc7-f87dde2c99df] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:07:03.437271 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-8a116357-6f92-4bf8-a990-f3e8a02347cf tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '301ed3b9c37449bc9ade378f3c73a768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8807757227574c828dca1947af76659d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:07:03.438861 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-8a116357-6f92-4bf8-a990-f3e8a02347cf tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] 10.222.0.13 "GET /compute/v2.1/servers/af1071a8-a090-44c9-890c-123ca3ff39f1" status: 200 len: 1880 microversion: 2.42 time: 1.072606 Nov 01 19:07:03.440093 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1528/3114] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 19:07:02 2022] GET /compute/v2.1/servers/af1071a8-a090-44c9-890c-123ca3ff39f1 => generated 1880 bytes in 1074 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 19:07:03.449382 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-a6433d83-bf38-4506-bbf1-4699e60707ae tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:03.452124 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-a6433d83-bf38-4506-bbf1-4699e60707ae tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:03.454433 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-a6433d83-bf38-4506-bbf1-4699e60707ae tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:03.457234 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-a6433d83-bf38-4506-bbf1-4699e60707ae tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:03.458716 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-8b8180bb-245d-4105-aed5-0b428d5817da tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:07:03.459851 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-a6433d83-bf38-4506-bbf1-4699e60707ae tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:03.460686 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-a6433d83-bf38-4506-bbf1-4699e60707ae tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:03.461782 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-8b8180bb-245d-4105-aed5-0b428d5817da tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] [instance: 50bf9fd1-c4c6-4d58-80a1-4ce30f50f9bb] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:07:03.474028 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-8b8180bb-245d-4105-aed5-0b428d5817da tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:03.477661 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-8b8180bb-245d-4105-aed5-0b428d5817da tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:03.478192 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-8b8180bb-245d-4105-aed5-0b428d5817da tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:03.479012 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-8b8180bb-245d-4105-aed5-0b428d5817da tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:03.479558 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-8b8180bb-245d-4105-aed5-0b428d5817da tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:03.481359 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-8b8180bb-245d-4105-aed5-0b428d5817da tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:03.624971 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-8b8180bb-245d-4105-aed5-0b428d5817da tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05d6a1722dfa4e959aeb14d601e43b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b5d812eff94e2f89d4705d7e7d5f3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:07:03.640347 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-8b8180bb-245d-4105-aed5-0b428d5817da tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] 10.222.0.13 "GET /compute/v2.1/servers/50bf9fd1-c4c6-4d58-80a1-4ce30f50f9bb" status: 200 len: 1276 microversion: 2.1 time: 0.198428 Nov 01 19:07:03.642095 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1529/3115] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:07:03 2022] GET /compute/v2.1/servers/50bf9fd1-c4c6-4d58-80a1-4ce30f50f9bb => generated 1276 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:07:03.650152 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-090e23be-5e60-4e4d-9e32-5110d794ce5a tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:07:03.650963 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-090e23be-5e60-4e4d-9e32-5110d794ce5a tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] [instance: 3a13d400-ebab-4430-bba5-4b5339199be4] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:07:03.692699 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-090e23be-5e60-4e4d-9e32-5110d794ce5a tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:03.693604 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-090e23be-5e60-4e4d-9e32-5110d794ce5a tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:03.699643 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-090e23be-5e60-4e4d-9e32-5110d794ce5a tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:03.700888 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-090e23be-5e60-4e4d-9e32-5110d794ce5a tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:03.701651 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-090e23be-5e60-4e4d-9e32-5110d794ce5a tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:03.710776 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-090e23be-5e60-4e4d-9e32-5110d794ce5a tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:03.812820 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-090e23be-5e60-4e4d-9e32-5110d794ce5a tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '058480d92c9b4ab4af6815d0438a65c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee9dc49b89143f781e4ab30296e4d01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:07:03.832719 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-090e23be-5e60-4e4d-9e32-5110d794ce5a tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] 10.222.0.13 "GET /compute/v2.1/servers/3a13d400-ebab-4430-bba5-4b5339199be4" status: 200 len: 1294 microversion: 2.1 time: 0.189092 Nov 01 19:07:03.833718 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1530/3116] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:07:03 2022] GET /compute/v2.1/servers/3a13d400-ebab-4430-bba5-4b5339199be4 => generated 1294 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:07:03.862020 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-b5d9e2ea-c8aa-4d80-8bca-d28e7b4a4ff3 tempest-AttachSCSIVolumeTestJSON-356336257 tempest-AttachSCSIVolumeTestJSON-356336257-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:07:03.863218 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-b5d9e2ea-c8aa-4d80-8bca-d28e7b4a4ff3 tempest-AttachSCSIVolumeTestJSON-356336257 tempest-AttachSCSIVolumeTestJSON-356336257-project] [instance: 8a378b79-bd92-4ade-b034-1aaf5c87b74b] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:07:03.878141 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b5d9e2ea-c8aa-4d80-8bca-d28e7b4a4ff3 tempest-AttachSCSIVolumeTestJSON-356336257 tempest-AttachSCSIVolumeTestJSON-356336257-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:03.878553 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b5d9e2ea-c8aa-4d80-8bca-d28e7b4a4ff3 tempest-AttachSCSIVolumeTestJSON-356336257 tempest-AttachSCSIVolumeTestJSON-356336257-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:03.879191 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b5d9e2ea-c8aa-4d80-8bca-d28e7b4a4ff3 tempest-AttachSCSIVolumeTestJSON-356336257 tempest-AttachSCSIVolumeTestJSON-356336257-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:03.880215 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b5d9e2ea-c8aa-4d80-8bca-d28e7b4a4ff3 tempest-AttachSCSIVolumeTestJSON-356336257 tempest-AttachSCSIVolumeTestJSON-356336257-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:03.880706 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b5d9e2ea-c8aa-4d80-8bca-d28e7b4a4ff3 tempest-AttachSCSIVolumeTestJSON-356336257 tempest-AttachSCSIVolumeTestJSON-356336257-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:03.881297 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b5d9e2ea-c8aa-4d80-8bca-d28e7b4a4ff3 tempest-AttachSCSIVolumeTestJSON-356336257 tempest-AttachSCSIVolumeTestJSON-356336257-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:03.915572 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-a6433d83-bf38-4506-bbf1-4699e60707ae tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd2105b0264b48d084d0e79cabff8bc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf4adda91364dab94830347c06e3957', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:07:03.924904 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-a6433d83-bf38-4506-bbf1-4699e60707ae tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd2105b0264b48d084d0e79cabff8bc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf4adda91364dab94830347c06e3957', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:07:03.926358 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-a6433d83-bf38-4506-bbf1-4699e60707ae tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd2105b0264b48d084d0e79cabff8bc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf4adda91364dab94830347c06e3957', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:07:03.927518 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-a6433d83-bf38-4506-bbf1-4699e60707ae tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] 10.222.0.13 "GET /compute/v2.1/servers/ba6ffc5c-84a4-40f1-bdc7-f87dde2c99df" status: 200 len: 1875 microversion: 2.32 time: 0.509228 Nov 01 19:07:03.928086 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1587/3117] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 19:07:03 2022] GET /compute/v2.1/servers/ba6ffc5c-84a4-40f1-bdc7-f87dde2c99df => generated 1875 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 19:07:03.933475 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-be341ba7-5f87-4ef2-9fd7-40c6f6b0cfeb tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:07:03.934948 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-be341ba7-5f87-4ef2-9fd7-40c6f6b0cfeb tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] [instance: 307ee785-a01d-401c-8be2-b17558e735f3] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:07:03.944159 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-be341ba7-5f87-4ef2-9fd7-40c6f6b0cfeb tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:03.945298 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-be341ba7-5f87-4ef2-9fd7-40c6f6b0cfeb tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:03.946492 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-be341ba7-5f87-4ef2-9fd7-40c6f6b0cfeb tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:03.947260 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-be341ba7-5f87-4ef2-9fd7-40c6f6b0cfeb tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:03.947729 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-be341ba7-5f87-4ef2-9fd7-40c6f6b0cfeb tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:03.948159 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-be341ba7-5f87-4ef2-9fd7-40c6f6b0cfeb tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:03.964397 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.wsgi [None req-be341ba7-5f87-4ef2-9fd7-40c6f6b0cfeb tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] HTTP exception thrown: Instance 307ee785-a01d-401c-8be2-b17558e735f3 could not be found. Nov 01 19:07:03.966174 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-be341ba7-5f87-4ef2-9fd7-40c6f6b0cfeb tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] Request method failure captured: Nov 01 19:07:03.966174 n-d-863052-2 devstack@n-api.service[121403]: request: GET /compute/v2.1/servers/307ee785-a01d-401c-8be2-b17558e735f3 HTTP/1.1 Nov 01 19:07:03.966174 n-d-863052-2 devstack@n-api.service[121403]: Accept: application/json Nov 01 19:07:03.966174 n-d-863052-2 devstack@n-api.service[121403]: Accept-Encoding: identity Nov 01 19:07:03.966174 n-d-863052-2 devstack@n-api.service[121403]: Connection: close Nov 01 19:07:03.966174 n-d-863052-2 devstack@n-api.service[121403]: Content-Length: 0 Nov 01 19:07:03.966174 n-d-863052-2 devstack@n-api.service[121403]: Content-Type: application/json Nov 01 19:07:03.966174 n-d-863052-2 devstack@n-api.service[121403]: Host: 10.222.0.13 Nov 01 19:07:03.966174 n-d-863052-2 devstack@n-api.service[121403]: Openstack-System-Scope: None Nov 01 19:07:03.966174 n-d-863052-2 devstack@n-api.service[121403]: User-Agent: python-urllib3/1.26.12 Nov 01 19:07:03.966174 n-d-863052-2 devstack@n-api.service[121403]: X-Auth-Token: gAAAAABjYW3l1zjt15tpRvy62ZUmUnf-XZxpbSJaR0Dz3soyrlzi86jlPzPKEooclquc3opw_GKrdbXdSeyzKLo3vUIm9CiW9UDiYVDmVEaSOvihx8IsbHZQB9Keg8pxW47Z9w5HYtZDEK-2NPCONnIEl4lawojb3pMdAC01mBceYWT19W8flDo Nov 01 19:07:03.966174 n-d-863052-2 devstack@n-api.service[121403]: X-Domain-Id: None Nov 01 19:07:03.966174 n-d-863052-2 devstack@n-api.service[121403]: X-Domain-Name: None Nov 01 19:07:03.966174 n-d-863052-2 devstack@n-api.service[121403]: X-Identity-Status: Confirmed Nov 01 19:07:03.966174 n-d-863052-2 devstack@n-api.service[121403]: X-Is-Admin-Project: True Nov 01 19:07:03.966174 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Domain-Id: default Nov 01 19:07:03.966174 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Domain-Name: Default Nov 01 19:07:03.966174 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Id: eda6511ea24c4c19a7c5d91535c7288d Nov 01 19:07:03.966174 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-1224240465 Nov 01 19:07:03.966174 n-d-863052-2 devstack@n-api.service[121403]: X-Role: member,reader Nov 01 19:07:03.966174 n-d-863052-2 devstack@n-api.service[121403]: X-Roles: member,reader Nov 01 19:07:03.966174 n-d-863052-2 devstack@n-api.service[121403]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/eda6511ea24c4c19a7c5d91535c7288d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/eda6511ea24c4c19a7c5d91535c7288d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_eda6511ea24c4c19a7c5d91535c7288d", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/eda6511ea24c4c19a7c5d91535c7288d"}]}] Nov 01 19:07:03.966174 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-1224240465 Nov 01 19:07:03.966174 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant-Id: eda6511ea24c4c19a7c5d91535c7288d Nov 01 19:07:03.966174 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-1224240465 Nov 01 19:07:03.966174 n-d-863052-2 devstack@n-api.service[121403]: X-User: tempest-FloatingIPsAssociationTestJSON-1224240465-project Nov 01 19:07:03.966174 n-d-863052-2 devstack@n-api.service[121403]: X-User-Domain-Id: default Nov 01 19:07:03.966174 n-d-863052-2 devstack@n-api.service[121403]: X-User-Domain-Name: Default Nov 01 19:07:03.966174 n-d-863052-2 devstack@n-api.service[121403]: X-User-Id: cb87e6147a6f470391921ac3b7a62f8d Nov 01 19:07:03.966174 n-d-863052-2 devstack@n-api.service[121403]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-1224240465-project Nov 01 19:07:03.966174 n-d-863052-2 devstack@n-api.service[121403]: method: > Nov 01 19:07:03.966174 n-d-863052-2 devstack@n-api.service[121403]: exception: Instance 307ee785-a01d-401c-8be2-b17558e735f3 could not be found. Nov 01 19:07:03.966174 n-d-863052-2 devstack@n-api.service[121403]: action_args: {'id': '307ee785-a01d-401c-8be2-b17558e735f3'} Nov 01 19:07:03.966174 n-d-863052-2 devstack@n-api.service[121403]: {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 01 19:07:03.966174 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:07:03.966174 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 01 19:07:03.966174 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 01 19:07:03.966174 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 01 19:07:03.966174 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 01 19:07:03.966174 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 01 19:07:03.966174 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 01 19:07:03.966174 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 01 19:07:03.966174 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 01 19:07:03.966174 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 307ee785-a01d-401c-8be2-b17558e735f3 could not be found. Nov 01 19:07:03.966174 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:07:03.966174 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:07:03.966174 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:07:03.966174 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:07:03.966174 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:07:03.966174 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:07:03.966174 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 01 19:07:03.966174 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 01 19:07:03.966174 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 01 19:07:03.966174 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 01 19:07:03.966174 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 01 19:07:03.966174 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 01 19:07:03.966174 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 01 19:07:03.966174 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 01 19:07:03.966174 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 01 19:07:03.966174 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 01 19:07:03.966174 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 307ee785-a01d-401c-8be2-b17558e735f3 could not be found. Nov 01 19:07:03.966174 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:07:03.966174 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:07:03.975457 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:07:03.975457 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:07:03.975457 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:07:03.975457 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:07:03.975457 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 01 19:07:03.975457 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 01 19:07:03.975457 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 307ee785-a01d-401c-8be2-b17558e735f3 could not be found. Nov 01 19:07:03.975457 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:07:03.975457 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-be341ba7-5f87-4ef2-9fd7-40c6f6b0cfeb tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] Returning 404 to user: Instance 307ee785-a01d-401c-8be2-b17558e735f3 could not be found. {{(pid=121403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 01 19:07:03.975457 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-be341ba7-5f87-4ef2-9fd7-40c6f6b0cfeb tempest-FloatingIPsAssociationTestJSON-1224240465 tempest-FloatingIPsAssociationTestJSON-1224240465-project] 10.222.0.13 "GET /compute/v2.1/servers/307ee785-a01d-401c-8be2-b17558e735f3" status: 404 len: 111 microversion: 2.1 time: 0.038467 Nov 01 19:07:03.975457 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1588/3118] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:07:03 2022] GET /compute/v2.1/servers/307ee785-a01d-401c-8be2-b17558e735f3 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 01 19:07:03.983421 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-a6246b72-68da-4ad6-8dd2-b5f149dfa623 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:07:03.984169 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-a6246b72-68da-4ad6-8dd2-b5f149dfa623 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] [instance: f5d5dfa8-4516-428f-bcf5-f0a1174bd14e] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:07:03.990516 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-a6246b72-68da-4ad6-8dd2-b5f149dfa623 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:03.991111 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-a6246b72-68da-4ad6-8dd2-b5f149dfa623 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:03.991639 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-a6246b72-68da-4ad6-8dd2-b5f149dfa623 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:03.992432 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-a6246b72-68da-4ad6-8dd2-b5f149dfa623 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:03.993003 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-a6246b72-68da-4ad6-8dd2-b5f149dfa623 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:03.993531 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-a6246b72-68da-4ad6-8dd2-b5f149dfa623 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:04.064537 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-b5d9e2ea-c8aa-4d80-8bca-d28e7b4a4ff3 tempest-AttachSCSIVolumeTestJSON-356336257 tempest-AttachSCSIVolumeTestJSON-356336257-project] 10.222.0.13 "GET /compute/v2.1/servers/8a378b79-bd92-4ade-b034-1aaf5c87b74b/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.214579 Nov 01 19:07:04.065383 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1531/3119] 10.222.0.13 () {58 vars in 1275 bytes} [Tue Nov 1 19:07:03 2022] GET /compute/v2.1/servers/8a378b79-bd92-4ade-b034-1aaf5c87b74b/os-interface => generated 285 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:07:04.298927 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-a6246b72-68da-4ad6-8dd2-b5f149dfa623 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113bd8c844ee490b86a68bc7e1e75da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '851785a5f76548898a77d67792888504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:07:04.308537 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-a6246b72-68da-4ad6-8dd2-b5f149dfa623 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] 10.222.0.13 "GET /compute/v2.1/servers/f5d5dfa8-4516-428f-bcf5-f0a1174bd14e" status: 200 len: 1292 microversion: 2.1 time: 0.328637 Nov 01 19:07:04.326225 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1589/3120] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:07:03 2022] GET /compute/v2.1/servers/f5d5dfa8-4516-428f-bcf5-f0a1174bd14e => generated 1292 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 19:07:04.366724 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [req-1c4e1784-9980-42f4-ac44-2ad1a58d9e53 req-ac218577-483e-4987-9e2b-f9bf0dbf5cae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "307ee785-a01d-401c-8be2-b17558e735f3", "name": "network-vif-deleted", "tag": "d65b5fcd-5bb6-4feb-b4bf-95734bcb3072"}]} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:07:04.375446 n-d-863052-2 devstack@n-api.service[121402]: DEBUG dbcounter [-] [121402] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=121402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 19:07:04.381168 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-1c4e1784-9980-42f4-ac44-2ad1a58d9e53 req-ac218577-483e-4987-9e2b-f9bf0dbf5cae service nova] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:04.381656 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-1c4e1784-9980-42f4-ac44-2ad1a58d9e53 req-ac218577-483e-4987-9e2b-f9bf0dbf5cae service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:04.382098 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-1c4e1784-9980-42f4-ac44-2ad1a58d9e53 req-ac218577-483e-4987-9e2b-f9bf0dbf5cae service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:04.395597 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.compute.server_external_events [req-1c4e1784-9980-42f4-ac44-2ad1a58d9e53 req-ac218577-483e-4987-9e2b-f9bf0dbf5cae service nova] Creating event network-vif-deleted:d65b5fcd-5bb6-4feb-b4bf-95734bcb3072 for instance 307ee785-a01d-401c-8be2-b17558e735f3 on n-h2-863052-2 Nov 01 19:07:04.401282 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [req-1c4e1784-9980-42f4-ac44-2ad1a58d9e53 req-ac218577-483e-4987-9e2b-f9bf0dbf5cae service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043013 Nov 01 19:07:04.402002 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1532/3121] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Nov 1 19:07:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:07:04.467894 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-a02fc6e8-f319-4c53-9ceb-a88faeecc266 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:07:04.469879 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-a02fc6e8-f319-4c53-9ceb-a88faeecc266 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] [instance: af1071a8-a090-44c9-890c-123ca3ff39f1] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:07:04.481994 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-a02fc6e8-f319-4c53-9ceb-a88faeecc266 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:04.485228 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-a02fc6e8-f319-4c53-9ceb-a88faeecc266 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:04.485228 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-a02fc6e8-f319-4c53-9ceb-a88faeecc266 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:04.485228 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-a02fc6e8-f319-4c53-9ceb-a88faeecc266 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:04.485228 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-a02fc6e8-f319-4c53-9ceb-a88faeecc266 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:04.493350 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-a02fc6e8-f319-4c53-9ceb-a88faeecc266 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:04.672374 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-4dbc0030-e2f4-4f7c-a618-875054482f9f tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:07:04.673701 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-4dbc0030-e2f4-4f7c-a618-875054482f9f tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] [instance: 50bf9fd1-c4c6-4d58-80a1-4ce30f50f9bb] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:07:04.689326 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-4dbc0030-e2f4-4f7c-a618-875054482f9f tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:04.691819 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-4dbc0030-e2f4-4f7c-a618-875054482f9f tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:04.692319 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-4dbc0030-e2f4-4f7c-a618-875054482f9f tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:04.694025 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-4dbc0030-e2f4-4f7c-a618-875054482f9f tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:04.694518 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-4dbc0030-e2f4-4f7c-a618-875054482f9f tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:04.694953 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-4dbc0030-e2f4-4f7c-a618-875054482f9f tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:04.957891 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-a02fc6e8-f319-4c53-9ceb-a88faeecc266 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '301ed3b9c37449bc9ade378f3c73a768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8807757227574c828dca1947af76659d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:07:04.972572 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-a02fc6e8-f319-4c53-9ceb-a88faeecc266 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '301ed3b9c37449bc9ade378f3c73a768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8807757227574c828dca1947af76659d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:07:04.975454 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-a02fc6e8-f319-4c53-9ceb-a88faeecc266 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '301ed3b9c37449bc9ade378f3c73a768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8807757227574c828dca1947af76659d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:07:04.977269 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-a02fc6e8-f319-4c53-9ceb-a88faeecc266 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] 10.222.0.13 "GET /compute/v2.1/servers/af1071a8-a090-44c9-890c-123ca3ff39f1" status: 200 len: 2838 microversion: 2.42 time: 0.514142 Nov 01 19:07:04.978827 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1590/3122] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 19:07:04 2022] GET /compute/v2.1/servers/af1071a8-a090-44c9-890c-123ca3ff39f1 => generated 2838 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 19:07:04.985673 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [req-592f6d69-2fd8-4c9f-b4b1-219625839aaf req-27d12ee2-46a8-47c9-9d57-09a5903de103 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f5d5dfa8-4516-428f-bcf5-f0a1174bd14e", "name": "network-vif-plugged", "status": "completed", "tag": "4db67a8c-a091-40b4-adb0-8c3b246af143"}]} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:07:04.997351 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-592f6d69-2fd8-4c9f-b4b1-219625839aaf req-27d12ee2-46a8-47c9-9d57-09a5903de103 service nova] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:04.998067 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-592f6d69-2fd8-4c9f-b4b1-219625839aaf req-27d12ee2-46a8-47c9-9d57-09a5903de103 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:04.998690 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-592f6d69-2fd8-4c9f-b4b1-219625839aaf req-27d12ee2-46a8-47c9-9d57-09a5903de103 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:05.045856 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.compute.server_external_events [req-592f6d69-2fd8-4c9f-b4b1-219625839aaf req-27d12ee2-46a8-47c9-9d57-09a5903de103 service nova] Creating event network-vif-plugged:4db67a8c-a091-40b4-adb0-8c3b246af143 for instance f5d5dfa8-4516-428f-bcf5-f0a1174bd14e on n-h2-863052-2 Nov 01 19:07:05.053022 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [req-592f6d69-2fd8-4c9f-b4b1-219625839aaf req-27d12ee2-46a8-47c9-9d57-09a5903de103 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071571 Nov 01 19:07:05.062695 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1591/3123] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Nov 1 19:07:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:07:05.071486 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-b66aacee-d9b4-4595-8ee8-76d5856c31f0 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:07:05.073216 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-b66aacee-d9b4-4595-8ee8-76d5856c31f0 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] [instance: 3a13d400-ebab-4430-bba5-4b5339199be4] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:07:05.083069 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-b66aacee-d9b4-4595-8ee8-76d5856c31f0 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:05.083844 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-b66aacee-d9b4-4595-8ee8-76d5856c31f0 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:05.084695 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-b66aacee-d9b4-4595-8ee8-76d5856c31f0 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:05.085646 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-b66aacee-d9b4-4595-8ee8-76d5856c31f0 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:05.086434 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-b66aacee-d9b4-4595-8ee8-76d5856c31f0 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:05.087677 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-b66aacee-d9b4-4595-8ee8-76d5856c31f0 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:05.206135 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-b66aacee-d9b4-4595-8ee8-76d5856c31f0 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '058480d92c9b4ab4af6815d0438a65c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee9dc49b89143f781e4ab30296e4d01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:07:05.220384 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-b66aacee-d9b4-4595-8ee8-76d5856c31f0 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] 10.222.0.13 "GET /compute/v2.1/servers/3a13d400-ebab-4430-bba5-4b5339199be4" status: 200 len: 1294 microversion: 2.1 time: 0.155847 Nov 01 19:07:05.221303 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1592/3124] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:07:05 2022] GET /compute/v2.1/servers/3a13d400-ebab-4430-bba5-4b5339199be4 => generated 1294 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:07:05.228508 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-2a04dc2c-f771-4162-8185-42b7f9dd99dc tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:07:05.230152 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-2a04dc2c-f771-4162-8185-42b7f9dd99dc tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] [instance: ba6ffc5c-84a4-40f1-bdc7-f87dde2c99df] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:07:05.238870 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-2a04dc2c-f771-4162-8185-42b7f9dd99dc tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:05.243707 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-2a04dc2c-f771-4162-8185-42b7f9dd99dc tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:05.244169 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-2a04dc2c-f771-4162-8185-42b7f9dd99dc tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:05.245201 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-2a04dc2c-f771-4162-8185-42b7f9dd99dc tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:05.245827 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-2a04dc2c-f771-4162-8185-42b7f9dd99dc tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:05.246264 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-2a04dc2c-f771-4162-8185-42b7f9dd99dc tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:05.597248 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-4dbc0030-e2f4-4f7c-a618-875054482f9f tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05d6a1722dfa4e959aeb14d601e43b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b5d812eff94e2f89d4705d7e7d5f3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:07:05.617482 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-4dbc0030-e2f4-4f7c-a618-875054482f9f tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] 10.222.0.13 "GET /compute/v2.1/servers/50bf9fd1-c4c6-4d58-80a1-4ce30f50f9bb" status: 200 len: 1318 microversion: 2.1 time: 0.951351 Nov 01 19:07:05.618628 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1533/3125] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:07:04 2022] GET /compute/v2.1/servers/50bf9fd1-c4c6-4d58-80a1-4ce30f50f9bb => generated 1318 bytes in 954 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:07:05.624502 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-73e74d57-4686-417e-a7cf-095d6d073cbc tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:07:05.625568 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-73e74d57-4686-417e-a7cf-095d6d073cbc tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] [instance: af1071a8-a090-44c9-890c-123ca3ff39f1] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:07:05.633504 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-73e74d57-4686-417e-a7cf-095d6d073cbc tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:05.634326 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-73e74d57-4686-417e-a7cf-095d6d073cbc tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:05.635078 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-73e74d57-4686-417e-a7cf-095d6d073cbc tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:05.636831 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-73e74d57-4686-417e-a7cf-095d6d073cbc tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:05.637433 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-73e74d57-4686-417e-a7cf-095d6d073cbc tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:05.637975 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-73e74d57-4686-417e-a7cf-095d6d073cbc tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:05.656262 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-2a04dc2c-f771-4162-8185-42b7f9dd99dc tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd2105b0264b48d084d0e79cabff8bc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf4adda91364dab94830347c06e3957', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:07:05.666811 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-2a04dc2c-f771-4162-8185-42b7f9dd99dc tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd2105b0264b48d084d0e79cabff8bc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf4adda91364dab94830347c06e3957', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:07:05.672708 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-2a04dc2c-f771-4162-8185-42b7f9dd99dc tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd2105b0264b48d084d0e79cabff8bc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf4adda91364dab94830347c06e3957', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:07:05.673989 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-2a04dc2c-f771-4162-8185-42b7f9dd99dc tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] 10.222.0.13 "GET /compute/v2.1/servers/ba6ffc5c-84a4-40f1-bdc7-f87dde2c99df" status: 200 len: 1875 microversion: 2.32 time: 0.451570 Nov 01 19:07:05.674552 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1593/3126] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 19:07:05 2022] GET /compute/v2.1/servers/ba6ffc5c-84a4-40f1-bdc7-f87dde2c99df => generated 1875 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 19:07:05.705063 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-84f8812c-5b85-4710-962f-4abdede305b2 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:07:05.707015 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-84f8812c-5b85-4710-962f-4abdede305b2 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] [instance: f5d5dfa8-4516-428f-bcf5-f0a1174bd14e] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:07:05.722029 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-84f8812c-5b85-4710-962f-4abdede305b2 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:05.724832 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-84f8812c-5b85-4710-962f-4abdede305b2 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:05.725453 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-84f8812c-5b85-4710-962f-4abdede305b2 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:05.726317 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-84f8812c-5b85-4710-962f-4abdede305b2 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:05.727213 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-84f8812c-5b85-4710-962f-4abdede305b2 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:05.727794 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-84f8812c-5b85-4710-962f-4abdede305b2 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:05.951573 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-73e74d57-4686-417e-a7cf-095d6d073cbc tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] 10.222.0.13 "GET /compute/v2.1/servers/af1071a8-a090-44c9-890c-123ca3ff39f1/os-interface" status: 200 len: 1832 microversion: 2.42 time: 0.331458 Nov 01 19:07:05.953879 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1534/3127] 10.222.0.13 () {60 vars in 1316 bytes} [Tue Nov 1 19:07:05 2022] GET /compute/v2.1/servers/af1071a8-a090-44c9-890c-123ca3ff39f1/os-interface => generated 1832 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 19:07:06.137570 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-84f8812c-5b85-4710-962f-4abdede305b2 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113bd8c844ee490b86a68bc7e1e75da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '851785a5f76548898a77d67792888504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:07:06.147907 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-84f8812c-5b85-4710-962f-4abdede305b2 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] 10.222.0.13 "GET /compute/v2.1/servers/f5d5dfa8-4516-428f-bcf5-f0a1174bd14e" status: 200 len: 1292 microversion: 2.1 time: 0.472219 Nov 01 19:07:06.149271 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1594/3128] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:07:05 2022] GET /compute/v2.1/servers/f5d5dfa8-4516-428f-bcf5-f0a1174bd14e => generated 1292 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:07:06.245915 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-d3622a67-02cf-4c75-bf14-403f962b7768 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:07:06.246567 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-d3622a67-02cf-4c75-bf14-403f962b7768 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] [instance: 3a13d400-ebab-4430-bba5-4b5339199be4] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:07:06.257493 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-d3622a67-02cf-4c75-bf14-403f962b7768 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:06.258000 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-d3622a67-02cf-4c75-bf14-403f962b7768 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:06.261969 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-d3622a67-02cf-4c75-bf14-403f962b7768 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:06.264004 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-d3622a67-02cf-4c75-bf14-403f962b7768 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:06.266386 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-d3622a67-02cf-4c75-bf14-403f962b7768 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:06.269108 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-d3622a67-02cf-4c75-bf14-403f962b7768 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:06.298584 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.wsgi [None req-d3622a67-02cf-4c75-bf14-403f962b7768 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] HTTP exception thrown: Instance 3a13d400-ebab-4430-bba5-4b5339199be4 could not be found. Nov 01 19:07:06.300244 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-d3622a67-02cf-4c75-bf14-403f962b7768 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Request method failure captured: Nov 01 19:07:06.300244 n-d-863052-2 devstack@n-api.service[121402]: request: GET /compute/v2.1/servers/3a13d400-ebab-4430-bba5-4b5339199be4 HTTP/1.1 Nov 01 19:07:06.300244 n-d-863052-2 devstack@n-api.service[121402]: Accept: application/json Nov 01 19:07:06.300244 n-d-863052-2 devstack@n-api.service[121402]: Accept-Encoding: identity Nov 01 19:07:06.300244 n-d-863052-2 devstack@n-api.service[121402]: Connection: close Nov 01 19:07:06.300244 n-d-863052-2 devstack@n-api.service[121402]: Content-Length: 0 Nov 01 19:07:06.300244 n-d-863052-2 devstack@n-api.service[121402]: Content-Type: application/json Nov 01 19:07:06.300244 n-d-863052-2 devstack@n-api.service[121402]: Host: 10.222.0.13 Nov 01 19:07:06.300244 n-d-863052-2 devstack@n-api.service[121402]: Openstack-System-Scope: None Nov 01 19:07:06.300244 n-d-863052-2 devstack@n-api.service[121402]: User-Agent: python-urllib3/1.26.12 Nov 01 19:07:06.300244 n-d-863052-2 devstack@n-api.service[121402]: X-Auth-Token: gAAAAABjYW3ByfBI9VCjWikZSFUz_hPClqqMancoCxnwBX6xqaMeeugycqMQyEPQybXqoeO46TFhJ9TITtoJFiSbS9Ry6pB9Kueb-hoVnQBV0e7qQWXwvcx4eB_AomP3ogOCXvqhfUnxVmmooBEoQbpvBIMsXQEjVVdPObNP8WS9oGjTsTTTO4o Nov 01 19:07:06.300244 n-d-863052-2 devstack@n-api.service[121402]: X-Domain-Id: None Nov 01 19:07:06.300244 n-d-863052-2 devstack@n-api.service[121402]: X-Domain-Name: None Nov 01 19:07:06.300244 n-d-863052-2 devstack@n-api.service[121402]: X-Identity-Status: Confirmed Nov 01 19:07:06.300244 n-d-863052-2 devstack@n-api.service[121402]: X-Is-Admin-Project: True Nov 01 19:07:06.300244 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Domain-Id: default Nov 01 19:07:06.300244 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Domain-Name: Default Nov 01 19:07:06.300244 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Id: 1ee9dc49b89143f781e4ab30296e4d01 Nov 01 19:07:06.300244 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Name: tempest-DeleteServersTestJSON-412339701 Nov 01 19:07:06.300244 n-d-863052-2 devstack@n-api.service[121402]: X-Role: member,reader Nov 01 19:07:06.300244 n-d-863052-2 devstack@n-api.service[121402]: X-Roles: member,reader Nov 01 19:07:06.300244 n-d-863052-2 devstack@n-api.service[121402]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/1ee9dc49b89143f781e4ab30296e4d01"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/1ee9dc49b89143f781e4ab30296e4d01"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_1ee9dc49b89143f781e4ab30296e4d01", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/1ee9dc49b89143f781e4ab30296e4d01"}]}] Nov 01 19:07:06.300244 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant: tempest-DeleteServersTestJSON-412339701 Nov 01 19:07:06.300244 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant-Id: 1ee9dc49b89143f781e4ab30296e4d01 Nov 01 19:07:06.300244 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant-Name: tempest-DeleteServersTestJSON-412339701 Nov 01 19:07:06.300244 n-d-863052-2 devstack@n-api.service[121402]: X-User: tempest-DeleteServersTestJSON-412339701-project Nov 01 19:07:06.300244 n-d-863052-2 devstack@n-api.service[121402]: X-User-Domain-Id: default Nov 01 19:07:06.300244 n-d-863052-2 devstack@n-api.service[121402]: X-User-Domain-Name: Default Nov 01 19:07:06.300244 n-d-863052-2 devstack@n-api.service[121402]: X-User-Id: 058480d92c9b4ab4af6815d0438a65c7 Nov 01 19:07:06.300244 n-d-863052-2 devstack@n-api.service[121402]: X-User-Name: tempest-DeleteServersTestJSON-412339701-project Nov 01 19:07:06.300244 n-d-863052-2 devstack@n-api.service[121402]: method: > Nov 01 19:07:06.300244 n-d-863052-2 devstack@n-api.service[121402]: exception: Instance 3a13d400-ebab-4430-bba5-4b5339199be4 could not be found. Nov 01 19:07:06.300244 n-d-863052-2 devstack@n-api.service[121402]: action_args: {'id': '3a13d400-ebab-4430-bba5-4b5339199be4'} Nov 01 19:07:06.300244 n-d-863052-2 devstack@n-api.service[121402]: {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 01 19:07:06.300244 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:07:06.300244 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 01 19:07:06.300244 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 01 19:07:06.300244 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 01 19:07:06.300244 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 01 19:07:06.300244 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 01 19:07:06.300244 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 01 19:07:06.300244 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 01 19:07:06.300244 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 01 19:07:06.300244 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3a13d400-ebab-4430-bba5-4b5339199be4 could not be found. Nov 01 19:07:06.300244 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:07:06.300244 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:07:06.300244 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:07:06.300244 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:07:06.300244 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:07:06.300244 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:07:06.300244 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 01 19:07:06.300244 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 01 19:07:06.300244 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 01 19:07:06.300244 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 01 19:07:06.300244 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 01 19:07:06.300244 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 01 19:07:06.300244 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 01 19:07:06.300244 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 01 19:07:06.300244 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 01 19:07:06.300244 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 01 19:07:06.300244 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3a13d400-ebab-4430-bba5-4b5339199be4 could not be found. Nov 01 19:07:06.300244 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:07:06.300244 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:07:06.300244 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:07:06.305147 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:07:06.305147 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:07:06.305147 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:07:06.305147 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 01 19:07:06.305147 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 01 19:07:06.305147 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3a13d400-ebab-4430-bba5-4b5339199be4 could not be found. Nov 01 19:07:06.305147 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:07:06.305147 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-d3622a67-02cf-4c75-bf14-403f962b7768 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Returning 404 to user: Instance 3a13d400-ebab-4430-bba5-4b5339199be4 could not be found. {{(pid=121402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 01 19:07:06.305147 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-d3622a67-02cf-4c75-bf14-403f962b7768 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] 10.222.0.13 "GET /compute/v2.1/servers/3a13d400-ebab-4430-bba5-4b5339199be4" status: 404 len: 111 microversion: 2.1 time: 0.060404 Nov 01 19:07:06.308734 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1535/3129] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:07:06 2022] GET /compute/v2.1/servers/3a13d400-ebab-4430-bba5-4b5339199be4 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 01 19:07:06.357714 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-2e6ab3ad-0dd4-408a-9d9e-c4194be984df tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1802674489", "imageRef": "2d4a0047-1b9e-445f-8af8-1b5c9d93e881", "flavorRef": "452", "networks": [{"uuid": "6da1da8d-6719-4a9a-851f-308df797b88a"}]}} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:07:06.424888 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.network.neutron [None req-2e6ab3ad-0dd4-408a-9d9e-c4194be984df tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] validate_networks() for [('6da1da8d-6719-4a9a-851f-308df797b88a', None, None, None, None, None)] {{(pid=121403) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 01 19:07:06.442721 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [req-a7b4998b-558b-41ee-a16b-fa6be085b205 req-bc605d9c-f243-425e-83b6-2817013d7f23 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "674f7fae-6219-4e5e-b85a-2647b948807e", "tag": "e78f185e-94a2-461b-9824-b0b788dd62e1"}]} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:07:06.461916 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-a7b4998b-558b-41ee-a16b-fa6be085b205 req-bc605d9c-f243-425e-83b6-2817013d7f23 service nova] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:06.462408 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-a7b4998b-558b-41ee-a16b-fa6be085b205 req-bc605d9c-f243-425e-83b6-2817013d7f23 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:06.462849 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-a7b4998b-558b-41ee-a16b-fa6be085b205 req-bc605d9c-f243-425e-83b6-2817013d7f23 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:06.502050 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.compute.server_external_events [req-a7b4998b-558b-41ee-a16b-fa6be085b205 req-bc605d9c-f243-425e-83b6-2817013d7f23 service nova] Creating event network-changed:e78f185e-94a2-461b-9824-b0b788dd62e1 for instance 674f7fae-6219-4e5e-b85a-2647b948807e on n-h1-863052-2 Nov 01 19:07:06.512371 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [req-a7b4998b-558b-41ee-a16b-fa6be085b205 req-bc605d9c-f243-425e-83b6-2817013d7f23 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073827 Nov 01 19:07:06.516798 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1536/3130] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Nov 1 19:07:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 01 19:07:06.649039 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-5eaab656-72b1-4e2d-84cb-707426d4da66 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:07:06.649727 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-5eaab656-72b1-4e2d-84cb-707426d4da66 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] [instance: 50bf9fd1-c4c6-4d58-80a1-4ce30f50f9bb] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:07:06.660635 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-5eaab656-72b1-4e2d-84cb-707426d4da66 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:06.662051 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-5eaab656-72b1-4e2d-84cb-707426d4da66 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:06.662500 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-5eaab656-72b1-4e2d-84cb-707426d4da66 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:06.663224 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-5eaab656-72b1-4e2d-84cb-707426d4da66 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:06.663683 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-5eaab656-72b1-4e2d-84cb-707426d4da66 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:06.664113 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-5eaab656-72b1-4e2d-84cb-707426d4da66 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:07.024111 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-5eaab656-72b1-4e2d-84cb-707426d4da66 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05d6a1722dfa4e959aeb14d601e43b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b5d812eff94e2f89d4705d7e7d5f3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:07:07.033325 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-5eaab656-72b1-4e2d-84cb-707426d4da66 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] 10.222.0.13 "GET /compute/v2.1/servers/50bf9fd1-c4c6-4d58-80a1-4ce30f50f9bb" status: 200 len: 1318 microversion: 2.1 time: 0.388950 Nov 01 19:07:07.034023 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1537/3131] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:07:06 2022] GET /compute/v2.1/servers/50bf9fd1-c4c6-4d58-80a1-4ce30f50f9bb => generated 1318 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 19:07:07.039006 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-24a41200-ff65-4ac4-b980-ec180c624e95 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:07:07.039615 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-24a41200-ff65-4ac4-b980-ec180c624e95 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] [instance: ba6ffc5c-84a4-40f1-bdc7-f87dde2c99df] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:07:07.056612 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-24a41200-ff65-4ac4-b980-ec180c624e95 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:07.057416 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-24a41200-ff65-4ac4-b980-ec180c624e95 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:07.058564 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-24a41200-ff65-4ac4-b980-ec180c624e95 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:07.059435 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-24a41200-ff65-4ac4-b980-ec180c624e95 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:07.060057 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-24a41200-ff65-4ac4-b980-ec180c624e95 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:07.061590 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-24a41200-ff65-4ac4-b980-ec180c624e95 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:07.480986 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-24a41200-ff65-4ac4-b980-ec180c624e95 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd2105b0264b48d084d0e79cabff8bc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf4adda91364dab94830347c06e3957', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:07:07.505879 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-24a41200-ff65-4ac4-b980-ec180c624e95 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd2105b0264b48d084d0e79cabff8bc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf4adda91364dab94830347c06e3957', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:07:07.510864 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-24a41200-ff65-4ac4-b980-ec180c624e95 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd2105b0264b48d084d0e79cabff8bc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf4adda91364dab94830347c06e3957', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:07:07.512681 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-24a41200-ff65-4ac4-b980-ec180c624e95 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] 10.222.0.13 "GET /compute/v2.1/servers/ba6ffc5c-84a4-40f1-bdc7-f87dde2c99df" status: 200 len: 1875 microversion: 2.32 time: 0.476969 Nov 01 19:07:07.514204 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1538/3132] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 19:07:07 2022] GET /compute/v2.1/servers/ba6ffc5c-84a4-40f1-bdc7-f87dde2c99df => generated 1875 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 19:07:07.525408 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-a362ee74-be2e-4855-9457-03156bfab129 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:07:07.526040 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-a362ee74-be2e-4855-9457-03156bfab129 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] [instance: f5d5dfa8-4516-428f-bcf5-f0a1174bd14e] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:07:07.537932 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-a362ee74-be2e-4855-9457-03156bfab129 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:07.538432 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-a362ee74-be2e-4855-9457-03156bfab129 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:07.551942 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-a362ee74-be2e-4855-9457-03156bfab129 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:07.563417 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-a362ee74-be2e-4855-9457-03156bfab129 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:07.563970 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-a362ee74-be2e-4855-9457-03156bfab129 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:07.564426 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-a362ee74-be2e-4855-9457-03156bfab129 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:07.829577 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-a362ee74-be2e-4855-9457-03156bfab129 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113bd8c844ee490b86a68bc7e1e75da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '851785a5f76548898a77d67792888504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:07:07.842882 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-a362ee74-be2e-4855-9457-03156bfab129 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] 10.222.0.13 "GET /compute/v2.1/servers/f5d5dfa8-4516-428f-bcf5-f0a1174bd14e" status: 200 len: 1473 microversion: 2.1 time: 0.326773 Nov 01 19:07:07.844091 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1539/3133] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:07:07 2022] GET /compute/v2.1/servers/f5d5dfa8-4516-428f-bcf5-f0a1174bd14e => generated 1473 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:07:07.941775 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-42bb37b4-ebb2-4082-a474-fed35b90ae8a tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-437400561", "imageRef": "2d4a0047-1b9e-445f-8af8-1b5c9d93e881", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:07:08.038098 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.network.neutron [None req-42bb37b4-ebb2-4082-a474-fed35b90ae8a tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] validate_networks() for [('346d9303-d6bc-4555-85be-95ee31a2d9cd', None, None, None, None, None)] {{(pid=121402) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 01 19:07:08.179148 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.virt.hardware [None req-2e6ab3ad-0dd4-408a-9d9e-c4194be984df tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Flavor limits 0:0:0 {{(pid=121403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 01 19:07:08.182550 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.virt.hardware [None req-2e6ab3ad-0dd4-408a-9d9e-c4194be984df tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Image limits 0:0:0 {{(pid=121403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 01 19:07:08.183939 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.virt.hardware [None req-2e6ab3ad-0dd4-408a-9d9e-c4194be984df tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Flavor pref 0:0:0 {{(pid=121403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 01 19:07:08.184535 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.virt.hardware [None req-2e6ab3ad-0dd4-408a-9d9e-c4194be984df tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Image pref 0:0:0 {{(pid=121403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 01 19:07:08.185507 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.virt.hardware [None req-2e6ab3ad-0dd4-408a-9d9e-c4194be984df tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 01 19:07:08.206077 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-2e6ab3ad-0dd4-408a-9d9e-c4194be984df tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:08.209259 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-2e6ab3ad-0dd4-408a-9d9e-c4194be984df tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:08.209881 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-2e6ab3ad-0dd4-408a-9d9e-c4194be984df tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:08.211514 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-2e6ab3ad-0dd4-408a-9d9e-c4194be984df tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:08.212168 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-2e6ab3ad-0dd4-408a-9d9e-c4194be984df tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:08.213555 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-2e6ab3ad-0dd4-408a-9d9e-c4194be984df tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:08.243887 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.quota [None req-2e6ab3ad-0dd4-408a-9d9e-c4194be984df tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Getting quotas for project 1ee9dc49b89143f781e4ab30296e4d01. Resources: {'cores', 'ram', 'instances'} {{(pid=121403) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 01 19:07:08.250522 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.quota [None req-2e6ab3ad-0dd4-408a-9d9e-c4194be984df tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Getting quotas for user 058480d92c9b4ab4af6815d0438a65c7 and project 1ee9dc49b89143f781e4ab30296e4d01. Resources: {'cores', 'ram', 'instances'} {{(pid=121403) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 01 19:07:08.264845 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-2e6ab3ad-0dd4-408a-9d9e-c4194be984df tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Going to run 1 instances... {{(pid=121403) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 01 19:07:08.267422 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-2e6ab3ad-0dd4-408a-9d9e-c4194be984df tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] [instance: d99a7f68-99ff-4c70-9e81-1c9faf6ebb7f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2d4a0047-1b9e-445f-8af8-1b5c9d93e881',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121403) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 01 19:07:08.321155 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-2e6ab3ad-0dd4-408a-9d9e-c4194be984df tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.967824 Nov 01 19:07:08.322421 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1595/3134] 10.222.0.13 () {60 vars in 1147 bytes} [Tue Nov 1 19:07:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 1970 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 01 19:07:08.327708 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-5ad0492f-5358-41bd-a1e7-561cd23065e2 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:07:08.328509 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-5ad0492f-5358-41bd-a1e7-561cd23065e2 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] [instance: 50bf9fd1-c4c6-4d58-80a1-4ce30f50f9bb] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:07:08.341599 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-5ad0492f-5358-41bd-a1e7-561cd23065e2 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:08.342338 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-5ad0492f-5358-41bd-a1e7-561cd23065e2 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:08.342930 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-5ad0492f-5358-41bd-a1e7-561cd23065e2 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:08.343796 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-5ad0492f-5358-41bd-a1e7-561cd23065e2 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:08.344520 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-5ad0492f-5358-41bd-a1e7-561cd23065e2 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:08.345125 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-5ad0492f-5358-41bd-a1e7-561cd23065e2 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:08.665268 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-5ad0492f-5358-41bd-a1e7-561cd23065e2 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05d6a1722dfa4e959aeb14d601e43b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b5d812eff94e2f89d4705d7e7d5f3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:07:08.673175 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-5ad0492f-5358-41bd-a1e7-561cd23065e2 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] 10.222.0.13 "GET /compute/v2.1/servers/50bf9fd1-c4c6-4d58-80a1-4ce30f50f9bb" status: 200 len: 1318 microversion: 2.1 time: 0.349535 Nov 01 19:07:08.673758 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1596/3135] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:07:08 2022] GET /compute/v2.1/servers/50bf9fd1-c4c6-4d58-80a1-4ce30f50f9bb => generated 1318 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:07:08.687138 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-4d309d93-236a-4474-a3dd-dd097965a803 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:07:08.690682 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-4d309d93-236a-4474-a3dd-dd097965a803 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] [instance: d99a7f68-99ff-4c70-9e81-1c9faf6ebb7f] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:07:08.733814 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.virt.hardware [None req-42bb37b4-ebb2-4082-a474-fed35b90ae8a tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Flavor limits 0:0:0 {{(pid=121402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 01 19:07:08.734934 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.virt.hardware [None req-42bb37b4-ebb2-4082-a474-fed35b90ae8a tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Image limits 0:0:0 {{(pid=121402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 01 19:07:08.735631 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.virt.hardware [None req-42bb37b4-ebb2-4082-a474-fed35b90ae8a tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Flavor pref 0:0:0 {{(pid=121402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 01 19:07:08.736417 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.virt.hardware [None req-42bb37b4-ebb2-4082-a474-fed35b90ae8a tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Image pref 0:0:0 {{(pid=121402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 01 19:07:08.737007 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.virt.hardware [None req-42bb37b4-ebb2-4082-a474-fed35b90ae8a tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 01 19:07:08.755482 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-42bb37b4-ebb2-4082-a474-fed35b90ae8a tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:08.756470 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-42bb37b4-ebb2-4082-a474-fed35b90ae8a tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:08.758142 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-42bb37b4-ebb2-4082-a474-fed35b90ae8a tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:08.759863 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-42bb37b4-ebb2-4082-a474-fed35b90ae8a tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:08.761732 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-42bb37b4-ebb2-4082-a474-fed35b90ae8a tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:08.762172 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-42bb37b4-ebb2-4082-a474-fed35b90ae8a tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:08.796544 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.quota [None req-42bb37b4-ebb2-4082-a474-fed35b90ae8a tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Getting quotas for project 851785a5f76548898a77d67792888504. Resources: {'cores', 'ram', 'instances'} {{(pid=121402) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 01 19:07:08.804842 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.quota [None req-42bb37b4-ebb2-4082-a474-fed35b90ae8a tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Getting quotas for user 113bd8c844ee490b86a68bc7e1e75da3 and project 851785a5f76548898a77d67792888504. Resources: {'cores', 'ram', 'instances'} {{(pid=121402) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 01 19:07:08.823268 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-42bb37b4-ebb2-4082-a474-fed35b90ae8a tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Going to run 1 instances... {{(pid=121402) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 01 19:07:08.826149 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-42bb37b4-ebb2-4082-a474-fed35b90ae8a tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] [instance: c5ca0ec6-c280-42cc-a851-7010c8fb63d2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2d4a0047-1b9e-445f-8af8-1b5c9d93e881',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121402) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 01 19:07:08.873333 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-4d309d93-236a-4474-a3dd-dd097965a803 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '058480d92c9b4ab4af6815d0438a65c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee9dc49b89143f781e4ab30296e4d01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:07:08.882163 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-4d309d93-236a-4474-a3dd-dd097965a803 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] 10.222.0.13 "GET /compute/v2.1/servers/d99a7f68-99ff-4c70-9e81-1c9faf6ebb7f" status: 200 len: 1215 microversion: 2.1 time: 0.207347 Nov 01 19:07:08.886530 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1597/3136] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:07:08 2022] GET /compute/v2.1/servers/d99a7f68-99ff-4c70-9e81-1c9faf6ebb7f => generated 1215 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:07:08.895824 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-4e61cfb5-72ba-4801-a0e6-789158517bd3 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:07:08.898364 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-4e61cfb5-72ba-4801-a0e6-789158517bd3 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] [instance: ba6ffc5c-84a4-40f1-bdc7-f87dde2c99df] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:07:08.907240 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-4e61cfb5-72ba-4801-a0e6-789158517bd3 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:08.908067 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-4e61cfb5-72ba-4801-a0e6-789158517bd3 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:08.908722 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-4e61cfb5-72ba-4801-a0e6-789158517bd3 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:08.909603 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-4e61cfb5-72ba-4801-a0e6-789158517bd3 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:08.910225 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-4e61cfb5-72ba-4801-a0e6-789158517bd3 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:08.910833 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-4e61cfb5-72ba-4801-a0e6-789158517bd3 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:08.918758 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-42bb37b4-ebb2-4082-a474-fed35b90ae8a tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.979134 Nov 01 19:07:08.919306 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1540/3137] 10.222.0.13 () {60 vars in 1147 bytes} [Tue Nov 1 19:07:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 985 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Nov 01 19:07:08.930163 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [req-b5ec94bb-b49e-4c16-9d95-885c89eb422b req-76538e0c-ec2a-4113-88dd-ea857a2586e3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "af1071a8-a090-44c9-890c-123ca3ff39f1", "tag": "203b8604-944e-4dd3-b782-489109f7158b"}]} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:07:08.954893 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-b5ec94bb-b49e-4c16-9d95-885c89eb422b req-76538e0c-ec2a-4113-88dd-ea857a2586e3 service nova] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:08.955475 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-b5ec94bb-b49e-4c16-9d95-885c89eb422b req-76538e0c-ec2a-4113-88dd-ea857a2586e3 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:08.970908 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-b5ec94bb-b49e-4c16-9d95-885c89eb422b req-76538e0c-ec2a-4113-88dd-ea857a2586e3 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:09.013536 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.compute.server_external_events [req-b5ec94bb-b49e-4c16-9d95-885c89eb422b req-76538e0c-ec2a-4113-88dd-ea857a2586e3 service nova] Creating event network-changed:203b8604-944e-4dd3-b782-489109f7158b for instance af1071a8-a090-44c9-890c-123ca3ff39f1 on n-h2-863052-2 Nov 01 19:07:09.030194 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [req-b5ec94bb-b49e-4c16-9d95-885c89eb422b req-76538e0c-ec2a-4113-88dd-ea857a2586e3 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.109247 Nov 01 19:07:09.033321 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1541/3138] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Nov 1 19:07:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:07:09.060695 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [req-e90a4837-53fb-42e9-8012-6a026c776b99 req-62f98a5d-4d49-47e8-a2fc-38ca51f6b85a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8a378b79-bd92-4ade-b034-1aaf5c87b74b", "tag": "7351786b-bb68-489c-a92f-36e1f62d4e9a"}, {"name": "network-changed", "server_uuid": "50bf9fd1-c4c6-4d58-80a1-4ce30f50f9bb", "tag": "43dc29db-6693-44f1-97a6-bfd732df398a"}]} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:07:09.089109 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-e90a4837-53fb-42e9-8012-6a026c776b99 req-62f98a5d-4d49-47e8-a2fc-38ca51f6b85a service nova] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:09.089851 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-e90a4837-53fb-42e9-8012-6a026c776b99 req-62f98a5d-4d49-47e8-a2fc-38ca51f6b85a service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:09.091391 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-e90a4837-53fb-42e9-8012-6a026c776b99 req-62f98a5d-4d49-47e8-a2fc-38ca51f6b85a service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:09.111328 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.compute.server_external_events [req-e90a4837-53fb-42e9-8012-6a026c776b99 req-62f98a5d-4d49-47e8-a2fc-38ca51f6b85a service nova] Creating event network-changed:7351786b-bb68-489c-a92f-36e1f62d4e9a for instance 8a378b79-bd92-4ade-b034-1aaf5c87b74b on n-h2-863052-2 Nov 01 19:07:09.112036 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.compute.server_external_events [req-e90a4837-53fb-42e9-8012-6a026c776b99 req-62f98a5d-4d49-47e8-a2fc-38ca51f6b85a service nova] Creating event network-changed:43dc29db-6693-44f1-97a6-bfd732df398a for instance 50bf9fd1-c4c6-4d58-80a1-4ce30f50f9bb on n-h1-863052-2 Nov 01 19:07:09.127565 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [req-e90a4837-53fb-42e9-8012-6a026c776b99 req-62f98a5d-4d49-47e8-a2fc-38ca51f6b85a service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.091980 Nov 01 19:07:09.129977 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1542/3139] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Nov 1 19:07:09 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:07:09.187087 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-41c2fafa-6b7b-4643-9cb5-66917ea7a9a8 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:07:09.191399 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-41c2fafa-6b7b-4643-9cb5-66917ea7a9a8 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] [instance: c5ca0ec6-c280-42cc-a851-7010c8fb63d2] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:07:09.276985 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-41c2fafa-6b7b-4643-9cb5-66917ea7a9a8 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] [instance: c5ca0ec6-c280-42cc-a851-7010c8fb63d2] Going to try to terminate instance {{(pid=121402) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 01 19:07:09.808030 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.scheduler.client.report [None req-41c2fafa-6b7b-4643-9cb5-66917ea7a9a8 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Deleted allocations for instance c5ca0ec6-c280-42cc-a851-7010c8fb63d2 Nov 01 19:07:09.815161 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.compute.api [None req-41c2fafa-6b7b-4643-9cb5-66917ea7a9a8 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] [instance: c5ca0ec6-c280-42cc-a851-7010c8fb63d2] Instance Mapping does not exist while attempting local delete cleanup. Nov 01 19:07:09.816177 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-41c2fafa-6b7b-4643-9cb5-66917ea7a9a8 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] 10.222.0.13 "DELETE /compute/v2.1/servers/c5ca0ec6-c280-42cc-a851-7010c8fb63d2" status: 204 len: 0 microversion: 2.1 time: 0.650653 Nov 01 19:07:09.817396 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1543/3140] 10.222.0.13 () {58 vars in 1239 bytes} [Tue Nov 1 19:07:09 2022] DELETE /compute/v2.1/servers/c5ca0ec6-c280-42cc-a851-7010c8fb63d2 => generated 0 bytes in 686 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 01 19:07:09.826546 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-d0ebb45f-f33a-453b-b2cb-d4adb47f5435 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:07:09.827608 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-d0ebb45f-f33a-453b-b2cb-d4adb47f5435 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] [instance: 50bf9fd1-c4c6-4d58-80a1-4ce30f50f9bb] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:07:09.848251 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-d0ebb45f-f33a-453b-b2cb-d4adb47f5435 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:09.849014 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-d0ebb45f-f33a-453b-b2cb-d4adb47f5435 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:09.850296 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-d0ebb45f-f33a-453b-b2cb-d4adb47f5435 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:09.857128 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-d0ebb45f-f33a-453b-b2cb-d4adb47f5435 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:09.857581 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-d0ebb45f-f33a-453b-b2cb-d4adb47f5435 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:09.858038 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-d0ebb45f-f33a-453b-b2cb-d4adb47f5435 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:09.869412 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-4e61cfb5-72ba-4801-a0e6-789158517bd3 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd2105b0264b48d084d0e79cabff8bc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf4adda91364dab94830347c06e3957', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:07:09.905514 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-4e61cfb5-72ba-4801-a0e6-789158517bd3 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd2105b0264b48d084d0e79cabff8bc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf4adda91364dab94830347c06e3957', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:07:09.937845 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-4e61cfb5-72ba-4801-a0e6-789158517bd3 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd2105b0264b48d084d0e79cabff8bc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf4adda91364dab94830347c06e3957', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:07:09.939085 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-4e61cfb5-72ba-4801-a0e6-789158517bd3 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] 10.222.0.13 "GET /compute/v2.1/servers/ba6ffc5c-84a4-40f1-bdc7-f87dde2c99df" status: 200 len: 1875 microversion: 2.32 time: 1.051341 Nov 01 19:07:09.957833 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1598/3141] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 19:07:08 2022] GET /compute/v2.1/servers/ba6ffc5c-84a4-40f1-bdc7-f87dde2c99df => generated 1875 bytes in 1053 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 19:07:09.987305 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-d8e4d4bb-b680-488f-9a34-b7a2facabbc8 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:07:09.989304 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-d8e4d4bb-b680-488f-9a34-b7a2facabbc8 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] [instance: c5ca0ec6-c280-42cc-a851-7010c8fb63d2] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:07:09.999552 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.wsgi [None req-d8e4d4bb-b680-488f-9a34-b7a2facabbc8 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] HTTP exception thrown: Instance c5ca0ec6-c280-42cc-a851-7010c8fb63d2 could not be found. Nov 01 19:07:10.003260 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-d8e4d4bb-b680-488f-9a34-b7a2facabbc8 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Request method failure captured: Nov 01 19:07:10.003260 n-d-863052-2 devstack@n-api.service[121403]: request: GET /compute/v2.1/servers/c5ca0ec6-c280-42cc-a851-7010c8fb63d2 HTTP/1.1 Nov 01 19:07:10.003260 n-d-863052-2 devstack@n-api.service[121403]: Accept: application/json Nov 01 19:07:10.003260 n-d-863052-2 devstack@n-api.service[121403]: Accept-Encoding: identity Nov 01 19:07:10.003260 n-d-863052-2 devstack@n-api.service[121403]: Connection: close Nov 01 19:07:10.003260 n-d-863052-2 devstack@n-api.service[121403]: Content-Length: 0 Nov 01 19:07:10.003260 n-d-863052-2 devstack@n-api.service[121403]: Content-Type: application/json Nov 01 19:07:10.003260 n-d-863052-2 devstack@n-api.service[121403]: Host: 10.222.0.13 Nov 01 19:07:10.003260 n-d-863052-2 devstack@n-api.service[121403]: Openstack-System-Scope: None Nov 01 19:07:10.003260 n-d-863052-2 devstack@n-api.service[121403]: User-Agent: python-urllib3/1.26.12 Nov 01 19:07:10.003260 n-d-863052-2 devstack@n-api.service[121403]: X-Auth-Token: gAAAAABjYW4_RJI8gKBQs81ShXQrfTSIzrNvaZj2e2rGhpR5xhmtuxP4h5uZIl9SLPqPqJ9Syn39UO-el4mPnuEEOGnWtpNlTopD6-Pc1m-VWD64ggyrfBZwUB0hnjNvBvBk6ge071YBJx2gxTN_InEu4tuxz3s-3IQBbEpMSIJZ4VoUIbz4DgY Nov 01 19:07:10.003260 n-d-863052-2 devstack@n-api.service[121403]: X-Domain-Id: None Nov 01 19:07:10.003260 n-d-863052-2 devstack@n-api.service[121403]: X-Domain-Name: None Nov 01 19:07:10.003260 n-d-863052-2 devstack@n-api.service[121403]: X-Identity-Status: Confirmed Nov 01 19:07:10.003260 n-d-863052-2 devstack@n-api.service[121403]: X-Is-Admin-Project: True Nov 01 19:07:10.003260 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Domain-Id: default Nov 01 19:07:10.003260 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Domain-Name: Default Nov 01 19:07:10.003260 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Id: 851785a5f76548898a77d67792888504 Nov 01 19:07:10.003260 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Name: tempest-ServersTestJSON-917766486 Nov 01 19:07:10.003260 n-d-863052-2 devstack@n-api.service[121403]: X-Role: member,reader Nov 01 19:07:10.003260 n-d-863052-2 devstack@n-api.service[121403]: X-Roles: member,reader Nov 01 19:07:10.003260 n-d-863052-2 devstack@n-api.service[121403]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/851785a5f76548898a77d67792888504"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/851785a5f76548898a77d67792888504"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_851785a5f76548898a77d67792888504", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/851785a5f76548898a77d67792888504"}]}] Nov 01 19:07:10.003260 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant: tempest-ServersTestJSON-917766486 Nov 01 19:07:10.003260 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant-Id: 851785a5f76548898a77d67792888504 Nov 01 19:07:10.003260 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant-Name: tempest-ServersTestJSON-917766486 Nov 01 19:07:10.003260 n-d-863052-2 devstack@n-api.service[121403]: X-User: tempest-ServersTestJSON-917766486-project Nov 01 19:07:10.003260 n-d-863052-2 devstack@n-api.service[121403]: X-User-Domain-Id: default Nov 01 19:07:10.003260 n-d-863052-2 devstack@n-api.service[121403]: X-User-Domain-Name: Default Nov 01 19:07:10.003260 n-d-863052-2 devstack@n-api.service[121403]: X-User-Id: 113bd8c844ee490b86a68bc7e1e75da3 Nov 01 19:07:10.003260 n-d-863052-2 devstack@n-api.service[121403]: X-User-Name: tempest-ServersTestJSON-917766486-project Nov 01 19:07:10.003260 n-d-863052-2 devstack@n-api.service[121403]: method: > Nov 01 19:07:10.003260 n-d-863052-2 devstack@n-api.service[121403]: exception: Instance c5ca0ec6-c280-42cc-a851-7010c8fb63d2 could not be found. Nov 01 19:07:10.003260 n-d-863052-2 devstack@n-api.service[121403]: action_args: {'id': 'c5ca0ec6-c280-42cc-a851-7010c8fb63d2'} Nov 01 19:07:10.003260 n-d-863052-2 devstack@n-api.service[121403]: {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 01 19:07:10.003260 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:07:10.003260 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 01 19:07:10.003260 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 01 19:07:10.003260 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 01 19:07:10.003260 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 01 19:07:10.003260 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Nov 01 19:07:10.003260 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Nov 01 19:07:10.003260 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c5ca0ec6-c280-42cc-a851-7010c8fb63d2 could not be found. Nov 01 19:07:10.003260 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:07:10.003260 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:07:10.003260 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:07:10.003260 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:07:10.003260 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:07:10.003260 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:07:10.003260 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 01 19:07:10.003260 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 01 19:07:10.003260 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 01 19:07:10.003260 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 01 19:07:10.003260 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 01 19:07:10.003260 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 01 19:07:10.003260 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 01 19:07:10.003260 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 01 19:07:10.003260 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 01 19:07:10.003260 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 01 19:07:10.003260 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c5ca0ec6-c280-42cc-a851-7010c8fb63d2 could not be found. Nov 01 19:07:10.003260 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:07:10.003260 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:07:10.003260 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:07:10.003260 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:07:10.003260 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:07:10.003260 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:07:10.017859 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 01 19:07:10.017859 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 01 19:07:10.017859 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c5ca0ec6-c280-42cc-a851-7010c8fb63d2 could not be found. Nov 01 19:07:10.017859 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:07:10.017859 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-d8e4d4bb-b680-488f-9a34-b7a2facabbc8 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Returning 404 to user: Instance c5ca0ec6-c280-42cc-a851-7010c8fb63d2 could not be found. {{(pid=121403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 01 19:07:10.017859 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-d8e4d4bb-b680-488f-9a34-b7a2facabbc8 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] 10.222.0.13 "GET /compute/v2.1/servers/c5ca0ec6-c280-42cc-a851-7010c8fb63d2" status: 404 len: 111 microversion: 2.1 time: 0.037583 Nov 01 19:07:10.017859 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1599/3142] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:07:09 2022] GET /compute/v2.1/servers/c5ca0ec6-c280-42cc-a851-7010c8fb63d2 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 01 19:07:10.026940 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-6b29ff04-c229-42fb-9c83-016a2d6d3df0 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:07:10.028282 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-6b29ff04-c229-42fb-9c83-016a2d6d3df0 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] [instance: d99a7f68-99ff-4c70-9e81-1c9faf6ebb7f] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:07:10.053609 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-6b29ff04-c229-42fb-9c83-016a2d6d3df0 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:10.054114 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-6b29ff04-c229-42fb-9c83-016a2d6d3df0 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:10.054555 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-6b29ff04-c229-42fb-9c83-016a2d6d3df0 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:10.070378 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-6b29ff04-c229-42fb-9c83-016a2d6d3df0 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:10.071114 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-6b29ff04-c229-42fb-9c83-016a2d6d3df0 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:10.071457 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-6b29ff04-c229-42fb-9c83-016a2d6d3df0 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:10.277690 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-6b29ff04-c229-42fb-9c83-016a2d6d3df0 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '058480d92c9b4ab4af6815d0438a65c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee9dc49b89143f781e4ab30296e4d01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:07:10.293972 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-6b29ff04-c229-42fb-9c83-016a2d6d3df0 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] 10.222.0.13 "GET /compute/v2.1/servers/d99a7f68-99ff-4c70-9e81-1c9faf6ebb7f" status: 200 len: 1267 microversion: 2.1 time: 0.278244 Nov 01 19:07:10.296253 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1600/3143] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:07:10 2022] GET /compute/v2.1/servers/d99a7f68-99ff-4c70-9e81-1c9faf6ebb7f => generated 1267 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:07:10.301275 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-4ac481ae-e6e8-499e-ac2d-f917e95a6c38 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-471956739", "imageRef": "2d4a0047-1b9e-445f-8af8-1b5c9d93e881", "flavorRef": "452", "accessIPv6": "2001:2001::3", "networks": [{"uuid": "346d9303-d6bc-4555-85be-95ee31a2d9cd"}]}} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:07:10.377157 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.network.neutron [None req-4ac481ae-e6e8-499e-ac2d-f917e95a6c38 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] validate_networks() for [('346d9303-d6bc-4555-85be-95ee31a2d9cd', None, None, None, None, None)] {{(pid=121403) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 01 19:07:10.604062 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-d0ebb45f-f33a-453b-b2cb-d4adb47f5435 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05d6a1722dfa4e959aeb14d601e43b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b5d812eff94e2f89d4705d7e7d5f3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:07:10.616293 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-d0ebb45f-f33a-453b-b2cb-d4adb47f5435 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] 10.222.0.13 "GET /compute/v2.1/servers/50bf9fd1-c4c6-4d58-80a1-4ce30f50f9bb" status: 200 len: 1318 microversion: 2.1 time: 0.797548 Nov 01 19:07:10.631278 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1544/3144] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:07:09 2022] GET /compute/v2.1/servers/50bf9fd1-c4c6-4d58-80a1-4ce30f50f9bb => generated 1318 bytes in 811 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:07:10.970347 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-48163c2b-3232-4151-afa5-f162998b52a9 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:07:10.971175 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-48163c2b-3232-4151-afa5-f162998b52a9 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] [instance: ba6ffc5c-84a4-40f1-bdc7-f87dde2c99df] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:07:10.978137 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-48163c2b-3232-4151-afa5-f162998b52a9 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:10.983217 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-48163c2b-3232-4151-afa5-f162998b52a9 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:10.986092 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-48163c2b-3232-4151-afa5-f162998b52a9 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:10.986910 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-48163c2b-3232-4151-afa5-f162998b52a9 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:10.989253 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-48163c2b-3232-4151-afa5-f162998b52a9 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:10.989706 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-48163c2b-3232-4151-afa5-f162998b52a9 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:11.626110 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-48163c2b-3232-4151-afa5-f162998b52a9 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd2105b0264b48d084d0e79cabff8bc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf4adda91364dab94830347c06e3957', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:07:11.637082 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-48163c2b-3232-4151-afa5-f162998b52a9 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd2105b0264b48d084d0e79cabff8bc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf4adda91364dab94830347c06e3957', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:07:11.638810 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-48163c2b-3232-4151-afa5-f162998b52a9 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd2105b0264b48d084d0e79cabff8bc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf4adda91364dab94830347c06e3957', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:07:11.640289 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-48163c2b-3232-4151-afa5-f162998b52a9 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] 10.222.0.13 "GET /compute/v2.1/servers/ba6ffc5c-84a4-40f1-bdc7-f87dde2c99df" status: 200 len: 1875 microversion: 2.32 time: 0.674662 Nov 01 19:07:11.641147 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1545/3145] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 19:07:10 2022] GET /compute/v2.1/servers/ba6ffc5c-84a4-40f1-bdc7-f87dde2c99df => generated 1875 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 01 19:07:11.646823 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-cfd04bd8-f279-4c84-a066-a62a188a3ba1 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:07:11.647932 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-cfd04bd8-f279-4c84-a066-a62a188a3ba1 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] [instance: d99a7f68-99ff-4c70-9e81-1c9faf6ebb7f] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:07:11.654344 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-cfd04bd8-f279-4c84-a066-a62a188a3ba1 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:11.654841 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-cfd04bd8-f279-4c84-a066-a62a188a3ba1 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:11.655548 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-cfd04bd8-f279-4c84-a066-a62a188a3ba1 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:11.656199 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-cfd04bd8-f279-4c84-a066-a62a188a3ba1 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:11.656843 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-cfd04bd8-f279-4c84-a066-a62a188a3ba1 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:11.657422 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-cfd04bd8-f279-4c84-a066-a62a188a3ba1 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:11.731798 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-cfd04bd8-f279-4c84-a066-a62a188a3ba1 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '058480d92c9b4ab4af6815d0438a65c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee9dc49b89143f781e4ab30296e4d01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:07:11.738827 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.virt.hardware [None req-4ac481ae-e6e8-499e-ac2d-f917e95a6c38 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Flavor limits 0:0:0 {{(pid=121403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 01 19:07:11.743602 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-cfd04bd8-f279-4c84-a066-a62a188a3ba1 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] 10.222.0.13 "GET /compute/v2.1/servers/d99a7f68-99ff-4c70-9e81-1c9faf6ebb7f" status: 200 len: 1273 microversion: 2.1 time: 0.100778 Nov 01 19:07:11.743978 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.virt.hardware [None req-4ac481ae-e6e8-499e-ac2d-f917e95a6c38 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Image limits 0:0:0 {{(pid=121403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 01 19:07:11.744563 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.virt.hardware [None req-4ac481ae-e6e8-499e-ac2d-f917e95a6c38 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Flavor pref 0:0:0 {{(pid=121403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 01 19:07:11.745663 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.virt.hardware [None req-4ac481ae-e6e8-499e-ac2d-f917e95a6c38 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Image pref 0:0:0 {{(pid=121403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 01 19:07:11.745839 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1546/3146] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:07:11 2022] GET /compute/v2.1/servers/d99a7f68-99ff-4c70-9e81-1c9faf6ebb7f => generated 1273 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:07:11.745957 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.virt.hardware [None req-4ac481ae-e6e8-499e-ac2d-f917e95a6c38 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 01 19:07:11.748129 n-d-863052-2 devstack@n-api.service[121403]: DEBUG dbcounter [-] [121403] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=121403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 19:07:11.759220 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-b54bbc13-28dc-40d7-bcaf-00e0134592d9 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:07:11.760080 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-b54bbc13-28dc-40d7-bcaf-00e0134592d9 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] [instance: 50bf9fd1-c4c6-4d58-80a1-4ce30f50f9bb] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:07:11.765728 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-4ac481ae-e6e8-499e-ac2d-f917e95a6c38 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:11.769096 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b54bbc13-28dc-40d7-bcaf-00e0134592d9 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:11.769590 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b54bbc13-28dc-40d7-bcaf-00e0134592d9 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:11.770310 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-4ac481ae-e6e8-499e-ac2d-f917e95a6c38 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:11.770749 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-4ac481ae-e6e8-499e-ac2d-f917e95a6c38 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:11.771529 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-4ac481ae-e6e8-499e-ac2d-f917e95a6c38 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:11.771992 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-4ac481ae-e6e8-499e-ac2d-f917e95a6c38 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:11.772389 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-4ac481ae-e6e8-499e-ac2d-f917e95a6c38 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:11.785296 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b54bbc13-28dc-40d7-bcaf-00e0134592d9 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:11.786314 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b54bbc13-28dc-40d7-bcaf-00e0134592d9 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:11.786954 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b54bbc13-28dc-40d7-bcaf-00e0134592d9 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:11.787568 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b54bbc13-28dc-40d7-bcaf-00e0134592d9 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:11.814190 n-d-863052-2 devstack@n-api.service[121402]: DEBUG dbcounter [-] [121402] Writing DB stats nova_cell1:SELECT=100 {{(pid=121402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 19:07:11.816614 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.quota [None req-4ac481ae-e6e8-499e-ac2d-f917e95a6c38 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Getting quotas for project 851785a5f76548898a77d67792888504. Resources: {'cores', 'ram', 'instances'} {{(pid=121403) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 01 19:07:11.828314 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.quota [None req-4ac481ae-e6e8-499e-ac2d-f917e95a6c38 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Getting quotas for user 113bd8c844ee490b86a68bc7e1e75da3 and project 851785a5f76548898a77d67792888504. Resources: {'cores', 'ram', 'instances'} {{(pid=121403) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 01 19:07:11.847336 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-4ac481ae-e6e8-499e-ac2d-f917e95a6c38 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Going to run 1 instances... {{(pid=121403) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 01 19:07:11.850074 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-4ac481ae-e6e8-499e-ac2d-f917e95a6c38 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] [instance: a3e21508-14b3-4a32-911a-86699cc0f1aa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2d4a0047-1b9e-445f-8af8-1b5c9d93e881',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121403) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 01 19:07:11.903630 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-4ac481ae-e6e8-499e-ac2d-f917e95a6c38 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.606225 Nov 01 19:07:11.904569 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1601/3147] 10.222.0.13 () {60 vars in 1147 bytes} [Tue Nov 1 19:07:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 1608 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 01 19:07:11.925057 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-48225455-3c2f-40e2-a82d-e2acb0421b63 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:07:11.925737 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-48225455-3c2f-40e2-a82d-e2acb0421b63 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] [instance: a3e21508-14b3-4a32-911a-86699cc0f1aa] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:07:12.016279 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-48225455-3c2f-40e2-a82d-e2acb0421b63 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113bd8c844ee490b86a68bc7e1e75da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '851785a5f76548898a77d67792888504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:07:12.027070 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-48225455-3c2f-40e2-a82d-e2acb0421b63 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] 10.222.0.13 "GET /compute/v2.1/servers/a3e21508-14b3-4a32-911a-86699cc0f1aa" status: 200 len: 1220 microversion: 2.1 time: 0.115198 Nov 01 19:07:12.027852 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1602/3148] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:07:11 2022] GET /compute/v2.1/servers/a3e21508-14b3-4a32-911a-86699cc0f1aa => generated 1220 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:07:12.078560 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-b54bbc13-28dc-40d7-bcaf-00e0134592d9 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05d6a1722dfa4e959aeb14d601e43b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b5d812eff94e2f89d4705d7e7d5f3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:07:12.088364 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-b54bbc13-28dc-40d7-bcaf-00e0134592d9 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] 10.222.0.13 "GET /compute/v2.1/servers/50bf9fd1-c4c6-4d58-80a1-4ce30f50f9bb" status: 200 len: 1318 microversion: 2.1 time: 0.340645 Nov 01 19:07:12.089756 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1547/3149] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:07:11 2022] GET /compute/v2.1/servers/50bf9fd1-c4c6-4d58-80a1-4ce30f50f9bb => generated 1318 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:07:12.669441 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-093fc55a-468e-4708-bd82-17366cadc9d2 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:07:12.670145 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-093fc55a-468e-4708-bd82-17366cadc9d2 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] [instance: ba6ffc5c-84a4-40f1-bdc7-f87dde2c99df] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:07:12.693668 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-093fc55a-468e-4708-bd82-17366cadc9d2 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:12.695731 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-093fc55a-468e-4708-bd82-17366cadc9d2 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:12.696286 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-093fc55a-468e-4708-bd82-17366cadc9d2 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:12.697206 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-093fc55a-468e-4708-bd82-17366cadc9d2 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:12.699983 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-093fc55a-468e-4708-bd82-17366cadc9d2 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:12.700530 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-093fc55a-468e-4708-bd82-17366cadc9d2 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:12.770708 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-0ee6e09b-4f63-4661-ab3a-aa07b57b122f tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:07:12.771475 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-0ee6e09b-4f63-4661-ab3a-aa07b57b122f tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] [instance: d99a7f68-99ff-4c70-9e81-1c9faf6ebb7f] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:07:12.785961 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-0ee6e09b-4f63-4661-ab3a-aa07b57b122f tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:12.787229 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-0ee6e09b-4f63-4661-ab3a-aa07b57b122f tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:12.788395 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-0ee6e09b-4f63-4661-ab3a-aa07b57b122f tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:12.790771 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-0ee6e09b-4f63-4661-ab3a-aa07b57b122f tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:12.792781 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-0ee6e09b-4f63-4661-ab3a-aa07b57b122f tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:12.794528 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-0ee6e09b-4f63-4661-ab3a-aa07b57b122f tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:13.051889 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-0ee6e09b-4f63-4661-ab3a-aa07b57b122f tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '058480d92c9b4ab4af6815d0438a65c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee9dc49b89143f781e4ab30296e4d01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:07:13.064857 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-0ee6e09b-4f63-4661-ab3a-aa07b57b122f tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] 10.222.0.13 "GET /compute/v2.1/servers/d99a7f68-99ff-4c70-9e81-1c9faf6ebb7f" status: 200 len: 1315 microversion: 2.1 time: 0.300256 Nov 01 19:07:13.066543 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1548/3150] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:07:12 2022] GET /compute/v2.1/servers/d99a7f68-99ff-4c70-9e81-1c9faf6ebb7f => generated 1315 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 19:07:13.072012 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-093fc55a-468e-4708-bd82-17366cadc9d2 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd2105b0264b48d084d0e79cabff8bc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf4adda91364dab94830347c06e3957', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:07:13.094146 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [req-f9d827d0-9010-43cb-b4b9-abf29b71a958 req-0be6e769-952c-48d5-b439-4dcb253493fe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "50bf9fd1-c4c6-4d58-80a1-4ce30f50f9bb", "name": "network-vif-plugged", "status": "completed", "tag": "43dc29db-6693-44f1-97a6-bfd732df398a"}]} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:07:13.095088 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-093fc55a-468e-4708-bd82-17366cadc9d2 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd2105b0264b48d084d0e79cabff8bc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf4adda91364dab94830347c06e3957', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:07:13.098177 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-093fc55a-468e-4708-bd82-17366cadc9d2 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd2105b0264b48d084d0e79cabff8bc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf4adda91364dab94830347c06e3957', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:07:13.105273 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-093fc55a-468e-4708-bd82-17366cadc9d2 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] 10.222.0.13 "GET /compute/v2.1/servers/ba6ffc5c-84a4-40f1-bdc7-f87dde2c99df" status: 200 len: 1875 microversion: 2.32 time: 0.434446 Nov 01 19:07:13.106119 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1603/3151] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 19:07:12 2022] GET /compute/v2.1/servers/ba6ffc5c-84a4-40f1-bdc7-f87dde2c99df => generated 1875 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 19:07:13.112821 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-4e84841e-873c-4783-92cc-0861ed24d7c4 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:07:13.113477 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-f9d827d0-9010-43cb-b4b9-abf29b71a958 req-0be6e769-952c-48d5-b439-4dcb253493fe service nova] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:13.113861 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-4e84841e-873c-4783-92cc-0861ed24d7c4 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] [instance: a3e21508-14b3-4a32-911a-86699cc0f1aa] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:07:13.113997 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-f9d827d0-9010-43cb-b4b9-abf29b71a958 req-0be6e769-952c-48d5-b439-4dcb253493fe service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:13.114381 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-f9d827d0-9010-43cb-b4b9-abf29b71a958 req-0be6e769-952c-48d5-b439-4dcb253493fe service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:13.121993 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-4e84841e-873c-4783-92cc-0861ed24d7c4 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:13.122713 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-4e84841e-873c-4783-92cc-0861ed24d7c4 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:13.123372 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-4e84841e-873c-4783-92cc-0861ed24d7c4 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:13.124288 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-4e84841e-873c-4783-92cc-0861ed24d7c4 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:13.126094 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-4e84841e-873c-4783-92cc-0861ed24d7c4 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:13.127196 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-4e84841e-873c-4783-92cc-0861ed24d7c4 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:13.134776 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.compute.server_external_events [req-f9d827d0-9010-43cb-b4b9-abf29b71a958 req-0be6e769-952c-48d5-b439-4dcb253493fe service nova] Creating event network-vif-plugged:43dc29db-6693-44f1-97a6-bfd732df398a for instance 50bf9fd1-c4c6-4d58-80a1-4ce30f50f9bb on n-h1-863052-2 Nov 01 19:07:13.155079 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [req-f9d827d0-9010-43cb-b4b9-abf29b71a958 req-0be6e769-952c-48d5-b439-4dcb253493fe service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077351 Nov 01 19:07:13.157409 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1549/3152] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Nov 1 19:07:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:07:13.170504 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-4db550a1-62d0-47e0-8131-791de8edc419 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:07:13.173774 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-4db550a1-62d0-47e0-8131-791de8edc419 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] [instance: 50bf9fd1-c4c6-4d58-80a1-4ce30f50f9bb] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:07:13.201109 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-4db550a1-62d0-47e0-8131-791de8edc419 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:13.202026 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-4db550a1-62d0-47e0-8131-791de8edc419 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:13.202477 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-4db550a1-62d0-47e0-8131-791de8edc419 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:13.203785 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-4db550a1-62d0-47e0-8131-791de8edc419 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:13.203911 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-4db550a1-62d0-47e0-8131-791de8edc419 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:13.204292 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-4db550a1-62d0-47e0-8131-791de8edc419 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:13.310667 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-4e84841e-873c-4783-92cc-0861ed24d7c4 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113bd8c844ee490b86a68bc7e1e75da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '851785a5f76548898a77d67792888504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:07:13.320618 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-4e84841e-873c-4783-92cc-0861ed24d7c4 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] 10.222.0.13 "GET /compute/v2.1/servers/a3e21508-14b3-4a32-911a-86699cc0f1aa" status: 200 len: 1272 microversion: 2.1 time: 0.211110 Nov 01 19:07:13.332613 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1604/3153] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:07:13 2022] GET /compute/v2.1/servers/a3e21508-14b3-4a32-911a-86699cc0f1aa => generated 1272 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:07:13.517166 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-4db550a1-62d0-47e0-8131-791de8edc419 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05d6a1722dfa4e959aeb14d601e43b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b5d812eff94e2f89d4705d7e7d5f3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:07:13.527339 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-4db550a1-62d0-47e0-8131-791de8edc419 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] 10.222.0.13 "GET /compute/v2.1/servers/50bf9fd1-c4c6-4d58-80a1-4ce30f50f9bb" status: 200 len: 1318 microversion: 2.1 time: 0.368174 Nov 01 19:07:13.528026 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1550/3154] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:07:13 2022] GET /compute/v2.1/servers/50bf9fd1-c4c6-4d58-80a1-4ce30f50f9bb => generated 1318 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:07:13.576462 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [req-6b0631eb-d328-43ea-ba2a-f76687a0f55c req-7efc6395-c840-4f3b-ab8c-bab4abf5929e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d99a7f68-99ff-4c70-9e81-1c9faf6ebb7f", "tag": "86a9807c-bdc4-485a-8d9d-51a89b1522de"}]} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:07:13.588893 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-6b0631eb-d328-43ea-ba2a-f76687a0f55c req-7efc6395-c840-4f3b-ab8c-bab4abf5929e service nova] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:13.589386 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-6b0631eb-d328-43ea-ba2a-f76687a0f55c req-7efc6395-c840-4f3b-ab8c-bab4abf5929e service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:13.590789 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-6b0631eb-d328-43ea-ba2a-f76687a0f55c req-7efc6395-c840-4f3b-ab8c-bab4abf5929e service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:13.596378 n-d-863052-2 devstack@n-api.service[121403]: DEBUG dbcounter [-] [121403] Writing DB stats nova_cell1:SELECT=100 {{(pid=121403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 19:07:13.609676 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.compute.server_external_events [req-6b0631eb-d328-43ea-ba2a-f76687a0f55c req-7efc6395-c840-4f3b-ab8c-bab4abf5929e service nova] Creating event network-changed:86a9807c-bdc4-485a-8d9d-51a89b1522de for instance d99a7f68-99ff-4c70-9e81-1c9faf6ebb7f on n-h2-863052-2 Nov 01 19:07:13.615266 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [req-6b0631eb-d328-43ea-ba2a-f76687a0f55c req-7efc6395-c840-4f3b-ab8c-bab4abf5929e service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042438 Nov 01 19:07:13.616772 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1605/3155] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Nov 1 19:07:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:07:14.092246 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-497e0bc3-5090-4f87-9e94-f8ff6609ed29 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:07:14.093589 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-497e0bc3-5090-4f87-9e94-f8ff6609ed29 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] [instance: d99a7f68-99ff-4c70-9e81-1c9faf6ebb7f] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:07:14.101431 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-497e0bc3-5090-4f87-9e94-f8ff6609ed29 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:14.102268 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-497e0bc3-5090-4f87-9e94-f8ff6609ed29 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:14.102889 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-497e0bc3-5090-4f87-9e94-f8ff6609ed29 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:14.104016 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-497e0bc3-5090-4f87-9e94-f8ff6609ed29 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:14.105473 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-497e0bc3-5090-4f87-9e94-f8ff6609ed29 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:14.106141 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-497e0bc3-5090-4f87-9e94-f8ff6609ed29 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:14.135571 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-6bc51247-18db-42ad-b66c-d8d81e1d9a51 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:07:14.136612 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-6bc51247-18db-42ad-b66c-d8d81e1d9a51 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] [instance: ba6ffc5c-84a4-40f1-bdc7-f87dde2c99df] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:07:14.153068 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-6bc51247-18db-42ad-b66c-d8d81e1d9a51 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:14.159397 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-6bc51247-18db-42ad-b66c-d8d81e1d9a51 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:14.160216 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-6bc51247-18db-42ad-b66c-d8d81e1d9a51 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:14.161283 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-6bc51247-18db-42ad-b66c-d8d81e1d9a51 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:14.162020 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-6bc51247-18db-42ad-b66c-d8d81e1d9a51 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:14.164339 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-6bc51247-18db-42ad-b66c-d8d81e1d9a51 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:14.340361 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-497e0bc3-5090-4f87-9e94-f8ff6609ed29 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '058480d92c9b4ab4af6815d0438a65c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee9dc49b89143f781e4ab30296e4d01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:07:14.349588 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-497e0bc3-5090-4f87-9e94-f8ff6609ed29 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] 10.222.0.13 "GET /compute/v2.1/servers/d99a7f68-99ff-4c70-9e81-1c9faf6ebb7f" status: 200 len: 1315 microversion: 2.1 time: 0.261457 Nov 01 19:07:14.350926 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1551/3156] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:07:14 2022] GET /compute/v2.1/servers/d99a7f68-99ff-4c70-9e81-1c9faf6ebb7f => generated 1315 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:07:14.357455 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-f4cc9355-8636-4337-81b2-6715c48bdb57 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:07:14.358243 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-f4cc9355-8636-4337-81b2-6715c48bdb57 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] [instance: a3e21508-14b3-4a32-911a-86699cc0f1aa] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:07:14.368795 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f4cc9355-8636-4337-81b2-6715c48bdb57 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:14.369713 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f4cc9355-8636-4337-81b2-6715c48bdb57 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:14.370441 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f4cc9355-8636-4337-81b2-6715c48bdb57 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:14.371356 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f4cc9355-8636-4337-81b2-6715c48bdb57 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:14.372201 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f4cc9355-8636-4337-81b2-6715c48bdb57 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:14.372747 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f4cc9355-8636-4337-81b2-6715c48bdb57 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:14.416898 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-6bc51247-18db-42ad-b66c-d8d81e1d9a51 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd2105b0264b48d084d0e79cabff8bc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf4adda91364dab94830347c06e3957', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:07:14.429255 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-6bc51247-18db-42ad-b66c-d8d81e1d9a51 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd2105b0264b48d084d0e79cabff8bc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf4adda91364dab94830347c06e3957', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:07:14.432038 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-6bc51247-18db-42ad-b66c-d8d81e1d9a51 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd2105b0264b48d084d0e79cabff8bc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf4adda91364dab94830347c06e3957', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:07:14.434757 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-6bc51247-18db-42ad-b66c-d8d81e1d9a51 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] 10.222.0.13 "GET /compute/v2.1/servers/ba6ffc5c-84a4-40f1-bdc7-f87dde2c99df" status: 200 len: 1875 microversion: 2.32 time: 0.303843 Nov 01 19:07:14.435869 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1606/3157] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 19:07:14 2022] GET /compute/v2.1/servers/ba6ffc5c-84a4-40f1-bdc7-f87dde2c99df => generated 1875 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 01 19:07:14.459331 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-f4cc9355-8636-4337-81b2-6715c48bdb57 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113bd8c844ee490b86a68bc7e1e75da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '851785a5f76548898a77d67792888504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:07:14.468276 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-f4cc9355-8636-4337-81b2-6715c48bdb57 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] 10.222.0.13 "GET /compute/v2.1/servers/a3e21508-14b3-4a32-911a-86699cc0f1aa" status: 200 len: 1278 microversion: 2.1 time: 0.115794 Nov 01 19:07:14.469606 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1552/3158] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:07:14 2022] GET /compute/v2.1/servers/a3e21508-14b3-4a32-911a-86699cc0f1aa => generated 1278 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:07:14.572213 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-3465399a-4a8c-4db1-a5dd-5de92ecf29ac tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:07:14.573754 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-3465399a-4a8c-4db1-a5dd-5de92ecf29ac tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] [instance: 50bf9fd1-c4c6-4d58-80a1-4ce30f50f9bb] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:07:14.588723 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-3465399a-4a8c-4db1-a5dd-5de92ecf29ac tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:14.604365 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-3465399a-4a8c-4db1-a5dd-5de92ecf29ac tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:14.611959 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-3465399a-4a8c-4db1-a5dd-5de92ecf29ac tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:14.613009 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-3465399a-4a8c-4db1-a5dd-5de92ecf29ac tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:14.613496 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-3465399a-4a8c-4db1-a5dd-5de92ecf29ac tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:14.613936 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-3465399a-4a8c-4db1-a5dd-5de92ecf29ac tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:14.914395 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-3465399a-4a8c-4db1-a5dd-5de92ecf29ac tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05d6a1722dfa4e959aeb14d601e43b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b5d812eff94e2f89d4705d7e7d5f3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:07:14.924319 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-3465399a-4a8c-4db1-a5dd-5de92ecf29ac tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] 10.222.0.13 "GET /compute/v2.1/servers/50bf9fd1-c4c6-4d58-80a1-4ce30f50f9bb" status: 200 len: 1508 microversion: 2.1 time: 0.359206 Nov 01 19:07:14.925298 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1607/3159] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:07:14 2022] GET /compute/v2.1/servers/50bf9fd1-c4c6-4d58-80a1-4ce30f50f9bb => generated 1508 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:07:14.948957 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-f83d3116-03d8-4d97-94b2-c971d97990c7 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:07:14.950015 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-f83d3116-03d8-4d97-94b2-c971d97990c7 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] [instance: 50bf9fd1-c4c6-4d58-80a1-4ce30f50f9bb] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:07:14.956930 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f83d3116-03d8-4d97-94b2-c971d97990c7 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:14.957414 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f83d3116-03d8-4d97-94b2-c971d97990c7 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:14.958093 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f83d3116-03d8-4d97-94b2-c971d97990c7 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:14.958822 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f83d3116-03d8-4d97-94b2-c971d97990c7 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:14.959277 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f83d3116-03d8-4d97-94b2-c971d97990c7 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:14.960008 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f83d3116-03d8-4d97-94b2-c971d97990c7 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:15.250104 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-f83d3116-03d8-4d97-94b2-c971d97990c7 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05d6a1722dfa4e959aeb14d601e43b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b5d812eff94e2f89d4705d7e7d5f3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:07:15.258372 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-f83d3116-03d8-4d97-94b2-c971d97990c7 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] 10.222.0.13 "GET /compute/v2.1/servers/50bf9fd1-c4c6-4d58-80a1-4ce30f50f9bb" status: 200 len: 1508 microversion: 2.1 time: 0.313939 Nov 01 19:07:15.258968 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1553/3160] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:07:14 2022] GET /compute/v2.1/servers/50bf9fd1-c4c6-4d58-80a1-4ce30f50f9bb => generated 1508 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:07:15.282300 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-91e93a85-4b54-4bed-9ce8-99569d3b8afc tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:07:15.285652 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-91e93a85-4b54-4bed-9ce8-99569d3b8afc tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] [instance: 50bf9fd1-c4c6-4d58-80a1-4ce30f50f9bb] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:07:15.293600 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-91e93a85-4b54-4bed-9ce8-99569d3b8afc tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:15.295138 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-91e93a85-4b54-4bed-9ce8-99569d3b8afc tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:15.295837 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-91e93a85-4b54-4bed-9ce8-99569d3b8afc tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:15.297043 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-91e93a85-4b54-4bed-9ce8-99569d3b8afc tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:15.297701 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-91e93a85-4b54-4bed-9ce8-99569d3b8afc tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:15.298321 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-91e93a85-4b54-4bed-9ce8-99569d3b8afc tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:15.379012 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-df1e2421-f4b4-4148-b438-e9c040ea524e tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:07:15.379902 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-df1e2421-f4b4-4148-b438-e9c040ea524e tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] [instance: d99a7f68-99ff-4c70-9e81-1c9faf6ebb7f] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:07:15.381690 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-91e93a85-4b54-4bed-9ce8-99569d3b8afc tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] 10.222.0.13 "PUT /compute/v2.1/servers/50bf9fd1-c4c6-4d58-80a1-4ce30f50f9bb" status: 200 len: 1080 microversion: 2.1 time: 0.103421 Nov 01 19:07:15.383112 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1608/3161] 10.222.0.13 () {60 vars in 1256 bytes} [Tue Nov 1 19:07:15 2022] PUT /compute/v2.1/servers/50bf9fd1-c4c6-4d58-80a1-4ce30f50f9bb => generated 1080 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:07:15.395897 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-df1e2421-f4b4-4148-b438-e9c040ea524e tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:15.396418 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-df1e2421-f4b4-4148-b438-e9c040ea524e tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:15.402533 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-df1e2421-f4b4-4148-b438-e9c040ea524e tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:15.404974 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-df1e2421-f4b4-4148-b438-e9c040ea524e tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:15.405651 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-df1e2421-f4b4-4148-b438-e9c040ea524e tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:15.406342 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-df1e2421-f4b4-4148-b438-e9c040ea524e tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:15.422786 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-1084d71c-309d-4841-beca-33de2bdcb9eb tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:07:15.427206 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-1084d71c-309d-4841-beca-33de2bdcb9eb tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] [instance: 50bf9fd1-c4c6-4d58-80a1-4ce30f50f9bb] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:07:15.442941 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-1084d71c-309d-4841-beca-33de2bdcb9eb tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:15.443793 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-1084d71c-309d-4841-beca-33de2bdcb9eb tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:15.445433 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-1084d71c-309d-4841-beca-33de2bdcb9eb tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:15.446241 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-1084d71c-309d-4841-beca-33de2bdcb9eb tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:15.451177 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-1084d71c-309d-4841-beca-33de2bdcb9eb tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:15.451733 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-1084d71c-309d-4841-beca-33de2bdcb9eb tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:15.674911 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-df1e2421-f4b4-4148-b438-e9c040ea524e tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '058480d92c9b4ab4af6815d0438a65c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee9dc49b89143f781e4ab30296e4d01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:07:15.686075 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-df1e2421-f4b4-4148-b438-e9c040ea524e tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] 10.222.0.13 "GET /compute/v2.1/servers/d99a7f68-99ff-4c70-9e81-1c9faf6ebb7f" status: 200 len: 1315 microversion: 2.1 time: 0.312406 Nov 01 19:07:15.687943 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1554/3162] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:07:15 2022] GET /compute/v2.1/servers/d99a7f68-99ff-4c70-9e81-1c9faf6ebb7f => generated 1315 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:07:15.694098 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-139053eb-9b11-4df0-95c7-b5926ad62210 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:07:15.694709 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-139053eb-9b11-4df0-95c7-b5926ad62210 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] [instance: ba6ffc5c-84a4-40f1-bdc7-f87dde2c99df] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:07:15.714345 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-139053eb-9b11-4df0-95c7-b5926ad62210 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:15.715062 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-139053eb-9b11-4df0-95c7-b5926ad62210 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:15.715680 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-139053eb-9b11-4df0-95c7-b5926ad62210 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:15.716686 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-139053eb-9b11-4df0-95c7-b5926ad62210 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:15.717363 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-139053eb-9b11-4df0-95c7-b5926ad62210 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:15.717948 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-139053eb-9b11-4df0-95c7-b5926ad62210 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:15.934120 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-1084d71c-309d-4841-beca-33de2bdcb9eb tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05d6a1722dfa4e959aeb14d601e43b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b5d812eff94e2f89d4705d7e7d5f3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:07:15.942591 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-1084d71c-309d-4841-beca-33de2bdcb9eb tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] 10.222.0.13 "GET /compute/v2.1/servers/50bf9fd1-c4c6-4d58-80a1-4ce30f50f9bb" status: 200 len: 1506 microversion: 2.1 time: 0.531294 Nov 01 19:07:15.943648 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1609/3163] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:07:15 2022] GET /compute/v2.1/servers/50bf9fd1-c4c6-4d58-80a1-4ce30f50f9bb => generated 1506 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:07:15.949264 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-7c40f35a-6bc3-4ccb-ae4e-74b5770cd3ad tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:07:15.950095 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-7c40f35a-6bc3-4ccb-ae4e-74b5770cd3ad tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] [instance: a3e21508-14b3-4a32-911a-86699cc0f1aa] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:07:15.956734 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-7c40f35a-6bc3-4ccb-ae4e-74b5770cd3ad tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:15.963213 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-7c40f35a-6bc3-4ccb-ae4e-74b5770cd3ad tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:15.964883 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-7c40f35a-6bc3-4ccb-ae4e-74b5770cd3ad tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:15.965845 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-7c40f35a-6bc3-4ccb-ae4e-74b5770cd3ad tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:15.966605 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-7c40f35a-6bc3-4ccb-ae4e-74b5770cd3ad tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:15.968064 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-7c40f35a-6bc3-4ccb-ae4e-74b5770cd3ad tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:16.107732 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-139053eb-9b11-4df0-95c7-b5926ad62210 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd2105b0264b48d084d0e79cabff8bc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf4adda91364dab94830347c06e3957', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:07:16.122521 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-139053eb-9b11-4df0-95c7-b5926ad62210 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd2105b0264b48d084d0e79cabff8bc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf4adda91364dab94830347c06e3957', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:07:16.124889 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-139053eb-9b11-4df0-95c7-b5926ad62210 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd2105b0264b48d084d0e79cabff8bc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf4adda91364dab94830347c06e3957', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:07:16.127008 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-139053eb-9b11-4df0-95c7-b5926ad62210 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] 10.222.0.13 "GET /compute/v2.1/servers/ba6ffc5c-84a4-40f1-bdc7-f87dde2c99df" status: 200 len: 1875 microversion: 2.32 time: 0.436998 Nov 01 19:07:16.128664 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1555/3164] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 19:07:15 2022] GET /compute/v2.1/servers/ba6ffc5c-84a4-40f1-bdc7-f87dde2c99df => generated 1875 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 19:07:16.134118 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-a54710c2-46b9-4df5-aad1-6e4c0ad09d02 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:07:16.135237 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-a54710c2-46b9-4df5-aad1-6e4c0ad09d02 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] [instance: 50bf9fd1-c4c6-4d58-80a1-4ce30f50f9bb] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:07:16.143155 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-a54710c2-46b9-4df5-aad1-6e4c0ad09d02 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:16.145539 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-a54710c2-46b9-4df5-aad1-6e4c0ad09d02 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:16.146256 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-a54710c2-46b9-4df5-aad1-6e4c0ad09d02 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:16.147361 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-a54710c2-46b9-4df5-aad1-6e4c0ad09d02 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:16.148311 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-a54710c2-46b9-4df5-aad1-6e4c0ad09d02 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:16.148988 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-a54710c2-46b9-4df5-aad1-6e4c0ad09d02 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:16.502568 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-a54710c2-46b9-4df5-aad1-6e4c0ad09d02 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05d6a1722dfa4e959aeb14d601e43b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b5d812eff94e2f89d4705d7e7d5f3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:07:16.517750 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-7c40f35a-6bc3-4ccb-ae4e-74b5770cd3ad tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113bd8c844ee490b86a68bc7e1e75da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '851785a5f76548898a77d67792888504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:07:16.526968 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-7c40f35a-6bc3-4ccb-ae4e-74b5770cd3ad tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] 10.222.0.13 "GET /compute/v2.1/servers/a3e21508-14b3-4a32-911a-86699cc0f1aa" status: 200 len: 1320 microversion: 2.1 time: 0.581342 Nov 01 19:07:16.528483 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-a54710c2-46b9-4df5-aad1-6e4c0ad09d02 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] 10.222.0.13 "GET /compute/v2.1/servers/50bf9fd1-c4c6-4d58-80a1-4ce30f50f9bb" status: 200 len: 1506 microversion: 2.1 time: 0.398338 Nov 01 19:07:16.543190 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1556/3165] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:07:16 2022] GET /compute/v2.1/servers/50bf9fd1-c4c6-4d58-80a1-4ce30f50f9bb => generated 1506 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:07:16.563352 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [req-1c32ec99-921e-453a-8a16-e0e8f579debd req-9e811339-b109-40ce-b21b-b1e76438c126 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a3e21508-14b3-4a32-911a-86699cc0f1aa", "tag": "39bd1d84-a8ad-4509-85bc-21bb62289695"}]} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:07:16.563623 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1610/3166] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:07:15 2022] GET /compute/v2.1/servers/a3e21508-14b3-4a32-911a-86699cc0f1aa => generated 1320 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:07:16.568410 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-5b976a94-9592-4c52-bc17-3048e7410ccf tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "MANUAL"}} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:07:16.572320 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-5b976a94-9592-4c52-bc17-3048e7410ccf tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] [instance: 50bf9fd1-c4c6-4d58-80a1-4ce30f50f9bb] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:07:16.584431 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-5b976a94-9592-4c52-bc17-3048e7410ccf tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:16.585170 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-5b976a94-9592-4c52-bc17-3048e7410ccf tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:16.585777 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-5b976a94-9592-4c52-bc17-3048e7410ccf tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:16.586130 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-1c32ec99-921e-453a-8a16-e0e8f579debd req-9e811339-b109-40ce-b21b-b1e76438c126 service nova] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:16.586726 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-1c32ec99-921e-453a-8a16-e0e8f579debd req-9e811339-b109-40ce-b21b-b1e76438c126 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:16.587049 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-5b976a94-9592-4c52-bc17-3048e7410ccf tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:16.587364 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-1c32ec99-921e-453a-8a16-e0e8f579debd req-9e811339-b109-40ce-b21b-b1e76438c126 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:16.587840 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-5b976a94-9592-4c52-bc17-3048e7410ccf tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:16.588509 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-5b976a94-9592-4c52-bc17-3048e7410ccf tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:16.609202 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.compute.server_external_events [req-1c32ec99-921e-453a-8a16-e0e8f579debd req-9e811339-b109-40ce-b21b-b1e76438c126 service nova] Creating event network-changed:39bd1d84-a8ad-4509-85bc-21bb62289695 for instance a3e21508-14b3-4a32-911a-86699cc0f1aa on n-h2-863052-2 Nov 01 19:07:16.623606 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [req-1c32ec99-921e-453a-8a16-e0e8f579debd req-9e811339-b109-40ce-b21b-b1e76438c126 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077097 Nov 01 19:07:16.625188 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1557/3167] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Nov 1 19:07:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:07:16.712242 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-7ce96252-a97f-4c84-b8ce-0423e971b5ae tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:07:16.712976 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-7ce96252-a97f-4c84-b8ce-0423e971b5ae tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] [instance: d99a7f68-99ff-4c70-9e81-1c9faf6ebb7f] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:07:16.735579 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-7ce96252-a97f-4c84-b8ce-0423e971b5ae tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:16.736176 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-7ce96252-a97f-4c84-b8ce-0423e971b5ae tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:16.736653 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-7ce96252-a97f-4c84-b8ce-0423e971b5ae tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:16.737401 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-7ce96252-a97f-4c84-b8ce-0423e971b5ae tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:16.737870 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-7ce96252-a97f-4c84-b8ce-0423e971b5ae tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:16.738302 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-7ce96252-a97f-4c84-b8ce-0423e971b5ae tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:16.764388 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-5b976a94-9592-4c52-bc17-3048e7410ccf tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] 10.222.0.13 "PUT /compute/v2.1/servers/50bf9fd1-c4c6-4d58-80a1-4ce30f50f9bb" status: 200 len: 1082 microversion: 2.1 time: 0.199576 Nov 01 19:07:16.765729 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1611/3168] 10.222.0.13 () {60 vars in 1256 bytes} [Tue Nov 1 19:07:16 2022] PUT /compute/v2.1/servers/50bf9fd1-c4c6-4d58-80a1-4ce30f50f9bb => generated 1082 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:07:16.784976 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-682bbc9b-e3cb-4539-ae54-e520356e777b tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:07:16.785822 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-682bbc9b-e3cb-4539-ae54-e520356e777b tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] [instance: 50bf9fd1-c4c6-4d58-80a1-4ce30f50f9bb] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:07:16.794425 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-682bbc9b-e3cb-4539-ae54-e520356e777b tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:16.795272 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-682bbc9b-e3cb-4539-ae54-e520356e777b tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:16.796037 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-682bbc9b-e3cb-4539-ae54-e520356e777b tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:16.797011 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-682bbc9b-e3cb-4539-ae54-e520356e777b tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:16.797634 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-682bbc9b-e3cb-4539-ae54-e520356e777b tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:16.798278 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-682bbc9b-e3cb-4539-ae54-e520356e777b tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:17.039518 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-7ce96252-a97f-4c84-b8ce-0423e971b5ae tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '058480d92c9b4ab4af6815d0438a65c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee9dc49b89143f781e4ab30296e4d01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:07:17.050765 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-682bbc9b-e3cb-4539-ae54-e520356e777b tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05d6a1722dfa4e959aeb14d601e43b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b5d812eff94e2f89d4705d7e7d5f3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:07:17.051925 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-7ce96252-a97f-4c84-b8ce-0423e971b5ae tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] 10.222.0.13 "GET /compute/v2.1/servers/d99a7f68-99ff-4c70-9e81-1c9faf6ebb7f" status: 200 len: 1315 microversion: 2.1 time: 0.344155 Nov 01 19:07:17.057970 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1558/3169] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:07:16 2022] GET /compute/v2.1/servers/d99a7f68-99ff-4c70-9e81-1c9faf6ebb7f => generated 1315 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:07:17.065245 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-682bbc9b-e3cb-4539-ae54-e520356e777b tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] 10.222.0.13 "GET /compute/v2.1/servers/50bf9fd1-c4c6-4d58-80a1-4ce30f50f9bb" status: 200 len: 1508 microversion: 2.1 time: 0.284255 Nov 01 19:07:17.066410 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1612/3170] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:07:16 2022] GET /compute/v2.1/servers/50bf9fd1-c4c6-4d58-80a1-4ce30f50f9bb => generated 1508 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 19:07:17.098627 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-dd8094fa-3fd1-46a0-a57c-b35007ebb314 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:07:17.099570 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-dd8094fa-3fd1-46a0-a57c-b35007ebb314 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] [instance: 50bf9fd1-c4c6-4d58-80a1-4ce30f50f9bb] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:07:17.108320 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-dd8094fa-3fd1-46a0-a57c-b35007ebb314 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:17.109103 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-dd8094fa-3fd1-46a0-a57c-b35007ebb314 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:17.109703 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-dd8094fa-3fd1-46a0-a57c-b35007ebb314 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:17.110624 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-dd8094fa-3fd1-46a0-a57c-b35007ebb314 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:17.111242 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-dd8094fa-3fd1-46a0-a57c-b35007ebb314 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:17.111853 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-dd8094fa-3fd1-46a0-a57c-b35007ebb314 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:17.169596 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-fe24e1c9-334c-4b02-82f8-b94726d29c4d tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:07:17.170564 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-fe24e1c9-334c-4b02-82f8-b94726d29c4d tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] [instance: ba6ffc5c-84a4-40f1-bdc7-f87dde2c99df] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:07:17.184014 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-fe24e1c9-334c-4b02-82f8-b94726d29c4d tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:17.185066 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-fe24e1c9-334c-4b02-82f8-b94726d29c4d tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:17.186700 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-fe24e1c9-334c-4b02-82f8-b94726d29c4d tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:17.192639 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-fe24e1c9-334c-4b02-82f8-b94726d29c4d tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:17.194750 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-fe24e1c9-334c-4b02-82f8-b94726d29c4d tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:17.196607 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-fe24e1c9-334c-4b02-82f8-b94726d29c4d tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:17.312677 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-dd8094fa-3fd1-46a0-a57c-b35007ebb314 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05d6a1722dfa4e959aeb14d601e43b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b5d812eff94e2f89d4705d7e7d5f3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:07:17.321092 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-dd8094fa-3fd1-46a0-a57c-b35007ebb314 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] 10.222.0.13 "GET /compute/v2.1/servers/50bf9fd1-c4c6-4d58-80a1-4ce30f50f9bb" status: 200 len: 1508 microversion: 2.1 time: 0.227082 Nov 01 19:07:17.321774 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1559/3171] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:07:17 2022] GET /compute/v2.1/servers/50bf9fd1-c4c6-4d58-80a1-4ce30f50f9bb => generated 1508 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:07:17.344437 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-02932815-f037-4e42-9560-d29a0231c2f4 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:07:17.345005 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-02932815-f037-4e42-9560-d29a0231c2f4 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] [instance: 50bf9fd1-c4c6-4d58-80a1-4ce30f50f9bb] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:07:17.353062 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-02932815-f037-4e42-9560-d29a0231c2f4 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:17.353845 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-02932815-f037-4e42-9560-d29a0231c2f4 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:17.355089 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-02932815-f037-4e42-9560-d29a0231c2f4 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:17.356026 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-02932815-f037-4e42-9560-d29a0231c2f4 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:17.356672 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-02932815-f037-4e42-9560-d29a0231c2f4 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:17.357328 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-02932815-f037-4e42-9560-d29a0231c2f4 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:17.390528 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-02932815-f037-4e42-9560-d29a0231c2f4 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] [instance: 50bf9fd1-c4c6-4d58-80a1-4ce30f50f9bb] Going to try to terminate instance {{(pid=121402) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 01 19:07:17.511586 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-02932815-f037-4e42-9560-d29a0231c2f4 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] 10.222.0.13 "DELETE /compute/v2.1/servers/50bf9fd1-c4c6-4d58-80a1-4ce30f50f9bb" status: 204 len: 0 microversion: 2.1 time: 0.171301 Nov 01 19:07:17.513383 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1560/3172] 10.222.0.13 () {58 vars in 1239 bytes} [Tue Nov 1 19:07:17 2022] DELETE /compute/v2.1/servers/50bf9fd1-c4c6-4d58-80a1-4ce30f50f9bb => generated 0 bytes in 174 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 01 19:07:17.527502 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-93cf7001-cd3f-4705-b496-bfdf94ecfaa5 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:07:17.528170 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-93cf7001-cd3f-4705-b496-bfdf94ecfaa5 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] [instance: 50bf9fd1-c4c6-4d58-80a1-4ce30f50f9bb] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:07:17.535057 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-93cf7001-cd3f-4705-b496-bfdf94ecfaa5 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:17.535616 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-93cf7001-cd3f-4705-b496-bfdf94ecfaa5 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:17.536142 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-93cf7001-cd3f-4705-b496-bfdf94ecfaa5 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:17.536952 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-93cf7001-cd3f-4705-b496-bfdf94ecfaa5 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:17.537540 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-93cf7001-cd3f-4705-b496-bfdf94ecfaa5 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:17.538043 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-93cf7001-cd3f-4705-b496-bfdf94ecfaa5 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:17.576964 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-93cf7001-cd3f-4705-b496-bfdf94ecfaa5 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] [instance: 50bf9fd1-c4c6-4d58-80a1-4ce30f50f9bb] Going to try to terminate instance {{(pid=121402) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 01 19:07:17.583179 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-fe24e1c9-334c-4b02-82f8-b94726d29c4d tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd2105b0264b48d084d0e79cabff8bc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf4adda91364dab94830347c06e3957', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:07:17.594107 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-fe24e1c9-334c-4b02-82f8-b94726d29c4d tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd2105b0264b48d084d0e79cabff8bc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf4adda91364dab94830347c06e3957', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:07:17.596311 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-fe24e1c9-334c-4b02-82f8-b94726d29c4d tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd2105b0264b48d084d0e79cabff8bc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf4adda91364dab94830347c06e3957', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:07:17.598276 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-fe24e1c9-334c-4b02-82f8-b94726d29c4d tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] 10.222.0.13 "GET /compute/v2.1/servers/ba6ffc5c-84a4-40f1-bdc7-f87dde2c99df" status: 200 len: 1875 microversion: 2.32 time: 0.443610 Nov 01 19:07:17.599050 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1613/3173] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 19:07:17 2022] GET /compute/v2.1/servers/ba6ffc5c-84a4-40f1-bdc7-f87dde2c99df => generated 1875 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 01 19:07:17.618387 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-c607a3d6-a3df-4a6d-89ae-107e451ad85d tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:07:17.623959 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-c607a3d6-a3df-4a6d-89ae-107e451ad85d tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] [instance: a3e21508-14b3-4a32-911a-86699cc0f1aa] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:07:17.630354 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-c607a3d6-a3df-4a6d-89ae-107e451ad85d tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:17.631134 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-c607a3d6-a3df-4a6d-89ae-107e451ad85d tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:17.631800 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-c607a3d6-a3df-4a6d-89ae-107e451ad85d tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:17.632722 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-c607a3d6-a3df-4a6d-89ae-107e451ad85d tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:17.633833 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-c607a3d6-a3df-4a6d-89ae-107e451ad85d tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:17.634319 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-c607a3d6-a3df-4a6d-89ae-107e451ad85d tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:17.649358 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.compute.api [None req-93cf7001-cd3f-4705-b496-bfdf94ecfaa5 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] [instance: 50bf9fd1-c4c6-4d58-80a1-4ce30f50f9bb] Instance is already in deleting state, ignoring this request Nov 01 19:07:17.650376 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-93cf7001-cd3f-4705-b496-bfdf94ecfaa5 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] 10.222.0.13 "DELETE /compute/v2.1/servers/50bf9fd1-c4c6-4d58-80a1-4ce30f50f9bb" status: 204 len: 0 microversion: 2.1 time: 0.128437 Nov 01 19:07:17.655152 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1561/3174] 10.222.0.13 () {58 vars in 1239 bytes} [Tue Nov 1 19:07:17 2022] DELETE /compute/v2.1/servers/50bf9fd1-c4c6-4d58-80a1-4ce30f50f9bb => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 01 19:07:17.660204 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-9666d3b9-801b-4a1e-9243-14faa8cdfcd4 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:07:17.660858 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-9666d3b9-801b-4a1e-9243-14faa8cdfcd4 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] [instance: 50bf9fd1-c4c6-4d58-80a1-4ce30f50f9bb] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:07:17.667837 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-9666d3b9-801b-4a1e-9243-14faa8cdfcd4 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:17.668334 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-9666d3b9-801b-4a1e-9243-14faa8cdfcd4 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:17.668802 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-9666d3b9-801b-4a1e-9243-14faa8cdfcd4 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:17.669505 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-9666d3b9-801b-4a1e-9243-14faa8cdfcd4 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:17.669963 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-9666d3b9-801b-4a1e-9243-14faa8cdfcd4 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:17.670395 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-9666d3b9-801b-4a1e-9243-14faa8cdfcd4 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:17.692057 n-d-863052-2 devstack@n-api.service[121402]: DEBUG dbcounter [-] [121402] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 19:07:17.832074 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-9666d3b9-801b-4a1e-9243-14faa8cdfcd4 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05d6a1722dfa4e959aeb14d601e43b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b5d812eff94e2f89d4705d7e7d5f3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:07:17.841159 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-9666d3b9-801b-4a1e-9243-14faa8cdfcd4 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] 10.222.0.13 "GET /compute/v2.1/servers/50bf9fd1-c4c6-4d58-80a1-4ce30f50f9bb" status: 200 len: 1514 microversion: 2.1 time: 0.184906 Nov 01 19:07:17.852951 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1562/3175] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:07:17 2022] GET /compute/v2.1/servers/50bf9fd1-c4c6-4d58-80a1-4ce30f50f9bb => generated 1514 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:07:17.870336 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-c607a3d6-a3df-4a6d-89ae-107e451ad85d tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113bd8c844ee490b86a68bc7e1e75da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '851785a5f76548898a77d67792888504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:07:17.878436 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-c607a3d6-a3df-4a6d-89ae-107e451ad85d tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] 10.222.0.13 "GET /compute/v2.1/servers/a3e21508-14b3-4a32-911a-86699cc0f1aa" status: 200 len: 1320 microversion: 2.1 time: 0.263885 Nov 01 19:07:17.879037 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1614/3176] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:07:17 2022] GET /compute/v2.1/servers/a3e21508-14b3-4a32-911a-86699cc0f1aa => generated 1320 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:07:18.089049 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-df4a3cc0-30bd-4db6-a74b-a92db2703eba tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:07:18.090503 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-df4a3cc0-30bd-4db6-a74b-a92db2703eba tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] [instance: d99a7f68-99ff-4c70-9e81-1c9faf6ebb7f] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:07:18.096634 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-df4a3cc0-30bd-4db6-a74b-a92db2703eba tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:18.097334 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-df4a3cc0-30bd-4db6-a74b-a92db2703eba tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:18.097871 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-df4a3cc0-30bd-4db6-a74b-a92db2703eba tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:18.098607 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-df4a3cc0-30bd-4db6-a74b-a92db2703eba tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:18.099061 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-df4a3cc0-30bd-4db6-a74b-a92db2703eba tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:18.099482 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-df4a3cc0-30bd-4db6-a74b-a92db2703eba tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:18.260037 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-df4a3cc0-30bd-4db6-a74b-a92db2703eba tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '058480d92c9b4ab4af6815d0438a65c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee9dc49b89143f781e4ab30296e4d01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:07:18.269104 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-df4a3cc0-30bd-4db6-a74b-a92db2703eba tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] 10.222.0.13 "GET /compute/v2.1/servers/d99a7f68-99ff-4c70-9e81-1c9faf6ebb7f" status: 200 len: 1315 microversion: 2.1 time: 0.184507 Nov 01 19:07:18.269685 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1563/3177] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:07:18 2022] GET /compute/v2.1/servers/d99a7f68-99ff-4c70-9e81-1c9faf6ebb7f => generated 1315 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:07:18.631122 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-0951f33a-343b-4bc1-884c-fa9dc8ed395e tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:07:18.631660 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-0951f33a-343b-4bc1-884c-fa9dc8ed395e tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] [instance: ba6ffc5c-84a4-40f1-bdc7-f87dde2c99df] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:07:18.640016 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-0951f33a-343b-4bc1-884c-fa9dc8ed395e tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:18.654478 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-0951f33a-343b-4bc1-884c-fa9dc8ed395e tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:18.661179 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-0951f33a-343b-4bc1-884c-fa9dc8ed395e tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:18.663598 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-0951f33a-343b-4bc1-884c-fa9dc8ed395e tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:18.676247 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-0951f33a-343b-4bc1-884c-fa9dc8ed395e tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:18.686127 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-0951f33a-343b-4bc1-884c-fa9dc8ed395e tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:18.867800 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-d72188f8-41ef-497c-a09b-c5defab423b5 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:07:18.868508 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-d72188f8-41ef-497c-a09b-c5defab423b5 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] [instance: 50bf9fd1-c4c6-4d58-80a1-4ce30f50f9bb] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:07:18.872716 n-d-863052-2 devstack@n-api.service[121402]: DEBUG dbcounter [-] [121402] Writing DB stats nova_cell0:SELECT=2 {{(pid=121402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 19:07:18.879299 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-d72188f8-41ef-497c-a09b-c5defab423b5 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:18.879611 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-d72188f8-41ef-497c-a09b-c5defab423b5 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:18.880470 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-d72188f8-41ef-497c-a09b-c5defab423b5 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:18.881298 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-d72188f8-41ef-497c-a09b-c5defab423b5 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:18.881711 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-d72188f8-41ef-497c-a09b-c5defab423b5 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:18.882139 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-d72188f8-41ef-497c-a09b-c5defab423b5 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:18.995455 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-0951f33a-343b-4bc1-884c-fa9dc8ed395e tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd2105b0264b48d084d0e79cabff8bc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf4adda91364dab94830347c06e3957', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:07:19.014820 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-0951f33a-343b-4bc1-884c-fa9dc8ed395e tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd2105b0264b48d084d0e79cabff8bc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf4adda91364dab94830347c06e3957', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:07:19.018941 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-0951f33a-343b-4bc1-884c-fa9dc8ed395e tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd2105b0264b48d084d0e79cabff8bc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf4adda91364dab94830347c06e3957', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:07:19.020531 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-0951f33a-343b-4bc1-884c-fa9dc8ed395e tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] 10.222.0.13 "GET /compute/v2.1/servers/ba6ffc5c-84a4-40f1-bdc7-f87dde2c99df" status: 200 len: 1875 microversion: 2.32 time: 0.393584 Nov 01 19:07:19.021298 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1615/3178] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 19:07:18 2022] GET /compute/v2.1/servers/ba6ffc5c-84a4-40f1-bdc7-f87dde2c99df => generated 1875 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 01 19:07:19.029675 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-84c5866b-f8a0-47c0-b6fa-a13c37c36249 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:07:19.030554 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-84c5866b-f8a0-47c0-b6fa-a13c37c36249 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] [instance: a3e21508-14b3-4a32-911a-86699cc0f1aa] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:07:19.039180 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-84c5866b-f8a0-47c0-b6fa-a13c37c36249 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:19.040013 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-84c5866b-f8a0-47c0-b6fa-a13c37c36249 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:19.040726 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-84c5866b-f8a0-47c0-b6fa-a13c37c36249 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:19.042329 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-84c5866b-f8a0-47c0-b6fa-a13c37c36249 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:19.043049 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-84c5866b-f8a0-47c0-b6fa-a13c37c36249 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:19.043728 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-84c5866b-f8a0-47c0-b6fa-a13c37c36249 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:19.074178 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-d72188f8-41ef-497c-a09b-c5defab423b5 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05d6a1722dfa4e959aeb14d601e43b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b5d812eff94e2f89d4705d7e7d5f3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:07:19.084877 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-d72188f8-41ef-497c-a09b-c5defab423b5 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] 10.222.0.13 "GET /compute/v2.1/servers/50bf9fd1-c4c6-4d58-80a1-4ce30f50f9bb" status: 200 len: 1514 microversion: 2.1 time: 0.222707 Nov 01 19:07:19.098081 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1564/3179] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:07:18 2022] GET /compute/v2.1/servers/50bf9fd1-c4c6-4d58-80a1-4ce30f50f9bb => generated 1514 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:07:19.287891 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-84c5866b-f8a0-47c0-b6fa-a13c37c36249 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113bd8c844ee490b86a68bc7e1e75da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '851785a5f76548898a77d67792888504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:07:19.291122 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-1011d5a2-b25f-4d77-9be7-057915d03379 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:07:19.292277 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-1011d5a2-b25f-4d77-9be7-057915d03379 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] [instance: d99a7f68-99ff-4c70-9e81-1c9faf6ebb7f] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:07:19.299492 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-1011d5a2-b25f-4d77-9be7-057915d03379 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:19.300293 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-1011d5a2-b25f-4d77-9be7-057915d03379 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:19.300987 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-1011d5a2-b25f-4d77-9be7-057915d03379 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:19.301651 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-84c5866b-f8a0-47c0-b6fa-a13c37c36249 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] 10.222.0.13 "GET /compute/v2.1/servers/a3e21508-14b3-4a32-911a-86699cc0f1aa" status: 200 len: 1320 microversion: 2.1 time: 0.278288 Nov 01 19:07:19.301783 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-1011d5a2-b25f-4d77-9be7-057915d03379 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:19.302264 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-1011d5a2-b25f-4d77-9be7-057915d03379 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:19.302902 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-1011d5a2-b25f-4d77-9be7-057915d03379 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:19.316763 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1616/3180] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:07:19 2022] GET /compute/v2.1/servers/a3e21508-14b3-4a32-911a-86699cc0f1aa => generated 1320 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:07:19.434353 n-d-863052-2 devstack@n-api.service[121402]: DEBUG dbcounter [-] [121402] Writing DB stats nova_cell0:SELECT=8 {{(pid=121402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 19:07:19.474155 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-1011d5a2-b25f-4d77-9be7-057915d03379 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '058480d92c9b4ab4af6815d0438a65c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee9dc49b89143f781e4ab30296e4d01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:07:19.483270 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-1011d5a2-b25f-4d77-9be7-057915d03379 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] 10.222.0.13 "GET /compute/v2.1/servers/d99a7f68-99ff-4c70-9e81-1c9faf6ebb7f" status: 200 len: 1315 microversion: 2.1 time: 0.195848 Nov 01 19:07:19.484056 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1565/3181] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:07:19 2022] GET /compute/v2.1/servers/d99a7f68-99ff-4c70-9e81-1c9faf6ebb7f => generated 1315 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 19:07:20.055120 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-62738427-15b0-4739-81b3-da66f0e5d7e2 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:07:20.056358 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-62738427-15b0-4739-81b3-da66f0e5d7e2 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] [instance: ba6ffc5c-84a4-40f1-bdc7-f87dde2c99df] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:07:20.067956 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-62738427-15b0-4739-81b3-da66f0e5d7e2 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:20.068852 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-62738427-15b0-4739-81b3-da66f0e5d7e2 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:20.069479 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-62738427-15b0-4739-81b3-da66f0e5d7e2 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:20.070457 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-62738427-15b0-4739-81b3-da66f0e5d7e2 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:20.071213 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-62738427-15b0-4739-81b3-da66f0e5d7e2 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:20.072852 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-62738427-15b0-4739-81b3-da66f0e5d7e2 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:20.111974 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-bba7f6a2-ec2f-445d-95cd-e8ccb6783117 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:07:20.113492 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-bba7f6a2-ec2f-445d-95cd-e8ccb6783117 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] [instance: 50bf9fd1-c4c6-4d58-80a1-4ce30f50f9bb] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:07:20.125146 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-bba7f6a2-ec2f-445d-95cd-e8ccb6783117 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:20.127586 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-bba7f6a2-ec2f-445d-95cd-e8ccb6783117 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:20.127961 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-bba7f6a2-ec2f-445d-95cd-e8ccb6783117 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:20.128715 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-bba7f6a2-ec2f-445d-95cd-e8ccb6783117 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:20.129180 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-bba7f6a2-ec2f-445d-95cd-e8ccb6783117 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:20.129603 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-bba7f6a2-ec2f-445d-95cd-e8ccb6783117 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:20.427029 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-62738427-15b0-4739-81b3-da66f0e5d7e2 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd2105b0264b48d084d0e79cabff8bc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf4adda91364dab94830347c06e3957', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:07:20.458053 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-62738427-15b0-4739-81b3-da66f0e5d7e2 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd2105b0264b48d084d0e79cabff8bc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf4adda91364dab94830347c06e3957', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:07:20.462258 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-62738427-15b0-4739-81b3-da66f0e5d7e2 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd2105b0264b48d084d0e79cabff8bc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf4adda91364dab94830347c06e3957', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:07:20.466972 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-62738427-15b0-4739-81b3-da66f0e5d7e2 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] 10.222.0.13 "GET /compute/v2.1/servers/ba6ffc5c-84a4-40f1-bdc7-f87dde2c99df" status: 200 len: 1875 microversion: 2.32 time: 0.422368 Nov 01 19:07:20.467599 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1617/3182] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 19:07:20 2022] GET /compute/v2.1/servers/ba6ffc5c-84a4-40f1-bdc7-f87dde2c99df => generated 1875 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 01 19:07:20.476905 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-9e58a484-26f9-4563-a652-4d2d6b6db59f tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:07:20.480104 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-9e58a484-26f9-4563-a652-4d2d6b6db59f tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] [instance: a3e21508-14b3-4a32-911a-86699cc0f1aa] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:07:20.498520 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-9e58a484-26f9-4563-a652-4d2d6b6db59f tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:20.499046 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-9e58a484-26f9-4563-a652-4d2d6b6db59f tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:20.499492 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-9e58a484-26f9-4563-a652-4d2d6b6db59f tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:20.507755 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-9e58a484-26f9-4563-a652-4d2d6b6db59f tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:20.510076 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-9e58a484-26f9-4563-a652-4d2d6b6db59f tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:20.510609 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-9e58a484-26f9-4563-a652-4d2d6b6db59f tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:20.793203 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-9e58a484-26f9-4563-a652-4d2d6b6db59f tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113bd8c844ee490b86a68bc7e1e75da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '851785a5f76548898a77d67792888504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:07:20.804853 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-9e58a484-26f9-4563-a652-4d2d6b6db59f tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] 10.222.0.13 "GET /compute/v2.1/servers/a3e21508-14b3-4a32-911a-86699cc0f1aa" status: 200 len: 1320 microversion: 2.1 time: 0.335308 Nov 01 19:07:20.805486 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1618/3183] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:07:20 2022] GET /compute/v2.1/servers/a3e21508-14b3-4a32-911a-86699cc0f1aa => generated 1320 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:07:20.819466 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-5a65b96e-181b-470e-9e58-a5ea13247a81 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:07:20.819466 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-5a65b96e-181b-470e-9e58-a5ea13247a81 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] [instance: d99a7f68-99ff-4c70-9e81-1c9faf6ebb7f] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:07:20.831339 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-5a65b96e-181b-470e-9e58-a5ea13247a81 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:20.831846 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-5a65b96e-181b-470e-9e58-a5ea13247a81 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:20.836189 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-5a65b96e-181b-470e-9e58-a5ea13247a81 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:20.838199 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-5a65b96e-181b-470e-9e58-a5ea13247a81 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:20.840190 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-5a65b96e-181b-470e-9e58-a5ea13247a81 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:20.842488 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-5a65b96e-181b-470e-9e58-a5ea13247a81 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:20.893543 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-bba7f6a2-ec2f-445d-95cd-e8ccb6783117 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05d6a1722dfa4e959aeb14d601e43b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b5d812eff94e2f89d4705d7e7d5f3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:07:20.907903 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-bba7f6a2-ec2f-445d-95cd-e8ccb6783117 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] 10.222.0.13 "GET /compute/v2.1/servers/50bf9fd1-c4c6-4d58-80a1-4ce30f50f9bb" status: 200 len: 1514 microversion: 2.1 time: 0.800932 Nov 01 19:07:20.919796 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1566/3184] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:07:20 2022] GET /compute/v2.1/servers/50bf9fd1-c4c6-4d58-80a1-4ce30f50f9bb => generated 1514 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:07:21.073237 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-5a65b96e-181b-470e-9e58-a5ea13247a81 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '058480d92c9b4ab4af6815d0438a65c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee9dc49b89143f781e4ab30296e4d01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:07:21.086463 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-5a65b96e-181b-470e-9e58-a5ea13247a81 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] 10.222.0.13 "GET /compute/v2.1/servers/d99a7f68-99ff-4c70-9e81-1c9faf6ebb7f" status: 200 len: 1315 microversion: 2.1 time: 0.279777 Nov 01 19:07:21.089235 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1619/3185] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:07:20 2022] GET /compute/v2.1/servers/d99a7f68-99ff-4c70-9e81-1c9faf6ebb7f => generated 1315 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:07:21.150508 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-52df1e71-32e9-4b9e-8240-168f72f492ba tempest-FloatingIPsTestJSON-924588053 tempest-FloatingIPsTestJSON-924588053-project] Action: 'create', calling method: .version_select at 0x7f0ae2b3b160>, body: {"pool": null} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:07:21.318103 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [req-c3865d49-71eb-4e87-9d1b-4241b234369e req-f332e1f9-54e0-45ff-a3ef-daf58721af22 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "50bf9fd1-c4c6-4d58-80a1-4ce30f50f9bb", "name": "network-vif-deleted", "tag": "43dc29db-6693-44f1-97a6-bfd732df398a"}]} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:07:21.373782 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-c3865d49-71eb-4e87-9d1b-4241b234369e req-f332e1f9-54e0-45ff-a3ef-daf58721af22 service nova] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:21.376718 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-c3865d49-71eb-4e87-9d1b-4241b234369e req-f332e1f9-54e0-45ff-a3ef-daf58721af22 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:21.377398 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-c3865d49-71eb-4e87-9d1b-4241b234369e req-f332e1f9-54e0-45ff-a3ef-daf58721af22 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:21.400563 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.compute.server_external_events [req-c3865d49-71eb-4e87-9d1b-4241b234369e req-f332e1f9-54e0-45ff-a3ef-daf58721af22 service nova] Creating event network-vif-deleted:43dc29db-6693-44f1-97a6-bfd732df398a for instance 50bf9fd1-c4c6-4d58-80a1-4ce30f50f9bb on n-h1-863052-2 Nov 01 19:07:21.410815 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [req-c3865d49-71eb-4e87-9d1b-4241b234369e req-f332e1f9-54e0-45ff-a3ef-daf58721af22 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096514 Nov 01 19:07:21.412505 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1620/3186] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Nov 1 19:07:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:07:21.497080 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-8e850d9b-b99b-4fe0-bf7e-f0aa899106e2 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:07:21.498032 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-8e850d9b-b99b-4fe0-bf7e-f0aa899106e2 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] [instance: ba6ffc5c-84a4-40f1-bdc7-f87dde2c99df] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:07:21.508412 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-8e850d9b-b99b-4fe0-bf7e-f0aa899106e2 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:21.509345 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-8e850d9b-b99b-4fe0-bf7e-f0aa899106e2 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:21.510841 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-8e850d9b-b99b-4fe0-bf7e-f0aa899106e2 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:21.511925 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-8e850d9b-b99b-4fe0-bf7e-f0aa899106e2 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:21.514404 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-8e850d9b-b99b-4fe0-bf7e-f0aa899106e2 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:21.515988 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-8e850d9b-b99b-4fe0-bf7e-f0aa899106e2 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:21.783853 n-d-863052-2 devstack@n-api.service[121403]: DEBUG dbcounter [-] [121403] Writing DB stats nova_cell0:SELECT=6 {{(pid=121403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 19:07:21.864688 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-8e850d9b-b99b-4fe0-bf7e-f0aa899106e2 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd2105b0264b48d084d0e79cabff8bc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf4adda91364dab94830347c06e3957', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:07:21.871869 n-d-863052-2 devstack@n-api.service[121403]: DEBUG dbcounter [-] [121403] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=2 {{(pid=121403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 19:07:21.876632 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-8e850d9b-b99b-4fe0-bf7e-f0aa899106e2 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd2105b0264b48d084d0e79cabff8bc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf4adda91364dab94830347c06e3957', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:07:21.878083 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-8e850d9b-b99b-4fe0-bf7e-f0aa899106e2 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd2105b0264b48d084d0e79cabff8bc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf4adda91364dab94830347c06e3957', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:07:21.879605 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-8e850d9b-b99b-4fe0-bf7e-f0aa899106e2 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] 10.222.0.13 "GET /compute/v2.1/servers/ba6ffc5c-84a4-40f1-bdc7-f87dde2c99df" status: 200 len: 1875 microversion: 2.32 time: 0.389888 Nov 01 19:07:21.892604 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1621/3187] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 19:07:21 2022] GET /compute/v2.1/servers/ba6ffc5c-84a4-40f1-bdc7-f87dde2c99df => generated 1875 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 01 19:07:21.905655 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-5e02965c-66c0-4cce-b26f-a9735d16c59a tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:07:21.906553 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-5e02965c-66c0-4cce-b26f-a9735d16c59a tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] [instance: a3e21508-14b3-4a32-911a-86699cc0f1aa] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:07:21.913840 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-5e02965c-66c0-4cce-b26f-a9735d16c59a tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:21.914343 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-5e02965c-66c0-4cce-b26f-a9735d16c59a tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:21.914786 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-5e02965c-66c0-4cce-b26f-a9735d16c59a tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:21.915782 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-5e02965c-66c0-4cce-b26f-a9735d16c59a tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:21.917189 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-5e02965c-66c0-4cce-b26f-a9735d16c59a tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:21.918072 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-5e02965c-66c0-4cce-b26f-a9735d16c59a tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:22.022739 n-d-863052-2 devstack@n-api.service[121403]: DEBUG dbcounter [-] [121403] Writing DB stats nova_cell0:SELECT=22 {{(pid=121403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 19:07:22.185262 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-5e02965c-66c0-4cce-b26f-a9735d16c59a tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113bd8c844ee490b86a68bc7e1e75da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '851785a5f76548898a77d67792888504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:07:22.196316 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-5e02965c-66c0-4cce-b26f-a9735d16c59a tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] 10.222.0.13 "GET /compute/v2.1/servers/a3e21508-14b3-4a32-911a-86699cc0f1aa" status: 200 len: 1320 microversion: 2.1 time: 0.305811 Nov 01 19:07:22.209173 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1622/3188] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:07:21 2022] GET /compute/v2.1/servers/a3e21508-14b3-4a32-911a-86699cc0f1aa => generated 1320 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:07:22.219304 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-56b07aa6-0119-45de-8770-e0daae96848e tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:07:22.220174 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-56b07aa6-0119-45de-8770-e0daae96848e tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] [instance: 50bf9fd1-c4c6-4d58-80a1-4ce30f50f9bb] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:07:22.226501 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-56b07aa6-0119-45de-8770-e0daae96848e tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:22.227252 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-56b07aa6-0119-45de-8770-e0daae96848e tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:22.227883 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-56b07aa6-0119-45de-8770-e0daae96848e tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:22.228790 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-56b07aa6-0119-45de-8770-e0daae96848e tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:22.229952 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-56b07aa6-0119-45de-8770-e0daae96848e tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:22.230545 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-56b07aa6-0119-45de-8770-e0daae96848e tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:22.299399 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-56b07aa6-0119-45de-8770-e0daae96848e tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:22.300119 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-56b07aa6-0119-45de-8770-e0daae96848e tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:22.300752 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-56b07aa6-0119-45de-8770-e0daae96848e tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:22.301371 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.objects.instance [None req-56b07aa6-0119-45de-8770-e0daae96848e tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Lazy-loading 'fault' on Instance uuid 50bf9fd1-c4c6-4d58-80a1-4ce30f50f9bb {{(pid=121403) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 01 19:07:22.357524 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-56b07aa6-0119-45de-8770-e0daae96848e tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05d6a1722dfa4e959aeb14d601e43b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b5d812eff94e2f89d4705d7e7d5f3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:07:22.365491 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-56b07aa6-0119-45de-8770-e0daae96848e tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] 10.222.0.13 "GET /compute/v2.1/servers/50bf9fd1-c4c6-4d58-80a1-4ce30f50f9bb" status: 200 len: 1308 microversion: 2.1 time: 0.150096 Nov 01 19:07:22.382467 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1623/3189] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:07:22 2022] GET /compute/v2.1/servers/50bf9fd1-c4c6-4d58-80a1-4ce30f50f9bb => generated 1308 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:07:22.389986 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-e62c3c32-c3c7-4711-a2cc-6437ce12dd4a tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:07:22.390983 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-e62c3c32-c3c7-4711-a2cc-6437ce12dd4a tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] [instance: d99a7f68-99ff-4c70-9e81-1c9faf6ebb7f] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:07:22.399530 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-e62c3c32-c3c7-4711-a2cc-6437ce12dd4a tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:22.400293 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-e62c3c32-c3c7-4711-a2cc-6437ce12dd4a tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:22.401838 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-e62c3c32-c3c7-4711-a2cc-6437ce12dd4a tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:22.403451 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-e62c3c32-c3c7-4711-a2cc-6437ce12dd4a tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:22.404148 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-e62c3c32-c3c7-4711-a2cc-6437ce12dd4a tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:22.404943 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-e62c3c32-c3c7-4711-a2cc-6437ce12dd4a tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:22.605605 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-e62c3c32-c3c7-4711-a2cc-6437ce12dd4a tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '058480d92c9b4ab4af6815d0438a65c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee9dc49b89143f781e4ab30296e4d01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:07:22.616716 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-e62c3c32-c3c7-4711-a2cc-6437ce12dd4a tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] 10.222.0.13 "GET /compute/v2.1/servers/d99a7f68-99ff-4c70-9e81-1c9faf6ebb7f" status: 200 len: 1315 microversion: 2.1 time: 0.231807 Nov 01 19:07:22.617697 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1624/3190] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:07:22 2022] GET /compute/v2.1/servers/d99a7f68-99ff-4c70-9e81-1c9faf6ebb7f => generated 1315 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:07:22.905417 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-c0836326-849e-4e45-a1f8-b37c9c9dc7fc tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:07:22.906318 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-c0836326-849e-4e45-a1f8-b37c9c9dc7fc tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] [instance: ba6ffc5c-84a4-40f1-bdc7-f87dde2c99df] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:07:22.913218 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-c0836326-849e-4e45-a1f8-b37c9c9dc7fc tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:22.913850 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-c0836326-849e-4e45-a1f8-b37c9c9dc7fc tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:22.914481 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-c0836326-849e-4e45-a1f8-b37c9c9dc7fc tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:22.915380 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-c0836326-849e-4e45-a1f8-b37c9c9dc7fc tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:22.915943 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-c0836326-849e-4e45-a1f8-b37c9c9dc7fc tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:22.916788 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-c0836326-849e-4e45-a1f8-b37c9c9dc7fc tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:22.925399 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-52df1e71-32e9-4b9e-8240-168f72f492ba tempest-FloatingIPsTestJSON-924588053 tempest-FloatingIPsTestJSON-924588053-project] 10.222.0.13 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 1.923732 Nov 01 19:07:22.937675 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1567/3191] 10.222.0.13 () {60 vars in 1170 bytes} [Tue Nov 1 19:07:21 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 1929 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 01 19:07:22.943734 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-0ef58928-d78d-4e73-86d2-6be1d7af378f tempest-FloatingIPsTestJSON-924588053 tempest-FloatingIPsTestJSON-924588053-project] Calling method '.version_select at 0x7f0ae1d5bf70>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:07:23.169384 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-0ef58928-d78d-4e73-86d2-6be1d7af378f tempest-FloatingIPsTestJSON-924588053 tempest-FloatingIPsTestJSON-924588053-project] 10.222.0.13 "GET /compute/v2.1/os-floating-ips/01745fb8-809a-49b0-9087-715e19bd7413" status: 200 len: 141 microversion: 2.1 time: 0.230083 Nov 01 19:07:23.169997 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1568/3192] 10.222.0.13 () {58 vars in 1260 bytes} [Tue Nov 1 19:07:22 2022] GET /compute/v2.1/os-floating-ips/01745fb8-809a-49b0-9087-715e19bd7413 => generated 141 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:07:23.174278 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-c0836326-849e-4e45-a1f8-b37c9c9dc7fc tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd2105b0264b48d084d0e79cabff8bc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf4adda91364dab94830347c06e3957', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:07:23.183285 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-f54eccd2-c6a1-4996-bf37-5c7232d40201 tempest-FloatingIPsTestJSON-924588053 tempest-FloatingIPsTestJSON-924588053-project] Calling method '.version_select at 0x7f0ae246d550>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:07:23.186741 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-c0836326-849e-4e45-a1f8-b37c9c9dc7fc tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd2105b0264b48d084d0e79cabff8bc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf4adda91364dab94830347c06e3957', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:07:23.189454 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-c0836326-849e-4e45-a1f8-b37c9c9dc7fc tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd2105b0264b48d084d0e79cabff8bc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf4adda91364dab94830347c06e3957', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:07:23.191559 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-c0836326-849e-4e45-a1f8-b37c9c9dc7fc tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] 10.222.0.13 "GET /compute/v2.1/servers/ba6ffc5c-84a4-40f1-bdc7-f87dde2c99df" status: 200 len: 1875 microversion: 2.32 time: 0.290483 Nov 01 19:07:23.192447 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1625/3193] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 19:07:22 2022] GET /compute/v2.1/servers/ba6ffc5c-84a4-40f1-bdc7-f87dde2c99df => generated 1875 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 01 19:07:23.221638 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-b68f672e-c858-411d-a8e7-0d4e71f58c6f tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:07:23.222250 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-b68f672e-c858-411d-a8e7-0d4e71f58c6f tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] [instance: a3e21508-14b3-4a32-911a-86699cc0f1aa] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:07:23.232188 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-b68f672e-c858-411d-a8e7-0d4e71f58c6f tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:23.232718 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-b68f672e-c858-411d-a8e7-0d4e71f58c6f tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:23.233234 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-b68f672e-c858-411d-a8e7-0d4e71f58c6f tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:23.233883 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-b68f672e-c858-411d-a8e7-0d4e71f58c6f tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:23.239417 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-b68f672e-c858-411d-a8e7-0d4e71f58c6f tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:23.239877 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-b68f672e-c858-411d-a8e7-0d4e71f58c6f tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:23.415416 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-b68f672e-c858-411d-a8e7-0d4e71f58c6f tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113bd8c844ee490b86a68bc7e1e75da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '851785a5f76548898a77d67792888504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:07:23.428716 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-b68f672e-c858-411d-a8e7-0d4e71f58c6f tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] 10.222.0.13 "GET /compute/v2.1/servers/a3e21508-14b3-4a32-911a-86699cc0f1aa" status: 200 len: 1320 microversion: 2.1 time: 0.210559 Nov 01 19:07:23.429990 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1626/3194] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:07:23 2022] GET /compute/v2.1/servers/a3e21508-14b3-4a32-911a-86699cc0f1aa => generated 1320 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:07:23.435128 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-47db9872-b1ce-4cf9-b191-085512974af3 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:07:23.435942 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-47db9872-b1ce-4cf9-b191-085512974af3 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] [instance: 50bf9fd1-c4c6-4d58-80a1-4ce30f50f9bb] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:07:23.443097 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-47db9872-b1ce-4cf9-b191-085512974af3 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:23.444293 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-47db9872-b1ce-4cf9-b191-085512974af3 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:23.445277 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-47db9872-b1ce-4cf9-b191-085512974af3 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:23.446907 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-47db9872-b1ce-4cf9-b191-085512974af3 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:23.447710 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-47db9872-b1ce-4cf9-b191-085512974af3 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:23.448503 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-47db9872-b1ce-4cf9-b191-085512974af3 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:23.467040 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.wsgi [None req-47db9872-b1ce-4cf9-b191-085512974af3 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] HTTP exception thrown: Instance 50bf9fd1-c4c6-4d58-80a1-4ce30f50f9bb could not be found. Nov 01 19:07:23.470106 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-47db9872-b1ce-4cf9-b191-085512974af3 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Request method failure captured: Nov 01 19:07:23.470106 n-d-863052-2 devstack@n-api.service[121403]: request: GET /compute/v2.1/servers/50bf9fd1-c4c6-4d58-80a1-4ce30f50f9bb HTTP/1.1 Nov 01 19:07:23.470106 n-d-863052-2 devstack@n-api.service[121403]: Accept: application/json Nov 01 19:07:23.470106 n-d-863052-2 devstack@n-api.service[121403]: Accept-Encoding: identity Nov 01 19:07:23.470106 n-d-863052-2 devstack@n-api.service[121403]: Connection: close Nov 01 19:07:23.470106 n-d-863052-2 devstack@n-api.service[121403]: Content-Length: 0 Nov 01 19:07:23.470106 n-d-863052-2 devstack@n-api.service[121403]: Content-Type: application/json Nov 01 19:07:23.470106 n-d-863052-2 devstack@n-api.service[121403]: Host: 10.222.0.13 Nov 01 19:07:23.470106 n-d-863052-2 devstack@n-api.service[121403]: Openstack-System-Scope: None Nov 01 19:07:23.470106 n-d-863052-2 devstack@n-api.service[121403]: User-Agent: python-urllib3/1.26.12 Nov 01 19:07:23.470106 n-d-863052-2 devstack@n-api.service[121403]: X-Auth-Token: gAAAAABjYW3QwfmWNfVZwfVdlqP4W3_DGRQnip1Y2KOU2Ty5xOr1d66aqTzSlcJErcpkDYVjKN9eJD_6PuZpgZ5fURnVk47YG8d-kvyvLvPn7aM3zncNbLQr3db7wyFvy8uh_PBtHPzuJWp61247528fn7Or8q2FB1A3jGBPnnq5iC0U5e0tL5I Nov 01 19:07:23.470106 n-d-863052-2 devstack@n-api.service[121403]: X-Domain-Id: None Nov 01 19:07:23.470106 n-d-863052-2 devstack@n-api.service[121403]: X-Domain-Name: None Nov 01 19:07:23.470106 n-d-863052-2 devstack@n-api.service[121403]: X-Identity-Status: Confirmed Nov 01 19:07:23.470106 n-d-863052-2 devstack@n-api.service[121403]: X-Is-Admin-Project: True Nov 01 19:07:23.470106 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Domain-Id: default Nov 01 19:07:23.470106 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Domain-Name: Default Nov 01 19:07:23.470106 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Id: 07b5d812eff94e2f89d4705d7e7d5f3d Nov 01 19:07:23.470106 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1499676095 Nov 01 19:07:23.470106 n-d-863052-2 devstack@n-api.service[121403]: X-Role: member,reader Nov 01 19:07:23.470106 n-d-863052-2 devstack@n-api.service[121403]: X-Roles: member,reader Nov 01 19:07:23.470106 n-d-863052-2 devstack@n-api.service[121403]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/07b5d812eff94e2f89d4705d7e7d5f3d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/07b5d812eff94e2f89d4705d7e7d5f3d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_07b5d812eff94e2f89d4705d7e7d5f3d", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/07b5d812eff94e2f89d4705d7e7d5f3d"}]}] Nov 01 19:07:23.470106 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant: tempest-ServerDiskConfigTestJSON-1499676095 Nov 01 19:07:23.470106 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant-Id: 07b5d812eff94e2f89d4705d7e7d5f3d Nov 01 19:07:23.470106 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1499676095 Nov 01 19:07:23.470106 n-d-863052-2 devstack@n-api.service[121403]: X-User: tempest-ServerDiskConfigTestJSON-1499676095-project Nov 01 19:07:23.470106 n-d-863052-2 devstack@n-api.service[121403]: X-User-Domain-Id: default Nov 01 19:07:23.470106 n-d-863052-2 devstack@n-api.service[121403]: X-User-Domain-Name: Default Nov 01 19:07:23.470106 n-d-863052-2 devstack@n-api.service[121403]: X-User-Id: 05d6a1722dfa4e959aeb14d601e43b93 Nov 01 19:07:23.470106 n-d-863052-2 devstack@n-api.service[121403]: X-User-Name: tempest-ServerDiskConfigTestJSON-1499676095-project Nov 01 19:07:23.470106 n-d-863052-2 devstack@n-api.service[121403]: method: > Nov 01 19:07:23.470106 n-d-863052-2 devstack@n-api.service[121403]: exception: Instance 50bf9fd1-c4c6-4d58-80a1-4ce30f50f9bb could not be found. Nov 01 19:07:23.470106 n-d-863052-2 devstack@n-api.service[121403]: action_args: {'id': '50bf9fd1-c4c6-4d58-80a1-4ce30f50f9bb'} Nov 01 19:07:23.470106 n-d-863052-2 devstack@n-api.service[121403]: {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 01 19:07:23.470106 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:07:23.470106 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 01 19:07:23.470106 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 01 19:07:23.470106 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 01 19:07:23.470106 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 01 19:07:23.470106 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 01 19:07:23.470106 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 01 19:07:23.470106 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 01 19:07:23.470106 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 01 19:07:23.470106 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 50bf9fd1-c4c6-4d58-80a1-4ce30f50f9bb could not be found. Nov 01 19:07:23.470106 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:07:23.470106 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:07:23.470106 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:07:23.470106 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:07:23.470106 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:07:23.470106 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:07:23.470106 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 01 19:07:23.470106 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 01 19:07:23.470106 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 01 19:07:23.470106 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 01 19:07:23.470106 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 01 19:07:23.470106 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 01 19:07:23.470106 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 01 19:07:23.470106 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 01 19:07:23.470106 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 01 19:07:23.470106 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 01 19:07:23.470106 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 50bf9fd1-c4c6-4d58-80a1-4ce30f50f9bb could not be found. Nov 01 19:07:23.470106 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:07:23.470106 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:07:23.470106 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:07:23.474521 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:07:23.474521 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:07:23.474521 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:07:23.474521 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 01 19:07:23.474521 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 01 19:07:23.474521 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 50bf9fd1-c4c6-4d58-80a1-4ce30f50f9bb could not be found. Nov 01 19:07:23.474521 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:07:23.475078 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-f54eccd2-c6a1-4996-bf37-5c7232d40201 tempest-FloatingIPsTestJSON-924588053 tempest-FloatingIPsTestJSON-924588053-project] 10.222.0.13 "GET /compute/v2.1/os-floating-ips" status: 200 len: 144 microversion: 2.1 time: 0.293721 Nov 01 19:07:23.475078 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1569/3195] 10.222.0.13 () {58 vars in 1149 bytes} [Tue Nov 1 19:07:23 2022] GET /compute/v2.1/os-floating-ips => generated 144 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 01 19:07:23.477319 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-47db9872-b1ce-4cf9-b191-085512974af3 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Returning 404 to user: Instance 50bf9fd1-c4c6-4d58-80a1-4ce30f50f9bb could not be found. {{(pid=121403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 01 19:07:23.480504 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-47db9872-b1ce-4cf9-b191-085512974af3 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] 10.222.0.13 "GET /compute/v2.1/servers/50bf9fd1-c4c6-4d58-80a1-4ce30f50f9bb" status: 404 len: 111 microversion: 2.1 time: 0.049021 Nov 01 19:07:23.481754 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1627/3196] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:07:23 2022] GET /compute/v2.1/servers/50bf9fd1-c4c6-4d58-80a1-4ce30f50f9bb => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 01 19:07:23.489086 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-f710873b-4c39-4daa-9bac-592c8d379a1e tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:07:23.489581 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-f710873b-4c39-4daa-9bac-592c8d379a1e tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] [instance: 0b57b50d-1ec4-4ee1-ac3a-f6f44d68a2c3] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:07:23.489829 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-eae6afd7-f7b7-479e-bf6b-cd369dfce3a0 tempest-FloatingIPsTestJSON-924588053 tempest-FloatingIPsTestJSON-924588053-project] Calling method '.version_select at 0x7f0ae2b3bd30>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:07:23.496880 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f710873b-4c39-4daa-9bac-592c8d379a1e tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:23.497372 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f710873b-4c39-4daa-9bac-592c8d379a1e tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:23.497923 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f710873b-4c39-4daa-9bac-592c8d379a1e tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:23.498745 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f710873b-4c39-4daa-9bac-592c8d379a1e tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:23.499175 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f710873b-4c39-4daa-9bac-592c8d379a1e tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:23.499602 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f710873b-4c39-4daa-9bac-592c8d379a1e tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:23.515608 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.wsgi [None req-f710873b-4c39-4daa-9bac-592c8d379a1e tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] HTTP exception thrown: Instance 0b57b50d-1ec4-4ee1-ac3a-f6f44d68a2c3 could not be found. Nov 01 19:07:23.517680 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-f710873b-4c39-4daa-9bac-592c8d379a1e tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Request method failure captured: Nov 01 19:07:23.517680 n-d-863052-2 devstack@n-api.service[121403]: request: DELETE /compute/v2.1/servers/0b57b50d-1ec4-4ee1-ac3a-f6f44d68a2c3 HTTP/1.1 Nov 01 19:07:23.517680 n-d-863052-2 devstack@n-api.service[121403]: Accept: application/json Nov 01 19:07:23.517680 n-d-863052-2 devstack@n-api.service[121403]: Accept-Encoding: identity Nov 01 19:07:23.517680 n-d-863052-2 devstack@n-api.service[121403]: Connection: close Nov 01 19:07:23.517680 n-d-863052-2 devstack@n-api.service[121403]: Content-Length: 0 Nov 01 19:07:23.517680 n-d-863052-2 devstack@n-api.service[121403]: Content-Type: application/json Nov 01 19:07:23.517680 n-d-863052-2 devstack@n-api.service[121403]: Host: 10.222.0.13 Nov 01 19:07:23.517680 n-d-863052-2 devstack@n-api.service[121403]: Openstack-System-Scope: None Nov 01 19:07:23.517680 n-d-863052-2 devstack@n-api.service[121403]: User-Agent: python-urllib3/1.26.12 Nov 01 19:07:23.517680 n-d-863052-2 devstack@n-api.service[121403]: X-Auth-Token: gAAAAABjYW3QwfmWNfVZwfVdlqP4W3_DGRQnip1Y2KOU2Ty5xOr1d66aqTzSlcJErcpkDYVjKN9eJD_6PuZpgZ5fURnVk47YG8d-kvyvLvPn7aM3zncNbLQr3db7wyFvy8uh_PBtHPzuJWp61247528fn7Or8q2FB1A3jGBPnnq5iC0U5e0tL5I Nov 01 19:07:23.517680 n-d-863052-2 devstack@n-api.service[121403]: X-Domain-Id: None Nov 01 19:07:23.517680 n-d-863052-2 devstack@n-api.service[121403]: X-Domain-Name: None Nov 01 19:07:23.517680 n-d-863052-2 devstack@n-api.service[121403]: X-Identity-Status: Confirmed Nov 01 19:07:23.517680 n-d-863052-2 devstack@n-api.service[121403]: X-Is-Admin-Project: True Nov 01 19:07:23.517680 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Domain-Id: default Nov 01 19:07:23.517680 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Domain-Name: Default Nov 01 19:07:23.517680 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Id: 07b5d812eff94e2f89d4705d7e7d5f3d Nov 01 19:07:23.517680 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1499676095 Nov 01 19:07:23.517680 n-d-863052-2 devstack@n-api.service[121403]: X-Role: member,reader Nov 01 19:07:23.517680 n-d-863052-2 devstack@n-api.service[121403]: X-Roles: member,reader Nov 01 19:07:23.517680 n-d-863052-2 devstack@n-api.service[121403]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/07b5d812eff94e2f89d4705d7e7d5f3d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/07b5d812eff94e2f89d4705d7e7d5f3d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_07b5d812eff94e2f89d4705d7e7d5f3d", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/07b5d812eff94e2f89d4705d7e7d5f3d"}]}] Nov 01 19:07:23.517680 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant: tempest-ServerDiskConfigTestJSON-1499676095 Nov 01 19:07:23.517680 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant-Id: 07b5d812eff94e2f89d4705d7e7d5f3d Nov 01 19:07:23.517680 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1499676095 Nov 01 19:07:23.517680 n-d-863052-2 devstack@n-api.service[121403]: X-User: tempest-ServerDiskConfigTestJSON-1499676095-project Nov 01 19:07:23.517680 n-d-863052-2 devstack@n-api.service[121403]: X-User-Domain-Id: default Nov 01 19:07:23.517680 n-d-863052-2 devstack@n-api.service[121403]: X-User-Domain-Name: Default Nov 01 19:07:23.517680 n-d-863052-2 devstack@n-api.service[121403]: X-User-Id: 05d6a1722dfa4e959aeb14d601e43b93 Nov 01 19:07:23.517680 n-d-863052-2 devstack@n-api.service[121403]: X-User-Name: tempest-ServerDiskConfigTestJSON-1499676095-project Nov 01 19:07:23.517680 n-d-863052-2 devstack@n-api.service[121403]: method: > Nov 01 19:07:23.517680 n-d-863052-2 devstack@n-api.service[121403]: exception: Instance 0b57b50d-1ec4-4ee1-ac3a-f6f44d68a2c3 could not be found. Nov 01 19:07:23.517680 n-d-863052-2 devstack@n-api.service[121403]: action_args: {'id': '0b57b50d-1ec4-4ee1-ac3a-f6f44d68a2c3'} Nov 01 19:07:23.517680 n-d-863052-2 devstack@n-api.service[121403]: {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 01 19:07:23.517680 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:07:23.517680 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 01 19:07:23.517680 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 01 19:07:23.517680 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 01 19:07:23.517680 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 01 19:07:23.517680 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 01 19:07:23.517680 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 01 19:07:23.517680 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 01 19:07:23.517680 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 01 19:07:23.517680 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0b57b50d-1ec4-4ee1-ac3a-f6f44d68a2c3 could not be found. Nov 01 19:07:23.517680 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:07:23.517680 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:07:23.517680 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:07:23.517680 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:07:23.517680 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:07:23.517680 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:07:23.517680 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 01 19:07:23.517680 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 01 19:07:23.517680 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 01 19:07:23.517680 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 01 19:07:23.517680 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 01 19:07:23.517680 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 01 19:07:23.517680 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 01 19:07:23.517680 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 01 19:07:23.517680 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 01 19:07:23.517680 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 01 19:07:23.517680 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 01 19:07:23.517680 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 01 19:07:23.521548 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0b57b50d-1ec4-4ee1-ac3a-f6f44d68a2c3 could not be found. Nov 01 19:07:23.521548 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:07:23.521548 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:07:23.521548 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:07:23.521548 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:07:23.521548 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:07:23.521548 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:07:23.521548 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 01 19:07:23.521548 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 01 19:07:23.521548 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0b57b50d-1ec4-4ee1-ac3a-f6f44d68a2c3 could not be found. Nov 01 19:07:23.521548 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:07:23.521548 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-f710873b-4c39-4daa-9bac-592c8d379a1e tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Returning 404 to user: Instance 0b57b50d-1ec4-4ee1-ac3a-f6f44d68a2c3 could not be found. {{(pid=121403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 01 19:07:23.521548 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-f710873b-4c39-4daa-9bac-592c8d379a1e tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] 10.222.0.13 "DELETE /compute/v2.1/servers/0b57b50d-1ec4-4ee1-ac3a-f6f44d68a2c3" status: 404 len: 111 microversion: 2.1 time: 0.033727 Nov 01 19:07:23.521548 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1628/3197] 10.222.0.13 () {58 vars in 1239 bytes} [Tue Nov 1 19:07:23 2022] DELETE /compute/v2.1/servers/0b57b50d-1ec4-4ee1-ac3a-f6f44d68a2c3 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 01 19:07:23.528616 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-a665778e-96a6-47d8-ba8d-b471321cb20e tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:07:23.529237 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-a665778e-96a6-47d8-ba8d-b471321cb20e tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] [instance: 0b57b50d-1ec4-4ee1-ac3a-f6f44d68a2c3] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:07:23.535760 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-a665778e-96a6-47d8-ba8d-b471321cb20e tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:23.536663 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-a665778e-96a6-47d8-ba8d-b471321cb20e tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:23.536785 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-a665778e-96a6-47d8-ba8d-b471321cb20e tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:23.537527 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-a665778e-96a6-47d8-ba8d-b471321cb20e tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:23.538007 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-a665778e-96a6-47d8-ba8d-b471321cb20e tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:23.538433 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-a665778e-96a6-47d8-ba8d-b471321cb20e tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:23.557003 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.wsgi [None req-a665778e-96a6-47d8-ba8d-b471321cb20e tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] HTTP exception thrown: Instance 0b57b50d-1ec4-4ee1-ac3a-f6f44d68a2c3 could not be found. Nov 01 19:07:23.558569 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-a665778e-96a6-47d8-ba8d-b471321cb20e tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Request method failure captured: Nov 01 19:07:23.558569 n-d-863052-2 devstack@n-api.service[121403]: request: GET /compute/v2.1/servers/0b57b50d-1ec4-4ee1-ac3a-f6f44d68a2c3 HTTP/1.1 Nov 01 19:07:23.558569 n-d-863052-2 devstack@n-api.service[121403]: Accept: application/json Nov 01 19:07:23.558569 n-d-863052-2 devstack@n-api.service[121403]: Accept-Encoding: identity Nov 01 19:07:23.558569 n-d-863052-2 devstack@n-api.service[121403]: Connection: close Nov 01 19:07:23.558569 n-d-863052-2 devstack@n-api.service[121403]: Content-Length: 0 Nov 01 19:07:23.558569 n-d-863052-2 devstack@n-api.service[121403]: Content-Type: application/json Nov 01 19:07:23.558569 n-d-863052-2 devstack@n-api.service[121403]: Host: 10.222.0.13 Nov 01 19:07:23.558569 n-d-863052-2 devstack@n-api.service[121403]: Openstack-System-Scope: None Nov 01 19:07:23.558569 n-d-863052-2 devstack@n-api.service[121403]: User-Agent: python-urllib3/1.26.12 Nov 01 19:07:23.558569 n-d-863052-2 devstack@n-api.service[121403]: X-Auth-Token: gAAAAABjYW3QwfmWNfVZwfVdlqP4W3_DGRQnip1Y2KOU2Ty5xOr1d66aqTzSlcJErcpkDYVjKN9eJD_6PuZpgZ5fURnVk47YG8d-kvyvLvPn7aM3zncNbLQr3db7wyFvy8uh_PBtHPzuJWp61247528fn7Or8q2FB1A3jGBPnnq5iC0U5e0tL5I Nov 01 19:07:23.558569 n-d-863052-2 devstack@n-api.service[121403]: X-Domain-Id: None Nov 01 19:07:23.558569 n-d-863052-2 devstack@n-api.service[121403]: X-Domain-Name: None Nov 01 19:07:23.558569 n-d-863052-2 devstack@n-api.service[121403]: X-Identity-Status: Confirmed Nov 01 19:07:23.558569 n-d-863052-2 devstack@n-api.service[121403]: X-Is-Admin-Project: True Nov 01 19:07:23.558569 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Domain-Id: default Nov 01 19:07:23.558569 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Domain-Name: Default Nov 01 19:07:23.558569 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Id: 07b5d812eff94e2f89d4705d7e7d5f3d Nov 01 19:07:23.558569 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1499676095 Nov 01 19:07:23.558569 n-d-863052-2 devstack@n-api.service[121403]: X-Role: member,reader Nov 01 19:07:23.558569 n-d-863052-2 devstack@n-api.service[121403]: X-Roles: member,reader Nov 01 19:07:23.558569 n-d-863052-2 devstack@n-api.service[121403]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/07b5d812eff94e2f89d4705d7e7d5f3d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/07b5d812eff94e2f89d4705d7e7d5f3d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_07b5d812eff94e2f89d4705d7e7d5f3d", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/07b5d812eff94e2f89d4705d7e7d5f3d"}]}] Nov 01 19:07:23.558569 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant: tempest-ServerDiskConfigTestJSON-1499676095 Nov 01 19:07:23.558569 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant-Id: 07b5d812eff94e2f89d4705d7e7d5f3d Nov 01 19:07:23.558569 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1499676095 Nov 01 19:07:23.558569 n-d-863052-2 devstack@n-api.service[121403]: X-User: tempest-ServerDiskConfigTestJSON-1499676095-project Nov 01 19:07:23.558569 n-d-863052-2 devstack@n-api.service[121403]: X-User-Domain-Id: default Nov 01 19:07:23.558569 n-d-863052-2 devstack@n-api.service[121403]: X-User-Domain-Name: Default Nov 01 19:07:23.558569 n-d-863052-2 devstack@n-api.service[121403]: X-User-Id: 05d6a1722dfa4e959aeb14d601e43b93 Nov 01 19:07:23.558569 n-d-863052-2 devstack@n-api.service[121403]: X-User-Name: tempest-ServerDiskConfigTestJSON-1499676095-project Nov 01 19:07:23.558569 n-d-863052-2 devstack@n-api.service[121403]: method: > Nov 01 19:07:23.558569 n-d-863052-2 devstack@n-api.service[121403]: exception: Instance 0b57b50d-1ec4-4ee1-ac3a-f6f44d68a2c3 could not be found. Nov 01 19:07:23.558569 n-d-863052-2 devstack@n-api.service[121403]: action_args: {'id': '0b57b50d-1ec4-4ee1-ac3a-f6f44d68a2c3'} Nov 01 19:07:23.558569 n-d-863052-2 devstack@n-api.service[121403]: {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 01 19:07:23.558569 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:07:23.558569 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 01 19:07:23.558569 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 01 19:07:23.558569 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 01 19:07:23.558569 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 01 19:07:23.558569 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 01 19:07:23.558569 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 01 19:07:23.558569 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 01 19:07:23.558569 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 01 19:07:23.558569 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0b57b50d-1ec4-4ee1-ac3a-f6f44d68a2c3 could not be found. Nov 01 19:07:23.558569 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:07:23.558569 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:07:23.558569 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:07:23.558569 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:07:23.558569 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:07:23.558569 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:07:23.558569 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 01 19:07:23.558569 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 01 19:07:23.558569 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 01 19:07:23.558569 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 01 19:07:23.558569 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 01 19:07:23.558569 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 01 19:07:23.558569 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 01 19:07:23.558569 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 01 19:07:23.558569 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 01 19:07:23.558569 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 01 19:07:23.558569 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0b57b50d-1ec4-4ee1-ac3a-f6f44d68a2c3 could not be found. Nov 01 19:07:23.558569 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:07:23.558569 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:07:23.558569 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:07:23.563208 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:07:23.563208 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:07:23.563208 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:07:23.563208 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 01 19:07:23.563208 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 01 19:07:23.563208 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0b57b50d-1ec4-4ee1-ac3a-f6f44d68a2c3 could not be found. Nov 01 19:07:23.563208 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:07:23.563208 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-a665778e-96a6-47d8-ba8d-b471321cb20e tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Returning 404 to user: Instance 0b57b50d-1ec4-4ee1-ac3a-f6f44d68a2c3 could not be found. {{(pid=121403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 01 19:07:23.563208 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-a665778e-96a6-47d8-ba8d-b471321cb20e tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] 10.222.0.13 "GET /compute/v2.1/servers/0b57b50d-1ec4-4ee1-ac3a-f6f44d68a2c3" status: 404 len: 111 microversion: 2.1 time: 0.035792 Nov 01 19:07:23.563208 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1629/3198] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:07:23 2022] GET /compute/v2.1/servers/0b57b50d-1ec4-4ee1-ac3a-f6f44d68a2c3 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 01 19:07:23.568792 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-ac699f29-0766-4305-8ece-f71ecf4b78ee tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:07:23.569161 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-ac699f29-0766-4305-8ece-f71ecf4b78ee tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] [instance: b58b3cb6-ebdc-4705-b308-4e804cd52bce] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:07:23.576128 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-ac699f29-0766-4305-8ece-f71ecf4b78ee tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:23.576527 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-ac699f29-0766-4305-8ece-f71ecf4b78ee tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:23.576999 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-ac699f29-0766-4305-8ece-f71ecf4b78ee tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:23.577702 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-ac699f29-0766-4305-8ece-f71ecf4b78ee tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:23.578164 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-ac699f29-0766-4305-8ece-f71ecf4b78ee tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:23.578577 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-ac699f29-0766-4305-8ece-f71ecf4b78ee tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:23.593511 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.wsgi [None req-ac699f29-0766-4305-8ece-f71ecf4b78ee tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] HTTP exception thrown: Instance b58b3cb6-ebdc-4705-b308-4e804cd52bce could not be found. Nov 01 19:07:23.595375 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-ac699f29-0766-4305-8ece-f71ecf4b78ee tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Request method failure captured: Nov 01 19:07:23.595375 n-d-863052-2 devstack@n-api.service[121403]: request: DELETE /compute/v2.1/servers/b58b3cb6-ebdc-4705-b308-4e804cd52bce HTTP/1.1 Nov 01 19:07:23.595375 n-d-863052-2 devstack@n-api.service[121403]: Accept: application/json Nov 01 19:07:23.595375 n-d-863052-2 devstack@n-api.service[121403]: Accept-Encoding: identity Nov 01 19:07:23.595375 n-d-863052-2 devstack@n-api.service[121403]: Connection: close Nov 01 19:07:23.595375 n-d-863052-2 devstack@n-api.service[121403]: Content-Length: 0 Nov 01 19:07:23.595375 n-d-863052-2 devstack@n-api.service[121403]: Content-Type: application/json Nov 01 19:07:23.595375 n-d-863052-2 devstack@n-api.service[121403]: Host: 10.222.0.13 Nov 01 19:07:23.595375 n-d-863052-2 devstack@n-api.service[121403]: Openstack-System-Scope: None Nov 01 19:07:23.595375 n-d-863052-2 devstack@n-api.service[121403]: User-Agent: python-urllib3/1.26.12 Nov 01 19:07:23.595375 n-d-863052-2 devstack@n-api.service[121403]: X-Auth-Token: gAAAAABjYW3QwfmWNfVZwfVdlqP4W3_DGRQnip1Y2KOU2Ty5xOr1d66aqTzSlcJErcpkDYVjKN9eJD_6PuZpgZ5fURnVk47YG8d-kvyvLvPn7aM3zncNbLQr3db7wyFvy8uh_PBtHPzuJWp61247528fn7Or8q2FB1A3jGBPnnq5iC0U5e0tL5I Nov 01 19:07:23.595375 n-d-863052-2 devstack@n-api.service[121403]: X-Domain-Id: None Nov 01 19:07:23.595375 n-d-863052-2 devstack@n-api.service[121403]: X-Domain-Name: None Nov 01 19:07:23.595375 n-d-863052-2 devstack@n-api.service[121403]: X-Identity-Status: Confirmed Nov 01 19:07:23.595375 n-d-863052-2 devstack@n-api.service[121403]: X-Is-Admin-Project: True Nov 01 19:07:23.595375 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Domain-Id: default Nov 01 19:07:23.595375 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Domain-Name: Default Nov 01 19:07:23.595375 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Id: 07b5d812eff94e2f89d4705d7e7d5f3d Nov 01 19:07:23.595375 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1499676095 Nov 01 19:07:23.595375 n-d-863052-2 devstack@n-api.service[121403]: X-Role: member,reader Nov 01 19:07:23.595375 n-d-863052-2 devstack@n-api.service[121403]: X-Roles: member,reader Nov 01 19:07:23.595375 n-d-863052-2 devstack@n-api.service[121403]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/07b5d812eff94e2f89d4705d7e7d5f3d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/07b5d812eff94e2f89d4705d7e7d5f3d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_07b5d812eff94e2f89d4705d7e7d5f3d", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/07b5d812eff94e2f89d4705d7e7d5f3d"}]}] Nov 01 19:07:23.595375 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant: tempest-ServerDiskConfigTestJSON-1499676095 Nov 01 19:07:23.595375 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant-Id: 07b5d812eff94e2f89d4705d7e7d5f3d Nov 01 19:07:23.595375 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1499676095 Nov 01 19:07:23.595375 n-d-863052-2 devstack@n-api.service[121403]: X-User: tempest-ServerDiskConfigTestJSON-1499676095-project Nov 01 19:07:23.595375 n-d-863052-2 devstack@n-api.service[121403]: X-User-Domain-Id: default Nov 01 19:07:23.595375 n-d-863052-2 devstack@n-api.service[121403]: X-User-Domain-Name: Default Nov 01 19:07:23.595375 n-d-863052-2 devstack@n-api.service[121403]: X-User-Id: 05d6a1722dfa4e959aeb14d601e43b93 Nov 01 19:07:23.595375 n-d-863052-2 devstack@n-api.service[121403]: X-User-Name: tempest-ServerDiskConfigTestJSON-1499676095-project Nov 01 19:07:23.595375 n-d-863052-2 devstack@n-api.service[121403]: method: > Nov 01 19:07:23.595375 n-d-863052-2 devstack@n-api.service[121403]: exception: Instance b58b3cb6-ebdc-4705-b308-4e804cd52bce could not be found. Nov 01 19:07:23.595375 n-d-863052-2 devstack@n-api.service[121403]: action_args: {'id': 'b58b3cb6-ebdc-4705-b308-4e804cd52bce'} Nov 01 19:07:23.595375 n-d-863052-2 devstack@n-api.service[121403]: {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 01 19:07:23.595375 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:07:23.595375 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 01 19:07:23.595375 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 01 19:07:23.595375 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 01 19:07:23.595375 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 01 19:07:23.595375 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 01 19:07:23.595375 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 01 19:07:23.595375 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 01 19:07:23.595375 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 01 19:07:23.595375 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b58b3cb6-ebdc-4705-b308-4e804cd52bce could not be found. Nov 01 19:07:23.595375 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:07:23.595375 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:07:23.595375 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:07:23.595375 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:07:23.595375 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:07:23.595375 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:07:23.595375 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 01 19:07:23.595375 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 01 19:07:23.595375 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 01 19:07:23.595375 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 01 19:07:23.595375 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 01 19:07:23.595375 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 01 19:07:23.595375 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 01 19:07:23.595375 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 01 19:07:23.595375 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 01 19:07:23.595375 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 01 19:07:23.595375 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 01 19:07:23.595375 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 01 19:07:23.599843 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b58b3cb6-ebdc-4705-b308-4e804cd52bce could not be found. Nov 01 19:07:23.599843 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:07:23.599843 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:07:23.599843 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:07:23.599843 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:07:23.599843 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:07:23.599843 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:07:23.599843 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 01 19:07:23.599843 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 01 19:07:23.599843 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b58b3cb6-ebdc-4705-b308-4e804cd52bce could not be found. Nov 01 19:07:23.599843 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:07:23.599843 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-ac699f29-0766-4305-8ece-f71ecf4b78ee tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Returning 404 to user: Instance b58b3cb6-ebdc-4705-b308-4e804cd52bce could not be found. {{(pid=121403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 01 19:07:23.599843 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-ac699f29-0766-4305-8ece-f71ecf4b78ee tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] 10.222.0.13 "DELETE /compute/v2.1/servers/b58b3cb6-ebdc-4705-b308-4e804cd52bce" status: 404 len: 111 microversion: 2.1 time: 0.031877 Nov 01 19:07:23.599843 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1630/3199] 10.222.0.13 () {58 vars in 1239 bytes} [Tue Nov 1 19:07:23 2022] DELETE /compute/v2.1/servers/b58b3cb6-ebdc-4705-b308-4e804cd52bce => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 01 19:07:23.606351 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-7e12a053-da98-4864-aba9-ff87defbd356 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:07:23.607948 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-7e12a053-da98-4864-aba9-ff87defbd356 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] [instance: b58b3cb6-ebdc-4705-b308-4e804cd52bce] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:07:23.613818 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-7e12a053-da98-4864-aba9-ff87defbd356 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:23.614303 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-7e12a053-da98-4864-aba9-ff87defbd356 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:23.615005 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-7e12a053-da98-4864-aba9-ff87defbd356 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:23.615730 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-7e12a053-da98-4864-aba9-ff87defbd356 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:23.616339 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-7e12a053-da98-4864-aba9-ff87defbd356 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:23.616812 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-7e12a053-da98-4864-aba9-ff87defbd356 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:23.640257 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.wsgi [None req-7e12a053-da98-4864-aba9-ff87defbd356 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] HTTP exception thrown: Instance b58b3cb6-ebdc-4705-b308-4e804cd52bce could not be found. Nov 01 19:07:23.642594 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-7e12a053-da98-4864-aba9-ff87defbd356 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Request method failure captured: Nov 01 19:07:23.642594 n-d-863052-2 devstack@n-api.service[121403]: request: GET /compute/v2.1/servers/b58b3cb6-ebdc-4705-b308-4e804cd52bce HTTP/1.1 Nov 01 19:07:23.642594 n-d-863052-2 devstack@n-api.service[121403]: Accept: application/json Nov 01 19:07:23.642594 n-d-863052-2 devstack@n-api.service[121403]: Accept-Encoding: identity Nov 01 19:07:23.642594 n-d-863052-2 devstack@n-api.service[121403]: Connection: close Nov 01 19:07:23.642594 n-d-863052-2 devstack@n-api.service[121403]: Content-Length: 0 Nov 01 19:07:23.642594 n-d-863052-2 devstack@n-api.service[121403]: Content-Type: application/json Nov 01 19:07:23.642594 n-d-863052-2 devstack@n-api.service[121403]: Host: 10.222.0.13 Nov 01 19:07:23.642594 n-d-863052-2 devstack@n-api.service[121403]: Openstack-System-Scope: None Nov 01 19:07:23.642594 n-d-863052-2 devstack@n-api.service[121403]: User-Agent: python-urllib3/1.26.12 Nov 01 19:07:23.642594 n-d-863052-2 devstack@n-api.service[121403]: X-Auth-Token: gAAAAABjYW3QwfmWNfVZwfVdlqP4W3_DGRQnip1Y2KOU2Ty5xOr1d66aqTzSlcJErcpkDYVjKN9eJD_6PuZpgZ5fURnVk47YG8d-kvyvLvPn7aM3zncNbLQr3db7wyFvy8uh_PBtHPzuJWp61247528fn7Or8q2FB1A3jGBPnnq5iC0U5e0tL5I Nov 01 19:07:23.642594 n-d-863052-2 devstack@n-api.service[121403]: X-Domain-Id: None Nov 01 19:07:23.642594 n-d-863052-2 devstack@n-api.service[121403]: X-Domain-Name: None Nov 01 19:07:23.642594 n-d-863052-2 devstack@n-api.service[121403]: X-Identity-Status: Confirmed Nov 01 19:07:23.642594 n-d-863052-2 devstack@n-api.service[121403]: X-Is-Admin-Project: True Nov 01 19:07:23.642594 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Domain-Id: default Nov 01 19:07:23.642594 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Domain-Name: Default Nov 01 19:07:23.642594 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Id: 07b5d812eff94e2f89d4705d7e7d5f3d Nov 01 19:07:23.642594 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1499676095 Nov 01 19:07:23.642594 n-d-863052-2 devstack@n-api.service[121403]: X-Role: member,reader Nov 01 19:07:23.642594 n-d-863052-2 devstack@n-api.service[121403]: X-Roles: member,reader Nov 01 19:07:23.642594 n-d-863052-2 devstack@n-api.service[121403]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/07b5d812eff94e2f89d4705d7e7d5f3d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/07b5d812eff94e2f89d4705d7e7d5f3d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_07b5d812eff94e2f89d4705d7e7d5f3d", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/07b5d812eff94e2f89d4705d7e7d5f3d"}]}] Nov 01 19:07:23.642594 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant: tempest-ServerDiskConfigTestJSON-1499676095 Nov 01 19:07:23.642594 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant-Id: 07b5d812eff94e2f89d4705d7e7d5f3d Nov 01 19:07:23.642594 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1499676095 Nov 01 19:07:23.642594 n-d-863052-2 devstack@n-api.service[121403]: X-User: tempest-ServerDiskConfigTestJSON-1499676095-project Nov 01 19:07:23.642594 n-d-863052-2 devstack@n-api.service[121403]: X-User-Domain-Id: default Nov 01 19:07:23.642594 n-d-863052-2 devstack@n-api.service[121403]: X-User-Domain-Name: Default Nov 01 19:07:23.642594 n-d-863052-2 devstack@n-api.service[121403]: X-User-Id: 05d6a1722dfa4e959aeb14d601e43b93 Nov 01 19:07:23.642594 n-d-863052-2 devstack@n-api.service[121403]: X-User-Name: tempest-ServerDiskConfigTestJSON-1499676095-project Nov 01 19:07:23.642594 n-d-863052-2 devstack@n-api.service[121403]: method: > Nov 01 19:07:23.642594 n-d-863052-2 devstack@n-api.service[121403]: exception: Instance b58b3cb6-ebdc-4705-b308-4e804cd52bce could not be found. Nov 01 19:07:23.642594 n-d-863052-2 devstack@n-api.service[121403]: action_args: {'id': 'b58b3cb6-ebdc-4705-b308-4e804cd52bce'} Nov 01 19:07:23.642594 n-d-863052-2 devstack@n-api.service[121403]: {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 01 19:07:23.642594 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:07:23.642594 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 01 19:07:23.642594 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 01 19:07:23.642594 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 01 19:07:23.642594 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 01 19:07:23.642594 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 01 19:07:23.642594 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 01 19:07:23.642594 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 01 19:07:23.642594 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 01 19:07:23.642594 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b58b3cb6-ebdc-4705-b308-4e804cd52bce could not be found. Nov 01 19:07:23.642594 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:07:23.642594 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:07:23.642594 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:07:23.642594 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:07:23.642594 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:07:23.642594 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:07:23.642594 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 01 19:07:23.642594 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 01 19:07:23.642594 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 01 19:07:23.642594 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 01 19:07:23.642594 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 01 19:07:23.642594 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 01 19:07:23.642594 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 01 19:07:23.642594 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 01 19:07:23.642594 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 01 19:07:23.642594 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 01 19:07:23.642594 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b58b3cb6-ebdc-4705-b308-4e804cd52bce could not be found. Nov 01 19:07:23.642594 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:07:23.642594 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:07:23.642594 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:07:23.647853 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:07:23.647853 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:07:23.647853 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:07:23.647853 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 01 19:07:23.647853 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 01 19:07:23.647853 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b58b3cb6-ebdc-4705-b308-4e804cd52bce could not be found. Nov 01 19:07:23.647853 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:07:23.647853 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-7e12a053-da98-4864-aba9-ff87defbd356 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] Returning 404 to user: Instance b58b3cb6-ebdc-4705-b308-4e804cd52bce could not be found. {{(pid=121403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 01 19:07:23.647853 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-7e12a053-da98-4864-aba9-ff87defbd356 tempest-ServerDiskConfigTestJSON-1499676095 tempest-ServerDiskConfigTestJSON-1499676095-project] 10.222.0.13 "GET /compute/v2.1/servers/b58b3cb6-ebdc-4705-b308-4e804cd52bce" status: 404 len: 111 microversion: 2.1 time: 0.042879 Nov 01 19:07:23.647853 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1631/3200] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:07:23 2022] GET /compute/v2.1/servers/b58b3cb6-ebdc-4705-b308-4e804cd52bce => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 01 19:07:23.656602 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-5cfa9953-b740-44a8-b947-79f75bda3a57 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:07:23.657332 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-5cfa9953-b740-44a8-b947-79f75bda3a57 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] [instance: d99a7f68-99ff-4c70-9e81-1c9faf6ebb7f] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:07:23.664533 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-5cfa9953-b740-44a8-b947-79f75bda3a57 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:23.665891 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-5cfa9953-b740-44a8-b947-79f75bda3a57 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:23.666251 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-5cfa9953-b740-44a8-b947-79f75bda3a57 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:23.667017 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-5cfa9953-b740-44a8-b947-79f75bda3a57 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:23.667470 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-5cfa9953-b740-44a8-b947-79f75bda3a57 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:23.668075 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-5cfa9953-b740-44a8-b947-79f75bda3a57 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:23.831151 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-5cfa9953-b740-44a8-b947-79f75bda3a57 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '058480d92c9b4ab4af6815d0438a65c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee9dc49b89143f781e4ab30296e4d01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:07:23.840763 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-5cfa9953-b740-44a8-b947-79f75bda3a57 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] 10.222.0.13 "GET /compute/v2.1/servers/d99a7f68-99ff-4c70-9e81-1c9faf6ebb7f" status: 200 len: 1315 microversion: 2.1 time: 0.190313 Nov 01 19:07:23.841518 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1632/3201] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:07:23 2022] GET /compute/v2.1/servers/d99a7f68-99ff-4c70-9e81-1c9faf6ebb7f => generated 1315 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:07:23.859059 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [req-3342a65d-e221-45b3-a70a-a9413015dd47 req-d30b47a8-81e3-4441-83ac-c6719cb9cfb7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a3e21508-14b3-4a32-911a-86699cc0f1aa", "name": "network-vif-plugged", "status": "completed", "tag": "39bd1d84-a8ad-4509-85bc-21bb62289695"}]} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:07:23.871090 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-3342a65d-e221-45b3-a70a-a9413015dd47 req-d30b47a8-81e3-4441-83ac-c6719cb9cfb7 service nova] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:23.871642 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-3342a65d-e221-45b3-a70a-a9413015dd47 req-d30b47a8-81e3-4441-83ac-c6719cb9cfb7 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:23.872241 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-3342a65d-e221-45b3-a70a-a9413015dd47 req-d30b47a8-81e3-4441-83ac-c6719cb9cfb7 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:23.886884 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.compute.server_external_events [req-3342a65d-e221-45b3-a70a-a9413015dd47 req-d30b47a8-81e3-4441-83ac-c6719cb9cfb7 service nova] Creating event network-vif-plugged:39bd1d84-a8ad-4509-85bc-21bb62289695 for instance a3e21508-14b3-4a32-911a-86699cc0f1aa on n-h2-863052-2 Nov 01 19:07:23.894177 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [req-3342a65d-e221-45b3-a70a-a9413015dd47 req-d30b47a8-81e3-4441-83ac-c6719cb9cfb7 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038695 Nov 01 19:07:23.894946 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1633/3202] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Nov 1 19:07:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 01 19:07:24.222913 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-5eefdfaa-5002-4226-bb97-69487009d948 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:07:24.228378 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-5eefdfaa-5002-4226-bb97-69487009d948 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] [instance: ba6ffc5c-84a4-40f1-bdc7-f87dde2c99df] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:07:24.237118 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-5eefdfaa-5002-4226-bb97-69487009d948 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:24.238586 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-5eefdfaa-5002-4226-bb97-69487009d948 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:24.239040 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-5eefdfaa-5002-4226-bb97-69487009d948 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:24.239956 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-5eefdfaa-5002-4226-bb97-69487009d948 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:24.241401 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-5eefdfaa-5002-4226-bb97-69487009d948 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:24.242008 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-5eefdfaa-5002-4226-bb97-69487009d948 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:24.460992 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-5eefdfaa-5002-4226-bb97-69487009d948 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd2105b0264b48d084d0e79cabff8bc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf4adda91364dab94830347c06e3957', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:07:24.471661 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-5eefdfaa-5002-4226-bb97-69487009d948 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd2105b0264b48d084d0e79cabff8bc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf4adda91364dab94830347c06e3957', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:07:24.473160 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-5eefdfaa-5002-4226-bb97-69487009d948 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd2105b0264b48d084d0e79cabff8bc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf4adda91364dab94830347c06e3957', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:07:24.474339 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-5eefdfaa-5002-4226-bb97-69487009d948 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] 10.222.0.13 "GET /compute/v2.1/servers/ba6ffc5c-84a4-40f1-bdc7-f87dde2c99df" status: 200 len: 1875 microversion: 2.32 time: 0.256015 Nov 01 19:07:24.481983 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1634/3203] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 19:07:24 2022] GET /compute/v2.1/servers/ba6ffc5c-84a4-40f1-bdc7-f87dde2c99df => generated 1875 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 19:07:24.492343 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-304b7ecf-e2c6-4300-a393-a98564252376 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:07:24.493120 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-304b7ecf-e2c6-4300-a393-a98564252376 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] [instance: a3e21508-14b3-4a32-911a-86699cc0f1aa] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:07:24.500715 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-304b7ecf-e2c6-4300-a393-a98564252376 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:24.501362 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-304b7ecf-e2c6-4300-a393-a98564252376 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:24.501906 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-304b7ecf-e2c6-4300-a393-a98564252376 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:24.502731 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-304b7ecf-e2c6-4300-a393-a98564252376 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:24.503406 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-304b7ecf-e2c6-4300-a393-a98564252376 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:24.503905 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-304b7ecf-e2c6-4300-a393-a98564252376 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:24.643198 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-304b7ecf-e2c6-4300-a393-a98564252376 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113bd8c844ee490b86a68bc7e1e75da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '851785a5f76548898a77d67792888504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:07:24.652399 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-304b7ecf-e2c6-4300-a393-a98564252376 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] 10.222.0.13 "GET /compute/v2.1/servers/a3e21508-14b3-4a32-911a-86699cc0f1aa" status: 200 len: 1320 microversion: 2.1 time: 0.168825 Nov 01 19:07:24.653042 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1635/3204] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:07:24 2022] GET /compute/v2.1/servers/a3e21508-14b3-4a32-911a-86699cc0f1aa => generated 1320 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:07:24.864562 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-44d0ff74-0e84-4d4b-8e3f-65dccb2d2308 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:07:24.865190 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-44d0ff74-0e84-4d4b-8e3f-65dccb2d2308 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] [instance: d99a7f68-99ff-4c70-9e81-1c9faf6ebb7f] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:07:24.871200 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-44d0ff74-0e84-4d4b-8e3f-65dccb2d2308 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:24.871683 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-44d0ff74-0e84-4d4b-8e3f-65dccb2d2308 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:24.872117 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-44d0ff74-0e84-4d4b-8e3f-65dccb2d2308 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:24.872833 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-44d0ff74-0e84-4d4b-8e3f-65dccb2d2308 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:24.873795 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-44d0ff74-0e84-4d4b-8e3f-65dccb2d2308 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:24.874225 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-44d0ff74-0e84-4d4b-8e3f-65dccb2d2308 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:24.948512 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-eae6afd7-f7b7-479e-bf6b-cd369dfce3a0 tempest-FloatingIPsTestJSON-924588053 tempest-FloatingIPsTestJSON-924588053-project] 10.222.0.13 "DELETE /compute/v2.1/os-floating-ips/01745fb8-809a-49b0-9087-715e19bd7413" status: 202 len: 0 microversion: 2.1 time: 1.464452 Nov 01 19:07:24.953516 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1570/3205] 10.222.0.13 () {58 vars in 1263 bytes} [Tue Nov 1 19:07:23 2022] DELETE /compute/v2.1/os-floating-ips/01745fb8-809a-49b0-9087-715e19bd7413 => generated 0 bytes in 1467 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 01 19:07:24.958421 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-f67ad0f3-75d1-4a50-8da4-9ae3b9da6cf0 tempest-FloatingIPsTestJSON-924588053 tempest-FloatingIPsTestJSON-924588053-project] Action: 'create', calling method: .version_select at 0x7f0ae26c10d0>, body: {"pool": null} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:07:25.024061 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-44d0ff74-0e84-4d4b-8e3f-65dccb2d2308 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '058480d92c9b4ab4af6815d0438a65c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee9dc49b89143f781e4ab30296e4d01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:07:25.033275 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-44d0ff74-0e84-4d4b-8e3f-65dccb2d2308 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] 10.222.0.13 "GET /compute/v2.1/servers/d99a7f68-99ff-4c70-9e81-1c9faf6ebb7f" status: 200 len: 1315 microversion: 2.1 time: 0.172506 Nov 01 19:07:25.034276 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1636/3206] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:07:24 2022] GET /compute/v2.1/servers/d99a7f68-99ff-4c70-9e81-1c9faf6ebb7f => generated 1315 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 19:07:25.503338 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-1aa96314-ef3a-49f9-90ca-b0fef51b1c68 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:07:25.504102 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-1aa96314-ef3a-49f9-90ca-b0fef51b1c68 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] [instance: ba6ffc5c-84a4-40f1-bdc7-f87dde2c99df] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:07:25.512849 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-1aa96314-ef3a-49f9-90ca-b0fef51b1c68 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:25.513361 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-1aa96314-ef3a-49f9-90ca-b0fef51b1c68 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:25.513849 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-1aa96314-ef3a-49f9-90ca-b0fef51b1c68 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:25.514845 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-1aa96314-ef3a-49f9-90ca-b0fef51b1c68 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:25.515479 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-1aa96314-ef3a-49f9-90ca-b0fef51b1c68 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:25.517442 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-1aa96314-ef3a-49f9-90ca-b0fef51b1c68 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:25.872290 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-1aa96314-ef3a-49f9-90ca-b0fef51b1c68 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd2105b0264b48d084d0e79cabff8bc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf4adda91364dab94830347c06e3957', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:07:25.899454 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-1aa96314-ef3a-49f9-90ca-b0fef51b1c68 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd2105b0264b48d084d0e79cabff8bc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf4adda91364dab94830347c06e3957', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:07:25.901609 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-1aa96314-ef3a-49f9-90ca-b0fef51b1c68 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd2105b0264b48d084d0e79cabff8bc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf4adda91364dab94830347c06e3957', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:07:25.905368 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-1aa96314-ef3a-49f9-90ca-b0fef51b1c68 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] 10.222.0.13 "GET /compute/v2.1/servers/ba6ffc5c-84a4-40f1-bdc7-f87dde2c99df" status: 200 len: 1875 microversion: 2.32 time: 0.407002 Nov 01 19:07:25.906193 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1637/3207] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 19:07:25 2022] GET /compute/v2.1/servers/ba6ffc5c-84a4-40f1-bdc7-f87dde2c99df => generated 1875 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 01 19:07:25.932259 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-49edadef-5668-47c7-b597-786a1e8610f0 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:07:25.933094 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-49edadef-5668-47c7-b597-786a1e8610f0 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] [instance: a3e21508-14b3-4a32-911a-86699cc0f1aa] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:07:25.941465 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-49edadef-5668-47c7-b597-786a1e8610f0 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:25.942561 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-49edadef-5668-47c7-b597-786a1e8610f0 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:25.943179 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-49edadef-5668-47c7-b597-786a1e8610f0 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:25.944858 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-49edadef-5668-47c7-b597-786a1e8610f0 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:25.945873 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-49edadef-5668-47c7-b597-786a1e8610f0 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:25.946526 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-49edadef-5668-47c7-b597-786a1e8610f0 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:26.172264 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-49edadef-5668-47c7-b597-786a1e8610f0 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113bd8c844ee490b86a68bc7e1e75da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '851785a5f76548898a77d67792888504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:07:26.183388 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-49edadef-5668-47c7-b597-786a1e8610f0 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] 10.222.0.13 "GET /compute/v2.1/servers/a3e21508-14b3-4a32-911a-86699cc0f1aa" status: 200 len: 1502 microversion: 2.1 time: 0.274255 Nov 01 19:07:26.184693 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1638/3208] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:07:25 2022] GET /compute/v2.1/servers/a3e21508-14b3-4a32-911a-86699cc0f1aa => generated 1502 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:07:26.191379 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [req-d87c6c56-1b00-4d79-8bbd-4013023b7964 req-e53d9b79-ef52-483c-a220-77f5d1f99b27 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d99a7f68-99ff-4c70-9e81-1c9faf6ebb7f", "name": "network-vif-plugged", "status": "completed", "tag": "86a9807c-bdc4-485a-8d9d-51a89b1522de"}]} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:07:26.203319 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-d87c6c56-1b00-4d79-8bbd-4013023b7964 req-e53d9b79-ef52-483c-a220-77f5d1f99b27 service nova] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:26.204361 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-d87c6c56-1b00-4d79-8bbd-4013023b7964 req-e53d9b79-ef52-483c-a220-77f5d1f99b27 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:26.204988 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-d87c6c56-1b00-4d79-8bbd-4013023b7964 req-e53d9b79-ef52-483c-a220-77f5d1f99b27 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:26.222486 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.compute.server_external_events [req-d87c6c56-1b00-4d79-8bbd-4013023b7964 req-e53d9b79-ef52-483c-a220-77f5d1f99b27 service nova] Creating event network-vif-plugged:86a9807c-bdc4-485a-8d9d-51a89b1522de for instance d99a7f68-99ff-4c70-9e81-1c9faf6ebb7f on n-h2-863052-2 Nov 01 19:07:26.230329 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [req-d87c6c56-1b00-4d79-8bbd-4013023b7964 req-e53d9b79-ef52-483c-a220-77f5d1f99b27 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044184 Nov 01 19:07:26.232026 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1639/3209] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Nov 1 19:07:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:07:26.238681 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-b8f9d3ac-733f-4a61-8f67-9070ba0f473f tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:07:26.239660 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-b8f9d3ac-733f-4a61-8f67-9070ba0f473f tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] [instance: d99a7f68-99ff-4c70-9e81-1c9faf6ebb7f] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:07:26.261820 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-b8f9d3ac-733f-4a61-8f67-9070ba0f473f tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:26.262329 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-b8f9d3ac-733f-4a61-8f67-9070ba0f473f tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:26.262773 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-b8f9d3ac-733f-4a61-8f67-9070ba0f473f tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:26.263482 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-b8f9d3ac-733f-4a61-8f67-9070ba0f473f tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:26.264132 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-b8f9d3ac-733f-4a61-8f67-9070ba0f473f tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:26.264858 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-b8f9d3ac-733f-4a61-8f67-9070ba0f473f tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:26.466897 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-b8f9d3ac-733f-4a61-8f67-9070ba0f473f tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '058480d92c9b4ab4af6815d0438a65c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee9dc49b89143f781e4ab30296e4d01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:07:26.478122 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-b8f9d3ac-733f-4a61-8f67-9070ba0f473f tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] 10.222.0.13 "GET /compute/v2.1/servers/d99a7f68-99ff-4c70-9e81-1c9faf6ebb7f" status: 200 len: 1315 microversion: 2.1 time: 0.244585 Nov 01 19:07:26.479019 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1640/3210] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:07:26 2022] GET /compute/v2.1/servers/d99a7f68-99ff-4c70-9e81-1c9faf6ebb7f => generated 1315 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:07:26.483741 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-60482bec-6533-4822-a9bf-97595514a0b4 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:07:26.484342 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-60482bec-6533-4822-a9bf-97595514a0b4 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] [instance: a3e21508-14b3-4a32-911a-86699cc0f1aa] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:07:26.496782 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-60482bec-6533-4822-a9bf-97595514a0b4 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:26.497532 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-60482bec-6533-4822-a9bf-97595514a0b4 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:26.498155 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-60482bec-6533-4822-a9bf-97595514a0b4 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:26.499028 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-60482bec-6533-4822-a9bf-97595514a0b4 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:26.499642 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-60482bec-6533-4822-a9bf-97595514a0b4 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:26.501704 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-60482bec-6533-4822-a9bf-97595514a0b4 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:26.700090 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-60482bec-6533-4822-a9bf-97595514a0b4 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113bd8c844ee490b86a68bc7e1e75da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '851785a5f76548898a77d67792888504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:07:26.714342 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-60482bec-6533-4822-a9bf-97595514a0b4 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] 10.222.0.13 "GET /compute/v2.1/servers/a3e21508-14b3-4a32-911a-86699cc0f1aa" status: 200 len: 1502 microversion: 2.1 time: 0.233984 Nov 01 19:07:26.715927 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1641/3211] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:07:26 2022] GET /compute/v2.1/servers/a3e21508-14b3-4a32-911a-86699cc0f1aa => generated 1502 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:07:26.754890 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-9481ca37-3041-4863-bd8b-5703dc93e16f tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:07:26.755636 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-9481ca37-3041-4863-bd8b-5703dc93e16f tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] [instance: a3e21508-14b3-4a32-911a-86699cc0f1aa] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:07:26.764183 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-9481ca37-3041-4863-bd8b-5703dc93e16f tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:26.764705 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-9481ca37-3041-4863-bd8b-5703dc93e16f tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:26.765147 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-9481ca37-3041-4863-bd8b-5703dc93e16f tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:26.766257 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-9481ca37-3041-4863-bd8b-5703dc93e16f tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:26.766718 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-9481ca37-3041-4863-bd8b-5703dc93e16f tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:26.767145 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-9481ca37-3041-4863-bd8b-5703dc93e16f tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:26.798471 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-9481ca37-3041-4863-bd8b-5703dc93e16f tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] [instance: a3e21508-14b3-4a32-911a-86699cc0f1aa] Going to try to terminate instance {{(pid=121403) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 01 19:07:26.805088 n-d-863052-2 devstack@n-api.service[121403]: DEBUG dbcounter [-] [121403] Writing DB stats nova_cell1:SELECT=100 {{(pid=121403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 19:07:26.904320 n-d-863052-2 devstack@n-api.service[121403]: DEBUG dbcounter [-] [121403] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=121403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 19:07:26.920421 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-9481ca37-3041-4863-bd8b-5703dc93e16f tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] 10.222.0.13 "DELETE /compute/v2.1/servers/a3e21508-14b3-4a32-911a-86699cc0f1aa" status: 204 len: 0 microversion: 2.1 time: 0.182168 Nov 01 19:07:26.924468 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1642/3212] 10.222.0.13 () {58 vars in 1239 bytes} [Tue Nov 1 19:07:26 2022] DELETE /compute/v2.1/servers/a3e21508-14b3-4a32-911a-86699cc0f1aa => generated 0 bytes in 184 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 01 19:07:26.932511 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-bb082594-00d6-403b-846e-6c86e597a127 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:07:26.933263 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-bb082594-00d6-403b-846e-6c86e597a127 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] [instance: a3e21508-14b3-4a32-911a-86699cc0f1aa] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:07:26.942130 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-bb082594-00d6-403b-846e-6c86e597a127 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:26.942704 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-bb082594-00d6-403b-846e-6c86e597a127 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:26.943566 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-bb082594-00d6-403b-846e-6c86e597a127 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:26.944393 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-bb082594-00d6-403b-846e-6c86e597a127 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:26.945024 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-bb082594-00d6-403b-846e-6c86e597a127 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:26.945592 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-bb082594-00d6-403b-846e-6c86e597a127 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:27.128358 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-bb082594-00d6-403b-846e-6c86e597a127 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113bd8c844ee490b86a68bc7e1e75da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '851785a5f76548898a77d67792888504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:07:27.140919 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-bb082594-00d6-403b-846e-6c86e597a127 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] 10.222.0.13 "GET /compute/v2.1/servers/a3e21508-14b3-4a32-911a-86699cc0f1aa" status: 200 len: 1508 microversion: 2.1 time: 0.214591 Nov 01 19:07:27.142325 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1643/3213] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:07:26 2022] GET /compute/v2.1/servers/a3e21508-14b3-4a32-911a-86699cc0f1aa => generated 1508 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:07:27.161140 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-bb4e8278-e9df-4de1-b801-2d6fc7042253 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:07:27.161813 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-bb4e8278-e9df-4de1-b801-2d6fc7042253 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] [instance: ba6ffc5c-84a4-40f1-bdc7-f87dde2c99df] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:07:27.178705 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-bb4e8278-e9df-4de1-b801-2d6fc7042253 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:27.179344 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-bb4e8278-e9df-4de1-b801-2d6fc7042253 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:27.179781 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-bb4e8278-e9df-4de1-b801-2d6fc7042253 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:27.182877 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-bb4e8278-e9df-4de1-b801-2d6fc7042253 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:27.183389 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-bb4e8278-e9df-4de1-b801-2d6fc7042253 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:27.183848 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-bb4e8278-e9df-4de1-b801-2d6fc7042253 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:27.437291 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-bb4e8278-e9df-4de1-b801-2d6fc7042253 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd2105b0264b48d084d0e79cabff8bc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf4adda91364dab94830347c06e3957', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:07:27.457253 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-bb4e8278-e9df-4de1-b801-2d6fc7042253 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd2105b0264b48d084d0e79cabff8bc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf4adda91364dab94830347c06e3957', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:07:27.459091 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-bb4e8278-e9df-4de1-b801-2d6fc7042253 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd2105b0264b48d084d0e79cabff8bc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf4adda91364dab94830347c06e3957', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:07:27.460534 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-bb4e8278-e9df-4de1-b801-2d6fc7042253 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] 10.222.0.13 "GET /compute/v2.1/servers/ba6ffc5c-84a4-40f1-bdc7-f87dde2c99df" status: 200 len: 1875 microversion: 2.32 time: 0.317129 Nov 01 19:07:27.461835 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1644/3214] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 19:07:27 2022] GET /compute/v2.1/servers/ba6ffc5c-84a4-40f1-bdc7-f87dde2c99df => generated 1875 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 19:07:27.502400 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-48b1d828-ea3b-43f1-a416-5765114023f4 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:07:27.503121 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-48b1d828-ea3b-43f1-a416-5765114023f4 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] [instance: d99a7f68-99ff-4c70-9e81-1c9faf6ebb7f] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:07:27.509698 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-48b1d828-ea3b-43f1-a416-5765114023f4 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:27.510336 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-48b1d828-ea3b-43f1-a416-5765114023f4 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:27.510824 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-48b1d828-ea3b-43f1-a416-5765114023f4 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:27.511594 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-48b1d828-ea3b-43f1-a416-5765114023f4 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:27.512123 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-48b1d828-ea3b-43f1-a416-5765114023f4 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:27.512743 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-48b1d828-ea3b-43f1-a416-5765114023f4 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:27.671421 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-48b1d828-ea3b-43f1-a416-5765114023f4 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '058480d92c9b4ab4af6815d0438a65c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee9dc49b89143f781e4ab30296e4d01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:07:27.680837 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-48b1d828-ea3b-43f1-a416-5765114023f4 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] 10.222.0.13 "GET /compute/v2.1/servers/d99a7f68-99ff-4c70-9e81-1c9faf6ebb7f" status: 200 len: 1315 microversion: 2.1 time: 0.182157 Nov 01 19:07:27.684649 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1645/3215] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:07:27 2022] GET /compute/v2.1/servers/d99a7f68-99ff-4c70-9e81-1c9faf6ebb7f => generated 1315 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:07:27.717139 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-f67ad0f3-75d1-4a50-8da4-9ae3b9da6cf0 tempest-FloatingIPsTestJSON-924588053 tempest-FloatingIPsTestJSON-924588053-project] 10.222.0.13 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 2.762435 Nov 01 19:07:27.718263 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1571/3216] 10.222.0.13 () {60 vars in 1170 bytes} [Tue Nov 1 19:07:24 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 2764 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 01 19:07:27.730970 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-773fcc95-8f92-49dd-afd8-b77e1e14b744 tempest-FloatingIPsTestJSON-924588053 tempest-FloatingIPsTestJSON-924588053-project] Calling method '.version_select at 0x7f0ae6763c10>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:07:28.177397 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-dfa1567e-f395-4dc1-bfd8-8065e405888d tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:07:28.178128 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-dfa1567e-f395-4dc1-bfd8-8065e405888d tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] [instance: a3e21508-14b3-4a32-911a-86699cc0f1aa] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:07:28.192216 n-d-863052-2 devstack@n-api.service[121402]: DEBUG dbcounter [-] [121402] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=121402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 19:07:28.193889 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-dfa1567e-f395-4dc1-bfd8-8065e405888d tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:28.194389 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-dfa1567e-f395-4dc1-bfd8-8065e405888d tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:28.195029 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-dfa1567e-f395-4dc1-bfd8-8065e405888d tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:28.206292 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-dfa1567e-f395-4dc1-bfd8-8065e405888d tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:28.207005 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-dfa1567e-f395-4dc1-bfd8-8065e405888d tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:28.207522 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-dfa1567e-f395-4dc1-bfd8-8065e405888d tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:28.531810 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-dfa1567e-f395-4dc1-bfd8-8065e405888d tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113bd8c844ee490b86a68bc7e1e75da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '851785a5f76548898a77d67792888504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:07:28.540464 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-dfa1567e-f395-4dc1-bfd8-8065e405888d tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] 10.222.0.13 "GET /compute/v2.1/servers/a3e21508-14b3-4a32-911a-86699cc0f1aa" status: 200 len: 1508 microversion: 2.1 time: 0.376871 Nov 01 19:07:28.559210 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1572/3217] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:07:28 2022] GET /compute/v2.1/servers/a3e21508-14b3-4a32-911a-86699cc0f1aa => generated 1508 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 19:07:28.566333 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [req-2d6a70a4-60c6-4268-8efc-b5a84cfd7621 req-37511bfd-6497-4753-a236-1ee8d052307b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ba6ffc5c-84a4-40f1-bdc7-f87dde2c99df", "name": "network-vif-plugged", "status": "completed", "tag": "df21a011-7bab-4ed2-bd70-fb0e2d704b1f"}, {"server_uuid": "ba6ffc5c-84a4-40f1-bdc7-f87dde2c99df", "name": "network-vif-plugged", "status": "completed", "tag": "50c047f7-0828-439d-8aac-50370fc1454f"}, {"server_uuid": "ba6ffc5c-84a4-40f1-bdc7-f87dde2c99df", "name": "network-vif-plugged", "status": "completed", "tag": "b830d6f3-9de8-4e86-9f65-0eb5d53f68f7"}]} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:07:28.582675 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-2d6a70a4-60c6-4268-8efc-b5a84cfd7621 req-37511bfd-6497-4753-a236-1ee8d052307b service nova] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:28.583653 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-2d6a70a4-60c6-4268-8efc-b5a84cfd7621 req-37511bfd-6497-4753-a236-1ee8d052307b service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:28.584405 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-2d6a70a4-60c6-4268-8efc-b5a84cfd7621 req-37511bfd-6497-4753-a236-1ee8d052307b service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:28.609338 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.compute.server_external_events [req-2d6a70a4-60c6-4268-8efc-b5a84cfd7621 req-37511bfd-6497-4753-a236-1ee8d052307b service nova] Creating event network-vif-plugged:df21a011-7bab-4ed2-bd70-fb0e2d704b1f for instance ba6ffc5c-84a4-40f1-bdc7-f87dde2c99df on n-h1-863052-2 Nov 01 19:07:28.610072 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.compute.server_external_events [req-2d6a70a4-60c6-4268-8efc-b5a84cfd7621 req-37511bfd-6497-4753-a236-1ee8d052307b service nova] Creating event network-vif-plugged:50c047f7-0828-439d-8aac-50370fc1454f for instance ba6ffc5c-84a4-40f1-bdc7-f87dde2c99df on n-h1-863052-2 Nov 01 19:07:28.610791 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.compute.server_external_events [req-2d6a70a4-60c6-4268-8efc-b5a84cfd7621 req-37511bfd-6497-4753-a236-1ee8d052307b service nova] Creating event network-vif-plugged:b830d6f3-9de8-4e86-9f65-0eb5d53f68f7 for instance ba6ffc5c-84a4-40f1-bdc7-f87dde2c99df on n-h1-863052-2 Nov 01 19:07:28.632566 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [req-2d6a70a4-60c6-4268-8efc-b5a84cfd7621 req-37511bfd-6497-4753-a236-1ee8d052307b service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.071367 Nov 01 19:07:28.634268 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1573/3218] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Nov 1 19:07:28 2022] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:07:28.640041 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-e98af889-703e-4aad-b0cb-68901baae0d2 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:07:28.641286 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-e98af889-703e-4aad-b0cb-68901baae0d2 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] [instance: ba6ffc5c-84a4-40f1-bdc7-f87dde2c99df] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:07:28.648054 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e98af889-703e-4aad-b0cb-68901baae0d2 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:28.648545 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e98af889-703e-4aad-b0cb-68901baae0d2 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:28.649273 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e98af889-703e-4aad-b0cb-68901baae0d2 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:28.649964 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e98af889-703e-4aad-b0cb-68901baae0d2 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:28.651240 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e98af889-703e-4aad-b0cb-68901baae0d2 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:28.652443 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e98af889-703e-4aad-b0cb-68901baae0d2 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:28.959931 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-e98af889-703e-4aad-b0cb-68901baae0d2 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd2105b0264b48d084d0e79cabff8bc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf4adda91364dab94830347c06e3957', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:07:28.987775 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-e98af889-703e-4aad-b0cb-68901baae0d2 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd2105b0264b48d084d0e79cabff8bc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf4adda91364dab94830347c06e3957', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:07:28.995786 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-e98af889-703e-4aad-b0cb-68901baae0d2 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd2105b0264b48d084d0e79cabff8bc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf4adda91364dab94830347c06e3957', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:07:29.003060 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-e98af889-703e-4aad-b0cb-68901baae0d2 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] 10.222.0.13 "GET /compute/v2.1/servers/ba6ffc5c-84a4-40f1-bdc7-f87dde2c99df" status: 200 len: 1875 microversion: 2.32 time: 0.367262 Nov 01 19:07:29.007235 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1574/3219] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 19:07:28 2022] GET /compute/v2.1/servers/ba6ffc5c-84a4-40f1-bdc7-f87dde2c99df => generated 1875 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 19:07:29.022086 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-cb85d643-6df3-4dcc-9b31-b7db8093fc02 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:07:29.022703 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-cb85d643-6df3-4dcc-9b31-b7db8093fc02 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] [instance: d99a7f68-99ff-4c70-9e81-1c9faf6ebb7f] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:07:29.029961 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-773fcc95-8f92-49dd-afd8-b77e1e14b744 tempest-FloatingIPsTestJSON-924588053 tempest-FloatingIPsTestJSON-924588053-project] 10.222.0.13 "DELETE /compute/v2.1/os-floating-ips/29a5e266-95d9-4e3e-af6a-3808ea9f19d2" status: 202 len: 0 microversion: 2.1 time: 1.303197 Nov 01 19:07:29.031060 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1646/3220] 10.222.0.13 () {58 vars in 1263 bytes} [Tue Nov 1 19:07:27 2022] DELETE /compute/v2.1/os-floating-ips/29a5e266-95d9-4e3e-af6a-3808ea9f19d2 => generated 0 bytes in 1305 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 01 19:07:29.040539 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-39a39a73-3667-4044-b391-7a4734310ff4 tempest-FloatingIPsTestJSON-924588053 tempest-FloatingIPsTestJSON-924588053-project] Calling method '.version_select at 0x7f0ae2051790>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:07:29.054557 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-cb85d643-6df3-4dcc-9b31-b7db8093fc02 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:29.057495 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-cb85d643-6df3-4dcc-9b31-b7db8093fc02 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:29.058229 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-cb85d643-6df3-4dcc-9b31-b7db8093fc02 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:29.059576 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-cb85d643-6df3-4dcc-9b31-b7db8093fc02 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:29.060402 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-cb85d643-6df3-4dcc-9b31-b7db8093fc02 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:29.061150 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-cb85d643-6df3-4dcc-9b31-b7db8093fc02 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:29.139429 n-d-863052-2 devstack@n-api.service[121403]: DEBUG neutronclient.v2_0.client [None req-39a39a73-3667-4044-b391-7a4734310ff4 tempest-FloatingIPsTestJSON-924588053 tempest-FloatingIPsTestJSON-924588053-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 29a5e266-95d9-4e3e-af6a-3808ea9f19d2 could not be found", "detail": ""}} {{(pid=121403) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Nov 01 19:07:29.140575 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.wsgi [None req-39a39a73-3667-4044-b391-7a4734310ff4 tempest-FloatingIPsTestJSON-924588053 tempest-FloatingIPsTestJSON-924588053-project] HTTP exception thrown: Floating IP not found for ID 29a5e266-95d9-4e3e-af6a-3808ea9f19d2 Nov 01 19:07:29.142801 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-39a39a73-3667-4044-b391-7a4734310ff4 tempest-FloatingIPsTestJSON-924588053 tempest-FloatingIPsTestJSON-924588053-project] Request method failure captured: Nov 01 19:07:29.142801 n-d-863052-2 devstack@n-api.service[121403]: request: GET /compute/v2.1/os-floating-ips/29a5e266-95d9-4e3e-af6a-3808ea9f19d2 HTTP/1.1 Nov 01 19:07:29.142801 n-d-863052-2 devstack@n-api.service[121403]: Accept: application/json Nov 01 19:07:29.142801 n-d-863052-2 devstack@n-api.service[121403]: Accept-Encoding: identity Nov 01 19:07:29.142801 n-d-863052-2 devstack@n-api.service[121403]: Connection: close Nov 01 19:07:29.142801 n-d-863052-2 devstack@n-api.service[121403]: Content-Length: 0 Nov 01 19:07:29.142801 n-d-863052-2 devstack@n-api.service[121403]: Content-Type: application/json Nov 01 19:07:29.142801 n-d-863052-2 devstack@n-api.service[121403]: Host: 10.222.0.13 Nov 01 19:07:29.142801 n-d-863052-2 devstack@n-api.service[121403]: Openstack-System-Scope: None Nov 01 19:07:29.142801 n-d-863052-2 devstack@n-api.service[121403]: User-Agent: python-urllib3/1.26.12 Nov 01 19:07:29.142801 n-d-863052-2 devstack@n-api.service[121403]: X-Auth-Token: gAAAAABjYW5ogdMw8anufWsM99zvaMDkl1w2NDGkptOdA5MQoLyQZcfmaxMBAoriG1MaKD4qqgzhQRawEjuC2SGgMhlO2kPycVZinMxuvoRAO0exGFW8rRj95yBf6vfOAIjQ4Nrl_vgNKdwBiYy5UtP834cpXKa4bCLLK-ztZvuijn29c4z1dB4 Nov 01 19:07:29.142801 n-d-863052-2 devstack@n-api.service[121403]: X-Domain-Id: None Nov 01 19:07:29.142801 n-d-863052-2 devstack@n-api.service[121403]: X-Domain-Name: None Nov 01 19:07:29.142801 n-d-863052-2 devstack@n-api.service[121403]: X-Identity-Status: Confirmed Nov 01 19:07:29.142801 n-d-863052-2 devstack@n-api.service[121403]: X-Is-Admin-Project: True Nov 01 19:07:29.142801 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Domain-Id: default Nov 01 19:07:29.142801 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Domain-Name: Default Nov 01 19:07:29.142801 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Id: 0e95dfaae0374a18b4177977dca61374 Nov 01 19:07:29.142801 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Name: tempest-FloatingIPsTestJSON-924588053 Nov 01 19:07:29.142801 n-d-863052-2 devstack@n-api.service[121403]: X-Role: member,reader Nov 01 19:07:29.142801 n-d-863052-2 devstack@n-api.service[121403]: X-Roles: member,reader Nov 01 19:07:29.142801 n-d-863052-2 devstack@n-api.service[121403]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/0e95dfaae0374a18b4177977dca61374"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/0e95dfaae0374a18b4177977dca61374"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_0e95dfaae0374a18b4177977dca61374", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/0e95dfaae0374a18b4177977dca61374"}]}] Nov 01 19:07:29.142801 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant: tempest-FloatingIPsTestJSON-924588053 Nov 01 19:07:29.142801 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant-Id: 0e95dfaae0374a18b4177977dca61374 Nov 01 19:07:29.142801 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant-Name: tempest-FloatingIPsTestJSON-924588053 Nov 01 19:07:29.142801 n-d-863052-2 devstack@n-api.service[121403]: X-User: tempest-FloatingIPsTestJSON-924588053-project Nov 01 19:07:29.142801 n-d-863052-2 devstack@n-api.service[121403]: X-User-Domain-Id: default Nov 01 19:07:29.142801 n-d-863052-2 devstack@n-api.service[121403]: X-User-Domain-Name: Default Nov 01 19:07:29.142801 n-d-863052-2 devstack@n-api.service[121403]: X-User-Id: 915461aa6c3348b48ccf420ce20b4ce3 Nov 01 19:07:29.142801 n-d-863052-2 devstack@n-api.service[121403]: X-User-Name: tempest-FloatingIPsTestJSON-924588053-project Nov 01 19:07:29.142801 n-d-863052-2 devstack@n-api.service[121403]: method: Nov 01 19:07:29.142801 n-d-863052-2 devstack@n-api.service[121403]: exception: Floating IP not found for ID 29a5e266-95d9-4e3e-af6a-3808ea9f19d2 Nov 01 19:07:29.142801 n-d-863052-2 devstack@n-api.service[121403]: action_args: {'id': '29a5e266-95d9-4e3e-af6a-3808ea9f19d2'} Nov 01 19:07:29.142801 n-d-863052-2 devstack@n-api.service[121403]: {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 01 19:07:29.142801 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:07:29.142801 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Nov 01 19:07:29.142801 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Nov 01 19:07:29.142801 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 01 19:07:29.142801 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 01 19:07:29.142801 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1008, in show_floatingip Nov 01 19:07:29.142801 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Nov 01 19:07:29.142801 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 01 19:07:29.142801 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 01 19:07:29.142801 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 01 19:07:29.142801 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 01 19:07:29.142801 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 01 19:07:29.142801 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 01 19:07:29.142801 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 01 19:07:29.142801 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 01 19:07:29.142801 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 01 19:07:29.142801 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 01 19:07:29.142801 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Nov 01 19:07:29.142801 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Nov 01 19:07:29.142801 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 01 19:07:29.142801 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 01 19:07:29.142801 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Nov 01 19:07:29.142801 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Nov 01 19:07:29.142801 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Nov 01 19:07:29.142801 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Nov 01 19:07:29.142801 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 29a5e266-95d9-4e3e-af6a-3808ea9f19d2 could not be found Nov 01 19:07:29.142801 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-fb6ca7e1-ace3-473d-9cf7-c7dc28ebcc43'] Nov 01 19:07:29.142801 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:07:29.149128 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:07:29.149128 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:07:29.149128 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:07:29.149128 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 94, in show Nov 01 19:07:29.149128 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Nov 01 19:07:29.149128 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Nov 01 19:07:29.149128 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Nov 01 19:07:29.149128 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 29a5e266-95d9-4e3e-af6a-3808ea9f19d2. Nov 01 19:07:29.149128 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:07:29.149128 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:07:29.149128 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:07:29.149128 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:07:29.149128 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:07:29.149128 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:07:29.149128 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 01 19:07:29.149128 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 01 19:07:29.149128 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 01 19:07:29.149128 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 01 19:07:29.149128 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 01 19:07:29.149128 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 01 19:07:29.149128 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 97, in show Nov 01 19:07:29.149128 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Nov 01 19:07:29.149128 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 29a5e266-95d9-4e3e-af6a-3808ea9f19d2 Nov 01 19:07:29.149128 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:07:29.149128 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:07:29.149128 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:07:29.149128 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:07:29.149128 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:07:29.149128 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:07:29.149128 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 01 19:07:29.149128 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 01 19:07:29.149128 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 29a5e266-95d9-4e3e-af6a-3808ea9f19d2 Nov 01 19:07:29.149128 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:07:29.165247 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-39a39a73-3667-4044-b391-7a4734310ff4 tempest-FloatingIPsTestJSON-924588053 tempest-FloatingIPsTestJSON-924588053-project] Returning 404 to user: Floating IP not found for ID 29a5e266-95d9-4e3e-af6a-3808ea9f19d2 {{(pid=121403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 01 19:07:29.169719 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-39a39a73-3667-4044-b391-7a4734310ff4 tempest-FloatingIPsTestJSON-924588053 tempest-FloatingIPsTestJSON-924588053-project] 10.222.0.13 "GET /compute/v2.1/os-floating-ips/29a5e266-95d9-4e3e-af6a-3808ea9f19d2" status: 404 len: 111 microversion: 2.1 time: 0.133847 Nov 01 19:07:29.171348 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1647/3221] 10.222.0.13 () {58 vars in 1260 bytes} [Tue Nov 1 19:07:29 2022] GET /compute/v2.1/os-floating-ips/29a5e266-95d9-4e3e-af6a-3808ea9f19d2 => generated 111 bytes in 137 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 01 19:07:29.198580 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-bf540604-f146-4119-b26e-0aa8461a459e tempest-FloatingIPsTestJSON-924588053 tempest-FloatingIPsTestJSON-924588053-project] Calling method '.version_select at 0x7f0ae1ca91f0>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:07:29.275089 n-d-863052-2 devstack@n-api.service[121403]: DEBUG neutronclient.v2_0.client [None req-bf540604-f146-4119-b26e-0aa8461a459e tempest-FloatingIPsTestJSON-924588053 tempest-FloatingIPsTestJSON-924588053-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 29a5e266-95d9-4e3e-af6a-3808ea9f19d2 could not be found", "detail": ""}} {{(pid=121403) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Nov 01 19:07:29.276499 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.wsgi [None req-bf540604-f146-4119-b26e-0aa8461a459e tempest-FloatingIPsTestJSON-924588053 tempest-FloatingIPsTestJSON-924588053-project] HTTP exception thrown: Floating IP not found for ID 29a5e266-95d9-4e3e-af6a-3808ea9f19d2 Nov 01 19:07:29.278619 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-bf540604-f146-4119-b26e-0aa8461a459e tempest-FloatingIPsTestJSON-924588053 tempest-FloatingIPsTestJSON-924588053-project] Request method failure captured: Nov 01 19:07:29.278619 n-d-863052-2 devstack@n-api.service[121403]: request: DELETE /compute/v2.1/os-floating-ips/29a5e266-95d9-4e3e-af6a-3808ea9f19d2 HTTP/1.1 Nov 01 19:07:29.278619 n-d-863052-2 devstack@n-api.service[121403]: Accept: application/json Nov 01 19:07:29.278619 n-d-863052-2 devstack@n-api.service[121403]: Accept-Encoding: identity Nov 01 19:07:29.278619 n-d-863052-2 devstack@n-api.service[121403]: Connection: close Nov 01 19:07:29.278619 n-d-863052-2 devstack@n-api.service[121403]: Content-Length: 0 Nov 01 19:07:29.278619 n-d-863052-2 devstack@n-api.service[121403]: Content-Type: application/json Nov 01 19:07:29.278619 n-d-863052-2 devstack@n-api.service[121403]: Host: 10.222.0.13 Nov 01 19:07:29.278619 n-d-863052-2 devstack@n-api.service[121403]: Openstack-System-Scope: None Nov 01 19:07:29.278619 n-d-863052-2 devstack@n-api.service[121403]: User-Agent: python-urllib3/1.26.12 Nov 01 19:07:29.278619 n-d-863052-2 devstack@n-api.service[121403]: X-Auth-Token: gAAAAABjYW5ogdMw8anufWsM99zvaMDkl1w2NDGkptOdA5MQoLyQZcfmaxMBAoriG1MaKD4qqgzhQRawEjuC2SGgMhlO2kPycVZinMxuvoRAO0exGFW8rRj95yBf6vfOAIjQ4Nrl_vgNKdwBiYy5UtP834cpXKa4bCLLK-ztZvuijn29c4z1dB4 Nov 01 19:07:29.278619 n-d-863052-2 devstack@n-api.service[121403]: X-Domain-Id: None Nov 01 19:07:29.278619 n-d-863052-2 devstack@n-api.service[121403]: X-Domain-Name: None Nov 01 19:07:29.278619 n-d-863052-2 devstack@n-api.service[121403]: X-Identity-Status: Confirmed Nov 01 19:07:29.278619 n-d-863052-2 devstack@n-api.service[121403]: X-Is-Admin-Project: True Nov 01 19:07:29.278619 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Domain-Id: default Nov 01 19:07:29.278619 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Domain-Name: Default Nov 01 19:07:29.278619 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Id: 0e95dfaae0374a18b4177977dca61374 Nov 01 19:07:29.278619 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Name: tempest-FloatingIPsTestJSON-924588053 Nov 01 19:07:29.278619 n-d-863052-2 devstack@n-api.service[121403]: X-Role: member,reader Nov 01 19:07:29.278619 n-d-863052-2 devstack@n-api.service[121403]: X-Roles: member,reader Nov 01 19:07:29.278619 n-d-863052-2 devstack@n-api.service[121403]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/0e95dfaae0374a18b4177977dca61374"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/0e95dfaae0374a18b4177977dca61374"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_0e95dfaae0374a18b4177977dca61374", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/0e95dfaae0374a18b4177977dca61374"}]}] Nov 01 19:07:29.278619 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant: tempest-FloatingIPsTestJSON-924588053 Nov 01 19:07:29.278619 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant-Id: 0e95dfaae0374a18b4177977dca61374 Nov 01 19:07:29.278619 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant-Name: tempest-FloatingIPsTestJSON-924588053 Nov 01 19:07:29.278619 n-d-863052-2 devstack@n-api.service[121403]: X-User: tempest-FloatingIPsTestJSON-924588053-project Nov 01 19:07:29.278619 n-d-863052-2 devstack@n-api.service[121403]: X-User-Domain-Id: default Nov 01 19:07:29.278619 n-d-863052-2 devstack@n-api.service[121403]: X-User-Domain-Name: Default Nov 01 19:07:29.278619 n-d-863052-2 devstack@n-api.service[121403]: X-User-Id: 915461aa6c3348b48ccf420ce20b4ce3 Nov 01 19:07:29.278619 n-d-863052-2 devstack@n-api.service[121403]: X-User-Name: tempest-FloatingIPsTestJSON-924588053-project Nov 01 19:07:29.278619 n-d-863052-2 devstack@n-api.service[121403]: method: Nov 01 19:07:29.278619 n-d-863052-2 devstack@n-api.service[121403]: exception: Floating IP not found for ID 29a5e266-95d9-4e3e-af6a-3808ea9f19d2 Nov 01 19:07:29.278619 n-d-863052-2 devstack@n-api.service[121403]: action_args: {'id': '29a5e266-95d9-4e3e-af6a-3808ea9f19d2'} Nov 01 19:07:29.278619 n-d-863052-2 devstack@n-api.service[121403]: {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 01 19:07:29.278619 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:07:29.278619 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Nov 01 19:07:29.278619 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Nov 01 19:07:29.278619 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 01 19:07:29.278619 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 01 19:07:29.278619 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1008, in show_floatingip Nov 01 19:07:29.278619 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Nov 01 19:07:29.278619 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 01 19:07:29.278619 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 01 19:07:29.278619 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 01 19:07:29.278619 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 01 19:07:29.278619 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 01 19:07:29.278619 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 01 19:07:29.278619 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 01 19:07:29.278619 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 01 19:07:29.278619 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 01 19:07:29.278619 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 01 19:07:29.278619 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Nov 01 19:07:29.278619 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Nov 01 19:07:29.278619 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 01 19:07:29.278619 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 01 19:07:29.278619 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Nov 01 19:07:29.278619 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Nov 01 19:07:29.278619 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Nov 01 19:07:29.278619 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Nov 01 19:07:29.278619 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 29a5e266-95d9-4e3e-af6a-3808ea9f19d2 could not be found Nov 01 19:07:29.278619 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2c2b0665-6f21-4429-bd38-b110e5b8b9c9'] Nov 01 19:07:29.278619 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:07:29.283467 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:07:29.283467 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:07:29.283467 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:07:29.283467 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 158, in delete Nov 01 19:07:29.283467 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Nov 01 19:07:29.283467 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Nov 01 19:07:29.283467 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Nov 01 19:07:29.283467 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 29a5e266-95d9-4e3e-af6a-3808ea9f19d2. Nov 01 19:07:29.283467 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:07:29.283467 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:07:29.283467 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:07:29.283467 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:07:29.283467 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:07:29.283467 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:07:29.283467 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 01 19:07:29.283467 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 01 19:07:29.283467 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 01 19:07:29.283467 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 01 19:07:29.283467 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 01 19:07:29.283467 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 01 19:07:29.283467 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 161, in delete Nov 01 19:07:29.283467 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Nov 01 19:07:29.283467 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 29a5e266-95d9-4e3e-af6a-3808ea9f19d2 Nov 01 19:07:29.283467 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:07:29.283467 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:07:29.283467 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:07:29.283467 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:07:29.283467 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:07:29.283467 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:07:29.283467 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 01 19:07:29.283467 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 01 19:07:29.283467 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 29a5e266-95d9-4e3e-af6a-3808ea9f19d2 Nov 01 19:07:29.283467 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:07:29.283467 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-bf540604-f146-4119-b26e-0aa8461a459e tempest-FloatingIPsTestJSON-924588053 tempest-FloatingIPsTestJSON-924588053-project] Returning 404 to user: Floating IP not found for ID 29a5e266-95d9-4e3e-af6a-3808ea9f19d2 {{(pid=121403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 01 19:07:29.286979 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-bf540604-f146-4119-b26e-0aa8461a459e tempest-FloatingIPsTestJSON-924588053 tempest-FloatingIPsTestJSON-924588053-project] 10.222.0.13 "DELETE /compute/v2.1/os-floating-ips/29a5e266-95d9-4e3e-af6a-3808ea9f19d2" status: 404 len: 111 microversion: 2.1 time: 0.106753 Nov 01 19:07:29.288037 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1648/3222] 10.222.0.13 () {58 vars in 1263 bytes} [Tue Nov 1 19:07:29 2022] DELETE /compute/v2.1/os-floating-ips/29a5e266-95d9-4e3e-af6a-3808ea9f19d2 => generated 111 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 01 19:07:29.577651 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-152131f2-fa65-4ef4-aaeb-f647d5f7bb08 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:07:29.578986 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-152131f2-fa65-4ef4-aaeb-f647d5f7bb08 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] [instance: a3e21508-14b3-4a32-911a-86699cc0f1aa] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:07:29.617943 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-152131f2-fa65-4ef4-aaeb-f647d5f7bb08 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:29.618860 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-152131f2-fa65-4ef4-aaeb-f647d5f7bb08 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:29.622060 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-152131f2-fa65-4ef4-aaeb-f647d5f7bb08 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:29.625415 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-152131f2-fa65-4ef4-aaeb-f647d5f7bb08 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:29.626762 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-152131f2-fa65-4ef4-aaeb-f647d5f7bb08 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:29.630599 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-152131f2-fa65-4ef4-aaeb-f647d5f7bb08 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:29.826363 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-cb85d643-6df3-4dcc-9b31-b7db8093fc02 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '058480d92c9b4ab4af6815d0438a65c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee9dc49b89143f781e4ab30296e4d01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:07:29.853131 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-cb85d643-6df3-4dcc-9b31-b7db8093fc02 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] 10.222.0.13 "GET /compute/v2.1/servers/d99a7f68-99ff-4c70-9e81-1c9faf6ebb7f" status: 200 len: 1315 microversion: 2.1 time: 0.844194 Nov 01 19:07:29.858743 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1575/3223] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:07:29 2022] GET /compute/v2.1/servers/d99a7f68-99ff-4c70-9e81-1c9faf6ebb7f => generated 1315 bytes in 851 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:07:30.042936 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-52cf344f-733b-4691-b97b-0b27f4e61ac0 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:07:30.044430 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-52cf344f-733b-4691-b97b-0b27f4e61ac0 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] [instance: ba6ffc5c-84a4-40f1-bdc7-f87dde2c99df] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:07:30.058179 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-52cf344f-733b-4691-b97b-0b27f4e61ac0 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:30.061627 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-52cf344f-733b-4691-b97b-0b27f4e61ac0 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:30.062270 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-52cf344f-733b-4691-b97b-0b27f4e61ac0 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:30.063169 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-52cf344f-733b-4691-b97b-0b27f4e61ac0 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:30.063788 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-52cf344f-733b-4691-b97b-0b27f4e61ac0 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:30.065093 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-52cf344f-733b-4691-b97b-0b27f4e61ac0 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:30.238570 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-152131f2-fa65-4ef4-aaeb-f647d5f7bb08 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113bd8c844ee490b86a68bc7e1e75da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '851785a5f76548898a77d67792888504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:07:30.249471 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-152131f2-fa65-4ef4-aaeb-f647d5f7bb08 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] 10.222.0.13 "GET /compute/v2.1/servers/a3e21508-14b3-4a32-911a-86699cc0f1aa" status: 200 len: 1508 microversion: 2.1 time: 0.685725 Nov 01 19:07:30.250156 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1649/3224] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:07:29 2022] GET /compute/v2.1/servers/a3e21508-14b3-4a32-911a-86699cc0f1aa => generated 1508 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:07:30.578202 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [req-d27b2fda-faea-4188-b707-eb79df331d2d req-de00fb0f-d46c-4bc1-8920-bcb57235fb2b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a3e21508-14b3-4a32-911a-86699cc0f1aa", "name": "network-vif-deleted", "tag": "39bd1d84-a8ad-4509-85bc-21bb62289695"}]} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:07:30.598356 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-d27b2fda-faea-4188-b707-eb79df331d2d req-de00fb0f-d46c-4bc1-8920-bcb57235fb2b service nova] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:30.599556 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-d27b2fda-faea-4188-b707-eb79df331d2d req-de00fb0f-d46c-4bc1-8920-bcb57235fb2b service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:30.600881 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-d27b2fda-faea-4188-b707-eb79df331d2d req-de00fb0f-d46c-4bc1-8920-bcb57235fb2b service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:30.623276 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.compute.server_external_events [req-d27b2fda-faea-4188-b707-eb79df331d2d req-de00fb0f-d46c-4bc1-8920-bcb57235fb2b service nova] Creating event network-vif-deleted:39bd1d84-a8ad-4509-85bc-21bb62289695 for instance a3e21508-14b3-4a32-911a-86699cc0f1aa on n-h2-863052-2 Nov 01 19:07:30.630912 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [req-d27b2fda-faea-4188-b707-eb79df331d2d req-de00fb0f-d46c-4bc1-8920-bcb57235fb2b service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055679 Nov 01 19:07:30.632244 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1650/3225] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Nov 1 19:07:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:07:30.671360 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [req-71853532-e6a5-4bdb-a278-9de4a5898aa1 req-acba5698-b05b-4f48-b4c9-cb77c6579fd6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ba6ffc5c-84a4-40f1-bdc7-f87dde2c99df", "name": "network-vif-plugged", "status": "completed", "tag": "edf5ed24-0e25-44d3-8ab2-d626304020a6"}, {"server_uuid": "ba6ffc5c-84a4-40f1-bdc7-f87dde2c99df", "name": "network-vif-plugged", "status": "completed", "tag": "9d41a73a-8bec-4fb0-8fe8-9b112c925078"}, {"server_uuid": "ba6ffc5c-84a4-40f1-bdc7-f87dde2c99df", "name": "network-vif-plugged", "status": "completed", "tag": "b7614985-399c-4722-b5a8-66eda94e4a8f"}]} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:07:30.684162 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-52cf344f-733b-4691-b97b-0b27f4e61ac0 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd2105b0264b48d084d0e79cabff8bc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf4adda91364dab94830347c06e3957', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:07:30.690485 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-71853532-e6a5-4bdb-a278-9de4a5898aa1 req-acba5698-b05b-4f48-b4c9-cb77c6579fd6 service nova] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:30.691149 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-71853532-e6a5-4bdb-a278-9de4a5898aa1 req-acba5698-b05b-4f48-b4c9-cb77c6579fd6 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:30.691801 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-71853532-e6a5-4bdb-a278-9de4a5898aa1 req-acba5698-b05b-4f48-b4c9-cb77c6579fd6 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:30.697102 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-52cf344f-733b-4691-b97b-0b27f4e61ac0 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd2105b0264b48d084d0e79cabff8bc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf4adda91364dab94830347c06e3957', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:07:30.705136 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-52cf344f-733b-4691-b97b-0b27f4e61ac0 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd2105b0264b48d084d0e79cabff8bc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf4adda91364dab94830347c06e3957', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:07:30.707833 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-52cf344f-733b-4691-b97b-0b27f4e61ac0 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] 10.222.0.13 "GET /compute/v2.1/servers/ba6ffc5c-84a4-40f1-bdc7-f87dde2c99df" status: 200 len: 1875 microversion: 2.32 time: 0.669739 Nov 01 19:07:30.712065 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1576/3226] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 19:07:30 2022] GET /compute/v2.1/servers/ba6ffc5c-84a4-40f1-bdc7-f87dde2c99df => generated 1875 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 19:07:30.727640 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.compute.server_external_events [req-71853532-e6a5-4bdb-a278-9de4a5898aa1 req-acba5698-b05b-4f48-b4c9-cb77c6579fd6 service nova] Creating event network-vif-plugged:edf5ed24-0e25-44d3-8ab2-d626304020a6 for instance ba6ffc5c-84a4-40f1-bdc7-f87dde2c99df on n-h1-863052-2 Nov 01 19:07:30.728434 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.compute.server_external_events [req-71853532-e6a5-4bdb-a278-9de4a5898aa1 req-acba5698-b05b-4f48-b4c9-cb77c6579fd6 service nova] Creating event network-vif-plugged:9d41a73a-8bec-4fb0-8fe8-9b112c925078 for instance ba6ffc5c-84a4-40f1-bdc7-f87dde2c99df on n-h1-863052-2 Nov 01 19:07:30.729420 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.compute.server_external_events [req-71853532-e6a5-4bdb-a278-9de4a5898aa1 req-acba5698-b05b-4f48-b4c9-cb77c6579fd6 service nova] Creating event network-vif-plugged:b7614985-399c-4722-b5a8-66eda94e4a8f for instance ba6ffc5c-84a4-40f1-bdc7-f87dde2c99df on n-h1-863052-2 Nov 01 19:07:30.736972 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [req-71853532-e6a5-4bdb-a278-9de4a5898aa1 req-acba5698-b05b-4f48-b4c9-cb77c6579fd6 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.074005 Nov 01 19:07:30.738210 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1651/3227] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Nov 1 19:07:30 2022] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 01 19:07:30.889497 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-f87e4b05-bba7-4675-9209-9154400919ae tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:07:30.890145 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-f87e4b05-bba7-4675-9209-9154400919ae tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] [instance: d99a7f68-99ff-4c70-9e81-1c9faf6ebb7f] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:07:30.908355 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f87e4b05-bba7-4675-9209-9154400919ae tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:30.908888 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f87e4b05-bba7-4675-9209-9154400919ae tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:30.909355 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f87e4b05-bba7-4675-9209-9154400919ae tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:30.910065 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f87e4b05-bba7-4675-9209-9154400919ae tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:30.910527 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f87e4b05-bba7-4675-9209-9154400919ae tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:30.910952 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f87e4b05-bba7-4675-9209-9154400919ae tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:31.091633 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-f87e4b05-bba7-4675-9209-9154400919ae tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '058480d92c9b4ab4af6815d0438a65c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee9dc49b89143f781e4ab30296e4d01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:07:31.102976 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-f87e4b05-bba7-4675-9209-9154400919ae tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] 10.222.0.13 "GET /compute/v2.1/servers/d99a7f68-99ff-4c70-9e81-1c9faf6ebb7f" status: 200 len: 1503 microversion: 2.1 time: 0.221659 Nov 01 19:07:31.104346 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1577/3228] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:07:30 2022] GET /compute/v2.1/servers/d99a7f68-99ff-4c70-9e81-1c9faf6ebb7f => generated 1503 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:07:31.127062 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-a0ca08ff-761e-46cc-84a9-86ba8212fe11 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:07:31.127693 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-a0ca08ff-761e-46cc-84a9-86ba8212fe11 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] [instance: d99a7f68-99ff-4c70-9e81-1c9faf6ebb7f] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:07:31.133874 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-a0ca08ff-761e-46cc-84a9-86ba8212fe11 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:31.134634 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-a0ca08ff-761e-46cc-84a9-86ba8212fe11 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:31.135273 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-a0ca08ff-761e-46cc-84a9-86ba8212fe11 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:31.136157 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-a0ca08ff-761e-46cc-84a9-86ba8212fe11 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:31.136797 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-a0ca08ff-761e-46cc-84a9-86ba8212fe11 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:31.137375 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-a0ca08ff-761e-46cc-84a9-86ba8212fe11 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:31.259921 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-a0ca08ff-761e-46cc-84a9-86ba8212fe11 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] 10.222.0.13 "POST /compute/v2.1/servers/d99a7f68-99ff-4c70-9e81-1c9faf6ebb7f/action" status: 202 len: 0 microversion: 2.1 time: 0.136192 Nov 01 19:07:31.261509 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1652/3229] 10.222.0.13 () {60 vars in 1278 bytes} [Tue Nov 1 19:07:31 2022] POST /compute/v2.1/servers/d99a7f68-99ff-4c70-9e81-1c9faf6ebb7f/action => generated 0 bytes in 140 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 01 19:07:31.271704 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-dc03f4d4-f7c8-4386-8783-acba0588deef tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:07:31.272502 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-dc03f4d4-f7c8-4386-8783-acba0588deef tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] [instance: d99a7f68-99ff-4c70-9e81-1c9faf6ebb7f] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:07:31.275004 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-eead87f1-1ce3-44a4-80d0-6683dfc51172 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:07:31.276662 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-eead87f1-1ce3-44a4-80d0-6683dfc51172 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] [instance: a3e21508-14b3-4a32-911a-86699cc0f1aa] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:07:31.280213 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-dc03f4d4-f7c8-4386-8783-acba0588deef tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:31.281161 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-dc03f4d4-f7c8-4386-8783-acba0588deef tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:31.281632 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-dc03f4d4-f7c8-4386-8783-acba0588deef tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:31.282758 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-dc03f4d4-f7c8-4386-8783-acba0588deef tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:31.283001 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-eead87f1-1ce3-44a4-80d0-6683dfc51172 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:31.283226 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-dc03f4d4-f7c8-4386-8783-acba0588deef tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:31.283495 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-eead87f1-1ce3-44a4-80d0-6683dfc51172 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:31.283921 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-eead87f1-1ce3-44a4-80d0-6683dfc51172 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:31.284310 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-dc03f4d4-f7c8-4386-8783-acba0588deef tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:31.284633 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-eead87f1-1ce3-44a4-80d0-6683dfc51172 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:31.285098 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-eead87f1-1ce3-44a4-80d0-6683dfc51172 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:31.285518 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-eead87f1-1ce3-44a4-80d0-6683dfc51172 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:31.339831 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-eead87f1-1ce3-44a4-80d0-6683dfc51172 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:31.340987 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-eead87f1-1ce3-44a4-80d0-6683dfc51172 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:31.341604 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-eead87f1-1ce3-44a4-80d0-6683dfc51172 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:31.344086 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.objects.instance [None req-eead87f1-1ce3-44a4-80d0-6683dfc51172 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lazy-loading 'fault' on Instance uuid a3e21508-14b3-4a32-911a-86699cc0f1aa {{(pid=121403) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 01 19:07:31.569807 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-dc03f4d4-f7c8-4386-8783-acba0588deef tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '058480d92c9b4ab4af6815d0438a65c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee9dc49b89143f781e4ab30296e4d01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:07:31.579699 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-dc03f4d4-f7c8-4386-8783-acba0588deef tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] 10.222.0.13 "GET /compute/v2.1/servers/d99a7f68-99ff-4c70-9e81-1c9faf6ebb7f" status: 200 len: 1508 microversion: 2.1 time: 0.312833 Nov 01 19:07:31.599662 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1578/3230] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:07:31 2022] GET /compute/v2.1/servers/d99a7f68-99ff-4c70-9e81-1c9faf6ebb7f => generated 1508 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:07:31.679440 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-eead87f1-1ce3-44a4-80d0-6683dfc51172 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113bd8c844ee490b86a68bc7e1e75da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '851785a5f76548898a77d67792888504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:07:31.693712 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-eead87f1-1ce3-44a4-80d0-6683dfc51172 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] 10.222.0.13 "GET /compute/v2.1/servers/a3e21508-14b3-4a32-911a-86699cc0f1aa" status: 200 len: 1310 microversion: 2.1 time: 0.422918 Nov 01 19:07:31.694996 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1653/3231] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:07:31 2022] GET /compute/v2.1/servers/a3e21508-14b3-4a32-911a-86699cc0f1aa => generated 1310 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 19:07:31.741332 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-0d287d7c-6a07-4ebc-a4ee-15942cd768ce tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:07:31.741912 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-0d287d7c-6a07-4ebc-a4ee-15942cd768ce tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] [instance: ba6ffc5c-84a4-40f1-bdc7-f87dde2c99df] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:07:31.748025 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-0d287d7c-6a07-4ebc-a4ee-15942cd768ce tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:31.748521 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-0d287d7c-6a07-4ebc-a4ee-15942cd768ce tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:31.748978 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-0d287d7c-6a07-4ebc-a4ee-15942cd768ce tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:31.750594 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-0d287d7c-6a07-4ebc-a4ee-15942cd768ce tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:31.751056 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-0d287d7c-6a07-4ebc-a4ee-15942cd768ce tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:31.752649 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-0d287d7c-6a07-4ebc-a4ee-15942cd768ce tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:31.986757 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-0d287d7c-6a07-4ebc-a4ee-15942cd768ce tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd2105b0264b48d084d0e79cabff8bc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf4adda91364dab94830347c06e3957', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:07:31.998413 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-0d287d7c-6a07-4ebc-a4ee-15942cd768ce tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd2105b0264b48d084d0e79cabff8bc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf4adda91364dab94830347c06e3957', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:07:32.000132 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-0d287d7c-6a07-4ebc-a4ee-15942cd768ce tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd2105b0264b48d084d0e79cabff8bc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf4adda91364dab94830347c06e3957', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:07:32.001484 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-0d287d7c-6a07-4ebc-a4ee-15942cd768ce tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] 10.222.0.13 "GET /compute/v2.1/servers/ba6ffc5c-84a4-40f1-bdc7-f87dde2c99df" status: 200 len: 1875 microversion: 2.32 time: 0.264120 Nov 01 19:07:32.002995 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1579/3232] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 19:07:31 2022] GET /compute/v2.1/servers/ba6ffc5c-84a4-40f1-bdc7-f87dde2c99df => generated 1875 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 19:07:32.608147 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-66e1c25e-7ed8-4101-9e69-aa7e94105899 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:07:32.609626 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-66e1c25e-7ed8-4101-9e69-aa7e94105899 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] [instance: d99a7f68-99ff-4c70-9e81-1c9faf6ebb7f] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:07:32.616720 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-66e1c25e-7ed8-4101-9e69-aa7e94105899 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:32.617440 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-66e1c25e-7ed8-4101-9e69-aa7e94105899 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:32.617897 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-66e1c25e-7ed8-4101-9e69-aa7e94105899 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:32.618660 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-66e1c25e-7ed8-4101-9e69-aa7e94105899 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:32.619151 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-66e1c25e-7ed8-4101-9e69-aa7e94105899 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:32.619580 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-66e1c25e-7ed8-4101-9e69-aa7e94105899 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:32.722353 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-a63d54d7-cd7a-4b6b-819d-e696f42e3f65 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:07:32.724032 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-a63d54d7-cd7a-4b6b-819d-e696f42e3f65 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] [instance: a3e21508-14b3-4a32-911a-86699cc0f1aa] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:07:32.736089 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-a63d54d7-cd7a-4b6b-819d-e696f42e3f65 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:32.737130 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-a63d54d7-cd7a-4b6b-819d-e696f42e3f65 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:32.746165 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-a63d54d7-cd7a-4b6b-819d-e696f42e3f65 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:32.747832 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-a63d54d7-cd7a-4b6b-819d-e696f42e3f65 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:32.749016 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-a63d54d7-cd7a-4b6b-819d-e696f42e3f65 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:32.750307 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-a63d54d7-cd7a-4b6b-819d-e696f42e3f65 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:32.786357 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.wsgi [None req-a63d54d7-cd7a-4b6b-819d-e696f42e3f65 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] HTTP exception thrown: Instance a3e21508-14b3-4a32-911a-86699cc0f1aa could not be found. Nov 01 19:07:32.789127 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-a63d54d7-cd7a-4b6b-819d-e696f42e3f65 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Request method failure captured: Nov 01 19:07:32.789127 n-d-863052-2 devstack@n-api.service[121402]: request: GET /compute/v2.1/servers/a3e21508-14b3-4a32-911a-86699cc0f1aa HTTP/1.1 Nov 01 19:07:32.789127 n-d-863052-2 devstack@n-api.service[121402]: Accept: application/json Nov 01 19:07:32.789127 n-d-863052-2 devstack@n-api.service[121402]: Accept-Encoding: identity Nov 01 19:07:32.789127 n-d-863052-2 devstack@n-api.service[121402]: Connection: close Nov 01 19:07:32.789127 n-d-863052-2 devstack@n-api.service[121402]: Content-Length: 0 Nov 01 19:07:32.789127 n-d-863052-2 devstack@n-api.service[121402]: Content-Type: application/json Nov 01 19:07:32.789127 n-d-863052-2 devstack@n-api.service[121402]: Host: 10.222.0.13 Nov 01 19:07:32.789127 n-d-863052-2 devstack@n-api.service[121402]: Openstack-System-Scope: None Nov 01 19:07:32.789127 n-d-863052-2 devstack@n-api.service[121402]: User-Agent: python-urllib3/1.26.12 Nov 01 19:07:32.789127 n-d-863052-2 devstack@n-api.service[121402]: X-Auth-Token: gAAAAABjYW4_RJI8gKBQs81ShXQrfTSIzrNvaZj2e2rGhpR5xhmtuxP4h5uZIl9SLPqPqJ9Syn39UO-el4mPnuEEOGnWtpNlTopD6-Pc1m-VWD64ggyrfBZwUB0hnjNvBvBk6ge071YBJx2gxTN_InEu4tuxz3s-3IQBbEpMSIJZ4VoUIbz4DgY Nov 01 19:07:32.789127 n-d-863052-2 devstack@n-api.service[121402]: X-Domain-Id: None Nov 01 19:07:32.789127 n-d-863052-2 devstack@n-api.service[121402]: X-Domain-Name: None Nov 01 19:07:32.789127 n-d-863052-2 devstack@n-api.service[121402]: X-Identity-Status: Confirmed Nov 01 19:07:32.789127 n-d-863052-2 devstack@n-api.service[121402]: X-Is-Admin-Project: True Nov 01 19:07:32.789127 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Domain-Id: default Nov 01 19:07:32.789127 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Domain-Name: Default Nov 01 19:07:32.789127 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Id: 851785a5f76548898a77d67792888504 Nov 01 19:07:32.789127 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Name: tempest-ServersTestJSON-917766486 Nov 01 19:07:32.789127 n-d-863052-2 devstack@n-api.service[121402]: X-Role: member,reader Nov 01 19:07:32.789127 n-d-863052-2 devstack@n-api.service[121402]: X-Roles: member,reader Nov 01 19:07:32.789127 n-d-863052-2 devstack@n-api.service[121402]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/851785a5f76548898a77d67792888504"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/851785a5f76548898a77d67792888504"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_851785a5f76548898a77d67792888504", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/851785a5f76548898a77d67792888504"}]}] Nov 01 19:07:32.789127 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant: tempest-ServersTestJSON-917766486 Nov 01 19:07:32.789127 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant-Id: 851785a5f76548898a77d67792888504 Nov 01 19:07:32.789127 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant-Name: tempest-ServersTestJSON-917766486 Nov 01 19:07:32.789127 n-d-863052-2 devstack@n-api.service[121402]: X-User: tempest-ServersTestJSON-917766486-project Nov 01 19:07:32.789127 n-d-863052-2 devstack@n-api.service[121402]: X-User-Domain-Id: default Nov 01 19:07:32.789127 n-d-863052-2 devstack@n-api.service[121402]: X-User-Domain-Name: Default Nov 01 19:07:32.789127 n-d-863052-2 devstack@n-api.service[121402]: X-User-Id: 113bd8c844ee490b86a68bc7e1e75da3 Nov 01 19:07:32.789127 n-d-863052-2 devstack@n-api.service[121402]: X-User-Name: tempest-ServersTestJSON-917766486-project Nov 01 19:07:32.789127 n-d-863052-2 devstack@n-api.service[121402]: method: > Nov 01 19:07:32.789127 n-d-863052-2 devstack@n-api.service[121402]: exception: Instance a3e21508-14b3-4a32-911a-86699cc0f1aa could not be found. Nov 01 19:07:32.789127 n-d-863052-2 devstack@n-api.service[121402]: action_args: {'id': 'a3e21508-14b3-4a32-911a-86699cc0f1aa'} Nov 01 19:07:32.789127 n-d-863052-2 devstack@n-api.service[121402]: {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 01 19:07:32.789127 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:07:32.789127 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 01 19:07:32.789127 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 01 19:07:32.789127 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 01 19:07:32.789127 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 01 19:07:32.789127 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 01 19:07:32.789127 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 01 19:07:32.789127 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 01 19:07:32.789127 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 01 19:07:32.789127 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a3e21508-14b3-4a32-911a-86699cc0f1aa could not be found. Nov 01 19:07:32.789127 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:07:32.789127 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:07:32.789127 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:07:32.789127 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:07:32.789127 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:07:32.789127 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:07:32.789127 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 01 19:07:32.789127 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 01 19:07:32.789127 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 01 19:07:32.789127 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 01 19:07:32.789127 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 01 19:07:32.789127 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 01 19:07:32.789127 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 01 19:07:32.789127 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 01 19:07:32.789127 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 01 19:07:32.789127 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 01 19:07:32.789127 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a3e21508-14b3-4a32-911a-86699cc0f1aa could not be found. Nov 01 19:07:32.789127 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:07:32.789127 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:07:32.789127 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:07:32.789127 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:07:32.794633 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:07:32.794633 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:07:32.794633 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 01 19:07:32.794633 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 01 19:07:32.794633 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a3e21508-14b3-4a32-911a-86699cc0f1aa could not be found. Nov 01 19:07:32.794633 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:07:32.796436 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-a63d54d7-cd7a-4b6b-819d-e696f42e3f65 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Returning 404 to user: Instance a3e21508-14b3-4a32-911a-86699cc0f1aa could not be found. {{(pid=121402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 01 19:07:32.797726 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-a63d54d7-cd7a-4b6b-819d-e696f42e3f65 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] 10.222.0.13 "GET /compute/v2.1/servers/a3e21508-14b3-4a32-911a-86699cc0f1aa" status: 404 len: 111 microversion: 2.1 time: 0.081575 Nov 01 19:07:32.798888 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1580/3233] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:07:32 2022] GET /compute/v2.1/servers/a3e21508-14b3-4a32-911a-86699cc0f1aa => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 01 19:07:32.809573 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [req-14dd0f4f-71f9-40c4-84d4-61677dc7e784 req-5abfd109-c91e-4985-8198-afa967c5182d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ba6ffc5c-84a4-40f1-bdc7-f87dde2c99df", "name": "network-vif-plugged", "status": "completed", "tag": "5505ddf1-841a-456c-b4c2-811d7146122d"}]} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:07:32.820576 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-14dd0f4f-71f9-40c4-84d4-61677dc7e784 req-5abfd109-c91e-4985-8198-afa967c5182d service nova] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:32.821599 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-14dd0f4f-71f9-40c4-84d4-61677dc7e784 req-5abfd109-c91e-4985-8198-afa967c5182d service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:32.822619 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-14dd0f4f-71f9-40c4-84d4-61677dc7e784 req-5abfd109-c91e-4985-8198-afa967c5182d service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:32.836680 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.compute.server_external_events [req-14dd0f4f-71f9-40c4-84d4-61677dc7e784 req-5abfd109-c91e-4985-8198-afa967c5182d service nova] Creating event network-vif-plugged:5505ddf1-841a-456c-b4c2-811d7146122d for instance ba6ffc5c-84a4-40f1-bdc7-f87dde2c99df on n-h1-863052-2 Nov 01 19:07:32.844277 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [req-14dd0f4f-71f9-40c4-84d4-61677dc7e784 req-5abfd109-c91e-4985-8198-afa967c5182d service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043500 Nov 01 19:07:32.845625 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1581/3234] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Nov 1 19:07:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:07:32.851481 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-66e1c25e-7ed8-4101-9e69-aa7e94105899 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '058480d92c9b4ab4af6815d0438a65c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee9dc49b89143f781e4ab30296e4d01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:07:32.854339 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-ba9763aa-f0f1-4271-9b1c-62168e5a9109 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Action: 'create', calling method: .version_select at 0x7f0ae1ac08b0>, body: {"keypair": {"name": "tempest-key-512482528", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG/XVeJwmRXQd0LWzKV5feL9342GmWJ9nzI+EUspN8PF9tVvB08f73hyENRw/5Q0IVm+B7q2xpZ3Gkwgyv+Q4HgsrHqh261ifCVPC5YLn4gr9GnQJPFHY9l+i8sxqyOW/g=="}} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:07:32.862030 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-66e1c25e-7ed8-4101-9e69-aa7e94105899 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] 10.222.0.13 "GET /compute/v2.1/servers/d99a7f68-99ff-4c70-9e81-1c9faf6ebb7f" status: 200 len: 1488 microversion: 2.1 time: 0.258420 Nov 01 19:07:32.882418 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1654/3235] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:07:32 2022] GET /compute/v2.1/servers/d99a7f68-99ff-4c70-9e81-1c9faf6ebb7f => generated 1488 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:07:32.883137 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.quota [None req-ba9763aa-f0f1-4271-9b1c-62168e5a9109 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Getting quotas for project 851785a5f76548898a77d67792888504. Resources: {'key_pairs'} {{(pid=121402) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 01 19:07:32.890833 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.quota [None req-ba9763aa-f0f1-4271-9b1c-62168e5a9109 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Getting quotas for user 113bd8c844ee490b86a68bc7e1e75da3 and project 851785a5f76548898a77d67792888504. Resources: {'key_pairs'} {{(pid=121402) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 01 19:07:32.894109 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-021b1dd5-2203-4689-bb2a-ad0fc59020a5 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:07:32.894645 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-021b1dd5-2203-4689-bb2a-ad0fc59020a5 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] [instance: d99a7f68-99ff-4c70-9e81-1c9faf6ebb7f] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:07:32.910759 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-021b1dd5-2203-4689-bb2a-ad0fc59020a5 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:32.911877 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-021b1dd5-2203-4689-bb2a-ad0fc59020a5 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:32.912480 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-021b1dd5-2203-4689-bb2a-ad0fc59020a5 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:32.914737 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-021b1dd5-2203-4689-bb2a-ad0fc59020a5 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:32.917925 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-021b1dd5-2203-4689-bb2a-ad0fc59020a5 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:32.918588 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-021b1dd5-2203-4689-bb2a-ad0fc59020a5 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:32.931144 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-ba9763aa-f0f1-4271-9b1c-62168e5a9109 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 381 microversion: 2.1 time: 0.083612 Nov 01 19:07:32.933233 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1582/3236] 10.222.0.13 () {60 vars in 1159 bytes} [Tue Nov 1 19:07:32 2022] POST /compute/v2.1/os-keypairs => generated 381 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:07:32.945899 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-279226f7-1a0a-4f53-8967-8493ae714161 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Calling method '.version_select at 0x7f0ae1c44160>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:07:32.954573 n-d-863052-2 devstack@n-api.service[121402]: WARNING oslo_db.sqlalchemy.utils [None req-279226f7-1a0a-4f53-8967-8493ae714161 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Unique keys not in sort_keys. The sorting order may be unstable. Nov 01 19:07:32.961762 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-279226f7-1a0a-4f53-8967-8493ae714161 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] 10.222.0.13 "GET /compute/v2.1/os-keypairs" status: 200 len: 350 microversion: 2.1 time: 0.020007 Nov 01 19:07:32.974621 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1583/3237] 10.222.0.13 () {58 vars in 1137 bytes} [Tue Nov 1 19:07:32 2022] GET /compute/v2.1/os-keypairs => generated 350 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:07:32.978325 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-021b1dd5-2203-4689-bb2a-ad0fc59020a5 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] [instance: d99a7f68-99ff-4c70-9e81-1c9faf6ebb7f] Going to try to terminate instance {{(pid=121403) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 01 19:07:33.030343 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-2990d3eb-a30f-4081-b7e8-6382910c5abf tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:07:33.031219 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-2990d3eb-a30f-4081-b7e8-6382910c5abf tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] [instance: ba6ffc5c-84a4-40f1-bdc7-f87dde2c99df] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:07:33.043056 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2990d3eb-a30f-4081-b7e8-6382910c5abf tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:33.043559 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2990d3eb-a30f-4081-b7e8-6382910c5abf tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:33.044003 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2990d3eb-a30f-4081-b7e8-6382910c5abf tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:33.051470 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2990d3eb-a30f-4081-b7e8-6382910c5abf tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:33.052086 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2990d3eb-a30f-4081-b7e8-6382910c5abf tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:33.052541 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2990d3eb-a30f-4081-b7e8-6382910c5abf tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:33.162549 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-021b1dd5-2203-4689-bb2a-ad0fc59020a5 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] 10.222.0.13 "DELETE /compute/v2.1/servers/d99a7f68-99ff-4c70-9e81-1c9faf6ebb7f" status: 204 len: 0 microversion: 2.1 time: 0.274980 Nov 01 19:07:33.163549 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1655/3238] 10.222.0.13 () {58 vars in 1239 bytes} [Tue Nov 1 19:07:32 2022] DELETE /compute/v2.1/servers/d99a7f68-99ff-4c70-9e81-1c9faf6ebb7f => generated 0 bytes in 278 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 01 19:07:33.178380 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-4377f9f1-7989-4200-af06-c33176535f97 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1398809458", "imageRef": "2d4a0047-1b9e-445f-8af8-1b5c9d93e881", "flavorRef": "452", "key_name": "tempest-key-512482528", "networks": [{"uuid": "346d9303-d6bc-4555-85be-95ee31a2d9cd"}]}} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:07:33.242751 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.network.neutron [None req-4377f9f1-7989-4200-af06-c33176535f97 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] validate_networks() for [('346d9303-d6bc-4555-85be-95ee31a2d9cd', None, None, None, None, None)] {{(pid=121403) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 01 19:07:33.639141 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-2990d3eb-a30f-4081-b7e8-6382910c5abf tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd2105b0264b48d084d0e79cabff8bc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf4adda91364dab94830347c06e3957', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:07:33.655825 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-2990d3eb-a30f-4081-b7e8-6382910c5abf tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd2105b0264b48d084d0e79cabff8bc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf4adda91364dab94830347c06e3957', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:07:33.657807 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-2990d3eb-a30f-4081-b7e8-6382910c5abf tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd2105b0264b48d084d0e79cabff8bc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf4adda91364dab94830347c06e3957', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:07:33.659427 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-2990d3eb-a30f-4081-b7e8-6382910c5abf tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] 10.222.0.13 "GET /compute/v2.1/servers/ba6ffc5c-84a4-40f1-bdc7-f87dde2c99df" status: 200 len: 1875 microversion: 2.32 time: 0.633674 Nov 01 19:07:33.660514 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1584/3239] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 19:07:33 2022] GET /compute/v2.1/servers/ba6ffc5c-84a4-40f1-bdc7-f87dde2c99df => generated 1875 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 01 19:07:33.665749 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-ce01095b-c4b5-486f-b555-db8b53ad7f40 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:07:33.666987 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-ce01095b-c4b5-486f-b555-db8b53ad7f40 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] [instance: d99a7f68-99ff-4c70-9e81-1c9faf6ebb7f] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:07:33.673356 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-ce01095b-c4b5-486f-b555-db8b53ad7f40 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:33.673885 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-ce01095b-c4b5-486f-b555-db8b53ad7f40 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:33.674326 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-ce01095b-c4b5-486f-b555-db8b53ad7f40 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:33.675022 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-ce01095b-c4b5-486f-b555-db8b53ad7f40 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:33.675642 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-ce01095b-c4b5-486f-b555-db8b53ad7f40 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:33.676044 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-ce01095b-c4b5-486f-b555-db8b53ad7f40 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:33.929249 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-ce01095b-c4b5-486f-b555-db8b53ad7f40 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '058480d92c9b4ab4af6815d0438a65c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee9dc49b89143f781e4ab30296e4d01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:07:33.941496 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-ce01095b-c4b5-486f-b555-db8b53ad7f40 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] 10.222.0.13 "GET /compute/v2.1/servers/d99a7f68-99ff-4c70-9e81-1c9faf6ebb7f" status: 200 len: 1494 microversion: 2.1 time: 0.279656 Nov 01 19:07:33.942891 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1585/3240] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:07:33 2022] GET /compute/v2.1/servers/d99a7f68-99ff-4c70-9e81-1c9faf6ebb7f => generated 1494 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:07:33.994754 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.virt.hardware [None req-4377f9f1-7989-4200-af06-c33176535f97 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Flavor limits 0:0:0 {{(pid=121403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 01 19:07:33.995855 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.virt.hardware [None req-4377f9f1-7989-4200-af06-c33176535f97 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Image limits 0:0:0 {{(pid=121403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 01 19:07:33.996753 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.virt.hardware [None req-4377f9f1-7989-4200-af06-c33176535f97 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Flavor pref 0:0:0 {{(pid=121403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 01 19:07:33.996876 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.virt.hardware [None req-4377f9f1-7989-4200-af06-c33176535f97 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Image pref 0:0:0 {{(pid=121403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 01 19:07:33.999819 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.virt.hardware [None req-4377f9f1-7989-4200-af06-c33176535f97 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 01 19:07:34.016107 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-4377f9f1-7989-4200-af06-c33176535f97 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:34.016638 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-4377f9f1-7989-4200-af06-c33176535f97 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:34.017701 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-4377f9f1-7989-4200-af06-c33176535f97 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:34.018688 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-4377f9f1-7989-4200-af06-c33176535f97 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:34.019425 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-4377f9f1-7989-4200-af06-c33176535f97 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:34.020045 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-4377f9f1-7989-4200-af06-c33176535f97 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:34.046293 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.quota [None req-4377f9f1-7989-4200-af06-c33176535f97 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Getting quotas for project 851785a5f76548898a77d67792888504. Resources: {'cores', 'ram', 'instances'} {{(pid=121403) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 01 19:07:34.055089 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.quota [None req-4377f9f1-7989-4200-af06-c33176535f97 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Getting quotas for user 113bd8c844ee490b86a68bc7e1e75da3 and project 851785a5f76548898a77d67792888504. Resources: {'cores', 'ram', 'instances'} {{(pid=121403) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 01 19:07:34.069876 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-4377f9f1-7989-4200-af06-c33176535f97 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Going to run 1 instances... {{(pid=121403) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 01 19:07:34.073409 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-4377f9f1-7989-4200-af06-c33176535f97 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] [instance: f6fc44ea-8b27-4807-98b4-8b4b837a7ec3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2d4a0047-1b9e-445f-8af8-1b5c9d93e881',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121403) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 01 19:07:34.135277 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-4377f9f1-7989-4200-af06-c33176535f97 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.969685 Nov 01 19:07:34.143023 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1656/3241] 10.222.0.13 () {60 vars in 1147 bytes} [Tue Nov 1 19:07:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 979 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 01 19:07:34.147690 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-81f7bd17-92f0-4558-9c4d-c689b5343246 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:07:34.151139 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-81f7bd17-92f0-4558-9c4d-c689b5343246 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] [instance: f6fc44ea-8b27-4807-98b4-8b4b837a7ec3] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:07:34.302466 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-81f7bd17-92f0-4558-9c4d-c689b5343246 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113bd8c844ee490b86a68bc7e1e75da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '851785a5f76548898a77d67792888504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:07:34.314254 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-81f7bd17-92f0-4558-9c4d-c689b5343246 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] 10.222.0.13 "GET /compute/v2.1/servers/f6fc44ea-8b27-4807-98b4-8b4b837a7ec3" status: 200 len: 1228 microversion: 2.1 time: 0.170209 Nov 01 19:07:34.316912 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1586/3242] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:07:34 2022] GET /compute/v2.1/servers/f6fc44ea-8b27-4807-98b4-8b4b837a7ec3 => generated 1228 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 19:07:34.693660 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-75fdc786-1967-47f1-a9a0-20627447d3a0 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:07:34.694940 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-75fdc786-1967-47f1-a9a0-20627447d3a0 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] [instance: ba6ffc5c-84a4-40f1-bdc7-f87dde2c99df] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:07:34.723031 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-75fdc786-1967-47f1-a9a0-20627447d3a0 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:34.723918 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-75fdc786-1967-47f1-a9a0-20627447d3a0 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:34.724897 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-75fdc786-1967-47f1-a9a0-20627447d3a0 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:34.725853 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-75fdc786-1967-47f1-a9a0-20627447d3a0 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:34.726527 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-75fdc786-1967-47f1-a9a0-20627447d3a0 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:34.727169 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-75fdc786-1967-47f1-a9a0-20627447d3a0 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:34.977404 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-71afb1f0-cfd5-467e-a159-6d1cf54f32c9 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:07:34.979304 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-71afb1f0-cfd5-467e-a159-6d1cf54f32c9 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] [instance: d99a7f68-99ff-4c70-9e81-1c9faf6ebb7f] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:07:34.991406 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-71afb1f0-cfd5-467e-a159-6d1cf54f32c9 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:35.000661 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-71afb1f0-cfd5-467e-a159-6d1cf54f32c9 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:35.001765 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-71afb1f0-cfd5-467e-a159-6d1cf54f32c9 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:35.003138 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-71afb1f0-cfd5-467e-a159-6d1cf54f32c9 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:35.003968 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-71afb1f0-cfd5-467e-a159-6d1cf54f32c9 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:35.005071 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-71afb1f0-cfd5-467e-a159-6d1cf54f32c9 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:35.139535 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-75fdc786-1967-47f1-a9a0-20627447d3a0 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd2105b0264b48d084d0e79cabff8bc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf4adda91364dab94830347c06e3957', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:07:35.162477 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-75fdc786-1967-47f1-a9a0-20627447d3a0 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd2105b0264b48d084d0e79cabff8bc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf4adda91364dab94830347c06e3957', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:07:35.164428 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-75fdc786-1967-47f1-a9a0-20627447d3a0 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd2105b0264b48d084d0e79cabff8bc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf4adda91364dab94830347c06e3957', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:07:35.165693 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-75fdc786-1967-47f1-a9a0-20627447d3a0 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] 10.222.0.13 "GET /compute/v2.1/servers/ba6ffc5c-84a4-40f1-bdc7-f87dde2c99df" status: 200 len: 1875 microversion: 2.32 time: 0.479649 Nov 01 19:07:35.166289 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1657/3243] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 19:07:34 2022] GET /compute/v2.1/servers/ba6ffc5c-84a4-40f1-bdc7-f87dde2c99df => generated 1875 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 19:07:35.339051 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-de7fc86c-14e0-43c5-9a09-d8e1bb89ad63 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:07:35.339762 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-de7fc86c-14e0-43c5-9a09-d8e1bb89ad63 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] [instance: f6fc44ea-8b27-4807-98b4-8b4b837a7ec3] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:07:35.349824 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-de7fc86c-14e0-43c5-9a09-d8e1bb89ad63 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:35.350301 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-de7fc86c-14e0-43c5-9a09-d8e1bb89ad63 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:35.350736 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-de7fc86c-14e0-43c5-9a09-d8e1bb89ad63 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:35.351426 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-de7fc86c-14e0-43c5-9a09-d8e1bb89ad63 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:35.351877 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-de7fc86c-14e0-43c5-9a09-d8e1bb89ad63 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:35.352296 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-de7fc86c-14e0-43c5-9a09-d8e1bb89ad63 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:35.451492 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-de7fc86c-14e0-43c5-9a09-d8e1bb89ad63 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113bd8c844ee490b86a68bc7e1e75da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '851785a5f76548898a77d67792888504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:07:35.477156 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-de7fc86c-14e0-43c5-9a09-d8e1bb89ad63 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] 10.222.0.13 "GET /compute/v2.1/servers/f6fc44ea-8b27-4807-98b4-8b4b837a7ec3" status: 200 len: 1280 microversion: 2.1 time: 0.142381 Nov 01 19:07:35.479177 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1658/3244] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:07:35 2022] GET /compute/v2.1/servers/f6fc44ea-8b27-4807-98b4-8b4b837a7ec3 => generated 1280 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 19:07:35.737207 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-71afb1f0-cfd5-467e-a159-6d1cf54f32c9 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '058480d92c9b4ab4af6815d0438a65c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee9dc49b89143f781e4ab30296e4d01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:07:35.747129 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-71afb1f0-cfd5-467e-a159-6d1cf54f32c9 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] 10.222.0.13 "GET /compute/v2.1/servers/d99a7f68-99ff-4c70-9e81-1c9faf6ebb7f" status: 200 len: 1494 microversion: 2.1 time: 0.779770 Nov 01 19:07:35.747986 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1587/3245] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:07:34 2022] GET /compute/v2.1/servers/d99a7f68-99ff-4c70-9e81-1c9faf6ebb7f => generated 1494 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 19:07:36.196024 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-2751ff76-c218-4015-8d6d-32abd6aecbc9 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:07:36.196699 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-2751ff76-c218-4015-8d6d-32abd6aecbc9 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] [instance: ba6ffc5c-84a4-40f1-bdc7-f87dde2c99df] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:07:36.207123 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-2751ff76-c218-4015-8d6d-32abd6aecbc9 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:36.207894 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-2751ff76-c218-4015-8d6d-32abd6aecbc9 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:36.208362 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-2751ff76-c218-4015-8d6d-32abd6aecbc9 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:36.209244 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-2751ff76-c218-4015-8d6d-32abd6aecbc9 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:36.209699 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-2751ff76-c218-4015-8d6d-32abd6aecbc9 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:36.210118 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-2751ff76-c218-4015-8d6d-32abd6aecbc9 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:36.426974 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-2751ff76-c218-4015-8d6d-32abd6aecbc9 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd2105b0264b48d084d0e79cabff8bc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf4adda91364dab94830347c06e3957', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:07:36.430824 n-d-863052-2 devstack@n-api.service[121403]: DEBUG dbcounter [-] [121403] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=121403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 19:07:36.441544 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-2751ff76-c218-4015-8d6d-32abd6aecbc9 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd2105b0264b48d084d0e79cabff8bc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf4adda91364dab94830347c06e3957', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:07:36.443461 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-2751ff76-c218-4015-8d6d-32abd6aecbc9 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd2105b0264b48d084d0e79cabff8bc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf4adda91364dab94830347c06e3957', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:07:36.444955 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-2751ff76-c218-4015-8d6d-32abd6aecbc9 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] 10.222.0.13 "GET /compute/v2.1/servers/ba6ffc5c-84a4-40f1-bdc7-f87dde2c99df" status: 200 len: 2828 microversion: 2.32 time: 0.253364 Nov 01 19:07:36.446034 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1659/3246] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 19:07:36 2022] GET /compute/v2.1/servers/ba6ffc5c-84a4-40f1-bdc7-f87dde2c99df => generated 2828 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 19:07:36.472847 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-1848193e-2695-43d5-80bd-2d7aab1339d9 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:07:36.474047 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-1848193e-2695-43d5-80bd-2d7aab1339d9 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] [instance: ba6ffc5c-84a4-40f1-bdc7-f87dde2c99df] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:07:36.482001 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-1848193e-2695-43d5-80bd-2d7aab1339d9 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:36.482380 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-1848193e-2695-43d5-80bd-2d7aab1339d9 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:36.483099 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-1848193e-2695-43d5-80bd-2d7aab1339d9 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:36.483849 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-1848193e-2695-43d5-80bd-2d7aab1339d9 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:36.484358 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-1848193e-2695-43d5-80bd-2d7aab1339d9 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:36.484838 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-1848193e-2695-43d5-80bd-2d7aab1339d9 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:36.507763 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-1ae1045d-44a2-44a1-b621-af16714d049b tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:07:36.508868 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-1ae1045d-44a2-44a1-b621-af16714d049b tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] [instance: f6fc44ea-8b27-4807-98b4-8b4b837a7ec3] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:07:36.518225 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-1ae1045d-44a2-44a1-b621-af16714d049b tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:36.522435 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-1ae1045d-44a2-44a1-b621-af16714d049b tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:36.523116 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-1ae1045d-44a2-44a1-b621-af16714d049b tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:36.524437 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-1ae1045d-44a2-44a1-b621-af16714d049b tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:36.525368 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-1ae1045d-44a2-44a1-b621-af16714d049b tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:36.526612 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-1ae1045d-44a2-44a1-b621-af16714d049b tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:36.608296 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-1ae1045d-44a2-44a1-b621-af16714d049b tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113bd8c844ee490b86a68bc7e1e75da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '851785a5f76548898a77d67792888504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:07:36.617565 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-1ae1045d-44a2-44a1-b621-af16714d049b tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] 10.222.0.13 "GET /compute/v2.1/servers/f6fc44ea-8b27-4807-98b4-8b4b837a7ec3" status: 200 len: 1286 microversion: 2.1 time: 0.114783 Nov 01 19:07:36.618422 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1660/3247] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:07:36 2022] GET /compute/v2.1/servers/f6fc44ea-8b27-4807-98b4-8b4b837a7ec3 => generated 1286 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:07:36.771851 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-1848193e-2695-43d5-80bd-2d7aab1339d9 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] 10.222.0.13 "GET /compute/v2.1/servers/ba6ffc5c-84a4-40f1-bdc7-f87dde2c99df/os-interface" status: 200 len: 1833 microversion: 2.32 time: 0.302825 Nov 01 19:07:36.773960 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1588/3248] 10.222.0.13 () {60 vars in 1316 bytes} [Tue Nov 1 19:07:36 2022] GET /compute/v2.1/servers/ba6ffc5c-84a4-40f1-bdc7-f87dde2c99df/os-interface => generated 1833 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 01 19:07:36.784528 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-5c6e60bf-a377-4128-b927-df85b5b3020d tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:07:36.785489 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-5c6e60bf-a377-4128-b927-df85b5b3020d tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] [instance: d99a7f68-99ff-4c70-9e81-1c9faf6ebb7f] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:07:36.801408 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-5c6e60bf-a377-4128-b927-df85b5b3020d tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:36.803045 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-5c6e60bf-a377-4128-b927-df85b5b3020d tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:36.803997 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-5c6e60bf-a377-4128-b927-df85b5b3020d tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:36.805976 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-5c6e60bf-a377-4128-b927-df85b5b3020d tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:36.809157 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-5c6e60bf-a377-4128-b927-df85b5b3020d tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:36.809715 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-5c6e60bf-a377-4128-b927-df85b5b3020d tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:36.981427 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [req-feb89c92-a93e-41a8-a051-7bb0a599f26b req-66088532-96e3-4f6e-a5ad-f4db7436842b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d99a7f68-99ff-4c70-9e81-1c9faf6ebb7f", "name": "network-vif-deleted", "tag": "86a9807c-bdc4-485a-8d9d-51a89b1522de"}]} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:07:37.004050 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-feb89c92-a93e-41a8-a051-7bb0a599f26b req-66088532-96e3-4f6e-a5ad-f4db7436842b service nova] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:37.005420 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-feb89c92-a93e-41a8-a051-7bb0a599f26b req-66088532-96e3-4f6e-a5ad-f4db7436842b service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:37.006134 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-5c6e60bf-a377-4128-b927-df85b5b3020d tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '058480d92c9b4ab4af6815d0438a65c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee9dc49b89143f781e4ab30296e4d01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:07:37.006568 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-feb89c92-a93e-41a8-a051-7bb0a599f26b req-66088532-96e3-4f6e-a5ad-f4db7436842b service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:37.017577 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-5c6e60bf-a377-4128-b927-df85b5b3020d tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] 10.222.0.13 "GET /compute/v2.1/servers/d99a7f68-99ff-4c70-9e81-1c9faf6ebb7f" status: 200 len: 1452 microversion: 2.1 time: 0.247839 Nov 01 19:07:37.018613 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1661/3249] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:07:36 2022] GET /compute/v2.1/servers/d99a7f68-99ff-4c70-9e81-1c9faf6ebb7f => generated 1452 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 19:07:37.036724 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.compute.server_external_events [req-feb89c92-a93e-41a8-a051-7bb0a599f26b req-66088532-96e3-4f6e-a5ad-f4db7436842b service nova] Creating event network-vif-deleted:86a9807c-bdc4-485a-8d9d-51a89b1522de for instance d99a7f68-99ff-4c70-9e81-1c9faf6ebb7f on n-h2-863052-2 Nov 01 19:07:37.045629 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [req-feb89c92-a93e-41a8-a051-7bb0a599f26b req-66088532-96e3-4f6e-a5ad-f4db7436842b service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076423 Nov 01 19:07:37.048428 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1589/3250] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Nov 1 19:07:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:07:37.648381 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-5077ebf3-b3e9-4f78-8844-026ea8edfb81 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:07:37.649570 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-5077ebf3-b3e9-4f78-8844-026ea8edfb81 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] [instance: f6fc44ea-8b27-4807-98b4-8b4b837a7ec3] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:07:37.657648 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-5077ebf3-b3e9-4f78-8844-026ea8edfb81 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:37.658505 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-5077ebf3-b3e9-4f78-8844-026ea8edfb81 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:37.659622 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-5077ebf3-b3e9-4f78-8844-026ea8edfb81 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:37.661170 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-5077ebf3-b3e9-4f78-8844-026ea8edfb81 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:37.661918 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-5077ebf3-b3e9-4f78-8844-026ea8edfb81 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:37.662349 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-5077ebf3-b3e9-4f78-8844-026ea8edfb81 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:37.765474 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-5077ebf3-b3e9-4f78-8844-026ea8edfb81 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113bd8c844ee490b86a68bc7e1e75da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '851785a5f76548898a77d67792888504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:07:37.782671 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-5077ebf3-b3e9-4f78-8844-026ea8edfb81 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] 10.222.0.13 "GET /compute/v2.1/servers/f6fc44ea-8b27-4807-98b4-8b4b837a7ec3" status: 200 len: 1286 microversion: 2.1 time: 0.140211 Nov 01 19:07:37.785717 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1662/3251] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:07:37 2022] GET /compute/v2.1/servers/f6fc44ea-8b27-4807-98b4-8b4b837a7ec3 => generated 1286 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:07:38.048320 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-bec01eb1-f4e8-4b0a-9e87-aa5ff6412e85 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:07:38.049126 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-bec01eb1-f4e8-4b0a-9e87-aa5ff6412e85 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] [instance: d99a7f68-99ff-4c70-9e81-1c9faf6ebb7f] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:07:38.059158 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-bec01eb1-f4e8-4b0a-9e87-aa5ff6412e85 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:38.063441 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-bec01eb1-f4e8-4b0a-9e87-aa5ff6412e85 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:38.065298 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-bec01eb1-f4e8-4b0a-9e87-aa5ff6412e85 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:38.068265 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-bec01eb1-f4e8-4b0a-9e87-aa5ff6412e85 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:38.070500 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-bec01eb1-f4e8-4b0a-9e87-aa5ff6412e85 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:38.071146 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-bec01eb1-f4e8-4b0a-9e87-aa5ff6412e85 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:38.083712 n-d-863052-2 devstack@n-api.service[121402]: DEBUG dbcounter [-] [121402] Writing DB stats nova_cell1:SELECT=100 {{(pid=121402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 19:07:38.120324 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.wsgi [None req-bec01eb1-f4e8-4b0a-9e87-aa5ff6412e85 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] HTTP exception thrown: Instance d99a7f68-99ff-4c70-9e81-1c9faf6ebb7f could not be found. Nov 01 19:07:38.122040 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-bec01eb1-f4e8-4b0a-9e87-aa5ff6412e85 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Request method failure captured: Nov 01 19:07:38.122040 n-d-863052-2 devstack@n-api.service[121402]: request: GET /compute/v2.1/servers/d99a7f68-99ff-4c70-9e81-1c9faf6ebb7f HTTP/1.1 Nov 01 19:07:38.122040 n-d-863052-2 devstack@n-api.service[121402]: Accept: application/json Nov 01 19:07:38.122040 n-d-863052-2 devstack@n-api.service[121402]: Accept-Encoding: identity Nov 01 19:07:38.122040 n-d-863052-2 devstack@n-api.service[121402]: Connection: close Nov 01 19:07:38.122040 n-d-863052-2 devstack@n-api.service[121402]: Content-Length: 0 Nov 01 19:07:38.122040 n-d-863052-2 devstack@n-api.service[121402]: Content-Type: application/json Nov 01 19:07:38.122040 n-d-863052-2 devstack@n-api.service[121402]: Host: 10.222.0.13 Nov 01 19:07:38.122040 n-d-863052-2 devstack@n-api.service[121402]: Openstack-System-Scope: None Nov 01 19:07:38.122040 n-d-863052-2 devstack@n-api.service[121402]: User-Agent: python-urllib3/1.26.12 Nov 01 19:07:38.122040 n-d-863052-2 devstack@n-api.service[121402]: X-Auth-Token: gAAAAABjYW3ByfBI9VCjWikZSFUz_hPClqqMancoCxnwBX6xqaMeeugycqMQyEPQybXqoeO46TFhJ9TITtoJFiSbS9Ry6pB9Kueb-hoVnQBV0e7qQWXwvcx4eB_AomP3ogOCXvqhfUnxVmmooBEoQbpvBIMsXQEjVVdPObNP8WS9oGjTsTTTO4o Nov 01 19:07:38.122040 n-d-863052-2 devstack@n-api.service[121402]: X-Domain-Id: None Nov 01 19:07:38.122040 n-d-863052-2 devstack@n-api.service[121402]: X-Domain-Name: None Nov 01 19:07:38.122040 n-d-863052-2 devstack@n-api.service[121402]: X-Identity-Status: Confirmed Nov 01 19:07:38.122040 n-d-863052-2 devstack@n-api.service[121402]: X-Is-Admin-Project: True Nov 01 19:07:38.122040 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Domain-Id: default Nov 01 19:07:38.122040 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Domain-Name: Default Nov 01 19:07:38.122040 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Id: 1ee9dc49b89143f781e4ab30296e4d01 Nov 01 19:07:38.122040 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Name: tempest-DeleteServersTestJSON-412339701 Nov 01 19:07:38.122040 n-d-863052-2 devstack@n-api.service[121402]: X-Role: member,reader Nov 01 19:07:38.122040 n-d-863052-2 devstack@n-api.service[121402]: X-Roles: member,reader Nov 01 19:07:38.122040 n-d-863052-2 devstack@n-api.service[121402]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/1ee9dc49b89143f781e4ab30296e4d01"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/1ee9dc49b89143f781e4ab30296e4d01"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_1ee9dc49b89143f781e4ab30296e4d01", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/1ee9dc49b89143f781e4ab30296e4d01"}]}] Nov 01 19:07:38.122040 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant: tempest-DeleteServersTestJSON-412339701 Nov 01 19:07:38.122040 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant-Id: 1ee9dc49b89143f781e4ab30296e4d01 Nov 01 19:07:38.122040 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant-Name: tempest-DeleteServersTestJSON-412339701 Nov 01 19:07:38.122040 n-d-863052-2 devstack@n-api.service[121402]: X-User: tempest-DeleteServersTestJSON-412339701-project Nov 01 19:07:38.122040 n-d-863052-2 devstack@n-api.service[121402]: X-User-Domain-Id: default Nov 01 19:07:38.122040 n-d-863052-2 devstack@n-api.service[121402]: X-User-Domain-Name: Default Nov 01 19:07:38.122040 n-d-863052-2 devstack@n-api.service[121402]: X-User-Id: 058480d92c9b4ab4af6815d0438a65c7 Nov 01 19:07:38.122040 n-d-863052-2 devstack@n-api.service[121402]: X-User-Name: tempest-DeleteServersTestJSON-412339701-project Nov 01 19:07:38.122040 n-d-863052-2 devstack@n-api.service[121402]: method: > Nov 01 19:07:38.122040 n-d-863052-2 devstack@n-api.service[121402]: exception: Instance d99a7f68-99ff-4c70-9e81-1c9faf6ebb7f could not be found. Nov 01 19:07:38.122040 n-d-863052-2 devstack@n-api.service[121402]: action_args: {'id': 'd99a7f68-99ff-4c70-9e81-1c9faf6ebb7f'} Nov 01 19:07:38.122040 n-d-863052-2 devstack@n-api.service[121402]: {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 01 19:07:38.122040 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:07:38.122040 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 01 19:07:38.122040 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 01 19:07:38.122040 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 01 19:07:38.122040 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 01 19:07:38.122040 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 01 19:07:38.122040 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 01 19:07:38.122040 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 01 19:07:38.122040 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 01 19:07:38.122040 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d99a7f68-99ff-4c70-9e81-1c9faf6ebb7f could not be found. Nov 01 19:07:38.122040 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:07:38.122040 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:07:38.122040 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:07:38.122040 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:07:38.122040 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:07:38.122040 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:07:38.122040 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 01 19:07:38.122040 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 01 19:07:38.122040 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 01 19:07:38.122040 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 01 19:07:38.122040 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 01 19:07:38.122040 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 01 19:07:38.122040 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 01 19:07:38.122040 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 01 19:07:38.122040 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 01 19:07:38.122040 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 01 19:07:38.122040 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d99a7f68-99ff-4c70-9e81-1c9faf6ebb7f could not be found. Nov 01 19:07:38.122040 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:07:38.122040 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:07:38.122040 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:07:38.126857 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:07:38.126857 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:07:38.126857 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:07:38.126857 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 01 19:07:38.126857 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 01 19:07:38.126857 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d99a7f68-99ff-4c70-9e81-1c9faf6ebb7f could not be found. Nov 01 19:07:38.126857 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:07:38.134409 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-bec01eb1-f4e8-4b0a-9e87-aa5ff6412e85 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Returning 404 to user: Instance d99a7f68-99ff-4c70-9e81-1c9faf6ebb7f could not be found. {{(pid=121402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 01 19:07:38.136700 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-bec01eb1-f4e8-4b0a-9e87-aa5ff6412e85 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] 10.222.0.13 "GET /compute/v2.1/servers/d99a7f68-99ff-4c70-9e81-1c9faf6ebb7f" status: 404 len: 111 microversion: 2.1 time: 0.093237 Nov 01 19:07:38.137777 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1590/3252] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:07:38 2022] GET /compute/v2.1/servers/d99a7f68-99ff-4c70-9e81-1c9faf6ebb7f => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 01 19:07:38.327443 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-222cf0fc-7012-4cab-8ce8-362b80a0139d tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1979037565", "imageRef": "2d4a0047-1b9e-445f-8af8-1b5c9d93e881", "flavorRef": "452", "networks": [{"uuid": "6da1da8d-6719-4a9a-851f-308df797b88a"}]}} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:07:38.355708 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [req-0f77755e-73bb-4612-8b87-2b2e6d03764e req-d213382d-3186-4ae1-81f2-3b16beffa525 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ba6ffc5c-84a4-40f1-bdc7-f87dde2c99df", "tag": "df21a011-7bab-4ed2-bd70-fb0e2d704b1f"}]} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:07:38.374076 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-0f77755e-73bb-4612-8b87-2b2e6d03764e req-d213382d-3186-4ae1-81f2-3b16beffa525 service nova] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:38.374561 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-0f77755e-73bb-4612-8b87-2b2e6d03764e req-d213382d-3186-4ae1-81f2-3b16beffa525 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:38.374994 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-0f77755e-73bb-4612-8b87-2b2e6d03764e req-d213382d-3186-4ae1-81f2-3b16beffa525 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:38.404656 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.compute.server_external_events [req-0f77755e-73bb-4612-8b87-2b2e6d03764e req-d213382d-3186-4ae1-81f2-3b16beffa525 service nova] Creating event network-changed:df21a011-7bab-4ed2-bd70-fb0e2d704b1f for instance ba6ffc5c-84a4-40f1-bdc7-f87dde2c99df on n-h1-863052-2 Nov 01 19:07:38.417886 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [req-0f77755e-73bb-4612-8b87-2b2e6d03764e req-d213382d-3186-4ae1-81f2-3b16beffa525 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066318 Nov 01 19:07:38.419065 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1591/3253] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Nov 1 19:07:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 01 19:07:38.467628 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.network.neutron [None req-222cf0fc-7012-4cab-8ce8-362b80a0139d tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] validate_networks() for [('6da1da8d-6719-4a9a-851f-308df797b88a', None, None, None, None, None)] {{(pid=121403) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 01 19:07:38.819431 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-37b04bb7-a94a-4bbe-a2eb-4a546118412c tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:07:38.820138 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-37b04bb7-a94a-4bbe-a2eb-4a546118412c tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] [instance: f6fc44ea-8b27-4807-98b4-8b4b837a7ec3] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:07:38.828176 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-37b04bb7-a94a-4bbe-a2eb-4a546118412c tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:38.828700 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-37b04bb7-a94a-4bbe-a2eb-4a546118412c tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:38.829357 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-37b04bb7-a94a-4bbe-a2eb-4a546118412c tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:38.830799 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-37b04bb7-a94a-4bbe-a2eb-4a546118412c tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:38.831432 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-37b04bb7-a94a-4bbe-a2eb-4a546118412c tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:38.832039 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-37b04bb7-a94a-4bbe-a2eb-4a546118412c tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:39.334170 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.virt.hardware [None req-222cf0fc-7012-4cab-8ce8-362b80a0139d tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Flavor limits 0:0:0 {{(pid=121403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 01 19:07:39.334699 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.virt.hardware [None req-222cf0fc-7012-4cab-8ce8-362b80a0139d tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Image limits 0:0:0 {{(pid=121403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 01 19:07:39.335194 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.virt.hardware [None req-222cf0fc-7012-4cab-8ce8-362b80a0139d tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Flavor pref 0:0:0 {{(pid=121403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 01 19:07:39.335764 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.virt.hardware [None req-222cf0fc-7012-4cab-8ce8-362b80a0139d tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Image pref 0:0:0 {{(pid=121403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 01 19:07:39.337299 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.virt.hardware [None req-222cf0fc-7012-4cab-8ce8-362b80a0139d tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 01 19:07:39.355319 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-222cf0fc-7012-4cab-8ce8-362b80a0139d tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:39.357000 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-222cf0fc-7012-4cab-8ce8-362b80a0139d tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:39.357833 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-222cf0fc-7012-4cab-8ce8-362b80a0139d tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:39.359620 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-222cf0fc-7012-4cab-8ce8-362b80a0139d tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:39.362580 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-222cf0fc-7012-4cab-8ce8-362b80a0139d tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:39.363243 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-222cf0fc-7012-4cab-8ce8-362b80a0139d tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:39.407853 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.quota [None req-222cf0fc-7012-4cab-8ce8-362b80a0139d tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Getting quotas for project 1ee9dc49b89143f781e4ab30296e4d01. Resources: {'cores', 'ram', 'instances'} {{(pid=121403) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 01 19:07:39.418825 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.quota [None req-222cf0fc-7012-4cab-8ce8-362b80a0139d tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Getting quotas for user 058480d92c9b4ab4af6815d0438a65c7 and project 1ee9dc49b89143f781e4ab30296e4d01. Resources: {'cores', 'ram', 'instances'} {{(pid=121403) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 01 19:07:39.440040 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-37b04bb7-a94a-4bbe-a2eb-4a546118412c tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113bd8c844ee490b86a68bc7e1e75da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '851785a5f76548898a77d67792888504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:07:39.454411 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-37b04bb7-a94a-4bbe-a2eb-4a546118412c tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] 10.222.0.13 "GET /compute/v2.1/servers/f6fc44ea-8b27-4807-98b4-8b4b837a7ec3" status: 200 len: 1328 microversion: 2.1 time: 0.647271 Nov 01 19:07:39.455782 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-222cf0fc-7012-4cab-8ce8-362b80a0139d tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Going to run 1 instances... {{(pid=121403) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 01 19:07:39.456639 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1592/3254] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:07:38 2022] GET /compute/v2.1/servers/f6fc44ea-8b27-4807-98b4-8b4b837a7ec3 => generated 1328 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 19:07:39.495368 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-222cf0fc-7012-4cab-8ce8-362b80a0139d tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] [instance: 8485db2a-fd8f-4615-bbe0-14822ad44194] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2d4a0047-1b9e-445f-8af8-1b5c9d93e881',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121403) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 01 19:07:39.643857 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-222cf0fc-7012-4cab-8ce8-362b80a0139d tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.321766 Nov 01 19:07:39.646482 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1663/3255] 10.222.0.13 () {60 vars in 1147 bytes} [Tue Nov 1 19:07:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 1326 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 01 19:07:39.659397 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-cbe0ce17-841d-4257-8bfb-35258b5233dd tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:07:39.661204 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-cbe0ce17-841d-4257-8bfb-35258b5233dd tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] [instance: 674f7fae-6219-4e5e-b85a-2647b948807e] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:07:39.676656 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-cbe0ce17-841d-4257-8bfb-35258b5233dd tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:39.677436 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-cbe0ce17-841d-4257-8bfb-35258b5233dd tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:39.678065 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-cbe0ce17-841d-4257-8bfb-35258b5233dd tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:39.684661 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-cbe0ce17-841d-4257-8bfb-35258b5233dd tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:39.685602 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-cbe0ce17-841d-4257-8bfb-35258b5233dd tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:39.687158 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-cbe0ce17-841d-4257-8bfb-35258b5233dd tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:39.746254 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-cbe0ce17-841d-4257-8bfb-35258b5233dd tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] 10.222.0.13 "GET /compute/v2.1/servers/674f7fae-6219-4e5e-b85a-2647b948807e/ips" status: 200 len: 149 microversion: 2.1 time: 0.098501 Nov 01 19:07:39.750193 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1664/3256] 10.222.0.13 () {58 vars in 1248 bytes} [Tue Nov 1 19:07:39 2022] GET /compute/v2.1/servers/674f7fae-6219-4e5e-b85a-2647b948807e/ips => generated 149 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:07:39.755097 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-a2ef94e1-c6d1-44ee-8105-42d986b5c36e tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:07:39.756021 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-a2ef94e1-c6d1-44ee-8105-42d986b5c36e tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] [instance: 8485db2a-fd8f-4615-bbe0-14822ad44194] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:07:39.790379 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-cbdc6788-6528-4f1b-80f9-8f403dca8957 tempest-ImagesOneServerTestJSON-1044295602 tempest-ImagesOneServerTestJSON-1044295602-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerTestJSON-server-508080254", "imageRef": "2d4a0047-1b9e-445f-8af8-1b5c9d93e881", "flavorRef": "452"}} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:07:39.859749 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-a2ef94e1-c6d1-44ee-8105-42d986b5c36e tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '058480d92c9b4ab4af6815d0438a65c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee9dc49b89143f781e4ab30296e4d01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:07:39.868570 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-a2ef94e1-c6d1-44ee-8105-42d986b5c36e tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] 10.222.0.13 "GET /compute/v2.1/servers/8485db2a-fd8f-4615-bbe0-14822ad44194" status: 200 len: 1215 microversion: 2.1 time: 0.117319 Nov 01 19:07:39.870389 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1665/3257] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:07:39 2022] GET /compute/v2.1/servers/8485db2a-fd8f-4615-bbe0-14822ad44194 => generated 1215 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:07:39.890357 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-d978e64c-67af-4ff0-a3e9-2c23723f6823 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "570e6f6f-08f1-4533-80b2-d91dfc64c54a"}} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:07:39.899342 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.network.neutron [None req-cbdc6788-6528-4f1b-80f9-8f403dca8957 tempest-ImagesOneServerTestJSON-1044295602 tempest-ImagesOneServerTestJSON-1044295602-project] validate_networks() for None {{(pid=121402) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 01 19:07:39.910740 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-d978e64c-67af-4ff0-a3e9-2c23723f6823 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] [instance: 674f7fae-6219-4e5e-b85a-2647b948807e] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:07:39.939541 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d978e64c-67af-4ff0-a3e9-2c23723f6823 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:39.940258 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d978e64c-67af-4ff0-a3e9-2c23723f6823 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:39.941644 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d978e64c-67af-4ff0-a3e9-2c23723f6823 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:39.942678 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d978e64c-67af-4ff0-a3e9-2c23723f6823 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:39.944616 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d978e64c-67af-4ff0-a3e9-2c23723f6823 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:39.945412 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d978e64c-67af-4ff0-a3e9-2c23723f6823 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:40.089905 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.wsgi [None req-d978e64c-67af-4ff0-a3e9-2c23723f6823 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] HTTP exception thrown: Invalid volume: volume 570e6f6f-08f1-4533-80b2-d91dfc64c54a is already attached to instances: 3029f3c1-4f32-4f6b-963c-16f65b6dff3c Nov 01 19:07:40.092195 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-d978e64c-67af-4ff0-a3e9-2c23723f6823 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Request method failure captured: Nov 01 19:07:40.092195 n-d-863052-2 devstack@n-api.service[121403]: request: POST /compute/v2.1/servers/674f7fae-6219-4e5e-b85a-2647b948807e/os-volume_attachments HTTP/1.1 Nov 01 19:07:40.092195 n-d-863052-2 devstack@n-api.service[121403]: Accept: application/json Nov 01 19:07:40.092195 n-d-863052-2 devstack@n-api.service[121403]: Accept-Encoding: identity Nov 01 19:07:40.092195 n-d-863052-2 devstack@n-api.service[121403]: Connection: close Nov 01 19:07:40.092195 n-d-863052-2 devstack@n-api.service[121403]: Content-Length: 74 Nov 01 19:07:40.092195 n-d-863052-2 devstack@n-api.service[121403]: Content-Type: application/json Nov 01 19:07:40.092195 n-d-863052-2 devstack@n-api.service[121403]: Host: 10.222.0.13 Nov 01 19:07:40.092195 n-d-863052-2 devstack@n-api.service[121403]: Openstack-System-Scope: None Nov 01 19:07:40.092195 n-d-863052-2 devstack@n-api.service[121403]: User-Agent: python-urllib3/1.26.12 Nov 01 19:07:40.092195 n-d-863052-2 devstack@n-api.service[121403]: X-Auth-Token: gAAAAABjYW26-niUURjtSz2aypPDgkYX79sMl0CZOJW_ml_lGFRo-4lOtvHbbGMI0UBaScGrQfLye0e0L4c10ym8MikDvB1h-T3Rh6fQQzcKLxsRSm1saxobVhs9el4Qiq-2aZx04HWuIjPot0FuuMjXsFtl108kYD3rs-RWb4TVydSfipjFJKk Nov 01 19:07:40.092195 n-d-863052-2 devstack@n-api.service[121403]: X-Domain-Id: None Nov 01 19:07:40.092195 n-d-863052-2 devstack@n-api.service[121403]: X-Domain-Name: None Nov 01 19:07:40.092195 n-d-863052-2 devstack@n-api.service[121403]: X-Identity-Status: Confirmed Nov 01 19:07:40.092195 n-d-863052-2 devstack@n-api.service[121403]: X-Is-Admin-Project: True Nov 01 19:07:40.092195 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Domain-Id: default Nov 01 19:07:40.092195 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Domain-Name: Default Nov 01 19:07:40.092195 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Id: 33e3d319293c46b6af2f728a50586906 Nov 01 19:07:40.092195 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Name: tempest-AttachVolumeNegativeTest-517167560 Nov 01 19:07:40.092195 n-d-863052-2 devstack@n-api.service[121403]: X-Role: member,reader Nov 01 19:07:40.092195 n-d-863052-2 devstack@n-api.service[121403]: X-Roles: member,reader Nov 01 19:07:40.092195 n-d-863052-2 devstack@n-api.service[121403]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/33e3d319293c46b6af2f728a50586906"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/33e3d319293c46b6af2f728a50586906"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_33e3d319293c46b6af2f728a50586906", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/33e3d319293c46b6af2f728a50586906"}]}] Nov 01 19:07:40.092195 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant: tempest-AttachVolumeNegativeTest-517167560 Nov 01 19:07:40.092195 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant-Id: 33e3d319293c46b6af2f728a50586906 Nov 01 19:07:40.092195 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-517167560 Nov 01 19:07:40.092195 n-d-863052-2 devstack@n-api.service[121403]: X-User: tempest-AttachVolumeNegativeTest-517167560-project Nov 01 19:07:40.092195 n-d-863052-2 devstack@n-api.service[121403]: X-User-Domain-Id: default Nov 01 19:07:40.092195 n-d-863052-2 devstack@n-api.service[121403]: X-User-Domain-Name: Default Nov 01 19:07:40.092195 n-d-863052-2 devstack@n-api.service[121403]: X-User-Id: 790f3f1566b7464aaca19d4d05c0942e Nov 01 19:07:40.092195 n-d-863052-2 devstack@n-api.service[121403]: X-User-Name: tempest-AttachVolumeNegativeTest-517167560-project Nov 01 19:07:40.092195 n-d-863052-2 devstack@n-api.service[121403]: Nov 01 19:07:40.092195 n-d-863052-2 devstack@n-api.service[121403]: {"volumeAttachment": {"volumeId": "570e6f6f-08f1-4533-80b2-d91dfc64c54a"}} Nov 01 19:07:40.092195 n-d-863052-2 devstack@n-api.service[121403]: method: > Nov 01 19:07:40.092195 n-d-863052-2 devstack@n-api.service[121403]: exception: Invalid volume: volume 570e6f6f-08f1-4533-80b2-d91dfc64c54a is already attached to instances: 3029f3c1-4f32-4f6b-963c-16f65b6dff3c Nov 01 19:07:40.092195 n-d-863052-2 devstack@n-api.service[121403]: action_args: {'server_id': '674f7fae-6219-4e5e-b85a-2647b948807e', 'body': {'volumeAttachment': {'volumeId': '570e6f6f-08f1-4533-80b2-d91dfc64c54a'}}} Nov 01 19:07:40.092195 n-d-863052-2 devstack@n-api.service[121403]: {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 01 19:07:40.092195 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:07:40.092195 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Nov 01 19:07:40.092195 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Nov 01 19:07:40.092195 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Nov 01 19:07:40.092195 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Nov 01 19:07:40.092195 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Nov 01 19:07:40.092195 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Nov 01 19:07:40.092195 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Nov 01 19:07:40.092195 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Nov 01 19:07:40.092195 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Nov 01 19:07:40.092195 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Nov 01 19:07:40.092195 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 570e6f6f-08f1-4533-80b2-d91dfc64c54a is already attached to instances: 3029f3c1-4f32-4f6b-963c-16f65b6dff3c Nov 01 19:07:40.092195 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:07:40.092195 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:07:40.092195 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:07:40.092195 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:07:40.092195 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:07:40.092195 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:07:40.092195 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 01 19:07:40.092195 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 01 19:07:40.092195 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 01 19:07:40.092195 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 01 19:07:40.092195 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 01 19:07:40.092195 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 01 19:07:40.092195 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 01 19:07:40.092195 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 01 19:07:40.097654 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 01 19:07:40.097654 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 01 19:07:40.097654 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Nov 01 19:07:40.097654 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Nov 01 19:07:40.097654 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 570e6f6f-08f1-4533-80b2-d91dfc64c54a is already attached to instances: 3029f3c1-4f32-4f6b-963c-16f65b6dff3c Nov 01 19:07:40.097654 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:07:40.097654 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:07:40.097654 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:07:40.097654 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:07:40.097654 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:07:40.097654 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:07:40.097654 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 01 19:07:40.097654 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 01 19:07:40.097654 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 570e6f6f-08f1-4533-80b2-d91dfc64c54a is already attached to instances: 3029f3c1-4f32-4f6b-963c-16f65b6dff3c Nov 01 19:07:40.097654 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:07:40.100979 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-d978e64c-67af-4ff0-a3e9-2c23723f6823 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Returning 400 to user: Invalid volume: volume 570e6f6f-08f1-4533-80b2-d91dfc64c54a is already attached to instances: 3029f3c1-4f32-4f6b-963c-16f65b6dff3c {{(pid=121403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 01 19:07:40.102916 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-d978e64c-67af-4ff0-a3e9-2c23723f6823 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] 10.222.0.13 "POST /compute/v2.1/servers/674f7fae-6219-4e5e-b85a-2647b948807e/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.231147 Nov 01 19:07:40.109331 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1666/3258] 10.222.0.13 () {60 vars in 1323 bytes} [Tue Nov 1 19:07:39 2022] POST /compute/v2.1/servers/674f7fae-6219-4e5e-b85a-2647b948807e/os-volume_attachments => generated 174 bytes in 238 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 01 19:07:40.122796 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-e68ce866-541e-4a7a-92db-171bbdb1e321 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:07:40.123804 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-e68ce866-541e-4a7a-92db-171bbdb1e321 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] [instance: 674f7fae-6219-4e5e-b85a-2647b948807e] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:07:40.132085 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-e68ce866-541e-4a7a-92db-171bbdb1e321 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:40.133120 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-e68ce866-541e-4a7a-92db-171bbdb1e321 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:40.133716 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-e68ce866-541e-4a7a-92db-171bbdb1e321 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:40.134648 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-e68ce866-541e-4a7a-92db-171bbdb1e321 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:40.135633 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-e68ce866-541e-4a7a-92db-171bbdb1e321 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:40.136225 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-e68ce866-541e-4a7a-92db-171bbdb1e321 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:40.173823 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-e68ce866-541e-4a7a-92db-171bbdb1e321 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] [instance: 674f7fae-6219-4e5e-b85a-2647b948807e] Going to try to terminate instance {{(pid=121403) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 01 19:07:40.328741 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.virt.hardware [None req-cbdc6788-6528-4f1b-80f9-8f403dca8957 tempest-ImagesOneServerTestJSON-1044295602 tempest-ImagesOneServerTestJSON-1044295602-project] Flavor limits 0:0:0 {{(pid=121402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 01 19:07:40.329369 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.virt.hardware [None req-cbdc6788-6528-4f1b-80f9-8f403dca8957 tempest-ImagesOneServerTestJSON-1044295602 tempest-ImagesOneServerTestJSON-1044295602-project] Image limits 0:0:0 {{(pid=121402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 01 19:07:40.330117 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-e68ce866-541e-4a7a-92db-171bbdb1e321 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] 10.222.0.13 "DELETE /compute/v2.1/servers/674f7fae-6219-4e5e-b85a-2647b948807e" status: 204 len: 0 microversion: 2.1 time: 0.218879 Nov 01 19:07:40.330298 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.virt.hardware [None req-cbdc6788-6528-4f1b-80f9-8f403dca8957 tempest-ImagesOneServerTestJSON-1044295602 tempest-ImagesOneServerTestJSON-1044295602-project] Flavor pref 0:0:0 {{(pid=121402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 01 19:07:40.330972 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.virt.hardware [None req-cbdc6788-6528-4f1b-80f9-8f403dca8957 tempest-ImagesOneServerTestJSON-1044295602 tempest-ImagesOneServerTestJSON-1044295602-project] Image pref 0:0:0 {{(pid=121402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 01 19:07:40.331261 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1667/3259] 10.222.0.13 () {58 vars in 1239 bytes} [Tue Nov 1 19:07:40 2022] DELETE /compute/v2.1/servers/674f7fae-6219-4e5e-b85a-2647b948807e => generated 0 bytes in 221 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 01 19:07:40.331835 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.virt.hardware [None req-cbdc6788-6528-4f1b-80f9-8f403dca8957 tempest-ImagesOneServerTestJSON-1044295602 tempest-ImagesOneServerTestJSON-1044295602-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 01 19:07:40.340370 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-90f60c6a-1650-4ec6-b553-f8619022e907 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:07:40.342758 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-90f60c6a-1650-4ec6-b553-f8619022e907 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] [instance: 674f7fae-6219-4e5e-b85a-2647b948807e] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:07:40.351740 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-90f60c6a-1650-4ec6-b553-f8619022e907 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:40.352640 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-90f60c6a-1650-4ec6-b553-f8619022e907 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:40.356028 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-cbdc6788-6528-4f1b-80f9-8f403dca8957 tempest-ImagesOneServerTestJSON-1044295602 tempest-ImagesOneServerTestJSON-1044295602-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:40.356820 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-cbdc6788-6528-4f1b-80f9-8f403dca8957 tempest-ImagesOneServerTestJSON-1044295602 tempest-ImagesOneServerTestJSON-1044295602-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:40.357747 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-cbdc6788-6528-4f1b-80f9-8f403dca8957 tempest-ImagesOneServerTestJSON-1044295602 tempest-ImagesOneServerTestJSON-1044295602-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:40.358996 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-cbdc6788-6528-4f1b-80f9-8f403dca8957 tempest-ImagesOneServerTestJSON-1044295602 tempest-ImagesOneServerTestJSON-1044295602-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:40.359639 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-cbdc6788-6528-4f1b-80f9-8f403dca8957 tempest-ImagesOneServerTestJSON-1044295602 tempest-ImagesOneServerTestJSON-1044295602-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:40.360226 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-cbdc6788-6528-4f1b-80f9-8f403dca8957 tempest-ImagesOneServerTestJSON-1044295602 tempest-ImagesOneServerTestJSON-1044295602-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:40.362216 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-90f60c6a-1650-4ec6-b553-f8619022e907 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:40.363287 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-90f60c6a-1650-4ec6-b553-f8619022e907 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:40.365418 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-90f60c6a-1650-4ec6-b553-f8619022e907 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:40.366176 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-90f60c6a-1650-4ec6-b553-f8619022e907 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:40.399742 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.quota [None req-cbdc6788-6528-4f1b-80f9-8f403dca8957 tempest-ImagesOneServerTestJSON-1044295602 tempest-ImagesOneServerTestJSON-1044295602-project] Getting quotas for project c548420d1df4403c9129cce5f040d45b. Resources: {'cores', 'ram', 'instances'} {{(pid=121402) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 01 19:07:40.418565 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.quota [None req-cbdc6788-6528-4f1b-80f9-8f403dca8957 tempest-ImagesOneServerTestJSON-1044295602 tempest-ImagesOneServerTestJSON-1044295602-project] Getting quotas for user ed6fd718964648e4bc83ed37cbaa9b84 and project c548420d1df4403c9129cce5f040d45b. Resources: {'cores', 'ram', 'instances'} {{(pid=121402) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 01 19:07:40.434392 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-cbdc6788-6528-4f1b-80f9-8f403dca8957 tempest-ImagesOneServerTestJSON-1044295602 tempest-ImagesOneServerTestJSON-1044295602-project] Going to run 1 instances... {{(pid=121402) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 01 19:07:40.437405 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-cbdc6788-6528-4f1b-80f9-8f403dca8957 tempest-ImagesOneServerTestJSON-1044295602 tempest-ImagesOneServerTestJSON-1044295602-project] [instance: 31f51cbd-b29a-46be-bca0-f27c2b287e15] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2d4a0047-1b9e-445f-8af8-1b5c9d93e881',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121402) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 01 19:07:40.527890 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-cbdc6788-6528-4f1b-80f9-8f403dca8957 tempest-ImagesOneServerTestJSON-1044295602 tempest-ImagesOneServerTestJSON-1044295602-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.065794 Nov 01 19:07:40.531096 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1593/3260] 10.222.0.13 () {60 vars in 1147 bytes} [Tue Nov 1 19:07:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 1071 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 01 19:07:40.545813 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-ed963ed7-c0bb-4043-ae00-b169d8cdfa38 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:07:40.546598 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-ed963ed7-c0bb-4043-ae00-b169d8cdfa38 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] [instance: f6fc44ea-8b27-4807-98b4-8b4b837a7ec3] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:07:40.558177 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-ed963ed7-c0bb-4043-ae00-b169d8cdfa38 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:40.559010 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-ed963ed7-c0bb-4043-ae00-b169d8cdfa38 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:40.559837 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-ed963ed7-c0bb-4043-ae00-b169d8cdfa38 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:40.561567 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-ed963ed7-c0bb-4043-ae00-b169d8cdfa38 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:40.562337 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-ed963ed7-c0bb-4043-ae00-b169d8cdfa38 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:40.562919 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-ed963ed7-c0bb-4043-ae00-b169d8cdfa38 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:40.665061 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-90f60c6a-1650-4ec6-b553-f8619022e907 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '790f3f1566b7464aaca19d4d05c0942e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33e3d319293c46b6af2f728a50586906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:07:40.678282 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-90f60c6a-1650-4ec6-b553-f8619022e907 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] 10.222.0.13 "GET /compute/v2.1/servers/674f7fae-6219-4e5e-b85a-2647b948807e" status: 200 len: 1681 microversion: 2.1 time: 0.342773 Nov 01 19:07:40.693774 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1668/3261] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:07:40 2022] GET /compute/v2.1/servers/674f7fae-6219-4e5e-b85a-2647b948807e => generated 1681 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:07:40.697908 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-ba15ba0b-cf8a-483c-826d-aae5895b972b tempest-ImagesOneServerTestJSON-1044295602 tempest-ImagesOneServerTestJSON-1044295602-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:07:40.698531 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-ba15ba0b-cf8a-483c-826d-aae5895b972b tempest-ImagesOneServerTestJSON-1044295602 tempest-ImagesOneServerTestJSON-1044295602-project] [instance: 31f51cbd-b29a-46be-bca0-f27c2b287e15] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:07:40.707545 n-d-863052-2 devstack@n-api.service[121403]: DEBUG dbcounter [-] [121403] Writing DB stats nova_api:SELECT=91,nova_api:UPDATE=3,nova_api:INSERT=6 {{(pid=121403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 19:07:40.770536 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-ba15ba0b-cf8a-483c-826d-aae5895b972b tempest-ImagesOneServerTestJSON-1044295602 tempest-ImagesOneServerTestJSON-1044295602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6fd718964648e4bc83ed37cbaa9b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c548420d1df4403c9129cce5f040d45b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:07:40.789934 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-ba15ba0b-cf8a-483c-826d-aae5895b972b tempest-ImagesOneServerTestJSON-1044295602 tempest-ImagesOneServerTestJSON-1044295602-project] 10.222.0.13 "GET /compute/v2.1/servers/31f51cbd-b29a-46be-bca0-f27c2b287e15" status: 200 len: 1216 microversion: 2.1 time: 0.108552 Nov 01 19:07:40.790669 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1669/3262] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:07:40 2022] GET /compute/v2.1/servers/31f51cbd-b29a-46be-bca0-f27c2b287e15 => generated 1216 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:07:40.900863 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-02be30fe-2387-4d58-9600-e14b478b47ce tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:07:40.901892 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-02be30fe-2387-4d58-9600-e14b478b47ce tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] [instance: 8485db2a-fd8f-4615-bbe0-14822ad44194] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:07:40.910880 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-02be30fe-2387-4d58-9600-e14b478b47ce tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:40.911870 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-02be30fe-2387-4d58-9600-e14b478b47ce tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:40.912818 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-02be30fe-2387-4d58-9600-e14b478b47ce tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:40.913843 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-02be30fe-2387-4d58-9600-e14b478b47ce tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:40.916224 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-02be30fe-2387-4d58-9600-e14b478b47ce tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:40.916959 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-02be30fe-2387-4d58-9600-e14b478b47ce tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:40.939224 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-ed963ed7-c0bb-4043-ae00-b169d8cdfa38 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113bd8c844ee490b86a68bc7e1e75da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '851785a5f76548898a77d67792888504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:07:40.948600 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-ed963ed7-c0bb-4043-ae00-b169d8cdfa38 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] 10.222.0.13 "GET /compute/v2.1/servers/f6fc44ea-8b27-4807-98b4-8b4b837a7ec3" status: 200 len: 1328 microversion: 2.1 time: 0.415623 Nov 01 19:07:40.953642 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1594/3263] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:07:40 2022] GET /compute/v2.1/servers/f6fc44ea-8b27-4807-98b4-8b4b837a7ec3 => generated 1328 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:07:40.961865 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [req-83c9da92-84fe-466f-b73e-42a438eed74f req-17dc2110-e525-445b-8492-6c9c3cfb1406 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f6fc44ea-8b27-4807-98b4-8b4b837a7ec3", "tag": "d8acb2d9-1cce-4aec-b4f5-cb000b4af23d"}]} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:07:40.986906 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-83c9da92-84fe-466f-b73e-42a438eed74f req-17dc2110-e525-445b-8492-6c9c3cfb1406 service nova] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:40.987404 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-83c9da92-84fe-466f-b73e-42a438eed74f req-17dc2110-e525-445b-8492-6c9c3cfb1406 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:40.987848 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-83c9da92-84fe-466f-b73e-42a438eed74f req-17dc2110-e525-445b-8492-6c9c3cfb1406 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:41.014367 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-02be30fe-2387-4d58-9600-e14b478b47ce tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '058480d92c9b4ab4af6815d0438a65c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee9dc49b89143f781e4ab30296e4d01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:07:41.016565 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.compute.server_external_events [req-83c9da92-84fe-466f-b73e-42a438eed74f req-17dc2110-e525-445b-8492-6c9c3cfb1406 service nova] Creating event network-changed:d8acb2d9-1cce-4aec-b4f5-cb000b4af23d for instance f6fc44ea-8b27-4807-98b4-8b4b837a7ec3 on n-h1-863052-2 Nov 01 19:07:41.024154 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [req-83c9da92-84fe-466f-b73e-42a438eed74f req-17dc2110-e525-445b-8492-6c9c3cfb1406 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065259 Nov 01 19:07:41.024316 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-02be30fe-2387-4d58-9600-e14b478b47ce tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] 10.222.0.13 "GET /compute/v2.1/servers/8485db2a-fd8f-4615-bbe0-14822ad44194" status: 200 len: 1267 microversion: 2.1 time: 0.131445 Nov 01 19:07:41.025749 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1670/3264] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:07:40 2022] GET /compute/v2.1/servers/8485db2a-fd8f-4615-bbe0-14822ad44194 => generated 1267 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:07:41.037451 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1595/3265] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Nov 1 19:07:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:07:41.705202 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-da8190a9-3615-435a-aaff-78beaf255d3b tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:07:41.707206 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-da8190a9-3615-435a-aaff-78beaf255d3b tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] [instance: 674f7fae-6219-4e5e-b85a-2647b948807e] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:07:41.723251 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-da8190a9-3615-435a-aaff-78beaf255d3b tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:41.724158 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-da8190a9-3615-435a-aaff-78beaf255d3b tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:41.724809 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-da8190a9-3615-435a-aaff-78beaf255d3b tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:41.725832 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-da8190a9-3615-435a-aaff-78beaf255d3b tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:41.726449 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-da8190a9-3615-435a-aaff-78beaf255d3b tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:41.727047 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-da8190a9-3615-435a-aaff-78beaf255d3b tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:41.816630 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-f4a50014-2140-4c2a-bce8-1695d7baae5d tempest-ImagesOneServerTestJSON-1044295602 tempest-ImagesOneServerTestJSON-1044295602-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:07:41.817056 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-f4a50014-2140-4c2a-bce8-1695d7baae5d tempest-ImagesOneServerTestJSON-1044295602 tempest-ImagesOneServerTestJSON-1044295602-project] [instance: 31f51cbd-b29a-46be-bca0-f27c2b287e15] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:07:41.828525 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f4a50014-2140-4c2a-bce8-1695d7baae5d tempest-ImagesOneServerTestJSON-1044295602 tempest-ImagesOneServerTestJSON-1044295602-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:41.829297 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f4a50014-2140-4c2a-bce8-1695d7baae5d tempest-ImagesOneServerTestJSON-1044295602 tempest-ImagesOneServerTestJSON-1044295602-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:41.829994 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f4a50014-2140-4c2a-bce8-1695d7baae5d tempest-ImagesOneServerTestJSON-1044295602 tempest-ImagesOneServerTestJSON-1044295602-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:41.830870 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f4a50014-2140-4c2a-bce8-1695d7baae5d tempest-ImagesOneServerTestJSON-1044295602 tempest-ImagesOneServerTestJSON-1044295602-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:41.831792 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f4a50014-2140-4c2a-bce8-1695d7baae5d tempest-ImagesOneServerTestJSON-1044295602 tempest-ImagesOneServerTestJSON-1044295602-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:41.832408 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f4a50014-2140-4c2a-bce8-1695d7baae5d tempest-ImagesOneServerTestJSON-1044295602 tempest-ImagesOneServerTestJSON-1044295602-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:42.011151 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-da8190a9-3615-435a-aaff-78beaf255d3b tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '790f3f1566b7464aaca19d4d05c0942e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33e3d319293c46b6af2f728a50586906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:07:42.020738 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-da8190a9-3615-435a-aaff-78beaf255d3b tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] 10.222.0.13 "GET /compute/v2.1/servers/674f7fae-6219-4e5e-b85a-2647b948807e" status: 200 len: 1681 microversion: 2.1 time: 0.319730 Nov 01 19:07:42.022242 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1671/3266] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:07:41 2022] GET /compute/v2.1/servers/674f7fae-6219-4e5e-b85a-2647b948807e => generated 1681 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:07:42.033472 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-a42818af-a4f2-45b8-a5c7-0eaccadcab35 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:07:42.034741 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-a42818af-a4f2-45b8-a5c7-0eaccadcab35 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] [instance: f6fc44ea-8b27-4807-98b4-8b4b837a7ec3] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:07:42.043966 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-a42818af-a4f2-45b8-a5c7-0eaccadcab35 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:42.044842 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-a42818af-a4f2-45b8-a5c7-0eaccadcab35 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:42.045433 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-a42818af-a4f2-45b8-a5c7-0eaccadcab35 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:42.047341 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-a42818af-a4f2-45b8-a5c7-0eaccadcab35 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:42.048039 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-a42818af-a4f2-45b8-a5c7-0eaccadcab35 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:42.048473 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-a42818af-a4f2-45b8-a5c7-0eaccadcab35 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:42.348296 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-f4a50014-2140-4c2a-bce8-1695d7baae5d tempest-ImagesOneServerTestJSON-1044295602 tempest-ImagesOneServerTestJSON-1044295602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6fd718964648e4bc83ed37cbaa9b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c548420d1df4403c9129cce5f040d45b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:07:42.359788 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-f4a50014-2140-4c2a-bce8-1695d7baae5d tempest-ImagesOneServerTestJSON-1044295602 tempest-ImagesOneServerTestJSON-1044295602-project] 10.222.0.13 "GET /compute/v2.1/servers/31f51cbd-b29a-46be-bca0-f27c2b287e15" status: 200 len: 1268 microversion: 2.1 time: 0.548801 Nov 01 19:07:42.362679 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1596/3267] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:07:41 2022] GET /compute/v2.1/servers/31f51cbd-b29a-46be-bca0-f27c2b287e15 => generated 1268 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 19:07:42.373805 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-7dee5874-7a16-4f85-a6ac-b1b918bd3896 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:07:42.374846 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-7dee5874-7a16-4f85-a6ac-b1b918bd3896 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] [instance: 8485db2a-fd8f-4615-bbe0-14822ad44194] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:07:42.382526 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-7dee5874-7a16-4f85-a6ac-b1b918bd3896 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:42.383448 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-7dee5874-7a16-4f85-a6ac-b1b918bd3896 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:42.384123 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-7dee5874-7a16-4f85-a6ac-b1b918bd3896 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:42.385754 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-7dee5874-7a16-4f85-a6ac-b1b918bd3896 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:42.386457 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-7dee5874-7a16-4f85-a6ac-b1b918bd3896 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:42.387295 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-7dee5874-7a16-4f85-a6ac-b1b918bd3896 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:42.484852 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-7dee5874-7a16-4f85-a6ac-b1b918bd3896 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '058480d92c9b4ab4af6815d0438a65c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee9dc49b89143f781e4ab30296e4d01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:07:42.495916 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-7dee5874-7a16-4f85-a6ac-b1b918bd3896 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] 10.222.0.13 "GET /compute/v2.1/servers/8485db2a-fd8f-4615-bbe0-14822ad44194" status: 200 len: 1273 microversion: 2.1 time: 0.131687 Nov 01 19:07:42.496922 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1597/3268] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:07:42 2022] GET /compute/v2.1/servers/8485db2a-fd8f-4615-bbe0-14822ad44194 => generated 1273 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:07:42.766882 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-a42818af-a4f2-45b8-a5c7-0eaccadcab35 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113bd8c844ee490b86a68bc7e1e75da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '851785a5f76548898a77d67792888504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:07:42.777967 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-a42818af-a4f2-45b8-a5c7-0eaccadcab35 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] 10.222.0.13 "GET /compute/v2.1/servers/f6fc44ea-8b27-4807-98b4-8b4b837a7ec3" status: 200 len: 1328 microversion: 2.1 time: 0.749418 Nov 01 19:07:42.779911 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1672/3269] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:07:42 2022] GET /compute/v2.1/servers/f6fc44ea-8b27-4807-98b4-8b4b837a7ec3 => generated 1328 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:07:43.053660 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-23739f10-a95b-46d0-b990-16cad8c3dbd0 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:07:43.054928 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-23739f10-a95b-46d0-b990-16cad8c3dbd0 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] [instance: 674f7fae-6219-4e5e-b85a-2647b948807e] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:07:43.065421 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-23739f10-a95b-46d0-b990-16cad8c3dbd0 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:43.066579 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-23739f10-a95b-46d0-b990-16cad8c3dbd0 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:43.067306 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-23739f10-a95b-46d0-b990-16cad8c3dbd0 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:43.068992 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-23739f10-a95b-46d0-b990-16cad8c3dbd0 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:43.069765 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-23739f10-a95b-46d0-b990-16cad8c3dbd0 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:43.071644 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-23739f10-a95b-46d0-b990-16cad8c3dbd0 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:43.272362 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-23739f10-a95b-46d0-b990-16cad8c3dbd0 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '790f3f1566b7464aaca19d4d05c0942e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33e3d319293c46b6af2f728a50586906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:07:43.288960 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-23739f10-a95b-46d0-b990-16cad8c3dbd0 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] 10.222.0.13 "GET /compute/v2.1/servers/674f7fae-6219-4e5e-b85a-2647b948807e" status: 200 len: 1613 microversion: 2.1 time: 0.239282 Nov 01 19:07:43.298951 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1598/3270] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:07:43 2022] GET /compute/v2.1/servers/674f7fae-6219-4e5e-b85a-2647b948807e => generated 1613 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:07:43.387165 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-85bf24a8-4eb9-4e35-91c3-e0d8d84f3dbe tempest-ImagesOneServerTestJSON-1044295602 tempest-ImagesOneServerTestJSON-1044295602-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:07:43.388294 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-85bf24a8-4eb9-4e35-91c3-e0d8d84f3dbe tempest-ImagesOneServerTestJSON-1044295602 tempest-ImagesOneServerTestJSON-1044295602-project] [instance: 31f51cbd-b29a-46be-bca0-f27c2b287e15] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:07:43.403347 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-85bf24a8-4eb9-4e35-91c3-e0d8d84f3dbe tempest-ImagesOneServerTestJSON-1044295602 tempest-ImagesOneServerTestJSON-1044295602-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:43.408747 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-85bf24a8-4eb9-4e35-91c3-e0d8d84f3dbe tempest-ImagesOneServerTestJSON-1044295602 tempest-ImagesOneServerTestJSON-1044295602-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:43.409469 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-85bf24a8-4eb9-4e35-91c3-e0d8d84f3dbe tempest-ImagesOneServerTestJSON-1044295602 tempest-ImagesOneServerTestJSON-1044295602-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:43.411232 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-85bf24a8-4eb9-4e35-91c3-e0d8d84f3dbe tempest-ImagesOneServerTestJSON-1044295602 tempest-ImagesOneServerTestJSON-1044295602-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:43.412855 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-85bf24a8-4eb9-4e35-91c3-e0d8d84f3dbe tempest-ImagesOneServerTestJSON-1044295602 tempest-ImagesOneServerTestJSON-1044295602-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:43.414452 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-85bf24a8-4eb9-4e35-91c3-e0d8d84f3dbe tempest-ImagesOneServerTestJSON-1044295602 tempest-ImagesOneServerTestJSON-1044295602-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:43.523002 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-f1291cba-4935-44f3-9671-7b35351c0352 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:07:43.523658 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-f1291cba-4935-44f3-9671-7b35351c0352 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] [instance: 8485db2a-fd8f-4615-bbe0-14822ad44194] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:07:43.538597 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f1291cba-4935-44f3-9671-7b35351c0352 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:43.539161 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f1291cba-4935-44f3-9671-7b35351c0352 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:43.539634 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f1291cba-4935-44f3-9671-7b35351c0352 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:43.540379 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f1291cba-4935-44f3-9671-7b35351c0352 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:43.541560 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f1291cba-4935-44f3-9671-7b35351c0352 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:43.542196 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f1291cba-4935-44f3-9671-7b35351c0352 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:43.823903 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-f1291cba-4935-44f3-9671-7b35351c0352 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '058480d92c9b4ab4af6815d0438a65c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee9dc49b89143f781e4ab30296e4d01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:07:43.833304 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-f1291cba-4935-44f3-9671-7b35351c0352 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] 10.222.0.13 "GET /compute/v2.1/servers/8485db2a-fd8f-4615-bbe0-14822ad44194" status: 200 len: 1273 microversion: 2.1 time: 0.314656 Nov 01 19:07:43.834547 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1599/3271] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:07:43 2022] GET /compute/v2.1/servers/8485db2a-fd8f-4615-bbe0-14822ad44194 => generated 1273 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 19:07:43.840660 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-92c07a7b-5060-49ee-a9c7-c2eee6f54256 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:07:43.841618 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-92c07a7b-5060-49ee-a9c7-c2eee6f54256 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] [instance: f6fc44ea-8b27-4807-98b4-8b4b837a7ec3] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:07:43.848379 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-92c07a7b-5060-49ee-a9c7-c2eee6f54256 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:43.849047 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-92c07a7b-5060-49ee-a9c7-c2eee6f54256 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:43.849856 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-92c07a7b-5060-49ee-a9c7-c2eee6f54256 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:43.850729 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-92c07a7b-5060-49ee-a9c7-c2eee6f54256 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:43.851459 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-92c07a7b-5060-49ee-a9c7-c2eee6f54256 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:43.854997 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-92c07a7b-5060-49ee-a9c7-c2eee6f54256 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:43.930491 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-85bf24a8-4eb9-4e35-91c3-e0d8d84f3dbe tempest-ImagesOneServerTestJSON-1044295602 tempest-ImagesOneServerTestJSON-1044295602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6fd718964648e4bc83ed37cbaa9b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c548420d1df4403c9129cce5f040d45b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:07:43.943772 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-85bf24a8-4eb9-4e35-91c3-e0d8d84f3dbe tempest-ImagesOneServerTestJSON-1044295602 tempest-ImagesOneServerTestJSON-1044295602-project] 10.222.0.13 "GET /compute/v2.1/servers/31f51cbd-b29a-46be-bca0-f27c2b287e15" status: 200 len: 1274 microversion: 2.1 time: 0.561276 Nov 01 19:07:43.944372 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1673/3272] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:07:43 2022] GET /compute/v2.1/servers/31f51cbd-b29a-46be-bca0-f27c2b287e15 => generated 1274 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:07:44.010855 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [req-dc0f0174-93c2-4e0e-842b-a60d0ee48a78 req-3aa94892-0f4f-42eb-b0b4-191a7a32d1e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "674f7fae-6219-4e5e-b85a-2647b948807e", "name": "network-vif-deleted", "tag": "e78f185e-94a2-461b-9824-b0b788dd62e1"}]} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:07:44.044762 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-dc0f0174-93c2-4e0e-842b-a60d0ee48a78 req-3aa94892-0f4f-42eb-b0b4-191a7a32d1e2 service nova] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:44.047339 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-dc0f0174-93c2-4e0e-842b-a60d0ee48a78 req-3aa94892-0f4f-42eb-b0b4-191a7a32d1e2 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:44.047982 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-dc0f0174-93c2-4e0e-842b-a60d0ee48a78 req-3aa94892-0f4f-42eb-b0b4-191a7a32d1e2 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:44.091981 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.compute.server_external_events [req-dc0f0174-93c2-4e0e-842b-a60d0ee48a78 req-3aa94892-0f4f-42eb-b0b4-191a7a32d1e2 service nova] Creating event network-vif-deleted:e78f185e-94a2-461b-9824-b0b788dd62e1 for instance 674f7fae-6219-4e5e-b85a-2647b948807e on n-h1-863052-2 Nov 01 19:07:44.107407 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [req-dc0f0174-93c2-4e0e-842b-a60d0ee48a78 req-3aa94892-0f4f-42eb-b0b4-191a7a32d1e2 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099590 Nov 01 19:07:44.111409 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1674/3273] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Nov 1 19:07:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 01 19:07:44.330485 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-b0c85276-55fe-480c-bf55-a08d431541c3 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:07:44.331315 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-b0c85276-55fe-480c-bf55-a08d431541c3 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] [instance: 674f7fae-6219-4e5e-b85a-2647b948807e] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:07:44.351259 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-b0c85276-55fe-480c-bf55-a08d431541c3 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:44.352183 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-b0c85276-55fe-480c-bf55-a08d431541c3 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:44.354804 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-b0c85276-55fe-480c-bf55-a08d431541c3 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:44.355869 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-b0c85276-55fe-480c-bf55-a08d431541c3 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:44.359106 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-b0c85276-55fe-480c-bf55-a08d431541c3 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:44.359562 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-b0c85276-55fe-480c-bf55-a08d431541c3 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:44.472053 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-b0c85276-55fe-480c-bf55-a08d431541c3 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:44.472759 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-b0c85276-55fe-480c-bf55-a08d431541c3 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:44.473350 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-b0c85276-55fe-480c-bf55-a08d431541c3 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:44.481703 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.objects.instance [None req-b0c85276-55fe-480c-bf55-a08d431541c3 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lazy-loading 'fault' on Instance uuid 674f7fae-6219-4e5e-b85a-2647b948807e {{(pid=121403) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 01 19:07:44.608987 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-b0c85276-55fe-480c-bf55-a08d431541c3 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '790f3f1566b7464aaca19d4d05c0942e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33e3d319293c46b6af2f728a50586906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:07:44.617887 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-b0c85276-55fe-480c-bf55-a08d431541c3 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] 10.222.0.13 "GET /compute/v2.1/servers/674f7fae-6219-4e5e-b85a-2647b948807e" status: 200 len: 1331 microversion: 2.1 time: 0.292815 Nov 01 19:07:44.626566 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-92c07a7b-5060-49ee-a9c7-c2eee6f54256 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113bd8c844ee490b86a68bc7e1e75da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '851785a5f76548898a77d67792888504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:07:44.628032 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1675/3274] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:07:44 2022] GET /compute/v2.1/servers/674f7fae-6219-4e5e-b85a-2647b948807e => generated 1331 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 19:07:44.660475 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-92c07a7b-5060-49ee-a9c7-c2eee6f54256 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] 10.222.0.13 "GET /compute/v2.1/servers/f6fc44ea-8b27-4807-98b4-8b4b837a7ec3" status: 200 len: 1328 microversion: 2.1 time: 0.822985 Nov 01 19:07:44.662604 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1600/3275] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:07:43 2022] GET /compute/v2.1/servers/f6fc44ea-8b27-4807-98b4-8b4b837a7ec3 => generated 1328 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:07:44.862352 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-643b7c07-20cb-4f05-aba3-7896325bdc18 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:07:44.863367 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-643b7c07-20cb-4f05-aba3-7896325bdc18 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] [instance: 8485db2a-fd8f-4615-bbe0-14822ad44194] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:07:44.874206 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-643b7c07-20cb-4f05-aba3-7896325bdc18 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:44.875890 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-643b7c07-20cb-4f05-aba3-7896325bdc18 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:44.877724 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-643b7c07-20cb-4f05-aba3-7896325bdc18 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:44.884815 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-643b7c07-20cb-4f05-aba3-7896325bdc18 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:44.887872 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-643b7c07-20cb-4f05-aba3-7896325bdc18 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:44.889406 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-643b7c07-20cb-4f05-aba3-7896325bdc18 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:44.959936 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-1eb15ef3-931f-40a8-a5e5-f8b9eed7f880 tempest-ServerMetadataNegativeTestJSON-414983834 tempest-ServerMetadataNegativeTestJSON-414983834-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-373955631", "imageRef": "2d4a0047-1b9e-445f-8af8-1b5c9d93e881", "flavorRef": "452", "metadata": {}, "networks": [{"uuid": "3d22c6c2-f92e-4412-8eb6-291b21149bea"}]}} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:07:45.069500 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.network.neutron [None req-1eb15ef3-931f-40a8-a5e5-f8b9eed7f880 tempest-ServerMetadataNegativeTestJSON-414983834 tempest-ServerMetadataNegativeTestJSON-414983834-project] validate_networks() for [('3d22c6c2-f92e-4412-8eb6-291b21149bea', None, None, None, None, None)] {{(pid=121403) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 01 19:07:45.422241 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-643b7c07-20cb-4f05-aba3-7896325bdc18 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '058480d92c9b4ab4af6815d0438a65c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee9dc49b89143f781e4ab30296e4d01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:07:45.439212 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-643b7c07-20cb-4f05-aba3-7896325bdc18 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] 10.222.0.13 "GET /compute/v2.1/servers/8485db2a-fd8f-4615-bbe0-14822ad44194" status: 200 len: 1315 microversion: 2.1 time: 0.575074 Nov 01 19:07:45.439877 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1601/3276] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:07:44 2022] GET /compute/v2.1/servers/8485db2a-fd8f-4615-bbe0-14822ad44194 => generated 1315 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:07:45.447887 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-5d39cb55-1041-4d31-af31-44555ed01074 tempest-ImagesOneServerTestJSON-1044295602 tempest-ImagesOneServerTestJSON-1044295602-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:07:45.448468 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-5d39cb55-1041-4d31-af31-44555ed01074 tempest-ImagesOneServerTestJSON-1044295602 tempest-ImagesOneServerTestJSON-1044295602-project] [instance: 31f51cbd-b29a-46be-bca0-f27c2b287e15] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:07:45.464796 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-5d39cb55-1041-4d31-af31-44555ed01074 tempest-ImagesOneServerTestJSON-1044295602 tempest-ImagesOneServerTestJSON-1044295602-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:45.465296 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-5d39cb55-1041-4d31-af31-44555ed01074 tempest-ImagesOneServerTestJSON-1044295602 tempest-ImagesOneServerTestJSON-1044295602-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:45.465831 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-5d39cb55-1041-4d31-af31-44555ed01074 tempest-ImagesOneServerTestJSON-1044295602 tempest-ImagesOneServerTestJSON-1044295602-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:45.466578 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-5d39cb55-1041-4d31-af31-44555ed01074 tempest-ImagesOneServerTestJSON-1044295602 tempest-ImagesOneServerTestJSON-1044295602-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:45.467141 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-5d39cb55-1041-4d31-af31-44555ed01074 tempest-ImagesOneServerTestJSON-1044295602 tempest-ImagesOneServerTestJSON-1044295602-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:45.467585 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-5d39cb55-1041-4d31-af31-44555ed01074 tempest-ImagesOneServerTestJSON-1044295602 tempest-ImagesOneServerTestJSON-1044295602-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:45.931756 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-5d39cb55-1041-4d31-af31-44555ed01074 tempest-ImagesOneServerTestJSON-1044295602 tempest-ImagesOneServerTestJSON-1044295602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6fd718964648e4bc83ed37cbaa9b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c548420d1df4403c9129cce5f040d45b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:07:45.945217 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-5d39cb55-1041-4d31-af31-44555ed01074 tempest-ImagesOneServerTestJSON-1044295602 tempest-ImagesOneServerTestJSON-1044295602-project] 10.222.0.13 "GET /compute/v2.1/servers/31f51cbd-b29a-46be-bca0-f27c2b287e15" status: 200 len: 1316 microversion: 2.1 time: 0.503967 Nov 01 19:07:45.945835 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1602/3277] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:07:45 2022] GET /compute/v2.1/servers/31f51cbd-b29a-46be-bca0-f27c2b287e15 => generated 1316 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:07:45.962057 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-aad9ea6b-5c63-49ec-84da-fe35bf5986fb tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:07:45.963495 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-aad9ea6b-5c63-49ec-84da-fe35bf5986fb tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] [instance: 674f7fae-6219-4e5e-b85a-2647b948807e] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:07:45.970208 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-aad9ea6b-5c63-49ec-84da-fe35bf5986fb tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:45.970631 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-aad9ea6b-5c63-49ec-84da-fe35bf5986fb tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:45.972862 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-aad9ea6b-5c63-49ec-84da-fe35bf5986fb tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:45.973828 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-aad9ea6b-5c63-49ec-84da-fe35bf5986fb tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:45.976425 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-aad9ea6b-5c63-49ec-84da-fe35bf5986fb tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:45.977098 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-aad9ea6b-5c63-49ec-84da-fe35bf5986fb tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:46.019639 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.wsgi [None req-aad9ea6b-5c63-49ec-84da-fe35bf5986fb tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] HTTP exception thrown: Instance 674f7fae-6219-4e5e-b85a-2647b948807e could not be found. Nov 01 19:07:46.021787 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-aad9ea6b-5c63-49ec-84da-fe35bf5986fb tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Request method failure captured: Nov 01 19:07:46.021787 n-d-863052-2 devstack@n-api.service[121402]: request: GET /compute/v2.1/servers/674f7fae-6219-4e5e-b85a-2647b948807e HTTP/1.1 Nov 01 19:07:46.021787 n-d-863052-2 devstack@n-api.service[121402]: Accept: application/json Nov 01 19:07:46.021787 n-d-863052-2 devstack@n-api.service[121402]: Accept-Encoding: identity Nov 01 19:07:46.021787 n-d-863052-2 devstack@n-api.service[121402]: Connection: close Nov 01 19:07:46.021787 n-d-863052-2 devstack@n-api.service[121402]: Content-Length: 0 Nov 01 19:07:46.021787 n-d-863052-2 devstack@n-api.service[121402]: Content-Type: application/json Nov 01 19:07:46.021787 n-d-863052-2 devstack@n-api.service[121402]: Host: 10.222.0.13 Nov 01 19:07:46.021787 n-d-863052-2 devstack@n-api.service[121402]: Openstack-System-Scope: None Nov 01 19:07:46.021787 n-d-863052-2 devstack@n-api.service[121402]: User-Agent: python-urllib3/1.26.12 Nov 01 19:07:46.021787 n-d-863052-2 devstack@n-api.service[121402]: X-Auth-Token: gAAAAABjYW26-niUURjtSz2aypPDgkYX79sMl0CZOJW_ml_lGFRo-4lOtvHbbGMI0UBaScGrQfLye0e0L4c10ym8MikDvB1h-T3Rh6fQQzcKLxsRSm1saxobVhs9el4Qiq-2aZx04HWuIjPot0FuuMjXsFtl108kYD3rs-RWb4TVydSfipjFJKk Nov 01 19:07:46.021787 n-d-863052-2 devstack@n-api.service[121402]: X-Domain-Id: None Nov 01 19:07:46.021787 n-d-863052-2 devstack@n-api.service[121402]: X-Domain-Name: None Nov 01 19:07:46.021787 n-d-863052-2 devstack@n-api.service[121402]: X-Identity-Status: Confirmed Nov 01 19:07:46.021787 n-d-863052-2 devstack@n-api.service[121402]: X-Is-Admin-Project: True Nov 01 19:07:46.021787 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Domain-Id: default Nov 01 19:07:46.021787 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Domain-Name: Default Nov 01 19:07:46.021787 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Id: 33e3d319293c46b6af2f728a50586906 Nov 01 19:07:46.021787 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Name: tempest-AttachVolumeNegativeTest-517167560 Nov 01 19:07:46.021787 n-d-863052-2 devstack@n-api.service[121402]: X-Role: member,reader Nov 01 19:07:46.021787 n-d-863052-2 devstack@n-api.service[121402]: X-Roles: member,reader Nov 01 19:07:46.021787 n-d-863052-2 devstack@n-api.service[121402]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/33e3d319293c46b6af2f728a50586906"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/33e3d319293c46b6af2f728a50586906"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_33e3d319293c46b6af2f728a50586906", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/33e3d319293c46b6af2f728a50586906"}]}] Nov 01 19:07:46.021787 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant: tempest-AttachVolumeNegativeTest-517167560 Nov 01 19:07:46.021787 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant-Id: 33e3d319293c46b6af2f728a50586906 Nov 01 19:07:46.021787 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-517167560 Nov 01 19:07:46.021787 n-d-863052-2 devstack@n-api.service[121402]: X-User: tempest-AttachVolumeNegativeTest-517167560-project Nov 01 19:07:46.021787 n-d-863052-2 devstack@n-api.service[121402]: X-User-Domain-Id: default Nov 01 19:07:46.021787 n-d-863052-2 devstack@n-api.service[121402]: X-User-Domain-Name: Default Nov 01 19:07:46.021787 n-d-863052-2 devstack@n-api.service[121402]: X-User-Id: 790f3f1566b7464aaca19d4d05c0942e Nov 01 19:07:46.021787 n-d-863052-2 devstack@n-api.service[121402]: X-User-Name: tempest-AttachVolumeNegativeTest-517167560-project Nov 01 19:07:46.021787 n-d-863052-2 devstack@n-api.service[121402]: method: > Nov 01 19:07:46.021787 n-d-863052-2 devstack@n-api.service[121402]: exception: Instance 674f7fae-6219-4e5e-b85a-2647b948807e could not be found. Nov 01 19:07:46.021787 n-d-863052-2 devstack@n-api.service[121402]: action_args: {'id': '674f7fae-6219-4e5e-b85a-2647b948807e'} Nov 01 19:07:46.021787 n-d-863052-2 devstack@n-api.service[121402]: {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 01 19:07:46.021787 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:07:46.021787 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 01 19:07:46.021787 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 01 19:07:46.021787 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 01 19:07:46.021787 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 01 19:07:46.021787 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 01 19:07:46.021787 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 01 19:07:46.021787 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 01 19:07:46.021787 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 01 19:07:46.021787 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 674f7fae-6219-4e5e-b85a-2647b948807e could not be found. Nov 01 19:07:46.021787 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:07:46.021787 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:07:46.021787 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:07:46.021787 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:07:46.021787 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:07:46.021787 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:07:46.021787 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 01 19:07:46.021787 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 01 19:07:46.021787 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 01 19:07:46.021787 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 01 19:07:46.021787 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 01 19:07:46.021787 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 01 19:07:46.021787 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 01 19:07:46.021787 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 01 19:07:46.021787 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 01 19:07:46.021787 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 01 19:07:46.021787 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 674f7fae-6219-4e5e-b85a-2647b948807e could not be found. Nov 01 19:07:46.021787 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:07:46.021787 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:07:46.021787 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:07:46.027602 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:07:46.027602 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:07:46.027602 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:07:46.027602 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 01 19:07:46.027602 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 01 19:07:46.027602 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 674f7fae-6219-4e5e-b85a-2647b948807e could not be found. Nov 01 19:07:46.027602 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:07:46.033557 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-aad9ea6b-5c63-49ec-84da-fe35bf5986fb tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Returning 404 to user: Instance 674f7fae-6219-4e5e-b85a-2647b948807e could not be found. {{(pid=121402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 01 19:07:46.034727 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-aad9ea6b-5c63-49ec-84da-fe35bf5986fb tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] 10.222.0.13 "GET /compute/v2.1/servers/674f7fae-6219-4e5e-b85a-2647b948807e" status: 404 len: 111 microversion: 2.1 time: 0.087657 Nov 01 19:07:46.040197 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1603/3278] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:07:45 2022] GET /compute/v2.1/servers/674f7fae-6219-4e5e-b85a-2647b948807e => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 01 19:07:46.052555 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-3ca53609-99a0-4b4c-893c-9554efd7c379 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:07:46.058132 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-3ca53609-99a0-4b4c-893c-9554efd7c379 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] [instance: f6fc44ea-8b27-4807-98b4-8b4b837a7ec3] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:07:46.072151 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-3ca53609-99a0-4b4c-893c-9554efd7c379 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:46.075376 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-3ca53609-99a0-4b4c-893c-9554efd7c379 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:46.076112 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-3ca53609-99a0-4b4c-893c-9554efd7c379 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:46.077532 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-3ca53609-99a0-4b4c-893c-9554efd7c379 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:46.080437 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-3ca53609-99a0-4b4c-893c-9554efd7c379 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:46.081355 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-3ca53609-99a0-4b4c-893c-9554efd7c379 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:46.251316 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.virt.hardware [None req-1eb15ef3-931f-40a8-a5e5-f8b9eed7f880 tempest-ServerMetadataNegativeTestJSON-414983834 tempest-ServerMetadataNegativeTestJSON-414983834-project] Flavor limits 0:0:0 {{(pid=121403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 01 19:07:46.252103 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.virt.hardware [None req-1eb15ef3-931f-40a8-a5e5-f8b9eed7f880 tempest-ServerMetadataNegativeTestJSON-414983834 tempest-ServerMetadataNegativeTestJSON-414983834-project] Image limits 0:0:0 {{(pid=121403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 01 19:07:46.255127 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.virt.hardware [None req-1eb15ef3-931f-40a8-a5e5-f8b9eed7f880 tempest-ServerMetadataNegativeTestJSON-414983834 tempest-ServerMetadataNegativeTestJSON-414983834-project] Flavor pref 0:0:0 {{(pid=121403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 01 19:07:46.255662 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.virt.hardware [None req-1eb15ef3-931f-40a8-a5e5-f8b9eed7f880 tempest-ServerMetadataNegativeTestJSON-414983834 tempest-ServerMetadataNegativeTestJSON-414983834-project] Image pref 0:0:0 {{(pid=121403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 01 19:07:46.256118 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.virt.hardware [None req-1eb15ef3-931f-40a8-a5e5-f8b9eed7f880 tempest-ServerMetadataNegativeTestJSON-414983834 tempest-ServerMetadataNegativeTestJSON-414983834-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 01 19:07:46.270293 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-1eb15ef3-931f-40a8-a5e5-f8b9eed7f880 tempest-ServerMetadataNegativeTestJSON-414983834 tempest-ServerMetadataNegativeTestJSON-414983834-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:46.271163 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-1eb15ef3-931f-40a8-a5e5-f8b9eed7f880 tempest-ServerMetadataNegativeTestJSON-414983834 tempest-ServerMetadataNegativeTestJSON-414983834-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:46.272300 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-1eb15ef3-931f-40a8-a5e5-f8b9eed7f880 tempest-ServerMetadataNegativeTestJSON-414983834 tempest-ServerMetadataNegativeTestJSON-414983834-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:46.273761 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-1eb15ef3-931f-40a8-a5e5-f8b9eed7f880 tempest-ServerMetadataNegativeTestJSON-414983834 tempest-ServerMetadataNegativeTestJSON-414983834-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:46.274599 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-1eb15ef3-931f-40a8-a5e5-f8b9eed7f880 tempest-ServerMetadataNegativeTestJSON-414983834 tempest-ServerMetadataNegativeTestJSON-414983834-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:46.275928 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-1eb15ef3-931f-40a8-a5e5-f8b9eed7f880 tempest-ServerMetadataNegativeTestJSON-414983834 tempest-ServerMetadataNegativeTestJSON-414983834-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:46.303306 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.quota [None req-1eb15ef3-931f-40a8-a5e5-f8b9eed7f880 tempest-ServerMetadataNegativeTestJSON-414983834 tempest-ServerMetadataNegativeTestJSON-414983834-project] Getting quotas for project d702a70dab124153b4f40d3219ffc5f3. Resources: {'cores', 'ram', 'instances'} {{(pid=121403) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 01 19:07:46.310140 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.quota [None req-1eb15ef3-931f-40a8-a5e5-f8b9eed7f880 tempest-ServerMetadataNegativeTestJSON-414983834 tempest-ServerMetadataNegativeTestJSON-414983834-project] Getting quotas for user aebd68d6b30e45debbfd99ee6360f905 and project d702a70dab124153b4f40d3219ffc5f3. Resources: {'cores', 'ram', 'instances'} {{(pid=121403) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 01 19:07:46.330310 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-1eb15ef3-931f-40a8-a5e5-f8b9eed7f880 tempest-ServerMetadataNegativeTestJSON-414983834 tempest-ServerMetadataNegativeTestJSON-414983834-project] Going to run 1 instances... {{(pid=121403) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 01 19:07:46.334594 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-1eb15ef3-931f-40a8-a5e5-f8b9eed7f880 tempest-ServerMetadataNegativeTestJSON-414983834 tempest-ServerMetadataNegativeTestJSON-414983834-project] [instance: 6bb5dbff-cdc7-4986-8606-cec948c9d28c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2d4a0047-1b9e-445f-8af8-1b5c9d93e881',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121403) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 01 19:07:46.390295 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-3ca53609-99a0-4b4c-893c-9554efd7c379 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113bd8c844ee490b86a68bc7e1e75da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '851785a5f76548898a77d67792888504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:07:46.404826 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-3ca53609-99a0-4b4c-893c-9554efd7c379 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] 10.222.0.13 "GET /compute/v2.1/servers/f6fc44ea-8b27-4807-98b4-8b4b837a7ec3" status: 200 len: 1328 microversion: 2.1 time: 0.360079 Nov 01 19:07:46.413204 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-1eb15ef3-931f-40a8-a5e5-f8b9eed7f880 tempest-ServerMetadataNegativeTestJSON-414983834 tempest-ServerMetadataNegativeTestJSON-414983834-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.654941 Nov 01 19:07:46.415287 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1676/3279] 10.222.0.13 () {60 vars in 1147 bytes} [Tue Nov 1 19:07:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 1660 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 01 19:07:46.424679 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-36afc62d-60e2-4159-b711-f0331f59f5bf tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Calling method '.version_select at 0x7f0ae66e2550>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:07:46.426538 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1604/3280] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:07:46 2022] GET /compute/v2.1/servers/f6fc44ea-8b27-4807-98b4-8b4b837a7ec3 => generated 1328 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:07:46.434537 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-cd843f40-82fa-4889-a8ba-cae29c8f5fbe tempest-AttachSCSIVolumeTestJSON-356336257 tempest-AttachSCSIVolumeTestJSON-356336257-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "568c1313-5e29-4849-a884-dab569a58a5f"}} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:07:46.439337 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-cd843f40-82fa-4889-a8ba-cae29c8f5fbe tempest-AttachSCSIVolumeTestJSON-356336257 tempest-AttachSCSIVolumeTestJSON-356336257-project] [instance: 8a378b79-bd92-4ade-b034-1aaf5c87b74b] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:07:46.456598 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-36afc62d-60e2-4159-b711-f0331f59f5bf tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1262518302" status: 202 len: 0 microversion: 2.1 time: 0.038456 Nov 01 19:07:46.460309 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1677/3281] 10.222.0.13 () {58 vars in 1221 bytes} [Tue Nov 1 19:07:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1262518302 => generated 0 bytes in 44 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 01 19:07:46.470892 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-cd843f40-82fa-4889-a8ba-cae29c8f5fbe tempest-AttachSCSIVolumeTestJSON-356336257 tempest-AttachSCSIVolumeTestJSON-356336257-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:46.474432 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-cd843f40-82fa-4889-a8ba-cae29c8f5fbe tempest-AttachSCSIVolumeTestJSON-356336257 tempest-AttachSCSIVolumeTestJSON-356336257-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:46.475673 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-c3dfc07e-64de-4896-8f76-2d7727f1b081 tempest-ServerMetadataNegativeTestJSON-414983834 tempest-ServerMetadataNegativeTestJSON-414983834-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:07:46.477328 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-c3dfc07e-64de-4896-8f76-2d7727f1b081 tempest-ServerMetadataNegativeTestJSON-414983834 tempest-ServerMetadataNegativeTestJSON-414983834-project] [instance: 6bb5dbff-cdc7-4986-8606-cec948c9d28c] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:07:46.478335 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-cd843f40-82fa-4889-a8ba-cae29c8f5fbe tempest-AttachSCSIVolumeTestJSON-356336257 tempest-AttachSCSIVolumeTestJSON-356336257-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:46.480001 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-cd843f40-82fa-4889-a8ba-cae29c8f5fbe tempest-AttachSCSIVolumeTestJSON-356336257 tempest-AttachSCSIVolumeTestJSON-356336257-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:46.499117 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-cd843f40-82fa-4889-a8ba-cae29c8f5fbe tempest-AttachSCSIVolumeTestJSON-356336257 tempest-AttachSCSIVolumeTestJSON-356336257-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:46.499954 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-cd843f40-82fa-4889-a8ba-cae29c8f5fbe tempest-AttachSCSIVolumeTestJSON-356336257 tempest-AttachSCSIVolumeTestJSON-356336257-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:46.642398 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-c3dfc07e-64de-4896-8f76-2d7727f1b081 tempest-ServerMetadataNegativeTestJSON-414983834 tempest-ServerMetadataNegativeTestJSON-414983834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aebd68d6b30e45debbfd99ee6360f905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd702a70dab124153b4f40d3219ffc5f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:07:46.658792 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-c3dfc07e-64de-4896-8f76-2d7727f1b081 tempest-ServerMetadataNegativeTestJSON-414983834 tempest-ServerMetadataNegativeTestJSON-414983834-project] 10.222.0.13 "GET /compute/v2.1/servers/6bb5dbff-cdc7-4986-8606-cec948c9d28c" status: 200 len: 1223 microversion: 2.1 time: 0.193866 Nov 01 19:07:46.660507 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1678/3282] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:07:46 2022] GET /compute/v2.1/servers/6bb5dbff-cdc7-4986-8606-cec948c9d28c => generated 1223 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:07:46.699079 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-a513aef3-e2cd-4785-9c9b-7bb48bb13358 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:07:46.701921 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-a513aef3-e2cd-4785-9c9b-7bb48bb13358 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] [instance: 8485db2a-fd8f-4615-bbe0-14822ad44194] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:07:46.721668 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-a513aef3-e2cd-4785-9c9b-7bb48bb13358 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:46.722765 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-a513aef3-e2cd-4785-9c9b-7bb48bb13358 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:46.723558 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-a513aef3-e2cd-4785-9c9b-7bb48bb13358 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:46.725718 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-a513aef3-e2cd-4785-9c9b-7bb48bb13358 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:46.727624 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-a513aef3-e2cd-4785-9c9b-7bb48bb13358 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:46.729030 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-a513aef3-e2cd-4785-9c9b-7bb48bb13358 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:47.052237 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-cd843f40-82fa-4889-a8ba-cae29c8f5fbe tempest-AttachSCSIVolumeTestJSON-356336257 tempest-AttachSCSIVolumeTestJSON-356336257-project] 10.222.0.13 "POST /compute/v2.1/servers/8a378b79-bd92-4ade-b034-1aaf5c87b74b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.621962 Nov 01 19:07:47.060382 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1605/3283] 10.222.0.13 () {60 vars in 1323 bytes} [Tue Nov 1 19:07:46 2022] POST /compute/v2.1/servers/8a378b79-bd92-4ade-b034-1aaf5c87b74b/os-volume_attachments => generated 194 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:07:47.087013 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-a8574dcd-aba8-4984-bf73-c13ef2423685 tempest-ImagesOneServerTestJSON-1044295602 tempest-ImagesOneServerTestJSON-1044295602-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:07:47.089264 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-a8574dcd-aba8-4984-bf73-c13ef2423685 tempest-ImagesOneServerTestJSON-1044295602 tempest-ImagesOneServerTestJSON-1044295602-project] [instance: 31f51cbd-b29a-46be-bca0-f27c2b287e15] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:07:47.101653 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-a8574dcd-aba8-4984-bf73-c13ef2423685 tempest-ImagesOneServerTestJSON-1044295602 tempest-ImagesOneServerTestJSON-1044295602-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:47.102609 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-a8574dcd-aba8-4984-bf73-c13ef2423685 tempest-ImagesOneServerTestJSON-1044295602 tempest-ImagesOneServerTestJSON-1044295602-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:47.103539 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-a8574dcd-aba8-4984-bf73-c13ef2423685 tempest-ImagesOneServerTestJSON-1044295602 tempest-ImagesOneServerTestJSON-1044295602-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:47.104786 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-a8574dcd-aba8-4984-bf73-c13ef2423685 tempest-ImagesOneServerTestJSON-1044295602 tempest-ImagesOneServerTestJSON-1044295602-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:47.106320 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-a8574dcd-aba8-4984-bf73-c13ef2423685 tempest-ImagesOneServerTestJSON-1044295602 tempest-ImagesOneServerTestJSON-1044295602-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:47.107001 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-a8574dcd-aba8-4984-bf73-c13ef2423685 tempest-ImagesOneServerTestJSON-1044295602 tempest-ImagesOneServerTestJSON-1044295602-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:47.389918 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-a513aef3-e2cd-4785-9c9b-7bb48bb13358 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '058480d92c9b4ab4af6815d0438a65c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee9dc49b89143f781e4ab30296e4d01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:07:47.416920 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-a513aef3-e2cd-4785-9c9b-7bb48bb13358 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] 10.222.0.13 "GET /compute/v2.1/servers/8485db2a-fd8f-4615-bbe0-14822ad44194" status: 200 len: 1315 microversion: 2.1 time: 0.735693 Nov 01 19:07:47.419137 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1679/3284] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:07:46 2022] GET /compute/v2.1/servers/8485db2a-fd8f-4615-bbe0-14822ad44194 => generated 1315 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:07:47.435096 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [req-318b455f-97eb-45e1-9e75-a99b3d2d4d86 req-0999e3fa-ec2a-41b7-843d-4eb091120e22 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8485db2a-fd8f-4615-bbe0-14822ad44194", "tag": "01274861-72a7-4685-9ca3-9bdd9e739056"}]} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:07:47.455877 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-318b455f-97eb-45e1-9e75-a99b3d2d4d86 req-0999e3fa-ec2a-41b7-843d-4eb091120e22 service nova] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:47.456892 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-318b455f-97eb-45e1-9e75-a99b3d2d4d86 req-0999e3fa-ec2a-41b7-843d-4eb091120e22 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:47.457686 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-318b455f-97eb-45e1-9e75-a99b3d2d4d86 req-0999e3fa-ec2a-41b7-843d-4eb091120e22 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:47.485447 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.compute.server_external_events [req-318b455f-97eb-45e1-9e75-a99b3d2d4d86 req-0999e3fa-ec2a-41b7-843d-4eb091120e22 service nova] Creating event network-changed:01274861-72a7-4685-9ca3-9bdd9e739056 for instance 8485db2a-fd8f-4615-bbe0-14822ad44194 on n-h2-863052-2 Nov 01 19:07:47.496019 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [req-318b455f-97eb-45e1-9e75-a99b3d2d4d86 req-0999e3fa-ec2a-41b7-843d-4eb091120e22 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073158 Nov 01 19:07:47.498922 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1680/3285] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Nov 1 19:07:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:07:47.519571 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [req-4f3510e2-707c-4f46-959d-dc8ed3e438d6 req-500d10b1-c635-4503-a38f-41c0d5a8964a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "31f51cbd-b29a-46be-bca0-f27c2b287e15", "tag": "bc5f2d73-99ce-47e7-bd41-afad82bb372e"}]} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:07:47.554898 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-4f3510e2-707c-4f46-959d-dc8ed3e438d6 req-500d10b1-c635-4503-a38f-41c0d5a8964a service nova] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:47.555374 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-4f3510e2-707c-4f46-959d-dc8ed3e438d6 req-500d10b1-c635-4503-a38f-41c0d5a8964a service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:47.557155 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-4f3510e2-707c-4f46-959d-dc8ed3e438d6 req-500d10b1-c635-4503-a38f-41c0d5a8964a service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:47.577267 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.compute.server_external_events [req-4f3510e2-707c-4f46-959d-dc8ed3e438d6 req-500d10b1-c635-4503-a38f-41c0d5a8964a service nova] Creating event network-changed:bc5f2d73-99ce-47e7-bd41-afad82bb372e for instance 31f51cbd-b29a-46be-bca0-f27c2b287e15 on n-h2-863052-2 Nov 01 19:07:47.585663 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [req-4f3510e2-707c-4f46-959d-dc8ed3e438d6 req-500d10b1-c635-4503-a38f-41c0d5a8964a service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084810 Nov 01 19:07:47.586923 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1681/3286] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Nov 1 19:07:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:07:47.596309 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-e567c088-42d7-469a-8c9a-01c611848a91 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:07:47.597383 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-e567c088-42d7-469a-8c9a-01c611848a91 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] [instance: f6fc44ea-8b27-4807-98b4-8b4b837a7ec3] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:07:47.608033 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-e567c088-42d7-469a-8c9a-01c611848a91 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:47.608920 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-e567c088-42d7-469a-8c9a-01c611848a91 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:47.609528 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-e567c088-42d7-469a-8c9a-01c611848a91 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:47.611163 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-e567c088-42d7-469a-8c9a-01c611848a91 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:47.613674 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-e567c088-42d7-469a-8c9a-01c611848a91 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:47.614373 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-e567c088-42d7-469a-8c9a-01c611848a91 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:47.633913 n-d-863052-2 devstack@n-api.service[121403]: DEBUG dbcounter [-] [121403] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 19:07:47.901181 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-a8574dcd-aba8-4984-bf73-c13ef2423685 tempest-ImagesOneServerTestJSON-1044295602 tempest-ImagesOneServerTestJSON-1044295602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6fd718964648e4bc83ed37cbaa9b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c548420d1df4403c9129cce5f040d45b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:07:47.916973 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-a8574dcd-aba8-4984-bf73-c13ef2423685 tempest-ImagesOneServerTestJSON-1044295602 tempest-ImagesOneServerTestJSON-1044295602-project] 10.222.0.13 "GET /compute/v2.1/servers/31f51cbd-b29a-46be-bca0-f27c2b287e15" status: 200 len: 1316 microversion: 2.1 time: 0.847489 Nov 01 19:07:47.923471 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1606/3287] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:07:47 2022] GET /compute/v2.1/servers/31f51cbd-b29a-46be-bca0-f27c2b287e15 => generated 1316 bytes in 862 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:07:47.930758 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-bc2ba299-b4b8-4319-914d-31bb3b11336c tempest-ServerMetadataNegativeTestJSON-414983834 tempest-ServerMetadataNegativeTestJSON-414983834-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:07:47.935358 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-bc2ba299-b4b8-4319-914d-31bb3b11336c tempest-ServerMetadataNegativeTestJSON-414983834 tempest-ServerMetadataNegativeTestJSON-414983834-project] [instance: 6bb5dbff-cdc7-4986-8606-cec948c9d28c] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:07:47.951412 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-bc2ba299-b4b8-4319-914d-31bb3b11336c tempest-ServerMetadataNegativeTestJSON-414983834 tempest-ServerMetadataNegativeTestJSON-414983834-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:47.953557 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-bc2ba299-b4b8-4319-914d-31bb3b11336c tempest-ServerMetadataNegativeTestJSON-414983834 tempest-ServerMetadataNegativeTestJSON-414983834-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:47.956754 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-bc2ba299-b4b8-4319-914d-31bb3b11336c tempest-ServerMetadataNegativeTestJSON-414983834 tempest-ServerMetadataNegativeTestJSON-414983834-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:47.959731 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-bc2ba299-b4b8-4319-914d-31bb3b11336c tempest-ServerMetadataNegativeTestJSON-414983834 tempest-ServerMetadataNegativeTestJSON-414983834-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:47.960876 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-bc2ba299-b4b8-4319-914d-31bb3b11336c tempest-ServerMetadataNegativeTestJSON-414983834 tempest-ServerMetadataNegativeTestJSON-414983834-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:47.963052 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-bc2ba299-b4b8-4319-914d-31bb3b11336c tempest-ServerMetadataNegativeTestJSON-414983834 tempest-ServerMetadataNegativeTestJSON-414983834-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:48.170765 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-bc2ba299-b4b8-4319-914d-31bb3b11336c tempest-ServerMetadataNegativeTestJSON-414983834 tempest-ServerMetadataNegativeTestJSON-414983834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aebd68d6b30e45debbfd99ee6360f905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd702a70dab124153b4f40d3219ffc5f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:07:48.195082 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-bc2ba299-b4b8-4319-914d-31bb3b11336c tempest-ServerMetadataNegativeTestJSON-414983834 tempest-ServerMetadataNegativeTestJSON-414983834-project] 10.222.0.13 "GET /compute/v2.1/servers/6bb5dbff-cdc7-4986-8606-cec948c9d28c" status: 200 len: 1275 microversion: 2.1 time: 0.269956 Nov 01 19:07:48.218188 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1607/3288] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:07:47 2022] GET /compute/v2.1/servers/6bb5dbff-cdc7-4986-8606-cec948c9d28c => generated 1275 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:07:48.410849 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-e567c088-42d7-469a-8c9a-01c611848a91 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113bd8c844ee490b86a68bc7e1e75da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '851785a5f76548898a77d67792888504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:07:48.423578 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-e567c088-42d7-469a-8c9a-01c611848a91 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] 10.222.0.13 "GET /compute/v2.1/servers/f6fc44ea-8b27-4807-98b4-8b4b837a7ec3" status: 200 len: 1328 microversion: 2.1 time: 0.834850 Nov 01 19:07:48.424506 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1682/3289] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:07:47 2022] GET /compute/v2.1/servers/f6fc44ea-8b27-4807-98b4-8b4b837a7ec3 => generated 1328 bytes in 837 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:07:48.442275 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-dbfea70e-8704-47b2-b95e-4d518dc0851f tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:07:48.442892 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-dbfea70e-8704-47b2-b95e-4d518dc0851f tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] [instance: 8485db2a-fd8f-4615-bbe0-14822ad44194] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:07:48.461128 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-dbfea70e-8704-47b2-b95e-4d518dc0851f tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:48.461890 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-dbfea70e-8704-47b2-b95e-4d518dc0851f tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:48.462561 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-dbfea70e-8704-47b2-b95e-4d518dc0851f tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:48.463360 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-dbfea70e-8704-47b2-b95e-4d518dc0851f tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:48.464306 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-dbfea70e-8704-47b2-b95e-4d518dc0851f tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:48.465021 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-dbfea70e-8704-47b2-b95e-4d518dc0851f tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:48.810697 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-e6d3c1dd-9d5a-46a1-97d3-f8417ec3f873 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:07:48.811205 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-e6d3c1dd-9d5a-46a1-97d3-f8417ec3f873 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] [instance: 3029f3c1-4f32-4f6b-963c-16f65b6dff3c] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:07:48.819167 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-e6d3c1dd-9d5a-46a1-97d3-f8417ec3f873 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:48.819591 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-e6d3c1dd-9d5a-46a1-97d3-f8417ec3f873 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:48.820030 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-e6d3c1dd-9d5a-46a1-97d3-f8417ec3f873 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:48.820788 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-e6d3c1dd-9d5a-46a1-97d3-f8417ec3f873 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:48.821265 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-e6d3c1dd-9d5a-46a1-97d3-f8417ec3f873 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:48.821720 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-e6d3c1dd-9d5a-46a1-97d3-f8417ec3f873 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:48.878629 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-dbfea70e-8704-47b2-b95e-4d518dc0851f tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '058480d92c9b4ab4af6815d0438a65c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee9dc49b89143f781e4ab30296e4d01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:07:48.884741 n-d-863052-2 devstack@n-api.service[121402]: DEBUG dbcounter [-] [121402] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 19:07:48.891159 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-dbfea70e-8704-47b2-b95e-4d518dc0851f tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] 10.222.0.13 "GET /compute/v2.1/servers/8485db2a-fd8f-4615-bbe0-14822ad44194" status: 200 len: 1315 microversion: 2.1 time: 0.452967 Nov 01 19:07:48.892547 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1608/3290] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:07:48 2022] GET /compute/v2.1/servers/8485db2a-fd8f-4615-bbe0-14822ad44194 => generated 1315 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:07:48.933651 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.objects.instance [None req-e6d3c1dd-9d5a-46a1-97d3-f8417ec3f873 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lazy-loading 'services' on Instance uuid 3029f3c1-4f32-4f6b-963c-16f65b6dff3c {{(pid=121403) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 01 19:07:48.954031 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-f1a98290-9c30-4551-82c5-1259a50e2100 tempest-ImagesOneServerTestJSON-1044295602 tempest-ImagesOneServerTestJSON-1044295602-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:07:48.954654 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-f1a98290-9c30-4551-82c5-1259a50e2100 tempest-ImagesOneServerTestJSON-1044295602 tempest-ImagesOneServerTestJSON-1044295602-project] [instance: 31f51cbd-b29a-46be-bca0-f27c2b287e15] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:07:48.964016 n-d-863052-2 devstack@n-api.service[121402]: DEBUG dbcounter [-] [121402] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=121402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 19:07:48.965733 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f1a98290-9c30-4551-82c5-1259a50e2100 tempest-ImagesOneServerTestJSON-1044295602 tempest-ImagesOneServerTestJSON-1044295602-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:48.966376 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f1a98290-9c30-4551-82c5-1259a50e2100 tempest-ImagesOneServerTestJSON-1044295602 tempest-ImagesOneServerTestJSON-1044295602-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:48.966857 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f1a98290-9c30-4551-82c5-1259a50e2100 tempest-ImagesOneServerTestJSON-1044295602 tempest-ImagesOneServerTestJSON-1044295602-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:48.967521 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f1a98290-9c30-4551-82c5-1259a50e2100 tempest-ImagesOneServerTestJSON-1044295602 tempest-ImagesOneServerTestJSON-1044295602-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:48.967977 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f1a98290-9c30-4551-82c5-1259a50e2100 tempest-ImagesOneServerTestJSON-1044295602 tempest-ImagesOneServerTestJSON-1044295602-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:48.968396 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f1a98290-9c30-4551-82c5-1259a50e2100 tempest-ImagesOneServerTestJSON-1044295602 tempest-ImagesOneServerTestJSON-1044295602-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:49.035435 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-e6d3c1dd-9d5a-46a1-97d3-f8417ec3f873 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] 10.222.0.13 "DELETE /compute/v2.1/servers/3029f3c1-4f32-4f6b-963c-16f65b6dff3c/os-volume_attachments/570e6f6f-08f1-4533-80b2-d91dfc64c54a" status: 202 len: 0 microversion: 2.1 time: 0.229125 Nov 01 19:07:49.036851 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1683/3291] 10.222.0.13 () {58 vars in 1416 bytes} [Tue Nov 1 19:07:48 2022] DELETE /compute/v2.1/servers/3029f3c1-4f32-4f6b-963c-16f65b6dff3c/os-volume_attachments/570e6f6f-08f1-4533-80b2-d91dfc64c54a => generated 0 bytes in 232 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 01 19:07:49.048810 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-87744763-d3ff-44d8-a5d6-2bce92ad8952 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:07:49.053058 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-87744763-d3ff-44d8-a5d6-2bce92ad8952 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] [instance: 3029f3c1-4f32-4f6b-963c-16f65b6dff3c] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:07:49.064039 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-87744763-d3ff-44d8-a5d6-2bce92ad8952 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:49.066258 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-87744763-d3ff-44d8-a5d6-2bce92ad8952 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:49.066919 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-87744763-d3ff-44d8-a5d6-2bce92ad8952 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:49.070447 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-87744763-d3ff-44d8-a5d6-2bce92ad8952 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:49.071077 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-87744763-d3ff-44d8-a5d6-2bce92ad8952 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:49.071626 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-87744763-d3ff-44d8-a5d6-2bce92ad8952 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:49.130776 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-87744763-d3ff-44d8-a5d6-2bce92ad8952 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] 10.222.0.13 "GET /compute/v2.1/servers/3029f3c1-4f32-4f6b-963c-16f65b6dff3c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.088534 Nov 01 19:07:49.132486 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1684/3292] 10.222.0.13 () {58 vars in 1302 bytes} [Tue Nov 1 19:07:49 2022] GET /compute/v2.1/servers/3029f3c1-4f32-4f6b-963c-16f65b6dff3c/os-volume_attachments => generated 197 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 01 19:07:49.224017 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-295bae21-bfe6-4144-a28d-d6fff6440769 tempest-ServerMetadataNegativeTestJSON-414983834 tempest-ServerMetadataNegativeTestJSON-414983834-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:07:49.225070 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-295bae21-bfe6-4144-a28d-d6fff6440769 tempest-ServerMetadataNegativeTestJSON-414983834 tempest-ServerMetadataNegativeTestJSON-414983834-project] [instance: 6bb5dbff-cdc7-4986-8606-cec948c9d28c] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:07:49.237547 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-295bae21-bfe6-4144-a28d-d6fff6440769 tempest-ServerMetadataNegativeTestJSON-414983834 tempest-ServerMetadataNegativeTestJSON-414983834-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:49.240181 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-295bae21-bfe6-4144-a28d-d6fff6440769 tempest-ServerMetadataNegativeTestJSON-414983834 tempest-ServerMetadataNegativeTestJSON-414983834-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:49.242489 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-295bae21-bfe6-4144-a28d-d6fff6440769 tempest-ServerMetadataNegativeTestJSON-414983834 tempest-ServerMetadataNegativeTestJSON-414983834-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:49.244106 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-295bae21-bfe6-4144-a28d-d6fff6440769 tempest-ServerMetadataNegativeTestJSON-414983834 tempest-ServerMetadataNegativeTestJSON-414983834-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:49.245367 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-295bae21-bfe6-4144-a28d-d6fff6440769 tempest-ServerMetadataNegativeTestJSON-414983834 tempest-ServerMetadataNegativeTestJSON-414983834-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:49.245899 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-295bae21-bfe6-4144-a28d-d6fff6440769 tempest-ServerMetadataNegativeTestJSON-414983834 tempest-ServerMetadataNegativeTestJSON-414983834-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:49.257734 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-f1a98290-9c30-4551-82c5-1259a50e2100 tempest-ImagesOneServerTestJSON-1044295602 tempest-ImagesOneServerTestJSON-1044295602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6fd718964648e4bc83ed37cbaa9b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c548420d1df4403c9129cce5f040d45b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:07:49.272250 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-f1a98290-9c30-4551-82c5-1259a50e2100 tempest-ImagesOneServerTestJSON-1044295602 tempest-ImagesOneServerTestJSON-1044295602-project] 10.222.0.13 "GET /compute/v2.1/servers/31f51cbd-b29a-46be-bca0-f27c2b287e15" status: 200 len: 1316 microversion: 2.1 time: 0.322828 Nov 01 19:07:49.281607 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1609/3293] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:07:48 2022] GET /compute/v2.1/servers/31f51cbd-b29a-46be-bca0-f27c2b287e15 => generated 1316 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 19:07:49.357558 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-295bae21-bfe6-4144-a28d-d6fff6440769 tempest-ServerMetadataNegativeTestJSON-414983834 tempest-ServerMetadataNegativeTestJSON-414983834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aebd68d6b30e45debbfd99ee6360f905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd702a70dab124153b4f40d3219ffc5f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:07:49.375130 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-295bae21-bfe6-4144-a28d-d6fff6440769 tempest-ServerMetadataNegativeTestJSON-414983834 tempest-ServerMetadataNegativeTestJSON-414983834-project] 10.222.0.13 "GET /compute/v2.1/servers/6bb5dbff-cdc7-4986-8606-cec948c9d28c" status: 200 len: 1281 microversion: 2.1 time: 0.155720 Nov 01 19:07:49.381110 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1685/3294] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:07:49 2022] GET /compute/v2.1/servers/6bb5dbff-cdc7-4986-8606-cec948c9d28c => generated 1281 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 19:07:49.455619 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-5d3196a3-48f9-498f-8f8c-c677a31ed384 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:07:49.456459 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-5d3196a3-48f9-498f-8f8c-c677a31ed384 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] [instance: f6fc44ea-8b27-4807-98b4-8b4b837a7ec3] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:07:49.468280 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-5d3196a3-48f9-498f-8f8c-c677a31ed384 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:49.469574 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-5d3196a3-48f9-498f-8f8c-c677a31ed384 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:49.470294 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-5d3196a3-48f9-498f-8f8c-c677a31ed384 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:49.471298 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-5d3196a3-48f9-498f-8f8c-c677a31ed384 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:49.472000 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-5d3196a3-48f9-498f-8f8c-c677a31ed384 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:49.472797 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-5d3196a3-48f9-498f-8f8c-c677a31ed384 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:49.740544 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [req-fb28ff14-34ff-47e5-bd90-3b11b1bfdbaa req-f313a89b-bfff-4df0-b6f9-a0302e29dfc7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f6fc44ea-8b27-4807-98b4-8b4b837a7ec3", "name": "network-vif-plugged", "status": "completed", "tag": "d8acb2d9-1cce-4aec-b4f5-cb000b4af23d"}]} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:07:49.760389 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-fb28ff14-34ff-47e5-bd90-3b11b1bfdbaa req-f313a89b-bfff-4df0-b6f9-a0302e29dfc7 service nova] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:49.761217 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-fb28ff14-34ff-47e5-bd90-3b11b1bfdbaa req-f313a89b-bfff-4df0-b6f9-a0302e29dfc7 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:49.762122 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-fb28ff14-34ff-47e5-bd90-3b11b1bfdbaa req-f313a89b-bfff-4df0-b6f9-a0302e29dfc7 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:49.782847 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.compute.server_external_events [req-fb28ff14-34ff-47e5-bd90-3b11b1bfdbaa req-f313a89b-bfff-4df0-b6f9-a0302e29dfc7 service nova] Creating event network-vif-plugged:d8acb2d9-1cce-4aec-b4f5-cb000b4af23d for instance f6fc44ea-8b27-4807-98b4-8b4b837a7ec3 on n-h1-863052-2 Nov 01 19:07:49.790353 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [req-fb28ff14-34ff-47e5-bd90-3b11b1bfdbaa req-f313a89b-bfff-4df0-b6f9-a0302e29dfc7 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053673 Nov 01 19:07:49.791980 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1686/3295] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Nov 1 19:07:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 01 19:07:49.883134 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-5d3196a3-48f9-498f-8f8c-c677a31ed384 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113bd8c844ee490b86a68bc7e1e75da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '851785a5f76548898a77d67792888504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:07:49.895684 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-5d3196a3-48f9-498f-8f8c-c677a31ed384 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] 10.222.0.13 "GET /compute/v2.1/servers/f6fc44ea-8b27-4807-98b4-8b4b837a7ec3" status: 200 len: 1328 microversion: 2.1 time: 0.447627 Nov 01 19:07:49.897931 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1610/3296] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:07:49 2022] GET /compute/v2.1/servers/f6fc44ea-8b27-4807-98b4-8b4b837a7ec3 => generated 1328 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:07:49.917539 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-d64efcc5-ddc6-478a-8365-d37071377c7d tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:07:49.918343 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-d64efcc5-ddc6-478a-8365-d37071377c7d tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] [instance: 8485db2a-fd8f-4615-bbe0-14822ad44194] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:07:49.925884 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d64efcc5-ddc6-478a-8365-d37071377c7d tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:49.926819 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d64efcc5-ddc6-478a-8365-d37071377c7d tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:49.927653 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d64efcc5-ddc6-478a-8365-d37071377c7d tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:49.928609 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d64efcc5-ddc6-478a-8365-d37071377c7d tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:49.929281 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d64efcc5-ddc6-478a-8365-d37071377c7d tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:49.929915 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d64efcc5-ddc6-478a-8365-d37071377c7d tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:50.127200 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-d64efcc5-ddc6-478a-8365-d37071377c7d tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '058480d92c9b4ab4af6815d0438a65c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee9dc49b89143f781e4ab30296e4d01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:07:50.136863 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-d64efcc5-ddc6-478a-8365-d37071377c7d tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] 10.222.0.13 "GET /compute/v2.1/servers/8485db2a-fd8f-4615-bbe0-14822ad44194" status: 200 len: 1315 microversion: 2.1 time: 0.224938 Nov 01 19:07:50.144920 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-455f3dbd-db24-413a-970f-67664a044c9a tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:07:50.147554 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-455f3dbd-db24-413a-970f-67664a044c9a tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] [instance: 3029f3c1-4f32-4f6b-963c-16f65b6dff3c] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:07:50.158548 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1687/3297] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:07:49 2022] GET /compute/v2.1/servers/8485db2a-fd8f-4615-bbe0-14822ad44194 => generated 1315 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:07:50.159905 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-455f3dbd-db24-413a-970f-67664a044c9a tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:50.160412 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-455f3dbd-db24-413a-970f-67664a044c9a tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:50.161356 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-455f3dbd-db24-413a-970f-67664a044c9a tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:50.162029 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-455f3dbd-db24-413a-970f-67664a044c9a tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:50.162493 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-455f3dbd-db24-413a-970f-67664a044c9a tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:50.163077 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-455f3dbd-db24-413a-970f-67664a044c9a tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:50.197232 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-455f3dbd-db24-413a-970f-67664a044c9a tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] 10.222.0.13 "GET /compute/v2.1/servers/3029f3c1-4f32-4f6b-963c-16f65b6dff3c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057316 Nov 01 19:07:50.198457 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1611/3298] 10.222.0.13 () {58 vars in 1302 bytes} [Tue Nov 1 19:07:50 2022] GET /compute/v2.1/servers/3029f3c1-4f32-4f6b-963c-16f65b6dff3c/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 01 19:07:50.300749 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-5b406a7f-a7b6-4642-9b60-a5b11e5e6c80 tempest-ImagesOneServerTestJSON-1044295602 tempest-ImagesOneServerTestJSON-1044295602-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:07:50.301543 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-5b406a7f-a7b6-4642-9b60-a5b11e5e6c80 tempest-ImagesOneServerTestJSON-1044295602 tempest-ImagesOneServerTestJSON-1044295602-project] [instance: 31f51cbd-b29a-46be-bca0-f27c2b287e15] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:07:50.312854 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-5b406a7f-a7b6-4642-9b60-a5b11e5e6c80 tempest-ImagesOneServerTestJSON-1044295602 tempest-ImagesOneServerTestJSON-1044295602-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:50.313500 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-5b406a7f-a7b6-4642-9b60-a5b11e5e6c80 tempest-ImagesOneServerTestJSON-1044295602 tempest-ImagesOneServerTestJSON-1044295602-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:50.314069 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-5b406a7f-a7b6-4642-9b60-a5b11e5e6c80 tempest-ImagesOneServerTestJSON-1044295602 tempest-ImagesOneServerTestJSON-1044295602-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:50.314881 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-5b406a7f-a7b6-4642-9b60-a5b11e5e6c80 tempest-ImagesOneServerTestJSON-1044295602 tempest-ImagesOneServerTestJSON-1044295602-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:50.319676 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-5b406a7f-a7b6-4642-9b60-a5b11e5e6c80 tempest-ImagesOneServerTestJSON-1044295602 tempest-ImagesOneServerTestJSON-1044295602-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:50.320364 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-5b406a7f-a7b6-4642-9b60-a5b11e5e6c80 tempest-ImagesOneServerTestJSON-1044295602 tempest-ImagesOneServerTestJSON-1044295602-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:50.404803 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-305046bd-630a-424a-a691-f9b3346e5e1c tempest-ServerMetadataNegativeTestJSON-414983834 tempest-ServerMetadataNegativeTestJSON-414983834-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:07:50.405338 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-305046bd-630a-424a-a691-f9b3346e5e1c tempest-ServerMetadataNegativeTestJSON-414983834 tempest-ServerMetadataNegativeTestJSON-414983834-project] [instance: 6bb5dbff-cdc7-4986-8606-cec948c9d28c] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:07:50.412046 n-d-863052-2 devstack@n-api.service[121402]: DEBUG dbcounter [-] [121402] Writing DB stats nova_cell0:SELECT=2 {{(pid=121402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 19:07:50.414148 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-305046bd-630a-424a-a691-f9b3346e5e1c tempest-ServerMetadataNegativeTestJSON-414983834 tempest-ServerMetadataNegativeTestJSON-414983834-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:50.414646 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-305046bd-630a-424a-a691-f9b3346e5e1c tempest-ServerMetadataNegativeTestJSON-414983834 tempest-ServerMetadataNegativeTestJSON-414983834-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:50.415096 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-305046bd-630a-424a-a691-f9b3346e5e1c tempest-ServerMetadataNegativeTestJSON-414983834 tempest-ServerMetadataNegativeTestJSON-414983834-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:50.416488 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-305046bd-630a-424a-a691-f9b3346e5e1c tempest-ServerMetadataNegativeTestJSON-414983834 tempest-ServerMetadataNegativeTestJSON-414983834-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:50.417217 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-305046bd-630a-424a-a691-f9b3346e5e1c tempest-ServerMetadataNegativeTestJSON-414983834 tempest-ServerMetadataNegativeTestJSON-414983834-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:50.417735 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-305046bd-630a-424a-a691-f9b3346e5e1c tempest-ServerMetadataNegativeTestJSON-414983834 tempest-ServerMetadataNegativeTestJSON-414983834-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:50.437620 n-d-863052-2 devstack@n-api.service[121402]: DEBUG dbcounter [-] [121402] Writing DB stats nova_cell0:SELECT=12 {{(pid=121402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 19:07:50.492459 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-5b406a7f-a7b6-4642-9b60-a5b11e5e6c80 tempest-ImagesOneServerTestJSON-1044295602 tempest-ImagesOneServerTestJSON-1044295602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6fd718964648e4bc83ed37cbaa9b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c548420d1df4403c9129cce5f040d45b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:07:50.500776 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-5b406a7f-a7b6-4642-9b60-a5b11e5e6c80 tempest-ImagesOneServerTestJSON-1044295602 tempest-ImagesOneServerTestJSON-1044295602-project] 10.222.0.13 "GET /compute/v2.1/servers/31f51cbd-b29a-46be-bca0-f27c2b287e15" status: 200 len: 1316 microversion: 2.1 time: 0.204054 Nov 01 19:07:50.501354 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1688/3299] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:07:50 2022] GET /compute/v2.1/servers/31f51cbd-b29a-46be-bca0-f27c2b287e15 => generated 1316 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:07:50.652633 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-305046bd-630a-424a-a691-f9b3346e5e1c tempest-ServerMetadataNegativeTestJSON-414983834 tempest-ServerMetadataNegativeTestJSON-414983834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aebd68d6b30e45debbfd99ee6360f905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd702a70dab124153b4f40d3219ffc5f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:07:50.661354 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-305046bd-630a-424a-a691-f9b3346e5e1c tempest-ServerMetadataNegativeTestJSON-414983834 tempest-ServerMetadataNegativeTestJSON-414983834-project] 10.222.0.13 "GET /compute/v2.1/servers/6bb5dbff-cdc7-4986-8606-cec948c9d28c" status: 200 len: 1323 microversion: 2.1 time: 0.263041 Nov 01 19:07:50.662006 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1612/3300] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:07:50 2022] GET /compute/v2.1/servers/6bb5dbff-cdc7-4986-8606-cec948c9d28c => generated 1323 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:07:50.920230 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-cc1d4f01-f206-4137-8910-3af82056543e tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:07:50.921590 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-cc1d4f01-f206-4137-8910-3af82056543e tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] [instance: f6fc44ea-8b27-4807-98b4-8b4b837a7ec3] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:07:50.930422 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-cc1d4f01-f206-4137-8910-3af82056543e tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:50.931034 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-cc1d4f01-f206-4137-8910-3af82056543e tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:50.931635 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-cc1d4f01-f206-4137-8910-3af82056543e tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:50.932732 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-cc1d4f01-f206-4137-8910-3af82056543e tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:50.933550 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-cc1d4f01-f206-4137-8910-3af82056543e tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:50.934677 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-cc1d4f01-f206-4137-8910-3af82056543e tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:51.161317 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-9496e5c6-3123-44a1-8429-db7f701f384a tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:07:51.162194 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-9496e5c6-3123-44a1-8429-db7f701f384a tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] [instance: 8485db2a-fd8f-4615-bbe0-14822ad44194] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:07:51.169411 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-9496e5c6-3123-44a1-8429-db7f701f384a tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:51.170387 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-9496e5c6-3123-44a1-8429-db7f701f384a tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:51.171358 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-9496e5c6-3123-44a1-8429-db7f701f384a tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:51.172250 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-9496e5c6-3123-44a1-8429-db7f701f384a tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:51.172938 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-9496e5c6-3123-44a1-8429-db7f701f384a tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:51.173328 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-cc1d4f01-f206-4137-8910-3af82056543e tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113bd8c844ee490b86a68bc7e1e75da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '851785a5f76548898a77d67792888504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:07:51.174014 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-9496e5c6-3123-44a1-8429-db7f701f384a tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:51.185944 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-cc1d4f01-f206-4137-8910-3af82056543e tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] 10.222.0.13 "GET /compute/v2.1/servers/f6fc44ea-8b27-4807-98b4-8b4b837a7ec3" status: 200 len: 1328 microversion: 2.1 time: 0.270283 Nov 01 19:07:51.205990 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1689/3301] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:07:50 2022] GET /compute/v2.1/servers/f6fc44ea-8b27-4807-98b4-8b4b837a7ec3 => generated 1328 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:07:51.212446 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-3213c205-48b6-4a10-a94e-80e7cc3fef33 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:07:51.216479 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-3213c205-48b6-4a10-a94e-80e7cc3fef33 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] [instance: 3029f3c1-4f32-4f6b-963c-16f65b6dff3c] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:07:51.227835 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-3213c205-48b6-4a10-a94e-80e7cc3fef33 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:51.229670 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-3213c205-48b6-4a10-a94e-80e7cc3fef33 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:51.231848 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-3213c205-48b6-4a10-a94e-80e7cc3fef33 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:51.232869 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-3213c205-48b6-4a10-a94e-80e7cc3fef33 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:51.235250 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-3213c205-48b6-4a10-a94e-80e7cc3fef33 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:51.236456 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-3213c205-48b6-4a10-a94e-80e7cc3fef33 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:51.312312 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-3213c205-48b6-4a10-a94e-80e7cc3fef33 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] 10.222.0.13 "GET /compute/v2.1/servers/3029f3c1-4f32-4f6b-963c-16f65b6dff3c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.106203 Nov 01 19:07:51.317704 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1690/3302] 10.222.0.13 () {58 vars in 1302 bytes} [Tue Nov 1 19:07:51 2022] GET /compute/v2.1/servers/3029f3c1-4f32-4f6b-963c-16f65b6dff3c/os-volume_attachments => generated 197 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:07:51.480361 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-9496e5c6-3123-44a1-8429-db7f701f384a tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '058480d92c9b4ab4af6815d0438a65c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee9dc49b89143f781e4ab30296e4d01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:07:51.493135 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-9496e5c6-3123-44a1-8429-db7f701f384a tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] 10.222.0.13 "GET /compute/v2.1/servers/8485db2a-fd8f-4615-bbe0-14822ad44194" status: 200 len: 1315 microversion: 2.1 time: 0.334491 Nov 01 19:07:51.494983 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1613/3303] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:07:51 2022] GET /compute/v2.1/servers/8485db2a-fd8f-4615-bbe0-14822ad44194 => generated 1315 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:07:51.529347 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-f813c19c-20a9-425b-8e7b-01a808915ef7 tempest-ImagesOneServerTestJSON-1044295602 tempest-ImagesOneServerTestJSON-1044295602-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:07:51.530231 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-f813c19c-20a9-425b-8e7b-01a808915ef7 tempest-ImagesOneServerTestJSON-1044295602 tempest-ImagesOneServerTestJSON-1044295602-project] [instance: 31f51cbd-b29a-46be-bca0-f27c2b287e15] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:07:51.538995 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f813c19c-20a9-425b-8e7b-01a808915ef7 tempest-ImagesOneServerTestJSON-1044295602 tempest-ImagesOneServerTestJSON-1044295602-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:51.541511 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f813c19c-20a9-425b-8e7b-01a808915ef7 tempest-ImagesOneServerTestJSON-1044295602 tempest-ImagesOneServerTestJSON-1044295602-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:51.542114 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f813c19c-20a9-425b-8e7b-01a808915ef7 tempest-ImagesOneServerTestJSON-1044295602 tempest-ImagesOneServerTestJSON-1044295602-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:51.543982 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f813c19c-20a9-425b-8e7b-01a808915ef7 tempest-ImagesOneServerTestJSON-1044295602 tempest-ImagesOneServerTestJSON-1044295602-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:51.544827 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f813c19c-20a9-425b-8e7b-01a808915ef7 tempest-ImagesOneServerTestJSON-1044295602 tempest-ImagesOneServerTestJSON-1044295602-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:51.545591 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f813c19c-20a9-425b-8e7b-01a808915ef7 tempest-ImagesOneServerTestJSON-1044295602 tempest-ImagesOneServerTestJSON-1044295602-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:51.603873 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [req-869771e5-a0ed-490c-a271-6c4007e3d5eb req-feb17c7c-53c5-437c-8128-c5b0b2478dff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6bb5dbff-cdc7-4986-8606-cec948c9d28c", "tag": "253432d3-6714-43d0-8c66-5ccffded0825"}]} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:07:51.629501 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-869771e5-a0ed-490c-a271-6c4007e3d5eb req-feb17c7c-53c5-437c-8128-c5b0b2478dff service nova] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:51.630677 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-869771e5-a0ed-490c-a271-6c4007e3d5eb req-feb17c7c-53c5-437c-8128-c5b0b2478dff service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:51.631178 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-869771e5-a0ed-490c-a271-6c4007e3d5eb req-feb17c7c-53c5-437c-8128-c5b0b2478dff service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:51.647803 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.compute.server_external_events [req-869771e5-a0ed-490c-a271-6c4007e3d5eb req-feb17c7c-53c5-437c-8128-c5b0b2478dff service nova] Creating event network-changed:253432d3-6714-43d0-8c66-5ccffded0825 for instance 6bb5dbff-cdc7-4986-8606-cec948c9d28c on n-h1-863052-2 Nov 01 19:07:51.658629 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [req-869771e5-a0ed-490c-a271-6c4007e3d5eb req-feb17c7c-53c5-437c-8128-c5b0b2478dff service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059108 Nov 01 19:07:51.659731 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1614/3304] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Nov 1 19:07:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:07:51.686964 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-f4f6f2f4-175f-4fda-b5c0-14f36bdb1c3a tempest-ServerMetadataNegativeTestJSON-414983834 tempest-ServerMetadataNegativeTestJSON-414983834-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:07:51.687888 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-f4f6f2f4-175f-4fda-b5c0-14f36bdb1c3a tempest-ServerMetadataNegativeTestJSON-414983834 tempest-ServerMetadataNegativeTestJSON-414983834-project] [instance: 6bb5dbff-cdc7-4986-8606-cec948c9d28c] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:07:51.706062 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f4f6f2f4-175f-4fda-b5c0-14f36bdb1c3a tempest-ServerMetadataNegativeTestJSON-414983834 tempest-ServerMetadataNegativeTestJSON-414983834-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:51.707166 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f4f6f2f4-175f-4fda-b5c0-14f36bdb1c3a tempest-ServerMetadataNegativeTestJSON-414983834 tempest-ServerMetadataNegativeTestJSON-414983834-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:51.708497 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f4f6f2f4-175f-4fda-b5c0-14f36bdb1c3a tempest-ServerMetadataNegativeTestJSON-414983834 tempest-ServerMetadataNegativeTestJSON-414983834-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:51.714564 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f4f6f2f4-175f-4fda-b5c0-14f36bdb1c3a tempest-ServerMetadataNegativeTestJSON-414983834 tempest-ServerMetadataNegativeTestJSON-414983834-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:51.715394 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f4f6f2f4-175f-4fda-b5c0-14f36bdb1c3a tempest-ServerMetadataNegativeTestJSON-414983834 tempest-ServerMetadataNegativeTestJSON-414983834-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:51.715935 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f4f6f2f4-175f-4fda-b5c0-14f36bdb1c3a tempest-ServerMetadataNegativeTestJSON-414983834 tempest-ServerMetadataNegativeTestJSON-414983834-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:51.823823 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-f813c19c-20a9-425b-8e7b-01a808915ef7 tempest-ImagesOneServerTestJSON-1044295602 tempest-ImagesOneServerTestJSON-1044295602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6fd718964648e4bc83ed37cbaa9b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c548420d1df4403c9129cce5f040d45b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:07:51.831547 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-f813c19c-20a9-425b-8e7b-01a808915ef7 tempest-ImagesOneServerTestJSON-1044295602 tempest-ImagesOneServerTestJSON-1044295602-project] 10.222.0.13 "GET /compute/v2.1/servers/31f51cbd-b29a-46be-bca0-f27c2b287e15" status: 200 len: 1316 microversion: 2.1 time: 0.310622 Nov 01 19:07:51.832132 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1691/3305] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:07:51 2022] GET /compute/v2.1/servers/31f51cbd-b29a-46be-bca0-f27c2b287e15 => generated 1316 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:07:51.995293 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-f4f6f2f4-175f-4fda-b5c0-14f36bdb1c3a tempest-ServerMetadataNegativeTestJSON-414983834 tempest-ServerMetadataNegativeTestJSON-414983834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aebd68d6b30e45debbfd99ee6360f905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd702a70dab124153b4f40d3219ffc5f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:07:52.003925 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-f4f6f2f4-175f-4fda-b5c0-14f36bdb1c3a tempest-ServerMetadataNegativeTestJSON-414983834 tempest-ServerMetadataNegativeTestJSON-414983834-project] 10.222.0.13 "GET /compute/v2.1/servers/6bb5dbff-cdc7-4986-8606-cec948c9d28c" status: 200 len: 1323 microversion: 2.1 time: 0.322315 Nov 01 19:07:52.018659 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1615/3306] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:07:51 2022] GET /compute/v2.1/servers/6bb5dbff-cdc7-4986-8606-cec948c9d28c => generated 1323 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 19:07:52.214341 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-79f47bdb-4d9c-41a5-b88d-a6a72de3d5f7 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:07:52.214979 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-79f47bdb-4d9c-41a5-b88d-a6a72de3d5f7 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] [instance: f6fc44ea-8b27-4807-98b4-8b4b837a7ec3] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:07:52.221878 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-79f47bdb-4d9c-41a5-b88d-a6a72de3d5f7 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:52.222431 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-79f47bdb-4d9c-41a5-b88d-a6a72de3d5f7 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:52.222943 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-79f47bdb-4d9c-41a5-b88d-a6a72de3d5f7 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:52.223680 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-79f47bdb-4d9c-41a5-b88d-a6a72de3d5f7 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:52.224199 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-79f47bdb-4d9c-41a5-b88d-a6a72de3d5f7 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:52.224722 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-79f47bdb-4d9c-41a5-b88d-a6a72de3d5f7 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:52.325574 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-8b39c86b-82f9-4ca3-bfea-248d2b23d0e4 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:07:52.328027 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-8b39c86b-82f9-4ca3-bfea-248d2b23d0e4 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] [instance: 3029f3c1-4f32-4f6b-963c-16f65b6dff3c] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:07:52.335434 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-8b39c86b-82f9-4ca3-bfea-248d2b23d0e4 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:52.335907 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-8b39c86b-82f9-4ca3-bfea-248d2b23d0e4 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:52.336347 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-8b39c86b-82f9-4ca3-bfea-248d2b23d0e4 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:52.337715 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-8b39c86b-82f9-4ca3-bfea-248d2b23d0e4 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:52.338184 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-8b39c86b-82f9-4ca3-bfea-248d2b23d0e4 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:52.338609 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-8b39c86b-82f9-4ca3-bfea-248d2b23d0e4 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:52.369532 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-8b39c86b-82f9-4ca3-bfea-248d2b23d0e4 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] 10.222.0.13 "GET /compute/v2.1/servers/3029f3c1-4f32-4f6b-963c-16f65b6dff3c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048295 Nov 01 19:07:52.373737 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1616/3307] 10.222.0.13 () {58 vars in 1302 bytes} [Tue Nov 1 19:07:52 2022] GET /compute/v2.1/servers/3029f3c1-4f32-4f6b-963c-16f65b6dff3c/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 01 19:07:52.386877 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-79f47bdb-4d9c-41a5-b88d-a6a72de3d5f7 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113bd8c844ee490b86a68bc7e1e75da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '851785a5f76548898a77d67792888504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:07:52.394922 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-79f47bdb-4d9c-41a5-b88d-a6a72de3d5f7 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] 10.222.0.13 "GET /compute/v2.1/servers/f6fc44ea-8b27-4807-98b4-8b4b837a7ec3" status: 200 len: 1509 microversion: 2.1 time: 0.185169 Nov 01 19:07:52.395897 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1692/3308] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:07:52 2022] GET /compute/v2.1/servers/f6fc44ea-8b27-4807-98b4-8b4b837a7ec3 => generated 1509 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:07:52.418694 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-c0f3d0a6-bbd4-4d3d-a8bb-60a9c7fefaf7 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:07:52.419753 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-c0f3d0a6-bbd4-4d3d-a8bb-60a9c7fefaf7 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] [instance: f6fc44ea-8b27-4807-98b4-8b4b837a7ec3] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:07:52.425972 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-c0f3d0a6-bbd4-4d3d-a8bb-60a9c7fefaf7 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:52.426488 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-c0f3d0a6-bbd4-4d3d-a8bb-60a9c7fefaf7 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:52.426929 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-c0f3d0a6-bbd4-4d3d-a8bb-60a9c7fefaf7 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:52.427624 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-c0f3d0a6-bbd4-4d3d-a8bb-60a9c7fefaf7 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:52.428255 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-c0f3d0a6-bbd4-4d3d-a8bb-60a9c7fefaf7 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:52.428766 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-c0f3d0a6-bbd4-4d3d-a8bb-60a9c7fefaf7 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:52.517859 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-f96751de-b7e8-4924-8cd0-4ae5e4d8c565 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:07:52.518852 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-f96751de-b7e8-4924-8cd0-4ae5e4d8c565 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] [instance: 8485db2a-fd8f-4615-bbe0-14822ad44194] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:07:52.526562 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f96751de-b7e8-4924-8cd0-4ae5e4d8c565 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:52.527311 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f96751de-b7e8-4924-8cd0-4ae5e4d8c565 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:52.527945 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f96751de-b7e8-4924-8cd0-4ae5e4d8c565 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:52.528915 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f96751de-b7e8-4924-8cd0-4ae5e4d8c565 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:52.529575 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f96751de-b7e8-4924-8cd0-4ae5e4d8c565 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:52.530196 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f96751de-b7e8-4924-8cd0-4ae5e4d8c565 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:52.603446 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-c0f3d0a6-bbd4-4d3d-a8bb-60a9c7fefaf7 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113bd8c844ee490b86a68bc7e1e75da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '851785a5f76548898a77d67792888504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:07:52.612356 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-c0f3d0a6-bbd4-4d3d-a8bb-60a9c7fefaf7 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] 10.222.0.13 "GET /compute/v2.1/servers/f6fc44ea-8b27-4807-98b4-8b4b837a7ec3" status: 200 len: 1509 microversion: 2.1 time: 0.197538 Nov 01 19:07:52.615401 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1617/3309] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:07:52 2022] GET /compute/v2.1/servers/f6fc44ea-8b27-4807-98b4-8b4b837a7ec3 => generated 1509 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:07:52.637059 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-671dcf18-33ba-41f2-88d7-3a8405f19f21 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:07:52.637872 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-671dcf18-33ba-41f2-88d7-3a8405f19f21 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] [instance: f6fc44ea-8b27-4807-98b4-8b4b837a7ec3] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:07:52.644916 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-671dcf18-33ba-41f2-88d7-3a8405f19f21 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:52.645705 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-671dcf18-33ba-41f2-88d7-3a8405f19f21 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:52.646366 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-671dcf18-33ba-41f2-88d7-3a8405f19f21 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:52.647698 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-671dcf18-33ba-41f2-88d7-3a8405f19f21 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:52.648381 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-671dcf18-33ba-41f2-88d7-3a8405f19f21 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:52.649046 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-671dcf18-33ba-41f2-88d7-3a8405f19f21 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:52.682351 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-671dcf18-33ba-41f2-88d7-3a8405f19f21 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] [instance: f6fc44ea-8b27-4807-98b4-8b4b837a7ec3] Going to try to terminate instance {{(pid=121402) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 01 19:07:52.695508 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-f96751de-b7e8-4924-8cd0-4ae5e4d8c565 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '058480d92c9b4ab4af6815d0438a65c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee9dc49b89143f781e4ab30296e4d01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:07:52.706600 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-f96751de-b7e8-4924-8cd0-4ae5e4d8c565 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] 10.222.0.13 "GET /compute/v2.1/servers/8485db2a-fd8f-4615-bbe0-14822ad44194" status: 200 len: 1315 microversion: 2.1 time: 0.192528 Nov 01 19:07:52.707774 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1693/3310] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:07:52 2022] GET /compute/v2.1/servers/8485db2a-fd8f-4615-bbe0-14822ad44194 => generated 1315 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 19:07:52.775572 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-671dcf18-33ba-41f2-88d7-3a8405f19f21 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] 10.222.0.13 "DELETE /compute/v2.1/servers/f6fc44ea-8b27-4807-98b4-8b4b837a7ec3" status: 204 len: 0 microversion: 2.1 time: 0.142903 Nov 01 19:07:52.776101 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1618/3311] 10.222.0.13 () {58 vars in 1239 bytes} [Tue Nov 1 19:07:52 2022] DELETE /compute/v2.1/servers/f6fc44ea-8b27-4807-98b4-8b4b837a7ec3 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 01 19:07:52.784849 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-700cb976-761a-4956-abd6-09745b63d020 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:07:52.785641 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-700cb976-761a-4956-abd6-09745b63d020 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] [instance: f6fc44ea-8b27-4807-98b4-8b4b837a7ec3] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:07:52.792424 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-700cb976-761a-4956-abd6-09745b63d020 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:52.793037 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-700cb976-761a-4956-abd6-09745b63d020 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:52.793583 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-700cb976-761a-4956-abd6-09745b63d020 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:52.794357 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-700cb976-761a-4956-abd6-09745b63d020 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:52.794888 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-700cb976-761a-4956-abd6-09745b63d020 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:52.795426 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-700cb976-761a-4956-abd6-09745b63d020 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:52.858148 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-a1e0e432-df90-4475-82aa-023d6b006465 tempest-ImagesOneServerTestJSON-1044295602 tempest-ImagesOneServerTestJSON-1044295602-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:07:52.858855 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-a1e0e432-df90-4475-82aa-023d6b006465 tempest-ImagesOneServerTestJSON-1044295602 tempest-ImagesOneServerTestJSON-1044295602-project] [instance: 31f51cbd-b29a-46be-bca0-f27c2b287e15] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:07:52.865524 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-a1e0e432-df90-4475-82aa-023d6b006465 tempest-ImagesOneServerTestJSON-1044295602 tempest-ImagesOneServerTestJSON-1044295602-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:52.865674 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-a1e0e432-df90-4475-82aa-023d6b006465 tempest-ImagesOneServerTestJSON-1044295602 tempest-ImagesOneServerTestJSON-1044295602-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:52.866025 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-a1e0e432-df90-4475-82aa-023d6b006465 tempest-ImagesOneServerTestJSON-1044295602 tempest-ImagesOneServerTestJSON-1044295602-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:52.866752 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-a1e0e432-df90-4475-82aa-023d6b006465 tempest-ImagesOneServerTestJSON-1044295602 tempest-ImagesOneServerTestJSON-1044295602-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:52.867212 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-a1e0e432-df90-4475-82aa-023d6b006465 tempest-ImagesOneServerTestJSON-1044295602 tempest-ImagesOneServerTestJSON-1044295602-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:52.867893 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-a1e0e432-df90-4475-82aa-023d6b006465 tempest-ImagesOneServerTestJSON-1044295602 tempest-ImagesOneServerTestJSON-1044295602-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:52.944739 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-700cb976-761a-4956-abd6-09745b63d020 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113bd8c844ee490b86a68bc7e1e75da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '851785a5f76548898a77d67792888504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:07:52.953372 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-700cb976-761a-4956-abd6-09745b63d020 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] 10.222.0.13 "GET /compute/v2.1/servers/f6fc44ea-8b27-4807-98b4-8b4b837a7ec3" status: 200 len: 1515 microversion: 2.1 time: 0.172904 Nov 01 19:07:52.956624 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1694/3312] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:07:52 2022] GET /compute/v2.1/servers/f6fc44ea-8b27-4807-98b4-8b4b837a7ec3 => generated 1515 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:07:53.019967 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-a1e0e432-df90-4475-82aa-023d6b006465 tempest-ImagesOneServerTestJSON-1044295602 tempest-ImagesOneServerTestJSON-1044295602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6fd718964648e4bc83ed37cbaa9b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c548420d1df4403c9129cce5f040d45b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:07:53.028043 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-a1e0e432-df90-4475-82aa-023d6b006465 tempest-ImagesOneServerTestJSON-1044295602 tempest-ImagesOneServerTestJSON-1044295602-project] 10.222.0.13 "GET /compute/v2.1/servers/31f51cbd-b29a-46be-bca0-f27c2b287e15" status: 200 len: 1316 microversion: 2.1 time: 0.174338 Nov 01 19:07:53.028609 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1619/3313] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:07:52 2022] GET /compute/v2.1/servers/31f51cbd-b29a-46be-bca0-f27c2b287e15 => generated 1316 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 19:07:53.042310 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-ffa4cf21-ad14-4105-8efc-2040816c4ea5 tempest-ServerMetadataNegativeTestJSON-414983834 tempest-ServerMetadataNegativeTestJSON-414983834-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:07:53.042931 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-ffa4cf21-ad14-4105-8efc-2040816c4ea5 tempest-ServerMetadataNegativeTestJSON-414983834 tempest-ServerMetadataNegativeTestJSON-414983834-project] [instance: 6bb5dbff-cdc7-4986-8606-cec948c9d28c] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:07:53.049466 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-ffa4cf21-ad14-4105-8efc-2040816c4ea5 tempest-ServerMetadataNegativeTestJSON-414983834 tempest-ServerMetadataNegativeTestJSON-414983834-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:53.049950 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-ffa4cf21-ad14-4105-8efc-2040816c4ea5 tempest-ServerMetadataNegativeTestJSON-414983834 tempest-ServerMetadataNegativeTestJSON-414983834-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:53.050392 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-ffa4cf21-ad14-4105-8efc-2040816c4ea5 tempest-ServerMetadataNegativeTestJSON-414983834 tempest-ServerMetadataNegativeTestJSON-414983834-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:53.051088 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-ffa4cf21-ad14-4105-8efc-2040816c4ea5 tempest-ServerMetadataNegativeTestJSON-414983834 tempest-ServerMetadataNegativeTestJSON-414983834-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:53.051543 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-ffa4cf21-ad14-4105-8efc-2040816c4ea5 tempest-ServerMetadataNegativeTestJSON-414983834 tempest-ServerMetadataNegativeTestJSON-414983834-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:53.051968 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-ffa4cf21-ad14-4105-8efc-2040816c4ea5 tempest-ServerMetadataNegativeTestJSON-414983834 tempest-ServerMetadataNegativeTestJSON-414983834-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:53.190759 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-ffa4cf21-ad14-4105-8efc-2040816c4ea5 tempest-ServerMetadataNegativeTestJSON-414983834 tempest-ServerMetadataNegativeTestJSON-414983834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aebd68d6b30e45debbfd99ee6360f905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd702a70dab124153b4f40d3219ffc5f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:07:53.199276 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-ffa4cf21-ad14-4105-8efc-2040816c4ea5 tempest-ServerMetadataNegativeTestJSON-414983834 tempest-ServerMetadataNegativeTestJSON-414983834-project] 10.222.0.13 "GET /compute/v2.1/servers/6bb5dbff-cdc7-4986-8606-cec948c9d28c" status: 200 len: 1323 microversion: 2.1 time: 0.161369 Nov 01 19:07:53.200096 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1695/3314] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:07:53 2022] GET /compute/v2.1/servers/6bb5dbff-cdc7-4986-8606-cec948c9d28c => generated 1323 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:07:53.382518 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-beb90aec-da5d-4634-a9ee-0a5e6e16eb10 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:07:53.385228 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-beb90aec-da5d-4634-a9ee-0a5e6e16eb10 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] [instance: 3029f3c1-4f32-4f6b-963c-16f65b6dff3c] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:07:53.402961 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-beb90aec-da5d-4634-a9ee-0a5e6e16eb10 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:53.403471 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-beb90aec-da5d-4634-a9ee-0a5e6e16eb10 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:53.403931 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-beb90aec-da5d-4634-a9ee-0a5e6e16eb10 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:53.404673 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-beb90aec-da5d-4634-a9ee-0a5e6e16eb10 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:53.405140 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-beb90aec-da5d-4634-a9ee-0a5e6e16eb10 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:53.405569 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-beb90aec-da5d-4634-a9ee-0a5e6e16eb10 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:53.444806 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-beb90aec-da5d-4634-a9ee-0a5e6e16eb10 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] 10.222.0.13 "GET /compute/v2.1/servers/3029f3c1-4f32-4f6b-963c-16f65b6dff3c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.066522 Nov 01 19:07:53.445368 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1620/3315] 10.222.0.13 () {58 vars in 1302 bytes} [Tue Nov 1 19:07:53 2022] GET /compute/v2.1/servers/3029f3c1-4f32-4f6b-963c-16f65b6dff3c/os-volume_attachments => generated 197 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:07:53.730812 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-690578d8-9730-4f16-9db5-4816ca0143a6 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:07:53.731453 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-690578d8-9730-4f16-9db5-4816ca0143a6 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] [instance: 8485db2a-fd8f-4615-bbe0-14822ad44194] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:07:53.738190 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-690578d8-9730-4f16-9db5-4816ca0143a6 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:53.738682 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-690578d8-9730-4f16-9db5-4816ca0143a6 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:53.739123 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-690578d8-9730-4f16-9db5-4816ca0143a6 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:53.739826 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-690578d8-9730-4f16-9db5-4816ca0143a6 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:53.740281 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-690578d8-9730-4f16-9db5-4816ca0143a6 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:53.740735 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-690578d8-9730-4f16-9db5-4816ca0143a6 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:53.878282 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-690578d8-9730-4f16-9db5-4816ca0143a6 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '058480d92c9b4ab4af6815d0438a65c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee9dc49b89143f781e4ab30296e4d01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:07:53.887267 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-690578d8-9730-4f16-9db5-4816ca0143a6 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] 10.222.0.13 "GET /compute/v2.1/servers/8485db2a-fd8f-4615-bbe0-14822ad44194" status: 200 len: 1315 microversion: 2.1 time: 0.160850 Nov 01 19:07:53.888327 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1696/3316] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:07:53 2022] GET /compute/v2.1/servers/8485db2a-fd8f-4615-bbe0-14822ad44194 => generated 1315 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:07:53.979674 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-431ea24d-978e-435e-aa48-fd05ec5f38dd tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:07:53.980980 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-431ea24d-978e-435e-aa48-fd05ec5f38dd tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] [instance: f6fc44ea-8b27-4807-98b4-8b4b837a7ec3] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:07:53.987424 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-431ea24d-978e-435e-aa48-fd05ec5f38dd tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:53.987908 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-431ea24d-978e-435e-aa48-fd05ec5f38dd tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:53.988370 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-431ea24d-978e-435e-aa48-fd05ec5f38dd tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:53.989229 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-431ea24d-978e-435e-aa48-fd05ec5f38dd tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:53.989737 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-431ea24d-978e-435e-aa48-fd05ec5f38dd tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:53.990148 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-431ea24d-978e-435e-aa48-fd05ec5f38dd tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:54.052520 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-026f5240-dd82-4c40-b485-905ff6e22651 tempest-ImagesOneServerTestJSON-1044295602 tempest-ImagesOneServerTestJSON-1044295602-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:07:54.053672 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-026f5240-dd82-4c40-b485-905ff6e22651 tempest-ImagesOneServerTestJSON-1044295602 tempest-ImagesOneServerTestJSON-1044295602-project] [instance: 31f51cbd-b29a-46be-bca0-f27c2b287e15] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:07:54.064727 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-026f5240-dd82-4c40-b485-905ff6e22651 tempest-ImagesOneServerTestJSON-1044295602 tempest-ImagesOneServerTestJSON-1044295602-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:54.065663 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-026f5240-dd82-4c40-b485-905ff6e22651 tempest-ImagesOneServerTestJSON-1044295602 tempest-ImagesOneServerTestJSON-1044295602-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:54.066162 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-026f5240-dd82-4c40-b485-905ff6e22651 tempest-ImagesOneServerTestJSON-1044295602 tempest-ImagesOneServerTestJSON-1044295602-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:54.066970 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-026f5240-dd82-4c40-b485-905ff6e22651 tempest-ImagesOneServerTestJSON-1044295602 tempest-ImagesOneServerTestJSON-1044295602-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:54.070018 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-026f5240-dd82-4c40-b485-905ff6e22651 tempest-ImagesOneServerTestJSON-1044295602 tempest-ImagesOneServerTestJSON-1044295602-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:54.070497 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-026f5240-dd82-4c40-b485-905ff6e22651 tempest-ImagesOneServerTestJSON-1044295602 tempest-ImagesOneServerTestJSON-1044295602-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:54.192852 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-431ea24d-978e-435e-aa48-fd05ec5f38dd tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113bd8c844ee490b86a68bc7e1e75da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '851785a5f76548898a77d67792888504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:07:54.203451 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-431ea24d-978e-435e-aa48-fd05ec5f38dd tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] 10.222.0.13 "GET /compute/v2.1/servers/f6fc44ea-8b27-4807-98b4-8b4b837a7ec3" status: 200 len: 1515 microversion: 2.1 time: 0.228453 Nov 01 19:07:54.204362 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1621/3317] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:07:53 2022] GET /compute/v2.1/servers/f6fc44ea-8b27-4807-98b4-8b4b837a7ec3 => generated 1515 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:07:54.223817 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-38aaed96-c387-49c3-8ba2-a5a3bb3895c7 tempest-ServerMetadataNegativeTestJSON-414983834 tempest-ServerMetadataNegativeTestJSON-414983834-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:07:54.224428 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-38aaed96-c387-49c3-8ba2-a5a3bb3895c7 tempest-ServerMetadataNegativeTestJSON-414983834 tempest-ServerMetadataNegativeTestJSON-414983834-project] [instance: 6bb5dbff-cdc7-4986-8606-cec948c9d28c] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:07:54.231020 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-38aaed96-c387-49c3-8ba2-a5a3bb3895c7 tempest-ServerMetadataNegativeTestJSON-414983834 tempest-ServerMetadataNegativeTestJSON-414983834-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:54.231518 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-38aaed96-c387-49c3-8ba2-a5a3bb3895c7 tempest-ServerMetadataNegativeTestJSON-414983834 tempest-ServerMetadataNegativeTestJSON-414983834-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:54.231967 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-38aaed96-c387-49c3-8ba2-a5a3bb3895c7 tempest-ServerMetadataNegativeTestJSON-414983834 tempest-ServerMetadataNegativeTestJSON-414983834-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:54.232741 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-38aaed96-c387-49c3-8ba2-a5a3bb3895c7 tempest-ServerMetadataNegativeTestJSON-414983834 tempest-ServerMetadataNegativeTestJSON-414983834-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:54.233207 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-38aaed96-c387-49c3-8ba2-a5a3bb3895c7 tempest-ServerMetadataNegativeTestJSON-414983834 tempest-ServerMetadataNegativeTestJSON-414983834-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:54.233757 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-38aaed96-c387-49c3-8ba2-a5a3bb3895c7 tempest-ServerMetadataNegativeTestJSON-414983834 tempest-ServerMetadataNegativeTestJSON-414983834-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:54.319271 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-026f5240-dd82-4c40-b485-905ff6e22651 tempest-ImagesOneServerTestJSON-1044295602 tempest-ImagesOneServerTestJSON-1044295602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6fd718964648e4bc83ed37cbaa9b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c548420d1df4403c9129cce5f040d45b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:07:54.331598 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-026f5240-dd82-4c40-b485-905ff6e22651 tempest-ImagesOneServerTestJSON-1044295602 tempest-ImagesOneServerTestJSON-1044295602-project] 10.222.0.13 "GET /compute/v2.1/servers/31f51cbd-b29a-46be-bca0-f27c2b287e15" status: 200 len: 1316 microversion: 2.1 time: 0.280497 Nov 01 19:07:54.332617 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1697/3318] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:07:54 2022] GET /compute/v2.1/servers/31f51cbd-b29a-46be-bca0-f27c2b287e15 => generated 1316 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:07:54.438105 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-38aaed96-c387-49c3-8ba2-a5a3bb3895c7 tempest-ServerMetadataNegativeTestJSON-414983834 tempest-ServerMetadataNegativeTestJSON-414983834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aebd68d6b30e45debbfd99ee6360f905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd702a70dab124153b4f40d3219ffc5f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:07:54.448743 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-38aaed96-c387-49c3-8ba2-a5a3bb3895c7 tempest-ServerMetadataNegativeTestJSON-414983834 tempest-ServerMetadataNegativeTestJSON-414983834-project] 10.222.0.13 "GET /compute/v2.1/servers/6bb5dbff-cdc7-4986-8606-cec948c9d28c" status: 200 len: 1323 microversion: 2.1 time: 0.229663 Nov 01 19:07:54.449645 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1622/3319] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:07:54 2022] GET /compute/v2.1/servers/6bb5dbff-cdc7-4986-8606-cec948c9d28c => generated 1323 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 19:07:54.458766 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-47050ec9-7de4-4bf4-9cfd-3c332129cc69 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:07:54.461730 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-47050ec9-7de4-4bf4-9cfd-3c332129cc69 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] [instance: 3029f3c1-4f32-4f6b-963c-16f65b6dff3c] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:07:54.477759 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [req-d4cf3916-9735-46fc-ad6d-cc3eec920df9 req-3ac6deb8-6d33-43e3-9dee-8454c3b53dc8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "31f51cbd-b29a-46be-bca0-f27c2b287e15", "name": "network-vif-plugged", "status": "completed", "tag": "bc5f2d73-99ce-47e7-bd41-afad82bb372e"}]} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:07:54.478695 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-47050ec9-7de4-4bf4-9cfd-3c332129cc69 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:54.479986 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-47050ec9-7de4-4bf4-9cfd-3c332129cc69 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:54.483778 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-47050ec9-7de4-4bf4-9cfd-3c332129cc69 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:54.487680 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-47050ec9-7de4-4bf4-9cfd-3c332129cc69 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:54.489744 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-47050ec9-7de4-4bf4-9cfd-3c332129cc69 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:54.494731 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-47050ec9-7de4-4bf4-9cfd-3c332129cc69 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:54.508454 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-d4cf3916-9735-46fc-ad6d-cc3eec920df9 req-3ac6deb8-6d33-43e3-9dee-8454c3b53dc8 service nova] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:54.510506 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-d4cf3916-9735-46fc-ad6d-cc3eec920df9 req-3ac6deb8-6d33-43e3-9dee-8454c3b53dc8 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:54.512436 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-d4cf3916-9735-46fc-ad6d-cc3eec920df9 req-3ac6deb8-6d33-43e3-9dee-8454c3b53dc8 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:54.539710 n-d-863052-2 devstack@n-api.service[121403]: DEBUG dbcounter [-] [121403] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=121403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 19:07:54.563606 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.compute.server_external_events [req-d4cf3916-9735-46fc-ad6d-cc3eec920df9 req-3ac6deb8-6d33-43e3-9dee-8454c3b53dc8 service nova] Creating event network-vif-plugged:bc5f2d73-99ce-47e7-bd41-afad82bb372e for instance 31f51cbd-b29a-46be-bca0-f27c2b287e15 on n-h2-863052-2 Nov 01 19:07:54.564367 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-47050ec9-7de4-4bf4-9cfd-3c332129cc69 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] 10.222.0.13 "GET /compute/v2.1/servers/3029f3c1-4f32-4f6b-963c-16f65b6dff3c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.110675 Nov 01 19:07:54.569274 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1698/3320] 10.222.0.13 () {58 vars in 1302 bytes} [Tue Nov 1 19:07:54 2022] GET /compute/v2.1/servers/3029f3c1-4f32-4f6b-963c-16f65b6dff3c/os-volume_attachments => generated 197 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:07:54.569582 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [req-d4cf3916-9735-46fc-ad6d-cc3eec920df9 req-3ac6deb8-6d33-43e3-9dee-8454c3b53dc8 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104333 Nov 01 19:07:54.570184 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1623/3321] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Nov 1 19:07:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:07:54.914875 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-7467e57c-40bb-44b7-8e4a-d16174c8ab82 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:07:54.916908 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-7467e57c-40bb-44b7-8e4a-d16174c8ab82 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] [instance: 8485db2a-fd8f-4615-bbe0-14822ad44194] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:07:54.926227 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-7467e57c-40bb-44b7-8e4a-d16174c8ab82 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:54.927082 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-7467e57c-40bb-44b7-8e4a-d16174c8ab82 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:54.928210 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-7467e57c-40bb-44b7-8e4a-d16174c8ab82 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:54.930398 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-7467e57c-40bb-44b7-8e4a-d16174c8ab82 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:54.932927 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-7467e57c-40bb-44b7-8e4a-d16174c8ab82 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:54.934119 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-7467e57c-40bb-44b7-8e4a-d16174c8ab82 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:55.228746 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-b8c0d37c-48a6-47ae-ad7b-e8aa59e00985 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:07:55.229463 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-b8c0d37c-48a6-47ae-ad7b-e8aa59e00985 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] [instance: f6fc44ea-8b27-4807-98b4-8b4b837a7ec3] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:07:55.236163 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b8c0d37c-48a6-47ae-ad7b-e8aa59e00985 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:55.236695 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b8c0d37c-48a6-47ae-ad7b-e8aa59e00985 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:55.237140 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b8c0d37c-48a6-47ae-ad7b-e8aa59e00985 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:55.237845 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b8c0d37c-48a6-47ae-ad7b-e8aa59e00985 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:55.238307 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b8c0d37c-48a6-47ae-ad7b-e8aa59e00985 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:55.238736 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b8c0d37c-48a6-47ae-ad7b-e8aa59e00985 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:55.433842 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-b8c0d37c-48a6-47ae-ad7b-e8aa59e00985 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113bd8c844ee490b86a68bc7e1e75da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '851785a5f76548898a77d67792888504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:07:55.443057 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-b8c0d37c-48a6-47ae-ad7b-e8aa59e00985 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] 10.222.0.13 "GET /compute/v2.1/servers/f6fc44ea-8b27-4807-98b4-8b4b837a7ec3" status: 200 len: 1515 microversion: 2.1 time: 0.219309 Nov 01 19:07:55.443998 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1624/3322] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:07:55 2022] GET /compute/v2.1/servers/f6fc44ea-8b27-4807-98b4-8b4b837a7ec3 => generated 1515 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:07:55.455418 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-47cac099-375d-4941-8186-f5b142c6f5b9 tempest-ImagesOneServerTestJSON-1044295602 tempest-ImagesOneServerTestJSON-1044295602-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:07:55.455418 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-47cac099-375d-4941-8186-f5b142c6f5b9 tempest-ImagesOneServerTestJSON-1044295602 tempest-ImagesOneServerTestJSON-1044295602-project] [instance: 31f51cbd-b29a-46be-bca0-f27c2b287e15] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:07:55.461722 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-47cac099-375d-4941-8186-f5b142c6f5b9 tempest-ImagesOneServerTestJSON-1044295602 tempest-ImagesOneServerTestJSON-1044295602-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:55.462834 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-47cac099-375d-4941-8186-f5b142c6f5b9 tempest-ImagesOneServerTestJSON-1044295602 tempest-ImagesOneServerTestJSON-1044295602-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:55.463318 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-47cac099-375d-4941-8186-f5b142c6f5b9 tempest-ImagesOneServerTestJSON-1044295602 tempest-ImagesOneServerTestJSON-1044295602-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:55.464068 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-47cac099-375d-4941-8186-f5b142c6f5b9 tempest-ImagesOneServerTestJSON-1044295602 tempest-ImagesOneServerTestJSON-1044295602-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:55.464628 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-47cac099-375d-4941-8186-f5b142c6f5b9 tempest-ImagesOneServerTestJSON-1044295602 tempest-ImagesOneServerTestJSON-1044295602-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:55.465057 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-47cac099-375d-4941-8186-f5b142c6f5b9 tempest-ImagesOneServerTestJSON-1044295602 tempest-ImagesOneServerTestJSON-1044295602-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:55.471014 n-d-863052-2 devstack@n-api.service[121402]: DEBUG dbcounter [-] [121402] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 19:07:55.481205 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-7467e57c-40bb-44b7-8e4a-d16174c8ab82 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '058480d92c9b4ab4af6815d0438a65c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee9dc49b89143f781e4ab30296e4d01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:07:55.490933 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-7467e57c-40bb-44b7-8e4a-d16174c8ab82 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] 10.222.0.13 "GET /compute/v2.1/servers/8485db2a-fd8f-4615-bbe0-14822ad44194" status: 200 len: 1315 microversion: 2.1 time: 0.583547 Nov 01 19:07:55.506669 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1699/3323] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:07:54 2022] GET /compute/v2.1/servers/8485db2a-fd8f-4615-bbe0-14822ad44194 => generated 1315 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:07:55.515710 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-2da0675e-faf1-46c4-ab71-091975ab1853 tempest-ServerMetadataNegativeTestJSON-414983834 tempest-ServerMetadataNegativeTestJSON-414983834-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:07:55.516333 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-2da0675e-faf1-46c4-ab71-091975ab1853 tempest-ServerMetadataNegativeTestJSON-414983834 tempest-ServerMetadataNegativeTestJSON-414983834-project] [instance: 6bb5dbff-cdc7-4986-8606-cec948c9d28c] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:07:55.522818 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-2da0675e-faf1-46c4-ab71-091975ab1853 tempest-ServerMetadataNegativeTestJSON-414983834 tempest-ServerMetadataNegativeTestJSON-414983834-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:55.523316 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-2da0675e-faf1-46c4-ab71-091975ab1853 tempest-ServerMetadataNegativeTestJSON-414983834 tempest-ServerMetadataNegativeTestJSON-414983834-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:55.523758 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-2da0675e-faf1-46c4-ab71-091975ab1853 tempest-ServerMetadataNegativeTestJSON-414983834 tempest-ServerMetadataNegativeTestJSON-414983834-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:55.525449 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-2da0675e-faf1-46c4-ab71-091975ab1853 tempest-ServerMetadataNegativeTestJSON-414983834 tempest-ServerMetadataNegativeTestJSON-414983834-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:55.525925 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-2da0675e-faf1-46c4-ab71-091975ab1853 tempest-ServerMetadataNegativeTestJSON-414983834 tempest-ServerMetadataNegativeTestJSON-414983834-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:55.526357 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-2da0675e-faf1-46c4-ab71-091975ab1853 tempest-ServerMetadataNegativeTestJSON-414983834 tempest-ServerMetadataNegativeTestJSON-414983834-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:55.687819 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-47cac099-375d-4941-8186-f5b142c6f5b9 tempest-ImagesOneServerTestJSON-1044295602 tempest-ImagesOneServerTestJSON-1044295602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6fd718964648e4bc83ed37cbaa9b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c548420d1df4403c9129cce5f040d45b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:07:55.698854 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-47cac099-375d-4941-8186-f5b142c6f5b9 tempest-ImagesOneServerTestJSON-1044295602 tempest-ImagesOneServerTestJSON-1044295602-project] 10.222.0.13 "GET /compute/v2.1/servers/31f51cbd-b29a-46be-bca0-f27c2b287e15" status: 200 len: 1316 microversion: 2.1 time: 0.250685 Nov 01 19:07:55.699650 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1625/3324] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:07:55 2022] GET /compute/v2.1/servers/31f51cbd-b29a-46be-bca0-f27c2b287e15 => generated 1316 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:07:55.719640 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-a2983b19-cb70-4bde-b06e-a172e78cebb0 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:07:55.722262 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-a2983b19-cb70-4bde-b06e-a172e78cebb0 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] [instance: 3029f3c1-4f32-4f6b-963c-16f65b6dff3c] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:07:55.730037 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-a2983b19-cb70-4bde-b06e-a172e78cebb0 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:55.730747 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-a2983b19-cb70-4bde-b06e-a172e78cebb0 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:55.731352 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-a2983b19-cb70-4bde-b06e-a172e78cebb0 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:55.732221 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-a2983b19-cb70-4bde-b06e-a172e78cebb0 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:55.732963 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-a2983b19-cb70-4bde-b06e-a172e78cebb0 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:55.733570 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-a2983b19-cb70-4bde-b06e-a172e78cebb0 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:55.795988 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-a2983b19-cb70-4bde-b06e-a172e78cebb0 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] 10.222.0.13 "GET /compute/v2.1/servers/3029f3c1-4f32-4f6b-963c-16f65b6dff3c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.080168 Nov 01 19:07:55.796615 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1626/3325] 10.222.0.13 () {58 vars in 1302 bytes} [Tue Nov 1 19:07:55 2022] GET /compute/v2.1/servers/3029f3c1-4f32-4f6b-963c-16f65b6dff3c/os-volume_attachments => generated 197 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:07:55.816993 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [req-85bc7dfc-b516-46a5-8164-5aeec73a8f42 req-e44ae3ee-415b-4bfc-bb68-be68b2f66a48 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f6fc44ea-8b27-4807-98b4-8b4b837a7ec3", "name": "network-vif-deleted", "tag": "d8acb2d9-1cce-4aec-b4f5-cb000b4af23d"}]} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:07:55.817359 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-2da0675e-faf1-46c4-ab71-091975ab1853 tempest-ServerMetadataNegativeTestJSON-414983834 tempest-ServerMetadataNegativeTestJSON-414983834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aebd68d6b30e45debbfd99ee6360f905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd702a70dab124153b4f40d3219ffc5f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:07:55.827822 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-2da0675e-faf1-46c4-ab71-091975ab1853 tempest-ServerMetadataNegativeTestJSON-414983834 tempest-ServerMetadataNegativeTestJSON-414983834-project] 10.222.0.13 "GET /compute/v2.1/servers/6bb5dbff-cdc7-4986-8606-cec948c9d28c" status: 200 len: 1323 microversion: 2.1 time: 0.317421 Nov 01 19:07:55.828697 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1700/3326] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:07:55 2022] GET /compute/v2.1/servers/6bb5dbff-cdc7-4986-8606-cec948c9d28c => generated 1323 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:07:55.840597 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-85bc7dfc-b516-46a5-8164-5aeec73a8f42 req-e44ae3ee-415b-4bfc-bb68-be68b2f66a48 service nova] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:55.847807 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-85bc7dfc-b516-46a5-8164-5aeec73a8f42 req-e44ae3ee-415b-4bfc-bb68-be68b2f66a48 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:55.848257 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-85bc7dfc-b516-46a5-8164-5aeec73a8f42 req-e44ae3ee-415b-4bfc-bb68-be68b2f66a48 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:55.862916 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.compute.server_external_events [req-85bc7dfc-b516-46a5-8164-5aeec73a8f42 req-e44ae3ee-415b-4bfc-bb68-be68b2f66a48 service nova] Creating event network-vif-deleted:d8acb2d9-1cce-4aec-b4f5-cb000b4af23d for instance f6fc44ea-8b27-4807-98b4-8b4b837a7ec3 on n-h1-863052-2 Nov 01 19:07:55.870437 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [req-85bc7dfc-b516-46a5-8164-5aeec73a8f42 req-e44ae3ee-415b-4bfc-bb68-be68b2f66a48 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072248 Nov 01 19:07:55.875598 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1627/3327] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Nov 1 19:07:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:07:56.470942 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-e96e4dda-e104-4028-90be-01dbb7c60840 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:07:56.472180 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-e96e4dda-e104-4028-90be-01dbb7c60840 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] [instance: f6fc44ea-8b27-4807-98b4-8b4b837a7ec3] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:07:56.478857 n-d-863052-2 devstack@n-api.service[121403]: DEBUG dbcounter [-] [121403] Writing DB stats nova_cell0:SELECT=6 {{(pid=121403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 19:07:56.482082 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-e96e4dda-e104-4028-90be-01dbb7c60840 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:56.482946 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-e96e4dda-e104-4028-90be-01dbb7c60840 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:56.483699 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-e96e4dda-e104-4028-90be-01dbb7c60840 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:56.484879 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-e96e4dda-e104-4028-90be-01dbb7c60840 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:56.485552 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-e96e4dda-e104-4028-90be-01dbb7c60840 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:56.486123 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-e96e4dda-e104-4028-90be-01dbb7c60840 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:56.524949 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-e96e4dda-e104-4028-90be-01dbb7c60840 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:56.525169 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-59f8c817-822c-4d80-ab98-07690a48216c tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:07:56.525605 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-e96e4dda-e104-4028-90be-01dbb7c60840 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:56.525999 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-e96e4dda-e104-4028-90be-01dbb7c60840 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:56.526534 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-59f8c817-822c-4d80-ab98-07690a48216c tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] [instance: 8485db2a-fd8f-4615-bbe0-14822ad44194] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:07:56.526689 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.objects.instance [None req-e96e4dda-e104-4028-90be-01dbb7c60840 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lazy-loading 'fault' on Instance uuid f6fc44ea-8b27-4807-98b4-8b4b837a7ec3 {{(pid=121403) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 01 19:07:56.535822 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-59f8c817-822c-4d80-ab98-07690a48216c tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:56.536332 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-59f8c817-822c-4d80-ab98-07690a48216c tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:56.536795 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-59f8c817-822c-4d80-ab98-07690a48216c tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:56.537490 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-59f8c817-822c-4d80-ab98-07690a48216c tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:56.537943 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-59f8c817-822c-4d80-ab98-07690a48216c tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:56.538364 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-59f8c817-822c-4d80-ab98-07690a48216c tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:56.581152 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-e96e4dda-e104-4028-90be-01dbb7c60840 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113bd8c844ee490b86a68bc7e1e75da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '851785a5f76548898a77d67792888504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:07:56.589768 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-e96e4dda-e104-4028-90be-01dbb7c60840 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] 10.222.0.13 "GET /compute/v2.1/servers/f6fc44ea-8b27-4807-98b4-8b4b837a7ec3" status: 200 len: 1318 microversion: 2.1 time: 0.124230 Nov 01 19:07:56.590448 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1701/3328] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:07:56 2022] GET /compute/v2.1/servers/f6fc44ea-8b27-4807-98b4-8b4b837a7ec3 => generated 1318 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:07:56.595634 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [req-85379415-ab7a-471a-bc16-9698f9110a44 req-b09cf53d-0131-409b-9fb3-7522422577fa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8485db2a-fd8f-4615-bbe0-14822ad44194", "name": "network-vif-plugged", "status": "completed", "tag": "01274861-72a7-4685-9ca3-9bdd9e739056"}]} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:07:56.605963 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-85379415-ab7a-471a-bc16-9698f9110a44 req-b09cf53d-0131-409b-9fb3-7522422577fa service nova] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:56.606711 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-85379415-ab7a-471a-bc16-9698f9110a44 req-b09cf53d-0131-409b-9fb3-7522422577fa service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:56.607231 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-85379415-ab7a-471a-bc16-9698f9110a44 req-b09cf53d-0131-409b-9fb3-7522422577fa service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:56.619063 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.compute.server_external_events [req-85379415-ab7a-471a-bc16-9698f9110a44 req-b09cf53d-0131-409b-9fb3-7522422577fa service nova] Creating event network-vif-plugged:01274861-72a7-4685-9ca3-9bdd9e739056 for instance 8485db2a-fd8f-4615-bbe0-14822ad44194 on n-h2-863052-2 Nov 01 19:07:56.624183 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [req-85379415-ab7a-471a-bc16-9698f9110a44 req-b09cf53d-0131-409b-9fb3-7522422577fa service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032429 Nov 01 19:07:56.624922 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1702/3329] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Nov 1 19:07:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:07:56.685938 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-59f8c817-822c-4d80-ab98-07690a48216c tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '058480d92c9b4ab4af6815d0438a65c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee9dc49b89143f781e4ab30296e4d01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:07:56.694519 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-59f8c817-822c-4d80-ab98-07690a48216c tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] 10.222.0.13 "GET /compute/v2.1/servers/8485db2a-fd8f-4615-bbe0-14822ad44194" status: 200 len: 1315 microversion: 2.1 time: 0.179486 Nov 01 19:07:56.695102 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1628/3330] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:07:56 2022] GET /compute/v2.1/servers/8485db2a-fd8f-4615-bbe0-14822ad44194 => generated 1315 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:07:56.719578 n-d-863052-2 devstack@n-api.service[121403]: DEBUG dbcounter [-] [121403] Writing DB stats nova_cell0:SELECT=24 {{(pid=121403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 19:07:56.724990 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-d100b0ad-767e-4882-a370-df292d3ef4d6 tempest-ImagesOneServerTestJSON-1044295602 tempest-ImagesOneServerTestJSON-1044295602-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:07:56.726400 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-d100b0ad-767e-4882-a370-df292d3ef4d6 tempest-ImagesOneServerTestJSON-1044295602 tempest-ImagesOneServerTestJSON-1044295602-project] [instance: 31f51cbd-b29a-46be-bca0-f27c2b287e15] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:07:56.734914 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d100b0ad-767e-4882-a370-df292d3ef4d6 tempest-ImagesOneServerTestJSON-1044295602 tempest-ImagesOneServerTestJSON-1044295602-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:56.735407 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d100b0ad-767e-4882-a370-df292d3ef4d6 tempest-ImagesOneServerTestJSON-1044295602 tempest-ImagesOneServerTestJSON-1044295602-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:56.735845 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d100b0ad-767e-4882-a370-df292d3ef4d6 tempest-ImagesOneServerTestJSON-1044295602 tempest-ImagesOneServerTestJSON-1044295602-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:56.736822 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d100b0ad-767e-4882-a370-df292d3ef4d6 tempest-ImagesOneServerTestJSON-1044295602 tempest-ImagesOneServerTestJSON-1044295602-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:56.737311 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d100b0ad-767e-4882-a370-df292d3ef4d6 tempest-ImagesOneServerTestJSON-1044295602 tempest-ImagesOneServerTestJSON-1044295602-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:56.737738 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d100b0ad-767e-4882-a370-df292d3ef4d6 tempest-ImagesOneServerTestJSON-1044295602 tempest-ImagesOneServerTestJSON-1044295602-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:56.809979 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-39b79c24-f53e-41f4-83af-79b6bb1e9ced tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:07:56.813760 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-39b79c24-f53e-41f4-83af-79b6bb1e9ced tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] [instance: 3029f3c1-4f32-4f6b-963c-16f65b6dff3c] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:07:56.821796 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-39b79c24-f53e-41f4-83af-79b6bb1e9ced tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:56.823015 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-39b79c24-f53e-41f4-83af-79b6bb1e9ced tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:56.824902 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-39b79c24-f53e-41f4-83af-79b6bb1e9ced tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:56.825834 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-39b79c24-f53e-41f4-83af-79b6bb1e9ced tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:56.826300 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-39b79c24-f53e-41f4-83af-79b6bb1e9ced tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:56.826899 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-39b79c24-f53e-41f4-83af-79b6bb1e9ced tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:56.869707 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-39b79c24-f53e-41f4-83af-79b6bb1e9ced tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] 10.222.0.13 "GET /compute/v2.1/servers/3029f3c1-4f32-4f6b-963c-16f65b6dff3c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.064619 Nov 01 19:07:56.871666 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1629/3331] 10.222.0.13 () {58 vars in 1302 bytes} [Tue Nov 1 19:07:56 2022] GET /compute/v2.1/servers/3029f3c1-4f32-4f6b-963c-16f65b6dff3c/os-volume_attachments => generated 197 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 01 19:07:56.877341 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-9f9ec7c9-60e5-425b-89df-c5b5281c9bed tempest-ServerMetadataNegativeTestJSON-414983834 tempest-ServerMetadataNegativeTestJSON-414983834-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:07:56.878265 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-9f9ec7c9-60e5-425b-89df-c5b5281c9bed tempest-ServerMetadataNegativeTestJSON-414983834 tempest-ServerMetadataNegativeTestJSON-414983834-project] [instance: 6bb5dbff-cdc7-4986-8606-cec948c9d28c] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:07:56.885802 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-9f9ec7c9-60e5-425b-89df-c5b5281c9bed tempest-ServerMetadataNegativeTestJSON-414983834 tempest-ServerMetadataNegativeTestJSON-414983834-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:56.886303 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-9f9ec7c9-60e5-425b-89df-c5b5281c9bed tempest-ServerMetadataNegativeTestJSON-414983834 tempest-ServerMetadataNegativeTestJSON-414983834-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:56.886749 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-9f9ec7c9-60e5-425b-89df-c5b5281c9bed tempest-ServerMetadataNegativeTestJSON-414983834 tempest-ServerMetadataNegativeTestJSON-414983834-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:56.887466 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-9f9ec7c9-60e5-425b-89df-c5b5281c9bed tempest-ServerMetadataNegativeTestJSON-414983834 tempest-ServerMetadataNegativeTestJSON-414983834-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:56.887931 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-9f9ec7c9-60e5-425b-89df-c5b5281c9bed tempest-ServerMetadataNegativeTestJSON-414983834 tempest-ServerMetadataNegativeTestJSON-414983834-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:56.888355 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-9f9ec7c9-60e5-425b-89df-c5b5281c9bed tempest-ServerMetadataNegativeTestJSON-414983834 tempest-ServerMetadataNegativeTestJSON-414983834-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:56.946730 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-d100b0ad-767e-4882-a370-df292d3ef4d6 tempest-ImagesOneServerTestJSON-1044295602 tempest-ImagesOneServerTestJSON-1044295602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6fd718964648e4bc83ed37cbaa9b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c548420d1df4403c9129cce5f040d45b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:07:56.957470 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-d100b0ad-767e-4882-a370-df292d3ef4d6 tempest-ImagesOneServerTestJSON-1044295602 tempest-ImagesOneServerTestJSON-1044295602-project] 10.222.0.13 "GET /compute/v2.1/servers/31f51cbd-b29a-46be-bca0-f27c2b287e15" status: 200 len: 1466 microversion: 2.1 time: 0.238774 Nov 01 19:07:56.958004 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1703/3332] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:07:56 2022] GET /compute/v2.1/servers/31f51cbd-b29a-46be-bca0-f27c2b287e15 => generated 1466 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:07:56.982373 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-e2d09b01-aa23-4311-ab25-5818ce02faf8 tempest-ImagesOneServerTestJSON-1044295602 tempest-ImagesOneServerTestJSON-1044295602-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-image-55756241", "metadata": {"image_type": "test"}}} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:07:56.984975 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-e2d09b01-aa23-4311-ab25-5818ce02faf8 tempest-ImagesOneServerTestJSON-1044295602 tempest-ImagesOneServerTestJSON-1044295602-project] [instance: 31f51cbd-b29a-46be-bca0-f27c2b287e15] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:07:56.991142 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-e2d09b01-aa23-4311-ab25-5818ce02faf8 tempest-ImagesOneServerTestJSON-1044295602 tempest-ImagesOneServerTestJSON-1044295602-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:56.991760 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-e2d09b01-aa23-4311-ab25-5818ce02faf8 tempest-ImagesOneServerTestJSON-1044295602 tempest-ImagesOneServerTestJSON-1044295602-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:56.992273 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-e2d09b01-aa23-4311-ab25-5818ce02faf8 tempest-ImagesOneServerTestJSON-1044295602 tempest-ImagesOneServerTestJSON-1044295602-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:56.993211 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-e2d09b01-aa23-4311-ab25-5818ce02faf8 tempest-ImagesOneServerTestJSON-1044295602 tempest-ImagesOneServerTestJSON-1044295602-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:56.994255 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-e2d09b01-aa23-4311-ab25-5818ce02faf8 tempest-ImagesOneServerTestJSON-1044295602 tempest-ImagesOneServerTestJSON-1044295602-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:56.994757 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-e2d09b01-aa23-4311-ab25-5818ce02faf8 tempest-ImagesOneServerTestJSON-1044295602 tempest-ImagesOneServerTestJSON-1044295602-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:57.041856 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.quota [None req-e2d09b01-aa23-4311-ab25-5818ce02faf8 tempest-ImagesOneServerTestJSON-1044295602 tempest-ImagesOneServerTestJSON-1044295602-project] Getting quotas for project c548420d1df4403c9129cce5f040d45b. Resources: dict_keys(['metadata_items']) {{(pid=121403) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 01 19:07:57.048796 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.quota [None req-e2d09b01-aa23-4311-ab25-5818ce02faf8 tempest-ImagesOneServerTestJSON-1044295602 tempest-ImagesOneServerTestJSON-1044295602-project] Getting quotas for user ed6fd718964648e4bc83ed37cbaa9b84 and project c548420d1df4403c9129cce5f040d45b. Resources: dict_keys(['metadata_items']) {{(pid=121403) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 01 19:07:57.052885 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-9f9ec7c9-60e5-425b-89df-c5b5281c9bed tempest-ServerMetadataNegativeTestJSON-414983834 tempest-ServerMetadataNegativeTestJSON-414983834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aebd68d6b30e45debbfd99ee6360f905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd702a70dab124153b4f40d3219ffc5f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:07:57.061147 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-9f9ec7c9-60e5-425b-89df-c5b5281c9bed tempest-ServerMetadataNegativeTestJSON-414983834 tempest-ServerMetadataNegativeTestJSON-414983834-project] 10.222.0.13 "GET /compute/v2.1/servers/6bb5dbff-cdc7-4986-8606-cec948c9d28c" status: 200 len: 1323 microversion: 2.1 time: 0.188468 Nov 01 19:07:57.061996 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1630/3333] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:07:56 2022] GET /compute/v2.1/servers/6bb5dbff-cdc7-4986-8606-cec948c9d28c => generated 1323 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:07:57.062800 n-d-863052-2 devstack@n-api.service[121403]: DEBUG dbcounter [-] [121403] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=121403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 19:07:57.252610 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-e2d09b01-aa23-4311-ab25-5818ce02faf8 tempest-ImagesOneServerTestJSON-1044295602 tempest-ImagesOneServerTestJSON-1044295602-project] 10.222.0.13 "POST /compute/v2.1/servers/31f51cbd-b29a-46be-bca0-f27c2b287e15/action" status: 202 len: 0 microversion: 2.1 time: 0.274993 Nov 01 19:07:57.253354 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1704/3334] 10.222.0.13 () {60 vars in 1278 bytes} [Tue Nov 1 19:07:56 2022] POST /compute/v2.1/servers/31f51cbd-b29a-46be-bca0-f27c2b287e15/action => generated 0 bytes in 277 msecs (HTTP/1.1 202) 10 headers in 450 bytes (2 switches on core 0) Nov 01 19:07:57.264017 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-5609462a-c2ad-449a-8fe0-20a182eacdd8 tempest-ImagesOneServerTestJSON-1044295602 tempest-ImagesOneServerTestJSON-1044295602-project] Calling method '.version_select at 0x7f0ae2b72dc0>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:07:57.310861 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-5609462a-c2ad-449a-8fe0-20a182eacdd8 tempest-ImagesOneServerTestJSON-1044295602 tempest-ImagesOneServerTestJSON-1044295602-project] 10.222.0.13 "GET /compute/v2.1/images/621c9785-490d-4245-8b6b-91f8571f7eab" status: 200 len: 1422 microversion: 2.1 time: 0.050528 Nov 01 19:07:57.311880 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1631/3335] 10.222.0.13 () {58 vars in 1233 bytes} [Tue Nov 1 19:07:57 2022] GET /compute/v2.1/images/621c9785-490d-4245-8b6b-91f8571f7eab => generated 1422 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:07:57.615389 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-c3b9e0da-85e6-4add-8546-c412beb4aed4 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:07:57.616171 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-c3b9e0da-85e6-4add-8546-c412beb4aed4 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] [instance: f6fc44ea-8b27-4807-98b4-8b4b837a7ec3] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:07:57.624248 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-c3b9e0da-85e6-4add-8546-c412beb4aed4 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:57.624863 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-c3b9e0da-85e6-4add-8546-c412beb4aed4 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:57.625216 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-c3b9e0da-85e6-4add-8546-c412beb4aed4 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:57.626067 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-c3b9e0da-85e6-4add-8546-c412beb4aed4 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:57.626549 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-c3b9e0da-85e6-4add-8546-c412beb4aed4 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:57.627083 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-c3b9e0da-85e6-4add-8546-c412beb4aed4 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:57.643236 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.wsgi [None req-c3b9e0da-85e6-4add-8546-c412beb4aed4 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] HTTP exception thrown: Instance f6fc44ea-8b27-4807-98b4-8b4b837a7ec3 could not be found. Nov 01 19:07:57.645248 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-c3b9e0da-85e6-4add-8546-c412beb4aed4 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Request method failure captured: Nov 01 19:07:57.645248 n-d-863052-2 devstack@n-api.service[121403]: request: GET /compute/v2.1/servers/f6fc44ea-8b27-4807-98b4-8b4b837a7ec3 HTTP/1.1 Nov 01 19:07:57.645248 n-d-863052-2 devstack@n-api.service[121403]: Accept: application/json Nov 01 19:07:57.645248 n-d-863052-2 devstack@n-api.service[121403]: Accept-Encoding: identity Nov 01 19:07:57.645248 n-d-863052-2 devstack@n-api.service[121403]: Connection: close Nov 01 19:07:57.645248 n-d-863052-2 devstack@n-api.service[121403]: Content-Length: 0 Nov 01 19:07:57.645248 n-d-863052-2 devstack@n-api.service[121403]: Content-Type: application/json Nov 01 19:07:57.645248 n-d-863052-2 devstack@n-api.service[121403]: Host: 10.222.0.13 Nov 01 19:07:57.645248 n-d-863052-2 devstack@n-api.service[121403]: Openstack-System-Scope: None Nov 01 19:07:57.645248 n-d-863052-2 devstack@n-api.service[121403]: User-Agent: python-urllib3/1.26.12 Nov 01 19:07:57.645248 n-d-863052-2 devstack@n-api.service[121403]: X-Auth-Token: gAAAAABjYW4_RJI8gKBQs81ShXQrfTSIzrNvaZj2e2rGhpR5xhmtuxP4h5uZIl9SLPqPqJ9Syn39UO-el4mPnuEEOGnWtpNlTopD6-Pc1m-VWD64ggyrfBZwUB0hnjNvBvBk6ge071YBJx2gxTN_InEu4tuxz3s-3IQBbEpMSIJZ4VoUIbz4DgY Nov 01 19:07:57.645248 n-d-863052-2 devstack@n-api.service[121403]: X-Domain-Id: None Nov 01 19:07:57.645248 n-d-863052-2 devstack@n-api.service[121403]: X-Domain-Name: None Nov 01 19:07:57.645248 n-d-863052-2 devstack@n-api.service[121403]: X-Identity-Status: Confirmed Nov 01 19:07:57.645248 n-d-863052-2 devstack@n-api.service[121403]: X-Is-Admin-Project: True Nov 01 19:07:57.645248 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Domain-Id: default Nov 01 19:07:57.645248 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Domain-Name: Default Nov 01 19:07:57.645248 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Id: 851785a5f76548898a77d67792888504 Nov 01 19:07:57.645248 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Name: tempest-ServersTestJSON-917766486 Nov 01 19:07:57.645248 n-d-863052-2 devstack@n-api.service[121403]: X-Role: member,reader Nov 01 19:07:57.645248 n-d-863052-2 devstack@n-api.service[121403]: X-Roles: member,reader Nov 01 19:07:57.645248 n-d-863052-2 devstack@n-api.service[121403]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/851785a5f76548898a77d67792888504"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/851785a5f76548898a77d67792888504"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_851785a5f76548898a77d67792888504", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/851785a5f76548898a77d67792888504"}]}] Nov 01 19:07:57.645248 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant: tempest-ServersTestJSON-917766486 Nov 01 19:07:57.645248 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant-Id: 851785a5f76548898a77d67792888504 Nov 01 19:07:57.645248 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant-Name: tempest-ServersTestJSON-917766486 Nov 01 19:07:57.645248 n-d-863052-2 devstack@n-api.service[121403]: X-User: tempest-ServersTestJSON-917766486-project Nov 01 19:07:57.645248 n-d-863052-2 devstack@n-api.service[121403]: X-User-Domain-Id: default Nov 01 19:07:57.645248 n-d-863052-2 devstack@n-api.service[121403]: X-User-Domain-Name: Default Nov 01 19:07:57.645248 n-d-863052-2 devstack@n-api.service[121403]: X-User-Id: 113bd8c844ee490b86a68bc7e1e75da3 Nov 01 19:07:57.645248 n-d-863052-2 devstack@n-api.service[121403]: X-User-Name: tempest-ServersTestJSON-917766486-project Nov 01 19:07:57.645248 n-d-863052-2 devstack@n-api.service[121403]: method: > Nov 01 19:07:57.645248 n-d-863052-2 devstack@n-api.service[121403]: exception: Instance f6fc44ea-8b27-4807-98b4-8b4b837a7ec3 could not be found. Nov 01 19:07:57.645248 n-d-863052-2 devstack@n-api.service[121403]: action_args: {'id': 'f6fc44ea-8b27-4807-98b4-8b4b837a7ec3'} Nov 01 19:07:57.645248 n-d-863052-2 devstack@n-api.service[121403]: {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 01 19:07:57.645248 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:07:57.645248 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 01 19:07:57.645248 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 01 19:07:57.645248 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 01 19:07:57.645248 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 01 19:07:57.645248 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 01 19:07:57.645248 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 01 19:07:57.645248 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 01 19:07:57.645248 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 01 19:07:57.645248 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f6fc44ea-8b27-4807-98b4-8b4b837a7ec3 could not be found. Nov 01 19:07:57.645248 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:07:57.645248 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:07:57.645248 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:07:57.645248 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:07:57.645248 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:07:57.645248 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:07:57.645248 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 01 19:07:57.645248 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 01 19:07:57.645248 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 01 19:07:57.645248 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 01 19:07:57.645248 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 01 19:07:57.645248 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 01 19:07:57.645248 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 01 19:07:57.645248 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 01 19:07:57.645248 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 01 19:07:57.645248 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 01 19:07:57.645248 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f6fc44ea-8b27-4807-98b4-8b4b837a7ec3 could not be found. Nov 01 19:07:57.645248 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:07:57.645248 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:07:57.645248 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:07:57.645248 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:07:57.652534 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:07:57.652534 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:07:57.652534 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 01 19:07:57.652534 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 01 19:07:57.652534 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f6fc44ea-8b27-4807-98b4-8b4b837a7ec3 could not be found. Nov 01 19:07:57.652534 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:07:57.652534 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-c3b9e0da-85e6-4add-8546-c412beb4aed4 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Returning 404 to user: Instance f6fc44ea-8b27-4807-98b4-8b4b837a7ec3 could not be found. {{(pid=121403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 01 19:07:57.652534 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-c3b9e0da-85e6-4add-8546-c412beb4aed4 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] 10.222.0.13 "GET /compute/v2.1/servers/f6fc44ea-8b27-4807-98b4-8b4b837a7ec3" status: 404 len: 111 microversion: 2.1 time: 0.036789 Nov 01 19:07:57.652534 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1705/3336] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:07:57 2022] GET /compute/v2.1/servers/f6fc44ea-8b27-4807-98b4-8b4b837a7ec3 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 01 19:07:57.657689 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-df72dcc2-e7ac-4da9-acc1-7f01b2542ec8 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Calling method '.version_select at 0x7f0ae2b3bf70>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:07:57.682882 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-df72dcc2-e7ac-4da9-acc1-7f01b2542ec8 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-key-512482528" status: 202 len: 0 microversion: 2.1 time: 0.029886 Nov 01 19:07:57.683971 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1632/3337] 10.222.0.13 () {58 vars in 1206 bytes} [Tue Nov 1 19:07:57 2022] DELETE /compute/v2.1/os-keypairs/tempest-key-512482528 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 01 19:07:57.721816 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-6f28d220-be8d-47f1-93a3-7206089e8d29 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:07:57.722461 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-6f28d220-be8d-47f1-93a3-7206089e8d29 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] [instance: 8485db2a-fd8f-4615-bbe0-14822ad44194] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:07:57.729325 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-6f28d220-be8d-47f1-93a3-7206089e8d29 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:57.729859 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-6f28d220-be8d-47f1-93a3-7206089e8d29 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:57.730328 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-6f28d220-be8d-47f1-93a3-7206089e8d29 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:57.731081 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-6f28d220-be8d-47f1-93a3-7206089e8d29 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:57.731562 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-6f28d220-be8d-47f1-93a3-7206089e8d29 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:57.731994 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-6f28d220-be8d-47f1-93a3-7206089e8d29 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:57.824315 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-72f0a134-3792-46e4-9038-553644a4aa29 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1127871838", "imageRef": "2d4a0047-1b9e-445f-8af8-1b5c9d93e881", "flavorRef": "452", "networks": [{"uuid": "346d9303-d6bc-4555-85be-95ee31a2d9cd"}]}} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:07:57.892941 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.network.neutron [None req-72f0a134-3792-46e4-9038-553644a4aa29 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] validate_networks() for [('346d9303-d6bc-4555-85be-95ee31a2d9cd', None, None, None, None, None)] {{(pid=121402) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 01 19:07:57.940686 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-6f28d220-be8d-47f1-93a3-7206089e8d29 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '058480d92c9b4ab4af6815d0438a65c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee9dc49b89143f781e4ab30296e4d01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:07:57.951513 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-6f28d220-be8d-47f1-93a3-7206089e8d29 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] 10.222.0.13 "GET /compute/v2.1/servers/8485db2a-fd8f-4615-bbe0-14822ad44194" status: 200 len: 1315 microversion: 2.1 time: 0.234688 Nov 01 19:07:57.952923 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1706/3338] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:07:57 2022] GET /compute/v2.1/servers/8485db2a-fd8f-4615-bbe0-14822ad44194 => generated 1315 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:07:57.990936 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-9eff5ab7-a5aa-4648-95e4-6237d20c9474 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:07:57.996077 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-9eff5ab7-a5aa-4648-95e4-6237d20c9474 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] [instance: 3029f3c1-4f32-4f6b-963c-16f65b6dff3c] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:07:58.009962 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-9eff5ab7-a5aa-4648-95e4-6237d20c9474 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:58.011166 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-9eff5ab7-a5aa-4648-95e4-6237d20c9474 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:58.011932 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-9eff5ab7-a5aa-4648-95e4-6237d20c9474 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:58.012777 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-9eff5ab7-a5aa-4648-95e4-6237d20c9474 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:58.013332 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-9eff5ab7-a5aa-4648-95e4-6237d20c9474 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:58.014459 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-9eff5ab7-a5aa-4648-95e4-6237d20c9474 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:58.055377 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-9eff5ab7-a5aa-4648-95e4-6237d20c9474 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] 10.222.0.13 "GET /compute/v2.1/servers/3029f3c1-4f32-4f6b-963c-16f65b6dff3c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.101146 Nov 01 19:07:58.055997 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1707/3339] 10.222.0.13 () {58 vars in 1302 bytes} [Tue Nov 1 19:07:57 2022] GET /compute/v2.1/servers/3029f3c1-4f32-4f6b-963c-16f65b6dff3c/os-volume_attachments => generated 25 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 01 19:07:58.087418 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-a35c1fa4-86ac-4ae5-921c-b6a8ac783b57 tempest-ServerMetadataNegativeTestJSON-414983834 tempest-ServerMetadataNegativeTestJSON-414983834-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:07:58.088268 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-a35c1fa4-86ac-4ae5-921c-b6a8ac783b57 tempest-ServerMetadataNegativeTestJSON-414983834 tempest-ServerMetadataNegativeTestJSON-414983834-project] [instance: 6bb5dbff-cdc7-4986-8606-cec948c9d28c] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:07:58.098000 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-a35c1fa4-86ac-4ae5-921c-b6a8ac783b57 tempest-ServerMetadataNegativeTestJSON-414983834 tempest-ServerMetadataNegativeTestJSON-414983834-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:58.099440 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-a35c1fa4-86ac-4ae5-921c-b6a8ac783b57 tempest-ServerMetadataNegativeTestJSON-414983834 tempest-ServerMetadataNegativeTestJSON-414983834-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:58.099853 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-a35c1fa4-86ac-4ae5-921c-b6a8ac783b57 tempest-ServerMetadataNegativeTestJSON-414983834 tempest-ServerMetadataNegativeTestJSON-414983834-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:58.100729 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-a35c1fa4-86ac-4ae5-921c-b6a8ac783b57 tempest-ServerMetadataNegativeTestJSON-414983834 tempest-ServerMetadataNegativeTestJSON-414983834-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:58.101592 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-a35c1fa4-86ac-4ae5-921c-b6a8ac783b57 tempest-ServerMetadataNegativeTestJSON-414983834 tempest-ServerMetadataNegativeTestJSON-414983834-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:58.102066 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-a35c1fa4-86ac-4ae5-921c-b6a8ac783b57 tempest-ServerMetadataNegativeTestJSON-414983834 tempest-ServerMetadataNegativeTestJSON-414983834-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:58.301639 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-a35c1fa4-86ac-4ae5-921c-b6a8ac783b57 tempest-ServerMetadataNegativeTestJSON-414983834 tempest-ServerMetadataNegativeTestJSON-414983834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aebd68d6b30e45debbfd99ee6360f905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd702a70dab124153b4f40d3219ffc5f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:07:58.310629 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-a35c1fa4-86ac-4ae5-921c-b6a8ac783b57 tempest-ServerMetadataNegativeTestJSON-414983834 tempest-ServerMetadataNegativeTestJSON-414983834-project] 10.222.0.13 "GET /compute/v2.1/servers/6bb5dbff-cdc7-4986-8606-cec948c9d28c" status: 200 len: 1323 microversion: 2.1 time: 0.229179 Nov 01 19:07:58.311210 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1708/3340] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:07:58 2022] GET /compute/v2.1/servers/6bb5dbff-cdc7-4986-8606-cec948c9d28c => generated 1323 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 19:07:58.330911 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-4a63d805-5f32-40c2-8805-3d7bed1ececb tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:07:58.331848 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-4a63d805-5f32-40c2-8805-3d7bed1ececb tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] [instance: 3029f3c1-4f32-4f6b-963c-16f65b6dff3c] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:07:58.339116 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-4a63d805-5f32-40c2-8805-3d7bed1ececb tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:58.339954 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-4a63d805-5f32-40c2-8805-3d7bed1ececb tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:58.340572 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-4a63d805-5f32-40c2-8805-3d7bed1ececb tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:58.341546 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-4a63d805-5f32-40c2-8805-3d7bed1ececb tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:58.342455 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-4a63d805-5f32-40c2-8805-3d7bed1ececb tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:58.343280 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-4a63d805-5f32-40c2-8805-3d7bed1ececb tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:58.379441 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-4a63d805-5f32-40c2-8805-3d7bed1ececb tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] [instance: 3029f3c1-4f32-4f6b-963c-16f65b6dff3c] Going to try to terminate instance {{(pid=121403) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 01 19:07:58.437680 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.virt.hardware [None req-72f0a134-3792-46e4-9038-553644a4aa29 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Flavor limits 0:0:0 {{(pid=121402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 01 19:07:58.438313 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.virt.hardware [None req-72f0a134-3792-46e4-9038-553644a4aa29 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Image limits 0:0:0 {{(pid=121402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 01 19:07:58.438797 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.virt.hardware [None req-72f0a134-3792-46e4-9038-553644a4aa29 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Flavor pref 0:0:0 {{(pid=121402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 01 19:07:58.439242 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.virt.hardware [None req-72f0a134-3792-46e4-9038-553644a4aa29 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Image pref 0:0:0 {{(pid=121402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 01 19:07:58.439635 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.virt.hardware [None req-72f0a134-3792-46e4-9038-553644a4aa29 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 01 19:07:58.450042 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-72f0a134-3792-46e4-9038-553644a4aa29 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:58.450530 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-72f0a134-3792-46e4-9038-553644a4aa29 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:58.451170 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-72f0a134-3792-46e4-9038-553644a4aa29 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:58.451957 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-72f0a134-3792-46e4-9038-553644a4aa29 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:58.452369 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-72f0a134-3792-46e4-9038-553644a4aa29 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:58.452900 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-72f0a134-3792-46e4-9038-553644a4aa29 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:58.473004 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.quota [None req-72f0a134-3792-46e4-9038-553644a4aa29 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Getting quotas for project 851785a5f76548898a77d67792888504. Resources: {'cores', 'ram', 'instances'} {{(pid=121402) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 01 19:07:58.479892 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.quota [None req-72f0a134-3792-46e4-9038-553644a4aa29 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Getting quotas for user 113bd8c844ee490b86a68bc7e1e75da3 and project 851785a5f76548898a77d67792888504. Resources: {'cores', 'ram', 'instances'} {{(pid=121402) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 01 19:07:58.497515 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-72f0a134-3792-46e4-9038-553644a4aa29 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Going to run 1 instances... {{(pid=121402) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 01 19:07:58.500264 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-72f0a134-3792-46e4-9038-553644a4aa29 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] [instance: 7c9dac18-3bfc-4379-ab97-25d185cd6b85] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2d4a0047-1b9e-445f-8af8-1b5c9d93e881',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121402) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 01 19:07:58.521482 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-4a63d805-5f32-40c2-8805-3d7bed1ececb tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] 10.222.0.13 "DELETE /compute/v2.1/servers/3029f3c1-4f32-4f6b-963c-16f65b6dff3c" status: 204 len: 0 microversion: 2.1 time: 0.208210 Nov 01 19:07:58.523060 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1709/3341] 10.222.0.13 () {58 vars in 1239 bytes} [Tue Nov 1 19:07:58 2022] DELETE /compute/v2.1/servers/3029f3c1-4f32-4f6b-963c-16f65b6dff3c => generated 0 bytes in 211 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 01 19:07:58.541189 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-9d3c5c7e-f7d1-441f-be0c-6be7d10ee661 tempest-ImagesOneServerTestJSON-1044295602 tempest-ImagesOneServerTestJSON-1044295602-project] Calling method '.version_select at 0x7f0ae67ffaf0>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:07:58.570722 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-72f0a134-3792-46e4-9038-553644a4aa29 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.751666 Nov 01 19:07:58.571663 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1633/3342] 10.222.0.13 () {60 vars in 1147 bytes} [Tue Nov 1 19:07:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 754 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Nov 01 19:07:58.576957 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-78041a5d-9072-496f-bf64-598fa2e51991 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:07:58.577952 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-78041a5d-9072-496f-bf64-598fa2e51991 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] [instance: 3029f3c1-4f32-4f6b-963c-16f65b6dff3c] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:07:58.586656 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-78041a5d-9072-496f-bf64-598fa2e51991 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:58.587460 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-78041a5d-9072-496f-bf64-598fa2e51991 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:58.588294 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-78041a5d-9072-496f-bf64-598fa2e51991 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:58.589299 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-78041a5d-9072-496f-bf64-598fa2e51991 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:58.589972 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-78041a5d-9072-496f-bf64-598fa2e51991 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:58.590833 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-78041a5d-9072-496f-bf64-598fa2e51991 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:58.652389 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-9d3c5c7e-f7d1-441f-be0c-6be7d10ee661 tempest-ImagesOneServerTestJSON-1044295602 tempest-ImagesOneServerTestJSON-1044295602-project] 10.222.0.13 "GET /compute/v2.1/images/621c9785-490d-4245-8b6b-91f8571f7eab" status: 200 len: 1422 microversion: 2.1 time: 0.117358 Nov 01 19:07:58.654048 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1710/3343] 10.222.0.13 () {58 vars in 1233 bytes} [Tue Nov 1 19:07:58 2022] GET /compute/v2.1/images/621c9785-490d-4245-8b6b-91f8571f7eab => generated 1422 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:07:58.659245 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-c094a8a1-624c-4119-a61b-3aeb5a5b9b81 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:07:58.661690 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-c094a8a1-624c-4119-a61b-3aeb5a5b9b81 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] [instance: 7c9dac18-3bfc-4379-ab97-25d185cd6b85] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:07:58.732203 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-c094a8a1-624c-4119-a61b-3aeb5a5b9b81 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113bd8c844ee490b86a68bc7e1e75da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '851785a5f76548898a77d67792888504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:07:58.750832 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-c094a8a1-624c-4119-a61b-3aeb5a5b9b81 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] 10.222.0.13 "GET /compute/v2.1/servers/7c9dac18-3bfc-4379-ab97-25d185cd6b85" status: 200 len: 1209 microversion: 2.1 time: 0.095407 Nov 01 19:07:58.753037 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1711/3344] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:07:58 2022] GET /compute/v2.1/servers/7c9dac18-3bfc-4379-ab97-25d185cd6b85 => generated 1209 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:07:58.760761 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [req-44b74024-9771-4fcf-ba2c-8072bc3833b5 req-a6740ed3-c530-4839-bc48-baab19914933 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6bb5dbff-cdc7-4986-8606-cec948c9d28c", "name": "network-vif-plugged", "status": "completed", "tag": "253432d3-6714-43d0-8c66-5ccffded0825"}]} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:07:58.787055 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-44b74024-9771-4fcf-ba2c-8072bc3833b5 req-a6740ed3-c530-4839-bc48-baab19914933 service nova] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:58.787554 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-44b74024-9771-4fcf-ba2c-8072bc3833b5 req-a6740ed3-c530-4839-bc48-baab19914933 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:58.788689 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-44b74024-9771-4fcf-ba2c-8072bc3833b5 req-a6740ed3-c530-4839-bc48-baab19914933 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:58.806266 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-78041a5d-9072-496f-bf64-598fa2e51991 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '790f3f1566b7464aaca19d4d05c0942e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33e3d319293c46b6af2f728a50586906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:07:58.809942 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.compute.server_external_events [req-44b74024-9771-4fcf-ba2c-8072bc3833b5 req-a6740ed3-c530-4839-bc48-baab19914933 service nova] Creating event network-vif-plugged:253432d3-6714-43d0-8c66-5ccffded0825 for instance 6bb5dbff-cdc7-4986-8606-cec948c9d28c on n-h1-863052-2 Nov 01 19:07:58.817550 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [req-44b74024-9771-4fcf-ba2c-8072bc3833b5 req-a6740ed3-c530-4839-bc48-baab19914933 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060779 Nov 01 19:07:58.818257 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-78041a5d-9072-496f-bf64-598fa2e51991 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] 10.222.0.13 "GET /compute/v2.1/servers/3029f3c1-4f32-4f6b-963c-16f65b6dff3c" status: 200 len: 1680 microversion: 2.1 time: 0.245055 Nov 01 19:07:58.818747 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1712/3345] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Nov 1 19:07:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:07:58.819017 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1634/3346] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:07:58 2022] GET /compute/v2.1/servers/3029f3c1-4f32-4f6b-963c-16f65b6dff3c => generated 1680 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:07:58.978123 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-c63e04fb-cb53-4691-aac7-23cd6e39edf9 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:07:58.978851 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-c63e04fb-cb53-4691-aac7-23cd6e39edf9 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] [instance: 8485db2a-fd8f-4615-bbe0-14822ad44194] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:07:58.987153 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-c63e04fb-cb53-4691-aac7-23cd6e39edf9 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:58.988387 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-c63e04fb-cb53-4691-aac7-23cd6e39edf9 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:58.989017 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-c63e04fb-cb53-4691-aac7-23cd6e39edf9 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:58.989775 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-c63e04fb-cb53-4691-aac7-23cd6e39edf9 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:58.990322 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-c63e04fb-cb53-4691-aac7-23cd6e39edf9 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:58.990907 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-c63e04fb-cb53-4691-aac7-23cd6e39edf9 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:59.133279 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-c63e04fb-cb53-4691-aac7-23cd6e39edf9 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '058480d92c9b4ab4af6815d0438a65c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee9dc49b89143f781e4ab30296e4d01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:07:59.141785 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-c63e04fb-cb53-4691-aac7-23cd6e39edf9 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] 10.222.0.13 "GET /compute/v2.1/servers/8485db2a-fd8f-4615-bbe0-14822ad44194" status: 200 len: 1502 microversion: 2.1 time: 0.168679 Nov 01 19:07:59.146661 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1713/3347] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:07:58 2022] GET /compute/v2.1/servers/8485db2a-fd8f-4615-bbe0-14822ad44194 => generated 1502 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:07:59.165783 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-66c3813c-d653-4f6b-ab5a-de06e30da3da tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:07:59.166348 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-66c3813c-d653-4f6b-ab5a-de06e30da3da tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] [instance: 8485db2a-fd8f-4615-bbe0-14822ad44194] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:07:59.172476 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-66c3813c-d653-4f6b-ab5a-de06e30da3da tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:59.172928 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-66c3813c-d653-4f6b-ab5a-de06e30da3da tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:59.173366 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-66c3813c-d653-4f6b-ab5a-de06e30da3da tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:59.174033 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-66c3813c-d653-4f6b-ab5a-de06e30da3da tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:59.174507 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-66c3813c-d653-4f6b-ab5a-de06e30da3da tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:59.175264 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-66c3813c-d653-4f6b-ab5a-de06e30da3da tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:59.202654 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.objects.instance [None req-66c3813c-d653-4f6b-ab5a-de06e30da3da tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lazy-loading 'flavor' on Instance uuid 8485db2a-fd8f-4615-bbe0-14822ad44194 {{(pid=121402) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 01 19:07:59.338240 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-4d2b2cf4-a296-4179-b873-7a2b3a77f9d5 tempest-ServerMetadataNegativeTestJSON-414983834 tempest-ServerMetadataNegativeTestJSON-414983834-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:07:59.338963 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-4d2b2cf4-a296-4179-b873-7a2b3a77f9d5 tempest-ServerMetadataNegativeTestJSON-414983834 tempest-ServerMetadataNegativeTestJSON-414983834-project] [instance: 6bb5dbff-cdc7-4986-8606-cec948c9d28c] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:07:59.345511 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-4d2b2cf4-a296-4179-b873-7a2b3a77f9d5 tempest-ServerMetadataNegativeTestJSON-414983834 tempest-ServerMetadataNegativeTestJSON-414983834-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:59.345994 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-4d2b2cf4-a296-4179-b873-7a2b3a77f9d5 tempest-ServerMetadataNegativeTestJSON-414983834 tempest-ServerMetadataNegativeTestJSON-414983834-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:59.346430 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-4d2b2cf4-a296-4179-b873-7a2b3a77f9d5 tempest-ServerMetadataNegativeTestJSON-414983834 tempest-ServerMetadataNegativeTestJSON-414983834-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:59.347151 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-4d2b2cf4-a296-4179-b873-7a2b3a77f9d5 tempest-ServerMetadataNegativeTestJSON-414983834 tempest-ServerMetadataNegativeTestJSON-414983834-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:59.347736 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-4d2b2cf4-a296-4179-b873-7a2b3a77f9d5 tempest-ServerMetadataNegativeTestJSON-414983834 tempest-ServerMetadataNegativeTestJSON-414983834-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:59.348171 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-4d2b2cf4-a296-4179-b873-7a2b3a77f9d5 tempest-ServerMetadataNegativeTestJSON-414983834 tempest-ServerMetadataNegativeTestJSON-414983834-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:59.394238 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-66c3813c-d653-4f6b-ab5a-de06e30da3da tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] 10.222.0.13 "POST /compute/v2.1/servers/8485db2a-fd8f-4615-bbe0-14822ad44194/action" status: 202 len: 0 microversion: 2.1 time: 0.233238 Nov 01 19:07:59.395235 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1635/3348] 10.222.0.13 () {60 vars in 1278 bytes} [Tue Nov 1 19:07:59 2022] POST /compute/v2.1/servers/8485db2a-fd8f-4615-bbe0-14822ad44194/action => generated 0 bytes in 235 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 01 19:07:59.404408 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-d2f59be7-bc19-49cc-9a9b-538e4fdf0760 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:07:59.405249 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-d2f59be7-bc19-49cc-9a9b-538e4fdf0760 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] [instance: 8485db2a-fd8f-4615-bbe0-14822ad44194] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:07:59.412282 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-d2f59be7-bc19-49cc-9a9b-538e4fdf0760 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:59.413213 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-d2f59be7-bc19-49cc-9a9b-538e4fdf0760 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:59.413984 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-d2f59be7-bc19-49cc-9a9b-538e4fdf0760 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:59.414898 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-d2f59be7-bc19-49cc-9a9b-538e4fdf0760 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:59.416321 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-d2f59be7-bc19-49cc-9a9b-538e4fdf0760 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:59.416943 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-d2f59be7-bc19-49cc-9a9b-538e4fdf0760 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:59.512182 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-4d2b2cf4-a296-4179-b873-7a2b3a77f9d5 tempest-ServerMetadataNegativeTestJSON-414983834 tempest-ServerMetadataNegativeTestJSON-414983834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aebd68d6b30e45debbfd99ee6360f905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd702a70dab124153b4f40d3219ffc5f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:07:59.520298 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-4d2b2cf4-a296-4179-b873-7a2b3a77f9d5 tempest-ServerMetadataNegativeTestJSON-414983834 tempest-ServerMetadataNegativeTestJSON-414983834-project] 10.222.0.13 "GET /compute/v2.1/servers/6bb5dbff-cdc7-4986-8606-cec948c9d28c" status: 200 len: 1323 microversion: 2.1 time: 0.186560 Nov 01 19:07:59.530722 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1714/3349] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:07:59 2022] GET /compute/v2.1/servers/6bb5dbff-cdc7-4986-8606-cec948c9d28c => generated 1323 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 19:07:59.564043 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-d2f59be7-bc19-49cc-9a9b-538e4fdf0760 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '058480d92c9b4ab4af6815d0438a65c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee9dc49b89143f781e4ab30296e4d01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:07:59.572224 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-d2f59be7-bc19-49cc-9a9b-538e4fdf0760 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] 10.222.0.13 "GET /compute/v2.1/servers/8485db2a-fd8f-4615-bbe0-14822ad44194" status: 200 len: 1508 microversion: 2.1 time: 0.172887 Nov 01 19:07:59.572966 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1636/3350] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:07:59 2022] GET /compute/v2.1/servers/8485db2a-fd8f-4615-bbe0-14822ad44194 => generated 1508 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 19:07:59.669362 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-ce658963-3eea-4dfb-b224-c3473ed2d3d9 tempest-ImagesOneServerTestJSON-1044295602 tempest-ImagesOneServerTestJSON-1044295602-project] Calling method '.version_select at 0x7f0ae1ccf310>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:07:59.715309 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-ce658963-3eea-4dfb-b224-c3473ed2d3d9 tempest-ImagesOneServerTestJSON-1044295602 tempest-ImagesOneServerTestJSON-1044295602-project] 10.222.0.13 "GET /compute/v2.1/images/621c9785-490d-4245-8b6b-91f8571f7eab" status: 200 len: 1422 microversion: 2.1 time: 0.050469 Nov 01 19:07:59.715884 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1715/3351] 10.222.0.13 () {58 vars in 1233 bytes} [Tue Nov 1 19:07:59 2022] GET /compute/v2.1/images/621c9785-490d-4245-8b6b-91f8571f7eab => generated 1422 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:07:59.778150 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-8c881041-2b47-4520-828a-c040a6ca869e tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:07:59.778758 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-8c881041-2b47-4520-828a-c040a6ca869e tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] [instance: 7c9dac18-3bfc-4379-ab97-25d185cd6b85] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:07:59.785575 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-8c881041-2b47-4520-828a-c040a6ca869e tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:59.786061 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-8c881041-2b47-4520-828a-c040a6ca869e tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:59.786496 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-8c881041-2b47-4520-828a-c040a6ca869e tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:59.787290 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-8c881041-2b47-4520-828a-c040a6ca869e tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:59.787791 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-8c881041-2b47-4520-828a-c040a6ca869e tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:59.788273 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-8c881041-2b47-4520-828a-c040a6ca869e tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:59.845950 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-0b1916b7-4716-4940-a2d8-f03b1ebfbd83 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:07:59.846861 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-0b1916b7-4716-4940-a2d8-f03b1ebfbd83 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] [instance: 3029f3c1-4f32-4f6b-963c-16f65b6dff3c] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:07:59.854905 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-0b1916b7-4716-4940-a2d8-f03b1ebfbd83 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:59.855897 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-0b1916b7-4716-4940-a2d8-f03b1ebfbd83 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:59.857046 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-0b1916b7-4716-4940-a2d8-f03b1ebfbd83 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:59.858024 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-0b1916b7-4716-4940-a2d8-f03b1ebfbd83 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:07:59.858760 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-0b1916b7-4716-4940-a2d8-f03b1ebfbd83 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:07:59.859957 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-0b1916b7-4716-4940-a2d8-f03b1ebfbd83 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:07:59.884996 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-8c881041-2b47-4520-828a-c040a6ca869e tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113bd8c844ee490b86a68bc7e1e75da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '851785a5f76548898a77d67792888504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:07:59.886017 n-d-863052-2 devstack@n-api.service[121403]: DEBUG dbcounter [-] [121403] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=121403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 19:07:59.894891 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-8c881041-2b47-4520-828a-c040a6ca869e tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] 10.222.0.13 "GET /compute/v2.1/servers/7c9dac18-3bfc-4379-ab97-25d185cd6b85" status: 200 len: 1213 microversion: 2.1 time: 0.121030 Nov 01 19:07:59.896099 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1637/3352] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:07:59 2022] GET /compute/v2.1/servers/7c9dac18-3bfc-4379-ab97-25d185cd6b85 => generated 1213 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:08:00.042001 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-0b1916b7-4716-4940-a2d8-f03b1ebfbd83 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '790f3f1566b7464aaca19d4d05c0942e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33e3d319293c46b6af2f728a50586906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:08:00.050909 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-0b1916b7-4716-4940-a2d8-f03b1ebfbd83 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] 10.222.0.13 "GET /compute/v2.1/servers/3029f3c1-4f32-4f6b-963c-16f65b6dff3c" status: 200 len: 1680 microversion: 2.1 time: 0.211246 Nov 01 19:08:00.059944 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1716/3353] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:07:59 2022] GET /compute/v2.1/servers/3029f3c1-4f32-4f6b-963c-16f65b6dff3c => generated 1680 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:08:00.545140 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-37c5de8c-1111-4476-a858-a0a0f23cd8c6 tempest-ServerMetadataNegativeTestJSON-414983834 tempest-ServerMetadataNegativeTestJSON-414983834-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:08:00.545952 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-37c5de8c-1111-4476-a858-a0a0f23cd8c6 tempest-ServerMetadataNegativeTestJSON-414983834 tempest-ServerMetadataNegativeTestJSON-414983834-project] [instance: 6bb5dbff-cdc7-4986-8606-cec948c9d28c] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:08:00.553257 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-37c5de8c-1111-4476-a858-a0a0f23cd8c6 tempest-ServerMetadataNegativeTestJSON-414983834 tempest-ServerMetadataNegativeTestJSON-414983834-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:08:00.554019 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-37c5de8c-1111-4476-a858-a0a0f23cd8c6 tempest-ServerMetadataNegativeTestJSON-414983834 tempest-ServerMetadataNegativeTestJSON-414983834-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:08:00.554652 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-37c5de8c-1111-4476-a858-a0a0f23cd8c6 tempest-ServerMetadataNegativeTestJSON-414983834 tempest-ServerMetadataNegativeTestJSON-414983834-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:08:00.555630 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-37c5de8c-1111-4476-a858-a0a0f23cd8c6 tempest-ServerMetadataNegativeTestJSON-414983834 tempest-ServerMetadataNegativeTestJSON-414983834-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:08:00.556296 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-37c5de8c-1111-4476-a858-a0a0f23cd8c6 tempest-ServerMetadataNegativeTestJSON-414983834 tempest-ServerMetadataNegativeTestJSON-414983834-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:08:00.556748 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-37c5de8c-1111-4476-a858-a0a0f23cd8c6 tempest-ServerMetadataNegativeTestJSON-414983834 tempest-ServerMetadataNegativeTestJSON-414983834-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:08:00.595739 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-de4a9d96-5061-49b1-8db7-362cfa04763e tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:08:00.596674 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-de4a9d96-5061-49b1-8db7-362cfa04763e tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] [instance: 8485db2a-fd8f-4615-bbe0-14822ad44194] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:08:00.604082 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-de4a9d96-5061-49b1-8db7-362cfa04763e tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:08:00.604951 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-de4a9d96-5061-49b1-8db7-362cfa04763e tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:08:00.605498 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-de4a9d96-5061-49b1-8db7-362cfa04763e tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:08:00.606429 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-de4a9d96-5061-49b1-8db7-362cfa04763e tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:08:00.618783 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-de4a9d96-5061-49b1-8db7-362cfa04763e tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:08:00.619355 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-de4a9d96-5061-49b1-8db7-362cfa04763e tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:08:00.727547 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-37c5de8c-1111-4476-a858-a0a0f23cd8c6 tempest-ServerMetadataNegativeTestJSON-414983834 tempest-ServerMetadataNegativeTestJSON-414983834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aebd68d6b30e45debbfd99ee6360f905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd702a70dab124153b4f40d3219ffc5f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:08:00.736333 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-37c5de8c-1111-4476-a858-a0a0f23cd8c6 tempest-ServerMetadataNegativeTestJSON-414983834 tempest-ServerMetadataNegativeTestJSON-414983834-project] 10.222.0.13 "GET /compute/v2.1/servers/6bb5dbff-cdc7-4986-8606-cec948c9d28c" status: 200 len: 1323 microversion: 2.1 time: 0.196473 Nov 01 19:08:00.737352 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1638/3354] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:08:00 2022] GET /compute/v2.1/servers/6bb5dbff-cdc7-4986-8606-cec948c9d28c => generated 1323 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:08:00.742846 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-1de17c7e-08d7-442e-b7bb-958cae7cadc2 tempest-ImagesOneServerTestJSON-1044295602 tempest-ImagesOneServerTestJSON-1044295602-project] Calling method '.version_select at 0x7f0ae1944b80>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:08:00.794872 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-1de17c7e-08d7-442e-b7bb-958cae7cadc2 tempest-ImagesOneServerTestJSON-1044295602 tempest-ImagesOneServerTestJSON-1044295602-project] 10.222.0.13 "GET /compute/v2.1/images/621c9785-490d-4245-8b6b-91f8571f7eab" status: 200 len: 1422 microversion: 2.1 time: 0.056226 Nov 01 19:08:00.795548 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1639/3355] 10.222.0.13 () {58 vars in 1233 bytes} [Tue Nov 1 19:08:00 2022] GET /compute/v2.1/images/621c9785-490d-4245-8b6b-91f8571f7eab => generated 1422 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:08:00.894760 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-de4a9d96-5061-49b1-8db7-362cfa04763e tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '058480d92c9b4ab4af6815d0438a65c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee9dc49b89143f781e4ab30296e4d01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:08:00.904457 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-de4a9d96-5061-49b1-8db7-362cfa04763e tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] 10.222.0.13 "GET /compute/v2.1/servers/8485db2a-fd8f-4615-bbe0-14822ad44194" status: 200 len: 1508 microversion: 2.1 time: 0.312791 Nov 01 19:08:00.907284 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1717/3356] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:08:00 2022] GET /compute/v2.1/servers/8485db2a-fd8f-4615-bbe0-14822ad44194 => generated 1508 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 19:08:00.927041 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-d1795186-60e2-47a9-86c8-16fd8947721e tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:08:00.928025 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-d1795186-60e2-47a9-86c8-16fd8947721e tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] [instance: 7c9dac18-3bfc-4379-ab97-25d185cd6b85] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:08:00.936169 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-d1795186-60e2-47a9-86c8-16fd8947721e tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:08:00.937224 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-d1795186-60e2-47a9-86c8-16fd8947721e tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:08:00.938312 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-d1795186-60e2-47a9-86c8-16fd8947721e tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:08:00.939271 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-d1795186-60e2-47a9-86c8-16fd8947721e tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:08:00.939911 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-d1795186-60e2-47a9-86c8-16fd8947721e tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:08:00.940505 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-d1795186-60e2-47a9-86c8-16fd8947721e tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:08:01.026605 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-d1795186-60e2-47a9-86c8-16fd8947721e tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113bd8c844ee490b86a68bc7e1e75da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '851785a5f76548898a77d67792888504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:08:01.034525 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-d1795186-60e2-47a9-86c8-16fd8947721e tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] 10.222.0.13 "GET /compute/v2.1/servers/7c9dac18-3bfc-4379-ab97-25d185cd6b85" status: 200 len: 1261 microversion: 2.1 time: 0.113420 Nov 01 19:08:01.045539 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1640/3357] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:08:00 2022] GET /compute/v2.1/servers/7c9dac18-3bfc-4379-ab97-25d185cd6b85 => generated 1261 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:08:01.076291 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-86434681-4c85-4c68-bcff-e11693f80c9e tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:08:01.077396 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-86434681-4c85-4c68-bcff-e11693f80c9e tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] [instance: 3029f3c1-4f32-4f6b-963c-16f65b6dff3c] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:08:01.085360 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-86434681-4c85-4c68-bcff-e11693f80c9e tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:08:01.092118 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-86434681-4c85-4c68-bcff-e11693f80c9e tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:08:01.092781 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-86434681-4c85-4c68-bcff-e11693f80c9e tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:08:01.093672 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-86434681-4c85-4c68-bcff-e11693f80c9e tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:08:01.094236 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-86434681-4c85-4c68-bcff-e11693f80c9e tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:08:01.095068 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-86434681-4c85-4c68-bcff-e11693f80c9e tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:08:01.191677 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-86434681-4c85-4c68-bcff-e11693f80c9e tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '790f3f1566b7464aaca19d4d05c0942e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33e3d319293c46b6af2f728a50586906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:08:01.200838 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-86434681-4c85-4c68-bcff-e11693f80c9e tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] 10.222.0.13 "GET /compute/v2.1/servers/3029f3c1-4f32-4f6b-963c-16f65b6dff3c" status: 200 len: 1612 microversion: 2.1 time: 0.129268 Nov 01 19:08:01.212621 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1718/3358] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:08:01 2022] GET /compute/v2.1/servers/3029f3c1-4f32-4f6b-963c-16f65b6dff3c => generated 1612 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:08:01.588566 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [req-c759e740-be62-47ff-99b8-d742466ed724 req-bff5a928-a11f-4e00-a0a9-fce719f3b81a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3029f3c1-4f32-4f6b-963c-16f65b6dff3c", "name": "network-vif-deleted", "tag": "840ef8a7-6bc6-4d48-932b-14a3209a45e7"}]} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:08:01.608306 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-c759e740-be62-47ff-99b8-d742466ed724 req-bff5a928-a11f-4e00-a0a9-fce719f3b81a service nova] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:08:01.608973 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-c759e740-be62-47ff-99b8-d742466ed724 req-bff5a928-a11f-4e00-a0a9-fce719f3b81a service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:08:01.610817 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-c759e740-be62-47ff-99b8-d742466ed724 req-bff5a928-a11f-4e00-a0a9-fce719f3b81a service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:08:01.622116 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-d56e159d-4501-475e-8809-d3ce1315df26 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:08:01.622765 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-d56e159d-4501-475e-8809-d3ce1315df26 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] [instance: af1071a8-a090-44c9-890c-123ca3ff39f1] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:08:01.640881 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d56e159d-4501-475e-8809-d3ce1315df26 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:08:01.643812 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d56e159d-4501-475e-8809-d3ce1315df26 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:08:01.645245 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.compute.server_external_events [req-c759e740-be62-47ff-99b8-d742466ed724 req-bff5a928-a11f-4e00-a0a9-fce719f3b81a service nova] Creating event network-vif-deleted:840ef8a7-6bc6-4d48-932b-14a3209a45e7 for instance 3029f3c1-4f32-4f6b-963c-16f65b6dff3c on n-h1-863052-2 Nov 01 19:08:01.647860 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d56e159d-4501-475e-8809-d3ce1315df26 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:08:01.649652 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d56e159d-4501-475e-8809-d3ce1315df26 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:08:01.656725 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d56e159d-4501-475e-8809-d3ce1315df26 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:08:01.661545 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d56e159d-4501-475e-8809-d3ce1315df26 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:08:01.662079 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [req-c759e740-be62-47ff-99b8-d742466ed724 req-bff5a928-a11f-4e00-a0a9-fce719f3b81a service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077834 Nov 01 19:08:01.679507 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1641/3359] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Nov 1 19:08:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:08:01.765445 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-60f7b34c-ca3d-4daf-a76a-8e7d69f357e7 tempest-ServerMetadataNegativeTestJSON-414983834 tempest-ServerMetadataNegativeTestJSON-414983834-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:08:01.766364 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-60f7b34c-ca3d-4daf-a76a-8e7d69f357e7 tempest-ServerMetadataNegativeTestJSON-414983834 tempest-ServerMetadataNegativeTestJSON-414983834-project] [instance: 6bb5dbff-cdc7-4986-8606-cec948c9d28c] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:08:01.793630 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-60f7b34c-ca3d-4daf-a76a-8e7d69f357e7 tempest-ServerMetadataNegativeTestJSON-414983834 tempest-ServerMetadataNegativeTestJSON-414983834-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:08:01.801756 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-60f7b34c-ca3d-4daf-a76a-8e7d69f357e7 tempest-ServerMetadataNegativeTestJSON-414983834 tempest-ServerMetadataNegativeTestJSON-414983834-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:08:01.802384 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-60f7b34c-ca3d-4daf-a76a-8e7d69f357e7 tempest-ServerMetadataNegativeTestJSON-414983834 tempest-ServerMetadataNegativeTestJSON-414983834-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:08:01.805671 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-60f7b34c-ca3d-4daf-a76a-8e7d69f357e7 tempest-ServerMetadataNegativeTestJSON-414983834 tempest-ServerMetadataNegativeTestJSON-414983834-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:08:01.806287 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-60f7b34c-ca3d-4daf-a76a-8e7d69f357e7 tempest-ServerMetadataNegativeTestJSON-414983834 tempest-ServerMetadataNegativeTestJSON-414983834-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:08:01.806821 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-60f7b34c-ca3d-4daf-a76a-8e7d69f357e7 tempest-ServerMetadataNegativeTestJSON-414983834 tempest-ServerMetadataNegativeTestJSON-414983834-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:08:02.107997 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-d56e159d-4501-475e-8809-d3ce1315df26 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '301ed3b9c37449bc9ade378f3c73a768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8807757227574c828dca1947af76659d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:08:02.124722 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-d56e159d-4501-475e-8809-d3ce1315df26 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '301ed3b9c37449bc9ade378f3c73a768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8807757227574c828dca1947af76659d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:08:02.126761 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-d56e159d-4501-475e-8809-d3ce1315df26 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '301ed3b9c37449bc9ade378f3c73a768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8807757227574c828dca1947af76659d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:08:02.128257 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-d56e159d-4501-475e-8809-d3ce1315df26 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] 10.222.0.13 "GET /compute/v2.1/servers/af1071a8-a090-44c9-890c-123ca3ff39f1" status: 200 len: 2956 microversion: 2.42 time: 0.512122 Nov 01 19:08:02.130191 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1719/3360] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 19:08:01 2022] GET /compute/v2.1/servers/af1071a8-a090-44c9-890c-123ca3ff39f1 => generated 2956 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 01 19:08:02.160043 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-c76c50b7-d1c1-4a00-aa1a-ef6a4a4db46d tempest-ImagesOneServerTestJSON-1044295602 tempest-ImagesOneServerTestJSON-1044295602-project] Calling method '.version_select at 0x7f0ae687c160>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:08:02.220638 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-c76c50b7-d1c1-4a00-aa1a-ef6a4a4db46d tempest-ImagesOneServerTestJSON-1044295602 tempest-ImagesOneServerTestJSON-1044295602-project] 10.222.0.13 "GET /compute/v2.1/images/621c9785-490d-4245-8b6b-91f8571f7eab" status: 200 len: 1422 microversion: 2.1 time: 0.082527 Nov 01 19:08:02.221553 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1720/3361] 10.222.0.13 () {58 vars in 1233 bytes} [Tue Nov 1 19:08:02 2022] GET /compute/v2.1/images/621c9785-490d-4245-8b6b-91f8571f7eab => generated 1422 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:08:02.237125 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-3ccb4dae-6db8-4ad0-8bcf-5f5496280dbd tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:08:02.238170 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-3ccb4dae-6db8-4ad0-8bcf-5f5496280dbd tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] [instance: 8485db2a-fd8f-4615-bbe0-14822ad44194] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:08:02.249001 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-3ccb4dae-6db8-4ad0-8bcf-5f5496280dbd tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:08:02.249595 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-3ccb4dae-6db8-4ad0-8bcf-5f5496280dbd tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:08:02.250213 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-3ccb4dae-6db8-4ad0-8bcf-5f5496280dbd tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:08:02.251076 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-3ccb4dae-6db8-4ad0-8bcf-5f5496280dbd tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:08:02.251612 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-3ccb4dae-6db8-4ad0-8bcf-5f5496280dbd tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:08:02.253656 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-3ccb4dae-6db8-4ad0-8bcf-5f5496280dbd tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:08:02.300087 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-60f7b34c-ca3d-4daf-a76a-8e7d69f357e7 tempest-ServerMetadataNegativeTestJSON-414983834 tempest-ServerMetadataNegativeTestJSON-414983834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aebd68d6b30e45debbfd99ee6360f905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd702a70dab124153b4f40d3219ffc5f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:08:02.309880 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-60f7b34c-ca3d-4daf-a76a-8e7d69f357e7 tempest-ServerMetadataNegativeTestJSON-414983834 tempest-ServerMetadataNegativeTestJSON-414983834-project] 10.222.0.13 "GET /compute/v2.1/servers/6bb5dbff-cdc7-4986-8606-cec948c9d28c" status: 200 len: 1519 microversion: 2.1 time: 0.554104 Nov 01 19:08:02.311207 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1642/3362] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:08:01 2022] GET /compute/v2.1/servers/6bb5dbff-cdc7-4986-8606-cec948c9d28c => generated 1519 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:08:02.322855 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-8e34719c-7cec-45cf-8c0f-51d3eef8bc39 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:08:02.324294 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-8e34719c-7cec-45cf-8c0f-51d3eef8bc39 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] [instance: 7c9dac18-3bfc-4379-ab97-25d185cd6b85] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:08:02.354782 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-8e34719c-7cec-45cf-8c0f-51d3eef8bc39 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:08:02.355711 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-8e34719c-7cec-45cf-8c0f-51d3eef8bc39 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:08:02.356254 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-8e34719c-7cec-45cf-8c0f-51d3eef8bc39 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:08:02.357142 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-8e34719c-7cec-45cf-8c0f-51d3eef8bc39 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:08:02.359122 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-8e34719c-7cec-45cf-8c0f-51d3eef8bc39 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:08:02.359696 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-8e34719c-7cec-45cf-8c0f-51d3eef8bc39 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:08:02.613505 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-3ccb4dae-6db8-4ad0-8bcf-5f5496280dbd tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '058480d92c9b4ab4af6815d0438a65c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee9dc49b89143f781e4ab30296e4d01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:08:02.628117 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-3ccb4dae-6db8-4ad0-8bcf-5f5496280dbd tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] 10.222.0.13 "GET /compute/v2.1/servers/8485db2a-fd8f-4615-bbe0-14822ad44194" status: 200 len: 1508 microversion: 2.1 time: 0.404692 Nov 01 19:08:02.628752 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1721/3363] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:08:02 2022] GET /compute/v2.1/servers/8485db2a-fd8f-4615-bbe0-14822ad44194 => generated 1508 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:08:02.650432 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-c4b89eca-cbc0-4837-9f1d-4f62e9a1b824 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:08:02.651293 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-c4b89eca-cbc0-4837-9f1d-4f62e9a1b824 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] [instance: af1071a8-a090-44c9-890c-123ca3ff39f1] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:08:02.662123 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-c4b89eca-cbc0-4837-9f1d-4f62e9a1b824 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:08:02.663071 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-c4b89eca-cbc0-4837-9f1d-4f62e9a1b824 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:08:02.663806 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-c4b89eca-cbc0-4837-9f1d-4f62e9a1b824 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:08:02.664957 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-c4b89eca-cbc0-4837-9f1d-4f62e9a1b824 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:08:02.666334 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-c4b89eca-cbc0-4837-9f1d-4f62e9a1b824 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:08:02.668067 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-c4b89eca-cbc0-4837-9f1d-4f62e9a1b824 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:08:02.689798 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-8e34719c-7cec-45cf-8c0f-51d3eef8bc39 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113bd8c844ee490b86a68bc7e1e75da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '851785a5f76548898a77d67792888504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:08:02.705009 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-8e34719c-7cec-45cf-8c0f-51d3eef8bc39 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] 10.222.0.13 "GET /compute/v2.1/servers/7c9dac18-3bfc-4379-ab97-25d185cd6b85" status: 200 len: 1267 microversion: 2.1 time: 0.390593 Nov 01 19:08:02.723096 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1643/3364] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:08:02 2022] GET /compute/v2.1/servers/7c9dac18-3bfc-4379-ab97-25d185cd6b85 => generated 1267 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:08:02.734099 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-a90a7a86-9c0f-4121-b68e-6675782a4373 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:08:02.737197 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-a90a7a86-9c0f-4121-b68e-6675782a4373 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] [instance: 3029f3c1-4f32-4f6b-963c-16f65b6dff3c] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:08:02.753207 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-a90a7a86-9c0f-4121-b68e-6675782a4373 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:08:02.755382 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-a90a7a86-9c0f-4121-b68e-6675782a4373 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:08:02.758039 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-a90a7a86-9c0f-4121-b68e-6675782a4373 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:08:02.759509 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-a90a7a86-9c0f-4121-b68e-6675782a4373 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:08:02.760331 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-a90a7a86-9c0f-4121-b68e-6675782a4373 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:08:02.762959 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-a90a7a86-9c0f-4121-b68e-6675782a4373 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:08:02.779413 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.wsgi [None req-a90a7a86-9c0f-4121-b68e-6675782a4373 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] HTTP exception thrown: Instance 3029f3c1-4f32-4f6b-963c-16f65b6dff3c could not be found. Nov 01 19:08:02.781609 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-a90a7a86-9c0f-4121-b68e-6675782a4373 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Request method failure captured: Nov 01 19:08:02.781609 n-d-863052-2 devstack@n-api.service[121402]: request: GET /compute/v2.1/servers/3029f3c1-4f32-4f6b-963c-16f65b6dff3c HTTP/1.1 Nov 01 19:08:02.781609 n-d-863052-2 devstack@n-api.service[121402]: Accept: application/json Nov 01 19:08:02.781609 n-d-863052-2 devstack@n-api.service[121402]: Accept-Encoding: identity Nov 01 19:08:02.781609 n-d-863052-2 devstack@n-api.service[121402]: Connection: close Nov 01 19:08:02.781609 n-d-863052-2 devstack@n-api.service[121402]: Content-Length: 0 Nov 01 19:08:02.781609 n-d-863052-2 devstack@n-api.service[121402]: Content-Type: application/json Nov 01 19:08:02.781609 n-d-863052-2 devstack@n-api.service[121402]: Host: 10.222.0.13 Nov 01 19:08:02.781609 n-d-863052-2 devstack@n-api.service[121402]: Openstack-System-Scope: None Nov 01 19:08:02.781609 n-d-863052-2 devstack@n-api.service[121402]: User-Agent: python-urllib3/1.26.12 Nov 01 19:08:02.781609 n-d-863052-2 devstack@n-api.service[121402]: X-Auth-Token: gAAAAABjYW26-niUURjtSz2aypPDgkYX79sMl0CZOJW_ml_lGFRo-4lOtvHbbGMI0UBaScGrQfLye0e0L4c10ym8MikDvB1h-T3Rh6fQQzcKLxsRSm1saxobVhs9el4Qiq-2aZx04HWuIjPot0FuuMjXsFtl108kYD3rs-RWb4TVydSfipjFJKk Nov 01 19:08:02.781609 n-d-863052-2 devstack@n-api.service[121402]: X-Domain-Id: None Nov 01 19:08:02.781609 n-d-863052-2 devstack@n-api.service[121402]: X-Domain-Name: None Nov 01 19:08:02.781609 n-d-863052-2 devstack@n-api.service[121402]: X-Identity-Status: Confirmed Nov 01 19:08:02.781609 n-d-863052-2 devstack@n-api.service[121402]: X-Is-Admin-Project: True Nov 01 19:08:02.781609 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Domain-Id: default Nov 01 19:08:02.781609 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Domain-Name: Default Nov 01 19:08:02.781609 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Id: 33e3d319293c46b6af2f728a50586906 Nov 01 19:08:02.781609 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Name: tempest-AttachVolumeNegativeTest-517167560 Nov 01 19:08:02.781609 n-d-863052-2 devstack@n-api.service[121402]: X-Role: member,reader Nov 01 19:08:02.781609 n-d-863052-2 devstack@n-api.service[121402]: X-Roles: member,reader Nov 01 19:08:02.781609 n-d-863052-2 devstack@n-api.service[121402]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/33e3d319293c46b6af2f728a50586906"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/33e3d319293c46b6af2f728a50586906"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_33e3d319293c46b6af2f728a50586906", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/33e3d319293c46b6af2f728a50586906"}]}] Nov 01 19:08:02.781609 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant: tempest-AttachVolumeNegativeTest-517167560 Nov 01 19:08:02.781609 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant-Id: 33e3d319293c46b6af2f728a50586906 Nov 01 19:08:02.781609 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-517167560 Nov 01 19:08:02.781609 n-d-863052-2 devstack@n-api.service[121402]: X-User: tempest-AttachVolumeNegativeTest-517167560-project Nov 01 19:08:02.781609 n-d-863052-2 devstack@n-api.service[121402]: X-User-Domain-Id: default Nov 01 19:08:02.781609 n-d-863052-2 devstack@n-api.service[121402]: X-User-Domain-Name: Default Nov 01 19:08:02.781609 n-d-863052-2 devstack@n-api.service[121402]: X-User-Id: 790f3f1566b7464aaca19d4d05c0942e Nov 01 19:08:02.781609 n-d-863052-2 devstack@n-api.service[121402]: X-User-Name: tempest-AttachVolumeNegativeTest-517167560-project Nov 01 19:08:02.781609 n-d-863052-2 devstack@n-api.service[121402]: method: > Nov 01 19:08:02.781609 n-d-863052-2 devstack@n-api.service[121402]: exception: Instance 3029f3c1-4f32-4f6b-963c-16f65b6dff3c could not be found. Nov 01 19:08:02.781609 n-d-863052-2 devstack@n-api.service[121402]: action_args: {'id': '3029f3c1-4f32-4f6b-963c-16f65b6dff3c'} Nov 01 19:08:02.781609 n-d-863052-2 devstack@n-api.service[121402]: {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 01 19:08:02.781609 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:08:02.781609 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 01 19:08:02.781609 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 01 19:08:02.781609 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 01 19:08:02.781609 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 01 19:08:02.781609 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 01 19:08:02.781609 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 01 19:08:02.781609 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 01 19:08:02.781609 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 01 19:08:02.781609 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3029f3c1-4f32-4f6b-963c-16f65b6dff3c could not be found. Nov 01 19:08:02.781609 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:08:02.781609 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:08:02.781609 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:08:02.781609 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:08:02.781609 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:08:02.781609 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:08:02.781609 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 01 19:08:02.781609 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 01 19:08:02.781609 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 01 19:08:02.781609 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 01 19:08:02.781609 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 01 19:08:02.781609 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 01 19:08:02.781609 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 01 19:08:02.781609 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 01 19:08:02.781609 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 01 19:08:02.781609 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 01 19:08:02.781609 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3029f3c1-4f32-4f6b-963c-16f65b6dff3c could not be found. Nov 01 19:08:02.781609 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:08:02.781609 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:08:02.781609 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:08:02.786619 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:08:02.786619 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:08:02.786619 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:08:02.786619 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 01 19:08:02.786619 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 01 19:08:02.786619 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3029f3c1-4f32-4f6b-963c-16f65b6dff3c could not be found. Nov 01 19:08:02.786619 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:08:02.788295 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-a90a7a86-9c0f-4121-b68e-6675782a4373 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Returning 404 to user: Instance 3029f3c1-4f32-4f6b-963c-16f65b6dff3c could not be found. {{(pid=121402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 01 19:08:02.789596 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-a90a7a86-9c0f-4121-b68e-6675782a4373 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] 10.222.0.13 "GET /compute/v2.1/servers/3029f3c1-4f32-4f6b-963c-16f65b6dff3c" status: 404 len: 111 microversion: 2.1 time: 0.062830 Nov 01 19:08:02.791225 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1644/3365] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:08:02 2022] GET /compute/v2.1/servers/3029f3c1-4f32-4f6b-963c-16f65b6dff3c => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 01 19:08:02.796458 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-3bb0099d-bfc0-4a44-a1d6-7a9e7190c34a tempest-ServerMetadataNegativeTestJSON-414983834 tempest-ServerMetadataNegativeTestJSON-414983834-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1435958536", "imageRef": "2d4a0047-1b9e-445f-8af8-1b5c9d93e881", "flavorRef": "452", "metadata": {"": "data1"}, "networks": [{"uuid": "3d22c6c2-f92e-4412-8eb6-291b21149bea"}]}} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:08:02.801854 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-3bb0099d-bfc0-4a44-a1d6-7a9e7190c34a tempest-ServerMetadataNegativeTestJSON-414983834 tempest-ServerMetadataNegativeTestJSON-414983834-project] Request method failure captured: Nov 01 19:08:02.801854 n-d-863052-2 devstack@n-api.service[121402]: request: POST /compute/v2.1/servers HTTP/1.1 Nov 01 19:08:02.801854 n-d-863052-2 devstack@n-api.service[121402]: Accept: application/json Nov 01 19:08:02.801854 n-d-863052-2 devstack@n-api.service[121402]: Accept-Encoding: identity Nov 01 19:08:02.801854 n-d-863052-2 devstack@n-api.service[121402]: Connection: close Nov 01 19:08:02.801854 n-d-863052-2 devstack@n-api.service[121402]: Content-Length: 243 Nov 01 19:08:02.801854 n-d-863052-2 devstack@n-api.service[121402]: Content-Type: application/json Nov 01 19:08:02.801854 n-d-863052-2 devstack@n-api.service[121402]: Host: 10.222.0.13 Nov 01 19:08:02.801854 n-d-863052-2 devstack@n-api.service[121402]: Openstack-System-Scope: None Nov 01 19:08:02.801854 n-d-863052-2 devstack@n-api.service[121402]: User-Agent: python-urllib3/1.26.12 Nov 01 19:08:02.801854 n-d-863052-2 devstack@n-api.service[121402]: X-Auth-Token: gAAAAABjYW6A_zo37UoyTGqmLiBbzVZAIcCwF8Jo_l29ziAaByPmJ2pwikzRg_TlNxgJjI75pzbQ2PW0duNreTXxYfNkvSQD4TNjwied1o0eXEbhsN6T-mYWAKZ9dTKYMAH1Py5SQtMH4I20d_YLeOK_c7Msy3lItgeqsXmRSJcSWXkcAGNY7HU Nov 01 19:08:02.801854 n-d-863052-2 devstack@n-api.service[121402]: X-Domain-Id: None Nov 01 19:08:02.801854 n-d-863052-2 devstack@n-api.service[121402]: X-Domain-Name: None Nov 01 19:08:02.801854 n-d-863052-2 devstack@n-api.service[121402]: X-Identity-Status: Confirmed Nov 01 19:08:02.801854 n-d-863052-2 devstack@n-api.service[121402]: X-Is-Admin-Project: True Nov 01 19:08:02.801854 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Domain-Id: default Nov 01 19:08:02.801854 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Domain-Name: Default Nov 01 19:08:02.801854 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Id: d702a70dab124153b4f40d3219ffc5f3 Nov 01 19:08:02.801854 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-414983834 Nov 01 19:08:02.801854 n-d-863052-2 devstack@n-api.service[121402]: X-Role: member,reader Nov 01 19:08:02.801854 n-d-863052-2 devstack@n-api.service[121402]: X-Roles: member,reader Nov 01 19:08:02.801854 n-d-863052-2 devstack@n-api.service[121402]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/d702a70dab124153b4f40d3219ffc5f3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/d702a70dab124153b4f40d3219ffc5f3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_d702a70dab124153b4f40d3219ffc5f3", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/d702a70dab124153b4f40d3219ffc5f3"}]}] Nov 01 19:08:02.801854 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-414983834 Nov 01 19:08:02.801854 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant-Id: d702a70dab124153b4f40d3219ffc5f3 Nov 01 19:08:02.801854 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-414983834 Nov 01 19:08:02.801854 n-d-863052-2 devstack@n-api.service[121402]: X-User: tempest-ServerMetadataNegativeTestJSON-414983834-project Nov 01 19:08:02.801854 n-d-863052-2 devstack@n-api.service[121402]: X-User-Domain-Id: default Nov 01 19:08:02.801854 n-d-863052-2 devstack@n-api.service[121402]: X-User-Domain-Name: Default Nov 01 19:08:02.801854 n-d-863052-2 devstack@n-api.service[121402]: X-User-Id: aebd68d6b30e45debbfd99ee6360f905 Nov 01 19:08:02.801854 n-d-863052-2 devstack@n-api.service[121402]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-414983834-project Nov 01 19:08:02.801854 n-d-863052-2 devstack@n-api.service[121402]: Nov 01 19:08:02.801854 n-d-863052-2 devstack@n-api.service[121402]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1435958536", "imageRef": "2d4a0047-1b9e-445f-8af8-1b5c9d93e881", "flavorRef": "452", "metadata": {"": "data1"}, "networks": [{"uuid": "3d22c6c2-f92e-4412-8eb6-291b21149bea"}]}} Nov 01 19:08:02.801854 n-d-863052-2 devstack@n-api.service[121402]: method: > Nov 01 19:08:02.801854 n-d-863052-2 devstack@n-api.service[121402]: exception: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Nov 01 19:08:02.801854 n-d-863052-2 devstack@n-api.service[121402]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-1435958536', 'imageRef': '2d4a0047-1b9e-445f-8af8-1b5c9d93e881', 'flavorRef': '452', 'metadata': {'': 'data1'}, 'networks': [{'uuid': '3d22c6c2-f92e-4412-8eb6-291b21149bea'}]}}} Nov 01 19:08:02.801854 n-d-863052-2 devstack@n-api.service[121402]: {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 01 19:08:02.801854 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:08:02.801854 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Nov 01 19:08:02.801854 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Nov 01 19:08:02.801854 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Nov 01 19:08:02.801854 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise error Nov 01 19:08:02.801854 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Nov 01 19:08:02.801854 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:08:02.801854 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Nov 01 19:08:02.801854 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Nov 01 19:08:02.801854 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Nov 01 19:08:02.801854 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Nov 01 19:08:02.801854 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi 'type': 'object'} Nov 01 19:08:02.801854 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:08:02.801854 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi On instance['server']: Nov 01 19:08:02.801854 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi {'': 'data1'} Nov 01 19:08:02.801854 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:08:02.801854 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:08:02.801854 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:08:02.801854 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:08:02.801854 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:08:02.801854 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:08:02.801854 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 01 19:08:02.801854 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 01 19:08:02.801854 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 01 19:08:02.801854 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 01 19:08:02.801854 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 01 19:08:02.807200 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 01 19:08:02.807200 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Nov 01 19:08:02.807200 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Nov 01 19:08:02.807200 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Nov 01 19:08:02.807200 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Nov 01 19:08:02.807200 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Nov 01 19:08:02.807200 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Nov 01 19:08:02.807200 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Nov 01 19:08:02.807200 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:08:02.807200 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:08:02.807200 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:08:02.807200 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:08:02.807200 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:08:02.807200 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:08:02.807200 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Nov 01 19:08:02.807200 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Nov 01 19:08:02.807200 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Nov 01 19:08:02.807200 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:08:02.810999 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-3bb0099d-bfc0-4a44-a1d6-7a9e7190c34a tempest-ServerMetadataNegativeTestJSON-414983834 tempest-ServerMetadataNegativeTestJSON-414983834-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=121402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 01 19:08:02.812375 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-3bb0099d-bfc0-4a44-a1d6-7a9e7190c34a tempest-ServerMetadataNegativeTestJSON-414983834 tempest-ServerMetadataNegativeTestJSON-414983834-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 400 len: 175 microversion: 2.1 time: 0.019874 Nov 01 19:08:02.813772 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1645/3366] 10.222.0.13 () {60 vars in 1147 bytes} [Tue Nov 1 19:08:02 2022] POST /compute/v2.1/servers => generated 175 bytes in 22 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 01 19:08:02.824799 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [req-48ebe446-4cae-407a-b440-7e033efa881d req-c79b2915-bf0a-4894-9322-2c19d0507a65 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "31f51cbd-b29a-46be-bca0-f27c2b287e15", "name": "network-vif-plugged", "status": "completed", "tag": "bc5f2d73-99ce-47e7-bd41-afad82bb372e"}]} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:08:02.838171 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-48ebe446-4cae-407a-b440-7e033efa881d req-c79b2915-bf0a-4894-9322-2c19d0507a65 service nova] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:08:02.839158 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-48ebe446-4cae-407a-b440-7e033efa881d req-c79b2915-bf0a-4894-9322-2c19d0507a65 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:08:02.839825 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-48ebe446-4cae-407a-b440-7e033efa881d req-c79b2915-bf0a-4894-9322-2c19d0507a65 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:08:02.860990 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.compute.server_external_events [req-48ebe446-4cae-407a-b440-7e033efa881d req-c79b2915-bf0a-4894-9322-2c19d0507a65 service nova] Creating event network-vif-plugged:bc5f2d73-99ce-47e7-bd41-afad82bb372e for instance 31f51cbd-b29a-46be-bca0-f27c2b287e15 on n-h2-863052-2 Nov 01 19:08:02.870016 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [req-48ebe446-4cae-407a-b440-7e033efa881d req-c79b2915-bf0a-4894-9322-2c19d0507a65 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054084 Nov 01 19:08:02.871993 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1646/3367] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Nov 1 19:08:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:08:02.878063 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-f50f5ea6-7911-49da-9f0c-2bafe35035a0 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Calling method '.version_select at 0x7f0ae1981b80>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:08:02.911291 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-f50f5ea6-7911-49da-9f0c-2bafe35035a0 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-834671170" status: 202 len: 0 microversion: 2.1 time: 0.037734 Nov 01 19:08:02.912619 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1647/3368] 10.222.0.13 () {58 vars in 1218 bytes} [Tue Nov 1 19:08:02 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-834671170 => generated 0 bytes in 40 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 01 19:08:02.919707 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-49c76034-24fa-40fa-a682-b3d72e6b88f9 tempest-ServerMetadataNegativeTestJSON-414983834 tempest-ServerMetadataNegativeTestJSON-414983834-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:08:02.920871 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-49c76034-24fa-40fa-a682-b3d72e6b88f9 tempest-ServerMetadataNegativeTestJSON-414983834 tempest-ServerMetadataNegativeTestJSON-414983834-project] [instance: cd15a01d-a7ca-4bd2-8fd7-8b86f9779547] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:08:02.928701 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.wsgi [None req-49c76034-24fa-40fa-a682-b3d72e6b88f9 tempest-ServerMetadataNegativeTestJSON-414983834 tempest-ServerMetadataNegativeTestJSON-414983834-project] HTTP exception thrown: Instance cd15a01d-a7ca-4bd2-8fd7-8b86f9779547 could not be found. Nov 01 19:08:02.940935 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-49c76034-24fa-40fa-a682-b3d72e6b88f9 tempest-ServerMetadataNegativeTestJSON-414983834 tempest-ServerMetadataNegativeTestJSON-414983834-project] Request method failure captured: Nov 01 19:08:02.940935 n-d-863052-2 devstack@n-api.service[121402]: request: GET /compute/v2.1/servers/cd15a01d-a7ca-4bd2-8fd7-8b86f9779547/metadata HTTP/1.1 Nov 01 19:08:02.940935 n-d-863052-2 devstack@n-api.service[121402]: Accept: application/json Nov 01 19:08:02.940935 n-d-863052-2 devstack@n-api.service[121402]: Accept-Encoding: identity Nov 01 19:08:02.940935 n-d-863052-2 devstack@n-api.service[121402]: Connection: close Nov 01 19:08:02.940935 n-d-863052-2 devstack@n-api.service[121402]: Content-Length: 0 Nov 01 19:08:02.940935 n-d-863052-2 devstack@n-api.service[121402]: Content-Type: application/json Nov 01 19:08:02.940935 n-d-863052-2 devstack@n-api.service[121402]: Host: 10.222.0.13 Nov 01 19:08:02.940935 n-d-863052-2 devstack@n-api.service[121402]: Openstack-System-Scope: None Nov 01 19:08:02.940935 n-d-863052-2 devstack@n-api.service[121402]: User-Agent: python-urllib3/1.26.12 Nov 01 19:08:02.940935 n-d-863052-2 devstack@n-api.service[121402]: X-Auth-Token: gAAAAABjYW6A_zo37UoyTGqmLiBbzVZAIcCwF8Jo_l29ziAaByPmJ2pwikzRg_TlNxgJjI75pzbQ2PW0duNreTXxYfNkvSQD4TNjwied1o0eXEbhsN6T-mYWAKZ9dTKYMAH1Py5SQtMH4I20d_YLeOK_c7Msy3lItgeqsXmRSJcSWXkcAGNY7HU Nov 01 19:08:02.940935 n-d-863052-2 devstack@n-api.service[121402]: X-Domain-Id: None Nov 01 19:08:02.940935 n-d-863052-2 devstack@n-api.service[121402]: X-Domain-Name: None Nov 01 19:08:02.940935 n-d-863052-2 devstack@n-api.service[121402]: X-Identity-Status: Confirmed Nov 01 19:08:02.940935 n-d-863052-2 devstack@n-api.service[121402]: X-Is-Admin-Project: True Nov 01 19:08:02.940935 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Domain-Id: default Nov 01 19:08:02.940935 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Domain-Name: Default Nov 01 19:08:02.940935 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Id: d702a70dab124153b4f40d3219ffc5f3 Nov 01 19:08:02.940935 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-414983834 Nov 01 19:08:02.940935 n-d-863052-2 devstack@n-api.service[121402]: X-Role: member,reader Nov 01 19:08:02.940935 n-d-863052-2 devstack@n-api.service[121402]: X-Roles: member,reader Nov 01 19:08:02.940935 n-d-863052-2 devstack@n-api.service[121402]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/d702a70dab124153b4f40d3219ffc5f3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/d702a70dab124153b4f40d3219ffc5f3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_d702a70dab124153b4f40d3219ffc5f3", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/d702a70dab124153b4f40d3219ffc5f3"}]}] Nov 01 19:08:02.940935 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-414983834 Nov 01 19:08:02.940935 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant-Id: d702a70dab124153b4f40d3219ffc5f3 Nov 01 19:08:02.940935 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-414983834 Nov 01 19:08:02.940935 n-d-863052-2 devstack@n-api.service[121402]: X-User: tempest-ServerMetadataNegativeTestJSON-414983834-project Nov 01 19:08:02.940935 n-d-863052-2 devstack@n-api.service[121402]: X-User-Domain-Id: default Nov 01 19:08:02.940935 n-d-863052-2 devstack@n-api.service[121402]: X-User-Domain-Name: Default Nov 01 19:08:02.940935 n-d-863052-2 devstack@n-api.service[121402]: X-User-Id: aebd68d6b30e45debbfd99ee6360f905 Nov 01 19:08:02.940935 n-d-863052-2 devstack@n-api.service[121402]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-414983834-project Nov 01 19:08:02.940935 n-d-863052-2 devstack@n-api.service[121402]: method: > Nov 01 19:08:02.940935 n-d-863052-2 devstack@n-api.service[121402]: exception: Instance cd15a01d-a7ca-4bd2-8fd7-8b86f9779547 could not be found. Nov 01 19:08:02.940935 n-d-863052-2 devstack@n-api.service[121402]: action_args: {'server_id': 'cd15a01d-a7ca-4bd2-8fd7-8b86f9779547'} Nov 01 19:08:02.940935 n-d-863052-2 devstack@n-api.service[121402]: {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 01 19:08:02.940935 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:08:02.940935 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 01 19:08:02.940935 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 01 19:08:02.940935 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 01 19:08:02.940935 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 01 19:08:02.940935 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Nov 01 19:08:02.940935 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Nov 01 19:08:02.940935 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cd15a01d-a7ca-4bd2-8fd7-8b86f9779547 could not be found. Nov 01 19:08:02.940935 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:08:02.940935 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:08:02.940935 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:08:02.940935 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:08:02.940935 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:08:02.940935 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:08:02.940935 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 01 19:08:02.940935 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 01 19:08:02.940935 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 01 19:08:02.940935 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 01 19:08:02.940935 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_metadata.py", line 54, in index Nov 01 19:08:02.940935 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, server_id) Nov 01 19:08:02.940935 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 01 19:08:02.940935 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 01 19:08:02.940935 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cd15a01d-a7ca-4bd2-8fd7-8b86f9779547 could not be found. Nov 01 19:08:02.940935 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:08:02.940935 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:08:02.940935 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:08:02.940935 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:08:02.940935 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:08:02.940935 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:08:02.947482 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 01 19:08:02.947482 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 01 19:08:02.947482 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cd15a01d-a7ca-4bd2-8fd7-8b86f9779547 could not be found. Nov 01 19:08:02.947482 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:08:02.949183 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-49c76034-24fa-40fa-a682-b3d72e6b88f9 tempest-ServerMetadataNegativeTestJSON-414983834 tempest-ServerMetadataNegativeTestJSON-414983834-project] Returning 404 to user: Instance cd15a01d-a7ca-4bd2-8fd7-8b86f9779547 could not be found. {{(pid=121402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 01 19:08:02.950605 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-49c76034-24fa-40fa-a682-b3d72e6b88f9 tempest-ServerMetadataNegativeTestJSON-414983834 tempest-ServerMetadataNegativeTestJSON-414983834-project] 10.222.0.13 "GET /compute/v2.1/servers/cd15a01d-a7ca-4bd2-8fd7-8b86f9779547/metadata" status: 404 len: 111 microversion: 2.1 time: 0.036480 Nov 01 19:08:02.951727 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1648/3369] 10.222.0.13 () {58 vars in 1263 bytes} [Tue Nov 1 19:08:02 2022] GET /compute/v2.1/servers/cd15a01d-a7ca-4bd2-8fd7-8b86f9779547/metadata => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 01 19:08:02.969329 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-c4b89eca-cbc0-4837-9f1d-4f62e9a1b824 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] 10.222.0.13 "GET /compute/v2.1/servers/af1071a8-a090-44c9-890c-123ca3ff39f1/os-interface" status: 200 len: 1832 microversion: 2.42 time: 0.338314 Nov 01 19:08:02.970937 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1722/3370] 10.222.0.13 () {60 vars in 1316 bytes} [Tue Nov 1 19:08:02 2022] GET /compute/v2.1/servers/af1071a8-a090-44c9-890c-123ca3ff39f1/os-interface => generated 1832 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 19:08:03.054532 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-f9dd2ccf-10c3-4f26-ae02-cc944f5655be tempest-ServerMetadataNegativeTestJSON-414983834 tempest-ServerMetadataNegativeTestJSON-414983834-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1391814904", "imageRef": "2d4a0047-1b9e-445f-8af8-1b5c9d93e881", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "3d22c6c2-f92e-4412-8eb6-291b21149bea"}]}} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:08:03.062451 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-f9dd2ccf-10c3-4f26-ae02-cc944f5655be tempest-ServerMetadataNegativeTestJSON-414983834 tempest-ServerMetadataNegativeTestJSON-414983834-project] Request method failure captured: Nov 01 19:08:03.062451 n-d-863052-2 devstack@n-api.service[121402]: request: POST /compute/v2.1/servers HTTP/1.1 Nov 01 19:08:03.062451 n-d-863052-2 devstack@n-api.service[121402]: Accept: application/json Nov 01 19:08:03.062451 n-d-863052-2 devstack@n-api.service[121402]: Accept-Encoding: identity Nov 01 19:08:03.062451 n-d-863052-2 devstack@n-api.service[121402]: Connection: close Nov 01 19:08:03.062451 n-d-863052-2 devstack@n-api.service[121402]: Content-Length: 499 Nov 01 19:08:03.062451 n-d-863052-2 devstack@n-api.service[121402]: Content-Type: application/json Nov 01 19:08:03.062451 n-d-863052-2 devstack@n-api.service[121402]: Host: 10.222.0.13 Nov 01 19:08:03.062451 n-d-863052-2 devstack@n-api.service[121402]: Openstack-System-Scope: None Nov 01 19:08:03.062451 n-d-863052-2 devstack@n-api.service[121402]: User-Agent: python-urllib3/1.26.12 Nov 01 19:08:03.062451 n-d-863052-2 devstack@n-api.service[121402]: X-Auth-Token: gAAAAABjYW6A_zo37UoyTGqmLiBbzVZAIcCwF8Jo_l29ziAaByPmJ2pwikzRg_TlNxgJjI75pzbQ2PW0duNreTXxYfNkvSQD4TNjwied1o0eXEbhsN6T-mYWAKZ9dTKYMAH1Py5SQtMH4I20d_YLeOK_c7Msy3lItgeqsXmRSJcSWXkcAGNY7HU Nov 01 19:08:03.062451 n-d-863052-2 devstack@n-api.service[121402]: X-Domain-Id: None Nov 01 19:08:03.062451 n-d-863052-2 devstack@n-api.service[121402]: X-Domain-Name: None Nov 01 19:08:03.062451 n-d-863052-2 devstack@n-api.service[121402]: X-Identity-Status: Confirmed Nov 01 19:08:03.062451 n-d-863052-2 devstack@n-api.service[121402]: X-Is-Admin-Project: True Nov 01 19:08:03.062451 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Domain-Id: default Nov 01 19:08:03.062451 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Domain-Name: Default Nov 01 19:08:03.062451 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Id: d702a70dab124153b4f40d3219ffc5f3 Nov 01 19:08:03.062451 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-414983834 Nov 01 19:08:03.062451 n-d-863052-2 devstack@n-api.service[121402]: X-Role: member,reader Nov 01 19:08:03.062451 n-d-863052-2 devstack@n-api.service[121402]: X-Roles: member,reader Nov 01 19:08:03.062451 n-d-863052-2 devstack@n-api.service[121402]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/d702a70dab124153b4f40d3219ffc5f3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/d702a70dab124153b4f40d3219ffc5f3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_d702a70dab124153b4f40d3219ffc5f3", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/d702a70dab124153b4f40d3219ffc5f3"}]}] Nov 01 19:08:03.062451 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-414983834 Nov 01 19:08:03.062451 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant-Id: d702a70dab124153b4f40d3219ffc5f3 Nov 01 19:08:03.062451 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-414983834 Nov 01 19:08:03.062451 n-d-863052-2 devstack@n-api.service[121402]: X-User: tempest-ServerMetadataNegativeTestJSON-414983834-project Nov 01 19:08:03.062451 n-d-863052-2 devstack@n-api.service[121402]: X-User-Domain-Id: default Nov 01 19:08:03.062451 n-d-863052-2 devstack@n-api.service[121402]: X-User-Domain-Name: Default Nov 01 19:08:03.062451 n-d-863052-2 devstack@n-api.service[121402]: X-User-Id: aebd68d6b30e45debbfd99ee6360f905 Nov 01 19:08:03.062451 n-d-863052-2 devstack@n-api.service[121402]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-414983834-project Nov 01 19:08:03.062451 n-d-863052-2 devstack@n-api.service[121402]: Nov 01 19:08:03.062451 n-d-863052-2 devstack@n-api.service[121402]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1391814904", "imageRef": "2d4a0047-1b9e-445f-8af8-1b5c9d93e881", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "3d22c6c2-f92e-4412-8eb6-291b21149bea"}]}} Nov 01 19:08:03.062451 n-d-863052-2 devstack@n-api.service[121402]: method: > Nov 01 19:08:03.062451 n-d-863052-2 devstack@n-api.service[121402]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Nov 01 19:08:03.062451 n-d-863052-2 devstack@n-api.service[121402]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-1391814904', 'imageRef': '2d4a0047-1b9e-445f-8af8-1b5c9d93e881', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '3d22c6c2-f92e-4412-8eb6-291b21149bea'}]}}} Nov 01 19:08:03.062451 n-d-863052-2 devstack@n-api.service[121402]: {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 01 19:08:03.062451 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:08:03.062451 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Nov 01 19:08:03.062451 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Nov 01 19:08:03.062451 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Nov 01 19:08:03.062451 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise error Nov 01 19:08:03.062451 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Nov 01 19:08:03.062451 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:08:03.062451 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Nov 01 19:08:03.062451 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Nov 01 19:08:03.062451 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Nov 01 19:08:03.062451 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Nov 01 19:08:03.065492 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi 'type': 'object'} Nov 01 19:08:03.065492 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:08:03.065492 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi On instance['server']: Nov 01 19:08:03.065492 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Nov 01 19:08:03.065492 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:08:03.065492 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:08:03.065492 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:08:03.065492 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:08:03.065492 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:08:03.065492 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:08:03.065492 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 01 19:08:03.065492 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 01 19:08:03.065492 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 01 19:08:03.065492 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 01 19:08:03.065492 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 01 19:08:03.065492 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 01 19:08:03.065492 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Nov 01 19:08:03.065492 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Nov 01 19:08:03.065492 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Nov 01 19:08:03.065492 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Nov 01 19:08:03.065492 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Nov 01 19:08:03.065492 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Nov 01 19:08:03.065492 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Nov 01 19:08:03.065492 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:08:03.065492 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:08:03.065492 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:08:03.065492 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:08:03.065492 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:08:03.065492 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:08:03.065492 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Nov 01 19:08:03.065492 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Nov 01 19:08:03.065492 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Nov 01 19:08:03.065492 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:08:03.069861 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-f9dd2ccf-10c3-4f26-ae02-cc944f5655be tempest-ServerMetadataNegativeTestJSON-414983834 tempest-ServerMetadataNegativeTestJSON-414983834-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=121402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 01 19:08:03.072047 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-f9dd2ccf-10c3-4f26-ae02-cc944f5655be tempest-ServerMetadataNegativeTestJSON-414983834 tempest-ServerMetadataNegativeTestJSON-414983834-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 400 len: 687 microversion: 2.1 time: 0.021236 Nov 01 19:08:03.073273 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1649/3371] 10.222.0.13 () {60 vars in 1147 bytes} [Tue Nov 1 19:08:03 2022] POST /compute/v2.1/servers => generated 687 bytes in 24 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 01 19:08:03.156958 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-e3d52541-4120-484b-9a2b-13ac576ab7a7 tempest-ServerMetadataNegativeTestJSON-414983834 tempest-ServerMetadataNegativeTestJSON-414983834-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-159453623", "imageRef": "2d4a0047-1b9e-445f-8af8-1b5c9d93e881", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "3d22c6c2-f92e-4412-8eb6-291b21149bea"}]}} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:08:03.162268 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-e3d52541-4120-484b-9a2b-13ac576ab7a7 tempest-ServerMetadataNegativeTestJSON-414983834 tempest-ServerMetadataNegativeTestJSON-414983834-project] Request method failure captured: Nov 01 19:08:03.162268 n-d-863052-2 devstack@n-api.service[121403]: request: POST /compute/v2.1/servers HTTP/1.1 Nov 01 19:08:03.162268 n-d-863052-2 devstack@n-api.service[121403]: Accept: application/json Nov 01 19:08:03.162268 n-d-863052-2 devstack@n-api.service[121403]: Accept-Encoding: identity Nov 01 19:08:03.162268 n-d-863052-2 devstack@n-api.service[121403]: Connection: close Nov 01 19:08:03.162268 n-d-863052-2 devstack@n-api.service[121403]: Content-Length: 499 Nov 01 19:08:03.162268 n-d-863052-2 devstack@n-api.service[121403]: Content-Type: application/json Nov 01 19:08:03.162268 n-d-863052-2 devstack@n-api.service[121403]: Host: 10.222.0.13 Nov 01 19:08:03.162268 n-d-863052-2 devstack@n-api.service[121403]: Openstack-System-Scope: None Nov 01 19:08:03.162268 n-d-863052-2 devstack@n-api.service[121403]: User-Agent: python-urllib3/1.26.12 Nov 01 19:08:03.162268 n-d-863052-2 devstack@n-api.service[121403]: X-Auth-Token: gAAAAABjYW6A_zo37UoyTGqmLiBbzVZAIcCwF8Jo_l29ziAaByPmJ2pwikzRg_TlNxgJjI75pzbQ2PW0duNreTXxYfNkvSQD4TNjwied1o0eXEbhsN6T-mYWAKZ9dTKYMAH1Py5SQtMH4I20d_YLeOK_c7Msy3lItgeqsXmRSJcSWXkcAGNY7HU Nov 01 19:08:03.162268 n-d-863052-2 devstack@n-api.service[121403]: X-Domain-Id: None Nov 01 19:08:03.162268 n-d-863052-2 devstack@n-api.service[121403]: X-Domain-Name: None Nov 01 19:08:03.162268 n-d-863052-2 devstack@n-api.service[121403]: X-Identity-Status: Confirmed Nov 01 19:08:03.162268 n-d-863052-2 devstack@n-api.service[121403]: X-Is-Admin-Project: True Nov 01 19:08:03.162268 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Domain-Id: default Nov 01 19:08:03.162268 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Domain-Name: Default Nov 01 19:08:03.162268 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Id: d702a70dab124153b4f40d3219ffc5f3 Nov 01 19:08:03.162268 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-414983834 Nov 01 19:08:03.162268 n-d-863052-2 devstack@n-api.service[121403]: X-Role: member,reader Nov 01 19:08:03.162268 n-d-863052-2 devstack@n-api.service[121403]: X-Roles: member,reader Nov 01 19:08:03.162268 n-d-863052-2 devstack@n-api.service[121403]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/d702a70dab124153b4f40d3219ffc5f3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/d702a70dab124153b4f40d3219ffc5f3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_d702a70dab124153b4f40d3219ffc5f3", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/d702a70dab124153b4f40d3219ffc5f3"}]}] Nov 01 19:08:03.162268 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-414983834 Nov 01 19:08:03.162268 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant-Id: d702a70dab124153b4f40d3219ffc5f3 Nov 01 19:08:03.162268 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-414983834 Nov 01 19:08:03.162268 n-d-863052-2 devstack@n-api.service[121403]: X-User: tempest-ServerMetadataNegativeTestJSON-414983834-project Nov 01 19:08:03.162268 n-d-863052-2 devstack@n-api.service[121403]: X-User-Domain-Id: default Nov 01 19:08:03.162268 n-d-863052-2 devstack@n-api.service[121403]: X-User-Domain-Name: Default Nov 01 19:08:03.162268 n-d-863052-2 devstack@n-api.service[121403]: X-User-Id: aebd68d6b30e45debbfd99ee6360f905 Nov 01 19:08:03.162268 n-d-863052-2 devstack@n-api.service[121403]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-414983834-project Nov 01 19:08:03.162268 n-d-863052-2 devstack@n-api.service[121403]: Nov 01 19:08:03.162268 n-d-863052-2 devstack@n-api.service[121403]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-159453623", "imageRef": "2d4a0047-1b9e-445f-8af8-1b5c9d93e881", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "3d22c6c2-f92e-4412-8eb6-291b21149bea"}]}} Nov 01 19:08:03.162268 n-d-863052-2 devstack@n-api.service[121403]: method: > Nov 01 19:08:03.162268 n-d-863052-2 devstack@n-api.service[121403]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Nov 01 19:08:03.162268 n-d-863052-2 devstack@n-api.service[121403]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-159453623', 'imageRef': '2d4a0047-1b9e-445f-8af8-1b5c9d93e881', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '3d22c6c2-f92e-4412-8eb6-291b21149bea'}]}}} Nov 01 19:08:03.162268 n-d-863052-2 devstack@n-api.service[121403]: {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 01 19:08:03.162268 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:08:03.162268 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Nov 01 19:08:03.162268 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Nov 01 19:08:03.162268 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Nov 01 19:08:03.162268 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise error Nov 01 19:08:03.162268 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Nov 01 19:08:03.162268 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:08:03.162268 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Nov 01 19:08:03.162268 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Nov 01 19:08:03.162268 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Nov 01 19:08:03.162268 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Nov 01 19:08:03.165925 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi 'type': 'object'} Nov 01 19:08:03.165925 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:08:03.165925 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi On instance['server']: Nov 01 19:08:03.165925 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Nov 01 19:08:03.165925 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:08:03.165925 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:08:03.165925 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:08:03.165925 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:08:03.165925 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:08:03.165925 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:08:03.165925 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 01 19:08:03.165925 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 01 19:08:03.165925 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 01 19:08:03.165925 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 01 19:08:03.165925 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 01 19:08:03.165925 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 01 19:08:03.165925 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Nov 01 19:08:03.165925 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Nov 01 19:08:03.165925 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Nov 01 19:08:03.165925 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Nov 01 19:08:03.165925 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Nov 01 19:08:03.165925 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Nov 01 19:08:03.165925 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Nov 01 19:08:03.165925 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:08:03.165925 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:08:03.165925 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:08:03.165925 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:08:03.165925 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:08:03.165925 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:08:03.165925 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Nov 01 19:08:03.165925 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Nov 01 19:08:03.165925 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Nov 01 19:08:03.165925 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:08:03.171281 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-e3d52541-4120-484b-9a2b-13ac576ab7a7 tempest-ServerMetadataNegativeTestJSON-414983834 tempest-ServerMetadataNegativeTestJSON-414983834-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=121403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 01 19:08:03.172442 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-e3d52541-4120-484b-9a2b-13ac576ab7a7 tempest-ServerMetadataNegativeTestJSON-414983834 tempest-ServerMetadataNegativeTestJSON-414983834-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 400 len: 689 microversion: 2.1 time: 0.019760 Nov 01 19:08:03.173692 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1723/3372] 10.222.0.13 () {60 vars in 1147 bytes} [Tue Nov 1 19:08:03 2022] POST /compute/v2.1/servers => generated 689 bytes in 21 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 01 19:08:03.238270 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-9746c36c-b82b-4f64-a796-e320e685725c tempest-ServerMetadataNegativeTestJSON-414983834 tempest-ServerMetadataNegativeTestJSON-414983834-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1386684997", "imageRef": "2d4a0047-1b9e-445f-8af8-1b5c9d93e881", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "3d22c6c2-f92e-4412-8eb6-291b21149bea"}]}} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:08:03.238872 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-667f58f9-6090-498f-b1d1-22e2d7257c52 tempest-ImagesOneServerTestJSON-1044295602 tempest-ImagesOneServerTestJSON-1044295602-project] Calling method '.version_select at 0x7f0ae6889820>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:08:03.248447 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-9746c36c-b82b-4f64-a796-e320e685725c tempest-ServerMetadataNegativeTestJSON-414983834 tempest-ServerMetadataNegativeTestJSON-414983834-project] Request method failure captured: Nov 01 19:08:03.248447 n-d-863052-2 devstack@n-api.service[121402]: request: POST /compute/v2.1/servers HTTP/1.1 Nov 01 19:08:03.248447 n-d-863052-2 devstack@n-api.service[121402]: Accept: application/json Nov 01 19:08:03.248447 n-d-863052-2 devstack@n-api.service[121402]: Accept-Encoding: identity Nov 01 19:08:03.248447 n-d-863052-2 devstack@n-api.service[121402]: Connection: close Nov 01 19:08:03.248447 n-d-863052-2 devstack@n-api.service[121402]: Content-Length: 754 Nov 01 19:08:03.248447 n-d-863052-2 devstack@n-api.service[121402]: Content-Type: application/json Nov 01 19:08:03.248447 n-d-863052-2 devstack@n-api.service[121402]: Host: 10.222.0.13 Nov 01 19:08:03.248447 n-d-863052-2 devstack@n-api.service[121402]: Openstack-System-Scope: None Nov 01 19:08:03.248447 n-d-863052-2 devstack@n-api.service[121402]: User-Agent: python-urllib3/1.26.12 Nov 01 19:08:03.248447 n-d-863052-2 devstack@n-api.service[121402]: X-Auth-Token: gAAAAABjYW6A_zo37UoyTGqmLiBbzVZAIcCwF8Jo_l29ziAaByPmJ2pwikzRg_TlNxgJjI75pzbQ2PW0duNreTXxYfNkvSQD4TNjwied1o0eXEbhsN6T-mYWAKZ9dTKYMAH1Py5SQtMH4I20d_YLeOK_c7Msy3lItgeqsXmRSJcSWXkcAGNY7HU Nov 01 19:08:03.248447 n-d-863052-2 devstack@n-api.service[121402]: X-Domain-Id: None Nov 01 19:08:03.248447 n-d-863052-2 devstack@n-api.service[121402]: X-Domain-Name: None Nov 01 19:08:03.248447 n-d-863052-2 devstack@n-api.service[121402]: X-Identity-Status: Confirmed Nov 01 19:08:03.248447 n-d-863052-2 devstack@n-api.service[121402]: X-Is-Admin-Project: True Nov 01 19:08:03.248447 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Domain-Id: default Nov 01 19:08:03.248447 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Domain-Name: Default Nov 01 19:08:03.248447 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Id: d702a70dab124153b4f40d3219ffc5f3 Nov 01 19:08:03.248447 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-414983834 Nov 01 19:08:03.248447 n-d-863052-2 devstack@n-api.service[121402]: X-Role: member,reader Nov 01 19:08:03.248447 n-d-863052-2 devstack@n-api.service[121402]: X-Roles: member,reader Nov 01 19:08:03.248447 n-d-863052-2 devstack@n-api.service[121402]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/d702a70dab124153b4f40d3219ffc5f3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/d702a70dab124153b4f40d3219ffc5f3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_d702a70dab124153b4f40d3219ffc5f3", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/d702a70dab124153b4f40d3219ffc5f3"}]}] Nov 01 19:08:03.248447 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-414983834 Nov 01 19:08:03.248447 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant-Id: d702a70dab124153b4f40d3219ffc5f3 Nov 01 19:08:03.248447 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-414983834 Nov 01 19:08:03.248447 n-d-863052-2 devstack@n-api.service[121402]: X-User: tempest-ServerMetadataNegativeTestJSON-414983834-project Nov 01 19:08:03.248447 n-d-863052-2 devstack@n-api.service[121402]: X-User-Domain-Id: default Nov 01 19:08:03.248447 n-d-863052-2 devstack@n-api.service[121402]: X-User-Domain-Name: Default Nov 01 19:08:03.248447 n-d-863052-2 devstack@n-api.service[121402]: X-User-Id: aebd68d6b30e45debbfd99ee6360f905 Nov 01 19:08:03.248447 n-d-863052-2 devstack@n-api.service[121402]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-414983834-project Nov 01 19:08:03.248447 n-d-863052-2 devstack@n-api.service[121402]: Nov 01 19:08:03.248447 n-d-863052-2 devstack@n-api.service[121402]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1386684997", "imageRef": "2d4a0047-1b9e-445f-8af8-1b5c9d93e881", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "3d22c6c2-f92e-4412-8eb6-291b21149bea"}]}} Nov 01 19:08:03.248447 n-d-863052-2 devstack@n-api.service[121402]: method: > Nov 01 19:08:03.248447 n-d-863052-2 devstack@n-api.service[121402]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Nov 01 19:08:03.248447 n-d-863052-2 devstack@n-api.service[121402]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-1386684997', 'imageRef': '2d4a0047-1b9e-445f-8af8-1b5c9d93e881', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '3d22c6c2-f92e-4412-8eb6-291b21149bea'}]}}} Nov 01 19:08:03.248447 n-d-863052-2 devstack@n-api.service[121402]: {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 01 19:08:03.248447 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:08:03.248447 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Nov 01 19:08:03.248447 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Nov 01 19:08:03.248447 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Nov 01 19:08:03.251824 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise error Nov 01 19:08:03.251824 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Nov 01 19:08:03.251824 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:08:03.251824 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Nov 01 19:08:03.251824 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Nov 01 19:08:03.251824 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Nov 01 19:08:03.251824 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Nov 01 19:08:03.251824 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi 'type': 'object'} Nov 01 19:08:03.251824 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:08:03.251824 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi On instance['server']: Nov 01 19:08:03.251824 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Nov 01 19:08:03.251824 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:08:03.251824 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:08:03.251824 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:08:03.251824 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:08:03.251824 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:08:03.251824 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:08:03.251824 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 01 19:08:03.251824 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 01 19:08:03.251824 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 01 19:08:03.251824 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 01 19:08:03.251824 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 01 19:08:03.251824 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 01 19:08:03.251824 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Nov 01 19:08:03.251824 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Nov 01 19:08:03.251824 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Nov 01 19:08:03.251824 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Nov 01 19:08:03.251824 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Nov 01 19:08:03.251824 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Nov 01 19:08:03.251824 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Nov 01 19:08:03.251824 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:08:03.251824 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:08:03.251824 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:08:03.251824 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:08:03.251824 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:08:03.251824 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:08:03.251824 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Nov 01 19:08:03.251824 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Nov 01 19:08:03.257030 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Nov 01 19:08:03.257030 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:08:03.257030 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-9746c36c-b82b-4f64-a796-e320e685725c tempest-ServerMetadataNegativeTestJSON-414983834 tempest-ServerMetadataNegativeTestJSON-414983834-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=121402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 01 19:08:03.257030 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-9746c36c-b82b-4f64-a796-e320e685725c tempest-ServerMetadataNegativeTestJSON-414983834 tempest-ServerMetadataNegativeTestJSON-414983834-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 400 len: 1197 microversion: 2.1 time: 0.017074 Nov 01 19:08:03.257030 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1650/3373] 10.222.0.13 () {60 vars in 1147 bytes} [Tue Nov 1 19:08:03 2022] POST /compute/v2.1/servers => generated 1197 bytes in 21 msecs (HTTP/1.1 400) 9 headers in 382 bytes (1 switches on core 0) Nov 01 19:08:03.326674 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-667f58f9-6090-498f-b1d1-22e2d7257c52 tempest-ImagesOneServerTestJSON-1044295602 tempest-ImagesOneServerTestJSON-1044295602-project] 10.222.0.13 "GET /compute/v2.1/images/621c9785-490d-4245-8b6b-91f8571f7eab" status: 200 len: 1422 microversion: 2.1 time: 0.086458 Nov 01 19:08:03.327632 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1724/3374] 10.222.0.13 () {58 vars in 1233 bytes} [Tue Nov 1 19:08:03 2022] GET /compute/v2.1/images/621c9785-490d-4245-8b6b-91f8571f7eab => generated 1422 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:08:03.345155 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-87ce6e46-9da4-4370-8ac5-9330f0233c71 tempest-ServerMetadataNegativeTestJSON-414983834 tempest-ServerMetadataNegativeTestJSON-414983834-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1324832717", "imageRef": "2d4a0047-1b9e-445f-8af8-1b5c9d93e881", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "3d22c6c2-f92e-4412-8eb6-291b21149bea"}]}} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:08:03.359120 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-87ce6e46-9da4-4370-8ac5-9330f0233c71 tempest-ServerMetadataNegativeTestJSON-414983834 tempest-ServerMetadataNegativeTestJSON-414983834-project] Request method failure captured: Nov 01 19:08:03.359120 n-d-863052-2 devstack@n-api.service[121402]: request: POST /compute/v2.1/servers HTTP/1.1 Nov 01 19:08:03.359120 n-d-863052-2 devstack@n-api.service[121402]: Accept: application/json Nov 01 19:08:03.359120 n-d-863052-2 devstack@n-api.service[121402]: Accept-Encoding: identity Nov 01 19:08:03.359120 n-d-863052-2 devstack@n-api.service[121402]: Connection: close Nov 01 19:08:03.359120 n-d-863052-2 devstack@n-api.service[121402]: Content-Length: 1266 Nov 01 19:08:03.359120 n-d-863052-2 devstack@n-api.service[121402]: Content-Type: application/json Nov 01 19:08:03.359120 n-d-863052-2 devstack@n-api.service[121402]: Host: 10.222.0.13 Nov 01 19:08:03.359120 n-d-863052-2 devstack@n-api.service[121402]: Openstack-System-Scope: None Nov 01 19:08:03.359120 n-d-863052-2 devstack@n-api.service[121402]: User-Agent: python-urllib3/1.26.12 Nov 01 19:08:03.359120 n-d-863052-2 devstack@n-api.service[121402]: X-Auth-Token: gAAAAABjYW6A_zo37UoyTGqmLiBbzVZAIcCwF8Jo_l29ziAaByPmJ2pwikzRg_TlNxgJjI75pzbQ2PW0duNreTXxYfNkvSQD4TNjwied1o0eXEbhsN6T-mYWAKZ9dTKYMAH1Py5SQtMH4I20d_YLeOK_c7Msy3lItgeqsXmRSJcSWXkcAGNY7HU Nov 01 19:08:03.359120 n-d-863052-2 devstack@n-api.service[121402]: X-Domain-Id: None Nov 01 19:08:03.359120 n-d-863052-2 devstack@n-api.service[121402]: X-Domain-Name: None Nov 01 19:08:03.359120 n-d-863052-2 devstack@n-api.service[121402]: X-Identity-Status: Confirmed Nov 01 19:08:03.359120 n-d-863052-2 devstack@n-api.service[121402]: X-Is-Admin-Project: True Nov 01 19:08:03.359120 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Domain-Id: default Nov 01 19:08:03.359120 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Domain-Name: Default Nov 01 19:08:03.359120 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Id: d702a70dab124153b4f40d3219ffc5f3 Nov 01 19:08:03.359120 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-414983834 Nov 01 19:08:03.359120 n-d-863052-2 devstack@n-api.service[121402]: X-Role: member,reader Nov 01 19:08:03.359120 n-d-863052-2 devstack@n-api.service[121402]: X-Roles: member,reader Nov 01 19:08:03.359120 n-d-863052-2 devstack@n-api.service[121402]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/d702a70dab124153b4f40d3219ffc5f3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/d702a70dab124153b4f40d3219ffc5f3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_d702a70dab124153b4f40d3219ffc5f3", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/d702a70dab124153b4f40d3219ffc5f3"}]}] Nov 01 19:08:03.359120 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-414983834 Nov 01 19:08:03.359120 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant-Id: d702a70dab124153b4f40d3219ffc5f3 Nov 01 19:08:03.359120 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-414983834 Nov 01 19:08:03.359120 n-d-863052-2 devstack@n-api.service[121402]: X-User: tempest-ServerMetadataNegativeTestJSON-414983834-project Nov 01 19:08:03.359120 n-d-863052-2 devstack@n-api.service[121402]: X-User-Domain-Id: default Nov 01 19:08:03.359120 n-d-863052-2 devstack@n-api.service[121402]: X-User-Domain-Name: Default Nov 01 19:08:03.359120 n-d-863052-2 devstack@n-api.service[121402]: X-User-Id: aebd68d6b30e45debbfd99ee6360f905 Nov 01 19:08:03.359120 n-d-863052-2 devstack@n-api.service[121402]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-414983834-project Nov 01 19:08:03.359120 n-d-863052-2 devstack@n-api.service[121402]: Nov 01 19:08:03.359120 n-d-863052-2 devstack@n-api.service[121402]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1324832717", "imageRef": "2d4a0047-1b9e-445f-8af8-1b5c9d93e881", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "3d22c6c2-f92e-4412-8eb6-291b21149bea"}]}} Nov 01 19:08:03.359120 n-d-863052-2 devstack@n-api.service[121402]: method: > Nov 01 19:08:03.362621 n-d-863052-2 devstack@n-api.service[121402]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Nov 01 19:08:03.362621 n-d-863052-2 devstack@n-api.service[121402]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-1324832717', 'imageRef': '2d4a0047-1b9e-445f-8af8-1b5c9d93e881', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '3d22c6c2-f92e-4412-8eb6-291b21149bea'}]}}} Nov 01 19:08:03.362621 n-d-863052-2 devstack@n-api.service[121402]: {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 01 19:08:03.362621 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:08:03.362621 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Nov 01 19:08:03.362621 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Nov 01 19:08:03.362621 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Nov 01 19:08:03.362621 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise error Nov 01 19:08:03.362621 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Nov 01 19:08:03.362621 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:08:03.362621 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Nov 01 19:08:03.362621 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Nov 01 19:08:03.362621 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Nov 01 19:08:03.362621 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Nov 01 19:08:03.362621 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi 'type': 'object'} Nov 01 19:08:03.362621 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:08:03.362621 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi On instance['server']: Nov 01 19:08:03.364385 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Nov 01 19:08:03.364385 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:08:03.364385 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:08:03.364385 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:08:03.364385 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:08:03.364385 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:08:03.364385 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:08:03.364385 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 01 19:08:03.364385 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 01 19:08:03.364385 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 01 19:08:03.364385 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 01 19:08:03.364385 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 01 19:08:03.364385 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 01 19:08:03.364385 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Nov 01 19:08:03.364385 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Nov 01 19:08:03.364385 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Nov 01 19:08:03.364385 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Nov 01 19:08:03.364385 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Nov 01 19:08:03.364385 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Nov 01 19:08:03.364385 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Nov 01 19:08:03.364385 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:08:03.364385 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:08:03.364385 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:08:03.364385 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:08:03.364385 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:08:03.364385 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:08:03.364385 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Nov 01 19:08:03.364385 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Nov 01 19:08:03.367078 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Nov 01 19:08:03.367078 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:08:03.369070 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-87ce6e46-9da4-4370-8ac5-9330f0233c71 tempest-ServerMetadataNegativeTestJSON-414983834 tempest-ServerMetadataNegativeTestJSON-414983834-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=121402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 01 19:08:03.374829 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-87ce6e46-9da4-4370-8ac5-9330f0233c71 tempest-ServerMetadataNegativeTestJSON-414983834 tempest-ServerMetadataNegativeTestJSON-414983834-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 400 len: 2221 microversion: 2.1 time: 0.033302 Nov 01 19:08:03.376873 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1651/3375] 10.222.0.13 () {60 vars in 1148 bytes} [Tue Nov 1 19:08:03 2022] POST /compute/v2.1/servers => generated 2221 bytes in 37 msecs (HTTP/1.1 400) 9 headers in 382 bytes (2 switches on core 0) Nov 01 19:08:03.392060 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-bbe55f96-af32-47c8-98d3-523f7a305efc tempest-ServerMetadataNegativeTestJSON-414983834 tempest-ServerMetadataNegativeTestJSON-414983834-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:08:03.392569 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-bbe55f96-af32-47c8-98d3-523f7a305efc tempest-ServerMetadataNegativeTestJSON-414983834 tempest-ServerMetadataNegativeTestJSON-414983834-project] [instance: 3076715b-f55f-4a16-9bee-15e7a79d9fee] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:08:03.409618 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.wsgi [None req-bbe55f96-af32-47c8-98d3-523f7a305efc tempest-ServerMetadataNegativeTestJSON-414983834 tempest-ServerMetadataNegativeTestJSON-414983834-project] HTTP exception thrown: Instance 3076715b-f55f-4a16-9bee-15e7a79d9fee could not be found. Nov 01 19:08:03.416280 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-bbe55f96-af32-47c8-98d3-523f7a305efc tempest-ServerMetadataNegativeTestJSON-414983834 tempest-ServerMetadataNegativeTestJSON-414983834-project] Request method failure captured: Nov 01 19:08:03.416280 n-d-863052-2 devstack@n-api.service[121403]: request: GET /compute/v2.1/servers/3076715b-f55f-4a16-9bee-15e7a79d9fee/metadata/test2 HTTP/1.1 Nov 01 19:08:03.416280 n-d-863052-2 devstack@n-api.service[121403]: Accept: application/json Nov 01 19:08:03.416280 n-d-863052-2 devstack@n-api.service[121403]: Accept-Encoding: identity Nov 01 19:08:03.416280 n-d-863052-2 devstack@n-api.service[121403]: Connection: close Nov 01 19:08:03.416280 n-d-863052-2 devstack@n-api.service[121403]: Content-Length: 0 Nov 01 19:08:03.416280 n-d-863052-2 devstack@n-api.service[121403]: Content-Type: application/json Nov 01 19:08:03.416280 n-d-863052-2 devstack@n-api.service[121403]: Host: 10.222.0.13 Nov 01 19:08:03.416280 n-d-863052-2 devstack@n-api.service[121403]: Openstack-System-Scope: None Nov 01 19:08:03.416280 n-d-863052-2 devstack@n-api.service[121403]: User-Agent: python-urllib3/1.26.12 Nov 01 19:08:03.416280 n-d-863052-2 devstack@n-api.service[121403]: X-Auth-Token: gAAAAABjYW6A_zo37UoyTGqmLiBbzVZAIcCwF8Jo_l29ziAaByPmJ2pwikzRg_TlNxgJjI75pzbQ2PW0duNreTXxYfNkvSQD4TNjwied1o0eXEbhsN6T-mYWAKZ9dTKYMAH1Py5SQtMH4I20d_YLeOK_c7Msy3lItgeqsXmRSJcSWXkcAGNY7HU Nov 01 19:08:03.416280 n-d-863052-2 devstack@n-api.service[121403]: X-Domain-Id: None Nov 01 19:08:03.416280 n-d-863052-2 devstack@n-api.service[121403]: X-Domain-Name: None Nov 01 19:08:03.416280 n-d-863052-2 devstack@n-api.service[121403]: X-Identity-Status: Confirmed Nov 01 19:08:03.416280 n-d-863052-2 devstack@n-api.service[121403]: X-Is-Admin-Project: True Nov 01 19:08:03.416280 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Domain-Id: default Nov 01 19:08:03.416280 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Domain-Name: Default Nov 01 19:08:03.416280 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Id: d702a70dab124153b4f40d3219ffc5f3 Nov 01 19:08:03.416280 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-414983834 Nov 01 19:08:03.416280 n-d-863052-2 devstack@n-api.service[121403]: X-Role: member,reader Nov 01 19:08:03.416280 n-d-863052-2 devstack@n-api.service[121403]: X-Roles: member,reader Nov 01 19:08:03.416280 n-d-863052-2 devstack@n-api.service[121403]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/d702a70dab124153b4f40d3219ffc5f3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/d702a70dab124153b4f40d3219ffc5f3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_d702a70dab124153b4f40d3219ffc5f3", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/d702a70dab124153b4f40d3219ffc5f3"}]}] Nov 01 19:08:03.416280 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-414983834 Nov 01 19:08:03.416280 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant-Id: d702a70dab124153b4f40d3219ffc5f3 Nov 01 19:08:03.416280 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-414983834 Nov 01 19:08:03.416280 n-d-863052-2 devstack@n-api.service[121403]: X-User: tempest-ServerMetadataNegativeTestJSON-414983834-project Nov 01 19:08:03.416280 n-d-863052-2 devstack@n-api.service[121403]: X-User-Domain-Id: default Nov 01 19:08:03.416280 n-d-863052-2 devstack@n-api.service[121403]: X-User-Domain-Name: Default Nov 01 19:08:03.416280 n-d-863052-2 devstack@n-api.service[121403]: X-User-Id: aebd68d6b30e45debbfd99ee6360f905 Nov 01 19:08:03.416280 n-d-863052-2 devstack@n-api.service[121403]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-414983834-project Nov 01 19:08:03.416280 n-d-863052-2 devstack@n-api.service[121403]: method: > Nov 01 19:08:03.416280 n-d-863052-2 devstack@n-api.service[121403]: exception: Instance 3076715b-f55f-4a16-9bee-15e7a79d9fee could not be found. Nov 01 19:08:03.416280 n-d-863052-2 devstack@n-api.service[121403]: action_args: {'server_id': '3076715b-f55f-4a16-9bee-15e7a79d9fee', 'id': 'test2'} Nov 01 19:08:03.416280 n-d-863052-2 devstack@n-api.service[121403]: {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 01 19:08:03.416280 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:08:03.416280 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 01 19:08:03.416280 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 01 19:08:03.416280 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 01 19:08:03.416280 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 01 19:08:03.416280 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Nov 01 19:08:03.416280 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Nov 01 19:08:03.416280 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3076715b-f55f-4a16-9bee-15e7a79d9fee could not be found. Nov 01 19:08:03.416280 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:08:03.416280 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:08:03.416280 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:08:03.416280 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:08:03.416280 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:08:03.416280 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:08:03.416280 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 01 19:08:03.416280 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 01 19:08:03.416280 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 01 19:08:03.416280 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 01 19:08:03.416280 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_metadata.py", line 129, in show Nov 01 19:08:03.416280 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, server_id) Nov 01 19:08:03.416280 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 01 19:08:03.416280 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 01 19:08:03.416280 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3076715b-f55f-4a16-9bee-15e7a79d9fee could not be found. Nov 01 19:08:03.416280 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:08:03.416280 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:08:03.416280 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:08:03.416280 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:08:03.416280 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:08:03.416280 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:08:03.420665 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 01 19:08:03.420665 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 01 19:08:03.420665 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3076715b-f55f-4a16-9bee-15e7a79d9fee could not be found. Nov 01 19:08:03.420665 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:08:03.422736 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-bbe55f96-af32-47c8-98d3-523f7a305efc tempest-ServerMetadataNegativeTestJSON-414983834 tempest-ServerMetadataNegativeTestJSON-414983834-project] Returning 404 to user: Instance 3076715b-f55f-4a16-9bee-15e7a79d9fee could not be found. {{(pid=121403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 01 19:08:03.423829 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-bbe55f96-af32-47c8-98d3-523f7a305efc tempest-ServerMetadataNegativeTestJSON-414983834 tempest-ServerMetadataNegativeTestJSON-414983834-project] 10.222.0.13 "GET /compute/v2.1/servers/3076715b-f55f-4a16-9bee-15e7a79d9fee/metadata/test2" status: 404 len: 111 microversion: 2.1 time: 0.036510 Nov 01 19:08:03.439087 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1725/3376] 10.222.0.13 () {58 vars in 1281 bytes} [Tue Nov 1 19:08:03 2022] GET /compute/v2.1/servers/3076715b-f55f-4a16-9bee-15e7a79d9fee/metadata/test2 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 01 19:08:03.490491 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-a707f427-c963-4dd1-96da-e8649833895d tempest-ServerMetadataNegativeTestJSON-414983834 tempest-ServerMetadataNegativeTestJSON-414983834-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:08:03.491198 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-a707f427-c963-4dd1-96da-e8649833895d tempest-ServerMetadataNegativeTestJSON-414983834 tempest-ServerMetadataNegativeTestJSON-414983834-project] [instance: 6bb5dbff-cdc7-4986-8606-cec948c9d28c] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:08:03.515177 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-a707f427-c963-4dd1-96da-e8649833895d tempest-ServerMetadataNegativeTestJSON-414983834 tempest-ServerMetadataNegativeTestJSON-414983834-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:08:03.516281 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-a707f427-c963-4dd1-96da-e8649833895d tempest-ServerMetadataNegativeTestJSON-414983834 tempest-ServerMetadataNegativeTestJSON-414983834-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:08:03.516979 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-a707f427-c963-4dd1-96da-e8649833895d tempest-ServerMetadataNegativeTestJSON-414983834 tempest-ServerMetadataNegativeTestJSON-414983834-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:08:03.517724 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-a707f427-c963-4dd1-96da-e8649833895d tempest-ServerMetadataNegativeTestJSON-414983834 tempest-ServerMetadataNegativeTestJSON-414983834-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:08:03.518372 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-a707f427-c963-4dd1-96da-e8649833895d tempest-ServerMetadataNegativeTestJSON-414983834 tempest-ServerMetadataNegativeTestJSON-414983834-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:08:03.518960 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-a707f427-c963-4dd1-96da-e8649833895d tempest-ServerMetadataNegativeTestJSON-414983834 tempest-ServerMetadataNegativeTestJSON-414983834-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:08:03.552573 n-d-863052-2 devstack@n-api.service[121402]: DEBUG dbcounter [-] [121402] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 19:08:03.567860 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-a707f427-c963-4dd1-96da-e8649833895d tempest-ServerMetadataNegativeTestJSON-414983834 tempest-ServerMetadataNegativeTestJSON-414983834-project] [instance: 6bb5dbff-cdc7-4986-8606-cec948c9d28c] Going to try to terminate instance {{(pid=121402) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 01 19:08:03.656623 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-a6e364c1-a83f-4d14-9885-421506c99276 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:08:03.657266 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-a6e364c1-a83f-4d14-9885-421506c99276 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] [instance: 8485db2a-fd8f-4615-bbe0-14822ad44194] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:08:03.672901 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-a6e364c1-a83f-4d14-9885-421506c99276 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:08:03.673765 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-a6e364c1-a83f-4d14-9885-421506c99276 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:08:03.674669 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-a6e364c1-a83f-4d14-9885-421506c99276 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:08:03.677860 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-a6e364c1-a83f-4d14-9885-421506c99276 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:08:03.679815 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-a6e364c1-a83f-4d14-9885-421506c99276 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:08:03.681333 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-a6e364c1-a83f-4d14-9885-421506c99276 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:08:03.683578 n-d-863052-2 devstack@n-api.service[121402]: DEBUG dbcounter [-] [121402] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=1,nova_api:DELETE=2,nova_api:INSERT=3 {{(pid=121402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 19:08:03.722156 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-a707f427-c963-4dd1-96da-e8649833895d tempest-ServerMetadataNegativeTestJSON-414983834 tempest-ServerMetadataNegativeTestJSON-414983834-project] 10.222.0.13 "DELETE /compute/v2.1/servers/6bb5dbff-cdc7-4986-8606-cec948c9d28c" status: 204 len: 0 microversion: 2.1 time: 0.252430 Nov 01 19:08:03.723216 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1652/3377] 10.222.0.13 () {58 vars in 1239 bytes} [Tue Nov 1 19:08:03 2022] DELETE /compute/v2.1/servers/6bb5dbff-cdc7-4986-8606-cec948c9d28c => generated 0 bytes in 258 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 01 19:08:03.738388 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-375f62a9-49e1-4ce5-82f9-93878c9c35b6 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:08:03.739923 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-375f62a9-49e1-4ce5-82f9-93878c9c35b6 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] [instance: 7c9dac18-3bfc-4379-ab97-25d185cd6b85] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:08:03.753641 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-375f62a9-49e1-4ce5-82f9-93878c9c35b6 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:08:03.755819 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-375f62a9-49e1-4ce5-82f9-93878c9c35b6 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:08:03.756340 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-375f62a9-49e1-4ce5-82f9-93878c9c35b6 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:08:03.759339 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-375f62a9-49e1-4ce5-82f9-93878c9c35b6 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:08:03.760045 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-375f62a9-49e1-4ce5-82f9-93878c9c35b6 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:08:03.763498 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-375f62a9-49e1-4ce5-82f9-93878c9c35b6 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:08:04.062776 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-375f62a9-49e1-4ce5-82f9-93878c9c35b6 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113bd8c844ee490b86a68bc7e1e75da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '851785a5f76548898a77d67792888504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:08:04.068733 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-a6e364c1-a83f-4d14-9885-421506c99276 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '058480d92c9b4ab4af6815d0438a65c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee9dc49b89143f781e4ab30296e4d01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:08:04.077666 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-375f62a9-49e1-4ce5-82f9-93878c9c35b6 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] 10.222.0.13 "GET /compute/v2.1/servers/7c9dac18-3bfc-4379-ab97-25d185cd6b85" status: 200 len: 1309 microversion: 2.1 time: 0.351651 Nov 01 19:08:04.078528 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1653/3378] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:08:03 2022] GET /compute/v2.1/servers/7c9dac18-3bfc-4379-ab97-25d185cd6b85 => generated 1309 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:08:04.081231 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-a6e364c1-a83f-4d14-9885-421506c99276 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] 10.222.0.13 "GET /compute/v2.1/servers/8485db2a-fd8f-4615-bbe0-14822ad44194" status: 200 len: 1508 microversion: 2.1 time: 0.433107 Nov 01 19:08:04.093595 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-046ee21c-29bb-4b11-850b-65443d0099e6 tempest-ServerMetadataNegativeTestJSON-414983834 tempest-ServerMetadataNegativeTestJSON-414983834-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:08:04.093595 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-046ee21c-29bb-4b11-850b-65443d0099e6 tempest-ServerMetadataNegativeTestJSON-414983834 tempest-ServerMetadataNegativeTestJSON-414983834-project] [instance: 6bb5dbff-cdc7-4986-8606-cec948c9d28c] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:08:04.095264 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1726/3379] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:08:03 2022] GET /compute/v2.1/servers/8485db2a-fd8f-4615-bbe0-14822ad44194 => generated 1508 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 19:08:04.112543 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-046ee21c-29bb-4b11-850b-65443d0099e6 tempest-ServerMetadataNegativeTestJSON-414983834 tempest-ServerMetadataNegativeTestJSON-414983834-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:08:04.118210 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-046ee21c-29bb-4b11-850b-65443d0099e6 tempest-ServerMetadataNegativeTestJSON-414983834 tempest-ServerMetadataNegativeTestJSON-414983834-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:08:04.119257 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-046ee21c-29bb-4b11-850b-65443d0099e6 tempest-ServerMetadataNegativeTestJSON-414983834 tempest-ServerMetadataNegativeTestJSON-414983834-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:08:04.120235 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-046ee21c-29bb-4b11-850b-65443d0099e6 tempest-ServerMetadataNegativeTestJSON-414983834 tempest-ServerMetadataNegativeTestJSON-414983834-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:08:04.121511 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-046ee21c-29bb-4b11-850b-65443d0099e6 tempest-ServerMetadataNegativeTestJSON-414983834 tempest-ServerMetadataNegativeTestJSON-414983834-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:08:04.122134 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-046ee21c-29bb-4b11-850b-65443d0099e6 tempest-ServerMetadataNegativeTestJSON-414983834 tempest-ServerMetadataNegativeTestJSON-414983834-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:08:04.347728 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-c248d932-5e7c-406e-b93b-e5bd76c261af tempest-ImagesOneServerTestJSON-1044295602 tempest-ImagesOneServerTestJSON-1044295602-project] Calling method '.version_select at 0x7f0ae28248b0>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:08:04.434022 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-c248d932-5e7c-406e-b93b-e5bd76c261af tempest-ImagesOneServerTestJSON-1044295602 tempest-ImagesOneServerTestJSON-1044295602-project] 10.222.0.13 "GET /compute/v2.1/images/621c9785-490d-4245-8b6b-91f8571f7eab" status: 200 len: 1422 microversion: 2.1 time: 0.093808 Nov 01 19:08:04.434703 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1727/3380] 10.222.0.13 () {58 vars in 1233 bytes} [Tue Nov 1 19:08:04 2022] GET /compute/v2.1/images/621c9785-490d-4245-8b6b-91f8571f7eab => generated 1422 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 19:08:04.524331 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-41fdfb69-5b7e-47fe-8945-7ed982e47d2a tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Action: 'create', calling method: .version_select at 0x7f0ae687c8b0>, body: {"keypair": {"name": "tempest-keypair-954591625", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHhnH/4l09RgflfhFRWQIIWaOqrIjSuXBFz+oYT4X4oby5rmWHmcv2Y1Iz6+zyW58G7xHCYogf782A75SJu7dV7aoOYd56dpH+JIHy5CtYqC2E0mnqGs00hMARrPoi+kWQ=="}} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:08:04.574855 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.quota [None req-41fdfb69-5b7e-47fe-8945-7ed982e47d2a tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Getting quotas for project 33e3d319293c46b6af2f728a50586906. Resources: {'key_pairs'} {{(pid=121403) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 01 19:08:04.591311 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.quota [None req-41fdfb69-5b7e-47fe-8945-7ed982e47d2a tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Getting quotas for user 790f3f1566b7464aaca19d4d05c0942e and project 33e3d319293c46b6af2f728a50586906. Resources: {'key_pairs'} {{(pid=121403) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 01 19:08:04.653208 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-046ee21c-29bb-4b11-850b-65443d0099e6 tempest-ServerMetadataNegativeTestJSON-414983834 tempest-ServerMetadataNegativeTestJSON-414983834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aebd68d6b30e45debbfd99ee6360f905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd702a70dab124153b4f40d3219ffc5f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:08:04.664162 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-41fdfb69-5b7e-47fe-8945-7ed982e47d2a tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.148978 Nov 01 19:08:04.670693 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1728/3381] 10.222.0.13 () {60 vars in 1159 bytes} [Tue Nov 1 19:08:04 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:08:04.673620 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-046ee21c-29bb-4b11-850b-65443d0099e6 tempest-ServerMetadataNegativeTestJSON-414983834 tempest-ServerMetadataNegativeTestJSON-414983834-project] 10.222.0.13 "GET /compute/v2.1/servers/6bb5dbff-cdc7-4986-8606-cec948c9d28c" status: 200 len: 1525 microversion: 2.1 time: 0.593854 Nov 01 19:08:04.703871 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1654/3382] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:08:04 2022] GET /compute/v2.1/servers/6bb5dbff-cdc7-4986-8606-cec948c9d28c => generated 1525 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:08:05.109434 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-205ab92b-e9d2-4850-81da-35c1acb96643 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:08:05.110106 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-205ab92b-e9d2-4850-81da-35c1acb96643 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] [instance: 8485db2a-fd8f-4615-bbe0-14822ad44194] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:08:05.117037 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-c19d0b21-3714-47b7-b140-ebe64d024177 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:08:05.117662 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-c19d0b21-3714-47b7-b140-ebe64d024177 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] [instance: 7c9dac18-3bfc-4379-ab97-25d185cd6b85] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:08:05.131194 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-205ab92b-e9d2-4850-81da-35c1acb96643 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:08:05.136041 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-c19d0b21-3714-47b7-b140-ebe64d024177 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:08:05.137093 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-205ab92b-e9d2-4850-81da-35c1acb96643 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:08:05.138366 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-205ab92b-e9d2-4850-81da-35c1acb96643 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:08:05.138850 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-c19d0b21-3714-47b7-b140-ebe64d024177 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:08:05.139954 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-c19d0b21-3714-47b7-b140-ebe64d024177 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:08:05.141668 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-c19d0b21-3714-47b7-b140-ebe64d024177 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:08:05.142380 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-205ab92b-e9d2-4850-81da-35c1acb96643 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:08:05.143213 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-205ab92b-e9d2-4850-81da-35c1acb96643 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:08:05.144103 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-c19d0b21-3714-47b7-b140-ebe64d024177 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:08:05.144814 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-205ab92b-e9d2-4850-81da-35c1acb96643 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:08:05.145839 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-c19d0b21-3714-47b7-b140-ebe64d024177 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:08:05.537636 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-c19d0b21-3714-47b7-b140-ebe64d024177 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113bd8c844ee490b86a68bc7e1e75da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '851785a5f76548898a77d67792888504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:08:05.550252 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-c19d0b21-3714-47b7-b140-ebe64d024177 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] 10.222.0.13 "GET /compute/v2.1/servers/7c9dac18-3bfc-4379-ab97-25d185cd6b85" status: 200 len: 1309 microversion: 2.1 time: 0.448387 Nov 01 19:08:05.552438 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1729/3383] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:08:05 2022] GET /compute/v2.1/servers/7c9dac18-3bfc-4379-ab97-25d185cd6b85 => generated 1309 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:08:05.558310 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [req-f8b8389a-3880-4256-b564-495b634ff358 req-965d7c0f-bb92-4d7c-8eb6-1a54c8d01fa9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7c9dac18-3bfc-4379-ab97-25d185cd6b85", "tag": "db3ec26a-e23c-42e4-acbb-72a089522cfa"}]} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:08:05.569821 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-f8b8389a-3880-4256-b564-495b634ff358 req-965d7c0f-bb92-4d7c-8eb6-1a54c8d01fa9 service nova] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:08:05.570627 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-f8b8389a-3880-4256-b564-495b634ff358 req-965d7c0f-bb92-4d7c-8eb6-1a54c8d01fa9 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:08:05.572034 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-f8b8389a-3880-4256-b564-495b634ff358 req-965d7c0f-bb92-4d7c-8eb6-1a54c8d01fa9 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:08:05.609601 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.compute.server_external_events [req-f8b8389a-3880-4256-b564-495b634ff358 req-965d7c0f-bb92-4d7c-8eb6-1a54c8d01fa9 service nova] Creating event network-changed:db3ec26a-e23c-42e4-acbb-72a089522cfa for instance 7c9dac18-3bfc-4379-ab97-25d185cd6b85 on n-h1-863052-2 Nov 01 19:08:05.618959 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [req-f8b8389a-3880-4256-b564-495b634ff358 req-965d7c0f-bb92-4d7c-8eb6-1a54c8d01fa9 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063993 Nov 01 19:08:05.619902 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1730/3384] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Nov 1 19:08:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:08:05.625775 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-bd8502e1-4cd8-4a72-a06f-c760a8cafe43 tempest-ImagesOneServerTestJSON-1044295602 tempest-ImagesOneServerTestJSON-1044295602-project] Calling method '.version_select at 0x7f0ae2ebb550>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:08:05.706529 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-bd8502e1-4cd8-4a72-a06f-c760a8cafe43 tempest-ImagesOneServerTestJSON-1044295602 tempest-ImagesOneServerTestJSON-1044295602-project] 10.222.0.13 "GET /compute/v2.1/images/621c9785-490d-4245-8b6b-91f8571f7eab" status: 200 len: 1422 microversion: 2.1 time: 0.084778 Nov 01 19:08:05.718288 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1731/3385] 10.222.0.13 () {58 vars in 1233 bytes} [Tue Nov 1 19:08:05 2022] GET /compute/v2.1/images/621c9785-490d-4245-8b6b-91f8571f7eab => generated 1422 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:08:05.725257 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-9efd681b-ef32-4af1-a368-7077cef35c68 tempest-ServerMetadataNegativeTestJSON-414983834 tempest-ServerMetadataNegativeTestJSON-414983834-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:08:05.728842 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-9efd681b-ef32-4af1-a368-7077cef35c68 tempest-ServerMetadataNegativeTestJSON-414983834 tempest-ServerMetadataNegativeTestJSON-414983834-project] [instance: 6bb5dbff-cdc7-4986-8606-cec948c9d28c] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:08:05.736269 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-9efd681b-ef32-4af1-a368-7077cef35c68 tempest-ServerMetadataNegativeTestJSON-414983834 tempest-ServerMetadataNegativeTestJSON-414983834-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:08:05.737264 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-9efd681b-ef32-4af1-a368-7077cef35c68 tempest-ServerMetadataNegativeTestJSON-414983834 tempest-ServerMetadataNegativeTestJSON-414983834-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:08:05.738680 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-9efd681b-ef32-4af1-a368-7077cef35c68 tempest-ServerMetadataNegativeTestJSON-414983834 tempest-ServerMetadataNegativeTestJSON-414983834-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:08:05.739760 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-9efd681b-ef32-4af1-a368-7077cef35c68 tempest-ServerMetadataNegativeTestJSON-414983834 tempest-ServerMetadataNegativeTestJSON-414983834-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:08:05.740524 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-9efd681b-ef32-4af1-a368-7077cef35c68 tempest-ServerMetadataNegativeTestJSON-414983834 tempest-ServerMetadataNegativeTestJSON-414983834-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:08:05.741245 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-9efd681b-ef32-4af1-a368-7077cef35c68 tempest-ServerMetadataNegativeTestJSON-414983834 tempest-ServerMetadataNegativeTestJSON-414983834-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:08:05.837826 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-205ab92b-e9d2-4850-81da-35c1acb96643 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '058480d92c9b4ab4af6815d0438a65c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee9dc49b89143f781e4ab30296e4d01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:08:05.849994 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-205ab92b-e9d2-4850-81da-35c1acb96643 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] 10.222.0.13 "GET /compute/v2.1/servers/8485db2a-fd8f-4615-bbe0-14822ad44194" status: 200 len: 1508 microversion: 2.1 time: 0.743704 Nov 01 19:08:05.853824 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1655/3386] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:08:05 2022] GET /compute/v2.1/servers/8485db2a-fd8f-4615-bbe0-14822ad44194 => generated 1508 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:08:06.046833 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-9efd681b-ef32-4af1-a368-7077cef35c68 tempest-ServerMetadataNegativeTestJSON-414983834 tempest-ServerMetadataNegativeTestJSON-414983834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aebd68d6b30e45debbfd99ee6360f905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd702a70dab124153b4f40d3219ffc5f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:08:06.070622 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-9efd681b-ef32-4af1-a368-7077cef35c68 tempest-ServerMetadataNegativeTestJSON-414983834 tempest-ServerMetadataNegativeTestJSON-414983834-project] 10.222.0.13 "GET /compute/v2.1/servers/6bb5dbff-cdc7-4986-8606-cec948c9d28c" status: 200 len: 1525 microversion: 2.1 time: 0.347270 Nov 01 19:08:06.072240 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1732/3387] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:08:05 2022] GET /compute/v2.1/servers/6bb5dbff-cdc7-4986-8606-cec948c9d28c => generated 1525 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:08:06.179698 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-6956c246-eb97-4da2-99d8-bd34f62ece98 tempest-AttachSCSIVolumeTestJSON-356336257 tempest-AttachSCSIVolumeTestJSON-356336257-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:08:06.183222 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-6956c246-eb97-4da2-99d8-bd34f62ece98 tempest-AttachSCSIVolumeTestJSON-356336257 tempest-AttachSCSIVolumeTestJSON-356336257-project] [instance: 8a378b79-bd92-4ade-b034-1aaf5c87b74b] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:08:06.200954 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-6956c246-eb97-4da2-99d8-bd34f62ece98 tempest-AttachSCSIVolumeTestJSON-356336257 tempest-AttachSCSIVolumeTestJSON-356336257-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:08:06.201755 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-6956c246-eb97-4da2-99d8-bd34f62ece98 tempest-AttachSCSIVolumeTestJSON-356336257 tempest-AttachSCSIVolumeTestJSON-356336257-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:08:06.202426 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-6956c246-eb97-4da2-99d8-bd34f62ece98 tempest-AttachSCSIVolumeTestJSON-356336257 tempest-AttachSCSIVolumeTestJSON-356336257-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:08:06.203360 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-6956c246-eb97-4da2-99d8-bd34f62ece98 tempest-AttachSCSIVolumeTestJSON-356336257 tempest-AttachSCSIVolumeTestJSON-356336257-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:08:06.204068 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-6956c246-eb97-4da2-99d8-bd34f62ece98 tempest-AttachSCSIVolumeTestJSON-356336257 tempest-AttachSCSIVolumeTestJSON-356336257-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:08:06.204815 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-6956c246-eb97-4da2-99d8-bd34f62ece98 tempest-AttachSCSIVolumeTestJSON-356336257 tempest-AttachSCSIVolumeTestJSON-356336257-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:08:06.271702 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-6956c246-eb97-4da2-99d8-bd34f62ece98 tempest-AttachSCSIVolumeTestJSON-356336257 tempest-AttachSCSIVolumeTestJSON-356336257-project] 10.222.0.13 "GET /compute/v2.1/servers/8a378b79-bd92-4ade-b034-1aaf5c87b74b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.095932 Nov 01 19:08:06.285395 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-a87eb561-9a2b-4d4c-83fe-ad7831cc21df tempest-AttachSCSIVolumeTestJSON-356336257 tempest-AttachSCSIVolumeTestJSON-356336257-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:08:06.285983 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-a87eb561-9a2b-4d4c-83fe-ad7831cc21df tempest-AttachSCSIVolumeTestJSON-356336257 tempest-AttachSCSIVolumeTestJSON-356336257-project] [instance: 8a378b79-bd92-4ade-b034-1aaf5c87b74b] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:08:06.292117 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1656/3388] 10.222.0.13 () {58 vars in 1302 bytes} [Tue Nov 1 19:08:06 2022] GET /compute/v2.1/servers/8a378b79-bd92-4ade-b034-1aaf5c87b74b/os-volume_attachments => generated 197 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:08:06.299684 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-a87eb561-9a2b-4d4c-83fe-ad7831cc21df tempest-AttachSCSIVolumeTestJSON-356336257 tempest-AttachSCSIVolumeTestJSON-356336257-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:08:06.300564 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-a87eb561-9a2b-4d4c-83fe-ad7831cc21df tempest-AttachSCSIVolumeTestJSON-356336257 tempest-AttachSCSIVolumeTestJSON-356336257-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:08:06.301942 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-a87eb561-9a2b-4d4c-83fe-ad7831cc21df tempest-AttachSCSIVolumeTestJSON-356336257 tempest-AttachSCSIVolumeTestJSON-356336257-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:08:06.302908 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-a87eb561-9a2b-4d4c-83fe-ad7831cc21df tempest-AttachSCSIVolumeTestJSON-356336257 tempest-AttachSCSIVolumeTestJSON-356336257-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:08:06.304074 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-a87eb561-9a2b-4d4c-83fe-ad7831cc21df tempest-AttachSCSIVolumeTestJSON-356336257 tempest-AttachSCSIVolumeTestJSON-356336257-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:08:06.304735 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-a87eb561-9a2b-4d4c-83fe-ad7831cc21df tempest-AttachSCSIVolumeTestJSON-356336257 tempest-AttachSCSIVolumeTestJSON-356336257-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:08:06.349692 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [req-46742c62-68fc-408a-bacb-315df1381bfa req-53c984ce-0e72-482d-b254-9fc8855d2744 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6bb5dbff-cdc7-4986-8606-cec948c9d28c", "name": "network-vif-deleted", "tag": "253432d3-6714-43d0-8c66-5ccffded0825"}]} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:08:06.376461 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-46742c62-68fc-408a-bacb-315df1381bfa req-53c984ce-0e72-482d-b254-9fc8855d2744 service nova] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:08:06.377096 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-46742c62-68fc-408a-bacb-315df1381bfa req-53c984ce-0e72-482d-b254-9fc8855d2744 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:08:06.378421 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-46742c62-68fc-408a-bacb-315df1381bfa req-53c984ce-0e72-482d-b254-9fc8855d2744 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:08:06.406254 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.compute.server_external_events [req-46742c62-68fc-408a-bacb-315df1381bfa req-53c984ce-0e72-482d-b254-9fc8855d2744 service nova] Creating event network-vif-deleted:253432d3-6714-43d0-8c66-5ccffded0825 for instance 6bb5dbff-cdc7-4986-8606-cec948c9d28c on n-h1-863052-2 Nov 01 19:08:06.420183 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [req-46742c62-68fc-408a-bacb-315df1381bfa req-53c984ce-0e72-482d-b254-9fc8855d2744 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074095 Nov 01 19:08:06.423138 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1657/3389] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Nov 1 19:08:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:08:06.497294 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.objects.instance [None req-a87eb561-9a2b-4d4c-83fe-ad7831cc21df tempest-AttachSCSIVolumeTestJSON-356336257 tempest-AttachSCSIVolumeTestJSON-356336257-project] Lazy-loading 'services' on Instance uuid 8a378b79-bd92-4ade-b034-1aaf5c87b74b {{(pid=121403) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 01 19:08:06.581249 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-0dd68910-7483-4272-a882-4e17f5a398ea tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:08:06.582110 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-0dd68910-7483-4272-a882-4e17f5a398ea tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] [instance: 7c9dac18-3bfc-4379-ab97-25d185cd6b85] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:08:06.592151 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-0dd68910-7483-4272-a882-4e17f5a398ea tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:08:06.592674 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-0dd68910-7483-4272-a882-4e17f5a398ea tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:08:06.593117 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-0dd68910-7483-4272-a882-4e17f5a398ea tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:08:06.593828 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-0dd68910-7483-4272-a882-4e17f5a398ea tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:08:06.594691 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-0dd68910-7483-4272-a882-4e17f5a398ea tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:08:06.595122 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-0dd68910-7483-4272-a882-4e17f5a398ea tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:08:06.597908 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-a87eb561-9a2b-4d4c-83fe-ad7831cc21df tempest-AttachSCSIVolumeTestJSON-356336257 tempest-AttachSCSIVolumeTestJSON-356336257-project] 10.222.0.13 "DELETE /compute/v2.1/servers/8a378b79-bd92-4ade-b034-1aaf5c87b74b/os-volume_attachments/568c1313-5e29-4849-a884-dab569a58a5f" status: 202 len: 0 microversion: 2.1 time: 0.316013 Nov 01 19:08:06.599992 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1733/3390] 10.222.0.13 () {58 vars in 1416 bytes} [Tue Nov 1 19:08:06 2022] DELETE /compute/v2.1/servers/8a378b79-bd92-4ade-b034-1aaf5c87b74b/os-volume_attachments/568c1313-5e29-4849-a884-dab569a58a5f => generated 0 bytes in 319 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 01 19:08:06.725842 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-321ed166-2f46-4948-bc9b-4560b7dd444e tempest-ImagesOneServerTestJSON-1044295602 tempest-ImagesOneServerTestJSON-1044295602-project] Calling method '.version_select at 0x7f0ae6889280>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:08:06.776247 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-0dd68910-7483-4272-a882-4e17f5a398ea tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113bd8c844ee490b86a68bc7e1e75da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '851785a5f76548898a77d67792888504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:08:06.786309 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-0dd68910-7483-4272-a882-4e17f5a398ea tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] 10.222.0.13 "GET /compute/v2.1/servers/7c9dac18-3bfc-4379-ab97-25d185cd6b85" status: 200 len: 1309 microversion: 2.1 time: 0.211706 Nov 01 19:08:06.801202 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1658/3391] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:08:06 2022] GET /compute/v2.1/servers/7c9dac18-3bfc-4379-ab97-25d185cd6b85 => generated 1309 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 19:08:06.823152 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-321ed166-2f46-4948-bc9b-4560b7dd444e tempest-ImagesOneServerTestJSON-1044295602 tempest-ImagesOneServerTestJSON-1044295602-project] 10.222.0.13 "GET /compute/v2.1/images/621c9785-490d-4245-8b6b-91f8571f7eab" status: 200 len: 1422 microversion: 2.1 time: 0.103317 Nov 01 19:08:06.834764 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1734/3392] 10.222.0.13 () {58 vars in 1233 bytes} [Tue Nov 1 19:08:06 2022] GET /compute/v2.1/images/621c9785-490d-4245-8b6b-91f8571f7eab => generated 1422 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 19:08:06.881657 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-2f779c09-13cf-4135-967f-5fe7bfadfa7a tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:08:06.884165 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-2f779c09-13cf-4135-967f-5fe7bfadfa7a tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] [instance: 8485db2a-fd8f-4615-bbe0-14822ad44194] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:08:06.909771 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2f779c09-13cf-4135-967f-5fe7bfadfa7a tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:08:06.910685 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2f779c09-13cf-4135-967f-5fe7bfadfa7a tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:08:06.911369 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2f779c09-13cf-4135-967f-5fe7bfadfa7a tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:08:06.912360 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2f779c09-13cf-4135-967f-5fe7bfadfa7a tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:08:06.913300 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2f779c09-13cf-4135-967f-5fe7bfadfa7a tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:08:06.914065 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2f779c09-13cf-4135-967f-5fe7bfadfa7a tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:08:07.078539 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-2f779c09-13cf-4135-967f-5fe7bfadfa7a tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '058480d92c9b4ab4af6815d0438a65c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee9dc49b89143f781e4ab30296e4d01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:08:07.086181 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-2f779c09-13cf-4135-967f-5fe7bfadfa7a tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] 10.222.0.13 "GET /compute/v2.1/servers/8485db2a-fd8f-4615-bbe0-14822ad44194" status: 200 len: 1508 microversion: 2.1 time: 0.209251 Nov 01 19:08:07.087275 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1659/3393] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:08:06 2022] GET /compute/v2.1/servers/8485db2a-fd8f-4615-bbe0-14822ad44194 => generated 1508 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:08:07.127598 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-1485f825-456d-4664-8307-7d2d76190c2d tempest-ServerMetadataNegativeTestJSON-414983834 tempest-ServerMetadataNegativeTestJSON-414983834-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:08:07.127598 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-1485f825-456d-4664-8307-7d2d76190c2d tempest-ServerMetadataNegativeTestJSON-414983834 tempest-ServerMetadataNegativeTestJSON-414983834-project] [instance: 6bb5dbff-cdc7-4986-8606-cec948c9d28c] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:08:07.129061 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-1485f825-456d-4664-8307-7d2d76190c2d tempest-ServerMetadataNegativeTestJSON-414983834 tempest-ServerMetadataNegativeTestJSON-414983834-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:08:07.129634 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-1485f825-456d-4664-8307-7d2d76190c2d tempest-ServerMetadataNegativeTestJSON-414983834 tempest-ServerMetadataNegativeTestJSON-414983834-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:08:07.130099 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-1485f825-456d-4664-8307-7d2d76190c2d tempest-ServerMetadataNegativeTestJSON-414983834 tempest-ServerMetadataNegativeTestJSON-414983834-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:08:07.130806 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-1485f825-456d-4664-8307-7d2d76190c2d tempest-ServerMetadataNegativeTestJSON-414983834 tempest-ServerMetadataNegativeTestJSON-414983834-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:08:07.131255 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-1485f825-456d-4664-8307-7d2d76190c2d tempest-ServerMetadataNegativeTestJSON-414983834 tempest-ServerMetadataNegativeTestJSON-414983834-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:08:07.131673 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-1485f825-456d-4664-8307-7d2d76190c2d tempest-ServerMetadataNegativeTestJSON-414983834 tempest-ServerMetadataNegativeTestJSON-414983834-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:08:07.166548 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-1485f825-456d-4664-8307-7d2d76190c2d tempest-ServerMetadataNegativeTestJSON-414983834 tempest-ServerMetadataNegativeTestJSON-414983834-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:08:07.167031 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-1485f825-456d-4664-8307-7d2d76190c2d tempest-ServerMetadataNegativeTestJSON-414983834 tempest-ServerMetadataNegativeTestJSON-414983834-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:08:07.167465 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-1485f825-456d-4664-8307-7d2d76190c2d tempest-ServerMetadataNegativeTestJSON-414983834 tempest-ServerMetadataNegativeTestJSON-414983834-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:08:07.167903 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.objects.instance [None req-1485f825-456d-4664-8307-7d2d76190c2d tempest-ServerMetadataNegativeTestJSON-414983834 tempest-ServerMetadataNegativeTestJSON-414983834-project] Lazy-loading 'fault' on Instance uuid 6bb5dbff-cdc7-4986-8606-cec948c9d28c {{(pid=121403) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 01 19:08:07.237593 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-1485f825-456d-4664-8307-7d2d76190c2d tempest-ServerMetadataNegativeTestJSON-414983834 tempest-ServerMetadataNegativeTestJSON-414983834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aebd68d6b30e45debbfd99ee6360f905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd702a70dab124153b4f40d3219ffc5f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:08:07.248319 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-1485f825-456d-4664-8307-7d2d76190c2d tempest-ServerMetadataNegativeTestJSON-414983834 tempest-ServerMetadataNegativeTestJSON-414983834-project] 10.222.0.13 "GET /compute/v2.1/servers/6bb5dbff-cdc7-4986-8606-cec948c9d28c" status: 200 len: 1313 microversion: 2.1 time: 0.130316 Nov 01 19:08:07.269173 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1735/3394] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:08:07 2022] GET /compute/v2.1/servers/6bb5dbff-cdc7-4986-8606-cec948c9d28c => generated 1313 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 19:08:07.810694 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-80b2778d-792a-454d-8358-1e166cde96db tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:08:07.812220 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-80b2778d-792a-454d-8358-1e166cde96db tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] [instance: 7c9dac18-3bfc-4379-ab97-25d185cd6b85] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:08:07.823151 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-80b2778d-792a-454d-8358-1e166cde96db tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:08:07.825721 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-80b2778d-792a-454d-8358-1e166cde96db tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:08:07.826378 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-80b2778d-792a-454d-8358-1e166cde96db tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:08:07.828434 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-80b2778d-792a-454d-8358-1e166cde96db tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:08:07.829320 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-80b2778d-792a-454d-8358-1e166cde96db tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:08:07.832451 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-80b2778d-792a-454d-8358-1e166cde96db tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:08:07.839345 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-b4b8c91a-94bd-4e9e-805a-1fa55cdb3c4e tempest-ImagesOneServerTestJSON-1044295602 tempest-ImagesOneServerTestJSON-1044295602-project] Calling method '.version_select at 0x7f0ae689a670>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:08:07.910959 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-b4b8c91a-94bd-4e9e-805a-1fa55cdb3c4e tempest-ImagesOneServerTestJSON-1044295602 tempest-ImagesOneServerTestJSON-1044295602-project] 10.222.0.13 "GET /compute/v2.1/images/621c9785-490d-4245-8b6b-91f8571f7eab" status: 200 len: 1422 microversion: 2.1 time: 0.075645 Nov 01 19:08:07.917249 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1736/3395] 10.222.0.13 () {58 vars in 1233 bytes} [Tue Nov 1 19:08:07 2022] GET /compute/v2.1/images/621c9785-490d-4245-8b6b-91f8571f7eab => generated 1422 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:08:08.005739 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-3f24bd5f-53bc-4f53-96e5-2921781afdb3 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1482244637", "imageRef": "2d4a0047-1b9e-445f-8af8-1b5c9d93e881", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f519283e-0b16-42bb-b3ce-8665b5719c87"}], "security_groups": [{"name": "tempest-securitygroup--1030414042"}], "key_name": "tempest-keypair-954591625", "user_data": "}} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:08:08.155106 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.network.neutron [None req-3f24bd5f-53bc-4f53-96e5-2921781afdb3 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] validate_networks() for [('f519283e-0b16-42bb-b3ce-8665b5719c87', None, None, None, None, None)] {{(pid=121403) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 01 19:08:08.460220 n-d-863052-2 devstack@n-api.service[121402]: DEBUG dbcounter [-] [121402] Writing DB stats nova_cell0:SELECT=2 {{(pid=121402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 19:08:08.489693 n-d-863052-2 devstack@n-api.service[121402]: DEBUG dbcounter [-] [121402] Writing DB stats nova_cell0:SELECT=6 {{(pid=121402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 19:08:08.522103 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-80b2778d-792a-454d-8358-1e166cde96db tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113bd8c844ee490b86a68bc7e1e75da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '851785a5f76548898a77d67792888504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:08:08.538652 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-80b2778d-792a-454d-8358-1e166cde96db tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] 10.222.0.13 "GET /compute/v2.1/servers/7c9dac18-3bfc-4379-ab97-25d185cd6b85" status: 200 len: 1309 microversion: 2.1 time: 0.732088 Nov 01 19:08:08.555931 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1660/3396] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:08:07 2022] GET /compute/v2.1/servers/7c9dac18-3bfc-4379-ab97-25d185cd6b85 => generated 1309 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:08:08.563685 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-81a8afba-7497-410b-95c1-9167548c02df tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:08:08.564349 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-81a8afba-7497-410b-95c1-9167548c02df tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] [instance: 8485db2a-fd8f-4615-bbe0-14822ad44194] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:08:08.584025 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-81a8afba-7497-410b-95c1-9167548c02df tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:08:08.584521 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-81a8afba-7497-410b-95c1-9167548c02df tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:08:08.585030 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-81a8afba-7497-410b-95c1-9167548c02df tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:08:08.585738 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-81a8afba-7497-410b-95c1-9167548c02df tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:08:08.586227 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-81a8afba-7497-410b-95c1-9167548c02df tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:08:08.586659 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-81a8afba-7497-410b-95c1-9167548c02df tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:08:08.786888 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.virt.hardware [None req-3f24bd5f-53bc-4f53-96e5-2921781afdb3 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Flavor limits 0:0:0 {{(pid=121403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 01 19:08:08.787313 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.virt.hardware [None req-3f24bd5f-53bc-4f53-96e5-2921781afdb3 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Image limits 0:0:0 {{(pid=121403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 01 19:08:08.787830 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.virt.hardware [None req-3f24bd5f-53bc-4f53-96e5-2921781afdb3 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Flavor pref 0:0:0 {{(pid=121403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 01 19:08:08.788250 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.virt.hardware [None req-3f24bd5f-53bc-4f53-96e5-2921781afdb3 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Image pref 0:0:0 {{(pid=121403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 01 19:08:08.788772 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.virt.hardware [None req-3f24bd5f-53bc-4f53-96e5-2921781afdb3 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 01 19:08:08.804979 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-3f24bd5f-53bc-4f53-96e5-2921781afdb3 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:08:08.806332 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-3f24bd5f-53bc-4f53-96e5-2921781afdb3 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:08:08.807385 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-3f24bd5f-53bc-4f53-96e5-2921781afdb3 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:08:08.808313 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-3f24bd5f-53bc-4f53-96e5-2921781afdb3 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:08:08.809023 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-3f24bd5f-53bc-4f53-96e5-2921781afdb3 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:08:08.809613 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-3f24bd5f-53bc-4f53-96e5-2921781afdb3 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:08:08.810010 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-81a8afba-7497-410b-95c1-9167548c02df tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '058480d92c9b4ab4af6815d0438a65c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee9dc49b89143f781e4ab30296e4d01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:08:08.819691 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-81a8afba-7497-410b-95c1-9167548c02df tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] 10.222.0.13 "GET /compute/v2.1/servers/8485db2a-fd8f-4615-bbe0-14822ad44194" status: 200 len: 1508 microversion: 2.1 time: 0.262663 Nov 01 19:08:08.820880 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1661/3397] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:08:08 2022] GET /compute/v2.1/servers/8485db2a-fd8f-4615-bbe0-14822ad44194 => generated 1508 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:08:08.826169 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-4a852672-7108-4e05-a1db-965aaeac7ad3 tempest-ServerMetadataNegativeTestJSON-414983834 tempest-ServerMetadataNegativeTestJSON-414983834-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:08:08.826979 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-4a852672-7108-4e05-a1db-965aaeac7ad3 tempest-ServerMetadataNegativeTestJSON-414983834 tempest-ServerMetadataNegativeTestJSON-414983834-project] [instance: 6bb5dbff-cdc7-4986-8606-cec948c9d28c] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:08:08.831526 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.quota [None req-3f24bd5f-53bc-4f53-96e5-2921781afdb3 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Getting quotas for project 33e3d319293c46b6af2f728a50586906. Resources: {'cores', 'ram', 'instances'} {{(pid=121403) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 01 19:08:08.833754 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-4a852672-7108-4e05-a1db-965aaeac7ad3 tempest-ServerMetadataNegativeTestJSON-414983834 tempest-ServerMetadataNegativeTestJSON-414983834-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:08:08.834534 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-4a852672-7108-4e05-a1db-965aaeac7ad3 tempest-ServerMetadataNegativeTestJSON-414983834 tempest-ServerMetadataNegativeTestJSON-414983834-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:08:08.835134 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-4a852672-7108-4e05-a1db-965aaeac7ad3 tempest-ServerMetadataNegativeTestJSON-414983834 tempest-ServerMetadataNegativeTestJSON-414983834-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:08:08.836003 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-4a852672-7108-4e05-a1db-965aaeac7ad3 tempest-ServerMetadataNegativeTestJSON-414983834 tempest-ServerMetadataNegativeTestJSON-414983834-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:08:08.836668 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-4a852672-7108-4e05-a1db-965aaeac7ad3 tempest-ServerMetadataNegativeTestJSON-414983834 tempest-ServerMetadataNegativeTestJSON-414983834-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:08:08.837246 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-4a852672-7108-4e05-a1db-965aaeac7ad3 tempest-ServerMetadataNegativeTestJSON-414983834 tempest-ServerMetadataNegativeTestJSON-414983834-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:08:08.837369 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.quota [None req-3f24bd5f-53bc-4f53-96e5-2921781afdb3 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Getting quotas for user 790f3f1566b7464aaca19d4d05c0942e and project 33e3d319293c46b6af2f728a50586906. Resources: {'cores', 'ram', 'instances'} {{(pid=121403) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 01 19:08:08.852913 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-3f24bd5f-53bc-4f53-96e5-2921781afdb3 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Going to run 1 instances... {{(pid=121403) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 01 19:08:08.855290 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-3f24bd5f-53bc-4f53-96e5-2921781afdb3 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] [instance: ac4160c6-ca16-455e-9613-0d425932af3b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2d4a0047-1b9e-445f-8af8-1b5c9d93e881',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121403) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 01 19:08:08.856277 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.wsgi [None req-4a852672-7108-4e05-a1db-965aaeac7ad3 tempest-ServerMetadataNegativeTestJSON-414983834 tempest-ServerMetadataNegativeTestJSON-414983834-project] HTTP exception thrown: Instance 6bb5dbff-cdc7-4986-8606-cec948c9d28c could not be found. Nov 01 19:08:08.858133 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-4a852672-7108-4e05-a1db-965aaeac7ad3 tempest-ServerMetadataNegativeTestJSON-414983834 tempest-ServerMetadataNegativeTestJSON-414983834-project] Request method failure captured: Nov 01 19:08:08.858133 n-d-863052-2 devstack@n-api.service[121402]: request: GET /compute/v2.1/servers/6bb5dbff-cdc7-4986-8606-cec948c9d28c HTTP/1.1 Nov 01 19:08:08.858133 n-d-863052-2 devstack@n-api.service[121402]: Accept: application/json Nov 01 19:08:08.858133 n-d-863052-2 devstack@n-api.service[121402]: Accept-Encoding: identity Nov 01 19:08:08.858133 n-d-863052-2 devstack@n-api.service[121402]: Connection: close Nov 01 19:08:08.858133 n-d-863052-2 devstack@n-api.service[121402]: Content-Length: 0 Nov 01 19:08:08.858133 n-d-863052-2 devstack@n-api.service[121402]: Content-Type: application/json Nov 01 19:08:08.858133 n-d-863052-2 devstack@n-api.service[121402]: Host: 10.222.0.13 Nov 01 19:08:08.858133 n-d-863052-2 devstack@n-api.service[121402]: Openstack-System-Scope: None Nov 01 19:08:08.858133 n-d-863052-2 devstack@n-api.service[121402]: User-Agent: python-urllib3/1.26.12 Nov 01 19:08:08.858133 n-d-863052-2 devstack@n-api.service[121402]: X-Auth-Token: gAAAAABjYW6A_zo37UoyTGqmLiBbzVZAIcCwF8Jo_l29ziAaByPmJ2pwikzRg_TlNxgJjI75pzbQ2PW0duNreTXxYfNkvSQD4TNjwied1o0eXEbhsN6T-mYWAKZ9dTKYMAH1Py5SQtMH4I20d_YLeOK_c7Msy3lItgeqsXmRSJcSWXkcAGNY7HU Nov 01 19:08:08.858133 n-d-863052-2 devstack@n-api.service[121402]: X-Domain-Id: None Nov 01 19:08:08.858133 n-d-863052-2 devstack@n-api.service[121402]: X-Domain-Name: None Nov 01 19:08:08.858133 n-d-863052-2 devstack@n-api.service[121402]: X-Identity-Status: Confirmed Nov 01 19:08:08.858133 n-d-863052-2 devstack@n-api.service[121402]: X-Is-Admin-Project: True Nov 01 19:08:08.858133 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Domain-Id: default Nov 01 19:08:08.858133 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Domain-Name: Default Nov 01 19:08:08.858133 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Id: d702a70dab124153b4f40d3219ffc5f3 Nov 01 19:08:08.858133 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-414983834 Nov 01 19:08:08.858133 n-d-863052-2 devstack@n-api.service[121402]: X-Role: member,reader Nov 01 19:08:08.858133 n-d-863052-2 devstack@n-api.service[121402]: X-Roles: member,reader Nov 01 19:08:08.858133 n-d-863052-2 devstack@n-api.service[121402]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/d702a70dab124153b4f40d3219ffc5f3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/d702a70dab124153b4f40d3219ffc5f3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_d702a70dab124153b4f40d3219ffc5f3", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/d702a70dab124153b4f40d3219ffc5f3"}]}] Nov 01 19:08:08.858133 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-414983834 Nov 01 19:08:08.858133 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant-Id: d702a70dab124153b4f40d3219ffc5f3 Nov 01 19:08:08.858133 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-414983834 Nov 01 19:08:08.858133 n-d-863052-2 devstack@n-api.service[121402]: X-User: tempest-ServerMetadataNegativeTestJSON-414983834-project Nov 01 19:08:08.858133 n-d-863052-2 devstack@n-api.service[121402]: X-User-Domain-Id: default Nov 01 19:08:08.858133 n-d-863052-2 devstack@n-api.service[121402]: X-User-Domain-Name: Default Nov 01 19:08:08.858133 n-d-863052-2 devstack@n-api.service[121402]: X-User-Id: aebd68d6b30e45debbfd99ee6360f905 Nov 01 19:08:08.858133 n-d-863052-2 devstack@n-api.service[121402]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-414983834-project Nov 01 19:08:08.858133 n-d-863052-2 devstack@n-api.service[121402]: method: > Nov 01 19:08:08.858133 n-d-863052-2 devstack@n-api.service[121402]: exception: Instance 6bb5dbff-cdc7-4986-8606-cec948c9d28c could not be found. Nov 01 19:08:08.858133 n-d-863052-2 devstack@n-api.service[121402]: action_args: {'id': '6bb5dbff-cdc7-4986-8606-cec948c9d28c'} Nov 01 19:08:08.858133 n-d-863052-2 devstack@n-api.service[121402]: {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 01 19:08:08.858133 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:08:08.858133 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 01 19:08:08.858133 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 01 19:08:08.858133 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 01 19:08:08.858133 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 01 19:08:08.858133 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 01 19:08:08.858133 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 01 19:08:08.858133 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 01 19:08:08.858133 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 01 19:08:08.858133 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6bb5dbff-cdc7-4986-8606-cec948c9d28c could not be found. Nov 01 19:08:08.858133 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:08:08.858133 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:08:08.858133 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:08:08.858133 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:08:08.858133 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:08:08.858133 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:08:08.858133 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 01 19:08:08.858133 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 01 19:08:08.858133 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 01 19:08:08.858133 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 01 19:08:08.858133 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 01 19:08:08.858133 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 01 19:08:08.858133 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 01 19:08:08.858133 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 01 19:08:08.858133 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 01 19:08:08.858133 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 01 19:08:08.858133 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6bb5dbff-cdc7-4986-8606-cec948c9d28c could not be found. Nov 01 19:08:08.858133 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:08:08.858133 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:08:08.862258 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:08:08.862258 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:08:08.862258 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:08:08.862258 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:08:08.862258 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 01 19:08:08.862258 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 01 19:08:08.862258 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6bb5dbff-cdc7-4986-8606-cec948c9d28c could not be found. Nov 01 19:08:08.862258 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:08:08.864165 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-4a852672-7108-4e05-a1db-965aaeac7ad3 tempest-ServerMetadataNegativeTestJSON-414983834 tempest-ServerMetadataNegativeTestJSON-414983834-project] Returning 404 to user: Instance 6bb5dbff-cdc7-4986-8606-cec948c9d28c could not be found. {{(pid=121402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 01 19:08:08.865335 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-4a852672-7108-4e05-a1db-965aaeac7ad3 tempest-ServerMetadataNegativeTestJSON-414983834 tempest-ServerMetadataNegativeTestJSON-414983834-project] 10.222.0.13 "GET /compute/v2.1/servers/6bb5dbff-cdc7-4986-8606-cec948c9d28c" status: 404 len: 111 microversion: 2.1 time: 0.043326 Nov 01 19:08:08.873124 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1662/3398] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:08:08 2022] GET /compute/v2.1/servers/6bb5dbff-cdc7-4986-8606-cec948c9d28c => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 01 19:08:08.931592 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-f80c78b6-3a7a-4dcb-8950-ba8f6665f04a tempest-ImagesOneServerTestJSON-1044295602 tempest-ImagesOneServerTestJSON-1044295602-project] Calling method '.version_select at 0x7f0ae1c7e040>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:08:08.980984 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-3f24bd5f-53bc-4f53-96e5-2921781afdb3 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.980913 Nov 01 19:08:08.981640 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1737/3399] 10.222.0.13 () {60 vars in 1147 bytes} [Tue Nov 1 19:08:07 2022] POST /compute/v2.1/servers => generated 402 bytes in 982 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Nov 01 19:08:09.003076 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-33889a81-788e-4fe0-bbd3-55741032e1e1 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:08:09.003725 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-33889a81-788e-4fe0-bbd3-55741032e1e1 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] [instance: ac4160c6-ca16-455e-9613-0d425932af3b] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:08:09.010074 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-f80c78b6-3a7a-4dcb-8950-ba8f6665f04a tempest-ImagesOneServerTestJSON-1044295602 tempest-ImagesOneServerTestJSON-1044295602-project] 10.222.0.13 "GET /compute/v2.1/images/621c9785-490d-4245-8b6b-91f8571f7eab" status: 200 len: 1422 microversion: 2.1 time: 0.083519 Nov 01 19:08:09.010899 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1663/3400] 10.222.0.13 () {58 vars in 1233 bytes} [Tue Nov 1 19:08:08 2022] GET /compute/v2.1/images/621c9785-490d-4245-8b6b-91f8571f7eab => generated 1422 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:08:09.120867 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-33889a81-788e-4fe0-bbd3-55741032e1e1 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '790f3f1566b7464aaca19d4d05c0942e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33e3d319293c46b6af2f728a50586906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:08:09.128872 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-33889a81-788e-4fe0-bbd3-55741032e1e1 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] 10.222.0.13 "GET /compute/v2.1/servers/ac4160c6-ca16-455e-9613-0d425932af3b" status: 200 len: 1241 microversion: 2.1 time: 0.136358 Nov 01 19:08:09.132873 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1738/3401] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:08:08 2022] GET /compute/v2.1/servers/ac4160c6-ca16-455e-9613-0d425932af3b => generated 1241 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:08:09.578802 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-8ded613b-948b-4d02-aae6-985a4d1d5265 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:08:09.580009 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-8ded613b-948b-4d02-aae6-985a4d1d5265 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] [instance: 7c9dac18-3bfc-4379-ab97-25d185cd6b85] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:08:09.595052 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-8ded613b-948b-4d02-aae6-985a4d1d5265 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:08:09.603434 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-8ded613b-948b-4d02-aae6-985a4d1d5265 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:08:09.605198 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-8ded613b-948b-4d02-aae6-985a4d1d5265 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:08:09.606400 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-8ded613b-948b-4d02-aae6-985a4d1d5265 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:08:09.615320 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-8ded613b-948b-4d02-aae6-985a4d1d5265 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:08:09.617196 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-8ded613b-948b-4d02-aae6-985a4d1d5265 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:08:09.844828 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-289a67de-7dbc-468a-8dc8-1df9d5ad4c46 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:08:09.845830 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-289a67de-7dbc-468a-8dc8-1df9d5ad4c46 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] [instance: 8485db2a-fd8f-4615-bbe0-14822ad44194] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:08:09.864276 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-289a67de-7dbc-468a-8dc8-1df9d5ad4c46 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:08:09.864925 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-289a67de-7dbc-468a-8dc8-1df9d5ad4c46 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:08:09.865365 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-289a67de-7dbc-468a-8dc8-1df9d5ad4c46 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:08:09.866157 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-289a67de-7dbc-468a-8dc8-1df9d5ad4c46 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:08:09.866694 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-289a67de-7dbc-468a-8dc8-1df9d5ad4c46 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:08:09.867196 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-289a67de-7dbc-468a-8dc8-1df9d5ad4c46 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:08:10.018264 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-8ded613b-948b-4d02-aae6-985a4d1d5265 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113bd8c844ee490b86a68bc7e1e75da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '851785a5f76548898a77d67792888504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:08:10.033581 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-8ded613b-948b-4d02-aae6-985a4d1d5265 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] 10.222.0.13 "GET /compute/v2.1/servers/7c9dac18-3bfc-4379-ab97-25d185cd6b85" status: 200 len: 1309 microversion: 2.1 time: 0.461102 Nov 01 19:08:10.035614 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1664/3402] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:08:09 2022] GET /compute/v2.1/servers/7c9dac18-3bfc-4379-ab97-25d185cd6b85 => generated 1309 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:08:10.050388 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-9d250b66-77c4-4cde-8f95-1c78944b3507 tempest-ImagesOneServerTestJSON-1044295602 tempest-ImagesOneServerTestJSON-1044295602-project] Calling method '.version_select at 0x7f0ae193aca0>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:08:10.149493 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-9d250b66-77c4-4cde-8f95-1c78944b3507 tempest-ImagesOneServerTestJSON-1044295602 tempest-ImagesOneServerTestJSON-1044295602-project] 10.222.0.13 "GET /compute/v2.1/images/621c9785-490d-4245-8b6b-91f8571f7eab" status: 200 len: 1422 microversion: 2.1 time: 0.110395 Nov 01 19:08:10.151371 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1665/3403] 10.222.0.13 () {58 vars in 1233 bytes} [Tue Nov 1 19:08:10 2022] GET /compute/v2.1/images/621c9785-490d-4245-8b6b-91f8571f7eab => generated 1422 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:08:10.182965 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-f52329a1-927e-4869-8268-2d9154fd0de3 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:08:10.183992 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-f52329a1-927e-4869-8268-2d9154fd0de3 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] [instance: ac4160c6-ca16-455e-9613-0d425932af3b] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:08:10.205306 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f52329a1-927e-4869-8268-2d9154fd0de3 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:08:10.206176 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f52329a1-927e-4869-8268-2d9154fd0de3 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:08:10.206717 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f52329a1-927e-4869-8268-2d9154fd0de3 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:08:10.209233 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f52329a1-927e-4869-8268-2d9154fd0de3 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:08:10.214927 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f52329a1-927e-4869-8268-2d9154fd0de3 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:08:10.215418 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f52329a1-927e-4869-8268-2d9154fd0de3 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:08:10.283581 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-289a67de-7dbc-468a-8dc8-1df9d5ad4c46 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '058480d92c9b4ab4af6815d0438a65c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee9dc49b89143f781e4ab30296e4d01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:08:10.298534 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-289a67de-7dbc-468a-8dc8-1df9d5ad4c46 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] 10.222.0.13 "GET /compute/v2.1/servers/8485db2a-fd8f-4615-bbe0-14822ad44194" status: 200 len: 1508 microversion: 2.1 time: 0.457994 Nov 01 19:08:10.300905 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1739/3404] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:08:09 2022] GET /compute/v2.1/servers/8485db2a-fd8f-4615-bbe0-14822ad44194 => generated 1508 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 19:08:10.356689 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-f52329a1-927e-4869-8268-2d9154fd0de3 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '790f3f1566b7464aaca19d4d05c0942e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33e3d319293c46b6af2f728a50586906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:08:10.366625 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-f52329a1-927e-4869-8268-2d9154fd0de3 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] 10.222.0.13 "GET /compute/v2.1/servers/ac4160c6-ca16-455e-9613-0d425932af3b" status: 200 len: 1237 microversion: 2.1 time: 0.195598 Nov 01 19:08:10.380635 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1666/3405] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:08:10 2022] GET /compute/v2.1/servers/ac4160c6-ca16-455e-9613-0d425932af3b => generated 1237 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:08:11.060046 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-c6635722-9f51-4f59-a604-026100d48ec1 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:08:11.061730 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-c6635722-9f51-4f59-a604-026100d48ec1 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] [instance: 7c9dac18-3bfc-4379-ab97-25d185cd6b85] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:08:11.082064 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-c6635722-9f51-4f59-a604-026100d48ec1 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:08:11.083186 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-c6635722-9f51-4f59-a604-026100d48ec1 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:08:11.083889 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-c6635722-9f51-4f59-a604-026100d48ec1 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:08:11.087156 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-c6635722-9f51-4f59-a604-026100d48ec1 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:08:11.092198 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-c6635722-9f51-4f59-a604-026100d48ec1 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:08:11.093072 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-c6635722-9f51-4f59-a604-026100d48ec1 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:08:11.169261 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-a0571a8d-81b0-417f-a6d9-03b4ae314b28 tempest-ImagesOneServerTestJSON-1044295602 tempest-ImagesOneServerTestJSON-1044295602-project] Calling method '.version_select at 0x7f0ae1ddd430>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:08:11.262877 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-a0571a8d-81b0-417f-a6d9-03b4ae314b28 tempest-ImagesOneServerTestJSON-1044295602 tempest-ImagesOneServerTestJSON-1044295602-project] 10.222.0.13 "GET /compute/v2.1/images/621c9785-490d-4245-8b6b-91f8571f7eab" status: 200 len: 1422 microversion: 2.1 time: 0.101022 Nov 01 19:08:11.266633 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1667/3406] 10.222.0.13 () {58 vars in 1233 bytes} [Tue Nov 1 19:08:11 2022] GET /compute/v2.1/images/621c9785-490d-4245-8b6b-91f8571f7eab => generated 1422 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:08:11.322816 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-221bcbf3-4224-4efb-b737-40076b3138db tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:08:11.323431 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-221bcbf3-4224-4efb-b737-40076b3138db tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] [instance: 8485db2a-fd8f-4615-bbe0-14822ad44194] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:08:11.342651 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-221bcbf3-4224-4efb-b737-40076b3138db tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:08:11.345754 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-221bcbf3-4224-4efb-b737-40076b3138db tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:08:11.346418 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-221bcbf3-4224-4efb-b737-40076b3138db tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:08:11.347179 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-221bcbf3-4224-4efb-b737-40076b3138db tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:08:11.347649 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-221bcbf3-4224-4efb-b737-40076b3138db tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:08:11.348104 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-221bcbf3-4224-4efb-b737-40076b3138db tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:08:11.632764 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-c6635722-9f51-4f59-a604-026100d48ec1 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113bd8c844ee490b86a68bc7e1e75da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '851785a5f76548898a77d67792888504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:08:11.657499 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-c6635722-9f51-4f59-a604-026100d48ec1 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] 10.222.0.13 "GET /compute/v2.1/servers/7c9dac18-3bfc-4379-ab97-25d185cd6b85" status: 200 len: 1309 microversion: 2.1 time: 0.601944 Nov 01 19:08:11.674303 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1740/3407] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:08:11 2022] GET /compute/v2.1/servers/7c9dac18-3bfc-4379-ab97-25d185cd6b85 => generated 1309 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:08:11.682976 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-89793e98-9d4b-4f42-80bc-e86c0f3d9ac1 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:08:11.702399 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-89793e98-9d4b-4f42-80bc-e86c0f3d9ac1 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] [instance: ac4160c6-ca16-455e-9613-0d425932af3b] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:08:11.704236 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-221bcbf3-4224-4efb-b737-40076b3138db tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '058480d92c9b4ab4af6815d0438a65c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee9dc49b89143f781e4ab30296e4d01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:08:11.714232 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-89793e98-9d4b-4f42-80bc-e86c0f3d9ac1 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:08:11.714735 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-89793e98-9d4b-4f42-80bc-e86c0f3d9ac1 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:08:11.715179 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-89793e98-9d4b-4f42-80bc-e86c0f3d9ac1 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:08:11.715888 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-89793e98-9d4b-4f42-80bc-e86c0f3d9ac1 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:08:11.716346 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-89793e98-9d4b-4f42-80bc-e86c0f3d9ac1 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:08:11.716804 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-89793e98-9d4b-4f42-80bc-e86c0f3d9ac1 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:08:11.736895 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-221bcbf3-4224-4efb-b737-40076b3138db tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] 10.222.0.13 "GET /compute/v2.1/servers/8485db2a-fd8f-4615-bbe0-14822ad44194" status: 200 len: 1508 microversion: 2.1 time: 0.417413 Nov 01 19:08:11.743588 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1668/3408] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:08:11 2022] GET /compute/v2.1/servers/8485db2a-fd8f-4615-bbe0-14822ad44194 => generated 1508 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 19:08:11.903195 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-89793e98-9d4b-4f42-80bc-e86c0f3d9ac1 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '790f3f1566b7464aaca19d4d05c0942e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33e3d319293c46b6af2f728a50586906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:08:11.917934 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-89793e98-9d4b-4f42-80bc-e86c0f3d9ac1 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] 10.222.0.13 "GET /compute/v2.1/servers/ac4160c6-ca16-455e-9613-0d425932af3b" status: 200 len: 1299 microversion: 2.1 time: 0.241172 Nov 01 19:08:11.918529 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1741/3409] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:08:11 2022] GET /compute/v2.1/servers/ac4160c6-ca16-455e-9613-0d425932af3b => generated 1299 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:08:12.280088 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-08dd6a71-0da7-425d-923c-f6c2d816869b tempest-ImagesOneServerTestJSON-1044295602 tempest-ImagesOneServerTestJSON-1044295602-project] Calling method '.version_select at 0x7f0ae1d5b9d0>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:08:12.311620 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [req-8f26a242-9dff-41e6-b46f-187dfa97358f req-8c0aa7db-4310-4d30-854e-0799674e877e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c9dac18-3bfc-4379-ab97-25d185cd6b85", "name": "network-vif-plugged", "status": "completed", "tag": "db3ec26a-e23c-42e4-acbb-72a089522cfa"}]} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:08:12.332416 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-8f26a242-9dff-41e6-b46f-187dfa97358f req-8c0aa7db-4310-4d30-854e-0799674e877e service nova] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:08:12.333248 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-8f26a242-9dff-41e6-b46f-187dfa97358f req-8c0aa7db-4310-4d30-854e-0799674e877e service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:08:12.338941 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-8f26a242-9dff-41e6-b46f-187dfa97358f req-8c0aa7db-4310-4d30-854e-0799674e877e service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:08:12.370829 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.compute.server_external_events [req-8f26a242-9dff-41e6-b46f-187dfa97358f req-8c0aa7db-4310-4d30-854e-0799674e877e service nova] Creating event network-vif-plugged:db3ec26a-e23c-42e4-acbb-72a089522cfa for instance 7c9dac18-3bfc-4379-ab97-25d185cd6b85 on n-h1-863052-2 Nov 01 19:08:12.388027 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [req-8f26a242-9dff-41e6-b46f-187dfa97358f req-8c0aa7db-4310-4d30-854e-0799674e877e service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081017 Nov 01 19:08:12.388678 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1742/3410] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Nov 1 19:08:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 01 19:08:12.431164 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-08dd6a71-0da7-425d-923c-f6c2d816869b tempest-ImagesOneServerTestJSON-1044295602 tempest-ImagesOneServerTestJSON-1044295602-project] 10.222.0.13 "GET /compute/v2.1/images/621c9785-490d-4245-8b6b-91f8571f7eab" status: 200 len: 1422 microversion: 2.1 time: 0.155476 Nov 01 19:08:12.435831 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1669/3411] 10.222.0.13 () {58 vars in 1233 bytes} [Tue Nov 1 19:08:12 2022] GET /compute/v2.1/images/621c9785-490d-4245-8b6b-91f8571f7eab => generated 1422 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:08:12.680127 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-62e80195-ba59-4c70-bca2-ac4464b0a5b1 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:08:12.680869 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-62e80195-ba59-4c70-bca2-ac4464b0a5b1 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] [instance: 7c9dac18-3bfc-4379-ab97-25d185cd6b85] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:08:12.696556 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-62e80195-ba59-4c70-bca2-ac4464b0a5b1 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:08:12.697262 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-62e80195-ba59-4c70-bca2-ac4464b0a5b1 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:08:12.697895 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-62e80195-ba59-4c70-bca2-ac4464b0a5b1 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:08:12.701476 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-62e80195-ba59-4c70-bca2-ac4464b0a5b1 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:08:12.702146 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-62e80195-ba59-4c70-bca2-ac4464b0a5b1 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:08:12.702750 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-62e80195-ba59-4c70-bca2-ac4464b0a5b1 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:08:12.768106 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-8f946f93-93df-40bb-98fa-14a8a22e4b73 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:08:12.768947 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-8f946f93-93df-40bb-98fa-14a8a22e4b73 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] [instance: 8485db2a-fd8f-4615-bbe0-14822ad44194] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:08:12.791325 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-8f946f93-93df-40bb-98fa-14a8a22e4b73 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:08:12.792067 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-8f946f93-93df-40bb-98fa-14a8a22e4b73 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:08:12.792735 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-8f946f93-93df-40bb-98fa-14a8a22e4b73 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:08:12.793623 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-8f946f93-93df-40bb-98fa-14a8a22e4b73 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:08:12.794259 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-8f946f93-93df-40bb-98fa-14a8a22e4b73 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:08:12.794849 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-8f946f93-93df-40bb-98fa-14a8a22e4b73 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:08:13.101408 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-62e80195-ba59-4c70-bca2-ac4464b0a5b1 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113bd8c844ee490b86a68bc7e1e75da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '851785a5f76548898a77d67792888504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:08:13.111383 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-62e80195-ba59-4c70-bca2-ac4464b0a5b1 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] 10.222.0.13 "GET /compute/v2.1/servers/7c9dac18-3bfc-4379-ab97-25d185cd6b85" status: 200 len: 1309 microversion: 2.1 time: 0.435713 Nov 01 19:08:13.158085 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1743/3412] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:08:12 2022] GET /compute/v2.1/servers/7c9dac18-3bfc-4379-ab97-25d185cd6b85 => generated 1309 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:08:13.174300 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-25782623-9d7e-401a-99dc-89a7bc7f1cab tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:08:13.178417 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-25782623-9d7e-401a-99dc-89a7bc7f1cab tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] [instance: ac4160c6-ca16-455e-9613-0d425932af3b] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:08:13.199320 n-d-863052-2 devstack@n-api.service[121403]: DEBUG dbcounter [-] [121403] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=121403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 19:08:13.206615 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-25782623-9d7e-401a-99dc-89a7bc7f1cab tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:08:13.214688 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-25782623-9d7e-401a-99dc-89a7bc7f1cab tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:08:13.215848 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-25782623-9d7e-401a-99dc-89a7bc7f1cab tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:08:13.216912 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-25782623-9d7e-401a-99dc-89a7bc7f1cab tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:08:13.226209 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-25782623-9d7e-401a-99dc-89a7bc7f1cab tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:08:13.227590 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-25782623-9d7e-401a-99dc-89a7bc7f1cab tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:08:13.342056 n-d-863052-2 devstack@n-api.service[121403]: DEBUG dbcounter [-] [121403] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=121403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 19:08:13.496107 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-8f946f93-93df-40bb-98fa-14a8a22e4b73 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '058480d92c9b4ab4af6815d0438a65c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee9dc49b89143f781e4ab30296e4d01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:08:13.504457 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-8f946f93-93df-40bb-98fa-14a8a22e4b73 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] 10.222.0.13 "GET /compute/v2.1/servers/8485db2a-fd8f-4615-bbe0-14822ad44194" status: 200 len: 1508 microversion: 2.1 time: 0.740823 Nov 01 19:08:13.505419 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1670/3413] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:08:12 2022] GET /compute/v2.1/servers/8485db2a-fd8f-4615-bbe0-14822ad44194 => generated 1508 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 19:08:13.510865 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-0ec94905-9715-4e5f-b318-f1125266228a tempest-ImagesOneServerTestJSON-1044295602 tempest-ImagesOneServerTestJSON-1044295602-project] Calling method '.version_select at 0x7f0ae183f790>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:08:13.636566 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-0ec94905-9715-4e5f-b318-f1125266228a tempest-ImagesOneServerTestJSON-1044295602 tempest-ImagesOneServerTestJSON-1044295602-project] 10.222.0.13 "GET /compute/v2.1/images/621c9785-490d-4245-8b6b-91f8571f7eab" status: 200 len: 1422 microversion: 2.1 time: 0.129796 Nov 01 19:08:13.645352 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1671/3414] 10.222.0.13 () {58 vars in 1233 bytes} [Tue Nov 1 19:08:13 2022] GET /compute/v2.1/images/621c9785-490d-4245-8b6b-91f8571f7eab => generated 1422 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:08:13.688955 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-25782623-9d7e-401a-99dc-89a7bc7f1cab tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '790f3f1566b7464aaca19d4d05c0942e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33e3d319293c46b6af2f728a50586906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:08:13.712000 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-25782623-9d7e-401a-99dc-89a7bc7f1cab tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] 10.222.0.13 "GET /compute/v2.1/servers/ac4160c6-ca16-455e-9613-0d425932af3b" status: 200 len: 1367 microversion: 2.1 time: 0.548898 Nov 01 19:08:13.714635 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1744/3415] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:08:13 2022] GET /compute/v2.1/servers/ac4160c6-ca16-455e-9613-0d425932af3b => generated 1367 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:08:14.161245 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-540c44ce-cef3-4bd0-abdd-4c3276dc4753 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:08:14.161873 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-540c44ce-cef3-4bd0-abdd-4c3276dc4753 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] [instance: 7c9dac18-3bfc-4379-ab97-25d185cd6b85] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:08:14.173101 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-540c44ce-cef3-4bd0-abdd-4c3276dc4753 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:08:14.173862 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-540c44ce-cef3-4bd0-abdd-4c3276dc4753 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:08:14.174498 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-540c44ce-cef3-4bd0-abdd-4c3276dc4753 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:08:14.175400 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-540c44ce-cef3-4bd0-abdd-4c3276dc4753 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:08:14.178501 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-540c44ce-cef3-4bd0-abdd-4c3276dc4753 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:08:14.179173 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-540c44ce-cef3-4bd0-abdd-4c3276dc4753 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:08:14.428444 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [req-22125c13-4392-4b35-9645-40292dd1e8b2 req-57510a6a-d91a-4020-b584-663ad355a62d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ac4160c6-ca16-455e-9613-0d425932af3b", "tag": "bf1271b3-df00-4974-8247-8425a2ebf2ee"}]} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:08:14.450082 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-22125c13-4392-4b35-9645-40292dd1e8b2 req-57510a6a-d91a-4020-b584-663ad355a62d service nova] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:08:14.450566 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-22125c13-4392-4b35-9645-40292dd1e8b2 req-57510a6a-d91a-4020-b584-663ad355a62d service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:08:14.451005 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-22125c13-4392-4b35-9645-40292dd1e8b2 req-57510a6a-d91a-4020-b584-663ad355a62d service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:08:14.485936 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.compute.server_external_events [req-22125c13-4392-4b35-9645-40292dd1e8b2 req-57510a6a-d91a-4020-b584-663ad355a62d service nova] Creating event network-changed:bf1271b3-df00-4974-8247-8425a2ebf2ee for instance ac4160c6-ca16-455e-9613-0d425932af3b on n-h1-863052-2 Nov 01 19:08:14.503205 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [req-22125c13-4392-4b35-9645-40292dd1e8b2 req-57510a6a-d91a-4020-b584-663ad355a62d service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077294 Nov 01 19:08:14.504191 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1745/3416] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Nov 1 19:08:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 01 19:08:14.528142 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-9e2e36e7-0c04-4642-9d04-b2b4fbf004ef tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:08:14.536202 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-9e2e36e7-0c04-4642-9d04-b2b4fbf004ef tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] [instance: 8485db2a-fd8f-4615-bbe0-14822ad44194] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:08:14.551155 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-9e2e36e7-0c04-4642-9d04-b2b4fbf004ef tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:08:14.555448 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-9e2e36e7-0c04-4642-9d04-b2b4fbf004ef tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:08:14.557890 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-9e2e36e7-0c04-4642-9d04-b2b4fbf004ef tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:08:14.559493 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-9e2e36e7-0c04-4642-9d04-b2b4fbf004ef tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:08:14.564673 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-9e2e36e7-0c04-4642-9d04-b2b4fbf004ef tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:08:14.565365 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-9e2e36e7-0c04-4642-9d04-b2b4fbf004ef tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:08:15.168153 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-9e2e36e7-0c04-4642-9d04-b2b4fbf004ef tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '058480d92c9b4ab4af6815d0438a65c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee9dc49b89143f781e4ab30296e4d01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:08:15.188168 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-9e2e36e7-0c04-4642-9d04-b2b4fbf004ef tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] 10.222.0.13 "GET /compute/v2.1/servers/8485db2a-fd8f-4615-bbe0-14822ad44194" status: 200 len: 1508 microversion: 2.1 time: 0.664256 Nov 01 19:08:15.190201 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1746/3417] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:08:14 2022] GET /compute/v2.1/servers/8485db2a-fd8f-4615-bbe0-14822ad44194 => generated 1508 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:08:15.198597 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-472e0d0f-94a7-47fd-aa8f-b417ca9bcf23 tempest-ImagesOneServerTestJSON-1044295602 tempest-ImagesOneServerTestJSON-1044295602-project] Calling method '.version_select at 0x7f0ae2bd4dc0>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:08:15.241671 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-540c44ce-cef3-4bd0-abdd-4c3276dc4753 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113bd8c844ee490b86a68bc7e1e75da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '851785a5f76548898a77d67792888504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:08:15.262640 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-540c44ce-cef3-4bd0-abdd-4c3276dc4753 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] 10.222.0.13 "GET /compute/v2.1/servers/7c9dac18-3bfc-4379-ab97-25d185cd6b85" status: 200 len: 1309 microversion: 2.1 time: 1.104141 Nov 01 19:08:15.265079 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1672/3418] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:08:14 2022] GET /compute/v2.1/servers/7c9dac18-3bfc-4379-ab97-25d185cd6b85 => generated 1309 bytes in 1108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:08:15.288981 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-5ebc0436-fe88-4374-b347-d8eafdb8188f tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:08:15.292158 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-5ebc0436-fe88-4374-b347-d8eafdb8188f tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] [instance: ac4160c6-ca16-455e-9613-0d425932af3b] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:08:15.326417 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-472e0d0f-94a7-47fd-aa8f-b417ca9bcf23 tempest-ImagesOneServerTestJSON-1044295602 tempest-ImagesOneServerTestJSON-1044295602-project] 10.222.0.13 "GET /compute/v2.1/images/621c9785-490d-4245-8b6b-91f8571f7eab" status: 200 len: 1422 microversion: 2.1 time: 0.134277 Nov 01 19:08:15.332977 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1747/3419] 10.222.0.13 () {58 vars in 1233 bytes} [Tue Nov 1 19:08:15 2022] GET /compute/v2.1/images/621c9785-490d-4245-8b6b-91f8571f7eab => generated 1422 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:08:15.339809 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-5ebc0436-fe88-4374-b347-d8eafdb8188f tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:08:15.341541 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-5ebc0436-fe88-4374-b347-d8eafdb8188f tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:08:15.343559 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-5ebc0436-fe88-4374-b347-d8eafdb8188f tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:08:15.346716 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-5ebc0436-fe88-4374-b347-d8eafdb8188f tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:08:15.347971 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-5ebc0436-fe88-4374-b347-d8eafdb8188f tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:08:15.350148 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-5ebc0436-fe88-4374-b347-d8eafdb8188f tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:08:15.415518 n-d-863052-2 devstack@n-api.service[121402]: DEBUG dbcounter [-] [121402] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 19:08:15.809590 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-5ebc0436-fe88-4374-b347-d8eafdb8188f tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '790f3f1566b7464aaca19d4d05c0942e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33e3d319293c46b6af2f728a50586906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:08:15.831080 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-5ebc0436-fe88-4374-b347-d8eafdb8188f tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] 10.222.0.13 "GET /compute/v2.1/servers/ac4160c6-ca16-455e-9613-0d425932af3b" status: 200 len: 1367 microversion: 2.1 time: 0.563298 Nov 01 19:08:15.846977 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1673/3420] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:08:15 2022] GET /compute/v2.1/servers/ac4160c6-ca16-455e-9613-0d425932af3b => generated 1367 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:08:15.962393 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-f7457689-4e0c-482c-a8f0-42bd0cf4d0f1 tempest-AttachSCSIVolumeTestJSON-356336257 tempest-AttachSCSIVolumeTestJSON-356336257-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:08:15.966838 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-f7457689-4e0c-482c-a8f0-42bd0cf4d0f1 tempest-AttachSCSIVolumeTestJSON-356336257 tempest-AttachSCSIVolumeTestJSON-356336257-project] [instance: 8a378b79-bd92-4ade-b034-1aaf5c87b74b] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:08:15.987256 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f7457689-4e0c-482c-a8f0-42bd0cf4d0f1 tempest-AttachSCSIVolumeTestJSON-356336257 tempest-AttachSCSIVolumeTestJSON-356336257-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:08:15.988241 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f7457689-4e0c-482c-a8f0-42bd0cf4d0f1 tempest-AttachSCSIVolumeTestJSON-356336257 tempest-AttachSCSIVolumeTestJSON-356336257-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:08:15.989190 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f7457689-4e0c-482c-a8f0-42bd0cf4d0f1 tempest-AttachSCSIVolumeTestJSON-356336257 tempest-AttachSCSIVolumeTestJSON-356336257-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:08:15.990400 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f7457689-4e0c-482c-a8f0-42bd0cf4d0f1 tempest-AttachSCSIVolumeTestJSON-356336257 tempest-AttachSCSIVolumeTestJSON-356336257-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:08:15.991103 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f7457689-4e0c-482c-a8f0-42bd0cf4d0f1 tempest-AttachSCSIVolumeTestJSON-356336257 tempest-AttachSCSIVolumeTestJSON-356336257-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:08:15.991790 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f7457689-4e0c-482c-a8f0-42bd0cf4d0f1 tempest-AttachSCSIVolumeTestJSON-356336257 tempest-AttachSCSIVolumeTestJSON-356336257-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:08:16.083385 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-f7457689-4e0c-482c-a8f0-42bd0cf4d0f1 tempest-AttachSCSIVolumeTestJSON-356336257 tempest-AttachSCSIVolumeTestJSON-356336257-project] 10.222.0.13 "GET /compute/v2.1/servers/8a378b79-bd92-4ade-b034-1aaf5c87b74b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.126196 Nov 01 19:08:16.084386 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1748/3421] 10.222.0.13 () {58 vars in 1302 bytes} [Tue Nov 1 19:08:15 2022] GET /compute/v2.1/servers/8a378b79-bd92-4ade-b034-1aaf5c87b74b/os-volume_attachments => generated 25 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 01 19:08:16.204212 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-90fb0e4e-8fea-4502-b356-804eb1961669 tempest-AttachSCSIVolumeTestJSON-356336257 tempest-AttachSCSIVolumeTestJSON-356336257-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:08:16.206654 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-90fb0e4e-8fea-4502-b356-804eb1961669 tempest-AttachSCSIVolumeTestJSON-356336257 tempest-AttachSCSIVolumeTestJSON-356336257-project] [instance: 8a378b79-bd92-4ade-b034-1aaf5c87b74b] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:08:16.216268 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-b20c6785-b534-48cd-aa8c-80a56f3fb550 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:08:16.219734 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-b20c6785-b534-48cd-aa8c-80a56f3fb550 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] [instance: 8485db2a-fd8f-4615-bbe0-14822ad44194] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:08:16.277373 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-90fb0e4e-8fea-4502-b356-804eb1961669 tempest-AttachSCSIVolumeTestJSON-356336257 tempest-AttachSCSIVolumeTestJSON-356336257-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:08:16.277991 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-90fb0e4e-8fea-4502-b356-804eb1961669 tempest-AttachSCSIVolumeTestJSON-356336257 tempest-AttachSCSIVolumeTestJSON-356336257-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:08:16.278620 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-b20c6785-b534-48cd-aa8c-80a56f3fb550 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:08:16.279229 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-b20c6785-b534-48cd-aa8c-80a56f3fb550 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:08:16.279755 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-b20c6785-b534-48cd-aa8c-80a56f3fb550 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:08:16.280510 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-b20c6785-b534-48cd-aa8c-80a56f3fb550 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:08:16.288986 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-90fb0e4e-8fea-4502-b356-804eb1961669 tempest-AttachSCSIVolumeTestJSON-356336257 tempest-AttachSCSIVolumeTestJSON-356336257-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:08:16.291006 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-b20c6785-b534-48cd-aa8c-80a56f3fb550 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:08:16.291890 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-b20c6785-b534-48cd-aa8c-80a56f3fb550 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:08:16.292767 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-90fb0e4e-8fea-4502-b356-804eb1961669 tempest-AttachSCSIVolumeTestJSON-356336257 tempest-AttachSCSIVolumeTestJSON-356336257-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:08:16.297426 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-90fb0e4e-8fea-4502-b356-804eb1961669 tempest-AttachSCSIVolumeTestJSON-356336257 tempest-AttachSCSIVolumeTestJSON-356336257-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:08:16.298243 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-90fb0e4e-8fea-4502-b356-804eb1961669 tempest-AttachSCSIVolumeTestJSON-356336257 tempest-AttachSCSIVolumeTestJSON-356336257-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:08:16.395705 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-90fb0e4e-8fea-4502-b356-804eb1961669 tempest-AttachSCSIVolumeTestJSON-356336257 tempest-AttachSCSIVolumeTestJSON-356336257-project] 10.222.0.13 "GET /compute/v2.1/servers/8a378b79-bd92-4ade-b034-1aaf5c87b74b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.199677 Nov 01 19:08:16.403149 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1674/3422] 10.222.0.13 () {58 vars in 1302 bytes} [Tue Nov 1 19:08:16 2022] GET /compute/v2.1/servers/8a378b79-bd92-4ade-b034-1aaf5c87b74b/os-volume_attachments => generated 25 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 01 19:08:16.408389 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-cd6caf03-0588-41c4-a607-e0bdc179baf4 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:08:16.409610 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-cd6caf03-0588-41c4-a607-e0bdc179baf4 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] [instance: 7c9dac18-3bfc-4379-ab97-25d185cd6b85] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:08:16.416618 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-cd6caf03-0588-41c4-a607-e0bdc179baf4 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:08:16.417139 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-cd6caf03-0588-41c4-a607-e0bdc179baf4 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:08:16.417725 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-cd6caf03-0588-41c4-a607-e0bdc179baf4 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:08:16.418460 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-cd6caf03-0588-41c4-a607-e0bdc179baf4 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:08:16.419102 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-cd6caf03-0588-41c4-a607-e0bdc179baf4 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:08:16.419694 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-cd6caf03-0588-41c4-a607-e0bdc179baf4 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:08:16.619842 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-b20c6785-b534-48cd-aa8c-80a56f3fb550 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '058480d92c9b4ab4af6815d0438a65c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee9dc49b89143f781e4ab30296e4d01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:08:16.630924 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-b20c6785-b534-48cd-aa8c-80a56f3fb550 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] 10.222.0.13 "GET /compute/v2.1/servers/8485db2a-fd8f-4615-bbe0-14822ad44194" status: 200 len: 1508 microversion: 2.1 time: 0.419816 Nov 01 19:08:16.633924 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1749/3423] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:08:16 2022] GET /compute/v2.1/servers/8485db2a-fd8f-4615-bbe0-14822ad44194 => generated 1508 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:08:16.640609 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-a302fdc2-1409-4951-8c93-132ea8bf73d5 tempest-ImagesOneServerTestJSON-1044295602 tempest-ImagesOneServerTestJSON-1044295602-project] Calling method '.version_select at 0x7f0ae2acc4c0>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:08:16.655527 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-cd6caf03-0588-41c4-a607-e0bdc179baf4 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113bd8c844ee490b86a68bc7e1e75da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '851785a5f76548898a77d67792888504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:08:16.668081 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-cd6caf03-0588-41c4-a607-e0bdc179baf4 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] 10.222.0.13 "GET /compute/v2.1/servers/7c9dac18-3bfc-4379-ab97-25d185cd6b85" status: 200 len: 1490 microversion: 2.1 time: 0.263774 Nov 01 19:08:16.668728 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1675/3424] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:08:16 2022] GET /compute/v2.1/servers/7c9dac18-3bfc-4379-ab97-25d185cd6b85 => generated 1490 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:08:16.690272 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-55a18cd2-1b1f-4fe0-892f-5a70acbfab84 tempest-AttachSCSIVolumeTestJSON-356336257 tempest-AttachSCSIVolumeTestJSON-356336257-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:08:16.691342 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-55a18cd2-1b1f-4fe0-892f-5a70acbfab84 tempest-AttachSCSIVolumeTestJSON-356336257 tempest-AttachSCSIVolumeTestJSON-356336257-project] [instance: 8a378b79-bd92-4ade-b034-1aaf5c87b74b] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:08:16.709000 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-55a18cd2-1b1f-4fe0-892f-5a70acbfab84 tempest-AttachSCSIVolumeTestJSON-356336257 tempest-AttachSCSIVolumeTestJSON-356336257-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:08:16.709944 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-55a18cd2-1b1f-4fe0-892f-5a70acbfab84 tempest-AttachSCSIVolumeTestJSON-356336257 tempest-AttachSCSIVolumeTestJSON-356336257-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:08:16.711520 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-55a18cd2-1b1f-4fe0-892f-5a70acbfab84 tempest-AttachSCSIVolumeTestJSON-356336257 tempest-AttachSCSIVolumeTestJSON-356336257-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:08:16.712421 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-55a18cd2-1b1f-4fe0-892f-5a70acbfab84 tempest-AttachSCSIVolumeTestJSON-356336257 tempest-AttachSCSIVolumeTestJSON-356336257-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:08:16.720129 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-55a18cd2-1b1f-4fe0-892f-5a70acbfab84 tempest-AttachSCSIVolumeTestJSON-356336257 tempest-AttachSCSIVolumeTestJSON-356336257-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:08:16.720945 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-55a18cd2-1b1f-4fe0-892f-5a70acbfab84 tempest-AttachSCSIVolumeTestJSON-356336257 tempest-AttachSCSIVolumeTestJSON-356336257-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:08:16.747447 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-a302fdc2-1409-4951-8c93-132ea8bf73d5 tempest-ImagesOneServerTestJSON-1044295602 tempest-ImagesOneServerTestJSON-1044295602-project] 10.222.0.13 "GET /compute/v2.1/images/621c9785-490d-4245-8b6b-91f8571f7eab" status: 200 len: 1422 microversion: 2.1 time: 0.112197 Nov 01 19:08:16.749104 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1750/3425] 10.222.0.13 () {58 vars in 1233 bytes} [Tue Nov 1 19:08:16 2022] GET /compute/v2.1/images/621c9785-490d-4245-8b6b-91f8571f7eab => generated 1422 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:08:16.768187 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-64457d10-c974-489a-b1dd-33739902a04e tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1127871838", "imageRef": "2d4a0047-1b9e-445f-8af8-1b5c9d93e881", "flavorRef": "452", "networks": [{"uuid": "346d9303-d6bc-4555-85be-95ee31a2d9cd"}]}} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:08:16.797645 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-55a18cd2-1b1f-4fe0-892f-5a70acbfab84 tempest-AttachSCSIVolumeTestJSON-356336257 tempest-AttachSCSIVolumeTestJSON-356336257-project] [instance: 8a378b79-bd92-4ade-b034-1aaf5c87b74b] Going to try to terminate instance {{(pid=121402) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 01 19:08:16.882588 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.network.neutron [None req-64457d10-c974-489a-b1dd-33739902a04e tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] validate_networks() for [('346d9303-d6bc-4555-85be-95ee31a2d9cd', None, None, None, None, None)] {{(pid=121403) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 01 19:08:16.944449 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-55a18cd2-1b1f-4fe0-892f-5a70acbfab84 tempest-AttachSCSIVolumeTestJSON-356336257 tempest-AttachSCSIVolumeTestJSON-356336257-project] 10.222.0.13 "DELETE /compute/v2.1/servers/8a378b79-bd92-4ade-b034-1aaf5c87b74b" status: 204 len: 0 microversion: 2.1 time: 0.269498 Nov 01 19:08:16.945651 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1676/3426] 10.222.0.13 () {58 vars in 1239 bytes} [Tue Nov 1 19:08:16 2022] DELETE /compute/v2.1/servers/8a378b79-bd92-4ade-b034-1aaf5c87b74b => generated 0 bytes in 272 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 01 19:08:16.953956 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-eb9c92bd-37e4-432b-b5c2-b3f42e14ca33 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:08:16.955344 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-eb9c92bd-37e4-432b-b5c2-b3f42e14ca33 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] [instance: ac4160c6-ca16-455e-9613-0d425932af3b] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:08:16.963977 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-eb9c92bd-37e4-432b-b5c2-b3f42e14ca33 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:08:16.964798 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-eb9c92bd-37e4-432b-b5c2-b3f42e14ca33 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:08:16.965440 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-eb9c92bd-37e4-432b-b5c2-b3f42e14ca33 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:08:16.966473 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-eb9c92bd-37e4-432b-b5c2-b3f42e14ca33 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:08:16.967154 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-eb9c92bd-37e4-432b-b5c2-b3f42e14ca33 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:08:16.967765 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-eb9c92bd-37e4-432b-b5c2-b3f42e14ca33 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:08:17.301400 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-eb9c92bd-37e4-432b-b5c2-b3f42e14ca33 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '790f3f1566b7464aaca19d4d05c0942e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33e3d319293c46b6af2f728a50586906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:08:17.315522 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-eb9c92bd-37e4-432b-b5c2-b3f42e14ca33 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] 10.222.0.13 "GET /compute/v2.1/servers/ac4160c6-ca16-455e-9613-0d425932af3b" status: 200 len: 1367 microversion: 2.1 time: 0.367182 Nov 01 19:08:17.316499 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1677/3427] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:08:16 2022] GET /compute/v2.1/servers/ac4160c6-ca16-455e-9613-0d425932af3b => generated 1367 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:08:17.334655 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-8d29e7e1-983c-4f3d-bf36-34f316257b6b tempest-AttachSCSIVolumeTestJSON-356336257 tempest-AttachSCSIVolumeTestJSON-356336257-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:08:17.335216 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-8d29e7e1-983c-4f3d-bf36-34f316257b6b tempest-AttachSCSIVolumeTestJSON-356336257 tempest-AttachSCSIVolumeTestJSON-356336257-project] [instance: 8a378b79-bd92-4ade-b034-1aaf5c87b74b] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:08:17.358900 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-8d29e7e1-983c-4f3d-bf36-34f316257b6b tempest-AttachSCSIVolumeTestJSON-356336257 tempest-AttachSCSIVolumeTestJSON-356336257-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:08:17.360891 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-8d29e7e1-983c-4f3d-bf36-34f316257b6b tempest-AttachSCSIVolumeTestJSON-356336257 tempest-AttachSCSIVolumeTestJSON-356336257-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:08:17.361416 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-8d29e7e1-983c-4f3d-bf36-34f316257b6b tempest-AttachSCSIVolumeTestJSON-356336257 tempest-AttachSCSIVolumeTestJSON-356336257-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:08:17.362406 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-8d29e7e1-983c-4f3d-bf36-34f316257b6b tempest-AttachSCSIVolumeTestJSON-356336257 tempest-AttachSCSIVolumeTestJSON-356336257-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:08:17.363163 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-8d29e7e1-983c-4f3d-bf36-34f316257b6b tempest-AttachSCSIVolumeTestJSON-356336257 tempest-AttachSCSIVolumeTestJSON-356336257-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:08:17.363662 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-8d29e7e1-983c-4f3d-bf36-34f316257b6b tempest-AttachSCSIVolumeTestJSON-356336257 tempest-AttachSCSIVolumeTestJSON-356336257-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:08:17.773101 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-8d29e7e1-983c-4f3d-bf36-34f316257b6b tempest-AttachSCSIVolumeTestJSON-356336257 tempest-AttachSCSIVolumeTestJSON-356336257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde7667dbbfd4864a5b0ca8d8b291406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b14142c34d54977ac9eb59962f2a9e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:08:17.798227 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-8d29e7e1-983c-4f3d-bf36-34f316257b6b tempest-AttachSCSIVolumeTestJSON-356336257 tempest-AttachSCSIVolumeTestJSON-356336257-project] 10.222.0.13 "GET /compute/v2.1/servers/8a378b79-bd92-4ade-b034-1aaf5c87b74b" status: 200 len: 1682 microversion: 2.1 time: 0.474905 Nov 01 19:08:17.799076 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1678/3428] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:08:17 2022] GET /compute/v2.1/servers/8a378b79-bd92-4ade-b034-1aaf5c87b74b => generated 1682 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:08:17.820305 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-6a6a95e0-a1d5-4856-a514-aff5ab3e81c9 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:08:17.835282 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-6a6a95e0-a1d5-4856-a514-aff5ab3e81c9 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] [instance: 8485db2a-fd8f-4615-bbe0-14822ad44194] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:08:17.846899 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-6a6a95e0-a1d5-4856-a514-aff5ab3e81c9 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:08:17.847688 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-6a6a95e0-a1d5-4856-a514-aff5ab3e81c9 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:08:17.848290 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-6a6a95e0-a1d5-4856-a514-aff5ab3e81c9 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:08:17.853066 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-6a6a95e0-a1d5-4856-a514-aff5ab3e81c9 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:08:17.853744 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-6a6a95e0-a1d5-4856-a514-aff5ab3e81c9 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:08:17.854374 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-6a6a95e0-a1d5-4856-a514-aff5ab3e81c9 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:08:18.308152 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.virt.hardware [None req-64457d10-c974-489a-b1dd-33739902a04e tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Flavor limits 0:0:0 {{(pid=121403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 01 19:08:18.308742 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.virt.hardware [None req-64457d10-c974-489a-b1dd-33739902a04e tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Image limits 0:0:0 {{(pid=121403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 01 19:08:18.309213 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.virt.hardware [None req-64457d10-c974-489a-b1dd-33739902a04e tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Flavor pref 0:0:0 {{(pid=121403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 01 19:08:18.309722 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.virt.hardware [None req-64457d10-c974-489a-b1dd-33739902a04e tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Image pref 0:0:0 {{(pid=121403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 01 19:08:18.310231 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.virt.hardware [None req-64457d10-c974-489a-b1dd-33739902a04e tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 01 19:08:18.330770 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-64457d10-c974-489a-b1dd-33739902a04e tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:08:18.331473 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-64457d10-c974-489a-b1dd-33739902a04e tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:08:18.332073 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-64457d10-c974-489a-b1dd-33739902a04e tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:08:18.333662 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-64457d10-c974-489a-b1dd-33739902a04e tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:08:18.335000 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-64457d10-c974-489a-b1dd-33739902a04e tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:08:18.336178 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-64457d10-c974-489a-b1dd-33739902a04e tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:08:18.373543 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.quota [None req-64457d10-c974-489a-b1dd-33739902a04e tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Getting quotas for project 851785a5f76548898a77d67792888504. Resources: {'cores', 'ram', 'instances'} {{(pid=121403) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 01 19:08:18.381705 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.quota [None req-64457d10-c974-489a-b1dd-33739902a04e tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Getting quotas for user 113bd8c844ee490b86a68bc7e1e75da3 and project 851785a5f76548898a77d67792888504. Resources: {'cores', 'ram', 'instances'} {{(pid=121403) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 01 19:08:18.398995 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-64457d10-c974-489a-b1dd-33739902a04e tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Going to run 1 instances... {{(pid=121403) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 01 19:08:18.405667 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-64457d10-c974-489a-b1dd-33739902a04e tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] [instance: 8bfb4e44-7a5f-466d-9f1e-bebee16d400c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2d4a0047-1b9e-445f-8af8-1b5c9d93e881',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121403) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 01 19:08:18.423034 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-6a6a95e0-a1d5-4856-a514-aff5ab3e81c9 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '058480d92c9b4ab4af6815d0438a65c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee9dc49b89143f781e4ab30296e4d01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:08:18.433904 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-6a6a95e0-a1d5-4856-a514-aff5ab3e81c9 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] 10.222.0.13 "GET /compute/v2.1/servers/8485db2a-fd8f-4615-bbe0-14822ad44194" status: 200 len: 1508 microversion: 2.1 time: 0.633571 Nov 01 19:08:18.456955 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1679/3429] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:08:17 2022] GET /compute/v2.1/servers/8485db2a-fd8f-4615-bbe0-14822ad44194 => generated 1508 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:08:18.471697 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-1ef223e0-ce77-4884-b5d6-528b05ed991b tempest-ImagesOneServerTestJSON-1044295602 tempest-ImagesOneServerTestJSON-1044295602-project] Calling method '.version_select at 0x7f0ae2b12550>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:08:18.497636 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-64457d10-c974-489a-b1dd-33739902a04e tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.733216 Nov 01 19:08:18.499939 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1751/3430] 10.222.0.13 () {60 vars in 1147 bytes} [Tue Nov 1 19:08:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 1736 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Nov 01 19:08:18.513670 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-a7853dcb-108b-42d5-8dbb-76be025bca00 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:08:18.514711 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-a7853dcb-108b-42d5-8dbb-76be025bca00 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] [instance: ac4160c6-ca16-455e-9613-0d425932af3b] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:08:18.534847 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-1ef223e0-ce77-4884-b5d6-528b05ed991b tempest-ImagesOneServerTestJSON-1044295602 tempest-ImagesOneServerTestJSON-1044295602-project] 10.222.0.13 "GET /compute/v2.1/images/621c9785-490d-4245-8b6b-91f8571f7eab" status: 200 len: 1422 microversion: 2.1 time: 0.071173 Nov 01 19:08:18.543682 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1680/3431] 10.222.0.13 () {58 vars in 1233 bytes} [Tue Nov 1 19:08:18 2022] GET /compute/v2.1/images/621c9785-490d-4245-8b6b-91f8571f7eab => generated 1422 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:08:18.544111 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-a7853dcb-108b-42d5-8dbb-76be025bca00 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:08:18.544111 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-a7853dcb-108b-42d5-8dbb-76be025bca00 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:08:18.544111 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-a7853dcb-108b-42d5-8dbb-76be025bca00 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:08:18.544111 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-a7853dcb-108b-42d5-8dbb-76be025bca00 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:08:18.544111 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-a7853dcb-108b-42d5-8dbb-76be025bca00 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:08:18.544111 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-a7853dcb-108b-42d5-8dbb-76be025bca00 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:08:18.544545 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-bd77345d-ebc0-4249-b733-af942075cb03 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:08:18.544545 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-bd77345d-ebc0-4249-b733-af942075cb03 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] [instance: 8bfb4e44-7a5f-466d-9f1e-bebee16d400c] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:08:18.614385 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-bd77345d-ebc0-4249-b733-af942075cb03 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113bd8c844ee490b86a68bc7e1e75da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '851785a5f76548898a77d67792888504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:08:18.622853 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-bd77345d-ebc0-4249-b733-af942075cb03 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] 10.222.0.13 "GET /compute/v2.1/servers/8bfb4e44-7a5f-466d-9f1e-bebee16d400c" status: 200 len: 1209 microversion: 2.1 time: 0.086084 Nov 01 19:08:18.640192 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1681/3432] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:08:18 2022] GET /compute/v2.1/servers/8bfb4e44-7a5f-466d-9f1e-bebee16d400c => generated 1209 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:08:18.827920 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-60db8e2f-e687-4b4c-8f1c-d6d6dcd49bb6 tempest-AttachSCSIVolumeTestJSON-356336257 tempest-AttachSCSIVolumeTestJSON-356336257-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:08:18.828498 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-60db8e2f-e687-4b4c-8f1c-d6d6dcd49bb6 tempest-AttachSCSIVolumeTestJSON-356336257 tempest-AttachSCSIVolumeTestJSON-356336257-project] [instance: 8a378b79-bd92-4ade-b034-1aaf5c87b74b] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:08:18.839576 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-60db8e2f-e687-4b4c-8f1c-d6d6dcd49bb6 tempest-AttachSCSIVolumeTestJSON-356336257 tempest-AttachSCSIVolumeTestJSON-356336257-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:08:18.844236 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-60db8e2f-e687-4b4c-8f1c-d6d6dcd49bb6 tempest-AttachSCSIVolumeTestJSON-356336257 tempest-AttachSCSIVolumeTestJSON-356336257-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:08:18.845717 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-60db8e2f-e687-4b4c-8f1c-d6d6dcd49bb6 tempest-AttachSCSIVolumeTestJSON-356336257 tempest-AttachSCSIVolumeTestJSON-356336257-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:08:18.849401 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-60db8e2f-e687-4b4c-8f1c-d6d6dcd49bb6 tempest-AttachSCSIVolumeTestJSON-356336257 tempest-AttachSCSIVolumeTestJSON-356336257-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:08:18.850755 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-60db8e2f-e687-4b4c-8f1c-d6d6dcd49bb6 tempest-AttachSCSIVolumeTestJSON-356336257 tempest-AttachSCSIVolumeTestJSON-356336257-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:08:18.851222 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-60db8e2f-e687-4b4c-8f1c-d6d6dcd49bb6 tempest-AttachSCSIVolumeTestJSON-356336257 tempest-AttachSCSIVolumeTestJSON-356336257-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:08:19.054796 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-a7853dcb-108b-42d5-8dbb-76be025bca00 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '790f3f1566b7464aaca19d4d05c0942e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33e3d319293c46b6af2f728a50586906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:08:19.071207 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-a7853dcb-108b-42d5-8dbb-76be025bca00 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] 10.222.0.13 "GET /compute/v2.1/servers/ac4160c6-ca16-455e-9613-0d425932af3b" status: 200 len: 1367 microversion: 2.1 time: 0.569895 Nov 01 19:08:19.073861 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1752/3433] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:08:18 2022] GET /compute/v2.1/servers/ac4160c6-ca16-455e-9613-0d425932af3b => generated 1367 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:08:19.169123 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-60db8e2f-e687-4b4c-8f1c-d6d6dcd49bb6 tempest-AttachSCSIVolumeTestJSON-356336257 tempest-AttachSCSIVolumeTestJSON-356336257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde7667dbbfd4864a5b0ca8d8b291406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b14142c34d54977ac9eb59962f2a9e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:08:19.179265 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-60db8e2f-e687-4b4c-8f1c-d6d6dcd49bb6 tempest-AttachSCSIVolumeTestJSON-356336257 tempest-AttachSCSIVolumeTestJSON-356336257-project] 10.222.0.13 "GET /compute/v2.1/servers/8a378b79-bd92-4ade-b034-1aaf5c87b74b" status: 200 len: 1682 microversion: 2.1 time: 0.356426 Nov 01 19:08:19.180724 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1682/3434] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:08:18 2022] GET /compute/v2.1/servers/8a378b79-bd92-4ade-b034-1aaf5c87b74b => generated 1682 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:08:19.465935 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-4e393e3d-0dac-42c8-866f-bc112da0232e tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:08:19.468142 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-4e393e3d-0dac-42c8-866f-bc112da0232e tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] [instance: 8485db2a-fd8f-4615-bbe0-14822ad44194] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:08:19.488018 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-4e393e3d-0dac-42c8-866f-bc112da0232e tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:08:19.489241 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-4e393e3d-0dac-42c8-866f-bc112da0232e tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:08:19.491261 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-4e393e3d-0dac-42c8-866f-bc112da0232e tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:08:19.494377 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-4e393e3d-0dac-42c8-866f-bc112da0232e tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:08:19.495133 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-4e393e3d-0dac-42c8-866f-bc112da0232e tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:08:19.498130 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-4e393e3d-0dac-42c8-866f-bc112da0232e tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:08:19.554332 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-aecc5dc8-3ec1-4b61-8e66-47b9c2d4e916 tempest-ImagesOneServerTestJSON-1044295602 tempest-ImagesOneServerTestJSON-1044295602-project] Calling method '.version_select at 0x7f0ae19204c0>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:08:19.630450 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-aecc5dc8-3ec1-4b61-8e66-47b9c2d4e916 tempest-ImagesOneServerTestJSON-1044295602 tempest-ImagesOneServerTestJSON-1044295602-project] 10.222.0.13 "GET /compute/v2.1/images/621c9785-490d-4245-8b6b-91f8571f7eab" status: 200 len: 1422 microversion: 2.1 time: 0.079915 Nov 01 19:08:19.642111 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1683/3435] 10.222.0.13 () {58 vars in 1233 bytes} [Tue Nov 1 19:08:19 2022] GET /compute/v2.1/images/621c9785-490d-4245-8b6b-91f8571f7eab => generated 1422 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:08:19.652959 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-f652d8b9-4ca7-47b4-9c76-9e2aff5868bb tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:08:19.654625 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-f652d8b9-4ca7-47b4-9c76-9e2aff5868bb tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] [instance: 8bfb4e44-7a5f-466d-9f1e-bebee16d400c] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:08:19.687670 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f652d8b9-4ca7-47b4-9c76-9e2aff5868bb tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:08:19.688178 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f652d8b9-4ca7-47b4-9c76-9e2aff5868bb tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:08:19.691884 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f652d8b9-4ca7-47b4-9c76-9e2aff5868bb tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:08:19.696237 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f652d8b9-4ca7-47b4-9c76-9e2aff5868bb tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:08:19.698531 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f652d8b9-4ca7-47b4-9c76-9e2aff5868bb tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:08:19.703302 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f652d8b9-4ca7-47b4-9c76-9e2aff5868bb tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:08:19.864020 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-f652d8b9-4ca7-47b4-9c76-9e2aff5868bb tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113bd8c844ee490b86a68bc7e1e75da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '851785a5f76548898a77d67792888504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:08:19.878906 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-f652d8b9-4ca7-47b4-9c76-9e2aff5868bb tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] 10.222.0.13 "GET /compute/v2.1/servers/8bfb4e44-7a5f-466d-9f1e-bebee16d400c" status: 200 len: 1213 microversion: 2.1 time: 0.233448 Nov 01 19:08:19.880007 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1684/3436] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:08:19 2022] GET /compute/v2.1/servers/8bfb4e44-7a5f-466d-9f1e-bebee16d400c => generated 1213 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:08:19.999835 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-4e393e3d-0dac-42c8-866f-bc112da0232e tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '058480d92c9b4ab4af6815d0438a65c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee9dc49b89143f781e4ab30296e4d01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:08:20.008788 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-4e393e3d-0dac-42c8-866f-bc112da0232e tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] 10.222.0.13 "GET /compute/v2.1/servers/8485db2a-fd8f-4615-bbe0-14822ad44194" status: 200 len: 1508 microversion: 2.1 time: 0.549923 Nov 01 19:08:20.028646 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1753/3437] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:08:19 2022] GET /compute/v2.1/servers/8485db2a-fd8f-4615-bbe0-14822ad44194 => generated 1508 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:08:20.116106 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-22a22202-554e-479f-9157-96cb548d99e8 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:08:20.117208 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-22a22202-554e-479f-9157-96cb548d99e8 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] [instance: ac4160c6-ca16-455e-9613-0d425932af3b] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:08:20.126167 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-22a22202-554e-479f-9157-96cb548d99e8 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:08:20.129938 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-22a22202-554e-479f-9157-96cb548d99e8 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:08:20.130728 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-22a22202-554e-479f-9157-96cb548d99e8 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:08:20.131811 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-22a22202-554e-479f-9157-96cb548d99e8 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:08:20.133933 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-22a22202-554e-479f-9157-96cb548d99e8 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:08:20.134723 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-22a22202-554e-479f-9157-96cb548d99e8 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:08:20.209958 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-1140fbd6-57d1-4f12-9d60-e4a42a5b8795 tempest-AttachSCSIVolumeTestJSON-356336257 tempest-AttachSCSIVolumeTestJSON-356336257-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:08:20.210572 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-1140fbd6-57d1-4f12-9d60-e4a42a5b8795 tempest-AttachSCSIVolumeTestJSON-356336257 tempest-AttachSCSIVolumeTestJSON-356336257-project] [instance: 8a378b79-bd92-4ade-b034-1aaf5c87b74b] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:08:20.217784 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-1140fbd6-57d1-4f12-9d60-e4a42a5b8795 tempest-AttachSCSIVolumeTestJSON-356336257 tempest-AttachSCSIVolumeTestJSON-356336257-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:08:20.218273 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-1140fbd6-57d1-4f12-9d60-e4a42a5b8795 tempest-AttachSCSIVolumeTestJSON-356336257 tempest-AttachSCSIVolumeTestJSON-356336257-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:08:20.218716 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-1140fbd6-57d1-4f12-9d60-e4a42a5b8795 tempest-AttachSCSIVolumeTestJSON-356336257 tempest-AttachSCSIVolumeTestJSON-356336257-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:08:20.226888 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-1140fbd6-57d1-4f12-9d60-e4a42a5b8795 tempest-AttachSCSIVolumeTestJSON-356336257 tempest-AttachSCSIVolumeTestJSON-356336257-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:08:20.231799 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-1140fbd6-57d1-4f12-9d60-e4a42a5b8795 tempest-AttachSCSIVolumeTestJSON-356336257 tempest-AttachSCSIVolumeTestJSON-356336257-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:08:20.235018 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-1140fbd6-57d1-4f12-9d60-e4a42a5b8795 tempest-AttachSCSIVolumeTestJSON-356336257 tempest-AttachSCSIVolumeTestJSON-356336257-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:08:20.434462 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-22a22202-554e-479f-9157-96cb548d99e8 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '790f3f1566b7464aaca19d4d05c0942e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33e3d319293c46b6af2f728a50586906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:08:20.446971 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-22a22202-554e-479f-9157-96cb548d99e8 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] 10.222.0.13 "GET /compute/v2.1/servers/ac4160c6-ca16-455e-9613-0d425932af3b" status: 200 len: 1367 microversion: 2.1 time: 0.335225 Nov 01 19:08:20.457539 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1685/3438] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:08:20 2022] GET /compute/v2.1/servers/ac4160c6-ca16-455e-9613-0d425932af3b => generated 1367 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:08:20.650246 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-21945ed1-31b1-437b-a15f-746aacbe36bc tempest-ImagesOneServerTestJSON-1044295602 tempest-ImagesOneServerTestJSON-1044295602-project] Calling method '.version_select at 0x7f0ae1972d30>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:08:20.702495 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-1140fbd6-57d1-4f12-9d60-e4a42a5b8795 tempest-AttachSCSIVolumeTestJSON-356336257 tempest-AttachSCSIVolumeTestJSON-356336257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde7667dbbfd4864a5b0ca8d8b291406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b14142c34d54977ac9eb59962f2a9e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:08:20.712853 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-1140fbd6-57d1-4f12-9d60-e4a42a5b8795 tempest-AttachSCSIVolumeTestJSON-356336257 tempest-AttachSCSIVolumeTestJSON-356336257-project] 10.222.0.13 "GET /compute/v2.1/servers/8a378b79-bd92-4ade-b034-1aaf5c87b74b" status: 200 len: 1682 microversion: 2.1 time: 0.506692 Nov 01 19:08:20.714005 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1754/3439] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:08:20 2022] GET /compute/v2.1/servers/8a378b79-bd92-4ade-b034-1aaf5c87b74b => generated 1682 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:08:20.739643 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-21945ed1-31b1-437b-a15f-746aacbe36bc tempest-ImagesOneServerTestJSON-1044295602 tempest-ImagesOneServerTestJSON-1044295602-project] 10.222.0.13 "GET /compute/v2.1/images/621c9785-490d-4245-8b6b-91f8571f7eab" status: 200 len: 1431 microversion: 2.1 time: 0.095261 Nov 01 19:08:20.740845 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1686/3440] 10.222.0.13 () {58 vars in 1233 bytes} [Tue Nov 1 19:08:20 2022] GET /compute/v2.1/images/621c9785-490d-4245-8b6b-91f8571f7eab => generated 1431 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:08:20.758606 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-6333c13a-89b5-411c-a02a-6c71c0ddbd9d tempest-ImagesOneServerTestJSON-1044295602 tempest-ImagesOneServerTestJSON-1044295602-project] Calling method '.version_select at 0x7f0ae28054c0>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:08:20.820923 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-6333c13a-89b5-411c-a02a-6c71c0ddbd9d tempest-ImagesOneServerTestJSON-1044295602 tempest-ImagesOneServerTestJSON-1044295602-project] 10.222.0.13 "GET /compute/v2.1/images/621c9785-490d-4245-8b6b-91f8571f7eab" status: 200 len: 1431 microversion: 2.1 time: 0.066762 Nov 01 19:08:20.821507 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1755/3441] 10.222.0.13 () {58 vars in 1233 bytes} [Tue Nov 1 19:08:20 2022] GET /compute/v2.1/images/621c9785-490d-4245-8b6b-91f8571f7eab => generated 1431 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:08:20.836940 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-fb68fefd-2ffb-4bcd-95c5-18e98e367710 tempest-ImagesOneServerTestJSON-1044295602 tempest-ImagesOneServerTestJSON-1044295602-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:08:20.837646 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-fb68fefd-2ffb-4bcd-95c5-18e98e367710 tempest-ImagesOneServerTestJSON-1044295602 tempest-ImagesOneServerTestJSON-1044295602-project] [instance: 31f51cbd-b29a-46be-bca0-f27c2b287e15] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:08:20.844710 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-fb68fefd-2ffb-4bcd-95c5-18e98e367710 tempest-ImagesOneServerTestJSON-1044295602 tempest-ImagesOneServerTestJSON-1044295602-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:08:20.845273 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-fb68fefd-2ffb-4bcd-95c5-18e98e367710 tempest-ImagesOneServerTestJSON-1044295602 tempest-ImagesOneServerTestJSON-1044295602-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:08:20.845779 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-fb68fefd-2ffb-4bcd-95c5-18e98e367710 tempest-ImagesOneServerTestJSON-1044295602 tempest-ImagesOneServerTestJSON-1044295602-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:08:20.846540 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-fb68fefd-2ffb-4bcd-95c5-18e98e367710 tempest-ImagesOneServerTestJSON-1044295602 tempest-ImagesOneServerTestJSON-1044295602-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:08:20.847065 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-fb68fefd-2ffb-4bcd-95c5-18e98e367710 tempest-ImagesOneServerTestJSON-1044295602 tempest-ImagesOneServerTestJSON-1044295602-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:08:20.847558 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-fb68fefd-2ffb-4bcd-95c5-18e98e367710 tempest-ImagesOneServerTestJSON-1044295602 tempest-ImagesOneServerTestJSON-1044295602-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:08:20.951719 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-061cfaa6-6e7f-4f09-8465-8858751a5f4e tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV247Test-server-822926794", "imageRef": "2d4a0047-1b9e-445f-8af8-1b5c9d93e881", "flavorRef": "452", "networks": "none"}} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:08:21.013012 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.virt.hardware [None req-061cfaa6-6e7f-4f09-8465-8858751a5f4e tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Flavor limits 0:0:0 {{(pid=121402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 01 19:08:21.013799 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.virt.hardware [None req-061cfaa6-6e7f-4f09-8465-8858751a5f4e tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Image limits 0:0:0 {{(pid=121402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 01 19:08:21.014314 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.virt.hardware [None req-061cfaa6-6e7f-4f09-8465-8858751a5f4e tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Flavor pref 0:0:0 {{(pid=121402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 01 19:08:21.014828 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.virt.hardware [None req-061cfaa6-6e7f-4f09-8465-8858751a5f4e tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Image pref 0:0:0 {{(pid=121402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 01 19:08:21.015369 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.virt.hardware [None req-061cfaa6-6e7f-4f09-8465-8858751a5f4e tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 01 19:08:21.032046 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-061cfaa6-6e7f-4f09-8465-8858751a5f4e tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:08:21.032936 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-061cfaa6-6e7f-4f09-8465-8858751a5f4e tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:08:21.033584 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-061cfaa6-6e7f-4f09-8465-8858751a5f4e tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:08:21.034781 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-061cfaa6-6e7f-4f09-8465-8858751a5f4e tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:08:21.035808 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-061cfaa6-6e7f-4f09-8465-8858751a5f4e tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:08:21.036206 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-061cfaa6-6e7f-4f09-8465-8858751a5f4e tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:08:21.079498 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.quota [None req-061cfaa6-6e7f-4f09-8465-8858751a5f4e tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Getting quotas for project 1a0c0985c7b9450a8b622b6761e5b5c3. Resources: {'cores', 'ram', 'instances'} {{(pid=121402) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 01 19:08:21.098290 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.quota [None req-061cfaa6-6e7f-4f09-8465-8858751a5f4e tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Getting quotas for user 57ba6eeb99714c7cabb14f484968e269 and project 1a0c0985c7b9450a8b622b6761e5b5c3. Resources: {'cores', 'ram', 'instances'} {{(pid=121402) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 01 19:08:21.129420 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-061cfaa6-6e7f-4f09-8465-8858751a5f4e tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Going to run 1 instances... {{(pid=121402) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 01 19:08:21.132093 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-061cfaa6-6e7f-4f09-8465-8858751a5f4e tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] [instance: a30abc7e-5432-4280-b0cc-19a1a8223e7a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2d4a0047-1b9e-445f-8af8-1b5c9d93e881',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121402) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 01 19:08:21.182093 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-061cfaa6-6e7f-4f09-8465-8858751a5f4e tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.412686 Nov 01 19:08:21.183461 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1687/3442] 10.222.0.13 () {62 vars in 1188 bytes} [Tue Nov 1 19:08:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 415 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Nov 01 19:08:21.193572 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-e32c7ddd-1726-40a6-9942-e5b4cd392be5 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:08:21.194521 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-e32c7ddd-1726-40a6-9942-e5b4cd392be5 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] [instance: 8bfb4e44-7a5f-466d-9f1e-bebee16d400c] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:08:21.201559 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e32c7ddd-1726-40a6-9942-e5b4cd392be5 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:08:21.202238 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e32c7ddd-1726-40a6-9942-e5b4cd392be5 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:08:21.202747 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e32c7ddd-1726-40a6-9942-e5b4cd392be5 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:08:21.203539 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e32c7ddd-1726-40a6-9942-e5b4cd392be5 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:08:21.204062 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e32c7ddd-1726-40a6-9942-e5b4cd392be5 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:08:21.204547 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e32c7ddd-1726-40a6-9942-e5b4cd392be5 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:08:21.205217 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-fb68fefd-2ffb-4bcd-95c5-18e98e367710 tempest-ImagesOneServerTestJSON-1044295602 tempest-ImagesOneServerTestJSON-1044295602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6fd718964648e4bc83ed37cbaa9b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c548420d1df4403c9129cce5f040d45b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:08:21.221276 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-fb68fefd-2ffb-4bcd-95c5-18e98e367710 tempest-ImagesOneServerTestJSON-1044295602 tempest-ImagesOneServerTestJSON-1044295602-project] 10.222.0.13 "GET /compute/v2.1/servers/31f51cbd-b29a-46be-bca0-f27c2b287e15" status: 200 len: 1479 microversion: 2.1 time: 0.388318 Nov 01 19:08:21.226182 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1756/3443] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:08:20 2022] GET /compute/v2.1/servers/31f51cbd-b29a-46be-bca0-f27c2b287e15 => generated 1479 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 19:08:21.231830 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-4a98997f-d25a-4439-a832-0e88762ea4e9 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:08:21.232696 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-4a98997f-d25a-4439-a832-0e88762ea4e9 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] [instance: 8485db2a-fd8f-4615-bbe0-14822ad44194] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:08:21.249499 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-4a98997f-d25a-4439-a832-0e88762ea4e9 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:08:21.250249 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-4a98997f-d25a-4439-a832-0e88762ea4e9 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:08:21.251134 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-4a98997f-d25a-4439-a832-0e88762ea4e9 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:08:21.252057 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-4a98997f-d25a-4439-a832-0e88762ea4e9 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:08:21.252769 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-4a98997f-d25a-4439-a832-0e88762ea4e9 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:08:21.253356 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-4a98997f-d25a-4439-a832-0e88762ea4e9 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:08:21.321251 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-e32c7ddd-1726-40a6-9942-e5b4cd392be5 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113bd8c844ee490b86a68bc7e1e75da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '851785a5f76548898a77d67792888504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:08:21.330054 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-e32c7ddd-1726-40a6-9942-e5b4cd392be5 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] 10.222.0.13 "GET /compute/v2.1/servers/8bfb4e44-7a5f-466d-9f1e-bebee16d400c" status: 200 len: 1279 microversion: 2.1 time: 0.144982 Nov 01 19:08:21.331179 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1688/3444] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:08:21 2022] GET /compute/v2.1/servers/8bfb4e44-7a5f-466d-9f1e-bebee16d400c => generated 1279 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:08:21.336549 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-fe110a78-84cd-445d-a411-c8db00f91eaf tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:08:21.337511 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-fe110a78-84cd-445d-a411-c8db00f91eaf tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] [instance: a30abc7e-5432-4280-b0cc-19a1a8223e7a] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:08:21.446553 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-fe110a78-84cd-445d-a411-c8db00f91eaf tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57ba6eeb99714c7cabb14f484968e269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a0c0985c7b9450a8b622b6761e5b5c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:08:21.473859 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-fe110a78-84cd-445d-a411-c8db00f91eaf tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57ba6eeb99714c7cabb14f484968e269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a0c0985c7b9450a8b622b6761e5b5c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:08:21.475496 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-fe110a78-84cd-445d-a411-c8db00f91eaf tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57ba6eeb99714c7cabb14f484968e269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a0c0985c7b9450a8b622b6761e5b5c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:08:21.487488 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-fe110a78-84cd-445d-a411-c8db00f91eaf tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] 10.222.0.13 "GET /compute/v2.1/servers/a30abc7e-5432-4280-b0cc-19a1a8223e7a" status: 200 len: 1277 microversion: 2.47 time: 0.150742 Nov 01 19:08:21.500607 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1689/3445] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 19:08:21 2022] GET /compute/v2.1/servers/a30abc7e-5432-4280-b0cc-19a1a8223e7a => generated 1277 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 19:08:21.500607 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-6d8179f4-75ff-4bec-8928-7b8d3b12c025 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:08:21.500607 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-6d8179f4-75ff-4bec-8928-7b8d3b12c025 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] [instance: ac4160c6-ca16-455e-9613-0d425932af3b] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:08:21.514847 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-6d8179f4-75ff-4bec-8928-7b8d3b12c025 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:08:21.515342 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-6d8179f4-75ff-4bec-8928-7b8d3b12c025 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:08:21.515781 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-6d8179f4-75ff-4bec-8928-7b8d3b12c025 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:08:21.516489 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-6d8179f4-75ff-4bec-8928-7b8d3b12c025 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:08:21.521761 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-6d8179f4-75ff-4bec-8928-7b8d3b12c025 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:08:21.522225 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-6d8179f4-75ff-4bec-8928-7b8d3b12c025 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:08:21.676181 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-4a98997f-d25a-4439-a832-0e88762ea4e9 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '058480d92c9b4ab4af6815d0438a65c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee9dc49b89143f781e4ab30296e4d01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:08:21.687171 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-4a98997f-d25a-4439-a832-0e88762ea4e9 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] 10.222.0.13 "GET /compute/v2.1/servers/8485db2a-fd8f-4615-bbe0-14822ad44194" status: 200 len: 1508 microversion: 2.1 time: 0.459074 Nov 01 19:08:21.688893 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1757/3446] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:08:21 2022] GET /compute/v2.1/servers/8485db2a-fd8f-4615-bbe0-14822ad44194 => generated 1508 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:08:21.694153 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-8062fd5a-92d5-4473-9d4f-121d30bc7d13 tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV247Test-server-1333517324", "imageRef": "2d4a0047-1b9e-445f-8af8-1b5c9d93e881", "flavorRef": "452", "networks": "none"}} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:08:21.801228 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.virt.hardware [None req-8062fd5a-92d5-4473-9d4f-121d30bc7d13 tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Flavor limits 0:0:0 {{(pid=121403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 01 19:08:21.801969 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.virt.hardware [None req-8062fd5a-92d5-4473-9d4f-121d30bc7d13 tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Image limits 0:0:0 {{(pid=121403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 01 19:08:21.803561 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.virt.hardware [None req-8062fd5a-92d5-4473-9d4f-121d30bc7d13 tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Flavor pref 0:0:0 {{(pid=121403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 01 19:08:21.805757 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.virt.hardware [None req-8062fd5a-92d5-4473-9d4f-121d30bc7d13 tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Image pref 0:0:0 {{(pid=121403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 01 19:08:21.807051 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.virt.hardware [None req-8062fd5a-92d5-4473-9d4f-121d30bc7d13 tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 01 19:08:21.836482 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-8062fd5a-92d5-4473-9d4f-121d30bc7d13 tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:08:21.837524 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-8062fd5a-92d5-4473-9d4f-121d30bc7d13 tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:08:21.838141 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-8062fd5a-92d5-4473-9d4f-121d30bc7d13 tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:08:21.839352 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-8062fd5a-92d5-4473-9d4f-121d30bc7d13 tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:08:21.840038 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-8062fd5a-92d5-4473-9d4f-121d30bc7d13 tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:08:21.846584 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-8062fd5a-92d5-4473-9d4f-121d30bc7d13 tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:08:21.897050 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.quota [None req-8062fd5a-92d5-4473-9d4f-121d30bc7d13 tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Getting quotas for project 1a0c0985c7b9450a8b622b6761e5b5c3. Resources: {'cores', 'ram', 'instances'} {{(pid=121403) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 01 19:08:21.910192 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.quota [None req-8062fd5a-92d5-4473-9d4f-121d30bc7d13 tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Getting quotas for user 57ba6eeb99714c7cabb14f484968e269 and project 1a0c0985c7b9450a8b622b6761e5b5c3. Resources: {'cores', 'ram', 'instances'} {{(pid=121403) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 01 19:08:21.960772 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-8062fd5a-92d5-4473-9d4f-121d30bc7d13 tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Going to run 1 instances... {{(pid=121403) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 01 19:08:21.970485 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-8062fd5a-92d5-4473-9d4f-121d30bc7d13 tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] [instance: 77d6f571-5742-462c-ada0-1b05dd1561d1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2d4a0047-1b9e-445f-8af8-1b5c9d93e881',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121403) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 01 19:08:22.010019 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-6d8179f4-75ff-4bec-8928-7b8d3b12c025 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '790f3f1566b7464aaca19d4d05c0942e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33e3d319293c46b6af2f728a50586906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:08:22.022738 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-6d8179f4-75ff-4bec-8928-7b8d3b12c025 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] 10.222.0.13 "GET /compute/v2.1/servers/ac4160c6-ca16-455e-9613-0d425932af3b" status: 200 len: 1367 microversion: 2.1 time: 0.531168 Nov 01 19:08:22.026391 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1690/3447] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:08:21 2022] GET /compute/v2.1/servers/ac4160c6-ca16-455e-9613-0d425932af3b => generated 1367 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:08:22.032300 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-245299e6-afef-4ca4-a67c-d13e9b033684 tempest-AttachSCSIVolumeTestJSON-356336257 tempest-AttachSCSIVolumeTestJSON-356336257-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:08:22.036199 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-245299e6-afef-4ca4-a67c-d13e9b033684 tempest-AttachSCSIVolumeTestJSON-356336257 tempest-AttachSCSIVolumeTestJSON-356336257-project] [instance: 8a378b79-bd92-4ade-b034-1aaf5c87b74b] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:08:22.052215 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-245299e6-afef-4ca4-a67c-d13e9b033684 tempest-AttachSCSIVolumeTestJSON-356336257 tempest-AttachSCSIVolumeTestJSON-356336257-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:08:22.055941 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-245299e6-afef-4ca4-a67c-d13e9b033684 tempest-AttachSCSIVolumeTestJSON-356336257 tempest-AttachSCSIVolumeTestJSON-356336257-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:08:22.056603 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-245299e6-afef-4ca4-a67c-d13e9b033684 tempest-AttachSCSIVolumeTestJSON-356336257 tempest-AttachSCSIVolumeTestJSON-356336257-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:08:22.057460 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-245299e6-afef-4ca4-a67c-d13e9b033684 tempest-AttachSCSIVolumeTestJSON-356336257 tempest-AttachSCSIVolumeTestJSON-356336257-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:08:22.057994 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-245299e6-afef-4ca4-a67c-d13e9b033684 tempest-AttachSCSIVolumeTestJSON-356336257 tempest-AttachSCSIVolumeTestJSON-356336257-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:08:22.060853 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-245299e6-afef-4ca4-a67c-d13e9b033684 tempest-AttachSCSIVolumeTestJSON-356336257 tempest-AttachSCSIVolumeTestJSON-356336257-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:08:22.158015 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-8062fd5a-92d5-4473-9d4f-121d30bc7d13 tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.467836 Nov 01 19:08:22.159334 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-245299e6-afef-4ca4-a67c-d13e9b033684 tempest-AttachSCSIVolumeTestJSON-356336257 tempest-AttachSCSIVolumeTestJSON-356336257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde7667dbbfd4864a5b0ca8d8b291406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b14142c34d54977ac9eb59962f2a9e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:08:22.163483 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1758/3448] 10.222.0.13 () {62 vars in 1188 bytes} [Tue Nov 1 19:08:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 474 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Nov 01 19:08:22.177571 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-245299e6-afef-4ca4-a67c-d13e9b033684 tempest-AttachSCSIVolumeTestJSON-356336257 tempest-AttachSCSIVolumeTestJSON-356336257-project] 10.222.0.13 "GET /compute/v2.1/servers/8a378b79-bd92-4ade-b034-1aaf5c87b74b" status: 200 len: 1327 microversion: 2.1 time: 0.149791 Nov 01 19:08:22.180165 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1691/3449] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:08:22 2022] GET /compute/v2.1/servers/8a378b79-bd92-4ade-b034-1aaf5c87b74b => generated 1327 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:08:22.194195 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [req-02ca997f-0510-4f00-b715-592bc4a4c00d req-f8c06de0-e604-422c-b5da-a77df784a816 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8a378b79-bd92-4ade-b034-1aaf5c87b74b", "name": "network-vif-deleted", "tag": "7351786b-bb68-489c-a92f-36e1f62d4e9a"}]} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:08:22.213205 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-02ca997f-0510-4f00-b715-592bc4a4c00d req-f8c06de0-e604-422c-b5da-a77df784a816 service nova] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:08:22.218468 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-02ca997f-0510-4f00-b715-592bc4a4c00d req-f8c06de0-e604-422c-b5da-a77df784a816 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:08:22.220555 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-02ca997f-0510-4f00-b715-592bc4a4c00d req-f8c06de0-e604-422c-b5da-a77df784a816 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:08:22.222066 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [req-9cd12a17-e981-4110-bb31-1d55b6e8cb01 req-6f8f982c-bf1f-4543-8428-b675612297d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac4160c6-ca16-455e-9613-0d425932af3b", "name": "network-vif-plugged", "status": "completed", "tag": "bf1271b3-df00-4974-8247-8425a2ebf2ee"}]} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:08:22.246577 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.compute.server_external_events [req-02ca997f-0510-4f00-b715-592bc4a4c00d req-f8c06de0-e604-422c-b5da-a77df784a816 service nova] Creating event network-vif-deleted:7351786b-bb68-489c-a92f-36e1f62d4e9a for instance 8a378b79-bd92-4ade-b034-1aaf5c87b74b on n-h2-863052-2 Nov 01 19:08:22.262425 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [req-02ca997f-0510-4f00-b715-592bc4a4c00d req-f8c06de0-e604-422c-b5da-a77df784a816 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078641 Nov 01 19:08:22.267905 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1692/3450] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Nov 1 19:08:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:08:22.273650 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-b9d0f8b8-f302-4df8-9315-578b665a959e tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Action: 'update', calling method: >, body: {"server": {}} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:08:22.276563 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-b9d0f8b8-f302-4df8-9315-578b665a959e tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] [instance: 77d6f571-5742-462c-ada0-1b05dd1561d1] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:08:22.285856 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-9cd12a17-e981-4110-bb31-1d55b6e8cb01 req-6f8f982c-bf1f-4543-8428-b675612297d1 service nova] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:08:22.286477 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-9cd12a17-e981-4110-bb31-1d55b6e8cb01 req-6f8f982c-bf1f-4543-8428-b675612297d1 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:08:22.286986 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-9cd12a17-e981-4110-bb31-1d55b6e8cb01 req-6f8f982c-bf1f-4543-8428-b675612297d1 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:08:22.301828 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.compute.server_external_events [req-9cd12a17-e981-4110-bb31-1d55b6e8cb01 req-6f8f982c-bf1f-4543-8428-b675612297d1 service nova] Creating event network-vif-plugged:bf1271b3-df00-4974-8247-8425a2ebf2ee for instance ac4160c6-ca16-455e-9613-0d425932af3b on n-h1-863052-2 Nov 01 19:08:22.308418 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [req-9cd12a17-e981-4110-bb31-1d55b6e8cb01 req-6f8f982c-bf1f-4543-8428-b675612297d1 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.136556 Nov 01 19:08:22.309385 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1759/3451] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Nov 1 19:08:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:08:22.315915 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-d45008d3-b41a-438c-bd77-42f89e6a3f74 tempest-ImagesOneServerTestJSON-1044295602 tempest-ImagesOneServerTestJSON-1044295602-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:08:22.317474 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-d45008d3-b41a-438c-bd77-42f89e6a3f74 tempest-ImagesOneServerTestJSON-1044295602 tempest-ImagesOneServerTestJSON-1044295602-project] [instance: 31f51cbd-b29a-46be-bca0-f27c2b287e15] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:08:22.325647 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d45008d3-b41a-438c-bd77-42f89e6a3f74 tempest-ImagesOneServerTestJSON-1044295602 tempest-ImagesOneServerTestJSON-1044295602-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:08:22.326440 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d45008d3-b41a-438c-bd77-42f89e6a3f74 tempest-ImagesOneServerTestJSON-1044295602 tempest-ImagesOneServerTestJSON-1044295602-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:08:22.327107 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d45008d3-b41a-438c-bd77-42f89e6a3f74 tempest-ImagesOneServerTestJSON-1044295602 tempest-ImagesOneServerTestJSON-1044295602-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:08:22.328019 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d45008d3-b41a-438c-bd77-42f89e6a3f74 tempest-ImagesOneServerTestJSON-1044295602 tempest-ImagesOneServerTestJSON-1044295602-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:08:22.329329 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d45008d3-b41a-438c-bd77-42f89e6a3f74 tempest-ImagesOneServerTestJSON-1044295602 tempest-ImagesOneServerTestJSON-1044295602-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:08:22.329960 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d45008d3-b41a-438c-bd77-42f89e6a3f74 tempest-ImagesOneServerTestJSON-1044295602 tempest-ImagesOneServerTestJSON-1044295602-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:08:22.355266 n-d-863052-2 devstack@n-api.service[121402]: DEBUG dbcounter [-] [121402] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=121402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 19:08:22.399530 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-b9d0f8b8-f302-4df8-9315-578b665a959e tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] 10.222.0.13 "PUT /compute/v2.1/servers/77d6f571-5742-462c-ada0-1b05dd1561d1" status: 200 len: 992 microversion: 2.47 time: 0.130070 Nov 01 19:08:22.413175 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1693/3452] 10.222.0.13 () {62 vars in 1297 bytes} [Tue Nov 1 19:08:22 2022] PUT /compute/v2.1/servers/77d6f571-5742-462c-ada0-1b05dd1561d1 => generated 992 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 01 19:08:22.432030 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-f935e3be-d54f-4a45-9256-2c6ab935d608 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:08:22.437700 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-f935e3be-d54f-4a45-9256-2c6ab935d608 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] [instance: 8bfb4e44-7a5f-466d-9f1e-bebee16d400c] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:08:22.449814 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f935e3be-d54f-4a45-9256-2c6ab935d608 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:08:22.450478 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f935e3be-d54f-4a45-9256-2c6ab935d608 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:08:22.450750 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f935e3be-d54f-4a45-9256-2c6ab935d608 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:08:22.451458 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f935e3be-d54f-4a45-9256-2c6ab935d608 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:08:22.451912 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f935e3be-d54f-4a45-9256-2c6ab935d608 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:08:22.452390 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f935e3be-d54f-4a45-9256-2c6ab935d608 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:08:22.538519 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-f935e3be-d54f-4a45-9256-2c6ab935d608 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113bd8c844ee490b86a68bc7e1e75da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '851785a5f76548898a77d67792888504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:08:22.560228 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-f935e3be-d54f-4a45-9256-2c6ab935d608 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] 10.222.0.13 "GET /compute/v2.1/servers/8bfb4e44-7a5f-466d-9f1e-bebee16d400c" status: 200 len: 1267 microversion: 2.1 time: 0.155595 Nov 01 19:08:22.563696 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1694/3453] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:08:22 2022] GET /compute/v2.1/servers/8bfb4e44-7a5f-466d-9f1e-bebee16d400c => generated 1267 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:08:22.592732 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-79233cc2-7650-4eac-9251-11d888c4ece6 tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:08:22.593364 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-79233cc2-7650-4eac-9251-11d888c4ece6 tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] [instance: 77d6f571-5742-462c-ada0-1b05dd1561d1] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:08:22.667996 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-d45008d3-b41a-438c-bd77-42f89e6a3f74 tempest-ImagesOneServerTestJSON-1044295602 tempest-ImagesOneServerTestJSON-1044295602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6fd718964648e4bc83ed37cbaa9b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c548420d1df4403c9129cce5f040d45b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:08:22.684785 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-d45008d3-b41a-438c-bd77-42f89e6a3f74 tempest-ImagesOneServerTestJSON-1044295602 tempest-ImagesOneServerTestJSON-1044295602-project] 10.222.0.13 "GET /compute/v2.1/servers/31f51cbd-b29a-46be-bca0-f27c2b287e15" status: 200 len: 1466 microversion: 2.1 time: 0.372476 Nov 01 19:08:22.688733 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1760/3454] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:08:22 2022] GET /compute/v2.1/servers/31f51cbd-b29a-46be-bca0-f27c2b287e15 => generated 1466 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:08:22.725577 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-c5a4754a-1a2d-4f11-b108-54f23e48cc04 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:08:22.729107 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-c5a4754a-1a2d-4f11-b108-54f23e48cc04 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] [instance: 8485db2a-fd8f-4615-bbe0-14822ad44194] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:08:22.760549 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-c5a4754a-1a2d-4f11-b108-54f23e48cc04 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:08:22.763531 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-c5a4754a-1a2d-4f11-b108-54f23e48cc04 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:08:22.766008 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-c5a4754a-1a2d-4f11-b108-54f23e48cc04 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:08:22.769564 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-c5a4754a-1a2d-4f11-b108-54f23e48cc04 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:08:22.770774 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-c5a4754a-1a2d-4f11-b108-54f23e48cc04 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:08:22.771386 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-c5a4754a-1a2d-4f11-b108-54f23e48cc04 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:08:22.837990 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-79233cc2-7650-4eac-9251-11d888c4ece6 tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57ba6eeb99714c7cabb14f484968e269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a0c0985c7b9450a8b622b6761e5b5c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:08:22.846837 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-79233cc2-7650-4eac-9251-11d888c4ece6 tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57ba6eeb99714c7cabb14f484968e269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a0c0985c7b9450a8b622b6761e5b5c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:08:22.849196 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-79233cc2-7650-4eac-9251-11d888c4ece6 tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57ba6eeb99714c7cabb14f484968e269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a0c0985c7b9450a8b622b6761e5b5c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:08:22.854757 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-79233cc2-7650-4eac-9251-11d888c4ece6 tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] 10.222.0.13 "GET /compute/v2.1/servers/77d6f571-5742-462c-ada0-1b05dd1561d1" status: 200 len: 1278 microversion: 2.47 time: 0.276419 Nov 01 19:08:22.865471 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1695/3455] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 19:08:22 2022] GET /compute/v2.1/servers/77d6f571-5742-462c-ada0-1b05dd1561d1 => generated 1278 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 19:08:22.880117 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-15ae1191-2911-40d7-8177-616c1dd9822d tempest-ImagesOneServerTestJSON-1044295602 tempest-ImagesOneServerTestJSON-1044295602-project] Calling method '.version_select at 0x7f0ae19af040>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:08:22.946109 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-15ae1191-2911-40d7-8177-616c1dd9822d tempest-ImagesOneServerTestJSON-1044295602 tempest-ImagesOneServerTestJSON-1044295602-project] 10.222.0.13 "GET /compute/v2.1/images/2d4a0047-1b9e-445f-8af8-1b5c9d93e881" status: 200 len: 784 microversion: 2.1 time: 0.074577 Nov 01 19:08:22.946825 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1696/3456] 10.222.0.13 () {58 vars in 1233 bytes} [Tue Nov 1 19:08:22 2022] GET /compute/v2.1/images/2d4a0047-1b9e-445f-8af8-1b5c9d93e881 => generated 784 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:08:22.965121 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-ec50834d-d4e5-4cb4-946e-1e32323b3e6d tempest-ImagesOneServerTestJSON-1044295602 tempest-ImagesOneServerTestJSON-1044295602-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:08:22.995579 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-ec50834d-d4e5-4cb4-946e-1e32323b3e6d tempest-ImagesOneServerTestJSON-1044295602 tempest-ImagesOneServerTestJSON-1044295602-project] 10.222.0.13 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.030616 Nov 01 19:08:22.996344 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1697/3457] 10.222.0.13 () {58 vars in 1137 bytes} [Tue Nov 1 19:08:22 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 01 19:08:23.013607 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-24d285e7-f310-4bc8-8fff-8668d4ba2dc4 tempest-ImagesOneServerTestJSON-1044295602 tempest-ImagesOneServerTestJSON-1044295602-project] Calling method '.version_select at 0x7f0ae1c7e5e0>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:08:23.253708 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-c5a4754a-1a2d-4f11-b108-54f23e48cc04 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '058480d92c9b4ab4af6815d0438a65c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee9dc49b89143f781e4ab30296e4d01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:08:23.266994 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-c5a4754a-1a2d-4f11-b108-54f23e48cc04 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] 10.222.0.13 "GET /compute/v2.1/servers/8485db2a-fd8f-4615-bbe0-14822ad44194" status: 200 len: 1508 microversion: 2.1 time: 0.554825 Nov 01 19:08:23.292603 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1761/3458] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:08:22 2022] GET /compute/v2.1/servers/8485db2a-fd8f-4615-bbe0-14822ad44194 => generated 1508 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:08:23.297918 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-de4221b9-08f2-4ba3-85d4-b113bba61552 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:08:23.298539 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-de4221b9-08f2-4ba3-85d4-b113bba61552 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] [instance: ac4160c6-ca16-455e-9613-0d425932af3b] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:08:23.305665 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-de4221b9-08f2-4ba3-85d4-b113bba61552 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:08:23.306389 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-de4221b9-08f2-4ba3-85d4-b113bba61552 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:08:23.306841 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-de4221b9-08f2-4ba3-85d4-b113bba61552 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:08:23.307717 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-de4221b9-08f2-4ba3-85d4-b113bba61552 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:08:23.308189 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-de4221b9-08f2-4ba3-85d4-b113bba61552 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:08:23.308651 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-de4221b9-08f2-4ba3-85d4-b113bba61552 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:08:23.629630 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-de4221b9-08f2-4ba3-85d4-b113bba61552 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '790f3f1566b7464aaca19d4d05c0942e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33e3d319293c46b6af2f728a50586906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:08:23.669770 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-de4221b9-08f2-4ba3-85d4-b113bba61552 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] 10.222.0.13 "GET /compute/v2.1/servers/ac4160c6-ca16-455e-9613-0d425932af3b" status: 200 len: 1367 microversion: 2.1 time: 0.375732 Nov 01 19:08:23.688950 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1762/3459] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:08:23 2022] GET /compute/v2.1/servers/ac4160c6-ca16-455e-9613-0d425932af3b => generated 1367 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:08:23.708286 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-20ca8a1d-0517-4bb7-b3d3-abda9bdf2089 tempest-AttachSCSIVolumeTestJSON-356336257 tempest-AttachSCSIVolumeTestJSON-356336257-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:08:23.709856 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-20ca8a1d-0517-4bb7-b3d3-abda9bdf2089 tempest-AttachSCSIVolumeTestJSON-356336257 tempest-AttachSCSIVolumeTestJSON-356336257-project] [instance: 8a378b79-bd92-4ade-b034-1aaf5c87b74b] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:08:23.726454 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-20ca8a1d-0517-4bb7-b3d3-abda9bdf2089 tempest-AttachSCSIVolumeTestJSON-356336257 tempest-AttachSCSIVolumeTestJSON-356336257-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:08:23.728110 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-20ca8a1d-0517-4bb7-b3d3-abda9bdf2089 tempest-AttachSCSIVolumeTestJSON-356336257 tempest-AttachSCSIVolumeTestJSON-356336257-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:08:23.729619 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-20ca8a1d-0517-4bb7-b3d3-abda9bdf2089 tempest-AttachSCSIVolumeTestJSON-356336257 tempest-AttachSCSIVolumeTestJSON-356336257-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:08:23.731699 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-20ca8a1d-0517-4bb7-b3d3-abda9bdf2089 tempest-AttachSCSIVolumeTestJSON-356336257 tempest-AttachSCSIVolumeTestJSON-356336257-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:08:23.733405 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-20ca8a1d-0517-4bb7-b3d3-abda9bdf2089 tempest-AttachSCSIVolumeTestJSON-356336257 tempest-AttachSCSIVolumeTestJSON-356336257-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:08:23.735885 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-20ca8a1d-0517-4bb7-b3d3-abda9bdf2089 tempest-AttachSCSIVolumeTestJSON-356336257 tempest-AttachSCSIVolumeTestJSON-356336257-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:08:23.774377 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.wsgi [None req-20ca8a1d-0517-4bb7-b3d3-abda9bdf2089 tempest-AttachSCSIVolumeTestJSON-356336257 tempest-AttachSCSIVolumeTestJSON-356336257-project] HTTP exception thrown: Instance 8a378b79-bd92-4ade-b034-1aaf5c87b74b could not be found. Nov 01 19:08:23.787206 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-20ca8a1d-0517-4bb7-b3d3-abda9bdf2089 tempest-AttachSCSIVolumeTestJSON-356336257 tempest-AttachSCSIVolumeTestJSON-356336257-project] Request method failure captured: Nov 01 19:08:23.787206 n-d-863052-2 devstack@n-api.service[121403]: request: GET /compute/v2.1/servers/8a378b79-bd92-4ade-b034-1aaf5c87b74b HTTP/1.1 Nov 01 19:08:23.787206 n-d-863052-2 devstack@n-api.service[121403]: Accept: application/json Nov 01 19:08:23.787206 n-d-863052-2 devstack@n-api.service[121403]: Accept-Encoding: identity Nov 01 19:08:23.787206 n-d-863052-2 devstack@n-api.service[121403]: Connection: close Nov 01 19:08:23.787206 n-d-863052-2 devstack@n-api.service[121403]: Content-Length: 0 Nov 01 19:08:23.787206 n-d-863052-2 devstack@n-api.service[121403]: Content-Type: application/json Nov 01 19:08:23.787206 n-d-863052-2 devstack@n-api.service[121403]: Host: 10.222.0.13 Nov 01 19:08:23.787206 n-d-863052-2 devstack@n-api.service[121403]: Openstack-System-Scope: None Nov 01 19:08:23.787206 n-d-863052-2 devstack@n-api.service[121403]: User-Agent: python-urllib3/1.26.12 Nov 01 19:08:23.787206 n-d-863052-2 devstack@n-api.service[121403]: X-Auth-Token: gAAAAABjYW322Ikm_ocmYFWaXeTzUVArMWNo2ga7gyBaoe75ews3xNelAFe6noir-ZPmtGngdORwaDTF5ayBBPAECsdi__b3foOPVhmu0UKeZR2U8i7lU9CgT8FrzsLjTEvUL0TyZuHNUAXYgyeKUDm_XKtiH5B8qHKuHpbM8EcwhuZx6KmnQNg Nov 01 19:08:23.787206 n-d-863052-2 devstack@n-api.service[121403]: X-Domain-Id: None Nov 01 19:08:23.787206 n-d-863052-2 devstack@n-api.service[121403]: X-Domain-Name: None Nov 01 19:08:23.787206 n-d-863052-2 devstack@n-api.service[121403]: X-Identity-Status: Confirmed Nov 01 19:08:23.787206 n-d-863052-2 devstack@n-api.service[121403]: X-Is-Admin-Project: True Nov 01 19:08:23.787206 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Domain-Id: default Nov 01 19:08:23.787206 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Domain-Name: Default Nov 01 19:08:23.787206 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Id: 7b14142c34d54977ac9eb59962f2a9e1 Nov 01 19:08:23.787206 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-356336257 Nov 01 19:08:23.787206 n-d-863052-2 devstack@n-api.service[121403]: X-Role: member,reader Nov 01 19:08:23.787206 n-d-863052-2 devstack@n-api.service[121403]: X-Roles: member,reader Nov 01 19:08:23.787206 n-d-863052-2 devstack@n-api.service[121403]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/7b14142c34d54977ac9eb59962f2a9e1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/7b14142c34d54977ac9eb59962f2a9e1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_7b14142c34d54977ac9eb59962f2a9e1", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/7b14142c34d54977ac9eb59962f2a9e1"}]}] Nov 01 19:08:23.787206 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-356336257 Nov 01 19:08:23.787206 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant-Id: 7b14142c34d54977ac9eb59962f2a9e1 Nov 01 19:08:23.787206 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-356336257 Nov 01 19:08:23.787206 n-d-863052-2 devstack@n-api.service[121403]: X-User: tempest-AttachSCSIVolumeTestJSON-356336257-project Nov 01 19:08:23.787206 n-d-863052-2 devstack@n-api.service[121403]: X-User-Domain-Id: default Nov 01 19:08:23.787206 n-d-863052-2 devstack@n-api.service[121403]: X-User-Domain-Name: Default Nov 01 19:08:23.787206 n-d-863052-2 devstack@n-api.service[121403]: X-User-Id: cde7667dbbfd4864a5b0ca8d8b291406 Nov 01 19:08:23.787206 n-d-863052-2 devstack@n-api.service[121403]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-356336257-project Nov 01 19:08:23.787206 n-d-863052-2 devstack@n-api.service[121403]: method: > Nov 01 19:08:23.787206 n-d-863052-2 devstack@n-api.service[121403]: exception: Instance 8a378b79-bd92-4ade-b034-1aaf5c87b74b could not be found. Nov 01 19:08:23.787206 n-d-863052-2 devstack@n-api.service[121403]: action_args: {'id': '8a378b79-bd92-4ade-b034-1aaf5c87b74b'} Nov 01 19:08:23.787206 n-d-863052-2 devstack@n-api.service[121403]: {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 01 19:08:23.787206 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:08:23.787206 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 01 19:08:23.787206 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 01 19:08:23.787206 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 01 19:08:23.787206 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 01 19:08:23.787206 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 01 19:08:23.787206 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 01 19:08:23.787206 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 01 19:08:23.787206 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 01 19:08:23.787206 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8a378b79-bd92-4ade-b034-1aaf5c87b74b could not be found. Nov 01 19:08:23.787206 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:08:23.787206 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:08:23.787206 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:08:23.787206 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:08:23.787206 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:08:23.787206 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:08:23.787206 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 01 19:08:23.787206 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 01 19:08:23.787206 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 01 19:08:23.787206 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 01 19:08:23.787206 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 01 19:08:23.787206 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 01 19:08:23.787206 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 01 19:08:23.787206 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 01 19:08:23.787206 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 01 19:08:23.787206 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 01 19:08:23.787206 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8a378b79-bd92-4ade-b034-1aaf5c87b74b could not be found. Nov 01 19:08:23.787206 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:08:23.787206 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:08:23.787206 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:08:23.793016 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:08:23.793016 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:08:23.793016 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:08:23.793016 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 01 19:08:23.793016 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 01 19:08:23.793016 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8a378b79-bd92-4ade-b034-1aaf5c87b74b could not be found. Nov 01 19:08:23.793016 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:08:23.798520 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-20ca8a1d-0517-4bb7-b3d3-abda9bdf2089 tempest-AttachSCSIVolumeTestJSON-356336257 tempest-AttachSCSIVolumeTestJSON-356336257-project] Returning 404 to user: Instance 8a378b79-bd92-4ade-b034-1aaf5c87b74b could not be found. {{(pid=121403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 01 19:08:23.801919 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-20ca8a1d-0517-4bb7-b3d3-abda9bdf2089 tempest-AttachSCSIVolumeTestJSON-356336257 tempest-AttachSCSIVolumeTestJSON-356336257-project] 10.222.0.13 "GET /compute/v2.1/servers/8a378b79-bd92-4ade-b034-1aaf5c87b74b" status: 404 len: 111 microversion: 2.1 time: 0.109550 Nov 01 19:08:23.803464 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1763/3460] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:08:23 2022] GET /compute/v2.1/servers/8a378b79-bd92-4ade-b034-1aaf5c87b74b => generated 111 bytes in 113 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 01 19:08:23.817126 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-27e83186-24eb-4cfb-9f89-1c6a969ffe72 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:08:23.820203 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-27e83186-24eb-4cfb-9f89-1c6a969ffe72 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] [instance: 8bfb4e44-7a5f-466d-9f1e-bebee16d400c] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:08:23.827361 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-27e83186-24eb-4cfb-9f89-1c6a969ffe72 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:08:23.828358 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-27e83186-24eb-4cfb-9f89-1c6a969ffe72 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:08:23.829205 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-27e83186-24eb-4cfb-9f89-1c6a969ffe72 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:08:23.830099 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-27e83186-24eb-4cfb-9f89-1c6a969ffe72 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:08:23.837043 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-27e83186-24eb-4cfb-9f89-1c6a969ffe72 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:08:23.837616 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-27e83186-24eb-4cfb-9f89-1c6a969ffe72 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:08:24.128134 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-27e83186-24eb-4cfb-9f89-1c6a969ffe72 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113bd8c844ee490b86a68bc7e1e75da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '851785a5f76548898a77d67792888504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:08:24.140070 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-27e83186-24eb-4cfb-9f89-1c6a969ffe72 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] 10.222.0.13 "GET /compute/v2.1/servers/8bfb4e44-7a5f-466d-9f1e-bebee16d400c" status: 200 len: 1309 microversion: 2.1 time: 0.335358 Nov 01 19:08:24.152949 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1764/3461] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:08:23 2022] GET /compute/v2.1/servers/8bfb4e44-7a5f-466d-9f1e-bebee16d400c => generated 1309 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:08:24.160460 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-692cdb1e-05f4-4d53-acc7-7154183734dd tempest-AttachSCSIVolumeTestJSON-356336257 tempest-AttachSCSIVolumeTestJSON-356336257-project] Calling method '.version_select at 0x7f0ae687c310>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:08:24.176871 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-24d285e7-f310-4bc8-8fff-8668d4ba2dc4 tempest-ImagesOneServerTestJSON-1044295602 tempest-ImagesOneServerTestJSON-1044295602-project] 10.222.0.13 "DELETE /compute/v2.1/images/621c9785-490d-4245-8b6b-91f8571f7eab" status: 204 len: 0 microversion: 2.1 time: 1.171788 Nov 01 19:08:24.177692 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1698/3462] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:08:23 2022] DELETE /compute/v2.1/images/621c9785-490d-4245-8b6b-91f8571f7eab => generated 0 bytes in 1173 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 01 19:08:24.202113 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-65400395-1956-496a-be13-5bf3b22ec78f tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:08:24.204442 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-692cdb1e-05f4-4d53-acc7-7154183734dd tempest-AttachSCSIVolumeTestJSON-356336257 tempest-AttachSCSIVolumeTestJSON-356336257-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1984786559" status: 202 len: 0 microversion: 2.1 time: 0.062591 Nov 01 19:08:24.205491 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1765/3463] 10.222.0.13 () {58 vars in 1221 bytes} [Tue Nov 1 19:08:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1984786559 => generated 0 bytes in 64 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 01 19:08:24.207016 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-65400395-1956-496a-be13-5bf3b22ec78f tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] [instance: 77d6f571-5742-462c-ada0-1b05dd1561d1] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:08:24.220800 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-2475ea38-c2bc-4924-975b-db0b3203950c tempest-ImagesOneServerTestJSON-1044295602 tempest-ImagesOneServerTestJSON-1044295602-project] Calling method '.version_select at 0x7f0ae67ff430>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:08:24.225544 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-65400395-1956-496a-be13-5bf3b22ec78f tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:08:24.226329 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-65400395-1956-496a-be13-5bf3b22ec78f tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:08:24.227529 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-65400395-1956-496a-be13-5bf3b22ec78f tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:08:24.228943 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-65400395-1956-496a-be13-5bf3b22ec78f tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:08:24.229843 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-65400395-1956-496a-be13-5bf3b22ec78f tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:08:24.230503 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-65400395-1956-496a-be13-5bf3b22ec78f tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:08:24.260689 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.wsgi [None req-2475ea38-c2bc-4924-975b-db0b3203950c tempest-ImagesOneServerTestJSON-1044295602 tempest-ImagesOneServerTestJSON-1044295602-project] HTTP exception thrown: Image not found. Nov 01 19:08:24.263057 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-2475ea38-c2bc-4924-975b-db0b3203950c tempest-ImagesOneServerTestJSON-1044295602 tempest-ImagesOneServerTestJSON-1044295602-project] Request method failure captured: Nov 01 19:08:24.263057 n-d-863052-2 devstack@n-api.service[121403]: request: GET /compute/v2.1/images/621c9785-490d-4245-8b6b-91f8571f7eab HTTP/1.1 Nov 01 19:08:24.263057 n-d-863052-2 devstack@n-api.service[121403]: Accept: application/json Nov 01 19:08:24.263057 n-d-863052-2 devstack@n-api.service[121403]: Accept-Encoding: identity Nov 01 19:08:24.263057 n-d-863052-2 devstack@n-api.service[121403]: Connection: close Nov 01 19:08:24.263057 n-d-863052-2 devstack@n-api.service[121403]: Content-Length: 0 Nov 01 19:08:24.263057 n-d-863052-2 devstack@n-api.service[121403]: Content-Type: application/json Nov 01 19:08:24.263057 n-d-863052-2 devstack@n-api.service[121403]: Host: 10.222.0.13 Nov 01 19:08:24.263057 n-d-863052-2 devstack@n-api.service[121403]: Openstack-System-Scope: None Nov 01 19:08:24.263057 n-d-863052-2 devstack@n-api.service[121403]: User-Agent: python-urllib3/1.26.12 Nov 01 19:08:24.263057 n-d-863052-2 devstack@n-api.service[121403]: X-Auth-Token: gAAAAABjYW56eNe5SQRyBnUkIgXlO71F0kzVXqumCGMUgtp3NV0a4qsd1ewy4tcX5amPLpoZq-HyQz4Q7cIFwB8WjSgRutL7v-B4JhAhTDD5aGIrcknHr6P6jMfRHLSuZ4N9yk6Fsnnm9M7cAVfRFmhcpSKO6i2TKscRAWDtxhj3rv4cRFwz130 Nov 01 19:08:24.263057 n-d-863052-2 devstack@n-api.service[121403]: X-Domain-Id: None Nov 01 19:08:24.263057 n-d-863052-2 devstack@n-api.service[121403]: X-Domain-Name: None Nov 01 19:08:24.263057 n-d-863052-2 devstack@n-api.service[121403]: X-Identity-Status: Confirmed Nov 01 19:08:24.263057 n-d-863052-2 devstack@n-api.service[121403]: X-Is-Admin-Project: True Nov 01 19:08:24.263057 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Domain-Id: default Nov 01 19:08:24.263057 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Domain-Name: Default Nov 01 19:08:24.263057 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Id: c548420d1df4403c9129cce5f040d45b Nov 01 19:08:24.263057 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Name: tempest-ImagesOneServerTestJSON-1044295602 Nov 01 19:08:24.263057 n-d-863052-2 devstack@n-api.service[121403]: X-Role: member,reader Nov 01 19:08:24.263057 n-d-863052-2 devstack@n-api.service[121403]: X-Roles: member,reader Nov 01 19:08:24.263057 n-d-863052-2 devstack@n-api.service[121403]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/c548420d1df4403c9129cce5f040d45b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/c548420d1df4403c9129cce5f040d45b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_c548420d1df4403c9129cce5f040d45b", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/c548420d1df4403c9129cce5f040d45b"}]}] Nov 01 19:08:24.263057 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant: tempest-ImagesOneServerTestJSON-1044295602 Nov 01 19:08:24.263057 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant-Id: c548420d1df4403c9129cce5f040d45b Nov 01 19:08:24.263057 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-1044295602 Nov 01 19:08:24.263057 n-d-863052-2 devstack@n-api.service[121403]: X-User: tempest-ImagesOneServerTestJSON-1044295602-project Nov 01 19:08:24.263057 n-d-863052-2 devstack@n-api.service[121403]: X-User-Domain-Id: default Nov 01 19:08:24.263057 n-d-863052-2 devstack@n-api.service[121403]: X-User-Domain-Name: Default Nov 01 19:08:24.263057 n-d-863052-2 devstack@n-api.service[121403]: X-User-Id: ed6fd718964648e4bc83ed37cbaa9b84 Nov 01 19:08:24.263057 n-d-863052-2 devstack@n-api.service[121403]: X-User-Name: tempest-ImagesOneServerTestJSON-1044295602-project Nov 01 19:08:24.263057 n-d-863052-2 devstack@n-api.service[121403]: method: Nov 01 19:08:24.263057 n-d-863052-2 devstack@n-api.service[121403]: exception: Image not found. Nov 01 19:08:24.263057 n-d-863052-2 devstack@n-api.service[121403]: action_args: {'id': '621c9785-490d-4245-8b6b-91f8571f7eab'} Nov 01 19:08:24.263057 n-d-863052-2 devstack@n-api.service[121403]: {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 01 19:08:24.263057 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:08:24.263057 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Nov 01 19:08:24.263057 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Nov 01 19:08:24.263057 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Nov 01 19:08:24.263057 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Nov 01 19:08:24.263057 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Nov 01 19:08:24.263057 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return self._get(image_id) Nov 01 19:08:24.263057 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Nov 01 19:08:24.263057 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Nov 01 19:08:24.263057 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Nov 01 19:08:24.263057 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Nov 01 19:08:24.263057 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Nov 01 19:08:24.263057 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Nov 01 19:08:24.263057 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Nov 01 19:08:24.263057 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Nov 01 19:08:24.263057 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Nov 01 19:08:24.263057 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Nov 01 19:08:24.263057 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 621c9785-490d-4245-8b6b-91f8571f7eab Nov 01 19:08:24.263057 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:08:24.263057 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:08:24.263057 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:08:24.263057 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:08:24.263057 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Nov 01 19:08:24.263057 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Nov 01 19:08:24.263057 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Nov 01 19:08:24.263057 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Nov 01 19:08:24.263057 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Nov 01 19:08:24.263057 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Nov 01 19:08:24.263057 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Nov 01 19:08:24.267255 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Nov 01 19:08:24.267255 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Nov 01 19:08:24.267255 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Nov 01 19:08:24.267255 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Nov 01 19:08:24.267255 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Nov 01 19:08:24.267255 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Nov 01 19:08:24.267255 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return self._get(image_id) Nov 01 19:08:24.267255 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Nov 01 19:08:24.267255 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Nov 01 19:08:24.267255 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Nov 01 19:08:24.267255 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Nov 01 19:08:24.267255 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Nov 01 19:08:24.267255 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Nov 01 19:08:24.267255 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Nov 01 19:08:24.267255 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Nov 01 19:08:24.267255 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Nov 01 19:08:24.267255 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Nov 01 19:08:24.267255 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 621c9785-490d-4245-8b6b-91f8571f7eab could not be found. Nov 01 19:08:24.267255 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:08:24.267255 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:08:24.267255 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:08:24.267255 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:08:24.267255 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:08:24.267255 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:08:24.267255 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 01 19:08:24.267255 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 01 19:08:24.267255 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 01 19:08:24.267255 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 01 19:08:24.267255 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 01 19:08:24.267255 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 01 19:08:24.267255 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Nov 01 19:08:24.267255 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Nov 01 19:08:24.267255 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Nov 01 19:08:24.267255 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:08:24.267255 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:08:24.267255 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:08:24.267255 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:08:24.267255 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:08:24.267255 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:08:24.267255 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 01 19:08:24.267255 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 01 19:08:24.267255 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Nov 01 19:08:24.267255 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:08:24.267255 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-2475ea38-c2bc-4924-975b-db0b3203950c tempest-ImagesOneServerTestJSON-1044295602 tempest-ImagesOneServerTestJSON-1044295602-project] Returning 404 to user: Image not found. {{(pid=121403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 01 19:08:24.267255 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-2475ea38-c2bc-4924-975b-db0b3203950c tempest-ImagesOneServerTestJSON-1044295602 tempest-ImagesOneServerTestJSON-1044295602-project] 10.222.0.13 "GET /compute/v2.1/images/621c9785-490d-4245-8b6b-91f8571f7eab" status: 404 len: 62 microversion: 2.1 time: 0.058001 Nov 01 19:08:24.267255 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1766/3464] 10.222.0.13 () {58 vars in 1233 bytes} [Tue Nov 1 19:08:24 2022] GET /compute/v2.1/images/621c9785-490d-4245-8b6b-91f8571f7eab => generated 62 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 01 19:08:24.279428 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-824d4f04-4173-4426-abbe-47452731df1d tempest-ImagesOneServerTestJSON-1044295602 tempest-ImagesOneServerTestJSON-1044295602-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-\u20a1-183965299"}} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:08:24.293160 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-824d4f04-4173-4426-abbe-47452731df1d tempest-ImagesOneServerTestJSON-1044295602 tempest-ImagesOneServerTestJSON-1044295602-project] [instance: 31f51cbd-b29a-46be-bca0-f27c2b287e15] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:08:24.313456 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-824d4f04-4173-4426-abbe-47452731df1d tempest-ImagesOneServerTestJSON-1044295602 tempest-ImagesOneServerTestJSON-1044295602-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:08:24.314134 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-824d4f04-4173-4426-abbe-47452731df1d tempest-ImagesOneServerTestJSON-1044295602 tempest-ImagesOneServerTestJSON-1044295602-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:08:24.318424 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-824d4f04-4173-4426-abbe-47452731df1d tempest-ImagesOneServerTestJSON-1044295602 tempest-ImagesOneServerTestJSON-1044295602-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:08:24.321885 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-824d4f04-4173-4426-abbe-47452731df1d tempest-ImagesOneServerTestJSON-1044295602 tempest-ImagesOneServerTestJSON-1044295602-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:08:24.323129 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-824d4f04-4173-4426-abbe-47452731df1d tempest-ImagesOneServerTestJSON-1044295602 tempest-ImagesOneServerTestJSON-1044295602-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:08:24.323587 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-824d4f04-4173-4426-abbe-47452731df1d tempest-ImagesOneServerTestJSON-1044295602 tempest-ImagesOneServerTestJSON-1044295602-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:08:24.447450 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-65400395-1956-496a-be13-5bf3b22ec78f tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57ba6eeb99714c7cabb14f484968e269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a0c0985c7b9450a8b622b6761e5b5c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:08:24.454817 n-d-863052-2 devstack@n-api.service[121402]: DEBUG dbcounter [-] [121402] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 19:08:24.464782 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-65400395-1956-496a-be13-5bf3b22ec78f tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57ba6eeb99714c7cabb14f484968e269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a0c0985c7b9450a8b622b6761e5b5c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:08:24.469436 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-65400395-1956-496a-be13-5bf3b22ec78f tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57ba6eeb99714c7cabb14f484968e269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a0c0985c7b9450a8b622b6761e5b5c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:08:24.474644 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-65400395-1956-496a-be13-5bf3b22ec78f tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] 10.222.0.13 "GET /compute/v2.1/servers/77d6f571-5742-462c-ada0-1b05dd1561d1" status: 200 len: 1274 microversion: 2.47 time: 0.293567 Nov 01 19:08:24.475690 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1699/3465] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 19:08:24 2022] GET /compute/v2.1/servers/77d6f571-5742-462c-ada0-1b05dd1561d1 => generated 1274 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 19:08:24.524471 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-a899286c-5df8-49a0-8229-c20cfdf0e7ac tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:08:24.525191 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-a899286c-5df8-49a0-8229-c20cfdf0e7ac tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] [instance: 8485db2a-fd8f-4615-bbe0-14822ad44194] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:08:24.536927 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-a899286c-5df8-49a0-8229-c20cfdf0e7ac tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:08:24.537506 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-a899286c-5df8-49a0-8229-c20cfdf0e7ac tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:08:24.537979 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-a899286c-5df8-49a0-8229-c20cfdf0e7ac tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:08:24.538748 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-a899286c-5df8-49a0-8229-c20cfdf0e7ac tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:08:24.542654 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-a899286c-5df8-49a0-8229-c20cfdf0e7ac tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:08:24.575398 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-a899286c-5df8-49a0-8229-c20cfdf0e7ac tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.036s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:08:24.765201 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-824d4f04-4173-4426-abbe-47452731df1d tempest-ImagesOneServerTestJSON-1044295602 tempest-ImagesOneServerTestJSON-1044295602-project] 10.222.0.13 "POST /compute/v2.1/servers/31f51cbd-b29a-46be-bca0-f27c2b287e15/action" status: 202 len: 0 microversion: 2.1 time: 0.477901 Nov 01 19:08:24.766531 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1767/3466] 10.222.0.13 () {60 vars in 1278 bytes} [Tue Nov 1 19:08:24 2022] POST /compute/v2.1/servers/31f51cbd-b29a-46be-bca0-f27c2b287e15/action => generated 0 bytes in 495 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 01 19:08:24.782212 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [req-6418fb31-de85-47a1-9333-67c31c4a6da2 req-84102d07-6792-44d6-8302-ecbfadd194f7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "31f51cbd-b29a-46be-bca0-f27c2b287e15", "name": "network-vif-unplugged", "status": "completed", "tag": "bc5f2d73-99ce-47e7-bd41-afad82bb372e"}]} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:08:24.793684 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-6418fb31-de85-47a1-9333-67c31c4a6da2 req-84102d07-6792-44d6-8302-ecbfadd194f7 service nova] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:08:24.794418 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-6418fb31-de85-47a1-9333-67c31c4a6da2 req-84102d07-6792-44d6-8302-ecbfadd194f7 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:08:24.795044 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-6418fb31-de85-47a1-9333-67c31c4a6da2 req-84102d07-6792-44d6-8302-ecbfadd194f7 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:08:24.799704 n-d-863052-2 devstack@n-api.service[121403]: DEBUG dbcounter [-] [121403] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 19:08:24.811487 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.compute.server_external_events [req-6418fb31-de85-47a1-9333-67c31c4a6da2 req-84102d07-6792-44d6-8302-ecbfadd194f7 service nova] Creating event network-vif-unplugged:bc5f2d73-99ce-47e7-bd41-afad82bb372e for instance 31f51cbd-b29a-46be-bca0-f27c2b287e15 on n-h2-863052-2 Nov 01 19:08:24.818276 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [req-6418fb31-de85-47a1-9333-67c31c4a6da2 req-84102d07-6792-44d6-8302-ecbfadd194f7 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.042872 Nov 01 19:08:24.819406 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1768/3467] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Nov 1 19:08:24 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:08:24.827550 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [req-9ac4dc75-785e-4f15-92af-a1c0ad4eb366 req-0b7d4515-a1e8-403a-94ca-8a5898e26394 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8bfb4e44-7a5f-466d-9f1e-bebee16d400c", "tag": "69625ce1-e061-4e19-b336-0c35e9ffbbd9"}]} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:08:24.837900 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-9ac4dc75-785e-4f15-92af-a1c0ad4eb366 req-0b7d4515-a1e8-403a-94ca-8a5898e26394 service nova] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:08:24.838379 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-9ac4dc75-785e-4f15-92af-a1c0ad4eb366 req-0b7d4515-a1e8-403a-94ca-8a5898e26394 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:08:24.838811 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-9ac4dc75-785e-4f15-92af-a1c0ad4eb366 req-0b7d4515-a1e8-403a-94ca-8a5898e26394 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:08:24.850003 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.compute.server_external_events [req-9ac4dc75-785e-4f15-92af-a1c0ad4eb366 req-0b7d4515-a1e8-403a-94ca-8a5898e26394 service nova] Creating event network-changed:69625ce1-e061-4e19-b336-0c35e9ffbbd9 for instance 8bfb4e44-7a5f-466d-9f1e-bebee16d400c on n-h2-863052-2 Nov 01 19:08:24.854797 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [req-9ac4dc75-785e-4f15-92af-a1c0ad4eb366 req-0b7d4515-a1e8-403a-94ca-8a5898e26394 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032676 Nov 01 19:08:24.855437 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1769/3468] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Nov 1 19:08:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:08:24.860306 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-3de4c925-0a72-4674-8c51-ca800cde321d tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:08:24.861028 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-3de4c925-0a72-4674-8c51-ca800cde321d tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] [instance: ac4160c6-ca16-455e-9613-0d425932af3b] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:08:24.867080 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-3de4c925-0a72-4674-8c51-ca800cde321d tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:08:24.867566 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-3de4c925-0a72-4674-8c51-ca800cde321d tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:08:24.867998 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-3de4c925-0a72-4674-8c51-ca800cde321d tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:08:24.868712 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-3de4c925-0a72-4674-8c51-ca800cde321d tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:08:24.869169 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-3de4c925-0a72-4674-8c51-ca800cde321d tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:08:24.869595 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-3de4c925-0a72-4674-8c51-ca800cde321d tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:08:24.975084 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-a899286c-5df8-49a0-8229-c20cfdf0e7ac tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '058480d92c9b4ab4af6815d0438a65c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee9dc49b89143f781e4ab30296e4d01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:08:24.984280 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-a899286c-5df8-49a0-8229-c20cfdf0e7ac tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] 10.222.0.13 "GET /compute/v2.1/servers/8485db2a-fd8f-4615-bbe0-14822ad44194" status: 200 len: 1508 microversion: 2.1 time: 0.492336 Nov 01 19:08:24.984953 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1700/3469] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:08:24 2022] GET /compute/v2.1/servers/8485db2a-fd8f-4615-bbe0-14822ad44194 => generated 1508 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:08:24.991533 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-f89b68eb-58f8-4b17-a908-3979956f3a64 tempest-ImagesOneServerTestJSON-1044295602 tempest-ImagesOneServerTestJSON-1044295602-project] Calling method '.version_select at 0x7f0ae2818c10>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:08:25.008440 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-3de4c925-0a72-4674-8c51-ca800cde321d tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '790f3f1566b7464aaca19d4d05c0942e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33e3d319293c46b6af2f728a50586906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:08:25.016250 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-3de4c925-0a72-4674-8c51-ca800cde321d tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] 10.222.0.13 "GET /compute/v2.1/servers/ac4160c6-ca16-455e-9613-0d425932af3b" status: 200 len: 1557 microversion: 2.1 time: 0.159723 Nov 01 19:08:25.017158 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1770/3470] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:08:24 2022] GET /compute/v2.1/servers/ac4160c6-ca16-455e-9613-0d425932af3b => generated 1557 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:08:25.039658 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-8e178984-896e-403a-bd39-226bcd0c241d tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:08:25.040171 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-8e178984-896e-403a-bd39-226bcd0c241d tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] [instance: ac4160c6-ca16-455e-9613-0d425932af3b] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:08:25.041834 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-f89b68eb-58f8-4b17-a908-3979956f3a64 tempest-ImagesOneServerTestJSON-1044295602 tempest-ImagesOneServerTestJSON-1044295602-project] 10.222.0.13 "GET /compute/v2.1/images/5ef04aec-03ab-4186-8460-a6385af6c9f1" status: 200 len: 1428 microversion: 2.1 time: 0.054842 Nov 01 19:08:25.042410 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1701/3471] 10.222.0.13 () {58 vars in 1233 bytes} [Tue Nov 1 19:08:24 2022] GET /compute/v2.1/images/5ef04aec-03ab-4186-8460-a6385af6c9f1 => generated 1428 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:08:25.051323 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-8e178984-896e-403a-bd39-226bcd0c241d tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:08:25.051808 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-8e178984-896e-403a-bd39-226bcd0c241d tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:08:25.052293 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-8e178984-896e-403a-bd39-226bcd0c241d tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:08:25.052967 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-8e178984-896e-403a-bd39-226bcd0c241d tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:08:25.053426 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-8e178984-896e-403a-bd39-226bcd0c241d tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:08:25.053853 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-8e178984-896e-403a-bd39-226bcd0c241d tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:08:25.130949 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-8e178984-896e-403a-bd39-226bcd0c241d tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] 10.222.0.13 "GET /compute/v2.1/servers/ac4160c6-ca16-455e-9613-0d425932af3b/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.095601 Nov 01 19:08:25.131553 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1771/3472] 10.222.0.13 () {58 vars in 1275 bytes} [Tue Nov 1 19:08:25 2022] GET /compute/v2.1/servers/ac4160c6-ca16-455e-9613-0d425932af3b/os-interface => generated 285 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 01 19:08:25.167401 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-a2b2c73b-84f3-43cc-895f-e1c6fa664f3e tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:08:25.168013 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-a2b2c73b-84f3-43cc-895f-e1c6fa664f3e tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] [instance: 8bfb4e44-7a5f-466d-9f1e-bebee16d400c] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:08:25.175175 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-a2b2c73b-84f3-43cc-895f-e1c6fa664f3e tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:08:25.175780 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-a2b2c73b-84f3-43cc-895f-e1c6fa664f3e tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:08:25.176473 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-a2b2c73b-84f3-43cc-895f-e1c6fa664f3e tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:08:25.177191 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-a2b2c73b-84f3-43cc-895f-e1c6fa664f3e tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:08:25.177751 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-a2b2c73b-84f3-43cc-895f-e1c6fa664f3e tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:08:25.178051 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-a2b2c73b-84f3-43cc-895f-e1c6fa664f3e tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:08:25.394103 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-a2b2c73b-84f3-43cc-895f-e1c6fa664f3e tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113bd8c844ee490b86a68bc7e1e75da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '851785a5f76548898a77d67792888504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:08:25.402648 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-a2b2c73b-84f3-43cc-895f-e1c6fa664f3e tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] 10.222.0.13 "GET /compute/v2.1/servers/8bfb4e44-7a5f-466d-9f1e-bebee16d400c" status: 200 len: 1309 microversion: 2.1 time: 0.239126 Nov 01 19:08:25.403469 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1702/3473] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:08:25 2022] GET /compute/v2.1/servers/8bfb4e44-7a5f-466d-9f1e-bebee16d400c => generated 1309 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:08:25.502326 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-499b2b8d-1168-4066-87d3-203597dbee6f tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:08:25.502966 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-499b2b8d-1168-4066-87d3-203597dbee6f tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] [instance: 77d6f571-5742-462c-ada0-1b05dd1561d1] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:08:25.509009 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-499b2b8d-1168-4066-87d3-203597dbee6f tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:08:25.509906 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-499b2b8d-1168-4066-87d3-203597dbee6f tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:08:25.510114 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-499b2b8d-1168-4066-87d3-203597dbee6f tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:08:25.510837 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-499b2b8d-1168-4066-87d3-203597dbee6f tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:08:25.511378 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-499b2b8d-1168-4066-87d3-203597dbee6f tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:08:25.511687 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-499b2b8d-1168-4066-87d3-203597dbee6f tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:08:25.588911 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-499b2b8d-1168-4066-87d3-203597dbee6f tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57ba6eeb99714c7cabb14f484968e269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a0c0985c7b9450a8b622b6761e5b5c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:08:25.600940 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-499b2b8d-1168-4066-87d3-203597dbee6f tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57ba6eeb99714c7cabb14f484968e269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a0c0985c7b9450a8b622b6761e5b5c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:08:25.603079 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-499b2b8d-1168-4066-87d3-203597dbee6f tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57ba6eeb99714c7cabb14f484968e269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a0c0985c7b9450a8b622b6761e5b5c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:08:25.604345 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-499b2b8d-1168-4066-87d3-203597dbee6f tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] 10.222.0.13 "GET /compute/v2.1/servers/77d6f571-5742-462c-ada0-1b05dd1561d1" status: 200 len: 1330 microversion: 2.47 time: 0.106403 Nov 01 19:08:25.613896 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1772/3474] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 19:08:25 2022] GET /compute/v2.1/servers/77d6f571-5742-462c-ada0-1b05dd1561d1 => generated 1330 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 19:08:26.012203 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-5bdff90e-6574-4766-926d-bdc21aa595be tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:08:26.013027 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-5bdff90e-6574-4766-926d-bdc21aa595be tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] [instance: 8485db2a-fd8f-4615-bbe0-14822ad44194] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:08:26.020956 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-5bdff90e-6574-4766-926d-bdc21aa595be tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:08:26.021357 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-5bdff90e-6574-4766-926d-bdc21aa595be tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:08:26.021875 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-5bdff90e-6574-4766-926d-bdc21aa595be tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:08:26.022665 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-5bdff90e-6574-4766-926d-bdc21aa595be tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:08:26.023854 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-5bdff90e-6574-4766-926d-bdc21aa595be tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:08:26.024497 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-5bdff90e-6574-4766-926d-bdc21aa595be tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:08:26.058011 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-36c75c6c-cd0c-429d-ab14-f9b4e48421e2 tempest-ImagesOneServerTestJSON-1044295602 tempest-ImagesOneServerTestJSON-1044295602-project] Calling method '.version_select at 0x7f0ae67ff820>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:08:26.130779 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-36c75c6c-cd0c-429d-ab14-f9b4e48421e2 tempest-ImagesOneServerTestJSON-1044295602 tempest-ImagesOneServerTestJSON-1044295602-project] 10.222.0.13 "GET /compute/v2.1/images/5ef04aec-03ab-4186-8460-a6385af6c9f1" status: 200 len: 1428 microversion: 2.1 time: 0.076916 Nov 01 19:08:26.131758 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1773/3475] 10.222.0.13 () {58 vars in 1233 bytes} [Tue Nov 1 19:08:26 2022] GET /compute/v2.1/images/5ef04aec-03ab-4186-8460-a6385af6c9f1 => generated 1428 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:08:26.296630 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-5bdff90e-6574-4766-926d-bdc21aa595be tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '058480d92c9b4ab4af6815d0438a65c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee9dc49b89143f781e4ab30296e4d01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:08:26.305271 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-5bdff90e-6574-4766-926d-bdc21aa595be tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] 10.222.0.13 "GET /compute/v2.1/servers/8485db2a-fd8f-4615-bbe0-14822ad44194" status: 200 len: 1508 microversion: 2.1 time: 0.297606 Nov 01 19:08:26.305861 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1703/3476] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:08:26 2022] GET /compute/v2.1/servers/8485db2a-fd8f-4615-bbe0-14822ad44194 => generated 1508 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 19:08:26.426432 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-b46c2d9b-9481-4a27-bb6d-32e1c0b2a746 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:08:26.427233 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-b46c2d9b-9481-4a27-bb6d-32e1c0b2a746 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] [instance: 8bfb4e44-7a5f-466d-9f1e-bebee16d400c] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:08:26.434647 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-b46c2d9b-9481-4a27-bb6d-32e1c0b2a746 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:08:26.435236 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-b46c2d9b-9481-4a27-bb6d-32e1c0b2a746 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:08:26.435683 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-b46c2d9b-9481-4a27-bb6d-32e1c0b2a746 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:08:26.436669 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-b46c2d9b-9481-4a27-bb6d-32e1c0b2a746 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:08:26.437161 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-b46c2d9b-9481-4a27-bb6d-32e1c0b2a746 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:08:26.437615 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-b46c2d9b-9481-4a27-bb6d-32e1c0b2a746 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:08:26.633469 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-c63a6066-af7f-45c8-b122-c316fec1e8a1 tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:08:26.634359 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-c63a6066-af7f-45c8-b122-c316fec1e8a1 tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] [instance: 77d6f571-5742-462c-ada0-1b05dd1561d1] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:08:26.645616 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-c63a6066-af7f-45c8-b122-c316fec1e8a1 tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:08:26.646421 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-c63a6066-af7f-45c8-b122-c316fec1e8a1 tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:08:26.647081 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-c63a6066-af7f-45c8-b122-c316fec1e8a1 tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:08:26.648071 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-c63a6066-af7f-45c8-b122-c316fec1e8a1 tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:08:26.648830 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-c63a6066-af7f-45c8-b122-c316fec1e8a1 tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:08:26.649498 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-c63a6066-af7f-45c8-b122-c316fec1e8a1 tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:08:26.734401 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-c63a6066-af7f-45c8-b122-c316fec1e8a1 tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57ba6eeb99714c7cabb14f484968e269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a0c0985c7b9450a8b622b6761e5b5c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:08:26.746506 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-c63a6066-af7f-45c8-b122-c316fec1e8a1 tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57ba6eeb99714c7cabb14f484968e269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a0c0985c7b9450a8b622b6761e5b5c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:08:26.748347 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-c63a6066-af7f-45c8-b122-c316fec1e8a1 tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57ba6eeb99714c7cabb14f484968e269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a0c0985c7b9450a8b622b6761e5b5c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:08:26.749014 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-b46c2d9b-9481-4a27-bb6d-32e1c0b2a746 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113bd8c844ee490b86a68bc7e1e75da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '851785a5f76548898a77d67792888504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:08:26.750594 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-c63a6066-af7f-45c8-b122-c316fec1e8a1 tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] 10.222.0.13 "GET /compute/v2.1/servers/77d6f571-5742-462c-ada0-1b05dd1561d1" status: 200 len: 1348 microversion: 2.47 time: 0.121705 Nov 01 19:08:26.751546 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1704/3477] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 19:08:26 2022] GET /compute/v2.1/servers/77d6f571-5742-462c-ada0-1b05dd1561d1 => generated 1348 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 01 19:08:26.766444 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-b46c2d9b-9481-4a27-bb6d-32e1c0b2a746 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] 10.222.0.13 "GET /compute/v2.1/servers/8bfb4e44-7a5f-466d-9f1e-bebee16d400c" status: 200 len: 1309 microversion: 2.1 time: 0.343799 Nov 01 19:08:26.772988 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1774/3478] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:08:26 2022] GET /compute/v2.1/servers/8bfb4e44-7a5f-466d-9f1e-bebee16d400c => generated 1309 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:08:26.846534 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [req-5bf7f7a7-7ae2-486a-973e-4e75396e6c4f req-b84c0f1d-125e-49db-98fc-9d33b0ddcf77 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ac4160c6-ca16-455e-9613-0d425932af3b", "tag": "bf1271b3-df00-4974-8247-8425a2ebf2ee"}]} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:08:26.857451 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-5bf7f7a7-7ae2-486a-973e-4e75396e6c4f req-b84c0f1d-125e-49db-98fc-9d33b0ddcf77 service nova] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:08:26.858317 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-5bf7f7a7-7ae2-486a-973e-4e75396e6c4f req-b84c0f1d-125e-49db-98fc-9d33b0ddcf77 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:08:26.859054 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-5bf7f7a7-7ae2-486a-973e-4e75396e6c4f req-b84c0f1d-125e-49db-98fc-9d33b0ddcf77 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:08:26.875025 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.compute.server_external_events [req-5bf7f7a7-7ae2-486a-973e-4e75396e6c4f req-b84c0f1d-125e-49db-98fc-9d33b0ddcf77 service nova] Creating event network-changed:bf1271b3-df00-4974-8247-8425a2ebf2ee for instance ac4160c6-ca16-455e-9613-0d425932af3b on n-h1-863052-2 Nov 01 19:08:26.880811 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [req-5bf7f7a7-7ae2-486a-973e-4e75396e6c4f req-b84c0f1d-125e-49db-98fc-9d33b0ddcf77 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037793 Nov 01 19:08:26.881749 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1705/3479] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Nov 1 19:08:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:08:27.150000 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-17f9bd08-bf92-4588-bb78-d391cc007995 tempest-ImagesOneServerTestJSON-1044295602 tempest-ImagesOneServerTestJSON-1044295602-project] Calling method '.version_select at 0x7f0ae2c45280>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:08:27.213802 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-17f9bd08-bf92-4588-bb78-d391cc007995 tempest-ImagesOneServerTestJSON-1044295602 tempest-ImagesOneServerTestJSON-1044295602-project] 10.222.0.13 "GET /compute/v2.1/images/5ef04aec-03ab-4186-8460-a6385af6c9f1" status: 200 len: 1428 microversion: 2.1 time: 0.068120 Nov 01 19:08:27.222535 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1775/3480] 10.222.0.13 () {58 vars in 1233 bytes} [Tue Nov 1 19:08:27 2022] GET /compute/v2.1/images/5ef04aec-03ab-4186-8460-a6385af6c9f1 => generated 1428 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:08:27.330652 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-3ab167a4-8e63-4927-b04e-7a49cea7ab5f tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:08:27.332084 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-3ab167a4-8e63-4927-b04e-7a49cea7ab5f tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] [instance: 8485db2a-fd8f-4615-bbe0-14822ad44194] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:08:27.345781 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-3ab167a4-8e63-4927-b04e-7a49cea7ab5f tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:08:27.346612 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-3ab167a4-8e63-4927-b04e-7a49cea7ab5f tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:08:27.347314 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-3ab167a4-8e63-4927-b04e-7a49cea7ab5f tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:08:27.348268 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-3ab167a4-8e63-4927-b04e-7a49cea7ab5f tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:08:27.348981 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-3ab167a4-8e63-4927-b04e-7a49cea7ab5f tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:08:27.349633 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-3ab167a4-8e63-4927-b04e-7a49cea7ab5f tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:08:27.553100 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-3ab167a4-8e63-4927-b04e-7a49cea7ab5f tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '058480d92c9b4ab4af6815d0438a65c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee9dc49b89143f781e4ab30296e4d01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:08:27.568923 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-3ab167a4-8e63-4927-b04e-7a49cea7ab5f tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] 10.222.0.13 "GET /compute/v2.1/servers/8485db2a-fd8f-4615-bbe0-14822ad44194" status: 200 len: 1508 microversion: 2.1 time: 0.243162 Nov 01 19:08:27.570485 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1706/3481] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:08:27 2022] GET /compute/v2.1/servers/8485db2a-fd8f-4615-bbe0-14822ad44194 => generated 1508 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:08:27.780272 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-9b61e907-3d41-4d30-b3bd-d3b8284025dc tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:08:27.780818 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-9b61e907-3d41-4d30-b3bd-d3b8284025dc tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] [instance: 77d6f571-5742-462c-ada0-1b05dd1561d1] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:08:27.791809 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-61988d9d-81b5-437c-ad8d-7ef3d1f3bb6b tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:08:27.792449 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-61988d9d-81b5-437c-ad8d-7ef3d1f3bb6b tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] [instance: 8bfb4e44-7a5f-466d-9f1e-bebee16d400c] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:08:27.796540 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-9b61e907-3d41-4d30-b3bd-d3b8284025dc tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:08:27.797623 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-9b61e907-3d41-4d30-b3bd-d3b8284025dc tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:08:27.798081 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-9b61e907-3d41-4d30-b3bd-d3b8284025dc tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:08:27.804561 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-61988d9d-81b5-437c-ad8d-7ef3d1f3bb6b tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:08:27.807891 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-9b61e907-3d41-4d30-b3bd-d3b8284025dc tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:08:27.808460 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-9b61e907-3d41-4d30-b3bd-d3b8284025dc tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:08:27.808869 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-61988d9d-81b5-437c-ad8d-7ef3d1f3bb6b tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:08:27.809625 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-61988d9d-81b5-437c-ad8d-7ef3d1f3bb6b tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:08:27.810332 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-9b61e907-3d41-4d30-b3bd-d3b8284025dc tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:08:27.810870 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-61988d9d-81b5-437c-ad8d-7ef3d1f3bb6b tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:08:27.811809 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-61988d9d-81b5-437c-ad8d-7ef3d1f3bb6b tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:08:27.814697 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-61988d9d-81b5-437c-ad8d-7ef3d1f3bb6b tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:08:27.933226 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-9b61e907-3d41-4d30-b3bd-d3b8284025dc tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57ba6eeb99714c7cabb14f484968e269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a0c0985c7b9450a8b622b6761e5b5c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:08:27.944366 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-9b61e907-3d41-4d30-b3bd-d3b8284025dc tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57ba6eeb99714c7cabb14f484968e269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a0c0985c7b9450a8b622b6761e5b5c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:08:27.947463 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-9b61e907-3d41-4d30-b3bd-d3b8284025dc tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57ba6eeb99714c7cabb14f484968e269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a0c0985c7b9450a8b622b6761e5b5c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:08:27.949257 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-9b61e907-3d41-4d30-b3bd-d3b8284025dc tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] 10.222.0.13 "GET /compute/v2.1/servers/77d6f571-5742-462c-ada0-1b05dd1561d1" status: 200 len: 1336 microversion: 2.47 time: 0.172776 Nov 01 19:08:27.950526 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1776/3482] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 19:08:27 2022] GET /compute/v2.1/servers/77d6f571-5742-462c-ada0-1b05dd1561d1 => generated 1336 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 19:08:28.026490 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-61988d9d-81b5-437c-ad8d-7ef3d1f3bb6b tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113bd8c844ee490b86a68bc7e1e75da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '851785a5f76548898a77d67792888504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:08:28.034643 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-61988d9d-81b5-437c-ad8d-7ef3d1f3bb6b tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] 10.222.0.13 "GET /compute/v2.1/servers/8bfb4e44-7a5f-466d-9f1e-bebee16d400c" status: 200 len: 1309 microversion: 2.1 time: 0.246955 Nov 01 19:08:28.035165 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1707/3483] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:08:27 2022] GET /compute/v2.1/servers/8bfb4e44-7a5f-466d-9f1e-bebee16d400c => generated 1309 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 19:08:28.229114 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-1c0e1ffb-8bb7-48f0-a5bc-f5f8ce5e3df1 tempest-ImagesOneServerTestJSON-1044295602 tempest-ImagesOneServerTestJSON-1044295602-project] Calling method '.version_select at 0x7f0ae1ccf310>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:08:28.277148 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-1c0e1ffb-8bb7-48f0-a5bc-f5f8ce5e3df1 tempest-ImagesOneServerTestJSON-1044295602 tempest-ImagesOneServerTestJSON-1044295602-project] 10.222.0.13 "GET /compute/v2.1/images/5ef04aec-03ab-4186-8460-a6385af6c9f1" status: 200 len: 1428 microversion: 2.1 time: 0.051869 Nov 01 19:08:28.277771 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1777/3484] 10.222.0.13 () {58 vars in 1233 bytes} [Tue Nov 1 19:08:28 2022] GET /compute/v2.1/images/5ef04aec-03ab-4186-8460-a6385af6c9f1 => generated 1428 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:08:28.595397 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-aad6d044-7a39-4141-be29-d40bbb3761f5 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:08:28.596131 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-aad6d044-7a39-4141-be29-d40bbb3761f5 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] [instance: 8485db2a-fd8f-4615-bbe0-14822ad44194] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:08:28.603561 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-aad6d044-7a39-4141-be29-d40bbb3761f5 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:08:28.604122 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-aad6d044-7a39-4141-be29-d40bbb3761f5 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:08:28.604675 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-aad6d044-7a39-4141-be29-d40bbb3761f5 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:08:28.605440 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-aad6d044-7a39-4141-be29-d40bbb3761f5 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:08:28.605966 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-aad6d044-7a39-4141-be29-d40bbb3761f5 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:08:28.606458 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-aad6d044-7a39-4141-be29-d40bbb3761f5 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:08:28.852249 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-aad6d044-7a39-4141-be29-d40bbb3761f5 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '058480d92c9b4ab4af6815d0438a65c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee9dc49b89143f781e4ab30296e4d01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:08:28.862972 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-aad6d044-7a39-4141-be29-d40bbb3761f5 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] 10.222.0.13 "GET /compute/v2.1/servers/8485db2a-fd8f-4615-bbe0-14822ad44194" status: 200 len: 1508 microversion: 2.1 time: 0.271448 Nov 01 19:08:28.863568 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1708/3485] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:08:28 2022] GET /compute/v2.1/servers/8485db2a-fd8f-4615-bbe0-14822ad44194 => generated 1508 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:08:28.976145 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-45a8fc82-6227-4e0e-bee5-ef184f2e1869 tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:08:28.976849 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-45a8fc82-6227-4e0e-bee5-ef184f2e1869 tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] [instance: 77d6f571-5742-462c-ada0-1b05dd1561d1] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:08:28.986397 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-45a8fc82-6227-4e0e-bee5-ef184f2e1869 tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:08:28.986903 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-45a8fc82-6227-4e0e-bee5-ef184f2e1869 tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:08:28.987347 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-45a8fc82-6227-4e0e-bee5-ef184f2e1869 tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:08:28.988079 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-45a8fc82-6227-4e0e-bee5-ef184f2e1869 tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:08:28.988537 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-45a8fc82-6227-4e0e-bee5-ef184f2e1869 tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:08:28.988986 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-45a8fc82-6227-4e0e-bee5-ef184f2e1869 tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:08:29.058567 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-45a8fc82-6227-4e0e-bee5-ef184f2e1869 tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57ba6eeb99714c7cabb14f484968e269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a0c0985c7b9450a8b622b6761e5b5c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:08:29.058962 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-c7f942df-a03f-4b6c-848e-73a8a9241111 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:08:29.059680 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-c7f942df-a03f-4b6c-848e-73a8a9241111 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] [instance: 8bfb4e44-7a5f-466d-9f1e-bebee16d400c] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:08:29.066156 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-c7f942df-a03f-4b6c-848e-73a8a9241111 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:08:29.066861 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-c7f942df-a03f-4b6c-848e-73a8a9241111 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:08:29.067499 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-c7f942df-a03f-4b6c-848e-73a8a9241111 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:08:29.068053 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-45a8fc82-6227-4e0e-bee5-ef184f2e1869 tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57ba6eeb99714c7cabb14f484968e269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a0c0985c7b9450a8b622b6761e5b5c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:08:29.068597 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-c7f942df-a03f-4b6c-848e-73a8a9241111 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:08:29.069207 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-c7f942df-a03f-4b6c-848e-73a8a9241111 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:08:29.069849 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-c7f942df-a03f-4b6c-848e-73a8a9241111 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:08:29.070019 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-45a8fc82-6227-4e0e-bee5-ef184f2e1869 tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57ba6eeb99714c7cabb14f484968e269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a0c0985c7b9450a8b622b6761e5b5c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:08:29.071403 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-45a8fc82-6227-4e0e-bee5-ef184f2e1869 tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] 10.222.0.13 "GET /compute/v2.1/servers/77d6f571-5742-462c-ada0-1b05dd1561d1" status: 200 len: 1336 microversion: 2.47 time: 0.099393 Nov 01 19:08:29.072058 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1778/3486] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 19:08:28 2022] GET /compute/v2.1/servers/77d6f571-5742-462c-ada0-1b05dd1561d1 => generated 1336 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 19:08:29.205076 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-c7f942df-a03f-4b6c-848e-73a8a9241111 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113bd8c844ee490b86a68bc7e1e75da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '851785a5f76548898a77d67792888504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:08:29.208548 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-7f610a09-c71c-467d-875c-edc8f4138826 tempest-AttachSCSIVolumeTestJSON-356336257 tempest-AttachSCSIVolumeTestJSON-356336257-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:08:29.210415 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-7f610a09-c71c-467d-875c-edc8f4138826 tempest-AttachSCSIVolumeTestJSON-356336257 tempest-AttachSCSIVolumeTestJSON-356336257-project] [instance: 8a378b79-bd92-4ade-b034-1aaf5c87b74b] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:08:29.213389 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-c7f942df-a03f-4b6c-848e-73a8a9241111 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] 10.222.0.13 "GET /compute/v2.1/servers/8bfb4e44-7a5f-466d-9f1e-bebee16d400c" status: 200 len: 1309 microversion: 2.1 time: 0.159141 Nov 01 19:08:29.213973 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1709/3487] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:08:29 2022] GET /compute/v2.1/servers/8bfb4e44-7a5f-466d-9f1e-bebee16d400c => generated 1309 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 19:08:29.218094 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-7f610a09-c71c-467d-875c-edc8f4138826 tempest-AttachSCSIVolumeTestJSON-356336257 tempest-AttachSCSIVolumeTestJSON-356336257-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:08:29.219397 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-7f610a09-c71c-467d-875c-edc8f4138826 tempest-AttachSCSIVolumeTestJSON-356336257 tempest-AttachSCSIVolumeTestJSON-356336257-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:08:29.220039 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-7f610a09-c71c-467d-875c-edc8f4138826 tempest-AttachSCSIVolumeTestJSON-356336257 tempest-AttachSCSIVolumeTestJSON-356336257-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:08:29.221238 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-7f610a09-c71c-467d-875c-edc8f4138826 tempest-AttachSCSIVolumeTestJSON-356336257 tempest-AttachSCSIVolumeTestJSON-356336257-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:08:29.221889 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-7f610a09-c71c-467d-875c-edc8f4138826 tempest-AttachSCSIVolumeTestJSON-356336257 tempest-AttachSCSIVolumeTestJSON-356336257-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:08:29.222518 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-7f610a09-c71c-467d-875c-edc8f4138826 tempest-AttachSCSIVolumeTestJSON-356336257 tempest-AttachSCSIVolumeTestJSON-356336257-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:08:29.237792 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.wsgi [None req-7f610a09-c71c-467d-875c-edc8f4138826 tempest-AttachSCSIVolumeTestJSON-356336257 tempest-AttachSCSIVolumeTestJSON-356336257-project] HTTP exception thrown: Instance 8a378b79-bd92-4ade-b034-1aaf5c87b74b could not be found. Nov 01 19:08:29.239479 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-7f610a09-c71c-467d-875c-edc8f4138826 tempest-AttachSCSIVolumeTestJSON-356336257 tempest-AttachSCSIVolumeTestJSON-356336257-project] Request method failure captured: Nov 01 19:08:29.239479 n-d-863052-2 devstack@n-api.service[121403]: request: DELETE /compute/v2.1/servers/8a378b79-bd92-4ade-b034-1aaf5c87b74b HTTP/1.1 Nov 01 19:08:29.239479 n-d-863052-2 devstack@n-api.service[121403]: Accept: application/json Nov 01 19:08:29.239479 n-d-863052-2 devstack@n-api.service[121403]: Accept-Encoding: identity Nov 01 19:08:29.239479 n-d-863052-2 devstack@n-api.service[121403]: Connection: close Nov 01 19:08:29.239479 n-d-863052-2 devstack@n-api.service[121403]: Content-Length: 0 Nov 01 19:08:29.239479 n-d-863052-2 devstack@n-api.service[121403]: Content-Type: application/json Nov 01 19:08:29.239479 n-d-863052-2 devstack@n-api.service[121403]: Host: 10.222.0.13 Nov 01 19:08:29.239479 n-d-863052-2 devstack@n-api.service[121403]: Openstack-System-Scope: None Nov 01 19:08:29.239479 n-d-863052-2 devstack@n-api.service[121403]: User-Agent: python-urllib3/1.26.12 Nov 01 19:08:29.239479 n-d-863052-2 devstack@n-api.service[121403]: X-Auth-Token: gAAAAABjYW322Ikm_ocmYFWaXeTzUVArMWNo2ga7gyBaoe75ews3xNelAFe6noir-ZPmtGngdORwaDTF5ayBBPAECsdi__b3foOPVhmu0UKeZR2U8i7lU9CgT8FrzsLjTEvUL0TyZuHNUAXYgyeKUDm_XKtiH5B8qHKuHpbM8EcwhuZx6KmnQNg Nov 01 19:08:29.239479 n-d-863052-2 devstack@n-api.service[121403]: X-Domain-Id: None Nov 01 19:08:29.239479 n-d-863052-2 devstack@n-api.service[121403]: X-Domain-Name: None Nov 01 19:08:29.239479 n-d-863052-2 devstack@n-api.service[121403]: X-Identity-Status: Confirmed Nov 01 19:08:29.239479 n-d-863052-2 devstack@n-api.service[121403]: X-Is-Admin-Project: True Nov 01 19:08:29.239479 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Domain-Id: default Nov 01 19:08:29.239479 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Domain-Name: Default Nov 01 19:08:29.239479 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Id: 7b14142c34d54977ac9eb59962f2a9e1 Nov 01 19:08:29.239479 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-356336257 Nov 01 19:08:29.239479 n-d-863052-2 devstack@n-api.service[121403]: X-Role: member,reader Nov 01 19:08:29.239479 n-d-863052-2 devstack@n-api.service[121403]: X-Roles: member,reader Nov 01 19:08:29.239479 n-d-863052-2 devstack@n-api.service[121403]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/7b14142c34d54977ac9eb59962f2a9e1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/7b14142c34d54977ac9eb59962f2a9e1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_7b14142c34d54977ac9eb59962f2a9e1", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/7b14142c34d54977ac9eb59962f2a9e1"}]}] Nov 01 19:08:29.239479 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-356336257 Nov 01 19:08:29.239479 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant-Id: 7b14142c34d54977ac9eb59962f2a9e1 Nov 01 19:08:29.239479 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-356336257 Nov 01 19:08:29.239479 n-d-863052-2 devstack@n-api.service[121403]: X-User: tempest-AttachSCSIVolumeTestJSON-356336257-project Nov 01 19:08:29.239479 n-d-863052-2 devstack@n-api.service[121403]: X-User-Domain-Id: default Nov 01 19:08:29.239479 n-d-863052-2 devstack@n-api.service[121403]: X-User-Domain-Name: Default Nov 01 19:08:29.239479 n-d-863052-2 devstack@n-api.service[121403]: X-User-Id: cde7667dbbfd4864a5b0ca8d8b291406 Nov 01 19:08:29.239479 n-d-863052-2 devstack@n-api.service[121403]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-356336257-project Nov 01 19:08:29.239479 n-d-863052-2 devstack@n-api.service[121403]: method: > Nov 01 19:08:29.239479 n-d-863052-2 devstack@n-api.service[121403]: exception: Instance 8a378b79-bd92-4ade-b034-1aaf5c87b74b could not be found. Nov 01 19:08:29.239479 n-d-863052-2 devstack@n-api.service[121403]: action_args: {'id': '8a378b79-bd92-4ade-b034-1aaf5c87b74b'} Nov 01 19:08:29.239479 n-d-863052-2 devstack@n-api.service[121403]: {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 01 19:08:29.239479 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:08:29.239479 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 01 19:08:29.239479 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 01 19:08:29.239479 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 01 19:08:29.239479 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 01 19:08:29.239479 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 01 19:08:29.239479 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 01 19:08:29.239479 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 01 19:08:29.239479 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 01 19:08:29.239479 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8a378b79-bd92-4ade-b034-1aaf5c87b74b could not be found. Nov 01 19:08:29.239479 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:08:29.239479 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:08:29.239479 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:08:29.239479 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:08:29.239479 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:08:29.239479 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:08:29.239479 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 01 19:08:29.239479 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 01 19:08:29.239479 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 01 19:08:29.239479 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 01 19:08:29.239479 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 01 19:08:29.239479 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 01 19:08:29.239479 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 01 19:08:29.239479 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 01 19:08:29.239479 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 01 19:08:29.239479 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 01 19:08:29.239479 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 01 19:08:29.239479 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 01 19:08:29.244603 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8a378b79-bd92-4ade-b034-1aaf5c87b74b could not be found. Nov 01 19:08:29.244603 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:08:29.244603 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:08:29.244603 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:08:29.244603 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:08:29.244603 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:08:29.244603 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:08:29.244603 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 01 19:08:29.244603 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 01 19:08:29.244603 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8a378b79-bd92-4ade-b034-1aaf5c87b74b could not be found. Nov 01 19:08:29.244603 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:08:29.244603 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-7f610a09-c71c-467d-875c-edc8f4138826 tempest-AttachSCSIVolumeTestJSON-356336257 tempest-AttachSCSIVolumeTestJSON-356336257-project] Returning 404 to user: Instance 8a378b79-bd92-4ade-b034-1aaf5c87b74b could not be found. {{(pid=121403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 01 19:08:29.244603 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-7f610a09-c71c-467d-875c-edc8f4138826 tempest-AttachSCSIVolumeTestJSON-356336257 tempest-AttachSCSIVolumeTestJSON-356336257-project] 10.222.0.13 "DELETE /compute/v2.1/servers/8a378b79-bd92-4ade-b034-1aaf5c87b74b" status: 404 len: 111 microversion: 2.1 time: 0.039049 Nov 01 19:08:29.245799 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1779/3488] 10.222.0.13 () {58 vars in 1239 bytes} [Tue Nov 1 19:08:29 2022] DELETE /compute/v2.1/servers/8a378b79-bd92-4ade-b034-1aaf5c87b74b => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 01 19:08:29.255290 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-61a58a75-f0f5-433d-9dba-aa219f85f92e tempest-AttachSCSIVolumeTestJSON-356336257 tempest-AttachSCSIVolumeTestJSON-356336257-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:08:29.255910 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-61a58a75-f0f5-433d-9dba-aa219f85f92e tempest-AttachSCSIVolumeTestJSON-356336257 tempest-AttachSCSIVolumeTestJSON-356336257-project] [instance: 8a378b79-bd92-4ade-b034-1aaf5c87b74b] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:08:29.262088 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-61a58a75-f0f5-433d-9dba-aa219f85f92e tempest-AttachSCSIVolumeTestJSON-356336257 tempest-AttachSCSIVolumeTestJSON-356336257-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:08:29.262583 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-61a58a75-f0f5-433d-9dba-aa219f85f92e tempest-AttachSCSIVolumeTestJSON-356336257 tempest-AttachSCSIVolumeTestJSON-356336257-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:08:29.263027 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-61a58a75-f0f5-433d-9dba-aa219f85f92e tempest-AttachSCSIVolumeTestJSON-356336257 tempest-AttachSCSIVolumeTestJSON-356336257-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:08:29.263731 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-61a58a75-f0f5-433d-9dba-aa219f85f92e tempest-AttachSCSIVolumeTestJSON-356336257 tempest-AttachSCSIVolumeTestJSON-356336257-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:08:29.264230 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-61a58a75-f0f5-433d-9dba-aa219f85f92e tempest-AttachSCSIVolumeTestJSON-356336257 tempest-AttachSCSIVolumeTestJSON-356336257-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:08:29.265210 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-61a58a75-f0f5-433d-9dba-aa219f85f92e tempest-AttachSCSIVolumeTestJSON-356336257 tempest-AttachSCSIVolumeTestJSON-356336257-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:08:29.278836 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.wsgi [None req-61a58a75-f0f5-433d-9dba-aa219f85f92e tempest-AttachSCSIVolumeTestJSON-356336257 tempest-AttachSCSIVolumeTestJSON-356336257-project] HTTP exception thrown: Instance 8a378b79-bd92-4ade-b034-1aaf5c87b74b could not be found. Nov 01 19:08:29.280703 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-61a58a75-f0f5-433d-9dba-aa219f85f92e tempest-AttachSCSIVolumeTestJSON-356336257 tempest-AttachSCSIVolumeTestJSON-356336257-project] Request method failure captured: Nov 01 19:08:29.280703 n-d-863052-2 devstack@n-api.service[121402]: request: GET /compute/v2.1/servers/8a378b79-bd92-4ade-b034-1aaf5c87b74b HTTP/1.1 Nov 01 19:08:29.280703 n-d-863052-2 devstack@n-api.service[121402]: Accept: application/json Nov 01 19:08:29.280703 n-d-863052-2 devstack@n-api.service[121402]: Accept-Encoding: identity Nov 01 19:08:29.280703 n-d-863052-2 devstack@n-api.service[121402]: Connection: close Nov 01 19:08:29.280703 n-d-863052-2 devstack@n-api.service[121402]: Content-Length: 0 Nov 01 19:08:29.280703 n-d-863052-2 devstack@n-api.service[121402]: Content-Type: application/json Nov 01 19:08:29.280703 n-d-863052-2 devstack@n-api.service[121402]: Host: 10.222.0.13 Nov 01 19:08:29.280703 n-d-863052-2 devstack@n-api.service[121402]: Openstack-System-Scope: None Nov 01 19:08:29.280703 n-d-863052-2 devstack@n-api.service[121402]: User-Agent: python-urllib3/1.26.12 Nov 01 19:08:29.280703 n-d-863052-2 devstack@n-api.service[121402]: X-Auth-Token: gAAAAABjYW322Ikm_ocmYFWaXeTzUVArMWNo2ga7gyBaoe75ews3xNelAFe6noir-ZPmtGngdORwaDTF5ayBBPAECsdi__b3foOPVhmu0UKeZR2U8i7lU9CgT8FrzsLjTEvUL0TyZuHNUAXYgyeKUDm_XKtiH5B8qHKuHpbM8EcwhuZx6KmnQNg Nov 01 19:08:29.280703 n-d-863052-2 devstack@n-api.service[121402]: X-Domain-Id: None Nov 01 19:08:29.280703 n-d-863052-2 devstack@n-api.service[121402]: X-Domain-Name: None Nov 01 19:08:29.280703 n-d-863052-2 devstack@n-api.service[121402]: X-Identity-Status: Confirmed Nov 01 19:08:29.280703 n-d-863052-2 devstack@n-api.service[121402]: X-Is-Admin-Project: True Nov 01 19:08:29.280703 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Domain-Id: default Nov 01 19:08:29.280703 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Domain-Name: Default Nov 01 19:08:29.280703 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Id: 7b14142c34d54977ac9eb59962f2a9e1 Nov 01 19:08:29.280703 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-356336257 Nov 01 19:08:29.280703 n-d-863052-2 devstack@n-api.service[121402]: X-Role: member,reader Nov 01 19:08:29.280703 n-d-863052-2 devstack@n-api.service[121402]: X-Roles: member,reader Nov 01 19:08:29.280703 n-d-863052-2 devstack@n-api.service[121402]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/7b14142c34d54977ac9eb59962f2a9e1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/7b14142c34d54977ac9eb59962f2a9e1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_7b14142c34d54977ac9eb59962f2a9e1", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/7b14142c34d54977ac9eb59962f2a9e1"}]}] Nov 01 19:08:29.280703 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-356336257 Nov 01 19:08:29.280703 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant-Id: 7b14142c34d54977ac9eb59962f2a9e1 Nov 01 19:08:29.280703 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-356336257 Nov 01 19:08:29.280703 n-d-863052-2 devstack@n-api.service[121402]: X-User: tempest-AttachSCSIVolumeTestJSON-356336257-project Nov 01 19:08:29.280703 n-d-863052-2 devstack@n-api.service[121402]: X-User-Domain-Id: default Nov 01 19:08:29.280703 n-d-863052-2 devstack@n-api.service[121402]: X-User-Domain-Name: Default Nov 01 19:08:29.280703 n-d-863052-2 devstack@n-api.service[121402]: X-User-Id: cde7667dbbfd4864a5b0ca8d8b291406 Nov 01 19:08:29.280703 n-d-863052-2 devstack@n-api.service[121402]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-356336257-project Nov 01 19:08:29.280703 n-d-863052-2 devstack@n-api.service[121402]: method: > Nov 01 19:08:29.280703 n-d-863052-2 devstack@n-api.service[121402]: exception: Instance 8a378b79-bd92-4ade-b034-1aaf5c87b74b could not be found. Nov 01 19:08:29.280703 n-d-863052-2 devstack@n-api.service[121402]: action_args: {'id': '8a378b79-bd92-4ade-b034-1aaf5c87b74b'} Nov 01 19:08:29.280703 n-d-863052-2 devstack@n-api.service[121402]: {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 01 19:08:29.280703 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:08:29.280703 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 01 19:08:29.280703 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 01 19:08:29.280703 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 01 19:08:29.280703 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 01 19:08:29.280703 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 01 19:08:29.280703 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 01 19:08:29.280703 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 01 19:08:29.280703 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 01 19:08:29.280703 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8a378b79-bd92-4ade-b034-1aaf5c87b74b could not be found. Nov 01 19:08:29.280703 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:08:29.280703 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:08:29.280703 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:08:29.280703 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:08:29.280703 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:08:29.280703 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:08:29.280703 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 01 19:08:29.280703 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 01 19:08:29.280703 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 01 19:08:29.280703 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 01 19:08:29.280703 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 01 19:08:29.280703 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 01 19:08:29.280703 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 01 19:08:29.280703 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 01 19:08:29.280703 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 01 19:08:29.280703 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 01 19:08:29.280703 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8a378b79-bd92-4ade-b034-1aaf5c87b74b could not be found. Nov 01 19:08:29.280703 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:08:29.280703 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:08:29.280703 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:08:29.285078 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:08:29.285078 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:08:29.285078 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:08:29.285078 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 01 19:08:29.285078 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 01 19:08:29.285078 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8a378b79-bd92-4ade-b034-1aaf5c87b74b could not be found. Nov 01 19:08:29.285078 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:08:29.285078 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-61a58a75-f0f5-433d-9dba-aa219f85f92e tempest-AttachSCSIVolumeTestJSON-356336257 tempest-AttachSCSIVolumeTestJSON-356336257-project] Returning 404 to user: Instance 8a378b79-bd92-4ade-b034-1aaf5c87b74b could not be found. {{(pid=121402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 01 19:08:29.285078 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-61a58a75-f0f5-433d-9dba-aa219f85f92e tempest-AttachSCSIVolumeTestJSON-356336257 tempest-AttachSCSIVolumeTestJSON-356336257-project] 10.222.0.13 "GET /compute/v2.1/servers/8a378b79-bd92-4ade-b034-1aaf5c87b74b" status: 404 len: 111 microversion: 2.1 time: 0.032850 Nov 01 19:08:29.285078 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1710/3489] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:08:29 2022] GET /compute/v2.1/servers/8a378b79-bd92-4ade-b034-1aaf5c87b74b => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 01 19:08:29.293605 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-b6bd16d8-ad02-4447-8122-efc08a18c8f7 tempest-ImagesOneServerTestJSON-1044295602 tempest-ImagesOneServerTestJSON-1044295602-project] Calling method '.version_select at 0x7f0ae1ccf310>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:08:29.339418 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-b6bd16d8-ad02-4447-8122-efc08a18c8f7 tempest-ImagesOneServerTestJSON-1044295602 tempest-ImagesOneServerTestJSON-1044295602-project] 10.222.0.13 "GET /compute/v2.1/images/5ef04aec-03ab-4186-8460-a6385af6c9f1" status: 200 len: 1428 microversion: 2.1 time: 0.049573 Nov 01 19:08:29.340464 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1780/3490] 10.222.0.13 () {58 vars in 1233 bytes} [Tue Nov 1 19:08:29 2022] GET /compute/v2.1/images/5ef04aec-03ab-4186-8460-a6385af6c9f1 => generated 1428 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:08:29.841686 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [req-9f9696a9-2027-43ae-8212-cd595bf20414 req-7d5ce00a-7b54-4b82-89e6-1dada5591ed4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "31f51cbd-b29a-46be-bca0-f27c2b287e15", "name": "network-vif-plugged", "status": "completed", "tag": "bc5f2d73-99ce-47e7-bd41-afad82bb372e"}]} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:08:29.855719 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-9f9696a9-2027-43ae-8212-cd595bf20414 req-7d5ce00a-7b54-4b82-89e6-1dada5591ed4 service nova] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:08:29.856544 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-9f9696a9-2027-43ae-8212-cd595bf20414 req-7d5ce00a-7b54-4b82-89e6-1dada5591ed4 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:08:29.857206 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-9f9696a9-2027-43ae-8212-cd595bf20414 req-7d5ce00a-7b54-4b82-89e6-1dada5591ed4 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:08:29.870300 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.compute.server_external_events [req-9f9696a9-2027-43ae-8212-cd595bf20414 req-7d5ce00a-7b54-4b82-89e6-1dada5591ed4 service nova] Creating event network-vif-plugged:bc5f2d73-99ce-47e7-bd41-afad82bb372e for instance 31f51cbd-b29a-46be-bca0-f27c2b287e15 on n-h2-863052-2 Nov 01 19:08:29.878768 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [req-9f9696a9-2027-43ae-8212-cd595bf20414 req-7d5ce00a-7b54-4b82-89e6-1dada5591ed4 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039953 Nov 01 19:08:29.879907 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1711/3491] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Nov 1 19:08:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:08:29.887622 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-691b6d93-cd59-4956-a399-1ba75bb39099 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:08:29.888521 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-691b6d93-cd59-4956-a399-1ba75bb39099 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] [instance: 8485db2a-fd8f-4615-bbe0-14822ad44194] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:08:29.897716 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-691b6d93-cd59-4956-a399-1ba75bb39099 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:08:29.899760 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-691b6d93-cd59-4956-a399-1ba75bb39099 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:08:29.900402 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-691b6d93-cd59-4956-a399-1ba75bb39099 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:08:29.901815 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-691b6d93-cd59-4956-a399-1ba75bb39099 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:08:29.902470 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-691b6d93-cd59-4956-a399-1ba75bb39099 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:08:29.903161 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-691b6d93-cd59-4956-a399-1ba75bb39099 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:08:30.099750 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-2aa9c0e7-d13a-4487-b919-7cd24ed92575 tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:08:30.100797 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-2aa9c0e7-d13a-4487-b919-7cd24ed92575 tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] [instance: 77d6f571-5742-462c-ada0-1b05dd1561d1] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:08:30.107694 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2aa9c0e7-d13a-4487-b919-7cd24ed92575 tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:08:30.108570 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2aa9c0e7-d13a-4487-b919-7cd24ed92575 tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:08:30.109287 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2aa9c0e7-d13a-4487-b919-7cd24ed92575 tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:08:30.110217 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2aa9c0e7-d13a-4487-b919-7cd24ed92575 tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:08:30.110912 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2aa9c0e7-d13a-4487-b919-7cd24ed92575 tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:08:30.111555 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2aa9c0e7-d13a-4487-b919-7cd24ed92575 tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:08:30.146374 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-691b6d93-cd59-4956-a399-1ba75bb39099 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '058480d92c9b4ab4af6815d0438a65c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee9dc49b89143f781e4ab30296e4d01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:08:30.156964 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-691b6d93-cd59-4956-a399-1ba75bb39099 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] 10.222.0.13 "GET /compute/v2.1/servers/8485db2a-fd8f-4615-bbe0-14822ad44194" status: 200 len: 1508 microversion: 2.1 time: 0.274096 Nov 01 19:08:30.175129 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1781/3492] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:08:29 2022] GET /compute/v2.1/servers/8485db2a-fd8f-4615-bbe0-14822ad44194 => generated 1508 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:08:30.226830 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-2aa9c0e7-d13a-4487-b919-7cd24ed92575 tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57ba6eeb99714c7cabb14f484968e269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a0c0985c7b9450a8b622b6761e5b5c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:08:30.254493 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-668926ca-3ddd-47b3-a1f2-d72364c94093 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:08:30.254687 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-2aa9c0e7-d13a-4487-b919-7cd24ed92575 tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57ba6eeb99714c7cabb14f484968e269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a0c0985c7b9450a8b622b6761e5b5c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:08:30.256014 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-2aa9c0e7-d13a-4487-b919-7cd24ed92575 tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57ba6eeb99714c7cabb14f484968e269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a0c0985c7b9450a8b622b6761e5b5c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:08:30.256270 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-668926ca-3ddd-47b3-a1f2-d72364c94093 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] [instance: 8bfb4e44-7a5f-466d-9f1e-bebee16d400c] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:08:30.261067 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-2aa9c0e7-d13a-4487-b919-7cd24ed92575 tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] 10.222.0.13 "GET /compute/v2.1/servers/77d6f571-5742-462c-ada0-1b05dd1561d1" status: 200 len: 1336 microversion: 2.47 time: 0.165667 Nov 01 19:08:30.261671 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1712/3493] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 19:08:30 2022] GET /compute/v2.1/servers/77d6f571-5742-462c-ada0-1b05dd1561d1 => generated 1336 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 19:08:30.268097 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-668926ca-3ddd-47b3-a1f2-d72364c94093 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:08:30.268778 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-668926ca-3ddd-47b3-a1f2-d72364c94093 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:08:30.269394 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-668926ca-3ddd-47b3-a1f2-d72364c94093 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:08:30.270102 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-668926ca-3ddd-47b3-a1f2-d72364c94093 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:08:30.270557 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-668926ca-3ddd-47b3-a1f2-d72364c94093 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:08:30.270980 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-668926ca-3ddd-47b3-a1f2-d72364c94093 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:08:30.355585 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-d911ac66-d66c-4ec2-82ad-e897bb74a917 tempest-ImagesOneServerTestJSON-1044295602 tempest-ImagesOneServerTestJSON-1044295602-project] Calling method '.version_select at 0x7f0ae184bca0>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:08:30.412648 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-d911ac66-d66c-4ec2-82ad-e897bb74a917 tempest-ImagesOneServerTestJSON-1044295602 tempest-ImagesOneServerTestJSON-1044295602-project] 10.222.0.13 "GET /compute/v2.1/images/5ef04aec-03ab-4186-8460-a6385af6c9f1" status: 200 len: 1428 microversion: 2.1 time: 0.061108 Nov 01 19:08:30.424762 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1713/3494] 10.222.0.13 () {58 vars in 1233 bytes} [Tue Nov 1 19:08:30 2022] GET /compute/v2.1/images/5ef04aec-03ab-4186-8460-a6385af6c9f1 => generated 1428 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 19:08:30.530291 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-668926ca-3ddd-47b3-a1f2-d72364c94093 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113bd8c844ee490b86a68bc7e1e75da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '851785a5f76548898a77d67792888504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:08:30.542134 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-668926ca-3ddd-47b3-a1f2-d72364c94093 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] 10.222.0.13 "GET /compute/v2.1/servers/8bfb4e44-7a5f-466d-9f1e-bebee16d400c" status: 200 len: 1309 microversion: 2.1 time: 0.307620 Nov 01 19:08:30.557575 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1782/3495] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:08:30 2022] GET /compute/v2.1/servers/8bfb4e44-7a5f-466d-9f1e-bebee16d400c => generated 1309 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:08:31.178143 n-d-863052-2 devstack@n-api.service[121402]: DEBUG dbcounter [-] [121402] Writing DB stats nova_cell0:SELECT=2 {{(pid=121402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 19:08:31.185186 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-81fa4bbc-ec37-4fbc-92ba-602e6c28b9e5 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:08:31.186599 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-81fa4bbc-ec37-4fbc-92ba-602e6c28b9e5 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] [instance: 8485db2a-fd8f-4615-bbe0-14822ad44194] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:08:31.194140 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-81fa4bbc-ec37-4fbc-92ba-602e6c28b9e5 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:08:31.195032 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-81fa4bbc-ec37-4fbc-92ba-602e6c28b9e5 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:08:31.195635 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-81fa4bbc-ec37-4fbc-92ba-602e6c28b9e5 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:08:31.196506 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-81fa4bbc-ec37-4fbc-92ba-602e6c28b9e5 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:08:31.197133 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-81fa4bbc-ec37-4fbc-92ba-602e6c28b9e5 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:08:31.197731 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-81fa4bbc-ec37-4fbc-92ba-602e6c28b9e5 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:08:31.250826 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-d69dab8b-3009-4bd1-ad43-c72bb147392c tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:08:31.251236 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-d69dab8b-3009-4bd1-ad43-c72bb147392c tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] [instance: ba6ffc5c-84a4-40f1-bdc7-f87dde2c99df] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:08:31.263553 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d69dab8b-3009-4bd1-ad43-c72bb147392c tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:08:31.264257 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d69dab8b-3009-4bd1-ad43-c72bb147392c tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:08:31.264904 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d69dab8b-3009-4bd1-ad43-c72bb147392c tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:08:31.266330 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d69dab8b-3009-4bd1-ad43-c72bb147392c tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:08:31.266950 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d69dab8b-3009-4bd1-ad43-c72bb147392c tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:08:31.269868 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d69dab8b-3009-4bd1-ad43-c72bb147392c tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:08:31.435403 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-81fa4bbc-ec37-4fbc-92ba-602e6c28b9e5 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '058480d92c9b4ab4af6815d0438a65c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee9dc49b89143f781e4ab30296e4d01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:08:31.457569 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-81fa4bbc-ec37-4fbc-92ba-602e6c28b9e5 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] 10.222.0.13 "GET /compute/v2.1/servers/8485db2a-fd8f-4615-bbe0-14822ad44194" status: 200 len: 1529 microversion: 2.1 time: 0.280000 Nov 01 19:08:31.472674 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1714/3496] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:08:31 2022] GET /compute/v2.1/servers/8485db2a-fd8f-4615-bbe0-14822ad44194 => generated 1529 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:08:31.488721 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-4f66aa4d-1559-452e-b4e8-738489fcc093 tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:08:31.489442 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-4f66aa4d-1559-452e-b4e8-738489fcc093 tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] [instance: 77d6f571-5742-462c-ada0-1b05dd1561d1] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:08:31.501142 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-4f66aa4d-1559-452e-b4e8-738489fcc093 tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:08:31.502551 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-4f66aa4d-1559-452e-b4e8-738489fcc093 tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:08:31.503111 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-4f66aa4d-1559-452e-b4e8-738489fcc093 tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:08:31.504142 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-4f66aa4d-1559-452e-b4e8-738489fcc093 tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:08:31.504777 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-4f66aa4d-1559-452e-b4e8-738489fcc093 tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:08:31.505907 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-4f66aa4d-1559-452e-b4e8-738489fcc093 tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:08:31.641555 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-4f66aa4d-1559-452e-b4e8-738489fcc093 tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57ba6eeb99714c7cabb14f484968e269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a0c0985c7b9450a8b622b6761e5b5c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:08:31.664501 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-4f66aa4d-1559-452e-b4e8-738489fcc093 tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57ba6eeb99714c7cabb14f484968e269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a0c0985c7b9450a8b622b6761e5b5c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:08:31.670423 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-4f66aa4d-1559-452e-b4e8-738489fcc093 tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57ba6eeb99714c7cabb14f484968e269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a0c0985c7b9450a8b622b6761e5b5c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:08:31.674172 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-4f66aa4d-1559-452e-b4e8-738489fcc093 tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] 10.222.0.13 "GET /compute/v2.1/servers/77d6f571-5742-462c-ada0-1b05dd1561d1" status: 200 len: 1336 microversion: 2.47 time: 0.204616 Nov 01 19:08:31.687541 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1715/3497] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 19:08:31 2022] GET /compute/v2.1/servers/77d6f571-5742-462c-ada0-1b05dd1561d1 => generated 1336 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 19:08:31.709628 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-be11f401-f9d1-4e0a-85e5-bc5d6cfe59f5 tempest-ImagesOneServerTestJSON-1044295602 tempest-ImagesOneServerTestJSON-1044295602-project] Calling method '.version_select at 0x7f0ae182c430>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:08:31.819366 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-be11f401-f9d1-4e0a-85e5-bc5d6cfe59f5 tempest-ImagesOneServerTestJSON-1044295602 tempest-ImagesOneServerTestJSON-1044295602-project] 10.222.0.13 "GET /compute/v2.1/images/5ef04aec-03ab-4186-8460-a6385af6c9f1" status: 200 len: 1428 microversion: 2.1 time: 0.128026 Nov 01 19:08:31.820322 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1716/3498] 10.222.0.13 () {58 vars in 1233 bytes} [Tue Nov 1 19:08:31 2022] GET /compute/v2.1/images/5ef04aec-03ab-4186-8460-a6385af6c9f1 => generated 1428 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:08:31.845902 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-563911c7-7cb7-44ac-b5c8-e329204f97d9 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:08:31.846637 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-563911c7-7cb7-44ac-b5c8-e329204f97d9 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] [instance: 8bfb4e44-7a5f-466d-9f1e-bebee16d400c] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:08:31.864342 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-563911c7-7cb7-44ac-b5c8-e329204f97d9 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:08:31.867979 n-d-863052-2 devstack@n-api.service[121403]: DEBUG dbcounter [-] [121403] Writing DB stats nova_cell0:SELECT=6 {{(pid=121403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 19:08:31.869241 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-563911c7-7cb7-44ac-b5c8-e329204f97d9 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:08:31.870110 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-563911c7-7cb7-44ac-b5c8-e329204f97d9 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:08:31.873577 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-563911c7-7cb7-44ac-b5c8-e329204f97d9 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:08:31.874852 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-563911c7-7cb7-44ac-b5c8-e329204f97d9 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:08:31.877059 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-563911c7-7cb7-44ac-b5c8-e329204f97d9 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:08:31.936889 n-d-863052-2 devstack@n-api.service[121403]: DEBUG dbcounter [-] [121403] Writing DB stats nova_cell0:SELECT=26 {{(pid=121403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 19:08:31.964482 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-d69dab8b-3009-4bd1-ad43-c72bb147392c tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd2105b0264b48d084d0e79cabff8bc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf4adda91364dab94830347c06e3957', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:08:31.974311 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-d69dab8b-3009-4bd1-ad43-c72bb147392c tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd2105b0264b48d084d0e79cabff8bc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf4adda91364dab94830347c06e3957', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:08:31.975682 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-d69dab8b-3009-4bd1-ad43-c72bb147392c tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd2105b0264b48d084d0e79cabff8bc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf4adda91364dab94830347c06e3957', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:08:31.985737 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-d69dab8b-3009-4bd1-ad43-c72bb147392c tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] 10.222.0.13 "GET /compute/v2.1/servers/ba6ffc5c-84a4-40f1-bdc7-f87dde2c99df" status: 200 len: 2946 microversion: 2.32 time: 0.739169 Nov 01 19:08:31.986521 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1783/3499] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 19:08:31 2022] GET /compute/v2.1/servers/ba6ffc5c-84a4-40f1-bdc7-f87dde2c99df => generated 2946 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 01 19:08:32.035544 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-fc6ad2f8-8c64-41ce-8926-439ef0f44e98 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:08:32.036125 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-fc6ad2f8-8c64-41ce-8926-439ef0f44e98 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] [instance: ba6ffc5c-84a4-40f1-bdc7-f87dde2c99df] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:08:32.055113 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-fc6ad2f8-8c64-41ce-8926-439ef0f44e98 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:08:32.055603 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-fc6ad2f8-8c64-41ce-8926-439ef0f44e98 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:08:32.056048 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-fc6ad2f8-8c64-41ce-8926-439ef0f44e98 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:08:32.056793 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-fc6ad2f8-8c64-41ce-8926-439ef0f44e98 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:08:32.057255 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-fc6ad2f8-8c64-41ce-8926-439ef0f44e98 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:08:32.071345 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-fc6ad2f8-8c64-41ce-8926-439ef0f44e98 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:08:32.210019 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-563911c7-7cb7-44ac-b5c8-e329204f97d9 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113bd8c844ee490b86a68bc7e1e75da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '851785a5f76548898a77d67792888504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:08:32.225395 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-563911c7-7cb7-44ac-b5c8-e329204f97d9 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] 10.222.0.13 "GET /compute/v2.1/servers/8bfb4e44-7a5f-466d-9f1e-bebee16d400c" status: 200 len: 1309 microversion: 2.1 time: 0.396282 Nov 01 19:08:32.227931 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1717/3500] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:08:31 2022] GET /compute/v2.1/servers/8bfb4e44-7a5f-466d-9f1e-bebee16d400c => generated 1309 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:08:32.244068 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [req-fe262455-3c6d-4b26-8c62-41db9f62ca14 req-dfce66b2-169d-4068-b805-90e4918abfe9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8bfb4e44-7a5f-466d-9f1e-bebee16d400c", "name": "network-vif-plugged", "status": "completed", "tag": "69625ce1-e061-4e19-b336-0c35e9ffbbd9"}]} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:08:32.268050 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-fe262455-3c6d-4b26-8c62-41db9f62ca14 req-dfce66b2-169d-4068-b805-90e4918abfe9 service nova] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:08:32.268726 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-fe262455-3c6d-4b26-8c62-41db9f62ca14 req-dfce66b2-169d-4068-b805-90e4918abfe9 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:08:32.269168 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-fe262455-3c6d-4b26-8c62-41db9f62ca14 req-dfce66b2-169d-4068-b805-90e4918abfe9 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:08:32.285135 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.compute.server_external_events [req-fe262455-3c6d-4b26-8c62-41db9f62ca14 req-dfce66b2-169d-4068-b805-90e4918abfe9 service nova] Creating event network-vif-plugged:69625ce1-e061-4e19-b336-0c35e9ffbbd9 for instance 8bfb4e44-7a5f-466d-9f1e-bebee16d400c on n-h2-863052-2 Nov 01 19:08:32.294248 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [req-fe262455-3c6d-4b26-8c62-41db9f62ca14 req-dfce66b2-169d-4068-b805-90e4918abfe9 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062501 Nov 01 19:08:32.301810 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1718/3501] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Nov 1 19:08:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:08:32.488274 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-58eb40c9-2824-4ccd-aa6a-bd5969f3f349 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:08:32.490843 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-58eb40c9-2824-4ccd-aa6a-bd5969f3f349 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] [instance: 8485db2a-fd8f-4615-bbe0-14822ad44194] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:08:32.507204 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-58eb40c9-2824-4ccd-aa6a-bd5969f3f349 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:08:32.511439 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-58eb40c9-2824-4ccd-aa6a-bd5969f3f349 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:08:32.512704 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-58eb40c9-2824-4ccd-aa6a-bd5969f3f349 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:08:32.517482 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-58eb40c9-2824-4ccd-aa6a-bd5969f3f349 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:08:32.518257 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-58eb40c9-2824-4ccd-aa6a-bd5969f3f349 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:08:32.519722 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-58eb40c9-2824-4ccd-aa6a-bd5969f3f349 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:08:32.758056 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-58eb40c9-2824-4ccd-aa6a-bd5969f3f349 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '058480d92c9b4ab4af6815d0438a65c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee9dc49b89143f781e4ab30296e4d01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:08:32.768513 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-58eb40c9-2824-4ccd-aa6a-bd5969f3f349 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] 10.222.0.13 "GET /compute/v2.1/servers/8485db2a-fd8f-4615-bbe0-14822ad44194" status: 200 len: 1529 microversion: 2.1 time: 0.285082 Nov 01 19:08:32.772842 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1719/3502] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:08:32 2022] GET /compute/v2.1/servers/8485db2a-fd8f-4615-bbe0-14822ad44194 => generated 1529 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:08:32.788230 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-d05625e0-d47f-414b-b29e-9c353609cd89 tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:08:32.788230 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-d05625e0-d47f-414b-b29e-9c353609cd89 tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] [instance: 77d6f571-5742-462c-ada0-1b05dd1561d1] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:08:32.802438 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-d05625e0-d47f-414b-b29e-9c353609cd89 tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:08:32.803139 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-d05625e0-d47f-414b-b29e-9c353609cd89 tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:08:32.803916 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-d05625e0-d47f-414b-b29e-9c353609cd89 tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:08:32.804870 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-d05625e0-d47f-414b-b29e-9c353609cd89 tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:08:32.805482 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-d05625e0-d47f-414b-b29e-9c353609cd89 tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:08:32.806058 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-d05625e0-d47f-414b-b29e-9c353609cd89 tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:08:32.818263 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-fc6ad2f8-8c64-41ce-8926-439ef0f44e98 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] 10.222.0.13 "GET /compute/v2.1/servers/ba6ffc5c-84a4-40f1-bdc7-f87dde2c99df/os-interface" status: 200 len: 1833 microversion: 2.32 time: 0.792791 Nov 01 19:08:32.818880 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1784/3503] 10.222.0.13 () {60 vars in 1316 bytes} [Tue Nov 1 19:08:32 2022] GET /compute/v2.1/servers/ba6ffc5c-84a4-40f1-bdc7-f87dde2c99df/os-interface => generated 1833 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 19:08:32.837043 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-bb7df4ad-35c0-46e6-80d2-540ef29832c6 tempest-ImagesOneServerTestJSON-1044295602 tempest-ImagesOneServerTestJSON-1044295602-project] Calling method '.version_select at 0x7f0ae1d684c0>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:08:32.848026 n-d-863052-2 devstack@n-api.service[121402]: DEBUG dbcounter [-] [121402] Writing DB stats nova_cell0:SELECT=12 {{(pid=121402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 19:08:32.925880 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-d05625e0-d47f-414b-b29e-9c353609cd89 tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57ba6eeb99714c7cabb14f484968e269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a0c0985c7b9450a8b622b6761e5b5c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:08:32.927854 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-bb7df4ad-35c0-46e6-80d2-540ef29832c6 tempest-ImagesOneServerTestJSON-1044295602 tempest-ImagesOneServerTestJSON-1044295602-project] 10.222.0.13 "GET /compute/v2.1/images/5ef04aec-03ab-4186-8460-a6385af6c9f1" status: 200 len: 1428 microversion: 2.1 time: 0.095709 Nov 01 19:08:32.929034 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1785/3504] 10.222.0.13 () {58 vars in 1233 bytes} [Tue Nov 1 19:08:32 2022] GET /compute/v2.1/images/5ef04aec-03ab-4186-8460-a6385af6c9f1 => generated 1428 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:08:32.936554 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-d05625e0-d47f-414b-b29e-9c353609cd89 tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57ba6eeb99714c7cabb14f484968e269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a0c0985c7b9450a8b622b6761e5b5c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:08:32.943180 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-d05625e0-d47f-414b-b29e-9c353609cd89 tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57ba6eeb99714c7cabb14f484968e269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a0c0985c7b9450a8b622b6761e5b5c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:08:32.948808 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-d05625e0-d47f-414b-b29e-9c353609cd89 tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] 10.222.0.13 "GET /compute/v2.1/servers/77d6f571-5742-462c-ada0-1b05dd1561d1" status: 200 len: 1357 microversion: 2.47 time: 0.173038 Nov 01 19:08:32.968769 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1720/3505] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 19:08:32 2022] GET /compute/v2.1/servers/77d6f571-5742-462c-ada0-1b05dd1561d1 => generated 1357 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 19:08:33.000199 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-eec72b24-14c0-4acb-9e16-b08a897271ea tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "2d4a0047-1b9e-445f-8af8-1b5c9d93e881"}} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:08:33.004071 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-eec72b24-14c0-4acb-9e16-b08a897271ea tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] [instance: 77d6f571-5742-462c-ada0-1b05dd1561d1] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:08:33.015057 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-eec72b24-14c0-4acb-9e16-b08a897271ea tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:08:33.015770 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-eec72b24-14c0-4acb-9e16-b08a897271ea tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:08:33.016533 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-eec72b24-14c0-4acb-9e16-b08a897271ea tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:08:33.017576 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-eec72b24-14c0-4acb-9e16-b08a897271ea tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:08:33.018281 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-eec72b24-14c0-4acb-9e16-b08a897271ea tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:08:33.018935 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-eec72b24-14c0-4acb-9e16-b08a897271ea tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:08:33.162069 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.virt.hardware [None req-eec72b24-14c0-4acb-9e16-b08a897271ea tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Flavor limits 0:0:0 {{(pid=121403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 01 19:08:33.162492 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.virt.hardware [None req-eec72b24-14c0-4acb-9e16-b08a897271ea tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Image limits 0:0:0 {{(pid=121403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 01 19:08:33.164331 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.virt.hardware [None req-eec72b24-14c0-4acb-9e16-b08a897271ea tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Flavor pref 0:0:0 {{(pid=121403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 01 19:08:33.167300 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.virt.hardware [None req-eec72b24-14c0-4acb-9e16-b08a897271ea tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Image pref 0:0:0 {{(pid=121403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 01 19:08:33.168822 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.virt.hardware [None req-eec72b24-14c0-4acb-9e16-b08a897271ea tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 01 19:08:33.254970 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-ae9f4890-ce97-442f-a020-1258c162b736 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:08:33.255774 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-ae9f4890-ce97-442f-a020-1258c162b736 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] [instance: 8bfb4e44-7a5f-466d-9f1e-bebee16d400c] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:08:33.269645 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-ae9f4890-ce97-442f-a020-1258c162b736 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:08:33.270076 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-ae9f4890-ce97-442f-a020-1258c162b736 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:08:33.272465 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-ae9f4890-ce97-442f-a020-1258c162b736 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:08:33.275262 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-ae9f4890-ce97-442f-a020-1258c162b736 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:08:33.276076 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-ae9f4890-ce97-442f-a020-1258c162b736 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:08:33.276698 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-ae9f4890-ce97-442f-a020-1258c162b736 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:08:33.303847 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-eec72b24-14c0-4acb-9e16-b08a897271ea tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] [instance: 77d6f571-5742-462c-ada0-1b05dd1561d1] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:08:33.313588 n-d-863052-2 devstack@n-api.service[121403]: DEBUG dbcounter [-] [121403] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:DELETE=1 {{(pid=121403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 19:08:33.326691 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-eec72b24-14c0-4acb-9e16-b08a897271ea tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:08:33.327199 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-eec72b24-14c0-4acb-9e16-b08a897271ea tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:08:33.327644 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-eec72b24-14c0-4acb-9e16-b08a897271ea tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:08:33.328420 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-eec72b24-14c0-4acb-9e16-b08a897271ea tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:08:33.338540 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-eec72b24-14c0-4acb-9e16-b08a897271ea tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:08:33.339400 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-eec72b24-14c0-4acb-9e16-b08a897271ea tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:08:33.476060 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-eec72b24-14c0-4acb-9e16-b08a897271ea tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] 10.222.0.13 "POST /compute/v2.1/servers/77d6f571-5742-462c-ada0-1b05dd1561d1/action" status: 202 len: 1079 microversion: 2.47 time: 0.481351 Nov 01 19:08:33.481945 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1786/3506] 10.222.0.13 () {62 vars in 1319 bytes} [Tue Nov 1 19:08:32 2022] POST /compute/v2.1/servers/77d6f571-5742-462c-ada0-1b05dd1561d1/action => generated 1079 bytes in 493 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Nov 01 19:08:33.513749 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-f92299ea-7f96-4765-a63f-592663bd3820 tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:08:33.514501 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-f92299ea-7f96-4765-a63f-592663bd3820 tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] [instance: 77d6f571-5742-462c-ada0-1b05dd1561d1] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:08:33.525430 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f92299ea-7f96-4765-a63f-592663bd3820 tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:08:33.525932 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f92299ea-7f96-4765-a63f-592663bd3820 tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:08:33.526369 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f92299ea-7f96-4765-a63f-592663bd3820 tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:08:33.527074 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f92299ea-7f96-4765-a63f-592663bd3820 tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:08:33.527531 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f92299ea-7f96-4765-a63f-592663bd3820 tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:08:33.527970 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f92299ea-7f96-4765-a63f-592663bd3820 tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:08:33.610631 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-ae9f4890-ce97-442f-a020-1258c162b736 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113bd8c844ee490b86a68bc7e1e75da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '851785a5f76548898a77d67792888504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:08:33.621733 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-ae9f4890-ce97-442f-a020-1258c162b736 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] 10.222.0.13 "GET /compute/v2.1/servers/8bfb4e44-7a5f-466d-9f1e-bebee16d400c" status: 200 len: 1309 microversion: 2.1 time: 0.372097 Nov 01 19:08:33.625283 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1721/3507] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:08:33 2022] GET /compute/v2.1/servers/8bfb4e44-7a5f-466d-9f1e-bebee16d400c => generated 1309 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:08:33.673322 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-f92299ea-7f96-4765-a63f-592663bd3820 tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57ba6eeb99714c7cabb14f484968e269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a0c0985c7b9450a8b622b6761e5b5c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:08:33.683751 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-f92299ea-7f96-4765-a63f-592663bd3820 tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57ba6eeb99714c7cabb14f484968e269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a0c0985c7b9450a8b622b6761e5b5c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:08:33.686184 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-f92299ea-7f96-4765-a63f-592663bd3820 tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57ba6eeb99714c7cabb14f484968e269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a0c0985c7b9450a8b622b6761e5b5c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:08:33.687838 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-f92299ea-7f96-4765-a63f-592663bd3820 tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] 10.222.0.13 "GET /compute/v2.1/servers/77d6f571-5742-462c-ada0-1b05dd1561d1" status: 200 len: 1366 microversion: 2.47 time: 0.178419 Nov 01 19:08:33.694617 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1787/3508] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 19:08:33 2022] GET /compute/v2.1/servers/77d6f571-5742-462c-ada0-1b05dd1561d1 => generated 1366 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 19:08:33.808019 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-d98a1664-8bae-4681-847b-7a608ebf923b tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:08:33.809116 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-d98a1664-8bae-4681-847b-7a608ebf923b tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] [instance: 8485db2a-fd8f-4615-bbe0-14822ad44194] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:08:33.824923 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-d98a1664-8bae-4681-847b-7a608ebf923b tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:08:33.827058 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-d98a1664-8bae-4681-847b-7a608ebf923b tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:08:33.832416 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-d98a1664-8bae-4681-847b-7a608ebf923b tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:08:33.846640 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-d98a1664-8bae-4681-847b-7a608ebf923b tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:08:33.847415 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-d98a1664-8bae-4681-847b-7a608ebf923b tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:08:33.857335 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-d98a1664-8bae-4681-847b-7a608ebf923b tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:08:33.867985 n-d-863052-2 devstack@n-api.service[121402]: DEBUG dbcounter [-] [121402] Writing DB stats nova_cell1:SELECT=100 {{(pid=121402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 19:08:33.944842 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-c0a2baa7-cf41-4c4c-a193-ba390a6a4088 tempest-ImagesOneServerTestJSON-1044295602 tempest-ImagesOneServerTestJSON-1044295602-project] Calling method '.version_select at 0x7f0ae282a8b0>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:08:34.073762 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-c0a2baa7-cf41-4c4c-a193-ba390a6a4088 tempest-ImagesOneServerTestJSON-1044295602 tempest-ImagesOneServerTestJSON-1044295602-project] 10.222.0.13 "GET /compute/v2.1/images/5ef04aec-03ab-4186-8460-a6385af6c9f1" status: 200 len: 1428 microversion: 2.1 time: 0.134277 Nov 01 19:08:34.074358 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1788/3509] 10.222.0.13 () {58 vars in 1233 bytes} [Tue Nov 1 19:08:33 2022] GET /compute/v2.1/images/5ef04aec-03ab-4186-8460-a6385af6c9f1 => generated 1428 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 19:08:34.276137 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-d98a1664-8bae-4681-847b-7a608ebf923b tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '058480d92c9b4ab4af6815d0438a65c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee9dc49b89143f781e4ab30296e4d01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:08:34.298886 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-d98a1664-8bae-4681-847b-7a608ebf923b tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] 10.222.0.13 "GET /compute/v2.1/servers/8485db2a-fd8f-4615-bbe0-14822ad44194" status: 200 len: 1524 microversion: 2.1 time: 0.499611 Nov 01 19:08:34.299615 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1722/3510] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:08:33 2022] GET /compute/v2.1/servers/8485db2a-fd8f-4615-bbe0-14822ad44194 => generated 1524 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:08:34.651836 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-f242ce35-18e7-46ad-8c56-1443d029a18e tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:08:34.653393 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-f242ce35-18e7-46ad-8c56-1443d029a18e tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] [instance: 8bfb4e44-7a5f-466d-9f1e-bebee16d400c] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:08:34.664307 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f242ce35-18e7-46ad-8c56-1443d029a18e tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:08:34.665349 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f242ce35-18e7-46ad-8c56-1443d029a18e tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:08:34.666155 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f242ce35-18e7-46ad-8c56-1443d029a18e tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:08:34.668630 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f242ce35-18e7-46ad-8c56-1443d029a18e tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:08:34.669369 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f242ce35-18e7-46ad-8c56-1443d029a18e tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:08:34.670086 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f242ce35-18e7-46ad-8c56-1443d029a18e tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:08:34.723654 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-aefbab7b-2aec-43fa-827d-825dad56adbd tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:08:34.724345 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-aefbab7b-2aec-43fa-827d-825dad56adbd tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] [instance: 77d6f571-5742-462c-ada0-1b05dd1561d1] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:08:34.762761 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-aefbab7b-2aec-43fa-827d-825dad56adbd tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:08:34.764481 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-aefbab7b-2aec-43fa-827d-825dad56adbd tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.025s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:08:34.765922 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-aefbab7b-2aec-43fa-827d-825dad56adbd tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:08:34.767960 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-aefbab7b-2aec-43fa-827d-825dad56adbd tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:08:34.769662 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-aefbab7b-2aec-43fa-827d-825dad56adbd tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:08:34.771589 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-aefbab7b-2aec-43fa-827d-825dad56adbd tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:08:34.911032 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-aefbab7b-2aec-43fa-827d-825dad56adbd tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57ba6eeb99714c7cabb14f484968e269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a0c0985c7b9450a8b622b6761e5b5c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:08:34.926183 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-aefbab7b-2aec-43fa-827d-825dad56adbd tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57ba6eeb99714c7cabb14f484968e269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a0c0985c7b9450a8b622b6761e5b5c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:08:34.928203 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-aefbab7b-2aec-43fa-827d-825dad56adbd tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57ba6eeb99714c7cabb14f484968e269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a0c0985c7b9450a8b622b6761e5b5c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:08:34.930504 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-aefbab7b-2aec-43fa-827d-825dad56adbd tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] 10.222.0.13 "GET /compute/v2.1/servers/77d6f571-5742-462c-ada0-1b05dd1561d1" status: 200 len: 1366 microversion: 2.47 time: 0.211541 Nov 01 19:08:34.934971 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1723/3511] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 19:08:34 2022] GET /compute/v2.1/servers/77d6f571-5742-462c-ada0-1b05dd1561d1 => generated 1366 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 01 19:08:35.089372 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-a42a0110-3e1d-4fcf-a029-db23a8a3a77c tempest-ImagesOneServerTestJSON-1044295602 tempest-ImagesOneServerTestJSON-1044295602-project] Calling method '.version_select at 0x7f0ae17d6e50>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:08:35.285594 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-f242ce35-18e7-46ad-8c56-1443d029a18e tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113bd8c844ee490b86a68bc7e1e75da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '851785a5f76548898a77d67792888504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:08:35.308775 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-f242ce35-18e7-46ad-8c56-1443d029a18e tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] 10.222.0.13 "GET /compute/v2.1/servers/8bfb4e44-7a5f-466d-9f1e-bebee16d400c" status: 200 len: 1490 microversion: 2.1 time: 0.664142 Nov 01 19:08:35.310752 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1789/3512] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:08:34 2022] GET /compute/v2.1/servers/8bfb4e44-7a5f-466d-9f1e-bebee16d400c => generated 1490 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:08:35.330148 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-7bab7d77-3189-4475-8907-7f3ef5ff1f8d tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:08:35.330966 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-7bab7d77-3189-4475-8907-7f3ef5ff1f8d tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] [instance: 8485db2a-fd8f-4615-bbe0-14822ad44194] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:08:35.346424 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-7bab7d77-3189-4475-8907-7f3ef5ff1f8d tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:08:35.347112 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-7bab7d77-3189-4475-8907-7f3ef5ff1f8d tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:08:35.347727 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-7bab7d77-3189-4475-8907-7f3ef5ff1f8d tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:08:35.348641 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-7bab7d77-3189-4475-8907-7f3ef5ff1f8d tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:08:35.349259 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-7bab7d77-3189-4475-8907-7f3ef5ff1f8d tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:08:35.349846 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-7bab7d77-3189-4475-8907-7f3ef5ff1f8d tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:08:36.038324 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-7bab7d77-3189-4475-8907-7f3ef5ff1f8d tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '058480d92c9b4ab4af6815d0438a65c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee9dc49b89143f781e4ab30296e4d01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:08:36.051811 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-7bab7d77-3189-4475-8907-7f3ef5ff1f8d tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] 10.222.0.13 "GET /compute/v2.1/servers/8485db2a-fd8f-4615-bbe0-14822ad44194" status: 200 len: 1524 microversion: 2.1 time: 0.725687 Nov 01 19:08:36.052792 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1790/3513] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:08:35 2022] GET /compute/v2.1/servers/8485db2a-fd8f-4615-bbe0-14822ad44194 => generated 1524 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 19:08:36.063282 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-b20260cb-dbc3-4f2d-b5b0-8e2e9535e852 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:08:36.070541 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-b20260cb-dbc3-4f2d-b5b0-8e2e9535e852 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] [instance: 7c9dac18-3bfc-4379-ab97-25d185cd6b85] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:08:36.087496 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-b20260cb-dbc3-4f2d-b5b0-8e2e9535e852 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:08:36.088263 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-b20260cb-dbc3-4f2d-b5b0-8e2e9535e852 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:08:36.088916 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-b20260cb-dbc3-4f2d-b5b0-8e2e9535e852 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:08:36.091552 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-b20260cb-dbc3-4f2d-b5b0-8e2e9535e852 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:08:36.092178 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-b20260cb-dbc3-4f2d-b5b0-8e2e9535e852 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:08:36.093084 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-b20260cb-dbc3-4f2d-b5b0-8e2e9535e852 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:08:36.139819 n-d-863052-2 devstack@n-api.service[121403]: DEBUG dbcounter [-] [121403] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 19:08:36.459091 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-b20260cb-dbc3-4f2d-b5b0-8e2e9535e852 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113bd8c844ee490b86a68bc7e1e75da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '851785a5f76548898a77d67792888504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:08:36.476929 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-b20260cb-dbc3-4f2d-b5b0-8e2e9535e852 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] 10.222.0.13 "GET /compute/v2.1/servers/7c9dac18-3bfc-4379-ab97-25d185cd6b85" status: 200 len: 1490 microversion: 2.1 time: 0.421782 Nov 01 19:08:36.477540 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1791/3514] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:08:36 2022] GET /compute/v2.1/servers/7c9dac18-3bfc-4379-ab97-25d185cd6b85 => generated 1490 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:08:36.497782 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [req-d76aea6f-e864-49c9-a2c8-e3a3df006f96 req-86662f20-c1cf-4e0e-a6a6-ebe4cd97d3f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8485db2a-fd8f-4615-bbe0-14822ad44194", "name": "network-vif-plugged", "status": "completed", "tag": "01274861-72a7-4685-9ca3-9bdd9e739056"}]} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:08:36.522126 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-d76aea6f-e864-49c9-a2c8-e3a3df006f96 req-86662f20-c1cf-4e0e-a6a6-ebe4cd97d3f8 service nova] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:08:36.525322 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-d76aea6f-e864-49c9-a2c8-e3a3df006f96 req-86662f20-c1cf-4e0e-a6a6-ebe4cd97d3f8 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:08:36.528287 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-d76aea6f-e864-49c9-a2c8-e3a3df006f96 req-86662f20-c1cf-4e0e-a6a6-ebe4cd97d3f8 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:08:36.565136 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.compute.server_external_events [req-d76aea6f-e864-49c9-a2c8-e3a3df006f96 req-86662f20-c1cf-4e0e-a6a6-ebe4cd97d3f8 service nova] Creating event network-vif-plugged:01274861-72a7-4685-9ca3-9bdd9e739056 for instance 8485db2a-fd8f-4615-bbe0-14822ad44194 on n-h2-863052-2 Nov 01 19:08:36.580373 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [req-d76aea6f-e864-49c9-a2c8-e3a3df006f96 req-86662f20-c1cf-4e0e-a6a6-ebe4cd97d3f8 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097766 Nov 01 19:08:36.581405 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1792/3515] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Nov 1 19:08:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:08:36.591201 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-219429be-964f-4781-8ac7-feec29f3a707 tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:08:36.591903 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-219429be-964f-4781-8ac7-feec29f3a707 tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] [instance: 77d6f571-5742-462c-ada0-1b05dd1561d1] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:08:36.607274 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-219429be-964f-4781-8ac7-feec29f3a707 tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:08:36.607775 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-219429be-964f-4781-8ac7-feec29f3a707 tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:08:36.608210 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-219429be-964f-4781-8ac7-feec29f3a707 tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:08:36.609215 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-219429be-964f-4781-8ac7-feec29f3a707 tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:08:36.609673 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-219429be-964f-4781-8ac7-feec29f3a707 tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:08:36.610100 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-219429be-964f-4781-8ac7-feec29f3a707 tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:08:36.757463 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-219429be-964f-4781-8ac7-feec29f3a707 tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57ba6eeb99714c7cabb14f484968e269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a0c0985c7b9450a8b622b6761e5b5c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:08:36.776532 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-219429be-964f-4781-8ac7-feec29f3a707 tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57ba6eeb99714c7cabb14f484968e269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a0c0985c7b9450a8b622b6761e5b5c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:08:36.778018 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-219429be-964f-4781-8ac7-feec29f3a707 tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57ba6eeb99714c7cabb14f484968e269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a0c0985c7b9450a8b622b6761e5b5c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:08:36.786851 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-219429be-964f-4781-8ac7-feec29f3a707 tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] 10.222.0.13 "GET /compute/v2.1/servers/77d6f571-5742-462c-ada0-1b05dd1561d1" status: 200 len: 1366 microversion: 2.47 time: 0.201979 Nov 01 19:08:36.787683 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1793/3516] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 19:08:36 2022] GET /compute/v2.1/servers/77d6f571-5742-462c-ada0-1b05dd1561d1 => generated 1366 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 19:08:36.813733 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-72fec10c-1043-4766-992c-c412f83b02d9 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:08:36.815271 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-72fec10c-1043-4766-992c-c412f83b02d9 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] [instance: 8bfb4e44-7a5f-466d-9f1e-bebee16d400c] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:08:36.823784 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-72fec10c-1043-4766-992c-c412f83b02d9 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:08:36.825168 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-72fec10c-1043-4766-992c-c412f83b02d9 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:08:36.825902 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-72fec10c-1043-4766-992c-c412f83b02d9 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:08:36.826784 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-72fec10c-1043-4766-992c-c412f83b02d9 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:08:36.827439 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-72fec10c-1043-4766-992c-c412f83b02d9 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:08:36.828135 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-72fec10c-1043-4766-992c-c412f83b02d9 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:08:37.139504 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-72fec10c-1043-4766-992c-c412f83b02d9 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113bd8c844ee490b86a68bc7e1e75da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '851785a5f76548898a77d67792888504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:08:37.150025 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-72fec10c-1043-4766-992c-c412f83b02d9 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] 10.222.0.13 "GET /compute/v2.1/servers/8bfb4e44-7a5f-466d-9f1e-bebee16d400c" status: 200 len: 1490 microversion: 2.1 time: 0.344302 Nov 01 19:08:37.150820 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1794/3517] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:08:36 2022] GET /compute/v2.1/servers/8bfb4e44-7a5f-466d-9f1e-bebee16d400c => generated 1490 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:08:37.172523 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-d1453e77-d5e9-483b-a758-7037c28349e8 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:08:37.173235 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-d1453e77-d5e9-483b-a758-7037c28349e8 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] [instance: 8485db2a-fd8f-4615-bbe0-14822ad44194] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:08:37.181028 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d1453e77-d5e9-483b-a758-7037c28349e8 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:08:37.181523 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d1453e77-d5e9-483b-a758-7037c28349e8 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:08:37.181968 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d1453e77-d5e9-483b-a758-7037c28349e8 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:08:37.182677 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d1453e77-d5e9-483b-a758-7037c28349e8 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:08:37.183135 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d1453e77-d5e9-483b-a758-7037c28349e8 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:08:37.183655 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d1453e77-d5e9-483b-a758-7037c28349e8 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:08:37.480662 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-d1453e77-d5e9-483b-a758-7037c28349e8 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '058480d92c9b4ab4af6815d0438a65c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee9dc49b89143f781e4ab30296e4d01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:08:37.489830 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-d1453e77-d5e9-483b-a758-7037c28349e8 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] 10.222.0.13 "GET /compute/v2.1/servers/8485db2a-fd8f-4615-bbe0-14822ad44194" status: 200 len: 1524 microversion: 2.1 time: 0.322953 Nov 01 19:08:37.490810 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1795/3518] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:08:37 2022] GET /compute/v2.1/servers/8485db2a-fd8f-4615-bbe0-14822ad44194 => generated 1524 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:08:37.498021 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-da1d19a5-cf32-430d-8dd6-3a701663644e tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:08:37.499550 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-da1d19a5-cf32-430d-8dd6-3a701663644e tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] [instance: 8bfb4e44-7a5f-466d-9f1e-bebee16d400c] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:08:37.506139 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-da1d19a5-cf32-430d-8dd6-3a701663644e tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:08:37.506836 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-da1d19a5-cf32-430d-8dd6-3a701663644e tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:08:37.507982 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-da1d19a5-cf32-430d-8dd6-3a701663644e tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:08:37.508715 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-da1d19a5-cf32-430d-8dd6-3a701663644e tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:08:37.509176 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-da1d19a5-cf32-430d-8dd6-3a701663644e tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:08:37.509603 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-da1d19a5-cf32-430d-8dd6-3a701663644e tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:08:37.558958 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-da1d19a5-cf32-430d-8dd6-3a701663644e tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] [instance: 8bfb4e44-7a5f-466d-9f1e-bebee16d400c] Going to try to terminate instance {{(pid=121403) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 01 19:08:37.757143 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-da1d19a5-cf32-430d-8dd6-3a701663644e tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] 10.222.0.13 "DELETE /compute/v2.1/servers/8bfb4e44-7a5f-466d-9f1e-bebee16d400c" status: 204 len: 0 microversion: 2.1 time: 0.262506 Nov 01 19:08:37.759808 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1796/3519] 10.222.0.13 () {58 vars in 1239 bytes} [Tue Nov 1 19:08:37 2022] DELETE /compute/v2.1/servers/8bfb4e44-7a5f-466d-9f1e-bebee16d400c => generated 0 bytes in 268 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 01 19:08:37.777871 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-3bda6c03-f785-43f5-9bca-b4a299b6c87f tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:08:37.778996 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-3bda6c03-f785-43f5-9bca-b4a299b6c87f tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] [instance: 8bfb4e44-7a5f-466d-9f1e-bebee16d400c] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:08:37.805284 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-3bda6c03-f785-43f5-9bca-b4a299b6c87f tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:08:37.806053 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-3bda6c03-f785-43f5-9bca-b4a299b6c87f tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:08:37.806681 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-3bda6c03-f785-43f5-9bca-b4a299b6c87f tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:08:37.807699 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-3bda6c03-f785-43f5-9bca-b4a299b6c87f tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:08:37.808317 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-3bda6c03-f785-43f5-9bca-b4a299b6c87f tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:08:37.809170 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-3bda6c03-f785-43f5-9bca-b4a299b6c87f tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:08:38.221779 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-3bda6c03-f785-43f5-9bca-b4a299b6c87f tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113bd8c844ee490b86a68bc7e1e75da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '851785a5f76548898a77d67792888504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:08:38.236323 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-3bda6c03-f785-43f5-9bca-b4a299b6c87f tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] 10.222.0.13 "GET /compute/v2.1/servers/8bfb4e44-7a5f-466d-9f1e-bebee16d400c" status: 200 len: 1496 microversion: 2.1 time: 0.470519 Nov 01 19:08:38.240396 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1797/3520] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:08:37 2022] GET /compute/v2.1/servers/8bfb4e44-7a5f-466d-9f1e-bebee16d400c => generated 1496 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:08:38.247438 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-42bd16f5-2e6d-477f-8032-3d397eb5d9f2 tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:08:38.248046 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-42bd16f5-2e6d-477f-8032-3d397eb5d9f2 tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] [instance: 77d6f571-5742-462c-ada0-1b05dd1561d1] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:08:38.267569 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-42bd16f5-2e6d-477f-8032-3d397eb5d9f2 tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:08:38.268133 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-42bd16f5-2e6d-477f-8032-3d397eb5d9f2 tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:08:38.268595 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-42bd16f5-2e6d-477f-8032-3d397eb5d9f2 tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:08:38.274896 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-42bd16f5-2e6d-477f-8032-3d397eb5d9f2 tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:08:38.275469 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-42bd16f5-2e6d-477f-8032-3d397eb5d9f2 tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:08:38.278271 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-42bd16f5-2e6d-477f-8032-3d397eb5d9f2 tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:08:38.412089 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-42bd16f5-2e6d-477f-8032-3d397eb5d9f2 tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57ba6eeb99714c7cabb14f484968e269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a0c0985c7b9450a8b622b6761e5b5c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:08:38.424551 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-42bd16f5-2e6d-477f-8032-3d397eb5d9f2 tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57ba6eeb99714c7cabb14f484968e269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a0c0985c7b9450a8b622b6761e5b5c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:08:38.426024 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-42bd16f5-2e6d-477f-8032-3d397eb5d9f2 tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57ba6eeb99714c7cabb14f484968e269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a0c0985c7b9450a8b622b6761e5b5c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:08:38.427209 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-42bd16f5-2e6d-477f-8032-3d397eb5d9f2 tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] 10.222.0.13 "GET /compute/v2.1/servers/77d6f571-5742-462c-ada0-1b05dd1561d1" status: 200 len: 1366 microversion: 2.47 time: 0.185812 Nov 01 19:08:38.433380 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1798/3521] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 19:08:38 2022] GET /compute/v2.1/servers/77d6f571-5742-462c-ada0-1b05dd1561d1 => generated 1366 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 19:08:38.515972 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-22b24234-8bff-41b4-a137-7ee1bc665bbb tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:08:38.516864 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-22b24234-8bff-41b4-a137-7ee1bc665bbb tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] [instance: 8485db2a-fd8f-4615-bbe0-14822ad44194] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:08:38.524705 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-22b24234-8bff-41b4-a137-7ee1bc665bbb tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:08:38.525633 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-22b24234-8bff-41b4-a137-7ee1bc665bbb tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:08:38.527373 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-22b24234-8bff-41b4-a137-7ee1bc665bbb tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:08:38.528210 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-22b24234-8bff-41b4-a137-7ee1bc665bbb tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:08:38.528842 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-22b24234-8bff-41b4-a137-7ee1bc665bbb tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:08:38.533809 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-22b24234-8bff-41b4-a137-7ee1bc665bbb tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:08:38.829308 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-22b24234-8bff-41b4-a137-7ee1bc665bbb tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '058480d92c9b4ab4af6815d0438a65c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee9dc49b89143f781e4ab30296e4d01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:08:38.845332 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-22b24234-8bff-41b4-a137-7ee1bc665bbb tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] 10.222.0.13 "GET /compute/v2.1/servers/8485db2a-fd8f-4615-bbe0-14822ad44194" status: 200 len: 1524 microversion: 2.1 time: 0.333723 Nov 01 19:08:38.859085 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1799/3522] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:08:38 2022] GET /compute/v2.1/servers/8485db2a-fd8f-4615-bbe0-14822ad44194 => generated 1524 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 19:08:39.265003 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-175fcd62-1b72-4d2b-97ba-8fe0254ef7d6 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:08:39.265568 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-175fcd62-1b72-4d2b-97ba-8fe0254ef7d6 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] [instance: 8bfb4e44-7a5f-466d-9f1e-bebee16d400c] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:08:39.299028 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-175fcd62-1b72-4d2b-97ba-8fe0254ef7d6 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:08:39.299553 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-175fcd62-1b72-4d2b-97ba-8fe0254ef7d6 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:08:39.300030 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-175fcd62-1b72-4d2b-97ba-8fe0254ef7d6 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:08:39.300800 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-175fcd62-1b72-4d2b-97ba-8fe0254ef7d6 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:08:39.301270 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-175fcd62-1b72-4d2b-97ba-8fe0254ef7d6 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:08:39.301705 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-175fcd62-1b72-4d2b-97ba-8fe0254ef7d6 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:08:39.603439 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-175fcd62-1b72-4d2b-97ba-8fe0254ef7d6 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113bd8c844ee490b86a68bc7e1e75da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '851785a5f76548898a77d67792888504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:08:39.617495 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-175fcd62-1b72-4d2b-97ba-8fe0254ef7d6 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] 10.222.0.13 "GET /compute/v2.1/servers/8bfb4e44-7a5f-466d-9f1e-bebee16d400c" status: 200 len: 1496 microversion: 2.1 time: 0.357367 Nov 01 19:08:39.637530 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1800/3523] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:08:39 2022] GET /compute/v2.1/servers/8bfb4e44-7a5f-466d-9f1e-bebee16d400c => generated 1496 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:08:39.650042 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-e8bd5a52-1ec1-4bd8-8452-be25d455a086 tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:08:39.650684 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-e8bd5a52-1ec1-4bd8-8452-be25d455a086 tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] [instance: 77d6f571-5742-462c-ada0-1b05dd1561d1] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:08:39.665708 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-e8bd5a52-1ec1-4bd8-8452-be25d455a086 tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:08:39.666305 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-e8bd5a52-1ec1-4bd8-8452-be25d455a086 tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:08:39.666748 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-e8bd5a52-1ec1-4bd8-8452-be25d455a086 tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:08:39.668760 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-e8bd5a52-1ec1-4bd8-8452-be25d455a086 tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:08:39.669501 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-e8bd5a52-1ec1-4bd8-8452-be25d455a086 tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:08:39.669944 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-e8bd5a52-1ec1-4bd8-8452-be25d455a086 tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:08:39.791111 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-e8bd5a52-1ec1-4bd8-8452-be25d455a086 tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57ba6eeb99714c7cabb14f484968e269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a0c0985c7b9450a8b622b6761e5b5c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:08:39.808570 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-e8bd5a52-1ec1-4bd8-8452-be25d455a086 tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57ba6eeb99714c7cabb14f484968e269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a0c0985c7b9450a8b622b6761e5b5c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:08:39.821371 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-e8bd5a52-1ec1-4bd8-8452-be25d455a086 tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57ba6eeb99714c7cabb14f484968e269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a0c0985c7b9450a8b622b6761e5b5c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:08:39.824671 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-e8bd5a52-1ec1-4bd8-8452-be25d455a086 tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] 10.222.0.13 "GET /compute/v2.1/servers/77d6f571-5742-462c-ada0-1b05dd1561d1" status: 200 len: 1366 microversion: 2.47 time: 0.185939 Nov 01 19:08:39.826816 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1801/3524] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 19:08:39 2022] GET /compute/v2.1/servers/77d6f571-5742-462c-ada0-1b05dd1561d1 => generated 1366 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 19:08:39.874493 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-21d6d546-5791-4ea3-864b-1f190133573e tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:08:39.875104 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-21d6d546-5791-4ea3-864b-1f190133573e tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] [instance: 8485db2a-fd8f-4615-bbe0-14822ad44194] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:08:39.889712 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-21d6d546-5791-4ea3-864b-1f190133573e tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:08:39.890263 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-21d6d546-5791-4ea3-864b-1f190133573e tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:08:39.890716 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-21d6d546-5791-4ea3-864b-1f190133573e tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:08:39.891485 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-21d6d546-5791-4ea3-864b-1f190133573e tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:08:39.891940 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-21d6d546-5791-4ea3-864b-1f190133573e tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:08:39.892370 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-21d6d546-5791-4ea3-864b-1f190133573e tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:08:40.403229 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-21d6d546-5791-4ea3-864b-1f190133573e tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '058480d92c9b4ab4af6815d0438a65c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee9dc49b89143f781e4ab30296e4d01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:08:40.416432 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-21d6d546-5791-4ea3-864b-1f190133573e tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] 10.222.0.13 "GET /compute/v2.1/servers/8485db2a-fd8f-4615-bbe0-14822ad44194" status: 200 len: 1524 microversion: 2.1 time: 0.546005 Nov 01 19:08:40.428907 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1802/3525] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:08:39 2022] GET /compute/v2.1/servers/8485db2a-fd8f-4615-bbe0-14822ad44194 => generated 1524 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:08:40.441737 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [req-6c77fc96-68ad-4fed-8695-0c76fd693dc2 req-0c1e387e-e798-439c-a127-5fb8d42a2414 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8bfb4e44-7a5f-466d-9f1e-bebee16d400c", "name": "network-vif-deleted", "tag": "69625ce1-e061-4e19-b336-0c35e9ffbbd9"}]} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:08:40.475656 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-6c77fc96-68ad-4fed-8695-0c76fd693dc2 req-0c1e387e-e798-439c-a127-5fb8d42a2414 service nova] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:08:40.476687 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-6c77fc96-68ad-4fed-8695-0c76fd693dc2 req-0c1e387e-e798-439c-a127-5fb8d42a2414 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:08:40.477117 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-6c77fc96-68ad-4fed-8695-0c76fd693dc2 req-0c1e387e-e798-439c-a127-5fb8d42a2414 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:08:40.523739 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.compute.server_external_events [req-6c77fc96-68ad-4fed-8695-0c76fd693dc2 req-0c1e387e-e798-439c-a127-5fb8d42a2414 service nova] Creating event network-vif-deleted:69625ce1-e061-4e19-b336-0c35e9ffbbd9 for instance 8bfb4e44-7a5f-466d-9f1e-bebee16d400c on n-h2-863052-2 Nov 01 19:08:40.567744 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [req-6c77fc96-68ad-4fed-8695-0c76fd693dc2 req-0c1e387e-e798-439c-a127-5fb8d42a2414 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.143858 Nov 01 19:08:40.567744 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1803/3526] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Nov 1 19:08:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:08:40.654195 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-80be86c3-ea94-4eec-a344-0098d5967c74 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:08:40.654939 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-80be86c3-ea94-4eec-a344-0098d5967c74 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] [instance: 8bfb4e44-7a5f-466d-9f1e-bebee16d400c] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:08:40.672996 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-80be86c3-ea94-4eec-a344-0098d5967c74 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:08:40.683213 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-80be86c3-ea94-4eec-a344-0098d5967c74 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:08:40.683959 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-80be86c3-ea94-4eec-a344-0098d5967c74 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:08:40.685003 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-80be86c3-ea94-4eec-a344-0098d5967c74 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:08:40.685665 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-80be86c3-ea94-4eec-a344-0098d5967c74 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:08:40.687268 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-80be86c3-ea94-4eec-a344-0098d5967c74 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:08:40.843272 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-80be86c3-ea94-4eec-a344-0098d5967c74 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:08:40.848219 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-80be86c3-ea94-4eec-a344-0098d5967c74 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:08:40.850626 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-80be86c3-ea94-4eec-a344-0098d5967c74 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:08:40.851712 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.objects.instance [None req-80be86c3-ea94-4eec-a344-0098d5967c74 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lazy-loading 'fault' on Instance uuid 8bfb4e44-7a5f-466d-9f1e-bebee16d400c {{(pid=121403) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 01 19:08:40.959339 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-80be86c3-ea94-4eec-a344-0098d5967c74 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113bd8c844ee490b86a68bc7e1e75da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '851785a5f76548898a77d67792888504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:08:40.967888 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-80be86c3-ea94-4eec-a344-0098d5967c74 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] 10.222.0.13 "GET /compute/v2.1/servers/8bfb4e44-7a5f-466d-9f1e-bebee16d400c" status: 200 len: 1299 microversion: 2.1 time: 0.321144 Nov 01 19:08:40.990399 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1804/3527] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:08:40 2022] GET /compute/v2.1/servers/8bfb4e44-7a5f-466d-9f1e-bebee16d400c => generated 1299 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:08:40.998870 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-e7bc09a8-86d0-4636-a69f-61eb7fdb6a5d tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:08:40.999500 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-e7bc09a8-86d0-4636-a69f-61eb7fdb6a5d tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] [instance: 77d6f571-5742-462c-ada0-1b05dd1561d1] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:08:41.018114 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-e7bc09a8-86d0-4636-a69f-61eb7fdb6a5d tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:08:41.018629 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-e7bc09a8-86d0-4636-a69f-61eb7fdb6a5d tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:08:41.019077 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-e7bc09a8-86d0-4636-a69f-61eb7fdb6a5d tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:08:41.021737 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-e7bc09a8-86d0-4636-a69f-61eb7fdb6a5d tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:08:41.022145 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-e7bc09a8-86d0-4636-a69f-61eb7fdb6a5d tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:08:41.022628 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-e7bc09a8-86d0-4636-a69f-61eb7fdb6a5d tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:08:41.151938 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-e7bc09a8-86d0-4636-a69f-61eb7fdb6a5d tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57ba6eeb99714c7cabb14f484968e269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a0c0985c7b9450a8b622b6761e5b5c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:08:41.165305 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-e7bc09a8-86d0-4636-a69f-61eb7fdb6a5d tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57ba6eeb99714c7cabb14f484968e269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a0c0985c7b9450a8b622b6761e5b5c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:08:41.166779 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-e7bc09a8-86d0-4636-a69f-61eb7fdb6a5d tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57ba6eeb99714c7cabb14f484968e269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a0c0985c7b9450a8b622b6761e5b5c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:08:41.173345 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-e7bc09a8-86d0-4636-a69f-61eb7fdb6a5d tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] 10.222.0.13 "GET /compute/v2.1/servers/77d6f571-5742-462c-ada0-1b05dd1561d1" status: 200 len: 1366 microversion: 2.47 time: 0.179313 Nov 01 19:08:41.174134 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1805/3528] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 19:08:40 2022] GET /compute/v2.1/servers/77d6f571-5742-462c-ada0-1b05dd1561d1 => generated 1366 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 19:08:41.441515 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-3cc803e3-5443-4005-b4d0-589f3dc2ce4e tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:08:41.442131 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-3cc803e3-5443-4005-b4d0-589f3dc2ce4e tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] [instance: 8485db2a-fd8f-4615-bbe0-14822ad44194] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:08:41.497783 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-3cc803e3-5443-4005-b4d0-589f3dc2ce4e tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:08:41.504011 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-3cc803e3-5443-4005-b4d0-589f3dc2ce4e tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:08:41.505015 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-3cc803e3-5443-4005-b4d0-589f3dc2ce4e tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:08:41.506005 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-3cc803e3-5443-4005-b4d0-589f3dc2ce4e tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:08:41.506485 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-3cc803e3-5443-4005-b4d0-589f3dc2ce4e tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:08:41.508940 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-3cc803e3-5443-4005-b4d0-589f3dc2ce4e tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:08:42.208561 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-3cc803e3-5443-4005-b4d0-589f3dc2ce4e tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '058480d92c9b4ab4af6815d0438a65c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee9dc49b89143f781e4ab30296e4d01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:08:42.217220 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-3cc803e3-5443-4005-b4d0-589f3dc2ce4e tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] 10.222.0.13 "GET /compute/v2.1/servers/8485db2a-fd8f-4615-bbe0-14822ad44194" status: 200 len: 1524 microversion: 2.1 time: 0.779834 Nov 01 19:08:42.236560 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1806/3529] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:08:41 2022] GET /compute/v2.1/servers/8485db2a-fd8f-4615-bbe0-14822ad44194 => generated 1524 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:08:42.242403 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-c73220c0-6ddc-4343-a5b8-2cdacb5baa0c tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:08:42.245612 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-c73220c0-6ddc-4343-a5b8-2cdacb5baa0c tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] [instance: 8bfb4e44-7a5f-466d-9f1e-bebee16d400c] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:08:42.260827 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-c73220c0-6ddc-4343-a5b8-2cdacb5baa0c tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:08:42.263725 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-c73220c0-6ddc-4343-a5b8-2cdacb5baa0c tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:08:42.264182 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-c73220c0-6ddc-4343-a5b8-2cdacb5baa0c tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:08:42.264929 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-c73220c0-6ddc-4343-a5b8-2cdacb5baa0c tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:08:42.265388 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-c73220c0-6ddc-4343-a5b8-2cdacb5baa0c tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:08:42.265815 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-c73220c0-6ddc-4343-a5b8-2cdacb5baa0c tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:08:42.306520 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.wsgi [None req-c73220c0-6ddc-4343-a5b8-2cdacb5baa0c tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] HTTP exception thrown: Instance 8bfb4e44-7a5f-466d-9f1e-bebee16d400c could not be found. Nov 01 19:08:42.306520 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-c73220c0-6ddc-4343-a5b8-2cdacb5baa0c tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Request method failure captured: Nov 01 19:08:42.306520 n-d-863052-2 devstack@n-api.service[121403]: request: GET /compute/v2.1/servers/8bfb4e44-7a5f-466d-9f1e-bebee16d400c HTTP/1.1 Nov 01 19:08:42.306520 n-d-863052-2 devstack@n-api.service[121403]: Accept: application/json Nov 01 19:08:42.306520 n-d-863052-2 devstack@n-api.service[121403]: Accept-Encoding: identity Nov 01 19:08:42.306520 n-d-863052-2 devstack@n-api.service[121403]: Connection: close Nov 01 19:08:42.306520 n-d-863052-2 devstack@n-api.service[121403]: Content-Length: 0 Nov 01 19:08:42.306520 n-d-863052-2 devstack@n-api.service[121403]: Content-Type: application/json Nov 01 19:08:42.306520 n-d-863052-2 devstack@n-api.service[121403]: Host: 10.222.0.13 Nov 01 19:08:42.306520 n-d-863052-2 devstack@n-api.service[121403]: Openstack-System-Scope: None Nov 01 19:08:42.306520 n-d-863052-2 devstack@n-api.service[121403]: User-Agent: python-urllib3/1.26.12 Nov 01 19:08:42.306520 n-d-863052-2 devstack@n-api.service[121403]: X-Auth-Token: gAAAAABjYW4_RJI8gKBQs81ShXQrfTSIzrNvaZj2e2rGhpR5xhmtuxP4h5uZIl9SLPqPqJ9Syn39UO-el4mPnuEEOGnWtpNlTopD6-Pc1m-VWD64ggyrfBZwUB0hnjNvBvBk6ge071YBJx2gxTN_InEu4tuxz3s-3IQBbEpMSIJZ4VoUIbz4DgY Nov 01 19:08:42.306520 n-d-863052-2 devstack@n-api.service[121403]: X-Domain-Id: None Nov 01 19:08:42.306520 n-d-863052-2 devstack@n-api.service[121403]: X-Domain-Name: None Nov 01 19:08:42.306520 n-d-863052-2 devstack@n-api.service[121403]: X-Identity-Status: Confirmed Nov 01 19:08:42.306520 n-d-863052-2 devstack@n-api.service[121403]: X-Is-Admin-Project: True Nov 01 19:08:42.306520 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Domain-Id: default Nov 01 19:08:42.306520 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Domain-Name: Default Nov 01 19:08:42.306520 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Id: 851785a5f76548898a77d67792888504 Nov 01 19:08:42.306520 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Name: tempest-ServersTestJSON-917766486 Nov 01 19:08:42.306520 n-d-863052-2 devstack@n-api.service[121403]: X-Role: member,reader Nov 01 19:08:42.306520 n-d-863052-2 devstack@n-api.service[121403]: X-Roles: member,reader Nov 01 19:08:42.306520 n-d-863052-2 devstack@n-api.service[121403]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/851785a5f76548898a77d67792888504"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/851785a5f76548898a77d67792888504"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_851785a5f76548898a77d67792888504", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/851785a5f76548898a77d67792888504"}]}] Nov 01 19:08:42.306520 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant: tempest-ServersTestJSON-917766486 Nov 01 19:08:42.306520 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant-Id: 851785a5f76548898a77d67792888504 Nov 01 19:08:42.306520 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant-Name: tempest-ServersTestJSON-917766486 Nov 01 19:08:42.306520 n-d-863052-2 devstack@n-api.service[121403]: X-User: tempest-ServersTestJSON-917766486-project Nov 01 19:08:42.306520 n-d-863052-2 devstack@n-api.service[121403]: X-User-Domain-Id: default Nov 01 19:08:42.306520 n-d-863052-2 devstack@n-api.service[121403]: X-User-Domain-Name: Default Nov 01 19:08:42.306520 n-d-863052-2 devstack@n-api.service[121403]: X-User-Id: 113bd8c844ee490b86a68bc7e1e75da3 Nov 01 19:08:42.306520 n-d-863052-2 devstack@n-api.service[121403]: X-User-Name: tempest-ServersTestJSON-917766486-project Nov 01 19:08:42.306520 n-d-863052-2 devstack@n-api.service[121403]: method: > Nov 01 19:08:42.306520 n-d-863052-2 devstack@n-api.service[121403]: exception: Instance 8bfb4e44-7a5f-466d-9f1e-bebee16d400c could not be found. Nov 01 19:08:42.306520 n-d-863052-2 devstack@n-api.service[121403]: action_args: {'id': '8bfb4e44-7a5f-466d-9f1e-bebee16d400c'} Nov 01 19:08:42.306520 n-d-863052-2 devstack@n-api.service[121403]: {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 01 19:08:42.306520 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:08:42.306520 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 01 19:08:42.306520 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 01 19:08:42.306520 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 01 19:08:42.306520 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 01 19:08:42.306520 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 01 19:08:42.306520 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 01 19:08:42.306520 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 01 19:08:42.306520 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 01 19:08:42.306520 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8bfb4e44-7a5f-466d-9f1e-bebee16d400c could not be found. Nov 01 19:08:42.306520 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:08:42.306520 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:08:42.306520 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:08:42.306520 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:08:42.306520 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:08:42.306520 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:08:42.306520 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 01 19:08:42.306520 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 01 19:08:42.306520 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 01 19:08:42.306520 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 01 19:08:42.306520 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 01 19:08:42.306520 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 01 19:08:42.306520 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 01 19:08:42.306520 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 01 19:08:42.306520 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 01 19:08:42.306520 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 01 19:08:42.315159 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8bfb4e44-7a5f-466d-9f1e-bebee16d400c could not be found. Nov 01 19:08:42.315159 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:08:42.315159 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:08:42.315159 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:08:42.315159 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:08:42.315159 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:08:42.315159 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:08:42.315159 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 01 19:08:42.315159 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 01 19:08:42.315159 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8bfb4e44-7a5f-466d-9f1e-bebee16d400c could not be found. Nov 01 19:08:42.315159 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:08:42.315159 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-c73220c0-6ddc-4343-a5b8-2cdacb5baa0c tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Returning 404 to user: Instance 8bfb4e44-7a5f-466d-9f1e-bebee16d400c could not be found. {{(pid=121403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 01 19:08:42.315159 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-c73220c0-6ddc-4343-a5b8-2cdacb5baa0c tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] 10.222.0.13 "GET /compute/v2.1/servers/8bfb4e44-7a5f-466d-9f1e-bebee16d400c" status: 404 len: 111 microversion: 2.1 time: 0.067093 Nov 01 19:08:42.315159 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1807/3530] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:08:42 2022] GET /compute/v2.1/servers/8bfb4e44-7a5f-466d-9f1e-bebee16d400c => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 01 19:08:42.317518 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-e2575dba-3150-45a3-ac79-c5ac8e663c00 tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:08:42.318130 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-e2575dba-3150-45a3-ac79-c5ac8e663c00 tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] [instance: 77d6f571-5742-462c-ada0-1b05dd1561d1] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:08:42.332387 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-e2575dba-3150-45a3-ac79-c5ac8e663c00 tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:08:42.333195 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-e2575dba-3150-45a3-ac79-c5ac8e663c00 tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:08:42.333947 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-e2575dba-3150-45a3-ac79-c5ac8e663c00 tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:08:42.334683 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-e2575dba-3150-45a3-ac79-c5ac8e663c00 tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:08:42.335194 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-e2575dba-3150-45a3-ac79-c5ac8e663c00 tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:08:42.335630 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-e2575dba-3150-45a3-ac79-c5ac8e663c00 tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:08:42.342655 n-d-863052-2 devstack@n-api.service[121403]: DEBUG dbcounter [-] [121403] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 19:08:42.438574 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-e2575dba-3150-45a3-ac79-c5ac8e663c00 tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57ba6eeb99714c7cabb14f484968e269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a0c0985c7b9450a8b622b6761e5b5c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:08:42.455128 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-e2575dba-3150-45a3-ac79-c5ac8e663c00 tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57ba6eeb99714c7cabb14f484968e269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a0c0985c7b9450a8b622b6761e5b5c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:08:42.456904 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-e2575dba-3150-45a3-ac79-c5ac8e663c00 tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57ba6eeb99714c7cabb14f484968e269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a0c0985c7b9450a8b622b6761e5b5c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:08:42.458272 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-e2575dba-3150-45a3-ac79-c5ac8e663c00 tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] 10.222.0.13 "GET /compute/v2.1/servers/77d6f571-5742-462c-ada0-1b05dd1561d1" status: 200 len: 1366 microversion: 2.47 time: 0.147056 Nov 01 19:08:42.459017 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1808/3531] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 19:08:42 2022] GET /compute/v2.1/servers/77d6f571-5742-462c-ada0-1b05dd1561d1 => generated 1366 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 19:08:42.483375 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-3459522a-782c-4330-a1d8-52793e2b0ea6 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:08:42.484078 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-3459522a-782c-4330-a1d8-52793e2b0ea6 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] [instance: 7c9dac18-3bfc-4379-ab97-25d185cd6b85] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:08:42.490483 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-3459522a-782c-4330-a1d8-52793e2b0ea6 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:08:42.491211 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-3459522a-782c-4330-a1d8-52793e2b0ea6 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:08:42.492450 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-3459522a-782c-4330-a1d8-52793e2b0ea6 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:08:42.493349 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-3459522a-782c-4330-a1d8-52793e2b0ea6 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:08:42.493960 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-3459522a-782c-4330-a1d8-52793e2b0ea6 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:08:42.494541 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-3459522a-782c-4330-a1d8-52793e2b0ea6 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:08:42.523353 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-3459522a-782c-4330-a1d8-52793e2b0ea6 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] [instance: 7c9dac18-3bfc-4379-ab97-25d185cd6b85] Going to try to terminate instance {{(pid=121403) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 01 19:08:42.656388 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-3459522a-782c-4330-a1d8-52793e2b0ea6 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] 10.222.0.13 "DELETE /compute/v2.1/servers/7c9dac18-3bfc-4379-ab97-25d185cd6b85" status: 204 len: 0 microversion: 2.1 time: 0.179912 Nov 01 19:08:42.657391 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1809/3532] 10.222.0.13 () {58 vars in 1239 bytes} [Tue Nov 1 19:08:42 2022] DELETE /compute/v2.1/servers/7c9dac18-3bfc-4379-ab97-25d185cd6b85 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 01 19:08:42.668535 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-e231cda0-7417-4f52-a7d6-571a252da97c tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:08:42.669788 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-e231cda0-7417-4f52-a7d6-571a252da97c tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] [instance: 7c9dac18-3bfc-4379-ab97-25d185cd6b85] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:08:42.678479 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-e231cda0-7417-4f52-a7d6-571a252da97c tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:08:42.679257 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-e231cda0-7417-4f52-a7d6-571a252da97c tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:08:42.679854 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-e231cda0-7417-4f52-a7d6-571a252da97c tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:08:42.680792 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-e231cda0-7417-4f52-a7d6-571a252da97c tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:08:42.681559 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-e231cda0-7417-4f52-a7d6-571a252da97c tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:08:42.682196 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-e231cda0-7417-4f52-a7d6-571a252da97c tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:08:43.050583 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-e231cda0-7417-4f52-a7d6-571a252da97c tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113bd8c844ee490b86a68bc7e1e75da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '851785a5f76548898a77d67792888504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:08:43.074749 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-e231cda0-7417-4f52-a7d6-571a252da97c tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] 10.222.0.13 "GET /compute/v2.1/servers/7c9dac18-3bfc-4379-ab97-25d185cd6b85" status: 200 len: 1496 microversion: 2.1 time: 0.412614 Nov 01 19:08:43.075975 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1810/3533] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:08:42 2022] GET /compute/v2.1/servers/7c9dac18-3bfc-4379-ab97-25d185cd6b85 => generated 1496 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 19:08:43.239467 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-70643538-140b-4b61-b9f9-01d10e9d9a05 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:08:43.240153 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-70643538-140b-4b61-b9f9-01d10e9d9a05 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] [instance: 8485db2a-fd8f-4615-bbe0-14822ad44194] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:08:43.255067 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-70643538-140b-4b61-b9f9-01d10e9d9a05 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:08:43.255516 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-70643538-140b-4b61-b9f9-01d10e9d9a05 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:08:43.255903 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-70643538-140b-4b61-b9f9-01d10e9d9a05 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:08:43.256937 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-70643538-140b-4b61-b9f9-01d10e9d9a05 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:08:43.257563 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-70643538-140b-4b61-b9f9-01d10e9d9a05 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:08:43.261545 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-70643538-140b-4b61-b9f9-01d10e9d9a05 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:08:43.533946 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-70643538-140b-4b61-b9f9-01d10e9d9a05 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '058480d92c9b4ab4af6815d0438a65c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee9dc49b89143f781e4ab30296e4d01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:08:43.542929 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-70643538-140b-4b61-b9f9-01d10e9d9a05 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] 10.222.0.13 "GET /compute/v2.1/servers/8485db2a-fd8f-4615-bbe0-14822ad44194" status: 200 len: 1524 microversion: 2.1 time: 0.307259 Nov 01 19:08:43.559422 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1811/3534] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:08:43 2022] GET /compute/v2.1/servers/8485db2a-fd8f-4615-bbe0-14822ad44194 => generated 1524 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:08:43.565717 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-0193809f-ce17-40b1-874f-c2bb1905fad8 tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:08:43.566504 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-0193809f-ce17-40b1-874f-c2bb1905fad8 tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] [instance: 77d6f571-5742-462c-ada0-1b05dd1561d1] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:08:43.577908 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-0193809f-ce17-40b1-874f-c2bb1905fad8 tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:08:43.581807 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-0193809f-ce17-40b1-874f-c2bb1905fad8 tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:08:43.594574 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-0193809f-ce17-40b1-874f-c2bb1905fad8 tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:08:43.595556 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-0193809f-ce17-40b1-874f-c2bb1905fad8 tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:08:43.597999 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-0193809f-ce17-40b1-874f-c2bb1905fad8 tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:08:43.600116 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-0193809f-ce17-40b1-874f-c2bb1905fad8 tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:08:43.710915 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-0193809f-ce17-40b1-874f-c2bb1905fad8 tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57ba6eeb99714c7cabb14f484968e269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a0c0985c7b9450a8b622b6761e5b5c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:08:43.725455 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-0193809f-ce17-40b1-874f-c2bb1905fad8 tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57ba6eeb99714c7cabb14f484968e269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a0c0985c7b9450a8b622b6761e5b5c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:08:43.726883 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-0193809f-ce17-40b1-874f-c2bb1905fad8 tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57ba6eeb99714c7cabb14f484968e269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a0c0985c7b9450a8b622b6761e5b5c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:08:43.728070 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-0193809f-ce17-40b1-874f-c2bb1905fad8 tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] 10.222.0.13 "GET /compute/v2.1/servers/77d6f571-5742-462c-ada0-1b05dd1561d1" status: 200 len: 1366 microversion: 2.47 time: 0.167361 Nov 01 19:08:43.728646 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1812/3535] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 19:08:43 2022] GET /compute/v2.1/servers/77d6f571-5742-462c-ada0-1b05dd1561d1 => generated 1366 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 19:08:44.103258 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-cf5b3afb-4e19-428a-aac3-b9b7cdce7e15 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:08:44.104073 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-cf5b3afb-4e19-428a-aac3-b9b7cdce7e15 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] [instance: 7c9dac18-3bfc-4379-ab97-25d185cd6b85] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:08:44.111710 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-cf5b3afb-4e19-428a-aac3-b9b7cdce7e15 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:08:44.119031 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-cf5b3afb-4e19-428a-aac3-b9b7cdce7e15 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:08:44.119781 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-cf5b3afb-4e19-428a-aac3-b9b7cdce7e15 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:08:44.120868 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-cf5b3afb-4e19-428a-aac3-b9b7cdce7e15 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:08:44.121484 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-cf5b3afb-4e19-428a-aac3-b9b7cdce7e15 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:08:44.123089 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-cf5b3afb-4e19-428a-aac3-b9b7cdce7e15 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:08:44.692621 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-cf5b3afb-4e19-428a-aac3-b9b7cdce7e15 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113bd8c844ee490b86a68bc7e1e75da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '851785a5f76548898a77d67792888504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:08:44.701350 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-cf5b3afb-4e19-428a-aac3-b9b7cdce7e15 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] 10.222.0.13 "GET /compute/v2.1/servers/7c9dac18-3bfc-4379-ab97-25d185cd6b85" status: 200 len: 1496 microversion: 2.1 time: 0.602007 Nov 01 19:08:44.713718 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1813/3536] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:08:44 2022] GET /compute/v2.1/servers/7c9dac18-3bfc-4379-ab97-25d185cd6b85 => generated 1496 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:08:44.719015 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-e37af227-3ac6-4c24-b36f-f4ef13403111 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:08:44.719901 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-e37af227-3ac6-4c24-b36f-f4ef13403111 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] [instance: 8485db2a-fd8f-4615-bbe0-14822ad44194] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:08:44.739577 n-d-863052-2 devstack@n-api.service[121402]: DEBUG dbcounter [-] [121402] Writing DB stats nova_api:SELECT=52 {{(pid=121402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 19:08:44.767183 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-e37af227-3ac6-4c24-b36f-f4ef13403111 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:08:44.767927 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-e37af227-3ac6-4c24-b36f-f4ef13403111 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:08:44.768375 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-e37af227-3ac6-4c24-b36f-f4ef13403111 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:08:44.769136 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-e37af227-3ac6-4c24-b36f-f4ef13403111 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:08:44.769603 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-e37af227-3ac6-4c24-b36f-f4ef13403111 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:08:44.770060 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-e37af227-3ac6-4c24-b36f-f4ef13403111 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:08:44.919720 n-d-863052-2 devstack@n-api.service[121402]: DEBUG dbcounter [-] [121402] Writing DB stats nova_cell1:SELECT=10 {{(pid=121402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 19:08:45.136462 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-e37af227-3ac6-4c24-b36f-f4ef13403111 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '058480d92c9b4ab4af6815d0438a65c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee9dc49b89143f781e4ab30296e4d01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:08:45.146074 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-e37af227-3ac6-4c24-b36f-f4ef13403111 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] 10.222.0.13 "GET /compute/v2.1/servers/8485db2a-fd8f-4615-bbe0-14822ad44194" status: 200 len: 1524 microversion: 2.1 time: 0.430771 Nov 01 19:08:45.149273 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1814/3537] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:08:44 2022] GET /compute/v2.1/servers/8485db2a-fd8f-4615-bbe0-14822ad44194 => generated 1524 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:08:45.164431 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-cde075dc-0ae0-4ba1-8023-18addbb222ba tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:08:45.165350 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-cde075dc-0ae0-4ba1-8023-18addbb222ba tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] [instance: 77d6f571-5742-462c-ada0-1b05dd1561d1] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:08:45.171563 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-cde075dc-0ae0-4ba1-8023-18addbb222ba tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:08:45.172261 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-cde075dc-0ae0-4ba1-8023-18addbb222ba tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:08:45.180115 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-cde075dc-0ae0-4ba1-8023-18addbb222ba tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:08:45.180936 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-cde075dc-0ae0-4ba1-8023-18addbb222ba tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:08:45.181410 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-cde075dc-0ae0-4ba1-8023-18addbb222ba tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:08:45.181833 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-cde075dc-0ae0-4ba1-8023-18addbb222ba tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:08:45.328384 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-cde075dc-0ae0-4ba1-8023-18addbb222ba tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57ba6eeb99714c7cabb14f484968e269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a0c0985c7b9450a8b622b6761e5b5c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:08:45.352176 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-cde075dc-0ae0-4ba1-8023-18addbb222ba tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57ba6eeb99714c7cabb14f484968e269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a0c0985c7b9450a8b622b6761e5b5c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:08:45.358307 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-cde075dc-0ae0-4ba1-8023-18addbb222ba tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57ba6eeb99714c7cabb14f484968e269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a0c0985c7b9450a8b622b6761e5b5c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:08:45.361337 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-cde075dc-0ae0-4ba1-8023-18addbb222ba tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] 10.222.0.13 "GET /compute/v2.1/servers/77d6f571-5742-462c-ada0-1b05dd1561d1" status: 200 len: 1366 microversion: 2.47 time: 0.209142 Nov 01 19:08:45.361938 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1815/3538] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 19:08:45 2022] GET /compute/v2.1/servers/77d6f571-5742-462c-ada0-1b05dd1561d1 => generated 1366 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 19:08:45.740018 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-0217c282-a929-416d-986d-2ba8596e0df2 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:08:45.741758 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-0217c282-a929-416d-986d-2ba8596e0df2 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] [instance: 7c9dac18-3bfc-4379-ab97-25d185cd6b85] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:08:45.755975 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-0217c282-a929-416d-986d-2ba8596e0df2 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:08:45.757431 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-0217c282-a929-416d-986d-2ba8596e0df2 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:08:45.758190 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-0217c282-a929-416d-986d-2ba8596e0df2 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:08:45.759228 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-0217c282-a929-416d-986d-2ba8596e0df2 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:08:45.761131 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-0217c282-a929-416d-986d-2ba8596e0df2 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:08:45.762200 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-0217c282-a929-416d-986d-2ba8596e0df2 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:08:45.896077 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-0217c282-a929-416d-986d-2ba8596e0df2 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113bd8c844ee490b86a68bc7e1e75da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '851785a5f76548898a77d67792888504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:08:45.909389 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-0217c282-a929-416d-986d-2ba8596e0df2 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] 10.222.0.13 "GET /compute/v2.1/servers/7c9dac18-3bfc-4379-ab97-25d185cd6b85" status: 200 len: 1294 microversion: 2.1 time: 0.173470 Nov 01 19:08:45.910217 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1816/3539] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:08:45 2022] GET /compute/v2.1/servers/7c9dac18-3bfc-4379-ab97-25d185cd6b85 => generated 1294 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:08:45.935140 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [req-5e229866-b464-4a64-a98b-1addb74bf451 req-0b40aff3-583d-4dae-b488-38b9b36d4f9c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c9dac18-3bfc-4379-ab97-25d185cd6b85", "name": "network-vif-deleted", "tag": "db3ec26a-e23c-42e4-acbb-72a089522cfa"}]} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:08:45.967802 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-5e229866-b464-4a64-a98b-1addb74bf451 req-0b40aff3-583d-4dae-b488-38b9b36d4f9c service nova] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:08:45.968302 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-5e229866-b464-4a64-a98b-1addb74bf451 req-0b40aff3-583d-4dae-b488-38b9b36d4f9c service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:08:45.968777 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-5e229866-b464-4a64-a98b-1addb74bf451 req-0b40aff3-583d-4dae-b488-38b9b36d4f9c service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:08:46.006204 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.compute.server_external_events [req-5e229866-b464-4a64-a98b-1addb74bf451 req-0b40aff3-583d-4dae-b488-38b9b36d4f9c service nova] Creating event network-vif-deleted:db3ec26a-e23c-42e4-acbb-72a089522cfa for instance 7c9dac18-3bfc-4379-ab97-25d185cd6b85 on n-h1-863052-2 Nov 01 19:08:46.016043 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [req-5e229866-b464-4a64-a98b-1addb74bf451 req-0b40aff3-583d-4dae-b488-38b9b36d4f9c service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104253 Nov 01 19:08:46.021048 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1817/3540] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Nov 1 19:08:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:08:46.173244 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-c119523f-f918-4fed-a11b-e76c7ae0deeb tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:08:46.182925 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-c119523f-f918-4fed-a11b-e76c7ae0deeb tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] [instance: 8485db2a-fd8f-4615-bbe0-14822ad44194] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:08:46.197047 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-c119523f-f918-4fed-a11b-e76c7ae0deeb tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:08:46.197047 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-c119523f-f918-4fed-a11b-e76c7ae0deeb tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:08:46.208349 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-c119523f-f918-4fed-a11b-e76c7ae0deeb tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:08:46.209550 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-c119523f-f918-4fed-a11b-e76c7ae0deeb tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:08:46.212980 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-c119523f-f918-4fed-a11b-e76c7ae0deeb tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:08:46.214330 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-c119523f-f918-4fed-a11b-e76c7ae0deeb tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:08:46.584766 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-c119523f-f918-4fed-a11b-e76c7ae0deeb tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '058480d92c9b4ab4af6815d0438a65c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee9dc49b89143f781e4ab30296e4d01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:08:46.593707 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-c119523f-f918-4fed-a11b-e76c7ae0deeb tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] 10.222.0.13 "GET /compute/v2.1/servers/8485db2a-fd8f-4615-bbe0-14822ad44194" status: 200 len: 1524 microversion: 2.1 time: 0.425960 Nov 01 19:08:46.609394 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1818/3541] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:08:46 2022] GET /compute/v2.1/servers/8485db2a-fd8f-4615-bbe0-14822ad44194 => generated 1524 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 19:08:46.615443 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-79f21f07-b6be-4ac9-9309-d3ceb7df489b tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:08:46.616398 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-79f21f07-b6be-4ac9-9309-d3ceb7df489b tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] [instance: 77d6f571-5742-462c-ada0-1b05dd1561d1] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:08:46.624777 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-79f21f07-b6be-4ac9-9309-d3ceb7df489b tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:08:46.625664 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-79f21f07-b6be-4ac9-9309-d3ceb7df489b tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:08:46.626337 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-79f21f07-b6be-4ac9-9309-d3ceb7df489b tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:08:46.627276 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-79f21f07-b6be-4ac9-9309-d3ceb7df489b tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:08:46.627956 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-79f21f07-b6be-4ac9-9309-d3ceb7df489b tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:08:46.628634 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-79f21f07-b6be-4ac9-9309-d3ceb7df489b tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:08:46.712293 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-79f21f07-b6be-4ac9-9309-d3ceb7df489b tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57ba6eeb99714c7cabb14f484968e269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a0c0985c7b9450a8b622b6761e5b5c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:08:46.722375 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-79f21f07-b6be-4ac9-9309-d3ceb7df489b tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57ba6eeb99714c7cabb14f484968e269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a0c0985c7b9450a8b622b6761e5b5c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:08:46.725002 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-79f21f07-b6be-4ac9-9309-d3ceb7df489b tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57ba6eeb99714c7cabb14f484968e269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a0c0985c7b9450a8b622b6761e5b5c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:08:46.726632 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-79f21f07-b6be-4ac9-9309-d3ceb7df489b tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] 10.222.0.13 "GET /compute/v2.1/servers/77d6f571-5742-462c-ada0-1b05dd1561d1" status: 200 len: 1366 microversion: 2.47 time: 0.115930 Nov 01 19:08:46.727453 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1819/3542] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 19:08:46 2022] GET /compute/v2.1/servers/77d6f571-5742-462c-ada0-1b05dd1561d1 => generated 1366 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 19:08:46.945079 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-f7248de3-156f-4dff-bc56-b9d82cf62230 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:08:46.947369 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-f7248de3-156f-4dff-bc56-b9d82cf62230 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] [instance: 7c9dac18-3bfc-4379-ab97-25d185cd6b85] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:08:46.962197 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f7248de3-156f-4dff-bc56-b9d82cf62230 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:08:46.963224 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f7248de3-156f-4dff-bc56-b9d82cf62230 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:08:46.965997 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f7248de3-156f-4dff-bc56-b9d82cf62230 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:08:46.968806 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f7248de3-156f-4dff-bc56-b9d82cf62230 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:08:46.968806 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f7248de3-156f-4dff-bc56-b9d82cf62230 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:08:46.970450 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f7248de3-156f-4dff-bc56-b9d82cf62230 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:08:46.997711 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.wsgi [None req-f7248de3-156f-4dff-bc56-b9d82cf62230 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] HTTP exception thrown: Instance 7c9dac18-3bfc-4379-ab97-25d185cd6b85 could not be found. Nov 01 19:08:46.999861 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-f7248de3-156f-4dff-bc56-b9d82cf62230 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Request method failure captured: Nov 01 19:08:46.999861 n-d-863052-2 devstack@n-api.service[121403]: request: GET /compute/v2.1/servers/7c9dac18-3bfc-4379-ab97-25d185cd6b85 HTTP/1.1 Nov 01 19:08:46.999861 n-d-863052-2 devstack@n-api.service[121403]: Accept: application/json Nov 01 19:08:46.999861 n-d-863052-2 devstack@n-api.service[121403]: Accept-Encoding: identity Nov 01 19:08:46.999861 n-d-863052-2 devstack@n-api.service[121403]: Connection: close Nov 01 19:08:46.999861 n-d-863052-2 devstack@n-api.service[121403]: Content-Length: 0 Nov 01 19:08:46.999861 n-d-863052-2 devstack@n-api.service[121403]: Content-Type: application/json Nov 01 19:08:46.999861 n-d-863052-2 devstack@n-api.service[121403]: Host: 10.222.0.13 Nov 01 19:08:46.999861 n-d-863052-2 devstack@n-api.service[121403]: Openstack-System-Scope: None Nov 01 19:08:46.999861 n-d-863052-2 devstack@n-api.service[121403]: User-Agent: python-urllib3/1.26.12 Nov 01 19:08:46.999861 n-d-863052-2 devstack@n-api.service[121403]: X-Auth-Token: gAAAAABjYW4_RJI8gKBQs81ShXQrfTSIzrNvaZj2e2rGhpR5xhmtuxP4h5uZIl9SLPqPqJ9Syn39UO-el4mPnuEEOGnWtpNlTopD6-Pc1m-VWD64ggyrfBZwUB0hnjNvBvBk6ge071YBJx2gxTN_InEu4tuxz3s-3IQBbEpMSIJZ4VoUIbz4DgY Nov 01 19:08:46.999861 n-d-863052-2 devstack@n-api.service[121403]: X-Domain-Id: None Nov 01 19:08:46.999861 n-d-863052-2 devstack@n-api.service[121403]: X-Domain-Name: None Nov 01 19:08:46.999861 n-d-863052-2 devstack@n-api.service[121403]: X-Identity-Status: Confirmed Nov 01 19:08:46.999861 n-d-863052-2 devstack@n-api.service[121403]: X-Is-Admin-Project: True Nov 01 19:08:46.999861 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Domain-Id: default Nov 01 19:08:46.999861 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Domain-Name: Default Nov 01 19:08:46.999861 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Id: 851785a5f76548898a77d67792888504 Nov 01 19:08:46.999861 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Name: tempest-ServersTestJSON-917766486 Nov 01 19:08:46.999861 n-d-863052-2 devstack@n-api.service[121403]: X-Role: member,reader Nov 01 19:08:46.999861 n-d-863052-2 devstack@n-api.service[121403]: X-Roles: member,reader Nov 01 19:08:46.999861 n-d-863052-2 devstack@n-api.service[121403]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/851785a5f76548898a77d67792888504"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/851785a5f76548898a77d67792888504"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_851785a5f76548898a77d67792888504", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/851785a5f76548898a77d67792888504"}]}] Nov 01 19:08:46.999861 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant: tempest-ServersTestJSON-917766486 Nov 01 19:08:46.999861 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant-Id: 851785a5f76548898a77d67792888504 Nov 01 19:08:46.999861 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant-Name: tempest-ServersTestJSON-917766486 Nov 01 19:08:46.999861 n-d-863052-2 devstack@n-api.service[121403]: X-User: tempest-ServersTestJSON-917766486-project Nov 01 19:08:46.999861 n-d-863052-2 devstack@n-api.service[121403]: X-User-Domain-Id: default Nov 01 19:08:46.999861 n-d-863052-2 devstack@n-api.service[121403]: X-User-Domain-Name: Default Nov 01 19:08:46.999861 n-d-863052-2 devstack@n-api.service[121403]: X-User-Id: 113bd8c844ee490b86a68bc7e1e75da3 Nov 01 19:08:46.999861 n-d-863052-2 devstack@n-api.service[121403]: X-User-Name: tempest-ServersTestJSON-917766486-project Nov 01 19:08:46.999861 n-d-863052-2 devstack@n-api.service[121403]: method: > Nov 01 19:08:46.999861 n-d-863052-2 devstack@n-api.service[121403]: exception: Instance 7c9dac18-3bfc-4379-ab97-25d185cd6b85 could not be found. Nov 01 19:08:46.999861 n-d-863052-2 devstack@n-api.service[121403]: action_args: {'id': '7c9dac18-3bfc-4379-ab97-25d185cd6b85'} Nov 01 19:08:46.999861 n-d-863052-2 devstack@n-api.service[121403]: {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 01 19:08:46.999861 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:08:46.999861 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 01 19:08:46.999861 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 01 19:08:46.999861 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 01 19:08:46.999861 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 01 19:08:46.999861 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 01 19:08:46.999861 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 01 19:08:46.999861 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 01 19:08:46.999861 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 01 19:08:46.999861 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7c9dac18-3bfc-4379-ab97-25d185cd6b85 could not be found. Nov 01 19:08:46.999861 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:08:46.999861 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:08:46.999861 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:08:46.999861 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:08:46.999861 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:08:46.999861 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:08:46.999861 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 01 19:08:46.999861 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 01 19:08:46.999861 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 01 19:08:46.999861 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 01 19:08:46.999861 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 01 19:08:46.999861 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 01 19:08:46.999861 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 01 19:08:46.999861 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 01 19:08:46.999861 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 01 19:08:46.999861 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 01 19:08:46.999861 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7c9dac18-3bfc-4379-ab97-25d185cd6b85 could not be found. Nov 01 19:08:46.999861 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:08:46.999861 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:08:46.999861 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:08:46.999861 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:08:47.008742 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:08:47.008742 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:08:47.008742 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 01 19:08:47.008742 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 01 19:08:47.008742 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7c9dac18-3bfc-4379-ab97-25d185cd6b85 could not be found. Nov 01 19:08:47.008742 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:08:47.011113 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-f7248de3-156f-4dff-bc56-b9d82cf62230 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Returning 404 to user: Instance 7c9dac18-3bfc-4379-ab97-25d185cd6b85 could not be found. {{(pid=121403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 01 19:08:47.012379 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-f7248de3-156f-4dff-bc56-b9d82cf62230 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] 10.222.0.13 "GET /compute/v2.1/servers/7c9dac18-3bfc-4379-ab97-25d185cd6b85" status: 404 len: 111 microversion: 2.1 time: 0.078459 Nov 01 19:08:47.013640 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1820/3543] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:08:46 2022] GET /compute/v2.1/servers/7c9dac18-3bfc-4379-ab97-25d185cd6b85 => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 01 19:08:47.197132 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-d9ee023f-c323-4563-a97f-2d2b99de17c0 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-867258280", "imageRef": "2d4a0047-1b9e-445f-8af8-1b5c9d93e881", "flavorRef": "452", "networks": [{"uuid": "346d9303-d6bc-4555-85be-95ee31a2d9cd"}]}} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:08:47.867847 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-a42a0110-3e1d-4fcf-a029-db23a8a3a77c tempest-ImagesOneServerTestJSON-1044295602 tempest-ImagesOneServerTestJSON-1044295602-project] 10.222.0.13 "GET /compute/v2.1/images/5ef04aec-03ab-4186-8460-a6385af6c9f1" status: 200 len: 1437 microversion: 2.1 time: 12.782298 Nov 01 19:08:47.878131 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1724/3544] 10.222.0.13 () {58 vars in 1233 bytes} [Tue Nov 1 19:08:35 2022] GET /compute/v2.1/images/5ef04aec-03ab-4186-8460-a6385af6c9f1 => generated 1437 bytes in 12793 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:08:47.884713 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-3bbd0515-d9ca-4c31-91af-080868a8fa54 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:08:47.885807 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-3bbd0515-d9ca-4c31-91af-080868a8fa54 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] [instance: 8485db2a-fd8f-4615-bbe0-14822ad44194] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:08:47.895229 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.network.neutron [None req-d9ee023f-c323-4563-a97f-2d2b99de17c0 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] validate_networks() for [('346d9303-d6bc-4555-85be-95ee31a2d9cd', None, None, None, None, None)] {{(pid=121403) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 01 19:08:47.939669 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-3bbd0515-d9ca-4c31-91af-080868a8fa54 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:08:47.947285 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-3bbd0515-d9ca-4c31-91af-080868a8fa54 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:08:47.948197 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-3bbd0515-d9ca-4c31-91af-080868a8fa54 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:08:47.948766 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-3bbd0515-d9ca-4c31-91af-080868a8fa54 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:08:47.950522 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-3bbd0515-d9ca-4c31-91af-080868a8fa54 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:08:47.951201 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-3bbd0515-d9ca-4c31-91af-080868a8fa54 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:08:48.131488 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-3bbd0515-d9ca-4c31-91af-080868a8fa54 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '058480d92c9b4ab4af6815d0438a65c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee9dc49b89143f781e4ab30296e4d01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:08:48.142360 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-3bbd0515-d9ca-4c31-91af-080868a8fa54 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] 10.222.0.13 "GET /compute/v2.1/servers/8485db2a-fd8f-4615-bbe0-14822ad44194" status: 200 len: 1524 microversion: 2.1 time: 0.262331 Nov 01 19:08:48.147923 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1725/3545] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:08:47 2022] GET /compute/v2.1/servers/8485db2a-fd8f-4615-bbe0-14822ad44194 => generated 1524 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:08:48.167174 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-53953644-1b5d-48a1-9b82-cce2ee2436bf tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:08:48.167798 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-53953644-1b5d-48a1-9b82-cce2ee2436bf tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] [instance: 77d6f571-5742-462c-ada0-1b05dd1561d1] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:08:48.177280 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-53953644-1b5d-48a1-9b82-cce2ee2436bf tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:08:48.178163 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-53953644-1b5d-48a1-9b82-cce2ee2436bf tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:08:48.178812 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-53953644-1b5d-48a1-9b82-cce2ee2436bf tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:08:48.179694 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-53953644-1b5d-48a1-9b82-cce2ee2436bf tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:08:48.180316 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-53953644-1b5d-48a1-9b82-cce2ee2436bf tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:08:48.180932 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-53953644-1b5d-48a1-9b82-cce2ee2436bf tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:08:48.262955 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-53953644-1b5d-48a1-9b82-cce2ee2436bf tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57ba6eeb99714c7cabb14f484968e269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a0c0985c7b9450a8b622b6761e5b5c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:08:48.273585 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-53953644-1b5d-48a1-9b82-cce2ee2436bf tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57ba6eeb99714c7cabb14f484968e269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a0c0985c7b9450a8b622b6761e5b5c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:08:48.275035 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-53953644-1b5d-48a1-9b82-cce2ee2436bf tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57ba6eeb99714c7cabb14f484968e269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a0c0985c7b9450a8b622b6761e5b5c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:08:48.284116 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-53953644-1b5d-48a1-9b82-cce2ee2436bf tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] 10.222.0.13 "GET /compute/v2.1/servers/77d6f571-5742-462c-ada0-1b05dd1561d1" status: 200 len: 1366 microversion: 2.47 time: 0.126367 Nov 01 19:08:48.304769 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1726/3546] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 19:08:48 2022] GET /compute/v2.1/servers/77d6f571-5742-462c-ada0-1b05dd1561d1 => generated 1366 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 19:08:48.312173 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-ca18a75c-3026-47d1-99bf-6ce5dc3674ee tempest-ImagesOneServerTestJSON-1044295602 tempest-ImagesOneServerTestJSON-1044295602-project] Calling method '.version_select at 0x7f0ae180a700>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:08:48.370630 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-ca18a75c-3026-47d1-99bf-6ce5dc3674ee tempest-ImagesOneServerTestJSON-1044295602 tempest-ImagesOneServerTestJSON-1044295602-project] 10.222.0.13 "GET /compute/v2.1/images/5ef04aec-03ab-4186-8460-a6385af6c9f1" status: 200 len: 1437 microversion: 2.1 time: 0.063900 Nov 01 19:08:48.371533 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1727/3547] 10.222.0.13 () {58 vars in 1233 bytes} [Tue Nov 1 19:08:48 2022] GET /compute/v2.1/images/5ef04aec-03ab-4186-8460-a6385af6c9f1 => generated 1437 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:08:48.385821 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-f04405fa-3624-420a-8d84-d1e6432f5d9f tempest-ImagesOneServerTestJSON-1044295602 tempest-ImagesOneServerTestJSON-1044295602-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:08:48.386842 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-f04405fa-3624-420a-8d84-d1e6432f5d9f tempest-ImagesOneServerTestJSON-1044295602 tempest-ImagesOneServerTestJSON-1044295602-project] [instance: 31f51cbd-b29a-46be-bca0-f27c2b287e15] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:08:48.393112 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f04405fa-3624-420a-8d84-d1e6432f5d9f tempest-ImagesOneServerTestJSON-1044295602 tempest-ImagesOneServerTestJSON-1044295602-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:08:48.393890 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f04405fa-3624-420a-8d84-d1e6432f5d9f tempest-ImagesOneServerTestJSON-1044295602 tempest-ImagesOneServerTestJSON-1044295602-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:08:48.394556 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f04405fa-3624-420a-8d84-d1e6432f5d9f tempest-ImagesOneServerTestJSON-1044295602 tempest-ImagesOneServerTestJSON-1044295602-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:08:48.395467 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f04405fa-3624-420a-8d84-d1e6432f5d9f tempest-ImagesOneServerTestJSON-1044295602 tempest-ImagesOneServerTestJSON-1044295602-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:08:48.396133 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f04405fa-3624-420a-8d84-d1e6432f5d9f tempest-ImagesOneServerTestJSON-1044295602 tempest-ImagesOneServerTestJSON-1044295602-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:08:48.396808 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f04405fa-3624-420a-8d84-d1e6432f5d9f tempest-ImagesOneServerTestJSON-1044295602 tempest-ImagesOneServerTestJSON-1044295602-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:08:48.469297 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.virt.hardware [None req-d9ee023f-c323-4563-a97f-2d2b99de17c0 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Flavor limits 0:0:0 {{(pid=121403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 01 19:08:48.469815 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.virt.hardware [None req-d9ee023f-c323-4563-a97f-2d2b99de17c0 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Image limits 0:0:0 {{(pid=121403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 01 19:08:48.470589 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.virt.hardware [None req-d9ee023f-c323-4563-a97f-2d2b99de17c0 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Flavor pref 0:0:0 {{(pid=121403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 01 19:08:48.471003 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.virt.hardware [None req-d9ee023f-c323-4563-a97f-2d2b99de17c0 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Image pref 0:0:0 {{(pid=121403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 01 19:08:48.471415 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.virt.hardware [None req-d9ee023f-c323-4563-a97f-2d2b99de17c0 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 01 19:08:48.484174 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d9ee023f-c323-4563-a97f-2d2b99de17c0 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:08:48.484714 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d9ee023f-c323-4563-a97f-2d2b99de17c0 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:08:48.485172 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d9ee023f-c323-4563-a97f-2d2b99de17c0 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:08:48.486014 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d9ee023f-c323-4563-a97f-2d2b99de17c0 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:08:48.486490 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d9ee023f-c323-4563-a97f-2d2b99de17c0 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:08:48.486926 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d9ee023f-c323-4563-a97f-2d2b99de17c0 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:08:48.525694 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.quota [None req-d9ee023f-c323-4563-a97f-2d2b99de17c0 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Getting quotas for project 851785a5f76548898a77d67792888504. Resources: {'cores', 'ram', 'instances'} {{(pid=121403) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 01 19:08:48.533364 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.quota [None req-d9ee023f-c323-4563-a97f-2d2b99de17c0 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Getting quotas for user 113bd8c844ee490b86a68bc7e1e75da3 and project 851785a5f76548898a77d67792888504. Resources: {'cores', 'ram', 'instances'} {{(pid=121403) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 01 19:08:48.549772 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-d9ee023f-c323-4563-a97f-2d2b99de17c0 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Going to run 1 instances... {{(pid=121403) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 01 19:08:48.552384 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-d9ee023f-c323-4563-a97f-2d2b99de17c0 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] [instance: 34597ed3-08c9-4c33-b47a-56a9ad5ff70c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2d4a0047-1b9e-445f-8af8-1b5c9d93e881',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121403) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 01 19:08:48.611939 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-f04405fa-3624-420a-8d84-d1e6432f5d9f tempest-ImagesOneServerTestJSON-1044295602 tempest-ImagesOneServerTestJSON-1044295602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6fd718964648e4bc83ed37cbaa9b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c548420d1df4403c9129cce5f040d45b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:08:48.623538 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-f04405fa-3624-420a-8d84-d1e6432f5d9f tempest-ImagesOneServerTestJSON-1044295602 tempest-ImagesOneServerTestJSON-1044295602-project] 10.222.0.13 "GET /compute/v2.1/servers/31f51cbd-b29a-46be-bca0-f27c2b287e15" status: 200 len: 1466 microversion: 2.1 time: 0.242232 Nov 01 19:08:48.624127 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1728/3548] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:08:48 2022] GET /compute/v2.1/servers/31f51cbd-b29a-46be-bca0-f27c2b287e15 => generated 1466 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:08:48.636858 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-d9ee023f-c323-4563-a97f-2d2b99de17c0 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.439998 Nov 01 19:08:48.641015 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1821/3549] 10.222.0.13 () {60 vars in 1147 bytes} [Tue Nov 1 19:08:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 1449 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 01 19:08:48.654225 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-57f5ce2a-ab7e-4e05-8dee-d008fdca9386 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:08:48.655194 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-57f5ce2a-ab7e-4e05-8dee-d008fdca9386 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] [instance: 34597ed3-08c9-4c33-b47a-56a9ad5ff70c] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:08:48.666456 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-fca61604-3d67-48de-97e9-085c90fbf6b6 tempest-ImagesOneServerTestJSON-1044295602 tempest-ImagesOneServerTestJSON-1044295602-project] Calling method '.version_select at 0x7f0ae67ff1f0>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:08:48.738956 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-57f5ce2a-ab7e-4e05-8dee-d008fdca9386 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113bd8c844ee490b86a68bc7e1e75da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '851785a5f76548898a77d67792888504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:08:48.753618 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-57f5ce2a-ab7e-4e05-8dee-d008fdca9386 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] 10.222.0.13 "GET /compute/v2.1/servers/34597ed3-08c9-4c33-b47a-56a9ad5ff70c" status: 200 len: 1208 microversion: 2.1 time: 0.106120 Nov 01 19:08:48.760139 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1729/3550] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:08:48 2022] GET /compute/v2.1/servers/34597ed3-08c9-4c33-b47a-56a9ad5ff70c => generated 1208 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:08:49.172036 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-476ca372-a580-41ac-aaf1-f1d367c9936e tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:08:49.173323 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-476ca372-a580-41ac-aaf1-f1d367c9936e tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] [instance: 8485db2a-fd8f-4615-bbe0-14822ad44194] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:08:49.183833 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-476ca372-a580-41ac-aaf1-f1d367c9936e tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:08:49.184772 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-476ca372-a580-41ac-aaf1-f1d367c9936e tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:08:49.185766 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-476ca372-a580-41ac-aaf1-f1d367c9936e tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:08:49.187258 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-476ca372-a580-41ac-aaf1-f1d367c9936e tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:08:49.187933 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-476ca372-a580-41ac-aaf1-f1d367c9936e tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:08:49.189010 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-476ca372-a580-41ac-aaf1-f1d367c9936e tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:08:49.410761 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-476ca372-a580-41ac-aaf1-f1d367c9936e tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '058480d92c9b4ab4af6815d0438a65c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee9dc49b89143f781e4ab30296e4d01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:08:49.423303 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-476ca372-a580-41ac-aaf1-f1d367c9936e tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] 10.222.0.13 "GET /compute/v2.1/servers/8485db2a-fd8f-4615-bbe0-14822ad44194" status: 200 len: 1524 microversion: 2.1 time: 0.256611 Nov 01 19:08:49.439760 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1730/3551] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:08:49 2022] GET /compute/v2.1/servers/8485db2a-fd8f-4615-bbe0-14822ad44194 => generated 1524 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 19:08:49.439760 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-a311a573-b5d5-4202-ab45-bc4cbeb6c469 tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:08:49.439760 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-a311a573-b5d5-4202-ab45-bc4cbeb6c469 tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] [instance: 77d6f571-5742-462c-ada0-1b05dd1561d1] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:08:49.439760 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-a311a573-b5d5-4202-ab45-bc4cbeb6c469 tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:08:49.439760 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-a311a573-b5d5-4202-ab45-bc4cbeb6c469 tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:08:49.439760 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-a311a573-b5d5-4202-ab45-bc4cbeb6c469 tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:08:49.440488 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-a311a573-b5d5-4202-ab45-bc4cbeb6c469 tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:08:49.440777 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-a311a573-b5d5-4202-ab45-bc4cbeb6c469 tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:08:49.441570 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-a311a573-b5d5-4202-ab45-bc4cbeb6c469 tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:08:49.562120 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-a311a573-b5d5-4202-ab45-bc4cbeb6c469 tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57ba6eeb99714c7cabb14f484968e269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a0c0985c7b9450a8b622b6761e5b5c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:08:49.583446 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-a311a573-b5d5-4202-ab45-bc4cbeb6c469 tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57ba6eeb99714c7cabb14f484968e269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a0c0985c7b9450a8b622b6761e5b5c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:08:49.585632 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-a311a573-b5d5-4202-ab45-bc4cbeb6c469 tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57ba6eeb99714c7cabb14f484968e269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a0c0985c7b9450a8b622b6761e5b5c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:08:49.589196 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-a311a573-b5d5-4202-ab45-bc4cbeb6c469 tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] 10.222.0.13 "GET /compute/v2.1/servers/77d6f571-5742-462c-ada0-1b05dd1561d1" status: 200 len: 1366 microversion: 2.47 time: 0.163218 Nov 01 19:08:49.589957 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1731/3552] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 19:08:49 2022] GET /compute/v2.1/servers/77d6f571-5742-462c-ada0-1b05dd1561d1 => generated 1366 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 19:08:49.763416 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-fca61604-3d67-48de-97e9-085c90fbf6b6 tempest-ImagesOneServerTestJSON-1044295602 tempest-ImagesOneServerTestJSON-1044295602-project] 10.222.0.13 "DELETE /compute/v2.1/images/5ef04aec-03ab-4186-8460-a6385af6c9f1" status: 204 len: 0 microversion: 2.1 time: 1.114247 Nov 01 19:08:49.771294 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1822/3553] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:08:48 2022] DELETE /compute/v2.1/images/5ef04aec-03ab-4186-8460-a6385af6c9f1 => generated 0 bytes in 1118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 01 19:08:49.774250 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-32f312dc-be25-457f-818e-78bf2421be12 tempest-ImagesOneServerTestJSON-1044295602 tempest-ImagesOneServerTestJSON-1044295602-project] Calling method '.version_select at 0x7f0ae17f8040>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:08:49.785890 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-9d221698-5389-403e-8b80-5809de387354 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:08:49.787357 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-9d221698-5389-403e-8b80-5809de387354 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] [instance: 34597ed3-08c9-4c33-b47a-56a9ad5ff70c] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:08:49.806638 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-9d221698-5389-403e-8b80-5809de387354 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:08:49.807720 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-9d221698-5389-403e-8b80-5809de387354 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:08:49.808538 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-9d221698-5389-403e-8b80-5809de387354 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:08:49.809488 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-9d221698-5389-403e-8b80-5809de387354 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:08:49.810318 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-9d221698-5389-403e-8b80-5809de387354 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:08:49.810750 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-9d221698-5389-403e-8b80-5809de387354 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:08:49.811778 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.wsgi [None req-32f312dc-be25-457f-818e-78bf2421be12 tempest-ImagesOneServerTestJSON-1044295602 tempest-ImagesOneServerTestJSON-1044295602-project] HTTP exception thrown: Image not found. Nov 01 19:08:49.814230 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-32f312dc-be25-457f-818e-78bf2421be12 tempest-ImagesOneServerTestJSON-1044295602 tempest-ImagesOneServerTestJSON-1044295602-project] Request method failure captured: Nov 01 19:08:49.814230 n-d-863052-2 devstack@n-api.service[121402]: request: DELETE /compute/v2.1/images/621c9785-490d-4245-8b6b-91f8571f7eab HTTP/1.1 Nov 01 19:08:49.814230 n-d-863052-2 devstack@n-api.service[121402]: Accept: application/json Nov 01 19:08:49.814230 n-d-863052-2 devstack@n-api.service[121402]: Accept-Encoding: identity Nov 01 19:08:49.814230 n-d-863052-2 devstack@n-api.service[121402]: Connection: close Nov 01 19:08:49.814230 n-d-863052-2 devstack@n-api.service[121402]: Content-Length: 0 Nov 01 19:08:49.814230 n-d-863052-2 devstack@n-api.service[121402]: Content-Type: application/json Nov 01 19:08:49.814230 n-d-863052-2 devstack@n-api.service[121402]: Host: 10.222.0.13 Nov 01 19:08:49.814230 n-d-863052-2 devstack@n-api.service[121402]: Openstack-System-Scope: None Nov 01 19:08:49.814230 n-d-863052-2 devstack@n-api.service[121402]: User-Agent: python-urllib3/1.26.12 Nov 01 19:08:49.814230 n-d-863052-2 devstack@n-api.service[121402]: X-Auth-Token: gAAAAABjYW56eNe5SQRyBnUkIgXlO71F0kzVXqumCGMUgtp3NV0a4qsd1ewy4tcX5amPLpoZq-HyQz4Q7cIFwB8WjSgRutL7v-B4JhAhTDD5aGIrcknHr6P6jMfRHLSuZ4N9yk6Fsnnm9M7cAVfRFmhcpSKO6i2TKscRAWDtxhj3rv4cRFwz130 Nov 01 19:08:49.814230 n-d-863052-2 devstack@n-api.service[121402]: X-Domain-Id: None Nov 01 19:08:49.814230 n-d-863052-2 devstack@n-api.service[121402]: X-Domain-Name: None Nov 01 19:08:49.814230 n-d-863052-2 devstack@n-api.service[121402]: X-Identity-Status: Confirmed Nov 01 19:08:49.814230 n-d-863052-2 devstack@n-api.service[121402]: X-Is-Admin-Project: True Nov 01 19:08:49.814230 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Domain-Id: default Nov 01 19:08:49.814230 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Domain-Name: Default Nov 01 19:08:49.814230 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Id: c548420d1df4403c9129cce5f040d45b Nov 01 19:08:49.814230 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Name: tempest-ImagesOneServerTestJSON-1044295602 Nov 01 19:08:49.814230 n-d-863052-2 devstack@n-api.service[121402]: X-Role: member,reader Nov 01 19:08:49.814230 n-d-863052-2 devstack@n-api.service[121402]: X-Roles: member,reader Nov 01 19:08:49.814230 n-d-863052-2 devstack@n-api.service[121402]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/c548420d1df4403c9129cce5f040d45b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/c548420d1df4403c9129cce5f040d45b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_c548420d1df4403c9129cce5f040d45b", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/c548420d1df4403c9129cce5f040d45b"}]}] Nov 01 19:08:49.814230 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant: tempest-ImagesOneServerTestJSON-1044295602 Nov 01 19:08:49.814230 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant-Id: c548420d1df4403c9129cce5f040d45b Nov 01 19:08:49.814230 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-1044295602 Nov 01 19:08:49.814230 n-d-863052-2 devstack@n-api.service[121402]: X-User: tempest-ImagesOneServerTestJSON-1044295602-project Nov 01 19:08:49.814230 n-d-863052-2 devstack@n-api.service[121402]: X-User-Domain-Id: default Nov 01 19:08:49.814230 n-d-863052-2 devstack@n-api.service[121402]: X-User-Domain-Name: Default Nov 01 19:08:49.814230 n-d-863052-2 devstack@n-api.service[121402]: X-User-Id: ed6fd718964648e4bc83ed37cbaa9b84 Nov 01 19:08:49.814230 n-d-863052-2 devstack@n-api.service[121402]: X-User-Name: tempest-ImagesOneServerTestJSON-1044295602-project Nov 01 19:08:49.814230 n-d-863052-2 devstack@n-api.service[121402]: method: Nov 01 19:08:49.814230 n-d-863052-2 devstack@n-api.service[121402]: exception: Image not found. Nov 01 19:08:49.814230 n-d-863052-2 devstack@n-api.service[121402]: action_args: {'id': '621c9785-490d-4245-8b6b-91f8571f7eab'} Nov 01 19:08:49.814230 n-d-863052-2 devstack@n-api.service[121402]: {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 01 19:08:49.814230 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:08:49.814230 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Nov 01 19:08:49.814230 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Nov 01 19:08:49.814230 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Nov 01 19:08:49.814230 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Nov 01 19:08:49.814230 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Nov 01 19:08:49.814230 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Nov 01 19:08:49.814230 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Nov 01 19:08:49.814230 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Nov 01 19:08:49.814230 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Nov 01 19:08:49.814230 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Nov 01 19:08:49.814230 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Nov 01 19:08:49.814230 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Nov 01 19:08:49.814230 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Nov 01 19:08:49.814230 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Nov 01 19:08:49.814230 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 621c9785-490d-4245-8b6b-91f8571f7eab to delete Nov 01 19:08:49.814230 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:08:49.814230 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:08:49.814230 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:08:49.814230 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:08:49.814230 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Nov 01 19:08:49.814230 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Nov 01 19:08:49.814230 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Nov 01 19:08:49.814230 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Nov 01 19:08:49.814230 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Nov 01 19:08:49.814230 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Nov 01 19:08:49.814230 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 621c9785-490d-4245-8b6b-91f8571f7eab could not be found. Nov 01 19:08:49.814230 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:08:49.814230 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:08:49.814230 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:08:49.814230 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:08:49.820377 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:08:49.820377 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:08:49.820377 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 01 19:08:49.820377 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 01 19:08:49.820377 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 01 19:08:49.820377 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 01 19:08:49.820377 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 01 19:08:49.820377 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 01 19:08:49.820377 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Nov 01 19:08:49.820377 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Nov 01 19:08:49.820377 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Nov 01 19:08:49.820377 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:08:49.820377 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:08:49.820377 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:08:49.820377 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:08:49.820377 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:08:49.820377 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:08:49.820377 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 01 19:08:49.820377 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 01 19:08:49.820377 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Nov 01 19:08:49.820377 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:08:49.820377 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-32f312dc-be25-457f-818e-78bf2421be12 tempest-ImagesOneServerTestJSON-1044295602 tempest-ImagesOneServerTestJSON-1044295602-project] Returning 404 to user: Image not found. {{(pid=121402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 01 19:08:49.820377 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-32f312dc-be25-457f-818e-78bf2421be12 tempest-ImagesOneServerTestJSON-1044295602 tempest-ImagesOneServerTestJSON-1044295602-project] 10.222.0.13 "DELETE /compute/v2.1/images/621c9785-490d-4245-8b6b-91f8571f7eab" status: 404 len: 62 microversion: 2.1 time: 0.047235 Nov 01 19:08:49.820377 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1732/3554] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:08:49 2022] DELETE /compute/v2.1/images/621c9785-490d-4245-8b6b-91f8571f7eab => generated 62 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 01 19:08:49.826683 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-9ba024df-ac97-4448-b4eb-aa5c17edc6bd tempest-ImagesOneServerTestJSON-1044295602 tempest-ImagesOneServerTestJSON-1044295602-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:08:49.827465 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-9ba024df-ac97-4448-b4eb-aa5c17edc6bd tempest-ImagesOneServerTestJSON-1044295602 tempest-ImagesOneServerTestJSON-1044295602-project] [instance: 31f51cbd-b29a-46be-bca0-f27c2b287e15] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:08:49.834593 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-9ba024df-ac97-4448-b4eb-aa5c17edc6bd tempest-ImagesOneServerTestJSON-1044295602 tempest-ImagesOneServerTestJSON-1044295602-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:08:49.835172 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-9ba024df-ac97-4448-b4eb-aa5c17edc6bd tempest-ImagesOneServerTestJSON-1044295602 tempest-ImagesOneServerTestJSON-1044295602-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:08:49.835611 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-9ba024df-ac97-4448-b4eb-aa5c17edc6bd tempest-ImagesOneServerTestJSON-1044295602 tempest-ImagesOneServerTestJSON-1044295602-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:08:49.836424 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-9ba024df-ac97-4448-b4eb-aa5c17edc6bd tempest-ImagesOneServerTestJSON-1044295602 tempest-ImagesOneServerTestJSON-1044295602-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:08:49.836973 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-9ba024df-ac97-4448-b4eb-aa5c17edc6bd tempest-ImagesOneServerTestJSON-1044295602 tempest-ImagesOneServerTestJSON-1044295602-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:08:49.837396 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-9ba024df-ac97-4448-b4eb-aa5c17edc6bd tempest-ImagesOneServerTestJSON-1044295602 tempest-ImagesOneServerTestJSON-1044295602-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:08:49.874834 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-9ba024df-ac97-4448-b4eb-aa5c17edc6bd tempest-ImagesOneServerTestJSON-1044295602 tempest-ImagesOneServerTestJSON-1044295602-project] [instance: 31f51cbd-b29a-46be-bca0-f27c2b287e15] Going to try to terminate instance {{(pid=121402) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 01 19:08:49.881296 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-9d221698-5389-403e-8b80-5809de387354 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113bd8c844ee490b86a68bc7e1e75da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '851785a5f76548898a77d67792888504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:08:49.890849 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-9d221698-5389-403e-8b80-5809de387354 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] 10.222.0.13 "GET /compute/v2.1/servers/34597ed3-08c9-4c33-b47a-56a9ad5ff70c" status: 200 len: 1260 microversion: 2.1 time: 0.115452 Nov 01 19:08:49.891687 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1823/3555] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:08:49 2022] GET /compute/v2.1/servers/34597ed3-08c9-4c33-b47a-56a9ad5ff70c => generated 1260 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:08:49.954099 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-9ba024df-ac97-4448-b4eb-aa5c17edc6bd tempest-ImagesOneServerTestJSON-1044295602 tempest-ImagesOneServerTestJSON-1044295602-project] 10.222.0.13 "DELETE /compute/v2.1/servers/31f51cbd-b29a-46be-bca0-f27c2b287e15" status: 204 len: 0 microversion: 2.1 time: 0.130872 Nov 01 19:08:49.954689 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1733/3556] 10.222.0.13 () {58 vars in 1239 bytes} [Tue Nov 1 19:08:49 2022] DELETE /compute/v2.1/servers/31f51cbd-b29a-46be-bca0-f27c2b287e15 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 01 19:08:49.962986 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-44184d5b-8d04-47d3-b1ce-253defbbfe10 tempest-ImagesOneServerTestJSON-1044295602 tempest-ImagesOneServerTestJSON-1044295602-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:08:49.963604 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-44184d5b-8d04-47d3-b1ce-253defbbfe10 tempest-ImagesOneServerTestJSON-1044295602 tempest-ImagesOneServerTestJSON-1044295602-project] [instance: 31f51cbd-b29a-46be-bca0-f27c2b287e15] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:08:49.967128 n-d-863052-2 devstack@n-api.service[121403]: DEBUG dbcounter [-] [121403] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=121403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 19:08:49.970891 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-44184d5b-8d04-47d3-b1ce-253defbbfe10 tempest-ImagesOneServerTestJSON-1044295602 tempest-ImagesOneServerTestJSON-1044295602-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:08:49.971382 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-44184d5b-8d04-47d3-b1ce-253defbbfe10 tempest-ImagesOneServerTestJSON-1044295602 tempest-ImagesOneServerTestJSON-1044295602-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:08:49.971819 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-44184d5b-8d04-47d3-b1ce-253defbbfe10 tempest-ImagesOneServerTestJSON-1044295602 tempest-ImagesOneServerTestJSON-1044295602-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:08:49.972731 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-44184d5b-8d04-47d3-b1ce-253defbbfe10 tempest-ImagesOneServerTestJSON-1044295602 tempest-ImagesOneServerTestJSON-1044295602-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:08:49.973198 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-44184d5b-8d04-47d3-b1ce-253defbbfe10 tempest-ImagesOneServerTestJSON-1044295602 tempest-ImagesOneServerTestJSON-1044295602-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:08:49.973627 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-44184d5b-8d04-47d3-b1ce-253defbbfe10 tempest-ImagesOneServerTestJSON-1044295602 tempest-ImagesOneServerTestJSON-1044295602-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:08:50.207575 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-44184d5b-8d04-47d3-b1ce-253defbbfe10 tempest-ImagesOneServerTestJSON-1044295602 tempest-ImagesOneServerTestJSON-1044295602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6fd718964648e4bc83ed37cbaa9b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c548420d1df4403c9129cce5f040d45b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:08:50.222095 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-44184d5b-8d04-47d3-b1ce-253defbbfe10 tempest-ImagesOneServerTestJSON-1044295602 tempest-ImagesOneServerTestJSON-1044295602-project] 10.222.0.13 "GET /compute/v2.1/servers/31f51cbd-b29a-46be-bca0-f27c2b287e15" status: 200 len: 1472 microversion: 2.1 time: 0.263129 Nov 01 19:08:50.222957 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1824/3557] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:08:49 2022] GET /compute/v2.1/servers/31f51cbd-b29a-46be-bca0-f27c2b287e15 => generated 1472 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:08:50.448692 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-fae36c0d-58ba-47ae-a622-6a5bddcbb561 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:08:50.449653 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-fae36c0d-58ba-47ae-a622-6a5bddcbb561 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] [instance: 8485db2a-fd8f-4615-bbe0-14822ad44194] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:08:50.457093 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-fae36c0d-58ba-47ae-a622-6a5bddcbb561 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:08:50.458394 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-fae36c0d-58ba-47ae-a622-6a5bddcbb561 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:08:50.459053 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-fae36c0d-58ba-47ae-a622-6a5bddcbb561 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:08:50.460539 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-fae36c0d-58ba-47ae-a622-6a5bddcbb561 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:08:50.461254 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-fae36c0d-58ba-47ae-a622-6a5bddcbb561 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:08:50.461913 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-fae36c0d-58ba-47ae-a622-6a5bddcbb561 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:08:50.618508 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-84c36178-323b-4595-ab68-2efef1a7cc4e tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:08:50.619275 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-84c36178-323b-4595-ab68-2efef1a7cc4e tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] [instance: 77d6f571-5742-462c-ada0-1b05dd1561d1] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:08:50.627687 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-84c36178-323b-4595-ab68-2efef1a7cc4e tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:08:50.628188 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-84c36178-323b-4595-ab68-2efef1a7cc4e tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:08:50.628814 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-84c36178-323b-4595-ab68-2efef1a7cc4e tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:08:50.630325 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-84c36178-323b-4595-ab68-2efef1a7cc4e tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:08:50.630976 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-84c36178-323b-4595-ab68-2efef1a7cc4e tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:08:50.631695 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-84c36178-323b-4595-ab68-2efef1a7cc4e tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:08:50.705750 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-fae36c0d-58ba-47ae-a622-6a5bddcbb561 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '058480d92c9b4ab4af6815d0438a65c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee9dc49b89143f781e4ab30296e4d01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:08:50.714847 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-fae36c0d-58ba-47ae-a622-6a5bddcbb561 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] 10.222.0.13 "GET /compute/v2.1/servers/8485db2a-fd8f-4615-bbe0-14822ad44194" status: 200 len: 1506 microversion: 2.1 time: 0.270966 Nov 01 19:08:50.716075 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1734/3558] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:08:50 2022] GET /compute/v2.1/servers/8485db2a-fd8f-4615-bbe0-14822ad44194 => generated 1506 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:08:50.761567 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-84c36178-323b-4595-ab68-2efef1a7cc4e tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57ba6eeb99714c7cabb14f484968e269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a0c0985c7b9450a8b622b6761e5b5c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:08:50.770806 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-84c36178-323b-4595-ab68-2efef1a7cc4e tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57ba6eeb99714c7cabb14f484968e269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a0c0985c7b9450a8b622b6761e5b5c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:08:50.773797 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-84c36178-323b-4595-ab68-2efef1a7cc4e tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57ba6eeb99714c7cabb14f484968e269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a0c0985c7b9450a8b622b6761e5b5c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:08:50.775246 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-84c36178-323b-4595-ab68-2efef1a7cc4e tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] 10.222.0.13 "GET /compute/v2.1/servers/77d6f571-5742-462c-ada0-1b05dd1561d1" status: 200 len: 1366 microversion: 2.47 time: 0.162627 Nov 01 19:08:50.790284 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1825/3559] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 19:08:50 2022] GET /compute/v2.1/servers/77d6f571-5742-462c-ada0-1b05dd1561d1 => generated 1366 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 01 19:08:50.914197 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-b3b16e1f-4d57-4b9d-bc1f-0f182538900b tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:08:50.915204 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-b3b16e1f-4d57-4b9d-bc1f-0f182538900b tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] [instance: 34597ed3-08c9-4c33-b47a-56a9ad5ff70c] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:08:50.928185 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b3b16e1f-4d57-4b9d-bc1f-0f182538900b tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:08:50.929190 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b3b16e1f-4d57-4b9d-bc1f-0f182538900b tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:08:50.929326 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b3b16e1f-4d57-4b9d-bc1f-0f182538900b tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:08:50.929963 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b3b16e1f-4d57-4b9d-bc1f-0f182538900b tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:08:50.930409 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b3b16e1f-4d57-4b9d-bc1f-0f182538900b tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:08:50.931065 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b3b16e1f-4d57-4b9d-bc1f-0f182538900b tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:08:51.209142 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-b3b16e1f-4d57-4b9d-bc1f-0f182538900b tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113bd8c844ee490b86a68bc7e1e75da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '851785a5f76548898a77d67792888504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:08:51.221742 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-b3b16e1f-4d57-4b9d-bc1f-0f182538900b tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] 10.222.0.13 "GET /compute/v2.1/servers/34597ed3-08c9-4c33-b47a-56a9ad5ff70c" status: 200 len: 1308 microversion: 2.1 time: 0.311331 Nov 01 19:08:51.222524 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1735/3560] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:08:50 2022] GET /compute/v2.1/servers/34597ed3-08c9-4c33-b47a-56a9ad5ff70c => generated 1308 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:08:51.251176 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-85eee4de-c2b5-40f2-95a4-53ec1ed32925 tempest-ImagesOneServerTestJSON-1044295602 tempest-ImagesOneServerTestJSON-1044295602-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:08:51.251841 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-85eee4de-c2b5-40f2-95a4-53ec1ed32925 tempest-ImagesOneServerTestJSON-1044295602 tempest-ImagesOneServerTestJSON-1044295602-project] [instance: 31f51cbd-b29a-46be-bca0-f27c2b287e15] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:08:51.265211 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-85eee4de-c2b5-40f2-95a4-53ec1ed32925 tempest-ImagesOneServerTestJSON-1044295602 tempest-ImagesOneServerTestJSON-1044295602-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:08:51.265707 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-85eee4de-c2b5-40f2-95a4-53ec1ed32925 tempest-ImagesOneServerTestJSON-1044295602 tempest-ImagesOneServerTestJSON-1044295602-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:08:51.266154 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-85eee4de-c2b5-40f2-95a4-53ec1ed32925 tempest-ImagesOneServerTestJSON-1044295602 tempest-ImagesOneServerTestJSON-1044295602-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:08:51.266869 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-85eee4de-c2b5-40f2-95a4-53ec1ed32925 tempest-ImagesOneServerTestJSON-1044295602 tempest-ImagesOneServerTestJSON-1044295602-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:08:51.267339 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-85eee4de-c2b5-40f2-95a4-53ec1ed32925 tempest-ImagesOneServerTestJSON-1044295602 tempest-ImagesOneServerTestJSON-1044295602-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:08:51.267759 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-85eee4de-c2b5-40f2-95a4-53ec1ed32925 tempest-ImagesOneServerTestJSON-1044295602 tempest-ImagesOneServerTestJSON-1044295602-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:08:51.280576 n-d-863052-2 devstack@n-api.service[121403]: DEBUG dbcounter [-] [121403] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 19:08:51.532792 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-85eee4de-c2b5-40f2-95a4-53ec1ed32925 tempest-ImagesOneServerTestJSON-1044295602 tempest-ImagesOneServerTestJSON-1044295602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6fd718964648e4bc83ed37cbaa9b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c548420d1df4403c9129cce5f040d45b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:08:51.543235 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-85eee4de-c2b5-40f2-95a4-53ec1ed32925 tempest-ImagesOneServerTestJSON-1044295602 tempest-ImagesOneServerTestJSON-1044295602-project] 10.222.0.13 "GET /compute/v2.1/servers/31f51cbd-b29a-46be-bca0-f27c2b287e15" status: 200 len: 1472 microversion: 2.1 time: 0.296517 Nov 01 19:08:51.565743 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1826/3561] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:08:51 2022] GET /compute/v2.1/servers/31f51cbd-b29a-46be-bca0-f27c2b287e15 => generated 1472 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:08:51.740399 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-a411b8ec-56a5-49a3-a885-bc9f8c0f2b7b tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:08:51.741613 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-a411b8ec-56a5-49a3-a885-bc9f8c0f2b7b tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] [instance: 8485db2a-fd8f-4615-bbe0-14822ad44194] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:08:51.750520 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-a411b8ec-56a5-49a3-a885-bc9f8c0f2b7b tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:08:51.751215 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-a411b8ec-56a5-49a3-a885-bc9f8c0f2b7b tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:08:51.751830 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-a411b8ec-56a5-49a3-a885-bc9f8c0f2b7b tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:08:51.753087 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-a411b8ec-56a5-49a3-a885-bc9f8c0f2b7b tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:08:51.753744 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-a411b8ec-56a5-49a3-a885-bc9f8c0f2b7b tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:08:51.754356 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-a411b8ec-56a5-49a3-a885-bc9f8c0f2b7b tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:08:51.805368 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-79a55275-13d8-4a99-8246-22dba0fd13ef tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:08:51.805981 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-79a55275-13d8-4a99-8246-22dba0fd13ef tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] [instance: 77d6f571-5742-462c-ada0-1b05dd1561d1] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:08:51.814044 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-79a55275-13d8-4a99-8246-22dba0fd13ef tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:08:51.814788 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-79a55275-13d8-4a99-8246-22dba0fd13ef tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:08:51.819083 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-79a55275-13d8-4a99-8246-22dba0fd13ef tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:08:51.820083 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-79a55275-13d8-4a99-8246-22dba0fd13ef tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:08:51.820810 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-79a55275-13d8-4a99-8246-22dba0fd13ef tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:08:51.821444 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-79a55275-13d8-4a99-8246-22dba0fd13ef tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:08:51.922084 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-79a55275-13d8-4a99-8246-22dba0fd13ef tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57ba6eeb99714c7cabb14f484968e269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a0c0985c7b9450a8b622b6761e5b5c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:08:51.934100 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-79a55275-13d8-4a99-8246-22dba0fd13ef tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57ba6eeb99714c7cabb14f484968e269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a0c0985c7b9450a8b622b6761e5b5c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:08:51.938843 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-79a55275-13d8-4a99-8246-22dba0fd13ef tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57ba6eeb99714c7cabb14f484968e269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a0c0985c7b9450a8b622b6761e5b5c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:08:51.942025 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-79a55275-13d8-4a99-8246-22dba0fd13ef tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] 10.222.0.13 "GET /compute/v2.1/servers/77d6f571-5742-462c-ada0-1b05dd1561d1" status: 200 len: 1366 microversion: 2.47 time: 0.140066 Nov 01 19:08:51.942813 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1827/3562] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 19:08:51 2022] GET /compute/v2.1/servers/77d6f571-5742-462c-ada0-1b05dd1561d1 => generated 1366 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 19:08:51.961959 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [req-b19f5f99-f55a-452a-a467-3beff142f3af req-f942e1ec-b525-4364-96d7-924133f3f644 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "31f51cbd-b29a-46be-bca0-f27c2b287e15", "name": "network-vif-unplugged", "status": "completed", "tag": "bc5f2d73-99ce-47e7-bd41-afad82bb372e"}]} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:08:51.976689 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-b19f5f99-f55a-452a-a467-3beff142f3af req-f942e1ec-b525-4364-96d7-924133f3f644 service nova] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:08:51.977165 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-b19f5f99-f55a-452a-a467-3beff142f3af req-f942e1ec-b525-4364-96d7-924133f3f644 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:08:51.977802 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-b19f5f99-f55a-452a-a467-3beff142f3af req-f942e1ec-b525-4364-96d7-924133f3f644 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:08:51.989761 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.compute.server_external_events [req-b19f5f99-f55a-452a-a467-3beff142f3af req-f942e1ec-b525-4364-96d7-924133f3f644 service nova] Creating event network-vif-unplugged:bc5f2d73-99ce-47e7-bd41-afad82bb372e for instance 31f51cbd-b29a-46be-bca0-f27c2b287e15 on n-h2-863052-2 Nov 01 19:08:51.994985 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [req-b19f5f99-f55a-452a-a467-3beff142f3af req-f942e1ec-b525-4364-96d7-924133f3f644 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.047729 Nov 01 19:08:51.996112 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1828/3563] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Nov 1 19:08:51 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:08:52.082776 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-a411b8ec-56a5-49a3-a885-bc9f8c0f2b7b tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '058480d92c9b4ab4af6815d0438a65c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee9dc49b89143f781e4ab30296e4d01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:08:52.097033 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-a411b8ec-56a5-49a3-a885-bc9f8c0f2b7b tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] 10.222.0.13 "GET /compute/v2.1/servers/8485db2a-fd8f-4615-bbe0-14822ad44194" status: 200 len: 1506 microversion: 2.1 time: 0.361272 Nov 01 19:08:52.098343 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1736/3564] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:08:51 2022] GET /compute/v2.1/servers/8485db2a-fd8f-4615-bbe0-14822ad44194 => generated 1506 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:08:52.181623 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [req-4c11a3e8-e388-4af2-8dbf-a7e840541b05 req-5a084910-74d1-449e-9698-4d0307368905 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "34597ed3-08c9-4c33-b47a-56a9ad5ff70c", "tag": "3638395b-88f9-4712-a867-5c773ca49cde"}]} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:08:52.193082 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-4c11a3e8-e388-4af2-8dbf-a7e840541b05 req-5a084910-74d1-449e-9698-4d0307368905 service nova] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:08:52.193562 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-4c11a3e8-e388-4af2-8dbf-a7e840541b05 req-5a084910-74d1-449e-9698-4d0307368905 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:08:52.194939 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-4c11a3e8-e388-4af2-8dbf-a7e840541b05 req-5a084910-74d1-449e-9698-4d0307368905 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:08:52.222377 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.compute.server_external_events [req-4c11a3e8-e388-4af2-8dbf-a7e840541b05 req-5a084910-74d1-449e-9698-4d0307368905 service nova] Creating event network-changed:3638395b-88f9-4712-a867-5c773ca49cde for instance 34597ed3-08c9-4c33-b47a-56a9ad5ff70c on n-h1-863052-2 Nov 01 19:08:52.228320 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [req-4c11a3e8-e388-4af2-8dbf-a7e840541b05 req-5a084910-74d1-449e-9698-4d0307368905 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051340 Nov 01 19:08:52.229492 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1829/3565] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Nov 1 19:08:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 01 19:08:52.251775 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-1728d8d0-7b25-4300-a335-d94e5f565fa6 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:08:52.252612 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-1728d8d0-7b25-4300-a335-d94e5f565fa6 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] [instance: 34597ed3-08c9-4c33-b47a-56a9ad5ff70c] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:08:52.265204 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-1728d8d0-7b25-4300-a335-d94e5f565fa6 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:08:52.269454 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-1728d8d0-7b25-4300-a335-d94e5f565fa6 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:08:52.270107 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-1728d8d0-7b25-4300-a335-d94e5f565fa6 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:08:52.271074 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-1728d8d0-7b25-4300-a335-d94e5f565fa6 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:08:52.275666 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-1728d8d0-7b25-4300-a335-d94e5f565fa6 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:08:52.276345 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-1728d8d0-7b25-4300-a335-d94e5f565fa6 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:08:52.577213 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-680d654a-0a30-4493-82c1-a9973e039fa1 tempest-ImagesOneServerTestJSON-1044295602 tempest-ImagesOneServerTestJSON-1044295602-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:08:52.578206 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-680d654a-0a30-4493-82c1-a9973e039fa1 tempest-ImagesOneServerTestJSON-1044295602 tempest-ImagesOneServerTestJSON-1044295602-project] [instance: 31f51cbd-b29a-46be-bca0-f27c2b287e15] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:08:52.596655 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-680d654a-0a30-4493-82c1-a9973e039fa1 tempest-ImagesOneServerTestJSON-1044295602 tempest-ImagesOneServerTestJSON-1044295602-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:08:52.597120 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-680d654a-0a30-4493-82c1-a9973e039fa1 tempest-ImagesOneServerTestJSON-1044295602 tempest-ImagesOneServerTestJSON-1044295602-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:08:52.597582 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-680d654a-0a30-4493-82c1-a9973e039fa1 tempest-ImagesOneServerTestJSON-1044295602 tempest-ImagesOneServerTestJSON-1044295602-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:08:52.598294 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-680d654a-0a30-4493-82c1-a9973e039fa1 tempest-ImagesOneServerTestJSON-1044295602 tempest-ImagesOneServerTestJSON-1044295602-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:08:52.598755 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-680d654a-0a30-4493-82c1-a9973e039fa1 tempest-ImagesOneServerTestJSON-1044295602 tempest-ImagesOneServerTestJSON-1044295602-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:08:52.599185 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-680d654a-0a30-4493-82c1-a9973e039fa1 tempest-ImagesOneServerTestJSON-1044295602 tempest-ImagesOneServerTestJSON-1044295602-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:08:52.661882 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-1728d8d0-7b25-4300-a335-d94e5f565fa6 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113bd8c844ee490b86a68bc7e1e75da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '851785a5f76548898a77d67792888504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:08:52.672043 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-1728d8d0-7b25-4300-a335-d94e5f565fa6 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] 10.222.0.13 "GET /compute/v2.1/servers/34597ed3-08c9-4c33-b47a-56a9ad5ff70c" status: 200 len: 1308 microversion: 2.1 time: 0.426149 Nov 01 19:08:52.673077 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1737/3566] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:08:52 2022] GET /compute/v2.1/servers/34597ed3-08c9-4c33-b47a-56a9ad5ff70c => generated 1308 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:08:52.971538 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-aac9a745-0852-4269-8d88-8d2e244c6d95 tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:08:52.972206 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-aac9a745-0852-4269-8d88-8d2e244c6d95 tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] [instance: 77d6f571-5742-462c-ada0-1b05dd1561d1] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:08:52.979888 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-aac9a745-0852-4269-8d88-8d2e244c6d95 tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:08:52.985647 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-aac9a745-0852-4269-8d88-8d2e244c6d95 tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:08:52.986791 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-aac9a745-0852-4269-8d88-8d2e244c6d95 tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:08:52.987570 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-aac9a745-0852-4269-8d88-8d2e244c6d95 tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:08:52.988241 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-aac9a745-0852-4269-8d88-8d2e244c6d95 tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:08:52.991981 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-aac9a745-0852-4269-8d88-8d2e244c6d95 tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:08:53.129460 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-aac9a745-0852-4269-8d88-8d2e244c6d95 tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57ba6eeb99714c7cabb14f484968e269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a0c0985c7b9450a8b622b6761e5b5c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:08:53.140924 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-aac9a745-0852-4269-8d88-8d2e244c6d95 tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57ba6eeb99714c7cabb14f484968e269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a0c0985c7b9450a8b622b6761e5b5c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:08:53.142763 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-aac9a745-0852-4269-8d88-8d2e244c6d95 tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57ba6eeb99714c7cabb14f484968e269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a0c0985c7b9450a8b622b6761e5b5c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:08:53.144422 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-aac9a745-0852-4269-8d88-8d2e244c6d95 tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] 10.222.0.13 "GET /compute/v2.1/servers/77d6f571-5742-462c-ada0-1b05dd1561d1" status: 200 len: 1366 microversion: 2.47 time: 0.177323 Nov 01 19:08:53.145795 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1738/3567] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 19:08:52 2022] GET /compute/v2.1/servers/77d6f571-5742-462c-ada0-1b05dd1561d1 => generated 1366 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 19:08:53.151945 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-02dd8598-d7f8-4826-95c6-659b6d4c68fa tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:08:53.152840 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-02dd8598-d7f8-4826-95c6-659b6d4c68fa tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] [instance: 8485db2a-fd8f-4615-bbe0-14822ad44194] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:08:53.161251 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-02dd8598-d7f8-4826-95c6-659b6d4c68fa tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:08:53.162122 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-02dd8598-d7f8-4826-95c6-659b6d4c68fa tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:08:53.163610 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-02dd8598-d7f8-4826-95c6-659b6d4c68fa tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:08:53.164568 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-02dd8598-d7f8-4826-95c6-659b6d4c68fa tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:08:53.165274 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-02dd8598-d7f8-4826-95c6-659b6d4c68fa tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:08:53.165916 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-02dd8598-d7f8-4826-95c6-659b6d4c68fa tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:08:53.414503 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-680d654a-0a30-4493-82c1-a9973e039fa1 tempest-ImagesOneServerTestJSON-1044295602 tempest-ImagesOneServerTestJSON-1044295602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6fd718964648e4bc83ed37cbaa9b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c548420d1df4403c9129cce5f040d45b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:08:53.429330 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-680d654a-0a30-4493-82c1-a9973e039fa1 tempest-ImagesOneServerTestJSON-1044295602 tempest-ImagesOneServerTestJSON-1044295602-project] 10.222.0.13 "GET /compute/v2.1/servers/31f51cbd-b29a-46be-bca0-f27c2b287e15" status: 200 len: 1472 microversion: 2.1 time: 0.856509 Nov 01 19:08:53.430991 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1830/3568] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:08:52 2022] GET /compute/v2.1/servers/31f51cbd-b29a-46be-bca0-f27c2b287e15 => generated 1472 bytes in 859 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 19:08:53.698822 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-06e17dd4-5ea0-4ce6-a1b3-7096c2a6c711 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:08:53.700122 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-06e17dd4-5ea0-4ce6-a1b3-7096c2a6c711 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] [instance: 34597ed3-08c9-4c33-b47a-56a9ad5ff70c] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:08:53.721604 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-06e17dd4-5ea0-4ce6-a1b3-7096c2a6c711 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:08:53.724791 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-06e17dd4-5ea0-4ce6-a1b3-7096c2a6c711 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:08:53.728203 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-06e17dd4-5ea0-4ce6-a1b3-7096c2a6c711 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:08:53.731521 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-06e17dd4-5ea0-4ce6-a1b3-7096c2a6c711 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:08:53.732009 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-06e17dd4-5ea0-4ce6-a1b3-7096c2a6c711 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:08:53.732448 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-06e17dd4-5ea0-4ce6-a1b3-7096c2a6c711 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:08:54.016170 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-06e17dd4-5ea0-4ce6-a1b3-7096c2a6c711 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113bd8c844ee490b86a68bc7e1e75da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '851785a5f76548898a77d67792888504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:08:54.037245 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-06e17dd4-5ea0-4ce6-a1b3-7096c2a6c711 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] 10.222.0.13 "GET /compute/v2.1/servers/34597ed3-08c9-4c33-b47a-56a9ad5ff70c" status: 200 len: 1308 microversion: 2.1 time: 0.343611 Nov 01 19:08:54.037875 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1831/3569] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:08:53 2022] GET /compute/v2.1/servers/34597ed3-08c9-4c33-b47a-56a9ad5ff70c => generated 1308 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:08:54.060330 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [req-89aa02ca-5eb7-4dc6-9bc0-40270779ab7f req-943c99f5-1bcb-4e28-94bc-ec7851d49076 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8485db2a-fd8f-4615-bbe0-14822ad44194", "name": "network-vif-unplugged", "status": "completed", "tag": "01274861-72a7-4685-9ca3-9bdd9e739056"}]} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:08:54.071423 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-89aa02ca-5eb7-4dc6-9bc0-40270779ab7f req-943c99f5-1bcb-4e28-94bc-ec7851d49076 service nova] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:08:54.072183 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-89aa02ca-5eb7-4dc6-9bc0-40270779ab7f req-943c99f5-1bcb-4e28-94bc-ec7851d49076 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:08:54.072636 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-89aa02ca-5eb7-4dc6-9bc0-40270779ab7f req-943c99f5-1bcb-4e28-94bc-ec7851d49076 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:08:54.087268 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.compute.server_external_events [req-89aa02ca-5eb7-4dc6-9bc0-40270779ab7f req-943c99f5-1bcb-4e28-94bc-ec7851d49076 service nova] Creating event network-vif-unplugged:01274861-72a7-4685-9ca3-9bdd9e739056 for instance 8485db2a-fd8f-4615-bbe0-14822ad44194 on n-h2-863052-2 Nov 01 19:08:54.094089 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [req-89aa02ca-5eb7-4dc6-9bc0-40270779ab7f req-943c99f5-1bcb-4e28-94bc-ec7851d49076 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.038241 Nov 01 19:08:54.094722 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1832/3570] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Nov 1 19:08:54 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:08:54.198149 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-02dd8598-d7f8-4826-95c6-659b6d4c68fa tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '058480d92c9b4ab4af6815d0438a65c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee9dc49b89143f781e4ab30296e4d01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:08:54.203701 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-df78ebf2-7b7d-4d34-ae51-c04e53d273fc tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:08:54.205941 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-df78ebf2-7b7d-4d34-ae51-c04e53d273fc tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] [instance: 77d6f571-5742-462c-ada0-1b05dd1561d1] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:08:54.211091 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-02dd8598-d7f8-4826-95c6-659b6d4c68fa tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] 10.222.0.13 "GET /compute/v2.1/servers/8485db2a-fd8f-4615-bbe0-14822ad44194" status: 200 len: 1506 microversion: 2.1 time: 1.063719 Nov 01 19:08:54.215596 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-df78ebf2-7b7d-4d34-ae51-c04e53d273fc tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:08:54.216812 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-df78ebf2-7b7d-4d34-ae51-c04e53d273fc tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:08:54.217513 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-df78ebf2-7b7d-4d34-ae51-c04e53d273fc tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:08:54.218308 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1739/3571] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:08:53 2022] GET /compute/v2.1/servers/8485db2a-fd8f-4615-bbe0-14822ad44194 => generated 1506 bytes in 1071 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:08:54.218945 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-df78ebf2-7b7d-4d34-ae51-c04e53d273fc tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:08:54.219623 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-df78ebf2-7b7d-4d34-ae51-c04e53d273fc tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:08:54.220260 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-df78ebf2-7b7d-4d34-ae51-c04e53d273fc tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:08:54.257222 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [req-d18e744f-0c17-493e-8698-2056694a0110 req-b448a89d-1bf0-45e5-abdd-54ac1ab77f2a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "31f51cbd-b29a-46be-bca0-f27c2b287e15", "name": "network-vif-deleted", "tag": "bc5f2d73-99ce-47e7-bd41-afad82bb372e"}]} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:08:54.270079 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-d18e744f-0c17-493e-8698-2056694a0110 req-b448a89d-1bf0-45e5-abdd-54ac1ab77f2a service nova] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:08:54.270847 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-d18e744f-0c17-493e-8698-2056694a0110 req-b448a89d-1bf0-45e5-abdd-54ac1ab77f2a service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:08:54.271434 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-d18e744f-0c17-493e-8698-2056694a0110 req-b448a89d-1bf0-45e5-abdd-54ac1ab77f2a service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:08:54.285440 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.compute.server_external_events [req-d18e744f-0c17-493e-8698-2056694a0110 req-b448a89d-1bf0-45e5-abdd-54ac1ab77f2a service nova] Creating event network-vif-deleted:bc5f2d73-99ce-47e7-bd41-afad82bb372e for instance 31f51cbd-b29a-46be-bca0-f27c2b287e15 on n-h2-863052-2 Nov 01 19:08:54.291724 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [req-d18e744f-0c17-493e-8698-2056694a0110 req-b448a89d-1bf0-45e5-abdd-54ac1ab77f2a service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043759 Nov 01 19:08:54.293012 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1740/3572] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Nov 1 19:08:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:08:54.317305 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-df78ebf2-7b7d-4d34-ae51-c04e53d273fc tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57ba6eeb99714c7cabb14f484968e269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a0c0985c7b9450a8b622b6761e5b5c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:08:54.330474 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-df78ebf2-7b7d-4d34-ae51-c04e53d273fc tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57ba6eeb99714c7cabb14f484968e269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a0c0985c7b9450a8b622b6761e5b5c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:08:54.332445 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-df78ebf2-7b7d-4d34-ae51-c04e53d273fc tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57ba6eeb99714c7cabb14f484968e269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a0c0985c7b9450a8b622b6761e5b5c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:08:54.333938 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-df78ebf2-7b7d-4d34-ae51-c04e53d273fc tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] 10.222.0.13 "GET /compute/v2.1/servers/77d6f571-5742-462c-ada0-1b05dd1561d1" status: 200 len: 1366 microversion: 2.47 time: 0.162261 Nov 01 19:08:54.335119 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1833/3573] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 19:08:54 2022] GET /compute/v2.1/servers/77d6f571-5742-462c-ada0-1b05dd1561d1 => generated 1366 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 19:08:54.468443 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-d083d76d-f9d2-4321-803e-a1ea9ead0b9e tempest-ImagesOneServerTestJSON-1044295602 tempest-ImagesOneServerTestJSON-1044295602-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:08:54.469946 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-d083d76d-f9d2-4321-803e-a1ea9ead0b9e tempest-ImagesOneServerTestJSON-1044295602 tempest-ImagesOneServerTestJSON-1044295602-project] [instance: 31f51cbd-b29a-46be-bca0-f27c2b287e15] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:08:54.478009 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-d083d76d-f9d2-4321-803e-a1ea9ead0b9e tempest-ImagesOneServerTestJSON-1044295602 tempest-ImagesOneServerTestJSON-1044295602-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:08:54.478985 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-d083d76d-f9d2-4321-803e-a1ea9ead0b9e tempest-ImagesOneServerTestJSON-1044295602 tempest-ImagesOneServerTestJSON-1044295602-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:08:54.479688 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-d083d76d-f9d2-4321-803e-a1ea9ead0b9e tempest-ImagesOneServerTestJSON-1044295602 tempest-ImagesOneServerTestJSON-1044295602-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:08:54.481673 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-d083d76d-f9d2-4321-803e-a1ea9ead0b9e tempest-ImagesOneServerTestJSON-1044295602 tempest-ImagesOneServerTestJSON-1044295602-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:08:54.482349 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-d083d76d-f9d2-4321-803e-a1ea9ead0b9e tempest-ImagesOneServerTestJSON-1044295602 tempest-ImagesOneServerTestJSON-1044295602-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:08:54.482988 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-d083d76d-f9d2-4321-803e-a1ea9ead0b9e tempest-ImagesOneServerTestJSON-1044295602 tempest-ImagesOneServerTestJSON-1044295602-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:08:54.630759 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-d083d76d-f9d2-4321-803e-a1ea9ead0b9e tempest-ImagesOneServerTestJSON-1044295602 tempest-ImagesOneServerTestJSON-1044295602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6fd718964648e4bc83ed37cbaa9b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c548420d1df4403c9129cce5f040d45b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:08:54.641268 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-d083d76d-f9d2-4321-803e-a1ea9ead0b9e tempest-ImagesOneServerTestJSON-1044295602 tempest-ImagesOneServerTestJSON-1044295602-project] 10.222.0.13 "GET /compute/v2.1/servers/31f51cbd-b29a-46be-bca0-f27c2b287e15" status: 200 len: 1430 microversion: 2.1 time: 0.186868 Nov 01 19:08:54.642014 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1741/3574] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:08:54 2022] GET /compute/v2.1/servers/31f51cbd-b29a-46be-bca0-f27c2b287e15 => generated 1430 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:08:55.075989 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-11fe47e5-093f-4a0b-8548-2e2669f6927d tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:08:55.077918 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-11fe47e5-093f-4a0b-8548-2e2669f6927d tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] [instance: 34597ed3-08c9-4c33-b47a-56a9ad5ff70c] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:08:55.097987 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-11fe47e5-093f-4a0b-8548-2e2669f6927d tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:08:55.098544 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-11fe47e5-093f-4a0b-8548-2e2669f6927d tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:08:55.099000 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-11fe47e5-093f-4a0b-8548-2e2669f6927d tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:08:55.100027 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-11fe47e5-093f-4a0b-8548-2e2669f6927d tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:08:55.100865 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-11fe47e5-093f-4a0b-8548-2e2669f6927d tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:08:55.101206 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-11fe47e5-093f-4a0b-8548-2e2669f6927d tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:08:55.235423 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-4f357a2a-40b8-4f87-b009-08f8de5233d9 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:08:55.236039 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-4f357a2a-40b8-4f87-b009-08f8de5233d9 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] [instance: 8485db2a-fd8f-4615-bbe0-14822ad44194] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:08:55.243314 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-4f357a2a-40b8-4f87-b009-08f8de5233d9 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:08:55.243811 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-4f357a2a-40b8-4f87-b009-08f8de5233d9 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:08:55.244328 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-4f357a2a-40b8-4f87-b009-08f8de5233d9 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:08:55.245578 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-4f357a2a-40b8-4f87-b009-08f8de5233d9 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:08:55.246042 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-4f357a2a-40b8-4f87-b009-08f8de5233d9 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:08:55.246470 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-4f357a2a-40b8-4f87-b009-08f8de5233d9 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:08:55.341086 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-11fe47e5-093f-4a0b-8548-2e2669f6927d tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113bd8c844ee490b86a68bc7e1e75da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '851785a5f76548898a77d67792888504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:08:55.353223 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-11fe47e5-093f-4a0b-8548-2e2669f6927d tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] 10.222.0.13 "GET /compute/v2.1/servers/34597ed3-08c9-4c33-b47a-56a9ad5ff70c" status: 200 len: 1308 microversion: 2.1 time: 0.289997 Nov 01 19:08:55.357636 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1834/3575] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:08:55 2022] GET /compute/v2.1/servers/34597ed3-08c9-4c33-b47a-56a9ad5ff70c => generated 1308 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:08:55.364531 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-f0ca8dea-19a9-4030-a5e9-d07b59f9733b tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:08:55.365402 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-f0ca8dea-19a9-4030-a5e9-d07b59f9733b tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] [instance: 77d6f571-5742-462c-ada0-1b05dd1561d1] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:08:55.372892 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f0ca8dea-19a9-4030-a5e9-d07b59f9733b tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:08:55.373356 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f0ca8dea-19a9-4030-a5e9-d07b59f9733b tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:08:55.374802 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f0ca8dea-19a9-4030-a5e9-d07b59f9733b tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:08:55.375779 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f0ca8dea-19a9-4030-a5e9-d07b59f9733b tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:08:55.376417 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f0ca8dea-19a9-4030-a5e9-d07b59f9733b tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:08:55.378727 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f0ca8dea-19a9-4030-a5e9-d07b59f9733b tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:08:55.491376 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-f0ca8dea-19a9-4030-a5e9-d07b59f9733b tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57ba6eeb99714c7cabb14f484968e269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a0c0985c7b9450a8b622b6761e5b5c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:08:55.500898 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-f0ca8dea-19a9-4030-a5e9-d07b59f9733b tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57ba6eeb99714c7cabb14f484968e269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a0c0985c7b9450a8b622b6761e5b5c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:08:55.502414 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-f0ca8dea-19a9-4030-a5e9-d07b59f9733b tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57ba6eeb99714c7cabb14f484968e269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a0c0985c7b9450a8b622b6761e5b5c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:08:55.503861 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-f0ca8dea-19a9-4030-a5e9-d07b59f9733b tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] 10.222.0.13 "GET /compute/v2.1/servers/77d6f571-5742-462c-ada0-1b05dd1561d1" status: 200 len: 1366 microversion: 2.47 time: 0.144989 Nov 01 19:08:55.504484 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1835/3576] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 19:08:55 2022] GET /compute/v2.1/servers/77d6f571-5742-462c-ada0-1b05dd1561d1 => generated 1366 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 19:08:55.552185 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-4f357a2a-40b8-4f87-b009-08f8de5233d9 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '058480d92c9b4ab4af6815d0438a65c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee9dc49b89143f781e4ab30296e4d01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:08:55.562160 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-4f357a2a-40b8-4f87-b009-08f8de5233d9 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] 10.222.0.13 "GET /compute/v2.1/servers/8485db2a-fd8f-4615-bbe0-14822ad44194" status: 200 len: 1506 microversion: 2.1 time: 0.330471 Nov 01 19:08:55.577236 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1742/3577] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:08:55 2022] GET /compute/v2.1/servers/8485db2a-fd8f-4615-bbe0-14822ad44194 => generated 1506 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 19:08:55.668375 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-c1f78c33-a9c9-4d9b-a38d-cd559fb7ee66 tempest-ImagesOneServerTestJSON-1044295602 tempest-ImagesOneServerTestJSON-1044295602-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:08:55.669955 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-c1f78c33-a9c9-4d9b-a38d-cd559fb7ee66 tempest-ImagesOneServerTestJSON-1044295602 tempest-ImagesOneServerTestJSON-1044295602-project] [instance: 31f51cbd-b29a-46be-bca0-f27c2b287e15] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:08:55.677540 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-c1f78c33-a9c9-4d9b-a38d-cd559fb7ee66 tempest-ImagesOneServerTestJSON-1044295602 tempest-ImagesOneServerTestJSON-1044295602-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:08:55.679111 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-c1f78c33-a9c9-4d9b-a38d-cd559fb7ee66 tempest-ImagesOneServerTestJSON-1044295602 tempest-ImagesOneServerTestJSON-1044295602-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:08:55.680272 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-c1f78c33-a9c9-4d9b-a38d-cd559fb7ee66 tempest-ImagesOneServerTestJSON-1044295602 tempest-ImagesOneServerTestJSON-1044295602-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:08:55.681246 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-c1f78c33-a9c9-4d9b-a38d-cd559fb7ee66 tempest-ImagesOneServerTestJSON-1044295602 tempest-ImagesOneServerTestJSON-1044295602-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:08:55.684333 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-c1f78c33-a9c9-4d9b-a38d-cd559fb7ee66 tempest-ImagesOneServerTestJSON-1044295602 tempest-ImagesOneServerTestJSON-1044295602-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:08:55.684974 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-c1f78c33-a9c9-4d9b-a38d-cd559fb7ee66 tempest-ImagesOneServerTestJSON-1044295602 tempest-ImagesOneServerTestJSON-1044295602-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:08:55.773870 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-c1f78c33-a9c9-4d9b-a38d-cd559fb7ee66 tempest-ImagesOneServerTestJSON-1044295602 tempest-ImagesOneServerTestJSON-1044295602-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:08:55.774365 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-c1f78c33-a9c9-4d9b-a38d-cd559fb7ee66 tempest-ImagesOneServerTestJSON-1044295602 tempest-ImagesOneServerTestJSON-1044295602-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:08:55.776476 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-c1f78c33-a9c9-4d9b-a38d-cd559fb7ee66 tempest-ImagesOneServerTestJSON-1044295602 tempest-ImagesOneServerTestJSON-1044295602-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:08:55.777139 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.objects.instance [None req-c1f78c33-a9c9-4d9b-a38d-cd559fb7ee66 tempest-ImagesOneServerTestJSON-1044295602 tempest-ImagesOneServerTestJSON-1044295602-project] Lazy-loading 'fault' on Instance uuid 31f51cbd-b29a-46be-bca0-f27c2b287e15 {{(pid=121403) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 01 19:08:55.852561 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-c1f78c33-a9c9-4d9b-a38d-cd559fb7ee66 tempest-ImagesOneServerTestJSON-1044295602 tempest-ImagesOneServerTestJSON-1044295602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6fd718964648e4bc83ed37cbaa9b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c548420d1df4403c9129cce5f040d45b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:08:55.877374 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-c1f78c33-a9c9-4d9b-a38d-cd559fb7ee66 tempest-ImagesOneServerTestJSON-1044295602 tempest-ImagesOneServerTestJSON-1044295602-project] 10.222.0.13 "GET /compute/v2.1/servers/31f51cbd-b29a-46be-bca0-f27c2b287e15" status: 200 len: 1306 microversion: 2.1 time: 0.214449 Nov 01 19:08:55.879062 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1836/3578] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:08:55 2022] GET /compute/v2.1/servers/31f51cbd-b29a-46be-bca0-f27c2b287e15 => generated 1306 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:08:56.379456 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-d0d759a8-4c0c-4b57-885d-01a73fbf48bf tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:08:56.380966 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-d0d759a8-4c0c-4b57-885d-01a73fbf48bf tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] [instance: 34597ed3-08c9-4c33-b47a-56a9ad5ff70c] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:08:56.399379 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-d0d759a8-4c0c-4b57-885d-01a73fbf48bf tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:08:56.408737 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-d0d759a8-4c0c-4b57-885d-01a73fbf48bf tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:08:56.409286 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-d0d759a8-4c0c-4b57-885d-01a73fbf48bf tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:08:56.410214 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-d0d759a8-4c0c-4b57-885d-01a73fbf48bf tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:08:56.410849 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-d0d759a8-4c0c-4b57-885d-01a73fbf48bf tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:08:56.411355 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-d0d759a8-4c0c-4b57-885d-01a73fbf48bf tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:08:56.432346 n-d-863052-2 devstack@n-api.service[121402]: DEBUG dbcounter [-] [121402] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 19:08:56.530911 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-1d503670-e29e-4b7e-80c3-b0a2b7e9c04f tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:08:56.532237 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-1d503670-e29e-4b7e-80c3-b0a2b7e9c04f tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] [instance: 77d6f571-5742-462c-ada0-1b05dd1561d1] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:08:56.540041 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-1d503670-e29e-4b7e-80c3-b0a2b7e9c04f tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:08:56.540529 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-1d503670-e29e-4b7e-80c3-b0a2b7e9c04f tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:08:56.540999 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-1d503670-e29e-4b7e-80c3-b0a2b7e9c04f tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:08:56.541695 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-1d503670-e29e-4b7e-80c3-b0a2b7e9c04f tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:08:56.542320 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-1d503670-e29e-4b7e-80c3-b0a2b7e9c04f tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:08:56.542913 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-1d503670-e29e-4b7e-80c3-b0a2b7e9c04f tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:08:56.633324 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-1d503670-e29e-4b7e-80c3-b0a2b7e9c04f tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57ba6eeb99714c7cabb14f484968e269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a0c0985c7b9450a8b622b6761e5b5c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:08:56.642091 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-1d503670-e29e-4b7e-80c3-b0a2b7e9c04f tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57ba6eeb99714c7cabb14f484968e269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a0c0985c7b9450a8b622b6761e5b5c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:08:56.644371 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-1d503670-e29e-4b7e-80c3-b0a2b7e9c04f tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57ba6eeb99714c7cabb14f484968e269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a0c0985c7b9450a8b622b6761e5b5c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:08:56.645616 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-1d503670-e29e-4b7e-80c3-b0a2b7e9c04f tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] 10.222.0.13 "GET /compute/v2.1/servers/77d6f571-5742-462c-ada0-1b05dd1561d1" status: 200 len: 1366 microversion: 2.47 time: 0.118644 Nov 01 19:08:56.646214 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1837/3579] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 19:08:56 2022] GET /compute/v2.1/servers/77d6f571-5742-462c-ada0-1b05dd1561d1 => generated 1366 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 01 19:08:56.651275 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-2bee56bf-3e9b-4d05-a899-70798c3e3cbd tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:08:56.652052 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-2bee56bf-3e9b-4d05-a899-70798c3e3cbd tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] [instance: 8485db2a-fd8f-4615-bbe0-14822ad44194] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:08:56.657474 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-d0d759a8-4c0c-4b57-885d-01a73fbf48bf tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113bd8c844ee490b86a68bc7e1e75da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '851785a5f76548898a77d67792888504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:08:56.658038 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-2bee56bf-3e9b-4d05-a899-70798c3e3cbd tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:08:56.658715 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-2bee56bf-3e9b-4d05-a899-70798c3e3cbd tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:08:56.659316 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-2bee56bf-3e9b-4d05-a899-70798c3e3cbd tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:08:56.660407 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-2bee56bf-3e9b-4d05-a899-70798c3e3cbd tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:08:56.661966 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-2bee56bf-3e9b-4d05-a899-70798c3e3cbd tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:08:56.663184 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-2bee56bf-3e9b-4d05-a899-70798c3e3cbd tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:08:56.670239 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-d0d759a8-4c0c-4b57-885d-01a73fbf48bf tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] 10.222.0.13 "GET /compute/v2.1/servers/34597ed3-08c9-4c33-b47a-56a9ad5ff70c" status: 200 len: 1308 microversion: 2.1 time: 0.294555 Nov 01 19:08:56.671158 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1743/3580] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:08:56 2022] GET /compute/v2.1/servers/34597ed3-08c9-4c33-b47a-56a9ad5ff70c => generated 1308 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:08:56.905261 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-92d91eda-90a8-40e0-af1c-ab969e56d19b tempest-ImagesOneServerTestJSON-1044295602 tempest-ImagesOneServerTestJSON-1044295602-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:08:56.906143 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-92d91eda-90a8-40e0-af1c-ab969e56d19b tempest-ImagesOneServerTestJSON-1044295602 tempest-ImagesOneServerTestJSON-1044295602-project] [instance: 31f51cbd-b29a-46be-bca0-f27c2b287e15] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:08:56.912397 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-92d91eda-90a8-40e0-af1c-ab969e56d19b tempest-ImagesOneServerTestJSON-1044295602 tempest-ImagesOneServerTestJSON-1044295602-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:08:56.913069 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-92d91eda-90a8-40e0-af1c-ab969e56d19b tempest-ImagesOneServerTestJSON-1044295602 tempest-ImagesOneServerTestJSON-1044295602-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:08:56.913915 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-92d91eda-90a8-40e0-af1c-ab969e56d19b tempest-ImagesOneServerTestJSON-1044295602 tempest-ImagesOneServerTestJSON-1044295602-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:08:56.914584 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-92d91eda-90a8-40e0-af1c-ab969e56d19b tempest-ImagesOneServerTestJSON-1044295602 tempest-ImagesOneServerTestJSON-1044295602-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:08:56.915292 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-92d91eda-90a8-40e0-af1c-ab969e56d19b tempest-ImagesOneServerTestJSON-1044295602 tempest-ImagesOneServerTestJSON-1044295602-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:08:56.915722 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-92d91eda-90a8-40e0-af1c-ab969e56d19b tempest-ImagesOneServerTestJSON-1044295602 tempest-ImagesOneServerTestJSON-1044295602-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:08:56.932860 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.wsgi [None req-92d91eda-90a8-40e0-af1c-ab969e56d19b tempest-ImagesOneServerTestJSON-1044295602 tempest-ImagesOneServerTestJSON-1044295602-project] HTTP exception thrown: Instance 31f51cbd-b29a-46be-bca0-f27c2b287e15 could not be found. Nov 01 19:08:56.934551 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-92d91eda-90a8-40e0-af1c-ab969e56d19b tempest-ImagesOneServerTestJSON-1044295602 tempest-ImagesOneServerTestJSON-1044295602-project] Request method failure captured: Nov 01 19:08:56.934551 n-d-863052-2 devstack@n-api.service[121402]: request: GET /compute/v2.1/servers/31f51cbd-b29a-46be-bca0-f27c2b287e15 HTTP/1.1 Nov 01 19:08:56.934551 n-d-863052-2 devstack@n-api.service[121402]: Accept: application/json Nov 01 19:08:56.934551 n-d-863052-2 devstack@n-api.service[121402]: Accept-Encoding: identity Nov 01 19:08:56.934551 n-d-863052-2 devstack@n-api.service[121402]: Connection: close Nov 01 19:08:56.934551 n-d-863052-2 devstack@n-api.service[121402]: Content-Length: 0 Nov 01 19:08:56.934551 n-d-863052-2 devstack@n-api.service[121402]: Content-Type: application/json Nov 01 19:08:56.934551 n-d-863052-2 devstack@n-api.service[121402]: Host: 10.222.0.13 Nov 01 19:08:56.934551 n-d-863052-2 devstack@n-api.service[121402]: Openstack-System-Scope: None Nov 01 19:08:56.934551 n-d-863052-2 devstack@n-api.service[121402]: User-Agent: python-urllib3/1.26.12 Nov 01 19:08:56.934551 n-d-863052-2 devstack@n-api.service[121402]: X-Auth-Token: gAAAAABjYW56eNe5SQRyBnUkIgXlO71F0kzVXqumCGMUgtp3NV0a4qsd1ewy4tcX5amPLpoZq-HyQz4Q7cIFwB8WjSgRutL7v-B4JhAhTDD5aGIrcknHr6P6jMfRHLSuZ4N9yk6Fsnnm9M7cAVfRFmhcpSKO6i2TKscRAWDtxhj3rv4cRFwz130 Nov 01 19:08:56.934551 n-d-863052-2 devstack@n-api.service[121402]: X-Domain-Id: None Nov 01 19:08:56.934551 n-d-863052-2 devstack@n-api.service[121402]: X-Domain-Name: None Nov 01 19:08:56.934551 n-d-863052-2 devstack@n-api.service[121402]: X-Identity-Status: Confirmed Nov 01 19:08:56.934551 n-d-863052-2 devstack@n-api.service[121402]: X-Is-Admin-Project: True Nov 01 19:08:56.934551 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Domain-Id: default Nov 01 19:08:56.934551 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Domain-Name: Default Nov 01 19:08:56.934551 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Id: c548420d1df4403c9129cce5f040d45b Nov 01 19:08:56.934551 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Name: tempest-ImagesOneServerTestJSON-1044295602 Nov 01 19:08:56.934551 n-d-863052-2 devstack@n-api.service[121402]: X-Role: member,reader Nov 01 19:08:56.934551 n-d-863052-2 devstack@n-api.service[121402]: X-Roles: member,reader Nov 01 19:08:56.934551 n-d-863052-2 devstack@n-api.service[121402]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/c548420d1df4403c9129cce5f040d45b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/c548420d1df4403c9129cce5f040d45b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_c548420d1df4403c9129cce5f040d45b", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/c548420d1df4403c9129cce5f040d45b"}]}] Nov 01 19:08:56.934551 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant: tempest-ImagesOneServerTestJSON-1044295602 Nov 01 19:08:56.934551 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant-Id: c548420d1df4403c9129cce5f040d45b Nov 01 19:08:56.934551 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-1044295602 Nov 01 19:08:56.934551 n-d-863052-2 devstack@n-api.service[121402]: X-User: tempest-ImagesOneServerTestJSON-1044295602-project Nov 01 19:08:56.934551 n-d-863052-2 devstack@n-api.service[121402]: X-User-Domain-Id: default Nov 01 19:08:56.934551 n-d-863052-2 devstack@n-api.service[121402]: X-User-Domain-Name: Default Nov 01 19:08:56.934551 n-d-863052-2 devstack@n-api.service[121402]: X-User-Id: ed6fd718964648e4bc83ed37cbaa9b84 Nov 01 19:08:56.934551 n-d-863052-2 devstack@n-api.service[121402]: X-User-Name: tempest-ImagesOneServerTestJSON-1044295602-project Nov 01 19:08:56.934551 n-d-863052-2 devstack@n-api.service[121402]: method: > Nov 01 19:08:56.934551 n-d-863052-2 devstack@n-api.service[121402]: exception: Instance 31f51cbd-b29a-46be-bca0-f27c2b287e15 could not be found. Nov 01 19:08:56.934551 n-d-863052-2 devstack@n-api.service[121402]: action_args: {'id': '31f51cbd-b29a-46be-bca0-f27c2b287e15'} Nov 01 19:08:56.934551 n-d-863052-2 devstack@n-api.service[121402]: {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 01 19:08:56.934551 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:08:56.934551 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 01 19:08:56.934551 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 01 19:08:56.934551 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 01 19:08:56.934551 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 01 19:08:56.934551 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 01 19:08:56.934551 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 01 19:08:56.934551 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 01 19:08:56.934551 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 01 19:08:56.934551 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 31f51cbd-b29a-46be-bca0-f27c2b287e15 could not be found. Nov 01 19:08:56.934551 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:08:56.934551 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:08:56.934551 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:08:56.934551 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:08:56.934551 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:08:56.934551 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:08:56.934551 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 01 19:08:56.934551 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 01 19:08:56.934551 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 01 19:08:56.934551 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 01 19:08:56.934551 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 01 19:08:56.934551 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 01 19:08:56.934551 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 01 19:08:56.934551 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 01 19:08:56.934551 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 01 19:08:56.934551 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 01 19:08:56.934551 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 31f51cbd-b29a-46be-bca0-f27c2b287e15 could not be found. Nov 01 19:08:56.934551 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:08:56.934551 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:08:56.934551 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:08:56.938998 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:08:56.938998 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:08:56.938998 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:08:56.938998 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 01 19:08:56.938998 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 01 19:08:56.938998 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 31f51cbd-b29a-46be-bca0-f27c2b287e15 could not be found. Nov 01 19:08:56.938998 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:08:56.938998 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-92d91eda-90a8-40e0-af1c-ab969e56d19b tempest-ImagesOneServerTestJSON-1044295602 tempest-ImagesOneServerTestJSON-1044295602-project] Returning 404 to user: Instance 31f51cbd-b29a-46be-bca0-f27c2b287e15 could not be found. {{(pid=121402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 01 19:08:56.938998 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-92d91eda-90a8-40e0-af1c-ab969e56d19b tempest-ImagesOneServerTestJSON-1044295602 tempest-ImagesOneServerTestJSON-1044295602-project] 10.222.0.13 "GET /compute/v2.1/servers/31f51cbd-b29a-46be-bca0-f27c2b287e15" status: 404 len: 111 microversion: 2.1 time: 0.034681 Nov 01 19:08:56.938998 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1744/3581] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:08:56 2022] GET /compute/v2.1/servers/31f51cbd-b29a-46be-bca0-f27c2b287e15 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 01 19:08:56.949050 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-2bee56bf-3e9b-4d05-a899-70798c3e3cbd tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '058480d92c9b4ab4af6815d0438a65c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee9dc49b89143f781e4ab30296e4d01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:08:56.966010 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-2bee56bf-3e9b-4d05-a899-70798c3e3cbd tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] 10.222.0.13 "GET /compute/v2.1/servers/8485db2a-fd8f-4615-bbe0-14822ad44194" status: 200 len: 1509 microversion: 2.1 time: 0.318750 Nov 01 19:08:56.974744 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1838/3582] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:08:56 2022] GET /compute/v2.1/servers/8485db2a-fd8f-4615-bbe0-14822ad44194 => generated 1509 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:08:56.990394 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-6c88a8bb-ea9c-496e-85b1-c0172ea985b7 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:08:56.991015 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-6c88a8bb-ea9c-496e-85b1-c0172ea985b7 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] [instance: 8485db2a-fd8f-4615-bbe0-14822ad44194] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:08:56.997153 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-6c88a8bb-ea9c-496e-85b1-c0172ea985b7 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:08:56.997652 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-6c88a8bb-ea9c-496e-85b1-c0172ea985b7 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:08:56.998095 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-6c88a8bb-ea9c-496e-85b1-c0172ea985b7 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:08:56.999424 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-6c88a8bb-ea9c-496e-85b1-c0172ea985b7 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:08:56.999899 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-6c88a8bb-ea9c-496e-85b1-c0172ea985b7 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:08:57.000676 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-6c88a8bb-ea9c-496e-85b1-c0172ea985b7 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:08:57.041149 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-6c88a8bb-ea9c-496e-85b1-c0172ea985b7 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] [instance: 8485db2a-fd8f-4615-bbe0-14822ad44194] Going to try to terminate instance {{(pid=121402) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 01 19:08:57.048417 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.compute.api [None req-6c88a8bb-ea9c-496e-85b1-c0172ea985b7 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] [instance: 8485db2a-fd8f-4615-bbe0-14822ad44194] Working on deleting snapshot d48149a6-168c-45ea-ae71-11acecda9f26 from shelved instance... Nov 01 19:08:57.695043 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-ea8e235d-ea30-4c0e-9108-f2c3f8555226 tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:08:57.698642 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-ea8e235d-ea30-4c0e-9108-f2c3f8555226 tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] [instance: 77d6f571-5742-462c-ada0-1b05dd1561d1] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:08:57.711416 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-ea8e235d-ea30-4c0e-9108-f2c3f8555226 tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:08:57.711913 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-ea8e235d-ea30-4c0e-9108-f2c3f8555226 tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:08:57.712350 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-ea8e235d-ea30-4c0e-9108-f2c3f8555226 tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:08:57.713113 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-ea8e235d-ea30-4c0e-9108-f2c3f8555226 tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:08:57.713564 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-ea8e235d-ea30-4c0e-9108-f2c3f8555226 tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:08:57.714194 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-ea8e235d-ea30-4c0e-9108-f2c3f8555226 tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:08:57.908956 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-ea8e235d-ea30-4c0e-9108-f2c3f8555226 tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57ba6eeb99714c7cabb14f484968e269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a0c0985c7b9450a8b622b6761e5b5c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:08:57.934117 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-ea8e235d-ea30-4c0e-9108-f2c3f8555226 tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57ba6eeb99714c7cabb14f484968e269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a0c0985c7b9450a8b622b6761e5b5c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:08:57.943613 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-ea8e235d-ea30-4c0e-9108-f2c3f8555226 tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57ba6eeb99714c7cabb14f484968e269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a0c0985c7b9450a8b622b6761e5b5c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:08:57.944965 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-ea8e235d-ea30-4c0e-9108-f2c3f8555226 tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] 10.222.0.13 "GET /compute/v2.1/servers/77d6f571-5742-462c-ada0-1b05dd1561d1" status: 200 len: 1366 microversion: 2.47 time: 0.269072 Nov 01 19:08:57.945479 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1839/3583] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 19:08:57 2022] GET /compute/v2.1/servers/77d6f571-5742-462c-ada0-1b05dd1561d1 => generated 1366 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 19:08:57.977829 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-46241bf7-58cb-49f3-bc01-80f5bea53462 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:08:57.979558 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-46241bf7-58cb-49f3-bc01-80f5bea53462 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] [instance: 34597ed3-08c9-4c33-b47a-56a9ad5ff70c] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:08:57.992016 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-46241bf7-58cb-49f3-bc01-80f5bea53462 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:08:57.992788 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-46241bf7-58cb-49f3-bc01-80f5bea53462 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:08:57.994132 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-46241bf7-58cb-49f3-bc01-80f5bea53462 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:08:57.995390 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-46241bf7-58cb-49f3-bc01-80f5bea53462 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:08:57.995849 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-46241bf7-58cb-49f3-bc01-80f5bea53462 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:08:57.996277 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-46241bf7-58cb-49f3-bc01-80f5bea53462 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:08:58.110616 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-6c88a8bb-ea9c-496e-85b1-c0172ea985b7 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] [instance: 8485db2a-fd8f-4615-bbe0-14822ad44194] Doing local delete in cell 389766af-efe4-4d8b-b2de-e920ed3438ee(cell1) {{(pid=121402) _delete /opt/stack/nova/nova/compute/api.py:2546}} Nov 01 19:08:58.111447 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-6c88a8bb-ea9c-496e-85b1-c0172ea985b7 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:08:58.111932 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-6c88a8bb-ea9c-496e-85b1-c0172ea985b7 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:08:58.112409 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-6c88a8bb-ea9c-496e-85b1-c0172ea985b7 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:08:58.112936 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.compute.api [None req-6c88a8bb-ea9c-496e-85b1-c0172ea985b7 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] [instance: 8485db2a-fd8f-4615-bbe0-14822ad44194] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. Nov 01 19:08:58.118770 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.network.neutron [None req-6c88a8bb-ea9c-496e-85b1-c0172ea985b7 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] [instance: 8485db2a-fd8f-4615-bbe0-14822ad44194] deallocate_for_instance() {{(pid=121402) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1780}} Nov 01 19:08:58.270455 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-46241bf7-58cb-49f3-bc01-80f5bea53462 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113bd8c844ee490b86a68bc7e1e75da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '851785a5f76548898a77d67792888504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:08:58.286007 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-46241bf7-58cb-49f3-bc01-80f5bea53462 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] 10.222.0.13 "GET /compute/v2.1/servers/34597ed3-08c9-4c33-b47a-56a9ad5ff70c" status: 200 len: 1308 microversion: 2.1 time: 0.326915 Nov 01 19:08:58.288979 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1840/3584] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:08:57 2022] GET /compute/v2.1/servers/34597ed3-08c9-4c33-b47a-56a9ad5ff70c => generated 1308 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:08:58.744019 n-d-863052-2 devstack@n-api.service[121402]: DEBUG dbcounter [-] [121402] Writing DB stats nova_cell0:SELECT=2 {{(pid=121402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 19:08:58.774707 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [req-188a6976-77a0-4100-9282-e2e1994ac900 req-d294bc6d-83a6-4f0a-97c4-c86c20bfd698 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "34597ed3-08c9-4c33-b47a-56a9ad5ff70c", "name": "network-vif-plugged", "status": "completed", "tag": "3638395b-88f9-4712-a867-5c773ca49cde"}]} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:08:58.790907 n-d-863052-2 devstack@n-api.service[121403]: DEBUG dbcounter [-] [121403] Writing DB stats nova_cell0:SELECT=2 {{(pid=121403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 19:08:58.791955 n-d-863052-2 devstack@n-api.service[121403]: DEBUG dbcounter [-] [121403] Writing DB stats nova_cell0:SELECT=6 {{(pid=121403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 19:08:58.795627 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-188a6976-77a0-4100-9282-e2e1994ac900 req-d294bc6d-83a6-4f0a-97c4-c86c20bfd698 service nova] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:08:58.796415 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-188a6976-77a0-4100-9282-e2e1994ac900 req-d294bc6d-83a6-4f0a-97c4-c86c20bfd698 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:08:58.797191 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-188a6976-77a0-4100-9282-e2e1994ac900 req-d294bc6d-83a6-4f0a-97c4-c86c20bfd698 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:08:58.818009 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.compute.server_external_events [req-188a6976-77a0-4100-9282-e2e1994ac900 req-d294bc6d-83a6-4f0a-97c4-c86c20bfd698 service nova] Creating event network-vif-plugged:3638395b-88f9-4712-a867-5c773ca49cde for instance 34597ed3-08c9-4c33-b47a-56a9ad5ff70c on n-h1-863052-2 Nov 01 19:08:58.826667 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [req-188a6976-77a0-4100-9282-e2e1994ac900 req-d294bc6d-83a6-4f0a-97c4-c86c20bfd698 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058700 Nov 01 19:08:58.829584 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1841/3585] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Nov 1 19:08:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:08:59.203950 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-8f6fd7a8-42be-45e8-a2f5-70707f4d5d78 tempest-KeyPairsNegativeTestJSON-453844394 tempest-KeyPairsNegativeTestJSON-453844394-project] Action: 'create', calling method: .version_select at 0x7f0ae67fff70>, body: {"keypair": {"name": "key_/.\\@:", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD0k5FiXeGpvsJraEYgi71uAq6qR20Z3eMBvlztbGIRfSsbKaXlU+MnX/eHVgLUbQKEofNepHWsG266mWqpUjyocEtYOZ8cypfGZ8hwZjTmjrfSNnXgNVxOVPmwInY94uQ=="}} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:08:59.209962 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-8f6fd7a8-42be-45e8-a2f5-70707f4d5d78 tempest-KeyPairsNegativeTestJSON-453844394 tempest-KeyPairsNegativeTestJSON-453844394-project] Request method failure captured: Nov 01 19:08:59.209962 n-d-863052-2 devstack@n-api.service[121403]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Nov 01 19:08:59.209962 n-d-863052-2 devstack@n-api.service[121403]: Accept: application/json Nov 01 19:08:59.209962 n-d-863052-2 devstack@n-api.service[121403]: Accept-Encoding: identity Nov 01 19:08:59.209962 n-d-863052-2 devstack@n-api.service[121403]: Connection: close Nov 01 19:08:59.209962 n-d-863052-2 devstack@n-api.service[121403]: Content-Length: 257 Nov 01 19:08:59.209962 n-d-863052-2 devstack@n-api.service[121403]: Content-Type: application/json Nov 01 19:08:59.209962 n-d-863052-2 devstack@n-api.service[121403]: Host: 10.222.0.13 Nov 01 19:08:59.209962 n-d-863052-2 devstack@n-api.service[121403]: Openstack-System-Scope: None Nov 01 19:08:59.209962 n-d-863052-2 devstack@n-api.service[121403]: User-Agent: python-urllib3/1.26.12 Nov 01 19:08:59.209962 n-d-863052-2 devstack@n-api.service[121403]: X-Auth-Token: gAAAAABjYW7K3Hp-TkIHHJgdY0OsPlPPQsGcFRUPZ_DDVp5KYwxSj3GH_6fK242NiPOXtgFbiqrvdKU0C6MORaIEPoigoW6OE38EyiudSLlgB84PBUu7nsFa1kVJkpcgBnOlC86zMlf-bydlGrW62474iKRQIoAYW-rk-ECeGtrVfTMDprEHXzs Nov 01 19:08:59.209962 n-d-863052-2 devstack@n-api.service[121403]: X-Domain-Id: None Nov 01 19:08:59.209962 n-d-863052-2 devstack@n-api.service[121403]: X-Domain-Name: None Nov 01 19:08:59.209962 n-d-863052-2 devstack@n-api.service[121403]: X-Identity-Status: Confirmed Nov 01 19:08:59.209962 n-d-863052-2 devstack@n-api.service[121403]: X-Is-Admin-Project: True Nov 01 19:08:59.209962 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Domain-Id: default Nov 01 19:08:59.209962 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Domain-Name: Default Nov 01 19:08:59.209962 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Id: 6f01650f0109463fb6bf763d88a94b11 Nov 01 19:08:59.209962 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-453844394 Nov 01 19:08:59.209962 n-d-863052-2 devstack@n-api.service[121403]: X-Role: member,reader Nov 01 19:08:59.209962 n-d-863052-2 devstack@n-api.service[121403]: X-Roles: member,reader Nov 01 19:08:59.209962 n-d-863052-2 devstack@n-api.service[121403]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/6f01650f0109463fb6bf763d88a94b11"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/6f01650f0109463fb6bf763d88a94b11"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_6f01650f0109463fb6bf763d88a94b11", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/6f01650f0109463fb6bf763d88a94b11"}]}] Nov 01 19:08:59.209962 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant: tempest-KeyPairsNegativeTestJSON-453844394 Nov 01 19:08:59.209962 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant-Id: 6f01650f0109463fb6bf763d88a94b11 Nov 01 19:08:59.209962 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-453844394 Nov 01 19:08:59.209962 n-d-863052-2 devstack@n-api.service[121403]: X-User: tempest-KeyPairsNegativeTestJSON-453844394-project Nov 01 19:08:59.209962 n-d-863052-2 devstack@n-api.service[121403]: X-User-Domain-Id: default Nov 01 19:08:59.209962 n-d-863052-2 devstack@n-api.service[121403]: X-User-Domain-Name: Default Nov 01 19:08:59.209962 n-d-863052-2 devstack@n-api.service[121403]: X-User-Id: 678e6aae64334e0a934f215be174d0c5 Nov 01 19:08:59.209962 n-d-863052-2 devstack@n-api.service[121403]: X-User-Name: tempest-KeyPairsNegativeTestJSON-453844394-project Nov 01 19:08:59.209962 n-d-863052-2 devstack@n-api.service[121403]: Nov 01 19:08:59.209962 n-d-863052-2 devstack@n-api.service[121403]: {"keypair": {"name": "key_/.\\@:", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD0k5FiXeGpvsJraEYgi71uAq6qR20Z3eMBvlztbGIRfSsbKaXlU+MnX/eHVgLUbQKEofNepHWsG266mWqpUjyocEtYOZ8cypfGZ8hwZjTmjrfSNnXgNVxOVPmwInY94uQ=="}} Nov 01 19:08:59.209962 n-d-863052-2 devstack@n-api.service[121403]: method: Nov 01 19:08:59.209962 n-d-863052-2 devstack@n-api.service[121403]: exception: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Nov 01 19:08:59.209962 n-d-863052-2 devstack@n-api.service[121403]: action_args: {'body': {'keypair': {'name': 'key_/.\\@:', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD0k5FiXeGpvsJraEYgi71uAq6qR20Z3eMBvlztbGIRfSsbKaXlU+MnX/eHVgLUbQKEofNepHWsG266mWqpUjyocEtYOZ8cypfGZ8hwZjTmjrfSNnXgNVxOVPmwInY94uQ=='}}} Nov 01 19:08:59.209962 n-d-863052-2 devstack@n-api.service[121403]: {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 01 19:08:59.209962 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:08:59.209962 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Nov 01 19:08:59.209962 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi result = func(instance) Nov 01 19:08:59.209962 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 161, in _validate_keypair_name_20 Nov 01 19:08:59.209962 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return _validate_keypair_name(keypair_name, safe_chars) Nov 01 19:08:59.209962 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 175, in _validate_keypair_name Nov 01 19:08:59.209962 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise exception.InvalidName(reason=reason) Nov 01 19:08:59.209962 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi nova.exception.InvalidName: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Nov 01 19:08:59.209962 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:08:59.209962 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Nov 01 19:08:59.209962 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:08:59.209962 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:08:59.209962 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Nov 01 19:08:59.209962 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Nov 01 19:08:59.209962 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Nov 01 19:08:59.209962 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise error Nov 01 19:08:59.209962 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'key_/.\\@:' is not a 'keypair_name_20' Nov 01 19:08:59.209962 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:08:59.209962 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['keypair']['properties']['name']['allOf'][1]: Nov 01 19:08:59.209962 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi {'format': 'keypair_name_20', Nov 01 19:08:59.209962 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi 'maxLength': 255, Nov 01 19:08:59.209962 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi 'minLength': 1, Nov 01 19:08:59.209962 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi 'type': 'string'} Nov 01 19:08:59.209962 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:08:59.209962 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi On instance['keypair']['name']: Nov 01 19:08:59.209962 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi 'key_/.\\@:' Nov 01 19:08:59.209962 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:08:59.215949 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:08:59.215949 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:08:59.215949 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:08:59.215949 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:08:59.215949 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:08:59.215949 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 01 19:08:59.215949 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 01 19:08:59.215949 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 01 19:08:59.215949 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 01 19:08:59.215949 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 01 19:08:59.215949 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 01 19:08:59.215949 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 01 19:08:59.215949 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 01 19:08:59.215949 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Nov 01 19:08:59.215949 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Nov 01 19:08:59.215949 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Nov 01 19:08:59.215949 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Nov 01 19:08:59.215949 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Nov 01 19:08:59.215949 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Nov 01 19:08:59.215949 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Nov 01 19:08:59.215949 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:08:59.215949 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:08:59.215949 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:08:59.215949 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:08:59.215949 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:08:59.215949 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:08:59.215949 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Nov 01 19:08:59.215949 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Nov 01 19:08:59.215949 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Nov 01 19:08:59.215949 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:08:59.223484 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-8f6fd7a8-42be-45e8-a2f5-70707f4d5d78 tempest-KeyPairsNegativeTestJSON-453844394 tempest-KeyPairsNegativeTestJSON-453844394-project] Returning 400 to user: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] {{(pid=121403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 01 19:08:59.223484 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-8f6fd7a8-42be-45e8-a2f5-70707f4d5d78 tempest-KeyPairsNegativeTestJSON-453844394 tempest-KeyPairsNegativeTestJSON-453844394-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 400 len: 193 microversion: 2.1 time: 0.308980 Nov 01 19:08:59.223484 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1842/3586] 10.222.0.13 () {60 vars in 1159 bytes} [Tue Nov 1 19:08:58 2022] POST /compute/v2.1/os-keypairs => generated 193 bytes in 310 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 01 19:08:59.228469 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-928030ae-ed20-482b-b1fb-b54ac7ab32e9 tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:08:59.230655 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-928030ae-ed20-482b-b1fb-b54ac7ab32e9 tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] [instance: 77d6f571-5742-462c-ada0-1b05dd1561d1] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:08:59.239813 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-928030ae-ed20-482b-b1fb-b54ac7ab32e9 tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:08:59.241585 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-928030ae-ed20-482b-b1fb-b54ac7ab32e9 tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:08:59.242242 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-928030ae-ed20-482b-b1fb-b54ac7ab32e9 tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:08:59.243255 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-928030ae-ed20-482b-b1fb-b54ac7ab32e9 tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:08:59.244051 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-928030ae-ed20-482b-b1fb-b54ac7ab32e9 tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:08:59.244977 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-928030ae-ed20-482b-b1fb-b54ac7ab32e9 tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:08:59.324314 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.network.neutron [None req-6c88a8bb-ea9c-496e-85b1-c0172ea985b7 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] [instance: 8485db2a-fd8f-4615-bbe0-14822ad44194] Updating instance_info_cache with network_info: [] {{(pid=121402) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Nov 01 19:08:59.395026 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-928030ae-ed20-482b-b1fb-b54ac7ab32e9 tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57ba6eeb99714c7cabb14f484968e269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a0c0985c7b9450a8b622b6761e5b5c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:08:59.409737 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-928030ae-ed20-482b-b1fb-b54ac7ab32e9 tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57ba6eeb99714c7cabb14f484968e269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a0c0985c7b9450a8b622b6761e5b5c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:08:59.411648 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-928030ae-ed20-482b-b1fb-b54ac7ab32e9 tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57ba6eeb99714c7cabb14f484968e269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a0c0985c7b9450a8b622b6761e5b5c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:08:59.414443 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-928030ae-ed20-482b-b1fb-b54ac7ab32e9 tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] 10.222.0.13 "GET /compute/v2.1/servers/77d6f571-5742-462c-ada0-1b05dd1561d1" status: 200 len: 1366 microversion: 2.47 time: 0.189967 Nov 01 19:08:59.421399 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1843/3587] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 19:08:59 2022] GET /compute/v2.1/servers/77d6f571-5742-462c-ada0-1b05dd1561d1 => generated 1366 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 19:08:59.434349 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-a5b225a6-5709-42cd-9d0e-18ae5685b7a2 tempest-KeyPairsNegativeTestJSON-453844394 tempest-KeyPairsNegativeTestJSON-453844394-project] Action: 'create', calling method: .version_select at 0x7f0ae67fff70>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-2022271341", "public_key": "ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu"}} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:08:59.461927 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.quota [None req-a5b225a6-5709-42cd-9d0e-18ae5685b7a2 tempest-KeyPairsNegativeTestJSON-453844394 tempest-KeyPairsNegativeTestJSON-453844394-project] Getting quotas for project 6f01650f0109463fb6bf763d88a94b11. Resources: {'key_pairs'} {{(pid=121403) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 01 19:08:59.484050 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.quota [None req-a5b225a6-5709-42cd-9d0e-18ae5685b7a2 tempest-KeyPairsNegativeTestJSON-453844394 tempest-KeyPairsNegativeTestJSON-453844394-project] Getting quotas for user 678e6aae64334e0a934f215be174d0c5 and project 6f01650f0109463fb6bf763d88a94b11. Resources: {'key_pairs'} {{(pid=121403) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 01 19:08:59.528907 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.wsgi [None req-a5b225a6-5709-42cd-9d0e-18ae5685b7a2 tempest-KeyPairsNegativeTestJSON-453844394 tempest-KeyPairsNegativeTestJSON-453844394-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Nov 01 19:08:59.551396 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-a5b225a6-5709-42cd-9d0e-18ae5685b7a2 tempest-KeyPairsNegativeTestJSON-453844394 tempest-KeyPairsNegativeTestJSON-453844394-project] Request method failure captured: Nov 01 19:08:59.551396 n-d-863052-2 devstack@n-api.service[121403]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Nov 01 19:08:59.551396 n-d-863052-2 devstack@n-api.service[121403]: Accept: application/json Nov 01 19:08:59.551396 n-d-863052-2 devstack@n-api.service[121403]: Accept-Encoding: identity Nov 01 19:08:59.551396 n-d-863052-2 devstack@n-api.service[121403]: Connection: close Nov 01 19:08:59.551396 n-d-863052-2 devstack@n-api.service[121403]: Content-Length: 2167 Nov 01 19:08:59.551396 n-d-863052-2 devstack@n-api.service[121403]: Content-Type: application/json Nov 01 19:08:59.551396 n-d-863052-2 devstack@n-api.service[121403]: Host: 10.222.0.13 Nov 01 19:08:59.551396 n-d-863052-2 devstack@n-api.service[121403]: Openstack-System-Scope: None Nov 01 19:08:59.551396 n-d-863052-2 devstack@n-api.service[121403]: User-Agent: python-urllib3/1.26.12 Nov 01 19:08:59.551396 n-d-863052-2 devstack@n-api.service[121403]: X-Auth-Token: gAAAAABjYW7K3Hp-TkIHHJgdY0OsPlPPQsGcFRUPZ_DDVp5KYwxSj3GH_6fK242NiPOXtgFbiqrvdKU0C6MORaIEPoigoW6OE38EyiudSLlgB84PBUu7nsFa1kVJkpcgBnOlC86zMlf-bydlGrW62474iKRQIoAYW-rk-ECeGtrVfTMDprEHXzs Nov 01 19:08:59.551396 n-d-863052-2 devstack@n-api.service[121403]: X-Domain-Id: None Nov 01 19:08:59.551396 n-d-863052-2 devstack@n-api.service[121403]: X-Domain-Name: None Nov 01 19:08:59.551396 n-d-863052-2 devstack@n-api.service[121403]: X-Identity-Status: Confirmed Nov 01 19:08:59.551396 n-d-863052-2 devstack@n-api.service[121403]: X-Is-Admin-Project: True Nov 01 19:08:59.551396 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Domain-Id: default Nov 01 19:08:59.551396 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Domain-Name: Default Nov 01 19:08:59.551396 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Id: 6f01650f0109463fb6bf763d88a94b11 Nov 01 19:08:59.551396 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-453844394 Nov 01 19:08:59.551396 n-d-863052-2 devstack@n-api.service[121403]: X-Role: member,reader Nov 01 19:08:59.551396 n-d-863052-2 devstack@n-api.service[121403]: X-Roles: member,reader Nov 01 19:08:59.551396 n-d-863052-2 devstack@n-api.service[121403]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/6f01650f0109463fb6bf763d88a94b11"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/6f01650f0109463fb6bf763d88a94b11"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_6f01650f0109463fb6bf763d88a94b11", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/6f01650f0109463fb6bf763d88a94b11"}]}] Nov 01 19:08:59.551396 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant: tempest-KeyPairsNegativeTestJSON-453844394 Nov 01 19:08:59.551396 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant-Id: 6f01650f0109463fb6bf763d88a94b11 Nov 01 19:08:59.551396 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-453844394 Nov 01 19:08:59.551396 n-d-863052-2 devstack@n-api.service[121403]: X-User: tempest-KeyPairsNegativeTestJSON-453844394-project Nov 01 19:08:59.551396 n-d-863052-2 devstack@n-api.service[121403]: X-User-Domain-Id: default Nov 01 19:08:59.551396 n-d-863052-2 devstack@n-api.service[121403]: X-User-Domain-Name: Default Nov 01 19:08:59.551396 n-d-863052-2 devstack@n-api.service[121403]: X-User-Id: 678e6aae64334e0a934f215be174d0c5 Nov 01 19:08:59.551396 n-d-863052-2 devstack@n-api.service[121403]: X-User-Name: tempest-KeyPairsNegativeTestJSON-453844394-project Nov 01 19:08:59.551396 n-d-863052-2 devstack@n-api.service[121403]: Nov 01 19:08:59.551396 n-d-863052-2 devstack@n-api.service[121403]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-2022271341", "public_key": "ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu"}} Nov 01 19:08:59.551396 n-d-863052-2 devstack@n-api.service[121403]: method: Nov 01 19:08:59.551396 n-d-863052-2 devstack@n-api.service[121403]: exception: Keypair data is invalid: failed to generate fingerprint Nov 01 19:08:59.553874 n-d-863052-2 devstack@n-api.service[121403]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-2022271341', 'public_key': 'ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu'}}} Nov 01 19:08:59.553874 n-d-863052-2 devstack@n-api.service[121403]: {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 01 19:08:59.553874 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:08:59.553874 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Nov 01 19:08:59.553874 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Nov 01 19:08:59.553874 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 666, in load_ssh_public_key Nov 01 19:08:59.553874 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid key format") Nov 01 19:08:59.553874 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi ValueError: Invalid key format Nov 01 19:08:59.553874 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:08:59.553874 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:08:59.553874 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:08:59.553874 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:08:59.553874 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Nov 01 19:08:59.553874 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Nov 01 19:08:59.553874 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Nov 01 19:08:59.553874 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Nov 01 19:08:59.553874 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 01 19:08:59.553874 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 01 19:08:59.553874 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 01 19:08:59.553874 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise self.value Nov 01 19:08:59.553874 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Nov 01 19:08:59.553874 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Nov 01 19:08:59.553874 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6774, in import_key_pair Nov 01 19:08:59.553874 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Nov 01 19:08:59.553874 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6847, in _generate_fingerprint Nov 01 19:08:59.553874 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Nov 01 19:08:59.553874 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Nov 01 19:08:59.553874 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Nov 01 19:08:59.553874 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Nov 01 19:08:59.553874 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:08:59.553874 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:08:59.553874 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:08:59.553874 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:08:59.553874 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:08:59.553874 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:08:59.553874 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 01 19:08:59.553874 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 01 19:08:59.553874 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 01 19:08:59.553874 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 01 19:08:59.553874 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 01 19:08:59.553874 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 01 19:08:59.556491 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 01 19:08:59.556491 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 01 19:08:59.556491 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 01 19:08:59.556491 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 01 19:08:59.556491 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Nov 01 19:08:59.556491 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return self._create(req, body) Nov 01 19:08:59.556491 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Nov 01 19:08:59.556491 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Nov 01 19:08:59.556491 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Nov 01 19:08:59.556491 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:08:59.556491 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:08:59.556491 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:08:59.556491 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:08:59.556491 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:08:59.556491 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:08:59.556491 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 01 19:08:59.556491 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 01 19:08:59.556491 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Nov 01 19:08:59.556491 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:08:59.564094 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-a5b225a6-5709-42cd-9d0e-18ae5685b7a2 tempest-KeyPairsNegativeTestJSON-453844394 tempest-KeyPairsNegativeTestJSON-453844394-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=121403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 01 19:08:59.565338 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-a5b225a6-5709-42cd-9d0e-18ae5685b7a2 tempest-KeyPairsNegativeTestJSON-453844394 tempest-KeyPairsNegativeTestJSON-453844394-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.137809 Nov 01 19:08:59.566188 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1844/3588] 10.222.0.13 () {60 vars in 1160 bytes} [Tue Nov 1 19:08:59 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 144 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Nov 01 19:08:59.578846 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-ef7fca16-e91d-4024-83ac-5bf51e2d948b tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:08:59.579707 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-ef7fca16-e91d-4024-83ac-5bf51e2d948b tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] [instance: 34597ed3-08c9-4c33-b47a-56a9ad5ff70c] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:08:59.592030 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-ef7fca16-e91d-4024-83ac-5bf51e2d948b tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:08:59.595048 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-ef7fca16-e91d-4024-83ac-5bf51e2d948b tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:08:59.595752 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-ef7fca16-e91d-4024-83ac-5bf51e2d948b tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:08:59.596919 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-ef7fca16-e91d-4024-83ac-5bf51e2d948b tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:08:59.599552 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-ef7fca16-e91d-4024-83ac-5bf51e2d948b tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:08:59.601231 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-ef7fca16-e91d-4024-83ac-5bf51e2d948b tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:08:59.748277 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-6c88a8bb-ea9c-496e-85b1-c0172ea985b7 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] 10.222.0.13 "DELETE /compute/v2.1/servers/8485db2a-fd8f-4615-bbe0-14822ad44194" status: 204 len: 0 microversion: 2.1 time: 2.762331 Nov 01 19:08:59.749489 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1745/3589] 10.222.0.13 () {58 vars in 1239 bytes} [Tue Nov 1 19:08:56 2022] DELETE /compute/v2.1/servers/8485db2a-fd8f-4615-bbe0-14822ad44194 => generated 0 bytes in 2764 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 01 19:08:59.754964 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [req-5904ee40-3d98-4d16-bfdc-4e8079504d90 req-c0b676c5-a9ca-477a-b512-4dc11efbdd06 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8485db2a-fd8f-4615-bbe0-14822ad44194", "name": "network-vif-deleted", "tag": "01274861-72a7-4685-9ca3-9bdd9e739056"}]} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:08:59.774022 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-5904ee40-3d98-4d16-bfdc-4e8079504d90 req-c0b676c5-a9ca-477a-b512-4dc11efbdd06 service nova] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:08:59.774522 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-5904ee40-3d98-4d16-bfdc-4e8079504d90 req-c0b676c5-a9ca-477a-b512-4dc11efbdd06 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:08:59.774956 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-5904ee40-3d98-4d16-bfdc-4e8079504d90 req-c0b676c5-a9ca-477a-b512-4dc11efbdd06 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:08:59.805503 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.compute.server_external_events [req-5904ee40-3d98-4d16-bfdc-4e8079504d90 req-c0b676c5-a9ca-477a-b512-4dc11efbdd06 service nova] Unable to find a host for instance 8485db2a-fd8f-4615-bbe0-14822ad44194. Dropping event network-vif-deleted {{(pid=121402) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Nov 01 19:08:59.806426 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [req-5904ee40-3d98-4d16-bfdc-4e8079504d90 req-c0b676c5-a9ca-477a-b512-4dc11efbdd06 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.055788 Nov 01 19:08:59.807033 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1746/3590] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Nov 1 19:08:59 2022] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 57 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Nov 01 19:08:59.812181 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-b6b0a047-b908-45c7-aa22-73d3ac971ac0 tempest-KeyPairsNegativeTestJSON-453844394 tempest-KeyPairsNegativeTestJSON-453844394-project] Action: 'create', calling method: .version_select at 0x7f0ae1aa8670>, body: {"keypair": {"name": "tempest-keypair-634857727", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBcCnf7zjxuCDuJlSVT9j9QLYpw/ZbT3KvJRp4nm7KTdjxZeVukFwsJZf11cqX+ovhChBlu5LR99/y11sUe4A8cZWp/1bBbWEfahU+fqbFyAudwP08+Dymsy1J5Ze6DyWQ=="}} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:08:59.855769 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.quota [None req-b6b0a047-b908-45c7-aa22-73d3ac971ac0 tempest-KeyPairsNegativeTestJSON-453844394 tempest-KeyPairsNegativeTestJSON-453844394-project] Getting quotas for project 6f01650f0109463fb6bf763d88a94b11. Resources: {'key_pairs'} {{(pid=121402) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 01 19:08:59.868491 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.quota [None req-b6b0a047-b908-45c7-aa22-73d3ac971ac0 tempest-KeyPairsNegativeTestJSON-453844394 tempest-KeyPairsNegativeTestJSON-453844394-project] Getting quotas for user 678e6aae64334e0a934f215be174d0c5 and project 6f01650f0109463fb6bf763d88a94b11. Resources: {'key_pairs'} {{(pid=121402) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 01 19:08:59.884054 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-ef7fca16-e91d-4024-83ac-5bf51e2d948b tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113bd8c844ee490b86a68bc7e1e75da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '851785a5f76548898a77d67792888504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:08:59.893869 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-ef7fca16-e91d-4024-83ac-5bf51e2d948b tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] 10.222.0.13 "GET /compute/v2.1/servers/34597ed3-08c9-4c33-b47a-56a9ad5ff70c" status: 200 len: 1308 microversion: 2.1 time: 0.326336 Nov 01 19:08:59.912700 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1845/3591] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:08:59 2022] GET /compute/v2.1/servers/34597ed3-08c9-4c33-b47a-56a9ad5ff70c => generated 1308 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:08:59.916119 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-b6b0a047-b908-45c7-aa22-73d3ac971ac0 tempest-KeyPairsNegativeTestJSON-453844394 tempest-KeyPairsNegativeTestJSON-453844394-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.107755 Nov 01 19:08:59.919737 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1747/3592] 10.222.0.13 () {60 vars in 1159 bytes} [Tue Nov 1 19:08:59 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:08:59.921940 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-9b3f4979-34c1-4ea1-adb6-44d4f88d2086 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:08:59.922866 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-9b3f4979-34c1-4ea1-adb6-44d4f88d2086 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] [instance: 8485db2a-fd8f-4615-bbe0-14822ad44194] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:08:59.931895 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-45eea337-5619-49c7-98cb-27eee3a52fca tempest-KeyPairsNegativeTestJSON-453844394 tempest-KeyPairsNegativeTestJSON-453844394-project] Action: 'create', calling method: .version_select at 0x7f0ae17bc670>, body: {"keypair": {"name": "tempest-keypair-634857727", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKowuexHEszUmYYpSqmwCvvmGjtZbO1ytq4opMQ1Of8Asm5VhgCqsBzuhxnqsMi992APZ9ZCp0ZPC0ZTxjBD6VfIyJ273KTvI3UFbI3s4Dp4kZjrJKmK2qilfXb6kxAgGQ=="}} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:08:59.942429 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-9b3f4979-34c1-4ea1-adb6-44d4f88d2086 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:08:59.943163 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-9b3f4979-34c1-4ea1-adb6-44d4f88d2086 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:08:59.944397 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-9b3f4979-34c1-4ea1-adb6-44d4f88d2086 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:08:59.945308 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-9b3f4979-34c1-4ea1-adb6-44d4f88d2086 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:08:59.945758 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-9b3f4979-34c1-4ea1-adb6-44d4f88d2086 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:08:59.946364 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-9b3f4979-34c1-4ea1-adb6-44d4f88d2086 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:08:59.961785 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.quota [None req-45eea337-5619-49c7-98cb-27eee3a52fca tempest-KeyPairsNegativeTestJSON-453844394 tempest-KeyPairsNegativeTestJSON-453844394-project] Getting quotas for project 6f01650f0109463fb6bf763d88a94b11. Resources: {'key_pairs'} {{(pid=121402) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 01 19:08:59.969406 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.quota [None req-45eea337-5619-49c7-98cb-27eee3a52fca tempest-KeyPairsNegativeTestJSON-453844394 tempest-KeyPairsNegativeTestJSON-453844394-project] Getting quotas for user 678e6aae64334e0a934f215be174d0c5 and project 6f01650f0109463fb6bf763d88a94b11. Resources: {'key_pairs'} {{(pid=121402) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 01 19:08:59.976018 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.wsgi [None req-9b3f4979-34c1-4ea1-adb6-44d4f88d2086 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] HTTP exception thrown: Instance 8485db2a-fd8f-4615-bbe0-14822ad44194 could not be found. Nov 01 19:08:59.982016 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-9b3f4979-34c1-4ea1-adb6-44d4f88d2086 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Request method failure captured: Nov 01 19:08:59.982016 n-d-863052-2 devstack@n-api.service[121403]: request: GET /compute/v2.1/servers/8485db2a-fd8f-4615-bbe0-14822ad44194 HTTP/1.1 Nov 01 19:08:59.982016 n-d-863052-2 devstack@n-api.service[121403]: Accept: application/json Nov 01 19:08:59.982016 n-d-863052-2 devstack@n-api.service[121403]: Accept-Encoding: identity Nov 01 19:08:59.982016 n-d-863052-2 devstack@n-api.service[121403]: Connection: close Nov 01 19:08:59.982016 n-d-863052-2 devstack@n-api.service[121403]: Content-Length: 0 Nov 01 19:08:59.982016 n-d-863052-2 devstack@n-api.service[121403]: Content-Type: application/json Nov 01 19:08:59.982016 n-d-863052-2 devstack@n-api.service[121403]: Host: 10.222.0.13 Nov 01 19:08:59.982016 n-d-863052-2 devstack@n-api.service[121403]: Openstack-System-Scope: None Nov 01 19:08:59.982016 n-d-863052-2 devstack@n-api.service[121403]: User-Agent: python-urllib3/1.26.12 Nov 01 19:08:59.982016 n-d-863052-2 devstack@n-api.service[121403]: X-Auth-Token: gAAAAABjYW3ByfBI9VCjWikZSFUz_hPClqqMancoCxnwBX6xqaMeeugycqMQyEPQybXqoeO46TFhJ9TITtoJFiSbS9Ry6pB9Kueb-hoVnQBV0e7qQWXwvcx4eB_AomP3ogOCXvqhfUnxVmmooBEoQbpvBIMsXQEjVVdPObNP8WS9oGjTsTTTO4o Nov 01 19:08:59.982016 n-d-863052-2 devstack@n-api.service[121403]: X-Domain-Id: None Nov 01 19:08:59.982016 n-d-863052-2 devstack@n-api.service[121403]: X-Domain-Name: None Nov 01 19:08:59.982016 n-d-863052-2 devstack@n-api.service[121403]: X-Identity-Status: Confirmed Nov 01 19:08:59.982016 n-d-863052-2 devstack@n-api.service[121403]: X-Is-Admin-Project: True Nov 01 19:08:59.982016 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Domain-Id: default Nov 01 19:08:59.982016 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Domain-Name: Default Nov 01 19:08:59.982016 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Id: 1ee9dc49b89143f781e4ab30296e4d01 Nov 01 19:08:59.982016 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Name: tempest-DeleteServersTestJSON-412339701 Nov 01 19:08:59.982016 n-d-863052-2 devstack@n-api.service[121403]: X-Role: member,reader Nov 01 19:08:59.982016 n-d-863052-2 devstack@n-api.service[121403]: X-Roles: member,reader Nov 01 19:08:59.982016 n-d-863052-2 devstack@n-api.service[121403]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/1ee9dc49b89143f781e4ab30296e4d01"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/1ee9dc49b89143f781e4ab30296e4d01"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_1ee9dc49b89143f781e4ab30296e4d01", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/1ee9dc49b89143f781e4ab30296e4d01"}]}] Nov 01 19:08:59.982016 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant: tempest-DeleteServersTestJSON-412339701 Nov 01 19:08:59.982016 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant-Id: 1ee9dc49b89143f781e4ab30296e4d01 Nov 01 19:08:59.982016 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant-Name: tempest-DeleteServersTestJSON-412339701 Nov 01 19:08:59.982016 n-d-863052-2 devstack@n-api.service[121403]: X-User: tempest-DeleteServersTestJSON-412339701-project Nov 01 19:08:59.982016 n-d-863052-2 devstack@n-api.service[121403]: X-User-Domain-Id: default Nov 01 19:08:59.982016 n-d-863052-2 devstack@n-api.service[121403]: X-User-Domain-Name: Default Nov 01 19:08:59.982016 n-d-863052-2 devstack@n-api.service[121403]: X-User-Id: 058480d92c9b4ab4af6815d0438a65c7 Nov 01 19:08:59.982016 n-d-863052-2 devstack@n-api.service[121403]: X-User-Name: tempest-DeleteServersTestJSON-412339701-project Nov 01 19:08:59.982016 n-d-863052-2 devstack@n-api.service[121403]: method: > Nov 01 19:08:59.982016 n-d-863052-2 devstack@n-api.service[121403]: exception: Instance 8485db2a-fd8f-4615-bbe0-14822ad44194 could not be found. Nov 01 19:08:59.982016 n-d-863052-2 devstack@n-api.service[121403]: action_args: {'id': '8485db2a-fd8f-4615-bbe0-14822ad44194'} Nov 01 19:08:59.982016 n-d-863052-2 devstack@n-api.service[121403]: {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 01 19:08:59.982016 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:08:59.982016 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 01 19:08:59.982016 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 01 19:08:59.982016 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 01 19:08:59.982016 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 01 19:08:59.982016 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 01 19:08:59.982016 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 01 19:08:59.982016 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 01 19:08:59.982016 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 01 19:08:59.982016 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8485db2a-fd8f-4615-bbe0-14822ad44194 could not be found. Nov 01 19:08:59.982016 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:08:59.982016 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:08:59.982016 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:08:59.982016 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:08:59.982016 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:08:59.982016 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:08:59.982016 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 01 19:08:59.982016 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 01 19:08:59.982016 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 01 19:08:59.982016 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 01 19:08:59.982016 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 01 19:08:59.982016 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 01 19:08:59.982016 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 01 19:08:59.982016 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 01 19:08:59.982016 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 01 19:08:59.982016 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 01 19:08:59.982016 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8485db2a-fd8f-4615-bbe0-14822ad44194 could not be found. Nov 01 19:08:59.982016 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:08:59.982016 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:08:59.982016 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:08:59.987333 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:08:59.987333 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:08:59.987333 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:08:59.987333 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 01 19:08:59.987333 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 01 19:08:59.987333 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8485db2a-fd8f-4615-bbe0-14822ad44194 could not be found. Nov 01 19:08:59.987333 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:08:59.987333 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-9b3f4979-34c1-4ea1-adb6-44d4f88d2086 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Returning 404 to user: Instance 8485db2a-fd8f-4615-bbe0-14822ad44194 could not be found. {{(pid=121403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 01 19:08:59.987333 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-9b3f4979-34c1-4ea1-adb6-44d4f88d2086 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] 10.222.0.13 "GET /compute/v2.1/servers/8485db2a-fd8f-4615-bbe0-14822ad44194" status: 404 len: 111 microversion: 2.1 time: 0.069266 Nov 01 19:08:59.987333 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1846/3593] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:08:59 2022] GET /compute/v2.1/servers/8485db2a-fd8f-4615-bbe0-14822ad44194 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 01 19:09:00.018270 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.wsgi [None req-45eea337-5619-49c7-98cb-27eee3a52fca tempest-KeyPairsNegativeTestJSON-453844394 tempest-KeyPairsNegativeTestJSON-453844394-project] HTTP exception thrown: Key pair 'tempest-keypair-634857727' already exists. Nov 01 19:09:00.041721 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-45eea337-5619-49c7-98cb-27eee3a52fca tempest-KeyPairsNegativeTestJSON-453844394 tempest-KeyPairsNegativeTestJSON-453844394-project] Request method failure captured: Nov 01 19:09:00.041721 n-d-863052-2 devstack@n-api.service[121402]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Nov 01 19:09:00.041721 n-d-863052-2 devstack@n-api.service[121402]: Accept: application/json Nov 01 19:09:00.041721 n-d-863052-2 devstack@n-api.service[121402]: Accept-Encoding: identity Nov 01 19:09:00.041721 n-d-863052-2 devstack@n-api.service[121402]: Connection: close Nov 01 19:09:00.041721 n-d-863052-2 devstack@n-api.service[121402]: Content-Length: 272 Nov 01 19:09:00.041721 n-d-863052-2 devstack@n-api.service[121402]: Content-Type: application/json Nov 01 19:09:00.041721 n-d-863052-2 devstack@n-api.service[121402]: Host: 10.222.0.13 Nov 01 19:09:00.041721 n-d-863052-2 devstack@n-api.service[121402]: Openstack-System-Scope: None Nov 01 19:09:00.041721 n-d-863052-2 devstack@n-api.service[121402]: User-Agent: python-urllib3/1.26.12 Nov 01 19:09:00.041721 n-d-863052-2 devstack@n-api.service[121402]: X-Auth-Token: gAAAAABjYW7K3Hp-TkIHHJgdY0OsPlPPQsGcFRUPZ_DDVp5KYwxSj3GH_6fK242NiPOXtgFbiqrvdKU0C6MORaIEPoigoW6OE38EyiudSLlgB84PBUu7nsFa1kVJkpcgBnOlC86zMlf-bydlGrW62474iKRQIoAYW-rk-ECeGtrVfTMDprEHXzs Nov 01 19:09:00.041721 n-d-863052-2 devstack@n-api.service[121402]: X-Domain-Id: None Nov 01 19:09:00.041721 n-d-863052-2 devstack@n-api.service[121402]: X-Domain-Name: None Nov 01 19:09:00.041721 n-d-863052-2 devstack@n-api.service[121402]: X-Identity-Status: Confirmed Nov 01 19:09:00.041721 n-d-863052-2 devstack@n-api.service[121402]: X-Is-Admin-Project: True Nov 01 19:09:00.041721 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Domain-Id: default Nov 01 19:09:00.041721 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Domain-Name: Default Nov 01 19:09:00.041721 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Id: 6f01650f0109463fb6bf763d88a94b11 Nov 01 19:09:00.041721 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-453844394 Nov 01 19:09:00.041721 n-d-863052-2 devstack@n-api.service[121402]: X-Role: member,reader Nov 01 19:09:00.041721 n-d-863052-2 devstack@n-api.service[121402]: X-Roles: member,reader Nov 01 19:09:00.041721 n-d-863052-2 devstack@n-api.service[121402]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/6f01650f0109463fb6bf763d88a94b11"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/6f01650f0109463fb6bf763d88a94b11"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_6f01650f0109463fb6bf763d88a94b11", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/6f01650f0109463fb6bf763d88a94b11"}]}] Nov 01 19:09:00.041721 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant: tempest-KeyPairsNegativeTestJSON-453844394 Nov 01 19:09:00.041721 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant-Id: 6f01650f0109463fb6bf763d88a94b11 Nov 01 19:09:00.041721 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-453844394 Nov 01 19:09:00.041721 n-d-863052-2 devstack@n-api.service[121402]: X-User: tempest-KeyPairsNegativeTestJSON-453844394-project Nov 01 19:09:00.041721 n-d-863052-2 devstack@n-api.service[121402]: X-User-Domain-Id: default Nov 01 19:09:00.041721 n-d-863052-2 devstack@n-api.service[121402]: X-User-Domain-Name: Default Nov 01 19:09:00.041721 n-d-863052-2 devstack@n-api.service[121402]: X-User-Id: 678e6aae64334e0a934f215be174d0c5 Nov 01 19:09:00.041721 n-d-863052-2 devstack@n-api.service[121402]: X-User-Name: tempest-KeyPairsNegativeTestJSON-453844394-project Nov 01 19:09:00.041721 n-d-863052-2 devstack@n-api.service[121402]: Nov 01 19:09:00.041721 n-d-863052-2 devstack@n-api.service[121402]: {"keypair": {"name": "tempest-keypair-634857727", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKowuexHEszUmYYpSqmwCvvmGjtZbO1ytq4opMQ1Of8Asm5VhgCqsBzuhxnqsMi992APZ9ZCp0ZPC0ZTxjBD6VfIyJ273KTvI3UFbI3s4Dp4kZjrJKmK2qilfXb6kxAgGQ=="}} Nov 01 19:09:00.041721 n-d-863052-2 devstack@n-api.service[121402]: method: Nov 01 19:09:00.041721 n-d-863052-2 devstack@n-api.service[121402]: exception: Key pair 'tempest-keypair-634857727' already exists. Nov 01 19:09:00.041721 n-d-863052-2 devstack@n-api.service[121402]: action_args: {'body': {'keypair': {'name': 'tempest-keypair-634857727', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKowuexHEszUmYYpSqmwCvvmGjtZbO1ytq4opMQ1Of8Asm5VhgCqsBzuhxnqsMi992APZ9ZCp0ZPC0ZTxjBD6VfIyJ273KTvI3UFbI3s4Dp4kZjrJKmK2qilfXb6kxAgGQ=='}}} Nov 01 19:09:00.041721 n-d-863052-2 devstack@n-api.service[121402]: {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 01 19:09:00.041721 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:09:00.041721 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Nov 01 19:09:00.041721 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Nov 01 19:09:00.041721 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Nov 01 19:09:00.041721 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Nov 01 19:09:00.041721 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Nov 01 19:09:00.041721 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi result = self._query(query) Nov 01 19:09:00.041721 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Nov 01 19:09:00.041721 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi conn.query(q) Nov 01 19:09:00.041721 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Nov 01 19:09:00.041721 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Nov 01 19:09:00.041721 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Nov 01 19:09:00.041721 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi result.read() Nov 01 19:09:00.041721 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Nov 01 19:09:00.041721 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Nov 01 19:09:00.041721 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Nov 01 19:09:00.041721 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Nov 01 19:09:00.041721 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Nov 01 19:09:00.041721 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Nov 01 19:09:00.041721 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Nov 01 19:09:00.041721 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Nov 01 19:09:00.041721 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry '678e6aae64334e0a934f215be174d0c5-tempest-keypair-634857727' for key 'key_pairs.uniq_key_pairs0user_id0name'") Nov 01 19:09:00.041721 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:09:00.045557 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Nov 01 19:09:00.045557 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:09:00.045557 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:09:00.045557 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 69, in _create_in_db Nov 01 19:09:00.045557 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi kp.save(context.session) Nov 01 19:09:00.045557 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Nov 01 19:09:00.045557 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi session.flush() Nov 01 19:09:00.045557 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Nov 01 19:09:00.045557 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi self._flush(objects) Nov 01 19:09:00.045557 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Nov 01 19:09:00.045557 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Nov 01 19:09:00.045557 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Nov 01 19:09:00.045557 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi compat.raise_( Nov 01 19:09:00.045557 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Nov 01 19:09:00.045557 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise exception Nov 01 19:09:00.045557 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Nov 01 19:09:00.045557 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi flush_context.execute() Nov 01 19:09:00.045557 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Nov 01 19:09:00.045557 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi rec.execute(self) Nov 01 19:09:00.045557 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Nov 01 19:09:00.045557 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Nov 01 19:09:00.045557 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Nov 01 19:09:00.045557 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Nov 01 19:09:00.045557 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Nov 01 19:09:00.045557 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Nov 01 19:09:00.045557 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Nov 01 19:09:00.045557 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Nov 01 19:09:00.045557 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Nov 01 19:09:00.045557 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Nov 01 19:09:00.045557 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Nov 01 19:09:00.045557 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Nov 01 19:09:00.045557 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Nov 01 19:09:00.045557 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Nov 01 19:09:00.045557 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Nov 01 19:09:00.045557 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Nov 01 19:09:00.045557 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Nov 01 19:09:00.045557 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise exception Nov 01 19:09:00.045557 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Nov 01 19:09:00.045557 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Nov 01 19:09:00.045557 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Nov 01 19:09:00.045557 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Nov 01 19:09:00.045557 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Nov 01 19:09:00.045557 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi result = self._query(query) Nov 01 19:09:00.045557 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Nov 01 19:09:00.045557 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi conn.query(q) Nov 01 19:09:00.045557 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Nov 01 19:09:00.045557 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Nov 01 19:09:00.045557 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Nov 01 19:09:00.045557 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi result.read() Nov 01 19:09:00.045557 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Nov 01 19:09:00.045557 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Nov 01 19:09:00.045557 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Nov 01 19:09:00.045557 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Nov 01 19:09:00.045557 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Nov 01 19:09:00.045557 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Nov 01 19:09:00.045557 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Nov 01 19:09:00.052725 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Nov 01 19:09:00.052725 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '678e6aae64334e0a934f215be174d0c5-tempest-keypair-634857727' for key 'key_pairs.uniq_key_pairs0user_id0name'") Nov 01 19:09:00.052725 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO key_pairs (created_at, updated_at, name, user_id, fingerprint, public_key, type) VALUES (%(created_at)s, %(updated_at)s, %(name)s, %(user_id)s, %(fingerprint)s, %(public_key)s, %(type)s)] Nov 01 19:09:00.052725 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 11, 1, 19, 8, 59, 999526), 'updated_at': None, 'name': 'tempest-keypair-634857727', 'user_id': '678e6aae64334e0a934f215be174d0c5', 'fingerprint': 'b6:a6:ac:55:3b:1b:ad:a4:72:bf:80:9a:e4:da:83:64', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKowuexHEszUmYYpSqmwCvvmGjtZbO1ytq4opMQ1Of8Asm5VhgCqsBzuhxnqsMi992APZ9ZCp0ZPC0ZTxjBD6VfIyJ273KTvI3UFbI3s4Dp4kZjrJKmK2qilfXb6kxAgGQ==', 'type': 'ssh'}] Nov 01 19:09:00.052725 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Nov 01 19:09:00.052725 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:09:00.052725 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:09:00.052725 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:09:00.052725 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:09:00.052725 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Nov 01 19:09:00.052725 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Nov 01 19:09:00.052725 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Nov 01 19:09:00.052725 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Nov 01 19:09:00.052725 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 01 19:09:00.052725 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 01 19:09:00.052725 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 01 19:09:00.052725 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise self.value Nov 01 19:09:00.052725 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Nov 01 19:09:00.052725 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Nov 01 19:09:00.052725 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6777, in import_key_pair Nov 01 19:09:00.052725 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi keypair.create() Nov 01 19:09:00.052725 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Nov 01 19:09:00.052725 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Nov 01 19:09:00.052725 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 158, in create Nov 01 19:09:00.052725 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi self._create() Nov 01 19:09:00.052725 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 162, in _create Nov 01 19:09:00.052725 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi db_keypair = self._create_in_db(self._context, updates) Nov 01 19:09:00.052725 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 134, in _create_in_db Nov 01 19:09:00.052725 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return _create_in_db(context, values) Nov 01 19:09:00.052725 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Nov 01 19:09:00.052725 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Nov 01 19:09:00.052725 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 71, in _create_in_db Nov 01 19:09:00.052725 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise exception.KeyPairExists(key_name=values['name']) Nov 01 19:09:00.052725 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi nova.exception.KeyPairExists: Key pair 'tempest-keypair-634857727' already exists. Nov 01 19:09:00.052725 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:09:00.052725 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:09:00.052725 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:09:00.052725 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:09:00.052725 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:09:00.052725 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:09:00.052725 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 01 19:09:00.052725 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 01 19:09:00.052725 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 01 19:09:00.052725 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 01 19:09:00.052725 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 01 19:09:00.052725 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 01 19:09:00.052725 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 01 19:09:00.052725 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 01 19:09:00.052725 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 01 19:09:00.052725 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 01 19:09:00.052725 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Nov 01 19:09:00.052725 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return self._create(req, body) Nov 01 19:09:00.052725 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 132, in _create Nov 01 19:09:00.052725 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=exc.format_message()) Nov 01 19:09:00.052725 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Key pair 'tempest-keypair-634857727' already exists. Nov 01 19:09:00.061024 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:09:00.061024 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:09:00.061024 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:09:00.061024 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:09:00.061024 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:09:00.061024 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:09:00.061024 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 01 19:09:00.061024 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 01 19:09:00.061024 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Key pair 'tempest-keypair-634857727' already exists. Nov 01 19:09:00.061024 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:09:00.061024 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-45eea337-5619-49c7-98cb-27eee3a52fca tempest-KeyPairsNegativeTestJSON-453844394 tempest-KeyPairsNegativeTestJSON-453844394-project] Returning 409 to user: Key pair 'tempest-keypair-634857727' already exists. {{(pid=121402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 01 19:09:00.061024 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-45eea337-5619-49c7-98cb-27eee3a52fca tempest-KeyPairsNegativeTestJSON-453844394 tempest-KeyPairsNegativeTestJSON-453844394-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 409 len: 104 microversion: 2.1 time: 0.117704 Nov 01 19:09:00.061024 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1748/3594] 10.222.0.13 () {60 vars in 1159 bytes} [Tue Nov 1 19:08:59 2022] POST /compute/v2.1/os-keypairs => generated 104 bytes in 119 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Nov 01 19:09:00.063044 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-64b0dc92-4893-4b78-8e59-e80474d9a3de tempest-KeyPairsNegativeTestJSON-453844394 tempest-KeyPairsNegativeTestJSON-453844394-project] Calling method '.version_select at 0x7f0ae20bb940>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:09:00.109589 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-64b0dc92-4893-4b78-8e59-e80474d9a3de tempest-KeyPairsNegativeTestJSON-453844394 tempest-KeyPairsNegativeTestJSON-453844394-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-634857727" status: 202 len: 0 microversion: 2.1 time: 0.057985 Nov 01 19:09:00.135542 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-0790ca45-0bf8-495a-8d0b-c524dbaf71e8 tempest-KeyPairsNegativeTestJSON-453844394 tempest-KeyPairsNegativeTestJSON-453844394-project] Action: 'create', calling method: .version_select at 0x7f0ae17bce50>, body: {"keypair": {"name": "", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO2mARl02nbRsLgegMODSF3qqCgrHPOO7lcGJExIuyl80spL/HxJi3a4bkl/CWrooM5md2XyitcfG+ZG00Y7P+e54ZNs57PP52EoBJHeFWgpLN1vDSvMcoo4dkrgfjfFGg=="}} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:09:00.139984 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1847/3595] 10.222.0.13 () {58 vars in 1218 bytes} [Tue Nov 1 19:09:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-634857727 => generated 0 bytes in 90 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 01 19:09:00.143362 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-0790ca45-0bf8-495a-8d0b-c524dbaf71e8 tempest-KeyPairsNegativeTestJSON-453844394 tempest-KeyPairsNegativeTestJSON-453844394-project] Request method failure captured: Nov 01 19:09:00.143362 n-d-863052-2 devstack@n-api.service[121402]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Nov 01 19:09:00.143362 n-d-863052-2 devstack@n-api.service[121402]: Accept: application/json Nov 01 19:09:00.143362 n-d-863052-2 devstack@n-api.service[121402]: Accept-Encoding: identity Nov 01 19:09:00.143362 n-d-863052-2 devstack@n-api.service[121402]: Connection: close Nov 01 19:09:00.143362 n-d-863052-2 devstack@n-api.service[121402]: Content-Length: 247 Nov 01 19:09:00.143362 n-d-863052-2 devstack@n-api.service[121402]: Content-Type: application/json Nov 01 19:09:00.143362 n-d-863052-2 devstack@n-api.service[121402]: Host: 10.222.0.13 Nov 01 19:09:00.143362 n-d-863052-2 devstack@n-api.service[121402]: Openstack-System-Scope: None Nov 01 19:09:00.143362 n-d-863052-2 devstack@n-api.service[121402]: User-Agent: python-urllib3/1.26.12 Nov 01 19:09:00.143362 n-d-863052-2 devstack@n-api.service[121402]: X-Auth-Token: gAAAAABjYW7K3Hp-TkIHHJgdY0OsPlPPQsGcFRUPZ_DDVp5KYwxSj3GH_6fK242NiPOXtgFbiqrvdKU0C6MORaIEPoigoW6OE38EyiudSLlgB84PBUu7nsFa1kVJkpcgBnOlC86zMlf-bydlGrW62474iKRQIoAYW-rk-ECeGtrVfTMDprEHXzs Nov 01 19:09:00.143362 n-d-863052-2 devstack@n-api.service[121402]: X-Domain-Id: None Nov 01 19:09:00.143362 n-d-863052-2 devstack@n-api.service[121402]: X-Domain-Name: None Nov 01 19:09:00.143362 n-d-863052-2 devstack@n-api.service[121402]: X-Identity-Status: Confirmed Nov 01 19:09:00.143362 n-d-863052-2 devstack@n-api.service[121402]: X-Is-Admin-Project: True Nov 01 19:09:00.143362 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Domain-Id: default Nov 01 19:09:00.143362 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Domain-Name: Default Nov 01 19:09:00.143362 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Id: 6f01650f0109463fb6bf763d88a94b11 Nov 01 19:09:00.143362 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-453844394 Nov 01 19:09:00.143362 n-d-863052-2 devstack@n-api.service[121402]: X-Role: member,reader Nov 01 19:09:00.143362 n-d-863052-2 devstack@n-api.service[121402]: X-Roles: member,reader Nov 01 19:09:00.143362 n-d-863052-2 devstack@n-api.service[121402]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/6f01650f0109463fb6bf763d88a94b11"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/6f01650f0109463fb6bf763d88a94b11"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_6f01650f0109463fb6bf763d88a94b11", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/6f01650f0109463fb6bf763d88a94b11"}]}] Nov 01 19:09:00.143362 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant: tempest-KeyPairsNegativeTestJSON-453844394 Nov 01 19:09:00.143362 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant-Id: 6f01650f0109463fb6bf763d88a94b11 Nov 01 19:09:00.143362 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-453844394 Nov 01 19:09:00.143362 n-d-863052-2 devstack@n-api.service[121402]: X-User: tempest-KeyPairsNegativeTestJSON-453844394-project Nov 01 19:09:00.143362 n-d-863052-2 devstack@n-api.service[121402]: X-User-Domain-Id: default Nov 01 19:09:00.143362 n-d-863052-2 devstack@n-api.service[121402]: X-User-Domain-Name: Default Nov 01 19:09:00.143362 n-d-863052-2 devstack@n-api.service[121402]: X-User-Id: 678e6aae64334e0a934f215be174d0c5 Nov 01 19:09:00.143362 n-d-863052-2 devstack@n-api.service[121402]: X-User-Name: tempest-KeyPairsNegativeTestJSON-453844394-project Nov 01 19:09:00.143362 n-d-863052-2 devstack@n-api.service[121402]: Nov 01 19:09:00.143362 n-d-863052-2 devstack@n-api.service[121402]: {"keypair": {"name": "", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO2mARl02nbRsLgegMODSF3qqCgrHPOO7lcGJExIuyl80spL/HxJi3a4bkl/CWrooM5md2XyitcfG+ZG00Y7P+e54ZNs57PP52EoBJHeFWgpLN1vDSvMcoo4dkrgfjfFGg=="}} Nov 01 19:09:00.143362 n-d-863052-2 devstack@n-api.service[121402]: method: Nov 01 19:09:00.143362 n-d-863052-2 devstack@n-api.service[121402]: exception: Invalid input for field/attribute name. Value: . '' is too short Nov 01 19:09:00.143362 n-d-863052-2 devstack@n-api.service[121402]: action_args: {'body': {'keypair': {'name': '', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO2mARl02nbRsLgegMODSF3qqCgrHPOO7lcGJExIuyl80spL/HxJi3a4bkl/CWrooM5md2XyitcfG+ZG00Y7P+e54ZNs57PP52EoBJHeFWgpLN1vDSvMcoo4dkrgfjfFGg=='}}} Nov 01 19:09:00.143362 n-d-863052-2 devstack@n-api.service[121402]: {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 01 19:09:00.143362 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:09:00.143362 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Nov 01 19:09:00.143362 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Nov 01 19:09:00.143362 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Nov 01 19:09:00.143362 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise error Nov 01 19:09:00.143362 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Nov 01 19:09:00.143362 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:09:00.143362 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['keypair']['properties']['name']['allOf'][0]: Nov 01 19:09:00.143362 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Nov 01 19:09:00.143362 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:09:00.143362 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi On instance['keypair']: Nov 01 19:09:00.143362 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi '' Nov 01 19:09:00.143362 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:09:00.143362 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:09:00.143362 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:09:00.143362 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:09:00.143362 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:09:00.143362 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:09:00.143362 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 01 19:09:00.143362 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 01 19:09:00.143362 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 01 19:09:00.143362 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 01 19:09:00.143362 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 01 19:09:00.143362 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 01 19:09:00.143362 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 01 19:09:00.143362 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 01 19:09:00.143362 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Nov 01 19:09:00.143362 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Nov 01 19:09:00.149129 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Nov 01 19:09:00.149129 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Nov 01 19:09:00.149129 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Nov 01 19:09:00.149129 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Nov 01 19:09:00.149129 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Nov 01 19:09:00.149129 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:09:00.149129 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:09:00.149129 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:09:00.149129 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:09:00.149129 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:09:00.149129 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:09:00.149129 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Nov 01 19:09:00.149129 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Nov 01 19:09:00.149129 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Nov 01 19:09:00.149129 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:09:00.151794 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-0790ca45-0bf8-495a-8d0b-c524dbaf71e8 tempest-KeyPairsNegativeTestJSON-453844394 tempest-KeyPairsNegativeTestJSON-453844394-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=121402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 01 19:09:00.152939 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-0790ca45-0bf8-495a-8d0b-c524dbaf71e8 tempest-KeyPairsNegativeTestJSON-453844394 tempest-KeyPairsNegativeTestJSON-453844394-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 400 len: 108 microversion: 2.1 time: 0.028861 Nov 01 19:09:00.159232 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1749/3596] 10.222.0.13 () {60 vars in 1159 bytes} [Tue Nov 1 19:09:00 2022] POST /compute/v2.1/os-keypairs => generated 108 bytes in 39 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 01 19:09:00.164375 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-83998fbd-0aac-4d35-8d88-a0e5950f44bf tempest-KeyPairsNegativeTestJSON-453844394 tempest-KeyPairsNegativeTestJSON-453844394-project] Action: 'create', calling method: .version_select at 0x7f0ae20f2f70>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-563238016", "public_key": " "}} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:09:00.216257 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.quota [None req-83998fbd-0aac-4d35-8d88-a0e5950f44bf tempest-KeyPairsNegativeTestJSON-453844394 tempest-KeyPairsNegativeTestJSON-453844394-project] Getting quotas for project 6f01650f0109463fb6bf763d88a94b11. Resources: {'key_pairs'} {{(pid=121403) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 01 19:09:00.222502 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-dfc325bb-0b11-4b68-bdc9-b476cbdd6449 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1544333949", "imageRef": "2d4a0047-1b9e-445f-8af8-1b5c9d93e881", "flavorRef": "452", "networks": [{"uuid": "6da1da8d-6719-4a9a-851f-308df797b88a"}]}} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:09:00.233829 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.quota [None req-83998fbd-0aac-4d35-8d88-a0e5950f44bf tempest-KeyPairsNegativeTestJSON-453844394 tempest-KeyPairsNegativeTestJSON-453844394-project] Getting quotas for user 678e6aae64334e0a934f215be174d0c5 and project 6f01650f0109463fb6bf763d88a94b11. Resources: {'key_pairs'} {{(pid=121403) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 01 19:09:00.275449 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.wsgi [None req-83998fbd-0aac-4d35-8d88-a0e5950f44bf tempest-KeyPairsNegativeTestJSON-453844394 tempest-KeyPairsNegativeTestJSON-453844394-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Nov 01 19:09:00.290528 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-83998fbd-0aac-4d35-8d88-a0e5950f44bf tempest-KeyPairsNegativeTestJSON-453844394 tempest-KeyPairsNegativeTestJSON-453844394-project] Request method failure captured: Nov 01 19:09:00.290528 n-d-863052-2 devstack@n-api.service[121403]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Nov 01 19:09:00.290528 n-d-863052-2 devstack@n-api.service[121403]: Accept: application/json Nov 01 19:09:00.290528 n-d-863052-2 devstack@n-api.service[121403]: Accept-Encoding: identity Nov 01 19:09:00.290528 n-d-863052-2 devstack@n-api.service[121403]: Connection: close Nov 01 19:09:00.290528 n-d-863052-2 devstack@n-api.service[121403]: Content-Length: 94 Nov 01 19:09:00.290528 n-d-863052-2 devstack@n-api.service[121403]: Content-Type: application/json Nov 01 19:09:00.290528 n-d-863052-2 devstack@n-api.service[121403]: Host: 10.222.0.13 Nov 01 19:09:00.290528 n-d-863052-2 devstack@n-api.service[121403]: Openstack-System-Scope: None Nov 01 19:09:00.290528 n-d-863052-2 devstack@n-api.service[121403]: User-Agent: python-urllib3/1.26.12 Nov 01 19:09:00.290528 n-d-863052-2 devstack@n-api.service[121403]: X-Auth-Token: gAAAAABjYW7K3Hp-TkIHHJgdY0OsPlPPQsGcFRUPZ_DDVp5KYwxSj3GH_6fK242NiPOXtgFbiqrvdKU0C6MORaIEPoigoW6OE38EyiudSLlgB84PBUu7nsFa1kVJkpcgBnOlC86zMlf-bydlGrW62474iKRQIoAYW-rk-ECeGtrVfTMDprEHXzs Nov 01 19:09:00.290528 n-d-863052-2 devstack@n-api.service[121403]: X-Domain-Id: None Nov 01 19:09:00.290528 n-d-863052-2 devstack@n-api.service[121403]: X-Domain-Name: None Nov 01 19:09:00.290528 n-d-863052-2 devstack@n-api.service[121403]: X-Identity-Status: Confirmed Nov 01 19:09:00.290528 n-d-863052-2 devstack@n-api.service[121403]: X-Is-Admin-Project: True Nov 01 19:09:00.290528 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Domain-Id: default Nov 01 19:09:00.290528 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Domain-Name: Default Nov 01 19:09:00.290528 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Id: 6f01650f0109463fb6bf763d88a94b11 Nov 01 19:09:00.290528 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-453844394 Nov 01 19:09:00.290528 n-d-863052-2 devstack@n-api.service[121403]: X-Role: member,reader Nov 01 19:09:00.290528 n-d-863052-2 devstack@n-api.service[121403]: X-Roles: member,reader Nov 01 19:09:00.290528 n-d-863052-2 devstack@n-api.service[121403]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/6f01650f0109463fb6bf763d88a94b11"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/6f01650f0109463fb6bf763d88a94b11"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_6f01650f0109463fb6bf763d88a94b11", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/6f01650f0109463fb6bf763d88a94b11"}]}] Nov 01 19:09:00.290528 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant: tempest-KeyPairsNegativeTestJSON-453844394 Nov 01 19:09:00.290528 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant-Id: 6f01650f0109463fb6bf763d88a94b11 Nov 01 19:09:00.290528 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-453844394 Nov 01 19:09:00.290528 n-d-863052-2 devstack@n-api.service[121403]: X-User: tempest-KeyPairsNegativeTestJSON-453844394-project Nov 01 19:09:00.290528 n-d-863052-2 devstack@n-api.service[121403]: X-User-Domain-Id: default Nov 01 19:09:00.290528 n-d-863052-2 devstack@n-api.service[121403]: X-User-Domain-Name: Default Nov 01 19:09:00.290528 n-d-863052-2 devstack@n-api.service[121403]: X-User-Id: 678e6aae64334e0a934f215be174d0c5 Nov 01 19:09:00.290528 n-d-863052-2 devstack@n-api.service[121403]: X-User-Name: tempest-KeyPairsNegativeTestJSON-453844394-project Nov 01 19:09:00.290528 n-d-863052-2 devstack@n-api.service[121403]: Nov 01 19:09:00.290528 n-d-863052-2 devstack@n-api.service[121403]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-563238016", "public_key": " "}} Nov 01 19:09:00.290528 n-d-863052-2 devstack@n-api.service[121403]: method: Nov 01 19:09:00.290528 n-d-863052-2 devstack@n-api.service[121403]: exception: Keypair data is invalid: failed to generate fingerprint Nov 01 19:09:00.290528 n-d-863052-2 devstack@n-api.service[121403]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-563238016', 'public_key': ' '}}} Nov 01 19:09:00.290528 n-d-863052-2 devstack@n-api.service[121403]: {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 01 19:09:00.290528 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:09:00.290528 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Nov 01 19:09:00.290528 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Nov 01 19:09:00.290528 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 650, in load_ssh_public_key Nov 01 19:09:00.290528 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid line format") Nov 01 19:09:00.290528 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi ValueError: Invalid line format Nov 01 19:09:00.290528 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:09:00.290528 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:09:00.290528 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:09:00.290528 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:09:00.290528 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Nov 01 19:09:00.290528 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Nov 01 19:09:00.290528 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Nov 01 19:09:00.290528 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Nov 01 19:09:00.290528 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 01 19:09:00.290528 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 01 19:09:00.290528 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 01 19:09:00.290528 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise self.value Nov 01 19:09:00.290528 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Nov 01 19:09:00.290528 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Nov 01 19:09:00.290528 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6774, in import_key_pair Nov 01 19:09:00.290528 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Nov 01 19:09:00.290528 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6847, in _generate_fingerprint Nov 01 19:09:00.290528 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Nov 01 19:09:00.290528 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Nov 01 19:09:00.290528 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Nov 01 19:09:00.290528 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Nov 01 19:09:00.290528 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:09:00.290528 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:09:00.290528 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:09:00.295753 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:09:00.295753 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:09:00.295753 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:09:00.295753 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 01 19:09:00.295753 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 01 19:09:00.295753 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 01 19:09:00.295753 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 01 19:09:00.295753 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 01 19:09:00.295753 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 01 19:09:00.295753 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 01 19:09:00.295753 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 01 19:09:00.295753 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 01 19:09:00.295753 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 01 19:09:00.295753 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Nov 01 19:09:00.295753 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return self._create(req, body) Nov 01 19:09:00.295753 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Nov 01 19:09:00.295753 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Nov 01 19:09:00.295753 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Nov 01 19:09:00.295753 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:09:00.295753 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:09:00.295753 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:09:00.295753 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:09:00.295753 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:09:00.295753 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:09:00.295753 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 01 19:09:00.295753 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 01 19:09:00.295753 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Nov 01 19:09:00.295753 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:09:00.299990 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-83998fbd-0aac-4d35-8d88-a0e5950f44bf tempest-KeyPairsNegativeTestJSON-453844394 tempest-KeyPairsNegativeTestJSON-453844394-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=121403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 01 19:09:00.301327 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-83998fbd-0aac-4d35-8d88-a0e5950f44bf tempest-KeyPairsNegativeTestJSON-453844394 tempest-KeyPairsNegativeTestJSON-453844394-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.140955 Nov 01 19:09:00.306206 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1848/3597] 10.222.0.13 () {60 vars in 1158 bytes} [Tue Nov 1 19:09:00 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 146 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Nov 01 19:09:00.325397 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-7061142a-1d05-4994-a7ab-33d2d07641d9 tempest-KeyPairsNegativeTestJSON-453844394 tempest-KeyPairsNegativeTestJSON-453844394-project] Action: 'create', calling method: .version_select at 0x7f0ae6713940>, body: {"keypair": {"name": "keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBHft5IHLY0W/dBLZ+6TjygIOHIcO8q3KHValsvMWd7Wc6RscNpO1ylguRJLNbPftgkqKw9WU5rQ80WH2kXnOqR3Sf+dq1w2u25X6o3MzaKJqUhMc0NzZr2Z6LiO+74vJg=="}} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:09:00.332885 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.network.neutron [None req-dfc325bb-0b11-4b68-bdc9-b476cbdd6449 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] validate_networks() for [('6da1da8d-6719-4a9a-851f-308df797b88a', None, None, None, None, None)] {{(pid=121402) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 01 19:09:00.339122 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-7061142a-1d05-4994-a7ab-33d2d07641d9 tempest-KeyPairsNegativeTestJSON-453844394 tempest-KeyPairsNegativeTestJSON-453844394-project] Request method failure captured: Nov 01 19:09:00.339122 n-d-863052-2 devstack@n-api.service[121403]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Nov 01 19:09:00.339122 n-d-863052-2 devstack@n-api.service[121403]: Accept: application/json Nov 01 19:09:00.339122 n-d-863052-2 devstack@n-api.service[121403]: Accept-Encoding: identity Nov 01 19:09:00.339122 n-d-863052-2 devstack@n-api.service[121403]: Connection: close Nov 01 19:09:00.339122 n-d-863052-2 devstack@n-api.service[121403]: Content-Length: 507 Nov 01 19:09:00.339122 n-d-863052-2 devstack@n-api.service[121403]: Content-Type: application/json Nov 01 19:09:00.339122 n-d-863052-2 devstack@n-api.service[121403]: Host: 10.222.0.13 Nov 01 19:09:00.339122 n-d-863052-2 devstack@n-api.service[121403]: Openstack-System-Scope: None Nov 01 19:09:00.339122 n-d-863052-2 devstack@n-api.service[121403]: User-Agent: python-urllib3/1.26.12 Nov 01 19:09:00.339122 n-d-863052-2 devstack@n-api.service[121403]: X-Auth-Token: gAAAAABjYW7K3Hp-TkIHHJgdY0OsPlPPQsGcFRUPZ_DDVp5KYwxSj3GH_6fK242NiPOXtgFbiqrvdKU0C6MORaIEPoigoW6OE38EyiudSLlgB84PBUu7nsFa1kVJkpcgBnOlC86zMlf-bydlGrW62474iKRQIoAYW-rk-ECeGtrVfTMDprEHXzs Nov 01 19:09:00.339122 n-d-863052-2 devstack@n-api.service[121403]: X-Domain-Id: None Nov 01 19:09:00.339122 n-d-863052-2 devstack@n-api.service[121403]: X-Domain-Name: None Nov 01 19:09:00.339122 n-d-863052-2 devstack@n-api.service[121403]: X-Identity-Status: Confirmed Nov 01 19:09:00.339122 n-d-863052-2 devstack@n-api.service[121403]: X-Is-Admin-Project: True Nov 01 19:09:00.339122 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Domain-Id: default Nov 01 19:09:00.339122 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Domain-Name: Default Nov 01 19:09:00.339122 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Id: 6f01650f0109463fb6bf763d88a94b11 Nov 01 19:09:00.339122 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-453844394 Nov 01 19:09:00.339122 n-d-863052-2 devstack@n-api.service[121403]: X-Role: member,reader Nov 01 19:09:00.339122 n-d-863052-2 devstack@n-api.service[121403]: X-Roles: member,reader Nov 01 19:09:00.339122 n-d-863052-2 devstack@n-api.service[121403]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/6f01650f0109463fb6bf763d88a94b11"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/6f01650f0109463fb6bf763d88a94b11"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_6f01650f0109463fb6bf763d88a94b11", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/6f01650f0109463fb6bf763d88a94b11"}]}] Nov 01 19:09:00.339122 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant: tempest-KeyPairsNegativeTestJSON-453844394 Nov 01 19:09:00.339122 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant-Id: 6f01650f0109463fb6bf763d88a94b11 Nov 01 19:09:00.339122 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-453844394 Nov 01 19:09:00.339122 n-d-863052-2 devstack@n-api.service[121403]: X-User: tempest-KeyPairsNegativeTestJSON-453844394-project Nov 01 19:09:00.339122 n-d-863052-2 devstack@n-api.service[121403]: X-User-Domain-Id: default Nov 01 19:09:00.339122 n-d-863052-2 devstack@n-api.service[121403]: X-User-Domain-Name: Default Nov 01 19:09:00.339122 n-d-863052-2 devstack@n-api.service[121403]: X-User-Id: 678e6aae64334e0a934f215be174d0c5 Nov 01 19:09:00.339122 n-d-863052-2 devstack@n-api.service[121403]: X-User-Name: tempest-KeyPairsNegativeTestJSON-453844394-project Nov 01 19:09:00.339122 n-d-863052-2 devstack@n-api.service[121403]: Nov 01 19:09:00.339122 n-d-863052-2 devstack@n-api.service[121403]: {"keypair": {"name": "keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBHft5IHLY0W/dBLZ+6TjygIOHIcO8q3KHValsvMWd7Wc6RscNpO1ylguRJLNbPftgkqKw9WU5rQ80WH2kXnOqR3Sf+dq1w2u25X6o3MzaKJqUhMc0NzZr2Z6LiO+74vJg=="}} Nov 01 19:09:00.339122 n-d-863052-2 devstack@n-api.service[121403]: method: Nov 01 19:09:00.339122 n-d-863052-2 devstack@n-api.service[121403]: exception: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Nov 01 19:09:00.339122 n-d-863052-2 devstack@n-api.service[121403]: action_args: {'body': {'keypair': {'name': 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBHft5IHLY0W/dBLZ+6TjygIOHIcO8q3KHValsvMWd7Wc6RscNpO1ylguRJLNbPftgkqKw9WU5rQ80WH2kXnOqR3Sf+dq1w2u25X6o3MzaKJqUhMc0NzZr2Z6LiO+74vJg=='}}} Nov 01 19:09:00.339122 n-d-863052-2 devstack@n-api.service[121403]: {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 01 19:09:00.339122 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:09:00.339122 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Nov 01 19:09:00.339122 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Nov 01 19:09:00.339122 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Nov 01 19:09:00.339122 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise error Nov 01 19:09:00.339122 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Nov 01 19:09:00.339122 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:09:00.339122 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['keypair']['properties']['name']['allOf'][0]: Nov 01 19:09:00.339122 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Nov 01 19:09:00.339122 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:09:00.339122 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi On instance['keypair']: Nov 01 19:09:00.339122 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' Nov 01 19:09:00.342445 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:09:00.342445 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:09:00.342445 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:09:00.342445 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:09:00.342445 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:09:00.342445 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:09:00.342445 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 01 19:09:00.342445 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 01 19:09:00.342445 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 01 19:09:00.342445 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 01 19:09:00.342445 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 01 19:09:00.342445 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 01 19:09:00.342445 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 01 19:09:00.342445 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 01 19:09:00.342445 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Nov 01 19:09:00.342445 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Nov 01 19:09:00.342445 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Nov 01 19:09:00.342445 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Nov 01 19:09:00.342445 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Nov 01 19:09:00.342445 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Nov 01 19:09:00.342445 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Nov 01 19:09:00.342445 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:09:00.342445 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:09:00.342445 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:09:00.342445 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:09:00.342445 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:09:00.342445 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:09:00.342445 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Nov 01 19:09:00.342445 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Nov 01 19:09:00.342445 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Nov 01 19:09:00.342445 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:09:00.346015 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-7061142a-1d05-4994-a7ab-33d2d07641d9 tempest-KeyPairsNegativeTestJSON-453844394 tempest-KeyPairsNegativeTestJSON-453844394-project] Returning 400 to user: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long {{(pid=121403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 01 19:09:00.347561 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-7061142a-1d05-4994-a7ab-33d2d07641d9 tempest-KeyPairsNegativeTestJSON-453844394 tempest-KeyPairsNegativeTestJSON-453844394-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 400 len: 627 microversion: 2.1 time: 0.026821 Nov 01 19:09:00.355796 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1849/3598] 10.222.0.13 () {60 vars in 1159 bytes} [Tue Nov 1 19:09:00 2022] POST /compute/v2.1/os-keypairs => generated 627 bytes in 36 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 01 19:09:00.363208 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-c66c1c8e-d1a2-45a1-b99e-aaae53b18187 tempest-KeyPairsNegativeTestJSON-453844394 tempest-KeyPairsNegativeTestJSON-453844394-project] Action: 'create', calling method: .version_select at 0x7f0ae68ec550>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-809758353", "public_key": "ssh-rsa JUNK nova@ubuntu"}} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:09:00.389657 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.quota [None req-c66c1c8e-d1a2-45a1-b99e-aaae53b18187 tempest-KeyPairsNegativeTestJSON-453844394 tempest-KeyPairsNegativeTestJSON-453844394-project] Getting quotas for project 6f01650f0109463fb6bf763d88a94b11. Resources: {'key_pairs'} {{(pid=121403) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 01 19:09:00.400599 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.quota [None req-c66c1c8e-d1a2-45a1-b99e-aaae53b18187 tempest-KeyPairsNegativeTestJSON-453844394 tempest-KeyPairsNegativeTestJSON-453844394-project] Getting quotas for user 678e6aae64334e0a934f215be174d0c5 and project 6f01650f0109463fb6bf763d88a94b11. Resources: {'key_pairs'} {{(pid=121403) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 01 19:09:00.432920 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.wsgi [None req-c66c1c8e-d1a2-45a1-b99e-aaae53b18187 tempest-KeyPairsNegativeTestJSON-453844394 tempest-KeyPairsNegativeTestJSON-453844394-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Nov 01 19:09:00.437868 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-c66c1c8e-d1a2-45a1-b99e-aaae53b18187 tempest-KeyPairsNegativeTestJSON-453844394 tempest-KeyPairsNegativeTestJSON-453844394-project] Request method failure captured: Nov 01 19:09:00.437868 n-d-863052-2 devstack@n-api.service[121403]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Nov 01 19:09:00.437868 n-d-863052-2 devstack@n-api.service[121403]: Accept: application/json Nov 01 19:09:00.437868 n-d-863052-2 devstack@n-api.service[121403]: Accept-Encoding: identity Nov 01 19:09:00.437868 n-d-863052-2 devstack@n-api.service[121403]: Connection: close Nov 01 19:09:00.437868 n-d-863052-2 devstack@n-api.service[121403]: Content-Length: 117 Nov 01 19:09:00.437868 n-d-863052-2 devstack@n-api.service[121403]: Content-Type: application/json Nov 01 19:09:00.437868 n-d-863052-2 devstack@n-api.service[121403]: Host: 10.222.0.13 Nov 01 19:09:00.437868 n-d-863052-2 devstack@n-api.service[121403]: Openstack-System-Scope: None Nov 01 19:09:00.437868 n-d-863052-2 devstack@n-api.service[121403]: User-Agent: python-urllib3/1.26.12 Nov 01 19:09:00.437868 n-d-863052-2 devstack@n-api.service[121403]: X-Auth-Token: gAAAAABjYW7K3Hp-TkIHHJgdY0OsPlPPQsGcFRUPZ_DDVp5KYwxSj3GH_6fK242NiPOXtgFbiqrvdKU0C6MORaIEPoigoW6OE38EyiudSLlgB84PBUu7nsFa1kVJkpcgBnOlC86zMlf-bydlGrW62474iKRQIoAYW-rk-ECeGtrVfTMDprEHXzs Nov 01 19:09:00.437868 n-d-863052-2 devstack@n-api.service[121403]: X-Domain-Id: None Nov 01 19:09:00.437868 n-d-863052-2 devstack@n-api.service[121403]: X-Domain-Name: None Nov 01 19:09:00.437868 n-d-863052-2 devstack@n-api.service[121403]: X-Identity-Status: Confirmed Nov 01 19:09:00.437868 n-d-863052-2 devstack@n-api.service[121403]: X-Is-Admin-Project: True Nov 01 19:09:00.437868 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Domain-Id: default Nov 01 19:09:00.437868 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Domain-Name: Default Nov 01 19:09:00.437868 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Id: 6f01650f0109463fb6bf763d88a94b11 Nov 01 19:09:00.437868 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-453844394 Nov 01 19:09:00.437868 n-d-863052-2 devstack@n-api.service[121403]: X-Role: member,reader Nov 01 19:09:00.437868 n-d-863052-2 devstack@n-api.service[121403]: X-Roles: member,reader Nov 01 19:09:00.437868 n-d-863052-2 devstack@n-api.service[121403]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/6f01650f0109463fb6bf763d88a94b11"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/6f01650f0109463fb6bf763d88a94b11"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_6f01650f0109463fb6bf763d88a94b11", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/6f01650f0109463fb6bf763d88a94b11"}]}] Nov 01 19:09:00.437868 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant: tempest-KeyPairsNegativeTestJSON-453844394 Nov 01 19:09:00.437868 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant-Id: 6f01650f0109463fb6bf763d88a94b11 Nov 01 19:09:00.437868 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-453844394 Nov 01 19:09:00.437868 n-d-863052-2 devstack@n-api.service[121403]: X-User: tempest-KeyPairsNegativeTestJSON-453844394-project Nov 01 19:09:00.437868 n-d-863052-2 devstack@n-api.service[121403]: X-User-Domain-Id: default Nov 01 19:09:00.437868 n-d-863052-2 devstack@n-api.service[121403]: X-User-Domain-Name: Default Nov 01 19:09:00.437868 n-d-863052-2 devstack@n-api.service[121403]: X-User-Id: 678e6aae64334e0a934f215be174d0c5 Nov 01 19:09:00.437868 n-d-863052-2 devstack@n-api.service[121403]: X-User-Name: tempest-KeyPairsNegativeTestJSON-453844394-project Nov 01 19:09:00.437868 n-d-863052-2 devstack@n-api.service[121403]: Nov 01 19:09:00.437868 n-d-863052-2 devstack@n-api.service[121403]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-809758353", "public_key": "ssh-rsa JUNK nova@ubuntu"}} Nov 01 19:09:00.437868 n-d-863052-2 devstack@n-api.service[121403]: method: Nov 01 19:09:00.437868 n-d-863052-2 devstack@n-api.service[121403]: exception: Keypair data is invalid: failed to generate fingerprint Nov 01 19:09:00.437868 n-d-863052-2 devstack@n-api.service[121403]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-809758353', 'public_key': 'ssh-rsa JUNK nova@ubuntu'}}} Nov 01 19:09:00.437868 n-d-863052-2 devstack@n-api.service[121403]: {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 01 19:09:00.437868 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:09:00.437868 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Nov 01 19:09:00.437868 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Nov 01 19:09:00.437868 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 664, in load_ssh_public_key Nov 01 19:09:00.437868 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi inner_key_type, data = _get_sshstr(data) Nov 01 19:09:00.437868 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 134, in _get_sshstr Nov 01 19:09:00.437868 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi n, data = _get_u32(data) Nov 01 19:09:00.437868 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 121, in _get_u32 Nov 01 19:09:00.437868 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid data") Nov 01 19:09:00.437868 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi ValueError: Invalid data Nov 01 19:09:00.437868 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:09:00.437868 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:09:00.437868 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:09:00.437868 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:09:00.437868 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Nov 01 19:09:00.437868 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Nov 01 19:09:00.437868 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Nov 01 19:09:00.437868 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Nov 01 19:09:00.437868 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 01 19:09:00.437868 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 01 19:09:00.437868 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 01 19:09:00.437868 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise self.value Nov 01 19:09:00.437868 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Nov 01 19:09:00.437868 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Nov 01 19:09:00.437868 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6774, in import_key_pair Nov 01 19:09:00.437868 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Nov 01 19:09:00.437868 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6847, in _generate_fingerprint Nov 01 19:09:00.437868 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Nov 01 19:09:00.443071 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Nov 01 19:09:00.443071 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Nov 01 19:09:00.443071 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Nov 01 19:09:00.443071 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:09:00.443071 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:09:00.443071 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:09:00.443071 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:09:00.443071 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:09:00.443071 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:09:00.443071 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 01 19:09:00.443071 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 01 19:09:00.443071 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 01 19:09:00.443071 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 01 19:09:00.443071 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 01 19:09:00.443071 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 01 19:09:00.443071 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 01 19:09:00.443071 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 01 19:09:00.443071 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 01 19:09:00.443071 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 01 19:09:00.443071 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Nov 01 19:09:00.443071 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return self._create(req, body) Nov 01 19:09:00.443071 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Nov 01 19:09:00.443071 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Nov 01 19:09:00.443071 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Nov 01 19:09:00.443071 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:09:00.443071 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:09:00.443071 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:09:00.443071 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:09:00.443071 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:09:00.443071 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:09:00.443071 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 01 19:09:00.443071 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 01 19:09:00.443071 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Nov 01 19:09:00.443071 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:09:00.451749 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-c66c1c8e-d1a2-45a1-b99e-aaae53b18187 tempest-KeyPairsNegativeTestJSON-453844394 tempest-KeyPairsNegativeTestJSON-453844394-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=121403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 01 19:09:00.452890 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-c66c1c8e-d1a2-45a1-b99e-aaae53b18187 tempest-KeyPairsNegativeTestJSON-453844394 tempest-KeyPairsNegativeTestJSON-453844394-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.094020 Nov 01 19:09:00.455611 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1850/3599] 10.222.0.13 () {60 vars in 1159 bytes} [Tue Nov 1 19:09:00 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 99 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Nov 01 19:09:00.466521 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-73d0e336-a225-45d8-a9ea-a93dc5d94266 tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:09:00.467455 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-73d0e336-a225-45d8-a9ea-a93dc5d94266 tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] [instance: 77d6f571-5742-462c-ada0-1b05dd1561d1] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:09:00.493010 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-73d0e336-a225-45d8-a9ea-a93dc5d94266 tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:09:00.496213 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-73d0e336-a225-45d8-a9ea-a93dc5d94266 tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:09:00.497070 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-73d0e336-a225-45d8-a9ea-a93dc5d94266 tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:09:00.499070 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-73d0e336-a225-45d8-a9ea-a93dc5d94266 tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:09:00.500574 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-73d0e336-a225-45d8-a9ea-a93dc5d94266 tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:09:00.502974 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-73d0e336-a225-45d8-a9ea-a93dc5d94266 tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:09:00.654583 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-73d0e336-a225-45d8-a9ea-a93dc5d94266 tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57ba6eeb99714c7cabb14f484968e269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a0c0985c7b9450a8b622b6761e5b5c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:09:00.658153 n-d-863052-2 devstack@n-api.service[121403]: DEBUG dbcounter [-] [121403] Writing DB stats nova_cell1:SELECT=100 {{(pid=121403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 19:09:00.667145 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-73d0e336-a225-45d8-a9ea-a93dc5d94266 tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57ba6eeb99714c7cabb14f484968e269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a0c0985c7b9450a8b622b6761e5b5c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:09:00.668626 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-73d0e336-a225-45d8-a9ea-a93dc5d94266 tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57ba6eeb99714c7cabb14f484968e269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a0c0985c7b9450a8b622b6761e5b5c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:09:00.677152 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-73d0e336-a225-45d8-a9ea-a93dc5d94266 tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] 10.222.0.13 "GET /compute/v2.1/servers/77d6f571-5742-462c-ada0-1b05dd1561d1" status: 200 len: 1366 microversion: 2.47 time: 0.210332 Nov 01 19:09:00.689266 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1851/3600] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 19:09:00 2022] GET /compute/v2.1/servers/77d6f571-5742-462c-ada0-1b05dd1561d1 => generated 1366 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 19:09:00.704220 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-d068a5c8-1ae8-471f-b74f-2fad245abf8a tempest-KeyPairsNegativeTestJSON-453844394 tempest-KeyPairsNegativeTestJSON-453844394-project] Calling method '.version_select at 0x7f0ae20f2ee0>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:09:00.719030 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.wsgi [None req-d068a5c8-1ae8-471f-b74f-2fad245abf8a tempest-KeyPairsNegativeTestJSON-453844394 tempest-KeyPairsNegativeTestJSON-453844394-project] HTTP exception thrown: Keypair tempest-keypair-non-existent-559106496 not found for user 678e6aae64334e0a934f215be174d0c5 Nov 01 19:09:00.721324 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-d068a5c8-1ae8-471f-b74f-2fad245abf8a tempest-KeyPairsNegativeTestJSON-453844394 tempest-KeyPairsNegativeTestJSON-453844394-project] Request method failure captured: Nov 01 19:09:00.721324 n-d-863052-2 devstack@n-api.service[121403]: request: DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-559106496 HTTP/1.1 Nov 01 19:09:00.721324 n-d-863052-2 devstack@n-api.service[121403]: Accept: application/json Nov 01 19:09:00.721324 n-d-863052-2 devstack@n-api.service[121403]: Accept-Encoding: identity Nov 01 19:09:00.721324 n-d-863052-2 devstack@n-api.service[121403]: Connection: close Nov 01 19:09:00.721324 n-d-863052-2 devstack@n-api.service[121403]: Content-Length: 0 Nov 01 19:09:00.721324 n-d-863052-2 devstack@n-api.service[121403]: Content-Type: application/json Nov 01 19:09:00.721324 n-d-863052-2 devstack@n-api.service[121403]: Host: 10.222.0.13 Nov 01 19:09:00.721324 n-d-863052-2 devstack@n-api.service[121403]: Openstack-System-Scope: None Nov 01 19:09:00.721324 n-d-863052-2 devstack@n-api.service[121403]: User-Agent: python-urllib3/1.26.12 Nov 01 19:09:00.721324 n-d-863052-2 devstack@n-api.service[121403]: X-Auth-Token: gAAAAABjYW7K3Hp-TkIHHJgdY0OsPlPPQsGcFRUPZ_DDVp5KYwxSj3GH_6fK242NiPOXtgFbiqrvdKU0C6MORaIEPoigoW6OE38EyiudSLlgB84PBUu7nsFa1kVJkpcgBnOlC86zMlf-bydlGrW62474iKRQIoAYW-rk-ECeGtrVfTMDprEHXzs Nov 01 19:09:00.721324 n-d-863052-2 devstack@n-api.service[121403]: X-Domain-Id: None Nov 01 19:09:00.721324 n-d-863052-2 devstack@n-api.service[121403]: X-Domain-Name: None Nov 01 19:09:00.721324 n-d-863052-2 devstack@n-api.service[121403]: X-Identity-Status: Confirmed Nov 01 19:09:00.721324 n-d-863052-2 devstack@n-api.service[121403]: X-Is-Admin-Project: True Nov 01 19:09:00.721324 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Domain-Id: default Nov 01 19:09:00.721324 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Domain-Name: Default Nov 01 19:09:00.721324 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Id: 6f01650f0109463fb6bf763d88a94b11 Nov 01 19:09:00.721324 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-453844394 Nov 01 19:09:00.721324 n-d-863052-2 devstack@n-api.service[121403]: X-Role: member,reader Nov 01 19:09:00.721324 n-d-863052-2 devstack@n-api.service[121403]: X-Roles: member,reader Nov 01 19:09:00.721324 n-d-863052-2 devstack@n-api.service[121403]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/6f01650f0109463fb6bf763d88a94b11"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/6f01650f0109463fb6bf763d88a94b11"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_6f01650f0109463fb6bf763d88a94b11", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/6f01650f0109463fb6bf763d88a94b11"}]}] Nov 01 19:09:00.721324 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant: tempest-KeyPairsNegativeTestJSON-453844394 Nov 01 19:09:00.721324 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant-Id: 6f01650f0109463fb6bf763d88a94b11 Nov 01 19:09:00.721324 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-453844394 Nov 01 19:09:00.721324 n-d-863052-2 devstack@n-api.service[121403]: X-User: tempest-KeyPairsNegativeTestJSON-453844394-project Nov 01 19:09:00.721324 n-d-863052-2 devstack@n-api.service[121403]: X-User-Domain-Id: default Nov 01 19:09:00.721324 n-d-863052-2 devstack@n-api.service[121403]: X-User-Domain-Name: Default Nov 01 19:09:00.721324 n-d-863052-2 devstack@n-api.service[121403]: X-User-Id: 678e6aae64334e0a934f215be174d0c5 Nov 01 19:09:00.721324 n-d-863052-2 devstack@n-api.service[121403]: X-User-Name: tempest-KeyPairsNegativeTestJSON-453844394-project Nov 01 19:09:00.721324 n-d-863052-2 devstack@n-api.service[121403]: method: Nov 01 19:09:00.721324 n-d-863052-2 devstack@n-api.service[121403]: exception: Keypair tempest-keypair-non-existent-559106496 not found for user 678e6aae64334e0a934f215be174d0c5 Nov 01 19:09:00.721324 n-d-863052-2 devstack@n-api.service[121403]: action_args: {'id': 'tempest-keypair-non-existent-559106496'} Nov 01 19:09:00.721324 n-d-863052-2 devstack@n-api.service[121403]: {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 01 19:09:00.721324 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:09:00.721324 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 170, in _delete Nov 01 19:09:00.721324 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi self.api.delete_key_pair(context, user_id, id) Nov 01 19:09:00.721324 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Nov 01 19:09:00.721324 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Nov 01 19:09:00.721324 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 01 19:09:00.721324 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 01 19:09:00.721324 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 01 19:09:00.721324 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise self.value Nov 01 19:09:00.721324 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Nov 01 19:09:00.721324 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Nov 01 19:09:00.721324 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6861, in delete_key_pair Nov 01 19:09:00.721324 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi keypair = self.get_key_pair(context, user_id, key_name) Nov 01 19:09:00.721324 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6882, in get_key_pair Nov 01 19:09:00.721324 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return objects.KeyPair.get_by_name(context, user_id, key_name) Nov 01 19:09:00.721324 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 01 19:09:00.721324 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 01 19:09:00.721324 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 144, in get_by_name Nov 01 19:09:00.721324 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi db_keypair = cls._get_from_db(context, user_id, name) Nov 01 19:09:00.721324 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 126, in _get_from_db Nov 01 19:09:00.721324 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return _get_from_db(context, user_id, name=name) Nov 01 19:09:00.721324 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Nov 01 19:09:00.721324 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Nov 01 19:09:00.721324 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 40, in _get_from_db Nov 01 19:09:00.721324 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise exception.KeypairNotFound(user_id=user_id, name=name) Nov 01 19:09:00.721324 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi nova.exception.KeypairNotFound: Keypair tempest-keypair-non-existent-559106496 not found for user 678e6aae64334e0a934f215be174d0c5 Nov 01 19:09:00.721324 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:09:00.721324 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:09:00.725755 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:09:00.725755 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:09:00.725755 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:09:00.725755 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:09:00.725755 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 01 19:09:00.725755 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 01 19:09:00.725755 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 01 19:09:00.725755 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 01 19:09:00.725755 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Nov 01 19:09:00.725755 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 01 19:09:00.725755 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 01 19:09:00.725755 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 01 19:09:00.725755 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 143, in delete Nov 01 19:09:00.725755 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi self._delete(req, id) Nov 01 19:09:00.725755 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 172, in _delete Nov 01 19:09:00.725755 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=exc.format_message()) Nov 01 19:09:00.725755 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Keypair tempest-keypair-non-existent-559106496 not found for user 678e6aae64334e0a934f215be174d0c5 Nov 01 19:09:00.725755 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:09:00.725755 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:09:00.725755 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:09:00.725755 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:09:00.725755 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:09:00.725755 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:09:00.725755 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 01 19:09:00.725755 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 01 19:09:00.725755 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair tempest-keypair-non-existent-559106496 not found for user 678e6aae64334e0a934f215be174d0c5 Nov 01 19:09:00.725755 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:09:00.729372 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-d068a5c8-1ae8-471f-b74f-2fad245abf8a tempest-KeyPairsNegativeTestJSON-453844394 tempest-KeyPairsNegativeTestJSON-453844394-project] Returning 404 to user: Keypair tempest-keypair-non-existent-559106496 not found for user 678e6aae64334e0a934f215be174d0c5 {{(pid=121403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 01 19:09:00.730467 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-d068a5c8-1ae8-471f-b74f-2fad245abf8a tempest-KeyPairsNegativeTestJSON-453844394 tempest-KeyPairsNegativeTestJSON-453844394-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-559106496" status: 404 len: 144 microversion: 2.1 time: 0.039861 Nov 01 19:09:00.731456 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1852/3601] 10.222.0.13 () {58 vars in 1257 bytes} [Tue Nov 1 19:09:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-559106496 => generated 144 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 01 19:09:00.923586 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-8f7fa156-8f01-4a42-b5c3-7d2a811aff22 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:09:00.924537 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-8f7fa156-8f01-4a42-b5c3-7d2a811aff22 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] [instance: 34597ed3-08c9-4c33-b47a-56a9ad5ff70c] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:09:00.935347 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-8f7fa156-8f01-4a42-b5c3-7d2a811aff22 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:09:00.935839 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-8f7fa156-8f01-4a42-b5c3-7d2a811aff22 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:09:00.936650 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-8f7fa156-8f01-4a42-b5c3-7d2a811aff22 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:09:00.937301 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-8f7fa156-8f01-4a42-b5c3-7d2a811aff22 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:09:00.937793 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-8f7fa156-8f01-4a42-b5c3-7d2a811aff22 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:09:00.938210 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-8f7fa156-8f01-4a42-b5c3-7d2a811aff22 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:09:01.409498 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-8f7fa156-8f01-4a42-b5c3-7d2a811aff22 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113bd8c844ee490b86a68bc7e1e75da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '851785a5f76548898a77d67792888504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:09:01.421644 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-8f7fa156-8f01-4a42-b5c3-7d2a811aff22 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] 10.222.0.13 "GET /compute/v2.1/servers/34597ed3-08c9-4c33-b47a-56a9ad5ff70c" status: 200 len: 1489 microversion: 2.1 time: 0.503668 Nov 01 19:09:01.427247 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1853/3602] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:09:00 2022] GET /compute/v2.1/servers/34597ed3-08c9-4c33-b47a-56a9ad5ff70c => generated 1489 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:09:01.450866 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-06108d4f-cffb-4968-885b-8ee04d99ebfc tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Action: 'update', calling method: >, body: {"server": {"accessIPv4": "1.1.1.1", "accessIPv6": "::babe:202:202"}} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:09:01.463560 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-06108d4f-cffb-4968-885b-8ee04d99ebfc tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] [instance: 34597ed3-08c9-4c33-b47a-56a9ad5ff70c] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:09:01.487025 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-06108d4f-cffb-4968-885b-8ee04d99ebfc tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:09:01.490094 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-06108d4f-cffb-4968-885b-8ee04d99ebfc tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:09:01.491366 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-06108d4f-cffb-4968-885b-8ee04d99ebfc tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:09:01.492450 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-06108d4f-cffb-4968-885b-8ee04d99ebfc tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:09:01.493296 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-06108d4f-cffb-4968-885b-8ee04d99ebfc tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:09:01.494159 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-06108d4f-cffb-4968-885b-8ee04d99ebfc tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:09:01.665208 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-06108d4f-cffb-4968-885b-8ee04d99ebfc tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] 10.222.0.13 "PUT /compute/v2.1/servers/34597ed3-08c9-4c33-b47a-56a9ad5ff70c" status: 200 len: 1084 microversion: 2.1 time: 0.219499 Nov 01 19:09:01.667537 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1854/3603] 10.222.0.13 () {60 vars in 1256 bytes} [Tue Nov 1 19:09:01 2022] PUT /compute/v2.1/servers/34597ed3-08c9-4c33-b47a-56a9ad5ff70c => generated 1084 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:09:01.689740 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-65dd19c7-fb1a-4812-9762-f1890c0e836c tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:09:01.690663 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-65dd19c7-fb1a-4812-9762-f1890c0e836c tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] [instance: 34597ed3-08c9-4c33-b47a-56a9ad5ff70c] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:09:01.723281 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-65dd19c7-fb1a-4812-9762-f1890c0e836c tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:09:01.725214 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-65dd19c7-fb1a-4812-9762-f1890c0e836c tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:09:01.725666 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-65dd19c7-fb1a-4812-9762-f1890c0e836c tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:09:01.729813 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-65dd19c7-fb1a-4812-9762-f1890c0e836c tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:09:01.730597 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-65dd19c7-fb1a-4812-9762-f1890c0e836c tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:09:01.731711 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-65dd19c7-fb1a-4812-9762-f1890c0e836c tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:09:01.769057 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.virt.hardware [None req-dfc325bb-0b11-4b68-bdc9-b476cbdd6449 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Flavor limits 0:0:0 {{(pid=121402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 01 19:09:01.769675 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.virt.hardware [None req-dfc325bb-0b11-4b68-bdc9-b476cbdd6449 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Image limits 0:0:0 {{(pid=121402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 01 19:09:01.769927 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.virt.hardware [None req-dfc325bb-0b11-4b68-bdc9-b476cbdd6449 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Flavor pref 0:0:0 {{(pid=121402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 01 19:09:01.770363 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.virt.hardware [None req-dfc325bb-0b11-4b68-bdc9-b476cbdd6449 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Image pref 0:0:0 {{(pid=121402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 01 19:09:01.770761 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.virt.hardware [None req-dfc325bb-0b11-4b68-bdc9-b476cbdd6449 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 01 19:09:01.790150 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-dfc325bb-0b11-4b68-bdc9-b476cbdd6449 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:09:01.790939 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-dfc325bb-0b11-4b68-bdc9-b476cbdd6449 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:09:01.793006 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-dfc325bb-0b11-4b68-bdc9-b476cbdd6449 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:09:01.794624 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-dfc325bb-0b11-4b68-bdc9-b476cbdd6449 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:09:01.796751 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-dfc325bb-0b11-4b68-bdc9-b476cbdd6449 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:09:01.799363 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-dfc325bb-0b11-4b68-bdc9-b476cbdd6449 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:09:01.841227 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.quota [None req-dfc325bb-0b11-4b68-bdc9-b476cbdd6449 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Getting quotas for project 1ee9dc49b89143f781e4ab30296e4d01. Resources: {'cores', 'ram', 'instances'} {{(pid=121402) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 01 19:09:01.856234 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.quota [None req-dfc325bb-0b11-4b68-bdc9-b476cbdd6449 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Getting quotas for user 058480d92c9b4ab4af6815d0438a65c7 and project 1ee9dc49b89143f781e4ab30296e4d01. Resources: {'cores', 'ram', 'instances'} {{(pid=121402) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 01 19:09:01.892288 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-dfc325bb-0b11-4b68-bdc9-b476cbdd6449 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Going to run 1 instances... {{(pid=121402) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 01 19:09:01.899394 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-dfc325bb-0b11-4b68-bdc9-b476cbdd6449 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] [instance: cc8a30dd-b655-48d8-b4e2-d4911cb15513] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2d4a0047-1b9e-445f-8af8-1b5c9d93e881',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121402) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 01 19:09:02.013063 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-dfc325bb-0b11-4b68-bdc9-b476cbdd6449 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.798409 Nov 01 19:09:02.014947 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1750/3604] 10.222.0.13 () {60 vars in 1147 bytes} [Tue Nov 1 19:09:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 1803 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Nov 01 19:09:02.021298 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-aa00e0b1-482e-4d2e-9237-a4292093d4a7 tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:09:02.023238 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-aa00e0b1-482e-4d2e-9237-a4292093d4a7 tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] [instance: 77d6f571-5742-462c-ada0-1b05dd1561d1] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:09:02.051066 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-aa00e0b1-482e-4d2e-9237-a4292093d4a7 tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:09:02.052022 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-aa00e0b1-482e-4d2e-9237-a4292093d4a7 tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:09:02.052844 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-aa00e0b1-482e-4d2e-9237-a4292093d4a7 tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:09:02.054619 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-aa00e0b1-482e-4d2e-9237-a4292093d4a7 tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:09:02.055447 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-aa00e0b1-482e-4d2e-9237-a4292093d4a7 tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:09:02.056058 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-aa00e0b1-482e-4d2e-9237-a4292093d4a7 tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:09:02.073042 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-65dd19c7-fb1a-4812-9762-f1890c0e836c tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113bd8c844ee490b86a68bc7e1e75da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '851785a5f76548898a77d67792888504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:09:02.088545 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-65dd19c7-fb1a-4812-9762-f1890c0e836c tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] 10.222.0.13 "GET /compute/v2.1/servers/34597ed3-08c9-4c33-b47a-56a9ad5ff70c" status: 200 len: 1510 microversion: 2.1 time: 0.404171 Nov 01 19:09:02.096945 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1855/3605] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:09:01 2022] GET /compute/v2.1/servers/34597ed3-08c9-4c33-b47a-56a9ad5ff70c => generated 1510 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:09:02.118867 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-f20e072c-fcb9-4b15-9159-e317b018fbf9 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:09:02.119868 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-f20e072c-fcb9-4b15-9159-e317b018fbf9 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] [instance: cc8a30dd-b655-48d8-b4e2-d4911cb15513] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:09:02.271008 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-f20e072c-fcb9-4b15-9159-e317b018fbf9 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '058480d92c9b4ab4af6815d0438a65c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee9dc49b89143f781e4ab30296e4d01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:09:02.278737 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-f20e072c-fcb9-4b15-9159-e317b018fbf9 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] 10.222.0.13 "GET /compute/v2.1/servers/cc8a30dd-b655-48d8-b4e2-d4911cb15513" status: 200 len: 1215 microversion: 2.1 time: 0.180446 Nov 01 19:09:02.279896 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1856/3606] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:09:02 2022] GET /compute/v2.1/servers/cc8a30dd-b655-48d8-b4e2-d4911cb15513 => generated 1215 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:09:02.285283 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-95d4b196-bca7-4a45-af68-1edf0bb5e5ec tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:09:02.286135 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-95d4b196-bca7-4a45-af68-1edf0bb5e5ec tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] [instance: 34597ed3-08c9-4c33-b47a-56a9ad5ff70c] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:09:02.293035 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-95d4b196-bca7-4a45-af68-1edf0bb5e5ec tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:09:02.294546 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-95d4b196-bca7-4a45-af68-1edf0bb5e5ec tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:09:02.295316 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-95d4b196-bca7-4a45-af68-1edf0bb5e5ec tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:09:02.296205 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-95d4b196-bca7-4a45-af68-1edf0bb5e5ec tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:09:02.297146 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-95d4b196-bca7-4a45-af68-1edf0bb5e5ec tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:09:02.298069 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-95d4b196-bca7-4a45-af68-1edf0bb5e5ec tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:09:02.358786 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-aa00e0b1-482e-4d2e-9237-a4292093d4a7 tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57ba6eeb99714c7cabb14f484968e269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a0c0985c7b9450a8b622b6761e5b5c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:09:02.368609 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-aa00e0b1-482e-4d2e-9237-a4292093d4a7 tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57ba6eeb99714c7cabb14f484968e269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a0c0985c7b9450a8b622b6761e5b5c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:09:02.377439 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-aa00e0b1-482e-4d2e-9237-a4292093d4a7 tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57ba6eeb99714c7cabb14f484968e269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a0c0985c7b9450a8b622b6761e5b5c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:09:02.380537 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-aa00e0b1-482e-4d2e-9237-a4292093d4a7 tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] 10.222.0.13 "GET /compute/v2.1/servers/77d6f571-5742-462c-ada0-1b05dd1561d1" status: 200 len: 1366 microversion: 2.47 time: 0.363649 Nov 01 19:09:02.400647 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1751/3607] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 19:09:02 2022] GET /compute/v2.1/servers/77d6f571-5742-462c-ada0-1b05dd1561d1 => generated 1366 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 19:09:02.786248 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-95d4b196-bca7-4a45-af68-1edf0bb5e5ec tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113bd8c844ee490b86a68bc7e1e75da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '851785a5f76548898a77d67792888504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:09:02.799307 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-95d4b196-bca7-4a45-af68-1edf0bb5e5ec tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] 10.222.0.13 "GET /compute/v2.1/servers/34597ed3-08c9-4c33-b47a-56a9ad5ff70c" status: 200 len: 1510 microversion: 2.1 time: 0.518062 Nov 01 19:09:02.800429 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1857/3608] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:09:02 2022] GET /compute/v2.1/servers/34597ed3-08c9-4c33-b47a-56a9ad5ff70c => generated 1510 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:09:02.829736 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-33630a96-c122-4e87-991e-bb53b694614d tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:09:02.830644 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-33630a96-c122-4e87-991e-bb53b694614d tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] [instance: 34597ed3-08c9-4c33-b47a-56a9ad5ff70c] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:09:02.845926 n-d-863052-2 devstack@n-api.service[121402]: DEBUG dbcounter [-] [121402] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=2,nova_api:INSERT=5 {{(pid=121402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 19:09:02.849277 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-33630a96-c122-4e87-991e-bb53b694614d tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:09:02.850974 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-33630a96-c122-4e87-991e-bb53b694614d tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:09:02.851787 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-33630a96-c122-4e87-991e-bb53b694614d tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:09:02.852981 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-33630a96-c122-4e87-991e-bb53b694614d tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:09:02.853722 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-33630a96-c122-4e87-991e-bb53b694614d tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:09:02.854319 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-33630a96-c122-4e87-991e-bb53b694614d tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:09:02.929160 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-33630a96-c122-4e87-991e-bb53b694614d tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] [instance: 34597ed3-08c9-4c33-b47a-56a9ad5ff70c] Going to try to terminate instance {{(pid=121402) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 01 19:09:03.069109 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-33630a96-c122-4e87-991e-bb53b694614d tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] 10.222.0.13 "DELETE /compute/v2.1/servers/34597ed3-08c9-4c33-b47a-56a9ad5ff70c" status: 204 len: 0 microversion: 2.1 time: 0.244850 Nov 01 19:09:03.070993 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1752/3609] 10.222.0.13 () {58 vars in 1239 bytes} [Tue Nov 1 19:09:02 2022] DELETE /compute/v2.1/servers/34597ed3-08c9-4c33-b47a-56a9ad5ff70c => generated 0 bytes in 248 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 01 19:09:03.080427 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-6ff2ee0a-4ded-4a76-b83f-059d7918deb1 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:09:03.086780 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-6ff2ee0a-4ded-4a76-b83f-059d7918deb1 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] [instance: 34597ed3-08c9-4c33-b47a-56a9ad5ff70c] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:09:03.094749 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-6ff2ee0a-4ded-4a76-b83f-059d7918deb1 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:09:03.095520 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-6ff2ee0a-4ded-4a76-b83f-059d7918deb1 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:09:03.096186 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-6ff2ee0a-4ded-4a76-b83f-059d7918deb1 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:09:03.097201 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-6ff2ee0a-4ded-4a76-b83f-059d7918deb1 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:09:03.098062 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-6ff2ee0a-4ded-4a76-b83f-059d7918deb1 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:09:03.098655 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-6ff2ee0a-4ded-4a76-b83f-059d7918deb1 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:09:03.310183 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-31d1e4fa-cb4d-4b19-81b6-e10c55569a45 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:09:03.311635 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-31d1e4fa-cb4d-4b19-81b6-e10c55569a45 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] [instance: cc8a30dd-b655-48d8-b4e2-d4911cb15513] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:09:03.321535 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-31d1e4fa-cb4d-4b19-81b6-e10c55569a45 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:09:03.322795 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-31d1e4fa-cb4d-4b19-81b6-e10c55569a45 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:09:03.323661 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-31d1e4fa-cb4d-4b19-81b6-e10c55569a45 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:09:03.325185 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-31d1e4fa-cb4d-4b19-81b6-e10c55569a45 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:09:03.325842 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-31d1e4fa-cb4d-4b19-81b6-e10c55569a45 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:09:03.326568 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-31d1e4fa-cb4d-4b19-81b6-e10c55569a45 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:09:03.351866 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-6ff2ee0a-4ded-4a76-b83f-059d7918deb1 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113bd8c844ee490b86a68bc7e1e75da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '851785a5f76548898a77d67792888504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:09:03.368697 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-6ff2ee0a-4ded-4a76-b83f-059d7918deb1 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] 10.222.0.13 "GET /compute/v2.1/servers/34597ed3-08c9-4c33-b47a-56a9ad5ff70c" status: 200 len: 1516 microversion: 2.1 time: 0.291456 Nov 01 19:09:03.371594 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1858/3610] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:09:03 2022] GET /compute/v2.1/servers/34597ed3-08c9-4c33-b47a-56a9ad5ff70c => generated 1516 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:09:03.401128 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-b1ac1419-e408-427a-9b02-1764d79e5388 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:09:03.401681 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-b1ac1419-e408-427a-9b02-1764d79e5388 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] [instance: ac4160c6-ca16-455e-9613-0d425932af3b] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:09:03.418541 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-b1ac1419-e408-427a-9b02-1764d79e5388 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:09:03.419046 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-b1ac1419-e408-427a-9b02-1764d79e5388 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:09:03.419483 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-b1ac1419-e408-427a-9b02-1764d79e5388 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:09:03.420206 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-b1ac1419-e408-427a-9b02-1764d79e5388 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:09:03.420683 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-b1ac1419-e408-427a-9b02-1764d79e5388 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:09:03.421113 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-b1ac1419-e408-427a-9b02-1764d79e5388 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:09:03.439314 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-31d1e4fa-cb4d-4b19-81b6-e10c55569a45 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '058480d92c9b4ab4af6815d0438a65c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee9dc49b89143f781e4ab30296e4d01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:09:03.449208 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-31d1e4fa-cb4d-4b19-81b6-e10c55569a45 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] 10.222.0.13 "GET /compute/v2.1/servers/cc8a30dd-b655-48d8-b4e2-d4911cb15513" status: 200 len: 1211 microversion: 2.1 time: 0.147516 Nov 01 19:09:03.455252 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1753/3611] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:09:03 2022] GET /compute/v2.1/servers/cc8a30dd-b655-48d8-b4e2-d4911cb15513 => generated 1211 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 19:09:03.472556 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-83df3d1a-70a9-4dd1-afe2-dd6cf81b3ec3 tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:09:03.473329 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-83df3d1a-70a9-4dd1-afe2-dd6cf81b3ec3 tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] [instance: 77d6f571-5742-462c-ada0-1b05dd1561d1] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:09:03.483764 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-83df3d1a-70a9-4dd1-afe2-dd6cf81b3ec3 tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:09:03.483916 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-b1ac1419-e408-427a-9b02-1764d79e5388 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] 10.222.0.13 "GET /compute/v2.1/servers/ac4160c6-ca16-455e-9613-0d425932af3b/ips" status: 200 len: 150 microversion: 2.1 time: 0.110806 Nov 01 19:09:03.484265 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-83df3d1a-70a9-4dd1-afe2-dd6cf81b3ec3 tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:09:03.492330 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-83df3d1a-70a9-4dd1-afe2-dd6cf81b3ec3 tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:09:03.493964 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-83df3d1a-70a9-4dd1-afe2-dd6cf81b3ec3 tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:09:03.494618 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-83df3d1a-70a9-4dd1-afe2-dd6cf81b3ec3 tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:09:03.495520 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-83df3d1a-70a9-4dd1-afe2-dd6cf81b3ec3 tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:09:03.503973 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1859/3612] 10.222.0.13 () {58 vars in 1248 bytes} [Tue Nov 1 19:09:03 2022] GET /compute/v2.1/servers/ac4160c6-ca16-455e-9613-0d425932af3b/ips => generated 150 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:09:03.609611 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-83df3d1a-70a9-4dd1-afe2-dd6cf81b3ec3 tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57ba6eeb99714c7cabb14f484968e269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a0c0985c7b9450a8b622b6761e5b5c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:09:03.619261 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-83df3d1a-70a9-4dd1-afe2-dd6cf81b3ec3 tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57ba6eeb99714c7cabb14f484968e269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a0c0985c7b9450a8b622b6761e5b5c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:09:03.621913 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-83df3d1a-70a9-4dd1-afe2-dd6cf81b3ec3 tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57ba6eeb99714c7cabb14f484968e269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a0c0985c7b9450a8b622b6761e5b5c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:09:03.629838 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-83df3d1a-70a9-4dd1-afe2-dd6cf81b3ec3 tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] 10.222.0.13 "GET /compute/v2.1/servers/77d6f571-5742-462c-ada0-1b05dd1561d1" status: 200 len: 1366 microversion: 2.47 time: 0.173239 Nov 01 19:09:03.630723 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1754/3613] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 19:09:03 2022] GET /compute/v2.1/servers/77d6f571-5742-462c-ada0-1b05dd1561d1 => generated 1366 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 19:09:04.395661 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-ce8aa6e0-7370-4efd-ab73-1a55e18516dd tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:09:04.396962 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-ce8aa6e0-7370-4efd-ab73-1a55e18516dd tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] [instance: 34597ed3-08c9-4c33-b47a-56a9ad5ff70c] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:09:04.410843 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-ce8aa6e0-7370-4efd-ab73-1a55e18516dd tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:09:04.411438 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-ce8aa6e0-7370-4efd-ab73-1a55e18516dd tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:09:04.411987 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-ce8aa6e0-7370-4efd-ab73-1a55e18516dd tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:09:04.417193 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-ce8aa6e0-7370-4efd-ab73-1a55e18516dd tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:09:04.418032 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-ce8aa6e0-7370-4efd-ab73-1a55e18516dd tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:09:04.418793 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-ce8aa6e0-7370-4efd-ab73-1a55e18516dd tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:09:04.479776 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-5ad4fcff-ab63-435f-9fdd-a6334ce0cf61 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:09:04.480398 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-5ad4fcff-ab63-435f-9fdd-a6334ce0cf61 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] [instance: cc8a30dd-b655-48d8-b4e2-d4911cb15513] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:09:04.501700 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-5ad4fcff-ab63-435f-9fdd-a6334ce0cf61 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:09:04.502207 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-5ad4fcff-ab63-435f-9fdd-a6334ce0cf61 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:09:04.502648 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-5ad4fcff-ab63-435f-9fdd-a6334ce0cf61 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:09:04.503434 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-5ad4fcff-ab63-435f-9fdd-a6334ce0cf61 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:09:04.503897 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-5ad4fcff-ab63-435f-9fdd-a6334ce0cf61 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:09:04.504324 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-5ad4fcff-ab63-435f-9fdd-a6334ce0cf61 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:09:04.641012 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-5ad4fcff-ab63-435f-9fdd-a6334ce0cf61 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '058480d92c9b4ab4af6815d0438a65c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee9dc49b89143f781e4ab30296e4d01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:09:04.651925 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-5ad4fcff-ab63-435f-9fdd-a6334ce0cf61 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] 10.222.0.13 "GET /compute/v2.1/servers/cc8a30dd-b655-48d8-b4e2-d4911cb15513" status: 200 len: 1267 microversion: 2.1 time: 0.176901 Nov 01 19:09:04.657226 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1755/3614] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:09:04 2022] GET /compute/v2.1/servers/cc8a30dd-b655-48d8-b4e2-d4911cb15513 => generated 1267 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 19:09:04.676199 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-b62640cb-8188-4ed5-8533-a92afda62959 tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:09:04.677235 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-b62640cb-8188-4ed5-8533-a92afda62959 tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] [instance: 77d6f571-5742-462c-ada0-1b05dd1561d1] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:09:04.683564 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b62640cb-8188-4ed5-8533-a92afda62959 tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:09:04.689385 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b62640cb-8188-4ed5-8533-a92afda62959 tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:09:04.690118 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b62640cb-8188-4ed5-8533-a92afda62959 tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:09:04.691275 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b62640cb-8188-4ed5-8533-a92afda62959 tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:09:04.691894 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b62640cb-8188-4ed5-8533-a92afda62959 tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:09:04.692485 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b62640cb-8188-4ed5-8533-a92afda62959 tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:09:04.882252 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-ce8aa6e0-7370-4efd-ab73-1a55e18516dd tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113bd8c844ee490b86a68bc7e1e75da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '851785a5f76548898a77d67792888504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:09:04.895197 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-ce8aa6e0-7370-4efd-ab73-1a55e18516dd tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] 10.222.0.13 "GET /compute/v2.1/servers/34597ed3-08c9-4c33-b47a-56a9ad5ff70c" status: 200 len: 1516 microversion: 2.1 time: 0.503639 Nov 01 19:09:04.901207 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1860/3615] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:09:04 2022] GET /compute/v2.1/servers/34597ed3-08c9-4c33-b47a-56a9ad5ff70c => generated 1516 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:09:04.985631 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-b62640cb-8188-4ed5-8533-a92afda62959 tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57ba6eeb99714c7cabb14f484968e269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a0c0985c7b9450a8b622b6761e5b5c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:09:05.003583 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-b62640cb-8188-4ed5-8533-a92afda62959 tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57ba6eeb99714c7cabb14f484968e269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a0c0985c7b9450a8b622b6761e5b5c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:09:05.008805 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-b62640cb-8188-4ed5-8533-a92afda62959 tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57ba6eeb99714c7cabb14f484968e269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a0c0985c7b9450a8b622b6761e5b5c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:09:05.010626 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-b62640cb-8188-4ed5-8533-a92afda62959 tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] 10.222.0.13 "GET /compute/v2.1/servers/77d6f571-5742-462c-ada0-1b05dd1561d1" status: 200 len: 1366 microversion: 2.47 time: 0.351812 Nov 01 19:09:05.012540 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1756/3616] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 19:09:04 2022] GET /compute/v2.1/servers/77d6f571-5742-462c-ada0-1b05dd1561d1 => generated 1366 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 19:09:05.300694 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-7ce67cca-9983-491e-b420-274f88894659 tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] Action: 'create', calling method: .version_select at 0x7f0ae21060d0>, body: {"keypair": {"name": "tempest-keypair-394532974", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEpllyr4hq3Ea9fYYUmPXTectV7sZYYHLaZ7SF+eDPU8WkFoRREZbrR+hPci2GS/KBKExV1aQrxifM97X601gUFwk3ZQLWw4iAhs13PlAro10Ix8LmO/GyUg05PbKWQmPA=="}} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:09:05.323105 n-d-863052-2 devstack@n-api.service[121403]: DEBUG dbcounter [-] [121403] Writing DB stats nova_api:SELECT=99,nova_api:DELETE=1 {{(pid=121403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 19:09:05.342642 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [req-196ea66e-42d9-4c15-8206-331757057415 req-856bdcd9-6f84-494b-91a5-84eb3c2cd573 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "34597ed3-08c9-4c33-b47a-56a9ad5ff70c", "name": "network-vif-deleted", "tag": "3638395b-88f9-4712-a867-5c773ca49cde"}]} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:09:05.365701 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-196ea66e-42d9-4c15-8206-331757057415 req-856bdcd9-6f84-494b-91a5-84eb3c2cd573 service nova] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:09:05.367133 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-196ea66e-42d9-4c15-8206-331757057415 req-856bdcd9-6f84-494b-91a5-84eb3c2cd573 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:09:05.367914 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-196ea66e-42d9-4c15-8206-331757057415 req-856bdcd9-6f84-494b-91a5-84eb3c2cd573 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:09:05.372924 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.quota [None req-7ce67cca-9983-491e-b420-274f88894659 tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] Getting quotas for project 3d8835c7b6754bfd81447b1f8893e56c. Resources: {'key_pairs'} {{(pid=121403) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 01 19:09:05.374863 n-d-863052-2 devstack@n-api.service[121402]: DEBUG dbcounter [-] [121402] Writing DB stats nova_cell1:SELECT=78,nova_cell1:UPDATE=17,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1,nova_cell1:DELETE=2,nova_cell1:INSERT=1 {{(pid=121402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 19:09:05.387665 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.compute.server_external_events [req-196ea66e-42d9-4c15-8206-331757057415 req-856bdcd9-6f84-494b-91a5-84eb3c2cd573 service nova] Creating event network-vif-deleted:3638395b-88f9-4712-a867-5c773ca49cde for instance 34597ed3-08c9-4c33-b47a-56a9ad5ff70c on n-h1-863052-2 Nov 01 19:09:05.397618 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.quota [None req-7ce67cca-9983-491e-b420-274f88894659 tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] Getting quotas for user c72e7e000a9a4fa49474bd5d19accf77 and project 3d8835c7b6754bfd81447b1f8893e56c. Resources: {'key_pairs'} {{(pid=121403) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 01 19:09:05.416817 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [req-196ea66e-42d9-4c15-8206-331757057415 req-856bdcd9-6f84-494b-91a5-84eb3c2cd573 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082984 Nov 01 19:09:05.424466 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1757/3617] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Nov 1 19:09:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 01 19:09:05.470840 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-7ce67cca-9983-491e-b420-274f88894659 tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.567996 Nov 01 19:09:05.471663 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1861/3618] 10.222.0.13 () {60 vars in 1159 bytes} [Tue Nov 1 19:09:04 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:09:05.685002 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-a25cb0d8-97d2-4b3b-a181-b43417d610f7 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:09:05.695412 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-a25cb0d8-97d2-4b3b-a181-b43417d610f7 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] [instance: cc8a30dd-b655-48d8-b4e2-d4911cb15513] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:09:05.714380 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-a25cb0d8-97d2-4b3b-a181-b43417d610f7 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:09:05.717516 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-a25cb0d8-97d2-4b3b-a181-b43417d610f7 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:09:05.717980 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-a25cb0d8-97d2-4b3b-a181-b43417d610f7 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:09:05.718799 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-a25cb0d8-97d2-4b3b-a181-b43417d610f7 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:09:05.719254 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-a25cb0d8-97d2-4b3b-a181-b43417d610f7 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:09:05.720155 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-a25cb0d8-97d2-4b3b-a181-b43417d610f7 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:09:05.914245 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-a25cb0d8-97d2-4b3b-a181-b43417d610f7 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '058480d92c9b4ab4af6815d0438a65c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee9dc49b89143f781e4ab30296e4d01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:09:05.926459 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-a25cb0d8-97d2-4b3b-a181-b43417d610f7 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] 10.222.0.13 "GET /compute/v2.1/servers/cc8a30dd-b655-48d8-b4e2-d4911cb15513" status: 200 len: 1273 microversion: 2.1 time: 0.248745 Nov 01 19:09:05.926938 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-9ba637f9-0c7e-4ea2-956c-27d924da1f9a tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:09:05.927665 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-9ba637f9-0c7e-4ea2-956c-27d924da1f9a tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] [instance: 34597ed3-08c9-4c33-b47a-56a9ad5ff70c] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:09:05.928667 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1758/3619] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:09:05 2022] GET /compute/v2.1/servers/cc8a30dd-b655-48d8-b4e2-d4911cb15513 => generated 1273 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:09:05.936179 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-9ba637f9-0c7e-4ea2-956c-27d924da1f9a tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:09:05.936899 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-9ba637f9-0c7e-4ea2-956c-27d924da1f9a tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:09:05.937338 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-9ba637f9-0c7e-4ea2-956c-27d924da1f9a tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:09:05.938081 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-9ba637f9-0c7e-4ea2-956c-27d924da1f9a tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:09:05.938496 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-9ba637f9-0c7e-4ea2-956c-27d924da1f9a tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:09:05.939016 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-9ba637f9-0c7e-4ea2-956c-27d924da1f9a tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:09:06.006235 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-9ba637f9-0c7e-4ea2-956c-27d924da1f9a tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:09:06.007788 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-9ba637f9-0c7e-4ea2-956c-27d924da1f9a tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:09:06.008742 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-9ba637f9-0c7e-4ea2-956c-27d924da1f9a tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:09:06.009436 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.objects.instance [None req-9ba637f9-0c7e-4ea2-956c-27d924da1f9a tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lazy-loading 'fault' on Instance uuid 34597ed3-08c9-4c33-b47a-56a9ad5ff70c {{(pid=121403) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 01 19:09:06.047909 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-150a9fc9-8e44-40d1-9ee6-896bd7063613 tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:09:06.048530 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-150a9fc9-8e44-40d1-9ee6-896bd7063613 tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] [instance: 77d6f571-5742-462c-ada0-1b05dd1561d1] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:09:06.057999 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-150a9fc9-8e44-40d1-9ee6-896bd7063613 tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:09:06.058480 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-150a9fc9-8e44-40d1-9ee6-896bd7063613 tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:09:06.059159 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-150a9fc9-8e44-40d1-9ee6-896bd7063613 tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:09:06.060438 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-150a9fc9-8e44-40d1-9ee6-896bd7063613 tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:09:06.061076 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-150a9fc9-8e44-40d1-9ee6-896bd7063613 tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:09:06.063403 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-150a9fc9-8e44-40d1-9ee6-896bd7063613 tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:09:06.067646 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-9ba637f9-0c7e-4ea2-956c-27d924da1f9a tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113bd8c844ee490b86a68bc7e1e75da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '851785a5f76548898a77d67792888504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:09:06.080336 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-9ba637f9-0c7e-4ea2-956c-27d924da1f9a tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] 10.222.0.13 "GET /compute/v2.1/servers/34597ed3-08c9-4c33-b47a-56a9ad5ff70c" status: 200 len: 1319 microversion: 2.1 time: 0.157788 Nov 01 19:09:06.082506 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1862/3620] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:09:05 2022] GET /compute/v2.1/servers/34597ed3-08c9-4c33-b47a-56a9ad5ff70c => generated 1319 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:09:06.218666 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-6d7f69eb-754a-4bbe-9f4f-62a265e1798f tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "01f27b12-60ce-42ac-b71f-046f96566ac7"}} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:09:06.221976 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-6d7f69eb-754a-4bbe-9f4f-62a265e1798f tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] [instance: ac4160c6-ca16-455e-9613-0d425932af3b] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:09:06.230349 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-6d7f69eb-754a-4bbe-9f4f-62a265e1798f tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:09:06.231936 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-6d7f69eb-754a-4bbe-9f4f-62a265e1798f tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:09:06.233052 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-6d7f69eb-754a-4bbe-9f4f-62a265e1798f tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:09:06.234092 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-6d7f69eb-754a-4bbe-9f4f-62a265e1798f tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:09:06.234871 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-6d7f69eb-754a-4bbe-9f4f-62a265e1798f tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:09:06.235807 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-6d7f69eb-754a-4bbe-9f4f-62a265e1798f tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:09:06.250630 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-150a9fc9-8e44-40d1-9ee6-896bd7063613 tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57ba6eeb99714c7cabb14f484968e269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a0c0985c7b9450a8b622b6761e5b5c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:09:06.262853 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-150a9fc9-8e44-40d1-9ee6-896bd7063613 tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57ba6eeb99714c7cabb14f484968e269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a0c0985c7b9450a8b622b6761e5b5c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:09:06.264338 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-150a9fc9-8e44-40d1-9ee6-896bd7063613 tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57ba6eeb99714c7cabb14f484968e269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a0c0985c7b9450a8b622b6761e5b5c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:09:06.269040 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-150a9fc9-8e44-40d1-9ee6-896bd7063613 tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] 10.222.0.13 "GET /compute/v2.1/servers/77d6f571-5742-462c-ada0-1b05dd1561d1" status: 200 len: 1366 microversion: 2.47 time: 0.228666 Nov 01 19:09:06.269636 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1759/3621] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 19:09:06 2022] GET /compute/v2.1/servers/77d6f571-5742-462c-ada0-1b05dd1561d1 => generated 1366 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 19:09:06.565103 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-6d7f69eb-754a-4bbe-9f4f-62a265e1798f tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] 10.222.0.13 "POST /compute/v2.1/servers/ac4160c6-ca16-455e-9613-0d425932af3b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.352952 Nov 01 19:09:06.566121 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1863/3622] 10.222.0.13 () {60 vars in 1323 bytes} [Tue Nov 1 19:09:06 2022] POST /compute/v2.1/servers/ac4160c6-ca16-455e-9613-0d425932af3b/os-volume_attachments => generated 194 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 01 19:09:06.951234 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-c6d56288-f3bd-45a6-9cb8-756e9a620f5e tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:09:06.952486 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-c6d56288-f3bd-45a6-9cb8-756e9a620f5e tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] [instance: cc8a30dd-b655-48d8-b4e2-d4911cb15513] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:09:06.959933 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-c6d56288-f3bd-45a6-9cb8-756e9a620f5e tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:09:06.960917 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-c6d56288-f3bd-45a6-9cb8-756e9a620f5e tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:09:06.961619 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-c6d56288-f3bd-45a6-9cb8-756e9a620f5e tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:09:06.962569 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-c6d56288-f3bd-45a6-9cb8-756e9a620f5e tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:09:06.963247 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-c6d56288-f3bd-45a6-9cb8-756e9a620f5e tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:09:06.963894 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-c6d56288-f3bd-45a6-9cb8-756e9a620f5e tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:09:07.112753 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-7164699e-edbc-4866-bcbc-f77a8ec0f09a tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:09:07.114937 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-7164699e-edbc-4866-bcbc-f77a8ec0f09a tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] [instance: 34597ed3-08c9-4c33-b47a-56a9ad5ff70c] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:09:07.125703 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-7164699e-edbc-4866-bcbc-f77a8ec0f09a tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:09:07.128016 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-7164699e-edbc-4866-bcbc-f77a8ec0f09a tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:09:07.129879 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-7164699e-edbc-4866-bcbc-f77a8ec0f09a tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:09:07.131893 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-7164699e-edbc-4866-bcbc-f77a8ec0f09a tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:09:07.132673 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-7164699e-edbc-4866-bcbc-f77a8ec0f09a tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:09:07.133977 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-7164699e-edbc-4866-bcbc-f77a8ec0f09a tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:09:07.179326 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.wsgi [None req-7164699e-edbc-4866-bcbc-f77a8ec0f09a tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] HTTP exception thrown: Instance 34597ed3-08c9-4c33-b47a-56a9ad5ff70c could not be found. Nov 01 19:09:07.188114 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-7164699e-edbc-4866-bcbc-f77a8ec0f09a tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Request method failure captured: Nov 01 19:09:07.188114 n-d-863052-2 devstack@n-api.service[121403]: request: GET /compute/v2.1/servers/34597ed3-08c9-4c33-b47a-56a9ad5ff70c HTTP/1.1 Nov 01 19:09:07.188114 n-d-863052-2 devstack@n-api.service[121403]: Accept: application/json Nov 01 19:09:07.188114 n-d-863052-2 devstack@n-api.service[121403]: Accept-Encoding: identity Nov 01 19:09:07.188114 n-d-863052-2 devstack@n-api.service[121403]: Connection: close Nov 01 19:09:07.188114 n-d-863052-2 devstack@n-api.service[121403]: Content-Length: 0 Nov 01 19:09:07.188114 n-d-863052-2 devstack@n-api.service[121403]: Content-Type: application/json Nov 01 19:09:07.188114 n-d-863052-2 devstack@n-api.service[121403]: Host: 10.222.0.13 Nov 01 19:09:07.188114 n-d-863052-2 devstack@n-api.service[121403]: Openstack-System-Scope: None Nov 01 19:09:07.188114 n-d-863052-2 devstack@n-api.service[121403]: User-Agent: python-urllib3/1.26.12 Nov 01 19:09:07.188114 n-d-863052-2 devstack@n-api.service[121403]: X-Auth-Token: gAAAAABjYW4_RJI8gKBQs81ShXQrfTSIzrNvaZj2e2rGhpR5xhmtuxP4h5uZIl9SLPqPqJ9Syn39UO-el4mPnuEEOGnWtpNlTopD6-Pc1m-VWD64ggyrfBZwUB0hnjNvBvBk6ge071YBJx2gxTN_InEu4tuxz3s-3IQBbEpMSIJZ4VoUIbz4DgY Nov 01 19:09:07.188114 n-d-863052-2 devstack@n-api.service[121403]: X-Domain-Id: None Nov 01 19:09:07.188114 n-d-863052-2 devstack@n-api.service[121403]: X-Domain-Name: None Nov 01 19:09:07.188114 n-d-863052-2 devstack@n-api.service[121403]: X-Identity-Status: Confirmed Nov 01 19:09:07.188114 n-d-863052-2 devstack@n-api.service[121403]: X-Is-Admin-Project: True Nov 01 19:09:07.188114 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Domain-Id: default Nov 01 19:09:07.188114 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Domain-Name: Default Nov 01 19:09:07.188114 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Id: 851785a5f76548898a77d67792888504 Nov 01 19:09:07.188114 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Name: tempest-ServersTestJSON-917766486 Nov 01 19:09:07.188114 n-d-863052-2 devstack@n-api.service[121403]: X-Role: member,reader Nov 01 19:09:07.188114 n-d-863052-2 devstack@n-api.service[121403]: X-Roles: member,reader Nov 01 19:09:07.188114 n-d-863052-2 devstack@n-api.service[121403]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/851785a5f76548898a77d67792888504"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/851785a5f76548898a77d67792888504"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_851785a5f76548898a77d67792888504", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/851785a5f76548898a77d67792888504"}]}] Nov 01 19:09:07.188114 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant: tempest-ServersTestJSON-917766486 Nov 01 19:09:07.188114 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant-Id: 851785a5f76548898a77d67792888504 Nov 01 19:09:07.188114 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant-Name: tempest-ServersTestJSON-917766486 Nov 01 19:09:07.188114 n-d-863052-2 devstack@n-api.service[121403]: X-User: tempest-ServersTestJSON-917766486-project Nov 01 19:09:07.188114 n-d-863052-2 devstack@n-api.service[121403]: X-User-Domain-Id: default Nov 01 19:09:07.188114 n-d-863052-2 devstack@n-api.service[121403]: X-User-Domain-Name: Default Nov 01 19:09:07.188114 n-d-863052-2 devstack@n-api.service[121403]: X-User-Id: 113bd8c844ee490b86a68bc7e1e75da3 Nov 01 19:09:07.188114 n-d-863052-2 devstack@n-api.service[121403]: X-User-Name: tempest-ServersTestJSON-917766486-project Nov 01 19:09:07.188114 n-d-863052-2 devstack@n-api.service[121403]: method: > Nov 01 19:09:07.188114 n-d-863052-2 devstack@n-api.service[121403]: exception: Instance 34597ed3-08c9-4c33-b47a-56a9ad5ff70c could not be found. Nov 01 19:09:07.188114 n-d-863052-2 devstack@n-api.service[121403]: action_args: {'id': '34597ed3-08c9-4c33-b47a-56a9ad5ff70c'} Nov 01 19:09:07.188114 n-d-863052-2 devstack@n-api.service[121403]: {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 01 19:09:07.188114 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:09:07.188114 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 01 19:09:07.188114 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 01 19:09:07.188114 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 01 19:09:07.188114 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 01 19:09:07.188114 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 01 19:09:07.188114 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 01 19:09:07.188114 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 01 19:09:07.188114 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 01 19:09:07.188114 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 34597ed3-08c9-4c33-b47a-56a9ad5ff70c could not be found. Nov 01 19:09:07.188114 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:09:07.188114 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:09:07.188114 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:09:07.188114 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:09:07.188114 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:09:07.188114 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:09:07.188114 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 01 19:09:07.188114 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 01 19:09:07.188114 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 01 19:09:07.188114 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 01 19:09:07.188114 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 01 19:09:07.188114 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 01 19:09:07.188114 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 01 19:09:07.188114 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 01 19:09:07.188114 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 01 19:09:07.188114 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 01 19:09:07.188114 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 34597ed3-08c9-4c33-b47a-56a9ad5ff70c could not be found. Nov 01 19:09:07.188114 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:09:07.188114 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:09:07.188114 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:09:07.188114 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:09:07.192781 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:09:07.192781 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:09:07.192781 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 01 19:09:07.192781 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 01 19:09:07.192781 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 34597ed3-08c9-4c33-b47a-56a9ad5ff70c could not be found. Nov 01 19:09:07.192781 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:09:07.200365 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-7164699e-edbc-4866-bcbc-f77a8ec0f09a tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Returning 404 to user: Instance 34597ed3-08c9-4c33-b47a-56a9ad5ff70c could not be found. {{(pid=121403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 01 19:09:07.204798 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-7164699e-edbc-4866-bcbc-f77a8ec0f09a tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] 10.222.0.13 "GET /compute/v2.1/servers/34597ed3-08c9-4c33-b47a-56a9ad5ff70c" status: 404 len: 111 microversion: 2.1 time: 0.096928 Nov 01 19:09:07.218771 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1864/3623] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:09:07 2022] GET /compute/v2.1/servers/34597ed3-08c9-4c33-b47a-56a9ad5ff70c => generated 111 bytes in 113 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 01 19:09:07.275960 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-c6d56288-f3bd-45a6-9cb8-756e9a620f5e tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '058480d92c9b4ab4af6815d0438a65c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee9dc49b89143f781e4ab30296e4d01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:09:07.310641 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-6c0c9016-316b-4313-88af-2204aae081c5 tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:09:07.310641 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-6c0c9016-316b-4313-88af-2204aae081c5 tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] [instance: 77d6f571-5742-462c-ada0-1b05dd1561d1] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:09:07.326214 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-c6d56288-f3bd-45a6-9cb8-756e9a620f5e tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] 10.222.0.13 "GET /compute/v2.1/servers/cc8a30dd-b655-48d8-b4e2-d4911cb15513" status: 200 len: 1315 microversion: 2.1 time: 0.379016 Nov 01 19:09:07.326833 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1760/3624] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:09:06 2022] GET /compute/v2.1/servers/cc8a30dd-b655-48d8-b4e2-d4911cb15513 => generated 1315 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:09:07.332423 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-6c0c9016-316b-4313-88af-2204aae081c5 tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:09:07.333460 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-6c0c9016-316b-4313-88af-2204aae081c5 tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:09:07.333927 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-6c0c9016-316b-4313-88af-2204aae081c5 tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:09:07.336467 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-6c0c9016-316b-4313-88af-2204aae081c5 tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:09:07.338428 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-6c0c9016-316b-4313-88af-2204aae081c5 tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:09:07.338879 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-6c0c9016-316b-4313-88af-2204aae081c5 tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:09:07.455906 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-6c0c9016-316b-4313-88af-2204aae081c5 tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57ba6eeb99714c7cabb14f484968e269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a0c0985c7b9450a8b622b6761e5b5c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:09:07.466176 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-6c0c9016-316b-4313-88af-2204aae081c5 tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57ba6eeb99714c7cabb14f484968e269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a0c0985c7b9450a8b622b6761e5b5c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:09:07.468833 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-6c0c9016-316b-4313-88af-2204aae081c5 tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57ba6eeb99714c7cabb14f484968e269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a0c0985c7b9450a8b622b6761e5b5c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:09:07.470787 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-6c0c9016-316b-4313-88af-2204aae081c5 tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] 10.222.0.13 "GET /compute/v2.1/servers/77d6f571-5742-462c-ada0-1b05dd1561d1" status: 200 len: 1372 microversion: 2.47 time: 0.172628 Nov 01 19:09:07.472249 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1865/3625] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 19:09:07 2022] GET /compute/v2.1/servers/77d6f571-5742-462c-ada0-1b05dd1561d1 => generated 1372 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 01 19:09:07.540981 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-0c4ab0c5-ff1e-473c-9c87-8964a4c0f00e tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-522214496", "imageRef": "2d4a0047-1b9e-445f-8af8-1b5c9d93e881", "flavorRef": "452", "networks": [{"uuid": "346d9303-d6bc-4555-85be-95ee31a2d9cd"}]}} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:09:07.644498 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.network.neutron [None req-0c4ab0c5-ff1e-473c-9c87-8964a4c0f00e tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] validate_networks() for [('346d9303-d6bc-4555-85be-95ee31a2d9cd', None, None, None, None, None)] {{(pid=121402) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 01 19:09:08.357809 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-38f9b2ff-9bb3-457a-ac44-271c4bb6644c tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:09:08.360157 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-38f9b2ff-9bb3-457a-ac44-271c4bb6644c tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] [instance: cc8a30dd-b655-48d8-b4e2-d4911cb15513] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:09:08.395971 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-38f9b2ff-9bb3-457a-ac44-271c4bb6644c tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:09:08.399684 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-38f9b2ff-9bb3-457a-ac44-271c4bb6644c tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:09:08.400487 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-38f9b2ff-9bb3-457a-ac44-271c4bb6644c tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:09:08.401627 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-38f9b2ff-9bb3-457a-ac44-271c4bb6644c tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:09:08.403261 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-38f9b2ff-9bb3-457a-ac44-271c4bb6644c tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:09:08.404392 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-38f9b2ff-9bb3-457a-ac44-271c4bb6644c tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:09:08.711140 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-38f9b2ff-9bb3-457a-ac44-271c4bb6644c tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '058480d92c9b4ab4af6815d0438a65c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee9dc49b89143f781e4ab30296e4d01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:09:08.723741 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-38f9b2ff-9bb3-457a-ac44-271c4bb6644c tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] 10.222.0.13 "GET /compute/v2.1/servers/cc8a30dd-b655-48d8-b4e2-d4911cb15513" status: 200 len: 1315 microversion: 2.1 time: 0.373196 Nov 01 19:09:08.736605 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1866/3626] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:09:08 2022] GET /compute/v2.1/servers/cc8a30dd-b655-48d8-b4e2-d4911cb15513 => generated 1315 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 19:09:08.736605 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-15223e10-f6c0-4173-8b68-d4568c37964a tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:09:08.736605 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-15223e10-f6c0-4173-8b68-d4568c37964a tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] [instance: 77d6f571-5742-462c-ada0-1b05dd1561d1] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:09:08.740033 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-15223e10-f6c0-4173-8b68-d4568c37964a tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:09:08.741540 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-15223e10-f6c0-4173-8b68-d4568c37964a tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:09:08.742479 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-15223e10-f6c0-4173-8b68-d4568c37964a tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:09:08.744146 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-15223e10-f6c0-4173-8b68-d4568c37964a tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:09:08.744914 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-15223e10-f6c0-4173-8b68-d4568c37964a tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:09:08.745746 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-15223e10-f6c0-4173-8b68-d4568c37964a tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:09:08.859566 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-15223e10-f6c0-4173-8b68-d4568c37964a tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57ba6eeb99714c7cabb14f484968e269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a0c0985c7b9450a8b622b6761e5b5c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:09:08.883615 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-15223e10-f6c0-4173-8b68-d4568c37964a tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57ba6eeb99714c7cabb14f484968e269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a0c0985c7b9450a8b622b6761e5b5c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:09:08.885100 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-15223e10-f6c0-4173-8b68-d4568c37964a tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57ba6eeb99714c7cabb14f484968e269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a0c0985c7b9450a8b622b6761e5b5c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:09:08.886500 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-15223e10-f6c0-4173-8b68-d4568c37964a tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] 10.222.0.13 "GET /compute/v2.1/servers/77d6f571-5742-462c-ada0-1b05dd1561d1" status: 200 len: 1372 microversion: 2.47 time: 0.159494 Nov 01 19:09:08.887243 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1867/3627] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 19:09:08 2022] GET /compute/v2.1/servers/77d6f571-5742-462c-ada0-1b05dd1561d1 => generated 1372 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 19:09:09.540959 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.virt.hardware [None req-0c4ab0c5-ff1e-473c-9c87-8964a4c0f00e tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Flavor limits 0:0:0 {{(pid=121402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 01 19:09:09.541410 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.virt.hardware [None req-0c4ab0c5-ff1e-473c-9c87-8964a4c0f00e tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Image limits 0:0:0 {{(pid=121402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 01 19:09:09.541809 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.virt.hardware [None req-0c4ab0c5-ff1e-473c-9c87-8964a4c0f00e tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Flavor pref 0:0:0 {{(pid=121402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 01 19:09:09.542545 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.virt.hardware [None req-0c4ab0c5-ff1e-473c-9c87-8964a4c0f00e tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Image pref 0:0:0 {{(pid=121402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 01 19:09:09.543112 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.virt.hardware [None req-0c4ab0c5-ff1e-473c-9c87-8964a4c0f00e tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 01 19:09:09.570352 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-0c4ab0c5-ff1e-473c-9c87-8964a4c0f00e tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:09:09.572069 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-0c4ab0c5-ff1e-473c-9c87-8964a4c0f00e tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:09:09.572767 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-0c4ab0c5-ff1e-473c-9c87-8964a4c0f00e tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:09:09.573736 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-0c4ab0c5-ff1e-473c-9c87-8964a4c0f00e tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:09:09.574408 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-0c4ab0c5-ff1e-473c-9c87-8964a4c0f00e tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:09:09.575057 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-0c4ab0c5-ff1e-473c-9c87-8964a4c0f00e tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:09:09.612454 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.quota [None req-0c4ab0c5-ff1e-473c-9c87-8964a4c0f00e tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Getting quotas for project 851785a5f76548898a77d67792888504. Resources: {'cores', 'ram', 'instances'} {{(pid=121402) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 01 19:09:09.620414 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.quota [None req-0c4ab0c5-ff1e-473c-9c87-8964a4c0f00e tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Getting quotas for user 113bd8c844ee490b86a68bc7e1e75da3 and project 851785a5f76548898a77d67792888504. Resources: {'cores', 'ram', 'instances'} {{(pid=121402) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 01 19:09:09.622436 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-189f3131-cba1-4931-9d6b-722e26bd7751 tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-1157391959", "imageRef": "2d4a0047-1b9e-445f-8af8-1b5c9d93e881", "flavorRef": "452", "networks": [{"uuid": "5244cda4-13e2-4009-ae4f-c429024d19da"}], "security_groups": [{"name": "tempest-securitygroup--1303526686"}], "key_name": "tempest-keypair-394532974", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:09:09.642629 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-0c4ab0c5-ff1e-473c-9c87-8964a4c0f00e tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Going to run 1 instances... {{(pid=121402) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 01 19:09:09.645680 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-0c4ab0c5-ff1e-473c-9c87-8964a4c0f00e tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] [instance: 43b22dd3-debb-4a6d-81fc-4666e5bb7804] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2d4a0047-1b9e-445f-8af8-1b5c9d93e881',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121402) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 01 19:09:09.717941 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-0c4ab0c5-ff1e-473c-9c87-8964a4c0f00e tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.182179 Nov 01 19:09:09.719528 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1761/3628] 10.222.0.13 () {60 vars in 1147 bytes} [Tue Nov 1 19:09:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 2184 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 01 19:09:09.745438 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-b7c37d20-963c-4fac-8f2c-c989bfe17acf tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:09:09.746460 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-b7c37d20-963c-4fac-8f2c-c989bfe17acf tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] [instance: 43b22dd3-debb-4a6d-81fc-4666e5bb7804] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:09:09.794985 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.network.neutron [None req-189f3131-cba1-4931-9d6b-722e26bd7751 tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] validate_networks() for [('5244cda4-13e2-4009-ae4f-c429024d19da', None, None, None, None, None)] {{(pid=121403) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 01 19:09:09.973909 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-b7c37d20-963c-4fac-8f2c-c989bfe17acf tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113bd8c844ee490b86a68bc7e1e75da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '851785a5f76548898a77d67792888504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:09:09.983093 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-b7c37d20-963c-4fac-8f2c-c989bfe17acf tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] 10.222.0.13 "GET /compute/v2.1/servers/43b22dd3-debb-4a6d-81fc-4666e5bb7804" status: 200 len: 1208 microversion: 2.1 time: 0.246768 Nov 01 19:09:09.985423 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1762/3629] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:09:09 2022] GET /compute/v2.1/servers/43b22dd3-debb-4a6d-81fc-4666e5bb7804 => generated 1208 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:09:10.005249 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-e0bcb84e-4d64-439e-9c85-f7e4cb93b499 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:09:10.009890 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-e0bcb84e-4d64-439e-9c85-f7e4cb93b499 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] [instance: cc8a30dd-b655-48d8-b4e2-d4911cb15513] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:09:10.042363 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e0bcb84e-4d64-439e-9c85-f7e4cb93b499 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:09:10.042878 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e0bcb84e-4d64-439e-9c85-f7e4cb93b499 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:09:10.043484 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e0bcb84e-4d64-439e-9c85-f7e4cb93b499 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:09:10.044227 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e0bcb84e-4d64-439e-9c85-f7e4cb93b499 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:09:10.044722 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e0bcb84e-4d64-439e-9c85-f7e4cb93b499 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:09:10.045156 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e0bcb84e-4d64-439e-9c85-f7e4cb93b499 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:09:10.467877 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.virt.hardware [None req-189f3131-cba1-4931-9d6b-722e26bd7751 tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] Flavor limits 0:0:0 {{(pid=121403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 01 19:09:10.468308 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.virt.hardware [None req-189f3131-cba1-4931-9d6b-722e26bd7751 tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] Image limits 0:0:0 {{(pid=121403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 01 19:09:10.468852 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.virt.hardware [None req-189f3131-cba1-4931-9d6b-722e26bd7751 tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] Flavor pref 0:0:0 {{(pid=121403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 01 19:09:10.469254 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.virt.hardware [None req-189f3131-cba1-4931-9d6b-722e26bd7751 tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] Image pref 0:0:0 {{(pid=121403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 01 19:09:10.470389 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.virt.hardware [None req-189f3131-cba1-4931-9d6b-722e26bd7751 tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 01 19:09:10.485261 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-189f3131-cba1-4931-9d6b-722e26bd7751 tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:09:10.486278 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-189f3131-cba1-4931-9d6b-722e26bd7751 tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:09:10.487208 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-189f3131-cba1-4931-9d6b-722e26bd7751 tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:09:10.488393 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-189f3131-cba1-4931-9d6b-722e26bd7751 tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:09:10.489279 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-189f3131-cba1-4931-9d6b-722e26bd7751 tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:09:10.490262 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-189f3131-cba1-4931-9d6b-722e26bd7751 tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:09:10.514600 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.quota [None req-189f3131-cba1-4931-9d6b-722e26bd7751 tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] Getting quotas for project 3d8835c7b6754bfd81447b1f8893e56c. Resources: {'cores', 'ram', 'instances'} {{(pid=121403) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 01 19:09:10.531234 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.quota [None req-189f3131-cba1-4931-9d6b-722e26bd7751 tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] Getting quotas for user c72e7e000a9a4fa49474bd5d19accf77 and project 3d8835c7b6754bfd81447b1f8893e56c. Resources: {'cores', 'ram', 'instances'} {{(pid=121403) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 01 19:09:10.550331 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-189f3131-cba1-4931-9d6b-722e26bd7751 tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] Going to run 1 instances... {{(pid=121403) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 01 19:09:10.554378 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-189f3131-cba1-4931-9d6b-722e26bd7751 tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] [instance: 03d4513b-9e04-4924-8654-1de3748e333e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2d4a0047-1b9e-445f-8af8-1b5c9d93e881',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121403) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 01 19:09:10.625736 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-189f3131-cba1-4931-9d6b-722e26bd7751 tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.007198 Nov 01 19:09:10.627236 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1868/3630] 10.222.0.13 () {60 vars in 1147 bytes} [Tue Nov 1 19:09:09 2022] POST /compute/v2.1/servers => generated 406 bytes in 1010 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Nov 01 19:09:10.639394 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-3c22f876-312e-4e86-94d0-f7bd49b31f10 tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:09:10.642351 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-3c22f876-312e-4e86-94d0-f7bd49b31f10 tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] [instance: 77d6f571-5742-462c-ada0-1b05dd1561d1] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:09:10.663575 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-3c22f876-312e-4e86-94d0-f7bd49b31f10 tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:09:10.664110 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-3c22f876-312e-4e86-94d0-f7bd49b31f10 tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:09:10.669021 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-3c22f876-312e-4e86-94d0-f7bd49b31f10 tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:09:10.670089 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-3c22f876-312e-4e86-94d0-f7bd49b31f10 tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:09:10.671411 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-3c22f876-312e-4e86-94d0-f7bd49b31f10 tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:09:10.672063 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-3c22f876-312e-4e86-94d0-f7bd49b31f10 tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:09:10.731725 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-e0bcb84e-4d64-439e-9c85-f7e4cb93b499 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '058480d92c9b4ab4af6815d0438a65c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee9dc49b89143f781e4ab30296e4d01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:09:10.745116 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-e0bcb84e-4d64-439e-9c85-f7e4cb93b499 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] 10.222.0.13 "GET /compute/v2.1/servers/cc8a30dd-b655-48d8-b4e2-d4911cb15513" status: 200 len: 1315 microversion: 2.1 time: 0.755241 Nov 01 19:09:10.747809 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1763/3631] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:09:09 2022] GET /compute/v2.1/servers/cc8a30dd-b655-48d8-b4e2-d4911cb15513 => generated 1315 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:09:10.765657 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-de89b17f-ac9d-4467-99b9-89c4575cfa25 tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:09:10.766281 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-de89b17f-ac9d-4467-99b9-89c4575cfa25 tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] [instance: 03d4513b-9e04-4924-8654-1de3748e333e] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:09:10.766776 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-3c22f876-312e-4e86-94d0-f7bd49b31f10 tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57ba6eeb99714c7cabb14f484968e269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a0c0985c7b9450a8b622b6761e5b5c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:09:10.789011 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-3c22f876-312e-4e86-94d0-f7bd49b31f10 tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57ba6eeb99714c7cabb14f484968e269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a0c0985c7b9450a8b622b6761e5b5c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:09:10.799337 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-3c22f876-312e-4e86-94d0-f7bd49b31f10 tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57ba6eeb99714c7cabb14f484968e269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a0c0985c7b9450a8b622b6761e5b5c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:09:10.803328 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-3c22f876-312e-4e86-94d0-f7bd49b31f10 tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] 10.222.0.13 "GET /compute/v2.1/servers/77d6f571-5742-462c-ada0-1b05dd1561d1" status: 200 len: 1357 microversion: 2.47 time: 0.167480 Nov 01 19:09:10.807193 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1869/3632] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 19:09:10 2022] GET /compute/v2.1/servers/77d6f571-5742-462c-ada0-1b05dd1561d1 => generated 1357 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 19:09:10.836802 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-2164a4fe-dd51-42cf-ba9a-2c8e6ba06bee tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:09:10.853915 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-2164a4fe-dd51-42cf-ba9a-2c8e6ba06bee tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '57ba6eeb99714c7cabb14f484968e269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a0c0985c7b9450a8b622b6761e5b5c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:09:10.858914 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-2164a4fe-dd51-42cf-ba9a-2c8e6ba06bee tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Searching by: {'deleted': False, 'project_id': '1a0c0985c7b9450a8b622b6761e5b5c3'} {{(pid=121403) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 01 19:09:10.872458 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-2164a4fe-dd51-42cf-ba9a-2c8e6ba06bee tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:09:10.873559 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-2164a4fe-dd51-42cf-ba9a-2c8e6ba06bee tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:09:10.874939 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-2164a4fe-dd51-42cf-ba9a-2c8e6ba06bee tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:09:10.880270 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-2164a4fe-dd51-42cf-ba9a-2c8e6ba06bee tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:09:10.881212 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-2164a4fe-dd51-42cf-ba9a-2c8e6ba06bee tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:09:10.881883 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-2164a4fe-dd51-42cf-ba9a-2c8e6ba06bee tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:09:10.916703 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-de89b17f-ac9d-4467-99b9-89c4575cfa25 tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c72e7e000a9a4fa49474bd5d19accf77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d8835c7b6754bfd81447b1f8893e56c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:09:10.924675 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-de89b17f-ac9d-4467-99b9-89c4575cfa25 tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] 10.222.0.13 "GET /compute/v2.1/servers/03d4513b-9e04-4924-8654-1de3748e333e" status: 200 len: 1241 microversion: 2.1 time: 0.175592 Nov 01 19:09:10.928113 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1764/3633] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:09:10 2022] GET /compute/v2.1/servers/03d4513b-9e04-4924-8654-1de3748e333e => generated 1241 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:09:11.009349 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-975e3271-290f-4ddb-b3f1-4a914620e774 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:09:11.010354 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-975e3271-290f-4ddb-b3f1-4a914620e774 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] [instance: 43b22dd3-debb-4a6d-81fc-4666e5bb7804] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:09:11.028164 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-975e3271-290f-4ddb-b3f1-4a914620e774 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:09:11.034167 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-975e3271-290f-4ddb-b3f1-4a914620e774 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:09:11.034561 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-975e3271-290f-4ddb-b3f1-4a914620e774 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:09:11.035297 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-975e3271-290f-4ddb-b3f1-4a914620e774 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:09:11.040364 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-975e3271-290f-4ddb-b3f1-4a914620e774 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:09:11.041190 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-975e3271-290f-4ddb-b3f1-4a914620e774 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:09:11.141426 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.multi_cell_list [None req-2164a4fe-dd51-42cf-ba9a-2c8e6ba06bee tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=121403) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 01 19:09:11.159948 n-d-863052-2 devstack@n-api.service[121403]: DEBUG dbcounter [-] [121403] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=121403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 19:09:11.278007 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-2164a4fe-dd51-42cf-ba9a-2c8e6ba06bee tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57ba6eeb99714c7cabb14f484968e269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a0c0985c7b9450a8b622b6761e5b5c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:09:11.299967 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-2164a4fe-dd51-42cf-ba9a-2c8e6ba06bee tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:09:11.301585 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-2164a4fe-dd51-42cf-ba9a-2c8e6ba06bee tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:09:11.302487 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-2164a4fe-dd51-42cf-ba9a-2c8e6ba06bee tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:09:11.331744 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-975e3271-290f-4ddb-b3f1-4a914620e774 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113bd8c844ee490b86a68bc7e1e75da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '851785a5f76548898a77d67792888504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:09:11.336605 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-2164a4fe-dd51-42cf-ba9a-2c8e6ba06bee tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57ba6eeb99714c7cabb14f484968e269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a0c0985c7b9450a8b622b6761e5b5c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:09:11.340489 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-975e3271-290f-4ddb-b3f1-4a914620e774 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] 10.222.0.13 "GET /compute/v2.1/servers/43b22dd3-debb-4a6d-81fc-4666e5bb7804" status: 200 len: 1260 microversion: 2.1 time: 0.336145 Nov 01 19:09:11.345222 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1765/3634] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:09:11 2022] GET /compute/v2.1/servers/43b22dd3-debb-4a6d-81fc-4666e5bb7804 => generated 1260 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 19:09:11.363585 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [req-50368b01-556f-49d0-813b-cdbeb3f8df9a req-50256f11-80fe-402a-8a11-97bdb03f1489 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cc8a30dd-b655-48d8-b4e2-d4911cb15513", "tag": "2fd41cc4-9129-4719-8eec-3c7b8ca74ec9"}]} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:09:11.366544 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-2164a4fe-dd51-42cf-ba9a-2c8e6ba06bee tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57ba6eeb99714c7cabb14f484968e269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a0c0985c7b9450a8b622b6761e5b5c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:09:11.381230 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-50368b01-556f-49d0-813b-cdbeb3f8df9a req-50256f11-80fe-402a-8a11-97bdb03f1489 service nova] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:09:11.383687 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-50368b01-556f-49d0-813b-cdbeb3f8df9a req-50256f11-80fe-402a-8a11-97bdb03f1489 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:09:11.385499 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-50368b01-556f-49d0-813b-cdbeb3f8df9a req-50256f11-80fe-402a-8a11-97bdb03f1489 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:09:11.417955 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.compute.server_external_events [req-50368b01-556f-49d0-813b-cdbeb3f8df9a req-50256f11-80fe-402a-8a11-97bdb03f1489 service nova] Creating event network-changed:2fd41cc4-9129-4719-8eec-3c7b8ca74ec9 for instance cc8a30dd-b655-48d8-b4e2-d4911cb15513 on n-h1-863052-2 Nov 01 19:09:11.429681 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [req-50368b01-556f-49d0-813b-cdbeb3f8df9a req-50256f11-80fe-402a-8a11-97bdb03f1489 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083082 Nov 01 19:09:11.430312 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1766/3635] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Nov 1 19:09:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:09:11.606064 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-2164a4fe-dd51-42cf-ba9a-2c8e6ba06bee tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] 10.222.0.13 "GET /compute/v2.1/servers/detail" status: 200 len: 2706 microversion: 2.47 time: 0.777716 Nov 01 19:09:11.606666 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1870/3636] 10.222.0.13 () {60 vars in 1187 bytes} [Tue Nov 1 19:09:10 2022] GET /compute/v2.1/servers/detail => generated 2706 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 01 19:09:11.645526 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-a4d6ccd0-7cb4-4fd3-a768-f7d7d5d9303d tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:09:11.646179 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-a4d6ccd0-7cb4-4fd3-a768-f7d7d5d9303d tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] [instance: 77d6f571-5742-462c-ada0-1b05dd1561d1] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:09:11.658208 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-a4d6ccd0-7cb4-4fd3-a768-f7d7d5d9303d tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:09:11.659557 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-a4d6ccd0-7cb4-4fd3-a768-f7d7d5d9303d tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:09:11.660617 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-a4d6ccd0-7cb4-4fd3-a768-f7d7d5d9303d tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:09:11.663191 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-a4d6ccd0-7cb4-4fd3-a768-f7d7d5d9303d tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:09:11.666110 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-a4d6ccd0-7cb4-4fd3-a768-f7d7d5d9303d tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:09:11.666752 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-a4d6ccd0-7cb4-4fd3-a768-f7d7d5d9303d tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:09:11.725316 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-a4d6ccd0-7cb4-4fd3-a768-f7d7d5d9303d tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] [instance: 77d6f571-5742-462c-ada0-1b05dd1561d1] Going to try to terminate instance {{(pid=121402) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 01 19:09:11.775650 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-6feab500-54ce-472b-9bc6-832380757419 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:09:11.776809 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-6feab500-54ce-472b-9bc6-832380757419 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] [instance: cc8a30dd-b655-48d8-b4e2-d4911cb15513] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:09:11.792480 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-6feab500-54ce-472b-9bc6-832380757419 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:09:11.794385 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-6feab500-54ce-472b-9bc6-832380757419 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:09:11.797321 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-6feab500-54ce-472b-9bc6-832380757419 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:09:11.798558 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-6feab500-54ce-472b-9bc6-832380757419 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:09:11.800509 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-6feab500-54ce-472b-9bc6-832380757419 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:09:11.801319 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-6feab500-54ce-472b-9bc6-832380757419 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:09:11.923506 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-a4d6ccd0-7cb4-4fd3-a768-f7d7d5d9303d tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] 10.222.0.13 "DELETE /compute/v2.1/servers/77d6f571-5742-462c-ada0-1b05dd1561d1" status: 204 len: 0 microversion: 2.47 time: 0.281479 Nov 01 19:09:11.928226 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1767/3637] 10.222.0.13 () {60 vars in 1280 bytes} [Tue Nov 1 19:09:11 2022] DELETE /compute/v2.1/servers/77d6f571-5742-462c-ada0-1b05dd1561d1 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 01 19:09:11.940363 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-f3a765f4-6c92-4c11-a881-f6c5b15545b9 tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:09:11.941604 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-f3a765f4-6c92-4c11-a881-f6c5b15545b9 tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] [instance: 77d6f571-5742-462c-ada0-1b05dd1561d1] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:09:11.950131 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f3a765f4-6c92-4c11-a881-f6c5b15545b9 tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:09:11.950855 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f3a765f4-6c92-4c11-a881-f6c5b15545b9 tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:09:11.951582 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f3a765f4-6c92-4c11-a881-f6c5b15545b9 tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:09:11.952536 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f3a765f4-6c92-4c11-a881-f6c5b15545b9 tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:09:11.953321 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f3a765f4-6c92-4c11-a881-f6c5b15545b9 tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:09:11.953913 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f3a765f4-6c92-4c11-a881-f6c5b15545b9 tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:09:12.288883 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-f3a765f4-6c92-4c11-a881-f6c5b15545b9 tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57ba6eeb99714c7cabb14f484968e269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a0c0985c7b9450a8b622b6761e5b5c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:09:12.291492 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-6feab500-54ce-472b-9bc6-832380757419 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '058480d92c9b4ab4af6815d0438a65c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee9dc49b89143f781e4ab30296e4d01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:09:12.304185 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-f3a765f4-6c92-4c11-a881-f6c5b15545b9 tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57ba6eeb99714c7cabb14f484968e269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a0c0985c7b9450a8b622b6761e5b5c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:09:12.305901 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-6feab500-54ce-472b-9bc6-832380757419 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] 10.222.0.13 "GET /compute/v2.1/servers/cc8a30dd-b655-48d8-b4e2-d4911cb15513" status: 200 len: 1315 microversion: 2.1 time: 0.534856 Nov 01 19:09:12.309142 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-f3a765f4-6c92-4c11-a881-f6c5b15545b9 tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57ba6eeb99714c7cabb14f484968e269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a0c0985c7b9450a8b622b6761e5b5c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:09:12.313437 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-f3a765f4-6c92-4c11-a881-f6c5b15545b9 tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] 10.222.0.13 "GET /compute/v2.1/servers/77d6f571-5742-462c-ada0-1b05dd1561d1" status: 200 len: 1363 microversion: 2.47 time: 0.381766 Nov 01 19:09:12.315368 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1768/3638] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 19:09:11 2022] GET /compute/v2.1/servers/77d6f571-5742-462c-ada0-1b05dd1561d1 => generated 1363 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 19:09:12.322418 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1871/3639] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:09:11 2022] GET /compute/v2.1/servers/cc8a30dd-b655-48d8-b4e2-d4911cb15513 => generated 1315 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:09:12.345791 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-528bf2b7-19d0-4277-9bd4-39f017d2ea72 tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:09:12.350576 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-528bf2b7-19d0-4277-9bd4-39f017d2ea72 tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] [instance: 03d4513b-9e04-4924-8654-1de3748e333e] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:09:12.368123 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-528bf2b7-19d0-4277-9bd4-39f017d2ea72 tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:09:12.368657 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-528bf2b7-19d0-4277-9bd4-39f017d2ea72 tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:09:12.371673 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-cedd488e-dae0-491e-8d61-5c7858525560 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:09:12.372239 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-528bf2b7-19d0-4277-9bd4-39f017d2ea72 tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:09:12.373024 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-528bf2b7-19d0-4277-9bd4-39f017d2ea72 tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:09:12.373491 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-528bf2b7-19d0-4277-9bd4-39f017d2ea72 tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:09:12.373918 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-528bf2b7-19d0-4277-9bd4-39f017d2ea72 tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:09:12.382038 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-cedd488e-dae0-491e-8d61-5c7858525560 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] [instance: 43b22dd3-debb-4a6d-81fc-4666e5bb7804] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:09:12.392551 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-cedd488e-dae0-491e-8d61-5c7858525560 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:09:12.393405 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-cedd488e-dae0-491e-8d61-5c7858525560 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:09:12.394840 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-cedd488e-dae0-491e-8d61-5c7858525560 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:09:12.396751 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-cedd488e-dae0-491e-8d61-5c7858525560 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:09:12.397634 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-cedd488e-dae0-491e-8d61-5c7858525560 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:09:12.398985 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-cedd488e-dae0-491e-8d61-5c7858525560 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:09:12.551731 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-cedd488e-dae0-491e-8d61-5c7858525560 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113bd8c844ee490b86a68bc7e1e75da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '851785a5f76548898a77d67792888504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:09:12.564267 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-cedd488e-dae0-491e-8d61-5c7858525560 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] 10.222.0.13 "GET /compute/v2.1/servers/43b22dd3-debb-4a6d-81fc-4666e5bb7804" status: 200 len: 1266 microversion: 2.1 time: 0.193997 Nov 01 19:09:12.568478 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-528bf2b7-19d0-4277-9bd4-39f017d2ea72 tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c72e7e000a9a4fa49474bd5d19accf77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d8835c7b6754bfd81447b1f8893e56c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:09:12.573473 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1872/3640] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:09:12 2022] GET /compute/v2.1/servers/43b22dd3-debb-4a6d-81fc-4666e5bb7804 => generated 1266 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 19:09:12.588247 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-528bf2b7-19d0-4277-9bd4-39f017d2ea72 tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] 10.222.0.13 "GET /compute/v2.1/servers/03d4513b-9e04-4924-8654-1de3748e333e" status: 200 len: 1293 microversion: 2.1 time: 0.251262 Nov 01 19:09:12.596944 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1769/3641] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:09:12 2022] GET /compute/v2.1/servers/03d4513b-9e04-4924-8654-1de3748e333e => generated 1293 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:09:13.335204 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-5c1359be-45f8-468b-8532-ed7349c476b4 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:09:13.335954 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-5c1359be-45f8-468b-8532-ed7349c476b4 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] [instance: cc8a30dd-b655-48d8-b4e2-d4911cb15513] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:09:13.352075 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-f60cf5d8-3dc5-45bc-b992-8b04ab4d6a00 tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:09:13.352947 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-f60cf5d8-3dc5-45bc-b992-8b04ab4d6a00 tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] [instance: 77d6f571-5742-462c-ada0-1b05dd1561d1] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:09:13.355247 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-5c1359be-45f8-468b-8532-ed7349c476b4 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:09:13.356829 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-5c1359be-45f8-468b-8532-ed7349c476b4 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:09:13.357534 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-5c1359be-45f8-468b-8532-ed7349c476b4 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:09:13.358782 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-5c1359be-45f8-468b-8532-ed7349c476b4 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:09:13.359422 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-5c1359be-45f8-468b-8532-ed7349c476b4 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:09:13.360010 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-5c1359be-45f8-468b-8532-ed7349c476b4 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:09:13.367866 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f60cf5d8-3dc5-45bc-b992-8b04ab4d6a00 tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:09:13.368680 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f60cf5d8-3dc5-45bc-b992-8b04ab4d6a00 tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:09:13.370644 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f60cf5d8-3dc5-45bc-b992-8b04ab4d6a00 tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:09:13.373089 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f60cf5d8-3dc5-45bc-b992-8b04ab4d6a00 tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:09:13.373688 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f60cf5d8-3dc5-45bc-b992-8b04ab4d6a00 tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:09:13.375394 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f60cf5d8-3dc5-45bc-b992-8b04ab4d6a00 tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:09:13.503460 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-f60cf5d8-3dc5-45bc-b992-8b04ab4d6a00 tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57ba6eeb99714c7cabb14f484968e269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a0c0985c7b9450a8b622b6761e5b5c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:09:13.513132 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-f60cf5d8-3dc5-45bc-b992-8b04ab4d6a00 tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57ba6eeb99714c7cabb14f484968e269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a0c0985c7b9450a8b622b6761e5b5c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:09:13.522560 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-f60cf5d8-3dc5-45bc-b992-8b04ab4d6a00 tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57ba6eeb99714c7cabb14f484968e269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a0c0985c7b9450a8b622b6761e5b5c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:09:13.523995 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-f60cf5d8-3dc5-45bc-b992-8b04ab4d6a00 tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] 10.222.0.13 "GET /compute/v2.1/servers/77d6f571-5742-462c-ada0-1b05dd1561d1" status: 200 len: 1363 microversion: 2.47 time: 0.179554 Nov 01 19:09:13.537906 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1770/3642] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 19:09:13 2022] GET /compute/v2.1/servers/77d6f571-5742-462c-ada0-1b05dd1561d1 => generated 1363 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 01 19:09:13.599499 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-033771ad-080f-48f3-9a12-4960d869321d tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:09:13.600112 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-033771ad-080f-48f3-9a12-4960d869321d tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] [instance: 43b22dd3-debb-4a6d-81fc-4666e5bb7804] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:09:13.611294 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-033771ad-080f-48f3-9a12-4960d869321d tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:09:13.611858 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-033771ad-080f-48f3-9a12-4960d869321d tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:09:13.612859 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-033771ad-080f-48f3-9a12-4960d869321d tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:09:13.613562 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-033771ad-080f-48f3-9a12-4960d869321d tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:09:13.614016 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-033771ad-080f-48f3-9a12-4960d869321d tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:09:13.614436 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-033771ad-080f-48f3-9a12-4960d869321d tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:09:13.794378 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-5c1359be-45f8-468b-8532-ed7349c476b4 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '058480d92c9b4ab4af6815d0438a65c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee9dc49b89143f781e4ab30296e4d01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:09:13.817585 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-5c1359be-45f8-468b-8532-ed7349c476b4 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] 10.222.0.13 "GET /compute/v2.1/servers/cc8a30dd-b655-48d8-b4e2-d4911cb15513" status: 200 len: 1315 microversion: 2.1 time: 0.488749 Nov 01 19:09:13.822383 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1873/3643] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:09:13 2022] GET /compute/v2.1/servers/cc8a30dd-b655-48d8-b4e2-d4911cb15513 => generated 1315 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:09:13.848758 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-007d1249-6d6f-443b-8f2f-ea206f408e33 tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:09:13.851658 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-007d1249-6d6f-443b-8f2f-ea206f408e33 tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] [instance: 03d4513b-9e04-4924-8654-1de3748e333e] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:09:13.876462 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-007d1249-6d6f-443b-8f2f-ea206f408e33 tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:09:13.878415 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-007d1249-6d6f-443b-8f2f-ea206f408e33 tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:09:13.883220 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-007d1249-6d6f-443b-8f2f-ea206f408e33 tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:09:13.886874 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-007d1249-6d6f-443b-8f2f-ea206f408e33 tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:09:13.889747 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-007d1249-6d6f-443b-8f2f-ea206f408e33 tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:09:13.890314 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-007d1249-6d6f-443b-8f2f-ea206f408e33 tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:09:14.185272 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-007d1249-6d6f-443b-8f2f-ea206f408e33 tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c72e7e000a9a4fa49474bd5d19accf77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d8835c7b6754bfd81447b1f8893e56c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:09:14.199116 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-007d1249-6d6f-443b-8f2f-ea206f408e33 tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] 10.222.0.13 "GET /compute/v2.1/servers/03d4513b-9e04-4924-8654-1de3748e333e" status: 200 len: 1301 microversion: 2.1 time: 0.373304 Nov 01 19:09:14.210906 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1874/3644] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:09:13 2022] GET /compute/v2.1/servers/03d4513b-9e04-4924-8654-1de3748e333e => generated 1301 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:09:14.568941 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-c4019f7b-79a1-4fb6-a020-ccfbc9f0e264 tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:09:14.569563 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-c4019f7b-79a1-4fb6-a020-ccfbc9f0e264 tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] [instance: 77d6f571-5742-462c-ada0-1b05dd1561d1] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:09:14.579774 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-c4019f7b-79a1-4fb6-a020-ccfbc9f0e264 tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:09:14.583601 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-c4019f7b-79a1-4fb6-a020-ccfbc9f0e264 tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:09:14.584321 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-c4019f7b-79a1-4fb6-a020-ccfbc9f0e264 tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:09:14.585241 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-c4019f7b-79a1-4fb6-a020-ccfbc9f0e264 tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:09:14.587538 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-c4019f7b-79a1-4fb6-a020-ccfbc9f0e264 tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:09:14.588149 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-c4019f7b-79a1-4fb6-a020-ccfbc9f0e264 tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:09:14.716931 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-c4019f7b-79a1-4fb6-a020-ccfbc9f0e264 tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57ba6eeb99714c7cabb14f484968e269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a0c0985c7b9450a8b622b6761e5b5c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:09:14.738433 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-c4019f7b-79a1-4fb6-a020-ccfbc9f0e264 tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57ba6eeb99714c7cabb14f484968e269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a0c0985c7b9450a8b622b6761e5b5c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:09:14.747160 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-c4019f7b-79a1-4fb6-a020-ccfbc9f0e264 tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57ba6eeb99714c7cabb14f484968e269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a0c0985c7b9450a8b622b6761e5b5c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:09:14.752429 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-c4019f7b-79a1-4fb6-a020-ccfbc9f0e264 tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] 10.222.0.13 "GET /compute/v2.1/servers/77d6f571-5742-462c-ada0-1b05dd1561d1" status: 200 len: 1363 microversion: 2.47 time: 0.200469 Nov 01 19:09:14.757978 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1875/3645] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 19:09:14 2022] GET /compute/v2.1/servers/77d6f571-5742-462c-ada0-1b05dd1561d1 => generated 1363 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 19:09:14.867392 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-85f7600b-f7e9-49a8-9eb7-dfefef2c88fc tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:09:14.868301 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-85f7600b-f7e9-49a8-9eb7-dfefef2c88fc tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] [instance: cc8a30dd-b655-48d8-b4e2-d4911cb15513] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:09:14.871468 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-033771ad-080f-48f3-9a12-4960d869321d tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113bd8c844ee490b86a68bc7e1e75da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '851785a5f76548898a77d67792888504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:09:14.877883 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-85f7600b-f7e9-49a8-9eb7-dfefef2c88fc tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:09:14.878602 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-85f7600b-f7e9-49a8-9eb7-dfefef2c88fc tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:09:14.879195 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-85f7600b-f7e9-49a8-9eb7-dfefef2c88fc tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:09:14.880069 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-85f7600b-f7e9-49a8-9eb7-dfefef2c88fc tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:09:14.880815 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-033771ad-080f-48f3-9a12-4960d869321d tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] 10.222.0.13 "GET /compute/v2.1/servers/43b22dd3-debb-4a6d-81fc-4666e5bb7804" status: 200 len: 1308 microversion: 2.1 time: 1.285302 Nov 01 19:09:14.881085 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-85f7600b-f7e9-49a8-9eb7-dfefef2c88fc tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:09:14.881744 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-85f7600b-f7e9-49a8-9eb7-dfefef2c88fc tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:09:14.887331 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1771/3646] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:09:13 2022] GET /compute/v2.1/servers/43b22dd3-debb-4a6d-81fc-4666e5bb7804 => generated 1308 bytes in 1292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:09:15.226185 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-79a7fd5f-bf44-4406-88f4-4e179f378e32 tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:09:15.226855 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-79a7fd5f-bf44-4406-88f4-4e179f378e32 tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] [instance: 03d4513b-9e04-4924-8654-1de3748e333e] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:09:15.229666 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-85f7600b-f7e9-49a8-9eb7-dfefef2c88fc tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '058480d92c9b4ab4af6815d0438a65c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee9dc49b89143f781e4ab30296e4d01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:09:15.234043 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-79a7fd5f-bf44-4406-88f4-4e179f378e32 tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:09:15.234805 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-79a7fd5f-bf44-4406-88f4-4e179f378e32 tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:09:15.235728 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-79a7fd5f-bf44-4406-88f4-4e179f378e32 tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:09:15.236754 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-79a7fd5f-bf44-4406-88f4-4e179f378e32 tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:09:15.237459 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-79a7fd5f-bf44-4406-88f4-4e179f378e32 tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:09:15.238366 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-85f7600b-f7e9-49a8-9eb7-dfefef2c88fc tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] 10.222.0.13 "GET /compute/v2.1/servers/cc8a30dd-b655-48d8-b4e2-d4911cb15513" status: 200 len: 1315 microversion: 2.1 time: 0.394410 Nov 01 19:09:15.239923 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-79a7fd5f-bf44-4406-88f4-4e179f378e32 tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:09:15.255351 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1876/3647] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:09:14 2022] GET /compute/v2.1/servers/cc8a30dd-b655-48d8-b4e2-d4911cb15513 => generated 1315 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 19:09:15.370686 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-79a7fd5f-bf44-4406-88f4-4e179f378e32 tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c72e7e000a9a4fa49474bd5d19accf77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d8835c7b6754bfd81447b1f8893e56c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:09:15.382444 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-79a7fd5f-bf44-4406-88f4-4e179f378e32 tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] 10.222.0.13 "GET /compute/v2.1/servers/03d4513b-9e04-4924-8654-1de3748e333e" status: 200 len: 1299 microversion: 2.1 time: 0.161570 Nov 01 19:09:15.383175 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1772/3648] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:09:15 2022] GET /compute/v2.1/servers/03d4513b-9e04-4924-8654-1de3748e333e => generated 1299 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 19:09:15.786861 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-a59faad8-265b-48c3-b6b6-bc659fc1d83f tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:09:15.787646 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-a59faad8-265b-48c3-b6b6-bc659fc1d83f tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] [instance: 77d6f571-5742-462c-ada0-1b05dd1561d1] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:09:15.800750 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-a59faad8-265b-48c3-b6b6-bc659fc1d83f tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:09:15.803368 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-a59faad8-265b-48c3-b6b6-bc659fc1d83f tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:09:15.803971 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-a59faad8-265b-48c3-b6b6-bc659fc1d83f tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:09:15.807785 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-a59faad8-265b-48c3-b6b6-bc659fc1d83f tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:09:15.808522 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-a59faad8-265b-48c3-b6b6-bc659fc1d83f tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:09:15.809154 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-a59faad8-265b-48c3-b6b6-bc659fc1d83f tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:09:15.845388 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.wsgi [None req-a59faad8-265b-48c3-b6b6-bc659fc1d83f tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] HTTP exception thrown: Instance 77d6f571-5742-462c-ada0-1b05dd1561d1 could not be found. Nov 01 19:09:15.850860 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-a59faad8-265b-48c3-b6b6-bc659fc1d83f tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Request method failure captured: Nov 01 19:09:15.850860 n-d-863052-2 devstack@n-api.service[121403]: request: GET /compute/v2.1/servers/77d6f571-5742-462c-ada0-1b05dd1561d1 HTTP/1.1 Nov 01 19:09:15.850860 n-d-863052-2 devstack@n-api.service[121403]: Accept: application/json Nov 01 19:09:15.850860 n-d-863052-2 devstack@n-api.service[121403]: Accept-Encoding: identity Nov 01 19:09:15.850860 n-d-863052-2 devstack@n-api.service[121403]: Connection: close Nov 01 19:09:15.850860 n-d-863052-2 devstack@n-api.service[121403]: Content-Length: 0 Nov 01 19:09:15.850860 n-d-863052-2 devstack@n-api.service[121403]: Content-Type: application/json Nov 01 19:09:15.850860 n-d-863052-2 devstack@n-api.service[121403]: Host: 10.222.0.13 Nov 01 19:09:15.850860 n-d-863052-2 devstack@n-api.service[121403]: Openstack-System-Scope: None Nov 01 19:09:15.850860 n-d-863052-2 devstack@n-api.service[121403]: User-Agent: python-urllib3/1.26.12 Nov 01 19:09:15.850860 n-d-863052-2 devstack@n-api.service[121403]: X-Auth-Token: gAAAAABjYW6kYQbSR4XU4IG7RJw3nb1h_8mJ3WnWJqTzboszdQNcelgJFTbky0izOQTwWVfdJ99D298WNussYySf7BuE8Ucc0KNKC-VDJPd4DY81dKi8Q327MigDDpHJTHE3c6imjVplAYbvsHDGdkhTO0nIrA_Zcc21kMmrrUDMdEV6mjAYzd8 Nov 01 19:09:15.850860 n-d-863052-2 devstack@n-api.service[121403]: X-Domain-Id: None Nov 01 19:09:15.850860 n-d-863052-2 devstack@n-api.service[121403]: X-Domain-Name: None Nov 01 19:09:15.850860 n-d-863052-2 devstack@n-api.service[121403]: X-Identity-Status: Confirmed Nov 01 19:09:15.850860 n-d-863052-2 devstack@n-api.service[121403]: X-Is-Admin-Project: True Nov 01 19:09:15.850860 n-d-863052-2 devstack@n-api.service[121403]: X-Openstack-Nova-Api-Version: 2.47 Nov 01 19:09:15.850860 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Domain-Id: default Nov 01 19:09:15.850860 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Domain-Name: Default Nov 01 19:09:15.850860 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Id: 1a0c0985c7b9450a8b622b6761e5b5c3 Nov 01 19:09:15.850860 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Name: tempest-ServerShowV247Test-2092915885 Nov 01 19:09:15.850860 n-d-863052-2 devstack@n-api.service[121403]: X-Role: member,reader Nov 01 19:09:15.850860 n-d-863052-2 devstack@n-api.service[121403]: X-Roles: member,reader Nov 01 19:09:15.850860 n-d-863052-2 devstack@n-api.service[121403]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/1a0c0985c7b9450a8b622b6761e5b5c3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/1a0c0985c7b9450a8b622b6761e5b5c3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_1a0c0985c7b9450a8b622b6761e5b5c3", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/1a0c0985c7b9450a8b622b6761e5b5c3"}]}] Nov 01 19:09:15.850860 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant: tempest-ServerShowV247Test-2092915885 Nov 01 19:09:15.850860 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant-Id: 1a0c0985c7b9450a8b622b6761e5b5c3 Nov 01 19:09:15.850860 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant-Name: tempest-ServerShowV247Test-2092915885 Nov 01 19:09:15.850860 n-d-863052-2 devstack@n-api.service[121403]: X-User: tempest-ServerShowV247Test-2092915885-project Nov 01 19:09:15.850860 n-d-863052-2 devstack@n-api.service[121403]: X-User-Domain-Id: default Nov 01 19:09:15.850860 n-d-863052-2 devstack@n-api.service[121403]: X-User-Domain-Name: Default Nov 01 19:09:15.850860 n-d-863052-2 devstack@n-api.service[121403]: X-User-Id: 57ba6eeb99714c7cabb14f484968e269 Nov 01 19:09:15.850860 n-d-863052-2 devstack@n-api.service[121403]: X-User-Name: tempest-ServerShowV247Test-2092915885-project Nov 01 19:09:15.850860 n-d-863052-2 devstack@n-api.service[121403]: method: > Nov 01 19:09:15.850860 n-d-863052-2 devstack@n-api.service[121403]: exception: Instance 77d6f571-5742-462c-ada0-1b05dd1561d1 could not be found. Nov 01 19:09:15.850860 n-d-863052-2 devstack@n-api.service[121403]: action_args: {'id': '77d6f571-5742-462c-ada0-1b05dd1561d1'} Nov 01 19:09:15.850860 n-d-863052-2 devstack@n-api.service[121403]: {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 01 19:09:15.850860 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:09:15.850860 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 01 19:09:15.850860 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 01 19:09:15.850860 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 01 19:09:15.850860 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 01 19:09:15.850860 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 01 19:09:15.850860 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 01 19:09:15.850860 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 01 19:09:15.850860 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 01 19:09:15.850860 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 77d6f571-5742-462c-ada0-1b05dd1561d1 could not be found. Nov 01 19:09:15.850860 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:09:15.850860 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:09:15.850860 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:09:15.850860 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:09:15.850860 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:09:15.850860 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:09:15.850860 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 01 19:09:15.850860 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 01 19:09:15.850860 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 01 19:09:15.850860 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 01 19:09:15.850860 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 01 19:09:15.850860 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 01 19:09:15.850860 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 01 19:09:15.850860 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 01 19:09:15.850860 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 01 19:09:15.850860 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 01 19:09:15.850860 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 77d6f571-5742-462c-ada0-1b05dd1561d1 could not be found. Nov 01 19:09:15.850860 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:09:15.850860 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:09:15.850860 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:09:15.858695 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:09:15.858695 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:09:15.858695 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:09:15.858695 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 01 19:09:15.858695 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 01 19:09:15.858695 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 77d6f571-5742-462c-ada0-1b05dd1561d1 could not be found. Nov 01 19:09:15.858695 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:09:15.860883 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-a59faad8-265b-48c3-b6b6-bc659fc1d83f tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Returning 404 to user: Instance 77d6f571-5742-462c-ada0-1b05dd1561d1 could not be found. {{(pid=121403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 01 19:09:15.861852 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-a59faad8-265b-48c3-b6b6-bc659fc1d83f tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] 10.222.0.13 "GET /compute/v2.1/servers/77d6f571-5742-462c-ada0-1b05dd1561d1" status: 404 len: 111 microversion: 2.47 time: 0.080800 Nov 01 19:09:15.862677 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1877/3649] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 19:09:15 2022] GET /compute/v2.1/servers/77d6f571-5742-462c-ada0-1b05dd1561d1 => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 01 19:09:15.878636 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-e6605b96-d757-4b62-9062-526e5a5ffda9 tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:09:15.884971 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-e6605b96-d757-4b62-9062-526e5a5ffda9 tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] [instance: a30abc7e-5432-4280-b0cc-19a1a8223e7a] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:09:15.905997 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-79c8f300-98a0-49d2-afd3-444ffc10b8cc tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:09:15.906892 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-79c8f300-98a0-49d2-afd3-444ffc10b8cc tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] [instance: 43b22dd3-debb-4a6d-81fc-4666e5bb7804] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:09:15.909965 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e6605b96-d757-4b62-9062-526e5a5ffda9 tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:09:15.910554 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e6605b96-d757-4b62-9062-526e5a5ffda9 tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:09:15.912402 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e6605b96-d757-4b62-9062-526e5a5ffda9 tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:09:15.915703 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e6605b96-d757-4b62-9062-526e5a5ffda9 tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:09:15.918105 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e6605b96-d757-4b62-9062-526e5a5ffda9 tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:09:15.918263 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-79c8f300-98a0-49d2-afd3-444ffc10b8cc tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:09:15.918776 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e6605b96-d757-4b62-9062-526e5a5ffda9 tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:09:15.920395 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-79c8f300-98a0-49d2-afd3-444ffc10b8cc tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:09:15.921237 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-79c8f300-98a0-49d2-afd3-444ffc10b8cc tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:09:15.921993 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-79c8f300-98a0-49d2-afd3-444ffc10b8cc tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:09:15.922627 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-79c8f300-98a0-49d2-afd3-444ffc10b8cc tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:09:15.923067 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-79c8f300-98a0-49d2-afd3-444ffc10b8cc tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:09:15.975977 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-e6605b96-d757-4b62-9062-526e5a5ffda9 tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] [instance: a30abc7e-5432-4280-b0cc-19a1a8223e7a] Going to try to terminate instance {{(pid=121402) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 01 19:09:16.074226 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-e6605b96-d757-4b62-9062-526e5a5ffda9 tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] 10.222.0.13 "DELETE /compute/v2.1/servers/a30abc7e-5432-4280-b0cc-19a1a8223e7a" status: 204 len: 0 microversion: 2.47 time: 0.206720 Nov 01 19:09:16.075493 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1773/3650] 10.222.0.13 () {60 vars in 1280 bytes} [Tue Nov 1 19:09:15 2022] DELETE /compute/v2.1/servers/a30abc7e-5432-4280-b0cc-19a1a8223e7a => generated 0 bytes in 209 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 01 19:09:16.098414 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-8ba46669-3dd9-41b8-9534-3b0c316aa623 tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:09:16.099742 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-8ba46669-3dd9-41b8-9534-3b0c316aa623 tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] [instance: a30abc7e-5432-4280-b0cc-19a1a8223e7a] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:09:16.114759 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-8ba46669-3dd9-41b8-9534-3b0c316aa623 tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:09:16.116036 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-8ba46669-3dd9-41b8-9534-3b0c316aa623 tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:09:16.116962 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-8ba46669-3dd9-41b8-9534-3b0c316aa623 tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:09:16.117805 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-8ba46669-3dd9-41b8-9534-3b0c316aa623 tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:09:16.119027 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-8ba46669-3dd9-41b8-9534-3b0c316aa623 tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:09:16.120085 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-8ba46669-3dd9-41b8-9534-3b0c316aa623 tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:09:16.156179 n-d-863052-2 devstack@n-api.service[121402]: DEBUG dbcounter [-] [121402] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=121402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 19:09:16.289012 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-8ba46669-3dd9-41b8-9534-3b0c316aa623 tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57ba6eeb99714c7cabb14f484968e269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a0c0985c7b9450a8b622b6761e5b5c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:09:16.301172 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-8ba46669-3dd9-41b8-9534-3b0c316aa623 tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57ba6eeb99714c7cabb14f484968e269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a0c0985c7b9450a8b622b6761e5b5c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:09:16.303840 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-8ba46669-3dd9-41b8-9534-3b0c316aa623 tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57ba6eeb99714c7cabb14f484968e269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a0c0985c7b9450a8b622b6761e5b5c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:09:16.306399 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-8ba46669-3dd9-41b8-9534-3b0c316aa623 tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] 10.222.0.13 "GET /compute/v2.1/servers/a30abc7e-5432-4280-b0cc-19a1a8223e7a" status: 200 len: 1362 microversion: 2.47 time: 0.223974 Nov 01 19:09:16.320905 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1774/3651] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 19:09:16 2022] GET /compute/v2.1/servers/a30abc7e-5432-4280-b0cc-19a1a8223e7a => generated 1362 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 19:09:16.323364 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-28851792-906d-46a9-a22d-301a6dc960fa tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:09:16.329448 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-28851792-906d-46a9-a22d-301a6dc960fa tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] [instance: cc8a30dd-b655-48d8-b4e2-d4911cb15513] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:09:16.338767 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-28851792-906d-46a9-a22d-301a6dc960fa tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:09:16.339917 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-28851792-906d-46a9-a22d-301a6dc960fa tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:09:16.339917 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-28851792-906d-46a9-a22d-301a6dc960fa tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:09:16.341727 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-28851792-906d-46a9-a22d-301a6dc960fa tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:09:16.342221 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-28851792-906d-46a9-a22d-301a6dc960fa tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:09:16.342656 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-28851792-906d-46a9-a22d-301a6dc960fa tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:09:16.456135 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-79c8f300-98a0-49d2-afd3-444ffc10b8cc tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113bd8c844ee490b86a68bc7e1e75da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '851785a5f76548898a77d67792888504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:09:16.467425 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-79c8f300-98a0-49d2-afd3-444ffc10b8cc tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] 10.222.0.13 "GET /compute/v2.1/servers/43b22dd3-debb-4a6d-81fc-4666e5bb7804" status: 200 len: 1308 microversion: 2.1 time: 0.565403 Nov 01 19:09:16.468018 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1878/3652] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:09:15 2022] GET /compute/v2.1/servers/43b22dd3-debb-4a6d-81fc-4666e5bb7804 => generated 1308 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 19:09:16.487562 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-eebe2440-e53c-4601-89b4-67f9181d25f9 tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:09:16.488480 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-eebe2440-e53c-4601-89b4-67f9181d25f9 tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] [instance: 03d4513b-9e04-4924-8654-1de3748e333e] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:09:16.501716 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-eebe2440-e53c-4601-89b4-67f9181d25f9 tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:09:16.502530 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-eebe2440-e53c-4601-89b4-67f9181d25f9 tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:09:16.503186 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-eebe2440-e53c-4601-89b4-67f9181d25f9 tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:09:16.504026 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-eebe2440-e53c-4601-89b4-67f9181d25f9 tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:09:16.504489 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-eebe2440-e53c-4601-89b4-67f9181d25f9 tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:09:16.505199 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-eebe2440-e53c-4601-89b4-67f9181d25f9 tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:09:16.673721 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-eebe2440-e53c-4601-89b4-67f9181d25f9 tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c72e7e000a9a4fa49474bd5d19accf77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d8835c7b6754bfd81447b1f8893e56c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:09:16.687042 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-eebe2440-e53c-4601-89b4-67f9181d25f9 tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] 10.222.0.13 "GET /compute/v2.1/servers/03d4513b-9e04-4924-8654-1de3748e333e" status: 200 len: 1299 microversion: 2.1 time: 0.215600 Nov 01 19:09:16.688644 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1879/3653] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:09:16 2022] GET /compute/v2.1/servers/03d4513b-9e04-4924-8654-1de3748e333e => generated 1299 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:09:16.709731 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-28851792-906d-46a9-a22d-301a6dc960fa tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '058480d92c9b4ab4af6815d0438a65c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee9dc49b89143f781e4ab30296e4d01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:09:16.718038 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-28851792-906d-46a9-a22d-301a6dc960fa tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] 10.222.0.13 "GET /compute/v2.1/servers/cc8a30dd-b655-48d8-b4e2-d4911cb15513" status: 200 len: 1315 microversion: 2.1 time: 0.404715 Nov 01 19:09:16.725268 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1775/3654] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:09:16 2022] GET /compute/v2.1/servers/cc8a30dd-b655-48d8-b4e2-d4911cb15513 => generated 1315 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:09:17.249343 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [req-5ce86354-e673-4bef-b83c-9102a2ed9e81 req-5dacb7fb-b076-4a01-a0c5-721a74132f4a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "43b22dd3-debb-4a6d-81fc-4666e5bb7804", "tag": "73fe4105-122c-4088-8dcb-2d3dec7104d3"}]} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:09:17.268777 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-5ce86354-e673-4bef-b83c-9102a2ed9e81 req-5dacb7fb-b076-4a01-a0c5-721a74132f4a service nova] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:09:17.269263 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-5ce86354-e673-4bef-b83c-9102a2ed9e81 req-5dacb7fb-b076-4a01-a0c5-721a74132f4a service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:09:17.269878 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-5ce86354-e673-4bef-b83c-9102a2ed9e81 req-5dacb7fb-b076-4a01-a0c5-721a74132f4a service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:09:17.280792 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-bb944074-5675-419d-b686-985b62c4ac12 tempest-SecurityGroupRulesTestJSON-1558457040 tempest-SecurityGroupRulesTestJSON-1558457040-project] Action: 'create', calling method: .version_select at 0x7f0ae6713940>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1830447803", "description": "tempest-description-90227771"}} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:09:17.299180 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.compute.server_external_events [req-5ce86354-e673-4bef-b83c-9102a2ed9e81 req-5dacb7fb-b076-4a01-a0c5-721a74132f4a service nova] Creating event network-changed:73fe4105-122c-4088-8dcb-2d3dec7104d3 for instance 43b22dd3-debb-4a6d-81fc-4666e5bb7804 on n-h1-863052-2 Nov 01 19:09:17.304190 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [req-5ce86354-e673-4bef-b83c-9102a2ed9e81 req-5dacb7fb-b076-4a01-a0c5-721a74132f4a service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058930 Nov 01 19:09:17.304837 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1776/3655] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Nov 1 19:09:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:09:17.339121 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-df2e477a-139c-48b5-ad3b-9bae89e242bf tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:09:17.340137 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-df2e477a-139c-48b5-ad3b-9bae89e242bf tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] [instance: a30abc7e-5432-4280-b0cc-19a1a8223e7a] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:09:17.350404 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-df2e477a-139c-48b5-ad3b-9bae89e242bf tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:09:17.358659 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-df2e477a-139c-48b5-ad3b-9bae89e242bf tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:09:17.359116 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-df2e477a-139c-48b5-ad3b-9bae89e242bf tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:09:17.359863 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-df2e477a-139c-48b5-ad3b-9bae89e242bf tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:09:17.360321 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-df2e477a-139c-48b5-ad3b-9bae89e242bf tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:09:17.360796 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-df2e477a-139c-48b5-ad3b-9bae89e242bf tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:09:17.501732 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-df2e477a-139c-48b5-ad3b-9bae89e242bf tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57ba6eeb99714c7cabb14f484968e269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a0c0985c7b9450a8b622b6761e5b5c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:09:17.513560 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-df2e477a-139c-48b5-ad3b-9bae89e242bf tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57ba6eeb99714c7cabb14f484968e269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a0c0985c7b9450a8b622b6761e5b5c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:09:17.515599 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-df2e477a-139c-48b5-ad3b-9bae89e242bf tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57ba6eeb99714c7cabb14f484968e269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a0c0985c7b9450a8b622b6761e5b5c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:09:17.517792 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-df2e477a-139c-48b5-ad3b-9bae89e242bf tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] 10.222.0.13 "GET /compute/v2.1/servers/a30abc7e-5432-4280-b0cc-19a1a8223e7a" status: 200 len: 1362 microversion: 2.47 time: 0.183847 Nov 01 19:09:17.530307 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1777/3656] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 19:09:17 2022] GET /compute/v2.1/servers/a30abc7e-5432-4280-b0cc-19a1a8223e7a => generated 1362 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 01 19:09:17.573532 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-3aff6e55-4e4f-48c2-a1d9-5a14cd49d72c tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:09:17.574393 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-3aff6e55-4e4f-48c2-a1d9-5a14cd49d72c tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] [instance: 43b22dd3-debb-4a6d-81fc-4666e5bb7804] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:09:17.581912 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-3aff6e55-4e4f-48c2-a1d9-5a14cd49d72c tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:09:17.582398 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-3aff6e55-4e4f-48c2-a1d9-5a14cd49d72c tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:09:17.582829 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-3aff6e55-4e4f-48c2-a1d9-5a14cd49d72c tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:09:17.583531 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-3aff6e55-4e4f-48c2-a1d9-5a14cd49d72c tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:09:17.584040 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-3aff6e55-4e4f-48c2-a1d9-5a14cd49d72c tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:09:17.584486 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-3aff6e55-4e4f-48c2-a1d9-5a14cd49d72c tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:09:17.711519 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-bb944074-5675-419d-b686-985b62c4ac12 tempest-SecurityGroupRulesTestJSON-1558457040 tempest-SecurityGroupRulesTestJSON-1558457040-project] 10.222.0.13 "POST /compute/v2.1/os-security-groups" status: 200 len: 246 microversion: 2.1 time: 0.499437 Nov 01 19:09:17.712257 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1880/3657] 10.222.0.13 () {60 vars in 1180 bytes} [Tue Nov 1 19:09:17 2022] POST /compute/v2.1/os-security-groups => generated 246 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:09:17.724048 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-df789851-a023-4a6d-91e4-6c84b54d936d tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:09:17.724835 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-df789851-a023-4a6d-91e4-6c84b54d936d tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] [instance: 03d4513b-9e04-4924-8654-1de3748e333e] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:09:17.731573 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-df789851-a023-4a6d-91e4-6c84b54d936d tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:09:17.734248 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-df789851-a023-4a6d-91e4-6c84b54d936d tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:09:17.737318 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-df789851-a023-4a6d-91e4-6c84b54d936d tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:09:17.738599 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-df789851-a023-4a6d-91e4-6c84b54d936d tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:09:17.739704 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-df789851-a023-4a6d-91e4-6c84b54d936d tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:09:17.740903 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-df789851-a023-4a6d-91e4-6c84b54d936d tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:09:17.966001 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-3aff6e55-4e4f-48c2-a1d9-5a14cd49d72c tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113bd8c844ee490b86a68bc7e1e75da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '851785a5f76548898a77d67792888504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:09:17.978135 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-3aff6e55-4e4f-48c2-a1d9-5a14cd49d72c tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] 10.222.0.13 "GET /compute/v2.1/servers/43b22dd3-debb-4a6d-81fc-4666e5bb7804" status: 200 len: 1308 microversion: 2.1 time: 0.435555 Nov 01 19:09:17.979878 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1778/3658] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:09:17 2022] GET /compute/v2.1/servers/43b22dd3-debb-4a6d-81fc-4666e5bb7804 => generated 1308 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:09:17.987149 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-c65ba134-86bb-4cb9-9c6b-4a1aa4ecb508 tempest-SecurityGroupRulesTestJSON-1558457040 tempest-SecurityGroupRulesTestJSON-1558457040-project] Action: 'create', calling method: .version_select at 0x7f0ae17ca550>, body: {"security_group_rule": {"parent_group_id": "facf6e2c-5142-4174-946a-15019f74c044", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:09:18.077022 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-df789851-a023-4a6d-91e4-6c84b54d936d tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c72e7e000a9a4fa49474bd5d19accf77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d8835c7b6754bfd81447b1f8893e56c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:09:18.085788 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-df789851-a023-4a6d-91e4-6c84b54d936d tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] 10.222.0.13 "GET /compute/v2.1/servers/03d4513b-9e04-4924-8654-1de3748e333e" status: 200 len: 1367 microversion: 2.1 time: 0.372197 Nov 01 19:09:18.087324 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1881/3659] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:09:17 2022] GET /compute/v2.1/servers/03d4513b-9e04-4924-8654-1de3748e333e => generated 1367 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:09:18.097454 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-afacbdff-d08b-40a8-ad5c-0a668a7c3aea tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:09:18.098365 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-afacbdff-d08b-40a8-ad5c-0a668a7c3aea tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] [instance: cc8a30dd-b655-48d8-b4e2-d4911cb15513] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:09:18.114202 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-afacbdff-d08b-40a8-ad5c-0a668a7c3aea tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:09:18.114808 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-afacbdff-d08b-40a8-ad5c-0a668a7c3aea tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:09:18.115908 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-afacbdff-d08b-40a8-ad5c-0a668a7c3aea tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:09:18.116753 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-afacbdff-d08b-40a8-ad5c-0a668a7c3aea tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:09:18.117254 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-afacbdff-d08b-40a8-ad5c-0a668a7c3aea tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:09:18.117684 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-afacbdff-d08b-40a8-ad5c-0a668a7c3aea tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:09:18.438023 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-afacbdff-d08b-40a8-ad5c-0a668a7c3aea tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '058480d92c9b4ab4af6815d0438a65c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee9dc49b89143f781e4ab30296e4d01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:09:18.449135 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-afacbdff-d08b-40a8-ad5c-0a668a7c3aea tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] 10.222.0.13 "GET /compute/v2.1/servers/cc8a30dd-b655-48d8-b4e2-d4911cb15513" status: 200 len: 1315 microversion: 2.1 time: 0.360396 Nov 01 19:09:18.449885 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1882/3660] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:09:18 2022] GET /compute/v2.1/servers/cc8a30dd-b655-48d8-b4e2-d4911cb15513 => generated 1315 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:09:18.473184 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [req-a8e2e604-761a-4c46-8773-aa715bc39cbe req-981475a2-cdb0-41f6-a0a5-07feab350047 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cc8a30dd-b655-48d8-b4e2-d4911cb15513", "name": "network-vif-plugged", "status": "completed", "tag": "2fd41cc4-9129-4719-8eec-3c7b8ca74ec9"}]} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:09:18.499202 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-c65ba134-86bb-4cb9-9c6b-4a1aa4ecb508 tempest-SecurityGroupRulesTestJSON-1558457040 tempest-SecurityGroupRulesTestJSON-1558457040-project] 10.222.0.13 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.517642 Nov 01 19:09:18.509032 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1779/3661] 10.222.0.13 () {60 vars in 1195 bytes} [Tue Nov 1 19:09:17 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:09:18.511402 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-a8e2e604-761a-4c46-8773-aa715bc39cbe req-981475a2-cdb0-41f6-a0a5-07feab350047 service nova] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:09:18.511963 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-a8e2e604-761a-4c46-8773-aa715bc39cbe req-981475a2-cdb0-41f6-a0a5-07feab350047 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:09:18.512358 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-a8e2e604-761a-4c46-8773-aa715bc39cbe req-981475a2-cdb0-41f6-a0a5-07feab350047 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:09:18.515824 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-d5e41813-5028-4bbb-a260-14f92d5d9d80 tempest-SecurityGroupRulesTestJSON-1558457040 tempest-SecurityGroupRulesTestJSON-1558457040-project] Action: 'create', calling method: .version_select at 0x7f0ae182c5e0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1621308326", "description": "tempest-description-795564996"}} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:09:18.537944 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.compute.server_external_events [req-a8e2e604-761a-4c46-8773-aa715bc39cbe req-981475a2-cdb0-41f6-a0a5-07feab350047 service nova] Creating event network-vif-plugged:2fd41cc4-9129-4719-8eec-3c7b8ca74ec9 for instance cc8a30dd-b655-48d8-b4e2-d4911cb15513 on n-h1-863052-2 Nov 01 19:09:18.544201 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [req-a8e2e604-761a-4c46-8773-aa715bc39cbe req-981475a2-cdb0-41f6-a0a5-07feab350047 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074903 Nov 01 19:09:18.545364 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1883/3662] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Nov 1 19:09:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 01 19:09:18.552522 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-8a9a9375-0145-4435-acc0-99847fa8b2a1 tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:09:18.553528 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-8a9a9375-0145-4435-acc0-99847fa8b2a1 tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] [instance: a30abc7e-5432-4280-b0cc-19a1a8223e7a] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:09:18.565138 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-8a9a9375-0145-4435-acc0-99847fa8b2a1 tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:09:18.572951 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-8a9a9375-0145-4435-acc0-99847fa8b2a1 tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:09:18.574212 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-8a9a9375-0145-4435-acc0-99847fa8b2a1 tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:09:18.575066 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-8a9a9375-0145-4435-acc0-99847fa8b2a1 tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:09:18.575713 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-8a9a9375-0145-4435-acc0-99847fa8b2a1 tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:09:18.576600 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-8a9a9375-0145-4435-acc0-99847fa8b2a1 tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:09:18.626282 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-8a9a9375-0145-4435-acc0-99847fa8b2a1 tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:09:18.626896 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-8a9a9375-0145-4435-acc0-99847fa8b2a1 tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:09:18.627423 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-8a9a9375-0145-4435-acc0-99847fa8b2a1 tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:09:18.628048 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.objects.instance [None req-8a9a9375-0145-4435-acc0-99847fa8b2a1 tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Lazy-loading 'fault' on Instance uuid a30abc7e-5432-4280-b0cc-19a1a8223e7a {{(pid=121403) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 01 19:09:18.718496 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-8a9a9375-0145-4435-acc0-99847fa8b2a1 tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57ba6eeb99714c7cabb14f484968e269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a0c0985c7b9450a8b622b6761e5b5c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:09:18.733864 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-8a9a9375-0145-4435-acc0-99847fa8b2a1 tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57ba6eeb99714c7cabb14f484968e269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a0c0985c7b9450a8b622b6761e5b5c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:09:18.735951 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-8a9a9375-0145-4435-acc0-99847fa8b2a1 tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57ba6eeb99714c7cabb14f484968e269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a0c0985c7b9450a8b622b6761e5b5c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:09:18.738488 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-8a9a9375-0145-4435-acc0-99847fa8b2a1 tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] 10.222.0.13 "GET /compute/v2.1/servers/a30abc7e-5432-4280-b0cc-19a1a8223e7a" status: 200 len: 1367 microversion: 2.47 time: 0.191448 Nov 01 19:09:18.740604 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1884/3663] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 19:09:18 2022] GET /compute/v2.1/servers/a30abc7e-5432-4280-b0cc-19a1a8223e7a => generated 1367 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 19:09:18.766805 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-d5e41813-5028-4bbb-a260-14f92d5d9d80 tempest-SecurityGroupRulesTestJSON-1558457040 tempest-SecurityGroupRulesTestJSON-1558457040-project] 10.222.0.13 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.256056 Nov 01 19:09:18.767906 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1780/3664] 10.222.0.13 () {60 vars in 1180 bytes} [Tue Nov 1 19:09:18 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:09:18.783388 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-05d081b9-ee05-4029-b8e6-731b80ae6a05 tempest-SecurityGroupRulesTestJSON-1558457040 tempest-SecurityGroupRulesTestJSON-1558457040-project] Action: 'create', calling method: .version_select at 0x7f0ae67133a0>, body: {"security_group_rule": {"parent_group_id": "df9cbd47-0c79-4564-9c6e-09a18f56eb32", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "cidr": "10.2.3.124/24"}} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:09:18.972108 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-05d081b9-ee05-4029-b8e6-731b80ae6a05 tempest-SecurityGroupRulesTestJSON-1558457040 tempest-SecurityGroupRulesTestJSON-1558457040-project] 10.222.0.13 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 236 microversion: 2.1 time: 0.193465 Nov 01 19:09:18.972868 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1885/3665] 10.222.0.13 () {60 vars in 1195 bytes} [Tue Nov 1 19:09:18 2022] POST /compute/v2.1/os-security-group-rules => generated 236 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 01 19:09:18.985961 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-4dd515ae-b653-4522-a951-f00d900fbcd7 tempest-SecurityGroupRulesTestJSON-1558457040 tempest-SecurityGroupRulesTestJSON-1558457040-project] Action: 'create', calling method: .version_select at 0x7f0ae1776ee0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-309768162", "description": "tempest-description-1870882939"}} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:09:19.007127 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-88905e4d-bb99-4f03-a68e-b11c18f5dacc tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:09:19.007736 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-88905e4d-bb99-4f03-a68e-b11c18f5dacc tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] [instance: 43b22dd3-debb-4a6d-81fc-4666e5bb7804] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:09:19.014671 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-88905e4d-bb99-4f03-a68e-b11c18f5dacc tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:09:19.015445 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-88905e4d-bb99-4f03-a68e-b11c18f5dacc tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:09:19.015886 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-88905e4d-bb99-4f03-a68e-b11c18f5dacc tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:09:19.016692 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-88905e4d-bb99-4f03-a68e-b11c18f5dacc tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:09:19.017146 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-88905e4d-bb99-4f03-a68e-b11c18f5dacc tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:09:19.017772 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-88905e4d-bb99-4f03-a68e-b11c18f5dacc tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:09:19.147915 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-4dd515ae-b653-4522-a951-f00d900fbcd7 tempest-SecurityGroupRulesTestJSON-1558457040 tempest-SecurityGroupRulesTestJSON-1558457040-project] 10.222.0.13 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.165833 Nov 01 19:09:19.148528 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1781/3666] 10.222.0.13 () {60 vars in 1180 bytes} [Tue Nov 1 19:09:18 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 01 19:09:19.153203 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-d2280988-a217-4bd4-afff-ad90a3b47b6c tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:09:19.153841 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-d2280988-a217-4bd4-afff-ad90a3b47b6c tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] [instance: 03d4513b-9e04-4924-8654-1de3748e333e] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:09:19.163515 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-d2280988-a217-4bd4-afff-ad90a3b47b6c tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:09:19.164288 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-d2280988-a217-4bd4-afff-ad90a3b47b6c tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:09:19.164950 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-d2280988-a217-4bd4-afff-ad90a3b47b6c tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:09:19.165814 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-d2280988-a217-4bd4-afff-ad90a3b47b6c tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:09:19.166434 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-d2280988-a217-4bd4-afff-ad90a3b47b6c tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:09:19.167039 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-d2280988-a217-4bd4-afff-ad90a3b47b6c tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:09:19.195672 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-88905e4d-bb99-4f03-a68e-b11c18f5dacc tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113bd8c844ee490b86a68bc7e1e75da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '851785a5f76548898a77d67792888504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:09:19.209826 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-88905e4d-bb99-4f03-a68e-b11c18f5dacc tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] 10.222.0.13 "GET /compute/v2.1/servers/43b22dd3-debb-4a6d-81fc-4666e5bb7804" status: 200 len: 1308 microversion: 2.1 time: 0.206925 Nov 01 19:09:19.210858 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1886/3667] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:09:19 2022] GET /compute/v2.1/servers/43b22dd3-debb-4a6d-81fc-4666e5bb7804 => generated 1308 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 19:09:19.222078 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-ed42f0e5-cf46-4be4-8781-408075e0bc72 tempest-SecurityGroupRulesTestJSON-1558457040 tempest-SecurityGroupRulesTestJSON-1558457040-project] Action: 'create', calling method: .version_select at 0x7f0ae2106f70>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-606375395", "description": "tempest-description-1967642798"}} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:09:19.596119 n-d-863052-2 devstack@n-api.service[121402]: DEBUG dbcounter [-] [121402] Writing DB stats nova_cell0:SELECT=4 {{(pid=121402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 19:09:19.642363 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-ed42f0e5-cf46-4be4-8781-408075e0bc72 tempest-SecurityGroupRulesTestJSON-1558457040 tempest-SecurityGroupRulesTestJSON-1558457040-project] 10.222.0.13 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.430159 Nov 01 19:09:19.643360 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1887/3668] 10.222.0.13 () {60 vars in 1180 bytes} [Tue Nov 1 19:09:19 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:09:19.648596 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [req-8a18911c-75c5-4700-b443-62eef38cceeb req-7aa599d1-fc39-431e-b3bb-b4f458b2a8d5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "03d4513b-9e04-4924-8654-1de3748e333e", "tag": "1006d010-6ff0-43d5-af55-b5743e6e84b1"}]} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:09:19.670775 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-8a18911c-75c5-4700-b443-62eef38cceeb req-7aa599d1-fc39-431e-b3bb-b4f458b2a8d5 service nova] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:09:19.671376 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-8a18911c-75c5-4700-b443-62eef38cceeb req-7aa599d1-fc39-431e-b3bb-b4f458b2a8d5 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:09:19.671894 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-8a18911c-75c5-4700-b443-62eef38cceeb req-7aa599d1-fc39-431e-b3bb-b4f458b2a8d5 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:09:19.698860 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.compute.server_external_events [req-8a18911c-75c5-4700-b443-62eef38cceeb req-7aa599d1-fc39-431e-b3bb-b4f458b2a8d5 service nova] Creating event network-changed:1006d010-6ff0-43d5-af55-b5743e6e84b1 for instance 03d4513b-9e04-4924-8654-1de3748e333e on n-h1-863052-2 Nov 01 19:09:19.709594 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [req-8a18911c-75c5-4700-b443-62eef38cceeb req-7aa599d1-fc39-431e-b3bb-b4f458b2a8d5 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064912 Nov 01 19:09:19.710222 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1888/3669] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Nov 1 19:09:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:09:19.715452 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-f0f560a3-bbb1-401b-8439-11c399ec9b3b tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:09:19.721226 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-f0f560a3-bbb1-401b-8439-11c399ec9b3b tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] [instance: cc8a30dd-b655-48d8-b4e2-d4911cb15513] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:09:19.745747 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f0f560a3-bbb1-401b-8439-11c399ec9b3b tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:09:19.746199 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f0f560a3-bbb1-401b-8439-11c399ec9b3b tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:09:19.746659 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f0f560a3-bbb1-401b-8439-11c399ec9b3b tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:09:19.747382 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f0f560a3-bbb1-401b-8439-11c399ec9b3b tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:09:19.747843 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f0f560a3-bbb1-401b-8439-11c399ec9b3b tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:09:19.748568 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f0f560a3-bbb1-401b-8439-11c399ec9b3b tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:09:19.926448 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-f0f560a3-bbb1-401b-8439-11c399ec9b3b tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '058480d92c9b4ab4af6815d0438a65c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee9dc49b89143f781e4ab30296e4d01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:09:19.935357 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-f0f560a3-bbb1-401b-8439-11c399ec9b3b tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] 10.222.0.13 "GET /compute/v2.1/servers/cc8a30dd-b655-48d8-b4e2-d4911cb15513" status: 200 len: 1315 microversion: 2.1 time: 0.223941 Nov 01 19:09:19.941162 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1889/3670] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:09:19 2022] GET /compute/v2.1/servers/cc8a30dd-b655-48d8-b4e2-d4911cb15513 => generated 1315 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:09:19.947733 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-a6a8a3ea-f607-4893-b0dc-2ca9d48f6ff7 tempest-SecurityGroupRulesTestJSON-1558457040 tempest-SecurityGroupRulesTestJSON-1558457040-project] Action: 'create', calling method: .version_select at 0x7f0ae67ff1f0>, body: {"security_group_rule": {"parent_group_id": "74d29902-0461-4a66-91fc-fbaf39776e78", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "910901aa-7f51-454e-a6e9-85b7a0a2f1a6"}} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:09:20.091938 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-d2280988-a217-4bd4-afff-ad90a3b47b6c tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c72e7e000a9a4fa49474bd5d19accf77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d8835c7b6754bfd81447b1f8893e56c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:09:20.116999 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-d2280988-a217-4bd4-afff-ad90a3b47b6c tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] 10.222.0.13 "GET /compute/v2.1/servers/03d4513b-9e04-4924-8654-1de3748e333e" status: 200 len: 1367 microversion: 2.1 time: 0.967107 Nov 01 19:09:20.118636 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1782/3671] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:09:19 2022] GET /compute/v2.1/servers/03d4513b-9e04-4924-8654-1de3748e333e => generated 1367 bytes in 969 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:09:20.124959 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-910368d2-265a-4c90-8d37-1eef67195b55 tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:09:20.126023 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-910368d2-265a-4c90-8d37-1eef67195b55 tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] [instance: a30abc7e-5432-4280-b0cc-19a1a8223e7a] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:09:20.134323 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-910368d2-265a-4c90-8d37-1eef67195b55 tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:09:20.135165 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-910368d2-265a-4c90-8d37-1eef67195b55 tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:09:20.136065 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-910368d2-265a-4c90-8d37-1eef67195b55 tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:09:20.136844 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-910368d2-265a-4c90-8d37-1eef67195b55 tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:09:20.137850 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-910368d2-265a-4c90-8d37-1eef67195b55 tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:09:20.138431 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-910368d2-265a-4c90-8d37-1eef67195b55 tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:09:20.160616 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.wsgi [None req-910368d2-265a-4c90-8d37-1eef67195b55 tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] HTTP exception thrown: Instance a30abc7e-5432-4280-b0cc-19a1a8223e7a could not be found. Nov 01 19:09:20.163351 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-910368d2-265a-4c90-8d37-1eef67195b55 tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Request method failure captured: Nov 01 19:09:20.163351 n-d-863052-2 devstack@n-api.service[121402]: request: GET /compute/v2.1/servers/a30abc7e-5432-4280-b0cc-19a1a8223e7a HTTP/1.1 Nov 01 19:09:20.163351 n-d-863052-2 devstack@n-api.service[121402]: Accept: application/json Nov 01 19:09:20.163351 n-d-863052-2 devstack@n-api.service[121402]: Accept-Encoding: identity Nov 01 19:09:20.163351 n-d-863052-2 devstack@n-api.service[121402]: Connection: close Nov 01 19:09:20.163351 n-d-863052-2 devstack@n-api.service[121402]: Content-Length: 0 Nov 01 19:09:20.163351 n-d-863052-2 devstack@n-api.service[121402]: Content-Type: application/json Nov 01 19:09:20.163351 n-d-863052-2 devstack@n-api.service[121402]: Host: 10.222.0.13 Nov 01 19:09:20.163351 n-d-863052-2 devstack@n-api.service[121402]: Openstack-System-Scope: None Nov 01 19:09:20.163351 n-d-863052-2 devstack@n-api.service[121402]: User-Agent: python-urllib3/1.26.12 Nov 01 19:09:20.163351 n-d-863052-2 devstack@n-api.service[121402]: X-Auth-Token: gAAAAABjYW6kYQbSR4XU4IG7RJw3nb1h_8mJ3WnWJqTzboszdQNcelgJFTbky0izOQTwWVfdJ99D298WNussYySf7BuE8Ucc0KNKC-VDJPd4DY81dKi8Q327MigDDpHJTHE3c6imjVplAYbvsHDGdkhTO0nIrA_Zcc21kMmrrUDMdEV6mjAYzd8 Nov 01 19:09:20.163351 n-d-863052-2 devstack@n-api.service[121402]: X-Domain-Id: None Nov 01 19:09:20.163351 n-d-863052-2 devstack@n-api.service[121402]: X-Domain-Name: None Nov 01 19:09:20.163351 n-d-863052-2 devstack@n-api.service[121402]: X-Identity-Status: Confirmed Nov 01 19:09:20.163351 n-d-863052-2 devstack@n-api.service[121402]: X-Is-Admin-Project: True Nov 01 19:09:20.163351 n-d-863052-2 devstack@n-api.service[121402]: X-Openstack-Nova-Api-Version: 2.47 Nov 01 19:09:20.163351 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Domain-Id: default Nov 01 19:09:20.163351 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Domain-Name: Default Nov 01 19:09:20.163351 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Id: 1a0c0985c7b9450a8b622b6761e5b5c3 Nov 01 19:09:20.163351 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Name: tempest-ServerShowV247Test-2092915885 Nov 01 19:09:20.163351 n-d-863052-2 devstack@n-api.service[121402]: X-Role: member,reader Nov 01 19:09:20.163351 n-d-863052-2 devstack@n-api.service[121402]: X-Roles: member,reader Nov 01 19:09:20.163351 n-d-863052-2 devstack@n-api.service[121402]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/1a0c0985c7b9450a8b622b6761e5b5c3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/1a0c0985c7b9450a8b622b6761e5b5c3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_1a0c0985c7b9450a8b622b6761e5b5c3", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/1a0c0985c7b9450a8b622b6761e5b5c3"}]}] Nov 01 19:09:20.163351 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant: tempest-ServerShowV247Test-2092915885 Nov 01 19:09:20.163351 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant-Id: 1a0c0985c7b9450a8b622b6761e5b5c3 Nov 01 19:09:20.163351 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant-Name: tempest-ServerShowV247Test-2092915885 Nov 01 19:09:20.163351 n-d-863052-2 devstack@n-api.service[121402]: X-User: tempest-ServerShowV247Test-2092915885-project Nov 01 19:09:20.163351 n-d-863052-2 devstack@n-api.service[121402]: X-User-Domain-Id: default Nov 01 19:09:20.163351 n-d-863052-2 devstack@n-api.service[121402]: X-User-Domain-Name: Default Nov 01 19:09:20.163351 n-d-863052-2 devstack@n-api.service[121402]: X-User-Id: 57ba6eeb99714c7cabb14f484968e269 Nov 01 19:09:20.163351 n-d-863052-2 devstack@n-api.service[121402]: X-User-Name: tempest-ServerShowV247Test-2092915885-project Nov 01 19:09:20.163351 n-d-863052-2 devstack@n-api.service[121402]: method: > Nov 01 19:09:20.163351 n-d-863052-2 devstack@n-api.service[121402]: exception: Instance a30abc7e-5432-4280-b0cc-19a1a8223e7a could not be found. Nov 01 19:09:20.163351 n-d-863052-2 devstack@n-api.service[121402]: action_args: {'id': 'a30abc7e-5432-4280-b0cc-19a1a8223e7a'} Nov 01 19:09:20.163351 n-d-863052-2 devstack@n-api.service[121402]: {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 01 19:09:20.163351 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:09:20.163351 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 01 19:09:20.163351 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 01 19:09:20.163351 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 01 19:09:20.163351 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 01 19:09:20.163351 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 01 19:09:20.163351 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 01 19:09:20.163351 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 01 19:09:20.163351 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 01 19:09:20.163351 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a30abc7e-5432-4280-b0cc-19a1a8223e7a could not be found. Nov 01 19:09:20.163351 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:09:20.163351 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:09:20.163351 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:09:20.163351 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:09:20.163351 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:09:20.163351 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:09:20.163351 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 01 19:09:20.163351 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 01 19:09:20.163351 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 01 19:09:20.163351 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 01 19:09:20.163351 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 01 19:09:20.163351 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 01 19:09:20.163351 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 01 19:09:20.163351 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 01 19:09:20.163351 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 01 19:09:20.163351 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 01 19:09:20.163351 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a30abc7e-5432-4280-b0cc-19a1a8223e7a could not be found. Nov 01 19:09:20.163351 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:09:20.163351 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:09:20.163351 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:09:20.168645 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:09:20.168645 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:09:20.168645 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:09:20.168645 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 01 19:09:20.168645 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 01 19:09:20.168645 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a30abc7e-5432-4280-b0cc-19a1a8223e7a could not be found. Nov 01 19:09:20.168645 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:09:20.171534 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-910368d2-265a-4c90-8d37-1eef67195b55 tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] Returning 404 to user: Instance a30abc7e-5432-4280-b0cc-19a1a8223e7a could not be found. {{(pid=121402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 01 19:09:20.172940 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-910368d2-265a-4c90-8d37-1eef67195b55 tempest-ServerShowV247Test-2092915885 tempest-ServerShowV247Test-2092915885-project] 10.222.0.13 "GET /compute/v2.1/servers/a30abc7e-5432-4280-b0cc-19a1a8223e7a" status: 404 len: 111 microversion: 2.47 time: 0.052406 Nov 01 19:09:20.174622 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1783/3672] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 19:09:20 2022] GET /compute/v2.1/servers/a30abc7e-5432-4280-b0cc-19a1a8223e7a => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 01 19:09:20.235810 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-318b70c6-4a3a-48d2-8f2a-1159e67f95cb tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:09:20.236619 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-318b70c6-4a3a-48d2-8f2a-1159e67f95cb tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] [instance: 43b22dd3-debb-4a6d-81fc-4666e5bb7804] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:09:20.250902 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-318b70c6-4a3a-48d2-8f2a-1159e67f95cb tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:09:20.251798 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-318b70c6-4a3a-48d2-8f2a-1159e67f95cb tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:09:20.253121 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-318b70c6-4a3a-48d2-8f2a-1159e67f95cb tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:09:20.254880 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-318b70c6-4a3a-48d2-8f2a-1159e67f95cb tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:09:20.258464 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-318b70c6-4a3a-48d2-8f2a-1159e67f95cb tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:09:20.259199 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-318b70c6-4a3a-48d2-8f2a-1159e67f95cb tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:09:20.383919 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-a6a8a3ea-f607-4893-b0dc-2ca9d48f6ff7 tempest-SecurityGroupRulesTestJSON-1558457040 tempest-SecurityGroupRulesTestJSON-1558457040-project] 10.222.0.13 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 330 microversion: 2.1 time: 0.441232 Nov 01 19:09:20.385223 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1890/3673] 10.222.0.13 () {60 vars in 1195 bytes} [Tue Nov 1 19:09:19 2022] POST /compute/v2.1/os-security-group-rules => generated 330 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:09:20.400114 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-7ad81bfe-2a8d-4891-a3ed-a07d9644958a tempest-SecurityGroupRulesTestJSON-1558457040 tempest-SecurityGroupRulesTestJSON-1558457040-project] Action: 'create', calling method: .version_select at 0x7f0ae6713310>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1741970846", "description": "tempest-description-1415777629"}} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:09:20.640084 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-318b70c6-4a3a-48d2-8f2a-1159e67f95cb tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113bd8c844ee490b86a68bc7e1e75da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '851785a5f76548898a77d67792888504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:09:20.649963 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-318b70c6-4a3a-48d2-8f2a-1159e67f95cb tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] 10.222.0.13 "GET /compute/v2.1/servers/43b22dd3-debb-4a6d-81fc-4666e5bb7804" status: 200 len: 1308 microversion: 2.1 time: 0.419566 Nov 01 19:09:20.650556 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1784/3674] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:09:20 2022] GET /compute/v2.1/servers/43b22dd3-debb-4a6d-81fc-4666e5bb7804 => generated 1308 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:09:20.676924 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-7ad81bfe-2a8d-4891-a3ed-a07d9644958a tempest-SecurityGroupRulesTestJSON-1558457040 tempest-SecurityGroupRulesTestJSON-1558457040-project] 10.222.0.13 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 0.282525 Nov 01 19:09:20.678445 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1891/3675] 10.222.0.13 () {60 vars in 1180 bytes} [Tue Nov 1 19:09:20 2022] POST /compute/v2.1/os-security-groups => generated 248 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:09:20.692003 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-f649092f-034e-450d-b60e-7a762e0e8fa1 tempest-SecurityGroupRulesTestJSON-1558457040 tempest-SecurityGroupRulesTestJSON-1558457040-project] Action: 'create', calling method: .version_select at 0x7f0ae1a1f040>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-2053131870", "description": "tempest-description-2102203965"}} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:09:20.922735 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-f649092f-034e-450d-b60e-7a762e0e8fa1 tempest-SecurityGroupRulesTestJSON-1558457040 tempest-SecurityGroupRulesTestJSON-1558457040-project] 10.222.0.13 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 0.234835 Nov 01 19:09:20.923548 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1785/3676] 10.222.0.13 () {60 vars in 1180 bytes} [Tue Nov 1 19:09:20 2022] POST /compute/v2.1/os-security-groups => generated 248 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:09:20.936495 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-a7e766e8-f8b6-4fe9-97a8-e860aade909b tempest-SecurityGroupRulesTestJSON-1558457040 tempest-SecurityGroupRulesTestJSON-1558457040-project] Action: 'create', calling method: .version_select at 0x7f0ae20f2dc0>, body: {"security_group_rule": {"parent_group_id": "024da4d3-b42e-443a-a656-983cfb304fbe", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "6b82dc2c-04cf-497f-bcce-9e799d9bfef6"}} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:09:20.961144 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-1072259c-7fc2-49fb-a3c1-2ae1a9164749 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:09:20.961968 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-1072259c-7fc2-49fb-a3c1-2ae1a9164749 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] [instance: cc8a30dd-b655-48d8-b4e2-d4911cb15513] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:09:20.969057 n-d-863052-2 devstack@n-api.service[121402]: DEBUG dbcounter [-] [121402] Writing DB stats nova_cell0:SELECT=24 {{(pid=121402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 19:09:20.970603 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-1072259c-7fc2-49fb-a3c1-2ae1a9164749 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:09:20.971115 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-1072259c-7fc2-49fb-a3c1-2ae1a9164749 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:09:20.971694 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-1072259c-7fc2-49fb-a3c1-2ae1a9164749 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:09:20.974752 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-1072259c-7fc2-49fb-a3c1-2ae1a9164749 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:09:20.975223 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-1072259c-7fc2-49fb-a3c1-2ae1a9164749 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:09:20.975642 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-1072259c-7fc2-49fb-a3c1-2ae1a9164749 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:09:21.018949 n-d-863052-2 devstack@n-api.service[121403]: DEBUG dbcounter [-] [121403] Writing DB stats nova_cell0:SELECT=4 {{(pid=121403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 19:09:21.145096 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-1072259c-7fc2-49fb-a3c1-2ae1a9164749 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '058480d92c9b4ab4af6815d0438a65c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee9dc49b89143f781e4ab30296e4d01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:09:21.154090 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-1072259c-7fc2-49fb-a3c1-2ae1a9164749 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] 10.222.0.13 "GET /compute/v2.1/servers/cc8a30dd-b655-48d8-b4e2-d4911cb15513" status: 200 len: 1315 microversion: 2.1 time: 0.198706 Nov 01 19:09:21.155142 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1786/3677] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:09:20 2022] GET /compute/v2.1/servers/cc8a30dd-b655-48d8-b4e2-d4911cb15513 => generated 1315 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 19:09:21.160910 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-f27b8b11-02e7-4c17-927c-121ec84453b2 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "01f27b12-60ce-42ac-b71f-046f96566ac7"}} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:09:21.164843 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-f27b8b11-02e7-4c17-927c-121ec84453b2 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] [instance: ac4160c6-ca16-455e-9613-0d425932af3b] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:09:21.172510 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f27b8b11-02e7-4c17-927c-121ec84453b2 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:09:21.173217 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f27b8b11-02e7-4c17-927c-121ec84453b2 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:09:21.173657 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f27b8b11-02e7-4c17-927c-121ec84453b2 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:09:21.174379 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f27b8b11-02e7-4c17-927c-121ec84453b2 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:09:21.174874 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f27b8b11-02e7-4c17-927c-121ec84453b2 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:09:21.175340 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f27b8b11-02e7-4c17-927c-121ec84453b2 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:09:21.271156 n-d-863052-2 devstack@n-api.service[121403]: DEBUG dbcounter [-] [121403] Writing DB stats nova_cell0:SELECT=26 {{(pid=121403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 19:09:21.295381 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.wsgi [None req-f27b8b11-02e7-4c17-927c-121ec84453b2 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] HTTP exception thrown: Invalid volume: volume 01f27b12-60ce-42ac-b71f-046f96566ac7 is already attached to instances: ac4160c6-ca16-455e-9613-0d425932af3b Nov 01 19:09:21.297200 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-f27b8b11-02e7-4c17-927c-121ec84453b2 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Request method failure captured: Nov 01 19:09:21.297200 n-d-863052-2 devstack@n-api.service[121402]: request: POST /compute/v2.1/servers/ac4160c6-ca16-455e-9613-0d425932af3b/os-volume_attachments HTTP/1.1 Nov 01 19:09:21.297200 n-d-863052-2 devstack@n-api.service[121402]: Accept: application/json Nov 01 19:09:21.297200 n-d-863052-2 devstack@n-api.service[121402]: Accept-Encoding: identity Nov 01 19:09:21.297200 n-d-863052-2 devstack@n-api.service[121402]: Connection: close Nov 01 19:09:21.297200 n-d-863052-2 devstack@n-api.service[121402]: Content-Length: 74 Nov 01 19:09:21.297200 n-d-863052-2 devstack@n-api.service[121402]: Content-Type: application/json Nov 01 19:09:21.297200 n-d-863052-2 devstack@n-api.service[121402]: Host: 10.222.0.13 Nov 01 19:09:21.297200 n-d-863052-2 devstack@n-api.service[121402]: Openstack-System-Scope: None Nov 01 19:09:21.297200 n-d-863052-2 devstack@n-api.service[121402]: User-Agent: python-urllib3/1.26.12 Nov 01 19:09:21.297200 n-d-863052-2 devstack@n-api.service[121402]: X-Auth-Token: gAAAAABjYW26-niUURjtSz2aypPDgkYX79sMl0CZOJW_ml_lGFRo-4lOtvHbbGMI0UBaScGrQfLye0e0L4c10ym8MikDvB1h-T3Rh6fQQzcKLxsRSm1saxobVhs9el4Qiq-2aZx04HWuIjPot0FuuMjXsFtl108kYD3rs-RWb4TVydSfipjFJKk Nov 01 19:09:21.297200 n-d-863052-2 devstack@n-api.service[121402]: X-Domain-Id: None Nov 01 19:09:21.297200 n-d-863052-2 devstack@n-api.service[121402]: X-Domain-Name: None Nov 01 19:09:21.297200 n-d-863052-2 devstack@n-api.service[121402]: X-Identity-Status: Confirmed Nov 01 19:09:21.297200 n-d-863052-2 devstack@n-api.service[121402]: X-Is-Admin-Project: True Nov 01 19:09:21.297200 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Domain-Id: default Nov 01 19:09:21.297200 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Domain-Name: Default Nov 01 19:09:21.297200 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Id: 33e3d319293c46b6af2f728a50586906 Nov 01 19:09:21.297200 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Name: tempest-AttachVolumeNegativeTest-517167560 Nov 01 19:09:21.297200 n-d-863052-2 devstack@n-api.service[121402]: X-Role: member,reader Nov 01 19:09:21.297200 n-d-863052-2 devstack@n-api.service[121402]: X-Roles: member,reader Nov 01 19:09:21.297200 n-d-863052-2 devstack@n-api.service[121402]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/33e3d319293c46b6af2f728a50586906"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/33e3d319293c46b6af2f728a50586906"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_33e3d319293c46b6af2f728a50586906", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/33e3d319293c46b6af2f728a50586906"}]}] Nov 01 19:09:21.297200 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant: tempest-AttachVolumeNegativeTest-517167560 Nov 01 19:09:21.297200 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant-Id: 33e3d319293c46b6af2f728a50586906 Nov 01 19:09:21.297200 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-517167560 Nov 01 19:09:21.297200 n-d-863052-2 devstack@n-api.service[121402]: X-User: tempest-AttachVolumeNegativeTest-517167560-project Nov 01 19:09:21.297200 n-d-863052-2 devstack@n-api.service[121402]: X-User-Domain-Id: default Nov 01 19:09:21.297200 n-d-863052-2 devstack@n-api.service[121402]: X-User-Domain-Name: Default Nov 01 19:09:21.297200 n-d-863052-2 devstack@n-api.service[121402]: X-User-Id: 790f3f1566b7464aaca19d4d05c0942e Nov 01 19:09:21.297200 n-d-863052-2 devstack@n-api.service[121402]: X-User-Name: tempest-AttachVolumeNegativeTest-517167560-project Nov 01 19:09:21.297200 n-d-863052-2 devstack@n-api.service[121402]: Nov 01 19:09:21.297200 n-d-863052-2 devstack@n-api.service[121402]: {"volumeAttachment": {"volumeId": "01f27b12-60ce-42ac-b71f-046f96566ac7"}} Nov 01 19:09:21.297200 n-d-863052-2 devstack@n-api.service[121402]: method: > Nov 01 19:09:21.297200 n-d-863052-2 devstack@n-api.service[121402]: exception: Invalid volume: volume 01f27b12-60ce-42ac-b71f-046f96566ac7 is already attached to instances: ac4160c6-ca16-455e-9613-0d425932af3b Nov 01 19:09:21.297200 n-d-863052-2 devstack@n-api.service[121402]: action_args: {'server_id': 'ac4160c6-ca16-455e-9613-0d425932af3b', 'body': {'volumeAttachment': {'volumeId': '01f27b12-60ce-42ac-b71f-046f96566ac7'}}} Nov 01 19:09:21.297200 n-d-863052-2 devstack@n-api.service[121402]: {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 01 19:09:21.297200 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:09:21.297200 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Nov 01 19:09:21.297200 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Nov 01 19:09:21.297200 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Nov 01 19:09:21.297200 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Nov 01 19:09:21.297200 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Nov 01 19:09:21.297200 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Nov 01 19:09:21.297200 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Nov 01 19:09:21.297200 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Nov 01 19:09:21.297200 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Nov 01 19:09:21.297200 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Nov 01 19:09:21.297200 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 01f27b12-60ce-42ac-b71f-046f96566ac7 is already attached to instances: ac4160c6-ca16-455e-9613-0d425932af3b Nov 01 19:09:21.297200 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:09:21.297200 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:09:21.297200 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:09:21.297200 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:09:21.297200 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:09:21.297200 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:09:21.297200 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 01 19:09:21.297200 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 01 19:09:21.297200 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 01 19:09:21.297200 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 01 19:09:21.297200 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 01 19:09:21.297200 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 01 19:09:21.297200 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 01 19:09:21.297200 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 01 19:09:21.303188 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 01 19:09:21.303188 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 01 19:09:21.303188 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Nov 01 19:09:21.303188 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Nov 01 19:09:21.303188 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 01f27b12-60ce-42ac-b71f-046f96566ac7 is already attached to instances: ac4160c6-ca16-455e-9613-0d425932af3b Nov 01 19:09:21.303188 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:09:21.303188 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:09:21.303188 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:09:21.303188 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:09:21.303188 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:09:21.303188 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:09:21.303188 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 01 19:09:21.303188 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 01 19:09:21.303188 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 01f27b12-60ce-42ac-b71f-046f96566ac7 is already attached to instances: ac4160c6-ca16-455e-9613-0d425932af3b Nov 01 19:09:21.303188 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:09:21.303188 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-f27b8b11-02e7-4c17-927c-121ec84453b2 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Returning 400 to user: Invalid volume: volume 01f27b12-60ce-42ac-b71f-046f96566ac7 is already attached to instances: ac4160c6-ca16-455e-9613-0d425932af3b {{(pid=121402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 01 19:09:21.303188 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-f27b8b11-02e7-4c17-927c-121ec84453b2 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] 10.222.0.13 "POST /compute/v2.1/servers/ac4160c6-ca16-455e-9613-0d425932af3b/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.142144 Nov 01 19:09:21.303188 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1787/3678] 10.222.0.13 () {60 vars in 1323 bytes} [Tue Nov 1 19:09:21 2022] POST /compute/v2.1/servers/ac4160c6-ca16-455e-9613-0d425932af3b/os-volume_attachments => generated 174 bytes in 143 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 01 19:09:21.306259 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-a7e766e8-f8b6-4fe9-97a8-e860aade909b tempest-SecurityGroupRulesTestJSON-1558457040 tempest-SecurityGroupRulesTestJSON-1558457040-project] 10.222.0.13 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 331 microversion: 2.1 time: 0.372889 Nov 01 19:09:21.307026 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1892/3679] 10.222.0.13 () {60 vars in 1195 bytes} [Tue Nov 1 19:09:20 2022] POST /compute/v2.1/os-security-group-rules => generated 331 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:09:21.317271 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-951d5d0e-9c38-4e67-9ea7-e96c087f0b5b tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:09:21.318429 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-951d5d0e-9c38-4e67-9ea7-e96c087f0b5b tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] [instance: 03d4513b-9e04-4924-8654-1de3748e333e] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:09:21.319957 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-3b2b8441-3de5-480a-af84-9c7eff5fc7bf tempest-SecurityGroupRulesTestJSON-1558457040 tempest-SecurityGroupRulesTestJSON-1558457040-project] Calling method '.version_select at 0x7f0ae285f310>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:09:21.324997 n-d-863052-2 devstack@n-api.service[121402]: DEBUG dbcounter [-] [121402] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=3,nova_api:INSERT=3 {{(pid=121402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 19:09:21.326712 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-951d5d0e-9c38-4e67-9ea7-e96c087f0b5b tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:09:21.327349 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-951d5d0e-9c38-4e67-9ea7-e96c087f0b5b tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:09:21.328055 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-951d5d0e-9c38-4e67-9ea7-e96c087f0b5b tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:09:21.328816 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-951d5d0e-9c38-4e67-9ea7-e96c087f0b5b tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:09:21.329336 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-951d5d0e-9c38-4e67-9ea7-e96c087f0b5b tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:09:21.329886 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-951d5d0e-9c38-4e67-9ea7-e96c087f0b5b tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:09:21.573272 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-951d5d0e-9c38-4e67-9ea7-e96c087f0b5b tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c72e7e000a9a4fa49474bd5d19accf77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d8835c7b6754bfd81447b1f8893e56c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:09:21.581824 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-951d5d0e-9c38-4e67-9ea7-e96c087f0b5b tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] 10.222.0.13 "GET /compute/v2.1/servers/03d4513b-9e04-4924-8654-1de3748e333e" status: 200 len: 1367 microversion: 2.1 time: 0.267988 Nov 01 19:09:21.582418 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1788/3680] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:09:21 2022] GET /compute/v2.1/servers/03d4513b-9e04-4924-8654-1de3748e333e => generated 1367 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:09:21.589919 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-62584ae9-e189-4aaf-b167-f1bc3a2b59e2 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:09:21.590657 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-62584ae9-e189-4aaf-b167-f1bc3a2b59e2 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] [instance: ac4160c6-ca16-455e-9613-0d425932af3b] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:09:21.600919 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-62584ae9-e189-4aaf-b167-f1bc3a2b59e2 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:09:21.601776 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-62584ae9-e189-4aaf-b167-f1bc3a2b59e2 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:09:21.602222 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-62584ae9-e189-4aaf-b167-f1bc3a2b59e2 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:09:21.602927 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-62584ae9-e189-4aaf-b167-f1bc3a2b59e2 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:09:21.603386 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-62584ae9-e189-4aaf-b167-f1bc3a2b59e2 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:09:21.604146 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-62584ae9-e189-4aaf-b167-f1bc3a2b59e2 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:09:21.713426 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.objects.instance [None req-62584ae9-e189-4aaf-b167-f1bc3a2b59e2 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lazy-loading 'services' on Instance uuid ac4160c6-ca16-455e-9613-0d425932af3b {{(pid=121402) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 01 19:09:21.815675 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-62584ae9-e189-4aaf-b167-f1bc3a2b59e2 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] 10.222.0.13 "DELETE /compute/v2.1/servers/ac4160c6-ca16-455e-9613-0d425932af3b/os-volume_attachments/01f27b12-60ce-42ac-b71f-046f96566ac7" status: 202 len: 0 microversion: 2.1 time: 0.231190 Nov 01 19:09:21.817084 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1789/3681] 10.222.0.13 () {58 vars in 1416 bytes} [Tue Nov 1 19:09:21 2022] DELETE /compute/v2.1/servers/ac4160c6-ca16-455e-9613-0d425932af3b/os-volume_attachments/01f27b12-60ce-42ac-b71f-046f96566ac7 => generated 0 bytes in 234 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 01 19:09:21.822589 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-45312558-81f2-4b8b-901e-2616569b9bb4 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:09:21.822901 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-3b2b8441-3de5-480a-af84-9c7eff5fc7bf tempest-SecurityGroupRulesTestJSON-1558457040 tempest-SecurityGroupRulesTestJSON-1558457040-project] 10.222.0.13 "DELETE /compute/v2.1/os-security-groups/6b82dc2c-04cf-497f-bcce-9e799d9bfef6" status: 202 len: 0 microversion: 2.1 time: 0.507434 Nov 01 19:09:21.823475 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-45312558-81f2-4b8b-901e-2616569b9bb4 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] [instance: 43b22dd3-debb-4a6d-81fc-4666e5bb7804] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:09:21.823807 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1893/3682] 10.222.0.13 () {58 vars in 1272 bytes} [Tue Nov 1 19:09:21 2022] DELETE /compute/v2.1/os-security-groups/6b82dc2c-04cf-497f-bcce-9e799d9bfef6 => generated 0 bytes in 509 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 01 19:09:21.829684 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-5a63e459-21c1-45c0-9394-59171baebec7 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:09:21.830089 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-45312558-81f2-4b8b-901e-2616569b9bb4 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:09:21.830598 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-45312558-81f2-4b8b-901e-2616569b9bb4 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:09:21.831043 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-45312558-81f2-4b8b-901e-2616569b9bb4 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:09:21.831773 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-45312558-81f2-4b8b-901e-2616569b9bb4 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:09:21.832632 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-45312558-81f2-4b8b-901e-2616569b9bb4 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:09:21.833076 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-45312558-81f2-4b8b-901e-2616569b9bb4 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:09:21.834223 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-5a63e459-21c1-45c0-9394-59171baebec7 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] [instance: ac4160c6-ca16-455e-9613-0d425932af3b] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:09:21.841292 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-5a63e459-21c1-45c0-9394-59171baebec7 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:09:21.842012 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-5a63e459-21c1-45c0-9394-59171baebec7 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:09:21.842896 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-5a63e459-21c1-45c0-9394-59171baebec7 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:09:21.844010 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-5a63e459-21c1-45c0-9394-59171baebec7 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:09:21.844800 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-5a63e459-21c1-45c0-9394-59171baebec7 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:09:21.845445 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-5a63e459-21c1-45c0-9394-59171baebec7 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:09:21.906294 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-5a63e459-21c1-45c0-9394-59171baebec7 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] 10.222.0.13 "GET /compute/v2.1/servers/ac4160c6-ca16-455e-9613-0d425932af3b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.080848 Nov 01 19:09:21.913103 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1894/3683] 10.222.0.13 () {58 vars in 1302 bytes} [Tue Nov 1 19:09:21 2022] GET /compute/v2.1/servers/ac4160c6-ca16-455e-9613-0d425932af3b/os-volume_attachments => generated 197 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:09:21.918468 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-e297fa38-45aa-4205-a1aa-2ee44d23e073 tempest-SecurityGroupRulesTestJSON-1558457040 tempest-SecurityGroupRulesTestJSON-1558457040-project] Calling method '.version_select at 0x7f0ae1f290d0>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:09:21.980008 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-e297fa38-45aa-4205-a1aa-2ee44d23e073 tempest-SecurityGroupRulesTestJSON-1558457040 tempest-SecurityGroupRulesTestJSON-1558457040-project] 10.222.0.13 "GET /compute/v2.1/os-security-groups/024da4d3-b42e-443a-a656-983cfb304fbe" status: 200 len: 248 microversion: 2.1 time: 0.065588 Nov 01 19:09:21.980720 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1895/3684] 10.222.0.13 () {58 vars in 1269 bytes} [Tue Nov 1 19:09:21 2022] GET /compute/v2.1/os-security-groups/024da4d3-b42e-443a-a656-983cfb304fbe => generated 248 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:09:21.997005 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-45312558-81f2-4b8b-901e-2616569b9bb4 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113bd8c844ee490b86a68bc7e1e75da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '851785a5f76548898a77d67792888504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:09:22.002598 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-45312558-81f2-4b8b-901e-2616569b9bb4 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] 10.222.0.13 "GET /compute/v2.1/servers/43b22dd3-debb-4a6d-81fc-4666e5bb7804" status: 200 len: 1308 microversion: 2.1 time: 0.184076 Nov 01 19:09:22.003566 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-fbb5a457-6c42-40c4-a746-49fc114044e3 tempest-SecurityGroupRulesTestJSON-1558457040 tempest-SecurityGroupRulesTestJSON-1558457040-project] Action: 'create', calling method: .version_select at 0x7f0ae203f940>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-264641229", "description": "tempest-description-502980807"}} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:09:22.004891 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1790/3685] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:09:21 2022] GET /compute/v2.1/servers/43b22dd3-debb-4a6d-81fc-4666e5bb7804 => generated 1308 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:09:22.177549 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-3fad4d5c-e13d-450a-82cb-701c86abc020 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:09:22.179275 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-3fad4d5c-e13d-450a-82cb-701c86abc020 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] [instance: cc8a30dd-b655-48d8-b4e2-d4911cb15513] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:09:22.192800 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-3fad4d5c-e13d-450a-82cb-701c86abc020 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:09:22.194170 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-3fad4d5c-e13d-450a-82cb-701c86abc020 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:09:22.196084 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-3fad4d5c-e13d-450a-82cb-701c86abc020 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:09:22.199411 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-3fad4d5c-e13d-450a-82cb-701c86abc020 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:09:22.200317 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-3fad4d5c-e13d-450a-82cb-701c86abc020 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:09:22.201539 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-3fad4d5c-e13d-450a-82cb-701c86abc020 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:09:22.220992 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-fbb5a457-6c42-40c4-a746-49fc114044e3 tempest-SecurityGroupRulesTestJSON-1558457040 tempest-SecurityGroupRulesTestJSON-1558457040-project] 10.222.0.13 "POST /compute/v2.1/os-security-groups" status: 200 len: 246 microversion: 2.1 time: 0.222115 Nov 01 19:09:22.221846 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1896/3686] 10.222.0.13 () {60 vars in 1180 bytes} [Tue Nov 1 19:09:21 2022] POST /compute/v2.1/os-security-groups => generated 246 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:09:22.451329 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-28ab6f64-42a2-4583-91c4-6404d96aa7b1 tempest-VolumesSnapshotsTestJSON-1574615377 tempest-VolumesSnapshotsTestJSON-1574615377-project] Action: 'create', calling method: .version_select at 0x7f0ae20f2820>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1203131989"}} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:09:22.569906 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-3fad4d5c-e13d-450a-82cb-701c86abc020 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '058480d92c9b4ab4af6815d0438a65c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee9dc49b89143f781e4ab30296e4d01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:09:22.579074 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-3fad4d5c-e13d-450a-82cb-701c86abc020 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] 10.222.0.13 "GET /compute/v2.1/servers/cc8a30dd-b655-48d8-b4e2-d4911cb15513" status: 200 len: 1502 microversion: 2.1 time: 0.405837 Nov 01 19:09:22.579969 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1791/3687] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:09:22 2022] GET /compute/v2.1/servers/cc8a30dd-b655-48d8-b4e2-d4911cb15513 => generated 1502 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:09:22.587147 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-be90fe55-5a78-45ab-9557-d307279efa15 tempest-SecurityGroupRulesTestJSON-1558457040 tempest-SecurityGroupRulesTestJSON-1558457040-project] Action: 'create', calling method: .version_select at 0x7f0ae17c25e0>, body: {"security_group_rule": {"parent_group_id": "9acac642-0c48-49dc-8a1d-481279b989ad", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:09:22.864458 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-28ab6f64-42a2-4583-91c4-6404d96aa7b1 tempest-VolumesSnapshotsTestJSON-1574615377 tempest-VolumesSnapshotsTestJSON-1574615377-project] 10.222.0.13 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 0.641296 Nov 01 19:09:22.876088 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1897/3688] 10.222.0.13 () {60 vars in 1155 bytes} [Tue Nov 1 19:09:22 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 653 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Nov 01 19:09:22.883626 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [req-310fe893-f7e2-4f30-8127-657039232211 req-5310e021-85fa-4934-be56-076fe99c79fc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "43b22dd3-debb-4a6d-81fc-4666e5bb7804", "name": "network-vif-plugged", "status": "completed", "tag": "73fe4105-122c-4088-8dcb-2d3dec7104d3"}]} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:09:22.895255 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-310fe893-f7e2-4f30-8127-657039232211 req-5310e021-85fa-4934-be56-076fe99c79fc service nova] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:09:22.896719 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-310fe893-f7e2-4f30-8127-657039232211 req-5310e021-85fa-4934-be56-076fe99c79fc service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:09:22.897670 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-310fe893-f7e2-4f30-8127-657039232211 req-5310e021-85fa-4934-be56-076fe99c79fc service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:09:22.913831 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.compute.server_external_events [req-310fe893-f7e2-4f30-8127-657039232211 req-5310e021-85fa-4934-be56-076fe99c79fc service nova] Creating event network-vif-plugged:73fe4105-122c-4088-8dcb-2d3dec7104d3 for instance 43b22dd3-debb-4a6d-81fc-4666e5bb7804 on n-h1-863052-2 Nov 01 19:09:22.930390 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [req-310fe893-f7e2-4f30-8127-657039232211 req-5310e021-85fa-4934-be56-076fe99c79fc service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043903 Nov 01 19:09:22.931296 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1898/3689] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Nov 1 19:09:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:09:22.939253 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-70fb9aaf-19ee-4bed-b928-8479b9444371 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:09:22.948157 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-70fb9aaf-19ee-4bed-b928-8479b9444371 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:09:22.948981 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-70fb9aaf-19ee-4bed-b928-8479b9444371 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:09:22.949628 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-70fb9aaf-19ee-4bed-b928-8479b9444371 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:09:22.979078 n-d-863052-2 devstack@n-api.service[121403]: DEBUG dbcounter [-] [121403] Writing DB stats nova_cell1:SELECT=100 {{(pid=121403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 19:09:23.018077 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-be90fe55-5a78-45ab-9557-d307279efa15 tempest-SecurityGroupRulesTestJSON-1558457040 tempest-SecurityGroupRulesTestJSON-1558457040-project] 10.222.0.13 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.436764 Nov 01 19:09:23.026954 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1792/3690] 10.222.0.13 () {60 vars in 1195 bytes} [Tue Nov 1 19:09:22 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:09:23.026954 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-057850e4-44ca-48e6-a7e2-ee7dceef5865 tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:09:23.026954 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-057850e4-44ca-48e6-a7e2-ee7dceef5865 tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] [instance: 03d4513b-9e04-4924-8654-1de3748e333e] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:09:23.032818 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-70fb9aaf-19ee-4bed-b928-8479b9444371 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] [instance: cc8a30dd-b655-48d8-b4e2-d4911cb15513] Going to try to stop instance {{(pid=121403) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Nov 01 19:09:23.033775 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-057850e4-44ca-48e6-a7e2-ee7dceef5865 tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:09:23.034430 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-057850e4-44ca-48e6-a7e2-ee7dceef5865 tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:09:23.034951 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-057850e4-44ca-48e6-a7e2-ee7dceef5865 tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:09:23.035754 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-057850e4-44ca-48e6-a7e2-ee7dceef5865 tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:09:23.036312 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-057850e4-44ca-48e6-a7e2-ee7dceef5865 tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:09:23.037370 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-057850e4-44ca-48e6-a7e2-ee7dceef5865 tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:09:23.109949 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-70fb9aaf-19ee-4bed-b928-8479b9444371 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] 10.222.0.13 "POST /compute/v2.1/servers/cc8a30dd-b655-48d8-b4e2-d4911cb15513/action" status: 202 len: 0 microversion: 2.1 time: 0.176303 Nov 01 19:09:23.111641 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1899/3691] 10.222.0.13 () {60 vars in 1278 bytes} [Tue Nov 1 19:09:22 2022] POST /compute/v2.1/servers/cc8a30dd-b655-48d8-b4e2-d4911cb15513/action => generated 0 bytes in 179 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 01 19:09:23.118731 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-91a54c61-66af-4c8b-abe4-c00661939050 tempest-VolumesSnapshotsTestJSON-1574615377 tempest-VolumesSnapshotsTestJSON-1574615377-project] Calling method '.version_select at 0x7f0ae20a5280>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:09:23.189340 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-91a54c61-66af-4c8b-abe4-c00661939050 tempest-VolumesSnapshotsTestJSON-1574615377 tempest-VolumesSnapshotsTestJSON-1574615377-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/5a7b5481-a33f-47af-ad0a-30868a452555" status: 200 len: 345 microversion: 2.1 time: 0.076110 Nov 01 19:09:23.199843 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1900/3692] 10.222.0.13 () {58 vars in 1245 bytes} [Tue Nov 1 19:09:23 2022] GET /compute/v2.1/os-volumes/5a7b5481-a33f-47af-ad0a-30868a452555 => generated 345 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:09:23.205030 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-27ab9e34-9129-41db-b36a-823c1d92beba tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:09:23.207280 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-27ab9e34-9129-41db-b36a-823c1d92beba tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] [instance: ac4160c6-ca16-455e-9613-0d425932af3b] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:09:23.229443 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-27ab9e34-9129-41db-b36a-823c1d92beba tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:09:23.230106 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-27ab9e34-9129-41db-b36a-823c1d92beba tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:09:23.230639 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-27ab9e34-9129-41db-b36a-823c1d92beba tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:09:23.231441 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-27ab9e34-9129-41db-b36a-823c1d92beba tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:09:23.231999 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-27ab9e34-9129-41db-b36a-823c1d92beba tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:09:23.232544 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-27ab9e34-9129-41db-b36a-823c1d92beba tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:09:23.270363 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-27ab9e34-9129-41db-b36a-823c1d92beba tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] 10.222.0.13 "GET /compute/v2.1/servers/ac4160c6-ca16-455e-9613-0d425932af3b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.069293 Nov 01 19:09:23.271266 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1901/3693] 10.222.0.13 () {58 vars in 1302 bytes} [Tue Nov 1 19:09:23 2022] GET /compute/v2.1/servers/ac4160c6-ca16-455e-9613-0d425932af3b/os-volume_attachments => generated 197 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:09:23.276814 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-38b27d89-f722-4260-b8c1-86ea80cd655c tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:09:23.277780 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-38b27d89-f722-4260-b8c1-86ea80cd655c tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] [instance: 43b22dd3-debb-4a6d-81fc-4666e5bb7804] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:09:23.285185 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-38b27d89-f722-4260-b8c1-86ea80cd655c tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:09:23.285951 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-38b27d89-f722-4260-b8c1-86ea80cd655c tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:09:23.287336 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-38b27d89-f722-4260-b8c1-86ea80cd655c tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:09:23.288254 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-38b27d89-f722-4260-b8c1-86ea80cd655c tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:09:23.288958 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-38b27d89-f722-4260-b8c1-86ea80cd655c tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:09:23.289598 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-38b27d89-f722-4260-b8c1-86ea80cd655c tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:09:23.520260 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-38b27d89-f722-4260-b8c1-86ea80cd655c tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113bd8c844ee490b86a68bc7e1e75da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '851785a5f76548898a77d67792888504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:09:23.528394 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-38b27d89-f722-4260-b8c1-86ea80cd655c tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] 10.222.0.13 "GET /compute/v2.1/servers/43b22dd3-debb-4a6d-81fc-4666e5bb7804" status: 200 len: 1308 microversion: 2.1 time: 0.255831 Nov 01 19:09:23.540605 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1902/3694] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:09:23 2022] GET /compute/v2.1/servers/43b22dd3-debb-4a6d-81fc-4666e5bb7804 => generated 1308 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:09:23.540605 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-5f1053df-1a92-44f8-aaca-6969df2936e3 tempest-SecurityGroupRulesTestJSON-1558457040 tempest-SecurityGroupRulesTestJSON-1558457040-project] Action: 'create', calling method: .version_select at 0x7f0ae20f2ee0>, body: {"security_group_rule": {"parent_group_id": "9acac642-0c48-49dc-8a1d-481279b989ad", "ip_protocol": "icmp", "from_port": -1, "to_port": -1}} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:09:23.559626 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-057850e4-44ca-48e6-a7e2-ee7dceef5865 tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c72e7e000a9a4fa49474bd5d19accf77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d8835c7b6754bfd81447b1f8893e56c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:09:23.571921 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-057850e4-44ca-48e6-a7e2-ee7dceef5865 tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] 10.222.0.13 "GET /compute/v2.1/servers/03d4513b-9e04-4924-8654-1de3748e333e" status: 200 len: 1367 microversion: 2.1 time: 0.548837 Nov 01 19:09:23.572531 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1793/3695] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:09:23 2022] GET /compute/v2.1/servers/03d4513b-9e04-4924-8654-1de3748e333e => generated 1367 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:09:23.581368 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-bdb3f770-d877-4192-8fba-63b72781dcab tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:09:23.587326 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-bdb3f770-d877-4192-8fba-63b72781dcab tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] [instance: cc8a30dd-b655-48d8-b4e2-d4911cb15513] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:09:23.595856 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-bdb3f770-d877-4192-8fba-63b72781dcab tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:09:23.596617 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-bdb3f770-d877-4192-8fba-63b72781dcab tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:09:23.597253 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-bdb3f770-d877-4192-8fba-63b72781dcab tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:09:23.598141 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-bdb3f770-d877-4192-8fba-63b72781dcab tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:09:23.598767 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-bdb3f770-d877-4192-8fba-63b72781dcab tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:09:23.599914 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-bdb3f770-d877-4192-8fba-63b72781dcab tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:09:23.780331 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-bdb3f770-d877-4192-8fba-63b72781dcab tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '058480d92c9b4ab4af6815d0438a65c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee9dc49b89143f781e4ab30296e4d01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:09:23.791371 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-bdb3f770-d877-4192-8fba-63b72781dcab tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] 10.222.0.13 "GET /compute/v2.1/servers/cc8a30dd-b655-48d8-b4e2-d4911cb15513" status: 200 len: 1512 microversion: 2.1 time: 0.213278 Nov 01 19:09:23.796707 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1794/3696] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:09:23 2022] GET /compute/v2.1/servers/cc8a30dd-b655-48d8-b4e2-d4911cb15513 => generated 1512 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:09:23.804180 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-5f1053df-1a92-44f8-aaca-6969df2936e3 tempest-SecurityGroupRulesTestJSON-1558457040 tempest-SecurityGroupRulesTestJSON-1558457040-project] 10.222.0.13 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 233 microversion: 2.1 time: 0.273448 Nov 01 19:09:23.805156 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1903/3697] 10.222.0.13 () {60 vars in 1195 bytes} [Tue Nov 1 19:09:23 2022] POST /compute/v2.1/os-security-group-rules => generated 233 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:09:23.822954 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-60c89b43-c0e4-4f98-ac94-f5c20273820d tempest-SecurityGroupRulesTestJSON-1558457040 tempest-SecurityGroupRulesTestJSON-1558457040-project] Calling method '.version_select at 0x7f0ae17c2f70>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:09:23.889162 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-60c89b43-c0e4-4f98-ac94-f5c20273820d tempest-SecurityGroupRulesTestJSON-1558457040 tempest-SecurityGroupRulesTestJSON-1558457040-project] 10.222.0.13 "GET /compute/v2.1/os-security-groups/9acac642-0c48-49dc-8a1d-481279b989ad" status: 200 len: 663 microversion: 2.1 time: 0.071824 Nov 01 19:09:23.889869 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1795/3698] 10.222.0.13 () {58 vars in 1269 bytes} [Tue Nov 1 19:09:23 2022] GET /compute/v2.1/os-security-groups/9acac642-0c48-49dc-8a1d-481279b989ad => generated 663 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:09:23.904293 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-b1842591-3ed1-4e52-ab49-a1573e14b56f tempest-SecurityGroupRulesTestJSON-1558457040 tempest-SecurityGroupRulesTestJSON-1558457040-project] Calling method '.version_select at 0x7f0ae6713b80>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:09:24.063997 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-b1842591-3ed1-4e52-ab49-a1573e14b56f tempest-SecurityGroupRulesTestJSON-1558457040 tempest-SecurityGroupRulesTestJSON-1558457040-project] 10.222.0.13 "DELETE /compute/v2.1/os-security-group-rules/c63ac19f-ab84-4260-b6ad-67a6b5e162ce" status: 202 len: 0 microversion: 2.1 time: 0.163504 Nov 01 19:09:24.064672 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1904/3699] 10.222.0.13 () {58 vars in 1287 bytes} [Tue Nov 1 19:09:23 2022] DELETE /compute/v2.1/os-security-group-rules/c63ac19f-ab84-4260-b6ad-67a6b5e162ce => generated 0 bytes in 165 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 01 19:09:24.075033 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-35612d14-f2e5-4a72-86c4-5168a56f812c tempest-SecurityGroupRulesTestJSON-1558457040 tempest-SecurityGroupRulesTestJSON-1558457040-project] Calling method '.version_select at 0x7f0ae17c11f0>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:09:24.204802 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-e6bdd448-1b95-4eb5-8296-a0ab4b3ccaf3 tempest-VolumesSnapshotsTestJSON-1574615377 tempest-VolumesSnapshotsTestJSON-1574615377-project] Calling method '.version_select at 0x7f0ae6713670>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:09:24.257994 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-e6bdd448-1b95-4eb5-8296-a0ab4b3ccaf3 tempest-VolumesSnapshotsTestJSON-1574615377 tempest-VolumesSnapshotsTestJSON-1574615377-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/5a7b5481-a33f-47af-ad0a-30868a452555" status: 200 len: 346 microversion: 2.1 time: 0.058462 Nov 01 19:09:24.258605 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1905/3700] 10.222.0.13 () {58 vars in 1245 bytes} [Tue Nov 1 19:09:24 2022] GET /compute/v2.1/os-volumes/5a7b5481-a33f-47af-ad0a-30868a452555 => generated 346 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 01 19:09:24.273487 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-53d3230c-ec05-47ac-bbcd-7ce2da13d96b tempest-VolumesSnapshotsTestJSON-1574615377 tempest-VolumesSnapshotsTestJSON-1574615377-project] Action: 'create', calling method: .version_select at 0x7f0ae1f1a040>, body: {"snapshot": {"volume_id": "5a7b5481-a33f-47af-ad0a-30868a452555", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-157561740"}} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:09:24.306177 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-35612d14-f2e5-4a72-86c4-5168a56f812c tempest-SecurityGroupRulesTestJSON-1558457040 tempest-SecurityGroupRulesTestJSON-1558457040-project] 10.222.0.13 "DELETE /compute/v2.1/os-security-groups/9acac642-0c48-49dc-8a1d-481279b989ad" status: 202 len: 0 microversion: 2.1 time: 0.235443 Nov 01 19:09:24.313167 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1796/3701] 10.222.0.13 () {58 vars in 1272 bytes} [Tue Nov 1 19:09:24 2022] DELETE /compute/v2.1/os-security-groups/9acac642-0c48-49dc-8a1d-481279b989ad => generated 0 bytes in 243 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 01 19:09:24.327873 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-f00bc6f6-ceff-4e13-90e6-014de7c4d5f1 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:09:24.341978 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-f00bc6f6-ceff-4e13-90e6-014de7c4d5f1 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] [instance: ac4160c6-ca16-455e-9613-0d425932af3b] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:09:24.359100 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f00bc6f6-ceff-4e13-90e6-014de7c4d5f1 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:09:24.366207 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f00bc6f6-ceff-4e13-90e6-014de7c4d5f1 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:09:24.366978 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f00bc6f6-ceff-4e13-90e6-014de7c4d5f1 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:09:24.369334 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f00bc6f6-ceff-4e13-90e6-014de7c4d5f1 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:09:24.370532 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f00bc6f6-ceff-4e13-90e6-014de7c4d5f1 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:09:24.371037 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f00bc6f6-ceff-4e13-90e6-014de7c4d5f1 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:09:24.413676 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-f00bc6f6-ceff-4e13-90e6-014de7c4d5f1 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] 10.222.0.13 "GET /compute/v2.1/servers/ac4160c6-ca16-455e-9613-0d425932af3b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.098376 Nov 01 19:09:24.414584 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1797/3702] 10.222.0.13 () {58 vars in 1302 bytes} [Tue Nov 1 19:09:24 2022] GET /compute/v2.1/servers/ac4160c6-ca16-455e-9613-0d425932af3b/os-volume_attachments => generated 197 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:09:24.422943 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-f2866d08-6997-45ef-87e0-0b160678930f tempest-SecurityGroupRulesTestJSON-1558457040 tempest-SecurityGroupRulesTestJSON-1558457040-project] Calling method '.version_select at 0x7f0ae17d6c10>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:09:24.466403 n-d-863052-2 devstack@n-api.service[121402]: DEBUG neutronclient.v2_0.client [None req-f2866d08-6997-45ef-87e0-0b160678930f tempest-SecurityGroupRulesTestJSON-1558457040 tempest-SecurityGroupRulesTestJSON-1558457040-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 6b82dc2c-04cf-497f-bcce-9e799d9bfef6 does not exist", "detail": ""}} {{(pid=121402) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Nov 01 19:09:24.467039 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.network.security_group_api [None req-f2866d08-6997-45ef-87e0-0b160678930f tempest-SecurityGroupRulesTestJSON-1558457040 tempest-SecurityGroupRulesTestJSON-1558457040-project] Neutron security group 6b82dc2c-04cf-497f-bcce-9e799d9bfef6 not found {{(pid=121402) get /opt/stack/nova/nova/network/security_group_api.py:313}} Nov 01 19:09:24.467604 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.wsgi [None req-f2866d08-6997-45ef-87e0-0b160678930f tempest-SecurityGroupRulesTestJSON-1558457040 tempest-SecurityGroupRulesTestJSON-1558457040-project] HTTP exception thrown: Security group 6b82dc2c-04cf-497f-bcce-9e799d9bfef6 does not exist Nov 01 19:09:24.467604 n-d-863052-2 devstack@n-api.service[121402]: Neutron server returns request_ids: ['req-9fbc6006-a514-4587-b91f-bee38c3a7c3b'] Nov 01 19:09:24.469955 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-f2866d08-6997-45ef-87e0-0b160678930f tempest-SecurityGroupRulesTestJSON-1558457040 tempest-SecurityGroupRulesTestJSON-1558457040-project] Request method failure captured: Nov 01 19:09:24.469955 n-d-863052-2 devstack@n-api.service[121402]: request: DELETE /compute/v2.1/os-security-groups/6b82dc2c-04cf-497f-bcce-9e799d9bfef6 HTTP/1.1 Nov 01 19:09:24.469955 n-d-863052-2 devstack@n-api.service[121402]: Accept: application/json Nov 01 19:09:24.469955 n-d-863052-2 devstack@n-api.service[121402]: Accept-Encoding: identity Nov 01 19:09:24.469955 n-d-863052-2 devstack@n-api.service[121402]: Connection: close Nov 01 19:09:24.469955 n-d-863052-2 devstack@n-api.service[121402]: Content-Length: 0 Nov 01 19:09:24.469955 n-d-863052-2 devstack@n-api.service[121402]: Content-Type: application/json Nov 01 19:09:24.469955 n-d-863052-2 devstack@n-api.service[121402]: Host: 10.222.0.13 Nov 01 19:09:24.469955 n-d-863052-2 devstack@n-api.service[121402]: Openstack-System-Scope: None Nov 01 19:09:24.469955 n-d-863052-2 devstack@n-api.service[121402]: User-Agent: python-urllib3/1.26.12 Nov 01 19:09:24.469955 n-d-863052-2 devstack@n-api.service[121402]: X-Auth-Token: gAAAAABjYW7dOV7VQyzPfPEMUhDizICZ262MCzDQ5GQYsUNPSeBZOLBckGe2YGlUuVXEOWo8jgdjf6l_UnbWfT_ME1K7OuuJead7039w-Q9N53mg5Txhzjd7bGGNBB6QOJVcHWugSHtiAznsQxbCW46iet49QupFlK7R5indujSDWE73MQxTfiw Nov 01 19:09:24.469955 n-d-863052-2 devstack@n-api.service[121402]: X-Domain-Id: None Nov 01 19:09:24.469955 n-d-863052-2 devstack@n-api.service[121402]: X-Domain-Name: None Nov 01 19:09:24.469955 n-d-863052-2 devstack@n-api.service[121402]: X-Identity-Status: Confirmed Nov 01 19:09:24.469955 n-d-863052-2 devstack@n-api.service[121402]: X-Is-Admin-Project: True Nov 01 19:09:24.469955 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Domain-Id: default Nov 01 19:09:24.469955 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Domain-Name: Default Nov 01 19:09:24.469955 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Id: 31cb3f97e2b240f5b23c2a3371e3f7e3 Nov 01 19:09:24.469955 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Name: tempest-SecurityGroupRulesTestJSON-1558457040 Nov 01 19:09:24.469955 n-d-863052-2 devstack@n-api.service[121402]: X-Role: member,reader Nov 01 19:09:24.469955 n-d-863052-2 devstack@n-api.service[121402]: X-Roles: member,reader Nov 01 19:09:24.469955 n-d-863052-2 devstack@n-api.service[121402]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/31cb3f97e2b240f5b23c2a3371e3f7e3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/31cb3f97e2b240f5b23c2a3371e3f7e3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_31cb3f97e2b240f5b23c2a3371e3f7e3", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/31cb3f97e2b240f5b23c2a3371e3f7e3"}]}] Nov 01 19:09:24.469955 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant: tempest-SecurityGroupRulesTestJSON-1558457040 Nov 01 19:09:24.469955 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant-Id: 31cb3f97e2b240f5b23c2a3371e3f7e3 Nov 01 19:09:24.469955 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant-Name: tempest-SecurityGroupRulesTestJSON-1558457040 Nov 01 19:09:24.469955 n-d-863052-2 devstack@n-api.service[121402]: X-User: tempest-SecurityGroupRulesTestJSON-1558457040-project Nov 01 19:09:24.469955 n-d-863052-2 devstack@n-api.service[121402]: X-User-Domain-Id: default Nov 01 19:09:24.469955 n-d-863052-2 devstack@n-api.service[121402]: X-User-Domain-Name: Default Nov 01 19:09:24.469955 n-d-863052-2 devstack@n-api.service[121402]: X-User-Id: 8a633bbfcec54c8cbc5471f76f8b34db Nov 01 19:09:24.469955 n-d-863052-2 devstack@n-api.service[121402]: X-User-Name: tempest-SecurityGroupRulesTestJSON-1558457040-project Nov 01 19:09:24.469955 n-d-863052-2 devstack@n-api.service[121402]: method: Nov 01 19:09:24.469955 n-d-863052-2 devstack@n-api.service[121402]: exception: Security group 6b82dc2c-04cf-497f-bcce-9e799d9bfef6 does not exist Nov 01 19:09:24.469955 n-d-863052-2 devstack@n-api.service[121402]: Neutron server returns request_ids: ['req-9fbc6006-a514-4587-b91f-bee38c3a7c3b'] Nov 01 19:09:24.469955 n-d-863052-2 devstack@n-api.service[121402]: action_args: {'id': '6b82dc2c-04cf-497f-bcce-9e799d9bfef6'} Nov 01 19:09:24.469955 n-d-863052-2 devstack@n-api.service[121402]: {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 01 19:09:24.469955 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:09:24.469955 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Nov 01 19:09:24.469955 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Nov 01 19:09:24.469955 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 01 19:09:24.469955 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 01 19:09:24.469955 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Nov 01 19:09:24.469955 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Nov 01 19:09:24.469955 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 01 19:09:24.469955 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 01 19:09:24.469955 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 01 19:09:24.469955 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 01 19:09:24.469955 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 01 19:09:24.469955 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 01 19:09:24.469955 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 01 19:09:24.469955 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 01 19:09:24.469955 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 01 19:09:24.469955 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 01 19:09:24.469955 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Nov 01 19:09:24.469955 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Nov 01 19:09:24.469955 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 01 19:09:24.469955 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 01 19:09:24.469955 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Nov 01 19:09:24.469955 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Nov 01 19:09:24.469955 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Nov 01 19:09:24.469955 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Nov 01 19:09:24.469955 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 6b82dc2c-04cf-497f-bcce-9e799d9bfef6 does not exist Nov 01 19:09:24.474635 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9fbc6006-a514-4587-b91f-bee38c3a7c3b'] Nov 01 19:09:24.474635 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:09:24.474635 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:09:24.474635 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:09:24.474635 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:09:24.474635 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Nov 01 19:09:24.474635 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Nov 01 19:09:24.474635 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Nov 01 19:09:24.474635 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Nov 01 19:09:24.474635 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 6b82dc2c-04cf-497f-bcce-9e799d9bfef6 does not exist Nov 01 19:09:24.474635 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9fbc6006-a514-4587-b91f-bee38c3a7c3b'] Nov 01 19:09:24.474635 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:09:24.474635 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:09:24.474635 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:09:24.474635 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:09:24.474635 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:09:24.474635 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:09:24.474635 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 01 19:09:24.474635 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 01 19:09:24.474635 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 01 19:09:24.474635 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 01 19:09:24.474635 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 01 19:09:24.474635 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 01 19:09:24.474635 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Nov 01 19:09:24.474635 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Nov 01 19:09:24.474635 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 6b82dc2c-04cf-497f-bcce-9e799d9bfef6 does not exist Nov 01 19:09:24.474635 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9fbc6006-a514-4587-b91f-bee38c3a7c3b'] Nov 01 19:09:24.474635 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:09:24.474635 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:09:24.474635 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:09:24.474635 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:09:24.474635 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:09:24.474635 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:09:24.474635 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 01 19:09:24.474635 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 01 19:09:24.474635 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 6b82dc2c-04cf-497f-bcce-9e799d9bfef6 does not exist Nov 01 19:09:24.474635 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9fbc6006-a514-4587-b91f-bee38c3a7c3b'] Nov 01 19:09:24.474635 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:09:24.474635 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-f2866d08-6997-45ef-87e0-0b160678930f tempest-SecurityGroupRulesTestJSON-1558457040 tempest-SecurityGroupRulesTestJSON-1558457040-project] Returning 404 to user: Security group 6b82dc2c-04cf-497f-bcce-9e799d9bfef6 does not exist Nov 01 19:09:24.474635 n-d-863052-2 devstack@n-api.service[121402]: Neutron server returns request_ids: ['req-9fbc6006-a514-4587-b91f-bee38c3a7c3b'] {{(pid=121402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 01 19:09:24.474635 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-f2866d08-6997-45ef-87e0-0b160678930f tempest-SecurityGroupRulesTestJSON-1558457040 tempest-SecurityGroupRulesTestJSON-1558457040-project] 10.222.0.13 "DELETE /compute/v2.1/os-security-groups/6b82dc2c-04cf-497f-bcce-9e799d9bfef6" status: 404 len: 194 microversion: 2.1 time: 0.057729 Nov 01 19:09:24.474635 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1798/3703] 10.222.0.13 () {58 vars in 1272 bytes} [Tue Nov 1 19:09:24 2022] DELETE /compute/v2.1/os-security-groups/6b82dc2c-04cf-497f-bcce-9e799d9bfef6 => generated 194 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 01 19:09:24.483165 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-970865a5-638e-49b3-be48-d5daff789995 tempest-SecurityGroupRulesTestJSON-1558457040 tempest-SecurityGroupRulesTestJSON-1558457040-project] Calling method '.version_select at 0x7f0ae1746670>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:09:24.535726 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-53d3230c-ec05-47ac-bbcd-7ce2da13d96b tempest-VolumesSnapshotsTestJSON-1574615377 tempest-VolumesSnapshotsTestJSON-1574615377-project] 10.222.0.13 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.267548 Nov 01 19:09:24.536406 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1906/3704] 10.222.0.13 () {60 vars in 1162 bytes} [Tue Nov 1 19:09:24 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 01 19:09:24.549439 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-b06c39ca-fd34-424c-83c4-44ee69948b57 tempest-VolumesSnapshotsTestJSON-1574615377 tempest-VolumesSnapshotsTestJSON-1574615377-project] Calling method '.version_select at 0x7f0ae2e02d30>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:09:24.605905 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-b06c39ca-fd34-424c-83c4-44ee69948b57 tempest-VolumesSnapshotsTestJSON-1574615377 tempest-VolumesSnapshotsTestJSON-1574615377-project] 10.222.0.13 "GET /compute/v2.1/os-snapshots/ba375cb3-a613-43ac-9c5e-627f1793aa79" status: 200 len: 286 microversion: 2.1 time: 0.060596 Nov 01 19:09:24.614375 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1907/3705] 10.222.0.13 () {58 vars in 1251 bytes} [Tue Nov 1 19:09:24 2022] GET /compute/v2.1/os-snapshots/ba375cb3-a613-43ac-9c5e-627f1793aa79 => generated 286 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:09:24.621137 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-42b3097f-80b3-4a4f-abe6-4ba2640ea33b tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:09:24.621913 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-42b3097f-80b3-4a4f-abe6-4ba2640ea33b tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] [instance: 43b22dd3-debb-4a6d-81fc-4666e5bb7804] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:09:24.632091 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-42b3097f-80b3-4a4f-abe6-4ba2640ea33b tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:09:24.632976 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-42b3097f-80b3-4a4f-abe6-4ba2640ea33b tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:09:24.633940 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-42b3097f-80b3-4a4f-abe6-4ba2640ea33b tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:09:24.635422 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-42b3097f-80b3-4a4f-abe6-4ba2640ea33b tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:09:24.639021 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-42b3097f-80b3-4a4f-abe6-4ba2640ea33b tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:09:24.639716 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-42b3097f-80b3-4a4f-abe6-4ba2640ea33b tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:09:24.848675 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-42b3097f-80b3-4a4f-abe6-4ba2640ea33b tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113bd8c844ee490b86a68bc7e1e75da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '851785a5f76548898a77d67792888504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:09:24.863527 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-42b3097f-80b3-4a4f-abe6-4ba2640ea33b tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] 10.222.0.13 "GET /compute/v2.1/servers/43b22dd3-debb-4a6d-81fc-4666e5bb7804" status: 200 len: 1308 microversion: 2.1 time: 0.247058 Nov 01 19:09:24.867787 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1908/3706] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:09:24 2022] GET /compute/v2.1/servers/43b22dd3-debb-4a6d-81fc-4666e5bb7804 => generated 1308 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:09:24.878942 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-19443768-4a9c-4706-beb6-f8118aafe93d tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:09:24.879786 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-19443768-4a9c-4706-beb6-f8118aafe93d tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] [instance: 03d4513b-9e04-4924-8654-1de3748e333e] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:09:24.886914 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-19443768-4a9c-4706-beb6-f8118aafe93d tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:09:24.887672 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-19443768-4a9c-4706-beb6-f8118aafe93d tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:09:24.888344 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-19443768-4a9c-4706-beb6-f8118aafe93d tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:09:24.889518 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-19443768-4a9c-4706-beb6-f8118aafe93d tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:09:24.890181 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-19443768-4a9c-4706-beb6-f8118aafe93d tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:09:24.890808 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-19443768-4a9c-4706-beb6-f8118aafe93d tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:09:25.063460 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-19443768-4a9c-4706-beb6-f8118aafe93d tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c72e7e000a9a4fa49474bd5d19accf77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d8835c7b6754bfd81447b1f8893e56c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:09:25.074334 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-19443768-4a9c-4706-beb6-f8118aafe93d tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] 10.222.0.13 "GET /compute/v2.1/servers/03d4513b-9e04-4924-8654-1de3748e333e" status: 200 len: 1367 microversion: 2.1 time: 0.203652 Nov 01 19:09:25.074941 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1909/3707] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:09:24 2022] GET /compute/v2.1/servers/03d4513b-9e04-4924-8654-1de3748e333e => generated 1367 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:09:25.093290 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-6eb168b3-46c0-4386-9012-62c9952cd0fd tempest-VolumesSnapshotsTestJSON-1574615377 tempest-VolumesSnapshotsTestJSON-1574615377-project] Calling method '.version_select at 0x7f0ae6713b80>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:09:25.148067 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-6eb168b3-46c0-4386-9012-62c9952cd0fd tempest-VolumesSnapshotsTestJSON-1574615377 tempest-VolumesSnapshotsTestJSON-1574615377-project] 10.222.0.13 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.065826 Nov 01 19:09:25.155496 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-970865a5-638e-49b3-be48-d5daff789995 tempest-SecurityGroupRulesTestJSON-1558457040 tempest-SecurityGroupRulesTestJSON-1558457040-project] 10.222.0.13 "DELETE /compute/v2.1/os-security-groups/024da4d3-b42e-443a-a656-983cfb304fbe" status: 202 len: 0 microversion: 2.1 time: 0.671432 Nov 01 19:09:25.155496 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1799/3708] 10.222.0.13 () {58 vars in 1272 bytes} [Tue Nov 1 19:09:24 2022] DELETE /compute/v2.1/os-security-groups/024da4d3-b42e-443a-a656-983cfb304fbe => generated 0 bytes in 673 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 01 19:09:25.157057 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-0a3b16d2-6112-4787-86e3-038e0d47e1b7 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:09:25.157636 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1910/3709] 10.222.0.13 () {58 vars in 1140 bytes} [Tue Nov 1 19:09:25 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:09:25.157763 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-0a3b16d2-6112-4787-86e3-038e0d47e1b7 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] [instance: cc8a30dd-b655-48d8-b4e2-d4911cb15513] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:09:25.165997 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-70961582-7470-4f6c-861b-109d2bbd3116 tempest-SecurityGroupRulesTestJSON-1558457040 tempest-SecurityGroupRulesTestJSON-1558457040-project] Calling method '.version_select at 0x7f0ae1f299d0>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:09:25.174864 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-0a3b16d2-6112-4787-86e3-038e0d47e1b7 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:09:25.175344 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-0a3b16d2-6112-4787-86e3-038e0d47e1b7 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:09:25.179138 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-0a3b16d2-6112-4787-86e3-038e0d47e1b7 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:09:25.179909 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-0a3b16d2-6112-4787-86e3-038e0d47e1b7 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:09:25.180391 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-0a3b16d2-6112-4787-86e3-038e0d47e1b7 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:09:25.180870 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-0a3b16d2-6112-4787-86e3-038e0d47e1b7 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:09:25.410501 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-0a3b16d2-6112-4787-86e3-038e0d47e1b7 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '058480d92c9b4ab4af6815d0438a65c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee9dc49b89143f781e4ab30296e4d01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:09:25.412052 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-70961582-7470-4f6c-861b-109d2bbd3116 tempest-SecurityGroupRulesTestJSON-1558457040 tempest-SecurityGroupRulesTestJSON-1558457040-project] 10.222.0.13 "DELETE /compute/v2.1/os-security-groups/910901aa-7f51-454e-a6e9-85b7a0a2f1a6" status: 202 len: 0 microversion: 2.1 time: 0.252123 Nov 01 19:09:25.416118 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1911/3710] 10.222.0.13 () {58 vars in 1272 bytes} [Tue Nov 1 19:09:25 2022] DELETE /compute/v2.1/os-security-groups/910901aa-7f51-454e-a6e9-85b7a0a2f1a6 => generated 0 bytes in 258 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 01 19:09:25.419743 n-d-863052-2 devstack@n-api.service[121402]: DEBUG dbcounter [-] [121402] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=121402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 19:09:25.424545 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-0a3b16d2-6112-4787-86e3-038e0d47e1b7 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] 10.222.0.13 "GET /compute/v2.1/servers/cc8a30dd-b655-48d8-b4e2-d4911cb15513" status: 200 len: 1512 microversion: 2.1 time: 0.272275 Nov 01 19:09:25.426815 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1800/3711] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:09:25 2022] GET /compute/v2.1/servers/cc8a30dd-b655-48d8-b4e2-d4911cb15513 => generated 1512 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:09:25.427926 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-259f1787-ff69-4382-b2a2-1a587131a869 tempest-VolumesSnapshotsTestJSON-1574615377 tempest-VolumesSnapshotsTestJSON-1574615377-project] Calling method '.version_select at 0x7f0ae1d2eca0>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:09:25.448327 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-f031bf04-810c-4407-9757-ca0a4ef54a50 tempest-SecurityGroupRulesTestJSON-1558457040 tempest-SecurityGroupRulesTestJSON-1558457040-project] Calling method '.version_select at 0x7f0ae1776820>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:09:25.483851 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-259f1787-ff69-4382-b2a2-1a587131a869 tempest-VolumesSnapshotsTestJSON-1574615377 tempest-VolumesSnapshotsTestJSON-1574615377-project] 10.222.0.13 "GET /compute/v2.1/os-snapshots/ba375cb3-a613-43ac-9c5e-627f1793aa79" status: 200 len: 286 microversion: 2.1 time: 0.066302 Nov 01 19:09:25.489383 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1912/3712] 10.222.0.13 () {58 vars in 1251 bytes} [Tue Nov 1 19:09:25 2022] GET /compute/v2.1/os-snapshots/ba375cb3-a613-43ac-9c5e-627f1793aa79 => generated 286 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:09:25.634585 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-5e1c9008-5edd-4b3c-83f7-dc2a2b268fea tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:09:25.637114 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-5e1c9008-5edd-4b3c-83f7-dc2a2b268fea tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] [instance: ac4160c6-ca16-455e-9613-0d425932af3b] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:09:25.643373 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-5e1c9008-5edd-4b3c-83f7-dc2a2b268fea tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:09:25.644141 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-5e1c9008-5edd-4b3c-83f7-dc2a2b268fea tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:09:25.644817 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-5e1c9008-5edd-4b3c-83f7-dc2a2b268fea tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:09:25.646507 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-5e1c9008-5edd-4b3c-83f7-dc2a2b268fea tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:09:25.647422 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-5e1c9008-5edd-4b3c-83f7-dc2a2b268fea tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:09:25.648086 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-5e1c9008-5edd-4b3c-83f7-dc2a2b268fea tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:09:25.682358 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-5e1c9008-5edd-4b3c-83f7-dc2a2b268fea tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] 10.222.0.13 "GET /compute/v2.1/servers/ac4160c6-ca16-455e-9613-0d425932af3b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.196359 Nov 01 19:09:25.683198 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1913/3713] 10.222.0.13 () {58 vars in 1302 bytes} [Tue Nov 1 19:09:25 2022] GET /compute/v2.1/servers/ac4160c6-ca16-455e-9613-0d425932af3b/os-volume_attachments => generated 197 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:09:25.684233 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-f031bf04-810c-4407-9757-ca0a4ef54a50 tempest-SecurityGroupRulesTestJSON-1558457040 tempest-SecurityGroupRulesTestJSON-1558457040-project] 10.222.0.13 "DELETE /compute/v2.1/os-security-groups/74d29902-0461-4a66-91fc-fbaf39776e78" status: 202 len: 0 microversion: 2.1 time: 0.255116 Nov 01 19:09:25.687841 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1801/3714] 10.222.0.13 () {58 vars in 1272 bytes} [Tue Nov 1 19:09:25 2022] DELETE /compute/v2.1/os-security-groups/74d29902-0461-4a66-91fc-fbaf39776e78 => generated 0 bytes in 257 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 01 19:09:25.696623 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-9348d983-748b-4e89-a939-c0a69efb349b tempest-SecurityGroupRulesTestJSON-1558457040 tempest-SecurityGroupRulesTestJSON-1558457040-project] Calling method '.version_select at 0x7f0ae28518b0>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:09:25.893644 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-3838e34b-be0d-474c-891c-7f03b3641b81 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:09:25.894886 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-3838e34b-be0d-474c-891c-7f03b3641b81 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] [instance: 43b22dd3-debb-4a6d-81fc-4666e5bb7804] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:09:25.904498 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-3838e34b-be0d-474c-891c-7f03b3641b81 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:09:25.905479 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-3838e34b-be0d-474c-891c-7f03b3641b81 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:09:25.906128 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-3838e34b-be0d-474c-891c-7f03b3641b81 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:09:25.907135 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-3838e34b-be0d-474c-891c-7f03b3641b81 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:09:25.907801 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-3838e34b-be0d-474c-891c-7f03b3641b81 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:09:25.908490 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-3838e34b-be0d-474c-891c-7f03b3641b81 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:09:25.920228 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-9348d983-748b-4e89-a939-c0a69efb349b tempest-SecurityGroupRulesTestJSON-1558457040 tempest-SecurityGroupRulesTestJSON-1558457040-project] 10.222.0.13 "DELETE /compute/v2.1/os-security-groups/df9cbd47-0c79-4564-9c6e-09a18f56eb32" status: 202 len: 0 microversion: 2.1 time: 0.230509 Nov 01 19:09:25.921105 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1914/3715] 10.222.0.13 () {58 vars in 1272 bytes} [Tue Nov 1 19:09:25 2022] DELETE /compute/v2.1/os-security-groups/df9cbd47-0c79-4564-9c6e-09a18f56eb32 => generated 0 bytes in 232 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 01 19:09:25.931524 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-1b72759c-ea31-44dc-a41d-ac75cbc995f5 tempest-SecurityGroupRulesTestJSON-1558457040 tempest-SecurityGroupRulesTestJSON-1558457040-project] Calling method '.version_select at 0x7f0ae6713e50>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:09:26.073474 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-3838e34b-be0d-474c-891c-7f03b3641b81 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113bd8c844ee490b86a68bc7e1e75da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '851785a5f76548898a77d67792888504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:09:26.081643 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-3838e34b-be0d-474c-891c-7f03b3641b81 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] 10.222.0.13 "GET /compute/v2.1/servers/43b22dd3-debb-4a6d-81fc-4666e5bb7804" status: 200 len: 1489 microversion: 2.1 time: 0.192259 Nov 01 19:09:26.096979 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1802/3716] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:09:25 2022] GET /compute/v2.1/servers/43b22dd3-debb-4a6d-81fc-4666e5bb7804 => generated 1489 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:09:26.105465 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-58f80404-36ea-4570-b2d5-6bda2a4444d7 tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:09:26.106400 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-58f80404-36ea-4570-b2d5-6bda2a4444d7 tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] [instance: 03d4513b-9e04-4924-8654-1de3748e333e] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:09:26.114132 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-58f80404-36ea-4570-b2d5-6bda2a4444d7 tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:09:26.116150 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-58f80404-36ea-4570-b2d5-6bda2a4444d7 tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:09:26.116629 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-58f80404-36ea-4570-b2d5-6bda2a4444d7 tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:09:26.117695 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-58f80404-36ea-4570-b2d5-6bda2a4444d7 tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:09:26.118239 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-58f80404-36ea-4570-b2d5-6bda2a4444d7 tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:09:26.118682 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-58f80404-36ea-4570-b2d5-6bda2a4444d7 tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:09:26.212484 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-1b72759c-ea31-44dc-a41d-ac75cbc995f5 tempest-SecurityGroupRulesTestJSON-1558457040 tempest-SecurityGroupRulesTestJSON-1558457040-project] 10.222.0.13 "DELETE /compute/v2.1/os-security-groups/facf6e2c-5142-4174-946a-15019f74c044" status: 202 len: 0 microversion: 2.1 time: 0.287074 Nov 01 19:09:26.214226 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1915/3717] 10.222.0.13 () {58 vars in 1272 bytes} [Tue Nov 1 19:09:25 2022] DELETE /compute/v2.1/os-security-groups/facf6e2c-5142-4174-946a-15019f74c044 => generated 0 bytes in 290 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 01 19:09:26.221353 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-a4281838-837c-42d7-b6fe-5128f2003051 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-\u00cd\u00f1st\u00e1\u00f1c\u00e9-2043568827"}} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:09:26.225686 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-a4281838-837c-42d7-b6fe-5128f2003051 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] [instance: 43b22dd3-debb-4a6d-81fc-4666e5bb7804] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:09:26.251387 n-d-863052-2 devstack@n-api.service[121403]: DEBUG dbcounter [-] [121403] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=121403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 19:09:26.252460 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-a4281838-837c-42d7-b6fe-5128f2003051 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:09:26.254020 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-a4281838-837c-42d7-b6fe-5128f2003051 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:09:26.256686 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-a4281838-837c-42d7-b6fe-5128f2003051 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:09:26.257653 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-a4281838-837c-42d7-b6fe-5128f2003051 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:09:26.260130 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-a4281838-837c-42d7-b6fe-5128f2003051 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:09:26.260841 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-a4281838-837c-42d7-b6fe-5128f2003051 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:09:26.363576 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-a4281838-837c-42d7-b6fe-5128f2003051 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] 10.222.0.13 "PUT /compute/v2.1/servers/43b22dd3-debb-4a6d-81fc-4666e5bb7804" status: 200 len: 1075 microversion: 2.1 time: 0.147861 Nov 01 19:09:26.380161 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1916/3718] 10.222.0.13 () {60 vars in 1256 bytes} [Tue Nov 1 19:09:26 2022] PUT /compute/v2.1/servers/43b22dd3-debb-4a6d-81fc-4666e5bb7804 => generated 1075 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:09:26.395531 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-022d0968-8531-4879-ab39-15ad0c624533 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:09:26.399420 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-022d0968-8531-4879-ab39-15ad0c624533 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] [instance: 43b22dd3-debb-4a6d-81fc-4666e5bb7804] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:09:26.414900 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-022d0968-8531-4879-ab39-15ad0c624533 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:09:26.417013 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-022d0968-8531-4879-ab39-15ad0c624533 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:09:26.417638 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-022d0968-8531-4879-ab39-15ad0c624533 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:09:26.419910 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-022d0968-8531-4879-ab39-15ad0c624533 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:09:26.420482 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-022d0968-8531-4879-ab39-15ad0c624533 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:09:26.424215 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-022d0968-8531-4879-ab39-15ad0c624533 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:09:26.467204 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-58f80404-36ea-4570-b2d5-6bda2a4444d7 tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c72e7e000a9a4fa49474bd5d19accf77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d8835c7b6754bfd81447b1f8893e56c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:09:26.497301 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-58f80404-36ea-4570-b2d5-6bda2a4444d7 tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] 10.222.0.13 "GET /compute/v2.1/servers/03d4513b-9e04-4924-8654-1de3748e333e" status: 200 len: 1367 microversion: 2.1 time: 0.390054 Nov 01 19:09:26.505420 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1803/3719] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:09:26 2022] GET /compute/v2.1/servers/03d4513b-9e04-4924-8654-1de3748e333e => generated 1367 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:09:26.542381 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-888bd1ac-f801-426c-8af6-017dc75ebbb0 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:09:26.551297 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-888bd1ac-f801-426c-8af6-017dc75ebbb0 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] [instance: cc8a30dd-b655-48d8-b4e2-d4911cb15513] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:09:26.566273 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-888bd1ac-f801-426c-8af6-017dc75ebbb0 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:09:26.566991 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-888bd1ac-f801-426c-8af6-017dc75ebbb0 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:09:26.567654 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-888bd1ac-f801-426c-8af6-017dc75ebbb0 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:09:26.568906 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-888bd1ac-f801-426c-8af6-017dc75ebbb0 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:09:26.569739 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-888bd1ac-f801-426c-8af6-017dc75ebbb0 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:09:26.570674 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-888bd1ac-f801-426c-8af6-017dc75ebbb0 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:09:26.710756 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-022d0968-8531-4879-ab39-15ad0c624533 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113bd8c844ee490b86a68bc7e1e75da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '851785a5f76548898a77d67792888504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:09:26.722090 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-022d0968-8531-4879-ab39-15ad0c624533 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] 10.222.0.13 "GET /compute/v2.1/servers/43b22dd3-debb-4a6d-81fc-4666e5bb7804" status: 200 len: 1501 microversion: 2.1 time: 0.333981 Nov 01 19:09:26.738698 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1917/3720] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:09:26 2022] GET /compute/v2.1/servers/43b22dd3-debb-4a6d-81fc-4666e5bb7804 => generated 1501 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:09:26.745331 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-9d2bcc00-66dd-433f-9f68-3e7613823441 tempest-VolumesSnapshotsTestJSON-1574615377 tempest-VolumesSnapshotsTestJSON-1574615377-project] Calling method '.version_select at 0x7f0ae1d2eca0>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:09:26.781863 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-9d2bcc00-66dd-433f-9f68-3e7613823441 tempest-VolumesSnapshotsTestJSON-1574615377 tempest-VolumesSnapshotsTestJSON-1574615377-project] 10.222.0.13 "GET /compute/v2.1/os-snapshots/ba375cb3-a613-43ac-9c5e-627f1793aa79" status: 200 len: 286 microversion: 2.1 time: 0.040962 Nov 01 19:09:26.788725 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1918/3721] 10.222.0.13 () {58 vars in 1251 bytes} [Tue Nov 1 19:09:26 2022] GET /compute/v2.1/os-snapshots/ba375cb3-a613-43ac-9c5e-627f1793aa79 => generated 286 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:09:26.794184 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [req-fcd1c729-8fcb-4306-abad-bce5c568053a req-9bdd35cc-d640-41ae-947c-e8d404dafc09 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03d4513b-9e04-4924-8654-1de3748e333e", "name": "network-vif-plugged", "status": "completed", "tag": "1006d010-6ff0-43d5-af55-b5743e6e84b1"}]} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:09:26.805236 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-fcd1c729-8fcb-4306-abad-bce5c568053a req-9bdd35cc-d640-41ae-947c-e8d404dafc09 service nova] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:09:26.805916 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-fcd1c729-8fcb-4306-abad-bce5c568053a req-9bdd35cc-d640-41ae-947c-e8d404dafc09 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:09:26.806542 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-fcd1c729-8fcb-4306-abad-bce5c568053a req-9bdd35cc-d640-41ae-947c-e8d404dafc09 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:09:26.820394 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.compute.server_external_events [req-fcd1c729-8fcb-4306-abad-bce5c568053a req-9bdd35cc-d640-41ae-947c-e8d404dafc09 service nova] Creating event network-vif-plugged:1006d010-6ff0-43d5-af55-b5743e6e84b1 for instance 03d4513b-9e04-4924-8654-1de3748e333e on n-h1-863052-2 Nov 01 19:09:26.825671 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [req-fcd1c729-8fcb-4306-abad-bce5c568053a req-9bdd35cc-d640-41ae-947c-e8d404dafc09 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035359 Nov 01 19:09:26.826833 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1919/3722] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Nov 1 19:09:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:09:26.833289 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-b5cf3102-2aac-448e-94fe-d02483d4e07a tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:09:26.840091 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-b5cf3102-2aac-448e-94fe-d02483d4e07a tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] [instance: ac4160c6-ca16-455e-9613-0d425932af3b] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:09:26.849961 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-b5cf3102-2aac-448e-94fe-d02483d4e07a tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:09:26.852199 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-b5cf3102-2aac-448e-94fe-d02483d4e07a tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:09:26.853031 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-b5cf3102-2aac-448e-94fe-d02483d4e07a tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:09:26.854037 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-b5cf3102-2aac-448e-94fe-d02483d4e07a tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:09:26.854743 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-b5cf3102-2aac-448e-94fe-d02483d4e07a tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:09:26.855363 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-b5cf3102-2aac-448e-94fe-d02483d4e07a tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:09:26.855712 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-888bd1ac-f801-426c-8af6-017dc75ebbb0 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '058480d92c9b4ab4af6815d0438a65c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee9dc49b89143f781e4ab30296e4d01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:09:26.878390 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-888bd1ac-f801-426c-8af6-017dc75ebbb0 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] 10.222.0.13 "GET /compute/v2.1/servers/cc8a30dd-b655-48d8-b4e2-d4911cb15513" status: 200 len: 1512 microversion: 2.1 time: 0.346294 Nov 01 19:09:26.880767 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1804/3723] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:09:26 2022] GET /compute/v2.1/servers/cc8a30dd-b655-48d8-b4e2-d4911cb15513 => generated 1512 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:09:26.889602 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-b5cf3102-2aac-448e-94fe-d02483d4e07a tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] 10.222.0.13 "GET /compute/v2.1/servers/ac4160c6-ca16-455e-9613-0d425932af3b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.061282 Nov 01 19:09:26.894322 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1920/3724] 10.222.0.13 () {58 vars in 1302 bytes} [Tue Nov 1 19:09:26 2022] GET /compute/v2.1/servers/ac4160c6-ca16-455e-9613-0d425932af3b/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:09:26.900088 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-39f7aca2-34ba-41e5-8bf0-020712e71564 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:09:26.900997 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-39f7aca2-34ba-41e5-8bf0-020712e71564 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] [instance: 43b22dd3-debb-4a6d-81fc-4666e5bb7804] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:09:26.909541 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-39f7aca2-34ba-41e5-8bf0-020712e71564 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:09:26.910269 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-39f7aca2-34ba-41e5-8bf0-020712e71564 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:09:26.910924 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-39f7aca2-34ba-41e5-8bf0-020712e71564 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:09:26.911831 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-39f7aca2-34ba-41e5-8bf0-020712e71564 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:09:26.912291 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-39f7aca2-34ba-41e5-8bf0-020712e71564 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:09:26.912858 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-39f7aca2-34ba-41e5-8bf0-020712e71564 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:09:27.225722 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-39f7aca2-34ba-41e5-8bf0-020712e71564 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113bd8c844ee490b86a68bc7e1e75da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '851785a5f76548898a77d67792888504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:09:27.233897 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-39f7aca2-34ba-41e5-8bf0-020712e71564 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] 10.222.0.13 "GET /compute/v2.1/servers/43b22dd3-debb-4a6d-81fc-4666e5bb7804" status: 200 len: 1501 microversion: 2.1 time: 0.351285 Nov 01 19:09:27.236917 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1805/3725] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:09:26 2022] GET /compute/v2.1/servers/43b22dd3-debb-4a6d-81fc-4666e5bb7804 => generated 1501 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:09:27.260486 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-8347be4c-ba69-42a8-a32f-b5a5d6668080 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:09:27.266908 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-8347be4c-ba69-42a8-a32f-b5a5d6668080 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:09:27.267399 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-8347be4c-ba69-42a8-a32f-b5a5d6668080 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:09:27.268055 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-8347be4c-ba69-42a8-a32f-b5a5d6668080 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:09:27.292195 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-8347be4c-ba69-42a8-a32f-b5a5d6668080 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] [instance: 43b22dd3-debb-4a6d-81fc-4666e5bb7804] Going to try to stop instance {{(pid=121403) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Nov 01 19:09:27.348070 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-8347be4c-ba69-42a8-a32f-b5a5d6668080 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] 10.222.0.13 "POST /compute/v2.1/servers/43b22dd3-debb-4a6d-81fc-4666e5bb7804/action" status: 202 len: 0 microversion: 2.1 time: 0.091294 Nov 01 19:09:27.348834 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1921/3726] 10.222.0.13 () {60 vars in 1278 bytes} [Tue Nov 1 19:09:27 2022] POST /compute/v2.1/servers/43b22dd3-debb-4a6d-81fc-4666e5bb7804/action => generated 0 bytes in 93 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 01 19:09:27.357983 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-37008a43-21cf-4f55-a89c-f17da00a1eba tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:09:27.358710 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-37008a43-21cf-4f55-a89c-f17da00a1eba tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] [instance: 43b22dd3-debb-4a6d-81fc-4666e5bb7804] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:09:27.365363 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-37008a43-21cf-4f55-a89c-f17da00a1eba tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:09:27.365992 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-37008a43-21cf-4f55-a89c-f17da00a1eba tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:09:27.366650 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-37008a43-21cf-4f55-a89c-f17da00a1eba tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:09:27.367423 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-37008a43-21cf-4f55-a89c-f17da00a1eba tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:09:27.367887 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-37008a43-21cf-4f55-a89c-f17da00a1eba tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:09:27.368313 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-37008a43-21cf-4f55-a89c-f17da00a1eba tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:09:27.528506 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-6cfc75e5-296a-4018-ae20-c8f02194be6c tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:09:27.529387 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-6cfc75e5-296a-4018-ae20-c8f02194be6c tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] [instance: 03d4513b-9e04-4924-8654-1de3748e333e] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:09:27.535884 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-6cfc75e5-296a-4018-ae20-c8f02194be6c tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:09:27.536189 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-6cfc75e5-296a-4018-ae20-c8f02194be6c tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:09:27.537220 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-6cfc75e5-296a-4018-ae20-c8f02194be6c tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:09:27.537915 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-6cfc75e5-296a-4018-ae20-c8f02194be6c tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:09:27.538363 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-6cfc75e5-296a-4018-ae20-c8f02194be6c tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:09:27.538778 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-6cfc75e5-296a-4018-ae20-c8f02194be6c tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:09:27.565313 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-37008a43-21cf-4f55-a89c-f17da00a1eba tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113bd8c844ee490b86a68bc7e1e75da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '851785a5f76548898a77d67792888504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:09:27.573047 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-37008a43-21cf-4f55-a89c-f17da00a1eba tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] 10.222.0.13 "GET /compute/v2.1/servers/43b22dd3-debb-4a6d-81fc-4666e5bb7804" status: 200 len: 1511 microversion: 2.1 time: 0.219758 Nov 01 19:09:27.574169 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1806/3727] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:09:27 2022] GET /compute/v2.1/servers/43b22dd3-debb-4a6d-81fc-4666e5bb7804 => generated 1511 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 19:09:27.704308 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-6cfc75e5-296a-4018-ae20-c8f02194be6c tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c72e7e000a9a4fa49474bd5d19accf77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d8835c7b6754bfd81447b1f8893e56c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:09:27.712920 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-6cfc75e5-296a-4018-ae20-c8f02194be6c tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] 10.222.0.13 "GET /compute/v2.1/servers/03d4513b-9e04-4924-8654-1de3748e333e" status: 200 len: 1367 microversion: 2.1 time: 0.189208 Nov 01 19:09:27.713722 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1922/3728] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:09:27 2022] GET /compute/v2.1/servers/03d4513b-9e04-4924-8654-1de3748e333e => generated 1367 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:09:27.796529 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-9e74cb4c-f4a2-42e0-8c77-564767251a3d tempest-VolumesSnapshotsTestJSON-1574615377 tempest-VolumesSnapshotsTestJSON-1574615377-project] Calling method '.version_select at 0x7f0ae17c18b0>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:09:27.852080 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-9e74cb4c-f4a2-42e0-8c77-564767251a3d tempest-VolumesSnapshotsTestJSON-1574615377 tempest-VolumesSnapshotsTestJSON-1574615377-project] 10.222.0.13 "GET /compute/v2.1/os-snapshots/ba375cb3-a613-43ac-9c5e-627f1793aa79" status: 200 len: 287 microversion: 2.1 time: 0.060277 Nov 01 19:09:27.853265 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1807/3729] 10.222.0.13 () {58 vars in 1251 bytes} [Tue Nov 1 19:09:27 2022] GET /compute/v2.1/os-snapshots/ba375cb3-a613-43ac-9c5e-627f1793aa79 => generated 287 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:09:27.865089 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-08c6c052-93e4-4d72-aa2b-97a32e47f4da tempest-VolumesSnapshotsTestJSON-1574615377 tempest-VolumesSnapshotsTestJSON-1574615377-project] Calling method '.version_select at 0x7f0ae1d2e0d0>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:09:27.907227 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-9a8a0f5b-5956-48f0-b02d-31f57df05547 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:09:27.909541 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-9a8a0f5b-5956-48f0-b02d-31f57df05547 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] [instance: ac4160c6-ca16-455e-9613-0d425932af3b] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:09:27.917792 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-9a8a0f5b-5956-48f0-b02d-31f57df05547 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:09:27.927140 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-9a8a0f5b-5956-48f0-b02d-31f57df05547 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:09:27.931675 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-9a8a0f5b-5956-48f0-b02d-31f57df05547 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:09:27.935580 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-9a8a0f5b-5956-48f0-b02d-31f57df05547 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:09:27.937344 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-9a8a0f5b-5956-48f0-b02d-31f57df05547 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:09:27.937991 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-9a8a0f5b-5956-48f0-b02d-31f57df05547 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:09:27.959125 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-08c6c052-93e4-4d72-aa2b-97a32e47f4da tempest-VolumesSnapshotsTestJSON-1574615377 tempest-VolumesSnapshotsTestJSON-1574615377-project] 10.222.0.13 "DELETE /compute/v2.1/os-snapshots/ba375cb3-a613-43ac-9c5e-627f1793aa79" status: 202 len: 0 microversion: 2.1 time: 0.098317 Nov 01 19:09:27.960604 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1923/3730] 10.222.0.13 () {58 vars in 1254 bytes} [Tue Nov 1 19:09:27 2022] DELETE /compute/v2.1/os-snapshots/ba375cb3-a613-43ac-9c5e-627f1793aa79 => generated 0 bytes in 101 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 01 19:09:27.965316 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-e6407962-f29c-4874-b9bc-c668bc03f397 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:09:27.966031 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-e6407962-f29c-4874-b9bc-c668bc03f397 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] [instance: cc8a30dd-b655-48d8-b4e2-d4911cb15513] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:09:27.982021 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-e6407962-f29c-4874-b9bc-c668bc03f397 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:09:27.982752 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-e6407962-f29c-4874-b9bc-c668bc03f397 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:09:27.983336 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-e6407962-f29c-4874-b9bc-c668bc03f397 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:09:27.984125 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-e6407962-f29c-4874-b9bc-c668bc03f397 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:09:27.984783 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-e6407962-f29c-4874-b9bc-c668bc03f397 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:09:27.985399 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-e6407962-f29c-4874-b9bc-c668bc03f397 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:09:27.990988 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-9a8a0f5b-5956-48f0-b02d-31f57df05547 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] 10.222.0.13 "GET /compute/v2.1/servers/ac4160c6-ca16-455e-9613-0d425932af3b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.089346 Nov 01 19:09:27.996054 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1808/3731] 10.222.0.13 () {58 vars in 1302 bytes} [Tue Nov 1 19:09:27 2022] GET /compute/v2.1/servers/ac4160c6-ca16-455e-9613-0d425932af3b/os-volume_attachments => generated 197 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:09:27.999857 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-ef3bcdfc-8c3d-4a7b-879c-9d8c7ecaba66 tempest-VolumesSnapshotsTestJSON-1574615377 tempest-VolumesSnapshotsTestJSON-1574615377-project] Calling method '.version_select at 0x7f0ae17ca160>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:09:28.052502 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-ef3bcdfc-8c3d-4a7b-879c-9d8c7ecaba66 tempest-VolumesSnapshotsTestJSON-1574615377 tempest-VolumesSnapshotsTestJSON-1574615377-project] 10.222.0.13 "GET /compute/v2.1/os-snapshots/ba375cb3-a613-43ac-9c5e-627f1793aa79" status: 200 len: 286 microversion: 2.1 time: 0.056613 Nov 01 19:09:28.053107 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1809/3732] 10.222.0.13 () {58 vars in 1251 bytes} [Tue Nov 1 19:09:27 2022] GET /compute/v2.1/os-snapshots/ba375cb3-a613-43ac-9c5e-627f1793aa79 => generated 286 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:09:28.236803 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-e6407962-f29c-4874-b9bc-c668bc03f397 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '058480d92c9b4ab4af6815d0438a65c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee9dc49b89143f781e4ab30296e4d01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:09:28.245951 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-e6407962-f29c-4874-b9bc-c668bc03f397 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] 10.222.0.13 "GET /compute/v2.1/servers/cc8a30dd-b655-48d8-b4e2-d4911cb15513" status: 200 len: 1512 microversion: 2.1 time: 0.284303 Nov 01 19:09:28.264699 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1924/3733] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:09:27 2022] GET /compute/v2.1/servers/cc8a30dd-b655-48d8-b4e2-d4911cb15513 => generated 1512 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:09:28.598350 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-e361a31b-8946-41cb-a611-b8444ec934f2 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:09:28.599619 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-e361a31b-8946-41cb-a611-b8444ec934f2 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] [instance: 43b22dd3-debb-4a6d-81fc-4666e5bb7804] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:09:28.607838 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e361a31b-8946-41cb-a611-b8444ec934f2 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:09:28.608569 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e361a31b-8946-41cb-a611-b8444ec934f2 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:09:28.609185 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e361a31b-8946-41cb-a611-b8444ec934f2 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:09:28.610167 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e361a31b-8946-41cb-a611-b8444ec934f2 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:09:28.610789 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e361a31b-8946-41cb-a611-b8444ec934f2 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:09:28.611377 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e361a31b-8946-41cb-a611-b8444ec934f2 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:09:28.736272 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-16ad56c3-3cae-4d84-8c47-15a589628885 tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:09:28.736910 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-16ad56c3-3cae-4d84-8c47-15a589628885 tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] [instance: 03d4513b-9e04-4924-8654-1de3748e333e] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:09:28.745625 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-16ad56c3-3cae-4d84-8c47-15a589628885 tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:09:28.746488 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-16ad56c3-3cae-4d84-8c47-15a589628885 tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:09:28.747765 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-16ad56c3-3cae-4d84-8c47-15a589628885 tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:09:28.749463 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-16ad56c3-3cae-4d84-8c47-15a589628885 tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:09:28.750282 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-16ad56c3-3cae-4d84-8c47-15a589628885 tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:09:28.757214 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-16ad56c3-3cae-4d84-8c47-15a589628885 tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:09:28.854469 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-e361a31b-8946-41cb-a611-b8444ec934f2 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113bd8c844ee490b86a68bc7e1e75da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '851785a5f76548898a77d67792888504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:09:28.869768 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-e361a31b-8946-41cb-a611-b8444ec934f2 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] 10.222.0.13 "GET /compute/v2.1/servers/43b22dd3-debb-4a6d-81fc-4666e5bb7804" status: 200 len: 1511 microversion: 2.1 time: 0.276438 Nov 01 19:09:28.886255 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1810/3734] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:09:28 2022] GET /compute/v2.1/servers/43b22dd3-debb-4a6d-81fc-4666e5bb7804 => generated 1511 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:09:28.991858 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-16ad56c3-3cae-4d84-8c47-15a589628885 tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c72e7e000a9a4fa49474bd5d19accf77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d8835c7b6754bfd81447b1f8893e56c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:09:29.001414 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-16ad56c3-3cae-4d84-8c47-15a589628885 tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] 10.222.0.13 "GET /compute/v2.1/servers/03d4513b-9e04-4924-8654-1de3748e333e" status: 200 len: 1557 microversion: 2.1 time: 0.269058 Nov 01 19:09:29.002339 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1925/3735] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:09:28 2022] GET /compute/v2.1/servers/03d4513b-9e04-4924-8654-1de3748e333e => generated 1557 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 19:09:29.003905 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-24bc06fa-d613-4829-abff-b1b330a97581 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:09:29.006841 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-24bc06fa-d613-4829-abff-b1b330a97581 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] [instance: ac4160c6-ca16-455e-9613-0d425932af3b] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:09:29.026007 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-0b1ae628-7f8d-4798-b36d-3c2832ff2d5a tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:09:29.026502 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-0b1ae628-7f8d-4798-b36d-3c2832ff2d5a tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] [instance: 03d4513b-9e04-4924-8654-1de3748e333e] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:09:29.033248 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-0b1ae628-7f8d-4798-b36d-3c2832ff2d5a tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:09:29.033738 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-0b1ae628-7f8d-4798-b36d-3c2832ff2d5a tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:09:29.034071 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-24bc06fa-d613-4829-abff-b1b330a97581 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:09:29.034255 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-0b1ae628-7f8d-4798-b36d-3c2832ff2d5a tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:09:29.034859 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-0b1ae628-7f8d-4798-b36d-3c2832ff2d5a tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:09:29.035067 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-24bc06fa-d613-4829-abff-b1b330a97581 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:09:29.035311 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-0b1ae628-7f8d-4798-b36d-3c2832ff2d5a tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:09:29.035895 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-0b1ae628-7f8d-4798-b36d-3c2832ff2d5a tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:09:29.036165 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-24bc06fa-d613-4829-abff-b1b330a97581 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:09:29.037744 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-24bc06fa-d613-4829-abff-b1b330a97581 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:09:29.038512 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-24bc06fa-d613-4829-abff-b1b330a97581 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:09:29.039156 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-24bc06fa-d613-4829-abff-b1b330a97581 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:09:29.082795 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-24bc06fa-d613-4829-abff-b1b330a97581 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] 10.222.0.13 "GET /compute/v2.1/servers/ac4160c6-ca16-455e-9613-0d425932af3b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.083059 Nov 01 19:09:29.106809 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1811/3736] 10.222.0.13 () {58 vars in 1302 bytes} [Tue Nov 1 19:09:28 2022] GET /compute/v2.1/servers/ac4160c6-ca16-455e-9613-0d425932af3b/os-volume_attachments => generated 25 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Nov 01 19:09:29.125523 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-967073f7-dbec-481c-904e-e044deccb299 tempest-VolumesSnapshotsTestJSON-1574615377 tempest-VolumesSnapshotsTestJSON-1574615377-project] Calling method '.version_select at 0x7f0ae182c4c0>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:09:29.189599 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-0b1ae628-7f8d-4798-b36d-3c2832ff2d5a tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] 10.222.0.13 "GET /compute/v2.1/servers/03d4513b-9e04-4924-8654-1de3748e333e/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.168168 Nov 01 19:09:29.197788 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1926/3737] 10.222.0.13 () {58 vars in 1275 bytes} [Tue Nov 1 19:09:29 2022] GET /compute/v2.1/servers/03d4513b-9e04-4924-8654-1de3748e333e/os-interface => generated 284 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:09:29.202665 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-c01c1c58-d411-4271-b837-a4680a6f8eb2 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:09:29.203163 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-c01c1c58-d411-4271-b837-a4680a6f8eb2 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] [instance: ac4160c6-ca16-455e-9613-0d425932af3b] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:09:29.219641 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-c01c1c58-d411-4271-b837-a4680a6f8eb2 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:09:29.220147 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-c01c1c58-d411-4271-b837-a4680a6f8eb2 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:09:29.220622 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-c01c1c58-d411-4271-b837-a4680a6f8eb2 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:09:29.225197 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-c01c1c58-d411-4271-b837-a4680a6f8eb2 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:09:29.225676 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-c01c1c58-d411-4271-b837-a4680a6f8eb2 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:09:29.226112 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-c01c1c58-d411-4271-b837-a4680a6f8eb2 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:09:29.235897 n-d-863052-2 devstack@n-api.service[121403]: DEBUG dbcounter [-] [121403] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=121403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 19:09:29.287053 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-967073f7-dbec-481c-904e-e044deccb299 tempest-VolumesSnapshotsTestJSON-1574615377 tempest-VolumesSnapshotsTestJSON-1574615377-project] 10.222.0.13 "GET /compute/v2.1/os-snapshots/ba375cb3-a613-43ac-9c5e-627f1793aa79" status: 200 len: 286 microversion: 2.1 time: 0.178392 Nov 01 19:09:29.287879 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1812/3738] 10.222.0.13 () {58 vars in 1251 bytes} [Tue Nov 1 19:09:29 2022] GET /compute/v2.1/os-snapshots/ba375cb3-a613-43ac-9c5e-627f1793aa79 => generated 286 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:09:29.294603 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-57d773cb-645c-46d9-a07b-4b77136f5c3f tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:09:29.295390 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-57d773cb-645c-46d9-a07b-4b77136f5c3f tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] [instance: cc8a30dd-b655-48d8-b4e2-d4911cb15513] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:09:29.314785 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-57d773cb-645c-46d9-a07b-4b77136f5c3f tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:09:29.317627 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-57d773cb-645c-46d9-a07b-4b77136f5c3f tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:09:29.318007 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-c01c1c58-d411-4271-b837-a4680a6f8eb2 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] [instance: ac4160c6-ca16-455e-9613-0d425932af3b] Going to try to terminate instance {{(pid=121403) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 01 19:09:29.320377 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-57d773cb-645c-46d9-a07b-4b77136f5c3f tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:09:29.321363 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-57d773cb-645c-46d9-a07b-4b77136f5c3f tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:09:29.324389 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-57d773cb-645c-46d9-a07b-4b77136f5c3f tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:09:29.325484 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-57d773cb-645c-46d9-a07b-4b77136f5c3f tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:09:29.581906 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-c01c1c58-d411-4271-b837-a4680a6f8eb2 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] 10.222.0.13 "DELETE /compute/v2.1/servers/ac4160c6-ca16-455e-9613-0d425932af3b" status: 204 len: 0 microversion: 2.1 time: 0.380770 Nov 01 19:09:29.581906 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1927/3739] 10.222.0.13 () {58 vars in 1239 bytes} [Tue Nov 1 19:09:29 2022] DELETE /compute/v2.1/servers/ac4160c6-ca16-455e-9613-0d425932af3b => generated 0 bytes in 382 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 01 19:09:29.592670 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-3ce5a69d-a6c5-4229-a6c4-69b77ef2cde6 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:09:29.593464 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-3ce5a69d-a6c5-4229-a6c4-69b77ef2cde6 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] [instance: ac4160c6-ca16-455e-9613-0d425932af3b] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:09:29.603894 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-3ce5a69d-a6c5-4229-a6c4-69b77ef2cde6 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:09:29.606182 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-3ce5a69d-a6c5-4229-a6c4-69b77ef2cde6 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:09:29.606701 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-3ce5a69d-a6c5-4229-a6c4-69b77ef2cde6 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:09:29.609221 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-3ce5a69d-a6c5-4229-a6c4-69b77ef2cde6 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:09:29.609773 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-3ce5a69d-a6c5-4229-a6c4-69b77ef2cde6 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:09:29.610293 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-3ce5a69d-a6c5-4229-a6c4-69b77ef2cde6 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:09:29.762347 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-57d773cb-645c-46d9-a07b-4b77136f5c3f tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '058480d92c9b4ab4af6815d0438a65c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee9dc49b89143f781e4ab30296e4d01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:09:29.775311 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-57d773cb-645c-46d9-a07b-4b77136f5c3f tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] 10.222.0.13 "GET /compute/v2.1/servers/cc8a30dd-b655-48d8-b4e2-d4911cb15513" status: 200 len: 1512 microversion: 2.1 time: 0.485288 Nov 01 19:09:29.777460 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1813/3740] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:09:29 2022] GET /compute/v2.1/servers/cc8a30dd-b655-48d8-b4e2-d4911cb15513 => generated 1512 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:09:29.899359 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-ebf750b9-4a00-4288-bf66-4a2572905c19 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:09:29.900252 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-ebf750b9-4a00-4288-bf66-4a2572905c19 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] [instance: 43b22dd3-debb-4a6d-81fc-4666e5bb7804] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:09:29.910484 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-ebf750b9-4a00-4288-bf66-4a2572905c19 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:09:29.910990 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-ebf750b9-4a00-4288-bf66-4a2572905c19 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:09:29.911654 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-ebf750b9-4a00-4288-bf66-4a2572905c19 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:09:29.912522 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-ebf750b9-4a00-4288-bf66-4a2572905c19 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:09:29.913163 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-ebf750b9-4a00-4288-bf66-4a2572905c19 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:09:29.913592 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-ebf750b9-4a00-4288-bf66-4a2572905c19 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:09:29.977629 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-3ce5a69d-a6c5-4229-a6c4-69b77ef2cde6 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '790f3f1566b7464aaca19d4d05c0942e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33e3d319293c46b6af2f728a50586906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:09:29.994816 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-3ce5a69d-a6c5-4229-a6c4-69b77ef2cde6 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] 10.222.0.13 "GET /compute/v2.1/servers/ac4160c6-ca16-455e-9613-0d425932af3b" status: 200 len: 1682 microversion: 2.1 time: 0.403051 Nov 01 19:09:29.996250 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1928/3741] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:09:29 2022] GET /compute/v2.1/servers/ac4160c6-ca16-455e-9613-0d425932af3b => generated 1682 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 19:09:30.134851 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-ebf750b9-4a00-4288-bf66-4a2572905c19 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113bd8c844ee490b86a68bc7e1e75da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '851785a5f76548898a77d67792888504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:09:30.148243 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-ebf750b9-4a00-4288-bf66-4a2572905c19 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] 10.222.0.13 "GET /compute/v2.1/servers/43b22dd3-debb-4a6d-81fc-4666e5bb7804" status: 200 len: 1511 microversion: 2.1 time: 0.256976 Nov 01 19:09:30.167138 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1814/3742] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:09:29 2022] GET /compute/v2.1/servers/43b22dd3-debb-4a6d-81fc-4666e5bb7804 => generated 1511 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 19:09:30.299357 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-22f5d818-c3de-43ef-acb3-5da3c68790eb tempest-VolumesSnapshotsTestJSON-1574615377 tempest-VolumesSnapshotsTestJSON-1574615377-project] Calling method '.version_select at 0x7f0ae2817670>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:09:30.327311 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.wsgi [None req-22f5d818-c3de-43ef-acb3-5da3c68790eb tempest-VolumesSnapshotsTestJSON-1574615377 tempest-VolumesSnapshotsTestJSON-1574615377-project] HTTP exception thrown: Snapshot ba375cb3-a613-43ac-9c5e-627f1793aa79 could not be found. Nov 01 19:09:30.350017 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-22f5d818-c3de-43ef-acb3-5da3c68790eb tempest-VolumesSnapshotsTestJSON-1574615377 tempest-VolumesSnapshotsTestJSON-1574615377-project] Request method failure captured: Nov 01 19:09:30.350017 n-d-863052-2 devstack@n-api.service[121403]: request: GET /compute/v2.1/os-snapshots/ba375cb3-a613-43ac-9c5e-627f1793aa79 HTTP/1.1 Nov 01 19:09:30.350017 n-d-863052-2 devstack@n-api.service[121403]: Accept: application/json Nov 01 19:09:30.350017 n-d-863052-2 devstack@n-api.service[121403]: Accept-Encoding: identity Nov 01 19:09:30.350017 n-d-863052-2 devstack@n-api.service[121403]: Connection: close Nov 01 19:09:30.350017 n-d-863052-2 devstack@n-api.service[121403]: Content-Length: 0 Nov 01 19:09:30.350017 n-d-863052-2 devstack@n-api.service[121403]: Content-Type: application/json Nov 01 19:09:30.350017 n-d-863052-2 devstack@n-api.service[121403]: Host: 10.222.0.13 Nov 01 19:09:30.350017 n-d-863052-2 devstack@n-api.service[121403]: Openstack-System-Scope: None Nov 01 19:09:30.350017 n-d-863052-2 devstack@n-api.service[121403]: User-Agent: python-urllib3/1.26.12 Nov 01 19:09:30.350017 n-d-863052-2 devstack@n-api.service[121403]: X-Auth-Token: gAAAAABjYW7iE7QeI4B_ZOTb-etclVWf97RlUW4KBoPW1IM-vcR445q9dg6epFMMDI-XiFsxL7lxaooeGe9RGaWKJx6QkMxql_zQxbWyt56MTfBHoIEa8EAwll8t97QFS-Sw82vlJXjukUhQKchquvuGn-4GHigoKwNa7YxaZy2bpatQrNTVRhA Nov 01 19:09:30.350017 n-d-863052-2 devstack@n-api.service[121403]: X-Domain-Id: None Nov 01 19:09:30.350017 n-d-863052-2 devstack@n-api.service[121403]: X-Domain-Name: None Nov 01 19:09:30.350017 n-d-863052-2 devstack@n-api.service[121403]: X-Identity-Status: Confirmed Nov 01 19:09:30.350017 n-d-863052-2 devstack@n-api.service[121403]: X-Is-Admin-Project: True Nov 01 19:09:30.350017 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Domain-Id: default Nov 01 19:09:30.350017 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Domain-Name: Default Nov 01 19:09:30.350017 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Id: bbfa1aa719a34301a0ade36760607fd5 Nov 01 19:09:30.350017 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1574615377 Nov 01 19:09:30.350017 n-d-863052-2 devstack@n-api.service[121403]: X-Role: member,reader Nov 01 19:09:30.350017 n-d-863052-2 devstack@n-api.service[121403]: X-Roles: member,reader Nov 01 19:09:30.350017 n-d-863052-2 devstack@n-api.service[121403]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/bbfa1aa719a34301a0ade36760607fd5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/bbfa1aa719a34301a0ade36760607fd5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_bbfa1aa719a34301a0ade36760607fd5", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/bbfa1aa719a34301a0ade36760607fd5"}]}] Nov 01 19:09:30.350017 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1574615377 Nov 01 19:09:30.350017 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant-Id: bbfa1aa719a34301a0ade36760607fd5 Nov 01 19:09:30.350017 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1574615377 Nov 01 19:09:30.350017 n-d-863052-2 devstack@n-api.service[121403]: X-User: tempest-VolumesSnapshotsTestJSON-1574615377-project Nov 01 19:09:30.350017 n-d-863052-2 devstack@n-api.service[121403]: X-User-Domain-Id: default Nov 01 19:09:30.350017 n-d-863052-2 devstack@n-api.service[121403]: X-User-Domain-Name: Default Nov 01 19:09:30.350017 n-d-863052-2 devstack@n-api.service[121403]: X-User-Id: 1c00fa1a3d534b1fad963be11ce6923f Nov 01 19:09:30.350017 n-d-863052-2 devstack@n-api.service[121403]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1574615377-project Nov 01 19:09:30.350017 n-d-863052-2 devstack@n-api.service[121403]: method: Nov 01 19:09:30.350017 n-d-863052-2 devstack@n-api.service[121403]: exception: Snapshot ba375cb3-a613-43ac-9c5e-627f1793aa79 could not be found. Nov 01 19:09:30.350017 n-d-863052-2 devstack@n-api.service[121403]: action_args: {'id': 'ba375cb3-a613-43ac-9c5e-627f1793aa79'} Nov 01 19:09:30.350017 n-d-863052-2 devstack@n-api.service[121403]: {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 01 19:09:30.350017 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:09:30.350017 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Nov 01 19:09:30.350017 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Nov 01 19:09:30.350017 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Nov 01 19:09:30.350017 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Nov 01 19:09:30.350017 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Nov 01 19:09:30.350017 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Nov 01 19:09:30.350017 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Nov 01 19:09:30.350017 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Nov 01 19:09:30.350017 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Nov 01 19:09:30.350017 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Nov 01 19:09:30.350017 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Nov 01 19:09:30.350017 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Nov 01 19:09:30.350017 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Nov 01 19:09:30.350017 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Nov 01 19:09:30.350017 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot ba375cb3-a613-43ac-9c5e-627f1793aa79 could not be found. (HTTP 404) (Request-ID: req-83689831-2b78-4a2e-8891-c1e8f8acd18c) Nov 01 19:09:30.350017 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:09:30.350017 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:09:30.350017 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:09:30.350017 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:09:30.350017 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Nov 01 19:09:30.350017 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Nov 01 19:09:30.350017 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Nov 01 19:09:30.350017 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Nov 01 19:09:30.350017 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Nov 01 19:09:30.350017 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Nov 01 19:09:30.350017 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Nov 01 19:09:30.350017 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Nov 01 19:09:30.354624 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Nov 01 19:09:30.354624 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Nov 01 19:09:30.354624 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Nov 01 19:09:30.354624 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Nov 01 19:09:30.354624 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Nov 01 19:09:30.354624 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Nov 01 19:09:30.354624 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Nov 01 19:09:30.354624 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Nov 01 19:09:30.354624 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Nov 01 19:09:30.354624 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Nov 01 19:09:30.354624 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Nov 01 19:09:30.354624 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Nov 01 19:09:30.354624 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Nov 01 19:09:30.354624 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Nov 01 19:09:30.354624 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot ba375cb3-a613-43ac-9c5e-627f1793aa79 could not be found. Nov 01 19:09:30.354624 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:09:30.354624 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:09:30.354624 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:09:30.354624 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:09:30.354624 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:09:30.354624 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:09:30.354624 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 01 19:09:30.354624 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 01 19:09:30.354624 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 01 19:09:30.354624 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 01 19:09:30.354624 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 01 19:09:30.354624 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 01 19:09:30.354624 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Nov 01 19:09:30.354624 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 01 19:09:30.354624 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot ba375cb3-a613-43ac-9c5e-627f1793aa79 could not be found. Nov 01 19:09:30.354624 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:09:30.354624 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:09:30.354624 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:09:30.354624 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:09:30.354624 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:09:30.354624 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:09:30.354624 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 01 19:09:30.354624 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 01 19:09:30.354624 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot ba375cb3-a613-43ac-9c5e-627f1793aa79 could not be found. Nov 01 19:09:30.354624 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:09:30.354624 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-22f5d818-c3de-43ef-acb3-5da3c68790eb tempest-VolumesSnapshotsTestJSON-1574615377 tempest-VolumesSnapshotsTestJSON-1574615377-project] Returning 404 to user: Snapshot ba375cb3-a613-43ac-9c5e-627f1793aa79 could not be found. {{(pid=121403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 01 19:09:30.354624 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-22f5d818-c3de-43ef-acb3-5da3c68790eb tempest-VolumesSnapshotsTestJSON-1574615377 tempest-VolumesSnapshotsTestJSON-1574615377-project] 10.222.0.13 "GET /compute/v2.1/os-snapshots/ba375cb3-a613-43ac-9c5e-627f1793aa79" status: 404 len: 111 microversion: 2.1 time: 0.056119 Nov 01 19:09:30.354624 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1929/3743] 10.222.0.13 () {58 vars in 1251 bytes} [Tue Nov 1 19:09:30 2022] GET /compute/v2.1/os-snapshots/ba375cb3-a613-43ac-9c5e-627f1793aa79 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 01 19:09:30.360610 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-6291a771-db76-451e-aebe-429be296dffe tempest-VolumesSnapshotsTestJSON-1574615377 tempest-VolumesSnapshotsTestJSON-1574615377-project] Calling method '.version_select at 0x7f0ae17c1040>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:09:30.426629 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-6291a771-db76-451e-aebe-429be296dffe tempest-VolumesSnapshotsTestJSON-1574615377 tempest-VolumesSnapshotsTestJSON-1574615377-project] 10.222.0.13 "DELETE /compute/v2.1/os-volumes/5a7b5481-a33f-47af-ad0a-30868a452555" status: 202 len: 0 microversion: 2.1 time: 0.069703 Nov 01 19:09:30.428471 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1815/3744] 10.222.0.13 () {58 vars in 1248 bytes} [Tue Nov 1 19:09:30 2022] DELETE /compute/v2.1/os-volumes/5a7b5481-a33f-47af-ad0a-30868a452555 => generated 0 bytes in 72 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 01 19:09:30.438360 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-12ad81f7-c874-4673-904f-34b1f35a7a0e tempest-VolumesSnapshotsTestJSON-1574615377 tempest-VolumesSnapshotsTestJSON-1574615377-project] Calling method '.version_select at 0x7f0ae1d2e8b0>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:09:30.524530 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-12ad81f7-c874-4673-904f-34b1f35a7a0e tempest-VolumesSnapshotsTestJSON-1574615377 tempest-VolumesSnapshotsTestJSON-1574615377-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/5a7b5481-a33f-47af-ad0a-30868a452555" status: 200 len: 345 microversion: 2.1 time: 0.091598 Nov 01 19:09:30.525290 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1930/3745] 10.222.0.13 () {58 vars in 1245 bytes} [Tue Nov 1 19:09:30 2022] GET /compute/v2.1/os-volumes/5a7b5481-a33f-47af-ad0a-30868a452555 => generated 345 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:09:30.681467 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [req-68ce327a-5e1f-44c7-a8c5-298c9cf40daa req-3912f7ee-ea18-46b1-a5b4-f45c3710d1e2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "03d4513b-9e04-4924-8654-1de3748e333e", "tag": "1006d010-6ff0-43d5-af55-b5743e6e84b1"}]} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:09:30.694270 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-68ce327a-5e1f-44c7-a8c5-298c9cf40daa req-3912f7ee-ea18-46b1-a5b4-f45c3710d1e2 service nova] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:09:30.695018 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-68ce327a-5e1f-44c7-a8c5-298c9cf40daa req-3912f7ee-ea18-46b1-a5b4-f45c3710d1e2 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:09:30.695615 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-68ce327a-5e1f-44c7-a8c5-298c9cf40daa req-3912f7ee-ea18-46b1-a5b4-f45c3710d1e2 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:09:30.707174 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.compute.server_external_events [req-68ce327a-5e1f-44c7-a8c5-298c9cf40daa req-3912f7ee-ea18-46b1-a5b4-f45c3710d1e2 service nova] Creating event network-changed:1006d010-6ff0-43d5-af55-b5743e6e84b1 for instance 03d4513b-9e04-4924-8654-1de3748e333e on n-h1-863052-2 Nov 01 19:09:30.713659 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [req-68ce327a-5e1f-44c7-a8c5-298c9cf40daa req-3912f7ee-ea18-46b1-a5b4-f45c3710d1e2 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037027 Nov 01 19:09:30.714973 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1816/3746] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Nov 1 19:09:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:09:30.804755 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-e688d2ea-b18e-4745-8b37-3c4a262492ae tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:09:30.805363 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-e688d2ea-b18e-4745-8b37-3c4a262492ae tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] [instance: cc8a30dd-b655-48d8-b4e2-d4911cb15513] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:09:30.822015 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-e688d2ea-b18e-4745-8b37-3c4a262492ae tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:09:30.822556 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-e688d2ea-b18e-4745-8b37-3c4a262492ae tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:09:30.823074 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-e688d2ea-b18e-4745-8b37-3c4a262492ae tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:09:30.823818 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-e688d2ea-b18e-4745-8b37-3c4a262492ae tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:09:30.824278 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-e688d2ea-b18e-4745-8b37-3c4a262492ae tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:09:30.826866 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-e688d2ea-b18e-4745-8b37-3c4a262492ae tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:09:31.023850 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-21d386cf-ff6d-4962-bf10-aa0d37e97eba tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:09:31.025302 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-21d386cf-ff6d-4962-bf10-aa0d37e97eba tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] [instance: ac4160c6-ca16-455e-9613-0d425932af3b] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:09:31.040260 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-21d386cf-ff6d-4962-bf10-aa0d37e97eba tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:09:31.041359 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-21d386cf-ff6d-4962-bf10-aa0d37e97eba tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:09:31.042404 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-21d386cf-ff6d-4962-bf10-aa0d37e97eba tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:09:31.043230 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-21d386cf-ff6d-4962-bf10-aa0d37e97eba tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:09:31.043581 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-21d386cf-ff6d-4962-bf10-aa0d37e97eba tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:09:31.044013 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-21d386cf-ff6d-4962-bf10-aa0d37e97eba tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:09:31.418859 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-21d386cf-ff6d-4962-bf10-aa0d37e97eba tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '790f3f1566b7464aaca19d4d05c0942e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33e3d319293c46b6af2f728a50586906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:09:31.427002 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-21d386cf-ff6d-4962-bf10-aa0d37e97eba tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] 10.222.0.13 "GET /compute/v2.1/servers/ac4160c6-ca16-455e-9613-0d425932af3b" status: 200 len: 1682 microversion: 2.1 time: 0.409332 Nov 01 19:09:31.427592 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1817/3747] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:09:31 2022] GET /compute/v2.1/servers/ac4160c6-ca16-455e-9613-0d425932af3b => generated 1682 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:09:31.445850 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-e6fe6a86-4e2d-47a2-900e-19d2ed587e3c tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:09:31.446462 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-e6fe6a86-4e2d-47a2-900e-19d2ed587e3c tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] [instance: 43b22dd3-debb-4a6d-81fc-4666e5bb7804] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:09:31.454317 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e6fe6a86-4e2d-47a2-900e-19d2ed587e3c tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:09:31.454819 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e6fe6a86-4e2d-47a2-900e-19d2ed587e3c tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:09:31.455261 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e6fe6a86-4e2d-47a2-900e-19d2ed587e3c tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:09:31.455975 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e6fe6a86-4e2d-47a2-900e-19d2ed587e3c tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:09:31.456429 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e6fe6a86-4e2d-47a2-900e-19d2ed587e3c tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:09:31.456880 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e6fe6a86-4e2d-47a2-900e-19d2ed587e3c tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:09:31.580083 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-e688d2ea-b18e-4745-8b37-3c4a262492ae tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '058480d92c9b4ab4af6815d0438a65c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee9dc49b89143f781e4ab30296e4d01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:09:31.594672 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-e688d2ea-b18e-4745-8b37-3c4a262492ae tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] 10.222.0.13 "GET /compute/v2.1/servers/cc8a30dd-b655-48d8-b4e2-d4911cb15513" status: 200 len: 1512 microversion: 2.1 time: 0.796160 Nov 01 19:09:31.599700 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1931/3748] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:09:30 2022] GET /compute/v2.1/servers/cc8a30dd-b655-48d8-b4e2-d4911cb15513 => generated 1512 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:09:31.609001 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-1ced776f-73d7-428f-b7fa-10f8a4ae8b5f tempest-VolumesSnapshotsTestJSON-1574615377 tempest-VolumesSnapshotsTestJSON-1574615377-project] Calling method '.version_select at 0x7f0ae1cf6ca0>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:09:31.710666 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-1ced776f-73d7-428f-b7fa-10f8a4ae8b5f tempest-VolumesSnapshotsTestJSON-1574615377 tempest-VolumesSnapshotsTestJSON-1574615377-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/5a7b5481-a33f-47af-ad0a-30868a452555" status: 200 len: 345 microversion: 2.1 time: 0.109499 Nov 01 19:09:31.711547 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1932/3749] 10.222.0.13 () {58 vars in 1245 bytes} [Tue Nov 1 19:09:31 2022] GET /compute/v2.1/os-volumes/5a7b5481-a33f-47af-ad0a-30868a452555 => generated 345 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:09:31.818941 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-e6fe6a86-4e2d-47a2-900e-19d2ed587e3c tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113bd8c844ee490b86a68bc7e1e75da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '851785a5f76548898a77d67792888504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:09:31.837425 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-e6fe6a86-4e2d-47a2-900e-19d2ed587e3c tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] 10.222.0.13 "GET /compute/v2.1/servers/43b22dd3-debb-4a6d-81fc-4666e5bb7804" status: 200 len: 1511 microversion: 2.1 time: 0.405896 Nov 01 19:09:31.852614 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1818/3750] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:09:31 2022] GET /compute/v2.1/servers/43b22dd3-debb-4a6d-81fc-4666e5bb7804 => generated 1511 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:09:32.452225 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-26655995-ba6c-4f23-afa8-97fd3d22c3a2 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:09:32.453048 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-26655995-ba6c-4f23-afa8-97fd3d22c3a2 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] [instance: ac4160c6-ca16-455e-9613-0d425932af3b] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:09:32.470202 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-26655995-ba6c-4f23-afa8-97fd3d22c3a2 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:09:32.470912 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-26655995-ba6c-4f23-afa8-97fd3d22c3a2 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:09:32.472477 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-26655995-ba6c-4f23-afa8-97fd3d22c3a2 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:09:32.474870 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-26655995-ba6c-4f23-afa8-97fd3d22c3a2 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:09:32.479227 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-26655995-ba6c-4f23-afa8-97fd3d22c3a2 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:09:32.480646 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-26655995-ba6c-4f23-afa8-97fd3d22c3a2 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:09:32.619906 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-26655995-ba6c-4f23-afa8-97fd3d22c3a2 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '790f3f1566b7464aaca19d4d05c0942e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33e3d319293c46b6af2f728a50586906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:09:32.627176 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-28811f1e-6827-4bbc-84fd-039f6793001b tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:09:32.627805 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-28811f1e-6827-4bbc-84fd-039f6793001b tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] [instance: cc8a30dd-b655-48d8-b4e2-d4911cb15513] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:09:32.630772 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-26655995-ba6c-4f23-afa8-97fd3d22c3a2 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] 10.222.0.13 "GET /compute/v2.1/servers/ac4160c6-ca16-455e-9613-0d425932af3b" status: 200 len: 1614 microversion: 2.1 time: 0.183062 Nov 01 19:09:32.631361 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1933/3751] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:09:32 2022] GET /compute/v2.1/servers/ac4160c6-ca16-455e-9613-0d425932af3b => generated 1614 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:09:32.652124 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-28811f1e-6827-4bbc-84fd-039f6793001b tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:09:32.653618 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-28811f1e-6827-4bbc-84fd-039f6793001b tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:09:32.654314 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-28811f1e-6827-4bbc-84fd-039f6793001b tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:09:32.655664 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-28811f1e-6827-4bbc-84fd-039f6793001b tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:09:32.656878 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-28811f1e-6827-4bbc-84fd-039f6793001b tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:09:32.658146 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-28811f1e-6827-4bbc-84fd-039f6793001b tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:09:32.725288 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-e3711bb9-397d-495a-9355-a7ba753627e3 tempest-VolumesSnapshotsTestJSON-1574615377 tempest-VolumesSnapshotsTestJSON-1574615377-project] Calling method '.version_select at 0x7f0ae1cf65e0>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:09:32.856426 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-e3711bb9-397d-495a-9355-a7ba753627e3 tempest-VolumesSnapshotsTestJSON-1574615377 tempest-VolumesSnapshotsTestJSON-1574615377-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/5a7b5481-a33f-47af-ad0a-30868a452555" status: 200 len: 345 microversion: 2.1 time: 0.135485 Nov 01 19:09:32.857612 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1934/3752] 10.222.0.13 () {58 vars in 1245 bytes} [Tue Nov 1 19:09:32 2022] GET /compute/v2.1/os-volumes/5a7b5481-a33f-47af-ad0a-30868a452555 => generated 345 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 01 19:09:32.872696 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [req-598af50e-79b6-496a-9805-3bd27604b05a req-64577477-e392-4875-acaf-bdbade52a4ec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac4160c6-ca16-455e-9613-0d425932af3b", "name": "network-vif-deleted", "tag": "bf1271b3-df00-4974-8247-8425a2ebf2ee"}]} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:09:32.904334 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-598af50e-79b6-496a-9805-3bd27604b05a req-64577477-e392-4875-acaf-bdbade52a4ec service nova] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:09:32.906251 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-598af50e-79b6-496a-9805-3bd27604b05a req-64577477-e392-4875-acaf-bdbade52a4ec service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:09:32.908359 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-598af50e-79b6-496a-9805-3bd27604b05a req-64577477-e392-4875-acaf-bdbade52a4ec service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:09:32.949950 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-28811f1e-6827-4bbc-84fd-039f6793001b tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '058480d92c9b4ab4af6815d0438a65c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee9dc49b89143f781e4ab30296e4d01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:09:32.951685 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.compute.server_external_events [req-598af50e-79b6-496a-9805-3bd27604b05a req-64577477-e392-4875-acaf-bdbade52a4ec service nova] Creating event network-vif-deleted:bf1271b3-df00-4974-8247-8425a2ebf2ee for instance ac4160c6-ca16-455e-9613-0d425932af3b on n-h1-863052-2 Nov 01 19:09:32.964845 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-28811f1e-6827-4bbc-84fd-039f6793001b tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] 10.222.0.13 "GET /compute/v2.1/servers/cc8a30dd-b655-48d8-b4e2-d4911cb15513" status: 200 len: 1512 microversion: 2.1 time: 0.340994 Nov 01 19:09:32.965158 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [req-598af50e-79b6-496a-9805-3bd27604b05a req-64577477-e392-4875-acaf-bdbade52a4ec service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094920 Nov 01 19:09:32.968828 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1819/3754] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:09:32 2022] GET /compute/v2.1/servers/cc8a30dd-b655-48d8-b4e2-d4911cb15513 => generated 1512 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:09:32.969061 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1935/3754] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Nov 1 19:09:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:09:32.977214 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-c3e66b6b-0306-4604-8705-e7eb09859c32 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:09:32.978112 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-c3e66b6b-0306-4604-8705-e7eb09859c32 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] [instance: 43b22dd3-debb-4a6d-81fc-4666e5bb7804] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:09:32.985774 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-c3e66b6b-0306-4604-8705-e7eb09859c32 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:09:32.986488 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-c3e66b6b-0306-4604-8705-e7eb09859c32 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:09:32.987096 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-c3e66b6b-0306-4604-8705-e7eb09859c32 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:09:32.988009 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-c3e66b6b-0306-4604-8705-e7eb09859c32 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:09:32.988699 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-c3e66b6b-0306-4604-8705-e7eb09859c32 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:09:32.989586 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-c3e66b6b-0306-4604-8705-e7eb09859c32 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:09:33.301413 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-c3e66b6b-0306-4604-8705-e7eb09859c32 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113bd8c844ee490b86a68bc7e1e75da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '851785a5f76548898a77d67792888504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:09:33.312374 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-c3e66b6b-0306-4604-8705-e7eb09859c32 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] 10.222.0.13 "GET /compute/v2.1/servers/43b22dd3-debb-4a6d-81fc-4666e5bb7804" status: 200 len: 1511 microversion: 2.1 time: 0.341301 Nov 01 19:09:33.312985 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1820/3755] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:09:32 2022] GET /compute/v2.1/servers/43b22dd3-debb-4a6d-81fc-4666e5bb7804 => generated 1511 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:09:33.662756 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-98690570-1479-4949-a945-93ac8684305e tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:09:33.664306 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-98690570-1479-4949-a945-93ac8684305e tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] [instance: ac4160c6-ca16-455e-9613-0d425932af3b] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:09:33.673174 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-98690570-1479-4949-a945-93ac8684305e tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:09:33.674000 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-98690570-1479-4949-a945-93ac8684305e tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:09:33.674882 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-98690570-1479-4949-a945-93ac8684305e tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:09:33.675812 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-98690570-1479-4949-a945-93ac8684305e tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:09:33.676542 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-98690570-1479-4949-a945-93ac8684305e tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:09:33.677915 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-98690570-1479-4949-a945-93ac8684305e tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:09:33.727790 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-98690570-1479-4949-a945-93ac8684305e tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:09:33.729075 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-98690570-1479-4949-a945-93ac8684305e tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:09:33.729946 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-98690570-1479-4949-a945-93ac8684305e tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:09:33.730572 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.objects.instance [None req-98690570-1479-4949-a945-93ac8684305e tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lazy-loading 'fault' on Instance uuid ac4160c6-ca16-455e-9613-0d425932af3b {{(pid=121403) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 01 19:09:33.823999 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-98690570-1479-4949-a945-93ac8684305e tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '790f3f1566b7464aaca19d4d05c0942e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33e3d319293c46b6af2f728a50586906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:09:33.836634 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-98690570-1479-4949-a945-93ac8684305e tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] 10.222.0.13 "GET /compute/v2.1/servers/ac4160c6-ca16-455e-9613-0d425932af3b" status: 200 len: 1331 microversion: 2.1 time: 0.183120 Nov 01 19:09:33.838500 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1936/3756] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:09:33 2022] GET /compute/v2.1/servers/ac4160c6-ca16-455e-9613-0d425932af3b => generated 1331 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:09:33.872639 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-1aad162b-dd13-4ee3-9ec3-f09a39f9b1bd tempest-VolumesSnapshotsTestJSON-1574615377 tempest-VolumesSnapshotsTestJSON-1574615377-project] Calling method '.version_select at 0x7f0ae1776430>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:09:33.922725 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.wsgi [None req-1aad162b-dd13-4ee3-9ec3-f09a39f9b1bd tempest-VolumesSnapshotsTestJSON-1574615377 tempest-VolumesSnapshotsTestJSON-1574615377-project] HTTP exception thrown: Volume 5a7b5481-a33f-47af-ad0a-30868a452555 could not be found. Nov 01 19:09:33.928090 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-1aad162b-dd13-4ee3-9ec3-f09a39f9b1bd tempest-VolumesSnapshotsTestJSON-1574615377 tempest-VolumesSnapshotsTestJSON-1574615377-project] Request method failure captured: Nov 01 19:09:33.928090 n-d-863052-2 devstack@n-api.service[121402]: request: GET /compute/v2.1/os-volumes/5a7b5481-a33f-47af-ad0a-30868a452555 HTTP/1.1 Nov 01 19:09:33.928090 n-d-863052-2 devstack@n-api.service[121402]: Accept: application/json Nov 01 19:09:33.928090 n-d-863052-2 devstack@n-api.service[121402]: Accept-Encoding: identity Nov 01 19:09:33.928090 n-d-863052-2 devstack@n-api.service[121402]: Connection: close Nov 01 19:09:33.928090 n-d-863052-2 devstack@n-api.service[121402]: Content-Length: 0 Nov 01 19:09:33.928090 n-d-863052-2 devstack@n-api.service[121402]: Content-Type: application/json Nov 01 19:09:33.928090 n-d-863052-2 devstack@n-api.service[121402]: Host: 10.222.0.13 Nov 01 19:09:33.928090 n-d-863052-2 devstack@n-api.service[121402]: Openstack-System-Scope: None Nov 01 19:09:33.928090 n-d-863052-2 devstack@n-api.service[121402]: User-Agent: python-urllib3/1.26.12 Nov 01 19:09:33.928090 n-d-863052-2 devstack@n-api.service[121402]: X-Auth-Token: gAAAAABjYW7iE7QeI4B_ZOTb-etclVWf97RlUW4KBoPW1IM-vcR445q9dg6epFMMDI-XiFsxL7lxaooeGe9RGaWKJx6QkMxql_zQxbWyt56MTfBHoIEa8EAwll8t97QFS-Sw82vlJXjukUhQKchquvuGn-4GHigoKwNa7YxaZy2bpatQrNTVRhA Nov 01 19:09:33.928090 n-d-863052-2 devstack@n-api.service[121402]: X-Domain-Id: None Nov 01 19:09:33.928090 n-d-863052-2 devstack@n-api.service[121402]: X-Domain-Name: None Nov 01 19:09:33.928090 n-d-863052-2 devstack@n-api.service[121402]: X-Identity-Status: Confirmed Nov 01 19:09:33.928090 n-d-863052-2 devstack@n-api.service[121402]: X-Is-Admin-Project: True Nov 01 19:09:33.928090 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Domain-Id: default Nov 01 19:09:33.928090 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Domain-Name: Default Nov 01 19:09:33.928090 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Id: bbfa1aa719a34301a0ade36760607fd5 Nov 01 19:09:33.928090 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1574615377 Nov 01 19:09:33.928090 n-d-863052-2 devstack@n-api.service[121402]: X-Role: member,reader Nov 01 19:09:33.928090 n-d-863052-2 devstack@n-api.service[121402]: X-Roles: member,reader Nov 01 19:09:33.928090 n-d-863052-2 devstack@n-api.service[121402]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/bbfa1aa719a34301a0ade36760607fd5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/bbfa1aa719a34301a0ade36760607fd5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_bbfa1aa719a34301a0ade36760607fd5", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/bbfa1aa719a34301a0ade36760607fd5"}]}] Nov 01 19:09:33.928090 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1574615377 Nov 01 19:09:33.928090 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant-Id: bbfa1aa719a34301a0ade36760607fd5 Nov 01 19:09:33.928090 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1574615377 Nov 01 19:09:33.928090 n-d-863052-2 devstack@n-api.service[121402]: X-User: tempest-VolumesSnapshotsTestJSON-1574615377-project Nov 01 19:09:33.928090 n-d-863052-2 devstack@n-api.service[121402]: X-User-Domain-Id: default Nov 01 19:09:33.928090 n-d-863052-2 devstack@n-api.service[121402]: X-User-Domain-Name: Default Nov 01 19:09:33.928090 n-d-863052-2 devstack@n-api.service[121402]: X-User-Id: 1c00fa1a3d534b1fad963be11ce6923f Nov 01 19:09:33.928090 n-d-863052-2 devstack@n-api.service[121402]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1574615377-project Nov 01 19:09:33.928090 n-d-863052-2 devstack@n-api.service[121402]: method: Nov 01 19:09:33.928090 n-d-863052-2 devstack@n-api.service[121402]: exception: Volume 5a7b5481-a33f-47af-ad0a-30868a452555 could not be found. Nov 01 19:09:33.928090 n-d-863052-2 devstack@n-api.service[121402]: action_args: {'id': '5a7b5481-a33f-47af-ad0a-30868a452555'} Nov 01 19:09:33.928090 n-d-863052-2 devstack@n-api.service[121402]: {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 01 19:09:33.928090 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:09:33.928090 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Nov 01 19:09:33.928090 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Nov 01 19:09:33.928090 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Nov 01 19:09:33.928090 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi item = cinderclient( Nov 01 19:09:33.928090 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Nov 01 19:09:33.928090 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Nov 01 19:09:33.928090 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Nov 01 19:09:33.928090 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Nov 01 19:09:33.928090 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Nov 01 19:09:33.928090 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Nov 01 19:09:33.928090 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Nov 01 19:09:33.928090 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Nov 01 19:09:33.928090 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Nov 01 19:09:33.928090 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Nov 01 19:09:33.928090 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 5a7b5481-a33f-47af-ad0a-30868a452555 could not be found. (HTTP 404) (Request-ID: req-5c8eaa8d-d78e-4e7b-85bb-2e2dc8e4923e) Nov 01 19:09:33.928090 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:09:33.928090 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:09:33.928090 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:09:33.928090 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:09:33.928090 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Nov 01 19:09:33.928090 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Nov 01 19:09:33.928090 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Nov 01 19:09:33.928090 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Nov 01 19:09:33.928090 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Nov 01 19:09:33.928090 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Nov 01 19:09:33.928090 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Nov 01 19:09:33.928090 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Nov 01 19:09:33.928090 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Nov 01 19:09:33.933446 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Nov 01 19:09:33.933446 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Nov 01 19:09:33.933446 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi item = cinderclient( Nov 01 19:09:33.933446 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Nov 01 19:09:33.933446 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Nov 01 19:09:33.933446 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Nov 01 19:09:33.933446 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Nov 01 19:09:33.933446 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Nov 01 19:09:33.933446 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Nov 01 19:09:33.933446 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Nov 01 19:09:33.933446 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Nov 01 19:09:33.933446 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Nov 01 19:09:33.933446 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Nov 01 19:09:33.933446 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 5a7b5481-a33f-47af-ad0a-30868a452555 could not be found. Nov 01 19:09:33.933446 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:09:33.933446 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:09:33.933446 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:09:33.933446 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:09:33.933446 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:09:33.933446 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:09:33.933446 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 01 19:09:33.933446 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 01 19:09:33.933446 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 01 19:09:33.933446 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 01 19:09:33.933446 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 01 19:09:33.933446 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 01 19:09:33.933446 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Nov 01 19:09:33.933446 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 01 19:09:33.933446 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 5a7b5481-a33f-47af-ad0a-30868a452555 could not be found. Nov 01 19:09:33.933446 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:09:33.933446 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:09:33.933446 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:09:33.933446 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:09:33.933446 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:09:33.933446 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:09:33.933446 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 01 19:09:33.933446 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 01 19:09:33.933446 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 5a7b5481-a33f-47af-ad0a-30868a452555 could not be found. Nov 01 19:09:33.933446 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:09:33.933446 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-1aad162b-dd13-4ee3-9ec3-f09a39f9b1bd tempest-VolumesSnapshotsTestJSON-1574615377 tempest-VolumesSnapshotsTestJSON-1574615377-project] Returning 404 to user: Volume 5a7b5481-a33f-47af-ad0a-30868a452555 could not be found. {{(pid=121402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 01 19:09:33.933446 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-1aad162b-dd13-4ee3-9ec3-f09a39f9b1bd tempest-VolumesSnapshotsTestJSON-1574615377 tempest-VolumesSnapshotsTestJSON-1574615377-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/5a7b5481-a33f-47af-ad0a-30868a452555" status: 404 len: 109 microversion: 2.1 time: 0.062026 Nov 01 19:09:33.941619 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-cce5b893-188f-4f62-9ea6-ee0f98c0a789 tempest-VolumesSnapshotsTestJSON-1574615377 tempest-VolumesSnapshotsTestJSON-1574615377-project] Calling method '.version_select at 0x7f0ae1cf6790>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:09:33.949386 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1821/3757] 10.222.0.13 () {58 vars in 1245 bytes} [Tue Nov 1 19:09:33 2022] GET /compute/v2.1/os-volumes/5a7b5481-a33f-47af-ad0a-30868a452555 => generated 109 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 01 19:09:33.977208 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.wsgi [None req-cce5b893-188f-4f62-9ea6-ee0f98c0a789 tempest-VolumesSnapshotsTestJSON-1574615377 tempest-VolumesSnapshotsTestJSON-1574615377-project] HTTP exception thrown: Volume 5a7b5481-a33f-47af-ad0a-30868a452555 could not be found. Nov 01 19:09:33.979590 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-cce5b893-188f-4f62-9ea6-ee0f98c0a789 tempest-VolumesSnapshotsTestJSON-1574615377 tempest-VolumesSnapshotsTestJSON-1574615377-project] Request method failure captured: Nov 01 19:09:33.979590 n-d-863052-2 devstack@n-api.service[121403]: request: DELETE /compute/v2.1/os-volumes/5a7b5481-a33f-47af-ad0a-30868a452555 HTTP/1.1 Nov 01 19:09:33.979590 n-d-863052-2 devstack@n-api.service[121403]: Accept: application/json Nov 01 19:09:33.979590 n-d-863052-2 devstack@n-api.service[121403]: Accept-Encoding: identity Nov 01 19:09:33.979590 n-d-863052-2 devstack@n-api.service[121403]: Connection: close Nov 01 19:09:33.979590 n-d-863052-2 devstack@n-api.service[121403]: Content-Length: 0 Nov 01 19:09:33.979590 n-d-863052-2 devstack@n-api.service[121403]: Content-Type: application/json Nov 01 19:09:33.979590 n-d-863052-2 devstack@n-api.service[121403]: Host: 10.222.0.13 Nov 01 19:09:33.979590 n-d-863052-2 devstack@n-api.service[121403]: Openstack-System-Scope: None Nov 01 19:09:33.979590 n-d-863052-2 devstack@n-api.service[121403]: User-Agent: python-urllib3/1.26.12 Nov 01 19:09:33.979590 n-d-863052-2 devstack@n-api.service[121403]: X-Auth-Token: gAAAAABjYW7iE7QeI4B_ZOTb-etclVWf97RlUW4KBoPW1IM-vcR445q9dg6epFMMDI-XiFsxL7lxaooeGe9RGaWKJx6QkMxql_zQxbWyt56MTfBHoIEa8EAwll8t97QFS-Sw82vlJXjukUhQKchquvuGn-4GHigoKwNa7YxaZy2bpatQrNTVRhA Nov 01 19:09:33.979590 n-d-863052-2 devstack@n-api.service[121403]: X-Domain-Id: None Nov 01 19:09:33.979590 n-d-863052-2 devstack@n-api.service[121403]: X-Domain-Name: None Nov 01 19:09:33.979590 n-d-863052-2 devstack@n-api.service[121403]: X-Identity-Status: Confirmed Nov 01 19:09:33.979590 n-d-863052-2 devstack@n-api.service[121403]: X-Is-Admin-Project: True Nov 01 19:09:33.979590 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Domain-Id: default Nov 01 19:09:33.979590 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Domain-Name: Default Nov 01 19:09:33.979590 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Id: bbfa1aa719a34301a0ade36760607fd5 Nov 01 19:09:33.979590 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1574615377 Nov 01 19:09:33.979590 n-d-863052-2 devstack@n-api.service[121403]: X-Role: member,reader Nov 01 19:09:33.979590 n-d-863052-2 devstack@n-api.service[121403]: X-Roles: member,reader Nov 01 19:09:33.979590 n-d-863052-2 devstack@n-api.service[121403]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/bbfa1aa719a34301a0ade36760607fd5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/bbfa1aa719a34301a0ade36760607fd5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_bbfa1aa719a34301a0ade36760607fd5", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/bbfa1aa719a34301a0ade36760607fd5"}]}] Nov 01 19:09:33.979590 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1574615377 Nov 01 19:09:33.979590 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant-Id: bbfa1aa719a34301a0ade36760607fd5 Nov 01 19:09:33.979590 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1574615377 Nov 01 19:09:33.979590 n-d-863052-2 devstack@n-api.service[121403]: X-User: tempest-VolumesSnapshotsTestJSON-1574615377-project Nov 01 19:09:33.979590 n-d-863052-2 devstack@n-api.service[121403]: X-User-Domain-Id: default Nov 01 19:09:33.979590 n-d-863052-2 devstack@n-api.service[121403]: X-User-Domain-Name: Default Nov 01 19:09:33.979590 n-d-863052-2 devstack@n-api.service[121403]: X-User-Id: 1c00fa1a3d534b1fad963be11ce6923f Nov 01 19:09:33.979590 n-d-863052-2 devstack@n-api.service[121403]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1574615377-project Nov 01 19:09:33.979590 n-d-863052-2 devstack@n-api.service[121403]: method: Nov 01 19:09:33.979590 n-d-863052-2 devstack@n-api.service[121403]: exception: Volume 5a7b5481-a33f-47af-ad0a-30868a452555 could not be found. Nov 01 19:09:33.979590 n-d-863052-2 devstack@n-api.service[121403]: action_args: {'id': '5a7b5481-a33f-47af-ad0a-30868a452555'} Nov 01 19:09:33.979590 n-d-863052-2 devstack@n-api.service[121403]: {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 01 19:09:33.979590 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:09:33.979590 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Nov 01 19:09:33.979590 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Nov 01 19:09:33.979590 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Nov 01 19:09:33.979590 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Nov 01 19:09:33.979590 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Nov 01 19:09:33.979590 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return self._delete(loc) Nov 01 19:09:33.979590 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Nov 01 19:09:33.979590 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Nov 01 19:09:33.979590 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Nov 01 19:09:33.979590 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Nov 01 19:09:33.979590 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Nov 01 19:09:33.979590 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Nov 01 19:09:33.979590 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Nov 01 19:09:33.979590 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Nov 01 19:09:33.979590 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 5a7b5481-a33f-47af-ad0a-30868a452555 could not be found. (HTTP 404) (Request-ID: req-0803fbf0-b9e5-4a4c-8262-79ee8e6f6ea6) Nov 01 19:09:33.979590 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:09:33.979590 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:09:33.979590 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:09:33.979590 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:09:33.979590 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Nov 01 19:09:33.979590 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Nov 01 19:09:33.979590 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Nov 01 19:09:33.979590 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Nov 01 19:09:33.979590 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Nov 01 19:09:33.979590 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Nov 01 19:09:33.979590 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Nov 01 19:09:33.979590 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Nov 01 19:09:33.979590 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Nov 01 19:09:33.984366 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Nov 01 19:09:33.984366 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Nov 01 19:09:33.984366 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Nov 01 19:09:33.984366 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Nov 01 19:09:33.984366 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return self._delete(loc) Nov 01 19:09:33.984366 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Nov 01 19:09:33.984366 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Nov 01 19:09:33.984366 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Nov 01 19:09:33.984366 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Nov 01 19:09:33.984366 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Nov 01 19:09:33.984366 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Nov 01 19:09:33.984366 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Nov 01 19:09:33.984366 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Nov 01 19:09:33.984366 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 5a7b5481-a33f-47af-ad0a-30868a452555 could not be found. Nov 01 19:09:33.984366 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:09:33.984366 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:09:33.984366 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:09:33.984366 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:09:33.984366 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:09:33.984366 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:09:33.984366 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 01 19:09:33.984366 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 01 19:09:33.984366 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 01 19:09:33.984366 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 01 19:09:33.984366 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 01 19:09:33.984366 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 01 19:09:33.984366 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Nov 01 19:09:33.984366 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 01 19:09:33.984366 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 5a7b5481-a33f-47af-ad0a-30868a452555 could not be found. Nov 01 19:09:33.984366 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:09:33.984366 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:09:33.984366 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:09:33.984366 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:09:33.984366 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:09:33.984366 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:09:33.984366 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 01 19:09:33.984366 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 01 19:09:33.984366 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 5a7b5481-a33f-47af-ad0a-30868a452555 could not be found. Nov 01 19:09:33.984366 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:09:33.984366 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-cce5b893-188f-4f62-9ea6-ee0f98c0a789 tempest-VolumesSnapshotsTestJSON-1574615377 tempest-VolumesSnapshotsTestJSON-1574615377-project] Returning 404 to user: Volume 5a7b5481-a33f-47af-ad0a-30868a452555 could not be found. {{(pid=121403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 01 19:09:33.984366 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-cce5b893-188f-4f62-9ea6-ee0f98c0a789 tempest-VolumesSnapshotsTestJSON-1574615377 tempest-VolumesSnapshotsTestJSON-1574615377-project] 10.222.0.13 "DELETE /compute/v2.1/os-volumes/5a7b5481-a33f-47af-ad0a-30868a452555" status: 404 len: 109 microversion: 2.1 time: 0.043893 Nov 01 19:09:33.984366 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1937/3758] 10.222.0.13 () {58 vars in 1248 bytes} [Tue Nov 1 19:09:33 2022] DELETE /compute/v2.1/os-volumes/5a7b5481-a33f-47af-ad0a-30868a452555 => generated 109 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 01 19:09:33.995728 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-bb56c547-c48c-43e9-9cfa-624a029a97a7 tempest-VolumesSnapshotsTestJSON-1574615377 tempest-VolumesSnapshotsTestJSON-1574615377-project] Calling method '.version_select at 0x7f0ae17d6f70>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:09:34.031288 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.wsgi [None req-bb56c547-c48c-43e9-9cfa-624a029a97a7 tempest-VolumesSnapshotsTestJSON-1574615377 tempest-VolumesSnapshotsTestJSON-1574615377-project] HTTP exception thrown: Volume 5a7b5481-a33f-47af-ad0a-30868a452555 could not be found. Nov 01 19:09:34.033682 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-bb56c547-c48c-43e9-9cfa-624a029a97a7 tempest-VolumesSnapshotsTestJSON-1574615377 tempest-VolumesSnapshotsTestJSON-1574615377-project] Request method failure captured: Nov 01 19:09:34.033682 n-d-863052-2 devstack@n-api.service[121402]: request: GET /compute/v2.1/os-volumes/5a7b5481-a33f-47af-ad0a-30868a452555 HTTP/1.1 Nov 01 19:09:34.033682 n-d-863052-2 devstack@n-api.service[121402]: Accept: application/json Nov 01 19:09:34.033682 n-d-863052-2 devstack@n-api.service[121402]: Accept-Encoding: identity Nov 01 19:09:34.033682 n-d-863052-2 devstack@n-api.service[121402]: Connection: close Nov 01 19:09:34.033682 n-d-863052-2 devstack@n-api.service[121402]: Content-Length: 0 Nov 01 19:09:34.033682 n-d-863052-2 devstack@n-api.service[121402]: Content-Type: application/json Nov 01 19:09:34.033682 n-d-863052-2 devstack@n-api.service[121402]: Host: 10.222.0.13 Nov 01 19:09:34.033682 n-d-863052-2 devstack@n-api.service[121402]: Openstack-System-Scope: None Nov 01 19:09:34.033682 n-d-863052-2 devstack@n-api.service[121402]: User-Agent: python-urllib3/1.26.12 Nov 01 19:09:34.033682 n-d-863052-2 devstack@n-api.service[121402]: X-Auth-Token: gAAAAABjYW7iE7QeI4B_ZOTb-etclVWf97RlUW4KBoPW1IM-vcR445q9dg6epFMMDI-XiFsxL7lxaooeGe9RGaWKJx6QkMxql_zQxbWyt56MTfBHoIEa8EAwll8t97QFS-Sw82vlJXjukUhQKchquvuGn-4GHigoKwNa7YxaZy2bpatQrNTVRhA Nov 01 19:09:34.033682 n-d-863052-2 devstack@n-api.service[121402]: X-Domain-Id: None Nov 01 19:09:34.033682 n-d-863052-2 devstack@n-api.service[121402]: X-Domain-Name: None Nov 01 19:09:34.033682 n-d-863052-2 devstack@n-api.service[121402]: X-Identity-Status: Confirmed Nov 01 19:09:34.033682 n-d-863052-2 devstack@n-api.service[121402]: X-Is-Admin-Project: True Nov 01 19:09:34.033682 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Domain-Id: default Nov 01 19:09:34.033682 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Domain-Name: Default Nov 01 19:09:34.033682 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Id: bbfa1aa719a34301a0ade36760607fd5 Nov 01 19:09:34.033682 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1574615377 Nov 01 19:09:34.033682 n-d-863052-2 devstack@n-api.service[121402]: X-Role: member,reader Nov 01 19:09:34.033682 n-d-863052-2 devstack@n-api.service[121402]: X-Roles: member,reader Nov 01 19:09:34.033682 n-d-863052-2 devstack@n-api.service[121402]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/bbfa1aa719a34301a0ade36760607fd5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/bbfa1aa719a34301a0ade36760607fd5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_bbfa1aa719a34301a0ade36760607fd5", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/bbfa1aa719a34301a0ade36760607fd5"}]}] Nov 01 19:09:34.033682 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1574615377 Nov 01 19:09:34.033682 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant-Id: bbfa1aa719a34301a0ade36760607fd5 Nov 01 19:09:34.033682 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1574615377 Nov 01 19:09:34.033682 n-d-863052-2 devstack@n-api.service[121402]: X-User: tempest-VolumesSnapshotsTestJSON-1574615377-project Nov 01 19:09:34.033682 n-d-863052-2 devstack@n-api.service[121402]: X-User-Domain-Id: default Nov 01 19:09:34.033682 n-d-863052-2 devstack@n-api.service[121402]: X-User-Domain-Name: Default Nov 01 19:09:34.033682 n-d-863052-2 devstack@n-api.service[121402]: X-User-Id: 1c00fa1a3d534b1fad963be11ce6923f Nov 01 19:09:34.033682 n-d-863052-2 devstack@n-api.service[121402]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1574615377-project Nov 01 19:09:34.033682 n-d-863052-2 devstack@n-api.service[121402]: method: Nov 01 19:09:34.033682 n-d-863052-2 devstack@n-api.service[121402]: exception: Volume 5a7b5481-a33f-47af-ad0a-30868a452555 could not be found. Nov 01 19:09:34.033682 n-d-863052-2 devstack@n-api.service[121402]: action_args: {'id': '5a7b5481-a33f-47af-ad0a-30868a452555'} Nov 01 19:09:34.033682 n-d-863052-2 devstack@n-api.service[121402]: {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 01 19:09:34.033682 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:09:34.033682 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Nov 01 19:09:34.033682 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Nov 01 19:09:34.033682 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Nov 01 19:09:34.033682 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi item = cinderclient( Nov 01 19:09:34.033682 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Nov 01 19:09:34.033682 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Nov 01 19:09:34.033682 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Nov 01 19:09:34.033682 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Nov 01 19:09:34.033682 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Nov 01 19:09:34.033682 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Nov 01 19:09:34.033682 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Nov 01 19:09:34.033682 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Nov 01 19:09:34.033682 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Nov 01 19:09:34.033682 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Nov 01 19:09:34.033682 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 5a7b5481-a33f-47af-ad0a-30868a452555 could not be found. (HTTP 404) (Request-ID: req-6dbd749e-0053-487c-ac95-7194b2b9a918) Nov 01 19:09:34.033682 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:09:34.033682 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:09:34.033682 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:09:34.033682 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:09:34.033682 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Nov 01 19:09:34.033682 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Nov 01 19:09:34.033682 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Nov 01 19:09:34.033682 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Nov 01 19:09:34.033682 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Nov 01 19:09:34.033682 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Nov 01 19:09:34.033682 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Nov 01 19:09:34.033682 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Nov 01 19:09:34.033682 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Nov 01 19:09:34.039468 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Nov 01 19:09:34.039468 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Nov 01 19:09:34.039468 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi item = cinderclient( Nov 01 19:09:34.039468 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Nov 01 19:09:34.039468 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Nov 01 19:09:34.039468 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Nov 01 19:09:34.039468 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Nov 01 19:09:34.039468 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Nov 01 19:09:34.039468 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Nov 01 19:09:34.039468 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Nov 01 19:09:34.039468 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Nov 01 19:09:34.039468 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Nov 01 19:09:34.039468 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Nov 01 19:09:34.039468 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 5a7b5481-a33f-47af-ad0a-30868a452555 could not be found. Nov 01 19:09:34.039468 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:09:34.039468 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:09:34.039468 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:09:34.039468 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:09:34.039468 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:09:34.039468 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:09:34.039468 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 01 19:09:34.039468 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 01 19:09:34.039468 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 01 19:09:34.039468 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 01 19:09:34.039468 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 01 19:09:34.039468 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 01 19:09:34.039468 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Nov 01 19:09:34.039468 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 01 19:09:34.039468 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 5a7b5481-a33f-47af-ad0a-30868a452555 could not be found. Nov 01 19:09:34.039468 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:09:34.039468 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:09:34.039468 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:09:34.039468 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:09:34.039468 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:09:34.039468 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:09:34.039468 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 01 19:09:34.039468 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 01 19:09:34.039468 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 5a7b5481-a33f-47af-ad0a-30868a452555 could not be found. Nov 01 19:09:34.039468 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:09:34.039468 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-bb56c547-c48c-43e9-9cfa-624a029a97a7 tempest-VolumesSnapshotsTestJSON-1574615377 tempest-VolumesSnapshotsTestJSON-1574615377-project] Returning 404 to user: Volume 5a7b5481-a33f-47af-ad0a-30868a452555 could not be found. {{(pid=121402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 01 19:09:34.039468 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-bb56c547-c48c-43e9-9cfa-624a029a97a7 tempest-VolumesSnapshotsTestJSON-1574615377 tempest-VolumesSnapshotsTestJSON-1574615377-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/5a7b5481-a33f-47af-ad0a-30868a452555" status: 404 len: 109 microversion: 2.1 time: 0.045379 Nov 01 19:09:34.045365 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1822/3759] 10.222.0.13 () {58 vars in 1245 bytes} [Tue Nov 1 19:09:33 2022] GET /compute/v2.1/os-volumes/5a7b5481-a33f-47af-ad0a-30868a452555 => generated 109 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 01 19:09:34.341481 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-7412c71d-9e04-4b3b-8afd-504e4ecc53e7 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:09:34.342305 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-7412c71d-9e04-4b3b-8afd-504e4ecc53e7 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] [instance: 43b22dd3-debb-4a6d-81fc-4666e5bb7804] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:09:34.352564 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-7412c71d-9e04-4b3b-8afd-504e4ecc53e7 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:09:34.355955 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-7412c71d-9e04-4b3b-8afd-504e4ecc53e7 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:09:34.356692 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-7412c71d-9e04-4b3b-8afd-504e4ecc53e7 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:09:34.358869 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-9da420d0-7c06-4c1e-827d-36f22381c72a tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:09:34.359518 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-9da420d0-7c06-4c1e-827d-36f22381c72a tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] [instance: cc8a30dd-b655-48d8-b4e2-d4911cb15513] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:09:34.359646 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-7412c71d-9e04-4b3b-8afd-504e4ecc53e7 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:09:34.360065 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-7412c71d-9e04-4b3b-8afd-504e4ecc53e7 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:09:34.360504 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-7412c71d-9e04-4b3b-8afd-504e4ecc53e7 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:09:34.372611 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-9da420d0-7c06-4c1e-827d-36f22381c72a tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:09:34.373445 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-9da420d0-7c06-4c1e-827d-36f22381c72a tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:09:34.373902 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-9da420d0-7c06-4c1e-827d-36f22381c72a tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:09:34.377260 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-9da420d0-7c06-4c1e-827d-36f22381c72a tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:09:34.377755 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-9da420d0-7c06-4c1e-827d-36f22381c72a tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:09:34.378198 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-9da420d0-7c06-4c1e-827d-36f22381c72a tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:09:34.601263 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-9da420d0-7c06-4c1e-827d-36f22381c72a tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '058480d92c9b4ab4af6815d0438a65c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee9dc49b89143f781e4ab30296e4d01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:09:34.621040 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-9da420d0-7c06-4c1e-827d-36f22381c72a tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] 10.222.0.13 "GET /compute/v2.1/servers/cc8a30dd-b655-48d8-b4e2-d4911cb15513" status: 200 len: 1512 microversion: 2.1 time: 0.627478 Nov 01 19:09:34.621984 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1938/3760] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:09:33 2022] GET /compute/v2.1/servers/cc8a30dd-b655-48d8-b4e2-d4911cb15513 => generated 1512 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 19:09:34.655033 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-7412c71d-9e04-4b3b-8afd-504e4ecc53e7 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113bd8c844ee490b86a68bc7e1e75da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '851785a5f76548898a77d67792888504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:09:34.666097 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-7412c71d-9e04-4b3b-8afd-504e4ecc53e7 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] 10.222.0.13 "GET /compute/v2.1/servers/43b22dd3-debb-4a6d-81fc-4666e5bb7804" status: 200 len: 1511 microversion: 2.1 time: 0.329357 Nov 01 19:09:34.667170 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1823/3761] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:09:34 2022] GET /compute/v2.1/servers/43b22dd3-debb-4a6d-81fc-4666e5bb7804 => generated 1511 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:09:34.796081 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-9338024b-4be5-47ec-a479-448245d5b1ae tempest-AZV2TestJSON-1089639604 tempest-AZV2TestJSON-1089639604-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:09:34.798413 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-9338024b-4be5-47ec-a479-448245d5b1ae tempest-AZV2TestJSON-1089639604 tempest-AZV2TestJSON-1089639604-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:09:34.799051 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-9338024b-4be5-47ec-a479-448245d5b1ae tempest-AZV2TestJSON-1089639604 tempest-AZV2TestJSON-1089639604-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:09:34.799637 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-9338024b-4be5-47ec-a479-448245d5b1ae tempest-AZV2TestJSON-1089639604 tempest-AZV2TestJSON-1089639604-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:09:34.800413 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-9338024b-4be5-47ec-a479-448245d5b1ae tempest-AZV2TestJSON-1089639604 tempest-AZV2TestJSON-1089639604-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:09:34.801085 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-9338024b-4be5-47ec-a479-448245d5b1ae tempest-AZV2TestJSON-1089639604 tempest-AZV2TestJSON-1089639604-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:09:34.801508 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-9338024b-4be5-47ec-a479-448245d5b1ae tempest-AZV2TestJSON-1089639604 tempest-AZV2TestJSON-1089639604-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:09:34.839594 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-9338024b-4be5-47ec-a479-448245d5b1ae tempest-AZV2TestJSON-1089639604 tempest-AZV2TestJSON-1089639604-project] 10.222.0.13 "GET /compute/v2.1/os-availability-zone" status: 200 len: 97 microversion: 2.1 time: 0.216427 Nov 01 19:09:34.840181 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1939/3762] 10.222.0.13 () {58 vars in 1164 bytes} [Tue Nov 1 19:09:34 2022] GET /compute/v2.1/os-availability-zone => generated 97 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 01 19:09:34.863763 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-8dcccf1f-2c6e-4db2-8a41-35f5dad096b9 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:09:34.865408 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-8dcccf1f-2c6e-4db2-8a41-35f5dad096b9 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] [instance: ac4160c6-ca16-455e-9613-0d425932af3b] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:09:34.872438 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-8dcccf1f-2c6e-4db2-8a41-35f5dad096b9 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:09:34.873041 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-8dcccf1f-2c6e-4db2-8a41-35f5dad096b9 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:09:34.874104 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-8dcccf1f-2c6e-4db2-8a41-35f5dad096b9 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:09:34.875579 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-8dcccf1f-2c6e-4db2-8a41-35f5dad096b9 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:09:34.876226 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-8dcccf1f-2c6e-4db2-8a41-35f5dad096b9 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:09:34.876751 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-8dcccf1f-2c6e-4db2-8a41-35f5dad096b9 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:09:34.895597 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.wsgi [None req-8dcccf1f-2c6e-4db2-8a41-35f5dad096b9 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] HTTP exception thrown: Instance ac4160c6-ca16-455e-9613-0d425932af3b could not be found. Nov 01 19:09:34.897163 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-8dcccf1f-2c6e-4db2-8a41-35f5dad096b9 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Request method failure captured: Nov 01 19:09:34.897163 n-d-863052-2 devstack@n-api.service[121402]: request: GET /compute/v2.1/servers/ac4160c6-ca16-455e-9613-0d425932af3b HTTP/1.1 Nov 01 19:09:34.897163 n-d-863052-2 devstack@n-api.service[121402]: Accept: application/json Nov 01 19:09:34.897163 n-d-863052-2 devstack@n-api.service[121402]: Accept-Encoding: identity Nov 01 19:09:34.897163 n-d-863052-2 devstack@n-api.service[121402]: Connection: close Nov 01 19:09:34.897163 n-d-863052-2 devstack@n-api.service[121402]: Content-Length: 0 Nov 01 19:09:34.897163 n-d-863052-2 devstack@n-api.service[121402]: Content-Type: application/json Nov 01 19:09:34.897163 n-d-863052-2 devstack@n-api.service[121402]: Host: 10.222.0.13 Nov 01 19:09:34.897163 n-d-863052-2 devstack@n-api.service[121402]: Openstack-System-Scope: None Nov 01 19:09:34.897163 n-d-863052-2 devstack@n-api.service[121402]: User-Agent: python-urllib3/1.26.12 Nov 01 19:09:34.897163 n-d-863052-2 devstack@n-api.service[121402]: X-Auth-Token: gAAAAABjYW26-niUURjtSz2aypPDgkYX79sMl0CZOJW_ml_lGFRo-4lOtvHbbGMI0UBaScGrQfLye0e0L4c10ym8MikDvB1h-T3Rh6fQQzcKLxsRSm1saxobVhs9el4Qiq-2aZx04HWuIjPot0FuuMjXsFtl108kYD3rs-RWb4TVydSfipjFJKk Nov 01 19:09:34.897163 n-d-863052-2 devstack@n-api.service[121402]: X-Domain-Id: None Nov 01 19:09:34.897163 n-d-863052-2 devstack@n-api.service[121402]: X-Domain-Name: None Nov 01 19:09:34.897163 n-d-863052-2 devstack@n-api.service[121402]: X-Identity-Status: Confirmed Nov 01 19:09:34.897163 n-d-863052-2 devstack@n-api.service[121402]: X-Is-Admin-Project: True Nov 01 19:09:34.897163 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Domain-Id: default Nov 01 19:09:34.897163 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Domain-Name: Default Nov 01 19:09:34.897163 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Id: 33e3d319293c46b6af2f728a50586906 Nov 01 19:09:34.897163 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Name: tempest-AttachVolumeNegativeTest-517167560 Nov 01 19:09:34.897163 n-d-863052-2 devstack@n-api.service[121402]: X-Role: member,reader Nov 01 19:09:34.897163 n-d-863052-2 devstack@n-api.service[121402]: X-Roles: member,reader Nov 01 19:09:34.897163 n-d-863052-2 devstack@n-api.service[121402]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/33e3d319293c46b6af2f728a50586906"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/33e3d319293c46b6af2f728a50586906"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_33e3d319293c46b6af2f728a50586906", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/33e3d319293c46b6af2f728a50586906"}]}] Nov 01 19:09:34.897163 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant: tempest-AttachVolumeNegativeTest-517167560 Nov 01 19:09:34.897163 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant-Id: 33e3d319293c46b6af2f728a50586906 Nov 01 19:09:34.897163 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-517167560 Nov 01 19:09:34.897163 n-d-863052-2 devstack@n-api.service[121402]: X-User: tempest-AttachVolumeNegativeTest-517167560-project Nov 01 19:09:34.897163 n-d-863052-2 devstack@n-api.service[121402]: X-User-Domain-Id: default Nov 01 19:09:34.897163 n-d-863052-2 devstack@n-api.service[121402]: X-User-Domain-Name: Default Nov 01 19:09:34.897163 n-d-863052-2 devstack@n-api.service[121402]: X-User-Id: 790f3f1566b7464aaca19d4d05c0942e Nov 01 19:09:34.897163 n-d-863052-2 devstack@n-api.service[121402]: X-User-Name: tempest-AttachVolumeNegativeTest-517167560-project Nov 01 19:09:34.897163 n-d-863052-2 devstack@n-api.service[121402]: method: > Nov 01 19:09:34.897163 n-d-863052-2 devstack@n-api.service[121402]: exception: Instance ac4160c6-ca16-455e-9613-0d425932af3b could not be found. Nov 01 19:09:34.897163 n-d-863052-2 devstack@n-api.service[121402]: action_args: {'id': 'ac4160c6-ca16-455e-9613-0d425932af3b'} Nov 01 19:09:34.897163 n-d-863052-2 devstack@n-api.service[121402]: {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 01 19:09:34.897163 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:09:34.897163 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 01 19:09:34.897163 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 01 19:09:34.897163 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 01 19:09:34.897163 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 01 19:09:34.897163 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 01 19:09:34.897163 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 01 19:09:34.897163 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 01 19:09:34.897163 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 01 19:09:34.897163 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ac4160c6-ca16-455e-9613-0d425932af3b could not be found. Nov 01 19:09:34.897163 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:09:34.897163 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:09:34.897163 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:09:34.897163 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:09:34.897163 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:09:34.897163 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:09:34.897163 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 01 19:09:34.897163 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 01 19:09:34.897163 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 01 19:09:34.897163 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 01 19:09:34.897163 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 01 19:09:34.897163 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 01 19:09:34.897163 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 01 19:09:34.897163 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 01 19:09:34.897163 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 01 19:09:34.897163 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 01 19:09:34.897163 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ac4160c6-ca16-455e-9613-0d425932af3b could not be found. Nov 01 19:09:34.897163 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:09:34.897163 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:09:34.897163 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:09:34.903247 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:09:34.903247 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:09:34.903247 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:09:34.903247 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 01 19:09:34.903247 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 01 19:09:34.903247 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ac4160c6-ca16-455e-9613-0d425932af3b could not be found. Nov 01 19:09:34.903247 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:09:34.903247 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-8dcccf1f-2c6e-4db2-8a41-35f5dad096b9 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Returning 404 to user: Instance ac4160c6-ca16-455e-9613-0d425932af3b could not be found. {{(pid=121402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 01 19:09:34.903247 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-8dcccf1f-2c6e-4db2-8a41-35f5dad096b9 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] 10.222.0.13 "GET /compute/v2.1/servers/ac4160c6-ca16-455e-9613-0d425932af3b" status: 404 len: 111 microversion: 2.1 time: 0.039359 Nov 01 19:09:34.903247 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1824/3763] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:09:34 2022] GET /compute/v2.1/servers/ac4160c6-ca16-455e-9613-0d425932af3b => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 01 19:09:34.908152 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-9cb83d1e-2f2a-4d82-bcde-569b5c301f97 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Calling method '.version_select at 0x7f0ae1cf6b80>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:09:34.932399 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-9cb83d1e-2f2a-4d82-bcde-569b5c301f97 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-954591625" status: 202 len: 0 microversion: 2.1 time: 0.028039 Nov 01 19:09:34.936972 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1940/3764] 10.222.0.13 () {58 vars in 1218 bytes} [Tue Nov 1 19:09:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-954591625 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 01 19:09:35.644888 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-1ada4d31-5cfa-4e92-a2ee-19d2c1b967e1 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:09:35.646455 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-1ada4d31-5cfa-4e92-a2ee-19d2c1b967e1 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] [instance: cc8a30dd-b655-48d8-b4e2-d4911cb15513] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:09:35.658540 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-1ada4d31-5cfa-4e92-a2ee-19d2c1b967e1 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:09:35.659827 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-1ada4d31-5cfa-4e92-a2ee-19d2c1b967e1 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:09:35.660296 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-1ada4d31-5cfa-4e92-a2ee-19d2c1b967e1 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:09:35.662286 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-1ada4d31-5cfa-4e92-a2ee-19d2c1b967e1 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:09:35.663212 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-1ada4d31-5cfa-4e92-a2ee-19d2c1b967e1 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:09:35.663715 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-1ada4d31-5cfa-4e92-a2ee-19d2c1b967e1 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:09:35.693675 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-02f7ef0c-d772-43b8-bf0e-bb6283a855fe tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:09:35.693675 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-02f7ef0c-d772-43b8-bf0e-bb6283a855fe tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] [instance: 43b22dd3-debb-4a6d-81fc-4666e5bb7804] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:09:35.702237 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-02f7ef0c-d772-43b8-bf0e-bb6283a855fe tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:09:35.702721 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-02f7ef0c-d772-43b8-bf0e-bb6283a855fe tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:09:35.703163 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-02f7ef0c-d772-43b8-bf0e-bb6283a855fe tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:09:35.703858 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-02f7ef0c-d772-43b8-bf0e-bb6283a855fe tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:09:35.706601 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-02f7ef0c-d772-43b8-bf0e-bb6283a855fe tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:09:35.707232 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-02f7ef0c-d772-43b8-bf0e-bb6283a855fe tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:09:35.946618 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-02f7ef0c-d772-43b8-bf0e-bb6283a855fe tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113bd8c844ee490b86a68bc7e1e75da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '851785a5f76548898a77d67792888504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:09:35.957603 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-02f7ef0c-d772-43b8-bf0e-bb6283a855fe tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] 10.222.0.13 "GET /compute/v2.1/servers/43b22dd3-debb-4a6d-81fc-4666e5bb7804" status: 200 len: 1511 microversion: 2.1 time: 0.269734 Nov 01 19:09:35.960175 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1941/3765] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:09:35 2022] GET /compute/v2.1/servers/43b22dd3-debb-4a6d-81fc-4666e5bb7804 => generated 1511 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 19:09:36.214484 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-39a8dbb6-672e-4241-9ddf-3a07f01d4666 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Action: 'create', calling method: .version_select at 0x7f0ae1cf6940>, body: {"keypair": {"name": "tempest-keypair-545523049", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKQ9179YfDMH9zVGxus7PezZYu+rJLsMLAey1vMmYU2qvcjRbXckL46z7Gr3WtH0iQQFWkJYP8E+rIYCEjDOcMBS9/zGHCoPxupamkhYiZGg9Owvh+0sqcaUNd7n6NlJiw=="}} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:09:36.231719 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.quota [None req-39a8dbb6-672e-4241-9ddf-3a07f01d4666 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Getting quotas for project 33e3d319293c46b6af2f728a50586906. Resources: {'key_pairs'} {{(pid=121403) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 01 19:09:36.237862 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.quota [None req-39a8dbb6-672e-4241-9ddf-3a07f01d4666 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Getting quotas for user 790f3f1566b7464aaca19d4d05c0942e and project 33e3d319293c46b6af2f728a50586906. Resources: {'key_pairs'} {{(pid=121403) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 01 19:09:36.253013 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-1ada4d31-5cfa-4e92-a2ee-19d2c1b967e1 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '058480d92c9b4ab4af6815d0438a65c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee9dc49b89143f781e4ab30296e4d01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:09:36.257494 n-d-863052-2 devstack@n-api.service[121402]: DEBUG dbcounter [-] [121402] Writing DB stats nova_cell1:SELECT=100 {{(pid=121402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 19:09:36.264227 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-1ada4d31-5cfa-4e92-a2ee-19d2c1b967e1 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] 10.222.0.13 "GET /compute/v2.1/servers/cc8a30dd-b655-48d8-b4e2-d4911cb15513" status: 200 len: 1512 microversion: 2.1 time: 0.623256 Nov 01 19:09:36.265270 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1825/3766] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:09:35 2022] GET /compute/v2.1/servers/cc8a30dd-b655-48d8-b4e2-d4911cb15513 => generated 1512 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:09:36.266868 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-39a8dbb6-672e-4241-9ddf-3a07f01d4666 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.056688 Nov 01 19:09:36.269118 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1942/3767] 10.222.0.13 () {60 vars in 1159 bytes} [Tue Nov 1 19:09:36 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:09:36.991030 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-b8295f82-f907-4cff-9ab0-6d50eda9df8d tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:09:36.991632 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-b8295f82-f907-4cff-9ab0-6d50eda9df8d tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] [instance: 43b22dd3-debb-4a6d-81fc-4666e5bb7804] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:09:37.005238 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b8295f82-f907-4cff-9ab0-6d50eda9df8d tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:09:37.006625 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b8295f82-f907-4cff-9ab0-6d50eda9df8d tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:09:37.007466 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b8295f82-f907-4cff-9ab0-6d50eda9df8d tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:09:37.009890 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b8295f82-f907-4cff-9ab0-6d50eda9df8d tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:09:37.011214 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b8295f82-f907-4cff-9ab0-6d50eda9df8d tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:09:37.011812 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b8295f82-f907-4cff-9ab0-6d50eda9df8d tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:09:37.222493 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-b8295f82-f907-4cff-9ab0-6d50eda9df8d tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113bd8c844ee490b86a68bc7e1e75da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '851785a5f76548898a77d67792888504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:09:37.232391 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-b8295f82-f907-4cff-9ab0-6d50eda9df8d tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] 10.222.0.13 "GET /compute/v2.1/servers/43b22dd3-debb-4a6d-81fc-4666e5bb7804" status: 200 len: 1511 microversion: 2.1 time: 0.246007 Nov 01 19:09:37.244943 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1826/3768] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:09:36 2022] GET /compute/v2.1/servers/43b22dd3-debb-4a6d-81fc-4666e5bb7804 => generated 1511 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:09:37.290596 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-f2f85967-3611-4e70-8a6a-acad27cbd752 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:09:37.292679 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-f2f85967-3611-4e70-8a6a-acad27cbd752 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] [instance: cc8a30dd-b655-48d8-b4e2-d4911cb15513] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:09:37.301528 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f2f85967-3611-4e70-8a6a-acad27cbd752 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:09:37.302332 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f2f85967-3611-4e70-8a6a-acad27cbd752 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:09:37.302977 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f2f85967-3611-4e70-8a6a-acad27cbd752 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:09:37.303856 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f2f85967-3611-4e70-8a6a-acad27cbd752 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:09:37.304324 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f2f85967-3611-4e70-8a6a-acad27cbd752 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:09:37.304780 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f2f85967-3611-4e70-8a6a-acad27cbd752 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:09:37.533830 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-f2f85967-3611-4e70-8a6a-acad27cbd752 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '058480d92c9b4ab4af6815d0438a65c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee9dc49b89143f781e4ab30296e4d01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:09:37.545578 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-f2f85967-3611-4e70-8a6a-acad27cbd752 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] 10.222.0.13 "GET /compute/v2.1/servers/cc8a30dd-b655-48d8-b4e2-d4911cb15513" status: 200 len: 1512 microversion: 2.1 time: 0.261476 Nov 01 19:09:37.547080 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1943/3769] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:09:37 2022] GET /compute/v2.1/servers/cc8a30dd-b655-48d8-b4e2-d4911cb15513 => generated 1512 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:09:37.991489 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-81ae064f-2088-48f9-b35c-30766d6cfadb tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-218123676", "imageRef": "2d4a0047-1b9e-445f-8af8-1b5c9d93e881", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f519283e-0b16-42bb-b3ce-8665b5719c87"}], "security_groups": [{"name": "tempest-securitygroup--584584942"}], "key_name": "tempest-keypair-545523049", "user_data": "}} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:09:38.125334 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.network.neutron [None req-81ae064f-2088-48f9-b35c-30766d6cfadb tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] validate_networks() for [('f519283e-0b16-42bb-b3ce-8665b5719c87', None, None, None, None, None)] {{(pid=121402) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 01 19:09:38.534257 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-096860f7-78d1-4008-a18d-8809e0f4d446 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-1380889138", "imageRef": "2d4a0047-1b9e-445f-8af8-1b5c9d93e881", "flavorRef": "452", "networks": [{"uuid": "d1cd9cb4-c869-443e-8ad3-ef7113285c7c"}]}} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:09:38.625517 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.virt.hardware [None req-81ae064f-2088-48f9-b35c-30766d6cfadb tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Flavor limits 0:0:0 {{(pid=121402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 01 19:09:38.625899 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.network.neutron [None req-096860f7-78d1-4008-a18d-8809e0f4d446 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] validate_networks() for [('d1cd9cb4-c869-443e-8ad3-ef7113285c7c', None, None, None, None, None)] {{(pid=121403) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 01 19:09:38.626545 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.virt.hardware [None req-81ae064f-2088-48f9-b35c-30766d6cfadb tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Image limits 0:0:0 {{(pid=121402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 01 19:09:38.627191 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.virt.hardware [None req-81ae064f-2088-48f9-b35c-30766d6cfadb tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Flavor pref 0:0:0 {{(pid=121402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 01 19:09:38.627781 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.virt.hardware [None req-81ae064f-2088-48f9-b35c-30766d6cfadb tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Image pref 0:0:0 {{(pid=121402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 01 19:09:38.628350 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.virt.hardware [None req-81ae064f-2088-48f9-b35c-30766d6cfadb tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 01 19:09:38.654058 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-81ae064f-2088-48f9-b35c-30766d6cfadb tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:09:38.654546 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-81ae064f-2088-48f9-b35c-30766d6cfadb tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:09:38.654975 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-81ae064f-2088-48f9-b35c-30766d6cfadb tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:09:38.657695 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-81ae064f-2088-48f9-b35c-30766d6cfadb tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:09:38.658335 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-81ae064f-2088-48f9-b35c-30766d6cfadb tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:09:38.658928 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-81ae064f-2088-48f9-b35c-30766d6cfadb tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:09:38.687664 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.quota [None req-81ae064f-2088-48f9-b35c-30766d6cfadb tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Getting quotas for project 33e3d319293c46b6af2f728a50586906. Resources: {'cores', 'ram', 'instances'} {{(pid=121402) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 01 19:09:38.693444 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.quota [None req-81ae064f-2088-48f9-b35c-30766d6cfadb tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Getting quotas for user 790f3f1566b7464aaca19d4d05c0942e and project 33e3d319293c46b6af2f728a50586906. Resources: {'cores', 'ram', 'instances'} {{(pid=121402) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 01 19:09:38.707323 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-81ae064f-2088-48f9-b35c-30766d6cfadb tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Going to run 1 instances... {{(pid=121402) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 01 19:09:38.710344 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-81ae064f-2088-48f9-b35c-30766d6cfadb tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] [instance: eced579f-beea-4d3c-b2b8-8a6b31f7829b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2d4a0047-1b9e-445f-8af8-1b5c9d93e881',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121402) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 01 19:09:38.766270 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-81ae064f-2088-48f9-b35c-30766d6cfadb tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.782294 Nov 01 19:09:38.774832 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1827/3770] 10.222.0.13 () {60 vars in 1147 bytes} [Tue Nov 1 19:09:37 2022] POST /compute/v2.1/servers => generated 401 bytes in 791 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 01 19:09:38.780099 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-bc3bf9ff-661c-481c-94bf-aae6b3ff10dc tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:09:38.780952 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-bc3bf9ff-661c-481c-94bf-aae6b3ff10dc tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] [instance: 43b22dd3-debb-4a6d-81fc-4666e5bb7804] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:09:38.789558 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-bc3bf9ff-661c-481c-94bf-aae6b3ff10dc tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:09:38.790223 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-bc3bf9ff-661c-481c-94bf-aae6b3ff10dc tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:09:38.790847 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-bc3bf9ff-661c-481c-94bf-aae6b3ff10dc tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:09:38.791702 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-bc3bf9ff-661c-481c-94bf-aae6b3ff10dc tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:09:38.792313 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-bc3bf9ff-661c-481c-94bf-aae6b3ff10dc tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:09:38.793091 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-bc3bf9ff-661c-481c-94bf-aae6b3ff10dc tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:09:38.968941 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-bc3bf9ff-661c-481c-94bf-aae6b3ff10dc tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113bd8c844ee490b86a68bc7e1e75da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '851785a5f76548898a77d67792888504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:09:38.982159 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-bc3bf9ff-661c-481c-94bf-aae6b3ff10dc tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] 10.222.0.13 "GET /compute/v2.1/servers/43b22dd3-debb-4a6d-81fc-4666e5bb7804" status: 200 len: 1511 microversion: 2.1 time: 0.203774 Nov 01 19:09:38.983256 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1828/3771] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:09:38 2022] GET /compute/v2.1/servers/43b22dd3-debb-4a6d-81fc-4666e5bb7804 => generated 1511 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:09:38.994397 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-45c428bc-c49e-4462-82b1-f29311e8344c tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:09:38.995968 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-45c428bc-c49e-4462-82b1-f29311e8344c tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] [instance: cc8a30dd-b655-48d8-b4e2-d4911cb15513] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:09:39.006085 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-45c428bc-c49e-4462-82b1-f29311e8344c tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:09:39.007053 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-45c428bc-c49e-4462-82b1-f29311e8344c tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:09:39.007832 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-45c428bc-c49e-4462-82b1-f29311e8344c tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:09:39.008877 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-45c428bc-c49e-4462-82b1-f29311e8344c tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:09:39.009566 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-45c428bc-c49e-4462-82b1-f29311e8344c tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:09:39.010340 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-45c428bc-c49e-4462-82b1-f29311e8344c tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:09:39.200338 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.virt.hardware [None req-096860f7-78d1-4008-a18d-8809e0f4d446 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Flavor limits 0:0:0 {{(pid=121403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 01 19:09:39.209166 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.virt.hardware [None req-096860f7-78d1-4008-a18d-8809e0f4d446 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Image limits 0:0:0 {{(pid=121403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 01 19:09:39.209824 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.virt.hardware [None req-096860f7-78d1-4008-a18d-8809e0f4d446 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Flavor pref 0:0:0 {{(pid=121403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 01 19:09:39.210083 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.virt.hardware [None req-096860f7-78d1-4008-a18d-8809e0f4d446 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Image pref 0:0:0 {{(pid=121403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 01 19:09:39.210495 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.virt.hardware [None req-096860f7-78d1-4008-a18d-8809e0f4d446 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 01 19:09:39.229023 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-096860f7-78d1-4008-a18d-8809e0f4d446 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:09:39.229696 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-096860f7-78d1-4008-a18d-8809e0f4d446 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:09:39.230293 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-096860f7-78d1-4008-a18d-8809e0f4d446 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:09:39.246204 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-096860f7-78d1-4008-a18d-8809e0f4d446 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:09:39.246815 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-096860f7-78d1-4008-a18d-8809e0f4d446 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:09:39.247266 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-096860f7-78d1-4008-a18d-8809e0f4d446 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:09:39.257820 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-45c428bc-c49e-4462-82b1-f29311e8344c tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '058480d92c9b4ab4af6815d0438a65c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee9dc49b89143f781e4ab30296e4d01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:09:39.268368 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-45c428bc-c49e-4462-82b1-f29311e8344c tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] 10.222.0.13 "GET /compute/v2.1/servers/cc8a30dd-b655-48d8-b4e2-d4911cb15513" status: 200 len: 1512 microversion: 2.1 time: 0.281180 Nov 01 19:09:39.269480 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1829/3772] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:09:38 2022] GET /compute/v2.1/servers/cc8a30dd-b655-48d8-b4e2-d4911cb15513 => generated 1512 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:09:39.275318 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-134f7921-767e-46c5-b5ee-9e7dcaae8e75 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:09:39.276217 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-134f7921-767e-46c5-b5ee-9e7dcaae8e75 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] [instance: eced579f-beea-4d3c-b2b8-8a6b31f7829b] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:09:39.313005 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.quota [None req-096860f7-78d1-4008-a18d-8809e0f4d446 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Getting quotas for project 04ef687c40bd45c297d22a791bae58cf. Resources: {'cores', 'ram', 'instances'} {{(pid=121403) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 01 19:09:39.324725 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.quota [None req-096860f7-78d1-4008-a18d-8809e0f4d446 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Getting quotas for user 2868ccfdfb164cffa37232c821f205a8 and project 04ef687c40bd45c297d22a791bae58cf. Resources: {'cores', 'ram', 'instances'} {{(pid=121403) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 01 19:09:39.339643 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-096860f7-78d1-4008-a18d-8809e0f4d446 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Going to run 1 instances... {{(pid=121403) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 01 19:09:39.342360 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-096860f7-78d1-4008-a18d-8809e0f4d446 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] [instance: ac19dd18-c22a-46de-91ef-454a0b78872f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2d4a0047-1b9e-445f-8af8-1b5c9d93e881',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121403) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 01 19:09:39.369475 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-134f7921-767e-46c5-b5ee-9e7dcaae8e75 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '790f3f1566b7464aaca19d4d05c0942e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33e3d319293c46b6af2f728a50586906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:09:39.384872 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-134f7921-767e-46c5-b5ee-9e7dcaae8e75 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] 10.222.0.13 "GET /compute/v2.1/servers/eced579f-beea-4d3c-b2b8-8a6b31f7829b" status: 200 len: 1240 microversion: 2.1 time: 0.113878 Nov 01 19:09:39.390596 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1830/3773] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:09:39 2022] GET /compute/v2.1/servers/eced579f-beea-4d3c-b2b8-8a6b31f7829b => generated 1240 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:09:39.419140 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-096860f7-78d1-4008-a18d-8809e0f4d446 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.203712 Nov 01 19:09:39.432557 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1944/3774] 10.222.0.13 () {60 vars in 1147 bytes} [Tue Nov 1 19:09:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 1218 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 01 19:09:39.539589 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-8c42c83a-e1e5-45ba-857a-5b9884a1c5a9 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-925424230", "imageRef": "2d4a0047-1b9e-445f-8af8-1b5c9d93e881", "flavorRef": "452", "networks": [{"uuid": "d1cd9cb4-c869-443e-8ad3-ef7113285c7c"}]}} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:09:39.618265 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.network.neutron [None req-8c42c83a-e1e5-45ba-857a-5b9884a1c5a9 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] validate_networks() for [('d1cd9cb4-c869-443e-8ad3-ef7113285c7c', None, None, None, None, None)] {{(pid=121402) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 01 19:09:40.007622 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-fe4e7123-5cd4-4b77-99d7-5f96c62ffba6 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:09:40.008930 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-fe4e7123-5cd4-4b77-99d7-5f96c62ffba6 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] [instance: 43b22dd3-debb-4a6d-81fc-4666e5bb7804] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:09:40.017875 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-fe4e7123-5cd4-4b77-99d7-5f96c62ffba6 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:09:40.021623 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-fe4e7123-5cd4-4b77-99d7-5f96c62ffba6 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:09:40.022289 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-fe4e7123-5cd4-4b77-99d7-5f96c62ffba6 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:09:40.023239 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-fe4e7123-5cd4-4b77-99d7-5f96c62ffba6 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:09:40.026016 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-fe4e7123-5cd4-4b77-99d7-5f96c62ffba6 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:09:40.026733 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-fe4e7123-5cd4-4b77-99d7-5f96c62ffba6 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:09:40.330708 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-fe4e7123-5cd4-4b77-99d7-5f96c62ffba6 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113bd8c844ee490b86a68bc7e1e75da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '851785a5f76548898a77d67792888504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:09:40.345895 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.virt.hardware [None req-8c42c83a-e1e5-45ba-857a-5b9884a1c5a9 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Flavor limits 0:0:0 {{(pid=121402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 01 19:09:40.346420 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.virt.hardware [None req-8c42c83a-e1e5-45ba-857a-5b9884a1c5a9 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Image limits 0:0:0 {{(pid=121402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 01 19:09:40.347175 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.virt.hardware [None req-8c42c83a-e1e5-45ba-857a-5b9884a1c5a9 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Flavor pref 0:0:0 {{(pid=121402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 01 19:09:40.347991 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.virt.hardware [None req-8c42c83a-e1e5-45ba-857a-5b9884a1c5a9 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Image pref 0:0:0 {{(pid=121402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 01 19:09:40.349013 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.virt.hardware [None req-8c42c83a-e1e5-45ba-857a-5b9884a1c5a9 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 01 19:09:40.358306 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-fe4e7123-5cd4-4b77-99d7-5f96c62ffba6 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] 10.222.0.13 "GET /compute/v2.1/servers/43b22dd3-debb-4a6d-81fc-4666e5bb7804" status: 200 len: 1511 microversion: 2.1 time: 0.355113 Nov 01 19:09:40.359343 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1945/3775] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:09:40 2022] GET /compute/v2.1/servers/43b22dd3-debb-4a6d-81fc-4666e5bb7804 => generated 1511 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:09:40.372855 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-8c42c83a-e1e5-45ba-857a-5b9884a1c5a9 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:09:40.374621 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-825c29b6-9e27-4d4d-931f-329aa66745a4 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:09:40.375456 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-825c29b6-9e27-4d4d-931f-329aa66745a4 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] [instance: cc8a30dd-b655-48d8-b4e2-d4911cb15513] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:09:40.378717 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-8c42c83a-e1e5-45ba-857a-5b9884a1c5a9 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:09:40.381956 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-8c42c83a-e1e5-45ba-857a-5b9884a1c5a9 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:09:40.382417 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-825c29b6-9e27-4d4d-931f-329aa66745a4 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:09:40.383010 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-825c29b6-9e27-4d4d-931f-329aa66745a4 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:09:40.383332 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-825c29b6-9e27-4d4d-931f-329aa66745a4 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:09:40.384064 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-825c29b6-9e27-4d4d-931f-329aa66745a4 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:09:40.384519 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-825c29b6-9e27-4d4d-931f-329aa66745a4 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:09:40.384997 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-825c29b6-9e27-4d4d-931f-329aa66745a4 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:09:40.387705 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-8c42c83a-e1e5-45ba-857a-5b9884a1c5a9 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:09:40.388228 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-8c42c83a-e1e5-45ba-857a-5b9884a1c5a9 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:09:40.388688 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-8c42c83a-e1e5-45ba-857a-5b9884a1c5a9 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:09:40.412085 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.quota [None req-8c42c83a-e1e5-45ba-857a-5b9884a1c5a9 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Getting quotas for project 04ef687c40bd45c297d22a791bae58cf. Resources: {'cores', 'ram', 'instances'} {{(pid=121402) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 01 19:09:40.417607 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.quota [None req-8c42c83a-e1e5-45ba-857a-5b9884a1c5a9 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Getting quotas for user 2868ccfdfb164cffa37232c821f205a8 and project 04ef687c40bd45c297d22a791bae58cf. Resources: {'cores', 'ram', 'instances'} {{(pid=121402) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 01 19:09:40.433197 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-8c42c83a-e1e5-45ba-857a-5b9884a1c5a9 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Going to run 1 instances... {{(pid=121402) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 01 19:09:40.435604 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-8c42c83a-e1e5-45ba-857a-5b9884a1c5a9 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] [instance: 33dd79e0-eb7c-4f18-a61f-df8022667dd0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2d4a0047-1b9e-445f-8af8-1b5c9d93e881',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121402) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 01 19:09:40.494594 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-8c42c83a-e1e5-45ba-857a-5b9884a1c5a9 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.960007 Nov 01 19:09:40.495940 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1831/3776] 10.222.0.13 () {60 vars in 1147 bytes} [Tue Nov 1 19:09:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 962 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 01 19:09:40.502455 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-edc482d4-25c8-4cc8-ab0b-c60c87f11098 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:09:40.503326 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-edc482d4-25c8-4cc8-ab0b-c60c87f11098 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] [instance: eced579f-beea-4d3c-b2b8-8a6b31f7829b] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:09:40.534121 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-edc482d4-25c8-4cc8-ab0b-c60c87f11098 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:09:40.534726 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-edc482d4-25c8-4cc8-ab0b-c60c87f11098 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:09:40.535263 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-edc482d4-25c8-4cc8-ab0b-c60c87f11098 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:09:40.538012 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-edc482d4-25c8-4cc8-ab0b-c60c87f11098 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:09:40.538588 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-edc482d4-25c8-4cc8-ab0b-c60c87f11098 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:09:40.539540 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-edc482d4-25c8-4cc8-ab0b-c60c87f11098 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:09:40.609356 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-825c29b6-9e27-4d4d-931f-329aa66745a4 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '058480d92c9b4ab4af6815d0438a65c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee9dc49b89143f781e4ab30296e4d01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:09:40.619626 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-825c29b6-9e27-4d4d-931f-329aa66745a4 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] 10.222.0.13 "GET /compute/v2.1/servers/cc8a30dd-b655-48d8-b4e2-d4911cb15513" status: 200 len: 1512 microversion: 2.1 time: 0.258621 Nov 01 19:09:40.624571 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1946/3777] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:09:40 2022] GET /compute/v2.1/servers/cc8a30dd-b655-48d8-b4e2-d4911cb15513 => generated 1512 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:09:40.693507 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-edc482d4-25c8-4cc8-ab0b-c60c87f11098 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '790f3f1566b7464aaca19d4d05c0942e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33e3d319293c46b6af2f728a50586906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:09:40.705484 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-7b397048-91a0-464b-bb90-afe14d9b4c54 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-770102591", "imageRef": "2d4a0047-1b9e-445f-8af8-1b5c9d93e881", "flavorRef": "451", "networks": [{"uuid": "d1cd9cb4-c869-443e-8ad3-ef7113285c7c"}]}} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:09:40.709653 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-edc482d4-25c8-4cc8-ab0b-c60c87f11098 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] 10.222.0.13 "GET /compute/v2.1/servers/eced579f-beea-4d3c-b2b8-8a6b31f7829b" status: 200 len: 1292 microversion: 2.1 time: 0.209356 Nov 01 19:09:40.712035 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1832/3778] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:09:40 2022] GET /compute/v2.1/servers/eced579f-beea-4d3c-b2b8-8a6b31f7829b => generated 1292 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:09:40.828305 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.network.neutron [None req-7b397048-91a0-464b-bb90-afe14d9b4c54 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] validate_networks() for [('d1cd9cb4-c869-443e-8ad3-ef7113285c7c', None, None, None, None, None)] {{(pid=121403) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 01 19:09:41.384129 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-b0b21d93-cf78-493c-89b5-f4df15bf3a3a tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:09:41.384780 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-b0b21d93-cf78-493c-89b5-f4df15bf3a3a tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] [instance: 43b22dd3-debb-4a6d-81fc-4666e5bb7804] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:09:41.403939 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b0b21d93-cf78-493c-89b5-f4df15bf3a3a tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:09:41.404433 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b0b21d93-cf78-493c-89b5-f4df15bf3a3a tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:09:41.404893 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b0b21d93-cf78-493c-89b5-f4df15bf3a3a tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:09:41.405588 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b0b21d93-cf78-493c-89b5-f4df15bf3a3a tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:09:41.406038 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b0b21d93-cf78-493c-89b5-f4df15bf3a3a tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:09:41.406452 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b0b21d93-cf78-493c-89b5-f4df15bf3a3a tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:09:41.447440 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.virt.hardware [None req-7b397048-91a0-464b-bb90-afe14d9b4c54 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Flavor limits 0:0:0 {{(pid=121403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 01 19:09:41.448538 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.virt.hardware [None req-7b397048-91a0-464b-bb90-afe14d9b4c54 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Image limits 0:0:0 {{(pid=121403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 01 19:09:41.449266 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.virt.hardware [None req-7b397048-91a0-464b-bb90-afe14d9b4c54 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Flavor pref 0:0:0 {{(pid=121403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 01 19:09:41.450871 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.virt.hardware [None req-7b397048-91a0-464b-bb90-afe14d9b4c54 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Image pref 0:0:0 {{(pid=121403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 01 19:09:41.451509 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.virt.hardware [None req-7b397048-91a0-464b-bb90-afe14d9b4c54 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 01 19:09:41.468167 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-7b397048-91a0-464b-bb90-afe14d9b4c54 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:09:41.471522 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-7b397048-91a0-464b-bb90-afe14d9b4c54 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:09:41.472341 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-7b397048-91a0-464b-bb90-afe14d9b4c54 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:09:41.477822 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-7b397048-91a0-464b-bb90-afe14d9b4c54 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:09:41.478650 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-7b397048-91a0-464b-bb90-afe14d9b4c54 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:09:41.479535 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-7b397048-91a0-464b-bb90-afe14d9b4c54 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:09:41.505387 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.quota [None req-7b397048-91a0-464b-bb90-afe14d9b4c54 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Getting quotas for project 04ef687c40bd45c297d22a791bae58cf. Resources: {'cores', 'ram', 'instances'} {{(pid=121403) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 01 19:09:41.511014 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.quota [None req-7b397048-91a0-464b-bb90-afe14d9b4c54 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Getting quotas for user 2868ccfdfb164cffa37232c821f205a8 and project 04ef687c40bd45c297d22a791bae58cf. Resources: {'cores', 'ram', 'instances'} {{(pid=121403) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 01 19:09:41.525853 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-7b397048-91a0-464b-bb90-afe14d9b4c54 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Going to run 1 instances... {{(pid=121403) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 01 19:09:41.539612 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-7b397048-91a0-464b-bb90-afe14d9b4c54 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] [instance: 42415fcc-ac00-4854-bc88-0416ef12d8cb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2d4a0047-1b9e-445f-8af8-1b5c9d93e881',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121403) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 01 19:09:41.638953 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-7b397048-91a0-464b-bb90-afe14d9b4c54 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.938445 Nov 01 19:09:41.645780 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1947/3779] 10.222.0.13 () {60 vars in 1147 bytes} [Tue Nov 1 19:09:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 940 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 01 19:09:41.649860 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-961306f0-99de-474d-8143-c4f7a68f60e4 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:09:41.650482 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-961306f0-99de-474d-8143-c4f7a68f60e4 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] [instance: cc8a30dd-b655-48d8-b4e2-d4911cb15513] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:09:41.662209 n-d-863052-2 devstack@n-api.service[121403]: DEBUG dbcounter [-] [121403] Writing DB stats nova_api:SELECT=91,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=7 {{(pid=121403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 19:09:41.664931 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-961306f0-99de-474d-8143-c4f7a68f60e4 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:09:41.665536 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-961306f0-99de-474d-8143-c4f7a68f60e4 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:09:41.666173 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-961306f0-99de-474d-8143-c4f7a68f60e4 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:09:41.667375 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-961306f0-99de-474d-8143-c4f7a68f60e4 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:09:41.670427 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-961306f0-99de-474d-8143-c4f7a68f60e4 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:09:41.670934 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-961306f0-99de-474d-8143-c4f7a68f60e4 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:09:41.869193 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-b0b21d93-cf78-493c-89b5-f4df15bf3a3a tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113bd8c844ee490b86a68bc7e1e75da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '851785a5f76548898a77d67792888504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:09:41.879065 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-b0b21d93-cf78-493c-89b5-f4df15bf3a3a tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] 10.222.0.13 "GET /compute/v2.1/servers/43b22dd3-debb-4a6d-81fc-4666e5bb7804" status: 200 len: 1511 microversion: 2.1 time: 0.499746 Nov 01 19:09:41.888995 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1833/3780] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:09:41 2022] GET /compute/v2.1/servers/43b22dd3-debb-4a6d-81fc-4666e5bb7804 => generated 1511 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:09:41.899398 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-6863f44d-980a-41b1-a0b8-3ab7f45c3d88 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:09:41.899398 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-6863f44d-980a-41b1-a0b8-3ab7f45c3d88 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] [instance: 42415fcc-ac00-4854-bc88-0416ef12d8cb] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:09:41.899398 n-d-863052-2 devstack@n-api.service[121402]: DEBUG dbcounter [-] [121402] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=121402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 19:09:41.995711 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-961306f0-99de-474d-8143-c4f7a68f60e4 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '058480d92c9b4ab4af6815d0438a65c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee9dc49b89143f781e4ab30296e4d01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:09:42.004133 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-961306f0-99de-474d-8143-c4f7a68f60e4 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] 10.222.0.13 "GET /compute/v2.1/servers/cc8a30dd-b655-48d8-b4e2-d4911cb15513" status: 200 len: 1512 microversion: 2.1 time: 0.363127 Nov 01 19:09:42.017202 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1948/3781] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:09:41 2022] GET /compute/v2.1/servers/cc8a30dd-b655-48d8-b4e2-d4911cb15513 => generated 1512 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:09:42.027900 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-6863f44d-980a-41b1-a0b8-3ab7f45c3d88 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2868ccfdfb164cffa37232c821f205a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04ef687c40bd45c297d22a791bae58cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:09:42.036516 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-6863f44d-980a-41b1-a0b8-3ab7f45c3d88 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] 10.222.0.13 "GET /compute/v2.1/servers/42415fcc-ac00-4854-bc88-0416ef12d8cb" status: 200 len: 1220 microversion: 2.1 time: 0.150860 Nov 01 19:09:42.037287 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1834/3782] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:09:41 2022] GET /compute/v2.1/servers/42415fcc-ac00-4854-bc88-0416ef12d8cb => generated 1220 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:09:42.040239 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-105e9931-e1fb-47d3-8d47-80bfa72c98da tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:09:42.041531 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-105e9931-e1fb-47d3-8d47-80bfa72c98da tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] [instance: eced579f-beea-4d3c-b2b8-8a6b31f7829b] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:09:42.061456 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-105e9931-e1fb-47d3-8d47-80bfa72c98da tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:09:42.065474 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-105e9931-e1fb-47d3-8d47-80bfa72c98da tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:09:42.067755 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-105e9931-e1fb-47d3-8d47-80bfa72c98da tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:09:42.069390 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-105e9931-e1fb-47d3-8d47-80bfa72c98da tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:09:42.070009 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-105e9931-e1fb-47d3-8d47-80bfa72c98da tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:09:42.070605 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-105e9931-e1fb-47d3-8d47-80bfa72c98da tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:09:42.209304 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-105e9931-e1fb-47d3-8d47-80bfa72c98da tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '790f3f1566b7464aaca19d4d05c0942e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33e3d319293c46b6af2f728a50586906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:09:42.224448 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-105e9931-e1fb-47d3-8d47-80bfa72c98da tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] 10.222.0.13 "GET /compute/v2.1/servers/eced579f-beea-4d3c-b2b8-8a6b31f7829b" status: 200 len: 1298 microversion: 2.1 time: 0.205635 Nov 01 19:09:42.225287 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1949/3783] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:09:42 2022] GET /compute/v2.1/servers/eced579f-beea-4d3c-b2b8-8a6b31f7829b => generated 1298 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:09:42.907064 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-93383ff0-4da0-490f-9927-ceacc281fa0e tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:09:42.908233 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-93383ff0-4da0-490f-9927-ceacc281fa0e tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] [instance: 43b22dd3-debb-4a6d-81fc-4666e5bb7804] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:09:42.923317 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-93383ff0-4da0-490f-9927-ceacc281fa0e tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:09:42.931370 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-93383ff0-4da0-490f-9927-ceacc281fa0e tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:09:42.932569 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-93383ff0-4da0-490f-9927-ceacc281fa0e tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:09:42.941621 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-93383ff0-4da0-490f-9927-ceacc281fa0e tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:09:42.942939 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-93383ff0-4da0-490f-9927-ceacc281fa0e tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:09:42.943554 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-93383ff0-4da0-490f-9927-ceacc281fa0e tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:09:43.039862 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-a4c7b64f-3294-47e4-a0d6-6b7fc4d01830 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:09:43.041949 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-a4c7b64f-3294-47e4-a0d6-6b7fc4d01830 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] [instance: cc8a30dd-b655-48d8-b4e2-d4911cb15513] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:09:43.052839 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-a4c7b64f-3294-47e4-a0d6-6b7fc4d01830 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:09:43.054573 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-a4c7b64f-3294-47e4-a0d6-6b7fc4d01830 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:09:43.055240 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-a4c7b64f-3294-47e4-a0d6-6b7fc4d01830 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:09:43.056192 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-a4c7b64f-3294-47e4-a0d6-6b7fc4d01830 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:09:43.056990 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-a4c7b64f-3294-47e4-a0d6-6b7fc4d01830 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:09:43.057687 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-a4c7b64f-3294-47e4-a0d6-6b7fc4d01830 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:09:43.294721 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-93383ff0-4da0-490f-9927-ceacc281fa0e tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113bd8c844ee490b86a68bc7e1e75da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '851785a5f76548898a77d67792888504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:09:43.304149 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-93383ff0-4da0-490f-9927-ceacc281fa0e tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] 10.222.0.13 "GET /compute/v2.1/servers/43b22dd3-debb-4a6d-81fc-4666e5bb7804" status: 200 len: 1511 microversion: 2.1 time: 0.401134 Nov 01 19:09:43.320332 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1835/3784] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:09:42 2022] GET /compute/v2.1/servers/43b22dd3-debb-4a6d-81fc-4666e5bb7804 => generated 1511 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:09:43.328663 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-73477100-f447-4a97-ad85-75ef89e82e1e tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:09:43.329491 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-73477100-f447-4a97-ad85-75ef89e82e1e tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] [instance: 42415fcc-ac00-4854-bc88-0416ef12d8cb] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:09:43.346690 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-73477100-f447-4a97-ad85-75ef89e82e1e tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:09:43.347203 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-73477100-f447-4a97-ad85-75ef89e82e1e tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:09:43.347647 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-73477100-f447-4a97-ad85-75ef89e82e1e tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:09:43.348920 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-73477100-f447-4a97-ad85-75ef89e82e1e tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:09:43.349384 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-73477100-f447-4a97-ad85-75ef89e82e1e tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:09:43.349831 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-73477100-f447-4a97-ad85-75ef89e82e1e tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:09:43.452041 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-73477100-f447-4a97-ad85-75ef89e82e1e tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2868ccfdfb164cffa37232c821f205a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04ef687c40bd45c297d22a791bae58cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:09:43.461874 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-73477100-f447-4a97-ad85-75ef89e82e1e tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] 10.222.0.13 "GET /compute/v2.1/servers/42415fcc-ac00-4854-bc88-0416ef12d8cb" status: 200 len: 1272 microversion: 2.1 time: 0.140186 Nov 01 19:09:43.476704 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1836/3785] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:09:43 2022] GET /compute/v2.1/servers/42415fcc-ac00-4854-bc88-0416ef12d8cb => generated 1272 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:09:43.499740 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-a9e0fa0d-e116-4c03-9f57-b5809c01efd3 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:09:43.500776 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-a9e0fa0d-e116-4c03-9f57-b5809c01efd3 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] [instance: eced579f-beea-4d3c-b2b8-8a6b31f7829b] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:09:43.515813 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-a9e0fa0d-e116-4c03-9f57-b5809c01efd3 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:09:43.516709 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-a9e0fa0d-e116-4c03-9f57-b5809c01efd3 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:09:43.518950 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-a4c7b64f-3294-47e4-a0d6-6b7fc4d01830 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '058480d92c9b4ab4af6815d0438a65c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee9dc49b89143f781e4ab30296e4d01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:09:43.519131 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-a9e0fa0d-e116-4c03-9f57-b5809c01efd3 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:09:43.519873 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-a9e0fa0d-e116-4c03-9f57-b5809c01efd3 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:09:43.520503 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-a9e0fa0d-e116-4c03-9f57-b5809c01efd3 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:09:43.521298 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-a9e0fa0d-e116-4c03-9f57-b5809c01efd3 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:09:43.527191 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-a4c7b64f-3294-47e4-a0d6-6b7fc4d01830 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] 10.222.0.13 "GET /compute/v2.1/servers/cc8a30dd-b655-48d8-b4e2-d4911cb15513" status: 200 len: 1512 microversion: 2.1 time: 0.493439 Nov 01 19:09:43.541696 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1950/3786] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:09:43 2022] GET /compute/v2.1/servers/cc8a30dd-b655-48d8-b4e2-d4911cb15513 => generated 1512 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:09:43.917194 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-a9e0fa0d-e116-4c03-9f57-b5809c01efd3 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '790f3f1566b7464aaca19d4d05c0942e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33e3d319293c46b6af2f728a50586906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:09:43.929522 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-a9e0fa0d-e116-4c03-9f57-b5809c01efd3 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] 10.222.0.13 "GET /compute/v2.1/servers/eced579f-beea-4d3c-b2b8-8a6b31f7829b" status: 200 len: 1365 microversion: 2.1 time: 0.465158 Nov 01 19:09:43.945645 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1837/3787] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:09:43 2022] GET /compute/v2.1/servers/eced579f-beea-4d3c-b2b8-8a6b31f7829b => generated 1365 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:09:44.332294 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-ee848f8e-c055-41bf-8c74-2162bcaf982c tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:09:44.333514 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-ee848f8e-c055-41bf-8c74-2162bcaf982c tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] [instance: 43b22dd3-debb-4a6d-81fc-4666e5bb7804] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:09:44.348703 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-ee848f8e-c055-41bf-8c74-2162bcaf982c tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:09:44.349198 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-ee848f8e-c055-41bf-8c74-2162bcaf982c tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:09:44.349632 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-ee848f8e-c055-41bf-8c74-2162bcaf982c tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:09:44.350332 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-ee848f8e-c055-41bf-8c74-2162bcaf982c tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:09:44.350782 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-ee848f8e-c055-41bf-8c74-2162bcaf982c tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:09:44.351203 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-ee848f8e-c055-41bf-8c74-2162bcaf982c tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:09:44.473286 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [req-2889c507-47d4-4274-bc14-7520e9448b6a req-e5cfb6b3-f77e-48bc-b914-374fec78c46b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eced579f-beea-4d3c-b2b8-8a6b31f7829b", "tag": "6c13aa9c-ab51-456c-9f28-6101db6d2168"}]} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:09:44.496802 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-2889c507-47d4-4274-bc14-7520e9448b6a req-e5cfb6b3-f77e-48bc-b914-374fec78c46b service nova] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:09:44.498100 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-2889c507-47d4-4274-bc14-7520e9448b6a req-e5cfb6b3-f77e-48bc-b914-374fec78c46b service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:09:44.500455 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-2889c507-47d4-4274-bc14-7520e9448b6a req-e5cfb6b3-f77e-48bc-b914-374fec78c46b service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:09:44.520459 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.compute.server_external_events [req-2889c507-47d4-4274-bc14-7520e9448b6a req-e5cfb6b3-f77e-48bc-b914-374fec78c46b service nova] Creating event network-changed:6c13aa9c-ab51-456c-9f28-6101db6d2168 for instance eced579f-beea-4d3c-b2b8-8a6b31f7829b on n-h2-863052-2 Nov 01 19:09:44.526316 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [req-2889c507-47d4-4274-bc14-7520e9448b6a req-e5cfb6b3-f77e-48bc-b914-374fec78c46b service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.243747 Nov 01 19:09:44.527320 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1951/3788] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Nov 1 19:09:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:09:44.532528 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-5e48b9b0-4eb7-4a3f-8dbb-f2dccdb9771b tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:09:44.533364 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-5e48b9b0-4eb7-4a3f-8dbb-f2dccdb9771b tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] [instance: 42415fcc-ac00-4854-bc88-0416ef12d8cb] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:09:44.540188 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-5e48b9b0-4eb7-4a3f-8dbb-f2dccdb9771b tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:09:44.540815 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-5e48b9b0-4eb7-4a3f-8dbb-f2dccdb9771b tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:09:44.541593 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-5e48b9b0-4eb7-4a3f-8dbb-f2dccdb9771b tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:09:44.553920 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-5e48b9b0-4eb7-4a3f-8dbb-f2dccdb9771b tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:09:44.554678 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-5e48b9b0-4eb7-4a3f-8dbb-f2dccdb9771b tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:09:44.555369 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-5e48b9b0-4eb7-4a3f-8dbb-f2dccdb9771b tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:09:44.567564 n-d-863052-2 devstack@n-api.service[121403]: DEBUG dbcounter [-] [121403] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 19:09:44.690654 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-5e48b9b0-4eb7-4a3f-8dbb-f2dccdb9771b tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2868ccfdfb164cffa37232c821f205a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04ef687c40bd45c297d22a791bae58cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:09:44.705906 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-5e48b9b0-4eb7-4a3f-8dbb-f2dccdb9771b tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] 10.222.0.13 "GET /compute/v2.1/servers/42415fcc-ac00-4854-bc88-0416ef12d8cb" status: 200 len: 1278 microversion: 2.1 time: 0.175831 Nov 01 19:09:44.706701 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1952/3789] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:09:44 2022] GET /compute/v2.1/servers/42415fcc-ac00-4854-bc88-0416ef12d8cb => generated 1278 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:09:44.726589 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-b582a426-b6a4-43ed-8a06-bd95f2ec2a29 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:09:44.727248 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-b582a426-b6a4-43ed-8a06-bd95f2ec2a29 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] [instance: cc8a30dd-b655-48d8-b4e2-d4911cb15513] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:09:44.735744 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-b582a426-b6a4-43ed-8a06-bd95f2ec2a29 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:09:44.736242 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-b582a426-b6a4-43ed-8a06-bd95f2ec2a29 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:09:44.736872 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-b582a426-b6a4-43ed-8a06-bd95f2ec2a29 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:09:44.739219 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-b582a426-b6a4-43ed-8a06-bd95f2ec2a29 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:09:44.739690 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-b582a426-b6a4-43ed-8a06-bd95f2ec2a29 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:09:44.740175 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-b582a426-b6a4-43ed-8a06-bd95f2ec2a29 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:09:44.768457 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-ee848f8e-c055-41bf-8c74-2162bcaf982c tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113bd8c844ee490b86a68bc7e1e75da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '851785a5f76548898a77d67792888504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:09:44.781092 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-ee848f8e-c055-41bf-8c74-2162bcaf982c tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] 10.222.0.13 "GET /compute/v2.1/servers/43b22dd3-debb-4a6d-81fc-4666e5bb7804" status: 200 len: 1511 microversion: 2.1 time: 0.452473 Nov 01 19:09:44.785301 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1838/3790] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:09:44 2022] GET /compute/v2.1/servers/43b22dd3-debb-4a6d-81fc-4666e5bb7804 => generated 1511 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 19:09:44.874216 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [req-f3bc8b7c-6160-4386-812b-077f0d55f330 req-e85a8ee1-0c74-4730-a6a3-9248c59d7c43 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ac19dd18-c22a-46de-91ef-454a0b78872f", "tag": "01134387-2119-4a51-a70d-487b57f4610e"}]} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:09:44.888235 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-f3bc8b7c-6160-4386-812b-077f0d55f330 req-e85a8ee1-0c74-4730-a6a3-9248c59d7c43 service nova] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:09:44.889074 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-f3bc8b7c-6160-4386-812b-077f0d55f330 req-e85a8ee1-0c74-4730-a6a3-9248c59d7c43 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:09:44.889732 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-f3bc8b7c-6160-4386-812b-077f0d55f330 req-e85a8ee1-0c74-4730-a6a3-9248c59d7c43 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:09:44.906010 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.compute.server_external_events [req-f3bc8b7c-6160-4386-812b-077f0d55f330 req-e85a8ee1-0c74-4730-a6a3-9248c59d7c43 service nova] Creating event network-changed:01134387-2119-4a51-a70d-487b57f4610e for instance ac19dd18-c22a-46de-91ef-454a0b78872f on n-h2-863052-2 Nov 01 19:09:44.912000 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [req-f3bc8b7c-6160-4386-812b-077f0d55f330 req-e85a8ee1-0c74-4730-a6a3-9248c59d7c43 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044405 Nov 01 19:09:44.912973 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1839/3791] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Nov 1 19:09:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 01 19:09:44.956668 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-d882ed4f-559a-4420-bfc5-343b249bb2c9 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:09:44.957613 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-d882ed4f-559a-4420-bfc5-343b249bb2c9 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] [instance: eced579f-beea-4d3c-b2b8-8a6b31f7829b] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:09:44.965548 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-d882ed4f-559a-4420-bfc5-343b249bb2c9 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:09:44.966298 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-d882ed4f-559a-4420-bfc5-343b249bb2c9 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:09:44.966731 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-d882ed4f-559a-4420-bfc5-343b249bb2c9 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:09:44.967770 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-d882ed4f-559a-4420-bfc5-343b249bb2c9 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:09:44.968228 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-d882ed4f-559a-4420-bfc5-343b249bb2c9 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:09:44.968926 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-d882ed4f-559a-4420-bfc5-343b249bb2c9 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:09:45.076926 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-b582a426-b6a4-43ed-8a06-bd95f2ec2a29 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '058480d92c9b4ab4af6815d0438a65c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee9dc49b89143f781e4ab30296e4d01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:09:45.090979 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-b582a426-b6a4-43ed-8a06-bd95f2ec2a29 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] 10.222.0.13 "GET /compute/v2.1/servers/cc8a30dd-b655-48d8-b4e2-d4911cb15513" status: 200 len: 1512 microversion: 2.1 time: 0.379908 Nov 01 19:09:45.092109 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1953/3792] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:09:44 2022] GET /compute/v2.1/servers/cc8a30dd-b655-48d8-b4e2-d4911cb15513 => generated 1512 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:09:45.272117 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-d882ed4f-559a-4420-bfc5-343b249bb2c9 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '790f3f1566b7464aaca19d4d05c0942e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33e3d319293c46b6af2f728a50586906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:09:45.284401 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-d882ed4f-559a-4420-bfc5-343b249bb2c9 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] 10.222.0.13 "GET /compute/v2.1/servers/eced579f-beea-4d3c-b2b8-8a6b31f7829b" status: 200 len: 1365 microversion: 2.1 time: 0.333867 Nov 01 19:09:45.285444 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1840/3793] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:09:44 2022] GET /compute/v2.1/servers/eced579f-beea-4d3c-b2b8-8a6b31f7829b => generated 1365 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 19:09:45.730214 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-80a095d1-1a8c-44d2-996f-01d59e52d481 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:09:45.730887 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-80a095d1-1a8c-44d2-996f-01d59e52d481 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] [instance: 42415fcc-ac00-4854-bc88-0416ef12d8cb] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:09:45.737660 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-80a095d1-1a8c-44d2-996f-01d59e52d481 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:09:45.738149 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-80a095d1-1a8c-44d2-996f-01d59e52d481 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:09:45.738596 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-80a095d1-1a8c-44d2-996f-01d59e52d481 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:09:45.739322 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-80a095d1-1a8c-44d2-996f-01d59e52d481 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:09:45.739777 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-80a095d1-1a8c-44d2-996f-01d59e52d481 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:09:45.740204 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-80a095d1-1a8c-44d2-996f-01d59e52d481 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:09:45.810789 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-bf643981-0539-4803-b64b-a8136aff318f tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:09:45.811651 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-bf643981-0539-4803-b64b-a8136aff318f tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] [instance: 43b22dd3-debb-4a6d-81fc-4666e5bb7804] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:09:45.818323 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-bf643981-0539-4803-b64b-a8136aff318f tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:09:45.818822 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-bf643981-0539-4803-b64b-a8136aff318f tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:09:45.819368 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-bf643981-0539-4803-b64b-a8136aff318f tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:09:45.820064 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-bf643981-0539-4803-b64b-a8136aff318f tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:09:45.820684 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-bf643981-0539-4803-b64b-a8136aff318f tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:09:45.821376 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-bf643981-0539-4803-b64b-a8136aff318f tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:09:45.996490 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-80a095d1-1a8c-44d2-996f-01d59e52d481 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2868ccfdfb164cffa37232c821f205a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04ef687c40bd45c297d22a791bae58cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:09:46.007821 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-80a095d1-1a8c-44d2-996f-01d59e52d481 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] 10.222.0.13 "GET /compute/v2.1/servers/42415fcc-ac00-4854-bc88-0416ef12d8cb" status: 200 len: 1320 microversion: 2.1 time: 0.281165 Nov 01 19:09:46.022708 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1954/3794] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:09:45 2022] GET /compute/v2.1/servers/42415fcc-ac00-4854-bc88-0416ef12d8cb => generated 1320 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:09:46.084557 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-bf643981-0539-4803-b64b-a8136aff318f tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113bd8c844ee490b86a68bc7e1e75da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '851785a5f76548898a77d67792888504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:09:46.096966 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-bf643981-0539-4803-b64b-a8136aff318f tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] 10.222.0.13 "GET /compute/v2.1/servers/43b22dd3-debb-4a6d-81fc-4666e5bb7804" status: 200 len: 1511 microversion: 2.1 time: 0.290153 Nov 01 19:09:46.097686 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1841/3795] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:09:45 2022] GET /compute/v2.1/servers/43b22dd3-debb-4a6d-81fc-4666e5bb7804 => generated 1511 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 19:09:46.115623 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-97cf14d1-25db-4ce7-83f6-032c768745a0 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:09:46.116712 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-97cf14d1-25db-4ce7-83f6-032c768745a0 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] [instance: cc8a30dd-b655-48d8-b4e2-d4911cb15513] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:09:46.123114 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-97cf14d1-25db-4ce7-83f6-032c768745a0 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:09:46.123913 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-97cf14d1-25db-4ce7-83f6-032c768745a0 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:09:46.124677 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-97cf14d1-25db-4ce7-83f6-032c768745a0 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:09:46.125699 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-97cf14d1-25db-4ce7-83f6-032c768745a0 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:09:46.126551 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-97cf14d1-25db-4ce7-83f6-032c768745a0 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:09:46.127205 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-97cf14d1-25db-4ce7-83f6-032c768745a0 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:09:46.314128 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-66b6d066-7b51-42ad-84bb-e7f277358bdb tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:09:46.315811 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-66b6d066-7b51-42ad-84bb-e7f277358bdb tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] [instance: eced579f-beea-4d3c-b2b8-8a6b31f7829b] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:09:46.339291 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-66b6d066-7b51-42ad-84bb-e7f277358bdb tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:09:46.340067 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-66b6d066-7b51-42ad-84bb-e7f277358bdb tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:09:46.340612 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-66b6d066-7b51-42ad-84bb-e7f277358bdb tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:09:46.342332 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-66b6d066-7b51-42ad-84bb-e7f277358bdb tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:09:46.342877 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-66b6d066-7b51-42ad-84bb-e7f277358bdb tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:09:46.343509 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-66b6d066-7b51-42ad-84bb-e7f277358bdb tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:09:46.522622 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-97cf14d1-25db-4ce7-83f6-032c768745a0 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '058480d92c9b4ab4af6815d0438a65c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee9dc49b89143f781e4ab30296e4d01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:09:46.542253 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-97cf14d1-25db-4ce7-83f6-032c768745a0 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] 10.222.0.13 "GET /compute/v2.1/servers/cc8a30dd-b655-48d8-b4e2-d4911cb15513" status: 200 len: 1512 microversion: 2.1 time: 0.430859 Nov 01 19:09:46.543203 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1955/3796] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:09:46 2022] GET /compute/v2.1/servers/cc8a30dd-b655-48d8-b4e2-d4911cb15513 => generated 1512 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:09:46.869979 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-66b6d066-7b51-42ad-84bb-e7f277358bdb tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '790f3f1566b7464aaca19d4d05c0942e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33e3d319293c46b6af2f728a50586906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:09:46.878946 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-66b6d066-7b51-42ad-84bb-e7f277358bdb tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] 10.222.0.13 "GET /compute/v2.1/servers/eced579f-beea-4d3c-b2b8-8a6b31f7829b" status: 200 len: 1365 microversion: 2.1 time: 0.573247 Nov 01 19:09:46.879771 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1842/3797] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:09:46 2022] GET /compute/v2.1/servers/eced579f-beea-4d3c-b2b8-8a6b31f7829b => generated 1365 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:09:46.941153 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [req-99000ae2-2411-4d58-80b1-d307ace65662 req-395f585b-43dd-47af-8721-4e99ad01e666 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "33dd79e0-eb7c-4f18-a61f-df8022667dd0", "tag": "b6f7cb22-5f30-4f8f-9e4c-e4d1e25035f0"}]} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:09:46.951340 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-99000ae2-2411-4d58-80b1-d307ace65662 req-395f585b-43dd-47af-8721-4e99ad01e666 service nova] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:09:46.951820 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-99000ae2-2411-4d58-80b1-d307ace65662 req-395f585b-43dd-47af-8721-4e99ad01e666 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:09:46.952254 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-99000ae2-2411-4d58-80b1-d307ace65662 req-395f585b-43dd-47af-8721-4e99ad01e666 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:09:46.963887 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.compute.server_external_events [req-99000ae2-2411-4d58-80b1-d307ace65662 req-395f585b-43dd-47af-8721-4e99ad01e666 service nova] Creating event network-changed:b6f7cb22-5f30-4f8f-9e4c-e4d1e25035f0 for instance 33dd79e0-eb7c-4f18-a61f-df8022667dd0 on n-h2-863052-2 Nov 01 19:09:46.969057 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [req-99000ae2-2411-4d58-80b1-d307ace65662 req-395f585b-43dd-47af-8721-4e99ad01e666 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031466 Nov 01 19:09:46.969662 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1956/3798] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Nov 1 19:09:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:09:47.017493 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [req-0e1a4218-c7ac-4c16-bd56-331742815bb2 req-515224c2-69dc-4c48-b76e-9ecdccfe5011 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "42415fcc-ac00-4854-bc88-0416ef12d8cb", "tag": "8ff40252-03e6-43f2-9f03-0b314534b983"}]} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:09:47.038564 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-0e1a4218-c7ac-4c16-bd56-331742815bb2 req-515224c2-69dc-4c48-b76e-9ecdccfe5011 service nova] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:09:47.038967 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-c57a9556-f1e2-4535-aef3-48db52ca9156 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:09:47.039531 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-0e1a4218-c7ac-4c16-bd56-331742815bb2 req-515224c2-69dc-4c48-b76e-9ecdccfe5011 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:09:47.039722 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-c57a9556-f1e2-4535-aef3-48db52ca9156 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] [instance: 42415fcc-ac00-4854-bc88-0416ef12d8cb] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:09:47.040293 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-0e1a4218-c7ac-4c16-bd56-331742815bb2 req-515224c2-69dc-4c48-b76e-9ecdccfe5011 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:09:47.054810 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-c57a9556-f1e2-4535-aef3-48db52ca9156 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:09:47.055302 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-c57a9556-f1e2-4535-aef3-48db52ca9156 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:09:47.055733 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-c57a9556-f1e2-4535-aef3-48db52ca9156 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:09:47.056206 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.compute.server_external_events [req-0e1a4218-c7ac-4c16-bd56-331742815bb2 req-515224c2-69dc-4c48-b76e-9ecdccfe5011 service nova] Creating event network-changed:8ff40252-03e6-43f2-9f03-0b314534b983 for instance 42415fcc-ac00-4854-bc88-0416ef12d8cb on n-h1-863052-2 Nov 01 19:09:47.056841 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-c57a9556-f1e2-4535-aef3-48db52ca9156 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:09:47.057497 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-c57a9556-f1e2-4535-aef3-48db52ca9156 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:09:47.058226 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-c57a9556-f1e2-4535-aef3-48db52ca9156 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:09:47.063307 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [req-0e1a4218-c7ac-4c16-bd56-331742815bb2 req-515224c2-69dc-4c48-b76e-9ecdccfe5011 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050272 Nov 01 19:09:47.065362 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1843/3799] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Nov 1 19:09:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:09:47.120362 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-ecb88eb1-d214-4fd2-bef5-cbdb320815c3 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:09:47.121164 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-ecb88eb1-d214-4fd2-bef5-cbdb320815c3 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] [instance: 43b22dd3-debb-4a6d-81fc-4666e5bb7804] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:09:47.127867 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-ecb88eb1-d214-4fd2-bef5-cbdb320815c3 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:09:47.128522 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-ecb88eb1-d214-4fd2-bef5-cbdb320815c3 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:09:47.130277 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-ecb88eb1-d214-4fd2-bef5-cbdb320815c3 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:09:47.131161 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-ecb88eb1-d214-4fd2-bef5-cbdb320815c3 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:09:47.131624 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-ecb88eb1-d214-4fd2-bef5-cbdb320815c3 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:09:47.132108 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-ecb88eb1-d214-4fd2-bef5-cbdb320815c3 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:09:47.221229 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-c57a9556-f1e2-4535-aef3-48db52ca9156 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2868ccfdfb164cffa37232c821f205a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04ef687c40bd45c297d22a791bae58cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:09:47.229176 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-c57a9556-f1e2-4535-aef3-48db52ca9156 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] 10.222.0.13 "GET /compute/v2.1/servers/42415fcc-ac00-4854-bc88-0416ef12d8cb" status: 200 len: 1320 microversion: 2.1 time: 0.197138 Nov 01 19:09:47.229755 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1957/3800] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:09:47 2022] GET /compute/v2.1/servers/42415fcc-ac00-4854-bc88-0416ef12d8cb => generated 1320 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:09:47.351103 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-ecb88eb1-d214-4fd2-bef5-cbdb320815c3 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113bd8c844ee490b86a68bc7e1e75da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '851785a5f76548898a77d67792888504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:09:47.362809 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-ecb88eb1-d214-4fd2-bef5-cbdb320815c3 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] 10.222.0.13 "GET /compute/v2.1/servers/43b22dd3-debb-4a6d-81fc-4666e5bb7804" status: 200 len: 1511 microversion: 2.1 time: 0.246884 Nov 01 19:09:47.364399 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1844/3801] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:09:47 2022] GET /compute/v2.1/servers/43b22dd3-debb-4a6d-81fc-4666e5bb7804 => generated 1511 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 19:09:47.568399 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-d808c46f-dcb6-491c-91d9-ecb1b7ee49ea tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:09:47.569129 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-d808c46f-dcb6-491c-91d9-ecb1b7ee49ea tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] [instance: cc8a30dd-b655-48d8-b4e2-d4911cb15513] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:09:47.577151 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d808c46f-dcb6-491c-91d9-ecb1b7ee49ea tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:09:47.577959 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d808c46f-dcb6-491c-91d9-ecb1b7ee49ea tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:09:47.578605 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d808c46f-dcb6-491c-91d9-ecb1b7ee49ea tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:09:47.579560 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d808c46f-dcb6-491c-91d9-ecb1b7ee49ea tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:09:47.580236 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d808c46f-dcb6-491c-91d9-ecb1b7ee49ea tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:09:47.580899 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d808c46f-dcb6-491c-91d9-ecb1b7ee49ea tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:09:47.904914 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-26b19dd4-206a-4f0e-bc29-a37eee3e2d18 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:09:47.905622 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-26b19dd4-206a-4f0e-bc29-a37eee3e2d18 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] [instance: eced579f-beea-4d3c-b2b8-8a6b31f7829b] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:09:47.912605 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-26b19dd4-206a-4f0e-bc29-a37eee3e2d18 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:09:47.913138 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-26b19dd4-206a-4f0e-bc29-a37eee3e2d18 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:09:47.913581 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-26b19dd4-206a-4f0e-bc29-a37eee3e2d18 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:09:47.914409 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-26b19dd4-206a-4f0e-bc29-a37eee3e2d18 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:09:47.914896 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-26b19dd4-206a-4f0e-bc29-a37eee3e2d18 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:09:47.915302 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-26b19dd4-206a-4f0e-bc29-a37eee3e2d18 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:09:47.928602 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-d808c46f-dcb6-491c-91d9-ecb1b7ee49ea tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '058480d92c9b4ab4af6815d0438a65c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee9dc49b89143f781e4ab30296e4d01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:09:47.937154 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-d808c46f-dcb6-491c-91d9-ecb1b7ee49ea tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] 10.222.0.13 "GET /compute/v2.1/servers/cc8a30dd-b655-48d8-b4e2-d4911cb15513" status: 200 len: 1512 microversion: 2.1 time: 0.372861 Nov 01 19:09:47.939178 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1958/3802] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:09:47 2022] GET /compute/v2.1/servers/cc8a30dd-b655-48d8-b4e2-d4911cb15513 => generated 1512 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:09:48.067121 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-26b19dd4-206a-4f0e-bc29-a37eee3e2d18 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '790f3f1566b7464aaca19d4d05c0942e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33e3d319293c46b6af2f728a50586906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:09:48.075742 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-26b19dd4-206a-4f0e-bc29-a37eee3e2d18 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] 10.222.0.13 "GET /compute/v2.1/servers/eced579f-beea-4d3c-b2b8-8a6b31f7829b" status: 200 len: 1365 microversion: 2.1 time: 0.176440 Nov 01 19:09:48.077683 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1845/3803] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:09:47 2022] GET /compute/v2.1/servers/eced579f-beea-4d3c-b2b8-8a6b31f7829b => generated 1365 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 19:09:48.252412 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-bed9a368-a9aa-499d-bd20-88c95950e4ae tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:09:48.253048 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-bed9a368-a9aa-499d-bd20-88c95950e4ae tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] [instance: 42415fcc-ac00-4854-bc88-0416ef12d8cb] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:09:48.261888 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-bed9a368-a9aa-499d-bd20-88c95950e4ae tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:09:48.262383 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-bed9a368-a9aa-499d-bd20-88c95950e4ae tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:09:48.262817 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-bed9a368-a9aa-499d-bd20-88c95950e4ae tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:09:48.263520 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-bed9a368-a9aa-499d-bd20-88c95950e4ae tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:09:48.263968 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-bed9a368-a9aa-499d-bd20-88c95950e4ae tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:09:48.264392 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-bed9a368-a9aa-499d-bd20-88c95950e4ae tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:09:48.393055 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-2cf6ec70-e81d-48d0-b19e-35a0fa5b3cca tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:09:48.396075 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-2cf6ec70-e81d-48d0-b19e-35a0fa5b3cca tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] [instance: 43b22dd3-debb-4a6d-81fc-4666e5bb7804] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:09:48.407895 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2cf6ec70-e81d-48d0-b19e-35a0fa5b3cca tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:09:48.409236 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2cf6ec70-e81d-48d0-b19e-35a0fa5b3cca tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:09:48.410067 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2cf6ec70-e81d-48d0-b19e-35a0fa5b3cca tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:09:48.411995 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2cf6ec70-e81d-48d0-b19e-35a0fa5b3cca tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:09:48.413303 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2cf6ec70-e81d-48d0-b19e-35a0fa5b3cca tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:09:48.414288 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2cf6ec70-e81d-48d0-b19e-35a0fa5b3cca tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:09:48.414813 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-bed9a368-a9aa-499d-bd20-88c95950e4ae tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2868ccfdfb164cffa37232c821f205a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04ef687c40bd45c297d22a791bae58cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:09:48.422662 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-bed9a368-a9aa-499d-bd20-88c95950e4ae tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] 10.222.0.13 "GET /compute/v2.1/servers/42415fcc-ac00-4854-bc88-0416ef12d8cb" status: 200 len: 1320 microversion: 2.1 time: 0.174448 Nov 01 19:09:48.437806 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1959/3804] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:09:48 2022] GET /compute/v2.1/servers/42415fcc-ac00-4854-bc88-0416ef12d8cb => generated 1320 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:09:48.571607 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-2cf6ec70-e81d-48d0-b19e-35a0fa5b3cca tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113bd8c844ee490b86a68bc7e1e75da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '851785a5f76548898a77d67792888504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:09:48.580884 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-2cf6ec70-e81d-48d0-b19e-35a0fa5b3cca tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] 10.222.0.13 "GET /compute/v2.1/servers/43b22dd3-debb-4a6d-81fc-4666e5bb7804" status: 200 len: 1511 microversion: 2.1 time: 0.196924 Nov 01 19:09:48.581574 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1846/3805] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:09:48 2022] GET /compute/v2.1/servers/43b22dd3-debb-4a6d-81fc-4666e5bb7804 => generated 1511 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:09:48.963342 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-191e9756-deb3-4821-a308-c65e5e5297a4 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:09:48.964026 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-191e9756-deb3-4821-a308-c65e5e5297a4 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] [instance: cc8a30dd-b655-48d8-b4e2-d4911cb15513] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:09:48.970479 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-191e9756-deb3-4821-a308-c65e5e5297a4 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:09:48.970958 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-191e9756-deb3-4821-a308-c65e5e5297a4 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:09:48.971488 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-191e9756-deb3-4821-a308-c65e5e5297a4 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:09:48.972429 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-191e9756-deb3-4821-a308-c65e5e5297a4 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:09:48.973001 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-191e9756-deb3-4821-a308-c65e5e5297a4 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:09:48.973519 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-191e9756-deb3-4821-a308-c65e5e5297a4 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:09:49.102818 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-31f07d4b-ba51-43f6-ac8f-ba124849143a tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:09:49.104047 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-31f07d4b-ba51-43f6-ac8f-ba124849143a tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] [instance: eced579f-beea-4d3c-b2b8-8a6b31f7829b] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:09:49.115478 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-31f07d4b-ba51-43f6-ac8f-ba124849143a tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:09:49.116426 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-31f07d4b-ba51-43f6-ac8f-ba124849143a tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:09:49.117111 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-31f07d4b-ba51-43f6-ac8f-ba124849143a tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:09:49.118232 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-31f07d4b-ba51-43f6-ac8f-ba124849143a tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:09:49.118796 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-31f07d4b-ba51-43f6-ac8f-ba124849143a tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:09:49.119322 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-31f07d4b-ba51-43f6-ac8f-ba124849143a tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:09:49.126275 n-d-863052-2 devstack@n-api.service[121402]: DEBUG dbcounter [-] [121402] Writing DB stats nova_cell1:SELECT=100 {{(pid=121402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 19:09:49.333738 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-191e9756-deb3-4821-a308-c65e5e5297a4 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '058480d92c9b4ab4af6815d0438a65c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee9dc49b89143f781e4ab30296e4d01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:09:49.349011 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-191e9756-deb3-4821-a308-c65e5e5297a4 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] 10.222.0.13 "GET /compute/v2.1/servers/cc8a30dd-b655-48d8-b4e2-d4911cb15513" status: 200 len: 1512 microversion: 2.1 time: 0.388714 Nov 01 19:09:49.350330 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1960/3806] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:09:48 2022] GET /compute/v2.1/servers/cc8a30dd-b655-48d8-b4e2-d4911cb15513 => generated 1512 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:09:49.388978 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-31f07d4b-ba51-43f6-ac8f-ba124849143a tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '790f3f1566b7464aaca19d4d05c0942e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33e3d319293c46b6af2f728a50586906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:09:49.402831 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-31f07d4b-ba51-43f6-ac8f-ba124849143a tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] 10.222.0.13 "GET /compute/v2.1/servers/eced579f-beea-4d3c-b2b8-8a6b31f7829b" status: 200 len: 1365 microversion: 2.1 time: 0.304559 Nov 01 19:09:49.416349 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1847/3807] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:09:49 2022] GET /compute/v2.1/servers/eced579f-beea-4d3c-b2b8-8a6b31f7829b => generated 1365 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 19:09:49.447621 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-a96f82ac-a2a0-4406-9567-18fc20b7dd40 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:09:49.448266 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-a96f82ac-a2a0-4406-9567-18fc20b7dd40 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] [instance: 42415fcc-ac00-4854-bc88-0416ef12d8cb] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:09:49.457910 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-a96f82ac-a2a0-4406-9567-18fc20b7dd40 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:09:49.458407 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-a96f82ac-a2a0-4406-9567-18fc20b7dd40 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:09:49.458856 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-a96f82ac-a2a0-4406-9567-18fc20b7dd40 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:09:49.459579 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-a96f82ac-a2a0-4406-9567-18fc20b7dd40 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:09:49.462769 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-a96f82ac-a2a0-4406-9567-18fc20b7dd40 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:09:49.463258 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-a96f82ac-a2a0-4406-9567-18fc20b7dd40 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:09:49.606344 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-b1f8f3e5-7909-46d6-a504-17b69462e144 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:09:49.607226 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-b1f8f3e5-7909-46d6-a504-17b69462e144 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] [instance: 43b22dd3-debb-4a6d-81fc-4666e5bb7804] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:09:49.614300 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b1f8f3e5-7909-46d6-a504-17b69462e144 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:09:49.615562 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b1f8f3e5-7909-46d6-a504-17b69462e144 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:09:49.616296 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b1f8f3e5-7909-46d6-a504-17b69462e144 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:09:49.618317 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b1f8f3e5-7909-46d6-a504-17b69462e144 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:09:49.618896 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b1f8f3e5-7909-46d6-a504-17b69462e144 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:09:49.620176 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b1f8f3e5-7909-46d6-a504-17b69462e144 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:09:49.691094 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-a96f82ac-a2a0-4406-9567-18fc20b7dd40 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2868ccfdfb164cffa37232c821f205a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04ef687c40bd45c297d22a791bae58cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:09:49.704601 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-a96f82ac-a2a0-4406-9567-18fc20b7dd40 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] 10.222.0.13 "GET /compute/v2.1/servers/42415fcc-ac00-4854-bc88-0416ef12d8cb" status: 200 len: 1320 microversion: 2.1 time: 0.260740 Nov 01 19:09:49.705781 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1961/3808] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:09:49 2022] GET /compute/v2.1/servers/42415fcc-ac00-4854-bc88-0416ef12d8cb => generated 1320 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:09:49.771076 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-b1f8f3e5-7909-46d6-a504-17b69462e144 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113bd8c844ee490b86a68bc7e1e75da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '851785a5f76548898a77d67792888504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:09:49.780527 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-b1f8f3e5-7909-46d6-a504-17b69462e144 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] 10.222.0.13 "GET /compute/v2.1/servers/43b22dd3-debb-4a6d-81fc-4666e5bb7804" status: 200 len: 1511 microversion: 2.1 time: 0.179333 Nov 01 19:09:49.781625 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1848/3809] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:09:49 2022] GET /compute/v2.1/servers/43b22dd3-debb-4a6d-81fc-4666e5bb7804 => generated 1511 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 19:09:50.374728 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-5e4605c9-427c-473e-9ad5-b7f83f7d00d4 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:09:50.376668 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-5e4605c9-427c-473e-9ad5-b7f83f7d00d4 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] [instance: cc8a30dd-b655-48d8-b4e2-d4911cb15513] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:09:50.389038 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-5e4605c9-427c-473e-9ad5-b7f83f7d00d4 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:09:50.389607 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-5e4605c9-427c-473e-9ad5-b7f83f7d00d4 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:09:50.390166 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-5e4605c9-427c-473e-9ad5-b7f83f7d00d4 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:09:50.390860 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-5e4605c9-427c-473e-9ad5-b7f83f7d00d4 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:09:50.391533 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-5e4605c9-427c-473e-9ad5-b7f83f7d00d4 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:09:50.392318 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-5e4605c9-427c-473e-9ad5-b7f83f7d00d4 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:09:50.430425 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-57450225-25ab-45d3-9f2b-cd25fbddb8e1 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:09:50.432964 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-57450225-25ab-45d3-9f2b-cd25fbddb8e1 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] [instance: eced579f-beea-4d3c-b2b8-8a6b31f7829b] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:09:50.445828 n-d-863052-2 devstack@n-api.service[121402]: DEBUG dbcounter [-] [121402] Writing DB stats nova_cell0:SELECT=4 {{(pid=121402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 19:09:50.450037 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-57450225-25ab-45d3-9f2b-cd25fbddb8e1 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:09:50.451078 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-57450225-25ab-45d3-9f2b-cd25fbddb8e1 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:09:50.451959 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-57450225-25ab-45d3-9f2b-cd25fbddb8e1 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:09:50.460962 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-57450225-25ab-45d3-9f2b-cd25fbddb8e1 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:09:50.461626 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-57450225-25ab-45d3-9f2b-cd25fbddb8e1 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:09:50.462283 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-57450225-25ab-45d3-9f2b-cd25fbddb8e1 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:09:50.535570 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-5e4605c9-427c-473e-9ad5-b7f83f7d00d4 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '058480d92c9b4ab4af6815d0438a65c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee9dc49b89143f781e4ab30296e4d01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:09:50.544329 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-5e4605c9-427c-473e-9ad5-b7f83f7d00d4 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] 10.222.0.13 "GET /compute/v2.1/servers/cc8a30dd-b655-48d8-b4e2-d4911cb15513" status: 200 len: 1512 microversion: 2.1 time: 0.174446 Nov 01 19:09:50.545221 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1962/3810] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:09:50 2022] GET /compute/v2.1/servers/cc8a30dd-b655-48d8-b4e2-d4911cb15513 => generated 1512 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:09:50.623870 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-57450225-25ab-45d3-9f2b-cd25fbddb8e1 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '790f3f1566b7464aaca19d4d05c0942e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33e3d319293c46b6af2f728a50586906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:09:50.633369 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-57450225-25ab-45d3-9f2b-cd25fbddb8e1 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] 10.222.0.13 "GET /compute/v2.1/servers/eced579f-beea-4d3c-b2b8-8a6b31f7829b" status: 200 len: 1365 microversion: 2.1 time: 0.209630 Nov 01 19:09:50.634270 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1849/3811] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:09:50 2022] GET /compute/v2.1/servers/eced579f-beea-4d3c-b2b8-8a6b31f7829b => generated 1365 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 19:09:50.730290 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-ec244c45-2226-47f7-ab13-f5933974a08f tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:09:50.730895 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-ec244c45-2226-47f7-ab13-f5933974a08f tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] [instance: 42415fcc-ac00-4854-bc88-0416ef12d8cb] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:09:50.737237 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-ec244c45-2226-47f7-ab13-f5933974a08f tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:09:50.737926 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-ec244c45-2226-47f7-ab13-f5933974a08f tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:09:50.739014 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-ec244c45-2226-47f7-ab13-f5933974a08f tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:09:50.739953 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-ec244c45-2226-47f7-ab13-f5933974a08f tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:09:50.740598 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-ec244c45-2226-47f7-ab13-f5933974a08f tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:09:50.741085 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-ec244c45-2226-47f7-ab13-f5933974a08f tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:09:50.808363 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-910e9ac7-bce6-4a75-b3d1-90f2e998a883 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:09:50.810734 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-910e9ac7-bce6-4a75-b3d1-90f2e998a883 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] [instance: 43b22dd3-debb-4a6d-81fc-4666e5bb7804] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:09:50.822398 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-910e9ac7-bce6-4a75-b3d1-90f2e998a883 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:09:50.824109 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-910e9ac7-bce6-4a75-b3d1-90f2e998a883 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:09:50.824844 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-910e9ac7-bce6-4a75-b3d1-90f2e998a883 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:09:50.825802 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-910e9ac7-bce6-4a75-b3d1-90f2e998a883 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:09:50.827327 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-910e9ac7-bce6-4a75-b3d1-90f2e998a883 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:09:50.827979 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-910e9ac7-bce6-4a75-b3d1-90f2e998a883 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:09:50.899310 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-ec244c45-2226-47f7-ab13-f5933974a08f tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2868ccfdfb164cffa37232c821f205a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04ef687c40bd45c297d22a791bae58cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:09:50.906991 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-ec244c45-2226-47f7-ab13-f5933974a08f tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] 10.222.0.13 "GET /compute/v2.1/servers/42415fcc-ac00-4854-bc88-0416ef12d8cb" status: 200 len: 1320 microversion: 2.1 time: 0.180446 Nov 01 19:09:50.907578 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1963/3812] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:09:50 2022] GET /compute/v2.1/servers/42415fcc-ac00-4854-bc88-0416ef12d8cb => generated 1320 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:09:50.982995 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-910e9ac7-bce6-4a75-b3d1-90f2e998a883 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113bd8c844ee490b86a68bc7e1e75da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '851785a5f76548898a77d67792888504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:09:50.991691 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-910e9ac7-bce6-4a75-b3d1-90f2e998a883 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] 10.222.0.13 "GET /compute/v2.1/servers/43b22dd3-debb-4a6d-81fc-4666e5bb7804" status: 200 len: 1511 microversion: 2.1 time: 0.190650 Nov 01 19:09:50.992253 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1850/3813] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:09:50 2022] GET /compute/v2.1/servers/43b22dd3-debb-4a6d-81fc-4666e5bb7804 => generated 1511 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 19:09:51.050793 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [req-1f529c40-3ec5-4199-a89c-4973f7439807 req-7dd91518-7eca-4183-a779-c471ff917fd6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eced579f-beea-4d3c-b2b8-8a6b31f7829b", "name": "network-vif-plugged", "status": "completed", "tag": "6c13aa9c-ab51-456c-9f28-6101db6d2168"}]} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:09:51.062745 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-1f529c40-3ec5-4199-a89c-4973f7439807 req-7dd91518-7eca-4183-a779-c471ff917fd6 service nova] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:09:51.063426 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-1f529c40-3ec5-4199-a89c-4973f7439807 req-7dd91518-7eca-4183-a779-c471ff917fd6 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:09:51.063932 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-1f529c40-3ec5-4199-a89c-4973f7439807 req-7dd91518-7eca-4183-a779-c471ff917fd6 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:09:51.075825 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.compute.server_external_events [req-1f529c40-3ec5-4199-a89c-4973f7439807 req-7dd91518-7eca-4183-a779-c471ff917fd6 service nova] Creating event network-vif-plugged:6c13aa9c-ab51-456c-9f28-6101db6d2168 for instance eced579f-beea-4d3c-b2b8-8a6b31f7829b on n-h2-863052-2 Nov 01 19:09:51.080938 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [req-1f529c40-3ec5-4199-a89c-4973f7439807 req-7dd91518-7eca-4183-a779-c471ff917fd6 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034105 Nov 01 19:09:51.081527 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1964/3814] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Nov 1 19:09:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:09:51.571038 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-d08ebbff-9487-4f30-99c0-5b64eec60cc7 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:09:51.571790 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-d08ebbff-9487-4f30-99c0-5b64eec60cc7 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] [instance: cc8a30dd-b655-48d8-b4e2-d4911cb15513] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:09:51.578915 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-d08ebbff-9487-4f30-99c0-5b64eec60cc7 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:09:51.579475 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-d08ebbff-9487-4f30-99c0-5b64eec60cc7 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:09:51.579980 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-d08ebbff-9487-4f30-99c0-5b64eec60cc7 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:09:51.580883 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-d08ebbff-9487-4f30-99c0-5b64eec60cc7 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:09:51.581347 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-d08ebbff-9487-4f30-99c0-5b64eec60cc7 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:09:51.581772 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-d08ebbff-9487-4f30-99c0-5b64eec60cc7 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:09:51.657826 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-d32e2383-80bb-457a-a3bc-c2ce6889a47a tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:09:51.658605 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-d32e2383-80bb-457a-a3bc-c2ce6889a47a tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] [instance: eced579f-beea-4d3c-b2b8-8a6b31f7829b] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:09:51.664698 n-d-863052-2 devstack@n-api.service[121403]: DEBUG dbcounter [-] [121403] Writing DB stats nova_cell0:SELECT=6 {{(pid=121403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 19:09:51.665525 n-d-863052-2 devstack@n-api.service[121403]: DEBUG dbcounter [-] [121403] Writing DB stats nova_cell0:SELECT=16 {{(pid=121403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 19:09:51.667528 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d32e2383-80bb-457a-a3bc-c2ce6889a47a tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:09:51.668041 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d32e2383-80bb-457a-a3bc-c2ce6889a47a tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:09:51.668442 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d32e2383-80bb-457a-a3bc-c2ce6889a47a tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:09:51.669570 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d32e2383-80bb-457a-a3bc-c2ce6889a47a tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:09:51.670024 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d32e2383-80bb-457a-a3bc-c2ce6889a47a tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:09:51.670444 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d32e2383-80bb-457a-a3bc-c2ce6889a47a tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:09:51.724859 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-d08ebbff-9487-4f30-99c0-5b64eec60cc7 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '058480d92c9b4ab4af6815d0438a65c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee9dc49b89143f781e4ab30296e4d01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:09:51.735892 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-d08ebbff-9487-4f30-99c0-5b64eec60cc7 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] 10.222.0.13 "GET /compute/v2.1/servers/cc8a30dd-b655-48d8-b4e2-d4911cb15513" status: 200 len: 1512 microversion: 2.1 time: 0.171596 Nov 01 19:09:51.736408 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1851/3815] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:09:51 2022] GET /compute/v2.1/servers/cc8a30dd-b655-48d8-b4e2-d4911cb15513 => generated 1512 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:09:51.809332 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-d32e2383-80bb-457a-a3bc-c2ce6889a47a tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '790f3f1566b7464aaca19d4d05c0942e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33e3d319293c46b6af2f728a50586906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:09:51.817932 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-d32e2383-80bb-457a-a3bc-c2ce6889a47a tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] 10.222.0.13 "GET /compute/v2.1/servers/eced579f-beea-4d3c-b2b8-8a6b31f7829b" status: 200 len: 1365 microversion: 2.1 time: 0.164266 Nov 01 19:09:51.818510 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1965/3816] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:09:51 2022] GET /compute/v2.1/servers/eced579f-beea-4d3c-b2b8-8a6b31f7829b => generated 1365 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 19:09:51.931110 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-135a622b-2d6b-450a-9738-0c2f0aafd830 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:09:51.931721 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-135a622b-2d6b-450a-9738-0c2f0aafd830 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] [instance: 42415fcc-ac00-4854-bc88-0416ef12d8cb] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:09:51.938779 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-135a622b-2d6b-450a-9738-0c2f0aafd830 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:09:51.939270 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-135a622b-2d6b-450a-9738-0c2f0aafd830 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:09:51.939708 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-135a622b-2d6b-450a-9738-0c2f0aafd830 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:09:51.940402 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-135a622b-2d6b-450a-9738-0c2f0aafd830 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:09:51.940880 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-135a622b-2d6b-450a-9738-0c2f0aafd830 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:09:51.941306 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-135a622b-2d6b-450a-9738-0c2f0aafd830 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:09:52.016431 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-08a18180-fa68-4e64-a441-d99875480319 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:09:52.017381 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-08a18180-fa68-4e64-a441-d99875480319 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] [instance: 43b22dd3-debb-4a6d-81fc-4666e5bb7804] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:09:52.024306 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-08a18180-fa68-4e64-a441-d99875480319 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:09:52.024826 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-08a18180-fa68-4e64-a441-d99875480319 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:09:52.025608 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-08a18180-fa68-4e64-a441-d99875480319 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:09:52.026463 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-08a18180-fa68-4e64-a441-d99875480319 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:09:52.027183 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-08a18180-fa68-4e64-a441-d99875480319 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:09:52.027808 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-08a18180-fa68-4e64-a441-d99875480319 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:09:52.034148 n-d-863052-2 devstack@n-api.service[121402]: DEBUG dbcounter [-] [121402] Writing DB stats nova_cell0:SELECT=16 {{(pid=121402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 19:09:52.083978 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-135a622b-2d6b-450a-9738-0c2f0aafd830 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2868ccfdfb164cffa37232c821f205a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04ef687c40bd45c297d22a791bae58cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:09:52.093902 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-135a622b-2d6b-450a-9738-0c2f0aafd830 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] 10.222.0.13 "GET /compute/v2.1/servers/42415fcc-ac00-4854-bc88-0416ef12d8cb" status: 200 len: 1320 microversion: 2.1 time: 0.166483 Nov 01 19:09:52.095883 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1852/3817] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:09:51 2022] GET /compute/v2.1/servers/42415fcc-ac00-4854-bc88-0416ef12d8cb => generated 1320 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 19:09:52.182360 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-08a18180-fa68-4e64-a441-d99875480319 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113bd8c844ee490b86a68bc7e1e75da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '851785a5f76548898a77d67792888504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:09:52.190839 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-08a18180-fa68-4e64-a441-d99875480319 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] 10.222.0.13 "GET /compute/v2.1/servers/43b22dd3-debb-4a6d-81fc-4666e5bb7804" status: 200 len: 1511 microversion: 2.1 time: 0.179398 Nov 01 19:09:52.192390 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1966/3818] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:09:52 2022] GET /compute/v2.1/servers/43b22dd3-debb-4a6d-81fc-4666e5bb7804 => generated 1511 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:09:52.759486 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-a1875364-ceef-4463-a358-f1cd3b00d9d3 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:09:52.760081 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-a1875364-ceef-4463-a358-f1cd3b00d9d3 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] [instance: cc8a30dd-b655-48d8-b4e2-d4911cb15513] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:09:52.767537 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-a1875364-ceef-4463-a358-f1cd3b00d9d3 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:09:52.768353 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-a1875364-ceef-4463-a358-f1cd3b00d9d3 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:09:52.769217 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-a1875364-ceef-4463-a358-f1cd3b00d9d3 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:09:52.770145 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-a1875364-ceef-4463-a358-f1cd3b00d9d3 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:09:52.772073 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-a1875364-ceef-4463-a358-f1cd3b00d9d3 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:09:52.772723 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-a1875364-ceef-4463-a358-f1cd3b00d9d3 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:09:52.841559 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-3e459865-5d77-4b60-be3d-6b5a3b01d328 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:09:52.842708 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-3e459865-5d77-4b60-be3d-6b5a3b01d328 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] [instance: eced579f-beea-4d3c-b2b8-8a6b31f7829b] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:09:52.849772 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-3e459865-5d77-4b60-be3d-6b5a3b01d328 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:09:52.850462 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-3e459865-5d77-4b60-be3d-6b5a3b01d328 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:09:52.851082 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-3e459865-5d77-4b60-be3d-6b5a3b01d328 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:09:52.851959 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-3e459865-5d77-4b60-be3d-6b5a3b01d328 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:09:52.852565 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-3e459865-5d77-4b60-be3d-6b5a3b01d328 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:09:52.853171 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-3e459865-5d77-4b60-be3d-6b5a3b01d328 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:09:52.927253 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-a1875364-ceef-4463-a358-f1cd3b00d9d3 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '058480d92c9b4ab4af6815d0438a65c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee9dc49b89143f781e4ab30296e4d01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:09:52.936531 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-a1875364-ceef-4463-a358-f1cd3b00d9d3 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] 10.222.0.13 "GET /compute/v2.1/servers/cc8a30dd-b655-48d8-b4e2-d4911cb15513" status: 200 len: 1512 microversion: 2.1 time: 0.180635 Nov 01 19:09:52.944632 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1853/3819] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:09:52 2022] GET /compute/v2.1/servers/cc8a30dd-b655-48d8-b4e2-d4911cb15513 => generated 1512 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:09:53.000222 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-3e459865-5d77-4b60-be3d-6b5a3b01d328 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '790f3f1566b7464aaca19d4d05c0942e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33e3d319293c46b6af2f728a50586906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:09:53.011500 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-3e459865-5d77-4b60-be3d-6b5a3b01d328 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] 10.222.0.13 "GET /compute/v2.1/servers/eced579f-beea-4d3c-b2b8-8a6b31f7829b" status: 200 len: 1555 microversion: 2.1 time: 0.174257 Nov 01 19:09:53.012073 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1967/3820] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:09:52 2022] GET /compute/v2.1/servers/eced579f-beea-4d3c-b2b8-8a6b31f7829b => generated 1555 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:09:53.033973 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-693932cb-986f-4e1c-a900-9546452695ae tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:09:53.034539 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-693932cb-986f-4e1c-a900-9546452695ae tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] [instance: eced579f-beea-4d3c-b2b8-8a6b31f7829b] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:09:53.041047 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-693932cb-986f-4e1c-a900-9546452695ae tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:09:53.041532 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-693932cb-986f-4e1c-a900-9546452695ae tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:09:53.041990 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-693932cb-986f-4e1c-a900-9546452695ae tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:09:53.042650 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-693932cb-986f-4e1c-a900-9546452695ae tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:09:53.043157 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-693932cb-986f-4e1c-a900-9546452695ae tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:09:53.043589 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-693932cb-986f-4e1c-a900-9546452695ae tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:09:53.099705 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [req-1f2020c5-ab9e-4ed6-9050-82573573a045 req-456f282b-803d-40d2-8f1b-a70668f98d78 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac19dd18-c22a-46de-91ef-454a0b78872f", "name": "network-vif-plugged", "status": "completed", "tag": "01134387-2119-4a51-a70d-487b57f4610e"}, {"server_uuid": "42415fcc-ac00-4854-bc88-0416ef12d8cb", "name": "network-vif-plugged", "status": "completed", "tag": "8ff40252-03e6-43f2-9f03-0b314534b983"}]} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:09:53.110598 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-1f2020c5-ab9e-4ed6-9050-82573573a045 req-456f282b-803d-40d2-8f1b-a70668f98d78 service nova] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:09:53.111119 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-1f2020c5-ab9e-4ed6-9050-82573573a045 req-456f282b-803d-40d2-8f1b-a70668f98d78 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:09:53.111588 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-1f2020c5-ab9e-4ed6-9050-82573573a045 req-456f282b-803d-40d2-8f1b-a70668f98d78 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:09:53.124969 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.compute.server_external_events [req-1f2020c5-ab9e-4ed6-9050-82573573a045 req-456f282b-803d-40d2-8f1b-a70668f98d78 service nova] Creating event network-vif-plugged:01134387-2119-4a51-a70d-487b57f4610e for instance ac19dd18-c22a-46de-91ef-454a0b78872f on n-h2-863052-2 Nov 01 19:09:53.125560 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.compute.server_external_events [req-1f2020c5-ab9e-4ed6-9050-82573573a045 req-456f282b-803d-40d2-8f1b-a70668f98d78 service nova] Creating event network-vif-plugged:8ff40252-03e6-43f2-9f03-0b314534b983 for instance 42415fcc-ac00-4854-bc88-0416ef12d8cb on n-h1-863052-2 Nov 01 19:09:53.133977 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [req-1f2020c5-ab9e-4ed6-9050-82573573a045 req-456f282b-803d-40d2-8f1b-a70668f98d78 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.038503 Nov 01 19:09:53.134746 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1968/3821] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Nov 1 19:09:53 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:09:53.139750 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-18d2bccf-d342-4ada-9604-c494eda5ecb1 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:09:53.140508 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-18d2bccf-d342-4ada-9604-c494eda5ecb1 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] [instance: 42415fcc-ac00-4854-bc88-0416ef12d8cb] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:09:53.147667 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-18d2bccf-d342-4ada-9604-c494eda5ecb1 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:09:53.148258 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-18d2bccf-d342-4ada-9604-c494eda5ecb1 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:09:53.148730 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-18d2bccf-d342-4ada-9604-c494eda5ecb1 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:09:53.149421 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-18d2bccf-d342-4ada-9604-c494eda5ecb1 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:09:53.149990 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-18d2bccf-d342-4ada-9604-c494eda5ecb1 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:09:53.150883 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-18d2bccf-d342-4ada-9604-c494eda5ecb1 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:09:53.165002 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-693932cb-986f-4e1c-a900-9546452695ae tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] 10.222.0.13 "GET /compute/v2.1/servers/eced579f-beea-4d3c-b2b8-8a6b31f7829b/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.134868 Nov 01 19:09:53.172951 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1854/3822] 10.222.0.13 () {58 vars in 1275 bytes} [Tue Nov 1 19:09:53 2022] GET /compute/v2.1/servers/eced579f-beea-4d3c-b2b8-8a6b31f7829b/os-interface => generated 285 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:09:53.215337 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-39f89076-5d65-4ac1-925b-7504a40a2226 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:09:53.215951 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-39f89076-5d65-4ac1-925b-7504a40a2226 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] [instance: 43b22dd3-debb-4a6d-81fc-4666e5bb7804] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:09:53.222104 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-39f89076-5d65-4ac1-925b-7504a40a2226 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:09:53.222594 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-39f89076-5d65-4ac1-925b-7504a40a2226 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:09:53.223564 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-39f89076-5d65-4ac1-925b-7504a40a2226 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:09:53.224257 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-39f89076-5d65-4ac1-925b-7504a40a2226 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:09:53.224741 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-39f89076-5d65-4ac1-925b-7504a40a2226 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:09:53.225161 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-39f89076-5d65-4ac1-925b-7504a40a2226 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:09:53.496464 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-39f89076-5d65-4ac1-925b-7504a40a2226 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113bd8c844ee490b86a68bc7e1e75da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '851785a5f76548898a77d67792888504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:09:53.512896 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-39f89076-5d65-4ac1-925b-7504a40a2226 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] 10.222.0.13 "GET /compute/v2.1/servers/43b22dd3-debb-4a6d-81fc-4666e5bb7804" status: 200 len: 1511 microversion: 2.1 time: 0.301481 Nov 01 19:09:53.526041 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1855/3823] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:09:53 2022] GET /compute/v2.1/servers/43b22dd3-debb-4a6d-81fc-4666e5bb7804 => generated 1511 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:09:53.559493 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-18d2bccf-d342-4ada-9604-c494eda5ecb1 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2868ccfdfb164cffa37232c821f205a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04ef687c40bd45c297d22a791bae58cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:09:53.570514 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-18d2bccf-d342-4ada-9604-c494eda5ecb1 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] 10.222.0.13 "GET /compute/v2.1/servers/42415fcc-ac00-4854-bc88-0416ef12d8cb" status: 200 len: 1320 microversion: 2.1 time: 0.434547 Nov 01 19:09:53.571709 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1969/3824] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:09:53 2022] GET /compute/v2.1/servers/42415fcc-ac00-4854-bc88-0416ef12d8cb => generated 1320 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:09:53.959864 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-55b4c363-c74c-4050-92d2-d44ef08edef6 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:09:53.960479 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-55b4c363-c74c-4050-92d2-d44ef08edef6 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] [instance: cc8a30dd-b655-48d8-b4e2-d4911cb15513] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:09:53.980025 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-55b4c363-c74c-4050-92d2-d44ef08edef6 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:09:53.980514 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-55b4c363-c74c-4050-92d2-d44ef08edef6 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:09:53.981352 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-55b4c363-c74c-4050-92d2-d44ef08edef6 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:09:53.981694 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-55b4c363-c74c-4050-92d2-d44ef08edef6 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:09:53.982144 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-55b4c363-c74c-4050-92d2-d44ef08edef6 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:09:53.982562 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-55b4c363-c74c-4050-92d2-d44ef08edef6 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:09:54.196477 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-55b4c363-c74c-4050-92d2-d44ef08edef6 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '058480d92c9b4ab4af6815d0438a65c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee9dc49b89143f781e4ab30296e4d01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:09:54.209453 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-55b4c363-c74c-4050-92d2-d44ef08edef6 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] 10.222.0.13 "GET /compute/v2.1/servers/cc8a30dd-b655-48d8-b4e2-d4911cb15513" status: 200 len: 1489 microversion: 2.1 time: 0.253884 Nov 01 19:09:54.211238 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1856/3825] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:09:53 2022] GET /compute/v2.1/servers/cc8a30dd-b655-48d8-b4e2-d4911cb15513 => generated 1489 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:09:54.235446 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-fc96a3e3-a5a4-4968-9ef3-a9f7f73880a5 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:09:54.235954 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-fc96a3e3-a5a4-4968-9ef3-a9f7f73880a5 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] [instance: cc8a30dd-b655-48d8-b4e2-d4911cb15513] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:09:54.249343 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-fc96a3e3-a5a4-4968-9ef3-a9f7f73880a5 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:09:54.249852 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-fc96a3e3-a5a4-4968-9ef3-a9f7f73880a5 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:09:54.250297 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-fc96a3e3-a5a4-4968-9ef3-a9f7f73880a5 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:09:54.251024 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-fc96a3e3-a5a4-4968-9ef3-a9f7f73880a5 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:09:54.251482 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-fc96a3e3-a5a4-4968-9ef3-a9f7f73880a5 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:09:54.255768 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-fc96a3e3-a5a4-4968-9ef3-a9f7f73880a5 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:09:54.309499 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-fc96a3e3-a5a4-4968-9ef3-a9f7f73880a5 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] [instance: cc8a30dd-b655-48d8-b4e2-d4911cb15513] Going to try to terminate instance {{(pid=121403) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 01 19:09:54.317470 n-d-863052-2 devstack@n-api.service[121403]: DEBUG dbcounter [-] [121403] Writing DB stats nova_cell1:SELECT=100 {{(pid=121403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 19:09:54.450857 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-fc96a3e3-a5a4-4968-9ef3-a9f7f73880a5 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] 10.222.0.13 "DELETE /compute/v2.1/servers/cc8a30dd-b655-48d8-b4e2-d4911cb15513" status: 204 len: 0 microversion: 2.1 time: 0.217280 Nov 01 19:09:54.452002 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1970/3826] 10.222.0.13 () {58 vars in 1239 bytes} [Tue Nov 1 19:09:54 2022] DELETE /compute/v2.1/servers/cc8a30dd-b655-48d8-b4e2-d4911cb15513 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 01 19:09:54.462651 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-e153fb20-b9db-4143-8047-bffbc328dccf tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:09:54.463714 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-e153fb20-b9db-4143-8047-bffbc328dccf tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] [instance: cc8a30dd-b655-48d8-b4e2-d4911cb15513] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:09:54.486221 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e153fb20-b9db-4143-8047-bffbc328dccf tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:09:54.487363 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e153fb20-b9db-4143-8047-bffbc328dccf tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:09:54.488108 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e153fb20-b9db-4143-8047-bffbc328dccf tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:09:54.490972 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e153fb20-b9db-4143-8047-bffbc328dccf tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:09:54.491731 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e153fb20-b9db-4143-8047-bffbc328dccf tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:09:54.492376 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e153fb20-b9db-4143-8047-bffbc328dccf tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:09:54.540041 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [req-6903afbf-c4a6-4615-ae59-23ca502e4422 req-8edee56e-4383-4e88-8ca4-637dc42e9583 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eced579f-beea-4d3c-b2b8-8a6b31f7829b", "tag": "6c13aa9c-ab51-456c-9f28-6101db6d2168"}]} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:09:54.569660 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-6903afbf-c4a6-4615-ae59-23ca502e4422 req-8edee56e-4383-4e88-8ca4-637dc42e9583 service nova] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:09:54.570490 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-6903afbf-c4a6-4615-ae59-23ca502e4422 req-8edee56e-4383-4e88-8ca4-637dc42e9583 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:09:54.571154 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-6903afbf-c4a6-4615-ae59-23ca502e4422 req-8edee56e-4383-4e88-8ca4-637dc42e9583 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:09:54.600108 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.compute.server_external_events [req-6903afbf-c4a6-4615-ae59-23ca502e4422 req-8edee56e-4383-4e88-8ca4-637dc42e9583 service nova] Creating event network-changed:6c13aa9c-ab51-456c-9f28-6101db6d2168 for instance eced579f-beea-4d3c-b2b8-8a6b31f7829b on n-h2-863052-2 Nov 01 19:09:54.615231 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [req-6903afbf-c4a6-4615-ae59-23ca502e4422 req-8edee56e-4383-4e88-8ca4-637dc42e9583 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084081 Nov 01 19:09:54.621009 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1971/3827] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Nov 1 19:09:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:09:54.634226 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-7205de53-c9f2-4c83-9537-b2a5ba2fad8f tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:09:54.636023 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-7205de53-c9f2-4c83-9537-b2a5ba2fad8f tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] [instance: 43b22dd3-debb-4a6d-81fc-4666e5bb7804] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:09:54.655763 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-7205de53-c9f2-4c83-9537-b2a5ba2fad8f tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:09:54.656289 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-7205de53-c9f2-4c83-9537-b2a5ba2fad8f tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:09:54.656772 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-7205de53-c9f2-4c83-9537-b2a5ba2fad8f tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:09:54.658566 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-7205de53-c9f2-4c83-9537-b2a5ba2fad8f tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:09:54.659051 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-7205de53-c9f2-4c83-9537-b2a5ba2fad8f tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:09:54.659630 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-7205de53-c9f2-4c83-9537-b2a5ba2fad8f tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:09:54.716217 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-e153fb20-b9db-4143-8047-bffbc328dccf tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '058480d92c9b4ab4af6815d0438a65c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee9dc49b89143f781e4ab30296e4d01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:09:54.725882 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-e153fb20-b9db-4143-8047-bffbc328dccf tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] 10.222.0.13 "GET /compute/v2.1/servers/cc8a30dd-b655-48d8-b4e2-d4911cb15513" status: 200 len: 1495 microversion: 2.1 time: 0.269603 Nov 01 19:09:54.728463 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1857/3828] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:09:54 2022] GET /compute/v2.1/servers/cc8a30dd-b655-48d8-b4e2-d4911cb15513 => generated 1495 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:09:54.745381 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-69707812-eb4d-404f-9616-57c5598fade8 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:09:54.746348 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-69707812-eb4d-404f-9616-57c5598fade8 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] [instance: 42415fcc-ac00-4854-bc88-0416ef12d8cb] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:09:54.765359 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-69707812-eb4d-404f-9616-57c5598fade8 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:09:54.765915 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-69707812-eb4d-404f-9616-57c5598fade8 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:09:54.767395 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-69707812-eb4d-404f-9616-57c5598fade8 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:09:54.769284 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-69707812-eb4d-404f-9616-57c5598fade8 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:09:54.769950 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-69707812-eb4d-404f-9616-57c5598fade8 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:09:54.771532 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-69707812-eb4d-404f-9616-57c5598fade8 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:09:54.992241 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-69707812-eb4d-404f-9616-57c5598fade8 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2868ccfdfb164cffa37232c821f205a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04ef687c40bd45c297d22a791bae58cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:09:55.003138 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-7205de53-c9f2-4c83-9537-b2a5ba2fad8f tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113bd8c844ee490b86a68bc7e1e75da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '851785a5f76548898a77d67792888504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:09:55.007869 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-69707812-eb4d-404f-9616-57c5598fade8 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] 10.222.0.13 "GET /compute/v2.1/servers/42415fcc-ac00-4854-bc88-0416ef12d8cb" status: 200 len: 1512 microversion: 2.1 time: 0.277865 Nov 01 19:09:55.009288 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1858/3829] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:09:54 2022] GET /compute/v2.1/servers/42415fcc-ac00-4854-bc88-0416ef12d8cb => generated 1512 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:09:55.012448 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-7205de53-c9f2-4c83-9537-b2a5ba2fad8f tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] 10.222.0.13 "GET /compute/v2.1/servers/43b22dd3-debb-4a6d-81fc-4666e5bb7804" status: 200 len: 1511 microversion: 2.1 time: 0.389838 Nov 01 19:09:55.017150 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1972/3830] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:09:54 2022] GET /compute/v2.1/servers/43b22dd3-debb-4a6d-81fc-4666e5bb7804 => generated 1511 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:09:55.037308 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-1759a953-0648-44d3-937b-37cc0a5f77ef tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:09:55.038035 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-1759a953-0648-44d3-937b-37cc0a5f77ef tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] [instance: ac19dd18-c22a-46de-91ef-454a0b78872f] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:09:55.045526 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-1759a953-0648-44d3-937b-37cc0a5f77ef tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:09:55.046152 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-1759a953-0648-44d3-937b-37cc0a5f77ef tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:09:55.046703 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-1759a953-0648-44d3-937b-37cc0a5f77ef tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:09:55.047498 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-1759a953-0648-44d3-937b-37cc0a5f77ef tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:09:55.048349 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-1759a953-0648-44d3-937b-37cc0a5f77ef tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:09:55.048947 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-1759a953-0648-44d3-937b-37cc0a5f77ef tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:09:55.157951 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [req-9159fd1f-2bad-49ed-8963-2e2d9ac9eabe req-a2eea026-eec2-409b-aa9f-45a19ba3cf8c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "33dd79e0-eb7c-4f18-a61f-df8022667dd0", "name": "network-vif-plugged", "status": "completed", "tag": "b6f7cb22-5f30-4f8f-9e4c-e4d1e25035f0"}]} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:09:55.169251 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-9159fd1f-2bad-49ed-8963-2e2d9ac9eabe req-a2eea026-eec2-409b-aa9f-45a19ba3cf8c service nova] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:09:55.169732 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-9159fd1f-2bad-49ed-8963-2e2d9ac9eabe req-a2eea026-eec2-409b-aa9f-45a19ba3cf8c service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:09:55.170156 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-9159fd1f-2bad-49ed-8963-2e2d9ac9eabe req-a2eea026-eec2-409b-aa9f-45a19ba3cf8c service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:09:55.182673 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.compute.server_external_events [req-9159fd1f-2bad-49ed-8963-2e2d9ac9eabe req-a2eea026-eec2-409b-aa9f-45a19ba3cf8c service nova] Creating event network-vif-plugged:b6f7cb22-5f30-4f8f-9e4c-e4d1e25035f0 for instance 33dd79e0-eb7c-4f18-a61f-df8022667dd0 on n-h2-863052-2 Nov 01 19:09:55.190865 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [req-9159fd1f-2bad-49ed-8963-2e2d9ac9eabe req-a2eea026-eec2-409b-aa9f-45a19ba3cf8c service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044501 Nov 01 19:09:55.191724 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1973/3831] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Nov 1 19:09:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 01 19:09:55.251877 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-1759a953-0648-44d3-937b-37cc0a5f77ef tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2868ccfdfb164cffa37232c821f205a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04ef687c40bd45c297d22a791bae58cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:09:55.261316 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-1759a953-0648-44d3-937b-37cc0a5f77ef tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] 10.222.0.13 "GET /compute/v2.1/servers/ac19dd18-c22a-46de-91ef-454a0b78872f" status: 200 len: 1513 microversion: 2.1 time: 0.229250 Nov 01 19:09:55.262619 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1859/3832] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:09:55 2022] GET /compute/v2.1/servers/ac19dd18-c22a-46de-91ef-454a0b78872f => generated 1513 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:09:55.291389 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-92758b5c-0b6a-428d-9c6e-01fa00af0bbe tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:09:55.292699 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-92758b5c-0b6a-428d-9c6e-01fa00af0bbe tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] [instance: 33dd79e0-eb7c-4f18-a61f-df8022667dd0] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:09:55.299581 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-92758b5c-0b6a-428d-9c6e-01fa00af0bbe tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:09:55.300345 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-92758b5c-0b6a-428d-9c6e-01fa00af0bbe tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:09:55.301166 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-92758b5c-0b6a-428d-9c6e-01fa00af0bbe tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:09:55.302081 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-92758b5c-0b6a-428d-9c6e-01fa00af0bbe tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:09:55.302693 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-92758b5c-0b6a-428d-9c6e-01fa00af0bbe tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:09:55.303274 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-92758b5c-0b6a-428d-9c6e-01fa00af0bbe tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:09:55.751586 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-d447ba4a-be05-4806-b516-c86661b24544 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:09:55.752130 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-d447ba4a-be05-4806-b516-c86661b24544 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] [instance: cc8a30dd-b655-48d8-b4e2-d4911cb15513] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:09:55.758962 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-d447ba4a-be05-4806-b516-c86661b24544 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:09:55.759680 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-d447ba4a-be05-4806-b516-c86661b24544 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:09:55.760484 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-d447ba4a-be05-4806-b516-c86661b24544 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:09:55.761384 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-d447ba4a-be05-4806-b516-c86661b24544 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:09:55.761845 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-d447ba4a-be05-4806-b516-c86661b24544 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:09:55.762434 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-d447ba4a-be05-4806-b516-c86661b24544 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:09:55.872330 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-92758b5c-0b6a-428d-9c6e-01fa00af0bbe tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2868ccfdfb164cffa37232c821f205a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04ef687c40bd45c297d22a791bae58cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:09:55.882825 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-92758b5c-0b6a-428d-9c6e-01fa00af0bbe tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] 10.222.0.13 "GET /compute/v2.1/servers/33dd79e0-eb7c-4f18-a61f-df8022667dd0" status: 200 len: 1320 microversion: 2.1 time: 0.597750 Nov 01 19:09:55.883778 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1974/3833] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:09:55 2022] GET /compute/v2.1/servers/33dd79e0-eb7c-4f18-a61f-df8022667dd0 => generated 1320 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:09:56.039278 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-b89c570a-da17-453a-9afb-ce7803aefc01 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:09:56.040482 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-b89c570a-da17-453a-9afb-ce7803aefc01 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] [instance: 43b22dd3-debb-4a6d-81fc-4666e5bb7804] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:09:56.055813 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-d447ba4a-be05-4806-b516-c86661b24544 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '058480d92c9b4ab4af6815d0438a65c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee9dc49b89143f781e4ab30296e4d01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:09:56.066060 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-b89c570a-da17-453a-9afb-ce7803aefc01 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:09:56.067916 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-d447ba4a-be05-4806-b516-c86661b24544 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] 10.222.0.13 "GET /compute/v2.1/servers/cc8a30dd-b655-48d8-b4e2-d4911cb15513" status: 200 len: 1495 microversion: 2.1 time: 0.320373 Nov 01 19:09:56.068494 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-b89c570a-da17-453a-9afb-ce7803aefc01 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:09:56.075235 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1860/3834] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:09:55 2022] GET /compute/v2.1/servers/cc8a30dd-b655-48d8-b4e2-d4911cb15513 => generated 1495 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:09:56.076205 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-b89c570a-da17-453a-9afb-ce7803aefc01 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:09:56.083837 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-b89c570a-da17-453a-9afb-ce7803aefc01 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:09:56.085772 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-b89c570a-da17-453a-9afb-ce7803aefc01 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:09:56.087519 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-b89c570a-da17-453a-9afb-ce7803aefc01 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:09:56.288836 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-b89c570a-da17-453a-9afb-ce7803aefc01 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113bd8c844ee490b86a68bc7e1e75da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '851785a5f76548898a77d67792888504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:09:56.300199 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-b89c570a-da17-453a-9afb-ce7803aefc01 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] 10.222.0.13 "GET /compute/v2.1/servers/43b22dd3-debb-4a6d-81fc-4666e5bb7804" status: 200 len: 1511 microversion: 2.1 time: 0.265322 Nov 01 19:09:56.311630 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1975/3835] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:09:56 2022] GET /compute/v2.1/servers/43b22dd3-debb-4a6d-81fc-4666e5bb7804 => generated 1511 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:09:56.493044 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [req-83fd1c6d-12b3-45d8-970c-56afb6cce7d4 req-9c749fae-44f4-485e-ab67-e7f3f0e2ee0e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cc8a30dd-b655-48d8-b4e2-d4911cb15513", "name": "network-vif-deleted", "tag": "2fd41cc4-9129-4719-8eec-3c7b8ca74ec9"}]} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:09:56.516270 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-83fd1c6d-12b3-45d8-970c-56afb6cce7d4 req-9c749fae-44f4-485e-ab67-e7f3f0e2ee0e service nova] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:09:56.516830 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-83fd1c6d-12b3-45d8-970c-56afb6cce7d4 req-9c749fae-44f4-485e-ab67-e7f3f0e2ee0e service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:09:56.517272 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-83fd1c6d-12b3-45d8-970c-56afb6cce7d4 req-9c749fae-44f4-485e-ab67-e7f3f0e2ee0e service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:09:56.536648 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.compute.server_external_events [req-83fd1c6d-12b3-45d8-970c-56afb6cce7d4 req-9c749fae-44f4-485e-ab67-e7f3f0e2ee0e service nova] Creating event network-vif-deleted:2fd41cc4-9129-4719-8eec-3c7b8ca74ec9 for instance cc8a30dd-b655-48d8-b4e2-d4911cb15513 on n-h1-863052-2 Nov 01 19:09:56.541982 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [req-83fd1c6d-12b3-45d8-970c-56afb6cce7d4 req-9c749fae-44f4-485e-ab67-e7f3f0e2ee0e service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054111 Nov 01 19:09:56.542592 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1861/3836] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Nov 1 19:09:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:09:56.912639 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-3febc24b-0ca3-46d3-b6c5-8db69d6b6d77 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:09:56.913256 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-3febc24b-0ca3-46d3-b6c5-8db69d6b6d77 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] [instance: 33dd79e0-eb7c-4f18-a61f-df8022667dd0] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:09:56.920994 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-3febc24b-0ca3-46d3-b6c5-8db69d6b6d77 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:09:56.921484 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-3febc24b-0ca3-46d3-b6c5-8db69d6b6d77 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:09:56.921927 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-3febc24b-0ca3-46d3-b6c5-8db69d6b6d77 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:09:56.922617 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-3febc24b-0ca3-46d3-b6c5-8db69d6b6d77 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:09:56.924260 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-3febc24b-0ca3-46d3-b6c5-8db69d6b6d77 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:09:56.924260 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-3febc24b-0ca3-46d3-b6c5-8db69d6b6d77 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:09:57.093788 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-eb7a4469-5387-4e3f-91f8-3fd051ee461d tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:09:57.095177 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-eb7a4469-5387-4e3f-91f8-3fd051ee461d tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] [instance: cc8a30dd-b655-48d8-b4e2-d4911cb15513] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:09:57.104219 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-eb7a4469-5387-4e3f-91f8-3fd051ee461d tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:09:57.105098 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-eb7a4469-5387-4e3f-91f8-3fd051ee461d tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:09:57.105733 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-eb7a4469-5387-4e3f-91f8-3fd051ee461d tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:09:57.106648 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-eb7a4469-5387-4e3f-91f8-3fd051ee461d tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:09:57.107279 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-eb7a4469-5387-4e3f-91f8-3fd051ee461d tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:09:57.107869 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-eb7a4469-5387-4e3f-91f8-3fd051ee461d tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:09:57.119598 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-3febc24b-0ca3-46d3-b6c5-8db69d6b6d77 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2868ccfdfb164cffa37232c821f205a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04ef687c40bd45c297d22a791bae58cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:09:57.127962 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-3febc24b-0ca3-46d3-b6c5-8db69d6b6d77 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] 10.222.0.13 "GET /compute/v2.1/servers/33dd79e0-eb7c-4f18-a61f-df8022667dd0" status: 200 len: 1320 microversion: 2.1 time: 0.219116 Nov 01 19:09:57.128545 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1976/3837] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:09:56 2022] GET /compute/v2.1/servers/33dd79e0-eb7c-4f18-a61f-df8022667dd0 => generated 1320 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:09:57.147846 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-eb7a4469-5387-4e3f-91f8-3fd051ee461d tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:09:57.148241 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-eb7a4469-5387-4e3f-91f8-3fd051ee461d tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:09:57.149129 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-eb7a4469-5387-4e3f-91f8-3fd051ee461d tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:09:57.150293 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.objects.instance [None req-eb7a4469-5387-4e3f-91f8-3fd051ee461d tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lazy-loading 'fault' on Instance uuid cc8a30dd-b655-48d8-b4e2-d4911cb15513 {{(pid=121402) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 01 19:09:57.201933 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-eb7a4469-5387-4e3f-91f8-3fd051ee461d tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '058480d92c9b4ab4af6815d0438a65c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee9dc49b89143f781e4ab30296e4d01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:09:57.210451 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-eb7a4469-5387-4e3f-91f8-3fd051ee461d tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] 10.222.0.13 "GET /compute/v2.1/servers/cc8a30dd-b655-48d8-b4e2-d4911cb15513" status: 200 len: 1305 microversion: 2.1 time: 0.122866 Nov 01 19:09:57.211039 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1862/3838] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:09:57 2022] GET /compute/v2.1/servers/cc8a30dd-b655-48d8-b4e2-d4911cb15513 => generated 1305 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 19:09:57.334752 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-f4ed5c84-fcfb-4272-b91d-11d26227b50e tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:09:57.335525 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-f4ed5c84-fcfb-4272-b91d-11d26227b50e tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] [instance: 43b22dd3-debb-4a6d-81fc-4666e5bb7804] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:09:57.342180 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f4ed5c84-fcfb-4272-b91d-11d26227b50e tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:09:57.342659 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f4ed5c84-fcfb-4272-b91d-11d26227b50e tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:09:57.343086 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f4ed5c84-fcfb-4272-b91d-11d26227b50e tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:09:57.343762 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f4ed5c84-fcfb-4272-b91d-11d26227b50e tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:09:57.344207 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f4ed5c84-fcfb-4272-b91d-11d26227b50e tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:09:57.344641 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f4ed5c84-fcfb-4272-b91d-11d26227b50e tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:09:57.482470 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-f4ed5c84-fcfb-4272-b91d-11d26227b50e tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113bd8c844ee490b86a68bc7e1e75da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '851785a5f76548898a77d67792888504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:09:57.492351 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-f4ed5c84-fcfb-4272-b91d-11d26227b50e tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] 10.222.0.13 "GET /compute/v2.1/servers/43b22dd3-debb-4a6d-81fc-4666e5bb7804" status: 200 len: 1511 microversion: 2.1 time: 0.161083 Nov 01 19:09:57.493123 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1977/3839] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:09:57 2022] GET /compute/v2.1/servers/43b22dd3-debb-4a6d-81fc-4666e5bb7804 => generated 1511 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:09:58.152259 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-b95e5eec-e77b-43ad-af48-cda499ad35a1 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:09:58.153026 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-b95e5eec-e77b-43ad-af48-cda499ad35a1 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] [instance: 33dd79e0-eb7c-4f18-a61f-df8022667dd0] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:09:58.160840 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b95e5eec-e77b-43ad-af48-cda499ad35a1 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:09:58.161392 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b95e5eec-e77b-43ad-af48-cda499ad35a1 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:09:58.161956 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b95e5eec-e77b-43ad-af48-cda499ad35a1 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:09:58.162655 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b95e5eec-e77b-43ad-af48-cda499ad35a1 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:09:58.163134 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b95e5eec-e77b-43ad-af48-cda499ad35a1 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:09:58.163553 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b95e5eec-e77b-43ad-af48-cda499ad35a1 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:09:58.234083 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-0d43a4b8-f5f4-4c82-bad5-8b5177a4dc09 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:09:58.234715 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-0d43a4b8-f5f4-4c82-bad5-8b5177a4dc09 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] [instance: cc8a30dd-b655-48d8-b4e2-d4911cb15513] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:09:58.241290 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-0d43a4b8-f5f4-4c82-bad5-8b5177a4dc09 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:09:58.241972 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-0d43a4b8-f5f4-4c82-bad5-8b5177a4dc09 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:09:58.242468 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-0d43a4b8-f5f4-4c82-bad5-8b5177a4dc09 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:09:58.243769 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-0d43a4b8-f5f4-4c82-bad5-8b5177a4dc09 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:09:58.244230 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-0d43a4b8-f5f4-4c82-bad5-8b5177a4dc09 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:09:58.244677 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-0d43a4b8-f5f4-4c82-bad5-8b5177a4dc09 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:09:58.259538 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.wsgi [None req-0d43a4b8-f5f4-4c82-bad5-8b5177a4dc09 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] HTTP exception thrown: Instance cc8a30dd-b655-48d8-b4e2-d4911cb15513 could not be found. Nov 01 19:09:58.261213 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-0d43a4b8-f5f4-4c82-bad5-8b5177a4dc09 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Request method failure captured: Nov 01 19:09:58.261213 n-d-863052-2 devstack@n-api.service[121403]: request: GET /compute/v2.1/servers/cc8a30dd-b655-48d8-b4e2-d4911cb15513 HTTP/1.1 Nov 01 19:09:58.261213 n-d-863052-2 devstack@n-api.service[121403]: Accept: application/json Nov 01 19:09:58.261213 n-d-863052-2 devstack@n-api.service[121403]: Accept-Encoding: identity Nov 01 19:09:58.261213 n-d-863052-2 devstack@n-api.service[121403]: Connection: close Nov 01 19:09:58.261213 n-d-863052-2 devstack@n-api.service[121403]: Content-Length: 0 Nov 01 19:09:58.261213 n-d-863052-2 devstack@n-api.service[121403]: Content-Type: application/json Nov 01 19:09:58.261213 n-d-863052-2 devstack@n-api.service[121403]: Host: 10.222.0.13 Nov 01 19:09:58.261213 n-d-863052-2 devstack@n-api.service[121403]: Openstack-System-Scope: None Nov 01 19:09:58.261213 n-d-863052-2 devstack@n-api.service[121403]: User-Agent: python-urllib3/1.26.12 Nov 01 19:09:58.261213 n-d-863052-2 devstack@n-api.service[121403]: X-Auth-Token: gAAAAABjYW3ByfBI9VCjWikZSFUz_hPClqqMancoCxnwBX6xqaMeeugycqMQyEPQybXqoeO46TFhJ9TITtoJFiSbS9Ry6pB9Kueb-hoVnQBV0e7qQWXwvcx4eB_AomP3ogOCXvqhfUnxVmmooBEoQbpvBIMsXQEjVVdPObNP8WS9oGjTsTTTO4o Nov 01 19:09:58.261213 n-d-863052-2 devstack@n-api.service[121403]: X-Domain-Id: None Nov 01 19:09:58.261213 n-d-863052-2 devstack@n-api.service[121403]: X-Domain-Name: None Nov 01 19:09:58.261213 n-d-863052-2 devstack@n-api.service[121403]: X-Identity-Status: Confirmed Nov 01 19:09:58.261213 n-d-863052-2 devstack@n-api.service[121403]: X-Is-Admin-Project: True Nov 01 19:09:58.261213 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Domain-Id: default Nov 01 19:09:58.261213 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Domain-Name: Default Nov 01 19:09:58.261213 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Id: 1ee9dc49b89143f781e4ab30296e4d01 Nov 01 19:09:58.261213 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Name: tempest-DeleteServersTestJSON-412339701 Nov 01 19:09:58.261213 n-d-863052-2 devstack@n-api.service[121403]: X-Role: member,reader Nov 01 19:09:58.261213 n-d-863052-2 devstack@n-api.service[121403]: X-Roles: member,reader Nov 01 19:09:58.261213 n-d-863052-2 devstack@n-api.service[121403]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/1ee9dc49b89143f781e4ab30296e4d01"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/1ee9dc49b89143f781e4ab30296e4d01"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_1ee9dc49b89143f781e4ab30296e4d01", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/1ee9dc49b89143f781e4ab30296e4d01"}]}] Nov 01 19:09:58.261213 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant: tempest-DeleteServersTestJSON-412339701 Nov 01 19:09:58.261213 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant-Id: 1ee9dc49b89143f781e4ab30296e4d01 Nov 01 19:09:58.261213 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant-Name: tempest-DeleteServersTestJSON-412339701 Nov 01 19:09:58.261213 n-d-863052-2 devstack@n-api.service[121403]: X-User: tempest-DeleteServersTestJSON-412339701-project Nov 01 19:09:58.261213 n-d-863052-2 devstack@n-api.service[121403]: X-User-Domain-Id: default Nov 01 19:09:58.261213 n-d-863052-2 devstack@n-api.service[121403]: X-User-Domain-Name: Default Nov 01 19:09:58.261213 n-d-863052-2 devstack@n-api.service[121403]: X-User-Id: 058480d92c9b4ab4af6815d0438a65c7 Nov 01 19:09:58.261213 n-d-863052-2 devstack@n-api.service[121403]: X-User-Name: tempest-DeleteServersTestJSON-412339701-project Nov 01 19:09:58.261213 n-d-863052-2 devstack@n-api.service[121403]: method: > Nov 01 19:09:58.261213 n-d-863052-2 devstack@n-api.service[121403]: exception: Instance cc8a30dd-b655-48d8-b4e2-d4911cb15513 could not be found. Nov 01 19:09:58.261213 n-d-863052-2 devstack@n-api.service[121403]: action_args: {'id': 'cc8a30dd-b655-48d8-b4e2-d4911cb15513'} Nov 01 19:09:58.261213 n-d-863052-2 devstack@n-api.service[121403]: {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 01 19:09:58.261213 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:09:58.261213 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 01 19:09:58.261213 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 01 19:09:58.261213 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 01 19:09:58.261213 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 01 19:09:58.261213 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 01 19:09:58.261213 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 01 19:09:58.261213 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 01 19:09:58.261213 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 01 19:09:58.261213 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cc8a30dd-b655-48d8-b4e2-d4911cb15513 could not be found. Nov 01 19:09:58.261213 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:09:58.261213 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:09:58.261213 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:09:58.261213 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:09:58.261213 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:09:58.261213 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:09:58.261213 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 01 19:09:58.261213 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 01 19:09:58.261213 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 01 19:09:58.261213 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 01 19:09:58.261213 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 01 19:09:58.261213 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 01 19:09:58.261213 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 01 19:09:58.261213 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 01 19:09:58.261213 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 01 19:09:58.261213 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 01 19:09:58.261213 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cc8a30dd-b655-48d8-b4e2-d4911cb15513 could not be found. Nov 01 19:09:58.261213 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:09:58.261213 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:09:58.261213 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:09:58.265771 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:09:58.265771 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:09:58.265771 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:09:58.265771 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 01 19:09:58.265771 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 01 19:09:58.265771 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cc8a30dd-b655-48d8-b4e2-d4911cb15513 could not be found. Nov 01 19:09:58.265771 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:09:58.265771 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-0d43a4b8-f5f4-4c82-bad5-8b5177a4dc09 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Returning 404 to user: Instance cc8a30dd-b655-48d8-b4e2-d4911cb15513 could not be found. {{(pid=121403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 01 19:09:58.265771 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-0d43a4b8-f5f4-4c82-bad5-8b5177a4dc09 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] 10.222.0.13 "GET /compute/v2.1/servers/cc8a30dd-b655-48d8-b4e2-d4911cb15513" status: 404 len: 111 microversion: 2.1 time: 0.033055 Nov 01 19:09:58.265771 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1978/3840] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:09:58 2022] GET /compute/v2.1/servers/cc8a30dd-b655-48d8-b4e2-d4911cb15513 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 01 19:09:58.307724 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-b95e5eec-e77b-43ad-af48-cda499ad35a1 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2868ccfdfb164cffa37232c821f205a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04ef687c40bd45c297d22a791bae58cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:09:58.318789 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-b95e5eec-e77b-43ad-af48-cda499ad35a1 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] 10.222.0.13 "GET /compute/v2.1/servers/33dd79e0-eb7c-4f18-a61f-df8022667dd0" status: 200 len: 1512 microversion: 2.1 time: 0.170152 Nov 01 19:09:58.319896 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1863/3841] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:09:58 2022] GET /compute/v2.1/servers/33dd79e0-eb7c-4f18-a61f-df8022667dd0 => generated 1512 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:09:58.342096 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-635973af-a325-4b32-b0c1-47ab9c535708 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:09:58.351271 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-635973af-a325-4b32-b0c1-47ab9c535708 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '2868ccfdfb164cffa37232c821f205a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04ef687c40bd45c297d22a791bae58cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:09:58.352137 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-635973af-a325-4b32-b0c1-47ab9c535708 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Searching by: {'flavor': '451', 'deleted': False, 'project_id': '04ef687c40bd45c297d22a791bae58cf'} {{(pid=121403) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 01 19:09:58.365247 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-635973af-a325-4b32-b0c1-47ab9c535708 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:09:58.365788 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-635973af-a325-4b32-b0c1-47ab9c535708 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:09:58.366217 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-635973af-a325-4b32-b0c1-47ab9c535708 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:09:58.366925 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-635973af-a325-4b32-b0c1-47ab9c535708 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:09:58.367547 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-635973af-a325-4b32-b0c1-47ab9c535708 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:09:58.368138 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-635973af-a325-4b32-b0c1-47ab9c535708 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:09:58.383364 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-2886d357-e724-4baa-97e9-1e8d3a50f7fb tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-8663780", "imageRef": "2d4a0047-1b9e-445f-8af8-1b5c9d93e881", "flavorRef": "452", "networks": [{"uuid": "6da1da8d-6719-4a9a-851f-308df797b88a"}]}} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:09:58.445686 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.network.neutron [None req-2886d357-e724-4baa-97e9-1e8d3a50f7fb tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] validate_networks() for [('6da1da8d-6719-4a9a-851f-308df797b88a', None, None, None, None, None)] {{(pid=121402) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 01 19:09:58.476005 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.multi_cell_list [None req-635973af-a325-4b32-b0c1-47ab9c535708 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=121403) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 01 19:09:58.544864 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-635973af-a325-4b32-b0c1-47ab9c535708 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2868ccfdfb164cffa37232c821f205a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04ef687c40bd45c297d22a791bae58cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:09:58.551711 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-635973af-a325-4b32-b0c1-47ab9c535708 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:09:58.551981 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-635973af-a325-4b32-b0c1-47ab9c535708 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:09:58.552319 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-635973af-a325-4b32-b0c1-47ab9c535708 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:09:58.690956 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-635973af-a325-4b32-b0c1-47ab9c535708 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] 10.222.0.13 "GET /compute/v2.1/servers/detail?flavor=451" status: 200 len: 1515 microversion: 2.1 time: 0.350703 Nov 01 19:09:58.696333 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1979/3842] 10.222.0.13 () {58 vars in 1167 bytes} [Tue Nov 1 19:09:58 2022] GET /compute/v2.1/servers/detail?flavor=451 => generated 1515 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:09:58.708645 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-933336a1-4aed-4130-bf34-df211ae837f7 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:09:58.709576 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-933336a1-4aed-4130-bf34-df211ae837f7 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] [instance: 43b22dd3-debb-4a6d-81fc-4666e5bb7804] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:09:58.718929 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-933336a1-4aed-4130-bf34-df211ae837f7 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:09:58.719331 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-933336a1-4aed-4130-bf34-df211ae837f7 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:09:58.719989 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-933336a1-4aed-4130-bf34-df211ae837f7 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:09:58.720513 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-933336a1-4aed-4130-bf34-df211ae837f7 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:09:58.720996 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-933336a1-4aed-4130-bf34-df211ae837f7 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:09:58.721862 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-933336a1-4aed-4130-bf34-df211ae837f7 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:09:58.873617 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-933336a1-4aed-4130-bf34-df211ae837f7 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113bd8c844ee490b86a68bc7e1e75da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '851785a5f76548898a77d67792888504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:09:58.883489 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-933336a1-4aed-4130-bf34-df211ae837f7 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] 10.222.0.13 "GET /compute/v2.1/servers/43b22dd3-debb-4a6d-81fc-4666e5bb7804" status: 200 len: 1488 microversion: 2.1 time: 0.185864 Nov 01 19:09:58.884645 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1980/3843] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:09:58 2022] GET /compute/v2.1/servers/43b22dd3-debb-4a6d-81fc-4666e5bb7804 => generated 1488 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:09:58.889731 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-817b4c4b-3501-4641-9c46-e3d989eefc56 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:09:58.889964 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.virt.hardware [None req-2886d357-e724-4baa-97e9-1e8d3a50f7fb tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Flavor limits 0:0:0 {{(pid=121402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 01 19:09:58.890394 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.virt.hardware [None req-2886d357-e724-4baa-97e9-1e8d3a50f7fb tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Image limits 0:0:0 {{(pid=121402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 01 19:09:58.890877 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.virt.hardware [None req-2886d357-e724-4baa-97e9-1e8d3a50f7fb tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Flavor pref 0:0:0 {{(pid=121402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 01 19:09:58.891286 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.virt.hardware [None req-2886d357-e724-4baa-97e9-1e8d3a50f7fb tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Image pref 0:0:0 {{(pid=121402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 01 19:09:58.891700 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.virt.hardware [None req-2886d357-e724-4baa-97e9-1e8d3a50f7fb tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 01 19:09:58.895375 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-817b4c4b-3501-4641-9c46-e3d989eefc56 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '2868ccfdfb164cffa37232c821f205a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04ef687c40bd45c297d22a791bae58cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:09:58.896308 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-817b4c4b-3501-4641-9c46-e3d989eefc56 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Searching by: {'name': 'tempest-ListServerFiltersTestJSON-instance-1380889138', 'deleted': False, 'project_id': '04ef687c40bd45c297d22a791bae58cf'} {{(pid=121403) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 01 19:09:58.901543 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-817b4c4b-3501-4641-9c46-e3d989eefc56 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:09:58.902329 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2886d357-e724-4baa-97e9-1e8d3a50f7fb tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:09:58.902515 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-817b4c4b-3501-4641-9c46-e3d989eefc56 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:09:58.902876 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2886d357-e724-4baa-97e9-1e8d3a50f7fb tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:09:58.903216 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-817b4c4b-3501-4641-9c46-e3d989eefc56 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:09:58.903350 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2886d357-e724-4baa-97e9-1e8d3a50f7fb tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:09:58.904114 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-817b4c4b-3501-4641-9c46-e3d989eefc56 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:09:58.904299 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2886d357-e724-4baa-97e9-1e8d3a50f7fb tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:09:58.904801 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-817b4c4b-3501-4641-9c46-e3d989eefc56 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:09:58.905195 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2886d357-e724-4baa-97e9-1e8d3a50f7fb tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:09:58.905582 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-817b4c4b-3501-4641-9c46-e3d989eefc56 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:09:58.905706 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2886d357-e724-4baa-97e9-1e8d3a50f7fb tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:09:58.927269 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.quota [None req-2886d357-e724-4baa-97e9-1e8d3a50f7fb tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Getting quotas for project 1ee9dc49b89143f781e4ab30296e4d01. Resources: {'cores', 'ram', 'instances'} {{(pid=121402) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 01 19:09:58.932868 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.quota [None req-2886d357-e724-4baa-97e9-1e8d3a50f7fb tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Getting quotas for user 058480d92c9b4ab4af6815d0438a65c7 and project 1ee9dc49b89143f781e4ab30296e4d01. Resources: {'cores', 'ram', 'instances'} {{(pid=121402) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 01 19:09:58.947084 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-2886d357-e724-4baa-97e9-1e8d3a50f7fb tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Going to run 1 instances... {{(pid=121402) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 01 19:09:58.949586 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-2886d357-e724-4baa-97e9-1e8d3a50f7fb tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] [instance: 8c460f41-9dc1-4f0c-9d2d-0a91b38f7787] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2d4a0047-1b9e-445f-8af8-1b5c9d93e881',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121402) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 01 19:09:58.998232 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-2886d357-e724-4baa-97e9-1e8d3a50f7fb tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.619406 Nov 01 19:09:59.004684 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1864/3844] 10.222.0.13 () {60 vars in 1147 bytes} [Tue Nov 1 19:09:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 627 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Nov 01 19:09:59.009860 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.multi_cell_list [None req-817b4c4b-3501-4641-9c46-e3d989eefc56 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=121403) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 01 19:09:59.013605 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-a20345e7-6052-4d7a-a502-b7f7b1bb96fd tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-\u00cd\u00f1st\u00e1\u00f1c\u00e9-1683744370"}} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:09:59.016835 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-a20345e7-6052-4d7a-a502-b7f7b1bb96fd tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] [instance: 43b22dd3-debb-4a6d-81fc-4666e5bb7804] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:09:59.036204 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-a20345e7-6052-4d7a-a502-b7f7b1bb96fd tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:09:59.037016 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-a20345e7-6052-4d7a-a502-b7f7b1bb96fd tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:09:59.037397 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-a20345e7-6052-4d7a-a502-b7f7b1bb96fd tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:09:59.038117 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-a20345e7-6052-4d7a-a502-b7f7b1bb96fd tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:09:59.038575 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-a20345e7-6052-4d7a-a502-b7f7b1bb96fd tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:09:59.039037 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-a20345e7-6052-4d7a-a502-b7f7b1bb96fd tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:09:59.044125 n-d-863052-2 devstack@n-api.service[121402]: DEBUG dbcounter [-] [121402] Writing DB stats nova_cell1:SELECT=100 {{(pid=121402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 19:09:59.087442 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-817b4c4b-3501-4641-9c46-e3d989eefc56 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2868ccfdfb164cffa37232c821f205a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04ef687c40bd45c297d22a791bae58cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:09:59.094141 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-817b4c4b-3501-4641-9c46-e3d989eefc56 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:09:59.094659 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-817b4c4b-3501-4641-9c46-e3d989eefc56 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:09:59.095099 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-817b4c4b-3501-4641-9c46-e3d989eefc56 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:09:59.122486 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-a20345e7-6052-4d7a-a502-b7f7b1bb96fd tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] 10.222.0.13 "PUT /compute/v2.1/servers/43b22dd3-debb-4a6d-81fc-4666e5bb7804" status: 200 len: 1061 microversion: 2.1 time: 0.112970 Nov 01 19:09:59.123207 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1865/3845] 10.222.0.13 () {60 vars in 1256 bytes} [Tue Nov 1 19:09:59 2022] PUT /compute/v2.1/servers/43b22dd3-debb-4a6d-81fc-4666e5bb7804 => generated 1061 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:09:59.129814 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-b4dfd3d3-40c4-41b5-a8c2-10dd427b09c5 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:09:59.130642 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-b4dfd3d3-40c4-41b5-a8c2-10dd427b09c5 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] [instance: 8c460f41-9dc1-4f0c-9d2d-0a91b38f7787] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:09:59.225641 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-b4dfd3d3-40c4-41b5-a8c2-10dd427b09c5 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '058480d92c9b4ab4af6815d0438a65c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee9dc49b89143f781e4ab30296e4d01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:09:59.239038 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-b4dfd3d3-40c4-41b5-a8c2-10dd427b09c5 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] 10.222.0.13 "GET /compute/v2.1/servers/8c460f41-9dc1-4f0c-9d2d-0a91b38f7787" status: 200 len: 1212 microversion: 2.1 time: 0.114211 Nov 01 19:09:59.239782 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1866/3846] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:09:59 2022] GET /compute/v2.1/servers/8c460f41-9dc1-4f0c-9d2d-0a91b38f7787 => generated 1212 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:09:59.247084 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-817b4c4b-3501-4641-9c46-e3d989eefc56 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] 10.222.0.13 "GET /compute/v2.1/servers/detail?name=tempest-ListServerFiltersTestJSON-instance-1380889138" status: 200 len: 1516 microversion: 2.1 time: 0.361177 Nov 01 19:09:59.247715 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1981/3847] 10.222.0.13 () {58 vars in 1263 bytes} [Tue Nov 1 19:09:58 2022] GET /compute/v2.1/servers/detail?name=tempest-ListServerFiltersTestJSON-instance-1380889138 => generated 1516 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:09:59.264151 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-4138905c-08a9-4ed0-bff1-f7e9ecefb634 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:09:59.264856 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-4138905c-08a9-4ed0-bff1-f7e9ecefb634 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] [instance: 43b22dd3-debb-4a6d-81fc-4666e5bb7804] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:09:59.277058 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-4138905c-08a9-4ed0-bff1-f7e9ecefb634 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:09:59.277554 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-4138905c-08a9-4ed0-bff1-f7e9ecefb634 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:09:59.277989 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-4138905c-08a9-4ed0-bff1-f7e9ecefb634 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:09:59.278686 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-4138905c-08a9-4ed0-bff1-f7e9ecefb634 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:09:59.279034 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-a673b61d-f527-4d30-bc85-8aeba35ca9f5 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:09:59.279170 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-4138905c-08a9-4ed0-bff1-f7e9ecefb634 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:09:59.279550 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-4138905c-08a9-4ed0-bff1-f7e9ecefb634 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:09:59.284556 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-a673b61d-f527-4d30-bc85-8aeba35ca9f5 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '2868ccfdfb164cffa37232c821f205a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04ef687c40bd45c297d22a791bae58cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:09:59.285420 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-a673b61d-f527-4d30-bc85-8aeba35ca9f5 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Searching by: {'vm_state': ['active'], 'deleted': False, 'project_id': '04ef687c40bd45c297d22a791bae58cf'} {{(pid=121403) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 01 19:09:59.291332 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-a673b61d-f527-4d30-bc85-8aeba35ca9f5 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:09:59.291817 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-a673b61d-f527-4d30-bc85-8aeba35ca9f5 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:09:59.292296 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-a673b61d-f527-4d30-bc85-8aeba35ca9f5 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:09:59.292981 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-a673b61d-f527-4d30-bc85-8aeba35ca9f5 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:09:59.293736 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-a673b61d-f527-4d30-bc85-8aeba35ca9f5 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:09:59.294357 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-a673b61d-f527-4d30-bc85-8aeba35ca9f5 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:09:59.491963 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-4138905c-08a9-4ed0-bff1-f7e9ecefb634 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113bd8c844ee490b86a68bc7e1e75da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '851785a5f76548898a77d67792888504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:09:59.499988 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-4138905c-08a9-4ed0-bff1-f7e9ecefb634 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] 10.222.0.13 "GET /compute/v2.1/servers/43b22dd3-debb-4a6d-81fc-4666e5bb7804" status: 200 len: 1488 microversion: 2.1 time: 0.245059 Nov 01 19:09:59.517261 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1867/3848] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:09:59 2022] GET /compute/v2.1/servers/43b22dd3-debb-4a6d-81fc-4666e5bb7804 => generated 1488 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:09:59.525681 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-9a5b6e2f-cbe9-4f20-8a51-7d9b030201d8 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:09:59.526683 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-9a5b6e2f-cbe9-4f20-8a51-7d9b030201d8 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] [instance: 43b22dd3-debb-4a6d-81fc-4666e5bb7804] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:09:59.533258 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-9a5b6e2f-cbe9-4f20-8a51-7d9b030201d8 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:09:59.534113 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-9a5b6e2f-cbe9-4f20-8a51-7d9b030201d8 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:09:59.534752 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-9a5b6e2f-cbe9-4f20-8a51-7d9b030201d8 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:09:59.535740 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-9a5b6e2f-cbe9-4f20-8a51-7d9b030201d8 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:09:59.536446 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-9a5b6e2f-cbe9-4f20-8a51-7d9b030201d8 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:09:59.537109 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-9a5b6e2f-cbe9-4f20-8a51-7d9b030201d8 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:09:59.700859 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.multi_cell_list [None req-a673b61d-f527-4d30-bc85-8aeba35ca9f5 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=121403) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 01 19:09:59.705247 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-9a5b6e2f-cbe9-4f20-8a51-7d9b030201d8 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113bd8c844ee490b86a68bc7e1e75da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '851785a5f76548898a77d67792888504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:09:59.715050 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-9a5b6e2f-cbe9-4f20-8a51-7d9b030201d8 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] 10.222.0.13 "GET /compute/v2.1/servers/43b22dd3-debb-4a6d-81fc-4666e5bb7804" status: 200 len: 1488 microversion: 2.1 time: 0.193326 Nov 01 19:09:59.715646 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1868/3849] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:09:59 2022] GET /compute/v2.1/servers/43b22dd3-debb-4a6d-81fc-4666e5bb7804 => generated 1488 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:09:59.738890 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-28dcf867-2fb4-4251-bd23-1e7e2040e6c1 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:09:59.739649 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-28dcf867-2fb4-4251-bd23-1e7e2040e6c1 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] [instance: 43b22dd3-debb-4a6d-81fc-4666e5bb7804] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:09:59.746911 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-28dcf867-2fb4-4251-bd23-1e7e2040e6c1 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:09:59.747675 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-28dcf867-2fb4-4251-bd23-1e7e2040e6c1 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:09:59.748113 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-28dcf867-2fb4-4251-bd23-1e7e2040e6c1 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:09:59.748878 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-28dcf867-2fb4-4251-bd23-1e7e2040e6c1 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:09:59.749493 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-28dcf867-2fb4-4251-bd23-1e7e2040e6c1 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:09:59.749932 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-28dcf867-2fb4-4251-bd23-1e7e2040e6c1 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:09:59.777248 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-28dcf867-2fb4-4251-bd23-1e7e2040e6c1 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] [instance: 43b22dd3-debb-4a6d-81fc-4666e5bb7804] Going to try to terminate instance {{(pid=121402) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 01 19:09:59.779877 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-a673b61d-f527-4d30-bc85-8aeba35ca9f5 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2868ccfdfb164cffa37232c821f205a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04ef687c40bd45c297d22a791bae58cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:09:59.788309 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-a673b61d-f527-4d30-bc85-8aeba35ca9f5 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:09:59.788831 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-a673b61d-f527-4d30-bc85-8aeba35ca9f5 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:09:59.789624 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-a673b61d-f527-4d30-bc85-8aeba35ca9f5 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:09:59.868664 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-28dcf867-2fb4-4251-bd23-1e7e2040e6c1 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] 10.222.0.13 "DELETE /compute/v2.1/servers/43b22dd3-debb-4a6d-81fc-4666e5bb7804" status: 204 len: 0 microversion: 2.1 time: 0.134214 Nov 01 19:09:59.872099 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1869/3850] 10.222.0.13 () {58 vars in 1239 bytes} [Tue Nov 1 19:09:59 2022] DELETE /compute/v2.1/servers/43b22dd3-debb-4a6d-81fc-4666e5bb7804 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 01 19:09:59.880348 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-c2ac803d-ab00-4e13-ae6d-83b2f9d031d5 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:09:59.883192 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-c2ac803d-ab00-4e13-ae6d-83b2f9d031d5 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] [instance: 43b22dd3-debb-4a6d-81fc-4666e5bb7804] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:09:59.893668 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-c2ac803d-ab00-4e13-ae6d-83b2f9d031d5 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:09:59.894171 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-c2ac803d-ab00-4e13-ae6d-83b2f9d031d5 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:09:59.895266 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-c2ac803d-ab00-4e13-ae6d-83b2f9d031d5 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:09:59.895972 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-c2ac803d-ab00-4e13-ae6d-83b2f9d031d5 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:09:59.896805 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-c2ac803d-ab00-4e13-ae6d-83b2f9d031d5 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:09:59.896929 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-c2ac803d-ab00-4e13-ae6d-83b2f9d031d5 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:09:59.966149 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-a673b61d-f527-4d30-bc85-8aeba35ca9f5 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] 10.222.0.13 "GET /compute/v2.1/servers/detail?status=active" status: 200 len: 4520 microversion: 2.1 time: 0.691930 Nov 01 19:09:59.967190 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1982/3851] 10.222.0.13 () {58 vars in 1173 bytes} [Tue Nov 1 19:09:59 2022] GET /compute/v2.1/servers/detail?status=active => generated 4520 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 19:09:59.994012 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-26580b73-e6af-4fc6-b405-f465d8f6e72b tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:09:59.999162 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-26580b73-e6af-4fc6-b405-f465d8f6e72b tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '2868ccfdfb164cffa37232c821f205a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04ef687c40bd45c297d22a791bae58cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:10:00.001127 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.compute.servers [None req-26580b73-e6af-4fc6-b405-f465d8f6e72b tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Removing options 'limit' from query {{(pid=121403) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Nov 01 19:10:00.001917 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-26580b73-e6af-4fc6-b405-f465d8f6e72b tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Searching by: {'deleted': False, 'project_id': '04ef687c40bd45c297d22a791bae58cf'} {{(pid=121403) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 01 19:10:00.008170 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-26580b73-e6af-4fc6-b405-f465d8f6e72b tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:00.008693 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-26580b73-e6af-4fc6-b405-f465d8f6e72b tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:00.009145 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-26580b73-e6af-4fc6-b405-f465d8f6e72b tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:00.009859 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-26580b73-e6af-4fc6-b405-f465d8f6e72b tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:00.010319 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-26580b73-e6af-4fc6-b405-f465d8f6e72b tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:00.010748 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-26580b73-e6af-4fc6-b405-f465d8f6e72b tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:00.046924 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-26580b73-e6af-4fc6-b405-f465d8f6e72b tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2868ccfdfb164cffa37232c821f205a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04ef687c40bd45c297d22a791bae58cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:10:00.053330 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-26580b73-e6af-4fc6-b405-f465d8f6e72b tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:00.053929 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-26580b73-e6af-4fc6-b405-f465d8f6e72b tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:00.054443 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-26580b73-e6af-4fc6-b405-f465d8f6e72b tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:00.057328 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-c2ac803d-ab00-4e13-ae6d-83b2f9d031d5 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113bd8c844ee490b86a68bc7e1e75da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '851785a5f76548898a77d67792888504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:10:00.068124 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-c2ac803d-ab00-4e13-ae6d-83b2f9d031d5 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] 10.222.0.13 "GET /compute/v2.1/servers/43b22dd3-debb-4a6d-81fc-4666e5bb7804" status: 200 len: 1494 microversion: 2.1 time: 0.192221 Nov 01 19:10:00.068728 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1870/3852] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:09:59 2022] GET /compute/v2.1/servers/43b22dd3-debb-4a6d-81fc-4666e5bb7804 => generated 1494 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 19:10:00.170929 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-26580b73-e6af-4fc6-b405-f465d8f6e72b tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] 10.222.0.13 "GET /compute/v2.1/servers/detail?limit=1" status: 200 len: 1661 microversion: 2.1 time: 0.180767 Nov 01 19:10:00.171529 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1983/3853] 10.222.0.13 () {58 vars in 1161 bytes} [Tue Nov 1 19:09:59 2022] GET /compute/v2.1/servers/detail?limit=1 => generated 1661 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:10:00.195943 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-32c67305-2687-48d8-9971-faa33b925fd6 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:10:00.200857 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-32c67305-2687-48d8-9971-faa33b925fd6 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '2868ccfdfb164cffa37232c821f205a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04ef687c40bd45c297d22a791bae58cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:10:00.201684 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-32c67305-2687-48d8-9971-faa33b925fd6 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Searching by: {'vm_state': ['active'], 'deleted': False, 'project_id': '04ef687c40bd45c297d22a791bae58cf'} {{(pid=121402) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 01 19:10:00.204924 n-d-863052-2 devstack@n-api.service[121402]: DEBUG dbcounter [-] [121402] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=121402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 19:10:00.207984 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-32c67305-2687-48d8-9971-faa33b925fd6 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:00.208463 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-32c67305-2687-48d8-9971-faa33b925fd6 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:00.208926 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-32c67305-2687-48d8-9971-faa33b925fd6 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:00.209642 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-32c67305-2687-48d8-9971-faa33b925fd6 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:00.210115 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-32c67305-2687-48d8-9971-faa33b925fd6 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:00.210539 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-32c67305-2687-48d8-9971-faa33b925fd6 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:00.241312 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.multi_cell_list [None req-32c67305-2687-48d8-9971-faa33b925fd6 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=121402) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 01 19:10:00.269058 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-7f1735a5-e284-4ea0-a2b1-b8e31777865a tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:10:00.269711 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-7f1735a5-e284-4ea0-a2b1-b8e31777865a tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] [instance: 8c460f41-9dc1-4f0c-9d2d-0a91b38f7787] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:10:00.275781 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-7f1735a5-e284-4ea0-a2b1-b8e31777865a tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:00.276191 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-7f1735a5-e284-4ea0-a2b1-b8e31777865a tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:00.276939 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-7f1735a5-e284-4ea0-a2b1-b8e31777865a tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:00.277088 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-32c67305-2687-48d8-9971-faa33b925fd6 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] 10.222.0.13 "GET /compute/v2.1/servers?status=active" status: 200 len: 1010 microversion: 2.1 time: 0.085304 Nov 01 19:10:00.277649 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-7f1735a5-e284-4ea0-a2b1-b8e31777865a tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:00.278024 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1871/3854] 10.222.0.13 () {58 vars in 1152 bytes} [Tue Nov 1 19:10:00 2022] GET /compute/v2.1/servers?status=active => generated 1010 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:10:00.278150 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-7f1735a5-e284-4ea0-a2b1-b8e31777865a tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:00.278728 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-7f1735a5-e284-4ea0-a2b1-b8e31777865a tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:00.290966 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-57b85415-40c9-440e-87e9-713e2d959c6e tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:10:00.295964 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-57b85415-40c9-440e-87e9-713e2d959c6e tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '2868ccfdfb164cffa37232c821f205a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04ef687c40bd45c297d22a791bae58cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:10:00.296432 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.compute.servers [None req-57b85415-40c9-440e-87e9-713e2d959c6e tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Removing options 'limit' from query {{(pid=121402) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Nov 01 19:10:00.297133 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-57b85415-40c9-440e-87e9-713e2d959c6e tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Searching by: {'deleted': False, 'project_id': '04ef687c40bd45c297d22a791bae58cf'} {{(pid=121402) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 01 19:10:00.303049 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-57b85415-40c9-440e-87e9-713e2d959c6e tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:00.303523 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-57b85415-40c9-440e-87e9-713e2d959c6e tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:00.304176 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-57b85415-40c9-440e-87e9-713e2d959c6e tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:00.305106 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-57b85415-40c9-440e-87e9-713e2d959c6e tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:00.305566 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-57b85415-40c9-440e-87e9-713e2d959c6e tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:00.305992 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-57b85415-40c9-440e-87e9-713e2d959c6e tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:00.348843 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-7f1735a5-e284-4ea0-a2b1-b8e31777865a tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '058480d92c9b4ab4af6815d0438a65c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee9dc49b89143f781e4ab30296e4d01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:10:00.358253 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-7f1735a5-e284-4ea0-a2b1-b8e31777865a tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] 10.222.0.13 "GET /compute/v2.1/servers/8c460f41-9dc1-4f0c-9d2d-0a91b38f7787" status: 200 len: 1264 microversion: 2.1 time: 0.092850 Nov 01 19:10:00.359435 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1984/3855] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:10:00 2022] GET /compute/v2.1/servers/8c460f41-9dc1-4f0c-9d2d-0a91b38f7787 => generated 1264 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:10:00.569395 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.multi_cell_list [None req-57b85415-40c9-440e-87e9-713e2d959c6e tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=121402) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 01 19:10:00.597201 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-57b85415-40c9-440e-87e9-713e2d959c6e tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] 10.222.0.13 "GET /compute/v2.1/servers?limit=100000" status: 200 len: 1010 microversion: 2.1 time: 0.310077 Nov 01 19:10:00.598451 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1872/3856] 10.222.0.13 () {58 vars in 1150 bytes} [Tue Nov 1 19:10:00 2022] GET /compute/v2.1/servers?limit=100000 => generated 1010 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 19:10:00.610395 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-cd28942a-9ce6-4163-94a9-9082a1f7595e tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:10:00.615725 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-cd28942a-9ce6-4163-94a9-9082a1f7595e tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '2868ccfdfb164cffa37232c821f205a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04ef687c40bd45c297d22a791bae58cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:10:00.616377 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-cd28942a-9ce6-4163-94a9-9082a1f7595e tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Searching by: {'deleted': False, 'project_id': '04ef687c40bd45c297d22a791bae58cf'} {{(pid=121403) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 01 19:10:00.621456 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-cd28942a-9ce6-4163-94a9-9082a1f7595e tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:00.621935 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-cd28942a-9ce6-4163-94a9-9082a1f7595e tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:00.622362 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-cd28942a-9ce6-4163-94a9-9082a1f7595e tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:00.623183 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-cd28942a-9ce6-4163-94a9-9082a1f7595e tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:00.623663 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-cd28942a-9ce6-4163-94a9-9082a1f7595e tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:00.624082 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-cd28942a-9ce6-4163-94a9-9082a1f7595e tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:00.650839 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.multi_cell_list [None req-cd28942a-9ce6-4163-94a9-9082a1f7595e tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=121403) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 01 19:10:00.667770 n-d-863052-2 devstack@n-api.service[121403]: DEBUG dbcounter [-] [121403] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 19:10:00.686856 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-cd28942a-9ce6-4163-94a9-9082a1f7595e tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] 10.222.0.13 "GET /compute/v2.1/servers" status: 200 len: 1010 microversion: 2.1 time: 0.079787 Nov 01 19:10:00.687451 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1985/3857] 10.222.0.13 () {58 vars in 1125 bytes} [Tue Nov 1 19:10:00 2022] GET /compute/v2.1/servers => generated 1010 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:10:00.700509 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-133baffd-b6db-49ce-8481-b88f95dbe401 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:10:00.705426 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-133baffd-b6db-49ce-8481-b88f95dbe401 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '2868ccfdfb164cffa37232c821f205a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04ef687c40bd45c297d22a791bae58cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:10:00.706081 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-133baffd-b6db-49ce-8481-b88f95dbe401 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Searching by: {'flavor': '451', 'deleted': False, 'project_id': '04ef687c40bd45c297d22a791bae58cf'} {{(pid=121402) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 01 19:10:00.717572 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-133baffd-b6db-49ce-8481-b88f95dbe401 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:00.718060 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-133baffd-b6db-49ce-8481-b88f95dbe401 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:00.718505 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-133baffd-b6db-49ce-8481-b88f95dbe401 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:00.719224 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-133baffd-b6db-49ce-8481-b88f95dbe401 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:00.719878 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-133baffd-b6db-49ce-8481-b88f95dbe401 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:00.720305 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-133baffd-b6db-49ce-8481-b88f95dbe401 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:00.806795 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.multi_cell_list [None req-133baffd-b6db-49ce-8481-b88f95dbe401 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=121402) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 01 19:10:00.867177 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-133baffd-b6db-49ce-8481-b88f95dbe401 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] 10.222.0.13 "GET /compute/v2.1/servers?flavor=451" status: 200 len: 345 microversion: 2.1 time: 0.170319 Nov 01 19:10:00.867751 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1873/3858] 10.222.0.13 () {58 vars in 1146 bytes} [Tue Nov 1 19:10:00 2022] GET /compute/v2.1/servers?flavor=451 => generated 345 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:10:00.881343 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-3c0b45f9-946f-4dad-a1a2-ee3eeb4eef33 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:10:00.886486 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-3c0b45f9-946f-4dad-a1a2-ee3eeb4eef33 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '2868ccfdfb164cffa37232c821f205a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04ef687c40bd45c297d22a791bae58cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:10:00.886933 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.compute.servers [None req-3c0b45f9-946f-4dad-a1a2-ee3eeb4eef33 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Removing options 'limit' from query {{(pid=121403) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Nov 01 19:10:00.887582 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-3c0b45f9-946f-4dad-a1a2-ee3eeb4eef33 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Searching by: {'deleted': False, 'project_id': '04ef687c40bd45c297d22a791bae58cf'} {{(pid=121403) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 01 19:10:00.893636 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-3c0b45f9-946f-4dad-a1a2-ee3eeb4eef33 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:00.894109 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-3c0b45f9-946f-4dad-a1a2-ee3eeb4eef33 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:00.895058 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-3c0b45f9-946f-4dad-a1a2-ee3eeb4eef33 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:00.895772 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-3c0b45f9-946f-4dad-a1a2-ee3eeb4eef33 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:00.896252 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-3c0b45f9-946f-4dad-a1a2-ee3eeb4eef33 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:00.896692 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-3c0b45f9-946f-4dad-a1a2-ee3eeb4eef33 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:00.922962 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-3c0b45f9-946f-4dad-a1a2-ee3eeb4eef33 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] 10.222.0.13 "GET /compute/v2.1/servers?limit=1" status: 200 len: 484 microversion: 2.1 time: 0.045873 Nov 01 19:10:00.923541 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1986/3859] 10.222.0.13 () {58 vars in 1140 bytes} [Tue Nov 1 19:10:00 2022] GET /compute/v2.1/servers?limit=1 => generated 484 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:10:00.937376 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-4a8f6023-6350-4457-98b7-14bab2676388 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:10:00.942630 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-4a8f6023-6350-4457-98b7-14bab2676388 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '2868ccfdfb164cffa37232c821f205a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04ef687c40bd45c297d22a791bae58cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:10:00.943303 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-4a8f6023-6350-4457-98b7-14bab2676388 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Searching by: {'name': 'tempest-ListServerFiltersTestJSON-instance-1380889138', 'deleted': False, 'project_id': '04ef687c40bd45c297d22a791bae58cf'} {{(pid=121402) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 01 19:10:00.948410 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-4a8f6023-6350-4457-98b7-14bab2676388 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:00.948928 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-4a8f6023-6350-4457-98b7-14bab2676388 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:00.949364 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-4a8f6023-6350-4457-98b7-14bab2676388 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:00.950213 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-4a8f6023-6350-4457-98b7-14bab2676388 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:00.950674 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-4a8f6023-6350-4457-98b7-14bab2676388 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:00.951098 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-4a8f6023-6350-4457-98b7-14bab2676388 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:01.036892 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.multi_cell_list [None req-4a8f6023-6350-4457-98b7-14bab2676388 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=121402) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 01 19:10:01.093446 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-87a2fdf8-6f3e-4853-a839-dbdf398f0869 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:10:01.094222 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-87a2fdf8-6f3e-4853-a839-dbdf398f0869 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] [instance: 43b22dd3-debb-4a6d-81fc-4666e5bb7804] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:10:01.101226 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-87a2fdf8-6f3e-4853-a839-dbdf398f0869 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:01.101857 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-4a8f6023-6350-4457-98b7-14bab2676388 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] 10.222.0.13 "GET /compute/v2.1/servers?name=tempest-ListServerFiltersTestJSON-instance-1380889138" status: 200 len: 346 microversion: 2.1 time: 0.168678 Nov 01 19:10:01.102859 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-87a2fdf8-6f3e-4853-a839-dbdf398f0869 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:01.103538 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-87a2fdf8-6f3e-4853-a839-dbdf398f0869 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:01.104358 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1874/3860] 10.222.0.13 () {58 vars in 1242 bytes} [Tue Nov 1 19:10:00 2022] GET /compute/v2.1/servers?name=tempest-ListServerFiltersTestJSON-instance-1380889138 => generated 346 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 01 19:10:01.104897 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-87a2fdf8-6f3e-4853-a839-dbdf398f0869 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:01.105516 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-87a2fdf8-6f3e-4853-a839-dbdf398f0869 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:01.106109 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-87a2fdf8-6f3e-4853-a839-dbdf398f0869 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:01.115913 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-f6b3cb50-3a21-4be0-a810-32e37a603b34 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:10:01.122411 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f6b3cb50-3a21-4be0-a810-32e37a603b34 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:01.122984 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f6b3cb50-3a21-4be0-a810-32e37a603b34 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:01.123604 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f6b3cb50-3a21-4be0-a810-32e37a603b34 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:01.204268 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-f6b3cb50-3a21-4be0-a810-32e37a603b34 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] [instance: ac19dd18-c22a-46de-91ef-454a0b78872f] Going to try to stop instance {{(pid=121402) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Nov 01 19:10:01.260234 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-f6b3cb50-3a21-4be0-a810-32e37a603b34 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] 10.222.0.13 "POST /compute/v2.1/servers/ac19dd18-c22a-46de-91ef-454a0b78872f/action" status: 202 len: 0 microversion: 2.1 time: 0.147909 Nov 01 19:10:01.264416 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1875/3861] 10.222.0.13 () {60 vars in 1278 bytes} [Tue Nov 1 19:10:01 2022] POST /compute/v2.1/servers/ac19dd18-c22a-46de-91ef-454a0b78872f/action => generated 0 bytes in 150 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 01 19:10:01.272002 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-949b262f-ed86-4070-83e4-0bc806d40cf7 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:10:01.273052 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-949b262f-ed86-4070-83e4-0bc806d40cf7 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] [instance: ac19dd18-c22a-46de-91ef-454a0b78872f] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:10:01.281224 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-949b262f-ed86-4070-83e4-0bc806d40cf7 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:01.282233 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-949b262f-ed86-4070-83e4-0bc806d40cf7 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:01.283312 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-949b262f-ed86-4070-83e4-0bc806d40cf7 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:01.284403 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-949b262f-ed86-4070-83e4-0bc806d40cf7 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:01.284761 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-87a2fdf8-6f3e-4853-a839-dbdf398f0869 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113bd8c844ee490b86a68bc7e1e75da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '851785a5f76548898a77d67792888504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:10:01.285762 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-949b262f-ed86-4070-83e4-0bc806d40cf7 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:01.286373 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-949b262f-ed86-4070-83e4-0bc806d40cf7 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:01.294683 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-87a2fdf8-6f3e-4853-a839-dbdf398f0869 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] 10.222.0.13 "GET /compute/v2.1/servers/43b22dd3-debb-4a6d-81fc-4666e5bb7804" status: 200 len: 1494 microversion: 2.1 time: 0.205103 Nov 01 19:10:01.295309 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1987/3862] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:10:01 2022] GET /compute/v2.1/servers/43b22dd3-debb-4a6d-81fc-4666e5bb7804 => generated 1494 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 19:10:01.383692 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-b83bed71-439b-4338-b5c9-b367b6d2938e tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:10:01.384301 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-b83bed71-439b-4338-b5c9-b367b6d2938e tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] [instance: 8c460f41-9dc1-4f0c-9d2d-0a91b38f7787] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:10:01.390344 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-b83bed71-439b-4338-b5c9-b367b6d2938e tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:01.390818 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-b83bed71-439b-4338-b5c9-b367b6d2938e tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:01.391248 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-b83bed71-439b-4338-b5c9-b367b6d2938e tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:01.391929 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-b83bed71-439b-4338-b5c9-b367b6d2938e tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:01.392385 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-b83bed71-439b-4338-b5c9-b367b6d2938e tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:01.392832 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-b83bed71-439b-4338-b5c9-b367b6d2938e tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:01.455517 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-b83bed71-439b-4338-b5c9-b367b6d2938e tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '058480d92c9b4ab4af6815d0438a65c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee9dc49b89143f781e4ab30296e4d01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:10:01.465908 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-b83bed71-439b-4338-b5c9-b367b6d2938e tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] 10.222.0.13 "GET /compute/v2.1/servers/8c460f41-9dc1-4f0c-9d2d-0a91b38f7787" status: 200 len: 1264 microversion: 2.1 time: 0.086734 Nov 01 19:10:01.466638 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1988/3863] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:10:01 2022] GET /compute/v2.1/servers/8c460f41-9dc1-4f0c-9d2d-0a91b38f7787 => generated 1264 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 19:10:01.593885 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-949b262f-ed86-4070-83e4-0bc806d40cf7 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2868ccfdfb164cffa37232c821f205a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04ef687c40bd45c297d22a791bae58cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:10:01.602725 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-949b262f-ed86-4070-83e4-0bc806d40cf7 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] 10.222.0.13 "GET /compute/v2.1/servers/ac19dd18-c22a-46de-91ef-454a0b78872f" status: 200 len: 1523 microversion: 2.1 time: 0.335898 Nov 01 19:10:01.603787 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1876/3864] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:10:01 2022] GET /compute/v2.1/servers/ac19dd18-c22a-46de-91ef-454a0b78872f => generated 1523 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 19:10:02.146021 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [req-a7191307-d1b5-45cd-9723-33faa44f43fd req-c0225bc9-f738-4873-96bb-e1b5450523fe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "43b22dd3-debb-4a6d-81fc-4666e5bb7804", "name": "network-vif-deleted", "tag": "73fe4105-122c-4088-8dcb-2d3dec7104d3"}]} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:10:02.164245 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-a7191307-d1b5-45cd-9723-33faa44f43fd req-c0225bc9-f738-4873-96bb-e1b5450523fe service nova] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:02.164862 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-a7191307-d1b5-45cd-9723-33faa44f43fd req-c0225bc9-f738-4873-96bb-e1b5450523fe service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:02.165200 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-a7191307-d1b5-45cd-9723-33faa44f43fd req-c0225bc9-f738-4873-96bb-e1b5450523fe service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:02.197015 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.compute.server_external_events [req-a7191307-d1b5-45cd-9723-33faa44f43fd req-c0225bc9-f738-4873-96bb-e1b5450523fe service nova] Creating event network-vif-deleted:73fe4105-122c-4088-8dcb-2d3dec7104d3 for instance 43b22dd3-debb-4a6d-81fc-4666e5bb7804 on n-h1-863052-2 Nov 01 19:10:02.208134 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [req-a7191307-d1b5-45cd-9723-33faa44f43fd req-c0225bc9-f738-4873-96bb-e1b5450523fe service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065908 Nov 01 19:10:02.208851 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1989/3865] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Nov 1 19:10:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:10:02.318242 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-471bc8cb-c8ad-4fc5-b151-0d31385d0c15 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:10:02.319491 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-471bc8cb-c8ad-4fc5-b151-0d31385d0c15 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] [instance: 43b22dd3-debb-4a6d-81fc-4666e5bb7804] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:10:02.328686 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-471bc8cb-c8ad-4fc5-b151-0d31385d0c15 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:02.329448 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-471bc8cb-c8ad-4fc5-b151-0d31385d0c15 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:02.330135 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-471bc8cb-c8ad-4fc5-b151-0d31385d0c15 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:02.331066 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-471bc8cb-c8ad-4fc5-b151-0d31385d0c15 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:02.331751 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-471bc8cb-c8ad-4fc5-b151-0d31385d0c15 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:02.332456 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-471bc8cb-c8ad-4fc5-b151-0d31385d0c15 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:02.371883 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-471bc8cb-c8ad-4fc5-b151-0d31385d0c15 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:02.372528 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-471bc8cb-c8ad-4fc5-b151-0d31385d0c15 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:02.373120 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-471bc8cb-c8ad-4fc5-b151-0d31385d0c15 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:02.373674 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.objects.instance [None req-471bc8cb-c8ad-4fc5-b151-0d31385d0c15 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lazy-loading 'fault' on Instance uuid 43b22dd3-debb-4a6d-81fc-4666e5bb7804 {{(pid=121402) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 01 19:10:02.437916 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-471bc8cb-c8ad-4fc5-b151-0d31385d0c15 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113bd8c844ee490b86a68bc7e1e75da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '851785a5f76548898a77d67792888504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:10:02.449198 n-d-863052-2 devstack@n-api.service[121402]: DEBUG dbcounter [-] [121402] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=121402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 19:10:02.453748 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-471bc8cb-c8ad-4fc5-b151-0d31385d0c15 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] 10.222.0.13 "GET /compute/v2.1/servers/43b22dd3-debb-4a6d-81fc-4666e5bb7804" status: 200 len: 1310 microversion: 2.1 time: 0.139560 Nov 01 19:10:02.468763 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1877/3866] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:10:02 2022] GET /compute/v2.1/servers/43b22dd3-debb-4a6d-81fc-4666e5bb7804 => generated 1310 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:10:02.493398 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-599d8d1c-b976-4676-8d4a-f2a48d3d172b tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:10:02.494104 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-599d8d1c-b976-4676-8d4a-f2a48d3d172b tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] [instance: 8c460f41-9dc1-4f0c-9d2d-0a91b38f7787] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:10:02.511759 n-d-863052-2 devstack@n-api.service[121403]: DEBUG dbcounter [-] [121403] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=121403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 19:10:02.516455 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-599d8d1c-b976-4676-8d4a-f2a48d3d172b tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:02.517013 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-599d8d1c-b976-4676-8d4a-f2a48d3d172b tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:02.517458 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-599d8d1c-b976-4676-8d4a-f2a48d3d172b tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:02.518178 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-599d8d1c-b976-4676-8d4a-f2a48d3d172b tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:02.518646 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-599d8d1c-b976-4676-8d4a-f2a48d3d172b tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:02.519068 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-599d8d1c-b976-4676-8d4a-f2a48d3d172b tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:02.615998 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-599d8d1c-b976-4676-8d4a-f2a48d3d172b tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '058480d92c9b4ab4af6815d0438a65c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee9dc49b89143f781e4ab30296e4d01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:10:02.626464 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-599d8d1c-b976-4676-8d4a-f2a48d3d172b tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] 10.222.0.13 "GET /compute/v2.1/servers/8c460f41-9dc1-4f0c-9d2d-0a91b38f7787" status: 200 len: 1270 microversion: 2.1 time: 0.138661 Nov 01 19:10:02.626854 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-4ba30c5d-a2cf-40ad-a85f-bf856313a9d7 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:10:02.636351 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1990/3867] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:10:02 2022] GET /compute/v2.1/servers/8c460f41-9dc1-4f0c-9d2d-0a91b38f7787 => generated 1270 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:10:02.637543 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-4ba30c5d-a2cf-40ad-a85f-bf856313a9d7 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] [instance: ac19dd18-c22a-46de-91ef-454a0b78872f] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:10:02.648767 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-4ba30c5d-a2cf-40ad-a85f-bf856313a9d7 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:02.649519 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-4ba30c5d-a2cf-40ad-a85f-bf856313a9d7 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:02.650562 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-4ba30c5d-a2cf-40ad-a85f-bf856313a9d7 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:02.651275 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-4ba30c5d-a2cf-40ad-a85f-bf856313a9d7 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:02.652373 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-4ba30c5d-a2cf-40ad-a85f-bf856313a9d7 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:02.652984 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-4ba30c5d-a2cf-40ad-a85f-bf856313a9d7 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:02.916455 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-4ba30c5d-a2cf-40ad-a85f-bf856313a9d7 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2868ccfdfb164cffa37232c821f205a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04ef687c40bd45c297d22a791bae58cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:10:02.931823 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-4ba30c5d-a2cf-40ad-a85f-bf856313a9d7 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] 10.222.0.13 "GET /compute/v2.1/servers/ac19dd18-c22a-46de-91ef-454a0b78872f" status: 200 len: 1523 microversion: 2.1 time: 0.308217 Nov 01 19:10:02.946395 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1878/3868] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:10:02 2022] GET /compute/v2.1/servers/ac19dd18-c22a-46de-91ef-454a0b78872f => generated 1523 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 19:10:03.478491 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-a3294b47-a74c-4948-b80e-c33ca8473dfe tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:10:03.480288 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-a3294b47-a74c-4948-b80e-c33ca8473dfe tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] [instance: 43b22dd3-debb-4a6d-81fc-4666e5bb7804] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:10:03.489632 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-a3294b47-a74c-4948-b80e-c33ca8473dfe tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:03.490289 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-a3294b47-a74c-4948-b80e-c33ca8473dfe tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:03.490810 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-a3294b47-a74c-4948-b80e-c33ca8473dfe tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:03.491801 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-a3294b47-a74c-4948-b80e-c33ca8473dfe tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:03.492541 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-a3294b47-a74c-4948-b80e-c33ca8473dfe tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:03.493171 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-a3294b47-a74c-4948-b80e-c33ca8473dfe tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:03.513488 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.wsgi [None req-a3294b47-a74c-4948-b80e-c33ca8473dfe tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] HTTP exception thrown: Instance 43b22dd3-debb-4a6d-81fc-4666e5bb7804 could not be found. Nov 01 19:10:03.515145 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-a3294b47-a74c-4948-b80e-c33ca8473dfe tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Request method failure captured: Nov 01 19:10:03.515145 n-d-863052-2 devstack@n-api.service[121403]: request: GET /compute/v2.1/servers/43b22dd3-debb-4a6d-81fc-4666e5bb7804 HTTP/1.1 Nov 01 19:10:03.515145 n-d-863052-2 devstack@n-api.service[121403]: Accept: application/json Nov 01 19:10:03.515145 n-d-863052-2 devstack@n-api.service[121403]: Accept-Encoding: identity Nov 01 19:10:03.515145 n-d-863052-2 devstack@n-api.service[121403]: Connection: close Nov 01 19:10:03.515145 n-d-863052-2 devstack@n-api.service[121403]: Content-Length: 0 Nov 01 19:10:03.515145 n-d-863052-2 devstack@n-api.service[121403]: Content-Type: application/json Nov 01 19:10:03.515145 n-d-863052-2 devstack@n-api.service[121403]: Host: 10.222.0.13 Nov 01 19:10:03.515145 n-d-863052-2 devstack@n-api.service[121403]: Openstack-System-Scope: None Nov 01 19:10:03.515145 n-d-863052-2 devstack@n-api.service[121403]: User-Agent: python-urllib3/1.26.12 Nov 01 19:10:03.515145 n-d-863052-2 devstack@n-api.service[121403]: X-Auth-Token: gAAAAABjYW4_RJI8gKBQs81ShXQrfTSIzrNvaZj2e2rGhpR5xhmtuxP4h5uZIl9SLPqPqJ9Syn39UO-el4mPnuEEOGnWtpNlTopD6-Pc1m-VWD64ggyrfBZwUB0hnjNvBvBk6ge071YBJx2gxTN_InEu4tuxz3s-3IQBbEpMSIJZ4VoUIbz4DgY Nov 01 19:10:03.515145 n-d-863052-2 devstack@n-api.service[121403]: X-Domain-Id: None Nov 01 19:10:03.515145 n-d-863052-2 devstack@n-api.service[121403]: X-Domain-Name: None Nov 01 19:10:03.515145 n-d-863052-2 devstack@n-api.service[121403]: X-Identity-Status: Confirmed Nov 01 19:10:03.515145 n-d-863052-2 devstack@n-api.service[121403]: X-Is-Admin-Project: True Nov 01 19:10:03.515145 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Domain-Id: default Nov 01 19:10:03.515145 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Domain-Name: Default Nov 01 19:10:03.515145 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Id: 851785a5f76548898a77d67792888504 Nov 01 19:10:03.515145 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Name: tempest-ServersTestJSON-917766486 Nov 01 19:10:03.515145 n-d-863052-2 devstack@n-api.service[121403]: X-Role: member,reader Nov 01 19:10:03.515145 n-d-863052-2 devstack@n-api.service[121403]: X-Roles: member,reader Nov 01 19:10:03.515145 n-d-863052-2 devstack@n-api.service[121403]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/851785a5f76548898a77d67792888504"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/851785a5f76548898a77d67792888504"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_851785a5f76548898a77d67792888504", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/851785a5f76548898a77d67792888504"}]}] Nov 01 19:10:03.515145 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant: tempest-ServersTestJSON-917766486 Nov 01 19:10:03.515145 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant-Id: 851785a5f76548898a77d67792888504 Nov 01 19:10:03.515145 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant-Name: tempest-ServersTestJSON-917766486 Nov 01 19:10:03.515145 n-d-863052-2 devstack@n-api.service[121403]: X-User: tempest-ServersTestJSON-917766486-project Nov 01 19:10:03.515145 n-d-863052-2 devstack@n-api.service[121403]: X-User-Domain-Id: default Nov 01 19:10:03.515145 n-d-863052-2 devstack@n-api.service[121403]: X-User-Domain-Name: Default Nov 01 19:10:03.515145 n-d-863052-2 devstack@n-api.service[121403]: X-User-Id: 113bd8c844ee490b86a68bc7e1e75da3 Nov 01 19:10:03.515145 n-d-863052-2 devstack@n-api.service[121403]: X-User-Name: tempest-ServersTestJSON-917766486-project Nov 01 19:10:03.515145 n-d-863052-2 devstack@n-api.service[121403]: method: > Nov 01 19:10:03.515145 n-d-863052-2 devstack@n-api.service[121403]: exception: Instance 43b22dd3-debb-4a6d-81fc-4666e5bb7804 could not be found. Nov 01 19:10:03.515145 n-d-863052-2 devstack@n-api.service[121403]: action_args: {'id': '43b22dd3-debb-4a6d-81fc-4666e5bb7804'} Nov 01 19:10:03.515145 n-d-863052-2 devstack@n-api.service[121403]: {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 01 19:10:03.515145 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:10:03.515145 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 01 19:10:03.515145 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 01 19:10:03.515145 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 01 19:10:03.515145 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 01 19:10:03.515145 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 01 19:10:03.515145 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 01 19:10:03.515145 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 01 19:10:03.515145 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 01 19:10:03.515145 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 43b22dd3-debb-4a6d-81fc-4666e5bb7804 could not be found. Nov 01 19:10:03.515145 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:10:03.515145 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:10:03.515145 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:10:03.515145 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:10:03.515145 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:10:03.515145 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:10:03.515145 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 01 19:10:03.515145 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 01 19:10:03.515145 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 01 19:10:03.515145 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 01 19:10:03.515145 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 01 19:10:03.515145 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 01 19:10:03.515145 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 01 19:10:03.515145 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 01 19:10:03.515145 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 01 19:10:03.515145 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 01 19:10:03.515145 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 43b22dd3-debb-4a6d-81fc-4666e5bb7804 could not be found. Nov 01 19:10:03.515145 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:10:03.515145 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:10:03.515145 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:10:03.515145 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:10:03.520505 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:10:03.520505 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:10:03.520505 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 01 19:10:03.520505 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 01 19:10:03.520505 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 43b22dd3-debb-4a6d-81fc-4666e5bb7804 could not be found. Nov 01 19:10:03.520505 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:10:03.520505 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-a3294b47-a74c-4948-b80e-c33ca8473dfe tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Returning 404 to user: Instance 43b22dd3-debb-4a6d-81fc-4666e5bb7804 could not be found. {{(pid=121403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 01 19:10:03.520505 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-a3294b47-a74c-4948-b80e-c33ca8473dfe tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] 10.222.0.13 "GET /compute/v2.1/servers/43b22dd3-debb-4a6d-81fc-4666e5bb7804" status: 404 len: 111 microversion: 2.1 time: 0.042490 Nov 01 19:10:03.520505 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1991/3869] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:10:03 2022] GET /compute/v2.1/servers/43b22dd3-debb-4a6d-81fc-4666e5bb7804 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 01 19:10:03.530511 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-fa62153f-9602-4717-a510-faf02bdbd05a tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:10:03.531038 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-fa62153f-9602-4717-a510-faf02bdbd05a tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] [instance: 43b22dd3-debb-4a6d-81fc-4666e5bb7804] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:10:03.538606 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-fa62153f-9602-4717-a510-faf02bdbd05a tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:03.539099 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-fa62153f-9602-4717-a510-faf02bdbd05a tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:03.540186 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-fa62153f-9602-4717-a510-faf02bdbd05a tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:03.540929 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-fa62153f-9602-4717-a510-faf02bdbd05a tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:03.541395 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-fa62153f-9602-4717-a510-faf02bdbd05a tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:03.541824 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-fa62153f-9602-4717-a510-faf02bdbd05a tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:03.556907 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.wsgi [None req-fa62153f-9602-4717-a510-faf02bdbd05a tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] HTTP exception thrown: Instance 43b22dd3-debb-4a6d-81fc-4666e5bb7804 could not be found. Nov 01 19:10:03.558658 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-fa62153f-9602-4717-a510-faf02bdbd05a tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Request method failure captured: Nov 01 19:10:03.558658 n-d-863052-2 devstack@n-api.service[121402]: request: DELETE /compute/v2.1/servers/43b22dd3-debb-4a6d-81fc-4666e5bb7804 HTTP/1.1 Nov 01 19:10:03.558658 n-d-863052-2 devstack@n-api.service[121402]: Accept: application/json Nov 01 19:10:03.558658 n-d-863052-2 devstack@n-api.service[121402]: Accept-Encoding: identity Nov 01 19:10:03.558658 n-d-863052-2 devstack@n-api.service[121402]: Connection: close Nov 01 19:10:03.558658 n-d-863052-2 devstack@n-api.service[121402]: Content-Length: 0 Nov 01 19:10:03.558658 n-d-863052-2 devstack@n-api.service[121402]: Content-Type: application/json Nov 01 19:10:03.558658 n-d-863052-2 devstack@n-api.service[121402]: Host: 10.222.0.13 Nov 01 19:10:03.558658 n-d-863052-2 devstack@n-api.service[121402]: Openstack-System-Scope: None Nov 01 19:10:03.558658 n-d-863052-2 devstack@n-api.service[121402]: User-Agent: python-urllib3/1.26.12 Nov 01 19:10:03.558658 n-d-863052-2 devstack@n-api.service[121402]: X-Auth-Token: gAAAAABjYW4_RJI8gKBQs81ShXQrfTSIzrNvaZj2e2rGhpR5xhmtuxP4h5uZIl9SLPqPqJ9Syn39UO-el4mPnuEEOGnWtpNlTopD6-Pc1m-VWD64ggyrfBZwUB0hnjNvBvBk6ge071YBJx2gxTN_InEu4tuxz3s-3IQBbEpMSIJZ4VoUIbz4DgY Nov 01 19:10:03.558658 n-d-863052-2 devstack@n-api.service[121402]: X-Domain-Id: None Nov 01 19:10:03.558658 n-d-863052-2 devstack@n-api.service[121402]: X-Domain-Name: None Nov 01 19:10:03.558658 n-d-863052-2 devstack@n-api.service[121402]: X-Identity-Status: Confirmed Nov 01 19:10:03.558658 n-d-863052-2 devstack@n-api.service[121402]: X-Is-Admin-Project: True Nov 01 19:10:03.558658 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Domain-Id: default Nov 01 19:10:03.558658 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Domain-Name: Default Nov 01 19:10:03.558658 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Id: 851785a5f76548898a77d67792888504 Nov 01 19:10:03.558658 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Name: tempest-ServersTestJSON-917766486 Nov 01 19:10:03.558658 n-d-863052-2 devstack@n-api.service[121402]: X-Role: member,reader Nov 01 19:10:03.558658 n-d-863052-2 devstack@n-api.service[121402]: X-Roles: member,reader Nov 01 19:10:03.558658 n-d-863052-2 devstack@n-api.service[121402]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/851785a5f76548898a77d67792888504"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/851785a5f76548898a77d67792888504"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_851785a5f76548898a77d67792888504", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/851785a5f76548898a77d67792888504"}]}] Nov 01 19:10:03.558658 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant: tempest-ServersTestJSON-917766486 Nov 01 19:10:03.558658 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant-Id: 851785a5f76548898a77d67792888504 Nov 01 19:10:03.558658 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant-Name: tempest-ServersTestJSON-917766486 Nov 01 19:10:03.558658 n-d-863052-2 devstack@n-api.service[121402]: X-User: tempest-ServersTestJSON-917766486-project Nov 01 19:10:03.558658 n-d-863052-2 devstack@n-api.service[121402]: X-User-Domain-Id: default Nov 01 19:10:03.558658 n-d-863052-2 devstack@n-api.service[121402]: X-User-Domain-Name: Default Nov 01 19:10:03.558658 n-d-863052-2 devstack@n-api.service[121402]: X-User-Id: 113bd8c844ee490b86a68bc7e1e75da3 Nov 01 19:10:03.558658 n-d-863052-2 devstack@n-api.service[121402]: X-User-Name: tempest-ServersTestJSON-917766486-project Nov 01 19:10:03.558658 n-d-863052-2 devstack@n-api.service[121402]: method: > Nov 01 19:10:03.558658 n-d-863052-2 devstack@n-api.service[121402]: exception: Instance 43b22dd3-debb-4a6d-81fc-4666e5bb7804 could not be found. Nov 01 19:10:03.558658 n-d-863052-2 devstack@n-api.service[121402]: action_args: {'id': '43b22dd3-debb-4a6d-81fc-4666e5bb7804'} Nov 01 19:10:03.558658 n-d-863052-2 devstack@n-api.service[121402]: {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 01 19:10:03.558658 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:10:03.558658 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 01 19:10:03.558658 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 01 19:10:03.558658 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 01 19:10:03.558658 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 01 19:10:03.558658 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 01 19:10:03.558658 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 01 19:10:03.558658 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 01 19:10:03.558658 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 01 19:10:03.558658 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 43b22dd3-debb-4a6d-81fc-4666e5bb7804 could not be found. Nov 01 19:10:03.558658 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:10:03.558658 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:10:03.558658 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:10:03.558658 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:10:03.558658 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:10:03.558658 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:10:03.558658 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 01 19:10:03.558658 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 01 19:10:03.558658 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 01 19:10:03.558658 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 01 19:10:03.558658 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 01 19:10:03.558658 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 01 19:10:03.558658 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 01 19:10:03.558658 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 01 19:10:03.558658 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 01 19:10:03.558658 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 01 19:10:03.558658 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 01 19:10:03.558658 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 01 19:10:03.558658 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 43b22dd3-debb-4a6d-81fc-4666e5bb7804 could not be found. Nov 01 19:10:03.563955 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:10:03.563955 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:10:03.563955 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:10:03.563955 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:10:03.563955 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:10:03.563955 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:10:03.563955 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 01 19:10:03.563955 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 01 19:10:03.563955 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 43b22dd3-debb-4a6d-81fc-4666e5bb7804 could not be found. Nov 01 19:10:03.563955 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:10:03.565995 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-fa62153f-9602-4717-a510-faf02bdbd05a tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Returning 404 to user: Instance 43b22dd3-debb-4a6d-81fc-4666e5bb7804 could not be found. {{(pid=121402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 01 19:10:03.567113 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-fa62153f-9602-4717-a510-faf02bdbd05a tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] 10.222.0.13 "DELETE /compute/v2.1/servers/43b22dd3-debb-4a6d-81fc-4666e5bb7804" status: 404 len: 111 microversion: 2.1 time: 0.040977 Nov 01 19:10:03.567691 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1879/3870] 10.222.0.13 () {58 vars in 1239 bytes} [Tue Nov 1 19:10:03 2022] DELETE /compute/v2.1/servers/43b22dd3-debb-4a6d-81fc-4666e5bb7804 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 01 19:10:03.575870 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-0c90601b-4ba1-44b8-b6de-ae84a5ea2898 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:10:03.576917 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-0c90601b-4ba1-44b8-b6de-ae84a5ea2898 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] [instance: 43b22dd3-debb-4a6d-81fc-4666e5bb7804] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:10:03.584016 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-0c90601b-4ba1-44b8-b6de-ae84a5ea2898 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:03.584432 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-0c90601b-4ba1-44b8-b6de-ae84a5ea2898 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:03.585098 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-0c90601b-4ba1-44b8-b6de-ae84a5ea2898 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:03.585805 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-0c90601b-4ba1-44b8-b6de-ae84a5ea2898 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:03.586262 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-0c90601b-4ba1-44b8-b6de-ae84a5ea2898 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:03.587122 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-0c90601b-4ba1-44b8-b6de-ae84a5ea2898 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:03.603067 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.wsgi [None req-0c90601b-4ba1-44b8-b6de-ae84a5ea2898 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] HTTP exception thrown: Instance 43b22dd3-debb-4a6d-81fc-4666e5bb7804 could not be found. Nov 01 19:10:03.605484 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-0c90601b-4ba1-44b8-b6de-ae84a5ea2898 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Request method failure captured: Nov 01 19:10:03.605484 n-d-863052-2 devstack@n-api.service[121403]: request: GET /compute/v2.1/servers/43b22dd3-debb-4a6d-81fc-4666e5bb7804 HTTP/1.1 Nov 01 19:10:03.605484 n-d-863052-2 devstack@n-api.service[121403]: Accept: application/json Nov 01 19:10:03.605484 n-d-863052-2 devstack@n-api.service[121403]: Accept-Encoding: identity Nov 01 19:10:03.605484 n-d-863052-2 devstack@n-api.service[121403]: Connection: close Nov 01 19:10:03.605484 n-d-863052-2 devstack@n-api.service[121403]: Content-Length: 0 Nov 01 19:10:03.605484 n-d-863052-2 devstack@n-api.service[121403]: Content-Type: application/json Nov 01 19:10:03.605484 n-d-863052-2 devstack@n-api.service[121403]: Host: 10.222.0.13 Nov 01 19:10:03.605484 n-d-863052-2 devstack@n-api.service[121403]: Openstack-System-Scope: None Nov 01 19:10:03.605484 n-d-863052-2 devstack@n-api.service[121403]: User-Agent: python-urllib3/1.26.12 Nov 01 19:10:03.605484 n-d-863052-2 devstack@n-api.service[121403]: X-Auth-Token: gAAAAABjYW4_RJI8gKBQs81ShXQrfTSIzrNvaZj2e2rGhpR5xhmtuxP4h5uZIl9SLPqPqJ9Syn39UO-el4mPnuEEOGnWtpNlTopD6-Pc1m-VWD64ggyrfBZwUB0hnjNvBvBk6ge071YBJx2gxTN_InEu4tuxz3s-3IQBbEpMSIJZ4VoUIbz4DgY Nov 01 19:10:03.605484 n-d-863052-2 devstack@n-api.service[121403]: X-Domain-Id: None Nov 01 19:10:03.605484 n-d-863052-2 devstack@n-api.service[121403]: X-Domain-Name: None Nov 01 19:10:03.605484 n-d-863052-2 devstack@n-api.service[121403]: X-Identity-Status: Confirmed Nov 01 19:10:03.605484 n-d-863052-2 devstack@n-api.service[121403]: X-Is-Admin-Project: True Nov 01 19:10:03.605484 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Domain-Id: default Nov 01 19:10:03.605484 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Domain-Name: Default Nov 01 19:10:03.605484 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Id: 851785a5f76548898a77d67792888504 Nov 01 19:10:03.605484 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Name: tempest-ServersTestJSON-917766486 Nov 01 19:10:03.605484 n-d-863052-2 devstack@n-api.service[121403]: X-Role: member,reader Nov 01 19:10:03.605484 n-d-863052-2 devstack@n-api.service[121403]: X-Roles: member,reader Nov 01 19:10:03.605484 n-d-863052-2 devstack@n-api.service[121403]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/851785a5f76548898a77d67792888504"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/851785a5f76548898a77d67792888504"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_851785a5f76548898a77d67792888504", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/851785a5f76548898a77d67792888504"}]}] Nov 01 19:10:03.605484 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant: tempest-ServersTestJSON-917766486 Nov 01 19:10:03.605484 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant-Id: 851785a5f76548898a77d67792888504 Nov 01 19:10:03.605484 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant-Name: tempest-ServersTestJSON-917766486 Nov 01 19:10:03.605484 n-d-863052-2 devstack@n-api.service[121403]: X-User: tempest-ServersTestJSON-917766486-project Nov 01 19:10:03.605484 n-d-863052-2 devstack@n-api.service[121403]: X-User-Domain-Id: default Nov 01 19:10:03.605484 n-d-863052-2 devstack@n-api.service[121403]: X-User-Domain-Name: Default Nov 01 19:10:03.605484 n-d-863052-2 devstack@n-api.service[121403]: X-User-Id: 113bd8c844ee490b86a68bc7e1e75da3 Nov 01 19:10:03.605484 n-d-863052-2 devstack@n-api.service[121403]: X-User-Name: tempest-ServersTestJSON-917766486-project Nov 01 19:10:03.605484 n-d-863052-2 devstack@n-api.service[121403]: method: > Nov 01 19:10:03.605484 n-d-863052-2 devstack@n-api.service[121403]: exception: Instance 43b22dd3-debb-4a6d-81fc-4666e5bb7804 could not be found. Nov 01 19:10:03.605484 n-d-863052-2 devstack@n-api.service[121403]: action_args: {'id': '43b22dd3-debb-4a6d-81fc-4666e5bb7804'} Nov 01 19:10:03.605484 n-d-863052-2 devstack@n-api.service[121403]: {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 01 19:10:03.605484 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:10:03.605484 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 01 19:10:03.605484 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 01 19:10:03.605484 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 01 19:10:03.605484 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 01 19:10:03.605484 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 01 19:10:03.605484 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 01 19:10:03.605484 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 01 19:10:03.605484 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 01 19:10:03.605484 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 43b22dd3-debb-4a6d-81fc-4666e5bb7804 could not be found. Nov 01 19:10:03.605484 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:10:03.605484 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:10:03.605484 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:10:03.605484 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:10:03.605484 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:10:03.605484 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:10:03.605484 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 01 19:10:03.605484 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 01 19:10:03.605484 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 01 19:10:03.605484 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 01 19:10:03.605484 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 01 19:10:03.605484 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 01 19:10:03.605484 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 01 19:10:03.605484 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 01 19:10:03.605484 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 01 19:10:03.605484 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 01 19:10:03.605484 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 43b22dd3-debb-4a6d-81fc-4666e5bb7804 could not be found. Nov 01 19:10:03.605484 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:10:03.605484 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:10:03.605484 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:10:03.605484 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:10:03.610732 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:10:03.610732 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:10:03.610732 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 01 19:10:03.610732 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 01 19:10:03.610732 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 43b22dd3-debb-4a6d-81fc-4666e5bb7804 could not be found. Nov 01 19:10:03.610732 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:10:03.612373 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-0c90601b-4ba1-44b8-b6de-ae84a5ea2898 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Returning 404 to user: Instance 43b22dd3-debb-4a6d-81fc-4666e5bb7804 could not be found. {{(pid=121403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 01 19:10:03.614478 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-0c90601b-4ba1-44b8-b6de-ae84a5ea2898 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] 10.222.0.13 "GET /compute/v2.1/servers/43b22dd3-debb-4a6d-81fc-4666e5bb7804" status: 404 len: 111 microversion: 2.1 time: 0.042518 Nov 01 19:10:03.615527 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1992/3871] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:10:03 2022] GET /compute/v2.1/servers/43b22dd3-debb-4a6d-81fc-4666e5bb7804 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 01 19:10:03.625544 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-d562c5d7-2710-4565-b24d-70247c646c8c tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:10:03.626930 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-d562c5d7-2710-4565-b24d-70247c646c8c tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] [instance: 34597ed3-08c9-4c33-b47a-56a9ad5ff70c] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:10:03.634237 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-d562c5d7-2710-4565-b24d-70247c646c8c tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:03.635173 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-d562c5d7-2710-4565-b24d-70247c646c8c tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:03.635872 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-d562c5d7-2710-4565-b24d-70247c646c8c tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:03.636851 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-d562c5d7-2710-4565-b24d-70247c646c8c tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:03.637511 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-d562c5d7-2710-4565-b24d-70247c646c8c tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:03.638175 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-d562c5d7-2710-4565-b24d-70247c646c8c tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:03.651838 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-43e30fe4-30bf-460c-9684-912b22c4bfd9 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:10:03.653284 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.wsgi [None req-d562c5d7-2710-4565-b24d-70247c646c8c tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] HTTP exception thrown: Instance 34597ed3-08c9-4c33-b47a-56a9ad5ff70c could not be found. Nov 01 19:10:03.653436 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-43e30fe4-30bf-460c-9684-912b22c4bfd9 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] [instance: 8c460f41-9dc1-4f0c-9d2d-0a91b38f7787] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:10:03.655148 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-d562c5d7-2710-4565-b24d-70247c646c8c tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Request method failure captured: Nov 01 19:10:03.655148 n-d-863052-2 devstack@n-api.service[121402]: request: DELETE /compute/v2.1/servers/34597ed3-08c9-4c33-b47a-56a9ad5ff70c HTTP/1.1 Nov 01 19:10:03.655148 n-d-863052-2 devstack@n-api.service[121402]: Accept: application/json Nov 01 19:10:03.655148 n-d-863052-2 devstack@n-api.service[121402]: Accept-Encoding: identity Nov 01 19:10:03.655148 n-d-863052-2 devstack@n-api.service[121402]: Connection: close Nov 01 19:10:03.655148 n-d-863052-2 devstack@n-api.service[121402]: Content-Length: 0 Nov 01 19:10:03.655148 n-d-863052-2 devstack@n-api.service[121402]: Content-Type: application/json Nov 01 19:10:03.655148 n-d-863052-2 devstack@n-api.service[121402]: Host: 10.222.0.13 Nov 01 19:10:03.655148 n-d-863052-2 devstack@n-api.service[121402]: Openstack-System-Scope: None Nov 01 19:10:03.655148 n-d-863052-2 devstack@n-api.service[121402]: User-Agent: python-urllib3/1.26.12 Nov 01 19:10:03.655148 n-d-863052-2 devstack@n-api.service[121402]: X-Auth-Token: gAAAAABjYW4_RJI8gKBQs81ShXQrfTSIzrNvaZj2e2rGhpR5xhmtuxP4h5uZIl9SLPqPqJ9Syn39UO-el4mPnuEEOGnWtpNlTopD6-Pc1m-VWD64ggyrfBZwUB0hnjNvBvBk6ge071YBJx2gxTN_InEu4tuxz3s-3IQBbEpMSIJZ4VoUIbz4DgY Nov 01 19:10:03.655148 n-d-863052-2 devstack@n-api.service[121402]: X-Domain-Id: None Nov 01 19:10:03.655148 n-d-863052-2 devstack@n-api.service[121402]: X-Domain-Name: None Nov 01 19:10:03.655148 n-d-863052-2 devstack@n-api.service[121402]: X-Identity-Status: Confirmed Nov 01 19:10:03.655148 n-d-863052-2 devstack@n-api.service[121402]: X-Is-Admin-Project: True Nov 01 19:10:03.655148 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Domain-Id: default Nov 01 19:10:03.655148 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Domain-Name: Default Nov 01 19:10:03.655148 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Id: 851785a5f76548898a77d67792888504 Nov 01 19:10:03.655148 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Name: tempest-ServersTestJSON-917766486 Nov 01 19:10:03.655148 n-d-863052-2 devstack@n-api.service[121402]: X-Role: member,reader Nov 01 19:10:03.655148 n-d-863052-2 devstack@n-api.service[121402]: X-Roles: member,reader Nov 01 19:10:03.655148 n-d-863052-2 devstack@n-api.service[121402]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/851785a5f76548898a77d67792888504"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/851785a5f76548898a77d67792888504"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_851785a5f76548898a77d67792888504", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/851785a5f76548898a77d67792888504"}]}] Nov 01 19:10:03.655148 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant: tempest-ServersTestJSON-917766486 Nov 01 19:10:03.655148 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant-Id: 851785a5f76548898a77d67792888504 Nov 01 19:10:03.655148 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant-Name: tempest-ServersTestJSON-917766486 Nov 01 19:10:03.655148 n-d-863052-2 devstack@n-api.service[121402]: X-User: tempest-ServersTestJSON-917766486-project Nov 01 19:10:03.655148 n-d-863052-2 devstack@n-api.service[121402]: X-User-Domain-Id: default Nov 01 19:10:03.655148 n-d-863052-2 devstack@n-api.service[121402]: X-User-Domain-Name: Default Nov 01 19:10:03.655148 n-d-863052-2 devstack@n-api.service[121402]: X-User-Id: 113bd8c844ee490b86a68bc7e1e75da3 Nov 01 19:10:03.655148 n-d-863052-2 devstack@n-api.service[121402]: X-User-Name: tempest-ServersTestJSON-917766486-project Nov 01 19:10:03.655148 n-d-863052-2 devstack@n-api.service[121402]: method: > Nov 01 19:10:03.655148 n-d-863052-2 devstack@n-api.service[121402]: exception: Instance 34597ed3-08c9-4c33-b47a-56a9ad5ff70c could not be found. Nov 01 19:10:03.655148 n-d-863052-2 devstack@n-api.service[121402]: action_args: {'id': '34597ed3-08c9-4c33-b47a-56a9ad5ff70c'} Nov 01 19:10:03.655148 n-d-863052-2 devstack@n-api.service[121402]: {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 01 19:10:03.655148 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:10:03.655148 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 01 19:10:03.655148 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 01 19:10:03.655148 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 01 19:10:03.655148 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 01 19:10:03.655148 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 01 19:10:03.655148 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 01 19:10:03.655148 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 01 19:10:03.655148 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 01 19:10:03.655148 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 34597ed3-08c9-4c33-b47a-56a9ad5ff70c could not be found. Nov 01 19:10:03.655148 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:10:03.655148 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:10:03.655148 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:10:03.655148 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:10:03.655148 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:10:03.655148 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:10:03.655148 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 01 19:10:03.655148 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 01 19:10:03.655148 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 01 19:10:03.655148 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 01 19:10:03.655148 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 01 19:10:03.655148 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 01 19:10:03.655148 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 01 19:10:03.655148 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 01 19:10:03.655148 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 01 19:10:03.655148 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 01 19:10:03.655148 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 01 19:10:03.655148 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 01 19:10:03.655148 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 34597ed3-08c9-4c33-b47a-56a9ad5ff70c could not be found. Nov 01 19:10:03.660644 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:10:03.660644 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:10:03.660644 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:10:03.660644 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:10:03.660644 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:10:03.660644 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:10:03.660644 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 01 19:10:03.660644 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 01 19:10:03.660644 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 34597ed3-08c9-4c33-b47a-56a9ad5ff70c could not be found. Nov 01 19:10:03.660644 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:10:03.660644 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-d562c5d7-2710-4565-b24d-70247c646c8c tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Returning 404 to user: Instance 34597ed3-08c9-4c33-b47a-56a9ad5ff70c could not be found. {{(pid=121402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 01 19:10:03.660644 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-d562c5d7-2710-4565-b24d-70247c646c8c tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] 10.222.0.13 "DELETE /compute/v2.1/servers/34597ed3-08c9-4c33-b47a-56a9ad5ff70c" status: 404 len: 111 microversion: 2.1 time: 0.039051 Nov 01 19:10:03.665828 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1880/3872] 10.222.0.13 () {58 vars in 1239 bytes} [Tue Nov 1 19:10:03 2022] DELETE /compute/v2.1/servers/34597ed3-08c9-4c33-b47a-56a9ad5ff70c => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 01 19:10:03.668982 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-43e30fe4-30bf-460c-9684-912b22c4bfd9 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:03.669715 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-43e30fe4-30bf-460c-9684-912b22c4bfd9 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:03.670620 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-43e30fe4-30bf-460c-9684-912b22c4bfd9 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:03.671467 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-43e30fe4-30bf-460c-9684-912b22c4bfd9 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:03.672255 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-43e30fe4-30bf-460c-9684-912b22c4bfd9 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:03.674143 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-43e30fe4-30bf-460c-9684-912b22c4bfd9 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:03.677776 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-89916b63-537f-481f-863c-377c0faffb88 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:10:03.678619 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-89916b63-537f-481f-863c-377c0faffb88 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] [instance: 34597ed3-08c9-4c33-b47a-56a9ad5ff70c] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:10:03.701884 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-89916b63-537f-481f-863c-377c0faffb88 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:03.703191 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-89916b63-537f-481f-863c-377c0faffb88 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:03.703836 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-89916b63-537f-481f-863c-377c0faffb88 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:03.704759 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-89916b63-537f-481f-863c-377c0faffb88 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:03.705387 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-89916b63-537f-481f-863c-377c0faffb88 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:03.705982 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-89916b63-537f-481f-863c-377c0faffb88 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:03.724006 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.wsgi [None req-89916b63-537f-481f-863c-377c0faffb88 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] HTTP exception thrown: Instance 34597ed3-08c9-4c33-b47a-56a9ad5ff70c could not be found. Nov 01 19:10:03.725580 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-89916b63-537f-481f-863c-377c0faffb88 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Request method failure captured: Nov 01 19:10:03.725580 n-d-863052-2 devstack@n-api.service[121402]: request: GET /compute/v2.1/servers/34597ed3-08c9-4c33-b47a-56a9ad5ff70c HTTP/1.1 Nov 01 19:10:03.725580 n-d-863052-2 devstack@n-api.service[121402]: Accept: application/json Nov 01 19:10:03.725580 n-d-863052-2 devstack@n-api.service[121402]: Accept-Encoding: identity Nov 01 19:10:03.725580 n-d-863052-2 devstack@n-api.service[121402]: Connection: close Nov 01 19:10:03.725580 n-d-863052-2 devstack@n-api.service[121402]: Content-Length: 0 Nov 01 19:10:03.725580 n-d-863052-2 devstack@n-api.service[121402]: Content-Type: application/json Nov 01 19:10:03.725580 n-d-863052-2 devstack@n-api.service[121402]: Host: 10.222.0.13 Nov 01 19:10:03.725580 n-d-863052-2 devstack@n-api.service[121402]: Openstack-System-Scope: None Nov 01 19:10:03.725580 n-d-863052-2 devstack@n-api.service[121402]: User-Agent: python-urllib3/1.26.12 Nov 01 19:10:03.725580 n-d-863052-2 devstack@n-api.service[121402]: X-Auth-Token: gAAAAABjYW4_RJI8gKBQs81ShXQrfTSIzrNvaZj2e2rGhpR5xhmtuxP4h5uZIl9SLPqPqJ9Syn39UO-el4mPnuEEOGnWtpNlTopD6-Pc1m-VWD64ggyrfBZwUB0hnjNvBvBk6ge071YBJx2gxTN_InEu4tuxz3s-3IQBbEpMSIJZ4VoUIbz4DgY Nov 01 19:10:03.725580 n-d-863052-2 devstack@n-api.service[121402]: X-Domain-Id: None Nov 01 19:10:03.725580 n-d-863052-2 devstack@n-api.service[121402]: X-Domain-Name: None Nov 01 19:10:03.725580 n-d-863052-2 devstack@n-api.service[121402]: X-Identity-Status: Confirmed Nov 01 19:10:03.725580 n-d-863052-2 devstack@n-api.service[121402]: X-Is-Admin-Project: True Nov 01 19:10:03.725580 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Domain-Id: default Nov 01 19:10:03.725580 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Domain-Name: Default Nov 01 19:10:03.725580 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Id: 851785a5f76548898a77d67792888504 Nov 01 19:10:03.725580 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Name: tempest-ServersTestJSON-917766486 Nov 01 19:10:03.725580 n-d-863052-2 devstack@n-api.service[121402]: X-Role: member,reader Nov 01 19:10:03.725580 n-d-863052-2 devstack@n-api.service[121402]: X-Roles: member,reader Nov 01 19:10:03.725580 n-d-863052-2 devstack@n-api.service[121402]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/851785a5f76548898a77d67792888504"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/851785a5f76548898a77d67792888504"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_851785a5f76548898a77d67792888504", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/851785a5f76548898a77d67792888504"}]}] Nov 01 19:10:03.725580 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant: tempest-ServersTestJSON-917766486 Nov 01 19:10:03.725580 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant-Id: 851785a5f76548898a77d67792888504 Nov 01 19:10:03.725580 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant-Name: tempest-ServersTestJSON-917766486 Nov 01 19:10:03.725580 n-d-863052-2 devstack@n-api.service[121402]: X-User: tempest-ServersTestJSON-917766486-project Nov 01 19:10:03.725580 n-d-863052-2 devstack@n-api.service[121402]: X-User-Domain-Id: default Nov 01 19:10:03.725580 n-d-863052-2 devstack@n-api.service[121402]: X-User-Domain-Name: Default Nov 01 19:10:03.725580 n-d-863052-2 devstack@n-api.service[121402]: X-User-Id: 113bd8c844ee490b86a68bc7e1e75da3 Nov 01 19:10:03.725580 n-d-863052-2 devstack@n-api.service[121402]: X-User-Name: tempest-ServersTestJSON-917766486-project Nov 01 19:10:03.725580 n-d-863052-2 devstack@n-api.service[121402]: method: > Nov 01 19:10:03.725580 n-d-863052-2 devstack@n-api.service[121402]: exception: Instance 34597ed3-08c9-4c33-b47a-56a9ad5ff70c could not be found. Nov 01 19:10:03.725580 n-d-863052-2 devstack@n-api.service[121402]: action_args: {'id': '34597ed3-08c9-4c33-b47a-56a9ad5ff70c'} Nov 01 19:10:03.725580 n-d-863052-2 devstack@n-api.service[121402]: {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 01 19:10:03.725580 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:10:03.725580 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 01 19:10:03.725580 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 01 19:10:03.725580 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 01 19:10:03.725580 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 01 19:10:03.725580 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 01 19:10:03.725580 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 01 19:10:03.725580 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 01 19:10:03.725580 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 01 19:10:03.725580 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 34597ed3-08c9-4c33-b47a-56a9ad5ff70c could not be found. Nov 01 19:10:03.725580 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:10:03.725580 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:10:03.725580 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:10:03.725580 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:10:03.725580 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:10:03.725580 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:10:03.725580 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 01 19:10:03.725580 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 01 19:10:03.725580 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 01 19:10:03.725580 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 01 19:10:03.725580 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 01 19:10:03.725580 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 01 19:10:03.725580 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 01 19:10:03.725580 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 01 19:10:03.725580 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 01 19:10:03.725580 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 01 19:10:03.725580 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 34597ed3-08c9-4c33-b47a-56a9ad5ff70c could not be found. Nov 01 19:10:03.725580 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:10:03.725580 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:10:03.725580 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:10:03.725580 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:10:03.730886 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:10:03.730886 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:10:03.730886 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 01 19:10:03.730886 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 01 19:10:03.730886 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 34597ed3-08c9-4c33-b47a-56a9ad5ff70c could not be found. Nov 01 19:10:03.730886 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:10:03.730886 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-89916b63-537f-481f-863c-377c0faffb88 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Returning 404 to user: Instance 34597ed3-08c9-4c33-b47a-56a9ad5ff70c could not be found. {{(pid=121402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 01 19:10:03.730886 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-89916b63-537f-481f-863c-377c0faffb88 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] 10.222.0.13 "GET /compute/v2.1/servers/34597ed3-08c9-4c33-b47a-56a9ad5ff70c" status: 404 len: 111 microversion: 2.1 time: 0.058780 Nov 01 19:10:03.730886 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1881/3873] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:10:03 2022] GET /compute/v2.1/servers/34597ed3-08c9-4c33-b47a-56a9ad5ff70c => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 01 19:10:03.735318 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-277d3616-fd9f-4767-9bdb-dbc25f80bb9e tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:10:03.735817 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-277d3616-fd9f-4767-9bdb-dbc25f80bb9e tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] [instance: 8bfb4e44-7a5f-466d-9f1e-bebee16d400c] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:10:03.742407 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-277d3616-fd9f-4767-9bdb-dbc25f80bb9e tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:03.742905 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-277d3616-fd9f-4767-9bdb-dbc25f80bb9e tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:03.743345 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-277d3616-fd9f-4767-9bdb-dbc25f80bb9e tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:03.744048 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-277d3616-fd9f-4767-9bdb-dbc25f80bb9e tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:03.744512 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-277d3616-fd9f-4767-9bdb-dbc25f80bb9e tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:03.744964 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-277d3616-fd9f-4767-9bdb-dbc25f80bb9e tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:03.761788 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.wsgi [None req-277d3616-fd9f-4767-9bdb-dbc25f80bb9e tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] HTTP exception thrown: Instance 8bfb4e44-7a5f-466d-9f1e-bebee16d400c could not be found. Nov 01 19:10:03.763485 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-277d3616-fd9f-4767-9bdb-dbc25f80bb9e tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Request method failure captured: Nov 01 19:10:03.763485 n-d-863052-2 devstack@n-api.service[121402]: request: DELETE /compute/v2.1/servers/8bfb4e44-7a5f-466d-9f1e-bebee16d400c HTTP/1.1 Nov 01 19:10:03.763485 n-d-863052-2 devstack@n-api.service[121402]: Accept: application/json Nov 01 19:10:03.763485 n-d-863052-2 devstack@n-api.service[121402]: Accept-Encoding: identity Nov 01 19:10:03.763485 n-d-863052-2 devstack@n-api.service[121402]: Connection: close Nov 01 19:10:03.763485 n-d-863052-2 devstack@n-api.service[121402]: Content-Length: 0 Nov 01 19:10:03.763485 n-d-863052-2 devstack@n-api.service[121402]: Content-Type: application/json Nov 01 19:10:03.763485 n-d-863052-2 devstack@n-api.service[121402]: Host: 10.222.0.13 Nov 01 19:10:03.763485 n-d-863052-2 devstack@n-api.service[121402]: Openstack-System-Scope: None Nov 01 19:10:03.763485 n-d-863052-2 devstack@n-api.service[121402]: User-Agent: python-urllib3/1.26.12 Nov 01 19:10:03.763485 n-d-863052-2 devstack@n-api.service[121402]: X-Auth-Token: gAAAAABjYW4_RJI8gKBQs81ShXQrfTSIzrNvaZj2e2rGhpR5xhmtuxP4h5uZIl9SLPqPqJ9Syn39UO-el4mPnuEEOGnWtpNlTopD6-Pc1m-VWD64ggyrfBZwUB0hnjNvBvBk6ge071YBJx2gxTN_InEu4tuxz3s-3IQBbEpMSIJZ4VoUIbz4DgY Nov 01 19:10:03.763485 n-d-863052-2 devstack@n-api.service[121402]: X-Domain-Id: None Nov 01 19:10:03.763485 n-d-863052-2 devstack@n-api.service[121402]: X-Domain-Name: None Nov 01 19:10:03.763485 n-d-863052-2 devstack@n-api.service[121402]: X-Identity-Status: Confirmed Nov 01 19:10:03.763485 n-d-863052-2 devstack@n-api.service[121402]: X-Is-Admin-Project: True Nov 01 19:10:03.763485 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Domain-Id: default Nov 01 19:10:03.763485 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Domain-Name: Default Nov 01 19:10:03.763485 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Id: 851785a5f76548898a77d67792888504 Nov 01 19:10:03.763485 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Name: tempest-ServersTestJSON-917766486 Nov 01 19:10:03.763485 n-d-863052-2 devstack@n-api.service[121402]: X-Role: member,reader Nov 01 19:10:03.763485 n-d-863052-2 devstack@n-api.service[121402]: X-Roles: member,reader Nov 01 19:10:03.763485 n-d-863052-2 devstack@n-api.service[121402]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/851785a5f76548898a77d67792888504"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/851785a5f76548898a77d67792888504"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_851785a5f76548898a77d67792888504", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/851785a5f76548898a77d67792888504"}]}] Nov 01 19:10:03.763485 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant: tempest-ServersTestJSON-917766486 Nov 01 19:10:03.763485 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant-Id: 851785a5f76548898a77d67792888504 Nov 01 19:10:03.763485 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant-Name: tempest-ServersTestJSON-917766486 Nov 01 19:10:03.763485 n-d-863052-2 devstack@n-api.service[121402]: X-User: tempest-ServersTestJSON-917766486-project Nov 01 19:10:03.763485 n-d-863052-2 devstack@n-api.service[121402]: X-User-Domain-Id: default Nov 01 19:10:03.763485 n-d-863052-2 devstack@n-api.service[121402]: X-User-Domain-Name: Default Nov 01 19:10:03.763485 n-d-863052-2 devstack@n-api.service[121402]: X-User-Id: 113bd8c844ee490b86a68bc7e1e75da3 Nov 01 19:10:03.763485 n-d-863052-2 devstack@n-api.service[121402]: X-User-Name: tempest-ServersTestJSON-917766486-project Nov 01 19:10:03.763485 n-d-863052-2 devstack@n-api.service[121402]: method: > Nov 01 19:10:03.763485 n-d-863052-2 devstack@n-api.service[121402]: exception: Instance 8bfb4e44-7a5f-466d-9f1e-bebee16d400c could not be found. Nov 01 19:10:03.763485 n-d-863052-2 devstack@n-api.service[121402]: action_args: {'id': '8bfb4e44-7a5f-466d-9f1e-bebee16d400c'} Nov 01 19:10:03.763485 n-d-863052-2 devstack@n-api.service[121402]: {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 01 19:10:03.763485 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:10:03.763485 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 01 19:10:03.763485 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 01 19:10:03.763485 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 01 19:10:03.763485 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 01 19:10:03.763485 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 01 19:10:03.763485 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 01 19:10:03.763485 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 01 19:10:03.763485 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 01 19:10:03.763485 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8bfb4e44-7a5f-466d-9f1e-bebee16d400c could not be found. Nov 01 19:10:03.763485 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:10:03.763485 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:10:03.763485 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:10:03.763485 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:10:03.763485 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:10:03.763485 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:10:03.763485 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 01 19:10:03.763485 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 01 19:10:03.763485 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 01 19:10:03.763485 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 01 19:10:03.763485 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 01 19:10:03.763485 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 01 19:10:03.763485 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 01 19:10:03.763485 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 01 19:10:03.763485 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 01 19:10:03.763485 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 01 19:10:03.763485 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 01 19:10:03.763485 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 01 19:10:03.763485 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8bfb4e44-7a5f-466d-9f1e-bebee16d400c could not be found. Nov 01 19:10:03.767810 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:10:03.767810 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:10:03.767810 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:10:03.767810 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:10:03.767810 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:10:03.767810 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:10:03.767810 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 01 19:10:03.767810 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 01 19:10:03.767810 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8bfb4e44-7a5f-466d-9f1e-bebee16d400c could not be found. Nov 01 19:10:03.767810 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:10:03.767810 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-277d3616-fd9f-4767-9bdb-dbc25f80bb9e tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Returning 404 to user: Instance 8bfb4e44-7a5f-466d-9f1e-bebee16d400c could not be found. {{(pid=121402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 01 19:10:03.767810 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-277d3616-fd9f-4767-9bdb-dbc25f80bb9e tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] 10.222.0.13 "DELETE /compute/v2.1/servers/8bfb4e44-7a5f-466d-9f1e-bebee16d400c" status: 404 len: 111 microversion: 2.1 time: 0.033165 Nov 01 19:10:03.769496 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1882/3874] 10.222.0.13 () {58 vars in 1239 bytes} [Tue Nov 1 19:10:03 2022] DELETE /compute/v2.1/servers/8bfb4e44-7a5f-466d-9f1e-bebee16d400c => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 01 19:10:03.774195 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-8f96093a-f3f5-4a6e-8962-772cdd73f8f6 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:10:03.774814 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-8f96093a-f3f5-4a6e-8962-772cdd73f8f6 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] [instance: 8bfb4e44-7a5f-466d-9f1e-bebee16d400c] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:10:03.780796 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-8f96093a-f3f5-4a6e-8962-772cdd73f8f6 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:03.781482 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-8f96093a-f3f5-4a6e-8962-772cdd73f8f6 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:03.781933 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-8f96093a-f3f5-4a6e-8962-772cdd73f8f6 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:03.782670 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-8f96093a-f3f5-4a6e-8962-772cdd73f8f6 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:03.783103 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-8f96093a-f3f5-4a6e-8962-772cdd73f8f6 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:03.783565 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-8f96093a-f3f5-4a6e-8962-772cdd73f8f6 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:03.798494 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.wsgi [None req-8f96093a-f3f5-4a6e-8962-772cdd73f8f6 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] HTTP exception thrown: Instance 8bfb4e44-7a5f-466d-9f1e-bebee16d400c could not be found. Nov 01 19:10:03.800032 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-8f96093a-f3f5-4a6e-8962-772cdd73f8f6 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Request method failure captured: Nov 01 19:10:03.800032 n-d-863052-2 devstack@n-api.service[121402]: request: GET /compute/v2.1/servers/8bfb4e44-7a5f-466d-9f1e-bebee16d400c HTTP/1.1 Nov 01 19:10:03.800032 n-d-863052-2 devstack@n-api.service[121402]: Accept: application/json Nov 01 19:10:03.800032 n-d-863052-2 devstack@n-api.service[121402]: Accept-Encoding: identity Nov 01 19:10:03.800032 n-d-863052-2 devstack@n-api.service[121402]: Connection: close Nov 01 19:10:03.800032 n-d-863052-2 devstack@n-api.service[121402]: Content-Length: 0 Nov 01 19:10:03.800032 n-d-863052-2 devstack@n-api.service[121402]: Content-Type: application/json Nov 01 19:10:03.800032 n-d-863052-2 devstack@n-api.service[121402]: Host: 10.222.0.13 Nov 01 19:10:03.800032 n-d-863052-2 devstack@n-api.service[121402]: Openstack-System-Scope: None Nov 01 19:10:03.800032 n-d-863052-2 devstack@n-api.service[121402]: User-Agent: python-urllib3/1.26.12 Nov 01 19:10:03.800032 n-d-863052-2 devstack@n-api.service[121402]: X-Auth-Token: gAAAAABjYW4_RJI8gKBQs81ShXQrfTSIzrNvaZj2e2rGhpR5xhmtuxP4h5uZIl9SLPqPqJ9Syn39UO-el4mPnuEEOGnWtpNlTopD6-Pc1m-VWD64ggyrfBZwUB0hnjNvBvBk6ge071YBJx2gxTN_InEu4tuxz3s-3IQBbEpMSIJZ4VoUIbz4DgY Nov 01 19:10:03.800032 n-d-863052-2 devstack@n-api.service[121402]: X-Domain-Id: None Nov 01 19:10:03.800032 n-d-863052-2 devstack@n-api.service[121402]: X-Domain-Name: None Nov 01 19:10:03.800032 n-d-863052-2 devstack@n-api.service[121402]: X-Identity-Status: Confirmed Nov 01 19:10:03.800032 n-d-863052-2 devstack@n-api.service[121402]: X-Is-Admin-Project: True Nov 01 19:10:03.800032 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Domain-Id: default Nov 01 19:10:03.800032 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Domain-Name: Default Nov 01 19:10:03.800032 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Id: 851785a5f76548898a77d67792888504 Nov 01 19:10:03.800032 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Name: tempest-ServersTestJSON-917766486 Nov 01 19:10:03.800032 n-d-863052-2 devstack@n-api.service[121402]: X-Role: member,reader Nov 01 19:10:03.800032 n-d-863052-2 devstack@n-api.service[121402]: X-Roles: member,reader Nov 01 19:10:03.800032 n-d-863052-2 devstack@n-api.service[121402]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/851785a5f76548898a77d67792888504"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/851785a5f76548898a77d67792888504"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_851785a5f76548898a77d67792888504", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/851785a5f76548898a77d67792888504"}]}] Nov 01 19:10:03.800032 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant: tempest-ServersTestJSON-917766486 Nov 01 19:10:03.800032 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant-Id: 851785a5f76548898a77d67792888504 Nov 01 19:10:03.800032 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant-Name: tempest-ServersTestJSON-917766486 Nov 01 19:10:03.800032 n-d-863052-2 devstack@n-api.service[121402]: X-User: tempest-ServersTestJSON-917766486-project Nov 01 19:10:03.800032 n-d-863052-2 devstack@n-api.service[121402]: X-User-Domain-Id: default Nov 01 19:10:03.800032 n-d-863052-2 devstack@n-api.service[121402]: X-User-Domain-Name: Default Nov 01 19:10:03.800032 n-d-863052-2 devstack@n-api.service[121402]: X-User-Id: 113bd8c844ee490b86a68bc7e1e75da3 Nov 01 19:10:03.800032 n-d-863052-2 devstack@n-api.service[121402]: X-User-Name: tempest-ServersTestJSON-917766486-project Nov 01 19:10:03.800032 n-d-863052-2 devstack@n-api.service[121402]: method: > Nov 01 19:10:03.800032 n-d-863052-2 devstack@n-api.service[121402]: exception: Instance 8bfb4e44-7a5f-466d-9f1e-bebee16d400c could not be found. Nov 01 19:10:03.800032 n-d-863052-2 devstack@n-api.service[121402]: action_args: {'id': '8bfb4e44-7a5f-466d-9f1e-bebee16d400c'} Nov 01 19:10:03.800032 n-d-863052-2 devstack@n-api.service[121402]: {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 01 19:10:03.800032 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:10:03.800032 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 01 19:10:03.800032 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 01 19:10:03.800032 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 01 19:10:03.800032 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 01 19:10:03.800032 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 01 19:10:03.800032 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 01 19:10:03.800032 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 01 19:10:03.800032 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 01 19:10:03.800032 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8bfb4e44-7a5f-466d-9f1e-bebee16d400c could not be found. Nov 01 19:10:03.800032 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:10:03.800032 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:10:03.800032 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:10:03.800032 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:10:03.800032 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:10:03.800032 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:10:03.800032 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 01 19:10:03.800032 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 01 19:10:03.800032 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 01 19:10:03.800032 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 01 19:10:03.800032 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 01 19:10:03.800032 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 01 19:10:03.800032 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 01 19:10:03.800032 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 01 19:10:03.800032 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 01 19:10:03.800032 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 01 19:10:03.800032 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8bfb4e44-7a5f-466d-9f1e-bebee16d400c could not be found. Nov 01 19:10:03.800032 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:10:03.800032 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:10:03.800032 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:10:03.800032 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:10:03.806600 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:10:03.806600 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:10:03.806600 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 01 19:10:03.806600 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 01 19:10:03.806600 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8bfb4e44-7a5f-466d-9f1e-bebee16d400c could not be found. Nov 01 19:10:03.806600 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:10:03.806600 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-8f96093a-f3f5-4a6e-8962-772cdd73f8f6 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Returning 404 to user: Instance 8bfb4e44-7a5f-466d-9f1e-bebee16d400c could not be found. {{(pid=121402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 01 19:10:03.812844 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-8f96093a-f3f5-4a6e-8962-772cdd73f8f6 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] 10.222.0.13 "GET /compute/v2.1/servers/8bfb4e44-7a5f-466d-9f1e-bebee16d400c" status: 404 len: 111 microversion: 2.1 time: 0.038786 Nov 01 19:10:03.813105 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1883/3875] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:10:03 2022] GET /compute/v2.1/servers/8bfb4e44-7a5f-466d-9f1e-bebee16d400c => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 01 19:10:03.819499 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-5cf0d617-f9e3-48a2-8ce6-b418b99b7527 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:10:03.820081 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-5cf0d617-f9e3-48a2-8ce6-b418b99b7527 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] [instance: 7c9dac18-3bfc-4379-ab97-25d185cd6b85] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:10:03.827403 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-5cf0d617-f9e3-48a2-8ce6-b418b99b7527 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:03.827965 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-5cf0d617-f9e3-48a2-8ce6-b418b99b7527 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:03.828470 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-5cf0d617-f9e3-48a2-8ce6-b418b99b7527 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:03.829270 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-5cf0d617-f9e3-48a2-8ce6-b418b99b7527 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:03.829796 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-5cf0d617-f9e3-48a2-8ce6-b418b99b7527 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:03.830296 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-5cf0d617-f9e3-48a2-8ce6-b418b99b7527 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:03.845194 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.wsgi [None req-5cf0d617-f9e3-48a2-8ce6-b418b99b7527 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] HTTP exception thrown: Instance 7c9dac18-3bfc-4379-ab97-25d185cd6b85 could not be found. Nov 01 19:10:03.846959 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-5cf0d617-f9e3-48a2-8ce6-b418b99b7527 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Request method failure captured: Nov 01 19:10:03.846959 n-d-863052-2 devstack@n-api.service[121402]: request: DELETE /compute/v2.1/servers/7c9dac18-3bfc-4379-ab97-25d185cd6b85 HTTP/1.1 Nov 01 19:10:03.846959 n-d-863052-2 devstack@n-api.service[121402]: Accept: application/json Nov 01 19:10:03.846959 n-d-863052-2 devstack@n-api.service[121402]: Accept-Encoding: identity Nov 01 19:10:03.846959 n-d-863052-2 devstack@n-api.service[121402]: Connection: close Nov 01 19:10:03.846959 n-d-863052-2 devstack@n-api.service[121402]: Content-Length: 0 Nov 01 19:10:03.846959 n-d-863052-2 devstack@n-api.service[121402]: Content-Type: application/json Nov 01 19:10:03.846959 n-d-863052-2 devstack@n-api.service[121402]: Host: 10.222.0.13 Nov 01 19:10:03.846959 n-d-863052-2 devstack@n-api.service[121402]: Openstack-System-Scope: None Nov 01 19:10:03.846959 n-d-863052-2 devstack@n-api.service[121402]: User-Agent: python-urllib3/1.26.12 Nov 01 19:10:03.846959 n-d-863052-2 devstack@n-api.service[121402]: X-Auth-Token: gAAAAABjYW4_RJI8gKBQs81ShXQrfTSIzrNvaZj2e2rGhpR5xhmtuxP4h5uZIl9SLPqPqJ9Syn39UO-el4mPnuEEOGnWtpNlTopD6-Pc1m-VWD64ggyrfBZwUB0hnjNvBvBk6ge071YBJx2gxTN_InEu4tuxz3s-3IQBbEpMSIJZ4VoUIbz4DgY Nov 01 19:10:03.846959 n-d-863052-2 devstack@n-api.service[121402]: X-Domain-Id: None Nov 01 19:10:03.846959 n-d-863052-2 devstack@n-api.service[121402]: X-Domain-Name: None Nov 01 19:10:03.846959 n-d-863052-2 devstack@n-api.service[121402]: X-Identity-Status: Confirmed Nov 01 19:10:03.846959 n-d-863052-2 devstack@n-api.service[121402]: X-Is-Admin-Project: True Nov 01 19:10:03.846959 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Domain-Id: default Nov 01 19:10:03.846959 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Domain-Name: Default Nov 01 19:10:03.846959 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Id: 851785a5f76548898a77d67792888504 Nov 01 19:10:03.846959 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Name: tempest-ServersTestJSON-917766486 Nov 01 19:10:03.846959 n-d-863052-2 devstack@n-api.service[121402]: X-Role: member,reader Nov 01 19:10:03.846959 n-d-863052-2 devstack@n-api.service[121402]: X-Roles: member,reader Nov 01 19:10:03.846959 n-d-863052-2 devstack@n-api.service[121402]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/851785a5f76548898a77d67792888504"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/851785a5f76548898a77d67792888504"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_851785a5f76548898a77d67792888504", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/851785a5f76548898a77d67792888504"}]}] Nov 01 19:10:03.846959 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant: tempest-ServersTestJSON-917766486 Nov 01 19:10:03.846959 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant-Id: 851785a5f76548898a77d67792888504 Nov 01 19:10:03.846959 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant-Name: tempest-ServersTestJSON-917766486 Nov 01 19:10:03.846959 n-d-863052-2 devstack@n-api.service[121402]: X-User: tempest-ServersTestJSON-917766486-project Nov 01 19:10:03.846959 n-d-863052-2 devstack@n-api.service[121402]: X-User-Domain-Id: default Nov 01 19:10:03.846959 n-d-863052-2 devstack@n-api.service[121402]: X-User-Domain-Name: Default Nov 01 19:10:03.846959 n-d-863052-2 devstack@n-api.service[121402]: X-User-Id: 113bd8c844ee490b86a68bc7e1e75da3 Nov 01 19:10:03.846959 n-d-863052-2 devstack@n-api.service[121402]: X-User-Name: tempest-ServersTestJSON-917766486-project Nov 01 19:10:03.846959 n-d-863052-2 devstack@n-api.service[121402]: method: > Nov 01 19:10:03.846959 n-d-863052-2 devstack@n-api.service[121402]: exception: Instance 7c9dac18-3bfc-4379-ab97-25d185cd6b85 could not be found. Nov 01 19:10:03.846959 n-d-863052-2 devstack@n-api.service[121402]: action_args: {'id': '7c9dac18-3bfc-4379-ab97-25d185cd6b85'} Nov 01 19:10:03.846959 n-d-863052-2 devstack@n-api.service[121402]: {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 01 19:10:03.846959 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:10:03.846959 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 01 19:10:03.846959 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 01 19:10:03.846959 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 01 19:10:03.846959 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 01 19:10:03.846959 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 01 19:10:03.846959 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 01 19:10:03.846959 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 01 19:10:03.846959 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 01 19:10:03.846959 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7c9dac18-3bfc-4379-ab97-25d185cd6b85 could not be found. Nov 01 19:10:03.846959 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:10:03.846959 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:10:03.846959 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:10:03.846959 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:10:03.846959 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:10:03.846959 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:10:03.846959 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 01 19:10:03.846959 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 01 19:10:03.846959 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 01 19:10:03.846959 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 01 19:10:03.846959 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 01 19:10:03.846959 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 01 19:10:03.846959 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 01 19:10:03.846959 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 01 19:10:03.846959 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 01 19:10:03.846959 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 01 19:10:03.846959 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 01 19:10:03.846959 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 01 19:10:03.846959 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7c9dac18-3bfc-4379-ab97-25d185cd6b85 could not be found. Nov 01 19:10:03.854255 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:10:03.854255 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:10:03.854255 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:10:03.854255 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:10:03.854255 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:10:03.854255 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:10:03.854255 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 01 19:10:03.854255 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 01 19:10:03.854255 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7c9dac18-3bfc-4379-ab97-25d185cd6b85 could not be found. Nov 01 19:10:03.854255 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:10:03.854255 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-5cf0d617-f9e3-48a2-8ce6-b418b99b7527 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Returning 404 to user: Instance 7c9dac18-3bfc-4379-ab97-25d185cd6b85 could not be found. {{(pid=121402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 01 19:10:03.854255 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-5cf0d617-f9e3-48a2-8ce6-b418b99b7527 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] 10.222.0.13 "DELETE /compute/v2.1/servers/7c9dac18-3bfc-4379-ab97-25d185cd6b85" status: 404 len: 111 microversion: 2.1 time: 0.033523 Nov 01 19:10:03.854255 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1884/3876] 10.222.0.13 () {58 vars in 1239 bytes} [Tue Nov 1 19:10:03 2022] DELETE /compute/v2.1/servers/7c9dac18-3bfc-4379-ab97-25d185cd6b85 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 01 19:10:03.859331 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-c9d51c7a-bdab-45e8-bf6b-48baeb51460b tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:10:03.859943 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-c9d51c7a-bdab-45e8-bf6b-48baeb51460b tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] [instance: 7c9dac18-3bfc-4379-ab97-25d185cd6b85] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:10:03.863870 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-43e30fe4-30bf-460c-9684-912b22c4bfd9 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '058480d92c9b4ab4af6815d0438a65c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee9dc49b89143f781e4ab30296e4d01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:10:03.866824 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-c9d51c7a-bdab-45e8-bf6b-48baeb51460b tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:03.867318 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-c9d51c7a-bdab-45e8-bf6b-48baeb51460b tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:03.867758 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-c9d51c7a-bdab-45e8-bf6b-48baeb51460b tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:03.868484 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-c9d51c7a-bdab-45e8-bf6b-48baeb51460b tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:03.868980 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-c9d51c7a-bdab-45e8-bf6b-48baeb51460b tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:03.869397 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-c9d51c7a-bdab-45e8-bf6b-48baeb51460b tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:03.872720 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-43e30fe4-30bf-460c-9684-912b22c4bfd9 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] 10.222.0.13 "GET /compute/v2.1/servers/8c460f41-9dc1-4f0c-9d2d-0a91b38f7787" status: 200 len: 1312 microversion: 2.1 time: 0.224860 Nov 01 19:10:03.881464 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1993/3877] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:10:03 2022] GET /compute/v2.1/servers/8c460f41-9dc1-4f0c-9d2d-0a91b38f7787 => generated 1312 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 19:10:03.883378 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.wsgi [None req-c9d51c7a-bdab-45e8-bf6b-48baeb51460b tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] HTTP exception thrown: Instance 7c9dac18-3bfc-4379-ab97-25d185cd6b85 could not be found. Nov 01 19:10:03.885738 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-c9d51c7a-bdab-45e8-bf6b-48baeb51460b tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Request method failure captured: Nov 01 19:10:03.885738 n-d-863052-2 devstack@n-api.service[121402]: request: GET /compute/v2.1/servers/7c9dac18-3bfc-4379-ab97-25d185cd6b85 HTTP/1.1 Nov 01 19:10:03.885738 n-d-863052-2 devstack@n-api.service[121402]: Accept: application/json Nov 01 19:10:03.885738 n-d-863052-2 devstack@n-api.service[121402]: Accept-Encoding: identity Nov 01 19:10:03.885738 n-d-863052-2 devstack@n-api.service[121402]: Connection: close Nov 01 19:10:03.885738 n-d-863052-2 devstack@n-api.service[121402]: Content-Length: 0 Nov 01 19:10:03.885738 n-d-863052-2 devstack@n-api.service[121402]: Content-Type: application/json Nov 01 19:10:03.885738 n-d-863052-2 devstack@n-api.service[121402]: Host: 10.222.0.13 Nov 01 19:10:03.885738 n-d-863052-2 devstack@n-api.service[121402]: Openstack-System-Scope: None Nov 01 19:10:03.885738 n-d-863052-2 devstack@n-api.service[121402]: User-Agent: python-urllib3/1.26.12 Nov 01 19:10:03.885738 n-d-863052-2 devstack@n-api.service[121402]: X-Auth-Token: gAAAAABjYW4_RJI8gKBQs81ShXQrfTSIzrNvaZj2e2rGhpR5xhmtuxP4h5uZIl9SLPqPqJ9Syn39UO-el4mPnuEEOGnWtpNlTopD6-Pc1m-VWD64ggyrfBZwUB0hnjNvBvBk6ge071YBJx2gxTN_InEu4tuxz3s-3IQBbEpMSIJZ4VoUIbz4DgY Nov 01 19:10:03.885738 n-d-863052-2 devstack@n-api.service[121402]: X-Domain-Id: None Nov 01 19:10:03.885738 n-d-863052-2 devstack@n-api.service[121402]: X-Domain-Name: None Nov 01 19:10:03.885738 n-d-863052-2 devstack@n-api.service[121402]: X-Identity-Status: Confirmed Nov 01 19:10:03.885738 n-d-863052-2 devstack@n-api.service[121402]: X-Is-Admin-Project: True Nov 01 19:10:03.885738 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Domain-Id: default Nov 01 19:10:03.885738 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Domain-Name: Default Nov 01 19:10:03.885738 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Id: 851785a5f76548898a77d67792888504 Nov 01 19:10:03.885738 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Name: tempest-ServersTestJSON-917766486 Nov 01 19:10:03.885738 n-d-863052-2 devstack@n-api.service[121402]: X-Role: member,reader Nov 01 19:10:03.885738 n-d-863052-2 devstack@n-api.service[121402]: X-Roles: member,reader Nov 01 19:10:03.885738 n-d-863052-2 devstack@n-api.service[121402]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/851785a5f76548898a77d67792888504"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/851785a5f76548898a77d67792888504"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_851785a5f76548898a77d67792888504", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/851785a5f76548898a77d67792888504"}]}] Nov 01 19:10:03.885738 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant: tempest-ServersTestJSON-917766486 Nov 01 19:10:03.885738 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant-Id: 851785a5f76548898a77d67792888504 Nov 01 19:10:03.885738 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant-Name: tempest-ServersTestJSON-917766486 Nov 01 19:10:03.885738 n-d-863052-2 devstack@n-api.service[121402]: X-User: tempest-ServersTestJSON-917766486-project Nov 01 19:10:03.885738 n-d-863052-2 devstack@n-api.service[121402]: X-User-Domain-Id: default Nov 01 19:10:03.885738 n-d-863052-2 devstack@n-api.service[121402]: X-User-Domain-Name: Default Nov 01 19:10:03.885738 n-d-863052-2 devstack@n-api.service[121402]: X-User-Id: 113bd8c844ee490b86a68bc7e1e75da3 Nov 01 19:10:03.885738 n-d-863052-2 devstack@n-api.service[121402]: X-User-Name: tempest-ServersTestJSON-917766486-project Nov 01 19:10:03.885738 n-d-863052-2 devstack@n-api.service[121402]: method: > Nov 01 19:10:03.885738 n-d-863052-2 devstack@n-api.service[121402]: exception: Instance 7c9dac18-3bfc-4379-ab97-25d185cd6b85 could not be found. Nov 01 19:10:03.885738 n-d-863052-2 devstack@n-api.service[121402]: action_args: {'id': '7c9dac18-3bfc-4379-ab97-25d185cd6b85'} Nov 01 19:10:03.885738 n-d-863052-2 devstack@n-api.service[121402]: {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 01 19:10:03.885738 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:10:03.885738 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 01 19:10:03.885738 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 01 19:10:03.885738 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 01 19:10:03.885738 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 01 19:10:03.885738 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 01 19:10:03.885738 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 01 19:10:03.885738 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 01 19:10:03.885738 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 01 19:10:03.885738 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7c9dac18-3bfc-4379-ab97-25d185cd6b85 could not be found. Nov 01 19:10:03.885738 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:10:03.885738 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:10:03.885738 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:10:03.885738 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:10:03.885738 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:10:03.885738 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:10:03.885738 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 01 19:10:03.885738 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 01 19:10:03.885738 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 01 19:10:03.885738 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 01 19:10:03.885738 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 01 19:10:03.885738 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 01 19:10:03.885738 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 01 19:10:03.885738 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 01 19:10:03.885738 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 01 19:10:03.885738 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 01 19:10:03.885738 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7c9dac18-3bfc-4379-ab97-25d185cd6b85 could not be found. Nov 01 19:10:03.885738 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:10:03.885738 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:10:03.885738 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:10:03.885738 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:10:03.890763 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:10:03.890763 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:10:03.890763 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 01 19:10:03.890763 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 01 19:10:03.890763 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7c9dac18-3bfc-4379-ab97-25d185cd6b85 could not be found. Nov 01 19:10:03.890763 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:10:03.890763 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-c9d51c7a-bdab-45e8-bf6b-48baeb51460b tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Returning 404 to user: Instance 7c9dac18-3bfc-4379-ab97-25d185cd6b85 could not be found. {{(pid=121402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 01 19:10:03.891263 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-c9d51c7a-bdab-45e8-bf6b-48baeb51460b tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] 10.222.0.13 "GET /compute/v2.1/servers/7c9dac18-3bfc-4379-ab97-25d185cd6b85" status: 404 len: 111 microversion: 2.1 time: 0.037302 Nov 01 19:10:03.891790 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1885/3878] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:10:03 2022] GET /compute/v2.1/servers/7c9dac18-3bfc-4379-ab97-25d185cd6b85 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 01 19:10:03.901410 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-66fe8af3-b201-41c5-8e4c-6222cf797aee tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:10:03.902342 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-66fe8af3-b201-41c5-8e4c-6222cf797aee tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] [instance: f6fc44ea-8b27-4807-98b4-8b4b837a7ec3] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:10:03.909036 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-66fe8af3-b201-41c5-8e4c-6222cf797aee tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:03.909521 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-66fe8af3-b201-41c5-8e4c-6222cf797aee tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:03.910525 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-66fe8af3-b201-41c5-8e4c-6222cf797aee tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:03.911211 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-66fe8af3-b201-41c5-8e4c-6222cf797aee tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:03.911666 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-66fe8af3-b201-41c5-8e4c-6222cf797aee tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:03.912091 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-66fe8af3-b201-41c5-8e4c-6222cf797aee tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:03.926826 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.wsgi [None req-66fe8af3-b201-41c5-8e4c-6222cf797aee tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] HTTP exception thrown: Instance f6fc44ea-8b27-4807-98b4-8b4b837a7ec3 could not be found. Nov 01 19:10:03.928532 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-66fe8af3-b201-41c5-8e4c-6222cf797aee tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Request method failure captured: Nov 01 19:10:03.928532 n-d-863052-2 devstack@n-api.service[121403]: request: DELETE /compute/v2.1/servers/f6fc44ea-8b27-4807-98b4-8b4b837a7ec3 HTTP/1.1 Nov 01 19:10:03.928532 n-d-863052-2 devstack@n-api.service[121403]: Accept: application/json Nov 01 19:10:03.928532 n-d-863052-2 devstack@n-api.service[121403]: Accept-Encoding: identity Nov 01 19:10:03.928532 n-d-863052-2 devstack@n-api.service[121403]: Connection: close Nov 01 19:10:03.928532 n-d-863052-2 devstack@n-api.service[121403]: Content-Length: 0 Nov 01 19:10:03.928532 n-d-863052-2 devstack@n-api.service[121403]: Content-Type: application/json Nov 01 19:10:03.928532 n-d-863052-2 devstack@n-api.service[121403]: Host: 10.222.0.13 Nov 01 19:10:03.928532 n-d-863052-2 devstack@n-api.service[121403]: Openstack-System-Scope: None Nov 01 19:10:03.928532 n-d-863052-2 devstack@n-api.service[121403]: User-Agent: python-urllib3/1.26.12 Nov 01 19:10:03.928532 n-d-863052-2 devstack@n-api.service[121403]: X-Auth-Token: gAAAAABjYW4_RJI8gKBQs81ShXQrfTSIzrNvaZj2e2rGhpR5xhmtuxP4h5uZIl9SLPqPqJ9Syn39UO-el4mPnuEEOGnWtpNlTopD6-Pc1m-VWD64ggyrfBZwUB0hnjNvBvBk6ge071YBJx2gxTN_InEu4tuxz3s-3IQBbEpMSIJZ4VoUIbz4DgY Nov 01 19:10:03.928532 n-d-863052-2 devstack@n-api.service[121403]: X-Domain-Id: None Nov 01 19:10:03.928532 n-d-863052-2 devstack@n-api.service[121403]: X-Domain-Name: None Nov 01 19:10:03.928532 n-d-863052-2 devstack@n-api.service[121403]: X-Identity-Status: Confirmed Nov 01 19:10:03.928532 n-d-863052-2 devstack@n-api.service[121403]: X-Is-Admin-Project: True Nov 01 19:10:03.928532 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Domain-Id: default Nov 01 19:10:03.928532 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Domain-Name: Default Nov 01 19:10:03.928532 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Id: 851785a5f76548898a77d67792888504 Nov 01 19:10:03.928532 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Name: tempest-ServersTestJSON-917766486 Nov 01 19:10:03.928532 n-d-863052-2 devstack@n-api.service[121403]: X-Role: member,reader Nov 01 19:10:03.928532 n-d-863052-2 devstack@n-api.service[121403]: X-Roles: member,reader Nov 01 19:10:03.928532 n-d-863052-2 devstack@n-api.service[121403]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/851785a5f76548898a77d67792888504"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/851785a5f76548898a77d67792888504"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_851785a5f76548898a77d67792888504", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/851785a5f76548898a77d67792888504"}]}] Nov 01 19:10:03.928532 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant: tempest-ServersTestJSON-917766486 Nov 01 19:10:03.928532 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant-Id: 851785a5f76548898a77d67792888504 Nov 01 19:10:03.928532 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant-Name: tempest-ServersTestJSON-917766486 Nov 01 19:10:03.928532 n-d-863052-2 devstack@n-api.service[121403]: X-User: tempest-ServersTestJSON-917766486-project Nov 01 19:10:03.928532 n-d-863052-2 devstack@n-api.service[121403]: X-User-Domain-Id: default Nov 01 19:10:03.928532 n-d-863052-2 devstack@n-api.service[121403]: X-User-Domain-Name: Default Nov 01 19:10:03.928532 n-d-863052-2 devstack@n-api.service[121403]: X-User-Id: 113bd8c844ee490b86a68bc7e1e75da3 Nov 01 19:10:03.928532 n-d-863052-2 devstack@n-api.service[121403]: X-User-Name: tempest-ServersTestJSON-917766486-project Nov 01 19:10:03.928532 n-d-863052-2 devstack@n-api.service[121403]: method: > Nov 01 19:10:03.928532 n-d-863052-2 devstack@n-api.service[121403]: exception: Instance f6fc44ea-8b27-4807-98b4-8b4b837a7ec3 could not be found. Nov 01 19:10:03.928532 n-d-863052-2 devstack@n-api.service[121403]: action_args: {'id': 'f6fc44ea-8b27-4807-98b4-8b4b837a7ec3'} Nov 01 19:10:03.928532 n-d-863052-2 devstack@n-api.service[121403]: {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 01 19:10:03.928532 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:10:03.928532 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 01 19:10:03.928532 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 01 19:10:03.928532 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 01 19:10:03.928532 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 01 19:10:03.928532 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 01 19:10:03.928532 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 01 19:10:03.928532 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 01 19:10:03.928532 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 01 19:10:03.928532 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f6fc44ea-8b27-4807-98b4-8b4b837a7ec3 could not be found. Nov 01 19:10:03.928532 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:10:03.928532 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:10:03.928532 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:10:03.928532 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:10:03.928532 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:10:03.928532 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:10:03.928532 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 01 19:10:03.928532 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 01 19:10:03.928532 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 01 19:10:03.928532 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 01 19:10:03.928532 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 01 19:10:03.928532 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 01 19:10:03.928532 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 01 19:10:03.928532 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 01 19:10:03.928532 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 01 19:10:03.928532 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 01 19:10:03.928532 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 01 19:10:03.928532 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 01 19:10:03.928532 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f6fc44ea-8b27-4807-98b4-8b4b837a7ec3 could not be found. Nov 01 19:10:03.934442 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:10:03.934442 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:10:03.934442 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:10:03.934442 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:10:03.934442 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:10:03.934442 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:10:03.934442 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 01 19:10:03.934442 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 01 19:10:03.934442 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f6fc44ea-8b27-4807-98b4-8b4b837a7ec3 could not be found. Nov 01 19:10:03.934442 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:10:03.934442 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-66fe8af3-b201-41c5-8e4c-6222cf797aee tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Returning 404 to user: Instance f6fc44ea-8b27-4807-98b4-8b4b837a7ec3 could not be found. {{(pid=121403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 01 19:10:03.934442 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-66fe8af3-b201-41c5-8e4c-6222cf797aee tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] 10.222.0.13 "DELETE /compute/v2.1/servers/f6fc44ea-8b27-4807-98b4-8b4b837a7ec3" status: 404 len: 111 microversion: 2.1 time: 0.033482 Nov 01 19:10:03.934442 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1994/3879] 10.222.0.13 () {58 vars in 1239 bytes} [Tue Nov 1 19:10:03 2022] DELETE /compute/v2.1/servers/f6fc44ea-8b27-4807-98b4-8b4b837a7ec3 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 01 19:10:03.942242 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-d5784b91-3d84-4ca7-9a85-d382feca4906 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:10:03.942938 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-d5784b91-3d84-4ca7-9a85-d382feca4906 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] [instance: f6fc44ea-8b27-4807-98b4-8b4b837a7ec3] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:10:03.950498 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-d5784b91-3d84-4ca7-9a85-d382feca4906 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:03.951329 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-d5784b91-3d84-4ca7-9a85-d382feca4906 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:03.951948 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-d5784b91-3d84-4ca7-9a85-d382feca4906 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:03.953005 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-d5784b91-3d84-4ca7-9a85-d382feca4906 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:03.957617 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-d5784b91-3d84-4ca7-9a85-d382feca4906 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:03.957855 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-d5784b91-3d84-4ca7-9a85-d382feca4906 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:03.963339 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-a396e5e6-01df-4385-8262-9e25064d458b tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:10:03.964125 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-a396e5e6-01df-4385-8262-9e25064d458b tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] [instance: ac19dd18-c22a-46de-91ef-454a0b78872f] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:10:03.970797 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-a396e5e6-01df-4385-8262-9e25064d458b tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:03.971297 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-a396e5e6-01df-4385-8262-9e25064d458b tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:03.971815 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-a396e5e6-01df-4385-8262-9e25064d458b tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:03.973180 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-a396e5e6-01df-4385-8262-9e25064d458b tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:03.973900 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-a396e5e6-01df-4385-8262-9e25064d458b tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:03.974036 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.wsgi [None req-d5784b91-3d84-4ca7-9a85-d382feca4906 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] HTTP exception thrown: Instance f6fc44ea-8b27-4807-98b4-8b4b837a7ec3 could not be found. Nov 01 19:10:03.974329 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-a396e5e6-01df-4385-8262-9e25064d458b tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:03.976817 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-d5784b91-3d84-4ca7-9a85-d382feca4906 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Request method failure captured: Nov 01 19:10:03.976817 n-d-863052-2 devstack@n-api.service[121402]: request: GET /compute/v2.1/servers/f6fc44ea-8b27-4807-98b4-8b4b837a7ec3 HTTP/1.1 Nov 01 19:10:03.976817 n-d-863052-2 devstack@n-api.service[121402]: Accept: application/json Nov 01 19:10:03.976817 n-d-863052-2 devstack@n-api.service[121402]: Accept-Encoding: identity Nov 01 19:10:03.976817 n-d-863052-2 devstack@n-api.service[121402]: Connection: close Nov 01 19:10:03.976817 n-d-863052-2 devstack@n-api.service[121402]: Content-Length: 0 Nov 01 19:10:03.976817 n-d-863052-2 devstack@n-api.service[121402]: Content-Type: application/json Nov 01 19:10:03.976817 n-d-863052-2 devstack@n-api.service[121402]: Host: 10.222.0.13 Nov 01 19:10:03.976817 n-d-863052-2 devstack@n-api.service[121402]: Openstack-System-Scope: None Nov 01 19:10:03.976817 n-d-863052-2 devstack@n-api.service[121402]: User-Agent: python-urllib3/1.26.12 Nov 01 19:10:03.976817 n-d-863052-2 devstack@n-api.service[121402]: X-Auth-Token: gAAAAABjYW4_RJI8gKBQs81ShXQrfTSIzrNvaZj2e2rGhpR5xhmtuxP4h5uZIl9SLPqPqJ9Syn39UO-el4mPnuEEOGnWtpNlTopD6-Pc1m-VWD64ggyrfBZwUB0hnjNvBvBk6ge071YBJx2gxTN_InEu4tuxz3s-3IQBbEpMSIJZ4VoUIbz4DgY Nov 01 19:10:03.976817 n-d-863052-2 devstack@n-api.service[121402]: X-Domain-Id: None Nov 01 19:10:03.976817 n-d-863052-2 devstack@n-api.service[121402]: X-Domain-Name: None Nov 01 19:10:03.976817 n-d-863052-2 devstack@n-api.service[121402]: X-Identity-Status: Confirmed Nov 01 19:10:03.976817 n-d-863052-2 devstack@n-api.service[121402]: X-Is-Admin-Project: True Nov 01 19:10:03.976817 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Domain-Id: default Nov 01 19:10:03.976817 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Domain-Name: Default Nov 01 19:10:03.976817 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Id: 851785a5f76548898a77d67792888504 Nov 01 19:10:03.976817 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Name: tempest-ServersTestJSON-917766486 Nov 01 19:10:03.976817 n-d-863052-2 devstack@n-api.service[121402]: X-Role: member,reader Nov 01 19:10:03.976817 n-d-863052-2 devstack@n-api.service[121402]: X-Roles: member,reader Nov 01 19:10:03.976817 n-d-863052-2 devstack@n-api.service[121402]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/851785a5f76548898a77d67792888504"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/851785a5f76548898a77d67792888504"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_851785a5f76548898a77d67792888504", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/851785a5f76548898a77d67792888504"}]}] Nov 01 19:10:03.976817 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant: tempest-ServersTestJSON-917766486 Nov 01 19:10:03.976817 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant-Id: 851785a5f76548898a77d67792888504 Nov 01 19:10:03.976817 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant-Name: tempest-ServersTestJSON-917766486 Nov 01 19:10:03.976817 n-d-863052-2 devstack@n-api.service[121402]: X-User: tempest-ServersTestJSON-917766486-project Nov 01 19:10:03.976817 n-d-863052-2 devstack@n-api.service[121402]: X-User-Domain-Id: default Nov 01 19:10:03.976817 n-d-863052-2 devstack@n-api.service[121402]: X-User-Domain-Name: Default Nov 01 19:10:03.976817 n-d-863052-2 devstack@n-api.service[121402]: X-User-Id: 113bd8c844ee490b86a68bc7e1e75da3 Nov 01 19:10:03.976817 n-d-863052-2 devstack@n-api.service[121402]: X-User-Name: tempest-ServersTestJSON-917766486-project Nov 01 19:10:03.976817 n-d-863052-2 devstack@n-api.service[121402]: method: > Nov 01 19:10:03.976817 n-d-863052-2 devstack@n-api.service[121402]: exception: Instance f6fc44ea-8b27-4807-98b4-8b4b837a7ec3 could not be found. Nov 01 19:10:03.976817 n-d-863052-2 devstack@n-api.service[121402]: action_args: {'id': 'f6fc44ea-8b27-4807-98b4-8b4b837a7ec3'} Nov 01 19:10:03.976817 n-d-863052-2 devstack@n-api.service[121402]: {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 01 19:10:03.976817 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:10:03.976817 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 01 19:10:03.976817 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 01 19:10:03.976817 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 01 19:10:03.976817 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 01 19:10:03.976817 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 01 19:10:03.976817 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 01 19:10:03.976817 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 01 19:10:03.976817 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 01 19:10:03.976817 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f6fc44ea-8b27-4807-98b4-8b4b837a7ec3 could not be found. Nov 01 19:10:03.976817 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:10:03.976817 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:10:03.976817 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:10:03.976817 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:10:03.976817 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:10:03.976817 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:10:03.976817 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 01 19:10:03.976817 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 01 19:10:03.976817 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 01 19:10:03.976817 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 01 19:10:03.976817 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 01 19:10:03.976817 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 01 19:10:03.976817 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 01 19:10:03.976817 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 01 19:10:03.976817 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 01 19:10:03.976817 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 01 19:10:03.976817 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f6fc44ea-8b27-4807-98b4-8b4b837a7ec3 could not be found. Nov 01 19:10:03.976817 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:10:03.976817 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:10:03.976817 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:10:03.976817 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:10:03.982568 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:10:03.982568 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:10:03.982568 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 01 19:10:03.982568 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 01 19:10:03.982568 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f6fc44ea-8b27-4807-98b4-8b4b837a7ec3 could not be found. Nov 01 19:10:03.982568 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:10:03.982568 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-d5784b91-3d84-4ca7-9a85-d382feca4906 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Returning 404 to user: Instance f6fc44ea-8b27-4807-98b4-8b4b837a7ec3 could not be found. {{(pid=121402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 01 19:10:03.982568 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-d5784b91-3d84-4ca7-9a85-d382feca4906 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] 10.222.0.13 "GET /compute/v2.1/servers/f6fc44ea-8b27-4807-98b4-8b4b837a7ec3" status: 404 len: 111 microversion: 2.1 time: 0.040793 Nov 01 19:10:03.982568 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1886/3880] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:10:03 2022] GET /compute/v2.1/servers/f6fc44ea-8b27-4807-98b4-8b4b837a7ec3 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 01 19:10:03.989250 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-4d8ae754-14e3-4258-a7c7-5ebe0e4a25d7 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:10:03.989923 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-4d8ae754-14e3-4258-a7c7-5ebe0e4a25d7 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] [instance: a3e21508-14b3-4a32-911a-86699cc0f1aa] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:10:03.996437 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-4d8ae754-14e3-4258-a7c7-5ebe0e4a25d7 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:03.997351 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-4d8ae754-14e3-4258-a7c7-5ebe0e4a25d7 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:03.997891 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-4d8ae754-14e3-4258-a7c7-5ebe0e4a25d7 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:03.998682 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-4d8ae754-14e3-4258-a7c7-5ebe0e4a25d7 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:03.999238 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-4d8ae754-14e3-4258-a7c7-5ebe0e4a25d7 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:03.999756 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-4d8ae754-14e3-4258-a7c7-5ebe0e4a25d7 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:04.017758 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.wsgi [None req-4d8ae754-14e3-4258-a7c7-5ebe0e4a25d7 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] HTTP exception thrown: Instance a3e21508-14b3-4a32-911a-86699cc0f1aa could not be found. Nov 01 19:10:04.020875 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-4d8ae754-14e3-4258-a7c7-5ebe0e4a25d7 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Request method failure captured: Nov 01 19:10:04.020875 n-d-863052-2 devstack@n-api.service[121402]: request: DELETE /compute/v2.1/servers/a3e21508-14b3-4a32-911a-86699cc0f1aa HTTP/1.1 Nov 01 19:10:04.020875 n-d-863052-2 devstack@n-api.service[121402]: Accept: application/json Nov 01 19:10:04.020875 n-d-863052-2 devstack@n-api.service[121402]: Accept-Encoding: identity Nov 01 19:10:04.020875 n-d-863052-2 devstack@n-api.service[121402]: Connection: close Nov 01 19:10:04.020875 n-d-863052-2 devstack@n-api.service[121402]: Content-Length: 0 Nov 01 19:10:04.020875 n-d-863052-2 devstack@n-api.service[121402]: Content-Type: application/json Nov 01 19:10:04.020875 n-d-863052-2 devstack@n-api.service[121402]: Host: 10.222.0.13 Nov 01 19:10:04.020875 n-d-863052-2 devstack@n-api.service[121402]: Openstack-System-Scope: None Nov 01 19:10:04.020875 n-d-863052-2 devstack@n-api.service[121402]: User-Agent: python-urllib3/1.26.12 Nov 01 19:10:04.020875 n-d-863052-2 devstack@n-api.service[121402]: X-Auth-Token: gAAAAABjYW4_RJI8gKBQs81ShXQrfTSIzrNvaZj2e2rGhpR5xhmtuxP4h5uZIl9SLPqPqJ9Syn39UO-el4mPnuEEOGnWtpNlTopD6-Pc1m-VWD64ggyrfBZwUB0hnjNvBvBk6ge071YBJx2gxTN_InEu4tuxz3s-3IQBbEpMSIJZ4VoUIbz4DgY Nov 01 19:10:04.020875 n-d-863052-2 devstack@n-api.service[121402]: X-Domain-Id: None Nov 01 19:10:04.020875 n-d-863052-2 devstack@n-api.service[121402]: X-Domain-Name: None Nov 01 19:10:04.020875 n-d-863052-2 devstack@n-api.service[121402]: X-Identity-Status: Confirmed Nov 01 19:10:04.020875 n-d-863052-2 devstack@n-api.service[121402]: X-Is-Admin-Project: True Nov 01 19:10:04.020875 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Domain-Id: default Nov 01 19:10:04.020875 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Domain-Name: Default Nov 01 19:10:04.020875 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Id: 851785a5f76548898a77d67792888504 Nov 01 19:10:04.020875 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Name: tempest-ServersTestJSON-917766486 Nov 01 19:10:04.020875 n-d-863052-2 devstack@n-api.service[121402]: X-Role: member,reader Nov 01 19:10:04.020875 n-d-863052-2 devstack@n-api.service[121402]: X-Roles: member,reader Nov 01 19:10:04.020875 n-d-863052-2 devstack@n-api.service[121402]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/851785a5f76548898a77d67792888504"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/851785a5f76548898a77d67792888504"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_851785a5f76548898a77d67792888504", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/851785a5f76548898a77d67792888504"}]}] Nov 01 19:10:04.020875 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant: tempest-ServersTestJSON-917766486 Nov 01 19:10:04.020875 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant-Id: 851785a5f76548898a77d67792888504 Nov 01 19:10:04.020875 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant-Name: tempest-ServersTestJSON-917766486 Nov 01 19:10:04.020875 n-d-863052-2 devstack@n-api.service[121402]: X-User: tempest-ServersTestJSON-917766486-project Nov 01 19:10:04.020875 n-d-863052-2 devstack@n-api.service[121402]: X-User-Domain-Id: default Nov 01 19:10:04.020875 n-d-863052-2 devstack@n-api.service[121402]: X-User-Domain-Name: Default Nov 01 19:10:04.020875 n-d-863052-2 devstack@n-api.service[121402]: X-User-Id: 113bd8c844ee490b86a68bc7e1e75da3 Nov 01 19:10:04.020875 n-d-863052-2 devstack@n-api.service[121402]: X-User-Name: tempest-ServersTestJSON-917766486-project Nov 01 19:10:04.020875 n-d-863052-2 devstack@n-api.service[121402]: method: > Nov 01 19:10:04.020875 n-d-863052-2 devstack@n-api.service[121402]: exception: Instance a3e21508-14b3-4a32-911a-86699cc0f1aa could not be found. Nov 01 19:10:04.020875 n-d-863052-2 devstack@n-api.service[121402]: action_args: {'id': 'a3e21508-14b3-4a32-911a-86699cc0f1aa'} Nov 01 19:10:04.020875 n-d-863052-2 devstack@n-api.service[121402]: {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 01 19:10:04.020875 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:10:04.020875 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 01 19:10:04.020875 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 01 19:10:04.020875 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 01 19:10:04.020875 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 01 19:10:04.020875 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 01 19:10:04.020875 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 01 19:10:04.020875 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 01 19:10:04.020875 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 01 19:10:04.020875 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a3e21508-14b3-4a32-911a-86699cc0f1aa could not be found. Nov 01 19:10:04.020875 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:10:04.020875 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:10:04.020875 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:10:04.020875 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:10:04.020875 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:10:04.020875 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:10:04.020875 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 01 19:10:04.020875 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 01 19:10:04.020875 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 01 19:10:04.020875 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 01 19:10:04.020875 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 01 19:10:04.020875 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 01 19:10:04.020875 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 01 19:10:04.020875 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 01 19:10:04.020875 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 01 19:10:04.020875 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 01 19:10:04.020875 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 01 19:10:04.020875 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 01 19:10:04.020875 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a3e21508-14b3-4a32-911a-86699cc0f1aa could not be found. Nov 01 19:10:04.025920 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:10:04.025920 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:10:04.025920 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:10:04.025920 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:10:04.025920 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:10:04.025920 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:10:04.025920 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 01 19:10:04.025920 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 01 19:10:04.025920 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a3e21508-14b3-4a32-911a-86699cc0f1aa could not be found. Nov 01 19:10:04.025920 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:10:04.025920 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-4d8ae754-14e3-4258-a7c7-5ebe0e4a25d7 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Returning 404 to user: Instance a3e21508-14b3-4a32-911a-86699cc0f1aa could not be found. {{(pid=121402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 01 19:10:04.025920 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-4d8ae754-14e3-4258-a7c7-5ebe0e4a25d7 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] 10.222.0.13 "DELETE /compute/v2.1/servers/a3e21508-14b3-4a32-911a-86699cc0f1aa" status: 404 len: 111 microversion: 2.1 time: 0.038414 Nov 01 19:10:04.026896 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1887/3881] 10.222.0.13 () {58 vars in 1239 bytes} [Tue Nov 1 19:10:03 2022] DELETE /compute/v2.1/servers/a3e21508-14b3-4a32-911a-86699cc0f1aa => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 01 19:10:04.037848 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-ef8df65e-b502-4e39-9864-7b97a89db9b2 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:10:04.038617 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-ef8df65e-b502-4e39-9864-7b97a89db9b2 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] [instance: a3e21508-14b3-4a32-911a-86699cc0f1aa] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:10:04.045565 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-ef8df65e-b502-4e39-9864-7b97a89db9b2 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:04.046067 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-ef8df65e-b502-4e39-9864-7b97a89db9b2 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:04.046531 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-ef8df65e-b502-4e39-9864-7b97a89db9b2 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:04.047222 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-ef8df65e-b502-4e39-9864-7b97a89db9b2 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:04.047684 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-ef8df65e-b502-4e39-9864-7b97a89db9b2 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:04.048140 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-ef8df65e-b502-4e39-9864-7b97a89db9b2 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:04.063626 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.wsgi [None req-ef8df65e-b502-4e39-9864-7b97a89db9b2 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] HTTP exception thrown: Instance a3e21508-14b3-4a32-911a-86699cc0f1aa could not be found. Nov 01 19:10:04.065631 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-ef8df65e-b502-4e39-9864-7b97a89db9b2 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Request method failure captured: Nov 01 19:10:04.065631 n-d-863052-2 devstack@n-api.service[121402]: request: GET /compute/v2.1/servers/a3e21508-14b3-4a32-911a-86699cc0f1aa HTTP/1.1 Nov 01 19:10:04.065631 n-d-863052-2 devstack@n-api.service[121402]: Accept: application/json Nov 01 19:10:04.065631 n-d-863052-2 devstack@n-api.service[121402]: Accept-Encoding: identity Nov 01 19:10:04.065631 n-d-863052-2 devstack@n-api.service[121402]: Connection: close Nov 01 19:10:04.065631 n-d-863052-2 devstack@n-api.service[121402]: Content-Length: 0 Nov 01 19:10:04.065631 n-d-863052-2 devstack@n-api.service[121402]: Content-Type: application/json Nov 01 19:10:04.065631 n-d-863052-2 devstack@n-api.service[121402]: Host: 10.222.0.13 Nov 01 19:10:04.065631 n-d-863052-2 devstack@n-api.service[121402]: Openstack-System-Scope: None Nov 01 19:10:04.065631 n-d-863052-2 devstack@n-api.service[121402]: User-Agent: python-urllib3/1.26.12 Nov 01 19:10:04.065631 n-d-863052-2 devstack@n-api.service[121402]: X-Auth-Token: gAAAAABjYW4_RJI8gKBQs81ShXQrfTSIzrNvaZj2e2rGhpR5xhmtuxP4h5uZIl9SLPqPqJ9Syn39UO-el4mPnuEEOGnWtpNlTopD6-Pc1m-VWD64ggyrfBZwUB0hnjNvBvBk6ge071YBJx2gxTN_InEu4tuxz3s-3IQBbEpMSIJZ4VoUIbz4DgY Nov 01 19:10:04.065631 n-d-863052-2 devstack@n-api.service[121402]: X-Domain-Id: None Nov 01 19:10:04.065631 n-d-863052-2 devstack@n-api.service[121402]: X-Domain-Name: None Nov 01 19:10:04.065631 n-d-863052-2 devstack@n-api.service[121402]: X-Identity-Status: Confirmed Nov 01 19:10:04.065631 n-d-863052-2 devstack@n-api.service[121402]: X-Is-Admin-Project: True Nov 01 19:10:04.065631 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Domain-Id: default Nov 01 19:10:04.065631 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Domain-Name: Default Nov 01 19:10:04.065631 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Id: 851785a5f76548898a77d67792888504 Nov 01 19:10:04.065631 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Name: tempest-ServersTestJSON-917766486 Nov 01 19:10:04.065631 n-d-863052-2 devstack@n-api.service[121402]: X-Role: member,reader Nov 01 19:10:04.065631 n-d-863052-2 devstack@n-api.service[121402]: X-Roles: member,reader Nov 01 19:10:04.065631 n-d-863052-2 devstack@n-api.service[121402]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/851785a5f76548898a77d67792888504"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/851785a5f76548898a77d67792888504"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_851785a5f76548898a77d67792888504", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/851785a5f76548898a77d67792888504"}]}] Nov 01 19:10:04.065631 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant: tempest-ServersTestJSON-917766486 Nov 01 19:10:04.065631 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant-Id: 851785a5f76548898a77d67792888504 Nov 01 19:10:04.065631 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant-Name: tempest-ServersTestJSON-917766486 Nov 01 19:10:04.065631 n-d-863052-2 devstack@n-api.service[121402]: X-User: tempest-ServersTestJSON-917766486-project Nov 01 19:10:04.065631 n-d-863052-2 devstack@n-api.service[121402]: X-User-Domain-Id: default Nov 01 19:10:04.065631 n-d-863052-2 devstack@n-api.service[121402]: X-User-Domain-Name: Default Nov 01 19:10:04.065631 n-d-863052-2 devstack@n-api.service[121402]: X-User-Id: 113bd8c844ee490b86a68bc7e1e75da3 Nov 01 19:10:04.065631 n-d-863052-2 devstack@n-api.service[121402]: X-User-Name: tempest-ServersTestJSON-917766486-project Nov 01 19:10:04.065631 n-d-863052-2 devstack@n-api.service[121402]: method: > Nov 01 19:10:04.065631 n-d-863052-2 devstack@n-api.service[121402]: exception: Instance a3e21508-14b3-4a32-911a-86699cc0f1aa could not be found. Nov 01 19:10:04.065631 n-d-863052-2 devstack@n-api.service[121402]: action_args: {'id': 'a3e21508-14b3-4a32-911a-86699cc0f1aa'} Nov 01 19:10:04.065631 n-d-863052-2 devstack@n-api.service[121402]: {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 01 19:10:04.065631 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:10:04.065631 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 01 19:10:04.065631 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 01 19:10:04.065631 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 01 19:10:04.065631 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 01 19:10:04.065631 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 01 19:10:04.065631 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 01 19:10:04.065631 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 01 19:10:04.065631 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 01 19:10:04.065631 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a3e21508-14b3-4a32-911a-86699cc0f1aa could not be found. Nov 01 19:10:04.065631 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:10:04.065631 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:10:04.065631 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:10:04.065631 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:10:04.065631 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:10:04.065631 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:10:04.065631 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 01 19:10:04.065631 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 01 19:10:04.065631 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 01 19:10:04.065631 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 01 19:10:04.065631 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 01 19:10:04.065631 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 01 19:10:04.065631 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 01 19:10:04.065631 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 01 19:10:04.065631 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 01 19:10:04.065631 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 01 19:10:04.065631 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a3e21508-14b3-4a32-911a-86699cc0f1aa could not be found. Nov 01 19:10:04.065631 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:10:04.065631 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:10:04.065631 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:10:04.065631 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:10:04.071339 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:10:04.071339 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:10:04.071339 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 01 19:10:04.071339 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 01 19:10:04.071339 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a3e21508-14b3-4a32-911a-86699cc0f1aa could not be found. Nov 01 19:10:04.071339 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:10:04.071339 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-ef8df65e-b502-4e39-9864-7b97a89db9b2 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Returning 404 to user: Instance a3e21508-14b3-4a32-911a-86699cc0f1aa could not be found. {{(pid=121402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 01 19:10:04.071339 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-ef8df65e-b502-4e39-9864-7b97a89db9b2 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] 10.222.0.13 "GET /compute/v2.1/servers/a3e21508-14b3-4a32-911a-86699cc0f1aa" status: 404 len: 111 microversion: 2.1 time: 0.039377 Nov 01 19:10:04.071339 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1888/3882] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:10:04 2022] GET /compute/v2.1/servers/a3e21508-14b3-4a32-911a-86699cc0f1aa => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 01 19:10:04.077485 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-f2322cd8-6415-4642-bd14-121d1876a75c tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:10:04.078397 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-f2322cd8-6415-4642-bd14-121d1876a75c tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] [instance: c5ca0ec6-c280-42cc-a851-7010c8fb63d2] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:10:04.084107 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.wsgi [None req-f2322cd8-6415-4642-bd14-121d1876a75c tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] HTTP exception thrown: Instance c5ca0ec6-c280-42cc-a851-7010c8fb63d2 could not be found. Nov 01 19:10:04.086209 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-f2322cd8-6415-4642-bd14-121d1876a75c tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Request method failure captured: Nov 01 19:10:04.086209 n-d-863052-2 devstack@n-api.service[121402]: request: DELETE /compute/v2.1/servers/c5ca0ec6-c280-42cc-a851-7010c8fb63d2 HTTP/1.1 Nov 01 19:10:04.086209 n-d-863052-2 devstack@n-api.service[121402]: Accept: application/json Nov 01 19:10:04.086209 n-d-863052-2 devstack@n-api.service[121402]: Accept-Encoding: identity Nov 01 19:10:04.086209 n-d-863052-2 devstack@n-api.service[121402]: Connection: close Nov 01 19:10:04.086209 n-d-863052-2 devstack@n-api.service[121402]: Content-Length: 0 Nov 01 19:10:04.086209 n-d-863052-2 devstack@n-api.service[121402]: Content-Type: application/json Nov 01 19:10:04.086209 n-d-863052-2 devstack@n-api.service[121402]: Host: 10.222.0.13 Nov 01 19:10:04.086209 n-d-863052-2 devstack@n-api.service[121402]: Openstack-System-Scope: None Nov 01 19:10:04.086209 n-d-863052-2 devstack@n-api.service[121402]: User-Agent: python-urllib3/1.26.12 Nov 01 19:10:04.086209 n-d-863052-2 devstack@n-api.service[121402]: X-Auth-Token: gAAAAABjYW4_RJI8gKBQs81ShXQrfTSIzrNvaZj2e2rGhpR5xhmtuxP4h5uZIl9SLPqPqJ9Syn39UO-el4mPnuEEOGnWtpNlTopD6-Pc1m-VWD64ggyrfBZwUB0hnjNvBvBk6ge071YBJx2gxTN_InEu4tuxz3s-3IQBbEpMSIJZ4VoUIbz4DgY Nov 01 19:10:04.086209 n-d-863052-2 devstack@n-api.service[121402]: X-Domain-Id: None Nov 01 19:10:04.086209 n-d-863052-2 devstack@n-api.service[121402]: X-Domain-Name: None Nov 01 19:10:04.086209 n-d-863052-2 devstack@n-api.service[121402]: X-Identity-Status: Confirmed Nov 01 19:10:04.086209 n-d-863052-2 devstack@n-api.service[121402]: X-Is-Admin-Project: True Nov 01 19:10:04.086209 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Domain-Id: default Nov 01 19:10:04.086209 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Domain-Name: Default Nov 01 19:10:04.086209 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Id: 851785a5f76548898a77d67792888504 Nov 01 19:10:04.086209 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Name: tempest-ServersTestJSON-917766486 Nov 01 19:10:04.086209 n-d-863052-2 devstack@n-api.service[121402]: X-Role: member,reader Nov 01 19:10:04.086209 n-d-863052-2 devstack@n-api.service[121402]: X-Roles: member,reader Nov 01 19:10:04.086209 n-d-863052-2 devstack@n-api.service[121402]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/851785a5f76548898a77d67792888504"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/851785a5f76548898a77d67792888504"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_851785a5f76548898a77d67792888504", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/851785a5f76548898a77d67792888504"}]}] Nov 01 19:10:04.086209 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant: tempest-ServersTestJSON-917766486 Nov 01 19:10:04.086209 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant-Id: 851785a5f76548898a77d67792888504 Nov 01 19:10:04.086209 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant-Name: tempest-ServersTestJSON-917766486 Nov 01 19:10:04.086209 n-d-863052-2 devstack@n-api.service[121402]: X-User: tempest-ServersTestJSON-917766486-project Nov 01 19:10:04.086209 n-d-863052-2 devstack@n-api.service[121402]: X-User-Domain-Id: default Nov 01 19:10:04.086209 n-d-863052-2 devstack@n-api.service[121402]: X-User-Domain-Name: Default Nov 01 19:10:04.086209 n-d-863052-2 devstack@n-api.service[121402]: X-User-Id: 113bd8c844ee490b86a68bc7e1e75da3 Nov 01 19:10:04.086209 n-d-863052-2 devstack@n-api.service[121402]: X-User-Name: tempest-ServersTestJSON-917766486-project Nov 01 19:10:04.086209 n-d-863052-2 devstack@n-api.service[121402]: method: > Nov 01 19:10:04.086209 n-d-863052-2 devstack@n-api.service[121402]: exception: Instance c5ca0ec6-c280-42cc-a851-7010c8fb63d2 could not be found. Nov 01 19:10:04.086209 n-d-863052-2 devstack@n-api.service[121402]: action_args: {'id': 'c5ca0ec6-c280-42cc-a851-7010c8fb63d2'} Nov 01 19:10:04.086209 n-d-863052-2 devstack@n-api.service[121402]: {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 01 19:10:04.086209 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:10:04.086209 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 01 19:10:04.086209 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 01 19:10:04.086209 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 01 19:10:04.086209 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 01 19:10:04.086209 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Nov 01 19:10:04.086209 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Nov 01 19:10:04.086209 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c5ca0ec6-c280-42cc-a851-7010c8fb63d2 could not be found. Nov 01 19:10:04.086209 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:10:04.086209 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:10:04.086209 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:10:04.086209 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:10:04.086209 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:10:04.086209 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:10:04.086209 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 01 19:10:04.086209 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 01 19:10:04.086209 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 01 19:10:04.086209 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 01 19:10:04.086209 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 01 19:10:04.086209 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 01 19:10:04.086209 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 01 19:10:04.086209 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 01 19:10:04.086209 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 01 19:10:04.086209 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 01 19:10:04.086209 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 01 19:10:04.086209 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 01 19:10:04.086209 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c5ca0ec6-c280-42cc-a851-7010c8fb63d2 could not be found. Nov 01 19:10:04.086209 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:10:04.086209 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:10:04.086209 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:10:04.091301 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:10:04.091301 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:10:04.091301 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:10:04.091301 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 01 19:10:04.091301 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 01 19:10:04.091301 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c5ca0ec6-c280-42cc-a851-7010c8fb63d2 could not be found. Nov 01 19:10:04.091301 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:10:04.091301 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-f2322cd8-6415-4642-bd14-121d1876a75c tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Returning 404 to user: Instance c5ca0ec6-c280-42cc-a851-7010c8fb63d2 could not be found. {{(pid=121402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 01 19:10:04.091301 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-f2322cd8-6415-4642-bd14-121d1876a75c tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] 10.222.0.13 "DELETE /compute/v2.1/servers/c5ca0ec6-c280-42cc-a851-7010c8fb63d2" status: 404 len: 111 microversion: 2.1 time: 0.014285 Nov 01 19:10:04.091301 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1889/3883] 10.222.0.13 () {58 vars in 1239 bytes} [Tue Nov 1 19:10:04 2022] DELETE /compute/v2.1/servers/c5ca0ec6-c280-42cc-a851-7010c8fb63d2 => generated 111 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 01 19:10:04.101136 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-d6a29a98-3747-4e9f-81fb-f0b7ba6a1f2a tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:10:04.102004 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-d6a29a98-3747-4e9f-81fb-f0b7ba6a1f2a tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] [instance: c5ca0ec6-c280-42cc-a851-7010c8fb63d2] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:10:04.114477 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.wsgi [None req-d6a29a98-3747-4e9f-81fb-f0b7ba6a1f2a tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] HTTP exception thrown: Instance c5ca0ec6-c280-42cc-a851-7010c8fb63d2 could not be found. Nov 01 19:10:04.116726 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-d6a29a98-3747-4e9f-81fb-f0b7ba6a1f2a tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Request method failure captured: Nov 01 19:10:04.116726 n-d-863052-2 devstack@n-api.service[121402]: request: GET /compute/v2.1/servers/c5ca0ec6-c280-42cc-a851-7010c8fb63d2 HTTP/1.1 Nov 01 19:10:04.116726 n-d-863052-2 devstack@n-api.service[121402]: Accept: application/json Nov 01 19:10:04.116726 n-d-863052-2 devstack@n-api.service[121402]: Accept-Encoding: identity Nov 01 19:10:04.116726 n-d-863052-2 devstack@n-api.service[121402]: Connection: close Nov 01 19:10:04.116726 n-d-863052-2 devstack@n-api.service[121402]: Content-Length: 0 Nov 01 19:10:04.116726 n-d-863052-2 devstack@n-api.service[121402]: Content-Type: application/json Nov 01 19:10:04.116726 n-d-863052-2 devstack@n-api.service[121402]: Host: 10.222.0.13 Nov 01 19:10:04.116726 n-d-863052-2 devstack@n-api.service[121402]: Openstack-System-Scope: None Nov 01 19:10:04.116726 n-d-863052-2 devstack@n-api.service[121402]: User-Agent: python-urllib3/1.26.12 Nov 01 19:10:04.116726 n-d-863052-2 devstack@n-api.service[121402]: X-Auth-Token: gAAAAABjYW4_RJI8gKBQs81ShXQrfTSIzrNvaZj2e2rGhpR5xhmtuxP4h5uZIl9SLPqPqJ9Syn39UO-el4mPnuEEOGnWtpNlTopD6-Pc1m-VWD64ggyrfBZwUB0hnjNvBvBk6ge071YBJx2gxTN_InEu4tuxz3s-3IQBbEpMSIJZ4VoUIbz4DgY Nov 01 19:10:04.116726 n-d-863052-2 devstack@n-api.service[121402]: X-Domain-Id: None Nov 01 19:10:04.116726 n-d-863052-2 devstack@n-api.service[121402]: X-Domain-Name: None Nov 01 19:10:04.116726 n-d-863052-2 devstack@n-api.service[121402]: X-Identity-Status: Confirmed Nov 01 19:10:04.116726 n-d-863052-2 devstack@n-api.service[121402]: X-Is-Admin-Project: True Nov 01 19:10:04.116726 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Domain-Id: default Nov 01 19:10:04.116726 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Domain-Name: Default Nov 01 19:10:04.116726 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Id: 851785a5f76548898a77d67792888504 Nov 01 19:10:04.116726 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Name: tempest-ServersTestJSON-917766486 Nov 01 19:10:04.116726 n-d-863052-2 devstack@n-api.service[121402]: X-Role: member,reader Nov 01 19:10:04.116726 n-d-863052-2 devstack@n-api.service[121402]: X-Roles: member,reader Nov 01 19:10:04.116726 n-d-863052-2 devstack@n-api.service[121402]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/851785a5f76548898a77d67792888504"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/851785a5f76548898a77d67792888504"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_851785a5f76548898a77d67792888504", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/851785a5f76548898a77d67792888504"}]}] Nov 01 19:10:04.116726 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant: tempest-ServersTestJSON-917766486 Nov 01 19:10:04.116726 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant-Id: 851785a5f76548898a77d67792888504 Nov 01 19:10:04.116726 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant-Name: tempest-ServersTestJSON-917766486 Nov 01 19:10:04.116726 n-d-863052-2 devstack@n-api.service[121402]: X-User: tempest-ServersTestJSON-917766486-project Nov 01 19:10:04.116726 n-d-863052-2 devstack@n-api.service[121402]: X-User-Domain-Id: default Nov 01 19:10:04.116726 n-d-863052-2 devstack@n-api.service[121402]: X-User-Domain-Name: Default Nov 01 19:10:04.116726 n-d-863052-2 devstack@n-api.service[121402]: X-User-Id: 113bd8c844ee490b86a68bc7e1e75da3 Nov 01 19:10:04.116726 n-d-863052-2 devstack@n-api.service[121402]: X-User-Name: tempest-ServersTestJSON-917766486-project Nov 01 19:10:04.116726 n-d-863052-2 devstack@n-api.service[121402]: method: > Nov 01 19:10:04.116726 n-d-863052-2 devstack@n-api.service[121402]: exception: Instance c5ca0ec6-c280-42cc-a851-7010c8fb63d2 could not be found. Nov 01 19:10:04.116726 n-d-863052-2 devstack@n-api.service[121402]: action_args: {'id': 'c5ca0ec6-c280-42cc-a851-7010c8fb63d2'} Nov 01 19:10:04.116726 n-d-863052-2 devstack@n-api.service[121402]: {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 01 19:10:04.116726 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:10:04.116726 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 01 19:10:04.116726 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 01 19:10:04.116726 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 01 19:10:04.116726 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 01 19:10:04.116726 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Nov 01 19:10:04.116726 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Nov 01 19:10:04.116726 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c5ca0ec6-c280-42cc-a851-7010c8fb63d2 could not be found. Nov 01 19:10:04.116726 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:10:04.116726 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:10:04.116726 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:10:04.116726 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:10:04.116726 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:10:04.116726 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:10:04.116726 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 01 19:10:04.116726 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 01 19:10:04.116726 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 01 19:10:04.116726 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 01 19:10:04.116726 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 01 19:10:04.116726 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 01 19:10:04.116726 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 01 19:10:04.116726 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 01 19:10:04.116726 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 01 19:10:04.116726 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 01 19:10:04.116726 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c5ca0ec6-c280-42cc-a851-7010c8fb63d2 could not be found. Nov 01 19:10:04.116726 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:10:04.116726 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:10:04.116726 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:10:04.116726 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:10:04.116726 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:10:04.116726 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:10:04.121768 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 01 19:10:04.121768 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 01 19:10:04.121768 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c5ca0ec6-c280-42cc-a851-7010c8fb63d2 could not be found. Nov 01 19:10:04.121768 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:10:04.121768 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-d6a29a98-3747-4e9f-81fb-f0b7ba6a1f2a tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Returning 404 to user: Instance c5ca0ec6-c280-42cc-a851-7010c8fb63d2 could not be found. {{(pid=121402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 01 19:10:04.122973 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-d6a29a98-3747-4e9f-81fb-f0b7ba6a1f2a tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] 10.222.0.13 "GET /compute/v2.1/servers/c5ca0ec6-c280-42cc-a851-7010c8fb63d2" status: 404 len: 111 microversion: 2.1 time: 0.024101 Nov 01 19:10:04.123651 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1890/3884] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:10:04 2022] GET /compute/v2.1/servers/c5ca0ec6-c280-42cc-a851-7010c8fb63d2 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 01 19:10:04.131851 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-a274e918-e5e9-4f53-a49b-bf716f303637 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:10:04.132635 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-a274e918-e5e9-4f53-a49b-bf716f303637 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] [instance: f5d5dfa8-4516-428f-bcf5-f0a1174bd14e] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:10:04.139269 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-a274e918-e5e9-4f53-a49b-bf716f303637 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:04.140194 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-a274e918-e5e9-4f53-a49b-bf716f303637 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:04.140876 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-a274e918-e5e9-4f53-a49b-bf716f303637 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:04.141713 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-a274e918-e5e9-4f53-a49b-bf716f303637 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:04.142174 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-a274e918-e5e9-4f53-a49b-bf716f303637 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:04.142602 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-a274e918-e5e9-4f53-a49b-bf716f303637 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:04.156825 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-a396e5e6-01df-4385-8262-9e25064d458b tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2868ccfdfb164cffa37232c821f205a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04ef687c40bd45c297d22a791bae58cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:10:04.171972 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-a274e918-e5e9-4f53-a49b-bf716f303637 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] [instance: f5d5dfa8-4516-428f-bcf5-f0a1174bd14e] Going to try to terminate instance {{(pid=121402) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 01 19:10:04.175068 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-a396e5e6-01df-4385-8262-9e25064d458b tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] 10.222.0.13 "GET /compute/v2.1/servers/ac19dd18-c22a-46de-91ef-454a0b78872f" status: 200 len: 1523 microversion: 2.1 time: 0.219551 Nov 01 19:10:04.175965 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1995/3885] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:10:03 2022] GET /compute/v2.1/servers/ac19dd18-c22a-46de-91ef-454a0b78872f => generated 1523 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:10:04.229154 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [req-0db7267b-58bc-4400-b954-640b950dd2e7 req-b8d8f5e4-1485-486a-af51-6f2a3d937a13 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8c460f41-9dc1-4f0c-9d2d-0a91b38f7787", "tag": "436f0d66-4268-48fc-8c8a-803f4e2f3428"}]} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:10:04.240516 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-0db7267b-58bc-4400-b954-640b950dd2e7 req-b8d8f5e4-1485-486a-af51-6f2a3d937a13 service nova] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:04.241015 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-0db7267b-58bc-4400-b954-640b950dd2e7 req-b8d8f5e4-1485-486a-af51-6f2a3d937a13 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:04.241442 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-0db7267b-58bc-4400-b954-640b950dd2e7 req-b8d8f5e4-1485-486a-af51-6f2a3d937a13 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:04.257946 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-a274e918-e5e9-4f53-a49b-bf716f303637 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] 10.222.0.13 "DELETE /compute/v2.1/servers/f5d5dfa8-4516-428f-bcf5-f0a1174bd14e" status: 204 len: 0 microversion: 2.1 time: 0.129192 Nov 01 19:10:04.261489 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1891/3886] 10.222.0.13 () {58 vars in 1239 bytes} [Tue Nov 1 19:10:04 2022] DELETE /compute/v2.1/servers/f5d5dfa8-4516-428f-bcf5-f0a1174bd14e => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 01 19:10:04.270369 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.compute.server_external_events [req-0db7267b-58bc-4400-b954-640b950dd2e7 req-b8d8f5e4-1485-486a-af51-6f2a3d937a13 service nova] Creating event network-changed:436f0d66-4268-48fc-8c8a-803f4e2f3428 for instance 8c460f41-9dc1-4f0c-9d2d-0a91b38f7787 on n-h1-863052-2 Nov 01 19:10:04.271816 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-f18c1564-562a-4229-8980-c61e7c9abd11 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:10:04.272638 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-f18c1564-562a-4229-8980-c61e7c9abd11 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] [instance: f5d5dfa8-4516-428f-bcf5-f0a1174bd14e] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:10:04.278846 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [req-0db7267b-58bc-4400-b954-640b950dd2e7 req-b8d8f5e4-1485-486a-af51-6f2a3d937a13 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054666 Nov 01 19:10:04.279789 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1996/3887] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Nov 1 19:10:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:10:04.280858 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f18c1564-562a-4229-8980-c61e7c9abd11 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:04.281382 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f18c1564-562a-4229-8980-c61e7c9abd11 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:04.282127 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f18c1564-562a-4229-8980-c61e7c9abd11 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:04.282524 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f18c1564-562a-4229-8980-c61e7c9abd11 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:04.282980 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f18c1564-562a-4229-8980-c61e7c9abd11 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:04.283390 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f18c1564-562a-4229-8980-c61e7c9abd11 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:04.734697 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-f18c1564-562a-4229-8980-c61e7c9abd11 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113bd8c844ee490b86a68bc7e1e75da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '851785a5f76548898a77d67792888504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:10:04.743016 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-f18c1564-562a-4229-8980-c61e7c9abd11 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] 10.222.0.13 "GET /compute/v2.1/servers/f5d5dfa8-4516-428f-bcf5-f0a1174bd14e" status: 200 len: 1479 microversion: 2.1 time: 0.477884 Nov 01 19:10:04.743581 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1892/3888] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:10:04 2022] GET /compute/v2.1/servers/f5d5dfa8-4516-428f-bcf5-f0a1174bd14e => generated 1479 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:10:04.897266 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-ec8bb5a7-7aae-4dd3-94fa-e0256ddd824c tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:10:04.897971 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-ec8bb5a7-7aae-4dd3-94fa-e0256ddd824c tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] [instance: 8c460f41-9dc1-4f0c-9d2d-0a91b38f7787] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:10:04.903962 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-ec8bb5a7-7aae-4dd3-94fa-e0256ddd824c tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:04.904444 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-ec8bb5a7-7aae-4dd3-94fa-e0256ddd824c tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:04.904921 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-ec8bb5a7-7aae-4dd3-94fa-e0256ddd824c tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:04.905610 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-ec8bb5a7-7aae-4dd3-94fa-e0256ddd824c tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:04.906069 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-ec8bb5a7-7aae-4dd3-94fa-e0256ddd824c tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:04.906554 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-ec8bb5a7-7aae-4dd3-94fa-e0256ddd824c tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:05.042136 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-ec8bb5a7-7aae-4dd3-94fa-e0256ddd824c tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '058480d92c9b4ab4af6815d0438a65c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee9dc49b89143f781e4ab30296e4d01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:10:05.051127 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-ec8bb5a7-7aae-4dd3-94fa-e0256ddd824c tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] 10.222.0.13 "GET /compute/v2.1/servers/8c460f41-9dc1-4f0c-9d2d-0a91b38f7787" status: 200 len: 1312 microversion: 2.1 time: 0.158439 Nov 01 19:10:05.051706 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1997/3889] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:10:04 2022] GET /compute/v2.1/servers/8c460f41-9dc1-4f0c-9d2d-0a91b38f7787 => generated 1312 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:10:05.200261 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-b3fe4b28-093d-4dc5-8c75-27bddf97a0a7 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:10:05.200897 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-b3fe4b28-093d-4dc5-8c75-27bddf97a0a7 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] [instance: ac19dd18-c22a-46de-91ef-454a0b78872f] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:10:05.207189 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b3fe4b28-093d-4dc5-8c75-27bddf97a0a7 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:05.207807 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b3fe4b28-093d-4dc5-8c75-27bddf97a0a7 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:05.208250 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b3fe4b28-093d-4dc5-8c75-27bddf97a0a7 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:05.209119 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b3fe4b28-093d-4dc5-8c75-27bddf97a0a7 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:05.209576 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b3fe4b28-093d-4dc5-8c75-27bddf97a0a7 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:05.210304 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b3fe4b28-093d-4dc5-8c75-27bddf97a0a7 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:05.451228 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-b3fe4b28-093d-4dc5-8c75-27bddf97a0a7 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2868ccfdfb164cffa37232c821f205a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04ef687c40bd45c297d22a791bae58cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:10:05.462067 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-b3fe4b28-093d-4dc5-8c75-27bddf97a0a7 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] 10.222.0.13 "GET /compute/v2.1/servers/ac19dd18-c22a-46de-91ef-454a0b78872f" status: 200 len: 1523 microversion: 2.1 time: 0.266682 Nov 01 19:10:05.462652 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1893/3890] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:10:05 2022] GET /compute/v2.1/servers/ac19dd18-c22a-46de-91ef-454a0b78872f => generated 1523 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:10:05.766710 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-6eee59fb-5b59-4e9b-821e-beb195cf0887 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:10:05.767421 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-6eee59fb-5b59-4e9b-821e-beb195cf0887 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] [instance: f5d5dfa8-4516-428f-bcf5-f0a1174bd14e] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:10:05.774387 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-6eee59fb-5b59-4e9b-821e-beb195cf0887 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:05.774883 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-6eee59fb-5b59-4e9b-821e-beb195cf0887 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:05.775327 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-6eee59fb-5b59-4e9b-821e-beb195cf0887 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:05.776029 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-6eee59fb-5b59-4e9b-821e-beb195cf0887 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:05.776487 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-6eee59fb-5b59-4e9b-821e-beb195cf0887 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:05.776947 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-6eee59fb-5b59-4e9b-821e-beb195cf0887 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:06.039894 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-6eee59fb-5b59-4e9b-821e-beb195cf0887 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113bd8c844ee490b86a68bc7e1e75da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '851785a5f76548898a77d67792888504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:10:06.053343 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-6eee59fb-5b59-4e9b-821e-beb195cf0887 tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] 10.222.0.13 "GET /compute/v2.1/servers/f5d5dfa8-4516-428f-bcf5-f0a1174bd14e" status: 200 len: 1479 microversion: 2.1 time: 0.290522 Nov 01 19:10:06.054715 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1998/3891] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:10:05 2022] GET /compute/v2.1/servers/f5d5dfa8-4516-428f-bcf5-f0a1174bd14e => generated 1479 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:10:06.074463 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-2788044c-82c0-4f13-a68b-02c9815bd1a4 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:10:06.075851 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-2788044c-82c0-4f13-a68b-02c9815bd1a4 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] [instance: 8c460f41-9dc1-4f0c-9d2d-0a91b38f7787] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:10:06.085143 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2788044c-82c0-4f13-a68b-02c9815bd1a4 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:06.086277 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2788044c-82c0-4f13-a68b-02c9815bd1a4 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:06.087008 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2788044c-82c0-4f13-a68b-02c9815bd1a4 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:06.088060 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2788044c-82c0-4f13-a68b-02c9815bd1a4 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:06.089305 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2788044c-82c0-4f13-a68b-02c9815bd1a4 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:06.090032 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2788044c-82c0-4f13-a68b-02c9815bd1a4 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:06.294508 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-2788044c-82c0-4f13-a68b-02c9815bd1a4 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '058480d92c9b4ab4af6815d0438a65c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee9dc49b89143f781e4ab30296e4d01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:10:06.307936 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-2788044c-82c0-4f13-a68b-02c9815bd1a4 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] 10.222.0.13 "GET /compute/v2.1/servers/8c460f41-9dc1-4f0c-9d2d-0a91b38f7787" status: 200 len: 1312 microversion: 2.1 time: 0.237264 Nov 01 19:10:06.339895 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1894/3892] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:10:06 2022] GET /compute/v2.1/servers/8c460f41-9dc1-4f0c-9d2d-0a91b38f7787 => generated 1312 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:10:06.478402 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [req-77459183-d877-4a09-8dfa-9b3ded968305 req-a535f761-b2c2-47bb-9432-21cb750e0e1d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f5d5dfa8-4516-428f-bcf5-f0a1174bd14e", "name": "network-vif-deleted", "tag": "4db67a8c-a091-40b4-adb0-8c3b246af143"}]} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:10:06.487774 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-91f345fc-8c53-4467-b0ac-28e04b655d0b tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:10:06.489455 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-91f345fc-8c53-4467-b0ac-28e04b655d0b tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] [instance: ac19dd18-c22a-46de-91ef-454a0b78872f] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:10:06.493407 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-77459183-d877-4a09-8dfa-9b3ded968305 req-a535f761-b2c2-47bb-9432-21cb750e0e1d service nova] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:06.493925 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-77459183-d877-4a09-8dfa-9b3ded968305 req-a535f761-b2c2-47bb-9432-21cb750e0e1d service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:06.494765 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-77459183-d877-4a09-8dfa-9b3ded968305 req-a535f761-b2c2-47bb-9432-21cb750e0e1d service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:06.501858 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-91f345fc-8c53-4467-b0ac-28e04b655d0b tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:06.504722 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-91f345fc-8c53-4467-b0ac-28e04b655d0b tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:06.505939 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-91f345fc-8c53-4467-b0ac-28e04b655d0b tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:06.511215 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-91f345fc-8c53-4467-b0ac-28e04b655d0b tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:06.512127 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-91f345fc-8c53-4467-b0ac-28e04b655d0b tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:06.512880 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-91f345fc-8c53-4467-b0ac-28e04b655d0b tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:06.523101 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.compute.server_external_events [req-77459183-d877-4a09-8dfa-9b3ded968305 req-a535f761-b2c2-47bb-9432-21cb750e0e1d service nova] Creating event network-vif-deleted:4db67a8c-a091-40b4-adb0-8c3b246af143 for instance f5d5dfa8-4516-428f-bcf5-f0a1174bd14e on n-h2-863052-2 Nov 01 19:10:06.539103 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [req-77459183-d877-4a09-8dfa-9b3ded968305 req-a535f761-b2c2-47bb-9432-21cb750e0e1d service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065474 Nov 01 19:10:06.542165 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 1999/3893] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Nov 1 19:10:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:10:06.713328 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-91f345fc-8c53-4467-b0ac-28e04b655d0b tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2868ccfdfb164cffa37232c821f205a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04ef687c40bd45c297d22a791bae58cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:10:06.735768 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-91f345fc-8c53-4467-b0ac-28e04b655d0b tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] 10.222.0.13 "GET /compute/v2.1/servers/ac19dd18-c22a-46de-91ef-454a0b78872f" status: 200 len: 1523 microversion: 2.1 time: 0.248605 Nov 01 19:10:06.736402 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1895/3894] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:10:06 2022] GET /compute/v2.1/servers/ac19dd18-c22a-46de-91ef-454a0b78872f => generated 1523 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:10:07.080746 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-4f0e8b89-597a-49d1-82ca-3edad37607af tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:10:07.082983 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-4f0e8b89-597a-49d1-82ca-3edad37607af tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] [instance: f5d5dfa8-4516-428f-bcf5-f0a1174bd14e] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:10:07.091187 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-4f0e8b89-597a-49d1-82ca-3edad37607af tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:07.091668 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-4f0e8b89-597a-49d1-82ca-3edad37607af tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:07.092102 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-4f0e8b89-597a-49d1-82ca-3edad37607af tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:07.092850 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-4f0e8b89-597a-49d1-82ca-3edad37607af tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:07.093535 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-4f0e8b89-597a-49d1-82ca-3edad37607af tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:07.093955 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-4f0e8b89-597a-49d1-82ca-3edad37607af tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:07.138845 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-4f0e8b89-597a-49d1-82ca-3edad37607af tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:07.140129 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-4f0e8b89-597a-49d1-82ca-3edad37607af tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:07.140907 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-4f0e8b89-597a-49d1-82ca-3edad37607af tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:07.141526 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.objects.instance [None req-4f0e8b89-597a-49d1-82ca-3edad37607af tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lazy-loading 'fault' on Instance uuid f5d5dfa8-4516-428f-bcf5-f0a1174bd14e {{(pid=121403) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 01 19:10:07.193281 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-4f0e8b89-597a-49d1-82ca-3edad37607af tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113bd8c844ee490b86a68bc7e1e75da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '851785a5f76548898a77d67792888504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:10:07.208069 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-4f0e8b89-597a-49d1-82ca-3edad37607af tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] 10.222.0.13 "GET /compute/v2.1/servers/f5d5dfa8-4516-428f-bcf5-f0a1174bd14e" status: 200 len: 1282 microversion: 2.1 time: 0.132435 Nov 01 19:10:07.208701 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 2000/3895] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:10:07 2022] GET /compute/v2.1/servers/f5d5dfa8-4516-428f-bcf5-f0a1174bd14e => generated 1282 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:10:07.340767 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-5cce748e-67f3-414a-8216-78c1da01188f tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:10:07.342174 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-5cce748e-67f3-414a-8216-78c1da01188f tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] [instance: 8c460f41-9dc1-4f0c-9d2d-0a91b38f7787] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:10:07.350436 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-5cce748e-67f3-414a-8216-78c1da01188f tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:07.356089 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-5cce748e-67f3-414a-8216-78c1da01188f tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:07.358862 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-5cce748e-67f3-414a-8216-78c1da01188f tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:07.361905 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-5cce748e-67f3-414a-8216-78c1da01188f tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:07.362493 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-5cce748e-67f3-414a-8216-78c1da01188f tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:07.362830 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-5cce748e-67f3-414a-8216-78c1da01188f tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:07.521405 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-5cce748e-67f3-414a-8216-78c1da01188f tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '058480d92c9b4ab4af6815d0438a65c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee9dc49b89143f781e4ab30296e4d01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:10:07.529420 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-5cce748e-67f3-414a-8216-78c1da01188f tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] 10.222.0.13 "GET /compute/v2.1/servers/8c460f41-9dc1-4f0c-9d2d-0a91b38f7787" status: 200 len: 1312 microversion: 2.1 time: 0.194303 Nov 01 19:10:07.530056 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1896/3896] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:10:07 2022] GET /compute/v2.1/servers/8c460f41-9dc1-4f0c-9d2d-0a91b38f7787 => generated 1312 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:10:07.763205 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-85a15230-e240-409a-8c83-8124f7cbf60d tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:10:07.763929 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-85a15230-e240-409a-8c83-8124f7cbf60d tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] [instance: ac19dd18-c22a-46de-91ef-454a0b78872f] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:10:07.770369 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-85a15230-e240-409a-8c83-8124f7cbf60d tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:07.771127 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-85a15230-e240-409a-8c83-8124f7cbf60d tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:07.771737 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-85a15230-e240-409a-8c83-8124f7cbf60d tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:07.772621 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-85a15230-e240-409a-8c83-8124f7cbf60d tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:07.773077 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-85a15230-e240-409a-8c83-8124f7cbf60d tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:07.773667 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-85a15230-e240-409a-8c83-8124f7cbf60d tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:07.819548 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-7905445a-108e-4e9e-aa03-5fa7cc20417a tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:10:07.820675 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-7905445a-108e-4e9e-aa03-5fa7cc20417a tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] [instance: af1071a8-a090-44c9-890c-123ca3ff39f1] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:10:07.827275 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-7905445a-108e-4e9e-aa03-5fa7cc20417a tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:07.828361 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-7905445a-108e-4e9e-aa03-5fa7cc20417a tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:07.828924 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-7905445a-108e-4e9e-aa03-5fa7cc20417a tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:07.829932 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-7905445a-108e-4e9e-aa03-5fa7cc20417a tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:07.830617 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-7905445a-108e-4e9e-aa03-5fa7cc20417a tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:07.831269 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-7905445a-108e-4e9e-aa03-5fa7cc20417a tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:07.860175 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-7905445a-108e-4e9e-aa03-5fa7cc20417a tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] [instance: af1071a8-a090-44c9-890c-123ca3ff39f1] Going to try to terminate instance {{(pid=121403) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 01 19:10:07.915719 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-85a15230-e240-409a-8c83-8124f7cbf60d tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2868ccfdfb164cffa37232c821f205a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04ef687c40bd45c297d22a791bae58cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:10:07.924092 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-85a15230-e240-409a-8c83-8124f7cbf60d tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] 10.222.0.13 "GET /compute/v2.1/servers/ac19dd18-c22a-46de-91ef-454a0b78872f" status: 200 len: 1523 microversion: 2.1 time: 0.164593 Nov 01 19:10:07.925034 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1897/3897] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:10:07 2022] GET /compute/v2.1/servers/ac19dd18-c22a-46de-91ef-454a0b78872f => generated 1523 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 19:10:07.959231 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-7905445a-108e-4e9e-aa03-5fa7cc20417a tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] 10.222.0.13 "DELETE /compute/v2.1/servers/af1071a8-a090-44c9-890c-123ca3ff39f1" status: 204 len: 0 microversion: 2.42 time: 0.319687 Nov 01 19:10:07.964661 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 2001/3898] 10.222.0.13 () {60 vars in 1280 bytes} [Tue Nov 1 19:10:07 2022] DELETE /compute/v2.1/servers/af1071a8-a090-44c9-890c-123ca3ff39f1 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 01 19:10:07.970022 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-03134f6f-e540-468f-ae91-b9d47e1f9338 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:10:07.971093 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-03134f6f-e540-468f-ae91-b9d47e1f9338 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] [instance: af1071a8-a090-44c9-890c-123ca3ff39f1] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:10:07.978145 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-03134f6f-e540-468f-ae91-b9d47e1f9338 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:07.978851 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-03134f6f-e540-468f-ae91-b9d47e1f9338 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:07.979285 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-03134f6f-e540-468f-ae91-b9d47e1f9338 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:07.979979 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-03134f6f-e540-468f-ae91-b9d47e1f9338 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:07.980642 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-03134f6f-e540-468f-ae91-b9d47e1f9338 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:07.981070 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-03134f6f-e540-468f-ae91-b9d47e1f9338 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:08.171525 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-03134f6f-e540-468f-ae91-b9d47e1f9338 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '301ed3b9c37449bc9ade378f3c73a768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8807757227574c828dca1947af76659d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:10:08.180845 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-03134f6f-e540-468f-ae91-b9d47e1f9338 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '301ed3b9c37449bc9ade378f3c73a768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8807757227574c828dca1947af76659d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:10:08.182473 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-03134f6f-e540-468f-ae91-b9d47e1f9338 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '301ed3b9c37449bc9ade378f3c73a768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8807757227574c828dca1947af76659d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:10:08.183506 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-03134f6f-e540-468f-ae91-b9d47e1f9338 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] 10.222.0.13 "GET /compute/v2.1/servers/af1071a8-a090-44c9-890c-123ca3ff39f1" status: 200 len: 2962 microversion: 2.42 time: 0.217998 Nov 01 19:10:08.184076 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1898/3899] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 19:10:07 2022] GET /compute/v2.1/servers/af1071a8-a090-44c9-890c-123ca3ff39f1 => generated 2962 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 19:10:08.233290 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-8e7d3c41-08b0-4c1f-b605-5e22fb2c648b tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:10:08.234000 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-8e7d3c41-08b0-4c1f-b605-5e22fb2c648b tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] [instance: f5d5dfa8-4516-428f-bcf5-f0a1174bd14e] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:10:08.241672 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-8e7d3c41-08b0-4c1f-b605-5e22fb2c648b tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:08.242350 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-8e7d3c41-08b0-4c1f-b605-5e22fb2c648b tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:08.243086 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-8e7d3c41-08b0-4c1f-b605-5e22fb2c648b tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:08.243780 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-8e7d3c41-08b0-4c1f-b605-5e22fb2c648b tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:08.244229 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-8e7d3c41-08b0-4c1f-b605-5e22fb2c648b tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:08.244683 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-8e7d3c41-08b0-4c1f-b605-5e22fb2c648b tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:08.258843 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.wsgi [None req-8e7d3c41-08b0-4c1f-b605-5e22fb2c648b tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] HTTP exception thrown: Instance f5d5dfa8-4516-428f-bcf5-f0a1174bd14e could not be found. Nov 01 19:10:08.260482 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-8e7d3c41-08b0-4c1f-b605-5e22fb2c648b tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Request method failure captured: Nov 01 19:10:08.260482 n-d-863052-2 devstack@n-api.service[121403]: request: GET /compute/v2.1/servers/f5d5dfa8-4516-428f-bcf5-f0a1174bd14e HTTP/1.1 Nov 01 19:10:08.260482 n-d-863052-2 devstack@n-api.service[121403]: Accept: application/json Nov 01 19:10:08.260482 n-d-863052-2 devstack@n-api.service[121403]: Accept-Encoding: identity Nov 01 19:10:08.260482 n-d-863052-2 devstack@n-api.service[121403]: Connection: close Nov 01 19:10:08.260482 n-d-863052-2 devstack@n-api.service[121403]: Content-Length: 0 Nov 01 19:10:08.260482 n-d-863052-2 devstack@n-api.service[121403]: Content-Type: application/json Nov 01 19:10:08.260482 n-d-863052-2 devstack@n-api.service[121403]: Host: 10.222.0.13 Nov 01 19:10:08.260482 n-d-863052-2 devstack@n-api.service[121403]: Openstack-System-Scope: None Nov 01 19:10:08.260482 n-d-863052-2 devstack@n-api.service[121403]: User-Agent: python-urllib3/1.26.12 Nov 01 19:10:08.260482 n-d-863052-2 devstack@n-api.service[121403]: X-Auth-Token: gAAAAABjYW4_RJI8gKBQs81ShXQrfTSIzrNvaZj2e2rGhpR5xhmtuxP4h5uZIl9SLPqPqJ9Syn39UO-el4mPnuEEOGnWtpNlTopD6-Pc1m-VWD64ggyrfBZwUB0hnjNvBvBk6ge071YBJx2gxTN_InEu4tuxz3s-3IQBbEpMSIJZ4VoUIbz4DgY Nov 01 19:10:08.260482 n-d-863052-2 devstack@n-api.service[121403]: X-Domain-Id: None Nov 01 19:10:08.260482 n-d-863052-2 devstack@n-api.service[121403]: X-Domain-Name: None Nov 01 19:10:08.260482 n-d-863052-2 devstack@n-api.service[121403]: X-Identity-Status: Confirmed Nov 01 19:10:08.260482 n-d-863052-2 devstack@n-api.service[121403]: X-Is-Admin-Project: True Nov 01 19:10:08.260482 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Domain-Id: default Nov 01 19:10:08.260482 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Domain-Name: Default Nov 01 19:10:08.260482 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Id: 851785a5f76548898a77d67792888504 Nov 01 19:10:08.260482 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Name: tempest-ServersTestJSON-917766486 Nov 01 19:10:08.260482 n-d-863052-2 devstack@n-api.service[121403]: X-Role: member,reader Nov 01 19:10:08.260482 n-d-863052-2 devstack@n-api.service[121403]: X-Roles: member,reader Nov 01 19:10:08.260482 n-d-863052-2 devstack@n-api.service[121403]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/851785a5f76548898a77d67792888504"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/851785a5f76548898a77d67792888504"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_851785a5f76548898a77d67792888504", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/851785a5f76548898a77d67792888504"}]}] Nov 01 19:10:08.260482 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant: tempest-ServersTestJSON-917766486 Nov 01 19:10:08.260482 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant-Id: 851785a5f76548898a77d67792888504 Nov 01 19:10:08.260482 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant-Name: tempest-ServersTestJSON-917766486 Nov 01 19:10:08.260482 n-d-863052-2 devstack@n-api.service[121403]: X-User: tempest-ServersTestJSON-917766486-project Nov 01 19:10:08.260482 n-d-863052-2 devstack@n-api.service[121403]: X-User-Domain-Id: default Nov 01 19:10:08.260482 n-d-863052-2 devstack@n-api.service[121403]: X-User-Domain-Name: Default Nov 01 19:10:08.260482 n-d-863052-2 devstack@n-api.service[121403]: X-User-Id: 113bd8c844ee490b86a68bc7e1e75da3 Nov 01 19:10:08.260482 n-d-863052-2 devstack@n-api.service[121403]: X-User-Name: tempest-ServersTestJSON-917766486-project Nov 01 19:10:08.260482 n-d-863052-2 devstack@n-api.service[121403]: method: > Nov 01 19:10:08.260482 n-d-863052-2 devstack@n-api.service[121403]: exception: Instance f5d5dfa8-4516-428f-bcf5-f0a1174bd14e could not be found. Nov 01 19:10:08.260482 n-d-863052-2 devstack@n-api.service[121403]: action_args: {'id': 'f5d5dfa8-4516-428f-bcf5-f0a1174bd14e'} Nov 01 19:10:08.260482 n-d-863052-2 devstack@n-api.service[121403]: {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 01 19:10:08.260482 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:10:08.260482 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 01 19:10:08.260482 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 01 19:10:08.260482 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 01 19:10:08.260482 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 01 19:10:08.260482 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 01 19:10:08.260482 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 01 19:10:08.260482 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 01 19:10:08.260482 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 01 19:10:08.260482 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f5d5dfa8-4516-428f-bcf5-f0a1174bd14e could not be found. Nov 01 19:10:08.260482 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:10:08.260482 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:10:08.260482 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:10:08.260482 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:10:08.260482 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:10:08.260482 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:10:08.260482 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 01 19:10:08.260482 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 01 19:10:08.260482 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 01 19:10:08.260482 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 01 19:10:08.260482 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 01 19:10:08.260482 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 01 19:10:08.260482 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 01 19:10:08.260482 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 01 19:10:08.260482 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 01 19:10:08.260482 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 01 19:10:08.260482 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f5d5dfa8-4516-428f-bcf5-f0a1174bd14e could not be found. Nov 01 19:10:08.260482 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:10:08.260482 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:10:08.260482 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:10:08.260482 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:10:08.265136 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:10:08.265136 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:10:08.265136 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 01 19:10:08.265136 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 01 19:10:08.265136 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f5d5dfa8-4516-428f-bcf5-f0a1174bd14e could not be found. Nov 01 19:10:08.265136 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:10:08.265136 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-8e7d3c41-08b0-4c1f-b605-5e22fb2c648b tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] Returning 404 to user: Instance f5d5dfa8-4516-428f-bcf5-f0a1174bd14e could not be found. {{(pid=121403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 01 19:10:08.265136 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-8e7d3c41-08b0-4c1f-b605-5e22fb2c648b tempest-ServersTestJSON-917766486 tempest-ServersTestJSON-917766486-project] 10.222.0.13 "GET /compute/v2.1/servers/f5d5dfa8-4516-428f-bcf5-f0a1174bd14e" status: 404 len: 111 microversion: 2.1 time: 0.032974 Nov 01 19:10:08.265136 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 2002/3900] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:10:08 2022] GET /compute/v2.1/servers/f5d5dfa8-4516-428f-bcf5-f0a1174bd14e => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 01 19:10:08.438832 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-b3b59c49-6792-4a21-bf81-691e3a85f932 tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8ab9f6d8-0533-41ce-87cd-071f74fc9c15"}} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:10:08.442965 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-b3b59c49-6792-4a21-bf81-691e3a85f932 tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] [instance: 03d4513b-9e04-4924-8654-1de3748e333e] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:10:08.450584 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b3b59c49-6792-4a21-bf81-691e3a85f932 tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:08.451386 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b3b59c49-6792-4a21-bf81-691e3a85f932 tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:08.452234 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b3b59c49-6792-4a21-bf81-691e3a85f932 tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:08.452978 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b3b59c49-6792-4a21-bf81-691e3a85f932 tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:08.453544 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b3b59c49-6792-4a21-bf81-691e3a85f932 tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:08.454076 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b3b59c49-6792-4a21-bf81-691e3a85f932 tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:08.724239 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [req-cbfc0d10-0d43-4474-8120-5fc38b63a028 req-309917de-808c-45a6-a092-4366e10d65df service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8c460f41-9dc1-4f0c-9d2d-0a91b38f7787", "name": "network-vif-plugged", "status": "completed", "tag": "436f0d66-4268-48fc-8c8a-803f4e2f3428"}]} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:10:08.740306 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-cbfc0d10-0d43-4474-8120-5fc38b63a028 req-309917de-808c-45a6-a092-4366e10d65df service nova] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:08.740781 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-cbfc0d10-0d43-4474-8120-5fc38b63a028 req-309917de-808c-45a6-a092-4366e10d65df service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:08.745091 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-cbfc0d10-0d43-4474-8120-5fc38b63a028 req-309917de-808c-45a6-a092-4366e10d65df service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:08.761872 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.compute.server_external_events [req-cbfc0d10-0d43-4474-8120-5fc38b63a028 req-309917de-808c-45a6-a092-4366e10d65df service nova] Creating event network-vif-plugged:436f0d66-4268-48fc-8c8a-803f4e2f3428 for instance 8c460f41-9dc1-4f0c-9d2d-0a91b38f7787 on n-h1-863052-2 Nov 01 19:10:08.767241 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [req-cbfc0d10-0d43-4474-8120-5fc38b63a028 req-309917de-808c-45a6-a092-4366e10d65df service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.272372 Nov 01 19:10:08.767935 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 2003/3901] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Nov 1 19:10:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 01 19:10:08.774295 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-44bb9c2a-6104-4f2f-980d-5dcf744b6aa7 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:10:08.775000 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-44bb9c2a-6104-4f2f-980d-5dcf744b6aa7 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] [instance: 8c460f41-9dc1-4f0c-9d2d-0a91b38f7787] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:10:08.781648 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-44bb9c2a-6104-4f2f-980d-5dcf744b6aa7 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:08.782351 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-44bb9c2a-6104-4f2f-980d-5dcf744b6aa7 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:08.783020 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-44bb9c2a-6104-4f2f-980d-5dcf744b6aa7 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:08.783728 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-44bb9c2a-6104-4f2f-980d-5dcf744b6aa7 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:08.784182 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-44bb9c2a-6104-4f2f-980d-5dcf744b6aa7 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:08.785250 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-44bb9c2a-6104-4f2f-980d-5dcf744b6aa7 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:08.813812 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-b3b59c49-6792-4a21-bf81-691e3a85f932 tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] 10.222.0.13 "POST /compute/v2.1/servers/03d4513b-9e04-4924-8654-1de3748e333e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.378474 Nov 01 19:10:08.819501 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1899/3902] 10.222.0.13 () {60 vars in 1323 bytes} [Tue Nov 1 19:10:08 2022] POST /compute/v2.1/servers/03d4513b-9e04-4924-8654-1de3748e333e/os-volume_attachments => generated 194 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:10:08.953247 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-a46fcac6-d0f4-4354-acc8-f765e7947e94 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:10:08.954228 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-a46fcac6-d0f4-4354-acc8-f765e7947e94 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] [instance: ac19dd18-c22a-46de-91ef-454a0b78872f] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:10:08.976475 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-a46fcac6-d0f4-4354-acc8-f765e7947e94 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:08.979111 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-a46fcac6-d0f4-4354-acc8-f765e7947e94 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:08.981719 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-a46fcac6-d0f4-4354-acc8-f765e7947e94 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:08.982480 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-a46fcac6-d0f4-4354-acc8-f765e7947e94 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:08.986777 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-a46fcac6-d0f4-4354-acc8-f765e7947e94 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:08.987240 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-a46fcac6-d0f4-4354-acc8-f765e7947e94 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:09.007555 n-d-863052-2 devstack@n-api.service[121402]: DEBUG dbcounter [-] [121402] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=121402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 19:10:09.102647 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-44bb9c2a-6104-4f2f-980d-5dcf744b6aa7 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '058480d92c9b4ab4af6815d0438a65c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee9dc49b89143f781e4ab30296e4d01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:10:09.110742 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-44bb9c2a-6104-4f2f-980d-5dcf744b6aa7 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] 10.222.0.13 "GET /compute/v2.1/servers/8c460f41-9dc1-4f0c-9d2d-0a91b38f7787" status: 200 len: 1312 microversion: 2.1 time: 0.341304 Nov 01 19:10:09.114363 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 2004/3903] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:10:08 2022] GET /compute/v2.1/servers/8c460f41-9dc1-4f0c-9d2d-0a91b38f7787 => generated 1312 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:10:09.162228 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-a46fcac6-d0f4-4354-acc8-f765e7947e94 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2868ccfdfb164cffa37232c821f205a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04ef687c40bd45c297d22a791bae58cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:10:09.170512 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-a46fcac6-d0f4-4354-acc8-f765e7947e94 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] 10.222.0.13 "GET /compute/v2.1/servers/ac19dd18-c22a-46de-91ef-454a0b78872f" status: 200 len: 1523 microversion: 2.1 time: 0.223158 Nov 01 19:10:09.171475 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1900/3904] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:10:08 2022] GET /compute/v2.1/servers/ac19dd18-c22a-46de-91ef-454a0b78872f => generated 1523 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:10:09.212380 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-a69fe354-3fcf-44d1-8f31-e0ad4b66d5f9 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:10:09.213085 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-a69fe354-3fcf-44d1-8f31-e0ad4b66d5f9 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] [instance: af1071a8-a090-44c9-890c-123ca3ff39f1] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:10:09.227113 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-a69fe354-3fcf-44d1-8f31-e0ad4b66d5f9 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:09.228566 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-a69fe354-3fcf-44d1-8f31-e0ad4b66d5f9 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:09.229811 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-a69fe354-3fcf-44d1-8f31-e0ad4b66d5f9 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:09.231291 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-a69fe354-3fcf-44d1-8f31-e0ad4b66d5f9 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:09.231791 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-a69fe354-3fcf-44d1-8f31-e0ad4b66d5f9 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:09.232699 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-a69fe354-3fcf-44d1-8f31-e0ad4b66d5f9 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:09.540432 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-a69fe354-3fcf-44d1-8f31-e0ad4b66d5f9 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '301ed3b9c37449bc9ade378f3c73a768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8807757227574c828dca1947af76659d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:10:09.586013 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-a69fe354-3fcf-44d1-8f31-e0ad4b66d5f9 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '301ed3b9c37449bc9ade378f3c73a768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8807757227574c828dca1947af76659d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:10:09.587583 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-a69fe354-3fcf-44d1-8f31-e0ad4b66d5f9 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '301ed3b9c37449bc9ade378f3c73a768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8807757227574c828dca1947af76659d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:10:09.588922 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-a69fe354-3fcf-44d1-8f31-e0ad4b66d5f9 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] 10.222.0.13 "GET /compute/v2.1/servers/af1071a8-a090-44c9-890c-123ca3ff39f1" status: 200 len: 2962 microversion: 2.42 time: 0.380483 Nov 01 19:10:09.589712 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 2005/3905] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 19:10:09 2022] GET /compute/v2.1/servers/af1071a8-a090-44c9-890c-123ca3ff39f1 => generated 2962 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 19:10:10.137802 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-fae07c83-fe6e-40b4-b116-dbc1fe3bba46 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:10:10.138494 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-fae07c83-fe6e-40b4-b116-dbc1fe3bba46 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] [instance: 8c460f41-9dc1-4f0c-9d2d-0a91b38f7787] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:10:10.152741 n-d-863052-2 devstack@n-api.service[121402]: DEBUG dbcounter [-] [121402] Writing DB stats nova_cell0:SELECT=8 {{(pid=121402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 19:10:10.155789 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-fae07c83-fe6e-40b4-b116-dbc1fe3bba46 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:10.156535 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-fae07c83-fe6e-40b4-b116-dbc1fe3bba46 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:10.157117 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-fae07c83-fe6e-40b4-b116-dbc1fe3bba46 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:10.157846 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-fae07c83-fe6e-40b4-b116-dbc1fe3bba46 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:10.158312 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-fae07c83-fe6e-40b4-b116-dbc1fe3bba46 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:10.158741 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-fae07c83-fe6e-40b4-b116-dbc1fe3bba46 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:10.195781 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-3b8a5102-ad40-4afd-a1a4-92f85816bacd tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:10:10.196672 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-3b8a5102-ad40-4afd-a1a4-92f85816bacd tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] [instance: ac19dd18-c22a-46de-91ef-454a0b78872f] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:10:10.206185 n-d-863052-2 devstack@n-api.service[121403]: DEBUG dbcounter [-] [121403] Writing DB stats nova_cell0:SELECT=8 {{(pid=121403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 19:10:10.211727 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-3b8a5102-ad40-4afd-a1a4-92f85816bacd tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:10.213249 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-3b8a5102-ad40-4afd-a1a4-92f85816bacd tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:10.214073 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-3b8a5102-ad40-4afd-a1a4-92f85816bacd tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:10.217381 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-3b8a5102-ad40-4afd-a1a4-92f85816bacd tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:10.219403 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-3b8a5102-ad40-4afd-a1a4-92f85816bacd tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:10.222504 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-3b8a5102-ad40-4afd-a1a4-92f85816bacd tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:10.230176 n-d-863052-2 devstack@n-api.service[121403]: DEBUG dbcounter [-] [121403] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 19:10:10.502295 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-3b8a5102-ad40-4afd-a1a4-92f85816bacd tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2868ccfdfb164cffa37232c821f205a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04ef687c40bd45c297d22a791bae58cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:10:10.514144 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-3b8a5102-ad40-4afd-a1a4-92f85816bacd tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] 10.222.0.13 "GET /compute/v2.1/servers/ac19dd18-c22a-46de-91ef-454a0b78872f" status: 200 len: 1523 microversion: 2.1 time: 0.322967 Nov 01 19:10:10.529985 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-fae07c83-fe6e-40b4-b116-dbc1fe3bba46 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '058480d92c9b4ab4af6815d0438a65c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee9dc49b89143f781e4ab30296e4d01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:10:10.530444 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 2006/3906] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:10:10 2022] GET /compute/v2.1/servers/ac19dd18-c22a-46de-91ef-454a0b78872f => generated 1523 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:10:10.557024 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-fae07c83-fe6e-40b4-b116-dbc1fe3bba46 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] 10.222.0.13 "GET /compute/v2.1/servers/8c460f41-9dc1-4f0c-9d2d-0a91b38f7787" status: 200 len: 1499 microversion: 2.1 time: 0.421653 Nov 01 19:10:10.558118 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1901/3907] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:10:10 2022] GET /compute/v2.1/servers/8c460f41-9dc1-4f0c-9d2d-0a91b38f7787 => generated 1499 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:10:10.594141 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-1f82ad34-2565-4c41-807f-c9cd43466f4a tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:10:10.598892 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-1f82ad34-2565-4c41-807f-c9cd43466f4a tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] [instance: 8c460f41-9dc1-4f0c-9d2d-0a91b38f7787] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:10:10.609816 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-1f82ad34-2565-4c41-807f-c9cd43466f4a tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:10.610603 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-1f82ad34-2565-4c41-807f-c9cd43466f4a tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:10.611237 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-1f82ad34-2565-4c41-807f-c9cd43466f4a tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:10.612273 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-1f82ad34-2565-4c41-807f-c9cd43466f4a tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:10.613933 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-1f82ad34-2565-4c41-807f-c9cd43466f4a tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:10.614543 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-1f82ad34-2565-4c41-807f-c9cd43466f4a tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:10.618169 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-f52160ae-1330-4b6c-a7c2-e3d137b5527b tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:10:10.618882 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-f52160ae-1330-4b6c-a7c2-e3d137b5527b tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] [instance: af1071a8-a090-44c9-890c-123ca3ff39f1] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:10:10.628867 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f52160ae-1330-4b6c-a7c2-e3d137b5527b tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:10.629249 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f52160ae-1330-4b6c-a7c2-e3d137b5527b tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:10.647686 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f52160ae-1330-4b6c-a7c2-e3d137b5527b tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:10.648738 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.objects.instance [None req-1f82ad34-2565-4c41-807f-c9cd43466f4a tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lazy-loading 'flavor' on Instance uuid 8c460f41-9dc1-4f0c-9d2d-0a91b38f7787 {{(pid=121403) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 01 19:10:10.650338 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f52160ae-1330-4b6c-a7c2-e3d137b5527b tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:10.651869 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f52160ae-1330-4b6c-a7c2-e3d137b5527b tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:10.653380 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f52160ae-1330-4b6c-a7c2-e3d137b5527b tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:10.773465 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-1f82ad34-2565-4c41-807f-c9cd43466f4a tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] 10.222.0.13 "POST /compute/v2.1/servers/8c460f41-9dc1-4f0c-9d2d-0a91b38f7787/action" status: 202 len: 0 microversion: 2.1 time: 0.190213 Nov 01 19:10:10.774325 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 2007/3908] 10.222.0.13 () {60 vars in 1278 bytes} [Tue Nov 1 19:10:10 2022] POST /compute/v2.1/servers/8c460f41-9dc1-4f0c-9d2d-0a91b38f7787/action => generated 0 bytes in 192 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 01 19:10:10.786681 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-991367c3-405f-4b55-aaa2-3b985f131ebf tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:10:10.789283 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-991367c3-405f-4b55-aaa2-3b985f131ebf tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] [instance: 8c460f41-9dc1-4f0c-9d2d-0a91b38f7787] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:10:10.804609 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-991367c3-405f-4b55-aaa2-3b985f131ebf tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:10.805407 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-991367c3-405f-4b55-aaa2-3b985f131ebf tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:10.805847 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-991367c3-405f-4b55-aaa2-3b985f131ebf tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:10.806760 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-991367c3-405f-4b55-aaa2-3b985f131ebf tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:10.807216 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-991367c3-405f-4b55-aaa2-3b985f131ebf tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:10.807642 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-991367c3-405f-4b55-aaa2-3b985f131ebf tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:10.903087 n-d-863052-2 devstack@n-api.service[121403]: DEBUG dbcounter [-] [121403] Writing DB stats nova_cell0:SELECT=12 {{(pid=121403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 19:10:10.977364 n-d-863052-2 devstack@n-api.service[121402]: DEBUG dbcounter [-] [121402] Writing DB stats nova_cell0:SELECT=10 {{(pid=121402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 19:10:11.036515 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-f52160ae-1330-4b6c-a7c2-e3d137b5527b tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '301ed3b9c37449bc9ade378f3c73a768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8807757227574c828dca1947af76659d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:10:11.063079 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-f52160ae-1330-4b6c-a7c2-e3d137b5527b tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '301ed3b9c37449bc9ade378f3c73a768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8807757227574c828dca1947af76659d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:10:11.065413 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-f52160ae-1330-4b6c-a7c2-e3d137b5527b tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '301ed3b9c37449bc9ade378f3c73a768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8807757227574c828dca1947af76659d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:10:11.067452 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-f52160ae-1330-4b6c-a7c2-e3d137b5527b tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] 10.222.0.13 "GET /compute/v2.1/servers/af1071a8-a090-44c9-890c-123ca3ff39f1" status: 200 len: 2962 microversion: 2.42 time: 0.453316 Nov 01 19:10:11.068027 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1902/3909] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 19:10:10 2022] GET /compute/v2.1/servers/af1071a8-a090-44c9-890c-123ca3ff39f1 => generated 2962 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 01 19:10:11.149852 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-991367c3-405f-4b55-aaa2-3b985f131ebf tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '058480d92c9b4ab4af6815d0438a65c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee9dc49b89143f781e4ab30296e4d01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:10:11.159956 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-991367c3-405f-4b55-aaa2-3b985f131ebf tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] 10.222.0.13 "GET /compute/v2.1/servers/8c460f41-9dc1-4f0c-9d2d-0a91b38f7787" status: 200 len: 1507 microversion: 2.1 time: 0.380823 Nov 01 19:10:11.160638 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 2008/3910] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:10:10 2022] GET /compute/v2.1/servers/8c460f41-9dc1-4f0c-9d2d-0a91b38f7787 => generated 1507 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:10:11.547008 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-1f61fbb9-d918-45ce-bd00-6b0ad455d233 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:10:11.549066 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-1f61fbb9-d918-45ce-bd00-6b0ad455d233 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] [instance: ac19dd18-c22a-46de-91ef-454a0b78872f] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:10:11.573140 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-1f61fbb9-d918-45ce-bd00-6b0ad455d233 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:11.573868 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-1f61fbb9-d918-45ce-bd00-6b0ad455d233 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:11.575622 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-1f61fbb9-d918-45ce-bd00-6b0ad455d233 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:11.577732 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-1f61fbb9-d918-45ce-bd00-6b0ad455d233 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:11.580355 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-1f61fbb9-d918-45ce-bd00-6b0ad455d233 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:11.583122 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-1f61fbb9-d918-45ce-bd00-6b0ad455d233 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:12.055348 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-1f61fbb9-d918-45ce-bd00-6b0ad455d233 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2868ccfdfb164cffa37232c821f205a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04ef687c40bd45c297d22a791bae58cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:10:12.067073 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-1f61fbb9-d918-45ce-bd00-6b0ad455d233 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] 10.222.0.13 "GET /compute/v2.1/servers/ac19dd18-c22a-46de-91ef-454a0b78872f" status: 200 len: 1523 microversion: 2.1 time: 0.528344 Nov 01 19:10:12.068106 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1903/3911] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:10:11 2022] GET /compute/v2.1/servers/ac19dd18-c22a-46de-91ef-454a0b78872f => generated 1523 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:10:12.098505 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-0d9fc1d7-c706-4af1-87f6-8218e290c1ce tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:10:12.099802 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-0d9fc1d7-c706-4af1-87f6-8218e290c1ce tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] [instance: af1071a8-a090-44c9-890c-123ca3ff39f1] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:10:12.112426 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-0d9fc1d7-c706-4af1-87f6-8218e290c1ce tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:12.113585 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-0d9fc1d7-c706-4af1-87f6-8218e290c1ce tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:12.114454 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-0d9fc1d7-c706-4af1-87f6-8218e290c1ce tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:12.115514 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-0d9fc1d7-c706-4af1-87f6-8218e290c1ce tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:12.116339 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-0d9fc1d7-c706-4af1-87f6-8218e290c1ce tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:12.117105 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-0d9fc1d7-c706-4af1-87f6-8218e290c1ce tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:12.184471 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-9ce26a6c-cf8a-4760-8df1-2ef6efccc1bf tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:10:12.185223 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-9ce26a6c-cf8a-4760-8df1-2ef6efccc1bf tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] [instance: 8c460f41-9dc1-4f0c-9d2d-0a91b38f7787] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:10:12.199130 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-9ce26a6c-cf8a-4760-8df1-2ef6efccc1bf tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:12.200247 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-9ce26a6c-cf8a-4760-8df1-2ef6efccc1bf tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:12.200909 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-9ce26a6c-cf8a-4760-8df1-2ef6efccc1bf tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:12.202217 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-9ce26a6c-cf8a-4760-8df1-2ef6efccc1bf tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:12.203145 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-9ce26a6c-cf8a-4760-8df1-2ef6efccc1bf tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:12.204009 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-9ce26a6c-cf8a-4760-8df1-2ef6efccc1bf tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:12.455820 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-9ce26a6c-cf8a-4760-8df1-2ef6efccc1bf tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '058480d92c9b4ab4af6815d0438a65c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee9dc49b89143f781e4ab30296e4d01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:10:12.476297 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-9ce26a6c-cf8a-4760-8df1-2ef6efccc1bf tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] 10.222.0.13 "GET /compute/v2.1/servers/8c460f41-9dc1-4f0c-9d2d-0a91b38f7787" status: 200 len: 1490 microversion: 2.1 time: 0.296447 Nov 01 19:10:12.483586 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1904/3912] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:10:12 2022] GET /compute/v2.1/servers/8c460f41-9dc1-4f0c-9d2d-0a91b38f7787 => generated 1490 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 19:10:12.510275 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-a68b74e7-c7f4-4325-b04f-adc5ab8ee783 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:10:12.510844 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-a68b74e7-c7f4-4325-b04f-adc5ab8ee783 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] [instance: 8c460f41-9dc1-4f0c-9d2d-0a91b38f7787] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:10:12.517500 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-a68b74e7-c7f4-4325-b04f-adc5ab8ee783 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:12.518492 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-a68b74e7-c7f4-4325-b04f-adc5ab8ee783 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:12.519209 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-a68b74e7-c7f4-4325-b04f-adc5ab8ee783 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:12.520164 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-a68b74e7-c7f4-4325-b04f-adc5ab8ee783 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:12.520905 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-a68b74e7-c7f4-4325-b04f-adc5ab8ee783 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:12.521561 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-a68b74e7-c7f4-4325-b04f-adc5ab8ee783 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:12.578434 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-a68b74e7-c7f4-4325-b04f-adc5ab8ee783 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] [instance: 8c460f41-9dc1-4f0c-9d2d-0a91b38f7787] Going to try to terminate instance {{(pid=121402) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 01 19:10:12.689458 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-a68b74e7-c7f4-4325-b04f-adc5ab8ee783 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] 10.222.0.13 "DELETE /compute/v2.1/servers/8c460f41-9dc1-4f0c-9d2d-0a91b38f7787" status: 204 len: 0 microversion: 2.1 time: 0.182619 Nov 01 19:10:12.692551 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1905/3913] 10.222.0.13 () {58 vars in 1239 bytes} [Tue Nov 1 19:10:12 2022] DELETE /compute/v2.1/servers/8c460f41-9dc1-4f0c-9d2d-0a91b38f7787 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 01 19:10:12.703887 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-b8c5b77c-798b-4ede-90b9-7902a9c069b6 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:10:12.705012 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-b8c5b77c-798b-4ede-90b9-7902a9c069b6 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] [instance: 8c460f41-9dc1-4f0c-9d2d-0a91b38f7787] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:10:12.720232 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b8c5b77c-798b-4ede-90b9-7902a9c069b6 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:12.721319 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b8c5b77c-798b-4ede-90b9-7902a9c069b6 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:12.722884 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b8c5b77c-798b-4ede-90b9-7902a9c069b6 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:12.723982 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b8c5b77c-798b-4ede-90b9-7902a9c069b6 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:12.724689 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b8c5b77c-798b-4ede-90b9-7902a9c069b6 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:12.725392 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b8c5b77c-798b-4ede-90b9-7902a9c069b6 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:12.945362 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-0d9fc1d7-c706-4af1-87f6-8218e290c1ce tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '301ed3b9c37449bc9ade378f3c73a768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8807757227574c828dca1947af76659d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:10:12.954571 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-0d9fc1d7-c706-4af1-87f6-8218e290c1ce tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '301ed3b9c37449bc9ade378f3c73a768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8807757227574c828dca1947af76659d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:10:12.956152 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-0d9fc1d7-c706-4af1-87f6-8218e290c1ce tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '301ed3b9c37449bc9ade378f3c73a768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8807757227574c828dca1947af76659d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:10:12.957861 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-0d9fc1d7-c706-4af1-87f6-8218e290c1ce tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] 10.222.0.13 "GET /compute/v2.1/servers/af1071a8-a090-44c9-890c-123ca3ff39f1" status: 200 len: 2962 microversion: 2.42 time: 0.864486 Nov 01 19:10:12.966373 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 2009/3914] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 19:10:12 2022] GET /compute/v2.1/servers/af1071a8-a090-44c9-890c-123ca3ff39f1 => generated 2962 bytes in 873 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 19:10:13.027538 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-b8c5b77c-798b-4ede-90b9-7902a9c069b6 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '058480d92c9b4ab4af6815d0438a65c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee9dc49b89143f781e4ab30296e4d01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:10:13.041611 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-b8c5b77c-798b-4ede-90b9-7902a9c069b6 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] 10.222.0.13 "GET /compute/v2.1/servers/8c460f41-9dc1-4f0c-9d2d-0a91b38f7787" status: 200 len: 1496 microversion: 2.1 time: 0.342171 Nov 01 19:10:13.044892 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1906/3915] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:10:12 2022] GET /compute/v2.1/servers/8c460f41-9dc1-4f0c-9d2d-0a91b38f7787 => generated 1496 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:10:13.091849 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-6226526b-ea74-45f5-aafe-91fe0fc9b916 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:10:13.092465 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-6226526b-ea74-45f5-aafe-91fe0fc9b916 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] [instance: ac19dd18-c22a-46de-91ef-454a0b78872f] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:10:13.100658 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-6226526b-ea74-45f5-aafe-91fe0fc9b916 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:13.101260 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-6226526b-ea74-45f5-aafe-91fe0fc9b916 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:13.101582 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-6226526b-ea74-45f5-aafe-91fe0fc9b916 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:13.107678 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-6226526b-ea74-45f5-aafe-91fe0fc9b916 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:13.108445 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-6226526b-ea74-45f5-aafe-91fe0fc9b916 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:13.109132 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-6226526b-ea74-45f5-aafe-91fe0fc9b916 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:13.497385 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-6226526b-ea74-45f5-aafe-91fe0fc9b916 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2868ccfdfb164cffa37232c821f205a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04ef687c40bd45c297d22a791bae58cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:10:13.509589 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-6226526b-ea74-45f5-aafe-91fe0fc9b916 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] 10.222.0.13 "GET /compute/v2.1/servers/ac19dd18-c22a-46de-91ef-454a0b78872f" status: 200 len: 1523 microversion: 2.1 time: 0.421534 Nov 01 19:10:13.510602 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 2010/3916] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:10:13 2022] GET /compute/v2.1/servers/ac19dd18-c22a-46de-91ef-454a0b78872f => generated 1523 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:10:13.986080 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-05ac81c1-9bf3-4a15-a59f-60d67ec24adf tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:10:13.987345 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-05ac81c1-9bf3-4a15-a59f-60d67ec24adf tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] [instance: af1071a8-a090-44c9-890c-123ca3ff39f1] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:10:13.995549 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-05ac81c1-9bf3-4a15-a59f-60d67ec24adf tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:13.996395 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-05ac81c1-9bf3-4a15-a59f-60d67ec24adf tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:13.997108 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-05ac81c1-9bf3-4a15-a59f-60d67ec24adf tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:13.997923 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-05ac81c1-9bf3-4a15-a59f-60d67ec24adf tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:13.998615 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-05ac81c1-9bf3-4a15-a59f-60d67ec24adf tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:13.999274 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-05ac81c1-9bf3-4a15-a59f-60d67ec24adf tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:14.069339 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-8438b5a1-5c0b-423c-8dfa-ae48d4996057 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:10:14.070041 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-8438b5a1-5c0b-423c-8dfa-ae48d4996057 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] [instance: 8c460f41-9dc1-4f0c-9d2d-0a91b38f7787] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:10:14.084636 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-8438b5a1-5c0b-423c-8dfa-ae48d4996057 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:14.085952 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-8438b5a1-5c0b-423c-8dfa-ae48d4996057 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:14.086880 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-8438b5a1-5c0b-423c-8dfa-ae48d4996057 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:14.087787 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-8438b5a1-5c0b-423c-8dfa-ae48d4996057 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:14.088532 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-8438b5a1-5c0b-423c-8dfa-ae48d4996057 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:14.089178 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-8438b5a1-5c0b-423c-8dfa-ae48d4996057 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:14.516612 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-8438b5a1-5c0b-423c-8dfa-ae48d4996057 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '058480d92c9b4ab4af6815d0438a65c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee9dc49b89143f781e4ab30296e4d01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:10:14.529964 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-05ac81c1-9bf3-4a15-a59f-60d67ec24adf tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '301ed3b9c37449bc9ade378f3c73a768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8807757227574c828dca1947af76659d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:10:14.535736 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-8438b5a1-5c0b-423c-8dfa-ae48d4996057 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] 10.222.0.13 "GET /compute/v2.1/servers/8c460f41-9dc1-4f0c-9d2d-0a91b38f7787" status: 200 len: 1496 microversion: 2.1 time: 0.469719 Nov 01 19:10:14.536540 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 2011/3917] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:10:14 2022] GET /compute/v2.1/servers/8c460f41-9dc1-4f0c-9d2d-0a91b38f7787 => generated 1496 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 19:10:14.541904 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-05ac81c1-9bf3-4a15-a59f-60d67ec24adf tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '301ed3b9c37449bc9ade378f3c73a768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8807757227574c828dca1947af76659d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:10:14.548900 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [req-90117221-9b8c-479e-87e4-a42e97b7edbe req-8175488e-4ab2-457c-a3b3-a37d0ea7f6ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "af1071a8-a090-44c9-890c-123ca3ff39f1", "name": "network-vif-unplugged", "status": "completed", "tag": "b02cdf3d-b259-4361-af25-d77a93946fa4"}]} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:10:14.550963 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-05ac81c1-9bf3-4a15-a59f-60d67ec24adf tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '301ed3b9c37449bc9ade378f3c73a768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8807757227574c828dca1947af76659d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:10:14.552704 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-05ac81c1-9bf3-4a15-a59f-60d67ec24adf tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] 10.222.0.13 "GET /compute/v2.1/servers/af1071a8-a090-44c9-890c-123ca3ff39f1" status: 200 len: 2941 microversion: 2.42 time: 0.570577 Nov 01 19:10:14.573438 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-90117221-9b8c-479e-87e4-a42e97b7edbe req-8175488e-4ab2-457c-a3b3-a37d0ea7f6ee service nova] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:14.573438 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-90117221-9b8c-479e-87e4-a42e97b7edbe req-8175488e-4ab2-457c-a3b3-a37d0ea7f6ee service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:14.573438 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-90117221-9b8c-479e-87e4-a42e97b7edbe req-8175488e-4ab2-457c-a3b3-a37d0ea7f6ee service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:14.576213 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1907/3918] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 19:10:13 2022] GET /compute/v2.1/servers/af1071a8-a090-44c9-890c-123ca3ff39f1 => generated 2941 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 01 19:10:14.592311 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-97c087bd-7d7c-4755-8bbd-78eba7a110b0 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:10:14.593276 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-97c087bd-7d7c-4755-8bbd-78eba7a110b0 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] [instance: ac19dd18-c22a-46de-91ef-454a0b78872f] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:10:14.606910 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-97c087bd-7d7c-4755-8bbd-78eba7a110b0 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:14.607774 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-97c087bd-7d7c-4755-8bbd-78eba7a110b0 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:14.608466 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-97c087bd-7d7c-4755-8bbd-78eba7a110b0 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:14.608766 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.compute.server_external_events [req-90117221-9b8c-479e-87e4-a42e97b7edbe req-8175488e-4ab2-457c-a3b3-a37d0ea7f6ee service nova] Creating event network-vif-unplugged:b02cdf3d-b259-4361-af25-d77a93946fa4 for instance af1071a8-a090-44c9-890c-123ca3ff39f1 on n-h2-863052-2 Nov 01 19:10:14.609678 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-97c087bd-7d7c-4755-8bbd-78eba7a110b0 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:14.610351 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-97c087bd-7d7c-4755-8bbd-78eba7a110b0 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:14.616517 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-97c087bd-7d7c-4755-8bbd-78eba7a110b0 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:14.627438 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [req-90117221-9b8c-479e-87e4-a42e97b7edbe req-8175488e-4ab2-457c-a3b3-a37d0ea7f6ee service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.089511 Nov 01 19:10:14.630040 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 2012/3919] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Nov 1 19:10:14 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:10:14.900575 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-97c087bd-7d7c-4755-8bbd-78eba7a110b0 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2868ccfdfb164cffa37232c821f205a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04ef687c40bd45c297d22a791bae58cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:10:14.908745 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-97c087bd-7d7c-4755-8bbd-78eba7a110b0 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] 10.222.0.13 "GET /compute/v2.1/servers/ac19dd18-c22a-46de-91ef-454a0b78872f" status: 200 len: 1523 microversion: 2.1 time: 0.331120 Nov 01 19:10:14.912466 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1908/3920] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:10:14 2022] GET /compute/v2.1/servers/ac19dd18-c22a-46de-91ef-454a0b78872f => generated 1523 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:10:15.349278 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [req-42e25836-f326-4db9-8192-ecb52d6ae1b8 req-fb3bb715-cf69-423d-a27a-043564f6fdc5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8c460f41-9dc1-4f0c-9d2d-0a91b38f7787", "name": "network-vif-deleted", "tag": "436f0d66-4268-48fc-8c8a-803f4e2f3428"}]} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:10:15.411663 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-42e25836-f326-4db9-8192-ecb52d6ae1b8 req-fb3bb715-cf69-423d-a27a-043564f6fdc5 service nova] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:15.412269 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-42e25836-f326-4db9-8192-ecb52d6ae1b8 req-fb3bb715-cf69-423d-a27a-043564f6fdc5 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:15.414402 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-42e25836-f326-4db9-8192-ecb52d6ae1b8 req-fb3bb715-cf69-423d-a27a-043564f6fdc5 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:15.474009 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.compute.server_external_events [req-42e25836-f326-4db9-8192-ecb52d6ae1b8 req-fb3bb715-cf69-423d-a27a-043564f6fdc5 service nova] Creating event network-vif-deleted:436f0d66-4268-48fc-8c8a-803f4e2f3428 for instance 8c460f41-9dc1-4f0c-9d2d-0a91b38f7787 on n-h1-863052-2 Nov 01 19:10:15.491038 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [req-42e25836-f326-4db9-8192-ecb52d6ae1b8 req-fb3bb715-cf69-423d-a27a-043564f6fdc5 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.146878 Nov 01 19:10:15.494166 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 2013/3921] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Nov 1 19:10:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:10:15.559014 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-b4fb909f-a908-4e52-926b-1ace1c1f56d6 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:10:15.559543 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-b4fb909f-a908-4e52-926b-1ace1c1f56d6 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] [instance: 8c460f41-9dc1-4f0c-9d2d-0a91b38f7787] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:10:15.576919 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b4fb909f-a908-4e52-926b-1ace1c1f56d6 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:15.577467 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b4fb909f-a908-4e52-926b-1ace1c1f56d6 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:15.577913 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b4fb909f-a908-4e52-926b-1ace1c1f56d6 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:15.578636 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b4fb909f-a908-4e52-926b-1ace1c1f56d6 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:15.599015 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-11770e86-fe0a-4cdc-b8b4-882b410f7aa2 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:10:15.599990 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-11770e86-fe0a-4cdc-b8b4-882b410f7aa2 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] [instance: af1071a8-a090-44c9-890c-123ca3ff39f1] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:10:15.608915 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-11770e86-fe0a-4cdc-b8b4-882b410f7aa2 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:15.609403 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-11770e86-fe0a-4cdc-b8b4-882b410f7aa2 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:15.610180 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b4fb909f-a908-4e52-926b-1ace1c1f56d6 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.031s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:15.610831 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b4fb909f-a908-4e52-926b-1ace1c1f56d6 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:15.617378 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-11770e86-fe0a-4cdc-b8b4-882b410f7aa2 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:15.620467 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-11770e86-fe0a-4cdc-b8b4-882b410f7aa2 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:15.620999 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-11770e86-fe0a-4cdc-b8b4-882b410f7aa2 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:15.621443 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-11770e86-fe0a-4cdc-b8b4-882b410f7aa2 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:15.749282 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b4fb909f-a908-4e52-926b-1ace1c1f56d6 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:15.749790 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b4fb909f-a908-4e52-926b-1ace1c1f56d6 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:15.750237 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b4fb909f-a908-4e52-926b-1ace1c1f56d6 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:15.750709 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.objects.instance [None req-b4fb909f-a908-4e52-926b-1ace1c1f56d6 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lazy-loading 'fault' on Instance uuid 8c460f41-9dc1-4f0c-9d2d-0a91b38f7787 {{(pid=121402) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 01 19:10:15.861407 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-b4fb909f-a908-4e52-926b-1ace1c1f56d6 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '058480d92c9b4ab4af6815d0438a65c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee9dc49b89143f781e4ab30296e4d01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:10:15.883130 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-b4fb909f-a908-4e52-926b-1ace1c1f56d6 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] 10.222.0.13 "GET /compute/v2.1/servers/8c460f41-9dc1-4f0c-9d2d-0a91b38f7787" status: 200 len: 1302 microversion: 2.1 time: 0.327528 Nov 01 19:10:15.884562 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1909/3922] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:10:15 2022] GET /compute/v2.1/servers/8c460f41-9dc1-4f0c-9d2d-0a91b38f7787 => generated 1302 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:10:15.939317 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-f091ac07-2dc5-42e7-af3f-9c66e3be92df tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:10:15.944409 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-f091ac07-2dc5-42e7-af3f-9c66e3be92df tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] [instance: ac19dd18-c22a-46de-91ef-454a0b78872f] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:10:15.963652 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f091ac07-2dc5-42e7-af3f-9c66e3be92df tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:15.964413 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f091ac07-2dc5-42e7-af3f-9c66e3be92df tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:15.966418 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f091ac07-2dc5-42e7-af3f-9c66e3be92df tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:15.968173 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f091ac07-2dc5-42e7-af3f-9c66e3be92df tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:15.970579 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f091ac07-2dc5-42e7-af3f-9c66e3be92df tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:15.971218 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f091ac07-2dc5-42e7-af3f-9c66e3be92df tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:16.188978 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-11770e86-fe0a-4cdc-b8b4-882b410f7aa2 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '301ed3b9c37449bc9ade378f3c73a768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8807757227574c828dca1947af76659d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:10:16.206005 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-11770e86-fe0a-4cdc-b8b4-882b410f7aa2 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '301ed3b9c37449bc9ade378f3c73a768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8807757227574c828dca1947af76659d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:10:16.208167 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-11770e86-fe0a-4cdc-b8b4-882b410f7aa2 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '301ed3b9c37449bc9ade378f3c73a768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8807757227574c828dca1947af76659d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:10:16.209963 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-11770e86-fe0a-4cdc-b8b4-882b410f7aa2 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] 10.222.0.13 "GET /compute/v2.1/servers/af1071a8-a090-44c9-890c-123ca3ff39f1" status: 200 len: 2873 microversion: 2.42 time: 0.618266 Nov 01 19:10:16.210545 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 2014/3923] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 19:10:15 2022] GET /compute/v2.1/servers/af1071a8-a090-44c9-890c-123ca3ff39f1 => generated 2873 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 01 19:10:16.387083 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-f091ac07-2dc5-42e7-af3f-9c66e3be92df tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2868ccfdfb164cffa37232c821f205a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04ef687c40bd45c297d22a791bae58cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:10:16.394541 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-f091ac07-2dc5-42e7-af3f-9c66e3be92df tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] 10.222.0.13 "GET /compute/v2.1/servers/ac19dd18-c22a-46de-91ef-454a0b78872f" status: 200 len: 1523 microversion: 2.1 time: 0.458935 Nov 01 19:10:16.395151 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1910/3924] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:10:15 2022] GET /compute/v2.1/servers/ac19dd18-c22a-46de-91ef-454a0b78872f => generated 1523 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:10:16.494905 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [req-726cf6ec-f7c8-4655-881c-e95d49ef9788 req-ad5412ca-3eb1-48d6-b9ee-b89596f9a186 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "af1071a8-a090-44c9-890c-123ca3ff39f1", "name": "network-vif-deleted", "tag": "203b8604-944e-4dd3-b782-489109f7158b"}]} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:10:16.526039 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-726cf6ec-f7c8-4655-881c-e95d49ef9788 req-ad5412ca-3eb1-48d6-b9ee-b89596f9a186 service nova] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:16.526845 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-726cf6ec-f7c8-4655-881c-e95d49ef9788 req-ad5412ca-3eb1-48d6-b9ee-b89596f9a186 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:16.527192 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-726cf6ec-f7c8-4655-881c-e95d49ef9788 req-ad5412ca-3eb1-48d6-b9ee-b89596f9a186 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:16.572813 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.compute.server_external_events [req-726cf6ec-f7c8-4655-881c-e95d49ef9788 req-ad5412ca-3eb1-48d6-b9ee-b89596f9a186 service nova] Creating event network-vif-deleted:203b8604-944e-4dd3-b782-489109f7158b for instance af1071a8-a090-44c9-890c-123ca3ff39f1 on n-h2-863052-2 Nov 01 19:10:16.592720 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [req-726cf6ec-f7c8-4655-881c-e95d49ef9788 req-ad5412ca-3eb1-48d6-b9ee-b89596f9a186 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101512 Nov 01 19:10:16.593343 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 2015/3925] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Nov 1 19:10:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:10:16.656669 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [req-4860efc7-8f6f-434e-b407-cc0e5f66345a req-fddf2e22-97b0-49c0-b32d-f2909ec59851 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "af1071a8-a090-44c9-890c-123ca3ff39f1", "name": "network-vif-unplugged", "status": "completed", "tag": "203b8604-944e-4dd3-b782-489109f7158b"}, {"server_uuid": "af1071a8-a090-44c9-890c-123ca3ff39f1", "name": "network-vif-unplugged", "status": "completed", "tag": "647aec31-8971-4e83-9e8f-4dfc4202c174"}, {"server_uuid": "af1071a8-a090-44c9-890c-123ca3ff39f1", "name": "network-vif-unplugged", "status": "completed", "tag": "5bf6bd76-de52-44ac-88f4-a18e9dd144b7"}, {"server_uuid": "af1071a8-a090-44c9-890c-123ca3ff39f1", "name": "network-vif-unplugged", "status": "completed", "tag": "47e5170e-02f3-496f-b886-a133bae1b952"}]} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:10:16.687324 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-4860efc7-8f6f-434e-b407-cc0e5f66345a req-fddf2e22-97b0-49c0-b32d-f2909ec59851 service nova] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:16.688507 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-4860efc7-8f6f-434e-b407-cc0e5f66345a req-fddf2e22-97b0-49c0-b32d-f2909ec59851 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:16.689853 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-4860efc7-8f6f-434e-b407-cc0e5f66345a req-fddf2e22-97b0-49c0-b32d-f2909ec59851 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:16.722926 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.compute.server_external_events [req-4860efc7-8f6f-434e-b407-cc0e5f66345a req-fddf2e22-97b0-49c0-b32d-f2909ec59851 service nova] Creating event network-vif-unplugged:203b8604-944e-4dd3-b782-489109f7158b for instance af1071a8-a090-44c9-890c-123ca3ff39f1 on n-h2-863052-2 Nov 01 19:10:16.723732 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.compute.server_external_events [req-4860efc7-8f6f-434e-b407-cc0e5f66345a req-fddf2e22-97b0-49c0-b32d-f2909ec59851 service nova] Creating event network-vif-unplugged:647aec31-8971-4e83-9e8f-4dfc4202c174 for instance af1071a8-a090-44c9-890c-123ca3ff39f1 on n-h2-863052-2 Nov 01 19:10:16.724843 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.compute.server_external_events [req-4860efc7-8f6f-434e-b407-cc0e5f66345a req-fddf2e22-97b0-49c0-b32d-f2909ec59851 service nova] Creating event network-vif-unplugged:5bf6bd76-de52-44ac-88f4-a18e9dd144b7 for instance af1071a8-a090-44c9-890c-123ca3ff39f1 on n-h2-863052-2 Nov 01 19:10:16.725532 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.compute.server_external_events [req-4860efc7-8f6f-434e-b407-cc0e5f66345a req-fddf2e22-97b0-49c0-b32d-f2909ec59851 service nova] Creating event network-vif-unplugged:47e5170e-02f3-496f-b886-a133bae1b952 for instance af1071a8-a090-44c9-890c-123ca3ff39f1 on n-h2-863052-2 Nov 01 19:10:16.738475 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [req-4860efc7-8f6f-434e-b407-cc0e5f66345a req-fddf2e22-97b0-49c0-b32d-f2909ec59851 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 704 microversion: 2.1 time: 0.085242 Nov 01 19:10:16.739787 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1911/3926] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Nov 1 19:10:16 2022] POST /compute/v2.1/os-server-external-events => generated 704 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:10:16.912178 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-44e75747-7d90-4c6a-a37c-645cd988cf5d tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:10:16.912982 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-44e75747-7d90-4c6a-a37c-645cd988cf5d tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] [instance: 8c460f41-9dc1-4f0c-9d2d-0a91b38f7787] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:10:16.917141 n-d-863052-2 devstack@n-api.service[121402]: DEBUG dbcounter [-] [121402] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=121402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 19:10:16.931978 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-44e75747-7d90-4c6a-a37c-645cd988cf5d tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:16.932552 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-44e75747-7d90-4c6a-a37c-645cd988cf5d tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:16.933348 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-44e75747-7d90-4c6a-a37c-645cd988cf5d tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:16.934438 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-44e75747-7d90-4c6a-a37c-645cd988cf5d tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:16.935858 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-44e75747-7d90-4c6a-a37c-645cd988cf5d tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:16.936563 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-44e75747-7d90-4c6a-a37c-645cd988cf5d tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:16.960830 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.wsgi [None req-44e75747-7d90-4c6a-a37c-645cd988cf5d tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] HTTP exception thrown: Instance 8c460f41-9dc1-4f0c-9d2d-0a91b38f7787 could not be found. Nov 01 19:10:16.962641 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-44e75747-7d90-4c6a-a37c-645cd988cf5d tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Request method failure captured: Nov 01 19:10:16.962641 n-d-863052-2 devstack@n-api.service[121402]: request: GET /compute/v2.1/servers/8c460f41-9dc1-4f0c-9d2d-0a91b38f7787 HTTP/1.1 Nov 01 19:10:16.962641 n-d-863052-2 devstack@n-api.service[121402]: Accept: application/json Nov 01 19:10:16.962641 n-d-863052-2 devstack@n-api.service[121402]: Accept-Encoding: identity Nov 01 19:10:16.962641 n-d-863052-2 devstack@n-api.service[121402]: Connection: close Nov 01 19:10:16.962641 n-d-863052-2 devstack@n-api.service[121402]: Content-Length: 0 Nov 01 19:10:16.962641 n-d-863052-2 devstack@n-api.service[121402]: Content-Type: application/json Nov 01 19:10:16.962641 n-d-863052-2 devstack@n-api.service[121402]: Host: 10.222.0.13 Nov 01 19:10:16.962641 n-d-863052-2 devstack@n-api.service[121402]: Openstack-System-Scope: None Nov 01 19:10:16.962641 n-d-863052-2 devstack@n-api.service[121402]: User-Agent: python-urllib3/1.26.12 Nov 01 19:10:16.962641 n-d-863052-2 devstack@n-api.service[121402]: X-Auth-Token: gAAAAABjYW3ByfBI9VCjWikZSFUz_hPClqqMancoCxnwBX6xqaMeeugycqMQyEPQybXqoeO46TFhJ9TITtoJFiSbS9Ry6pB9Kueb-hoVnQBV0e7qQWXwvcx4eB_AomP3ogOCXvqhfUnxVmmooBEoQbpvBIMsXQEjVVdPObNP8WS9oGjTsTTTO4o Nov 01 19:10:16.962641 n-d-863052-2 devstack@n-api.service[121402]: X-Domain-Id: None Nov 01 19:10:16.962641 n-d-863052-2 devstack@n-api.service[121402]: X-Domain-Name: None Nov 01 19:10:16.962641 n-d-863052-2 devstack@n-api.service[121402]: X-Identity-Status: Confirmed Nov 01 19:10:16.962641 n-d-863052-2 devstack@n-api.service[121402]: X-Is-Admin-Project: True Nov 01 19:10:16.962641 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Domain-Id: default Nov 01 19:10:16.962641 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Domain-Name: Default Nov 01 19:10:16.962641 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Id: 1ee9dc49b89143f781e4ab30296e4d01 Nov 01 19:10:16.962641 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Name: tempest-DeleteServersTestJSON-412339701 Nov 01 19:10:16.962641 n-d-863052-2 devstack@n-api.service[121402]: X-Role: member,reader Nov 01 19:10:16.962641 n-d-863052-2 devstack@n-api.service[121402]: X-Roles: member,reader Nov 01 19:10:16.962641 n-d-863052-2 devstack@n-api.service[121402]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/1ee9dc49b89143f781e4ab30296e4d01"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/1ee9dc49b89143f781e4ab30296e4d01"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_1ee9dc49b89143f781e4ab30296e4d01", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/1ee9dc49b89143f781e4ab30296e4d01"}]}] Nov 01 19:10:16.962641 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant: tempest-DeleteServersTestJSON-412339701 Nov 01 19:10:16.962641 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant-Id: 1ee9dc49b89143f781e4ab30296e4d01 Nov 01 19:10:16.962641 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant-Name: tempest-DeleteServersTestJSON-412339701 Nov 01 19:10:16.962641 n-d-863052-2 devstack@n-api.service[121402]: X-User: tempest-DeleteServersTestJSON-412339701-project Nov 01 19:10:16.962641 n-d-863052-2 devstack@n-api.service[121402]: X-User-Domain-Id: default Nov 01 19:10:16.962641 n-d-863052-2 devstack@n-api.service[121402]: X-User-Domain-Name: Default Nov 01 19:10:16.962641 n-d-863052-2 devstack@n-api.service[121402]: X-User-Id: 058480d92c9b4ab4af6815d0438a65c7 Nov 01 19:10:16.962641 n-d-863052-2 devstack@n-api.service[121402]: X-User-Name: tempest-DeleteServersTestJSON-412339701-project Nov 01 19:10:16.962641 n-d-863052-2 devstack@n-api.service[121402]: method: > Nov 01 19:10:16.962641 n-d-863052-2 devstack@n-api.service[121402]: exception: Instance 8c460f41-9dc1-4f0c-9d2d-0a91b38f7787 could not be found. Nov 01 19:10:16.962641 n-d-863052-2 devstack@n-api.service[121402]: action_args: {'id': '8c460f41-9dc1-4f0c-9d2d-0a91b38f7787'} Nov 01 19:10:16.962641 n-d-863052-2 devstack@n-api.service[121402]: {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 01 19:10:16.962641 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:10:16.962641 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 01 19:10:16.962641 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 01 19:10:16.962641 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 01 19:10:16.962641 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 01 19:10:16.962641 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 01 19:10:16.962641 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 01 19:10:16.962641 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 01 19:10:16.962641 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 01 19:10:16.962641 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8c460f41-9dc1-4f0c-9d2d-0a91b38f7787 could not be found. Nov 01 19:10:16.962641 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:10:16.962641 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:10:16.962641 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:10:16.962641 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:10:16.962641 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:10:16.962641 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:10:16.962641 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 01 19:10:16.962641 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 01 19:10:16.962641 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 01 19:10:16.962641 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 01 19:10:16.962641 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 01 19:10:16.962641 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 01 19:10:16.962641 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 01 19:10:16.962641 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 01 19:10:16.962641 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 01 19:10:16.962641 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 01 19:10:16.962641 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8c460f41-9dc1-4f0c-9d2d-0a91b38f7787 could not be found. Nov 01 19:10:16.962641 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:10:16.962641 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:10:16.962641 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:10:16.970072 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:10:16.970072 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:10:16.970072 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:10:16.970072 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 01 19:10:16.970072 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 01 19:10:16.970072 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8c460f41-9dc1-4f0c-9d2d-0a91b38f7787 could not be found. Nov 01 19:10:16.970072 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:10:16.970072 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-44e75747-7d90-4c6a-a37c-645cd988cf5d tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Returning 404 to user: Instance 8c460f41-9dc1-4f0c-9d2d-0a91b38f7787 could not be found. {{(pid=121402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 01 19:10:16.970072 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-44e75747-7d90-4c6a-a37c-645cd988cf5d tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] 10.222.0.13 "GET /compute/v2.1/servers/8c460f41-9dc1-4f0c-9d2d-0a91b38f7787" status: 404 len: 111 microversion: 2.1 time: 0.058322 Nov 01 19:10:16.970072 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1912/3927] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:10:16 2022] GET /compute/v2.1/servers/8c460f41-9dc1-4f0c-9d2d-0a91b38f7787 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 01 19:10:16.985650 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-6fabb2e2-8d38-4e7b-aefb-02d8658ec06b tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:10:16.986015 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-6fabb2e2-8d38-4e7b-aefb-02d8658ec06b tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] [instance: 8c460f41-9dc1-4f0c-9d2d-0a91b38f7787] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:10:16.998833 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-6fabb2e2-8d38-4e7b-aefb-02d8658ec06b tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:16.999371 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-6fabb2e2-8d38-4e7b-aefb-02d8658ec06b tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:16.999798 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-6fabb2e2-8d38-4e7b-aefb-02d8658ec06b tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:17.004908 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-6fabb2e2-8d38-4e7b-aefb-02d8658ec06b tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:17.005806 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-6fabb2e2-8d38-4e7b-aefb-02d8658ec06b tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:17.006128 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-6fabb2e2-8d38-4e7b-aefb-02d8658ec06b tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:17.039284 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-0aaf9ac3-49db-4e5a-8b90-334aa32da27e tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV257Test-server-1133540164", "imageRef": "2d4a0047-1b9e-445f-8af8-1b5c9d93e881", "flavorRef": "452", "networks": "none"}} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:10:17.053478 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.wsgi [None req-6fabb2e2-8d38-4e7b-aefb-02d8658ec06b tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] HTTP exception thrown: Instance 8c460f41-9dc1-4f0c-9d2d-0a91b38f7787 could not be found. Nov 01 19:10:17.056422 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-6fabb2e2-8d38-4e7b-aefb-02d8658ec06b tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Request method failure captured: Nov 01 19:10:17.056422 n-d-863052-2 devstack@n-api.service[121402]: request: DELETE /compute/v2.1/servers/8c460f41-9dc1-4f0c-9d2d-0a91b38f7787 HTTP/1.1 Nov 01 19:10:17.056422 n-d-863052-2 devstack@n-api.service[121402]: Accept: application/json Nov 01 19:10:17.056422 n-d-863052-2 devstack@n-api.service[121402]: Accept-Encoding: identity Nov 01 19:10:17.056422 n-d-863052-2 devstack@n-api.service[121402]: Connection: close Nov 01 19:10:17.056422 n-d-863052-2 devstack@n-api.service[121402]: Content-Length: 0 Nov 01 19:10:17.056422 n-d-863052-2 devstack@n-api.service[121402]: Content-Type: application/json Nov 01 19:10:17.056422 n-d-863052-2 devstack@n-api.service[121402]: Host: 10.222.0.13 Nov 01 19:10:17.056422 n-d-863052-2 devstack@n-api.service[121402]: Openstack-System-Scope: None Nov 01 19:10:17.056422 n-d-863052-2 devstack@n-api.service[121402]: User-Agent: python-urllib3/1.26.12 Nov 01 19:10:17.056422 n-d-863052-2 devstack@n-api.service[121402]: X-Auth-Token: gAAAAABjYW3ByfBI9VCjWikZSFUz_hPClqqMancoCxnwBX6xqaMeeugycqMQyEPQybXqoeO46TFhJ9TITtoJFiSbS9Ry6pB9Kueb-hoVnQBV0e7qQWXwvcx4eB_AomP3ogOCXvqhfUnxVmmooBEoQbpvBIMsXQEjVVdPObNP8WS9oGjTsTTTO4o Nov 01 19:10:17.056422 n-d-863052-2 devstack@n-api.service[121402]: X-Domain-Id: None Nov 01 19:10:17.056422 n-d-863052-2 devstack@n-api.service[121402]: X-Domain-Name: None Nov 01 19:10:17.056422 n-d-863052-2 devstack@n-api.service[121402]: X-Identity-Status: Confirmed Nov 01 19:10:17.056422 n-d-863052-2 devstack@n-api.service[121402]: X-Is-Admin-Project: True Nov 01 19:10:17.056422 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Domain-Id: default Nov 01 19:10:17.056422 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Domain-Name: Default Nov 01 19:10:17.056422 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Id: 1ee9dc49b89143f781e4ab30296e4d01 Nov 01 19:10:17.056422 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Name: tempest-DeleteServersTestJSON-412339701 Nov 01 19:10:17.056422 n-d-863052-2 devstack@n-api.service[121402]: X-Role: member,reader Nov 01 19:10:17.056422 n-d-863052-2 devstack@n-api.service[121402]: X-Roles: member,reader Nov 01 19:10:17.056422 n-d-863052-2 devstack@n-api.service[121402]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/1ee9dc49b89143f781e4ab30296e4d01"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/1ee9dc49b89143f781e4ab30296e4d01"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_1ee9dc49b89143f781e4ab30296e4d01", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/1ee9dc49b89143f781e4ab30296e4d01"}]}] Nov 01 19:10:17.056422 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant: tempest-DeleteServersTestJSON-412339701 Nov 01 19:10:17.056422 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant-Id: 1ee9dc49b89143f781e4ab30296e4d01 Nov 01 19:10:17.056422 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant-Name: tempest-DeleteServersTestJSON-412339701 Nov 01 19:10:17.056422 n-d-863052-2 devstack@n-api.service[121402]: X-User: tempest-DeleteServersTestJSON-412339701-project Nov 01 19:10:17.056422 n-d-863052-2 devstack@n-api.service[121402]: X-User-Domain-Id: default Nov 01 19:10:17.056422 n-d-863052-2 devstack@n-api.service[121402]: X-User-Domain-Name: Default Nov 01 19:10:17.056422 n-d-863052-2 devstack@n-api.service[121402]: X-User-Id: 058480d92c9b4ab4af6815d0438a65c7 Nov 01 19:10:17.056422 n-d-863052-2 devstack@n-api.service[121402]: X-User-Name: tempest-DeleteServersTestJSON-412339701-project Nov 01 19:10:17.056422 n-d-863052-2 devstack@n-api.service[121402]: method: > Nov 01 19:10:17.056422 n-d-863052-2 devstack@n-api.service[121402]: exception: Instance 8c460f41-9dc1-4f0c-9d2d-0a91b38f7787 could not be found. Nov 01 19:10:17.056422 n-d-863052-2 devstack@n-api.service[121402]: action_args: {'id': '8c460f41-9dc1-4f0c-9d2d-0a91b38f7787'} Nov 01 19:10:17.056422 n-d-863052-2 devstack@n-api.service[121402]: {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 01 19:10:17.056422 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:10:17.056422 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 01 19:10:17.056422 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 01 19:10:17.056422 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 01 19:10:17.056422 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 01 19:10:17.056422 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 01 19:10:17.056422 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 01 19:10:17.056422 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 01 19:10:17.056422 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 01 19:10:17.056422 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8c460f41-9dc1-4f0c-9d2d-0a91b38f7787 could not be found. Nov 01 19:10:17.056422 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:10:17.056422 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:10:17.056422 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:10:17.056422 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:10:17.056422 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:10:17.056422 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:10:17.056422 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 01 19:10:17.056422 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 01 19:10:17.056422 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 01 19:10:17.056422 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 01 19:10:17.056422 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 01 19:10:17.056422 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 01 19:10:17.056422 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 01 19:10:17.056422 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 01 19:10:17.056422 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 01 19:10:17.056422 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 01 19:10:17.056422 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 01 19:10:17.056422 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 01 19:10:17.063729 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8c460f41-9dc1-4f0c-9d2d-0a91b38f7787 could not be found. Nov 01 19:10:17.063729 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:10:17.063729 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:10:17.063729 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:10:17.063729 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:10:17.063729 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:10:17.063729 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:10:17.063729 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 01 19:10:17.063729 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 01 19:10:17.063729 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8c460f41-9dc1-4f0c-9d2d-0a91b38f7787 could not be found. Nov 01 19:10:17.063729 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:10:17.063729 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-6fabb2e2-8d38-4e7b-aefb-02d8658ec06b tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Returning 404 to user: Instance 8c460f41-9dc1-4f0c-9d2d-0a91b38f7787 could not be found. {{(pid=121402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 01 19:10:17.066056 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-6fabb2e2-8d38-4e7b-aefb-02d8658ec06b tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] 10.222.0.13 "DELETE /compute/v2.1/servers/8c460f41-9dc1-4f0c-9d2d-0a91b38f7787" status: 404 len: 111 microversion: 2.1 time: 0.090482 Nov 01 19:10:17.066056 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1913/3928] 10.222.0.13 () {58 vars in 1239 bytes} [Tue Nov 1 19:10:16 2022] DELETE /compute/v2.1/servers/8c460f41-9dc1-4f0c-9d2d-0a91b38f7787 => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 01 19:10:17.075777 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-1ffe3901-775a-45a5-a198-bbc713c82299 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:10:17.078505 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-1ffe3901-775a-45a5-a198-bbc713c82299 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] [instance: 8c460f41-9dc1-4f0c-9d2d-0a91b38f7787] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:10:17.095764 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-1ffe3901-775a-45a5-a198-bbc713c82299 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:17.096461 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-1ffe3901-775a-45a5-a198-bbc713c82299 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:17.098353 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-1ffe3901-775a-45a5-a198-bbc713c82299 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:17.101090 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-1ffe3901-775a-45a5-a198-bbc713c82299 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:17.101552 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-1ffe3901-775a-45a5-a198-bbc713c82299 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:17.102276 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-1ffe3901-775a-45a5-a198-bbc713c82299 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:17.118122 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.virt.hardware [None req-0aaf9ac3-49db-4e5a-8b90-334aa32da27e tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] Flavor limits 0:0:0 {{(pid=121403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 01 19:10:17.118429 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.virt.hardware [None req-0aaf9ac3-49db-4e5a-8b90-334aa32da27e tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] Image limits 0:0:0 {{(pid=121403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 01 19:10:17.118905 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.virt.hardware [None req-0aaf9ac3-49db-4e5a-8b90-334aa32da27e tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] Flavor pref 0:0:0 {{(pid=121403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 01 19:10:17.119317 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.virt.hardware [None req-0aaf9ac3-49db-4e5a-8b90-334aa32da27e tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] Image pref 0:0:0 {{(pid=121403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 01 19:10:17.119730 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.virt.hardware [None req-0aaf9ac3-49db-4e5a-8b90-334aa32da27e tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 01 19:10:17.121787 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.wsgi [None req-1ffe3901-775a-45a5-a198-bbc713c82299 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] HTTP exception thrown: Instance 8c460f41-9dc1-4f0c-9d2d-0a91b38f7787 could not be found. Nov 01 19:10:17.124447 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-1ffe3901-775a-45a5-a198-bbc713c82299 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Request method failure captured: Nov 01 19:10:17.124447 n-d-863052-2 devstack@n-api.service[121402]: request: GET /compute/v2.1/servers/8c460f41-9dc1-4f0c-9d2d-0a91b38f7787 HTTP/1.1 Nov 01 19:10:17.124447 n-d-863052-2 devstack@n-api.service[121402]: Accept: application/json Nov 01 19:10:17.124447 n-d-863052-2 devstack@n-api.service[121402]: Accept-Encoding: identity Nov 01 19:10:17.124447 n-d-863052-2 devstack@n-api.service[121402]: Connection: close Nov 01 19:10:17.124447 n-d-863052-2 devstack@n-api.service[121402]: Content-Length: 0 Nov 01 19:10:17.124447 n-d-863052-2 devstack@n-api.service[121402]: Content-Type: application/json Nov 01 19:10:17.124447 n-d-863052-2 devstack@n-api.service[121402]: Host: 10.222.0.13 Nov 01 19:10:17.124447 n-d-863052-2 devstack@n-api.service[121402]: Openstack-System-Scope: None Nov 01 19:10:17.124447 n-d-863052-2 devstack@n-api.service[121402]: User-Agent: python-urllib3/1.26.12 Nov 01 19:10:17.124447 n-d-863052-2 devstack@n-api.service[121402]: X-Auth-Token: gAAAAABjYW3ByfBI9VCjWikZSFUz_hPClqqMancoCxnwBX6xqaMeeugycqMQyEPQybXqoeO46TFhJ9TITtoJFiSbS9Ry6pB9Kueb-hoVnQBV0e7qQWXwvcx4eB_AomP3ogOCXvqhfUnxVmmooBEoQbpvBIMsXQEjVVdPObNP8WS9oGjTsTTTO4o Nov 01 19:10:17.124447 n-d-863052-2 devstack@n-api.service[121402]: X-Domain-Id: None Nov 01 19:10:17.124447 n-d-863052-2 devstack@n-api.service[121402]: X-Domain-Name: None Nov 01 19:10:17.124447 n-d-863052-2 devstack@n-api.service[121402]: X-Identity-Status: Confirmed Nov 01 19:10:17.124447 n-d-863052-2 devstack@n-api.service[121402]: X-Is-Admin-Project: True Nov 01 19:10:17.124447 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Domain-Id: default Nov 01 19:10:17.124447 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Domain-Name: Default Nov 01 19:10:17.124447 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Id: 1ee9dc49b89143f781e4ab30296e4d01 Nov 01 19:10:17.124447 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Name: tempest-DeleteServersTestJSON-412339701 Nov 01 19:10:17.124447 n-d-863052-2 devstack@n-api.service[121402]: X-Role: member,reader Nov 01 19:10:17.124447 n-d-863052-2 devstack@n-api.service[121402]: X-Roles: member,reader Nov 01 19:10:17.124447 n-d-863052-2 devstack@n-api.service[121402]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/1ee9dc49b89143f781e4ab30296e4d01"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/1ee9dc49b89143f781e4ab30296e4d01"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_1ee9dc49b89143f781e4ab30296e4d01", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/1ee9dc49b89143f781e4ab30296e4d01"}]}] Nov 01 19:10:17.124447 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant: tempest-DeleteServersTestJSON-412339701 Nov 01 19:10:17.124447 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant-Id: 1ee9dc49b89143f781e4ab30296e4d01 Nov 01 19:10:17.124447 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant-Name: tempest-DeleteServersTestJSON-412339701 Nov 01 19:10:17.124447 n-d-863052-2 devstack@n-api.service[121402]: X-User: tempest-DeleteServersTestJSON-412339701-project Nov 01 19:10:17.124447 n-d-863052-2 devstack@n-api.service[121402]: X-User-Domain-Id: default Nov 01 19:10:17.124447 n-d-863052-2 devstack@n-api.service[121402]: X-User-Domain-Name: Default Nov 01 19:10:17.124447 n-d-863052-2 devstack@n-api.service[121402]: X-User-Id: 058480d92c9b4ab4af6815d0438a65c7 Nov 01 19:10:17.124447 n-d-863052-2 devstack@n-api.service[121402]: X-User-Name: tempest-DeleteServersTestJSON-412339701-project Nov 01 19:10:17.124447 n-d-863052-2 devstack@n-api.service[121402]: method: > Nov 01 19:10:17.124447 n-d-863052-2 devstack@n-api.service[121402]: exception: Instance 8c460f41-9dc1-4f0c-9d2d-0a91b38f7787 could not be found. Nov 01 19:10:17.124447 n-d-863052-2 devstack@n-api.service[121402]: action_args: {'id': '8c460f41-9dc1-4f0c-9d2d-0a91b38f7787'} Nov 01 19:10:17.124447 n-d-863052-2 devstack@n-api.service[121402]: {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 01 19:10:17.124447 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:10:17.124447 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 01 19:10:17.124447 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 01 19:10:17.124447 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 01 19:10:17.124447 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 01 19:10:17.124447 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 01 19:10:17.124447 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 01 19:10:17.124447 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 01 19:10:17.124447 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 01 19:10:17.124447 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8c460f41-9dc1-4f0c-9d2d-0a91b38f7787 could not be found. Nov 01 19:10:17.124447 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:10:17.124447 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:10:17.124447 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:10:17.124447 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:10:17.124447 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:10:17.124447 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:10:17.124447 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 01 19:10:17.124447 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 01 19:10:17.124447 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 01 19:10:17.124447 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 01 19:10:17.124447 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 01 19:10:17.124447 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 01 19:10:17.124447 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 01 19:10:17.124447 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 01 19:10:17.124447 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 01 19:10:17.124447 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 01 19:10:17.124447 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8c460f41-9dc1-4f0c-9d2d-0a91b38f7787 could not be found. Nov 01 19:10:17.124447 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:10:17.124447 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:10:17.124447 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:10:17.130642 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:10:17.130642 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:10:17.130642 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:10:17.130642 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 01 19:10:17.130642 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 01 19:10:17.130642 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8c460f41-9dc1-4f0c-9d2d-0a91b38f7787 could not be found. Nov 01 19:10:17.130642 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:10:17.132968 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-1ffe3901-775a-45a5-a198-bbc713c82299 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Returning 404 to user: Instance 8c460f41-9dc1-4f0c-9d2d-0a91b38f7787 could not be found. {{(pid=121402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 01 19:10:17.134143 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-1ffe3901-775a-45a5-a198-bbc713c82299 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] 10.222.0.13 "GET /compute/v2.1/servers/8c460f41-9dc1-4f0c-9d2d-0a91b38f7787" status: 404 len: 111 microversion: 2.1 time: 0.064630 Nov 01 19:10:17.135234 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1914/3929] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:10:17 2022] GET /compute/v2.1/servers/8c460f41-9dc1-4f0c-9d2d-0a91b38f7787 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 01 19:10:17.143826 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-997e9001-13cc-4002-b0a8-8436848e04cd tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:10:17.144376 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-997e9001-13cc-4002-b0a8-8436848e04cd tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] [instance: cc8a30dd-b655-48d8-b4e2-d4911cb15513] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:10:17.144933 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-0aaf9ac3-49db-4e5a-8b90-334aa32da27e tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:17.145421 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-0aaf9ac3-49db-4e5a-8b90-334aa32da27e tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:17.146107 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-0aaf9ac3-49db-4e5a-8b90-334aa32da27e tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:17.147015 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-0aaf9ac3-49db-4e5a-8b90-334aa32da27e tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:17.151755 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-997e9001-13cc-4002-b0a8-8436848e04cd tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:17.152523 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-997e9001-13cc-4002-b0a8-8436848e04cd tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:17.153142 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-0aaf9ac3-49db-4e5a-8b90-334aa32da27e tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:17.153593 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-0aaf9ac3-49db-4e5a-8b90-334aa32da27e tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:17.154324 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-997e9001-13cc-4002-b0a8-8436848e04cd tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:17.155146 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-997e9001-13cc-4002-b0a8-8436848e04cd tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:17.155713 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-997e9001-13cc-4002-b0a8-8436848e04cd tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:17.156426 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-997e9001-13cc-4002-b0a8-8436848e04cd tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:17.174112 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.wsgi [None req-997e9001-13cc-4002-b0a8-8436848e04cd tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] HTTP exception thrown: Instance cc8a30dd-b655-48d8-b4e2-d4911cb15513 could not be found. Nov 01 19:10:17.176719 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-997e9001-13cc-4002-b0a8-8436848e04cd tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Request method failure captured: Nov 01 19:10:17.176719 n-d-863052-2 devstack@n-api.service[121402]: request: DELETE /compute/v2.1/servers/cc8a30dd-b655-48d8-b4e2-d4911cb15513 HTTP/1.1 Nov 01 19:10:17.176719 n-d-863052-2 devstack@n-api.service[121402]: Accept: application/json Nov 01 19:10:17.176719 n-d-863052-2 devstack@n-api.service[121402]: Accept-Encoding: identity Nov 01 19:10:17.176719 n-d-863052-2 devstack@n-api.service[121402]: Connection: close Nov 01 19:10:17.176719 n-d-863052-2 devstack@n-api.service[121402]: Content-Length: 0 Nov 01 19:10:17.176719 n-d-863052-2 devstack@n-api.service[121402]: Content-Type: application/json Nov 01 19:10:17.176719 n-d-863052-2 devstack@n-api.service[121402]: Host: 10.222.0.13 Nov 01 19:10:17.176719 n-d-863052-2 devstack@n-api.service[121402]: Openstack-System-Scope: None Nov 01 19:10:17.176719 n-d-863052-2 devstack@n-api.service[121402]: User-Agent: python-urllib3/1.26.12 Nov 01 19:10:17.176719 n-d-863052-2 devstack@n-api.service[121402]: X-Auth-Token: gAAAAABjYW3ByfBI9VCjWikZSFUz_hPClqqMancoCxnwBX6xqaMeeugycqMQyEPQybXqoeO46TFhJ9TITtoJFiSbS9Ry6pB9Kueb-hoVnQBV0e7qQWXwvcx4eB_AomP3ogOCXvqhfUnxVmmooBEoQbpvBIMsXQEjVVdPObNP8WS9oGjTsTTTO4o Nov 01 19:10:17.176719 n-d-863052-2 devstack@n-api.service[121402]: X-Domain-Id: None Nov 01 19:10:17.176719 n-d-863052-2 devstack@n-api.service[121402]: X-Domain-Name: None Nov 01 19:10:17.176719 n-d-863052-2 devstack@n-api.service[121402]: X-Identity-Status: Confirmed Nov 01 19:10:17.176719 n-d-863052-2 devstack@n-api.service[121402]: X-Is-Admin-Project: True Nov 01 19:10:17.176719 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Domain-Id: default Nov 01 19:10:17.176719 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Domain-Name: Default Nov 01 19:10:17.176719 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Id: 1ee9dc49b89143f781e4ab30296e4d01 Nov 01 19:10:17.176719 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Name: tempest-DeleteServersTestJSON-412339701 Nov 01 19:10:17.176719 n-d-863052-2 devstack@n-api.service[121402]: X-Role: member,reader Nov 01 19:10:17.176719 n-d-863052-2 devstack@n-api.service[121402]: X-Roles: member,reader Nov 01 19:10:17.176719 n-d-863052-2 devstack@n-api.service[121402]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/1ee9dc49b89143f781e4ab30296e4d01"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/1ee9dc49b89143f781e4ab30296e4d01"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_1ee9dc49b89143f781e4ab30296e4d01", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/1ee9dc49b89143f781e4ab30296e4d01"}]}] Nov 01 19:10:17.176719 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant: tempest-DeleteServersTestJSON-412339701 Nov 01 19:10:17.176719 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant-Id: 1ee9dc49b89143f781e4ab30296e4d01 Nov 01 19:10:17.176719 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant-Name: tempest-DeleteServersTestJSON-412339701 Nov 01 19:10:17.176719 n-d-863052-2 devstack@n-api.service[121402]: X-User: tempest-DeleteServersTestJSON-412339701-project Nov 01 19:10:17.176719 n-d-863052-2 devstack@n-api.service[121402]: X-User-Domain-Id: default Nov 01 19:10:17.176719 n-d-863052-2 devstack@n-api.service[121402]: X-User-Domain-Name: Default Nov 01 19:10:17.176719 n-d-863052-2 devstack@n-api.service[121402]: X-User-Id: 058480d92c9b4ab4af6815d0438a65c7 Nov 01 19:10:17.176719 n-d-863052-2 devstack@n-api.service[121402]: X-User-Name: tempest-DeleteServersTestJSON-412339701-project Nov 01 19:10:17.176719 n-d-863052-2 devstack@n-api.service[121402]: method: > Nov 01 19:10:17.176719 n-d-863052-2 devstack@n-api.service[121402]: exception: Instance cc8a30dd-b655-48d8-b4e2-d4911cb15513 could not be found. Nov 01 19:10:17.176719 n-d-863052-2 devstack@n-api.service[121402]: action_args: {'id': 'cc8a30dd-b655-48d8-b4e2-d4911cb15513'} Nov 01 19:10:17.176719 n-d-863052-2 devstack@n-api.service[121402]: {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 01 19:10:17.176719 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:10:17.176719 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 01 19:10:17.176719 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 01 19:10:17.176719 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 01 19:10:17.176719 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 01 19:10:17.176719 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 01 19:10:17.176719 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 01 19:10:17.176719 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 01 19:10:17.176719 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 01 19:10:17.176719 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cc8a30dd-b655-48d8-b4e2-d4911cb15513 could not be found. Nov 01 19:10:17.176719 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:10:17.176719 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:10:17.176719 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:10:17.176719 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:10:17.176719 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:10:17.176719 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:10:17.176719 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 01 19:10:17.176719 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 01 19:10:17.176719 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 01 19:10:17.176719 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 01 19:10:17.176719 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 01 19:10:17.176719 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 01 19:10:17.176719 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 01 19:10:17.176719 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 01 19:10:17.176719 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 01 19:10:17.176719 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 01 19:10:17.176719 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 01 19:10:17.176719 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 01 19:10:17.181385 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cc8a30dd-b655-48d8-b4e2-d4911cb15513 could not be found. Nov 01 19:10:17.181385 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:10:17.181385 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:10:17.181385 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:10:17.181385 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:10:17.181385 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:10:17.181385 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:10:17.181385 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 01 19:10:17.181385 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 01 19:10:17.181385 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cc8a30dd-b655-48d8-b4e2-d4911cb15513 could not be found. Nov 01 19:10:17.181385 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:10:17.183900 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-997e9001-13cc-4002-b0a8-8436848e04cd tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Returning 404 to user: Instance cc8a30dd-b655-48d8-b4e2-d4911cb15513 could not be found. {{(pid=121402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 01 19:10:17.184286 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.quota [None req-0aaf9ac3-49db-4e5a-8b90-334aa32da27e tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] Getting quotas for project c30003431656408bb328e90be22d009a. Resources: {'cores', 'ram', 'instances'} {{(pid=121403) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 01 19:10:17.187743 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-997e9001-13cc-4002-b0a8-8436848e04cd tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] 10.222.0.13 "DELETE /compute/v2.1/servers/cc8a30dd-b655-48d8-b4e2-d4911cb15513" status: 404 len: 111 microversion: 2.1 time: 0.048462 Nov 01 19:10:17.189112 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1915/3930] 10.222.0.13 () {58 vars in 1239 bytes} [Tue Nov 1 19:10:17 2022] DELETE /compute/v2.1/servers/cc8a30dd-b655-48d8-b4e2-d4911cb15513 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 01 19:10:17.193260 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.quota [None req-0aaf9ac3-49db-4e5a-8b90-334aa32da27e tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] Getting quotas for user 3111dabbf6d14e2c91766f2f5544057c and project c30003431656408bb328e90be22d009a. Resources: {'cores', 'ram', 'instances'} {{(pid=121403) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 01 19:10:17.201988 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-df175ddc-1c71-418b-8232-27eea3a803cc tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:10:17.202733 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-df175ddc-1c71-418b-8232-27eea3a803cc tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] [instance: cc8a30dd-b655-48d8-b4e2-d4911cb15513] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:10:17.208390 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-0aaf9ac3-49db-4e5a-8b90-334aa32da27e tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] Going to run 1 instances... {{(pid=121403) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 01 19:10:17.210911 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-0aaf9ac3-49db-4e5a-8b90-334aa32da27e tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] [instance: 29b73e88-1e2a-45d8-bdbb-6c5f9399d270] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2d4a0047-1b9e-445f-8af8-1b5c9d93e881',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121403) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 01 19:10:17.218916 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-df175ddc-1c71-418b-8232-27eea3a803cc tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:17.219530 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-df175ddc-1c71-418b-8232-27eea3a803cc tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:17.220157 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-df175ddc-1c71-418b-8232-27eea3a803cc tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:17.221399 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-df175ddc-1c71-418b-8232-27eea3a803cc tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:17.222492 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-df175ddc-1c71-418b-8232-27eea3a803cc tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:17.223148 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-df175ddc-1c71-418b-8232-27eea3a803cc tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:17.241664 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.wsgi [None req-df175ddc-1c71-418b-8232-27eea3a803cc tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] HTTP exception thrown: Instance cc8a30dd-b655-48d8-b4e2-d4911cb15513 could not be found. Nov 01 19:10:17.243753 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-df175ddc-1c71-418b-8232-27eea3a803cc tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Request method failure captured: Nov 01 19:10:17.243753 n-d-863052-2 devstack@n-api.service[121402]: request: GET /compute/v2.1/servers/cc8a30dd-b655-48d8-b4e2-d4911cb15513 HTTP/1.1 Nov 01 19:10:17.243753 n-d-863052-2 devstack@n-api.service[121402]: Accept: application/json Nov 01 19:10:17.243753 n-d-863052-2 devstack@n-api.service[121402]: Accept-Encoding: identity Nov 01 19:10:17.243753 n-d-863052-2 devstack@n-api.service[121402]: Connection: close Nov 01 19:10:17.243753 n-d-863052-2 devstack@n-api.service[121402]: Content-Length: 0 Nov 01 19:10:17.243753 n-d-863052-2 devstack@n-api.service[121402]: Content-Type: application/json Nov 01 19:10:17.243753 n-d-863052-2 devstack@n-api.service[121402]: Host: 10.222.0.13 Nov 01 19:10:17.243753 n-d-863052-2 devstack@n-api.service[121402]: Openstack-System-Scope: None Nov 01 19:10:17.243753 n-d-863052-2 devstack@n-api.service[121402]: User-Agent: python-urllib3/1.26.12 Nov 01 19:10:17.243753 n-d-863052-2 devstack@n-api.service[121402]: X-Auth-Token: gAAAAABjYW3ByfBI9VCjWikZSFUz_hPClqqMancoCxnwBX6xqaMeeugycqMQyEPQybXqoeO46TFhJ9TITtoJFiSbS9Ry6pB9Kueb-hoVnQBV0e7qQWXwvcx4eB_AomP3ogOCXvqhfUnxVmmooBEoQbpvBIMsXQEjVVdPObNP8WS9oGjTsTTTO4o Nov 01 19:10:17.243753 n-d-863052-2 devstack@n-api.service[121402]: X-Domain-Id: None Nov 01 19:10:17.243753 n-d-863052-2 devstack@n-api.service[121402]: X-Domain-Name: None Nov 01 19:10:17.243753 n-d-863052-2 devstack@n-api.service[121402]: X-Identity-Status: Confirmed Nov 01 19:10:17.243753 n-d-863052-2 devstack@n-api.service[121402]: X-Is-Admin-Project: True Nov 01 19:10:17.243753 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Domain-Id: default Nov 01 19:10:17.243753 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Domain-Name: Default Nov 01 19:10:17.243753 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Id: 1ee9dc49b89143f781e4ab30296e4d01 Nov 01 19:10:17.243753 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Name: tempest-DeleteServersTestJSON-412339701 Nov 01 19:10:17.243753 n-d-863052-2 devstack@n-api.service[121402]: X-Role: member,reader Nov 01 19:10:17.243753 n-d-863052-2 devstack@n-api.service[121402]: X-Roles: member,reader Nov 01 19:10:17.243753 n-d-863052-2 devstack@n-api.service[121402]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/1ee9dc49b89143f781e4ab30296e4d01"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/1ee9dc49b89143f781e4ab30296e4d01"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_1ee9dc49b89143f781e4ab30296e4d01", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/1ee9dc49b89143f781e4ab30296e4d01"}]}] Nov 01 19:10:17.243753 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant: tempest-DeleteServersTestJSON-412339701 Nov 01 19:10:17.243753 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant-Id: 1ee9dc49b89143f781e4ab30296e4d01 Nov 01 19:10:17.243753 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant-Name: tempest-DeleteServersTestJSON-412339701 Nov 01 19:10:17.243753 n-d-863052-2 devstack@n-api.service[121402]: X-User: tempest-DeleteServersTestJSON-412339701-project Nov 01 19:10:17.243753 n-d-863052-2 devstack@n-api.service[121402]: X-User-Domain-Id: default Nov 01 19:10:17.243753 n-d-863052-2 devstack@n-api.service[121402]: X-User-Domain-Name: Default Nov 01 19:10:17.243753 n-d-863052-2 devstack@n-api.service[121402]: X-User-Id: 058480d92c9b4ab4af6815d0438a65c7 Nov 01 19:10:17.243753 n-d-863052-2 devstack@n-api.service[121402]: X-User-Name: tempest-DeleteServersTestJSON-412339701-project Nov 01 19:10:17.243753 n-d-863052-2 devstack@n-api.service[121402]: method: > Nov 01 19:10:17.243753 n-d-863052-2 devstack@n-api.service[121402]: exception: Instance cc8a30dd-b655-48d8-b4e2-d4911cb15513 could not be found. Nov 01 19:10:17.243753 n-d-863052-2 devstack@n-api.service[121402]: action_args: {'id': 'cc8a30dd-b655-48d8-b4e2-d4911cb15513'} Nov 01 19:10:17.243753 n-d-863052-2 devstack@n-api.service[121402]: {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 01 19:10:17.243753 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:10:17.243753 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 01 19:10:17.243753 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 01 19:10:17.243753 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 01 19:10:17.243753 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 01 19:10:17.243753 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 01 19:10:17.243753 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 01 19:10:17.243753 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 01 19:10:17.243753 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 01 19:10:17.243753 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cc8a30dd-b655-48d8-b4e2-d4911cb15513 could not be found. Nov 01 19:10:17.243753 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:10:17.243753 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:10:17.243753 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:10:17.243753 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:10:17.243753 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:10:17.243753 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:10:17.243753 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 01 19:10:17.243753 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 01 19:10:17.243753 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 01 19:10:17.243753 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 01 19:10:17.243753 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 01 19:10:17.243753 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 01 19:10:17.243753 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 01 19:10:17.243753 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 01 19:10:17.243753 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 01 19:10:17.243753 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 01 19:10:17.243753 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cc8a30dd-b655-48d8-b4e2-d4911cb15513 could not be found. Nov 01 19:10:17.243753 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:10:17.243753 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:10:17.243753 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:10:17.249305 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:10:17.249305 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:10:17.249305 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:10:17.249305 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 01 19:10:17.249305 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 01 19:10:17.249305 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cc8a30dd-b655-48d8-b4e2-d4911cb15513 could not be found. Nov 01 19:10:17.249305 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:10:17.251924 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-df175ddc-1c71-418b-8232-27eea3a803cc tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Returning 404 to user: Instance cc8a30dd-b655-48d8-b4e2-d4911cb15513 could not be found. {{(pid=121402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 01 19:10:17.253292 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-df175ddc-1c71-418b-8232-27eea3a803cc tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] 10.222.0.13 "GET /compute/v2.1/servers/cc8a30dd-b655-48d8-b4e2-d4911cb15513" status: 404 len: 111 microversion: 2.1 time: 0.059083 Nov 01 19:10:17.254432 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1916/3931] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:10:17 2022] GET /compute/v2.1/servers/cc8a30dd-b655-48d8-b4e2-d4911cb15513 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 01 19:10:17.261862 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-7ffdaaf1-d8a3-4484-ae34-e8ea430233c3 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:10:17.262762 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-7ffdaaf1-d8a3-4484-ae34-e8ea430233c3 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] [instance: af1071a8-a090-44c9-890c-123ca3ff39f1] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:10:17.274158 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-7ffdaaf1-d8a3-4484-ae34-e8ea430233c3 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:17.274947 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-7ffdaaf1-d8a3-4484-ae34-e8ea430233c3 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:17.275890 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-7ffdaaf1-d8a3-4484-ae34-e8ea430233c3 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:17.276545 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-0aaf9ac3-49db-4e5a-8b90-334aa32da27e tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.57 time: 0.499084 Nov 01 19:10:17.277017 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-7ffdaaf1-d8a3-4484-ae34-e8ea430233c3 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:17.277668 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-7ffdaaf1-d8a3-4484-ae34-e8ea430233c3 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:17.277958 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 2016/3932] 10.222.0.13 () {62 vars in 1188 bytes} [Tue Nov 1 19:10:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 502 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Nov 01 19:10:17.278611 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-7ffdaaf1-d8a3-4484-ae34-e8ea430233c3 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:17.282996 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-3f4bbf43-b57b-4223-aa6d-89ce9055750d tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:10:17.283912 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-3f4bbf43-b57b-4223-aa6d-89ce9055750d tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] [instance: 8485db2a-fd8f-4615-bbe0-14822ad44194] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:10:17.291816 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-3f4bbf43-b57b-4223-aa6d-89ce9055750d tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:17.292895 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-3f4bbf43-b57b-4223-aa6d-89ce9055750d tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:17.293674 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-3f4bbf43-b57b-4223-aa6d-89ce9055750d tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:17.294655 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-3f4bbf43-b57b-4223-aa6d-89ce9055750d tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:17.295557 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-3f4bbf43-b57b-4223-aa6d-89ce9055750d tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:17.296263 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-3f4bbf43-b57b-4223-aa6d-89ce9055750d tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:17.313882 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.wsgi [None req-3f4bbf43-b57b-4223-aa6d-89ce9055750d tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] HTTP exception thrown: Instance 8485db2a-fd8f-4615-bbe0-14822ad44194 could not be found. Nov 01 19:10:17.316489 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-3f4bbf43-b57b-4223-aa6d-89ce9055750d tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Request method failure captured: Nov 01 19:10:17.316489 n-d-863052-2 devstack@n-api.service[121403]: request: DELETE /compute/v2.1/servers/8485db2a-fd8f-4615-bbe0-14822ad44194 HTTP/1.1 Nov 01 19:10:17.316489 n-d-863052-2 devstack@n-api.service[121403]: Accept: application/json Nov 01 19:10:17.316489 n-d-863052-2 devstack@n-api.service[121403]: Accept-Encoding: identity Nov 01 19:10:17.316489 n-d-863052-2 devstack@n-api.service[121403]: Connection: close Nov 01 19:10:17.316489 n-d-863052-2 devstack@n-api.service[121403]: Content-Length: 0 Nov 01 19:10:17.316489 n-d-863052-2 devstack@n-api.service[121403]: Content-Type: application/json Nov 01 19:10:17.316489 n-d-863052-2 devstack@n-api.service[121403]: Host: 10.222.0.13 Nov 01 19:10:17.316489 n-d-863052-2 devstack@n-api.service[121403]: Openstack-System-Scope: None Nov 01 19:10:17.316489 n-d-863052-2 devstack@n-api.service[121403]: User-Agent: python-urllib3/1.26.12 Nov 01 19:10:17.316489 n-d-863052-2 devstack@n-api.service[121403]: X-Auth-Token: gAAAAABjYW3ByfBI9VCjWikZSFUz_hPClqqMancoCxnwBX6xqaMeeugycqMQyEPQybXqoeO46TFhJ9TITtoJFiSbS9Ry6pB9Kueb-hoVnQBV0e7qQWXwvcx4eB_AomP3ogOCXvqhfUnxVmmooBEoQbpvBIMsXQEjVVdPObNP8WS9oGjTsTTTO4o Nov 01 19:10:17.316489 n-d-863052-2 devstack@n-api.service[121403]: X-Domain-Id: None Nov 01 19:10:17.316489 n-d-863052-2 devstack@n-api.service[121403]: X-Domain-Name: None Nov 01 19:10:17.316489 n-d-863052-2 devstack@n-api.service[121403]: X-Identity-Status: Confirmed Nov 01 19:10:17.316489 n-d-863052-2 devstack@n-api.service[121403]: X-Is-Admin-Project: True Nov 01 19:10:17.316489 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Domain-Id: default Nov 01 19:10:17.316489 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Domain-Name: Default Nov 01 19:10:17.316489 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Id: 1ee9dc49b89143f781e4ab30296e4d01 Nov 01 19:10:17.316489 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Name: tempest-DeleteServersTestJSON-412339701 Nov 01 19:10:17.316489 n-d-863052-2 devstack@n-api.service[121403]: X-Role: member,reader Nov 01 19:10:17.316489 n-d-863052-2 devstack@n-api.service[121403]: X-Roles: member,reader Nov 01 19:10:17.316489 n-d-863052-2 devstack@n-api.service[121403]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/1ee9dc49b89143f781e4ab30296e4d01"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/1ee9dc49b89143f781e4ab30296e4d01"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_1ee9dc49b89143f781e4ab30296e4d01", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/1ee9dc49b89143f781e4ab30296e4d01"}]}] Nov 01 19:10:17.316489 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant: tempest-DeleteServersTestJSON-412339701 Nov 01 19:10:17.316489 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant-Id: 1ee9dc49b89143f781e4ab30296e4d01 Nov 01 19:10:17.316489 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant-Name: tempest-DeleteServersTestJSON-412339701 Nov 01 19:10:17.316489 n-d-863052-2 devstack@n-api.service[121403]: X-User: tempest-DeleteServersTestJSON-412339701-project Nov 01 19:10:17.316489 n-d-863052-2 devstack@n-api.service[121403]: X-User-Domain-Id: default Nov 01 19:10:17.316489 n-d-863052-2 devstack@n-api.service[121403]: X-User-Domain-Name: Default Nov 01 19:10:17.316489 n-d-863052-2 devstack@n-api.service[121403]: X-User-Id: 058480d92c9b4ab4af6815d0438a65c7 Nov 01 19:10:17.316489 n-d-863052-2 devstack@n-api.service[121403]: X-User-Name: tempest-DeleteServersTestJSON-412339701-project Nov 01 19:10:17.316489 n-d-863052-2 devstack@n-api.service[121403]: method: > Nov 01 19:10:17.316489 n-d-863052-2 devstack@n-api.service[121403]: exception: Instance 8485db2a-fd8f-4615-bbe0-14822ad44194 could not be found. Nov 01 19:10:17.316489 n-d-863052-2 devstack@n-api.service[121403]: action_args: {'id': '8485db2a-fd8f-4615-bbe0-14822ad44194'} Nov 01 19:10:17.316489 n-d-863052-2 devstack@n-api.service[121403]: {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 01 19:10:17.316489 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:10:17.316489 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 01 19:10:17.316489 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 01 19:10:17.316489 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 01 19:10:17.316489 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 01 19:10:17.316489 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 01 19:10:17.316489 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 01 19:10:17.316489 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 01 19:10:17.316489 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 01 19:10:17.316489 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8485db2a-fd8f-4615-bbe0-14822ad44194 could not be found. Nov 01 19:10:17.316489 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:10:17.316489 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:10:17.316489 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:10:17.316489 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:10:17.316489 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:10:17.316489 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:10:17.316489 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 01 19:10:17.316489 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 01 19:10:17.316489 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 01 19:10:17.316489 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 01 19:10:17.316489 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 01 19:10:17.316489 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 01 19:10:17.316489 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 01 19:10:17.316489 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 01 19:10:17.316489 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 01 19:10:17.316489 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 01 19:10:17.316489 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 01 19:10:17.316489 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 01 19:10:17.322687 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8485db2a-fd8f-4615-bbe0-14822ad44194 could not be found. Nov 01 19:10:17.322687 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:10:17.322687 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:10:17.322687 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:10:17.322687 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:10:17.322687 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:10:17.322687 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:10:17.322687 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 01 19:10:17.322687 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 01 19:10:17.322687 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8485db2a-fd8f-4615-bbe0-14822ad44194 could not be found. Nov 01 19:10:17.322687 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:10:17.326926 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-3f4bbf43-b57b-4223-aa6d-89ce9055750d tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Returning 404 to user: Instance 8485db2a-fd8f-4615-bbe0-14822ad44194 could not be found. {{(pid=121403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 01 19:10:17.328173 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-3f4bbf43-b57b-4223-aa6d-89ce9055750d tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] 10.222.0.13 "DELETE /compute/v2.1/servers/8485db2a-fd8f-4615-bbe0-14822ad44194" status: 404 len: 111 microversion: 2.1 time: 0.049034 Nov 01 19:10:17.341060 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 2017/3933] 10.222.0.13 () {58 vars in 1239 bytes} [Tue Nov 1 19:10:17 2022] DELETE /compute/v2.1/servers/8485db2a-fd8f-4615-bbe0-14822ad44194 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 01 19:10:17.351731 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-a0399eff-c379-4ef4-8a26-b44427a20d70 tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:10:17.352471 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-a0399eff-c379-4ef4-8a26-b44427a20d70 tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] [instance: 29b73e88-1e2a-45d8-bdbb-6c5f9399d270] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:10:17.487993 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-7ffdaaf1-d8a3-4484-ae34-e8ea430233c3 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '301ed3b9c37449bc9ade378f3c73a768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8807757227574c828dca1947af76659d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:10:17.502853 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-7ffdaaf1-d8a3-4484-ae34-e8ea430233c3 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '301ed3b9c37449bc9ade378f3c73a768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8807757227574c828dca1947af76659d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:10:17.506163 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-7ffdaaf1-d8a3-4484-ae34-e8ea430233c3 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '301ed3b9c37449bc9ade378f3c73a768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8807757227574c828dca1947af76659d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:10:17.508654 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-7ffdaaf1-d8a3-4484-ae34-e8ea430233c3 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] 10.222.0.13 "GET /compute/v2.1/servers/af1071a8-a090-44c9-890c-123ca3ff39f1" status: 200 len: 2536 microversion: 2.42 time: 0.252105 Nov 01 19:10:17.509460 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1917/3934] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 19:10:17 2022] GET /compute/v2.1/servers/af1071a8-a090-44c9-890c-123ca3ff39f1 => generated 2536 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 19:10:17.525085 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-516e78c7-454f-4f11-981e-cb1a5e2af1c9 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:10:17.526134 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-516e78c7-454f-4f11-981e-cb1a5e2af1c9 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] [instance: 8485db2a-fd8f-4615-bbe0-14822ad44194] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:10:17.539620 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-a0399eff-c379-4ef4-8a26-b44427a20d70 tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3111dabbf6d14e2c91766f2f5544057c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c30003431656408bb328e90be22d009a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:10:17.542799 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-516e78c7-454f-4f11-981e-cb1a5e2af1c9 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:17.543738 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-516e78c7-454f-4f11-981e-cb1a5e2af1c9 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:17.551521 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-516e78c7-454f-4f11-981e-cb1a5e2af1c9 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:17.552341 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-516e78c7-454f-4f11-981e-cb1a5e2af1c9 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:17.552867 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-516e78c7-454f-4f11-981e-cb1a5e2af1c9 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:17.553310 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-516e78c7-454f-4f11-981e-cb1a5e2af1c9 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:17.558450 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-a0399eff-c379-4ef4-8a26-b44427a20d70 tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3111dabbf6d14e2c91766f2f5544057c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c30003431656408bb328e90be22d009a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:10:17.559991 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-a0399eff-c379-4ef4-8a26-b44427a20d70 tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3111dabbf6d14e2c91766f2f5544057c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c30003431656408bb328e90be22d009a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:10:17.561602 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-a0399eff-c379-4ef4-8a26-b44427a20d70 tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] 10.222.0.13 "GET /compute/v2.1/servers/29b73e88-1e2a-45d8-bdbb-6c5f9399d270" status: 200 len: 1278 microversion: 2.57 time: 0.219102 Nov 01 19:10:17.563638 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 2018/3935] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 19:10:17 2022] GET /compute/v2.1/servers/29b73e88-1e2a-45d8-bdbb-6c5f9399d270 => generated 1278 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 19:10:17.583168 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-d37cb5ad-1553-4721-b135-3f53ad4dd5cd tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:10:17.583821 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-d37cb5ad-1553-4721-b135-3f53ad4dd5cd tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] [instance: ac19dd18-c22a-46de-91ef-454a0b78872f] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:10:17.590785 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d37cb5ad-1553-4721-b135-3f53ad4dd5cd tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:17.591192 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d37cb5ad-1553-4721-b135-3f53ad4dd5cd tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:17.592166 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.wsgi [None req-516e78c7-454f-4f11-981e-cb1a5e2af1c9 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] HTTP exception thrown: Instance 8485db2a-fd8f-4615-bbe0-14822ad44194 could not be found. Nov 01 19:10:17.595651 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d37cb5ad-1553-4721-b135-3f53ad4dd5cd tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:17.596314 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d37cb5ad-1553-4721-b135-3f53ad4dd5cd tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:17.597436 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d37cb5ad-1553-4721-b135-3f53ad4dd5cd tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:17.597802 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d37cb5ad-1553-4721-b135-3f53ad4dd5cd tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:17.598585 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-516e78c7-454f-4f11-981e-cb1a5e2af1c9 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Request method failure captured: Nov 01 19:10:17.598585 n-d-863052-2 devstack@n-api.service[121402]: request: GET /compute/v2.1/servers/8485db2a-fd8f-4615-bbe0-14822ad44194 HTTP/1.1 Nov 01 19:10:17.598585 n-d-863052-2 devstack@n-api.service[121402]: Accept: application/json Nov 01 19:10:17.598585 n-d-863052-2 devstack@n-api.service[121402]: Accept-Encoding: identity Nov 01 19:10:17.598585 n-d-863052-2 devstack@n-api.service[121402]: Connection: close Nov 01 19:10:17.598585 n-d-863052-2 devstack@n-api.service[121402]: Content-Length: 0 Nov 01 19:10:17.598585 n-d-863052-2 devstack@n-api.service[121402]: Content-Type: application/json Nov 01 19:10:17.598585 n-d-863052-2 devstack@n-api.service[121402]: Host: 10.222.0.13 Nov 01 19:10:17.598585 n-d-863052-2 devstack@n-api.service[121402]: Openstack-System-Scope: None Nov 01 19:10:17.598585 n-d-863052-2 devstack@n-api.service[121402]: User-Agent: python-urllib3/1.26.12 Nov 01 19:10:17.598585 n-d-863052-2 devstack@n-api.service[121402]: X-Auth-Token: gAAAAABjYW3ByfBI9VCjWikZSFUz_hPClqqMancoCxnwBX6xqaMeeugycqMQyEPQybXqoeO46TFhJ9TITtoJFiSbS9Ry6pB9Kueb-hoVnQBV0e7qQWXwvcx4eB_AomP3ogOCXvqhfUnxVmmooBEoQbpvBIMsXQEjVVdPObNP8WS9oGjTsTTTO4o Nov 01 19:10:17.598585 n-d-863052-2 devstack@n-api.service[121402]: X-Domain-Id: None Nov 01 19:10:17.598585 n-d-863052-2 devstack@n-api.service[121402]: X-Domain-Name: None Nov 01 19:10:17.598585 n-d-863052-2 devstack@n-api.service[121402]: X-Identity-Status: Confirmed Nov 01 19:10:17.598585 n-d-863052-2 devstack@n-api.service[121402]: X-Is-Admin-Project: True Nov 01 19:10:17.598585 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Domain-Id: default Nov 01 19:10:17.598585 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Domain-Name: Default Nov 01 19:10:17.598585 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Id: 1ee9dc49b89143f781e4ab30296e4d01 Nov 01 19:10:17.598585 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Name: tempest-DeleteServersTestJSON-412339701 Nov 01 19:10:17.598585 n-d-863052-2 devstack@n-api.service[121402]: X-Role: member,reader Nov 01 19:10:17.598585 n-d-863052-2 devstack@n-api.service[121402]: X-Roles: member,reader Nov 01 19:10:17.598585 n-d-863052-2 devstack@n-api.service[121402]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/1ee9dc49b89143f781e4ab30296e4d01"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/1ee9dc49b89143f781e4ab30296e4d01"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_1ee9dc49b89143f781e4ab30296e4d01", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/1ee9dc49b89143f781e4ab30296e4d01"}]}] Nov 01 19:10:17.598585 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant: tempest-DeleteServersTestJSON-412339701 Nov 01 19:10:17.598585 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant-Id: 1ee9dc49b89143f781e4ab30296e4d01 Nov 01 19:10:17.598585 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant-Name: tempest-DeleteServersTestJSON-412339701 Nov 01 19:10:17.598585 n-d-863052-2 devstack@n-api.service[121402]: X-User: tempest-DeleteServersTestJSON-412339701-project Nov 01 19:10:17.598585 n-d-863052-2 devstack@n-api.service[121402]: X-User-Domain-Id: default Nov 01 19:10:17.598585 n-d-863052-2 devstack@n-api.service[121402]: X-User-Domain-Name: Default Nov 01 19:10:17.598585 n-d-863052-2 devstack@n-api.service[121402]: X-User-Id: 058480d92c9b4ab4af6815d0438a65c7 Nov 01 19:10:17.598585 n-d-863052-2 devstack@n-api.service[121402]: X-User-Name: tempest-DeleteServersTestJSON-412339701-project Nov 01 19:10:17.598585 n-d-863052-2 devstack@n-api.service[121402]: method: > Nov 01 19:10:17.598585 n-d-863052-2 devstack@n-api.service[121402]: exception: Instance 8485db2a-fd8f-4615-bbe0-14822ad44194 could not be found. Nov 01 19:10:17.598585 n-d-863052-2 devstack@n-api.service[121402]: action_args: {'id': '8485db2a-fd8f-4615-bbe0-14822ad44194'} Nov 01 19:10:17.598585 n-d-863052-2 devstack@n-api.service[121402]: {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 01 19:10:17.598585 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:10:17.598585 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 01 19:10:17.598585 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 01 19:10:17.598585 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 01 19:10:17.598585 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 01 19:10:17.598585 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 01 19:10:17.598585 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 01 19:10:17.598585 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 01 19:10:17.598585 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 01 19:10:17.598585 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8485db2a-fd8f-4615-bbe0-14822ad44194 could not be found. Nov 01 19:10:17.598585 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:10:17.598585 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:10:17.598585 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:10:17.598585 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:10:17.598585 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:10:17.598585 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:10:17.598585 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 01 19:10:17.598585 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 01 19:10:17.598585 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 01 19:10:17.598585 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 01 19:10:17.598585 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 01 19:10:17.598585 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 01 19:10:17.598585 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 01 19:10:17.598585 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 01 19:10:17.598585 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 01 19:10:17.598585 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 01 19:10:17.598585 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8485db2a-fd8f-4615-bbe0-14822ad44194 could not be found. Nov 01 19:10:17.598585 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:10:17.598585 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:10:17.598585 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:10:17.603011 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:10:17.603011 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:10:17.603011 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:10:17.603011 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 01 19:10:17.603011 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 01 19:10:17.603011 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8485db2a-fd8f-4615-bbe0-14822ad44194 could not be found. Nov 01 19:10:17.603011 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:10:17.611435 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-516e78c7-454f-4f11-981e-cb1a5e2af1c9 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Returning 404 to user: Instance 8485db2a-fd8f-4615-bbe0-14822ad44194 could not be found. {{(pid=121402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 01 19:10:17.611435 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-516e78c7-454f-4f11-981e-cb1a5e2af1c9 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] 10.222.0.13 "GET /compute/v2.1/servers/8485db2a-fd8f-4615-bbe0-14822ad44194" status: 404 len: 111 microversion: 2.1 time: 0.099323 Nov 01 19:10:17.611435 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1918/3936] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:10:17 2022] GET /compute/v2.1/servers/8485db2a-fd8f-4615-bbe0-14822ad44194 => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 01 19:10:17.618756 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-c5841074-800d-4420-90a2-b5460f430cfb tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:10:17.619266 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-c5841074-800d-4420-90a2-b5460f430cfb tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] [instance: d99a7f68-99ff-4c70-9e81-1c9faf6ebb7f] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:10:17.626404 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-c5841074-800d-4420-90a2-b5460f430cfb tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:17.627084 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-c5841074-800d-4420-90a2-b5460f430cfb tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:17.627720 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-c5841074-800d-4420-90a2-b5460f430cfb tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:17.628814 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-c5841074-800d-4420-90a2-b5460f430cfb tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:17.629570 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-c5841074-800d-4420-90a2-b5460f430cfb tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:17.630167 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-c5841074-800d-4420-90a2-b5460f430cfb tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:17.672945 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.wsgi [None req-c5841074-800d-4420-90a2-b5460f430cfb tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] HTTP exception thrown: Instance d99a7f68-99ff-4c70-9e81-1c9faf6ebb7f could not be found. Nov 01 19:10:17.674527 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-c5841074-800d-4420-90a2-b5460f430cfb tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Request method failure captured: Nov 01 19:10:17.674527 n-d-863052-2 devstack@n-api.service[121402]: request: DELETE /compute/v2.1/servers/d99a7f68-99ff-4c70-9e81-1c9faf6ebb7f HTTP/1.1 Nov 01 19:10:17.674527 n-d-863052-2 devstack@n-api.service[121402]: Accept: application/json Nov 01 19:10:17.674527 n-d-863052-2 devstack@n-api.service[121402]: Accept-Encoding: identity Nov 01 19:10:17.674527 n-d-863052-2 devstack@n-api.service[121402]: Connection: close Nov 01 19:10:17.674527 n-d-863052-2 devstack@n-api.service[121402]: Content-Length: 0 Nov 01 19:10:17.674527 n-d-863052-2 devstack@n-api.service[121402]: Content-Type: application/json Nov 01 19:10:17.674527 n-d-863052-2 devstack@n-api.service[121402]: Host: 10.222.0.13 Nov 01 19:10:17.674527 n-d-863052-2 devstack@n-api.service[121402]: Openstack-System-Scope: None Nov 01 19:10:17.674527 n-d-863052-2 devstack@n-api.service[121402]: User-Agent: python-urllib3/1.26.12 Nov 01 19:10:17.674527 n-d-863052-2 devstack@n-api.service[121402]: X-Auth-Token: gAAAAABjYW3ByfBI9VCjWikZSFUz_hPClqqMancoCxnwBX6xqaMeeugycqMQyEPQybXqoeO46TFhJ9TITtoJFiSbS9Ry6pB9Kueb-hoVnQBV0e7qQWXwvcx4eB_AomP3ogOCXvqhfUnxVmmooBEoQbpvBIMsXQEjVVdPObNP8WS9oGjTsTTTO4o Nov 01 19:10:17.674527 n-d-863052-2 devstack@n-api.service[121402]: X-Domain-Id: None Nov 01 19:10:17.674527 n-d-863052-2 devstack@n-api.service[121402]: X-Domain-Name: None Nov 01 19:10:17.674527 n-d-863052-2 devstack@n-api.service[121402]: X-Identity-Status: Confirmed Nov 01 19:10:17.674527 n-d-863052-2 devstack@n-api.service[121402]: X-Is-Admin-Project: True Nov 01 19:10:17.674527 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Domain-Id: default Nov 01 19:10:17.674527 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Domain-Name: Default Nov 01 19:10:17.674527 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Id: 1ee9dc49b89143f781e4ab30296e4d01 Nov 01 19:10:17.674527 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Name: tempest-DeleteServersTestJSON-412339701 Nov 01 19:10:17.674527 n-d-863052-2 devstack@n-api.service[121402]: X-Role: member,reader Nov 01 19:10:17.674527 n-d-863052-2 devstack@n-api.service[121402]: X-Roles: member,reader Nov 01 19:10:17.674527 n-d-863052-2 devstack@n-api.service[121402]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/1ee9dc49b89143f781e4ab30296e4d01"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/1ee9dc49b89143f781e4ab30296e4d01"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_1ee9dc49b89143f781e4ab30296e4d01", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/1ee9dc49b89143f781e4ab30296e4d01"}]}] Nov 01 19:10:17.674527 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant: tempest-DeleteServersTestJSON-412339701 Nov 01 19:10:17.674527 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant-Id: 1ee9dc49b89143f781e4ab30296e4d01 Nov 01 19:10:17.674527 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant-Name: tempest-DeleteServersTestJSON-412339701 Nov 01 19:10:17.674527 n-d-863052-2 devstack@n-api.service[121402]: X-User: tempest-DeleteServersTestJSON-412339701-project Nov 01 19:10:17.674527 n-d-863052-2 devstack@n-api.service[121402]: X-User-Domain-Id: default Nov 01 19:10:17.674527 n-d-863052-2 devstack@n-api.service[121402]: X-User-Domain-Name: Default Nov 01 19:10:17.674527 n-d-863052-2 devstack@n-api.service[121402]: X-User-Id: 058480d92c9b4ab4af6815d0438a65c7 Nov 01 19:10:17.674527 n-d-863052-2 devstack@n-api.service[121402]: X-User-Name: tempest-DeleteServersTestJSON-412339701-project Nov 01 19:10:17.674527 n-d-863052-2 devstack@n-api.service[121402]: method: > Nov 01 19:10:17.674527 n-d-863052-2 devstack@n-api.service[121402]: exception: Instance d99a7f68-99ff-4c70-9e81-1c9faf6ebb7f could not be found. Nov 01 19:10:17.674527 n-d-863052-2 devstack@n-api.service[121402]: action_args: {'id': 'd99a7f68-99ff-4c70-9e81-1c9faf6ebb7f'} Nov 01 19:10:17.674527 n-d-863052-2 devstack@n-api.service[121402]: {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 01 19:10:17.674527 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:10:17.674527 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 01 19:10:17.674527 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 01 19:10:17.674527 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 01 19:10:17.674527 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 01 19:10:17.674527 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 01 19:10:17.674527 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 01 19:10:17.674527 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 01 19:10:17.674527 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 01 19:10:17.674527 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d99a7f68-99ff-4c70-9e81-1c9faf6ebb7f could not be found. Nov 01 19:10:17.674527 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:10:17.674527 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:10:17.674527 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:10:17.674527 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:10:17.674527 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:10:17.674527 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:10:17.674527 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 01 19:10:17.674527 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 01 19:10:17.674527 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 01 19:10:17.674527 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 01 19:10:17.674527 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 01 19:10:17.674527 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 01 19:10:17.674527 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 01 19:10:17.674527 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 01 19:10:17.674527 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 01 19:10:17.674527 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 01 19:10:17.674527 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 01 19:10:17.674527 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 01 19:10:17.679114 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d99a7f68-99ff-4c70-9e81-1c9faf6ebb7f could not be found. Nov 01 19:10:17.679114 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:10:17.679114 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:10:17.679114 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:10:17.679114 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:10:17.679114 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:10:17.679114 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:10:17.679114 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 01 19:10:17.679114 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 01 19:10:17.679114 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d99a7f68-99ff-4c70-9e81-1c9faf6ebb7f could not be found. Nov 01 19:10:17.679114 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:10:17.679114 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-c5841074-800d-4420-90a2-b5460f430cfb tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Returning 404 to user: Instance d99a7f68-99ff-4c70-9e81-1c9faf6ebb7f could not be found. {{(pid=121402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 01 19:10:17.679114 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-c5841074-800d-4420-90a2-b5460f430cfb tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] 10.222.0.13 "DELETE /compute/v2.1/servers/d99a7f68-99ff-4c70-9e81-1c9faf6ebb7f" status: 404 len: 111 microversion: 2.1 time: 0.061385 Nov 01 19:10:17.679114 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1919/3937] 10.222.0.13 () {58 vars in 1239 bytes} [Tue Nov 1 19:10:17 2022] DELETE /compute/v2.1/servers/d99a7f68-99ff-4c70-9e81-1c9faf6ebb7f => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 01 19:10:17.685265 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-2efa4f84-a0cd-4999-906f-e3ee0c1bc7ff tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:10:17.686948 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-2efa4f84-a0cd-4999-906f-e3ee0c1bc7ff tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] [instance: d99a7f68-99ff-4c70-9e81-1c9faf6ebb7f] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:10:17.693597 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2efa4f84-a0cd-4999-906f-e3ee0c1bc7ff tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:17.694095 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2efa4f84-a0cd-4999-906f-e3ee0c1bc7ff tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:17.694542 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2efa4f84-a0cd-4999-906f-e3ee0c1bc7ff tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:17.695249 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2efa4f84-a0cd-4999-906f-e3ee0c1bc7ff tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:17.695710 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2efa4f84-a0cd-4999-906f-e3ee0c1bc7ff tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:17.696138 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2efa4f84-a0cd-4999-906f-e3ee0c1bc7ff tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:17.700659 n-d-863052-2 devstack@n-api.service[121402]: DEBUG dbcounter [-] [121402] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 19:10:17.729451 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.wsgi [None req-2efa4f84-a0cd-4999-906f-e3ee0c1bc7ff tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] HTTP exception thrown: Instance d99a7f68-99ff-4c70-9e81-1c9faf6ebb7f could not be found. Nov 01 19:10:17.731048 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-2efa4f84-a0cd-4999-906f-e3ee0c1bc7ff tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Request method failure captured: Nov 01 19:10:17.731048 n-d-863052-2 devstack@n-api.service[121402]: request: GET /compute/v2.1/servers/d99a7f68-99ff-4c70-9e81-1c9faf6ebb7f HTTP/1.1 Nov 01 19:10:17.731048 n-d-863052-2 devstack@n-api.service[121402]: Accept: application/json Nov 01 19:10:17.731048 n-d-863052-2 devstack@n-api.service[121402]: Accept-Encoding: identity Nov 01 19:10:17.731048 n-d-863052-2 devstack@n-api.service[121402]: Connection: close Nov 01 19:10:17.731048 n-d-863052-2 devstack@n-api.service[121402]: Content-Length: 0 Nov 01 19:10:17.731048 n-d-863052-2 devstack@n-api.service[121402]: Content-Type: application/json Nov 01 19:10:17.731048 n-d-863052-2 devstack@n-api.service[121402]: Host: 10.222.0.13 Nov 01 19:10:17.731048 n-d-863052-2 devstack@n-api.service[121402]: Openstack-System-Scope: None Nov 01 19:10:17.731048 n-d-863052-2 devstack@n-api.service[121402]: User-Agent: python-urllib3/1.26.12 Nov 01 19:10:17.731048 n-d-863052-2 devstack@n-api.service[121402]: X-Auth-Token: gAAAAABjYW3ByfBI9VCjWikZSFUz_hPClqqMancoCxnwBX6xqaMeeugycqMQyEPQybXqoeO46TFhJ9TITtoJFiSbS9Ry6pB9Kueb-hoVnQBV0e7qQWXwvcx4eB_AomP3ogOCXvqhfUnxVmmooBEoQbpvBIMsXQEjVVdPObNP8WS9oGjTsTTTO4o Nov 01 19:10:17.731048 n-d-863052-2 devstack@n-api.service[121402]: X-Domain-Id: None Nov 01 19:10:17.731048 n-d-863052-2 devstack@n-api.service[121402]: X-Domain-Name: None Nov 01 19:10:17.731048 n-d-863052-2 devstack@n-api.service[121402]: X-Identity-Status: Confirmed Nov 01 19:10:17.731048 n-d-863052-2 devstack@n-api.service[121402]: X-Is-Admin-Project: True Nov 01 19:10:17.731048 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Domain-Id: default Nov 01 19:10:17.731048 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Domain-Name: Default Nov 01 19:10:17.731048 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Id: 1ee9dc49b89143f781e4ab30296e4d01 Nov 01 19:10:17.731048 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Name: tempest-DeleteServersTestJSON-412339701 Nov 01 19:10:17.731048 n-d-863052-2 devstack@n-api.service[121402]: X-Role: member,reader Nov 01 19:10:17.731048 n-d-863052-2 devstack@n-api.service[121402]: X-Roles: member,reader Nov 01 19:10:17.731048 n-d-863052-2 devstack@n-api.service[121402]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/1ee9dc49b89143f781e4ab30296e4d01"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/1ee9dc49b89143f781e4ab30296e4d01"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_1ee9dc49b89143f781e4ab30296e4d01", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/1ee9dc49b89143f781e4ab30296e4d01"}]}] Nov 01 19:10:17.731048 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant: tempest-DeleteServersTestJSON-412339701 Nov 01 19:10:17.731048 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant-Id: 1ee9dc49b89143f781e4ab30296e4d01 Nov 01 19:10:17.731048 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant-Name: tempest-DeleteServersTestJSON-412339701 Nov 01 19:10:17.731048 n-d-863052-2 devstack@n-api.service[121402]: X-User: tempest-DeleteServersTestJSON-412339701-project Nov 01 19:10:17.731048 n-d-863052-2 devstack@n-api.service[121402]: X-User-Domain-Id: default Nov 01 19:10:17.731048 n-d-863052-2 devstack@n-api.service[121402]: X-User-Domain-Name: Default Nov 01 19:10:17.731048 n-d-863052-2 devstack@n-api.service[121402]: X-User-Id: 058480d92c9b4ab4af6815d0438a65c7 Nov 01 19:10:17.731048 n-d-863052-2 devstack@n-api.service[121402]: X-User-Name: tempest-DeleteServersTestJSON-412339701-project Nov 01 19:10:17.731048 n-d-863052-2 devstack@n-api.service[121402]: method: > Nov 01 19:10:17.731048 n-d-863052-2 devstack@n-api.service[121402]: exception: Instance d99a7f68-99ff-4c70-9e81-1c9faf6ebb7f could not be found. Nov 01 19:10:17.731048 n-d-863052-2 devstack@n-api.service[121402]: action_args: {'id': 'd99a7f68-99ff-4c70-9e81-1c9faf6ebb7f'} Nov 01 19:10:17.731048 n-d-863052-2 devstack@n-api.service[121402]: {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 01 19:10:17.731048 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:10:17.731048 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 01 19:10:17.731048 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 01 19:10:17.731048 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 01 19:10:17.731048 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 01 19:10:17.731048 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 01 19:10:17.731048 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 01 19:10:17.731048 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 01 19:10:17.731048 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 01 19:10:17.731048 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d99a7f68-99ff-4c70-9e81-1c9faf6ebb7f could not be found. Nov 01 19:10:17.731048 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:10:17.731048 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:10:17.731048 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:10:17.731048 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:10:17.731048 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:10:17.731048 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:10:17.731048 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 01 19:10:17.731048 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 01 19:10:17.731048 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 01 19:10:17.731048 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 01 19:10:17.731048 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 01 19:10:17.731048 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 01 19:10:17.731048 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 01 19:10:17.731048 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 01 19:10:17.731048 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 01 19:10:17.731048 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 01 19:10:17.731048 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d99a7f68-99ff-4c70-9e81-1c9faf6ebb7f could not be found. Nov 01 19:10:17.731048 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:10:17.731048 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:10:17.731048 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:10:17.735923 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:10:17.735923 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:10:17.735923 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:10:17.735923 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 01 19:10:17.735923 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 01 19:10:17.735923 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d99a7f68-99ff-4c70-9e81-1c9faf6ebb7f could not be found. Nov 01 19:10:17.735923 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:10:17.735923 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-2efa4f84-a0cd-4999-906f-e3ee0c1bc7ff tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Returning 404 to user: Instance d99a7f68-99ff-4c70-9e81-1c9faf6ebb7f could not be found. {{(pid=121402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 01 19:10:17.735923 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-2efa4f84-a0cd-4999-906f-e3ee0c1bc7ff tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] 10.222.0.13 "GET /compute/v2.1/servers/d99a7f68-99ff-4c70-9e81-1c9faf6ebb7f" status: 404 len: 111 microversion: 2.1 time: 0.051621 Nov 01 19:10:17.735923 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1920/3938] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:10:17 2022] GET /compute/v2.1/servers/d99a7f68-99ff-4c70-9e81-1c9faf6ebb7f => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 01 19:10:17.742144 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-9b91d415-c806-410d-840a-91fe71619306 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:10:17.742735 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-9b91d415-c806-410d-840a-91fe71619306 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] [instance: 3a13d400-ebab-4430-bba5-4b5339199be4] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:10:17.749683 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-9b91d415-c806-410d-840a-91fe71619306 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:17.750658 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-9b91d415-c806-410d-840a-91fe71619306 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:17.751334 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-9b91d415-c806-410d-840a-91fe71619306 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:17.752862 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-9b91d415-c806-410d-840a-91fe71619306 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:17.753773 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-9b91d415-c806-410d-840a-91fe71619306 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:17.754655 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-9b91d415-c806-410d-840a-91fe71619306 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:17.778237 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.wsgi [None req-9b91d415-c806-410d-840a-91fe71619306 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] HTTP exception thrown: Instance 3a13d400-ebab-4430-bba5-4b5339199be4 could not be found. Nov 01 19:10:17.780943 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-9b91d415-c806-410d-840a-91fe71619306 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Request method failure captured: Nov 01 19:10:17.780943 n-d-863052-2 devstack@n-api.service[121402]: request: DELETE /compute/v2.1/servers/3a13d400-ebab-4430-bba5-4b5339199be4 HTTP/1.1 Nov 01 19:10:17.780943 n-d-863052-2 devstack@n-api.service[121402]: Accept: application/json Nov 01 19:10:17.780943 n-d-863052-2 devstack@n-api.service[121402]: Accept-Encoding: identity Nov 01 19:10:17.780943 n-d-863052-2 devstack@n-api.service[121402]: Connection: close Nov 01 19:10:17.780943 n-d-863052-2 devstack@n-api.service[121402]: Content-Length: 0 Nov 01 19:10:17.780943 n-d-863052-2 devstack@n-api.service[121402]: Content-Type: application/json Nov 01 19:10:17.780943 n-d-863052-2 devstack@n-api.service[121402]: Host: 10.222.0.13 Nov 01 19:10:17.780943 n-d-863052-2 devstack@n-api.service[121402]: Openstack-System-Scope: None Nov 01 19:10:17.780943 n-d-863052-2 devstack@n-api.service[121402]: User-Agent: python-urllib3/1.26.12 Nov 01 19:10:17.780943 n-d-863052-2 devstack@n-api.service[121402]: X-Auth-Token: gAAAAABjYW3ByfBI9VCjWikZSFUz_hPClqqMancoCxnwBX6xqaMeeugycqMQyEPQybXqoeO46TFhJ9TITtoJFiSbS9Ry6pB9Kueb-hoVnQBV0e7qQWXwvcx4eB_AomP3ogOCXvqhfUnxVmmooBEoQbpvBIMsXQEjVVdPObNP8WS9oGjTsTTTO4o Nov 01 19:10:17.780943 n-d-863052-2 devstack@n-api.service[121402]: X-Domain-Id: None Nov 01 19:10:17.780943 n-d-863052-2 devstack@n-api.service[121402]: X-Domain-Name: None Nov 01 19:10:17.780943 n-d-863052-2 devstack@n-api.service[121402]: X-Identity-Status: Confirmed Nov 01 19:10:17.780943 n-d-863052-2 devstack@n-api.service[121402]: X-Is-Admin-Project: True Nov 01 19:10:17.780943 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Domain-Id: default Nov 01 19:10:17.780943 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Domain-Name: Default Nov 01 19:10:17.780943 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Id: 1ee9dc49b89143f781e4ab30296e4d01 Nov 01 19:10:17.780943 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Name: tempest-DeleteServersTestJSON-412339701 Nov 01 19:10:17.780943 n-d-863052-2 devstack@n-api.service[121402]: X-Role: member,reader Nov 01 19:10:17.780943 n-d-863052-2 devstack@n-api.service[121402]: X-Roles: member,reader Nov 01 19:10:17.780943 n-d-863052-2 devstack@n-api.service[121402]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/1ee9dc49b89143f781e4ab30296e4d01"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/1ee9dc49b89143f781e4ab30296e4d01"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_1ee9dc49b89143f781e4ab30296e4d01", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/1ee9dc49b89143f781e4ab30296e4d01"}]}] Nov 01 19:10:17.780943 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant: tempest-DeleteServersTestJSON-412339701 Nov 01 19:10:17.780943 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant-Id: 1ee9dc49b89143f781e4ab30296e4d01 Nov 01 19:10:17.780943 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant-Name: tempest-DeleteServersTestJSON-412339701 Nov 01 19:10:17.780943 n-d-863052-2 devstack@n-api.service[121402]: X-User: tempest-DeleteServersTestJSON-412339701-project Nov 01 19:10:17.780943 n-d-863052-2 devstack@n-api.service[121402]: X-User-Domain-Id: default Nov 01 19:10:17.780943 n-d-863052-2 devstack@n-api.service[121402]: X-User-Domain-Name: Default Nov 01 19:10:17.780943 n-d-863052-2 devstack@n-api.service[121402]: X-User-Id: 058480d92c9b4ab4af6815d0438a65c7 Nov 01 19:10:17.780943 n-d-863052-2 devstack@n-api.service[121402]: X-User-Name: tempest-DeleteServersTestJSON-412339701-project Nov 01 19:10:17.780943 n-d-863052-2 devstack@n-api.service[121402]: method: > Nov 01 19:10:17.780943 n-d-863052-2 devstack@n-api.service[121402]: exception: Instance 3a13d400-ebab-4430-bba5-4b5339199be4 could not be found. Nov 01 19:10:17.780943 n-d-863052-2 devstack@n-api.service[121402]: action_args: {'id': '3a13d400-ebab-4430-bba5-4b5339199be4'} Nov 01 19:10:17.780943 n-d-863052-2 devstack@n-api.service[121402]: {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 01 19:10:17.780943 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:10:17.780943 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 01 19:10:17.780943 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 01 19:10:17.780943 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 01 19:10:17.780943 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 01 19:10:17.780943 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 01 19:10:17.780943 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 01 19:10:17.780943 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 01 19:10:17.780943 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 01 19:10:17.780943 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3a13d400-ebab-4430-bba5-4b5339199be4 could not be found. Nov 01 19:10:17.780943 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:10:17.780943 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:10:17.780943 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:10:17.780943 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:10:17.780943 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:10:17.780943 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:10:17.780943 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 01 19:10:17.780943 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 01 19:10:17.780943 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 01 19:10:17.780943 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 01 19:10:17.780943 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 01 19:10:17.780943 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 01 19:10:17.780943 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 01 19:10:17.780943 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 01 19:10:17.780943 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 01 19:10:17.780943 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 01 19:10:17.780943 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 01 19:10:17.780943 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 01 19:10:17.786508 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3a13d400-ebab-4430-bba5-4b5339199be4 could not be found. Nov 01 19:10:17.786508 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:10:17.786508 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:10:17.786508 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:10:17.786508 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:10:17.786508 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:10:17.786508 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:10:17.786508 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 01 19:10:17.786508 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 01 19:10:17.786508 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3a13d400-ebab-4430-bba5-4b5339199be4 could not be found. Nov 01 19:10:17.786508 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:10:17.789056 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-9b91d415-c806-410d-840a-91fe71619306 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Returning 404 to user: Instance 3a13d400-ebab-4430-bba5-4b5339199be4 could not be found. {{(pid=121402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 01 19:10:17.790567 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-9b91d415-c806-410d-840a-91fe71619306 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] 10.222.0.13 "DELETE /compute/v2.1/servers/3a13d400-ebab-4430-bba5-4b5339199be4" status: 404 len: 111 microversion: 2.1 time: 0.053318 Nov 01 19:10:17.791724 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1921/3939] 10.222.0.13 () {58 vars in 1239 bytes} [Tue Nov 1 19:10:17 2022] DELETE /compute/v2.1/servers/3a13d400-ebab-4430-bba5-4b5339199be4 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 01 19:10:17.804083 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-298edb90-269b-406f-b182-45b2b5f6d4f8 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:10:17.807471 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-298edb90-269b-406f-b182-45b2b5f6d4f8 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] [instance: 3a13d400-ebab-4430-bba5-4b5339199be4] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:10:17.815298 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-298edb90-269b-406f-b182-45b2b5f6d4f8 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:17.816735 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-298edb90-269b-406f-b182-45b2b5f6d4f8 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:17.817346 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-298edb90-269b-406f-b182-45b2b5f6d4f8 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:17.818473 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-298edb90-269b-406f-b182-45b2b5f6d4f8 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:17.819222 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-298edb90-269b-406f-b182-45b2b5f6d4f8 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:17.819843 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-298edb90-269b-406f-b182-45b2b5f6d4f8 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:17.842562 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.wsgi [None req-298edb90-269b-406f-b182-45b2b5f6d4f8 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] HTTP exception thrown: Instance 3a13d400-ebab-4430-bba5-4b5339199be4 could not be found. Nov 01 19:10:17.844275 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-298edb90-269b-406f-b182-45b2b5f6d4f8 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Request method failure captured: Nov 01 19:10:17.844275 n-d-863052-2 devstack@n-api.service[121402]: request: GET /compute/v2.1/servers/3a13d400-ebab-4430-bba5-4b5339199be4 HTTP/1.1 Nov 01 19:10:17.844275 n-d-863052-2 devstack@n-api.service[121402]: Accept: application/json Nov 01 19:10:17.844275 n-d-863052-2 devstack@n-api.service[121402]: Accept-Encoding: identity Nov 01 19:10:17.844275 n-d-863052-2 devstack@n-api.service[121402]: Connection: close Nov 01 19:10:17.844275 n-d-863052-2 devstack@n-api.service[121402]: Content-Length: 0 Nov 01 19:10:17.844275 n-d-863052-2 devstack@n-api.service[121402]: Content-Type: application/json Nov 01 19:10:17.844275 n-d-863052-2 devstack@n-api.service[121402]: Host: 10.222.0.13 Nov 01 19:10:17.844275 n-d-863052-2 devstack@n-api.service[121402]: Openstack-System-Scope: None Nov 01 19:10:17.844275 n-d-863052-2 devstack@n-api.service[121402]: User-Agent: python-urllib3/1.26.12 Nov 01 19:10:17.844275 n-d-863052-2 devstack@n-api.service[121402]: X-Auth-Token: gAAAAABjYW3ByfBI9VCjWikZSFUz_hPClqqMancoCxnwBX6xqaMeeugycqMQyEPQybXqoeO46TFhJ9TITtoJFiSbS9Ry6pB9Kueb-hoVnQBV0e7qQWXwvcx4eB_AomP3ogOCXvqhfUnxVmmooBEoQbpvBIMsXQEjVVdPObNP8WS9oGjTsTTTO4o Nov 01 19:10:17.844275 n-d-863052-2 devstack@n-api.service[121402]: X-Domain-Id: None Nov 01 19:10:17.844275 n-d-863052-2 devstack@n-api.service[121402]: X-Domain-Name: None Nov 01 19:10:17.844275 n-d-863052-2 devstack@n-api.service[121402]: X-Identity-Status: Confirmed Nov 01 19:10:17.844275 n-d-863052-2 devstack@n-api.service[121402]: X-Is-Admin-Project: True Nov 01 19:10:17.844275 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Domain-Id: default Nov 01 19:10:17.844275 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Domain-Name: Default Nov 01 19:10:17.844275 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Id: 1ee9dc49b89143f781e4ab30296e4d01 Nov 01 19:10:17.844275 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Name: tempest-DeleteServersTestJSON-412339701 Nov 01 19:10:17.844275 n-d-863052-2 devstack@n-api.service[121402]: X-Role: member,reader Nov 01 19:10:17.844275 n-d-863052-2 devstack@n-api.service[121402]: X-Roles: member,reader Nov 01 19:10:17.844275 n-d-863052-2 devstack@n-api.service[121402]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/1ee9dc49b89143f781e4ab30296e4d01"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/1ee9dc49b89143f781e4ab30296e4d01"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_1ee9dc49b89143f781e4ab30296e4d01", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/1ee9dc49b89143f781e4ab30296e4d01"}]}] Nov 01 19:10:17.844275 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant: tempest-DeleteServersTestJSON-412339701 Nov 01 19:10:17.844275 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant-Id: 1ee9dc49b89143f781e4ab30296e4d01 Nov 01 19:10:17.844275 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant-Name: tempest-DeleteServersTestJSON-412339701 Nov 01 19:10:17.844275 n-d-863052-2 devstack@n-api.service[121402]: X-User: tempest-DeleteServersTestJSON-412339701-project Nov 01 19:10:17.844275 n-d-863052-2 devstack@n-api.service[121402]: X-User-Domain-Id: default Nov 01 19:10:17.844275 n-d-863052-2 devstack@n-api.service[121402]: X-User-Domain-Name: Default Nov 01 19:10:17.844275 n-d-863052-2 devstack@n-api.service[121402]: X-User-Id: 058480d92c9b4ab4af6815d0438a65c7 Nov 01 19:10:17.844275 n-d-863052-2 devstack@n-api.service[121402]: X-User-Name: tempest-DeleteServersTestJSON-412339701-project Nov 01 19:10:17.844275 n-d-863052-2 devstack@n-api.service[121402]: method: > Nov 01 19:10:17.844275 n-d-863052-2 devstack@n-api.service[121402]: exception: Instance 3a13d400-ebab-4430-bba5-4b5339199be4 could not be found. Nov 01 19:10:17.844275 n-d-863052-2 devstack@n-api.service[121402]: action_args: {'id': '3a13d400-ebab-4430-bba5-4b5339199be4'} Nov 01 19:10:17.844275 n-d-863052-2 devstack@n-api.service[121402]: {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 01 19:10:17.844275 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:10:17.844275 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 01 19:10:17.844275 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 01 19:10:17.844275 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 01 19:10:17.844275 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 01 19:10:17.844275 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 01 19:10:17.844275 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 01 19:10:17.844275 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 01 19:10:17.844275 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 01 19:10:17.844275 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3a13d400-ebab-4430-bba5-4b5339199be4 could not be found. Nov 01 19:10:17.844275 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:10:17.844275 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:10:17.844275 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:10:17.844275 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:10:17.844275 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:10:17.844275 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:10:17.844275 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 01 19:10:17.844275 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 01 19:10:17.844275 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 01 19:10:17.844275 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 01 19:10:17.844275 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 01 19:10:17.844275 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 01 19:10:17.844275 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 01 19:10:17.844275 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 01 19:10:17.844275 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 01 19:10:17.844275 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 01 19:10:17.844275 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3a13d400-ebab-4430-bba5-4b5339199be4 could not be found. Nov 01 19:10:17.844275 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:10:17.844275 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:10:17.844275 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:10:17.849174 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:10:17.849174 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:10:17.849174 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:10:17.849174 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 01 19:10:17.849174 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 01 19:10:17.849174 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3a13d400-ebab-4430-bba5-4b5339199be4 could not be found. Nov 01 19:10:17.849174 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:10:17.849174 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-298edb90-269b-406f-b182-45b2b5f6d4f8 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Returning 404 to user: Instance 3a13d400-ebab-4430-bba5-4b5339199be4 could not be found. {{(pid=121402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 01 19:10:17.849174 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-298edb90-269b-406f-b182-45b2b5f6d4f8 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] 10.222.0.13 "GET /compute/v2.1/servers/3a13d400-ebab-4430-bba5-4b5339199be4" status: 404 len: 111 microversion: 2.1 time: 0.050075 Nov 01 19:10:17.849174 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1922/3940] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:10:17 2022] GET /compute/v2.1/servers/3a13d400-ebab-4430-bba5-4b5339199be4 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 01 19:10:18.017011 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-d37cb5ad-1553-4721-b135-3f53ad4dd5cd tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2868ccfdfb164cffa37232c821f205a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04ef687c40bd45c297d22a791bae58cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:10:18.026110 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-d37cb5ad-1553-4721-b135-3f53ad4dd5cd tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] 10.222.0.13 "GET /compute/v2.1/servers/ac19dd18-c22a-46de-91ef-454a0b78872f" status: 200 len: 1523 microversion: 2.1 time: 0.459811 Nov 01 19:10:18.026707 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 2019/3941] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:10:17 2022] GET /compute/v2.1/servers/ac19dd18-c22a-46de-91ef-454a0b78872f => generated 1523 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:10:18.541531 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-8f7a2c44-66cc-4a7d-86be-ee7795ef4d09 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:10:18.542433 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-8f7a2c44-66cc-4a7d-86be-ee7795ef4d09 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] [instance: af1071a8-a090-44c9-890c-123ca3ff39f1] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:10:18.549643 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-8f7a2c44-66cc-4a7d-86be-ee7795ef4d09 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:18.551357 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-8f7a2c44-66cc-4a7d-86be-ee7795ef4d09 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:18.551959 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-8f7a2c44-66cc-4a7d-86be-ee7795ef4d09 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:18.555528 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-8f7a2c44-66cc-4a7d-86be-ee7795ef4d09 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:18.556340 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-8f7a2c44-66cc-4a7d-86be-ee7795ef4d09 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:18.557034 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-8f7a2c44-66cc-4a7d-86be-ee7795ef4d09 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:18.590192 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-f47bd159-c80c-4025-8b8c-1dfbd65017dd tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:10:18.591393 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-f47bd159-c80c-4025-8b8c-1dfbd65017dd tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] [instance: 29b73e88-1e2a-45d8-bdbb-6c5f9399d270] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:10:18.600640 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f47bd159-c80c-4025-8b8c-1dfbd65017dd tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:18.601135 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f47bd159-c80c-4025-8b8c-1dfbd65017dd tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:18.601572 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f47bd159-c80c-4025-8b8c-1dfbd65017dd tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:18.602263 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f47bd159-c80c-4025-8b8c-1dfbd65017dd tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:18.624305 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f47bd159-c80c-4025-8b8c-1dfbd65017dd tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:18.625059 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f47bd159-c80c-4025-8b8c-1dfbd65017dd tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:18.815582 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-8f7a2c44-66cc-4a7d-86be-ee7795ef4d09 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '301ed3b9c37449bc9ade378f3c73a768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8807757227574c828dca1947af76659d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:10:18.825578 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-8f7a2c44-66cc-4a7d-86be-ee7795ef4d09 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '301ed3b9c37449bc9ade378f3c73a768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8807757227574c828dca1947af76659d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:10:18.828512 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-8f7a2c44-66cc-4a7d-86be-ee7795ef4d09 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '301ed3b9c37449bc9ade378f3c73a768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8807757227574c828dca1947af76659d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:10:18.829986 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-8f7a2c44-66cc-4a7d-86be-ee7795ef4d09 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] 10.222.0.13 "GET /compute/v2.1/servers/af1071a8-a090-44c9-890c-123ca3ff39f1" status: 200 len: 2489 microversion: 2.42 time: 0.292741 Nov 01 19:10:18.831071 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1923/3942] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 19:10:18 2022] GET /compute/v2.1/servers/af1071a8-a090-44c9-890c-123ca3ff39f1 => generated 2489 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 19:10:18.836851 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [req-20f0f35c-76ac-42b2-990a-cc3fbeb94fc7 req-8ac72476-2ce0-4f8d-b55c-a9a542f7539d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "af1071a8-a090-44c9-890c-123ca3ff39f1", "name": "network-vif-deleted", "tag": "5bf6bd76-de52-44ac-88f4-a18e9dd144b7"}, {"server_uuid": "af1071a8-a090-44c9-890c-123ca3ff39f1", "name": "network-vif-deleted", "tag": "47e5170e-02f3-496f-b886-a133bae1b952"}]} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:10:18.848332 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-20f0f35c-76ac-42b2-990a-cc3fbeb94fc7 req-8ac72476-2ce0-4f8d-b55c-a9a542f7539d service nova] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:18.849035 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-20f0f35c-76ac-42b2-990a-cc3fbeb94fc7 req-8ac72476-2ce0-4f8d-b55c-a9a542f7539d service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:18.849647 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-20f0f35c-76ac-42b2-990a-cc3fbeb94fc7 req-8ac72476-2ce0-4f8d-b55c-a9a542f7539d service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:18.862311 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.compute.server_external_events [req-20f0f35c-76ac-42b2-990a-cc3fbeb94fc7 req-8ac72476-2ce0-4f8d-b55c-a9a542f7539d service nova] Creating event network-vif-deleted:5bf6bd76-de52-44ac-88f4-a18e9dd144b7 for instance af1071a8-a090-44c9-890c-123ca3ff39f1 on n-h2-863052-2 Nov 01 19:10:18.863857 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.compute.server_external_events [req-20f0f35c-76ac-42b2-990a-cc3fbeb94fc7 req-8ac72476-2ce0-4f8d-b55c-a9a542f7539d service nova] Creating event network-vif-deleted:47e5170e-02f3-496f-b886-a133bae1b952 for instance af1071a8-a090-44c9-890c-123ca3ff39f1 on n-h2-863052-2 Nov 01 19:10:18.869932 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [req-20f0f35c-76ac-42b2-990a-cc3fbeb94fc7 req-8ac72476-2ce0-4f8d-b55c-a9a542f7539d service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.037107 Nov 01 19:10:18.871342 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1924/3943] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Nov 1 19:10:18 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:10:19.025778 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-f47bd159-c80c-4025-8b8c-1dfbd65017dd tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3111dabbf6d14e2c91766f2f5544057c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c30003431656408bb328e90be22d009a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:10:19.035936 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-f47bd159-c80c-4025-8b8c-1dfbd65017dd tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3111dabbf6d14e2c91766f2f5544057c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c30003431656408bb328e90be22d009a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:10:19.038112 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-f47bd159-c80c-4025-8b8c-1dfbd65017dd tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3111dabbf6d14e2c91766f2f5544057c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c30003431656408bb328e90be22d009a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:10:19.041070 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-f47bd159-c80c-4025-8b8c-1dfbd65017dd tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] 10.222.0.13 "GET /compute/v2.1/servers/29b73e88-1e2a-45d8-bdbb-6c5f9399d270" status: 200 len: 1330 microversion: 2.57 time: 0.454726 Nov 01 19:10:19.047129 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 2020/3944] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 19:10:18 2022] GET /compute/v2.1/servers/29b73e88-1e2a-45d8-bdbb-6c5f9399d270 => generated 1330 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 19:10:19.055531 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-55c52169-c000-493a-883b-a981d1dac24d tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:10:19.056539 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-55c52169-c000-493a-883b-a981d1dac24d tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] [instance: ac19dd18-c22a-46de-91ef-454a0b78872f] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:10:19.077185 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-55c52169-c000-493a-883b-a981d1dac24d tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:19.077773 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-55c52169-c000-493a-883b-a981d1dac24d tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:19.078228 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-55c52169-c000-493a-883b-a981d1dac24d tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:19.079087 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-55c52169-c000-493a-883b-a981d1dac24d tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:19.079722 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-55c52169-c000-493a-883b-a981d1dac24d tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:19.080319 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-55c52169-c000-493a-883b-a981d1dac24d tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:19.318505 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-55c52169-c000-493a-883b-a981d1dac24d tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2868ccfdfb164cffa37232c821f205a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04ef687c40bd45c297d22a791bae58cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:10:19.329660 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-55c52169-c000-493a-883b-a981d1dac24d tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] 10.222.0.13 "GET /compute/v2.1/servers/ac19dd18-c22a-46de-91ef-454a0b78872f" status: 200 len: 1523 microversion: 2.1 time: 0.280243 Nov 01 19:10:19.330397 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1925/3945] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:10:19 2022] GET /compute/v2.1/servers/ac19dd18-c22a-46de-91ef-454a0b78872f => generated 1523 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:10:19.869460 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-3a8ba40f-1108-45eb-b5f3-b2e5f7d0c62d tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:10:19.870101 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-3a8ba40f-1108-45eb-b5f3-b2e5f7d0c62d tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] [instance: af1071a8-a090-44c9-890c-123ca3ff39f1] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:10:19.884840 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-3a8ba40f-1108-45eb-b5f3-b2e5f7d0c62d tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:19.885344 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-3a8ba40f-1108-45eb-b5f3-b2e5f7d0c62d tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:19.885789 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-3a8ba40f-1108-45eb-b5f3-b2e5f7d0c62d tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:19.886518 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-3a8ba40f-1108-45eb-b5f3-b2e5f7d0c62d tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:19.886995 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-3a8ba40f-1108-45eb-b5f3-b2e5f7d0c62d tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:19.887423 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-3a8ba40f-1108-45eb-b5f3-b2e5f7d0c62d tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:19.975813 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-3a8ba40f-1108-45eb-b5f3-b2e5f7d0c62d tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '301ed3b9c37449bc9ade378f3c73a768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8807757227574c828dca1947af76659d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:10:19.987111 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-3a8ba40f-1108-45eb-b5f3-b2e5f7d0c62d tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '301ed3b9c37449bc9ade378f3c73a768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8807757227574c828dca1947af76659d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:10:19.989418 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-3a8ba40f-1108-45eb-b5f3-b2e5f7d0c62d tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '301ed3b9c37449bc9ade378f3c73a768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8807757227574c828dca1947af76659d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:10:19.990870 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-3a8ba40f-1108-45eb-b5f3-b2e5f7d0c62d tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] 10.222.0.13 "GET /compute/v2.1/servers/af1071a8-a090-44c9-890c-123ca3ff39f1" status: 200 len: 1605 microversion: 2.42 time: 0.129605 Nov 01 19:10:20.005294 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 2021/3946] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 19:10:19 2022] GET /compute/v2.1/servers/af1071a8-a090-44c9-890c-123ca3ff39f1 => generated 1605 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 19:10:20.074299 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-f9a9ec00-e7a8-4eae-9e17-2fdda83ccdeb tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:10:20.076500 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-f9a9ec00-e7a8-4eae-9e17-2fdda83ccdeb tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] [instance: 29b73e88-1e2a-45d8-bdbb-6c5f9399d270] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:10:20.094320 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f9a9ec00-e7a8-4eae-9e17-2fdda83ccdeb tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:20.094826 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f9a9ec00-e7a8-4eae-9e17-2fdda83ccdeb tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:20.095262 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f9a9ec00-e7a8-4eae-9e17-2fdda83ccdeb tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:20.095983 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f9a9ec00-e7a8-4eae-9e17-2fdda83ccdeb tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:20.096440 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f9a9ec00-e7a8-4eae-9e17-2fdda83ccdeb tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:20.097412 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f9a9ec00-e7a8-4eae-9e17-2fdda83ccdeb tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:20.248716 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-f9a9ec00-e7a8-4eae-9e17-2fdda83ccdeb tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3111dabbf6d14e2c91766f2f5544057c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c30003431656408bb328e90be22d009a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:10:20.263712 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-f9a9ec00-e7a8-4eae-9e17-2fdda83ccdeb tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3111dabbf6d14e2c91766f2f5544057c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c30003431656408bb328e90be22d009a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:10:20.264502 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-f9a9ec00-e7a8-4eae-9e17-2fdda83ccdeb tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3111dabbf6d14e2c91766f2f5544057c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c30003431656408bb328e90be22d009a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:10:20.265720 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-f9a9ec00-e7a8-4eae-9e17-2fdda83ccdeb tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] 10.222.0.13 "GET /compute/v2.1/servers/29b73e88-1e2a-45d8-bdbb-6c5f9399d270" status: 200 len: 1336 microversion: 2.57 time: 0.195609 Nov 01 19:10:20.269980 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1926/3947] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 19:10:20 2022] GET /compute/v2.1/servers/29b73e88-1e2a-45d8-bdbb-6c5f9399d270 => generated 1336 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 19:10:20.355713 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-d0df20a8-b839-45b7-b2b7-aed95c27f722 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:10:20.357415 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-d0df20a8-b839-45b7-b2b7-aed95c27f722 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] [instance: ac19dd18-c22a-46de-91ef-454a0b78872f] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:10:20.371257 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d0df20a8-b839-45b7-b2b7-aed95c27f722 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:20.371696 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d0df20a8-b839-45b7-b2b7-aed95c27f722 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:20.372150 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d0df20a8-b839-45b7-b2b7-aed95c27f722 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:20.372906 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d0df20a8-b839-45b7-b2b7-aed95c27f722 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:20.377082 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d0df20a8-b839-45b7-b2b7-aed95c27f722 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:20.378150 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d0df20a8-b839-45b7-b2b7-aed95c27f722 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:20.624482 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-d0df20a8-b839-45b7-b2b7-aed95c27f722 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2868ccfdfb164cffa37232c821f205a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04ef687c40bd45c297d22a791bae58cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:10:20.634138 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-d0df20a8-b839-45b7-b2b7-aed95c27f722 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] 10.222.0.13 "GET /compute/v2.1/servers/ac19dd18-c22a-46de-91ef-454a0b78872f" status: 200 len: 1523 microversion: 2.1 time: 0.283911 Nov 01 19:10:20.636678 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 2022/3948] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:10:20 2022] GET /compute/v2.1/servers/ac19dd18-c22a-46de-91ef-454a0b78872f => generated 1523 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:10:21.019528 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-bb58914b-6f7b-4a80-96b7-aa93ea5cae6f tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:10:21.020382 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-bb58914b-6f7b-4a80-96b7-aa93ea5cae6f tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] [instance: af1071a8-a090-44c9-890c-123ca3ff39f1] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:10:21.028930 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-bb58914b-6f7b-4a80-96b7-aa93ea5cae6f tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:21.029839 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-bb58914b-6f7b-4a80-96b7-aa93ea5cae6f tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:21.030506 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-bb58914b-6f7b-4a80-96b7-aa93ea5cae6f tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:21.031497 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-bb58914b-6f7b-4a80-96b7-aa93ea5cae6f tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:21.032288 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-bb58914b-6f7b-4a80-96b7-aa93ea5cae6f tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:21.032971 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-bb58914b-6f7b-4a80-96b7-aa93ea5cae6f tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:21.108864 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [req-aa1d23ad-4e83-4339-8b97-3b6025e2d5bb req-95b37d45-486f-40e8-acf3-d08b9d0a7125 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "af1071a8-a090-44c9-890c-123ca3ff39f1", "name": "network-vif-deleted", "tag": "b02cdf3d-b259-4361-af25-d77a93946fa4"}, {"server_uuid": "af1071a8-a090-44c9-890c-123ca3ff39f1", "name": "network-vif-deleted", "tag": "647aec31-8971-4e83-9e8f-4dfc4202c174"}]} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:10:21.115822 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-bb58914b-6f7b-4a80-96b7-aa93ea5cae6f tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '301ed3b9c37449bc9ade378f3c73a768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8807757227574c828dca1947af76659d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:10:21.133935 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-bb58914b-6f7b-4a80-96b7-aa93ea5cae6f tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '301ed3b9c37449bc9ade378f3c73a768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8807757227574c828dca1947af76659d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:10:21.136516 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-aa1d23ad-4e83-4339-8b97-3b6025e2d5bb req-95b37d45-486f-40e8-acf3-d08b9d0a7125 service nova] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:21.136695 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-bb58914b-6f7b-4a80-96b7-aa93ea5cae6f tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '301ed3b9c37449bc9ade378f3c73a768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8807757227574c828dca1947af76659d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:10:21.137873 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-bb58914b-6f7b-4a80-96b7-aa93ea5cae6f tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] 10.222.0.13 "GET /compute/v2.1/servers/af1071a8-a090-44c9-890c-123ca3ff39f1" status: 200 len: 1605 microversion: 2.42 time: 0.122996 Nov 01 19:10:21.138739 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1927/3949] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 19:10:21 2022] GET /compute/v2.1/servers/af1071a8-a090-44c9-890c-123ca3ff39f1 => generated 1605 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 19:10:21.149233 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-aa1d23ad-4e83-4339-8b97-3b6025e2d5bb req-95b37d45-486f-40e8-acf3-d08b9d0a7125 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:21.163072 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-aa1d23ad-4e83-4339-8b97-3b6025e2d5bb req-95b37d45-486f-40e8-acf3-d08b9d0a7125 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:21.163786 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.compute.server_external_events [req-aa1d23ad-4e83-4339-8b97-3b6025e2d5bb req-95b37d45-486f-40e8-acf3-d08b9d0a7125 service nova] Creating event network-vif-deleted:b02cdf3d-b259-4361-af25-d77a93946fa4 for instance af1071a8-a090-44c9-890c-123ca3ff39f1 on n-h2-863052-2 Nov 01 19:10:21.164517 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.compute.server_external_events [req-aa1d23ad-4e83-4339-8b97-3b6025e2d5bb req-95b37d45-486f-40e8-acf3-d08b9d0a7125 service nova] Creating event network-vif-deleted:647aec31-8971-4e83-9e8f-4dfc4202c174 for instance af1071a8-a090-44c9-890c-123ca3ff39f1 on n-h2-863052-2 Nov 01 19:10:21.169837 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [req-aa1d23ad-4e83-4339-8b97-3b6025e2d5bb req-95b37d45-486f-40e8-acf3-d08b9d0a7125 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.065936 Nov 01 19:10:21.170984 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 2023/3950] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Nov 1 19:10:21 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:10:21.300399 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-3d2196e8-033a-4011-855e-da33d708ec17 tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:10:21.301107 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-3d2196e8-033a-4011-855e-da33d708ec17 tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] [instance: 29b73e88-1e2a-45d8-bdbb-6c5f9399d270] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:10:21.307077 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-3d2196e8-033a-4011-855e-da33d708ec17 tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:21.307779 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-3d2196e8-033a-4011-855e-da33d708ec17 tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:21.308382 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-3d2196e8-033a-4011-855e-da33d708ec17 tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:21.309281 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-3d2196e8-033a-4011-855e-da33d708ec17 tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:21.309900 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-3d2196e8-033a-4011-855e-da33d708ec17 tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:21.310488 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-3d2196e8-033a-4011-855e-da33d708ec17 tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:21.419250 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-3d2196e8-033a-4011-855e-da33d708ec17 tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3111dabbf6d14e2c91766f2f5544057c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c30003431656408bb328e90be22d009a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:10:21.429171 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-3d2196e8-033a-4011-855e-da33d708ec17 tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3111dabbf6d14e2c91766f2f5544057c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c30003431656408bb328e90be22d009a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:10:21.430644 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-3d2196e8-033a-4011-855e-da33d708ec17 tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3111dabbf6d14e2c91766f2f5544057c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c30003431656408bb328e90be22d009a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:10:21.431803 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-3d2196e8-033a-4011-855e-da33d708ec17 tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] 10.222.0.13 "GET /compute/v2.1/servers/29b73e88-1e2a-45d8-bdbb-6c5f9399d270" status: 200 len: 1336 microversion: 2.57 time: 0.136273 Nov 01 19:10:21.432548 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1928/3951] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 19:10:21 2022] GET /compute/v2.1/servers/29b73e88-1e2a-45d8-bdbb-6c5f9399d270 => generated 1336 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 19:10:21.667661 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-a52fa56e-b693-4d1d-b817-fe9d302b6cdb tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:10:21.668554 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-a52fa56e-b693-4d1d-b817-fe9d302b6cdb tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] [instance: ac19dd18-c22a-46de-91ef-454a0b78872f] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:10:21.677822 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-a52fa56e-b693-4d1d-b817-fe9d302b6cdb tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:21.678320 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-a52fa56e-b693-4d1d-b817-fe9d302b6cdb tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:21.678757 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-a52fa56e-b693-4d1d-b817-fe9d302b6cdb tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:21.679464 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-a52fa56e-b693-4d1d-b817-fe9d302b6cdb tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:21.679926 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-a52fa56e-b693-4d1d-b817-fe9d302b6cdb tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:21.680351 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-a52fa56e-b693-4d1d-b817-fe9d302b6cdb tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:21.867974 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-a52fa56e-b693-4d1d-b817-fe9d302b6cdb tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2868ccfdfb164cffa37232c821f205a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04ef687c40bd45c297d22a791bae58cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:10:21.875832 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-a52fa56e-b693-4d1d-b817-fe9d302b6cdb tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] 10.222.0.13 "GET /compute/v2.1/servers/ac19dd18-c22a-46de-91ef-454a0b78872f" status: 200 len: 1523 microversion: 2.1 time: 0.212422 Nov 01 19:10:21.876417 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 2024/3952] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:10:21 2022] GET /compute/v2.1/servers/ac19dd18-c22a-46de-91ef-454a0b78872f => generated 1523 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:10:22.172270 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-6952d956-2ee4-4fe6-94df-75c80ff3c51f tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:10:22.173719 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-6952d956-2ee4-4fe6-94df-75c80ff3c51f tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] [instance: af1071a8-a090-44c9-890c-123ca3ff39f1] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:10:22.183064 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-6952d956-2ee4-4fe6-94df-75c80ff3c51f tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:22.183980 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-6952d956-2ee4-4fe6-94df-75c80ff3c51f tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:22.184635 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-6952d956-2ee4-4fe6-94df-75c80ff3c51f tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:22.185984 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-6952d956-2ee4-4fe6-94df-75c80ff3c51f tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:22.186960 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-6952d956-2ee4-4fe6-94df-75c80ff3c51f tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:22.187563 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-6952d956-2ee4-4fe6-94df-75c80ff3c51f tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:22.267723 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-6952d956-2ee4-4fe6-94df-75c80ff3c51f tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '301ed3b9c37449bc9ade378f3c73a768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8807757227574c828dca1947af76659d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:10:22.278738 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-6952d956-2ee4-4fe6-94df-75c80ff3c51f tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '301ed3b9c37449bc9ade378f3c73a768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8807757227574c828dca1947af76659d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:10:22.280231 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-6952d956-2ee4-4fe6-94df-75c80ff3c51f tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '301ed3b9c37449bc9ade378f3c73a768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8807757227574c828dca1947af76659d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:10:22.281461 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-6952d956-2ee4-4fe6-94df-75c80ff3c51f tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] 10.222.0.13 "GET /compute/v2.1/servers/af1071a8-a090-44c9-890c-123ca3ff39f1" status: 200 len: 1605 microversion: 2.42 time: 0.114044 Nov 01 19:10:22.282162 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1929/3953] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 19:10:22 2022] GET /compute/v2.1/servers/af1071a8-a090-44c9-890c-123ca3ff39f1 => generated 1605 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 19:10:22.465207 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-0a1f1081-2596-44a6-b028-1ab8500fc7f3 tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:10:22.466757 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-0a1f1081-2596-44a6-b028-1ab8500fc7f3 tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] [instance: 29b73e88-1e2a-45d8-bdbb-6c5f9399d270] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:10:22.487550 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-0a1f1081-2596-44a6-b028-1ab8500fc7f3 tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:22.488517 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-0a1f1081-2596-44a6-b028-1ab8500fc7f3 tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:22.490049 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-0a1f1081-2596-44a6-b028-1ab8500fc7f3 tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:22.493844 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-0a1f1081-2596-44a6-b028-1ab8500fc7f3 tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:22.494693 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-0a1f1081-2596-44a6-b028-1ab8500fc7f3 tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:22.497347 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-0a1f1081-2596-44a6-b028-1ab8500fc7f3 tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:22.507743 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-118d822f-0361-450c-9a25-6e20b1c3702a tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:10:22.508261 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-118d822f-0361-450c-9a25-6e20b1c3702a tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] [instance: 990f3535-a5c4-4f62-bed9-b310a77293c8] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:10:22.524276 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-118d822f-0361-450c-9a25-6e20b1c3702a tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:22.525102 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-118d822f-0361-450c-9a25-6e20b1c3702a tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:22.525766 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-118d822f-0361-450c-9a25-6e20b1c3702a tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:22.526730 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-118d822f-0361-450c-9a25-6e20b1c3702a tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:22.527362 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-118d822f-0361-450c-9a25-6e20b1c3702a tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:22.528018 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-118d822f-0361-450c-9a25-6e20b1c3702a tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:22.573184 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.wsgi [None req-118d822f-0361-450c-9a25-6e20b1c3702a tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] HTTP exception thrown: Instance 990f3535-a5c4-4f62-bed9-b310a77293c8 could not be found. Nov 01 19:10:22.575463 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-118d822f-0361-450c-9a25-6e20b1c3702a tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Request method failure captured: Nov 01 19:10:22.575463 n-d-863052-2 devstack@n-api.service[121402]: request: DELETE /compute/v2.1/servers/990f3535-a5c4-4f62-bed9-b310a77293c8 HTTP/1.1 Nov 01 19:10:22.575463 n-d-863052-2 devstack@n-api.service[121402]: Accept: application/json Nov 01 19:10:22.575463 n-d-863052-2 devstack@n-api.service[121402]: Accept-Encoding: identity Nov 01 19:10:22.575463 n-d-863052-2 devstack@n-api.service[121402]: Connection: close Nov 01 19:10:22.575463 n-d-863052-2 devstack@n-api.service[121402]: Content-Length: 0 Nov 01 19:10:22.575463 n-d-863052-2 devstack@n-api.service[121402]: Content-Type: application/json Nov 01 19:10:22.575463 n-d-863052-2 devstack@n-api.service[121402]: Host: 10.222.0.13 Nov 01 19:10:22.575463 n-d-863052-2 devstack@n-api.service[121402]: Openstack-System-Scope: None Nov 01 19:10:22.575463 n-d-863052-2 devstack@n-api.service[121402]: User-Agent: python-urllib3/1.26.12 Nov 01 19:10:22.575463 n-d-863052-2 devstack@n-api.service[121402]: X-Auth-Token: gAAAAABjYW3ByfBI9VCjWikZSFUz_hPClqqMancoCxnwBX6xqaMeeugycqMQyEPQybXqoeO46TFhJ9TITtoJFiSbS9Ry6pB9Kueb-hoVnQBV0e7qQWXwvcx4eB_AomP3ogOCXvqhfUnxVmmooBEoQbpvBIMsXQEjVVdPObNP8WS9oGjTsTTTO4o Nov 01 19:10:22.575463 n-d-863052-2 devstack@n-api.service[121402]: X-Domain-Id: None Nov 01 19:10:22.575463 n-d-863052-2 devstack@n-api.service[121402]: X-Domain-Name: None Nov 01 19:10:22.575463 n-d-863052-2 devstack@n-api.service[121402]: X-Identity-Status: Confirmed Nov 01 19:10:22.575463 n-d-863052-2 devstack@n-api.service[121402]: X-Is-Admin-Project: True Nov 01 19:10:22.575463 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Domain-Id: default Nov 01 19:10:22.575463 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Domain-Name: Default Nov 01 19:10:22.575463 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Id: 1ee9dc49b89143f781e4ab30296e4d01 Nov 01 19:10:22.575463 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Name: tempest-DeleteServersTestJSON-412339701 Nov 01 19:10:22.575463 n-d-863052-2 devstack@n-api.service[121402]: X-Role: member,reader Nov 01 19:10:22.575463 n-d-863052-2 devstack@n-api.service[121402]: X-Roles: member,reader Nov 01 19:10:22.575463 n-d-863052-2 devstack@n-api.service[121402]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/1ee9dc49b89143f781e4ab30296e4d01"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/1ee9dc49b89143f781e4ab30296e4d01"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_1ee9dc49b89143f781e4ab30296e4d01", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/1ee9dc49b89143f781e4ab30296e4d01"}]}] Nov 01 19:10:22.575463 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant: tempest-DeleteServersTestJSON-412339701 Nov 01 19:10:22.575463 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant-Id: 1ee9dc49b89143f781e4ab30296e4d01 Nov 01 19:10:22.575463 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant-Name: tempest-DeleteServersTestJSON-412339701 Nov 01 19:10:22.575463 n-d-863052-2 devstack@n-api.service[121402]: X-User: tempest-DeleteServersTestJSON-412339701-project Nov 01 19:10:22.575463 n-d-863052-2 devstack@n-api.service[121402]: X-User-Domain-Id: default Nov 01 19:10:22.575463 n-d-863052-2 devstack@n-api.service[121402]: X-User-Domain-Name: Default Nov 01 19:10:22.575463 n-d-863052-2 devstack@n-api.service[121402]: X-User-Id: 058480d92c9b4ab4af6815d0438a65c7 Nov 01 19:10:22.575463 n-d-863052-2 devstack@n-api.service[121402]: X-User-Name: tempest-DeleteServersTestJSON-412339701-project Nov 01 19:10:22.575463 n-d-863052-2 devstack@n-api.service[121402]: method: > Nov 01 19:10:22.575463 n-d-863052-2 devstack@n-api.service[121402]: exception: Instance 990f3535-a5c4-4f62-bed9-b310a77293c8 could not be found. Nov 01 19:10:22.575463 n-d-863052-2 devstack@n-api.service[121402]: action_args: {'id': '990f3535-a5c4-4f62-bed9-b310a77293c8'} Nov 01 19:10:22.575463 n-d-863052-2 devstack@n-api.service[121402]: {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 01 19:10:22.575463 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:10:22.575463 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 01 19:10:22.575463 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 01 19:10:22.575463 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 01 19:10:22.575463 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 01 19:10:22.575463 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 01 19:10:22.575463 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 01 19:10:22.575463 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 01 19:10:22.575463 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 01 19:10:22.575463 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 990f3535-a5c4-4f62-bed9-b310a77293c8 could not be found. Nov 01 19:10:22.575463 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:10:22.575463 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:10:22.575463 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:10:22.575463 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:10:22.575463 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:10:22.575463 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:10:22.575463 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 01 19:10:22.575463 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 01 19:10:22.575463 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 01 19:10:22.575463 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 01 19:10:22.575463 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 01 19:10:22.575463 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 01 19:10:22.575463 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 01 19:10:22.575463 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 01 19:10:22.575463 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 01 19:10:22.575463 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 01 19:10:22.575463 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 01 19:10:22.575463 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 01 19:10:22.580928 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 990f3535-a5c4-4f62-bed9-b310a77293c8 could not be found. Nov 01 19:10:22.580928 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:10:22.580928 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:10:22.580928 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:10:22.580928 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:10:22.580928 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:10:22.580928 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:10:22.580928 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 01 19:10:22.580928 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 01 19:10:22.580928 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 990f3535-a5c4-4f62-bed9-b310a77293c8 could not be found. Nov 01 19:10:22.580928 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:10:22.583979 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-118d822f-0361-450c-9a25-6e20b1c3702a tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Returning 404 to user: Instance 990f3535-a5c4-4f62-bed9-b310a77293c8 could not be found. {{(pid=121402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 01 19:10:22.585119 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-118d822f-0361-450c-9a25-6e20b1c3702a tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] 10.222.0.13 "DELETE /compute/v2.1/servers/990f3535-a5c4-4f62-bed9-b310a77293c8" status: 404 len: 111 microversion: 2.1 time: 0.082437 Nov 01 19:10:22.586256 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1930/3954] 10.222.0.13 () {58 vars in 1239 bytes} [Tue Nov 1 19:10:22 2022] DELETE /compute/v2.1/servers/990f3535-a5c4-4f62-bed9-b310a77293c8 => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 01 19:10:22.593410 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-0a1f1081-2596-44a6-b028-1ab8500fc7f3 tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3111dabbf6d14e2c91766f2f5544057c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c30003431656408bb328e90be22d009a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:10:22.594409 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-402cf97a-db1e-4c06-93b9-dea826bda75e tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:10:22.595803 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-402cf97a-db1e-4c06-93b9-dea826bda75e tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] [instance: 990f3535-a5c4-4f62-bed9-b310a77293c8] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:10:22.602242 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-402cf97a-db1e-4c06-93b9-dea826bda75e tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:22.602744 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-0a1f1081-2596-44a6-b028-1ab8500fc7f3 tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3111dabbf6d14e2c91766f2f5544057c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c30003431656408bb328e90be22d009a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:10:22.603299 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-402cf97a-db1e-4c06-93b9-dea826bda75e tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:22.605183 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-402cf97a-db1e-4c06-93b9-dea826bda75e tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:22.605670 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-0a1f1081-2596-44a6-b028-1ab8500fc7f3 tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3111dabbf6d14e2c91766f2f5544057c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c30003431656408bb328e90be22d009a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:10:22.606407 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-402cf97a-db1e-4c06-93b9-dea826bda75e tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:22.607096 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-402cf97a-db1e-4c06-93b9-dea826bda75e tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:22.607577 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-0a1f1081-2596-44a6-b028-1ab8500fc7f3 tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] 10.222.0.13 "GET /compute/v2.1/servers/29b73e88-1e2a-45d8-bdbb-6c5f9399d270" status: 200 len: 1357 microversion: 2.57 time: 0.149637 Nov 01 19:10:22.607987 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-402cf97a-db1e-4c06-93b9-dea826bda75e tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:22.608470 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 2025/3955] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 19:10:22 2022] GET /compute/v2.1/servers/29b73e88-1e2a-45d8-bdbb-6c5f9399d270 => generated 1357 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 19:10:22.623674 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.wsgi [None req-402cf97a-db1e-4c06-93b9-dea826bda75e tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] HTTP exception thrown: Instance 990f3535-a5c4-4f62-bed9-b310a77293c8 could not be found. Nov 01 19:10:22.625446 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-402cf97a-db1e-4c06-93b9-dea826bda75e tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Request method failure captured: Nov 01 19:10:22.625446 n-d-863052-2 devstack@n-api.service[121402]: request: GET /compute/v2.1/servers/990f3535-a5c4-4f62-bed9-b310a77293c8 HTTP/1.1 Nov 01 19:10:22.625446 n-d-863052-2 devstack@n-api.service[121402]: Accept: application/json Nov 01 19:10:22.625446 n-d-863052-2 devstack@n-api.service[121402]: Accept-Encoding: identity Nov 01 19:10:22.625446 n-d-863052-2 devstack@n-api.service[121402]: Connection: close Nov 01 19:10:22.625446 n-d-863052-2 devstack@n-api.service[121402]: Content-Length: 0 Nov 01 19:10:22.625446 n-d-863052-2 devstack@n-api.service[121402]: Content-Type: application/json Nov 01 19:10:22.625446 n-d-863052-2 devstack@n-api.service[121402]: Host: 10.222.0.13 Nov 01 19:10:22.625446 n-d-863052-2 devstack@n-api.service[121402]: Openstack-System-Scope: None Nov 01 19:10:22.625446 n-d-863052-2 devstack@n-api.service[121402]: User-Agent: python-urllib3/1.26.12 Nov 01 19:10:22.625446 n-d-863052-2 devstack@n-api.service[121402]: X-Auth-Token: gAAAAABjYW3ByfBI9VCjWikZSFUz_hPClqqMancoCxnwBX6xqaMeeugycqMQyEPQybXqoeO46TFhJ9TITtoJFiSbS9Ry6pB9Kueb-hoVnQBV0e7qQWXwvcx4eB_AomP3ogOCXvqhfUnxVmmooBEoQbpvBIMsXQEjVVdPObNP8WS9oGjTsTTTO4o Nov 01 19:10:22.625446 n-d-863052-2 devstack@n-api.service[121402]: X-Domain-Id: None Nov 01 19:10:22.625446 n-d-863052-2 devstack@n-api.service[121402]: X-Domain-Name: None Nov 01 19:10:22.625446 n-d-863052-2 devstack@n-api.service[121402]: X-Identity-Status: Confirmed Nov 01 19:10:22.625446 n-d-863052-2 devstack@n-api.service[121402]: X-Is-Admin-Project: True Nov 01 19:10:22.625446 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Domain-Id: default Nov 01 19:10:22.625446 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Domain-Name: Default Nov 01 19:10:22.625446 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Id: 1ee9dc49b89143f781e4ab30296e4d01 Nov 01 19:10:22.625446 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Name: tempest-DeleteServersTestJSON-412339701 Nov 01 19:10:22.625446 n-d-863052-2 devstack@n-api.service[121402]: X-Role: member,reader Nov 01 19:10:22.625446 n-d-863052-2 devstack@n-api.service[121402]: X-Roles: member,reader Nov 01 19:10:22.625446 n-d-863052-2 devstack@n-api.service[121402]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/1ee9dc49b89143f781e4ab30296e4d01"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/1ee9dc49b89143f781e4ab30296e4d01"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_1ee9dc49b89143f781e4ab30296e4d01", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/1ee9dc49b89143f781e4ab30296e4d01"}]}] Nov 01 19:10:22.625446 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant: tempest-DeleteServersTestJSON-412339701 Nov 01 19:10:22.625446 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant-Id: 1ee9dc49b89143f781e4ab30296e4d01 Nov 01 19:10:22.625446 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant-Name: tempest-DeleteServersTestJSON-412339701 Nov 01 19:10:22.625446 n-d-863052-2 devstack@n-api.service[121402]: X-User: tempest-DeleteServersTestJSON-412339701-project Nov 01 19:10:22.625446 n-d-863052-2 devstack@n-api.service[121402]: X-User-Domain-Id: default Nov 01 19:10:22.625446 n-d-863052-2 devstack@n-api.service[121402]: X-User-Domain-Name: Default Nov 01 19:10:22.625446 n-d-863052-2 devstack@n-api.service[121402]: X-User-Id: 058480d92c9b4ab4af6815d0438a65c7 Nov 01 19:10:22.625446 n-d-863052-2 devstack@n-api.service[121402]: X-User-Name: tempest-DeleteServersTestJSON-412339701-project Nov 01 19:10:22.625446 n-d-863052-2 devstack@n-api.service[121402]: method: > Nov 01 19:10:22.625446 n-d-863052-2 devstack@n-api.service[121402]: exception: Instance 990f3535-a5c4-4f62-bed9-b310a77293c8 could not be found. Nov 01 19:10:22.625446 n-d-863052-2 devstack@n-api.service[121402]: action_args: {'id': '990f3535-a5c4-4f62-bed9-b310a77293c8'} Nov 01 19:10:22.625446 n-d-863052-2 devstack@n-api.service[121402]: {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 01 19:10:22.625446 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:10:22.625446 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 01 19:10:22.625446 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 01 19:10:22.625446 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 01 19:10:22.625446 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 01 19:10:22.625446 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 01 19:10:22.625446 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 01 19:10:22.625446 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 01 19:10:22.625446 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 01 19:10:22.625446 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 990f3535-a5c4-4f62-bed9-b310a77293c8 could not be found. Nov 01 19:10:22.625446 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:10:22.625446 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:10:22.625446 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:10:22.625446 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:10:22.625446 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:10:22.625446 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:10:22.625446 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 01 19:10:22.625446 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 01 19:10:22.625446 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 01 19:10:22.625446 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 01 19:10:22.625446 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 01 19:10:22.625446 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 01 19:10:22.625446 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 01 19:10:22.625446 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 01 19:10:22.625446 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 01 19:10:22.625446 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 01 19:10:22.625446 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 990f3535-a5c4-4f62-bed9-b310a77293c8 could not be found. Nov 01 19:10:22.625446 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:10:22.625446 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:10:22.625446 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:10:22.630858 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:10:22.630858 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:10:22.630858 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:10:22.630858 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 01 19:10:22.630858 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 01 19:10:22.630858 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 990f3535-a5c4-4f62-bed9-b310a77293c8 could not be found. Nov 01 19:10:22.630858 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:10:22.632702 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-402cf97a-db1e-4c06-93b9-dea826bda75e tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Returning 404 to user: Instance 990f3535-a5c4-4f62-bed9-b310a77293c8 could not be found. {{(pid=121402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 01 19:10:22.633758 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-402cf97a-db1e-4c06-93b9-dea826bda75e tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] 10.222.0.13 "GET /compute/v2.1/servers/990f3535-a5c4-4f62-bed9-b310a77293c8" status: 404 len: 111 microversion: 2.1 time: 0.043598 Nov 01 19:10:22.634806 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1931/3956] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:10:22 2022] GET /compute/v2.1/servers/990f3535-a5c4-4f62-bed9-b310a77293c8 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 01 19:10:22.642038 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-bf63caea-f225-4e20-8f0a-7414269a6bca tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] Action: 'action', calling method: >, body: {"rebuild": {"user_data": "ZWNobyAiaGVsbG8gd29ybGQi", "imageRef": "2d4a0047-1b9e-445f-8af8-1b5c9d93e881"}} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:10:22.646848 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-bf63caea-f225-4e20-8f0a-7414269a6bca tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] [instance: 29b73e88-1e2a-45d8-bdbb-6c5f9399d270] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:10:22.647431 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-c74a29b3-21ce-4c5c-b16d-ab32f58034a0 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:10:22.648148 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-c74a29b3-21ce-4c5c-b16d-ab32f58034a0 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] [instance: e760fc87-dcc8-47ae-8bf1-014248a1c1b4] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:10:22.654562 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-bf63caea-f225-4e20-8f0a-7414269a6bca tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:22.655130 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-bf63caea-f225-4e20-8f0a-7414269a6bca tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:22.655620 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-bf63caea-f225-4e20-8f0a-7414269a6bca tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:22.656431 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-bf63caea-f225-4e20-8f0a-7414269a6bca tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:22.657015 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-bf63caea-f225-4e20-8f0a-7414269a6bca tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:22.657534 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-bf63caea-f225-4e20-8f0a-7414269a6bca tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:22.662456 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-c74a29b3-21ce-4c5c-b16d-ab32f58034a0 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:22.663215 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-c74a29b3-21ce-4c5c-b16d-ab32f58034a0 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:22.663885 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-c74a29b3-21ce-4c5c-b16d-ab32f58034a0 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:22.664839 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-c74a29b3-21ce-4c5c-b16d-ab32f58034a0 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:22.665596 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-c74a29b3-21ce-4c5c-b16d-ab32f58034a0 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:22.666568 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-c74a29b3-21ce-4c5c-b16d-ab32f58034a0 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:22.683658 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.wsgi [None req-c74a29b3-21ce-4c5c-b16d-ab32f58034a0 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] HTTP exception thrown: Instance e760fc87-dcc8-47ae-8bf1-014248a1c1b4 could not be found. Nov 01 19:10:22.685754 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-c74a29b3-21ce-4c5c-b16d-ab32f58034a0 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Request method failure captured: Nov 01 19:10:22.685754 n-d-863052-2 devstack@n-api.service[121402]: request: DELETE /compute/v2.1/servers/e760fc87-dcc8-47ae-8bf1-014248a1c1b4 HTTP/1.1 Nov 01 19:10:22.685754 n-d-863052-2 devstack@n-api.service[121402]: Accept: application/json Nov 01 19:10:22.685754 n-d-863052-2 devstack@n-api.service[121402]: Accept-Encoding: identity Nov 01 19:10:22.685754 n-d-863052-2 devstack@n-api.service[121402]: Connection: close Nov 01 19:10:22.685754 n-d-863052-2 devstack@n-api.service[121402]: Content-Length: 0 Nov 01 19:10:22.685754 n-d-863052-2 devstack@n-api.service[121402]: Content-Type: application/json Nov 01 19:10:22.685754 n-d-863052-2 devstack@n-api.service[121402]: Host: 10.222.0.13 Nov 01 19:10:22.685754 n-d-863052-2 devstack@n-api.service[121402]: Openstack-System-Scope: None Nov 01 19:10:22.685754 n-d-863052-2 devstack@n-api.service[121402]: User-Agent: python-urllib3/1.26.12 Nov 01 19:10:22.685754 n-d-863052-2 devstack@n-api.service[121402]: X-Auth-Token: gAAAAABjYW3ByfBI9VCjWikZSFUz_hPClqqMancoCxnwBX6xqaMeeugycqMQyEPQybXqoeO46TFhJ9TITtoJFiSbS9Ry6pB9Kueb-hoVnQBV0e7qQWXwvcx4eB_AomP3ogOCXvqhfUnxVmmooBEoQbpvBIMsXQEjVVdPObNP8WS9oGjTsTTTO4o Nov 01 19:10:22.685754 n-d-863052-2 devstack@n-api.service[121402]: X-Domain-Id: None Nov 01 19:10:22.685754 n-d-863052-2 devstack@n-api.service[121402]: X-Domain-Name: None Nov 01 19:10:22.685754 n-d-863052-2 devstack@n-api.service[121402]: X-Identity-Status: Confirmed Nov 01 19:10:22.685754 n-d-863052-2 devstack@n-api.service[121402]: X-Is-Admin-Project: True Nov 01 19:10:22.685754 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Domain-Id: default Nov 01 19:10:22.685754 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Domain-Name: Default Nov 01 19:10:22.685754 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Id: 1ee9dc49b89143f781e4ab30296e4d01 Nov 01 19:10:22.685754 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Name: tempest-DeleteServersTestJSON-412339701 Nov 01 19:10:22.685754 n-d-863052-2 devstack@n-api.service[121402]: X-Role: member,reader Nov 01 19:10:22.685754 n-d-863052-2 devstack@n-api.service[121402]: X-Roles: member,reader Nov 01 19:10:22.685754 n-d-863052-2 devstack@n-api.service[121402]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/1ee9dc49b89143f781e4ab30296e4d01"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/1ee9dc49b89143f781e4ab30296e4d01"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_1ee9dc49b89143f781e4ab30296e4d01", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/1ee9dc49b89143f781e4ab30296e4d01"}]}] Nov 01 19:10:22.685754 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant: tempest-DeleteServersTestJSON-412339701 Nov 01 19:10:22.685754 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant-Id: 1ee9dc49b89143f781e4ab30296e4d01 Nov 01 19:10:22.685754 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant-Name: tempest-DeleteServersTestJSON-412339701 Nov 01 19:10:22.685754 n-d-863052-2 devstack@n-api.service[121402]: X-User: tempest-DeleteServersTestJSON-412339701-project Nov 01 19:10:22.685754 n-d-863052-2 devstack@n-api.service[121402]: X-User-Domain-Id: default Nov 01 19:10:22.685754 n-d-863052-2 devstack@n-api.service[121402]: X-User-Domain-Name: Default Nov 01 19:10:22.685754 n-d-863052-2 devstack@n-api.service[121402]: X-User-Id: 058480d92c9b4ab4af6815d0438a65c7 Nov 01 19:10:22.685754 n-d-863052-2 devstack@n-api.service[121402]: X-User-Name: tempest-DeleteServersTestJSON-412339701-project Nov 01 19:10:22.685754 n-d-863052-2 devstack@n-api.service[121402]: method: > Nov 01 19:10:22.685754 n-d-863052-2 devstack@n-api.service[121402]: exception: Instance e760fc87-dcc8-47ae-8bf1-014248a1c1b4 could not be found. Nov 01 19:10:22.685754 n-d-863052-2 devstack@n-api.service[121402]: action_args: {'id': 'e760fc87-dcc8-47ae-8bf1-014248a1c1b4'} Nov 01 19:10:22.685754 n-d-863052-2 devstack@n-api.service[121402]: {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 01 19:10:22.685754 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:10:22.685754 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 01 19:10:22.685754 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 01 19:10:22.685754 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 01 19:10:22.685754 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 01 19:10:22.685754 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 01 19:10:22.685754 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 01 19:10:22.685754 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 01 19:10:22.685754 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 01 19:10:22.685754 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e760fc87-dcc8-47ae-8bf1-014248a1c1b4 could not be found. Nov 01 19:10:22.685754 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:10:22.685754 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:10:22.685754 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:10:22.685754 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:10:22.685754 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:10:22.685754 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:10:22.685754 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 01 19:10:22.685754 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 01 19:10:22.685754 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 01 19:10:22.685754 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 01 19:10:22.685754 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 01 19:10:22.685754 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 01 19:10:22.685754 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 01 19:10:22.685754 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 01 19:10:22.685754 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 01 19:10:22.685754 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 01 19:10:22.685754 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 01 19:10:22.685754 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 01 19:10:22.691178 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e760fc87-dcc8-47ae-8bf1-014248a1c1b4 could not be found. Nov 01 19:10:22.691178 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:10:22.691178 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:10:22.691178 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:10:22.691178 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:10:22.691178 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:10:22.691178 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:10:22.691178 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 01 19:10:22.691178 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 01 19:10:22.691178 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e760fc87-dcc8-47ae-8bf1-014248a1c1b4 could not be found. Nov 01 19:10:22.691178 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:10:22.692495 n-d-863052-2 devstack@n-api.service[121403]: DEBUG dbcounter [-] [121403] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 19:10:22.693746 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-c74a29b3-21ce-4c5c-b16d-ab32f58034a0 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Returning 404 to user: Instance e760fc87-dcc8-47ae-8bf1-014248a1c1b4 could not be found. {{(pid=121402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 01 19:10:22.694872 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-c74a29b3-21ce-4c5c-b16d-ab32f58034a0 tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] 10.222.0.13 "DELETE /compute/v2.1/servers/e760fc87-dcc8-47ae-8bf1-014248a1c1b4" status: 404 len: 111 microversion: 2.1 time: 0.056311 Nov 01 19:10:22.696059 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1932/3957] 10.222.0.13 () {58 vars in 1239 bytes} [Tue Nov 1 19:10:22 2022] DELETE /compute/v2.1/servers/e760fc87-dcc8-47ae-8bf1-014248a1c1b4 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 01 19:10:22.705762 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-44f4cff6-61ed-47f7-8b76-96f7380494ab tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:10:22.707305 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-44f4cff6-61ed-47f7-8b76-96f7380494ab tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] [instance: e760fc87-dcc8-47ae-8bf1-014248a1c1b4] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:10:22.717619 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-44f4cff6-61ed-47f7-8b76-96f7380494ab tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:22.718990 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-44f4cff6-61ed-47f7-8b76-96f7380494ab tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:22.719647 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-44f4cff6-61ed-47f7-8b76-96f7380494ab tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:22.722228 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-44f4cff6-61ed-47f7-8b76-96f7380494ab tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:22.723101 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-44f4cff6-61ed-47f7-8b76-96f7380494ab tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:22.724384 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-44f4cff6-61ed-47f7-8b76-96f7380494ab tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:22.741089 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.wsgi [None req-44f4cff6-61ed-47f7-8b76-96f7380494ab tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] HTTP exception thrown: Instance e760fc87-dcc8-47ae-8bf1-014248a1c1b4 could not be found. Nov 01 19:10:22.743498 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-44f4cff6-61ed-47f7-8b76-96f7380494ab tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Request method failure captured: Nov 01 19:10:22.743498 n-d-863052-2 devstack@n-api.service[121402]: request: GET /compute/v2.1/servers/e760fc87-dcc8-47ae-8bf1-014248a1c1b4 HTTP/1.1 Nov 01 19:10:22.743498 n-d-863052-2 devstack@n-api.service[121402]: Accept: application/json Nov 01 19:10:22.743498 n-d-863052-2 devstack@n-api.service[121402]: Accept-Encoding: identity Nov 01 19:10:22.743498 n-d-863052-2 devstack@n-api.service[121402]: Connection: close Nov 01 19:10:22.743498 n-d-863052-2 devstack@n-api.service[121402]: Content-Length: 0 Nov 01 19:10:22.743498 n-d-863052-2 devstack@n-api.service[121402]: Content-Type: application/json Nov 01 19:10:22.743498 n-d-863052-2 devstack@n-api.service[121402]: Host: 10.222.0.13 Nov 01 19:10:22.743498 n-d-863052-2 devstack@n-api.service[121402]: Openstack-System-Scope: None Nov 01 19:10:22.743498 n-d-863052-2 devstack@n-api.service[121402]: User-Agent: python-urllib3/1.26.12 Nov 01 19:10:22.743498 n-d-863052-2 devstack@n-api.service[121402]: X-Auth-Token: gAAAAABjYW3ByfBI9VCjWikZSFUz_hPClqqMancoCxnwBX6xqaMeeugycqMQyEPQybXqoeO46TFhJ9TITtoJFiSbS9Ry6pB9Kueb-hoVnQBV0e7qQWXwvcx4eB_AomP3ogOCXvqhfUnxVmmooBEoQbpvBIMsXQEjVVdPObNP8WS9oGjTsTTTO4o Nov 01 19:10:22.743498 n-d-863052-2 devstack@n-api.service[121402]: X-Domain-Id: None Nov 01 19:10:22.743498 n-d-863052-2 devstack@n-api.service[121402]: X-Domain-Name: None Nov 01 19:10:22.743498 n-d-863052-2 devstack@n-api.service[121402]: X-Identity-Status: Confirmed Nov 01 19:10:22.743498 n-d-863052-2 devstack@n-api.service[121402]: X-Is-Admin-Project: True Nov 01 19:10:22.743498 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Domain-Id: default Nov 01 19:10:22.743498 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Domain-Name: Default Nov 01 19:10:22.743498 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Id: 1ee9dc49b89143f781e4ab30296e4d01 Nov 01 19:10:22.743498 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Name: tempest-DeleteServersTestJSON-412339701 Nov 01 19:10:22.743498 n-d-863052-2 devstack@n-api.service[121402]: X-Role: member,reader Nov 01 19:10:22.743498 n-d-863052-2 devstack@n-api.service[121402]: X-Roles: member,reader Nov 01 19:10:22.743498 n-d-863052-2 devstack@n-api.service[121402]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/1ee9dc49b89143f781e4ab30296e4d01"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/1ee9dc49b89143f781e4ab30296e4d01"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_1ee9dc49b89143f781e4ab30296e4d01", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/1ee9dc49b89143f781e4ab30296e4d01"}]}] Nov 01 19:10:22.743498 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant: tempest-DeleteServersTestJSON-412339701 Nov 01 19:10:22.743498 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant-Id: 1ee9dc49b89143f781e4ab30296e4d01 Nov 01 19:10:22.743498 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant-Name: tempest-DeleteServersTestJSON-412339701 Nov 01 19:10:22.743498 n-d-863052-2 devstack@n-api.service[121402]: X-User: tempest-DeleteServersTestJSON-412339701-project Nov 01 19:10:22.743498 n-d-863052-2 devstack@n-api.service[121402]: X-User-Domain-Id: default Nov 01 19:10:22.743498 n-d-863052-2 devstack@n-api.service[121402]: X-User-Domain-Name: Default Nov 01 19:10:22.743498 n-d-863052-2 devstack@n-api.service[121402]: X-User-Id: 058480d92c9b4ab4af6815d0438a65c7 Nov 01 19:10:22.743498 n-d-863052-2 devstack@n-api.service[121402]: X-User-Name: tempest-DeleteServersTestJSON-412339701-project Nov 01 19:10:22.743498 n-d-863052-2 devstack@n-api.service[121402]: method: > Nov 01 19:10:22.743498 n-d-863052-2 devstack@n-api.service[121402]: exception: Instance e760fc87-dcc8-47ae-8bf1-014248a1c1b4 could not be found. Nov 01 19:10:22.743498 n-d-863052-2 devstack@n-api.service[121402]: action_args: {'id': 'e760fc87-dcc8-47ae-8bf1-014248a1c1b4'} Nov 01 19:10:22.743498 n-d-863052-2 devstack@n-api.service[121402]: {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 01 19:10:22.743498 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:10:22.743498 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 01 19:10:22.743498 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 01 19:10:22.743498 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 01 19:10:22.743498 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 01 19:10:22.743498 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 01 19:10:22.743498 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 01 19:10:22.743498 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 01 19:10:22.743498 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 01 19:10:22.743498 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e760fc87-dcc8-47ae-8bf1-014248a1c1b4 could not be found. Nov 01 19:10:22.743498 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:10:22.743498 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:10:22.743498 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:10:22.743498 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:10:22.743498 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:10:22.743498 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:10:22.743498 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 01 19:10:22.743498 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 01 19:10:22.743498 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 01 19:10:22.743498 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 01 19:10:22.743498 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 01 19:10:22.743498 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 01 19:10:22.743498 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 01 19:10:22.743498 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 01 19:10:22.743498 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 01 19:10:22.743498 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 01 19:10:22.743498 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e760fc87-dcc8-47ae-8bf1-014248a1c1b4 could not be found. Nov 01 19:10:22.743498 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:10:22.743498 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:10:22.743498 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:10:22.748811 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:10:22.748811 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:10:22.748811 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:10:22.748811 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 01 19:10:22.748811 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 01 19:10:22.748811 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e760fc87-dcc8-47ae-8bf1-014248a1c1b4 could not be found. Nov 01 19:10:22.748811 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:10:22.750537 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-44f4cff6-61ed-47f7-8b76-96f7380494ab tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] Returning 404 to user: Instance e760fc87-dcc8-47ae-8bf1-014248a1c1b4 could not be found. {{(pid=121402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 01 19:10:22.751599 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-44f4cff6-61ed-47f7-8b76-96f7380494ab tempest-DeleteServersTestJSON-412339701 tempest-DeleteServersTestJSON-412339701-project] 10.222.0.13 "GET /compute/v2.1/servers/e760fc87-dcc8-47ae-8bf1-014248a1c1b4" status: 404 len: 111 microversion: 2.1 time: 0.050435 Nov 01 19:10:22.752742 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1933/3958] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:10:22 2022] GET /compute/v2.1/servers/e760fc87-dcc8-47ae-8bf1-014248a1c1b4 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 01 19:10:22.841949 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.virt.hardware [None req-bf63caea-f225-4e20-8f0a-7414269a6bca tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] Flavor limits 0:0:0 {{(pid=121403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 01 19:10:22.849652 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.virt.hardware [None req-bf63caea-f225-4e20-8f0a-7414269a6bca tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] Image limits 0:0:0 {{(pid=121403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 01 19:10:22.850178 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.virt.hardware [None req-bf63caea-f225-4e20-8f0a-7414269a6bca tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] Flavor pref 0:0:0 {{(pid=121403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 01 19:10:22.850605 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.virt.hardware [None req-bf63caea-f225-4e20-8f0a-7414269a6bca tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] Image pref 0:0:0 {{(pid=121403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 01 19:10:22.851033 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.virt.hardware [None req-bf63caea-f225-4e20-8f0a-7414269a6bca tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 01 19:10:22.910689 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-31e753cb-8bd5-47b3-b050-79f7f6da8702 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:10:22.911223 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-31e753cb-8bd5-47b3-b050-79f7f6da8702 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] [instance: ac19dd18-c22a-46de-91ef-454a0b78872f] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:10:22.926659 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-31e753cb-8bd5-47b3-b050-79f7f6da8702 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:22.941714 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-31e753cb-8bd5-47b3-b050-79f7f6da8702 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:22.947491 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-31e753cb-8bd5-47b3-b050-79f7f6da8702 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:22.948642 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-31e753cb-8bd5-47b3-b050-79f7f6da8702 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:22.949333 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-31e753cb-8bd5-47b3-b050-79f7f6da8702 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:22.954649 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-31e753cb-8bd5-47b3-b050-79f7f6da8702 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:23.041268 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-bf63caea-f225-4e20-8f0a-7414269a6bca tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] [instance: 29b73e88-1e2a-45d8-bdbb-6c5f9399d270] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:10:23.054812 n-d-863052-2 devstack@n-api.service[121403]: DEBUG dbcounter [-] [121403] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=121403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 19:10:23.060226 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-bf63caea-f225-4e20-8f0a-7414269a6bca tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:23.061421 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-bf63caea-f225-4e20-8f0a-7414269a6bca tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:23.072998 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-bf63caea-f225-4e20-8f0a-7414269a6bca tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:23.077900 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-bf63caea-f225-4e20-8f0a-7414269a6bca tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:23.082137 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-bf63caea-f225-4e20-8f0a-7414269a6bca tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:23.087883 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-bf63caea-f225-4e20-8f0a-7414269a6bca tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:23.220980 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-bf63caea-f225-4e20-8f0a-7414269a6bca tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] 10.222.0.13 "POST /compute/v2.1/servers/29b73e88-1e2a-45d8-bdbb-6c5f9399d270/action" status: 202 len: 1138 microversion: 2.57 time: 0.587672 Nov 01 19:10:23.222382 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 2026/3959] 10.222.0.13 () {62 vars in 1320 bytes} [Tue Nov 1 19:10:22 2022] POST /compute/v2.1/servers/29b73e88-1e2a-45d8-bdbb-6c5f9399d270/action => generated 1138 bytes in 589 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Nov 01 19:10:23.246564 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-5a113ba5-3a21-48e2-a3e4-4bbfe9a82bc3 tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:10:23.247551 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-5a113ba5-3a21-48e2-a3e4-4bbfe9a82bc3 tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] [instance: 29b73e88-1e2a-45d8-bdbb-6c5f9399d270] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:10:23.260704 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-5a113ba5-3a21-48e2-a3e4-4bbfe9a82bc3 tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:23.261444 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-5a113ba5-3a21-48e2-a3e4-4bbfe9a82bc3 tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:23.262059 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-5a113ba5-3a21-48e2-a3e4-4bbfe9a82bc3 tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:23.284941 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-5a113ba5-3a21-48e2-a3e4-4bbfe9a82bc3 tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:23.287766 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-5a113ba5-3a21-48e2-a3e4-4bbfe9a82bc3 tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:23.288344 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-5a113ba5-3a21-48e2-a3e4-4bbfe9a82bc3 tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:23.295109 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-31e753cb-8bd5-47b3-b050-79f7f6da8702 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2868ccfdfb164cffa37232c821f205a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04ef687c40bd45c297d22a791bae58cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:10:23.311855 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-31e753cb-8bd5-47b3-b050-79f7f6da8702 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] 10.222.0.13 "GET /compute/v2.1/servers/ac19dd18-c22a-46de-91ef-454a0b78872f" status: 200 len: 1523 microversion: 2.1 time: 0.409529 Nov 01 19:10:23.316178 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1934/3960] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:10:22 2022] GET /compute/v2.1/servers/ac19dd18-c22a-46de-91ef-454a0b78872f => generated 1523 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:10:23.337802 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-9134a7c7-31f8-44b2-92aa-9ac52c7e102a tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:10:23.339058 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-9134a7c7-31f8-44b2-92aa-9ac52c7e102a tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] [instance: af1071a8-a090-44c9-890c-123ca3ff39f1] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:10:23.347466 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-9134a7c7-31f8-44b2-92aa-9ac52c7e102a tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:23.348204 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-9134a7c7-31f8-44b2-92aa-9ac52c7e102a tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:23.348844 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-9134a7c7-31f8-44b2-92aa-9ac52c7e102a tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:23.349859 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-9134a7c7-31f8-44b2-92aa-9ac52c7e102a tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:23.350615 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-9134a7c7-31f8-44b2-92aa-9ac52c7e102a tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:23.351221 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-9134a7c7-31f8-44b2-92aa-9ac52c7e102a tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:23.523823 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-9134a7c7-31f8-44b2-92aa-9ac52c7e102a tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '301ed3b9c37449bc9ade378f3c73a768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8807757227574c828dca1947af76659d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:10:23.544353 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-9134a7c7-31f8-44b2-92aa-9ac52c7e102a tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '301ed3b9c37449bc9ade378f3c73a768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8807757227574c828dca1947af76659d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:10:23.546024 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-9134a7c7-31f8-44b2-92aa-9ac52c7e102a tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '301ed3b9c37449bc9ade378f3c73a768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8807757227574c828dca1947af76659d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:10:23.551406 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-5a113ba5-3a21-48e2-a3e4-4bbfe9a82bc3 tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3111dabbf6d14e2c91766f2f5544057c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c30003431656408bb328e90be22d009a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:10:23.555373 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-9134a7c7-31f8-44b2-92aa-9ac52c7e102a tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] 10.222.0.13 "GET /compute/v2.1/servers/af1071a8-a090-44c9-890c-123ca3ff39f1" status: 200 len: 1605 microversion: 2.42 time: 0.234725 Nov 01 19:10:23.558101 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1935/3961] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 19:10:23 2022] GET /compute/v2.1/servers/af1071a8-a090-44c9-890c-123ca3ff39f1 => generated 1605 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 19:10:23.576211 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-5a113ba5-3a21-48e2-a3e4-4bbfe9a82bc3 tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3111dabbf6d14e2c91766f2f5544057c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c30003431656408bb328e90be22d009a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:10:23.577892 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-5a113ba5-3a21-48e2-a3e4-4bbfe9a82bc3 tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3111dabbf6d14e2c91766f2f5544057c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c30003431656408bb328e90be22d009a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:10:23.579160 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-5a113ba5-3a21-48e2-a3e4-4bbfe9a82bc3 tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] 10.222.0.13 "GET /compute/v2.1/servers/29b73e88-1e2a-45d8-bdbb-6c5f9399d270" status: 200 len: 1366 microversion: 2.57 time: 0.337595 Nov 01 19:10:23.580209 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 2027/3962] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 19:10:23 2022] GET /compute/v2.1/servers/29b73e88-1e2a-45d8-bdbb-6c5f9399d270 => generated 1366 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 01 19:10:24.005287 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-fd3536cd-8cf7-43d0-a8af-2438872ea1b4 tempest-VolumesAdminNegativeTest-108400703 tempest-VolumesAdminNegativeTest-108400703-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "03db3da7-d328-49df-b4c8-b0a58a41e9fc"}} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:10:24.007716 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-fd3536cd-8cf7-43d0-a8af-2438872ea1b4 tempest-VolumesAdminNegativeTest-108400703 tempest-VolumesAdminNegativeTest-108400703-project-admin] [instance: 03d4513b-9e04-4924-8654-1de3748e333e] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:10:24.015596 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-fd3536cd-8cf7-43d0-a8af-2438872ea1b4 tempest-VolumesAdminNegativeTest-108400703 tempest-VolumesAdminNegativeTest-108400703-project-admin] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:24.016382 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-fd3536cd-8cf7-43d0-a8af-2438872ea1b4 tempest-VolumesAdminNegativeTest-108400703 tempest-VolumesAdminNegativeTest-108400703-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:24.017077 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-fd3536cd-8cf7-43d0-a8af-2438872ea1b4 tempest-VolumesAdminNegativeTest-108400703 tempest-VolumesAdminNegativeTest-108400703-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:24.018004 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-fd3536cd-8cf7-43d0-a8af-2438872ea1b4 tempest-VolumesAdminNegativeTest-108400703 tempest-VolumesAdminNegativeTest-108400703-project-admin] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:24.018753 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-fd3536cd-8cf7-43d0-a8af-2438872ea1b4 tempest-VolumesAdminNegativeTest-108400703 tempest-VolumesAdminNegativeTest-108400703-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:24.019365 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-fd3536cd-8cf7-43d0-a8af-2438872ea1b4 tempest-VolumesAdminNegativeTest-108400703 tempest-VolumesAdminNegativeTest-108400703-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:24.149960 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.wsgi [None req-fd3536cd-8cf7-43d0-a8af-2438872ea1b4 tempest-VolumesAdminNegativeTest-108400703 tempest-VolumesAdminNegativeTest-108400703-project-admin] HTTP exception thrown: Volume 03db3da7-d328-49df-b4c8-b0a58a41e9fc could not be found. Nov 01 19:10:24.152352 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-fd3536cd-8cf7-43d0-a8af-2438872ea1b4 tempest-VolumesAdminNegativeTest-108400703 tempest-VolumesAdminNegativeTest-108400703-project-admin] Request method failure captured: Nov 01 19:10:24.152352 n-d-863052-2 devstack@n-api.service[121402]: request: PUT /compute/v2.1/servers/03d4513b-9e04-4924-8654-1de3748e333e/os-volume_attachments/8ab9f6d8-0533-41ce-87cd-071f74fc9c15 HTTP/1.1 Nov 01 19:10:24.152352 n-d-863052-2 devstack@n-api.service[121402]: Accept: application/json Nov 01 19:10:24.152352 n-d-863052-2 devstack@n-api.service[121402]: Accept-Encoding: identity Nov 01 19:10:24.152352 n-d-863052-2 devstack@n-api.service[121402]: Connection: close Nov 01 19:10:24.152352 n-d-863052-2 devstack@n-api.service[121402]: Content-Length: 74 Nov 01 19:10:24.152352 n-d-863052-2 devstack@n-api.service[121402]: Content-Type: application/json Nov 01 19:10:24.152352 n-d-863052-2 devstack@n-api.service[121402]: Host: 10.222.0.13 Nov 01 19:10:24.152352 n-d-863052-2 devstack@n-api.service[121402]: Openstack-System-Scope: None Nov 01 19:10:24.152352 n-d-863052-2 devstack@n-api.service[121402]: User-Agent: python-urllib3/1.26.12 Nov 01 19:10:24.152352 n-d-863052-2 devstack@n-api.service[121402]: X-Auth-Token: gAAAAABjYW7QhjUFewFmSmqJe7Fkb0IhhbnzO3K4wDJfC5E6HUgTjk4WlRZB1hEuqagFVocXVGLFn4lkUKLoVL1nUTu3wZuQNAn8Kb0ca7pJuwuQV3PwxBXTL2M_Y5YZz9Be4HhoYvmbVZIh0PhDur0qdASEOhXbpyWnuWUjuiCIkxa0ZtVXUJQ Nov 01 19:10:24.152352 n-d-863052-2 devstack@n-api.service[121402]: X-Domain-Id: None Nov 01 19:10:24.152352 n-d-863052-2 devstack@n-api.service[121402]: X-Domain-Name: None Nov 01 19:10:24.152352 n-d-863052-2 devstack@n-api.service[121402]: X-Identity-Status: Confirmed Nov 01 19:10:24.152352 n-d-863052-2 devstack@n-api.service[121402]: X-Is-Admin-Project: True Nov 01 19:10:24.152352 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Domain-Id: default Nov 01 19:10:24.152352 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Domain-Name: Default Nov 01 19:10:24.152352 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Id: 1389a4dcef3245068303c4074a0e8cc7 Nov 01 19:10:24.152352 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Name: tempest-VolumesAdminNegativeTest-108400703 Nov 01 19:10:24.152352 n-d-863052-2 devstack@n-api.service[121402]: X-Role: admin,member,reader Nov 01 19:10:24.152352 n-d-863052-2 devstack@n-api.service[121402]: X-Roles: admin,member,reader Nov 01 19:10:24.152352 n-d-863052-2 devstack@n-api.service[121402]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/1389a4dcef3245068303c4074a0e8cc7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/1389a4dcef3245068303c4074a0e8cc7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_1389a4dcef3245068303c4074a0e8cc7", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/1389a4dcef3245068303c4074a0e8cc7"}]}] Nov 01 19:10:24.152352 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant: tempest-VolumesAdminNegativeTest-108400703 Nov 01 19:10:24.152352 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant-Id: 1389a4dcef3245068303c4074a0e8cc7 Nov 01 19:10:24.152352 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-108400703 Nov 01 19:10:24.152352 n-d-863052-2 devstack@n-api.service[121402]: X-User: tempest-VolumesAdminNegativeTest-108400703-project-admin Nov 01 19:10:24.152352 n-d-863052-2 devstack@n-api.service[121402]: X-User-Domain-Id: default Nov 01 19:10:24.152352 n-d-863052-2 devstack@n-api.service[121402]: X-User-Domain-Name: Default Nov 01 19:10:24.152352 n-d-863052-2 devstack@n-api.service[121402]: X-User-Id: b596913003ba4c00b6eabadfdf8cad12 Nov 01 19:10:24.152352 n-d-863052-2 devstack@n-api.service[121402]: X-User-Name: tempest-VolumesAdminNegativeTest-108400703-project-admin Nov 01 19:10:24.152352 n-d-863052-2 devstack@n-api.service[121402]: Nov 01 19:10:24.152352 n-d-863052-2 devstack@n-api.service[121402]: {"volumeAttachment": {"volumeId": "03db3da7-d328-49df-b4c8-b0a58a41e9fc"}} Nov 01 19:10:24.152352 n-d-863052-2 devstack@n-api.service[121402]: method: > Nov 01 19:10:24.152352 n-d-863052-2 devstack@n-api.service[121402]: exception: Volume 03db3da7-d328-49df-b4c8-b0a58a41e9fc could not be found. Nov 01 19:10:24.152352 n-d-863052-2 devstack@n-api.service[121402]: action_args: {'server_id': '03d4513b-9e04-4924-8654-1de3748e333e', 'id': '8ab9f6d8-0533-41ce-87cd-071f74fc9c15', 'body': {'volumeAttachment': {'volumeId': '03db3da7-d328-49df-b4c8-b0a58a41e9fc'}}} Nov 01 19:10:24.152352 n-d-863052-2 devstack@n-api.service[121402]: {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 01 19:10:24.152352 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:10:24.152352 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Nov 01 19:10:24.152352 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Nov 01 19:10:24.152352 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Nov 01 19:10:24.152352 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi item = cinderclient( Nov 01 19:10:24.152352 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Nov 01 19:10:24.152352 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Nov 01 19:10:24.152352 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Nov 01 19:10:24.152352 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Nov 01 19:10:24.152352 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Nov 01 19:10:24.152352 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Nov 01 19:10:24.152352 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Nov 01 19:10:24.152352 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Nov 01 19:10:24.152352 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Nov 01 19:10:24.152352 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Nov 01 19:10:24.152352 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 03db3da7-d328-49df-b4c8-b0a58a41e9fc could not be found. (HTTP 404) (Request-ID: req-f6e669e1-ad3a-4344-8876-04ea988a9591) Nov 01 19:10:24.152352 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:10:24.152352 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:10:24.152352 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:10:24.152352 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:10:24.152352 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 436, in _update_volume_swap Nov 01 19:10:24.152352 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi new_volume = self.volume_api.get(context, new_volume_id) Nov 01 19:10:24.152352 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Nov 01 19:10:24.152352 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Nov 01 19:10:24.152352 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Nov 01 19:10:24.157395 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Nov 01 19:10:24.157395 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Nov 01 19:10:24.157395 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Nov 01 19:10:24.157395 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Nov 01 19:10:24.157395 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Nov 01 19:10:24.157395 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Nov 01 19:10:24.157395 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi item = cinderclient( Nov 01 19:10:24.157395 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Nov 01 19:10:24.157395 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Nov 01 19:10:24.157395 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Nov 01 19:10:24.157395 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Nov 01 19:10:24.157395 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Nov 01 19:10:24.157395 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Nov 01 19:10:24.157395 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Nov 01 19:10:24.157395 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Nov 01 19:10:24.157395 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Nov 01 19:10:24.157395 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Nov 01 19:10:24.157395 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 03db3da7-d328-49df-b4c8-b0a58a41e9fc could not be found. Nov 01 19:10:24.157395 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:10:24.157395 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:10:24.157395 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:10:24.157395 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:10:24.157395 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:10:24.157395 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:10:24.157395 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 01 19:10:24.157395 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 01 19:10:24.157395 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 01 19:10:24.157395 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 01 19:10:24.157395 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 01 19:10:24.157395 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 01 19:10:24.157395 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 01 19:10:24.157395 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 01 19:10:24.157395 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Nov 01 19:10:24.157395 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Nov 01 19:10:24.157395 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 445, in _update_volume_swap Nov 01 19:10:24.157395 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Nov 01 19:10:24.157395 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Volume 03db3da7-d328-49df-b4c8-b0a58a41e9fc could not be found. Nov 01 19:10:24.157395 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:10:24.157395 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:10:24.157395 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:10:24.157395 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:10:24.157395 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:10:24.157395 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:10:24.157395 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 01 19:10:24.157395 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 01 19:10:24.157395 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 03db3da7-d328-49df-b4c8-b0a58a41e9fc could not be found. Nov 01 19:10:24.157395 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:10:24.164687 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-fd3536cd-8cf7-43d0-a8af-2438872ea1b4 tempest-VolumesAdminNegativeTest-108400703 tempest-VolumesAdminNegativeTest-108400703-project-admin] Returning 400 to user: Volume 03db3da7-d328-49df-b4c8-b0a58a41e9fc could not be found. {{(pid=121402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 01 19:10:24.164687 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-fd3536cd-8cf7-43d0-a8af-2438872ea1b4 tempest-VolumesAdminNegativeTest-108400703 tempest-VolumesAdminNegativeTest-108400703-project-admin] 10.222.0.13 "PUT /compute/v2.1/servers/03d4513b-9e04-4924-8654-1de3748e333e/os-volume_attachments/8ab9f6d8-0533-41ce-87cd-071f74fc9c15" status: 400 len: 107 microversion: 2.1 time: 0.552757 Nov 01 19:10:24.164687 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1936/3963] 10.222.0.13 () {60 vars in 1433 bytes} [Tue Nov 1 19:10:23 2022] PUT /compute/v2.1/servers/03d4513b-9e04-4924-8654-1de3748e333e/os-volume_attachments/8ab9f6d8-0533-41ce-87cd-071f74fc9c15 => generated 107 bytes in 554 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 01 19:10:24.246327 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-45c7b452-74d3-40cd-90b1-ea2d17f5c4db tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:10:24.247293 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-45c7b452-74d3-40cd-90b1-ea2d17f5c4db tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] [instance: 03d4513b-9e04-4924-8654-1de3748e333e] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:10:24.253661 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-45c7b452-74d3-40cd-90b1-ea2d17f5c4db tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:24.254139 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-45c7b452-74d3-40cd-90b1-ea2d17f5c4db tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:24.254742 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-45c7b452-74d3-40cd-90b1-ea2d17f5c4db tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:24.255626 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-45c7b452-74d3-40cd-90b1-ea2d17f5c4db tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:24.256363 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-45c7b452-74d3-40cd-90b1-ea2d17f5c4db tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:24.257052 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-45c7b452-74d3-40cd-90b1-ea2d17f5c4db tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:24.343068 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-d3906deb-0f45-4945-8cbe-2a53fdf3bff8 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:10:24.343762 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-d3906deb-0f45-4945-8cbe-2a53fdf3bff8 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] [instance: ac19dd18-c22a-46de-91ef-454a0b78872f] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:10:24.358637 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.objects.instance [None req-45c7b452-74d3-40cd-90b1-ea2d17f5c4db tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] Lazy-loading 'services' on Instance uuid 03d4513b-9e04-4924-8654-1de3748e333e {{(pid=121403) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 01 19:10:24.363617 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-d3906deb-0f45-4945-8cbe-2a53fdf3bff8 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:24.365551 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-d3906deb-0f45-4945-8cbe-2a53fdf3bff8 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:24.366299 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-d3906deb-0f45-4945-8cbe-2a53fdf3bff8 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:24.367180 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-d3906deb-0f45-4945-8cbe-2a53fdf3bff8 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:24.367800 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-d3906deb-0f45-4945-8cbe-2a53fdf3bff8 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:24.368387 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-d3906deb-0f45-4945-8cbe-2a53fdf3bff8 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:24.479679 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-45c7b452-74d3-40cd-90b1-ea2d17f5c4db tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] 10.222.0.13 "DELETE /compute/v2.1/servers/03d4513b-9e04-4924-8654-1de3748e333e/os-volume_attachments/8ab9f6d8-0533-41ce-87cd-071f74fc9c15" status: 202 len: 0 microversion: 2.1 time: 0.237257 Nov 01 19:10:24.480546 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 2028/3964] 10.222.0.13 () {58 vars in 1416 bytes} [Tue Nov 1 19:10:24 2022] DELETE /compute/v2.1/servers/03d4513b-9e04-4924-8654-1de3748e333e/os-volume_attachments/8ab9f6d8-0533-41ce-87cd-071f74fc9c15 => generated 0 bytes in 239 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 01 19:10:24.490186 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-793001b9-8d55-43b7-ba49-5377c7945fac tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:10:24.500119 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-793001b9-8d55-43b7-ba49-5377c7945fac tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] [instance: 03d4513b-9e04-4924-8654-1de3748e333e] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:10:24.514479 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-793001b9-8d55-43b7-ba49-5377c7945fac tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:24.514979 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-793001b9-8d55-43b7-ba49-5377c7945fac tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:24.515422 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-793001b9-8d55-43b7-ba49-5377c7945fac tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:24.516129 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-793001b9-8d55-43b7-ba49-5377c7945fac tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:24.516822 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-793001b9-8d55-43b7-ba49-5377c7945fac tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:24.517569 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-793001b9-8d55-43b7-ba49-5377c7945fac tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:24.566934 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-793001b9-8d55-43b7-ba49-5377c7945fac tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] 10.222.0.13 "GET /compute/v2.1/servers/03d4513b-9e04-4924-8654-1de3748e333e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.081539 Nov 01 19:10:24.567618 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 2029/3965] 10.222.0.13 () {58 vars in 1302 bytes} [Tue Nov 1 19:10:24 2022] GET /compute/v2.1/servers/03d4513b-9e04-4924-8654-1de3748e333e/os-volume_attachments => generated 197 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:10:24.608507 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-3631407c-134e-4112-bb17-884b541fd4df tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:10:24.609488 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-3631407c-134e-4112-bb17-884b541fd4df tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] [instance: af1071a8-a090-44c9-890c-123ca3ff39f1] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:10:24.620514 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-3631407c-134e-4112-bb17-884b541fd4df tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:24.621949 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-3631407c-134e-4112-bb17-884b541fd4df tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:24.622641 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-3631407c-134e-4112-bb17-884b541fd4df tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:24.623448 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-3631407c-134e-4112-bb17-884b541fd4df tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:24.623693 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-d3906deb-0f45-4945-8cbe-2a53fdf3bff8 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2868ccfdfb164cffa37232c821f205a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04ef687c40bd45c297d22a791bae58cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:10:24.624076 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-3631407c-134e-4112-bb17-884b541fd4df tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:24.624573 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-3631407c-134e-4112-bb17-884b541fd4df tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:24.634949 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-d3906deb-0f45-4945-8cbe-2a53fdf3bff8 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] 10.222.0.13 "GET /compute/v2.1/servers/ac19dd18-c22a-46de-91ef-454a0b78872f" status: 200 len: 1523 microversion: 2.1 time: 0.296127 Nov 01 19:10:24.636927 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1937/3966] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:10:24 2022] GET /compute/v2.1/servers/ac19dd18-c22a-46de-91ef-454a0b78872f => generated 1523 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 19:10:24.649007 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-8278b47a-0795-4e4e-bfc6-d2f754da7533 tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:10:24.653580 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-8278b47a-0795-4e4e-bfc6-d2f754da7533 tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] [instance: 29b73e88-1e2a-45d8-bdbb-6c5f9399d270] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:10:24.667062 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-8278b47a-0795-4e4e-bfc6-d2f754da7533 tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:24.667739 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-8278b47a-0795-4e4e-bfc6-d2f754da7533 tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:24.668499 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-8278b47a-0795-4e4e-bfc6-d2f754da7533 tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:24.669601 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-8278b47a-0795-4e4e-bfc6-d2f754da7533 tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:24.670404 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-8278b47a-0795-4e4e-bfc6-d2f754da7533 tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:24.670833 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-8278b47a-0795-4e4e-bfc6-d2f754da7533 tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:24.756555 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-8278b47a-0795-4e4e-bfc6-d2f754da7533 tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3111dabbf6d14e2c91766f2f5544057c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c30003431656408bb328e90be22d009a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:10:24.763037 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-3631407c-134e-4112-bb17-884b541fd4df tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '301ed3b9c37449bc9ade378f3c73a768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8807757227574c828dca1947af76659d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:10:24.789775 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-8278b47a-0795-4e4e-bfc6-d2f754da7533 tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3111dabbf6d14e2c91766f2f5544057c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c30003431656408bb328e90be22d009a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:10:24.793894 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-8278b47a-0795-4e4e-bfc6-d2f754da7533 tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3111dabbf6d14e2c91766f2f5544057c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c30003431656408bb328e90be22d009a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:10:24.795211 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-3631407c-134e-4112-bb17-884b541fd4df tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '301ed3b9c37449bc9ade378f3c73a768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8807757227574c828dca1947af76659d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:10:24.795598 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-8278b47a-0795-4e4e-bfc6-d2f754da7533 tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] 10.222.0.13 "GET /compute/v2.1/servers/29b73e88-1e2a-45d8-bdbb-6c5f9399d270" status: 200 len: 1366 microversion: 2.57 time: 0.156649 Nov 01 19:10:24.796510 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1938/3967] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 19:10:24 2022] GET /compute/v2.1/servers/29b73e88-1e2a-45d8-bdbb-6c5f9399d270 => generated 1366 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 19:10:24.799051 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-3631407c-134e-4112-bb17-884b541fd4df tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '301ed3b9c37449bc9ade378f3c73a768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8807757227574c828dca1947af76659d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:10:24.800397 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-3631407c-134e-4112-bb17-884b541fd4df tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] 10.222.0.13 "GET /compute/v2.1/servers/af1071a8-a090-44c9-890c-123ca3ff39f1" status: 200 len: 1605 microversion: 2.42 time: 0.196626 Nov 01 19:10:24.813383 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 2030/3968] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 19:10:24 2022] GET /compute/v2.1/servers/af1071a8-a090-44c9-890c-123ca3ff39f1 => generated 1605 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 19:10:25.584075 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-310cb8bb-4194-461d-8c69-7a7beaba709d tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:10:25.590909 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-310cb8bb-4194-461d-8c69-7a7beaba709d tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] [instance: 03d4513b-9e04-4924-8654-1de3748e333e] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:10:25.609285 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-310cb8bb-4194-461d-8c69-7a7beaba709d tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:25.610057 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-310cb8bb-4194-461d-8c69-7a7beaba709d tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:25.610580 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-310cb8bb-4194-461d-8c69-7a7beaba709d tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:25.611377 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-310cb8bb-4194-461d-8c69-7a7beaba709d tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:25.618436 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-310cb8bb-4194-461d-8c69-7a7beaba709d tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:25.619245 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-310cb8bb-4194-461d-8c69-7a7beaba709d tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:25.662901 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-b90c5fd1-e402-4c21-aab7-c607023ff5d2 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:10:25.663640 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-b90c5fd1-e402-4c21-aab7-c607023ff5d2 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] [instance: ac19dd18-c22a-46de-91ef-454a0b78872f] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:10:25.676313 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-b90c5fd1-e402-4c21-aab7-c607023ff5d2 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:25.678230 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-b90c5fd1-e402-4c21-aab7-c607023ff5d2 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:25.679406 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-b90c5fd1-e402-4c21-aab7-c607023ff5d2 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:25.688260 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-b90c5fd1-e402-4c21-aab7-c607023ff5d2 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:25.699038 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-b90c5fd1-e402-4c21-aab7-c607023ff5d2 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:25.699612 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-310cb8bb-4194-461d-8c69-7a7beaba709d tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] 10.222.0.13 "GET /compute/v2.1/servers/03d4513b-9e04-4924-8654-1de3748e333e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.121195 Nov 01 19:10:25.699809 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-b90c5fd1-e402-4c21-aab7-c607023ff5d2 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:25.705100 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1939/3969] 10.222.0.13 () {58 vars in 1302 bytes} [Tue Nov 1 19:10:25 2022] GET /compute/v2.1/servers/03d4513b-9e04-4924-8654-1de3748e333e/os-volume_attachments => generated 197 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:10:25.831363 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-83795b35-cd79-4131-b19c-5179771c7e9b tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:10:25.832228 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-83795b35-cd79-4131-b19c-5179771c7e9b tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] [instance: 29b73e88-1e2a-45d8-bdbb-6c5f9399d270] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:10:25.848110 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-83795b35-cd79-4131-b19c-5179771c7e9b tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:25.849016 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-83795b35-cd79-4131-b19c-5179771c7e9b tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:25.850852 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-83795b35-cd79-4131-b19c-5179771c7e9b tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:25.852519 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-83795b35-cd79-4131-b19c-5179771c7e9b tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:25.856844 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-83795b35-cd79-4131-b19c-5179771c7e9b tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:25.857857 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-83795b35-cd79-4131-b19c-5179771c7e9b tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:26.020216 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-b90c5fd1-e402-4c21-aab7-c607023ff5d2 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2868ccfdfb164cffa37232c821f205a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04ef687c40bd45c297d22a791bae58cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:10:26.034914 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-b90c5fd1-e402-4c21-aab7-c607023ff5d2 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] 10.222.0.13 "GET /compute/v2.1/servers/ac19dd18-c22a-46de-91ef-454a0b78872f" status: 200 len: 1523 microversion: 2.1 time: 0.376130 Nov 01 19:10:26.035944 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 2031/3970] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:10:25 2022] GET /compute/v2.1/servers/ac19dd18-c22a-46de-91ef-454a0b78872f => generated 1523 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:10:26.041086 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-c1537281-ce3b-44b7-ba49-abb07963298d tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:10:26.053641 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-c1537281-ce3b-44b7-ba49-abb07963298d tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] [instance: af1071a8-a090-44c9-890c-123ca3ff39f1] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:10:26.060339 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-c1537281-ce3b-44b7-ba49-abb07963298d tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:26.061471 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-c1537281-ce3b-44b7-ba49-abb07963298d tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:26.062163 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-c1537281-ce3b-44b7-ba49-abb07963298d tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:26.064427 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-c1537281-ce3b-44b7-ba49-abb07963298d tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:26.065676 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-c1537281-ce3b-44b7-ba49-abb07963298d tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:26.066343 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-c1537281-ce3b-44b7-ba49-abb07963298d tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:26.067277 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-83795b35-cd79-4131-b19c-5179771c7e9b tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3111dabbf6d14e2c91766f2f5544057c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c30003431656408bb328e90be22d009a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:10:26.084840 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-83795b35-cd79-4131-b19c-5179771c7e9b tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3111dabbf6d14e2c91766f2f5544057c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c30003431656408bb328e90be22d009a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:10:26.088205 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-83795b35-cd79-4131-b19c-5179771c7e9b tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3111dabbf6d14e2c91766f2f5544057c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c30003431656408bb328e90be22d009a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:10:26.092449 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-83795b35-cd79-4131-b19c-5179771c7e9b tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] 10.222.0.13 "GET /compute/v2.1/servers/29b73e88-1e2a-45d8-bdbb-6c5f9399d270" status: 200 len: 1366 microversion: 2.57 time: 0.270557 Nov 01 19:10:26.096755 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1940/3971] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 19:10:25 2022] GET /compute/v2.1/servers/29b73e88-1e2a-45d8-bdbb-6c5f9399d270 => generated 1366 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 19:10:26.191564 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-c1537281-ce3b-44b7-ba49-abb07963298d tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '301ed3b9c37449bc9ade378f3c73a768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8807757227574c828dca1947af76659d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:10:26.202941 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-c1537281-ce3b-44b7-ba49-abb07963298d tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '301ed3b9c37449bc9ade378f3c73a768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8807757227574c828dca1947af76659d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:10:26.207044 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-c1537281-ce3b-44b7-ba49-abb07963298d tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '301ed3b9c37449bc9ade378f3c73a768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8807757227574c828dca1947af76659d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:10:26.214336 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-c1537281-ce3b-44b7-ba49-abb07963298d tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] 10.222.0.13 "GET /compute/v2.1/servers/af1071a8-a090-44c9-890c-123ca3ff39f1" status: 200 len: 1605 microversion: 2.42 time: 0.176630 Nov 01 19:10:26.215407 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 2032/3972] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 19:10:26 2022] GET /compute/v2.1/servers/af1071a8-a090-44c9-890c-123ca3ff39f1 => generated 1605 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 19:10:26.712388 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-c767ec54-01ca-43a1-97f3-7179ce3e9477 tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:10:26.714821 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-c767ec54-01ca-43a1-97f3-7179ce3e9477 tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] [instance: 03d4513b-9e04-4924-8654-1de3748e333e] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:10:26.728466 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-c767ec54-01ca-43a1-97f3-7179ce3e9477 tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:26.729247 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-c767ec54-01ca-43a1-97f3-7179ce3e9477 tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:26.729803 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-c767ec54-01ca-43a1-97f3-7179ce3e9477 tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:26.730619 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-c767ec54-01ca-43a1-97f3-7179ce3e9477 tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:26.731190 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-c767ec54-01ca-43a1-97f3-7179ce3e9477 tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:26.734307 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-c767ec54-01ca-43a1-97f3-7179ce3e9477 tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:26.789108 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-c767ec54-01ca-43a1-97f3-7179ce3e9477 tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] 10.222.0.13 "GET /compute/v2.1/servers/03d4513b-9e04-4924-8654-1de3748e333e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.080643 Nov 01 19:10:26.789710 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1941/3973] 10.222.0.13 () {58 vars in 1302 bytes} [Tue Nov 1 19:10:26 2022] GET /compute/v2.1/servers/03d4513b-9e04-4924-8654-1de3748e333e/os-volume_attachments => generated 197 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 01 19:10:27.057410 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-250958a5-cc39-49f9-8144-bdb02a81f9a0 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:10:27.058810 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-250958a5-cc39-49f9-8144-bdb02a81f9a0 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] [instance: ac19dd18-c22a-46de-91ef-454a0b78872f] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:10:27.066549 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-250958a5-cc39-49f9-8144-bdb02a81f9a0 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:27.067101 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-250958a5-cc39-49f9-8144-bdb02a81f9a0 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:27.067496 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-250958a5-cc39-49f9-8144-bdb02a81f9a0 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:27.068204 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-250958a5-cc39-49f9-8144-bdb02a81f9a0 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:27.068703 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-250958a5-cc39-49f9-8144-bdb02a81f9a0 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:27.069136 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-250958a5-cc39-49f9-8144-bdb02a81f9a0 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:27.122258 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-f6eb704b-3504-4841-b1a8-826f04feffb7 tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:10:27.123025 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-f6eb704b-3504-4841-b1a8-826f04feffb7 tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] [instance: 29b73e88-1e2a-45d8-bdbb-6c5f9399d270] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:10:27.129825 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f6eb704b-3504-4841-b1a8-826f04feffb7 tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:27.130784 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f6eb704b-3504-4841-b1a8-826f04feffb7 tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:27.131607 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f6eb704b-3504-4841-b1a8-826f04feffb7 tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:27.132611 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f6eb704b-3504-4841-b1a8-826f04feffb7 tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:27.133357 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f6eb704b-3504-4841-b1a8-826f04feffb7 tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:27.134010 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f6eb704b-3504-4841-b1a8-826f04feffb7 tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:27.165934 n-d-863052-2 devstack@n-api.service[121403]: DEBUG dbcounter [-] [121403] Writing DB stats nova_cell0:SELECT=2 {{(pid=121403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 19:10:27.166893 n-d-863052-2 devstack@n-api.service[121402]: DEBUG dbcounter [-] [121402] Writing DB stats nova_cell1:SELECT=100 {{(pid=121402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 19:10:27.233757 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-f6eb704b-3504-4841-b1a8-826f04feffb7 tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3111dabbf6d14e2c91766f2f5544057c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c30003431656408bb328e90be22d009a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:10:27.249480 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-f6eb704b-3504-4841-b1a8-826f04feffb7 tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3111dabbf6d14e2c91766f2f5544057c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c30003431656408bb328e90be22d009a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:10:27.251464 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-f6eb704b-3504-4841-b1a8-826f04feffb7 tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3111dabbf6d14e2c91766f2f5544057c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c30003431656408bb328e90be22d009a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:10:27.253824 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-f6eb704b-3504-4841-b1a8-826f04feffb7 tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] 10.222.0.13 "GET /compute/v2.1/servers/29b73e88-1e2a-45d8-bdbb-6c5f9399d270" status: 200 len: 1366 microversion: 2.57 time: 0.135314 Nov 01 19:10:27.254006 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1942/3974] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 19:10:27 2022] GET /compute/v2.1/servers/29b73e88-1e2a-45d8-bdbb-6c5f9399d270 => generated 1366 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 01 19:10:27.287159 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-3a983f18-a7d2-4495-8a2c-5b89897c1215 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:10:27.291147 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-3a983f18-a7d2-4495-8a2c-5b89897c1215 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] [instance: af1071a8-a090-44c9-890c-123ca3ff39f1] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:10:27.297313 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-3a983f18-a7d2-4495-8a2c-5b89897c1215 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:27.298157 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-3a983f18-a7d2-4495-8a2c-5b89897c1215 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:27.299275 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-3a983f18-a7d2-4495-8a2c-5b89897c1215 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:27.300633 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-3a983f18-a7d2-4495-8a2c-5b89897c1215 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:27.301313 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-3a983f18-a7d2-4495-8a2c-5b89897c1215 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:27.302232 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-3a983f18-a7d2-4495-8a2c-5b89897c1215 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:27.404982 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-3a983f18-a7d2-4495-8a2c-5b89897c1215 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '301ed3b9c37449bc9ade378f3c73a768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8807757227574c828dca1947af76659d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:10:27.419810 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-3a983f18-a7d2-4495-8a2c-5b89897c1215 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '301ed3b9c37449bc9ade378f3c73a768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8807757227574c828dca1947af76659d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:10:27.421318 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-3a983f18-a7d2-4495-8a2c-5b89897c1215 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '301ed3b9c37449bc9ade378f3c73a768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8807757227574c828dca1947af76659d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:10:27.426472 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-3a983f18-a7d2-4495-8a2c-5b89897c1215 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] 10.222.0.13 "GET /compute/v2.1/servers/af1071a8-a090-44c9-890c-123ca3ff39f1" status: 200 len: 1605 microversion: 2.42 time: 0.154743 Nov 01 19:10:27.427090 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1943/3975] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 19:10:27 2022] GET /compute/v2.1/servers/af1071a8-a090-44c9-890c-123ca3ff39f1 => generated 1605 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 19:10:27.546257 n-d-863052-2 devstack@n-api.service[121403]: DEBUG dbcounter [-] [121403] Writing DB stats nova_cell0:SELECT=8 {{(pid=121403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 19:10:27.625584 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-72447ca1-3b63-4425-b0ca-b698e403f8f9 tempest-PortsAdminExtendedAttrsIpV6TestJSON-775406244 tempest-PortsAdminExtendedAttrsIpV6TestJSON-775406244-project-admin] Calling method '.version_select at 0x7f0ae19725e0>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:10:27.628233 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-72447ca1-3b63-4425-b0ca-b698e403f8f9 tempest-PortsAdminExtendedAttrsIpV6TestJSON-775406244 tempest-PortsAdminExtendedAttrsIpV6TestJSON-775406244-project-admin] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:27.628773 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-72447ca1-3b63-4425-b0ca-b698e403f8f9 tempest-PortsAdminExtendedAttrsIpV6TestJSON-775406244 tempest-PortsAdminExtendedAttrsIpV6TestJSON-775406244-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:27.629223 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-72447ca1-3b63-4425-b0ca-b698e403f8f9 tempest-PortsAdminExtendedAttrsIpV6TestJSON-775406244 tempest-PortsAdminExtendedAttrsIpV6TestJSON-775406244-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:27.648050 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-72447ca1-3b63-4425-b0ca-b698e403f8f9 tempest-PortsAdminExtendedAttrsIpV6TestJSON-775406244 tempest-PortsAdminExtendedAttrsIpV6TestJSON-775406244-project-admin] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:27.648555 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-72447ca1-3b63-4425-b0ca-b698e403f8f9 tempest-PortsAdminExtendedAttrsIpV6TestJSON-775406244 tempest-PortsAdminExtendedAttrsIpV6TestJSON-775406244-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:27.649023 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-72447ca1-3b63-4425-b0ca-b698e403f8f9 tempest-PortsAdminExtendedAttrsIpV6TestJSON-775406244 tempest-PortsAdminExtendedAttrsIpV6TestJSON-775406244-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:27.662145 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-72447ca1-3b63-4425-b0ca-b698e403f8f9 tempest-PortsAdminExtendedAttrsIpV6TestJSON-775406244 tempest-PortsAdminExtendedAttrsIpV6TestJSON-775406244-project-admin] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:27.662652 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-72447ca1-3b63-4425-b0ca-b698e403f8f9 tempest-PortsAdminExtendedAttrsIpV6TestJSON-775406244 tempest-PortsAdminExtendedAttrsIpV6TestJSON-775406244-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:27.663097 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-72447ca1-3b63-4425-b0ca-b698e403f8f9 tempest-PortsAdminExtendedAttrsIpV6TestJSON-775406244 tempest-PortsAdminExtendedAttrsIpV6TestJSON-775406244-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:27.669909 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-72447ca1-3b63-4425-b0ca-b698e403f8f9 tempest-PortsAdminExtendedAttrsIpV6TestJSON-775406244 tempest-PortsAdminExtendedAttrsIpV6TestJSON-775406244-project-admin] 10.222.0.13 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.241738 Nov 01 19:10:27.670827 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1944/3976] 10.222.0.13 () {58 vars in 1146 bytes} [Tue Nov 1 19:10:27 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:10:27.712095 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-250958a5-cc39-49f9-8144-bdb02a81f9a0 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2868ccfdfb164cffa37232c821f205a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04ef687c40bd45c297d22a791bae58cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:10:27.721652 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-250958a5-cc39-49f9-8144-bdb02a81f9a0 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] 10.222.0.13 "GET /compute/v2.1/servers/ac19dd18-c22a-46de-91ef-454a0b78872f" status: 200 len: 1500 microversion: 2.1 time: 0.668001 Nov 01 19:10:27.722910 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 2033/3977] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:10:27 2022] GET /compute/v2.1/servers/ac19dd18-c22a-46de-91ef-454a0b78872f => generated 1500 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:10:27.744077 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-c1009b89-4d69-402c-9ed2-b8a653a9f6e0 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:10:27.749141 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-c1009b89-4d69-402c-9ed2-b8a653a9f6e0 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '2868ccfdfb164cffa37232c821f205a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04ef687c40bd45c297d22a791bae58cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:10:27.750082 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-c1009b89-4d69-402c-9ed2-b8a653a9f6e0 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Searching by: {'vm_state': ['stopped'], 'deleted': False, 'project_id': '04ef687c40bd45c297d22a791bae58cf'} {{(pid=121402) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 01 19:10:27.757329 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-c1009b89-4d69-402c-9ed2-b8a653a9f6e0 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:27.757991 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-c1009b89-4d69-402c-9ed2-b8a653a9f6e0 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:27.758648 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-c1009b89-4d69-402c-9ed2-b8a653a9f6e0 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:27.759599 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-c1009b89-4d69-402c-9ed2-b8a653a9f6e0 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:27.760241 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-c1009b89-4d69-402c-9ed2-b8a653a9f6e0 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:27.760972 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-c1009b89-4d69-402c-9ed2-b8a653a9f6e0 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:27.792952 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.multi_cell_list [None req-c1009b89-4d69-402c-9ed2-b8a653a9f6e0 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=121402) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 01 19:10:27.803243 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-31787eb1-bff7-4791-9a41-4f92a2b3a676 tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:10:27.806452 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-31787eb1-bff7-4791-9a41-4f92a2b3a676 tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] [instance: 03d4513b-9e04-4924-8654-1de3748e333e] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:10:27.819688 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-31787eb1-bff7-4791-9a41-4f92a2b3a676 tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:27.822076 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-31787eb1-bff7-4791-9a41-4f92a2b3a676 tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:27.822992 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-31787eb1-bff7-4791-9a41-4f92a2b3a676 tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:27.824869 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-31787eb1-bff7-4791-9a41-4f92a2b3a676 tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:27.825604 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-31787eb1-bff7-4791-9a41-4f92a2b3a676 tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:27.826818 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-31787eb1-bff7-4791-9a41-4f92a2b3a676 tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:27.838326 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-c1009b89-4d69-402c-9ed2-b8a653a9f6e0 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] 10.222.0.13 "GET /compute/v2.1/servers?status=shutoff" status: 200 len: 346 microversion: 2.1 time: 0.097976 Nov 01 19:10:27.841104 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1945/3978] 10.222.0.13 () {58 vars in 1154 bytes} [Tue Nov 1 19:10:27 2022] GET /compute/v2.1/servers?status=shutoff => generated 346 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:10:27.862154 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-6318237c-6edc-416f-adf9-36f7543d1893 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:10:27.877155 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-6318237c-6edc-416f-adf9-36f7543d1893 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:27.878232 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-6318237c-6edc-416f-adf9-36f7543d1893 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:27.880881 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-6318237c-6edc-416f-adf9-36f7543d1893 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:27.909025 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-31787eb1-bff7-4791-9a41-4f92a2b3a676 tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] 10.222.0.13 "GET /compute/v2.1/servers/03d4513b-9e04-4924-8654-1de3748e333e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.108841 Nov 01 19:10:27.910242 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 2034/3979] 10.222.0.13 () {58 vars in 1302 bytes} [Tue Nov 1 19:10:27 2022] GET /compute/v2.1/servers/03d4513b-9e04-4924-8654-1de3748e333e/os-volume_attachments => generated 197 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:10:27.920122 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-6318237c-6edc-416f-adf9-36f7543d1893 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] [instance: ac19dd18-c22a-46de-91ef-454a0b78872f] Going to try to start instance {{(pid=121402) start /opt/stack/nova/nova/compute/api.py:2785}} Nov 01 19:10:27.983800 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-6318237c-6edc-416f-adf9-36f7543d1893 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] 10.222.0.13 "POST /compute/v2.1/servers/ac19dd18-c22a-46de-91ef-454a0b78872f/action" status: 202 len: 0 microversion: 2.1 time: 0.133992 Nov 01 19:10:27.988222 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1946/3980] 10.222.0.13 () {60 vars in 1278 bytes} [Tue Nov 1 19:10:27 2022] POST /compute/v2.1/servers/ac19dd18-c22a-46de-91ef-454a0b78872f/action => generated 0 bytes in 136 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 01 19:10:27.993623 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-96ea87aa-ed26-4ec6-a0a7-15a7c7b346e4 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:10:27.994363 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-96ea87aa-ed26-4ec6-a0a7-15a7c7b346e4 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] [instance: ac19dd18-c22a-46de-91ef-454a0b78872f] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:10:28.005249 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-96ea87aa-ed26-4ec6-a0a7-15a7c7b346e4 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:28.005852 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-96ea87aa-ed26-4ec6-a0a7-15a7c7b346e4 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:28.006237 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-96ea87aa-ed26-4ec6-a0a7-15a7c7b346e4 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:28.006947 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-96ea87aa-ed26-4ec6-a0a7-15a7c7b346e4 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:28.007298 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-96ea87aa-ed26-4ec6-a0a7-15a7c7b346e4 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:28.007766 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-96ea87aa-ed26-4ec6-a0a7-15a7c7b346e4 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:28.291008 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-2fbc7eb8-ae4a-420c-ad32-5466ad97dc47 tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:10:28.292432 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-2fbc7eb8-ae4a-420c-ad32-5466ad97dc47 tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] [instance: 29b73e88-1e2a-45d8-bdbb-6c5f9399d270] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:10:28.303567 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2fbc7eb8-ae4a-420c-ad32-5466ad97dc47 tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:28.304038 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2fbc7eb8-ae4a-420c-ad32-5466ad97dc47 tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:28.304483 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2fbc7eb8-ae4a-420c-ad32-5466ad97dc47 tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:28.305221 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2fbc7eb8-ae4a-420c-ad32-5466ad97dc47 tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:28.305734 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2fbc7eb8-ae4a-420c-ad32-5466ad97dc47 tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:28.306167 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2fbc7eb8-ae4a-420c-ad32-5466ad97dc47 tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:28.367285 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-96ea87aa-ed26-4ec6-a0a7-15a7c7b346e4 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2868ccfdfb164cffa37232c821f205a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04ef687c40bd45c297d22a791bae58cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:10:28.377275 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-96ea87aa-ed26-4ec6-a0a7-15a7c7b346e4 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] 10.222.0.13 "GET /compute/v2.1/servers/ac19dd18-c22a-46de-91ef-454a0b78872f" status: 200 len: 1509 microversion: 2.1 time: 0.387554 Nov 01 19:10:28.379053 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 2035/3981] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:10:27 2022] GET /compute/v2.1/servers/ac19dd18-c22a-46de-91ef-454a0b78872f => generated 1509 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:10:28.405722 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-2fbc7eb8-ae4a-420c-ad32-5466ad97dc47 tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3111dabbf6d14e2c91766f2f5544057c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c30003431656408bb328e90be22d009a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:10:28.417661 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-2fbc7eb8-ae4a-420c-ad32-5466ad97dc47 tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3111dabbf6d14e2c91766f2f5544057c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c30003431656408bb328e90be22d009a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:10:28.420243 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-2fbc7eb8-ae4a-420c-ad32-5466ad97dc47 tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3111dabbf6d14e2c91766f2f5544057c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c30003431656408bb328e90be22d009a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:10:28.422073 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-2fbc7eb8-ae4a-420c-ad32-5466ad97dc47 tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] 10.222.0.13 "GET /compute/v2.1/servers/29b73e88-1e2a-45d8-bdbb-6c5f9399d270" status: 200 len: 1366 microversion: 2.57 time: 0.141138 Nov 01 19:10:28.439000 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1947/3982] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 19:10:28 2022] GET /compute/v2.1/servers/29b73e88-1e2a-45d8-bdbb-6c5f9399d270 => generated 1366 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 19:10:28.453758 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-7332b7b1-fc44-44dd-a9bd-46dfbb11aa9a tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:10:28.455011 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-7332b7b1-fc44-44dd-a9bd-46dfbb11aa9a tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] [instance: af1071a8-a090-44c9-890c-123ca3ff39f1] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:10:28.465656 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-7332b7b1-fc44-44dd-a9bd-46dfbb11aa9a tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:28.466650 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-7332b7b1-fc44-44dd-a9bd-46dfbb11aa9a tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:28.469630 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-7332b7b1-fc44-44dd-a9bd-46dfbb11aa9a tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:28.470262 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-7332b7b1-fc44-44dd-a9bd-46dfbb11aa9a tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:28.470930 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-7332b7b1-fc44-44dd-a9bd-46dfbb11aa9a tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:28.471889 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-7332b7b1-fc44-44dd-a9bd-46dfbb11aa9a tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:28.597904 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-7332b7b1-fc44-44dd-a9bd-46dfbb11aa9a tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '301ed3b9c37449bc9ade378f3c73a768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8807757227574c828dca1947af76659d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:10:28.618439 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-7332b7b1-fc44-44dd-a9bd-46dfbb11aa9a tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '301ed3b9c37449bc9ade378f3c73a768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8807757227574c828dca1947af76659d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:10:28.620237 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-7332b7b1-fc44-44dd-a9bd-46dfbb11aa9a tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '301ed3b9c37449bc9ade378f3c73a768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8807757227574c828dca1947af76659d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:10:28.621736 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-7332b7b1-fc44-44dd-a9bd-46dfbb11aa9a tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] 10.222.0.13 "GET /compute/v2.1/servers/af1071a8-a090-44c9-890c-123ca3ff39f1" status: 200 len: 1605 microversion: 2.42 time: 0.172427 Nov 01 19:10:28.622513 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 2036/3983] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 19:10:28 2022] GET /compute/v2.1/servers/af1071a8-a090-44c9-890c-123ca3ff39f1 => generated 1605 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 19:10:28.922025 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-71d6cd3f-f2a2-4787-bd3a-cd3ead964066 tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:10:28.924957 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-71d6cd3f-f2a2-4787-bd3a-cd3ead964066 tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] [instance: 03d4513b-9e04-4924-8654-1de3748e333e] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:10:28.933652 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-71d6cd3f-f2a2-4787-bd3a-cd3ead964066 tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:28.935255 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-71d6cd3f-f2a2-4787-bd3a-cd3ead964066 tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:28.936694 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-71d6cd3f-f2a2-4787-bd3a-cd3ead964066 tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:28.937711 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-71d6cd3f-f2a2-4787-bd3a-cd3ead964066 tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:28.938676 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-71d6cd3f-f2a2-4787-bd3a-cd3ead964066 tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:28.941006 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-71d6cd3f-f2a2-4787-bd3a-cd3ead964066 tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:28.988043 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-71d6cd3f-f2a2-4787-bd3a-cd3ead964066 tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] 10.222.0.13 "GET /compute/v2.1/servers/03d4513b-9e04-4924-8654-1de3748e333e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.069260 Nov 01 19:10:28.989908 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1948/3984] 10.222.0.13 () {58 vars in 1302 bytes} [Tue Nov 1 19:10:28 2022] GET /compute/v2.1/servers/03d4513b-9e04-4924-8654-1de3748e333e/os-volume_attachments => generated 197 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:10:29.402702 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-b0406417-6c2c-4ef0-8eb8-5f3faccf662c tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:10:29.403322 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-b0406417-6c2c-4ef0-8eb8-5f3faccf662c tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] [instance: ac19dd18-c22a-46de-91ef-454a0b78872f] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:10:29.413917 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-b0406417-6c2c-4ef0-8eb8-5f3faccf662c tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:29.414565 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-b0406417-6c2c-4ef0-8eb8-5f3faccf662c tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:29.415943 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-b0406417-6c2c-4ef0-8eb8-5f3faccf662c tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:29.417954 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-b0406417-6c2c-4ef0-8eb8-5f3faccf662c tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:29.418641 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-b0406417-6c2c-4ef0-8eb8-5f3faccf662c tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:29.419274 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-b0406417-6c2c-4ef0-8eb8-5f3faccf662c tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:29.450462 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-93837f07-c7ba-4477-b2f6-e08550b5a6d4 tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:10:29.461709 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-93837f07-c7ba-4477-b2f6-e08550b5a6d4 tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] [instance: 29b73e88-1e2a-45d8-bdbb-6c5f9399d270] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:10:29.478593 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-93837f07-c7ba-4477-b2f6-e08550b5a6d4 tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:29.481597 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-93837f07-c7ba-4477-b2f6-e08550b5a6d4 tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:29.482329 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-93837f07-c7ba-4477-b2f6-e08550b5a6d4 tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:29.486201 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-93837f07-c7ba-4477-b2f6-e08550b5a6d4 tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:29.492155 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-93837f07-c7ba-4477-b2f6-e08550b5a6d4 tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:29.493257 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-93837f07-c7ba-4477-b2f6-e08550b5a6d4 tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:29.598982 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-93837f07-c7ba-4477-b2f6-e08550b5a6d4 tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3111dabbf6d14e2c91766f2f5544057c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c30003431656408bb328e90be22d009a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:10:29.609264 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-93837f07-c7ba-4477-b2f6-e08550b5a6d4 tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3111dabbf6d14e2c91766f2f5544057c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c30003431656408bb328e90be22d009a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:10:29.611431 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-93837f07-c7ba-4477-b2f6-e08550b5a6d4 tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3111dabbf6d14e2c91766f2f5544057c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c30003431656408bb328e90be22d009a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:10:29.612853 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-93837f07-c7ba-4477-b2f6-e08550b5a6d4 tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] 10.222.0.13 "GET /compute/v2.1/servers/29b73e88-1e2a-45d8-bdbb-6c5f9399d270" status: 200 len: 1366 microversion: 2.57 time: 0.166366 Nov 01 19:10:29.613926 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1949/3985] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 19:10:29 2022] GET /compute/v2.1/servers/29b73e88-1e2a-45d8-bdbb-6c5f9399d270 => generated 1366 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 19:10:29.653123 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-c61cc790-f52d-4f72-a99a-6ff9b31eec17 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:10:29.653822 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-c61cc790-f52d-4f72-a99a-6ff9b31eec17 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] [instance: af1071a8-a090-44c9-890c-123ca3ff39f1] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:10:29.661726 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-c61cc790-f52d-4f72-a99a-6ff9b31eec17 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:29.662562 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-c61cc790-f52d-4f72-a99a-6ff9b31eec17 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:29.663103 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-c61cc790-f52d-4f72-a99a-6ff9b31eec17 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:29.664138 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-c61cc790-f52d-4f72-a99a-6ff9b31eec17 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:29.664823 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-c61cc790-f52d-4f72-a99a-6ff9b31eec17 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:29.665461 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-c61cc790-f52d-4f72-a99a-6ff9b31eec17 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:29.754921 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-c61cc790-f52d-4f72-a99a-6ff9b31eec17 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '301ed3b9c37449bc9ade378f3c73a768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8807757227574c828dca1947af76659d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:10:29.770123 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-c61cc790-f52d-4f72-a99a-6ff9b31eec17 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '301ed3b9c37449bc9ade378f3c73a768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8807757227574c828dca1947af76659d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:10:29.771754 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-c61cc790-f52d-4f72-a99a-6ff9b31eec17 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '301ed3b9c37449bc9ade378f3c73a768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8807757227574c828dca1947af76659d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:10:29.773365 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-c61cc790-f52d-4f72-a99a-6ff9b31eec17 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] 10.222.0.13 "GET /compute/v2.1/servers/af1071a8-a090-44c9-890c-123ca3ff39f1" status: 200 len: 1605 microversion: 2.42 time: 0.124759 Nov 01 19:10:29.785576 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1950/3986] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 19:10:29 2022] GET /compute/v2.1/servers/af1071a8-a090-44c9-890c-123ca3ff39f1 => generated 1605 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 01 19:10:29.822402 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-b0406417-6c2c-4ef0-8eb8-5f3faccf662c tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2868ccfdfb164cffa37232c821f205a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04ef687c40bd45c297d22a791bae58cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:10:29.832030 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-b0406417-6c2c-4ef0-8eb8-5f3faccf662c tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] 10.222.0.13 "GET /compute/v2.1/servers/ac19dd18-c22a-46de-91ef-454a0b78872f" status: 200 len: 1509 microversion: 2.1 time: 0.433390 Nov 01 19:10:29.832635 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 2037/3987] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:10:29 2022] GET /compute/v2.1/servers/ac19dd18-c22a-46de-91ef-454a0b78872f => generated 1509 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:10:30.002195 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-de51eb55-2394-4f8e-a36b-e1c8603f2e1d tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:10:30.006000 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-de51eb55-2394-4f8e-a36b-e1c8603f2e1d tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] [instance: 03d4513b-9e04-4924-8654-1de3748e333e] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:10:30.018244 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-de51eb55-2394-4f8e-a36b-e1c8603f2e1d tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:30.026567 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-de51eb55-2394-4f8e-a36b-e1c8603f2e1d tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:30.027335 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-de51eb55-2394-4f8e-a36b-e1c8603f2e1d tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:30.028093 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-de51eb55-2394-4f8e-a36b-e1c8603f2e1d tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:30.028564 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-de51eb55-2394-4f8e-a36b-e1c8603f2e1d tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:30.029051 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-de51eb55-2394-4f8e-a36b-e1c8603f2e1d tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:30.101236 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-de51eb55-2394-4f8e-a36b-e1c8603f2e1d tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] 10.222.0.13 "GET /compute/v2.1/servers/03d4513b-9e04-4924-8654-1de3748e333e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.103522 Nov 01 19:10:30.102183 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1951/3988] 10.222.0.13 () {58 vars in 1302 bytes} [Tue Nov 1 19:10:29 2022] GET /compute/v2.1/servers/03d4513b-9e04-4924-8654-1de3748e333e/os-volume_attachments => generated 197 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:10:30.644163 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-aacff07e-bb47-495e-80d7-530c22eaae3d tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:10:30.644811 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-aacff07e-bb47-495e-80d7-530c22eaae3d tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] [instance: 29b73e88-1e2a-45d8-bdbb-6c5f9399d270] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:10:30.656302 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-aacff07e-bb47-495e-80d7-530c22eaae3d tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:30.658663 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-aacff07e-bb47-495e-80d7-530c22eaae3d tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:30.659821 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-aacff07e-bb47-495e-80d7-530c22eaae3d tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:30.662464 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-aacff07e-bb47-495e-80d7-530c22eaae3d tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:30.663131 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-aacff07e-bb47-495e-80d7-530c22eaae3d tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:30.663571 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-aacff07e-bb47-495e-80d7-530c22eaae3d tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:30.787269 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-aacff07e-bb47-495e-80d7-530c22eaae3d tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3111dabbf6d14e2c91766f2f5544057c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c30003431656408bb328e90be22d009a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:10:30.796120 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-aacff07e-bb47-495e-80d7-530c22eaae3d tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3111dabbf6d14e2c91766f2f5544057c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c30003431656408bb328e90be22d009a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:10:30.797707 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-aacff07e-bb47-495e-80d7-530c22eaae3d tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3111dabbf6d14e2c91766f2f5544057c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c30003431656408bb328e90be22d009a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:10:30.798979 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-aacff07e-bb47-495e-80d7-530c22eaae3d tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] 10.222.0.13 "GET /compute/v2.1/servers/29b73e88-1e2a-45d8-bdbb-6c5f9399d270" status: 200 len: 1366 microversion: 2.57 time: 0.158908 Nov 01 19:10:30.800635 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 2038/3989] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 19:10:30 2022] GET /compute/v2.1/servers/29b73e88-1e2a-45d8-bdbb-6c5f9399d270 => generated 1366 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 19:10:30.804844 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-abf6f32e-9e87-4adc-ade8-9608d145e174 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:10:30.805711 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-abf6f32e-9e87-4adc-ade8-9608d145e174 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] [instance: af1071a8-a090-44c9-890c-123ca3ff39f1] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:10:30.812313 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-abf6f32e-9e87-4adc-ade8-9608d145e174 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:30.813304 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-abf6f32e-9e87-4adc-ade8-9608d145e174 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:30.814309 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-abf6f32e-9e87-4adc-ade8-9608d145e174 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:30.816026 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-abf6f32e-9e87-4adc-ade8-9608d145e174 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:30.817568 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-abf6f32e-9e87-4adc-ade8-9608d145e174 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:30.818594 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-abf6f32e-9e87-4adc-ade8-9608d145e174 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:30.859363 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-743b05f3-e527-4334-a8b2-939d6a927778 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:10:30.859976 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-743b05f3-e527-4334-a8b2-939d6a927778 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] [instance: ac19dd18-c22a-46de-91ef-454a0b78872f] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:10:30.870861 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-743b05f3-e527-4334-a8b2-939d6a927778 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:30.873143 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-743b05f3-e527-4334-a8b2-939d6a927778 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:30.873872 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-743b05f3-e527-4334-a8b2-939d6a927778 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:30.874768 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-743b05f3-e527-4334-a8b2-939d6a927778 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:30.875450 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-743b05f3-e527-4334-a8b2-939d6a927778 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:30.876054 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-743b05f3-e527-4334-a8b2-939d6a927778 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:30.905300 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-abf6f32e-9e87-4adc-ade8-9608d145e174 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '301ed3b9c37449bc9ade378f3c73a768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8807757227574c828dca1947af76659d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:10:30.915829 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-abf6f32e-9e87-4adc-ade8-9608d145e174 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '301ed3b9c37449bc9ade378f3c73a768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8807757227574c828dca1947af76659d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:10:30.917599 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-abf6f32e-9e87-4adc-ade8-9608d145e174 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '301ed3b9c37449bc9ade378f3c73a768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8807757227574c828dca1947af76659d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:10:30.919038 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-abf6f32e-9e87-4adc-ade8-9608d145e174 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] 10.222.0.13 "GET /compute/v2.1/servers/af1071a8-a090-44c9-890c-123ca3ff39f1" status: 200 len: 1605 microversion: 2.42 time: 0.121619 Nov 01 19:10:30.920214 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1952/3990] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 19:10:30 2022] GET /compute/v2.1/servers/af1071a8-a090-44c9-890c-123ca3ff39f1 => generated 1605 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 19:10:31.115402 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-fcc8d69c-72f0-4999-9561-86d58b521a3c tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:10:31.118212 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-fcc8d69c-72f0-4999-9561-86d58b521a3c tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] [instance: 03d4513b-9e04-4924-8654-1de3748e333e] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:10:31.127364 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-fcc8d69c-72f0-4999-9561-86d58b521a3c tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:31.128493 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-fcc8d69c-72f0-4999-9561-86d58b521a3c tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:31.129002 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-fcc8d69c-72f0-4999-9561-86d58b521a3c tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:31.130019 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-fcc8d69c-72f0-4999-9561-86d58b521a3c tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:31.130741 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-fcc8d69c-72f0-4999-9561-86d58b521a3c tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:31.131289 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-fcc8d69c-72f0-4999-9561-86d58b521a3c tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:31.169645 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-fcc8d69c-72f0-4999-9561-86d58b521a3c tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] 10.222.0.13 "GET /compute/v2.1/servers/03d4513b-9e04-4924-8654-1de3748e333e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059039 Nov 01 19:10:31.170625 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1953/3991] 10.222.0.13 () {58 vars in 1302 bytes} [Tue Nov 1 19:10:31 2022] GET /compute/v2.1/servers/03d4513b-9e04-4924-8654-1de3748e333e/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 01 19:10:31.183056 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-743b05f3-e527-4334-a8b2-939d6a927778 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2868ccfdfb164cffa37232c821f205a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04ef687c40bd45c297d22a791bae58cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:10:31.191710 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-743b05f3-e527-4334-a8b2-939d6a927778 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] 10.222.0.13 "GET /compute/v2.1/servers/ac19dd18-c22a-46de-91ef-454a0b78872f" status: 200 len: 1513 microversion: 2.1 time: 0.336154 Nov 01 19:10:31.192421 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 2039/3992] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:10:30 2022] GET /compute/v2.1/servers/ac19dd18-c22a-46de-91ef-454a0b78872f => generated 1513 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:10:31.219986 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-26f2f508-a71a-42b0-b1be-a763540ede7a tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:10:31.226192 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-26f2f508-a71a-42b0-b1be-a763540ede7a tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '2868ccfdfb164cffa37232c821f205a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04ef687c40bd45c297d22a791bae58cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:10:31.226642 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.compute.servers [None req-26f2f508-a71a-42b0-b1be-a763540ede7a tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Removing options 'limit' from query {{(pid=121402) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Nov 01 19:10:31.227479 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-26f2f508-a71a-42b0-b1be-a763540ede7a tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Searching by: {'deleted': False, 'project_id': '04ef687c40bd45c297d22a791bae58cf'} {{(pid=121402) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 01 19:10:31.228859 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-26f2f508-a71a-42b0-b1be-a763540ede7a tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:31.229474 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-26f2f508-a71a-42b0-b1be-a763540ede7a tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:31.230117 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-26f2f508-a71a-42b0-b1be-a763540ede7a tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:31.230987 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-26f2f508-a71a-42b0-b1be-a763540ede7a tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:31.231365 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-26f2f508-a71a-42b0-b1be-a763540ede7a tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:31.231740 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-26f2f508-a71a-42b0-b1be-a763540ede7a tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:31.233232 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-26f2f508-a71a-42b0-b1be-a763540ede7a tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] 10.222.0.13 "GET /compute/v2.1/servers?limit=0" status: 200 len: 15 microversion: 2.1 time: 0.018197 Nov 01 19:10:31.233974 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1954/3993] 10.222.0.13 () {58 vars in 1140 bytes} [Tue Nov 1 19:10:31 2022] GET /compute/v2.1/servers?limit=0 => generated 15 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 01 19:10:31.247719 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-3748c926-331e-4a18-a65f-b8db6b09b6f1 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:10:31.249271 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-3748c926-331e-4a18-a65f-b8db6b09b6f1 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] [instance: ac19dd18-c22a-46de-91ef-454a0b78872f] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:10:31.256235 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-3748c926-331e-4a18-a65f-b8db6b09b6f1 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:31.256898 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-3748c926-331e-4a18-a65f-b8db6b09b6f1 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:31.257529 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-3748c926-331e-4a18-a65f-b8db6b09b6f1 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:31.258434 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-3748c926-331e-4a18-a65f-b8db6b09b6f1 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:31.262019 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-3748c926-331e-4a18-a65f-b8db6b09b6f1 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:31.262019 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-3748c926-331e-4a18-a65f-b8db6b09b6f1 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:31.266744 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-f637dce2-c06a-4476-8078-f42132a1d421 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:10:31.267475 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-f637dce2-c06a-4476-8078-f42132a1d421 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] [instance: eced579f-beea-4d3c-b2b8-8a6b31f7829b] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:10:31.276104 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f637dce2-c06a-4476-8078-f42132a1d421 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:31.276862 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f637dce2-c06a-4476-8078-f42132a1d421 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:31.277539 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f637dce2-c06a-4476-8078-f42132a1d421 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:31.292416 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f637dce2-c06a-4476-8078-f42132a1d421 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:31.295439 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f637dce2-c06a-4476-8078-f42132a1d421 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:31.295898 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f637dce2-c06a-4476-8078-f42132a1d421 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:31.300266 n-d-863052-2 devstack@n-api.service[121403]: DEBUG dbcounter [-] [121403] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=121403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 19:10:31.335244 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-f637dce2-c06a-4476-8078-f42132a1d421 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] 10.222.0.13 "GET /compute/v2.1/servers/eced579f-beea-4d3c-b2b8-8a6b31f7829b/ips" status: 200 len: 149 microversion: 2.1 time: 0.072800 Nov 01 19:10:31.343294 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1955/3994] 10.222.0.13 () {58 vars in 1248 bytes} [Tue Nov 1 19:10:31 2022] GET /compute/v2.1/servers/eced579f-beea-4d3c-b2b8-8a6b31f7829b/ips => generated 149 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:10:31.589908 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-3748c926-331e-4a18-a65f-b8db6b09b6f1 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2868ccfdfb164cffa37232c821f205a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04ef687c40bd45c297d22a791bae58cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:10:31.601058 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-3748c926-331e-4a18-a65f-b8db6b09b6f1 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] 10.222.0.13 "GET /compute/v2.1/servers/ac19dd18-c22a-46de-91ef-454a0b78872f" status: 200 len: 1513 microversion: 2.1 time: 0.358343 Nov 01 19:10:31.603068 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 2040/3995] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:10:31 2022] GET /compute/v2.1/servers/ac19dd18-c22a-46de-91ef-454a0b78872f => generated 1513 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 19:10:31.625733 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-b457c231-a4c1-4f5e-92b5-e83df632b67c tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:10:31.627019 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-b457c231-a4c1-4f5e-92b5-e83df632b67c tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] [instance: 33dd79e0-eb7c-4f18-a61f-df8022667dd0] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:10:31.659392 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b457c231-a4c1-4f5e-92b5-e83df632b67c tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:31.660366 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b457c231-a4c1-4f5e-92b5-e83df632b67c tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:31.661014 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b457c231-a4c1-4f5e-92b5-e83df632b67c tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:31.662891 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b457c231-a4c1-4f5e-92b5-e83df632b67c tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:31.665235 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b457c231-a4c1-4f5e-92b5-e83df632b67c tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:31.666721 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b457c231-a4c1-4f5e-92b5-e83df632b67c tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:31.829637 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-89baae4d-b6c9-4836-98dd-6c6ea5093522 tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:10:31.830928 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-89baae4d-b6c9-4836-98dd-6c6ea5093522 tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] [instance: 29b73e88-1e2a-45d8-bdbb-6c5f9399d270] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:10:31.840428 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-89baae4d-b6c9-4836-98dd-6c6ea5093522 tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:31.841038 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-89baae4d-b6c9-4836-98dd-6c6ea5093522 tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:31.842568 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-89baae4d-b6c9-4836-98dd-6c6ea5093522 tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:31.843739 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-89baae4d-b6c9-4836-98dd-6c6ea5093522 tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:31.844658 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-89baae4d-b6c9-4836-98dd-6c6ea5093522 tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:31.845340 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-89baae4d-b6c9-4836-98dd-6c6ea5093522 tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:31.953922 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-89baae4d-b6c9-4836-98dd-6c6ea5093522 tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3111dabbf6d14e2c91766f2f5544057c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c30003431656408bb328e90be22d009a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:10:31.968348 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-89baae4d-b6c9-4836-98dd-6c6ea5093522 tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3111dabbf6d14e2c91766f2f5544057c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c30003431656408bb328e90be22d009a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:10:31.970077 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-89baae4d-b6c9-4836-98dd-6c6ea5093522 tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3111dabbf6d14e2c91766f2f5544057c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c30003431656408bb328e90be22d009a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:10:31.971537 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-89baae4d-b6c9-4836-98dd-6c6ea5093522 tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] 10.222.0.13 "GET /compute/v2.1/servers/29b73e88-1e2a-45d8-bdbb-6c5f9399d270" status: 200 len: 1366 microversion: 2.57 time: 0.148367 Nov 01 19:10:31.972389 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 2041/3996] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 19:10:31 2022] GET /compute/v2.1/servers/29b73e88-1e2a-45d8-bdbb-6c5f9399d270 => generated 1366 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 19:10:31.989154 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-b457c231-a4c1-4f5e-92b5-e83df632b67c tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2868ccfdfb164cffa37232c821f205a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04ef687c40bd45c297d22a791bae58cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:10:31.991670 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-b457c231-a4c1-4f5e-92b5-e83df632b67c tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] 10.222.0.13 "GET /compute/v2.1/servers/33dd79e0-eb7c-4f18-a61f-df8022667dd0" status: 200 len: 1512 microversion: 2.1 time: 0.367302 Nov 01 19:10:32.003212 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-9fdaf044-ab93-4bb3-84ed-9fca4b1de9c9 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:10:32.010483 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1956/3997] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:10:31 2022] GET /compute/v2.1/servers/33dd79e0-eb7c-4f18-a61f-df8022667dd0 => generated 1512 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:10:32.011816 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-9fdaf044-ab93-4bb3-84ed-9fca4b1de9c9 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] [instance: af1071a8-a090-44c9-890c-123ca3ff39f1] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:10:32.018328 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-2c8d832b-e71f-4df4-a1f2-0aa0423a23fb tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:10:32.018975 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-2c8d832b-e71f-4df4-a1f2-0aa0423a23fb tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] [instance: 42415fcc-ac00-4854-bc88-0416ef12d8cb] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:10:32.025873 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-9fdaf044-ab93-4bb3-84ed-9fca4b1de9c9 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:32.026750 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-9fdaf044-ab93-4bb3-84ed-9fca4b1de9c9 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:32.027286 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-9fdaf044-ab93-4bb3-84ed-9fca4b1de9c9 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:32.028055 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-9fdaf044-ab93-4bb3-84ed-9fca4b1de9c9 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:32.028852 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-9fdaf044-ab93-4bb3-84ed-9fca4b1de9c9 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:32.032978 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2c8d832b-e71f-4df4-a1f2-0aa0423a23fb tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:32.035622 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2c8d832b-e71f-4df4-a1f2-0aa0423a23fb tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:32.039036 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2c8d832b-e71f-4df4-a1f2-0aa0423a23fb tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:32.039954 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2c8d832b-e71f-4df4-a1f2-0aa0423a23fb tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:32.040610 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2c8d832b-e71f-4df4-a1f2-0aa0423a23fb tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:32.041237 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2c8d832b-e71f-4df4-a1f2-0aa0423a23fb tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:32.044258 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-9fdaf044-ab93-4bb3-84ed-9fca4b1de9c9 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:32.155713 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-9fdaf044-ab93-4bb3-84ed-9fca4b1de9c9 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '301ed3b9c37449bc9ade378f3c73a768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8807757227574c828dca1947af76659d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:10:32.169490 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-9fdaf044-ab93-4bb3-84ed-9fca4b1de9c9 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '301ed3b9c37449bc9ade378f3c73a768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8807757227574c828dca1947af76659d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:10:32.171178 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-9fdaf044-ab93-4bb3-84ed-9fca4b1de9c9 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '301ed3b9c37449bc9ade378f3c73a768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8807757227574c828dca1947af76659d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:10:32.172822 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-9fdaf044-ab93-4bb3-84ed-9fca4b1de9c9 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] 10.222.0.13 "GET /compute/v2.1/servers/af1071a8-a090-44c9-890c-123ca3ff39f1" status: 200 len: 1605 microversion: 2.42 time: 0.180872 Nov 01 19:10:32.175782 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 2042/3998] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 19:10:31 2022] GET /compute/v2.1/servers/af1071a8-a090-44c9-890c-123ca3ff39f1 => generated 1605 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 19:10:32.198262 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-9c0768c0-5575-4eff-a7dc-7d323fdd23cd tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:10:32.200950 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-9c0768c0-5575-4eff-a7dc-7d323fdd23cd tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] [instance: 03d4513b-9e04-4924-8654-1de3748e333e] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:10:32.209887 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-9c0768c0-5575-4eff-a7dc-7d323fdd23cd tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:32.210558 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-9c0768c0-5575-4eff-a7dc-7d323fdd23cd tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:32.211139 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-9c0768c0-5575-4eff-a7dc-7d323fdd23cd tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:32.212013 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-9c0768c0-5575-4eff-a7dc-7d323fdd23cd tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:32.212826 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-9c0768c0-5575-4eff-a7dc-7d323fdd23cd tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:32.213564 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-9c0768c0-5575-4eff-a7dc-7d323fdd23cd tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:32.252616 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-9c0768c0-5575-4eff-a7dc-7d323fdd23cd tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] 10.222.0.13 "GET /compute/v2.1/servers/03d4513b-9e04-4924-8654-1de3748e333e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.060647 Nov 01 19:10:32.253952 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 2043/3999] 10.222.0.13 () {58 vars in 1302 bytes} [Tue Nov 1 19:10:32 2022] GET /compute/v2.1/servers/03d4513b-9e04-4924-8654-1de3748e333e/os-volume_attachments => generated 25 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Nov 01 19:10:32.348471 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-2c8d832b-e71f-4df4-a1f2-0aa0423a23fb tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2868ccfdfb164cffa37232c821f205a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04ef687c40bd45c297d22a791bae58cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:10:32.361131 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-2c8d832b-e71f-4df4-a1f2-0aa0423a23fb tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] 10.222.0.13 "GET /compute/v2.1/servers/42415fcc-ac00-4854-bc88-0416ef12d8cb" status: 200 len: 1512 microversion: 2.1 time: 0.346564 Nov 01 19:10:32.362564 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1957/4000] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:10:32 2022] GET /compute/v2.1/servers/42415fcc-ac00-4854-bc88-0416ef12d8cb => generated 1512 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 19:10:32.386040 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-f4a915e5-ffc1-4305-99d7-67a6be4d77bc tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:10:32.391556 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-f4a915e5-ffc1-4305-99d7-67a6be4d77bc tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '2868ccfdfb164cffa37232c821f205a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04ef687c40bd45c297d22a791bae58cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:10:32.392349 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-f4a915e5-ffc1-4305-99d7-67a6be4d77bc tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Searching by: {'ip': '172.20.0.14', 'deleted': False, 'project_id': '04ef687c40bd45c297d22a791bae58cf'} {{(pid=121403) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 01 19:10:32.469972 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-43266291-25b9-469d-a99c-9b61e731737d tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-36847286", "imageRef": "2d4a0047-1b9e-445f-8af8-1b5c9d93e881", "flavorRef": "452", "networks": [{"uuid": "5244cda4-13e2-4009-ae4f-c429024d19da"}]}} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:10:32.575248 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.network.neutron [None req-43266291-25b9-469d-a99c-9b61e731737d tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] validate_networks() for [('5244cda4-13e2-4009-ae4f-c429024d19da', None, None, None, None, None)] {{(pid=121402) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 01 19:10:32.623934 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f4a915e5-ffc1-4305-99d7-67a6be4d77bc tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:32.624453 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f4a915e5-ffc1-4305-99d7-67a6be4d77bc tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:32.624921 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f4a915e5-ffc1-4305-99d7-67a6be4d77bc tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:32.625658 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f4a915e5-ffc1-4305-99d7-67a6be4d77bc tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:32.626336 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f4a915e5-ffc1-4305-99d7-67a6be4d77bc tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:32.626780 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f4a915e5-ffc1-4305-99d7-67a6be4d77bc tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:32.727702 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.multi_cell_list [None req-f4a915e5-ffc1-4305-99d7-67a6be4d77bc tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=121403) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 01 19:10:32.825403 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-f4a915e5-ffc1-4305-99d7-67a6be4d77bc tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] 10.222.0.13 "GET /compute/v2.1/servers?ip=172.20.0.14" status: 200 len: 345 microversion: 2.1 time: 0.444316 Nov 01 19:10:32.837903 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 2044/4001] 10.222.0.13 () {58 vars in 1154 bytes} [Tue Nov 1 19:10:32 2022] GET /compute/v2.1/servers?ip=172.20.0.14 => generated 345 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:10:32.845864 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-6bfecf26-f39c-4bbd-9513-e587e6d10cb1 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:10:32.847147 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-6bfecf26-f39c-4bbd-9513-e587e6d10cb1 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] [instance: ac19dd18-c22a-46de-91ef-454a0b78872f] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:10:32.855039 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-6bfecf26-f39c-4bbd-9513-e587e6d10cb1 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:32.856659 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-6bfecf26-f39c-4bbd-9513-e587e6d10cb1 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:32.857635 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-6bfecf26-f39c-4bbd-9513-e587e6d10cb1 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:32.859149 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-6bfecf26-f39c-4bbd-9513-e587e6d10cb1 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:32.859828 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-6bfecf26-f39c-4bbd-9513-e587e6d10cb1 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:32.860464 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-6bfecf26-f39c-4bbd-9513-e587e6d10cb1 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:33.414274 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-6bfecf26-f39c-4bbd-9513-e587e6d10cb1 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2868ccfdfb164cffa37232c821f205a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04ef687c40bd45c297d22a791bae58cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:10:33.422277 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-6bfecf26-f39c-4bbd-9513-e587e6d10cb1 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] 10.222.0.13 "GET /compute/v2.1/servers/ac19dd18-c22a-46de-91ef-454a0b78872f" status: 200 len: 1513 microversion: 2.1 time: 0.582406 Nov 01 19:10:33.422785 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 2045/4002] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:10:32 2022] GET /compute/v2.1/servers/ac19dd18-c22a-46de-91ef-454a0b78872f => generated 1513 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:10:33.441384 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-a38b46d1-c4cc-455f-ac0d-29db4f7c5e1f tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:10:33.441995 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-a38b46d1-c4cc-455f-ac0d-29db4f7c5e1f tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] [instance: 29b73e88-1e2a-45d8-bdbb-6c5f9399d270] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:10:33.449866 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-a38b46d1-c4cc-455f-ac0d-29db4f7c5e1f tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:33.450355 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-a38b46d1-c4cc-455f-ac0d-29db4f7c5e1f tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:33.450789 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-a38b46d1-c4cc-455f-ac0d-29db4f7c5e1f tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:33.451493 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-a38b46d1-c4cc-455f-ac0d-29db4f7c5e1f tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:33.451944 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-a38b46d1-c4cc-455f-ac0d-29db4f7c5e1f tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:33.452848 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-a38b46d1-c4cc-455f-ac0d-29db4f7c5e1f tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:33.607364 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-a38b46d1-c4cc-455f-ac0d-29db4f7c5e1f tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3111dabbf6d14e2c91766f2f5544057c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c30003431656408bb328e90be22d009a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:10:33.627635 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-a38b46d1-c4cc-455f-ac0d-29db4f7c5e1f tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3111dabbf6d14e2c91766f2f5544057c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c30003431656408bb328e90be22d009a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:10:33.629181 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-a38b46d1-c4cc-455f-ac0d-29db4f7c5e1f tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3111dabbf6d14e2c91766f2f5544057c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c30003431656408bb328e90be22d009a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:10:33.630378 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-a38b46d1-c4cc-455f-ac0d-29db4f7c5e1f tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] 10.222.0.13 "GET /compute/v2.1/servers/29b73e88-1e2a-45d8-bdbb-6c5f9399d270" status: 200 len: 1366 microversion: 2.57 time: 0.206680 Nov 01 19:10:33.644731 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 2046/4003] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 19:10:33 2022] GET /compute/v2.1/servers/29b73e88-1e2a-45d8-bdbb-6c5f9399d270 => generated 1366 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 19:10:33.645042 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-703071e0-e2f0-49ac-ab4b-9ced2858bd9b tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:10:33.645626 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-703071e0-e2f0-49ac-ab4b-9ced2858bd9b tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] [instance: af1071a8-a090-44c9-890c-123ca3ff39f1] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:10:33.656968 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-703071e0-e2f0-49ac-ab4b-9ced2858bd9b tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:33.657462 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-703071e0-e2f0-49ac-ab4b-9ced2858bd9b tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:33.657900 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-703071e0-e2f0-49ac-ab4b-9ced2858bd9b tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:33.659142 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-703071e0-e2f0-49ac-ab4b-9ced2858bd9b tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:33.659877 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-703071e0-e2f0-49ac-ab4b-9ced2858bd9b tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:33.660235 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-703071e0-e2f0-49ac-ab4b-9ced2858bd9b tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:33.777876 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-703071e0-e2f0-49ac-ab4b-9ced2858bd9b tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '301ed3b9c37449bc9ade378f3c73a768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8807757227574c828dca1947af76659d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:10:33.796356 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.virt.hardware [None req-43266291-25b9-469d-a99c-9b61e731737d tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] Flavor limits 0:0:0 {{(pid=121402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 01 19:10:33.796880 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.virt.hardware [None req-43266291-25b9-469d-a99c-9b61e731737d tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] Image limits 0:0:0 {{(pid=121402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 01 19:10:33.797336 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.virt.hardware [None req-43266291-25b9-469d-a99c-9b61e731737d tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] Flavor pref 0:0:0 {{(pid=121402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 01 19:10:33.797753 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.virt.hardware [None req-43266291-25b9-469d-a99c-9b61e731737d tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] Image pref 0:0:0 {{(pid=121402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 01 19:10:33.798222 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.virt.hardware [None req-43266291-25b9-469d-a99c-9b61e731737d tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 01 19:10:33.801268 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-703071e0-e2f0-49ac-ab4b-9ced2858bd9b tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '301ed3b9c37449bc9ade378f3c73a768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8807757227574c828dca1947af76659d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:10:33.803785 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-703071e0-e2f0-49ac-ab4b-9ced2858bd9b tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '301ed3b9c37449bc9ade378f3c73a768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8807757227574c828dca1947af76659d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:10:33.805052 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-703071e0-e2f0-49ac-ab4b-9ced2858bd9b tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] 10.222.0.13 "GET /compute/v2.1/servers/af1071a8-a090-44c9-890c-123ca3ff39f1" status: 200 len: 1605 microversion: 2.42 time: 0.172727 Nov 01 19:10:33.808758 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 2047/4004] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 19:10:33 2022] GET /compute/v2.1/servers/af1071a8-a090-44c9-890c-123ca3ff39f1 => generated 1605 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 19:10:33.814328 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-43266291-25b9-469d-a99c-9b61e731737d tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:33.816944 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-43266291-25b9-469d-a99c-9b61e731737d tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:33.817599 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-43266291-25b9-469d-a99c-9b61e731737d tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:33.818532 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-43266291-25b9-469d-a99c-9b61e731737d tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:33.819427 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-aec7f15b-a574-4209-80f0-443c99ac57d1 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:10:33.820072 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-43266291-25b9-469d-a99c-9b61e731737d tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:33.820794 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-aec7f15b-a574-4209-80f0-443c99ac57d1 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] [instance: 33dd79e0-eb7c-4f18-a61f-df8022667dd0] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:10:33.821419 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-43266291-25b9-469d-a99c-9b61e731737d tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:33.831462 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-aec7f15b-a574-4209-80f0-443c99ac57d1 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:33.832342 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-aec7f15b-a574-4209-80f0-443c99ac57d1 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:33.833155 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-aec7f15b-a574-4209-80f0-443c99ac57d1 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:33.834219 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-aec7f15b-a574-4209-80f0-443c99ac57d1 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:33.834913 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-aec7f15b-a574-4209-80f0-443c99ac57d1 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:33.835535 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-aec7f15b-a574-4209-80f0-443c99ac57d1 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:33.870978 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.quota [None req-43266291-25b9-469d-a99c-9b61e731737d tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] Getting quotas for project 3d8835c7b6754bfd81447b1f8893e56c. Resources: {'cores', 'ram', 'instances'} {{(pid=121402) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 01 19:10:33.879080 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.quota [None req-43266291-25b9-469d-a99c-9b61e731737d tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] Getting quotas for user c72e7e000a9a4fa49474bd5d19accf77 and project 3d8835c7b6754bfd81447b1f8893e56c. Resources: {'cores', 'ram', 'instances'} {{(pid=121402) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 01 19:10:33.881978 n-d-863052-2 devstack@n-api.service[121402]: DEBUG dbcounter [-] [121402] Writing DB stats nova_api:SELECT=100 {{(pid=121402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 19:10:33.906659 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-43266291-25b9-469d-a99c-9b61e731737d tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] Going to run 1 instances... {{(pid=121402) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 01 19:10:33.909987 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-43266291-25b9-469d-a99c-9b61e731737d tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] [instance: 7ee07462-fab6-49a3-b7fd-cbe545cc6f55] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2d4a0047-1b9e-445f-8af8-1b5c9d93e881',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121402) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 01 19:10:34.014939 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-43266291-25b9-469d-a99c-9b61e731737d tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.548866 Nov 01 19:10:34.021176 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1958/4005] 10.222.0.13 () {60 vars in 1147 bytes} [Tue Nov 1 19:10:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 1552 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Nov 01 19:10:34.029391 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-ec2ea4ef-271a-40af-9e57-82c6901090eb tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:10:34.030126 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-ec2ea4ef-271a-40af-9e57-82c6901090eb tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] [instance: 7ee07462-fab6-49a3-b7fd-cbe545cc6f55] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:10:34.204852 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-ec2ea4ef-271a-40af-9e57-82c6901090eb tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c72e7e000a9a4fa49474bd5d19accf77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d8835c7b6754bfd81447b1f8893e56c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:10:34.223714 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-ec2ea4ef-271a-40af-9e57-82c6901090eb tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] 10.222.0.13 "GET /compute/v2.1/servers/7ee07462-fab6-49a3-b7fd-cbe545cc6f55" status: 200 len: 1216 microversion: 2.1 time: 0.198219 Nov 01 19:10:34.229742 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1959/4006] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:10:34 2022] GET /compute/v2.1/servers/7ee07462-fab6-49a3-b7fd-cbe545cc6f55 => generated 1216 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 19:10:34.284758 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-a0dde6d5-9726-45ac-a398-e162ef597a93 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "236dcd2b-6c8e-47c8-a80e-bb2ec1641692"}} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:10:34.288812 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-a0dde6d5-9726-45ac-a398-e162ef597a93 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] [instance: eced579f-beea-4d3c-b2b8-8a6b31f7829b] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:10:34.292928 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-aec7f15b-a574-4209-80f0-443c99ac57d1 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2868ccfdfb164cffa37232c821f205a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04ef687c40bd45c297d22a791bae58cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:10:34.301755 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-aec7f15b-a574-4209-80f0-443c99ac57d1 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] 10.222.0.13 "GET /compute/v2.1/servers/33dd79e0-eb7c-4f18-a61f-df8022667dd0" status: 200 len: 1512 microversion: 2.1 time: 0.489121 Nov 01 19:10:34.304894 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 2048/4007] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:10:33 2022] GET /compute/v2.1/servers/33dd79e0-eb7c-4f18-a61f-df8022667dd0 => generated 1512 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:10:34.309207 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-a0dde6d5-9726-45ac-a398-e162ef597a93 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:34.309747 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-a0dde6d5-9726-45ac-a398-e162ef597a93 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:34.310190 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-a0dde6d5-9726-45ac-a398-e162ef597a93 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:34.310898 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-a0dde6d5-9726-45ac-a398-e162ef597a93 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:34.316146 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-a0dde6d5-9726-45ac-a398-e162ef597a93 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:34.316964 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-a0dde6d5-9726-45ac-a398-e162ef597a93 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:34.326004 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-72254f66-6ab7-47d4-a08b-3e83e1432b7a tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:10:34.326622 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-72254f66-6ab7-47d4-a08b-3e83e1432b7a tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] [instance: 42415fcc-ac00-4854-bc88-0416ef12d8cb] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:10:34.343128 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-72254f66-6ab7-47d4-a08b-3e83e1432b7a tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:34.343868 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-72254f66-6ab7-47d4-a08b-3e83e1432b7a tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:34.345367 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-72254f66-6ab7-47d4-a08b-3e83e1432b7a tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:34.346193 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-72254f66-6ab7-47d4-a08b-3e83e1432b7a tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:34.352347 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-72254f66-6ab7-47d4-a08b-3e83e1432b7a tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:34.355087 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-72254f66-6ab7-47d4-a08b-3e83e1432b7a tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:34.452673 n-d-863052-2 devstack@n-api.service[121402]: DEBUG dbcounter [-] [121402] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 19:10:34.800660 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-72254f66-6ab7-47d4-a08b-3e83e1432b7a tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2868ccfdfb164cffa37232c821f205a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04ef687c40bd45c297d22a791bae58cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:10:34.820167 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-a0dde6d5-9726-45ac-a398-e162ef597a93 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] 10.222.0.13 "POST /compute/v2.1/servers/eced579f-beea-4d3c-b2b8-8a6b31f7829b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.535084 Nov 01 19:10:34.821063 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1960/4008] 10.222.0.13 () {60 vars in 1323 bytes} [Tue Nov 1 19:10:34 2022] POST /compute/v2.1/servers/eced579f-beea-4d3c-b2b8-8a6b31f7829b/os-volume_attachments => generated 194 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:10:34.840711 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-72254f66-6ab7-47d4-a08b-3e83e1432b7a tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] 10.222.0.13 "GET /compute/v2.1/servers/42415fcc-ac00-4854-bc88-0416ef12d8cb" status: 200 len: 1512 microversion: 2.1 time: 0.496339 Nov 01 19:10:34.842783 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 2049/4009] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:10:34 2022] GET /compute/v2.1/servers/42415fcc-ac00-4854-bc88-0416ef12d8cb => generated 1512 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 19:10:34.856056 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-c5921ae1-3e1b-4e2d-bf65-051953e502af tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:10:34.857004 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-c5921ae1-3e1b-4e2d-bf65-051953e502af tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] [instance: af1071a8-a090-44c9-890c-123ca3ff39f1] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:10:34.860861 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-3ee9804d-1633-4c27-85f5-82aa83bcd79d tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:10:34.864277 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-3ee9804d-1633-4c27-85f5-82aa83bcd79d tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] [instance: 29b73e88-1e2a-45d8-bdbb-6c5f9399d270] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:10:34.877085 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-c5921ae1-3e1b-4e2d-bf65-051953e502af tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:34.878425 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-c5921ae1-3e1b-4e2d-bf65-051953e502af tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:34.880750 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-c5921ae1-3e1b-4e2d-bf65-051953e502af tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:34.881670 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-c5921ae1-3e1b-4e2d-bf65-051953e502af tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:34.884083 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-c5921ae1-3e1b-4e2d-bf65-051953e502af tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:34.885033 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-c5921ae1-3e1b-4e2d-bf65-051953e502af tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:34.890011 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-3ee9804d-1633-4c27-85f5-82aa83bcd79d tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:34.898430 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-3ee9804d-1633-4c27-85f5-82aa83bcd79d tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:34.898954 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-3ee9804d-1633-4c27-85f5-82aa83bcd79d tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:34.902237 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-3ee9804d-1633-4c27-85f5-82aa83bcd79d tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:34.902740 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-3ee9804d-1633-4c27-85f5-82aa83bcd79d tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:34.903181 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-3ee9804d-1633-4c27-85f5-82aa83bcd79d tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:35.001775 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-c5921ae1-3e1b-4e2d-bf65-051953e502af tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '301ed3b9c37449bc9ade378f3c73a768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8807757227574c828dca1947af76659d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:10:35.025156 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-c5921ae1-3e1b-4e2d-bf65-051953e502af tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '301ed3b9c37449bc9ade378f3c73a768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8807757227574c828dca1947af76659d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:10:35.028164 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-c5921ae1-3e1b-4e2d-bf65-051953e502af tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '301ed3b9c37449bc9ade378f3c73a768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8807757227574c828dca1947af76659d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:10:35.029730 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-c5921ae1-3e1b-4e2d-bf65-051953e502af tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] 10.222.0.13 "GET /compute/v2.1/servers/af1071a8-a090-44c9-890c-123ca3ff39f1" status: 200 len: 1605 microversion: 2.42 time: 0.183656 Nov 01 19:10:35.030633 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 2050/4010] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 19:10:34 2022] GET /compute/v2.1/servers/af1071a8-a090-44c9-890c-123ca3ff39f1 => generated 1605 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 19:10:35.058362 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-c6159eed-8579-42d9-8538-3635b4bc9599 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:10:35.081786 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-c6159eed-8579-42d9-8538-3635b4bc9599 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '2868ccfdfb164cffa37232c821f205a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04ef687c40bd45c297d22a791bae58cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:10:35.084666 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-c6159eed-8579-42d9-8538-3635b4bc9599 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Searching by: {'deleted': False, 'project_id': '04ef687c40bd45c297d22a791bae58cf'} {{(pid=121403) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 01 19:10:35.101118 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-c6159eed-8579-42d9-8538-3635b4bc9599 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:35.109919 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-c6159eed-8579-42d9-8538-3635b4bc9599 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:35.111623 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-c6159eed-8579-42d9-8538-3635b4bc9599 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:35.113029 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-c6159eed-8579-42d9-8538-3635b4bc9599 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:35.113957 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-c6159eed-8579-42d9-8538-3635b4bc9599 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:35.114641 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-c6159eed-8579-42d9-8538-3635b4bc9599 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:35.157250 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.multi_cell_list [None req-c6159eed-8579-42d9-8538-3635b4bc9599 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=121403) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 01 19:10:35.169628 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-3ee9804d-1633-4c27-85f5-82aa83bcd79d tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3111dabbf6d14e2c91766f2f5544057c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c30003431656408bb328e90be22d009a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:10:35.181766 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-3ee9804d-1633-4c27-85f5-82aa83bcd79d tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3111dabbf6d14e2c91766f2f5544057c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c30003431656408bb328e90be22d009a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:10:35.183222 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-3ee9804d-1633-4c27-85f5-82aa83bcd79d tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3111dabbf6d14e2c91766f2f5544057c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c30003431656408bb328e90be22d009a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:10:35.187257 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-3ee9804d-1633-4c27-85f5-82aa83bcd79d tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] 10.222.0.13 "GET /compute/v2.1/servers/29b73e88-1e2a-45d8-bdbb-6c5f9399d270" status: 200 len: 1366 microversion: 2.57 time: 0.340486 Nov 01 19:10:35.187885 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1961/4011] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 19:10:34 2022] GET /compute/v2.1/servers/29b73e88-1e2a-45d8-bdbb-6c5f9399d270 => generated 1366 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 19:10:35.254383 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-f99c45aa-5706-458d-8283-86b9a04a9894 tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:10:35.255407 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-f99c45aa-5706-458d-8283-86b9a04a9894 tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] [instance: 7ee07462-fab6-49a3-b7fd-cbe545cc6f55] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:10:35.269867 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f99c45aa-5706-458d-8283-86b9a04a9894 tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:35.270392 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f99c45aa-5706-458d-8283-86b9a04a9894 tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:35.270840 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f99c45aa-5706-458d-8283-86b9a04a9894 tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:35.271573 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f99c45aa-5706-458d-8283-86b9a04a9894 tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:35.274273 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f99c45aa-5706-458d-8283-86b9a04a9894 tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:35.274836 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f99c45aa-5706-458d-8283-86b9a04a9894 tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:35.279384 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-c6159eed-8579-42d9-8538-3635b4bc9599 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2868ccfdfb164cffa37232c821f205a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04ef687c40bd45c297d22a791bae58cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:10:35.289937 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-c6159eed-8579-42d9-8538-3635b4bc9599 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:35.290549 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-c6159eed-8579-42d9-8538-3635b4bc9599 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:35.291050 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-c6159eed-8579-42d9-8538-3635b4bc9599 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:35.402407 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-f99c45aa-5706-458d-8283-86b9a04a9894 tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c72e7e000a9a4fa49474bd5d19accf77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d8835c7b6754bfd81447b1f8893e56c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:10:35.428239 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-f99c45aa-5706-458d-8283-86b9a04a9894 tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] 10.222.0.13 "GET /compute/v2.1/servers/7ee07462-fab6-49a3-b7fd-cbe545cc6f55" status: 200 len: 1212 microversion: 2.1 time: 0.172536 Nov 01 19:10:35.432972 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1962/4012] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:10:35 2022] GET /compute/v2.1/servers/7ee07462-fab6-49a3-b7fd-cbe545cc6f55 => generated 1212 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:10:35.757540 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-c6159eed-8579-42d9-8538-3635b4bc9599 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] 10.222.0.13 "GET /compute/v2.1/servers/detail" status: 200 len: 4520 microversion: 2.1 time: 0.725733 Nov 01 19:10:35.759087 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 2051/4013] 10.222.0.13 () {58 vars in 1146 bytes} [Tue Nov 1 19:10:35 2022] GET /compute/v2.1/servers/detail => generated 4520 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:10:35.790591 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-2f11911b-2c33-4903-a8ca-7c39299f659e tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:10:35.802426 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-2f11911b-2c33-4903-a8ca-7c39299f659e tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '2868ccfdfb164cffa37232c821f205a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04ef687c40bd45c297d22a791bae58cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:10:35.803216 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-2f11911b-2c33-4903-a8ca-7c39299f659e tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Searching by: {'ip': '172.20.0.1', 'deleted': False, 'project_id': '04ef687c40bd45c297d22a791bae58cf'} {{(pid=121402) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 01 19:10:36.059955 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-ec0d023c-6cf0-4d6f-bad1-18b4ec5dd99f tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:10:36.060910 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-ec0d023c-6cf0-4d6f-bad1-18b4ec5dd99f tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] [instance: af1071a8-a090-44c9-890c-123ca3ff39f1] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:10:36.073301 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-ec0d023c-6cf0-4d6f-bad1-18b4ec5dd99f tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:36.074406 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-ec0d023c-6cf0-4d6f-bad1-18b4ec5dd99f tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:36.075018 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-ec0d023c-6cf0-4d6f-bad1-18b4ec5dd99f tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:36.075900 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-ec0d023c-6cf0-4d6f-bad1-18b4ec5dd99f tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:36.078009 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-ec0d023c-6cf0-4d6f-bad1-18b4ec5dd99f tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:36.078688 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-ec0d023c-6cf0-4d6f-bad1-18b4ec5dd99f tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:36.343146 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-ec0d023c-6cf0-4d6f-bad1-18b4ec5dd99f tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '301ed3b9c37449bc9ade378f3c73a768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8807757227574c828dca1947af76659d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:10:36.366510 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-ec0d023c-6cf0-4d6f-bad1-18b4ec5dd99f tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '301ed3b9c37449bc9ade378f3c73a768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8807757227574c828dca1947af76659d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:10:36.368557 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-ec0d023c-6cf0-4d6f-bad1-18b4ec5dd99f tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '301ed3b9c37449bc9ade378f3c73a768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8807757227574c828dca1947af76659d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:10:36.369895 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-ec0d023c-6cf0-4d6f-bad1-18b4ec5dd99f tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] 10.222.0.13 "GET /compute/v2.1/servers/af1071a8-a090-44c9-890c-123ca3ff39f1" status: 200 len: 1605 microversion: 2.42 time: 0.314321 Nov 01 19:10:36.386183 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 2052/4014] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 19:10:36 2022] GET /compute/v2.1/servers/af1071a8-a090-44c9-890c-123ca3ff39f1 => generated 1605 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 01 19:10:36.408043 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-0e27be63-009a-43c7-97fc-63c75bab0a69 tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:10:36.409294 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-0e27be63-009a-43c7-97fc-63c75bab0a69 tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] [instance: 29b73e88-1e2a-45d8-bdbb-6c5f9399d270] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:10:36.418327 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-0e27be63-009a-43c7-97fc-63c75bab0a69 tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:36.418819 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-0e27be63-009a-43c7-97fc-63c75bab0a69 tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:36.419451 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-0e27be63-009a-43c7-97fc-63c75bab0a69 tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:36.420374 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-0e27be63-009a-43c7-97fc-63c75bab0a69 tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:36.421083 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-0e27be63-009a-43c7-97fc-63c75bab0a69 tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:36.421700 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-0e27be63-009a-43c7-97fc-63c75bab0a69 tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:36.568178 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-0e27be63-009a-43c7-97fc-63c75bab0a69 tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3111dabbf6d14e2c91766f2f5544057c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c30003431656408bb328e90be22d009a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:10:36.578438 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-0e27be63-009a-43c7-97fc-63c75bab0a69 tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3111dabbf6d14e2c91766f2f5544057c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c30003431656408bb328e90be22d009a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:10:36.582139 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-0e27be63-009a-43c7-97fc-63c75bab0a69 tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3111dabbf6d14e2c91766f2f5544057c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c30003431656408bb328e90be22d009a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:10:36.584013 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-0e27be63-009a-43c7-97fc-63c75bab0a69 tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] 10.222.0.13 "GET /compute/v2.1/servers/29b73e88-1e2a-45d8-bdbb-6c5f9399d270" status: 200 len: 1366 microversion: 2.57 time: 0.196656 Nov 01 19:10:36.585226 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 2053/4015] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 19:10:36 2022] GET /compute/v2.1/servers/29b73e88-1e2a-45d8-bdbb-6c5f9399d270 => generated 1366 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 19:10:36.591285 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-2d4e832e-cc7c-458c-9324-b5f8067e313d tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:10:36.592249 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-2d4e832e-cc7c-458c-9324-b5f8067e313d tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] [instance: 7ee07462-fab6-49a3-b7fd-cbe545cc6f55] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:10:36.602214 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-2d4e832e-cc7c-458c-9324-b5f8067e313d tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:36.603043 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-2d4e832e-cc7c-458c-9324-b5f8067e313d tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:36.603879 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-2d4e832e-cc7c-458c-9324-b5f8067e313d tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:36.605026 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-2d4e832e-cc7c-458c-9324-b5f8067e313d tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:36.606683 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-2d4e832e-cc7c-458c-9324-b5f8067e313d tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:36.607172 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-2d4e832e-cc7c-458c-9324-b5f8067e313d tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:36.679259 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-2d4e832e-cc7c-458c-9324-b5f8067e313d tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c72e7e000a9a4fa49474bd5d19accf77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d8835c7b6754bfd81447b1f8893e56c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:10:36.688506 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-2d4e832e-cc7c-458c-9324-b5f8067e313d tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] 10.222.0.13 "GET /compute/v2.1/servers/7ee07462-fab6-49a3-b7fd-cbe545cc6f55" status: 200 len: 1274 microversion: 2.1 time: 0.101579 Nov 01 19:10:36.689415 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 2054/4016] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:10:36 2022] GET /compute/v2.1/servers/7ee07462-fab6-49a3-b7fd-cbe545cc6f55 => generated 1274 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:10:36.750921 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2f11911b-2c33-4903-a8ca-7c39299f659e tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:36.752001 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2f11911b-2c33-4903-a8ca-7c39299f659e tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:36.753387 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2f11911b-2c33-4903-a8ca-7c39299f659e tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:36.754883 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2f11911b-2c33-4903-a8ca-7c39299f659e tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:36.755599 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2f11911b-2c33-4903-a8ca-7c39299f659e tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:36.756402 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2f11911b-2c33-4903-a8ca-7c39299f659e tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:36.871205 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.multi_cell_list [None req-2f11911b-2c33-4903-a8ca-7c39299f659e tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=121402) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 01 19:10:36.944867 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-2f11911b-2c33-4903-a8ca-7c39299f659e tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] 10.222.0.13 "GET /compute/v2.1/servers?ip=172.20.0.1" status: 200 len: 1010 microversion: 2.1 time: 1.159541 Nov 01 19:10:36.946553 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1963/4017] 10.222.0.13 () {58 vars in 1152 bytes} [Tue Nov 1 19:10:35 2022] GET /compute/v2.1/servers?ip=172.20.0.1 => generated 1010 bytes in 1162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:10:36.964408 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-88a2b08f-1c09-4049-97e4-a2ddcc684a8a tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:10:36.972120 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-88a2b08f-1c09-4049-97e4-a2ddcc684a8a tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '2868ccfdfb164cffa37232c821f205a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04ef687c40bd45c297d22a791bae58cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:10:36.973298 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-88a2b08f-1c09-4049-97e4-a2ddcc684a8a tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Searching by: {'name': '^.*\\-instance\\-[0-9]+$', 'deleted': False, 'project_id': '04ef687c40bd45c297d22a791bae58cf'} {{(pid=121402) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 01 19:10:36.979643 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-88a2b08f-1c09-4049-97e4-a2ddcc684a8a tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:36.980133 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-88a2b08f-1c09-4049-97e4-a2ddcc684a8a tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:36.980573 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-88a2b08f-1c09-4049-97e4-a2ddcc684a8a tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:36.981310 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-88a2b08f-1c09-4049-97e4-a2ddcc684a8a tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:36.981768 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-88a2b08f-1c09-4049-97e4-a2ddcc684a8a tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:36.982195 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-88a2b08f-1c09-4049-97e4-a2ddcc684a8a tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:37.097373 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.multi_cell_list [None req-88a2b08f-1c09-4049-97e4-a2ddcc684a8a tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=121402) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 01 19:10:37.119534 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-7a833cf8-e7a2-4098-9d3e-77e0c4c0ae7b tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:10:37.121785 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-7a833cf8-e7a2-4098-9d3e-77e0c4c0ae7b tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] [instance: ba6ffc5c-84a4-40f1-bdc7-f87dde2c99df] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:10:37.129877 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-7a833cf8-e7a2-4098-9d3e-77e0c4c0ae7b tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:37.130637 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-7a833cf8-e7a2-4098-9d3e-77e0c4c0ae7b tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:37.131442 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-7a833cf8-e7a2-4098-9d3e-77e0c4c0ae7b tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:37.132386 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-7a833cf8-e7a2-4098-9d3e-77e0c4c0ae7b tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:37.133104 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-7a833cf8-e7a2-4098-9d3e-77e0c4c0ae7b tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:37.133982 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-7a833cf8-e7a2-4098-9d3e-77e0c4c0ae7b tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:37.171479 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-88a2b08f-1c09-4049-97e4-a2ddcc684a8a tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] 10.222.0.13 "GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-%5B0-9%5D%2B%24" status: 200 len: 1010 microversion: 2.1 time: 0.214337 Nov 01 19:10:37.171767 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-7a833cf8-e7a2-4098-9d3e-77e0c4c0ae7b tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] [instance: ba6ffc5c-84a4-40f1-bdc7-f87dde2c99df] Going to try to terminate instance {{(pid=121403) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 01 19:10:37.173711 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1964/4018] 10.222.0.13 () {58 vars in 1212 bytes} [Tue Nov 1 19:10:36 2022] GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-%5B0-9%5D%2B%24 => generated 1010 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:10:37.186907 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-468386c4-8333-4fb4-82a3-9c5001821f24 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:10:37.187419 n-d-863052-2 devstack@n-api.service[121403]: DEBUG dbcounter [-] [121403] Writing DB stats nova_cell1:SELECT=100 {{(pid=121403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 19:10:37.191836 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-468386c4-8333-4fb4-82a3-9c5001821f24 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '2868ccfdfb164cffa37232c821f205a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04ef687c40bd45c297d22a791bae58cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:10:37.192507 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-468386c4-8333-4fb4-82a3-9c5001821f24 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Searching by: {'name': '^.*\\-instance\\-.*$', 'deleted': False, 'project_id': '04ef687c40bd45c297d22a791bae58cf'} {{(pid=121402) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 01 19:10:37.197813 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-468386c4-8333-4fb4-82a3-9c5001821f24 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:37.198293 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-468386c4-8333-4fb4-82a3-9c5001821f24 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:37.198722 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-468386c4-8333-4fb4-82a3-9c5001821f24 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:37.199437 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-468386c4-8333-4fb4-82a3-9c5001821f24 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:37.199887 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-468386c4-8333-4fb4-82a3-9c5001821f24 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:37.200304 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-468386c4-8333-4fb4-82a3-9c5001821f24 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:37.302218 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-7a833cf8-e7a2-4098-9d3e-77e0c4c0ae7b tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] 10.222.0.13 "DELETE /compute/v2.1/servers/ba6ffc5c-84a4-40f1-bdc7-f87dde2c99df" status: 204 len: 0 microversion: 2.32 time: 0.394856 Nov 01 19:10:37.307213 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 2055/4019] 10.222.0.13 () {60 vars in 1280 bytes} [Tue Nov 1 19:10:36 2022] DELETE /compute/v2.1/servers/ba6ffc5c-84a4-40f1-bdc7-f87dde2c99df => generated 0 bytes in 398 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 01 19:10:37.313873 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-1e676ae0-699d-45f7-bcf2-8eada321c05f tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:10:37.315015 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-1e676ae0-699d-45f7-bcf2-8eada321c05f tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] [instance: ba6ffc5c-84a4-40f1-bdc7-f87dde2c99df] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:10:37.322498 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-1e676ae0-699d-45f7-bcf2-8eada321c05f tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:37.323743 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-1e676ae0-699d-45f7-bcf2-8eada321c05f tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:37.336665 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.multi_cell_list [None req-468386c4-8333-4fb4-82a3-9c5001821f24 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=121402) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 01 19:10:37.340794 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-1e676ae0-699d-45f7-bcf2-8eada321c05f tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:37.345720 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-1e676ae0-699d-45f7-bcf2-8eada321c05f tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:37.347000 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-1e676ae0-699d-45f7-bcf2-8eada321c05f tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:37.347455 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-1e676ae0-699d-45f7-bcf2-8eada321c05f tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:37.406282 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-468386c4-8333-4fb4-82a3-9c5001821f24 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] 10.222.0.13 "GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-.%2A%24" status: 200 len: 1010 microversion: 2.1 time: 0.224371 Nov 01 19:10:37.407202 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1965/4020] 10.222.0.13 () {58 vars in 1196 bytes} [Tue Nov 1 19:10:37 2022] GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-.%2A%24 => generated 1010 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 19:10:37.420546 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-83039934-b504-4f6a-a1a4-6ec96b597448 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:10:37.421420 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-83039934-b504-4f6a-a1a4-6ec96b597448 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] [instance: af1071a8-a090-44c9-890c-123ca3ff39f1] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:10:37.430034 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-83039934-b504-4f6a-a1a4-6ec96b597448 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:37.430525 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-83039934-b504-4f6a-a1a4-6ec96b597448 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:37.430967 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-83039934-b504-4f6a-a1a4-6ec96b597448 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:37.432695 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-83039934-b504-4f6a-a1a4-6ec96b597448 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:37.432695 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-83039934-b504-4f6a-a1a4-6ec96b597448 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:37.432923 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-83039934-b504-4f6a-a1a4-6ec96b597448 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:37.600376 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-83039934-b504-4f6a-a1a4-6ec96b597448 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '301ed3b9c37449bc9ade378f3c73a768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8807757227574c828dca1947af76659d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:10:37.617252 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-83039934-b504-4f6a-a1a4-6ec96b597448 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '301ed3b9c37449bc9ade378f3c73a768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8807757227574c828dca1947af76659d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:10:37.618873 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-83039934-b504-4f6a-a1a4-6ec96b597448 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '301ed3b9c37449bc9ade378f3c73a768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8807757227574c828dca1947af76659d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:10:37.621514 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-83039934-b504-4f6a-a1a4-6ec96b597448 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] 10.222.0.13 "GET /compute/v2.1/servers/af1071a8-a090-44c9-890c-123ca3ff39f1" status: 200 len: 1605 microversion: 2.42 time: 0.213190 Nov 01 19:10:37.622087 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1966/4021] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 19:10:37 2022] GET /compute/v2.1/servers/af1071a8-a090-44c9-890c-123ca3ff39f1 => generated 1605 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 19:10:37.636735 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-b7aedb66-d786-4b72-8a2d-e725656c6d14 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:10:37.644894 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-b7aedb66-d786-4b72-8a2d-e725656c6d14 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '2868ccfdfb164cffa37232c821f205a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04ef687c40bd45c297d22a791bae58cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:10:37.645583 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-b7aedb66-d786-4b72-8a2d-e725656c6d14 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Searching by: {'name': '1380889138', 'deleted': False, 'project_id': '04ef687c40bd45c297d22a791bae58cf'} {{(pid=121402) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 01 19:10:37.660414 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b7aedb66-d786-4b72-8a2d-e725656c6d14 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:37.660980 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b7aedb66-d786-4b72-8a2d-e725656c6d14 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:37.661556 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b7aedb66-d786-4b72-8a2d-e725656c6d14 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:37.662290 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b7aedb66-d786-4b72-8a2d-e725656c6d14 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:37.662747 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b7aedb66-d786-4b72-8a2d-e725656c6d14 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:37.663167 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b7aedb66-d786-4b72-8a2d-e725656c6d14 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:37.881657 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.multi_cell_list [None req-b7aedb66-d786-4b72-8a2d-e725656c6d14 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=121402) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 01 19:10:37.882246 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-1e676ae0-699d-45f7-bcf2-8eada321c05f tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd2105b0264b48d084d0e79cabff8bc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf4adda91364dab94830347c06e3957', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:10:37.898979 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-1e676ae0-699d-45f7-bcf2-8eada321c05f tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd2105b0264b48d084d0e79cabff8bc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf4adda91364dab94830347c06e3957', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:10:37.909081 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-1e676ae0-699d-45f7-bcf2-8eada321c05f tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd2105b0264b48d084d0e79cabff8bc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf4adda91364dab94830347c06e3957', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:10:37.911903 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-1e676ae0-699d-45f7-bcf2-8eada321c05f tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] 10.222.0.13 "GET /compute/v2.1/servers/ba6ffc5c-84a4-40f1-bdc7-f87dde2c99df" status: 200 len: 2952 microversion: 2.32 time: 0.602986 Nov 01 19:10:37.912817 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 2056/4022] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 19:10:37 2022] GET /compute/v2.1/servers/ba6ffc5c-84a4-40f1-bdc7-f87dde2c99df => generated 2952 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 19:10:37.919317 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-e5f5264d-f3a3-479f-8c70-8902fc3910f6 tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:10:37.920157 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-e5f5264d-f3a3-479f-8c70-8902fc3910f6 tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] [instance: 29b73e88-1e2a-45d8-bdbb-6c5f9399d270] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:10:37.928675 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-e5f5264d-f3a3-479f-8c70-8902fc3910f6 tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:37.930816 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-e5f5264d-f3a3-479f-8c70-8902fc3910f6 tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:37.931476 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-e5f5264d-f3a3-479f-8c70-8902fc3910f6 tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:37.932418 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-e5f5264d-f3a3-479f-8c70-8902fc3910f6 tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:37.933099 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-e5f5264d-f3a3-479f-8c70-8902fc3910f6 tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:37.933730 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-e5f5264d-f3a3-479f-8c70-8902fc3910f6 tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:38.027731 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-b7aedb66-d786-4b72-8a2d-e725656c6d14 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] 10.222.0.13 "GET /compute/v2.1/servers?name=1380889138" status: 200 len: 346 microversion: 2.1 time: 0.402349 Nov 01 19:10:38.029177 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1967/4023] 10.222.0.13 () {58 vars in 1156 bytes} [Tue Nov 1 19:10:37 2022] GET /compute/v2.1/servers?name=1380889138 => generated 346 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:10:38.035211 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-a8ba63eb-6ce2-4abe-bec4-351597adbf7e tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:10:38.036102 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-a8ba63eb-6ce2-4abe-bec4-351597adbf7e tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] [instance: 7ee07462-fab6-49a3-b7fd-cbe545cc6f55] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:10:38.043991 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-a8ba63eb-6ce2-4abe-bec4-351597adbf7e tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:38.044762 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-a8ba63eb-6ce2-4abe-bec4-351597adbf7e tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:38.045397 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-a8ba63eb-6ce2-4abe-bec4-351597adbf7e tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:38.046399 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-a8ba63eb-6ce2-4abe-bec4-351597adbf7e tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:38.047029 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-a8ba63eb-6ce2-4abe-bec4-351597adbf7e tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:38.047761 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-a8ba63eb-6ce2-4abe-bec4-351597adbf7e tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:38.262865 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-a8ba63eb-6ce2-4abe-bec4-351597adbf7e tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c72e7e000a9a4fa49474bd5d19accf77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d8835c7b6754bfd81447b1f8893e56c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:10:38.273320 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-a8ba63eb-6ce2-4abe-bec4-351597adbf7e tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] 10.222.0.13 "GET /compute/v2.1/servers/7ee07462-fab6-49a3-b7fd-cbe545cc6f55" status: 200 len: 1274 microversion: 2.1 time: 0.242733 Nov 01 19:10:38.277284 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1968/4024] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:10:38 2022] GET /compute/v2.1/servers/7ee07462-fab6-49a3-b7fd-cbe545cc6f55 => generated 1274 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:10:38.288806 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-a9e3aacc-6059-4a88-b811-5e0933bda3bd tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:10:38.294488 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-a9e3aacc-6059-4a88-b811-5e0933bda3bd tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '2868ccfdfb164cffa37232c821f205a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04ef687c40bd45c297d22a791bae58cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:10:38.295566 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-a9e3aacc-6059-4a88-b811-5e0933bda3bd tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Searching by: {'name': '-instance', 'deleted': False, 'project_id': '04ef687c40bd45c297d22a791bae58cf'} {{(pid=121402) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 01 19:10:38.301597 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-a9e3aacc-6059-4a88-b811-5e0933bda3bd tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:38.302470 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-a9e3aacc-6059-4a88-b811-5e0933bda3bd tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:38.303110 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-a9e3aacc-6059-4a88-b811-5e0933bda3bd tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:38.304043 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-a9e3aacc-6059-4a88-b811-5e0933bda3bd tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:38.304738 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-a9e3aacc-6059-4a88-b811-5e0933bda3bd tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:38.305555 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-a9e3aacc-6059-4a88-b811-5e0933bda3bd tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:38.416033 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.multi_cell_list [None req-a9e3aacc-6059-4a88-b811-5e0933bda3bd tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=121402) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 01 19:10:38.525401 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-e5f5264d-f3a3-479f-8c70-8902fc3910f6 tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3111dabbf6d14e2c91766f2f5544057c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c30003431656408bb328e90be22d009a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:10:38.536882 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-a9e3aacc-6059-4a88-b811-5e0933bda3bd tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] 10.222.0.13 "GET /compute/v2.1/servers?name=-instance" status: 200 len: 1010 microversion: 2.1 time: 0.257572 Nov 01 19:10:38.537513 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1969/4025] 10.222.0.13 () {58 vars in 1154 bytes} [Tue Nov 1 19:10:38 2022] GET /compute/v2.1/servers?name=-instance => generated 1010 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:10:38.552267 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-81413102-4b1e-4766-842e-f844397b8b15 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:10:38.558180 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-81413102-4b1e-4766-842e-f844397b8b15 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '2868ccfdfb164cffa37232c821f205a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04ef687c40bd45c297d22a791bae58cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:10:38.558915 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-81413102-4b1e-4766-842e-f844397b8b15 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Searching by: {'name': 't-ListServerFiltersTestJSON-instance-138088913', 'deleted': False, 'project_id': '04ef687c40bd45c297d22a791bae58cf'} {{(pid=121402) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 01 19:10:38.565463 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-81413102-4b1e-4766-842e-f844397b8b15 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:38.565955 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-81413102-4b1e-4766-842e-f844397b8b15 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:38.566385 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-81413102-4b1e-4766-842e-f844397b8b15 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:38.567107 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-81413102-4b1e-4766-842e-f844397b8b15 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:38.567702 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-81413102-4b1e-4766-842e-f844397b8b15 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:38.567969 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-81413102-4b1e-4766-842e-f844397b8b15 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:38.572151 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-e5f5264d-f3a3-479f-8c70-8902fc3910f6 tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3111dabbf6d14e2c91766f2f5544057c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c30003431656408bb328e90be22d009a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:10:38.574078 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-e5f5264d-f3a3-479f-8c70-8902fc3910f6 tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3111dabbf6d14e2c91766f2f5544057c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c30003431656408bb328e90be22d009a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:10:38.576825 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-e5f5264d-f3a3-479f-8c70-8902fc3910f6 tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] 10.222.0.13 "GET /compute/v2.1/servers/29b73e88-1e2a-45d8-bdbb-6c5f9399d270" status: 200 len: 1366 microversion: 2.57 time: 0.662395 Nov 01 19:10:38.577608 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 2057/4026] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 19:10:37 2022] GET /compute/v2.1/servers/29b73e88-1e2a-45d8-bdbb-6c5f9399d270 => generated 1366 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 19:10:38.656021 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-d3b7bd15-7c0e-45ee-a487-8dfb9f207572 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:10:38.657224 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-d3b7bd15-7c0e-45ee-a487-8dfb9f207572 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] [instance: af1071a8-a090-44c9-890c-123ca3ff39f1] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:10:38.671352 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d3b7bd15-7c0e-45ee-a487-8dfb9f207572 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:38.672881 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d3b7bd15-7c0e-45ee-a487-8dfb9f207572 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:38.673852 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d3b7bd15-7c0e-45ee-a487-8dfb9f207572 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:38.676097 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d3b7bd15-7c0e-45ee-a487-8dfb9f207572 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:38.677958 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d3b7bd15-7c0e-45ee-a487-8dfb9f207572 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:38.679286 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d3b7bd15-7c0e-45ee-a487-8dfb9f207572 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:38.695779 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.multi_cell_list [None req-81413102-4b1e-4766-842e-f844397b8b15 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=121402) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 01 19:10:38.820367 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-81413102-4b1e-4766-842e-f844397b8b15 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] 10.222.0.13 "GET /compute/v2.1/servers?name=t-ListServerFiltersTestJSON-instance-138088913" status: 200 len: 346 microversion: 2.1 time: 0.274124 Nov 01 19:10:38.821719 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1970/4027] 10.222.0.13 () {58 vars in 1228 bytes} [Tue Nov 1 19:10:38 2022] GET /compute/v2.1/servers?name=t-ListServerFiltersTestJSON-instance-138088913 => generated 346 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:10:38.835250 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-23a70997-c642-4f83-9dae-ed799aff2710 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:10:38.835750 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-23a70997-c642-4f83-9dae-ed799aff2710 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] [instance: 42415fcc-ac00-4854-bc88-0416ef12d8cb] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:10:38.854268 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-23a70997-c642-4f83-9dae-ed799aff2710 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:38.854768 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-23a70997-c642-4f83-9dae-ed799aff2710 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:38.855204 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-23a70997-c642-4f83-9dae-ed799aff2710 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:38.855910 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-23a70997-c642-4f83-9dae-ed799aff2710 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:38.856364 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-23a70997-c642-4f83-9dae-ed799aff2710 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:38.856811 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-23a70997-c642-4f83-9dae-ed799aff2710 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:38.865426 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-d3b7bd15-7c0e-45ee-a487-8dfb9f207572 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '301ed3b9c37449bc9ade378f3c73a768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8807757227574c828dca1947af76659d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:10:38.878280 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-d3b7bd15-7c0e-45ee-a487-8dfb9f207572 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '301ed3b9c37449bc9ade378f3c73a768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8807757227574c828dca1947af76659d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:10:38.886627 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-d3b7bd15-7c0e-45ee-a487-8dfb9f207572 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '301ed3b9c37449bc9ade378f3c73a768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8807757227574c828dca1947af76659d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:10:38.889176 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-d3b7bd15-7c0e-45ee-a487-8dfb9f207572 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] 10.222.0.13 "GET /compute/v2.1/servers/af1071a8-a090-44c9-890c-123ca3ff39f1" status: 200 len: 1605 microversion: 2.42 time: 0.238699 Nov 01 19:10:38.890002 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 2058/4028] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 19:10:38 2022] GET /compute/v2.1/servers/af1071a8-a090-44c9-890c-123ca3ff39f1 => generated 1605 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 01 19:10:38.939052 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-23a70997-c642-4f83-9dae-ed799aff2710 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] [instance: 42415fcc-ac00-4854-bc88-0416ef12d8cb] Going to try to terminate instance {{(pid=121402) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 01 19:10:38.941948 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-5ffe0fa3-bb8a-400e-8d63-7423c38f52b3 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:10:38.942867 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-5ffe0fa3-bb8a-400e-8d63-7423c38f52b3 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] [instance: ba6ffc5c-84a4-40f1-bdc7-f87dde2c99df] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:10:38.956031 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-5ffe0fa3-bb8a-400e-8d63-7423c38f52b3 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:38.958360 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-5ffe0fa3-bb8a-400e-8d63-7423c38f52b3 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:38.960757 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-5ffe0fa3-bb8a-400e-8d63-7423c38f52b3 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:38.961623 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-5ffe0fa3-bb8a-400e-8d63-7423c38f52b3 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:38.964146 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-5ffe0fa3-bb8a-400e-8d63-7423c38f52b3 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:38.964799 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-5ffe0fa3-bb8a-400e-8d63-7423c38f52b3 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:39.114983 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-23a70997-c642-4f83-9dae-ed799aff2710 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] 10.222.0.13 "DELETE /compute/v2.1/servers/42415fcc-ac00-4854-bc88-0416ef12d8cb" status: 204 len: 0 microversion: 2.1 time: 0.283401 Nov 01 19:10:39.119353 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1971/4029] 10.222.0.13 () {58 vars in 1239 bytes} [Tue Nov 1 19:10:38 2022] DELETE /compute/v2.1/servers/42415fcc-ac00-4854-bc88-0416ef12d8cb => generated 0 bytes in 286 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 01 19:10:39.126338 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-a8e81047-b5a7-4fa3-9e65-f90e3769b6e3 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:10:39.127447 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-a8e81047-b5a7-4fa3-9e65-f90e3769b6e3 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] [instance: 42415fcc-ac00-4854-bc88-0416ef12d8cb] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:10:39.150881 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-a8e81047-b5a7-4fa3-9e65-f90e3769b6e3 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:39.152046 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-a8e81047-b5a7-4fa3-9e65-f90e3769b6e3 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:39.152987 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-a8e81047-b5a7-4fa3-9e65-f90e3769b6e3 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:39.154034 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-a8e81047-b5a7-4fa3-9e65-f90e3769b6e3 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:39.154771 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-a8e81047-b5a7-4fa3-9e65-f90e3769b6e3 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:39.157824 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-a8e81047-b5a7-4fa3-9e65-f90e3769b6e3 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:39.183487 n-d-863052-2 devstack@n-api.service[121402]: DEBUG dbcounter [-] [121402] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=121402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 19:10:39.460616 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-5ffe0fa3-bb8a-400e-8d63-7423c38f52b3 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd2105b0264b48d084d0e79cabff8bc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf4adda91364dab94830347c06e3957', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:10:39.474472 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-5ffe0fa3-bb8a-400e-8d63-7423c38f52b3 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd2105b0264b48d084d0e79cabff8bc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf4adda91364dab94830347c06e3957', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:10:39.477431 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-5ffe0fa3-bb8a-400e-8d63-7423c38f52b3 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd2105b0264b48d084d0e79cabff8bc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf4adda91364dab94830347c06e3957', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:10:39.479843 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-5ffe0fa3-bb8a-400e-8d63-7423c38f52b3 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] 10.222.0.13 "GET /compute/v2.1/servers/ba6ffc5c-84a4-40f1-bdc7-f87dde2c99df" status: 200 len: 2952 microversion: 2.32 time: 0.543409 Nov 01 19:10:39.493660 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-a8e81047-b5a7-4fa3-9e65-f90e3769b6e3 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2868ccfdfb164cffa37232c821f205a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04ef687c40bd45c297d22a791bae58cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:10:39.495177 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 2059/4030] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 19:10:38 2022] GET /compute/v2.1/servers/ba6ffc5c-84a4-40f1-bdc7-f87dde2c99df => generated 2952 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 01 19:10:39.501318 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-a8e81047-b5a7-4fa3-9e65-f90e3769b6e3 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] 10.222.0.13 "GET /compute/v2.1/servers/42415fcc-ac00-4854-bc88-0416ef12d8cb" status: 200 len: 1518 microversion: 2.1 time: 0.377373 Nov 01 19:10:39.501523 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1972/4031] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:10:39 2022] GET /compute/v2.1/servers/42415fcc-ac00-4854-bc88-0416ef12d8cb => generated 1518 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:10:39.501985 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-1e39e361-cac0-40d1-8cb0-bcc9874d4756 tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:10:39.502969 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-1e39e361-cac0-40d1-8cb0-bcc9874d4756 tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] [instance: 7ee07462-fab6-49a3-b7fd-cbe545cc6f55] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:10:39.510229 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-1e39e361-cac0-40d1-8cb0-bcc9874d4756 tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:39.510837 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-1e39e361-cac0-40d1-8cb0-bcc9874d4756 tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:39.511374 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-1e39e361-cac0-40d1-8cb0-bcc9874d4756 tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:39.513635 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-1e39e361-cac0-40d1-8cb0-bcc9874d4756 tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:39.514669 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-1e39e361-cac0-40d1-8cb0-bcc9874d4756 tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:39.515927 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-1e39e361-cac0-40d1-8cb0-bcc9874d4756 tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:39.606534 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-520c4abf-5e53-49db-811f-f9f0f2f742f1 tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:10:39.607138 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-520c4abf-5e53-49db-811f-f9f0f2f742f1 tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] [instance: 29b73e88-1e2a-45d8-bdbb-6c5f9399d270] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:10:39.626057 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-520c4abf-5e53-49db-811f-f9f0f2f742f1 tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:39.626559 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-520c4abf-5e53-49db-811f-f9f0f2f742f1 tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:39.626995 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-520c4abf-5e53-49db-811f-f9f0f2f742f1 tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:39.628495 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-520c4abf-5e53-49db-811f-f9f0f2f742f1 tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:39.628754 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-520c4abf-5e53-49db-811f-f9f0f2f742f1 tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:39.629167 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-520c4abf-5e53-49db-811f-f9f0f2f742f1 tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:39.785496 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-520c4abf-5e53-49db-811f-f9f0f2f742f1 tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3111dabbf6d14e2c91766f2f5544057c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c30003431656408bb328e90be22d009a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:10:39.793825 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-520c4abf-5e53-49db-811f-f9f0f2f742f1 tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3111dabbf6d14e2c91766f2f5544057c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c30003431656408bb328e90be22d009a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:10:39.795276 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-520c4abf-5e53-49db-811f-f9f0f2f742f1 tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3111dabbf6d14e2c91766f2f5544057c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c30003431656408bb328e90be22d009a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:10:39.802351 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-520c4abf-5e53-49db-811f-f9f0f2f742f1 tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] 10.222.0.13 "GET /compute/v2.1/servers/29b73e88-1e2a-45d8-bdbb-6c5f9399d270" status: 200 len: 1366 microversion: 2.57 time: 0.199820 Nov 01 19:10:39.804919 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1973/4032] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 19:10:39 2022] GET /compute/v2.1/servers/29b73e88-1e2a-45d8-bdbb-6c5f9399d270 => generated 1366 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 19:10:39.919350 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-dff9173a-0b36-4927-bf79-4e086e38feea tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:10:39.920183 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-dff9173a-0b36-4927-bf79-4e086e38feea tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] [instance: af1071a8-a090-44c9-890c-123ca3ff39f1] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:10:39.932792 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-dff9173a-0b36-4927-bf79-4e086e38feea tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:39.933511 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-dff9173a-0b36-4927-bf79-4e086e38feea tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:39.938059 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-dff9173a-0b36-4927-bf79-4e086e38feea tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:39.941446 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-dff9173a-0b36-4927-bf79-4e086e38feea tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:39.942625 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-dff9173a-0b36-4927-bf79-4e086e38feea tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:39.943287 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-dff9173a-0b36-4927-bf79-4e086e38feea tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:40.063767 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-1e39e361-cac0-40d1-8cb0-bcc9874d4756 tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c72e7e000a9a4fa49474bd5d19accf77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d8835c7b6754bfd81447b1f8893e56c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:10:40.075656 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-1e39e361-cac0-40d1-8cb0-bcc9874d4756 tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] 10.222.0.13 "GET /compute/v2.1/servers/7ee07462-fab6-49a3-b7fd-cbe545cc6f55" status: 200 len: 1316 microversion: 2.1 time: 0.577544 Nov 01 19:10:40.094103 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 2060/4033] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:10:39 2022] GET /compute/v2.1/servers/7ee07462-fab6-49a3-b7fd-cbe545cc6f55 => generated 1316 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:10:40.239546 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-dff9173a-0b36-4927-bf79-4e086e38feea tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '301ed3b9c37449bc9ade378f3c73a768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8807757227574c828dca1947af76659d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:10:40.254646 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-dff9173a-0b36-4927-bf79-4e086e38feea tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '301ed3b9c37449bc9ade378f3c73a768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8807757227574c828dca1947af76659d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:10:40.257148 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-dff9173a-0b36-4927-bf79-4e086e38feea tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '301ed3b9c37449bc9ade378f3c73a768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8807757227574c828dca1947af76659d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:10:40.258390 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-dff9173a-0b36-4927-bf79-4e086e38feea tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] 10.222.0.13 "GET /compute/v2.1/servers/af1071a8-a090-44c9-890c-123ca3ff39f1" status: 200 len: 1605 microversion: 2.42 time: 0.343308 Nov 01 19:10:40.258958 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1974/4034] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 19:10:39 2022] GET /compute/v2.1/servers/af1071a8-a090-44c9-890c-123ca3ff39f1 => generated 1605 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 19:10:40.513617 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-a871b242-b0fd-43ff-a219-2de086dd07dc tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:10:40.514369 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-a871b242-b0fd-43ff-a219-2de086dd07dc tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] [instance: ba6ffc5c-84a4-40f1-bdc7-f87dde2c99df] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:10:40.524291 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-a871b242-b0fd-43ff-a219-2de086dd07dc tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:40.524822 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-a871b242-b0fd-43ff-a219-2de086dd07dc tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:40.527105 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-e529c0a4-bddc-451c-89c3-efe920c866f9 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:10:40.527725 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-e529c0a4-bddc-451c-89c3-efe920c866f9 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] [instance: 42415fcc-ac00-4854-bc88-0416ef12d8cb] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:10:40.531527 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-a871b242-b0fd-43ff-a219-2de086dd07dc tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:40.532271 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-a871b242-b0fd-43ff-a219-2de086dd07dc tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:40.532774 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-a871b242-b0fd-43ff-a219-2de086dd07dc tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:40.533203 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-a871b242-b0fd-43ff-a219-2de086dd07dc tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:40.536327 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e529c0a4-bddc-451c-89c3-efe920c866f9 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:40.537165 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e529c0a4-bddc-451c-89c3-efe920c866f9 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:40.537861 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e529c0a4-bddc-451c-89c3-efe920c866f9 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:40.539680 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e529c0a4-bddc-451c-89c3-efe920c866f9 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:40.541054 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e529c0a4-bddc-451c-89c3-efe920c866f9 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:40.541619 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e529c0a4-bddc-451c-89c3-efe920c866f9 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:40.950834 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-a871b242-b0fd-43ff-a219-2de086dd07dc tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd2105b0264b48d084d0e79cabff8bc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf4adda91364dab94830347c06e3957', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:10:40.962911 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-a871b242-b0fd-43ff-a219-2de086dd07dc tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd2105b0264b48d084d0e79cabff8bc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf4adda91364dab94830347c06e3957', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:10:40.964377 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-a871b242-b0fd-43ff-a219-2de086dd07dc tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd2105b0264b48d084d0e79cabff8bc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf4adda91364dab94830347c06e3957', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:10:40.968145 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-a871b242-b0fd-43ff-a219-2de086dd07dc tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] 10.222.0.13 "GET /compute/v2.1/servers/ba6ffc5c-84a4-40f1-bdc7-f87dde2c99df" status: 200 len: 2952 microversion: 2.32 time: 0.459399 Nov 01 19:10:40.974793 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 2061/4035] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 19:10:40 2022] GET /compute/v2.1/servers/ba6ffc5c-84a4-40f1-bdc7-f87dde2c99df => generated 2952 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 19:10:40.979778 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-01f80326-e977-41b5-9a27-7109ed23cb38 tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:10:40.980407 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-01f80326-e977-41b5-9a27-7109ed23cb38 tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] [instance: 29b73e88-1e2a-45d8-bdbb-6c5f9399d270] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:10:40.999362 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-01f80326-e977-41b5-9a27-7109ed23cb38 tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:40.999876 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-01f80326-e977-41b5-9a27-7109ed23cb38 tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:41.000513 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-01f80326-e977-41b5-9a27-7109ed23cb38 tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:41.005990 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-01f80326-e977-41b5-9a27-7109ed23cb38 tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:41.006672 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-01f80326-e977-41b5-9a27-7109ed23cb38 tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:41.007094 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-01f80326-e977-41b5-9a27-7109ed23cb38 tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:41.018008 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-e529c0a4-bddc-451c-89c3-efe920c866f9 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2868ccfdfb164cffa37232c821f205a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04ef687c40bd45c297d22a791bae58cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:10:41.032123 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-e529c0a4-bddc-451c-89c3-efe920c866f9 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] 10.222.0.13 "GET /compute/v2.1/servers/42415fcc-ac00-4854-bc88-0416ef12d8cb" status: 200 len: 1518 microversion: 2.1 time: 0.504105 Nov 01 19:10:41.033154 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1975/4036] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:10:40 2022] GET /compute/v2.1/servers/42415fcc-ac00-4854-bc88-0416ef12d8cb => generated 1518 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:10:41.038408 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [req-6d058559-8c57-4924-a550-1c630e8441b2 req-2eec5dc6-3145-4495-875d-a100fd009414 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7ee07462-fab6-49a3-b7fd-cbe545cc6f55", "tag": "07f5e414-1917-4efe-9307-869f5b12a987"}]} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:10:41.058510 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-6d058559-8c57-4924-a550-1c630e8441b2 req-2eec5dc6-3145-4495-875d-a100fd009414 service nova] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:41.059455 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-6d058559-8c57-4924-a550-1c630e8441b2 req-2eec5dc6-3145-4495-875d-a100fd009414 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:41.060120 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-6d058559-8c57-4924-a550-1c630e8441b2 req-2eec5dc6-3145-4495-875d-a100fd009414 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:41.107623 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-01f80326-e977-41b5-9a27-7109ed23cb38 tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3111dabbf6d14e2c91766f2f5544057c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c30003431656408bb328e90be22d009a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:10:41.119925 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.compute.server_external_events [req-6d058559-8c57-4924-a550-1c630e8441b2 req-2eec5dc6-3145-4495-875d-a100fd009414 service nova] Creating event network-changed:07f5e414-1917-4efe-9307-869f5b12a987 for instance 7ee07462-fab6-49a3-b7fd-cbe545cc6f55 on n-h1-863052-2 Nov 01 19:10:41.120946 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-01f80326-e977-41b5-9a27-7109ed23cb38 tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3111dabbf6d14e2c91766f2f5544057c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c30003431656408bb328e90be22d009a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:10:41.122955 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-01f80326-e977-41b5-9a27-7109ed23cb38 tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3111dabbf6d14e2c91766f2f5544057c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c30003431656408bb328e90be22d009a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:10:41.124439 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-01f80326-e977-41b5-9a27-7109ed23cb38 tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] 10.222.0.13 "GET /compute/v2.1/servers/29b73e88-1e2a-45d8-bdbb-6c5f9399d270" status: 200 len: 1366 microversion: 2.57 time: 0.148553 Nov 01 19:10:41.125620 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 2062/4037] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 19:10:40 2022] GET /compute/v2.1/servers/29b73e88-1e2a-45d8-bdbb-6c5f9399d270 => generated 1366 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 19:10:41.132201 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-5549f074-1508-4846-8534-89baa5ac3acf tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:10:41.133082 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-5549f074-1508-4846-8534-89baa5ac3acf tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] [instance: 7ee07462-fab6-49a3-b7fd-cbe545cc6f55] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:10:41.147306 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [req-6d058559-8c57-4924-a550-1c630e8441b2 req-2eec5dc6-3145-4495-875d-a100fd009414 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.112084 Nov 01 19:10:41.151027 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-5549f074-1508-4846-8534-89baa5ac3acf tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:41.151524 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-5549f074-1508-4846-8534-89baa5ac3acf tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:41.154455 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1976/4038] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Nov 1 19:10:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:10:41.157254 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-5549f074-1508-4846-8534-89baa5ac3acf tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:41.158056 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-5549f074-1508-4846-8534-89baa5ac3acf tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:41.159056 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-5549f074-1508-4846-8534-89baa5ac3acf tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:41.159487 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-5549f074-1508-4846-8534-89baa5ac3acf tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:41.290605 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-138f418b-ba11-4cb5-82fa-898e2a374a5a tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:10:41.291469 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-138f418b-ba11-4cb5-82fa-898e2a374a5a tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] [instance: af1071a8-a090-44c9-890c-123ca3ff39f1] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:10:41.304388 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-138f418b-ba11-4cb5-82fa-898e2a374a5a tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:41.305051 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-138f418b-ba11-4cb5-82fa-898e2a374a5a tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:41.305580 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-138f418b-ba11-4cb5-82fa-898e2a374a5a tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:41.306378 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-138f418b-ba11-4cb5-82fa-898e2a374a5a tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:41.309187 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-138f418b-ba11-4cb5-82fa-898e2a374a5a tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:41.309914 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-138f418b-ba11-4cb5-82fa-898e2a374a5a tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:41.527715 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-5549f074-1508-4846-8534-89baa5ac3acf tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c72e7e000a9a4fa49474bd5d19accf77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d8835c7b6754bfd81447b1f8893e56c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:10:41.537419 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-5549f074-1508-4846-8534-89baa5ac3acf tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] 10.222.0.13 "GET /compute/v2.1/servers/7ee07462-fab6-49a3-b7fd-cbe545cc6f55" status: 200 len: 1316 microversion: 2.1 time: 0.410392 Nov 01 19:10:41.540456 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 2063/4039] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:10:41 2022] GET /compute/v2.1/servers/7ee07462-fab6-49a3-b7fd-cbe545cc6f55 => generated 1316 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:10:41.713476 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-138f418b-ba11-4cb5-82fa-898e2a374a5a tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '301ed3b9c37449bc9ade378f3c73a768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8807757227574c828dca1947af76659d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:10:41.724890 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-138f418b-ba11-4cb5-82fa-898e2a374a5a tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '301ed3b9c37449bc9ade378f3c73a768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8807757227574c828dca1947af76659d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:10:41.737354 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-138f418b-ba11-4cb5-82fa-898e2a374a5a tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '301ed3b9c37449bc9ade378f3c73a768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8807757227574c828dca1947af76659d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:10:41.739271 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-138f418b-ba11-4cb5-82fa-898e2a374a5a tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] 10.222.0.13 "GET /compute/v2.1/servers/af1071a8-a090-44c9-890c-123ca3ff39f1" status: 200 len: 1605 microversion: 2.42 time: 0.452829 Nov 01 19:10:41.743743 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1977/4040] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 19:10:41 2022] GET /compute/v2.1/servers/af1071a8-a090-44c9-890c-123ca3ff39f1 => generated 1605 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 19:10:41.998101 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-58ac0214-97e1-4a23-babb-9a52010bc3c8 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:10:41.998708 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-58ac0214-97e1-4a23-babb-9a52010bc3c8 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] [instance: ba6ffc5c-84a4-40f1-bdc7-f87dde2c99df] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:10:42.009857 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-58ac0214-97e1-4a23-babb-9a52010bc3c8 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:42.013960 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-58ac0214-97e1-4a23-babb-9a52010bc3c8 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:42.014627 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-58ac0214-97e1-4a23-babb-9a52010bc3c8 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:42.015536 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-58ac0214-97e1-4a23-babb-9a52010bc3c8 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:42.016535 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-58ac0214-97e1-4a23-babb-9a52010bc3c8 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:42.017226 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-58ac0214-97e1-4a23-babb-9a52010bc3c8 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:42.263436 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-4ade872c-f035-46d5-ba68-0299ffc72a62 tempest-InstanceActionsNegativeTestJSON-1175023068 tempest-InstanceActionsNegativeTestJSON-1175023068-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsNegativeTestJSON-server-1263876747", "imageRef": "2d4a0047-1b9e-445f-8af8-1b5c9d93e881", "flavorRef": "452", "networks": [{"uuid": "79210a63-8204-4361-9ad2-712fd4cc1bd8"}]}} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:10:42.345499 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.network.neutron [None req-4ade872c-f035-46d5-ba68-0299ffc72a62 tempest-InstanceActionsNegativeTestJSON-1175023068 tempest-InstanceActionsNegativeTestJSON-1175023068-project] validate_networks() for [('79210a63-8204-4361-9ad2-712fd4cc1bd8', None, None, None, None, None)] {{(pid=121403) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 01 19:10:42.927310 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-58ac0214-97e1-4a23-babb-9a52010bc3c8 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd2105b0264b48d084d0e79cabff8bc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf4adda91364dab94830347c06e3957', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:10:42.943348 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-58ac0214-97e1-4a23-babb-9a52010bc3c8 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd2105b0264b48d084d0e79cabff8bc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf4adda91364dab94830347c06e3957', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:10:42.945985 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-58ac0214-97e1-4a23-babb-9a52010bc3c8 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd2105b0264b48d084d0e79cabff8bc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf4adda91364dab94830347c06e3957', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:10:42.947262 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-58ac0214-97e1-4a23-babb-9a52010bc3c8 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] 10.222.0.13 "GET /compute/v2.1/servers/ba6ffc5c-84a4-40f1-bdc7-f87dde2c99df" status: 200 len: 2952 microversion: 2.32 time: 0.953055 Nov 01 19:10:42.953713 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1978/4041] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 19:10:41 2022] GET /compute/v2.1/servers/ba6ffc5c-84a4-40f1-bdc7-f87dde2c99df => generated 2952 bytes in 960 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 19:10:42.958842 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-34ed0cb7-8a79-4c45-9dd5-c0c6d38180b0 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:10:42.959450 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-34ed0cb7-8a79-4c45-9dd5-c0c6d38180b0 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] [instance: 42415fcc-ac00-4854-bc88-0416ef12d8cb] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:10:42.970287 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-34ed0cb7-8a79-4c45-9dd5-c0c6d38180b0 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:42.980811 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-34ed0cb7-8a79-4c45-9dd5-c0c6d38180b0 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:42.981272 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-34ed0cb7-8a79-4c45-9dd5-c0c6d38180b0 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:42.982008 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-34ed0cb7-8a79-4c45-9dd5-c0c6d38180b0 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:42.982462 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-34ed0cb7-8a79-4c45-9dd5-c0c6d38180b0 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:42.987064 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-34ed0cb7-8a79-4c45-9dd5-c0c6d38180b0 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:43.159055 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-34ed0cb7-8a79-4c45-9dd5-c0c6d38180b0 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2868ccfdfb164cffa37232c821f205a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04ef687c40bd45c297d22a791bae58cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:10:43.174767 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-34ed0cb7-8a79-4c45-9dd5-c0c6d38180b0 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] 10.222.0.13 "GET /compute/v2.1/servers/42415fcc-ac00-4854-bc88-0416ef12d8cb" status: 200 len: 1476 microversion: 2.1 time: 0.219022 Nov 01 19:10:43.175832 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1979/4042] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:10:42 2022] GET /compute/v2.1/servers/42415fcc-ac00-4854-bc88-0416ef12d8cb => generated 1476 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:10:43.193204 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-395fe14b-9bc0-4ebd-ab2a-c85fcfc015ae tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:10:43.193828 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-395fe14b-9bc0-4ebd-ab2a-c85fcfc015ae tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] [instance: 29b73e88-1e2a-45d8-bdbb-6c5f9399d270] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:10:43.199805 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-395fe14b-9bc0-4ebd-ab2a-c85fcfc015ae tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:43.203009 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-395fe14b-9bc0-4ebd-ab2a-c85fcfc015ae tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:43.203456 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-395fe14b-9bc0-4ebd-ab2a-c85fcfc015ae tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:43.208446 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-395fe14b-9bc0-4ebd-ab2a-c85fcfc015ae tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:43.209211 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-395fe14b-9bc0-4ebd-ab2a-c85fcfc015ae tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:43.209836 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-395fe14b-9bc0-4ebd-ab2a-c85fcfc015ae tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:43.246441 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.virt.hardware [None req-4ade872c-f035-46d5-ba68-0299ffc72a62 tempest-InstanceActionsNegativeTestJSON-1175023068 tempest-InstanceActionsNegativeTestJSON-1175023068-project] Flavor limits 0:0:0 {{(pid=121403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 01 19:10:43.247214 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.virt.hardware [None req-4ade872c-f035-46d5-ba68-0299ffc72a62 tempest-InstanceActionsNegativeTestJSON-1175023068 tempest-InstanceActionsNegativeTestJSON-1175023068-project] Image limits 0:0:0 {{(pid=121403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 01 19:10:43.247946 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.virt.hardware [None req-4ade872c-f035-46d5-ba68-0299ffc72a62 tempest-InstanceActionsNegativeTestJSON-1175023068 tempest-InstanceActionsNegativeTestJSON-1175023068-project] Flavor pref 0:0:0 {{(pid=121403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 01 19:10:43.248607 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.virt.hardware [None req-4ade872c-f035-46d5-ba68-0299ffc72a62 tempest-InstanceActionsNegativeTestJSON-1175023068 tempest-InstanceActionsNegativeTestJSON-1175023068-project] Image pref 0:0:0 {{(pid=121403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 01 19:10:43.249690 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.virt.hardware [None req-4ade872c-f035-46d5-ba68-0299ffc72a62 tempest-InstanceActionsNegativeTestJSON-1175023068 tempest-InstanceActionsNegativeTestJSON-1175023068-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 01 19:10:43.263834 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-4ade872c-f035-46d5-ba68-0299ffc72a62 tempest-InstanceActionsNegativeTestJSON-1175023068 tempest-InstanceActionsNegativeTestJSON-1175023068-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:43.265335 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-4ade872c-f035-46d5-ba68-0299ffc72a62 tempest-InstanceActionsNegativeTestJSON-1175023068 tempest-InstanceActionsNegativeTestJSON-1175023068-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:43.266066 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-4ade872c-f035-46d5-ba68-0299ffc72a62 tempest-InstanceActionsNegativeTestJSON-1175023068 tempest-InstanceActionsNegativeTestJSON-1175023068-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:43.270296 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-4ade872c-f035-46d5-ba68-0299ffc72a62 tempest-InstanceActionsNegativeTestJSON-1175023068 tempest-InstanceActionsNegativeTestJSON-1175023068-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:43.271091 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-4ade872c-f035-46d5-ba68-0299ffc72a62 tempest-InstanceActionsNegativeTestJSON-1175023068 tempest-InstanceActionsNegativeTestJSON-1175023068-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:43.272018 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-4ade872c-f035-46d5-ba68-0299ffc72a62 tempest-InstanceActionsNegativeTestJSON-1175023068 tempest-InstanceActionsNegativeTestJSON-1175023068-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:43.298093 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.quota [None req-4ade872c-f035-46d5-ba68-0299ffc72a62 tempest-InstanceActionsNegativeTestJSON-1175023068 tempest-InstanceActionsNegativeTestJSON-1175023068-project] Getting quotas for project ba92568b226b4ea793c9f40cf9b97839. Resources: {'cores', 'ram', 'instances'} {{(pid=121403) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 01 19:10:43.305302 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.quota [None req-4ade872c-f035-46d5-ba68-0299ffc72a62 tempest-InstanceActionsNegativeTestJSON-1175023068 tempest-InstanceActionsNegativeTestJSON-1175023068-project] Getting quotas for user 90eeeb07a21345f5801a340078809488 and project ba92568b226b4ea793c9f40cf9b97839. Resources: {'cores', 'ram', 'instances'} {{(pid=121403) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 01 19:10:43.338372 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-4ade872c-f035-46d5-ba68-0299ffc72a62 tempest-InstanceActionsNegativeTestJSON-1175023068 tempest-InstanceActionsNegativeTestJSON-1175023068-project] Going to run 1 instances... {{(pid=121403) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 01 19:10:43.343859 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-4ade872c-f035-46d5-ba68-0299ffc72a62 tempest-InstanceActionsNegativeTestJSON-1175023068 tempest-InstanceActionsNegativeTestJSON-1175023068-project] [instance: 9ddd96fd-cb96-4808-9172-2785776d2d1d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2d4a0047-1b9e-445f-8af8-1b5c9d93e881',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121403) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 01 19:10:43.495614 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-4ade872c-f035-46d5-ba68-0299ffc72a62 tempest-InstanceActionsNegativeTestJSON-1175023068 tempest-InstanceActionsNegativeTestJSON-1175023068-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.646913 Nov 01 19:10:43.497779 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 2064/4043] 10.222.0.13 () {60 vars in 1147 bytes} [Tue Nov 1 19:10:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 1653 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 01 19:10:43.505032 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-395fe14b-9bc0-4ebd-ab2a-c85fcfc015ae tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3111dabbf6d14e2c91766f2f5544057c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c30003431656408bb328e90be22d009a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:10:43.515519 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-fe683a00-2107-49bf-bcf9-d3ce6a8906ac tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:10:43.525994 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-fe683a00-2107-49bf-bcf9-d3ce6a8906ac tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] [instance: 7ee07462-fab6-49a3-b7fd-cbe545cc6f55] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:10:43.532921 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-395fe14b-9bc0-4ebd-ab2a-c85fcfc015ae tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3111dabbf6d14e2c91766f2f5544057c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c30003431656408bb328e90be22d009a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:10:43.534571 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-395fe14b-9bc0-4ebd-ab2a-c85fcfc015ae tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3111dabbf6d14e2c91766f2f5544057c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c30003431656408bb328e90be22d009a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:10:43.535800 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-395fe14b-9bc0-4ebd-ab2a-c85fcfc015ae tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] 10.222.0.13 "GET /compute/v2.1/servers/29b73e88-1e2a-45d8-bdbb-6c5f9399d270" status: 200 len: 1366 microversion: 2.57 time: 0.359097 Nov 01 19:10:43.536381 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1980/4044] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 19:10:43 2022] GET /compute/v2.1/servers/29b73e88-1e2a-45d8-bdbb-6c5f9399d270 => generated 1366 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 19:10:43.564091 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-fe683a00-2107-49bf-bcf9-d3ce6a8906ac tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:43.565104 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-fe683a00-2107-49bf-bcf9-d3ce6a8906ac tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:43.565542 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-fe683a00-2107-49bf-bcf9-d3ce6a8906ac tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:43.567944 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-9db36c6b-ed4a-41b6-95c0-465513380a3c tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:10:43.569091 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-9db36c6b-ed4a-41b6-95c0-465513380a3c tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] [instance: af1071a8-a090-44c9-890c-123ca3ff39f1] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:10:43.571294 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-fe683a00-2107-49bf-bcf9-d3ce6a8906ac tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:43.578856 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-fe683a00-2107-49bf-bcf9-d3ce6a8906ac tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:43.579497 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-fe683a00-2107-49bf-bcf9-d3ce6a8906ac tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:43.616538 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-9db36c6b-ed4a-41b6-95c0-465513380a3c tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:43.617689 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-9db36c6b-ed4a-41b6-95c0-465513380a3c tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:43.618534 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-9db36c6b-ed4a-41b6-95c0-465513380a3c tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:43.619246 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-9db36c6b-ed4a-41b6-95c0-465513380a3c tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:43.619718 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-9db36c6b-ed4a-41b6-95c0-465513380a3c tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:43.620149 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-9db36c6b-ed4a-41b6-95c0-465513380a3c tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:43.790295 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-9db36c6b-ed4a-41b6-95c0-465513380a3c tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '301ed3b9c37449bc9ade378f3c73a768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8807757227574c828dca1947af76659d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:10:43.833278 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-9db36c6b-ed4a-41b6-95c0-465513380a3c tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '301ed3b9c37449bc9ade378f3c73a768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8807757227574c828dca1947af76659d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:10:43.834873 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-9db36c6b-ed4a-41b6-95c0-465513380a3c tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '301ed3b9c37449bc9ade378f3c73a768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8807757227574c828dca1947af76659d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:10:43.836112 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-9db36c6b-ed4a-41b6-95c0-465513380a3c tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] 10.222.0.13 "GET /compute/v2.1/servers/af1071a8-a090-44c9-890c-123ca3ff39f1" status: 200 len: 1605 microversion: 2.42 time: 0.298757 Nov 01 19:10:43.853691 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1981/4045] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 19:10:43 2022] GET /compute/v2.1/servers/af1071a8-a090-44c9-890c-123ca3ff39f1 => generated 1605 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 19:10:43.865591 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [req-04a63a45-ee53-48ab-867a-0782f73737a1 req-de28ff93-ae38-4105-8f7a-ac6299b6643c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "42415fcc-ac00-4854-bc88-0416ef12d8cb", "name": "network-vif-deleted", "tag": "8ff40252-03e6-43f2-9f03-0b314534b983"}]} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:10:43.917240 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-04a63a45-ee53-48ab-867a-0782f73737a1 req-de28ff93-ae38-4105-8f7a-ac6299b6643c service nova] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:43.918952 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-04a63a45-ee53-48ab-867a-0782f73737a1 req-de28ff93-ae38-4105-8f7a-ac6299b6643c service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:43.922975 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-04a63a45-ee53-48ab-867a-0782f73737a1 req-de28ff93-ae38-4105-8f7a-ac6299b6643c service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:43.982107 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.compute.server_external_events [req-04a63a45-ee53-48ab-867a-0782f73737a1 req-de28ff93-ae38-4105-8f7a-ac6299b6643c service nova] Creating event network-vif-deleted:8ff40252-03e6-43f2-9f03-0b314534b983 for instance 42415fcc-ac00-4854-bc88-0416ef12d8cb on n-h1-863052-2 Nov 01 19:10:43.999226 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [req-04a63a45-ee53-48ab-867a-0782f73737a1 req-de28ff93-ae38-4105-8f7a-ac6299b6643c service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.150347 Nov 01 19:10:44.003109 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1982/4046] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Nov 1 19:10:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:10:44.007825 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-fe683a00-2107-49bf-bcf9-d3ce6a8906ac tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c72e7e000a9a4fa49474bd5d19accf77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d8835c7b6754bfd81447b1f8893e56c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:10:44.013800 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-1ce9b655-a59a-4690-a5b1-e9030c4a1f26 tempest-InstanceActionsNegativeTestJSON-1175023068 tempest-InstanceActionsNegativeTestJSON-1175023068-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:10:44.016403 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-fe683a00-2107-49bf-bcf9-d3ce6a8906ac tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] 10.222.0.13 "GET /compute/v2.1/servers/7ee07462-fab6-49a3-b7fd-cbe545cc6f55" status: 200 len: 1316 microversion: 2.1 time: 0.516681 Nov 01 19:10:44.018083 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-1ce9b655-a59a-4690-a5b1-e9030c4a1f26 tempest-InstanceActionsNegativeTestJSON-1175023068 tempest-InstanceActionsNegativeTestJSON-1175023068-project] [instance: 9ddd96fd-cb96-4808-9172-2785776d2d1d] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:10:44.020932 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 2065/4047] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:10:43 2022] GET /compute/v2.1/servers/7ee07462-fab6-49a3-b7fd-cbe545cc6f55 => generated 1316 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:10:44.030124 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-45ee9696-5ebb-47a7-8296-d255e06e9199 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:10:44.037992 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-45ee9696-5ebb-47a7-8296-d255e06e9199 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] [instance: ba6ffc5c-84a4-40f1-bdc7-f87dde2c99df] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:10:44.045478 n-d-863052-2 devstack@n-api.service[121403]: DEBUG dbcounter [-] [121403] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=121403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 19:10:44.059780 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-45ee9696-5ebb-47a7-8296-d255e06e9199 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:44.060386 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-45ee9696-5ebb-47a7-8296-d255e06e9199 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:44.060828 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-45ee9696-5ebb-47a7-8296-d255e06e9199 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:44.061806 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-45ee9696-5ebb-47a7-8296-d255e06e9199 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:44.062263 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-45ee9696-5ebb-47a7-8296-d255e06e9199 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:44.080955 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-45ee9696-5ebb-47a7-8296-d255e06e9199 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:44.213019 n-d-863052-2 devstack@n-api.service[121402]: DEBUG dbcounter [-] [121402] Writing DB stats nova_cell0:SELECT=8 {{(pid=121402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 19:10:44.257309 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-1ce9b655-a59a-4690-a5b1-e9030c4a1f26 tempest-InstanceActionsNegativeTestJSON-1175023068 tempest-InstanceActionsNegativeTestJSON-1175023068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90eeeb07a21345f5801a340078809488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba92568b226b4ea793c9f40cf9b97839', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:10:44.272206 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-1ce9b655-a59a-4690-a5b1-e9030c4a1f26 tempest-InstanceActionsNegativeTestJSON-1175023068 tempest-InstanceActionsNegativeTestJSON-1175023068-project] 10.222.0.13 "GET /compute/v2.1/servers/9ddd96fd-cb96-4808-9172-2785776d2d1d" status: 200 len: 1225 microversion: 2.1 time: 0.266835 Nov 01 19:10:44.276015 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1983/4048] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:10:44 2022] GET /compute/v2.1/servers/9ddd96fd-cb96-4808-9172-2785776d2d1d => generated 1225 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:10:44.289952 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-0e80b574-d6c6-4adf-93cd-404406f86234 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:10:44.290577 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-0e80b574-d6c6-4adf-93cd-404406f86234 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] [instance: 42415fcc-ac00-4854-bc88-0416ef12d8cb] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:10:44.312576 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-0e80b574-d6c6-4adf-93cd-404406f86234 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:44.314889 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-0e80b574-d6c6-4adf-93cd-404406f86234 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:44.315341 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-0e80b574-d6c6-4adf-93cd-404406f86234 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:44.316067 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-0e80b574-d6c6-4adf-93cd-404406f86234 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:44.319086 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-0e80b574-d6c6-4adf-93cd-404406f86234 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:44.320118 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-0e80b574-d6c6-4adf-93cd-404406f86234 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:44.424327 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-0e80b574-d6c6-4adf-93cd-404406f86234 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:44.424863 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-0e80b574-d6c6-4adf-93cd-404406f86234 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:44.425302 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-0e80b574-d6c6-4adf-93cd-404406f86234 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:44.431073 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.objects.instance [None req-0e80b574-d6c6-4adf-93cd-404406f86234 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Lazy-loading 'fault' on Instance uuid 42415fcc-ac00-4854-bc88-0416ef12d8cb {{(pid=121402) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 01 19:10:44.624331 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-45ee9696-5ebb-47a7-8296-d255e06e9199 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd2105b0264b48d084d0e79cabff8bc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf4adda91364dab94830347c06e3957', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:10:44.643882 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-45ee9696-5ebb-47a7-8296-d255e06e9199 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd2105b0264b48d084d0e79cabff8bc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf4adda91364dab94830347c06e3957', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:10:44.649211 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-45ee9696-5ebb-47a7-8296-d255e06e9199 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd2105b0264b48d084d0e79cabff8bc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf4adda91364dab94830347c06e3957', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:10:44.654317 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-45ee9696-5ebb-47a7-8296-d255e06e9199 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] 10.222.0.13 "GET /compute/v2.1/servers/ba6ffc5c-84a4-40f1-bdc7-f87dde2c99df" status: 200 len: 2931 microversion: 2.32 time: 0.629607 Nov 01 19:10:44.657062 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-0e80b574-d6c6-4adf-93cd-404406f86234 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2868ccfdfb164cffa37232c821f205a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04ef687c40bd45c297d22a791bae58cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:10:44.659926 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 2066/4049] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 19:10:44 2022] GET /compute/v2.1/servers/ba6ffc5c-84a4-40f1-bdc7-f87dde2c99df => generated 2931 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 19:10:44.681033 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-0e80b574-d6c6-4adf-93cd-404406f86234 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] 10.222.0.13 "GET /compute/v2.1/servers/42415fcc-ac00-4854-bc88-0416ef12d8cb" status: 200 len: 1310 microversion: 2.1 time: 0.399388 Nov 01 19:10:44.681888 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1984/4050] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:10:44 2022] GET /compute/v2.1/servers/42415fcc-ac00-4854-bc88-0416ef12d8cb => generated 1310 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:10:44.710558 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-487959fe-350e-456c-9710-c7795443ea65 tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:10:44.711198 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-487959fe-350e-456c-9710-c7795443ea65 tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] [instance: 29b73e88-1e2a-45d8-bdbb-6c5f9399d270] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:10:44.735341 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-487959fe-350e-456c-9710-c7795443ea65 tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:44.736234 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-487959fe-350e-456c-9710-c7795443ea65 tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:44.736900 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-487959fe-350e-456c-9710-c7795443ea65 tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:44.738846 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-487959fe-350e-456c-9710-c7795443ea65 tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:44.741600 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-487959fe-350e-456c-9710-c7795443ea65 tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:44.742760 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-487959fe-350e-456c-9710-c7795443ea65 tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:44.794399 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [req-accce490-e020-4852-80d8-1d93cf05613e req-f33a3d97-55b7-477e-9fe8-7d23c039d054 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ba6ffc5c-84a4-40f1-bdc7-f87dde2c99df", "name": "network-vif-unplugged", "status": "completed", "tag": "50c047f7-0828-439d-8aac-50370fc1454f"}]} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:10:44.810283 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-accce490-e020-4852-80d8-1d93cf05613e req-f33a3d97-55b7-477e-9fe8-7d23c039d054 service nova] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:44.810767 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-accce490-e020-4852-80d8-1d93cf05613e req-f33a3d97-55b7-477e-9fe8-7d23c039d054 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:44.811451 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-accce490-e020-4852-80d8-1d93cf05613e req-f33a3d97-55b7-477e-9fe8-7d23c039d054 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:44.858734 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.compute.server_external_events [req-accce490-e020-4852-80d8-1d93cf05613e req-f33a3d97-55b7-477e-9fe8-7d23c039d054 service nova] Creating event network-vif-unplugged:50c047f7-0828-439d-8aac-50370fc1454f for instance ba6ffc5c-84a4-40f1-bdc7-f87dde2c99df on n-h1-863052-2 Nov 01 19:10:44.894958 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [req-accce490-e020-4852-80d8-1d93cf05613e req-f33a3d97-55b7-477e-9fe8-7d23c039d054 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.104975 Nov 01 19:10:44.895721 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1985/4051] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Nov 1 19:10:44 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:10:44.914064 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-6b3c0024-b843-42c6-8546-512397db8702 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:10:44.923207 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-6b3c0024-b843-42c6-8546-512397db8702 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] [instance: af1071a8-a090-44c9-890c-123ca3ff39f1] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:10:44.948656 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-6b3c0024-b843-42c6-8546-512397db8702 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:44.949423 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-6b3c0024-b843-42c6-8546-512397db8702 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:44.949990 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-6b3c0024-b843-42c6-8546-512397db8702 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:44.952157 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-6b3c0024-b843-42c6-8546-512397db8702 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:44.954812 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-6b3c0024-b843-42c6-8546-512397db8702 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:44.956158 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-6b3c0024-b843-42c6-8546-512397db8702 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:45.209954 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-487959fe-350e-456c-9710-c7795443ea65 tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3111dabbf6d14e2c91766f2f5544057c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c30003431656408bb328e90be22d009a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:10:45.237508 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-487959fe-350e-456c-9710-c7795443ea65 tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3111dabbf6d14e2c91766f2f5544057c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c30003431656408bb328e90be22d009a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:10:45.239295 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-487959fe-350e-456c-9710-c7795443ea65 tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3111dabbf6d14e2c91766f2f5544057c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c30003431656408bb328e90be22d009a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:10:45.240538 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-487959fe-350e-456c-9710-c7795443ea65 tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] 10.222.0.13 "GET /compute/v2.1/servers/29b73e88-1e2a-45d8-bdbb-6c5f9399d270" status: 200 len: 1366 microversion: 2.57 time: 0.567030 Nov 01 19:10:45.241148 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 2067/4052] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 19:10:44 2022] GET /compute/v2.1/servers/29b73e88-1e2a-45d8-bdbb-6c5f9399d270 => generated 1366 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 19:10:45.271293 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-b8676a1c-623e-475f-8229-bc6cb6168d40 tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:10:45.271926 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-b8676a1c-623e-475f-8229-bc6cb6168d40 tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] [instance: 7ee07462-fab6-49a3-b7fd-cbe545cc6f55] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:10:45.293484 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-b8676a1c-623e-475f-8229-bc6cb6168d40 tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:45.294386 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-b8676a1c-623e-475f-8229-bc6cb6168d40 tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:45.297088 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-b8676a1c-623e-475f-8229-bc6cb6168d40 tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:45.298124 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-b8676a1c-623e-475f-8229-bc6cb6168d40 tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:45.299746 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-b8676a1c-623e-475f-8229-bc6cb6168d40 tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:45.300550 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-b8676a1c-623e-475f-8229-bc6cb6168d40 tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:45.323193 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-6b3c0024-b843-42c6-8546-512397db8702 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '301ed3b9c37449bc9ade378f3c73a768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8807757227574c828dca1947af76659d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:10:45.333972 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-6b3c0024-b843-42c6-8546-512397db8702 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '301ed3b9c37449bc9ade378f3c73a768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8807757227574c828dca1947af76659d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:10:45.335355 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-6b3c0024-b843-42c6-8546-512397db8702 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '301ed3b9c37449bc9ade378f3c73a768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8807757227574c828dca1947af76659d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:10:45.336544 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-6b3c0024-b843-42c6-8546-512397db8702 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] 10.222.0.13 "GET /compute/v2.1/servers/af1071a8-a090-44c9-890c-123ca3ff39f1" status: 200 len: 1605 microversion: 2.42 time: 0.439608 Nov 01 19:10:45.355221 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1986/4053] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 19:10:44 2022] GET /compute/v2.1/servers/af1071a8-a090-44c9-890c-123ca3ff39f1 => generated 1605 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 19:10:45.375137 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-dc9f829b-936b-4ce8-ad90-f5278ae41788 tempest-InstanceActionsNegativeTestJSON-1175023068 tempest-InstanceActionsNegativeTestJSON-1175023068-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:10:45.388935 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-dc9f829b-936b-4ce8-ad90-f5278ae41788 tempest-InstanceActionsNegativeTestJSON-1175023068 tempest-InstanceActionsNegativeTestJSON-1175023068-project] [instance: 9ddd96fd-cb96-4808-9172-2785776d2d1d] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:10:45.400944 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-dc9f829b-936b-4ce8-ad90-f5278ae41788 tempest-InstanceActionsNegativeTestJSON-1175023068 tempest-InstanceActionsNegativeTestJSON-1175023068-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:45.401439 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-dc9f829b-936b-4ce8-ad90-f5278ae41788 tempest-InstanceActionsNegativeTestJSON-1175023068 tempest-InstanceActionsNegativeTestJSON-1175023068-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:45.402285 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-dc9f829b-936b-4ce8-ad90-f5278ae41788 tempest-InstanceActionsNegativeTestJSON-1175023068 tempest-InstanceActionsNegativeTestJSON-1175023068-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:45.403658 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-dc9f829b-936b-4ce8-ad90-f5278ae41788 tempest-InstanceActionsNegativeTestJSON-1175023068 tempest-InstanceActionsNegativeTestJSON-1175023068-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:45.404679 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-dc9f829b-936b-4ce8-ad90-f5278ae41788 tempest-InstanceActionsNegativeTestJSON-1175023068 tempest-InstanceActionsNegativeTestJSON-1175023068-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:45.406265 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-dc9f829b-936b-4ce8-ad90-f5278ae41788 tempest-InstanceActionsNegativeTestJSON-1175023068 tempest-InstanceActionsNegativeTestJSON-1175023068-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:45.767858 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-dc9f829b-936b-4ce8-ad90-f5278ae41788 tempest-InstanceActionsNegativeTestJSON-1175023068 tempest-InstanceActionsNegativeTestJSON-1175023068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90eeeb07a21345f5801a340078809488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba92568b226b4ea793c9f40cf9b97839', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:10:45.777179 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-dc9f829b-936b-4ce8-ad90-f5278ae41788 tempest-InstanceActionsNegativeTestJSON-1175023068 tempest-InstanceActionsNegativeTestJSON-1175023068-project] 10.222.0.13 "GET /compute/v2.1/servers/9ddd96fd-cb96-4808-9172-2785776d2d1d" status: 200 len: 1277 microversion: 2.1 time: 0.420756 Nov 01 19:10:45.780132 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1987/4054] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:10:45 2022] GET /compute/v2.1/servers/9ddd96fd-cb96-4808-9172-2785776d2d1d => generated 1277 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:10:45.796490 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-4ba9dbec-3492-4a92-a45c-e339faa8dea6 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:10:45.797153 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-4ba9dbec-3492-4a92-a45c-e339faa8dea6 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] [instance: ba6ffc5c-84a4-40f1-bdc7-f87dde2c99df] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:10:45.834602 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-4ba9dbec-3492-4a92-a45c-e339faa8dea6 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:45.838139 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-4ba9dbec-3492-4a92-a45c-e339faa8dea6 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:45.842265 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-4ba9dbec-3492-4a92-a45c-e339faa8dea6 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:45.845140 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-4ba9dbec-3492-4a92-a45c-e339faa8dea6 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:45.847435 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-4ba9dbec-3492-4a92-a45c-e339faa8dea6 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:45.848167 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-4ba9dbec-3492-4a92-a45c-e339faa8dea6 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:46.319480 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-4ba9dbec-3492-4a92-a45c-e339faa8dea6 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd2105b0264b48d084d0e79cabff8bc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf4adda91364dab94830347c06e3957', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:10:46.334278 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-4ba9dbec-3492-4a92-a45c-e339faa8dea6 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd2105b0264b48d084d0e79cabff8bc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf4adda91364dab94830347c06e3957', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:10:46.335727 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-4ba9dbec-3492-4a92-a45c-e339faa8dea6 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd2105b0264b48d084d0e79cabff8bc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf4adda91364dab94830347c06e3957', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:10:46.337011 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-4ba9dbec-3492-4a92-a45c-e339faa8dea6 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] 10.222.0.13 "GET /compute/v2.1/servers/ba6ffc5c-84a4-40f1-bdc7-f87dde2c99df" status: 200 len: 2910 microversion: 2.32 time: 0.555621 Nov 01 19:10:46.344698 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1988/4055] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 19:10:45 2022] GET /compute/v2.1/servers/ba6ffc5c-84a4-40f1-bdc7-f87dde2c99df => generated 2910 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 19:10:46.354385 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-564e9e41-3927-4c0b-b7d3-31698a9ff008 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:10:46.357173 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-564e9e41-3927-4c0b-b7d3-31698a9ff008 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] [instance: 42415fcc-ac00-4854-bc88-0416ef12d8cb] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:10:46.376331 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-564e9e41-3927-4c0b-b7d3-31698a9ff008 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:46.377387 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-564e9e41-3927-4c0b-b7d3-31698a9ff008 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:46.377839 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-564e9e41-3927-4c0b-b7d3-31698a9ff008 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:46.378557 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-564e9e41-3927-4c0b-b7d3-31698a9ff008 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:46.379016 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-564e9e41-3927-4c0b-b7d3-31698a9ff008 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:46.379442 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-564e9e41-3927-4c0b-b7d3-31698a9ff008 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:46.409707 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.wsgi [None req-564e9e41-3927-4c0b-b7d3-31698a9ff008 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] HTTP exception thrown: Instance 42415fcc-ac00-4854-bc88-0416ef12d8cb could not be found. Nov 01 19:10:46.411690 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-564e9e41-3927-4c0b-b7d3-31698a9ff008 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Request method failure captured: Nov 01 19:10:46.411690 n-d-863052-2 devstack@n-api.service[121402]: request: GET /compute/v2.1/servers/42415fcc-ac00-4854-bc88-0416ef12d8cb HTTP/1.1 Nov 01 19:10:46.411690 n-d-863052-2 devstack@n-api.service[121402]: Accept: application/json Nov 01 19:10:46.411690 n-d-863052-2 devstack@n-api.service[121402]: Accept-Encoding: identity Nov 01 19:10:46.411690 n-d-863052-2 devstack@n-api.service[121402]: Connection: close Nov 01 19:10:46.411690 n-d-863052-2 devstack@n-api.service[121402]: Content-Length: 0 Nov 01 19:10:46.411690 n-d-863052-2 devstack@n-api.service[121402]: Content-Type: application/json Nov 01 19:10:46.411690 n-d-863052-2 devstack@n-api.service[121402]: Host: 10.222.0.13 Nov 01 19:10:46.411690 n-d-863052-2 devstack@n-api.service[121402]: Openstack-System-Scope: None Nov 01 19:10:46.411690 n-d-863052-2 devstack@n-api.service[121402]: User-Agent: python-urllib3/1.26.12 Nov 01 19:10:46.411690 n-d-863052-2 devstack@n-api.service[121402]: X-Auth-Token: gAAAAABjYW7xdoGEkUr9VmlNUPSTaUXnEM4cFVhCEosnqUFQu-SPdYOizV9_JPssqg1hkQ657RtQWwfdpbqukmZrySteKliSppoCmIGu9rFi0MbFndFq8Bb6qjRB6a9xe1deRV9xVTrc68Ro9pz9WovJ9U7N4N_g2t8EuiUPT8oRYr79Ppgt7Bc Nov 01 19:10:46.411690 n-d-863052-2 devstack@n-api.service[121402]: X-Domain-Id: None Nov 01 19:10:46.411690 n-d-863052-2 devstack@n-api.service[121402]: X-Domain-Name: None Nov 01 19:10:46.411690 n-d-863052-2 devstack@n-api.service[121402]: X-Identity-Status: Confirmed Nov 01 19:10:46.411690 n-d-863052-2 devstack@n-api.service[121402]: X-Is-Admin-Project: True Nov 01 19:10:46.411690 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Domain-Id: default Nov 01 19:10:46.411690 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Domain-Name: Default Nov 01 19:10:46.411690 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Id: 04ef687c40bd45c297d22a791bae58cf Nov 01 19:10:46.411690 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Name: tempest-ListServerFiltersTestJSON-1807374630 Nov 01 19:10:46.411690 n-d-863052-2 devstack@n-api.service[121402]: X-Role: member,reader Nov 01 19:10:46.411690 n-d-863052-2 devstack@n-api.service[121402]: X-Roles: member,reader Nov 01 19:10:46.411690 n-d-863052-2 devstack@n-api.service[121402]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/04ef687c40bd45c297d22a791bae58cf"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/04ef687c40bd45c297d22a791bae58cf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_04ef687c40bd45c297d22a791bae58cf", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/04ef687c40bd45c297d22a791bae58cf"}]}] Nov 01 19:10:46.411690 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant: tempest-ListServerFiltersTestJSON-1807374630 Nov 01 19:10:46.411690 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant-Id: 04ef687c40bd45c297d22a791bae58cf Nov 01 19:10:46.411690 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-1807374630 Nov 01 19:10:46.411690 n-d-863052-2 devstack@n-api.service[121402]: X-User: tempest-ListServerFiltersTestJSON-1807374630-project Nov 01 19:10:46.411690 n-d-863052-2 devstack@n-api.service[121402]: X-User-Domain-Id: default Nov 01 19:10:46.411690 n-d-863052-2 devstack@n-api.service[121402]: X-User-Domain-Name: Default Nov 01 19:10:46.411690 n-d-863052-2 devstack@n-api.service[121402]: X-User-Id: 2868ccfdfb164cffa37232c821f205a8 Nov 01 19:10:46.411690 n-d-863052-2 devstack@n-api.service[121402]: X-User-Name: tempest-ListServerFiltersTestJSON-1807374630-project Nov 01 19:10:46.411690 n-d-863052-2 devstack@n-api.service[121402]: method: > Nov 01 19:10:46.411690 n-d-863052-2 devstack@n-api.service[121402]: exception: Instance 42415fcc-ac00-4854-bc88-0416ef12d8cb could not be found. Nov 01 19:10:46.411690 n-d-863052-2 devstack@n-api.service[121402]: action_args: {'id': '42415fcc-ac00-4854-bc88-0416ef12d8cb'} Nov 01 19:10:46.411690 n-d-863052-2 devstack@n-api.service[121402]: {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 01 19:10:46.411690 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:10:46.411690 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 01 19:10:46.411690 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 01 19:10:46.411690 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 01 19:10:46.411690 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 01 19:10:46.411690 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 01 19:10:46.411690 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 01 19:10:46.411690 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 01 19:10:46.411690 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 01 19:10:46.411690 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 42415fcc-ac00-4854-bc88-0416ef12d8cb could not be found. Nov 01 19:10:46.411690 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:10:46.411690 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:10:46.411690 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:10:46.411690 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:10:46.411690 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:10:46.411690 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:10:46.411690 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 01 19:10:46.411690 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 01 19:10:46.411690 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 01 19:10:46.411690 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 01 19:10:46.411690 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 01 19:10:46.411690 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 01 19:10:46.411690 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 01 19:10:46.411690 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 01 19:10:46.411690 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 01 19:10:46.411690 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 01 19:10:46.411690 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 42415fcc-ac00-4854-bc88-0416ef12d8cb could not be found. Nov 01 19:10:46.411690 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:10:46.411690 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:10:46.411690 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:10:46.417724 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:10:46.417724 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:10:46.417724 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:10:46.417724 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 01 19:10:46.417724 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 01 19:10:46.417724 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 42415fcc-ac00-4854-bc88-0416ef12d8cb could not be found. Nov 01 19:10:46.417724 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:10:46.419518 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-564e9e41-3927-4c0b-b7d3-31698a9ff008 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Returning 404 to user: Instance 42415fcc-ac00-4854-bc88-0416ef12d8cb could not be found. {{(pid=121402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 01 19:10:46.420658 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-564e9e41-3927-4c0b-b7d3-31698a9ff008 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] 10.222.0.13 "GET /compute/v2.1/servers/42415fcc-ac00-4854-bc88-0416ef12d8cb" status: 404 len: 111 microversion: 2.1 time: 0.074673 Nov 01 19:10:46.421763 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1989/4056] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:10:46 2022] GET /compute/v2.1/servers/42415fcc-ac00-4854-bc88-0416ef12d8cb => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 01 19:10:46.428293 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-4f58a13c-7108-4181-964e-7a4b79608204 tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:10:46.429281 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-4f58a13c-7108-4181-964e-7a4b79608204 tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] [instance: 29b73e88-1e2a-45d8-bdbb-6c5f9399d270] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:10:46.437084 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-4f58a13c-7108-4181-964e-7a4b79608204 tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:46.437817 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-4f58a13c-7108-4181-964e-7a4b79608204 tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:46.438484 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-4f58a13c-7108-4181-964e-7a4b79608204 tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:46.440353 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-4f58a13c-7108-4181-964e-7a4b79608204 tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:46.441063 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-4f58a13c-7108-4181-964e-7a4b79608204 tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:46.441683 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-4f58a13c-7108-4181-964e-7a4b79608204 tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:46.507845 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-b8676a1c-623e-475f-8229-bc6cb6168d40 tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c72e7e000a9a4fa49474bd5d19accf77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d8835c7b6754bfd81447b1f8893e56c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:10:46.518475 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-b8676a1c-623e-475f-8229-bc6cb6168d40 tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] 10.222.0.13 "GET /compute/v2.1/servers/7ee07462-fab6-49a3-b7fd-cbe545cc6f55" status: 200 len: 1316 microversion: 2.1 time: 1.262969 Nov 01 19:10:46.520900 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 2068/4057] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:10:45 2022] GET /compute/v2.1/servers/7ee07462-fab6-49a3-b7fd-cbe545cc6f55 => generated 1316 bytes in 1267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:10:46.531940 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-d8eb002b-d122-4c93-b122-70995874c13b tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:10:46.533398 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-d8eb002b-d122-4c93-b122-70995874c13b tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] [instance: af1071a8-a090-44c9-890c-123ca3ff39f1] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:10:46.550902 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d8eb002b-d122-4c93-b122-70995874c13b tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:46.551825 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d8eb002b-d122-4c93-b122-70995874c13b tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:46.552503 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d8eb002b-d122-4c93-b122-70995874c13b tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:46.553494 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d8eb002b-d122-4c93-b122-70995874c13b tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:46.554186 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d8eb002b-d122-4c93-b122-70995874c13b tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:46.554850 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d8eb002b-d122-4c93-b122-70995874c13b tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:46.572692 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-4f58a13c-7108-4181-964e-7a4b79608204 tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3111dabbf6d14e2c91766f2f5544057c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c30003431656408bb328e90be22d009a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:10:46.581958 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-4f58a13c-7108-4181-964e-7a4b79608204 tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3111dabbf6d14e2c91766f2f5544057c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c30003431656408bb328e90be22d009a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:10:46.583411 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-4f58a13c-7108-4181-964e-7a4b79608204 tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3111dabbf6d14e2c91766f2f5544057c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c30003431656408bb328e90be22d009a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:10:46.590815 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-4f58a13c-7108-4181-964e-7a4b79608204 tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] 10.222.0.13 "GET /compute/v2.1/servers/29b73e88-1e2a-45d8-bdbb-6c5f9399d270" status: 200 len: 1366 microversion: 2.57 time: 0.167719 Nov 01 19:10:46.608617 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1990/4058] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 19:10:46 2022] GET /compute/v2.1/servers/29b73e88-1e2a-45d8-bdbb-6c5f9399d270 => generated 1366 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 19:10:46.616004 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-5f8ca1f6-eaee-4cb6-b041-08cd22176266 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:10:46.616754 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-5f8ca1f6-eaee-4cb6-b041-08cd22176266 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] [instance: 33dd79e0-eb7c-4f18-a61f-df8022667dd0] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:10:46.626114 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-5f8ca1f6-eaee-4cb6-b041-08cd22176266 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:46.630329 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-5f8ca1f6-eaee-4cb6-b041-08cd22176266 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:46.631072 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-5f8ca1f6-eaee-4cb6-b041-08cd22176266 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:46.631809 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-5f8ca1f6-eaee-4cb6-b041-08cd22176266 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:46.632271 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-5f8ca1f6-eaee-4cb6-b041-08cd22176266 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:46.632770 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-5f8ca1f6-eaee-4cb6-b041-08cd22176266 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:46.693191 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-5f8ca1f6-eaee-4cb6-b041-08cd22176266 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] [instance: 33dd79e0-eb7c-4f18-a61f-df8022667dd0] Going to try to terminate instance {{(pid=121402) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 01 19:10:46.719480 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-d8eb002b-d122-4c93-b122-70995874c13b tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '301ed3b9c37449bc9ade378f3c73a768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8807757227574c828dca1947af76659d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:10:46.733002 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-d8eb002b-d122-4c93-b122-70995874c13b tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '301ed3b9c37449bc9ade378f3c73a768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8807757227574c828dca1947af76659d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:10:46.738346 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-d8eb002b-d122-4c93-b122-70995874c13b tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '301ed3b9c37449bc9ade378f3c73a768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8807757227574c828dca1947af76659d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:10:46.740348 n-d-863052-2 devstack@n-api.service[121402]: DEBUG dbcounter [-] [121402] Writing DB stats nova_cell1:SELECT=100 {{(pid=121402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 19:10:46.741889 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-d8eb002b-d122-4c93-b122-70995874c13b tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] 10.222.0.13 "GET /compute/v2.1/servers/af1071a8-a090-44c9-890c-123ca3ff39f1" status: 200 len: 1605 microversion: 2.42 time: 0.219713 Nov 01 19:10:46.756627 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 2069/4059] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 19:10:46 2022] GET /compute/v2.1/servers/af1071a8-a090-44c9-890c-123ca3ff39f1 => generated 1605 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 19:10:46.807169 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-e228db75-0d45-4345-9f0c-aa349ed5de1c tempest-InstanceActionsNegativeTestJSON-1175023068 tempest-InstanceActionsNegativeTestJSON-1175023068-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:10:46.807915 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-e228db75-0d45-4345-9f0c-aa349ed5de1c tempest-InstanceActionsNegativeTestJSON-1175023068 tempest-InstanceActionsNegativeTestJSON-1175023068-project] [instance: 9ddd96fd-cb96-4808-9172-2785776d2d1d] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:10:46.821701 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-e228db75-0d45-4345-9f0c-aa349ed5de1c tempest-InstanceActionsNegativeTestJSON-1175023068 tempest-InstanceActionsNegativeTestJSON-1175023068-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:46.822305 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-e228db75-0d45-4345-9f0c-aa349ed5de1c tempest-InstanceActionsNegativeTestJSON-1175023068 tempest-InstanceActionsNegativeTestJSON-1175023068-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:46.822818 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-e228db75-0d45-4345-9f0c-aa349ed5de1c tempest-InstanceActionsNegativeTestJSON-1175023068 tempest-InstanceActionsNegativeTestJSON-1175023068-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:46.827443 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-e228db75-0d45-4345-9f0c-aa349ed5de1c tempest-InstanceActionsNegativeTestJSON-1175023068 tempest-InstanceActionsNegativeTestJSON-1175023068-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:46.828295 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-e228db75-0d45-4345-9f0c-aa349ed5de1c tempest-InstanceActionsNegativeTestJSON-1175023068 tempest-InstanceActionsNegativeTestJSON-1175023068-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:46.829063 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-e228db75-0d45-4345-9f0c-aa349ed5de1c tempest-InstanceActionsNegativeTestJSON-1175023068 tempest-InstanceActionsNegativeTestJSON-1175023068-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:46.904874 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-5f8ca1f6-eaee-4cb6-b041-08cd22176266 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] 10.222.0.13 "DELETE /compute/v2.1/servers/33dd79e0-eb7c-4f18-a61f-df8022667dd0" status: 204 len: 0 microversion: 2.1 time: 0.307667 Nov 01 19:10:46.906713 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1991/4060] 10.222.0.13 () {58 vars in 1239 bytes} [Tue Nov 1 19:10:46 2022] DELETE /compute/v2.1/servers/33dd79e0-eb7c-4f18-a61f-df8022667dd0 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 01 19:10:46.923531 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-a3de683f-b995-4a68-97b7-0ee993decedc tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:10:46.924642 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-a3de683f-b995-4a68-97b7-0ee993decedc tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] [instance: 33dd79e0-eb7c-4f18-a61f-df8022667dd0] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:10:46.937646 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-a3de683f-b995-4a68-97b7-0ee993decedc tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:46.938405 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-a3de683f-b995-4a68-97b7-0ee993decedc tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:46.939087 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-a3de683f-b995-4a68-97b7-0ee993decedc tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:46.940127 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-a3de683f-b995-4a68-97b7-0ee993decedc tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:46.940629 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-a3de683f-b995-4a68-97b7-0ee993decedc tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:46.941250 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-a3de683f-b995-4a68-97b7-0ee993decedc tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:47.326184 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-a3de683f-b995-4a68-97b7-0ee993decedc tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2868ccfdfb164cffa37232c821f205a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04ef687c40bd45c297d22a791bae58cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:10:47.329376 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-e228db75-0d45-4345-9f0c-aa349ed5de1c tempest-InstanceActionsNegativeTestJSON-1175023068 tempest-InstanceActionsNegativeTestJSON-1175023068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90eeeb07a21345f5801a340078809488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba92568b226b4ea793c9f40cf9b97839', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:10:47.338178 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-a3de683f-b995-4a68-97b7-0ee993decedc tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] 10.222.0.13 "GET /compute/v2.1/servers/33dd79e0-eb7c-4f18-a61f-df8022667dd0" status: 200 len: 1518 microversion: 2.1 time: 0.422062 Nov 01 19:10:47.339154 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1992/4061] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:10:46 2022] GET /compute/v2.1/servers/33dd79e0-eb7c-4f18-a61f-df8022667dd0 => generated 1518 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:10:47.349767 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [req-73540e8f-c02a-445f-b3af-3611360ee2ad req-e5651431-9968-40cc-a7d5-f0813f6baf7a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ba6ffc5c-84a4-40f1-bdc7-f87dde2c99df", "name": "network-vif-unplugged", "status": "completed", "tag": "9d41a73a-8bec-4fb0-8fe8-9b112c925078"}, {"server_uuid": "ba6ffc5c-84a4-40f1-bdc7-f87dde2c99df", "name": "network-vif-unplugged", "status": "completed", "tag": "b830d6f3-9de8-4e86-9f65-0eb5d53f68f7"}, {"server_uuid": "ba6ffc5c-84a4-40f1-bdc7-f87dde2c99df", "name": "network-vif-unplugged", "status": "completed", "tag": "df21a011-7bab-4ed2-bd70-fb0e2d704b1f"}, {"server_uuid": "ba6ffc5c-84a4-40f1-bdc7-f87dde2c99df", "name": "network-vif-unplugged", "status": "completed", "tag": "5505ddf1-841a-456c-b4c2-811d7146122d"}]} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:10:47.361946 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-e228db75-0d45-4345-9f0c-aa349ed5de1c tempest-InstanceActionsNegativeTestJSON-1175023068 tempest-InstanceActionsNegativeTestJSON-1175023068-project] 10.222.0.13 "GET /compute/v2.1/servers/9ddd96fd-cb96-4808-9172-2785776d2d1d" status: 200 len: 1283 microversion: 2.1 time: 0.562437 Nov 01 19:10:47.376610 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 2070/4062] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:10:46 2022] GET /compute/v2.1/servers/9ddd96fd-cb96-4808-9172-2785776d2d1d => generated 1283 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 19:10:47.376610 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [req-168a32df-a388-4a2b-8f4d-d0d804be54ae req-4b4f7d6c-44dd-450f-912a-1da153ce29dd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ba6ffc5c-84a4-40f1-bdc7-f87dde2c99df", "name": "network-vif-deleted", "tag": "b830d6f3-9de8-4e86-9f65-0eb5d53f68f7"}]} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:10:47.382149 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-168a32df-a388-4a2b-8f4d-d0d804be54ae req-4b4f7d6c-44dd-450f-912a-1da153ce29dd service nova] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:47.382653 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-73540e8f-c02a-445f-b3af-3611360ee2ad req-e5651431-9968-40cc-a7d5-f0813f6baf7a service nova] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:47.383135 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-73540e8f-c02a-445f-b3af-3611360ee2ad req-e5651431-9968-40cc-a7d5-f0813f6baf7a service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:47.383564 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-73540e8f-c02a-445f-b3af-3611360ee2ad req-e5651431-9968-40cc-a7d5-f0813f6baf7a service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:47.383958 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-168a32df-a388-4a2b-8f4d-d0d804be54ae req-4b4f7d6c-44dd-450f-912a-1da153ce29dd service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:47.384943 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-168a32df-a388-4a2b-8f4d-d0d804be54ae req-4b4f7d6c-44dd-450f-912a-1da153ce29dd service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:47.403417 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.compute.server_external_events [req-168a32df-a388-4a2b-8f4d-d0d804be54ae req-4b4f7d6c-44dd-450f-912a-1da153ce29dd service nova] Creating event network-vif-deleted:b830d6f3-9de8-4e86-9f65-0eb5d53f68f7 for instance ba6ffc5c-84a4-40f1-bdc7-f87dde2c99df on n-h1-863052-2 Nov 01 19:10:47.410174 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.compute.server_external_events [req-73540e8f-c02a-445f-b3af-3611360ee2ad req-e5651431-9968-40cc-a7d5-f0813f6baf7a service nova] Creating event network-vif-unplugged:9d41a73a-8bec-4fb0-8fe8-9b112c925078 for instance ba6ffc5c-84a4-40f1-bdc7-f87dde2c99df on n-h1-863052-2 Nov 01 19:10:47.411187 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.compute.server_external_events [req-73540e8f-c02a-445f-b3af-3611360ee2ad req-e5651431-9968-40cc-a7d5-f0813f6baf7a service nova] Creating event network-vif-unplugged:b830d6f3-9de8-4e86-9f65-0eb5d53f68f7 for instance ba6ffc5c-84a4-40f1-bdc7-f87dde2c99df on n-h1-863052-2 Nov 01 19:10:47.412259 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.compute.server_external_events [req-73540e8f-c02a-445f-b3af-3611360ee2ad req-e5651431-9968-40cc-a7d5-f0813f6baf7a service nova] Creating event network-vif-unplugged:df21a011-7bab-4ed2-bd70-fb0e2d704b1f for instance ba6ffc5c-84a4-40f1-bdc7-f87dde2c99df on n-h1-863052-2 Nov 01 19:10:47.412666 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [req-168a32df-a388-4a2b-8f4d-d0d804be54ae req-4b4f7d6c-44dd-450f-912a-1da153ce29dd service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046022 Nov 01 19:10:47.413294 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.compute.server_external_events [req-73540e8f-c02a-445f-b3af-3611360ee2ad req-e5651431-9968-40cc-a7d5-f0813f6baf7a service nova] Creating event network-vif-unplugged:5505ddf1-841a-456c-b4c2-811d7146122d for instance ba6ffc5c-84a4-40f1-bdc7-f87dde2c99df on n-h1-863052-2 Nov 01 19:10:47.415825 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 2071/4063] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Nov 1 19:10:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:10:47.425770 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [req-73540e8f-c02a-445f-b3af-3611360ee2ad req-e5651431-9968-40cc-a7d5-f0813f6baf7a service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 704 microversion: 2.1 time: 0.084586 Nov 01 19:10:47.431433 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-4f17c354-9ff9-4a26-9691-33b130d715f8 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:10:47.432729 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-4f17c354-9ff9-4a26-9691-33b130d715f8 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] [instance: ba6ffc5c-84a4-40f1-bdc7-f87dde2c99df] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:10:47.435206 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1993/4064] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Nov 1 19:10:47 2022] POST /compute/v2.1/os-server-external-events => generated 704 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:10:47.449259 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-4f17c354-9ff9-4a26-9691-33b130d715f8 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:47.450050 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-4f17c354-9ff9-4a26-9691-33b130d715f8 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:47.450676 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-4f17c354-9ff9-4a26-9691-33b130d715f8 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:47.451612 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-4f17c354-9ff9-4a26-9691-33b130d715f8 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:47.453426 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-4f17c354-9ff9-4a26-9691-33b130d715f8 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:47.456343 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-4f17c354-9ff9-4a26-9691-33b130d715f8 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:47.493257 n-d-863052-2 devstack@n-api.service[121403]: DEBUG dbcounter [-] [121403] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 19:10:47.553646 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-9cb0f114-9604-4d5f-9d11-76337036ae24 tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:10:47.555309 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-9cb0f114-9604-4d5f-9d11-76337036ae24 tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] [instance: 7ee07462-fab6-49a3-b7fd-cbe545cc6f55] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:10:47.576203 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-9cb0f114-9604-4d5f-9d11-76337036ae24 tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:47.578991 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-9cb0f114-9604-4d5f-9d11-76337036ae24 tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:47.582123 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-9cb0f114-9604-4d5f-9d11-76337036ae24 tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:47.587193 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-9cb0f114-9604-4d5f-9d11-76337036ae24 tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:47.588351 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-9cb0f114-9604-4d5f-9d11-76337036ae24 tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:47.591691 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-9cb0f114-9604-4d5f-9d11-76337036ae24 tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:47.906591 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-4f17c354-9ff9-4a26-9691-33b130d715f8 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd2105b0264b48d084d0e79cabff8bc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf4adda91364dab94830347c06e3957', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:10:47.920279 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-4f17c354-9ff9-4a26-9691-33b130d715f8 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd2105b0264b48d084d0e79cabff8bc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf4adda91364dab94830347c06e3957', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:10:47.925200 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-4f17c354-9ff9-4a26-9691-33b130d715f8 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd2105b0264b48d084d0e79cabff8bc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf4adda91364dab94830347c06e3957', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:10:47.926729 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-4f17c354-9ff9-4a26-9691-33b130d715f8 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] 10.222.0.13 "GET /compute/v2.1/servers/ba6ffc5c-84a4-40f1-bdc7-f87dde2c99df" status: 200 len: 2750 microversion: 2.32 time: 0.509749 Nov 01 19:10:47.945109 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 2072/4065] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 19:10:47 2022] GET /compute/v2.1/servers/ba6ffc5c-84a4-40f1-bdc7-f87dde2c99df => generated 2750 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 19:10:47.962145 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-76627f0c-4204-4ba7-99a8-710a55dc60eb tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:10:47.963020 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-76627f0c-4204-4ba7-99a8-710a55dc60eb tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] [instance: 29b73e88-1e2a-45d8-bdbb-6c5f9399d270] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:10:47.971664 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-76627f0c-4204-4ba7-99a8-710a55dc60eb tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:47.972430 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-76627f0c-4204-4ba7-99a8-710a55dc60eb tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:47.973179 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-76627f0c-4204-4ba7-99a8-710a55dc60eb tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:47.974712 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-76627f0c-4204-4ba7-99a8-710a55dc60eb tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:47.975414 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-76627f0c-4204-4ba7-99a8-710a55dc60eb tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:47.976071 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-76627f0c-4204-4ba7-99a8-710a55dc60eb tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:48.164618 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-76627f0c-4204-4ba7-99a8-710a55dc60eb tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3111dabbf6d14e2c91766f2f5544057c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c30003431656408bb328e90be22d009a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:10:48.178728 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-76627f0c-4204-4ba7-99a8-710a55dc60eb tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3111dabbf6d14e2c91766f2f5544057c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c30003431656408bb328e90be22d009a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:10:48.180181 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-76627f0c-4204-4ba7-99a8-710a55dc60eb tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3111dabbf6d14e2c91766f2f5544057c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c30003431656408bb328e90be22d009a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:10:48.181430 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-76627f0c-4204-4ba7-99a8-710a55dc60eb tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] 10.222.0.13 "GET /compute/v2.1/servers/29b73e88-1e2a-45d8-bdbb-6c5f9399d270" status: 200 len: 1366 microversion: 2.57 time: 0.234887 Nov 01 19:10:48.197244 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 2073/4066] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 19:10:47 2022] GET /compute/v2.1/servers/29b73e88-1e2a-45d8-bdbb-6c5f9399d270 => generated 1366 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 19:10:48.201156 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-9cb0f114-9604-4d5f-9d11-76337036ae24 tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c72e7e000a9a4fa49474bd5d19accf77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d8835c7b6754bfd81447b1f8893e56c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:10:48.207802 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-8b043784-97d9-4790-9ffc-20c9e0e1622e tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:10:48.208647 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-8b043784-97d9-4790-9ffc-20c9e0e1622e tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] [instance: af1071a8-a090-44c9-890c-123ca3ff39f1] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:10:48.211492 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-9cb0f114-9604-4d5f-9d11-76337036ae24 tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] 10.222.0.13 "GET /compute/v2.1/servers/7ee07462-fab6-49a3-b7fd-cbe545cc6f55" status: 200 len: 1316 microversion: 2.1 time: 0.667476 Nov 01 19:10:48.215942 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-8b043784-97d9-4790-9ffc-20c9e0e1622e tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:48.217098 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-8b043784-97d9-4790-9ffc-20c9e0e1622e tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:48.217691 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-8b043784-97d9-4790-9ffc-20c9e0e1622e tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:48.218543 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-8b043784-97d9-4790-9ffc-20c9e0e1622e tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:48.219143 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-8b043784-97d9-4790-9ffc-20c9e0e1622e tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:48.219733 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-8b043784-97d9-4790-9ffc-20c9e0e1622e tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:48.229056 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1994/4067] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:10:47 2022] GET /compute/v2.1/servers/7ee07462-fab6-49a3-b7fd-cbe545cc6f55 => generated 1316 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:10:48.368609 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-255ed4a1-f8b4-414d-9287-fe08187d4254 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:10:48.372287 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-255ed4a1-f8b4-414d-9287-fe08187d4254 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] [instance: 33dd79e0-eb7c-4f18-a61f-df8022667dd0] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:10:48.382612 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-8b043784-97d9-4790-9ffc-20c9e0e1622e tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '301ed3b9c37449bc9ade378f3c73a768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8807757227574c828dca1947af76659d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:10:48.405653 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-255ed4a1-f8b4-414d-9287-fe08187d4254 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:48.406149 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-255ed4a1-f8b4-414d-9287-fe08187d4254 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:48.412390 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-255ed4a1-f8b4-414d-9287-fe08187d4254 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:48.415330 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-255ed4a1-f8b4-414d-9287-fe08187d4254 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:48.417463 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-255ed4a1-f8b4-414d-9287-fe08187d4254 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:48.417906 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-255ed4a1-f8b4-414d-9287-fe08187d4254 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:48.418794 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-8b043784-97d9-4790-9ffc-20c9e0e1622e tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '301ed3b9c37449bc9ade378f3c73a768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8807757227574c828dca1947af76659d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:10:48.424899 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-8b043784-97d9-4790-9ffc-20c9e0e1622e tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '301ed3b9c37449bc9ade378f3c73a768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8807757227574c828dca1947af76659d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:10:48.430354 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-8b043784-97d9-4790-9ffc-20c9e0e1622e tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] 10.222.0.13 "GET /compute/v2.1/servers/af1071a8-a090-44c9-890c-123ca3ff39f1" status: 200 len: 1605 microversion: 2.42 time: 0.231602 Nov 01 19:10:48.435851 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 2074/4068] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 19:10:48 2022] GET /compute/v2.1/servers/af1071a8-a090-44c9-890c-123ca3ff39f1 => generated 1605 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 19:10:48.461633 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-6c2ee9ce-fc22-434f-8243-1a9f154a74e0 tempest-InstanceActionsNegativeTestJSON-1175023068 tempest-InstanceActionsNegativeTestJSON-1175023068-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:10:48.468802 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-6c2ee9ce-fc22-434f-8243-1a9f154a74e0 tempest-InstanceActionsNegativeTestJSON-1175023068 tempest-InstanceActionsNegativeTestJSON-1175023068-project] [instance: 9ddd96fd-cb96-4808-9172-2785776d2d1d] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:10:48.500250 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-6c2ee9ce-fc22-434f-8243-1a9f154a74e0 tempest-InstanceActionsNegativeTestJSON-1175023068 tempest-InstanceActionsNegativeTestJSON-1175023068-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:48.502829 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-6c2ee9ce-fc22-434f-8243-1a9f154a74e0 tempest-InstanceActionsNegativeTestJSON-1175023068 tempest-InstanceActionsNegativeTestJSON-1175023068-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:48.505556 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-6c2ee9ce-fc22-434f-8243-1a9f154a74e0 tempest-InstanceActionsNegativeTestJSON-1175023068 tempest-InstanceActionsNegativeTestJSON-1175023068-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:48.507265 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-6c2ee9ce-fc22-434f-8243-1a9f154a74e0 tempest-InstanceActionsNegativeTestJSON-1175023068 tempest-InstanceActionsNegativeTestJSON-1175023068-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:48.510232 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-6c2ee9ce-fc22-434f-8243-1a9f154a74e0 tempest-InstanceActionsNegativeTestJSON-1175023068 tempest-InstanceActionsNegativeTestJSON-1175023068-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:48.512346 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-6c2ee9ce-fc22-434f-8243-1a9f154a74e0 tempest-InstanceActionsNegativeTestJSON-1175023068 tempest-InstanceActionsNegativeTestJSON-1175023068-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:48.618964 n-d-863052-2 devstack@n-api.service[121402]: DEBUG dbcounter [-] [121402] Writing DB stats nova_cell0:SELECT=16 {{(pid=121402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 19:10:48.864770 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-255ed4a1-f8b4-414d-9287-fe08187d4254 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2868ccfdfb164cffa37232c821f205a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04ef687c40bd45c297d22a791bae58cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:10:48.874369 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-255ed4a1-f8b4-414d-9287-fe08187d4254 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] 10.222.0.13 "GET /compute/v2.1/servers/33dd79e0-eb7c-4f18-a61f-df8022667dd0" status: 200 len: 1518 microversion: 2.1 time: 0.516442 Nov 01 19:10:48.894505 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1995/4069] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:10:48 2022] GET /compute/v2.1/servers/33dd79e0-eb7c-4f18-a61f-df8022667dd0 => generated 1518 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:10:48.963310 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-42807212-c06a-4b4e-8359-d569222c4135 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:10:48.964467 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-42807212-c06a-4b4e-8359-d569222c4135 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] [instance: ba6ffc5c-84a4-40f1-bdc7-f87dde2c99df] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:10:48.974358 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-42807212-c06a-4b4e-8359-d569222c4135 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:48.975913 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-42807212-c06a-4b4e-8359-d569222c4135 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:48.977123 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-42807212-c06a-4b4e-8359-d569222c4135 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:48.979552 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-42807212-c06a-4b4e-8359-d569222c4135 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:48.980530 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-42807212-c06a-4b4e-8359-d569222c4135 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:48.982910 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-42807212-c06a-4b4e-8359-d569222c4135 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:49.351027 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-6c2ee9ce-fc22-434f-8243-1a9f154a74e0 tempest-InstanceActionsNegativeTestJSON-1175023068 tempest-InstanceActionsNegativeTestJSON-1175023068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90eeeb07a21345f5801a340078809488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba92568b226b4ea793c9f40cf9b97839', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:10:49.364418 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-6c2ee9ce-fc22-434f-8243-1a9f154a74e0 tempest-InstanceActionsNegativeTestJSON-1175023068 tempest-InstanceActionsNegativeTestJSON-1175023068-project] 10.222.0.13 "GET /compute/v2.1/servers/9ddd96fd-cb96-4808-9172-2785776d2d1d" status: 200 len: 1325 microversion: 2.1 time: 0.921228 Nov 01 19:10:49.368066 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 2075/4070] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:10:48 2022] GET /compute/v2.1/servers/9ddd96fd-cb96-4808-9172-2785776d2d1d => generated 1325 bytes in 931 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:10:49.383699 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-960e6bc1-48d3-4aca-aeaa-e094538ba6e8 tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:10:49.387279 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-960e6bc1-48d3-4aca-aeaa-e094538ba6e8 tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] [instance: 29b73e88-1e2a-45d8-bdbb-6c5f9399d270] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:10:49.405035 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-960e6bc1-48d3-4aca-aeaa-e094538ba6e8 tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:49.405830 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-960e6bc1-48d3-4aca-aeaa-e094538ba6e8 tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:49.408910 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-960e6bc1-48d3-4aca-aeaa-e094538ba6e8 tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:49.410174 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-960e6bc1-48d3-4aca-aeaa-e094538ba6e8 tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:49.411829 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-960e6bc1-48d3-4aca-aeaa-e094538ba6e8 tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:49.412514 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-960e6bc1-48d3-4aca-aeaa-e094538ba6e8 tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:49.607328 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-42807212-c06a-4b4e-8359-d569222c4135 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd2105b0264b48d084d0e79cabff8bc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf4adda91364dab94830347c06e3957', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:10:49.620556 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-42807212-c06a-4b4e-8359-d569222c4135 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd2105b0264b48d084d0e79cabff8bc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf4adda91364dab94830347c06e3957', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:10:49.625453 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-42807212-c06a-4b4e-8359-d569222c4135 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd2105b0264b48d084d0e79cabff8bc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf4adda91364dab94830347c06e3957', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:10:49.626909 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-42807212-c06a-4b4e-8359-d569222c4135 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] 10.222.0.13 "GET /compute/v2.1/servers/ba6ffc5c-84a4-40f1-bdc7-f87dde2c99df" status: 200 len: 2704 microversion: 2.32 time: 0.667617 Nov 01 19:10:49.641421 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1996/4071] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 19:10:48 2022] GET /compute/v2.1/servers/ba6ffc5c-84a4-40f1-bdc7-f87dde2c99df => generated 2704 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 01 19:10:49.656301 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-74e0310f-6af6-44a9-b548-13a339397572 tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:10:49.657211 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-74e0310f-6af6-44a9-b548-13a339397572 tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] [instance: 7ee07462-fab6-49a3-b7fd-cbe545cc6f55] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:10:49.664619 n-d-863052-2 devstack@n-api.service[121402]: DEBUG dbcounter [-] [121402] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=121402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 19:10:49.666877 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-74e0310f-6af6-44a9-b548-13a339397572 tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:49.667613 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-74e0310f-6af6-44a9-b548-13a339397572 tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:49.668341 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-74e0310f-6af6-44a9-b548-13a339397572 tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:49.669317 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-74e0310f-6af6-44a9-b548-13a339397572 tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:49.670102 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-74e0310f-6af6-44a9-b548-13a339397572 tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:49.670770 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-74e0310f-6af6-44a9-b548-13a339397572 tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:49.670937 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-960e6bc1-48d3-4aca-aeaa-e094538ba6e8 tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3111dabbf6d14e2c91766f2f5544057c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c30003431656408bb328e90be22d009a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:10:49.686293 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-960e6bc1-48d3-4aca-aeaa-e094538ba6e8 tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3111dabbf6d14e2c91766f2f5544057c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c30003431656408bb328e90be22d009a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:10:49.687771 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-960e6bc1-48d3-4aca-aeaa-e094538ba6e8 tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3111dabbf6d14e2c91766f2f5544057c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c30003431656408bb328e90be22d009a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:10:49.689015 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-960e6bc1-48d3-4aca-aeaa-e094538ba6e8 tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] 10.222.0.13 "GET /compute/v2.1/servers/29b73e88-1e2a-45d8-bdbb-6c5f9399d270" status: 200 len: 1366 microversion: 2.57 time: 0.319597 Nov 01 19:10:49.689734 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 2076/4072] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 19:10:49 2022] GET /compute/v2.1/servers/29b73e88-1e2a-45d8-bdbb-6c5f9399d270 => generated 1366 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 19:10:49.703383 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-fa897c21-53b5-4861-9c96-e3865c83826e tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:10:49.712118 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-fa897c21-53b5-4861-9c96-e3865c83826e tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] [instance: af1071a8-a090-44c9-890c-123ca3ff39f1] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:10:49.730674 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-fa897c21-53b5-4861-9c96-e3865c83826e tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:49.731094 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-fa897c21-53b5-4861-9c96-e3865c83826e tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:49.731541 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-fa897c21-53b5-4861-9c96-e3865c83826e tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:49.732252 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-fa897c21-53b5-4861-9c96-e3865c83826e tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:49.733027 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-fa897c21-53b5-4861-9c96-e3865c83826e tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:49.733457 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-fa897c21-53b5-4861-9c96-e3865c83826e tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:49.882413 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-74e0310f-6af6-44a9-b548-13a339397572 tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c72e7e000a9a4fa49474bd5d19accf77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d8835c7b6754bfd81447b1f8893e56c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:10:49.890541 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-74e0310f-6af6-44a9-b548-13a339397572 tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] 10.222.0.13 "GET /compute/v2.1/servers/7ee07462-fab6-49a3-b7fd-cbe545cc6f55" status: 200 len: 1316 microversion: 2.1 time: 0.246514 Nov 01 19:10:49.890898 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1997/4073] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:10:49 2022] GET /compute/v2.1/servers/7ee07462-fab6-49a3-b7fd-cbe545cc6f55 => generated 1316 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:10:49.906575 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [req-afb4b85b-119f-433c-9f4d-bd02c245b70a req-40f5b291-a3ed-4f08-a0af-e389138c1231 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ba6ffc5c-84a4-40f1-bdc7-f87dde2c99df", "name": "network-vif-deleted", "tag": "df21a011-7bab-4ed2-bd70-fb0e2d704b1f"}]} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:10:49.928243 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-afb4b85b-119f-433c-9f4d-bd02c245b70a req-40f5b291-a3ed-4f08-a0af-e389138c1231 service nova] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:49.928922 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-afb4b85b-119f-433c-9f4d-bd02c245b70a req-40f5b291-a3ed-4f08-a0af-e389138c1231 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:49.929681 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-afb4b85b-119f-433c-9f4d-bd02c245b70a req-40f5b291-a3ed-4f08-a0af-e389138c1231 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:49.961784 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.compute.server_external_events [req-afb4b85b-119f-433c-9f4d-bd02c245b70a req-40f5b291-a3ed-4f08-a0af-e389138c1231 service nova] Creating event network-vif-deleted:df21a011-7bab-4ed2-bd70-fb0e2d704b1f for instance ba6ffc5c-84a4-40f1-bdc7-f87dde2c99df on n-h1-863052-2 Nov 01 19:10:49.970132 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [req-afb4b85b-119f-433c-9f4d-bd02c245b70a req-40f5b291-a3ed-4f08-a0af-e389138c1231 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068562 Nov 01 19:10:49.972186 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1998/4074] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Nov 1 19:10:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:10:49.988617 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [req-a4af686d-5897-4262-ad54-251a20552c20 req-4eb600df-861c-4305-abbb-2ba2f541ff57 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ee07462-fab6-49a3-b7fd-cbe545cc6f55", "name": "network-vif-plugged", "status": "completed", "tag": "07f5e414-1917-4efe-9307-869f5b12a987"}]} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:10:50.002583 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-a4af686d-5897-4262-ad54-251a20552c20 req-4eb600df-861c-4305-abbb-2ba2f541ff57 service nova] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:50.003600 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-a4af686d-5897-4262-ad54-251a20552c20 req-4eb600df-861c-4305-abbb-2ba2f541ff57 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:50.004327 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-a4af686d-5897-4262-ad54-251a20552c20 req-4eb600df-861c-4305-abbb-2ba2f541ff57 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:50.018039 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.compute.server_external_events [req-a4af686d-5897-4262-ad54-251a20552c20 req-4eb600df-861c-4305-abbb-2ba2f541ff57 service nova] Creating event network-vif-plugged:07f5e414-1917-4efe-9307-869f5b12a987 for instance 7ee07462-fab6-49a3-b7fd-cbe545cc6f55 on n-h1-863052-2 Nov 01 19:10:50.036374 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [req-a4af686d-5897-4262-ad54-251a20552c20 req-4eb600df-861c-4305-abbb-2ba2f541ff57 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060302 Nov 01 19:10:50.037739 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 1999/4075] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Nov 1 19:10:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:10:50.048423 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-50a15fb4-7dfe-4d25-9ccb-a2d97cd40ec2 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:10:50.064606 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-50a15fb4-7dfe-4d25-9ccb-a2d97cd40ec2 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] [instance: 33dd79e0-eb7c-4f18-a61f-df8022667dd0] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:10:50.077349 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-50a15fb4-7dfe-4d25-9ccb-a2d97cd40ec2 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:50.079352 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-50a15fb4-7dfe-4d25-9ccb-a2d97cd40ec2 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:50.080080 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-50a15fb4-7dfe-4d25-9ccb-a2d97cd40ec2 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:50.081184 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-50a15fb4-7dfe-4d25-9ccb-a2d97cd40ec2 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:50.082451 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-50a15fb4-7dfe-4d25-9ccb-a2d97cd40ec2 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:50.083109 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-50a15fb4-7dfe-4d25-9ccb-a2d97cd40ec2 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:50.215770 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-50a15fb4-7dfe-4d25-9ccb-a2d97cd40ec2 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2868ccfdfb164cffa37232c821f205a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04ef687c40bd45c297d22a791bae58cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:10:50.224777 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-50a15fb4-7dfe-4d25-9ccb-a2d97cd40ec2 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] 10.222.0.13 "GET /compute/v2.1/servers/33dd79e0-eb7c-4f18-a61f-df8022667dd0" status: 200 len: 1476 microversion: 2.1 time: 0.185453 Nov 01 19:10:50.252187 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 2000/4076] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:10:50 2022] GET /compute/v2.1/servers/33dd79e0-eb7c-4f18-a61f-df8022667dd0 => generated 1476 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:10:50.357227 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [req-891f600e-b075-40c0-8c4c-8cefc73aa290 req-f0d3fb31-a25d-4cc3-beee-03c498857c6d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "33dd79e0-eb7c-4f18-a61f-df8022667dd0", "name": "network-vif-deleted", "tag": "b6f7cb22-5f30-4f8f-9e4c-e4d1e25035f0"}]} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:10:50.359254 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-fa897c21-53b5-4861-9c96-e3865c83826e tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '301ed3b9c37449bc9ade378f3c73a768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8807757227574c828dca1947af76659d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:10:50.384970 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-fa897c21-53b5-4861-9c96-e3865c83826e tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '301ed3b9c37449bc9ade378f3c73a768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8807757227574c828dca1947af76659d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:10:50.401237 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-fa897c21-53b5-4861-9c96-e3865c83826e tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '301ed3b9c37449bc9ade378f3c73a768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8807757227574c828dca1947af76659d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:10:50.403584 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-fa897c21-53b5-4861-9c96-e3865c83826e tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] 10.222.0.13 "GET /compute/v2.1/servers/af1071a8-a090-44c9-890c-123ca3ff39f1" status: 200 len: 1605 microversion: 2.42 time: 0.712865 Nov 01 19:10:50.403832 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-891f600e-b075-40c0-8c4c-8cefc73aa290 req-f0d3fb31-a25d-4cc3-beee-03c498857c6d service nova] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:50.404961 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-891f600e-b075-40c0-8c4c-8cefc73aa290 req-f0d3fb31-a25d-4cc3-beee-03c498857c6d service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:50.409309 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 2077/4077] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 19:10:49 2022] GET /compute/v2.1/servers/af1071a8-a090-44c9-890c-123ca3ff39f1 => generated 1605 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 19:10:50.420564 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-891f600e-b075-40c0-8c4c-8cefc73aa290 req-f0d3fb31-a25d-4cc3-beee-03c498857c6d service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:50.423355 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-3960dc89-97ca-4308-a734-8393c4f8297f tempest-InstanceActionsNegativeTestJSON-1175023068 tempest-InstanceActionsNegativeTestJSON-1175023068-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:10:50.424841 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-3960dc89-97ca-4308-a734-8393c4f8297f tempest-InstanceActionsNegativeTestJSON-1175023068 tempest-InstanceActionsNegativeTestJSON-1175023068-project] [instance: 9ddd96fd-cb96-4808-9172-2785776d2d1d] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:10:50.449037 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-3960dc89-97ca-4308-a734-8393c4f8297f tempest-InstanceActionsNegativeTestJSON-1175023068 tempest-InstanceActionsNegativeTestJSON-1175023068-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:50.449826 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-3960dc89-97ca-4308-a734-8393c4f8297f tempest-InstanceActionsNegativeTestJSON-1175023068 tempest-InstanceActionsNegativeTestJSON-1175023068-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:50.450789 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-3960dc89-97ca-4308-a734-8393c4f8297f tempest-InstanceActionsNegativeTestJSON-1175023068 tempest-InstanceActionsNegativeTestJSON-1175023068-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:50.451739 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-3960dc89-97ca-4308-a734-8393c4f8297f tempest-InstanceActionsNegativeTestJSON-1175023068 tempest-InstanceActionsNegativeTestJSON-1175023068-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:50.452415 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-3960dc89-97ca-4308-a734-8393c4f8297f tempest-InstanceActionsNegativeTestJSON-1175023068 tempest-InstanceActionsNegativeTestJSON-1175023068-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:50.453114 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-3960dc89-97ca-4308-a734-8393c4f8297f tempest-InstanceActionsNegativeTestJSON-1175023068 tempest-InstanceActionsNegativeTestJSON-1175023068-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:50.460230 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.compute.server_external_events [req-891f600e-b075-40c0-8c4c-8cefc73aa290 req-f0d3fb31-a25d-4cc3-beee-03c498857c6d service nova] Creating event network-vif-deleted:b6f7cb22-5f30-4f8f-9e4c-e4d1e25035f0 for instance 33dd79e0-eb7c-4f18-a61f-df8022667dd0 on n-h2-863052-2 Nov 01 19:10:50.473754 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [req-891f600e-b075-40c0-8c4c-8cefc73aa290 req-f0d3fb31-a25d-4cc3-beee-03c498857c6d service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.120300 Nov 01 19:10:50.475083 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 2001/4078] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Nov 1 19:10:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:10:50.661252 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-c7c75cd5-1ebc-4736-a3b2-8e0a939f0528 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:10:50.661951 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-c7c75cd5-1ebc-4736-a3b2-8e0a939f0528 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] [instance: ba6ffc5c-84a4-40f1-bdc7-f87dde2c99df] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:10:50.691254 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-c7c75cd5-1ebc-4736-a3b2-8e0a939f0528 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:50.692186 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-c7c75cd5-1ebc-4736-a3b2-8e0a939f0528 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:50.696887 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-c7c75cd5-1ebc-4736-a3b2-8e0a939f0528 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:50.700820 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-c7c75cd5-1ebc-4736-a3b2-8e0a939f0528 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:50.702866 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-c7c75cd5-1ebc-4736-a3b2-8e0a939f0528 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:50.703537 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-c7c75cd5-1ebc-4736-a3b2-8e0a939f0528 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:50.855013 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-3960dc89-97ca-4308-a734-8393c4f8297f tempest-InstanceActionsNegativeTestJSON-1175023068 tempest-InstanceActionsNegativeTestJSON-1175023068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90eeeb07a21345f5801a340078809488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba92568b226b4ea793c9f40cf9b97839', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:10:50.878151 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-3960dc89-97ca-4308-a734-8393c4f8297f tempest-InstanceActionsNegativeTestJSON-1175023068 tempest-InstanceActionsNegativeTestJSON-1175023068-project] 10.222.0.13 "GET /compute/v2.1/servers/9ddd96fd-cb96-4808-9172-2785776d2d1d" status: 200 len: 1325 microversion: 2.1 time: 0.466189 Nov 01 19:10:50.899946 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 2078/4079] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:10:50 2022] GET /compute/v2.1/servers/9ddd96fd-cb96-4808-9172-2785776d2d1d => generated 1325 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:10:50.906261 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-16404394-6a2e-4f72-b516-584024c2bfc8 tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:10:50.907458 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-16404394-6a2e-4f72-b516-584024c2bfc8 tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] [instance: 29b73e88-1e2a-45d8-bdbb-6c5f9399d270] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:10:50.918191 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-16404394-6a2e-4f72-b516-584024c2bfc8 tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:50.919167 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-16404394-6a2e-4f72-b516-584024c2bfc8 tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:50.919847 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-16404394-6a2e-4f72-b516-584024c2bfc8 tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:50.920821 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-16404394-6a2e-4f72-b516-584024c2bfc8 tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:50.921446 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-16404394-6a2e-4f72-b516-584024c2bfc8 tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:50.922066 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-16404394-6a2e-4f72-b516-584024c2bfc8 tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:51.083459 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-16404394-6a2e-4f72-b516-584024c2bfc8 tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3111dabbf6d14e2c91766f2f5544057c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c30003431656408bb328e90be22d009a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:10:51.093404 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-16404394-6a2e-4f72-b516-584024c2bfc8 tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3111dabbf6d14e2c91766f2f5544057c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c30003431656408bb328e90be22d009a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:10:51.096952 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-16404394-6a2e-4f72-b516-584024c2bfc8 tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3111dabbf6d14e2c91766f2f5544057c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c30003431656408bb328e90be22d009a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:10:51.098449 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-16404394-6a2e-4f72-b516-584024c2bfc8 tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] 10.222.0.13 "GET /compute/v2.1/servers/29b73e88-1e2a-45d8-bdbb-6c5f9399d270" status: 200 len: 1372 microversion: 2.57 time: 0.197048 Nov 01 19:10:51.099804 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 2079/4080] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 19:10:50 2022] GET /compute/v2.1/servers/29b73e88-1e2a-45d8-bdbb-6c5f9399d270 => generated 1372 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 19:10:51.105284 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-87ffb664-c849-48e5-8fcb-0dc22a7500a6 tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:10:51.106278 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-87ffb664-c849-48e5-8fcb-0dc22a7500a6 tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] [instance: 7ee07462-fab6-49a3-b7fd-cbe545cc6f55] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:10:51.113719 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-87ffb664-c849-48e5-8fcb-0dc22a7500a6 tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:51.116436 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-87ffb664-c849-48e5-8fcb-0dc22a7500a6 tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:51.118623 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-87ffb664-c849-48e5-8fcb-0dc22a7500a6 tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:51.119769 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-87ffb664-c849-48e5-8fcb-0dc22a7500a6 tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:51.134173 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-87ffb664-c849-48e5-8fcb-0dc22a7500a6 tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:51.137281 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-87ffb664-c849-48e5-8fcb-0dc22a7500a6 tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:51.402105 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-87ffb664-c849-48e5-8fcb-0dc22a7500a6 tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c72e7e000a9a4fa49474bd5d19accf77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d8835c7b6754bfd81447b1f8893e56c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:10:51.413263 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-87ffb664-c849-48e5-8fcb-0dc22a7500a6 tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] 10.222.0.13 "GET /compute/v2.1/servers/7ee07462-fab6-49a3-b7fd-cbe545cc6f55" status: 200 len: 1316 microversion: 2.1 time: 0.310803 Nov 01 19:10:51.415277 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 2080/4081] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:10:51 2022] GET /compute/v2.1/servers/7ee07462-fab6-49a3-b7fd-cbe545cc6f55 => generated 1316 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:10:51.426206 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-9c00a277-c6d3-452a-8118-abcdf5d4d890 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:10:51.428376 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-9c00a277-c6d3-452a-8118-abcdf5d4d890 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] [instance: 33dd79e0-eb7c-4f18-a61f-df8022667dd0] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:10:51.450321 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-9c00a277-c6d3-452a-8118-abcdf5d4d890 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:51.451201 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-9c00a277-c6d3-452a-8118-abcdf5d4d890 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:51.451851 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-9c00a277-c6d3-452a-8118-abcdf5d4d890 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:51.453086 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-9c00a277-c6d3-452a-8118-abcdf5d4d890 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:51.453754 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-9c00a277-c6d3-452a-8118-abcdf5d4d890 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:51.455133 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-9c00a277-c6d3-452a-8118-abcdf5d4d890 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:51.466639 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-c7c75cd5-1ebc-4736-a3b2-8e0a939f0528 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd2105b0264b48d084d0e79cabff8bc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf4adda91364dab94830347c06e3957', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:10:51.484792 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-c7c75cd5-1ebc-4736-a3b2-8e0a939f0528 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd2105b0264b48d084d0e79cabff8bc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf4adda91364dab94830347c06e3957', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:10:51.490155 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-c7c75cd5-1ebc-4736-a3b2-8e0a939f0528 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd2105b0264b48d084d0e79cabff8bc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf4adda91364dab94830347c06e3957', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:10:51.494653 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-c7c75cd5-1ebc-4736-a3b2-8e0a939f0528 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] 10.222.0.13 "GET /compute/v2.1/servers/ba6ffc5c-84a4-40f1-bdc7-f87dde2c99df" status: 200 len: 2372 microversion: 2.32 time: 0.837210 Nov 01 19:10:51.508696 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 2002/4082] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 19:10:50 2022] GET /compute/v2.1/servers/ba6ffc5c-84a4-40f1-bdc7-f87dde2c99df => generated 2372 bytes in 841 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 19:10:51.508696 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-a510aa6b-5ede-484b-9816-3d4fc991446f tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:10:51.508696 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-a510aa6b-5ede-484b-9816-3d4fc991446f tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] [instance: af1071a8-a090-44c9-890c-123ca3ff39f1] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:10:51.523269 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-a510aa6b-5ede-484b-9816-3d4fc991446f tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:51.525093 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-a510aa6b-5ede-484b-9816-3d4fc991446f tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:51.528620 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-a510aa6b-5ede-484b-9816-3d4fc991446f tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:51.530997 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-a510aa6b-5ede-484b-9816-3d4fc991446f tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:51.531511 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-a510aa6b-5ede-484b-9816-3d4fc991446f tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:51.533621 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-a510aa6b-5ede-484b-9816-3d4fc991446f tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:51.539489 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-9c00a277-c6d3-452a-8118-abcdf5d4d890 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:51.540422 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-9c00a277-c6d3-452a-8118-abcdf5d4d890 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:51.540896 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-9c00a277-c6d3-452a-8118-abcdf5d4d890 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:51.541357 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.objects.instance [None req-9c00a277-c6d3-452a-8118-abcdf5d4d890 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Lazy-loading 'fault' on Instance uuid 33dd79e0-eb7c-4f18-a61f-df8022667dd0 {{(pid=121403) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 01 19:10:51.576987 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.wsgi [None req-a510aa6b-5ede-484b-9816-3d4fc991446f tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] HTTP exception thrown: Instance af1071a8-a090-44c9-890c-123ca3ff39f1 could not be found. Nov 01 19:10:51.582393 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-a510aa6b-5ede-484b-9816-3d4fc991446f tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Request method failure captured: Nov 01 19:10:51.582393 n-d-863052-2 devstack@n-api.service[121402]: request: GET /compute/v2.1/servers/af1071a8-a090-44c9-890c-123ca3ff39f1 HTTP/1.1 Nov 01 19:10:51.582393 n-d-863052-2 devstack@n-api.service[121402]: Accept: application/json Nov 01 19:10:51.582393 n-d-863052-2 devstack@n-api.service[121402]: Accept-Encoding: identity Nov 01 19:10:51.582393 n-d-863052-2 devstack@n-api.service[121402]: Connection: close Nov 01 19:10:51.582393 n-d-863052-2 devstack@n-api.service[121402]: Content-Length: 0 Nov 01 19:10:51.582393 n-d-863052-2 devstack@n-api.service[121402]: Content-Type: application/json Nov 01 19:10:51.582393 n-d-863052-2 devstack@n-api.service[121402]: Host: 10.222.0.13 Nov 01 19:10:51.582393 n-d-863052-2 devstack@n-api.service[121402]: Openstack-System-Scope: None Nov 01 19:10:51.582393 n-d-863052-2 devstack@n-api.service[121402]: User-Agent: python-urllib3/1.26.12 Nov 01 19:10:51.582393 n-d-863052-2 devstack@n-api.service[121402]: X-Auth-Token: gAAAAABjYW2PwHA9xR9CaUTqr_Ug5905JFbP1_GbjHpmmKHn0_18JNln6AAWrDcY2I89rHXJe439LRz3BcZqnfBX_uoevdkGBNyixK7hCIoXvIZ0dYvt-AbKqusGVDbhL0A8x0ANz91Cm66Wf7f7AXwO5W7hyZ86g45XCCuVTW27iHRMwJ66FEc Nov 01 19:10:51.582393 n-d-863052-2 devstack@n-api.service[121402]: X-Domain-Id: None Nov 01 19:10:51.582393 n-d-863052-2 devstack@n-api.service[121402]: X-Domain-Name: None Nov 01 19:10:51.582393 n-d-863052-2 devstack@n-api.service[121402]: X-Identity-Status: Confirmed Nov 01 19:10:51.582393 n-d-863052-2 devstack@n-api.service[121402]: X-Is-Admin-Project: True Nov 01 19:10:51.582393 n-d-863052-2 devstack@n-api.service[121402]: X-Openstack-Nova-Api-Version: 2.42 Nov 01 19:10:51.582393 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Domain-Id: default Nov 01 19:10:51.582393 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Domain-Name: Default Nov 01 19:10:51.582393 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Id: 8807757227574c828dca1947af76659d Nov 01 19:10:51.582393 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-531364476 Nov 01 19:10:51.582393 n-d-863052-2 devstack@n-api.service[121402]: X-Role: member,reader Nov 01 19:10:51.582393 n-d-863052-2 devstack@n-api.service[121402]: X-Roles: member,reader Nov 01 19:10:51.582393 n-d-863052-2 devstack@n-api.service[121402]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/8807757227574c828dca1947af76659d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/8807757227574c828dca1947af76659d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_8807757227574c828dca1947af76659d", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/8807757227574c828dca1947af76659d"}]}] Nov 01 19:10:51.582393 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant: tempest-TaggedBootDevicesTest_v242-531364476 Nov 01 19:10:51.582393 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant-Id: 8807757227574c828dca1947af76659d Nov 01 19:10:51.582393 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-531364476 Nov 01 19:10:51.582393 n-d-863052-2 devstack@n-api.service[121402]: X-User: tempest-TaggedBootDevicesTest_v242-531364476-project Nov 01 19:10:51.582393 n-d-863052-2 devstack@n-api.service[121402]: X-User-Domain-Id: default Nov 01 19:10:51.582393 n-d-863052-2 devstack@n-api.service[121402]: X-User-Domain-Name: Default Nov 01 19:10:51.582393 n-d-863052-2 devstack@n-api.service[121402]: X-User-Id: 301ed3b9c37449bc9ade378f3c73a768 Nov 01 19:10:51.582393 n-d-863052-2 devstack@n-api.service[121402]: X-User-Name: tempest-TaggedBootDevicesTest_v242-531364476-project Nov 01 19:10:51.582393 n-d-863052-2 devstack@n-api.service[121402]: method: > Nov 01 19:10:51.582393 n-d-863052-2 devstack@n-api.service[121402]: exception: Instance af1071a8-a090-44c9-890c-123ca3ff39f1 could not be found. Nov 01 19:10:51.582393 n-d-863052-2 devstack@n-api.service[121402]: action_args: {'id': 'af1071a8-a090-44c9-890c-123ca3ff39f1'} Nov 01 19:10:51.582393 n-d-863052-2 devstack@n-api.service[121402]: {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 01 19:10:51.582393 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:10:51.582393 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 01 19:10:51.582393 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 01 19:10:51.582393 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 01 19:10:51.582393 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 01 19:10:51.582393 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 01 19:10:51.582393 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 01 19:10:51.582393 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 01 19:10:51.582393 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 01 19:10:51.582393 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance af1071a8-a090-44c9-890c-123ca3ff39f1 could not be found. Nov 01 19:10:51.582393 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:10:51.582393 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:10:51.582393 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:10:51.582393 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:10:51.582393 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:10:51.582393 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:10:51.582393 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 01 19:10:51.582393 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 01 19:10:51.582393 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 01 19:10:51.582393 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 01 19:10:51.582393 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 01 19:10:51.582393 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 01 19:10:51.582393 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 01 19:10:51.582393 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 01 19:10:51.582393 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 01 19:10:51.582393 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 01 19:10:51.582393 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance af1071a8-a090-44c9-890c-123ca3ff39f1 could not be found. Nov 01 19:10:51.582393 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:10:51.582393 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:10:51.587915 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:10:51.587915 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:10:51.587915 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:10:51.587915 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:10:51.587915 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 01 19:10:51.587915 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 01 19:10:51.587915 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance af1071a8-a090-44c9-890c-123ca3ff39f1 could not be found. Nov 01 19:10:51.587915 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:10:51.589833 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-a510aa6b-5ede-484b-9816-3d4fc991446f tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Returning 404 to user: Instance af1071a8-a090-44c9-890c-123ca3ff39f1 could not be found. {{(pid=121402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 01 19:10:51.591144 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-a510aa6b-5ede-484b-9816-3d4fc991446f tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] 10.222.0.13 "GET /compute/v2.1/servers/af1071a8-a090-44c9-890c-123ca3ff39f1" status: 404 len: 111 microversion: 2.42 time: 0.093029 Nov 01 19:10:51.591988 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 2003/4083] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 19:10:51 2022] GET /compute/v2.1/servers/af1071a8-a090-44c9-890c-123ca3ff39f1 => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 01 19:10:51.597264 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-9c00a277-c6d3-452a-8118-abcdf5d4d890 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2868ccfdfb164cffa37232c821f205a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04ef687c40bd45c297d22a791bae58cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:10:51.608486 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-5e621289-c489-49e0-83ec-8e81bdf485d8 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Calling method '.version_select at 0x7f0ae2db3ee0>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:10:51.609572 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-9c00a277-c6d3-452a-8118-abcdf5d4d890 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] 10.222.0.13 "GET /compute/v2.1/servers/33dd79e0-eb7c-4f18-a61f-df8022667dd0" status: 200 len: 1310 microversion: 2.1 time: 0.193030 Nov 01 19:10:51.610726 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 2081/4084] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:10:51 2022] GET /compute/v2.1/servers/33dd79e0-eb7c-4f18-a61f-df8022667dd0 => generated 1310 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:10:51.661084 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-5e621289-c489-49e0-83ec-8e81bdf485d8 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1185576951" status: 204 len: 0 microversion: 2.42 time: 0.063627 Nov 01 19:10:51.661675 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 2004/4085] 10.222.0.13 () {60 vars in 1262 bytes} [Tue Nov 1 19:10:51 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1185576951 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Nov 01 19:10:51.904445 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-be67de68-9e6e-45f2-b3bb-925d7cf26db4 tempest-InstanceActionsNegativeTestJSON-1175023068 tempest-InstanceActionsNegativeTestJSON-1175023068-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:10:51.909235 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-be67de68-9e6e-45f2-b3bb-925d7cf26db4 tempest-InstanceActionsNegativeTestJSON-1175023068 tempest-InstanceActionsNegativeTestJSON-1175023068-project] [instance: 9ddd96fd-cb96-4808-9172-2785776d2d1d] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:10:51.923333 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-be67de68-9e6e-45f2-b3bb-925d7cf26db4 tempest-InstanceActionsNegativeTestJSON-1175023068 tempest-InstanceActionsNegativeTestJSON-1175023068-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:51.924039 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-be67de68-9e6e-45f2-b3bb-925d7cf26db4 tempest-InstanceActionsNegativeTestJSON-1175023068 tempest-InstanceActionsNegativeTestJSON-1175023068-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:51.924487 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-be67de68-9e6e-45f2-b3bb-925d7cf26db4 tempest-InstanceActionsNegativeTestJSON-1175023068 tempest-InstanceActionsNegativeTestJSON-1175023068-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:51.925504 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-be67de68-9e6e-45f2-b3bb-925d7cf26db4 tempest-InstanceActionsNegativeTestJSON-1175023068 tempest-InstanceActionsNegativeTestJSON-1175023068-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:51.926116 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-be67de68-9e6e-45f2-b3bb-925d7cf26db4 tempest-InstanceActionsNegativeTestJSON-1175023068 tempest-InstanceActionsNegativeTestJSON-1175023068-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:51.926799 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-be67de68-9e6e-45f2-b3bb-925d7cf26db4 tempest-InstanceActionsNegativeTestJSON-1175023068 tempest-InstanceActionsNegativeTestJSON-1175023068-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:52.035102 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [req-0a0db83f-9874-4f70-aac3-64db6082eae6 req-6bd40e3e-2ba0-49a5-93cd-c7cf34e6b4e0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ba6ffc5c-84a4-40f1-bdc7-f87dde2c99df", "name": "network-vif-deleted", "tag": "9d41a73a-8bec-4fb0-8fe8-9b112c925078"}, {"server_uuid": "ba6ffc5c-84a4-40f1-bdc7-f87dde2c99df", "name": "network-vif-deleted", "tag": "50c047f7-0828-439d-8aac-50370fc1454f"}]} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:10:52.058288 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-0a0db83f-9874-4f70-aac3-64db6082eae6 req-6bd40e3e-2ba0-49a5-93cd-c7cf34e6b4e0 service nova] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:52.058973 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-0a0db83f-9874-4f70-aac3-64db6082eae6 req-6bd40e3e-2ba0-49a5-93cd-c7cf34e6b4e0 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:52.059408 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-0a0db83f-9874-4f70-aac3-64db6082eae6 req-6bd40e3e-2ba0-49a5-93cd-c7cf34e6b4e0 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:52.073813 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.compute.server_external_events [req-0a0db83f-9874-4f70-aac3-64db6082eae6 req-6bd40e3e-2ba0-49a5-93cd-c7cf34e6b4e0 service nova] Creating event network-vif-deleted:9d41a73a-8bec-4fb0-8fe8-9b112c925078 for instance ba6ffc5c-84a4-40f1-bdc7-f87dde2c99df on n-h1-863052-2 Nov 01 19:10:52.074258 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.compute.server_external_events [req-0a0db83f-9874-4f70-aac3-64db6082eae6 req-6bd40e3e-2ba0-49a5-93cd-c7cf34e6b4e0 service nova] Creating event network-vif-deleted:50c047f7-0828-439d-8aac-50370fc1454f for instance ba6ffc5c-84a4-40f1-bdc7-f87dde2c99df on n-h1-863052-2 Nov 01 19:10:52.080707 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [req-0a0db83f-9874-4f70-aac3-64db6082eae6 req-6bd40e3e-2ba0-49a5-93cd-c7cf34e6b4e0 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.050138 Nov 01 19:10:52.081622 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 2005/4086] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Nov 1 19:10:52 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 01 19:10:52.131162 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-4d8ef9fc-9e36-487e-bfbd-522fdd2d2d44 tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:10:52.131872 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-4d8ef9fc-9e36-487e-bfbd-522fdd2d2d44 tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] [instance: 29b73e88-1e2a-45d8-bdbb-6c5f9399d270] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:10:52.158898 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-4d8ef9fc-9e36-487e-bfbd-522fdd2d2d44 tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:52.159404 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-4d8ef9fc-9e36-487e-bfbd-522fdd2d2d44 tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:52.159849 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-4d8ef9fc-9e36-487e-bfbd-522fdd2d2d44 tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:52.160564 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-4d8ef9fc-9e36-487e-bfbd-522fdd2d2d44 tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:52.161050 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-4d8ef9fc-9e36-487e-bfbd-522fdd2d2d44 tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:52.161473 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-4d8ef9fc-9e36-487e-bfbd-522fdd2d2d44 tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:52.417638 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-be67de68-9e6e-45f2-b3bb-925d7cf26db4 tempest-InstanceActionsNegativeTestJSON-1175023068 tempest-InstanceActionsNegativeTestJSON-1175023068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90eeeb07a21345f5801a340078809488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba92568b226b4ea793c9f40cf9b97839', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:10:52.427236 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-be67de68-9e6e-45f2-b3bb-925d7cf26db4 tempest-InstanceActionsNegativeTestJSON-1175023068 tempest-InstanceActionsNegativeTestJSON-1175023068-project] 10.222.0.13 "GET /compute/v2.1/servers/9ddd96fd-cb96-4808-9172-2785776d2d1d" status: 200 len: 1325 microversion: 2.1 time: 0.527538 Nov 01 19:10:52.432594 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 2082/4087] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:10:51 2022] GET /compute/v2.1/servers/9ddd96fd-cb96-4808-9172-2785776d2d1d => generated 1325 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:10:52.439688 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-53584b81-0796-41ee-8e6e-18455c0a098c tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:10:52.443862 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-53584b81-0796-41ee-8e6e-18455c0a098c tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] [instance: 7ee07462-fab6-49a3-b7fd-cbe545cc6f55] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:10:52.455853 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-53584b81-0796-41ee-8e6e-18455c0a098c tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:52.456358 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-53584b81-0796-41ee-8e6e-18455c0a098c tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:52.456837 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-53584b81-0796-41ee-8e6e-18455c0a098c tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:52.457564 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-53584b81-0796-41ee-8e6e-18455c0a098c tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:52.458028 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-53584b81-0796-41ee-8e6e-18455c0a098c tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:52.458459 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-53584b81-0796-41ee-8e6e-18455c0a098c tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:52.574067 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-4d8ef9fc-9e36-487e-bfbd-522fdd2d2d44 tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3111dabbf6d14e2c91766f2f5544057c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c30003431656408bb328e90be22d009a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:10:52.588052 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-4d8ef9fc-9e36-487e-bfbd-522fdd2d2d44 tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3111dabbf6d14e2c91766f2f5544057c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c30003431656408bb328e90be22d009a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:10:52.590980 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-4d8ef9fc-9e36-487e-bfbd-522fdd2d2d44 tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3111dabbf6d14e2c91766f2f5544057c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c30003431656408bb328e90be22d009a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:10:52.593643 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-4d8ef9fc-9e36-487e-bfbd-522fdd2d2d44 tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] 10.222.0.13 "GET /compute/v2.1/servers/29b73e88-1e2a-45d8-bdbb-6c5f9399d270" status: 200 len: 1372 microversion: 2.57 time: 0.467456 Nov 01 19:10:52.596158 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 2006/4088] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 19:10:52 2022] GET /compute/v2.1/servers/29b73e88-1e2a-45d8-bdbb-6c5f9399d270 => generated 1372 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 01 19:10:52.603302 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-f099a4f7-fef3-4e1d-b3f3-c5a7feb006fc tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:10:52.604884 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-f099a4f7-fef3-4e1d-b3f3-c5a7feb006fc tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] [instance: ba6ffc5c-84a4-40f1-bdc7-f87dde2c99df] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:10:52.617207 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f099a4f7-fef3-4e1d-b3f3-c5a7feb006fc tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:52.618041 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f099a4f7-fef3-4e1d-b3f3-c5a7feb006fc tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:52.618720 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f099a4f7-fef3-4e1d-b3f3-c5a7feb006fc tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:52.621426 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f099a4f7-fef3-4e1d-b3f3-c5a7feb006fc tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:52.622735 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f099a4f7-fef3-4e1d-b3f3-c5a7feb006fc tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:52.623617 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f099a4f7-fef3-4e1d-b3f3-c5a7feb006fc tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:52.768906 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-53584b81-0796-41ee-8e6e-18455c0a098c tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c72e7e000a9a4fa49474bd5d19accf77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d8835c7b6754bfd81447b1f8893e56c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:10:52.777390 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-53584b81-0796-41ee-8e6e-18455c0a098c tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] 10.222.0.13 "GET /compute/v2.1/servers/7ee07462-fab6-49a3-b7fd-cbe545cc6f55" status: 200 len: 1316 microversion: 2.1 time: 0.341904 Nov 01 19:10:52.778276 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 2083/4089] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:10:52 2022] GET /compute/v2.1/servers/7ee07462-fab6-49a3-b7fd-cbe545cc6f55 => generated 1316 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 19:10:52.928199 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [req-fd0aaa14-5ae1-4c99-9209-8cbe712f0e47 req-b1bf8b22-13a0-4387-8d1e-8b4004c915ab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9ddd96fd-cb96-4808-9172-2785776d2d1d", "tag": "c29dc4b3-164b-4843-99d6-674e8b6ff2cc"}]} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:10:52.948677 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-fd0aaa14-5ae1-4c99-9209-8cbe712f0e47 req-b1bf8b22-13a0-4387-8d1e-8b4004c915ab service nova] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:52.949215 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-fd0aaa14-5ae1-4c99-9209-8cbe712f0e47 req-b1bf8b22-13a0-4387-8d1e-8b4004c915ab service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:52.949647 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-fd0aaa14-5ae1-4c99-9209-8cbe712f0e47 req-b1bf8b22-13a0-4387-8d1e-8b4004c915ab service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:52.964998 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.compute.server_external_events [req-fd0aaa14-5ae1-4c99-9209-8cbe712f0e47 req-b1bf8b22-13a0-4387-8d1e-8b4004c915ab service nova] Creating event network-changed:c29dc4b3-164b-4843-99d6-674e8b6ff2cc for instance 9ddd96fd-cb96-4808-9172-2785776d2d1d on n-h2-863052-2 Nov 01 19:10:52.972183 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [req-fd0aaa14-5ae1-4c99-9209-8cbe712f0e47 req-b1bf8b22-13a0-4387-8d1e-8b4004c915ab service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.174954 Nov 01 19:10:52.973357 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 2084/4090] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Nov 1 19:10:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:10:52.982282 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-232497d5-e058-48ee-a515-5f7a22e16d6e tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:10:52.983212 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-232497d5-e058-48ee-a515-5f7a22e16d6e tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] [instance: 33dd79e0-eb7c-4f18-a61f-df8022667dd0] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:10:52.991516 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-232497d5-e058-48ee-a515-5f7a22e16d6e tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:52.991926 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-232497d5-e058-48ee-a515-5f7a22e16d6e tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:52.992378 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-232497d5-e058-48ee-a515-5f7a22e16d6e tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:52.993118 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-232497d5-e058-48ee-a515-5f7a22e16d6e tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:52.993720 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-232497d5-e058-48ee-a515-5f7a22e16d6e tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:52.994160 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-232497d5-e058-48ee-a515-5f7a22e16d6e tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:52.997512 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-f099a4f7-fef3-4e1d-b3f3-c5a7feb006fc tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd2105b0264b48d084d0e79cabff8bc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf4adda91364dab94830347c06e3957', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:10:53.008793 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-f099a4f7-fef3-4e1d-b3f3-c5a7feb006fc tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd2105b0264b48d084d0e79cabff8bc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf4adda91364dab94830347c06e3957', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:10:53.010009 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.wsgi [None req-232497d5-e058-48ee-a515-5f7a22e16d6e tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] HTTP exception thrown: Instance 33dd79e0-eb7c-4f18-a61f-df8022667dd0 could not be found. Nov 01 19:10:53.011476 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-f099a4f7-fef3-4e1d-b3f3-c5a7feb006fc tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd2105b0264b48d084d0e79cabff8bc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf4adda91364dab94830347c06e3957', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:10:53.012047 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-232497d5-e058-48ee-a515-5f7a22e16d6e tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Request method failure captured: Nov 01 19:10:53.012047 n-d-863052-2 devstack@n-api.service[121403]: request: GET /compute/v2.1/servers/33dd79e0-eb7c-4f18-a61f-df8022667dd0 HTTP/1.1 Nov 01 19:10:53.012047 n-d-863052-2 devstack@n-api.service[121403]: Accept: application/json Nov 01 19:10:53.012047 n-d-863052-2 devstack@n-api.service[121403]: Accept-Encoding: identity Nov 01 19:10:53.012047 n-d-863052-2 devstack@n-api.service[121403]: Connection: close Nov 01 19:10:53.012047 n-d-863052-2 devstack@n-api.service[121403]: Content-Length: 0 Nov 01 19:10:53.012047 n-d-863052-2 devstack@n-api.service[121403]: Content-Type: application/json Nov 01 19:10:53.012047 n-d-863052-2 devstack@n-api.service[121403]: Host: 10.222.0.13 Nov 01 19:10:53.012047 n-d-863052-2 devstack@n-api.service[121403]: Openstack-System-Scope: None Nov 01 19:10:53.012047 n-d-863052-2 devstack@n-api.service[121403]: User-Agent: python-urllib3/1.26.12 Nov 01 19:10:53.012047 n-d-863052-2 devstack@n-api.service[121403]: X-Auth-Token: gAAAAABjYW7xdoGEkUr9VmlNUPSTaUXnEM4cFVhCEosnqUFQu-SPdYOizV9_JPssqg1hkQ657RtQWwfdpbqukmZrySteKliSppoCmIGu9rFi0MbFndFq8Bb6qjRB6a9xe1deRV9xVTrc68Ro9pz9WovJ9U7N4N_g2t8EuiUPT8oRYr79Ppgt7Bc Nov 01 19:10:53.012047 n-d-863052-2 devstack@n-api.service[121403]: X-Domain-Id: None Nov 01 19:10:53.012047 n-d-863052-2 devstack@n-api.service[121403]: X-Domain-Name: None Nov 01 19:10:53.012047 n-d-863052-2 devstack@n-api.service[121403]: X-Identity-Status: Confirmed Nov 01 19:10:53.012047 n-d-863052-2 devstack@n-api.service[121403]: X-Is-Admin-Project: True Nov 01 19:10:53.012047 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Domain-Id: default Nov 01 19:10:53.012047 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Domain-Name: Default Nov 01 19:10:53.012047 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Id: 04ef687c40bd45c297d22a791bae58cf Nov 01 19:10:53.012047 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Name: tempest-ListServerFiltersTestJSON-1807374630 Nov 01 19:10:53.012047 n-d-863052-2 devstack@n-api.service[121403]: X-Role: member,reader Nov 01 19:10:53.012047 n-d-863052-2 devstack@n-api.service[121403]: X-Roles: member,reader Nov 01 19:10:53.012047 n-d-863052-2 devstack@n-api.service[121403]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/04ef687c40bd45c297d22a791bae58cf"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/04ef687c40bd45c297d22a791bae58cf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_04ef687c40bd45c297d22a791bae58cf", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/04ef687c40bd45c297d22a791bae58cf"}]}] Nov 01 19:10:53.012047 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant: tempest-ListServerFiltersTestJSON-1807374630 Nov 01 19:10:53.012047 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant-Id: 04ef687c40bd45c297d22a791bae58cf Nov 01 19:10:53.012047 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-1807374630 Nov 01 19:10:53.012047 n-d-863052-2 devstack@n-api.service[121403]: X-User: tempest-ListServerFiltersTestJSON-1807374630-project Nov 01 19:10:53.012047 n-d-863052-2 devstack@n-api.service[121403]: X-User-Domain-Id: default Nov 01 19:10:53.012047 n-d-863052-2 devstack@n-api.service[121403]: X-User-Domain-Name: Default Nov 01 19:10:53.012047 n-d-863052-2 devstack@n-api.service[121403]: X-User-Id: 2868ccfdfb164cffa37232c821f205a8 Nov 01 19:10:53.012047 n-d-863052-2 devstack@n-api.service[121403]: X-User-Name: tempest-ListServerFiltersTestJSON-1807374630-project Nov 01 19:10:53.012047 n-d-863052-2 devstack@n-api.service[121403]: method: > Nov 01 19:10:53.012047 n-d-863052-2 devstack@n-api.service[121403]: exception: Instance 33dd79e0-eb7c-4f18-a61f-df8022667dd0 could not be found. Nov 01 19:10:53.012047 n-d-863052-2 devstack@n-api.service[121403]: action_args: {'id': '33dd79e0-eb7c-4f18-a61f-df8022667dd0'} Nov 01 19:10:53.012047 n-d-863052-2 devstack@n-api.service[121403]: {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 01 19:10:53.012047 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:10:53.012047 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 01 19:10:53.012047 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 01 19:10:53.012047 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 01 19:10:53.012047 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 01 19:10:53.012047 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 01 19:10:53.012047 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 01 19:10:53.012047 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 01 19:10:53.012047 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 01 19:10:53.012047 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 33dd79e0-eb7c-4f18-a61f-df8022667dd0 could not be found. Nov 01 19:10:53.012047 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:10:53.012047 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:10:53.012047 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:10:53.012047 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:10:53.012047 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:10:53.012047 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:10:53.012047 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 01 19:10:53.012047 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 01 19:10:53.012047 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 01 19:10:53.012047 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 01 19:10:53.012047 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 01 19:10:53.012047 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 01 19:10:53.012047 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 01 19:10:53.012047 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 01 19:10:53.012047 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 01 19:10:53.012047 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 01 19:10:53.012047 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 33dd79e0-eb7c-4f18-a61f-df8022667dd0 could not be found. Nov 01 19:10:53.012047 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:10:53.012047 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:10:53.012047 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:10:53.018789 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:10:53.018789 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:10:53.018789 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:10:53.018789 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 01 19:10:53.018789 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 01 19:10:53.018789 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 33dd79e0-eb7c-4f18-a61f-df8022667dd0 could not be found. Nov 01 19:10:53.018789 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:10:53.018789 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-232497d5-e058-48ee-a515-5f7a22e16d6e tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Returning 404 to user: Instance 33dd79e0-eb7c-4f18-a61f-df8022667dd0 could not be found. {{(pid=121403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 01 19:10:53.018789 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-232497d5-e058-48ee-a515-5f7a22e16d6e tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] 10.222.0.13 "GET /compute/v2.1/servers/33dd79e0-eb7c-4f18-a61f-df8022667dd0" status: 404 len: 111 microversion: 2.1 time: 0.038006 Nov 01 19:10:53.018789 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 2085/4091] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:10:52 2022] GET /compute/v2.1/servers/33dd79e0-eb7c-4f18-a61f-df8022667dd0 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 01 19:10:53.021250 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-f099a4f7-fef3-4e1d-b3f3-c5a7feb006fc tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] 10.222.0.13 "GET /compute/v2.1/servers/ba6ffc5c-84a4-40f1-bdc7-f87dde2c99df" status: 200 len: 2055 microversion: 2.32 time: 0.423702 Nov 01 19:10:53.021992 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 2007/4092] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 19:10:52 2022] GET /compute/v2.1/servers/ba6ffc5c-84a4-40f1-bdc7-f87dde2c99df => generated 2055 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 19:10:53.024389 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-951c3a0d-861b-4679-a99f-16d1e9c98022 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:10:53.025032 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-951c3a0d-861b-4679-a99f-16d1e9c98022 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] [instance: ac19dd18-c22a-46de-91ef-454a0b78872f] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:10:53.031737 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-951c3a0d-861b-4679-a99f-16d1e9c98022 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:53.032363 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-951c3a0d-861b-4679-a99f-16d1e9c98022 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:53.033529 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-951c3a0d-861b-4679-a99f-16d1e9c98022 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:53.034336 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-951c3a0d-861b-4679-a99f-16d1e9c98022 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:53.034896 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-951c3a0d-861b-4679-a99f-16d1e9c98022 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:53.035427 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-951c3a0d-861b-4679-a99f-16d1e9c98022 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:53.064823 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-951c3a0d-861b-4679-a99f-16d1e9c98022 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] [instance: ac19dd18-c22a-46de-91ef-454a0b78872f] Going to try to terminate instance {{(pid=121403) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 01 19:10:53.170571 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-951c3a0d-861b-4679-a99f-16d1e9c98022 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] 10.222.0.13 "DELETE /compute/v2.1/servers/ac19dd18-c22a-46de-91ef-454a0b78872f" status: 204 len: 0 microversion: 2.1 time: 0.149715 Nov 01 19:10:53.171479 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 2086/4093] 10.222.0.13 () {58 vars in 1239 bytes} [Tue Nov 1 19:10:53 2022] DELETE /compute/v2.1/servers/ac19dd18-c22a-46de-91ef-454a0b78872f => generated 0 bytes in 153 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 01 19:10:53.180744 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-b99f258c-b45a-472a-8f21-74b82cf6bf0d tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:10:53.181631 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-b99f258c-b45a-472a-8f21-74b82cf6bf0d tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] [instance: ac19dd18-c22a-46de-91ef-454a0b78872f] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:10:53.196159 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b99f258c-b45a-472a-8f21-74b82cf6bf0d tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:53.198532 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b99f258c-b45a-472a-8f21-74b82cf6bf0d tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:53.200100 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b99f258c-b45a-472a-8f21-74b82cf6bf0d tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:53.201550 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b99f258c-b45a-472a-8f21-74b82cf6bf0d tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:53.203407 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b99f258c-b45a-472a-8f21-74b82cf6bf0d tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:53.204616 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b99f258c-b45a-472a-8f21-74b82cf6bf0d tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:53.452872 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-0909002f-42f5-4572-8d19-816ab1c9e743 tempest-InstanceActionsNegativeTestJSON-1175023068 tempest-InstanceActionsNegativeTestJSON-1175023068-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:10:53.453834 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-0909002f-42f5-4572-8d19-816ab1c9e743 tempest-InstanceActionsNegativeTestJSON-1175023068 tempest-InstanceActionsNegativeTestJSON-1175023068-project] [instance: 9ddd96fd-cb96-4808-9172-2785776d2d1d] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:10:53.456041 n-d-863052-2 devstack@n-api.service[121403]: DEBUG dbcounter [-] [121403] Writing DB stats nova_cell0:SELECT=6 {{(pid=121403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 19:10:53.458622 n-d-863052-2 devstack@n-api.service[121403]: DEBUG dbcounter [-] [121403] Writing DB stats nova_cell0:SELECT=8 {{(pid=121403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 19:10:53.475822 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-0909002f-42f5-4572-8d19-816ab1c9e743 tempest-InstanceActionsNegativeTestJSON-1175023068 tempest-InstanceActionsNegativeTestJSON-1175023068-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:53.477123 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-0909002f-42f5-4572-8d19-816ab1c9e743 tempest-InstanceActionsNegativeTestJSON-1175023068 tempest-InstanceActionsNegativeTestJSON-1175023068-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:53.478042 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-0909002f-42f5-4572-8d19-816ab1c9e743 tempest-InstanceActionsNegativeTestJSON-1175023068 tempest-InstanceActionsNegativeTestJSON-1175023068-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:53.480702 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-0909002f-42f5-4572-8d19-816ab1c9e743 tempest-InstanceActionsNegativeTestJSON-1175023068 tempest-InstanceActionsNegativeTestJSON-1175023068-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:53.481646 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-0909002f-42f5-4572-8d19-816ab1c9e743 tempest-InstanceActionsNegativeTestJSON-1175023068 tempest-InstanceActionsNegativeTestJSON-1175023068-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:53.483340 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-0909002f-42f5-4572-8d19-816ab1c9e743 tempest-InstanceActionsNegativeTestJSON-1175023068 tempest-InstanceActionsNegativeTestJSON-1175023068-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:53.617005 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-b99f258c-b45a-472a-8f21-74b82cf6bf0d tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2868ccfdfb164cffa37232c821f205a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04ef687c40bd45c297d22a791bae58cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:10:53.625070 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-b99f258c-b45a-472a-8f21-74b82cf6bf0d tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] 10.222.0.13 "GET /compute/v2.1/servers/ac19dd18-c22a-46de-91ef-454a0b78872f" status: 200 len: 1519 microversion: 2.1 time: 0.449319 Nov 01 19:10:53.626043 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 2008/4094] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:10:53 2022] GET /compute/v2.1/servers/ac19dd18-c22a-46de-91ef-454a0b78872f => generated 1519 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:10:53.637400 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-480d04bc-e61d-485e-ada7-0fe805f53391 tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:10:53.639598 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-480d04bc-e61d-485e-ada7-0fe805f53391 tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] [instance: 29b73e88-1e2a-45d8-bdbb-6c5f9399d270] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:10:53.654312 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-480d04bc-e61d-485e-ada7-0fe805f53391 tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:53.654847 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-480d04bc-e61d-485e-ada7-0fe805f53391 tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:53.655535 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-480d04bc-e61d-485e-ada7-0fe805f53391 tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:53.656250 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-480d04bc-e61d-485e-ada7-0fe805f53391 tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:53.658123 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-480d04bc-e61d-485e-ada7-0fe805f53391 tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:53.672633 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-480d04bc-e61d-485e-ada7-0fe805f53391 tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:53.872914 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-0909002f-42f5-4572-8d19-816ab1c9e743 tempest-InstanceActionsNegativeTestJSON-1175023068 tempest-InstanceActionsNegativeTestJSON-1175023068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90eeeb07a21345f5801a340078809488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba92568b226b4ea793c9f40cf9b97839', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:10:53.882009 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-480d04bc-e61d-485e-ada7-0fe805f53391 tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3111dabbf6d14e2c91766f2f5544057c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c30003431656408bb328e90be22d009a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:10:53.885583 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-0909002f-42f5-4572-8d19-816ab1c9e743 tempest-InstanceActionsNegativeTestJSON-1175023068 tempest-InstanceActionsNegativeTestJSON-1175023068-project] 10.222.0.13 "GET /compute/v2.1/servers/9ddd96fd-cb96-4808-9172-2785776d2d1d" status: 200 len: 1325 microversion: 2.1 time: 0.438379 Nov 01 19:10:53.886307 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 2087/4095] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:10:53 2022] GET /compute/v2.1/servers/9ddd96fd-cb96-4808-9172-2785776d2d1d => generated 1325 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 19:10:53.892017 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-c29c1f1b-99d9-4a12-8aab-180e9e999c92 tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:10:53.894583 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-c29c1f1b-99d9-4a12-8aab-180e9e999c92 tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] [instance: 7ee07462-fab6-49a3-b7fd-cbe545cc6f55] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:10:53.904243 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-480d04bc-e61d-485e-ada7-0fe805f53391 tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3111dabbf6d14e2c91766f2f5544057c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c30003431656408bb328e90be22d009a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:10:53.905768 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-480d04bc-e61d-485e-ada7-0fe805f53391 tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3111dabbf6d14e2c91766f2f5544057c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c30003431656408bb328e90be22d009a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:10:53.906950 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-480d04bc-e61d-485e-ada7-0fe805f53391 tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] 10.222.0.13 "GET /compute/v2.1/servers/29b73e88-1e2a-45d8-bdbb-6c5f9399d270" status: 200 len: 1372 microversion: 2.57 time: 0.279279 Nov 01 19:10:53.913648 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-c29c1f1b-99d9-4a12-8aab-180e9e999c92 tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:53.916121 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-c29c1f1b-99d9-4a12-8aab-180e9e999c92 tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:53.922181 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-c29c1f1b-99d9-4a12-8aab-180e9e999c92 tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:53.927023 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-c29c1f1b-99d9-4a12-8aab-180e9e999c92 tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:53.927590 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-c29c1f1b-99d9-4a12-8aab-180e9e999c92 tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:53.928172 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-c29c1f1b-99d9-4a12-8aab-180e9e999c92 tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:53.932952 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 2009/4096] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 19:10:53 2022] GET /compute/v2.1/servers/29b73e88-1e2a-45d8-bdbb-6c5f9399d270 => generated 1372 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 19:10:53.933709 n-d-863052-2 devstack@n-api.service[121403]: DEBUG dbcounter [-] [121403] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 19:10:54.051569 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-1b1290bd-353a-422d-84b2-32bb7d21a074 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:10:54.052172 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-1b1290bd-353a-422d-84b2-32bb7d21a074 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] [instance: ba6ffc5c-84a4-40f1-bdc7-f87dde2c99df] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:10:54.058668 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-1b1290bd-353a-422d-84b2-32bb7d21a074 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:54.065789 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-1b1290bd-353a-422d-84b2-32bb7d21a074 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:54.066538 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-1b1290bd-353a-422d-84b2-32bb7d21a074 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:54.067986 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-1b1290bd-353a-422d-84b2-32bb7d21a074 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:54.069765 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-1b1290bd-353a-422d-84b2-32bb7d21a074 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:54.072689 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-1b1290bd-353a-422d-84b2-32bb7d21a074 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:54.162519 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-c29c1f1b-99d9-4a12-8aab-180e9e999c92 tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c72e7e000a9a4fa49474bd5d19accf77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d8835c7b6754bfd81447b1f8893e56c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:10:54.173103 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-c29c1f1b-99d9-4a12-8aab-180e9e999c92 tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] 10.222.0.13 "GET /compute/v2.1/servers/7ee07462-fab6-49a3-b7fd-cbe545cc6f55" status: 200 len: 1507 microversion: 2.1 time: 0.285075 Nov 01 19:10:54.174268 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 2088/4097] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:10:53 2022] GET /compute/v2.1/servers/7ee07462-fab6-49a3-b7fd-cbe545cc6f55 => generated 1507 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:10:54.179708 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [req-f5f80c5e-afa7-4a27-b3a7-3083d4fff764 req-3b154c32-5be6-4dde-b76e-17d38aafa1c6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ba6ffc5c-84a4-40f1-bdc7-f87dde2c99df", "name": "network-vif-deleted", "tag": "5505ddf1-841a-456c-b4c2-811d7146122d"}]} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:10:54.190759 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-f5f80c5e-afa7-4a27-b3a7-3083d4fff764 req-3b154c32-5be6-4dde-b76e-17d38aafa1c6 service nova] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:54.191833 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-f5f80c5e-afa7-4a27-b3a7-3083d4fff764 req-3b154c32-5be6-4dde-b76e-17d38aafa1c6 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:54.192418 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-f5f80c5e-afa7-4a27-b3a7-3083d4fff764 req-3b154c32-5be6-4dde-b76e-17d38aafa1c6 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:54.206707 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.compute.server_external_events [req-f5f80c5e-afa7-4a27-b3a7-3083d4fff764 req-3b154c32-5be6-4dde-b76e-17d38aafa1c6 service nova] Creating event network-vif-deleted:5505ddf1-841a-456c-b4c2-811d7146122d for instance ba6ffc5c-84a4-40f1-bdc7-f87dde2c99df on n-h1-863052-2 Nov 01 19:10:54.213005 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [req-f5f80c5e-afa7-4a27-b3a7-3083d4fff764 req-3b154c32-5be6-4dde-b76e-17d38aafa1c6 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037247 Nov 01 19:10:54.214246 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 2089/4098] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Nov 1 19:10:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:10:54.269665 n-d-863052-2 devstack@n-api.service[121402]: DEBUG dbcounter [-] [121402] Writing DB stats nova_cell0:SELECT=2 {{(pid=121402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 19:10:54.456041 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-1b1290bd-353a-422d-84b2-32bb7d21a074 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd2105b0264b48d084d0e79cabff8bc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf4adda91364dab94830347c06e3957', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:10:54.490437 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-1b1290bd-353a-422d-84b2-32bb7d21a074 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd2105b0264b48d084d0e79cabff8bc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf4adda91364dab94830347c06e3957', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:10:54.497419 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-1b1290bd-353a-422d-84b2-32bb7d21a074 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd2105b0264b48d084d0e79cabff8bc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf4adda91364dab94830347c06e3957', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:10:54.506601 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-1b1290bd-353a-422d-84b2-32bb7d21a074 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] 10.222.0.13 "GET /compute/v2.1/servers/ba6ffc5c-84a4-40f1-bdc7-f87dde2c99df" status: 200 len: 1605 microversion: 2.32 time: 0.458997 Nov 01 19:10:54.513058 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 2010/4099] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 19:10:54 2022] GET /compute/v2.1/servers/ba6ffc5c-84a4-40f1-bdc7-f87dde2c99df => generated 1605 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 01 19:10:54.656769 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-043c59c0-cdde-41d6-9bab-366e3e71d484 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:10:54.658089 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-043c59c0-cdde-41d6-9bab-366e3e71d484 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] [instance: ac19dd18-c22a-46de-91ef-454a0b78872f] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:10:54.670405 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-043c59c0-cdde-41d6-9bab-366e3e71d484 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:54.676831 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-043c59c0-cdde-41d6-9bab-366e3e71d484 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:54.679802 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-043c59c0-cdde-41d6-9bab-366e3e71d484 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:54.681028 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-043c59c0-cdde-41d6-9bab-366e3e71d484 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:54.681537 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-043c59c0-cdde-41d6-9bab-366e3e71d484 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:54.681979 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-043c59c0-cdde-41d6-9bab-366e3e71d484 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:54.907434 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-d6665f72-105e-49fb-8ffd-11e099052f49 tempest-InstanceActionsNegativeTestJSON-1175023068 tempest-InstanceActionsNegativeTestJSON-1175023068-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:10:54.908174 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-d6665f72-105e-49fb-8ffd-11e099052f49 tempest-InstanceActionsNegativeTestJSON-1175023068 tempest-InstanceActionsNegativeTestJSON-1175023068-project] [instance: 9ddd96fd-cb96-4808-9172-2785776d2d1d] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:10:54.924921 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-d6665f72-105e-49fb-8ffd-11e099052f49 tempest-InstanceActionsNegativeTestJSON-1175023068 tempest-InstanceActionsNegativeTestJSON-1175023068-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:54.924921 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-d6665f72-105e-49fb-8ffd-11e099052f49 tempest-InstanceActionsNegativeTestJSON-1175023068 tempest-InstanceActionsNegativeTestJSON-1175023068-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:54.924921 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-d6665f72-105e-49fb-8ffd-11e099052f49 tempest-InstanceActionsNegativeTestJSON-1175023068 tempest-InstanceActionsNegativeTestJSON-1175023068-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:54.926411 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-d6665f72-105e-49fb-8ffd-11e099052f49 tempest-InstanceActionsNegativeTestJSON-1175023068 tempest-InstanceActionsNegativeTestJSON-1175023068-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:54.927108 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-d6665f72-105e-49fb-8ffd-11e099052f49 tempest-InstanceActionsNegativeTestJSON-1175023068 tempest-InstanceActionsNegativeTestJSON-1175023068-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:54.928103 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-d6665f72-105e-49fb-8ffd-11e099052f49 tempest-InstanceActionsNegativeTestJSON-1175023068 tempest-InstanceActionsNegativeTestJSON-1175023068-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:54.981667 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-043c59c0-cdde-41d6-9bab-366e3e71d484 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2868ccfdfb164cffa37232c821f205a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04ef687c40bd45c297d22a791bae58cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:10:55.010216 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-043c59c0-cdde-41d6-9bab-366e3e71d484 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] 10.222.0.13 "GET /compute/v2.1/servers/ac19dd18-c22a-46de-91ef-454a0b78872f" status: 200 len: 1519 microversion: 2.1 time: 0.359879 Nov 01 19:10:55.010841 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 2090/4100] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:10:54 2022] GET /compute/v2.1/servers/ac19dd18-c22a-46de-91ef-454a0b78872f => generated 1519 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:10:55.027311 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-6e225fe2-af2d-438e-a154-6f7a53370e98 tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:10:55.029053 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-6e225fe2-af2d-438e-a154-6f7a53370e98 tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] [instance: 29b73e88-1e2a-45d8-bdbb-6c5f9399d270] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:10:55.054782 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-6e225fe2-af2d-438e-a154-6f7a53370e98 tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:55.055464 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-6e225fe2-af2d-438e-a154-6f7a53370e98 tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:55.057923 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-6e225fe2-af2d-438e-a154-6f7a53370e98 tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:55.059851 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-6e225fe2-af2d-438e-a154-6f7a53370e98 tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:55.060504 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-6e225fe2-af2d-438e-a154-6f7a53370e98 tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:55.063583 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-6e225fe2-af2d-438e-a154-6f7a53370e98 tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:55.305921 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-6e225fe2-af2d-438e-a154-6f7a53370e98 tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3111dabbf6d14e2c91766f2f5544057c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c30003431656408bb328e90be22d009a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:10:55.315078 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-6e225fe2-af2d-438e-a154-6f7a53370e98 tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3111dabbf6d14e2c91766f2f5544057c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c30003431656408bb328e90be22d009a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:10:55.316520 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-6e225fe2-af2d-438e-a154-6f7a53370e98 tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3111dabbf6d14e2c91766f2f5544057c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c30003431656408bb328e90be22d009a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:10:55.317732 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-6e225fe2-af2d-438e-a154-6f7a53370e98 tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] 10.222.0.13 "GET /compute/v2.1/servers/29b73e88-1e2a-45d8-bdbb-6c5f9399d270" status: 200 len: 1357 microversion: 2.57 time: 0.305955 Nov 01 19:10:55.318294 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 2091/4101] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 19:10:55 2022] GET /compute/v2.1/servers/29b73e88-1e2a-45d8-bdbb-6c5f9399d270 => generated 1357 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 19:10:55.332786 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-d6665f72-105e-49fb-8ffd-11e099052f49 tempest-InstanceActionsNegativeTestJSON-1175023068 tempest-InstanceActionsNegativeTestJSON-1175023068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90eeeb07a21345f5801a340078809488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba92568b226b4ea793c9f40cf9b97839', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:10:55.338094 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-d6665f72-105e-49fb-8ffd-11e099052f49 tempest-InstanceActionsNegativeTestJSON-1175023068 tempest-InstanceActionsNegativeTestJSON-1175023068-project] 10.222.0.13 "GET /compute/v2.1/servers/9ddd96fd-cb96-4808-9172-2785776d2d1d" status: 200 len: 1325 microversion: 2.1 time: 0.433648 Nov 01 19:10:55.340273 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 2011/4102] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:10:54 2022] GET /compute/v2.1/servers/9ddd96fd-cb96-4808-9172-2785776d2d1d => generated 1325 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 19:10:55.372156 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-06ad5411-283c-4fd7-98ff-0780dd8450c6 tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:10:55.372995 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-06ad5411-283c-4fd7-98ff-0780dd8450c6 tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] [instance: 29b73e88-1e2a-45d8-bdbb-6c5f9399d270] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:10:55.381929 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-06ad5411-283c-4fd7-98ff-0780dd8450c6 tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:55.382905 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-06ad5411-283c-4fd7-98ff-0780dd8450c6 tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:55.383453 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-06ad5411-283c-4fd7-98ff-0780dd8450c6 tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:55.384377 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-06ad5411-283c-4fd7-98ff-0780dd8450c6 tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:55.384974 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-06ad5411-283c-4fd7-98ff-0780dd8450c6 tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:55.385502 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-06ad5411-283c-4fd7-98ff-0780dd8450c6 tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:55.456964 n-d-863052-2 devstack@n-api.service[121402]: DEBUG dbcounter [-] [121402] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=98,nova_cell1:INSERT=1 {{(pid=121402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 19:10:55.469884 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-06ad5411-283c-4fd7-98ff-0780dd8450c6 tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] [instance: 29b73e88-1e2a-45d8-bdbb-6c5f9399d270] Going to try to terminate instance {{(pid=121402) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 01 19:10:55.542975 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-24cab304-c4c6-4407-b9a3-6b5ce83b1f96 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:10:55.543783 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-24cab304-c4c6-4407-b9a3-6b5ce83b1f96 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] [instance: ba6ffc5c-84a4-40f1-bdc7-f87dde2c99df] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:10:55.554164 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-24cab304-c4c6-4407-b9a3-6b5ce83b1f96 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:55.554939 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-24cab304-c4c6-4407-b9a3-6b5ce83b1f96 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:55.556032 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-24cab304-c4c6-4407-b9a3-6b5ce83b1f96 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:55.557386 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-24cab304-c4c6-4407-b9a3-6b5ce83b1f96 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:55.559221 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-24cab304-c4c6-4407-b9a3-6b5ce83b1f96 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:55.561535 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-24cab304-c4c6-4407-b9a3-6b5ce83b1f96 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:55.668771 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-06ad5411-283c-4fd7-98ff-0780dd8450c6 tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] 10.222.0.13 "DELETE /compute/v2.1/servers/29b73e88-1e2a-45d8-bdbb-6c5f9399d270" status: 204 len: 0 microversion: 2.57 time: 0.299713 Nov 01 19:10:55.671003 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 2012/4103] 10.222.0.13 () {60 vars in 1280 bytes} [Tue Nov 1 19:10:55 2022] DELETE /compute/v2.1/servers/29b73e88-1e2a-45d8-bdbb-6c5f9399d270 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 01 19:10:55.680833 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-434714c0-e7f2-4808-b2af-c1c08db52837 tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:10:55.682133 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-434714c0-e7f2-4808-b2af-c1c08db52837 tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] [instance: 29b73e88-1e2a-45d8-bdbb-6c5f9399d270] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:10:55.694087 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-434714c0-e7f2-4808-b2af-c1c08db52837 tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:55.696136 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-434714c0-e7f2-4808-b2af-c1c08db52837 tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:55.696938 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-434714c0-e7f2-4808-b2af-c1c08db52837 tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:55.697891 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-434714c0-e7f2-4808-b2af-c1c08db52837 tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:55.698881 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-434714c0-e7f2-4808-b2af-c1c08db52837 tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:55.699535 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-434714c0-e7f2-4808-b2af-c1c08db52837 tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:55.909779 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-24cab304-c4c6-4407-b9a3-6b5ce83b1f96 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd2105b0264b48d084d0e79cabff8bc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf4adda91364dab94830347c06e3957', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:10:55.926015 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-24cab304-c4c6-4407-b9a3-6b5ce83b1f96 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd2105b0264b48d084d0e79cabff8bc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf4adda91364dab94830347c06e3957', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:10:55.935732 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-434714c0-e7f2-4808-b2af-c1c08db52837 tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3111dabbf6d14e2c91766f2f5544057c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c30003431656408bb328e90be22d009a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:10:55.952115 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-24cab304-c4c6-4407-b9a3-6b5ce83b1f96 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd2105b0264b48d084d0e79cabff8bc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf4adda91364dab94830347c06e3957', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:10:55.952314 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-434714c0-e7f2-4808-b2af-c1c08db52837 tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3111dabbf6d14e2c91766f2f5544057c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c30003431656408bb328e90be22d009a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:10:55.955191 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-24cab304-c4c6-4407-b9a3-6b5ce83b1f96 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] 10.222.0.13 "GET /compute/v2.1/servers/ba6ffc5c-84a4-40f1-bdc7-f87dde2c99df" status: 200 len: 1605 microversion: 2.32 time: 0.416972 Nov 01 19:10:55.955769 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 2092/4104] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 19:10:55 2022] GET /compute/v2.1/servers/ba6ffc5c-84a4-40f1-bdc7-f87dde2c99df => generated 1605 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 01 19:10:55.972924 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-434714c0-e7f2-4808-b2af-c1c08db52837 tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3111dabbf6d14e2c91766f2f5544057c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c30003431656408bb328e90be22d009a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:10:55.972924 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-434714c0-e7f2-4808-b2af-c1c08db52837 tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] 10.222.0.13 "GET /compute/v2.1/servers/29b73e88-1e2a-45d8-bdbb-6c5f9399d270" status: 200 len: 1363 microversion: 2.57 time: 0.284318 Nov 01 19:10:55.972924 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 2013/4105] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 19:10:55 2022] GET /compute/v2.1/servers/29b73e88-1e2a-45d8-bdbb-6c5f9399d270 => generated 1363 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 01 19:10:56.046222 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-f398d338-5ef4-44b0-9dfa-e23acb4138cd tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:10:56.046829 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-f398d338-5ef4-44b0-9dfa-e23acb4138cd tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] [instance: ac19dd18-c22a-46de-91ef-454a0b78872f] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:10:56.053974 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f398d338-5ef4-44b0-9dfa-e23acb4138cd tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:56.054685 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f398d338-5ef4-44b0-9dfa-e23acb4138cd tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:56.055295 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f398d338-5ef4-44b0-9dfa-e23acb4138cd tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:56.056179 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f398d338-5ef4-44b0-9dfa-e23acb4138cd tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:56.056835 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f398d338-5ef4-44b0-9dfa-e23acb4138cd tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:56.057422 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f398d338-5ef4-44b0-9dfa-e23acb4138cd tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:56.370135 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-c26fbd51-5690-4a1c-a8d9-9161774b8e25 tempest-InstanceActionsNegativeTestJSON-1175023068 tempest-InstanceActionsNegativeTestJSON-1175023068-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:10:56.370887 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-c26fbd51-5690-4a1c-a8d9-9161774b8e25 tempest-InstanceActionsNegativeTestJSON-1175023068 tempest-InstanceActionsNegativeTestJSON-1175023068-project] [instance: 9ddd96fd-cb96-4808-9172-2785776d2d1d] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:10:56.382003 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-c26fbd51-5690-4a1c-a8d9-9161774b8e25 tempest-InstanceActionsNegativeTestJSON-1175023068 tempest-InstanceActionsNegativeTestJSON-1175023068-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:56.382682 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-c26fbd51-5690-4a1c-a8d9-9161774b8e25 tempest-InstanceActionsNegativeTestJSON-1175023068 tempest-InstanceActionsNegativeTestJSON-1175023068-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:56.383333 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-c26fbd51-5690-4a1c-a8d9-9161774b8e25 tempest-InstanceActionsNegativeTestJSON-1175023068 tempest-InstanceActionsNegativeTestJSON-1175023068-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:56.384211 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-c26fbd51-5690-4a1c-a8d9-9161774b8e25 tempest-InstanceActionsNegativeTestJSON-1175023068 tempest-InstanceActionsNegativeTestJSON-1175023068-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:56.384857 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-c26fbd51-5690-4a1c-a8d9-9161774b8e25 tempest-InstanceActionsNegativeTestJSON-1175023068 tempest-InstanceActionsNegativeTestJSON-1175023068-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:56.385450 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-c26fbd51-5690-4a1c-a8d9-9161774b8e25 tempest-InstanceActionsNegativeTestJSON-1175023068 tempest-InstanceActionsNegativeTestJSON-1175023068-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:56.477975 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-f398d338-5ef4-44b0-9dfa-e23acb4138cd tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2868ccfdfb164cffa37232c821f205a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04ef687c40bd45c297d22a791bae58cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:10:56.489673 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-f398d338-5ef4-44b0-9dfa-e23acb4138cd tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] 10.222.0.13 "GET /compute/v2.1/servers/ac19dd18-c22a-46de-91ef-454a0b78872f" status: 200 len: 1519 microversion: 2.1 time: 0.447579 Nov 01 19:10:56.491397 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 2093/4106] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:10:56 2022] GET /compute/v2.1/servers/ac19dd18-c22a-46de-91ef-454a0b78872f => generated 1519 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:10:56.619931 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-c26fbd51-5690-4a1c-a8d9-9161774b8e25 tempest-InstanceActionsNegativeTestJSON-1175023068 tempest-InstanceActionsNegativeTestJSON-1175023068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90eeeb07a21345f5801a340078809488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba92568b226b4ea793c9f40cf9b97839', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:10:56.646427 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-c26fbd51-5690-4a1c-a8d9-9161774b8e25 tempest-InstanceActionsNegativeTestJSON-1175023068 tempest-InstanceActionsNegativeTestJSON-1175023068-project] 10.222.0.13 "GET /compute/v2.1/servers/9ddd96fd-cb96-4808-9172-2785776d2d1d" status: 200 len: 1325 microversion: 2.1 time: 0.281685 Nov 01 19:10:56.647942 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 2014/4107] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:10:56 2022] GET /compute/v2.1/servers/9ddd96fd-cb96-4808-9172-2785776d2d1d => generated 1325 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 19:10:56.989674 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-df864455-ee1c-4d46-8601-fcdf1a74e64b tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:10:56.990652 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-37200325-2eea-426c-8ee2-4c072c54fe3c tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:10:56.991304 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-df864455-ee1c-4d46-8601-fcdf1a74e64b tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] [instance: 29b73e88-1e2a-45d8-bdbb-6c5f9399d270] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:10:56.991429 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-37200325-2eea-426c-8ee2-4c072c54fe3c tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] [instance: ba6ffc5c-84a4-40f1-bdc7-f87dde2c99df] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:10:57.000650 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-37200325-2eea-426c-8ee2-4c072c54fe3c tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:57.001146 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-37200325-2eea-426c-8ee2-4c072c54fe3c tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:57.003104 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-df864455-ee1c-4d46-8601-fcdf1a74e64b tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:57.005759 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-df864455-ee1c-4d46-8601-fcdf1a74e64b tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:57.006339 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-37200325-2eea-426c-8ee2-4c072c54fe3c tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:57.006769 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-df864455-ee1c-4d46-8601-fcdf1a74e64b tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:57.007725 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-df864455-ee1c-4d46-8601-fcdf1a74e64b tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:57.008435 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-df864455-ee1c-4d46-8601-fcdf1a74e64b tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:57.010481 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-37200325-2eea-426c-8ee2-4c072c54fe3c tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:57.010981 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-37200325-2eea-426c-8ee2-4c072c54fe3c tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:57.011657 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-df864455-ee1c-4d46-8601-fcdf1a74e64b tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:57.025770 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-37200325-2eea-426c-8ee2-4c072c54fe3c tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:57.160786 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-df864455-ee1c-4d46-8601-fcdf1a74e64b tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3111dabbf6d14e2c91766f2f5544057c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c30003431656408bb328e90be22d009a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:10:57.174099 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-df864455-ee1c-4d46-8601-fcdf1a74e64b tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3111dabbf6d14e2c91766f2f5544057c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c30003431656408bb328e90be22d009a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:10:57.179928 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-df864455-ee1c-4d46-8601-fcdf1a74e64b tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3111dabbf6d14e2c91766f2f5544057c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c30003431656408bb328e90be22d009a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:10:57.183576 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-df864455-ee1c-4d46-8601-fcdf1a74e64b tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] 10.222.0.13 "GET /compute/v2.1/servers/29b73e88-1e2a-45d8-bdbb-6c5f9399d270" status: 200 len: 1363 microversion: 2.57 time: 0.198079 Nov 01 19:10:57.186771 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 2015/4108] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 19:10:56 2022] GET /compute/v2.1/servers/29b73e88-1e2a-45d8-bdbb-6c5f9399d270 => generated 1363 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 19:10:57.193630 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-977956c4-dd4e-487c-80dc-fd65d1d47e8f tempest-VolumesAdminNegativeTest-108400703 tempest-VolumesAdminNegativeTest-108400703-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "7100be57-cc4c-43be-8c06-20e052229e3b"}} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:10:57.203409 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-977956c4-dd4e-487c-80dc-fd65d1d47e8f tempest-VolumesAdminNegativeTest-108400703 tempest-VolumesAdminNegativeTest-108400703-project-admin] [instance: 7ee07462-fab6-49a3-b7fd-cbe545cc6f55] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:10:57.213486 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-37200325-2eea-426c-8ee2-4c072c54fe3c tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd2105b0264b48d084d0e79cabff8bc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf4adda91364dab94830347c06e3957', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:10:57.219316 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-977956c4-dd4e-487c-80dc-fd65d1d47e8f tempest-VolumesAdminNegativeTest-108400703 tempest-VolumesAdminNegativeTest-108400703-project-admin] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:57.221928 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-977956c4-dd4e-487c-80dc-fd65d1d47e8f tempest-VolumesAdminNegativeTest-108400703 tempest-VolumesAdminNegativeTest-108400703-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:57.222483 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-977956c4-dd4e-487c-80dc-fd65d1d47e8f tempest-VolumesAdminNegativeTest-108400703 tempest-VolumesAdminNegativeTest-108400703-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:57.228952 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-977956c4-dd4e-487c-80dc-fd65d1d47e8f tempest-VolumesAdminNegativeTest-108400703 tempest-VolumesAdminNegativeTest-108400703-project-admin] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:57.229660 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-977956c4-dd4e-487c-80dc-fd65d1d47e8f tempest-VolumesAdminNegativeTest-108400703 tempest-VolumesAdminNegativeTest-108400703-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:57.230223 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-37200325-2eea-426c-8ee2-4c072c54fe3c tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd2105b0264b48d084d0e79cabff8bc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf4adda91364dab94830347c06e3957', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:10:57.230482 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-977956c4-dd4e-487c-80dc-fd65d1d47e8f tempest-VolumesAdminNegativeTest-108400703 tempest-VolumesAdminNegativeTest-108400703-project-admin] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:57.235589 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-37200325-2eea-426c-8ee2-4c072c54fe3c tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd2105b0264b48d084d0e79cabff8bc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf4adda91364dab94830347c06e3957', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:10:57.236891 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-37200325-2eea-426c-8ee2-4c072c54fe3c tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] 10.222.0.13 "GET /compute/v2.1/servers/ba6ffc5c-84a4-40f1-bdc7-f87dde2c99df" status: 200 len: 1605 microversion: 2.32 time: 0.251321 Nov 01 19:10:57.238385 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 2094/4109] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 19:10:56 2022] GET /compute/v2.1/servers/ba6ffc5c-84a4-40f1-bdc7-f87dde2c99df => generated 1605 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 19:10:57.262482 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [req-78bf1965-b85e-4c7c-9e6c-19f15fcb8d57 req-3bdc07b1-0f2c-4592-a70a-6a59ad58df1b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac19dd18-c22a-46de-91ef-454a0b78872f", "name": "network-vif-deleted", "tag": "01134387-2119-4a51-a70d-487b57f4610e"}]} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:10:57.294302 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-78bf1965-b85e-4c7c-9e6c-19f15fcb8d57 req-3bdc07b1-0f2c-4592-a70a-6a59ad58df1b service nova] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:57.294800 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-78bf1965-b85e-4c7c-9e6c-19f15fcb8d57 req-3bdc07b1-0f2c-4592-a70a-6a59ad58df1b service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:57.295232 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-78bf1965-b85e-4c7c-9e6c-19f15fcb8d57 req-3bdc07b1-0f2c-4592-a70a-6a59ad58df1b service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:57.332046 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.compute.server_external_events [req-78bf1965-b85e-4c7c-9e6c-19f15fcb8d57 req-3bdc07b1-0f2c-4592-a70a-6a59ad58df1b service nova] Creating event network-vif-deleted:01134387-2119-4a51-a70d-487b57f4610e for instance ac19dd18-c22a-46de-91ef-454a0b78872f on n-h2-863052-2 Nov 01 19:10:57.344910 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [req-78bf1965-b85e-4c7c-9e6c-19f15fcb8d57 req-3bdc07b1-0f2c-4592-a70a-6a59ad58df1b service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091320 Nov 01 19:10:57.347284 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 2095/4110] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Nov 1 19:10:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:10:57.374640 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.wsgi [None req-977956c4-dd4e-487c-80dc-fd65d1d47e8f tempest-VolumesAdminNegativeTest-108400703 tempest-VolumesAdminNegativeTest-108400703-project-admin] HTTP exception thrown: Volume 7b01f32d-3325-431d-92f5-8e4cbb9a6bac could not be found. Nov 01 19:10:57.378021 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-977956c4-dd4e-487c-80dc-fd65d1d47e8f tempest-VolumesAdminNegativeTest-108400703 tempest-VolumesAdminNegativeTest-108400703-project-admin] Request method failure captured: Nov 01 19:10:57.378021 n-d-863052-2 devstack@n-api.service[121402]: request: PUT /compute/v2.1/servers/7ee07462-fab6-49a3-b7fd-cbe545cc6f55/os-volume_attachments/7b01f32d-3325-431d-92f5-8e4cbb9a6bac HTTP/1.1 Nov 01 19:10:57.378021 n-d-863052-2 devstack@n-api.service[121402]: Accept: application/json Nov 01 19:10:57.378021 n-d-863052-2 devstack@n-api.service[121402]: Accept-Encoding: identity Nov 01 19:10:57.378021 n-d-863052-2 devstack@n-api.service[121402]: Connection: close Nov 01 19:10:57.378021 n-d-863052-2 devstack@n-api.service[121402]: Content-Length: 74 Nov 01 19:10:57.378021 n-d-863052-2 devstack@n-api.service[121402]: Content-Type: application/json Nov 01 19:10:57.378021 n-d-863052-2 devstack@n-api.service[121402]: Host: 10.222.0.13 Nov 01 19:10:57.378021 n-d-863052-2 devstack@n-api.service[121402]: Openstack-System-Scope: None Nov 01 19:10:57.378021 n-d-863052-2 devstack@n-api.service[121402]: User-Agent: python-urllib3/1.26.12 Nov 01 19:10:57.378021 n-d-863052-2 devstack@n-api.service[121402]: X-Auth-Token: gAAAAABjYW7QhjUFewFmSmqJe7Fkb0IhhbnzO3K4wDJfC5E6HUgTjk4WlRZB1hEuqagFVocXVGLFn4lkUKLoVL1nUTu3wZuQNAn8Kb0ca7pJuwuQV3PwxBXTL2M_Y5YZz9Be4HhoYvmbVZIh0PhDur0qdASEOhXbpyWnuWUjuiCIkxa0ZtVXUJQ Nov 01 19:10:57.378021 n-d-863052-2 devstack@n-api.service[121402]: X-Domain-Id: None Nov 01 19:10:57.378021 n-d-863052-2 devstack@n-api.service[121402]: X-Domain-Name: None Nov 01 19:10:57.378021 n-d-863052-2 devstack@n-api.service[121402]: X-Identity-Status: Confirmed Nov 01 19:10:57.378021 n-d-863052-2 devstack@n-api.service[121402]: X-Is-Admin-Project: True Nov 01 19:10:57.378021 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Domain-Id: default Nov 01 19:10:57.378021 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Domain-Name: Default Nov 01 19:10:57.378021 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Id: 1389a4dcef3245068303c4074a0e8cc7 Nov 01 19:10:57.378021 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Name: tempest-VolumesAdminNegativeTest-108400703 Nov 01 19:10:57.378021 n-d-863052-2 devstack@n-api.service[121402]: X-Role: admin,member,reader Nov 01 19:10:57.378021 n-d-863052-2 devstack@n-api.service[121402]: X-Roles: admin,member,reader Nov 01 19:10:57.378021 n-d-863052-2 devstack@n-api.service[121402]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/1389a4dcef3245068303c4074a0e8cc7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/1389a4dcef3245068303c4074a0e8cc7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_1389a4dcef3245068303c4074a0e8cc7", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/1389a4dcef3245068303c4074a0e8cc7"}]}] Nov 01 19:10:57.378021 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant: tempest-VolumesAdminNegativeTest-108400703 Nov 01 19:10:57.378021 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant-Id: 1389a4dcef3245068303c4074a0e8cc7 Nov 01 19:10:57.378021 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-108400703 Nov 01 19:10:57.378021 n-d-863052-2 devstack@n-api.service[121402]: X-User: tempest-VolumesAdminNegativeTest-108400703-project-admin Nov 01 19:10:57.378021 n-d-863052-2 devstack@n-api.service[121402]: X-User-Domain-Id: default Nov 01 19:10:57.378021 n-d-863052-2 devstack@n-api.service[121402]: X-User-Domain-Name: Default Nov 01 19:10:57.378021 n-d-863052-2 devstack@n-api.service[121402]: X-User-Id: b596913003ba4c00b6eabadfdf8cad12 Nov 01 19:10:57.378021 n-d-863052-2 devstack@n-api.service[121402]: X-User-Name: tempest-VolumesAdminNegativeTest-108400703-project-admin Nov 01 19:10:57.378021 n-d-863052-2 devstack@n-api.service[121402]: Nov 01 19:10:57.378021 n-d-863052-2 devstack@n-api.service[121402]: {"volumeAttachment": {"volumeId": "7100be57-cc4c-43be-8c06-20e052229e3b"}} Nov 01 19:10:57.378021 n-d-863052-2 devstack@n-api.service[121402]: method: > Nov 01 19:10:57.378021 n-d-863052-2 devstack@n-api.service[121402]: exception: Volume 7b01f32d-3325-431d-92f5-8e4cbb9a6bac could not be found. Nov 01 19:10:57.378021 n-d-863052-2 devstack@n-api.service[121402]: action_args: {'server_id': '7ee07462-fab6-49a3-b7fd-cbe545cc6f55', 'id': '7b01f32d-3325-431d-92f5-8e4cbb9a6bac', 'body': {'volumeAttachment': {'volumeId': '7100be57-cc4c-43be-8c06-20e052229e3b'}}} Nov 01 19:10:57.378021 n-d-863052-2 devstack@n-api.service[121402]: {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 01 19:10:57.378021 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:10:57.378021 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Nov 01 19:10:57.378021 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Nov 01 19:10:57.378021 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Nov 01 19:10:57.378021 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi item = cinderclient( Nov 01 19:10:57.378021 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Nov 01 19:10:57.378021 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Nov 01 19:10:57.378021 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Nov 01 19:10:57.378021 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Nov 01 19:10:57.378021 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Nov 01 19:10:57.378021 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Nov 01 19:10:57.378021 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Nov 01 19:10:57.378021 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Nov 01 19:10:57.378021 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Nov 01 19:10:57.378021 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Nov 01 19:10:57.378021 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 7b01f32d-3325-431d-92f5-8e4cbb9a6bac could not be found. (HTTP 404) (Request-ID: req-d6e16fb5-3c97-43c8-898d-5379c3ffc63e) Nov 01 19:10:57.378021 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:10:57.378021 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:10:57.378021 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:10:57.378021 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:10:57.378021 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 430, in _update_volume_swap Nov 01 19:10:57.378021 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi old_volume = self.volume_api.get(context, old_volume_id) Nov 01 19:10:57.378021 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Nov 01 19:10:57.378021 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Nov 01 19:10:57.378021 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Nov 01 19:10:57.383239 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Nov 01 19:10:57.383239 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Nov 01 19:10:57.383239 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Nov 01 19:10:57.383239 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Nov 01 19:10:57.383239 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Nov 01 19:10:57.383239 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Nov 01 19:10:57.383239 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi item = cinderclient( Nov 01 19:10:57.383239 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Nov 01 19:10:57.383239 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Nov 01 19:10:57.383239 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Nov 01 19:10:57.383239 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Nov 01 19:10:57.383239 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Nov 01 19:10:57.383239 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Nov 01 19:10:57.383239 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Nov 01 19:10:57.383239 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Nov 01 19:10:57.383239 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Nov 01 19:10:57.383239 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Nov 01 19:10:57.383239 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 7b01f32d-3325-431d-92f5-8e4cbb9a6bac could not be found. Nov 01 19:10:57.383239 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:10:57.383239 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:10:57.383239 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:10:57.383239 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:10:57.383239 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:10:57.383239 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:10:57.383239 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 01 19:10:57.383239 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 01 19:10:57.383239 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 01 19:10:57.383239 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 01 19:10:57.383239 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 01 19:10:57.383239 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 01 19:10:57.383239 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 01 19:10:57.383239 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 01 19:10:57.383239 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Nov 01 19:10:57.383239 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Nov 01 19:10:57.383239 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 432, in _update_volume_swap Nov 01 19:10:57.383239 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 01 19:10:57.383239 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 7b01f32d-3325-431d-92f5-8e4cbb9a6bac could not be found. Nov 01 19:10:57.383239 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:10:57.383239 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:10:57.383239 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:10:57.383239 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:10:57.383239 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:10:57.383239 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:10:57.383239 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 01 19:10:57.383239 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 01 19:10:57.383239 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 7b01f32d-3325-431d-92f5-8e4cbb9a6bac could not be found. Nov 01 19:10:57.383239 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:10:57.390250 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-977956c4-dd4e-487c-80dc-fd65d1d47e8f tempest-VolumesAdminNegativeTest-108400703 tempest-VolumesAdminNegativeTest-108400703-project-admin] Returning 404 to user: Volume 7b01f32d-3325-431d-92f5-8e4cbb9a6bac could not be found. {{(pid=121402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 01 19:10:57.390250 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-977956c4-dd4e-487c-80dc-fd65d1d47e8f tempest-VolumesAdminNegativeTest-108400703 tempest-VolumesAdminNegativeTest-108400703-project-admin] 10.222.0.13 "PUT /compute/v2.1/servers/7ee07462-fab6-49a3-b7fd-cbe545cc6f55/os-volume_attachments/7b01f32d-3325-431d-92f5-8e4cbb9a6bac" status: 404 len: 109 microversion: 2.1 time: 0.201691 Nov 01 19:10:57.390772 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 2016/4111] 10.222.0.13 () {60 vars in 1433 bytes} [Tue Nov 1 19:10:57 2022] PUT /compute/v2.1/servers/7ee07462-fab6-49a3-b7fd-cbe545cc6f55/os-volume_attachments/7b01f32d-3325-431d-92f5-8e4cbb9a6bac => generated 109 bytes in 203 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 01 19:10:57.525037 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-f6f25b99-8a46-4a20-b539-72fbee8a8fa8 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:10:57.528227 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-f6f25b99-8a46-4a20-b539-72fbee8a8fa8 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] [instance: ac19dd18-c22a-46de-91ef-454a0b78872f] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:10:57.556307 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f6f25b99-8a46-4a20-b539-72fbee8a8fa8 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:57.559578 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f6f25b99-8a46-4a20-b539-72fbee8a8fa8 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:57.561340 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f6f25b99-8a46-4a20-b539-72fbee8a8fa8 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:57.563243 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f6f25b99-8a46-4a20-b539-72fbee8a8fa8 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:57.566382 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f6f25b99-8a46-4a20-b539-72fbee8a8fa8 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:57.567888 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f6f25b99-8a46-4a20-b539-72fbee8a8fa8 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:57.671249 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-78b3dd60-86a2-4d6a-b696-5ea8806621de tempest-InstanceActionsNegativeTestJSON-1175023068 tempest-InstanceActionsNegativeTestJSON-1175023068-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:10:57.671962 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-78b3dd60-86a2-4d6a-b696-5ea8806621de tempest-InstanceActionsNegativeTestJSON-1175023068 tempest-InstanceActionsNegativeTestJSON-1175023068-project] [instance: 9ddd96fd-cb96-4808-9172-2785776d2d1d] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:10:57.690315 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-78b3dd60-86a2-4d6a-b696-5ea8806621de tempest-InstanceActionsNegativeTestJSON-1175023068 tempest-InstanceActionsNegativeTestJSON-1175023068-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:57.690926 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-78b3dd60-86a2-4d6a-b696-5ea8806621de tempest-InstanceActionsNegativeTestJSON-1175023068 tempest-InstanceActionsNegativeTestJSON-1175023068-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:57.691441 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-78b3dd60-86a2-4d6a-b696-5ea8806621de tempest-InstanceActionsNegativeTestJSON-1175023068 tempest-InstanceActionsNegativeTestJSON-1175023068-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:57.693940 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-78b3dd60-86a2-4d6a-b696-5ea8806621de tempest-InstanceActionsNegativeTestJSON-1175023068 tempest-InstanceActionsNegativeTestJSON-1175023068-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:57.696029 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-78b3dd60-86a2-4d6a-b696-5ea8806621de tempest-InstanceActionsNegativeTestJSON-1175023068 tempest-InstanceActionsNegativeTestJSON-1175023068-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:57.696634 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-78b3dd60-86a2-4d6a-b696-5ea8806621de tempest-InstanceActionsNegativeTestJSON-1175023068 tempest-InstanceActionsNegativeTestJSON-1175023068-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:57.713303 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f6f25b99-8a46-4a20-b539-72fbee8a8fa8 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:57.718477 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f6f25b99-8a46-4a20-b539-72fbee8a8fa8 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:57.719066 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f6f25b99-8a46-4a20-b539-72fbee8a8fa8 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:57.725482 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.objects.instance [None req-f6f25b99-8a46-4a20-b539-72fbee8a8fa8 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Lazy-loading 'fault' on Instance uuid ac19dd18-c22a-46de-91ef-454a0b78872f {{(pid=121403) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 01 19:10:58.334186 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-78b3dd60-86a2-4d6a-b696-5ea8806621de tempest-InstanceActionsNegativeTestJSON-1175023068 tempest-InstanceActionsNegativeTestJSON-1175023068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90eeeb07a21345f5801a340078809488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba92568b226b4ea793c9f40cf9b97839', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:10:58.349041 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-78b3dd60-86a2-4d6a-b696-5ea8806621de tempest-InstanceActionsNegativeTestJSON-1175023068 tempest-InstanceActionsNegativeTestJSON-1175023068-project] 10.222.0.13 "GET /compute/v2.1/servers/9ddd96fd-cb96-4808-9172-2785776d2d1d" status: 200 len: 1325 microversion: 2.1 time: 0.681482 Nov 01 19:10:58.355361 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 2017/4112] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:10:57 2022] GET /compute/v2.1/servers/9ddd96fd-cb96-4808-9172-2785776d2d1d => generated 1325 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 19:10:58.378723 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-6c08e3a1-1ce4-4e3f-b96c-21341033a18f tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:10:58.383086 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-6c08e3a1-1ce4-4e3f-b96c-21341033a18f tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] [instance: 29b73e88-1e2a-45d8-bdbb-6c5f9399d270] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:10:58.416273 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-6c08e3a1-1ce4-4e3f-b96c-21341033a18f tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:58.437923 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-6c08e3a1-1ce4-4e3f-b96c-21341033a18f tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:58.439547 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-6c08e3a1-1ce4-4e3f-b96c-21341033a18f tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:58.442224 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-6c08e3a1-1ce4-4e3f-b96c-21341033a18f tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:58.442834 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-6c08e3a1-1ce4-4e3f-b96c-21341033a18f tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:58.443739 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-6c08e3a1-1ce4-4e3f-b96c-21341033a18f tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:58.558551 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-6c08e3a1-1ce4-4e3f-b96c-21341033a18f tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:58.559256 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-6c08e3a1-1ce4-4e3f-b96c-21341033a18f tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:58.559711 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-6c08e3a1-1ce4-4e3f-b96c-21341033a18f tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:58.560175 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.objects.instance [None req-6c08e3a1-1ce4-4e3f-b96c-21341033a18f tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] Lazy-loading 'fault' on Instance uuid 29b73e88-1e2a-45d8-bdbb-6c5f9399d270 {{(pid=121402) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 01 19:10:58.584040 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-f6f25b99-8a46-4a20-b539-72fbee8a8fa8 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2868ccfdfb164cffa37232c821f205a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04ef687c40bd45c297d22a791bae58cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:10:58.613691 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-f6f25b99-8a46-4a20-b539-72fbee8a8fa8 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] 10.222.0.13 "GET /compute/v2.1/servers/ac19dd18-c22a-46de-91ef-454a0b78872f" status: 200 len: 1311 microversion: 2.1 time: 1.103409 Nov 01 19:10:58.614292 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 2096/4113] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:10:57 2022] GET /compute/v2.1/servers/ac19dd18-c22a-46de-91ef-454a0b78872f => generated 1311 bytes in 1105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:10:58.628602 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-92e00476-41d5-4f43-bf4c-bf6e2d37ff18 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:10:58.637552 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-92e00476-41d5-4f43-bf4c-bf6e2d37ff18 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] [instance: ba6ffc5c-84a4-40f1-bdc7-f87dde2c99df] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:10:58.650219 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-92e00476-41d5-4f43-bf4c-bf6e2d37ff18 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:58.653284 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-92e00476-41d5-4f43-bf4c-bf6e2d37ff18 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:58.657243 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-92e00476-41d5-4f43-bf4c-bf6e2d37ff18 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:58.659340 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-92e00476-41d5-4f43-bf4c-bf6e2d37ff18 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:58.659340 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-92e00476-41d5-4f43-bf4c-bf6e2d37ff18 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:58.659600 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-92e00476-41d5-4f43-bf4c-bf6e2d37ff18 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:58.797360 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-6c08e3a1-1ce4-4e3f-b96c-21341033a18f tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3111dabbf6d14e2c91766f2f5544057c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c30003431656408bb328e90be22d009a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:10:58.810911 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-6c08e3a1-1ce4-4e3f-b96c-21341033a18f tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3111dabbf6d14e2c91766f2f5544057c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c30003431656408bb328e90be22d009a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:10:58.812649 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-6c08e3a1-1ce4-4e3f-b96c-21341033a18f tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3111dabbf6d14e2c91766f2f5544057c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c30003431656408bb328e90be22d009a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:10:58.813885 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-6c08e3a1-1ce4-4e3f-b96c-21341033a18f tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] 10.222.0.13 "GET /compute/v2.1/servers/29b73e88-1e2a-45d8-bdbb-6c5f9399d270" status: 200 len: 1368 microversion: 2.57 time: 0.454071 Nov 01 19:10:58.821709 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 2018/4114] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 19:10:58 2022] GET /compute/v2.1/servers/29b73e88-1e2a-45d8-bdbb-6c5f9399d270 => generated 1368 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 19:10:58.955827 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-92e00476-41d5-4f43-bf4c-bf6e2d37ff18 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd2105b0264b48d084d0e79cabff8bc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf4adda91364dab94830347c06e3957', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:10:58.971479 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-92e00476-41d5-4f43-bf4c-bf6e2d37ff18 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd2105b0264b48d084d0e79cabff8bc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf4adda91364dab94830347c06e3957', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:10:58.972882 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-92e00476-41d5-4f43-bf4c-bf6e2d37ff18 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd2105b0264b48d084d0e79cabff8bc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf4adda91364dab94830347c06e3957', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:10:58.974091 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-92e00476-41d5-4f43-bf4c-bf6e2d37ff18 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] 10.222.0.13 "GET /compute/v2.1/servers/ba6ffc5c-84a4-40f1-bdc7-f87dde2c99df" status: 200 len: 1605 microversion: 2.32 time: 0.358641 Nov 01 19:10:59.001070 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 2097/4115] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 19:10:58 2022] GET /compute/v2.1/servers/ba6ffc5c-84a4-40f1-bdc7-f87dde2c99df => generated 1605 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 19:10:59.269536 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [req-da1d043e-9bda-4efc-ad94-2d317fc07bdd req-077ebf9f-1b21-4bb8-b2e5-e6b2a650be14 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9ddd96fd-cb96-4808-9172-2785776d2d1d", "name": "network-vif-plugged", "status": "completed", "tag": "c29dc4b3-164b-4843-99d6-674e8b6ff2cc"}]} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:10:59.289092 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-da1d043e-9bda-4efc-ad94-2d317fc07bdd req-077ebf9f-1b21-4bb8-b2e5-e6b2a650be14 service nova] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:59.289513 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-da1d043e-9bda-4efc-ad94-2d317fc07bdd req-077ebf9f-1b21-4bb8-b2e5-e6b2a650be14 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:59.289949 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-da1d043e-9bda-4efc-ad94-2d317fc07bdd req-077ebf9f-1b21-4bb8-b2e5-e6b2a650be14 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:59.323636 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.compute.server_external_events [req-da1d043e-9bda-4efc-ad94-2d317fc07bdd req-077ebf9f-1b21-4bb8-b2e5-e6b2a650be14 service nova] Creating event network-vif-plugged:c29dc4b3-164b-4843-99d6-674e8b6ff2cc for instance 9ddd96fd-cb96-4808-9172-2785776d2d1d on n-h2-863052-2 Nov 01 19:10:59.350820 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [req-da1d043e-9bda-4efc-ad94-2d317fc07bdd req-077ebf9f-1b21-4bb8-b2e5-e6b2a650be14 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085418 Nov 01 19:10:59.351429 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 2019/4116] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Nov 1 19:10:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:10:59.379862 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-ded755bb-faa5-40d5-9227-dffd81fb849c tempest-InstanceActionsNegativeTestJSON-1175023068 tempest-InstanceActionsNegativeTestJSON-1175023068-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:10:59.380478 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-ded755bb-faa5-40d5-9227-dffd81fb849c tempest-InstanceActionsNegativeTestJSON-1175023068 tempest-InstanceActionsNegativeTestJSON-1175023068-project] [instance: 9ddd96fd-cb96-4808-9172-2785776d2d1d] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:10:59.395229 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-ded755bb-faa5-40d5-9227-dffd81fb849c tempest-InstanceActionsNegativeTestJSON-1175023068 tempest-InstanceActionsNegativeTestJSON-1175023068-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:59.395773 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-ded755bb-faa5-40d5-9227-dffd81fb849c tempest-InstanceActionsNegativeTestJSON-1175023068 tempest-InstanceActionsNegativeTestJSON-1175023068-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:59.396266 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-ded755bb-faa5-40d5-9227-dffd81fb849c tempest-InstanceActionsNegativeTestJSON-1175023068 tempest-InstanceActionsNegativeTestJSON-1175023068-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:59.397189 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-ded755bb-faa5-40d5-9227-dffd81fb849c tempest-InstanceActionsNegativeTestJSON-1175023068 tempest-InstanceActionsNegativeTestJSON-1175023068-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:59.400308 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-ded755bb-faa5-40d5-9227-dffd81fb849c tempest-InstanceActionsNegativeTestJSON-1175023068 tempest-InstanceActionsNegativeTestJSON-1175023068-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:59.401030 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-ded755bb-faa5-40d5-9227-dffd81fb849c tempest-InstanceActionsNegativeTestJSON-1175023068 tempest-InstanceActionsNegativeTestJSON-1175023068-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:59.449905 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-ea7fe450-3a7b-4b78-b29d-ccdee0d966a8 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:10:59.450492 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-ea7fe450-3a7b-4b78-b29d-ccdee0d966a8 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] [instance: eced579f-beea-4d3c-b2b8-8a6b31f7829b] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:10:59.462811 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-ea7fe450-3a7b-4b78-b29d-ccdee0d966a8 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:59.463311 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-ea7fe450-3a7b-4b78-b29d-ccdee0d966a8 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:59.463830 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-ea7fe450-3a7b-4b78-b29d-ccdee0d966a8 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:59.464440 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-ea7fe450-3a7b-4b78-b29d-ccdee0d966a8 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:59.465081 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-ea7fe450-3a7b-4b78-b29d-ccdee0d966a8 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:59.477869 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-ea7fe450-3a7b-4b78-b29d-ccdee0d966a8 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:59.659064 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.objects.instance [None req-ea7fe450-3a7b-4b78-b29d-ccdee0d966a8 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lazy-loading 'services' on Instance uuid eced579f-beea-4d3c-b2b8-8a6b31f7829b {{(pid=121402) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 01 19:10:59.767535 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-ea7fe450-3a7b-4b78-b29d-ccdee0d966a8 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] 10.222.0.13 "DELETE /compute/v2.1/servers/eced579f-beea-4d3c-b2b8-8a6b31f7829b/os-volume_attachments/236dcd2b-6c8e-47c8-a80e-bb2ec1641692" status: 202 len: 0 microversion: 2.1 time: 0.322935 Nov 01 19:10:59.768635 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 2020/4117] 10.222.0.13 () {58 vars in 1416 bytes} [Tue Nov 1 19:10:59 2022] DELETE /compute/v2.1/servers/eced579f-beea-4d3c-b2b8-8a6b31f7829b/os-volume_attachments/236dcd2b-6c8e-47c8-a80e-bb2ec1641692 => generated 0 bytes in 325 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 01 19:10:59.774779 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-a2b0a1b5-e8e5-4fad-a9e6-9c136c6399b0 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:10:59.775765 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-a2b0a1b5-e8e5-4fad-a9e6-9c136c6399b0 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] [instance: ac19dd18-c22a-46de-91ef-454a0b78872f] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:10:59.784182 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-a2b0a1b5-e8e5-4fad-a9e6-9c136c6399b0 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:59.784710 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-a2b0a1b5-e8e5-4fad-a9e6-9c136c6399b0 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:59.785155 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-a2b0a1b5-e8e5-4fad-a9e6-9c136c6399b0 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:59.785933 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-a2b0a1b5-e8e5-4fad-a9e6-9c136c6399b0 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:59.786313 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-a2b0a1b5-e8e5-4fad-a9e6-9c136c6399b0 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:59.786768 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-a2b0a1b5-e8e5-4fad-a9e6-9c136c6399b0 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:59.801999 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.wsgi [None req-a2b0a1b5-e8e5-4fad-a9e6-9c136c6399b0 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] HTTP exception thrown: Instance ac19dd18-c22a-46de-91ef-454a0b78872f could not be found. Nov 01 19:10:59.803777 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-a2b0a1b5-e8e5-4fad-a9e6-9c136c6399b0 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Request method failure captured: Nov 01 19:10:59.803777 n-d-863052-2 devstack@n-api.service[121402]: request: GET /compute/v2.1/servers/ac19dd18-c22a-46de-91ef-454a0b78872f HTTP/1.1 Nov 01 19:10:59.803777 n-d-863052-2 devstack@n-api.service[121402]: Accept: application/json Nov 01 19:10:59.803777 n-d-863052-2 devstack@n-api.service[121402]: Accept-Encoding: identity Nov 01 19:10:59.803777 n-d-863052-2 devstack@n-api.service[121402]: Connection: close Nov 01 19:10:59.803777 n-d-863052-2 devstack@n-api.service[121402]: Content-Length: 0 Nov 01 19:10:59.803777 n-d-863052-2 devstack@n-api.service[121402]: Content-Type: application/json Nov 01 19:10:59.803777 n-d-863052-2 devstack@n-api.service[121402]: Host: 10.222.0.13 Nov 01 19:10:59.803777 n-d-863052-2 devstack@n-api.service[121402]: Openstack-System-Scope: None Nov 01 19:10:59.803777 n-d-863052-2 devstack@n-api.service[121402]: User-Agent: python-urllib3/1.26.12 Nov 01 19:10:59.803777 n-d-863052-2 devstack@n-api.service[121402]: X-Auth-Token: gAAAAABjYW7xdoGEkUr9VmlNUPSTaUXnEM4cFVhCEosnqUFQu-SPdYOizV9_JPssqg1hkQ657RtQWwfdpbqukmZrySteKliSppoCmIGu9rFi0MbFndFq8Bb6qjRB6a9xe1deRV9xVTrc68Ro9pz9WovJ9U7N4N_g2t8EuiUPT8oRYr79Ppgt7Bc Nov 01 19:10:59.803777 n-d-863052-2 devstack@n-api.service[121402]: X-Domain-Id: None Nov 01 19:10:59.803777 n-d-863052-2 devstack@n-api.service[121402]: X-Domain-Name: None Nov 01 19:10:59.803777 n-d-863052-2 devstack@n-api.service[121402]: X-Identity-Status: Confirmed Nov 01 19:10:59.803777 n-d-863052-2 devstack@n-api.service[121402]: X-Is-Admin-Project: True Nov 01 19:10:59.803777 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Domain-Id: default Nov 01 19:10:59.803777 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Domain-Name: Default Nov 01 19:10:59.803777 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Id: 04ef687c40bd45c297d22a791bae58cf Nov 01 19:10:59.803777 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Name: tempest-ListServerFiltersTestJSON-1807374630 Nov 01 19:10:59.803777 n-d-863052-2 devstack@n-api.service[121402]: X-Role: member,reader Nov 01 19:10:59.803777 n-d-863052-2 devstack@n-api.service[121402]: X-Roles: member,reader Nov 01 19:10:59.803777 n-d-863052-2 devstack@n-api.service[121402]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/04ef687c40bd45c297d22a791bae58cf"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/04ef687c40bd45c297d22a791bae58cf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_04ef687c40bd45c297d22a791bae58cf", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/04ef687c40bd45c297d22a791bae58cf"}]}] Nov 01 19:10:59.803777 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant: tempest-ListServerFiltersTestJSON-1807374630 Nov 01 19:10:59.803777 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant-Id: 04ef687c40bd45c297d22a791bae58cf Nov 01 19:10:59.803777 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-1807374630 Nov 01 19:10:59.803777 n-d-863052-2 devstack@n-api.service[121402]: X-User: tempest-ListServerFiltersTestJSON-1807374630-project Nov 01 19:10:59.803777 n-d-863052-2 devstack@n-api.service[121402]: X-User-Domain-Id: default Nov 01 19:10:59.803777 n-d-863052-2 devstack@n-api.service[121402]: X-User-Domain-Name: Default Nov 01 19:10:59.803777 n-d-863052-2 devstack@n-api.service[121402]: X-User-Id: 2868ccfdfb164cffa37232c821f205a8 Nov 01 19:10:59.803777 n-d-863052-2 devstack@n-api.service[121402]: X-User-Name: tempest-ListServerFiltersTestJSON-1807374630-project Nov 01 19:10:59.803777 n-d-863052-2 devstack@n-api.service[121402]: method: > Nov 01 19:10:59.803777 n-d-863052-2 devstack@n-api.service[121402]: exception: Instance ac19dd18-c22a-46de-91ef-454a0b78872f could not be found. Nov 01 19:10:59.803777 n-d-863052-2 devstack@n-api.service[121402]: action_args: {'id': 'ac19dd18-c22a-46de-91ef-454a0b78872f'} Nov 01 19:10:59.803777 n-d-863052-2 devstack@n-api.service[121402]: {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 01 19:10:59.803777 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:10:59.803777 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 01 19:10:59.803777 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 01 19:10:59.803777 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 01 19:10:59.803777 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 01 19:10:59.803777 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 01 19:10:59.803777 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 01 19:10:59.803777 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 01 19:10:59.803777 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 01 19:10:59.803777 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ac19dd18-c22a-46de-91ef-454a0b78872f could not be found. Nov 01 19:10:59.803777 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:10:59.803777 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:10:59.803777 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:10:59.803777 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:10:59.803777 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:10:59.803777 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:10:59.803777 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 01 19:10:59.803777 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 01 19:10:59.803777 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 01 19:10:59.803777 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 01 19:10:59.803777 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 01 19:10:59.803777 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 01 19:10:59.803777 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 01 19:10:59.803777 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 01 19:10:59.803777 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 01 19:10:59.803777 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 01 19:10:59.803777 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ac19dd18-c22a-46de-91ef-454a0b78872f could not be found. Nov 01 19:10:59.803777 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:10:59.803777 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:10:59.803777 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:10:59.809578 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:10:59.809578 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:10:59.809578 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:10:59.809578 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 01 19:10:59.809578 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 01 19:10:59.809578 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ac19dd18-c22a-46de-91ef-454a0b78872f could not be found. Nov 01 19:10:59.809578 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:10:59.809578 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-a2b0a1b5-e8e5-4fad-a9e6-9c136c6399b0 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] Returning 404 to user: Instance ac19dd18-c22a-46de-91ef-454a0b78872f could not be found. {{(pid=121402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 01 19:10:59.809578 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-a2b0a1b5-e8e5-4fad-a9e6-9c136c6399b0 tempest-ListServerFiltersTestJSON-1807374630 tempest-ListServerFiltersTestJSON-1807374630-project] 10.222.0.13 "GET /compute/v2.1/servers/ac19dd18-c22a-46de-91ef-454a0b78872f" status: 404 len: 111 microversion: 2.1 time: 0.035198 Nov 01 19:10:59.809578 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 2021/4118] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:10:59 2022] GET /compute/v2.1/servers/ac19dd18-c22a-46de-91ef-454a0b78872f => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 01 19:10:59.810873 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-ded755bb-faa5-40d5-9227-dffd81fb849c tempest-InstanceActionsNegativeTestJSON-1175023068 tempest-InstanceActionsNegativeTestJSON-1175023068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90eeeb07a21345f5801a340078809488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba92568b226b4ea793c9f40cf9b97839', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:10:59.814385 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-430d366b-559f-49ce-8e0f-54c8ef9ff77f tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:10:59.814914 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-430d366b-559f-49ce-8e0f-54c8ef9ff77f tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] [instance: af1071a8-a090-44c9-890c-123ca3ff39f1] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:10:59.822750 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-430d366b-559f-49ce-8e0f-54c8ef9ff77f tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:59.823582 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-430d366b-559f-49ce-8e0f-54c8ef9ff77f tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:59.824290 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-430d366b-559f-49ce-8e0f-54c8ef9ff77f tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:59.825330 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-430d366b-559f-49ce-8e0f-54c8ef9ff77f tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:59.825900 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-ded755bb-faa5-40d5-9227-dffd81fb849c tempest-InstanceActionsNegativeTestJSON-1175023068 tempest-InstanceActionsNegativeTestJSON-1175023068-project] 10.222.0.13 "GET /compute/v2.1/servers/9ddd96fd-cb96-4808-9172-2785776d2d1d" status: 200 len: 1325 microversion: 2.1 time: 0.446760 Nov 01 19:10:59.826313 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-430d366b-559f-49ce-8e0f-54c8ef9ff77f tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:59.826946 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-430d366b-559f-49ce-8e0f-54c8ef9ff77f tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:59.829044 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 2098/4119] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:10:59 2022] GET /compute/v2.1/servers/9ddd96fd-cb96-4808-9172-2785776d2d1d => generated 1325 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:10:59.838740 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-193a4043-3bd3-4651-a502-33b2d85679ef tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:10:59.844131 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-193a4043-3bd3-4651-a502-33b2d85679ef tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] [instance: eced579f-beea-4d3c-b2b8-8a6b31f7829b] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:10:59.854012 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.wsgi [None req-430d366b-559f-49ce-8e0f-54c8ef9ff77f tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] HTTP exception thrown: Instance af1071a8-a090-44c9-890c-123ca3ff39f1 could not be found. Nov 01 19:10:59.856081 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-193a4043-3bd3-4651-a502-33b2d85679ef tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:59.856966 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-193a4043-3bd3-4651-a502-33b2d85679ef tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:59.858069 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-430d366b-559f-49ce-8e0f-54c8ef9ff77f tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Request method failure captured: Nov 01 19:10:59.858069 n-d-863052-2 devstack@n-api.service[121402]: request: DELETE /compute/v2.1/servers/af1071a8-a090-44c9-890c-123ca3ff39f1 HTTP/1.1 Nov 01 19:10:59.858069 n-d-863052-2 devstack@n-api.service[121402]: Accept: application/json Nov 01 19:10:59.858069 n-d-863052-2 devstack@n-api.service[121402]: Accept-Encoding: identity Nov 01 19:10:59.858069 n-d-863052-2 devstack@n-api.service[121402]: Connection: close Nov 01 19:10:59.858069 n-d-863052-2 devstack@n-api.service[121402]: Content-Length: 0 Nov 01 19:10:59.858069 n-d-863052-2 devstack@n-api.service[121402]: Content-Type: application/json Nov 01 19:10:59.858069 n-d-863052-2 devstack@n-api.service[121402]: Host: 10.222.0.13 Nov 01 19:10:59.858069 n-d-863052-2 devstack@n-api.service[121402]: Openstack-System-Scope: None Nov 01 19:10:59.858069 n-d-863052-2 devstack@n-api.service[121402]: User-Agent: python-urllib3/1.26.12 Nov 01 19:10:59.858069 n-d-863052-2 devstack@n-api.service[121402]: X-Auth-Token: gAAAAABjYW2PwHA9xR9CaUTqr_Ug5905JFbP1_GbjHpmmKHn0_18JNln6AAWrDcY2I89rHXJe439LRz3BcZqnfBX_uoevdkGBNyixK7hCIoXvIZ0dYvt-AbKqusGVDbhL0A8x0ANz91Cm66Wf7f7AXwO5W7hyZ86g45XCCuVTW27iHRMwJ66FEc Nov 01 19:10:59.858069 n-d-863052-2 devstack@n-api.service[121402]: X-Domain-Id: None Nov 01 19:10:59.858069 n-d-863052-2 devstack@n-api.service[121402]: X-Domain-Name: None Nov 01 19:10:59.858069 n-d-863052-2 devstack@n-api.service[121402]: X-Identity-Status: Confirmed Nov 01 19:10:59.858069 n-d-863052-2 devstack@n-api.service[121402]: X-Is-Admin-Project: True Nov 01 19:10:59.858069 n-d-863052-2 devstack@n-api.service[121402]: X-Openstack-Nova-Api-Version: 2.42 Nov 01 19:10:59.858069 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Domain-Id: default Nov 01 19:10:59.858069 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Domain-Name: Default Nov 01 19:10:59.858069 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Id: 8807757227574c828dca1947af76659d Nov 01 19:10:59.858069 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-531364476 Nov 01 19:10:59.858069 n-d-863052-2 devstack@n-api.service[121402]: X-Role: member,reader Nov 01 19:10:59.858069 n-d-863052-2 devstack@n-api.service[121402]: X-Roles: member,reader Nov 01 19:10:59.858069 n-d-863052-2 devstack@n-api.service[121402]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/8807757227574c828dca1947af76659d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/8807757227574c828dca1947af76659d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_8807757227574c828dca1947af76659d", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/8807757227574c828dca1947af76659d"}]}] Nov 01 19:10:59.858069 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant: tempest-TaggedBootDevicesTest_v242-531364476 Nov 01 19:10:59.858069 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant-Id: 8807757227574c828dca1947af76659d Nov 01 19:10:59.858069 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-531364476 Nov 01 19:10:59.858069 n-d-863052-2 devstack@n-api.service[121402]: X-User: tempest-TaggedBootDevicesTest_v242-531364476-project Nov 01 19:10:59.858069 n-d-863052-2 devstack@n-api.service[121402]: X-User-Domain-Id: default Nov 01 19:10:59.858069 n-d-863052-2 devstack@n-api.service[121402]: X-User-Domain-Name: Default Nov 01 19:10:59.858069 n-d-863052-2 devstack@n-api.service[121402]: X-User-Id: 301ed3b9c37449bc9ade378f3c73a768 Nov 01 19:10:59.858069 n-d-863052-2 devstack@n-api.service[121402]: X-User-Name: tempest-TaggedBootDevicesTest_v242-531364476-project Nov 01 19:10:59.858069 n-d-863052-2 devstack@n-api.service[121402]: method: > Nov 01 19:10:59.858069 n-d-863052-2 devstack@n-api.service[121402]: exception: Instance af1071a8-a090-44c9-890c-123ca3ff39f1 could not be found. Nov 01 19:10:59.858069 n-d-863052-2 devstack@n-api.service[121402]: action_args: {'id': 'af1071a8-a090-44c9-890c-123ca3ff39f1'} Nov 01 19:10:59.858069 n-d-863052-2 devstack@n-api.service[121402]: {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 01 19:10:59.858069 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:10:59.858069 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 01 19:10:59.858069 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 01 19:10:59.858069 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 01 19:10:59.858069 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 01 19:10:59.858069 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 01 19:10:59.858069 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 01 19:10:59.858069 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 01 19:10:59.858069 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 01 19:10:59.858069 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance af1071a8-a090-44c9-890c-123ca3ff39f1 could not be found. Nov 01 19:10:59.858069 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:10:59.858069 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:10:59.858069 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:10:59.858069 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:10:59.858069 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:10:59.858069 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:10:59.858069 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 01 19:10:59.858069 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 01 19:10:59.858069 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 01 19:10:59.858069 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 01 19:10:59.858069 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 01 19:10:59.858069 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 01 19:10:59.858069 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 01 19:10:59.858069 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 01 19:10:59.858069 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 01 19:10:59.858069 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 01 19:10:59.858069 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 01 19:10:59.858069 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 01 19:10:59.865605 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance af1071a8-a090-44c9-890c-123ca3ff39f1 could not be found. Nov 01 19:10:59.865605 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:10:59.865605 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:10:59.865605 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:10:59.865605 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:10:59.865605 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:10:59.865605 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:10:59.865605 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 01 19:10:59.865605 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 01 19:10:59.865605 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance af1071a8-a090-44c9-890c-123ca3ff39f1 could not be found. Nov 01 19:10:59.865605 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:10:59.865605 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-430d366b-559f-49ce-8e0f-54c8ef9ff77f tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Returning 404 to user: Instance af1071a8-a090-44c9-890c-123ca3ff39f1 could not be found. {{(pid=121402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 01 19:10:59.865605 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-430d366b-559f-49ce-8e0f-54c8ef9ff77f tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] 10.222.0.13 "DELETE /compute/v2.1/servers/af1071a8-a090-44c9-890c-123ca3ff39f1" status: 404 len: 111 microversion: 2.42 time: 0.050408 Nov 01 19:10:59.867239 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 2022/4120] 10.222.0.13 () {60 vars in 1280 bytes} [Tue Nov 1 19:10:59 2022] DELETE /compute/v2.1/servers/af1071a8-a090-44c9-890c-123ca3ff39f1 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 01 19:10:59.869701 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-193a4043-3bd3-4651-a502-33b2d85679ef tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:59.870670 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-193a4043-3bd3-4651-a502-33b2d85679ef tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:59.871257 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-193a4043-3bd3-4651-a502-33b2d85679ef tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:59.872745 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-193a4043-3bd3-4651-a502-33b2d85679ef tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:59.874581 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-b5e1da91-dd1c-4b96-9069-ca8703d79d55 tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:10:59.879657 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-b5e1da91-dd1c-4b96-9069-ca8703d79d55 tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] [instance: 29b73e88-1e2a-45d8-bdbb-6c5f9399d270] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:10:59.888076 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b5e1da91-dd1c-4b96-9069-ca8703d79d55 tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:59.888605 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b5e1da91-dd1c-4b96-9069-ca8703d79d55 tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:59.889533 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b5e1da91-dd1c-4b96-9069-ca8703d79d55 tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:59.890465 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b5e1da91-dd1c-4b96-9069-ca8703d79d55 tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:59.891115 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b5e1da91-dd1c-4b96-9069-ca8703d79d55 tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:59.891740 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b5e1da91-dd1c-4b96-9069-ca8703d79d55 tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:59.911578 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.wsgi [None req-b5e1da91-dd1c-4b96-9069-ca8703d79d55 tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] HTTP exception thrown: Instance 29b73e88-1e2a-45d8-bdbb-6c5f9399d270 could not be found. Nov 01 19:10:59.913449 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-b5e1da91-dd1c-4b96-9069-ca8703d79d55 tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] Request method failure captured: Nov 01 19:10:59.913449 n-d-863052-2 devstack@n-api.service[121402]: request: GET /compute/v2.1/servers/29b73e88-1e2a-45d8-bdbb-6c5f9399d270 HTTP/1.1 Nov 01 19:10:59.913449 n-d-863052-2 devstack@n-api.service[121402]: Accept: application/json Nov 01 19:10:59.913449 n-d-863052-2 devstack@n-api.service[121402]: Accept-Encoding: identity Nov 01 19:10:59.913449 n-d-863052-2 devstack@n-api.service[121402]: Connection: close Nov 01 19:10:59.913449 n-d-863052-2 devstack@n-api.service[121402]: Content-Length: 0 Nov 01 19:10:59.913449 n-d-863052-2 devstack@n-api.service[121402]: Content-Type: application/json Nov 01 19:10:59.913449 n-d-863052-2 devstack@n-api.service[121402]: Host: 10.222.0.13 Nov 01 19:10:59.913449 n-d-863052-2 devstack@n-api.service[121402]: Openstack-System-Scope: None Nov 01 19:10:59.913449 n-d-863052-2 devstack@n-api.service[121402]: User-Agent: python-urllib3/1.26.12 Nov 01 19:10:59.913449 n-d-863052-2 devstack@n-api.service[121402]: X-Auth-Token: gAAAAABjYW8YZO9ch2sVYVrhtRTM55FJ1te6wDcgPv2AHSjHEPtxRXDwMkdy1yI5GgP0344ZP5UALC0xKlKCHsdykN4MGEUPmXQiFBiB_5k7XDiGMPJEYEu-MUIH4KWwFJu_bIQBUxafl4iMlRmK9mf_Ylu6krW7gWaNkpoinSfuyhXlA_-PzOU Nov 01 19:10:59.913449 n-d-863052-2 devstack@n-api.service[121402]: X-Domain-Id: None Nov 01 19:10:59.913449 n-d-863052-2 devstack@n-api.service[121402]: X-Domain-Name: None Nov 01 19:10:59.913449 n-d-863052-2 devstack@n-api.service[121402]: X-Identity-Status: Confirmed Nov 01 19:10:59.913449 n-d-863052-2 devstack@n-api.service[121402]: X-Is-Admin-Project: True Nov 01 19:10:59.913449 n-d-863052-2 devstack@n-api.service[121402]: X-Openstack-Nova-Api-Version: 2.57 Nov 01 19:10:59.913449 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Domain-Id: default Nov 01 19:10:59.913449 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Domain-Name: Default Nov 01 19:10:59.913449 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Id: c30003431656408bb328e90be22d009a Nov 01 19:10:59.913449 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Name: tempest-ServerShowV257Test-432962993 Nov 01 19:10:59.913449 n-d-863052-2 devstack@n-api.service[121402]: X-Role: member,reader Nov 01 19:10:59.913449 n-d-863052-2 devstack@n-api.service[121402]: X-Roles: member,reader Nov 01 19:10:59.913449 n-d-863052-2 devstack@n-api.service[121402]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/c30003431656408bb328e90be22d009a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/c30003431656408bb328e90be22d009a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_c30003431656408bb328e90be22d009a", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/c30003431656408bb328e90be22d009a"}]}] Nov 01 19:10:59.913449 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant: tempest-ServerShowV257Test-432962993 Nov 01 19:10:59.913449 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant-Id: c30003431656408bb328e90be22d009a Nov 01 19:10:59.913449 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant-Name: tempest-ServerShowV257Test-432962993 Nov 01 19:10:59.913449 n-d-863052-2 devstack@n-api.service[121402]: X-User: tempest-ServerShowV257Test-432962993-project Nov 01 19:10:59.913449 n-d-863052-2 devstack@n-api.service[121402]: X-User-Domain-Id: default Nov 01 19:10:59.913449 n-d-863052-2 devstack@n-api.service[121402]: X-User-Domain-Name: Default Nov 01 19:10:59.913449 n-d-863052-2 devstack@n-api.service[121402]: X-User-Id: 3111dabbf6d14e2c91766f2f5544057c Nov 01 19:10:59.913449 n-d-863052-2 devstack@n-api.service[121402]: X-User-Name: tempest-ServerShowV257Test-432962993-project Nov 01 19:10:59.913449 n-d-863052-2 devstack@n-api.service[121402]: method: > Nov 01 19:10:59.913449 n-d-863052-2 devstack@n-api.service[121402]: exception: Instance 29b73e88-1e2a-45d8-bdbb-6c5f9399d270 could not be found. Nov 01 19:10:59.913449 n-d-863052-2 devstack@n-api.service[121402]: action_args: {'id': '29b73e88-1e2a-45d8-bdbb-6c5f9399d270'} Nov 01 19:10:59.913449 n-d-863052-2 devstack@n-api.service[121402]: {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 01 19:10:59.913449 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:10:59.913449 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 01 19:10:59.913449 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 01 19:10:59.913449 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 01 19:10:59.913449 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 01 19:10:59.913449 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 01 19:10:59.913449 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 01 19:10:59.913449 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 01 19:10:59.913449 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 01 19:10:59.913449 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 29b73e88-1e2a-45d8-bdbb-6c5f9399d270 could not be found. Nov 01 19:10:59.913449 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:10:59.913449 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:10:59.913449 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:10:59.913449 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:10:59.913449 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:10:59.913449 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:10:59.913449 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 01 19:10:59.913449 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 01 19:10:59.913449 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 01 19:10:59.913449 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 01 19:10:59.913449 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 01 19:10:59.913449 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 01 19:10:59.913449 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 01 19:10:59.913449 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 01 19:10:59.913449 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 01 19:10:59.913449 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 01 19:10:59.913449 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 29b73e88-1e2a-45d8-bdbb-6c5f9399d270 could not be found. Nov 01 19:10:59.913449 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:10:59.913449 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:10:59.913449 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:10:59.919712 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:10:59.919712 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:10:59.919712 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:10:59.919712 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 01 19:10:59.919712 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 01 19:10:59.919712 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 29b73e88-1e2a-45d8-bdbb-6c5f9399d270 could not be found. Nov 01 19:10:59.919712 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:10:59.934565 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-b5e1da91-dd1c-4b96-9069-ca8703d79d55 tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] Returning 404 to user: Instance 29b73e88-1e2a-45d8-bdbb-6c5f9399d270 could not be found. {{(pid=121402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 01 19:10:59.939661 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-b5e1da91-dd1c-4b96-9069-ca8703d79d55 tempest-ServerShowV257Test-432962993 tempest-ServerShowV257Test-432962993-project] 10.222.0.13 "GET /compute/v2.1/servers/29b73e88-1e2a-45d8-bdbb-6c5f9399d270" status: 404 len: 111 microversion: 2.57 time: 0.068702 Nov 01 19:10:59.946021 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 2023/4121] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 19:10:59 2022] GET /compute/v2.1/servers/29b73e88-1e2a-45d8-bdbb-6c5f9399d270 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 01 19:10:59.960422 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-c66a3ee9-47ea-4c53-8106-c174c6fc7636 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:10:59.961496 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-193a4043-3bd3-4651-a502-33b2d85679ef tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] 10.222.0.13 "GET /compute/v2.1/servers/eced579f-beea-4d3c-b2b8-8a6b31f7829b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.128994 Nov 01 19:10:59.962635 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 2099/4122] 10.222.0.13 () {58 vars in 1302 bytes} [Tue Nov 1 19:10:59 2022] GET /compute/v2.1/servers/eced579f-beea-4d3c-b2b8-8a6b31f7829b/os-volume_attachments => generated 197 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:10:59.968976 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-c66a3ee9-47ea-4c53-8106-c174c6fc7636 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] [instance: af1071a8-a090-44c9-890c-123ca3ff39f1] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:10:59.981990 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-c66a3ee9-47ea-4c53-8106-c174c6fc7636 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:59.982384 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-c66a3ee9-47ea-4c53-8106-c174c6fc7636 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:59.982859 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-c66a3ee9-47ea-4c53-8106-c174c6fc7636 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:10:59.983602 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-c66a3ee9-47ea-4c53-8106-c174c6fc7636 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:10:59.984112 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-c66a3ee9-47ea-4c53-8106-c174c6fc7636 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:10:59.987041 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-c66a3ee9-47ea-4c53-8106-c174c6fc7636 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:11:00.009836 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-3a1bd51c-63ca-4eec-856f-e600d5443a51 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:11:00.010765 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-3a1bd51c-63ca-4eec-856f-e600d5443a51 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] [instance: ba6ffc5c-84a4-40f1-bdc7-f87dde2c99df] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:11:00.016735 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.wsgi [None req-c66a3ee9-47ea-4c53-8106-c174c6fc7636 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] HTTP exception thrown: Instance af1071a8-a090-44c9-890c-123ca3ff39f1 could not be found. Nov 01 19:11:00.020119 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-3a1bd51c-63ca-4eec-856f-e600d5443a51 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:11:00.020402 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-c66a3ee9-47ea-4c53-8106-c174c6fc7636 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Request method failure captured: Nov 01 19:11:00.020402 n-d-863052-2 devstack@n-api.service[121402]: request: GET /compute/v2.1/servers/af1071a8-a090-44c9-890c-123ca3ff39f1 HTTP/1.1 Nov 01 19:11:00.020402 n-d-863052-2 devstack@n-api.service[121402]: Accept: application/json Nov 01 19:11:00.020402 n-d-863052-2 devstack@n-api.service[121402]: Accept-Encoding: identity Nov 01 19:11:00.020402 n-d-863052-2 devstack@n-api.service[121402]: Connection: close Nov 01 19:11:00.020402 n-d-863052-2 devstack@n-api.service[121402]: Content-Length: 0 Nov 01 19:11:00.020402 n-d-863052-2 devstack@n-api.service[121402]: Content-Type: application/json Nov 01 19:11:00.020402 n-d-863052-2 devstack@n-api.service[121402]: Host: 10.222.0.13 Nov 01 19:11:00.020402 n-d-863052-2 devstack@n-api.service[121402]: Openstack-System-Scope: None Nov 01 19:11:00.020402 n-d-863052-2 devstack@n-api.service[121402]: User-Agent: python-urllib3/1.26.12 Nov 01 19:11:00.020402 n-d-863052-2 devstack@n-api.service[121402]: X-Auth-Token: gAAAAABjYW2PwHA9xR9CaUTqr_Ug5905JFbP1_GbjHpmmKHn0_18JNln6AAWrDcY2I89rHXJe439LRz3BcZqnfBX_uoevdkGBNyixK7hCIoXvIZ0dYvt-AbKqusGVDbhL0A8x0ANz91Cm66Wf7f7AXwO5W7hyZ86g45XCCuVTW27iHRMwJ66FEc Nov 01 19:11:00.020402 n-d-863052-2 devstack@n-api.service[121402]: X-Domain-Id: None Nov 01 19:11:00.020402 n-d-863052-2 devstack@n-api.service[121402]: X-Domain-Name: None Nov 01 19:11:00.020402 n-d-863052-2 devstack@n-api.service[121402]: X-Identity-Status: Confirmed Nov 01 19:11:00.020402 n-d-863052-2 devstack@n-api.service[121402]: X-Is-Admin-Project: True Nov 01 19:11:00.020402 n-d-863052-2 devstack@n-api.service[121402]: X-Openstack-Nova-Api-Version: 2.42 Nov 01 19:11:00.020402 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Domain-Id: default Nov 01 19:11:00.020402 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Domain-Name: Default Nov 01 19:11:00.020402 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Id: 8807757227574c828dca1947af76659d Nov 01 19:11:00.020402 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-531364476 Nov 01 19:11:00.020402 n-d-863052-2 devstack@n-api.service[121402]: X-Role: member,reader Nov 01 19:11:00.020402 n-d-863052-2 devstack@n-api.service[121402]: X-Roles: member,reader Nov 01 19:11:00.020402 n-d-863052-2 devstack@n-api.service[121402]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/8807757227574c828dca1947af76659d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/8807757227574c828dca1947af76659d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_8807757227574c828dca1947af76659d", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/8807757227574c828dca1947af76659d"}]}] Nov 01 19:11:00.020402 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant: tempest-TaggedBootDevicesTest_v242-531364476 Nov 01 19:11:00.020402 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant-Id: 8807757227574c828dca1947af76659d Nov 01 19:11:00.020402 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-531364476 Nov 01 19:11:00.020402 n-d-863052-2 devstack@n-api.service[121402]: X-User: tempest-TaggedBootDevicesTest_v242-531364476-project Nov 01 19:11:00.020402 n-d-863052-2 devstack@n-api.service[121402]: X-User-Domain-Id: default Nov 01 19:11:00.020402 n-d-863052-2 devstack@n-api.service[121402]: X-User-Domain-Name: Default Nov 01 19:11:00.020402 n-d-863052-2 devstack@n-api.service[121402]: X-User-Id: 301ed3b9c37449bc9ade378f3c73a768 Nov 01 19:11:00.020402 n-d-863052-2 devstack@n-api.service[121402]: X-User-Name: tempest-TaggedBootDevicesTest_v242-531364476-project Nov 01 19:11:00.020402 n-d-863052-2 devstack@n-api.service[121402]: method: > Nov 01 19:11:00.020402 n-d-863052-2 devstack@n-api.service[121402]: exception: Instance af1071a8-a090-44c9-890c-123ca3ff39f1 could not be found. Nov 01 19:11:00.020402 n-d-863052-2 devstack@n-api.service[121402]: action_args: {'id': 'af1071a8-a090-44c9-890c-123ca3ff39f1'} Nov 01 19:11:00.020402 n-d-863052-2 devstack@n-api.service[121402]: {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 01 19:11:00.020402 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:11:00.020402 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 01 19:11:00.020402 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 01 19:11:00.020402 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 01 19:11:00.020402 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 01 19:11:00.020402 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 01 19:11:00.020402 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 01 19:11:00.020402 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 01 19:11:00.020402 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 01 19:11:00.020402 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance af1071a8-a090-44c9-890c-123ca3ff39f1 could not be found. Nov 01 19:11:00.020402 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:11:00.020402 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:11:00.020402 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:11:00.020402 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:11:00.020402 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:11:00.020402 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:11:00.020402 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 01 19:11:00.020402 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 01 19:11:00.020402 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 01 19:11:00.020402 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 01 19:11:00.020402 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 01 19:11:00.020402 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 01 19:11:00.020402 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 01 19:11:00.020402 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 01 19:11:00.020402 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 01 19:11:00.020402 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 01 19:11:00.020402 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance af1071a8-a090-44c9-890c-123ca3ff39f1 could not be found. Nov 01 19:11:00.020402 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:11:00.020402 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:11:00.025127 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:11:00.025127 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:11:00.025127 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:11:00.025127 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:11:00.025127 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 01 19:11:00.025127 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 01 19:11:00.025127 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance af1071a8-a090-44c9-890c-123ca3ff39f1 could not be found. Nov 01 19:11:00.025127 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:11:00.025127 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-c66a3ee9-47ea-4c53-8106-c174c6fc7636 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] Returning 404 to user: Instance af1071a8-a090-44c9-890c-123ca3ff39f1 could not be found. {{(pid=121402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 01 19:11:00.025127 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-c66a3ee9-47ea-4c53-8106-c174c6fc7636 tempest-TaggedBootDevicesTest_v242-531364476 tempest-TaggedBootDevicesTest_v242-531364476-project] 10.222.0.13 "GET /compute/v2.1/servers/af1071a8-a090-44c9-890c-123ca3ff39f1" status: 404 len: 111 microversion: 2.42 time: 0.068616 Nov 01 19:11:00.025843 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-3a1bd51c-63ca-4eec-856f-e600d5443a51 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:11:00.025843 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-3a1bd51c-63ca-4eec-856f-e600d5443a51 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:11:00.025843 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-3a1bd51c-63ca-4eec-856f-e600d5443a51 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:11:00.025843 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-3a1bd51c-63ca-4eec-856f-e600d5443a51 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:11:00.026886 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 2024/4123] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 19:10:59 2022] GET /compute/v2.1/servers/af1071a8-a090-44c9-890c-123ca3ff39f1 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 01 19:11:00.029484 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-3a1bd51c-63ca-4eec-856f-e600d5443a51 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:11:00.348432 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-3a1bd51c-63ca-4eec-856f-e600d5443a51 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd2105b0264b48d084d0e79cabff8bc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf4adda91364dab94830347c06e3957', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:11:00.365697 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-3a1bd51c-63ca-4eec-856f-e600d5443a51 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd2105b0264b48d084d0e79cabff8bc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf4adda91364dab94830347c06e3957', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:11:00.371632 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-3a1bd51c-63ca-4eec-856f-e600d5443a51 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd2105b0264b48d084d0e79cabff8bc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf4adda91364dab94830347c06e3957', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:11:00.374047 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-3a1bd51c-63ca-4eec-856f-e600d5443a51 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] 10.222.0.13 "GET /compute/v2.1/servers/ba6ffc5c-84a4-40f1-bdc7-f87dde2c99df" status: 200 len: 1605 microversion: 2.32 time: 0.369153 Nov 01 19:11:00.374636 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 2100/4124] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 19:11:00 2022] GET /compute/v2.1/servers/ba6ffc5c-84a4-40f1-bdc7-f87dde2c99df => generated 1605 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 19:11:00.850761 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-7b8880c3-2f82-482e-a565-9059674c2031 tempest-InstanceActionsNegativeTestJSON-1175023068 tempest-InstanceActionsNegativeTestJSON-1175023068-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:11:00.851382 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-7b8880c3-2f82-482e-a565-9059674c2031 tempest-InstanceActionsNegativeTestJSON-1175023068 tempest-InstanceActionsNegativeTestJSON-1175023068-project] [instance: 9ddd96fd-cb96-4808-9172-2785776d2d1d] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:11:00.866252 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-7b8880c3-2f82-482e-a565-9059674c2031 tempest-InstanceActionsNegativeTestJSON-1175023068 tempest-InstanceActionsNegativeTestJSON-1175023068-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:11:00.877614 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-7b8880c3-2f82-482e-a565-9059674c2031 tempest-InstanceActionsNegativeTestJSON-1175023068 tempest-InstanceActionsNegativeTestJSON-1175023068-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:11:00.878384 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-7b8880c3-2f82-482e-a565-9059674c2031 tempest-InstanceActionsNegativeTestJSON-1175023068 tempest-InstanceActionsNegativeTestJSON-1175023068-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:11:00.879335 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-7b8880c3-2f82-482e-a565-9059674c2031 tempest-InstanceActionsNegativeTestJSON-1175023068 tempest-InstanceActionsNegativeTestJSON-1175023068-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:11:00.879977 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-7b8880c3-2f82-482e-a565-9059674c2031 tempest-InstanceActionsNegativeTestJSON-1175023068 tempest-InstanceActionsNegativeTestJSON-1175023068-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:11:00.880639 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-7b8880c3-2f82-482e-a565-9059674c2031 tempest-InstanceActionsNegativeTestJSON-1175023068 tempest-InstanceActionsNegativeTestJSON-1175023068-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:11:00.974829 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-8d5a031e-8f93-44af-970a-2922cce61d77 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:11:00.978042 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-8d5a031e-8f93-44af-970a-2922cce61d77 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] [instance: eced579f-beea-4d3c-b2b8-8a6b31f7829b] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:11:01.001218 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-8d5a031e-8f93-44af-970a-2922cce61d77 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:11:01.002261 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-8d5a031e-8f93-44af-970a-2922cce61d77 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:11:01.002705 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-8d5a031e-8f93-44af-970a-2922cce61d77 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:11:01.003400 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-8d5a031e-8f93-44af-970a-2922cce61d77 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:11:01.003849 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-8d5a031e-8f93-44af-970a-2922cce61d77 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:11:01.004272 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-8d5a031e-8f93-44af-970a-2922cce61d77 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:11:01.072755 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-8d5a031e-8f93-44af-970a-2922cce61d77 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] 10.222.0.13 "GET /compute/v2.1/servers/eced579f-beea-4d3c-b2b8-8a6b31f7829b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.102287 Nov 01 19:11:01.077367 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 2101/4125] 10.222.0.13 () {58 vars in 1302 bytes} [Tue Nov 1 19:11:00 2022] GET /compute/v2.1/servers/eced579f-beea-4d3c-b2b8-8a6b31f7829b/os-volume_attachments => generated 197 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 01 19:11:01.402730 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-0bdba23e-ba4b-4223-bc98-f4c693da14e2 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:11:01.403456 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-0bdba23e-ba4b-4223-bc98-f4c693da14e2 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] [instance: ba6ffc5c-84a4-40f1-bdc7-f87dde2c99df] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:11:01.410731 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-0bdba23e-ba4b-4223-bc98-f4c693da14e2 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:11:01.417390 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-0bdba23e-ba4b-4223-bc98-f4c693da14e2 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:11:01.417940 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-0bdba23e-ba4b-4223-bc98-f4c693da14e2 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:11:01.418698 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-0bdba23e-ba4b-4223-bc98-f4c693da14e2 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:11:01.419234 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-0bdba23e-ba4b-4223-bc98-f4c693da14e2 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:11:01.419637 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-0bdba23e-ba4b-4223-bc98-f4c693da14e2 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:11:01.658393 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-0bdba23e-ba4b-4223-bc98-f4c693da14e2 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd2105b0264b48d084d0e79cabff8bc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf4adda91364dab94830347c06e3957', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:11:01.672317 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-0bdba23e-ba4b-4223-bc98-f4c693da14e2 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd2105b0264b48d084d0e79cabff8bc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf4adda91364dab94830347c06e3957', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:11:01.676255 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-0bdba23e-ba4b-4223-bc98-f4c693da14e2 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd2105b0264b48d084d0e79cabff8bc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf4adda91364dab94830347c06e3957', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:11:01.680396 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-0bdba23e-ba4b-4223-bc98-f4c693da14e2 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] 10.222.0.13 "GET /compute/v2.1/servers/ba6ffc5c-84a4-40f1-bdc7-f87dde2c99df" status: 200 len: 1605 microversion: 2.32 time: 0.280030 Nov 01 19:11:01.682937 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 2102/4126] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 19:11:01 2022] GET /compute/v2.1/servers/ba6ffc5c-84a4-40f1-bdc7-f87dde2c99df => generated 1605 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 19:11:01.701147 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-05411525-f9b2-4c81-bcc7-83fed2abf324 tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:11:01.702245 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-05411525-f9b2-4c81-bcc7-83fed2abf324 tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] [instance: 7ee07462-fab6-49a3-b7fd-cbe545cc6f55] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:11:01.711001 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-05411525-f9b2-4c81-bcc7-83fed2abf324 tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:11:01.712245 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-05411525-f9b2-4c81-bcc7-83fed2abf324 tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:11:01.713972 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-05411525-f9b2-4c81-bcc7-83fed2abf324 tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:11:01.714757 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-05411525-f9b2-4c81-bcc7-83fed2abf324 tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:11:01.717652 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-05411525-f9b2-4c81-bcc7-83fed2abf324 tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:11:01.718189 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-05411525-f9b2-4c81-bcc7-83fed2abf324 tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:11:01.779972 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-05411525-f9b2-4c81-bcc7-83fed2abf324 tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] [instance: 7ee07462-fab6-49a3-b7fd-cbe545cc6f55] Going to try to terminate instance {{(pid=121403) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 01 19:11:01.921820 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-05411525-f9b2-4c81-bcc7-83fed2abf324 tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] 10.222.0.13 "DELETE /compute/v2.1/servers/7ee07462-fab6-49a3-b7fd-cbe545cc6f55" status: 204 len: 0 microversion: 2.1 time: 0.237279 Nov 01 19:11:01.928434 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 2103/4127] 10.222.0.13 () {58 vars in 1239 bytes} [Tue Nov 1 19:11:01 2022] DELETE /compute/v2.1/servers/7ee07462-fab6-49a3-b7fd-cbe545cc6f55 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 01 19:11:01.943238 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-ab163d2c-b29f-4aca-acf2-eaec7962deb0 tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:11:01.945559 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-ab163d2c-b29f-4aca-acf2-eaec7962deb0 tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] [instance: 7ee07462-fab6-49a3-b7fd-cbe545cc6f55] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:11:01.960293 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-ab163d2c-b29f-4aca-acf2-eaec7962deb0 tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:11:01.961855 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-ab163d2c-b29f-4aca-acf2-eaec7962deb0 tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:11:01.962336 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-ab163d2c-b29f-4aca-acf2-eaec7962deb0 tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:11:01.965553 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-ab163d2c-b29f-4aca-acf2-eaec7962deb0 tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:11:01.966285 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-ab163d2c-b29f-4aca-acf2-eaec7962deb0 tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:11:01.967995 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-ab163d2c-b29f-4aca-acf2-eaec7962deb0 tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:11:02.029474 n-d-863052-2 devstack@n-api.service[121403]: DEBUG dbcounter [-] [121403] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 19:11:02.163764 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-7b8880c3-2f82-482e-a565-9059674c2031 tempest-InstanceActionsNegativeTestJSON-1175023068 tempest-InstanceActionsNegativeTestJSON-1175023068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90eeeb07a21345f5801a340078809488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba92568b226b4ea793c9f40cf9b97839', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:11:02.173467 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-7b8880c3-2f82-482e-a565-9059674c2031 tempest-InstanceActionsNegativeTestJSON-1175023068 tempest-InstanceActionsNegativeTestJSON-1175023068-project] 10.222.0.13 "GET /compute/v2.1/servers/9ddd96fd-cb96-4808-9172-2785776d2d1d" status: 200 len: 1523 microversion: 2.1 time: 1.326540 Nov 01 19:11:02.174045 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 2025/4128] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:11:00 2022] GET /compute/v2.1/servers/9ddd96fd-cb96-4808-9172-2785776d2d1d => generated 1523 bytes in 1328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:11:02.188495 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-1762f710-8bc0-4bad-b6da-c422f4d19629 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:11:02.195344 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-1762f710-8bc0-4bad-b6da-c422f4d19629 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] [instance: eced579f-beea-4d3c-b2b8-8a6b31f7829b] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:11:02.208883 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-1762f710-8bc0-4bad-b6da-c422f4d19629 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:11:02.209400 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-1762f710-8bc0-4bad-b6da-c422f4d19629 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:11:02.212713 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-1762f710-8bc0-4bad-b6da-c422f4d19629 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:11:02.215872 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-1762f710-8bc0-4bad-b6da-c422f4d19629 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:11:02.217537 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-1762f710-8bc0-4bad-b6da-c422f4d19629 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:11:02.218985 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-1762f710-8bc0-4bad-b6da-c422f4d19629 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:11:02.306692 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-1762f710-8bc0-4bad-b6da-c422f4d19629 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] 10.222.0.13 "GET /compute/v2.1/servers/eced579f-beea-4d3c-b2b8-8a6b31f7829b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.115999 Nov 01 19:11:02.312465 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 2026/4129] 10.222.0.13 () {58 vars in 1302 bytes} [Tue Nov 1 19:11:02 2022] GET /compute/v2.1/servers/eced579f-beea-4d3c-b2b8-8a6b31f7829b/os-volume_attachments => generated 197 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:11:02.326411 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-902ced53-8ea2-4b0d-9d1d-540be6763a17 tempest-InstanceActionsNegativeTestJSON-1175023068 tempest-InstanceActionsNegativeTestJSON-1175023068-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:11:02.327151 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-902ced53-8ea2-4b0d-9d1d-540be6763a17 tempest-InstanceActionsNegativeTestJSON-1175023068 tempest-InstanceActionsNegativeTestJSON-1175023068-project] [instance: 9ddd96fd-cb96-4808-9172-2785776d2d1d] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:11:02.338293 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-902ced53-8ea2-4b0d-9d1d-540be6763a17 tempest-InstanceActionsNegativeTestJSON-1175023068 tempest-InstanceActionsNegativeTestJSON-1175023068-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:11:02.342167 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-902ced53-8ea2-4b0d-9d1d-540be6763a17 tempest-InstanceActionsNegativeTestJSON-1175023068 tempest-InstanceActionsNegativeTestJSON-1175023068-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:11:02.342498 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-902ced53-8ea2-4b0d-9d1d-540be6763a17 tempest-InstanceActionsNegativeTestJSON-1175023068 tempest-InstanceActionsNegativeTestJSON-1175023068-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:11:02.343310 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-902ced53-8ea2-4b0d-9d1d-540be6763a17 tempest-InstanceActionsNegativeTestJSON-1175023068 tempest-InstanceActionsNegativeTestJSON-1175023068-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:11:02.344269 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-902ced53-8ea2-4b0d-9d1d-540be6763a17 tempest-InstanceActionsNegativeTestJSON-1175023068 tempest-InstanceActionsNegativeTestJSON-1175023068-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:11:02.344736 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-902ced53-8ea2-4b0d-9d1d-540be6763a17 tempest-InstanceActionsNegativeTestJSON-1175023068 tempest-InstanceActionsNegativeTestJSON-1175023068-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:11:02.419733 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.wsgi [None req-902ced53-8ea2-4b0d-9d1d-540be6763a17 tempest-InstanceActionsNegativeTestJSON-1175023068 tempest-InstanceActionsNegativeTestJSON-1175023068-project] HTTP exception thrown: Action 999 not found Nov 01 19:11:02.425477 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-902ced53-8ea2-4b0d-9d1d-540be6763a17 tempest-InstanceActionsNegativeTestJSON-1175023068 tempest-InstanceActionsNegativeTestJSON-1175023068-project] Request method failure captured: Nov 01 19:11:02.425477 n-d-863052-2 devstack@n-api.service[121402]: request: GET /compute/v2.1/servers/9ddd96fd-cb96-4808-9172-2785776d2d1d/os-instance-actions/999 HTTP/1.1 Nov 01 19:11:02.425477 n-d-863052-2 devstack@n-api.service[121402]: Accept: application/json Nov 01 19:11:02.425477 n-d-863052-2 devstack@n-api.service[121402]: Accept-Encoding: identity Nov 01 19:11:02.425477 n-d-863052-2 devstack@n-api.service[121402]: Connection: close Nov 01 19:11:02.425477 n-d-863052-2 devstack@n-api.service[121402]: Content-Length: 0 Nov 01 19:11:02.425477 n-d-863052-2 devstack@n-api.service[121402]: Content-Type: application/json Nov 01 19:11:02.425477 n-d-863052-2 devstack@n-api.service[121402]: Host: 10.222.0.13 Nov 01 19:11:02.425477 n-d-863052-2 devstack@n-api.service[121402]: Openstack-System-Scope: None Nov 01 19:11:02.425477 n-d-863052-2 devstack@n-api.service[121402]: User-Agent: python-urllib3/1.26.12 Nov 01 19:11:02.425477 n-d-863052-2 devstack@n-api.service[121402]: X-Auth-Token: gAAAAABjYW8xE51U-zJLRQkwUKvxwf--KUrtw2HnjSCirj4RvVWTTZ0AdU0uaDyGZtSnkMqfwi_x12wp_0FYVTradpkaAWjVf7c56pUwpCq3SiKLvPi8xSrAJFZt_dMZJEmXUbMctFh0_kTLKhLVxJyzcVv_CflUBDdZO83reWDaey2UKrBAxK4 Nov 01 19:11:02.425477 n-d-863052-2 devstack@n-api.service[121402]: X-Domain-Id: None Nov 01 19:11:02.425477 n-d-863052-2 devstack@n-api.service[121402]: X-Domain-Name: None Nov 01 19:11:02.425477 n-d-863052-2 devstack@n-api.service[121402]: X-Identity-Status: Confirmed Nov 01 19:11:02.425477 n-d-863052-2 devstack@n-api.service[121402]: X-Is-Admin-Project: True Nov 01 19:11:02.425477 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Domain-Id: default Nov 01 19:11:02.425477 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Domain-Name: Default Nov 01 19:11:02.425477 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Id: ba92568b226b4ea793c9f40cf9b97839 Nov 01 19:11:02.425477 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-1175023068 Nov 01 19:11:02.425477 n-d-863052-2 devstack@n-api.service[121402]: X-Role: member,reader Nov 01 19:11:02.425477 n-d-863052-2 devstack@n-api.service[121402]: X-Roles: member,reader Nov 01 19:11:02.425477 n-d-863052-2 devstack@n-api.service[121402]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/ba92568b226b4ea793c9f40cf9b97839"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/ba92568b226b4ea793c9f40cf9b97839"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_ba92568b226b4ea793c9f40cf9b97839", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/ba92568b226b4ea793c9f40cf9b97839"}]}] Nov 01 19:11:02.425477 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-1175023068 Nov 01 19:11:02.425477 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant-Id: ba92568b226b4ea793c9f40cf9b97839 Nov 01 19:11:02.425477 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-1175023068 Nov 01 19:11:02.425477 n-d-863052-2 devstack@n-api.service[121402]: X-User: tempest-InstanceActionsNegativeTestJSON-1175023068-project Nov 01 19:11:02.425477 n-d-863052-2 devstack@n-api.service[121402]: X-User-Domain-Id: default Nov 01 19:11:02.425477 n-d-863052-2 devstack@n-api.service[121402]: X-User-Domain-Name: Default Nov 01 19:11:02.425477 n-d-863052-2 devstack@n-api.service[121402]: X-User-Id: 90eeeb07a21345f5801a340078809488 Nov 01 19:11:02.425477 n-d-863052-2 devstack@n-api.service[121402]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-1175023068-project Nov 01 19:11:02.425477 n-d-863052-2 devstack@n-api.service[121402]: method: > Nov 01 19:11:02.425477 n-d-863052-2 devstack@n-api.service[121402]: exception: Action 999 not found Nov 01 19:11:02.425477 n-d-863052-2 devstack@n-api.service[121402]: action_args: {'server_id': '9ddd96fd-cb96-4808-9172-2785776d2d1d', 'id': '999'} Nov 01 19:11:02.425477 n-d-863052-2 devstack@n-api.service[121402]: {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 01 19:11:02.425477 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:11:02.425477 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:11:02.425477 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:11:02.425477 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 01 19:11:02.425477 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 01 19:11:02.425477 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 01 19:11:02.425477 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 01 19:11:02.425477 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 152, in show Nov 01 19:11:02.425477 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Nov 01 19:11:02.425477 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Action 999 not found Nov 01 19:11:02.425477 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:11:02.425477 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:11:02.425477 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:11:02.425477 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:11:02.425477 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:11:02.425477 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:11:02.425477 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 01 19:11:02.425477 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 01 19:11:02.425477 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Action 999 not found Nov 01 19:11:02.425477 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:11:02.429398 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-902ced53-8ea2-4b0d-9d1d-540be6763a17 tempest-InstanceActionsNegativeTestJSON-1175023068 tempest-InstanceActionsNegativeTestJSON-1175023068-project] Returning 404 to user: Action 999 not found {{(pid=121402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 01 19:11:02.429398 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-902ced53-8ea2-4b0d-9d1d-540be6763a17 tempest-InstanceActionsNegativeTestJSON-1175023068 tempest-InstanceActionsNegativeTestJSON-1175023068-project] 10.222.0.13 "GET /compute/v2.1/servers/9ddd96fd-cb96-4808-9172-2785776d2d1d/os-instance-actions/999" status: 404 len: 66 microversion: 2.1 time: 0.113486 Nov 01 19:11:02.429398 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 2027/4130] 10.222.0.13 () {58 vars in 1308 bytes} [Tue Nov 1 19:11:02 2022] GET /compute/v2.1/servers/9ddd96fd-cb96-4808-9172-2785776d2d1d/os-instance-actions/999 => generated 66 bytes in 115 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 01 19:11:02.442091 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-119871ce-3c16-4295-bd29-9825388d7936 tempest-InstanceActionsNegativeTestJSON-1175023068 tempest-InstanceActionsNegativeTestJSON-1175023068-project] Calling method '.version_select at 0x7f0ae1dddca0>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:11:02.443833 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-119871ce-3c16-4295-bd29-9825388d7936 tempest-InstanceActionsNegativeTestJSON-1175023068 tempest-InstanceActionsNegativeTestJSON-1175023068-project] [instance: 0e3399a2-1605-4316-9d56-ef24bcc45079] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:11:02.450603 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.wsgi [None req-119871ce-3c16-4295-bd29-9825388d7936 tempest-InstanceActionsNegativeTestJSON-1175023068 tempest-InstanceActionsNegativeTestJSON-1175023068-project] HTTP exception thrown: Instance 0e3399a2-1605-4316-9d56-ef24bcc45079 could not be found. Nov 01 19:11:02.453168 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-119871ce-3c16-4295-bd29-9825388d7936 tempest-InstanceActionsNegativeTestJSON-1175023068 tempest-InstanceActionsNegativeTestJSON-1175023068-project] Request method failure captured: Nov 01 19:11:02.453168 n-d-863052-2 devstack@n-api.service[121402]: request: GET /compute/v2.1/servers/0e3399a2-1605-4316-9d56-ef24bcc45079/os-instance-actions HTTP/1.1 Nov 01 19:11:02.453168 n-d-863052-2 devstack@n-api.service[121402]: Accept: application/json Nov 01 19:11:02.453168 n-d-863052-2 devstack@n-api.service[121402]: Accept-Encoding: identity Nov 01 19:11:02.453168 n-d-863052-2 devstack@n-api.service[121402]: Connection: close Nov 01 19:11:02.453168 n-d-863052-2 devstack@n-api.service[121402]: Content-Length: 0 Nov 01 19:11:02.453168 n-d-863052-2 devstack@n-api.service[121402]: Content-Type: application/json Nov 01 19:11:02.453168 n-d-863052-2 devstack@n-api.service[121402]: Host: 10.222.0.13 Nov 01 19:11:02.453168 n-d-863052-2 devstack@n-api.service[121402]: Openstack-System-Scope: None Nov 01 19:11:02.453168 n-d-863052-2 devstack@n-api.service[121402]: User-Agent: python-urllib3/1.26.12 Nov 01 19:11:02.453168 n-d-863052-2 devstack@n-api.service[121402]: X-Auth-Token: gAAAAABjYW8xE51U-zJLRQkwUKvxwf--KUrtw2HnjSCirj4RvVWTTZ0AdU0uaDyGZtSnkMqfwi_x12wp_0FYVTradpkaAWjVf7c56pUwpCq3SiKLvPi8xSrAJFZt_dMZJEmXUbMctFh0_kTLKhLVxJyzcVv_CflUBDdZO83reWDaey2UKrBAxK4 Nov 01 19:11:02.453168 n-d-863052-2 devstack@n-api.service[121402]: X-Domain-Id: None Nov 01 19:11:02.453168 n-d-863052-2 devstack@n-api.service[121402]: X-Domain-Name: None Nov 01 19:11:02.453168 n-d-863052-2 devstack@n-api.service[121402]: X-Identity-Status: Confirmed Nov 01 19:11:02.453168 n-d-863052-2 devstack@n-api.service[121402]: X-Is-Admin-Project: True Nov 01 19:11:02.453168 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Domain-Id: default Nov 01 19:11:02.453168 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Domain-Name: Default Nov 01 19:11:02.453168 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Id: ba92568b226b4ea793c9f40cf9b97839 Nov 01 19:11:02.453168 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-1175023068 Nov 01 19:11:02.453168 n-d-863052-2 devstack@n-api.service[121402]: X-Role: member,reader Nov 01 19:11:02.453168 n-d-863052-2 devstack@n-api.service[121402]: X-Roles: member,reader Nov 01 19:11:02.453168 n-d-863052-2 devstack@n-api.service[121402]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/ba92568b226b4ea793c9f40cf9b97839"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/ba92568b226b4ea793c9f40cf9b97839"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_ba92568b226b4ea793c9f40cf9b97839", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/ba92568b226b4ea793c9f40cf9b97839"}]}] Nov 01 19:11:02.453168 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-1175023068 Nov 01 19:11:02.453168 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant-Id: ba92568b226b4ea793c9f40cf9b97839 Nov 01 19:11:02.453168 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-1175023068 Nov 01 19:11:02.453168 n-d-863052-2 devstack@n-api.service[121402]: X-User: tempest-InstanceActionsNegativeTestJSON-1175023068-project Nov 01 19:11:02.453168 n-d-863052-2 devstack@n-api.service[121402]: X-User-Domain-Id: default Nov 01 19:11:02.453168 n-d-863052-2 devstack@n-api.service[121402]: X-User-Domain-Name: Default Nov 01 19:11:02.453168 n-d-863052-2 devstack@n-api.service[121402]: X-User-Id: 90eeeb07a21345f5801a340078809488 Nov 01 19:11:02.453168 n-d-863052-2 devstack@n-api.service[121402]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-1175023068-project Nov 01 19:11:02.453168 n-d-863052-2 devstack@n-api.service[121402]: method: Nov 01 19:11:02.453168 n-d-863052-2 devstack@n-api.service[121402]: exception: Instance 0e3399a2-1605-4316-9d56-ef24bcc45079 could not be found. Nov 01 19:11:02.453168 n-d-863052-2 devstack@n-api.service[121402]: action_args: {'server_id': '0e3399a2-1605-4316-9d56-ef24bcc45079'} Nov 01 19:11:02.453168 n-d-863052-2 devstack@n-api.service[121402]: {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 01 19:11:02.453168 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:11:02.453168 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 01 19:11:02.453168 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 01 19:11:02.453168 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 01 19:11:02.453168 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 01 19:11:02.453168 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Nov 01 19:11:02.453168 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Nov 01 19:11:02.453168 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0e3399a2-1605-4316-9d56-ef24bcc45079 could not be found. Nov 01 19:11:02.453168 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:11:02.453168 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:11:02.453168 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:11:02.453168 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:11:02.453168 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:11:02.453168 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:11:02.453168 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 01 19:11:02.453168 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 01 19:11:02.453168 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 01 19:11:02.453168 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 01 19:11:02.453168 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 01 19:11:02.453168 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 01 19:11:02.453168 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 89, in index Nov 01 19:11:02.453168 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = self._get_instance(req, context, server_id) Nov 01 19:11:02.453168 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 01 19:11:02.453168 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 01 19:11:02.453168 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 77, in _get_instance Nov 01 19:11:02.453168 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return common.get_instance(self.compute_api, context, server_id) Nov 01 19:11:02.453168 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 01 19:11:02.453168 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 01 19:11:02.458105 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0e3399a2-1605-4316-9d56-ef24bcc45079 could not be found. Nov 01 19:11:02.458105 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:11:02.458105 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:11:02.458105 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:11:02.458105 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:11:02.458105 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:11:02.458105 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:11:02.458105 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 01 19:11:02.458105 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 01 19:11:02.458105 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0e3399a2-1605-4316-9d56-ef24bcc45079 could not be found. Nov 01 19:11:02.458105 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:11:02.460386 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-119871ce-3c16-4295-bd29-9825388d7936 tempest-InstanceActionsNegativeTestJSON-1175023068 tempest-InstanceActionsNegativeTestJSON-1175023068-project] Returning 404 to user: Instance 0e3399a2-1605-4316-9d56-ef24bcc45079 could not be found. {{(pid=121402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 01 19:11:02.461604 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-119871ce-3c16-4295-bd29-9825388d7936 tempest-InstanceActionsNegativeTestJSON-1175023068 tempest-InstanceActionsNegativeTestJSON-1175023068-project] 10.222.0.13 "GET /compute/v2.1/servers/0e3399a2-1605-4316-9d56-ef24bcc45079/os-instance-actions" status: 404 len: 111 microversion: 2.1 time: 0.027898 Nov 01 19:11:02.463250 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 2028/4131] 10.222.0.13 () {58 vars in 1296 bytes} [Tue Nov 1 19:11:02 2022] GET /compute/v2.1/servers/0e3399a2-1605-4316-9d56-ef24bcc45079/os-instance-actions => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 01 19:11:02.475046 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-ac863942-a33d-45c2-9096-91bbd3b2dc0e tempest-InstanceActionsNegativeTestJSON-1175023068 tempest-InstanceActionsNegativeTestJSON-1175023068-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:11:02.476008 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-ac863942-a33d-45c2-9096-91bbd3b2dc0e tempest-InstanceActionsNegativeTestJSON-1175023068 tempest-InstanceActionsNegativeTestJSON-1175023068-project] [instance: 9ddd96fd-cb96-4808-9172-2785776d2d1d] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:11:02.496980 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-ab163d2c-b29f-4aca-acf2-eaec7962deb0 tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c72e7e000a9a4fa49474bd5d19accf77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d8835c7b6754bfd81447b1f8893e56c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:11:02.505147 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-ac863942-a33d-45c2-9096-91bbd3b2dc0e tempest-InstanceActionsNegativeTestJSON-1175023068 tempest-InstanceActionsNegativeTestJSON-1175023068-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:11:02.506443 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-ac863942-a33d-45c2-9096-91bbd3b2dc0e tempest-InstanceActionsNegativeTestJSON-1175023068 tempest-InstanceActionsNegativeTestJSON-1175023068-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:11:02.507504 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-ac863942-a33d-45c2-9096-91bbd3b2dc0e tempest-InstanceActionsNegativeTestJSON-1175023068 tempest-InstanceActionsNegativeTestJSON-1175023068-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:11:02.511067 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-ac863942-a33d-45c2-9096-91bbd3b2dc0e tempest-InstanceActionsNegativeTestJSON-1175023068 tempest-InstanceActionsNegativeTestJSON-1175023068-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:11:02.511755 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-ac863942-a33d-45c2-9096-91bbd3b2dc0e tempest-InstanceActionsNegativeTestJSON-1175023068 tempest-InstanceActionsNegativeTestJSON-1175023068-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:11:02.512430 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-ac863942-a33d-45c2-9096-91bbd3b2dc0e tempest-InstanceActionsNegativeTestJSON-1175023068 tempest-InstanceActionsNegativeTestJSON-1175023068-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:11:02.513797 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-ab163d2c-b29f-4aca-acf2-eaec7962deb0 tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] 10.222.0.13 "GET /compute/v2.1/servers/7ee07462-fab6-49a3-b7fd-cbe545cc6f55" status: 200 len: 1513 microversion: 2.1 time: 0.582894 Nov 01 19:11:02.518400 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 2104/4132] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:11:01 2022] GET /compute/v2.1/servers/7ee07462-fab6-49a3-b7fd-cbe545cc6f55 => generated 1513 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:11:02.609755 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-ac863942-a33d-45c2-9096-91bbd3b2dc0e tempest-InstanceActionsNegativeTestJSON-1175023068 tempest-InstanceActionsNegativeTestJSON-1175023068-project] [instance: 9ddd96fd-cb96-4808-9172-2785776d2d1d] Going to try to terminate instance {{(pid=121402) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 01 19:11:02.711098 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-f293fe62-507d-4cd5-8cfa-65f1e3450383 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:11:02.712219 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-f293fe62-507d-4cd5-8cfa-65f1e3450383 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] [instance: ba6ffc5c-84a4-40f1-bdc7-f87dde2c99df] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:11:02.721773 n-d-863052-2 devstack@n-api.service[121402]: DEBUG dbcounter [-] [121402] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=121402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 19:11:02.733177 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f293fe62-507d-4cd5-8cfa-65f1e3450383 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:11:02.738258 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f293fe62-507d-4cd5-8cfa-65f1e3450383 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:11:02.738755 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f293fe62-507d-4cd5-8cfa-65f1e3450383 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:11:02.745383 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f293fe62-507d-4cd5-8cfa-65f1e3450383 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:11:02.749219 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f293fe62-507d-4cd5-8cfa-65f1e3450383 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:11:02.749953 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f293fe62-507d-4cd5-8cfa-65f1e3450383 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:11:02.849578 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-ac863942-a33d-45c2-9096-91bbd3b2dc0e tempest-InstanceActionsNegativeTestJSON-1175023068 tempest-InstanceActionsNegativeTestJSON-1175023068-project] 10.222.0.13 "DELETE /compute/v2.1/servers/9ddd96fd-cb96-4808-9172-2785776d2d1d" status: 204 len: 0 microversion: 2.1 time: 0.380884 Nov 01 19:11:02.850756 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 2029/4133] 10.222.0.13 () {58 vars in 1239 bytes} [Tue Nov 1 19:11:02 2022] DELETE /compute/v2.1/servers/9ddd96fd-cb96-4808-9172-2785776d2d1d => generated 0 bytes in 383 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 01 19:11:02.863636 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-b42f2887-21a4-435e-8200-e2f9ae92d32e tempest-InstanceActionsNegativeTestJSON-1175023068 tempest-InstanceActionsNegativeTestJSON-1175023068-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:11:02.864405 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-b42f2887-21a4-435e-8200-e2f9ae92d32e tempest-InstanceActionsNegativeTestJSON-1175023068 tempest-InstanceActionsNegativeTestJSON-1175023068-project] [instance: 9ddd96fd-cb96-4808-9172-2785776d2d1d] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:11:02.878303 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b42f2887-21a4-435e-8200-e2f9ae92d32e tempest-InstanceActionsNegativeTestJSON-1175023068 tempest-InstanceActionsNegativeTestJSON-1175023068-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:11:02.879098 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b42f2887-21a4-435e-8200-e2f9ae92d32e tempest-InstanceActionsNegativeTestJSON-1175023068 tempest-InstanceActionsNegativeTestJSON-1175023068-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:11:02.879778 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b42f2887-21a4-435e-8200-e2f9ae92d32e tempest-InstanceActionsNegativeTestJSON-1175023068 tempest-InstanceActionsNegativeTestJSON-1175023068-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:11:02.880752 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b42f2887-21a4-435e-8200-e2f9ae92d32e tempest-InstanceActionsNegativeTestJSON-1175023068 tempest-InstanceActionsNegativeTestJSON-1175023068-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:11:02.881385 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b42f2887-21a4-435e-8200-e2f9ae92d32e tempest-InstanceActionsNegativeTestJSON-1175023068 tempest-InstanceActionsNegativeTestJSON-1175023068-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:11:02.881989 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b42f2887-21a4-435e-8200-e2f9ae92d32e tempest-InstanceActionsNegativeTestJSON-1175023068 tempest-InstanceActionsNegativeTestJSON-1175023068-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:11:02.973191 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-f293fe62-507d-4cd5-8cfa-65f1e3450383 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd2105b0264b48d084d0e79cabff8bc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf4adda91364dab94830347c06e3957', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:11:03.012426 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-f293fe62-507d-4cd5-8cfa-65f1e3450383 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd2105b0264b48d084d0e79cabff8bc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf4adda91364dab94830347c06e3957', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:11:03.017360 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-f293fe62-507d-4cd5-8cfa-65f1e3450383 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd2105b0264b48d084d0e79cabff8bc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf4adda91364dab94830347c06e3957', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:11:03.027064 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-f293fe62-507d-4cd5-8cfa-65f1e3450383 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] 10.222.0.13 "GET /compute/v2.1/servers/ba6ffc5c-84a4-40f1-bdc7-f87dde2c99df" status: 200 len: 1605 microversion: 2.32 time: 0.318964 Nov 01 19:11:03.033426 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 2105/4134] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 19:11:02 2022] GET /compute/v2.1/servers/ba6ffc5c-84a4-40f1-bdc7-f87dde2c99df => generated 1605 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 19:11:03.321170 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-e2feca90-97c1-41e6-bfe8-f1a054278e80 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:11:03.323869 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-e2feca90-97c1-41e6-bfe8-f1a054278e80 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] [instance: eced579f-beea-4d3c-b2b8-8a6b31f7829b] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:11:03.337569 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-e2feca90-97c1-41e6-bfe8-f1a054278e80 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:11:03.338067 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-e2feca90-97c1-41e6-bfe8-f1a054278e80 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:11:03.338508 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-e2feca90-97c1-41e6-bfe8-f1a054278e80 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:11:03.339225 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-e2feca90-97c1-41e6-bfe8-f1a054278e80 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:11:03.339686 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-e2feca90-97c1-41e6-bfe8-f1a054278e80 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:11:03.340111 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-e2feca90-97c1-41e6-bfe8-f1a054278e80 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:11:03.428249 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-e2feca90-97c1-41e6-bfe8-f1a054278e80 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] 10.222.0.13 "GET /compute/v2.1/servers/eced579f-beea-4d3c-b2b8-8a6b31f7829b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.112569 Nov 01 19:11:03.441043 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 2106/4135] 10.222.0.13 () {58 vars in 1302 bytes} [Tue Nov 1 19:11:03 2022] GET /compute/v2.1/servers/eced579f-beea-4d3c-b2b8-8a6b31f7829b/os-volume_attachments => generated 197 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 01 19:11:03.491581 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-b42f2887-21a4-435e-8200-e2f9ae92d32e tempest-InstanceActionsNegativeTestJSON-1175023068 tempest-InstanceActionsNegativeTestJSON-1175023068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90eeeb07a21345f5801a340078809488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba92568b226b4ea793c9f40cf9b97839', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:11:03.510675 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-b42f2887-21a4-435e-8200-e2f9ae92d32e tempest-InstanceActionsNegativeTestJSON-1175023068 tempest-InstanceActionsNegativeTestJSON-1175023068-project] 10.222.0.13 "GET /compute/v2.1/servers/9ddd96fd-cb96-4808-9172-2785776d2d1d" status: 200 len: 1529 microversion: 2.1 time: 0.653342 Nov 01 19:11:03.514183 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 2030/4136] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:11:02 2022] GET /compute/v2.1/servers/9ddd96fd-cb96-4808-9172-2785776d2d1d => generated 1529 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 19:11:03.544047 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-73d7a49a-3cd7-475c-a20f-990518061b8a tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:11:03.545058 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-73d7a49a-3cd7-475c-a20f-990518061b8a tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] [instance: 7ee07462-fab6-49a3-b7fd-cbe545cc6f55] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:11:03.562820 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-73d7a49a-3cd7-475c-a20f-990518061b8a tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:11:03.564350 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-73d7a49a-3cd7-475c-a20f-990518061b8a tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:11:03.565081 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-73d7a49a-3cd7-475c-a20f-990518061b8a tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:11:03.566290 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-73d7a49a-3cd7-475c-a20f-990518061b8a tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:11:03.566999 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-73d7a49a-3cd7-475c-a20f-990518061b8a tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:11:03.569102 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-73d7a49a-3cd7-475c-a20f-990518061b8a tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:11:03.870263 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-73d7a49a-3cd7-475c-a20f-990518061b8a tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c72e7e000a9a4fa49474bd5d19accf77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d8835c7b6754bfd81447b1f8893e56c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:11:03.888338 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-73d7a49a-3cd7-475c-a20f-990518061b8a tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] 10.222.0.13 "GET /compute/v2.1/servers/7ee07462-fab6-49a3-b7fd-cbe545cc6f55" status: 200 len: 1513 microversion: 2.1 time: 0.347996 Nov 01 19:11:03.891150 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 2107/4137] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:11:03 2022] GET /compute/v2.1/servers/7ee07462-fab6-49a3-b7fd-cbe545cc6f55 => generated 1513 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:11:04.060870 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-9b30887c-e773-4495-96e4-165b80a7cd31 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:11:04.061943 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-9b30887c-e773-4495-96e4-165b80a7cd31 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] [instance: ba6ffc5c-84a4-40f1-bdc7-f87dde2c99df] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:11:04.079088 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-9b30887c-e773-4495-96e4-165b80a7cd31 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:11:04.081739 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-9b30887c-e773-4495-96e4-165b80a7cd31 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:11:04.083040 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-9b30887c-e773-4495-96e4-165b80a7cd31 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:11:04.084822 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-9b30887c-e773-4495-96e4-165b80a7cd31 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:11:04.089115 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-9b30887c-e773-4495-96e4-165b80a7cd31 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:11:04.089807 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-9b30887c-e773-4495-96e4-165b80a7cd31 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:11:04.447331 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-3a5428bd-3221-4327-9dd1-636c8ebed433 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:11:04.451535 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-3a5428bd-3221-4327-9dd1-636c8ebed433 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] [instance: eced579f-beea-4d3c-b2b8-8a6b31f7829b] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:11:04.455032 n-d-863052-2 devstack@n-api.service[121403]: DEBUG dbcounter [-] [121403] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=121403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 19:11:04.468209 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-3a5428bd-3221-4327-9dd1-636c8ebed433 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:11:04.472465 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-3a5428bd-3221-4327-9dd1-636c8ebed433 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:11:04.473390 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-3a5428bd-3221-4327-9dd1-636c8ebed433 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:11:04.475547 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-3a5428bd-3221-4327-9dd1-636c8ebed433 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:11:04.476697 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-3a5428bd-3221-4327-9dd1-636c8ebed433 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:11:04.478327 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-3a5428bd-3221-4327-9dd1-636c8ebed433 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:11:04.569484 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-3a5428bd-3221-4327-9dd1-636c8ebed433 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] 10.222.0.13 "GET /compute/v2.1/servers/eced579f-beea-4d3c-b2b8-8a6b31f7829b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.125952 Nov 01 19:11:04.575913 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 2108/4138] 10.222.0.13 () {58 vars in 1302 bytes} [Tue Nov 1 19:11:04 2022] GET /compute/v2.1/servers/eced579f-beea-4d3c-b2b8-8a6b31f7829b/os-volume_attachments => generated 197 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:11:04.585669 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-a42ac43e-999e-4052-b3ca-839f5989fb96 tempest-InstanceActionsNegativeTestJSON-1175023068 tempest-InstanceActionsNegativeTestJSON-1175023068-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:11:04.587147 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-a42ac43e-999e-4052-b3ca-839f5989fb96 tempest-InstanceActionsNegativeTestJSON-1175023068 tempest-InstanceActionsNegativeTestJSON-1175023068-project] [instance: 9ddd96fd-cb96-4808-9172-2785776d2d1d] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:11:04.615902 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-a42ac43e-999e-4052-b3ca-839f5989fb96 tempest-InstanceActionsNegativeTestJSON-1175023068 tempest-InstanceActionsNegativeTestJSON-1175023068-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:11:04.623554 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-a42ac43e-999e-4052-b3ca-839f5989fb96 tempest-InstanceActionsNegativeTestJSON-1175023068 tempest-InstanceActionsNegativeTestJSON-1175023068-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:11:04.625614 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-a42ac43e-999e-4052-b3ca-839f5989fb96 tempest-InstanceActionsNegativeTestJSON-1175023068 tempest-InstanceActionsNegativeTestJSON-1175023068-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:11:04.626720 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-a42ac43e-999e-4052-b3ca-839f5989fb96 tempest-InstanceActionsNegativeTestJSON-1175023068 tempest-InstanceActionsNegativeTestJSON-1175023068-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:11:04.627399 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-a42ac43e-999e-4052-b3ca-839f5989fb96 tempest-InstanceActionsNegativeTestJSON-1175023068 tempest-InstanceActionsNegativeTestJSON-1175023068-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:11:04.628076 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-a42ac43e-999e-4052-b3ca-839f5989fb96 tempest-InstanceActionsNegativeTestJSON-1175023068 tempest-InstanceActionsNegativeTestJSON-1175023068-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:11:04.752256 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-9b30887c-e773-4495-96e4-165b80a7cd31 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd2105b0264b48d084d0e79cabff8bc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf4adda91364dab94830347c06e3957', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:11:04.766498 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-9b30887c-e773-4495-96e4-165b80a7cd31 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd2105b0264b48d084d0e79cabff8bc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf4adda91364dab94830347c06e3957', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:11:04.771214 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-9b30887c-e773-4495-96e4-165b80a7cd31 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd2105b0264b48d084d0e79cabff8bc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf4adda91364dab94830347c06e3957', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:11:04.774693 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-9b30887c-e773-4495-96e4-165b80a7cd31 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] 10.222.0.13 "GET /compute/v2.1/servers/ba6ffc5c-84a4-40f1-bdc7-f87dde2c99df" status: 200 len: 1605 microversion: 2.32 time: 0.720934 Nov 01 19:11:04.775285 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 2031/4139] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 19:11:04 2022] GET /compute/v2.1/servers/ba6ffc5c-84a4-40f1-bdc7-f87dde2c99df => generated 1605 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 19:11:04.918846 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-768f0a10-13e2-4dee-b446-218e5a89cc24 tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:11:04.919828 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-768f0a10-13e2-4dee-b446-218e5a89cc24 tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] [instance: 7ee07462-fab6-49a3-b7fd-cbe545cc6f55] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:11:04.939979 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-768f0a10-13e2-4dee-b446-218e5a89cc24 tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:11:04.945368 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-768f0a10-13e2-4dee-b446-218e5a89cc24 tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:11:04.946280 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-768f0a10-13e2-4dee-b446-218e5a89cc24 tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:11:04.950065 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-768f0a10-13e2-4dee-b446-218e5a89cc24 tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:11:04.951809 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-768f0a10-13e2-4dee-b446-218e5a89cc24 tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:11:04.957089 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-768f0a10-13e2-4dee-b446-218e5a89cc24 tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:11:05.194126 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-768f0a10-13e2-4dee-b446-218e5a89cc24 tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c72e7e000a9a4fa49474bd5d19accf77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d8835c7b6754bfd81447b1f8893e56c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:11:05.215855 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-768f0a10-13e2-4dee-b446-218e5a89cc24 tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] 10.222.0.13 "GET /compute/v2.1/servers/7ee07462-fab6-49a3-b7fd-cbe545cc6f55" status: 200 len: 1471 microversion: 2.1 time: 0.300080 Nov 01 19:11:05.218141 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 2032/4140] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:11:04 2022] GET /compute/v2.1/servers/7ee07462-fab6-49a3-b7fd-cbe545cc6f55 => generated 1471 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 19:11:05.232054 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [req-9c236e91-da1f-4e0b-a37e-be73d9a59cc7 req-555e07a8-328b-4b6f-b927-7f79fd44e235 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ee07462-fab6-49a3-b7fd-cbe545cc6f55", "name": "network-vif-deleted", "tag": "07f5e414-1917-4efe-9307-869f5b12a987"}]} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:11:05.258348 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-9c236e91-da1f-4e0b-a37e-be73d9a59cc7 req-555e07a8-328b-4b6f-b927-7f79fd44e235 service nova] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:11:05.259506 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-9c236e91-da1f-4e0b-a37e-be73d9a59cc7 req-555e07a8-328b-4b6f-b927-7f79fd44e235 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:11:05.261114 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-9c236e91-da1f-4e0b-a37e-be73d9a59cc7 req-555e07a8-328b-4b6f-b927-7f79fd44e235 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:11:05.292228 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.compute.server_external_events [req-9c236e91-da1f-4e0b-a37e-be73d9a59cc7 req-555e07a8-328b-4b6f-b927-7f79fd44e235 service nova] Creating event network-vif-deleted:07f5e414-1917-4efe-9307-869f5b12a987 for instance 7ee07462-fab6-49a3-b7fd-cbe545cc6f55 on n-h1-863052-2 Nov 01 19:11:05.306861 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [req-9c236e91-da1f-4e0b-a37e-be73d9a59cc7 req-555e07a8-328b-4b6f-b927-7f79fd44e235 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084496 Nov 01 19:11:05.307590 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 2033/4141] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Nov 1 19:11:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:11:05.356854 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-a42ac43e-999e-4052-b3ca-839f5989fb96 tempest-InstanceActionsNegativeTestJSON-1175023068 tempest-InstanceActionsNegativeTestJSON-1175023068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90eeeb07a21345f5801a340078809488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba92568b226b4ea793c9f40cf9b97839', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:11:05.368425 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-a42ac43e-999e-4052-b3ca-839f5989fb96 tempest-InstanceActionsNegativeTestJSON-1175023068 tempest-InstanceActionsNegativeTestJSON-1175023068-project] 10.222.0.13 "GET /compute/v2.1/servers/9ddd96fd-cb96-4808-9172-2785776d2d1d" status: 200 len: 1529 microversion: 2.1 time: 0.786895 Nov 01 19:11:05.369605 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 2109/4142] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:11:04 2022] GET /compute/v2.1/servers/9ddd96fd-cb96-4808-9172-2785776d2d1d => generated 1529 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:11:05.588560 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-e9d35e9c-7b39-401a-a270-e64f4e69ff65 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:11:05.591022 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-e9d35e9c-7b39-401a-a270-e64f4e69ff65 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] [instance: eced579f-beea-4d3c-b2b8-8a6b31f7829b] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:11:05.602339 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e9d35e9c-7b39-401a-a270-e64f4e69ff65 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:11:05.604997 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e9d35e9c-7b39-401a-a270-e64f4e69ff65 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:11:05.606183 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e9d35e9c-7b39-401a-a270-e64f4e69ff65 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:11:05.608295 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e9d35e9c-7b39-401a-a270-e64f4e69ff65 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:11:05.612863 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e9d35e9c-7b39-401a-a270-e64f4e69ff65 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:11:05.613595 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e9d35e9c-7b39-401a-a270-e64f4e69ff65 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:11:05.693184 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-e9d35e9c-7b39-401a-a270-e64f4e69ff65 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] 10.222.0.13 "GET /compute/v2.1/servers/eced579f-beea-4d3c-b2b8-8a6b31f7829b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.110083 Nov 01 19:11:05.702428 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 2034/4143] 10.222.0.13 () {58 vars in 1302 bytes} [Tue Nov 1 19:11:05 2022] GET /compute/v2.1/servers/eced579f-beea-4d3c-b2b8-8a6b31f7829b/os-volume_attachments => generated 197 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:11:05.730086 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [req-3f307079-2d09-4266-a74c-829e24fefedb req-45527dc3-6428-4d1f-aeb7-3f1cece39563 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9ddd96fd-cb96-4808-9172-2785776d2d1d", "name": "network-vif-deleted", "tag": "c29dc4b3-164b-4843-99d6-674e8b6ff2cc"}]} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:11:05.747586 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-3f307079-2d09-4266-a74c-829e24fefedb req-45527dc3-6428-4d1f-aeb7-3f1cece39563 service nova] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:11:05.748969 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-3f307079-2d09-4266-a74c-829e24fefedb req-45527dc3-6428-4d1f-aeb7-3f1cece39563 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:11:05.749803 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-3f307079-2d09-4266-a74c-829e24fefedb req-45527dc3-6428-4d1f-aeb7-3f1cece39563 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:11:05.771147 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.compute.server_external_events [req-3f307079-2d09-4266-a74c-829e24fefedb req-45527dc3-6428-4d1f-aeb7-3f1cece39563 service nova] Creating event network-vif-deleted:c29dc4b3-164b-4843-99d6-674e8b6ff2cc for instance 9ddd96fd-cb96-4808-9172-2785776d2d1d on n-h2-863052-2 Nov 01 19:11:05.784878 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [req-3f307079-2d09-4266-a74c-829e24fefedb req-45527dc3-6428-4d1f-aeb7-3f1cece39563 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057439 Nov 01 19:11:05.790400 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 2110/4144] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Nov 1 19:11:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:11:05.804403 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-0801cb69-d755-484e-801c-9f49f3060019 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:11:05.805297 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-0801cb69-d755-484e-801c-9f49f3060019 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] [instance: ba6ffc5c-84a4-40f1-bdc7-f87dde2c99df] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:11:05.821124 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-0801cb69-d755-484e-801c-9f49f3060019 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:11:05.824097 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-0801cb69-d755-484e-801c-9f49f3060019 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:11:05.832868 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-0801cb69-d755-484e-801c-9f49f3060019 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:11:05.833638 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-0801cb69-d755-484e-801c-9f49f3060019 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:11:05.834125 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-0801cb69-d755-484e-801c-9f49f3060019 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:11:05.834714 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-0801cb69-d755-484e-801c-9f49f3060019 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:11:06.095556 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-0801cb69-d755-484e-801c-9f49f3060019 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd2105b0264b48d084d0e79cabff8bc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf4adda91364dab94830347c06e3957', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:11:06.112037 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-0801cb69-d755-484e-801c-9f49f3060019 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd2105b0264b48d084d0e79cabff8bc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf4adda91364dab94830347c06e3957', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:11:06.113910 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-0801cb69-d755-484e-801c-9f49f3060019 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd2105b0264b48d084d0e79cabff8bc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf4adda91364dab94830347c06e3957', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:11:06.118383 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-0801cb69-d755-484e-801c-9f49f3060019 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] 10.222.0.13 "GET /compute/v2.1/servers/ba6ffc5c-84a4-40f1-bdc7-f87dde2c99df" status: 200 len: 1605 microversion: 2.32 time: 0.317393 Nov 01 19:11:06.122876 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 2035/4145] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 19:11:05 2022] GET /compute/v2.1/servers/ba6ffc5c-84a4-40f1-bdc7-f87dde2c99df => generated 1605 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 19:11:06.245436 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-14cabfd6-cf2b-4fd9-b9e4-90dadbb2ab3c tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:11:06.247434 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-14cabfd6-cf2b-4fd9-b9e4-90dadbb2ab3c tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] [instance: 7ee07462-fab6-49a3-b7fd-cbe545cc6f55] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:11:06.259297 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-14cabfd6-cf2b-4fd9-b9e4-90dadbb2ab3c tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:11:06.266063 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-14cabfd6-cf2b-4fd9-b9e4-90dadbb2ab3c tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:11:06.268443 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-14cabfd6-cf2b-4fd9-b9e4-90dadbb2ab3c tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:11:06.269368 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-14cabfd6-cf2b-4fd9-b9e4-90dadbb2ab3c tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:11:06.272919 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-14cabfd6-cf2b-4fd9-b9e4-90dadbb2ab3c tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:11:06.273481 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-14cabfd6-cf2b-4fd9-b9e4-90dadbb2ab3c tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:11:06.308494 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.wsgi [None req-14cabfd6-cf2b-4fd9-b9e4-90dadbb2ab3c tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] HTTP exception thrown: Instance 7ee07462-fab6-49a3-b7fd-cbe545cc6f55 could not be found. Nov 01 19:11:06.310207 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-14cabfd6-cf2b-4fd9-b9e4-90dadbb2ab3c tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] Request method failure captured: Nov 01 19:11:06.310207 n-d-863052-2 devstack@n-api.service[121403]: request: GET /compute/v2.1/servers/7ee07462-fab6-49a3-b7fd-cbe545cc6f55 HTTP/1.1 Nov 01 19:11:06.310207 n-d-863052-2 devstack@n-api.service[121403]: Accept: application/json Nov 01 19:11:06.310207 n-d-863052-2 devstack@n-api.service[121403]: Accept-Encoding: identity Nov 01 19:11:06.310207 n-d-863052-2 devstack@n-api.service[121403]: Connection: close Nov 01 19:11:06.310207 n-d-863052-2 devstack@n-api.service[121403]: Content-Length: 0 Nov 01 19:11:06.310207 n-d-863052-2 devstack@n-api.service[121403]: Content-Type: application/json Nov 01 19:11:06.310207 n-d-863052-2 devstack@n-api.service[121403]: Host: 10.222.0.13 Nov 01 19:11:06.310207 n-d-863052-2 devstack@n-api.service[121403]: Openstack-System-Scope: None Nov 01 19:11:06.310207 n-d-863052-2 devstack@n-api.service[121403]: User-Agent: python-urllib3/1.26.12 Nov 01 19:11:06.310207 n-d-863052-2 devstack@n-api.service[121403]: X-Auth-Token: gAAAAABjYW7HMki1_ABgHO7dxRvivRv_wqT8yW1357EMuj7cZMTDOtNlIoykdf9GFUQ5Qj9h3jVU1GoRQFOtZRXN5BWe11EJtARWzQ96nkUNGsa5CODrQigS0fFh-_OeQA5AguTmIHaN02Egcz3uQOnK8WdesSCzZgKa6pNsi85nov2TrD9zjvc Nov 01 19:11:06.310207 n-d-863052-2 devstack@n-api.service[121403]: X-Domain-Id: None Nov 01 19:11:06.310207 n-d-863052-2 devstack@n-api.service[121403]: X-Domain-Name: None Nov 01 19:11:06.310207 n-d-863052-2 devstack@n-api.service[121403]: X-Identity-Status: Confirmed Nov 01 19:11:06.310207 n-d-863052-2 devstack@n-api.service[121403]: X-Is-Admin-Project: True Nov 01 19:11:06.310207 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Domain-Id: default Nov 01 19:11:06.310207 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Domain-Name: Default Nov 01 19:11:06.310207 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Id: 3d8835c7b6754bfd81447b1f8893e56c Nov 01 19:11:06.310207 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Name: tempest-VolumesAdminNegativeTest-526487121 Nov 01 19:11:06.310207 n-d-863052-2 devstack@n-api.service[121403]: X-Role: member,reader Nov 01 19:11:06.310207 n-d-863052-2 devstack@n-api.service[121403]: X-Roles: member,reader Nov 01 19:11:06.310207 n-d-863052-2 devstack@n-api.service[121403]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/3d8835c7b6754bfd81447b1f8893e56c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/3d8835c7b6754bfd81447b1f8893e56c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_3d8835c7b6754bfd81447b1f8893e56c", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/3d8835c7b6754bfd81447b1f8893e56c"}]}] Nov 01 19:11:06.310207 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant: tempest-VolumesAdminNegativeTest-526487121 Nov 01 19:11:06.310207 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant-Id: 3d8835c7b6754bfd81447b1f8893e56c Nov 01 19:11:06.310207 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-526487121 Nov 01 19:11:06.310207 n-d-863052-2 devstack@n-api.service[121403]: X-User: tempest-VolumesAdminNegativeTest-526487121-project Nov 01 19:11:06.310207 n-d-863052-2 devstack@n-api.service[121403]: X-User-Domain-Id: default Nov 01 19:11:06.310207 n-d-863052-2 devstack@n-api.service[121403]: X-User-Domain-Name: Default Nov 01 19:11:06.310207 n-d-863052-2 devstack@n-api.service[121403]: X-User-Id: c72e7e000a9a4fa49474bd5d19accf77 Nov 01 19:11:06.310207 n-d-863052-2 devstack@n-api.service[121403]: X-User-Name: tempest-VolumesAdminNegativeTest-526487121-project Nov 01 19:11:06.310207 n-d-863052-2 devstack@n-api.service[121403]: method: > Nov 01 19:11:06.310207 n-d-863052-2 devstack@n-api.service[121403]: exception: Instance 7ee07462-fab6-49a3-b7fd-cbe545cc6f55 could not be found. Nov 01 19:11:06.310207 n-d-863052-2 devstack@n-api.service[121403]: action_args: {'id': '7ee07462-fab6-49a3-b7fd-cbe545cc6f55'} Nov 01 19:11:06.310207 n-d-863052-2 devstack@n-api.service[121403]: {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 01 19:11:06.310207 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:11:06.310207 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 01 19:11:06.310207 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 01 19:11:06.310207 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 01 19:11:06.310207 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 01 19:11:06.310207 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 01 19:11:06.310207 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 01 19:11:06.310207 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 01 19:11:06.310207 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 01 19:11:06.310207 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7ee07462-fab6-49a3-b7fd-cbe545cc6f55 could not be found. Nov 01 19:11:06.310207 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:11:06.310207 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:11:06.310207 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:11:06.310207 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:11:06.310207 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:11:06.310207 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:11:06.310207 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 01 19:11:06.310207 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 01 19:11:06.310207 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 01 19:11:06.310207 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 01 19:11:06.310207 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 01 19:11:06.310207 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 01 19:11:06.310207 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 01 19:11:06.310207 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 01 19:11:06.310207 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 01 19:11:06.310207 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 01 19:11:06.310207 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7ee07462-fab6-49a3-b7fd-cbe545cc6f55 could not be found. Nov 01 19:11:06.310207 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:11:06.310207 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:11:06.310207 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:11:06.319135 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:11:06.319135 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:11:06.319135 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:11:06.319135 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 01 19:11:06.319135 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 01 19:11:06.319135 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7ee07462-fab6-49a3-b7fd-cbe545cc6f55 could not be found. Nov 01 19:11:06.319135 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:11:06.319135 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-14cabfd6-cf2b-4fd9-b9e4-90dadbb2ab3c tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] Returning 404 to user: Instance 7ee07462-fab6-49a3-b7fd-cbe545cc6f55 could not be found. {{(pid=121403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 01 19:11:06.319135 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-14cabfd6-cf2b-4fd9-b9e4-90dadbb2ab3c tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] 10.222.0.13 "GET /compute/v2.1/servers/7ee07462-fab6-49a3-b7fd-cbe545cc6f55" status: 404 len: 111 microversion: 2.1 time: 0.072164 Nov 01 19:11:06.319135 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 2111/4146] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:11:06 2022] GET /compute/v2.1/servers/7ee07462-fab6-49a3-b7fd-cbe545cc6f55 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 01 19:11:06.396898 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-10358b2c-beb8-4c29-9a2a-8059a53a371f tempest-InstanceActionsNegativeTestJSON-1175023068 tempest-InstanceActionsNegativeTestJSON-1175023068-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:11:06.397819 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-10358b2c-beb8-4c29-9a2a-8059a53a371f tempest-InstanceActionsNegativeTestJSON-1175023068 tempest-InstanceActionsNegativeTestJSON-1175023068-project] [instance: 9ddd96fd-cb96-4808-9172-2785776d2d1d] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:11:06.414629 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-10358b2c-beb8-4c29-9a2a-8059a53a371f tempest-InstanceActionsNegativeTestJSON-1175023068 tempest-InstanceActionsNegativeTestJSON-1175023068-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:11:06.415136 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-10358b2c-beb8-4c29-9a2a-8059a53a371f tempest-InstanceActionsNegativeTestJSON-1175023068 tempest-InstanceActionsNegativeTestJSON-1175023068-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:11:06.422675 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-10358b2c-beb8-4c29-9a2a-8059a53a371f tempest-InstanceActionsNegativeTestJSON-1175023068 tempest-InstanceActionsNegativeTestJSON-1175023068-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:11:06.424867 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-10358b2c-beb8-4c29-9a2a-8059a53a371f tempest-InstanceActionsNegativeTestJSON-1175023068 tempest-InstanceActionsNegativeTestJSON-1175023068-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:11:06.425554 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-10358b2c-beb8-4c29-9a2a-8059a53a371f tempest-InstanceActionsNegativeTestJSON-1175023068 tempest-InstanceActionsNegativeTestJSON-1175023068-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:11:06.426802 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-10358b2c-beb8-4c29-9a2a-8059a53a371f tempest-InstanceActionsNegativeTestJSON-1175023068 tempest-InstanceActionsNegativeTestJSON-1175023068-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:11:06.507588 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-10358b2c-beb8-4c29-9a2a-8059a53a371f tempest-InstanceActionsNegativeTestJSON-1175023068 tempest-InstanceActionsNegativeTestJSON-1175023068-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:11:06.508484 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-10358b2c-beb8-4c29-9a2a-8059a53a371f tempest-InstanceActionsNegativeTestJSON-1175023068 tempest-InstanceActionsNegativeTestJSON-1175023068-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:11:06.509195 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-10358b2c-beb8-4c29-9a2a-8059a53a371f tempest-InstanceActionsNegativeTestJSON-1175023068 tempest-InstanceActionsNegativeTestJSON-1175023068-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:11:06.510072 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.objects.instance [None req-10358b2c-beb8-4c29-9a2a-8059a53a371f tempest-InstanceActionsNegativeTestJSON-1175023068 tempest-InstanceActionsNegativeTestJSON-1175023068-project] Lazy-loading 'fault' on Instance uuid 9ddd96fd-cb96-4808-9172-2785776d2d1d {{(pid=121402) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 01 19:11:06.709657 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-10358b2c-beb8-4c29-9a2a-8059a53a371f tempest-InstanceActionsNegativeTestJSON-1175023068 tempest-InstanceActionsNegativeTestJSON-1175023068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90eeeb07a21345f5801a340078809488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba92568b226b4ea793c9f40cf9b97839', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:11:06.714340 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-9151f345-61e1-4c5c-8c6d-11d6b3e2b23a tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:11:06.716993 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-9151f345-61e1-4c5c-8c6d-11d6b3e2b23a tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] [instance: eced579f-beea-4d3c-b2b8-8a6b31f7829b] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:11:06.724703 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-10358b2c-beb8-4c29-9a2a-8059a53a371f tempest-InstanceActionsNegativeTestJSON-1175023068 tempest-InstanceActionsNegativeTestJSON-1175023068-project] 10.222.0.13 "GET /compute/v2.1/servers/9ddd96fd-cb96-4808-9172-2785776d2d1d" status: 200 len: 1315 microversion: 2.1 time: 0.331540 Nov 01 19:11:06.726595 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 2036/4147] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:11:06 2022] GET /compute/v2.1/servers/9ddd96fd-cb96-4808-9172-2785776d2d1d => generated 1315 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:11:06.729831 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-9151f345-61e1-4c5c-8c6d-11d6b3e2b23a tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:11:06.731124 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-9151f345-61e1-4c5c-8c6d-11d6b3e2b23a tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:11:06.732192 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-9151f345-61e1-4c5c-8c6d-11d6b3e2b23a tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:11:06.733334 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-9151f345-61e1-4c5c-8c6d-11d6b3e2b23a tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:11:06.733997 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-9151f345-61e1-4c5c-8c6d-11d6b3e2b23a tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:11:06.734729 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-9151f345-61e1-4c5c-8c6d-11d6b3e2b23a tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:11:06.771402 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-9151f345-61e1-4c5c-8c6d-11d6b3e2b23a tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] 10.222.0.13 "GET /compute/v2.1/servers/eced579f-beea-4d3c-b2b8-8a6b31f7829b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.069775 Nov 01 19:11:06.772663 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 2112/4148] 10.222.0.13 () {58 vars in 1302 bytes} [Tue Nov 1 19:11:06 2022] GET /compute/v2.1/servers/eced579f-beea-4d3c-b2b8-8a6b31f7829b/os-volume_attachments => generated 197 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 01 19:11:07.150066 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-2bb7e85c-e715-4aec-8320-d92b0764b823 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:11:07.150955 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-2bb7e85c-e715-4aec-8320-d92b0764b823 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] [instance: ba6ffc5c-84a4-40f1-bdc7-f87dde2c99df] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:11:07.169107 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2bb7e85c-e715-4aec-8320-d92b0764b823 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:11:07.169998 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2bb7e85c-e715-4aec-8320-d92b0764b823 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:11:07.171406 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2bb7e85c-e715-4aec-8320-d92b0764b823 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:11:07.175159 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2bb7e85c-e715-4aec-8320-d92b0764b823 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:11:07.175954 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2bb7e85c-e715-4aec-8320-d92b0764b823 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:11:07.176408 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2bb7e85c-e715-4aec-8320-d92b0764b823 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:11:07.522921 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-2bb7e85c-e715-4aec-8320-d92b0764b823 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd2105b0264b48d084d0e79cabff8bc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf4adda91364dab94830347c06e3957', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:11:07.542155 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-2bb7e85c-e715-4aec-8320-d92b0764b823 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd2105b0264b48d084d0e79cabff8bc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf4adda91364dab94830347c06e3957', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:11:07.556552 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-2bb7e85c-e715-4aec-8320-d92b0764b823 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd2105b0264b48d084d0e79cabff8bc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf4adda91364dab94830347c06e3957', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:11:07.558255 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-2bb7e85c-e715-4aec-8320-d92b0764b823 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] 10.222.0.13 "GET /compute/v2.1/servers/ba6ffc5c-84a4-40f1-bdc7-f87dde2c99df" status: 200 len: 1605 microversion: 2.32 time: 0.414769 Nov 01 19:11:07.573846 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 2037/4149] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 19:11:07 2022] GET /compute/v2.1/servers/ba6ffc5c-84a4-40f1-bdc7-f87dde2c99df => generated 1605 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 19:11:07.757997 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-d549a6ca-9432-435f-a314-d21b07f0950f tempest-InstanceActionsNegativeTestJSON-1175023068 tempest-InstanceActionsNegativeTestJSON-1175023068-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:11:07.760062 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-d549a6ca-9432-435f-a314-d21b07f0950f tempest-InstanceActionsNegativeTestJSON-1175023068 tempest-InstanceActionsNegativeTestJSON-1175023068-project] [instance: 9ddd96fd-cb96-4808-9172-2785776d2d1d] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:11:07.785254 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-becf0e9a-09bc-40b2-83a8-7101bdcad8fc tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:11:07.790931 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-becf0e9a-09bc-40b2-83a8-7101bdcad8fc tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] [instance: eced579f-beea-4d3c-b2b8-8a6b31f7829b] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:11:07.799153 n-d-863052-2 devstack@n-api.service[121402]: DEBUG dbcounter [-] [121402] Writing DB stats nova_api:SELECT=97,nova_api:DELETE=1,nova_api:UPDATE=2 {{(pid=121402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 19:11:07.802756 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d549a6ca-9432-435f-a314-d21b07f0950f tempest-InstanceActionsNegativeTestJSON-1175023068 tempest-InstanceActionsNegativeTestJSON-1175023068-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:11:07.803419 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d549a6ca-9432-435f-a314-d21b07f0950f tempest-InstanceActionsNegativeTestJSON-1175023068 tempest-InstanceActionsNegativeTestJSON-1175023068-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:11:07.803920 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d549a6ca-9432-435f-a314-d21b07f0950f tempest-InstanceActionsNegativeTestJSON-1175023068 tempest-InstanceActionsNegativeTestJSON-1175023068-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:11:07.804794 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d549a6ca-9432-435f-a314-d21b07f0950f tempest-InstanceActionsNegativeTestJSON-1175023068 tempest-InstanceActionsNegativeTestJSON-1175023068-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:11:07.810010 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d549a6ca-9432-435f-a314-d21b07f0950f tempest-InstanceActionsNegativeTestJSON-1175023068 tempest-InstanceActionsNegativeTestJSON-1175023068-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:11:07.810724 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d549a6ca-9432-435f-a314-d21b07f0950f tempest-InstanceActionsNegativeTestJSON-1175023068 tempest-InstanceActionsNegativeTestJSON-1175023068-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:11:07.812061 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-becf0e9a-09bc-40b2-83a8-7101bdcad8fc tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:11:07.813139 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-becf0e9a-09bc-40b2-83a8-7101bdcad8fc tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:11:07.813901 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-becf0e9a-09bc-40b2-83a8-7101bdcad8fc tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:11:07.814977 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-becf0e9a-09bc-40b2-83a8-7101bdcad8fc tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:11:07.815678 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-becf0e9a-09bc-40b2-83a8-7101bdcad8fc tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:11:07.817350 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-becf0e9a-09bc-40b2-83a8-7101bdcad8fc tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:11:07.856967 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.wsgi [None req-d549a6ca-9432-435f-a314-d21b07f0950f tempest-InstanceActionsNegativeTestJSON-1175023068 tempest-InstanceActionsNegativeTestJSON-1175023068-project] HTTP exception thrown: Instance 9ddd96fd-cb96-4808-9172-2785776d2d1d could not be found. Nov 01 19:11:07.859557 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-d549a6ca-9432-435f-a314-d21b07f0950f tempest-InstanceActionsNegativeTestJSON-1175023068 tempest-InstanceActionsNegativeTestJSON-1175023068-project] Request method failure captured: Nov 01 19:11:07.859557 n-d-863052-2 devstack@n-api.service[121403]: request: GET /compute/v2.1/servers/9ddd96fd-cb96-4808-9172-2785776d2d1d HTTP/1.1 Nov 01 19:11:07.859557 n-d-863052-2 devstack@n-api.service[121403]: Accept: application/json Nov 01 19:11:07.859557 n-d-863052-2 devstack@n-api.service[121403]: Accept-Encoding: identity Nov 01 19:11:07.859557 n-d-863052-2 devstack@n-api.service[121403]: Connection: close Nov 01 19:11:07.859557 n-d-863052-2 devstack@n-api.service[121403]: Content-Length: 0 Nov 01 19:11:07.859557 n-d-863052-2 devstack@n-api.service[121403]: Content-Type: application/json Nov 01 19:11:07.859557 n-d-863052-2 devstack@n-api.service[121403]: Host: 10.222.0.13 Nov 01 19:11:07.859557 n-d-863052-2 devstack@n-api.service[121403]: Openstack-System-Scope: None Nov 01 19:11:07.859557 n-d-863052-2 devstack@n-api.service[121403]: User-Agent: python-urllib3/1.26.12 Nov 01 19:11:07.859557 n-d-863052-2 devstack@n-api.service[121403]: X-Auth-Token: gAAAAABjYW8xE51U-zJLRQkwUKvxwf--KUrtw2HnjSCirj4RvVWTTZ0AdU0uaDyGZtSnkMqfwi_x12wp_0FYVTradpkaAWjVf7c56pUwpCq3SiKLvPi8xSrAJFZt_dMZJEmXUbMctFh0_kTLKhLVxJyzcVv_CflUBDdZO83reWDaey2UKrBAxK4 Nov 01 19:11:07.859557 n-d-863052-2 devstack@n-api.service[121403]: X-Domain-Id: None Nov 01 19:11:07.859557 n-d-863052-2 devstack@n-api.service[121403]: X-Domain-Name: None Nov 01 19:11:07.859557 n-d-863052-2 devstack@n-api.service[121403]: X-Identity-Status: Confirmed Nov 01 19:11:07.859557 n-d-863052-2 devstack@n-api.service[121403]: X-Is-Admin-Project: True Nov 01 19:11:07.859557 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Domain-Id: default Nov 01 19:11:07.859557 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Domain-Name: Default Nov 01 19:11:07.859557 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Id: ba92568b226b4ea793c9f40cf9b97839 Nov 01 19:11:07.859557 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-1175023068 Nov 01 19:11:07.859557 n-d-863052-2 devstack@n-api.service[121403]: X-Role: member,reader Nov 01 19:11:07.859557 n-d-863052-2 devstack@n-api.service[121403]: X-Roles: member,reader Nov 01 19:11:07.859557 n-d-863052-2 devstack@n-api.service[121403]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/ba92568b226b4ea793c9f40cf9b97839"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/ba92568b226b4ea793c9f40cf9b97839"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_ba92568b226b4ea793c9f40cf9b97839", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/ba92568b226b4ea793c9f40cf9b97839"}]}] Nov 01 19:11:07.859557 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-1175023068 Nov 01 19:11:07.859557 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant-Id: ba92568b226b4ea793c9f40cf9b97839 Nov 01 19:11:07.859557 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-1175023068 Nov 01 19:11:07.859557 n-d-863052-2 devstack@n-api.service[121403]: X-User: tempest-InstanceActionsNegativeTestJSON-1175023068-project Nov 01 19:11:07.859557 n-d-863052-2 devstack@n-api.service[121403]: X-User-Domain-Id: default Nov 01 19:11:07.859557 n-d-863052-2 devstack@n-api.service[121403]: X-User-Domain-Name: Default Nov 01 19:11:07.859557 n-d-863052-2 devstack@n-api.service[121403]: X-User-Id: 90eeeb07a21345f5801a340078809488 Nov 01 19:11:07.859557 n-d-863052-2 devstack@n-api.service[121403]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-1175023068-project Nov 01 19:11:07.859557 n-d-863052-2 devstack@n-api.service[121403]: method: > Nov 01 19:11:07.859557 n-d-863052-2 devstack@n-api.service[121403]: exception: Instance 9ddd96fd-cb96-4808-9172-2785776d2d1d could not be found. Nov 01 19:11:07.859557 n-d-863052-2 devstack@n-api.service[121403]: action_args: {'id': '9ddd96fd-cb96-4808-9172-2785776d2d1d'} Nov 01 19:11:07.859557 n-d-863052-2 devstack@n-api.service[121403]: {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 01 19:11:07.859557 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:11:07.859557 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 01 19:11:07.859557 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 01 19:11:07.859557 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 01 19:11:07.859557 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 01 19:11:07.859557 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 01 19:11:07.859557 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 01 19:11:07.859557 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 01 19:11:07.859557 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 01 19:11:07.859557 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9ddd96fd-cb96-4808-9172-2785776d2d1d could not be found. Nov 01 19:11:07.859557 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:11:07.859557 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:11:07.859557 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:11:07.859557 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:11:07.859557 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:11:07.859557 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:11:07.859557 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 01 19:11:07.859557 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 01 19:11:07.859557 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 01 19:11:07.859557 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 01 19:11:07.859557 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 01 19:11:07.859557 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 01 19:11:07.859557 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 01 19:11:07.859557 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 01 19:11:07.859557 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 01 19:11:07.859557 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 01 19:11:07.859557 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9ddd96fd-cb96-4808-9172-2785776d2d1d could not be found. Nov 01 19:11:07.859557 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:11:07.859557 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:11:07.865572 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:11:07.865572 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:11:07.865572 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:11:07.865572 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:11:07.865572 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 01 19:11:07.865572 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 01 19:11:07.865572 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9ddd96fd-cb96-4808-9172-2785776d2d1d could not be found. Nov 01 19:11:07.865572 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:11:07.878358 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-d549a6ca-9432-435f-a314-d21b07f0950f tempest-InstanceActionsNegativeTestJSON-1175023068 tempest-InstanceActionsNegativeTestJSON-1175023068-project] Returning 404 to user: Instance 9ddd96fd-cb96-4808-9172-2785776d2d1d could not be found. {{(pid=121403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 01 19:11:07.879741 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-d549a6ca-9432-435f-a314-d21b07f0950f tempest-InstanceActionsNegativeTestJSON-1175023068 tempest-InstanceActionsNegativeTestJSON-1175023068-project] 10.222.0.13 "GET /compute/v2.1/servers/9ddd96fd-cb96-4808-9172-2785776d2d1d" status: 404 len: 111 microversion: 2.1 time: 0.135210 Nov 01 19:11:07.884225 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 2113/4150] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:11:07 2022] GET /compute/v2.1/servers/9ddd96fd-cb96-4808-9172-2785776d2d1d => generated 111 bytes in 141 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 01 19:11:07.927836 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-becf0e9a-09bc-40b2-83a8-7101bdcad8fc tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] 10.222.0.13 "GET /compute/v2.1/servers/eced579f-beea-4d3c-b2b8-8a6b31f7829b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.147336 Nov 01 19:11:07.939027 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 2038/4151] 10.222.0.13 () {58 vars in 1302 bytes} [Tue Nov 1 19:11:07 2022] GET /compute/v2.1/servers/eced579f-beea-4d3c-b2b8-8a6b31f7829b/os-volume_attachments => generated 197 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:11:08.587874 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-0ace06bf-b013-478e-b264-c354a81c3eae tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:11:08.588478 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-0ace06bf-b013-478e-b264-c354a81c3eae tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] [instance: ba6ffc5c-84a4-40f1-bdc7-f87dde2c99df] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:11:08.611069 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-0ace06bf-b013-478e-b264-c354a81c3eae tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:11:08.613426 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-0ace06bf-b013-478e-b264-c354a81c3eae tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:11:08.618084 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-0ace06bf-b013-478e-b264-c354a81c3eae tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:11:08.619181 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-0ace06bf-b013-478e-b264-c354a81c3eae tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:11:08.625301 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-0ace06bf-b013-478e-b264-c354a81c3eae tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:11:08.626626 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-0ace06bf-b013-478e-b264-c354a81c3eae tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:11:08.946951 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-fec6329d-3925-4d49-ab5a-ae77ac090c98 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:11:08.949278 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-fec6329d-3925-4d49-ab5a-ae77ac090c98 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] [instance: eced579f-beea-4d3c-b2b8-8a6b31f7829b] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:11:08.963808 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-fec6329d-3925-4d49-ab5a-ae77ac090c98 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:11:08.965876 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-fec6329d-3925-4d49-ab5a-ae77ac090c98 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:11:08.966677 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-fec6329d-3925-4d49-ab5a-ae77ac090c98 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:11:08.969417 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-fec6329d-3925-4d49-ab5a-ae77ac090c98 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:11:08.971468 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-fec6329d-3925-4d49-ab5a-ae77ac090c98 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:11:08.972339 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-fec6329d-3925-4d49-ab5a-ae77ac090c98 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:11:09.060927 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-fec6329d-3925-4d49-ab5a-ae77ac090c98 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] 10.222.0.13 "GET /compute/v2.1/servers/eced579f-beea-4d3c-b2b8-8a6b31f7829b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.117672 Nov 01 19:11:09.062266 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 2039/4152] 10.222.0.13 () {58 vars in 1302 bytes} [Tue Nov 1 19:11:08 2022] GET /compute/v2.1/servers/eced579f-beea-4d3c-b2b8-8a6b31f7829b/os-volume_attachments => generated 197 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:11:09.171843 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-0ace06bf-b013-478e-b264-c354a81c3eae tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd2105b0264b48d084d0e79cabff8bc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf4adda91364dab94830347c06e3957', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:11:09.188148 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-0ace06bf-b013-478e-b264-c354a81c3eae tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd2105b0264b48d084d0e79cabff8bc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf4adda91364dab94830347c06e3957', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:11:09.198688 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-0ace06bf-b013-478e-b264-c354a81c3eae tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd2105b0264b48d084d0e79cabff8bc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf4adda91364dab94830347c06e3957', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:11:09.202465 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-0ace06bf-b013-478e-b264-c354a81c3eae tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] 10.222.0.13 "GET /compute/v2.1/servers/ba6ffc5c-84a4-40f1-bdc7-f87dde2c99df" status: 200 len: 1605 microversion: 2.32 time: 0.618727 Nov 01 19:11:09.204813 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 2114/4153] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 19:11:08 2022] GET /compute/v2.1/servers/ba6ffc5c-84a4-40f1-bdc7-f87dde2c99df => generated 1605 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 19:11:10.075510 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-96aefd64-cf67-4462-9de5-d1b61d4168ac tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:11:10.078373 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-96aefd64-cf67-4462-9de5-d1b61d4168ac tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] [instance: eced579f-beea-4d3c-b2b8-8a6b31f7829b] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:11:10.107259 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-96aefd64-cf67-4462-9de5-d1b61d4168ac tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:11:10.107773 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-96aefd64-cf67-4462-9de5-d1b61d4168ac tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:11:10.108220 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-96aefd64-cf67-4462-9de5-d1b61d4168ac tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:11:10.109080 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-96aefd64-cf67-4462-9de5-d1b61d4168ac tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:11:10.109544 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-96aefd64-cf67-4462-9de5-d1b61d4168ac tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:11:10.109975 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-96aefd64-cf67-4462-9de5-d1b61d4168ac tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:11:10.169884 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-96aefd64-cf67-4462-9de5-d1b61d4168ac tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] 10.222.0.13 "GET /compute/v2.1/servers/eced579f-beea-4d3c-b2b8-8a6b31f7829b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.098789 Nov 01 19:11:10.170883 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 2040/4154] 10.222.0.13 () {58 vars in 1302 bytes} [Tue Nov 1 19:11:10 2022] GET /compute/v2.1/servers/eced579f-beea-4d3c-b2b8-8a6b31f7829b/os-volume_attachments => generated 197 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:11:10.237959 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-57b84853-de1b-46ff-92f0-9ac38470e3e7 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:11:10.238580 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-57b84853-de1b-46ff-92f0-9ac38470e3e7 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] [instance: ba6ffc5c-84a4-40f1-bdc7-f87dde2c99df] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:11:10.249784 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-57b84853-de1b-46ff-92f0-9ac38470e3e7 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:11:10.251504 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-57b84853-de1b-46ff-92f0-9ac38470e3e7 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:11:10.254889 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-57b84853-de1b-46ff-92f0-9ac38470e3e7 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:11:10.255921 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-57b84853-de1b-46ff-92f0-9ac38470e3e7 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:11:10.257791 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-57b84853-de1b-46ff-92f0-9ac38470e3e7 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:11:10.258473 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-57b84853-de1b-46ff-92f0-9ac38470e3e7 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:11:10.416041 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-57b84853-de1b-46ff-92f0-9ac38470e3e7 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd2105b0264b48d084d0e79cabff8bc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf4adda91364dab94830347c06e3957', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:11:10.431719 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-57b84853-de1b-46ff-92f0-9ac38470e3e7 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd2105b0264b48d084d0e79cabff8bc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf4adda91364dab94830347c06e3957', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:11:10.439933 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-57b84853-de1b-46ff-92f0-9ac38470e3e7 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd2105b0264b48d084d0e79cabff8bc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf4adda91364dab94830347c06e3957', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:11:10.441228 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-57b84853-de1b-46ff-92f0-9ac38470e3e7 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] 10.222.0.13 "GET /compute/v2.1/servers/ba6ffc5c-84a4-40f1-bdc7-f87dde2c99df" status: 200 len: 1605 microversion: 2.32 time: 0.207157 Nov 01 19:11:10.442176 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 2115/4155] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 19:11:10 2022] GET /compute/v2.1/servers/ba6ffc5c-84a4-40f1-bdc7-f87dde2c99df => generated 1605 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 19:11:11.189734 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-b416d9cc-df40-44c0-9338-56c24ad73665 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:11:11.192245 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-b416d9cc-df40-44c0-9338-56c24ad73665 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] [instance: eced579f-beea-4d3c-b2b8-8a6b31f7829b] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:11:11.212300 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b416d9cc-df40-44c0-9338-56c24ad73665 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:11:11.214681 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b416d9cc-df40-44c0-9338-56c24ad73665 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:11:11.215432 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b416d9cc-df40-44c0-9338-56c24ad73665 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:11:11.216514 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b416d9cc-df40-44c0-9338-56c24ad73665 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:11:11.217940 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b416d9cc-df40-44c0-9338-56c24ad73665 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:11:11.218571 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b416d9cc-df40-44c0-9338-56c24ad73665 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:11:11.325283 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-b416d9cc-df40-44c0-9338-56c24ad73665 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] 10.222.0.13 "GET /compute/v2.1/servers/eced579f-beea-4d3c-b2b8-8a6b31f7829b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.142412 Nov 01 19:11:11.329802 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 2041/4156] 10.222.0.13 () {58 vars in 1302 bytes} [Tue Nov 1 19:11:11 2022] GET /compute/v2.1/servers/eced579f-beea-4d3c-b2b8-8a6b31f7829b/os-volume_attachments => generated 25 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 01 19:11:11.486939 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-dff30a09-3594-4892-97b8-2db448f71c7e tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:11:11.489161 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-dff30a09-3594-4892-97b8-2db448f71c7e tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] [instance: ba6ffc5c-84a4-40f1-bdc7-f87dde2c99df] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:11:11.521976 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-dff30a09-3594-4892-97b8-2db448f71c7e tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:11:11.522509 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-dff30a09-3594-4892-97b8-2db448f71c7e tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:11:11.526426 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-dff30a09-3594-4892-97b8-2db448f71c7e tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:11:11.527191 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-dff30a09-3594-4892-97b8-2db448f71c7e tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:11:11.527669 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-dff30a09-3594-4892-97b8-2db448f71c7e tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:11:11.528104 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-dff30a09-3594-4892-97b8-2db448f71c7e tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:11:11.711822 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-511e80f2-b98f-42b4-bac0-1da68c5093e6 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:11:11.712557 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-511e80f2-b98f-42b4-bac0-1da68c5093e6 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] [instance: eced579f-beea-4d3c-b2b8-8a6b31f7829b] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:11:11.733525 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-511e80f2-b98f-42b4-bac0-1da68c5093e6 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:11:11.734044 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-511e80f2-b98f-42b4-bac0-1da68c5093e6 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:11:11.734499 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-511e80f2-b98f-42b4-bac0-1da68c5093e6 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:11:11.744606 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-511e80f2-b98f-42b4-bac0-1da68c5093e6 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:11:11.744606 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-511e80f2-b98f-42b4-bac0-1da68c5093e6 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:11:11.744606 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-511e80f2-b98f-42b4-bac0-1da68c5093e6 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:11:11.810666 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-dff30a09-3594-4892-97b8-2db448f71c7e tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd2105b0264b48d084d0e79cabff8bc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf4adda91364dab94830347c06e3957', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:11:11.829076 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-511e80f2-b98f-42b4-bac0-1da68c5093e6 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] [instance: eced579f-beea-4d3c-b2b8-8a6b31f7829b] Going to try to terminate instance {{(pid=121402) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 01 19:11:11.835395 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-dff30a09-3594-4892-97b8-2db448f71c7e tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd2105b0264b48d084d0e79cabff8bc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf4adda91364dab94830347c06e3957', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:11:11.836968 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-dff30a09-3594-4892-97b8-2db448f71c7e tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd2105b0264b48d084d0e79cabff8bc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf4adda91364dab94830347c06e3957', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:11:11.838206 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-dff30a09-3594-4892-97b8-2db448f71c7e tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] 10.222.0.13 "GET /compute/v2.1/servers/ba6ffc5c-84a4-40f1-bdc7-f87dde2c99df" status: 200 len: 1605 microversion: 2.32 time: 0.359040 Nov 01 19:11:11.844098 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 2116/4157] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 19:11:11 2022] GET /compute/v2.1/servers/ba6ffc5c-84a4-40f1-bdc7-f87dde2c99df => generated 1605 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 19:11:12.099507 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-511e80f2-b98f-42b4-bac0-1da68c5093e6 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] 10.222.0.13 "DELETE /compute/v2.1/servers/eced579f-beea-4d3c-b2b8-8a6b31f7829b" status: 204 len: 0 microversion: 2.1 time: 0.392110 Nov 01 19:11:12.100846 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 2042/4158] 10.222.0.13 () {58 vars in 1239 bytes} [Tue Nov 1 19:11:11 2022] DELETE /compute/v2.1/servers/eced579f-beea-4d3c-b2b8-8a6b31f7829b => generated 0 bytes in 394 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 01 19:11:12.109572 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-934c52e9-5c41-4592-9726-637d5ce6a6fe tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:11:12.111147 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-934c52e9-5c41-4592-9726-637d5ce6a6fe tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] [instance: eced579f-beea-4d3c-b2b8-8a6b31f7829b] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:11:12.123385 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-934c52e9-5c41-4592-9726-637d5ce6a6fe tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:11:12.125810 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-934c52e9-5c41-4592-9726-637d5ce6a6fe tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:11:12.127154 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-934c52e9-5c41-4592-9726-637d5ce6a6fe tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:11:12.129492 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-934c52e9-5c41-4592-9726-637d5ce6a6fe tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:11:12.130221 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-934c52e9-5c41-4592-9726-637d5ce6a6fe tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:11:12.137500 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-934c52e9-5c41-4592-9726-637d5ce6a6fe tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:11:12.880712 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-5f6f9d4a-5dcd-42d4-aefb-7de0adff74d1 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:11:12.882238 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-5f6f9d4a-5dcd-42d4-aefb-7de0adff74d1 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] [instance: ba6ffc5c-84a4-40f1-bdc7-f87dde2c99df] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:11:12.899080 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-934c52e9-5c41-4592-9726-637d5ce6a6fe tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '790f3f1566b7464aaca19d4d05c0942e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33e3d319293c46b6af2f728a50586906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:11:12.930084 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-5f6f9d4a-5dcd-42d4-aefb-7de0adff74d1 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:11:12.932079 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-934c52e9-5c41-4592-9726-637d5ce6a6fe tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] 10.222.0.13 "GET /compute/v2.1/servers/eced579f-beea-4d3c-b2b8-8a6b31f7829b" status: 200 len: 1679 microversion: 2.1 time: 0.825879 Nov 01 19:11:12.933266 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-5f6f9d4a-5dcd-42d4-aefb-7de0adff74d1 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:11:12.934126 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 2117/4159] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:11:12 2022] GET /compute/v2.1/servers/eced579f-beea-4d3c-b2b8-8a6b31f7829b => generated 1679 bytes in 830 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:11:12.935387 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-5f6f9d4a-5dcd-42d4-aefb-7de0adff74d1 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:11:12.939970 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-5f6f9d4a-5dcd-42d4-aefb-7de0adff74d1 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:11:12.941378 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-5f6f9d4a-5dcd-42d4-aefb-7de0adff74d1 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:11:12.943630 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-5f6f9d4a-5dcd-42d4-aefb-7de0adff74d1 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:11:13.181940 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-5f6f9d4a-5dcd-42d4-aefb-7de0adff74d1 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd2105b0264b48d084d0e79cabff8bc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf4adda91364dab94830347c06e3957', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:11:13.206771 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-5f6f9d4a-5dcd-42d4-aefb-7de0adff74d1 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd2105b0264b48d084d0e79cabff8bc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf4adda91364dab94830347c06e3957', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:11:13.209498 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-5f6f9d4a-5dcd-42d4-aefb-7de0adff74d1 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd2105b0264b48d084d0e79cabff8bc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf4adda91364dab94830347c06e3957', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:11:13.211217 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-5f6f9d4a-5dcd-42d4-aefb-7de0adff74d1 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] 10.222.0.13 "GET /compute/v2.1/servers/ba6ffc5c-84a4-40f1-bdc7-f87dde2c99df" status: 200 len: 1605 microversion: 2.32 time: 0.339478 Nov 01 19:11:13.212360 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 2043/4160] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 19:11:12 2022] GET /compute/v2.1/servers/ba6ffc5c-84a4-40f1-bdc7-f87dde2c99df => generated 1605 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 19:11:13.965767 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-6b6c1815-fb0b-416c-87b1-2b89482d968d tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:11:13.966378 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-6b6c1815-fb0b-416c-87b1-2b89482d968d tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] [instance: eced579f-beea-4d3c-b2b8-8a6b31f7829b] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:11:13.974487 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-6b6c1815-fb0b-416c-87b1-2b89482d968d tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:11:13.975378 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-6b6c1815-fb0b-416c-87b1-2b89482d968d tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:11:13.976072 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-6b6c1815-fb0b-416c-87b1-2b89482d968d tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:11:13.977030 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-6b6c1815-fb0b-416c-87b1-2b89482d968d tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:11:13.977710 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-6b6c1815-fb0b-416c-87b1-2b89482d968d tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:11:13.990654 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-6b6c1815-fb0b-416c-87b1-2b89482d968d tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:11:14.248544 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-8c721f12-92d5-4eee-943e-174fbf54fc73 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:11:14.249639 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-8c721f12-92d5-4eee-943e-174fbf54fc73 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] [instance: ba6ffc5c-84a4-40f1-bdc7-f87dde2c99df] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:11:14.263963 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-8c721f12-92d5-4eee-943e-174fbf54fc73 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:11:14.266914 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-8c721f12-92d5-4eee-943e-174fbf54fc73 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:11:14.267616 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-8c721f12-92d5-4eee-943e-174fbf54fc73 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:11:14.271305 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-8c721f12-92d5-4eee-943e-174fbf54fc73 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:11:14.272842 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-8c721f12-92d5-4eee-943e-174fbf54fc73 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:11:14.274169 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-8c721f12-92d5-4eee-943e-174fbf54fc73 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:11:14.476205 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-8c721f12-92d5-4eee-943e-174fbf54fc73 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd2105b0264b48d084d0e79cabff8bc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf4adda91364dab94830347c06e3957', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:11:14.486428 n-d-863052-2 devstack@n-api.service[121402]: DEBUG dbcounter [-] [121402] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=121402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 19:11:14.499358 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-8c721f12-92d5-4eee-943e-174fbf54fc73 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd2105b0264b48d084d0e79cabff8bc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf4adda91364dab94830347c06e3957', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:11:14.503112 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-8c721f12-92d5-4eee-943e-174fbf54fc73 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd2105b0264b48d084d0e79cabff8bc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf4adda91364dab94830347c06e3957', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:11:14.506495 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-8c721f12-92d5-4eee-943e-174fbf54fc73 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] 10.222.0.13 "GET /compute/v2.1/servers/ba6ffc5c-84a4-40f1-bdc7-f87dde2c99df" status: 200 len: 1605 microversion: 2.32 time: 0.264021 Nov 01 19:11:14.510592 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 2044/4161] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 19:11:14 2022] GET /compute/v2.1/servers/ba6ffc5c-84a4-40f1-bdc7-f87dde2c99df => generated 1605 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 19:11:15.518047 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-6b6c1815-fb0b-416c-87b1-2b89482d968d tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '790f3f1566b7464aaca19d4d05c0942e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33e3d319293c46b6af2f728a50586906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:11:15.542392 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-ec83c714-d051-4284-a216-49144861afd6 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:11:15.543845 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-ec83c714-d051-4284-a216-49144861afd6 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] [instance: ba6ffc5c-84a4-40f1-bdc7-f87dde2c99df] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:11:15.555081 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-6b6c1815-fb0b-416c-87b1-2b89482d968d tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] 10.222.0.13 "GET /compute/v2.1/servers/eced579f-beea-4d3c-b2b8-8a6b31f7829b" status: 200 len: 1679 microversion: 2.1 time: 1.595046 Nov 01 19:11:15.564911 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 2118/4162] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:11:13 2022] GET /compute/v2.1/servers/eced579f-beea-4d3c-b2b8-8a6b31f7829b => generated 1679 bytes in 1606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:11:15.575209 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-ec83c714-d051-4284-a216-49144861afd6 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:11:15.575923 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-ec83c714-d051-4284-a216-49144861afd6 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:11:15.576564 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-ec83c714-d051-4284-a216-49144861afd6 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:11:15.582027 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-ec83c714-d051-4284-a216-49144861afd6 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:11:15.582829 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-ec83c714-d051-4284-a216-49144861afd6 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:11:15.583574 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-ec83c714-d051-4284-a216-49144861afd6 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:11:15.858620 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-ec83c714-d051-4284-a216-49144861afd6 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd2105b0264b48d084d0e79cabff8bc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf4adda91364dab94830347c06e3957', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:11:15.896731 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-ec83c714-d051-4284-a216-49144861afd6 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd2105b0264b48d084d0e79cabff8bc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf4adda91364dab94830347c06e3957', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:11:15.902220 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-ec83c714-d051-4284-a216-49144861afd6 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd2105b0264b48d084d0e79cabff8bc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf4adda91364dab94830347c06e3957', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:11:15.906713 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-ec83c714-d051-4284-a216-49144861afd6 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] 10.222.0.13 "GET /compute/v2.1/servers/ba6ffc5c-84a4-40f1-bdc7-f87dde2c99df" status: 200 len: 1605 microversion: 2.32 time: 0.368183 Nov 01 19:11:15.908029 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 2045/4163] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 19:11:15 2022] GET /compute/v2.1/servers/ba6ffc5c-84a4-40f1-bdc7-f87dde2c99df => generated 1605 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 19:11:16.588559 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-857ad796-7237-4c25-9e63-b302920d92b6 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:11:16.590418 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-857ad796-7237-4c25-9e63-b302920d92b6 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] [instance: eced579f-beea-4d3c-b2b8-8a6b31f7829b] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:11:16.611017 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-857ad796-7237-4c25-9e63-b302920d92b6 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:11:16.612805 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-857ad796-7237-4c25-9e63-b302920d92b6 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:11:16.613547 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-857ad796-7237-4c25-9e63-b302920d92b6 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:11:16.618086 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-857ad796-7237-4c25-9e63-b302920d92b6 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:11:16.619262 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-857ad796-7237-4c25-9e63-b302920d92b6 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:11:16.620400 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-857ad796-7237-4c25-9e63-b302920d92b6 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:11:16.941885 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-2b56d8d9-5b77-4332-b2a7-0613cab4cc34 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:11:16.942643 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-2b56d8d9-5b77-4332-b2a7-0613cab4cc34 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] [instance: ba6ffc5c-84a4-40f1-bdc7-f87dde2c99df] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:11:16.974998 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2b56d8d9-5b77-4332-b2a7-0613cab4cc34 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:11:16.976053 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2b56d8d9-5b77-4332-b2a7-0613cab4cc34 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:11:16.978147 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2b56d8d9-5b77-4332-b2a7-0613cab4cc34 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:11:16.979477 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2b56d8d9-5b77-4332-b2a7-0613cab4cc34 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:11:16.980368 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2b56d8d9-5b77-4332-b2a7-0613cab4cc34 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:11:16.981181 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2b56d8d9-5b77-4332-b2a7-0613cab4cc34 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:11:17.307914 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-2b56d8d9-5b77-4332-b2a7-0613cab4cc34 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd2105b0264b48d084d0e79cabff8bc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf4adda91364dab94830347c06e3957', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:11:17.336667 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-2b56d8d9-5b77-4332-b2a7-0613cab4cc34 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd2105b0264b48d084d0e79cabff8bc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf4adda91364dab94830347c06e3957', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:11:17.341702 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-2b56d8d9-5b77-4332-b2a7-0613cab4cc34 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd2105b0264b48d084d0e79cabff8bc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf4adda91364dab94830347c06e3957', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:11:17.346874 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-2b56d8d9-5b77-4332-b2a7-0613cab4cc34 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] 10.222.0.13 "GET /compute/v2.1/servers/ba6ffc5c-84a4-40f1-bdc7-f87dde2c99df" status: 200 len: 1605 microversion: 2.32 time: 0.410238 Nov 01 19:11:17.352070 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-857ad796-7237-4c25-9e63-b302920d92b6 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '790f3f1566b7464aaca19d4d05c0942e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33e3d319293c46b6af2f728a50586906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:11:17.361159 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 2046/4164] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 19:11:16 2022] GET /compute/v2.1/servers/ba6ffc5c-84a4-40f1-bdc7-f87dde2c99df => generated 1605 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 19:11:17.363116 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-857ad796-7237-4c25-9e63-b302920d92b6 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] 10.222.0.13 "GET /compute/v2.1/servers/eced579f-beea-4d3c-b2b8-8a6b31f7829b" status: 200 len: 1679 microversion: 2.1 time: 0.779398 Nov 01 19:11:17.363695 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 2119/4165] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:11:16 2022] GET /compute/v2.1/servers/eced579f-beea-4d3c-b2b8-8a6b31f7829b => generated 1679 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:11:17.798048 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-c3d87bf1-6497-4e76-b29d-c4e12c6cc8ad tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] Action: 'create', calling method: .version_select at 0x7f0ae1ddd940>, body: {"keypair": {"name": "tempest-keypair-37306838", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFMTa+8nh+zDoJul4fxYNL/eLgEf4z3X0rj7fWrc7miMVmN507oD69aDcX55RUdecokeXryrOE70DMXuf5+aBQlFjtGsYXf6dFG8yXthcDnGPYgiKTm1ypeliOFuJ9cUiQ=="}} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:11:17.846570 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.quota [None req-c3d87bf1-6497-4e76-b29d-c4e12c6cc8ad tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] Getting quotas for project 73cb8697de6d407ba82c334d9f2b48d3. Resources: {'key_pairs'} {{(pid=121402) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 01 19:11:17.878295 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.quota [None req-c3d87bf1-6497-4e76-b29d-c4e12c6cc8ad tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] Getting quotas for user fcf93260eaef487dac5d7bb00b26e3b0 and project 73cb8697de6d407ba82c334d9f2b48d3. Resources: {'key_pairs'} {{(pid=121402) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 01 19:11:17.931278 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-c3d87bf1-6497-4e76-b29d-c4e12c6cc8ad tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.319356 Nov 01 19:11:17.932225 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 2047/4166] 10.222.0.13 () {60 vars in 1159 bytes} [Tue Nov 1 19:11:17 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:11:18.394941 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-d6be8d75-881c-4715-afd0-1e80b202e56f tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:11:18.396697 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-d6be8d75-881c-4715-afd0-1e80b202e56f tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] [instance: ba6ffc5c-84a4-40f1-bdc7-f87dde2c99df] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:11:18.399361 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-a8b019ee-c286-4f21-9341-55c090808294 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:11:18.400161 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-a8b019ee-c286-4f21-9341-55c090808294 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] [instance: eced579f-beea-4d3c-b2b8-8a6b31f7829b] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:11:18.413616 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-a8b019ee-c286-4f21-9341-55c090808294 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:11:18.414687 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-a8b019ee-c286-4f21-9341-55c090808294 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:11:18.418476 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d6be8d75-881c-4715-afd0-1e80b202e56f tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:11:18.418965 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-a8b019ee-c286-4f21-9341-55c090808294 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:11:18.419728 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-a8b019ee-c286-4f21-9341-55c090808294 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:11:18.420392 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-a8b019ee-c286-4f21-9341-55c090808294 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:11:18.421631 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-a8b019ee-c286-4f21-9341-55c090808294 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:11:18.422464 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d6be8d75-881c-4715-afd0-1e80b202e56f tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:11:18.424406 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d6be8d75-881c-4715-afd0-1e80b202e56f tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:11:18.425603 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d6be8d75-881c-4715-afd0-1e80b202e56f tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:11:18.427445 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d6be8d75-881c-4715-afd0-1e80b202e56f tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:11:18.428123 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d6be8d75-881c-4715-afd0-1e80b202e56f tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:11:18.694510 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-d6be8d75-881c-4715-afd0-1e80b202e56f tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd2105b0264b48d084d0e79cabff8bc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf4adda91364dab94830347c06e3957', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:11:18.709249 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-d6be8d75-881c-4715-afd0-1e80b202e56f tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd2105b0264b48d084d0e79cabff8bc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf4adda91364dab94830347c06e3957', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:11:18.714202 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-d6be8d75-881c-4715-afd0-1e80b202e56f tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd2105b0264b48d084d0e79cabff8bc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf4adda91364dab94830347c06e3957', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:11:18.715455 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-d6be8d75-881c-4715-afd0-1e80b202e56f tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] 10.222.0.13 "GET /compute/v2.1/servers/ba6ffc5c-84a4-40f1-bdc7-f87dde2c99df" status: 200 len: 1605 microversion: 2.32 time: 0.327787 Nov 01 19:11:18.720285 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-a8b019ee-c286-4f21-9341-55c090808294 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '790f3f1566b7464aaca19d4d05c0942e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33e3d319293c46b6af2f728a50586906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:11:18.729577 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-a8b019ee-c286-4f21-9341-55c090808294 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] 10.222.0.13 "GET /compute/v2.1/servers/eced579f-beea-4d3c-b2b8-8a6b31f7829b" status: 200 len: 1612 microversion: 2.1 time: 0.335723 Nov 01 19:11:18.730736 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 2048/4167] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:11:18 2022] GET /compute/v2.1/servers/eced579f-beea-4d3c-b2b8-8a6b31f7829b => generated 1612 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 19:11:18.737118 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 2120/4168] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 19:11:18 2022] GET /compute/v2.1/servers/ba6ffc5c-84a4-40f1-bdc7-f87dde2c99df => generated 1605 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 19:11:19.761528 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-67d8c48a-87d4-4b0d-8064-0d28645049c8 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:11:19.763435 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-67d8c48a-87d4-4b0d-8064-0d28645049c8 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] [instance: ba6ffc5c-84a4-40f1-bdc7-f87dde2c99df] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:11:19.765936 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-3399428e-b617-4046-9f9b-d87e91ca904b tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:11:19.767291 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-3399428e-b617-4046-9f9b-d87e91ca904b tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] [instance: eced579f-beea-4d3c-b2b8-8a6b31f7829b] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:11:19.776640 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-3399428e-b617-4046-9f9b-d87e91ca904b tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:11:19.779779 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-3399428e-b617-4046-9f9b-d87e91ca904b tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:11:19.781392 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-3399428e-b617-4046-9f9b-d87e91ca904b tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:11:19.783149 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-67d8c48a-87d4-4b0d-8064-0d28645049c8 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:11:19.784066 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-3399428e-b617-4046-9f9b-d87e91ca904b tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:11:19.784852 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-3399428e-b617-4046-9f9b-d87e91ca904b tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:11:19.785189 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-67d8c48a-87d4-4b0d-8064-0d28645049c8 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:11:19.785733 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-3399428e-b617-4046-9f9b-d87e91ca904b tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:11:19.786967 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-67d8c48a-87d4-4b0d-8064-0d28645049c8 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:11:19.789386 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-67d8c48a-87d4-4b0d-8064-0d28645049c8 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:11:19.791156 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-67d8c48a-87d4-4b0d-8064-0d28645049c8 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:11:19.793099 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-67d8c48a-87d4-4b0d-8064-0d28645049c8 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:11:19.967660 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-67d8c48a-87d4-4b0d-8064-0d28645049c8 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd2105b0264b48d084d0e79cabff8bc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf4adda91364dab94830347c06e3957', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:11:19.987060 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-67d8c48a-87d4-4b0d-8064-0d28645049c8 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd2105b0264b48d084d0e79cabff8bc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf4adda91364dab94830347c06e3957', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:11:19.990862 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-67d8c48a-87d4-4b0d-8064-0d28645049c8 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd2105b0264b48d084d0e79cabff8bc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf4adda91364dab94830347c06e3957', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:11:19.995754 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-67d8c48a-87d4-4b0d-8064-0d28645049c8 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] 10.222.0.13 "GET /compute/v2.1/servers/ba6ffc5c-84a4-40f1-bdc7-f87dde2c99df" status: 200 len: 1605 microversion: 2.32 time: 0.244480 Nov 01 19:11:20.010128 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 2049/4169] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 19:11:19 2022] GET /compute/v2.1/servers/ba6ffc5c-84a4-40f1-bdc7-f87dde2c99df => generated 1605 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 19:11:20.048199 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [req-d769b36a-b1c5-4e50-809d-50e09922ceda req-f3fab2ab-77e7-4735-b34e-4a2f25b874f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eced579f-beea-4d3c-b2b8-8a6b31f7829b", "name": "network-vif-deleted", "tag": "6c13aa9c-ab51-456c-9f28-6101db6d2168"}]} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:11:20.071362 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-d769b36a-b1c5-4e50-809d-50e09922ceda req-f3fab2ab-77e7-4735-b34e-4a2f25b874f9 service nova] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:11:20.071362 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-d769b36a-b1c5-4e50-809d-50e09922ceda req-f3fab2ab-77e7-4735-b34e-4a2f25b874f9 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:11:20.071362 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-d769b36a-b1c5-4e50-809d-50e09922ceda req-f3fab2ab-77e7-4735-b34e-4a2f25b874f9 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:11:20.099659 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.compute.server_external_events [req-d769b36a-b1c5-4e50-809d-50e09922ceda req-f3fab2ab-77e7-4735-b34e-4a2f25b874f9 service nova] Creating event network-vif-deleted:6c13aa9c-ab51-456c-9f28-6101db6d2168 for instance eced579f-beea-4d3c-b2b8-8a6b31f7829b on n-h2-863052-2 Nov 01 19:11:20.116402 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [req-d769b36a-b1c5-4e50-809d-50e09922ceda req-f3fab2ab-77e7-4735-b34e-4a2f25b874f9 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072377 Nov 01 19:11:20.120096 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-3399428e-b617-4046-9f9b-d87e91ca904b tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '790f3f1566b7464aaca19d4d05c0942e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33e3d319293c46b6af2f728a50586906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:11:20.127966 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 2050/4170] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Nov 1 19:11:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:11:20.135399 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-3399428e-b617-4046-9f9b-d87e91ca904b tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] 10.222.0.13 "GET /compute/v2.1/servers/eced579f-beea-4d3c-b2b8-8a6b31f7829b" status: 200 len: 1612 microversion: 2.1 time: 0.370877 Nov 01 19:11:20.136392 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 2121/4171] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:11:19 2022] GET /compute/v2.1/servers/eced579f-beea-4d3c-b2b8-8a6b31f7829b => generated 1612 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:11:21.030699 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-b7708bf2-2c99-4641-98fb-3d6a4b44a966 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:11:21.032929 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-b7708bf2-2c99-4641-98fb-3d6a4b44a966 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] [instance: ba6ffc5c-84a4-40f1-bdc7-f87dde2c99df] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:11:21.049017 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b7708bf2-2c99-4641-98fb-3d6a4b44a966 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:11:21.049747 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b7708bf2-2c99-4641-98fb-3d6a4b44a966 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:11:21.050360 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b7708bf2-2c99-4641-98fb-3d6a4b44a966 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:11:21.051456 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b7708bf2-2c99-4641-98fb-3d6a4b44a966 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:11:21.052081 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b7708bf2-2c99-4641-98fb-3d6a4b44a966 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:11:21.061681 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b7708bf2-2c99-4641-98fb-3d6a4b44a966 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:11:21.275319 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-066294f6-ce6d-4179-b802-2a79bb7f924f tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-2049227473", "imageRef": "2d4a0047-1b9e-445f-8af8-1b5c9d93e881", "flavorRef": "452", "networks": [{"uuid": "f2fc603f-a5ab-4120-939f-124d49e1f7c1"}]}} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:11:21.390341 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.network.neutron [None req-066294f6-ce6d-4179-b802-2a79bb7f924f tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] validate_networks() for [('f2fc603f-a5ab-4120-939f-124d49e1f7c1', None, None, None, None, None)] {{(pid=121403) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 01 19:11:21.885399 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-b7708bf2-2c99-4641-98fb-3d6a4b44a966 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd2105b0264b48d084d0e79cabff8bc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf4adda91364dab94830347c06e3957', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:11:21.903025 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-b7708bf2-2c99-4641-98fb-3d6a4b44a966 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd2105b0264b48d084d0e79cabff8bc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf4adda91364dab94830347c06e3957', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:11:21.904955 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-b7708bf2-2c99-4641-98fb-3d6a4b44a966 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd2105b0264b48d084d0e79cabff8bc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf4adda91364dab94830347c06e3957', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:11:21.908686 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-b7708bf2-2c99-4641-98fb-3d6a4b44a966 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] 10.222.0.13 "GET /compute/v2.1/servers/ba6ffc5c-84a4-40f1-bdc7-f87dde2c99df" status: 200 len: 1605 microversion: 2.32 time: 0.887658 Nov 01 19:11:21.910825 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 2051/4172] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 19:11:21 2022] GET /compute/v2.1/servers/ba6ffc5c-84a4-40f1-bdc7-f87dde2c99df => generated 1605 bytes in 891 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 19:11:21.929467 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-b023efa0-788b-46ff-b8de-a7e74cb94250 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:11:21.930686 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-b023efa0-788b-46ff-b8de-a7e74cb94250 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] [instance: eced579f-beea-4d3c-b2b8-8a6b31f7829b] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:11:21.949142 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b023efa0-788b-46ff-b8de-a7e74cb94250 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:11:21.951950 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b023efa0-788b-46ff-b8de-a7e74cb94250 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:11:21.953796 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b023efa0-788b-46ff-b8de-a7e74cb94250 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:11:21.959985 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b023efa0-788b-46ff-b8de-a7e74cb94250 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:11:21.960962 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b023efa0-788b-46ff-b8de-a7e74cb94250 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:11:21.961643 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b023efa0-788b-46ff-b8de-a7e74cb94250 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:11:22.015165 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.wsgi [None req-b023efa0-788b-46ff-b8de-a7e74cb94250 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] HTTP exception thrown: Instance eced579f-beea-4d3c-b2b8-8a6b31f7829b could not be found. Nov 01 19:11:22.019498 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-b023efa0-788b-46ff-b8de-a7e74cb94250 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Request method failure captured: Nov 01 19:11:22.019498 n-d-863052-2 devstack@n-api.service[121402]: request: GET /compute/v2.1/servers/eced579f-beea-4d3c-b2b8-8a6b31f7829b HTTP/1.1 Nov 01 19:11:22.019498 n-d-863052-2 devstack@n-api.service[121402]: Accept: application/json Nov 01 19:11:22.019498 n-d-863052-2 devstack@n-api.service[121402]: Accept-Encoding: identity Nov 01 19:11:22.019498 n-d-863052-2 devstack@n-api.service[121402]: Connection: close Nov 01 19:11:22.019498 n-d-863052-2 devstack@n-api.service[121402]: Content-Length: 0 Nov 01 19:11:22.019498 n-d-863052-2 devstack@n-api.service[121402]: Content-Type: application/json Nov 01 19:11:22.019498 n-d-863052-2 devstack@n-api.service[121402]: Host: 10.222.0.13 Nov 01 19:11:22.019498 n-d-863052-2 devstack@n-api.service[121402]: Openstack-System-Scope: None Nov 01 19:11:22.019498 n-d-863052-2 devstack@n-api.service[121402]: User-Agent: python-urllib3/1.26.12 Nov 01 19:11:22.019498 n-d-863052-2 devstack@n-api.service[121402]: X-Auth-Token: gAAAAABjYW26-niUURjtSz2aypPDgkYX79sMl0CZOJW_ml_lGFRo-4lOtvHbbGMI0UBaScGrQfLye0e0L4c10ym8MikDvB1h-T3Rh6fQQzcKLxsRSm1saxobVhs9el4Qiq-2aZx04HWuIjPot0FuuMjXsFtl108kYD3rs-RWb4TVydSfipjFJKk Nov 01 19:11:22.019498 n-d-863052-2 devstack@n-api.service[121402]: X-Domain-Id: None Nov 01 19:11:22.019498 n-d-863052-2 devstack@n-api.service[121402]: X-Domain-Name: None Nov 01 19:11:22.019498 n-d-863052-2 devstack@n-api.service[121402]: X-Identity-Status: Confirmed Nov 01 19:11:22.019498 n-d-863052-2 devstack@n-api.service[121402]: X-Is-Admin-Project: True Nov 01 19:11:22.019498 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Domain-Id: default Nov 01 19:11:22.019498 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Domain-Name: Default Nov 01 19:11:22.019498 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Id: 33e3d319293c46b6af2f728a50586906 Nov 01 19:11:22.019498 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Name: tempest-AttachVolumeNegativeTest-517167560 Nov 01 19:11:22.019498 n-d-863052-2 devstack@n-api.service[121402]: X-Role: member,reader Nov 01 19:11:22.019498 n-d-863052-2 devstack@n-api.service[121402]: X-Roles: member,reader Nov 01 19:11:22.019498 n-d-863052-2 devstack@n-api.service[121402]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/33e3d319293c46b6af2f728a50586906"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/33e3d319293c46b6af2f728a50586906"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_33e3d319293c46b6af2f728a50586906", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/33e3d319293c46b6af2f728a50586906"}]}] Nov 01 19:11:22.019498 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant: tempest-AttachVolumeNegativeTest-517167560 Nov 01 19:11:22.019498 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant-Id: 33e3d319293c46b6af2f728a50586906 Nov 01 19:11:22.019498 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-517167560 Nov 01 19:11:22.019498 n-d-863052-2 devstack@n-api.service[121402]: X-User: tempest-AttachVolumeNegativeTest-517167560-project Nov 01 19:11:22.019498 n-d-863052-2 devstack@n-api.service[121402]: X-User-Domain-Id: default Nov 01 19:11:22.019498 n-d-863052-2 devstack@n-api.service[121402]: X-User-Domain-Name: Default Nov 01 19:11:22.019498 n-d-863052-2 devstack@n-api.service[121402]: X-User-Id: 790f3f1566b7464aaca19d4d05c0942e Nov 01 19:11:22.019498 n-d-863052-2 devstack@n-api.service[121402]: X-User-Name: tempest-AttachVolumeNegativeTest-517167560-project Nov 01 19:11:22.019498 n-d-863052-2 devstack@n-api.service[121402]: method: > Nov 01 19:11:22.019498 n-d-863052-2 devstack@n-api.service[121402]: exception: Instance eced579f-beea-4d3c-b2b8-8a6b31f7829b could not be found. Nov 01 19:11:22.019498 n-d-863052-2 devstack@n-api.service[121402]: action_args: {'id': 'eced579f-beea-4d3c-b2b8-8a6b31f7829b'} Nov 01 19:11:22.019498 n-d-863052-2 devstack@n-api.service[121402]: {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 01 19:11:22.019498 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:11:22.019498 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 01 19:11:22.019498 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 01 19:11:22.019498 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 01 19:11:22.019498 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 01 19:11:22.019498 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 01 19:11:22.019498 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 01 19:11:22.019498 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 01 19:11:22.019498 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 01 19:11:22.019498 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eced579f-beea-4d3c-b2b8-8a6b31f7829b could not be found. Nov 01 19:11:22.019498 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:11:22.019498 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:11:22.019498 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:11:22.019498 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:11:22.019498 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:11:22.019498 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:11:22.019498 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 01 19:11:22.019498 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 01 19:11:22.019498 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 01 19:11:22.019498 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 01 19:11:22.019498 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 01 19:11:22.019498 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 01 19:11:22.019498 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 01 19:11:22.019498 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 01 19:11:22.019498 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 01 19:11:22.019498 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 01 19:11:22.019498 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eced579f-beea-4d3c-b2b8-8a6b31f7829b could not be found. Nov 01 19:11:22.019498 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:11:22.019498 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:11:22.019498 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:11:22.024777 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:11:22.024777 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:11:22.024777 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:11:22.024777 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 01 19:11:22.024777 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 01 19:11:22.024777 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eced579f-beea-4d3c-b2b8-8a6b31f7829b could not be found. Nov 01 19:11:22.024777 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:11:22.024777 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-b023efa0-788b-46ff-b8de-a7e74cb94250 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Returning 404 to user: Instance eced579f-beea-4d3c-b2b8-8a6b31f7829b could not be found. {{(pid=121402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 01 19:11:22.024777 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-b023efa0-788b-46ff-b8de-a7e74cb94250 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] 10.222.0.13 "GET /compute/v2.1/servers/eced579f-beea-4d3c-b2b8-8a6b31f7829b" status: 404 len: 111 microversion: 2.1 time: 0.109843 Nov 01 19:11:22.024777 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 2052/4173] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:11:21 2022] GET /compute/v2.1/servers/eced579f-beea-4d3c-b2b8-8a6b31f7829b => generated 111 bytes in 111 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 01 19:11:22.033484 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-14f00a3f-465b-44ac-b841-0ca42bc2658b tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Calling method '.version_select at 0x7f0ae1d75940>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:11:22.060697 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-14f00a3f-465b-44ac-b841-0ca42bc2658b tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-545523049" status: 202 len: 0 microversion: 2.1 time: 0.030696 Nov 01 19:11:22.062228 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 2053/4174] 10.222.0.13 () {58 vars in 1218 bytes} [Tue Nov 1 19:11:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-545523049 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 01 19:11:22.942639 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-279ae778-2a1d-4c17-84c0-98cc6dc4b520 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:11:22.944205 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-279ae778-2a1d-4c17-84c0-98cc6dc4b520 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] [instance: ba6ffc5c-84a4-40f1-bdc7-f87dde2c99df] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:11:23.010807 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-279ae778-2a1d-4c17-84c0-98cc6dc4b520 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:11:23.027103 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-279ae778-2a1d-4c17-84c0-98cc6dc4b520 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.023s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:11:23.030108 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-279ae778-2a1d-4c17-84c0-98cc6dc4b520 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:11:23.031227 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-279ae778-2a1d-4c17-84c0-98cc6dc4b520 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:11:23.036640 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-279ae778-2a1d-4c17-84c0-98cc6dc4b520 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:11:23.037271 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-279ae778-2a1d-4c17-84c0-98cc6dc4b520 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:11:23.169713 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-279ae778-2a1d-4c17-84c0-98cc6dc4b520 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd2105b0264b48d084d0e79cabff8bc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf4adda91364dab94830347c06e3957', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:11:23.185583 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-279ae778-2a1d-4c17-84c0-98cc6dc4b520 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd2105b0264b48d084d0e79cabff8bc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf4adda91364dab94830347c06e3957', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:11:23.187627 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-279ae778-2a1d-4c17-84c0-98cc6dc4b520 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd2105b0264b48d084d0e79cabff8bc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf4adda91364dab94830347c06e3957', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:11:23.202987 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-279ae778-2a1d-4c17-84c0-98cc6dc4b520 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] 10.222.0.13 "GET /compute/v2.1/servers/ba6ffc5c-84a4-40f1-bdc7-f87dde2c99df" status: 200 len: 1605 microversion: 2.32 time: 0.264572 Nov 01 19:11:23.207595 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 2054/4175] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 19:11:22 2022] GET /compute/v2.1/servers/ba6ffc5c-84a4-40f1-bdc7-f87dde2c99df => generated 1605 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 01 19:11:23.569380 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.virt.hardware [None req-066294f6-ce6d-4179-b802-2a79bb7f924f tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Flavor limits 0:0:0 {{(pid=121403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 01 19:11:23.569886 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.virt.hardware [None req-066294f6-ce6d-4179-b802-2a79bb7f924f tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Image limits 0:0:0 {{(pid=121403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 01 19:11:23.570305 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.virt.hardware [None req-066294f6-ce6d-4179-b802-2a79bb7f924f tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Flavor pref 0:0:0 {{(pid=121403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 01 19:11:23.570718 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.virt.hardware [None req-066294f6-ce6d-4179-b802-2a79bb7f924f tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Image pref 0:0:0 {{(pid=121403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 01 19:11:23.571126 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.virt.hardware [None req-066294f6-ce6d-4179-b802-2a79bb7f924f tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 01 19:11:23.604507 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-066294f6-ce6d-4179-b802-2a79bb7f924f tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:11:23.617659 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-066294f6-ce6d-4179-b802-2a79bb7f924f tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:11:23.629047 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-066294f6-ce6d-4179-b802-2a79bb7f924f tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:11:23.634100 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-066294f6-ce6d-4179-b802-2a79bb7f924f tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:11:23.634936 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-066294f6-ce6d-4179-b802-2a79bb7f924f tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:11:23.641382 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-066294f6-ce6d-4179-b802-2a79bb7f924f tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:11:23.817014 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.quota [None req-066294f6-ce6d-4179-b802-2a79bb7f924f tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Getting quotas for project 9ecdc83933544a899117531a960027a7. Resources: {'cores', 'ram', 'instances'} {{(pid=121403) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 01 19:11:23.840542 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.quota [None req-066294f6-ce6d-4179-b802-2a79bb7f924f tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Getting quotas for user 3fc5c19b930543f5a5091922a9859813 and project 9ecdc83933544a899117531a960027a7. Resources: {'cores', 'ram', 'instances'} {{(pid=121403) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 01 19:11:23.921820 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-066294f6-ce6d-4179-b802-2a79bb7f924f tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Going to run 1 instances... {{(pid=121403) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 01 19:11:23.958367 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-066294f6-ce6d-4179-b802-2a79bb7f924f tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] [instance: b27eaab4-a751-47fb-acdb-db7c99b06a5f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2d4a0047-1b9e-445f-8af8-1b5c9d93e881',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121403) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 01 19:11:24.136555 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-066294f6-ce6d-4179-b802-2a79bb7f924f tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.014015 Nov 01 19:11:24.137534 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 2122/4176] 10.222.0.13 () {60 vars in 1147 bytes} [Tue Nov 1 19:11:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 3016 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 01 19:11:24.150411 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-7fbb435e-e0f1-4088-97bc-10a3cb4c9a9a tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:11:24.151038 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-7fbb435e-e0f1-4088-97bc-10a3cb4c9a9a tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] [instance: b27eaab4-a751-47fb-acdb-db7c99b06a5f] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:11:24.234812 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-38803549-b1ae-4073-bd0c-ce386916b4ff tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:11:24.236628 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-38803549-b1ae-4073-bd0c-ce386916b4ff tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] [instance: ba6ffc5c-84a4-40f1-bdc7-f87dde2c99df] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:11:24.258343 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-38803549-b1ae-4073-bd0c-ce386916b4ff tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:11:24.259738 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-38803549-b1ae-4073-bd0c-ce386916b4ff tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:11:24.262838 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-38803549-b1ae-4073-bd0c-ce386916b4ff tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:11:24.263853 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-38803549-b1ae-4073-bd0c-ce386916b4ff tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:11:24.267643 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-38803549-b1ae-4073-bd0c-ce386916b4ff tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:11:24.268338 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-38803549-b1ae-4073-bd0c-ce386916b4ff tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:11:24.353897 n-d-863052-2 devstack@n-api.service[121403]: DEBUG dbcounter [-] [121403] Writing DB stats nova_cell1:SELECT=100 {{(pid=121403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 19:11:24.474008 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-7fbb435e-e0f1-4088-97bc-10a3cb4c9a9a tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc5c19b930543f5a5091922a9859813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ecdc83933544a899117531a960027a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:11:24.498239 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-7fbb435e-e0f1-4088-97bc-10a3cb4c9a9a tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] 10.222.0.13 "GET /compute/v2.1/servers/b27eaab4-a751-47fb-acdb-db7c99b06a5f" status: 200 len: 1217 microversion: 2.1 time: 0.352396 Nov 01 19:11:24.499970 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 2055/4177] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:11:24 2022] GET /compute/v2.1/servers/b27eaab4-a751-47fb-acdb-db7c99b06a5f => generated 1217 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:11:24.531431 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-38803549-b1ae-4073-bd0c-ce386916b4ff tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd2105b0264b48d084d0e79cabff8bc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf4adda91364dab94830347c06e3957', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:11:24.542163 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-38803549-b1ae-4073-bd0c-ce386916b4ff tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd2105b0264b48d084d0e79cabff8bc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf4adda91364dab94830347c06e3957', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:11:24.543746 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-38803549-b1ae-4073-bd0c-ce386916b4ff tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd2105b0264b48d084d0e79cabff8bc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf4adda91364dab94830347c06e3957', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:11:24.545109 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-38803549-b1ae-4073-bd0c-ce386916b4ff tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] 10.222.0.13 "GET /compute/v2.1/servers/ba6ffc5c-84a4-40f1-bdc7-f87dde2c99df" status: 200 len: 1605 microversion: 2.32 time: 0.317892 Nov 01 19:11:24.546934 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 2123/4178] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 19:11:24 2022] GET /compute/v2.1/servers/ba6ffc5c-84a4-40f1-bdc7-f87dde2c99df => generated 1605 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 01 19:11:25.532968 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-bc0820a6-4278-4bb7-a4cc-c1fc4dfd81e5 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:11:25.534381 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-bc0820a6-4278-4bb7-a4cc-c1fc4dfd81e5 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] [instance: b27eaab4-a751-47fb-acdb-db7c99b06a5f] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:11:25.573976 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-380d2c06-d95b-4466-a7dd-272cc9b7da9e tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:11:25.575342 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-380d2c06-d95b-4466-a7dd-272cc9b7da9e tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] [instance: ba6ffc5c-84a4-40f1-bdc7-f87dde2c99df] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:11:25.592323 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-380d2c06-d95b-4466-a7dd-272cc9b7da9e tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:11:25.609072 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-380d2c06-d95b-4466-a7dd-272cc9b7da9e tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:11:25.609677 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-380d2c06-d95b-4466-a7dd-272cc9b7da9e tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:11:25.610460 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-380d2c06-d95b-4466-a7dd-272cc9b7da9e tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:11:25.610911 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-380d2c06-d95b-4466-a7dd-272cc9b7da9e tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:11:25.611330 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-380d2c06-d95b-4466-a7dd-272cc9b7da9e tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:11:25.871097 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-bc0820a6-4278-4bb7-a4cc-c1fc4dfd81e5 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc5c19b930543f5a5091922a9859813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ecdc83933544a899117531a960027a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:11:25.902580 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-bc0820a6-4278-4bb7-a4cc-c1fc4dfd81e5 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] 10.222.0.13 "GET /compute/v2.1/servers/b27eaab4-a751-47fb-acdb-db7c99b06a5f" status: 200 len: 1217 microversion: 2.1 time: 0.375315 Nov 01 19:11:25.903558 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 2056/4179] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:11:25 2022] GET /compute/v2.1/servers/b27eaab4-a751-47fb-acdb-db7c99b06a5f => generated 1217 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:11:25.986752 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-380d2c06-d95b-4466-a7dd-272cc9b7da9e tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd2105b0264b48d084d0e79cabff8bc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf4adda91364dab94830347c06e3957', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:11:26.003635 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-380d2c06-d95b-4466-a7dd-272cc9b7da9e tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd2105b0264b48d084d0e79cabff8bc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf4adda91364dab94830347c06e3957', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:11:26.005669 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-380d2c06-d95b-4466-a7dd-272cc9b7da9e tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd2105b0264b48d084d0e79cabff8bc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf4adda91364dab94830347c06e3957', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:11:26.009472 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-380d2c06-d95b-4466-a7dd-272cc9b7da9e tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] 10.222.0.13 "GET /compute/v2.1/servers/ba6ffc5c-84a4-40f1-bdc7-f87dde2c99df" status: 200 len: 1605 microversion: 2.32 time: 0.440616 Nov 01 19:11:26.034940 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 2124/4180] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 19:11:25 2022] GET /compute/v2.1/servers/ba6ffc5c-84a4-40f1-bdc7-f87dde2c99df => generated 1605 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 19:11:26.157678 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-4df5f8b1-945f-41b8-9c58-19ec51e21679 tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-435709347", "imageRef": "2d4a0047-1b9e-445f-8af8-1b5c9d93e881", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "9a835c47-8612-41f7-8959-1149e26b66e0"}], "security_groups": [{"name": "tempest-securitygroup--388945234"}], "key_name": "tempest-keypair-37306838", "user_data": "}} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:11:26.931582 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-f452ec66-6587-4e45-869e-d5cc3fc6158b tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:11:26.932182 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-f452ec66-6587-4e45-869e-d5cc3fc6158b tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] [instance: b27eaab4-a751-47fb-acdb-db7c99b06a5f] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:11:26.951565 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f452ec66-6587-4e45-869e-d5cc3fc6158b tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:11:26.956991 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f452ec66-6587-4e45-869e-d5cc3fc6158b tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:11:26.963479 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f452ec66-6587-4e45-869e-d5cc3fc6158b tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:11:26.964315 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f452ec66-6587-4e45-869e-d5cc3fc6158b tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:11:26.964708 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f452ec66-6587-4e45-869e-d5cc3fc6158b tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:11:26.965128 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f452ec66-6587-4e45-869e-d5cc3fc6158b tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:11:27.043997 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.network.neutron [None req-4df5f8b1-945f-41b8-9c58-19ec51e21679 tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] validate_networks() for [('9a835c47-8612-41f7-8959-1149e26b66e0', None, None, None, None, None)] {{(pid=121402) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 01 19:11:27.424035 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-f452ec66-6587-4e45-869e-d5cc3fc6158b tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc5c19b930543f5a5091922a9859813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ecdc83933544a899117531a960027a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:11:27.435820 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-f452ec66-6587-4e45-869e-d5cc3fc6158b tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] 10.222.0.13 "GET /compute/v2.1/servers/b27eaab4-a751-47fb-acdb-db7c99b06a5f" status: 200 len: 1277 microversion: 2.1 time: 0.508004 Nov 01 19:11:27.437037 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 2125/4181] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:11:26 2022] GET /compute/v2.1/servers/b27eaab4-a751-47fb-acdb-db7c99b06a5f => generated 1277 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 19:11:27.455465 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-8efbdae8-3fe3-4e6e-b50a-c011d5d5232a tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:11:27.463710 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-8efbdae8-3fe3-4e6e-b50a-c011d5d5232a tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] [instance: ba6ffc5c-84a4-40f1-bdc7-f87dde2c99df] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:11:27.482086 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-8efbdae8-3fe3-4e6e-b50a-c011d5d5232a tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:11:27.482747 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-8efbdae8-3fe3-4e6e-b50a-c011d5d5232a tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:11:27.483017 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-8efbdae8-3fe3-4e6e-b50a-c011d5d5232a tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:11:27.483728 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-8efbdae8-3fe3-4e6e-b50a-c011d5d5232a tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:11:27.484184 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-8efbdae8-3fe3-4e6e-b50a-c011d5d5232a tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:11:27.511657 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-8efbdae8-3fe3-4e6e-b50a-c011d5d5232a tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:11:27.844553 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-8efbdae8-3fe3-4e6e-b50a-c011d5d5232a tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd2105b0264b48d084d0e79cabff8bc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf4adda91364dab94830347c06e3957', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:11:27.858121 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-8efbdae8-3fe3-4e6e-b50a-c011d5d5232a tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd2105b0264b48d084d0e79cabff8bc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf4adda91364dab94830347c06e3957', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:11:27.859879 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-8efbdae8-3fe3-4e6e-b50a-c011d5d5232a tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd2105b0264b48d084d0e79cabff8bc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf4adda91364dab94830347c06e3957', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:11:27.861370 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-8efbdae8-3fe3-4e6e-b50a-c011d5d5232a tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] 10.222.0.13 "GET /compute/v2.1/servers/ba6ffc5c-84a4-40f1-bdc7-f87dde2c99df" status: 200 len: 1605 microversion: 2.32 time: 0.423085 Nov 01 19:11:27.877926 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 2126/4182] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 19:11:27 2022] GET /compute/v2.1/servers/ba6ffc5c-84a4-40f1-bdc7-f87dde2c99df => generated 1605 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 19:11:27.896555 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-028ceb9b-0b78-411d-8ffa-5e60c063bd96 tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:11:27.897471 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-028ceb9b-0b78-411d-8ffa-5e60c063bd96 tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] [instance: 03d4513b-9e04-4924-8654-1de3748e333e] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:11:27.909545 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-028ceb9b-0b78-411d-8ffa-5e60c063bd96 tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:11:27.910306 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-028ceb9b-0b78-411d-8ffa-5e60c063bd96 tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:11:27.910914 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-028ceb9b-0b78-411d-8ffa-5e60c063bd96 tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:11:27.912831 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-028ceb9b-0b78-411d-8ffa-5e60c063bd96 tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:11:27.925163 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-028ceb9b-0b78-411d-8ffa-5e60c063bd96 tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:11:27.926475 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-028ceb9b-0b78-411d-8ffa-5e60c063bd96 tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:11:27.968257 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-028ceb9b-0b78-411d-8ffa-5e60c063bd96 tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] [instance: 03d4513b-9e04-4924-8654-1de3748e333e] Going to try to terminate instance {{(pid=121403) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 01 19:11:28.173189 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-028ceb9b-0b78-411d-8ffa-5e60c063bd96 tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] 10.222.0.13 "DELETE /compute/v2.1/servers/03d4513b-9e04-4924-8654-1de3748e333e" status: 204 len: 0 microversion: 2.1 time: 0.293249 Nov 01 19:11:28.173793 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 2127/4183] 10.222.0.13 () {58 vars in 1239 bytes} [Tue Nov 1 19:11:27 2022] DELETE /compute/v2.1/servers/03d4513b-9e04-4924-8654-1de3748e333e => generated 0 bytes in 295 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 01 19:11:28.193615 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-a5134b86-78d1-4176-9889-9194c324c078 tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:11:28.194831 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-a5134b86-78d1-4176-9889-9194c324c078 tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] [instance: 03d4513b-9e04-4924-8654-1de3748e333e] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:11:28.217071 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-a5134b86-78d1-4176-9889-9194c324c078 tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:11:28.217760 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-a5134b86-78d1-4176-9889-9194c324c078 tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:11:28.218373 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-a5134b86-78d1-4176-9889-9194c324c078 tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:11:28.219315 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-a5134b86-78d1-4176-9889-9194c324c078 tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:11:28.219983 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-a5134b86-78d1-4176-9889-9194c324c078 tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:11:28.220614 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-a5134b86-78d1-4176-9889-9194c324c078 tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:11:28.261716 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.virt.hardware [None req-4df5f8b1-945f-41b8-9c58-19ec51e21679 tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] Flavor limits 0:0:0 {{(pid=121402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 01 19:11:28.263476 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.virt.hardware [None req-4df5f8b1-945f-41b8-9c58-19ec51e21679 tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] Image limits 0:0:0 {{(pid=121402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 01 19:11:28.264159 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.virt.hardware [None req-4df5f8b1-945f-41b8-9c58-19ec51e21679 tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] Flavor pref 0:0:0 {{(pid=121402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 01 19:11:28.265001 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.virt.hardware [None req-4df5f8b1-945f-41b8-9c58-19ec51e21679 tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] Image pref 0:0:0 {{(pid=121402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 01 19:11:28.265669 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.virt.hardware [None req-4df5f8b1-945f-41b8-9c58-19ec51e21679 tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 01 19:11:28.279906 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-4df5f8b1-945f-41b8-9c58-19ec51e21679 tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:11:28.282130 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-4df5f8b1-945f-41b8-9c58-19ec51e21679 tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:11:28.282763 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-4df5f8b1-945f-41b8-9c58-19ec51e21679 tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:11:28.283933 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-4df5f8b1-945f-41b8-9c58-19ec51e21679 tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:11:28.284643 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-4df5f8b1-945f-41b8-9c58-19ec51e21679 tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:11:28.285449 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-4df5f8b1-945f-41b8-9c58-19ec51e21679 tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:11:28.345776 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.quota [None req-4df5f8b1-945f-41b8-9c58-19ec51e21679 tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] Getting quotas for project 73cb8697de6d407ba82c334d9f2b48d3. Resources: {'cores', 'ram', 'instances'} {{(pid=121402) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 01 19:11:28.370651 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.quota [None req-4df5f8b1-945f-41b8-9c58-19ec51e21679 tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] Getting quotas for user fcf93260eaef487dac5d7bb00b26e3b0 and project 73cb8697de6d407ba82c334d9f2b48d3. Resources: {'cores', 'ram', 'instances'} {{(pid=121402) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 01 19:11:28.405251 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-4df5f8b1-945f-41b8-9c58-19ec51e21679 tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] Going to run 1 instances... {{(pid=121402) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 01 19:11:28.411451 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-4df5f8b1-945f-41b8-9c58-19ec51e21679 tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] [instance: cae1c729-7c41-488d-ab0e-30d1f5d22180] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2d4a0047-1b9e-445f-8af8-1b5c9d93e881',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121402) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 01 19:11:28.499562 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-4df5f8b1-945f-41b8-9c58-19ec51e21679 tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 2.346853 Nov 01 19:11:28.509553 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 2057/4184] 10.222.0.13 () {60 vars in 1147 bytes} [Tue Nov 1 19:11:26 2022] POST /compute/v2.1/servers => generated 408 bytes in 2358 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 01 19:11:28.516022 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-12241a9c-b7e1-4388-a851-e155990015b4 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:11:28.517113 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-12241a9c-b7e1-4388-a851-e155990015b4 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] [instance: b27eaab4-a751-47fb-acdb-db7c99b06a5f] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:11:28.530625 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-12241a9c-b7e1-4388-a851-e155990015b4 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:11:28.535356 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-12241a9c-b7e1-4388-a851-e155990015b4 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:11:28.536118 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-12241a9c-b7e1-4388-a851-e155990015b4 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:11:28.537444 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-12241a9c-b7e1-4388-a851-e155990015b4 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:11:28.538294 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-12241a9c-b7e1-4388-a851-e155990015b4 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:11:28.539829 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-12241a9c-b7e1-4388-a851-e155990015b4 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:11:28.775145 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-12241a9c-b7e1-4388-a851-e155990015b4 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc5c19b930543f5a5091922a9859813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ecdc83933544a899117531a960027a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:11:28.780237 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-a5134b86-78d1-4176-9889-9194c324c078 tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c72e7e000a9a4fa49474bd5d19accf77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d8835c7b6754bfd81447b1f8893e56c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:11:28.794348 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-a5134b86-78d1-4176-9889-9194c324c078 tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] 10.222.0.13 "GET /compute/v2.1/servers/03d4513b-9e04-4924-8654-1de3748e333e" status: 200 len: 1682 microversion: 2.1 time: 0.610806 Nov 01 19:11:28.797280 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 2128/4185] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:11:28 2022] GET /compute/v2.1/servers/03d4513b-9e04-4924-8654-1de3748e333e => generated 1682 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:11:28.803242 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-12241a9c-b7e1-4388-a851-e155990015b4 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] 10.222.0.13 "GET /compute/v2.1/servers/b27eaab4-a751-47fb-acdb-db7c99b06a5f" status: 200 len: 1275 microversion: 2.1 time: 0.284655 Nov 01 19:11:28.804489 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 2058/4186] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:11:28 2022] GET /compute/v2.1/servers/b27eaab4-a751-47fb-acdb-db7c99b06a5f => generated 1275 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:11:28.809084 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-b8cf33f8-00c8-492b-a404-a6aba9a048ba tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:11:28.812884 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-b8cf33f8-00c8-492b-a404-a6aba9a048ba tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] [instance: cae1c729-7c41-488d-ab0e-30d1f5d22180] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:11:28.895665 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-3e93a68a-1526-4178-80e1-dc5fa2e5f15c tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:11:28.896844 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-3e93a68a-1526-4178-80e1-dc5fa2e5f15c tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] [instance: ba6ffc5c-84a4-40f1-bdc7-f87dde2c99df] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:11:28.916866 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-3e93a68a-1526-4178-80e1-dc5fa2e5f15c tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:11:28.927144 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-3e93a68a-1526-4178-80e1-dc5fa2e5f15c tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:11:28.927960 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-3e93a68a-1526-4178-80e1-dc5fa2e5f15c tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:11:28.929010 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-3e93a68a-1526-4178-80e1-dc5fa2e5f15c tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:11:28.930252 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-3e93a68a-1526-4178-80e1-dc5fa2e5f15c tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:11:28.930864 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-3e93a68a-1526-4178-80e1-dc5fa2e5f15c tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:11:29.077097 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-b8cf33f8-00c8-492b-a404-a6aba9a048ba tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcf93260eaef487dac5d7bb00b26e3b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73cb8697de6d407ba82c334d9f2b48d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:11:29.085384 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-b8cf33f8-00c8-492b-a404-a6aba9a048ba tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] 10.222.0.13 "GET /compute/v2.1/servers/cae1c729-7c41-488d-ab0e-30d1f5d22180" status: 200 len: 1236 microversion: 2.1 time: 0.285800 Nov 01 19:11:29.092922 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 2129/4187] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:11:28 2022] GET /compute/v2.1/servers/cae1c729-7c41-488d-ab0e-30d1f5d22180 => generated 1236 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:11:29.184348 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-3e93a68a-1526-4178-80e1-dc5fa2e5f15c tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd2105b0264b48d084d0e79cabff8bc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf4adda91364dab94830347c06e3957', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:11:29.205691 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-3e93a68a-1526-4178-80e1-dc5fa2e5f15c tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd2105b0264b48d084d0e79cabff8bc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf4adda91364dab94830347c06e3957', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:11:29.217758 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-3e93a68a-1526-4178-80e1-dc5fa2e5f15c tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd2105b0264b48d084d0e79cabff8bc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf4adda91364dab94830347c06e3957', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:11:29.222457 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-3e93a68a-1526-4178-80e1-dc5fa2e5f15c tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] 10.222.0.13 "GET /compute/v2.1/servers/ba6ffc5c-84a4-40f1-bdc7-f87dde2c99df" status: 200 len: 1605 microversion: 2.32 time: 0.332479 Nov 01 19:11:29.247406 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 2059/4188] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 19:11:28 2022] GET /compute/v2.1/servers/ba6ffc5c-84a4-40f1-bdc7-f87dde2c99df => generated 1605 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 01 19:11:29.841898 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-6394f000-e22c-4675-8fed-46053da013a9 tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:11:29.842684 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-6394f000-e22c-4675-8fed-46053da013a9 tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] [instance: 03d4513b-9e04-4924-8654-1de3748e333e] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:11:29.844716 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-19d680bf-e8d0-42ba-95de-f878f0aa7b21 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:11:29.845335 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-19d680bf-e8d0-42ba-95de-f878f0aa7b21 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] [instance: b27eaab4-a751-47fb-acdb-db7c99b06a5f] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:11:29.865220 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-6394f000-e22c-4675-8fed-46053da013a9 tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:11:29.868297 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-19d680bf-e8d0-42ba-95de-f878f0aa7b21 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:11:29.868449 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-6394f000-e22c-4675-8fed-46053da013a9 tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:11:29.868897 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-6394f000-e22c-4675-8fed-46053da013a9 tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:11:29.869019 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-19d680bf-e8d0-42ba-95de-f878f0aa7b21 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:11:29.869343 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-19d680bf-e8d0-42ba-95de-f878f0aa7b21 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:11:29.869633 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-6394f000-e22c-4675-8fed-46053da013a9 tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:11:29.870059 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-19d680bf-e8d0-42ba-95de-f878f0aa7b21 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:11:29.870200 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-6394f000-e22c-4675-8fed-46053da013a9 tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:11:29.870507 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-6394f000-e22c-4675-8fed-46053da013a9 tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:11:29.870625 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-19d680bf-e8d0-42ba-95de-f878f0aa7b21 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:11:29.872751 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-19d680bf-e8d0-42ba-95de-f878f0aa7b21 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:11:30.356289 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-6394f000-e22c-4675-8fed-46053da013a9 tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c72e7e000a9a4fa49474bd5d19accf77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d8835c7b6754bfd81447b1f8893e56c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:11:30.364967 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-6394f000-e22c-4675-8fed-46053da013a9 tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] 10.222.0.13 "GET /compute/v2.1/servers/03d4513b-9e04-4924-8654-1de3748e333e" status: 200 len: 1682 microversion: 2.1 time: 0.529072 Nov 01 19:11:30.365549 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 2130/4189] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:11:29 2022] GET /compute/v2.1/servers/03d4513b-9e04-4924-8654-1de3748e333e => generated 1682 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:11:30.393150 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-9edbd15a-9794-436c-ba76-3d7caefe5876 tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:11:30.394052 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-9edbd15a-9794-436c-ba76-3d7caefe5876 tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] [instance: cae1c729-7c41-488d-ab0e-30d1f5d22180] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:11:30.402454 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-19d680bf-e8d0-42ba-95de-f878f0aa7b21 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc5c19b930543f5a5091922a9859813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ecdc83933544a899117531a960027a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:11:30.424086 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-9edbd15a-9794-436c-ba76-3d7caefe5876 tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:11:30.424605 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-9edbd15a-9794-436c-ba76-3d7caefe5876 tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:11:30.427391 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-19d680bf-e8d0-42ba-95de-f878f0aa7b21 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] 10.222.0.13 "GET /compute/v2.1/servers/b27eaab4-a751-47fb-acdb-db7c99b06a5f" status: 200 len: 1317 microversion: 2.1 time: 0.586989 Nov 01 19:11:30.427996 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 2060/4190] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:11:29 2022] GET /compute/v2.1/servers/b27eaab4-a751-47fb-acdb-db7c99b06a5f => generated 1317 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 19:11:30.436970 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-9edbd15a-9794-436c-ba76-3d7caefe5876 tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:11:30.437910 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-9edbd15a-9794-436c-ba76-3d7caefe5876 tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:11:30.438392 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-9edbd15a-9794-436c-ba76-3d7caefe5876 tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:11:30.438830 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-9edbd15a-9794-436c-ba76-3d7caefe5876 tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:11:30.448082 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-56abeba1-00a1-4326-8d24-602b4a96ab5d tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:11:30.456825 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-56abeba1-00a1-4326-8d24-602b4a96ab5d tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] [instance: ba6ffc5c-84a4-40f1-bdc7-f87dde2c99df] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:11:30.477085 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-56abeba1-00a1-4326-8d24-602b4a96ab5d tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:11:30.479235 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-56abeba1-00a1-4326-8d24-602b4a96ab5d tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:11:30.480935 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-56abeba1-00a1-4326-8d24-602b4a96ab5d tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:11:30.485695 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-56abeba1-00a1-4326-8d24-602b4a96ab5d tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:11:30.486258 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-56abeba1-00a1-4326-8d24-602b4a96ab5d tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:11:30.487022 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-56abeba1-00a1-4326-8d24-602b4a96ab5d tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:11:30.666024 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-9edbd15a-9794-436c-ba76-3d7caefe5876 tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcf93260eaef487dac5d7bb00b26e3b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73cb8697de6d407ba82c334d9f2b48d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:11:30.677131 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-9edbd15a-9794-436c-ba76-3d7caefe5876 tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] 10.222.0.13 "GET /compute/v2.1/servers/cae1c729-7c41-488d-ab0e-30d1f5d22180" status: 200 len: 1288 microversion: 2.1 time: 0.302211 Nov 01 19:11:30.686402 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 2131/4191] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:11:30 2022] GET /compute/v2.1/servers/cae1c729-7c41-488d-ab0e-30d1f5d22180 => generated 1288 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:11:30.764088 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-56abeba1-00a1-4326-8d24-602b4a96ab5d tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd2105b0264b48d084d0e79cabff8bc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf4adda91364dab94830347c06e3957', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:11:30.785144 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-56abeba1-00a1-4326-8d24-602b4a96ab5d tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd2105b0264b48d084d0e79cabff8bc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf4adda91364dab94830347c06e3957', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:11:30.788786 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-56abeba1-00a1-4326-8d24-602b4a96ab5d tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd2105b0264b48d084d0e79cabff8bc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf4adda91364dab94830347c06e3957', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:11:30.792119 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-56abeba1-00a1-4326-8d24-602b4a96ab5d tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] 10.222.0.13 "GET /compute/v2.1/servers/ba6ffc5c-84a4-40f1-bdc7-f87dde2c99df" status: 200 len: 1605 microversion: 2.32 time: 0.363178 Nov 01 19:11:30.795054 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 2061/4192] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 19:11:30 2022] GET /compute/v2.1/servers/ba6ffc5c-84a4-40f1-bdc7-f87dde2c99df => generated 1605 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 19:11:31.399920 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-b072356a-242e-483b-9cf6-f590d2c538ed tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:11:31.401279 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-b072356a-242e-483b-9cf6-f590d2c538ed tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] [instance: 03d4513b-9e04-4924-8654-1de3748e333e] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:11:31.411271 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-b072356a-242e-483b-9cf6-f590d2c538ed tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:11:31.412291 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-b072356a-242e-483b-9cf6-f590d2c538ed tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:11:31.413260 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-b072356a-242e-483b-9cf6-f590d2c538ed tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:11:31.414448 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-b072356a-242e-483b-9cf6-f590d2c538ed tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:11:31.416428 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-b072356a-242e-483b-9cf6-f590d2c538ed tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:11:31.418277 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-b072356a-242e-483b-9cf6-f590d2c538ed tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:11:31.457653 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-79de2235-1bd8-4a66-b2bc-7fa5cc271cb2 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:11:31.458257 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-79de2235-1bd8-4a66-b2bc-7fa5cc271cb2 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] [instance: b27eaab4-a751-47fb-acdb-db7c99b06a5f] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:11:31.470295 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-79de2235-1bd8-4a66-b2bc-7fa5cc271cb2 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:11:31.470796 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-79de2235-1bd8-4a66-b2bc-7fa5cc271cb2 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:11:31.471235 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-79de2235-1bd8-4a66-b2bc-7fa5cc271cb2 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:11:31.471944 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-79de2235-1bd8-4a66-b2bc-7fa5cc271cb2 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:11:31.475731 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-79de2235-1bd8-4a66-b2bc-7fa5cc271cb2 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:11:31.476180 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-79de2235-1bd8-4a66-b2bc-7fa5cc271cb2 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:11:31.839599 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-79de2235-1bd8-4a66-b2bc-7fa5cc271cb2 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc5c19b930543f5a5091922a9859813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ecdc83933544a899117531a960027a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:11:31.852940 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-79de2235-1bd8-4a66-b2bc-7fa5cc271cb2 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] 10.222.0.13 "GET /compute/v2.1/servers/b27eaab4-a751-47fb-acdb-db7c99b06a5f" status: 200 len: 1317 microversion: 2.1 time: 0.400507 Nov 01 19:11:31.854623 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 2062/4193] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:11:31 2022] GET /compute/v2.1/servers/b27eaab4-a751-47fb-acdb-db7c99b06a5f => generated 1317 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:11:31.864374 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-0f400668-3494-41b4-8608-16e10e61c9a3 tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:11:31.865402 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-0f400668-3494-41b4-8608-16e10e61c9a3 tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] [instance: cae1c729-7c41-488d-ab0e-30d1f5d22180] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:11:31.872378 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-0f400668-3494-41b4-8608-16e10e61c9a3 tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:11:31.873603 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-0f400668-3494-41b4-8608-16e10e61c9a3 tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:11:31.874533 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-0f400668-3494-41b4-8608-16e10e61c9a3 tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:11:31.876078 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-0f400668-3494-41b4-8608-16e10e61c9a3 tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:11:31.876825 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-0f400668-3494-41b4-8608-16e10e61c9a3 tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:11:31.877953 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-0f400668-3494-41b4-8608-16e10e61c9a3 tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:11:31.934741 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-b072356a-242e-483b-9cf6-f590d2c538ed tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c72e7e000a9a4fa49474bd5d19accf77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d8835c7b6754bfd81447b1f8893e56c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:11:31.959166 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-b072356a-242e-483b-9cf6-f590d2c538ed tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] 10.222.0.13 "GET /compute/v2.1/servers/03d4513b-9e04-4924-8654-1de3748e333e" status: 200 len: 1682 microversion: 2.1 time: 0.569400 Nov 01 19:11:31.973809 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 2132/4194] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:11:31 2022] GET /compute/v2.1/servers/03d4513b-9e04-4924-8654-1de3748e333e => generated 1682 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:11:31.989635 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-a5fa6711-d5c2-4cd8-9cf2-56cce7bbd163 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:11:31.998872 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-a5fa6711-d5c2-4cd8-9cf2-56cce7bbd163 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] [instance: ba6ffc5c-84a4-40f1-bdc7-f87dde2c99df] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:11:32.007251 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-a5fa6711-d5c2-4cd8-9cf2-56cce7bbd163 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:11:32.008443 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-a5fa6711-d5c2-4cd8-9cf2-56cce7bbd163 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:11:32.009574 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-a5fa6711-d5c2-4cd8-9cf2-56cce7bbd163 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:11:32.011601 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-a5fa6711-d5c2-4cd8-9cf2-56cce7bbd163 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:11:32.012180 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-a5fa6711-d5c2-4cd8-9cf2-56cce7bbd163 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:11:32.012751 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-a5fa6711-d5c2-4cd8-9cf2-56cce7bbd163 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:11:32.149442 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-a5fa6711-d5c2-4cd8-9cf2-56cce7bbd163 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd2105b0264b48d084d0e79cabff8bc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf4adda91364dab94830347c06e3957', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:11:32.164448 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-a5fa6711-d5c2-4cd8-9cf2-56cce7bbd163 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd2105b0264b48d084d0e79cabff8bc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf4adda91364dab94830347c06e3957', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:11:32.168685 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-a5fa6711-d5c2-4cd8-9cf2-56cce7bbd163 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd2105b0264b48d084d0e79cabff8bc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf4adda91364dab94830347c06e3957', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:11:32.173505 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-a5fa6711-d5c2-4cd8-9cf2-56cce7bbd163 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] 10.222.0.13 "GET /compute/v2.1/servers/ba6ffc5c-84a4-40f1-bdc7-f87dde2c99df" status: 200 len: 1605 microversion: 2.32 time: 0.191405 Nov 01 19:11:32.174641 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 2133/4195] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 19:11:31 2022] GET /compute/v2.1/servers/ba6ffc5c-84a4-40f1-bdc7-f87dde2c99df => generated 1605 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 19:11:32.186530 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [req-e5286038-93fc-47fa-be30-010e6d8ee8c0 req-52521d62-68fe-45d1-8ac8-88a14c12801b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b27eaab4-a751-47fb-acdb-db7c99b06a5f", "tag": "200423f3-1c61-4481-816b-7b546d2ec3c8"}]} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:11:32.201193 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-e5286038-93fc-47fa-be30-010e6d8ee8c0 req-52521d62-68fe-45d1-8ac8-88a14c12801b service nova] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:11:32.202748 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-e5286038-93fc-47fa-be30-010e6d8ee8c0 req-52521d62-68fe-45d1-8ac8-88a14c12801b service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:11:32.204240 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-e5286038-93fc-47fa-be30-010e6d8ee8c0 req-52521d62-68fe-45d1-8ac8-88a14c12801b service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:11:32.221258 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.compute.server_external_events [req-e5286038-93fc-47fa-be30-010e6d8ee8c0 req-52521d62-68fe-45d1-8ac8-88a14c12801b service nova] Creating event network-changed:200423f3-1c61-4481-816b-7b546d2ec3c8 for instance b27eaab4-a751-47fb-acdb-db7c99b06a5f on n-h2-863052-2 Nov 01 19:11:32.227738 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [req-e5286038-93fc-47fa-be30-010e6d8ee8c0 req-52521d62-68fe-45d1-8ac8-88a14c12801b service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051441 Nov 01 19:11:32.230444 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 2134/4196] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Nov 1 19:11:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:11:32.385056 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-0f400668-3494-41b4-8608-16e10e61c9a3 tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcf93260eaef487dac5d7bb00b26e3b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73cb8697de6d407ba82c334d9f2b48d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:11:32.394377 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-0f400668-3494-41b4-8608-16e10e61c9a3 tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] 10.222.0.13 "GET /compute/v2.1/servers/cae1c729-7c41-488d-ab0e-30d1f5d22180" status: 200 len: 1294 microversion: 2.1 time: 0.536134 Nov 01 19:11:32.409229 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 2063/4197] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:11:31 2022] GET /compute/v2.1/servers/cae1c729-7c41-488d-ab0e-30d1f5d22180 => generated 1294 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:11:32.885120 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-50527abe-3015-4a4d-b09a-c1d76e2e0fd4 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:11:32.886573 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-50527abe-3015-4a4d-b09a-c1d76e2e0fd4 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] [instance: b27eaab4-a751-47fb-acdb-db7c99b06a5f] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:11:32.901028 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-50527abe-3015-4a4d-b09a-c1d76e2e0fd4 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:11:32.908552 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-50527abe-3015-4a4d-b09a-c1d76e2e0fd4 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:11:32.909109 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-50527abe-3015-4a4d-b09a-c1d76e2e0fd4 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:11:32.909940 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-50527abe-3015-4a4d-b09a-c1d76e2e0fd4 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:11:32.910505 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-50527abe-3015-4a4d-b09a-c1d76e2e0fd4 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:11:32.911007 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-50527abe-3015-4a4d-b09a-c1d76e2e0fd4 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:11:32.997457 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-ba0515fe-81cd-40d8-bd72-513ecd8bbad6 tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:11:32.998215 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-ba0515fe-81cd-40d8-bd72-513ecd8bbad6 tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] [instance: 03d4513b-9e04-4924-8654-1de3748e333e] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:11:33.007201 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-ba0515fe-81cd-40d8-bd72-513ecd8bbad6 tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:11:33.008006 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-ba0515fe-81cd-40d8-bd72-513ecd8bbad6 tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:11:33.008724 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-ba0515fe-81cd-40d8-bd72-513ecd8bbad6 tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:11:33.009699 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-ba0515fe-81cd-40d8-bd72-513ecd8bbad6 tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:11:33.010334 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-ba0515fe-81cd-40d8-bd72-513ecd8bbad6 tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:11:33.010931 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-ba0515fe-81cd-40d8-bd72-513ecd8bbad6 tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:11:33.345783 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-ba0515fe-81cd-40d8-bd72-513ecd8bbad6 tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c72e7e000a9a4fa49474bd5d19accf77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d8835c7b6754bfd81447b1f8893e56c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:11:33.358551 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-ba0515fe-81cd-40d8-bd72-513ecd8bbad6 tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] 10.222.0.13 "GET /compute/v2.1/servers/03d4513b-9e04-4924-8654-1de3748e333e" status: 200 len: 1614 microversion: 2.1 time: 0.365218 Nov 01 19:11:33.363225 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 2064/4198] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:11:32 2022] GET /compute/v2.1/servers/03d4513b-9e04-4924-8654-1de3748e333e => generated 1614 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 19:11:33.381861 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-bd241afc-db2e-40d9-b46d-9ad9fef37565 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:11:33.383609 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-bd241afc-db2e-40d9-b46d-9ad9fef37565 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] [instance: ba6ffc5c-84a4-40f1-bdc7-f87dde2c99df] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:11:33.392826 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-bd241afc-db2e-40d9-b46d-9ad9fef37565 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:11:33.393618 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-bd241afc-db2e-40d9-b46d-9ad9fef37565 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:11:33.394308 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-bd241afc-db2e-40d9-b46d-9ad9fef37565 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:11:33.395348 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-bd241afc-db2e-40d9-b46d-9ad9fef37565 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:11:33.396054 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-bd241afc-db2e-40d9-b46d-9ad9fef37565 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:11:33.396751 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-bd241afc-db2e-40d9-b46d-9ad9fef37565 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:11:33.592091 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-50527abe-3015-4a4d-b09a-c1d76e2e0fd4 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc5c19b930543f5a5091922a9859813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ecdc83933544a899117531a960027a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:11:33.604265 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-50527abe-3015-4a4d-b09a-c1d76e2e0fd4 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] 10.222.0.13 "GET /compute/v2.1/servers/b27eaab4-a751-47fb-acdb-db7c99b06a5f" status: 200 len: 1317 microversion: 2.1 time: 0.726681 Nov 01 19:11:33.605091 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 2135/4199] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:11:32 2022] GET /compute/v2.1/servers/b27eaab4-a751-47fb-acdb-db7c99b06a5f => generated 1317 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:11:33.617099 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-1d54272b-f03e-4be9-92b2-21cd786811b0 tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:11:33.621491 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-1d54272b-f03e-4be9-92b2-21cd786811b0 tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] [instance: cae1c729-7c41-488d-ab0e-30d1f5d22180] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:11:33.633777 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-1d54272b-f03e-4be9-92b2-21cd786811b0 tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:11:33.637160 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-1d54272b-f03e-4be9-92b2-21cd786811b0 tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:11:33.637905 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-1d54272b-f03e-4be9-92b2-21cd786811b0 tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:11:33.638966 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-1d54272b-f03e-4be9-92b2-21cd786811b0 tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:11:33.643274 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-1d54272b-f03e-4be9-92b2-21cd786811b0 tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:11:33.644086 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-1d54272b-f03e-4be9-92b2-21cd786811b0 tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:11:33.657416 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-bd241afc-db2e-40d9-b46d-9ad9fef37565 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd2105b0264b48d084d0e79cabff8bc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf4adda91364dab94830347c06e3957', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:11:33.684158 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-bd241afc-db2e-40d9-b46d-9ad9fef37565 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd2105b0264b48d084d0e79cabff8bc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf4adda91364dab94830347c06e3957', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:11:33.686545 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-bd241afc-db2e-40d9-b46d-9ad9fef37565 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd2105b0264b48d084d0e79cabff8bc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf4adda91364dab94830347c06e3957', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:11:33.690354 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-bd241afc-db2e-40d9-b46d-9ad9fef37565 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] 10.222.0.13 "GET /compute/v2.1/servers/ba6ffc5c-84a4-40f1-bdc7-f87dde2c99df" status: 200 len: 1605 microversion: 2.32 time: 0.325770 Nov 01 19:11:33.698401 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 2065/4200] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 19:11:33 2022] GET /compute/v2.1/servers/ba6ffc5c-84a4-40f1-bdc7-f87dde2c99df => generated 1605 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 19:11:33.709245 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [req-c605f56e-11ae-4ed4-9e83-5b17590d109f req-3344b59e-e3b8-47b9-90c1-e9e6ea0587a9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03d4513b-9e04-4924-8654-1de3748e333e", "name": "network-vif-deleted", "tag": "1006d010-6ff0-43d5-af55-b5743e6e84b1"}]} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:11:33.750025 n-d-863052-2 devstack@n-api.service[121403]: DEBUG dbcounter [-] [121403] Writing DB stats nova_cell0:SELECT=2 {{(pid=121403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 19:11:33.753302 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-c605f56e-11ae-4ed4-9e83-5b17590d109f req-3344b59e-e3b8-47b9-90c1-e9e6ea0587a9 service nova] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:11:33.755312 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-c605f56e-11ae-4ed4-9e83-5b17590d109f req-3344b59e-e3b8-47b9-90c1-e9e6ea0587a9 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:11:33.757126 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-c605f56e-11ae-4ed4-9e83-5b17590d109f req-3344b59e-e3b8-47b9-90c1-e9e6ea0587a9 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:11:33.806206 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.compute.server_external_events [req-c605f56e-11ae-4ed4-9e83-5b17590d109f req-3344b59e-e3b8-47b9-90c1-e9e6ea0587a9 service nova] Creating event network-vif-deleted:1006d010-6ff0-43d5-af55-b5743e6e84b1 for instance 03d4513b-9e04-4924-8654-1de3748e333e on n-h1-863052-2 Nov 01 19:11:33.818174 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [req-c605f56e-11ae-4ed4-9e83-5b17590d109f req-3344b59e-e3b8-47b9-90c1-e9e6ea0587a9 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.116954 Nov 01 19:11:33.819758 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 2066/4201] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Nov 1 19:11:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:11:34.388313 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-771367e9-6bfd-401e-98ef-f73f036b24f9 tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:11:34.389036 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-771367e9-6bfd-401e-98ef-f73f036b24f9 tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] [instance: 03d4513b-9e04-4924-8654-1de3748e333e] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:11:34.416878 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-771367e9-6bfd-401e-98ef-f73f036b24f9 tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:11:34.421217 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-771367e9-6bfd-401e-98ef-f73f036b24f9 tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:11:34.421966 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-771367e9-6bfd-401e-98ef-f73f036b24f9 tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:11:34.422891 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-771367e9-6bfd-401e-98ef-f73f036b24f9 tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:11:34.423814 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-771367e9-6bfd-401e-98ef-f73f036b24f9 tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:11:34.424429 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-771367e9-6bfd-401e-98ef-f73f036b24f9 tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:11:34.529165 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-771367e9-6bfd-401e-98ef-f73f036b24f9 tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:11:34.529890 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-771367e9-6bfd-401e-98ef-f73f036b24f9 tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:11:34.530533 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-771367e9-6bfd-401e-98ef-f73f036b24f9 tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:11:34.531207 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.objects.instance [None req-771367e9-6bfd-401e-98ef-f73f036b24f9 tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] Lazy-loading 'fault' on Instance uuid 03d4513b-9e04-4924-8654-1de3748e333e {{(pid=121402) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 01 19:11:34.699405 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-771367e9-6bfd-401e-98ef-f73f036b24f9 tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c72e7e000a9a4fa49474bd5d19accf77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d8835c7b6754bfd81447b1f8893e56c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:11:34.705608 n-d-863052-2 devstack@n-api.service[121402]: DEBUG dbcounter [-] [121402] Writing DB stats nova_cell1:SELECT=100 {{(pid=121402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 19:11:34.721984 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-771367e9-6bfd-401e-98ef-f73f036b24f9 tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] 10.222.0.13 "GET /compute/v2.1/servers/03d4513b-9e04-4924-8654-1de3748e333e" status: 200 len: 1331 microversion: 2.1 time: 0.333880 Nov 01 19:11:34.723010 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 2067/4202] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:11:34 2022] GET /compute/v2.1/servers/03d4513b-9e04-4924-8654-1de3748e333e => generated 1331 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:11:34.736173 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-8c0236b5-559d-452d-b738-85704ee6b830 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:11:34.737185 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-8c0236b5-559d-452d-b738-85704ee6b830 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] [instance: b27eaab4-a751-47fb-acdb-db7c99b06a5f] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:11:34.745036 n-d-863052-2 devstack@n-api.service[121402]: DEBUG dbcounter [-] [121402] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=1,nova_api:INSERT=4,nova_api:DELETE=1 {{(pid=121402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 19:11:34.753891 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-8c0236b5-559d-452d-b738-85704ee6b830 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:11:34.756726 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-8c0236b5-559d-452d-b738-85704ee6b830 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:11:34.760907 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-8c0236b5-559d-452d-b738-85704ee6b830 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:11:34.761673 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-8c0236b5-559d-452d-b738-85704ee6b830 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:11:34.762334 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-8c0236b5-559d-452d-b738-85704ee6b830 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:11:34.763020 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-8c0236b5-559d-452d-b738-85704ee6b830 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:11:35.165336 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-1d54272b-f03e-4be9-92b2-21cd786811b0 tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcf93260eaef487dac5d7bb00b26e3b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73cb8697de6d407ba82c334d9f2b48d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:11:35.204627 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-1d54272b-f03e-4be9-92b2-21cd786811b0 tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] 10.222.0.13 "GET /compute/v2.1/servers/cae1c729-7c41-488d-ab0e-30d1f5d22180" status: 200 len: 1361 microversion: 2.1 time: 1.592451 Nov 01 19:11:35.206168 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 2136/4203] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:11:33 2022] GET /compute/v2.1/servers/cae1c729-7c41-488d-ab0e-30d1f5d22180 => generated 1361 bytes in 1597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:11:35.219975 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-5147e1ae-5473-4021-bea1-674e9b8fb896 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:11:35.221379 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-5147e1ae-5473-4021-bea1-674e9b8fb896 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] [instance: ba6ffc5c-84a4-40f1-bdc7-f87dde2c99df] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:11:35.228262 n-d-863052-2 devstack@n-api.service[121403]: DEBUG dbcounter [-] [121403] Writing DB stats nova_api:SELECT=76,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=121403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 19:11:35.230958 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-5147e1ae-5473-4021-bea1-674e9b8fb896 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:11:35.233009 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-5147e1ae-5473-4021-bea1-674e9b8fb896 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:11:35.234032 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-5147e1ae-5473-4021-bea1-674e9b8fb896 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:11:35.235545 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-5147e1ae-5473-4021-bea1-674e9b8fb896 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:11:35.236980 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-5147e1ae-5473-4021-bea1-674e9b8fb896 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:11:35.238886 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-5147e1ae-5473-4021-bea1-674e9b8fb896 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:11:35.262813 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.wsgi [None req-5147e1ae-5473-4021-bea1-674e9b8fb896 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] HTTP exception thrown: Instance ba6ffc5c-84a4-40f1-bdc7-f87dde2c99df could not be found. Nov 01 19:11:35.266651 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-5147e1ae-5473-4021-bea1-674e9b8fb896 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Request method failure captured: Nov 01 19:11:35.266651 n-d-863052-2 devstack@n-api.service[121403]: request: GET /compute/v2.1/servers/ba6ffc5c-84a4-40f1-bdc7-f87dde2c99df HTTP/1.1 Nov 01 19:11:35.266651 n-d-863052-2 devstack@n-api.service[121403]: Accept: application/json Nov 01 19:11:35.266651 n-d-863052-2 devstack@n-api.service[121403]: Accept-Encoding: identity Nov 01 19:11:35.266651 n-d-863052-2 devstack@n-api.service[121403]: Connection: close Nov 01 19:11:35.266651 n-d-863052-2 devstack@n-api.service[121403]: Content-Length: 0 Nov 01 19:11:35.266651 n-d-863052-2 devstack@n-api.service[121403]: Content-Type: application/json Nov 01 19:11:35.266651 n-d-863052-2 devstack@n-api.service[121403]: Host: 10.222.0.13 Nov 01 19:11:35.266651 n-d-863052-2 devstack@n-api.service[121403]: Openstack-System-Scope: None Nov 01 19:11:35.266651 n-d-863052-2 devstack@n-api.service[121403]: User-Agent: python-urllib3/1.26.12 Nov 01 19:11:35.266651 n-d-863052-2 devstack@n-api.service[121403]: X-Auth-Token: gAAAAABjYW3EOHzEH64j_KBBQYcNunLrukxedHCJNlYLjUk4zQx-sawgKsr5qcXOr1N0C3iybtUeOQ80bxR5aK1WFQhX-tdUpqAUNKmgReQT8ZS9wY9zA7-HcWOfygbtS8i9r8irZqvv2XSM2Sn6RT4cdv930usQU5qU9eZE2-ew_aeZg78UNo4 Nov 01 19:11:35.266651 n-d-863052-2 devstack@n-api.service[121403]: X-Domain-Id: None Nov 01 19:11:35.266651 n-d-863052-2 devstack@n-api.service[121403]: X-Domain-Name: None Nov 01 19:11:35.266651 n-d-863052-2 devstack@n-api.service[121403]: X-Identity-Status: Confirmed Nov 01 19:11:35.266651 n-d-863052-2 devstack@n-api.service[121403]: X-Is-Admin-Project: True Nov 01 19:11:35.266651 n-d-863052-2 devstack@n-api.service[121403]: X-Openstack-Nova-Api-Version: 2.32 Nov 01 19:11:35.266651 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Domain-Id: default Nov 01 19:11:35.266651 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Domain-Name: Default Nov 01 19:11:35.266651 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Id: adf4adda91364dab94830347c06e3957 Nov 01 19:11:35.266651 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Name: tempest-TaggedBootDevicesTest-1622381130 Nov 01 19:11:35.266651 n-d-863052-2 devstack@n-api.service[121403]: X-Role: member,reader Nov 01 19:11:35.266651 n-d-863052-2 devstack@n-api.service[121403]: X-Roles: member,reader Nov 01 19:11:35.266651 n-d-863052-2 devstack@n-api.service[121403]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/adf4adda91364dab94830347c06e3957"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/adf4adda91364dab94830347c06e3957"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_adf4adda91364dab94830347c06e3957", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/adf4adda91364dab94830347c06e3957"}]}] Nov 01 19:11:35.266651 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant: tempest-TaggedBootDevicesTest-1622381130 Nov 01 19:11:35.266651 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant-Id: adf4adda91364dab94830347c06e3957 Nov 01 19:11:35.266651 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant-Name: tempest-TaggedBootDevicesTest-1622381130 Nov 01 19:11:35.266651 n-d-863052-2 devstack@n-api.service[121403]: X-User: tempest-TaggedBootDevicesTest-1622381130-project Nov 01 19:11:35.266651 n-d-863052-2 devstack@n-api.service[121403]: X-User-Domain-Id: default Nov 01 19:11:35.266651 n-d-863052-2 devstack@n-api.service[121403]: X-User-Domain-Name: Default Nov 01 19:11:35.266651 n-d-863052-2 devstack@n-api.service[121403]: X-User-Id: cd2105b0264b48d084d0e79cabff8bc4 Nov 01 19:11:35.266651 n-d-863052-2 devstack@n-api.service[121403]: X-User-Name: tempest-TaggedBootDevicesTest-1622381130-project Nov 01 19:11:35.266651 n-d-863052-2 devstack@n-api.service[121403]: method: > Nov 01 19:11:35.266651 n-d-863052-2 devstack@n-api.service[121403]: exception: Instance ba6ffc5c-84a4-40f1-bdc7-f87dde2c99df could not be found. Nov 01 19:11:35.266651 n-d-863052-2 devstack@n-api.service[121403]: action_args: {'id': 'ba6ffc5c-84a4-40f1-bdc7-f87dde2c99df'} Nov 01 19:11:35.266651 n-d-863052-2 devstack@n-api.service[121403]: {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 01 19:11:35.266651 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:11:35.266651 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 01 19:11:35.266651 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 01 19:11:35.266651 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 01 19:11:35.266651 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 01 19:11:35.266651 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 01 19:11:35.266651 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 01 19:11:35.266651 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 01 19:11:35.266651 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 01 19:11:35.266651 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ba6ffc5c-84a4-40f1-bdc7-f87dde2c99df could not be found. Nov 01 19:11:35.266651 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:11:35.266651 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:11:35.266651 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:11:35.266651 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:11:35.266651 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:11:35.266651 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:11:35.266651 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 01 19:11:35.266651 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 01 19:11:35.266651 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 01 19:11:35.266651 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 01 19:11:35.266651 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 01 19:11:35.266651 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 01 19:11:35.266651 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 01 19:11:35.266651 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 01 19:11:35.266651 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 01 19:11:35.266651 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 01 19:11:35.266651 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ba6ffc5c-84a4-40f1-bdc7-f87dde2c99df could not be found. Nov 01 19:11:35.266651 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:11:35.266651 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:11:35.272633 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:11:35.272633 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:11:35.272633 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:11:35.272633 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:11:35.272633 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 01 19:11:35.272633 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 01 19:11:35.272633 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ba6ffc5c-84a4-40f1-bdc7-f87dde2c99df could not be found. Nov 01 19:11:35.272633 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:11:35.275880 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-5147e1ae-5473-4021-bea1-674e9b8fb896 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Returning 404 to user: Instance ba6ffc5c-84a4-40f1-bdc7-f87dde2c99df could not be found. {{(pid=121403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 01 19:11:35.277558 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-5147e1ae-5473-4021-bea1-674e9b8fb896 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] 10.222.0.13 "GET /compute/v2.1/servers/ba6ffc5c-84a4-40f1-bdc7-f87dde2c99df" status: 404 len: 111 microversion: 2.32 time: 0.069348 Nov 01 19:11:35.279682 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 2137/4204] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 19:11:35 2022] GET /compute/v2.1/servers/ba6ffc5c-84a4-40f1-bdc7-f87dde2c99df => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 01 19:11:35.290621 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-bc3cc236-e35b-453b-92eb-55026f3d0f94 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Calling method '.version_select at 0x7f0ae29a5e50>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:11:35.324779 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-bc3cc236-e35b-453b-92eb-55026f3d0f94 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1545214518" status: 204 len: 0 microversion: 2.32 time: 0.038057 Nov 01 19:11:35.341813 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 2138/4205] 10.222.0.13 () {60 vars in 1262 bytes} [Tue Nov 1 19:11:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1545214518 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 01 19:11:35.428559 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-8c0236b5-559d-452d-b738-85704ee6b830 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc5c19b930543f5a5091922a9859813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ecdc83933544a899117531a960027a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:11:35.441337 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-8c0236b5-559d-452d-b738-85704ee6b830 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] 10.222.0.13 "GET /compute/v2.1/servers/b27eaab4-a751-47fb-acdb-db7c99b06a5f" status: 200 len: 1317 microversion: 2.1 time: 0.716562 Nov 01 19:11:35.462521 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 2068/4206] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:11:34 2022] GET /compute/v2.1/servers/b27eaab4-a751-47fb-acdb-db7c99b06a5f => generated 1317 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:11:35.787683 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-7587a499-da01-43b7-b712-7a0f8c0121fa tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:11:35.787683 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-7587a499-da01-43b7-b712-7a0f8c0121fa tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] [instance: 03d4513b-9e04-4924-8654-1de3748e333e] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:11:35.795555 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-7587a499-da01-43b7-b712-7a0f8c0121fa tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:11:35.799793 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-7587a499-da01-43b7-b712-7a0f8c0121fa tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:11:35.800457 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-7587a499-da01-43b7-b712-7a0f8c0121fa tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:11:35.801572 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-7587a499-da01-43b7-b712-7a0f8c0121fa tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:11:35.802174 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-7587a499-da01-43b7-b712-7a0f8c0121fa tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:11:35.804493 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-7587a499-da01-43b7-b712-7a0f8c0121fa tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:11:35.835937 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.wsgi [None req-7587a499-da01-43b7-b712-7a0f8c0121fa tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] HTTP exception thrown: Instance 03d4513b-9e04-4924-8654-1de3748e333e could not be found. Nov 01 19:11:35.840516 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-7587a499-da01-43b7-b712-7a0f8c0121fa tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] Request method failure captured: Nov 01 19:11:35.840516 n-d-863052-2 devstack@n-api.service[121403]: request: GET /compute/v2.1/servers/03d4513b-9e04-4924-8654-1de3748e333e HTTP/1.1 Nov 01 19:11:35.840516 n-d-863052-2 devstack@n-api.service[121403]: Accept: application/json Nov 01 19:11:35.840516 n-d-863052-2 devstack@n-api.service[121403]: Accept-Encoding: identity Nov 01 19:11:35.840516 n-d-863052-2 devstack@n-api.service[121403]: Connection: close Nov 01 19:11:35.840516 n-d-863052-2 devstack@n-api.service[121403]: Content-Length: 0 Nov 01 19:11:35.840516 n-d-863052-2 devstack@n-api.service[121403]: Content-Type: application/json Nov 01 19:11:35.840516 n-d-863052-2 devstack@n-api.service[121403]: Host: 10.222.0.13 Nov 01 19:11:35.840516 n-d-863052-2 devstack@n-api.service[121403]: Openstack-System-Scope: None Nov 01 19:11:35.840516 n-d-863052-2 devstack@n-api.service[121403]: User-Agent: python-urllib3/1.26.12 Nov 01 19:11:35.840516 n-d-863052-2 devstack@n-api.service[121403]: X-Auth-Token: gAAAAABjYW7HMki1_ABgHO7dxRvivRv_wqT8yW1357EMuj7cZMTDOtNlIoykdf9GFUQ5Qj9h3jVU1GoRQFOtZRXN5BWe11EJtARWzQ96nkUNGsa5CODrQigS0fFh-_OeQA5AguTmIHaN02Egcz3uQOnK8WdesSCzZgKa6pNsi85nov2TrD9zjvc Nov 01 19:11:35.840516 n-d-863052-2 devstack@n-api.service[121403]: X-Domain-Id: None Nov 01 19:11:35.840516 n-d-863052-2 devstack@n-api.service[121403]: X-Domain-Name: None Nov 01 19:11:35.840516 n-d-863052-2 devstack@n-api.service[121403]: X-Identity-Status: Confirmed Nov 01 19:11:35.840516 n-d-863052-2 devstack@n-api.service[121403]: X-Is-Admin-Project: True Nov 01 19:11:35.840516 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Domain-Id: default Nov 01 19:11:35.840516 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Domain-Name: Default Nov 01 19:11:35.840516 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Id: 3d8835c7b6754bfd81447b1f8893e56c Nov 01 19:11:35.840516 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Name: tempest-VolumesAdminNegativeTest-526487121 Nov 01 19:11:35.840516 n-d-863052-2 devstack@n-api.service[121403]: X-Role: member,reader Nov 01 19:11:35.840516 n-d-863052-2 devstack@n-api.service[121403]: X-Roles: member,reader Nov 01 19:11:35.840516 n-d-863052-2 devstack@n-api.service[121403]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/3d8835c7b6754bfd81447b1f8893e56c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/3d8835c7b6754bfd81447b1f8893e56c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_3d8835c7b6754bfd81447b1f8893e56c", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/3d8835c7b6754bfd81447b1f8893e56c"}]}] Nov 01 19:11:35.840516 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant: tempest-VolumesAdminNegativeTest-526487121 Nov 01 19:11:35.840516 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant-Id: 3d8835c7b6754bfd81447b1f8893e56c Nov 01 19:11:35.840516 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-526487121 Nov 01 19:11:35.840516 n-d-863052-2 devstack@n-api.service[121403]: X-User: tempest-VolumesAdminNegativeTest-526487121-project Nov 01 19:11:35.840516 n-d-863052-2 devstack@n-api.service[121403]: X-User-Domain-Id: default Nov 01 19:11:35.840516 n-d-863052-2 devstack@n-api.service[121403]: X-User-Domain-Name: Default Nov 01 19:11:35.840516 n-d-863052-2 devstack@n-api.service[121403]: X-User-Id: c72e7e000a9a4fa49474bd5d19accf77 Nov 01 19:11:35.840516 n-d-863052-2 devstack@n-api.service[121403]: X-User-Name: tempest-VolumesAdminNegativeTest-526487121-project Nov 01 19:11:35.840516 n-d-863052-2 devstack@n-api.service[121403]: method: > Nov 01 19:11:35.840516 n-d-863052-2 devstack@n-api.service[121403]: exception: Instance 03d4513b-9e04-4924-8654-1de3748e333e could not be found. Nov 01 19:11:35.840516 n-d-863052-2 devstack@n-api.service[121403]: action_args: {'id': '03d4513b-9e04-4924-8654-1de3748e333e'} Nov 01 19:11:35.840516 n-d-863052-2 devstack@n-api.service[121403]: {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 01 19:11:35.840516 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:11:35.840516 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 01 19:11:35.840516 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 01 19:11:35.840516 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 01 19:11:35.840516 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 01 19:11:35.840516 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 01 19:11:35.840516 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 01 19:11:35.840516 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 01 19:11:35.840516 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 01 19:11:35.840516 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 03d4513b-9e04-4924-8654-1de3748e333e could not be found. Nov 01 19:11:35.840516 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:11:35.840516 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:11:35.840516 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:11:35.840516 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:11:35.840516 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:11:35.840516 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:11:35.840516 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 01 19:11:35.840516 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 01 19:11:35.840516 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 01 19:11:35.840516 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 01 19:11:35.840516 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 01 19:11:35.840516 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 01 19:11:35.840516 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 01 19:11:35.840516 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 01 19:11:35.840516 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 01 19:11:35.840516 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 01 19:11:35.840516 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 03d4513b-9e04-4924-8654-1de3748e333e could not be found. Nov 01 19:11:35.840516 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:11:35.840516 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:11:35.840516 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:11:35.844309 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:11:35.844309 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:11:35.844309 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:11:35.844309 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 01 19:11:35.844309 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 01 19:11:35.844309 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 03d4513b-9e04-4924-8654-1de3748e333e could not be found. Nov 01 19:11:35.844309 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:11:35.844309 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-7587a499-da01-43b7-b712-7a0f8c0121fa tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] Returning 404 to user: Instance 03d4513b-9e04-4924-8654-1de3748e333e could not be found. {{(pid=121403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 01 19:11:35.846755 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-7587a499-da01-43b7-b712-7a0f8c0121fa tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] 10.222.0.13 "GET /compute/v2.1/servers/03d4513b-9e04-4924-8654-1de3748e333e" status: 404 len: 111 microversion: 2.1 time: 0.093009 Nov 01 19:11:35.854624 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 2139/4207] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:11:35 2022] GET /compute/v2.1/servers/03d4513b-9e04-4924-8654-1de3748e333e => generated 111 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 01 19:11:35.857367 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-b7d6da7c-887d-42e6-b171-25be6f158730 tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] Calling method '.version_select at 0x7f0ae3055700>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:11:35.911712 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-b7d6da7c-887d-42e6-b171-25be6f158730 tempest-VolumesAdminNegativeTest-526487121 tempest-VolumesAdminNegativeTest-526487121-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-394532974" status: 202 len: 0 microversion: 2.1 time: 0.058187 Nov 01 19:11:35.912711 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 2069/4208] 10.222.0.13 () {58 vars in 1218 bytes} [Tue Nov 1 19:11:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-394532974 => generated 0 bytes in 60 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 01 19:11:36.102706 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [req-8338ed80-09a5-4803-81de-125b91824d00 req-c52b042f-a3cb-4e62-8107-92e05fc57112 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cae1c729-7c41-488d-ab0e-30d1f5d22180", "tag": "3533eeb6-f9e6-47ff-ba35-f061eb6fd641"}]} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:11:36.146444 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-8338ed80-09a5-4803-81de-125b91824d00 req-c52b042f-a3cb-4e62-8107-92e05fc57112 service nova] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:11:36.147168 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-8338ed80-09a5-4803-81de-125b91824d00 req-c52b042f-a3cb-4e62-8107-92e05fc57112 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:11:36.147757 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-8338ed80-09a5-4803-81de-125b91824d00 req-c52b042f-a3cb-4e62-8107-92e05fc57112 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:11:36.178443 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.compute.server_external_events [req-8338ed80-09a5-4803-81de-125b91824d00 req-c52b042f-a3cb-4e62-8107-92e05fc57112 service nova] Creating event network-changed:3533eeb6-f9e6-47ff-ba35-f061eb6fd641 for instance cae1c729-7c41-488d-ab0e-30d1f5d22180 on n-h1-863052-2 Nov 01 19:11:36.195405 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [req-8338ed80-09a5-4803-81de-125b91824d00 req-c52b042f-a3cb-4e62-8107-92e05fc57112 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096330 Nov 01 19:11:36.196045 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 2140/4209] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Nov 1 19:11:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:11:36.228452 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-fe08802c-2771-4273-b388-ad53ce3bbd5a tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:11:36.229129 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-fe08802c-2771-4273-b388-ad53ce3bbd5a tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] [instance: cae1c729-7c41-488d-ab0e-30d1f5d22180] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:11:36.240149 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-fe08802c-2771-4273-b388-ad53ce3bbd5a tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:11:36.240793 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-fe08802c-2771-4273-b388-ad53ce3bbd5a tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:11:36.241997 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-fe08802c-2771-4273-b388-ad53ce3bbd5a tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:11:36.244734 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-fe08802c-2771-4273-b388-ad53ce3bbd5a tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:11:36.245232 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-fe08802c-2771-4273-b388-ad53ce3bbd5a tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:11:36.245664 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-fe08802c-2771-4273-b388-ad53ce3bbd5a tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:11:36.472493 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-f6b7d40a-61cd-4929-905d-019f6a3b279e tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:11:36.473527 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-f6b7d40a-61cd-4929-905d-019f6a3b279e tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] [instance: b27eaab4-a751-47fb-acdb-db7c99b06a5f] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:11:36.491266 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f6b7d40a-61cd-4929-905d-019f6a3b279e tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:11:36.493969 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f6b7d40a-61cd-4929-905d-019f6a3b279e tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:11:36.494608 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f6b7d40a-61cd-4929-905d-019f6a3b279e tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:11:36.497292 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f6b7d40a-61cd-4929-905d-019f6a3b279e tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:11:36.497809 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f6b7d40a-61cd-4929-905d-019f6a3b279e tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:11:36.500186 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f6b7d40a-61cd-4929-905d-019f6a3b279e tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:11:36.844675 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-fe08802c-2771-4273-b388-ad53ce3bbd5a tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcf93260eaef487dac5d7bb00b26e3b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73cb8697de6d407ba82c334d9f2b48d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:11:36.859079 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-fe08802c-2771-4273-b388-ad53ce3bbd5a tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] 10.222.0.13 "GET /compute/v2.1/servers/cae1c729-7c41-488d-ab0e-30d1f5d22180" status: 200 len: 1361 microversion: 2.1 time: 0.635568 Nov 01 19:11:36.859736 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 2070/4210] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:11:36 2022] GET /compute/v2.1/servers/cae1c729-7c41-488d-ab0e-30d1f5d22180 => generated 1361 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:11:37.250686 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-f6b7d40a-61cd-4929-905d-019f6a3b279e tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc5c19b930543f5a5091922a9859813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ecdc83933544a899117531a960027a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:11:37.259506 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-f6b7d40a-61cd-4929-905d-019f6a3b279e tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] 10.222.0.13 "GET /compute/v2.1/servers/b27eaab4-a751-47fb-acdb-db7c99b06a5f" status: 200 len: 1317 microversion: 2.1 time: 0.794157 Nov 01 19:11:37.262476 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 2141/4211] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:11:36 2022] GET /compute/v2.1/servers/b27eaab4-a751-47fb-acdb-db7c99b06a5f => generated 1317 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 19:11:37.887375 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-70d8ebfa-81f9-4e1f-96f5-fe62cef6a963 tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:11:37.888804 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-70d8ebfa-81f9-4e1f-96f5-fe62cef6a963 tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] [instance: cae1c729-7c41-488d-ab0e-30d1f5d22180] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:11:37.902984 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-70d8ebfa-81f9-4e1f-96f5-fe62cef6a963 tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:11:37.904117 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-70d8ebfa-81f9-4e1f-96f5-fe62cef6a963 tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:11:37.904872 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-70d8ebfa-81f9-4e1f-96f5-fe62cef6a963 tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:11:37.905827 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-70d8ebfa-81f9-4e1f-96f5-fe62cef6a963 tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:11:37.907046 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-70d8ebfa-81f9-4e1f-96f5-fe62cef6a963 tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:11:37.907679 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-70d8ebfa-81f9-4e1f-96f5-fe62cef6a963 tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:11:38.304792 n-d-863052-2 devstack@n-api.service[121402]: DEBUG dbcounter [-] [121402] Writing DB stats nova_cell0:SELECT=2 {{(pid=121402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 19:11:38.310356 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-10ad2c5f-55ff-48a5-9611-601171ccd1ce tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:11:38.314721 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-10ad2c5f-55ff-48a5-9611-601171ccd1ce tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] [instance: b27eaab4-a751-47fb-acdb-db7c99b06a5f] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:11:38.323852 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-10ad2c5f-55ff-48a5-9611-601171ccd1ce tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:11:38.326531 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-10ad2c5f-55ff-48a5-9611-601171ccd1ce tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:11:38.338919 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-10ad2c5f-55ff-48a5-9611-601171ccd1ce tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:11:38.340811 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-10ad2c5f-55ff-48a5-9611-601171ccd1ce tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:11:38.341555 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-10ad2c5f-55ff-48a5-9611-601171ccd1ce tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:11:38.342578 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-10ad2c5f-55ff-48a5-9611-601171ccd1ce tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:11:38.392956 n-d-863052-2 devstack@n-api.service[121402]: DEBUG dbcounter [-] [121402] Writing DB stats nova_cell0:SELECT=14 {{(pid=121402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 19:11:38.459949 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-70d8ebfa-81f9-4e1f-96f5-fe62cef6a963 tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcf93260eaef487dac5d7bb00b26e3b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73cb8697de6d407ba82c334d9f2b48d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:11:38.468409 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-70d8ebfa-81f9-4e1f-96f5-fe62cef6a963 tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] 10.222.0.13 "GET /compute/v2.1/servers/cae1c729-7c41-488d-ab0e-30d1f5d22180" status: 200 len: 1361 microversion: 2.1 time: 0.586227 Nov 01 19:11:38.480919 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 2071/4212] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:11:37 2022] GET /compute/v2.1/servers/cae1c729-7c41-488d-ab0e-30d1f5d22180 => generated 1361 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:11:38.940923 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-822fac12-f6f4-4a1c-907d-5a12cefcc9d7 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:11:38.941480 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-822fac12-f6f4-4a1c-907d-5a12cefcc9d7 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] [instance: eced579f-beea-4d3c-b2b8-8a6b31f7829b] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:11:38.968123 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-822fac12-f6f4-4a1c-907d-5a12cefcc9d7 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:11:38.968880 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-822fac12-f6f4-4a1c-907d-5a12cefcc9d7 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:11:38.969470 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-822fac12-f6f4-4a1c-907d-5a12cefcc9d7 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:11:38.970332 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-822fac12-f6f4-4a1c-907d-5a12cefcc9d7 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:11:38.973230 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-822fac12-f6f4-4a1c-907d-5a12cefcc9d7 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:11:38.973975 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-822fac12-f6f4-4a1c-907d-5a12cefcc9d7 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:11:39.001785 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.wsgi [None req-822fac12-f6f4-4a1c-907d-5a12cefcc9d7 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] HTTP exception thrown: Instance eced579f-beea-4d3c-b2b8-8a6b31f7829b could not be found. Nov 01 19:11:39.012348 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-822fac12-f6f4-4a1c-907d-5a12cefcc9d7 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Request method failure captured: Nov 01 19:11:39.012348 n-d-863052-2 devstack@n-api.service[121402]: request: DELETE /compute/v2.1/servers/eced579f-beea-4d3c-b2b8-8a6b31f7829b HTTP/1.1 Nov 01 19:11:39.012348 n-d-863052-2 devstack@n-api.service[121402]: Accept: application/json Nov 01 19:11:39.012348 n-d-863052-2 devstack@n-api.service[121402]: Accept-Encoding: identity Nov 01 19:11:39.012348 n-d-863052-2 devstack@n-api.service[121402]: Connection: close Nov 01 19:11:39.012348 n-d-863052-2 devstack@n-api.service[121402]: Content-Length: 0 Nov 01 19:11:39.012348 n-d-863052-2 devstack@n-api.service[121402]: Content-Type: application/json Nov 01 19:11:39.012348 n-d-863052-2 devstack@n-api.service[121402]: Host: 10.222.0.13 Nov 01 19:11:39.012348 n-d-863052-2 devstack@n-api.service[121402]: Openstack-System-Scope: None Nov 01 19:11:39.012348 n-d-863052-2 devstack@n-api.service[121402]: User-Agent: python-urllib3/1.26.12 Nov 01 19:11:39.012348 n-d-863052-2 devstack@n-api.service[121402]: X-Auth-Token: gAAAAABjYW26-niUURjtSz2aypPDgkYX79sMl0CZOJW_ml_lGFRo-4lOtvHbbGMI0UBaScGrQfLye0e0L4c10ym8MikDvB1h-T3Rh6fQQzcKLxsRSm1saxobVhs9el4Qiq-2aZx04HWuIjPot0FuuMjXsFtl108kYD3rs-RWb4TVydSfipjFJKk Nov 01 19:11:39.012348 n-d-863052-2 devstack@n-api.service[121402]: X-Domain-Id: None Nov 01 19:11:39.012348 n-d-863052-2 devstack@n-api.service[121402]: X-Domain-Name: None Nov 01 19:11:39.012348 n-d-863052-2 devstack@n-api.service[121402]: X-Identity-Status: Confirmed Nov 01 19:11:39.012348 n-d-863052-2 devstack@n-api.service[121402]: X-Is-Admin-Project: True Nov 01 19:11:39.012348 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Domain-Id: default Nov 01 19:11:39.012348 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Domain-Name: Default Nov 01 19:11:39.012348 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Id: 33e3d319293c46b6af2f728a50586906 Nov 01 19:11:39.012348 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Name: tempest-AttachVolumeNegativeTest-517167560 Nov 01 19:11:39.012348 n-d-863052-2 devstack@n-api.service[121402]: X-Role: member,reader Nov 01 19:11:39.012348 n-d-863052-2 devstack@n-api.service[121402]: X-Roles: member,reader Nov 01 19:11:39.012348 n-d-863052-2 devstack@n-api.service[121402]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/33e3d319293c46b6af2f728a50586906"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/33e3d319293c46b6af2f728a50586906"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_33e3d319293c46b6af2f728a50586906", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/33e3d319293c46b6af2f728a50586906"}]}] Nov 01 19:11:39.012348 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant: tempest-AttachVolumeNegativeTest-517167560 Nov 01 19:11:39.012348 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant-Id: 33e3d319293c46b6af2f728a50586906 Nov 01 19:11:39.012348 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-517167560 Nov 01 19:11:39.012348 n-d-863052-2 devstack@n-api.service[121402]: X-User: tempest-AttachVolumeNegativeTest-517167560-project Nov 01 19:11:39.012348 n-d-863052-2 devstack@n-api.service[121402]: X-User-Domain-Id: default Nov 01 19:11:39.012348 n-d-863052-2 devstack@n-api.service[121402]: X-User-Domain-Name: Default Nov 01 19:11:39.012348 n-d-863052-2 devstack@n-api.service[121402]: X-User-Id: 790f3f1566b7464aaca19d4d05c0942e Nov 01 19:11:39.012348 n-d-863052-2 devstack@n-api.service[121402]: X-User-Name: tempest-AttachVolumeNegativeTest-517167560-project Nov 01 19:11:39.012348 n-d-863052-2 devstack@n-api.service[121402]: method: > Nov 01 19:11:39.012348 n-d-863052-2 devstack@n-api.service[121402]: exception: Instance eced579f-beea-4d3c-b2b8-8a6b31f7829b could not be found. Nov 01 19:11:39.012348 n-d-863052-2 devstack@n-api.service[121402]: action_args: {'id': 'eced579f-beea-4d3c-b2b8-8a6b31f7829b'} Nov 01 19:11:39.012348 n-d-863052-2 devstack@n-api.service[121402]: {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 01 19:11:39.012348 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:11:39.012348 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 01 19:11:39.012348 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 01 19:11:39.012348 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 01 19:11:39.012348 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 01 19:11:39.012348 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 01 19:11:39.012348 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 01 19:11:39.012348 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 01 19:11:39.012348 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 01 19:11:39.012348 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eced579f-beea-4d3c-b2b8-8a6b31f7829b could not be found. Nov 01 19:11:39.012348 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:11:39.012348 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:11:39.012348 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:11:39.012348 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:11:39.012348 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:11:39.012348 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:11:39.012348 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 01 19:11:39.012348 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 01 19:11:39.012348 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 01 19:11:39.012348 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 01 19:11:39.012348 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 01 19:11:39.012348 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 01 19:11:39.012348 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 01 19:11:39.012348 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 01 19:11:39.012348 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 01 19:11:39.012348 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 01 19:11:39.012348 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 01 19:11:39.012348 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 01 19:11:39.016257 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eced579f-beea-4d3c-b2b8-8a6b31f7829b could not be found. Nov 01 19:11:39.016257 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:11:39.016257 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:11:39.016257 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:11:39.016257 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:11:39.016257 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:11:39.016257 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:11:39.016257 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 01 19:11:39.016257 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 01 19:11:39.016257 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eced579f-beea-4d3c-b2b8-8a6b31f7829b could not be found. Nov 01 19:11:39.016257 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:11:39.018820 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-822fac12-f6f4-4a1c-907d-5a12cefcc9d7 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Returning 404 to user: Instance eced579f-beea-4d3c-b2b8-8a6b31f7829b could not be found. {{(pid=121402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 01 19:11:39.023703 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-822fac12-f6f4-4a1c-907d-5a12cefcc9d7 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] 10.222.0.13 "DELETE /compute/v2.1/servers/eced579f-beea-4d3c-b2b8-8a6b31f7829b" status: 404 len: 111 microversion: 2.1 time: 0.087491 Nov 01 19:11:39.025015 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 2072/4213] 10.222.0.13 () {58 vars in 1239 bytes} [Tue Nov 1 19:11:38 2022] DELETE /compute/v2.1/servers/eced579f-beea-4d3c-b2b8-8a6b31f7829b => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 01 19:11:39.034137 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-1efbf158-6e2c-48c5-b032-503efee83eff tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:11:39.039234 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-1efbf158-6e2c-48c5-b032-503efee83eff tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] [instance: eced579f-beea-4d3c-b2b8-8a6b31f7829b] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:11:39.053069 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-1efbf158-6e2c-48c5-b032-503efee83eff tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:11:39.053784 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-1efbf158-6e2c-48c5-b032-503efee83eff tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:11:39.054376 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-1efbf158-6e2c-48c5-b032-503efee83eff tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:11:39.055256 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-1efbf158-6e2c-48c5-b032-503efee83eff tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:11:39.055871 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-1efbf158-6e2c-48c5-b032-503efee83eff tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:11:39.056437 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-1efbf158-6e2c-48c5-b032-503efee83eff tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:11:39.085444 n-d-863052-2 devstack@n-api.service[121403]: DEBUG dbcounter [-] [121403] Writing DB stats nova_cell0:SELECT=8 {{(pid=121403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 19:11:39.093634 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.wsgi [None req-1efbf158-6e2c-48c5-b032-503efee83eff tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] HTTP exception thrown: Instance eced579f-beea-4d3c-b2b8-8a6b31f7829b could not be found. Nov 01 19:11:39.097515 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-1efbf158-6e2c-48c5-b032-503efee83eff tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Request method failure captured: Nov 01 19:11:39.097515 n-d-863052-2 devstack@n-api.service[121402]: request: GET /compute/v2.1/servers/eced579f-beea-4d3c-b2b8-8a6b31f7829b HTTP/1.1 Nov 01 19:11:39.097515 n-d-863052-2 devstack@n-api.service[121402]: Accept: application/json Nov 01 19:11:39.097515 n-d-863052-2 devstack@n-api.service[121402]: Accept-Encoding: identity Nov 01 19:11:39.097515 n-d-863052-2 devstack@n-api.service[121402]: Connection: close Nov 01 19:11:39.097515 n-d-863052-2 devstack@n-api.service[121402]: Content-Length: 0 Nov 01 19:11:39.097515 n-d-863052-2 devstack@n-api.service[121402]: Content-Type: application/json Nov 01 19:11:39.097515 n-d-863052-2 devstack@n-api.service[121402]: Host: 10.222.0.13 Nov 01 19:11:39.097515 n-d-863052-2 devstack@n-api.service[121402]: Openstack-System-Scope: None Nov 01 19:11:39.097515 n-d-863052-2 devstack@n-api.service[121402]: User-Agent: python-urllib3/1.26.12 Nov 01 19:11:39.097515 n-d-863052-2 devstack@n-api.service[121402]: X-Auth-Token: gAAAAABjYW26-niUURjtSz2aypPDgkYX79sMl0CZOJW_ml_lGFRo-4lOtvHbbGMI0UBaScGrQfLye0e0L4c10ym8MikDvB1h-T3Rh6fQQzcKLxsRSm1saxobVhs9el4Qiq-2aZx04HWuIjPot0FuuMjXsFtl108kYD3rs-RWb4TVydSfipjFJKk Nov 01 19:11:39.097515 n-d-863052-2 devstack@n-api.service[121402]: X-Domain-Id: None Nov 01 19:11:39.097515 n-d-863052-2 devstack@n-api.service[121402]: X-Domain-Name: None Nov 01 19:11:39.097515 n-d-863052-2 devstack@n-api.service[121402]: X-Identity-Status: Confirmed Nov 01 19:11:39.097515 n-d-863052-2 devstack@n-api.service[121402]: X-Is-Admin-Project: True Nov 01 19:11:39.097515 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Domain-Id: default Nov 01 19:11:39.097515 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Domain-Name: Default Nov 01 19:11:39.097515 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Id: 33e3d319293c46b6af2f728a50586906 Nov 01 19:11:39.097515 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Name: tempest-AttachVolumeNegativeTest-517167560 Nov 01 19:11:39.097515 n-d-863052-2 devstack@n-api.service[121402]: X-Role: member,reader Nov 01 19:11:39.097515 n-d-863052-2 devstack@n-api.service[121402]: X-Roles: member,reader Nov 01 19:11:39.097515 n-d-863052-2 devstack@n-api.service[121402]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/33e3d319293c46b6af2f728a50586906"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/33e3d319293c46b6af2f728a50586906"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_33e3d319293c46b6af2f728a50586906", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/33e3d319293c46b6af2f728a50586906"}]}] Nov 01 19:11:39.097515 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant: tempest-AttachVolumeNegativeTest-517167560 Nov 01 19:11:39.097515 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant-Id: 33e3d319293c46b6af2f728a50586906 Nov 01 19:11:39.097515 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-517167560 Nov 01 19:11:39.097515 n-d-863052-2 devstack@n-api.service[121402]: X-User: tempest-AttachVolumeNegativeTest-517167560-project Nov 01 19:11:39.097515 n-d-863052-2 devstack@n-api.service[121402]: X-User-Domain-Id: default Nov 01 19:11:39.097515 n-d-863052-2 devstack@n-api.service[121402]: X-User-Domain-Name: Default Nov 01 19:11:39.097515 n-d-863052-2 devstack@n-api.service[121402]: X-User-Id: 790f3f1566b7464aaca19d4d05c0942e Nov 01 19:11:39.097515 n-d-863052-2 devstack@n-api.service[121402]: X-User-Name: tempest-AttachVolumeNegativeTest-517167560-project Nov 01 19:11:39.097515 n-d-863052-2 devstack@n-api.service[121402]: method: > Nov 01 19:11:39.097515 n-d-863052-2 devstack@n-api.service[121402]: exception: Instance eced579f-beea-4d3c-b2b8-8a6b31f7829b could not be found. Nov 01 19:11:39.097515 n-d-863052-2 devstack@n-api.service[121402]: action_args: {'id': 'eced579f-beea-4d3c-b2b8-8a6b31f7829b'} Nov 01 19:11:39.097515 n-d-863052-2 devstack@n-api.service[121402]: {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 01 19:11:39.097515 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:11:39.097515 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 01 19:11:39.097515 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 01 19:11:39.097515 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 01 19:11:39.097515 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 01 19:11:39.097515 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 01 19:11:39.097515 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 01 19:11:39.097515 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 01 19:11:39.097515 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 01 19:11:39.097515 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eced579f-beea-4d3c-b2b8-8a6b31f7829b could not be found. Nov 01 19:11:39.097515 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:11:39.097515 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:11:39.097515 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:11:39.097515 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:11:39.097515 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:11:39.097515 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:11:39.097515 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 01 19:11:39.097515 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 01 19:11:39.097515 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 01 19:11:39.097515 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 01 19:11:39.097515 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 01 19:11:39.097515 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 01 19:11:39.097515 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 01 19:11:39.097515 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 01 19:11:39.097515 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 01 19:11:39.097515 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 01 19:11:39.097515 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eced579f-beea-4d3c-b2b8-8a6b31f7829b could not be found. Nov 01 19:11:39.097515 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:11:39.097515 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:11:39.097515 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:11:39.100481 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:11:39.100481 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:11:39.100481 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:11:39.100481 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 01 19:11:39.100481 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 01 19:11:39.100481 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eced579f-beea-4d3c-b2b8-8a6b31f7829b could not be found. Nov 01 19:11:39.100481 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:11:39.100853 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-1efbf158-6e2c-48c5-b032-503efee83eff tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Returning 404 to user: Instance eced579f-beea-4d3c-b2b8-8a6b31f7829b could not be found. {{(pid=121402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 01 19:11:39.102978 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-1efbf158-6e2c-48c5-b032-503efee83eff tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] 10.222.0.13 "GET /compute/v2.1/servers/eced579f-beea-4d3c-b2b8-8a6b31f7829b" status: 404 len: 111 microversion: 2.1 time: 0.072955 Nov 01 19:11:39.120192 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 2073/4214] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:11:39 2022] GET /compute/v2.1/servers/eced579f-beea-4d3c-b2b8-8a6b31f7829b => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 01 19:11:39.129274 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [req-b85c1ed1-e905-40f3-ad9b-56f84178675c req-373a2efc-72e3-4db0-8486-1235e1580e10 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b27eaab4-a751-47fb-acdb-db7c99b06a5f", "name": "network-vif-plugged", "status": "completed", "tag": "200423f3-1c61-4481-816b-7b546d2ec3c8"}]} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:11:39.165580 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-b85c1ed1-e905-40f3-ad9b-56f84178675c req-373a2efc-72e3-4db0-8486-1235e1580e10 service nova] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:11:39.165985 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-b85c1ed1-e905-40f3-ad9b-56f84178675c req-373a2efc-72e3-4db0-8486-1235e1580e10 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:11:39.167959 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-b85c1ed1-e905-40f3-ad9b-56f84178675c req-373a2efc-72e3-4db0-8486-1235e1580e10 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:11:39.198299 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.compute.server_external_events [req-b85c1ed1-e905-40f3-ad9b-56f84178675c req-373a2efc-72e3-4db0-8486-1235e1580e10 service nova] Creating event network-vif-plugged:200423f3-1c61-4481-816b-7b546d2ec3c8 for instance b27eaab4-a751-47fb-acdb-db7c99b06a5f on n-h2-863052-2 Nov 01 19:11:39.205785 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [req-b85c1ed1-e905-40f3-ad9b-56f84178675c req-373a2efc-72e3-4db0-8486-1235e1580e10 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080573 Nov 01 19:11:39.206573 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 2074/4215] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Nov 1 19:11:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:11:39.496570 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-3066ed7d-7f1f-487c-ae33-b9e3e1fd8e01 tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:11:39.497355 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-3066ed7d-7f1f-487c-ae33-b9e3e1fd8e01 tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] [instance: cae1c729-7c41-488d-ab0e-30d1f5d22180] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:11:39.511078 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-3066ed7d-7f1f-487c-ae33-b9e3e1fd8e01 tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:11:39.511563 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-3066ed7d-7f1f-487c-ae33-b9e3e1fd8e01 tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:11:39.512008 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-3066ed7d-7f1f-487c-ae33-b9e3e1fd8e01 tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:11:39.516874 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-3066ed7d-7f1f-487c-ae33-b9e3e1fd8e01 tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:11:39.517445 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-3066ed7d-7f1f-487c-ae33-b9e3e1fd8e01 tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:11:39.517892 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-3066ed7d-7f1f-487c-ae33-b9e3e1fd8e01 tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:11:39.555911 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-10ad2c5f-55ff-48a5-9611-601171ccd1ce tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc5c19b930543f5a5091922a9859813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ecdc83933544a899117531a960027a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:11:39.578842 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-10ad2c5f-55ff-48a5-9611-601171ccd1ce tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] 10.222.0.13 "GET /compute/v2.1/servers/b27eaab4-a751-47fb-acdb-db7c99b06a5f" status: 200 len: 1317 microversion: 2.1 time: 1.286632 Nov 01 19:11:39.580545 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 2142/4216] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:11:38 2022] GET /compute/v2.1/servers/b27eaab4-a751-47fb-acdb-db7c99b06a5f => generated 1317 bytes in 1290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:11:40.201709 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-3066ed7d-7f1f-487c-ae33-b9e3e1fd8e01 tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcf93260eaef487dac5d7bb00b26e3b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73cb8697de6d407ba82c334d9f2b48d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:11:40.228622 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-3066ed7d-7f1f-487c-ae33-b9e3e1fd8e01 tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] 10.222.0.13 "GET /compute/v2.1/servers/cae1c729-7c41-488d-ab0e-30d1f5d22180" status: 200 len: 1361 microversion: 2.1 time: 0.734280 Nov 01 19:11:40.241594 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 2075/4217] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:11:39 2022] GET /compute/v2.1/servers/cae1c729-7c41-488d-ab0e-30d1f5d22180 => generated 1361 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:11:40.605164 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-d597f8b4-1747-4626-be2d-a571d9ec010e tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:11:40.606925 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-d597f8b4-1747-4626-be2d-a571d9ec010e tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] [instance: b27eaab4-a751-47fb-acdb-db7c99b06a5f] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:11:40.630964 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d597f8b4-1747-4626-be2d-a571d9ec010e tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:11:40.633298 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d597f8b4-1747-4626-be2d-a571d9ec010e tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:11:40.634980 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d597f8b4-1747-4626-be2d-a571d9ec010e tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:11:40.638096 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d597f8b4-1747-4626-be2d-a571d9ec010e tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:11:40.638691 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d597f8b4-1747-4626-be2d-a571d9ec010e tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:11:40.640778 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d597f8b4-1747-4626-be2d-a571d9ec010e tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:11:40.736455 n-d-863052-2 devstack@n-api.service[121403]: DEBUG dbcounter [-] [121403] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 19:11:41.256125 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-37ecf9ee-1f5d-4358-9333-818e7b0ed494 tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:11:41.256810 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-37ecf9ee-1f5d-4358-9333-818e7b0ed494 tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] [instance: cae1c729-7c41-488d-ab0e-30d1f5d22180] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:11:41.277983 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-37ecf9ee-1f5d-4358-9333-818e7b0ed494 tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:11:41.278500 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-37ecf9ee-1f5d-4358-9333-818e7b0ed494 tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:11:41.278953 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-37ecf9ee-1f5d-4358-9333-818e7b0ed494 tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:11:41.280153 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-37ecf9ee-1f5d-4358-9333-818e7b0ed494 tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:11:41.280153 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-37ecf9ee-1f5d-4358-9333-818e7b0ed494 tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:11:41.280614 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-37ecf9ee-1f5d-4358-9333-818e7b0ed494 tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:11:41.841831 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-d597f8b4-1747-4626-be2d-a571d9ec010e tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc5c19b930543f5a5091922a9859813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ecdc83933544a899117531a960027a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:11:41.853832 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-d597f8b4-1747-4626-be2d-a571d9ec010e tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] 10.222.0.13 "GET /compute/v2.1/servers/b27eaab4-a751-47fb-acdb-db7c99b06a5f" status: 200 len: 1317 microversion: 2.1 time: 1.254099 Nov 01 19:11:41.862460 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 2143/4218] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:11:40 2022] GET /compute/v2.1/servers/b27eaab4-a751-47fb-acdb-db7c99b06a5f => generated 1317 bytes in 1264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:11:42.174741 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-37ecf9ee-1f5d-4358-9333-818e7b0ed494 tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcf93260eaef487dac5d7bb00b26e3b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73cb8697de6d407ba82c334d9f2b48d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:11:42.182992 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-37ecf9ee-1f5d-4358-9333-818e7b0ed494 tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] 10.222.0.13 "GET /compute/v2.1/servers/cae1c729-7c41-488d-ab0e-30d1f5d22180" status: 200 len: 1361 microversion: 2.1 time: 0.932523 Nov 01 19:11:42.189830 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 2076/4219] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:11:41 2022] GET /compute/v2.1/servers/cae1c729-7c41-488d-ab0e-30d1f5d22180 => generated 1361 bytes in 940 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 19:11:42.881294 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-215abafd-5053-418b-9170-56b0ed881ef2 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:11:42.881989 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-215abafd-5053-418b-9170-56b0ed881ef2 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] [instance: b27eaab4-a751-47fb-acdb-db7c99b06a5f] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:11:42.902206 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-215abafd-5053-418b-9170-56b0ed881ef2 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:11:42.904716 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-215abafd-5053-418b-9170-56b0ed881ef2 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:11:42.906664 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-215abafd-5053-418b-9170-56b0ed881ef2 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:11:42.907405 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-215abafd-5053-418b-9170-56b0ed881ef2 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:11:42.907870 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-215abafd-5053-418b-9170-56b0ed881ef2 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:11:42.912492 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-215abafd-5053-418b-9170-56b0ed881ef2 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:11:43.212097 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-67b96133-ecd5-4aa1-89bc-b23519ef08a4 tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:11:43.213349 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-67b96133-ecd5-4aa1-89bc-b23519ef08a4 tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] [instance: cae1c729-7c41-488d-ab0e-30d1f5d22180] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:11:43.234321 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-67b96133-ecd5-4aa1-89bc-b23519ef08a4 tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:11:43.237154 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-67b96133-ecd5-4aa1-89bc-b23519ef08a4 tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:11:43.239517 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-67b96133-ecd5-4aa1-89bc-b23519ef08a4 tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:11:43.242125 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-67b96133-ecd5-4aa1-89bc-b23519ef08a4 tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:11:43.246365 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-67b96133-ecd5-4aa1-89bc-b23519ef08a4 tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:11:43.247884 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-67b96133-ecd5-4aa1-89bc-b23519ef08a4 tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:11:43.891804 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-67b96133-ecd5-4aa1-89bc-b23519ef08a4 tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcf93260eaef487dac5d7bb00b26e3b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73cb8697de6d407ba82c334d9f2b48d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:11:43.911984 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-67b96133-ecd5-4aa1-89bc-b23519ef08a4 tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] 10.222.0.13 "GET /compute/v2.1/servers/cae1c729-7c41-488d-ab0e-30d1f5d22180" status: 200 len: 1361 microversion: 2.1 time: 0.700218 Nov 01 19:11:43.913442 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 2077/4220] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:11:43 2022] GET /compute/v2.1/servers/cae1c729-7c41-488d-ab0e-30d1f5d22180 => generated 1361 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 19:11:43.918224 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [req-27ead1ca-25ab-415a-a6f3-006e110057c9 req-0b2eb05f-54a9-4563-9e26-72991ea49440 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cae1c729-7c41-488d-ab0e-30d1f5d22180", "name": "network-vif-plugged", "status": "completed", "tag": "3533eeb6-f9e6-47ff-ba35-f061eb6fd641"}]} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:11:43.972421 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-215abafd-5053-418b-9170-56b0ed881ef2 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc5c19b930543f5a5091922a9859813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ecdc83933544a899117531a960027a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:11:43.985607 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-27ead1ca-25ab-415a-a6f3-006e110057c9 req-0b2eb05f-54a9-4563-9e26-72991ea49440 service nova] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:11:43.990733 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-215abafd-5053-418b-9170-56b0ed881ef2 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] 10.222.0.13 "GET /compute/v2.1/servers/b27eaab4-a751-47fb-acdb-db7c99b06a5f" status: 200 len: 1506 microversion: 2.1 time: 1.113580 Nov 01 19:11:43.991839 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-27ead1ca-25ab-415a-a6f3-006e110057c9 req-0b2eb05f-54a9-4563-9e26-72991ea49440 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:11:43.992374 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-27ead1ca-25ab-415a-a6f3-006e110057c9 req-0b2eb05f-54a9-4563-9e26-72991ea49440 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:11:43.995738 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 2144/4221] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:11:42 2022] GET /compute/v2.1/servers/b27eaab4-a751-47fb-acdb-db7c99b06a5f => generated 1506 bytes in 1119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:11:44.056272 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.compute.server_external_events [req-27ead1ca-25ab-415a-a6f3-006e110057c9 req-0b2eb05f-54a9-4563-9e26-72991ea49440 service nova] Creating event network-vif-plugged:3533eeb6-f9e6-47ff-ba35-f061eb6fd641 for instance cae1c729-7c41-488d-ab0e-30d1f5d22180 on n-h1-863052-2 Nov 01 19:11:44.078573 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [req-27ead1ca-25ab-415a-a6f3-006e110057c9 req-0b2eb05f-54a9-4563-9e26-72991ea49440 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.163620 Nov 01 19:11:44.079137 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 2078/4222] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Nov 1 19:11:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:11:44.278342 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-278033c6-dac4-476a-9412-9852f9773f6a tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1469367763", "imageRef": "2d4a0047-1b9e-445f-8af8-1b5c9d93e881", "flavorRef": "452", "networks": [{"uuid": "f2fc603f-a5ab-4120-939f-124d49e1f7c1"}]}} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:11:44.416212 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.network.neutron [None req-278033c6-dac4-476a-9412-9852f9773f6a tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] validate_networks() for [('f2fc603f-a5ab-4120-939f-124d49e1f7c1', None, None, None, None, None)] {{(pid=121403) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 01 19:11:44.942490 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-281b7433-b1b0-4297-b007-90dd77dd934f tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:11:44.943339 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-281b7433-b1b0-4297-b007-90dd77dd934f tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] [instance: cae1c729-7c41-488d-ab0e-30d1f5d22180] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:11:44.955210 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-281b7433-b1b0-4297-b007-90dd77dd934f tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:11:44.955716 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-281b7433-b1b0-4297-b007-90dd77dd934f tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:11:44.956153 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-281b7433-b1b0-4297-b007-90dd77dd934f tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:11:44.959763 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-281b7433-b1b0-4297-b007-90dd77dd934f tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:11:44.962263 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-281b7433-b1b0-4297-b007-90dd77dd934f tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:11:44.962870 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-281b7433-b1b0-4297-b007-90dd77dd934f tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:11:45.981813 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-281b7433-b1b0-4297-b007-90dd77dd934f tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcf93260eaef487dac5d7bb00b26e3b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73cb8697de6d407ba82c334d9f2b48d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:11:45.993784 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-281b7433-b1b0-4297-b007-90dd77dd934f tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] 10.222.0.13 "GET /compute/v2.1/servers/cae1c729-7c41-488d-ab0e-30d1f5d22180" status: 200 len: 1361 microversion: 2.1 time: 1.058950 Nov 01 19:11:46.008621 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 2079/4223] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:11:44 2022] GET /compute/v2.1/servers/cae1c729-7c41-488d-ab0e-30d1f5d22180 => generated 1361 bytes in 1063 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:11:46.009721 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-e313751f-5de5-4ccd-bce0-875103ee4598 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:11:46.010652 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-e313751f-5de5-4ccd-bce0-875103ee4598 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] [instance: ac4160c6-ca16-455e-9613-0d425932af3b] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:11:46.031531 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e313751f-5de5-4ccd-bce0-875103ee4598 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:11:46.032271 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e313751f-5de5-4ccd-bce0-875103ee4598 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:11:46.036645 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e313751f-5de5-4ccd-bce0-875103ee4598 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:11:46.042503 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e313751f-5de5-4ccd-bce0-875103ee4598 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:11:46.045990 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e313751f-5de5-4ccd-bce0-875103ee4598 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:11:46.048073 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e313751f-5de5-4ccd-bce0-875103ee4598 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:11:46.096297 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.wsgi [None req-e313751f-5de5-4ccd-bce0-875103ee4598 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] HTTP exception thrown: Instance ac4160c6-ca16-455e-9613-0d425932af3b could not be found. Nov 01 19:11:46.102362 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-e313751f-5de5-4ccd-bce0-875103ee4598 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Request method failure captured: Nov 01 19:11:46.102362 n-d-863052-2 devstack@n-api.service[121402]: request: DELETE /compute/v2.1/servers/ac4160c6-ca16-455e-9613-0d425932af3b HTTP/1.1 Nov 01 19:11:46.102362 n-d-863052-2 devstack@n-api.service[121402]: Accept: application/json Nov 01 19:11:46.102362 n-d-863052-2 devstack@n-api.service[121402]: Accept-Encoding: identity Nov 01 19:11:46.102362 n-d-863052-2 devstack@n-api.service[121402]: Connection: close Nov 01 19:11:46.102362 n-d-863052-2 devstack@n-api.service[121402]: Content-Length: 0 Nov 01 19:11:46.102362 n-d-863052-2 devstack@n-api.service[121402]: Content-Type: application/json Nov 01 19:11:46.102362 n-d-863052-2 devstack@n-api.service[121402]: Host: 10.222.0.13 Nov 01 19:11:46.102362 n-d-863052-2 devstack@n-api.service[121402]: Openstack-System-Scope: None Nov 01 19:11:46.102362 n-d-863052-2 devstack@n-api.service[121402]: User-Agent: python-urllib3/1.26.12 Nov 01 19:11:46.102362 n-d-863052-2 devstack@n-api.service[121402]: X-Auth-Token: gAAAAABjYW26-niUURjtSz2aypPDgkYX79sMl0CZOJW_ml_lGFRo-4lOtvHbbGMI0UBaScGrQfLye0e0L4c10ym8MikDvB1h-T3Rh6fQQzcKLxsRSm1saxobVhs9el4Qiq-2aZx04HWuIjPot0FuuMjXsFtl108kYD3rs-RWb4TVydSfipjFJKk Nov 01 19:11:46.102362 n-d-863052-2 devstack@n-api.service[121402]: X-Domain-Id: None Nov 01 19:11:46.102362 n-d-863052-2 devstack@n-api.service[121402]: X-Domain-Name: None Nov 01 19:11:46.102362 n-d-863052-2 devstack@n-api.service[121402]: X-Identity-Status: Confirmed Nov 01 19:11:46.102362 n-d-863052-2 devstack@n-api.service[121402]: X-Is-Admin-Project: True Nov 01 19:11:46.102362 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Domain-Id: default Nov 01 19:11:46.102362 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Domain-Name: Default Nov 01 19:11:46.102362 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Id: 33e3d319293c46b6af2f728a50586906 Nov 01 19:11:46.102362 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Name: tempest-AttachVolumeNegativeTest-517167560 Nov 01 19:11:46.102362 n-d-863052-2 devstack@n-api.service[121402]: X-Role: member,reader Nov 01 19:11:46.102362 n-d-863052-2 devstack@n-api.service[121402]: X-Roles: member,reader Nov 01 19:11:46.102362 n-d-863052-2 devstack@n-api.service[121402]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/33e3d319293c46b6af2f728a50586906"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/33e3d319293c46b6af2f728a50586906"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_33e3d319293c46b6af2f728a50586906", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/33e3d319293c46b6af2f728a50586906"}]}] Nov 01 19:11:46.102362 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant: tempest-AttachVolumeNegativeTest-517167560 Nov 01 19:11:46.102362 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant-Id: 33e3d319293c46b6af2f728a50586906 Nov 01 19:11:46.102362 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-517167560 Nov 01 19:11:46.102362 n-d-863052-2 devstack@n-api.service[121402]: X-User: tempest-AttachVolumeNegativeTest-517167560-project Nov 01 19:11:46.102362 n-d-863052-2 devstack@n-api.service[121402]: X-User-Domain-Id: default Nov 01 19:11:46.102362 n-d-863052-2 devstack@n-api.service[121402]: X-User-Domain-Name: Default Nov 01 19:11:46.102362 n-d-863052-2 devstack@n-api.service[121402]: X-User-Id: 790f3f1566b7464aaca19d4d05c0942e Nov 01 19:11:46.102362 n-d-863052-2 devstack@n-api.service[121402]: X-User-Name: tempest-AttachVolumeNegativeTest-517167560-project Nov 01 19:11:46.102362 n-d-863052-2 devstack@n-api.service[121402]: method: > Nov 01 19:11:46.102362 n-d-863052-2 devstack@n-api.service[121402]: exception: Instance ac4160c6-ca16-455e-9613-0d425932af3b could not be found. Nov 01 19:11:46.102362 n-d-863052-2 devstack@n-api.service[121402]: action_args: {'id': 'ac4160c6-ca16-455e-9613-0d425932af3b'} Nov 01 19:11:46.102362 n-d-863052-2 devstack@n-api.service[121402]: {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 01 19:11:46.102362 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:11:46.102362 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 01 19:11:46.102362 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 01 19:11:46.102362 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 01 19:11:46.102362 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 01 19:11:46.102362 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 01 19:11:46.102362 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 01 19:11:46.102362 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 01 19:11:46.102362 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 01 19:11:46.102362 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ac4160c6-ca16-455e-9613-0d425932af3b could not be found. Nov 01 19:11:46.102362 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:11:46.102362 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:11:46.102362 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:11:46.102362 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:11:46.102362 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:11:46.102362 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:11:46.102362 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 01 19:11:46.102362 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 01 19:11:46.102362 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 01 19:11:46.102362 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 01 19:11:46.102362 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 01 19:11:46.102362 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 01 19:11:46.102362 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 01 19:11:46.102362 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 01 19:11:46.102362 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 01 19:11:46.102362 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 01 19:11:46.102362 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 01 19:11:46.102362 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 01 19:11:46.106283 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ac4160c6-ca16-455e-9613-0d425932af3b could not be found. Nov 01 19:11:46.106283 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:11:46.106283 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:11:46.106283 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:11:46.106283 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:11:46.106283 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:11:46.106283 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:11:46.106283 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 01 19:11:46.106283 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 01 19:11:46.106283 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ac4160c6-ca16-455e-9613-0d425932af3b could not be found. Nov 01 19:11:46.106283 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:11:46.107803 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-e313751f-5de5-4ccd-bce0-875103ee4598 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Returning 404 to user: Instance ac4160c6-ca16-455e-9613-0d425932af3b could not be found. {{(pid=121402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 01 19:11:46.110420 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-e313751f-5de5-4ccd-bce0-875103ee4598 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] 10.222.0.13 "DELETE /compute/v2.1/servers/ac4160c6-ca16-455e-9613-0d425932af3b" status: 404 len: 111 microversion: 2.1 time: 0.112092 Nov 01 19:11:46.115288 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 2080/4224] 10.222.0.13 () {58 vars in 1239 bytes} [Tue Nov 1 19:11:45 2022] DELETE /compute/v2.1/servers/ac4160c6-ca16-455e-9613-0d425932af3b => generated 111 bytes in 117 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 01 19:11:46.128048 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-fb068109-1dba-4774-87aa-b3ef1874c920 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:11:46.129078 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-fb068109-1dba-4774-87aa-b3ef1874c920 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] [instance: ac4160c6-ca16-455e-9613-0d425932af3b] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:11:46.147368 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-fb068109-1dba-4774-87aa-b3ef1874c920 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:11:46.148256 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-fb068109-1dba-4774-87aa-b3ef1874c920 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:11:46.148855 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-fb068109-1dba-4774-87aa-b3ef1874c920 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:11:46.149861 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-fb068109-1dba-4774-87aa-b3ef1874c920 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:11:46.154891 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-fb068109-1dba-4774-87aa-b3ef1874c920 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:11:46.155756 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-fb068109-1dba-4774-87aa-b3ef1874c920 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:11:46.188910 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.wsgi [None req-fb068109-1dba-4774-87aa-b3ef1874c920 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] HTTP exception thrown: Instance ac4160c6-ca16-455e-9613-0d425932af3b could not be found. Nov 01 19:11:46.190629 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-fb068109-1dba-4774-87aa-b3ef1874c920 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Request method failure captured: Nov 01 19:11:46.190629 n-d-863052-2 devstack@n-api.service[121402]: request: GET /compute/v2.1/servers/ac4160c6-ca16-455e-9613-0d425932af3b HTTP/1.1 Nov 01 19:11:46.190629 n-d-863052-2 devstack@n-api.service[121402]: Accept: application/json Nov 01 19:11:46.190629 n-d-863052-2 devstack@n-api.service[121402]: Accept-Encoding: identity Nov 01 19:11:46.190629 n-d-863052-2 devstack@n-api.service[121402]: Connection: close Nov 01 19:11:46.190629 n-d-863052-2 devstack@n-api.service[121402]: Content-Length: 0 Nov 01 19:11:46.190629 n-d-863052-2 devstack@n-api.service[121402]: Content-Type: application/json Nov 01 19:11:46.190629 n-d-863052-2 devstack@n-api.service[121402]: Host: 10.222.0.13 Nov 01 19:11:46.190629 n-d-863052-2 devstack@n-api.service[121402]: Openstack-System-Scope: None Nov 01 19:11:46.190629 n-d-863052-2 devstack@n-api.service[121402]: User-Agent: python-urllib3/1.26.12 Nov 01 19:11:46.190629 n-d-863052-2 devstack@n-api.service[121402]: X-Auth-Token: gAAAAABjYW26-niUURjtSz2aypPDgkYX79sMl0CZOJW_ml_lGFRo-4lOtvHbbGMI0UBaScGrQfLye0e0L4c10ym8MikDvB1h-T3Rh6fQQzcKLxsRSm1saxobVhs9el4Qiq-2aZx04HWuIjPot0FuuMjXsFtl108kYD3rs-RWb4TVydSfipjFJKk Nov 01 19:11:46.190629 n-d-863052-2 devstack@n-api.service[121402]: X-Domain-Id: None Nov 01 19:11:46.190629 n-d-863052-2 devstack@n-api.service[121402]: X-Domain-Name: None Nov 01 19:11:46.190629 n-d-863052-2 devstack@n-api.service[121402]: X-Identity-Status: Confirmed Nov 01 19:11:46.190629 n-d-863052-2 devstack@n-api.service[121402]: X-Is-Admin-Project: True Nov 01 19:11:46.190629 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Domain-Id: default Nov 01 19:11:46.190629 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Domain-Name: Default Nov 01 19:11:46.190629 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Id: 33e3d319293c46b6af2f728a50586906 Nov 01 19:11:46.190629 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Name: tempest-AttachVolumeNegativeTest-517167560 Nov 01 19:11:46.190629 n-d-863052-2 devstack@n-api.service[121402]: X-Role: member,reader Nov 01 19:11:46.190629 n-d-863052-2 devstack@n-api.service[121402]: X-Roles: member,reader Nov 01 19:11:46.190629 n-d-863052-2 devstack@n-api.service[121402]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/33e3d319293c46b6af2f728a50586906"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/33e3d319293c46b6af2f728a50586906"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_33e3d319293c46b6af2f728a50586906", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/33e3d319293c46b6af2f728a50586906"}]}] Nov 01 19:11:46.190629 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant: tempest-AttachVolumeNegativeTest-517167560 Nov 01 19:11:46.190629 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant-Id: 33e3d319293c46b6af2f728a50586906 Nov 01 19:11:46.190629 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-517167560 Nov 01 19:11:46.190629 n-d-863052-2 devstack@n-api.service[121402]: X-User: tempest-AttachVolumeNegativeTest-517167560-project Nov 01 19:11:46.190629 n-d-863052-2 devstack@n-api.service[121402]: X-User-Domain-Id: default Nov 01 19:11:46.190629 n-d-863052-2 devstack@n-api.service[121402]: X-User-Domain-Name: Default Nov 01 19:11:46.190629 n-d-863052-2 devstack@n-api.service[121402]: X-User-Id: 790f3f1566b7464aaca19d4d05c0942e Nov 01 19:11:46.190629 n-d-863052-2 devstack@n-api.service[121402]: X-User-Name: tempest-AttachVolumeNegativeTest-517167560-project Nov 01 19:11:46.190629 n-d-863052-2 devstack@n-api.service[121402]: method: > Nov 01 19:11:46.190629 n-d-863052-2 devstack@n-api.service[121402]: exception: Instance ac4160c6-ca16-455e-9613-0d425932af3b could not be found. Nov 01 19:11:46.190629 n-d-863052-2 devstack@n-api.service[121402]: action_args: {'id': 'ac4160c6-ca16-455e-9613-0d425932af3b'} Nov 01 19:11:46.190629 n-d-863052-2 devstack@n-api.service[121402]: {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 01 19:11:46.190629 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:11:46.190629 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 01 19:11:46.190629 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 01 19:11:46.190629 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 01 19:11:46.190629 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 01 19:11:46.190629 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 01 19:11:46.190629 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 01 19:11:46.190629 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 01 19:11:46.190629 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 01 19:11:46.190629 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ac4160c6-ca16-455e-9613-0d425932af3b could not be found. Nov 01 19:11:46.190629 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:11:46.190629 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:11:46.190629 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:11:46.190629 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:11:46.190629 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:11:46.190629 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:11:46.190629 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 01 19:11:46.190629 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 01 19:11:46.190629 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 01 19:11:46.190629 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 01 19:11:46.190629 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 01 19:11:46.190629 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 01 19:11:46.190629 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 01 19:11:46.190629 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 01 19:11:46.190629 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 01 19:11:46.190629 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 01 19:11:46.190629 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ac4160c6-ca16-455e-9613-0d425932af3b could not be found. Nov 01 19:11:46.190629 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:11:46.190629 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:11:46.190629 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:11:46.194835 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:11:46.194835 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:11:46.194835 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:11:46.194835 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 01 19:11:46.194835 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 01 19:11:46.194835 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ac4160c6-ca16-455e-9613-0d425932af3b could not be found. Nov 01 19:11:46.194835 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:11:46.195686 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-fb068109-1dba-4774-87aa-b3ef1874c920 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Returning 404 to user: Instance ac4160c6-ca16-455e-9613-0d425932af3b could not be found. {{(pid=121402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 01 19:11:46.199013 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-fb068109-1dba-4774-87aa-b3ef1874c920 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] 10.222.0.13 "GET /compute/v2.1/servers/ac4160c6-ca16-455e-9613-0d425932af3b" status: 404 len: 111 microversion: 2.1 time: 0.081195 Nov 01 19:11:46.207426 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 2081/4225] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:11:46 2022] GET /compute/v2.1/servers/ac4160c6-ca16-455e-9613-0d425932af3b => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 01 19:11:46.212796 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-fe368b22-21b9-4658-bb60-64dda4e8546d tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:11:46.215675 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-fe368b22-21b9-4658-bb60-64dda4e8546d tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] [instance: 674f7fae-6219-4e5e-b85a-2647b948807e] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:11:46.230598 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-fe368b22-21b9-4658-bb60-64dda4e8546d tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:11:46.231234 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-fe368b22-21b9-4658-bb60-64dda4e8546d tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:11:46.231786 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-fe368b22-21b9-4658-bb60-64dda4e8546d tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:11:46.238922 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-fe368b22-21b9-4658-bb60-64dda4e8546d tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:11:46.239616 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-fe368b22-21b9-4658-bb60-64dda4e8546d tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:11:46.240160 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-fe368b22-21b9-4658-bb60-64dda4e8546d tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:11:46.270435 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.wsgi [None req-fe368b22-21b9-4658-bb60-64dda4e8546d tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] HTTP exception thrown: Instance 674f7fae-6219-4e5e-b85a-2647b948807e could not be found. Nov 01 19:11:46.272396 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-fe368b22-21b9-4658-bb60-64dda4e8546d tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Request method failure captured: Nov 01 19:11:46.272396 n-d-863052-2 devstack@n-api.service[121402]: request: DELETE /compute/v2.1/servers/674f7fae-6219-4e5e-b85a-2647b948807e HTTP/1.1 Nov 01 19:11:46.272396 n-d-863052-2 devstack@n-api.service[121402]: Accept: application/json Nov 01 19:11:46.272396 n-d-863052-2 devstack@n-api.service[121402]: Accept-Encoding: identity Nov 01 19:11:46.272396 n-d-863052-2 devstack@n-api.service[121402]: Connection: close Nov 01 19:11:46.272396 n-d-863052-2 devstack@n-api.service[121402]: Content-Length: 0 Nov 01 19:11:46.272396 n-d-863052-2 devstack@n-api.service[121402]: Content-Type: application/json Nov 01 19:11:46.272396 n-d-863052-2 devstack@n-api.service[121402]: Host: 10.222.0.13 Nov 01 19:11:46.272396 n-d-863052-2 devstack@n-api.service[121402]: Openstack-System-Scope: None Nov 01 19:11:46.272396 n-d-863052-2 devstack@n-api.service[121402]: User-Agent: python-urllib3/1.26.12 Nov 01 19:11:46.272396 n-d-863052-2 devstack@n-api.service[121402]: X-Auth-Token: gAAAAABjYW26-niUURjtSz2aypPDgkYX79sMl0CZOJW_ml_lGFRo-4lOtvHbbGMI0UBaScGrQfLye0e0L4c10ym8MikDvB1h-T3Rh6fQQzcKLxsRSm1saxobVhs9el4Qiq-2aZx04HWuIjPot0FuuMjXsFtl108kYD3rs-RWb4TVydSfipjFJKk Nov 01 19:11:46.272396 n-d-863052-2 devstack@n-api.service[121402]: X-Domain-Id: None Nov 01 19:11:46.272396 n-d-863052-2 devstack@n-api.service[121402]: X-Domain-Name: None Nov 01 19:11:46.272396 n-d-863052-2 devstack@n-api.service[121402]: X-Identity-Status: Confirmed Nov 01 19:11:46.272396 n-d-863052-2 devstack@n-api.service[121402]: X-Is-Admin-Project: True Nov 01 19:11:46.272396 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Domain-Id: default Nov 01 19:11:46.272396 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Domain-Name: Default Nov 01 19:11:46.272396 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Id: 33e3d319293c46b6af2f728a50586906 Nov 01 19:11:46.272396 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Name: tempest-AttachVolumeNegativeTest-517167560 Nov 01 19:11:46.272396 n-d-863052-2 devstack@n-api.service[121402]: X-Role: member,reader Nov 01 19:11:46.272396 n-d-863052-2 devstack@n-api.service[121402]: X-Roles: member,reader Nov 01 19:11:46.272396 n-d-863052-2 devstack@n-api.service[121402]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/33e3d319293c46b6af2f728a50586906"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/33e3d319293c46b6af2f728a50586906"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_33e3d319293c46b6af2f728a50586906", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/33e3d319293c46b6af2f728a50586906"}]}] Nov 01 19:11:46.272396 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant: tempest-AttachVolumeNegativeTest-517167560 Nov 01 19:11:46.272396 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant-Id: 33e3d319293c46b6af2f728a50586906 Nov 01 19:11:46.272396 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-517167560 Nov 01 19:11:46.272396 n-d-863052-2 devstack@n-api.service[121402]: X-User: tempest-AttachVolumeNegativeTest-517167560-project Nov 01 19:11:46.272396 n-d-863052-2 devstack@n-api.service[121402]: X-User-Domain-Id: default Nov 01 19:11:46.272396 n-d-863052-2 devstack@n-api.service[121402]: X-User-Domain-Name: Default Nov 01 19:11:46.272396 n-d-863052-2 devstack@n-api.service[121402]: X-User-Id: 790f3f1566b7464aaca19d4d05c0942e Nov 01 19:11:46.272396 n-d-863052-2 devstack@n-api.service[121402]: X-User-Name: tempest-AttachVolumeNegativeTest-517167560-project Nov 01 19:11:46.272396 n-d-863052-2 devstack@n-api.service[121402]: method: > Nov 01 19:11:46.272396 n-d-863052-2 devstack@n-api.service[121402]: exception: Instance 674f7fae-6219-4e5e-b85a-2647b948807e could not be found. Nov 01 19:11:46.272396 n-d-863052-2 devstack@n-api.service[121402]: action_args: {'id': '674f7fae-6219-4e5e-b85a-2647b948807e'} Nov 01 19:11:46.272396 n-d-863052-2 devstack@n-api.service[121402]: {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 01 19:11:46.272396 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:11:46.272396 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 01 19:11:46.272396 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 01 19:11:46.272396 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 01 19:11:46.272396 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 01 19:11:46.272396 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 01 19:11:46.272396 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 01 19:11:46.272396 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 01 19:11:46.272396 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 01 19:11:46.272396 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 674f7fae-6219-4e5e-b85a-2647b948807e could not be found. Nov 01 19:11:46.272396 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:11:46.272396 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:11:46.272396 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:11:46.272396 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:11:46.272396 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:11:46.272396 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:11:46.272396 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 01 19:11:46.272396 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 01 19:11:46.272396 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 01 19:11:46.272396 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 01 19:11:46.272396 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 01 19:11:46.272396 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 01 19:11:46.272396 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 01 19:11:46.272396 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 01 19:11:46.272396 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 01 19:11:46.272396 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 01 19:11:46.272396 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 01 19:11:46.272396 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 01 19:11:46.275886 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 674f7fae-6219-4e5e-b85a-2647b948807e could not be found. Nov 01 19:11:46.275886 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:11:46.275886 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:11:46.275886 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:11:46.275886 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:11:46.275886 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:11:46.275886 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:11:46.275886 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 01 19:11:46.275886 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 01 19:11:46.275886 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 674f7fae-6219-4e5e-b85a-2647b948807e could not be found. Nov 01 19:11:46.275886 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:11:46.278851 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-fe368b22-21b9-4658-bb60-64dda4e8546d tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Returning 404 to user: Instance 674f7fae-6219-4e5e-b85a-2647b948807e could not be found. {{(pid=121402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 01 19:11:46.291142 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-fe368b22-21b9-4658-bb60-64dda4e8546d tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] 10.222.0.13 "DELETE /compute/v2.1/servers/674f7fae-6219-4e5e-b85a-2647b948807e" status: 404 len: 111 microversion: 2.1 time: 0.081527 Nov 01 19:11:46.292004 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 2082/4226] 10.222.0.13 () {58 vars in 1239 bytes} [Tue Nov 1 19:11:46 2022] DELETE /compute/v2.1/servers/674f7fae-6219-4e5e-b85a-2647b948807e => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 01 19:11:46.303029 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-e5f2df1f-7679-44e9-acc8-4552a2e32673 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:11:46.303674 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-e5f2df1f-7679-44e9-acc8-4552a2e32673 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] [instance: 674f7fae-6219-4e5e-b85a-2647b948807e] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:11:46.319247 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e5f2df1f-7679-44e9-acc8-4552a2e32673 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:11:46.320360 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e5f2df1f-7679-44e9-acc8-4552a2e32673 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:11:46.320962 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e5f2df1f-7679-44e9-acc8-4552a2e32673 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:11:46.330852 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e5f2df1f-7679-44e9-acc8-4552a2e32673 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:11:46.331509 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e5f2df1f-7679-44e9-acc8-4552a2e32673 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:11:46.332181 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e5f2df1f-7679-44e9-acc8-4552a2e32673 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:11:46.359848 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.wsgi [None req-e5f2df1f-7679-44e9-acc8-4552a2e32673 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] HTTP exception thrown: Instance 674f7fae-6219-4e5e-b85a-2647b948807e could not be found. Nov 01 19:11:46.362828 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-e5f2df1f-7679-44e9-acc8-4552a2e32673 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Request method failure captured: Nov 01 19:11:46.362828 n-d-863052-2 devstack@n-api.service[121402]: request: GET /compute/v2.1/servers/674f7fae-6219-4e5e-b85a-2647b948807e HTTP/1.1 Nov 01 19:11:46.362828 n-d-863052-2 devstack@n-api.service[121402]: Accept: application/json Nov 01 19:11:46.362828 n-d-863052-2 devstack@n-api.service[121402]: Accept-Encoding: identity Nov 01 19:11:46.362828 n-d-863052-2 devstack@n-api.service[121402]: Connection: close Nov 01 19:11:46.362828 n-d-863052-2 devstack@n-api.service[121402]: Content-Length: 0 Nov 01 19:11:46.362828 n-d-863052-2 devstack@n-api.service[121402]: Content-Type: application/json Nov 01 19:11:46.362828 n-d-863052-2 devstack@n-api.service[121402]: Host: 10.222.0.13 Nov 01 19:11:46.362828 n-d-863052-2 devstack@n-api.service[121402]: Openstack-System-Scope: None Nov 01 19:11:46.362828 n-d-863052-2 devstack@n-api.service[121402]: User-Agent: python-urllib3/1.26.12 Nov 01 19:11:46.362828 n-d-863052-2 devstack@n-api.service[121402]: X-Auth-Token: gAAAAABjYW26-niUURjtSz2aypPDgkYX79sMl0CZOJW_ml_lGFRo-4lOtvHbbGMI0UBaScGrQfLye0e0L4c10ym8MikDvB1h-T3Rh6fQQzcKLxsRSm1saxobVhs9el4Qiq-2aZx04HWuIjPot0FuuMjXsFtl108kYD3rs-RWb4TVydSfipjFJKk Nov 01 19:11:46.362828 n-d-863052-2 devstack@n-api.service[121402]: X-Domain-Id: None Nov 01 19:11:46.362828 n-d-863052-2 devstack@n-api.service[121402]: X-Domain-Name: None Nov 01 19:11:46.362828 n-d-863052-2 devstack@n-api.service[121402]: X-Identity-Status: Confirmed Nov 01 19:11:46.362828 n-d-863052-2 devstack@n-api.service[121402]: X-Is-Admin-Project: True Nov 01 19:11:46.362828 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Domain-Id: default Nov 01 19:11:46.362828 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Domain-Name: Default Nov 01 19:11:46.362828 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Id: 33e3d319293c46b6af2f728a50586906 Nov 01 19:11:46.362828 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Name: tempest-AttachVolumeNegativeTest-517167560 Nov 01 19:11:46.362828 n-d-863052-2 devstack@n-api.service[121402]: X-Role: member,reader Nov 01 19:11:46.362828 n-d-863052-2 devstack@n-api.service[121402]: X-Roles: member,reader Nov 01 19:11:46.362828 n-d-863052-2 devstack@n-api.service[121402]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/33e3d319293c46b6af2f728a50586906"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/33e3d319293c46b6af2f728a50586906"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_33e3d319293c46b6af2f728a50586906", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/33e3d319293c46b6af2f728a50586906"}]}] Nov 01 19:11:46.362828 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant: tempest-AttachVolumeNegativeTest-517167560 Nov 01 19:11:46.362828 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant-Id: 33e3d319293c46b6af2f728a50586906 Nov 01 19:11:46.362828 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-517167560 Nov 01 19:11:46.362828 n-d-863052-2 devstack@n-api.service[121402]: X-User: tempest-AttachVolumeNegativeTest-517167560-project Nov 01 19:11:46.362828 n-d-863052-2 devstack@n-api.service[121402]: X-User-Domain-Id: default Nov 01 19:11:46.362828 n-d-863052-2 devstack@n-api.service[121402]: X-User-Domain-Name: Default Nov 01 19:11:46.362828 n-d-863052-2 devstack@n-api.service[121402]: X-User-Id: 790f3f1566b7464aaca19d4d05c0942e Nov 01 19:11:46.362828 n-d-863052-2 devstack@n-api.service[121402]: X-User-Name: tempest-AttachVolumeNegativeTest-517167560-project Nov 01 19:11:46.362828 n-d-863052-2 devstack@n-api.service[121402]: method: > Nov 01 19:11:46.362828 n-d-863052-2 devstack@n-api.service[121402]: exception: Instance 674f7fae-6219-4e5e-b85a-2647b948807e could not be found. Nov 01 19:11:46.362828 n-d-863052-2 devstack@n-api.service[121402]: action_args: {'id': '674f7fae-6219-4e5e-b85a-2647b948807e'} Nov 01 19:11:46.362828 n-d-863052-2 devstack@n-api.service[121402]: {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 01 19:11:46.362828 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:11:46.362828 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 01 19:11:46.362828 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 01 19:11:46.362828 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 01 19:11:46.362828 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 01 19:11:46.362828 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 01 19:11:46.362828 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 01 19:11:46.362828 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 01 19:11:46.362828 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 01 19:11:46.362828 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 674f7fae-6219-4e5e-b85a-2647b948807e could not be found. Nov 01 19:11:46.362828 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:11:46.362828 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:11:46.362828 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:11:46.362828 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:11:46.362828 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:11:46.362828 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:11:46.362828 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 01 19:11:46.362828 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 01 19:11:46.362828 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 01 19:11:46.362828 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 01 19:11:46.362828 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 01 19:11:46.362828 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 01 19:11:46.362828 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 01 19:11:46.362828 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 01 19:11:46.362828 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 01 19:11:46.362828 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 01 19:11:46.362828 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 674f7fae-6219-4e5e-b85a-2647b948807e could not be found. Nov 01 19:11:46.362828 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:11:46.362828 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:11:46.362828 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:11:46.365988 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:11:46.365988 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:11:46.365988 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:11:46.365988 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 01 19:11:46.365988 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 01 19:11:46.365988 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 674f7fae-6219-4e5e-b85a-2647b948807e could not be found. Nov 01 19:11:46.365988 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:11:46.377132 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-e5f2df1f-7679-44e9-acc8-4552a2e32673 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Returning 404 to user: Instance 674f7fae-6219-4e5e-b85a-2647b948807e could not be found. {{(pid=121402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 01 19:11:46.378510 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-e5f2df1f-7679-44e9-acc8-4552a2e32673 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] 10.222.0.13 "GET /compute/v2.1/servers/674f7fae-6219-4e5e-b85a-2647b948807e" status: 404 len: 111 microversion: 2.1 time: 0.080583 Nov 01 19:11:46.383429 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 2083/4227] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:11:46 2022] GET /compute/v2.1/servers/674f7fae-6219-4e5e-b85a-2647b948807e => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 01 19:11:47.028737 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-aac1f4cb-3598-44bb-9bc4-992504d8fe53 tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:11:47.030139 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-aac1f4cb-3598-44bb-9bc4-992504d8fe53 tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] [instance: cae1c729-7c41-488d-ab0e-30d1f5d22180] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:11:47.050672 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-aac1f4cb-3598-44bb-9bc4-992504d8fe53 tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:11:47.051169 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-aac1f4cb-3598-44bb-9bc4-992504d8fe53 tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:11:47.051613 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-aac1f4cb-3598-44bb-9bc4-992504d8fe53 tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:11:47.052328 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-aac1f4cb-3598-44bb-9bc4-992504d8fe53 tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:11:47.052813 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-aac1f4cb-3598-44bb-9bc4-992504d8fe53 tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:11:47.057066 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-aac1f4cb-3598-44bb-9bc4-992504d8fe53 tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:11:47.147778 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.virt.hardware [None req-278033c6-dac4-476a-9412-9852f9773f6a tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Flavor limits 0:0:0 {{(pid=121403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 01 19:11:47.156022 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.virt.hardware [None req-278033c6-dac4-476a-9412-9852f9773f6a tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Image limits 0:0:0 {{(pid=121403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 01 19:11:47.157098 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.virt.hardware [None req-278033c6-dac4-476a-9412-9852f9773f6a tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Flavor pref 0:0:0 {{(pid=121403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 01 19:11:47.157906 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.virt.hardware [None req-278033c6-dac4-476a-9412-9852f9773f6a tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Image pref 0:0:0 {{(pid=121403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 01 19:11:47.158536 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.virt.hardware [None req-278033c6-dac4-476a-9412-9852f9773f6a tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 01 19:11:47.179360 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-278033c6-dac4-476a-9412-9852f9773f6a tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:11:47.181097 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-278033c6-dac4-476a-9412-9852f9773f6a tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:11:47.184091 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-278033c6-dac4-476a-9412-9852f9773f6a tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:11:47.188342 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-278033c6-dac4-476a-9412-9852f9773f6a tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:11:47.189136 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-278033c6-dac4-476a-9412-9852f9773f6a tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:11:47.190859 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-278033c6-dac4-476a-9412-9852f9773f6a tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:11:47.247901 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.quota [None req-278033c6-dac4-476a-9412-9852f9773f6a tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Getting quotas for project 9ecdc83933544a899117531a960027a7. Resources: {'cores', 'ram', 'instances'} {{(pid=121403) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 01 19:11:47.279614 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.quota [None req-278033c6-dac4-476a-9412-9852f9773f6a tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Getting quotas for user 3fc5c19b930543f5a5091922a9859813 and project 9ecdc83933544a899117531a960027a7. Resources: {'cores', 'ram', 'instances'} {{(pid=121403) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 01 19:11:47.311315 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-278033c6-dac4-476a-9412-9852f9773f6a tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Going to run 1 instances... {{(pid=121403) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 01 19:11:47.319214 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-278033c6-dac4-476a-9412-9852f9773f6a tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] [instance: 31bf7572-3418-4fbd-9356-03a890258701] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2d4a0047-1b9e-445f-8af8-1b5c9d93e881',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121403) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 01 19:11:47.451875 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-278033c6-dac4-476a-9412-9852f9773f6a tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.175480 Nov 01 19:11:47.460241 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 2145/4228] 10.222.0.13 () {60 vars in 1147 bytes} [Tue Nov 1 19:11:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 3187 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 01 19:11:47.475426 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-be0f7a08-3b0f-4341-ab22-357be483a265 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:11:47.476965 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-be0f7a08-3b0f-4341-ab22-357be483a265 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] [instance: 31bf7572-3418-4fbd-9356-03a890258701] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:11:47.694721 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-be0f7a08-3b0f-4341-ab22-357be483a265 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc5c19b930543f5a5091922a9859813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ecdc83933544a899117531a960027a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:11:47.709944 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-be0f7a08-3b0f-4341-ab22-357be483a265 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] 10.222.0.13 "GET /compute/v2.1/servers/31bf7572-3418-4fbd-9356-03a890258701" status: 200 len: 1217 microversion: 2.1 time: 0.241766 Nov 01 19:11:47.711051 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 2146/4229] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:11:47 2022] GET /compute/v2.1/servers/31bf7572-3418-4fbd-9356-03a890258701 => generated 1217 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:11:48.404790 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-aac1f4cb-3598-44bb-9bc4-992504d8fe53 tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcf93260eaef487dac5d7bb00b26e3b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73cb8697de6d407ba82c334d9f2b48d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:11:48.427029 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-aac1f4cb-3598-44bb-9bc4-992504d8fe53 tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] 10.222.0.13 "GET /compute/v2.1/servers/cae1c729-7c41-488d-ab0e-30d1f5d22180" status: 200 len: 1548 microversion: 2.1 time: 1.402720 Nov 01 19:11:48.430979 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 2084/4230] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:11:47 2022] GET /compute/v2.1/servers/cae1c729-7c41-488d-ab0e-30d1f5d22180 => generated 1548 bytes in 1407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 19:11:48.462794 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-0255b181-5390-429a-98d1-ded1e51f506d tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:11:48.465137 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-0255b181-5390-429a-98d1-ded1e51f506d tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] [instance: cae1c729-7c41-488d-ab0e-30d1f5d22180] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:11:48.484732 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-0255b181-5390-429a-98d1-ded1e51f506d tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:11:48.488321 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-0255b181-5390-429a-98d1-ded1e51f506d tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:11:48.489066 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-0255b181-5390-429a-98d1-ded1e51f506d tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:11:48.491890 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-0255b181-5390-429a-98d1-ded1e51f506d tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:11:48.492550 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-0255b181-5390-429a-98d1-ded1e51f506d tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:11:48.493160 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-0255b181-5390-429a-98d1-ded1e51f506d tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:11:48.740758 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-efe6bd1c-4691-4db8-9254-e2039f2b121b tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:11:48.741610 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-efe6bd1c-4691-4db8-9254-e2039f2b121b tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] [instance: 31bf7572-3418-4fbd-9356-03a890258701] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:11:48.780605 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-efe6bd1c-4691-4db8-9254-e2039f2b121b tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:11:48.780605 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-efe6bd1c-4691-4db8-9254-e2039f2b121b tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:11:48.780605 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-efe6bd1c-4691-4db8-9254-e2039f2b121b tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:11:48.780605 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-efe6bd1c-4691-4db8-9254-e2039f2b121b tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:11:48.780605 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-efe6bd1c-4691-4db8-9254-e2039f2b121b tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:11:48.789891 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-efe6bd1c-4691-4db8-9254-e2039f2b121b tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:11:48.848574 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-0255b181-5390-429a-98d1-ded1e51f506d tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] 10.222.0.13 "GET /compute/v2.1/servers/cae1c729-7c41-488d-ab0e-30d1f5d22180/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.391822 Nov 01 19:11:48.849415 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 2147/4231] 10.222.0.13 () {58 vars in 1275 bytes} [Tue Nov 1 19:11:48 2022] GET /compute/v2.1/servers/cae1c729-7c41-488d-ab0e-30d1f5d22180/os-interface => generated 284 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 01 19:11:48.858920 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-59465f5c-76ec-4474-8b57-4d5f636c020b tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:11:48.859666 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-59465f5c-76ec-4474-8b57-4d5f636c020b tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] [instance: ba6ffc5c-84a4-40f1-bdc7-f87dde2c99df] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:11:48.888436 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-59465f5c-76ec-4474-8b57-4d5f636c020b tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:11:48.888989 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-59465f5c-76ec-4474-8b57-4d5f636c020b tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:11:48.893016 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-59465f5c-76ec-4474-8b57-4d5f636c020b tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:11:48.895243 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-59465f5c-76ec-4474-8b57-4d5f636c020b tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:11:48.896013 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-59465f5c-76ec-4474-8b57-4d5f636c020b tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:11:48.897228 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-59465f5c-76ec-4474-8b57-4d5f636c020b tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:11:48.967814 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.wsgi [None req-59465f5c-76ec-4474-8b57-4d5f636c020b tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] HTTP exception thrown: Instance ba6ffc5c-84a4-40f1-bdc7-f87dde2c99df could not be found. Nov 01 19:11:48.969975 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-59465f5c-76ec-4474-8b57-4d5f636c020b tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Request method failure captured: Nov 01 19:11:48.969975 n-d-863052-2 devstack@n-api.service[121403]: request: DELETE /compute/v2.1/servers/ba6ffc5c-84a4-40f1-bdc7-f87dde2c99df HTTP/1.1 Nov 01 19:11:48.969975 n-d-863052-2 devstack@n-api.service[121403]: Accept: application/json Nov 01 19:11:48.969975 n-d-863052-2 devstack@n-api.service[121403]: Accept-Encoding: identity Nov 01 19:11:48.969975 n-d-863052-2 devstack@n-api.service[121403]: Connection: close Nov 01 19:11:48.969975 n-d-863052-2 devstack@n-api.service[121403]: Content-Length: 0 Nov 01 19:11:48.969975 n-d-863052-2 devstack@n-api.service[121403]: Content-Type: application/json Nov 01 19:11:48.969975 n-d-863052-2 devstack@n-api.service[121403]: Host: 10.222.0.13 Nov 01 19:11:48.969975 n-d-863052-2 devstack@n-api.service[121403]: Openstack-System-Scope: None Nov 01 19:11:48.969975 n-d-863052-2 devstack@n-api.service[121403]: User-Agent: python-urllib3/1.26.12 Nov 01 19:11:48.969975 n-d-863052-2 devstack@n-api.service[121403]: X-Auth-Token: gAAAAABjYW3EOHzEH64j_KBBQYcNunLrukxedHCJNlYLjUk4zQx-sawgKsr5qcXOr1N0C3iybtUeOQ80bxR5aK1WFQhX-tdUpqAUNKmgReQT8ZS9wY9zA7-HcWOfygbtS8i9r8irZqvv2XSM2Sn6RT4cdv930usQU5qU9eZE2-ew_aeZg78UNo4 Nov 01 19:11:48.969975 n-d-863052-2 devstack@n-api.service[121403]: X-Domain-Id: None Nov 01 19:11:48.969975 n-d-863052-2 devstack@n-api.service[121403]: X-Domain-Name: None Nov 01 19:11:48.969975 n-d-863052-2 devstack@n-api.service[121403]: X-Identity-Status: Confirmed Nov 01 19:11:48.969975 n-d-863052-2 devstack@n-api.service[121403]: X-Is-Admin-Project: True Nov 01 19:11:48.969975 n-d-863052-2 devstack@n-api.service[121403]: X-Openstack-Nova-Api-Version: 2.32 Nov 01 19:11:48.969975 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Domain-Id: default Nov 01 19:11:48.969975 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Domain-Name: Default Nov 01 19:11:48.969975 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Id: adf4adda91364dab94830347c06e3957 Nov 01 19:11:48.969975 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Name: tempest-TaggedBootDevicesTest-1622381130 Nov 01 19:11:48.969975 n-d-863052-2 devstack@n-api.service[121403]: X-Role: member,reader Nov 01 19:11:48.969975 n-d-863052-2 devstack@n-api.service[121403]: X-Roles: member,reader Nov 01 19:11:48.969975 n-d-863052-2 devstack@n-api.service[121403]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/adf4adda91364dab94830347c06e3957"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/adf4adda91364dab94830347c06e3957"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_adf4adda91364dab94830347c06e3957", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/adf4adda91364dab94830347c06e3957"}]}] Nov 01 19:11:48.969975 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant: tempest-TaggedBootDevicesTest-1622381130 Nov 01 19:11:48.969975 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant-Id: adf4adda91364dab94830347c06e3957 Nov 01 19:11:48.969975 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant-Name: tempest-TaggedBootDevicesTest-1622381130 Nov 01 19:11:48.969975 n-d-863052-2 devstack@n-api.service[121403]: X-User: tempest-TaggedBootDevicesTest-1622381130-project Nov 01 19:11:48.969975 n-d-863052-2 devstack@n-api.service[121403]: X-User-Domain-Id: default Nov 01 19:11:48.969975 n-d-863052-2 devstack@n-api.service[121403]: X-User-Domain-Name: Default Nov 01 19:11:48.969975 n-d-863052-2 devstack@n-api.service[121403]: X-User-Id: cd2105b0264b48d084d0e79cabff8bc4 Nov 01 19:11:48.969975 n-d-863052-2 devstack@n-api.service[121403]: X-User-Name: tempest-TaggedBootDevicesTest-1622381130-project Nov 01 19:11:48.969975 n-d-863052-2 devstack@n-api.service[121403]: method: > Nov 01 19:11:48.969975 n-d-863052-2 devstack@n-api.service[121403]: exception: Instance ba6ffc5c-84a4-40f1-bdc7-f87dde2c99df could not be found. Nov 01 19:11:48.969975 n-d-863052-2 devstack@n-api.service[121403]: action_args: {'id': 'ba6ffc5c-84a4-40f1-bdc7-f87dde2c99df'} Nov 01 19:11:48.969975 n-d-863052-2 devstack@n-api.service[121403]: {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 01 19:11:48.969975 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:11:48.969975 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 01 19:11:48.969975 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 01 19:11:48.969975 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 01 19:11:48.969975 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 01 19:11:48.969975 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 01 19:11:48.969975 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 01 19:11:48.969975 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 01 19:11:48.969975 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 01 19:11:48.969975 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ba6ffc5c-84a4-40f1-bdc7-f87dde2c99df could not be found. Nov 01 19:11:48.969975 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:11:48.969975 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:11:48.969975 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:11:48.969975 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:11:48.969975 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:11:48.969975 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:11:48.969975 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 01 19:11:48.969975 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 01 19:11:48.969975 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 01 19:11:48.969975 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 01 19:11:48.969975 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 01 19:11:48.969975 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 01 19:11:48.969975 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 01 19:11:48.969975 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 01 19:11:48.969975 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 01 19:11:48.969975 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 01 19:11:48.969975 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 01 19:11:48.969975 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 01 19:11:48.973425 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ba6ffc5c-84a4-40f1-bdc7-f87dde2c99df could not be found. Nov 01 19:11:48.973425 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:11:48.973425 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:11:48.973425 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:11:48.973425 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:11:48.973425 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:11:48.973425 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:11:48.973425 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 01 19:11:48.973425 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 01 19:11:48.973425 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ba6ffc5c-84a4-40f1-bdc7-f87dde2c99df could not be found. Nov 01 19:11:48.973425 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:11:48.977144 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-59465f5c-76ec-4474-8b57-4d5f636c020b tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Returning 404 to user: Instance ba6ffc5c-84a4-40f1-bdc7-f87dde2c99df could not be found. {{(pid=121403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 01 19:11:48.979128 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-59465f5c-76ec-4474-8b57-4d5f636c020b tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] 10.222.0.13 "DELETE /compute/v2.1/servers/ba6ffc5c-84a4-40f1-bdc7-f87dde2c99df" status: 404 len: 111 microversion: 2.32 time: 0.127179 Nov 01 19:11:48.983122 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 2148/4232] 10.222.0.13 () {60 vars in 1280 bytes} [Tue Nov 1 19:11:48 2022] DELETE /compute/v2.1/servers/ba6ffc5c-84a4-40f1-bdc7-f87dde2c99df => generated 111 bytes in 132 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 01 19:11:48.992612 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-8c69d61d-494b-44fc-a10c-33f2a6dce868 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:11:48.997585 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-8c69d61d-494b-44fc-a10c-33f2a6dce868 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] [instance: ba6ffc5c-84a4-40f1-bdc7-f87dde2c99df] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:11:49.011079 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-8c69d61d-494b-44fc-a10c-33f2a6dce868 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:11:49.011826 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-8c69d61d-494b-44fc-a10c-33f2a6dce868 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:11:49.014618 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-8c69d61d-494b-44fc-a10c-33f2a6dce868 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:11:49.020445 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-8c69d61d-494b-44fc-a10c-33f2a6dce868 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:11:49.027203 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-8c69d61d-494b-44fc-a10c-33f2a6dce868 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:11:49.027203 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-8c69d61d-494b-44fc-a10c-33f2a6dce868 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:11:49.096538 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.wsgi [None req-8c69d61d-494b-44fc-a10c-33f2a6dce868 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] HTTP exception thrown: Instance ba6ffc5c-84a4-40f1-bdc7-f87dde2c99df could not be found. Nov 01 19:11:49.099269 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-8c69d61d-494b-44fc-a10c-33f2a6dce868 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Request method failure captured: Nov 01 19:11:49.099269 n-d-863052-2 devstack@n-api.service[121403]: request: GET /compute/v2.1/servers/ba6ffc5c-84a4-40f1-bdc7-f87dde2c99df HTTP/1.1 Nov 01 19:11:49.099269 n-d-863052-2 devstack@n-api.service[121403]: Accept: application/json Nov 01 19:11:49.099269 n-d-863052-2 devstack@n-api.service[121403]: Accept-Encoding: identity Nov 01 19:11:49.099269 n-d-863052-2 devstack@n-api.service[121403]: Connection: close Nov 01 19:11:49.099269 n-d-863052-2 devstack@n-api.service[121403]: Content-Length: 0 Nov 01 19:11:49.099269 n-d-863052-2 devstack@n-api.service[121403]: Content-Type: application/json Nov 01 19:11:49.099269 n-d-863052-2 devstack@n-api.service[121403]: Host: 10.222.0.13 Nov 01 19:11:49.099269 n-d-863052-2 devstack@n-api.service[121403]: Openstack-System-Scope: None Nov 01 19:11:49.099269 n-d-863052-2 devstack@n-api.service[121403]: User-Agent: python-urllib3/1.26.12 Nov 01 19:11:49.099269 n-d-863052-2 devstack@n-api.service[121403]: X-Auth-Token: gAAAAABjYW3EOHzEH64j_KBBQYcNunLrukxedHCJNlYLjUk4zQx-sawgKsr5qcXOr1N0C3iybtUeOQ80bxR5aK1WFQhX-tdUpqAUNKmgReQT8ZS9wY9zA7-HcWOfygbtS8i9r8irZqvv2XSM2Sn6RT4cdv930usQU5qU9eZE2-ew_aeZg78UNo4 Nov 01 19:11:49.099269 n-d-863052-2 devstack@n-api.service[121403]: X-Domain-Id: None Nov 01 19:11:49.099269 n-d-863052-2 devstack@n-api.service[121403]: X-Domain-Name: None Nov 01 19:11:49.099269 n-d-863052-2 devstack@n-api.service[121403]: X-Identity-Status: Confirmed Nov 01 19:11:49.099269 n-d-863052-2 devstack@n-api.service[121403]: X-Is-Admin-Project: True Nov 01 19:11:49.099269 n-d-863052-2 devstack@n-api.service[121403]: X-Openstack-Nova-Api-Version: 2.32 Nov 01 19:11:49.099269 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Domain-Id: default Nov 01 19:11:49.099269 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Domain-Name: Default Nov 01 19:11:49.099269 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Id: adf4adda91364dab94830347c06e3957 Nov 01 19:11:49.099269 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Name: tempest-TaggedBootDevicesTest-1622381130 Nov 01 19:11:49.099269 n-d-863052-2 devstack@n-api.service[121403]: X-Role: member,reader Nov 01 19:11:49.099269 n-d-863052-2 devstack@n-api.service[121403]: X-Roles: member,reader Nov 01 19:11:49.099269 n-d-863052-2 devstack@n-api.service[121403]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/adf4adda91364dab94830347c06e3957"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/adf4adda91364dab94830347c06e3957"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_adf4adda91364dab94830347c06e3957", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/adf4adda91364dab94830347c06e3957"}]}] Nov 01 19:11:49.099269 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant: tempest-TaggedBootDevicesTest-1622381130 Nov 01 19:11:49.099269 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant-Id: adf4adda91364dab94830347c06e3957 Nov 01 19:11:49.099269 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant-Name: tempest-TaggedBootDevicesTest-1622381130 Nov 01 19:11:49.099269 n-d-863052-2 devstack@n-api.service[121403]: X-User: tempest-TaggedBootDevicesTest-1622381130-project Nov 01 19:11:49.099269 n-d-863052-2 devstack@n-api.service[121403]: X-User-Domain-Id: default Nov 01 19:11:49.099269 n-d-863052-2 devstack@n-api.service[121403]: X-User-Domain-Name: Default Nov 01 19:11:49.099269 n-d-863052-2 devstack@n-api.service[121403]: X-User-Id: cd2105b0264b48d084d0e79cabff8bc4 Nov 01 19:11:49.099269 n-d-863052-2 devstack@n-api.service[121403]: X-User-Name: tempest-TaggedBootDevicesTest-1622381130-project Nov 01 19:11:49.099269 n-d-863052-2 devstack@n-api.service[121403]: method: > Nov 01 19:11:49.099269 n-d-863052-2 devstack@n-api.service[121403]: exception: Instance ba6ffc5c-84a4-40f1-bdc7-f87dde2c99df could not be found. Nov 01 19:11:49.099269 n-d-863052-2 devstack@n-api.service[121403]: action_args: {'id': 'ba6ffc5c-84a4-40f1-bdc7-f87dde2c99df'} Nov 01 19:11:49.099269 n-d-863052-2 devstack@n-api.service[121403]: {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 01 19:11:49.099269 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:11:49.099269 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 01 19:11:49.099269 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 01 19:11:49.099269 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 01 19:11:49.099269 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 01 19:11:49.099269 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 01 19:11:49.099269 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 01 19:11:49.099269 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 01 19:11:49.099269 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 01 19:11:49.099269 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ba6ffc5c-84a4-40f1-bdc7-f87dde2c99df could not be found. Nov 01 19:11:49.099269 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:11:49.099269 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:11:49.099269 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:11:49.099269 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:11:49.099269 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:11:49.099269 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:11:49.099269 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 01 19:11:49.099269 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 01 19:11:49.099269 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 01 19:11:49.099269 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 01 19:11:49.099269 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 01 19:11:49.099269 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 01 19:11:49.099269 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 01 19:11:49.099269 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 01 19:11:49.099269 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 01 19:11:49.099269 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 01 19:11:49.099269 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ba6ffc5c-84a4-40f1-bdc7-f87dde2c99df could not be found. Nov 01 19:11:49.099269 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:11:49.099269 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:11:49.102705 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:11:49.102705 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:11:49.102705 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:11:49.102705 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:11:49.102705 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 01 19:11:49.102705 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 01 19:11:49.102705 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ba6ffc5c-84a4-40f1-bdc7-f87dde2c99df could not be found. Nov 01 19:11:49.102705 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:11:49.106826 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-8c69d61d-494b-44fc-a10c-33f2a6dce868 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] Returning 404 to user: Instance ba6ffc5c-84a4-40f1-bdc7-f87dde2c99df could not be found. {{(pid=121403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 01 19:11:49.112315 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-8c69d61d-494b-44fc-a10c-33f2a6dce868 tempest-TaggedBootDevicesTest-1622381130 tempest-TaggedBootDevicesTest-1622381130-project] 10.222.0.13 "GET /compute/v2.1/servers/ba6ffc5c-84a4-40f1-bdc7-f87dde2c99df" status: 404 len: 111 microversion: 2.32 time: 0.124505 Nov 01 19:11:49.112928 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 2149/4233] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 19:11:48 2022] GET /compute/v2.1/servers/ba6ffc5c-84a4-40f1-bdc7-f87dde2c99df => generated 111 bytes in 126 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 01 19:11:49.269538 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-efe6bd1c-4691-4db8-9254-e2039f2b121b tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc5c19b930543f5a5091922a9859813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ecdc83933544a899117531a960027a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:11:49.279813 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-efe6bd1c-4691-4db8-9254-e2039f2b121b tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] 10.222.0.13 "GET /compute/v2.1/servers/31bf7572-3418-4fbd-9356-03a890258701" status: 200 len: 1213 microversion: 2.1 time: 0.545852 Nov 01 19:11:49.287280 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 2085/4234] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:11:48 2022] GET /compute/v2.1/servers/31bf7572-3418-4fbd-9356-03a890258701 => generated 1213 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 19:11:50.311257 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-3cfca084-2c33-448d-8174-43e264e93d8d tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:11:50.313061 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-3cfca084-2c33-448d-8174-43e264e93d8d tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] [instance: 31bf7572-3418-4fbd-9356-03a890258701] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:11:50.335829 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-3cfca084-2c33-448d-8174-43e264e93d8d tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:11:50.337682 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-3cfca084-2c33-448d-8174-43e264e93d8d tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:11:50.342379 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-3cfca084-2c33-448d-8174-43e264e93d8d tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:11:50.345189 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-3cfca084-2c33-448d-8174-43e264e93d8d tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:11:50.346136 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-3cfca084-2c33-448d-8174-43e264e93d8d tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:11:50.347595 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-3cfca084-2c33-448d-8174-43e264e93d8d tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:11:50.459220 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-7c85a448-19b6-4b77-bafe-64438bc1e8dc tempest-ServerGroup264TestJSON-225072818 tempest-ServerGroup264TestJSON-225072818-project] Action: 'create', calling method: .version_select at 0x7f0ae66e2a60>, body: {"server_group": {"name": "server-group", "policy": "affinity"}} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:11:50.533603 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.quota [None req-7c85a448-19b6-4b77-bafe-64438bc1e8dc tempest-ServerGroup264TestJSON-225072818 tempest-ServerGroup264TestJSON-225072818-project] Getting quotas for project 2ef59845037c462eb106b825e398a531. Resources: {'server_groups'} {{(pid=121403) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 01 19:11:50.556369 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.quota [None req-7c85a448-19b6-4b77-bafe-64438bc1e8dc tempest-ServerGroup264TestJSON-225072818 tempest-ServerGroup264TestJSON-225072818-project] Getting quotas for user ff406fd6f9284e7a9e3564f7e149a7a8 and project 2ef59845037c462eb106b825e398a531. Resources: {'server_groups'} {{(pid=121403) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 01 19:11:50.676887 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.quota [None req-7c85a448-19b6-4b77-bafe-64438bc1e8dc tempest-ServerGroup264TestJSON-225072818 tempest-ServerGroup264TestJSON-225072818-project] Getting quotas for project 2ef59845037c462eb106b825e398a531. Resources: {'server_groups'} {{(pid=121403) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 01 19:11:50.691913 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.quota [None req-7c85a448-19b6-4b77-bafe-64438bc1e8dc tempest-ServerGroup264TestJSON-225072818 tempest-ServerGroup264TestJSON-225072818-project] Getting quotas for user ff406fd6f9284e7a9e3564f7e149a7a8 and project 2ef59845037c462eb106b825e398a531. Resources: {'server_groups'} {{(pid=121403) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 01 19:11:50.718452 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-7c85a448-19b6-4b77-bafe-64438bc1e8dc tempest-ServerGroup264TestJSON-225072818 tempest-ServerGroup264TestJSON-225072818-project] 10.222.0.13 "POST /compute/v2.1/os-server-groups" status: 200 len: 235 microversion: 2.64 time: 0.643540 Nov 01 19:11:50.725686 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 2150/4235] 10.222.0.13 () {62 vars in 1214 bytes} [Tue Nov 1 19:11:50 2022] POST /compute/v2.1/os-server-groups => generated 235 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 01 19:11:50.737287 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-28474218-3f40-47cb-a3a2-745a48973f0d tempest-ServerGroup264TestJSON-225072818 tempest-ServerGroup264TestJSON-225072818-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:11:50.763027 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-28474218-3f40-47cb-a3a2-745a48973f0d tempest-ServerGroup264TestJSON-225072818 tempest-ServerGroup264TestJSON-225072818-project] 10.222.0.13 "GET /compute/v2.1/os-server-groups" status: 200 len: 238 microversion: 2.64 time: 0.030143 Nov 01 19:11:50.764201 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 2151/4236] 10.222.0.13 () {60 vars in 1193 bytes} [Tue Nov 1 19:11:50 2022] GET /compute/v2.1/os-server-groups => generated 238 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 01 19:11:50.776013 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-2909eeb9-b80c-4129-810c-6590ab9e22eb tempest-ServerGroup264TestJSON-225072818 tempest-ServerGroup264TestJSON-225072818-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:11:50.793557 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-2909eeb9-b80c-4129-810c-6590ab9e22eb tempest-ServerGroup264TestJSON-225072818 tempest-ServerGroup264TestJSON-225072818-project] 10.222.0.13 "GET /compute/v2.1/os-server-groups/2810e3f8-20ad-400f-aba1-dd96f565227c" status: 200 len: 235 microversion: 2.64 time: 0.021578 Nov 01 19:11:50.794784 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 2152/4237] 10.222.0.13 () {60 vars in 1304 bytes} [Tue Nov 1 19:11:50 2022] GET /compute/v2.1/os-server-groups/2810e3f8-20ad-400f-aba1-dd96f565227c => generated 235 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 01 19:11:50.806911 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-74bf37a5-0a15-434f-b5ab-3bb1585155fc tempest-ServerGroup264TestJSON-225072818 tempest-ServerGroup264TestJSON-225072818-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:11:50.859270 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-74bf37a5-0a15-434f-b5ab-3bb1585155fc tempest-ServerGroup264TestJSON-225072818 tempest-ServerGroup264TestJSON-225072818-project] 10.222.0.13 "DELETE /compute/v2.1/os-server-groups/2810e3f8-20ad-400f-aba1-dd96f565227c" status: 204 len: 0 microversion: 2.64 time: 0.056209 Nov 01 19:11:50.860434 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 2153/4238] 10.222.0.13 () {60 vars in 1307 bytes} [Tue Nov 1 19:11:50 2022] DELETE /compute/v2.1/os-server-groups/2810e3f8-20ad-400f-aba1-dd96f565227c => generated 0 bytes in 58 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Nov 01 19:11:50.869578 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-1c5031d1-cf3a-427f-a677-c9f87789bd73 tempest-ServerGroup264TestJSON-225072818 tempest-ServerGroup264TestJSON-225072818-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:11:50.882775 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.wsgi [None req-1c5031d1-cf3a-427f-a677-c9f87789bd73 tempest-ServerGroup264TestJSON-225072818 tempest-ServerGroup264TestJSON-225072818-project] HTTP exception thrown: Instance group 2810e3f8-20ad-400f-aba1-dd96f565227c could not be found. Nov 01 19:11:50.885549 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-1c5031d1-cf3a-427f-a677-c9f87789bd73 tempest-ServerGroup264TestJSON-225072818 tempest-ServerGroup264TestJSON-225072818-project] Request method failure captured: Nov 01 19:11:50.885549 n-d-863052-2 devstack@n-api.service[121403]: request: DELETE /compute/v2.1/os-server-groups/2810e3f8-20ad-400f-aba1-dd96f565227c HTTP/1.1 Nov 01 19:11:50.885549 n-d-863052-2 devstack@n-api.service[121403]: Accept: application/json Nov 01 19:11:50.885549 n-d-863052-2 devstack@n-api.service[121403]: Accept-Encoding: identity Nov 01 19:11:50.885549 n-d-863052-2 devstack@n-api.service[121403]: Connection: close Nov 01 19:11:50.885549 n-d-863052-2 devstack@n-api.service[121403]: Content-Length: 0 Nov 01 19:11:50.885549 n-d-863052-2 devstack@n-api.service[121403]: Content-Type: application/json Nov 01 19:11:50.885549 n-d-863052-2 devstack@n-api.service[121403]: Host: 10.222.0.13 Nov 01 19:11:50.885549 n-d-863052-2 devstack@n-api.service[121403]: Openstack-System-Scope: None Nov 01 19:11:50.885549 n-d-863052-2 devstack@n-api.service[121403]: User-Agent: python-urllib3/1.26.12 Nov 01 19:11:50.885549 n-d-863052-2 devstack@n-api.service[121403]: X-Auth-Token: gAAAAABjYW91oFLT3zPtaEO4u3vuO3XAFXWt1KRqsMw8z85kQ138XnzSNRHI5i0FbvJv8O15HTW2iAjerG8_3fi2o_hheGPkQnqgprz3SDrCvgybEusIibqoa8K-DtiXosu5E3nM4i1dERzTJPdeva8MmeJfTOUHga1EzChHhxZ0voDilFgMJk4 Nov 01 19:11:50.885549 n-d-863052-2 devstack@n-api.service[121403]: X-Domain-Id: None Nov 01 19:11:50.885549 n-d-863052-2 devstack@n-api.service[121403]: X-Domain-Name: None Nov 01 19:11:50.885549 n-d-863052-2 devstack@n-api.service[121403]: X-Identity-Status: Confirmed Nov 01 19:11:50.885549 n-d-863052-2 devstack@n-api.service[121403]: X-Is-Admin-Project: True Nov 01 19:11:50.885549 n-d-863052-2 devstack@n-api.service[121403]: X-Openstack-Nova-Api-Version: 2.64 Nov 01 19:11:50.885549 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Domain-Id: default Nov 01 19:11:50.885549 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Domain-Name: Default Nov 01 19:11:50.885549 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Id: 2ef59845037c462eb106b825e398a531 Nov 01 19:11:50.885549 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Name: tempest-ServerGroup264TestJSON-225072818 Nov 01 19:11:50.885549 n-d-863052-2 devstack@n-api.service[121403]: X-Role: member,reader Nov 01 19:11:50.885549 n-d-863052-2 devstack@n-api.service[121403]: X-Roles: member,reader Nov 01 19:11:50.885549 n-d-863052-2 devstack@n-api.service[121403]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/2ef59845037c462eb106b825e398a531"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/2ef59845037c462eb106b825e398a531"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_2ef59845037c462eb106b825e398a531", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/2ef59845037c462eb106b825e398a531"}]}] Nov 01 19:11:50.885549 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant: tempest-ServerGroup264TestJSON-225072818 Nov 01 19:11:50.885549 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant-Id: 2ef59845037c462eb106b825e398a531 Nov 01 19:11:50.885549 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant-Name: tempest-ServerGroup264TestJSON-225072818 Nov 01 19:11:50.885549 n-d-863052-2 devstack@n-api.service[121403]: X-User: tempest-ServerGroup264TestJSON-225072818-project Nov 01 19:11:50.885549 n-d-863052-2 devstack@n-api.service[121403]: X-User-Domain-Id: default Nov 01 19:11:50.885549 n-d-863052-2 devstack@n-api.service[121403]: X-User-Domain-Name: Default Nov 01 19:11:50.885549 n-d-863052-2 devstack@n-api.service[121403]: X-User-Id: ff406fd6f9284e7a9e3564f7e149a7a8 Nov 01 19:11:50.885549 n-d-863052-2 devstack@n-api.service[121403]: X-User-Name: tempest-ServerGroup264TestJSON-225072818-project Nov 01 19:11:50.885549 n-d-863052-2 devstack@n-api.service[121403]: method: > Nov 01 19:11:50.885549 n-d-863052-2 devstack@n-api.service[121403]: exception: Instance group 2810e3f8-20ad-400f-aba1-dd96f565227c could not be found. Nov 01 19:11:50.885549 n-d-863052-2 devstack@n-api.service[121403]: action_args: {'id': '2810e3f8-20ad-400f-aba1-dd96f565227c'} Nov 01 19:11:50.885549 n-d-863052-2 devstack@n-api.service[121403]: {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 01 19:11:50.885549 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:11:50.885549 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Nov 01 19:11:50.885549 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Nov 01 19:11:50.885549 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 01 19:11:50.885549 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 01 19:11:50.885549 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Nov 01 19:11:50.885549 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Nov 01 19:11:50.885549 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Nov 01 19:11:50.885549 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Nov 01 19:11:50.885549 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Nov 01 19:11:50.885549 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Nov 01 19:11:50.885549 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 2810e3f8-20ad-400f-aba1-dd96f565227c could not be found. Nov 01 19:11:50.885549 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:11:50.885549 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:11:50.885549 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:11:50.885549 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:11:50.885549 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:11:50.885549 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:11:50.885549 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 01 19:11:50.885549 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 01 19:11:50.885549 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 01 19:11:50.885549 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 01 19:11:50.885549 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Nov 01 19:11:50.885549 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Nov 01 19:11:50.885549 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 2810e3f8-20ad-400f-aba1-dd96f565227c could not be found. Nov 01 19:11:50.885549 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:11:50.885549 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:11:50.885549 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:11:50.885549 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:11:50.888728 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:11:50.888728 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:11:50.888728 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 01 19:11:50.888728 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 01 19:11:50.888728 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 2810e3f8-20ad-400f-aba1-dd96f565227c could not be found. Nov 01 19:11:50.888728 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:11:50.892790 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-1c5031d1-cf3a-427f-a677-c9f87789bd73 tempest-ServerGroup264TestJSON-225072818 tempest-ServerGroup264TestJSON-225072818-project] Returning 404 to user: Instance group 2810e3f8-20ad-400f-aba1-dd96f565227c could not be found. {{(pid=121403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 01 19:11:50.893849 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-1c5031d1-cf3a-427f-a677-c9f87789bd73 tempest-ServerGroup264TestJSON-225072818 tempest-ServerGroup264TestJSON-225072818-project] 10.222.0.13 "DELETE /compute/v2.1/os-server-groups/2810e3f8-20ad-400f-aba1-dd96f565227c" status: 404 len: 117 microversion: 2.64 time: 0.028265 Nov 01 19:11:50.901280 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 2154/4239] 10.222.0.13 () {60 vars in 1307 bytes} [Tue Nov 1 19:11:50 2022] DELETE /compute/v2.1/os-server-groups/2810e3f8-20ad-400f-aba1-dd96f565227c => generated 117 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Nov 01 19:11:51.178856 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-3cfca084-2c33-448d-8174-43e264e93d8d tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc5c19b930543f5a5091922a9859813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ecdc83933544a899117531a960027a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:11:51.191232 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-3cfca084-2c33-448d-8174-43e264e93d8d tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] 10.222.0.13 "GET /compute/v2.1/servers/31bf7572-3418-4fbd-9356-03a890258701" status: 200 len: 1275 microversion: 2.1 time: 0.884238 Nov 01 19:11:51.191817 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 2086/4240] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:11:50 2022] GET /compute/v2.1/servers/31bf7572-3418-4fbd-9356-03a890258701 => generated 1275 bytes in 886 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 19:11:52.217741 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-c12358e5-6b95-48d8-96ca-ed41aef0e495 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:11:52.220025 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-c12358e5-6b95-48d8-96ca-ed41aef0e495 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] [instance: 31bf7572-3418-4fbd-9356-03a890258701] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:11:52.254010 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-c12358e5-6b95-48d8-96ca-ed41aef0e495 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:11:52.256726 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-c12358e5-6b95-48d8-96ca-ed41aef0e495 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:11:52.257287 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-c12358e5-6b95-48d8-96ca-ed41aef0e495 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:11:52.258125 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-c12358e5-6b95-48d8-96ca-ed41aef0e495 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:11:52.261493 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-c12358e5-6b95-48d8-96ca-ed41aef0e495 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:11:52.269217 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-c12358e5-6b95-48d8-96ca-ed41aef0e495 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:11:54.508914 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-940a5526-dc73-4cfa-af84-114e62dd1ff9 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:11:54.509501 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-940a5526-dc73-4cfa-af84-114e62dd1ff9 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] [instance: 3029f3c1-4f32-4f6b-963c-16f65b6dff3c] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:11:54.529060 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-940a5526-dc73-4cfa-af84-114e62dd1ff9 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:11:54.530118 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-940a5526-dc73-4cfa-af84-114e62dd1ff9 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:11:54.531988 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-940a5526-dc73-4cfa-af84-114e62dd1ff9 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:11:54.533388 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-940a5526-dc73-4cfa-af84-114e62dd1ff9 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:11:54.541058 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-940a5526-dc73-4cfa-af84-114e62dd1ff9 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:11:54.542161 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-940a5526-dc73-4cfa-af84-114e62dd1ff9 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:11:54.568435 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.wsgi [None req-940a5526-dc73-4cfa-af84-114e62dd1ff9 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] HTTP exception thrown: Instance 3029f3c1-4f32-4f6b-963c-16f65b6dff3c could not be found. Nov 01 19:11:54.593710 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-940a5526-dc73-4cfa-af84-114e62dd1ff9 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Request method failure captured: Nov 01 19:11:54.593710 n-d-863052-2 devstack@n-api.service[121402]: request: DELETE /compute/v2.1/servers/3029f3c1-4f32-4f6b-963c-16f65b6dff3c HTTP/1.1 Nov 01 19:11:54.593710 n-d-863052-2 devstack@n-api.service[121402]: Accept: application/json Nov 01 19:11:54.593710 n-d-863052-2 devstack@n-api.service[121402]: Accept-Encoding: identity Nov 01 19:11:54.593710 n-d-863052-2 devstack@n-api.service[121402]: Connection: close Nov 01 19:11:54.593710 n-d-863052-2 devstack@n-api.service[121402]: Content-Length: 0 Nov 01 19:11:54.593710 n-d-863052-2 devstack@n-api.service[121402]: Content-Type: application/json Nov 01 19:11:54.593710 n-d-863052-2 devstack@n-api.service[121402]: Host: 10.222.0.13 Nov 01 19:11:54.593710 n-d-863052-2 devstack@n-api.service[121402]: Openstack-System-Scope: None Nov 01 19:11:54.593710 n-d-863052-2 devstack@n-api.service[121402]: User-Agent: python-urllib3/1.26.12 Nov 01 19:11:54.593710 n-d-863052-2 devstack@n-api.service[121402]: X-Auth-Token: gAAAAABjYW26-niUURjtSz2aypPDgkYX79sMl0CZOJW_ml_lGFRo-4lOtvHbbGMI0UBaScGrQfLye0e0L4c10ym8MikDvB1h-T3Rh6fQQzcKLxsRSm1saxobVhs9el4Qiq-2aZx04HWuIjPot0FuuMjXsFtl108kYD3rs-RWb4TVydSfipjFJKk Nov 01 19:11:54.593710 n-d-863052-2 devstack@n-api.service[121402]: X-Domain-Id: None Nov 01 19:11:54.593710 n-d-863052-2 devstack@n-api.service[121402]: X-Domain-Name: None Nov 01 19:11:54.593710 n-d-863052-2 devstack@n-api.service[121402]: X-Identity-Status: Confirmed Nov 01 19:11:54.593710 n-d-863052-2 devstack@n-api.service[121402]: X-Is-Admin-Project: True Nov 01 19:11:54.593710 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Domain-Id: default Nov 01 19:11:54.593710 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Domain-Name: Default Nov 01 19:11:54.593710 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Id: 33e3d319293c46b6af2f728a50586906 Nov 01 19:11:54.593710 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Name: tempest-AttachVolumeNegativeTest-517167560 Nov 01 19:11:54.593710 n-d-863052-2 devstack@n-api.service[121402]: X-Role: member,reader Nov 01 19:11:54.593710 n-d-863052-2 devstack@n-api.service[121402]: X-Roles: member,reader Nov 01 19:11:54.593710 n-d-863052-2 devstack@n-api.service[121402]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/33e3d319293c46b6af2f728a50586906"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/33e3d319293c46b6af2f728a50586906"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_33e3d319293c46b6af2f728a50586906", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/33e3d319293c46b6af2f728a50586906"}]}] Nov 01 19:11:54.593710 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant: tempest-AttachVolumeNegativeTest-517167560 Nov 01 19:11:54.593710 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant-Id: 33e3d319293c46b6af2f728a50586906 Nov 01 19:11:54.593710 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-517167560 Nov 01 19:11:54.593710 n-d-863052-2 devstack@n-api.service[121402]: X-User: tempest-AttachVolumeNegativeTest-517167560-project Nov 01 19:11:54.593710 n-d-863052-2 devstack@n-api.service[121402]: X-User-Domain-Id: default Nov 01 19:11:54.593710 n-d-863052-2 devstack@n-api.service[121402]: X-User-Domain-Name: Default Nov 01 19:11:54.593710 n-d-863052-2 devstack@n-api.service[121402]: X-User-Id: 790f3f1566b7464aaca19d4d05c0942e Nov 01 19:11:54.593710 n-d-863052-2 devstack@n-api.service[121402]: X-User-Name: tempest-AttachVolumeNegativeTest-517167560-project Nov 01 19:11:54.593710 n-d-863052-2 devstack@n-api.service[121402]: method: > Nov 01 19:11:54.593710 n-d-863052-2 devstack@n-api.service[121402]: exception: Instance 3029f3c1-4f32-4f6b-963c-16f65b6dff3c could not be found. Nov 01 19:11:54.593710 n-d-863052-2 devstack@n-api.service[121402]: action_args: {'id': '3029f3c1-4f32-4f6b-963c-16f65b6dff3c'} Nov 01 19:11:54.593710 n-d-863052-2 devstack@n-api.service[121402]: {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 01 19:11:54.593710 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:11:54.593710 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 01 19:11:54.593710 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 01 19:11:54.593710 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 01 19:11:54.593710 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 01 19:11:54.593710 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 01 19:11:54.593710 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 01 19:11:54.593710 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 01 19:11:54.593710 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 01 19:11:54.593710 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3029f3c1-4f32-4f6b-963c-16f65b6dff3c could not be found. Nov 01 19:11:54.593710 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:11:54.593710 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:11:54.593710 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:11:54.593710 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:11:54.593710 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:11:54.593710 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:11:54.593710 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 01 19:11:54.593710 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 01 19:11:54.593710 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 01 19:11:54.593710 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 01 19:11:54.593710 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 01 19:11:54.593710 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 01 19:11:54.593710 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 01 19:11:54.593710 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 01 19:11:54.593710 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 01 19:11:54.593710 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 01 19:11:54.593710 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 01 19:11:54.593710 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 01 19:11:54.596893 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3029f3c1-4f32-4f6b-963c-16f65b6dff3c could not be found. Nov 01 19:11:54.596893 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:11:54.596893 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:11:54.596893 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:11:54.596893 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:11:54.596893 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:11:54.596893 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:11:54.596893 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 01 19:11:54.596893 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 01 19:11:54.596893 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3029f3c1-4f32-4f6b-963c-16f65b6dff3c could not be found. Nov 01 19:11:54.596893 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:11:54.596893 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-940a5526-dc73-4cfa-af84-114e62dd1ff9 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Returning 404 to user: Instance 3029f3c1-4f32-4f6b-963c-16f65b6dff3c could not be found. {{(pid=121402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 01 19:11:54.598392 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-940a5526-dc73-4cfa-af84-114e62dd1ff9 tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] 10.222.0.13 "DELETE /compute/v2.1/servers/3029f3c1-4f32-4f6b-963c-16f65b6dff3c" status: 404 len: 111 microversion: 2.1 time: 0.096862 Nov 01 19:11:54.599195 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 2087/4241] 10.222.0.13 () {58 vars in 1239 bytes} [Tue Nov 1 19:11:54 2022] DELETE /compute/v2.1/servers/3029f3c1-4f32-4f6b-963c-16f65b6dff3c => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 01 19:11:54.605548 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-c12358e5-6b95-48d8-96ca-ed41aef0e495 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc5c19b930543f5a5091922a9859813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ecdc83933544a899117531a960027a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:11:54.617108 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-e3c08c65-e883-4825-82cf-9c1b0c13738f tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:11:54.617745 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-e3c08c65-e883-4825-82cf-9c1b0c13738f tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] [instance: 3029f3c1-4f32-4f6b-963c-16f65b6dff3c] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:11:54.622808 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-c12358e5-6b95-48d8-96ca-ed41aef0e495 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] 10.222.0.13 "GET /compute/v2.1/servers/31bf7572-3418-4fbd-9356-03a890258701" status: 200 len: 1317 microversion: 2.1 time: 2.402520 Nov 01 19:11:54.624662 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 2155/4242] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:11:52 2022] GET /compute/v2.1/servers/31bf7572-3418-4fbd-9356-03a890258701 => generated 1317 bytes in 2411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:11:54.661789 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e3c08c65-e883-4825-82cf-9c1b0c13738f tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:11:54.668349 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e3c08c65-e883-4825-82cf-9c1b0c13738f tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:11:54.670380 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e3c08c65-e883-4825-82cf-9c1b0c13738f tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:11:54.674775 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e3c08c65-e883-4825-82cf-9c1b0c13738f tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:11:54.675303 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e3c08c65-e883-4825-82cf-9c1b0c13738f tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:11:54.675754 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e3c08c65-e883-4825-82cf-9c1b0c13738f tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:11:54.728872 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.wsgi [None req-e3c08c65-e883-4825-82cf-9c1b0c13738f tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] HTTP exception thrown: Instance 3029f3c1-4f32-4f6b-963c-16f65b6dff3c could not be found. Nov 01 19:11:54.734396 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-e3c08c65-e883-4825-82cf-9c1b0c13738f tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Request method failure captured: Nov 01 19:11:54.734396 n-d-863052-2 devstack@n-api.service[121402]: request: GET /compute/v2.1/servers/3029f3c1-4f32-4f6b-963c-16f65b6dff3c HTTP/1.1 Nov 01 19:11:54.734396 n-d-863052-2 devstack@n-api.service[121402]: Accept: application/json Nov 01 19:11:54.734396 n-d-863052-2 devstack@n-api.service[121402]: Accept-Encoding: identity Nov 01 19:11:54.734396 n-d-863052-2 devstack@n-api.service[121402]: Connection: close Nov 01 19:11:54.734396 n-d-863052-2 devstack@n-api.service[121402]: Content-Length: 0 Nov 01 19:11:54.734396 n-d-863052-2 devstack@n-api.service[121402]: Content-Type: application/json Nov 01 19:11:54.734396 n-d-863052-2 devstack@n-api.service[121402]: Host: 10.222.0.13 Nov 01 19:11:54.734396 n-d-863052-2 devstack@n-api.service[121402]: Openstack-System-Scope: None Nov 01 19:11:54.734396 n-d-863052-2 devstack@n-api.service[121402]: User-Agent: python-urllib3/1.26.12 Nov 01 19:11:54.734396 n-d-863052-2 devstack@n-api.service[121402]: X-Auth-Token: gAAAAABjYW26-niUURjtSz2aypPDgkYX79sMl0CZOJW_ml_lGFRo-4lOtvHbbGMI0UBaScGrQfLye0e0L4c10ym8MikDvB1h-T3Rh6fQQzcKLxsRSm1saxobVhs9el4Qiq-2aZx04HWuIjPot0FuuMjXsFtl108kYD3rs-RWb4TVydSfipjFJKk Nov 01 19:11:54.734396 n-d-863052-2 devstack@n-api.service[121402]: X-Domain-Id: None Nov 01 19:11:54.734396 n-d-863052-2 devstack@n-api.service[121402]: X-Domain-Name: None Nov 01 19:11:54.734396 n-d-863052-2 devstack@n-api.service[121402]: X-Identity-Status: Confirmed Nov 01 19:11:54.734396 n-d-863052-2 devstack@n-api.service[121402]: X-Is-Admin-Project: True Nov 01 19:11:54.734396 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Domain-Id: default Nov 01 19:11:54.734396 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Domain-Name: Default Nov 01 19:11:54.734396 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Id: 33e3d319293c46b6af2f728a50586906 Nov 01 19:11:54.734396 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Name: tempest-AttachVolumeNegativeTest-517167560 Nov 01 19:11:54.734396 n-d-863052-2 devstack@n-api.service[121402]: X-Role: member,reader Nov 01 19:11:54.734396 n-d-863052-2 devstack@n-api.service[121402]: X-Roles: member,reader Nov 01 19:11:54.734396 n-d-863052-2 devstack@n-api.service[121402]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/33e3d319293c46b6af2f728a50586906"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/33e3d319293c46b6af2f728a50586906"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_33e3d319293c46b6af2f728a50586906", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/33e3d319293c46b6af2f728a50586906"}]}] Nov 01 19:11:54.734396 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant: tempest-AttachVolumeNegativeTest-517167560 Nov 01 19:11:54.734396 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant-Id: 33e3d319293c46b6af2f728a50586906 Nov 01 19:11:54.734396 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-517167560 Nov 01 19:11:54.734396 n-d-863052-2 devstack@n-api.service[121402]: X-User: tempest-AttachVolumeNegativeTest-517167560-project Nov 01 19:11:54.734396 n-d-863052-2 devstack@n-api.service[121402]: X-User-Domain-Id: default Nov 01 19:11:54.734396 n-d-863052-2 devstack@n-api.service[121402]: X-User-Domain-Name: Default Nov 01 19:11:54.734396 n-d-863052-2 devstack@n-api.service[121402]: X-User-Id: 790f3f1566b7464aaca19d4d05c0942e Nov 01 19:11:54.734396 n-d-863052-2 devstack@n-api.service[121402]: X-User-Name: tempest-AttachVolumeNegativeTest-517167560-project Nov 01 19:11:54.734396 n-d-863052-2 devstack@n-api.service[121402]: method: > Nov 01 19:11:54.734396 n-d-863052-2 devstack@n-api.service[121402]: exception: Instance 3029f3c1-4f32-4f6b-963c-16f65b6dff3c could not be found. Nov 01 19:11:54.734396 n-d-863052-2 devstack@n-api.service[121402]: action_args: {'id': '3029f3c1-4f32-4f6b-963c-16f65b6dff3c'} Nov 01 19:11:54.734396 n-d-863052-2 devstack@n-api.service[121402]: {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 01 19:11:54.734396 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:11:54.734396 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 01 19:11:54.734396 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 01 19:11:54.734396 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 01 19:11:54.734396 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 01 19:11:54.734396 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 01 19:11:54.734396 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 01 19:11:54.734396 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 01 19:11:54.734396 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 01 19:11:54.734396 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3029f3c1-4f32-4f6b-963c-16f65b6dff3c could not be found. Nov 01 19:11:54.734396 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:11:54.734396 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:11:54.734396 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:11:54.734396 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:11:54.734396 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:11:54.734396 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:11:54.734396 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 01 19:11:54.734396 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 01 19:11:54.734396 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 01 19:11:54.734396 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 01 19:11:54.734396 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 01 19:11:54.734396 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 01 19:11:54.734396 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 01 19:11:54.734396 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 01 19:11:54.734396 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 01 19:11:54.734396 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 01 19:11:54.734396 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3029f3c1-4f32-4f6b-963c-16f65b6dff3c could not be found. Nov 01 19:11:54.734396 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:11:54.734396 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:11:54.734396 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:11:54.737663 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:11:54.737663 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:11:54.737663 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:11:54.737663 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 01 19:11:54.737663 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 01 19:11:54.737663 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3029f3c1-4f32-4f6b-963c-16f65b6dff3c could not be found. Nov 01 19:11:54.737663 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:11:54.737663 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-e3c08c65-e883-4825-82cf-9c1b0c13738f tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] Returning 404 to user: Instance 3029f3c1-4f32-4f6b-963c-16f65b6dff3c could not be found. {{(pid=121402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 01 19:11:54.737663 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-e3c08c65-e883-4825-82cf-9c1b0c13738f tempest-AttachVolumeNegativeTest-517167560 tempest-AttachVolumeNegativeTest-517167560-project] 10.222.0.13 "GET /compute/v2.1/servers/3029f3c1-4f32-4f6b-963c-16f65b6dff3c" status: 404 len: 111 microversion: 2.1 time: 0.132518 Nov 01 19:11:54.739351 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 2088/4243] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:11:54 2022] GET /compute/v2.1/servers/3029f3c1-4f32-4f6b-963c-16f65b6dff3c => generated 111 bytes in 135 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 01 19:11:55.661658 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [req-a4da8ee0-bcb3-4917-bc20-33a175100898 req-c19b2cc7-ff30-4b98-b34f-ee5fa88f74d1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cae1c729-7c41-488d-ab0e-30d1f5d22180", "tag": "3533eeb6-f9e6-47ff-ba35-f061eb6fd641"}]} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:11:55.663337 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-3e56c702-94da-4833-9681-fda48d77a001 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:11:55.666105 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-3e56c702-94da-4833-9681-fda48d77a001 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] [instance: 31bf7572-3418-4fbd-9356-03a890258701] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:11:55.704825 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-3e56c702-94da-4833-9681-fda48d77a001 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:11:55.706932 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-3e56c702-94da-4833-9681-fda48d77a001 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:11:55.708104 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-3e56c702-94da-4833-9681-fda48d77a001 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:11:55.712385 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-a4da8ee0-bcb3-4917-bc20-33a175100898 req-c19b2cc7-ff30-4b98-b34f-ee5fa88f74d1 service nova] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:11:55.715556 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-3e56c702-94da-4833-9681-fda48d77a001 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:11:55.716282 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-3e56c702-94da-4833-9681-fda48d77a001 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:11:55.719344 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-a4da8ee0-bcb3-4917-bc20-33a175100898 req-c19b2cc7-ff30-4b98-b34f-ee5fa88f74d1 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:11:55.723593 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-3e56c702-94da-4833-9681-fda48d77a001 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:11:55.724706 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-a4da8ee0-bcb3-4917-bc20-33a175100898 req-c19b2cc7-ff30-4b98-b34f-ee5fa88f74d1 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:11:55.788525 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.compute.server_external_events [req-a4da8ee0-bcb3-4917-bc20-33a175100898 req-c19b2cc7-ff30-4b98-b34f-ee5fa88f74d1 service nova] Creating event network-changed:3533eeb6-f9e6-47ff-ba35-f061eb6fd641 for instance cae1c729-7c41-488d-ab0e-30d1f5d22180 on n-h1-863052-2 Nov 01 19:11:55.818273 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [req-a4da8ee0-bcb3-4917-bc20-33a175100898 req-c19b2cc7-ff30-4b98-b34f-ee5fa88f74d1 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.162312 Nov 01 19:11:55.827305 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 2089/4244] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Nov 1 19:11:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:11:56.905062 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-3e56c702-94da-4833-9681-fda48d77a001 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc5c19b930543f5a5091922a9859813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ecdc83933544a899117531a960027a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:11:56.915676 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-3e56c702-94da-4833-9681-fda48d77a001 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] 10.222.0.13 "GET /compute/v2.1/servers/31bf7572-3418-4fbd-9356-03a890258701" status: 200 len: 1317 microversion: 2.1 time: 1.267742 Nov 01 19:11:56.933146 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 2156/4245] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:11:55 2022] GET /compute/v2.1/servers/31bf7572-3418-4fbd-9356-03a890258701 => generated 1317 bytes in 1288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:11:57.947103 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-a70917c7-2c2d-4d7c-a1c1-326ab3d7dc87 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:11:57.948955 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-a70917c7-2c2d-4d7c-a1c1-326ab3d7dc87 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] [instance: 31bf7572-3418-4fbd-9356-03a890258701] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:11:57.961514 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-a70917c7-2c2d-4d7c-a1c1-326ab3d7dc87 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:11:57.962005 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-a70917c7-2c2d-4d7c-a1c1-326ab3d7dc87 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:11:57.962441 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-a70917c7-2c2d-4d7c-a1c1-326ab3d7dc87 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:11:57.963150 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-a70917c7-2c2d-4d7c-a1c1-326ab3d7dc87 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:11:57.963602 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-a70917c7-2c2d-4d7c-a1c1-326ab3d7dc87 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:11:57.964023 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-a70917c7-2c2d-4d7c-a1c1-326ab3d7dc87 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:11:58.439370 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-a70917c7-2c2d-4d7c-a1c1-326ab3d7dc87 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc5c19b930543f5a5091922a9859813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ecdc83933544a899117531a960027a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:11:58.449890 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-a70917c7-2c2d-4d7c-a1c1-326ab3d7dc87 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] 10.222.0.13 "GET /compute/v2.1/servers/31bf7572-3418-4fbd-9356-03a890258701" status: 200 len: 1317 microversion: 2.1 time: 0.510187 Nov 01 19:11:58.450968 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 2090/4246] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:11:57 2022] GET /compute/v2.1/servers/31bf7572-3418-4fbd-9356-03a890258701 => generated 1317 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:11:59.474265 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-8c92ac5b-30c3-485c-aeaa-c6ab5cd43821 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:11:59.475013 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-8c92ac5b-30c3-485c-aeaa-c6ab5cd43821 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] [instance: 31bf7572-3418-4fbd-9356-03a890258701] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:11:59.477118 n-d-863052-2 devstack@n-api.service[121403]: DEBUG dbcounter [-] [121403] Writing DB stats nova_cell0:SELECT=2 {{(pid=121403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 19:11:59.494303 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-8c92ac5b-30c3-485c-aeaa-c6ab5cd43821 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:11:59.495184 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-8c92ac5b-30c3-485c-aeaa-c6ab5cd43821 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:11:59.495949 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-8c92ac5b-30c3-485c-aeaa-c6ab5cd43821 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:11:59.496904 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-8c92ac5b-30c3-485c-aeaa-c6ab5cd43821 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:11:59.497569 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-8c92ac5b-30c3-485c-aeaa-c6ab5cd43821 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:11:59.498737 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-8c92ac5b-30c3-485c-aeaa-c6ab5cd43821 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:12:00.030746 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-8c92ac5b-30c3-485c-aeaa-c6ab5cd43821 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc5c19b930543f5a5091922a9859813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ecdc83933544a899117531a960027a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:12:00.055264 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-8c92ac5b-30c3-485c-aeaa-c6ab5cd43821 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] 10.222.0.13 "GET /compute/v2.1/servers/31bf7572-3418-4fbd-9356-03a890258701" status: 200 len: 1317 microversion: 2.1 time: 0.585487 Nov 01 19:12:00.055900 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 2157/4247] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:11:59 2022] GET /compute/v2.1/servers/31bf7572-3418-4fbd-9356-03a890258701 => generated 1317 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:12:00.780427 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [req-8d9b30d4-fcf8-4a8e-a95c-23f915346c0e req-3bc44d7f-e13c-4f0f-b8bc-13626ddec42b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "31bf7572-3418-4fbd-9356-03a890258701", "tag": "f618307d-2062-4346-9bc6-738e0be05a65"}]} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:12:00.807428 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-8d9b30d4-fcf8-4a8e-a95c-23f915346c0e req-3bc44d7f-e13c-4f0f-b8bc-13626ddec42b service nova] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:12:00.810337 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-8d9b30d4-fcf8-4a8e-a95c-23f915346c0e req-3bc44d7f-e13c-4f0f-b8bc-13626ddec42b service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:12:00.811821 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-8d9b30d4-fcf8-4a8e-a95c-23f915346c0e req-3bc44d7f-e13c-4f0f-b8bc-13626ddec42b service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:12:00.854847 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.compute.server_external_events [req-8d9b30d4-fcf8-4a8e-a95c-23f915346c0e req-3bc44d7f-e13c-4f0f-b8bc-13626ddec42b service nova] Creating event network-changed:f618307d-2062-4346-9bc6-738e0be05a65 for instance 31bf7572-3418-4fbd-9356-03a890258701 on n-h2-863052-2 Nov 01 19:12:00.866510 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [req-8d9b30d4-fcf8-4a8e-a95c-23f915346c0e req-3bc44d7f-e13c-4f0f-b8bc-13626ddec42b service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093342 Nov 01 19:12:00.869075 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 2091/4248] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Nov 1 19:12:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:12:01.092478 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-325a02a3-9a83-4aca-8231-bae339adadd5 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:12:01.093337 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-325a02a3-9a83-4aca-8231-bae339adadd5 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] [instance: 31bf7572-3418-4fbd-9356-03a890258701] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:12:01.119930 n-d-863052-2 devstack@n-api.service[121403]: DEBUG dbcounter [-] [121403] Writing DB stats nova_cell0:SELECT=16 {{(pid=121403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 19:12:01.121825 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-325a02a3-9a83-4aca-8231-bae339adadd5 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:12:01.125284 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-325a02a3-9a83-4aca-8231-bae339adadd5 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:12:01.125930 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-325a02a3-9a83-4aca-8231-bae339adadd5 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:12:01.127036 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-325a02a3-9a83-4aca-8231-bae339adadd5 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:12:01.127886 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-325a02a3-9a83-4aca-8231-bae339adadd5 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:12:01.128693 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-325a02a3-9a83-4aca-8231-bae339adadd5 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:12:02.292108 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-325a02a3-9a83-4aca-8231-bae339adadd5 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc5c19b930543f5a5091922a9859813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ecdc83933544a899117531a960027a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:12:02.312183 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-325a02a3-9a83-4aca-8231-bae339adadd5 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] 10.222.0.13 "GET /compute/v2.1/servers/31bf7572-3418-4fbd-9356-03a890258701" status: 200 len: 1317 microversion: 2.1 time: 1.235679 Nov 01 19:12:02.317814 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 2158/4249] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:12:01 2022] GET /compute/v2.1/servers/31bf7572-3418-4fbd-9356-03a890258701 => generated 1317 bytes in 1243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:12:03.355895 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-34084ff4-30c1-4030-8174-932f8c50342f tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:12:03.361625 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-34084ff4-30c1-4030-8174-932f8c50342f tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] [instance: 31bf7572-3418-4fbd-9356-03a890258701] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:12:03.382222 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-34084ff4-30c1-4030-8174-932f8c50342f tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:12:03.386324 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-34084ff4-30c1-4030-8174-932f8c50342f tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:12:03.390480 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-34084ff4-30c1-4030-8174-932f8c50342f tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:12:03.398672 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-34084ff4-30c1-4030-8174-932f8c50342f tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:12:03.399308 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-34084ff4-30c1-4030-8174-932f8c50342f tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:12:03.403040 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-34084ff4-30c1-4030-8174-932f8c50342f tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:12:04.985954 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-34084ff4-30c1-4030-8174-932f8c50342f tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc5c19b930543f5a5091922a9859813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ecdc83933544a899117531a960027a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:12:04.988412 n-d-863052-2 devstack@n-api.service[121402]: DEBUG dbcounter [-] [121402] Writing DB stats nova_cell1:SELECT=95 {{(pid=121402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 19:12:05.003997 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-34084ff4-30c1-4030-8174-932f8c50342f tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] 10.222.0.13 "GET /compute/v2.1/servers/31bf7572-3418-4fbd-9356-03a890258701" status: 200 len: 1317 microversion: 2.1 time: 1.659081 Nov 01 19:12:05.006103 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 2092/4250] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:12:03 2022] GET /compute/v2.1/servers/31bf7572-3418-4fbd-9356-03a890258701 => generated 1317 bytes in 1665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:12:06.027396 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-fcdb82be-1fd3-4b71-91db-0e023a6171d3 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:12:06.028104 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-fcdb82be-1fd3-4b71-91db-0e023a6171d3 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] [instance: 31bf7572-3418-4fbd-9356-03a890258701] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:12:06.030854 n-d-863052-2 devstack@n-api.service[121403]: DEBUG dbcounter [-] [121403] Writing DB stats nova_api:SELECT=84,nova_api:DELETE=4,nova_api:INSERT=5 {{(pid=121403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 19:12:06.038130 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-fcdb82be-1fd3-4b71-91db-0e023a6171d3 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:12:06.045379 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-fcdb82be-1fd3-4b71-91db-0e023a6171d3 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:12:06.045903 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-fcdb82be-1fd3-4b71-91db-0e023a6171d3 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:12:06.046736 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-fcdb82be-1fd3-4b71-91db-0e023a6171d3 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:12:06.047274 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-fcdb82be-1fd3-4b71-91db-0e023a6171d3 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:12:06.057301 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-fcdb82be-1fd3-4b71-91db-0e023a6171d3 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:12:06.626142 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-fcdb82be-1fd3-4b71-91db-0e023a6171d3 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc5c19b930543f5a5091922a9859813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ecdc83933544a899117531a960027a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:12:06.638276 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-fcdb82be-1fd3-4b71-91db-0e023a6171d3 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] 10.222.0.13 "GET /compute/v2.1/servers/31bf7572-3418-4fbd-9356-03a890258701" status: 200 len: 1317 microversion: 2.1 time: 0.612475 Nov 01 19:12:06.654230 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 2159/4251] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:12:06 2022] GET /compute/v2.1/servers/31bf7572-3418-4fbd-9356-03a890258701 => generated 1317 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:12:07.666326 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-741ef233-956c-47fa-8533-b0961a17839d tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:12:07.667528 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-741ef233-956c-47fa-8533-b0961a17839d tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] [instance: 31bf7572-3418-4fbd-9356-03a890258701] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:12:07.680464 n-d-863052-2 devstack@n-api.service[121402]: DEBUG dbcounter [-] [121402] Writing DB stats nova_api:SELECT=50,nova_api:DELETE=1 {{(pid=121402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 19:12:07.684440 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-741ef233-956c-47fa-8533-b0961a17839d tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:12:07.685185 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-741ef233-956c-47fa-8533-b0961a17839d tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:12:07.687808 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-741ef233-956c-47fa-8533-b0961a17839d tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:12:07.688793 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-741ef233-956c-47fa-8533-b0961a17839d tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:12:07.691381 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-741ef233-956c-47fa-8533-b0961a17839d tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:12:07.692000 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-741ef233-956c-47fa-8533-b0961a17839d tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:12:08.399591 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-741ef233-956c-47fa-8533-b0961a17839d tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc5c19b930543f5a5091922a9859813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ecdc83933544a899117531a960027a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:12:08.448640 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-741ef233-956c-47fa-8533-b0961a17839d tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] 10.222.0.13 "GET /compute/v2.1/servers/31bf7572-3418-4fbd-9356-03a890258701" status: 200 len: 1317 microversion: 2.1 time: 0.787441 Nov 01 19:12:08.453450 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 2093/4252] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:12:07 2022] GET /compute/v2.1/servers/31bf7572-3418-4fbd-9356-03a890258701 => generated 1317 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:12:09.475219 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-08cf218a-c7bd-4ec2-8bee-4adcaa2b3826 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:12:09.475840 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-08cf218a-c7bd-4ec2-8bee-4adcaa2b3826 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] [instance: 31bf7572-3418-4fbd-9356-03a890258701] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:12:09.486998 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-08cf218a-c7bd-4ec2-8bee-4adcaa2b3826 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:12:09.487488 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-08cf218a-c7bd-4ec2-8bee-4adcaa2b3826 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:12:09.489692 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-08cf218a-c7bd-4ec2-8bee-4adcaa2b3826 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:12:09.494550 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-08cf218a-c7bd-4ec2-8bee-4adcaa2b3826 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:12:09.495587 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-08cf218a-c7bd-4ec2-8bee-4adcaa2b3826 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:12:09.496218 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-08cf218a-c7bd-4ec2-8bee-4adcaa2b3826 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:12:10.094287 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [req-3ab36b02-6628-4c3b-b310-4a8f570e4991 req-883e65e9-bbe9-430c-adf3-1fd7765a0f6a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "31bf7572-3418-4fbd-9356-03a890258701", "name": "network-vif-plugged", "status": "completed", "tag": "f618307d-2062-4346-9bc6-738e0be05a65"}]} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:12:10.135528 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-3ab36b02-6628-4c3b-b310-4a8f570e4991 req-883e65e9-bbe9-430c-adf3-1fd7765a0f6a service nova] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:12:10.135528 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-3ab36b02-6628-4c3b-b310-4a8f570e4991 req-883e65e9-bbe9-430c-adf3-1fd7765a0f6a service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:12:10.135528 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-3ab36b02-6628-4c3b-b310-4a8f570e4991 req-883e65e9-bbe9-430c-adf3-1fd7765a0f6a service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:12:10.169171 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-08cf218a-c7bd-4ec2-8bee-4adcaa2b3826 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc5c19b930543f5a5091922a9859813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ecdc83933544a899117531a960027a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:12:10.198510 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-08cf218a-c7bd-4ec2-8bee-4adcaa2b3826 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] 10.222.0.13 "GET /compute/v2.1/servers/31bf7572-3418-4fbd-9356-03a890258701" status: 200 len: 1317 microversion: 2.1 time: 0.727211 Nov 01 19:12:10.202278 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 2160/4253] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:12:09 2022] GET /compute/v2.1/servers/31bf7572-3418-4fbd-9356-03a890258701 => generated 1317 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:12:10.210386 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.compute.server_external_events [req-3ab36b02-6628-4c3b-b310-4a8f570e4991 req-883e65e9-bbe9-430c-adf3-1fd7765a0f6a service nova] Creating event network-vif-plugged:f618307d-2062-4346-9bc6-738e0be05a65 for instance 31bf7572-3418-4fbd-9356-03a890258701 on n-h2-863052-2 Nov 01 19:12:10.220415 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [req-3ab36b02-6628-4c3b-b310-4a8f570e4991 req-883e65e9-bbe9-430c-adf3-1fd7765a0f6a service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.154651 Nov 01 19:12:10.230445 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 2094/4254] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Nov 1 19:12:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:12:11.224058 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-90d7a256-95cd-449d-86bb-7cc00e850bc1 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:12:11.225411 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-90d7a256-95cd-449d-86bb-7cc00e850bc1 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] [instance: 31bf7572-3418-4fbd-9356-03a890258701] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:12:11.232808 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-90d7a256-95cd-449d-86bb-7cc00e850bc1 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:12:11.234099 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-90d7a256-95cd-449d-86bb-7cc00e850bc1 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:12:11.234731 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-90d7a256-95cd-449d-86bb-7cc00e850bc1 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:12:11.235641 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-90d7a256-95cd-449d-86bb-7cc00e850bc1 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:12:11.236295 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-90d7a256-95cd-449d-86bb-7cc00e850bc1 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:12:11.236942 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-90d7a256-95cd-449d-86bb-7cc00e850bc1 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:12:11.241694 n-d-863052-2 devstack@n-api.service[121403]: DEBUG dbcounter [-] [121403] Writing DB stats nova_cell1:SELECT=57 {{(pid=121403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 19:12:11.453666 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-90d7a256-95cd-449d-86bb-7cc00e850bc1 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc5c19b930543f5a5091922a9859813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ecdc83933544a899117531a960027a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:12:11.463937 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-90d7a256-95cd-449d-86bb-7cc00e850bc1 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] 10.222.0.13 "GET /compute/v2.1/servers/31bf7572-3418-4fbd-9356-03a890258701" status: 200 len: 1317 microversion: 2.1 time: 0.244450 Nov 01 19:12:11.465500 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 2161/4255] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:12:11 2022] GET /compute/v2.1/servers/31bf7572-3418-4fbd-9356-03a890258701 => generated 1317 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:12:12.491076 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-ddd5c66d-b911-42d7-a007-0843f8c227c4 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:12:12.492084 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-ddd5c66d-b911-42d7-a007-0843f8c227c4 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] [instance: 31bf7572-3418-4fbd-9356-03a890258701] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:12:12.509172 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-ddd5c66d-b911-42d7-a007-0843f8c227c4 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:12:12.510090 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-ddd5c66d-b911-42d7-a007-0843f8c227c4 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:12:12.510876 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-ddd5c66d-b911-42d7-a007-0843f8c227c4 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:12:12.511889 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-ddd5c66d-b911-42d7-a007-0843f8c227c4 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:12:12.512507 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-ddd5c66d-b911-42d7-a007-0843f8c227c4 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:12:12.513140 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-ddd5c66d-b911-42d7-a007-0843f8c227c4 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:12:12.961215 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-ddd5c66d-b911-42d7-a007-0843f8c227c4 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc5c19b930543f5a5091922a9859813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ecdc83933544a899117531a960027a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:12:12.973721 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-ddd5c66d-b911-42d7-a007-0843f8c227c4 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] 10.222.0.13 "GET /compute/v2.1/servers/31bf7572-3418-4fbd-9356-03a890258701" status: 200 len: 1506 microversion: 2.1 time: 0.488002 Nov 01 19:12:12.974313 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 2095/4256] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:12:12 2022] GET /compute/v2.1/servers/31bf7572-3418-4fbd-9356-03a890258701 => generated 1506 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:12:13.006421 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-c71d7d04-096e-4c04-a2a9-4b55afce6be5 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:12:13.007024 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-c71d7d04-096e-4c04-a2a9-4b55afce6be5 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] [instance: 31bf7572-3418-4fbd-9356-03a890258701] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:12:13.027542 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-c71d7d04-096e-4c04-a2a9-4b55afce6be5 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:12:13.030516 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-c71d7d04-096e-4c04-a2a9-4b55afce6be5 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:12:13.031082 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-c71d7d04-096e-4c04-a2a9-4b55afce6be5 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:12:13.031927 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-c71d7d04-096e-4c04-a2a9-4b55afce6be5 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:12:13.034171 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-c71d7d04-096e-4c04-a2a9-4b55afce6be5 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:12:13.034171 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-c71d7d04-096e-4c04-a2a9-4b55afce6be5 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:12:13.094319 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-c71d7d04-096e-4c04-a2a9-4b55afce6be5 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] [instance: 31bf7572-3418-4fbd-9356-03a890258701] Going to try to terminate instance {{(pid=121403) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 01 19:12:13.264226 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-c71d7d04-096e-4c04-a2a9-4b55afce6be5 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] 10.222.0.13 "DELETE /compute/v2.1/servers/31bf7572-3418-4fbd-9356-03a890258701" status: 204 len: 0 microversion: 2.1 time: 0.264247 Nov 01 19:12:13.265158 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 2162/4257] 10.222.0.13 () {58 vars in 1239 bytes} [Tue Nov 1 19:12:12 2022] DELETE /compute/v2.1/servers/31bf7572-3418-4fbd-9356-03a890258701 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 01 19:12:13.273516 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-b6c4b322-60b2-47ba-9896-f657fab59a39 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:12:13.274111 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-b6c4b322-60b2-47ba-9896-f657fab59a39 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] [instance: 31bf7572-3418-4fbd-9356-03a890258701] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:12:13.283141 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b6c4b322-60b2-47ba-9896-f657fab59a39 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:12:13.283727 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b6c4b322-60b2-47ba-9896-f657fab59a39 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:12:13.284067 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b6c4b322-60b2-47ba-9896-f657fab59a39 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:12:13.284808 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b6c4b322-60b2-47ba-9896-f657fab59a39 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:12:13.285279 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b6c4b322-60b2-47ba-9896-f657fab59a39 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:12:13.285691 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b6c4b322-60b2-47ba-9896-f657fab59a39 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:12:13.583436 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-b6c4b322-60b2-47ba-9896-f657fab59a39 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc5c19b930543f5a5091922a9859813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ecdc83933544a899117531a960027a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:12:13.598020 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-b6c4b322-60b2-47ba-9896-f657fab59a39 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] 10.222.0.13 "GET /compute/v2.1/servers/31bf7572-3418-4fbd-9356-03a890258701" status: 200 len: 1512 microversion: 2.1 time: 0.328745 Nov 01 19:12:13.599121 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 2096/4258] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:12:13 2022] GET /compute/v2.1/servers/31bf7572-3418-4fbd-9356-03a890258701 => generated 1512 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:12:14.626664 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-2d116084-b002-40bc-95ad-d5378a5bd507 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:12:14.628197 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-2d116084-b002-40bc-95ad-d5378a5bd507 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] [instance: 31bf7572-3418-4fbd-9356-03a890258701] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:12:14.644528 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-2d116084-b002-40bc-95ad-d5378a5bd507 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:12:14.645526 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-2d116084-b002-40bc-95ad-d5378a5bd507 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:12:14.646179 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-2d116084-b002-40bc-95ad-d5378a5bd507 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:12:14.647088 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-2d116084-b002-40bc-95ad-d5378a5bd507 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:12:14.647744 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-2d116084-b002-40bc-95ad-d5378a5bd507 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:12:14.648486 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-2d116084-b002-40bc-95ad-d5378a5bd507 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:12:14.980488 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-2d116084-b002-40bc-95ad-d5378a5bd507 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc5c19b930543f5a5091922a9859813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ecdc83933544a899117531a960027a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:12:14.992668 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-2d116084-b002-40bc-95ad-d5378a5bd507 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] 10.222.0.13 "GET /compute/v2.1/servers/31bf7572-3418-4fbd-9356-03a890258701" status: 200 len: 1512 microversion: 2.1 time: 0.370793 Nov 01 19:12:14.993263 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 2163/4259] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:12:14 2022] GET /compute/v2.1/servers/31bf7572-3418-4fbd-9356-03a890258701 => generated 1512 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:12:16.024508 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-8eed0168-554f-4bb3-b436-918ac2257720 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:12:16.025407 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-8eed0168-554f-4bb3-b436-918ac2257720 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] [instance: 31bf7572-3418-4fbd-9356-03a890258701] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:12:16.039445 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-8eed0168-554f-4bb3-b436-918ac2257720 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:12:16.042703 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-8eed0168-554f-4bb3-b436-918ac2257720 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:12:16.044573 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-8eed0168-554f-4bb3-b436-918ac2257720 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:12:16.046450 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-8eed0168-554f-4bb3-b436-918ac2257720 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:12:16.046929 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-8eed0168-554f-4bb3-b436-918ac2257720 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:12:16.048565 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-8eed0168-554f-4bb3-b436-918ac2257720 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:12:16.084072 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-26906dab-3617-4283-ad62-1563d43d92a9 tempest-FlavorsV2TestJSON-102836632 tempest-FlavorsV2TestJSON-102836632-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:12:16.095560 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-26906dab-3617-4283-ad62-1563d43d92a9 tempest-FlavorsV2TestJSON-102836632 tempest-FlavorsV2TestJSON-102836632-project] 10.222.0.13 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.595818 Nov 01 19:12:16.106937 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 2097/4260] 10.222.0.13 () {58 vars in 1137 bytes} [Tue Nov 1 19:12:15 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:12:16.113442 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-b58270ca-b5ce-4ff2-894d-96ca70df9d6b tempest-FlavorsV2TestJSON-102836632 tempest-FlavorsV2TestJSON-102836632-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:12:16.141029 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-b58270ca-b5ce-4ff2-894d-96ca70df9d6b tempest-FlavorsV2TestJSON-102836632 tempest-FlavorsV2TestJSON-102836632-project] 10.222.0.13 "GET /compute/v2.1/flavors" status: 200 len: 2594 microversion: 2.1 time: 0.031958 Nov 01 19:12:16.141879 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 2098/4261] 10.222.0.13 () {58 vars in 1125 bytes} [Tue Nov 1 19:12:16 2022] GET /compute/v2.1/flavors => generated 2594 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:12:16.160715 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-5799dda1-a3ed-43ea-b8e2-5633d3d7c01c tempest-FlavorsV2TestJSON-102836632 tempest-FlavorsV2TestJSON-102836632-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:12:16.170070 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-5799dda1-a3ed-43ea-b8e2-5633d3d7c01c tempest-FlavorsV2TestJSON-102836632 tempest-FlavorsV2TestJSON-102836632-project] 10.222.0.13 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.015630 Nov 01 19:12:16.171229 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 2099/4262] 10.222.0.13 () {58 vars in 1137 bytes} [Tue Nov 1 19:12:16 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:12:16.188817 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-a581639a-ef3d-4a4f-a72e-cef15c066d62 tempest-FlavorsV2TestJSON-102836632 tempest-FlavorsV2TestJSON-102836632-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:12:16.205628 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-a581639a-ef3d-4a4f-a72e-cef15c066d62 tempest-FlavorsV2TestJSON-102836632 tempest-FlavorsV2TestJSON-102836632-project] 10.222.0.13 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.023889 Nov 01 19:12:16.206473 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 2100/4263] 10.222.0.13 () {58 vars in 1137 bytes} [Tue Nov 1 19:12:16 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 01 19:12:16.237135 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-c8377f25-740f-401b-8492-f69490703834 tempest-FlavorsV2TestJSON-102836632 tempest-FlavorsV2TestJSON-102836632-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:12:16.288042 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-c8377f25-740f-401b-8492-f69490703834 tempest-FlavorsV2TestJSON-102836632 tempest-FlavorsV2TestJSON-102836632-project] 10.222.0.13 "GET /compute/v2.1/flavors/detail?minDisk=2" status: 200 len: 3209 microversion: 2.1 time: 0.073023 Nov 01 19:12:16.290846 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 2101/4264] 10.222.0.13 () {58 vars in 1165 bytes} [Tue Nov 1 19:12:16 2022] GET /compute/v2.1/flavors/detail?minDisk=2 => generated 3209 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:12:16.308881 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-da2e19e6-f9ca-4ced-84f4-855efcb17ea8 tempest-FlavorsV2TestJSON-102836632 tempest-FlavorsV2TestJSON-102836632-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:12:16.317352 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-da2e19e6-f9ca-4ced-84f4-855efcb17ea8 tempest-FlavorsV2TestJSON-102836632 tempest-FlavorsV2TestJSON-102836632-project] 10.222.0.13 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.013324 Nov 01 19:12:16.318594 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 2102/4265] 10.222.0.13 () {58 vars in 1137 bytes} [Tue Nov 1 19:12:16 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:12:16.331700 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-408bcdbb-8dd0-49b5-975c-aef7317324ae tempest-FlavorsV2TestJSON-102836632 tempest-FlavorsV2TestJSON-102836632-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:12:16.388424 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-408bcdbb-8dd0-49b5-975c-aef7317324ae tempest-FlavorsV2TestJSON-102836632 tempest-FlavorsV2TestJSON-102836632-project] 10.222.0.13 "GET /compute/v2.1/flavors/detail?minRam=1025" status: 200 len: 2145 microversion: 2.1 time: 0.060264 Nov 01 19:12:16.390001 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 2103/4266] 10.222.0.13 () {58 vars in 1169 bytes} [Tue Nov 1 19:12:16 2022] GET /compute/v2.1/flavors/detail?minRam=1025 => generated 2145 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:12:16.423830 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-84296400-cb1c-4de1-a9a1-1680c4e5e9b7 tempest-FlavorsV2TestJSON-102836632 tempest-FlavorsV2TestJSON-102836632-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:12:16.457531 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-84296400-cb1c-4de1-a9a1-1680c4e5e9b7 tempest-FlavorsV2TestJSON-102836632 tempest-FlavorsV2TestJSON-102836632-project] 10.222.0.13 "GET /compute/v2.1/flavors/detail?limit=1" status: 200 len: 476 microversion: 2.1 time: 0.051553 Nov 01 19:12:16.469372 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 2104/4267] 10.222.0.13 () {58 vars in 1161 bytes} [Tue Nov 1 19:12:16 2022] GET /compute/v2.1/flavors/detail?limit=1 => generated 476 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:12:16.483517 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-65f32f75-8285-410f-8105-9877abab527b tempest-FlavorsV2TestJSON-102836632 tempest-FlavorsV2TestJSON-102836632-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:12:16.500890 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-65f32f75-8285-410f-8105-9877abab527b tempest-FlavorsV2TestJSON-102836632 tempest-FlavorsV2TestJSON-102836632-project] 10.222.0.13 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.030331 Nov 01 19:12:16.515765 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 2105/4268] 10.222.0.13 () {58 vars in 1137 bytes} [Tue Nov 1 19:12:16 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:12:16.524858 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-0bd31a57-62a4-45c8-a516-63c3542f4a9d tempest-FlavorsV2TestJSON-102836632 tempest-FlavorsV2TestJSON-102836632-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:12:16.617790 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-8eed0168-554f-4bb3-b436-918ac2257720 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc5c19b930543f5a5091922a9859813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ecdc83933544a899117531a960027a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:12:16.630120 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-8eed0168-554f-4bb3-b436-918ac2257720 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] 10.222.0.13 "GET /compute/v2.1/servers/31bf7572-3418-4fbd-9356-03a890258701" status: 200 len: 1512 microversion: 2.1 time: 0.613481 Nov 01 19:12:16.630707 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 2164/4269] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:12:16 2022] GET /compute/v2.1/servers/31bf7572-3418-4fbd-9356-03a890258701 => generated 1512 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 19:12:16.637069 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-0bd31a57-62a4-45c8-a516-63c3542f4a9d tempest-FlavorsV2TestJSON-102836632 tempest-FlavorsV2TestJSON-102836632-project] 10.222.0.13 "GET /compute/v2.1/flavors/detail?marker=452" status: 200 len: 2500 microversion: 2.1 time: 0.119825 Nov 01 19:12:16.651092 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 2106/4270] 10.222.0.13 () {58 vars in 1167 bytes} [Tue Nov 1 19:12:16 2022] GET /compute/v2.1/flavors/detail?marker=452 => generated 2500 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:12:16.657474 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-c7683542-6f66-4ebc-8418-7fb1467a6afa tempest-FlavorsV2TestJSON-102836632 tempest-FlavorsV2TestJSON-102836632-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:12:16.666708 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-c7683542-6f66-4ebc-8418-7fb1467a6afa tempest-FlavorsV2TestJSON-102836632 tempest-FlavorsV2TestJSON-102836632-project] 10.222.0.13 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.013711 Nov 01 19:12:16.675986 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 2165/4271] 10.222.0.13 () {58 vars in 1137 bytes} [Tue Nov 1 19:12:16 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:12:16.679846 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-7ec81b45-d7b6-46a8-a223-9cf6c662bd1b tempest-FlavorsV2TestJSON-102836632 tempest-FlavorsV2TestJSON-102836632-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:12:16.700728 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-7ec81b45-d7b6-46a8-a223-9cf6c662bd1b tempest-FlavorsV2TestJSON-102836632 tempest-FlavorsV2TestJSON-102836632-project] 10.222.0.13 "GET /compute/v2.1/flavors?minDisk=2" status: 200 len: 1663 microversion: 2.1 time: 0.024567 Nov 01 19:12:16.711534 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 2107/4272] 10.222.0.13 () {58 vars in 1144 bytes} [Tue Nov 1 19:12:16 2022] GET /compute/v2.1/flavors?minDisk=2 => generated 1663 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 19:12:16.717244 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-ceface81-27b7-499c-8e2e-ec5516e9f607 tempest-FlavorsV2TestJSON-102836632 tempest-FlavorsV2TestJSON-102836632-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:12:16.727567 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-ceface81-27b7-499c-8e2e-ec5516e9f607 tempest-FlavorsV2TestJSON-102836632 tempest-FlavorsV2TestJSON-102836632-project] 10.222.0.13 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.014778 Nov 01 19:12:16.728767 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 2166/4273] 10.222.0.13 () {58 vars in 1137 bytes} [Tue Nov 1 19:12:16 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 01 19:12:16.742740 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-4f238564-924c-4e71-a01b-299bcdd3f92b tempest-FlavorsV2TestJSON-102836632 tempest-FlavorsV2TestJSON-102836632-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:12:16.761299 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-4f238564-924c-4e71-a01b-299bcdd3f92b tempest-FlavorsV2TestJSON-102836632 tempest-FlavorsV2TestJSON-102836632-project] 10.222.0.13 "GET /compute/v2.1/flavors?minRam=1025" status: 200 len: 1111 microversion: 2.1 time: 0.023691 Nov 01 19:12:16.762562 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 2108/4274] 10.222.0.13 () {58 vars in 1148 bytes} [Tue Nov 1 19:12:16 2022] GET /compute/v2.1/flavors?minRam=1025 => generated 1111 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:12:16.777453 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-ad3ae002-f840-4cad-8886-2c842a829cb1 tempest-FlavorsV2TestJSON-102836632 tempest-FlavorsV2TestJSON-102836632-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:12:16.792628 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-ad3ae002-f840-4cad-8886-2c842a829cb1 tempest-FlavorsV2TestJSON-102836632 tempest-FlavorsV2TestJSON-102836632-project] 10.222.0.13 "GET /compute/v2.1/flavors?limit=1" status: 200 len: 299 microversion: 2.1 time: 0.019327 Nov 01 19:12:16.793666 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 2167/4275] 10.222.0.13 () {58 vars in 1140 bytes} [Tue Nov 1 19:12:16 2022] GET /compute/v2.1/flavors?limit=1 => generated 299 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:12:16.809935 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-f7fd86ca-09f6-4ca1-acad-4d8b9741aa4d tempest-FlavorsV2TestJSON-102836632 tempest-FlavorsV2TestJSON-102836632-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:12:16.821628 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-f7fd86ca-09f6-4ca1-acad-4d8b9741aa4d tempest-FlavorsV2TestJSON-102836632 tempest-FlavorsV2TestJSON-102836632-project] 10.222.0.13 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.016382 Nov 01 19:12:16.823572 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 2109/4276] 10.222.0.13 () {58 vars in 1137 bytes} [Tue Nov 1 19:12:16 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:12:16.835493 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-28f3ac3c-21f4-47ed-ad0b-16ea551afe10 tempest-FlavorsV2TestJSON-102836632 tempest-FlavorsV2TestJSON-102836632-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:12:16.889443 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-28f3ac3c-21f4-47ed-ad0b-16ea551afe10 tempest-FlavorsV2TestJSON-102836632 tempest-FlavorsV2TestJSON-102836632-project] 10.222.0.13 "GET /compute/v2.1/flavors?marker=452" status: 200 len: 1300 microversion: 2.1 time: 0.057916 Nov 01 19:12:16.899580 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 2168/4277] 10.222.0.13 () {58 vars in 1146 bytes} [Tue Nov 1 19:12:16 2022] GET /compute/v2.1/flavors?marker=452 => generated 1300 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:12:16.904312 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-48c1c295-fe22-4a4e-999f-ac531337bed7 tempest-FlavorsV2TestJSON-102836632 tempest-FlavorsV2TestJSON-102836632-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:12:16.962737 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-48c1c295-fe22-4a4e-999f-ac531337bed7 tempest-FlavorsV2TestJSON-102836632 tempest-FlavorsV2TestJSON-102836632-project] 10.222.0.13 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.061860 Nov 01 19:12:16.963935 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 2110/4278] 10.222.0.13 () {58 vars in 1146 bytes} [Tue Nov 1 19:12:16 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:12:16.988041 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-b6d7ae5b-c9a6-4487-a805-67ee668712f3 tempest-FlavorsV2TestJSON-102836632 tempest-FlavorsV2TestJSON-102836632-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:12:17.001091 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-b6d7ae5b-c9a6-4487-a805-67ee668712f3 tempest-FlavorsV2TestJSON-102836632 tempest-FlavorsV2TestJSON-102836632-project] 10.222.0.13 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.019351 Nov 01 19:12:17.010955 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 2169/4279] 10.222.0.13 () {58 vars in 1137 bytes} [Tue Nov 1 19:12:16 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:12:17.265506 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [req-429984cb-6b24-49d7-bdc1-4e2dd7243862 req-364d8c4f-86b9-4534-a212-8df89a5a4da5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "31bf7572-3418-4fbd-9356-03a890258701", "name": "network-vif-deleted", "tag": "f618307d-2062-4346-9bc6-738e0be05a65"}]} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:12:17.283965 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-429984cb-6b24-49d7-bdc1-4e2dd7243862 req-364d8c4f-86b9-4534-a212-8df89a5a4da5 service nova] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:12:17.284946 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-429984cb-6b24-49d7-bdc1-4e2dd7243862 req-364d8c4f-86b9-4534-a212-8df89a5a4da5 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:12:17.285582 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-429984cb-6b24-49d7-bdc1-4e2dd7243862 req-364d8c4f-86b9-4534-a212-8df89a5a4da5 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:12:17.303170 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.compute.server_external_events [req-429984cb-6b24-49d7-bdc1-4e2dd7243862 req-364d8c4f-86b9-4534-a212-8df89a5a4da5 service nova] Creating event network-vif-deleted:f618307d-2062-4346-9bc6-738e0be05a65 for instance 31bf7572-3418-4fbd-9356-03a890258701 on n-h2-863052-2 Nov 01 19:12:17.311717 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [req-429984cb-6b24-49d7-bdc1-4e2dd7243862 req-364d8c4f-86b9-4534-a212-8df89a5a4da5 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049848 Nov 01 19:12:17.312943 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 2111/4280] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Nov 1 19:12:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:12:17.658128 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-01e3d626-a381-424b-9294-a1f063903be6 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:12:17.658895 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-01e3d626-a381-424b-9294-a1f063903be6 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] [instance: 31bf7572-3418-4fbd-9356-03a890258701] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:12:17.674673 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-01e3d626-a381-424b-9294-a1f063903be6 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:12:17.675178 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-01e3d626-a381-424b-9294-a1f063903be6 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:12:17.675707 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-01e3d626-a381-424b-9294-a1f063903be6 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:12:17.676433 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-01e3d626-a381-424b-9294-a1f063903be6 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:12:17.677697 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-01e3d626-a381-424b-9294-a1f063903be6 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:12:17.678133 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-01e3d626-a381-424b-9294-a1f063903be6 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:12:17.748134 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-01e3d626-a381-424b-9294-a1f063903be6 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:12:17.748661 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-01e3d626-a381-424b-9294-a1f063903be6 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:12:17.749107 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-01e3d626-a381-424b-9294-a1f063903be6 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:12:17.749569 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.objects.instance [None req-01e3d626-a381-424b-9294-a1f063903be6 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lazy-loading 'fault' on Instance uuid 31bf7572-3418-4fbd-9356-03a890258701 {{(pid=121403) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 01 19:12:17.831559 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-01e3d626-a381-424b-9294-a1f063903be6 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc5c19b930543f5a5091922a9859813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ecdc83933544a899117531a960027a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:12:17.851000 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-01e3d626-a381-424b-9294-a1f063903be6 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] 10.222.0.13 "GET /compute/v2.1/servers/31bf7572-3418-4fbd-9356-03a890258701" status: 200 len: 1307 microversion: 2.1 time: 0.198621 Nov 01 19:12:17.851623 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 2170/4281] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:12:17 2022] GET /compute/v2.1/servers/31bf7572-3418-4fbd-9356-03a890258701 => generated 1307 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:12:18.879173 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-f0ab83ad-757b-4921-bdfe-c299fdac6e48 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:12:18.880446 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-f0ab83ad-757b-4921-bdfe-c299fdac6e48 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] [instance: 31bf7572-3418-4fbd-9356-03a890258701] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:12:18.890125 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f0ab83ad-757b-4921-bdfe-c299fdac6e48 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:12:18.898550 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f0ab83ad-757b-4921-bdfe-c299fdac6e48 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:12:18.900130 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f0ab83ad-757b-4921-bdfe-c299fdac6e48 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:12:18.902294 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f0ab83ad-757b-4921-bdfe-c299fdac6e48 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:12:18.903400 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f0ab83ad-757b-4921-bdfe-c299fdac6e48 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:12:18.905798 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-f0ab83ad-757b-4921-bdfe-c299fdac6e48 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:12:18.946071 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.wsgi [None req-f0ab83ad-757b-4921-bdfe-c299fdac6e48 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] HTTP exception thrown: Instance 31bf7572-3418-4fbd-9356-03a890258701 could not be found. Nov 01 19:12:18.950089 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-f0ab83ad-757b-4921-bdfe-c299fdac6e48 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Request method failure captured: Nov 01 19:12:18.950089 n-d-863052-2 devstack@n-api.service[121402]: request: GET /compute/v2.1/servers/31bf7572-3418-4fbd-9356-03a890258701 HTTP/1.1 Nov 01 19:12:18.950089 n-d-863052-2 devstack@n-api.service[121402]: Accept: application/json Nov 01 19:12:18.950089 n-d-863052-2 devstack@n-api.service[121402]: Accept-Encoding: identity Nov 01 19:12:18.950089 n-d-863052-2 devstack@n-api.service[121402]: Connection: close Nov 01 19:12:18.950089 n-d-863052-2 devstack@n-api.service[121402]: Content-Length: 0 Nov 01 19:12:18.950089 n-d-863052-2 devstack@n-api.service[121402]: Content-Type: application/json Nov 01 19:12:18.950089 n-d-863052-2 devstack@n-api.service[121402]: Host: 10.222.0.13 Nov 01 19:12:18.950089 n-d-863052-2 devstack@n-api.service[121402]: Openstack-System-Scope: None Nov 01 19:12:18.950089 n-d-863052-2 devstack@n-api.service[121402]: User-Agent: python-urllib3/1.26.12 Nov 01 19:12:18.950089 n-d-863052-2 devstack@n-api.service[121402]: X-Auth-Token: gAAAAABjYW9YFTR7hO-vK03S-3HbvOtG2z3_fji2KJH39vNHENu4xIKneeHYviQiPj9ERGiA3aZIA7DvAYzczgSZ5-vK782IQ7CYnUFXvn9Aqt1AbunNMYxhes9BKzhvODzqwzqiQq89wgC4nbpZ9jJWFWMOC4z9bcW4UMi_ylwdZFjmhWfD49s Nov 01 19:12:18.950089 n-d-863052-2 devstack@n-api.service[121402]: X-Domain-Id: None Nov 01 19:12:18.950089 n-d-863052-2 devstack@n-api.service[121402]: X-Domain-Name: None Nov 01 19:12:18.950089 n-d-863052-2 devstack@n-api.service[121402]: X-Identity-Status: Confirmed Nov 01 19:12:18.950089 n-d-863052-2 devstack@n-api.service[121402]: X-Is-Admin-Project: True Nov 01 19:12:18.950089 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Domain-Id: default Nov 01 19:12:18.950089 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Domain-Name: Default Nov 01 19:12:18.950089 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Id: 9ecdc83933544a899117531a960027a7 Nov 01 19:12:18.950089 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Name: tempest-ServersNegativeTestJSON-638944671 Nov 01 19:12:18.950089 n-d-863052-2 devstack@n-api.service[121402]: X-Role: member,reader Nov 01 19:12:18.950089 n-d-863052-2 devstack@n-api.service[121402]: X-Roles: member,reader Nov 01 19:12:18.950089 n-d-863052-2 devstack@n-api.service[121402]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/9ecdc83933544a899117531a960027a7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/9ecdc83933544a899117531a960027a7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_9ecdc83933544a899117531a960027a7", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/9ecdc83933544a899117531a960027a7"}]}] Nov 01 19:12:18.950089 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant: tempest-ServersNegativeTestJSON-638944671 Nov 01 19:12:18.950089 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant-Id: 9ecdc83933544a899117531a960027a7 Nov 01 19:12:18.950089 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant-Name: tempest-ServersNegativeTestJSON-638944671 Nov 01 19:12:18.950089 n-d-863052-2 devstack@n-api.service[121402]: X-User: tempest-ServersNegativeTestJSON-638944671-project Nov 01 19:12:18.950089 n-d-863052-2 devstack@n-api.service[121402]: X-User-Domain-Id: default Nov 01 19:12:18.950089 n-d-863052-2 devstack@n-api.service[121402]: X-User-Domain-Name: Default Nov 01 19:12:18.950089 n-d-863052-2 devstack@n-api.service[121402]: X-User-Id: 3fc5c19b930543f5a5091922a9859813 Nov 01 19:12:18.950089 n-d-863052-2 devstack@n-api.service[121402]: X-User-Name: tempest-ServersNegativeTestJSON-638944671-project Nov 01 19:12:18.950089 n-d-863052-2 devstack@n-api.service[121402]: method: > Nov 01 19:12:18.950089 n-d-863052-2 devstack@n-api.service[121402]: exception: Instance 31bf7572-3418-4fbd-9356-03a890258701 could not be found. Nov 01 19:12:18.950089 n-d-863052-2 devstack@n-api.service[121402]: action_args: {'id': '31bf7572-3418-4fbd-9356-03a890258701'} Nov 01 19:12:18.950089 n-d-863052-2 devstack@n-api.service[121402]: {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 01 19:12:18.950089 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:12:18.950089 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 01 19:12:18.950089 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 01 19:12:18.950089 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 01 19:12:18.950089 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 01 19:12:18.950089 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 01 19:12:18.950089 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 01 19:12:18.950089 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 01 19:12:18.950089 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 01 19:12:18.950089 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 31bf7572-3418-4fbd-9356-03a890258701 could not be found. Nov 01 19:12:18.950089 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:12:18.950089 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:12:18.950089 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:12:18.950089 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:12:18.950089 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:12:18.950089 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:12:18.950089 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 01 19:12:18.950089 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 01 19:12:18.950089 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 01 19:12:18.950089 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 01 19:12:18.950089 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 01 19:12:18.950089 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 01 19:12:18.950089 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 01 19:12:18.950089 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 01 19:12:18.950089 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 01 19:12:18.950089 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 01 19:12:18.950089 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 31bf7572-3418-4fbd-9356-03a890258701 could not be found. Nov 01 19:12:18.950089 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:12:18.950089 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:12:18.950089 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:12:18.953685 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:12:18.953685 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:12:18.953685 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:12:18.953685 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 01 19:12:18.953685 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 01 19:12:18.953685 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 31bf7572-3418-4fbd-9356-03a890258701 could not be found. Nov 01 19:12:18.953685 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:12:18.961159 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-f0ab83ad-757b-4921-bdfe-c299fdac6e48 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Returning 404 to user: Instance 31bf7572-3418-4fbd-9356-03a890258701 could not be found. {{(pid=121402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 01 19:12:18.962947 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-f0ab83ad-757b-4921-bdfe-c299fdac6e48 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] 10.222.0.13 "GET /compute/v2.1/servers/31bf7572-3418-4fbd-9356-03a890258701" status: 404 len: 111 microversion: 2.1 time: 0.089698 Nov 01 19:12:18.967493 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 2112/4282] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:12:18 2022] GET /compute/v2.1/servers/31bf7572-3418-4fbd-9356-03a890258701 => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 01 19:12:18.973907 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-739fb69a-56a7-4874-a5db-376dbb527e2a tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:12:18.974673 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-739fb69a-56a7-4874-a5db-376dbb527e2a tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] [instance: b27eaab4-a751-47fb-acdb-db7c99b06a5f] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:12:18.984627 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-739fb69a-56a7-4874-a5db-376dbb527e2a tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:12:18.989849 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-739fb69a-56a7-4874-a5db-376dbb527e2a tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:12:18.990427 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-739fb69a-56a7-4874-a5db-376dbb527e2a tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:12:18.991302 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-739fb69a-56a7-4874-a5db-376dbb527e2a tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:12:18.991955 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-739fb69a-56a7-4874-a5db-376dbb527e2a tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:12:18.993110 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-739fb69a-56a7-4874-a5db-376dbb527e2a tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:12:19.348727 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-8fca62aa-870e-4d55-94b2-e92590994b8e tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:12:19.351767 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-8fca62aa-870e-4d55-94b2-e92590994b8e tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] [instance: cae1c729-7c41-488d-ab0e-30d1f5d22180] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:12:19.375389 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-8fca62aa-870e-4d55-94b2-e92590994b8e tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:12:19.376130 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-8fca62aa-870e-4d55-94b2-e92590994b8e tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:12:19.377834 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-8fca62aa-870e-4d55-94b2-e92590994b8e tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:12:19.381100 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-8fca62aa-870e-4d55-94b2-e92590994b8e tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:12:19.382319 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-8fca62aa-870e-4d55-94b2-e92590994b8e tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:12:19.382915 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-8fca62aa-870e-4d55-94b2-e92590994b8e tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:12:19.985895 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-8fca62aa-870e-4d55-94b2-e92590994b8e tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcf93260eaef487dac5d7bb00b26e3b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73cb8697de6d407ba82c334d9f2b48d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:12:19.997518 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-8fca62aa-870e-4d55-94b2-e92590994b8e tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] 10.222.0.13 "GET /compute/v2.1/servers/cae1c729-7c41-488d-ab0e-30d1f5d22180" status: 200 len: 1667 microversion: 2.1 time: 0.656215 Nov 01 19:12:20.021145 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 2113/4283] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:12:19 2022] GET /compute/v2.1/servers/cae1c729-7c41-488d-ab0e-30d1f5d22180 => generated 1667 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:12:20.032611 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-6a55e767-b29f-411d-8630-04ed37b4654c tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:12:20.041699 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-6a55e767-b29f-411d-8630-04ed37b4654c tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] [instance: cae1c729-7c41-488d-ab0e-30d1f5d22180] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:12:20.050104 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-6a55e767-b29f-411d-8630-04ed37b4654c tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:12:20.051699 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-6a55e767-b29f-411d-8630-04ed37b4654c tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:12:20.052362 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-6a55e767-b29f-411d-8630-04ed37b4654c tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:12:20.057545 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-6a55e767-b29f-411d-8630-04ed37b4654c tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:12:20.058364 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-6a55e767-b29f-411d-8630-04ed37b4654c tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:12:20.059019 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-6a55e767-b29f-411d-8630-04ed37b4654c tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:12:20.338757 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-6a55e767-b29f-411d-8630-04ed37b4654c tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcf93260eaef487dac5d7bb00b26e3b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73cb8697de6d407ba82c334d9f2b48d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:12:20.349715 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-6a55e767-b29f-411d-8630-04ed37b4654c tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] 10.222.0.13 "GET /compute/v2.1/servers/cae1c729-7c41-488d-ab0e-30d1f5d22180" status: 200 len: 1667 microversion: 2.1 time: 0.321437 Nov 01 19:12:20.365775 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 2114/4284] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:12:20 2022] GET /compute/v2.1/servers/cae1c729-7c41-488d-ab0e-30d1f5d22180 => generated 1667 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 19:12:20.374613 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-1c32d701-633d-4d4b-9d1c-eb1859284737 tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:12:20.375865 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-1c32d701-633d-4d4b-9d1c-eb1859284737 tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] [instance: cae1c729-7c41-488d-ab0e-30d1f5d22180] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:12:20.382666 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-1c32d701-633d-4d4b-9d1c-eb1859284737 tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:12:20.383403 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-1c32d701-633d-4d4b-9d1c-eb1859284737 tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:12:20.384001 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-1c32d701-633d-4d4b-9d1c-eb1859284737 tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:12:20.384926 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-1c32d701-633d-4d4b-9d1c-eb1859284737 tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:12:20.385896 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-1c32d701-633d-4d4b-9d1c-eb1859284737 tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:12:20.386481 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-1c32d701-633d-4d4b-9d1c-eb1859284737 tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:12:20.464712 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-739fb69a-56a7-4874-a5db-376dbb527e2a tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc5c19b930543f5a5091922a9859813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ecdc83933544a899117531a960027a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:12:20.480160 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-739fb69a-56a7-4874-a5db-376dbb527e2a tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] 10.222.0.13 "GET /compute/v2.1/servers/b27eaab4-a751-47fb-acdb-db7c99b06a5f" status: 200 len: 1506 microversion: 2.1 time: 1.509519 Nov 01 19:12:20.500571 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 2171/4285] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:12:18 2022] GET /compute/v2.1/servers/b27eaab4-a751-47fb-acdb-db7c99b06a5f => generated 1506 bytes in 1531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:12:20.667003 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-1c32d701-633d-4d4b-9d1c-eb1859284737 tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcf93260eaef487dac5d7bb00b26e3b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73cb8697de6d407ba82c334d9f2b48d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:12:20.678170 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-1c32d701-633d-4d4b-9d1c-eb1859284737 tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] 10.222.0.13 "GET /compute/v2.1/servers/cae1c729-7c41-488d-ab0e-30d1f5d22180" status: 200 len: 1667 microversion: 2.1 time: 0.308213 Nov 01 19:12:20.680019 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 2115/4286] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:12:20 2022] GET /compute/v2.1/servers/cae1c729-7c41-488d-ab0e-30d1f5d22180 => generated 1667 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 19:12:20.705383 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-acbca250-08f2-4995-95e7-0ed5e9e0bbb5 tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-1-718720000"}} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:12:20.708343 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-acbca250-08f2-4995-95e7-0ed5e9e0bbb5 tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] [instance: cae1c729-7c41-488d-ab0e-30d1f5d22180] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:12:20.719783 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-acbca250-08f2-4995-95e7-0ed5e9e0bbb5 tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:12:20.726596 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-acbca250-08f2-4995-95e7-0ed5e9e0bbb5 tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:12:20.727903 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-acbca250-08f2-4995-95e7-0ed5e9e0bbb5 tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:12:20.728775 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-acbca250-08f2-4995-95e7-0ed5e9e0bbb5 tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:12:20.729927 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-acbca250-08f2-4995-95e7-0ed5e9e0bbb5 tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:12:20.734073 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-acbca250-08f2-4995-95e7-0ed5e9e0bbb5 tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:12:20.775059 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-33315932-934b-46f4-a81a-5a942a87478d tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Action: 'create', calling method: >, body: {"server": {"name": 12345, "imageRef": "2d4a0047-1b9e-445f-8af8-1b5c9d93e881", "flavorRef": "452", "networks": [{"uuid": "f2fc603f-a5ab-4120-939f-124d49e1f7c1"}]}} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:12:20.779050 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-33315932-934b-46f4-a81a-5a942a87478d tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Request method failure captured: Nov 01 19:12:20.779050 n-d-863052-2 devstack@n-api.service[121402]: request: POST /compute/v2.1/servers HTTP/1.1 Nov 01 19:12:20.779050 n-d-863052-2 devstack@n-api.service[121402]: Accept: application/json Nov 01 19:12:20.779050 n-d-863052-2 devstack@n-api.service[121402]: Accept-Encoding: identity Nov 01 19:12:20.779050 n-d-863052-2 devstack@n-api.service[121402]: Connection: close Nov 01 19:12:20.779050 n-d-863052-2 devstack@n-api.service[121402]: Content-Length: 163 Nov 01 19:12:20.779050 n-d-863052-2 devstack@n-api.service[121402]: Content-Type: application/json Nov 01 19:12:20.779050 n-d-863052-2 devstack@n-api.service[121402]: Host: 10.222.0.13 Nov 01 19:12:20.779050 n-d-863052-2 devstack@n-api.service[121402]: Openstack-System-Scope: None Nov 01 19:12:20.779050 n-d-863052-2 devstack@n-api.service[121402]: User-Agent: python-urllib3/1.26.12 Nov 01 19:12:20.779050 n-d-863052-2 devstack@n-api.service[121402]: X-Auth-Token: gAAAAABjYW9YFTR7hO-vK03S-3HbvOtG2z3_fji2KJH39vNHENu4xIKneeHYviQiPj9ERGiA3aZIA7DvAYzczgSZ5-vK782IQ7CYnUFXvn9Aqt1AbunNMYxhes9BKzhvODzqwzqiQq89wgC4nbpZ9jJWFWMOC4z9bcW4UMi_ylwdZFjmhWfD49s Nov 01 19:12:20.779050 n-d-863052-2 devstack@n-api.service[121402]: X-Domain-Id: None Nov 01 19:12:20.779050 n-d-863052-2 devstack@n-api.service[121402]: X-Domain-Name: None Nov 01 19:12:20.779050 n-d-863052-2 devstack@n-api.service[121402]: X-Identity-Status: Confirmed Nov 01 19:12:20.779050 n-d-863052-2 devstack@n-api.service[121402]: X-Is-Admin-Project: True Nov 01 19:12:20.779050 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Domain-Id: default Nov 01 19:12:20.779050 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Domain-Name: Default Nov 01 19:12:20.779050 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Id: 9ecdc83933544a899117531a960027a7 Nov 01 19:12:20.779050 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Name: tempest-ServersNegativeTestJSON-638944671 Nov 01 19:12:20.779050 n-d-863052-2 devstack@n-api.service[121402]: X-Role: member,reader Nov 01 19:12:20.779050 n-d-863052-2 devstack@n-api.service[121402]: X-Roles: member,reader Nov 01 19:12:20.779050 n-d-863052-2 devstack@n-api.service[121402]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/9ecdc83933544a899117531a960027a7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/9ecdc83933544a899117531a960027a7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_9ecdc83933544a899117531a960027a7", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/9ecdc83933544a899117531a960027a7"}]}] Nov 01 19:12:20.779050 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant: tempest-ServersNegativeTestJSON-638944671 Nov 01 19:12:20.779050 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant-Id: 9ecdc83933544a899117531a960027a7 Nov 01 19:12:20.779050 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant-Name: tempest-ServersNegativeTestJSON-638944671 Nov 01 19:12:20.779050 n-d-863052-2 devstack@n-api.service[121402]: X-User: tempest-ServersNegativeTestJSON-638944671-project Nov 01 19:12:20.779050 n-d-863052-2 devstack@n-api.service[121402]: X-User-Domain-Id: default Nov 01 19:12:20.779050 n-d-863052-2 devstack@n-api.service[121402]: X-User-Domain-Name: Default Nov 01 19:12:20.779050 n-d-863052-2 devstack@n-api.service[121402]: X-User-Id: 3fc5c19b930543f5a5091922a9859813 Nov 01 19:12:20.779050 n-d-863052-2 devstack@n-api.service[121402]: X-User-Name: tempest-ServersNegativeTestJSON-638944671-project Nov 01 19:12:20.779050 n-d-863052-2 devstack@n-api.service[121402]: Nov 01 19:12:20.779050 n-d-863052-2 devstack@n-api.service[121402]: {"server": {"name": 12345, "imageRef": "2d4a0047-1b9e-445f-8af8-1b5c9d93e881", "flavorRef": "452", "networks": [{"uuid": "f2fc603f-a5ab-4120-939f-124d49e1f7c1"}]}} Nov 01 19:12:20.779050 n-d-863052-2 devstack@n-api.service[121402]: method: > Nov 01 19:12:20.779050 n-d-863052-2 devstack@n-api.service[121402]: exception: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Nov 01 19:12:20.779050 n-d-863052-2 devstack@n-api.service[121402]: action_args: {'body': {'server': {'name': 12345, 'imageRef': '2d4a0047-1b9e-445f-8af8-1b5c9d93e881', 'flavorRef': '452', 'networks': [{'uuid': 'f2fc603f-a5ab-4120-939f-124d49e1f7c1'}]}}} Nov 01 19:12:20.779050 n-d-863052-2 devstack@n-api.service[121402]: {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 01 19:12:20.779050 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:12:20.779050 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Nov 01 19:12:20.779050 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Nov 01 19:12:20.779050 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Nov 01 19:12:20.779050 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise error Nov 01 19:12:20.779050 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 12345 is not of type 'string' Nov 01 19:12:20.779050 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:12:20.779050 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['name']: Nov 01 19:12:20.779050 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Nov 01 19:12:20.779050 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:12:20.779050 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi On instance['server']: Nov 01 19:12:20.779050 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi 12345 Nov 01 19:12:20.779050 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:12:20.779050 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:12:20.779050 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:12:20.779050 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:12:20.779050 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:12:20.779050 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:12:20.779050 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 01 19:12:20.779050 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 01 19:12:20.779050 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 01 19:12:20.779050 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 01 19:12:20.779050 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 01 19:12:20.779050 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 01 19:12:20.779050 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Nov 01 19:12:20.779050 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Nov 01 19:12:20.779050 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Nov 01 19:12:20.779050 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Nov 01 19:12:20.779050 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Nov 01 19:12:20.785501 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Nov 01 19:12:20.785501 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Nov 01 19:12:20.785501 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:12:20.785501 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:12:20.785501 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:12:20.785501 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:12:20.785501 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:12:20.785501 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:12:20.785501 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Nov 01 19:12:20.785501 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Nov 01 19:12:20.785501 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Nov 01 19:12:20.785501 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:12:20.785501 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-33315932-934b-46f4-a81a-5a942a87478d tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Returning 400 to user: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' {{(pid=121402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 01 19:12:20.787075 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-33315932-934b-46f4-a81a-5a942a87478d tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 400 len: 127 microversion: 2.1 time: 0.014348 Nov 01 19:12:20.793726 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 2116/4287] 10.222.0.13 () {60 vars in 1147 bytes} [Tue Nov 1 19:12:20 2022] POST /compute/v2.1/servers => generated 127 bytes in 20 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Nov 01 19:12:20.801168 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-b2bc4dec-3a23-40a3-8d49-a9e890fab052 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:12:20.804117 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-b2bc4dec-3a23-40a3-8d49-a9e890fab052 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] [instance: b27eaab4-a751-47fb-acdb-db7c99b06a5f] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:12:20.828518 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b2bc4dec-3a23-40a3-8d49-a9e890fab052 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:12:20.832150 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b2bc4dec-3a23-40a3-8d49-a9e890fab052 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:12:20.839110 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b2bc4dec-3a23-40a3-8d49-a9e890fab052 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:12:20.842296 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b2bc4dec-3a23-40a3-8d49-a9e890fab052 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:12:20.843778 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b2bc4dec-3a23-40a3-8d49-a9e890fab052 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:12:20.844860 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b2bc4dec-3a23-40a3-8d49-a9e890fab052 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:12:21.133190 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-acbca250-08f2-4995-95e7-0ed5e9e0bbb5 tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] 10.222.0.13 "POST /compute/v2.1/servers/cae1c729-7c41-488d-ab0e-30d1f5d22180/action" status: 202 len: 0 microversion: 2.1 time: 0.432388 Nov 01 19:12:21.134882 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 2172/4288] 10.222.0.13 () {60 vars in 1278 bytes} [Tue Nov 1 19:12:20 2022] POST /compute/v2.1/servers/cae1c729-7c41-488d-ab0e-30d1f5d22180/action => generated 0 bytes in 435 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Nov 01 19:12:21.617097 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-b2bc4dec-3a23-40a3-8d49-a9e890fab052 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc5c19b930543f5a5091922a9859813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ecdc83933544a899117531a960027a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:12:21.630103 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-b2bc4dec-3a23-40a3-8d49-a9e890fab052 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] 10.222.0.13 "GET /compute/v2.1/servers/b27eaab4-a751-47fb-acdb-db7c99b06a5f" status: 200 len: 1506 microversion: 2.1 time: 0.833841 Nov 01 19:12:21.637059 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 2117/4289] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:12:20 2022] GET /compute/v2.1/servers/b27eaab4-a751-47fb-acdb-db7c99b06a5f => generated 1506 bytes in 842 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 19:12:21.665238 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-8cde556e-a0ea-41e6-99e9-b1df57458b72 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:12:21.665937 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-8cde556e-a0ea-41e6-99e9-b1df57458b72 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] [instance: b27eaab4-a751-47fb-acdb-db7c99b06a5f] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:12:21.682296 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-8cde556e-a0ea-41e6-99e9-b1df57458b72 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:12:21.682296 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-8cde556e-a0ea-41e6-99e9-b1df57458b72 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:12:21.682535 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-8cde556e-a0ea-41e6-99e9-b1df57458b72 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:12:21.691766 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-8cde556e-a0ea-41e6-99e9-b1df57458b72 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:12:21.692137 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-8cde556e-a0ea-41e6-99e9-b1df57458b72 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:12:21.697487 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-8cde556e-a0ea-41e6-99e9-b1df57458b72 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:12:22.717429 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-8cde556e-a0ea-41e6-99e9-b1df57458b72 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc5c19b930543f5a5091922a9859813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ecdc83933544a899117531a960027a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:12:22.725314 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-8cde556e-a0ea-41e6-99e9-b1df57458b72 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] 10.222.0.13 "GET /compute/v2.1/servers/b27eaab4-a751-47fb-acdb-db7c99b06a5f" status: 200 len: 1506 microversion: 2.1 time: 1.065878 Nov 01 19:12:22.728909 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 2173/4290] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:12:21 2022] GET /compute/v2.1/servers/b27eaab4-a751-47fb-acdb-db7c99b06a5f => generated 1506 bytes in 1070 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:12:27.927466 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-86fca2d9-fe3b-42e1-bf32-65a2dfc3b209 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-599899431", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "5138f008-c842-45b4-af74-d5a9fb04d7af", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "f2fc603f-a5ab-4120-939f-124d49e1f7c1"}]}} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:12:28.112338 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.wsgi [None req-86fca2d9-fe3b-42e1-bf32-65a2dfc3b209 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] HTTP exception thrown: Block Device 5138f008-c842-45b4-af74-d5a9fb04d7af is not bootable. Nov 01 19:12:28.121579 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-86fca2d9-fe3b-42e1-bf32-65a2dfc3b209 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Request method failure captured: Nov 01 19:12:28.121579 n-d-863052-2 devstack@n-api.service[121402]: request: POST /compute/v2.1/servers HTTP/1.1 Nov 01 19:12:28.121579 n-d-863052-2 devstack@n-api.service[121402]: Accept: application/json Nov 01 19:12:28.121579 n-d-863052-2 devstack@n-api.service[121402]: Accept-Encoding: identity Nov 01 19:12:28.121579 n-d-863052-2 devstack@n-api.service[121402]: Connection: close Nov 01 19:12:28.121579 n-d-863052-2 devstack@n-api.service[121402]: Content-Length: 357 Nov 01 19:12:28.121579 n-d-863052-2 devstack@n-api.service[121402]: Content-Type: application/json Nov 01 19:12:28.121579 n-d-863052-2 devstack@n-api.service[121402]: Host: 10.222.0.13 Nov 01 19:12:28.121579 n-d-863052-2 devstack@n-api.service[121402]: Openstack-System-Scope: None Nov 01 19:12:28.121579 n-d-863052-2 devstack@n-api.service[121402]: User-Agent: python-urllib3/1.26.12 Nov 01 19:12:28.121579 n-d-863052-2 devstack@n-api.service[121402]: X-Auth-Token: gAAAAABjYW9YFTR7hO-vK03S-3HbvOtG2z3_fji2KJH39vNHENu4xIKneeHYviQiPj9ERGiA3aZIA7DvAYzczgSZ5-vK782IQ7CYnUFXvn9Aqt1AbunNMYxhes9BKzhvODzqwzqiQq89wgC4nbpZ9jJWFWMOC4z9bcW4UMi_ylwdZFjmhWfD49s Nov 01 19:12:28.121579 n-d-863052-2 devstack@n-api.service[121402]: X-Domain-Id: None Nov 01 19:12:28.121579 n-d-863052-2 devstack@n-api.service[121402]: X-Domain-Name: None Nov 01 19:12:28.121579 n-d-863052-2 devstack@n-api.service[121402]: X-Identity-Status: Confirmed Nov 01 19:12:28.121579 n-d-863052-2 devstack@n-api.service[121402]: X-Is-Admin-Project: True Nov 01 19:12:28.121579 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Domain-Id: default Nov 01 19:12:28.121579 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Domain-Name: Default Nov 01 19:12:28.121579 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Id: 9ecdc83933544a899117531a960027a7 Nov 01 19:12:28.121579 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Name: tempest-ServersNegativeTestJSON-638944671 Nov 01 19:12:28.121579 n-d-863052-2 devstack@n-api.service[121402]: X-Role: member,reader Nov 01 19:12:28.121579 n-d-863052-2 devstack@n-api.service[121402]: X-Roles: member,reader Nov 01 19:12:28.121579 n-d-863052-2 devstack@n-api.service[121402]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/9ecdc83933544a899117531a960027a7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/9ecdc83933544a899117531a960027a7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_9ecdc83933544a899117531a960027a7", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/9ecdc83933544a899117531a960027a7"}]}] Nov 01 19:12:28.121579 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant: tempest-ServersNegativeTestJSON-638944671 Nov 01 19:12:28.121579 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant-Id: 9ecdc83933544a899117531a960027a7 Nov 01 19:12:28.121579 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant-Name: tempest-ServersNegativeTestJSON-638944671 Nov 01 19:12:28.121579 n-d-863052-2 devstack@n-api.service[121402]: X-User: tempest-ServersNegativeTestJSON-638944671-project Nov 01 19:12:28.121579 n-d-863052-2 devstack@n-api.service[121402]: X-User-Domain-Id: default Nov 01 19:12:28.121579 n-d-863052-2 devstack@n-api.service[121402]: X-User-Domain-Name: Default Nov 01 19:12:28.121579 n-d-863052-2 devstack@n-api.service[121402]: X-User-Id: 3fc5c19b930543f5a5091922a9859813 Nov 01 19:12:28.121579 n-d-863052-2 devstack@n-api.service[121402]: X-User-Name: tempest-ServersNegativeTestJSON-638944671-project Nov 01 19:12:28.121579 n-d-863052-2 devstack@n-api.service[121402]: Nov 01 19:12:28.121579 n-d-863052-2 devstack@n-api.service[121402]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-599899431", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "5138f008-c842-45b4-af74-d5a9fb04d7af", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "f2fc603f-a5ab-4120-939f-124d49e1f7c1"}]}} Nov 01 19:12:28.121579 n-d-863052-2 devstack@n-api.service[121402]: method: > Nov 01 19:12:28.121579 n-d-863052-2 devstack@n-api.service[121402]: exception: Block Device 5138f008-c842-45b4-af74-d5a9fb04d7af is not bootable. Nov 01 19:12:28.121579 n-d-863052-2 devstack@n-api.service[121402]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-599899431', 'imageRef': '', 'flavorRef': '452', 'block_device_mapping_v2': [{'boot_index': 0, 'source_type': 'volume', 'destination_type': 'volume', 'delete_on_termination': False, 'volume_id': '5138f008-c842-45b4-af74-d5a9fb04d7af'}], 'networks': [{'uuid': 'f2fc603f-a5ab-4120-939f-124d49e1f7c1'}]}}} Nov 01 19:12:28.121579 n-d-863052-2 devstack@n-api.service[121402]: {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 01 19:12:28.121579 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:12:28.121579 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Nov 01 19:12:28.121579 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Nov 01 19:12:28.121579 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Nov 01 19:12:28.121579 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return self._create_instance( Nov 01 19:12:28.121579 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1672, in _create_instance Nov 01 19:12:28.121579 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi boot_meta = block_device.get_bdm_image_metadata( Nov 01 19:12:28.121579 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/block_device.py", line 664, in get_bdm_image_metadata Nov 01 19:12:28.121579 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise exception.InvalidBDMVolumeNotBootable(id=volume_id) Nov 01 19:12:28.121579 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi nova.exception.InvalidBDMVolumeNotBootable: Block Device 5138f008-c842-45b4-af74-d5a9fb04d7af is not bootable. Nov 01 19:12:28.121579 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:12:28.121579 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:12:28.121579 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:12:28.121579 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:12:28.121579 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:12:28.121579 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:12:28.121579 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 01 19:12:28.121579 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 01 19:12:28.121579 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 01 19:12:28.121579 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 01 19:12:28.121579 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 01 19:12:28.121579 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 01 19:12:28.121579 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 01 19:12:28.125604 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 01 19:12:28.125604 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 01 19:12:28.125604 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 01 19:12:28.125604 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Nov 01 19:12:28.125604 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Nov 01 19:12:28.125604 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Nov 01 19:12:28.125604 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Block Device 5138f008-c842-45b4-af74-d5a9fb04d7af is not bootable. Nov 01 19:12:28.125604 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:12:28.125604 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:12:28.125604 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:12:28.125604 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:12:28.125604 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:12:28.125604 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:12:28.125604 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 01 19:12:28.125604 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 01 19:12:28.125604 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Block Device 5138f008-c842-45b4-af74-d5a9fb04d7af is not bootable. Nov 01 19:12:28.125604 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:12:28.127348 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-86fca2d9-fe3b-42e1-bf32-65a2dfc3b209 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Returning 400 to user: Block Device 5138f008-c842-45b4-af74-d5a9fb04d7af is not bootable. {{(pid=121402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 01 19:12:28.128388 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-86fca2d9-fe3b-42e1-bf32-65a2dfc3b209 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 400 len: 110 microversion: 2.1 time: 0.204841 Nov 01 19:12:28.130268 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 2118/4291] 10.222.0.13 () {60 vars in 1147 bytes} [Tue Nov 1 19:12:27 2022] POST /compute/v2.1/servers => generated 110 bytes in 207 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 01 19:12:28.138171 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-9f3bf509-38ab-471b-8f1a-c2f6654a50be tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:12:28.140113 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-9f3bf509-38ab-471b-8f1a-c2f6654a50be tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] [instance: b27eaab4-a751-47fb-acdb-db7c99b06a5f] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:12:28.156441 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-9f3bf509-38ab-471b-8f1a-c2f6654a50be tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:12:28.159671 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-9f3bf509-38ab-471b-8f1a-c2f6654a50be tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:12:28.162838 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-9f3bf509-38ab-471b-8f1a-c2f6654a50be tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:12:28.164195 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-9f3bf509-38ab-471b-8f1a-c2f6654a50be tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:12:28.167066 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-9f3bf509-38ab-471b-8f1a-c2f6654a50be tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:12:28.181230 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-9f3bf509-38ab-471b-8f1a-c2f6654a50be tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:12:29.380054 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-9f3bf509-38ab-471b-8f1a-c2f6654a50be tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc5c19b930543f5a5091922a9859813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ecdc83933544a899117531a960027a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:12:29.388054 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-9f3bf509-38ab-471b-8f1a-c2f6654a50be tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] 10.222.0.13 "GET /compute/v2.1/servers/b27eaab4-a751-47fb-acdb-db7c99b06a5f" status: 200 len: 1506 microversion: 2.1 time: 1.254372 Nov 01 19:12:29.402953 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 2174/4292] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:12:28 2022] GET /compute/v2.1/servers/b27eaab4-a751-47fb-acdb-db7c99b06a5f => generated 1506 bytes in 1270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:12:29.437488 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-1aa8103f-3f0b-4742-8ba4-18941d49b1fe tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:12:29.439538 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-1aa8103f-3f0b-4742-8ba4-18941d49b1fe tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] [instance: b27eaab4-a751-47fb-acdb-db7c99b06a5f] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:12:29.451767 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-1aa8103f-3f0b-4742-8ba4-18941d49b1fe tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:12:29.452727 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-1aa8103f-3f0b-4742-8ba4-18941d49b1fe tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:12:29.453536 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-1aa8103f-3f0b-4742-8ba4-18941d49b1fe tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:12:29.457786 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-1aa8103f-3f0b-4742-8ba4-18941d49b1fe tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:12:29.458661 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-1aa8103f-3f0b-4742-8ba4-18941d49b1fe tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:12:29.459622 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-1aa8103f-3f0b-4742-8ba4-18941d49b1fe tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:12:30.277541 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-1aa8103f-3f0b-4742-8ba4-18941d49b1fe tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc5c19b930543f5a5091922a9859813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ecdc83933544a899117531a960027a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:12:30.296222 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-1aa8103f-3f0b-4742-8ba4-18941d49b1fe tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] 10.222.0.13 "GET /compute/v2.1/servers/b27eaab4-a751-47fb-acdb-db7c99b06a5f" status: 200 len: 1506 microversion: 2.1 time: 0.862198 Nov 01 19:12:30.308794 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 2119/4293] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:12:29 2022] GET /compute/v2.1/servers/b27eaab4-a751-47fb-acdb-db7c99b06a5f => generated 1506 bytes in 876 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:12:34.947240 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-ae35be2e-3842-4925-a88b-4846e03bad8f tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-524401881", "imageRef": "2d4a0047-1b9e-445f-8af8-1b5c9d93e881", "flavorRef": "452", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "2d4a0047-1b9e-445f-8af8-1b5c9d93e881", "destination_type": "local"}, {"source_type": "volume", "uuid": "7b971338-784e-4499-b65e-af6dc3041549", "destination_type": "invalid"}], "networks": [{"uuid": "f2fc603f-a5ab-4120-939f-124d49e1f7c1"}]}} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:12:34.951668 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-ae35be2e-3842-4925-a88b-4846e03bad8f tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Request method failure captured: Nov 01 19:12:34.951668 n-d-863052-2 devstack@n-api.service[121403]: request: POST /compute/v2.1/servers HTTP/1.1 Nov 01 19:12:34.951668 n-d-863052-2 devstack@n-api.service[121403]: Accept: application/json Nov 01 19:12:34.951668 n-d-863052-2 devstack@n-api.service[121403]: Accept-Encoding: identity Nov 01 19:12:34.951668 n-d-863052-2 devstack@n-api.service[121403]: Connection: close Nov 01 19:12:34.951668 n-d-863052-2 devstack@n-api.service[121403]: Content-Length: 494 Nov 01 19:12:34.951668 n-d-863052-2 devstack@n-api.service[121403]: Content-Type: application/json Nov 01 19:12:34.951668 n-d-863052-2 devstack@n-api.service[121403]: Host: 10.222.0.13 Nov 01 19:12:34.951668 n-d-863052-2 devstack@n-api.service[121403]: Openstack-System-Scope: None Nov 01 19:12:34.951668 n-d-863052-2 devstack@n-api.service[121403]: User-Agent: python-urllib3/1.26.12 Nov 01 19:12:34.951668 n-d-863052-2 devstack@n-api.service[121403]: X-Auth-Token: gAAAAABjYW9YFTR7hO-vK03S-3HbvOtG2z3_fji2KJH39vNHENu4xIKneeHYviQiPj9ERGiA3aZIA7DvAYzczgSZ5-vK782IQ7CYnUFXvn9Aqt1AbunNMYxhes9BKzhvODzqwzqiQq89wgC4nbpZ9jJWFWMOC4z9bcW4UMi_ylwdZFjmhWfD49s Nov 01 19:12:34.951668 n-d-863052-2 devstack@n-api.service[121403]: X-Domain-Id: None Nov 01 19:12:34.951668 n-d-863052-2 devstack@n-api.service[121403]: X-Domain-Name: None Nov 01 19:12:34.951668 n-d-863052-2 devstack@n-api.service[121403]: X-Identity-Status: Confirmed Nov 01 19:12:34.951668 n-d-863052-2 devstack@n-api.service[121403]: X-Is-Admin-Project: True Nov 01 19:12:34.951668 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Domain-Id: default Nov 01 19:12:34.951668 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Domain-Name: Default Nov 01 19:12:34.951668 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Id: 9ecdc83933544a899117531a960027a7 Nov 01 19:12:34.951668 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Name: tempest-ServersNegativeTestJSON-638944671 Nov 01 19:12:34.951668 n-d-863052-2 devstack@n-api.service[121403]: X-Role: member,reader Nov 01 19:12:34.951668 n-d-863052-2 devstack@n-api.service[121403]: X-Roles: member,reader Nov 01 19:12:34.951668 n-d-863052-2 devstack@n-api.service[121403]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/9ecdc83933544a899117531a960027a7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/9ecdc83933544a899117531a960027a7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_9ecdc83933544a899117531a960027a7", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/9ecdc83933544a899117531a960027a7"}]}] Nov 01 19:12:34.951668 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant: tempest-ServersNegativeTestJSON-638944671 Nov 01 19:12:34.951668 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant-Id: 9ecdc83933544a899117531a960027a7 Nov 01 19:12:34.951668 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant-Name: tempest-ServersNegativeTestJSON-638944671 Nov 01 19:12:34.951668 n-d-863052-2 devstack@n-api.service[121403]: X-User: tempest-ServersNegativeTestJSON-638944671-project Nov 01 19:12:34.951668 n-d-863052-2 devstack@n-api.service[121403]: X-User-Domain-Id: default Nov 01 19:12:34.951668 n-d-863052-2 devstack@n-api.service[121403]: X-User-Domain-Name: Default Nov 01 19:12:34.951668 n-d-863052-2 devstack@n-api.service[121403]: X-User-Id: 3fc5c19b930543f5a5091922a9859813 Nov 01 19:12:34.951668 n-d-863052-2 devstack@n-api.service[121403]: X-User-Name: tempest-ServersNegativeTestJSON-638944671-project Nov 01 19:12:34.951668 n-d-863052-2 devstack@n-api.service[121403]: Nov 01 19:12:34.951668 n-d-863052-2 devstack@n-api.service[121403]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-524401881", "imageRef": "2d4a0047-1b9e-445f-8af8-1b5c9d93e881", "flavorRef": "452", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "2d4a0047-1b9e-445f-8af8-1b5c9d93e881", "destination_type": "local"}, {"source_type": "volume", "uuid": "7b971338-784e-4499-b65e-af6dc3041549", "destination_type": "invalid"}], "networks": [{"uuid": "f2fc603f-a5ab-4120-939f-124d49e1f7c1"}]}} Nov 01 19:12:34.951668 n-d-863052-2 devstack@n-api.service[121403]: method: > Nov 01 19:12:34.951668 n-d-863052-2 devstack@n-api.service[121403]: exception: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Nov 01 19:12:34.951668 n-d-863052-2 devstack@n-api.service[121403]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-524401881', 'imageRef': '2d4a0047-1b9e-445f-8af8-1b5c9d93e881', 'flavorRef': '452', 'block_device_mapping_v2': [{'source_type': 'image', 'delete_on_termination': True, 'boot_index': 0, 'uuid': '2d4a0047-1b9e-445f-8af8-1b5c9d93e881', 'destination_type': 'local'}, {'source_type': 'volume', 'uuid': '7b971338-784e-4499-b65e-af6dc3041549', 'destination_type': 'invalid'}], 'networks': [{'uuid': 'f2fc603f-a5ab-4120-939f-124d49e1f7c1'}]}}} Nov 01 19:12:34.951668 n-d-863052-2 devstack@n-api.service[121403]: {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 01 19:12:34.951668 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:12:34.951668 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Nov 01 19:12:34.951668 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Nov 01 19:12:34.951668 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Nov 01 19:12:34.951668 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise error Nov 01 19:12:34.951668 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['local', 'volume'] Nov 01 19:12:34.951668 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:12:34.951668 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['server']['properties']['block_device_mapping_v2']['items']['properties']['destination_type']: Nov 01 19:12:34.951668 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi {'enum': ['local', 'volume'], 'type': 'string'} Nov 01 19:12:34.951668 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:12:34.951668 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi On instance['server']['block_device_mapping_v2'][1]: Nov 01 19:12:34.951668 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi 'invalid' Nov 01 19:12:34.951668 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:12:34.951668 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:12:34.951668 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:12:34.951668 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:12:34.951668 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:12:34.951668 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:12:34.951668 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 01 19:12:34.951668 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 01 19:12:34.951668 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 01 19:12:34.951668 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 01 19:12:34.954972 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 01 19:12:34.954972 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 01 19:12:34.954972 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Nov 01 19:12:34.954972 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Nov 01 19:12:34.954972 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Nov 01 19:12:34.954972 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Nov 01 19:12:34.954972 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Nov 01 19:12:34.954972 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Nov 01 19:12:34.954972 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Nov 01 19:12:34.954972 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:12:34.954972 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:12:34.954972 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:12:34.954972 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:12:34.954972 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:12:34.954972 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:12:34.954972 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Nov 01 19:12:34.954972 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Nov 01 19:12:34.954972 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Nov 01 19:12:34.954972 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:12:34.962603 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-ae35be2e-3842-4925-a88b-4846e03bad8f tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Returning 400 to user: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] {{(pid=121403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 01 19:12:34.970787 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-ae35be2e-3842-4925-a88b-4846e03bad8f tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 400 len: 155 microversion: 2.1 time: 0.030213 Nov 01 19:12:34.977291 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 2175/4294] 10.222.0.13 () {60 vars in 1147 bytes} [Tue Nov 1 19:12:34 2022] POST /compute/v2.1/servers => generated 155 bytes in 37 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 01 19:12:34.982954 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-740aee12-9cdb-48fb-a5c1-0b5ac91e88ad tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:12:34.983576 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-740aee12-9cdb-48fb-a5c1-0b5ac91e88ad tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] [instance: b27eaab4-a751-47fb-acdb-db7c99b06a5f] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:12:34.991869 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-740aee12-9cdb-48fb-a5c1-0b5ac91e88ad tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:12:34.992378 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-740aee12-9cdb-48fb-a5c1-0b5ac91e88ad tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:12:34.992850 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-740aee12-9cdb-48fb-a5c1-0b5ac91e88ad tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:12:34.993564 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-740aee12-9cdb-48fb-a5c1-0b5ac91e88ad tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:12:34.994028 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-740aee12-9cdb-48fb-a5c1-0b5ac91e88ad tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:12:34.994513 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-740aee12-9cdb-48fb-a5c1-0b5ac91e88ad tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:12:36.099030 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-740aee12-9cdb-48fb-a5c1-0b5ac91e88ad tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc5c19b930543f5a5091922a9859813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ecdc83933544a899117531a960027a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:12:36.110129 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-740aee12-9cdb-48fb-a5c1-0b5ac91e88ad tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] 10.222.0.13 "GET /compute/v2.1/servers/b27eaab4-a751-47fb-acdb-db7c99b06a5f" status: 200 len: 1506 microversion: 2.1 time: 1.131442 Nov 01 19:12:36.114903 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 2120/4295] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:12:34 2022] GET /compute/v2.1/servers/b27eaab4-a751-47fb-acdb-db7c99b06a5f => generated 1506 bytes in 1133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:12:36.153589 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-77d66b54-6f86-47e2-8969-1033f1d5744f tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:12:36.155204 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-77d66b54-6f86-47e2-8969-1033f1d5744f tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] [instance: b27eaab4-a751-47fb-acdb-db7c99b06a5f] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:12:36.159303 n-d-863052-2 devstack@n-api.service[121403]: DEBUG dbcounter [-] [121403] Writing DB stats nova_api:SELECT=40,nova_api:UPDATE=1 {{(pid=121403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 19:12:36.236953 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-77d66b54-6f86-47e2-8969-1033f1d5744f tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:12:36.236953 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-77d66b54-6f86-47e2-8969-1033f1d5744f tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.025s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:12:36.236953 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-77d66b54-6f86-47e2-8969-1033f1d5744f tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:12:36.236953 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-77d66b54-6f86-47e2-8969-1033f1d5744f tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:12:36.244632 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-77d66b54-6f86-47e2-8969-1033f1d5744f tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:12:36.245141 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-77d66b54-6f86-47e2-8969-1033f1d5744f tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:12:36.902304 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-77d66b54-6f86-47e2-8969-1033f1d5744f tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc5c19b930543f5a5091922a9859813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ecdc83933544a899117531a960027a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:12:36.917365 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-77d66b54-6f86-47e2-8969-1033f1d5744f tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] 10.222.0.13 "GET /compute/v2.1/servers/b27eaab4-a751-47fb-acdb-db7c99b06a5f" status: 200 len: 1506 microversion: 2.1 time: 0.769876 Nov 01 19:12:36.944274 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 2176/4296] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:12:36 2022] GET /compute/v2.1/servers/b27eaab4-a751-47fb-acdb-db7c99b06a5f => generated 1506 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:12:37.408376 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [req-24392ee0-746b-489b-8560-634b602a0d24 req-d9ef9e5e-97f5-4f7d-b827-1060a6f7b911 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cae1c729-7c41-488d-ab0e-30d1f5d22180", "name": "network-vif-plugged", "status": "completed", "tag": "3533eeb6-f9e6-47ff-ba35-f061eb6fd641"}]} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:12:37.466836 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-24392ee0-746b-489b-8560-634b602a0d24 req-d9ef9e5e-97f5-4f7d-b827-1060a6f7b911 service nova] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:12:37.468203 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-24392ee0-746b-489b-8560-634b602a0d24 req-d9ef9e5e-97f5-4f7d-b827-1060a6f7b911 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:12:37.475385 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-24392ee0-746b-489b-8560-634b602a0d24 req-d9ef9e5e-97f5-4f7d-b827-1060a6f7b911 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:12:37.560253 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.compute.server_external_events [req-24392ee0-746b-489b-8560-634b602a0d24 req-d9ef9e5e-97f5-4f7d-b827-1060a6f7b911 service nova] Creating event network-vif-plugged:3533eeb6-f9e6-47ff-ba35-f061eb6fd641 for instance cae1c729-7c41-488d-ab0e-30d1f5d22180 on n-h1-863052-2 Nov 01 19:12:37.596335 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [req-24392ee0-746b-489b-8560-634b602a0d24 req-d9ef9e5e-97f5-4f7d-b827-1060a6f7b911 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.198314 Nov 01 19:12:37.601849 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 2177/4297] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Nov 1 19:12:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:12:37.633856 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-8b76a1f4-98ab-4daa-9f50-723500695bd7 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-984922193", "imageRef": "2d4a0047-1b9e-445f-8af8-1b5c9d93e881", "flavorRef": "452", "metadata": {"a": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}, "networks": [{"uuid": "f2fc603f-a5ab-4120-939f-124d49e1f7c1"}]}} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:12:37.668085 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-8b76a1f4-98ab-4daa-9f50-723500695bd7 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Request method failure captured: Nov 01 19:12:37.668085 n-d-863052-2 devstack@n-api.service[121403]: request: POST /compute/v2.1/servers HTTP/1.1 Nov 01 19:12:37.668085 n-d-863052-2 devstack@n-api.service[121403]: Accept: application/json Nov 01 19:12:37.668085 n-d-863052-2 devstack@n-api.service[121403]: Accept-Encoding: identity Nov 01 19:12:37.668085 n-d-863052-2 devstack@n-api.service[121403]: Connection: close Nov 01 19:12:37.668085 n-d-863052-2 devstack@n-api.service[121403]: Content-Length: 491 Nov 01 19:12:37.668085 n-d-863052-2 devstack@n-api.service[121403]: Content-Type: application/json Nov 01 19:12:37.668085 n-d-863052-2 devstack@n-api.service[121403]: Host: 10.222.0.13 Nov 01 19:12:37.668085 n-d-863052-2 devstack@n-api.service[121403]: Openstack-System-Scope: None Nov 01 19:12:37.668085 n-d-863052-2 devstack@n-api.service[121403]: User-Agent: python-urllib3/1.26.12 Nov 01 19:12:37.668085 n-d-863052-2 devstack@n-api.service[121403]: X-Auth-Token: gAAAAABjYW9YFTR7hO-vK03S-3HbvOtG2z3_fji2KJH39vNHENu4xIKneeHYviQiPj9ERGiA3aZIA7DvAYzczgSZ5-vK782IQ7CYnUFXvn9Aqt1AbunNMYxhes9BKzhvODzqwzqiQq89wgC4nbpZ9jJWFWMOC4z9bcW4UMi_ylwdZFjmhWfD49s Nov 01 19:12:37.668085 n-d-863052-2 devstack@n-api.service[121403]: X-Domain-Id: None Nov 01 19:12:37.668085 n-d-863052-2 devstack@n-api.service[121403]: X-Domain-Name: None Nov 01 19:12:37.668085 n-d-863052-2 devstack@n-api.service[121403]: X-Identity-Status: Confirmed Nov 01 19:12:37.668085 n-d-863052-2 devstack@n-api.service[121403]: X-Is-Admin-Project: True Nov 01 19:12:37.668085 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Domain-Id: default Nov 01 19:12:37.668085 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Domain-Name: Default Nov 01 19:12:37.668085 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Id: 9ecdc83933544a899117531a960027a7 Nov 01 19:12:37.668085 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Name: tempest-ServersNegativeTestJSON-638944671 Nov 01 19:12:37.668085 n-d-863052-2 devstack@n-api.service[121403]: X-Role: member,reader Nov 01 19:12:37.668085 n-d-863052-2 devstack@n-api.service[121403]: X-Roles: member,reader Nov 01 19:12:37.668085 n-d-863052-2 devstack@n-api.service[121403]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/9ecdc83933544a899117531a960027a7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/9ecdc83933544a899117531a960027a7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_9ecdc83933544a899117531a960027a7", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/9ecdc83933544a899117531a960027a7"}]}] Nov 01 19:12:37.668085 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant: tempest-ServersNegativeTestJSON-638944671 Nov 01 19:12:37.668085 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant-Id: 9ecdc83933544a899117531a960027a7 Nov 01 19:12:37.668085 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant-Name: tempest-ServersNegativeTestJSON-638944671 Nov 01 19:12:37.668085 n-d-863052-2 devstack@n-api.service[121403]: X-User: tempest-ServersNegativeTestJSON-638944671-project Nov 01 19:12:37.668085 n-d-863052-2 devstack@n-api.service[121403]: X-User-Domain-Id: default Nov 01 19:12:37.668085 n-d-863052-2 devstack@n-api.service[121403]: X-User-Domain-Name: Default Nov 01 19:12:37.668085 n-d-863052-2 devstack@n-api.service[121403]: X-User-Id: 3fc5c19b930543f5a5091922a9859813 Nov 01 19:12:37.668085 n-d-863052-2 devstack@n-api.service[121403]: X-User-Name: tempest-ServersNegativeTestJSON-638944671-project Nov 01 19:12:37.668085 n-d-863052-2 devstack@n-api.service[121403]: Nov 01 19:12:37.668085 n-d-863052-2 devstack@n-api.service[121403]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-984922193", "imageRef": "2d4a0047-1b9e-445f-8af8-1b5c9d93e881", "flavorRef": "452", "metadata": {"a": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}, "networks": [{"uuid": "f2fc603f-a5ab-4120-939f-124d49e1f7c1"}]}} Nov 01 19:12:37.668085 n-d-863052-2 devstack@n-api.service[121403]: method: > Nov 01 19:12:37.668085 n-d-863052-2 devstack@n-api.service[121403]: exception: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Nov 01 19:12:37.668085 n-d-863052-2 devstack@n-api.service[121403]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-984922193', 'imageRef': '2d4a0047-1b9e-445f-8af8-1b5c9d93e881', 'flavorRef': '452', 'metadata': {'a': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}, 'networks': [{'uuid': 'f2fc603f-a5ab-4120-939f-124d49e1f7c1'}]}}} Nov 01 19:12:37.668085 n-d-863052-2 devstack@n-api.service[121403]: {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 01 19:12:37.668085 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:12:37.668085 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Nov 01 19:12:37.668085 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Nov 01 19:12:37.668085 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Nov 01 19:12:37.668085 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise error Nov 01 19:12:37.668085 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Nov 01 19:12:37.668085 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:12:37.668085 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['metadata']['patternProperties']['^[a-zA-Z0-9-_:. ]{1,255}$']: Nov 01 19:12:37.668085 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi {'maxLength': 255, 'type': 'string'} Nov 01 19:12:37.668085 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:12:37.668085 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi On instance['server']['metadata']: Nov 01 19:12:37.671356 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' Nov 01 19:12:37.671356 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:12:37.671356 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:12:37.671356 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:12:37.671356 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:12:37.671356 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:12:37.671356 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:12:37.671356 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 01 19:12:37.671356 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 01 19:12:37.671356 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 01 19:12:37.671356 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 01 19:12:37.671356 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 01 19:12:37.671356 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 01 19:12:37.671356 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Nov 01 19:12:37.671356 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Nov 01 19:12:37.671356 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Nov 01 19:12:37.671356 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Nov 01 19:12:37.671356 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Nov 01 19:12:37.671356 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Nov 01 19:12:37.671356 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Nov 01 19:12:37.671356 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:12:37.671356 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:12:37.671356 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:12:37.671356 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:12:37.671356 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:12:37.671356 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:12:37.671356 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Nov 01 19:12:37.671356 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Nov 01 19:12:37.671356 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Nov 01 19:12:37.671356 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:12:37.671356 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-8b76a1f4-98ab-4daa-9f50-723500695bd7 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Returning 400 to user: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long {{(pid=121403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 01 19:12:37.675607 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-8b76a1f4-98ab-4daa-9f50-723500695bd7 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 400 len: 624 microversion: 2.1 time: 0.063891 Nov 01 19:12:37.685363 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 2178/4298] 10.222.0.13 () {60 vars in 1147 bytes} [Tue Nov 1 19:12:37 2022] POST /compute/v2.1/servers => generated 624 bytes in 82 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 01 19:12:37.695163 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-9f08c85f-51e6-4719-a51d-a5fadfb0839c tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:12:37.713537 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-9f08c85f-51e6-4719-a51d-a5fadfb0839c tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] [instance: b27eaab4-a751-47fb-acdb-db7c99b06a5f] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:12:37.744972 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-9f08c85f-51e6-4719-a51d-a5fadfb0839c tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:12:37.750705 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-9f08c85f-51e6-4719-a51d-a5fadfb0839c tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:12:37.752134 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-9f08c85f-51e6-4719-a51d-a5fadfb0839c tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:12:37.757198 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-9f08c85f-51e6-4719-a51d-a5fadfb0839c tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:12:37.760291 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-9f08c85f-51e6-4719-a51d-a5fadfb0839c tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:12:37.764169 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-9f08c85f-51e6-4719-a51d-a5fadfb0839c tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:12:38.194459 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-e934b60f-59ad-4e2e-b65e-e842d2c2c47b tempest-InstanceActionsV221TestJSON-1016349810 tempest-InstanceActionsV221TestJSON-1016349810-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsV221TestJSON-server-993465931", "imageRef": "2d4a0047-1b9e-445f-8af8-1b5c9d93e881", "flavorRef": "452", "networks": [{"uuid": "589e46e3-6d95-457e-9b35-b0ee50e84f60"}]}} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:12:38.234633 n-d-863052-2 devstack@n-api.service[121402]: DEBUG dbcounter [-] [121402] Writing DB stats nova_api:SELECT=55 {{(pid=121402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 19:12:38.285983 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-9f08c85f-51e6-4719-a51d-a5fadfb0839c tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc5c19b930543f5a5091922a9859813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ecdc83933544a899117531a960027a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:12:38.297663 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-9f08c85f-51e6-4719-a51d-a5fadfb0839c tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] 10.222.0.13 "GET /compute/v2.1/servers/b27eaab4-a751-47fb-acdb-db7c99b06a5f" status: 200 len: 1506 microversion: 2.1 time: 0.609060 Nov 01 19:12:38.302647 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 2179/4299] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:12:37 2022] GET /compute/v2.1/servers/b27eaab4-a751-47fb-acdb-db7c99b06a5f => generated 1506 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:12:38.346016 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.network.neutron [None req-e934b60f-59ad-4e2e-b65e-e842d2c2c47b tempest-InstanceActionsV221TestJSON-1016349810 tempest-InstanceActionsV221TestJSON-1016349810-project] validate_networks() for [('589e46e3-6d95-457e-9b35-b0ee50e84f60', None, None, None, None, None)] {{(pid=121402) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 01 19:12:38.594729 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-5da9e46d-d261-4cc5-93db-363c5ea96900 tempest-ServerPasswordTestJSON-1534707503 tempest-ServerPasswordTestJSON-1534707503-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerPasswordTestJSON-server-1927402777", "imageRef": "2d4a0047-1b9e-445f-8af8-1b5c9d93e881", "flavorRef": "452", "networks": [{"uuid": "9d342fb8-96ac-4c6b-9673-6814af9bce66"}]}} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:12:38.779164 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.network.neutron [None req-5da9e46d-d261-4cc5-93db-363c5ea96900 tempest-ServerPasswordTestJSON-1534707503 tempest-ServerPasswordTestJSON-1534707503-project] validate_networks() for [('9d342fb8-96ac-4c6b-9673-6814af9bce66', None, None, None, None, None)] {{(pid=121403) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 01 19:12:40.185372 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.virt.hardware [None req-e934b60f-59ad-4e2e-b65e-e842d2c2c47b tempest-InstanceActionsV221TestJSON-1016349810 tempest-InstanceActionsV221TestJSON-1016349810-project] Flavor limits 0:0:0 {{(pid=121402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 01 19:12:40.186128 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.virt.hardware [None req-e934b60f-59ad-4e2e-b65e-e842d2c2c47b tempest-InstanceActionsV221TestJSON-1016349810 tempest-InstanceActionsV221TestJSON-1016349810-project] Image limits 0:0:0 {{(pid=121402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 01 19:12:40.186521 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.virt.hardware [None req-e934b60f-59ad-4e2e-b65e-e842d2c2c47b tempest-InstanceActionsV221TestJSON-1016349810 tempest-InstanceActionsV221TestJSON-1016349810-project] Flavor pref 0:0:0 {{(pid=121402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 01 19:12:40.186931 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.virt.hardware [None req-e934b60f-59ad-4e2e-b65e-e842d2c2c47b tempest-InstanceActionsV221TestJSON-1016349810 tempest-InstanceActionsV221TestJSON-1016349810-project] Image pref 0:0:0 {{(pid=121402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 01 19:12:40.187339 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.virt.hardware [None req-e934b60f-59ad-4e2e-b65e-e842d2c2c47b tempest-InstanceActionsV221TestJSON-1016349810 tempest-InstanceActionsV221TestJSON-1016349810-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 01 19:12:40.221595 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e934b60f-59ad-4e2e-b65e-e842d2c2c47b tempest-InstanceActionsV221TestJSON-1016349810 tempest-InstanceActionsV221TestJSON-1016349810-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:12:40.222094 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e934b60f-59ad-4e2e-b65e-e842d2c2c47b tempest-InstanceActionsV221TestJSON-1016349810 tempest-InstanceActionsV221TestJSON-1016349810-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:12:40.222632 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e934b60f-59ad-4e2e-b65e-e842d2c2c47b tempest-InstanceActionsV221TestJSON-1016349810 tempest-InstanceActionsV221TestJSON-1016349810-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:12:40.223254 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e934b60f-59ad-4e2e-b65e-e842d2c2c47b tempest-InstanceActionsV221TestJSON-1016349810 tempest-InstanceActionsV221TestJSON-1016349810-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:12:40.223714 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e934b60f-59ad-4e2e-b65e-e842d2c2c47b tempest-InstanceActionsV221TestJSON-1016349810 tempest-InstanceActionsV221TestJSON-1016349810-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:12:40.224153 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e934b60f-59ad-4e2e-b65e-e842d2c2c47b tempest-InstanceActionsV221TestJSON-1016349810 tempest-InstanceActionsV221TestJSON-1016349810-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:12:40.290756 n-d-863052-2 devstack@n-api.service[121402]: DEBUG dbcounter [-] [121402] Writing DB stats nova_cell1:SELECT=62 {{(pid=121402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 19:12:40.349042 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.quota [None req-e934b60f-59ad-4e2e-b65e-e842d2c2c47b tempest-InstanceActionsV221TestJSON-1016349810 tempest-InstanceActionsV221TestJSON-1016349810-project] Getting quotas for project 4c29ec5eebf84c198c11bae29e3df2d3. Resources: {'cores', 'ram', 'instances'} {{(pid=121402) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 01 19:12:40.378026 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.quota [None req-e934b60f-59ad-4e2e-b65e-e842d2c2c47b tempest-InstanceActionsV221TestJSON-1016349810 tempest-InstanceActionsV221TestJSON-1016349810-project] Getting quotas for user 060d1fb6604f4096b650cf40060db86a and project 4c29ec5eebf84c198c11bae29e3df2d3. Resources: {'cores', 'ram', 'instances'} {{(pid=121402) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 01 19:12:40.453641 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-e934b60f-59ad-4e2e-b65e-e842d2c2c47b tempest-InstanceActionsV221TestJSON-1016349810 tempest-InstanceActionsV221TestJSON-1016349810-project] Going to run 1 instances... {{(pid=121402) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 01 19:12:40.498716 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-e934b60f-59ad-4e2e-b65e-e842d2c2c47b tempest-InstanceActionsV221TestJSON-1016349810 tempest-InstanceActionsV221TestJSON-1016349810-project] [instance: aa7aa9c6-8a88-4948-a623-be7e64e73b5f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2d4a0047-1b9e-445f-8af8-1b5c9d93e881',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121402) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 01 19:12:40.738632 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-e934b60f-59ad-4e2e-b65e-e842d2c2c47b tempest-InstanceActionsV221TestJSON-1016349810 tempest-InstanceActionsV221TestJSON-1016349810-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.21 time: 3.535080 Nov 01 19:12:40.758614 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 2121/4300] 10.222.0.13 () {62 vars in 1188 bytes} [Tue Nov 1 19:12:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 3552 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Nov 01 19:12:40.788430 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-b470d09d-9213-4a82-8935-9585eae3cd6d tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:12:40.815292 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-b470d09d-9213-4a82-8935-9585eae3cd6d tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] [instance: b27eaab4-a751-47fb-acdb-db7c99b06a5f] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:12:40.849048 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b470d09d-9213-4a82-8935-9585eae3cd6d tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:12:40.849718 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b470d09d-9213-4a82-8935-9585eae3cd6d tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:12:40.850177 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b470d09d-9213-4a82-8935-9585eae3cd6d tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:12:40.850889 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b470d09d-9213-4a82-8935-9585eae3cd6d tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:12:40.864926 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b470d09d-9213-4a82-8935-9585eae3cd6d tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:12:40.871775 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.virt.hardware [None req-5da9e46d-d261-4cc5-93db-363c5ea96900 tempest-ServerPasswordTestJSON-1534707503 tempest-ServerPasswordTestJSON-1534707503-project] Flavor limits 0:0:0 {{(pid=121403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 01 19:12:40.872856 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.virt.hardware [None req-5da9e46d-d261-4cc5-93db-363c5ea96900 tempest-ServerPasswordTestJSON-1534707503 tempest-ServerPasswordTestJSON-1534707503-project] Image limits 0:0:0 {{(pid=121403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 01 19:12:40.873476 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.virt.hardware [None req-5da9e46d-d261-4cc5-93db-363c5ea96900 tempest-ServerPasswordTestJSON-1534707503 tempest-ServerPasswordTestJSON-1534707503-project] Flavor pref 0:0:0 {{(pid=121403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 01 19:12:40.874022 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.virt.hardware [None req-5da9e46d-d261-4cc5-93db-363c5ea96900 tempest-ServerPasswordTestJSON-1534707503 tempest-ServerPasswordTestJSON-1534707503-project] Image pref 0:0:0 {{(pid=121403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 01 19:12:40.874604 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.virt.hardware [None req-5da9e46d-d261-4cc5-93db-363c5ea96900 tempest-ServerPasswordTestJSON-1534707503 tempest-ServerPasswordTestJSON-1534707503-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 01 19:12:40.880613 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b470d09d-9213-4a82-8935-9585eae3cd6d tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:12:40.915129 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-5da9e46d-d261-4cc5-93db-363c5ea96900 tempest-ServerPasswordTestJSON-1534707503 tempest-ServerPasswordTestJSON-1534707503-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:12:40.920201 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-5da9e46d-d261-4cc5-93db-363c5ea96900 tempest-ServerPasswordTestJSON-1534707503 tempest-ServerPasswordTestJSON-1534707503-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:12:40.921746 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-5da9e46d-d261-4cc5-93db-363c5ea96900 tempest-ServerPasswordTestJSON-1534707503 tempest-ServerPasswordTestJSON-1534707503-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:12:40.927264 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-5da9e46d-d261-4cc5-93db-363c5ea96900 tempest-ServerPasswordTestJSON-1534707503 tempest-ServerPasswordTestJSON-1534707503-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:12:40.931462 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-5da9e46d-d261-4cc5-93db-363c5ea96900 tempest-ServerPasswordTestJSON-1534707503 tempest-ServerPasswordTestJSON-1534707503-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:12:40.932059 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-5da9e46d-d261-4cc5-93db-363c5ea96900 tempest-ServerPasswordTestJSON-1534707503 tempest-ServerPasswordTestJSON-1534707503-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:12:41.043356 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.quota [None req-5da9e46d-d261-4cc5-93db-363c5ea96900 tempest-ServerPasswordTestJSON-1534707503 tempest-ServerPasswordTestJSON-1534707503-project] Getting quotas for project 9871416ead87433589b8f54783b023b1. Resources: {'cores', 'ram', 'instances'} {{(pid=121403) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 01 19:12:41.063264 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.quota [None req-5da9e46d-d261-4cc5-93db-363c5ea96900 tempest-ServerPasswordTestJSON-1534707503 tempest-ServerPasswordTestJSON-1534707503-project] Getting quotas for user 969cec09484942aebbab6c0f021b7067 and project 9871416ead87433589b8f54783b023b1. Resources: {'cores', 'ram', 'instances'} {{(pid=121403) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 01 19:12:41.114930 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-5da9e46d-d261-4cc5-93db-363c5ea96900 tempest-ServerPasswordTestJSON-1534707503 tempest-ServerPasswordTestJSON-1534707503-project] Going to run 1 instances... {{(pid=121403) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 01 19:12:41.120378 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-5da9e46d-d261-4cc5-93db-363c5ea96900 tempest-ServerPasswordTestJSON-1534707503 tempest-ServerPasswordTestJSON-1534707503-project] [instance: 3463bb31-5f34-4b89-8b40-af83df5c7635] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2d4a0047-1b9e-445f-8af8-1b5c9d93e881',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121403) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 01 19:12:41.287293 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-5da9e46d-d261-4cc5-93db-363c5ea96900 tempest-ServerPasswordTestJSON-1534707503 tempest-ServerPasswordTestJSON-1534707503-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.983471 Nov 01 19:12:41.299906 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 2180/4301] 10.222.0.13 () {60 vars in 1147 bytes} [Tue Nov 1 19:12:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 2997 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 01 19:12:41.305185 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-4662272b-bc5c-47c8-acdb-09acd2fa7da3 tempest-InstanceActionsV221TestJSON-1016349810 tempest-InstanceActionsV221TestJSON-1016349810-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:12:41.315885 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-4662272b-bc5c-47c8-acdb-09acd2fa7da3 tempest-InstanceActionsV221TestJSON-1016349810 tempest-InstanceActionsV221TestJSON-1016349810-project] [instance: aa7aa9c6-8a88-4948-a623-be7e64e73b5f] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:12:41.625523 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-4662272b-bc5c-47c8-acdb-09acd2fa7da3 tempest-InstanceActionsV221TestJSON-1016349810 tempest-InstanceActionsV221TestJSON-1016349810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '060d1fb6604f4096b650cf40060db86a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c29ec5eebf84c198c11bae29e3df2d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:12:41.643372 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-4662272b-bc5c-47c8-acdb-09acd2fa7da3 tempest-InstanceActionsV221TestJSON-1016349810 tempest-InstanceActionsV221TestJSON-1016349810-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '060d1fb6604f4096b650cf40060db86a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c29ec5eebf84c198c11bae29e3df2d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:12:41.689014 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-4662272b-bc5c-47c8-acdb-09acd2fa7da3 tempest-InstanceActionsV221TestJSON-1016349810 tempest-InstanceActionsV221TestJSON-1016349810-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '060d1fb6604f4096b650cf40060db86a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c29ec5eebf84c198c11bae29e3df2d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:12:41.690212 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-4662272b-bc5c-47c8-acdb-09acd2fa7da3 tempest-InstanceActionsV221TestJSON-1016349810 tempest-InstanceActionsV221TestJSON-1016349810-project] 10.222.0.13 "GET /compute/v2.1/servers/aa7aa9c6-8a88-4948-a623-be7e64e73b5f" status: 200 len: 1258 microversion: 2.21 time: 0.388927 Nov 01 19:12:41.712437 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 2181/4302] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 19:12:41 2022] GET /compute/v2.1/servers/aa7aa9c6-8a88-4948-a623-be7e64e73b5f => generated 1258 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 19:12:41.732946 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-3a68d09b-8f72-4e30-9083-fcf47babf74a tempest-ServerPasswordTestJSON-1534707503 tempest-ServerPasswordTestJSON-1534707503-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:12:41.733616 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-3a68d09b-8f72-4e30-9083-fcf47babf74a tempest-ServerPasswordTestJSON-1534707503 tempest-ServerPasswordTestJSON-1534707503-project] [instance: 3463bb31-5f34-4b89-8b40-af83df5c7635] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:12:42.100610 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-3a68d09b-8f72-4e30-9083-fcf47babf74a tempest-ServerPasswordTestJSON-1534707503 tempest-ServerPasswordTestJSON-1534707503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '969cec09484942aebbab6c0f021b7067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9871416ead87433589b8f54783b023b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:12:42.115189 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-3a68d09b-8f72-4e30-9083-fcf47babf74a tempest-ServerPasswordTestJSON-1534707503 tempest-ServerPasswordTestJSON-1534707503-project] 10.222.0.13 "GET /compute/v2.1/servers/3463bb31-5f34-4b89-8b40-af83df5c7635" status: 200 len: 1216 microversion: 2.1 time: 0.395945 Nov 01 19:12:42.117454 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 2182/4303] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:12:41 2022] GET /compute/v2.1/servers/3463bb31-5f34-4b89-8b40-af83df5c7635 => generated 1216 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:12:42.722008 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-d4d23bf0-00d8-4402-9338-ad592b4bb337 tempest-InstanceActionsV221TestJSON-1016349810 tempest-InstanceActionsV221TestJSON-1016349810-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:12:42.723495 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-d4d23bf0-00d8-4402-9338-ad592b4bb337 tempest-InstanceActionsV221TestJSON-1016349810 tempest-InstanceActionsV221TestJSON-1016349810-project] [instance: aa7aa9c6-8a88-4948-a623-be7e64e73b5f] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:12:42.770948 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d4d23bf0-00d8-4402-9338-ad592b4bb337 tempest-InstanceActionsV221TestJSON-1016349810 tempest-InstanceActionsV221TestJSON-1016349810-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:12:42.777847 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d4d23bf0-00d8-4402-9338-ad592b4bb337 tempest-InstanceActionsV221TestJSON-1016349810 tempest-InstanceActionsV221TestJSON-1016349810-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:12:42.804172 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d4d23bf0-00d8-4402-9338-ad592b4bb337 tempest-InstanceActionsV221TestJSON-1016349810 tempest-InstanceActionsV221TestJSON-1016349810-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.030s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:12:42.806400 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d4d23bf0-00d8-4402-9338-ad592b4bb337 tempest-InstanceActionsV221TestJSON-1016349810 tempest-InstanceActionsV221TestJSON-1016349810-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:12:42.807254 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d4d23bf0-00d8-4402-9338-ad592b4bb337 tempest-InstanceActionsV221TestJSON-1016349810 tempest-InstanceActionsV221TestJSON-1016349810-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:12:42.808031 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d4d23bf0-00d8-4402-9338-ad592b4bb337 tempest-InstanceActionsV221TestJSON-1016349810 tempest-InstanceActionsV221TestJSON-1016349810-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:12:42.928503 n-d-863052-2 devstack@n-api.service[121403]: DEBUG dbcounter [-] [121403] Writing DB stats nova_cell1:SELECT=86,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=121403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 19:12:43.179748 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-d4d23bf0-00d8-4402-9338-ad592b4bb337 tempest-InstanceActionsV221TestJSON-1016349810 tempest-InstanceActionsV221TestJSON-1016349810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '060d1fb6604f4096b650cf40060db86a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c29ec5eebf84c198c11bae29e3df2d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:12:43.204299 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-d4d23bf0-00d8-4402-9338-ad592b4bb337 tempest-InstanceActionsV221TestJSON-1016349810 tempest-InstanceActionsV221TestJSON-1016349810-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '060d1fb6604f4096b650cf40060db86a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c29ec5eebf84c198c11bae29e3df2d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:12:43.210252 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-d4d23bf0-00d8-4402-9338-ad592b4bb337 tempest-InstanceActionsV221TestJSON-1016349810 tempest-InstanceActionsV221TestJSON-1016349810-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '060d1fb6604f4096b650cf40060db86a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c29ec5eebf84c198c11bae29e3df2d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:12:43.211492 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-d4d23bf0-00d8-4402-9338-ad592b4bb337 tempest-InstanceActionsV221TestJSON-1016349810 tempest-InstanceActionsV221TestJSON-1016349810-project] 10.222.0.13 "GET /compute/v2.1/servers/aa7aa9c6-8a88-4948-a623-be7e64e73b5f" status: 200 len: 1254 microversion: 2.21 time: 0.497076 Nov 01 19:12:43.220988 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 2183/4304] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 19:12:42 2022] GET /compute/v2.1/servers/aa7aa9c6-8a88-4948-a623-be7e64e73b5f => generated 1254 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 19:12:43.230883 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-684c1e33-78e3-49fe-918c-a54ae738546c tempest-ServerPasswordTestJSON-1534707503 tempest-ServerPasswordTestJSON-1534707503-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:12:43.232044 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-684c1e33-78e3-49fe-918c-a54ae738546c tempest-ServerPasswordTestJSON-1534707503 tempest-ServerPasswordTestJSON-1534707503-project] [instance: 3463bb31-5f34-4b89-8b40-af83df5c7635] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:12:43.275834 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-684c1e33-78e3-49fe-918c-a54ae738546c tempest-ServerPasswordTestJSON-1534707503 tempest-ServerPasswordTestJSON-1534707503-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:12:43.282165 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-684c1e33-78e3-49fe-918c-a54ae738546c tempest-ServerPasswordTestJSON-1534707503 tempest-ServerPasswordTestJSON-1534707503-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:12:43.288447 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-684c1e33-78e3-49fe-918c-a54ae738546c tempest-ServerPasswordTestJSON-1534707503 tempest-ServerPasswordTestJSON-1534707503-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:12:43.290061 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-684c1e33-78e3-49fe-918c-a54ae738546c tempest-ServerPasswordTestJSON-1534707503 tempest-ServerPasswordTestJSON-1534707503-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:12:43.294930 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-684c1e33-78e3-49fe-918c-a54ae738546c tempest-ServerPasswordTestJSON-1534707503 tempest-ServerPasswordTestJSON-1534707503-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:12:43.298771 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-684c1e33-78e3-49fe-918c-a54ae738546c tempest-ServerPasswordTestJSON-1534707503 tempest-ServerPasswordTestJSON-1534707503-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:12:43.578700 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-684c1e33-78e3-49fe-918c-a54ae738546c tempest-ServerPasswordTestJSON-1534707503 tempest-ServerPasswordTestJSON-1534707503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '969cec09484942aebbab6c0f021b7067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9871416ead87433589b8f54783b023b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:12:43.588459 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-684c1e33-78e3-49fe-918c-a54ae738546c tempest-ServerPasswordTestJSON-1534707503 tempest-ServerPasswordTestJSON-1534707503-project] 10.222.0.13 "GET /compute/v2.1/servers/3463bb31-5f34-4b89-8b40-af83df5c7635" status: 200 len: 1212 microversion: 2.1 time: 0.368927 Nov 01 19:12:43.589092 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 2184/4305] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:12:43 2022] GET /compute/v2.1/servers/3463bb31-5f34-4b89-8b40-af83df5c7635 => generated 1212 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:12:44.169100 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-b470d09d-9213-4a82-8935-9585eae3cd6d tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc5c19b930543f5a5091922a9859813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ecdc83933544a899117531a960027a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:12:44.189169 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-b470d09d-9213-4a82-8935-9585eae3cd6d tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] 10.222.0.13 "GET /compute/v2.1/servers/b27eaab4-a751-47fb-acdb-db7c99b06a5f" status: 200 len: 1506 microversion: 2.1 time: 3.418607 Nov 01 19:12:44.189844 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 2122/4306] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:12:40 2022] GET /compute/v2.1/servers/b27eaab4-a751-47fb-acdb-db7c99b06a5f => generated 1506 bytes in 3431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:12:44.236964 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-fb06669c-6f3f-4ae4-b1d8-791b51c6bd72 tempest-InstanceActionsV221TestJSON-1016349810 tempest-InstanceActionsV221TestJSON-1016349810-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:12:44.238082 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-fb06669c-6f3f-4ae4-b1d8-791b51c6bd72 tempest-InstanceActionsV221TestJSON-1016349810 tempest-InstanceActionsV221TestJSON-1016349810-project] [instance: aa7aa9c6-8a88-4948-a623-be7e64e73b5f] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:12:44.271378 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-fb06669c-6f3f-4ae4-b1d8-791b51c6bd72 tempest-InstanceActionsV221TestJSON-1016349810 tempest-InstanceActionsV221TestJSON-1016349810-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:12:44.272225 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-fb06669c-6f3f-4ae4-b1d8-791b51c6bd72 tempest-InstanceActionsV221TestJSON-1016349810 tempest-InstanceActionsV221TestJSON-1016349810-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.025s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:12:44.288744 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-fb06669c-6f3f-4ae4-b1d8-791b51c6bd72 tempest-InstanceActionsV221TestJSON-1016349810 tempest-InstanceActionsV221TestJSON-1016349810-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:12:44.293358 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-fb06669c-6f3f-4ae4-b1d8-791b51c6bd72 tempest-InstanceActionsV221TestJSON-1016349810 tempest-InstanceActionsV221TestJSON-1016349810-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:12:44.297826 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-fb06669c-6f3f-4ae4-b1d8-791b51c6bd72 tempest-InstanceActionsV221TestJSON-1016349810 tempest-InstanceActionsV221TestJSON-1016349810-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:12:44.303959 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-fb06669c-6f3f-4ae4-b1d8-791b51c6bd72 tempest-InstanceActionsV221TestJSON-1016349810 tempest-InstanceActionsV221TestJSON-1016349810-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:12:44.504770 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-fb06669c-6f3f-4ae4-b1d8-791b51c6bd72 tempest-InstanceActionsV221TestJSON-1016349810 tempest-InstanceActionsV221TestJSON-1016349810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '060d1fb6604f4096b650cf40060db86a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c29ec5eebf84c198c11bae29e3df2d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:12:44.526184 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-fb06669c-6f3f-4ae4-b1d8-791b51c6bd72 tempest-InstanceActionsV221TestJSON-1016349810 tempest-InstanceActionsV221TestJSON-1016349810-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '060d1fb6604f4096b650cf40060db86a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c29ec5eebf84c198c11bae29e3df2d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:12:44.530663 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-fb06669c-6f3f-4ae4-b1d8-791b51c6bd72 tempest-InstanceActionsV221TestJSON-1016349810 tempest-InstanceActionsV221TestJSON-1016349810-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '060d1fb6604f4096b650cf40060db86a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c29ec5eebf84c198c11bae29e3df2d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:12:44.537495 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-fb06669c-6f3f-4ae4-b1d8-791b51c6bd72 tempest-InstanceActionsV221TestJSON-1016349810 tempest-InstanceActionsV221TestJSON-1016349810-project] 10.222.0.13 "GET /compute/v2.1/servers/aa7aa9c6-8a88-4948-a623-be7e64e73b5f" status: 200 len: 1316 microversion: 2.21 time: 0.301324 Nov 01 19:12:44.538841 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 2185/4307] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 19:12:44 2022] GET /compute/v2.1/servers/aa7aa9c6-8a88-4948-a623-be7e64e73b5f => generated 1316 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 19:12:44.554550 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-d7020d47-28c1-4434-9b54-cb4aca8a35c1 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Action: 'create', calling method: >, body: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa", "imageRef": "2d4a0047-1b9e-445f-8af8-1b5c9d93e881", "flavorRef": "452", "networks": [{"uuid": "f2fc603f-a5ab-4120-939f-124d49e1f7c1"}]}} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:12:44.563901 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-d7020d47-28c1-4434-9b54-cb4aca8a35c1 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Request method failure captured: Nov 01 19:12:44.563901 n-d-863052-2 devstack@n-api.service[121402]: request: POST /compute/v2.1/servers HTTP/1.1 Nov 01 19:12:44.563901 n-d-863052-2 devstack@n-api.service[121402]: Accept: application/json Nov 01 19:12:44.563901 n-d-863052-2 devstack@n-api.service[121402]: Accept-Encoding: identity Nov 01 19:12:44.563901 n-d-863052-2 devstack@n-api.service[121402]: Connection: close Nov 01 19:12:44.563901 n-d-863052-2 devstack@n-api.service[121402]: Content-Length: 416 Nov 01 19:12:44.563901 n-d-863052-2 devstack@n-api.service[121402]: Content-Type: application/json Nov 01 19:12:44.563901 n-d-863052-2 devstack@n-api.service[121402]: Host: 10.222.0.13 Nov 01 19:12:44.563901 n-d-863052-2 devstack@n-api.service[121402]: Openstack-System-Scope: None Nov 01 19:12:44.563901 n-d-863052-2 devstack@n-api.service[121402]: User-Agent: python-urllib3/1.26.12 Nov 01 19:12:44.563901 n-d-863052-2 devstack@n-api.service[121402]: X-Auth-Token: gAAAAABjYW9YFTR7hO-vK03S-3HbvOtG2z3_fji2KJH39vNHENu4xIKneeHYviQiPj9ERGiA3aZIA7DvAYzczgSZ5-vK782IQ7CYnUFXvn9Aqt1AbunNMYxhes9BKzhvODzqwzqiQq89wgC4nbpZ9jJWFWMOC4z9bcW4UMi_ylwdZFjmhWfD49s Nov 01 19:12:44.563901 n-d-863052-2 devstack@n-api.service[121402]: X-Domain-Id: None Nov 01 19:12:44.563901 n-d-863052-2 devstack@n-api.service[121402]: X-Domain-Name: None Nov 01 19:12:44.563901 n-d-863052-2 devstack@n-api.service[121402]: X-Identity-Status: Confirmed Nov 01 19:12:44.563901 n-d-863052-2 devstack@n-api.service[121402]: X-Is-Admin-Project: True Nov 01 19:12:44.563901 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Domain-Id: default Nov 01 19:12:44.563901 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Domain-Name: Default Nov 01 19:12:44.563901 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Id: 9ecdc83933544a899117531a960027a7 Nov 01 19:12:44.563901 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Name: tempest-ServersNegativeTestJSON-638944671 Nov 01 19:12:44.563901 n-d-863052-2 devstack@n-api.service[121402]: X-Role: member,reader Nov 01 19:12:44.563901 n-d-863052-2 devstack@n-api.service[121402]: X-Roles: member,reader Nov 01 19:12:44.563901 n-d-863052-2 devstack@n-api.service[121402]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/9ecdc83933544a899117531a960027a7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/9ecdc83933544a899117531a960027a7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_9ecdc83933544a899117531a960027a7", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/9ecdc83933544a899117531a960027a7"}]}] Nov 01 19:12:44.563901 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant: tempest-ServersNegativeTestJSON-638944671 Nov 01 19:12:44.563901 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant-Id: 9ecdc83933544a899117531a960027a7 Nov 01 19:12:44.563901 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant-Name: tempest-ServersNegativeTestJSON-638944671 Nov 01 19:12:44.563901 n-d-863052-2 devstack@n-api.service[121402]: X-User: tempest-ServersNegativeTestJSON-638944671-project Nov 01 19:12:44.563901 n-d-863052-2 devstack@n-api.service[121402]: X-User-Domain-Id: default Nov 01 19:12:44.563901 n-d-863052-2 devstack@n-api.service[121402]: X-User-Domain-Name: Default Nov 01 19:12:44.563901 n-d-863052-2 devstack@n-api.service[121402]: X-User-Id: 3fc5c19b930543f5a5091922a9859813 Nov 01 19:12:44.563901 n-d-863052-2 devstack@n-api.service[121402]: X-User-Name: tempest-ServersNegativeTestJSON-638944671-project Nov 01 19:12:44.563901 n-d-863052-2 devstack@n-api.service[121402]: Nov 01 19:12:44.563901 n-d-863052-2 devstack@n-api.service[121402]: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa", "imageRef": "2d4a0047-1b9e-445f-8af8-1b5c9d93e881", "flavorRef": "452", "networks": [{"uuid": "f2fc603f-a5ab-4120-939f-124d49e1f7c1"}]}} Nov 01 19:12:44.563901 n-d-863052-2 devstack@n-api.service[121402]: method: > Nov 01 19:12:44.563901 n-d-863052-2 devstack@n-api.service[121402]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Nov 01 19:12:44.563901 n-d-863052-2 devstack@n-api.service[121402]: action_args: {'body': {'server': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'imageRef': '2d4a0047-1b9e-445f-8af8-1b5c9d93e881', 'flavorRef': '452', 'networks': [{'uuid': 'f2fc603f-a5ab-4120-939f-124d49e1f7c1'}]}}} Nov 01 19:12:44.563901 n-d-863052-2 devstack@n-api.service[121402]: {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 01 19:12:44.563901 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:12:44.563901 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Nov 01 19:12:44.563901 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Nov 01 19:12:44.563901 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Nov 01 19:12:44.563901 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise error Nov 01 19:12:44.563901 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Nov 01 19:12:44.563901 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:12:44.563901 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['name']: Nov 01 19:12:44.563901 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Nov 01 19:12:44.563901 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:12:44.563901 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi On instance['server']: Nov 01 19:12:44.563901 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Nov 01 19:12:44.563901 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:12:44.563901 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:12:44.567116 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:12:44.567116 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:12:44.567116 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:12:44.567116 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:12:44.567116 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 01 19:12:44.567116 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 01 19:12:44.567116 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 01 19:12:44.567116 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 01 19:12:44.567116 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 01 19:12:44.567116 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 01 19:12:44.567116 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Nov 01 19:12:44.567116 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Nov 01 19:12:44.567116 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Nov 01 19:12:44.567116 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Nov 01 19:12:44.567116 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Nov 01 19:12:44.567116 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Nov 01 19:12:44.567116 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Nov 01 19:12:44.567116 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:12:44.567116 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:12:44.567116 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:12:44.567116 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:12:44.567116 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:12:44.567116 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:12:44.567116 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Nov 01 19:12:44.567116 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Nov 01 19:12:44.567116 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Nov 01 19:12:44.567116 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:12:44.570087 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-d7020d47-28c1-4434-9b54-cb4aca8a35c1 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=121402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 01 19:12:44.572293 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-d7020d47-28c1-4434-9b54-cb4aca8a35c1 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 400 len: 619 microversion: 2.1 time: 0.024104 Nov 01 19:12:44.579044 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 2123/4308] 10.222.0.13 () {60 vars in 1147 bytes} [Tue Nov 1 19:12:44 2022] POST /compute/v2.1/servers => generated 619 bytes in 31 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 01 19:12:44.588476 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-8769af3d-4c63-4a6c-8072-6dc5c5ff5a8a tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:12:44.589903 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-8769af3d-4c63-4a6c-8072-6dc5c5ff5a8a tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] [instance: b27eaab4-a751-47fb-acdb-db7c99b06a5f] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:12:44.598332 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-8769af3d-4c63-4a6c-8072-6dc5c5ff5a8a tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:12:44.601356 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-8769af3d-4c63-4a6c-8072-6dc5c5ff5a8a tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:12:44.603223 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-8769af3d-4c63-4a6c-8072-6dc5c5ff5a8a tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:12:44.629607 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-c8807a9c-cc9a-4770-893f-d58c7cbfa658 tempest-ServerPasswordTestJSON-1534707503 tempest-ServerPasswordTestJSON-1534707503-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:12:44.637178 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-c8807a9c-cc9a-4770-893f-d58c7cbfa658 tempest-ServerPasswordTestJSON-1534707503 tempest-ServerPasswordTestJSON-1534707503-project] [instance: 3463bb31-5f34-4b89-8b40-af83df5c7635] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:12:44.661555 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-8769af3d-4c63-4a6c-8072-6dc5c5ff5a8a tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:12:44.663002 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-8769af3d-4c63-4a6c-8072-6dc5c5ff5a8a tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:12:44.686306 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-8769af3d-4c63-4a6c-8072-6dc5c5ff5a8a tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:12:44.728767 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-c8807a9c-cc9a-4770-893f-d58c7cbfa658 tempest-ServerPasswordTestJSON-1534707503 tempest-ServerPasswordTestJSON-1534707503-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:12:44.734861 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-c8807a9c-cc9a-4770-893f-d58c7cbfa658 tempest-ServerPasswordTestJSON-1534707503 tempest-ServerPasswordTestJSON-1534707503-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:12:44.735374 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-c8807a9c-cc9a-4770-893f-d58c7cbfa658 tempest-ServerPasswordTestJSON-1534707503 tempest-ServerPasswordTestJSON-1534707503-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:12:44.736158 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-c8807a9c-cc9a-4770-893f-d58c7cbfa658 tempest-ServerPasswordTestJSON-1534707503 tempest-ServerPasswordTestJSON-1534707503-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:12:44.736672 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-c8807a9c-cc9a-4770-893f-d58c7cbfa658 tempest-ServerPasswordTestJSON-1534707503 tempest-ServerPasswordTestJSON-1534707503-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:12:44.744832 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-c8807a9c-cc9a-4770-893f-d58c7cbfa658 tempest-ServerPasswordTestJSON-1534707503 tempest-ServerPasswordTestJSON-1534707503-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:12:45.072605 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-c8807a9c-cc9a-4770-893f-d58c7cbfa658 tempest-ServerPasswordTestJSON-1534707503 tempest-ServerPasswordTestJSON-1534707503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '969cec09484942aebbab6c0f021b7067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9871416ead87433589b8f54783b023b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:12:45.086734 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-c8807a9c-cc9a-4770-893f-d58c7cbfa658 tempest-ServerPasswordTestJSON-1534707503 tempest-ServerPasswordTestJSON-1534707503-project] 10.222.0.13 "GET /compute/v2.1/servers/3463bb31-5f34-4b89-8b40-af83df5c7635" status: 200 len: 1268 microversion: 2.1 time: 0.471369 Nov 01 19:12:45.091623 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 2124/4309] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:12:44 2022] GET /compute/v2.1/servers/3463bb31-5f34-4b89-8b40-af83df5c7635 => generated 1268 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 19:12:45.567925 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-adde2042-8784-4c5e-b0a7-9346c268af17 tempest-InstanceActionsV221TestJSON-1016349810 tempest-InstanceActionsV221TestJSON-1016349810-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:12:45.570229 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-adde2042-8784-4c5e-b0a7-9346c268af17 tempest-InstanceActionsV221TestJSON-1016349810 tempest-InstanceActionsV221TestJSON-1016349810-project] [instance: aa7aa9c6-8a88-4948-a623-be7e64e73b5f] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:12:45.592265 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-adde2042-8784-4c5e-b0a7-9346c268af17 tempest-InstanceActionsV221TestJSON-1016349810 tempest-InstanceActionsV221TestJSON-1016349810-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:12:45.594162 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-adde2042-8784-4c5e-b0a7-9346c268af17 tempest-InstanceActionsV221TestJSON-1016349810 tempest-InstanceActionsV221TestJSON-1016349810-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:12:45.595514 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-adde2042-8784-4c5e-b0a7-9346c268af17 tempest-InstanceActionsV221TestJSON-1016349810 tempest-InstanceActionsV221TestJSON-1016349810-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:12:45.600281 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-adde2042-8784-4c5e-b0a7-9346c268af17 tempest-InstanceActionsV221TestJSON-1016349810 tempest-InstanceActionsV221TestJSON-1016349810-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:12:45.605297 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-adde2042-8784-4c5e-b0a7-9346c268af17 tempest-InstanceActionsV221TestJSON-1016349810 tempest-InstanceActionsV221TestJSON-1016349810-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:12:45.610251 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-adde2042-8784-4c5e-b0a7-9346c268af17 tempest-InstanceActionsV221TestJSON-1016349810 tempest-InstanceActionsV221TestJSON-1016349810-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:12:45.760793 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-8769af3d-4c63-4a6c-8072-6dc5c5ff5a8a tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc5c19b930543f5a5091922a9859813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ecdc83933544a899117531a960027a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:12:45.774021 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-8769af3d-4c63-4a6c-8072-6dc5c5ff5a8a tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] 10.222.0.13 "GET /compute/v2.1/servers/b27eaab4-a751-47fb-acdb-db7c99b06a5f" status: 200 len: 1506 microversion: 2.1 time: 1.189409 Nov 01 19:12:45.789784 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 2186/4310] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:12:44 2022] GET /compute/v2.1/servers/b27eaab4-a751-47fb-acdb-db7c99b06a5f => generated 1506 bytes in 1207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:12:45.920121 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-adde2042-8784-4c5e-b0a7-9346c268af17 tempest-InstanceActionsV221TestJSON-1016349810 tempest-InstanceActionsV221TestJSON-1016349810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '060d1fb6604f4096b650cf40060db86a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c29ec5eebf84c198c11bae29e3df2d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:12:45.941003 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-adde2042-8784-4c5e-b0a7-9346c268af17 tempest-InstanceActionsV221TestJSON-1016349810 tempest-InstanceActionsV221TestJSON-1016349810-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '060d1fb6604f4096b650cf40060db86a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c29ec5eebf84c198c11bae29e3df2d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:12:45.947511 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-adde2042-8784-4c5e-b0a7-9346c268af17 tempest-InstanceActionsV221TestJSON-1016349810 tempest-InstanceActionsV221TestJSON-1016349810-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '060d1fb6604f4096b650cf40060db86a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c29ec5eebf84c198c11bae29e3df2d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:12:45.950577 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-adde2042-8784-4c5e-b0a7-9346c268af17 tempest-InstanceActionsV221TestJSON-1016349810 tempest-InstanceActionsV221TestJSON-1016349810-project] 10.222.0.13 "GET /compute/v2.1/servers/aa7aa9c6-8a88-4948-a623-be7e64e73b5f" status: 200 len: 1316 microversion: 2.21 time: 0.387474 Nov 01 19:12:45.953368 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 2125/4311] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 19:12:45 2022] GET /compute/v2.1/servers/aa7aa9c6-8a88-4948-a623-be7e64e73b5f => generated 1316 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 19:12:45.967365 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-977afa4d-4b49-46bb-8ebe-4ad3fd779f21 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:12:45.969683 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-977afa4d-4b49-46bb-8ebe-4ad3fd779f21 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] [instance: b27eaab4-a751-47fb-acdb-db7c99b06a5f] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:12:45.985200 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-977afa4d-4b49-46bb-8ebe-4ad3fd779f21 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:12:45.986187 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-977afa4d-4b49-46bb-8ebe-4ad3fd779f21 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:12:45.986814 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-977afa4d-4b49-46bb-8ebe-4ad3fd779f21 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:12:45.988617 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-977afa4d-4b49-46bb-8ebe-4ad3fd779f21 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:12:45.989237 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-977afa4d-4b49-46bb-8ebe-4ad3fd779f21 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:12:45.989820 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-977afa4d-4b49-46bb-8ebe-4ad3fd779f21 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:12:46.369524 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-977afa4d-4b49-46bb-8ebe-4ad3fd779f21 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc5c19b930543f5a5091922a9859813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ecdc83933544a899117531a960027a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:12:46.389463 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-977afa4d-4b49-46bb-8ebe-4ad3fd779f21 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] 10.222.0.13 "GET /compute/v2.1/servers/b27eaab4-a751-47fb-acdb-db7c99b06a5f" status: 200 len: 1506 microversion: 2.1 time: 0.434713 Nov 01 19:12:46.395163 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 2126/4312] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:12:45 2022] GET /compute/v2.1/servers/b27eaab4-a751-47fb-acdb-db7c99b06a5f => generated 1506 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:12:46.400853 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-1aae9bcd-51e3-4b89-a59f-2f58594882fd tempest-ServerPasswordTestJSON-1534707503 tempest-ServerPasswordTestJSON-1534707503-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:12:46.401457 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-1aae9bcd-51e3-4b89-a59f-2f58594882fd tempest-ServerPasswordTestJSON-1534707503 tempest-ServerPasswordTestJSON-1534707503-project] [instance: 3463bb31-5f34-4b89-8b40-af83df5c7635] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:12:46.430137 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-1aae9bcd-51e3-4b89-a59f-2f58594882fd tempest-ServerPasswordTestJSON-1534707503 tempest-ServerPasswordTestJSON-1534707503-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:12:46.431539 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-1aae9bcd-51e3-4b89-a59f-2f58594882fd tempest-ServerPasswordTestJSON-1534707503 tempest-ServerPasswordTestJSON-1534707503-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:12:46.437624 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-1aae9bcd-51e3-4b89-a59f-2f58594882fd tempest-ServerPasswordTestJSON-1534707503 tempest-ServerPasswordTestJSON-1534707503-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:12:46.441504 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-1aae9bcd-51e3-4b89-a59f-2f58594882fd tempest-ServerPasswordTestJSON-1534707503 tempest-ServerPasswordTestJSON-1534707503-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:12:46.441974 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-1aae9bcd-51e3-4b89-a59f-2f58594882fd tempest-ServerPasswordTestJSON-1534707503 tempest-ServerPasswordTestJSON-1534707503-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:12:46.443765 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-1aae9bcd-51e3-4b89-a59f-2f58594882fd tempest-ServerPasswordTestJSON-1534707503 tempest-ServerPasswordTestJSON-1534707503-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:12:46.497826 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-221d70aa-58ad-4ae0-b826-c17bf1a02d33 tempest-FloatingIPDetailsTestJSON-1286833380 tempest-FloatingIPDetailsTestJSON-1286833380-project] Action: 'create', calling method: .version_select at 0x7f0ae1d1d700>, body: {"pool": null} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:12:46.625472 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-1aae9bcd-51e3-4b89-a59f-2f58594882fd tempest-ServerPasswordTestJSON-1534707503 tempest-ServerPasswordTestJSON-1534707503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '969cec09484942aebbab6c0f021b7067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9871416ead87433589b8f54783b023b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:12:46.639122 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-1aae9bcd-51e3-4b89-a59f-2f58594882fd tempest-ServerPasswordTestJSON-1534707503 tempest-ServerPasswordTestJSON-1534707503-project] 10.222.0.13 "GET /compute/v2.1/servers/3463bb31-5f34-4b89-8b40-af83df5c7635" status: 200 len: 1274 microversion: 2.1 time: 0.237447 Nov 01 19:12:46.640930 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 2127/4313] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:12:46 2022] GET /compute/v2.1/servers/3463bb31-5f34-4b89-8b40-af83df5c7635 => generated 1274 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:12:46.802401 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-24059341-3bd8-49e4-86d0-fa7c8a2d8dd6 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-598068555", "imageRef": "2d4a0047-1b9e-445f-8af8-1b5c9d93e881", "flavorRef": -1, "networks": [{"uuid": "f2fc603f-a5ab-4120-939f-124d49e1f7c1"}]}} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:12:46.844331 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.wsgi [None req-24059341-3bd8-49e4-86d0-fa7c8a2d8dd6 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] HTTP exception thrown: Flavor -1 could not be found. Nov 01 19:12:46.858816 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-24059341-3bd8-49e4-86d0-fa7c8a2d8dd6 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Request method failure captured: Nov 01 19:12:46.858816 n-d-863052-2 devstack@n-api.service[121402]: request: POST /compute/v2.1/servers HTTP/1.1 Nov 01 19:12:46.858816 n-d-863052-2 devstack@n-api.service[121402]: Accept: application/json Nov 01 19:12:46.858816 n-d-863052-2 devstack@n-api.service[121402]: Accept-Encoding: identity Nov 01 19:12:46.858816 n-d-863052-2 devstack@n-api.service[121402]: Connection: close Nov 01 19:12:46.858816 n-d-863052-2 devstack@n-api.service[121402]: Content-Length: 205 Nov 01 19:12:46.858816 n-d-863052-2 devstack@n-api.service[121402]: Content-Type: application/json Nov 01 19:12:46.858816 n-d-863052-2 devstack@n-api.service[121402]: Host: 10.222.0.13 Nov 01 19:12:46.858816 n-d-863052-2 devstack@n-api.service[121402]: Openstack-System-Scope: None Nov 01 19:12:46.858816 n-d-863052-2 devstack@n-api.service[121402]: User-Agent: python-urllib3/1.26.12 Nov 01 19:12:46.858816 n-d-863052-2 devstack@n-api.service[121402]: X-Auth-Token: gAAAAABjYW9YFTR7hO-vK03S-3HbvOtG2z3_fji2KJH39vNHENu4xIKneeHYviQiPj9ERGiA3aZIA7DvAYzczgSZ5-vK782IQ7CYnUFXvn9Aqt1AbunNMYxhes9BKzhvODzqwzqiQq89wgC4nbpZ9jJWFWMOC4z9bcW4UMi_ylwdZFjmhWfD49s Nov 01 19:12:46.858816 n-d-863052-2 devstack@n-api.service[121402]: X-Domain-Id: None Nov 01 19:12:46.858816 n-d-863052-2 devstack@n-api.service[121402]: X-Domain-Name: None Nov 01 19:12:46.858816 n-d-863052-2 devstack@n-api.service[121402]: X-Identity-Status: Confirmed Nov 01 19:12:46.858816 n-d-863052-2 devstack@n-api.service[121402]: X-Is-Admin-Project: True Nov 01 19:12:46.858816 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Domain-Id: default Nov 01 19:12:46.858816 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Domain-Name: Default Nov 01 19:12:46.858816 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Id: 9ecdc83933544a899117531a960027a7 Nov 01 19:12:46.858816 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Name: tempest-ServersNegativeTestJSON-638944671 Nov 01 19:12:46.858816 n-d-863052-2 devstack@n-api.service[121402]: X-Role: member,reader Nov 01 19:12:46.858816 n-d-863052-2 devstack@n-api.service[121402]: X-Roles: member,reader Nov 01 19:12:46.858816 n-d-863052-2 devstack@n-api.service[121402]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/9ecdc83933544a899117531a960027a7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/9ecdc83933544a899117531a960027a7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_9ecdc83933544a899117531a960027a7", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/9ecdc83933544a899117531a960027a7"}]}] Nov 01 19:12:46.858816 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant: tempest-ServersNegativeTestJSON-638944671 Nov 01 19:12:46.858816 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant-Id: 9ecdc83933544a899117531a960027a7 Nov 01 19:12:46.858816 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant-Name: tempest-ServersNegativeTestJSON-638944671 Nov 01 19:12:46.858816 n-d-863052-2 devstack@n-api.service[121402]: X-User: tempest-ServersNegativeTestJSON-638944671-project Nov 01 19:12:46.858816 n-d-863052-2 devstack@n-api.service[121402]: X-User-Domain-Id: default Nov 01 19:12:46.858816 n-d-863052-2 devstack@n-api.service[121402]: X-User-Domain-Name: Default Nov 01 19:12:46.858816 n-d-863052-2 devstack@n-api.service[121402]: X-User-Id: 3fc5c19b930543f5a5091922a9859813 Nov 01 19:12:46.858816 n-d-863052-2 devstack@n-api.service[121402]: X-User-Name: tempest-ServersNegativeTestJSON-638944671-project Nov 01 19:12:46.858816 n-d-863052-2 devstack@n-api.service[121402]: Nov 01 19:12:46.858816 n-d-863052-2 devstack@n-api.service[121402]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-598068555", "imageRef": "2d4a0047-1b9e-445f-8af8-1b5c9d93e881", "flavorRef": -1, "networks": [{"uuid": "f2fc603f-a5ab-4120-939f-124d49e1f7c1"}]}} Nov 01 19:12:46.858816 n-d-863052-2 devstack@n-api.service[121402]: method: > Nov 01 19:12:46.858816 n-d-863052-2 devstack@n-api.service[121402]: exception: Flavor -1 could not be found. Nov 01 19:12:46.858816 n-d-863052-2 devstack@n-api.service[121402]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-598068555', 'imageRef': '2d4a0047-1b9e-445f-8af8-1b5c9d93e881', 'flavorRef': -1, 'networks': [{'uuid': 'f2fc603f-a5ab-4120-939f-124d49e1f7c1'}]}}} Nov 01 19:12:46.858816 n-d-863052-2 devstack@n-api.service[121402]: {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 01 19:12:46.858816 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:12:46.858816 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 778, in create Nov 01 19:12:46.858816 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id( Nov 01 19:12:46.858816 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Nov 01 19:12:46.858816 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Nov 01 19:12:46.858816 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 01 19:12:46.858816 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 01 19:12:46.858816 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Nov 01 19:12:46.858816 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Nov 01 19:12:46.858816 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Nov 01 19:12:46.858816 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 01 19:12:46.858816 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Nov 01 19:12:46.858816 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Nov 01 19:12:46.858816 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor -1 could not be found. Nov 01 19:12:46.858816 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:12:46.858816 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:12:46.858816 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:12:46.858816 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:12:46.858816 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:12:46.858816 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:12:46.858816 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 01 19:12:46.858816 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 01 19:12:46.858816 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 01 19:12:46.858816 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 01 19:12:46.858816 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 01 19:12:46.858816 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 01 19:12:46.862318 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 01 19:12:46.862318 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 01 19:12:46.862318 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 01 19:12:46.862318 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 01 19:12:46.862318 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Nov 01 19:12:46.862318 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Nov 01 19:12:46.862318 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Nov 01 19:12:46.862318 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor -1 could not be found. Nov 01 19:12:46.862318 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:12:46.862318 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:12:46.862318 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:12:46.862318 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:12:46.862318 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:12:46.862318 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:12:46.862318 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 01 19:12:46.862318 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 01 19:12:46.862318 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor -1 could not be found. Nov 01 19:12:46.862318 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:12:46.864306 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-24059341-3bd8-49e4-86d0-fa7c8a2d8dd6 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Returning 400 to user: Flavor -1 could not be found. {{(pid=121402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 01 19:12:46.869077 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-24059341-3bd8-49e4-86d0-fa7c8a2d8dd6 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 400 len: 73 microversion: 2.1 time: 0.068194 Nov 01 19:12:46.871719 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 2128/4314] 10.222.0.13 () {60 vars in 1147 bytes} [Tue Nov 1 19:12:46 2022] POST /compute/v2.1/servers => generated 73 bytes in 75 msecs (HTTP/1.1 400) 9 headers in 380 bytes (2 switches on core 0) Nov 01 19:12:46.901055 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-b9832945-0ee7-430b-a6c6-ecb0f6dde6fa tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:12:46.902988 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-b9832945-0ee7-430b-a6c6-ecb0f6dde6fa tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] [instance: b27eaab4-a751-47fb-acdb-db7c99b06a5f] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:12:46.958140 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b9832945-0ee7-430b-a6c6-ecb0f6dde6fa tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:12:46.958640 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b9832945-0ee7-430b-a6c6-ecb0f6dde6fa tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:12:46.959099 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b9832945-0ee7-430b-a6c6-ecb0f6dde6fa tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:12:46.959788 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b9832945-0ee7-430b-a6c6-ecb0f6dde6fa tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:12:46.960242 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b9832945-0ee7-430b-a6c6-ecb0f6dde6fa tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:12:46.974866 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b9832945-0ee7-430b-a6c6-ecb0f6dde6fa tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:12:47.364837 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-b9832945-0ee7-430b-a6c6-ecb0f6dde6fa tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc5c19b930543f5a5091922a9859813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ecdc83933544a899117531a960027a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:12:47.376632 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-b9832945-0ee7-430b-a6c6-ecb0f6dde6fa tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] 10.222.0.13 "GET /compute/v2.1/servers/b27eaab4-a751-47fb-acdb-db7c99b06a5f" status: 200 len: 1506 microversion: 2.1 time: 0.501251 Nov 01 19:12:47.377877 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 2129/4315] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:12:46 2022] GET /compute/v2.1/servers/b27eaab4-a751-47fb-acdb-db7c99b06a5f => generated 1506 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:12:47.385355 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-03b4beb5-dedd-4e35-a2c5-6516c0afdcec tempest-InstanceActionsV221TestJSON-1016349810 tempest-InstanceActionsV221TestJSON-1016349810-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:12:47.386344 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-03b4beb5-dedd-4e35-a2c5-6516c0afdcec tempest-InstanceActionsV221TestJSON-1016349810 tempest-InstanceActionsV221TestJSON-1016349810-project] [instance: aa7aa9c6-8a88-4948-a623-be7e64e73b5f] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:12:47.396574 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-03b4beb5-dedd-4e35-a2c5-6516c0afdcec tempest-InstanceActionsV221TestJSON-1016349810 tempest-InstanceActionsV221TestJSON-1016349810-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:12:47.397411 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-03b4beb5-dedd-4e35-a2c5-6516c0afdcec tempest-InstanceActionsV221TestJSON-1016349810 tempest-InstanceActionsV221TestJSON-1016349810-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:12:47.398560 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-03b4beb5-dedd-4e35-a2c5-6516c0afdcec tempest-InstanceActionsV221TestJSON-1016349810 tempest-InstanceActionsV221TestJSON-1016349810-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:12:47.399705 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-03b4beb5-dedd-4e35-a2c5-6516c0afdcec tempest-InstanceActionsV221TestJSON-1016349810 tempest-InstanceActionsV221TestJSON-1016349810-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:12:47.400420 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-03b4beb5-dedd-4e35-a2c5-6516c0afdcec tempest-InstanceActionsV221TestJSON-1016349810 tempest-InstanceActionsV221TestJSON-1016349810-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:12:47.401985 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-03b4beb5-dedd-4e35-a2c5-6516c0afdcec tempest-InstanceActionsV221TestJSON-1016349810 tempest-InstanceActionsV221TestJSON-1016349810-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:12:47.752624 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-03b4beb5-dedd-4e35-a2c5-6516c0afdcec tempest-InstanceActionsV221TestJSON-1016349810 tempest-InstanceActionsV221TestJSON-1016349810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '060d1fb6604f4096b650cf40060db86a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c29ec5eebf84c198c11bae29e3df2d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:12:47.767995 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-03b4beb5-dedd-4e35-a2c5-6516c0afdcec tempest-InstanceActionsV221TestJSON-1016349810 tempest-InstanceActionsV221TestJSON-1016349810-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '060d1fb6604f4096b650cf40060db86a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c29ec5eebf84c198c11bae29e3df2d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:12:47.772164 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-03b4beb5-dedd-4e35-a2c5-6516c0afdcec tempest-InstanceActionsV221TestJSON-1016349810 tempest-InstanceActionsV221TestJSON-1016349810-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '060d1fb6604f4096b650cf40060db86a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c29ec5eebf84c198c11bae29e3df2d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:12:47.773429 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-03b4beb5-dedd-4e35-a2c5-6516c0afdcec tempest-InstanceActionsV221TestJSON-1016349810 tempest-InstanceActionsV221TestJSON-1016349810-project] 10.222.0.13 "GET /compute/v2.1/servers/aa7aa9c6-8a88-4948-a623-be7e64e73b5f" status: 200 len: 1358 microversion: 2.21 time: 0.393879 Nov 01 19:12:47.777026 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 2130/4316] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 19:12:47 2022] GET /compute/v2.1/servers/aa7aa9c6-8a88-4948-a623-be7e64e73b5f => generated 1358 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 19:12:47.784763 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-40833363-a65d-42ae-a849-d3f328a16c07 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:12:47.788820 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-40833363-a65d-42ae-a849-d3f328a16c07 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] [instance: b27eaab4-a751-47fb-acdb-db7c99b06a5f] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:12:47.805663 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-40833363-a65d-42ae-a849-d3f328a16c07 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:12:47.808040 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-40833363-a65d-42ae-a849-d3f328a16c07 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:12:47.808830 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-40833363-a65d-42ae-a849-d3f328a16c07 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:12:47.817055 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-40833363-a65d-42ae-a849-d3f328a16c07 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:12:47.817835 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-40833363-a65d-42ae-a849-d3f328a16c07 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:12:47.818586 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-40833363-a65d-42ae-a849-d3f328a16c07 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:12:48.239454 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-40833363-a65d-42ae-a849-d3f328a16c07 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc5c19b930543f5a5091922a9859813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ecdc83933544a899117531a960027a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:12:48.247992 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-40833363-a65d-42ae-a849-d3f328a16c07 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] 10.222.0.13 "GET /compute/v2.1/servers/b27eaab4-a751-47fb-acdb-db7c99b06a5f" status: 200 len: 1506 microversion: 2.1 time: 0.469882 Nov 01 19:12:48.250722 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 2131/4317] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:12:47 2022] GET /compute/v2.1/servers/b27eaab4-a751-47fb-acdb-db7c99b06a5f => generated 1506 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:12:48.255777 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-40fb50a3-0120-4766-854f-718e09eec42b tempest-ServerPasswordTestJSON-1534707503 tempest-ServerPasswordTestJSON-1534707503-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:12:48.256576 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-40fb50a3-0120-4766-854f-718e09eec42b tempest-ServerPasswordTestJSON-1534707503 tempest-ServerPasswordTestJSON-1534707503-project] [instance: 3463bb31-5f34-4b89-8b40-af83df5c7635] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:12:48.266544 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-40fb50a3-0120-4766-854f-718e09eec42b tempest-ServerPasswordTestJSON-1534707503 tempest-ServerPasswordTestJSON-1534707503-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:12:48.270697 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-40fb50a3-0120-4766-854f-718e09eec42b tempest-ServerPasswordTestJSON-1534707503 tempest-ServerPasswordTestJSON-1534707503-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:12:48.272432 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-40fb50a3-0120-4766-854f-718e09eec42b tempest-ServerPasswordTestJSON-1534707503 tempest-ServerPasswordTestJSON-1534707503-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:12:48.274084 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-40fb50a3-0120-4766-854f-718e09eec42b tempest-ServerPasswordTestJSON-1534707503 tempest-ServerPasswordTestJSON-1534707503-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:12:48.284392 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-40fb50a3-0120-4766-854f-718e09eec42b tempest-ServerPasswordTestJSON-1534707503 tempest-ServerPasswordTestJSON-1534707503-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:12:48.293239 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-40fb50a3-0120-4766-854f-718e09eec42b tempest-ServerPasswordTestJSON-1534707503 tempest-ServerPasswordTestJSON-1534707503-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:12:48.445248 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-40fb50a3-0120-4766-854f-718e09eec42b tempest-ServerPasswordTestJSON-1534707503 tempest-ServerPasswordTestJSON-1534707503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '969cec09484942aebbab6c0f021b7067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9871416ead87433589b8f54783b023b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:12:48.458417 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-40fb50a3-0120-4766-854f-718e09eec42b tempest-ServerPasswordTestJSON-1534707503 tempest-ServerPasswordTestJSON-1534707503-project] 10.222.0.13 "GET /compute/v2.1/servers/3463bb31-5f34-4b89-8b40-af83df5c7635" status: 200 len: 1274 microversion: 2.1 time: 0.206221 Nov 01 19:12:48.463165 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 2132/4318] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:12:48 2022] GET /compute/v2.1/servers/3463bb31-5f34-4b89-8b40-af83df5c7635 => generated 1274 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:12:48.561057 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-5a790842-05cd-443e-8207-5eabc152a56e tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-837778548", "imageRef": -1, "flavorRef": "452", "networks": [{"uuid": "f2fc603f-a5ab-4120-939f-124d49e1f7c1"}]}} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:12:48.564380 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-5a790842-05cd-443e-8207-5eabc152a56e tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Request method failure captured: Nov 01 19:12:48.564380 n-d-863052-2 devstack@n-api.service[121402]: request: POST /compute/v2.1/servers HTTP/1.1 Nov 01 19:12:48.564380 n-d-863052-2 devstack@n-api.service[121402]: Accept: application/json Nov 01 19:12:48.564380 n-d-863052-2 devstack@n-api.service[121402]: Accept-Encoding: identity Nov 01 19:12:48.564380 n-d-863052-2 devstack@n-api.service[121402]: Connection: close Nov 01 19:12:48.564380 n-d-863052-2 devstack@n-api.service[121402]: Content-Length: 172 Nov 01 19:12:48.564380 n-d-863052-2 devstack@n-api.service[121402]: Content-Type: application/json Nov 01 19:12:48.564380 n-d-863052-2 devstack@n-api.service[121402]: Host: 10.222.0.13 Nov 01 19:12:48.564380 n-d-863052-2 devstack@n-api.service[121402]: Openstack-System-Scope: None Nov 01 19:12:48.564380 n-d-863052-2 devstack@n-api.service[121402]: User-Agent: python-urllib3/1.26.12 Nov 01 19:12:48.564380 n-d-863052-2 devstack@n-api.service[121402]: X-Auth-Token: gAAAAABjYW9YFTR7hO-vK03S-3HbvOtG2z3_fji2KJH39vNHENu4xIKneeHYviQiPj9ERGiA3aZIA7DvAYzczgSZ5-vK782IQ7CYnUFXvn9Aqt1AbunNMYxhes9BKzhvODzqwzqiQq89wgC4nbpZ9jJWFWMOC4z9bcW4UMi_ylwdZFjmhWfD49s Nov 01 19:12:48.564380 n-d-863052-2 devstack@n-api.service[121402]: X-Domain-Id: None Nov 01 19:12:48.564380 n-d-863052-2 devstack@n-api.service[121402]: X-Domain-Name: None Nov 01 19:12:48.564380 n-d-863052-2 devstack@n-api.service[121402]: X-Identity-Status: Confirmed Nov 01 19:12:48.564380 n-d-863052-2 devstack@n-api.service[121402]: X-Is-Admin-Project: True Nov 01 19:12:48.564380 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Domain-Id: default Nov 01 19:12:48.564380 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Domain-Name: Default Nov 01 19:12:48.564380 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Id: 9ecdc83933544a899117531a960027a7 Nov 01 19:12:48.564380 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Name: tempest-ServersNegativeTestJSON-638944671 Nov 01 19:12:48.564380 n-d-863052-2 devstack@n-api.service[121402]: X-Role: member,reader Nov 01 19:12:48.564380 n-d-863052-2 devstack@n-api.service[121402]: X-Roles: member,reader Nov 01 19:12:48.564380 n-d-863052-2 devstack@n-api.service[121402]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/9ecdc83933544a899117531a960027a7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/9ecdc83933544a899117531a960027a7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_9ecdc83933544a899117531a960027a7", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/9ecdc83933544a899117531a960027a7"}]}] Nov 01 19:12:48.564380 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant: tempest-ServersNegativeTestJSON-638944671 Nov 01 19:12:48.564380 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant-Id: 9ecdc83933544a899117531a960027a7 Nov 01 19:12:48.564380 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant-Name: tempest-ServersNegativeTestJSON-638944671 Nov 01 19:12:48.564380 n-d-863052-2 devstack@n-api.service[121402]: X-User: tempest-ServersNegativeTestJSON-638944671-project Nov 01 19:12:48.564380 n-d-863052-2 devstack@n-api.service[121402]: X-User-Domain-Id: default Nov 01 19:12:48.564380 n-d-863052-2 devstack@n-api.service[121402]: X-User-Domain-Name: Default Nov 01 19:12:48.564380 n-d-863052-2 devstack@n-api.service[121402]: X-User-Id: 3fc5c19b930543f5a5091922a9859813 Nov 01 19:12:48.564380 n-d-863052-2 devstack@n-api.service[121402]: X-User-Name: tempest-ServersNegativeTestJSON-638944671-project Nov 01 19:12:48.564380 n-d-863052-2 devstack@n-api.service[121402]: Nov 01 19:12:48.564380 n-d-863052-2 devstack@n-api.service[121402]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-837778548", "imageRef": -1, "flavorRef": "452", "networks": [{"uuid": "f2fc603f-a5ab-4120-939f-124d49e1f7c1"}]}} Nov 01 19:12:48.564380 n-d-863052-2 devstack@n-api.service[121402]: method: > Nov 01 19:12:48.564380 n-d-863052-2 devstack@n-api.service[121402]: exception: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Nov 01 19:12:48.564380 n-d-863052-2 devstack@n-api.service[121402]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-837778548', 'imageRef': -1, 'flavorRef': '452', 'networks': [{'uuid': 'f2fc603f-a5ab-4120-939f-124d49e1f7c1'}]}}} Nov 01 19:12:48.564380 n-d-863052-2 devstack@n-api.service[121402]: {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 01 19:12:48.564380 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:12:48.564380 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Nov 01 19:12:48.564380 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Nov 01 19:12:48.564380 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Nov 01 19:12:48.564380 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise error Nov 01 19:12:48.564380 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: -1 is not valid under any of the given schemas Nov 01 19:12:48.564380 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:12:48.564380 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Failed validating 'oneOf' in schema['properties']['server']['properties']['imageRef']: Nov 01 19:12:48.564380 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi {'oneOf': [{'format': 'uuid', 'type': 'string'}, Nov 01 19:12:48.564380 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi {'maxLength': 0, 'type': 'string'}]} Nov 01 19:12:48.564380 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:12:48.564380 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi On instance['server']: Nov 01 19:12:48.564380 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi -1 Nov 01 19:12:48.564380 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:12:48.564380 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:12:48.564380 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:12:48.564380 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:12:48.564380 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:12:48.564380 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:12:48.564380 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 01 19:12:48.564380 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 01 19:12:48.564380 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 01 19:12:48.564380 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 01 19:12:48.564380 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 01 19:12:48.564380 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 01 19:12:48.564380 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Nov 01 19:12:48.564380 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Nov 01 19:12:48.564380 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Nov 01 19:12:48.564380 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Nov 01 19:12:48.567784 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Nov 01 19:12:48.567784 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Nov 01 19:12:48.567784 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Nov 01 19:12:48.567784 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:12:48.567784 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:12:48.567784 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:12:48.567784 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:12:48.567784 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:12:48.567784 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:12:48.567784 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Nov 01 19:12:48.567784 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Nov 01 19:12:48.567784 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Nov 01 19:12:48.567784 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:12:48.567784 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-5a790842-05cd-443e-8207-5eabc152a56e tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Returning 400 to user: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas {{(pid=121402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 01 19:12:48.569370 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-5a790842-05cd-443e-8207-5eabc152a56e tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 400 len: 145 microversion: 2.1 time: 0.017306 Nov 01 19:12:48.569992 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 2133/4319] 10.222.0.13 () {60 vars in 1147 bytes} [Tue Nov 1 19:12:48 2022] POST /compute/v2.1/servers => generated 145 bytes in 19 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 01 19:12:48.597264 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-004ee951-3453-4e7f-ad6a-ecc92851ea5f tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:12:48.598044 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-004ee951-3453-4e7f-ad6a-ecc92851ea5f tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] [instance: b27eaab4-a751-47fb-acdb-db7c99b06a5f] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:12:48.615803 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-004ee951-3453-4e7f-ad6a-ecc92851ea5f tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:12:48.616401 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-004ee951-3453-4e7f-ad6a-ecc92851ea5f tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:12:48.619097 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-004ee951-3453-4e7f-ad6a-ecc92851ea5f tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:12:48.619962 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-004ee951-3453-4e7f-ad6a-ecc92851ea5f tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:12:48.620449 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-004ee951-3453-4e7f-ad6a-ecc92851ea5f tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:12:48.620917 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-004ee951-3453-4e7f-ad6a-ecc92851ea5f tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:12:49.008405 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-004ee951-3453-4e7f-ad6a-ecc92851ea5f tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc5c19b930543f5a5091922a9859813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ecdc83933544a899117531a960027a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:12:49.024572 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-004ee951-3453-4e7f-ad6a-ecc92851ea5f tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] 10.222.0.13 "GET /compute/v2.1/servers/b27eaab4-a751-47fb-acdb-db7c99b06a5f" status: 200 len: 1506 microversion: 2.1 time: 0.442647 Nov 01 19:12:49.050349 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 2134/4320] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:12:48 2022] GET /compute/v2.1/servers/b27eaab4-a751-47fb-acdb-db7c99b06a5f => generated 1506 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:12:49.073244 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-0b2e5c5f-5056-4208-b035-ea3d4e369e1e tempest-InstanceActionsV221TestJSON-1016349810 tempest-InstanceActionsV221TestJSON-1016349810-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:12:49.076194 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-0b2e5c5f-5056-4208-b035-ea3d4e369e1e tempest-InstanceActionsV221TestJSON-1016349810 tempest-InstanceActionsV221TestJSON-1016349810-project] [instance: aa7aa9c6-8a88-4948-a623-be7e64e73b5f] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:12:49.092652 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-0b2e5c5f-5056-4208-b035-ea3d4e369e1e tempest-InstanceActionsV221TestJSON-1016349810 tempest-InstanceActionsV221TestJSON-1016349810-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:12:49.099743 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-0b2e5c5f-5056-4208-b035-ea3d4e369e1e tempest-InstanceActionsV221TestJSON-1016349810 tempest-InstanceActionsV221TestJSON-1016349810-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:12:49.101855 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-0b2e5c5f-5056-4208-b035-ea3d4e369e1e tempest-InstanceActionsV221TestJSON-1016349810 tempest-InstanceActionsV221TestJSON-1016349810-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:12:49.105159 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-0b2e5c5f-5056-4208-b035-ea3d4e369e1e tempest-InstanceActionsV221TestJSON-1016349810 tempest-InstanceActionsV221TestJSON-1016349810-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:12:49.105841 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-0b2e5c5f-5056-4208-b035-ea3d4e369e1e tempest-InstanceActionsV221TestJSON-1016349810 tempest-InstanceActionsV221TestJSON-1016349810-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:12:49.108087 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-0b2e5c5f-5056-4208-b035-ea3d4e369e1e tempest-InstanceActionsV221TestJSON-1016349810 tempest-InstanceActionsV221TestJSON-1016349810-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:12:49.535464 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-0b2e5c5f-5056-4208-b035-ea3d4e369e1e tempest-InstanceActionsV221TestJSON-1016349810 tempest-InstanceActionsV221TestJSON-1016349810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '060d1fb6604f4096b650cf40060db86a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c29ec5eebf84c198c11bae29e3df2d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:12:49.547844 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-0b2e5c5f-5056-4208-b035-ea3d4e369e1e tempest-InstanceActionsV221TestJSON-1016349810 tempest-InstanceActionsV221TestJSON-1016349810-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '060d1fb6604f4096b650cf40060db86a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c29ec5eebf84c198c11bae29e3df2d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:12:49.555154 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-0b2e5c5f-5056-4208-b035-ea3d4e369e1e tempest-InstanceActionsV221TestJSON-1016349810 tempest-InstanceActionsV221TestJSON-1016349810-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '060d1fb6604f4096b650cf40060db86a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c29ec5eebf84c198c11bae29e3df2d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:12:49.563626 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-0b2e5c5f-5056-4208-b035-ea3d4e369e1e tempest-InstanceActionsV221TestJSON-1016349810 tempest-InstanceActionsV221TestJSON-1016349810-project] 10.222.0.13 "GET /compute/v2.1/servers/aa7aa9c6-8a88-4948-a623-be7e64e73b5f" status: 200 len: 1358 microversion: 2.21 time: 0.511674 Nov 01 19:12:49.569265 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 2135/4321] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 19:12:49 2022] GET /compute/v2.1/servers/aa7aa9c6-8a88-4948-a623-be7e64e73b5f => generated 1358 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 19:12:49.579865 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-8e4ce3b8-cbd6-4bd8-a536-6a3bafde722f tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:12:49.583257 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-8e4ce3b8-cbd6-4bd8-a536-6a3bafde722f tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] [instance: b27eaab4-a751-47fb-acdb-db7c99b06a5f] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:12:49.613575 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-8e4ce3b8-cbd6-4bd8-a536-6a3bafde722f tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:12:49.614380 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-8e4ce3b8-cbd6-4bd8-a536-6a3bafde722f tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:12:49.615046 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-8e4ce3b8-cbd6-4bd8-a536-6a3bafde722f tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:12:49.615955 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-8e4ce3b8-cbd6-4bd8-a536-6a3bafde722f tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:12:49.619601 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-8e4ce3b8-cbd6-4bd8-a536-6a3bafde722f tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:12:49.620286 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-8e4ce3b8-cbd6-4bd8-a536-6a3bafde722f tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:12:49.984864 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-8e4ce3b8-cbd6-4bd8-a536-6a3bafde722f tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc5c19b930543f5a5091922a9859813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ecdc83933544a899117531a960027a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:12:49.995998 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-8e4ce3b8-cbd6-4bd8-a536-6a3bafde722f tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] 10.222.0.13 "GET /compute/v2.1/servers/b27eaab4-a751-47fb-acdb-db7c99b06a5f" status: 200 len: 1506 microversion: 2.1 time: 0.425242 Nov 01 19:12:50.013261 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 2136/4322] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:12:49 2022] GET /compute/v2.1/servers/b27eaab4-a751-47fb-acdb-db7c99b06a5f => generated 1506 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:12:50.027516 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-c2cae91d-5f1c-4d35-b965-d8b8d37d457b tempest-ServerPasswordTestJSON-1534707503 tempest-ServerPasswordTestJSON-1534707503-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:12:50.042731 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-c2cae91d-5f1c-4d35-b965-d8b8d37d457b tempest-ServerPasswordTestJSON-1534707503 tempest-ServerPasswordTestJSON-1534707503-project] [instance: 3463bb31-5f34-4b89-8b40-af83df5c7635] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:12:50.077166 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-c2cae91d-5f1c-4d35-b965-d8b8d37d457b tempest-ServerPasswordTestJSON-1534707503 tempest-ServerPasswordTestJSON-1534707503-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:12:50.083893 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-c2cae91d-5f1c-4d35-b965-d8b8d37d457b tempest-ServerPasswordTestJSON-1534707503 tempest-ServerPasswordTestJSON-1534707503-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:12:50.084362 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-c2cae91d-5f1c-4d35-b965-d8b8d37d457b tempest-ServerPasswordTestJSON-1534707503 tempest-ServerPasswordTestJSON-1534707503-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:12:50.085146 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-c2cae91d-5f1c-4d35-b965-d8b8d37d457b tempest-ServerPasswordTestJSON-1534707503 tempest-ServerPasswordTestJSON-1534707503-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:12:50.095307 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-c2cae91d-5f1c-4d35-b965-d8b8d37d457b tempest-ServerPasswordTestJSON-1534707503 tempest-ServerPasswordTestJSON-1534707503-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:12:50.095904 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-c2cae91d-5f1c-4d35-b965-d8b8d37d457b tempest-ServerPasswordTestJSON-1534707503 tempest-ServerPasswordTestJSON-1534707503-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:12:50.296335 n-d-863052-2 devstack@n-api.service[121402]: DEBUG dbcounter [-] [121402] Writing DB stats nova_cell0:SELECT=2 {{(pid=121402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 19:12:50.416774 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-c2cae91d-5f1c-4d35-b965-d8b8d37d457b tempest-ServerPasswordTestJSON-1534707503 tempest-ServerPasswordTestJSON-1534707503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '969cec09484942aebbab6c0f021b7067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9871416ead87433589b8f54783b023b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:12:50.422098 n-d-863052-2 devstack@n-api.service[121402]: DEBUG dbcounter [-] [121402] Writing DB stats nova_cell0:SELECT=6 {{(pid=121402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 19:12:50.431172 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-c2cae91d-5f1c-4d35-b965-d8b8d37d457b tempest-ServerPasswordTestJSON-1534707503 tempest-ServerPasswordTestJSON-1534707503-project] 10.222.0.13 "GET /compute/v2.1/servers/3463bb31-5f34-4b89-8b40-af83df5c7635" status: 200 len: 1274 microversion: 2.1 time: 0.416229 Nov 01 19:12:50.432289 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 2137/4323] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:12:50 2022] GET /compute/v2.1/servers/3463bb31-5f34-4b89-8b40-af83df5c7635 => generated 1274 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:12:50.441895 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-1e068877-28eb-4827-bba6-76051c33663f tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-414096791", "imageRef": "2d4a0047-1b9e-445f-8af8-1b5c9d93e881", "flavorRef": "452", "networks": [{"fixed_ip": "10.0.1.1", "uuid": "a-b-c-d-e-f-g-h-i-j"}]}} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:12:50.471754 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.wsgi [None req-1e068877-28eb-4827-bba6-76051c33663f tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] HTTP exception thrown: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Nov 01 19:12:50.479066 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-1e068877-28eb-4827-bba6-76051c33663f tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Request method failure captured: Nov 01 19:12:50.479066 n-d-863052-2 devstack@n-api.service[121402]: request: POST /compute/v2.1/servers HTTP/1.1 Nov 01 19:12:50.479066 n-d-863052-2 devstack@n-api.service[121402]: Accept: application/json Nov 01 19:12:50.479066 n-d-863052-2 devstack@n-api.service[121402]: Accept-Encoding: identity Nov 01 19:12:50.479066 n-d-863052-2 devstack@n-api.service[121402]: Connection: close Nov 01 19:12:50.479066 n-d-863052-2 devstack@n-api.service[121402]: Content-Length: 215 Nov 01 19:12:50.479066 n-d-863052-2 devstack@n-api.service[121402]: Content-Type: application/json Nov 01 19:12:50.479066 n-d-863052-2 devstack@n-api.service[121402]: Host: 10.222.0.13 Nov 01 19:12:50.479066 n-d-863052-2 devstack@n-api.service[121402]: Openstack-System-Scope: None Nov 01 19:12:50.479066 n-d-863052-2 devstack@n-api.service[121402]: User-Agent: python-urllib3/1.26.12 Nov 01 19:12:50.479066 n-d-863052-2 devstack@n-api.service[121402]: X-Auth-Token: gAAAAABjYW9YFTR7hO-vK03S-3HbvOtG2z3_fji2KJH39vNHENu4xIKneeHYviQiPj9ERGiA3aZIA7DvAYzczgSZ5-vK782IQ7CYnUFXvn9Aqt1AbunNMYxhes9BKzhvODzqwzqiQq89wgC4nbpZ9jJWFWMOC4z9bcW4UMi_ylwdZFjmhWfD49s Nov 01 19:12:50.479066 n-d-863052-2 devstack@n-api.service[121402]: X-Domain-Id: None Nov 01 19:12:50.479066 n-d-863052-2 devstack@n-api.service[121402]: X-Domain-Name: None Nov 01 19:12:50.479066 n-d-863052-2 devstack@n-api.service[121402]: X-Identity-Status: Confirmed Nov 01 19:12:50.479066 n-d-863052-2 devstack@n-api.service[121402]: X-Is-Admin-Project: True Nov 01 19:12:50.479066 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Domain-Id: default Nov 01 19:12:50.479066 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Domain-Name: Default Nov 01 19:12:50.479066 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Id: 9ecdc83933544a899117531a960027a7 Nov 01 19:12:50.479066 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Name: tempest-ServersNegativeTestJSON-638944671 Nov 01 19:12:50.479066 n-d-863052-2 devstack@n-api.service[121402]: X-Role: member,reader Nov 01 19:12:50.479066 n-d-863052-2 devstack@n-api.service[121402]: X-Roles: member,reader Nov 01 19:12:50.479066 n-d-863052-2 devstack@n-api.service[121402]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/9ecdc83933544a899117531a960027a7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/9ecdc83933544a899117531a960027a7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_9ecdc83933544a899117531a960027a7", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/9ecdc83933544a899117531a960027a7"}]}] Nov 01 19:12:50.479066 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant: tempest-ServersNegativeTestJSON-638944671 Nov 01 19:12:50.479066 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant-Id: 9ecdc83933544a899117531a960027a7 Nov 01 19:12:50.479066 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant-Name: tempest-ServersNegativeTestJSON-638944671 Nov 01 19:12:50.479066 n-d-863052-2 devstack@n-api.service[121402]: X-User: tempest-ServersNegativeTestJSON-638944671-project Nov 01 19:12:50.479066 n-d-863052-2 devstack@n-api.service[121402]: X-User-Domain-Id: default Nov 01 19:12:50.479066 n-d-863052-2 devstack@n-api.service[121402]: X-User-Domain-Name: Default Nov 01 19:12:50.479066 n-d-863052-2 devstack@n-api.service[121402]: X-User-Id: 3fc5c19b930543f5a5091922a9859813 Nov 01 19:12:50.479066 n-d-863052-2 devstack@n-api.service[121402]: X-User-Name: tempest-ServersNegativeTestJSON-638944671-project Nov 01 19:12:50.479066 n-d-863052-2 devstack@n-api.service[121402]: Nov 01 19:12:50.479066 n-d-863052-2 devstack@n-api.service[121402]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-414096791", "imageRef": "2d4a0047-1b9e-445f-8af8-1b5c9d93e881", "flavorRef": "452", "networks": [{"fixed_ip": "10.0.1.1", "uuid": "a-b-c-d-e-f-g-h-i-j"}]}} Nov 01 19:12:50.479066 n-d-863052-2 devstack@n-api.service[121402]: method: > Nov 01 19:12:50.479066 n-d-863052-2 devstack@n-api.service[121402]: exception: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Nov 01 19:12:50.479066 n-d-863052-2 devstack@n-api.service[121402]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-414096791', 'imageRef': '2d4a0047-1b9e-445f-8af8-1b5c9d93e881', 'flavorRef': '452', 'networks': [{'fixed_ip': '10.0.1.1', 'uuid': 'a-b-c-d-e-f-g-h-i-j'}]}}} Nov 01 19:12:50.479066 n-d-863052-2 devstack@n-api.service[121402]: {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 01 19:12:50.479066 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:12:50.479066 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:12:50.479066 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:12:50.479066 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 01 19:12:50.479066 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 01 19:12:50.479066 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 01 19:12:50.479066 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 01 19:12:50.479066 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 01 19:12:50.479066 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 01 19:12:50.479066 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 01 19:12:50.479066 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 01 19:12:50.479066 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 01 19:12:50.479066 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 01 19:12:50.479066 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Nov 01 19:12:50.479066 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 773, in create Nov 01 19:12:50.479066 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi self._process_networks_for_create( Nov 01 19:12:50.479066 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 547, in _process_networks_for_create Nov 01 19:12:50.479066 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi requested_networks = self._get_requested_networks( Nov 01 19:12:50.479066 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 447, in _get_requested_networks Nov 01 19:12:50.479066 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi self._validate_network_id( Nov 01 19:12:50.479066 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 396, in _validate_network_id Nov 01 19:12:50.479066 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Nov 01 19:12:50.479066 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Nov 01 19:12:50.479066 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:12:50.479066 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:12:50.479066 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:12:50.483092 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:12:50.483092 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:12:50.483092 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:12:50.483092 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 01 19:12:50.483092 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 01 19:12:50.483092 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Nov 01 19:12:50.483092 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:12:50.488504 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-1e068877-28eb-4827-bba6-76051c33663f tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Returning 400 to user: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) {{(pid=121402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 01 19:12:50.489786 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-1e068877-28eb-4827-bba6-76051c33663f tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 400 len: 123 microversion: 2.1 time: 0.056299 Nov 01 19:12:50.493136 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 2138/4324] 10.222.0.13 () {60 vars in 1147 bytes} [Tue Nov 1 19:12:50 2022] POST /compute/v2.1/servers => generated 123 bytes in 60 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 01 19:12:50.582084 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-a9694785-7e1a-4c4b-9c8c-764de1deef61 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:12:50.582721 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-a9694785-7e1a-4c4b-9c8c-764de1deef61 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] [instance: b27eaab4-a751-47fb-acdb-db7c99b06a5f] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:12:50.615513 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-a9694785-7e1a-4c4b-9c8c-764de1deef61 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:12:50.616061 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-a9694785-7e1a-4c4b-9c8c-764de1deef61 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:12:50.616511 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-a9694785-7e1a-4c4b-9c8c-764de1deef61 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:12:50.617265 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-a9694785-7e1a-4c4b-9c8c-764de1deef61 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:12:50.622984 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-a9694785-7e1a-4c4b-9c8c-764de1deef61 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:12:50.624184 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-a9694785-7e1a-4c4b-9c8c-764de1deef61 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:12:50.956835 n-d-863052-2 devstack@n-api.service[121403]: DEBUG dbcounter [-] [121403] Writing DB stats nova_cell0:SELECT=2 {{(pid=121403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 19:12:51.045374 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-a9694785-7e1a-4c4b-9c8c-764de1deef61 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc5c19b930543f5a5091922a9859813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ecdc83933544a899117531a960027a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:12:51.062228 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-a9694785-7e1a-4c4b-9c8c-764de1deef61 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] 10.222.0.13 "GET /compute/v2.1/servers/b27eaab4-a751-47fb-acdb-db7c99b06a5f" status: 200 len: 1506 microversion: 2.1 time: 0.563775 Nov 01 19:12:51.063410 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 2139/4325] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:12:50 2022] GET /compute/v2.1/servers/b27eaab4-a751-47fb-acdb-db7c99b06a5f => generated 1506 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:12:51.075895 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-8eeae8eb-cd4d-410e-b735-14438205e2bf tempest-InstanceActionsV221TestJSON-1016349810 tempest-InstanceActionsV221TestJSON-1016349810-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:12:51.077349 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-8eeae8eb-cd4d-410e-b735-14438205e2bf tempest-InstanceActionsV221TestJSON-1016349810 tempest-InstanceActionsV221TestJSON-1016349810-project] [instance: aa7aa9c6-8a88-4948-a623-be7e64e73b5f] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:12:51.095358 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-8eeae8eb-cd4d-410e-b735-14438205e2bf tempest-InstanceActionsV221TestJSON-1016349810 tempest-InstanceActionsV221TestJSON-1016349810-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:12:51.096062 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-8eeae8eb-cd4d-410e-b735-14438205e2bf tempest-InstanceActionsV221TestJSON-1016349810 tempest-InstanceActionsV221TestJSON-1016349810-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:12:51.097020 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-8eeae8eb-cd4d-410e-b735-14438205e2bf tempest-InstanceActionsV221TestJSON-1016349810 tempest-InstanceActionsV221TestJSON-1016349810-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:12:51.105200 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-8eeae8eb-cd4d-410e-b735-14438205e2bf tempest-InstanceActionsV221TestJSON-1016349810 tempest-InstanceActionsV221TestJSON-1016349810-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:12:51.112503 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-8eeae8eb-cd4d-410e-b735-14438205e2bf tempest-InstanceActionsV221TestJSON-1016349810 tempest-InstanceActionsV221TestJSON-1016349810-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:12:51.113833 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-8eeae8eb-cd4d-410e-b735-14438205e2bf tempest-InstanceActionsV221TestJSON-1016349810 tempest-InstanceActionsV221TestJSON-1016349810-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:12:51.398084 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-8eeae8eb-cd4d-410e-b735-14438205e2bf tempest-InstanceActionsV221TestJSON-1016349810 tempest-InstanceActionsV221TestJSON-1016349810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '060d1fb6604f4096b650cf40060db86a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c29ec5eebf84c198c11bae29e3df2d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:12:51.417940 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-8eeae8eb-cd4d-410e-b735-14438205e2bf tempest-InstanceActionsV221TestJSON-1016349810 tempest-InstanceActionsV221TestJSON-1016349810-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '060d1fb6604f4096b650cf40060db86a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c29ec5eebf84c198c11bae29e3df2d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:12:51.421838 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-8eeae8eb-cd4d-410e-b735-14438205e2bf tempest-InstanceActionsV221TestJSON-1016349810 tempest-InstanceActionsV221TestJSON-1016349810-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '060d1fb6604f4096b650cf40060db86a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c29ec5eebf84c198c11bae29e3df2d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:12:51.425640 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-8eeae8eb-cd4d-410e-b735-14438205e2bf tempest-InstanceActionsV221TestJSON-1016349810 tempest-InstanceActionsV221TestJSON-1016349810-project] 10.222.0.13 "GET /compute/v2.1/servers/aa7aa9c6-8a88-4948-a623-be7e64e73b5f" status: 200 len: 1358 microversion: 2.21 time: 0.360407 Nov 01 19:12:51.428694 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 2140/4326] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 19:12:51 2022] GET /compute/v2.1/servers/aa7aa9c6-8a88-4948-a623-be7e64e73b5f => generated 1358 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 19:12:51.450661 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-6f8cc7e9-07f0-4891-9eb3-6417d53f463d tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:12:51.453767 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-6f8cc7e9-07f0-4891-9eb3-6417d53f463d tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] [instance: b27eaab4-a751-47fb-acdb-db7c99b06a5f] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:12:51.473731 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-6f8cc7e9-07f0-4891-9eb3-6417d53f463d tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:12:51.474517 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-6f8cc7e9-07f0-4891-9eb3-6417d53f463d tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:12:51.475120 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-6f8cc7e9-07f0-4891-9eb3-6417d53f463d tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:12:51.475999 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-6f8cc7e9-07f0-4891-9eb3-6417d53f463d tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:12:51.476634 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-6f8cc7e9-07f0-4891-9eb3-6417d53f463d tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:12:51.477211 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-6f8cc7e9-07f0-4891-9eb3-6417d53f463d tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:12:51.844014 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-6f8cc7e9-07f0-4891-9eb3-6417d53f463d tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc5c19b930543f5a5091922a9859813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ecdc83933544a899117531a960027a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:12:51.858673 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-6f8cc7e9-07f0-4891-9eb3-6417d53f463d tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] 10.222.0.13 "GET /compute/v2.1/servers/b27eaab4-a751-47fb-acdb-db7c99b06a5f" status: 200 len: 1506 microversion: 2.1 time: 0.426276 Nov 01 19:12:51.862947 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 2141/4327] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:12:51 2022] GET /compute/v2.1/servers/b27eaab4-a751-47fb-acdb-db7c99b06a5f => generated 1506 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:12:51.876789 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-18595d12-8be4-43c4-b1f2-db8c46876d92 tempest-ServerPasswordTestJSON-1534707503 tempest-ServerPasswordTestJSON-1534707503-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:12:51.877415 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-18595d12-8be4-43c4-b1f2-db8c46876d92 tempest-ServerPasswordTestJSON-1534707503 tempest-ServerPasswordTestJSON-1534707503-project] [instance: 3463bb31-5f34-4b89-8b40-af83df5c7635] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:12:51.899496 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-18595d12-8be4-43c4-b1f2-db8c46876d92 tempest-ServerPasswordTestJSON-1534707503 tempest-ServerPasswordTestJSON-1534707503-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:12:51.900004 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-18595d12-8be4-43c4-b1f2-db8c46876d92 tempest-ServerPasswordTestJSON-1534707503 tempest-ServerPasswordTestJSON-1534707503-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:12:51.900607 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-18595d12-8be4-43c4-b1f2-db8c46876d92 tempest-ServerPasswordTestJSON-1534707503 tempest-ServerPasswordTestJSON-1534707503-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:12:51.901334 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-18595d12-8be4-43c4-b1f2-db8c46876d92 tempest-ServerPasswordTestJSON-1534707503 tempest-ServerPasswordTestJSON-1534707503-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:12:51.901795 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-18595d12-8be4-43c4-b1f2-db8c46876d92 tempest-ServerPasswordTestJSON-1534707503 tempest-ServerPasswordTestJSON-1534707503-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:12:51.902222 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-18595d12-8be4-43c4-b1f2-db8c46876d92 tempest-ServerPasswordTestJSON-1534707503 tempest-ServerPasswordTestJSON-1534707503-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:12:51.938663 n-d-863052-2 devstack@n-api.service[121402]: DEBUG dbcounter [-] [121402] Writing DB stats nova_cell1:SELECT=100 {{(pid=121402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 19:12:52.106595 n-d-863052-2 devstack@n-api.service[121403]: DEBUG dbcounter [-] [121403] Writing DB stats nova_cell0:SELECT=10 {{(pid=121403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 19:12:52.324921 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-18595d12-8be4-43c4-b1f2-db8c46876d92 tempest-ServerPasswordTestJSON-1534707503 tempest-ServerPasswordTestJSON-1534707503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '969cec09484942aebbab6c0f021b7067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9871416ead87433589b8f54783b023b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:12:52.342144 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-18595d12-8be4-43c4-b1f2-db8c46876d92 tempest-ServerPasswordTestJSON-1534707503 tempest-ServerPasswordTestJSON-1534707503-project] 10.222.0.13 "GET /compute/v2.1/servers/3463bb31-5f34-4b89-8b40-af83df5c7635" status: 200 len: 1316 microversion: 2.1 time: 0.475295 Nov 01 19:12:52.345100 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 2142/4328] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:12:51 2022] GET /compute/v2.1/servers/3463bb31-5f34-4b89-8b40-af83df5c7635 => generated 1316 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:12:52.353722 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-0157ea4c-6f14-465a-aaf2-61adb16e8478 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-981099874", "imageRef": "2d4a0047-1b9e-445f-8af8-1b5c9d93e881", "flavorRef": "452", "key_name": "tempest-key-2047615020", "networks": [{"uuid": "f2fc603f-a5ab-4120-939f-124d49e1f7c1"}]}} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:12:52.427807 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.network.neutron [None req-0157ea4c-6f14-465a-aaf2-61adb16e8478 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] validate_networks() for [('f2fc603f-a5ab-4120-939f-124d49e1f7c1', None, None, None, None, None)] {{(pid=121402) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 01 19:12:52.951408 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.wsgi [None req-0157ea4c-6f14-465a-aaf2-61adb16e8478 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] HTTP exception thrown: Invalid key_name provided. Nov 01 19:12:52.953897 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-0157ea4c-6f14-465a-aaf2-61adb16e8478 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Request method failure captured: Nov 01 19:12:52.953897 n-d-863052-2 devstack@n-api.service[121402]: request: POST /compute/v2.1/servers HTTP/1.1 Nov 01 19:12:52.953897 n-d-863052-2 devstack@n-api.service[121402]: Accept: application/json Nov 01 19:12:52.953897 n-d-863052-2 devstack@n-api.service[121402]: Accept-Encoding: identity Nov 01 19:12:52.953897 n-d-863052-2 devstack@n-api.service[121402]: Connection: close Nov 01 19:12:52.953897 n-d-863052-2 devstack@n-api.service[121402]: Content-Length: 246 Nov 01 19:12:52.953897 n-d-863052-2 devstack@n-api.service[121402]: Content-Type: application/json Nov 01 19:12:52.953897 n-d-863052-2 devstack@n-api.service[121402]: Host: 10.222.0.13 Nov 01 19:12:52.953897 n-d-863052-2 devstack@n-api.service[121402]: Openstack-System-Scope: None Nov 01 19:12:52.953897 n-d-863052-2 devstack@n-api.service[121402]: User-Agent: python-urllib3/1.26.12 Nov 01 19:12:52.953897 n-d-863052-2 devstack@n-api.service[121402]: X-Auth-Token: gAAAAABjYW9YFTR7hO-vK03S-3HbvOtG2z3_fji2KJH39vNHENu4xIKneeHYviQiPj9ERGiA3aZIA7DvAYzczgSZ5-vK782IQ7CYnUFXvn9Aqt1AbunNMYxhes9BKzhvODzqwzqiQq89wgC4nbpZ9jJWFWMOC4z9bcW4UMi_ylwdZFjmhWfD49s Nov 01 19:12:52.953897 n-d-863052-2 devstack@n-api.service[121402]: X-Domain-Id: None Nov 01 19:12:52.953897 n-d-863052-2 devstack@n-api.service[121402]: X-Domain-Name: None Nov 01 19:12:52.953897 n-d-863052-2 devstack@n-api.service[121402]: X-Identity-Status: Confirmed Nov 01 19:12:52.953897 n-d-863052-2 devstack@n-api.service[121402]: X-Is-Admin-Project: True Nov 01 19:12:52.953897 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Domain-Id: default Nov 01 19:12:52.953897 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Domain-Name: Default Nov 01 19:12:52.953897 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Id: 9ecdc83933544a899117531a960027a7 Nov 01 19:12:52.953897 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Name: tempest-ServersNegativeTestJSON-638944671 Nov 01 19:12:52.953897 n-d-863052-2 devstack@n-api.service[121402]: X-Role: member,reader Nov 01 19:12:52.953897 n-d-863052-2 devstack@n-api.service[121402]: X-Roles: member,reader Nov 01 19:12:52.953897 n-d-863052-2 devstack@n-api.service[121402]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/9ecdc83933544a899117531a960027a7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/9ecdc83933544a899117531a960027a7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_9ecdc83933544a899117531a960027a7", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/9ecdc83933544a899117531a960027a7"}]}] Nov 01 19:12:52.953897 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant: tempest-ServersNegativeTestJSON-638944671 Nov 01 19:12:52.953897 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant-Id: 9ecdc83933544a899117531a960027a7 Nov 01 19:12:52.953897 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant-Name: tempest-ServersNegativeTestJSON-638944671 Nov 01 19:12:52.953897 n-d-863052-2 devstack@n-api.service[121402]: X-User: tempest-ServersNegativeTestJSON-638944671-project Nov 01 19:12:52.953897 n-d-863052-2 devstack@n-api.service[121402]: X-User-Domain-Id: default Nov 01 19:12:52.953897 n-d-863052-2 devstack@n-api.service[121402]: X-User-Domain-Name: Default Nov 01 19:12:52.953897 n-d-863052-2 devstack@n-api.service[121402]: X-User-Id: 3fc5c19b930543f5a5091922a9859813 Nov 01 19:12:52.953897 n-d-863052-2 devstack@n-api.service[121402]: X-User-Name: tempest-ServersNegativeTestJSON-638944671-project Nov 01 19:12:52.953897 n-d-863052-2 devstack@n-api.service[121402]: Nov 01 19:12:52.953897 n-d-863052-2 devstack@n-api.service[121402]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-981099874", "imageRef": "2d4a0047-1b9e-445f-8af8-1b5c9d93e881", "flavorRef": "452", "key_name": "tempest-key-2047615020", "networks": [{"uuid": "f2fc603f-a5ab-4120-939f-124d49e1f7c1"}]}} Nov 01 19:12:52.953897 n-d-863052-2 devstack@n-api.service[121402]: method: > Nov 01 19:12:52.953897 n-d-863052-2 devstack@n-api.service[121402]: exception: Invalid key_name provided. Nov 01 19:12:52.953897 n-d-863052-2 devstack@n-api.service[121402]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-981099874', 'imageRef': '2d4a0047-1b9e-445f-8af8-1b5c9d93e881', 'flavorRef': '452', 'key_name': 'tempest-key-2047615020', 'networks': [{'uuid': 'f2fc603f-a5ab-4120-939f-124d49e1f7c1'}]}}} Nov 01 19:12:52.953897 n-d-863052-2 devstack@n-api.service[121402]: {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 01 19:12:52.953897 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:12:52.953897 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Nov 01 19:12:52.953897 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Nov 01 19:12:52.953897 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Nov 01 19:12:52.953897 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return self._create_instance( Nov 01 19:12:52.953897 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Nov 01 19:12:52.953897 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Nov 01 19:12:52.953897 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1089, in _validate_and_build_base_options Nov 01 19:12:52.953897 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi key_pair = objects.KeyPair.get_by_name(context, Nov 01 19:12:52.953897 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 01 19:12:52.953897 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 01 19:12:52.953897 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 144, in get_by_name Nov 01 19:12:52.953897 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi db_keypair = cls._get_from_db(context, user_id, name) Nov 01 19:12:52.953897 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 126, in _get_from_db Nov 01 19:12:52.953897 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return _get_from_db(context, user_id, name=name) Nov 01 19:12:52.953897 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Nov 01 19:12:52.953897 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Nov 01 19:12:52.953897 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 40, in _get_from_db Nov 01 19:12:52.953897 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise exception.KeypairNotFound(user_id=user_id, name=name) Nov 01 19:12:52.953897 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi nova.exception.KeypairNotFound: Keypair tempest-key-2047615020 not found for user 3fc5c19b930543f5a5091922a9859813 Nov 01 19:12:52.953897 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:12:52.953897 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:12:52.953897 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:12:52.953897 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:12:52.953897 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:12:52.957357 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:12:52.957357 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 01 19:12:52.957357 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 01 19:12:52.957357 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 01 19:12:52.957357 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 01 19:12:52.957357 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 01 19:12:52.957357 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 01 19:12:52.957357 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 01 19:12:52.957357 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 01 19:12:52.957357 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 01 19:12:52.957357 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 01 19:12:52.957357 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Nov 01 19:12:52.957357 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 807, in create Nov 01 19:12:52.957357 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Nov 01 19:12:52.957357 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid key_name provided. Nov 01 19:12:52.957357 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:12:52.957357 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:12:52.957357 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:12:52.957357 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:12:52.957357 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:12:52.957357 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:12:52.957357 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 01 19:12:52.957357 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 01 19:12:52.957357 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid key_name provided. Nov 01 19:12:52.957357 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:12:52.957357 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-0157ea4c-6f14-465a-aaf2-61adb16e8478 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Returning 400 to user: Invalid key_name provided. {{(pid=121402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 01 19:12:52.957357 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-0157ea4c-6f14-465a-aaf2-61adb16e8478 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 400 len: 70 microversion: 2.1 time: 0.609076 Nov 01 19:12:52.960156 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 2143/4329] 10.222.0.13 () {60 vars in 1147 bytes} [Tue Nov 1 19:12:52 2022] POST /compute/v2.1/servers => generated 70 bytes in 614 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Nov 01 19:12:52.966229 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-05a3a52d-48e3-4cf9-a152-786dbe5b4b32 tempest-InstanceActionsV221TestJSON-1016349810 tempest-InstanceActionsV221TestJSON-1016349810-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:12:52.966874 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-05a3a52d-48e3-4cf9-a152-786dbe5b4b32 tempest-InstanceActionsV221TestJSON-1016349810 tempest-InstanceActionsV221TestJSON-1016349810-project] [instance: aa7aa9c6-8a88-4948-a623-be7e64e73b5f] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:12:52.997447 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-05a3a52d-48e3-4cf9-a152-786dbe5b4b32 tempest-InstanceActionsV221TestJSON-1016349810 tempest-InstanceActionsV221TestJSON-1016349810-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:12:52.997981 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-05a3a52d-48e3-4cf9-a152-786dbe5b4b32 tempest-InstanceActionsV221TestJSON-1016349810 tempest-InstanceActionsV221TestJSON-1016349810-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:12:52.998437 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-05a3a52d-48e3-4cf9-a152-786dbe5b4b32 tempest-InstanceActionsV221TestJSON-1016349810 tempest-InstanceActionsV221TestJSON-1016349810-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:12:52.999172 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-05a3a52d-48e3-4cf9-a152-786dbe5b4b32 tempest-InstanceActionsV221TestJSON-1016349810 tempest-InstanceActionsV221TestJSON-1016349810-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:12:52.999692 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-05a3a52d-48e3-4cf9-a152-786dbe5b4b32 tempest-InstanceActionsV221TestJSON-1016349810 tempest-InstanceActionsV221TestJSON-1016349810-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:12:53.000133 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-05a3a52d-48e3-4cf9-a152-786dbe5b4b32 tempest-InstanceActionsV221TestJSON-1016349810 tempest-InstanceActionsV221TestJSON-1016349810-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:12:53.392317 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-05a3a52d-48e3-4cf9-a152-786dbe5b4b32 tempest-InstanceActionsV221TestJSON-1016349810 tempest-InstanceActionsV221TestJSON-1016349810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '060d1fb6604f4096b650cf40060db86a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c29ec5eebf84c198c11bae29e3df2d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:12:53.408713 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-05a3a52d-48e3-4cf9-a152-786dbe5b4b32 tempest-InstanceActionsV221TestJSON-1016349810 tempest-InstanceActionsV221TestJSON-1016349810-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '060d1fb6604f4096b650cf40060db86a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c29ec5eebf84c198c11bae29e3df2d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:12:53.416097 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-05a3a52d-48e3-4cf9-a152-786dbe5b4b32 tempest-InstanceActionsV221TestJSON-1016349810 tempest-InstanceActionsV221TestJSON-1016349810-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '060d1fb6604f4096b650cf40060db86a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c29ec5eebf84c198c11bae29e3df2d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:12:53.421882 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-05a3a52d-48e3-4cf9-a152-786dbe5b4b32 tempest-InstanceActionsV221TestJSON-1016349810 tempest-InstanceActionsV221TestJSON-1016349810-project] 10.222.0.13 "GET /compute/v2.1/servers/aa7aa9c6-8a88-4948-a623-be7e64e73b5f" status: 200 len: 1358 microversion: 2.21 time: 0.459610 Nov 01 19:12:53.447916 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 2144/4330] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 19:12:52 2022] GET /compute/v2.1/servers/aa7aa9c6-8a88-4948-a623-be7e64e73b5f => generated 1358 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 19:12:53.458569 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-2a97a96d-1aae-4245-83a2-4bd7495968d4 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:12:53.459219 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-2a97a96d-1aae-4245-83a2-4bd7495968d4 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] [instance: b27eaab4-a751-47fb-acdb-db7c99b06a5f] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:12:53.490048 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2a97a96d-1aae-4245-83a2-4bd7495968d4 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:12:53.491857 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2a97a96d-1aae-4245-83a2-4bd7495968d4 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:12:53.494245 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2a97a96d-1aae-4245-83a2-4bd7495968d4 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:12:53.495731 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2a97a96d-1aae-4245-83a2-4bd7495968d4 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:12:53.497384 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2a97a96d-1aae-4245-83a2-4bd7495968d4 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:12:53.500536 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2a97a96d-1aae-4245-83a2-4bd7495968d4 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:12:53.901299 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-2a97a96d-1aae-4245-83a2-4bd7495968d4 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc5c19b930543f5a5091922a9859813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ecdc83933544a899117531a960027a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:12:53.909576 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-2a97a96d-1aae-4245-83a2-4bd7495968d4 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] 10.222.0.13 "GET /compute/v2.1/servers/b27eaab4-a751-47fb-acdb-db7c99b06a5f" status: 200 len: 1506 microversion: 2.1 time: 0.455018 Nov 01 19:12:53.915612 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 2145/4331] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:12:53 2022] GET /compute/v2.1/servers/b27eaab4-a751-47fb-acdb-db7c99b06a5f => generated 1506 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:12:53.927452 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-1a4a8a5f-3685-4a88-8ae5-f61e93d3db61 tempest-ServerPasswordTestJSON-1534707503 tempest-ServerPasswordTestJSON-1534707503-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:12:53.929442 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-1a4a8a5f-3685-4a88-8ae5-f61e93d3db61 tempest-ServerPasswordTestJSON-1534707503 tempest-ServerPasswordTestJSON-1534707503-project] [instance: 3463bb31-5f34-4b89-8b40-af83df5c7635] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:12:53.963925 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-1a4a8a5f-3685-4a88-8ae5-f61e93d3db61 tempest-ServerPasswordTestJSON-1534707503 tempest-ServerPasswordTestJSON-1534707503-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:12:53.966334 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-1a4a8a5f-3685-4a88-8ae5-f61e93d3db61 tempest-ServerPasswordTestJSON-1534707503 tempest-ServerPasswordTestJSON-1534707503-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:12:53.969202 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-1a4a8a5f-3685-4a88-8ae5-f61e93d3db61 tempest-ServerPasswordTestJSON-1534707503 tempest-ServerPasswordTestJSON-1534707503-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:12:53.970209 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-1a4a8a5f-3685-4a88-8ae5-f61e93d3db61 tempest-ServerPasswordTestJSON-1534707503 tempest-ServerPasswordTestJSON-1534707503-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:12:53.975203 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-1a4a8a5f-3685-4a88-8ae5-f61e93d3db61 tempest-ServerPasswordTestJSON-1534707503 tempest-ServerPasswordTestJSON-1534707503-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:12:53.975681 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-1a4a8a5f-3685-4a88-8ae5-f61e93d3db61 tempest-ServerPasswordTestJSON-1534707503 tempest-ServerPasswordTestJSON-1534707503-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:12:54.434130 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-1a4a8a5f-3685-4a88-8ae5-f61e93d3db61 tempest-ServerPasswordTestJSON-1534707503 tempest-ServerPasswordTestJSON-1534707503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '969cec09484942aebbab6c0f021b7067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9871416ead87433589b8f54783b023b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:12:54.445829 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-1a4a8a5f-3685-4a88-8ae5-f61e93d3db61 tempest-ServerPasswordTestJSON-1534707503 tempest-ServerPasswordTestJSON-1534707503-project] 10.222.0.13 "GET /compute/v2.1/servers/3463bb31-5f34-4b89-8b40-af83df5c7635" status: 200 len: 1316 microversion: 2.1 time: 0.524783 Nov 01 19:12:54.446733 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 2146/4332] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:12:53 2022] GET /compute/v2.1/servers/3463bb31-5f34-4b89-8b40-af83df5c7635 => generated 1316 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:12:54.457899 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-200fda74-22f9-4292-95d7-6901fc1f23d9 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:12:54.460841 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-200fda74-22f9-4292-95d7-6901fc1f23d9 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] [instance: b27eaab4-a751-47fb-acdb-db7c99b06a5f] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:12:54.477220 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-200fda74-22f9-4292-95d7-6901fc1f23d9 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:12:54.482376 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-200fda74-22f9-4292-95d7-6901fc1f23d9 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:12:54.482983 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-200fda74-22f9-4292-95d7-6901fc1f23d9 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:12:54.487261 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-200fda74-22f9-4292-95d7-6901fc1f23d9 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:12:54.489161 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-200fda74-22f9-4292-95d7-6901fc1f23d9 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:12:54.497735 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-200fda74-22f9-4292-95d7-6901fc1f23d9 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:12:54.598639 n-d-863052-2 devstack@n-api.service[121403]: DEBUG dbcounter [-] [121403] Writing DB stats nova_api:SELECT=34,nova_api:INSERT=3 {{(pid=121403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 19:12:55.765883 n-d-863052-2 devstack@n-api.service[121403]: DEBUG dbcounter [-] [121403] Writing DB stats nova_cell1:SELECT=23 {{(pid=121403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 19:12:55.876808 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-200fda74-22f9-4292-95d7-6901fc1f23d9 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc5c19b930543f5a5091922a9859813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ecdc83933544a899117531a960027a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:12:55.890526 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-200fda74-22f9-4292-95d7-6901fc1f23d9 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] 10.222.0.13 "GET /compute/v2.1/servers/b27eaab4-a751-47fb-acdb-db7c99b06a5f" status: 200 len: 1506 microversion: 2.1 time: 1.439551 Nov 01 19:12:55.892522 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 2147/4333] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:12:54 2022] GET /compute/v2.1/servers/b27eaab4-a751-47fb-acdb-db7c99b06a5f => generated 1506 bytes in 1442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:12:55.899278 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-051d20c5-2d31-46f4-915a-228d328036d3 tempest-InstanceActionsV221TestJSON-1016349810 tempest-InstanceActionsV221TestJSON-1016349810-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:12:55.899895 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-051d20c5-2d31-46f4-915a-228d328036d3 tempest-InstanceActionsV221TestJSON-1016349810 tempest-InstanceActionsV221TestJSON-1016349810-project] [instance: aa7aa9c6-8a88-4948-a623-be7e64e73b5f] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:12:55.928412 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-051d20c5-2d31-46f4-915a-228d328036d3 tempest-InstanceActionsV221TestJSON-1016349810 tempest-InstanceActionsV221TestJSON-1016349810-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:12:55.940063 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-051d20c5-2d31-46f4-915a-228d328036d3 tempest-InstanceActionsV221TestJSON-1016349810 tempest-InstanceActionsV221TestJSON-1016349810-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:12:55.940614 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-051d20c5-2d31-46f4-915a-228d328036d3 tempest-InstanceActionsV221TestJSON-1016349810 tempest-InstanceActionsV221TestJSON-1016349810-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:12:55.941372 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-051d20c5-2d31-46f4-915a-228d328036d3 tempest-InstanceActionsV221TestJSON-1016349810 tempest-InstanceActionsV221TestJSON-1016349810-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:12:55.941861 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-051d20c5-2d31-46f4-915a-228d328036d3 tempest-InstanceActionsV221TestJSON-1016349810 tempest-InstanceActionsV221TestJSON-1016349810-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:12:55.952823 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-051d20c5-2d31-46f4-915a-228d328036d3 tempest-InstanceActionsV221TestJSON-1016349810 tempest-InstanceActionsV221TestJSON-1016349810-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:12:56.257522 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-051d20c5-2d31-46f4-915a-228d328036d3 tempest-InstanceActionsV221TestJSON-1016349810 tempest-InstanceActionsV221TestJSON-1016349810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '060d1fb6604f4096b650cf40060db86a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c29ec5eebf84c198c11bae29e3df2d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:12:56.266894 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-051d20c5-2d31-46f4-915a-228d328036d3 tempest-InstanceActionsV221TestJSON-1016349810 tempest-InstanceActionsV221TestJSON-1016349810-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '060d1fb6604f4096b650cf40060db86a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c29ec5eebf84c198c11bae29e3df2d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:12:56.275383 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-051d20c5-2d31-46f4-915a-228d328036d3 tempest-InstanceActionsV221TestJSON-1016349810 tempest-InstanceActionsV221TestJSON-1016349810-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '060d1fb6604f4096b650cf40060db86a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c29ec5eebf84c198c11bae29e3df2d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:12:56.283156 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-051d20c5-2d31-46f4-915a-228d328036d3 tempest-InstanceActionsV221TestJSON-1016349810 tempest-InstanceActionsV221TestJSON-1016349810-project] 10.222.0.13 "GET /compute/v2.1/servers/aa7aa9c6-8a88-4948-a623-be7e64e73b5f" status: 200 len: 1358 microversion: 2.21 time: 0.389504 Nov 01 19:12:56.313876 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 2148/4334] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 19:12:55 2022] GET /compute/v2.1/servers/aa7aa9c6-8a88-4948-a623-be7e64e73b5f => generated 1358 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 19:12:56.329506 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-11981cd2-c362-40ea-817e-84bac022b7a6 tempest-ServerPasswordTestJSON-1534707503 tempest-ServerPasswordTestJSON-1534707503-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:12:56.330652 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-11981cd2-c362-40ea-817e-84bac022b7a6 tempest-ServerPasswordTestJSON-1534707503 tempest-ServerPasswordTestJSON-1534707503-project] [instance: 3463bb31-5f34-4b89-8b40-af83df5c7635] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:12:56.339390 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-11981cd2-c362-40ea-817e-84bac022b7a6 tempest-ServerPasswordTestJSON-1534707503 tempest-ServerPasswordTestJSON-1534707503-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:12:56.347480 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-11981cd2-c362-40ea-817e-84bac022b7a6 tempest-ServerPasswordTestJSON-1534707503 tempest-ServerPasswordTestJSON-1534707503-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:12:56.347963 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-11981cd2-c362-40ea-817e-84bac022b7a6 tempest-ServerPasswordTestJSON-1534707503 tempest-ServerPasswordTestJSON-1534707503-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:12:56.353514 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-11981cd2-c362-40ea-817e-84bac022b7a6 tempest-ServerPasswordTestJSON-1534707503 tempest-ServerPasswordTestJSON-1534707503-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:12:56.354941 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-11981cd2-c362-40ea-817e-84bac022b7a6 tempest-ServerPasswordTestJSON-1534707503 tempest-ServerPasswordTestJSON-1534707503-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:12:56.356375 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-11981cd2-c362-40ea-817e-84bac022b7a6 tempest-ServerPasswordTestJSON-1534707503 tempest-ServerPasswordTestJSON-1534707503-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:12:56.698694 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-11981cd2-c362-40ea-817e-84bac022b7a6 tempest-ServerPasswordTestJSON-1534707503 tempest-ServerPasswordTestJSON-1534707503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '969cec09484942aebbab6c0f021b7067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9871416ead87433589b8f54783b023b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:12:56.708344 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-11981cd2-c362-40ea-817e-84bac022b7a6 tempest-ServerPasswordTestJSON-1534707503 tempest-ServerPasswordTestJSON-1534707503-project] 10.222.0.13 "GET /compute/v2.1/servers/3463bb31-5f34-4b89-8b40-af83df5c7635" status: 200 len: 1316 microversion: 2.1 time: 0.392891 Nov 01 19:12:56.736057 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 2149/4335] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:12:56 2022] GET /compute/v2.1/servers/3463bb31-5f34-4b89-8b40-af83df5c7635 => generated 1316 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:12:56.757453 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-aacf65ae-1fc0-4407-b74a-7a7be58a788c tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1122387642", "imageRef": "2d4a0047-1b9e-445f-8af8-1b5c9d93e881", "flavorRef": "452", "security_groups": [{"name": "does_not_exist"}], "networks": [{"uuid": "f2fc603f-a5ab-4120-939f-124d49e1f7c1"}]}} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:12:56.930704 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.network.security_group_api [None req-aacf65ae-1fc0-4407-b74a-7a7be58a788c tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Neutron security group does_not_exist not found {{(pid=121402) validate_name /opt/stack/nova/nova/network/security_group_api.py:74}} Nov 01 19:12:56.931357 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.wsgi [None req-aacf65ae-1fc0-4407-b74a-7a7be58a788c tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] HTTP exception thrown: Unable to find security_group with name or id 'does_not_exist' Nov 01 19:12:56.940117 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-aacf65ae-1fc0-4407-b74a-7a7be58a788c tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Request method failure captured: Nov 01 19:12:56.940117 n-d-863052-2 devstack@n-api.service[121402]: request: POST /compute/v2.1/servers HTTP/1.1 Nov 01 19:12:56.940117 n-d-863052-2 devstack@n-api.service[121402]: Accept: application/json Nov 01 19:12:56.940117 n-d-863052-2 devstack@n-api.service[121402]: Accept-Encoding: identity Nov 01 19:12:56.940117 n-d-863052-2 devstack@n-api.service[121402]: Connection: close Nov 01 19:12:56.940117 n-d-863052-2 devstack@n-api.service[121402]: Content-Length: 258 Nov 01 19:12:56.940117 n-d-863052-2 devstack@n-api.service[121402]: Content-Type: application/json Nov 01 19:12:56.940117 n-d-863052-2 devstack@n-api.service[121402]: Host: 10.222.0.13 Nov 01 19:12:56.940117 n-d-863052-2 devstack@n-api.service[121402]: Openstack-System-Scope: None Nov 01 19:12:56.940117 n-d-863052-2 devstack@n-api.service[121402]: User-Agent: python-urllib3/1.26.12 Nov 01 19:12:56.940117 n-d-863052-2 devstack@n-api.service[121402]: X-Auth-Token: gAAAAABjYW9YFTR7hO-vK03S-3HbvOtG2z3_fji2KJH39vNHENu4xIKneeHYviQiPj9ERGiA3aZIA7DvAYzczgSZ5-vK782IQ7CYnUFXvn9Aqt1AbunNMYxhes9BKzhvODzqwzqiQq89wgC4nbpZ9jJWFWMOC4z9bcW4UMi_ylwdZFjmhWfD49s Nov 01 19:12:56.940117 n-d-863052-2 devstack@n-api.service[121402]: X-Domain-Id: None Nov 01 19:12:56.940117 n-d-863052-2 devstack@n-api.service[121402]: X-Domain-Name: None Nov 01 19:12:56.940117 n-d-863052-2 devstack@n-api.service[121402]: X-Identity-Status: Confirmed Nov 01 19:12:56.940117 n-d-863052-2 devstack@n-api.service[121402]: X-Is-Admin-Project: True Nov 01 19:12:56.940117 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Domain-Id: default Nov 01 19:12:56.940117 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Domain-Name: Default Nov 01 19:12:56.940117 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Id: 9ecdc83933544a899117531a960027a7 Nov 01 19:12:56.940117 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Name: tempest-ServersNegativeTestJSON-638944671 Nov 01 19:12:56.940117 n-d-863052-2 devstack@n-api.service[121402]: X-Role: member,reader Nov 01 19:12:56.940117 n-d-863052-2 devstack@n-api.service[121402]: X-Roles: member,reader Nov 01 19:12:56.940117 n-d-863052-2 devstack@n-api.service[121402]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/9ecdc83933544a899117531a960027a7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/9ecdc83933544a899117531a960027a7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_9ecdc83933544a899117531a960027a7", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/9ecdc83933544a899117531a960027a7"}]}] Nov 01 19:12:56.940117 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant: tempest-ServersNegativeTestJSON-638944671 Nov 01 19:12:56.940117 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant-Id: 9ecdc83933544a899117531a960027a7 Nov 01 19:12:56.940117 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant-Name: tempest-ServersNegativeTestJSON-638944671 Nov 01 19:12:56.940117 n-d-863052-2 devstack@n-api.service[121402]: X-User: tempest-ServersNegativeTestJSON-638944671-project Nov 01 19:12:56.940117 n-d-863052-2 devstack@n-api.service[121402]: X-User-Domain-Id: default Nov 01 19:12:56.940117 n-d-863052-2 devstack@n-api.service[121402]: X-User-Domain-Name: Default Nov 01 19:12:56.940117 n-d-863052-2 devstack@n-api.service[121402]: X-User-Id: 3fc5c19b930543f5a5091922a9859813 Nov 01 19:12:56.940117 n-d-863052-2 devstack@n-api.service[121402]: X-User-Name: tempest-ServersNegativeTestJSON-638944671-project Nov 01 19:12:56.940117 n-d-863052-2 devstack@n-api.service[121402]: Nov 01 19:12:56.940117 n-d-863052-2 devstack@n-api.service[121402]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1122387642", "imageRef": "2d4a0047-1b9e-445f-8af8-1b5c9d93e881", "flavorRef": "452", "security_groups": [{"name": "does_not_exist"}], "networks": [{"uuid": "f2fc603f-a5ab-4120-939f-124d49e1f7c1"}]}} Nov 01 19:12:56.940117 n-d-863052-2 devstack@n-api.service[121402]: method: > Nov 01 19:12:56.940117 n-d-863052-2 devstack@n-api.service[121402]: exception: Unable to find security_group with name or id 'does_not_exist' Nov 01 19:12:56.940117 n-d-863052-2 devstack@n-api.service[121402]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1122387642', 'imageRef': '2d4a0047-1b9e-445f-8af8-1b5c9d93e881', 'flavorRef': '452', 'security_groups': [{'name': 'does_not_exist'}], 'networks': [{'uuid': 'f2fc603f-a5ab-4120-939f-124d49e1f7c1'}]}}} Nov 01 19:12:56.940117 n-d-863052-2 devstack@n-api.service[121402]: {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 01 19:12:56.940117 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:12:56.940117 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 476, in find_resource Nov 01 19:12:56.940117 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return self.find_resource_by_id(resource, name_or_id, Nov 01 19:12:56.940117 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 01 19:12:56.940117 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 01 19:12:56.940117 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 440, in find_resource_by_id Nov 01 19:12:56.940117 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound(message=not_found_message) Nov 01 19:12:56.940117 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with id 'does_not_exist' Nov 01 19:12:56.940117 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:12:56.940117 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:12:56.940117 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:12:56.940117 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:12:56.940117 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 480, in find_resource Nov 01 19:12:56.940117 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return self._find_resource_by_name( Nov 01 19:12:56.940117 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 01 19:12:56.940117 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 01 19:12:56.940117 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 469, in _find_resource_by_name Nov 01 19:12:56.940117 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound(message=not_found_message) Nov 01 19:12:56.940117 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with name 'does_not_exist' Nov 01 19:12:56.940117 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:12:56.940117 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:12:56.940117 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:12:56.940117 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:12:56.940117 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 68, in validate_name Nov 01 19:12:56.940117 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return neutronv20.find_resourceid_by_name_or_id( Nov 01 19:12:56.943495 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/neutron/v2_0/__init__.py", line 56, in find_resourceid_by_name_or_id Nov 01 19:12:56.943495 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return find_resource_by_name_or_id(client, resource, name_or_id, Nov 01 19:12:56.943495 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/neutron/v2_0/__init__.py", line 49, in find_resource_by_name_or_id Nov 01 19:12:56.943495 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return client.find_resource(resource, name_or_id, project_id, Nov 01 19:12:56.943495 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 01 19:12:56.943495 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 01 19:12:56.943495 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 488, in find_resource Nov 01 19:12:56.943495 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound( Nov 01 19:12:56.943495 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with name or id 'does_not_exist' Nov 01 19:12:56.943495 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:12:56.943495 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:12:56.943495 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:12:56.943495 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:12:56.943495 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Nov 01 19:12:56.943495 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Nov 01 19:12:56.943495 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Nov 01 19:12:56.943495 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return self._create_instance( Nov 01 19:12:56.943495 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Nov 01 19:12:56.943495 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Nov 01 19:12:56.943495 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1074, in _validate_and_build_base_options Nov 01 19:12:56.943495 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi security_groups = self._check_requested_secgroups( Nov 01 19:12:56.943495 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 521, in _check_requested_secgroups Nov 01 19:12:56.943495 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi secgroup_uuid = security_group_api.validate_name(context, secgroup) Nov 01 19:12:56.943495 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 75, in validate_name Nov 01 19:12:56.943495 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Nov 01 19:12:56.943495 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Unable to find security_group with name or id 'does_not_exist' Nov 01 19:12:56.943495 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:12:56.943495 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:12:56.943495 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:12:56.943495 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:12:56.943495 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:12:56.943495 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:12:56.943495 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 01 19:12:56.943495 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 01 19:12:56.943495 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 01 19:12:56.943495 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 01 19:12:56.943495 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 01 19:12:56.943495 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 01 19:12:56.943495 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 01 19:12:56.943495 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 01 19:12:56.943495 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 01 19:12:56.943495 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 01 19:12:56.943495 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Nov 01 19:12:56.943495 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Nov 01 19:12:56.943495 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Nov 01 19:12:56.943495 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Unable to find security_group with name or id 'does_not_exist' Nov 01 19:12:56.943495 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:12:56.943495 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:12:56.943495 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:12:56.943495 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:12:56.943495 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:12:56.943495 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:12:56.943495 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 01 19:12:56.943495 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 01 19:12:56.943495 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unable to find security_group with name or id 'does_not_exist' Nov 01 19:12:56.943495 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:12:56.943495 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-aacf65ae-1fc0-4407-b74a-7a7be58a788c tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Returning 400 to user: Unable to find security_group with name or id 'does_not_exist' {{(pid=121402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 01 19:12:56.950410 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-aacf65ae-1fc0-4407-b74a-7a7be58a788c tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 400 len: 106 microversion: 2.1 time: 0.203625 Nov 01 19:12:56.950410 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 2150/4336] 10.222.0.13 () {60 vars in 1147 bytes} [Tue Nov 1 19:12:56 2022] POST /compute/v2.1/servers => generated 106 bytes in 206 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 01 19:12:56.950410 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [req-bba2000e-a935-47a7-9a17-a1517084951b req-371027dc-f9f1-4914-9a99-b74ff19a046e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aa7aa9c6-8a88-4948-a623-be7e64e73b5f", "tag": "fb554c8f-139c-4a4c-8638-bbf99708790c"}]} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:12:56.971299 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-bba2000e-a935-47a7-9a17-a1517084951b req-371027dc-f9f1-4914-9a99-b74ff19a046e service nova] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:12:56.971791 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-bba2000e-a935-47a7-9a17-a1517084951b req-371027dc-f9f1-4914-9a99-b74ff19a046e service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:12:56.972220 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-bba2000e-a935-47a7-9a17-a1517084951b req-371027dc-f9f1-4914-9a99-b74ff19a046e service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:12:56.987712 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.compute.server_external_events [req-bba2000e-a935-47a7-9a17-a1517084951b req-371027dc-f9f1-4914-9a99-b74ff19a046e service nova] Creating event network-changed:fb554c8f-139c-4a4c-8638-bbf99708790c for instance aa7aa9c6-8a88-4948-a623-be7e64e73b5f on n-h2-863052-2 Nov 01 19:12:56.997307 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [req-bba2000e-a935-47a7-9a17-a1517084951b req-371027dc-f9f1-4914-9a99-b74ff19a046e service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053251 Nov 01 19:12:57.004134 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 2151/4337] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Nov 1 19:12:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:12:57.011645 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-90edb26e-2a14-419c-8a93-6589b5517a66 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:12:57.017496 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-90edb26e-2a14-419c-8a93-6589b5517a66 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] [instance: b27eaab4-a751-47fb-acdb-db7c99b06a5f] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:12:57.031648 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-90edb26e-2a14-419c-8a93-6589b5517a66 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:12:57.032371 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-90edb26e-2a14-419c-8a93-6589b5517a66 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:12:57.033181 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-90edb26e-2a14-419c-8a93-6589b5517a66 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:12:57.034317 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-90edb26e-2a14-419c-8a93-6589b5517a66 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:12:57.034961 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-90edb26e-2a14-419c-8a93-6589b5517a66 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:12:57.035538 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-90edb26e-2a14-419c-8a93-6589b5517a66 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:12:57.408756 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-90edb26e-2a14-419c-8a93-6589b5517a66 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc5c19b930543f5a5091922a9859813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ecdc83933544a899117531a960027a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:12:57.419963 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-90edb26e-2a14-419c-8a93-6589b5517a66 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] 10.222.0.13 "GET /compute/v2.1/servers/b27eaab4-a751-47fb-acdb-db7c99b06a5f" status: 200 len: 1506 microversion: 2.1 time: 0.412599 Nov 01 19:12:57.421133 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 2152/4338] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:12:57 2022] GET /compute/v2.1/servers/b27eaab4-a751-47fb-acdb-db7c99b06a5f => generated 1506 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:12:57.466013 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-6be91d62-eed6-4b70-a657-eba0d613a704 tempest-InstanceActionsV221TestJSON-1016349810 tempest-InstanceActionsV221TestJSON-1016349810-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:12:57.466918 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-6be91d62-eed6-4b70-a657-eba0d613a704 tempest-InstanceActionsV221TestJSON-1016349810 tempest-InstanceActionsV221TestJSON-1016349810-project] [instance: aa7aa9c6-8a88-4948-a623-be7e64e73b5f] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:12:57.478412 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-6be91d62-eed6-4b70-a657-eba0d613a704 tempest-InstanceActionsV221TestJSON-1016349810 tempest-InstanceActionsV221TestJSON-1016349810-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:12:57.479201 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-6be91d62-eed6-4b70-a657-eba0d613a704 tempest-InstanceActionsV221TestJSON-1016349810 tempest-InstanceActionsV221TestJSON-1016349810-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:12:57.479898 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-6be91d62-eed6-4b70-a657-eba0d613a704 tempest-InstanceActionsV221TestJSON-1016349810 tempest-InstanceActionsV221TestJSON-1016349810-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:12:57.480994 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-6be91d62-eed6-4b70-a657-eba0d613a704 tempest-InstanceActionsV221TestJSON-1016349810 tempest-InstanceActionsV221TestJSON-1016349810-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:12:57.482120 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-6be91d62-eed6-4b70-a657-eba0d613a704 tempest-InstanceActionsV221TestJSON-1016349810 tempest-InstanceActionsV221TestJSON-1016349810-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:12:57.482882 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-6be91d62-eed6-4b70-a657-eba0d613a704 tempest-InstanceActionsV221TestJSON-1016349810 tempest-InstanceActionsV221TestJSON-1016349810-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:12:57.781359 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-6be91d62-eed6-4b70-a657-eba0d613a704 tempest-InstanceActionsV221TestJSON-1016349810 tempest-InstanceActionsV221TestJSON-1016349810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '060d1fb6604f4096b650cf40060db86a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c29ec5eebf84c198c11bae29e3df2d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:12:57.788094 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-6be91d62-eed6-4b70-a657-eba0d613a704 tempest-InstanceActionsV221TestJSON-1016349810 tempest-InstanceActionsV221TestJSON-1016349810-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '060d1fb6604f4096b650cf40060db86a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c29ec5eebf84c198c11bae29e3df2d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:12:57.789602 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-6be91d62-eed6-4b70-a657-eba0d613a704 tempest-InstanceActionsV221TestJSON-1016349810 tempest-InstanceActionsV221TestJSON-1016349810-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '060d1fb6604f4096b650cf40060db86a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c29ec5eebf84c198c11bae29e3df2d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:12:57.790755 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-6be91d62-eed6-4b70-a657-eba0d613a704 tempest-InstanceActionsV221TestJSON-1016349810 tempest-InstanceActionsV221TestJSON-1016349810-project] 10.222.0.13 "GET /compute/v2.1/servers/aa7aa9c6-8a88-4948-a623-be7e64e73b5f" status: 200 len: 1358 microversion: 2.21 time: 0.348353 Nov 01 19:12:57.791348 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 2153/4339] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 19:12:57 2022] GET /compute/v2.1/servers/aa7aa9c6-8a88-4948-a623-be7e64e73b5f => generated 1358 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 19:12:57.815726 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-e55ef731-85d3-45ff-abdc-f38b0296e716 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:12:57.816250 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-e55ef731-85d3-45ff-abdc-f38b0296e716 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] [instance: b27eaab4-a751-47fb-acdb-db7c99b06a5f] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:12:57.839381 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e55ef731-85d3-45ff-abdc-f38b0296e716 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:12:57.839881 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e55ef731-85d3-45ff-abdc-f38b0296e716 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:12:57.840362 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e55ef731-85d3-45ff-abdc-f38b0296e716 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:12:57.841084 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e55ef731-85d3-45ff-abdc-f38b0296e716 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:12:57.841539 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e55ef731-85d3-45ff-abdc-f38b0296e716 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:12:57.841960 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e55ef731-85d3-45ff-abdc-f38b0296e716 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:12:58.150816 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-e55ef731-85d3-45ff-abdc-f38b0296e716 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc5c19b930543f5a5091922a9859813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ecdc83933544a899117531a960027a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:12:58.167983 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-e55ef731-85d3-45ff-abdc-f38b0296e716 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] 10.222.0.13 "GET /compute/v2.1/servers/b27eaab4-a751-47fb-acdb-db7c99b06a5f" status: 200 len: 1506 microversion: 2.1 time: 0.375608 Nov 01 19:12:58.170525 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 2154/4340] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:12:57 2022] GET /compute/v2.1/servers/b27eaab4-a751-47fb-acdb-db7c99b06a5f => generated 1506 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:12:58.186576 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-0936c863-3f2d-409d-8c85-523d0414072e tempest-ServerPasswordTestJSON-1534707503 tempest-ServerPasswordTestJSON-1534707503-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:12:58.188103 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-0936c863-3f2d-409d-8c85-523d0414072e tempest-ServerPasswordTestJSON-1534707503 tempest-ServerPasswordTestJSON-1534707503-project] [instance: 3463bb31-5f34-4b89-8b40-af83df5c7635] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:12:58.208511 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-0936c863-3f2d-409d-8c85-523d0414072e tempest-ServerPasswordTestJSON-1534707503 tempest-ServerPasswordTestJSON-1534707503-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:12:58.209043 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-0936c863-3f2d-409d-8c85-523d0414072e tempest-ServerPasswordTestJSON-1534707503 tempest-ServerPasswordTestJSON-1534707503-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:12:58.209492 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-0936c863-3f2d-409d-8c85-523d0414072e tempest-ServerPasswordTestJSON-1534707503 tempest-ServerPasswordTestJSON-1534707503-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:12:58.210203 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-0936c863-3f2d-409d-8c85-523d0414072e tempest-ServerPasswordTestJSON-1534707503 tempest-ServerPasswordTestJSON-1534707503-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:12:58.219524 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-0936c863-3f2d-409d-8c85-523d0414072e tempest-ServerPasswordTestJSON-1534707503 tempest-ServerPasswordTestJSON-1534707503-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:12:58.219989 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-0936c863-3f2d-409d-8c85-523d0414072e tempest-ServerPasswordTestJSON-1534707503 tempest-ServerPasswordTestJSON-1534707503-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:12:58.599677 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-0936c863-3f2d-409d-8c85-523d0414072e tempest-ServerPasswordTestJSON-1534707503 tempest-ServerPasswordTestJSON-1534707503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '969cec09484942aebbab6c0f021b7067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9871416ead87433589b8f54783b023b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:12:58.608739 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-0936c863-3f2d-409d-8c85-523d0414072e tempest-ServerPasswordTestJSON-1534707503 tempest-ServerPasswordTestJSON-1534707503-project] 10.222.0.13 "GET /compute/v2.1/servers/3463bb31-5f34-4b89-8b40-af83df5c7635" status: 200 len: 1316 microversion: 2.1 time: 0.436637 Nov 01 19:12:58.612421 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 2155/4341] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:12:58 2022] GET /compute/v2.1/servers/3463bb31-5f34-4b89-8b40-af83df5c7635 => generated 1316 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:12:58.619562 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-336908ea-1d5e-4c0d-ae50-79d4f6dd9e51 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:12:58.622299 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-336908ea-1d5e-4c0d-ae50-79d4f6dd9e51 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] [instance: 92eba31a-28a2-4ad5-a1ed-725b8f3d1a38] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:12:58.640345 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.wsgi [None req-336908ea-1d5e-4c0d-ae50-79d4f6dd9e51 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] HTTP exception thrown: Instance 92eba31a-28a2-4ad5-a1ed-725b8f3d1a38 could not be found. Nov 01 19:12:58.643828 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-336908ea-1d5e-4c0d-ae50-79d4f6dd9e51 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Request method failure captured: Nov 01 19:12:58.643828 n-d-863052-2 devstack@n-api.service[121402]: request: DELETE /compute/v2.1/servers/92eba31a-28a2-4ad5-a1ed-725b8f3d1a38 HTTP/1.1 Nov 01 19:12:58.643828 n-d-863052-2 devstack@n-api.service[121402]: Accept: application/json Nov 01 19:12:58.643828 n-d-863052-2 devstack@n-api.service[121402]: Accept-Encoding: identity Nov 01 19:12:58.643828 n-d-863052-2 devstack@n-api.service[121402]: Connection: close Nov 01 19:12:58.643828 n-d-863052-2 devstack@n-api.service[121402]: Content-Length: 0 Nov 01 19:12:58.643828 n-d-863052-2 devstack@n-api.service[121402]: Content-Type: application/json Nov 01 19:12:58.643828 n-d-863052-2 devstack@n-api.service[121402]: Host: 10.222.0.13 Nov 01 19:12:58.643828 n-d-863052-2 devstack@n-api.service[121402]: Openstack-System-Scope: None Nov 01 19:12:58.643828 n-d-863052-2 devstack@n-api.service[121402]: User-Agent: python-urllib3/1.26.12 Nov 01 19:12:58.643828 n-d-863052-2 devstack@n-api.service[121402]: X-Auth-Token: gAAAAABjYW9YFTR7hO-vK03S-3HbvOtG2z3_fji2KJH39vNHENu4xIKneeHYviQiPj9ERGiA3aZIA7DvAYzczgSZ5-vK782IQ7CYnUFXvn9Aqt1AbunNMYxhes9BKzhvODzqwzqiQq89wgC4nbpZ9jJWFWMOC4z9bcW4UMi_ylwdZFjmhWfD49s Nov 01 19:12:58.643828 n-d-863052-2 devstack@n-api.service[121402]: X-Domain-Id: None Nov 01 19:12:58.643828 n-d-863052-2 devstack@n-api.service[121402]: X-Domain-Name: None Nov 01 19:12:58.643828 n-d-863052-2 devstack@n-api.service[121402]: X-Identity-Status: Confirmed Nov 01 19:12:58.643828 n-d-863052-2 devstack@n-api.service[121402]: X-Is-Admin-Project: True Nov 01 19:12:58.643828 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Domain-Id: default Nov 01 19:12:58.643828 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Domain-Name: Default Nov 01 19:12:58.643828 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Id: 9ecdc83933544a899117531a960027a7 Nov 01 19:12:58.643828 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Name: tempest-ServersNegativeTestJSON-638944671 Nov 01 19:12:58.643828 n-d-863052-2 devstack@n-api.service[121402]: X-Role: member,reader Nov 01 19:12:58.643828 n-d-863052-2 devstack@n-api.service[121402]: X-Roles: member,reader Nov 01 19:12:58.643828 n-d-863052-2 devstack@n-api.service[121402]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/9ecdc83933544a899117531a960027a7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/9ecdc83933544a899117531a960027a7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_9ecdc83933544a899117531a960027a7", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/9ecdc83933544a899117531a960027a7"}]}] Nov 01 19:12:58.643828 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant: tempest-ServersNegativeTestJSON-638944671 Nov 01 19:12:58.643828 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant-Id: 9ecdc83933544a899117531a960027a7 Nov 01 19:12:58.643828 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant-Name: tempest-ServersNegativeTestJSON-638944671 Nov 01 19:12:58.643828 n-d-863052-2 devstack@n-api.service[121402]: X-User: tempest-ServersNegativeTestJSON-638944671-project Nov 01 19:12:58.643828 n-d-863052-2 devstack@n-api.service[121402]: X-User-Domain-Id: default Nov 01 19:12:58.643828 n-d-863052-2 devstack@n-api.service[121402]: X-User-Domain-Name: Default Nov 01 19:12:58.643828 n-d-863052-2 devstack@n-api.service[121402]: X-User-Id: 3fc5c19b930543f5a5091922a9859813 Nov 01 19:12:58.643828 n-d-863052-2 devstack@n-api.service[121402]: X-User-Name: tempest-ServersNegativeTestJSON-638944671-project Nov 01 19:12:58.643828 n-d-863052-2 devstack@n-api.service[121402]: method: > Nov 01 19:12:58.643828 n-d-863052-2 devstack@n-api.service[121402]: exception: Instance 92eba31a-28a2-4ad5-a1ed-725b8f3d1a38 could not be found. Nov 01 19:12:58.643828 n-d-863052-2 devstack@n-api.service[121402]: action_args: {'id': '92eba31a-28a2-4ad5-a1ed-725b8f3d1a38'} Nov 01 19:12:58.643828 n-d-863052-2 devstack@n-api.service[121402]: {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 01 19:12:58.643828 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:12:58.643828 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 01 19:12:58.643828 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 01 19:12:58.643828 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 01 19:12:58.643828 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 01 19:12:58.643828 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Nov 01 19:12:58.643828 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Nov 01 19:12:58.643828 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 92eba31a-28a2-4ad5-a1ed-725b8f3d1a38 could not be found. Nov 01 19:12:58.643828 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:12:58.643828 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:12:58.643828 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:12:58.643828 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:12:58.643828 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:12:58.643828 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:12:58.643828 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 01 19:12:58.643828 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 01 19:12:58.643828 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 01 19:12:58.643828 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 01 19:12:58.643828 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 01 19:12:58.643828 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 01 19:12:58.643828 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 01 19:12:58.643828 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 01 19:12:58.643828 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 01 19:12:58.643828 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 01 19:12:58.643828 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 01 19:12:58.643828 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 01 19:12:58.643828 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 92eba31a-28a2-4ad5-a1ed-725b8f3d1a38 could not be found. Nov 01 19:12:58.643828 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:12:58.643828 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:12:58.648717 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:12:58.648717 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:12:58.648717 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:12:58.648717 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:12:58.648717 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 01 19:12:58.648717 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 01 19:12:58.648717 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 92eba31a-28a2-4ad5-a1ed-725b8f3d1a38 could not be found. Nov 01 19:12:58.648717 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:12:58.654461 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-336908ea-1d5e-4c0d-ae50-79d4f6dd9e51 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Returning 404 to user: Instance 92eba31a-28a2-4ad5-a1ed-725b8f3d1a38 could not be found. {{(pid=121402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 01 19:12:58.658501 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-336908ea-1d5e-4c0d-ae50-79d4f6dd9e51 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] 10.222.0.13 "DELETE /compute/v2.1/servers/92eba31a-28a2-4ad5-a1ed-725b8f3d1a38" status: 404 len: 111 microversion: 2.1 time: 0.043414 Nov 01 19:12:58.660479 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 2156/4342] 10.222.0.13 () {58 vars in 1239 bytes} [Tue Nov 1 19:12:58 2022] DELETE /compute/v2.1/servers/92eba31a-28a2-4ad5-a1ed-725b8f3d1a38 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 01 19:12:58.671287 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-fc7ef164-9dcd-493c-a3bf-89d8a83cd5dc tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:12:58.673111 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-fc7ef164-9dcd-493c-a3bf-89d8a83cd5dc tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] [instance: b27eaab4-a751-47fb-acdb-db7c99b06a5f] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:12:58.691881 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-fc7ef164-9dcd-493c-a3bf-89d8a83cd5dc tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:12:58.693696 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-fc7ef164-9dcd-493c-a3bf-89d8a83cd5dc tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:12:58.695310 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-fc7ef164-9dcd-493c-a3bf-89d8a83cd5dc tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:12:58.696791 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-fc7ef164-9dcd-493c-a3bf-89d8a83cd5dc tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:12:58.699754 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-fc7ef164-9dcd-493c-a3bf-89d8a83cd5dc tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:12:58.703916 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-fc7ef164-9dcd-493c-a3bf-89d8a83cd5dc tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:12:58.914404 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-fc7ef164-9dcd-493c-a3bf-89d8a83cd5dc tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc5c19b930543f5a5091922a9859813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ecdc83933544a899117531a960027a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:12:58.925176 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-fc7ef164-9dcd-493c-a3bf-89d8a83cd5dc tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] 10.222.0.13 "GET /compute/v2.1/servers/b27eaab4-a751-47fb-acdb-db7c99b06a5f" status: 200 len: 1506 microversion: 2.1 time: 0.259873 Nov 01 19:12:58.928538 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 2157/4343] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:12:58 2022] GET /compute/v2.1/servers/b27eaab4-a751-47fb-acdb-db7c99b06a5f => generated 1506 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:12:58.936847 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-8ea15086-9d9c-47c7-a199-1ca0b9865a5d tempest-InstanceActionsV221TestJSON-1016349810 tempest-InstanceActionsV221TestJSON-1016349810-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:12:58.944169 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-8ea15086-9d9c-47c7-a199-1ca0b9865a5d tempest-InstanceActionsV221TestJSON-1016349810 tempest-InstanceActionsV221TestJSON-1016349810-project] [instance: aa7aa9c6-8a88-4948-a623-be7e64e73b5f] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:12:58.956221 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-8ea15086-9d9c-47c7-a199-1ca0b9865a5d tempest-InstanceActionsV221TestJSON-1016349810 tempest-InstanceActionsV221TestJSON-1016349810-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:12:58.972843 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-8ea15086-9d9c-47c7-a199-1ca0b9865a5d tempest-InstanceActionsV221TestJSON-1016349810 tempest-InstanceActionsV221TestJSON-1016349810-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:12:58.973460 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-8ea15086-9d9c-47c7-a199-1ca0b9865a5d tempest-InstanceActionsV221TestJSON-1016349810 tempest-InstanceActionsV221TestJSON-1016349810-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:12:58.974227 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-8ea15086-9d9c-47c7-a199-1ca0b9865a5d tempest-InstanceActionsV221TestJSON-1016349810 tempest-InstanceActionsV221TestJSON-1016349810-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:12:58.974710 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-8ea15086-9d9c-47c7-a199-1ca0b9865a5d tempest-InstanceActionsV221TestJSON-1016349810 tempest-InstanceActionsV221TestJSON-1016349810-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:12:58.975141 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-8ea15086-9d9c-47c7-a199-1ca0b9865a5d tempest-InstanceActionsV221TestJSON-1016349810 tempest-InstanceActionsV221TestJSON-1016349810-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:12:59.383312 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-8ea15086-9d9c-47c7-a199-1ca0b9865a5d tempest-InstanceActionsV221TestJSON-1016349810 tempest-InstanceActionsV221TestJSON-1016349810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '060d1fb6604f4096b650cf40060db86a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c29ec5eebf84c198c11bae29e3df2d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:12:59.394718 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-8ea15086-9d9c-47c7-a199-1ca0b9865a5d tempest-InstanceActionsV221TestJSON-1016349810 tempest-InstanceActionsV221TestJSON-1016349810-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '060d1fb6604f4096b650cf40060db86a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c29ec5eebf84c198c11bae29e3df2d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:12:59.396190 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-8ea15086-9d9c-47c7-a199-1ca0b9865a5d tempest-InstanceActionsV221TestJSON-1016349810 tempest-InstanceActionsV221TestJSON-1016349810-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '060d1fb6604f4096b650cf40060db86a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c29ec5eebf84c198c11bae29e3df2d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:12:59.397360 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-8ea15086-9d9c-47c7-a199-1ca0b9865a5d tempest-InstanceActionsV221TestJSON-1016349810 tempest-InstanceActionsV221TestJSON-1016349810-project] 10.222.0.13 "GET /compute/v2.1/servers/aa7aa9c6-8a88-4948-a623-be7e64e73b5f" status: 200 len: 1358 microversion: 2.21 time: 0.467741 Nov 01 19:12:59.397923 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 2158/4344] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 19:12:58 2022] GET /compute/v2.1/servers/aa7aa9c6-8a88-4948-a623-be7e64e73b5f => generated 1358 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 19:12:59.413143 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-86f95133-26a6-4ac3-a409-2c380f9d325e tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:12:59.413773 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-86f95133-26a6-4ac3-a409-2c380f9d325e tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] [instance: b27eaab4-a751-47fb-acdb-db7c99b06a5f] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:12:59.426983 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-86f95133-26a6-4ac3-a409-2c380f9d325e tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:12:59.427488 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-86f95133-26a6-4ac3-a409-2c380f9d325e tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:12:59.432777 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-86f95133-26a6-4ac3-a409-2c380f9d325e tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:12:59.433658 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-86f95133-26a6-4ac3-a409-2c380f9d325e tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:12:59.437017 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-86f95133-26a6-4ac3-a409-2c380f9d325e tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:12:59.437503 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-86f95133-26a6-4ac3-a409-2c380f9d325e tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:12:59.758938 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-86f95133-26a6-4ac3-a409-2c380f9d325e tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc5c19b930543f5a5091922a9859813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ecdc83933544a899117531a960027a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:12:59.767743 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-86f95133-26a6-4ac3-a409-2c380f9d325e tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] 10.222.0.13 "GET /compute/v2.1/servers/b27eaab4-a751-47fb-acdb-db7c99b06a5f" status: 200 len: 1506 microversion: 2.1 time: 0.368808 Nov 01 19:12:59.768324 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 2159/4345] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:12:59 2022] GET /compute/v2.1/servers/b27eaab4-a751-47fb-acdb-db7c99b06a5f => generated 1506 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:12:59.786232 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [req-310c5abb-f6fb-4169-869d-c9c82fbcd697 req-9a725d74-f035-49e1-abcb-a7c8df04442d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3463bb31-5f34-4b89-8b40-af83df5c7635", "tag": "904e2114-15bb-4980-94da-1ab46ccf1c70"}]} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:12:59.804408 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-310c5abb-f6fb-4169-869d-c9c82fbcd697 req-9a725d74-f035-49e1-abcb-a7c8df04442d service nova] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:12:59.804931 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-310c5abb-f6fb-4169-869d-c9c82fbcd697 req-9a725d74-f035-49e1-abcb-a7c8df04442d service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:12:59.809760 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-310c5abb-f6fb-4169-869d-c9c82fbcd697 req-9a725d74-f035-49e1-abcb-a7c8df04442d service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:12:59.834314 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.compute.server_external_events [req-310c5abb-f6fb-4169-869d-c9c82fbcd697 req-9a725d74-f035-49e1-abcb-a7c8df04442d service nova] Creating event network-changed:904e2114-15bb-4980-94da-1ab46ccf1c70 for instance 3463bb31-5f34-4b89-8b40-af83df5c7635 on n-h2-863052-2 Nov 01 19:12:59.843202 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [req-310c5abb-f6fb-4169-869d-c9c82fbcd697 req-9a725d74-f035-49e1-abcb-a7c8df04442d service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073269 Nov 01 19:12:59.844554 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 2160/4346] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Nov 1 19:12:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:12:59.851425 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-83e9cf69-b2bb-488e-aaa9-4d09b9ebb7fd tempest-ServerPasswordTestJSON-1534707503 tempest-ServerPasswordTestJSON-1534707503-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:12:59.852407 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-83e9cf69-b2bb-488e-aaa9-4d09b9ebb7fd tempest-ServerPasswordTestJSON-1534707503 tempest-ServerPasswordTestJSON-1534707503-project] [instance: 3463bb31-5f34-4b89-8b40-af83df5c7635] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:12:59.860942 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-83e9cf69-b2bb-488e-aaa9-4d09b9ebb7fd tempest-ServerPasswordTestJSON-1534707503 tempest-ServerPasswordTestJSON-1534707503-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:12:59.861683 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-83e9cf69-b2bb-488e-aaa9-4d09b9ebb7fd tempest-ServerPasswordTestJSON-1534707503 tempest-ServerPasswordTestJSON-1534707503-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:12:59.862274 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-83e9cf69-b2bb-488e-aaa9-4d09b9ebb7fd tempest-ServerPasswordTestJSON-1534707503 tempest-ServerPasswordTestJSON-1534707503-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:12:59.863173 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-83e9cf69-b2bb-488e-aaa9-4d09b9ebb7fd tempest-ServerPasswordTestJSON-1534707503 tempest-ServerPasswordTestJSON-1534707503-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:12:59.863885 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-83e9cf69-b2bb-488e-aaa9-4d09b9ebb7fd tempest-ServerPasswordTestJSON-1534707503 tempest-ServerPasswordTestJSON-1534707503-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:12:59.864468 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-83e9cf69-b2bb-488e-aaa9-4d09b9ebb7fd tempest-ServerPasswordTestJSON-1534707503 tempest-ServerPasswordTestJSON-1534707503-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:13:00.073517 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-83e9cf69-b2bb-488e-aaa9-4d09b9ebb7fd tempest-ServerPasswordTestJSON-1534707503 tempest-ServerPasswordTestJSON-1534707503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '969cec09484942aebbab6c0f021b7067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9871416ead87433589b8f54783b023b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:13:00.087299 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-83e9cf69-b2bb-488e-aaa9-4d09b9ebb7fd tempest-ServerPasswordTestJSON-1534707503 tempest-ServerPasswordTestJSON-1534707503-project] 10.222.0.13 "GET /compute/v2.1/servers/3463bb31-5f34-4b89-8b40-af83df5c7635" status: 200 len: 1316 microversion: 2.1 time: 0.237014 Nov 01 19:13:00.088137 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 2161/4347] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:12:59 2022] GET /compute/v2.1/servers/3463bb31-5f34-4b89-8b40-af83df5c7635 => generated 1316 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:13:00.111459 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-5d6744ac-3427-4032-b2ad-07bb8d3b5e62 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:13:00.112124 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-5d6744ac-3427-4032-b2ad-07bb8d3b5e62 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Failed to fetch instance by id 9223372036854775808 {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2981}} Nov 01 19:13:00.112916 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.wsgi [None req-5d6744ac-3427-4032-b2ad-07bb8d3b5e62 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] HTTP exception thrown: Instance 9223372036854775808 could not be found. Nov 01 19:13:00.114688 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-5d6744ac-3427-4032-b2ad-07bb8d3b5e62 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Request method failure captured: Nov 01 19:13:00.114688 n-d-863052-2 devstack@n-api.service[121402]: request: DELETE /compute/v2.1/servers/9223372036854775808 HTTP/1.1 Nov 01 19:13:00.114688 n-d-863052-2 devstack@n-api.service[121402]: Accept: application/json Nov 01 19:13:00.114688 n-d-863052-2 devstack@n-api.service[121402]: Accept-Encoding: identity Nov 01 19:13:00.114688 n-d-863052-2 devstack@n-api.service[121402]: Connection: close Nov 01 19:13:00.114688 n-d-863052-2 devstack@n-api.service[121402]: Content-Length: 0 Nov 01 19:13:00.114688 n-d-863052-2 devstack@n-api.service[121402]: Content-Type: application/json Nov 01 19:13:00.114688 n-d-863052-2 devstack@n-api.service[121402]: Host: 10.222.0.13 Nov 01 19:13:00.114688 n-d-863052-2 devstack@n-api.service[121402]: Openstack-System-Scope: None Nov 01 19:13:00.114688 n-d-863052-2 devstack@n-api.service[121402]: User-Agent: python-urllib3/1.26.12 Nov 01 19:13:00.114688 n-d-863052-2 devstack@n-api.service[121402]: X-Auth-Token: gAAAAABjYW9YFTR7hO-vK03S-3HbvOtG2z3_fji2KJH39vNHENu4xIKneeHYviQiPj9ERGiA3aZIA7DvAYzczgSZ5-vK782IQ7CYnUFXvn9Aqt1AbunNMYxhes9BKzhvODzqwzqiQq89wgC4nbpZ9jJWFWMOC4z9bcW4UMi_ylwdZFjmhWfD49s Nov 01 19:13:00.114688 n-d-863052-2 devstack@n-api.service[121402]: X-Domain-Id: None Nov 01 19:13:00.114688 n-d-863052-2 devstack@n-api.service[121402]: X-Domain-Name: None Nov 01 19:13:00.114688 n-d-863052-2 devstack@n-api.service[121402]: X-Identity-Status: Confirmed Nov 01 19:13:00.114688 n-d-863052-2 devstack@n-api.service[121402]: X-Is-Admin-Project: True Nov 01 19:13:00.114688 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Domain-Id: default Nov 01 19:13:00.114688 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Domain-Name: Default Nov 01 19:13:00.114688 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Id: 9ecdc83933544a899117531a960027a7 Nov 01 19:13:00.114688 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Name: tempest-ServersNegativeTestJSON-638944671 Nov 01 19:13:00.114688 n-d-863052-2 devstack@n-api.service[121402]: X-Role: member,reader Nov 01 19:13:00.114688 n-d-863052-2 devstack@n-api.service[121402]: X-Roles: member,reader Nov 01 19:13:00.114688 n-d-863052-2 devstack@n-api.service[121402]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/9ecdc83933544a899117531a960027a7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/9ecdc83933544a899117531a960027a7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_9ecdc83933544a899117531a960027a7", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/9ecdc83933544a899117531a960027a7"}]}] Nov 01 19:13:00.114688 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant: tempest-ServersNegativeTestJSON-638944671 Nov 01 19:13:00.114688 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant-Id: 9ecdc83933544a899117531a960027a7 Nov 01 19:13:00.114688 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant-Name: tempest-ServersNegativeTestJSON-638944671 Nov 01 19:13:00.114688 n-d-863052-2 devstack@n-api.service[121402]: X-User: tempest-ServersNegativeTestJSON-638944671-project Nov 01 19:13:00.114688 n-d-863052-2 devstack@n-api.service[121402]: X-User-Domain-Id: default Nov 01 19:13:00.114688 n-d-863052-2 devstack@n-api.service[121402]: X-User-Domain-Name: Default Nov 01 19:13:00.114688 n-d-863052-2 devstack@n-api.service[121402]: X-User-Id: 3fc5c19b930543f5a5091922a9859813 Nov 01 19:13:00.114688 n-d-863052-2 devstack@n-api.service[121402]: X-User-Name: tempest-ServersNegativeTestJSON-638944671-project Nov 01 19:13:00.114688 n-d-863052-2 devstack@n-api.service[121402]: method: > Nov 01 19:13:00.114688 n-d-863052-2 devstack@n-api.service[121402]: exception: Instance 9223372036854775808 could not be found. Nov 01 19:13:00.114688 n-d-863052-2 devstack@n-api.service[121402]: action_args: {'id': '9223372036854775808'} Nov 01 19:13:00.114688 n-d-863052-2 devstack@n-api.service[121402]: {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 01 19:13:00.114688 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:13:00.114688 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 01 19:13:00.114688 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 01 19:13:00.114688 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Nov 01 19:13:00.114688 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Nov 01 19:13:00.114688 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9223372036854775808 could not be found. Nov 01 19:13:00.114688 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:13:00.114688 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:13:00.114688 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:13:00.114688 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:13:00.114688 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:13:00.114688 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:13:00.114688 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 01 19:13:00.114688 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 01 19:13:00.114688 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 01 19:13:00.114688 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 01 19:13:00.114688 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 01 19:13:00.114688 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 01 19:13:00.114688 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 01 19:13:00.114688 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 01 19:13:00.114688 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 01 19:13:00.114688 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 01 19:13:00.114688 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 01 19:13:00.114688 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 01 19:13:00.114688 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9223372036854775808 could not be found. Nov 01 19:13:00.114688 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:13:00.114688 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:13:00.114688 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:13:00.114688 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:13:00.114688 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:13:00.118448 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:13:00.118448 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 01 19:13:00.118448 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 01 19:13:00.118448 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9223372036854775808 could not be found. Nov 01 19:13:00.118448 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:13:00.121161 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-5d6744ac-3427-4032-b2ad-07bb8d3b5e62 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Returning 404 to user: Instance 9223372036854775808 could not be found. {{(pid=121402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 01 19:13:00.122316 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-5d6744ac-3427-4032-b2ad-07bb8d3b5e62 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] 10.222.0.13 "DELETE /compute/v2.1/servers/9223372036854775808" status: 404 len: 94 microversion: 2.1 time: 0.014911 Nov 01 19:13:00.123395 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 2162/4348] 10.222.0.13 () {58 vars in 1188 bytes} [Tue Nov 1 19:13:00 2022] DELETE /compute/v2.1/servers/9223372036854775808 => generated 94 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 01 19:13:00.138036 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-8e33d7ab-134a-4a2a-9ae7-af640d160943 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:13:00.138994 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-8e33d7ab-134a-4a2a-9ae7-af640d160943 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] [instance: b27eaab4-a751-47fb-acdb-db7c99b06a5f] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:13:00.158514 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-8e33d7ab-134a-4a2a-9ae7-af640d160943 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:13:00.160350 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-8e33d7ab-134a-4a2a-9ae7-af640d160943 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:13:00.161424 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-8e33d7ab-134a-4a2a-9ae7-af640d160943 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:13:00.162404 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-8e33d7ab-134a-4a2a-9ae7-af640d160943 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:13:00.163125 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-8e33d7ab-134a-4a2a-9ae7-af640d160943 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:13:00.163624 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-8e33d7ab-134a-4a2a-9ae7-af640d160943 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:13:00.404414 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-221d70aa-58ad-4ae0-b826-c17bf1a02d33 tempest-FloatingIPDetailsTestJSON-1286833380 tempest-FloatingIPDetailsTestJSON-1286833380-project] 10.222.0.13 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 14.612363 Nov 01 19:13:00.405418 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 2187/4349] 10.222.0.13 () {60 vars in 1170 bytes} [Tue Nov 1 19:12:45 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 14615 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:13:00.419392 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-4ec62b04-932e-4993-8ec8-df9ce7f6ec6c tempest-FloatingIPDetailsTestJSON-1286833380 tempest-FloatingIPDetailsTestJSON-1286833380-project] Action: 'create', calling method: .version_select at 0x7f0ae1cfd430>, body: {"pool": null} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:13:00.728389 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-8e33d7ab-134a-4a2a-9ae7-af640d160943 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc5c19b930543f5a5091922a9859813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ecdc83933544a899117531a960027a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:13:00.744284 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-8e33d7ab-134a-4a2a-9ae7-af640d160943 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] 10.222.0.13 "GET /compute/v2.1/servers/b27eaab4-a751-47fb-acdb-db7c99b06a5f" status: 200 len: 1506 microversion: 2.1 time: 0.614109 Nov 01 19:13:00.745114 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 2163/4350] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:13:00 2022] GET /compute/v2.1/servers/b27eaab4-a751-47fb-acdb-db7c99b06a5f => generated 1506 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:13:00.766371 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-97dc4301-e607-4ac2-8c88-12646d7296cc tempest-InstanceActionsV221TestJSON-1016349810 tempest-InstanceActionsV221TestJSON-1016349810-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:13:00.766997 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-97dc4301-e607-4ac2-8c88-12646d7296cc tempest-InstanceActionsV221TestJSON-1016349810 tempest-InstanceActionsV221TestJSON-1016349810-project] [instance: aa7aa9c6-8a88-4948-a623-be7e64e73b5f] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:13:00.773103 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-97dc4301-e607-4ac2-8c88-12646d7296cc tempest-InstanceActionsV221TestJSON-1016349810 tempest-InstanceActionsV221TestJSON-1016349810-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:13:00.777000 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-97dc4301-e607-4ac2-8c88-12646d7296cc tempest-InstanceActionsV221TestJSON-1016349810 tempest-InstanceActionsV221TestJSON-1016349810-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:13:00.777403 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-97dc4301-e607-4ac2-8c88-12646d7296cc tempest-InstanceActionsV221TestJSON-1016349810 tempest-InstanceActionsV221TestJSON-1016349810-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:13:00.778687 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-97dc4301-e607-4ac2-8c88-12646d7296cc tempest-InstanceActionsV221TestJSON-1016349810 tempest-InstanceActionsV221TestJSON-1016349810-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:13:00.779170 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-97dc4301-e607-4ac2-8c88-12646d7296cc tempest-InstanceActionsV221TestJSON-1016349810 tempest-InstanceActionsV221TestJSON-1016349810-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:13:00.779606 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-97dc4301-e607-4ac2-8c88-12646d7296cc tempest-InstanceActionsV221TestJSON-1016349810 tempest-InstanceActionsV221TestJSON-1016349810-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:13:00.872286 n-d-863052-2 devstack@n-api.service[121402]: DEBUG dbcounter [-] [121402] Writing DB stats nova_cell1:SELECT=100 {{(pid=121402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 19:13:01.171153 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-97dc4301-e607-4ac2-8c88-12646d7296cc tempest-InstanceActionsV221TestJSON-1016349810 tempest-InstanceActionsV221TestJSON-1016349810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '060d1fb6604f4096b650cf40060db86a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c29ec5eebf84c198c11bae29e3df2d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:13:01.181792 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-97dc4301-e607-4ac2-8c88-12646d7296cc tempest-InstanceActionsV221TestJSON-1016349810 tempest-InstanceActionsV221TestJSON-1016349810-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '060d1fb6604f4096b650cf40060db86a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c29ec5eebf84c198c11bae29e3df2d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:13:01.184090 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-97dc4301-e607-4ac2-8c88-12646d7296cc tempest-InstanceActionsV221TestJSON-1016349810 tempest-InstanceActionsV221TestJSON-1016349810-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '060d1fb6604f4096b650cf40060db86a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c29ec5eebf84c198c11bae29e3df2d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:13:01.188313 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-97dc4301-e607-4ac2-8c88-12646d7296cc tempest-InstanceActionsV221TestJSON-1016349810 tempest-InstanceActionsV221TestJSON-1016349810-project] 10.222.0.13 "GET /compute/v2.1/servers/aa7aa9c6-8a88-4948-a623-be7e64e73b5f" status: 200 len: 1358 microversion: 2.21 time: 0.441093 Nov 01 19:13:01.189205 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 2164/4351] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 19:13:00 2022] GET /compute/v2.1/servers/aa7aa9c6-8a88-4948-a623-be7e64e73b5f => generated 1358 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 19:13:01.194438 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-b2a72065-bca0-4e74-9b85-65ab3ccebda5 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:13:01.195325 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-b2a72065-bca0-4e74-9b85-65ab3ccebda5 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] [instance: b27eaab4-a751-47fb-acdb-db7c99b06a5f] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:13:01.203754 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b2a72065-bca0-4e74-9b85-65ab3ccebda5 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:13:01.204636 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b2a72065-bca0-4e74-9b85-65ab3ccebda5 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:13:01.205512 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b2a72065-bca0-4e74-9b85-65ab3ccebda5 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:13:01.206635 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b2a72065-bca0-4e74-9b85-65ab3ccebda5 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:13:01.208228 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b2a72065-bca0-4e74-9b85-65ab3ccebda5 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:13:01.208932 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b2a72065-bca0-4e74-9b85-65ab3ccebda5 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:13:01.394972 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-b2a72065-bca0-4e74-9b85-65ab3ccebda5 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc5c19b930543f5a5091922a9859813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ecdc83933544a899117531a960027a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:13:01.407773 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-b2a72065-bca0-4e74-9b85-65ab3ccebda5 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] 10.222.0.13 "GET /compute/v2.1/servers/b27eaab4-a751-47fb-acdb-db7c99b06a5f" status: 200 len: 1506 microversion: 2.1 time: 0.216947 Nov 01 19:13:01.408925 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 2165/4352] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:13:01 2022] GET /compute/v2.1/servers/b27eaab4-a751-47fb-acdb-db7c99b06a5f => generated 1506 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:13:01.426706 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-26a01bce-79bd-4bab-976e-591f0eb6c4b2 tempest-ServerPasswordTestJSON-1534707503 tempest-ServerPasswordTestJSON-1534707503-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:13:01.427653 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-26a01bce-79bd-4bab-976e-591f0eb6c4b2 tempest-ServerPasswordTestJSON-1534707503 tempest-ServerPasswordTestJSON-1534707503-project] [instance: 3463bb31-5f34-4b89-8b40-af83df5c7635] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:13:01.438627 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-26a01bce-79bd-4bab-976e-591f0eb6c4b2 tempest-ServerPasswordTestJSON-1534707503 tempest-ServerPasswordTestJSON-1534707503-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:13:01.439058 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-26a01bce-79bd-4bab-976e-591f0eb6c4b2 tempest-ServerPasswordTestJSON-1534707503 tempest-ServerPasswordTestJSON-1534707503-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:13:01.439505 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-26a01bce-79bd-4bab-976e-591f0eb6c4b2 tempest-ServerPasswordTestJSON-1534707503 tempest-ServerPasswordTestJSON-1534707503-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:13:01.440222 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-26a01bce-79bd-4bab-976e-591f0eb6c4b2 tempest-ServerPasswordTestJSON-1534707503 tempest-ServerPasswordTestJSON-1534707503-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:13:01.440713 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-26a01bce-79bd-4bab-976e-591f0eb6c4b2 tempest-ServerPasswordTestJSON-1534707503 tempest-ServerPasswordTestJSON-1534707503-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:13:01.446755 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-26a01bce-79bd-4bab-976e-591f0eb6c4b2 tempest-ServerPasswordTestJSON-1534707503 tempest-ServerPasswordTestJSON-1534707503-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:13:01.711902 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-26a01bce-79bd-4bab-976e-591f0eb6c4b2 tempest-ServerPasswordTestJSON-1534707503 tempest-ServerPasswordTestJSON-1534707503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '969cec09484942aebbab6c0f021b7067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9871416ead87433589b8f54783b023b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:13:01.719947 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-26a01bce-79bd-4bab-976e-591f0eb6c4b2 tempest-ServerPasswordTestJSON-1534707503 tempest-ServerPasswordTestJSON-1534707503-project] 10.222.0.13 "GET /compute/v2.1/servers/3463bb31-5f34-4b89-8b40-af83df5c7635" status: 200 len: 1316 microversion: 2.1 time: 0.306101 Nov 01 19:13:01.726743 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 2166/4353] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:13:01 2022] GET /compute/v2.1/servers/3463bb31-5f34-4b89-8b40-af83df5c7635 => generated 1316 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:13:01.754897 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-238cc8be-747f-4e31-930e-ffe3806afb17 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:13:01.755811 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-238cc8be-747f-4e31-930e-ffe3806afb17 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Failed to fetch instance by id -1 {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2981}} Nov 01 19:13:01.755903 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.wsgi [None req-238cc8be-747f-4e31-930e-ffe3806afb17 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] HTTP exception thrown: Instance -1 could not be found. Nov 01 19:13:01.757750 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-238cc8be-747f-4e31-930e-ffe3806afb17 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Request method failure captured: Nov 01 19:13:01.757750 n-d-863052-2 devstack@n-api.service[121402]: request: DELETE /compute/v2.1/servers/-1 HTTP/1.1 Nov 01 19:13:01.757750 n-d-863052-2 devstack@n-api.service[121402]: Accept: application/json Nov 01 19:13:01.757750 n-d-863052-2 devstack@n-api.service[121402]: Accept-Encoding: identity Nov 01 19:13:01.757750 n-d-863052-2 devstack@n-api.service[121402]: Connection: close Nov 01 19:13:01.757750 n-d-863052-2 devstack@n-api.service[121402]: Content-Length: 0 Nov 01 19:13:01.757750 n-d-863052-2 devstack@n-api.service[121402]: Content-Type: application/json Nov 01 19:13:01.757750 n-d-863052-2 devstack@n-api.service[121402]: Host: 10.222.0.13 Nov 01 19:13:01.757750 n-d-863052-2 devstack@n-api.service[121402]: Openstack-System-Scope: None Nov 01 19:13:01.757750 n-d-863052-2 devstack@n-api.service[121402]: User-Agent: python-urllib3/1.26.12 Nov 01 19:13:01.757750 n-d-863052-2 devstack@n-api.service[121402]: X-Auth-Token: gAAAAABjYW9YFTR7hO-vK03S-3HbvOtG2z3_fji2KJH39vNHENu4xIKneeHYviQiPj9ERGiA3aZIA7DvAYzczgSZ5-vK782IQ7CYnUFXvn9Aqt1AbunNMYxhes9BKzhvODzqwzqiQq89wgC4nbpZ9jJWFWMOC4z9bcW4UMi_ylwdZFjmhWfD49s Nov 01 19:13:01.757750 n-d-863052-2 devstack@n-api.service[121402]: X-Domain-Id: None Nov 01 19:13:01.757750 n-d-863052-2 devstack@n-api.service[121402]: X-Domain-Name: None Nov 01 19:13:01.757750 n-d-863052-2 devstack@n-api.service[121402]: X-Identity-Status: Confirmed Nov 01 19:13:01.757750 n-d-863052-2 devstack@n-api.service[121402]: X-Is-Admin-Project: True Nov 01 19:13:01.757750 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Domain-Id: default Nov 01 19:13:01.757750 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Domain-Name: Default Nov 01 19:13:01.757750 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Id: 9ecdc83933544a899117531a960027a7 Nov 01 19:13:01.757750 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Name: tempest-ServersNegativeTestJSON-638944671 Nov 01 19:13:01.757750 n-d-863052-2 devstack@n-api.service[121402]: X-Role: member,reader Nov 01 19:13:01.757750 n-d-863052-2 devstack@n-api.service[121402]: X-Roles: member,reader Nov 01 19:13:01.757750 n-d-863052-2 devstack@n-api.service[121402]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/9ecdc83933544a899117531a960027a7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/9ecdc83933544a899117531a960027a7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_9ecdc83933544a899117531a960027a7", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/9ecdc83933544a899117531a960027a7"}]}] Nov 01 19:13:01.757750 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant: tempest-ServersNegativeTestJSON-638944671 Nov 01 19:13:01.757750 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant-Id: 9ecdc83933544a899117531a960027a7 Nov 01 19:13:01.757750 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant-Name: tempest-ServersNegativeTestJSON-638944671 Nov 01 19:13:01.757750 n-d-863052-2 devstack@n-api.service[121402]: X-User: tempest-ServersNegativeTestJSON-638944671-project Nov 01 19:13:01.757750 n-d-863052-2 devstack@n-api.service[121402]: X-User-Domain-Id: default Nov 01 19:13:01.757750 n-d-863052-2 devstack@n-api.service[121402]: X-User-Domain-Name: Default Nov 01 19:13:01.757750 n-d-863052-2 devstack@n-api.service[121402]: X-User-Id: 3fc5c19b930543f5a5091922a9859813 Nov 01 19:13:01.757750 n-d-863052-2 devstack@n-api.service[121402]: X-User-Name: tempest-ServersNegativeTestJSON-638944671-project Nov 01 19:13:01.757750 n-d-863052-2 devstack@n-api.service[121402]: method: > Nov 01 19:13:01.757750 n-d-863052-2 devstack@n-api.service[121402]: exception: Instance -1 could not be found. Nov 01 19:13:01.757750 n-d-863052-2 devstack@n-api.service[121402]: action_args: {'id': '-1'} Nov 01 19:13:01.757750 n-d-863052-2 devstack@n-api.service[121402]: {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 01 19:13:01.757750 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:13:01.757750 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 01 19:13:01.757750 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 01 19:13:01.757750 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Nov 01 19:13:01.757750 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Nov 01 19:13:01.757750 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance -1 could not be found. Nov 01 19:13:01.757750 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:13:01.757750 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:13:01.757750 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:13:01.757750 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:13:01.757750 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:13:01.757750 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:13:01.757750 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 01 19:13:01.757750 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 01 19:13:01.757750 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 01 19:13:01.757750 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 01 19:13:01.757750 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 01 19:13:01.757750 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 01 19:13:01.757750 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 01 19:13:01.757750 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 01 19:13:01.757750 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 01 19:13:01.757750 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 01 19:13:01.757750 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 01 19:13:01.757750 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 01 19:13:01.757750 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance -1 could not be found. Nov 01 19:13:01.757750 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:13:01.757750 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:13:01.757750 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:13:01.757750 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:13:01.757750 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:13:01.757750 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:13:01.763858 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 01 19:13:01.763858 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 01 19:13:01.763858 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance -1 could not be found. Nov 01 19:13:01.763858 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:13:01.763858 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-238cc8be-747f-4e31-930e-ffe3806afb17 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Returning 404 to user: Instance -1 could not be found. {{(pid=121402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 01 19:13:01.763858 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-238cc8be-747f-4e31-930e-ffe3806afb17 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] 10.222.0.13 "DELETE /compute/v2.1/servers/-1" status: 404 len: 77 microversion: 2.1 time: 0.017506 Nov 01 19:13:01.764896 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 2167/4354] 10.222.0.13 () {58 vars in 1137 bytes} [Tue Nov 1 19:13:01 2022] DELETE /compute/v2.1/servers/-1 => generated 77 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 01 19:13:01.769759 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-5d493fb1-a43b-4ebe-abe0-88282a87e2ff tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:13:01.770351 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-5d493fb1-a43b-4ebe-abe0-88282a87e2ff tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] [instance: b27eaab4-a751-47fb-acdb-db7c99b06a5f] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:13:01.826776 n-d-863052-2 devstack@n-api.service[121402]: DEBUG dbcounter [-] [121402] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=121402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 19:13:01.833868 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-5d493fb1-a43b-4ebe-abe0-88282a87e2ff tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:13:01.843964 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-5d493fb1-a43b-4ebe-abe0-88282a87e2ff tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:13:01.844465 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-5d493fb1-a43b-4ebe-abe0-88282a87e2ff tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:13:01.847786 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-5d493fb1-a43b-4ebe-abe0-88282a87e2ff tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:13:01.853669 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-5d493fb1-a43b-4ebe-abe0-88282a87e2ff tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:13:01.855332 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-5d493fb1-a43b-4ebe-abe0-88282a87e2ff tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:13:02.350121 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-5d493fb1-a43b-4ebe-abe0-88282a87e2ff tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc5c19b930543f5a5091922a9859813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ecdc83933544a899117531a960027a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:13:02.360361 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-5d493fb1-a43b-4ebe-abe0-88282a87e2ff tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] 10.222.0.13 "GET /compute/v2.1/servers/b27eaab4-a751-47fb-acdb-db7c99b06a5f" status: 200 len: 1506 microversion: 2.1 time: 0.594352 Nov 01 19:13:02.365646 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 2168/4355] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:13:01 2022] GET /compute/v2.1/servers/b27eaab4-a751-47fb-acdb-db7c99b06a5f => generated 1506 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:13:02.385409 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-abde3e1b-78a4-4376-aae3-81ba028919e0 tempest-InstanceActionsV221TestJSON-1016349810 tempest-InstanceActionsV221TestJSON-1016349810-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:13:02.386182 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-abde3e1b-78a4-4376-aae3-81ba028919e0 tempest-InstanceActionsV221TestJSON-1016349810 tempest-InstanceActionsV221TestJSON-1016349810-project] [instance: aa7aa9c6-8a88-4948-a623-be7e64e73b5f] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:13:02.398237 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-abde3e1b-78a4-4376-aae3-81ba028919e0 tempest-InstanceActionsV221TestJSON-1016349810 tempest-InstanceActionsV221TestJSON-1016349810-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:13:02.398939 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-abde3e1b-78a4-4376-aae3-81ba028919e0 tempest-InstanceActionsV221TestJSON-1016349810 tempest-InstanceActionsV221TestJSON-1016349810-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:13:02.399759 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-abde3e1b-78a4-4376-aae3-81ba028919e0 tempest-InstanceActionsV221TestJSON-1016349810 tempest-InstanceActionsV221TestJSON-1016349810-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:13:02.400615 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-abde3e1b-78a4-4376-aae3-81ba028919e0 tempest-InstanceActionsV221TestJSON-1016349810 tempest-InstanceActionsV221TestJSON-1016349810-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:13:02.403447 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-abde3e1b-78a4-4376-aae3-81ba028919e0 tempest-InstanceActionsV221TestJSON-1016349810 tempest-InstanceActionsV221TestJSON-1016349810-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:13:02.403997 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-abde3e1b-78a4-4376-aae3-81ba028919e0 tempest-InstanceActionsV221TestJSON-1016349810 tempest-InstanceActionsV221TestJSON-1016349810-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:13:02.759880 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-abde3e1b-78a4-4376-aae3-81ba028919e0 tempest-InstanceActionsV221TestJSON-1016349810 tempest-InstanceActionsV221TestJSON-1016349810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '060d1fb6604f4096b650cf40060db86a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c29ec5eebf84c198c11bae29e3df2d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:13:02.770637 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-abde3e1b-78a4-4376-aae3-81ba028919e0 tempest-InstanceActionsV221TestJSON-1016349810 tempest-InstanceActionsV221TestJSON-1016349810-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '060d1fb6604f4096b650cf40060db86a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c29ec5eebf84c198c11bae29e3df2d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:13:02.776695 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-abde3e1b-78a4-4376-aae3-81ba028919e0 tempest-InstanceActionsV221TestJSON-1016349810 tempest-InstanceActionsV221TestJSON-1016349810-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '060d1fb6604f4096b650cf40060db86a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c29ec5eebf84c198c11bae29e3df2d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:13:02.780864 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-abde3e1b-78a4-4376-aae3-81ba028919e0 tempest-InstanceActionsV221TestJSON-1016349810 tempest-InstanceActionsV221TestJSON-1016349810-project] 10.222.0.13 "GET /compute/v2.1/servers/aa7aa9c6-8a88-4948-a623-be7e64e73b5f" status: 200 len: 1358 microversion: 2.21 time: 0.414001 Nov 01 19:13:02.781650 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 2169/4356] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 19:13:02 2022] GET /compute/v2.1/servers/aa7aa9c6-8a88-4948-a623-be7e64e73b5f => generated 1358 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 19:13:02.787613 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-2a280a4e-3baa-4191-bb2a-63e9e962d5d4 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:13:02.788421 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-2a280a4e-3baa-4191-bb2a-63e9e962d5d4 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] [instance: b27eaab4-a751-47fb-acdb-db7c99b06a5f] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:13:02.795513 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2a280a4e-3baa-4191-bb2a-63e9e962d5d4 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:13:02.796318 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2a280a4e-3baa-4191-bb2a-63e9e962d5d4 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:13:02.797110 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2a280a4e-3baa-4191-bb2a-63e9e962d5d4 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:13:02.798046 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2a280a4e-3baa-4191-bb2a-63e9e962d5d4 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:13:02.798701 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2a280a4e-3baa-4191-bb2a-63e9e962d5d4 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:13:02.799304 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2a280a4e-3baa-4191-bb2a-63e9e962d5d4 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:13:03.046983 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-2a280a4e-3baa-4191-bb2a-63e9e962d5d4 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc5c19b930543f5a5091922a9859813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ecdc83933544a899117531a960027a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:13:03.058619 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-2a280a4e-3baa-4191-bb2a-63e9e962d5d4 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] 10.222.0.13 "GET /compute/v2.1/servers/b27eaab4-a751-47fb-acdb-db7c99b06a5f" status: 200 len: 1506 microversion: 2.1 time: 0.275454 Nov 01 19:13:03.064551 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 2170/4357] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:13:02 2022] GET /compute/v2.1/servers/b27eaab4-a751-47fb-acdb-db7c99b06a5f => generated 1506 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:13:03.072211 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-acde6334-6b31-4e37-8dc8-edb6ce74b6e3 tempest-ServerPasswordTestJSON-1534707503 tempest-ServerPasswordTestJSON-1534707503-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:13:03.072959 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-acde6334-6b31-4e37-8dc8-edb6ce74b6e3 tempest-ServerPasswordTestJSON-1534707503 tempest-ServerPasswordTestJSON-1534707503-project] [instance: 3463bb31-5f34-4b89-8b40-af83df5c7635] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:13:03.092648 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-acde6334-6b31-4e37-8dc8-edb6ce74b6e3 tempest-ServerPasswordTestJSON-1534707503 tempest-ServerPasswordTestJSON-1534707503-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:13:03.093164 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-acde6334-6b31-4e37-8dc8-edb6ce74b6e3 tempest-ServerPasswordTestJSON-1534707503 tempest-ServerPasswordTestJSON-1534707503-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:13:03.093611 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-acde6334-6b31-4e37-8dc8-edb6ce74b6e3 tempest-ServerPasswordTestJSON-1534707503 tempest-ServerPasswordTestJSON-1534707503-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:13:03.094331 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-acde6334-6b31-4e37-8dc8-edb6ce74b6e3 tempest-ServerPasswordTestJSON-1534707503 tempest-ServerPasswordTestJSON-1534707503-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:13:03.094955 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-acde6334-6b31-4e37-8dc8-edb6ce74b6e3 tempest-ServerPasswordTestJSON-1534707503 tempest-ServerPasswordTestJSON-1534707503-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:13:03.095718 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-acde6334-6b31-4e37-8dc8-edb6ce74b6e3 tempest-ServerPasswordTestJSON-1534707503 tempest-ServerPasswordTestJSON-1534707503-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:13:03.849526 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-acde6334-6b31-4e37-8dc8-edb6ce74b6e3 tempest-ServerPasswordTestJSON-1534707503 tempest-ServerPasswordTestJSON-1534707503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '969cec09484942aebbab6c0f021b7067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9871416ead87433589b8f54783b023b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:13:03.861972 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-acde6334-6b31-4e37-8dc8-edb6ce74b6e3 tempest-ServerPasswordTestJSON-1534707503 tempest-ServerPasswordTestJSON-1534707503-project] 10.222.0.13 "GET /compute/v2.1/servers/3463bb31-5f34-4b89-8b40-af83df5c7635" status: 200 len: 1316 microversion: 2.1 time: 0.796226 Nov 01 19:13:03.862884 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 2171/4358] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:13:03 2022] GET /compute/v2.1/servers/3463bb31-5f34-4b89-8b40-af83df5c7635 => generated 1316 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:13:03.867836 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-577d1313-d849-4eb2-b2c0-b10f34b76fb8 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Action: 'action', calling method: >, body: {"forceDelete": {}} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:13:03.882667 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-577d1313-d849-4eb2-b2c0-b10f34b76fb8 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] [instance: 169974ad-5287-46dd-8550-d57572db0faa] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:13:03.896882 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.wsgi [None req-577d1313-d849-4eb2-b2c0-b10f34b76fb8 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] HTTP exception thrown: Instance 169974ad-5287-46dd-8550-d57572db0faa could not be found. Nov 01 19:13:03.906018 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-577d1313-d849-4eb2-b2c0-b10f34b76fb8 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Request method failure captured: Nov 01 19:13:03.906018 n-d-863052-2 devstack@n-api.service[121402]: request: POST /compute/v2.1/servers/169974ad-5287-46dd-8550-d57572db0faa/action HTTP/1.1 Nov 01 19:13:03.906018 n-d-863052-2 devstack@n-api.service[121402]: Accept: application/json Nov 01 19:13:03.906018 n-d-863052-2 devstack@n-api.service[121402]: Accept-Encoding: identity Nov 01 19:13:03.906018 n-d-863052-2 devstack@n-api.service[121402]: Connection: close Nov 01 19:13:03.906018 n-d-863052-2 devstack@n-api.service[121402]: Content-Length: 19 Nov 01 19:13:03.906018 n-d-863052-2 devstack@n-api.service[121402]: Content-Type: application/json Nov 01 19:13:03.906018 n-d-863052-2 devstack@n-api.service[121402]: Host: 10.222.0.13 Nov 01 19:13:03.906018 n-d-863052-2 devstack@n-api.service[121402]: Openstack-System-Scope: None Nov 01 19:13:03.906018 n-d-863052-2 devstack@n-api.service[121402]: User-Agent: python-urllib3/1.26.12 Nov 01 19:13:03.906018 n-d-863052-2 devstack@n-api.service[121402]: X-Auth-Token: gAAAAABjYW9YFTR7hO-vK03S-3HbvOtG2z3_fji2KJH39vNHENu4xIKneeHYviQiPj9ERGiA3aZIA7DvAYzczgSZ5-vK782IQ7CYnUFXvn9Aqt1AbunNMYxhes9BKzhvODzqwzqiQq89wgC4nbpZ9jJWFWMOC4z9bcW4UMi_ylwdZFjmhWfD49s Nov 01 19:13:03.906018 n-d-863052-2 devstack@n-api.service[121402]: X-Domain-Id: None Nov 01 19:13:03.906018 n-d-863052-2 devstack@n-api.service[121402]: X-Domain-Name: None Nov 01 19:13:03.906018 n-d-863052-2 devstack@n-api.service[121402]: X-Identity-Status: Confirmed Nov 01 19:13:03.906018 n-d-863052-2 devstack@n-api.service[121402]: X-Is-Admin-Project: True Nov 01 19:13:03.906018 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Domain-Id: default Nov 01 19:13:03.906018 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Domain-Name: Default Nov 01 19:13:03.906018 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Id: 9ecdc83933544a899117531a960027a7 Nov 01 19:13:03.906018 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Name: tempest-ServersNegativeTestJSON-638944671 Nov 01 19:13:03.906018 n-d-863052-2 devstack@n-api.service[121402]: X-Role: member,reader Nov 01 19:13:03.906018 n-d-863052-2 devstack@n-api.service[121402]: X-Roles: member,reader Nov 01 19:13:03.906018 n-d-863052-2 devstack@n-api.service[121402]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/9ecdc83933544a899117531a960027a7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/9ecdc83933544a899117531a960027a7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_9ecdc83933544a899117531a960027a7", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/9ecdc83933544a899117531a960027a7"}]}] Nov 01 19:13:03.906018 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant: tempest-ServersNegativeTestJSON-638944671 Nov 01 19:13:03.906018 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant-Id: 9ecdc83933544a899117531a960027a7 Nov 01 19:13:03.906018 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant-Name: tempest-ServersNegativeTestJSON-638944671 Nov 01 19:13:03.906018 n-d-863052-2 devstack@n-api.service[121402]: X-User: tempest-ServersNegativeTestJSON-638944671-project Nov 01 19:13:03.906018 n-d-863052-2 devstack@n-api.service[121402]: X-User-Domain-Id: default Nov 01 19:13:03.906018 n-d-863052-2 devstack@n-api.service[121402]: X-User-Domain-Name: Default Nov 01 19:13:03.906018 n-d-863052-2 devstack@n-api.service[121402]: X-User-Id: 3fc5c19b930543f5a5091922a9859813 Nov 01 19:13:03.906018 n-d-863052-2 devstack@n-api.service[121402]: X-User-Name: tempest-ServersNegativeTestJSON-638944671-project Nov 01 19:13:03.906018 n-d-863052-2 devstack@n-api.service[121402]: Nov 01 19:13:03.906018 n-d-863052-2 devstack@n-api.service[121402]: {"forceDelete": {}} Nov 01 19:13:03.906018 n-d-863052-2 devstack@n-api.service[121402]: method: > Nov 01 19:13:03.906018 n-d-863052-2 devstack@n-api.service[121402]: exception: Instance 169974ad-5287-46dd-8550-d57572db0faa could not be found. Nov 01 19:13:03.906018 n-d-863052-2 devstack@n-api.service[121402]: action_args: {'id': '169974ad-5287-46dd-8550-d57572db0faa', 'body': {'forceDelete': {}}} Nov 01 19:13:03.906018 n-d-863052-2 devstack@n-api.service[121402]: {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 01 19:13:03.906018 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:13:03.906018 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 01 19:13:03.906018 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 01 19:13:03.906018 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 01 19:13:03.906018 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 01 19:13:03.906018 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Nov 01 19:13:03.906018 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Nov 01 19:13:03.906018 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 169974ad-5287-46dd-8550-d57572db0faa could not be found. Nov 01 19:13:03.906018 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:13:03.906018 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:13:03.906018 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:13:03.906018 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:13:03.906018 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:13:03.906018 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:13:03.906018 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 01 19:13:03.906018 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 01 19:13:03.906018 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 01 19:13:03.906018 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 01 19:13:03.906018 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 55, in _force_delete Nov 01 19:13:03.906018 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Nov 01 19:13:03.906018 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 01 19:13:03.906018 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 01 19:13:03.906018 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 169974ad-5287-46dd-8550-d57572db0faa could not be found. Nov 01 19:13:03.906018 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:13:03.906018 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:13:03.906018 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:13:03.906018 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:13:03.906018 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:13:03.906018 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:13:03.909686 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 01 19:13:03.909686 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 01 19:13:03.909686 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 169974ad-5287-46dd-8550-d57572db0faa could not be found. Nov 01 19:13:03.909686 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:13:03.911519 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-577d1313-d849-4eb2-b2c0-b10f34b76fb8 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Returning 404 to user: Instance 169974ad-5287-46dd-8550-d57572db0faa could not be found. {{(pid=121402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 01 19:13:03.912613 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-577d1313-d849-4eb2-b2c0-b10f34b76fb8 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] 10.222.0.13 "POST /compute/v2.1/servers/169974ad-5287-46dd-8550-d57572db0faa/action" status: 404 len: 111 microversion: 2.1 time: 0.048563 Nov 01 19:13:03.913711 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 2172/4359] 10.222.0.13 () {60 vars in 1278 bytes} [Tue Nov 1 19:13:03 2022] POST /compute/v2.1/servers/169974ad-5287-46dd-8550-d57572db0faa/action => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 01 19:13:03.923424 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-2865832f-482e-475e-9ea0-9d965ab16ac1 tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:13:03.924493 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-2865832f-482e-475e-9ea0-9d965ab16ac1 tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] [instance: cae1c729-7c41-488d-ab0e-30d1f5d22180] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:13:03.940938 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2865832f-482e-475e-9ea0-9d965ab16ac1 tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:13:03.942466 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2865832f-482e-475e-9ea0-9d965ab16ac1 tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:13:03.945593 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2865832f-482e-475e-9ea0-9d965ab16ac1 tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:13:03.947065 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2865832f-482e-475e-9ea0-9d965ab16ac1 tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:13:03.951589 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2865832f-482e-475e-9ea0-9d965ab16ac1 tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:13:03.952267 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2865832f-482e-475e-9ea0-9d965ab16ac1 tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:13:04.243413 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-2865832f-482e-475e-9ea0-9d965ab16ac1 tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcf93260eaef487dac5d7bb00b26e3b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73cb8697de6d407ba82c334d9f2b48d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:13:04.256511 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-2865832f-482e-475e-9ea0-9d965ab16ac1 tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] 10.222.0.13 "GET /compute/v2.1/servers/cae1c729-7c41-488d-ab0e-30d1f5d22180" status: 200 len: 1667 microversion: 2.1 time: 0.341528 Nov 01 19:13:04.259150 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 2173/4360] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:13:03 2022] GET /compute/v2.1/servers/cae1c729-7c41-488d-ab0e-30d1f5d22180 => generated 1667 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:13:04.274254 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-bbafb442-e939-43e8-b121-942f53fe8c54 tempest-InstanceActionsV221TestJSON-1016349810 tempest-InstanceActionsV221TestJSON-1016349810-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:13:04.276819 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-bbafb442-e939-43e8-b121-942f53fe8c54 tempest-InstanceActionsV221TestJSON-1016349810 tempest-InstanceActionsV221TestJSON-1016349810-project] [instance: aa7aa9c6-8a88-4948-a623-be7e64e73b5f] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:13:04.287904 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-bbafb442-e939-43e8-b121-942f53fe8c54 tempest-InstanceActionsV221TestJSON-1016349810 tempest-InstanceActionsV221TestJSON-1016349810-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:13:04.291770 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-bbafb442-e939-43e8-b121-942f53fe8c54 tempest-InstanceActionsV221TestJSON-1016349810 tempest-InstanceActionsV221TestJSON-1016349810-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:13:04.297906 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-bbafb442-e939-43e8-b121-942f53fe8c54 tempest-InstanceActionsV221TestJSON-1016349810 tempest-InstanceActionsV221TestJSON-1016349810-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:13:04.298807 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-bbafb442-e939-43e8-b121-942f53fe8c54 tempest-InstanceActionsV221TestJSON-1016349810 tempest-InstanceActionsV221TestJSON-1016349810-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:13:04.299636 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-bbafb442-e939-43e8-b121-942f53fe8c54 tempest-InstanceActionsV221TestJSON-1016349810 tempest-InstanceActionsV221TestJSON-1016349810-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:13:04.300293 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-bbafb442-e939-43e8-b121-942f53fe8c54 tempest-InstanceActionsV221TestJSON-1016349810 tempest-InstanceActionsV221TestJSON-1016349810-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:13:04.975608 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-bbafb442-e939-43e8-b121-942f53fe8c54 tempest-InstanceActionsV221TestJSON-1016349810 tempest-InstanceActionsV221TestJSON-1016349810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '060d1fb6604f4096b650cf40060db86a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c29ec5eebf84c198c11bae29e3df2d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:13:04.994195 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-bbafb442-e939-43e8-b121-942f53fe8c54 tempest-InstanceActionsV221TestJSON-1016349810 tempest-InstanceActionsV221TestJSON-1016349810-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '060d1fb6604f4096b650cf40060db86a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c29ec5eebf84c198c11bae29e3df2d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:13:04.995915 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-bbafb442-e939-43e8-b121-942f53fe8c54 tempest-InstanceActionsV221TestJSON-1016349810 tempest-InstanceActionsV221TestJSON-1016349810-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '060d1fb6604f4096b650cf40060db86a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c29ec5eebf84c198c11bae29e3df2d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:13:04.997531 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-bbafb442-e939-43e8-b121-942f53fe8c54 tempest-InstanceActionsV221TestJSON-1016349810 tempest-InstanceActionsV221TestJSON-1016349810-project] 10.222.0.13 "GET /compute/v2.1/servers/aa7aa9c6-8a88-4948-a623-be7e64e73b5f" status: 200 len: 1358 microversion: 2.21 time: 0.737214 Nov 01 19:13:04.998092 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 2174/4361] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 19:13:04 2022] GET /compute/v2.1/servers/aa7aa9c6-8a88-4948-a623-be7e64e73b5f => generated 1358 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 19:13:05.032452 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-1bbfcbb8-a4ca-455d-be1e-3f60c5912588 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:13:05.033141 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-1bbfcbb8-a4ca-455d-be1e-3f60c5912588 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] [instance: b27eaab4-a751-47fb-acdb-db7c99b06a5f] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:13:05.045397 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-1bbfcbb8-a4ca-455d-be1e-3f60c5912588 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:13:05.045896 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-1bbfcbb8-a4ca-455d-be1e-3f60c5912588 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:13:05.049855 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-1bbfcbb8-a4ca-455d-be1e-3f60c5912588 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:13:05.050615 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-1bbfcbb8-a4ca-455d-be1e-3f60c5912588 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:13:05.051096 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-1bbfcbb8-a4ca-455d-be1e-3f60c5912588 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:13:05.051499 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-4ec62b04-932e-4993-8ec8-df9ce7f6ec6c tempest-FloatingIPDetailsTestJSON-1286833380 tempest-FloatingIPDetailsTestJSON-1286833380-project] 10.222.0.13 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 4.637254 Nov 01 19:13:05.051951 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-1bbfcbb8-a4ca-455d-be1e-3f60c5912588 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:13:05.053029 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 2188/4362] 10.222.0.13 () {60 vars in 1170 bytes} [Tue Nov 1 19:13:00 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 4640 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:13:05.059182 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-6c0ed21a-e619-4e2d-896d-ca18aacb7a40 tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-2-1455440949"}} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:13:05.062910 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-6c0ed21a-e619-4e2d-896d-ca18aacb7a40 tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] [instance: cae1c729-7c41-488d-ab0e-30d1f5d22180] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:13:05.072512 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-6c0ed21a-e619-4e2d-896d-ca18aacb7a40 tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:13:05.073324 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-6c0ed21a-e619-4e2d-896d-ca18aacb7a40 tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:13:05.073917 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-6c0ed21a-e619-4e2d-896d-ca18aacb7a40 tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:13:05.074986 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-6c0ed21a-e619-4e2d-896d-ca18aacb7a40 tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:13:05.075703 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-6c0ed21a-e619-4e2d-896d-ca18aacb7a40 tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:13:05.076273 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-6c0ed21a-e619-4e2d-896d-ca18aacb7a40 tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:13:05.506542 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-6c0ed21a-e619-4e2d-896d-ca18aacb7a40 tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] 10.222.0.13 "POST /compute/v2.1/servers/cae1c729-7c41-488d-ab0e-30d1f5d22180/action" status: 202 len: 0 microversion: 2.1 time: 0.452049 Nov 01 19:13:05.509273 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 2189/4363] 10.222.0.13 () {60 vars in 1278 bytes} [Tue Nov 1 19:13:05 2022] POST /compute/v2.1/servers/cae1c729-7c41-488d-ab0e-30d1f5d22180/action => generated 0 bytes in 455 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Nov 01 19:13:05.532160 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-023fa7c3-08e5-4edf-ad15-82ad85a5da80 tempest-ServerPasswordTestJSON-1534707503 tempest-ServerPasswordTestJSON-1534707503-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:13:05.533432 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-023fa7c3-08e5-4edf-ad15-82ad85a5da80 tempest-ServerPasswordTestJSON-1534707503 tempest-ServerPasswordTestJSON-1534707503-project] [instance: 3463bb31-5f34-4b89-8b40-af83df5c7635] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:13:05.564166 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-023fa7c3-08e5-4edf-ad15-82ad85a5da80 tempest-ServerPasswordTestJSON-1534707503 tempest-ServerPasswordTestJSON-1534707503-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:13:05.568384 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-023fa7c3-08e5-4edf-ad15-82ad85a5da80 tempest-ServerPasswordTestJSON-1534707503 tempest-ServerPasswordTestJSON-1534707503-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:13:05.571504 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-023fa7c3-08e5-4edf-ad15-82ad85a5da80 tempest-ServerPasswordTestJSON-1534707503 tempest-ServerPasswordTestJSON-1534707503-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:13:05.572612 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-023fa7c3-08e5-4edf-ad15-82ad85a5da80 tempest-ServerPasswordTestJSON-1534707503 tempest-ServerPasswordTestJSON-1534707503-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:13:05.573088 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-023fa7c3-08e5-4edf-ad15-82ad85a5da80 tempest-ServerPasswordTestJSON-1534707503 tempest-ServerPasswordTestJSON-1534707503-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:13:05.573517 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-023fa7c3-08e5-4edf-ad15-82ad85a5da80 tempest-ServerPasswordTestJSON-1534707503 tempest-ServerPasswordTestJSON-1534707503-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:13:05.658893 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-1bbfcbb8-a4ca-455d-be1e-3f60c5912588 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc5c19b930543f5a5091922a9859813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ecdc83933544a899117531a960027a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:13:05.671508 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-1bbfcbb8-a4ca-455d-be1e-3f60c5912588 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] 10.222.0.13 "GET /compute/v2.1/servers/b27eaab4-a751-47fb-acdb-db7c99b06a5f" status: 200 len: 1506 microversion: 2.1 time: 0.656851 Nov 01 19:13:05.673776 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 2175/4364] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:13:04 2022] GET /compute/v2.1/servers/b27eaab4-a751-47fb-acdb-db7c99b06a5f => generated 1506 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:13:05.686713 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-2ca54c1c-fd2b-4632-b160-9bb68f58b5a0 tempest-FloatingIPDetailsTestJSON-1286833380 tempest-FloatingIPDetailsTestJSON-1286833380-project] Action: 'create', calling method: .version_select at 0x7f0ae19bb5e0>, body: {"pool": null} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:13:05.893054 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-023fa7c3-08e5-4edf-ad15-82ad85a5da80 tempest-ServerPasswordTestJSON-1534707503 tempest-ServerPasswordTestJSON-1534707503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '969cec09484942aebbab6c0f021b7067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9871416ead87433589b8f54783b023b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:13:05.903713 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-023fa7c3-08e5-4edf-ad15-82ad85a5da80 tempest-ServerPasswordTestJSON-1534707503 tempest-ServerPasswordTestJSON-1534707503-project] 10.222.0.13 "GET /compute/v2.1/servers/3463bb31-5f34-4b89-8b40-af83df5c7635" status: 200 len: 1316 microversion: 2.1 time: 0.393189 Nov 01 19:13:05.904490 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 2190/4365] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:13:05 2022] GET /compute/v2.1/servers/3463bb31-5f34-4b89-8b40-af83df5c7635 => generated 1316 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:13:05.912101 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [req-be8df7e2-2ab7-4d88-b3ce-9f55dbf7d44d req-232ae028-3fb0-402f-bc2c-79e98c4703f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa7aa9c6-8a88-4948-a623-be7e64e73b5f", "name": "network-vif-plugged", "status": "completed", "tag": "fb554c8f-139c-4a4c-8638-bbf99708790c"}]} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:13:05.932522 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-be8df7e2-2ab7-4d88-b3ce-9f55dbf7d44d req-232ae028-3fb0-402f-bc2c-79e98c4703f8 service nova] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:13:05.934059 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-be8df7e2-2ab7-4d88-b3ce-9f55dbf7d44d req-232ae028-3fb0-402f-bc2c-79e98c4703f8 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:13:05.934669 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-be8df7e2-2ab7-4d88-b3ce-9f55dbf7d44d req-232ae028-3fb0-402f-bc2c-79e98c4703f8 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:13:05.955082 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.compute.server_external_events [req-be8df7e2-2ab7-4d88-b3ce-9f55dbf7d44d req-232ae028-3fb0-402f-bc2c-79e98c4703f8 service nova] Creating event network-vif-plugged:fb554c8f-139c-4a4c-8638-bbf99708790c for instance aa7aa9c6-8a88-4948-a623-be7e64e73b5f on n-h2-863052-2 Nov 01 19:13:05.969455 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [req-be8df7e2-2ab7-4d88-b3ce-9f55dbf7d44d req-232ae028-3fb0-402f-bc2c-79e98c4703f8 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062378 Nov 01 19:13:05.971811 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 2191/4366] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Nov 1 19:13:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:13:05.979580 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-5363df2a-df71-48c2-8ada-b1922e943954 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:13:05.980555 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-5363df2a-df71-48c2-8ada-b1922e943954 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] [instance: b27eaab4-a751-47fb-acdb-db7c99b06a5f] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:13:05.987524 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-5363df2a-df71-48c2-8ada-b1922e943954 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:13:05.987945 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-5363df2a-df71-48c2-8ada-b1922e943954 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:13:05.988552 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-5363df2a-df71-48c2-8ada-b1922e943954 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:13:05.989615 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-5363df2a-df71-48c2-8ada-b1922e943954 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:13:05.990818 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-5363df2a-df71-48c2-8ada-b1922e943954 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:13:05.991465 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-5363df2a-df71-48c2-8ada-b1922e943954 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:13:06.217506 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-5363df2a-df71-48c2-8ada-b1922e943954 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc5c19b930543f5a5091922a9859813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ecdc83933544a899117531a960027a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:13:06.225338 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-5363df2a-df71-48c2-8ada-b1922e943954 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] 10.222.0.13 "GET /compute/v2.1/servers/b27eaab4-a751-47fb-acdb-db7c99b06a5f" status: 200 len: 1506 microversion: 2.1 time: 0.251295 Nov 01 19:13:06.241079 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 2192/4367] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:13:05 2022] GET /compute/v2.1/servers/b27eaab4-a751-47fb-acdb-db7c99b06a5f => generated 1506 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:13:06.255772 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-b27db57e-6bcb-41fb-ab55-15a0362f2ab5 tempest-InstanceActionsV221TestJSON-1016349810 tempest-InstanceActionsV221TestJSON-1016349810-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:13:06.256680 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-b27db57e-6bcb-41fb-ab55-15a0362f2ab5 tempest-InstanceActionsV221TestJSON-1016349810 tempest-InstanceActionsV221TestJSON-1016349810-project] [instance: aa7aa9c6-8a88-4948-a623-be7e64e73b5f] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:13:06.266468 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-b27db57e-6bcb-41fb-ab55-15a0362f2ab5 tempest-InstanceActionsV221TestJSON-1016349810 tempest-InstanceActionsV221TestJSON-1016349810-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:13:06.266963 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-b27db57e-6bcb-41fb-ab55-15a0362f2ab5 tempest-InstanceActionsV221TestJSON-1016349810 tempest-InstanceActionsV221TestJSON-1016349810-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:13:06.267566 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-b27db57e-6bcb-41fb-ab55-15a0362f2ab5 tempest-InstanceActionsV221TestJSON-1016349810 tempest-InstanceActionsV221TestJSON-1016349810-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:13:06.268554 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-b27db57e-6bcb-41fb-ab55-15a0362f2ab5 tempest-InstanceActionsV221TestJSON-1016349810 tempest-InstanceActionsV221TestJSON-1016349810-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:13:06.269178 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-b27db57e-6bcb-41fb-ab55-15a0362f2ab5 tempest-InstanceActionsV221TestJSON-1016349810 tempest-InstanceActionsV221TestJSON-1016349810-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:13:06.269756 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-b27db57e-6bcb-41fb-ab55-15a0362f2ab5 tempest-InstanceActionsV221TestJSON-1016349810 tempest-InstanceActionsV221TestJSON-1016349810-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:13:06.550371 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-b27db57e-6bcb-41fb-ab55-15a0362f2ab5 tempest-InstanceActionsV221TestJSON-1016349810 tempest-InstanceActionsV221TestJSON-1016349810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '060d1fb6604f4096b650cf40060db86a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c29ec5eebf84c198c11bae29e3df2d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:13:06.562554 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-b27db57e-6bcb-41fb-ab55-15a0362f2ab5 tempest-InstanceActionsV221TestJSON-1016349810 tempest-InstanceActionsV221TestJSON-1016349810-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '060d1fb6604f4096b650cf40060db86a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c29ec5eebf84c198c11bae29e3df2d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:13:06.567678 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-b27db57e-6bcb-41fb-ab55-15a0362f2ab5 tempest-InstanceActionsV221TestJSON-1016349810 tempest-InstanceActionsV221TestJSON-1016349810-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '060d1fb6604f4096b650cf40060db86a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c29ec5eebf84c198c11bae29e3df2d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:13:06.572646 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-b27db57e-6bcb-41fb-ab55-15a0362f2ab5 tempest-InstanceActionsV221TestJSON-1016349810 tempest-InstanceActionsV221TestJSON-1016349810-project] 10.222.0.13 "GET /compute/v2.1/servers/aa7aa9c6-8a88-4948-a623-be7e64e73b5f" status: 200 len: 1358 microversion: 2.21 time: 0.328282 Nov 01 19:13:06.573856 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 2193/4368] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 19:13:06 2022] GET /compute/v2.1/servers/aa7aa9c6-8a88-4948-a623-be7e64e73b5f => generated 1358 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 19:13:06.588678 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-e39246a4-e55f-4023-b4fd-e094b16f0e8b tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 10}} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:13:06.592316 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-e39246a4-e55f-4023-b4fd-e094b16f0e8b tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] [instance: dbb0140c-eb00-4f56-b85b-c823d48a7d56] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:13:06.608434 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.wsgi [None req-e39246a4-e55f-4023-b4fd-e094b16f0e8b tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] HTTP exception thrown: Instance dbb0140c-eb00-4f56-b85b-c823d48a7d56 could not be found. Nov 01 19:13:06.617797 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-e39246a4-e55f-4023-b4fd-e094b16f0e8b tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Request method failure captured: Nov 01 19:13:06.617797 n-d-863052-2 devstack@n-api.service[121403]: request: POST /compute/v2.1/servers/dbb0140c-eb00-4f56-b85b-c823d48a7d56/action HTTP/1.1 Nov 01 19:13:06.617797 n-d-863052-2 devstack@n-api.service[121403]: Accept: application/json Nov 01 19:13:06.617797 n-d-863052-2 devstack@n-api.service[121403]: Accept-Encoding: identity Nov 01 19:13:06.617797 n-d-863052-2 devstack@n-api.service[121403]: Connection: close Nov 01 19:13:06.617797 n-d-863052-2 devstack@n-api.service[121403]: Content-Length: 39 Nov 01 19:13:06.617797 n-d-863052-2 devstack@n-api.service[121403]: Content-Type: application/json Nov 01 19:13:06.617797 n-d-863052-2 devstack@n-api.service[121403]: Host: 10.222.0.13 Nov 01 19:13:06.617797 n-d-863052-2 devstack@n-api.service[121403]: Openstack-System-Scope: None Nov 01 19:13:06.617797 n-d-863052-2 devstack@n-api.service[121403]: User-Agent: python-urllib3/1.26.12 Nov 01 19:13:06.617797 n-d-863052-2 devstack@n-api.service[121403]: X-Auth-Token: gAAAAABjYW9YFTR7hO-vK03S-3HbvOtG2z3_fji2KJH39vNHENu4xIKneeHYviQiPj9ERGiA3aZIA7DvAYzczgSZ5-vK782IQ7CYnUFXvn9Aqt1AbunNMYxhes9BKzhvODzqwzqiQq89wgC4nbpZ9jJWFWMOC4z9bcW4UMi_ylwdZFjmhWfD49s Nov 01 19:13:06.617797 n-d-863052-2 devstack@n-api.service[121403]: X-Domain-Id: None Nov 01 19:13:06.617797 n-d-863052-2 devstack@n-api.service[121403]: X-Domain-Name: None Nov 01 19:13:06.617797 n-d-863052-2 devstack@n-api.service[121403]: X-Identity-Status: Confirmed Nov 01 19:13:06.617797 n-d-863052-2 devstack@n-api.service[121403]: X-Is-Admin-Project: True Nov 01 19:13:06.617797 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Domain-Id: default Nov 01 19:13:06.617797 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Domain-Name: Default Nov 01 19:13:06.617797 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Id: 9ecdc83933544a899117531a960027a7 Nov 01 19:13:06.617797 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Name: tempest-ServersNegativeTestJSON-638944671 Nov 01 19:13:06.617797 n-d-863052-2 devstack@n-api.service[121403]: X-Role: member,reader Nov 01 19:13:06.617797 n-d-863052-2 devstack@n-api.service[121403]: X-Roles: member,reader Nov 01 19:13:06.617797 n-d-863052-2 devstack@n-api.service[121403]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/9ecdc83933544a899117531a960027a7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/9ecdc83933544a899117531a960027a7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_9ecdc83933544a899117531a960027a7", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/9ecdc83933544a899117531a960027a7"}]}] Nov 01 19:13:06.617797 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant: tempest-ServersNegativeTestJSON-638944671 Nov 01 19:13:06.617797 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant-Id: 9ecdc83933544a899117531a960027a7 Nov 01 19:13:06.617797 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant-Name: tempest-ServersNegativeTestJSON-638944671 Nov 01 19:13:06.617797 n-d-863052-2 devstack@n-api.service[121403]: X-User: tempest-ServersNegativeTestJSON-638944671-project Nov 01 19:13:06.617797 n-d-863052-2 devstack@n-api.service[121403]: X-User-Domain-Id: default Nov 01 19:13:06.617797 n-d-863052-2 devstack@n-api.service[121403]: X-User-Domain-Name: Default Nov 01 19:13:06.617797 n-d-863052-2 devstack@n-api.service[121403]: X-User-Id: 3fc5c19b930543f5a5091922a9859813 Nov 01 19:13:06.617797 n-d-863052-2 devstack@n-api.service[121403]: X-User-Name: tempest-ServersNegativeTestJSON-638944671-project Nov 01 19:13:06.617797 n-d-863052-2 devstack@n-api.service[121403]: Nov 01 19:13:06.617797 n-d-863052-2 devstack@n-api.service[121403]: {"os-getConsoleOutput": {"length": 10}} Nov 01 19:13:06.617797 n-d-863052-2 devstack@n-api.service[121403]: method: > Nov 01 19:13:06.617797 n-d-863052-2 devstack@n-api.service[121403]: exception: Instance dbb0140c-eb00-4f56-b85b-c823d48a7d56 could not be found. Nov 01 19:13:06.617797 n-d-863052-2 devstack@n-api.service[121403]: action_args: {'id': 'dbb0140c-eb00-4f56-b85b-c823d48a7d56', 'body': {'os-getConsoleOutput': {'length': 10}}} Nov 01 19:13:06.617797 n-d-863052-2 devstack@n-api.service[121403]: {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 01 19:13:06.617797 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:13:06.617797 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 01 19:13:06.617797 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 01 19:13:06.617797 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 01 19:13:06.617797 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 01 19:13:06.617797 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Nov 01 19:13:06.617797 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Nov 01 19:13:06.617797 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dbb0140c-eb00-4f56-b85b-c823d48a7d56 could not be found. Nov 01 19:13:06.617797 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:13:06.617797 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:13:06.617797 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:13:06.617797 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:13:06.617797 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:13:06.617797 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:13:06.617797 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 01 19:13:06.617797 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 01 19:13:06.617797 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 01 19:13:06.617797 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 01 19:13:06.617797 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 01 19:13:06.617797 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 01 19:13:06.617797 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/console_output.py", line 41, in get_console_output Nov 01 19:13:06.617797 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Nov 01 19:13:06.617797 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 01 19:13:06.617797 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 01 19:13:06.617797 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dbb0140c-eb00-4f56-b85b-c823d48a7d56 could not be found. Nov 01 19:13:06.617797 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:13:06.617797 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:13:06.617797 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:13:06.617797 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:13:06.623198 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:13:06.623198 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:13:06.623198 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 01 19:13:06.623198 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 01 19:13:06.623198 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dbb0140c-eb00-4f56-b85b-c823d48a7d56 could not be found. Nov 01 19:13:06.623198 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:13:06.623198 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-e39246a4-e55f-4023-b4fd-e094b16f0e8b tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Returning 404 to user: Instance dbb0140c-eb00-4f56-b85b-c823d48a7d56 could not be found. {{(pid=121403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 01 19:13:06.623198 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-e39246a4-e55f-4023-b4fd-e094b16f0e8b tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] 10.222.0.13 "POST /compute/v2.1/servers/dbb0140c-eb00-4f56-b85b-c823d48a7d56/action" status: 404 len: 111 microversion: 2.1 time: 0.044379 Nov 01 19:13:06.626048 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 2194/4369] 10.222.0.13 () {60 vars in 1278 bytes} [Tue Nov 1 19:13:06 2022] POST /compute/v2.1/servers/dbb0140c-eb00-4f56-b85b-c823d48a7d56/action => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 01 19:13:06.659675 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-af907627-2fa4-4e54-b9bd-b77e7e5d85cc tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:13:06.669244 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-af907627-2fa4-4e54-b9bd-b77e7e5d85cc tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] [instance: b27eaab4-a751-47fb-acdb-db7c99b06a5f] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:13:06.678439 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-af907627-2fa4-4e54-b9bd-b77e7e5d85cc tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:13:06.679222 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-af907627-2fa4-4e54-b9bd-b77e7e5d85cc tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:13:06.689307 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-af907627-2fa4-4e54-b9bd-b77e7e5d85cc tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:13:06.690311 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-af907627-2fa4-4e54-b9bd-b77e7e5d85cc tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:13:06.690947 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-af907627-2fa4-4e54-b9bd-b77e7e5d85cc tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:13:06.691533 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-af907627-2fa4-4e54-b9bd-b77e7e5d85cc tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:13:06.994747 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-af907627-2fa4-4e54-b9bd-b77e7e5d85cc tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc5c19b930543f5a5091922a9859813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ecdc83933544a899117531a960027a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:13:07.004468 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-af907627-2fa4-4e54-b9bd-b77e7e5d85cc tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] 10.222.0.13 "GET /compute/v2.1/servers/b27eaab4-a751-47fb-acdb-db7c99b06a5f" status: 200 len: 1506 microversion: 2.1 time: 0.377168 Nov 01 19:13:07.023308 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 2195/4370] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:13:06 2022] GET /compute/v2.1/servers/b27eaab4-a751-47fb-acdb-db7c99b06a5f => generated 1506 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:13:07.036333 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-80f6e30f-53bd-4880-aaa8-222f9e2a2720 tempest-ServerPasswordTestJSON-1534707503 tempest-ServerPasswordTestJSON-1534707503-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:13:07.047852 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-80f6e30f-53bd-4880-aaa8-222f9e2a2720 tempest-ServerPasswordTestJSON-1534707503 tempest-ServerPasswordTestJSON-1534707503-project] [instance: 3463bb31-5f34-4b89-8b40-af83df5c7635] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:13:07.062599 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-80f6e30f-53bd-4880-aaa8-222f9e2a2720 tempest-ServerPasswordTestJSON-1534707503 tempest-ServerPasswordTestJSON-1534707503-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:13:07.063097 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-80f6e30f-53bd-4880-aaa8-222f9e2a2720 tempest-ServerPasswordTestJSON-1534707503 tempest-ServerPasswordTestJSON-1534707503-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:13:07.063777 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-80f6e30f-53bd-4880-aaa8-222f9e2a2720 tempest-ServerPasswordTestJSON-1534707503 tempest-ServerPasswordTestJSON-1534707503-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:13:07.064697 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-80f6e30f-53bd-4880-aaa8-222f9e2a2720 tempest-ServerPasswordTestJSON-1534707503 tempest-ServerPasswordTestJSON-1534707503-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:13:07.077617 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-80f6e30f-53bd-4880-aaa8-222f9e2a2720 tempest-ServerPasswordTestJSON-1534707503 tempest-ServerPasswordTestJSON-1534707503-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:13:07.089112 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-80f6e30f-53bd-4880-aaa8-222f9e2a2720 tempest-ServerPasswordTestJSON-1534707503 tempest-ServerPasswordTestJSON-1534707503-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:13:07.416325 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-80f6e30f-53bd-4880-aaa8-222f9e2a2720 tempest-ServerPasswordTestJSON-1534707503 tempest-ServerPasswordTestJSON-1534707503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '969cec09484942aebbab6c0f021b7067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9871416ead87433589b8f54783b023b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:13:07.429316 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-80f6e30f-53bd-4880-aaa8-222f9e2a2720 tempest-ServerPasswordTestJSON-1534707503 tempest-ServerPasswordTestJSON-1534707503-project] 10.222.0.13 "GET /compute/v2.1/servers/3463bb31-5f34-4b89-8b40-af83df5c7635" status: 200 len: 1316 microversion: 2.1 time: 0.404373 Nov 01 19:13:07.430421 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 2196/4371] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:13:07 2022] GET /compute/v2.1/servers/3463bb31-5f34-4b89-8b40-af83df5c7635 => generated 1316 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:13:07.436415 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-787689ec-393d-46e0-8c22-269782612f09 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:13:07.437472 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-787689ec-393d-46e0-8c22-269782612f09 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] [instance: b27eaab4-a751-47fb-acdb-db7c99b06a5f] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:13:07.444883 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-787689ec-393d-46e0-8c22-269782612f09 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:13:07.445644 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-787689ec-393d-46e0-8c22-269782612f09 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:13:07.446372 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-787689ec-393d-46e0-8c22-269782612f09 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:13:07.447291 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-787689ec-393d-46e0-8c22-269782612f09 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:13:07.447965 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-787689ec-393d-46e0-8c22-269782612f09 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:13:07.448946 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-787689ec-393d-46e0-8c22-269782612f09 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:13:07.656290 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-787689ec-393d-46e0-8c22-269782612f09 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc5c19b930543f5a5091922a9859813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ecdc83933544a899117531a960027a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:13:07.665347 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-787689ec-393d-46e0-8c22-269782612f09 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] 10.222.0.13 "GET /compute/v2.1/servers/b27eaab4-a751-47fb-acdb-db7c99b06a5f" status: 200 len: 1506 microversion: 2.1 time: 0.234121 Nov 01 19:13:07.688883 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 2197/4372] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:13:07 2022] GET /compute/v2.1/servers/b27eaab4-a751-47fb-acdb-db7c99b06a5f => generated 1506 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:13:07.696540 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-45edc4af-0d3a-4309-acba-939227ff46fa tempest-InstanceActionsV221TestJSON-1016349810 tempest-InstanceActionsV221TestJSON-1016349810-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:13:07.697787 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-45edc4af-0d3a-4309-acba-939227ff46fa tempest-InstanceActionsV221TestJSON-1016349810 tempest-InstanceActionsV221TestJSON-1016349810-project] [instance: aa7aa9c6-8a88-4948-a623-be7e64e73b5f] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:13:07.705141 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-45edc4af-0d3a-4309-acba-939227ff46fa tempest-InstanceActionsV221TestJSON-1016349810 tempest-InstanceActionsV221TestJSON-1016349810-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:13:07.705883 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-45edc4af-0d3a-4309-acba-939227ff46fa tempest-InstanceActionsV221TestJSON-1016349810 tempest-InstanceActionsV221TestJSON-1016349810-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:13:07.706525 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-45edc4af-0d3a-4309-acba-939227ff46fa tempest-InstanceActionsV221TestJSON-1016349810 tempest-InstanceActionsV221TestJSON-1016349810-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:13:07.707781 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-45edc4af-0d3a-4309-acba-939227ff46fa tempest-InstanceActionsV221TestJSON-1016349810 tempest-InstanceActionsV221TestJSON-1016349810-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:13:07.708479 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-45edc4af-0d3a-4309-acba-939227ff46fa tempest-InstanceActionsV221TestJSON-1016349810 tempest-InstanceActionsV221TestJSON-1016349810-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:13:07.709156 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-45edc4af-0d3a-4309-acba-939227ff46fa tempest-InstanceActionsV221TestJSON-1016349810 tempest-InstanceActionsV221TestJSON-1016349810-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:13:07.906368 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-45edc4af-0d3a-4309-acba-939227ff46fa tempest-InstanceActionsV221TestJSON-1016349810 tempest-InstanceActionsV221TestJSON-1016349810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '060d1fb6604f4096b650cf40060db86a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c29ec5eebf84c198c11bae29e3df2d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:13:07.919256 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-45edc4af-0d3a-4309-acba-939227ff46fa tempest-InstanceActionsV221TestJSON-1016349810 tempest-InstanceActionsV221TestJSON-1016349810-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '060d1fb6604f4096b650cf40060db86a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c29ec5eebf84c198c11bae29e3df2d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:13:07.921039 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-45edc4af-0d3a-4309-acba-939227ff46fa tempest-InstanceActionsV221TestJSON-1016349810 tempest-InstanceActionsV221TestJSON-1016349810-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '060d1fb6604f4096b650cf40060db86a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c29ec5eebf84c198c11bae29e3df2d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:13:07.922702 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-45edc4af-0d3a-4309-acba-939227ff46fa tempest-InstanceActionsV221TestJSON-1016349810 tempest-InstanceActionsV221TestJSON-1016349810-project] 10.222.0.13 "GET /compute/v2.1/servers/aa7aa9c6-8a88-4948-a623-be7e64e73b5f" status: 200 len: 1551 microversion: 2.21 time: 0.232424 Nov 01 19:13:07.924008 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 2198/4373] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 19:13:07 2022] GET /compute/v2.1/servers/aa7aa9c6-8a88-4948-a623-be7e64e73b5f => generated 1551 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 19:13:07.951070 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-cc78e301-ea04-4188-a02d-43acce511412 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:13:07.952551 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-cc78e301-ea04-4188-a02d-43acce511412 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] [instance: 34c615d6-203d-433e-89fa-edf5c1d82d84] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:13:07.959030 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.wsgi [None req-cc78e301-ea04-4188-a02d-43acce511412 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] HTTP exception thrown: Instance 34c615d6-203d-433e-89fa-edf5c1d82d84 could not be found. Nov 01 19:13:07.960920 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-cc78e301-ea04-4188-a02d-43acce511412 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Request method failure captured: Nov 01 19:13:07.960920 n-d-863052-2 devstack@n-api.service[121403]: request: GET /compute/v2.1/servers/34c615d6-203d-433e-89fa-edf5c1d82d84 HTTP/1.1 Nov 01 19:13:07.960920 n-d-863052-2 devstack@n-api.service[121403]: Accept: application/json Nov 01 19:13:07.960920 n-d-863052-2 devstack@n-api.service[121403]: Accept-Encoding: identity Nov 01 19:13:07.960920 n-d-863052-2 devstack@n-api.service[121403]: Connection: close Nov 01 19:13:07.960920 n-d-863052-2 devstack@n-api.service[121403]: Content-Length: 0 Nov 01 19:13:07.960920 n-d-863052-2 devstack@n-api.service[121403]: Content-Type: application/json Nov 01 19:13:07.960920 n-d-863052-2 devstack@n-api.service[121403]: Host: 10.222.0.13 Nov 01 19:13:07.960920 n-d-863052-2 devstack@n-api.service[121403]: Openstack-System-Scope: None Nov 01 19:13:07.960920 n-d-863052-2 devstack@n-api.service[121403]: User-Agent: python-urllib3/1.26.12 Nov 01 19:13:07.960920 n-d-863052-2 devstack@n-api.service[121403]: X-Auth-Token: gAAAAABjYW9YFTR7hO-vK03S-3HbvOtG2z3_fji2KJH39vNHENu4xIKneeHYviQiPj9ERGiA3aZIA7DvAYzczgSZ5-vK782IQ7CYnUFXvn9Aqt1AbunNMYxhes9BKzhvODzqwzqiQq89wgC4nbpZ9jJWFWMOC4z9bcW4UMi_ylwdZFjmhWfD49s Nov 01 19:13:07.960920 n-d-863052-2 devstack@n-api.service[121403]: X-Domain-Id: None Nov 01 19:13:07.960920 n-d-863052-2 devstack@n-api.service[121403]: X-Domain-Name: None Nov 01 19:13:07.960920 n-d-863052-2 devstack@n-api.service[121403]: X-Identity-Status: Confirmed Nov 01 19:13:07.960920 n-d-863052-2 devstack@n-api.service[121403]: X-Is-Admin-Project: True Nov 01 19:13:07.960920 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Domain-Id: default Nov 01 19:13:07.960920 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Domain-Name: Default Nov 01 19:13:07.960920 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Id: 9ecdc83933544a899117531a960027a7 Nov 01 19:13:07.960920 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Name: tempest-ServersNegativeTestJSON-638944671 Nov 01 19:13:07.960920 n-d-863052-2 devstack@n-api.service[121403]: X-Role: member,reader Nov 01 19:13:07.960920 n-d-863052-2 devstack@n-api.service[121403]: X-Roles: member,reader Nov 01 19:13:07.960920 n-d-863052-2 devstack@n-api.service[121403]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/9ecdc83933544a899117531a960027a7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/9ecdc83933544a899117531a960027a7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_9ecdc83933544a899117531a960027a7", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/9ecdc83933544a899117531a960027a7"}]}] Nov 01 19:13:07.960920 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant: tempest-ServersNegativeTestJSON-638944671 Nov 01 19:13:07.960920 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant-Id: 9ecdc83933544a899117531a960027a7 Nov 01 19:13:07.960920 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant-Name: tempest-ServersNegativeTestJSON-638944671 Nov 01 19:13:07.960920 n-d-863052-2 devstack@n-api.service[121403]: X-User: tempest-ServersNegativeTestJSON-638944671-project Nov 01 19:13:07.960920 n-d-863052-2 devstack@n-api.service[121403]: X-User-Domain-Id: default Nov 01 19:13:07.960920 n-d-863052-2 devstack@n-api.service[121403]: X-User-Domain-Name: Default Nov 01 19:13:07.960920 n-d-863052-2 devstack@n-api.service[121403]: X-User-Id: 3fc5c19b930543f5a5091922a9859813 Nov 01 19:13:07.960920 n-d-863052-2 devstack@n-api.service[121403]: X-User-Name: tempest-ServersNegativeTestJSON-638944671-project Nov 01 19:13:07.960920 n-d-863052-2 devstack@n-api.service[121403]: method: > Nov 01 19:13:07.960920 n-d-863052-2 devstack@n-api.service[121403]: exception: Instance 34c615d6-203d-433e-89fa-edf5c1d82d84 could not be found. Nov 01 19:13:07.960920 n-d-863052-2 devstack@n-api.service[121403]: action_args: {'id': '34c615d6-203d-433e-89fa-edf5c1d82d84'} Nov 01 19:13:07.960920 n-d-863052-2 devstack@n-api.service[121403]: {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 01 19:13:07.960920 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:13:07.960920 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 01 19:13:07.960920 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 01 19:13:07.960920 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 01 19:13:07.960920 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 01 19:13:07.960920 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Nov 01 19:13:07.960920 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Nov 01 19:13:07.960920 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 34c615d6-203d-433e-89fa-edf5c1d82d84 could not be found. Nov 01 19:13:07.960920 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:13:07.960920 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:13:07.960920 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:13:07.960920 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:13:07.960920 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:13:07.960920 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:13:07.960920 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 01 19:13:07.960920 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 01 19:13:07.960920 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 01 19:13:07.960920 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 01 19:13:07.960920 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 01 19:13:07.960920 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 01 19:13:07.960920 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 01 19:13:07.960920 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 01 19:13:07.960920 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 01 19:13:07.960920 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 01 19:13:07.960920 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 34c615d6-203d-433e-89fa-edf5c1d82d84 could not be found. Nov 01 19:13:07.960920 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:13:07.960920 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:13:07.960920 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:13:07.960920 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:13:07.960920 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:13:07.964563 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:13:07.964563 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 01 19:13:07.964563 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 01 19:13:07.964563 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 34c615d6-203d-433e-89fa-edf5c1d82d84 could not be found. Nov 01 19:13:07.964563 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:13:07.966466 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-cc78e301-ea04-4188-a02d-43acce511412 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Returning 404 to user: Instance 34c615d6-203d-433e-89fa-edf5c1d82d84 could not be found. {{(pid=121403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 01 19:13:07.967499 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-cc78e301-ea04-4188-a02d-43acce511412 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] 10.222.0.13 "GET /compute/v2.1/servers/34c615d6-203d-433e-89fa-edf5c1d82d84" status: 404 len: 111 microversion: 2.1 time: 0.024293 Nov 01 19:13:07.968492 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 2199/4374] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:13:07 2022] GET /compute/v2.1/servers/34c615d6-203d-433e-89fa-edf5c1d82d84 => generated 111 bytes in 26 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 01 19:13:08.212457 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-7afa0479-f07c-4c06-bc71-32167a0f1ea0 tempest-InstanceActionsTestJSON-621834551 tempest-InstanceActionsTestJSON-621834551-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsTestJSON-server-1556305486", "imageRef": "2d4a0047-1b9e-445f-8af8-1b5c9d93e881", "flavorRef": "452", "networks": [{"uuid": "cd47d2a6-77f0-4731-8020-cc3287e90751"}]}} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:13:08.358140 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.network.neutron [None req-7afa0479-f07c-4c06-bc71-32167a0f1ea0 tempest-InstanceActionsTestJSON-621834551 tempest-InstanceActionsTestJSON-621834551-project] validate_networks() for [('cd47d2a6-77f0-4731-8020-cc3287e90751', None, None, None, None, None)] {{(pid=121403) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 01 19:13:09.019850 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-2ca54c1c-fd2b-4632-b160-9bb68f58b5a0 tempest-FloatingIPDetailsTestJSON-1286833380 tempest-FloatingIPDetailsTestJSON-1286833380-project] 10.222.0.13 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 3.343704 Nov 01 19:13:09.028848 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 2176/4375] 10.222.0.13 () {60 vars in 1170 bytes} [Tue Nov 1 19:13:05 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 3346 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:13:09.028848 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-e5f36ce2-7d34-4874-8301-1f989ca8d141 tempest-InstanceActionsV221TestJSON-1016349810 tempest-InstanceActionsV221TestJSON-1016349810-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:13:09.028848 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-e5f36ce2-7d34-4874-8301-1f989ca8d141 tempest-InstanceActionsV221TestJSON-1016349810 tempest-InstanceActionsV221TestJSON-1016349810-project] [instance: aa7aa9c6-8a88-4948-a623-be7e64e73b5f] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:13:09.038920 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e5f36ce2-7d34-4874-8301-1f989ca8d141 tempest-InstanceActionsV221TestJSON-1016349810 tempest-InstanceActionsV221TestJSON-1016349810-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:13:09.039770 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e5f36ce2-7d34-4874-8301-1f989ca8d141 tempest-InstanceActionsV221TestJSON-1016349810 tempest-InstanceActionsV221TestJSON-1016349810-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:13:09.040228 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e5f36ce2-7d34-4874-8301-1f989ca8d141 tempest-InstanceActionsV221TestJSON-1016349810 tempest-InstanceActionsV221TestJSON-1016349810-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:13:09.042609 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e5f36ce2-7d34-4874-8301-1f989ca8d141 tempest-InstanceActionsV221TestJSON-1016349810 tempest-InstanceActionsV221TestJSON-1016349810-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:13:09.043849 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e5f36ce2-7d34-4874-8301-1f989ca8d141 tempest-InstanceActionsV221TestJSON-1016349810 tempest-InstanceActionsV221TestJSON-1016349810-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:13:09.045442 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e5f36ce2-7d34-4874-8301-1f989ca8d141 tempest-InstanceActionsV221TestJSON-1016349810 tempest-InstanceActionsV221TestJSON-1016349810-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:13:09.084011 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.virt.hardware [None req-7afa0479-f07c-4c06-bc71-32167a0f1ea0 tempest-InstanceActionsTestJSON-621834551 tempest-InstanceActionsTestJSON-621834551-project] Flavor limits 0:0:0 {{(pid=121403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 01 19:13:09.084567 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.virt.hardware [None req-7afa0479-f07c-4c06-bc71-32167a0f1ea0 tempest-InstanceActionsTestJSON-621834551 tempest-InstanceActionsTestJSON-621834551-project] Image limits 0:0:0 {{(pid=121403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 01 19:13:09.084940 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.virt.hardware [None req-7afa0479-f07c-4c06-bc71-32167a0f1ea0 tempest-InstanceActionsTestJSON-621834551 tempest-InstanceActionsTestJSON-621834551-project] Flavor pref 0:0:0 {{(pid=121403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 01 19:13:09.085537 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.virt.hardware [None req-7afa0479-f07c-4c06-bc71-32167a0f1ea0 tempest-InstanceActionsTestJSON-621834551 tempest-InstanceActionsTestJSON-621834551-project] Image pref 0:0:0 {{(pid=121403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 01 19:13:09.085948 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.virt.hardware [None req-7afa0479-f07c-4c06-bc71-32167a0f1ea0 tempest-InstanceActionsTestJSON-621834551 tempest-InstanceActionsTestJSON-621834551-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 01 19:13:09.097969 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-7afa0479-f07c-4c06-bc71-32167a0f1ea0 tempest-InstanceActionsTestJSON-621834551 tempest-InstanceActionsTestJSON-621834551-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:13:09.098897 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-7afa0479-f07c-4c06-bc71-32167a0f1ea0 tempest-InstanceActionsTestJSON-621834551 tempest-InstanceActionsTestJSON-621834551-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:13:09.099533 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-7afa0479-f07c-4c06-bc71-32167a0f1ea0 tempest-InstanceActionsTestJSON-621834551 tempest-InstanceActionsTestJSON-621834551-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:13:09.100265 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-7afa0479-f07c-4c06-bc71-32167a0f1ea0 tempest-InstanceActionsTestJSON-621834551 tempest-InstanceActionsTestJSON-621834551-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:13:09.100745 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-7afa0479-f07c-4c06-bc71-32167a0f1ea0 tempest-InstanceActionsTestJSON-621834551 tempest-InstanceActionsTestJSON-621834551-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:13:09.101379 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-7afa0479-f07c-4c06-bc71-32167a0f1ea0 tempest-InstanceActionsTestJSON-621834551 tempest-InstanceActionsTestJSON-621834551-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:13:09.130795 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.quota [None req-7afa0479-f07c-4c06-bc71-32167a0f1ea0 tempest-InstanceActionsTestJSON-621834551 tempest-InstanceActionsTestJSON-621834551-project] Getting quotas for project 553f439f412542e3a36c5db93d039593. Resources: {'cores', 'ram', 'instances'} {{(pid=121403) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 01 19:13:09.137472 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.quota [None req-7afa0479-f07c-4c06-bc71-32167a0f1ea0 tempest-InstanceActionsTestJSON-621834551 tempest-InstanceActionsTestJSON-621834551-project] Getting quotas for user 32430a3dff994c929c0e635b372c9f86 and project 553f439f412542e3a36c5db93d039593. Resources: {'cores', 'ram', 'instances'} {{(pid=121403) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 01 19:13:09.157569 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-7afa0479-f07c-4c06-bc71-32167a0f1ea0 tempest-InstanceActionsTestJSON-621834551 tempest-InstanceActionsTestJSON-621834551-project] Going to run 1 instances... {{(pid=121403) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 01 19:13:09.160076 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-7afa0479-f07c-4c06-bc71-32167a0f1ea0 tempest-InstanceActionsTestJSON-621834551 tempest-InstanceActionsTestJSON-621834551-project] [instance: 922898a0-ba6d-48cc-9b0b-b3b781eddb9e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2d4a0047-1b9e-445f-8af8-1b5c9d93e881',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121403) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 01 19:13:09.165081 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-e5f36ce2-7d34-4874-8301-1f989ca8d141 tempest-InstanceActionsV221TestJSON-1016349810 tempest-InstanceActionsV221TestJSON-1016349810-project] [instance: aa7aa9c6-8a88-4948-a623-be7e64e73b5f] Going to try to terminate instance {{(pid=121402) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 01 19:13:09.220934 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-7afa0479-f07c-4c06-bc71-32167a0f1ea0 tempest-InstanceActionsTestJSON-621834551 tempest-InstanceActionsTestJSON-621834551-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.251204 Nov 01 19:13:09.222253 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 2200/4376] 10.222.0.13 () {60 vars in 1147 bytes} [Tue Nov 1 19:13:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 1253 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 01 19:13:09.227845 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-fc5c8cc5-34df-4ab2-99e7-4fc043d8de18 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:13:09.229016 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-fc5c8cc5-34df-4ab2-99e7-4fc043d8de18 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] [instance: b27eaab4-a751-47fb-acdb-db7c99b06a5f] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:13:09.240536 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-fc5c8cc5-34df-4ab2-99e7-4fc043d8de18 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:13:09.241540 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-fc5c8cc5-34df-4ab2-99e7-4fc043d8de18 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:13:09.254034 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-fc5c8cc5-34df-4ab2-99e7-4fc043d8de18 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:13:09.255358 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-fc5c8cc5-34df-4ab2-99e7-4fc043d8de18 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:13:09.258245 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-fc5c8cc5-34df-4ab2-99e7-4fc043d8de18 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:13:09.259946 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-fc5c8cc5-34df-4ab2-99e7-4fc043d8de18 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:13:09.362214 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-e5f36ce2-7d34-4874-8301-1f989ca8d141 tempest-InstanceActionsV221TestJSON-1016349810 tempest-InstanceActionsV221TestJSON-1016349810-project] 10.222.0.13 "DELETE /compute/v2.1/servers/aa7aa9c6-8a88-4948-a623-be7e64e73b5f" status: 204 len: 0 microversion: 2.21 time: 0.339652 Nov 01 19:13:09.363568 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 2177/4377] 10.222.0.13 () {60 vars in 1280 bytes} [Tue Nov 1 19:13:09 2022] DELETE /compute/v2.1/servers/aa7aa9c6-8a88-4948-a623-be7e64e73b5f => generated 0 bytes in 342 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 01 19:13:09.375378 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [req-a6890134-dead-4d8b-91ed-5399f7087ff9 req-1894843e-3d35-4aa4-a009-a169e821ed31 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cae1c729-7c41-488d-ab0e-30d1f5d22180", "name": "network-vif-unplugged", "status": "completed", "tag": "3533eeb6-f9e6-47ff-ba35-f061eb6fd641"}, {"server_uuid": "3463bb31-5f34-4b89-8b40-af83df5c7635", "name": "network-vif-plugged", "status": "completed", "tag": "904e2114-15bb-4980-94da-1ab46ccf1c70"}]} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:13:09.403210 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-a6890134-dead-4d8b-91ed-5399f7087ff9 req-1894843e-3d35-4aa4-a009-a169e821ed31 service nova] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:13:09.403696 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-a6890134-dead-4d8b-91ed-5399f7087ff9 req-1894843e-3d35-4aa4-a009-a169e821ed31 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:13:09.404124 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-a6890134-dead-4d8b-91ed-5399f7087ff9 req-1894843e-3d35-4aa4-a009-a169e821ed31 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:13:09.418440 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.compute.server_external_events [req-a6890134-dead-4d8b-91ed-5399f7087ff9 req-1894843e-3d35-4aa4-a009-a169e821ed31 service nova] Creating event network-vif-unplugged:3533eeb6-f9e6-47ff-ba35-f061eb6fd641 for instance cae1c729-7c41-488d-ab0e-30d1f5d22180 on n-h1-863052-2 Nov 01 19:13:09.419103 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.compute.server_external_events [req-a6890134-dead-4d8b-91ed-5399f7087ff9 req-1894843e-3d35-4aa4-a009-a169e821ed31 service nova] Creating event network-vif-plugged:904e2114-15bb-4980-94da-1ab46ccf1c70 for instance 3463bb31-5f34-4b89-8b40-af83df5c7635 on n-h2-863052-2 Nov 01 19:13:09.429853 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [req-a6890134-dead-4d8b-91ed-5399f7087ff9 req-1894843e-3d35-4aa4-a009-a169e821ed31 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.059107 Nov 01 19:13:09.430460 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 2178/4378] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Nov 1 19:13:09 2022] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:13:09.438060 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-e489d454-50e1-4a83-ada9-f9dce934049e tempest-ServerPasswordTestJSON-1534707503 tempest-ServerPasswordTestJSON-1534707503-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:13:09.440136 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-e489d454-50e1-4a83-ada9-f9dce934049e tempest-ServerPasswordTestJSON-1534707503 tempest-ServerPasswordTestJSON-1534707503-project] [instance: 3463bb31-5f34-4b89-8b40-af83df5c7635] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:13:09.456443 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e489d454-50e1-4a83-ada9-f9dce934049e tempest-ServerPasswordTestJSON-1534707503 tempest-ServerPasswordTestJSON-1534707503-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:13:09.459338 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e489d454-50e1-4a83-ada9-f9dce934049e tempest-ServerPasswordTestJSON-1534707503 tempest-ServerPasswordTestJSON-1534707503-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:13:09.460674 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e489d454-50e1-4a83-ada9-f9dce934049e tempest-ServerPasswordTestJSON-1534707503 tempest-ServerPasswordTestJSON-1534707503-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:13:09.462744 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e489d454-50e1-4a83-ada9-f9dce934049e tempest-ServerPasswordTestJSON-1534707503 tempest-ServerPasswordTestJSON-1534707503-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:13:09.463586 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e489d454-50e1-4a83-ada9-f9dce934049e tempest-ServerPasswordTestJSON-1534707503 tempest-ServerPasswordTestJSON-1534707503-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:13:09.464288 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e489d454-50e1-4a83-ada9-f9dce934049e tempest-ServerPasswordTestJSON-1534707503 tempest-ServerPasswordTestJSON-1534707503-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:13:09.638969 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-fc5c8cc5-34df-4ab2-99e7-4fc043d8de18 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc5c19b930543f5a5091922a9859813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ecdc83933544a899117531a960027a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:13:09.649731 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-fc5c8cc5-34df-4ab2-99e7-4fc043d8de18 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] 10.222.0.13 "GET /compute/v2.1/servers/b27eaab4-a751-47fb-acdb-db7c99b06a5f" status: 200 len: 1506 microversion: 2.1 time: 0.426165 Nov 01 19:13:09.652025 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 2201/4379] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:13:09 2022] GET /compute/v2.1/servers/b27eaab4-a751-47fb-acdb-db7c99b06a5f => generated 1506 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:13:09.663317 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-941e73ed-dac1-4ffd-a742-e144b577f6ed tempest-FloatingIPDetailsTestJSON-1286833380 tempest-FloatingIPDetailsTestJSON-1286833380-project] Action: 'create', calling method: .version_select at 0x7f0ae1d1f4c0>, body: {"pool": null} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:13:09.769768 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-e489d454-50e1-4a83-ada9-f9dce934049e tempest-ServerPasswordTestJSON-1534707503 tempest-ServerPasswordTestJSON-1534707503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '969cec09484942aebbab6c0f021b7067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9871416ead87433589b8f54783b023b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:13:09.782832 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-e489d454-50e1-4a83-ada9-f9dce934049e tempest-ServerPasswordTestJSON-1534707503 tempest-ServerPasswordTestJSON-1534707503-project] 10.222.0.13 "GET /compute/v2.1/servers/3463bb31-5f34-4b89-8b40-af83df5c7635" status: 200 len: 1316 microversion: 2.1 time: 0.348112 Nov 01 19:13:09.784733 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 2179/4380] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:13:09 2022] GET /compute/v2.1/servers/3463bb31-5f34-4b89-8b40-af83df5c7635 => generated 1316 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:13:09.803111 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-8bfbb361-5527-46c7-affb-168b8d746093 tempest-InstanceActionsTestJSON-621834551 tempest-InstanceActionsTestJSON-621834551-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:13:09.806919 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-8bfbb361-5527-46c7-affb-168b8d746093 tempest-InstanceActionsTestJSON-621834551 tempest-InstanceActionsTestJSON-621834551-project] [instance: 922898a0-ba6d-48cc-9b0b-b3b781eddb9e] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:13:09.952664 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-8bfbb361-5527-46c7-affb-168b8d746093 tempest-InstanceActionsTestJSON-621834551 tempest-InstanceActionsTestJSON-621834551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32430a3dff994c929c0e635b372c9f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553f439f412542e3a36c5db93d039593', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:13:09.961581 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-8bfbb361-5527-46c7-affb-168b8d746093 tempest-InstanceActionsTestJSON-621834551 tempest-InstanceActionsTestJSON-621834551-project] 10.222.0.13 "GET /compute/v2.1/servers/922898a0-ba6d-48cc-9b0b-b3b781eddb9e" status: 200 len: 1217 microversion: 2.1 time: 0.175486 Nov 01 19:13:09.962860 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 2180/4381] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:13:09 2022] GET /compute/v2.1/servers/922898a0-ba6d-48cc-9b0b-b3b781eddb9e => generated 1217 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:13:09.973270 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-7c22c8ed-4d4d-40dd-af70-1a83e91f76af tempest-InstanceActionsV221TestJSON-1016349810 tempest-InstanceActionsV221TestJSON-1016349810-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:13:09.975157 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-7c22c8ed-4d4d-40dd-af70-1a83e91f76af tempest-InstanceActionsV221TestJSON-1016349810 tempest-InstanceActionsV221TestJSON-1016349810-project] [instance: aa7aa9c6-8a88-4948-a623-be7e64e73b5f] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:13:09.992859 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-7c22c8ed-4d4d-40dd-af70-1a83e91f76af tempest-InstanceActionsV221TestJSON-1016349810 tempest-InstanceActionsV221TestJSON-1016349810-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:13:09.994425 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-7c22c8ed-4d4d-40dd-af70-1a83e91f76af tempest-InstanceActionsV221TestJSON-1016349810 tempest-InstanceActionsV221TestJSON-1016349810-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:13:09.995147 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-7c22c8ed-4d4d-40dd-af70-1a83e91f76af tempest-InstanceActionsV221TestJSON-1016349810 tempest-InstanceActionsV221TestJSON-1016349810-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:13:09.997198 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-7c22c8ed-4d4d-40dd-af70-1a83e91f76af tempest-InstanceActionsV221TestJSON-1016349810 tempest-InstanceActionsV221TestJSON-1016349810-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:13:09.997972 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-7c22c8ed-4d4d-40dd-af70-1a83e91f76af tempest-InstanceActionsV221TestJSON-1016349810 tempest-InstanceActionsV221TestJSON-1016349810-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:13:10.001353 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-7c22c8ed-4d4d-40dd-af70-1a83e91f76af tempest-InstanceActionsV221TestJSON-1016349810 tempest-InstanceActionsV221TestJSON-1016349810-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:13:10.521266 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-7c22c8ed-4d4d-40dd-af70-1a83e91f76af tempest-InstanceActionsV221TestJSON-1016349810 tempest-InstanceActionsV221TestJSON-1016349810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '060d1fb6604f4096b650cf40060db86a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c29ec5eebf84c198c11bae29e3df2d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:13:10.533669 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-7c22c8ed-4d4d-40dd-af70-1a83e91f76af tempest-InstanceActionsV221TestJSON-1016349810 tempest-InstanceActionsV221TestJSON-1016349810-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '060d1fb6604f4096b650cf40060db86a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c29ec5eebf84c198c11bae29e3df2d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:13:10.536150 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-7c22c8ed-4d4d-40dd-af70-1a83e91f76af tempest-InstanceActionsV221TestJSON-1016349810 tempest-InstanceActionsV221TestJSON-1016349810-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '060d1fb6604f4096b650cf40060db86a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c29ec5eebf84c198c11bae29e3df2d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:13:10.537572 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-7c22c8ed-4d4d-40dd-af70-1a83e91f76af tempest-InstanceActionsV221TestJSON-1016349810 tempest-InstanceActionsV221TestJSON-1016349810-project] 10.222.0.13 "GET /compute/v2.1/servers/aa7aa9c6-8a88-4948-a623-be7e64e73b5f" status: 200 len: 1557 microversion: 2.21 time: 0.570751 Nov 01 19:13:10.552645 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 2181/4382] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 19:13:09 2022] GET /compute/v2.1/servers/aa7aa9c6-8a88-4948-a623-be7e64e73b5f => generated 1557 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 19:13:10.568794 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-cd3c1878-895a-4f5a-95bc-753fe1e1e435 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:13:10.571282 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-cd3c1878-895a-4f5a-95bc-753fe1e1e435 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] [instance: b27eaab4-a751-47fb-acdb-db7c99b06a5f] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:13:10.594739 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-cd3c1878-895a-4f5a-95bc-753fe1e1e435 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:13:10.596108 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-cd3c1878-895a-4f5a-95bc-753fe1e1e435 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:13:10.597197 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-cd3c1878-895a-4f5a-95bc-753fe1e1e435 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:13:10.598094 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-cd3c1878-895a-4f5a-95bc-753fe1e1e435 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:13:10.598667 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-cd3c1878-895a-4f5a-95bc-753fe1e1e435 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:13:10.599219 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-cd3c1878-895a-4f5a-95bc-753fe1e1e435 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:13:10.962155 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-cd3c1878-895a-4f5a-95bc-753fe1e1e435 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc5c19b930543f5a5091922a9859813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ecdc83933544a899117531a960027a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:13:10.974352 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-cd3c1878-895a-4f5a-95bc-753fe1e1e435 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] 10.222.0.13 "GET /compute/v2.1/servers/b27eaab4-a751-47fb-acdb-db7c99b06a5f" status: 200 len: 1506 microversion: 2.1 time: 0.434542 Nov 01 19:13:10.977423 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 2182/4383] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:13:10 2022] GET /compute/v2.1/servers/b27eaab4-a751-47fb-acdb-db7c99b06a5f => generated 1506 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:13:10.984874 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-ce143b5a-da60-4d98-957e-d0bfff3467fc tempest-ServerPasswordTestJSON-1534707503 tempest-ServerPasswordTestJSON-1534707503-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:13:10.985529 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-ce143b5a-da60-4d98-957e-d0bfff3467fc tempest-ServerPasswordTestJSON-1534707503 tempest-ServerPasswordTestJSON-1534707503-project] [instance: 3463bb31-5f34-4b89-8b40-af83df5c7635] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:13:11.010734 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-ce143b5a-da60-4d98-957e-d0bfff3467fc tempest-ServerPasswordTestJSON-1534707503 tempest-ServerPasswordTestJSON-1534707503-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:13:11.015029 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-ce143b5a-da60-4d98-957e-d0bfff3467fc tempest-ServerPasswordTestJSON-1534707503 tempest-ServerPasswordTestJSON-1534707503-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:13:11.016444 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-ce143b5a-da60-4d98-957e-d0bfff3467fc tempest-ServerPasswordTestJSON-1534707503 tempest-ServerPasswordTestJSON-1534707503-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:13:11.019940 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-ce143b5a-da60-4d98-957e-d0bfff3467fc tempest-ServerPasswordTestJSON-1534707503 tempest-ServerPasswordTestJSON-1534707503-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:13:11.022375 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-ce143b5a-da60-4d98-957e-d0bfff3467fc tempest-ServerPasswordTestJSON-1534707503 tempest-ServerPasswordTestJSON-1534707503-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:13:11.022993 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-ce143b5a-da60-4d98-957e-d0bfff3467fc tempest-ServerPasswordTestJSON-1534707503 tempest-ServerPasswordTestJSON-1534707503-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:13:11.312263 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-ce143b5a-da60-4d98-957e-d0bfff3467fc tempest-ServerPasswordTestJSON-1534707503 tempest-ServerPasswordTestJSON-1534707503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '969cec09484942aebbab6c0f021b7067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9871416ead87433589b8f54783b023b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:13:11.325573 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-ce143b5a-da60-4d98-957e-d0bfff3467fc tempest-ServerPasswordTestJSON-1534707503 tempest-ServerPasswordTestJSON-1534707503-project] 10.222.0.13 "GET /compute/v2.1/servers/3463bb31-5f34-4b89-8b40-af83df5c7635" status: 200 len: 1316 microversion: 2.1 time: 0.347012 Nov 01 19:13:11.332244 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 2183/4384] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:13:10 2022] GET /compute/v2.1/servers/3463bb31-5f34-4b89-8b40-af83df5c7635 => generated 1316 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:13:11.345334 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-e99c2575-d58c-4f73-9cd6-a33c1977d17e tempest-InstanceActionsTestJSON-621834551 tempest-InstanceActionsTestJSON-621834551-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:13:11.349707 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-e99c2575-d58c-4f73-9cd6-a33c1977d17e tempest-InstanceActionsTestJSON-621834551 tempest-InstanceActionsTestJSON-621834551-project] [instance: 922898a0-ba6d-48cc-9b0b-b3b781eddb9e] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:13:11.380861 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e99c2575-d58c-4f73-9cd6-a33c1977d17e tempest-InstanceActionsTestJSON-621834551 tempest-InstanceActionsTestJSON-621834551-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:13:11.384834 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e99c2575-d58c-4f73-9cd6-a33c1977d17e tempest-InstanceActionsTestJSON-621834551 tempest-InstanceActionsTestJSON-621834551-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:13:11.385372 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e99c2575-d58c-4f73-9cd6-a33c1977d17e tempest-InstanceActionsTestJSON-621834551 tempest-InstanceActionsTestJSON-621834551-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:13:11.388535 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e99c2575-d58c-4f73-9cd6-a33c1977d17e tempest-InstanceActionsTestJSON-621834551 tempest-InstanceActionsTestJSON-621834551-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:13:11.391216 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e99c2575-d58c-4f73-9cd6-a33c1977d17e tempest-InstanceActionsTestJSON-621834551 tempest-InstanceActionsTestJSON-621834551-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:13:11.391763 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-e99c2575-d58c-4f73-9cd6-a33c1977d17e tempest-InstanceActionsTestJSON-621834551 tempest-InstanceActionsTestJSON-621834551-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:13:11.465980 n-d-863052-2 devstack@n-api.service[121402]: DEBUG dbcounter [-] [121402] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 19:13:11.649895 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-e99c2575-d58c-4f73-9cd6-a33c1977d17e tempest-InstanceActionsTestJSON-621834551 tempest-InstanceActionsTestJSON-621834551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32430a3dff994c929c0e635b372c9f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553f439f412542e3a36c5db93d039593', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:13:11.661156 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-e99c2575-d58c-4f73-9cd6-a33c1977d17e tempest-InstanceActionsTestJSON-621834551 tempest-InstanceActionsTestJSON-621834551-project] 10.222.0.13 "GET /compute/v2.1/servers/922898a0-ba6d-48cc-9b0b-b3b781eddb9e" status: 200 len: 1277 microversion: 2.1 time: 0.327401 Nov 01 19:13:11.665766 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 2184/4385] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:13:11 2022] GET /compute/v2.1/servers/922898a0-ba6d-48cc-9b0b-b3b781eddb9e => generated 1277 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:13:11.677796 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-edc072f6-7f01-4cb4-a90c-0e9db6ebd919 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-667725852", "imageRef": "2d4a0047-1b9e-445f-8af8-1b5c9d93e881", "flavorRef": "452", "accessIPv4": "1.1.1.1.1.1", "networks": [{"uuid": "f2fc603f-a5ab-4120-939f-124d49e1f7c1"}]}} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:13:11.701575 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-edc072f6-7f01-4cb4-a90c-0e9db6ebd919 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Request method failure captured: Nov 01 19:13:11.701575 n-d-863052-2 devstack@n-api.service[121402]: request: POST /compute/v2.1/servers HTTP/1.1 Nov 01 19:13:11.701575 n-d-863052-2 devstack@n-api.service[121402]: Accept: application/json Nov 01 19:13:11.701575 n-d-863052-2 devstack@n-api.service[121402]: Accept-Encoding: identity Nov 01 19:13:11.701575 n-d-863052-2 devstack@n-api.service[121402]: Connection: close Nov 01 19:13:11.701575 n-d-863052-2 devstack@n-api.service[121402]: Content-Length: 237 Nov 01 19:13:11.701575 n-d-863052-2 devstack@n-api.service[121402]: Content-Type: application/json Nov 01 19:13:11.701575 n-d-863052-2 devstack@n-api.service[121402]: Host: 10.222.0.13 Nov 01 19:13:11.701575 n-d-863052-2 devstack@n-api.service[121402]: Openstack-System-Scope: None Nov 01 19:13:11.701575 n-d-863052-2 devstack@n-api.service[121402]: User-Agent: python-urllib3/1.26.12 Nov 01 19:13:11.701575 n-d-863052-2 devstack@n-api.service[121402]: X-Auth-Token: gAAAAABjYW9YFTR7hO-vK03S-3HbvOtG2z3_fji2KJH39vNHENu4xIKneeHYviQiPj9ERGiA3aZIA7DvAYzczgSZ5-vK782IQ7CYnUFXvn9Aqt1AbunNMYxhes9BKzhvODzqwzqiQq89wgC4nbpZ9jJWFWMOC4z9bcW4UMi_ylwdZFjmhWfD49s Nov 01 19:13:11.701575 n-d-863052-2 devstack@n-api.service[121402]: X-Domain-Id: None Nov 01 19:13:11.701575 n-d-863052-2 devstack@n-api.service[121402]: X-Domain-Name: None Nov 01 19:13:11.701575 n-d-863052-2 devstack@n-api.service[121402]: X-Identity-Status: Confirmed Nov 01 19:13:11.701575 n-d-863052-2 devstack@n-api.service[121402]: X-Is-Admin-Project: True Nov 01 19:13:11.701575 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Domain-Id: default Nov 01 19:13:11.701575 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Domain-Name: Default Nov 01 19:13:11.701575 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Id: 9ecdc83933544a899117531a960027a7 Nov 01 19:13:11.701575 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Name: tempest-ServersNegativeTestJSON-638944671 Nov 01 19:13:11.701575 n-d-863052-2 devstack@n-api.service[121402]: X-Role: member,reader Nov 01 19:13:11.701575 n-d-863052-2 devstack@n-api.service[121402]: X-Roles: member,reader Nov 01 19:13:11.701575 n-d-863052-2 devstack@n-api.service[121402]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/9ecdc83933544a899117531a960027a7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/9ecdc83933544a899117531a960027a7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_9ecdc83933544a899117531a960027a7", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/9ecdc83933544a899117531a960027a7"}]}] Nov 01 19:13:11.701575 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant: tempest-ServersNegativeTestJSON-638944671 Nov 01 19:13:11.701575 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant-Id: 9ecdc83933544a899117531a960027a7 Nov 01 19:13:11.701575 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant-Name: tempest-ServersNegativeTestJSON-638944671 Nov 01 19:13:11.701575 n-d-863052-2 devstack@n-api.service[121402]: X-User: tempest-ServersNegativeTestJSON-638944671-project Nov 01 19:13:11.701575 n-d-863052-2 devstack@n-api.service[121402]: X-User-Domain-Id: default Nov 01 19:13:11.701575 n-d-863052-2 devstack@n-api.service[121402]: X-User-Domain-Name: Default Nov 01 19:13:11.701575 n-d-863052-2 devstack@n-api.service[121402]: X-User-Id: 3fc5c19b930543f5a5091922a9859813 Nov 01 19:13:11.701575 n-d-863052-2 devstack@n-api.service[121402]: X-User-Name: tempest-ServersNegativeTestJSON-638944671-project Nov 01 19:13:11.701575 n-d-863052-2 devstack@n-api.service[121402]: Nov 01 19:13:11.701575 n-d-863052-2 devstack@n-api.service[121402]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-667725852", "imageRef": "2d4a0047-1b9e-445f-8af8-1b5c9d93e881", "flavorRef": "452", "accessIPv4": "1.1.1.1.1.1", "networks": [{"uuid": "f2fc603f-a5ab-4120-939f-124d49e1f7c1"}]}} Nov 01 19:13:11.701575 n-d-863052-2 devstack@n-api.service[121402]: method: > Nov 01 19:13:11.701575 n-d-863052-2 devstack@n-api.service[121402]: exception: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Nov 01 19:13:11.701575 n-d-863052-2 devstack@n-api.service[121402]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-667725852', 'imageRef': '2d4a0047-1b9e-445f-8af8-1b5c9d93e881', 'flavorRef': '452', 'accessIPv4': '1.1.1.1.1.1', 'networks': [{'uuid': 'f2fc603f-a5ab-4120-939f-124d49e1f7c1'}]}}} Nov 01 19:13:11.701575 n-d-863052-2 devstack@n-api.service[121402]: {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 01 19:13:11.701575 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:13:11.701575 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Nov 01 19:13:11.701575 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi result = func(instance) Nov 01 19:13:11.701575 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/_format.py", line 253, in is_ipv4 Nov 01 19:13:11.701575 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return bool(ipaddress.IPv4Address(instance)) Nov 01 19:13:11.701575 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1257, in __init__ Nov 01 19:13:11.701575 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi self._ip = self._ip_int_from_string(addr_str) Nov 01 19:13:11.701575 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1144, in _ip_int_from_string Nov 01 19:13:11.701575 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise AddressValueError("Expected 4 octets in %r" % ip_str) Nov 01 19:13:11.701575 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi ipaddress.AddressValueError: Expected 4 octets in '1.1.1.1.1.1' Nov 01 19:13:11.701575 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:13:11.701575 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Nov 01 19:13:11.701575 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:13:11.701575 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:13:11.701575 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Nov 01 19:13:11.701575 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Nov 01 19:13:11.701575 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Nov 01 19:13:11.701575 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise error Nov 01 19:13:11.701575 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '1.1.1.1.1.1' is not a 'ipv4' Nov 01 19:13:11.701575 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:13:11.701575 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['server']['properties']['accessIPv4']: Nov 01 19:13:11.701575 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi {'format': 'ipv4', 'type': 'string'} Nov 01 19:13:11.701575 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:13:11.701575 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi On instance['server']: Nov 01 19:13:11.701575 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi '1.1.1.1.1.1' Nov 01 19:13:11.701575 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:13:11.701575 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:13:11.701575 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:13:11.701575 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:13:11.706002 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:13:11.706002 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:13:11.706002 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 01 19:13:11.706002 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 01 19:13:11.706002 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 01 19:13:11.706002 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 01 19:13:11.706002 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 01 19:13:11.706002 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 01 19:13:11.706002 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Nov 01 19:13:11.706002 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Nov 01 19:13:11.706002 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Nov 01 19:13:11.706002 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Nov 01 19:13:11.706002 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Nov 01 19:13:11.706002 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Nov 01 19:13:11.706002 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Nov 01 19:13:11.706002 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:13:11.706002 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:13:11.706002 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:13:11.706002 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:13:11.706002 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:13:11.706002 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:13:11.706002 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Nov 01 19:13:11.706002 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Nov 01 19:13:11.706002 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Nov 01 19:13:11.706002 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:13:11.706002 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-edc072f6-7f01-4cb4-a90c-0e9db6ebd919 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Returning 400 to user: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' {{(pid=121402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 01 19:13:11.706002 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-edc072f6-7f01-4cb4-a90c-0e9db6ebd919 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.035805 Nov 01 19:13:11.706002 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 2185/4386] 10.222.0.13 () {60 vars in 1147 bytes} [Tue Nov 1 19:13:11 2022] POST /compute/v2.1/servers => generated 139 bytes in 38 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 01 19:13:11.712005 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-7f2788b8-daff-443c-b854-6238e3a1ec01 tempest-InstanceActionsV221TestJSON-1016349810 tempest-InstanceActionsV221TestJSON-1016349810-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:13:11.713973 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-7f2788b8-daff-443c-b854-6238e3a1ec01 tempest-InstanceActionsV221TestJSON-1016349810 tempest-InstanceActionsV221TestJSON-1016349810-project] [instance: aa7aa9c6-8a88-4948-a623-be7e64e73b5f] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:13:11.727315 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-7f2788b8-daff-443c-b854-6238e3a1ec01 tempest-InstanceActionsV221TestJSON-1016349810 tempest-InstanceActionsV221TestJSON-1016349810-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:13:11.727824 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-7f2788b8-daff-443c-b854-6238e3a1ec01 tempest-InstanceActionsV221TestJSON-1016349810 tempest-InstanceActionsV221TestJSON-1016349810-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:13:11.728278 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-7f2788b8-daff-443c-b854-6238e3a1ec01 tempest-InstanceActionsV221TestJSON-1016349810 tempest-InstanceActionsV221TestJSON-1016349810-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:13:11.734966 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-7f2788b8-daff-443c-b854-6238e3a1ec01 tempest-InstanceActionsV221TestJSON-1016349810 tempest-InstanceActionsV221TestJSON-1016349810-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:13:11.736054 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-7f2788b8-daff-443c-b854-6238e3a1ec01 tempest-InstanceActionsV221TestJSON-1016349810 tempest-InstanceActionsV221TestJSON-1016349810-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:13:11.737412 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-7f2788b8-daff-443c-b854-6238e3a1ec01 tempest-InstanceActionsV221TestJSON-1016349810 tempest-InstanceActionsV221TestJSON-1016349810-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:13:12.011218 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-7f2788b8-daff-443c-b854-6238e3a1ec01 tempest-InstanceActionsV221TestJSON-1016349810 tempest-InstanceActionsV221TestJSON-1016349810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '060d1fb6604f4096b650cf40060db86a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c29ec5eebf84c198c11bae29e3df2d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:13:12.023649 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-7f2788b8-daff-443c-b854-6238e3a1ec01 tempest-InstanceActionsV221TestJSON-1016349810 tempest-InstanceActionsV221TestJSON-1016349810-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '060d1fb6604f4096b650cf40060db86a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c29ec5eebf84c198c11bae29e3df2d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:13:12.028945 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-7f2788b8-daff-443c-b854-6238e3a1ec01 tempest-InstanceActionsV221TestJSON-1016349810 tempest-InstanceActionsV221TestJSON-1016349810-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '060d1fb6604f4096b650cf40060db86a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c29ec5eebf84c198c11bae29e3df2d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:13:12.037826 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-7f2788b8-daff-443c-b854-6238e3a1ec01 tempest-InstanceActionsV221TestJSON-1016349810 tempest-InstanceActionsV221TestJSON-1016349810-project] 10.222.0.13 "GET /compute/v2.1/servers/aa7aa9c6-8a88-4948-a623-be7e64e73b5f" status: 200 len: 1557 microversion: 2.21 time: 0.333014 Nov 01 19:13:12.038683 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 2186/4387] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 19:13:11 2022] GET /compute/v2.1/servers/aa7aa9c6-8a88-4948-a623-be7e64e73b5f => generated 1557 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 19:13:12.048900 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [req-9b4a480e-7b55-44cf-b67d-18deae58a4fe req-c6aeea27-46ea-4dec-8c04-854740d57492 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cae1c729-7c41-488d-ab0e-30d1f5d22180", "name": "network-vif-plugged", "status": "completed", "tag": "3533eeb6-f9e6-47ff-ba35-f061eb6fd641"}]} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:13:12.070420 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-9b4a480e-7b55-44cf-b67d-18deae58a4fe req-c6aeea27-46ea-4dec-8c04-854740d57492 service nova] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:13:12.072244 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-9b4a480e-7b55-44cf-b67d-18deae58a4fe req-c6aeea27-46ea-4dec-8c04-854740d57492 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:13:12.073251 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-9b4a480e-7b55-44cf-b67d-18deae58a4fe req-c6aeea27-46ea-4dec-8c04-854740d57492 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:13:12.099597 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.compute.server_external_events [req-9b4a480e-7b55-44cf-b67d-18deae58a4fe req-c6aeea27-46ea-4dec-8c04-854740d57492 service nova] Creating event network-vif-plugged:3533eeb6-f9e6-47ff-ba35-f061eb6fd641 for instance cae1c729-7c41-488d-ab0e-30d1f5d22180 on n-h1-863052-2 Nov 01 19:13:12.113500 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [req-9b4a480e-7b55-44cf-b67d-18deae58a4fe req-c6aeea27-46ea-4dec-8c04-854740d57492 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073225 Nov 01 19:13:12.114751 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 2187/4388] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Nov 1 19:13:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:13:12.127562 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-893b6c9b-272c-4570-9cba-4dfcd7183383 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:13:12.128313 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-893b6c9b-272c-4570-9cba-4dfcd7183383 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] [instance: b27eaab4-a751-47fb-acdb-db7c99b06a5f] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:13:12.148947 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-893b6c9b-272c-4570-9cba-4dfcd7183383 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:13:12.149594 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-893b6c9b-272c-4570-9cba-4dfcd7183383 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:13:12.150109 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-893b6c9b-272c-4570-9cba-4dfcd7183383 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:13:12.150864 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-893b6c9b-272c-4570-9cba-4dfcd7183383 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:13:12.151336 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-893b6c9b-272c-4570-9cba-4dfcd7183383 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:13:12.151768 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-893b6c9b-272c-4570-9cba-4dfcd7183383 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:13:12.510999 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-893b6c9b-272c-4570-9cba-4dfcd7183383 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc5c19b930543f5a5091922a9859813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ecdc83933544a899117531a960027a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:13:12.521145 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-893b6c9b-272c-4570-9cba-4dfcd7183383 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] 10.222.0.13 "GET /compute/v2.1/servers/b27eaab4-a751-47fb-acdb-db7c99b06a5f" status: 200 len: 1506 microversion: 2.1 time: 0.404873 Nov 01 19:13:12.523983 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 2188/4389] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:13:12 2022] GET /compute/v2.1/servers/b27eaab4-a751-47fb-acdb-db7c99b06a5f => generated 1506 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:13:12.588792 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-a5bba9bc-e296-48fb-be84-e2808c9f46be tempest-ServerPasswordTestJSON-1534707503 tempest-ServerPasswordTestJSON-1534707503-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:13:12.589769 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-a5bba9bc-e296-48fb-be84-e2808c9f46be tempest-ServerPasswordTestJSON-1534707503 tempest-ServerPasswordTestJSON-1534707503-project] [instance: 3463bb31-5f34-4b89-8b40-af83df5c7635] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:13:12.619575 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-a5bba9bc-e296-48fb-be84-e2808c9f46be tempest-ServerPasswordTestJSON-1534707503 tempest-ServerPasswordTestJSON-1534707503-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:13:12.627314 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-a5bba9bc-e296-48fb-be84-e2808c9f46be tempest-ServerPasswordTestJSON-1534707503 tempest-ServerPasswordTestJSON-1534707503-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:13:12.628100 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-a5bba9bc-e296-48fb-be84-e2808c9f46be tempest-ServerPasswordTestJSON-1534707503 tempest-ServerPasswordTestJSON-1534707503-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:13:12.631655 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-a5bba9bc-e296-48fb-be84-e2808c9f46be tempest-ServerPasswordTestJSON-1534707503 tempest-ServerPasswordTestJSON-1534707503-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:13:12.636240 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-a5bba9bc-e296-48fb-be84-e2808c9f46be tempest-ServerPasswordTestJSON-1534707503 tempest-ServerPasswordTestJSON-1534707503-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:13:12.638509 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-a5bba9bc-e296-48fb-be84-e2808c9f46be tempest-ServerPasswordTestJSON-1534707503 tempest-ServerPasswordTestJSON-1534707503-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:13:13.387267 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-a5bba9bc-e296-48fb-be84-e2808c9f46be tempest-ServerPasswordTestJSON-1534707503 tempest-ServerPasswordTestJSON-1534707503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '969cec09484942aebbab6c0f021b7067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9871416ead87433589b8f54783b023b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:13:13.395367 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-a5bba9bc-e296-48fb-be84-e2808c9f46be tempest-ServerPasswordTestJSON-1534707503 tempest-ServerPasswordTestJSON-1534707503-project] 10.222.0.13 "GET /compute/v2.1/servers/3463bb31-5f34-4b89-8b40-af83df5c7635" status: 200 len: 1316 microversion: 2.1 time: 0.866860 Nov 01 19:13:13.396262 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 2189/4390] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:13:12 2022] GET /compute/v2.1/servers/3463bb31-5f34-4b89-8b40-af83df5c7635 => generated 1316 bytes in 872 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:13:13.412730 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-1de8e504-3f9e-4b4c-b5a8-658583834651 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:13:13.413644 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-1de8e504-3f9e-4b4c-b5a8-658583834651 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] [instance: b27eaab4-a751-47fb-acdb-db7c99b06a5f] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:13:13.439075 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-1de8e504-3f9e-4b4c-b5a8-658583834651 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:13:13.440019 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-1de8e504-3f9e-4b4c-b5a8-658583834651 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:13:13.440664 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-1de8e504-3f9e-4b4c-b5a8-658583834651 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:13:13.443348 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-1de8e504-3f9e-4b4c-b5a8-658583834651 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:13:13.445454 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-1de8e504-3f9e-4b4c-b5a8-658583834651 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:13:13.447125 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-1de8e504-3f9e-4b4c-b5a8-658583834651 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:13:13.773378 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-941e73ed-dac1-4ffd-a742-e144b577f6ed tempest-FloatingIPDetailsTestJSON-1286833380 tempest-FloatingIPDetailsTestJSON-1286833380-project] 10.222.0.13 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 4.118978 Nov 01 19:13:13.774625 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 2202/4391] 10.222.0.13 () {60 vars in 1170 bytes} [Tue Nov 1 19:13:09 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 4121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:13:13.787654 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-02d12c85-e080-4c6a-8876-c0ccce60f655 tempest-InstanceActionsTestJSON-621834551 tempest-InstanceActionsTestJSON-621834551-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:13:13.789129 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-02d12c85-e080-4c6a-8876-c0ccce60f655 tempest-InstanceActionsTestJSON-621834551 tempest-InstanceActionsTestJSON-621834551-project] [instance: 922898a0-ba6d-48cc-9b0b-b3b781eddb9e] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:13:13.831257 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-02d12c85-e080-4c6a-8876-c0ccce60f655 tempest-InstanceActionsTestJSON-621834551 tempest-InstanceActionsTestJSON-621834551-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:13:13.831756 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-02d12c85-e080-4c6a-8876-c0ccce60f655 tempest-InstanceActionsTestJSON-621834551 tempest-InstanceActionsTestJSON-621834551-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:13:13.832200 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-02d12c85-e080-4c6a-8876-c0ccce60f655 tempest-InstanceActionsTestJSON-621834551 tempest-InstanceActionsTestJSON-621834551-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:13:13.832942 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-02d12c85-e080-4c6a-8876-c0ccce60f655 tempest-InstanceActionsTestJSON-621834551 tempest-InstanceActionsTestJSON-621834551-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:13:13.833398 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-02d12c85-e080-4c6a-8876-c0ccce60f655 tempest-InstanceActionsTestJSON-621834551 tempest-InstanceActionsTestJSON-621834551-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:13:13.833828 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-02d12c85-e080-4c6a-8876-c0ccce60f655 tempest-InstanceActionsTestJSON-621834551 tempest-InstanceActionsTestJSON-621834551-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:13:14.026768 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-1de8e504-3f9e-4b4c-b5a8-658583834651 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc5c19b930543f5a5091922a9859813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ecdc83933544a899117531a960027a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:13:14.037026 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-1de8e504-3f9e-4b4c-b5a8-658583834651 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] 10.222.0.13 "GET /compute/v2.1/servers/b27eaab4-a751-47fb-acdb-db7c99b06a5f" status: 200 len: 1506 microversion: 2.1 time: 0.639338 Nov 01 19:13:14.042353 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 2190/4392] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:13:13 2022] GET /compute/v2.1/servers/b27eaab4-a751-47fb-acdb-db7c99b06a5f => generated 1506 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:13:14.048002 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-efb0069b-7f5c-480f-8793-c460b5cdf3d1 tempest-InstanceActionsV221TestJSON-1016349810 tempest-InstanceActionsV221TestJSON-1016349810-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:13:14.057192 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-efb0069b-7f5c-480f-8793-c460b5cdf3d1 tempest-InstanceActionsV221TestJSON-1016349810 tempest-InstanceActionsV221TestJSON-1016349810-project] [instance: aa7aa9c6-8a88-4948-a623-be7e64e73b5f] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:13:14.066950 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-efb0069b-7f5c-480f-8793-c460b5cdf3d1 tempest-InstanceActionsV221TestJSON-1016349810 tempest-InstanceActionsV221TestJSON-1016349810-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:13:14.067716 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-02d12c85-e080-4c6a-8876-c0ccce60f655 tempest-InstanceActionsTestJSON-621834551 tempest-InstanceActionsTestJSON-621834551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32430a3dff994c929c0e635b372c9f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553f439f412542e3a36c5db93d039593', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:13:14.068456 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-efb0069b-7f5c-480f-8793-c460b5cdf3d1 tempest-InstanceActionsV221TestJSON-1016349810 tempest-InstanceActionsV221TestJSON-1016349810-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:13:14.070430 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-efb0069b-7f5c-480f-8793-c460b5cdf3d1 tempest-InstanceActionsV221TestJSON-1016349810 tempest-InstanceActionsV221TestJSON-1016349810-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:13:14.071422 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-efb0069b-7f5c-480f-8793-c460b5cdf3d1 tempest-InstanceActionsV221TestJSON-1016349810 tempest-InstanceActionsV221TestJSON-1016349810-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:13:14.080655 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-efb0069b-7f5c-480f-8793-c460b5cdf3d1 tempest-InstanceActionsV221TestJSON-1016349810 tempest-InstanceActionsV221TestJSON-1016349810-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:13:14.081257 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-efb0069b-7f5c-480f-8793-c460b5cdf3d1 tempest-InstanceActionsV221TestJSON-1016349810 tempest-InstanceActionsV221TestJSON-1016349810-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:13:14.083456 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-02d12c85-e080-4c6a-8876-c0ccce60f655 tempest-InstanceActionsTestJSON-621834551 tempest-InstanceActionsTestJSON-621834551-project] 10.222.0.13 "GET /compute/v2.1/servers/922898a0-ba6d-48cc-9b0b-b3b781eddb9e" status: 200 len: 1317 microversion: 2.1 time: 0.299214 Nov 01 19:13:14.101062 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 2203/4393] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:13:13 2022] GET /compute/v2.1/servers/922898a0-ba6d-48cc-9b0b-b3b781eddb9e => generated 1317 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:13:14.112379 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [req-6c452df4-f64a-4f5f-8fee-bf942560faf1 req-6054f54c-1445-42dd-9c35-5d0c2839d015 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa7aa9c6-8a88-4948-a623-be7e64e73b5f", "name": "network-vif-deleted", "tag": "fb554c8f-139c-4a4c-8638-bbf99708790c"}]} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:13:14.129921 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-6c452df4-f64a-4f5f-8fee-bf942560faf1 req-6054f54c-1445-42dd-9c35-5d0c2839d015 service nova] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:13:14.130632 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-6c452df4-f64a-4f5f-8fee-bf942560faf1 req-6054f54c-1445-42dd-9c35-5d0c2839d015 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:13:14.131663 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-6c452df4-f64a-4f5f-8fee-bf942560faf1 req-6054f54c-1445-42dd-9c35-5d0c2839d015 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:13:14.149913 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-efb0069b-7f5c-480f-8793-c460b5cdf3d1 tempest-InstanceActionsV221TestJSON-1016349810 tempest-InstanceActionsV221TestJSON-1016349810-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:13:14.150594 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-efb0069b-7f5c-480f-8793-c460b5cdf3d1 tempest-InstanceActionsV221TestJSON-1016349810 tempest-InstanceActionsV221TestJSON-1016349810-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:13:14.151206 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-efb0069b-7f5c-480f-8793-c460b5cdf3d1 tempest-InstanceActionsV221TestJSON-1016349810 tempest-InstanceActionsV221TestJSON-1016349810-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:13:14.151814 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.objects.instance [None req-efb0069b-7f5c-480f-8793-c460b5cdf3d1 tempest-InstanceActionsV221TestJSON-1016349810 tempest-InstanceActionsV221TestJSON-1016349810-project] Lazy-loading 'fault' on Instance uuid aa7aa9c6-8a88-4948-a623-be7e64e73b5f {{(pid=121402) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 01 19:13:14.169741 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.compute.server_external_events [req-6c452df4-f64a-4f5f-8fee-bf942560faf1 req-6054f54c-1445-42dd-9c35-5d0c2839d015 service nova] Creating event network-vif-deleted:fb554c8f-139c-4a4c-8638-bbf99708790c for instance aa7aa9c6-8a88-4948-a623-be7e64e73b5f on n-h2-863052-2 Nov 01 19:13:14.190430 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [req-6c452df4-f64a-4f5f-8fee-bf942560faf1 req-6054f54c-1445-42dd-9c35-5d0c2839d015 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087586 Nov 01 19:13:14.191039 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 2204/4394] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Nov 1 19:13:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:13:14.196029 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-2b281741-7c10-4b84-abc5-c716b6056665 tempest-FloatingIPDetailsTestJSON-1286833380 tempest-FloatingIPDetailsTestJSON-1286833380-project] Calling method '.version_select at 0x7f0ae2262d30>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:13:14.272903 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-efb0069b-7f5c-480f-8793-c460b5cdf3d1 tempest-InstanceActionsV221TestJSON-1016349810 tempest-InstanceActionsV221TestJSON-1016349810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '060d1fb6604f4096b650cf40060db86a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c29ec5eebf84c198c11bae29e3df2d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:13:14.287441 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-efb0069b-7f5c-480f-8793-c460b5cdf3d1 tempest-InstanceActionsV221TestJSON-1016349810 tempest-InstanceActionsV221TestJSON-1016349810-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '060d1fb6604f4096b650cf40060db86a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c29ec5eebf84c198c11bae29e3df2d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:13:14.290020 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-efb0069b-7f5c-480f-8793-c460b5cdf3d1 tempest-InstanceActionsV221TestJSON-1016349810 tempest-InstanceActionsV221TestJSON-1016349810-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '060d1fb6604f4096b650cf40060db86a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c29ec5eebf84c198c11bae29e3df2d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:13:14.294442 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-efb0069b-7f5c-480f-8793-c460b5cdf3d1 tempest-InstanceActionsV221TestJSON-1016349810 tempest-InstanceActionsV221TestJSON-1016349810-project] 10.222.0.13 "GET /compute/v2.1/servers/aa7aa9c6-8a88-4948-a623-be7e64e73b5f" status: 200 len: 1348 microversion: 2.21 time: 0.250205 Nov 01 19:13:14.295821 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 2191/4395] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 19:13:14 2022] GET /compute/v2.1/servers/aa7aa9c6-8a88-4948-a623-be7e64e73b5f => generated 1348 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 19:13:14.401124 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-ba5a54ec-f0c5-4042-b4f1-0c0ea2da9b7e tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1919165850", "imageRef": "2d4a0047-1b9e-445f-8af8-1b5c9d93e881", "flavorRef": "452", "accessIPv6": "notvalid", "networks": [{"uuid": "f2fc603f-a5ab-4120-939f-124d49e1f7c1"}]}} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:13:14.406765 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-ba5a54ec-f0c5-4042-b4f1-0c0ea2da9b7e tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Request method failure captured: Nov 01 19:13:14.406765 n-d-863052-2 devstack@n-api.service[121402]: request: POST /compute/v2.1/servers HTTP/1.1 Nov 01 19:13:14.406765 n-d-863052-2 devstack@n-api.service[121402]: Accept: application/json Nov 01 19:13:14.406765 n-d-863052-2 devstack@n-api.service[121402]: Accept-Encoding: identity Nov 01 19:13:14.406765 n-d-863052-2 devstack@n-api.service[121402]: Connection: close Nov 01 19:13:14.406765 n-d-863052-2 devstack@n-api.service[121402]: Content-Length: 235 Nov 01 19:13:14.406765 n-d-863052-2 devstack@n-api.service[121402]: Content-Type: application/json Nov 01 19:13:14.406765 n-d-863052-2 devstack@n-api.service[121402]: Host: 10.222.0.13 Nov 01 19:13:14.406765 n-d-863052-2 devstack@n-api.service[121402]: Openstack-System-Scope: None Nov 01 19:13:14.406765 n-d-863052-2 devstack@n-api.service[121402]: User-Agent: python-urllib3/1.26.12 Nov 01 19:13:14.406765 n-d-863052-2 devstack@n-api.service[121402]: X-Auth-Token: gAAAAABjYW9YFTR7hO-vK03S-3HbvOtG2z3_fji2KJH39vNHENu4xIKneeHYviQiPj9ERGiA3aZIA7DvAYzczgSZ5-vK782IQ7CYnUFXvn9Aqt1AbunNMYxhes9BKzhvODzqwzqiQq89wgC4nbpZ9jJWFWMOC4z9bcW4UMi_ylwdZFjmhWfD49s Nov 01 19:13:14.406765 n-d-863052-2 devstack@n-api.service[121402]: X-Domain-Id: None Nov 01 19:13:14.406765 n-d-863052-2 devstack@n-api.service[121402]: X-Domain-Name: None Nov 01 19:13:14.406765 n-d-863052-2 devstack@n-api.service[121402]: X-Identity-Status: Confirmed Nov 01 19:13:14.406765 n-d-863052-2 devstack@n-api.service[121402]: X-Is-Admin-Project: True Nov 01 19:13:14.406765 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Domain-Id: default Nov 01 19:13:14.406765 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Domain-Name: Default Nov 01 19:13:14.406765 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Id: 9ecdc83933544a899117531a960027a7 Nov 01 19:13:14.406765 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Name: tempest-ServersNegativeTestJSON-638944671 Nov 01 19:13:14.406765 n-d-863052-2 devstack@n-api.service[121402]: X-Role: member,reader Nov 01 19:13:14.406765 n-d-863052-2 devstack@n-api.service[121402]: X-Roles: member,reader Nov 01 19:13:14.406765 n-d-863052-2 devstack@n-api.service[121402]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/9ecdc83933544a899117531a960027a7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/9ecdc83933544a899117531a960027a7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_9ecdc83933544a899117531a960027a7", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/9ecdc83933544a899117531a960027a7"}]}] Nov 01 19:13:14.406765 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant: tempest-ServersNegativeTestJSON-638944671 Nov 01 19:13:14.406765 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant-Id: 9ecdc83933544a899117531a960027a7 Nov 01 19:13:14.406765 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant-Name: tempest-ServersNegativeTestJSON-638944671 Nov 01 19:13:14.406765 n-d-863052-2 devstack@n-api.service[121402]: X-User: tempest-ServersNegativeTestJSON-638944671-project Nov 01 19:13:14.406765 n-d-863052-2 devstack@n-api.service[121402]: X-User-Domain-Id: default Nov 01 19:13:14.406765 n-d-863052-2 devstack@n-api.service[121402]: X-User-Domain-Name: Default Nov 01 19:13:14.406765 n-d-863052-2 devstack@n-api.service[121402]: X-User-Id: 3fc5c19b930543f5a5091922a9859813 Nov 01 19:13:14.406765 n-d-863052-2 devstack@n-api.service[121402]: X-User-Name: tempest-ServersNegativeTestJSON-638944671-project Nov 01 19:13:14.406765 n-d-863052-2 devstack@n-api.service[121402]: Nov 01 19:13:14.406765 n-d-863052-2 devstack@n-api.service[121402]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1919165850", "imageRef": "2d4a0047-1b9e-445f-8af8-1b5c9d93e881", "flavorRef": "452", "accessIPv6": "notvalid", "networks": [{"uuid": "f2fc603f-a5ab-4120-939f-124d49e1f7c1"}]}} Nov 01 19:13:14.406765 n-d-863052-2 devstack@n-api.service[121402]: method: > Nov 01 19:13:14.406765 n-d-863052-2 devstack@n-api.service[121402]: exception: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Nov 01 19:13:14.406765 n-d-863052-2 devstack@n-api.service[121402]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1919165850', 'imageRef': '2d4a0047-1b9e-445f-8af8-1b5c9d93e881', 'flavorRef': '452', 'accessIPv6': 'notvalid', 'networks': [{'uuid': 'f2fc603f-a5ab-4120-939f-124d49e1f7c1'}]}}} Nov 01 19:13:14.406765 n-d-863052-2 devstack@n-api.service[121402]: {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 01 19:13:14.406765 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:13:14.406765 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Nov 01 19:13:14.406765 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi result = func(instance) Nov 01 19:13:14.406765 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/_format.py", line 260, in is_ipv6 Nov 01 19:13:14.406765 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi address = ipaddress.IPv6Address(instance) Nov 01 19:13:14.406765 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1844, in __init__ Nov 01 19:13:14.406765 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi self._ip = self._ip_int_from_string(addr_str) Nov 01 19:13:14.406765 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1581, in _ip_int_from_string Nov 01 19:13:14.406765 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise AddressValueError(msg) Nov 01 19:13:14.406765 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi ipaddress.AddressValueError: At least 3 parts expected in 'notvalid' Nov 01 19:13:14.406765 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:13:14.406765 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Nov 01 19:13:14.406765 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:13:14.406765 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:13:14.406765 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Nov 01 19:13:14.406765 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Nov 01 19:13:14.406765 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Nov 01 19:13:14.406765 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise error Nov 01 19:13:14.406765 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'notvalid' is not a 'ipv6' Nov 01 19:13:14.406765 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:13:14.406765 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['server']['properties']['accessIPv6']: Nov 01 19:13:14.406765 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi {'format': 'ipv6', 'type': 'string'} Nov 01 19:13:14.406765 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:13:14.406765 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi On instance['server']: Nov 01 19:13:14.406765 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi 'notvalid' Nov 01 19:13:14.406765 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:13:14.406765 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:13:14.406765 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:13:14.406765 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:13:14.411302 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:13:14.411302 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:13:14.411302 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 01 19:13:14.411302 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 01 19:13:14.411302 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 01 19:13:14.411302 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 01 19:13:14.411302 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 01 19:13:14.411302 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 01 19:13:14.411302 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Nov 01 19:13:14.411302 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Nov 01 19:13:14.411302 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Nov 01 19:13:14.411302 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Nov 01 19:13:14.411302 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Nov 01 19:13:14.411302 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Nov 01 19:13:14.411302 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Nov 01 19:13:14.411302 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:13:14.411302 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:13:14.411302 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:13:14.411302 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:13:14.411302 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:13:14.411302 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:13:14.411302 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Nov 01 19:13:14.411302 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Nov 01 19:13:14.411302 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Nov 01 19:13:14.411302 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:13:14.424442 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-ba5a54ec-f0c5-4042-b4f1-0c0ea2da9b7e tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Returning 400 to user: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' {{(pid=121402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 01 19:13:14.425840 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-ba5a54ec-f0c5-4042-b4f1-0c0ea2da9b7e tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 400 len: 133 microversion: 2.1 time: 0.028697 Nov 01 19:13:14.426633 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 2192/4396] 10.222.0.13 () {60 vars in 1147 bytes} [Tue Nov 1 19:13:14 2022] POST /compute/v2.1/servers => generated 133 bytes in 30 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Nov 01 19:13:14.435168 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-5c430f06-b27d-41ac-bbdb-cb99d07b2c6c tempest-ServerPasswordTestJSON-1534707503 tempest-ServerPasswordTestJSON-1534707503-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:13:14.441119 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-5c430f06-b27d-41ac-bbdb-cb99d07b2c6c tempest-ServerPasswordTestJSON-1534707503 tempest-ServerPasswordTestJSON-1534707503-project] [instance: 3463bb31-5f34-4b89-8b40-af83df5c7635] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:13:14.453033 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-5c430f06-b27d-41ac-bbdb-cb99d07b2c6c tempest-ServerPasswordTestJSON-1534707503 tempest-ServerPasswordTestJSON-1534707503-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:13:14.461318 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-5c430f06-b27d-41ac-bbdb-cb99d07b2c6c tempest-ServerPasswordTestJSON-1534707503 tempest-ServerPasswordTestJSON-1534707503-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:13:14.462287 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-5c430f06-b27d-41ac-bbdb-cb99d07b2c6c tempest-ServerPasswordTestJSON-1534707503 tempest-ServerPasswordTestJSON-1534707503-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:13:14.463277 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-5c430f06-b27d-41ac-bbdb-cb99d07b2c6c tempest-ServerPasswordTestJSON-1534707503 tempest-ServerPasswordTestJSON-1534707503-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:13:14.463970 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-5c430f06-b27d-41ac-bbdb-cb99d07b2c6c tempest-ServerPasswordTestJSON-1534707503 tempest-ServerPasswordTestJSON-1534707503-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:13:14.465282 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-5c430f06-b27d-41ac-bbdb-cb99d07b2c6c tempest-ServerPasswordTestJSON-1534707503 tempest-ServerPasswordTestJSON-1534707503-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:13:14.720929 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-2b281741-7c10-4b84-abc5-c716b6056665 tempest-FloatingIPDetailsTestJSON-1286833380 tempest-FloatingIPDetailsTestJSON-1286833380-project] 10.222.0.13 "GET /compute/v2.1/os-floating-ips/d9fdfbbe-946b-47fb-a37f-1f7ccb0e93f4" status: 200 len: 141 microversion: 2.1 time: 0.528652 Nov 01 19:13:14.722047 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 2205/4397] 10.222.0.13 () {58 vars in 1260 bytes} [Tue Nov 1 19:13:14 2022] GET /compute/v2.1/os-floating-ips/d9fdfbbe-946b-47fb-a37f-1f7ccb0e93f4 => generated 141 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:13:14.732786 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-3ae579e8-3098-40aa-924e-35315c40aa57 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:13:14.733895 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-3ae579e8-3098-40aa-924e-35315c40aa57 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] [instance: b27eaab4-a751-47fb-acdb-db7c99b06a5f] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:13:14.755081 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-3ae579e8-3098-40aa-924e-35315c40aa57 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:13:14.755831 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-3ae579e8-3098-40aa-924e-35315c40aa57 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:13:14.756496 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-3ae579e8-3098-40aa-924e-35315c40aa57 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:13:14.757439 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-3ae579e8-3098-40aa-924e-35315c40aa57 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:13:14.758123 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-3ae579e8-3098-40aa-924e-35315c40aa57 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:13:14.758753 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-3ae579e8-3098-40aa-924e-35315c40aa57 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:13:14.915642 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-5c430f06-b27d-41ac-bbdb-cb99d07b2c6c tempest-ServerPasswordTestJSON-1534707503 tempest-ServerPasswordTestJSON-1534707503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '969cec09484942aebbab6c0f021b7067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9871416ead87433589b8f54783b023b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:13:14.924516 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-5c430f06-b27d-41ac-bbdb-cb99d07b2c6c tempest-ServerPasswordTestJSON-1534707503 tempest-ServerPasswordTestJSON-1534707503-project] 10.222.0.13 "GET /compute/v2.1/servers/3463bb31-5f34-4b89-8b40-af83df5c7635" status: 200 len: 1504 microversion: 2.1 time: 0.496594 Nov 01 19:13:14.949547 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 2193/4398] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:13:14 2022] GET /compute/v2.1/servers/3463bb31-5f34-4b89-8b40-af83df5c7635 => generated 1504 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:13:14.959806 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-6b88b4d0-cf0b-4ccd-86ab-b9d4d2b12aed tempest-FloatingIPDetailsTestJSON-1286833380 tempest-FloatingIPDetailsTestJSON-1286833380-project] Calling method '.version_select at 0x7f0ae2ae60d0>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:13:15.357342 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-3ae579e8-3098-40aa-924e-35315c40aa57 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc5c19b930543f5a5091922a9859813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ecdc83933544a899117531a960027a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:13:15.365759 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-3ae579e8-3098-40aa-924e-35315c40aa57 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] 10.222.0.13 "GET /compute/v2.1/servers/b27eaab4-a751-47fb-acdb-db7c99b06a5f" status: 200 len: 1506 microversion: 2.1 time: 0.642427 Nov 01 19:13:15.366349 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 2206/4399] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:13:14 2022] GET /compute/v2.1/servers/b27eaab4-a751-47fb-acdb-db7c99b06a5f => generated 1506 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:13:15.380104 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-6719902e-26b3-4600-ab5d-157c7ab18a37 tempest-ServerPasswordTestJSON-1534707503 tempest-ServerPasswordTestJSON-1534707503-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:13:15.380880 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-6719902e-26b3-4600-ab5d-157c7ab18a37 tempest-ServerPasswordTestJSON-1534707503 tempest-ServerPasswordTestJSON-1534707503-project] [instance: 3463bb31-5f34-4b89-8b40-af83df5c7635] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:13:15.396917 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-6719902e-26b3-4600-ab5d-157c7ab18a37 tempest-ServerPasswordTestJSON-1534707503 tempest-ServerPasswordTestJSON-1534707503-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:13:15.397611 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-6719902e-26b3-4600-ab5d-157c7ab18a37 tempest-ServerPasswordTestJSON-1534707503 tempest-ServerPasswordTestJSON-1534707503-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:13:15.398291 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-6719902e-26b3-4600-ab5d-157c7ab18a37 tempest-ServerPasswordTestJSON-1534707503 tempest-ServerPasswordTestJSON-1534707503-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:13:15.406949 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-6719902e-26b3-4600-ab5d-157c7ab18a37 tempest-ServerPasswordTestJSON-1534707503 tempest-ServerPasswordTestJSON-1534707503-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:13:15.407664 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-6719902e-26b3-4600-ab5d-157c7ab18a37 tempest-ServerPasswordTestJSON-1534707503 tempest-ServerPasswordTestJSON-1534707503-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:13:15.408251 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-6719902e-26b3-4600-ab5d-157c7ab18a37 tempest-ServerPasswordTestJSON-1534707503 tempest-ServerPasswordTestJSON-1534707503-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:13:15.546666 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-6719902e-26b3-4600-ab5d-157c7ab18a37 tempest-ServerPasswordTestJSON-1534707503 tempest-ServerPasswordTestJSON-1534707503-project] 10.222.0.13 "DELETE /compute/v2.1/servers/3463bb31-5f34-4b89-8b40-af83df5c7635/os-server-password" status: 204 len: 0 microversion: 2.1 time: 0.179171 Nov 01 19:13:15.561504 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 2207/4400] 10.222.0.13 () {58 vars in 1296 bytes} [Tue Nov 1 19:13:15 2022] DELETE /compute/v2.1/servers/3463bb31-5f34-4b89-8b40-af83df5c7635/os-server-password => generated 0 bytes in 188 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 01 19:13:15.567257 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-87e41752-1b4f-4df7-90e0-9789fd90c4d1 tempest-InstanceActionsTestJSON-621834551 tempest-InstanceActionsTestJSON-621834551-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:13:15.568079 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-87e41752-1b4f-4df7-90e0-9789fd90c4d1 tempest-InstanceActionsTestJSON-621834551 tempest-InstanceActionsTestJSON-621834551-project] [instance: 922898a0-ba6d-48cc-9b0b-b3b781eddb9e] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:13:15.580015 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-87e41752-1b4f-4df7-90e0-9789fd90c4d1 tempest-InstanceActionsTestJSON-621834551 tempest-InstanceActionsTestJSON-621834551-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:13:15.587301 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-87e41752-1b4f-4df7-90e0-9789fd90c4d1 tempest-InstanceActionsTestJSON-621834551 tempest-InstanceActionsTestJSON-621834551-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:13:15.587981 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-87e41752-1b4f-4df7-90e0-9789fd90c4d1 tempest-InstanceActionsTestJSON-621834551 tempest-InstanceActionsTestJSON-621834551-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:13:15.588898 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-87e41752-1b4f-4df7-90e0-9789fd90c4d1 tempest-InstanceActionsTestJSON-621834551 tempest-InstanceActionsTestJSON-621834551-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:13:15.589541 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-87e41752-1b4f-4df7-90e0-9789fd90c4d1 tempest-InstanceActionsTestJSON-621834551 tempest-InstanceActionsTestJSON-621834551-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:13:15.590147 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-87e41752-1b4f-4df7-90e0-9789fd90c4d1 tempest-InstanceActionsTestJSON-621834551 tempest-InstanceActionsTestJSON-621834551-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:13:15.842496 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-87e41752-1b4f-4df7-90e0-9789fd90c4d1 tempest-InstanceActionsTestJSON-621834551 tempest-InstanceActionsTestJSON-621834551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32430a3dff994c929c0e635b372c9f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553f439f412542e3a36c5db93d039593', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:13:15.846316 n-d-863052-2 devstack@n-api.service[121403]: DEBUG dbcounter [-] [121403] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=2,nova_cell1:INSERT=5 {{(pid=121403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 19:13:15.852833 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-87e41752-1b4f-4df7-90e0-9789fd90c4d1 tempest-InstanceActionsTestJSON-621834551 tempest-InstanceActionsTestJSON-621834551-project] 10.222.0.13 "GET /compute/v2.1/servers/922898a0-ba6d-48cc-9b0b-b3b781eddb9e" status: 200 len: 1317 microversion: 2.1 time: 0.289862 Nov 01 19:13:15.853611 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 2208/4401] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:13:15 2022] GET /compute/v2.1/servers/922898a0-ba6d-48cc-9b0b-b3b781eddb9e => generated 1317 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:13:15.858759 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-cfb7381a-3216-4ddb-a670-7a80288bc7eb tempest-InstanceActionsV221TestJSON-1016349810 tempest-InstanceActionsV221TestJSON-1016349810-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:13:15.860205 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-cfb7381a-3216-4ddb-a670-7a80288bc7eb tempest-InstanceActionsV221TestJSON-1016349810 tempest-InstanceActionsV221TestJSON-1016349810-project] [instance: aa7aa9c6-8a88-4948-a623-be7e64e73b5f] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:13:15.867418 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-cfb7381a-3216-4ddb-a670-7a80288bc7eb tempest-InstanceActionsV221TestJSON-1016349810 tempest-InstanceActionsV221TestJSON-1016349810-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:13:15.868642 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-cfb7381a-3216-4ddb-a670-7a80288bc7eb tempest-InstanceActionsV221TestJSON-1016349810 tempest-InstanceActionsV221TestJSON-1016349810-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:13:15.869304 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-cfb7381a-3216-4ddb-a670-7a80288bc7eb tempest-InstanceActionsV221TestJSON-1016349810 tempest-InstanceActionsV221TestJSON-1016349810-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:13:15.870277 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-cfb7381a-3216-4ddb-a670-7a80288bc7eb tempest-InstanceActionsV221TestJSON-1016349810 tempest-InstanceActionsV221TestJSON-1016349810-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:13:15.871774 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-cfb7381a-3216-4ddb-a670-7a80288bc7eb tempest-InstanceActionsV221TestJSON-1016349810 tempest-InstanceActionsV221TestJSON-1016349810-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:13:15.872439 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-cfb7381a-3216-4ddb-a670-7a80288bc7eb tempest-InstanceActionsV221TestJSON-1016349810 tempest-InstanceActionsV221TestJSON-1016349810-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:13:15.900233 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.wsgi [None req-cfb7381a-3216-4ddb-a670-7a80288bc7eb tempest-InstanceActionsV221TestJSON-1016349810 tempest-InstanceActionsV221TestJSON-1016349810-project] HTTP exception thrown: Instance aa7aa9c6-8a88-4948-a623-be7e64e73b5f could not be found. Nov 01 19:13:15.905701 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-cfb7381a-3216-4ddb-a670-7a80288bc7eb tempest-InstanceActionsV221TestJSON-1016349810 tempest-InstanceActionsV221TestJSON-1016349810-project] Request method failure captured: Nov 01 19:13:15.905701 n-d-863052-2 devstack@n-api.service[121403]: request: GET /compute/v2.1/servers/aa7aa9c6-8a88-4948-a623-be7e64e73b5f HTTP/1.1 Nov 01 19:13:15.905701 n-d-863052-2 devstack@n-api.service[121403]: Accept: application/json Nov 01 19:13:15.905701 n-d-863052-2 devstack@n-api.service[121403]: Accept-Encoding: identity Nov 01 19:13:15.905701 n-d-863052-2 devstack@n-api.service[121403]: Connection: close Nov 01 19:13:15.905701 n-d-863052-2 devstack@n-api.service[121403]: Content-Length: 0 Nov 01 19:13:15.905701 n-d-863052-2 devstack@n-api.service[121403]: Content-Type: application/json Nov 01 19:13:15.905701 n-d-863052-2 devstack@n-api.service[121403]: Host: 10.222.0.13 Nov 01 19:13:15.905701 n-d-863052-2 devstack@n-api.service[121403]: Openstack-System-Scope: None Nov 01 19:13:15.905701 n-d-863052-2 devstack@n-api.service[121403]: User-Agent: python-urllib3/1.26.12 Nov 01 19:13:15.905701 n-d-863052-2 devstack@n-api.service[121403]: X-Auth-Token: gAAAAABjYW-jJvmtO8f2xaGfJRkESwZAkRQc-E5K2skVUiOIkuGlu6Mbu1us9xrXJ5uDljvHrumazJrtBKf2PEGVjqzef4g_jGRK1L42MVKzgK1cxvVgIb7KHQ0RMP6-c-tovS40_ePyhHnvzoe9vMgGjEpwQzMmf0bptisBCkebFnLK8N8P2Jo Nov 01 19:13:15.905701 n-d-863052-2 devstack@n-api.service[121403]: X-Domain-Id: None Nov 01 19:13:15.905701 n-d-863052-2 devstack@n-api.service[121403]: X-Domain-Name: None Nov 01 19:13:15.905701 n-d-863052-2 devstack@n-api.service[121403]: X-Identity-Status: Confirmed Nov 01 19:13:15.905701 n-d-863052-2 devstack@n-api.service[121403]: X-Is-Admin-Project: True Nov 01 19:13:15.905701 n-d-863052-2 devstack@n-api.service[121403]: X-Openstack-Nova-Api-Version: 2.21 Nov 01 19:13:15.905701 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Domain-Id: default Nov 01 19:13:15.905701 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Domain-Name: Default Nov 01 19:13:15.905701 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Id: 4c29ec5eebf84c198c11bae29e3df2d3 Nov 01 19:13:15.905701 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Name: tempest-InstanceActionsV221TestJSON-1016349810 Nov 01 19:13:15.905701 n-d-863052-2 devstack@n-api.service[121403]: X-Role: member,reader Nov 01 19:13:15.905701 n-d-863052-2 devstack@n-api.service[121403]: X-Roles: member,reader Nov 01 19:13:15.905701 n-d-863052-2 devstack@n-api.service[121403]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/4c29ec5eebf84c198c11bae29e3df2d3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/4c29ec5eebf84c198c11bae29e3df2d3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_4c29ec5eebf84c198c11bae29e3df2d3", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/4c29ec5eebf84c198c11bae29e3df2d3"}]}] Nov 01 19:13:15.905701 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant: tempest-InstanceActionsV221TestJSON-1016349810 Nov 01 19:13:15.905701 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant-Id: 4c29ec5eebf84c198c11bae29e3df2d3 Nov 01 19:13:15.905701 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-1016349810 Nov 01 19:13:15.905701 n-d-863052-2 devstack@n-api.service[121403]: X-User: tempest-InstanceActionsV221TestJSON-1016349810-project Nov 01 19:13:15.905701 n-d-863052-2 devstack@n-api.service[121403]: X-User-Domain-Id: default Nov 01 19:13:15.905701 n-d-863052-2 devstack@n-api.service[121403]: X-User-Domain-Name: Default Nov 01 19:13:15.905701 n-d-863052-2 devstack@n-api.service[121403]: X-User-Id: 060d1fb6604f4096b650cf40060db86a Nov 01 19:13:15.905701 n-d-863052-2 devstack@n-api.service[121403]: X-User-Name: tempest-InstanceActionsV221TestJSON-1016349810-project Nov 01 19:13:15.905701 n-d-863052-2 devstack@n-api.service[121403]: method: > Nov 01 19:13:15.905701 n-d-863052-2 devstack@n-api.service[121403]: exception: Instance aa7aa9c6-8a88-4948-a623-be7e64e73b5f could not be found. Nov 01 19:13:15.905701 n-d-863052-2 devstack@n-api.service[121403]: action_args: {'id': 'aa7aa9c6-8a88-4948-a623-be7e64e73b5f'} Nov 01 19:13:15.905701 n-d-863052-2 devstack@n-api.service[121403]: {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 01 19:13:15.905701 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:13:15.905701 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 01 19:13:15.905701 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 01 19:13:15.905701 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 01 19:13:15.905701 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 01 19:13:15.905701 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 01 19:13:15.905701 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 01 19:13:15.905701 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 01 19:13:15.905701 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 01 19:13:15.905701 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aa7aa9c6-8a88-4948-a623-be7e64e73b5f could not be found. Nov 01 19:13:15.905701 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:13:15.905701 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:13:15.905701 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:13:15.905701 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:13:15.905701 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:13:15.905701 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:13:15.905701 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 01 19:13:15.905701 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 01 19:13:15.905701 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 01 19:13:15.905701 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 01 19:13:15.905701 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 01 19:13:15.905701 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 01 19:13:15.905701 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 01 19:13:15.905701 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 01 19:13:15.905701 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 01 19:13:15.905701 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 01 19:13:15.905701 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aa7aa9c6-8a88-4948-a623-be7e64e73b5f could not be found. Nov 01 19:13:15.905701 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:13:15.905701 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:13:15.909434 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:13:15.909434 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:13:15.909434 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:13:15.909434 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:13:15.909434 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 01 19:13:15.909434 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 01 19:13:15.909434 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aa7aa9c6-8a88-4948-a623-be7e64e73b5f could not be found. Nov 01 19:13:15.909434 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:13:15.911912 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-cfb7381a-3216-4ddb-a670-7a80288bc7eb tempest-InstanceActionsV221TestJSON-1016349810 tempest-InstanceActionsV221TestJSON-1016349810-project] Returning 404 to user: Instance aa7aa9c6-8a88-4948-a623-be7e64e73b5f could not be found. {{(pid=121403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 01 19:13:15.913302 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-cfb7381a-3216-4ddb-a670-7a80288bc7eb tempest-InstanceActionsV221TestJSON-1016349810 tempest-InstanceActionsV221TestJSON-1016349810-project] 10.222.0.13 "GET /compute/v2.1/servers/aa7aa9c6-8a88-4948-a623-be7e64e73b5f" status: 404 len: 111 microversion: 2.21 time: 0.058508 Nov 01 19:13:15.920365 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 2209/4402] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 19:13:15 2022] GET /compute/v2.1/servers/aa7aa9c6-8a88-4948-a623-be7e64e73b5f => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 01 19:13:15.931918 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-a62f209c-30d6-43d5-b831-6c538adb758c tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:13:15.932931 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-a62f209c-30d6-43d5-b831-6c538adb758c tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] [instance: b27eaab4-a751-47fb-acdb-db7c99b06a5f] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:13:15.950158 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-a62f209c-30d6-43d5-b831-6c538adb758c tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:13:15.951355 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-a62f209c-30d6-43d5-b831-6c538adb758c tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:13:15.952251 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-a62f209c-30d6-43d5-b831-6c538adb758c tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:13:15.953137 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-a62f209c-30d6-43d5-b831-6c538adb758c tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:13:15.954759 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-a62f209c-30d6-43d5-b831-6c538adb758c tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:13:15.955330 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-a62f209c-30d6-43d5-b831-6c538adb758c tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:13:16.149114 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-a62f209c-30d6-43d5-b831-6c538adb758c tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc5c19b930543f5a5091922a9859813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ecdc83933544a899117531a960027a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:13:16.171829 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-a62f209c-30d6-43d5-b831-6c538adb758c tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] 10.222.0.13 "GET /compute/v2.1/servers/b27eaab4-a751-47fb-acdb-db7c99b06a5f" status: 200 len: 1506 microversion: 2.1 time: 0.250172 Nov 01 19:13:16.173769 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 2210/4403] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:13:15 2022] GET /compute/v2.1/servers/b27eaab4-a751-47fb-acdb-db7c99b06a5f => generated 1506 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:13:16.187597 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-79fac8f9-e037-49b3-9a58-b774dc44f3d0 tempest-ServerPasswordTestJSON-1534707503 tempest-ServerPasswordTestJSON-1534707503-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:13:16.191577 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-79fac8f9-e037-49b3-9a58-b774dc44f3d0 tempest-ServerPasswordTestJSON-1534707503 tempest-ServerPasswordTestJSON-1534707503-project] [instance: 3463bb31-5f34-4b89-8b40-af83df5c7635] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:13:16.201577 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-79fac8f9-e037-49b3-9a58-b774dc44f3d0 tempest-ServerPasswordTestJSON-1534707503 tempest-ServerPasswordTestJSON-1534707503-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:13:16.203331 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-79fac8f9-e037-49b3-9a58-b774dc44f3d0 tempest-ServerPasswordTestJSON-1534707503 tempest-ServerPasswordTestJSON-1534707503-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:13:16.211619 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-79fac8f9-e037-49b3-9a58-b774dc44f3d0 tempest-ServerPasswordTestJSON-1534707503 tempest-ServerPasswordTestJSON-1534707503-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:13:16.212805 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-79fac8f9-e037-49b3-9a58-b774dc44f3d0 tempest-ServerPasswordTestJSON-1534707503 tempest-ServerPasswordTestJSON-1534707503-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:13:16.216233 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-79fac8f9-e037-49b3-9a58-b774dc44f3d0 tempest-ServerPasswordTestJSON-1534707503 tempest-ServerPasswordTestJSON-1534707503-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:13:16.216945 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-79fac8f9-e037-49b3-9a58-b774dc44f3d0 tempest-ServerPasswordTestJSON-1534707503 tempest-ServerPasswordTestJSON-1534707503-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:13:16.270725 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-79fac8f9-e037-49b3-9a58-b774dc44f3d0 tempest-ServerPasswordTestJSON-1534707503 tempest-ServerPasswordTestJSON-1534707503-project] 10.222.0.13 "GET /compute/v2.1/servers/3463bb31-5f34-4b89-8b40-af83df5c7635/os-server-password" status: 200 len: 16 microversion: 2.1 time: 0.095259 Nov 01 19:13:16.272181 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 2211/4404] 10.222.0.13 () {58 vars in 1293 bytes} [Tue Nov 1 19:13:16 2022] GET /compute/v2.1/servers/3463bb31-5f34-4b89-8b40-af83df5c7635/os-server-password => generated 16 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 01 19:13:16.281202 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-d37f4095-3970-46ef-be27-20da54431d64 tempest-InstanceActionsV221TestJSON-1016349810 tempest-InstanceActionsV221TestJSON-1016349810-project] Calling method '.version_select at 0x7f0ae2130790>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:13:16.282576 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-d37f4095-3970-46ef-be27-20da54431d64 tempest-InstanceActionsV221TestJSON-1016349810 tempest-InstanceActionsV221TestJSON-1016349810-project] [instance: aa7aa9c6-8a88-4948-a623-be7e64e73b5f] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:13:16.304094 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d37f4095-3970-46ef-be27-20da54431d64 tempest-InstanceActionsV221TestJSON-1016349810 tempest-InstanceActionsV221TestJSON-1016349810-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:13:16.304622 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d37f4095-3970-46ef-be27-20da54431d64 tempest-InstanceActionsV221TestJSON-1016349810 tempest-InstanceActionsV221TestJSON-1016349810-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:13:16.306517 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d37f4095-3970-46ef-be27-20da54431d64 tempest-InstanceActionsV221TestJSON-1016349810 tempest-InstanceActionsV221TestJSON-1016349810-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:13:16.307260 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d37f4095-3970-46ef-be27-20da54431d64 tempest-InstanceActionsV221TestJSON-1016349810 tempest-InstanceActionsV221TestJSON-1016349810-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:13:16.307728 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d37f4095-3970-46ef-be27-20da54431d64 tempest-InstanceActionsV221TestJSON-1016349810 tempest-InstanceActionsV221TestJSON-1016349810-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:13:16.308226 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d37f4095-3970-46ef-be27-20da54431d64 tempest-InstanceActionsV221TestJSON-1016349810 tempest-InstanceActionsV221TestJSON-1016349810-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:13:16.481155 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-d37f4095-3970-46ef-be27-20da54431d64 tempest-InstanceActionsV221TestJSON-1016349810 tempest-InstanceActionsV221TestJSON-1016349810-project] 10.222.0.13 "GET /compute/v2.1/servers/aa7aa9c6-8a88-4948-a623-be7e64e73b5f/os-instance-actions" status: 200 len: 611 microversion: 2.21 time: 0.206887 Nov 01 19:13:16.493000 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 2212/4405] 10.222.0.13 () {60 vars in 1337 bytes} [Tue Nov 1 19:13:16 2022] GET /compute/v2.1/servers/aa7aa9c6-8a88-4948-a623-be7e64e73b5f/os-instance-actions => generated 611 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 01 19:13:16.507955 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-06a9ecbf-5fe7-47e6-8681-790736ffcd37 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:13:16.508504 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-06a9ecbf-5fe7-47e6-8681-790736ffcd37 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] [instance: 248a6ae0-8665-419a-9786-06ba015baf04] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:13:16.522328 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.wsgi [None req-06a9ecbf-5fe7-47e6-8681-790736ffcd37 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] HTTP exception thrown: Instance 248a6ae0-8665-419a-9786-06ba015baf04 could not be found. Nov 01 19:13:16.531096 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-06a9ecbf-5fe7-47e6-8681-790736ffcd37 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Request method failure captured: Nov 01 19:13:16.531096 n-d-863052-2 devstack@n-api.service[121403]: request: POST /compute/v2.1/servers/248a6ae0-8665-419a-9786-06ba015baf04/action HTTP/1.1 Nov 01 19:13:16.531096 n-d-863052-2 devstack@n-api.service[121403]: Accept: application/json Nov 01 19:13:16.531096 n-d-863052-2 devstack@n-api.service[121403]: Accept-Encoding: identity Nov 01 19:13:16.531096 n-d-863052-2 devstack@n-api.service[121403]: Connection: close Nov 01 19:13:16.531096 n-d-863052-2 devstack@n-api.service[121403]: Content-Length: 13 Nov 01 19:13:16.531096 n-d-863052-2 devstack@n-api.service[121403]: Content-Type: application/json Nov 01 19:13:16.531096 n-d-863052-2 devstack@n-api.service[121403]: Host: 10.222.0.13 Nov 01 19:13:16.531096 n-d-863052-2 devstack@n-api.service[121403]: Openstack-System-Scope: None Nov 01 19:13:16.531096 n-d-863052-2 devstack@n-api.service[121403]: User-Agent: python-urllib3/1.26.12 Nov 01 19:13:16.531096 n-d-863052-2 devstack@n-api.service[121403]: X-Auth-Token: gAAAAABjYW9YFTR7hO-vK03S-3HbvOtG2z3_fji2KJH39vNHENu4xIKneeHYviQiPj9ERGiA3aZIA7DvAYzczgSZ5-vK782IQ7CYnUFXvn9Aqt1AbunNMYxhes9BKzhvODzqwzqiQq89wgC4nbpZ9jJWFWMOC4z9bcW4UMi_ylwdZFjmhWfD49s Nov 01 19:13:16.531096 n-d-863052-2 devstack@n-api.service[121403]: X-Domain-Id: None Nov 01 19:13:16.531096 n-d-863052-2 devstack@n-api.service[121403]: X-Domain-Name: None Nov 01 19:13:16.531096 n-d-863052-2 devstack@n-api.service[121403]: X-Identity-Status: Confirmed Nov 01 19:13:16.531096 n-d-863052-2 devstack@n-api.service[121403]: X-Is-Admin-Project: True Nov 01 19:13:16.531096 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Domain-Id: default Nov 01 19:13:16.531096 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Domain-Name: Default Nov 01 19:13:16.531096 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Id: 9ecdc83933544a899117531a960027a7 Nov 01 19:13:16.531096 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Name: tempest-ServersNegativeTestJSON-638944671 Nov 01 19:13:16.531096 n-d-863052-2 devstack@n-api.service[121403]: X-Role: member,reader Nov 01 19:13:16.531096 n-d-863052-2 devstack@n-api.service[121403]: X-Roles: member,reader Nov 01 19:13:16.531096 n-d-863052-2 devstack@n-api.service[121403]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/9ecdc83933544a899117531a960027a7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/9ecdc83933544a899117531a960027a7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_9ecdc83933544a899117531a960027a7", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/9ecdc83933544a899117531a960027a7"}]}] Nov 01 19:13:16.531096 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant: tempest-ServersNegativeTestJSON-638944671 Nov 01 19:13:16.531096 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant-Id: 9ecdc83933544a899117531a960027a7 Nov 01 19:13:16.531096 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant-Name: tempest-ServersNegativeTestJSON-638944671 Nov 01 19:13:16.531096 n-d-863052-2 devstack@n-api.service[121403]: X-User: tempest-ServersNegativeTestJSON-638944671-project Nov 01 19:13:16.531096 n-d-863052-2 devstack@n-api.service[121403]: X-User-Domain-Id: default Nov 01 19:13:16.531096 n-d-863052-2 devstack@n-api.service[121403]: X-User-Domain-Name: Default Nov 01 19:13:16.531096 n-d-863052-2 devstack@n-api.service[121403]: X-User-Id: 3fc5c19b930543f5a5091922a9859813 Nov 01 19:13:16.531096 n-d-863052-2 devstack@n-api.service[121403]: X-User-Name: tempest-ServersNegativeTestJSON-638944671-project Nov 01 19:13:16.531096 n-d-863052-2 devstack@n-api.service[121403]: Nov 01 19:13:16.531096 n-d-863052-2 devstack@n-api.service[121403]: {"pause": {}} Nov 01 19:13:16.531096 n-d-863052-2 devstack@n-api.service[121403]: method: > Nov 01 19:13:16.531096 n-d-863052-2 devstack@n-api.service[121403]: exception: Instance 248a6ae0-8665-419a-9786-06ba015baf04 could not be found. Nov 01 19:13:16.531096 n-d-863052-2 devstack@n-api.service[121403]: action_args: {'id': '248a6ae0-8665-419a-9786-06ba015baf04', 'body': {'pause': {}}} Nov 01 19:13:16.531096 n-d-863052-2 devstack@n-api.service[121403]: {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 01 19:13:16.531096 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:13:16.531096 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 01 19:13:16.531096 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 01 19:13:16.531096 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 01 19:13:16.531096 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 01 19:13:16.531096 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Nov 01 19:13:16.531096 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Nov 01 19:13:16.531096 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 248a6ae0-8665-419a-9786-06ba015baf04 could not be found. Nov 01 19:13:16.531096 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:13:16.531096 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:13:16.531096 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:13:16.531096 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:13:16.531096 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:13:16.531096 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:13:16.531096 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 01 19:13:16.531096 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 01 19:13:16.531096 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 01 19:13:16.531096 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 01 19:13:16.531096 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 36, in _pause Nov 01 19:13:16.531096 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, ctxt, id) Nov 01 19:13:16.531096 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 01 19:13:16.531096 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 01 19:13:16.531096 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 248a6ae0-8665-419a-9786-06ba015baf04 could not be found. Nov 01 19:13:16.531096 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:13:16.531096 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:13:16.531096 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:13:16.531096 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:13:16.531096 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:13:16.531096 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:13:16.535000 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 01 19:13:16.535000 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 01 19:13:16.535000 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 248a6ae0-8665-419a-9786-06ba015baf04 could not be found. Nov 01 19:13:16.535000 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:13:16.535000 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-06a9ecbf-5fe7-47e6-8681-790736ffcd37 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Returning 404 to user: Instance 248a6ae0-8665-419a-9786-06ba015baf04 could not be found. {{(pid=121403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 01 19:13:16.535000 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-06a9ecbf-5fe7-47e6-8681-790736ffcd37 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] 10.222.0.13 "POST /compute/v2.1/servers/248a6ae0-8665-419a-9786-06ba015baf04/action" status: 404 len: 111 microversion: 2.1 time: 0.039213 Nov 01 19:13:16.535000 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 2213/4406] 10.222.0.13 () {60 vars in 1278 bytes} [Tue Nov 1 19:13:16 2022] POST /compute/v2.1/servers/248a6ae0-8665-419a-9786-06ba015baf04/action => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 01 19:13:16.550148 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-464d397c-a661-46e1-8f49-14a21cd95a05 tempest-ServerPasswordTestJSON-1534707503 tempest-ServerPasswordTestJSON-1534707503-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:13:16.551245 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-464d397c-a661-46e1-8f49-14a21cd95a05 tempest-ServerPasswordTestJSON-1534707503 tempest-ServerPasswordTestJSON-1534707503-project] [instance: 3463bb31-5f34-4b89-8b40-af83df5c7635] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:13:16.569812 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-464d397c-a661-46e1-8f49-14a21cd95a05 tempest-ServerPasswordTestJSON-1534707503 tempest-ServerPasswordTestJSON-1534707503-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:13:16.570871 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-464d397c-a661-46e1-8f49-14a21cd95a05 tempest-ServerPasswordTestJSON-1534707503 tempest-ServerPasswordTestJSON-1534707503-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:13:16.570997 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-464d397c-a661-46e1-8f49-14a21cd95a05 tempest-ServerPasswordTestJSON-1534707503 tempest-ServerPasswordTestJSON-1534707503-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:13:16.575203 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-464d397c-a661-46e1-8f49-14a21cd95a05 tempest-ServerPasswordTestJSON-1534707503 tempest-ServerPasswordTestJSON-1534707503-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:13:16.575682 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-464d397c-a661-46e1-8f49-14a21cd95a05 tempest-ServerPasswordTestJSON-1534707503 tempest-ServerPasswordTestJSON-1534707503-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:13:16.576116 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-464d397c-a661-46e1-8f49-14a21cd95a05 tempest-ServerPasswordTestJSON-1534707503 tempest-ServerPasswordTestJSON-1534707503-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:13:16.627436 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-464d397c-a661-46e1-8f49-14a21cd95a05 tempest-ServerPasswordTestJSON-1534707503 tempest-ServerPasswordTestJSON-1534707503-project] [instance: 3463bb31-5f34-4b89-8b40-af83df5c7635] Going to try to terminate instance {{(pid=121403) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 01 19:13:16.809638 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-464d397c-a661-46e1-8f49-14a21cd95a05 tempest-ServerPasswordTestJSON-1534707503 tempest-ServerPasswordTestJSON-1534707503-project] 10.222.0.13 "DELETE /compute/v2.1/servers/3463bb31-5f34-4b89-8b40-af83df5c7635" status: 204 len: 0 microversion: 2.1 time: 0.269305 Nov 01 19:13:16.810235 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 2214/4407] 10.222.0.13 () {58 vars in 1239 bytes} [Tue Nov 1 19:13:16 2022] DELETE /compute/v2.1/servers/3463bb31-5f34-4b89-8b40-af83df5c7635 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 01 19:13:16.822458 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-e42725fa-0898-4489-b58f-6248574e883d tempest-InstanceActionsV221TestJSON-1016349810 tempest-InstanceActionsV221TestJSON-1016349810-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:13:16.823381 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-e42725fa-0898-4489-b58f-6248574e883d tempest-InstanceActionsV221TestJSON-1016349810 tempest-InstanceActionsV221TestJSON-1016349810-project] [instance: aa7aa9c6-8a88-4948-a623-be7e64e73b5f] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:13:16.830954 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-e42725fa-0898-4489-b58f-6248574e883d tempest-InstanceActionsV221TestJSON-1016349810 tempest-InstanceActionsV221TestJSON-1016349810-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:13:16.831438 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-e42725fa-0898-4489-b58f-6248574e883d tempest-InstanceActionsV221TestJSON-1016349810 tempest-InstanceActionsV221TestJSON-1016349810-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:13:16.831901 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-e42725fa-0898-4489-b58f-6248574e883d tempest-InstanceActionsV221TestJSON-1016349810 tempest-InstanceActionsV221TestJSON-1016349810-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:13:16.835842 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-e42725fa-0898-4489-b58f-6248574e883d tempest-InstanceActionsV221TestJSON-1016349810 tempest-InstanceActionsV221TestJSON-1016349810-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:13:16.836370 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-e42725fa-0898-4489-b58f-6248574e883d tempest-InstanceActionsV221TestJSON-1016349810 tempest-InstanceActionsV221TestJSON-1016349810-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:13:16.836872 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-e42725fa-0898-4489-b58f-6248574e883d tempest-InstanceActionsV221TestJSON-1016349810 tempest-InstanceActionsV221TestJSON-1016349810-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:13:16.880409 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.wsgi [None req-e42725fa-0898-4489-b58f-6248574e883d tempest-InstanceActionsV221TestJSON-1016349810 tempest-InstanceActionsV221TestJSON-1016349810-project] HTTP exception thrown: Instance aa7aa9c6-8a88-4948-a623-be7e64e73b5f could not be found. Nov 01 19:13:16.886096 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-e42725fa-0898-4489-b58f-6248574e883d tempest-InstanceActionsV221TestJSON-1016349810 tempest-InstanceActionsV221TestJSON-1016349810-project] Request method failure captured: Nov 01 19:13:16.886096 n-d-863052-2 devstack@n-api.service[121403]: request: DELETE /compute/v2.1/servers/aa7aa9c6-8a88-4948-a623-be7e64e73b5f HTTP/1.1 Nov 01 19:13:16.886096 n-d-863052-2 devstack@n-api.service[121403]: Accept: application/json Nov 01 19:13:16.886096 n-d-863052-2 devstack@n-api.service[121403]: Accept-Encoding: identity Nov 01 19:13:16.886096 n-d-863052-2 devstack@n-api.service[121403]: Connection: close Nov 01 19:13:16.886096 n-d-863052-2 devstack@n-api.service[121403]: Content-Length: 0 Nov 01 19:13:16.886096 n-d-863052-2 devstack@n-api.service[121403]: Content-Type: application/json Nov 01 19:13:16.886096 n-d-863052-2 devstack@n-api.service[121403]: Host: 10.222.0.13 Nov 01 19:13:16.886096 n-d-863052-2 devstack@n-api.service[121403]: Openstack-System-Scope: None Nov 01 19:13:16.886096 n-d-863052-2 devstack@n-api.service[121403]: User-Agent: python-urllib3/1.26.12 Nov 01 19:13:16.886096 n-d-863052-2 devstack@n-api.service[121403]: X-Auth-Token: gAAAAABjYW-jJvmtO8f2xaGfJRkESwZAkRQc-E5K2skVUiOIkuGlu6Mbu1us9xrXJ5uDljvHrumazJrtBKf2PEGVjqzef4g_jGRK1L42MVKzgK1cxvVgIb7KHQ0RMP6-c-tovS40_ePyhHnvzoe9vMgGjEpwQzMmf0bptisBCkebFnLK8N8P2Jo Nov 01 19:13:16.886096 n-d-863052-2 devstack@n-api.service[121403]: X-Domain-Id: None Nov 01 19:13:16.886096 n-d-863052-2 devstack@n-api.service[121403]: X-Domain-Name: None Nov 01 19:13:16.886096 n-d-863052-2 devstack@n-api.service[121403]: X-Identity-Status: Confirmed Nov 01 19:13:16.886096 n-d-863052-2 devstack@n-api.service[121403]: X-Is-Admin-Project: True Nov 01 19:13:16.886096 n-d-863052-2 devstack@n-api.service[121403]: X-Openstack-Nova-Api-Version: 2.21 Nov 01 19:13:16.886096 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Domain-Id: default Nov 01 19:13:16.886096 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Domain-Name: Default Nov 01 19:13:16.886096 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Id: 4c29ec5eebf84c198c11bae29e3df2d3 Nov 01 19:13:16.886096 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Name: tempest-InstanceActionsV221TestJSON-1016349810 Nov 01 19:13:16.886096 n-d-863052-2 devstack@n-api.service[121403]: X-Role: member,reader Nov 01 19:13:16.886096 n-d-863052-2 devstack@n-api.service[121403]: X-Roles: member,reader Nov 01 19:13:16.886096 n-d-863052-2 devstack@n-api.service[121403]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/4c29ec5eebf84c198c11bae29e3df2d3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/4c29ec5eebf84c198c11bae29e3df2d3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_4c29ec5eebf84c198c11bae29e3df2d3", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/4c29ec5eebf84c198c11bae29e3df2d3"}]}] Nov 01 19:13:16.886096 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant: tempest-InstanceActionsV221TestJSON-1016349810 Nov 01 19:13:16.886096 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant-Id: 4c29ec5eebf84c198c11bae29e3df2d3 Nov 01 19:13:16.886096 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-1016349810 Nov 01 19:13:16.886096 n-d-863052-2 devstack@n-api.service[121403]: X-User: tempest-InstanceActionsV221TestJSON-1016349810-project Nov 01 19:13:16.886096 n-d-863052-2 devstack@n-api.service[121403]: X-User-Domain-Id: default Nov 01 19:13:16.886096 n-d-863052-2 devstack@n-api.service[121403]: X-User-Domain-Name: Default Nov 01 19:13:16.886096 n-d-863052-2 devstack@n-api.service[121403]: X-User-Id: 060d1fb6604f4096b650cf40060db86a Nov 01 19:13:16.886096 n-d-863052-2 devstack@n-api.service[121403]: X-User-Name: tempest-InstanceActionsV221TestJSON-1016349810-project Nov 01 19:13:16.886096 n-d-863052-2 devstack@n-api.service[121403]: method: > Nov 01 19:13:16.886096 n-d-863052-2 devstack@n-api.service[121403]: exception: Instance aa7aa9c6-8a88-4948-a623-be7e64e73b5f could not be found. Nov 01 19:13:16.886096 n-d-863052-2 devstack@n-api.service[121403]: action_args: {'id': 'aa7aa9c6-8a88-4948-a623-be7e64e73b5f'} Nov 01 19:13:16.886096 n-d-863052-2 devstack@n-api.service[121403]: {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 01 19:13:16.886096 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:13:16.886096 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 01 19:13:16.886096 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 01 19:13:16.886096 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 01 19:13:16.886096 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 01 19:13:16.886096 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 01 19:13:16.886096 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 01 19:13:16.886096 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 01 19:13:16.886096 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 01 19:13:16.886096 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aa7aa9c6-8a88-4948-a623-be7e64e73b5f could not be found. Nov 01 19:13:16.886096 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:13:16.886096 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:13:16.886096 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:13:16.886096 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:13:16.886096 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:13:16.886096 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:13:16.886096 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 01 19:13:16.886096 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 01 19:13:16.886096 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 01 19:13:16.886096 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 01 19:13:16.886096 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 01 19:13:16.886096 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 01 19:13:16.886096 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 01 19:13:16.886096 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 01 19:13:16.886096 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 01 19:13:16.886096 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 01 19:13:16.886096 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 01 19:13:16.886096 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 01 19:13:16.893936 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aa7aa9c6-8a88-4948-a623-be7e64e73b5f could not be found. Nov 01 19:13:16.893936 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:13:16.893936 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:13:16.893936 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:13:16.893936 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:13:16.893936 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:13:16.893936 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:13:16.893936 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 01 19:13:16.893936 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 01 19:13:16.893936 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aa7aa9c6-8a88-4948-a623-be7e64e73b5f could not be found. Nov 01 19:13:16.893936 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:13:16.893936 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-e42725fa-0898-4489-b58f-6248574e883d tempest-InstanceActionsV221TestJSON-1016349810 tempest-InstanceActionsV221TestJSON-1016349810-project] Returning 404 to user: Instance aa7aa9c6-8a88-4948-a623-be7e64e73b5f could not be found. {{(pid=121403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 01 19:13:16.893936 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-e42725fa-0898-4489-b58f-6248574e883d tempest-InstanceActionsV221TestJSON-1016349810 tempest-InstanceActionsV221TestJSON-1016349810-project] 10.222.0.13 "DELETE /compute/v2.1/servers/aa7aa9c6-8a88-4948-a623-be7e64e73b5f" status: 404 len: 111 microversion: 2.21 time: 0.076020 Nov 01 19:13:16.893936 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 2215/4408] 10.222.0.13 () {60 vars in 1280 bytes} [Tue Nov 1 19:13:16 2022] DELETE /compute/v2.1/servers/aa7aa9c6-8a88-4948-a623-be7e64e73b5f => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 01 19:13:16.899543 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-52c2f07f-7d28-4b57-90b9-888bf25a42ee tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:13:16.900151 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-52c2f07f-7d28-4b57-90b9-888bf25a42ee tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] [instance: b27eaab4-a751-47fb-acdb-db7c99b06a5f] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:13:16.930198 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-52c2f07f-7d28-4b57-90b9-888bf25a42ee tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:13:16.931698 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-52c2f07f-7d28-4b57-90b9-888bf25a42ee tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:13:16.932146 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-52c2f07f-7d28-4b57-90b9-888bf25a42ee tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:13:16.936853 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-52c2f07f-7d28-4b57-90b9-888bf25a42ee tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:13:16.940445 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-52c2f07f-7d28-4b57-90b9-888bf25a42ee tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:13:16.941209 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-52c2f07f-7d28-4b57-90b9-888bf25a42ee tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:13:17.280406 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-52c2f07f-7d28-4b57-90b9-888bf25a42ee tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc5c19b930543f5a5091922a9859813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ecdc83933544a899117531a960027a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:13:17.289406 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-52c2f07f-7d28-4b57-90b9-888bf25a42ee tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] 10.222.0.13 "GET /compute/v2.1/servers/b27eaab4-a751-47fb-acdb-db7c99b06a5f" status: 200 len: 1506 microversion: 2.1 time: 0.396145 Nov 01 19:13:17.306627 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 2216/4409] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:13:16 2022] GET /compute/v2.1/servers/b27eaab4-a751-47fb-acdb-db7c99b06a5f => generated 1506 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:13:17.319937 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-98da59cc-3b95-462b-ac84-d52d7ad7d948 tempest-ServerPasswordTestJSON-1534707503 tempest-ServerPasswordTestJSON-1534707503-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:13:17.320768 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-98da59cc-3b95-462b-ac84-d52d7ad7d948 tempest-ServerPasswordTestJSON-1534707503 tempest-ServerPasswordTestJSON-1534707503-project] [instance: 3463bb31-5f34-4b89-8b40-af83df5c7635] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:13:17.341602 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-98da59cc-3b95-462b-ac84-d52d7ad7d948 tempest-ServerPasswordTestJSON-1534707503 tempest-ServerPasswordTestJSON-1534707503-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:13:17.343012 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-98da59cc-3b95-462b-ac84-d52d7ad7d948 tempest-ServerPasswordTestJSON-1534707503 tempest-ServerPasswordTestJSON-1534707503-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:13:17.343719 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-98da59cc-3b95-462b-ac84-d52d7ad7d948 tempest-ServerPasswordTestJSON-1534707503 tempest-ServerPasswordTestJSON-1534707503-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:13:17.344752 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-98da59cc-3b95-462b-ac84-d52d7ad7d948 tempest-ServerPasswordTestJSON-1534707503 tempest-ServerPasswordTestJSON-1534707503-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:13:17.347580 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-98da59cc-3b95-462b-ac84-d52d7ad7d948 tempest-ServerPasswordTestJSON-1534707503 tempest-ServerPasswordTestJSON-1534707503-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:13:17.348289 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-98da59cc-3b95-462b-ac84-d52d7ad7d948 tempest-ServerPasswordTestJSON-1534707503 tempest-ServerPasswordTestJSON-1534707503-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:13:17.585744 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-98da59cc-3b95-462b-ac84-d52d7ad7d948 tempest-ServerPasswordTestJSON-1534707503 tempest-ServerPasswordTestJSON-1534707503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '969cec09484942aebbab6c0f021b7067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9871416ead87433589b8f54783b023b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:13:17.609520 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-98da59cc-3b95-462b-ac84-d52d7ad7d948 tempest-ServerPasswordTestJSON-1534707503 tempest-ServerPasswordTestJSON-1534707503-project] 10.222.0.13 "GET /compute/v2.1/servers/3463bb31-5f34-4b89-8b40-af83df5c7635" status: 200 len: 1510 microversion: 2.1 time: 0.301268 Nov 01 19:13:17.625466 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 2217/4410] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:13:17 2022] GET /compute/v2.1/servers/3463bb31-5f34-4b89-8b40-af83df5c7635 => generated 1510 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:13:17.629751 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-e5fcb70e-a7e7-4cf0-a731-d671a65e3a69 tempest-InstanceActionsTestJSON-621834551 tempest-InstanceActionsTestJSON-621834551-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:13:17.630799 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-e5fcb70e-a7e7-4cf0-a731-d671a65e3a69 tempest-InstanceActionsTestJSON-621834551 tempest-InstanceActionsTestJSON-621834551-project] [instance: 922898a0-ba6d-48cc-9b0b-b3b781eddb9e] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:13:17.638933 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-e5fcb70e-a7e7-4cf0-a731-d671a65e3a69 tempest-InstanceActionsTestJSON-621834551 tempest-InstanceActionsTestJSON-621834551-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:13:17.639594 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-e5fcb70e-a7e7-4cf0-a731-d671a65e3a69 tempest-InstanceActionsTestJSON-621834551 tempest-InstanceActionsTestJSON-621834551-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:13:17.641828 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-e5fcb70e-a7e7-4cf0-a731-d671a65e3a69 tempest-InstanceActionsTestJSON-621834551 tempest-InstanceActionsTestJSON-621834551-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:13:17.641992 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-e5fcb70e-a7e7-4cf0-a731-d671a65e3a69 tempest-InstanceActionsTestJSON-621834551 tempest-InstanceActionsTestJSON-621834551-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:13:17.642885 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-e5fcb70e-a7e7-4cf0-a731-d671a65e3a69 tempest-InstanceActionsTestJSON-621834551 tempest-InstanceActionsTestJSON-621834551-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:13:17.644661 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-e5fcb70e-a7e7-4cf0-a731-d671a65e3a69 tempest-InstanceActionsTestJSON-621834551 tempest-InstanceActionsTestJSON-621834551-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:13:17.789190 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-6b88b4d0-cf0b-4ccd-86ab-b9d4d2b12aed tempest-FloatingIPDetailsTestJSON-1286833380 tempest-FloatingIPDetailsTestJSON-1286833380-project] 10.222.0.13 "DELETE /compute/v2.1/os-floating-ips/d9fdfbbe-946b-47fb-a37f-1f7ccb0e93f4" status: 202 len: 0 microversion: 2.1 time: 2.838010 Nov 01 19:13:17.789862 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 2194/4411] 10.222.0.13 () {58 vars in 1263 bytes} [Tue Nov 1 19:13:14 2022] DELETE /compute/v2.1/os-floating-ips/d9fdfbbe-946b-47fb-a37f-1f7ccb0e93f4 => generated 0 bytes in 2839 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 01 19:13:17.799972 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-da01f3e2-f271-4b3c-87e3-70f8cc2d338d tempest-InstanceActionsV221TestJSON-1016349810 tempest-InstanceActionsV221TestJSON-1016349810-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:13:17.800608 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-da01f3e2-f271-4b3c-87e3-70f8cc2d338d tempest-InstanceActionsV221TestJSON-1016349810 tempest-InstanceActionsV221TestJSON-1016349810-project] [instance: aa7aa9c6-8a88-4948-a623-be7e64e73b5f] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:13:17.816083 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-da01f3e2-f271-4b3c-87e3-70f8cc2d338d tempest-InstanceActionsV221TestJSON-1016349810 tempest-InstanceActionsV221TestJSON-1016349810-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:13:17.816524 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-da01f3e2-f271-4b3c-87e3-70f8cc2d338d tempest-InstanceActionsV221TestJSON-1016349810 tempest-InstanceActionsV221TestJSON-1016349810-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:13:17.836307 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-da01f3e2-f271-4b3c-87e3-70f8cc2d338d tempest-InstanceActionsV221TestJSON-1016349810 tempest-InstanceActionsV221TestJSON-1016349810-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:13:17.839814 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-da01f3e2-f271-4b3c-87e3-70f8cc2d338d tempest-InstanceActionsV221TestJSON-1016349810 tempest-InstanceActionsV221TestJSON-1016349810-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:13:17.840322 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-da01f3e2-f271-4b3c-87e3-70f8cc2d338d tempest-InstanceActionsV221TestJSON-1016349810 tempest-InstanceActionsV221TestJSON-1016349810-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:13:17.840836 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-da01f3e2-f271-4b3c-87e3-70f8cc2d338d tempest-InstanceActionsV221TestJSON-1016349810 tempest-InstanceActionsV221TestJSON-1016349810-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:13:17.869940 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.wsgi [None req-da01f3e2-f271-4b3c-87e3-70f8cc2d338d tempest-InstanceActionsV221TestJSON-1016349810 tempest-InstanceActionsV221TestJSON-1016349810-project] HTTP exception thrown: Instance aa7aa9c6-8a88-4948-a623-be7e64e73b5f could not be found. Nov 01 19:13:17.871543 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-da01f3e2-f271-4b3c-87e3-70f8cc2d338d tempest-InstanceActionsV221TestJSON-1016349810 tempest-InstanceActionsV221TestJSON-1016349810-project] Request method failure captured: Nov 01 19:13:17.871543 n-d-863052-2 devstack@n-api.service[121402]: request: GET /compute/v2.1/servers/aa7aa9c6-8a88-4948-a623-be7e64e73b5f HTTP/1.1 Nov 01 19:13:17.871543 n-d-863052-2 devstack@n-api.service[121402]: Accept: application/json Nov 01 19:13:17.871543 n-d-863052-2 devstack@n-api.service[121402]: Accept-Encoding: identity Nov 01 19:13:17.871543 n-d-863052-2 devstack@n-api.service[121402]: Connection: close Nov 01 19:13:17.871543 n-d-863052-2 devstack@n-api.service[121402]: Content-Length: 0 Nov 01 19:13:17.871543 n-d-863052-2 devstack@n-api.service[121402]: Content-Type: application/json Nov 01 19:13:17.871543 n-d-863052-2 devstack@n-api.service[121402]: Host: 10.222.0.13 Nov 01 19:13:17.871543 n-d-863052-2 devstack@n-api.service[121402]: Openstack-System-Scope: None Nov 01 19:13:17.871543 n-d-863052-2 devstack@n-api.service[121402]: User-Agent: python-urllib3/1.26.12 Nov 01 19:13:17.871543 n-d-863052-2 devstack@n-api.service[121402]: X-Auth-Token: gAAAAABjYW-jJvmtO8f2xaGfJRkESwZAkRQc-E5K2skVUiOIkuGlu6Mbu1us9xrXJ5uDljvHrumazJrtBKf2PEGVjqzef4g_jGRK1L42MVKzgK1cxvVgIb7KHQ0RMP6-c-tovS40_ePyhHnvzoe9vMgGjEpwQzMmf0bptisBCkebFnLK8N8P2Jo Nov 01 19:13:17.871543 n-d-863052-2 devstack@n-api.service[121402]: X-Domain-Id: None Nov 01 19:13:17.871543 n-d-863052-2 devstack@n-api.service[121402]: X-Domain-Name: None Nov 01 19:13:17.871543 n-d-863052-2 devstack@n-api.service[121402]: X-Identity-Status: Confirmed Nov 01 19:13:17.871543 n-d-863052-2 devstack@n-api.service[121402]: X-Is-Admin-Project: True Nov 01 19:13:17.871543 n-d-863052-2 devstack@n-api.service[121402]: X-Openstack-Nova-Api-Version: 2.21 Nov 01 19:13:17.871543 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Domain-Id: default Nov 01 19:13:17.871543 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Domain-Name: Default Nov 01 19:13:17.871543 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Id: 4c29ec5eebf84c198c11bae29e3df2d3 Nov 01 19:13:17.871543 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Name: tempest-InstanceActionsV221TestJSON-1016349810 Nov 01 19:13:17.871543 n-d-863052-2 devstack@n-api.service[121402]: X-Role: member,reader Nov 01 19:13:17.871543 n-d-863052-2 devstack@n-api.service[121402]: X-Roles: member,reader Nov 01 19:13:17.871543 n-d-863052-2 devstack@n-api.service[121402]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/4c29ec5eebf84c198c11bae29e3df2d3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/4c29ec5eebf84c198c11bae29e3df2d3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_4c29ec5eebf84c198c11bae29e3df2d3", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/4c29ec5eebf84c198c11bae29e3df2d3"}]}] Nov 01 19:13:17.871543 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant: tempest-InstanceActionsV221TestJSON-1016349810 Nov 01 19:13:17.871543 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant-Id: 4c29ec5eebf84c198c11bae29e3df2d3 Nov 01 19:13:17.871543 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-1016349810 Nov 01 19:13:17.871543 n-d-863052-2 devstack@n-api.service[121402]: X-User: tempest-InstanceActionsV221TestJSON-1016349810-project Nov 01 19:13:17.871543 n-d-863052-2 devstack@n-api.service[121402]: X-User-Domain-Id: default Nov 01 19:13:17.871543 n-d-863052-2 devstack@n-api.service[121402]: X-User-Domain-Name: Default Nov 01 19:13:17.871543 n-d-863052-2 devstack@n-api.service[121402]: X-User-Id: 060d1fb6604f4096b650cf40060db86a Nov 01 19:13:17.871543 n-d-863052-2 devstack@n-api.service[121402]: X-User-Name: tempest-InstanceActionsV221TestJSON-1016349810-project Nov 01 19:13:17.871543 n-d-863052-2 devstack@n-api.service[121402]: method: > Nov 01 19:13:17.871543 n-d-863052-2 devstack@n-api.service[121402]: exception: Instance aa7aa9c6-8a88-4948-a623-be7e64e73b5f could not be found. Nov 01 19:13:17.871543 n-d-863052-2 devstack@n-api.service[121402]: action_args: {'id': 'aa7aa9c6-8a88-4948-a623-be7e64e73b5f'} Nov 01 19:13:17.871543 n-d-863052-2 devstack@n-api.service[121402]: {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 01 19:13:17.871543 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:13:17.871543 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 01 19:13:17.871543 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 01 19:13:17.871543 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 01 19:13:17.871543 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 01 19:13:17.871543 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 01 19:13:17.871543 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 01 19:13:17.871543 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 01 19:13:17.871543 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 01 19:13:17.871543 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aa7aa9c6-8a88-4948-a623-be7e64e73b5f could not be found. Nov 01 19:13:17.871543 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:13:17.871543 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:13:17.871543 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:13:17.871543 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:13:17.871543 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:13:17.871543 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:13:17.871543 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 01 19:13:17.871543 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 01 19:13:17.871543 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 01 19:13:17.871543 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 01 19:13:17.871543 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 01 19:13:17.871543 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 01 19:13:17.871543 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 01 19:13:17.871543 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 01 19:13:17.871543 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 01 19:13:17.871543 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 01 19:13:17.871543 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aa7aa9c6-8a88-4948-a623-be7e64e73b5f could not be found. Nov 01 19:13:17.871543 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:13:17.871543 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:13:17.877213 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:13:17.877213 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:13:17.877213 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:13:17.877213 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:13:17.877213 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 01 19:13:17.877213 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 01 19:13:17.877213 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aa7aa9c6-8a88-4948-a623-be7e64e73b5f could not be found. Nov 01 19:13:17.877213 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:13:17.877213 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-da01f3e2-f271-4b3c-87e3-70f8cc2d338d tempest-InstanceActionsV221TestJSON-1016349810 tempest-InstanceActionsV221TestJSON-1016349810-project] Returning 404 to user: Instance aa7aa9c6-8a88-4948-a623-be7e64e73b5f could not be found. {{(pid=121402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 01 19:13:17.877213 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-da01f3e2-f271-4b3c-87e3-70f8cc2d338d tempest-InstanceActionsV221TestJSON-1016349810 tempest-InstanceActionsV221TestJSON-1016349810-project] 10.222.0.13 "GET /compute/v2.1/servers/aa7aa9c6-8a88-4948-a623-be7e64e73b5f" status: 404 len: 111 microversion: 2.21 time: 0.077358 Nov 01 19:13:17.888280 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 2195/4412] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Nov 1 19:13:17 2022] GET /compute/v2.1/servers/aa7aa9c6-8a88-4948-a623-be7e64e73b5f => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 01 19:13:17.903244 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [req-bd833b67-6048-4a1e-8974-a3fc440b1a14 req-303c7ece-b218-4152-8904-96d08cf48e9f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "922898a0-ba6d-48cc-9b0b-b3b781eddb9e", "tag": "a57481b3-53f1-44fc-9ad5-428c8f7ff813"}]} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:13:17.929522 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-e5fcb70e-a7e7-4cf0-a731-d671a65e3a69 tempest-InstanceActionsTestJSON-621834551 tempest-InstanceActionsTestJSON-621834551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32430a3dff994c929c0e635b372c9f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553f439f412542e3a36c5db93d039593', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:13:17.935332 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-bd833b67-6048-4a1e-8974-a3fc440b1a14 req-303c7ece-b218-4152-8904-96d08cf48e9f service nova] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:13:17.938412 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-e5fcb70e-a7e7-4cf0-a731-d671a65e3a69 tempest-InstanceActionsTestJSON-621834551 tempest-InstanceActionsTestJSON-621834551-project] 10.222.0.13 "GET /compute/v2.1/servers/922898a0-ba6d-48cc-9b0b-b3b781eddb9e" status: 200 len: 1317 microversion: 2.1 time: 0.323667 Nov 01 19:13:17.938647 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-bd833b67-6048-4a1e-8974-a3fc440b1a14 req-303c7ece-b218-4152-8904-96d08cf48e9f service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:13:17.939005 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 2218/4413] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:13:17 2022] GET /compute/v2.1/servers/922898a0-ba6d-48cc-9b0b-b3b781eddb9e => generated 1317 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:13:17.949330 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-bd833b67-6048-4a1e-8974-a3fc440b1a14 req-303c7ece-b218-4152-8904-96d08cf48e9f service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:13:17.956808 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-367bc687-1551-4fd8-9cdb-47ea051c56e5 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:13:17.956808 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-367bc687-1551-4fd8-9cdb-47ea051c56e5 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] [instance: b27eaab4-a751-47fb-acdb-db7c99b06a5f] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:13:17.982729 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-367bc687-1551-4fd8-9cdb-47ea051c56e5 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:13:17.983243 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-367bc687-1551-4fd8-9cdb-47ea051c56e5 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:13:17.983688 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-367bc687-1551-4fd8-9cdb-47ea051c56e5 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:13:17.984410 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-367bc687-1551-4fd8-9cdb-47ea051c56e5 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:13:17.984907 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-367bc687-1551-4fd8-9cdb-47ea051c56e5 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:13:17.985671 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-367bc687-1551-4fd8-9cdb-47ea051c56e5 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:13:18.002400 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.compute.server_external_events [req-bd833b67-6048-4a1e-8974-a3fc440b1a14 req-303c7ece-b218-4152-8904-96d08cf48e9f service nova] Creating event network-changed:a57481b3-53f1-44fc-9ad5-428c8f7ff813 for instance 922898a0-ba6d-48cc-9b0b-b3b781eddb9e on n-h1-863052-2 Nov 01 19:13:18.012117 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [req-bd833b67-6048-4a1e-8974-a3fc440b1a14 req-303c7ece-b218-4152-8904-96d08cf48e9f service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.120859 Nov 01 19:13:18.012759 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 2196/4414] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Nov 1 19:13:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:13:18.020137 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-b6f7ff14-966e-4349-94be-141d1c7d48e1 tempest-FloatingIPDetailsTestJSON-1286833380 tempest-FloatingIPDetailsTestJSON-1286833380-project] Calling method '.version_select at 0x7f0ae1999820>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:13:18.312227 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-b6f7ff14-966e-4349-94be-141d1c7d48e1 tempest-FloatingIPDetailsTestJSON-1286833380 tempest-FloatingIPDetailsTestJSON-1286833380-project] 10.222.0.13 "GET /compute/v2.1/os-floating-ip-pools" status: 200 len: 43 microversion: 2.1 time: 0.295841 Nov 01 19:13:18.313470 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 2197/4415] 10.222.0.13 () {58 vars in 1164 bytes} [Tue Nov 1 19:13:18 2022] GET /compute/v2.1/os-floating-ip-pools => generated 43 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 01 19:13:18.326888 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-b2b56b4c-81d4-48a1-9848-05b11481886b tempest-FloatingIPDetailsTestJSON-1286833380 tempest-FloatingIPDetailsTestJSON-1286833380-project] Calling method '.version_select at 0x7f0ae2ae6e50>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:13:18.338378 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-367bc687-1551-4fd8-9cdb-47ea051c56e5 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc5c19b930543f5a5091922a9859813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ecdc83933544a899117531a960027a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:13:18.347259 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-367bc687-1551-4fd8-9cdb-47ea051c56e5 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] 10.222.0.13 "GET /compute/v2.1/servers/b27eaab4-a751-47fb-acdb-db7c99b06a5f" status: 200 len: 1506 microversion: 2.1 time: 0.407211 Nov 01 19:13:18.348053 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 2219/4416] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:13:17 2022] GET /compute/v2.1/servers/b27eaab4-a751-47fb-acdb-db7c99b06a5f => generated 1506 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:13:18.372815 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-d3cb2ce9-9dfd-4450-a2b6-c9967b22ddfb tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:13:18.373526 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-d3cb2ce9-9dfd-4450-a2b6-c9967b22ddfb tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] [instance: b27eaab4-a751-47fb-acdb-db7c99b06a5f] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:13:18.380642 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d3cb2ce9-9dfd-4450-a2b6-c9967b22ddfb tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:13:18.381307 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d3cb2ce9-9dfd-4450-a2b6-c9967b22ddfb tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:13:18.382036 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d3cb2ce9-9dfd-4450-a2b6-c9967b22ddfb tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:13:18.382896 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d3cb2ce9-9dfd-4450-a2b6-c9967b22ddfb tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:13:18.383495 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d3cb2ce9-9dfd-4450-a2b6-c9967b22ddfb tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:13:18.384063 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d3cb2ce9-9dfd-4450-a2b6-c9967b22ddfb tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:13:18.502809 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-d3cb2ce9-9dfd-4450-a2b6-c9967b22ddfb tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] 10.222.0.13 "POST /compute/v2.1/servers/b27eaab4-a751-47fb-acdb-db7c99b06a5f/action" status: 202 len: 0 microversion: 2.1 time: 0.133883 Nov 01 19:13:18.508462 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 2220/4417] 10.222.0.13 () {60 vars in 1278 bytes} [Tue Nov 1 19:13:18 2022] POST /compute/v2.1/servers/b27eaab4-a751-47fb-acdb-db7c99b06a5f/action => generated 0 bytes in 140 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 01 19:13:18.515967 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-c51d6315-e159-4d1b-92f0-a011b52a88c9 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:13:18.516940 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-c51d6315-e159-4d1b-92f0-a011b52a88c9 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] [instance: b27eaab4-a751-47fb-acdb-db7c99b06a5f] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:13:18.525532 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-c51d6315-e159-4d1b-92f0-a011b52a88c9 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:13:18.526420 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-c51d6315-e159-4d1b-92f0-a011b52a88c9 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:13:18.528153 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-c51d6315-e159-4d1b-92f0-a011b52a88c9 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:13:18.529232 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-c51d6315-e159-4d1b-92f0-a011b52a88c9 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:13:18.530085 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-c51d6315-e159-4d1b-92f0-a011b52a88c9 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:13:18.530710 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-c51d6315-e159-4d1b-92f0-a011b52a88c9 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:13:18.811524 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-b2b56b4c-81d4-48a1-9848-05b11481886b tempest-FloatingIPDetailsTestJSON-1286833380 tempest-FloatingIPDetailsTestJSON-1286833380-project] 10.222.0.13 "GET /compute/v2.1/os-floating-ips" status: 200 len: 398 microversion: 2.1 time: 0.490517 Nov 01 19:13:18.812239 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 2198/4418] 10.222.0.13 () {58 vars in 1149 bytes} [Tue Nov 1 19:13:18 2022] GET /compute/v2.1/os-floating-ips => generated 398 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:13:18.821547 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-083ba725-b40b-45f3-a963-1938138786d3 tempest-ServerPasswordTestJSON-1534707503 tempest-ServerPasswordTestJSON-1534707503-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:13:18.822699 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-083ba725-b40b-45f3-a963-1938138786d3 tempest-ServerPasswordTestJSON-1534707503 tempest-ServerPasswordTestJSON-1534707503-project] [instance: 3463bb31-5f34-4b89-8b40-af83df5c7635] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:13:18.838384 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-083ba725-b40b-45f3-a963-1938138786d3 tempest-ServerPasswordTestJSON-1534707503 tempest-ServerPasswordTestJSON-1534707503-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:13:18.840861 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-083ba725-b40b-45f3-a963-1938138786d3 tempest-ServerPasswordTestJSON-1534707503 tempest-ServerPasswordTestJSON-1534707503-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:13:18.843648 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-083ba725-b40b-45f3-a963-1938138786d3 tempest-ServerPasswordTestJSON-1534707503 tempest-ServerPasswordTestJSON-1534707503-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:13:18.844657 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-083ba725-b40b-45f3-a963-1938138786d3 tempest-ServerPasswordTestJSON-1534707503 tempest-ServerPasswordTestJSON-1534707503-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:13:18.845356 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-083ba725-b40b-45f3-a963-1938138786d3 tempest-ServerPasswordTestJSON-1534707503 tempest-ServerPasswordTestJSON-1534707503-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:13:18.847200 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-083ba725-b40b-45f3-a963-1938138786d3 tempest-ServerPasswordTestJSON-1534707503 tempest-ServerPasswordTestJSON-1534707503-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:13:19.033023 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-c51d6315-e159-4d1b-92f0-a011b52a88c9 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc5c19b930543f5a5091922a9859813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ecdc83933544a899117531a960027a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:13:19.045241 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-c51d6315-e159-4d1b-92f0-a011b52a88c9 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] 10.222.0.13 "GET /compute/v2.1/servers/b27eaab4-a751-47fb-acdb-db7c99b06a5f" status: 200 len: 1511 microversion: 2.1 time: 0.534381 Nov 01 19:13:19.046234 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 2221/4419] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:13:18 2022] GET /compute/v2.1/servers/b27eaab4-a751-47fb-acdb-db7c99b06a5f => generated 1511 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:13:19.050895 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-52b11b71-5d14-44ff-953c-53345f6f25ff tempest-FloatingIPDetailsTestJSON-1286833380 tempest-FloatingIPDetailsTestJSON-1286833380-project] Calling method '.version_select at 0x7f0ae2272af0>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:13:19.112896 n-d-863052-2 devstack@n-api.service[121403]: DEBUG dbcounter [-] [121403] Writing DB stats nova_cell0:SELECT=2 {{(pid=121403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 19:13:19.154670 n-d-863052-2 devstack@n-api.service[121403]: DEBUG dbcounter [-] [121403] Writing DB stats nova_cell0:SELECT=6 {{(pid=121403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 19:13:19.399014 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-083ba725-b40b-45f3-a963-1938138786d3 tempest-ServerPasswordTestJSON-1534707503 tempest-ServerPasswordTestJSON-1534707503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '969cec09484942aebbab6c0f021b7067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9871416ead87433589b8f54783b023b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:13:19.410293 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-083ba725-b40b-45f3-a963-1938138786d3 tempest-ServerPasswordTestJSON-1534707503 tempest-ServerPasswordTestJSON-1534707503-project] 10.222.0.13 "GET /compute/v2.1/servers/3463bb31-5f34-4b89-8b40-af83df5c7635" status: 200 len: 1510 microversion: 2.1 time: 0.596840 Nov 01 19:13:19.413322 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 2199/4420] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:13:18 2022] GET /compute/v2.1/servers/3463bb31-5f34-4b89-8b40-af83df5c7635 => generated 1510 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:13:19.421743 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-ddc766fb-f590-45ee-8d37-81da6d6b4080 tempest-InstanceActionsTestJSON-621834551 tempest-InstanceActionsTestJSON-621834551-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:13:19.422572 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-ddc766fb-f590-45ee-8d37-81da6d6b4080 tempest-InstanceActionsTestJSON-621834551 tempest-InstanceActionsTestJSON-621834551-project] [instance: 922898a0-ba6d-48cc-9b0b-b3b781eddb9e] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:13:19.447399 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-ddc766fb-f590-45ee-8d37-81da6d6b4080 tempest-InstanceActionsTestJSON-621834551 tempest-InstanceActionsTestJSON-621834551-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:13:19.448320 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-ddc766fb-f590-45ee-8d37-81da6d6b4080 tempest-InstanceActionsTestJSON-621834551 tempest-InstanceActionsTestJSON-621834551-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:13:19.449601 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-ddc766fb-f590-45ee-8d37-81da6d6b4080 tempest-InstanceActionsTestJSON-621834551 tempest-InstanceActionsTestJSON-621834551-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:13:19.450856 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-ddc766fb-f590-45ee-8d37-81da6d6b4080 tempest-InstanceActionsTestJSON-621834551 tempest-InstanceActionsTestJSON-621834551-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:13:19.451492 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-ddc766fb-f590-45ee-8d37-81da6d6b4080 tempest-InstanceActionsTestJSON-621834551 tempest-InstanceActionsTestJSON-621834551-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:13:19.458866 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-ddc766fb-f590-45ee-8d37-81da6d6b4080 tempest-InstanceActionsTestJSON-621834551 tempest-InstanceActionsTestJSON-621834551-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:13:19.722357 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-ddc766fb-f590-45ee-8d37-81da6d6b4080 tempest-InstanceActionsTestJSON-621834551 tempest-InstanceActionsTestJSON-621834551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32430a3dff994c929c0e635b372c9f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553f439f412542e3a36c5db93d039593', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:13:19.738246 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-ddc766fb-f590-45ee-8d37-81da6d6b4080 tempest-InstanceActionsTestJSON-621834551 tempest-InstanceActionsTestJSON-621834551-project] 10.222.0.13 "GET /compute/v2.1/servers/922898a0-ba6d-48cc-9b0b-b3b781eddb9e" status: 200 len: 1317 microversion: 2.1 time: 0.321263 Nov 01 19:13:19.743488 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 2200/4421] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:13:19 2022] GET /compute/v2.1/servers/922898a0-ba6d-48cc-9b0b-b3b781eddb9e => generated 1317 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:13:20.076277 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-4499fa29-fbd5-495e-a3f4-71fb1d347212 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:13:20.077591 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-4499fa29-fbd5-495e-a3f4-71fb1d347212 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] [instance: b27eaab4-a751-47fb-acdb-db7c99b06a5f] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:13:20.081000 n-d-863052-2 devstack@n-api.service[121402]: DEBUG dbcounter [-] [121402] Writing DB stats nova_cell0:SELECT=2 {{(pid=121402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 19:13:20.097121 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-4499fa29-fbd5-495e-a3f4-71fb1d347212 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:13:20.098871 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-4499fa29-fbd5-495e-a3f4-71fb1d347212 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:13:20.106925 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-4499fa29-fbd5-495e-a3f4-71fb1d347212 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:13:20.107708 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-4499fa29-fbd5-495e-a3f4-71fb1d347212 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:13:20.110429 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-4499fa29-fbd5-495e-a3f4-71fb1d347212 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:13:20.110906 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-4499fa29-fbd5-495e-a3f4-71fb1d347212 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:13:20.536485 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-4499fa29-fbd5-495e-a3f4-71fb1d347212 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc5c19b930543f5a5091922a9859813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ecdc83933544a899117531a960027a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:13:20.554198 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-4499fa29-fbd5-495e-a3f4-71fb1d347212 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] 10.222.0.13 "GET /compute/v2.1/servers/b27eaab4-a751-47fb-acdb-db7c99b06a5f" status: 200 len: 1491 microversion: 2.1 time: 0.481216 Nov 01 19:13:20.556253 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 2201/4422] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:13:20 2022] GET /compute/v2.1/servers/b27eaab4-a751-47fb-acdb-db7c99b06a5f => generated 1491 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 19:13:20.564276 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-b92edae1-7bad-4297-b2b0-636547e87e9b tempest-ServerPasswordTestJSON-1534707503 tempest-ServerPasswordTestJSON-1534707503-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:13:20.565560 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-b92edae1-7bad-4297-b2b0-636547e87e9b tempest-ServerPasswordTestJSON-1534707503 tempest-ServerPasswordTestJSON-1534707503-project] [instance: 3463bb31-5f34-4b89-8b40-af83df5c7635] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:13:20.582605 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b92edae1-7bad-4297-b2b0-636547e87e9b tempest-ServerPasswordTestJSON-1534707503 tempest-ServerPasswordTestJSON-1534707503-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:13:20.583415 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b92edae1-7bad-4297-b2b0-636547e87e9b tempest-ServerPasswordTestJSON-1534707503 tempest-ServerPasswordTestJSON-1534707503-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:13:20.584075 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b92edae1-7bad-4297-b2b0-636547e87e9b tempest-ServerPasswordTestJSON-1534707503 tempest-ServerPasswordTestJSON-1534707503-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:13:20.584840 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b92edae1-7bad-4297-b2b0-636547e87e9b tempest-ServerPasswordTestJSON-1534707503 tempest-ServerPasswordTestJSON-1534707503-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:13:20.585338 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b92edae1-7bad-4297-b2b0-636547e87e9b tempest-ServerPasswordTestJSON-1534707503 tempest-ServerPasswordTestJSON-1534707503-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:13:20.585776 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b92edae1-7bad-4297-b2b0-636547e87e9b tempest-ServerPasswordTestJSON-1534707503 tempest-ServerPasswordTestJSON-1534707503-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:13:20.662808 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b92edae1-7bad-4297-b2b0-636547e87e9b tempest-ServerPasswordTestJSON-1534707503 tempest-ServerPasswordTestJSON-1534707503-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:13:20.663306 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b92edae1-7bad-4297-b2b0-636547e87e9b tempest-ServerPasswordTestJSON-1534707503 tempest-ServerPasswordTestJSON-1534707503-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:13:20.668885 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b92edae1-7bad-4297-b2b0-636547e87e9b tempest-ServerPasswordTestJSON-1534707503 tempest-ServerPasswordTestJSON-1534707503-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:13:20.669371 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.objects.instance [None req-b92edae1-7bad-4297-b2b0-636547e87e9b tempest-ServerPasswordTestJSON-1534707503 tempest-ServerPasswordTestJSON-1534707503-project] Lazy-loading 'fault' on Instance uuid 3463bb31-5f34-4b89-8b40-af83df5c7635 {{(pid=121402) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 01 19:13:20.769695 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-b92edae1-7bad-4297-b2b0-636547e87e9b tempest-ServerPasswordTestJSON-1534707503 tempest-ServerPasswordTestJSON-1534707503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '969cec09484942aebbab6c0f021b7067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9871416ead87433589b8f54783b023b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:13:20.778312 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-b92edae1-7bad-4297-b2b0-636547e87e9b tempest-ServerPasswordTestJSON-1534707503 tempest-ServerPasswordTestJSON-1534707503-project] 10.222.0.13 "GET /compute/v2.1/servers/3463bb31-5f34-4b89-8b40-af83df5c7635" status: 200 len: 1306 microversion: 2.1 time: 0.220442 Nov 01 19:13:20.785198 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 2202/4423] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:13:20 2022] GET /compute/v2.1/servers/3463bb31-5f34-4b89-8b40-af83df5c7635 => generated 1306 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:13:20.789950 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [req-407bd7c4-1ac5-49b5-9fb7-2037b9bf22ac req-3ace7331-bf6e-47d5-ace1-7098fa9db566 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3463bb31-5f34-4b89-8b40-af83df5c7635", "name": "network-vif-deleted", "tag": "904e2114-15bb-4980-94da-1ab46ccf1c70"}]} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:13:20.811290 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-407bd7c4-1ac5-49b5-9fb7-2037b9bf22ac req-3ace7331-bf6e-47d5-ace1-7098fa9db566 service nova] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:13:20.812246 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-407bd7c4-1ac5-49b5-9fb7-2037b9bf22ac req-3ace7331-bf6e-47d5-ace1-7098fa9db566 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:13:20.812718 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-407bd7c4-1ac5-49b5-9fb7-2037b9bf22ac req-3ace7331-bf6e-47d5-ace1-7098fa9db566 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:13:20.826155 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.compute.server_external_events [req-407bd7c4-1ac5-49b5-9fb7-2037b9bf22ac req-3ace7331-bf6e-47d5-ace1-7098fa9db566 service nova] Creating event network-vif-deleted:904e2114-15bb-4980-94da-1ab46ccf1c70 for instance 3463bb31-5f34-4b89-8b40-af83df5c7635 on n-h2-863052-2 Nov 01 19:13:20.831495 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [req-407bd7c4-1ac5-49b5-9fb7-2037b9bf22ac req-3ace7331-bf6e-47d5-ace1-7098fa9db566 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045096 Nov 01 19:13:20.832388 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 2203/4424] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Nov 1 19:13:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:13:20.839960 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-d649acd3-723c-443f-b9e5-b1a88cb9f2b6 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:13:20.840605 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-d649acd3-723c-443f-b9e5-b1a88cb9f2b6 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] [instance: b27eaab4-a751-47fb-acdb-db7c99b06a5f] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:13:20.846950 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-d649acd3-723c-443f-b9e5-b1a88cb9f2b6 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:13:20.847445 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-d649acd3-723c-443f-b9e5-b1a88cb9f2b6 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:13:20.847883 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-d649acd3-723c-443f-b9e5-b1a88cb9f2b6 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:13:20.848747 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-d649acd3-723c-443f-b9e5-b1a88cb9f2b6 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:13:20.849210 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-d649acd3-723c-443f-b9e5-b1a88cb9f2b6 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:13:20.849637 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-d649acd3-723c-443f-b9e5-b1a88cb9f2b6 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:13:20.893062 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.wsgi [None req-d649acd3-723c-443f-b9e5-b1a88cb9f2b6 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] HTTP exception thrown: Cannot 'pause' instance b27eaab4-a751-47fb-acdb-db7c99b06a5f while it is in vm_state paused Nov 01 19:13:20.894996 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-d649acd3-723c-443f-b9e5-b1a88cb9f2b6 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Request method failure captured: Nov 01 19:13:20.894996 n-d-863052-2 devstack@n-api.service[121402]: request: POST /compute/v2.1/servers/b27eaab4-a751-47fb-acdb-db7c99b06a5f/action HTTP/1.1 Nov 01 19:13:20.894996 n-d-863052-2 devstack@n-api.service[121402]: Accept: application/json Nov 01 19:13:20.894996 n-d-863052-2 devstack@n-api.service[121402]: Accept-Encoding: identity Nov 01 19:13:20.894996 n-d-863052-2 devstack@n-api.service[121402]: Connection: close Nov 01 19:13:20.894996 n-d-863052-2 devstack@n-api.service[121402]: Content-Length: 13 Nov 01 19:13:20.894996 n-d-863052-2 devstack@n-api.service[121402]: Content-Type: application/json Nov 01 19:13:20.894996 n-d-863052-2 devstack@n-api.service[121402]: Host: 10.222.0.13 Nov 01 19:13:20.894996 n-d-863052-2 devstack@n-api.service[121402]: Openstack-System-Scope: None Nov 01 19:13:20.894996 n-d-863052-2 devstack@n-api.service[121402]: User-Agent: python-urllib3/1.26.12 Nov 01 19:13:20.894996 n-d-863052-2 devstack@n-api.service[121402]: X-Auth-Token: gAAAAABjYW9YFTR7hO-vK03S-3HbvOtG2z3_fji2KJH39vNHENu4xIKneeHYviQiPj9ERGiA3aZIA7DvAYzczgSZ5-vK782IQ7CYnUFXvn9Aqt1AbunNMYxhes9BKzhvODzqwzqiQq89wgC4nbpZ9jJWFWMOC4z9bcW4UMi_ylwdZFjmhWfD49s Nov 01 19:13:20.894996 n-d-863052-2 devstack@n-api.service[121402]: X-Domain-Id: None Nov 01 19:13:20.894996 n-d-863052-2 devstack@n-api.service[121402]: X-Domain-Name: None Nov 01 19:13:20.894996 n-d-863052-2 devstack@n-api.service[121402]: X-Identity-Status: Confirmed Nov 01 19:13:20.894996 n-d-863052-2 devstack@n-api.service[121402]: X-Is-Admin-Project: True Nov 01 19:13:20.894996 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Domain-Id: default Nov 01 19:13:20.894996 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Domain-Name: Default Nov 01 19:13:20.894996 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Id: 9ecdc83933544a899117531a960027a7 Nov 01 19:13:20.894996 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Name: tempest-ServersNegativeTestJSON-638944671 Nov 01 19:13:20.894996 n-d-863052-2 devstack@n-api.service[121402]: X-Role: member,reader Nov 01 19:13:20.894996 n-d-863052-2 devstack@n-api.service[121402]: X-Roles: member,reader Nov 01 19:13:20.894996 n-d-863052-2 devstack@n-api.service[121402]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/9ecdc83933544a899117531a960027a7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/9ecdc83933544a899117531a960027a7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_9ecdc83933544a899117531a960027a7", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/9ecdc83933544a899117531a960027a7"}]}] Nov 01 19:13:20.894996 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant: tempest-ServersNegativeTestJSON-638944671 Nov 01 19:13:20.894996 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant-Id: 9ecdc83933544a899117531a960027a7 Nov 01 19:13:20.894996 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant-Name: tempest-ServersNegativeTestJSON-638944671 Nov 01 19:13:20.894996 n-d-863052-2 devstack@n-api.service[121402]: X-User: tempest-ServersNegativeTestJSON-638944671-project Nov 01 19:13:20.894996 n-d-863052-2 devstack@n-api.service[121402]: X-User-Domain-Id: default Nov 01 19:13:20.894996 n-d-863052-2 devstack@n-api.service[121402]: X-User-Domain-Name: Default Nov 01 19:13:20.894996 n-d-863052-2 devstack@n-api.service[121402]: X-User-Id: 3fc5c19b930543f5a5091922a9859813 Nov 01 19:13:20.894996 n-d-863052-2 devstack@n-api.service[121402]: X-User-Name: tempest-ServersNegativeTestJSON-638944671-project Nov 01 19:13:20.894996 n-d-863052-2 devstack@n-api.service[121402]: Nov 01 19:13:20.894996 n-d-863052-2 devstack@n-api.service[121402]: {"pause": {}} Nov 01 19:13:20.894996 n-d-863052-2 devstack@n-api.service[121402]: method: > Nov 01 19:13:20.894996 n-d-863052-2 devstack@n-api.service[121402]: exception: Cannot 'pause' instance b27eaab4-a751-47fb-acdb-db7c99b06a5f while it is in vm_state paused Nov 01 19:13:20.894996 n-d-863052-2 devstack@n-api.service[121402]: action_args: {'id': 'b27eaab4-a751-47fb-acdb-db7c99b06a5f', 'body': {'pause': {}}} Nov 01 19:13:20.894996 n-d-863052-2 devstack@n-api.service[121402]: {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 01 19:13:20.894996 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:13:20.894996 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 41, in _pause Nov 01 19:13:20.894996 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi self.compute_api.pause(ctxt, server) Nov 01 19:13:20.894996 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Nov 01 19:13:20.894996 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Nov 01 19:13:20.894996 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Nov 01 19:13:20.894996 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Nov 01 19:13:20.894996 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance b27eaab4-a751-47fb-acdb-db7c99b06a5f in vm_state paused. Cannot pause while the instance is in this state. Nov 01 19:13:20.894996 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:13:20.894996 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:13:20.894996 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:13:20.894996 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:13:20.894996 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:13:20.894996 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:13:20.894996 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 01 19:13:20.894996 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 01 19:13:20.894996 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 01 19:13:20.894996 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 01 19:13:20.894996 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 45, in _pause Nov 01 19:13:20.894996 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Nov 01 19:13:20.894996 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Nov 01 19:13:20.894996 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Nov 01 19:13:20.894996 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'pause' instance b27eaab4-a751-47fb-acdb-db7c99b06a5f while it is in vm_state paused Nov 01 19:13:20.894996 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:13:20.894996 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:13:20.894996 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:13:20.894996 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:13:20.894996 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:13:20.899451 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:13:20.899451 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 01 19:13:20.899451 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 01 19:13:20.899451 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'pause' instance b27eaab4-a751-47fb-acdb-db7c99b06a5f while it is in vm_state paused Nov 01 19:13:20.899451 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:13:20.899451 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-d649acd3-723c-443f-b9e5-b1a88cb9f2b6 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Returning 409 to user: Cannot 'pause' instance b27eaab4-a751-47fb-acdb-db7c99b06a5f while it is in vm_state paused {{(pid=121402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 01 19:13:20.899451 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-d649acd3-723c-443f-b9e5-b1a88cb9f2b6 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] 10.222.0.13 "POST /compute/v2.1/servers/b27eaab4-a751-47fb-acdb-db7c99b06a5f/action" status: 409 len: 143 microversion: 2.1 time: 0.062898 Nov 01 19:13:20.899451 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 2204/4425] 10.222.0.13 () {60 vars in 1278 bytes} [Tue Nov 1 19:13:20 2022] POST /compute/v2.1/servers/b27eaab4-a751-47fb-acdb-db7c99b06a5f/action => generated 143 bytes in 64 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Nov 01 19:13:20.918769 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-99c34608-cd06-4d23-83e5-fdd2ea877673 tempest-InstanceActionsTestJSON-621834551 tempest-InstanceActionsTestJSON-621834551-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:13:20.919648 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-99c34608-cd06-4d23-83e5-fdd2ea877673 tempest-InstanceActionsTestJSON-621834551 tempest-InstanceActionsTestJSON-621834551-project] [instance: 922898a0-ba6d-48cc-9b0b-b3b781eddb9e] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:13:20.928346 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-99c34608-cd06-4d23-83e5-fdd2ea877673 tempest-InstanceActionsTestJSON-621834551 tempest-InstanceActionsTestJSON-621834551-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:13:20.929107 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-99c34608-cd06-4d23-83e5-fdd2ea877673 tempest-InstanceActionsTestJSON-621834551 tempest-InstanceActionsTestJSON-621834551-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:13:20.929712 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-99c34608-cd06-4d23-83e5-fdd2ea877673 tempest-InstanceActionsTestJSON-621834551 tempest-InstanceActionsTestJSON-621834551-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:13:20.931428 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-99c34608-cd06-4d23-83e5-fdd2ea877673 tempest-InstanceActionsTestJSON-621834551 tempest-InstanceActionsTestJSON-621834551-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:13:20.932341 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-99c34608-cd06-4d23-83e5-fdd2ea877673 tempest-InstanceActionsTestJSON-621834551 tempest-InstanceActionsTestJSON-621834551-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:13:20.933094 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-99c34608-cd06-4d23-83e5-fdd2ea877673 tempest-InstanceActionsTestJSON-621834551 tempest-InstanceActionsTestJSON-621834551-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:13:21.187127 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-99c34608-cd06-4d23-83e5-fdd2ea877673 tempest-InstanceActionsTestJSON-621834551 tempest-InstanceActionsTestJSON-621834551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32430a3dff994c929c0e635b372c9f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553f439f412542e3a36c5db93d039593', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:13:21.199969 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-99c34608-cd06-4d23-83e5-fdd2ea877673 tempest-InstanceActionsTestJSON-621834551 tempest-InstanceActionsTestJSON-621834551-project] 10.222.0.13 "GET /compute/v2.1/servers/922898a0-ba6d-48cc-9b0b-b3b781eddb9e" status: 200 len: 1317 microversion: 2.1 time: 0.294199 Nov 01 19:13:21.212627 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 2205/4426] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:13:20 2022] GET /compute/v2.1/servers/922898a0-ba6d-48cc-9b0b-b3b781eddb9e => generated 1317 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:13:21.212627 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-5d574635-1bd6-4dd7-9961-a0b6010cd1bf tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:13:21.212627 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-5d574635-1bd6-4dd7-9961-a0b6010cd1bf tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] [instance: b27eaab4-a751-47fb-acdb-db7c99b06a5f] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:13:21.216857 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-5d574635-1bd6-4dd7-9961-a0b6010cd1bf tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:13:21.217717 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-5d574635-1bd6-4dd7-9961-a0b6010cd1bf tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:13:21.218949 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-5d574635-1bd6-4dd7-9961-a0b6010cd1bf tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:13:21.220169 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-5d574635-1bd6-4dd7-9961-a0b6010cd1bf tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:13:21.220908 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-5d574635-1bd6-4dd7-9961-a0b6010cd1bf tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:13:21.221480 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-5d574635-1bd6-4dd7-9961-a0b6010cd1bf tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:13:21.374608 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-5d574635-1bd6-4dd7-9961-a0b6010cd1bf tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] 10.222.0.13 "POST /compute/v2.1/servers/b27eaab4-a751-47fb-acdb-db7c99b06a5f/action" status: 202 len: 0 microversion: 2.1 time: 0.171829 Nov 01 19:13:21.375704 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 2206/4427] 10.222.0.13 () {60 vars in 1278 bytes} [Tue Nov 1 19:13:21 2022] POST /compute/v2.1/servers/b27eaab4-a751-47fb-acdb-db7c99b06a5f/action => generated 0 bytes in 174 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 01 19:13:21.396741 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-720a628a-8cd0-47c4-907b-9771f3ffd416 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:13:21.397813 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-720a628a-8cd0-47c4-907b-9771f3ffd416 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] [instance: b27eaab4-a751-47fb-acdb-db7c99b06a5f] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:13:21.423458 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-720a628a-8cd0-47c4-907b-9771f3ffd416 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:13:21.428984 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-720a628a-8cd0-47c4-907b-9771f3ffd416 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:13:21.437263 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-720a628a-8cd0-47c4-907b-9771f3ffd416 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:13:21.441634 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-720a628a-8cd0-47c4-907b-9771f3ffd416 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:13:21.442460 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-720a628a-8cd0-47c4-907b-9771f3ffd416 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:13:21.443063 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-720a628a-8cd0-47c4-907b-9771f3ffd416 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:13:21.446692 n-d-863052-2 devstack@n-api.service[121402]: DEBUG dbcounter [-] [121402] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 19:13:21.525952 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-52b11b71-5d14-44ff-953c-53345f6f25ff tempest-FloatingIPDetailsTestJSON-1286833380 tempest-FloatingIPDetailsTestJSON-1286833380-project] 10.222.0.13 "DELETE /compute/v2.1/os-floating-ips/8bb36b6d-e652-434c-8ac0-137f3e2bf09c" status: 202 len: 0 microversion: 2.1 time: 2.478229 Nov 01 19:13:21.527291 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 2222/4428] 10.222.0.13 () {58 vars in 1263 bytes} [Tue Nov 1 19:13:19 2022] DELETE /compute/v2.1/os-floating-ips/8bb36b6d-e652-434c-8ac0-137f3e2bf09c => generated 0 bytes in 2480 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 01 19:13:21.554449 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-de39aa8d-78e4-46a3-be75-aa0c0a6fbace tempest-FloatingIPDetailsTestJSON-1286833380 tempest-FloatingIPDetailsTestJSON-1286833380-project] Calling method '.version_select at 0x7f0ae1d1f670>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:13:21.764254 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-720a628a-8cd0-47c4-907b-9771f3ffd416 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc5c19b930543f5a5091922a9859813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ecdc83933544a899117531a960027a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:13:21.783428 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-720a628a-8cd0-47c4-907b-9771f3ffd416 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] 10.222.0.13 "GET /compute/v2.1/servers/b27eaab4-a751-47fb-acdb-db7c99b06a5f" status: 200 len: 1498 microversion: 2.1 time: 0.385362 Nov 01 19:13:21.810174 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 2207/4429] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:13:21 2022] GET /compute/v2.1/servers/b27eaab4-a751-47fb-acdb-db7c99b06a5f => generated 1498 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:13:21.824299 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-ce04ef22-6c8d-4579-a240-ff8603e24ab6 tempest-ServerPasswordTestJSON-1534707503 tempest-ServerPasswordTestJSON-1534707503-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:13:21.826130 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-ce04ef22-6c8d-4579-a240-ff8603e24ab6 tempest-ServerPasswordTestJSON-1534707503 tempest-ServerPasswordTestJSON-1534707503-project] [instance: 3463bb31-5f34-4b89-8b40-af83df5c7635] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:13:21.837209 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-ce04ef22-6c8d-4579-a240-ff8603e24ab6 tempest-ServerPasswordTestJSON-1534707503 tempest-ServerPasswordTestJSON-1534707503-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:13:21.838264 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-ce04ef22-6c8d-4579-a240-ff8603e24ab6 tempest-ServerPasswordTestJSON-1534707503 tempest-ServerPasswordTestJSON-1534707503-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:13:21.839950 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-ce04ef22-6c8d-4579-a240-ff8603e24ab6 tempest-ServerPasswordTestJSON-1534707503 tempest-ServerPasswordTestJSON-1534707503-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:13:21.841286 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-ce04ef22-6c8d-4579-a240-ff8603e24ab6 tempest-ServerPasswordTestJSON-1534707503 tempest-ServerPasswordTestJSON-1534707503-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:13:21.841977 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-ce04ef22-6c8d-4579-a240-ff8603e24ab6 tempest-ServerPasswordTestJSON-1534707503 tempest-ServerPasswordTestJSON-1534707503-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:13:21.845107 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-ce04ef22-6c8d-4579-a240-ff8603e24ab6 tempest-ServerPasswordTestJSON-1534707503 tempest-ServerPasswordTestJSON-1534707503-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:13:21.869623 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.wsgi [None req-ce04ef22-6c8d-4579-a240-ff8603e24ab6 tempest-ServerPasswordTestJSON-1534707503 tempest-ServerPasswordTestJSON-1534707503-project] HTTP exception thrown: Instance 3463bb31-5f34-4b89-8b40-af83df5c7635 could not be found. Nov 01 19:13:21.871937 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-ce04ef22-6c8d-4579-a240-ff8603e24ab6 tempest-ServerPasswordTestJSON-1534707503 tempest-ServerPasswordTestJSON-1534707503-project] Request method failure captured: Nov 01 19:13:21.871937 n-d-863052-2 devstack@n-api.service[121402]: request: GET /compute/v2.1/servers/3463bb31-5f34-4b89-8b40-af83df5c7635 HTTP/1.1 Nov 01 19:13:21.871937 n-d-863052-2 devstack@n-api.service[121402]: Accept: application/json Nov 01 19:13:21.871937 n-d-863052-2 devstack@n-api.service[121402]: Accept-Encoding: identity Nov 01 19:13:21.871937 n-d-863052-2 devstack@n-api.service[121402]: Connection: close Nov 01 19:13:21.871937 n-d-863052-2 devstack@n-api.service[121402]: Content-Length: 0 Nov 01 19:13:21.871937 n-d-863052-2 devstack@n-api.service[121402]: Content-Type: application/json Nov 01 19:13:21.871937 n-d-863052-2 devstack@n-api.service[121402]: Host: 10.222.0.13 Nov 01 19:13:21.871937 n-d-863052-2 devstack@n-api.service[121402]: Openstack-System-Scope: None Nov 01 19:13:21.871937 n-d-863052-2 devstack@n-api.service[121402]: User-Agent: python-urllib3/1.26.12 Nov 01 19:13:21.871937 n-d-863052-2 devstack@n-api.service[121402]: X-Auth-Token: gAAAAABjYW-ksxhFYKOQ19vJ_V6p6UEY6PO3vPGs6GvawTLfR-VbcMExv1tqO0BXjsNyYYd0jTXJZuMKcUUYtj0AVfCUfob8OkjvKspWS4ygF0et9o2D0QKTX33LadVJve1Glmch_8QwRqRplyt1AuJNUzHsEfbRN10skwlAc0ya7amgKsKRPaQ Nov 01 19:13:21.871937 n-d-863052-2 devstack@n-api.service[121402]: X-Domain-Id: None Nov 01 19:13:21.871937 n-d-863052-2 devstack@n-api.service[121402]: X-Domain-Name: None Nov 01 19:13:21.871937 n-d-863052-2 devstack@n-api.service[121402]: X-Identity-Status: Confirmed Nov 01 19:13:21.871937 n-d-863052-2 devstack@n-api.service[121402]: X-Is-Admin-Project: True Nov 01 19:13:21.871937 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Domain-Id: default Nov 01 19:13:21.871937 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Domain-Name: Default Nov 01 19:13:21.871937 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Id: 9871416ead87433589b8f54783b023b1 Nov 01 19:13:21.871937 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Name: tempest-ServerPasswordTestJSON-1534707503 Nov 01 19:13:21.871937 n-d-863052-2 devstack@n-api.service[121402]: X-Role: member,reader Nov 01 19:13:21.871937 n-d-863052-2 devstack@n-api.service[121402]: X-Roles: member,reader Nov 01 19:13:21.871937 n-d-863052-2 devstack@n-api.service[121402]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/9871416ead87433589b8f54783b023b1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/9871416ead87433589b8f54783b023b1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_9871416ead87433589b8f54783b023b1", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/9871416ead87433589b8f54783b023b1"}]}] Nov 01 19:13:21.871937 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant: tempest-ServerPasswordTestJSON-1534707503 Nov 01 19:13:21.871937 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant-Id: 9871416ead87433589b8f54783b023b1 Nov 01 19:13:21.871937 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant-Name: tempest-ServerPasswordTestJSON-1534707503 Nov 01 19:13:21.871937 n-d-863052-2 devstack@n-api.service[121402]: X-User: tempest-ServerPasswordTestJSON-1534707503-project Nov 01 19:13:21.871937 n-d-863052-2 devstack@n-api.service[121402]: X-User-Domain-Id: default Nov 01 19:13:21.871937 n-d-863052-2 devstack@n-api.service[121402]: X-User-Domain-Name: Default Nov 01 19:13:21.871937 n-d-863052-2 devstack@n-api.service[121402]: X-User-Id: 969cec09484942aebbab6c0f021b7067 Nov 01 19:13:21.871937 n-d-863052-2 devstack@n-api.service[121402]: X-User-Name: tempest-ServerPasswordTestJSON-1534707503-project Nov 01 19:13:21.871937 n-d-863052-2 devstack@n-api.service[121402]: method: > Nov 01 19:13:21.871937 n-d-863052-2 devstack@n-api.service[121402]: exception: Instance 3463bb31-5f34-4b89-8b40-af83df5c7635 could not be found. Nov 01 19:13:21.871937 n-d-863052-2 devstack@n-api.service[121402]: action_args: {'id': '3463bb31-5f34-4b89-8b40-af83df5c7635'} Nov 01 19:13:21.871937 n-d-863052-2 devstack@n-api.service[121402]: {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 01 19:13:21.871937 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:13:21.871937 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 01 19:13:21.871937 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 01 19:13:21.871937 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 01 19:13:21.871937 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 01 19:13:21.871937 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 01 19:13:21.871937 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 01 19:13:21.871937 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 01 19:13:21.871937 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 01 19:13:21.871937 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3463bb31-5f34-4b89-8b40-af83df5c7635 could not be found. Nov 01 19:13:21.871937 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:13:21.871937 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:13:21.871937 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:13:21.871937 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:13:21.871937 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:13:21.871937 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:13:21.871937 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 01 19:13:21.871937 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 01 19:13:21.871937 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 01 19:13:21.871937 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 01 19:13:21.871937 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 01 19:13:21.871937 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 01 19:13:21.871937 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 01 19:13:21.871937 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 01 19:13:21.871937 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 01 19:13:21.871937 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 01 19:13:21.871937 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3463bb31-5f34-4b89-8b40-af83df5c7635 could not be found. Nov 01 19:13:21.871937 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:13:21.871937 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:13:21.871937 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:13:21.879202 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:13:21.879202 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:13:21.879202 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:13:21.879202 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 01 19:13:21.879202 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 01 19:13:21.879202 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3463bb31-5f34-4b89-8b40-af83df5c7635 could not be found. Nov 01 19:13:21.879202 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:13:21.883551 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-ce04ef22-6c8d-4579-a240-ff8603e24ab6 tempest-ServerPasswordTestJSON-1534707503 tempest-ServerPasswordTestJSON-1534707503-project] Returning 404 to user: Instance 3463bb31-5f34-4b89-8b40-af83df5c7635 could not be found. {{(pid=121402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 01 19:13:21.884760 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-ce04ef22-6c8d-4579-a240-ff8603e24ab6 tempest-ServerPasswordTestJSON-1534707503 tempest-ServerPasswordTestJSON-1534707503-project] 10.222.0.13 "GET /compute/v2.1/servers/3463bb31-5f34-4b89-8b40-af83df5c7635" status: 404 len: 111 microversion: 2.1 time: 0.072301 Nov 01 19:13:21.885872 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 2208/4430] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:13:21 2022] GET /compute/v2.1/servers/3463bb31-5f34-4b89-8b40-af83df5c7635 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 01 19:13:22.230792 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-2ec6268e-e544-4fc4-a2ca-7874b3d3a3e4 tempest-InstanceActionsTestJSON-621834551 tempest-InstanceActionsTestJSON-621834551-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:13:22.232262 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-2ec6268e-e544-4fc4-a2ca-7874b3d3a3e4 tempest-InstanceActionsTestJSON-621834551 tempest-InstanceActionsTestJSON-621834551-project] [instance: 922898a0-ba6d-48cc-9b0b-b3b781eddb9e] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:13:22.250987 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2ec6268e-e544-4fc4-a2ca-7874b3d3a3e4 tempest-InstanceActionsTestJSON-621834551 tempest-InstanceActionsTestJSON-621834551-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:13:22.255087 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2ec6268e-e544-4fc4-a2ca-7874b3d3a3e4 tempest-InstanceActionsTestJSON-621834551 tempest-InstanceActionsTestJSON-621834551-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:13:22.258043 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2ec6268e-e544-4fc4-a2ca-7874b3d3a3e4 tempest-InstanceActionsTestJSON-621834551 tempest-InstanceActionsTestJSON-621834551-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:13:22.262079 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2ec6268e-e544-4fc4-a2ca-7874b3d3a3e4 tempest-InstanceActionsTestJSON-621834551 tempest-InstanceActionsTestJSON-621834551-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:13:22.264887 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2ec6268e-e544-4fc4-a2ca-7874b3d3a3e4 tempest-InstanceActionsTestJSON-621834551 tempest-InstanceActionsTestJSON-621834551-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:13:22.267019 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2ec6268e-e544-4fc4-a2ca-7874b3d3a3e4 tempest-InstanceActionsTestJSON-621834551 tempest-InstanceActionsTestJSON-621834551-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:13:22.705860 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-2ec6268e-e544-4fc4-a2ca-7874b3d3a3e4 tempest-InstanceActionsTestJSON-621834551 tempest-InstanceActionsTestJSON-621834551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32430a3dff994c929c0e635b372c9f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553f439f412542e3a36c5db93d039593', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:13:22.721387 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-2ec6268e-e544-4fc4-a2ca-7874b3d3a3e4 tempest-InstanceActionsTestJSON-621834551 tempest-InstanceActionsTestJSON-621834551-project] 10.222.0.13 "GET /compute/v2.1/servers/922898a0-ba6d-48cc-9b0b-b3b781eddb9e" status: 200 len: 1317 microversion: 2.1 time: 0.496269 Nov 01 19:13:22.737868 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 2209/4431] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:13:22 2022] GET /compute/v2.1/servers/922898a0-ba6d-48cc-9b0b-b3b781eddb9e => generated 1317 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 19:13:22.760098 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [req-22ba11dc-6028-405a-a8b3-7bae4036d84f req-2878802e-2ab9-4897-81ff-7575343ac963 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "922898a0-ba6d-48cc-9b0b-b3b781eddb9e", "name": "network-vif-plugged", "status": "completed", "tag": "a57481b3-53f1-44fc-9ad5-428c8f7ff813"}]} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:13:22.798492 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-22ba11dc-6028-405a-a8b3-7bae4036d84f req-2878802e-2ab9-4897-81ff-7575343ac963 service nova] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:13:22.799003 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-22ba11dc-6028-405a-a8b3-7bae4036d84f req-2878802e-2ab9-4897-81ff-7575343ac963 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:13:22.799484 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-22ba11dc-6028-405a-a8b3-7bae4036d84f req-2878802e-2ab9-4897-81ff-7575343ac963 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:13:22.835525 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.compute.server_external_events [req-22ba11dc-6028-405a-a8b3-7bae4036d84f req-2878802e-2ab9-4897-81ff-7575343ac963 service nova] Creating event network-vif-plugged:a57481b3-53f1-44fc-9ad5-428c8f7ff813 for instance 922898a0-ba6d-48cc-9b0b-b3b781eddb9e on n-h1-863052-2 Nov 01 19:13:22.848823 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [req-22ba11dc-6028-405a-a8b3-7bae4036d84f req-2878802e-2ab9-4897-81ff-7575343ac963 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104218 Nov 01 19:13:22.848823 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 2210/4432] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Nov 1 19:13:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:13:22.851901 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-91952884-5ac2-47f9-8bab-8aff768c9a91 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:13:22.852848 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-91952884-5ac2-47f9-8bab-8aff768c9a91 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] [instance: b27eaab4-a751-47fb-acdb-db7c99b06a5f] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:13:22.860546 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-91952884-5ac2-47f9-8bab-8aff768c9a91 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:13:22.861762 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-91952884-5ac2-47f9-8bab-8aff768c9a91 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:13:22.862351 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-91952884-5ac2-47f9-8bab-8aff768c9a91 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:13:22.863214 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-91952884-5ac2-47f9-8bab-8aff768c9a91 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:13:22.864070 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-91952884-5ac2-47f9-8bab-8aff768c9a91 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:13:22.864936 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-91952884-5ac2-47f9-8bab-8aff768c9a91 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:13:23.266104 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-91952884-5ac2-47f9-8bab-8aff768c9a91 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc5c19b930543f5a5091922a9859813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ecdc83933544a899117531a960027a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:13:23.276225 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-91952884-5ac2-47f9-8bab-8aff768c9a91 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] 10.222.0.13 "GET /compute/v2.1/servers/b27eaab4-a751-47fb-acdb-db7c99b06a5f" status: 200 len: 1506 microversion: 2.1 time: 0.430858 Nov 01 19:13:23.279403 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 2211/4433] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:13:22 2022] GET /compute/v2.1/servers/b27eaab4-a751-47fb-acdb-db7c99b06a5f => generated 1506 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:13:23.310930 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-ccf26c2e-ed78-4b88-a91a-5519fd02a716 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:13:23.311912 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-ccf26c2e-ed78-4b88-a91a-5519fd02a716 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] [instance: b27eaab4-a751-47fb-acdb-db7c99b06a5f] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:13:23.323013 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-ccf26c2e-ed78-4b88-a91a-5519fd02a716 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:13:23.326435 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-ccf26c2e-ed78-4b88-a91a-5519fd02a716 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:13:23.330657 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-ccf26c2e-ed78-4b88-a91a-5519fd02a716 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:13:23.332621 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-ccf26c2e-ed78-4b88-a91a-5519fd02a716 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:13:23.336154 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-ccf26c2e-ed78-4b88-a91a-5519fd02a716 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:13:23.337528 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-ccf26c2e-ed78-4b88-a91a-5519fd02a716 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:13:24.085070 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-de39aa8d-78e4-46a3-be75-aa0c0a6fbace tempest-FloatingIPDetailsTestJSON-1286833380 tempest-FloatingIPDetailsTestJSON-1286833380-project] 10.222.0.13 "DELETE /compute/v2.1/os-floating-ips/1ebaba70-6235-464a-9482-39986d3b5a00" status: 202 len: 0 microversion: 2.1 time: 2.552734 Nov 01 19:13:24.085666 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 2223/4434] 10.222.0.13 () {58 vars in 1263 bytes} [Tue Nov 1 19:13:21 2022] DELETE /compute/v2.1/os-floating-ips/1ebaba70-6235-464a-9482-39986d3b5a00 => generated 0 bytes in 2555 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 01 19:13:24.095839 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-0388389c-7331-46b7-a530-1788ca09a47b tempest-InstanceActionsTestJSON-621834551 tempest-InstanceActionsTestJSON-621834551-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:13:24.097203 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-0388389c-7331-46b7-a530-1788ca09a47b tempest-InstanceActionsTestJSON-621834551 tempest-InstanceActionsTestJSON-621834551-project] [instance: 922898a0-ba6d-48cc-9b0b-b3b781eddb9e] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:13:24.133448 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-0388389c-7331-46b7-a530-1788ca09a47b tempest-InstanceActionsTestJSON-621834551 tempest-InstanceActionsTestJSON-621834551-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:13:24.134291 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-0388389c-7331-46b7-a530-1788ca09a47b tempest-InstanceActionsTestJSON-621834551 tempest-InstanceActionsTestJSON-621834551-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:13:24.137006 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-0388389c-7331-46b7-a530-1788ca09a47b tempest-InstanceActionsTestJSON-621834551 tempest-InstanceActionsTestJSON-621834551-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:13:24.137956 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-0388389c-7331-46b7-a530-1788ca09a47b tempest-InstanceActionsTestJSON-621834551 tempest-InstanceActionsTestJSON-621834551-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:13:24.141649 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-0388389c-7331-46b7-a530-1788ca09a47b tempest-InstanceActionsTestJSON-621834551 tempest-InstanceActionsTestJSON-621834551-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:13:24.143120 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-0388389c-7331-46b7-a530-1788ca09a47b tempest-InstanceActionsTestJSON-621834551 tempest-InstanceActionsTestJSON-621834551-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:13:24.477256 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-ccf26c2e-ed78-4b88-a91a-5519fd02a716 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc5c19b930543f5a5091922a9859813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ecdc83933544a899117531a960027a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:13:24.493905 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-ccf26c2e-ed78-4b88-a91a-5519fd02a716 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] 10.222.0.13 "GET /compute/v2.1/servers/b27eaab4-a751-47fb-acdb-db7c99b06a5f" status: 200 len: 1506 microversion: 2.1 time: 1.186641 Nov 01 19:13:24.529773 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 2212/4435] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:13:23 2022] GET /compute/v2.1/servers/b27eaab4-a751-47fb-acdb-db7c99b06a5f => generated 1506 bytes in 1225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:13:24.562094 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-569766f7-65a6-4898-87a9-acd6bed1c4c0 tempest-FloatingIPDetailsTestJSON-1286833380 tempest-FloatingIPDetailsTestJSON-1286833380-project] Calling method '.version_select at 0x7f0ae19bba60>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:13:24.861863 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-0388389c-7331-46b7-a530-1788ca09a47b tempest-InstanceActionsTestJSON-621834551 tempest-InstanceActionsTestJSON-621834551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32430a3dff994c929c0e635b372c9f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553f439f412542e3a36c5db93d039593', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:13:24.899135 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-0388389c-7331-46b7-a530-1788ca09a47b tempest-InstanceActionsTestJSON-621834551 tempest-InstanceActionsTestJSON-621834551-project] 10.222.0.13 "GET /compute/v2.1/servers/922898a0-ba6d-48cc-9b0b-b3b781eddb9e" status: 200 len: 1317 microversion: 2.1 time: 0.800454 Nov 01 19:13:24.903571 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 2224/4436] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:13:24 2022] GET /compute/v2.1/servers/922898a0-ba6d-48cc-9b0b-b3b781eddb9e => generated 1317 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:13:24.934097 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-cadef62f-caac-47dc-8eca-49cc17a11765 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:13:24.945809 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-cadef62f-caac-47dc-8eca-49cc17a11765 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] [instance: 31bf7572-3418-4fbd-9356-03a890258701] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:13:24.963149 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-cadef62f-caac-47dc-8eca-49cc17a11765 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:13:24.963901 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-cadef62f-caac-47dc-8eca-49cc17a11765 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:13:24.969961 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-cadef62f-caac-47dc-8eca-49cc17a11765 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:13:24.970996 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-cadef62f-caac-47dc-8eca-49cc17a11765 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:13:24.971479 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-cadef62f-caac-47dc-8eca-49cc17a11765 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:13:24.971912 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-cadef62f-caac-47dc-8eca-49cc17a11765 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:13:25.014539 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.wsgi [None req-cadef62f-caac-47dc-8eca-49cc17a11765 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] HTTP exception thrown: Instance 31bf7572-3418-4fbd-9356-03a890258701 could not be found. Nov 01 19:13:25.016268 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-cadef62f-caac-47dc-8eca-49cc17a11765 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Request method failure captured: Nov 01 19:13:25.016268 n-d-863052-2 devstack@n-api.service[121403]: request: POST /compute/v2.1/servers/31bf7572-3418-4fbd-9356-03a890258701/action HTTP/1.1 Nov 01 19:13:25.016268 n-d-863052-2 devstack@n-api.service[121403]: Accept: application/json Nov 01 19:13:25.016268 n-d-863052-2 devstack@n-api.service[121403]: Accept-Encoding: identity Nov 01 19:13:25.016268 n-d-863052-2 devstack@n-api.service[121403]: Connection: close Nov 01 19:13:25.016268 n-d-863052-2 devstack@n-api.service[121403]: Content-Length: 28 Nov 01 19:13:25.016268 n-d-863052-2 devstack@n-api.service[121403]: Content-Type: application/json Nov 01 19:13:25.016268 n-d-863052-2 devstack@n-api.service[121403]: Host: 10.222.0.13 Nov 01 19:13:25.016268 n-d-863052-2 devstack@n-api.service[121403]: Openstack-System-Scope: None Nov 01 19:13:25.016268 n-d-863052-2 devstack@n-api.service[121403]: User-Agent: python-urllib3/1.26.12 Nov 01 19:13:25.016268 n-d-863052-2 devstack@n-api.service[121403]: X-Auth-Token: gAAAAABjYW9YFTR7hO-vK03S-3HbvOtG2z3_fji2KJH39vNHENu4xIKneeHYviQiPj9ERGiA3aZIA7DvAYzczgSZ5-vK782IQ7CYnUFXvn9Aqt1AbunNMYxhes9BKzhvODzqwzqiQq89wgC4nbpZ9jJWFWMOC4z9bcW4UMi_ylwdZFjmhWfD49s Nov 01 19:13:25.016268 n-d-863052-2 devstack@n-api.service[121403]: X-Domain-Id: None Nov 01 19:13:25.016268 n-d-863052-2 devstack@n-api.service[121403]: X-Domain-Name: None Nov 01 19:13:25.016268 n-d-863052-2 devstack@n-api.service[121403]: X-Identity-Status: Confirmed Nov 01 19:13:25.016268 n-d-863052-2 devstack@n-api.service[121403]: X-Is-Admin-Project: True Nov 01 19:13:25.016268 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Domain-Id: default Nov 01 19:13:25.016268 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Domain-Name: Default Nov 01 19:13:25.016268 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Id: 9ecdc83933544a899117531a960027a7 Nov 01 19:13:25.016268 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Name: tempest-ServersNegativeTestJSON-638944671 Nov 01 19:13:25.016268 n-d-863052-2 devstack@n-api.service[121403]: X-Role: member,reader Nov 01 19:13:25.016268 n-d-863052-2 devstack@n-api.service[121403]: X-Roles: member,reader Nov 01 19:13:25.016268 n-d-863052-2 devstack@n-api.service[121403]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/9ecdc83933544a899117531a960027a7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/9ecdc83933544a899117531a960027a7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_9ecdc83933544a899117531a960027a7", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/9ecdc83933544a899117531a960027a7"}]}] Nov 01 19:13:25.016268 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant: tempest-ServersNegativeTestJSON-638944671 Nov 01 19:13:25.016268 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant-Id: 9ecdc83933544a899117531a960027a7 Nov 01 19:13:25.016268 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant-Name: tempest-ServersNegativeTestJSON-638944671 Nov 01 19:13:25.016268 n-d-863052-2 devstack@n-api.service[121403]: X-User: tempest-ServersNegativeTestJSON-638944671-project Nov 01 19:13:25.016268 n-d-863052-2 devstack@n-api.service[121403]: X-User-Domain-Id: default Nov 01 19:13:25.016268 n-d-863052-2 devstack@n-api.service[121403]: X-User-Domain-Name: Default Nov 01 19:13:25.016268 n-d-863052-2 devstack@n-api.service[121403]: X-User-Id: 3fc5c19b930543f5a5091922a9859813 Nov 01 19:13:25.016268 n-d-863052-2 devstack@n-api.service[121403]: X-User-Name: tempest-ServersNegativeTestJSON-638944671-project Nov 01 19:13:25.016268 n-d-863052-2 devstack@n-api.service[121403]: Nov 01 19:13:25.016268 n-d-863052-2 devstack@n-api.service[121403]: {"reboot": {"type": "SOFT"}} Nov 01 19:13:25.016268 n-d-863052-2 devstack@n-api.service[121403]: method: > Nov 01 19:13:25.016268 n-d-863052-2 devstack@n-api.service[121403]: exception: Instance 31bf7572-3418-4fbd-9356-03a890258701 could not be found. Nov 01 19:13:25.016268 n-d-863052-2 devstack@n-api.service[121403]: action_args: {'id': '31bf7572-3418-4fbd-9356-03a890258701', 'body': {'reboot': {'type': 'SOFT'}}} Nov 01 19:13:25.016268 n-d-863052-2 devstack@n-api.service[121403]: {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 01 19:13:25.016268 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:13:25.016268 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 01 19:13:25.016268 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 01 19:13:25.016268 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 01 19:13:25.016268 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 01 19:13:25.016268 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 01 19:13:25.016268 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 01 19:13:25.016268 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 01 19:13:25.016268 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 01 19:13:25.016268 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 31bf7572-3418-4fbd-9356-03a890258701 could not be found. Nov 01 19:13:25.016268 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:13:25.016268 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:13:25.016268 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:13:25.016268 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:13:25.016268 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:13:25.016268 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:13:25.016268 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 01 19:13:25.016268 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 01 19:13:25.016268 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 01 19:13:25.016268 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 01 19:13:25.016268 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 01 19:13:25.016268 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 01 19:13:25.016268 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1031, in _action_reboot Nov 01 19:13:25.016268 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Nov 01 19:13:25.016268 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 01 19:13:25.016268 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 01 19:13:25.016268 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 01 19:13:25.016268 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 01 19:13:25.021984 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 31bf7572-3418-4fbd-9356-03a890258701 could not be found. Nov 01 19:13:25.021984 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:13:25.021984 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:13:25.021984 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:13:25.021984 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:13:25.021984 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:13:25.021984 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:13:25.021984 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 01 19:13:25.021984 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 01 19:13:25.021984 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 31bf7572-3418-4fbd-9356-03a890258701 could not be found. Nov 01 19:13:25.021984 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:13:25.021984 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-cadef62f-caac-47dc-8eca-49cc17a11765 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Returning 404 to user: Instance 31bf7572-3418-4fbd-9356-03a890258701 could not be found. {{(pid=121403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 01 19:13:25.032340 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-cadef62f-caac-47dc-8eca-49cc17a11765 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] 10.222.0.13 "POST /compute/v2.1/servers/31bf7572-3418-4fbd-9356-03a890258701/action" status: 404 len: 111 microversion: 2.1 time: 0.112978 Nov 01 19:13:25.033602 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 2225/4437] 10.222.0.13 () {60 vars in 1278 bytes} [Tue Nov 1 19:13:24 2022] POST /compute/v2.1/servers/31bf7572-3418-4fbd-9356-03a890258701/action => generated 111 bytes in 129 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 01 19:13:25.041358 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-d4d78da8-6abe-49b6-90fd-af28a64e89c8 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:13:25.047867 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-d4d78da8-6abe-49b6-90fd-af28a64e89c8 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] [instance: b27eaab4-a751-47fb-acdb-db7c99b06a5f] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:13:25.067224 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d4d78da8-6abe-49b6-90fd-af28a64e89c8 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:13:25.069062 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d4d78da8-6abe-49b6-90fd-af28a64e89c8 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:13:25.071270 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d4d78da8-6abe-49b6-90fd-af28a64e89c8 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:13:25.072181 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d4d78da8-6abe-49b6-90fd-af28a64e89c8 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:13:25.072838 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d4d78da8-6abe-49b6-90fd-af28a64e89c8 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:13:25.075204 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d4d78da8-6abe-49b6-90fd-af28a64e89c8 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:13:25.485868 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-d4d78da8-6abe-49b6-90fd-af28a64e89c8 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc5c19b930543f5a5091922a9859813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ecdc83933544a899117531a960027a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:13:25.496550 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-d4d78da8-6abe-49b6-90fd-af28a64e89c8 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] 10.222.0.13 "GET /compute/v2.1/servers/b27eaab4-a751-47fb-acdb-db7c99b06a5f" status: 200 len: 1506 microversion: 2.1 time: 0.458939 Nov 01 19:13:25.510342 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 2226/4438] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:13:25 2022] GET /compute/v2.1/servers/b27eaab4-a751-47fb-acdb-db7c99b06a5f => generated 1506 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 19:13:25.535361 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-34fa72a7-4330-49d8-a1b2-ed7d356d163d tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:13:25.536282 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-34fa72a7-4330-49d8-a1b2-ed7d356d163d tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] [instance: b27eaab4-a751-47fb-acdb-db7c99b06a5f] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:13:25.578267 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-34fa72a7-4330-49d8-a1b2-ed7d356d163d tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:13:25.578781 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-34fa72a7-4330-49d8-a1b2-ed7d356d163d tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:13:25.579224 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-34fa72a7-4330-49d8-a1b2-ed7d356d163d tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:13:25.579942 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-34fa72a7-4330-49d8-a1b2-ed7d356d163d tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:13:25.580405 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-34fa72a7-4330-49d8-a1b2-ed7d356d163d tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:13:25.582566 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-34fa72a7-4330-49d8-a1b2-ed7d356d163d tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:13:26.116437 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-34fa72a7-4330-49d8-a1b2-ed7d356d163d tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc5c19b930543f5a5091922a9859813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ecdc83933544a899117531a960027a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:13:26.130700 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-34fa72a7-4330-49d8-a1b2-ed7d356d163d tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] 10.222.0.13 "GET /compute/v2.1/servers/b27eaab4-a751-47fb-acdb-db7c99b06a5f" status: 200 len: 1506 microversion: 2.1 time: 0.599507 Nov 01 19:13:26.158140 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 2227/4439] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:13:25 2022] GET /compute/v2.1/servers/b27eaab4-a751-47fb-acdb-db7c99b06a5f => generated 1506 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 19:13:26.187110 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-6d6cf6cd-cccb-4bd0-b147-486307bb9540 tempest-InstanceActionsTestJSON-621834551 tempest-InstanceActionsTestJSON-621834551-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:13:26.188006 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-6d6cf6cd-cccb-4bd0-b147-486307bb9540 tempest-InstanceActionsTestJSON-621834551 tempest-InstanceActionsTestJSON-621834551-project] [instance: 922898a0-ba6d-48cc-9b0b-b3b781eddb9e] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:13:26.221914 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-6d6cf6cd-cccb-4bd0-b147-486307bb9540 tempest-InstanceActionsTestJSON-621834551 tempest-InstanceActionsTestJSON-621834551-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:13:26.224023 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-6d6cf6cd-cccb-4bd0-b147-486307bb9540 tempest-InstanceActionsTestJSON-621834551 tempest-InstanceActionsTestJSON-621834551-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:13:26.230557 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-6d6cf6cd-cccb-4bd0-b147-486307bb9540 tempest-InstanceActionsTestJSON-621834551 tempest-InstanceActionsTestJSON-621834551-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:13:26.231548 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-6d6cf6cd-cccb-4bd0-b147-486307bb9540 tempest-InstanceActionsTestJSON-621834551 tempest-InstanceActionsTestJSON-621834551-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:13:26.232790 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-6d6cf6cd-cccb-4bd0-b147-486307bb9540 tempest-InstanceActionsTestJSON-621834551 tempest-InstanceActionsTestJSON-621834551-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:13:26.234109 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-6d6cf6cd-cccb-4bd0-b147-486307bb9540 tempest-InstanceActionsTestJSON-621834551 tempest-InstanceActionsTestJSON-621834551-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:13:26.244979 n-d-863052-2 devstack@n-api.service[121403]: DEBUG dbcounter [-] [121403] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=121403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 19:13:27.236410 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-6d6cf6cd-cccb-4bd0-b147-486307bb9540 tempest-InstanceActionsTestJSON-621834551 tempest-InstanceActionsTestJSON-621834551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32430a3dff994c929c0e635b372c9f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553f439f412542e3a36c5db93d039593', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:13:27.248630 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-6d6cf6cd-cccb-4bd0-b147-486307bb9540 tempest-InstanceActionsTestJSON-621834551 tempest-InstanceActionsTestJSON-621834551-project] 10.222.0.13 "GET /compute/v2.1/servers/922898a0-ba6d-48cc-9b0b-b3b781eddb9e" status: 200 len: 1505 microversion: 2.1 time: 1.088075 Nov 01 19:13:27.249873 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 2228/4440] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:13:26 2022] GET /compute/v2.1/servers/922898a0-ba6d-48cc-9b0b-b3b781eddb9e => generated 1505 bytes in 1091 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:13:27.283766 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-eb13a1fb-3d72-4777-bcec-f35fc05e9924 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:13:27.286748 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-eb13a1fb-3d72-4777-bcec-f35fc05e9924 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] [instance: 88378b8d-179b-4f6c-8bf5-c06a4fd4144b] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:13:27.305460 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.wsgi [None req-eb13a1fb-3d72-4777-bcec-f35fc05e9924 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] HTTP exception thrown: Instance 88378b8d-179b-4f6c-8bf5-c06a4fd4144b could not be found. Nov 01 19:13:27.312025 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-eb13a1fb-3d72-4777-bcec-f35fc05e9924 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Request method failure captured: Nov 01 19:13:27.312025 n-d-863052-2 devstack@n-api.service[121403]: request: POST /compute/v2.1/servers/88378b8d-179b-4f6c-8bf5-c06a4fd4144b/action HTTP/1.1 Nov 01 19:13:27.312025 n-d-863052-2 devstack@n-api.service[121403]: Accept: application/json Nov 01 19:13:27.312025 n-d-863052-2 devstack@n-api.service[121403]: Accept-Encoding: identity Nov 01 19:13:27.312025 n-d-863052-2 devstack@n-api.service[121403]: Connection: close Nov 01 19:13:27.312025 n-d-863052-2 devstack@n-api.service[121403]: Content-Length: 28 Nov 01 19:13:27.312025 n-d-863052-2 devstack@n-api.service[121403]: Content-Type: application/json Nov 01 19:13:27.312025 n-d-863052-2 devstack@n-api.service[121403]: Host: 10.222.0.13 Nov 01 19:13:27.312025 n-d-863052-2 devstack@n-api.service[121403]: Openstack-System-Scope: None Nov 01 19:13:27.312025 n-d-863052-2 devstack@n-api.service[121403]: User-Agent: python-urllib3/1.26.12 Nov 01 19:13:27.312025 n-d-863052-2 devstack@n-api.service[121403]: X-Auth-Token: gAAAAABjYW9YFTR7hO-vK03S-3HbvOtG2z3_fji2KJH39vNHENu4xIKneeHYviQiPj9ERGiA3aZIA7DvAYzczgSZ5-vK782IQ7CYnUFXvn9Aqt1AbunNMYxhes9BKzhvODzqwzqiQq89wgC4nbpZ9jJWFWMOC4z9bcW4UMi_ylwdZFjmhWfD49s Nov 01 19:13:27.312025 n-d-863052-2 devstack@n-api.service[121403]: X-Domain-Id: None Nov 01 19:13:27.312025 n-d-863052-2 devstack@n-api.service[121403]: X-Domain-Name: None Nov 01 19:13:27.312025 n-d-863052-2 devstack@n-api.service[121403]: X-Identity-Status: Confirmed Nov 01 19:13:27.312025 n-d-863052-2 devstack@n-api.service[121403]: X-Is-Admin-Project: True Nov 01 19:13:27.312025 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Domain-Id: default Nov 01 19:13:27.312025 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Domain-Name: Default Nov 01 19:13:27.312025 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Id: 9ecdc83933544a899117531a960027a7 Nov 01 19:13:27.312025 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Name: tempest-ServersNegativeTestJSON-638944671 Nov 01 19:13:27.312025 n-d-863052-2 devstack@n-api.service[121403]: X-Role: member,reader Nov 01 19:13:27.312025 n-d-863052-2 devstack@n-api.service[121403]: X-Roles: member,reader Nov 01 19:13:27.312025 n-d-863052-2 devstack@n-api.service[121403]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/9ecdc83933544a899117531a960027a7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/9ecdc83933544a899117531a960027a7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_9ecdc83933544a899117531a960027a7", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/9ecdc83933544a899117531a960027a7"}]}] Nov 01 19:13:27.312025 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant: tempest-ServersNegativeTestJSON-638944671 Nov 01 19:13:27.312025 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant-Id: 9ecdc83933544a899117531a960027a7 Nov 01 19:13:27.312025 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant-Name: tempest-ServersNegativeTestJSON-638944671 Nov 01 19:13:27.312025 n-d-863052-2 devstack@n-api.service[121403]: X-User: tempest-ServersNegativeTestJSON-638944671-project Nov 01 19:13:27.312025 n-d-863052-2 devstack@n-api.service[121403]: X-User-Domain-Id: default Nov 01 19:13:27.312025 n-d-863052-2 devstack@n-api.service[121403]: X-User-Domain-Name: Default Nov 01 19:13:27.312025 n-d-863052-2 devstack@n-api.service[121403]: X-User-Id: 3fc5c19b930543f5a5091922a9859813 Nov 01 19:13:27.312025 n-d-863052-2 devstack@n-api.service[121403]: X-User-Name: tempest-ServersNegativeTestJSON-638944671-project Nov 01 19:13:27.312025 n-d-863052-2 devstack@n-api.service[121403]: Nov 01 19:13:27.312025 n-d-863052-2 devstack@n-api.service[121403]: {"reboot": {"type": "SOFT"}} Nov 01 19:13:27.312025 n-d-863052-2 devstack@n-api.service[121403]: method: > Nov 01 19:13:27.312025 n-d-863052-2 devstack@n-api.service[121403]: exception: Instance 88378b8d-179b-4f6c-8bf5-c06a4fd4144b could not be found. Nov 01 19:13:27.312025 n-d-863052-2 devstack@n-api.service[121403]: action_args: {'id': '88378b8d-179b-4f6c-8bf5-c06a4fd4144b', 'body': {'reboot': {'type': 'SOFT'}}} Nov 01 19:13:27.312025 n-d-863052-2 devstack@n-api.service[121403]: {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 01 19:13:27.312025 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:13:27.312025 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 01 19:13:27.312025 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 01 19:13:27.312025 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 01 19:13:27.312025 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 01 19:13:27.312025 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Nov 01 19:13:27.312025 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Nov 01 19:13:27.312025 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 88378b8d-179b-4f6c-8bf5-c06a4fd4144b could not be found. Nov 01 19:13:27.312025 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:13:27.312025 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:13:27.312025 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:13:27.312025 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:13:27.312025 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:13:27.312025 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:13:27.312025 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 01 19:13:27.312025 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 01 19:13:27.312025 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 01 19:13:27.312025 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 01 19:13:27.312025 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 01 19:13:27.312025 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 01 19:13:27.312025 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1031, in _action_reboot Nov 01 19:13:27.312025 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Nov 01 19:13:27.312025 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 01 19:13:27.312025 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 01 19:13:27.312025 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 01 19:13:27.312025 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 01 19:13:27.312025 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 88378b8d-179b-4f6c-8bf5-c06a4fd4144b could not be found. Nov 01 19:13:27.312025 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:13:27.315649 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:13:27.315649 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:13:27.315649 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:13:27.315649 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:13:27.315649 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:13:27.315649 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 01 19:13:27.315649 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 01 19:13:27.315649 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 88378b8d-179b-4f6c-8bf5-c06a4fd4144b could not be found. Nov 01 19:13:27.315649 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:13:27.320306 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-eb13a1fb-3d72-4777-bcec-f35fc05e9924 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Returning 404 to user: Instance 88378b8d-179b-4f6c-8bf5-c06a4fd4144b could not be found. {{(pid=121403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 01 19:13:27.321327 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-eb13a1fb-3d72-4777-bcec-f35fc05e9924 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] 10.222.0.13 "POST /compute/v2.1/servers/88378b8d-179b-4f6c-8bf5-c06a4fd4144b/action" status: 404 len: 111 microversion: 2.1 time: 0.057383 Nov 01 19:13:27.323910 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 2229/4441] 10.222.0.13 () {60 vars in 1278 bytes} [Tue Nov 1 19:13:27 2022] POST /compute/v2.1/servers/88378b8d-179b-4f6c-8bf5-c06a4fd4144b/action => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 01 19:13:27.348639 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-3e797e83-bcfa-4361-ad38-7caf1108a005 tempest-InstanceActionsTestJSON-621834551 tempest-InstanceActionsTestJSON-621834551-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:13:27.349453 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-3e797e83-bcfa-4361-ad38-7caf1108a005 tempest-InstanceActionsTestJSON-621834551 tempest-InstanceActionsTestJSON-621834551-project] [instance: 922898a0-ba6d-48cc-9b0b-b3b781eddb9e] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:13:27.370309 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-3e797e83-bcfa-4361-ad38-7caf1108a005 tempest-InstanceActionsTestJSON-621834551 tempest-InstanceActionsTestJSON-621834551-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:13:27.379949 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-3e797e83-bcfa-4361-ad38-7caf1108a005 tempest-InstanceActionsTestJSON-621834551 tempest-InstanceActionsTestJSON-621834551-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:13:27.380627 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-3e797e83-bcfa-4361-ad38-7caf1108a005 tempest-InstanceActionsTestJSON-621834551 tempest-InstanceActionsTestJSON-621834551-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:13:27.381542 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-3e797e83-bcfa-4361-ad38-7caf1108a005 tempest-InstanceActionsTestJSON-621834551 tempest-InstanceActionsTestJSON-621834551-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:13:27.382142 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-3e797e83-bcfa-4361-ad38-7caf1108a005 tempest-InstanceActionsTestJSON-621834551 tempest-InstanceActionsTestJSON-621834551-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:13:27.382709 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-3e797e83-bcfa-4361-ad38-7caf1108a005 tempest-InstanceActionsTestJSON-621834551 tempest-InstanceActionsTestJSON-621834551-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:13:27.496190 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-3e797e83-bcfa-4361-ad38-7caf1108a005 tempest-InstanceActionsTestJSON-621834551 tempest-InstanceActionsTestJSON-621834551-project] Policy check for os_compute_api:os-instance-actions:events failed with credentials {'is_admin': False, 'user_id': '32430a3dff994c929c0e635b372c9f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553f439f412542e3a36c5db93d039593', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:13:27.506354 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-3e797e83-bcfa-4361-ad38-7caf1108a005 tempest-InstanceActionsTestJSON-621834551 tempest-InstanceActionsTestJSON-621834551-project] 10.222.0.13 "GET /compute/v2.1/servers/922898a0-ba6d-48cc-9b0b-b3b781eddb9e/os-instance-actions/req-7afa0479-f07c-4c06-bc71-32167a0f1ea0" status: 200 len: 313 microversion: 2.1 time: 0.174838 Nov 01 19:13:27.508914 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 2230/4442] 10.222.0.13 () {58 vars in 1419 bytes} [Tue Nov 1 19:13:27 2022] GET /compute/v2.1/servers/922898a0-ba6d-48cc-9b0b-b3b781eddb9e/os-instance-actions/req-7afa0479-f07c-4c06-bc71-32167a0f1ea0 => generated 313 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:13:27.531438 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-3f1913a1-bdd3-42b0-b4ae-87718320decf tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:13:27.532251 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-3f1913a1-bdd3-42b0-b4ae-87718320decf tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] [instance: b27eaab4-a751-47fb-acdb-db7c99b06a5f] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:13:27.555873 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-3f1913a1-bdd3-42b0-b4ae-87718320decf tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:13:27.560429 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-3f1913a1-bdd3-42b0-b4ae-87718320decf tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:13:27.561423 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-3f1913a1-bdd3-42b0-b4ae-87718320decf tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:13:27.562351 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-3f1913a1-bdd3-42b0-b4ae-87718320decf tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:13:27.574185 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-3f1913a1-bdd3-42b0-b4ae-87718320decf tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:13:27.574821 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-3f1913a1-bdd3-42b0-b4ae-87718320decf tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:13:28.036167 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-3f1913a1-bdd3-42b0-b4ae-87718320decf tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc5c19b930543f5a5091922a9859813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ecdc83933544a899117531a960027a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:13:28.045264 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-3f1913a1-bdd3-42b0-b4ae-87718320decf tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] 10.222.0.13 "GET /compute/v2.1/servers/b27eaab4-a751-47fb-acdb-db7c99b06a5f" status: 200 len: 1506 microversion: 2.1 time: 0.526323 Nov 01 19:13:28.048372 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-569766f7-65a6-4898-87a9-acd6bed1c4c0 tempest-FloatingIPDetailsTestJSON-1286833380 tempest-FloatingIPDetailsTestJSON-1286833380-project] 10.222.0.13 "DELETE /compute/v2.1/os-floating-ips/bbd26af6-6068-436a-8752-6f6838f55e11" status: 202 len: 0 microversion: 2.1 time: 3.513381 Nov 01 19:13:28.056716 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 2231/4443] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:13:27 2022] GET /compute/v2.1/servers/b27eaab4-a751-47fb-acdb-db7c99b06a5f => generated 1506 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:13:28.062574 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-8a6411bc-d60a-4e2a-b676-3a5642610bdc tempest-InstanceActionsTestJSON-621834551 tempest-InstanceActionsTestJSON-621834551-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:13:28.065647 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 2213/4444] 10.222.0.13 () {58 vars in 1263 bytes} [Tue Nov 1 19:13:24 2022] DELETE /compute/v2.1/os-floating-ips/bbd26af6-6068-436a-8752-6f6838f55e11 => generated 0 bytes in 3534 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 01 19:13:28.078932 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-b8353fe9-4993-4e30-8516-10ab1174089d tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:13:28.079891 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-b8353fe9-4993-4e30-8516-10ab1174089d tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] [instance: b27eaab4-a751-47fb-acdb-db7c99b06a5f] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:13:28.083062 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-8a6411bc-d60a-4e2a-b676-3a5642610bdc tempest-InstanceActionsTestJSON-621834551 tempest-InstanceActionsTestJSON-621834551-project] [instance: 922898a0-ba6d-48cc-9b0b-b3b781eddb9e] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:13:28.086685 n-d-863052-2 devstack@n-api.service[121403]: DEBUG dbcounter [-] [121403] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=121403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 19:13:28.090331 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-8a6411bc-d60a-4e2a-b676-3a5642610bdc tempest-InstanceActionsTestJSON-621834551 tempest-InstanceActionsTestJSON-621834551-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:13:28.090843 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-8a6411bc-d60a-4e2a-b676-3a5642610bdc tempest-InstanceActionsTestJSON-621834551 tempest-InstanceActionsTestJSON-621834551-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:13:28.092713 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b8353fe9-4993-4e30-8516-10ab1174089d tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:13:28.096007 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b8353fe9-4993-4e30-8516-10ab1174089d tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:13:28.096994 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b8353fe9-4993-4e30-8516-10ab1174089d tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:13:28.101138 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b8353fe9-4993-4e30-8516-10ab1174089d tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:13:28.101845 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-8a6411bc-d60a-4e2a-b676-3a5642610bdc tempest-InstanceActionsTestJSON-621834551 tempest-InstanceActionsTestJSON-621834551-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:13:28.103224 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b8353fe9-4993-4e30-8516-10ab1174089d tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:13:28.104103 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b8353fe9-4993-4e30-8516-10ab1174089d tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:13:28.106292 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-8a6411bc-d60a-4e2a-b676-3a5642610bdc tempest-InstanceActionsTestJSON-621834551 tempest-InstanceActionsTestJSON-621834551-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:13:28.107445 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-8a6411bc-d60a-4e2a-b676-3a5642610bdc tempest-InstanceActionsTestJSON-621834551 tempest-InstanceActionsTestJSON-621834551-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:13:28.107920 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-8a6411bc-d60a-4e2a-b676-3a5642610bdc tempest-InstanceActionsTestJSON-621834551 tempest-InstanceActionsTestJSON-621834551-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:13:28.334863 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-8a6411bc-d60a-4e2a-b676-3a5642610bdc tempest-InstanceActionsTestJSON-621834551 tempest-InstanceActionsTestJSON-621834551-project] 10.222.0.13 "POST /compute/v2.1/servers/922898a0-ba6d-48cc-9b0b-b3b781eddb9e/action" status: 202 len: 0 microversion: 2.1 time: 0.276551 Nov 01 19:13:28.336632 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 2232/4445] 10.222.0.13 () {60 vars in 1278 bytes} [Tue Nov 1 19:13:28 2022] POST /compute/v2.1/servers/922898a0-ba6d-48cc-9b0b-b3b781eddb9e/action => generated 0 bytes in 279 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 01 19:13:28.381006 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-bb561b2f-5231-429c-b5f1-87c025c3aaeb tempest-InstanceActionsTestJSON-621834551 tempest-InstanceActionsTestJSON-621834551-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:13:28.385704 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-bb561b2f-5231-429c-b5f1-87c025c3aaeb tempest-InstanceActionsTestJSON-621834551 tempest-InstanceActionsTestJSON-621834551-project] [instance: 922898a0-ba6d-48cc-9b0b-b3b781eddb9e] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:13:28.411686 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-bb561b2f-5231-429c-b5f1-87c025c3aaeb tempest-InstanceActionsTestJSON-621834551 tempest-InstanceActionsTestJSON-621834551-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:13:28.418898 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-bb561b2f-5231-429c-b5f1-87c025c3aaeb tempest-InstanceActionsTestJSON-621834551 tempest-InstanceActionsTestJSON-621834551-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:13:28.421515 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-bb561b2f-5231-429c-b5f1-87c025c3aaeb tempest-InstanceActionsTestJSON-621834551 tempest-InstanceActionsTestJSON-621834551-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:13:28.422487 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-bb561b2f-5231-429c-b5f1-87c025c3aaeb tempest-InstanceActionsTestJSON-621834551 tempest-InstanceActionsTestJSON-621834551-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:13:28.423181 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-bb561b2f-5231-429c-b5f1-87c025c3aaeb tempest-InstanceActionsTestJSON-621834551 tempest-InstanceActionsTestJSON-621834551-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:13:28.424659 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-bb561b2f-5231-429c-b5f1-87c025c3aaeb tempest-InstanceActionsTestJSON-621834551 tempest-InstanceActionsTestJSON-621834551-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:13:29.257396 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-bb561b2f-5231-429c-b5f1-87c025c3aaeb tempest-InstanceActionsTestJSON-621834551 tempest-InstanceActionsTestJSON-621834551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32430a3dff994c929c0e635b372c9f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553f439f412542e3a36c5db93d039593', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:13:29.273979 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-bb561b2f-5231-429c-b5f1-87c025c3aaeb tempest-InstanceActionsTestJSON-621834551 tempest-InstanceActionsTestJSON-621834551-project] 10.222.0.13 "GET /compute/v2.1/servers/922898a0-ba6d-48cc-9b0b-b3b781eddb9e" status: 200 len: 1507 microversion: 2.1 time: 0.919705 Nov 01 19:13:29.275828 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 2233/4446] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:13:28 2022] GET /compute/v2.1/servers/922898a0-ba6d-48cc-9b0b-b3b781eddb9e => generated 1507 bytes in 924 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:13:29.830509 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-b8353fe9-4993-4e30-8516-10ab1174089d tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc5c19b930543f5a5091922a9859813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ecdc83933544a899117531a960027a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:13:29.840240 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-b8353fe9-4993-4e30-8516-10ab1174089d tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] 10.222.0.13 "GET /compute/v2.1/servers/b27eaab4-a751-47fb-acdb-db7c99b06a5f" status: 200 len: 1506 microversion: 2.1 time: 1.765163 Nov 01 19:13:29.841824 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 2214/4447] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:13:28 2022] GET /compute/v2.1/servers/b27eaab4-a751-47fb-acdb-db7c99b06a5f => generated 1506 bytes in 1767 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:13:29.865073 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-1eebe784-ee27-4353-994f-b938d5606d92 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "2d4a0047-1b9e-445f-8af8-1b5c9d93e881"}} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:13:29.867934 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-1eebe784-ee27-4353-994f-b938d5606d92 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] [instance: 31bf7572-3418-4fbd-9356-03a890258701] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:13:29.885232 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-1eebe784-ee27-4353-994f-b938d5606d92 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:13:29.886487 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-1eebe784-ee27-4353-994f-b938d5606d92 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:13:29.887006 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-1eebe784-ee27-4353-994f-b938d5606d92 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:13:29.888082 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-1eebe784-ee27-4353-994f-b938d5606d92 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:13:29.889976 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-1eebe784-ee27-4353-994f-b938d5606d92 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:13:29.890546 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-1eebe784-ee27-4353-994f-b938d5606d92 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:13:29.928243 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.wsgi [None req-1eebe784-ee27-4353-994f-b938d5606d92 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] HTTP exception thrown: Instance 31bf7572-3418-4fbd-9356-03a890258701 could not be found. Nov 01 19:13:29.933681 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-1eebe784-ee27-4353-994f-b938d5606d92 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Request method failure captured: Nov 01 19:13:29.933681 n-d-863052-2 devstack@n-api.service[121403]: request: POST /compute/v2.1/servers/31bf7572-3418-4fbd-9356-03a890258701/action HTTP/1.1 Nov 01 19:13:29.933681 n-d-863052-2 devstack@n-api.service[121403]: Accept: application/json Nov 01 19:13:29.933681 n-d-863052-2 devstack@n-api.service[121403]: Accept-Encoding: identity Nov 01 19:13:29.933681 n-d-863052-2 devstack@n-api.service[121403]: Connection: close Nov 01 19:13:29.933681 n-d-863052-2 devstack@n-api.service[121403]: Content-Length: 65 Nov 01 19:13:29.933681 n-d-863052-2 devstack@n-api.service[121403]: Content-Type: application/json Nov 01 19:13:29.933681 n-d-863052-2 devstack@n-api.service[121403]: Host: 10.222.0.13 Nov 01 19:13:29.933681 n-d-863052-2 devstack@n-api.service[121403]: Openstack-System-Scope: None Nov 01 19:13:29.933681 n-d-863052-2 devstack@n-api.service[121403]: User-Agent: python-urllib3/1.26.12 Nov 01 19:13:29.933681 n-d-863052-2 devstack@n-api.service[121403]: X-Auth-Token: gAAAAABjYW9YFTR7hO-vK03S-3HbvOtG2z3_fji2KJH39vNHENu4xIKneeHYviQiPj9ERGiA3aZIA7DvAYzczgSZ5-vK782IQ7CYnUFXvn9Aqt1AbunNMYxhes9BKzhvODzqwzqiQq89wgC4nbpZ9jJWFWMOC4z9bcW4UMi_ylwdZFjmhWfD49s Nov 01 19:13:29.933681 n-d-863052-2 devstack@n-api.service[121403]: X-Domain-Id: None Nov 01 19:13:29.933681 n-d-863052-2 devstack@n-api.service[121403]: X-Domain-Name: None Nov 01 19:13:29.933681 n-d-863052-2 devstack@n-api.service[121403]: X-Identity-Status: Confirmed Nov 01 19:13:29.933681 n-d-863052-2 devstack@n-api.service[121403]: X-Is-Admin-Project: True Nov 01 19:13:29.933681 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Domain-Id: default Nov 01 19:13:29.933681 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Domain-Name: Default Nov 01 19:13:29.933681 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Id: 9ecdc83933544a899117531a960027a7 Nov 01 19:13:29.933681 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Name: tempest-ServersNegativeTestJSON-638944671 Nov 01 19:13:29.933681 n-d-863052-2 devstack@n-api.service[121403]: X-Role: member,reader Nov 01 19:13:29.933681 n-d-863052-2 devstack@n-api.service[121403]: X-Roles: member,reader Nov 01 19:13:29.933681 n-d-863052-2 devstack@n-api.service[121403]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/9ecdc83933544a899117531a960027a7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/9ecdc83933544a899117531a960027a7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_9ecdc83933544a899117531a960027a7", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/9ecdc83933544a899117531a960027a7"}]}] Nov 01 19:13:29.933681 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant: tempest-ServersNegativeTestJSON-638944671 Nov 01 19:13:29.933681 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant-Id: 9ecdc83933544a899117531a960027a7 Nov 01 19:13:29.933681 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant-Name: tempest-ServersNegativeTestJSON-638944671 Nov 01 19:13:29.933681 n-d-863052-2 devstack@n-api.service[121403]: X-User: tempest-ServersNegativeTestJSON-638944671-project Nov 01 19:13:29.933681 n-d-863052-2 devstack@n-api.service[121403]: X-User-Domain-Id: default Nov 01 19:13:29.933681 n-d-863052-2 devstack@n-api.service[121403]: X-User-Domain-Name: Default Nov 01 19:13:29.933681 n-d-863052-2 devstack@n-api.service[121403]: X-User-Id: 3fc5c19b930543f5a5091922a9859813 Nov 01 19:13:29.933681 n-d-863052-2 devstack@n-api.service[121403]: X-User-Name: tempest-ServersNegativeTestJSON-638944671-project Nov 01 19:13:29.933681 n-d-863052-2 devstack@n-api.service[121403]: Nov 01 19:13:29.933681 n-d-863052-2 devstack@n-api.service[121403]: {"rebuild": {"imageRef": "2d4a0047-1b9e-445f-8af8-1b5c9d93e881"}} Nov 01 19:13:29.933681 n-d-863052-2 devstack@n-api.service[121403]: method: > Nov 01 19:13:29.933681 n-d-863052-2 devstack@n-api.service[121403]: exception: Instance 31bf7572-3418-4fbd-9356-03a890258701 could not be found. Nov 01 19:13:29.933681 n-d-863052-2 devstack@n-api.service[121403]: action_args: {'id': '31bf7572-3418-4fbd-9356-03a890258701', 'body': {'rebuild': {'imageRef': '2d4a0047-1b9e-445f-8af8-1b5c9d93e881'}}} Nov 01 19:13:29.933681 n-d-863052-2 devstack@n-api.service[121403]: {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 01 19:13:29.933681 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:13:29.933681 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 01 19:13:29.933681 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 01 19:13:29.933681 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 01 19:13:29.933681 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 01 19:13:29.933681 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 01 19:13:29.933681 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 01 19:13:29.933681 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 01 19:13:29.933681 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 01 19:13:29.933681 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 31bf7572-3418-4fbd-9356-03a890258701 could not be found. Nov 01 19:13:29.933681 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:13:29.933681 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:13:29.933681 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:13:29.933681 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:13:29.933681 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:13:29.933681 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:13:29.933681 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 01 19:13:29.933681 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 01 19:13:29.933681 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 01 19:13:29.933681 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 01 19:13:29.933681 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 01 19:13:29.933681 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 01 19:13:29.933681 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 01 19:13:29.933681 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 01 19:13:29.933681 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 01 19:13:29.933681 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 01 19:13:29.933681 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Nov 01 19:13:29.933681 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1160, in _action_rebuild Nov 01 19:13:29.938637 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Nov 01 19:13:29.938637 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 01 19:13:29.938637 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 01 19:13:29.938637 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 01 19:13:29.938637 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 01 19:13:29.938637 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 31bf7572-3418-4fbd-9356-03a890258701 could not be found. Nov 01 19:13:29.938637 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:13:29.938637 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:13:29.938637 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:13:29.938637 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:13:29.938637 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:13:29.938637 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:13:29.938637 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 01 19:13:29.938637 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 01 19:13:29.938637 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 31bf7572-3418-4fbd-9356-03a890258701 could not be found. Nov 01 19:13:29.938637 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:13:29.938637 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-1eebe784-ee27-4353-994f-b938d5606d92 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Returning 404 to user: Instance 31bf7572-3418-4fbd-9356-03a890258701 could not be found. {{(pid=121403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 01 19:13:29.939789 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-1eebe784-ee27-4353-994f-b938d5606d92 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] 10.222.0.13 "POST /compute/v2.1/servers/31bf7572-3418-4fbd-9356-03a890258701/action" status: 404 len: 111 microversion: 2.1 time: 0.076871 Nov 01 19:13:29.941059 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 2234/4448] 10.222.0.13 () {60 vars in 1278 bytes} [Tue Nov 1 19:13:29 2022] POST /compute/v2.1/servers/31bf7572-3418-4fbd-9356-03a890258701/action => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 01 19:13:29.949340 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-0f07e9ae-7b80-449e-a092-85f8bba29e65 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:13:29.950112 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-0f07e9ae-7b80-449e-a092-85f8bba29e65 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] [instance: b27eaab4-a751-47fb-acdb-db7c99b06a5f] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:13:29.959310 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-0f07e9ae-7b80-449e-a092-85f8bba29e65 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:13:29.966957 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-0f07e9ae-7b80-449e-a092-85f8bba29e65 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:13:29.967575 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-0f07e9ae-7b80-449e-a092-85f8bba29e65 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:13:29.970226 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-0f07e9ae-7b80-449e-a092-85f8bba29e65 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:13:29.971748 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-0f07e9ae-7b80-449e-a092-85f8bba29e65 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:13:29.972296 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-0f07e9ae-7b80-449e-a092-85f8bba29e65 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:13:30.298103 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-c3ae3779-231e-4689-8710-703bf4eec08b tempest-InstanceActionsTestJSON-621834551 tempest-InstanceActionsTestJSON-621834551-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:13:30.298717 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-c3ae3779-231e-4689-8710-703bf4eec08b tempest-InstanceActionsTestJSON-621834551 tempest-InstanceActionsTestJSON-621834551-project] [instance: 922898a0-ba6d-48cc-9b0b-b3b781eddb9e] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:13:30.312362 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-c3ae3779-231e-4689-8710-703bf4eec08b tempest-InstanceActionsTestJSON-621834551 tempest-InstanceActionsTestJSON-621834551-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:13:30.312879 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-c3ae3779-231e-4689-8710-703bf4eec08b tempest-InstanceActionsTestJSON-621834551 tempest-InstanceActionsTestJSON-621834551-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:13:30.313913 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-c3ae3779-231e-4689-8710-703bf4eec08b tempest-InstanceActionsTestJSON-621834551 tempest-InstanceActionsTestJSON-621834551-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:13:30.314633 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-c3ae3779-231e-4689-8710-703bf4eec08b tempest-InstanceActionsTestJSON-621834551 tempest-InstanceActionsTestJSON-621834551-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:13:30.315089 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-c3ae3779-231e-4689-8710-703bf4eec08b tempest-InstanceActionsTestJSON-621834551 tempest-InstanceActionsTestJSON-621834551-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:13:30.315514 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-c3ae3779-231e-4689-8710-703bf4eec08b tempest-InstanceActionsTestJSON-621834551 tempest-InstanceActionsTestJSON-621834551-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:13:30.725038 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-0f07e9ae-7b80-449e-a092-85f8bba29e65 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc5c19b930543f5a5091922a9859813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ecdc83933544a899117531a960027a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:13:30.734605 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-0f07e9ae-7b80-449e-a092-85f8bba29e65 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] 10.222.0.13 "GET /compute/v2.1/servers/b27eaab4-a751-47fb-acdb-db7c99b06a5f" status: 200 len: 1506 microversion: 2.1 time: 0.790030 Nov 01 19:13:30.744699 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 2215/4449] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:13:29 2022] GET /compute/v2.1/servers/b27eaab4-a751-47fb-acdb-db7c99b06a5f => generated 1506 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:13:30.765600 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-c4ddad92-d5a0-4c53-a5ff-d67c9e28a9b3 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:13:30.766218 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-c4ddad92-d5a0-4c53-a5ff-d67c9e28a9b3 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] [instance: b27eaab4-a751-47fb-acdb-db7c99b06a5f] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:13:30.785279 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-c4ddad92-d5a0-4c53-a5ff-d67c9e28a9b3 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:13:30.788207 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-c4ddad92-d5a0-4c53-a5ff-d67c9e28a9b3 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:13:30.788919 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-c4ddad92-d5a0-4c53-a5ff-d67c9e28a9b3 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:13:30.789923 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-c4ddad92-d5a0-4c53-a5ff-d67c9e28a9b3 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:13:30.791815 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-c4ddad92-d5a0-4c53-a5ff-d67c9e28a9b3 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:13:30.792755 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-c4ddad92-d5a0-4c53-a5ff-d67c9e28a9b3 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:13:30.963007 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-c3ae3779-231e-4689-8710-703bf4eec08b tempest-InstanceActionsTestJSON-621834551 tempest-InstanceActionsTestJSON-621834551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32430a3dff994c929c0e635b372c9f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553f439f412542e3a36c5db93d039593', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:13:30.973127 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-c3ae3779-231e-4689-8710-703bf4eec08b tempest-InstanceActionsTestJSON-621834551 tempest-InstanceActionsTestJSON-621834551-project] 10.222.0.13 "GET /compute/v2.1/servers/922898a0-ba6d-48cc-9b0b-b3b781eddb9e" status: 200 len: 1507 microversion: 2.1 time: 0.678777 Nov 01 19:13:30.984950 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 2235/4450] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:13:30 2022] GET /compute/v2.1/servers/922898a0-ba6d-48cc-9b0b-b3b781eddb9e => generated 1507 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 19:13:31.573774 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-c4ddad92-d5a0-4c53-a5ff-d67c9e28a9b3 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc5c19b930543f5a5091922a9859813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ecdc83933544a899117531a960027a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:13:31.591203 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-c4ddad92-d5a0-4c53-a5ff-d67c9e28a9b3 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] 10.222.0.13 "GET /compute/v2.1/servers/b27eaab4-a751-47fb-acdb-db7c99b06a5f" status: 200 len: 1506 microversion: 2.1 time: 0.830089 Nov 01 19:13:31.593277 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 2216/4451] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:13:30 2022] GET /compute/v2.1/servers/b27eaab4-a751-47fb-acdb-db7c99b06a5f => generated 1506 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:13:31.621626 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-b452dcc2-0342-4b72-9002-cf50613195ba tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "2d4a0047-1b9e-445f-8af8-1b5c9d93e881"}} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:13:31.624147 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-b452dcc2-0342-4b72-9002-cf50613195ba tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] [instance: 73e2dc31-e07f-4b69-8885-4ab8e3de45e2] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:13:31.640129 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.wsgi [None req-b452dcc2-0342-4b72-9002-cf50613195ba tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] HTTP exception thrown: Instance 73e2dc31-e07f-4b69-8885-4ab8e3de45e2 could not be found. Nov 01 19:13:31.641813 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-b452dcc2-0342-4b72-9002-cf50613195ba tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Request method failure captured: Nov 01 19:13:31.641813 n-d-863052-2 devstack@n-api.service[121403]: request: POST /compute/v2.1/servers/73e2dc31-e07f-4b69-8885-4ab8e3de45e2/action HTTP/1.1 Nov 01 19:13:31.641813 n-d-863052-2 devstack@n-api.service[121403]: Accept: application/json Nov 01 19:13:31.641813 n-d-863052-2 devstack@n-api.service[121403]: Accept-Encoding: identity Nov 01 19:13:31.641813 n-d-863052-2 devstack@n-api.service[121403]: Connection: close Nov 01 19:13:31.641813 n-d-863052-2 devstack@n-api.service[121403]: Content-Length: 65 Nov 01 19:13:31.641813 n-d-863052-2 devstack@n-api.service[121403]: Content-Type: application/json Nov 01 19:13:31.641813 n-d-863052-2 devstack@n-api.service[121403]: Host: 10.222.0.13 Nov 01 19:13:31.641813 n-d-863052-2 devstack@n-api.service[121403]: Openstack-System-Scope: None Nov 01 19:13:31.641813 n-d-863052-2 devstack@n-api.service[121403]: User-Agent: python-urllib3/1.26.12 Nov 01 19:13:31.641813 n-d-863052-2 devstack@n-api.service[121403]: X-Auth-Token: gAAAAABjYW9YFTR7hO-vK03S-3HbvOtG2z3_fji2KJH39vNHENu4xIKneeHYviQiPj9ERGiA3aZIA7DvAYzczgSZ5-vK782IQ7CYnUFXvn9Aqt1AbunNMYxhes9BKzhvODzqwzqiQq89wgC4nbpZ9jJWFWMOC4z9bcW4UMi_ylwdZFjmhWfD49s Nov 01 19:13:31.641813 n-d-863052-2 devstack@n-api.service[121403]: X-Domain-Id: None Nov 01 19:13:31.641813 n-d-863052-2 devstack@n-api.service[121403]: X-Domain-Name: None Nov 01 19:13:31.641813 n-d-863052-2 devstack@n-api.service[121403]: X-Identity-Status: Confirmed Nov 01 19:13:31.641813 n-d-863052-2 devstack@n-api.service[121403]: X-Is-Admin-Project: True Nov 01 19:13:31.641813 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Domain-Id: default Nov 01 19:13:31.641813 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Domain-Name: Default Nov 01 19:13:31.641813 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Id: 9ecdc83933544a899117531a960027a7 Nov 01 19:13:31.641813 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Name: tempest-ServersNegativeTestJSON-638944671 Nov 01 19:13:31.641813 n-d-863052-2 devstack@n-api.service[121403]: X-Role: member,reader Nov 01 19:13:31.641813 n-d-863052-2 devstack@n-api.service[121403]: X-Roles: member,reader Nov 01 19:13:31.641813 n-d-863052-2 devstack@n-api.service[121403]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/9ecdc83933544a899117531a960027a7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/9ecdc83933544a899117531a960027a7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_9ecdc83933544a899117531a960027a7", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/9ecdc83933544a899117531a960027a7"}]}] Nov 01 19:13:31.641813 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant: tempest-ServersNegativeTestJSON-638944671 Nov 01 19:13:31.641813 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant-Id: 9ecdc83933544a899117531a960027a7 Nov 01 19:13:31.641813 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant-Name: tempest-ServersNegativeTestJSON-638944671 Nov 01 19:13:31.641813 n-d-863052-2 devstack@n-api.service[121403]: X-User: tempest-ServersNegativeTestJSON-638944671-project Nov 01 19:13:31.641813 n-d-863052-2 devstack@n-api.service[121403]: X-User-Domain-Id: default Nov 01 19:13:31.641813 n-d-863052-2 devstack@n-api.service[121403]: X-User-Domain-Name: Default Nov 01 19:13:31.641813 n-d-863052-2 devstack@n-api.service[121403]: X-User-Id: 3fc5c19b930543f5a5091922a9859813 Nov 01 19:13:31.641813 n-d-863052-2 devstack@n-api.service[121403]: X-User-Name: tempest-ServersNegativeTestJSON-638944671-project Nov 01 19:13:31.641813 n-d-863052-2 devstack@n-api.service[121403]: Nov 01 19:13:31.641813 n-d-863052-2 devstack@n-api.service[121403]: {"rebuild": {"imageRef": "2d4a0047-1b9e-445f-8af8-1b5c9d93e881"}} Nov 01 19:13:31.641813 n-d-863052-2 devstack@n-api.service[121403]: method: > Nov 01 19:13:31.641813 n-d-863052-2 devstack@n-api.service[121403]: exception: Instance 73e2dc31-e07f-4b69-8885-4ab8e3de45e2 could not be found. Nov 01 19:13:31.641813 n-d-863052-2 devstack@n-api.service[121403]: action_args: {'id': '73e2dc31-e07f-4b69-8885-4ab8e3de45e2', 'body': {'rebuild': {'imageRef': '2d4a0047-1b9e-445f-8af8-1b5c9d93e881'}}} Nov 01 19:13:31.641813 n-d-863052-2 devstack@n-api.service[121403]: {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 01 19:13:31.641813 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:13:31.641813 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 01 19:13:31.641813 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 01 19:13:31.641813 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 01 19:13:31.641813 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 01 19:13:31.641813 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Nov 01 19:13:31.641813 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Nov 01 19:13:31.641813 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 73e2dc31-e07f-4b69-8885-4ab8e3de45e2 could not be found. Nov 01 19:13:31.641813 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:13:31.641813 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:13:31.641813 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:13:31.641813 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:13:31.641813 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:13:31.641813 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:13:31.641813 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 01 19:13:31.641813 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 01 19:13:31.641813 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 01 19:13:31.641813 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 01 19:13:31.641813 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 01 19:13:31.641813 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 01 19:13:31.641813 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 01 19:13:31.641813 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 01 19:13:31.641813 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 01 19:13:31.641813 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 01 19:13:31.641813 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Nov 01 19:13:31.641813 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1160, in _action_rebuild Nov 01 19:13:31.641813 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Nov 01 19:13:31.641813 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 01 19:13:31.646308 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 01 19:13:31.646308 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 01 19:13:31.646308 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 01 19:13:31.646308 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 73e2dc31-e07f-4b69-8885-4ab8e3de45e2 could not be found. Nov 01 19:13:31.646308 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:13:31.646308 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:13:31.646308 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:13:31.646308 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:13:31.646308 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:13:31.646308 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:13:31.646308 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 01 19:13:31.646308 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 01 19:13:31.646308 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 73e2dc31-e07f-4b69-8885-4ab8e3de45e2 could not be found. Nov 01 19:13:31.646308 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:13:31.646308 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-b452dcc2-0342-4b72-9002-cf50613195ba tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Returning 404 to user: Instance 73e2dc31-e07f-4b69-8885-4ab8e3de45e2 could not be found. {{(pid=121403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 01 19:13:31.646308 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-b452dcc2-0342-4b72-9002-cf50613195ba tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] 10.222.0.13 "POST /compute/v2.1/servers/73e2dc31-e07f-4b69-8885-4ab8e3de45e2/action" status: 404 len: 111 microversion: 2.1 time: 0.026422 Nov 01 19:13:31.646308 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 2236/4452] 10.222.0.13 () {60 vars in 1278 bytes} [Tue Nov 1 19:13:31 2022] POST /compute/v2.1/servers/73e2dc31-e07f-4b69-8885-4ab8e3de45e2/action => generated 111 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 01 19:13:31.652851 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-8b40f4c3-11b9-4365-8759-f0f798bb4861 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:13:31.653776 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-8b40f4c3-11b9-4365-8759-f0f798bb4861 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] [instance: b27eaab4-a751-47fb-acdb-db7c99b06a5f] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:13:31.664364 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-8b40f4c3-11b9-4365-8759-f0f798bb4861 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:13:31.665264 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-8b40f4c3-11b9-4365-8759-f0f798bb4861 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:13:31.667343 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-8b40f4c3-11b9-4365-8759-f0f798bb4861 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:13:31.670821 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-8b40f4c3-11b9-4365-8759-f0f798bb4861 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:13:31.671825 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-8b40f4c3-11b9-4365-8759-f0f798bb4861 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:13:31.675300 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-8b40f4c3-11b9-4365-8759-f0f798bb4861 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:13:32.002858 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-be86c7ab-5d3b-47e7-b80e-dfd4327f8048 tempest-InstanceActionsTestJSON-621834551 tempest-InstanceActionsTestJSON-621834551-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:13:32.003472 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-be86c7ab-5d3b-47e7-b80e-dfd4327f8048 tempest-InstanceActionsTestJSON-621834551 tempest-InstanceActionsTestJSON-621834551-project] [instance: 922898a0-ba6d-48cc-9b0b-b3b781eddb9e] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:13:32.019216 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-be86c7ab-5d3b-47e7-b80e-dfd4327f8048 tempest-InstanceActionsTestJSON-621834551 tempest-InstanceActionsTestJSON-621834551-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:13:32.019793 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-be86c7ab-5d3b-47e7-b80e-dfd4327f8048 tempest-InstanceActionsTestJSON-621834551 tempest-InstanceActionsTestJSON-621834551-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:13:32.020247 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-be86c7ab-5d3b-47e7-b80e-dfd4327f8048 tempest-InstanceActionsTestJSON-621834551 tempest-InstanceActionsTestJSON-621834551-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:13:32.021016 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-be86c7ab-5d3b-47e7-b80e-dfd4327f8048 tempest-InstanceActionsTestJSON-621834551 tempest-InstanceActionsTestJSON-621834551-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:13:32.021477 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-be86c7ab-5d3b-47e7-b80e-dfd4327f8048 tempest-InstanceActionsTestJSON-621834551 tempest-InstanceActionsTestJSON-621834551-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:13:32.021977 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-be86c7ab-5d3b-47e7-b80e-dfd4327f8048 tempest-InstanceActionsTestJSON-621834551 tempest-InstanceActionsTestJSON-621834551-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:13:32.315622 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-8b40f4c3-11b9-4365-8759-f0f798bb4861 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc5c19b930543f5a5091922a9859813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ecdc83933544a899117531a960027a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:13:32.324800 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-8b40f4c3-11b9-4365-8759-f0f798bb4861 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] 10.222.0.13 "GET /compute/v2.1/servers/b27eaab4-a751-47fb-acdb-db7c99b06a5f" status: 200 len: 1506 microversion: 2.1 time: 0.675995 Nov 01 19:13:32.343855 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 2217/4453] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:13:31 2022] GET /compute/v2.1/servers/b27eaab4-a751-47fb-acdb-db7c99b06a5f => generated 1506 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:13:32.379549 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-4e445694-9a49-43c7-bb3e-c4976287f2a2 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:13:32.385308 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-4e445694-9a49-43c7-bb3e-c4976287f2a2 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] [instance: b27eaab4-a751-47fb-acdb-db7c99b06a5f] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:13:32.406771 n-d-863052-2 devstack@n-api.service[121402]: DEBUG dbcounter [-] [121402] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=1 {{(pid=121402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 19:13:32.408429 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-4e445694-9a49-43c7-bb3e-c4976287f2a2 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:13:32.409567 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-4e445694-9a49-43c7-bb3e-c4976287f2a2 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:13:32.410161 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-4e445694-9a49-43c7-bb3e-c4976287f2a2 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:13:32.411324 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-4e445694-9a49-43c7-bb3e-c4976287f2a2 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:13:32.418120 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-4e445694-9a49-43c7-bb3e-c4976287f2a2 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:13:32.422873 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-4e445694-9a49-43c7-bb3e-c4976287f2a2 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:13:32.424501 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-be86c7ab-5d3b-47e7-b80e-dfd4327f8048 tempest-InstanceActionsTestJSON-621834551 tempest-InstanceActionsTestJSON-621834551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32430a3dff994c929c0e635b372c9f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553f439f412542e3a36c5db93d039593', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:13:32.435467 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-be86c7ab-5d3b-47e7-b80e-dfd4327f8048 tempest-InstanceActionsTestJSON-621834551 tempest-InstanceActionsTestJSON-621834551-project] 10.222.0.13 "GET /compute/v2.1/servers/922898a0-ba6d-48cc-9b0b-b3b781eddb9e" status: 200 len: 1512 microversion: 2.1 time: 0.436871 Nov 01 19:13:32.439435 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 2237/4454] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:13:31 2022] GET /compute/v2.1/servers/922898a0-ba6d-48cc-9b0b-b3b781eddb9e => generated 1512 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 19:13:32.950299 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-4e445694-9a49-43c7-bb3e-c4976287f2a2 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc5c19b930543f5a5091922a9859813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ecdc83933544a899117531a960027a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:13:32.970611 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-4e445694-9a49-43c7-bb3e-c4976287f2a2 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] 10.222.0.13 "GET /compute/v2.1/servers/b27eaab4-a751-47fb-acdb-db7c99b06a5f" status: 200 len: 1506 microversion: 2.1 time: 0.616286 Nov 01 19:13:32.985594 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 2218/4455] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:13:32 2022] GET /compute/v2.1/servers/b27eaab4-a751-47fb-acdb-db7c99b06a5f => generated 1506 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:13:32.998569 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-935e5740-35f7-474b-9d44-cd4b94d59e8d tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Action: 'action', calling method: >, body: {"restore": {}} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:13:33.000085 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-935e5740-35f7-474b-9d44-cd4b94d59e8d tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] [instance: caa5cf71-e4c6-4944-9486-645799608b64] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:13:33.017070 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.wsgi [None req-935e5740-35f7-474b-9d44-cd4b94d59e8d tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] HTTP exception thrown: Instance caa5cf71-e4c6-4944-9486-645799608b64 could not be found. Nov 01 19:13:33.025934 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-935e5740-35f7-474b-9d44-cd4b94d59e8d tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Request method failure captured: Nov 01 19:13:33.025934 n-d-863052-2 devstack@n-api.service[121403]: request: POST /compute/v2.1/servers/caa5cf71-e4c6-4944-9486-645799608b64/action HTTP/1.1 Nov 01 19:13:33.025934 n-d-863052-2 devstack@n-api.service[121403]: Accept: application/json Nov 01 19:13:33.025934 n-d-863052-2 devstack@n-api.service[121403]: Accept-Encoding: identity Nov 01 19:13:33.025934 n-d-863052-2 devstack@n-api.service[121403]: Connection: close Nov 01 19:13:33.025934 n-d-863052-2 devstack@n-api.service[121403]: Content-Length: 15 Nov 01 19:13:33.025934 n-d-863052-2 devstack@n-api.service[121403]: Content-Type: application/json Nov 01 19:13:33.025934 n-d-863052-2 devstack@n-api.service[121403]: Host: 10.222.0.13 Nov 01 19:13:33.025934 n-d-863052-2 devstack@n-api.service[121403]: Openstack-System-Scope: None Nov 01 19:13:33.025934 n-d-863052-2 devstack@n-api.service[121403]: User-Agent: python-urllib3/1.26.12 Nov 01 19:13:33.025934 n-d-863052-2 devstack@n-api.service[121403]: X-Auth-Token: gAAAAABjYW9YFTR7hO-vK03S-3HbvOtG2z3_fji2KJH39vNHENu4xIKneeHYviQiPj9ERGiA3aZIA7DvAYzczgSZ5-vK782IQ7CYnUFXvn9Aqt1AbunNMYxhes9BKzhvODzqwzqiQq89wgC4nbpZ9jJWFWMOC4z9bcW4UMi_ylwdZFjmhWfD49s Nov 01 19:13:33.025934 n-d-863052-2 devstack@n-api.service[121403]: X-Domain-Id: None Nov 01 19:13:33.025934 n-d-863052-2 devstack@n-api.service[121403]: X-Domain-Name: None Nov 01 19:13:33.025934 n-d-863052-2 devstack@n-api.service[121403]: X-Identity-Status: Confirmed Nov 01 19:13:33.025934 n-d-863052-2 devstack@n-api.service[121403]: X-Is-Admin-Project: True Nov 01 19:13:33.025934 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Domain-Id: default Nov 01 19:13:33.025934 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Domain-Name: Default Nov 01 19:13:33.025934 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Id: 9ecdc83933544a899117531a960027a7 Nov 01 19:13:33.025934 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Name: tempest-ServersNegativeTestJSON-638944671 Nov 01 19:13:33.025934 n-d-863052-2 devstack@n-api.service[121403]: X-Role: member,reader Nov 01 19:13:33.025934 n-d-863052-2 devstack@n-api.service[121403]: X-Roles: member,reader Nov 01 19:13:33.025934 n-d-863052-2 devstack@n-api.service[121403]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/9ecdc83933544a899117531a960027a7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/9ecdc83933544a899117531a960027a7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_9ecdc83933544a899117531a960027a7", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/9ecdc83933544a899117531a960027a7"}]}] Nov 01 19:13:33.025934 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant: tempest-ServersNegativeTestJSON-638944671 Nov 01 19:13:33.025934 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant-Id: 9ecdc83933544a899117531a960027a7 Nov 01 19:13:33.025934 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant-Name: tempest-ServersNegativeTestJSON-638944671 Nov 01 19:13:33.025934 n-d-863052-2 devstack@n-api.service[121403]: X-User: tempest-ServersNegativeTestJSON-638944671-project Nov 01 19:13:33.025934 n-d-863052-2 devstack@n-api.service[121403]: X-User-Domain-Id: default Nov 01 19:13:33.025934 n-d-863052-2 devstack@n-api.service[121403]: X-User-Domain-Name: Default Nov 01 19:13:33.025934 n-d-863052-2 devstack@n-api.service[121403]: X-User-Id: 3fc5c19b930543f5a5091922a9859813 Nov 01 19:13:33.025934 n-d-863052-2 devstack@n-api.service[121403]: X-User-Name: tempest-ServersNegativeTestJSON-638944671-project Nov 01 19:13:33.025934 n-d-863052-2 devstack@n-api.service[121403]: Nov 01 19:13:33.025934 n-d-863052-2 devstack@n-api.service[121403]: {"restore": {}} Nov 01 19:13:33.025934 n-d-863052-2 devstack@n-api.service[121403]: method: > Nov 01 19:13:33.025934 n-d-863052-2 devstack@n-api.service[121403]: exception: Instance caa5cf71-e4c6-4944-9486-645799608b64 could not be found. Nov 01 19:13:33.025934 n-d-863052-2 devstack@n-api.service[121403]: action_args: {'id': 'caa5cf71-e4c6-4944-9486-645799608b64', 'body': {'restore': {}}} Nov 01 19:13:33.025934 n-d-863052-2 devstack@n-api.service[121403]: {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 01 19:13:33.025934 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:13:33.025934 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 01 19:13:33.025934 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 01 19:13:33.025934 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 01 19:13:33.025934 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 01 19:13:33.025934 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Nov 01 19:13:33.025934 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Nov 01 19:13:33.025934 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance caa5cf71-e4c6-4944-9486-645799608b64 could not be found. Nov 01 19:13:33.025934 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:13:33.025934 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:13:33.025934 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:13:33.025934 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:13:33.025934 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:13:33.025934 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:13:33.025934 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 01 19:13:33.025934 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 01 19:13:33.025934 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 01 19:13:33.025934 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 01 19:13:33.025934 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 38, in _restore Nov 01 19:13:33.025934 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Nov 01 19:13:33.025934 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 01 19:13:33.025934 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 01 19:13:33.025934 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance caa5cf71-e4c6-4944-9486-645799608b64 could not be found. Nov 01 19:13:33.025934 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:13:33.025934 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:13:33.025934 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:13:33.025934 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:13:33.025934 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:13:33.025934 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:13:33.033232 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 01 19:13:33.033232 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 01 19:13:33.033232 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance caa5cf71-e4c6-4944-9486-645799608b64 could not be found. Nov 01 19:13:33.033232 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:13:33.035958 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-935e5740-35f7-474b-9d44-cd4b94d59e8d tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Returning 404 to user: Instance caa5cf71-e4c6-4944-9486-645799608b64 could not be found. {{(pid=121403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 01 19:13:33.039269 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-935e5740-35f7-474b-9d44-cd4b94d59e8d tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] 10.222.0.13 "POST /compute/v2.1/servers/caa5cf71-e4c6-4944-9486-645799608b64/action" status: 404 len: 111 microversion: 2.1 time: 0.045449 Nov 01 19:13:33.041562 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 2238/4456] 10.222.0.13 () {60 vars in 1278 bytes} [Tue Nov 1 19:13:32 2022] POST /compute/v2.1/servers/caa5cf71-e4c6-4944-9486-645799608b64/action => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 01 19:13:33.052732 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-b5253f6d-f196-4bee-bbbf-708ae29cf93b tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:13:33.053391 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-b5253f6d-f196-4bee-bbbf-708ae29cf93b tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] [instance: b27eaab4-a751-47fb-acdb-db7c99b06a5f] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:13:33.064238 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b5253f6d-f196-4bee-bbbf-708ae29cf93b tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:13:33.066937 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b5253f6d-f196-4bee-bbbf-708ae29cf93b tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:13:33.067432 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b5253f6d-f196-4bee-bbbf-708ae29cf93b tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:13:33.068177 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b5253f6d-f196-4bee-bbbf-708ae29cf93b tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:13:33.075287 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b5253f6d-f196-4bee-bbbf-708ae29cf93b tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:13:33.075853 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-b5253f6d-f196-4bee-bbbf-708ae29cf93b tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:13:33.477738 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-50007bac-5ca7-4f10-a940-e9870203fc67 tempest-InstanceActionsTestJSON-621834551 tempest-InstanceActionsTestJSON-621834551-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:13:33.478104 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-50007bac-5ca7-4f10-a940-e9870203fc67 tempest-InstanceActionsTestJSON-621834551 tempest-InstanceActionsTestJSON-621834551-project] [instance: 922898a0-ba6d-48cc-9b0b-b3b781eddb9e] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:13:33.497990 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-50007bac-5ca7-4f10-a940-e9870203fc67 tempest-InstanceActionsTestJSON-621834551 tempest-InstanceActionsTestJSON-621834551-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:13:33.498482 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-50007bac-5ca7-4f10-a940-e9870203fc67 tempest-InstanceActionsTestJSON-621834551 tempest-InstanceActionsTestJSON-621834551-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:13:33.501784 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-50007bac-5ca7-4f10-a940-e9870203fc67 tempest-InstanceActionsTestJSON-621834551 tempest-InstanceActionsTestJSON-621834551-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:13:33.503854 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-50007bac-5ca7-4f10-a940-e9870203fc67 tempest-InstanceActionsTestJSON-621834551 tempest-InstanceActionsTestJSON-621834551-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:13:33.505088 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-50007bac-5ca7-4f10-a940-e9870203fc67 tempest-InstanceActionsTestJSON-621834551 tempest-InstanceActionsTestJSON-621834551-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:13:33.506547 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-50007bac-5ca7-4f10-a940-e9870203fc67 tempest-InstanceActionsTestJSON-621834551 tempest-InstanceActionsTestJSON-621834551-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:13:33.536811 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-b5253f6d-f196-4bee-bbbf-708ae29cf93b tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc5c19b930543f5a5091922a9859813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ecdc83933544a899117531a960027a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:13:33.549487 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-b5253f6d-f196-4bee-bbbf-708ae29cf93b tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] 10.222.0.13 "GET /compute/v2.1/servers/b27eaab4-a751-47fb-acdb-db7c99b06a5f" status: 200 len: 1506 microversion: 2.1 time: 0.503509 Nov 01 19:13:33.550107 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 2219/4457] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:13:33 2022] GET /compute/v2.1/servers/b27eaab4-a751-47fb-acdb-db7c99b06a5f => generated 1506 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:13:33.611731 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-56686210-2d24-43de-afc9-ca77ac9145ce tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:13:33.618230 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-56686210-2d24-43de-afc9-ca77ac9145ce tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] [instance: b27eaab4-a751-47fb-acdb-db7c99b06a5f] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:13:33.631961 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-56686210-2d24-43de-afc9-ca77ac9145ce tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:13:33.637448 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-56686210-2d24-43de-afc9-ca77ac9145ce tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:13:33.640657 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-56686210-2d24-43de-afc9-ca77ac9145ce tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:13:33.641651 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-56686210-2d24-43de-afc9-ca77ac9145ce tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:13:33.642547 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-56686210-2d24-43de-afc9-ca77ac9145ce tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:13:33.644053 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-56686210-2d24-43de-afc9-ca77ac9145ce tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:13:34.318070 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-56686210-2d24-43de-afc9-ca77ac9145ce tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc5c19b930543f5a5091922a9859813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ecdc83933544a899117531a960027a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:13:34.330595 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-56686210-2d24-43de-afc9-ca77ac9145ce tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] 10.222.0.13 "GET /compute/v2.1/servers/b27eaab4-a751-47fb-acdb-db7c99b06a5f" status: 200 len: 1506 microversion: 2.1 time: 0.726339 Nov 01 19:13:34.359877 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 2220/4458] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:13:33 2022] GET /compute/v2.1/servers/b27eaab4-a751-47fb-acdb-db7c99b06a5f => generated 1506 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:13:34.379080 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-27e45b92-49ab-4d13-b6c6-8c3b2fb1d896 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Action: 'action', calling method: >, body: {"restore": {}} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:13:34.383452 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-27e45b92-49ab-4d13-b6c6-8c3b2fb1d896 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] [instance: b27eaab4-a751-47fb-acdb-db7c99b06a5f] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:13:34.403865 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-27e45b92-49ab-4d13-b6c6-8c3b2fb1d896 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:13:34.404385 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-27e45b92-49ab-4d13-b6c6-8c3b2fb1d896 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:13:34.406141 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-27e45b92-49ab-4d13-b6c6-8c3b2fb1d896 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:13:34.406875 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-27e45b92-49ab-4d13-b6c6-8c3b2fb1d896 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:13:34.407344 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-27e45b92-49ab-4d13-b6c6-8c3b2fb1d896 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:13:34.413320 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-27e45b92-49ab-4d13-b6c6-8c3b2fb1d896 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:13:34.472908 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.wsgi [None req-27e45b92-49ab-4d13-b6c6-8c3b2fb1d896 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] HTTP exception thrown: Cannot 'restore' instance b27eaab4-a751-47fb-acdb-db7c99b06a5f while it is in vm_state active Nov 01 19:13:34.475079 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-27e45b92-49ab-4d13-b6c6-8c3b2fb1d896 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Request method failure captured: Nov 01 19:13:34.475079 n-d-863052-2 devstack@n-api.service[121402]: request: POST /compute/v2.1/servers/b27eaab4-a751-47fb-acdb-db7c99b06a5f/action HTTP/1.1 Nov 01 19:13:34.475079 n-d-863052-2 devstack@n-api.service[121402]: Accept: application/json Nov 01 19:13:34.475079 n-d-863052-2 devstack@n-api.service[121402]: Accept-Encoding: identity Nov 01 19:13:34.475079 n-d-863052-2 devstack@n-api.service[121402]: Connection: close Nov 01 19:13:34.475079 n-d-863052-2 devstack@n-api.service[121402]: Content-Length: 15 Nov 01 19:13:34.475079 n-d-863052-2 devstack@n-api.service[121402]: Content-Type: application/json Nov 01 19:13:34.475079 n-d-863052-2 devstack@n-api.service[121402]: Host: 10.222.0.13 Nov 01 19:13:34.475079 n-d-863052-2 devstack@n-api.service[121402]: Openstack-System-Scope: None Nov 01 19:13:34.475079 n-d-863052-2 devstack@n-api.service[121402]: User-Agent: python-urllib3/1.26.12 Nov 01 19:13:34.475079 n-d-863052-2 devstack@n-api.service[121402]: X-Auth-Token: gAAAAABjYW9YFTR7hO-vK03S-3HbvOtG2z3_fji2KJH39vNHENu4xIKneeHYviQiPj9ERGiA3aZIA7DvAYzczgSZ5-vK782IQ7CYnUFXvn9Aqt1AbunNMYxhes9BKzhvODzqwzqiQq89wgC4nbpZ9jJWFWMOC4z9bcW4UMi_ylwdZFjmhWfD49s Nov 01 19:13:34.475079 n-d-863052-2 devstack@n-api.service[121402]: X-Domain-Id: None Nov 01 19:13:34.475079 n-d-863052-2 devstack@n-api.service[121402]: X-Domain-Name: None Nov 01 19:13:34.475079 n-d-863052-2 devstack@n-api.service[121402]: X-Identity-Status: Confirmed Nov 01 19:13:34.475079 n-d-863052-2 devstack@n-api.service[121402]: X-Is-Admin-Project: True Nov 01 19:13:34.475079 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Domain-Id: default Nov 01 19:13:34.475079 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Domain-Name: Default Nov 01 19:13:34.475079 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Id: 9ecdc83933544a899117531a960027a7 Nov 01 19:13:34.475079 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Name: tempest-ServersNegativeTestJSON-638944671 Nov 01 19:13:34.475079 n-d-863052-2 devstack@n-api.service[121402]: X-Role: member,reader Nov 01 19:13:34.475079 n-d-863052-2 devstack@n-api.service[121402]: X-Roles: member,reader Nov 01 19:13:34.475079 n-d-863052-2 devstack@n-api.service[121402]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/9ecdc83933544a899117531a960027a7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/9ecdc83933544a899117531a960027a7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_9ecdc83933544a899117531a960027a7", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/9ecdc83933544a899117531a960027a7"}]}] Nov 01 19:13:34.475079 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant: tempest-ServersNegativeTestJSON-638944671 Nov 01 19:13:34.475079 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant-Id: 9ecdc83933544a899117531a960027a7 Nov 01 19:13:34.475079 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant-Name: tempest-ServersNegativeTestJSON-638944671 Nov 01 19:13:34.475079 n-d-863052-2 devstack@n-api.service[121402]: X-User: tempest-ServersNegativeTestJSON-638944671-project Nov 01 19:13:34.475079 n-d-863052-2 devstack@n-api.service[121402]: X-User-Domain-Id: default Nov 01 19:13:34.475079 n-d-863052-2 devstack@n-api.service[121402]: X-User-Domain-Name: Default Nov 01 19:13:34.475079 n-d-863052-2 devstack@n-api.service[121402]: X-User-Id: 3fc5c19b930543f5a5091922a9859813 Nov 01 19:13:34.475079 n-d-863052-2 devstack@n-api.service[121402]: X-User-Name: tempest-ServersNegativeTestJSON-638944671-project Nov 01 19:13:34.475079 n-d-863052-2 devstack@n-api.service[121402]: Nov 01 19:13:34.475079 n-d-863052-2 devstack@n-api.service[121402]: {"restore": {}} Nov 01 19:13:34.475079 n-d-863052-2 devstack@n-api.service[121402]: method: > Nov 01 19:13:34.475079 n-d-863052-2 devstack@n-api.service[121402]: exception: Cannot 'restore' instance b27eaab4-a751-47fb-acdb-db7c99b06a5f while it is in vm_state active Nov 01 19:13:34.475079 n-d-863052-2 devstack@n-api.service[121402]: action_args: {'id': 'b27eaab4-a751-47fb-acdb-db7c99b06a5f', 'body': {'restore': {}}} Nov 01 19:13:34.475079 n-d-863052-2 devstack@n-api.service[121402]: {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 01 19:13:34.475079 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:13:34.475079 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 42, in _restore Nov 01 19:13:34.475079 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi self.compute_api.restore(context, instance) Nov 01 19:13:34.475079 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Nov 01 19:13:34.475079 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Nov 01 19:13:34.475079 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Nov 01 19:13:34.475079 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Nov 01 19:13:34.475079 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance b27eaab4-a751-47fb-acdb-db7c99b06a5f in vm_state active. Cannot restore while the instance is in this state. Nov 01 19:13:34.475079 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:13:34.475079 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:13:34.475079 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:13:34.475079 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:13:34.475079 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:13:34.475079 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:13:34.475079 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 01 19:13:34.475079 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 01 19:13:34.475079 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 01 19:13:34.475079 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 01 19:13:34.475079 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 46, in _restore Nov 01 19:13:34.475079 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Nov 01 19:13:34.475079 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Nov 01 19:13:34.475079 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Nov 01 19:13:34.475079 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'restore' instance b27eaab4-a751-47fb-acdb-db7c99b06a5f while it is in vm_state active Nov 01 19:13:34.475079 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:13:34.475079 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:13:34.475079 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:13:34.475079 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:13:34.475079 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:13:34.478803 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:13:34.478803 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 01 19:13:34.478803 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 01 19:13:34.478803 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'restore' instance b27eaab4-a751-47fb-acdb-db7c99b06a5f while it is in vm_state active Nov 01 19:13:34.478803 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:13:34.483329 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-27e45b92-49ab-4d13-b6c6-8c3b2fb1d896 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Returning 409 to user: Cannot 'restore' instance b27eaab4-a751-47fb-acdb-db7c99b06a5f while it is in vm_state active {{(pid=121402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 01 19:13:34.484210 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-27e45b92-49ab-4d13-b6c6-8c3b2fb1d896 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] 10.222.0.13 "POST /compute/v2.1/servers/b27eaab4-a751-47fb-acdb-db7c99b06a5f/action" status: 409 len: 145 microversion: 2.1 time: 0.119105 Nov 01 19:13:34.489940 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 2221/4459] 10.222.0.13 () {60 vars in 1278 bytes} [Tue Nov 1 19:13:34 2022] POST /compute/v2.1/servers/b27eaab4-a751-47fb-acdb-db7c99b06a5f/action => generated 145 bytes in 125 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Nov 01 19:13:34.503607 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-2b4f0ecf-c76b-4d01-9e1b-6e15a55718bc tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:13:34.506060 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-2b4f0ecf-c76b-4d01-9e1b-6e15a55718bc tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] [instance: b27eaab4-a751-47fb-acdb-db7c99b06a5f] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:13:34.517600 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2b4f0ecf-c76b-4d01-9e1b-6e15a55718bc tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:13:34.519537 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2b4f0ecf-c76b-4d01-9e1b-6e15a55718bc tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:13:34.522671 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2b4f0ecf-c76b-4d01-9e1b-6e15a55718bc tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:13:34.524454 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2b4f0ecf-c76b-4d01-9e1b-6e15a55718bc tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:13:34.526038 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2b4f0ecf-c76b-4d01-9e1b-6e15a55718bc tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:13:34.529784 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-2b4f0ecf-c76b-4d01-9e1b-6e15a55718bc tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:13:34.586843 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-50007bac-5ca7-4f10-a940-e9870203fc67 tempest-InstanceActionsTestJSON-621834551 tempest-InstanceActionsTestJSON-621834551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32430a3dff994c929c0e635b372c9f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553f439f412542e3a36c5db93d039593', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:13:34.609686 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-50007bac-5ca7-4f10-a940-e9870203fc67 tempest-InstanceActionsTestJSON-621834551 tempest-InstanceActionsTestJSON-621834551-project] 10.222.0.13 "GET /compute/v2.1/servers/922898a0-ba6d-48cc-9b0b-b3b781eddb9e" status: 200 len: 1505 microversion: 2.1 time: 1.147106 Nov 01 19:13:34.633021 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 2239/4460] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:13:33 2022] GET /compute/v2.1/servers/922898a0-ba6d-48cc-9b0b-b3b781eddb9e => generated 1505 bytes in 1169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:13:34.638903 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-7adbaf6b-29d6-4e6d-84af-ae265b95ca01 tempest-InstanceActionsTestJSON-621834551 tempest-InstanceActionsTestJSON-621834551-project] Calling method '.version_select at 0x7f0ae1f29b80>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:13:34.653280 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-7adbaf6b-29d6-4e6d-84af-ae265b95ca01 tempest-InstanceActionsTestJSON-621834551 tempest-InstanceActionsTestJSON-621834551-project] [instance: 922898a0-ba6d-48cc-9b0b-b3b781eddb9e] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:13:34.670911 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-7adbaf6b-29d6-4e6d-84af-ae265b95ca01 tempest-InstanceActionsTestJSON-621834551 tempest-InstanceActionsTestJSON-621834551-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:13:34.672955 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-7adbaf6b-29d6-4e6d-84af-ae265b95ca01 tempest-InstanceActionsTestJSON-621834551 tempest-InstanceActionsTestJSON-621834551-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:13:34.677584 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-7adbaf6b-29d6-4e6d-84af-ae265b95ca01 tempest-InstanceActionsTestJSON-621834551 tempest-InstanceActionsTestJSON-621834551-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:13:34.685378 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-7adbaf6b-29d6-4e6d-84af-ae265b95ca01 tempest-InstanceActionsTestJSON-621834551 tempest-InstanceActionsTestJSON-621834551-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:13:34.686616 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-7adbaf6b-29d6-4e6d-84af-ae265b95ca01 tempest-InstanceActionsTestJSON-621834551 tempest-InstanceActionsTestJSON-621834551-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:13:34.687066 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-7adbaf6b-29d6-4e6d-84af-ae265b95ca01 tempest-InstanceActionsTestJSON-621834551 tempest-InstanceActionsTestJSON-621834551-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:13:34.761831 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-7adbaf6b-29d6-4e6d-84af-ae265b95ca01 tempest-InstanceActionsTestJSON-621834551 tempest-InstanceActionsTestJSON-621834551-project] 10.222.0.13 "GET /compute/v2.1/servers/922898a0-ba6d-48cc-9b0b-b3b781eddb9e/os-instance-actions" status: 200 len: 611 microversion: 2.1 time: 0.126282 Nov 01 19:13:34.772172 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 2240/4461] 10.222.0.13 () {58 vars in 1296 bytes} [Tue Nov 1 19:13:34 2022] GET /compute/v2.1/servers/922898a0-ba6d-48cc-9b0b-b3b781eddb9e/os-instance-actions => generated 611 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:13:34.779884 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-daf8d8e0-9751-419e-bb72-1c351a37dc88 tempest-InstanceActionsTestJSON-621834551 tempest-InstanceActionsTestJSON-621834551-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:13:34.780675 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-daf8d8e0-9751-419e-bb72-1c351a37dc88 tempest-InstanceActionsTestJSON-621834551 tempest-InstanceActionsTestJSON-621834551-project] [instance: 922898a0-ba6d-48cc-9b0b-b3b781eddb9e] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:13:34.790390 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-daf8d8e0-9751-419e-bb72-1c351a37dc88 tempest-InstanceActionsTestJSON-621834551 tempest-InstanceActionsTestJSON-621834551-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:13:34.792329 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-daf8d8e0-9751-419e-bb72-1c351a37dc88 tempest-InstanceActionsTestJSON-621834551 tempest-InstanceActionsTestJSON-621834551-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:13:34.793606 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-daf8d8e0-9751-419e-bb72-1c351a37dc88 tempest-InstanceActionsTestJSON-621834551 tempest-InstanceActionsTestJSON-621834551-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:13:34.795161 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-daf8d8e0-9751-419e-bb72-1c351a37dc88 tempest-InstanceActionsTestJSON-621834551 tempest-InstanceActionsTestJSON-621834551-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:13:34.795876 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-daf8d8e0-9751-419e-bb72-1c351a37dc88 tempest-InstanceActionsTestJSON-621834551 tempest-InstanceActionsTestJSON-621834551-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:13:34.796517 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-daf8d8e0-9751-419e-bb72-1c351a37dc88 tempest-InstanceActionsTestJSON-621834551 tempest-InstanceActionsTestJSON-621834551-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:13:34.849011 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-daf8d8e0-9751-419e-bb72-1c351a37dc88 tempest-InstanceActionsTestJSON-621834551 tempest-InstanceActionsTestJSON-621834551-project] [instance: 922898a0-ba6d-48cc-9b0b-b3b781eddb9e] Going to try to terminate instance {{(pid=121403) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 01 19:13:35.078003 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-daf8d8e0-9751-419e-bb72-1c351a37dc88 tempest-InstanceActionsTestJSON-621834551 tempest-InstanceActionsTestJSON-621834551-project] 10.222.0.13 "DELETE /compute/v2.1/servers/922898a0-ba6d-48cc-9b0b-b3b781eddb9e" status: 204 len: 0 microversion: 2.1 time: 0.303181 Nov 01 19:13:35.080514 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 2241/4462] 10.222.0.13 () {58 vars in 1239 bytes} [Tue Nov 1 19:13:34 2022] DELETE /compute/v2.1/servers/922898a0-ba6d-48cc-9b0b-b3b781eddb9e => generated 0 bytes in 307 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 01 19:13:35.102506 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-6eb264c1-73af-42b3-8037-0a62be5b3b86 tempest-InstanceActionsTestJSON-621834551 tempest-InstanceActionsTestJSON-621834551-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:13:35.103472 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-6eb264c1-73af-42b3-8037-0a62be5b3b86 tempest-InstanceActionsTestJSON-621834551 tempest-InstanceActionsTestJSON-621834551-project] [instance: 922898a0-ba6d-48cc-9b0b-b3b781eddb9e] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:13:35.118593 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-6eb264c1-73af-42b3-8037-0a62be5b3b86 tempest-InstanceActionsTestJSON-621834551 tempest-InstanceActionsTestJSON-621834551-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:13:35.119490 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-6eb264c1-73af-42b3-8037-0a62be5b3b86 tempest-InstanceActionsTestJSON-621834551 tempest-InstanceActionsTestJSON-621834551-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:13:35.122453 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-6eb264c1-73af-42b3-8037-0a62be5b3b86 tempest-InstanceActionsTestJSON-621834551 tempest-InstanceActionsTestJSON-621834551-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:13:35.123458 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-6eb264c1-73af-42b3-8037-0a62be5b3b86 tempest-InstanceActionsTestJSON-621834551 tempest-InstanceActionsTestJSON-621834551-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:13:35.126287 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-6eb264c1-73af-42b3-8037-0a62be5b3b86 tempest-InstanceActionsTestJSON-621834551 tempest-InstanceActionsTestJSON-621834551-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:13:35.127561 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-6eb264c1-73af-42b3-8037-0a62be5b3b86 tempest-InstanceActionsTestJSON-621834551 tempest-InstanceActionsTestJSON-621834551-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:13:35.458915 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-2b4f0ecf-c76b-4d01-9e1b-6e15a55718bc tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc5c19b930543f5a5091922a9859813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ecdc83933544a899117531a960027a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:13:35.470036 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-2b4f0ecf-c76b-4d01-9e1b-6e15a55718bc tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] 10.222.0.13 "GET /compute/v2.1/servers/b27eaab4-a751-47fb-acdb-db7c99b06a5f" status: 200 len: 1506 microversion: 2.1 time: 0.978624 Nov 01 19:13:35.472128 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 2222/4463] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:13:34 2022] GET /compute/v2.1/servers/b27eaab4-a751-47fb-acdb-db7c99b06a5f => generated 1506 bytes in 981 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:13:35.507435 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-62ed46ec-332e-413d-8ce9-64584ad59be2 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:13:35.508525 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-62ed46ec-332e-413d-8ce9-64584ad59be2 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] [instance: b27eaab4-a751-47fb-acdb-db7c99b06a5f] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:13:35.526560 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-62ed46ec-332e-413d-8ce9-64584ad59be2 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:13:35.527284 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-62ed46ec-332e-413d-8ce9-64584ad59be2 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:13:35.527884 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-62ed46ec-332e-413d-8ce9-64584ad59be2 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:13:35.529142 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-62ed46ec-332e-413d-8ce9-64584ad59be2 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:13:35.531196 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-62ed46ec-332e-413d-8ce9-64584ad59be2 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:13:35.531836 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-62ed46ec-332e-413d-8ce9-64584ad59be2 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:13:35.978645 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-6eb264c1-73af-42b3-8037-0a62be5b3b86 tempest-InstanceActionsTestJSON-621834551 tempest-InstanceActionsTestJSON-621834551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32430a3dff994c929c0e635b372c9f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553f439f412542e3a36c5db93d039593', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:13:35.987746 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-62ed46ec-332e-413d-8ce9-64584ad59be2 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc5c19b930543f5a5091922a9859813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ecdc83933544a899117531a960027a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:13:35.995821 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-62ed46ec-332e-413d-8ce9-64584ad59be2 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] 10.222.0.13 "GET /compute/v2.1/servers/b27eaab4-a751-47fb-acdb-db7c99b06a5f" status: 200 len: 1506 microversion: 2.1 time: 0.494352 Nov 01 19:13:35.996295 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-6eb264c1-73af-42b3-8037-0a62be5b3b86 tempest-InstanceActionsTestJSON-621834551 tempest-InstanceActionsTestJSON-621834551-project] 10.222.0.13 "GET /compute/v2.1/servers/922898a0-ba6d-48cc-9b0b-b3b781eddb9e" status: 200 len: 1511 microversion: 2.1 time: 0.911404 Nov 01 19:13:35.996911 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 2242/4464] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:13:35 2022] GET /compute/v2.1/servers/922898a0-ba6d-48cc-9b0b-b3b781eddb9e => generated 1511 bytes in 913 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:13:36.009962 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 2223/4465] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:13:35 2022] GET /compute/v2.1/servers/b27eaab4-a751-47fb-acdb-db7c99b06a5f => generated 1506 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:13:36.025344 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-219fe12d-49fa-456f-bac5-123a408fa00a tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:13:36.025902 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-219fe12d-49fa-456f-bac5-123a408fa00a tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] [instance: 8b49844a-4099-46a1-93db-ebbb00d3cae3] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:13:36.032129 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.wsgi [None req-219fe12d-49fa-456f-bac5-123a408fa00a tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] HTTP exception thrown: Instance 8b49844a-4099-46a1-93db-ebbb00d3cae3 could not be found. Nov 01 19:13:36.040140 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-219fe12d-49fa-456f-bac5-123a408fa00a tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Request method failure captured: Nov 01 19:13:36.040140 n-d-863052-2 devstack@n-api.service[121402]: request: POST /compute/v2.1/servers/8b49844a-4099-46a1-93db-ebbb00d3cae3/action HTTP/1.1 Nov 01 19:13:36.040140 n-d-863052-2 devstack@n-api.service[121402]: Accept: application/json Nov 01 19:13:36.040140 n-d-863052-2 devstack@n-api.service[121402]: Accept-Encoding: identity Nov 01 19:13:36.040140 n-d-863052-2 devstack@n-api.service[121402]: Connection: close Nov 01 19:13:36.040140 n-d-863052-2 devstack@n-api.service[121402]: Content-Length: 14 Nov 01 19:13:36.040140 n-d-863052-2 devstack@n-api.service[121402]: Content-Type: application/json Nov 01 19:13:36.040140 n-d-863052-2 devstack@n-api.service[121402]: Host: 10.222.0.13 Nov 01 19:13:36.040140 n-d-863052-2 devstack@n-api.service[121402]: Openstack-System-Scope: None Nov 01 19:13:36.040140 n-d-863052-2 devstack@n-api.service[121402]: User-Agent: python-urllib3/1.26.12 Nov 01 19:13:36.040140 n-d-863052-2 devstack@n-api.service[121402]: X-Auth-Token: gAAAAABjYW9YFTR7hO-vK03S-3HbvOtG2z3_fji2KJH39vNHENu4xIKneeHYviQiPj9ERGiA3aZIA7DvAYzczgSZ5-vK782IQ7CYnUFXvn9Aqt1AbunNMYxhes9BKzhvODzqwzqiQq89wgC4nbpZ9jJWFWMOC4z9bcW4UMi_ylwdZFjmhWfD49s Nov 01 19:13:36.040140 n-d-863052-2 devstack@n-api.service[121402]: X-Domain-Id: None Nov 01 19:13:36.040140 n-d-863052-2 devstack@n-api.service[121402]: X-Domain-Name: None Nov 01 19:13:36.040140 n-d-863052-2 devstack@n-api.service[121402]: X-Identity-Status: Confirmed Nov 01 19:13:36.040140 n-d-863052-2 devstack@n-api.service[121402]: X-Is-Admin-Project: True Nov 01 19:13:36.040140 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Domain-Id: default Nov 01 19:13:36.040140 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Domain-Name: Default Nov 01 19:13:36.040140 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Id: 9ecdc83933544a899117531a960027a7 Nov 01 19:13:36.040140 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Name: tempest-ServersNegativeTestJSON-638944671 Nov 01 19:13:36.040140 n-d-863052-2 devstack@n-api.service[121402]: X-Role: member,reader Nov 01 19:13:36.040140 n-d-863052-2 devstack@n-api.service[121402]: X-Roles: member,reader Nov 01 19:13:36.040140 n-d-863052-2 devstack@n-api.service[121402]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/9ecdc83933544a899117531a960027a7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/9ecdc83933544a899117531a960027a7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_9ecdc83933544a899117531a960027a7", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/9ecdc83933544a899117531a960027a7"}]}] Nov 01 19:13:36.040140 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant: tempest-ServersNegativeTestJSON-638944671 Nov 01 19:13:36.040140 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant-Id: 9ecdc83933544a899117531a960027a7 Nov 01 19:13:36.040140 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant-Name: tempest-ServersNegativeTestJSON-638944671 Nov 01 19:13:36.040140 n-d-863052-2 devstack@n-api.service[121402]: X-User: tempest-ServersNegativeTestJSON-638944671-project Nov 01 19:13:36.040140 n-d-863052-2 devstack@n-api.service[121402]: X-User-Domain-Id: default Nov 01 19:13:36.040140 n-d-863052-2 devstack@n-api.service[121402]: X-User-Domain-Name: Default Nov 01 19:13:36.040140 n-d-863052-2 devstack@n-api.service[121402]: X-User-Id: 3fc5c19b930543f5a5091922a9859813 Nov 01 19:13:36.040140 n-d-863052-2 devstack@n-api.service[121402]: X-User-Name: tempest-ServersNegativeTestJSON-638944671-project Nov 01 19:13:36.040140 n-d-863052-2 devstack@n-api.service[121402]: Nov 01 19:13:36.040140 n-d-863052-2 devstack@n-api.service[121402]: {"resume": {}} Nov 01 19:13:36.040140 n-d-863052-2 devstack@n-api.service[121402]: method: > Nov 01 19:13:36.040140 n-d-863052-2 devstack@n-api.service[121402]: exception: Instance 8b49844a-4099-46a1-93db-ebbb00d3cae3 could not be found. Nov 01 19:13:36.040140 n-d-863052-2 devstack@n-api.service[121402]: action_args: {'id': '8b49844a-4099-46a1-93db-ebbb00d3cae3', 'body': {'resume': {}}} Nov 01 19:13:36.040140 n-d-863052-2 devstack@n-api.service[121402]: {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 01 19:13:36.040140 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:13:36.040140 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 01 19:13:36.040140 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 01 19:13:36.040140 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 01 19:13:36.040140 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 01 19:13:36.040140 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Nov 01 19:13:36.040140 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Nov 01 19:13:36.040140 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8b49844a-4099-46a1-93db-ebbb00d3cae3 could not be found. Nov 01 19:13:36.040140 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:13:36.040140 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:13:36.040140 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:13:36.040140 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:13:36.040140 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:13:36.040140 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:13:36.040140 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 01 19:13:36.040140 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 01 19:13:36.040140 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 01 19:13:36.040140 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 01 19:13:36.040140 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 55, in _resume Nov 01 19:13:36.040140 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, id) Nov 01 19:13:36.040140 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 01 19:13:36.040140 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 01 19:13:36.040140 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8b49844a-4099-46a1-93db-ebbb00d3cae3 could not be found. Nov 01 19:13:36.040140 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:13:36.040140 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:13:36.040140 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:13:36.040140 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:13:36.040140 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:13:36.040140 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:13:36.044350 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 01 19:13:36.044350 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 01 19:13:36.044350 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8b49844a-4099-46a1-93db-ebbb00d3cae3 could not be found. Nov 01 19:13:36.044350 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:13:36.049502 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-219fe12d-49fa-456f-bac5-123a408fa00a tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Returning 404 to user: Instance 8b49844a-4099-46a1-93db-ebbb00d3cae3 could not be found. {{(pid=121402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 01 19:13:36.050885 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-219fe12d-49fa-456f-bac5-123a408fa00a tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] 10.222.0.13 "POST /compute/v2.1/servers/8b49844a-4099-46a1-93db-ebbb00d3cae3/action" status: 404 len: 111 microversion: 2.1 time: 0.034003 Nov 01 19:13:36.051492 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 2224/4466] 10.222.0.13 () {60 vars in 1278 bytes} [Tue Nov 1 19:13:36 2022] POST /compute/v2.1/servers/8b49844a-4099-46a1-93db-ebbb00d3cae3/action => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 01 19:13:36.061282 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-9f821b62-1183-470e-935c-39f74f95ac14 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:13:36.061917 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-9f821b62-1183-470e-935c-39f74f95ac14 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] [instance: b27eaab4-a751-47fb-acdb-db7c99b06a5f] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:13:36.076462 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-9f821b62-1183-470e-935c-39f74f95ac14 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:13:36.079801 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-9f821b62-1183-470e-935c-39f74f95ac14 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:13:36.080431 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-9f821b62-1183-470e-935c-39f74f95ac14 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:13:36.081353 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-9f821b62-1183-470e-935c-39f74f95ac14 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:13:36.089849 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-9f821b62-1183-470e-935c-39f74f95ac14 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:13:36.090845 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-9f821b62-1183-470e-935c-39f74f95ac14 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:13:36.419424 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-44297714-ecf4-4505-a71c-b4828640826f tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:13:36.420718 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-44297714-ecf4-4505-a71c-b4828640826f tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] [instance: cae1c729-7c41-488d-ab0e-30d1f5d22180] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:13:36.433193 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-44297714-ecf4-4505-a71c-b4828640826f tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:13:36.433699 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-44297714-ecf4-4505-a71c-b4828640826f tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:13:36.444451 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-44297714-ecf4-4505-a71c-b4828640826f tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:13:36.445263 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-44297714-ecf4-4505-a71c-b4828640826f tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:13:36.445750 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-44297714-ecf4-4505-a71c-b4828640826f tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:13:36.446178 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-44297714-ecf4-4505-a71c-b4828640826f tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:13:36.593607 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-9f821b62-1183-470e-935c-39f74f95ac14 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc5c19b930543f5a5091922a9859813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ecdc83933544a899117531a960027a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:13:36.609881 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-9f821b62-1183-470e-935c-39f74f95ac14 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] 10.222.0.13 "GET /compute/v2.1/servers/b27eaab4-a751-47fb-acdb-db7c99b06a5f" status: 200 len: 1506 microversion: 2.1 time: 0.553772 Nov 01 19:13:36.611466 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 2243/4467] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:13:36 2022] GET /compute/v2.1/servers/b27eaab4-a751-47fb-acdb-db7c99b06a5f => generated 1506 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:13:36.633981 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-806686a0-02e2-4354-8e06-636c8e1e6628 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:13:36.634877 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-806686a0-02e2-4354-8e06-636c8e1e6628 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] [instance: b27eaab4-a751-47fb-acdb-db7c99b06a5f] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:13:36.643639 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-806686a0-02e2-4354-8e06-636c8e1e6628 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:13:36.650360 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-806686a0-02e2-4354-8e06-636c8e1e6628 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:13:36.651627 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-806686a0-02e2-4354-8e06-636c8e1e6628 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:13:36.653997 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-806686a0-02e2-4354-8e06-636c8e1e6628 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:13:36.655741 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-806686a0-02e2-4354-8e06-636c8e1e6628 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:13:36.658040 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-806686a0-02e2-4354-8e06-636c8e1e6628 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:13:36.984654 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-44297714-ecf4-4505-a71c-b4828640826f tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcf93260eaef487dac5d7bb00b26e3b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73cb8697de6d407ba82c334d9f2b48d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:13:37.000428 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-44297714-ecf4-4505-a71c-b4828640826f tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] 10.222.0.13 "GET /compute/v2.1/servers/cae1c729-7c41-488d-ab0e-30d1f5d22180" status: 200 len: 1680 microversion: 2.1 time: 0.584674 Nov 01 19:13:37.001363 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 2225/4468] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:13:36 2022] GET /compute/v2.1/servers/cae1c729-7c41-488d-ab0e-30d1f5d22180 => generated 1680 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:13:37.023092 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-94603b18-ac5c-4ae1-8964-a81297096d4a tempest-InstanceActionsTestJSON-621834551 tempest-InstanceActionsTestJSON-621834551-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:13:37.023254 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-94603b18-ac5c-4ae1-8964-a81297096d4a tempest-InstanceActionsTestJSON-621834551 tempest-InstanceActionsTestJSON-621834551-project] [instance: 922898a0-ba6d-48cc-9b0b-b3b781eddb9e] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:13:37.030850 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-94603b18-ac5c-4ae1-8964-a81297096d4a tempest-InstanceActionsTestJSON-621834551 tempest-InstanceActionsTestJSON-621834551-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:13:37.031579 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-94603b18-ac5c-4ae1-8964-a81297096d4a tempest-InstanceActionsTestJSON-621834551 tempest-InstanceActionsTestJSON-621834551-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:13:37.032238 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-94603b18-ac5c-4ae1-8964-a81297096d4a tempest-InstanceActionsTestJSON-621834551 tempest-InstanceActionsTestJSON-621834551-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:13:37.033198 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-94603b18-ac5c-4ae1-8964-a81297096d4a tempest-InstanceActionsTestJSON-621834551 tempest-InstanceActionsTestJSON-621834551-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:13:37.033897 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-94603b18-ac5c-4ae1-8964-a81297096d4a tempest-InstanceActionsTestJSON-621834551 tempest-InstanceActionsTestJSON-621834551-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:13:37.034551 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-94603b18-ac5c-4ae1-8964-a81297096d4a tempest-InstanceActionsTestJSON-621834551 tempest-InstanceActionsTestJSON-621834551-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:13:37.216838 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-806686a0-02e2-4354-8e06-636c8e1e6628 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc5c19b930543f5a5091922a9859813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ecdc83933544a899117531a960027a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:13:37.225892 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-806686a0-02e2-4354-8e06-636c8e1e6628 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] 10.222.0.13 "GET /compute/v2.1/servers/b27eaab4-a751-47fb-acdb-db7c99b06a5f" status: 200 len: 1506 microversion: 2.1 time: 0.595926 Nov 01 19:13:37.237352 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 2244/4469] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:13:36 2022] GET /compute/v2.1/servers/b27eaab4-a751-47fb-acdb-db7c99b06a5f => generated 1506 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 19:13:37.263202 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-92e60ee3-98fb-4ac3-b378-0bddb593e307 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:13:37.263868 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-92e60ee3-98fb-4ac3-b378-0bddb593e307 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] [instance: b27eaab4-a751-47fb-acdb-db7c99b06a5f] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:13:37.271349 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-92e60ee3-98fb-4ac3-b378-0bddb593e307 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:13:37.271869 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-92e60ee3-98fb-4ac3-b378-0bddb593e307 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:13:37.272312 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-92e60ee3-98fb-4ac3-b378-0bddb593e307 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:13:37.273076 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-92e60ee3-98fb-4ac3-b378-0bddb593e307 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:13:37.274086 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-92e60ee3-98fb-4ac3-b378-0bddb593e307 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:13:37.274086 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-92e60ee3-98fb-4ac3-b378-0bddb593e307 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:13:37.347173 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.wsgi [None req-92e60ee3-98fb-4ac3-b378-0bddb593e307 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] HTTP exception thrown: Cannot 'resume' instance b27eaab4-a751-47fb-acdb-db7c99b06a5f while it is in vm_state active Nov 01 19:13:37.351357 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-92e60ee3-98fb-4ac3-b378-0bddb593e307 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Request method failure captured: Nov 01 19:13:37.351357 n-d-863052-2 devstack@n-api.service[121403]: request: POST /compute/v2.1/servers/b27eaab4-a751-47fb-acdb-db7c99b06a5f/action HTTP/1.1 Nov 01 19:13:37.351357 n-d-863052-2 devstack@n-api.service[121403]: Accept: application/json Nov 01 19:13:37.351357 n-d-863052-2 devstack@n-api.service[121403]: Accept-Encoding: identity Nov 01 19:13:37.351357 n-d-863052-2 devstack@n-api.service[121403]: Connection: close Nov 01 19:13:37.351357 n-d-863052-2 devstack@n-api.service[121403]: Content-Length: 14 Nov 01 19:13:37.351357 n-d-863052-2 devstack@n-api.service[121403]: Content-Type: application/json Nov 01 19:13:37.351357 n-d-863052-2 devstack@n-api.service[121403]: Host: 10.222.0.13 Nov 01 19:13:37.351357 n-d-863052-2 devstack@n-api.service[121403]: Openstack-System-Scope: None Nov 01 19:13:37.351357 n-d-863052-2 devstack@n-api.service[121403]: User-Agent: python-urllib3/1.26.12 Nov 01 19:13:37.351357 n-d-863052-2 devstack@n-api.service[121403]: X-Auth-Token: gAAAAABjYW9YFTR7hO-vK03S-3HbvOtG2z3_fji2KJH39vNHENu4xIKneeHYviQiPj9ERGiA3aZIA7DvAYzczgSZ5-vK782IQ7CYnUFXvn9Aqt1AbunNMYxhes9BKzhvODzqwzqiQq89wgC4nbpZ9jJWFWMOC4z9bcW4UMi_ylwdZFjmhWfD49s Nov 01 19:13:37.351357 n-d-863052-2 devstack@n-api.service[121403]: X-Domain-Id: None Nov 01 19:13:37.351357 n-d-863052-2 devstack@n-api.service[121403]: X-Domain-Name: None Nov 01 19:13:37.351357 n-d-863052-2 devstack@n-api.service[121403]: X-Identity-Status: Confirmed Nov 01 19:13:37.351357 n-d-863052-2 devstack@n-api.service[121403]: X-Is-Admin-Project: True Nov 01 19:13:37.351357 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Domain-Id: default Nov 01 19:13:37.351357 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Domain-Name: Default Nov 01 19:13:37.351357 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Id: 9ecdc83933544a899117531a960027a7 Nov 01 19:13:37.351357 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Name: tempest-ServersNegativeTestJSON-638944671 Nov 01 19:13:37.351357 n-d-863052-2 devstack@n-api.service[121403]: X-Role: member,reader Nov 01 19:13:37.351357 n-d-863052-2 devstack@n-api.service[121403]: X-Roles: member,reader Nov 01 19:13:37.351357 n-d-863052-2 devstack@n-api.service[121403]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/9ecdc83933544a899117531a960027a7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/9ecdc83933544a899117531a960027a7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_9ecdc83933544a899117531a960027a7", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/9ecdc83933544a899117531a960027a7"}]}] Nov 01 19:13:37.351357 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant: tempest-ServersNegativeTestJSON-638944671 Nov 01 19:13:37.351357 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant-Id: 9ecdc83933544a899117531a960027a7 Nov 01 19:13:37.351357 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant-Name: tempest-ServersNegativeTestJSON-638944671 Nov 01 19:13:37.351357 n-d-863052-2 devstack@n-api.service[121403]: X-User: tempest-ServersNegativeTestJSON-638944671-project Nov 01 19:13:37.351357 n-d-863052-2 devstack@n-api.service[121403]: X-User-Domain-Id: default Nov 01 19:13:37.351357 n-d-863052-2 devstack@n-api.service[121403]: X-User-Domain-Name: Default Nov 01 19:13:37.351357 n-d-863052-2 devstack@n-api.service[121403]: X-User-Id: 3fc5c19b930543f5a5091922a9859813 Nov 01 19:13:37.351357 n-d-863052-2 devstack@n-api.service[121403]: X-User-Name: tempest-ServersNegativeTestJSON-638944671-project Nov 01 19:13:37.351357 n-d-863052-2 devstack@n-api.service[121403]: Nov 01 19:13:37.351357 n-d-863052-2 devstack@n-api.service[121403]: {"resume": {}} Nov 01 19:13:37.351357 n-d-863052-2 devstack@n-api.service[121403]: method: > Nov 01 19:13:37.351357 n-d-863052-2 devstack@n-api.service[121403]: exception: Cannot 'resume' instance b27eaab4-a751-47fb-acdb-db7c99b06a5f while it is in vm_state active Nov 01 19:13:37.351357 n-d-863052-2 devstack@n-api.service[121403]: action_args: {'id': 'b27eaab4-a751-47fb-acdb-db7c99b06a5f', 'body': {'resume': {}}} Nov 01 19:13:37.351357 n-d-863052-2 devstack@n-api.service[121403]: {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 01 19:13:37.351357 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:13:37.351357 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 59, in _resume Nov 01 19:13:37.351357 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi self.compute_api.resume(context, server) Nov 01 19:13:37.351357 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Nov 01 19:13:37.351357 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Nov 01 19:13:37.351357 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Nov 01 19:13:37.351357 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Nov 01 19:13:37.351357 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Nov 01 19:13:37.351357 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Nov 01 19:13:37.351357 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance b27eaab4-a751-47fb-acdb-db7c99b06a5f in vm_state active. Cannot resume while the instance is in this state. Nov 01 19:13:37.351357 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:13:37.351357 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:13:37.351357 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:13:37.351357 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:13:37.351357 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:13:37.351357 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:13:37.351357 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 01 19:13:37.351357 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 01 19:13:37.351357 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 01 19:13:37.351357 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 01 19:13:37.351357 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 63, in _resume Nov 01 19:13:37.351357 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Nov 01 19:13:37.351357 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Nov 01 19:13:37.351357 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Nov 01 19:13:37.351357 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'resume' instance b27eaab4-a751-47fb-acdb-db7c99b06a5f while it is in vm_state active Nov 01 19:13:37.351357 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:13:37.351357 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:13:37.351357 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:13:37.355644 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:13:37.355644 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:13:37.355644 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:13:37.355644 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 01 19:13:37.355644 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 01 19:13:37.355644 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'resume' instance b27eaab4-a751-47fb-acdb-db7c99b06a5f while it is in vm_state active Nov 01 19:13:37.355644 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:13:37.355644 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-92e60ee3-98fb-4ac3-b378-0bddb593e307 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Returning 409 to user: Cannot 'resume' instance b27eaab4-a751-47fb-acdb-db7c99b06a5f while it is in vm_state active {{(pid=121403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 01 19:13:37.361935 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-92e60ee3-98fb-4ac3-b378-0bddb593e307 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] 10.222.0.13 "POST /compute/v2.1/servers/b27eaab4-a751-47fb-acdb-db7c99b06a5f/action" status: 409 len: 144 microversion: 2.1 time: 0.098385 Nov 01 19:13:37.361935 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 2245/4470] 10.222.0.13 () {60 vars in 1278 bytes} [Tue Nov 1 19:13:37 2022] POST /compute/v2.1/servers/b27eaab4-a751-47fb-acdb-db7c99b06a5f/action => generated 144 bytes in 102 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Nov 01 19:13:37.375424 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-c392e5f6-8a8a-470d-b639-f05a8b920d2b tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:13:37.379648 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-c392e5f6-8a8a-470d-b639-f05a8b920d2b tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] [instance: b27eaab4-a751-47fb-acdb-db7c99b06a5f] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:13:37.389423 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-c392e5f6-8a8a-470d-b639-f05a8b920d2b tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:13:37.390464 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-c392e5f6-8a8a-470d-b639-f05a8b920d2b tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:13:37.391105 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-c392e5f6-8a8a-470d-b639-f05a8b920d2b tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:13:37.395840 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-c392e5f6-8a8a-470d-b639-f05a8b920d2b tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:13:37.396947 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-c392e5f6-8a8a-470d-b639-f05a8b920d2b tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:13:37.397940 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-c392e5f6-8a8a-470d-b639-f05a8b920d2b tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:13:37.404519 n-d-863052-2 devstack@n-api.service[121403]: DEBUG dbcounter [-] [121403] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=121403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 19:13:37.533988 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-94603b18-ac5c-4ae1-8964-a81297096d4a tempest-InstanceActionsTestJSON-621834551 tempest-InstanceActionsTestJSON-621834551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32430a3dff994c929c0e635b372c9f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553f439f412542e3a36c5db93d039593', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:13:37.549438 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-94603b18-ac5c-4ae1-8964-a81297096d4a tempest-InstanceActionsTestJSON-621834551 tempest-InstanceActionsTestJSON-621834551-project] 10.222.0.13 "GET /compute/v2.1/servers/922898a0-ba6d-48cc-9b0b-b3b781eddb9e" status: 200 len: 1511 microversion: 2.1 time: 0.530579 Nov 01 19:13:37.550238 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 2226/4471] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:13:37 2022] GET /compute/v2.1/servers/922898a0-ba6d-48cc-9b0b-b3b781eddb9e => generated 1511 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:13:37.876816 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-c392e5f6-8a8a-470d-b639-f05a8b920d2b tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc5c19b930543f5a5091922a9859813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ecdc83933544a899117531a960027a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:13:37.890811 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-c392e5f6-8a8a-470d-b639-f05a8b920d2b tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] 10.222.0.13 "GET /compute/v2.1/servers/b27eaab4-a751-47fb-acdb-db7c99b06a5f" status: 200 len: 1506 microversion: 2.1 time: 0.526065 Nov 01 19:13:37.891908 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 2246/4472] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:13:37 2022] GET /compute/v2.1/servers/b27eaab4-a751-47fb-acdb-db7c99b06a5f => generated 1506 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:13:37.917921 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-835f79bb-564f-43e8-bfac-15d9c12e765b tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:13:37.918421 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-835f79bb-564f-43e8-bfac-15d9c12e765b tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] [instance: b27eaab4-a751-47fb-acdb-db7c99b06a5f] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:13:37.931121 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-835f79bb-564f-43e8-bfac-15d9c12e765b tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:13:37.931810 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-835f79bb-564f-43e8-bfac-15d9c12e765b tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:13:37.932558 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-835f79bb-564f-43e8-bfac-15d9c12e765b tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:13:37.933627 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-835f79bb-564f-43e8-bfac-15d9c12e765b tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:13:37.934244 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-835f79bb-564f-43e8-bfac-15d9c12e765b tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:13:37.934680 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-835f79bb-564f-43e8-bfac-15d9c12e765b tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:13:37.970244 n-d-863052-2 devstack@n-api.service[121402]: DEBUG dbcounter [-] [121402] Writing DB stats nova_cell1:SELECT=100 {{(pid=121402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 19:13:38.029540 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-3d6134fa-785e-4bfe-ab7e-f7926f459e04 tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:13:38.030159 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-3d6134fa-785e-4bfe-ab7e-f7926f459e04 tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] [instance: cae1c729-7c41-488d-ab0e-30d1f5d22180] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:13:38.048093 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-3d6134fa-785e-4bfe-ab7e-f7926f459e04 tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:13:38.048914 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-3d6134fa-785e-4bfe-ab7e-f7926f459e04 tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:13:38.049516 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-3d6134fa-785e-4bfe-ab7e-f7926f459e04 tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:13:38.050387 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-3d6134fa-785e-4bfe-ab7e-f7926f459e04 tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:13:38.051006 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-3d6134fa-785e-4bfe-ab7e-f7926f459e04 tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:13:38.052216 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-3d6134fa-785e-4bfe-ab7e-f7926f459e04 tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:13:38.517516 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-3d6134fa-785e-4bfe-ab7e-f7926f459e04 tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcf93260eaef487dac5d7bb00b26e3b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73cb8697de6d407ba82c334d9f2b48d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:13:38.532273 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-3d6134fa-785e-4bfe-ab7e-f7926f459e04 tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] 10.222.0.13 "GET /compute/v2.1/servers/cae1c729-7c41-488d-ab0e-30d1f5d22180" status: 200 len: 1667 microversion: 2.1 time: 0.507834 Nov 01 19:13:38.566124 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 2247/4473] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:13:38 2022] GET /compute/v2.1/servers/cae1c729-7c41-488d-ab0e-30d1f5d22180 => generated 1667 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 19:13:38.573839 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [req-24cf7eea-6144-46ff-b235-5b8479794ee1 req-c327ad07-e4f9-4ebb-8d58-5ca403c2bb19 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "922898a0-ba6d-48cc-9b0b-b3b781eddb9e", "name": "network-vif-deleted", "tag": "a57481b3-53f1-44fc-9ad5-428c8f7ff813"}]} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:13:38.587746 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-24cf7eea-6144-46ff-b235-5b8479794ee1 req-c327ad07-e4f9-4ebb-8d58-5ca403c2bb19 service nova] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:13:38.588454 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-24cf7eea-6144-46ff-b235-5b8479794ee1 req-c327ad07-e4f9-4ebb-8d58-5ca403c2bb19 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:13:38.589615 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-835f79bb-564f-43e8-bfac-15d9c12e765b tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc5c19b930543f5a5091922a9859813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ecdc83933544a899117531a960027a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:13:38.592222 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-24cf7eea-6144-46ff-b235-5b8479794ee1 req-c327ad07-e4f9-4ebb-8d58-5ca403c2bb19 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:13:38.602091 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-835f79bb-564f-43e8-bfac-15d9c12e765b tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] 10.222.0.13 "GET /compute/v2.1/servers/b27eaab4-a751-47fb-acdb-db7c99b06a5f" status: 200 len: 1506 microversion: 2.1 time: 0.688115 Nov 01 19:13:38.605862 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 2227/4474] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:13:37 2022] GET /compute/v2.1/servers/b27eaab4-a751-47fb-acdb-db7c99b06a5f => generated 1506 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:13:38.617229 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-56b2a7ec-ec95-46a1-a081-40824f7bf08c tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-3-1661346037"}} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:13:38.623237 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-56b2a7ec-ec95-46a1-a081-40824f7bf08c tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] [instance: cae1c729-7c41-488d-ab0e-30d1f5d22180] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:13:38.645393 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-56b2a7ec-ec95-46a1-a081-40824f7bf08c tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:13:38.646711 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-56b2a7ec-ec95-46a1-a081-40824f7bf08c tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:13:38.648017 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-56b2a7ec-ec95-46a1-a081-40824f7bf08c tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:13:38.649042 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-56b2a7ec-ec95-46a1-a081-40824f7bf08c tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:13:38.651760 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-56b2a7ec-ec95-46a1-a081-40824f7bf08c tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:13:38.653062 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-56b2a7ec-ec95-46a1-a081-40824f7bf08c tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:13:38.671566 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.compute.server_external_events [req-24cf7eea-6144-46ff-b235-5b8479794ee1 req-c327ad07-e4f9-4ebb-8d58-5ca403c2bb19 service nova] Creating event network-vif-deleted:a57481b3-53f1-44fc-9ad5-428c8f7ff813 for instance 922898a0-ba6d-48cc-9b0b-b3b781eddb9e on n-h1-863052-2 Nov 01 19:13:38.691297 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [req-24cf7eea-6144-46ff-b235-5b8479794ee1 req-c327ad07-e4f9-4ebb-8d58-5ca403c2bb19 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.123518 Nov 01 19:13:38.697927 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 2248/4475] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Nov 1 19:13:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:13:38.722584 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-ea83f418-9090-4990-8750-cca5981fde1e tempest-InstanceActionsTestJSON-621834551 tempest-InstanceActionsTestJSON-621834551-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:13:38.724699 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-ea83f418-9090-4990-8750-cca5981fde1e tempest-InstanceActionsTestJSON-621834551 tempest-InstanceActionsTestJSON-621834551-project] [instance: 922898a0-ba6d-48cc-9b0b-b3b781eddb9e] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:13:38.746790 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-ea83f418-9090-4990-8750-cca5981fde1e tempest-InstanceActionsTestJSON-621834551 tempest-InstanceActionsTestJSON-621834551-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:13:38.753313 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-ea83f418-9090-4990-8750-cca5981fde1e tempest-InstanceActionsTestJSON-621834551 tempest-InstanceActionsTestJSON-621834551-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:13:38.753923 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-ea83f418-9090-4990-8750-cca5981fde1e tempest-InstanceActionsTestJSON-621834551 tempest-InstanceActionsTestJSON-621834551-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:13:38.756902 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-ea83f418-9090-4990-8750-cca5981fde1e tempest-InstanceActionsTestJSON-621834551 tempest-InstanceActionsTestJSON-621834551-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:13:38.757396 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-ea83f418-9090-4990-8750-cca5981fde1e tempest-InstanceActionsTestJSON-621834551 tempest-InstanceActionsTestJSON-621834551-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:13:38.757835 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-ea83f418-9090-4990-8750-cca5981fde1e tempest-InstanceActionsTestJSON-621834551 tempest-InstanceActionsTestJSON-621834551-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:13:38.886900 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-ea83f418-9090-4990-8750-cca5981fde1e tempest-InstanceActionsTestJSON-621834551 tempest-InstanceActionsTestJSON-621834551-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:13:38.889298 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-ea83f418-9090-4990-8750-cca5981fde1e tempest-InstanceActionsTestJSON-621834551 tempest-InstanceActionsTestJSON-621834551-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:13:38.890169 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-ea83f418-9090-4990-8750-cca5981fde1e tempest-InstanceActionsTestJSON-621834551 tempest-InstanceActionsTestJSON-621834551-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:13:38.892368 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.objects.instance [None req-ea83f418-9090-4990-8750-cca5981fde1e tempest-InstanceActionsTestJSON-621834551 tempest-InstanceActionsTestJSON-621834551-project] Lazy-loading 'fault' on Instance uuid 922898a0-ba6d-48cc-9b0b-b3b781eddb9e {{(pid=121403) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 01 19:13:39.051268 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-ea83f418-9090-4990-8750-cca5981fde1e tempest-InstanceActionsTestJSON-621834551 tempest-InstanceActionsTestJSON-621834551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32430a3dff994c929c0e635b372c9f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553f439f412542e3a36c5db93d039593', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:13:39.067931 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-ea83f418-9090-4990-8750-cca5981fde1e tempest-InstanceActionsTestJSON-621834551 tempest-InstanceActionsTestJSON-621834551-project] 10.222.0.13 "GET /compute/v2.1/servers/922898a0-ba6d-48cc-9b0b-b3b781eddb9e" status: 200 len: 1307 microversion: 2.1 time: 0.365778 Nov 01 19:13:39.069353 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 2249/4476] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:13:38 2022] GET /compute/v2.1/servers/922898a0-ba6d-48cc-9b0b-b3b781eddb9e => generated 1307 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:13:39.092383 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-c892dae5-885a-4223-a099-22b3ae595b3a tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Action: 'create', calling method: >, body: {"server": {"name": "", "imageRef": "2d4a0047-1b9e-445f-8af8-1b5c9d93e881", "flavorRef": "452", "networks": [{"uuid": "f2fc603f-a5ab-4120-939f-124d49e1f7c1"}]}} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:13:39.112325 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-c892dae5-885a-4223-a099-22b3ae595b3a tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Request method failure captured: Nov 01 19:13:39.112325 n-d-863052-2 devstack@n-api.service[121403]: request: POST /compute/v2.1/servers HTTP/1.1 Nov 01 19:13:39.112325 n-d-863052-2 devstack@n-api.service[121403]: Accept: application/json Nov 01 19:13:39.112325 n-d-863052-2 devstack@n-api.service[121403]: Accept-Encoding: identity Nov 01 19:13:39.112325 n-d-863052-2 devstack@n-api.service[121403]: Connection: close Nov 01 19:13:39.112325 n-d-863052-2 devstack@n-api.service[121403]: Content-Length: 160 Nov 01 19:13:39.112325 n-d-863052-2 devstack@n-api.service[121403]: Content-Type: application/json Nov 01 19:13:39.112325 n-d-863052-2 devstack@n-api.service[121403]: Host: 10.222.0.13 Nov 01 19:13:39.112325 n-d-863052-2 devstack@n-api.service[121403]: Openstack-System-Scope: None Nov 01 19:13:39.112325 n-d-863052-2 devstack@n-api.service[121403]: User-Agent: python-urllib3/1.26.12 Nov 01 19:13:39.112325 n-d-863052-2 devstack@n-api.service[121403]: X-Auth-Token: gAAAAABjYW9YFTR7hO-vK03S-3HbvOtG2z3_fji2KJH39vNHENu4xIKneeHYviQiPj9ERGiA3aZIA7DvAYzczgSZ5-vK782IQ7CYnUFXvn9Aqt1AbunNMYxhes9BKzhvODzqwzqiQq89wgC4nbpZ9jJWFWMOC4z9bcW4UMi_ylwdZFjmhWfD49s Nov 01 19:13:39.112325 n-d-863052-2 devstack@n-api.service[121403]: X-Domain-Id: None Nov 01 19:13:39.112325 n-d-863052-2 devstack@n-api.service[121403]: X-Domain-Name: None Nov 01 19:13:39.112325 n-d-863052-2 devstack@n-api.service[121403]: X-Identity-Status: Confirmed Nov 01 19:13:39.112325 n-d-863052-2 devstack@n-api.service[121403]: X-Is-Admin-Project: True Nov 01 19:13:39.112325 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Domain-Id: default Nov 01 19:13:39.112325 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Domain-Name: Default Nov 01 19:13:39.112325 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Id: 9ecdc83933544a899117531a960027a7 Nov 01 19:13:39.112325 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Name: tempest-ServersNegativeTestJSON-638944671 Nov 01 19:13:39.112325 n-d-863052-2 devstack@n-api.service[121403]: X-Role: member,reader Nov 01 19:13:39.112325 n-d-863052-2 devstack@n-api.service[121403]: X-Roles: member,reader Nov 01 19:13:39.112325 n-d-863052-2 devstack@n-api.service[121403]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/9ecdc83933544a899117531a960027a7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/9ecdc83933544a899117531a960027a7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_9ecdc83933544a899117531a960027a7", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/9ecdc83933544a899117531a960027a7"}]}] Nov 01 19:13:39.112325 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant: tempest-ServersNegativeTestJSON-638944671 Nov 01 19:13:39.112325 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant-Id: 9ecdc83933544a899117531a960027a7 Nov 01 19:13:39.112325 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant-Name: tempest-ServersNegativeTestJSON-638944671 Nov 01 19:13:39.112325 n-d-863052-2 devstack@n-api.service[121403]: X-User: tempest-ServersNegativeTestJSON-638944671-project Nov 01 19:13:39.112325 n-d-863052-2 devstack@n-api.service[121403]: X-User-Domain-Id: default Nov 01 19:13:39.112325 n-d-863052-2 devstack@n-api.service[121403]: X-User-Domain-Name: Default Nov 01 19:13:39.112325 n-d-863052-2 devstack@n-api.service[121403]: X-User-Id: 3fc5c19b930543f5a5091922a9859813 Nov 01 19:13:39.112325 n-d-863052-2 devstack@n-api.service[121403]: X-User-Name: tempest-ServersNegativeTestJSON-638944671-project Nov 01 19:13:39.112325 n-d-863052-2 devstack@n-api.service[121403]: Nov 01 19:13:39.112325 n-d-863052-2 devstack@n-api.service[121403]: {"server": {"name": "", "imageRef": "2d4a0047-1b9e-445f-8af8-1b5c9d93e881", "flavorRef": "452", "networks": [{"uuid": "f2fc603f-a5ab-4120-939f-124d49e1f7c1"}]}} Nov 01 19:13:39.112325 n-d-863052-2 devstack@n-api.service[121403]: method: > Nov 01 19:13:39.112325 n-d-863052-2 devstack@n-api.service[121403]: exception: Invalid input for field/attribute name. Value: . '' is too short Nov 01 19:13:39.112325 n-d-863052-2 devstack@n-api.service[121403]: action_args: {'body': {'server': {'name': '', 'imageRef': '2d4a0047-1b9e-445f-8af8-1b5c9d93e881', 'flavorRef': '452', 'networks': [{'uuid': 'f2fc603f-a5ab-4120-939f-124d49e1f7c1'}]}}} Nov 01 19:13:39.112325 n-d-863052-2 devstack@n-api.service[121403]: {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 01 19:13:39.112325 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:13:39.112325 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Nov 01 19:13:39.112325 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Nov 01 19:13:39.112325 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Nov 01 19:13:39.112325 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise error Nov 01 19:13:39.112325 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Nov 01 19:13:39.112325 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:13:39.112325 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['server']['properties']['name']: Nov 01 19:13:39.112325 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Nov 01 19:13:39.112325 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:13:39.112325 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi On instance['server']: Nov 01 19:13:39.112325 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi '' Nov 01 19:13:39.112325 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:13:39.112325 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:13:39.112325 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:13:39.112325 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:13:39.112325 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:13:39.112325 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:13:39.112325 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 01 19:13:39.112325 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 01 19:13:39.112325 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 01 19:13:39.112325 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 01 19:13:39.112325 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 01 19:13:39.112325 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 01 19:13:39.112325 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Nov 01 19:13:39.112325 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Nov 01 19:13:39.112325 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Nov 01 19:13:39.112325 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Nov 01 19:13:39.112325 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Nov 01 19:13:39.116803 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Nov 01 19:13:39.116803 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Nov 01 19:13:39.116803 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:13:39.116803 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:13:39.116803 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:13:39.116803 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:13:39.116803 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:13:39.116803 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:13:39.116803 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Nov 01 19:13:39.116803 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Nov 01 19:13:39.116803 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Nov 01 19:13:39.116803 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:13:39.116803 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-c892dae5-885a-4223-a099-22b3ae595b3a tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=121403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 01 19:13:39.116803 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-c892dae5-885a-4223-a099-22b3ae595b3a tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 400 len: 108 microversion: 2.1 time: 0.043478 Nov 01 19:13:39.119677 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 2250/4477] 10.222.0.13 () {60 vars in 1147 bytes} [Tue Nov 1 19:13:39 2022] POST /compute/v2.1/servers => generated 108 bytes in 48 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 01 19:13:39.145260 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-080825a0-198b-460f-9d6d-30824a140a1e tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:13:39.146969 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-080825a0-198b-460f-9d6d-30824a140a1e tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] [instance: b27eaab4-a751-47fb-acdb-db7c99b06a5f] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:13:39.164344 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-080825a0-198b-460f-9d6d-30824a140a1e tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:13:39.164898 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-080825a0-198b-460f-9d6d-30824a140a1e tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:13:39.165343 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-080825a0-198b-460f-9d6d-30824a140a1e tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:13:39.167001 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-080825a0-198b-460f-9d6d-30824a140a1e tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:13:39.167642 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-080825a0-198b-460f-9d6d-30824a140a1e tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:13:39.168272 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-080825a0-198b-460f-9d6d-30824a140a1e tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:13:39.261361 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-56b2a7ec-ec95-46a1-a081-40824f7bf08c tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] 10.222.0.13 "POST /compute/v2.1/servers/cae1c729-7c41-488d-ab0e-30d1f5d22180/action" status: 202 len: 0 microversion: 2.1 time: 0.652833 Nov 01 19:13:39.276641 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 2228/4478] 10.222.0.13 () {60 vars in 1278 bytes} [Tue Nov 1 19:13:38 2022] POST /compute/v2.1/servers/cae1c729-7c41-488d-ab0e-30d1f5d22180/action => generated 0 bytes in 669 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Nov 01 19:13:39.300176 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-5ade6b54-cafb-4497-a50b-8baaf3a9f490 tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:13:39.316194 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-5ade6b54-cafb-4497-a50b-8baaf3a9f490 tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] [instance: cae1c729-7c41-488d-ab0e-30d1f5d22180] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:13:39.328116 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-5ade6b54-cafb-4497-a50b-8baaf3a9f490 tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:13:39.329427 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-5ade6b54-cafb-4497-a50b-8baaf3a9f490 tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:13:39.330090 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-5ade6b54-cafb-4497-a50b-8baaf3a9f490 tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:13:39.331969 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-5ade6b54-cafb-4497-a50b-8baaf3a9f490 tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:13:39.332671 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-5ade6b54-cafb-4497-a50b-8baaf3a9f490 tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:13:39.333297 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-5ade6b54-cafb-4497-a50b-8baaf3a9f490 tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:13:39.825722 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-5ade6b54-cafb-4497-a50b-8baaf3a9f490 tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcf93260eaef487dac5d7bb00b26e3b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73cb8697de6d407ba82c334d9f2b48d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:13:39.839217 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-5ade6b54-cafb-4497-a50b-8baaf3a9f490 tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] 10.222.0.13 "GET /compute/v2.1/servers/cae1c729-7c41-488d-ab0e-30d1f5d22180" status: 200 len: 1677 microversion: 2.1 time: 0.557014 Nov 01 19:13:39.840502 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 2229/4479] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:13:39 2022] GET /compute/v2.1/servers/cae1c729-7c41-488d-ab0e-30d1f5d22180 => generated 1677 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:13:39.893968 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-080825a0-198b-460f-9d6d-30824a140a1e tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc5c19b930543f5a5091922a9859813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ecdc83933544a899117531a960027a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:13:39.906033 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-080825a0-198b-460f-9d6d-30824a140a1e tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] 10.222.0.13 "GET /compute/v2.1/servers/b27eaab4-a751-47fb-acdb-db7c99b06a5f" status: 200 len: 1506 microversion: 2.1 time: 0.779135 Nov 01 19:13:39.917745 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 2251/4480] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:13:39 2022] GET /compute/v2.1/servers/b27eaab4-a751-47fb-acdb-db7c99b06a5f => generated 1506 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:13:39.935077 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-4a7b2a10-2d83-4b80-88a6-7752a4eecc07 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:13:39.936214 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-4a7b2a10-2d83-4b80-88a6-7752a4eecc07 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] [instance: b27eaab4-a751-47fb-acdb-db7c99b06a5f] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:13:39.942678 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-4a7b2a10-2d83-4b80-88a6-7752a4eecc07 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:13:39.943503 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-4a7b2a10-2d83-4b80-88a6-7752a4eecc07 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:13:39.944153 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-4a7b2a10-2d83-4b80-88a6-7752a4eecc07 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:13:39.945119 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-4a7b2a10-2d83-4b80-88a6-7752a4eecc07 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:13:39.945782 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-4a7b2a10-2d83-4b80-88a6-7752a4eecc07 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:13:39.946518 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-4a7b2a10-2d83-4b80-88a6-7752a4eecc07 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:13:40.091276 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-c8886cf4-82a8-463d-a1f3-87651993e12e tempest-InstanceActionsTestJSON-621834551 tempest-InstanceActionsTestJSON-621834551-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:13:40.091891 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-c8886cf4-82a8-463d-a1f3-87651993e12e tempest-InstanceActionsTestJSON-621834551 tempest-InstanceActionsTestJSON-621834551-project] [instance: 922898a0-ba6d-48cc-9b0b-b3b781eddb9e] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:13:40.108693 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-c8886cf4-82a8-463d-a1f3-87651993e12e tempest-InstanceActionsTestJSON-621834551 tempest-InstanceActionsTestJSON-621834551-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:13:40.109567 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-c8886cf4-82a8-463d-a1f3-87651993e12e tempest-InstanceActionsTestJSON-621834551 tempest-InstanceActionsTestJSON-621834551-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:13:40.110247 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-c8886cf4-82a8-463d-a1f3-87651993e12e tempest-InstanceActionsTestJSON-621834551 tempest-InstanceActionsTestJSON-621834551-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:13:40.113076 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-c8886cf4-82a8-463d-a1f3-87651993e12e tempest-InstanceActionsTestJSON-621834551 tempest-InstanceActionsTestJSON-621834551-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:13:40.113786 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-c8886cf4-82a8-463d-a1f3-87651993e12e tempest-InstanceActionsTestJSON-621834551 tempest-InstanceActionsTestJSON-621834551-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:13:40.114457 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-c8886cf4-82a8-463d-a1f3-87651993e12e tempest-InstanceActionsTestJSON-621834551 tempest-InstanceActionsTestJSON-621834551-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:13:40.138419 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.wsgi [None req-c8886cf4-82a8-463d-a1f3-87651993e12e tempest-InstanceActionsTestJSON-621834551 tempest-InstanceActionsTestJSON-621834551-project] HTTP exception thrown: Instance 922898a0-ba6d-48cc-9b0b-b3b781eddb9e could not be found. Nov 01 19:13:40.140567 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-c8886cf4-82a8-463d-a1f3-87651993e12e tempest-InstanceActionsTestJSON-621834551 tempest-InstanceActionsTestJSON-621834551-project] Request method failure captured: Nov 01 19:13:40.140567 n-d-863052-2 devstack@n-api.service[121403]: request: GET /compute/v2.1/servers/922898a0-ba6d-48cc-9b0b-b3b781eddb9e HTTP/1.1 Nov 01 19:13:40.140567 n-d-863052-2 devstack@n-api.service[121403]: Accept: application/json Nov 01 19:13:40.140567 n-d-863052-2 devstack@n-api.service[121403]: Accept-Encoding: identity Nov 01 19:13:40.140567 n-d-863052-2 devstack@n-api.service[121403]: Connection: close Nov 01 19:13:40.140567 n-d-863052-2 devstack@n-api.service[121403]: Content-Length: 0 Nov 01 19:13:40.140567 n-d-863052-2 devstack@n-api.service[121403]: Content-Type: application/json Nov 01 19:13:40.140567 n-d-863052-2 devstack@n-api.service[121403]: Host: 10.222.0.13 Nov 01 19:13:40.140567 n-d-863052-2 devstack@n-api.service[121403]: Openstack-System-Scope: None Nov 01 19:13:40.140567 n-d-863052-2 devstack@n-api.service[121403]: User-Agent: python-urllib3/1.26.12 Nov 01 19:13:40.140567 n-d-863052-2 devstack@n-api.service[121403]: X-Auth-Token: gAAAAABjYW_Doq2iMwFSpcQQ95O0yRPXIg7JRz2Zc5wYruFMwnnfDQs2OL3HxsEEtyK_gYI_Fn2qoNIdud_D7OXW7er1OcfmAXaEVkYWs8OU3_QJlXxRs6PalLt80VxIcaJMIMJIcUAPBnCl0cusTvxgmX5wkU_wIorcz0yd1qx6zdtcMroeUTE Nov 01 19:13:40.140567 n-d-863052-2 devstack@n-api.service[121403]: X-Domain-Id: None Nov 01 19:13:40.140567 n-d-863052-2 devstack@n-api.service[121403]: X-Domain-Name: None Nov 01 19:13:40.140567 n-d-863052-2 devstack@n-api.service[121403]: X-Identity-Status: Confirmed Nov 01 19:13:40.140567 n-d-863052-2 devstack@n-api.service[121403]: X-Is-Admin-Project: True Nov 01 19:13:40.140567 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Domain-Id: default Nov 01 19:13:40.140567 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Domain-Name: Default Nov 01 19:13:40.140567 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Id: 553f439f412542e3a36c5db93d039593 Nov 01 19:13:40.140567 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Name: tempest-InstanceActionsTestJSON-621834551 Nov 01 19:13:40.140567 n-d-863052-2 devstack@n-api.service[121403]: X-Role: member,reader Nov 01 19:13:40.140567 n-d-863052-2 devstack@n-api.service[121403]: X-Roles: member,reader Nov 01 19:13:40.140567 n-d-863052-2 devstack@n-api.service[121403]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/553f439f412542e3a36c5db93d039593"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/553f439f412542e3a36c5db93d039593"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_553f439f412542e3a36c5db93d039593", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/553f439f412542e3a36c5db93d039593"}]}] Nov 01 19:13:40.140567 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant: tempest-InstanceActionsTestJSON-621834551 Nov 01 19:13:40.140567 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant-Id: 553f439f412542e3a36c5db93d039593 Nov 01 19:13:40.140567 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant-Name: tempest-InstanceActionsTestJSON-621834551 Nov 01 19:13:40.140567 n-d-863052-2 devstack@n-api.service[121403]: X-User: tempest-InstanceActionsTestJSON-621834551-project Nov 01 19:13:40.140567 n-d-863052-2 devstack@n-api.service[121403]: X-User-Domain-Id: default Nov 01 19:13:40.140567 n-d-863052-2 devstack@n-api.service[121403]: X-User-Domain-Name: Default Nov 01 19:13:40.140567 n-d-863052-2 devstack@n-api.service[121403]: X-User-Id: 32430a3dff994c929c0e635b372c9f86 Nov 01 19:13:40.140567 n-d-863052-2 devstack@n-api.service[121403]: X-User-Name: tempest-InstanceActionsTestJSON-621834551-project Nov 01 19:13:40.140567 n-d-863052-2 devstack@n-api.service[121403]: method: > Nov 01 19:13:40.140567 n-d-863052-2 devstack@n-api.service[121403]: exception: Instance 922898a0-ba6d-48cc-9b0b-b3b781eddb9e could not be found. Nov 01 19:13:40.140567 n-d-863052-2 devstack@n-api.service[121403]: action_args: {'id': '922898a0-ba6d-48cc-9b0b-b3b781eddb9e'} Nov 01 19:13:40.140567 n-d-863052-2 devstack@n-api.service[121403]: {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 01 19:13:40.140567 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:13:40.140567 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 01 19:13:40.140567 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 01 19:13:40.140567 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 01 19:13:40.140567 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 01 19:13:40.140567 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 01 19:13:40.140567 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 01 19:13:40.140567 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 01 19:13:40.140567 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 01 19:13:40.140567 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 922898a0-ba6d-48cc-9b0b-b3b781eddb9e could not be found. Nov 01 19:13:40.140567 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:13:40.140567 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:13:40.140567 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:13:40.140567 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:13:40.140567 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:13:40.140567 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:13:40.140567 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 01 19:13:40.140567 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 01 19:13:40.140567 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 01 19:13:40.140567 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 01 19:13:40.140567 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 01 19:13:40.140567 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 01 19:13:40.140567 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 01 19:13:40.140567 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 01 19:13:40.140567 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 01 19:13:40.140567 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 01 19:13:40.140567 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 922898a0-ba6d-48cc-9b0b-b3b781eddb9e could not be found. Nov 01 19:13:40.140567 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:13:40.140567 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:13:40.140567 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:13:40.144413 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:13:40.144413 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:13:40.144413 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:13:40.144413 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 01 19:13:40.144413 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 01 19:13:40.144413 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 922898a0-ba6d-48cc-9b0b-b3b781eddb9e could not be found. Nov 01 19:13:40.144413 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:13:40.144413 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-c8886cf4-82a8-463d-a1f3-87651993e12e tempest-InstanceActionsTestJSON-621834551 tempest-InstanceActionsTestJSON-621834551-project] Returning 404 to user: Instance 922898a0-ba6d-48cc-9b0b-b3b781eddb9e could not be found. {{(pid=121403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 01 19:13:40.144911 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-c8886cf4-82a8-463d-a1f3-87651993e12e tempest-InstanceActionsTestJSON-621834551 tempest-InstanceActionsTestJSON-621834551-project] 10.222.0.13 "GET /compute/v2.1/servers/922898a0-ba6d-48cc-9b0b-b3b781eddb9e" status: 404 len: 111 microversion: 2.1 time: 0.057236 Nov 01 19:13:40.151180 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 2252/4481] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:13:40 2022] GET /compute/v2.1/servers/922898a0-ba6d-48cc-9b0b-b3b781eddb9e => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 01 19:13:40.467026 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-4a7b2a10-2d83-4b80-88a6-7752a4eecc07 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc5c19b930543f5a5091922a9859813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ecdc83933544a899117531a960027a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:13:40.478729 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-4a7b2a10-2d83-4b80-88a6-7752a4eecc07 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] 10.222.0.13 "GET /compute/v2.1/servers/b27eaab4-a751-47fb-acdb-db7c99b06a5f" status: 200 len: 1506 microversion: 2.1 time: 0.548333 Nov 01 19:13:40.479975 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 2230/4482] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:13:39 2022] GET /compute/v2.1/servers/b27eaab4-a751-47fb-acdb-db7c99b06a5f => generated 1506 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:13:40.506532 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-1595dbca-1b81-4454-9234-fab8f9653ae3 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:13:40.507578 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-1595dbca-1b81-4454-9234-fab8f9653ae3 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] [instance: 134ffdb5-6364-41e7-b839-97a77ec4e384] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:13:40.516624 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.wsgi [None req-1595dbca-1b81-4454-9234-fab8f9653ae3 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] HTTP exception thrown: Instance 134ffdb5-6364-41e7-b839-97a77ec4e384 could not be found. Nov 01 19:13:40.523946 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-1595dbca-1b81-4454-9234-fab8f9653ae3 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Request method failure captured: Nov 01 19:13:40.523946 n-d-863052-2 devstack@n-api.service[121403]: request: POST /compute/v2.1/servers/134ffdb5-6364-41e7-b839-97a77ec4e384/action HTTP/1.1 Nov 01 19:13:40.523946 n-d-863052-2 devstack@n-api.service[121403]: Accept: application/json Nov 01 19:13:40.523946 n-d-863052-2 devstack@n-api.service[121403]: Accept-Encoding: identity Nov 01 19:13:40.523946 n-d-863052-2 devstack@n-api.service[121403]: Connection: close Nov 01 19:13:40.523946 n-d-863052-2 devstack@n-api.service[121403]: Content-Length: 14 Nov 01 19:13:40.523946 n-d-863052-2 devstack@n-api.service[121403]: Content-Type: application/json Nov 01 19:13:40.523946 n-d-863052-2 devstack@n-api.service[121403]: Host: 10.222.0.13 Nov 01 19:13:40.523946 n-d-863052-2 devstack@n-api.service[121403]: Openstack-System-Scope: None Nov 01 19:13:40.523946 n-d-863052-2 devstack@n-api.service[121403]: User-Agent: python-urllib3/1.26.12 Nov 01 19:13:40.523946 n-d-863052-2 devstack@n-api.service[121403]: X-Auth-Token: gAAAAABjYW9YFTR7hO-vK03S-3HbvOtG2z3_fji2KJH39vNHENu4xIKneeHYviQiPj9ERGiA3aZIA7DvAYzczgSZ5-vK782IQ7CYnUFXvn9Aqt1AbunNMYxhes9BKzhvODzqwzqiQq89wgC4nbpZ9jJWFWMOC4z9bcW4UMi_ylwdZFjmhWfD49s Nov 01 19:13:40.523946 n-d-863052-2 devstack@n-api.service[121403]: X-Domain-Id: None Nov 01 19:13:40.523946 n-d-863052-2 devstack@n-api.service[121403]: X-Domain-Name: None Nov 01 19:13:40.523946 n-d-863052-2 devstack@n-api.service[121403]: X-Identity-Status: Confirmed Nov 01 19:13:40.523946 n-d-863052-2 devstack@n-api.service[121403]: X-Is-Admin-Project: True Nov 01 19:13:40.523946 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Domain-Id: default Nov 01 19:13:40.523946 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Domain-Name: Default Nov 01 19:13:40.523946 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Id: 9ecdc83933544a899117531a960027a7 Nov 01 19:13:40.523946 n-d-863052-2 devstack@n-api.service[121403]: X-Project-Name: tempest-ServersNegativeTestJSON-638944671 Nov 01 19:13:40.523946 n-d-863052-2 devstack@n-api.service[121403]: X-Role: member,reader Nov 01 19:13:40.523946 n-d-863052-2 devstack@n-api.service[121403]: X-Roles: member,reader Nov 01 19:13:40.523946 n-d-863052-2 devstack@n-api.service[121403]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/9ecdc83933544a899117531a960027a7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/9ecdc83933544a899117531a960027a7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_9ecdc83933544a899117531a960027a7", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/9ecdc83933544a899117531a960027a7"}]}] Nov 01 19:13:40.523946 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant: tempest-ServersNegativeTestJSON-638944671 Nov 01 19:13:40.523946 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant-Id: 9ecdc83933544a899117531a960027a7 Nov 01 19:13:40.523946 n-d-863052-2 devstack@n-api.service[121403]: X-Tenant-Name: tempest-ServersNegativeTestJSON-638944671 Nov 01 19:13:40.523946 n-d-863052-2 devstack@n-api.service[121403]: X-User: tempest-ServersNegativeTestJSON-638944671-project Nov 01 19:13:40.523946 n-d-863052-2 devstack@n-api.service[121403]: X-User-Domain-Id: default Nov 01 19:13:40.523946 n-d-863052-2 devstack@n-api.service[121403]: X-User-Domain-Name: Default Nov 01 19:13:40.523946 n-d-863052-2 devstack@n-api.service[121403]: X-User-Id: 3fc5c19b930543f5a5091922a9859813 Nov 01 19:13:40.523946 n-d-863052-2 devstack@n-api.service[121403]: X-User-Name: tempest-ServersNegativeTestJSON-638944671-project Nov 01 19:13:40.523946 n-d-863052-2 devstack@n-api.service[121403]: Nov 01 19:13:40.523946 n-d-863052-2 devstack@n-api.service[121403]: {"shelve": {}} Nov 01 19:13:40.523946 n-d-863052-2 devstack@n-api.service[121403]: method: > Nov 01 19:13:40.523946 n-d-863052-2 devstack@n-api.service[121403]: exception: Instance 134ffdb5-6364-41e7-b839-97a77ec4e384 could not be found. Nov 01 19:13:40.523946 n-d-863052-2 devstack@n-api.service[121403]: action_args: {'id': '134ffdb5-6364-41e7-b839-97a77ec4e384', 'body': {'shelve': {}}} Nov 01 19:13:40.523946 n-d-863052-2 devstack@n-api.service[121403]: {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 01 19:13:40.523946 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:13:40.523946 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 01 19:13:40.523946 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 01 19:13:40.523946 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 01 19:13:40.523946 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 01 19:13:40.523946 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Nov 01 19:13:40.523946 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Nov 01 19:13:40.523946 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 134ffdb5-6364-41e7-b839-97a77ec4e384 could not be found. Nov 01 19:13:40.523946 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:13:40.523946 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:13:40.523946 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:13:40.523946 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:13:40.523946 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:13:40.523946 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:13:40.523946 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 01 19:13:40.523946 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 01 19:13:40.523946 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 01 19:13:40.523946 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 01 19:13:40.523946 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 44, in _shelve Nov 01 19:13:40.523946 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Nov 01 19:13:40.523946 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 01 19:13:40.523946 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 01 19:13:40.523946 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 134ffdb5-6364-41e7-b839-97a77ec4e384 could not be found. Nov 01 19:13:40.523946 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:13:40.523946 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:13:40.523946 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:13:40.523946 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:13:40.523946 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:13:40.523946 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:13:40.528326 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 01 19:13:40.528326 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 01 19:13:40.528326 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 134ffdb5-6364-41e7-b839-97a77ec4e384 could not be found. Nov 01 19:13:40.528326 n-d-863052-2 devstack@n-api.service[121403]: ERROR nova.api.openstack.wsgi Nov 01 19:13:40.528326 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-1595dbca-1b81-4454-9234-fab8f9653ae3 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Returning 404 to user: Instance 134ffdb5-6364-41e7-b839-97a77ec4e384 could not be found. {{(pid=121403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 01 19:13:40.528326 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-1595dbca-1b81-4454-9234-fab8f9653ae3 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] 10.222.0.13 "POST /compute/v2.1/servers/134ffdb5-6364-41e7-b839-97a77ec4e384/action" status: 404 len: 111 microversion: 2.1 time: 0.024060 Nov 01 19:13:40.528326 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 2253/4483] 10.222.0.13 () {60 vars in 1278 bytes} [Tue Nov 1 19:13:40 2022] POST /compute/v2.1/servers/134ffdb5-6364-41e7-b839-97a77ec4e384/action => generated 111 bytes in 26 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 01 19:13:40.538064 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-5b6e64b1-17d0-431d-a522-6e77081cc1cb tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:13:40.538827 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-5b6e64b1-17d0-431d-a522-6e77081cc1cb tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] [instance: b27eaab4-a751-47fb-acdb-db7c99b06a5f] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:13:40.553611 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-5b6e64b1-17d0-431d-a522-6e77081cc1cb tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:13:40.554633 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-5b6e64b1-17d0-431d-a522-6e77081cc1cb tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:13:40.555963 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-5b6e64b1-17d0-431d-a522-6e77081cc1cb tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:13:40.557192 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-5b6e64b1-17d0-431d-a522-6e77081cc1cb tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:13:40.557880 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-5b6e64b1-17d0-431d-a522-6e77081cc1cb tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:13:40.558459 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-5b6e64b1-17d0-431d-a522-6e77081cc1cb tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:13:40.654171 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [req-edbb3f8c-b525-46bb-8a4d-5fb069c7fd3b req-9400497b-a2ba-42fa-a6fd-c3ead4d02532 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cae1c729-7c41-488d-ab0e-30d1f5d22180", "name": "network-vif-unplugged", "status": "completed", "tag": "3533eeb6-f9e6-47ff-ba35-f061eb6fd641"}]} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:13:40.692108 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-edbb3f8c-b525-46bb-8a4d-5fb069c7fd3b req-9400497b-a2ba-42fa-a6fd-c3ead4d02532 service nova] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:13:40.692742 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-edbb3f8c-b525-46bb-8a4d-5fb069c7fd3b req-9400497b-a2ba-42fa-a6fd-c3ead4d02532 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:13:40.693583 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-edbb3f8c-b525-46bb-8a4d-5fb069c7fd3b req-9400497b-a2ba-42fa-a6fd-c3ead4d02532 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:13:40.712961 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.compute.server_external_events [req-edbb3f8c-b525-46bb-8a4d-5fb069c7fd3b req-9400497b-a2ba-42fa-a6fd-c3ead4d02532 service nova] Creating event network-vif-unplugged:3533eeb6-f9e6-47ff-ba35-f061eb6fd641 for instance cae1c729-7c41-488d-ab0e-30d1f5d22180 on n-h1-863052-2 Nov 01 19:13:40.720707 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [req-edbb3f8c-b525-46bb-8a4d-5fb069c7fd3b req-9400497b-a2ba-42fa-a6fd-c3ead4d02532 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.074828 Nov 01 19:13:40.722156 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 2254/4484] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Nov 1 19:13:40 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 01 19:13:40.864470 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-3a9bec27-c548-41dd-886c-fe5a509a9e00 tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:13:40.865283 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-3a9bec27-c548-41dd-886c-fe5a509a9e00 tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] [instance: cae1c729-7c41-488d-ab0e-30d1f5d22180] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:13:40.884892 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-3a9bec27-c548-41dd-886c-fe5a509a9e00 tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:13:40.886416 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-3a9bec27-c548-41dd-886c-fe5a509a9e00 tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:13:40.886888 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-3a9bec27-c548-41dd-886c-fe5a509a9e00 tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:13:40.887620 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-3a9bec27-c548-41dd-886c-fe5a509a9e00 tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:13:40.888115 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-3a9bec27-c548-41dd-886c-fe5a509a9e00 tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:13:40.888547 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-3a9bec27-c548-41dd-886c-fe5a509a9e00 tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:13:41.108730 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-5b6e64b1-17d0-431d-a522-6e77081cc1cb tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc5c19b930543f5a5091922a9859813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ecdc83933544a899117531a960027a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:13:41.124129 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-5b6e64b1-17d0-431d-a522-6e77081cc1cb tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] 10.222.0.13 "GET /compute/v2.1/servers/b27eaab4-a751-47fb-acdb-db7c99b06a5f" status: 200 len: 1506 microversion: 2.1 time: 0.590706 Nov 01 19:13:41.125677 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 2231/4485] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:13:40 2022] GET /compute/v2.1/servers/b27eaab4-a751-47fb-acdb-db7c99b06a5f => generated 1506 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:13:41.165711 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-ce038363-b13b-423c-b8b9-23de5385baf0 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:13:41.170301 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-ce038363-b13b-423c-b8b9-23de5385baf0 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] [instance: b27eaab4-a751-47fb-acdb-db7c99b06a5f] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:13:41.188655 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-ce038363-b13b-423c-b8b9-23de5385baf0 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:13:41.190359 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-ce038363-b13b-423c-b8b9-23de5385baf0 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:13:41.192782 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-ce038363-b13b-423c-b8b9-23de5385baf0 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:13:41.194391 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-ce038363-b13b-423c-b8b9-23de5385baf0 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:13:41.200091 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-ce038363-b13b-423c-b8b9-23de5385baf0 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:13:41.207387 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-ce038363-b13b-423c-b8b9-23de5385baf0 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:13:41.533884 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-3a9bec27-c548-41dd-886c-fe5a509a9e00 tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcf93260eaef487dac5d7bb00b26e3b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73cb8697de6d407ba82c334d9f2b48d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:13:41.554123 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-3a9bec27-c548-41dd-886c-fe5a509a9e00 tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] 10.222.0.13 "GET /compute/v2.1/servers/cae1c729-7c41-488d-ab0e-30d1f5d22180" status: 200 len: 1685 microversion: 2.1 time: 0.693280 Nov 01 19:13:41.560167 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 2255/4486] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:13:40 2022] GET /compute/v2.1/servers/cae1c729-7c41-488d-ab0e-30d1f5d22180 => generated 1685 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:13:41.607890 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-ce038363-b13b-423c-b8b9-23de5385baf0 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc5c19b930543f5a5091922a9859813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ecdc83933544a899117531a960027a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:13:41.622871 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-ce038363-b13b-423c-b8b9-23de5385baf0 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] 10.222.0.13 "GET /compute/v2.1/servers/b27eaab4-a751-47fb-acdb-db7c99b06a5f" status: 200 len: 1506 microversion: 2.1 time: 0.467711 Nov 01 19:13:41.624209 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 2232/4487] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:13:41 2022] GET /compute/v2.1/servers/b27eaab4-a751-47fb-acdb-db7c99b06a5f => generated 1506 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:13:41.651023 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-77bba185-a262-410e-a662-9e8bea533ed8 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:13:41.651966 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-77bba185-a262-410e-a662-9e8bea533ed8 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] [instance: b27eaab4-a751-47fb-acdb-db7c99b06a5f] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:13:41.660019 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-77bba185-a262-410e-a662-9e8bea533ed8 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:13:41.663177 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-77bba185-a262-410e-a662-9e8bea533ed8 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:13:41.663935 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-77bba185-a262-410e-a662-9e8bea533ed8 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:13:41.665486 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-77bba185-a262-410e-a662-9e8bea533ed8 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:13:41.668343 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-77bba185-a262-410e-a662-9e8bea533ed8 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:13:41.669031 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-77bba185-a262-410e-a662-9e8bea533ed8 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:13:41.717782 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.objects.instance [None req-77bba185-a262-410e-a662-9e8bea533ed8 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lazy-loading 'flavor' on Instance uuid b27eaab4-a751-47fb-acdb-db7c99b06a5f {{(pid=121403) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 01 19:13:42.093363 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-77bba185-a262-410e-a662-9e8bea533ed8 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] 10.222.0.13 "POST /compute/v2.1/servers/b27eaab4-a751-47fb-acdb-db7c99b06a5f/action" status: 202 len: 0 microversion: 2.1 time: 0.446403 Nov 01 19:13:42.094611 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 2256/4488] 10.222.0.13 () {60 vars in 1278 bytes} [Tue Nov 1 19:13:41 2022] POST /compute/v2.1/servers/b27eaab4-a751-47fb-acdb-db7c99b06a5f/action => generated 0 bytes in 449 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 01 19:13:42.103351 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-c5a9db5c-1f21-43b5-99f3-0fd6c2d72a78 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:13:42.103956 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-c5a9db5c-1f21-43b5-99f3-0fd6c2d72a78 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] [instance: b27eaab4-a751-47fb-acdb-db7c99b06a5f] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:13:42.116537 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-c5a9db5c-1f21-43b5-99f3-0fd6c2d72a78 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:13:42.119117 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-c5a9db5c-1f21-43b5-99f3-0fd6c2d72a78 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:13:42.122387 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-c5a9db5c-1f21-43b5-99f3-0fd6c2d72a78 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:13:42.123436 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-c5a9db5c-1f21-43b5-99f3-0fd6c2d72a78 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:13:42.124279 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-c5a9db5c-1f21-43b5-99f3-0fd6c2d72a78 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:13:42.124840 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-c5a9db5c-1f21-43b5-99f3-0fd6c2d72a78 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:13:42.588735 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-373f62bc-1cbf-453e-8a02-38e66fc0b75a tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:13:42.590121 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-373f62bc-1cbf-453e-8a02-38e66fc0b75a tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] [instance: cae1c729-7c41-488d-ab0e-30d1f5d22180] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:13:42.615785 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-373f62bc-1cbf-453e-8a02-38e66fc0b75a tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:13:42.616950 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-373f62bc-1cbf-453e-8a02-38e66fc0b75a tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:13:42.618332 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-373f62bc-1cbf-453e-8a02-38e66fc0b75a tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:13:42.620998 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-373f62bc-1cbf-453e-8a02-38e66fc0b75a tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:13:42.627859 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-373f62bc-1cbf-453e-8a02-38e66fc0b75a tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:13:42.631695 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-373f62bc-1cbf-453e-8a02-38e66fc0b75a tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:13:43.038870 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-373f62bc-1cbf-453e-8a02-38e66fc0b75a tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcf93260eaef487dac5d7bb00b26e3b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73cb8697de6d407ba82c334d9f2b48d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:13:43.050759 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-c5a9db5c-1f21-43b5-99f3-0fd6c2d72a78 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc5c19b930543f5a5091922a9859813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ecdc83933544a899117531a960027a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:13:43.084769 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-373f62bc-1cbf-453e-8a02-38e66fc0b75a tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] 10.222.0.13 "GET /compute/v2.1/servers/cae1c729-7c41-488d-ab0e-30d1f5d22180" status: 200 len: 1685 microversion: 2.1 time: 0.485790 Nov 01 19:13:43.086229 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-c5a9db5c-1f21-43b5-99f3-0fd6c2d72a78 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] 10.222.0.13 "GET /compute/v2.1/servers/b27eaab4-a751-47fb-acdb-db7c99b06a5f" status: 200 len: 1512 microversion: 2.1 time: 0.968402 Nov 01 19:13:43.090785 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 2233/4489] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:13:42 2022] GET /compute/v2.1/servers/b27eaab4-a751-47fb-acdb-db7c99b06a5f => generated 1512 bytes in 992 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:13:43.091824 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 2257/4490] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:13:42 2022] GET /compute/v2.1/servers/cae1c729-7c41-488d-ab0e-30d1f5d22180 => generated 1685 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 19:13:44.124212 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-1525d9a0-cf0c-4798-a3eb-83548cd4cc5a tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:13:44.125168 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-77275c82-dac2-4461-a053-caa88ba43e4b tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:13:44.126412 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-77275c82-dac2-4461-a053-caa88ba43e4b tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] [instance: b27eaab4-a751-47fb-acdb-db7c99b06a5f] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:13:44.126970 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-1525d9a0-cf0c-4798-a3eb-83548cd4cc5a tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] [instance: cae1c729-7c41-488d-ab0e-30d1f5d22180] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:13:44.146047 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-1525d9a0-cf0c-4798-a3eb-83548cd4cc5a tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:13:44.146545 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-1525d9a0-cf0c-4798-a3eb-83548cd4cc5a tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:13:44.146987 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-1525d9a0-cf0c-4798-a3eb-83548cd4cc5a tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:13:44.147702 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-1525d9a0-cf0c-4798-a3eb-83548cd4cc5a tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:13:44.147808 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-77275c82-dac2-4461-a053-caa88ba43e4b tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:13:44.148243 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-1525d9a0-cf0c-4798-a3eb-83548cd4cc5a tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:13:44.148390 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-77275c82-dac2-4461-a053-caa88ba43e4b tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:13:44.148632 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-1525d9a0-cf0c-4798-a3eb-83548cd4cc5a tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:13:44.148736 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-77275c82-dac2-4461-a053-caa88ba43e4b tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:13:44.149441 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-77275c82-dac2-4461-a053-caa88ba43e4b tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:13:44.155489 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-77275c82-dac2-4461-a053-caa88ba43e4b tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:13:44.159218 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-77275c82-dac2-4461-a053-caa88ba43e4b tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:13:44.633074 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-77275c82-dac2-4461-a053-caa88ba43e4b tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc5c19b930543f5a5091922a9859813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ecdc83933544a899117531a960027a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:13:44.635586 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-77275c82-dac2-4461-a053-caa88ba43e4b tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] 10.222.0.13 "GET /compute/v2.1/servers/b27eaab4-a751-47fb-acdb-db7c99b06a5f" status: 200 len: 1512 microversion: 2.1 time: 0.520757 Nov 01 19:13:44.639603 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 2234/4491] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:13:44 2022] GET /compute/v2.1/servers/b27eaab4-a751-47fb-acdb-db7c99b06a5f => generated 1512 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:13:45.245321 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-1525d9a0-cf0c-4798-a3eb-83548cd4cc5a tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcf93260eaef487dac5d7bb00b26e3b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73cb8697de6d407ba82c334d9f2b48d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:13:45.259554 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-1525d9a0-cf0c-4798-a3eb-83548cd4cc5a tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] 10.222.0.13 "GET /compute/v2.1/servers/cae1c729-7c41-488d-ab0e-30d1f5d22180" status: 200 len: 1680 microversion: 2.1 time: 1.146960 Nov 01 19:13:45.260204 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 2258/4492] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:13:44 2022] GET /compute/v2.1/servers/cae1c729-7c41-488d-ab0e-30d1f5d22180 => generated 1680 bytes in 1148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:13:45.666943 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-10ee462b-a8a8-455f-bc0e-be9d678dbdab tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:13:45.668274 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-10ee462b-a8a8-455f-bc0e-be9d678dbdab tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] [instance: b27eaab4-a751-47fb-acdb-db7c99b06a5f] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:13:45.681195 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-10ee462b-a8a8-455f-bc0e-be9d678dbdab tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:13:45.692960 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-10ee462b-a8a8-455f-bc0e-be9d678dbdab tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:13:45.696833 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-10ee462b-a8a8-455f-bc0e-be9d678dbdab tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:13:45.702621 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-10ee462b-a8a8-455f-bc0e-be9d678dbdab tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:13:45.706980 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-10ee462b-a8a8-455f-bc0e-be9d678dbdab tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:13:45.708711 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-10ee462b-a8a8-455f-bc0e-be9d678dbdab tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:13:45.964818 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [req-67b59dd4-2a71-43b1-bacb-08f6f6ad1a10 req-310f40e0-a13e-4fa5-bc3d-ce515b04292a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cae1c729-7c41-488d-ab0e-30d1f5d22180", "name": "network-vif-plugged", "status": "completed", "tag": "3533eeb6-f9e6-47ff-ba35-f061eb6fd641"}]} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:13:46.003321 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-67b59dd4-2a71-43b1-bacb-08f6f6ad1a10 req-310f40e0-a13e-4fa5-bc3d-ce515b04292a service nova] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:13:46.003806 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-67b59dd4-2a71-43b1-bacb-08f6f6ad1a10 req-310f40e0-a13e-4fa5-bc3d-ce515b04292a service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:13:46.004423 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-67b59dd4-2a71-43b1-bacb-08f6f6ad1a10 req-310f40e0-a13e-4fa5-bc3d-ce515b04292a service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:13:46.049130 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.compute.server_external_events [req-67b59dd4-2a71-43b1-bacb-08f6f6ad1a10 req-310f40e0-a13e-4fa5-bc3d-ce515b04292a service nova] Creating event network-vif-plugged:3533eeb6-f9e6-47ff-ba35-f061eb6fd641 for instance cae1c729-7c41-488d-ab0e-30d1f5d22180 on n-h1-863052-2 Nov 01 19:13:46.068558 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [req-67b59dd4-2a71-43b1-bacb-08f6f6ad1a10 req-310f40e0-a13e-4fa5-bc3d-ce515b04292a service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107341 Nov 01 19:13:46.071077 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 2259/4493] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Nov 1 19:13:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 01 19:13:46.290839 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-8b3bc8df-9520-4808-a4e6-6167c9f31a85 tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:13:46.292098 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-8b3bc8df-9520-4808-a4e6-6167c9f31a85 tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] [instance: cae1c729-7c41-488d-ab0e-30d1f5d22180] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:13:46.315839 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-8b3bc8df-9520-4808-a4e6-6167c9f31a85 tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:13:46.323503 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-8b3bc8df-9520-4808-a4e6-6167c9f31a85 tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:13:46.323903 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-8b3bc8df-9520-4808-a4e6-6167c9f31a85 tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:13:46.324670 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-8b3bc8df-9520-4808-a4e6-6167c9f31a85 tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:13:46.325142 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-8b3bc8df-9520-4808-a4e6-6167c9f31a85 tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:13:46.325596 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-8b3bc8df-9520-4808-a4e6-6167c9f31a85 tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:13:47.071467 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-10ee462b-a8a8-455f-bc0e-be9d678dbdab tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc5c19b930543f5a5091922a9859813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ecdc83933544a899117531a960027a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:13:47.085373 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-10ee462b-a8a8-455f-bc0e-be9d678dbdab tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] 10.222.0.13 "GET /compute/v2.1/servers/b27eaab4-a751-47fb-acdb-db7c99b06a5f" status: 200 len: 1512 microversion: 2.1 time: 1.422745 Nov 01 19:13:47.103270 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 2235/4494] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:13:45 2022] GET /compute/v2.1/servers/b27eaab4-a751-47fb-acdb-db7c99b06a5f => generated 1512 bytes in 1427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:13:47.511200 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-8b3bc8df-9520-4808-a4e6-6167c9f31a85 tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcf93260eaef487dac5d7bb00b26e3b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73cb8697de6d407ba82c334d9f2b48d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:13:47.529902 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-8b3bc8df-9520-4808-a4e6-6167c9f31a85 tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] 10.222.0.13 "GET /compute/v2.1/servers/cae1c729-7c41-488d-ab0e-30d1f5d22180" status: 200 len: 1680 microversion: 2.1 time: 1.236948 Nov 01 19:13:47.534531 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 2260/4495] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:13:46 2022] GET /compute/v2.1/servers/cae1c729-7c41-488d-ab0e-30d1f5d22180 => generated 1680 bytes in 1250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:13:48.117050 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-42d302d5-ec94-444e-b908-8b4dadaacf81 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:13:48.119217 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-42d302d5-ec94-444e-b908-8b4dadaacf81 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] [instance: b27eaab4-a751-47fb-acdb-db7c99b06a5f] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:13:48.134704 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-42d302d5-ec94-444e-b908-8b4dadaacf81 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:13:48.136122 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-42d302d5-ec94-444e-b908-8b4dadaacf81 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:13:48.140694 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-42d302d5-ec94-444e-b908-8b4dadaacf81 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:13:48.141694 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-42d302d5-ec94-444e-b908-8b4dadaacf81 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:13:48.144005 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-42d302d5-ec94-444e-b908-8b4dadaacf81 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:13:48.144668 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-42d302d5-ec94-444e-b908-8b4dadaacf81 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:13:48.569460 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-961fa8f8-c24e-491f-b87d-52fce90ff96b tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:13:48.571294 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-961fa8f8-c24e-491f-b87d-52fce90ff96b tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] [instance: cae1c729-7c41-488d-ab0e-30d1f5d22180] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:13:48.586627 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-961fa8f8-c24e-491f-b87d-52fce90ff96b tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:13:48.587664 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-961fa8f8-c24e-491f-b87d-52fce90ff96b tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:13:48.588909 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-961fa8f8-c24e-491f-b87d-52fce90ff96b tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:13:48.589858 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-961fa8f8-c24e-491f-b87d-52fce90ff96b tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:13:48.590544 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-961fa8f8-c24e-491f-b87d-52fce90ff96b tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:13:48.591181 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-961fa8f8-c24e-491f-b87d-52fce90ff96b tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:13:48.837697 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-42d302d5-ec94-444e-b908-8b4dadaacf81 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc5c19b930543f5a5091922a9859813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ecdc83933544a899117531a960027a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:13:48.859359 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-42d302d5-ec94-444e-b908-8b4dadaacf81 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] 10.222.0.13 "GET /compute/v2.1/servers/b27eaab4-a751-47fb-acdb-db7c99b06a5f" status: 200 len: 1512 microversion: 2.1 time: 0.747711 Nov 01 19:13:48.881883 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 2236/4496] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:13:48 2022] GET /compute/v2.1/servers/b27eaab4-a751-47fb-acdb-db7c99b06a5f => generated 1512 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:13:49.894335 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-cd5f3940-6234-437e-8a07-bf302eb1b0ab tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:13:49.894963 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-cd5f3940-6234-437e-8a07-bf302eb1b0ab tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] [instance: b27eaab4-a751-47fb-acdb-db7c99b06a5f] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:13:49.910459 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-cd5f3940-6234-437e-8a07-bf302eb1b0ab tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:13:49.911420 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-cd5f3940-6234-437e-8a07-bf302eb1b0ab tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:13:49.912096 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-cd5f3940-6234-437e-8a07-bf302eb1b0ab tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:13:49.913009 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-cd5f3940-6234-437e-8a07-bf302eb1b0ab tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:13:49.913632 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-cd5f3940-6234-437e-8a07-bf302eb1b0ab tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:13:49.914222 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-cd5f3940-6234-437e-8a07-bf302eb1b0ab tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:13:50.311397 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-961fa8f8-c24e-491f-b87d-52fce90ff96b tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcf93260eaef487dac5d7bb00b26e3b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73cb8697de6d407ba82c334d9f2b48d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:13:50.319241 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-961fa8f8-c24e-491f-b87d-52fce90ff96b tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] 10.222.0.13 "GET /compute/v2.1/servers/cae1c729-7c41-488d-ab0e-30d1f5d22180" status: 200 len: 1680 microversion: 2.1 time: 1.756910 Nov 01 19:13:50.319830 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 2261/4497] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:13:48 2022] GET /compute/v2.1/servers/cae1c729-7c41-488d-ab0e-30d1f5d22180 => generated 1680 bytes in 1758 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:13:51.343473 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-7e51eb4c-d675-4f3c-9ad0-131eaebf048f tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:13:51.344163 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-7e51eb4c-d675-4f3c-9ad0-131eaebf048f tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] [instance: cae1c729-7c41-488d-ab0e-30d1f5d22180] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:13:51.356745 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-7e51eb4c-d675-4f3c-9ad0-131eaebf048f tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:13:51.357215 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-7e51eb4c-d675-4f3c-9ad0-131eaebf048f tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:13:51.357659 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-7e51eb4c-d675-4f3c-9ad0-131eaebf048f tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:13:51.358411 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-7e51eb4c-d675-4f3c-9ad0-131eaebf048f tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:13:51.358816 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-7e51eb4c-d675-4f3c-9ad0-131eaebf048f tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:13:51.359246 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-7e51eb4c-d675-4f3c-9ad0-131eaebf048f tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:13:51.483297 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-cd5f3940-6234-437e-8a07-bf302eb1b0ab tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc5c19b930543f5a5091922a9859813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ecdc83933544a899117531a960027a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:13:51.502026 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-cd5f3940-6234-437e-8a07-bf302eb1b0ab tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] 10.222.0.13 "GET /compute/v2.1/servers/b27eaab4-a751-47fb-acdb-db7c99b06a5f" status: 200 len: 1512 microversion: 2.1 time: 1.611469 Nov 01 19:13:51.505667 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 2237/4498] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:13:49 2022] GET /compute/v2.1/servers/b27eaab4-a751-47fb-acdb-db7c99b06a5f => generated 1512 bytes in 1616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 19:13:51.942598 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-7e51eb4c-d675-4f3c-9ad0-131eaebf048f tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcf93260eaef487dac5d7bb00b26e3b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73cb8697de6d407ba82c334d9f2b48d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:13:51.984115 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-7e51eb4c-d675-4f3c-9ad0-131eaebf048f tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] 10.222.0.13 "GET /compute/v2.1/servers/cae1c729-7c41-488d-ab0e-30d1f5d22180" status: 200 len: 1680 microversion: 2.1 time: 0.643310 Nov 01 19:13:51.985332 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 2262/4499] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:13:51 2022] GET /compute/v2.1/servers/cae1c729-7c41-488d-ab0e-30d1f5d22180 => generated 1680 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:13:52.528967 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-2f2f1972-0e9f-4005-8b11-019fba85aa49 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:13:52.529640 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-2f2f1972-0e9f-4005-8b11-019fba85aa49 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] [instance: b27eaab4-a751-47fb-acdb-db7c99b06a5f] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:13:52.546075 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-2f2f1972-0e9f-4005-8b11-019fba85aa49 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:13:52.546551 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-2f2f1972-0e9f-4005-8b11-019fba85aa49 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:13:52.546988 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-2f2f1972-0e9f-4005-8b11-019fba85aa49 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:13:52.547708 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-2f2f1972-0e9f-4005-8b11-019fba85aa49 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:13:52.548163 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-2f2f1972-0e9f-4005-8b11-019fba85aa49 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:13:52.548654 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-2f2f1972-0e9f-4005-8b11-019fba85aa49 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:13:52.625016 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-3a2a6eb2-c38e-4923-a41e-143dc7dc1cea tempest-ListServersNegativeTestJSON-161318838 tempest-ListServersNegativeTestJSON-161318838-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServersNegativeTestJSON-server-374304778", "imageRef": "2d4a0047-1b9e-445f-8af8-1b5c9d93e881", "flavorRef": "452", "min_count": 3, "networks": [{"uuid": "7e17bef1-36b3-4964-9c2f-72df0fd4e65a"}]}} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:13:52.745011 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.network.neutron [None req-3a2a6eb2-c38e-4923-a41e-143dc7dc1cea tempest-ListServersNegativeTestJSON-161318838 tempest-ListServersNegativeTestJSON-161318838-project] validate_networks() for [('7e17bef1-36b3-4964-9c2f-72df0fd4e65a', None, None, None, None, None)] {{(pid=121402) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 01 19:13:53.115102 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-2f2f1972-0e9f-4005-8b11-019fba85aa49 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc5c19b930543f5a5091922a9859813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ecdc83933544a899117531a960027a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:13:53.125700 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-2f2f1972-0e9f-4005-8b11-019fba85aa49 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] 10.222.0.13 "GET /compute/v2.1/servers/b27eaab4-a751-47fb-acdb-db7c99b06a5f" status: 200 len: 1533 microversion: 2.1 time: 0.600618 Nov 01 19:13:53.126304 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 2263/4500] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:13:52 2022] GET /compute/v2.1/servers/b27eaab4-a751-47fb-acdb-db7c99b06a5f => generated 1533 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:13:53.147845 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-82ca4740-5d31-4951-906d-613ca52820d9 tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:13:53.148526 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-82ca4740-5d31-4951-906d-613ca52820d9 tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] [instance: cae1c729-7c41-488d-ab0e-30d1f5d22180] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:13:53.173476 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-82ca4740-5d31-4951-906d-613ca52820d9 tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:13:53.176558 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-82ca4740-5d31-4951-906d-613ca52820d9 tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:13:53.177279 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-82ca4740-5d31-4951-906d-613ca52820d9 tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:13:53.179878 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-82ca4740-5d31-4951-906d-613ca52820d9 tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:13:53.184132 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-82ca4740-5d31-4951-906d-613ca52820d9 tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:13:53.186232 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-82ca4740-5d31-4951-906d-613ca52820d9 tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:13:53.491320 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-82ca4740-5d31-4951-906d-613ca52820d9 tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcf93260eaef487dac5d7bb00b26e3b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73cb8697de6d407ba82c334d9f2b48d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:13:53.505086 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-82ca4740-5d31-4951-906d-613ca52820d9 tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] 10.222.0.13 "GET /compute/v2.1/servers/cae1c729-7c41-488d-ab0e-30d1f5d22180" status: 200 len: 1680 microversion: 2.1 time: 0.377401 Nov 01 19:13:53.505890 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 2264/4501] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:13:53 2022] GET /compute/v2.1/servers/cae1c729-7c41-488d-ab0e-30d1f5d22180 => generated 1680 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:13:54.816965 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-729e8662-2ad9-433a-8ab9-a5b0516eafe8 tempest-ServerRescueTestJSONUnderV235-673623996 tempest-ServerRescueTestJSONUnderV235-673623996-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSONUnderV235-server-283814287", "imageRef": "2d4a0047-1b9e-445f-8af8-1b5c9d93e881", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:13:55.192965 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.network.neutron [None req-729e8662-2ad9-433a-8ab9-a5b0516eafe8 tempest-ServerRescueTestJSONUnderV235-673623996 tempest-ServerRescueTestJSONUnderV235-673623996-project] validate_networks() for [('3de553a8-bfb1-4d59-afdf-437803a29d03', None, None, None, None, None)] {{(pid=121403) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 01 19:13:56.749899 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.virt.hardware [None req-729e8662-2ad9-433a-8ab9-a5b0516eafe8 tempest-ServerRescueTestJSONUnderV235-673623996 tempest-ServerRescueTestJSONUnderV235-673623996-project] Flavor limits 0:0:0 {{(pid=121403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 01 19:13:56.751006 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.virt.hardware [None req-729e8662-2ad9-433a-8ab9-a5b0516eafe8 tempest-ServerRescueTestJSONUnderV235-673623996 tempest-ServerRescueTestJSONUnderV235-673623996-project] Image limits 0:0:0 {{(pid=121403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 01 19:13:56.751898 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.virt.hardware [None req-729e8662-2ad9-433a-8ab9-a5b0516eafe8 tempest-ServerRescueTestJSONUnderV235-673623996 tempest-ServerRescueTestJSONUnderV235-673623996-project] Flavor pref 0:0:0 {{(pid=121403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 01 19:13:56.753294 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.virt.hardware [None req-729e8662-2ad9-433a-8ab9-a5b0516eafe8 tempest-ServerRescueTestJSONUnderV235-673623996 tempest-ServerRescueTestJSONUnderV235-673623996-project] Image pref 0:0:0 {{(pid=121403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 01 19:13:56.754157 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.virt.hardware [None req-729e8662-2ad9-433a-8ab9-a5b0516eafe8 tempest-ServerRescueTestJSONUnderV235-673623996 tempest-ServerRescueTestJSONUnderV235-673623996-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 01 19:13:56.787765 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-729e8662-2ad9-433a-8ab9-a5b0516eafe8 tempest-ServerRescueTestJSONUnderV235-673623996 tempest-ServerRescueTestJSONUnderV235-673623996-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:13:56.791646 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-729e8662-2ad9-433a-8ab9-a5b0516eafe8 tempest-ServerRescueTestJSONUnderV235-673623996 tempest-ServerRescueTestJSONUnderV235-673623996-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:13:56.794538 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-729e8662-2ad9-433a-8ab9-a5b0516eafe8 tempest-ServerRescueTestJSONUnderV235-673623996 tempest-ServerRescueTestJSONUnderV235-673623996-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:13:56.795870 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-729e8662-2ad9-433a-8ab9-a5b0516eafe8 tempest-ServerRescueTestJSONUnderV235-673623996 tempest-ServerRescueTestJSONUnderV235-673623996-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:13:56.799022 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-729e8662-2ad9-433a-8ab9-a5b0516eafe8 tempest-ServerRescueTestJSONUnderV235-673623996 tempest-ServerRescueTestJSONUnderV235-673623996-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:13:56.801171 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-729e8662-2ad9-433a-8ab9-a5b0516eafe8 tempest-ServerRescueTestJSONUnderV235-673623996 tempest-ServerRescueTestJSONUnderV235-673623996-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:13:56.842870 n-d-863052-2 devstack@n-api.service[121403]: DEBUG dbcounter [-] [121403] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 19:13:56.878137 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.virt.hardware [None req-3a2a6eb2-c38e-4923-a41e-143dc7dc1cea tempest-ListServersNegativeTestJSON-161318838 tempest-ListServersNegativeTestJSON-161318838-project] Flavor limits 0:0:0 {{(pid=121402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 01 19:13:56.880771 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.virt.hardware [None req-3a2a6eb2-c38e-4923-a41e-143dc7dc1cea tempest-ListServersNegativeTestJSON-161318838 tempest-ListServersNegativeTestJSON-161318838-project] Image limits 0:0:0 {{(pid=121402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 01 19:13:56.881431 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.virt.hardware [None req-3a2a6eb2-c38e-4923-a41e-143dc7dc1cea tempest-ListServersNegativeTestJSON-161318838 tempest-ListServersNegativeTestJSON-161318838-project] Flavor pref 0:0:0 {{(pid=121402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 01 19:13:56.882699 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.virt.hardware [None req-3a2a6eb2-c38e-4923-a41e-143dc7dc1cea tempest-ListServersNegativeTestJSON-161318838 tempest-ListServersNegativeTestJSON-161318838-project] Image pref 0:0:0 {{(pid=121402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 01 19:13:56.883235 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.virt.hardware [None req-3a2a6eb2-c38e-4923-a41e-143dc7dc1cea tempest-ListServersNegativeTestJSON-161318838 tempest-ListServersNegativeTestJSON-161318838-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 01 19:13:56.920465 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-3a2a6eb2-c38e-4923-a41e-143dc7dc1cea tempest-ListServersNegativeTestJSON-161318838 tempest-ListServersNegativeTestJSON-161318838-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:13:56.921243 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.quota [None req-729e8662-2ad9-433a-8ab9-a5b0516eafe8 tempest-ServerRescueTestJSONUnderV235-673623996 tempest-ServerRescueTestJSONUnderV235-673623996-project] Getting quotas for project 1c9c687e2f2940bbabecdf42a0678132. Resources: {'cores', 'ram', 'instances'} {{(pid=121403) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 01 19:13:56.924326 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-3a2a6eb2-c38e-4923-a41e-143dc7dc1cea tempest-ListServersNegativeTestJSON-161318838 tempest-ListServersNegativeTestJSON-161318838-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:13:56.925071 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-3a2a6eb2-c38e-4923-a41e-143dc7dc1cea tempest-ListServersNegativeTestJSON-161318838 tempest-ListServersNegativeTestJSON-161318838-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:13:56.940046 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-3a2a6eb2-c38e-4923-a41e-143dc7dc1cea tempest-ListServersNegativeTestJSON-161318838 tempest-ListServersNegativeTestJSON-161318838-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:13:56.962739 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-3a2a6eb2-c38e-4923-a41e-143dc7dc1cea tempest-ListServersNegativeTestJSON-161318838 tempest-ListServersNegativeTestJSON-161318838-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.023s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:13:56.967017 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-3a2a6eb2-c38e-4923-a41e-143dc7dc1cea tempest-ListServersNegativeTestJSON-161318838 tempest-ListServersNegativeTestJSON-161318838-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:13:56.979365 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.quota [None req-729e8662-2ad9-433a-8ab9-a5b0516eafe8 tempest-ServerRescueTestJSONUnderV235-673623996 tempest-ServerRescueTestJSONUnderV235-673623996-project] Getting quotas for user a8b1291b1e654a658382af950eb43c4c and project 1c9c687e2f2940bbabecdf42a0678132. Resources: {'cores', 'ram', 'instances'} {{(pid=121403) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 01 19:13:57.057960 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-729e8662-2ad9-433a-8ab9-a5b0516eafe8 tempest-ServerRescueTestJSONUnderV235-673623996 tempest-ServerRescueTestJSONUnderV235-673623996-project] Going to run 1 instances... {{(pid=121403) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 01 19:13:57.068950 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.quota [None req-3a2a6eb2-c38e-4923-a41e-143dc7dc1cea tempest-ListServersNegativeTestJSON-161318838 tempest-ListServersNegativeTestJSON-161318838-project] Getting quotas for project cf1f96424adc43eeb0e489b2d6485790. Resources: {'cores', 'ram', 'instances'} {{(pid=121402) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 01 19:13:57.072773 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-729e8662-2ad9-433a-8ab9-a5b0516eafe8 tempest-ServerRescueTestJSONUnderV235-673623996 tempest-ServerRescueTestJSONUnderV235-673623996-project] [instance: 045a6f82-b3b7-47a7-bcfd-5c1fe9c73f33] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2d4a0047-1b9e-445f-8af8-1b5c9d93e881',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121403) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 01 19:13:57.083602 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.quota [None req-3a2a6eb2-c38e-4923-a41e-143dc7dc1cea tempest-ListServersNegativeTestJSON-161318838 tempest-ListServersNegativeTestJSON-161318838-project] Getting quotas for user 6f36624705974d12a093672679d9e283 and project cf1f96424adc43eeb0e489b2d6485790. Resources: {'cores', 'ram', 'instances'} {{(pid=121402) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 01 19:13:57.125183 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-3a2a6eb2-c38e-4923-a41e-143dc7dc1cea tempest-ListServersNegativeTestJSON-161318838 tempest-ListServersNegativeTestJSON-161318838-project] Going to run 3 instances... {{(pid=121402) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 01 19:13:57.129661 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-3a2a6eb2-c38e-4923-a41e-143dc7dc1cea tempest-ListServersNegativeTestJSON-161318838 tempest-ListServersNegativeTestJSON-161318838-project] [instance: 21599026-c30e-410e-94d2-61501021fa86] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2d4a0047-1b9e-445f-8af8-1b5c9d93e881',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121402) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 01 19:13:57.231498 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-729e8662-2ad9-433a-8ab9-a5b0516eafe8 tempest-ServerRescueTestJSONUnderV235-673623996 tempest-ServerRescueTestJSONUnderV235-673623996-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.126319 Nov 01 19:13:57.234155 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 2265/4502] 10.222.0.13 () {60 vars in 1147 bytes} [Tue Nov 1 19:13:54 2022] POST /compute/v2.1/servers => generated 383 bytes in 3130 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 01 19:13:57.255189 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-3a2a6eb2-c38e-4923-a41e-143dc7dc1cea tempest-ListServersNegativeTestJSON-161318838 tempest-ListServersNegativeTestJSON-161318838-project] [instance: 9b19dbc5-6975-43d3-8d39-a045e986187a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2d4a0047-1b9e-445f-8af8-1b5c9d93e881',instance=,instance_uuid=21599026-c30e-410e-94d2-61501021fa86,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121402) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 01 19:13:57.270620 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-e14a7a74-cd2c-4786-8d7f-6171368c006f tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:13:57.275199 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-e14a7a74-cd2c-4786-8d7f-6171368c006f tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] [instance: b27eaab4-a751-47fb-acdb-db7c99b06a5f] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:13:57.307477 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-e14a7a74-cd2c-4786-8d7f-6171368c006f tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:13:57.311823 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-e14a7a74-cd2c-4786-8d7f-6171368c006f tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:13:57.315424 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-e14a7a74-cd2c-4786-8d7f-6171368c006f tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:13:57.317088 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-e14a7a74-cd2c-4786-8d7f-6171368c006f tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:13:57.318149 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-e14a7a74-cd2c-4786-8d7f-6171368c006f tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:13:57.320145 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-e14a7a74-cd2c-4786-8d7f-6171368c006f tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:13:57.386899 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-3a2a6eb2-c38e-4923-a41e-143dc7dc1cea tempest-ListServersNegativeTestJSON-161318838 tempest-ListServersNegativeTestJSON-161318838-project] [instance: 4bc22a5a-f58d-4ee6-8876-be5dc9e4ddb3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2d4a0047-1b9e-445f-8af8-1b5c9d93e881',instance=,instance_uuid=9b19dbc5-6975-43d3-8d39-a045e986187a,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121402) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 01 19:13:57.687645 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-3a2a6eb2-c38e-4923-a41e-143dc7dc1cea tempest-ListServersNegativeTestJSON-161318838 tempest-ListServersNegativeTestJSON-161318838-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 5.412578 Nov 01 19:13:57.694196 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 2238/4503] 10.222.0.13 () {60 vars in 1147 bytes} [Tue Nov 1 19:13:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 5420 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 01 19:13:57.711007 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-290940a8-a7ff-4ebb-b0ec-73c2a5f8476b tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:13:57.723614 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-290940a8-a7ff-4ebb-b0ec-73c2a5f8476b tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] [instance: cae1c729-7c41-488d-ab0e-30d1f5d22180] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:13:57.748618 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-290940a8-a7ff-4ebb-b0ec-73c2a5f8476b tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:13:57.754267 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-290940a8-a7ff-4ebb-b0ec-73c2a5f8476b tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:13:57.755189 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-290940a8-a7ff-4ebb-b0ec-73c2a5f8476b tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:13:57.755953 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-290940a8-a7ff-4ebb-b0ec-73c2a5f8476b tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:13:57.756424 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-290940a8-a7ff-4ebb-b0ec-73c2a5f8476b tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:13:57.756889 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-290940a8-a7ff-4ebb-b0ec-73c2a5f8476b tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:13:57.815886 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-e14a7a74-cd2c-4786-8d7f-6171368c006f tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc5c19b930543f5a5091922a9859813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ecdc83933544a899117531a960027a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:13:57.833073 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-e14a7a74-cd2c-4786-8d7f-6171368c006f tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] 10.222.0.13 "GET /compute/v2.1/servers/b27eaab4-a751-47fb-acdb-db7c99b06a5f" status: 200 len: 1528 microversion: 2.1 time: 0.596174 Nov 01 19:13:57.852408 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 2266/4504] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:13:57 2022] GET /compute/v2.1/servers/b27eaab4-a751-47fb-acdb-db7c99b06a5f => generated 1528 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:13:57.876224 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-0f09ca74-55e8-4209-8888-48ad351461a8 tempest-ServerRescueTestJSONUnderV235-673623996 tempest-ServerRescueTestJSONUnderV235-673623996-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:13:57.880428 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-0f09ca74-55e8-4209-8888-48ad351461a8 tempest-ServerRescueTestJSONUnderV235-673623996 tempest-ServerRescueTestJSONUnderV235-673623996-project] [instance: 045a6f82-b3b7-47a7-bcfd-5c1fe9c73f33] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:13:58.030794 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-0f09ca74-55e8-4209-8888-48ad351461a8 tempest-ServerRescueTestJSONUnderV235-673623996 tempest-ServerRescueTestJSONUnderV235-673623996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8b1291b1e654a658382af950eb43c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c9c687e2f2940bbabecdf42a0678132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:13:58.040116 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-0f09ca74-55e8-4209-8888-48ad351461a8 tempest-ServerRescueTestJSONUnderV235-673623996 tempest-ServerRescueTestJSONUnderV235-673623996-project] 10.222.0.13 "GET /compute/v2.1/servers/045a6f82-b3b7-47a7-bcfd-5c1fe9c73f33" status: 200 len: 1222 microversion: 2.1 time: 0.180607 Nov 01 19:13:58.043739 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 2267/4505] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:13:57 2022] GET /compute/v2.1/servers/045a6f82-b3b7-47a7-bcfd-5c1fe9c73f33 => generated 1222 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:13:58.054905 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-da191c3a-741b-4e58-aa5c-190c8e0401b9 tempest-ListServersNegativeTestJSON-161318838 tempest-ListServersNegativeTestJSON-161318838-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:13:58.083669 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-da191c3a-741b-4e58-aa5c-190c8e0401b9 tempest-ListServersNegativeTestJSON-161318838 tempest-ListServersNegativeTestJSON-161318838-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '6f36624705974d12a093672679d9e283', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf1f96424adc43eeb0e489b2d6485790', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:13:58.090147 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-da191c3a-741b-4e58-aa5c-190c8e0401b9 tempest-ListServersNegativeTestJSON-161318838 tempest-ListServersNegativeTestJSON-161318838-project] Searching by: {'deleted': False, 'project_id': 'cf1f96424adc43eeb0e489b2d6485790'} {{(pid=121403) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 01 19:13:58.191130 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-da191c3a-741b-4e58-aa5c-190c8e0401b9 tempest-ListServersNegativeTestJSON-161318838 tempest-ListServersNegativeTestJSON-161318838-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:13:58.195193 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-da191c3a-741b-4e58-aa5c-190c8e0401b9 tempest-ListServersNegativeTestJSON-161318838 tempest-ListServersNegativeTestJSON-161318838-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:13:58.196467 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-da191c3a-741b-4e58-aa5c-190c8e0401b9 tempest-ListServersNegativeTestJSON-161318838 tempest-ListServersNegativeTestJSON-161318838-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:13:58.198674 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-da191c3a-741b-4e58-aa5c-190c8e0401b9 tempest-ListServersNegativeTestJSON-161318838 tempest-ListServersNegativeTestJSON-161318838-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:13:58.200030 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-da191c3a-741b-4e58-aa5c-190c8e0401b9 tempest-ListServersNegativeTestJSON-161318838 tempest-ListServersNegativeTestJSON-161318838-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:13:58.201015 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-da191c3a-741b-4e58-aa5c-190c8e0401b9 tempest-ListServersNegativeTestJSON-161318838 tempest-ListServersNegativeTestJSON-161318838-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:13:58.252178 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-da191c3a-741b-4e58-aa5c-190c8e0401b9 tempest-ListServersNegativeTestJSON-161318838 tempest-ListServersNegativeTestJSON-161318838-project] 10.222.0.13 "GET /compute/v2.1/servers" status: 200 len: 1015 microversion: 2.1 time: 0.207098 Nov 01 19:13:58.256899 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 2268/4506] 10.222.0.13 () {58 vars in 1125 bytes} [Tue Nov 1 19:13:58 2022] GET /compute/v2.1/servers => generated 1015 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:13:58.292883 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-eeb8d994-7cc1-4f18-985e-829bda7ee082 tempest-ListServersNegativeTestJSON-161318838 tempest-ListServersNegativeTestJSON-161318838-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:13:58.293828 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-eeb8d994-7cc1-4f18-985e-829bda7ee082 tempest-ListServersNegativeTestJSON-161318838 tempest-ListServersNegativeTestJSON-161318838-project] [instance: 4bc22a5a-f58d-4ee6-8876-be5dc9e4ddb3] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:13:58.315918 n-d-863052-2 devstack@n-api.service[121403]: DEBUG dbcounter [-] [121403] Writing DB stats nova_api:SELECT=91,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=121403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 19:13:58.506308 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-eeb8d994-7cc1-4f18-985e-829bda7ee082 tempest-ListServersNegativeTestJSON-161318838 tempest-ListServersNegativeTestJSON-161318838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f36624705974d12a093672679d9e283', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf1f96424adc43eeb0e489b2d6485790', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:13:58.523862 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-eeb8d994-7cc1-4f18-985e-829bda7ee082 tempest-ListServersNegativeTestJSON-161318838 tempest-ListServersNegativeTestJSON-161318838-project] 10.222.0.13 "GET /compute/v2.1/servers/4bc22a5a-f58d-4ee6-8876-be5dc9e4ddb3" status: 200 len: 1222 microversion: 2.1 time: 0.258955 Nov 01 19:13:58.525188 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 2269/4507] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:13:58 2022] GET /compute/v2.1/servers/4bc22a5a-f58d-4ee6-8876-be5dc9e4ddb3 => generated 1222 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 19:13:58.880130 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-541056da-1aac-4174-bff0-f33d3650d693 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:13:58.880874 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-541056da-1aac-4174-bff0-f33d3650d693 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] [instance: b27eaab4-a751-47fb-acdb-db7c99b06a5f] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:13:58.898773 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-541056da-1aac-4174-bff0-f33d3650d693 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:13:58.899312 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-541056da-1aac-4174-bff0-f33d3650d693 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:13:58.899763 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-541056da-1aac-4174-bff0-f33d3650d693 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:13:58.936183 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-541056da-1aac-4174-bff0-f33d3650d693 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:13:58.938643 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-541056da-1aac-4174-bff0-f33d3650d693 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:13:58.938643 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-541056da-1aac-4174-bff0-f33d3650d693 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:13:59.487355 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-541056da-1aac-4174-bff0-f33d3650d693 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc5c19b930543f5a5091922a9859813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ecdc83933544a899117531a960027a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:13:59.488084 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-290940a8-a7ff-4ebb-b0ec-73c2a5f8476b tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcf93260eaef487dac5d7bb00b26e3b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73cb8697de6d407ba82c334d9f2b48d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:13:59.500173 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-541056da-1aac-4174-bff0-f33d3650d693 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] 10.222.0.13 "GET /compute/v2.1/servers/b27eaab4-a751-47fb-acdb-db7c99b06a5f" status: 200 len: 1528 microversion: 2.1 time: 0.624583 Nov 01 19:13:59.503072 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 2270/4508] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:13:58 2022] GET /compute/v2.1/servers/b27eaab4-a751-47fb-acdb-db7c99b06a5f => generated 1528 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 19:13:59.505950 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-290940a8-a7ff-4ebb-b0ec-73c2a5f8476b tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] 10.222.0.13 "GET /compute/v2.1/servers/cae1c729-7c41-488d-ab0e-30d1f5d22180" status: 200 len: 1680 microversion: 2.1 time: 1.807735 Nov 01 19:13:59.509317 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 2239/4509] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:13:57 2022] GET /compute/v2.1/servers/cae1c729-7c41-488d-ab0e-30d1f5d22180 => generated 1680 bytes in 1814 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:13:59.519459 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-d09c484c-00a7-4d14-a9e3-26a8c03a20a6 tempest-ServerRescueTestJSONUnderV235-673623996 tempest-ServerRescueTestJSONUnderV235-673623996-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:13:59.524534 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-d09c484c-00a7-4d14-a9e3-26a8c03a20a6 tempest-ServerRescueTestJSONUnderV235-673623996 tempest-ServerRescueTestJSONUnderV235-673623996-project] [instance: 045a6f82-b3b7-47a7-bcfd-5c1fe9c73f33] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:13:59.551490 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-ddc66b12-987b-46a5-9f4b-b74f00139aaf tempest-ListServersNegativeTestJSON-161318838 tempest-ListServersNegativeTestJSON-161318838-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:13:59.552238 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-ddc66b12-987b-46a5-9f4b-b74f00139aaf tempest-ListServersNegativeTestJSON-161318838 tempest-ListServersNegativeTestJSON-161318838-project] [instance: 4bc22a5a-f58d-4ee6-8876-be5dc9e4ddb3] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:13:59.555771 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d09c484c-00a7-4d14-a9e3-26a8c03a20a6 tempest-ServerRescueTestJSONUnderV235-673623996 tempest-ServerRescueTestJSONUnderV235-673623996-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:13:59.558143 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d09c484c-00a7-4d14-a9e3-26a8c03a20a6 tempest-ServerRescueTestJSONUnderV235-673623996 tempest-ServerRescueTestJSONUnderV235-673623996-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:13:59.559518 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d09c484c-00a7-4d14-a9e3-26a8c03a20a6 tempest-ServerRescueTestJSONUnderV235-673623996 tempest-ServerRescueTestJSONUnderV235-673623996-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:13:59.569015 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d09c484c-00a7-4d14-a9e3-26a8c03a20a6 tempest-ServerRescueTestJSONUnderV235-673623996 tempest-ServerRescueTestJSONUnderV235-673623996-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:13:59.569603 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d09c484c-00a7-4d14-a9e3-26a8c03a20a6 tempest-ServerRescueTestJSONUnderV235-673623996 tempest-ServerRescueTestJSONUnderV235-673623996-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:13:59.572892 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-d09c484c-00a7-4d14-a9e3-26a8c03a20a6 tempest-ServerRescueTestJSONUnderV235-673623996 tempest-ServerRescueTestJSONUnderV235-673623996-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:13:59.872880 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-ddc66b12-987b-46a5-9f4b-b74f00139aaf tempest-ListServersNegativeTestJSON-161318838 tempest-ListServersNegativeTestJSON-161318838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f36624705974d12a093672679d9e283', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf1f96424adc43eeb0e489b2d6485790', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:13:59.875280 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-d09c484c-00a7-4d14-a9e3-26a8c03a20a6 tempest-ServerRescueTestJSONUnderV235-673623996 tempest-ServerRescueTestJSONUnderV235-673623996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8b1291b1e654a658382af950eb43c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c9c687e2f2940bbabecdf42a0678132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:13:59.895460 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-ddc66b12-987b-46a5-9f4b-b74f00139aaf tempest-ListServersNegativeTestJSON-161318838 tempest-ListServersNegativeTestJSON-161318838-project] 10.222.0.13 "GET /compute/v2.1/servers/4bc22a5a-f58d-4ee6-8876-be5dc9e4ddb3" status: 200 len: 1222 microversion: 2.1 time: 0.346414 Nov 01 19:13:59.899002 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 2240/4510] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:13:59 2022] GET /compute/v2.1/servers/4bc22a5a-f58d-4ee6-8876-be5dc9e4ddb3 => generated 1222 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:13:59.905918 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-d09c484c-00a7-4d14-a9e3-26a8c03a20a6 tempest-ServerRescueTestJSONUnderV235-673623996 tempest-ServerRescueTestJSONUnderV235-673623996-project] 10.222.0.13 "GET /compute/v2.1/servers/045a6f82-b3b7-47a7-bcfd-5c1fe9c73f33" status: 200 len: 1274 microversion: 2.1 time: 0.401465 Nov 01 19:13:59.912723 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 2271/4511] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:13:59 2022] GET /compute/v2.1/servers/045a6f82-b3b7-47a7-bcfd-5c1fe9c73f33 => generated 1274 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:14:00.526684 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-53882d6b-724d-4072-926c-ea57604c68db tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:14:00.527520 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-53882d6b-724d-4072-926c-ea57604c68db tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] [instance: b27eaab4-a751-47fb-acdb-db7c99b06a5f] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:14:00.536330 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-8ca12114-fde5-46bc-8a0b-96ce9c5861d9 tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:14:00.537060 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-8ca12114-fde5-46bc-8a0b-96ce9c5861d9 tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] [instance: cae1c729-7c41-488d-ab0e-30d1f5d22180] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:14:00.562679 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-8ca12114-fde5-46bc-8a0b-96ce9c5861d9 tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:14:00.567316 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-8ca12114-fde5-46bc-8a0b-96ce9c5861d9 tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:14:00.570576 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-8ca12114-fde5-46bc-8a0b-96ce9c5861d9 tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:14:00.574664 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-8ca12114-fde5-46bc-8a0b-96ce9c5861d9 tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:14:00.577879 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-8ca12114-fde5-46bc-8a0b-96ce9c5861d9 tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:14:00.578497 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-53882d6b-724d-4072-926c-ea57604c68db tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:14:00.580030 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-53882d6b-724d-4072-926c-ea57604c68db tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:14:00.581386 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-8ca12114-fde5-46bc-8a0b-96ce9c5861d9 tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:14:00.583381 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-53882d6b-724d-4072-926c-ea57604c68db tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:14:00.586751 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-53882d6b-724d-4072-926c-ea57604c68db tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:14:00.594202 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-53882d6b-724d-4072-926c-ea57604c68db tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:14:00.595996 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-53882d6b-724d-4072-926c-ea57604c68db tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:14:01.602380 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-8ca12114-fde5-46bc-8a0b-96ce9c5861d9 tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcf93260eaef487dac5d7bb00b26e3b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73cb8697de6d407ba82c334d9f2b48d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:14:01.611621 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-8ca12114-fde5-46bc-8a0b-96ce9c5861d9 tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] 10.222.0.13 "GET /compute/v2.1/servers/cae1c729-7c41-488d-ab0e-30d1f5d22180" status: 200 len: 1680 microversion: 2.1 time: 1.079066 Nov 01 19:14:01.619651 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 2272/4512] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:14:00 2022] GET /compute/v2.1/servers/cae1c729-7c41-488d-ab0e-30d1f5d22180 => generated 1680 bytes in 1087 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 19:14:01.648203 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-b9135058-3468-467e-9b8a-9d428c266bb0 tempest-ListServersNegativeTestJSON-161318838 tempest-ListServersNegativeTestJSON-161318838-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:14:01.655120 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-b9135058-3468-467e-9b8a-9d428c266bb0 tempest-ListServersNegativeTestJSON-161318838 tempest-ListServersNegativeTestJSON-161318838-project] [instance: 4bc22a5a-f58d-4ee6-8876-be5dc9e4ddb3] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:14:01.696387 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-b9135058-3468-467e-9b8a-9d428c266bb0 tempest-ListServersNegativeTestJSON-161318838 tempest-ListServersNegativeTestJSON-161318838-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:14:01.711344 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-b9135058-3468-467e-9b8a-9d428c266bb0 tempest-ListServersNegativeTestJSON-161318838 tempest-ListServersNegativeTestJSON-161318838-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:14:01.714663 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-b9135058-3468-467e-9b8a-9d428c266bb0 tempest-ListServersNegativeTestJSON-161318838 tempest-ListServersNegativeTestJSON-161318838-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:14:01.720720 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-b9135058-3468-467e-9b8a-9d428c266bb0 tempest-ListServersNegativeTestJSON-161318838 tempest-ListServersNegativeTestJSON-161318838-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:14:01.721919 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-b9135058-3468-467e-9b8a-9d428c266bb0 tempest-ListServersNegativeTestJSON-161318838 tempest-ListServersNegativeTestJSON-161318838-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:14:01.722360 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-b9135058-3468-467e-9b8a-9d428c266bb0 tempest-ListServersNegativeTestJSON-161318838 tempest-ListServersNegativeTestJSON-161318838-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:14:01.950435 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-b9135058-3468-467e-9b8a-9d428c266bb0 tempest-ListServersNegativeTestJSON-161318838 tempest-ListServersNegativeTestJSON-161318838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f36624705974d12a093672679d9e283', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf1f96424adc43eeb0e489b2d6485790', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:14:01.964532 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-b9135058-3468-467e-9b8a-9d428c266bb0 tempest-ListServersNegativeTestJSON-161318838 tempest-ListServersNegativeTestJSON-161318838-project] 10.222.0.13 "GET /compute/v2.1/servers/4bc22a5a-f58d-4ee6-8876-be5dc9e4ddb3" status: 200 len: 1218 microversion: 2.1 time: 0.343215 Nov 01 19:14:01.968989 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 2273/4513] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:14:01 2022] GET /compute/v2.1/servers/4bc22a5a-f58d-4ee6-8876-be5dc9e4ddb3 => generated 1218 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:14:01.986423 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-c29368eb-4b65-452e-b4eb-cea9f08295b7 tempest-ServerRescueTestJSONUnderV235-673623996 tempest-ServerRescueTestJSONUnderV235-673623996-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:14:01.998840 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-c29368eb-4b65-452e-b4eb-cea9f08295b7 tempest-ServerRescueTestJSONUnderV235-673623996 tempest-ServerRescueTestJSONUnderV235-673623996-project] [instance: 045a6f82-b3b7-47a7-bcfd-5c1fe9c73f33] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:14:02.040432 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-c29368eb-4b65-452e-b4eb-cea9f08295b7 tempest-ServerRescueTestJSONUnderV235-673623996 tempest-ServerRescueTestJSONUnderV235-673623996-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:14:02.041747 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-c29368eb-4b65-452e-b4eb-cea9f08295b7 tempest-ServerRescueTestJSONUnderV235-673623996 tempest-ServerRescueTestJSONUnderV235-673623996-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.024s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:14:02.047420 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-c29368eb-4b65-452e-b4eb-cea9f08295b7 tempest-ServerRescueTestJSONUnderV235-673623996 tempest-ServerRescueTestJSONUnderV235-673623996-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:14:02.048373 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-c29368eb-4b65-452e-b4eb-cea9f08295b7 tempest-ServerRescueTestJSONUnderV235-673623996 tempest-ServerRescueTestJSONUnderV235-673623996-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:14:02.057791 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-c29368eb-4b65-452e-b4eb-cea9f08295b7 tempest-ServerRescueTestJSONUnderV235-673623996 tempest-ServerRescueTestJSONUnderV235-673623996-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:14:02.058442 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-c29368eb-4b65-452e-b4eb-cea9f08295b7 tempest-ServerRescueTestJSONUnderV235-673623996 tempest-ServerRescueTestJSONUnderV235-673623996-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:14:02.069728 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-53882d6b-724d-4072-926c-ea57604c68db tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc5c19b930543f5a5091922a9859813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ecdc83933544a899117531a960027a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:14:02.096057 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-53882d6b-724d-4072-926c-ea57604c68db tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] 10.222.0.13 "GET /compute/v2.1/servers/b27eaab4-a751-47fb-acdb-db7c99b06a5f" status: 200 len: 1528 microversion: 2.1 time: 1.570415 Nov 01 19:14:02.098672 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 2241/4514] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:14:00 2022] GET /compute/v2.1/servers/b27eaab4-a751-47fb-acdb-db7c99b06a5f => generated 1528 bytes in 1577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:14:02.648166 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-36a29e6b-15d5-4105-af09-87c98907a3a5 tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:14:02.649169 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-36a29e6b-15d5-4105-af09-87c98907a3a5 tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] [instance: cae1c729-7c41-488d-ab0e-30d1f5d22180] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:14:02.676636 n-d-863052-2 devstack@n-api.service[121402]: DEBUG dbcounter [-] [121402] Writing DB stats nova_api:SELECT=63,nova_api:INSERT=9 {{(pid=121402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 19:14:02.682928 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-36a29e6b-15d5-4105-af09-87c98907a3a5 tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:14:02.683460 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-36a29e6b-15d5-4105-af09-87c98907a3a5 tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:14:02.683889 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-36a29e6b-15d5-4105-af09-87c98907a3a5 tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:14:02.707875 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-c29368eb-4b65-452e-b4eb-cea9f08295b7 tempest-ServerRescueTestJSONUnderV235-673623996 tempest-ServerRescueTestJSONUnderV235-673623996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8b1291b1e654a658382af950eb43c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c9c687e2f2940bbabecdf42a0678132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:14:02.709076 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-36a29e6b-15d5-4105-af09-87c98907a3a5 tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:14:02.714255 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-36a29e6b-15d5-4105-af09-87c98907a3a5 tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.025s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:14:02.716173 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-36a29e6b-15d5-4105-af09-87c98907a3a5 tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:14:02.724502 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-c29368eb-4b65-452e-b4eb-cea9f08295b7 tempest-ServerRescueTestJSONUnderV235-673623996 tempest-ServerRescueTestJSONUnderV235-673623996-project] 10.222.0.13 "GET /compute/v2.1/servers/045a6f82-b3b7-47a7-bcfd-5c1fe9c73f33" status: 200 len: 1280 microversion: 2.1 time: 0.753691 Nov 01 19:14:02.725686 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 2274/4515] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:14:01 2022] GET /compute/v2.1/servers/045a6f82-b3b7-47a7-bcfd-5c1fe9c73f33 => generated 1280 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:14:02.995693 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-363064e9-52ef-48b1-9053-cb70d9b1233c tempest-ListServersNegativeTestJSON-161318838 tempest-ListServersNegativeTestJSON-161318838-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:14:02.996308 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-363064e9-52ef-48b1-9053-cb70d9b1233c tempest-ListServersNegativeTestJSON-161318838 tempest-ListServersNegativeTestJSON-161318838-project] [instance: 4bc22a5a-f58d-4ee6-8876-be5dc9e4ddb3] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:14:03.015579 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-363064e9-52ef-48b1-9053-cb70d9b1233c tempest-ListServersNegativeTestJSON-161318838 tempest-ListServersNegativeTestJSON-161318838-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:14:03.016328 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-363064e9-52ef-48b1-9053-cb70d9b1233c tempest-ListServersNegativeTestJSON-161318838 tempest-ListServersNegativeTestJSON-161318838-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:14:03.017129 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-363064e9-52ef-48b1-9053-cb70d9b1233c tempest-ListServersNegativeTestJSON-161318838 tempest-ListServersNegativeTestJSON-161318838-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:14:03.018139 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-363064e9-52ef-48b1-9053-cb70d9b1233c tempest-ListServersNegativeTestJSON-161318838 tempest-ListServersNegativeTestJSON-161318838-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:14:03.018749 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-363064e9-52ef-48b1-9053-cb70d9b1233c tempest-ListServersNegativeTestJSON-161318838 tempest-ListServersNegativeTestJSON-161318838-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:14:03.020721 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-363064e9-52ef-48b1-9053-cb70d9b1233c tempest-ListServersNegativeTestJSON-161318838 tempest-ListServersNegativeTestJSON-161318838-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:14:03.575705 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-363064e9-52ef-48b1-9053-cb70d9b1233c tempest-ListServersNegativeTestJSON-161318838 tempest-ListServersNegativeTestJSON-161318838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f36624705974d12a093672679d9e283', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf1f96424adc43eeb0e489b2d6485790', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:14:03.597642 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-363064e9-52ef-48b1-9053-cb70d9b1233c tempest-ListServersNegativeTestJSON-161318838 tempest-ListServersNegativeTestJSON-161318838-project] 10.222.0.13 "GET /compute/v2.1/servers/4bc22a5a-f58d-4ee6-8876-be5dc9e4ddb3" status: 200 len: 1274 microversion: 2.1 time: 0.606254 Nov 01 19:14:03.598255 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 2275/4516] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:14:02 2022] GET /compute/v2.1/servers/4bc22a5a-f58d-4ee6-8876-be5dc9e4ddb3 => generated 1274 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 19:14:03.623335 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-c2eb4e2f-a784-41b6-bfc1-2f749f865101 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:14:03.638308 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-c2eb4e2f-a784-41b6-bfc1-2f749f865101 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] [instance: b27eaab4-a751-47fb-acdb-db7c99b06a5f] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:14:03.660425 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-c2eb4e2f-a784-41b6-bfc1-2f749f865101 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:14:03.663329 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-c2eb4e2f-a784-41b6-bfc1-2f749f865101 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:14:03.664980 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-c2eb4e2f-a784-41b6-bfc1-2f749f865101 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:14:03.667114 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-c2eb4e2f-a784-41b6-bfc1-2f749f865101 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:14:03.668788 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-c2eb4e2f-a784-41b6-bfc1-2f749f865101 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:14:03.669456 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-c2eb4e2f-a784-41b6-bfc1-2f749f865101 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:14:04.767197 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-36a29e6b-15d5-4105-af09-87c98907a3a5 tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcf93260eaef487dac5d7bb00b26e3b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73cb8697de6d407ba82c334d9f2b48d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:14:04.787795 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-36a29e6b-15d5-4105-af09-87c98907a3a5 tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] 10.222.0.13 "GET /compute/v2.1/servers/cae1c729-7c41-488d-ab0e-30d1f5d22180" status: 200 len: 1680 microversion: 2.1 time: 2.145219 Nov 01 19:14:04.788980 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 2242/4517] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:14:02 2022] GET /compute/v2.1/servers/cae1c729-7c41-488d-ab0e-30d1f5d22180 => generated 1680 bytes in 2147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:14:04.801188 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-4d67f8a5-4c0a-4fd6-ab2b-5992f817cd5e tempest-ServerRescueTestJSONUnderV235-673623996 tempest-ServerRescueTestJSONUnderV235-673623996-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:14:04.802029 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-4d67f8a5-4c0a-4fd6-ab2b-5992f817cd5e tempest-ServerRescueTestJSONUnderV235-673623996 tempest-ServerRescueTestJSONUnderV235-673623996-project] [instance: 045a6f82-b3b7-47a7-bcfd-5c1fe9c73f33] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:14:04.820288 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-4d67f8a5-4c0a-4fd6-ab2b-5992f817cd5e tempest-ServerRescueTestJSONUnderV235-673623996 tempest-ServerRescueTestJSONUnderV235-673623996-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:14:04.820820 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-4d67f8a5-4c0a-4fd6-ab2b-5992f817cd5e tempest-ServerRescueTestJSONUnderV235-673623996 tempest-ServerRescueTestJSONUnderV235-673623996-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:14:04.821265 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-4d67f8a5-4c0a-4fd6-ab2b-5992f817cd5e tempest-ServerRescueTestJSONUnderV235-673623996 tempest-ServerRescueTestJSONUnderV235-673623996-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:14:04.822055 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-4d67f8a5-4c0a-4fd6-ab2b-5992f817cd5e tempest-ServerRescueTestJSONUnderV235-673623996 tempest-ServerRescueTestJSONUnderV235-673623996-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:14:04.822491 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-4d67f8a5-4c0a-4fd6-ab2b-5992f817cd5e tempest-ServerRescueTestJSONUnderV235-673623996 tempest-ServerRescueTestJSONUnderV235-673623996-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:14:04.822918 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-4d67f8a5-4c0a-4fd6-ab2b-5992f817cd5e tempest-ServerRescueTestJSONUnderV235-673623996 tempest-ServerRescueTestJSONUnderV235-673623996-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:14:05.320573 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-c2eb4e2f-a784-41b6-bfc1-2f749f865101 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc5c19b930543f5a5091922a9859813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ecdc83933544a899117531a960027a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:14:05.364204 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-c2eb4e2f-a784-41b6-bfc1-2f749f865101 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] 10.222.0.13 "GET /compute/v2.1/servers/b27eaab4-a751-47fb-acdb-db7c99b06a5f" status: 200 len: 1528 microversion: 2.1 time: 1.759724 Nov 01 19:14:05.376080 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 2276/4518] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:14:03 2022] GET /compute/v2.1/servers/b27eaab4-a751-47fb-acdb-db7c99b06a5f => generated 1528 bytes in 1773 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:14:05.383603 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-1e5232c8-6683-448f-ada9-d52033e2cea2 tempest-ListServersNegativeTestJSON-161318838 tempest-ListServersNegativeTestJSON-161318838-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:14:05.413239 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-1e5232c8-6683-448f-ada9-d52033e2cea2 tempest-ListServersNegativeTestJSON-161318838 tempest-ListServersNegativeTestJSON-161318838-project] [instance: 4bc22a5a-f58d-4ee6-8876-be5dc9e4ddb3] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:14:05.444779 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-1e5232c8-6683-448f-ada9-d52033e2cea2 tempest-ListServersNegativeTestJSON-161318838 tempest-ListServersNegativeTestJSON-161318838-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:14:05.445729 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-1e5232c8-6683-448f-ada9-d52033e2cea2 tempest-ListServersNegativeTestJSON-161318838 tempest-ListServersNegativeTestJSON-161318838-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:14:05.448923 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-1e5232c8-6683-448f-ada9-d52033e2cea2 tempest-ListServersNegativeTestJSON-161318838 tempest-ListServersNegativeTestJSON-161318838-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:14:05.450007 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-1e5232c8-6683-448f-ada9-d52033e2cea2 tempest-ListServersNegativeTestJSON-161318838 tempest-ListServersNegativeTestJSON-161318838-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:14:05.453213 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-1e5232c8-6683-448f-ada9-d52033e2cea2 tempest-ListServersNegativeTestJSON-161318838 tempest-ListServersNegativeTestJSON-161318838-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:14:05.453856 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-1e5232c8-6683-448f-ada9-d52033e2cea2 tempest-ListServersNegativeTestJSON-161318838 tempest-ListServersNegativeTestJSON-161318838-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:14:05.882159 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-4d67f8a5-4c0a-4fd6-ab2b-5992f817cd5e tempest-ServerRescueTestJSONUnderV235-673623996 tempest-ServerRescueTestJSONUnderV235-673623996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8b1291b1e654a658382af950eb43c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c9c687e2f2940bbabecdf42a0678132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:14:05.923429 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-4d67f8a5-4c0a-4fd6-ab2b-5992f817cd5e tempest-ServerRescueTestJSONUnderV235-673623996 tempest-ServerRescueTestJSONUnderV235-673623996-project] 10.222.0.13 "GET /compute/v2.1/servers/045a6f82-b3b7-47a7-bcfd-5c1fe9c73f33" status: 200 len: 1322 microversion: 2.1 time: 1.133156 Nov 01 19:14:05.924032 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 2243/4519] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:14:04 2022] GET /compute/v2.1/servers/045a6f82-b3b7-47a7-bcfd-5c1fe9c73f33 => generated 1322 bytes in 1134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:14:05.936269 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-1e5232c8-6683-448f-ada9-d52033e2cea2 tempest-ListServersNegativeTestJSON-161318838 tempest-ListServersNegativeTestJSON-161318838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f36624705974d12a093672679d9e283', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf1f96424adc43eeb0e489b2d6485790', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:14:05.945989 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [req-fd03f23d-1d6f-498c-8056-49d8276c1b5a req-6ed1a150-7933-4f84-9df8-03b8c4e0cc3a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b27eaab4-a751-47fb-acdb-db7c99b06a5f", "name": "network-vif-plugged", "status": "completed", "tag": "200423f3-1c61-4481-816b-7b546d2ec3c8"}]} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:14:05.949645 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-1e5232c8-6683-448f-ada9-d52033e2cea2 tempest-ListServersNegativeTestJSON-161318838 tempest-ListServersNegativeTestJSON-161318838-project] 10.222.0.13 "GET /compute/v2.1/servers/4bc22a5a-f58d-4ee6-8876-be5dc9e4ddb3" status: 200 len: 1280 microversion: 2.1 time: 0.572096 Nov 01 19:14:05.952950 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 2277/4520] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:14:05 2022] GET /compute/v2.1/servers/4bc22a5a-f58d-4ee6-8876-be5dc9e4ddb3 => generated 1280 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:14:05.960754 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-532c03dc-25b0-4909-b2b6-c92e3a99c0ec tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:14:05.965346 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-532c03dc-25b0-4909-b2b6-c92e3a99c0ec tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] [instance: cae1c729-7c41-488d-ab0e-30d1f5d22180] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:14:05.979944 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-532c03dc-25b0-4909-b2b6-c92e3a99c0ec tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:14:05.985310 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-532c03dc-25b0-4909-b2b6-c92e3a99c0ec tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:14:05.992843 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-532c03dc-25b0-4909-b2b6-c92e3a99c0ec tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:14:05.993082 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-fd03f23d-1d6f-498c-8056-49d8276c1b5a req-6ed1a150-7933-4f84-9df8-03b8c4e0cc3a service nova] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:14:05.994214 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-532c03dc-25b0-4909-b2b6-c92e3a99c0ec tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:14:05.994949 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-532c03dc-25b0-4909-b2b6-c92e3a99c0ec tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:14:05.996019 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-532c03dc-25b0-4909-b2b6-c92e3a99c0ec tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:14:06.000756 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-fd03f23d-1d6f-498c-8056-49d8276c1b5a req-6ed1a150-7933-4f84-9df8-03b8c4e0cc3a service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:14:06.001219 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-fd03f23d-1d6f-498c-8056-49d8276c1b5a req-6ed1a150-7933-4f84-9df8-03b8c4e0cc3a service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:14:06.036532 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.compute.server_external_events [req-fd03f23d-1d6f-498c-8056-49d8276c1b5a req-6ed1a150-7933-4f84-9df8-03b8c4e0cc3a service nova] Creating event network-vif-plugged:200423f3-1c61-4481-816b-7b546d2ec3c8 for instance b27eaab4-a751-47fb-acdb-db7c99b06a5f on n-h2-863052-2 Nov 01 19:14:06.060196 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [req-fd03f23d-1d6f-498c-8056-49d8276c1b5a req-6ed1a150-7933-4f84-9df8-03b8c4e0cc3a service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.126672 Nov 01 19:14:06.063427 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 2244/4521] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Nov 1 19:14:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:14:06.397826 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-08c27d7d-1a29-4936-974f-211813f943b5 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:14:06.398527 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-08c27d7d-1a29-4936-974f-211813f943b5 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] [instance: b27eaab4-a751-47fb-acdb-db7c99b06a5f] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:14:06.413723 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-08c27d7d-1a29-4936-974f-211813f943b5 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:14:06.423305 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-08c27d7d-1a29-4936-974f-211813f943b5 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:14:06.423921 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-08c27d7d-1a29-4936-974f-211813f943b5 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:14:06.431852 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-08c27d7d-1a29-4936-974f-211813f943b5 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:14:06.432676 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-08c27d7d-1a29-4936-974f-211813f943b5 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:14:06.433390 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-08c27d7d-1a29-4936-974f-211813f943b5 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:14:06.438309 n-d-863052-2 devstack@n-api.service[121402]: DEBUG dbcounter [-] [121402] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 19:14:07.029583 n-d-863052-2 devstack@n-api.service[121402]: DEBUG dbcounter [-] [121402] Writing DB stats nova_cell0:SELECT=2 {{(pid=121402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 19:14:07.441294 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-08c27d7d-1a29-4936-974f-211813f943b5 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc5c19b930543f5a5091922a9859813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ecdc83933544a899117531a960027a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:14:07.451923 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-08c27d7d-1a29-4936-974f-211813f943b5 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] 10.222.0.13 "GET /compute/v2.1/servers/b27eaab4-a751-47fb-acdb-db7c99b06a5f" status: 200 len: 1528 microversion: 2.1 time: 1.058633 Nov 01 19:14:07.454464 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 2245/4522] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:14:06 2022] GET /compute/v2.1/servers/b27eaab4-a751-47fb-acdb-db7c99b06a5f => generated 1528 bytes in 1062 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:14:07.459574 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-1b5631fd-4eae-48f4-bf01-996a10307708 tempest-ServerRescueTestJSONUnderV235-673623996 tempest-ServerRescueTestJSONUnderV235-673623996-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:14:07.460381 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-1b5631fd-4eae-48f4-bf01-996a10307708 tempest-ServerRescueTestJSONUnderV235-673623996 tempest-ServerRescueTestJSONUnderV235-673623996-project] [instance: 045a6f82-b3b7-47a7-bcfd-5c1fe9c73f33] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:14:07.467056 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-1b5631fd-4eae-48f4-bf01-996a10307708 tempest-ServerRescueTestJSONUnderV235-673623996 tempest-ServerRescueTestJSONUnderV235-673623996-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:14:07.467770 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-1b5631fd-4eae-48f4-bf01-996a10307708 tempest-ServerRescueTestJSONUnderV235-673623996 tempest-ServerRescueTestJSONUnderV235-673623996-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:14:07.468417 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-1b5631fd-4eae-48f4-bf01-996a10307708 tempest-ServerRescueTestJSONUnderV235-673623996 tempest-ServerRescueTestJSONUnderV235-673623996-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:14:07.469328 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-1b5631fd-4eae-48f4-bf01-996a10307708 tempest-ServerRescueTestJSONUnderV235-673623996 tempest-ServerRescueTestJSONUnderV235-673623996-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:14:07.469994 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-1b5631fd-4eae-48f4-bf01-996a10307708 tempest-ServerRescueTestJSONUnderV235-673623996 tempest-ServerRescueTestJSONUnderV235-673623996-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:14:07.470674 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-1b5631fd-4eae-48f4-bf01-996a10307708 tempest-ServerRescueTestJSONUnderV235-673623996 tempest-ServerRescueTestJSONUnderV235-673623996-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:14:08.213496 n-d-863052-2 devstack@n-api.service[121403]: DEBUG dbcounter [-] [121403] Writing DB stats nova_cell0:SELECT=4 {{(pid=121403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 19:14:08.480162 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-532c03dc-25b0-4909-b2b6-c92e3a99c0ec tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcf93260eaef487dac5d7bb00b26e3b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73cb8697de6d407ba82c334d9f2b48d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:14:08.504657 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-532c03dc-25b0-4909-b2b6-c92e3a99c0ec tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] 10.222.0.13 "GET /compute/v2.1/servers/cae1c729-7c41-488d-ab0e-30d1f5d22180" status: 200 len: 1680 microversion: 2.1 time: 2.547433 Nov 01 19:14:08.508566 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 2278/4523] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:14:05 2022] GET /compute/v2.1/servers/cae1c729-7c41-488d-ab0e-30d1f5d22180 => generated 1680 bytes in 2555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:14:08.526428 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-fa4127e5-2ea1-4e7e-be34-9d17593d0195 tempest-ListServersNegativeTestJSON-161318838 tempest-ListServersNegativeTestJSON-161318838-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:14:08.529548 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-fa4127e5-2ea1-4e7e-be34-9d17593d0195 tempest-ListServersNegativeTestJSON-161318838 tempest-ListServersNegativeTestJSON-161318838-project] [instance: 4bc22a5a-f58d-4ee6-8876-be5dc9e4ddb3] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:14:08.552831 n-d-863052-2 devstack@n-api.service[121403]: DEBUG dbcounter [-] [121403] Writing DB stats nova_cell0:SELECT=10 {{(pid=121403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 19:14:08.559068 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-fa4127e5-2ea1-4e7e-be34-9d17593d0195 tempest-ListServersNegativeTestJSON-161318838 tempest-ListServersNegativeTestJSON-161318838-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:14:08.559952 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-fa4127e5-2ea1-4e7e-be34-9d17593d0195 tempest-ListServersNegativeTestJSON-161318838 tempest-ListServersNegativeTestJSON-161318838-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:14:08.562785 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-fa4127e5-2ea1-4e7e-be34-9d17593d0195 tempest-ListServersNegativeTestJSON-161318838 tempest-ListServersNegativeTestJSON-161318838-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:14:08.563789 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-fa4127e5-2ea1-4e7e-be34-9d17593d0195 tempest-ListServersNegativeTestJSON-161318838 tempest-ListServersNegativeTestJSON-161318838-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:14:08.566391 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-fa4127e5-2ea1-4e7e-be34-9d17593d0195 tempest-ListServersNegativeTestJSON-161318838 tempest-ListServersNegativeTestJSON-161318838-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:14:08.567184 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-fa4127e5-2ea1-4e7e-be34-9d17593d0195 tempest-ListServersNegativeTestJSON-161318838 tempest-ListServersNegativeTestJSON-161318838-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:14:08.882893 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-1b5631fd-4eae-48f4-bf01-996a10307708 tempest-ServerRescueTestJSONUnderV235-673623996 tempest-ServerRescueTestJSONUnderV235-673623996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8b1291b1e654a658382af950eb43c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c9c687e2f2940bbabecdf42a0678132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:14:08.901849 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-1b5631fd-4eae-48f4-bf01-996a10307708 tempest-ServerRescueTestJSONUnderV235-673623996 tempest-ServerRescueTestJSONUnderV235-673623996-project] 10.222.0.13 "GET /compute/v2.1/servers/045a6f82-b3b7-47a7-bcfd-5c1fe9c73f33" status: 200 len: 1322 microversion: 2.1 time: 1.438185 Nov 01 19:14:08.916862 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 2246/4524] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:14:07 2022] GET /compute/v2.1/servers/045a6f82-b3b7-47a7-bcfd-5c1fe9c73f33 => generated 1322 bytes in 1448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:14:08.923993 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-1a8473ac-ae65-40b3-877f-f48c71150bd5 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:14:08.925376 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-1a8473ac-ae65-40b3-877f-f48c71150bd5 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] [instance: b27eaab4-a751-47fb-acdb-db7c99b06a5f] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:14:08.932492 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-1a8473ac-ae65-40b3-877f-f48c71150bd5 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:14:08.933337 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-1a8473ac-ae65-40b3-877f-f48c71150bd5 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:14:08.933939 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-1a8473ac-ae65-40b3-877f-f48c71150bd5 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:14:08.934816 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-1a8473ac-ae65-40b3-877f-f48c71150bd5 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:14:08.935433 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-1a8473ac-ae65-40b3-877f-f48c71150bd5 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:14:08.936268 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-1a8473ac-ae65-40b3-877f-f48c71150bd5 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:14:08.993570 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-fa4127e5-2ea1-4e7e-be34-9d17593d0195 tempest-ListServersNegativeTestJSON-161318838 tempest-ListServersNegativeTestJSON-161318838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f36624705974d12a093672679d9e283', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf1f96424adc43eeb0e489b2d6485790', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:14:09.002003 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-fa4127e5-2ea1-4e7e-be34-9d17593d0195 tempest-ListServersNegativeTestJSON-161318838 tempest-ListServersNegativeTestJSON-161318838-project] 10.222.0.13 "GET /compute/v2.1/servers/4bc22a5a-f58d-4ee6-8876-be5dc9e4ddb3" status: 200 len: 1280 microversion: 2.1 time: 0.488612 Nov 01 19:14:09.002588 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 2279/4525] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:14:08 2022] GET /compute/v2.1/servers/4bc22a5a-f58d-4ee6-8876-be5dc9e4ddb3 => generated 1280 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:14:09.532075 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-f88c874f-4722-411a-8ed1-dd7012c41a4c tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:14:09.533620 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-f88c874f-4722-411a-8ed1-dd7012c41a4c tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] [instance: cae1c729-7c41-488d-ab0e-30d1f5d22180] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:14:09.552436 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f88c874f-4722-411a-8ed1-dd7012c41a4c tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:14:09.558758 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f88c874f-4722-411a-8ed1-dd7012c41a4c tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:14:09.560989 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f88c874f-4722-411a-8ed1-dd7012c41a4c tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:14:09.561721 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f88c874f-4722-411a-8ed1-dd7012c41a4c tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:14:09.562203 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f88c874f-4722-411a-8ed1-dd7012c41a4c tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:14:09.574012 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-f88c874f-4722-411a-8ed1-dd7012c41a4c tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:14:09.607652 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-1a8473ac-ae65-40b3-877f-f48c71150bd5 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc5c19b930543f5a5091922a9859813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ecdc83933544a899117531a960027a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:14:09.616081 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-1a8473ac-ae65-40b3-877f-f48c71150bd5 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] 10.222.0.13 "GET /compute/v2.1/servers/b27eaab4-a751-47fb-acdb-db7c99b06a5f" status: 200 len: 1528 microversion: 2.1 time: 0.697607 Nov 01 19:14:09.620969 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 2247/4526] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:14:08 2022] GET /compute/v2.1/servers/b27eaab4-a751-47fb-acdb-db7c99b06a5f => generated 1528 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:14:09.930400 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-4d1f0f59-9c88-449f-a35c-fba8e87f5e02 tempest-ServerRescueTestJSONUnderV235-673623996 tempest-ServerRescueTestJSONUnderV235-673623996-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:14:09.932302 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-4d1f0f59-9c88-449f-a35c-fba8e87f5e02 tempest-ServerRescueTestJSONUnderV235-673623996 tempest-ServerRescueTestJSONUnderV235-673623996-project] [instance: 045a6f82-b3b7-47a7-bcfd-5c1fe9c73f33] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:14:09.951866 n-d-863052-2 devstack@n-api.service[121402]: DEBUG dbcounter [-] [121402] Writing DB stats nova_cell0:SELECT=8 {{(pid=121402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 19:14:09.963093 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-4d1f0f59-9c88-449f-a35c-fba8e87f5e02 tempest-ServerRescueTestJSONUnderV235-673623996 tempest-ServerRescueTestJSONUnderV235-673623996-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:14:09.963971 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-4d1f0f59-9c88-449f-a35c-fba8e87f5e02 tempest-ServerRescueTestJSONUnderV235-673623996 tempest-ServerRescueTestJSONUnderV235-673623996-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:14:09.964610 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-4d1f0f59-9c88-449f-a35c-fba8e87f5e02 tempest-ServerRescueTestJSONUnderV235-673623996 tempest-ServerRescueTestJSONUnderV235-673623996-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:14:09.965517 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-4d1f0f59-9c88-449f-a35c-fba8e87f5e02 tempest-ServerRescueTestJSONUnderV235-673623996 tempest-ServerRescueTestJSONUnderV235-673623996-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:14:09.966192 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-4d1f0f59-9c88-449f-a35c-fba8e87f5e02 tempest-ServerRescueTestJSONUnderV235-673623996 tempest-ServerRescueTestJSONUnderV235-673623996-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:14:09.969540 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-4d1f0f59-9c88-449f-a35c-fba8e87f5e02 tempest-ServerRescueTestJSONUnderV235-673623996 tempest-ServerRescueTestJSONUnderV235-673623996-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:14:11.186248 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-f88c874f-4722-411a-8ed1-dd7012c41a4c tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcf93260eaef487dac5d7bb00b26e3b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73cb8697de6d407ba82c334d9f2b48d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:14:11.195080 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-f88c874f-4722-411a-8ed1-dd7012c41a4c tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] 10.222.0.13 "GET /compute/v2.1/servers/cae1c729-7c41-488d-ab0e-30d1f5d22180" status: 200 len: 1680 microversion: 2.1 time: 1.667047 Nov 01 19:14:11.195683 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 2280/4527] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:14:09 2022] GET /compute/v2.1/servers/cae1c729-7c41-488d-ab0e-30d1f5d22180 => generated 1680 bytes in 1668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 19:14:11.214584 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-0f47b83a-34a5-4990-99d8-f698b8f96e7a tempest-ListServersNegativeTestJSON-161318838 tempest-ListServersNegativeTestJSON-161318838-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:14:11.215208 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-0f47b83a-34a5-4990-99d8-f698b8f96e7a tempest-ListServersNegativeTestJSON-161318838 tempest-ListServersNegativeTestJSON-161318838-project] [instance: 4bc22a5a-f58d-4ee6-8876-be5dc9e4ddb3] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:14:11.271403 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-0f47b83a-34a5-4990-99d8-f698b8f96e7a tempest-ListServersNegativeTestJSON-161318838 tempest-ListServersNegativeTestJSON-161318838-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:14:11.272162 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-0f47b83a-34a5-4990-99d8-f698b8f96e7a tempest-ListServersNegativeTestJSON-161318838 tempest-ListServersNegativeTestJSON-161318838-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:14:11.275126 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-0f47b83a-34a5-4990-99d8-f698b8f96e7a tempest-ListServersNegativeTestJSON-161318838 tempest-ListServersNegativeTestJSON-161318838-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:14:11.276053 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-0f47b83a-34a5-4990-99d8-f698b8f96e7a tempest-ListServersNegativeTestJSON-161318838 tempest-ListServersNegativeTestJSON-161318838-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:14:11.285341 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-0f47b83a-34a5-4990-99d8-f698b8f96e7a tempest-ListServersNegativeTestJSON-161318838 tempest-ListServersNegativeTestJSON-161318838-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:14:11.286030 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-0f47b83a-34a5-4990-99d8-f698b8f96e7a tempest-ListServersNegativeTestJSON-161318838 tempest-ListServersNegativeTestJSON-161318838-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:14:11.716821 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-0f47b83a-34a5-4990-99d8-f698b8f96e7a tempest-ListServersNegativeTestJSON-161318838 tempest-ListServersNegativeTestJSON-161318838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f36624705974d12a093672679d9e283', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf1f96424adc43eeb0e489b2d6485790', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:14:11.731556 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-0f47b83a-34a5-4990-99d8-f698b8f96e7a tempest-ListServersNegativeTestJSON-161318838 tempest-ListServersNegativeTestJSON-161318838-project] 10.222.0.13 "GET /compute/v2.1/servers/4bc22a5a-f58d-4ee6-8876-be5dc9e4ddb3" status: 200 len: 1280 microversion: 2.1 time: 0.534639 Nov 01 19:14:11.732084 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 2281/4528] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:14:11 2022] GET /compute/v2.1/servers/4bc22a5a-f58d-4ee6-8876-be5dc9e4ddb3 => generated 1280 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:14:11.741337 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-688c2ba9-9f57-4e2c-b3bb-bbfd3b36426b tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:14:11.742212 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-688c2ba9-9f57-4e2c-b3bb-bbfd3b36426b tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] [instance: b27eaab4-a751-47fb-acdb-db7c99b06a5f] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:14:11.768630 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-688c2ba9-9f57-4e2c-b3bb-bbfd3b36426b tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:14:11.769468 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-688c2ba9-9f57-4e2c-b3bb-bbfd3b36426b tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:14:11.770066 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-688c2ba9-9f57-4e2c-b3bb-bbfd3b36426b tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:14:11.771118 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-688c2ba9-9f57-4e2c-b3bb-bbfd3b36426b tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:14:11.771730 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-688c2ba9-9f57-4e2c-b3bb-bbfd3b36426b tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:14:11.772314 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-688c2ba9-9f57-4e2c-b3bb-bbfd3b36426b tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:14:13.511061 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-688c2ba9-9f57-4e2c-b3bb-bbfd3b36426b tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc5c19b930543f5a5091922a9859813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ecdc83933544a899117531a960027a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:14:13.525088 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-688c2ba9-9f57-4e2c-b3bb-bbfd3b36426b tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] 10.222.0.13 "GET /compute/v2.1/servers/b27eaab4-a751-47fb-acdb-db7c99b06a5f" status: 200 len: 1528 microversion: 2.1 time: 1.788835 Nov 01 19:14:13.529273 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 2282/4529] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:14:11 2022] GET /compute/v2.1/servers/b27eaab4-a751-47fb-acdb-db7c99b06a5f => generated 1528 bytes in 1796 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:14:13.561768 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [req-9984d01e-f561-4863-aeaa-fffea58e007c req-bdef9ea4-e813-4a28-b4d5-2c8847b465c1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "045a6f82-b3b7-47a7-bcfd-5c1fe9c73f33", "tag": "9f919ece-8580-4f40-ba86-fc03e5aa20d4"}]} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:14:13.614562 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-9984d01e-f561-4863-aeaa-fffea58e007c req-bdef9ea4-e813-4a28-b4d5-2c8847b465c1 service nova] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:14:13.615333 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-9984d01e-f561-4863-aeaa-fffea58e007c req-bdef9ea4-e813-4a28-b4d5-2c8847b465c1 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:14:13.615963 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-9984d01e-f561-4863-aeaa-fffea58e007c req-bdef9ea4-e813-4a28-b4d5-2c8847b465c1 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:14:13.655557 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.compute.server_external_events [req-9984d01e-f561-4863-aeaa-fffea58e007c req-bdef9ea4-e813-4a28-b4d5-2c8847b465c1 service nova] Creating event network-changed:9f919ece-8580-4f40-ba86-fc03e5aa20d4 for instance 045a6f82-b3b7-47a7-bcfd-5c1fe9c73f33 on n-h2-863052-2 Nov 01 19:14:13.662282 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [req-9984d01e-f561-4863-aeaa-fffea58e007c req-bdef9ea4-e813-4a28-b4d5-2c8847b465c1 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.130276 Nov 01 19:14:13.664710 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 2283/4530] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Nov 1 19:14:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:14:13.674321 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-a843d162-91eb-49db-b4ac-9c8eef455174 tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:14:13.675033 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-a843d162-91eb-49db-b4ac-9c8eef455174 tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] [instance: cae1c729-7c41-488d-ab0e-30d1f5d22180] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:14:13.697532 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-a843d162-91eb-49db-b4ac-9c8eef455174 tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:14:13.698049 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-a843d162-91eb-49db-b4ac-9c8eef455174 tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:14:13.698498 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-a843d162-91eb-49db-b4ac-9c8eef455174 tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:14:13.699226 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-a843d162-91eb-49db-b4ac-9c8eef455174 tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:14:13.699681 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-a843d162-91eb-49db-b4ac-9c8eef455174 tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:14:13.700106 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-a843d162-91eb-49db-b4ac-9c8eef455174 tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:14:13.833318 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-4d1f0f59-9c88-449f-a35c-fba8e87f5e02 tempest-ServerRescueTestJSONUnderV235-673623996 tempest-ServerRescueTestJSONUnderV235-673623996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8b1291b1e654a658382af950eb43c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c9c687e2f2940bbabecdf42a0678132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:14:13.855118 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-4d1f0f59-9c88-449f-a35c-fba8e87f5e02 tempest-ServerRescueTestJSONUnderV235-673623996 tempest-ServerRescueTestJSONUnderV235-673623996-project] 10.222.0.13 "GET /compute/v2.1/servers/045a6f82-b3b7-47a7-bcfd-5c1fe9c73f33" status: 200 len: 1322 microversion: 2.1 time: 3.922555 Nov 01 19:14:13.881097 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 2248/4531] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:14:09 2022] GET /compute/v2.1/servers/045a6f82-b3b7-47a7-bcfd-5c1fe9c73f33 => generated 1322 bytes in 3955 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 19:14:13.935966 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-994ca1cb-918a-47a6-8f41-0edb365eb7ba tempest-ListServersNegativeTestJSON-161318838 tempest-ListServersNegativeTestJSON-161318838-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:14:13.954291 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-994ca1cb-918a-47a6-8f41-0edb365eb7ba tempest-ListServersNegativeTestJSON-161318838 tempest-ListServersNegativeTestJSON-161318838-project] [instance: 4bc22a5a-f58d-4ee6-8876-be5dc9e4ddb3] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:14:13.999541 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-994ca1cb-918a-47a6-8f41-0edb365eb7ba tempest-ListServersNegativeTestJSON-161318838 tempest-ListServersNegativeTestJSON-161318838-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:14:14.000035 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-994ca1cb-918a-47a6-8f41-0edb365eb7ba tempest-ListServersNegativeTestJSON-161318838 tempest-ListServersNegativeTestJSON-161318838-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:14:14.000475 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-994ca1cb-918a-47a6-8f41-0edb365eb7ba tempest-ListServersNegativeTestJSON-161318838 tempest-ListServersNegativeTestJSON-161318838-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:14:14.027385 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-994ca1cb-918a-47a6-8f41-0edb365eb7ba tempest-ListServersNegativeTestJSON-161318838 tempest-ListServersNegativeTestJSON-161318838-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:14:14.030823 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-994ca1cb-918a-47a6-8f41-0edb365eb7ba tempest-ListServersNegativeTestJSON-161318838 tempest-ListServersNegativeTestJSON-161318838-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:14:14.034040 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-994ca1cb-918a-47a6-8f41-0edb365eb7ba tempest-ListServersNegativeTestJSON-161318838 tempest-ListServersNegativeTestJSON-161318838-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:14:14.116282 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-a843d162-91eb-49db-b4ac-9c8eef455174 tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcf93260eaef487dac5d7bb00b26e3b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73cb8697de6d407ba82c334d9f2b48d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:14:14.127448 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-a843d162-91eb-49db-b4ac-9c8eef455174 tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] 10.222.0.13 "GET /compute/v2.1/servers/cae1c729-7c41-488d-ab0e-30d1f5d22180" status: 200 len: 1680 microversion: 2.1 time: 0.461451 Nov 01 19:14:14.163698 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 2284/4532] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:14:13 2022] GET /compute/v2.1/servers/cae1c729-7c41-488d-ab0e-30d1f5d22180 => generated 1680 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:14:14.554214 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-7f8a2437-35f7-42c1-ba47-f404de0daf56 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:14:14.554818 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-7f8a2437-35f7-42c1-ba47-f404de0daf56 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] [instance: b27eaab4-a751-47fb-acdb-db7c99b06a5f] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:14:14.581862 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-7f8a2437-35f7-42c1-ba47-f404de0daf56 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:14:14.582759 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-7f8a2437-35f7-42c1-ba47-f404de0daf56 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:14:14.583524 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-7f8a2437-35f7-42c1-ba47-f404de0daf56 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:14:14.584971 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-7f8a2437-35f7-42c1-ba47-f404de0daf56 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:14:14.599179 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-7f8a2437-35f7-42c1-ba47-f404de0daf56 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:14:14.606095 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-7f8a2437-35f7-42c1-ba47-f404de0daf56 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:14:15.239985 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-7f8a2437-35f7-42c1-ba47-f404de0daf56 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc5c19b930543f5a5091922a9859813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ecdc83933544a899117531a960027a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:14:15.243681 n-d-863052-2 devstack@n-api.service[121403]: DEBUG dbcounter [-] [121403] Writing DB stats nova_cell1:SELECT=100 {{(pid=121403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 19:14:15.248834 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-7f8a2437-35f7-42c1-ba47-f404de0daf56 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] 10.222.0.13 "GET /compute/v2.1/servers/b27eaab4-a751-47fb-acdb-db7c99b06a5f" status: 200 len: 1528 microversion: 2.1 time: 0.701306 Nov 01 19:14:15.257781 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 2285/4533] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:14:14 2022] GET /compute/v2.1/servers/b27eaab4-a751-47fb-acdb-db7c99b06a5f => generated 1528 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:14:15.263419 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-cdde87b8-5451-42cc-99c4-10d8beff01f6 tempest-ServerRescueTestJSONUnderV235-673623996 tempest-ServerRescueTestJSONUnderV235-673623996-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:14:15.274332 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-cdde87b8-5451-42cc-99c4-10d8beff01f6 tempest-ServerRescueTestJSONUnderV235-673623996 tempest-ServerRescueTestJSONUnderV235-673623996-project] [instance: 045a6f82-b3b7-47a7-bcfd-5c1fe9c73f33] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:14:15.285341 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-cdde87b8-5451-42cc-99c4-10d8beff01f6 tempest-ServerRescueTestJSONUnderV235-673623996 tempest-ServerRescueTestJSONUnderV235-673623996-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:14:15.293616 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-cdde87b8-5451-42cc-99c4-10d8beff01f6 tempest-ServerRescueTestJSONUnderV235-673623996 tempest-ServerRescueTestJSONUnderV235-673623996-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:14:15.294072 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-cdde87b8-5451-42cc-99c4-10d8beff01f6 tempest-ServerRescueTestJSONUnderV235-673623996 tempest-ServerRescueTestJSONUnderV235-673623996-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:14:15.294823 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-cdde87b8-5451-42cc-99c4-10d8beff01f6 tempest-ServerRescueTestJSONUnderV235-673623996 tempest-ServerRescueTestJSONUnderV235-673623996-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:14:15.295285 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-cdde87b8-5451-42cc-99c4-10d8beff01f6 tempest-ServerRescueTestJSONUnderV235-673623996 tempest-ServerRescueTestJSONUnderV235-673623996-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:14:15.295709 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-cdde87b8-5451-42cc-99c4-10d8beff01f6 tempest-ServerRescueTestJSONUnderV235-673623996 tempest-ServerRescueTestJSONUnderV235-673623996-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:14:15.746701 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-994ca1cb-918a-47a6-8f41-0edb365eb7ba tempest-ListServersNegativeTestJSON-161318838 tempest-ListServersNegativeTestJSON-161318838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f36624705974d12a093672679d9e283', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf1f96424adc43eeb0e489b2d6485790', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:14:15.760886 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-994ca1cb-918a-47a6-8f41-0edb365eb7ba tempest-ListServersNegativeTestJSON-161318838 tempest-ListServersNegativeTestJSON-161318838-project] 10.222.0.13 "GET /compute/v2.1/servers/4bc22a5a-f58d-4ee6-8876-be5dc9e4ddb3" status: 200 len: 1322 microversion: 2.1 time: 1.877968 Nov 01 19:14:15.764656 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 2249/4534] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:14:13 2022] GET /compute/v2.1/servers/4bc22a5a-f58d-4ee6-8876-be5dc9e4ddb3 => generated 1322 bytes in 1882 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:14:15.798107 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-40f34c75-31cd-45ea-a311-6176cbc86480 tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:14:15.807061 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-40f34c75-31cd-45ea-a311-6176cbc86480 tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] [instance: cae1c729-7c41-488d-ab0e-30d1f5d22180] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:14:15.845703 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-40f34c75-31cd-45ea-a311-6176cbc86480 tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:14:15.852003 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-40f34c75-31cd-45ea-a311-6176cbc86480 tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:14:15.855227 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-40f34c75-31cd-45ea-a311-6176cbc86480 tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:14:15.856834 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-40f34c75-31cd-45ea-a311-6176cbc86480 tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:14:15.864116 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-40f34c75-31cd-45ea-a311-6176cbc86480 tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:14:15.867277 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-40f34c75-31cd-45ea-a311-6176cbc86480 tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:14:16.506406 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-cdde87b8-5451-42cc-99c4-10d8beff01f6 tempest-ServerRescueTestJSONUnderV235-673623996 tempest-ServerRescueTestJSONUnderV235-673623996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8b1291b1e654a658382af950eb43c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c9c687e2f2940bbabecdf42a0678132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:14:16.526434 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-cdde87b8-5451-42cc-99c4-10d8beff01f6 tempest-ServerRescueTestJSONUnderV235-673623996 tempest-ServerRescueTestJSONUnderV235-673623996-project] 10.222.0.13 "GET /compute/v2.1/servers/045a6f82-b3b7-47a7-bcfd-5c1fe9c73f33" status: 200 len: 1322 microversion: 2.1 time: 1.267173 Nov 01 19:14:16.531062 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 2286/4535] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:14:15 2022] GET /compute/v2.1/servers/045a6f82-b3b7-47a7-bcfd-5c1fe9c73f33 => generated 1322 bytes in 1272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:14:16.549085 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-41f0b269-d599-4d3f-8a05-d8ed11d311cd tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:14:16.549704 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-41f0b269-d599-4d3f-8a05-d8ed11d311cd tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] [instance: b27eaab4-a751-47fb-acdb-db7c99b06a5f] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:14:16.583107 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-41f0b269-d599-4d3f-8a05-d8ed11d311cd tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:14:16.583576 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-41f0b269-d599-4d3f-8a05-d8ed11d311cd tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:14:16.584004 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-41f0b269-d599-4d3f-8a05-d8ed11d311cd tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:14:16.584748 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-41f0b269-d599-4d3f-8a05-d8ed11d311cd tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:14:16.585203 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-41f0b269-d599-4d3f-8a05-d8ed11d311cd tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:14:16.585624 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-41f0b269-d599-4d3f-8a05-d8ed11d311cd tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:14:17.248316 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-41f0b269-d599-4d3f-8a05-d8ed11d311cd tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc5c19b930543f5a5091922a9859813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ecdc83933544a899117531a960027a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:14:17.264909 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-41f0b269-d599-4d3f-8a05-d8ed11d311cd tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] 10.222.0.13 "GET /compute/v2.1/servers/b27eaab4-a751-47fb-acdb-db7c99b06a5f" status: 200 len: 1528 microversion: 2.1 time: 0.723214 Nov 01 19:14:17.267759 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 2287/4536] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:14:16 2022] GET /compute/v2.1/servers/b27eaab4-a751-47fb-acdb-db7c99b06a5f => generated 1528 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:14:17.278530 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-c06e2706-9e30-4479-a067-ba0aac053bc9 tempest-ListServersNegativeTestJSON-161318838 tempest-ListServersNegativeTestJSON-161318838-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:14:17.288115 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-c06e2706-9e30-4479-a067-ba0aac053bc9 tempest-ListServersNegativeTestJSON-161318838 tempest-ListServersNegativeTestJSON-161318838-project] [instance: 4bc22a5a-f58d-4ee6-8876-be5dc9e4ddb3] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:14:17.318575 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-c06e2706-9e30-4479-a067-ba0aac053bc9 tempest-ListServersNegativeTestJSON-161318838 tempest-ListServersNegativeTestJSON-161318838-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:14:17.320224 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-c06e2706-9e30-4479-a067-ba0aac053bc9 tempest-ListServersNegativeTestJSON-161318838 tempest-ListServersNegativeTestJSON-161318838-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:14:17.324634 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-c06e2706-9e30-4479-a067-ba0aac053bc9 tempest-ListServersNegativeTestJSON-161318838 tempest-ListServersNegativeTestJSON-161318838-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:14:17.329233 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-c06e2706-9e30-4479-a067-ba0aac053bc9 tempest-ListServersNegativeTestJSON-161318838 tempest-ListServersNegativeTestJSON-161318838-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:14:17.332605 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-c06e2706-9e30-4479-a067-ba0aac053bc9 tempest-ListServersNegativeTestJSON-161318838 tempest-ListServersNegativeTestJSON-161318838-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:14:17.333539 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-c06e2706-9e30-4479-a067-ba0aac053bc9 tempest-ListServersNegativeTestJSON-161318838 tempest-ListServersNegativeTestJSON-161318838-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:14:17.429102 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-40f34c75-31cd-45ea-a311-6176cbc86480 tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcf93260eaef487dac5d7bb00b26e3b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73cb8697de6d407ba82c334d9f2b48d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:14:17.442512 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-40f34c75-31cd-45ea-a311-6176cbc86480 tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] 10.222.0.13 "GET /compute/v2.1/servers/cae1c729-7c41-488d-ab0e-30d1f5d22180" status: 200 len: 1667 microversion: 2.1 time: 1.676450 Nov 01 19:14:17.449381 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 2250/4537] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:14:15 2022] GET /compute/v2.1/servers/cae1c729-7c41-488d-ab0e-30d1f5d22180 => generated 1667 bytes in 1684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:14:17.461076 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [req-7337e81d-e6b3-4f98-8958-2504b796f84b req-4fd4e979-bb87-4bc0-861d-c79cb1d59cec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "21599026-c30e-410e-94d2-61501021fa86", "tag": "f9f99154-91d6-4e07-9759-9bb27a50f5b7"}]} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:14:17.485539 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-7337e81d-e6b3-4f98-8958-2504b796f84b req-4fd4e979-bb87-4bc0-861d-c79cb1d59cec service nova] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:14:17.487804 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-7337e81d-e6b3-4f98-8958-2504b796f84b req-4fd4e979-bb87-4bc0-861d-c79cb1d59cec service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:14:17.489093 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-7337e81d-e6b3-4f98-8958-2504b796f84b req-4fd4e979-bb87-4bc0-861d-c79cb1d59cec service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:14:17.514956 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.compute.server_external_events [req-7337e81d-e6b3-4f98-8958-2504b796f84b req-4fd4e979-bb87-4bc0-861d-c79cb1d59cec service nova] Creating event network-changed:f9f99154-91d6-4e07-9759-9bb27a50f5b7 for instance 21599026-c30e-410e-94d2-61501021fa86 on n-h2-863052-2 Nov 01 19:14:17.531928 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [req-7337e81d-e6b3-4f98-8958-2504b796f84b req-4fd4e979-bb87-4bc0-861d-c79cb1d59cec service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079262 Nov 01 19:14:17.532868 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 2251/4538] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Nov 1 19:14:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:14:17.558134 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-93a10ad4-156d-4c86-9c2d-29707d45a680 tempest-ServerRescueTestJSONUnderV235-673623996 tempest-ServerRescueTestJSONUnderV235-673623996-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:14:17.559003 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-93a10ad4-156d-4c86-9c2d-29707d45a680 tempest-ServerRescueTestJSONUnderV235-673623996 tempest-ServerRescueTestJSONUnderV235-673623996-project] [instance: 045a6f82-b3b7-47a7-bcfd-5c1fe9c73f33] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:14:17.570943 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-93a10ad4-156d-4c86-9c2d-29707d45a680 tempest-ServerRescueTestJSONUnderV235-673623996 tempest-ServerRescueTestJSONUnderV235-673623996-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:14:17.574536 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-93a10ad4-156d-4c86-9c2d-29707d45a680 tempest-ServerRescueTestJSONUnderV235-673623996 tempest-ServerRescueTestJSONUnderV235-673623996-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:14:17.577005 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-93a10ad4-156d-4c86-9c2d-29707d45a680 tempest-ServerRescueTestJSONUnderV235-673623996 tempest-ServerRescueTestJSONUnderV235-673623996-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:14:17.577999 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-93a10ad4-156d-4c86-9c2d-29707d45a680 tempest-ServerRescueTestJSONUnderV235-673623996 tempest-ServerRescueTestJSONUnderV235-673623996-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:14:17.579275 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-93a10ad4-156d-4c86-9c2d-29707d45a680 tempest-ServerRescueTestJSONUnderV235-673623996 tempest-ServerRescueTestJSONUnderV235-673623996-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:14:17.581051 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-93a10ad4-156d-4c86-9c2d-29707d45a680 tempest-ServerRescueTestJSONUnderV235-673623996 tempest-ServerRescueTestJSONUnderV235-673623996-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:14:17.996195 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-93a10ad4-156d-4c86-9c2d-29707d45a680 tempest-ServerRescueTestJSONUnderV235-673623996 tempest-ServerRescueTestJSONUnderV235-673623996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8b1291b1e654a658382af950eb43c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c9c687e2f2940bbabecdf42a0678132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:14:18.004525 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-93a10ad4-156d-4c86-9c2d-29707d45a680 tempest-ServerRescueTestJSONUnderV235-673623996 tempest-ServerRescueTestJSONUnderV235-673623996-project] 10.222.0.13 "GET /compute/v2.1/servers/045a6f82-b3b7-47a7-bcfd-5c1fe9c73f33" status: 200 len: 1322 microversion: 2.1 time: 0.451670 Nov 01 19:14:18.009429 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 2252/4539] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:14:17 2022] GET /compute/v2.1/servers/045a6f82-b3b7-47a7-bcfd-5c1fe9c73f33 => generated 1322 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:14:18.014354 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-14558e13-a9bf-4022-bd78-201b86361dff tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:14:18.021841 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-14558e13-a9bf-4022-bd78-201b86361dff tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] [instance: cae1c729-7c41-488d-ab0e-30d1f5d22180] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:14:18.034566 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-14558e13-a9bf-4022-bd78-201b86361dff tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:14:18.035066 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-14558e13-a9bf-4022-bd78-201b86361dff tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:14:18.035503 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-14558e13-a9bf-4022-bd78-201b86361dff tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:14:18.036215 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-14558e13-a9bf-4022-bd78-201b86361dff tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:14:18.036742 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-14558e13-a9bf-4022-bd78-201b86361dff tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:14:18.048856 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-14558e13-a9bf-4022-bd78-201b86361dff tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:14:18.299956 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-14558e13-a9bf-4022-bd78-201b86361dff tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcf93260eaef487dac5d7bb00b26e3b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73cb8697de6d407ba82c334d9f2b48d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:14:18.308646 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-14558e13-a9bf-4022-bd78-201b86361dff tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] 10.222.0.13 "GET /compute/v2.1/servers/cae1c729-7c41-488d-ab0e-30d1f5d22180" status: 200 len: 1667 microversion: 2.1 time: 0.297883 Nov 01 19:14:18.309259 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 2253/4540] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:14:18 2022] GET /compute/v2.1/servers/cae1c729-7c41-488d-ab0e-30d1f5d22180 => generated 1667 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:14:18.703210 n-d-863052-2 devstack@n-api.service[121403]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 01 19:14:18.703661 n-d-863052-2 devstack@n-api.service[121403]: Tue Nov 1 19:14:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/4bc22a5a-f58d-4ee6-8876-be5dc9e4ddb3 (ip 10.222.0.13) !!! Nov 01 19:14:18.742235 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-2e883e78-25de-4914-ad4b-379251c99148 tempest-FloatingIPDetailsNegativeTestJSON-988667450 tempest-FloatingIPDetailsNegativeTestJSON-988667450-project] Calling method '.version_select at 0x7f0ae179a040>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:14:18.988252 n-d-863052-2 devstack@n-api.service[121402]: DEBUG neutronclient.v2_0.client [None req-2e883e78-25de-4914-ad4b-379251c99148 tempest-FloatingIPDetailsNegativeTestJSON-988667450 tempest-FloatingIPDetailsNegativeTestJSON-988667450-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 71f695ad-c1dd-43f9-aca7-87a6a278fc7a could not be found", "detail": ""}} {{(pid=121402) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Nov 01 19:14:18.989206 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.wsgi [None req-2e883e78-25de-4914-ad4b-379251c99148 tempest-FloatingIPDetailsNegativeTestJSON-988667450 tempest-FloatingIPDetailsNegativeTestJSON-988667450-project] HTTP exception thrown: Floating IP not found for ID 71f695ad-c1dd-43f9-aca7-87a6a278fc7a Nov 01 19:14:18.993065 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-2e883e78-25de-4914-ad4b-379251c99148 tempest-FloatingIPDetailsNegativeTestJSON-988667450 tempest-FloatingIPDetailsNegativeTestJSON-988667450-project] Request method failure captured: Nov 01 19:14:18.993065 n-d-863052-2 devstack@n-api.service[121402]: request: GET /compute/v2.1/os-floating-ips/71f695ad-c1dd-43f9-aca7-87a6a278fc7a HTTP/1.1 Nov 01 19:14:18.993065 n-d-863052-2 devstack@n-api.service[121402]: Accept: application/json Nov 01 19:14:18.993065 n-d-863052-2 devstack@n-api.service[121402]: Accept-Encoding: identity Nov 01 19:14:18.993065 n-d-863052-2 devstack@n-api.service[121402]: Connection: close Nov 01 19:14:18.993065 n-d-863052-2 devstack@n-api.service[121402]: Content-Length: 0 Nov 01 19:14:18.993065 n-d-863052-2 devstack@n-api.service[121402]: Content-Type: application/json Nov 01 19:14:18.993065 n-d-863052-2 devstack@n-api.service[121402]: Host: 10.222.0.13 Nov 01 19:14:18.993065 n-d-863052-2 devstack@n-api.service[121402]: Openstack-System-Scope: None Nov 01 19:14:18.993065 n-d-863052-2 devstack@n-api.service[121402]: User-Agent: python-urllib3/1.26.12 Nov 01 19:14:18.993065 n-d-863052-2 devstack@n-api.service[121402]: X-Auth-Token: gAAAAABjYXAJI20vwN2aDqQwpSxjM0EEe575_4GBS-Wqsk1iY0MzzKsnS1sWY-fcz39brMqoaD4nRLoe70WDrMjQAbuP7FB5JlEoK3hKuHlwJGblevxGMHhLByxWci4ROaguTidgatPAO-c4_0NUnpu_YXvep93jjCL59LVLboYDxTS5pG3aPS8 Nov 01 19:14:18.993065 n-d-863052-2 devstack@n-api.service[121402]: X-Domain-Id: None Nov 01 19:14:18.993065 n-d-863052-2 devstack@n-api.service[121402]: X-Domain-Name: None Nov 01 19:14:18.993065 n-d-863052-2 devstack@n-api.service[121402]: X-Identity-Status: Confirmed Nov 01 19:14:18.993065 n-d-863052-2 devstack@n-api.service[121402]: X-Is-Admin-Project: True Nov 01 19:14:18.993065 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Domain-Id: default Nov 01 19:14:18.993065 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Domain-Name: Default Nov 01 19:14:18.993065 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Id: 2223f720612d4900bc4c653852ec244d Nov 01 19:14:18.993065 n-d-863052-2 devstack@n-api.service[121402]: X-Project-Name: tempest-FloatingIPDetailsNegativeTestJSON-988667450 Nov 01 19:14:18.993065 n-d-863052-2 devstack@n-api.service[121402]: X-Role: member,reader Nov 01 19:14:18.993065 n-d-863052-2 devstack@n-api.service[121402]: X-Roles: member,reader Nov 01 19:14:18.993065 n-d-863052-2 devstack@n-api.service[121402]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/2223f720612d4900bc4c653852ec244d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/2223f720612d4900bc4c653852ec244d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_2223f720612d4900bc4c653852ec244d", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/2223f720612d4900bc4c653852ec244d"}]}] Nov 01 19:14:18.993065 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant: tempest-FloatingIPDetailsNegativeTestJSON-988667450 Nov 01 19:14:18.993065 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant-Id: 2223f720612d4900bc4c653852ec244d Nov 01 19:14:18.993065 n-d-863052-2 devstack@n-api.service[121402]: X-Tenant-Name: tempest-FloatingIPDetailsNegativeTestJSON-988667450 Nov 01 19:14:18.993065 n-d-863052-2 devstack@n-api.service[121402]: X-User: tempest-FloatingIPDetailsNegativeTestJSON-988667450-project Nov 01 19:14:18.993065 n-d-863052-2 devstack@n-api.service[121402]: X-User-Domain-Id: default Nov 01 19:14:18.993065 n-d-863052-2 devstack@n-api.service[121402]: X-User-Domain-Name: Default Nov 01 19:14:18.993065 n-d-863052-2 devstack@n-api.service[121402]: X-User-Id: f39ff4b153c049f990f6ac080c1a410a Nov 01 19:14:18.993065 n-d-863052-2 devstack@n-api.service[121402]: X-User-Name: tempest-FloatingIPDetailsNegativeTestJSON-988667450-project Nov 01 19:14:18.993065 n-d-863052-2 devstack@n-api.service[121402]: method: Nov 01 19:14:18.993065 n-d-863052-2 devstack@n-api.service[121402]: exception: Floating IP not found for ID 71f695ad-c1dd-43f9-aca7-87a6a278fc7a Nov 01 19:14:18.993065 n-d-863052-2 devstack@n-api.service[121402]: action_args: {'id': '71f695ad-c1dd-43f9-aca7-87a6a278fc7a'} Nov 01 19:14:18.993065 n-d-863052-2 devstack@n-api.service[121402]: {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 01 19:14:18.993065 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:14:18.993065 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Nov 01 19:14:18.993065 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Nov 01 19:14:18.993065 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 01 19:14:18.993065 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 01 19:14:18.993065 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1008, in show_floatingip Nov 01 19:14:18.993065 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Nov 01 19:14:18.993065 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 01 19:14:18.993065 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 01 19:14:18.993065 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 01 19:14:18.993065 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 01 19:14:18.993065 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 01 19:14:18.993065 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 01 19:14:18.993065 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 01 19:14:18.993065 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 01 19:14:18.993065 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 01 19:14:18.993065 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 01 19:14:18.993065 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Nov 01 19:14:18.993065 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Nov 01 19:14:18.993065 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 01 19:14:18.993065 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 01 19:14:18.993065 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Nov 01 19:14:18.993065 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Nov 01 19:14:18.993065 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Nov 01 19:14:18.993065 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Nov 01 19:14:18.993065 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 71f695ad-c1dd-43f9-aca7-87a6a278fc7a could not be found Nov 01 19:14:18.993065 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b1d604ab-2a97-497e-8cd0-22b380ebbea9'] Nov 01 19:14:18.997909 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:14:18.997909 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:14:18.997909 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:14:18.997909 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:14:18.997909 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 94, in show Nov 01 19:14:18.997909 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Nov 01 19:14:18.997909 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Nov 01 19:14:18.997909 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Nov 01 19:14:18.997909 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 71f695ad-c1dd-43f9-aca7-87a6a278fc7a. Nov 01 19:14:18.997909 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:14:18.997909 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:14:18.997909 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:14:18.997909 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:14:18.997909 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:14:18.997909 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:14:18.997909 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 01 19:14:18.997909 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 01 19:14:18.997909 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 01 19:14:18.997909 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 01 19:14:18.997909 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 01 19:14:18.997909 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 01 19:14:18.997909 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 97, in show Nov 01 19:14:18.997909 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Nov 01 19:14:18.997909 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 71f695ad-c1dd-43f9-aca7-87a6a278fc7a Nov 01 19:14:18.997909 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:14:18.997909 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 01 19:14:18.997909 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:14:18.997909 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 01 19:14:18.997909 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 01 19:14:18.997909 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 01 19:14:18.997909 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 01 19:14:18.997909 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 01 19:14:18.997909 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 71f695ad-c1dd-43f9-aca7-87a6a278fc7a Nov 01 19:14:18.997909 n-d-863052-2 devstack@n-api.service[121402]: ERROR nova.api.openstack.wsgi Nov 01 19:14:19.004545 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-2e883e78-25de-4914-ad4b-379251c99148 tempest-FloatingIPDetailsNegativeTestJSON-988667450 tempest-FloatingIPDetailsNegativeTestJSON-988667450-project] Returning 404 to user: Floating IP not found for ID 71f695ad-c1dd-43f9-aca7-87a6a278fc7a {{(pid=121402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 01 19:14:19.004545 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-2e883e78-25de-4914-ad4b-379251c99148 tempest-FloatingIPDetailsNegativeTestJSON-988667450 tempest-FloatingIPDetailsNegativeTestJSON-988667450-project] 10.222.0.13 "GET /compute/v2.1/os-floating-ips/71f695ad-c1dd-43f9-aca7-87a6a278fc7a" status: 404 len: 111 microversion: 2.1 time: 0.694035 Nov 01 19:14:19.005492 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 2254/4541] 10.222.0.13 () {58 vars in 1260 bytes} [Tue Nov 1 19:14:18 2022] GET /compute/v2.1/os-floating-ips/71f695ad-c1dd-43f9-aca7-87a6a278fc7a => generated 111 bytes in 696 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 01 19:14:19.010728 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-efffcefc-6f3d-4c5d-9bd4-fb788fe33419 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:14:19.023182 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-efffcefc-6f3d-4c5d-9bd4-fb788fe33419 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] [instance: b27eaab4-a751-47fb-acdb-db7c99b06a5f] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:14:19.052733 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-efffcefc-6f3d-4c5d-9bd4-fb788fe33419 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:14:19.057227 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-efffcefc-6f3d-4c5d-9bd4-fb788fe33419 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:14:19.057758 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-efffcefc-6f3d-4c5d-9bd4-fb788fe33419 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:14:19.059389 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-efffcefc-6f3d-4c5d-9bd4-fb788fe33419 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:14:19.061539 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-efffcefc-6f3d-4c5d-9bd4-fb788fe33419 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:14:19.066472 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-efffcefc-6f3d-4c5d-9bd4-fb788fe33419 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:14:19.168436 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-c06e2706-9e30-4479-a067-ba0aac053bc9 tempest-ListServersNegativeTestJSON-161318838 tempest-ListServersNegativeTestJSON-161318838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f36624705974d12a093672679d9e283', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf1f96424adc43eeb0e489b2d6485790', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:14:19.188696 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-c06e2706-9e30-4479-a067-ba0aac053bc9 tempest-ListServersNegativeTestJSON-161318838 tempest-ListServersNegativeTestJSON-161318838-project] 10.222.0.13 "GET /compute/v2.1/servers/4bc22a5a-f58d-4ee6-8876-be5dc9e4ddb3" status: 200 len: 1322 microversion: 2.1 time: 1.913385 Nov 01 19:14:19.190159 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 2288/4542] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:14:17 2022] GET /compute/v2.1/servers/4bc22a5a-f58d-4ee6-8876-be5dc9e4ddb3 => generated 1322 bytes in 1920 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:14:19.199289 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-967b7a20-27d5-4b71-b976-2806288e040d tempest-ServerRescueTestJSONUnderV235-673623996 tempest-ServerRescueTestJSONUnderV235-673623996-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:14:19.202498 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-967b7a20-27d5-4b71-b976-2806288e040d tempest-ServerRescueTestJSONUnderV235-673623996 tempest-ServerRescueTestJSONUnderV235-673623996-project] [instance: 045a6f82-b3b7-47a7-bcfd-5c1fe9c73f33] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:14:19.216228 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-967b7a20-27d5-4b71-b976-2806288e040d tempest-ServerRescueTestJSONUnderV235-673623996 tempest-ServerRescueTestJSONUnderV235-673623996-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:14:19.219372 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-967b7a20-27d5-4b71-b976-2806288e040d tempest-ServerRescueTestJSONUnderV235-673623996 tempest-ServerRescueTestJSONUnderV235-673623996-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:14:19.224398 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-967b7a20-27d5-4b71-b976-2806288e040d tempest-ServerRescueTestJSONUnderV235-673623996 tempest-ServerRescueTestJSONUnderV235-673623996-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:14:19.225655 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-967b7a20-27d5-4b71-b976-2806288e040d tempest-ServerRescueTestJSONUnderV235-673623996 tempest-ServerRescueTestJSONUnderV235-673623996-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:14:19.226295 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-967b7a20-27d5-4b71-b976-2806288e040d tempest-ServerRescueTestJSONUnderV235-673623996 tempest-ServerRescueTestJSONUnderV235-673623996-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:14:19.226893 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-967b7a20-27d5-4b71-b976-2806288e040d tempest-ServerRescueTestJSONUnderV235-673623996 tempest-ServerRescueTestJSONUnderV235-673623996-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:14:19.280989 n-d-863052-2 devstack@n-api.service[121402]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 01 19:14:19.281214 n-d-863052-2 devstack@n-api.service[121402]: Tue Nov 1 19:14:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/b27eaab4-a751-47fb-acdb-db7c99b06a5f (ip 10.222.0.13) !!! Nov 01 19:14:20.371369 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-967b7a20-27d5-4b71-b976-2806288e040d tempest-ServerRescueTestJSONUnderV235-673623996 tempest-ServerRescueTestJSONUnderV235-673623996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8b1291b1e654a658382af950eb43c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c9c687e2f2940bbabecdf42a0678132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:14:20.387350 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-967b7a20-27d5-4b71-b976-2806288e040d tempest-ServerRescueTestJSONUnderV235-673623996 tempest-ServerRescueTestJSONUnderV235-673623996-project] 10.222.0.13 "GET /compute/v2.1/servers/045a6f82-b3b7-47a7-bcfd-5c1fe9c73f33" status: 200 len: 1322 microversion: 2.1 time: 1.195569 Nov 01 19:14:20.388519 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 2289/4543] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:14:19 2022] GET /compute/v2.1/servers/045a6f82-b3b7-47a7-bcfd-5c1fe9c73f33 => generated 1322 bytes in 1197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:14:20.393325 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-ee90bf63-1126-4f32-bd37-78b6553073ea tempest-ListServersNegativeTestJSON-161318838 tempest-ListServersNegativeTestJSON-161318838-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:14:20.394402 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-ee90bf63-1126-4f32-bd37-78b6553073ea tempest-ListServersNegativeTestJSON-161318838 tempest-ListServersNegativeTestJSON-161318838-project] [instance: 4bc22a5a-f58d-4ee6-8876-be5dc9e4ddb3] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:14:20.414518 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-ee90bf63-1126-4f32-bd37-78b6553073ea tempest-ListServersNegativeTestJSON-161318838 tempest-ListServersNegativeTestJSON-161318838-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:14:20.415076 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-ee90bf63-1126-4f32-bd37-78b6553073ea tempest-ListServersNegativeTestJSON-161318838 tempest-ListServersNegativeTestJSON-161318838-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:14:20.415501 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-ee90bf63-1126-4f32-bd37-78b6553073ea tempest-ListServersNegativeTestJSON-161318838 tempest-ListServersNegativeTestJSON-161318838-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:14:20.416206 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-ee90bf63-1126-4f32-bd37-78b6553073ea tempest-ListServersNegativeTestJSON-161318838 tempest-ListServersNegativeTestJSON-161318838-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:14:20.416680 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-ee90bf63-1126-4f32-bd37-78b6553073ea tempest-ListServersNegativeTestJSON-161318838 tempest-ListServersNegativeTestJSON-161318838-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:14:20.417102 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-ee90bf63-1126-4f32-bd37-78b6553073ea tempest-ListServersNegativeTestJSON-161318838 tempest-ListServersNegativeTestJSON-161318838-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:14:20.740077 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-efffcefc-6f3d-4c5d-9bd4-fb788fe33419 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc5c19b930543f5a5091922a9859813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ecdc83933544a899117531a960027a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:14:20.750089 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-efffcefc-6f3d-4c5d-9bd4-fb788fe33419 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] 10.222.0.13 "GET /compute/v2.1/servers/b27eaab4-a751-47fb-acdb-db7c99b06a5f" status: 200 len: 1528 microversion: 2.1 time: 1.743255 Nov 01 19:14:20.755930 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 2255/4544] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:14:19 2022] GET /compute/v2.1/servers/b27eaab4-a751-47fb-acdb-db7c99b06a5f => generated 1528 bytes in 1750 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:14:20.769731 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [req-ea308c8c-5824-4d1d-a32b-ba566f56962e req-585f773b-8bf7-4e22-9331-d731d6dfcaa9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4bc22a5a-f58d-4ee6-8876-be5dc9e4ddb3", "tag": "e506c7df-7915-4290-bf95-63abccd76c4a"}]} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:14:20.801824 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-ea308c8c-5824-4d1d-a32b-ba566f56962e req-585f773b-8bf7-4e22-9331-d731d6dfcaa9 service nova] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:14:20.804129 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-ea308c8c-5824-4d1d-a32b-ba566f56962e req-585f773b-8bf7-4e22-9331-d731d6dfcaa9 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:14:20.806128 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-ea308c8c-5824-4d1d-a32b-ba566f56962e req-585f773b-8bf7-4e22-9331-d731d6dfcaa9 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:14:20.829427 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.compute.server_external_events [req-ea308c8c-5824-4d1d-a32b-ba566f56962e req-585f773b-8bf7-4e22-9331-d731d6dfcaa9 service nova] Creating event network-changed:e506c7df-7915-4290-bf95-63abccd76c4a for instance 4bc22a5a-f58d-4ee6-8876-be5dc9e4ddb3 on n-h2-863052-2 Nov 01 19:14:20.842253 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [req-ea308c8c-5824-4d1d-a32b-ba566f56962e req-585f773b-8bf7-4e22-9331-d731d6dfcaa9 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084609 Nov 01 19:14:20.846472 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 2256/4545] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Nov 1 19:14:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:14:20.952835 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-49ae9fec-d107-4714-85e5-8c9fa18c57d1 tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:14:20.953870 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-49ae9fec-d107-4714-85e5-8c9fa18c57d1 tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] [instance: cae1c729-7c41-488d-ab0e-30d1f5d22180] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:14:20.961507 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-49ae9fec-d107-4714-85e5-8c9fa18c57d1 tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:14:20.962824 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-49ae9fec-d107-4714-85e5-8c9fa18c57d1 tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:14:20.963580 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-49ae9fec-d107-4714-85e5-8c9fa18c57d1 tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:14:20.964521 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-49ae9fec-d107-4714-85e5-8c9fa18c57d1 tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:14:20.965245 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-49ae9fec-d107-4714-85e5-8c9fa18c57d1 tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:14:20.966139 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-49ae9fec-d107-4714-85e5-8c9fa18c57d1 tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:14:21.145954 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-ee90bf63-1126-4f32-bd37-78b6553073ea tempest-ListServersNegativeTestJSON-161318838 tempest-ListServersNegativeTestJSON-161318838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f36624705974d12a093672679d9e283', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf1f96424adc43eeb0e489b2d6485790', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:14:21.158120 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-ee90bf63-1126-4f32-bd37-78b6553073ea tempest-ListServersNegativeTestJSON-161318838 tempest-ListServersNegativeTestJSON-161318838-project] 10.222.0.13 "GET /compute/v2.1/servers/4bc22a5a-f58d-4ee6-8876-be5dc9e4ddb3" status: 200 len: 1322 microversion: 2.1 time: 0.768342 Nov 01 19:14:21.163745 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 2290/4546] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:14:20 2022] GET /compute/v2.1/servers/4bc22a5a-f58d-4ee6-8876-be5dc9e4ddb3 => generated 1322 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:14:21.373677 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [req-faace822-f35f-48cc-ac9c-52d71aa1c1b1 req-be2ae8ab-be62-440a-8b8c-c966a1e390e9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cae1c729-7c41-488d-ab0e-30d1f5d22180", "name": "network-vif-unplugged", "status": "completed", "tag": "3533eeb6-f9e6-47ff-ba35-f061eb6fd641"}]} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:14:21.395043 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-faace822-f35f-48cc-ac9c-52d71aa1c1b1 req-be2ae8ab-be62-440a-8b8c-c966a1e390e9 service nova] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:14:21.395539 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-faace822-f35f-48cc-ac9c-52d71aa1c1b1 req-be2ae8ab-be62-440a-8b8c-c966a1e390e9 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:14:21.395967 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-faace822-f35f-48cc-ac9c-52d71aa1c1b1 req-be2ae8ab-be62-440a-8b8c-c966a1e390e9 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:14:21.421595 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.compute.server_external_events [req-faace822-f35f-48cc-ac9c-52d71aa1c1b1 req-be2ae8ab-be62-440a-8b8c-c966a1e390e9 service nova] Creating event network-vif-unplugged:3533eeb6-f9e6-47ff-ba35-f061eb6fd641 for instance cae1c729-7c41-488d-ab0e-30d1f5d22180 on n-h1-863052-2 Nov 01 19:14:21.438899 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [req-faace822-f35f-48cc-ac9c-52d71aa1c1b1 req-be2ae8ab-be62-440a-8b8c-c966a1e390e9 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.067143 Nov 01 19:14:21.439889 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 2291/4547] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Nov 1 19:14:21 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:14:21.457951 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-cdd7e730-2477-44bd-9757-935b9c6a08ff tempest-ServerRescueTestJSONUnderV235-673623996 tempest-ServerRescueTestJSONUnderV235-673623996-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:14:21.459949 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-cdd7e730-2477-44bd-9757-935b9c6a08ff tempest-ServerRescueTestJSONUnderV235-673623996 tempest-ServerRescueTestJSONUnderV235-673623996-project] [instance: 045a6f82-b3b7-47a7-bcfd-5c1fe9c73f33] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:14:21.485879 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-cdd7e730-2477-44bd-9757-935b9c6a08ff tempest-ServerRescueTestJSONUnderV235-673623996 tempest-ServerRescueTestJSONUnderV235-673623996-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:14:21.487312 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-cdd7e730-2477-44bd-9757-935b9c6a08ff tempest-ServerRescueTestJSONUnderV235-673623996 tempest-ServerRescueTestJSONUnderV235-673623996-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:14:21.506520 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-cdd7e730-2477-44bd-9757-935b9c6a08ff tempest-ServerRescueTestJSONUnderV235-673623996 tempest-ServerRescueTestJSONUnderV235-673623996-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:14:21.510948 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-cdd7e730-2477-44bd-9757-935b9c6a08ff tempest-ServerRescueTestJSONUnderV235-673623996 tempest-ServerRescueTestJSONUnderV235-673623996-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:14:21.515778 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-cdd7e730-2477-44bd-9757-935b9c6a08ff tempest-ServerRescueTestJSONUnderV235-673623996 tempest-ServerRescueTestJSONUnderV235-673623996-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:14:21.519400 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-cdd7e730-2477-44bd-9757-935b9c6a08ff tempest-ServerRescueTestJSONUnderV235-673623996 tempest-ServerRescueTestJSONUnderV235-673623996-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:14:21.845929 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-49ae9fec-d107-4714-85e5-8c9fa18c57d1 tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcf93260eaef487dac5d7bb00b26e3b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73cb8697de6d407ba82c334d9f2b48d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:14:21.854752 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-49ae9fec-d107-4714-85e5-8c9fa18c57d1 tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] 10.222.0.13 "GET /compute/v2.1/servers/cae1c729-7c41-488d-ab0e-30d1f5d22180" status: 200 len: 1667 microversion: 2.1 time: 0.906707 Nov 01 19:14:21.855349 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 2257/4548] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:14:20 2022] GET /compute/v2.1/servers/cae1c729-7c41-488d-ab0e-30d1f5d22180 => generated 1667 bytes in 908 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:14:21.916862 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-c849205b-5539-439d-9134-10f2aa38e967 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:14:21.917500 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-c849205b-5539-439d-9134-10f2aa38e967 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] [instance: b27eaab4-a751-47fb-acdb-db7c99b06a5f] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:14:21.951162 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-c849205b-5539-439d-9134-10f2aa38e967 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:14:21.953812 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-c849205b-5539-439d-9134-10f2aa38e967 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:14:21.954262 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-c849205b-5539-439d-9134-10f2aa38e967 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:14:21.954994 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-c849205b-5539-439d-9134-10f2aa38e967 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:14:21.955453 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-c849205b-5539-439d-9134-10f2aa38e967 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:14:21.955875 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-c849205b-5539-439d-9134-10f2aa38e967 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:14:22.643584 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-c849205b-5539-439d-9134-10f2aa38e967 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc5c19b930543f5a5091922a9859813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ecdc83933544a899117531a960027a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:14:22.655273 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-c849205b-5539-439d-9134-10f2aa38e967 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] 10.222.0.13 "GET /compute/v2.1/servers/b27eaab4-a751-47fb-acdb-db7c99b06a5f" status: 200 len: 1528 microversion: 2.1 time: 0.760938 Nov 01 19:14:22.655965 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 2258/4549] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:14:21 2022] GET /compute/v2.1/servers/b27eaab4-a751-47fb-acdb-db7c99b06a5f => generated 1528 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:14:22.666290 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-78f6f220-35fb-42a9-bf66-b1852b86a369 tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:14:22.671796 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-78f6f220-35fb-42a9-bf66-b1852b86a369 tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] [instance: cae1c729-7c41-488d-ab0e-30d1f5d22180] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:14:22.687059 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-78f6f220-35fb-42a9-bf66-b1852b86a369 tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:14:22.687984 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-78f6f220-35fb-42a9-bf66-b1852b86a369 tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:14:22.691564 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-78f6f220-35fb-42a9-bf66-b1852b86a369 tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:14:22.692575 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-78f6f220-35fb-42a9-bf66-b1852b86a369 tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:14:22.693256 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-78f6f220-35fb-42a9-bf66-b1852b86a369 tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:14:22.694160 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-78f6f220-35fb-42a9-bf66-b1852b86a369 tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:14:23.063333 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-cdd7e730-2477-44bd-9757-935b9c6a08ff tempest-ServerRescueTestJSONUnderV235-673623996 tempest-ServerRescueTestJSONUnderV235-673623996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8b1291b1e654a658382af950eb43c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c9c687e2f2940bbabecdf42a0678132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:14:23.077753 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-cdd7e730-2477-44bd-9757-935b9c6a08ff tempest-ServerRescueTestJSONUnderV235-673623996 tempest-ServerRescueTestJSONUnderV235-673623996-project] 10.222.0.13 "GET /compute/v2.1/servers/045a6f82-b3b7-47a7-bcfd-5c1fe9c73f33" status: 200 len: 1322 microversion: 2.1 time: 1.635764 Nov 01 19:14:23.080265 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 2292/4550] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:14:21 2022] GET /compute/v2.1/servers/045a6f82-b3b7-47a7-bcfd-5c1fe9c73f33 => generated 1322 bytes in 1639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:14:23.092709 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-9285594f-5517-4f1f-919e-434f496dc3a3 tempest-ListServersNegativeTestJSON-161318838 tempest-ListServersNegativeTestJSON-161318838-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:14:23.096048 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-9285594f-5517-4f1f-919e-434f496dc3a3 tempest-ListServersNegativeTestJSON-161318838 tempest-ListServersNegativeTestJSON-161318838-project] [instance: 4bc22a5a-f58d-4ee6-8876-be5dc9e4ddb3] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:14:23.110910 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-9285594f-5517-4f1f-919e-434f496dc3a3 tempest-ListServersNegativeTestJSON-161318838 tempest-ListServersNegativeTestJSON-161318838-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:14:23.111412 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-9285594f-5517-4f1f-919e-434f496dc3a3 tempest-ListServersNegativeTestJSON-161318838 tempest-ListServersNegativeTestJSON-161318838-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:14:23.114739 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-9285594f-5517-4f1f-919e-434f496dc3a3 tempest-ListServersNegativeTestJSON-161318838 tempest-ListServersNegativeTestJSON-161318838-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:14:23.119021 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-9285594f-5517-4f1f-919e-434f496dc3a3 tempest-ListServersNegativeTestJSON-161318838 tempest-ListServersNegativeTestJSON-161318838-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:14:23.119569 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-9285594f-5517-4f1f-919e-434f496dc3a3 tempest-ListServersNegativeTestJSON-161318838 tempest-ListServersNegativeTestJSON-161318838-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:14:23.121148 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-9285594f-5517-4f1f-919e-434f496dc3a3 tempest-ListServersNegativeTestJSON-161318838 tempest-ListServersNegativeTestJSON-161318838-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:14:24.004973 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-78f6f220-35fb-42a9-bf66-b1852b86a369 tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcf93260eaef487dac5d7bb00b26e3b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73cb8697de6d407ba82c334d9f2b48d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:14:24.019386 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-78f6f220-35fb-42a9-bf66-b1852b86a369 tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] 10.222.0.13 "GET /compute/v2.1/servers/cae1c729-7c41-488d-ab0e-30d1f5d22180" status: 200 len: 1667 microversion: 2.1 time: 1.357275 Nov 01 19:14:24.021261 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 2259/4551] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:14:22 2022] GET /compute/v2.1/servers/cae1c729-7c41-488d-ab0e-30d1f5d22180 => generated 1667 bytes in 1359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:14:24.036056 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [req-2ad87875-4784-4045-bf82-102d7c31c62f req-4b98f6c8-9435-4644-a221-a96ca7df52dc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9b19dbc5-6975-43d3-8d39-a045e986187a", "tag": "9b959796-33ed-4a98-b075-6a78288f5a21"}]} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:14:24.082142 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-2ad87875-4784-4045-bf82-102d7c31c62f req-4b98f6c8-9435-4644-a221-a96ca7df52dc service nova] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:14:24.085512 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-2ad87875-4784-4045-bf82-102d7c31c62f req-4b98f6c8-9435-4644-a221-a96ca7df52dc service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:14:24.086196 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-2ad87875-4784-4045-bf82-102d7c31c62f req-4b98f6c8-9435-4644-a221-a96ca7df52dc service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:14:24.108418 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.compute.server_external_events [req-2ad87875-4784-4045-bf82-102d7c31c62f req-4b98f6c8-9435-4644-a221-a96ca7df52dc service nova] Creating event network-changed:9b959796-33ed-4a98-b075-6a78288f5a21 for instance 9b19dbc5-6975-43d3-8d39-a045e986187a on n-h1-863052-2 Nov 01 19:14:24.138367 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [req-2ad87875-4784-4045-bf82-102d7c31c62f req-4b98f6c8-9435-4644-a221-a96ca7df52dc service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.113020 Nov 01 19:14:24.147682 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 2260/4552] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Nov 1 19:14:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:14:24.171083 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [req-72641720-c0dd-415a-a641-b2af77a8bcc3 req-dbf0aa35-ef45-4b00-93da-0c0ec67f8306 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "045a6f82-b3b7-47a7-bcfd-5c1fe9c73f33", "name": "network-vif-plugged", "status": "completed", "tag": "9f919ece-8580-4f40-ba86-fc03e5aa20d4"}]} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:14:24.232203 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-72641720-c0dd-415a-a641-b2af77a8bcc3 req-dbf0aa35-ef45-4b00-93da-0c0ec67f8306 service nova] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:14:24.233644 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-72641720-c0dd-415a-a641-b2af77a8bcc3 req-dbf0aa35-ef45-4b00-93da-0c0ec67f8306 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:14:24.234113 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-72641720-c0dd-415a-a641-b2af77a8bcc3 req-dbf0aa35-ef45-4b00-93da-0c0ec67f8306 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:14:24.325847 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.compute.server_external_events [req-72641720-c0dd-415a-a641-b2af77a8bcc3 req-dbf0aa35-ef45-4b00-93da-0c0ec67f8306 service nova] Creating event network-vif-plugged:9f919ece-8580-4f40-ba86-fc03e5aa20d4 for instance 045a6f82-b3b7-47a7-bcfd-5c1fe9c73f33 on n-h2-863052-2 Nov 01 19:14:24.390601 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [req-72641720-c0dd-415a-a641-b2af77a8bcc3 req-dbf0aa35-ef45-4b00-93da-0c0ec67f8306 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.201502 Nov 01 19:14:24.391068 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 2261/4553] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Nov 1 19:14:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:14:24.415683 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-9f25e022-1b88-4b5d-8588-a2e7529d9962 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:14:24.424170 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-9f25e022-1b88-4b5d-8588-a2e7529d9962 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] [instance: b27eaab4-a751-47fb-acdb-db7c99b06a5f] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:14:24.440864 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-9f25e022-1b88-4b5d-8588-a2e7529d9962 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:14:24.444950 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-9f25e022-1b88-4b5d-8588-a2e7529d9962 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:14:24.445652 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-9f25e022-1b88-4b5d-8588-a2e7529d9962 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:14:24.446621 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-9f25e022-1b88-4b5d-8588-a2e7529d9962 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:14:24.452201 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-9f25e022-1b88-4b5d-8588-a2e7529d9962 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:14:24.452926 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-9f25e022-1b88-4b5d-8588-a2e7529d9962 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:14:24.529249 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-9285594f-5517-4f1f-919e-434f496dc3a3 tempest-ListServersNegativeTestJSON-161318838 tempest-ListServersNegativeTestJSON-161318838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f36624705974d12a093672679d9e283', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf1f96424adc43eeb0e489b2d6485790', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:14:24.568227 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-9285594f-5517-4f1f-919e-434f496dc3a3 tempest-ListServersNegativeTestJSON-161318838 tempest-ListServersNegativeTestJSON-161318838-project] 10.222.0.13 "GET /compute/v2.1/servers/4bc22a5a-f58d-4ee6-8876-be5dc9e4ddb3" status: 200 len: 1322 microversion: 2.1 time: 1.471848 Nov 01 19:14:24.573871 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 2293/4554] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:14:23 2022] GET /compute/v2.1/servers/4bc22a5a-f58d-4ee6-8876-be5dc9e4ddb3 => generated 1322 bytes in 1493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:14:24.598149 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-69660da4-4ab1-487e-960f-0b92c72090e5 tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:14:24.599453 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-69660da4-4ab1-487e-960f-0b92c72090e5 tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] [instance: cae1c729-7c41-488d-ab0e-30d1f5d22180] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:14:24.656092 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-69660da4-4ab1-487e-960f-0b92c72090e5 tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:14:24.657937 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-69660da4-4ab1-487e-960f-0b92c72090e5 tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:14:24.658429 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-69660da4-4ab1-487e-960f-0b92c72090e5 tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:14:24.659185 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-69660da4-4ab1-487e-960f-0b92c72090e5 tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:14:24.659652 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-69660da4-4ab1-487e-960f-0b92c72090e5 tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:14:24.664509 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-69660da4-4ab1-487e-960f-0b92c72090e5 tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:14:25.490863 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-69660da4-4ab1-487e-960f-0b92c72090e5 tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcf93260eaef487dac5d7bb00b26e3b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73cb8697de6d407ba82c334d9f2b48d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:14:25.503047 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-69660da4-4ab1-487e-960f-0b92c72090e5 tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] 10.222.0.13 "GET /compute/v2.1/servers/cae1c729-7c41-488d-ab0e-30d1f5d22180" status: 200 len: 1667 microversion: 2.1 time: 0.925935 Nov 01 19:14:25.511125 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 2294/4555] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:14:24 2022] GET /compute/v2.1/servers/cae1c729-7c41-488d-ab0e-30d1f5d22180 => generated 1667 bytes in 935 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:14:25.527596 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-6d0b0224-50ec-4511-862f-d9de137be81a tempest-ServerRescueTestJSONUnderV235-673623996 tempest-ServerRescueTestJSONUnderV235-673623996-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:14:25.528239 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-6d0b0224-50ec-4511-862f-d9de137be81a tempest-ServerRescueTestJSONUnderV235-673623996 tempest-ServerRescueTestJSONUnderV235-673623996-project] [instance: 045a6f82-b3b7-47a7-bcfd-5c1fe9c73f33] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:14:25.589310 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-6d0b0224-50ec-4511-862f-d9de137be81a tempest-ServerRescueTestJSONUnderV235-673623996 tempest-ServerRescueTestJSONUnderV235-673623996-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:14:25.589955 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-6d0b0224-50ec-4511-862f-d9de137be81a tempest-ServerRescueTestJSONUnderV235-673623996 tempest-ServerRescueTestJSONUnderV235-673623996-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:14:25.590470 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-6d0b0224-50ec-4511-862f-d9de137be81a tempest-ServerRescueTestJSONUnderV235-673623996 tempest-ServerRescueTestJSONUnderV235-673623996-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:14:25.591389 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-6d0b0224-50ec-4511-862f-d9de137be81a tempest-ServerRescueTestJSONUnderV235-673623996 tempest-ServerRescueTestJSONUnderV235-673623996-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:14:25.592351 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-6d0b0224-50ec-4511-862f-d9de137be81a tempest-ServerRescueTestJSONUnderV235-673623996 tempest-ServerRescueTestJSONUnderV235-673623996-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:14:25.592446 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-6d0b0224-50ec-4511-862f-d9de137be81a tempest-ServerRescueTestJSONUnderV235-673623996 tempest-ServerRescueTestJSONUnderV235-673623996-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:14:26.151174 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-9f25e022-1b88-4b5d-8588-a2e7529d9962 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc5c19b930543f5a5091922a9859813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ecdc83933544a899117531a960027a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:14:26.169725 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-9f25e022-1b88-4b5d-8588-a2e7529d9962 tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] 10.222.0.13 "GET /compute/v2.1/servers/b27eaab4-a751-47fb-acdb-db7c99b06a5f" status: 200 len: 1528 microversion: 2.1 time: 1.762584 Nov 01 19:14:26.170665 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 2262/4556] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:14:24 2022] GET /compute/v2.1/servers/b27eaab4-a751-47fb-acdb-db7c99b06a5f => generated 1528 bytes in 1779 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:14:26.195696 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-50a03ffd-938f-42d9-9305-5e56669ce9a4 tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:14:26.199096 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-50a03ffd-938f-42d9-9305-5e56669ce9a4 tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] [instance: cae1c729-7c41-488d-ab0e-30d1f5d22180] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:14:26.215417 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-50a03ffd-938f-42d9-9305-5e56669ce9a4 tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:14:26.216279 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-50a03ffd-938f-42d9-9305-5e56669ce9a4 tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:14:26.216970 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-50a03ffd-938f-42d9-9305-5e56669ce9a4 tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:14:26.217892 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-50a03ffd-938f-42d9-9305-5e56669ce9a4 tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:14:26.218518 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-50a03ffd-938f-42d9-9305-5e56669ce9a4 tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:14:26.219149 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-50a03ffd-938f-42d9-9305-5e56669ce9a4 tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:14:26.411007 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-50a03ffd-938f-42d9-9305-5e56669ce9a4 tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] 10.222.0.13 "POST /compute/v2.1/servers/cae1c729-7c41-488d-ab0e-30d1f5d22180/action" status: 202 len: 0 microversion: 2.1 time: 0.223838 Nov 01 19:14:26.414692 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 2263/4557] 10.222.0.13 () {60 vars in 1278 bytes} [Tue Nov 1 19:14:26 2022] POST /compute/v2.1/servers/cae1c729-7c41-488d-ab0e-30d1f5d22180/action => generated 0 bytes in 226 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 01 19:14:26.457114 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-d37ea622-6179-43fe-9e82-2d8c6b955e58 tempest-ListServersNegativeTestJSON-161318838 tempest-ListServersNegativeTestJSON-161318838-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:14:26.457965 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-d37ea622-6179-43fe-9e82-2d8c6b955e58 tempest-ListServersNegativeTestJSON-161318838 tempest-ListServersNegativeTestJSON-161318838-project] [instance: 4bc22a5a-f58d-4ee6-8876-be5dc9e4ddb3] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:14:26.477944 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-d37ea622-6179-43fe-9e82-2d8c6b955e58 tempest-ListServersNegativeTestJSON-161318838 tempest-ListServersNegativeTestJSON-161318838-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:14:26.478446 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-d37ea622-6179-43fe-9e82-2d8c6b955e58 tempest-ListServersNegativeTestJSON-161318838 tempest-ListServersNegativeTestJSON-161318838-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:14:26.478886 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-d37ea622-6179-43fe-9e82-2d8c6b955e58 tempest-ListServersNegativeTestJSON-161318838 tempest-ListServersNegativeTestJSON-161318838-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:14:26.479609 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-d37ea622-6179-43fe-9e82-2d8c6b955e58 tempest-ListServersNegativeTestJSON-161318838 tempest-ListServersNegativeTestJSON-161318838-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:14:26.480260 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-d37ea622-6179-43fe-9e82-2d8c6b955e58 tempest-ListServersNegativeTestJSON-161318838 tempest-ListServersNegativeTestJSON-161318838-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:14:26.480625 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-d37ea622-6179-43fe-9e82-2d8c6b955e58 tempest-ListServersNegativeTestJSON-161318838 tempest-ListServersNegativeTestJSON-161318838-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:14:26.530391 n-d-863052-2 devstack@n-api.service[121402]: DEBUG dbcounter [-] [121402] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 19:14:26.822994 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-6d0b0224-50ec-4511-862f-d9de137be81a tempest-ServerRescueTestJSONUnderV235-673623996 tempest-ServerRescueTestJSONUnderV235-673623996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8b1291b1e654a658382af950eb43c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c9c687e2f2940bbabecdf42a0678132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:14:26.830953 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-6d0b0224-50ec-4511-862f-d9de137be81a tempest-ServerRescueTestJSONUnderV235-673623996 tempest-ServerRescueTestJSONUnderV235-673623996-project] 10.222.0.13 "GET /compute/v2.1/servers/045a6f82-b3b7-47a7-bcfd-5c1fe9c73f33" status: 200 len: 1322 microversion: 2.1 time: 1.318010 Nov 01 19:14:26.837649 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 2295/4558] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:14:25 2022] GET /compute/v2.1/servers/045a6f82-b3b7-47a7-bcfd-5c1fe9c73f33 => generated 1322 bytes in 1325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:14:26.847906 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-fa6c3177-4d60-4845-a0ab-bfa20775203d tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:14:26.849845 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-fa6c3177-4d60-4845-a0ab-bfa20775203d tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] [instance: cae1c729-7c41-488d-ab0e-30d1f5d22180] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:14:26.862346 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-fa6c3177-4d60-4845-a0ab-bfa20775203d tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:14:26.866278 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-fa6c3177-4d60-4845-a0ab-bfa20775203d tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:14:26.866880 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-fa6c3177-4d60-4845-a0ab-bfa20775203d tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:14:26.872408 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-fa6c3177-4d60-4845-a0ab-bfa20775203d tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:14:26.874711 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-fa6c3177-4d60-4845-a0ab-bfa20775203d tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:14:26.875249 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-fa6c3177-4d60-4845-a0ab-bfa20775203d tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:14:27.469064 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-fa6c3177-4d60-4845-a0ab-bfa20775203d tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcf93260eaef487dac5d7bb00b26e3b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73cb8697de6d407ba82c334d9f2b48d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:14:27.482605 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-fa6c3177-4d60-4845-a0ab-bfa20775203d tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] 10.222.0.13 "GET /compute/v2.1/servers/cae1c729-7c41-488d-ab0e-30d1f5d22180" status: 200 len: 1669 microversion: 2.1 time: 0.642801 Nov 01 19:14:27.484074 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 2296/4559] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:14:26 2022] GET /compute/v2.1/servers/cae1c729-7c41-488d-ab0e-30d1f5d22180 => generated 1669 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:14:27.499531 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [req-045413bb-c162-4f06-aaf0-c070fc6d08e9 req-4985aa67-c4b3-4b98-b196-183b496eea34 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "21599026-c30e-410e-94d2-61501021fa86", "name": "network-vif-plugged", "status": "completed", "tag": "f9f99154-91d6-4e07-9759-9bb27a50f5b7"}]} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:14:27.526017 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-045413bb-c162-4f06-aaf0-c070fc6d08e9 req-4985aa67-c4b3-4b98-b196-183b496eea34 service nova] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:14:27.528192 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-045413bb-c162-4f06-aaf0-c070fc6d08e9 req-4985aa67-c4b3-4b98-b196-183b496eea34 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:14:27.530296 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-045413bb-c162-4f06-aaf0-c070fc6d08e9 req-4985aa67-c4b3-4b98-b196-183b496eea34 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:14:27.532805 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-d37ea622-6179-43fe-9e82-2d8c6b955e58 tempest-ListServersNegativeTestJSON-161318838 tempest-ListServersNegativeTestJSON-161318838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f36624705974d12a093672679d9e283', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf1f96424adc43eeb0e489b2d6485790', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:14:27.542216 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-d37ea622-6179-43fe-9e82-2d8c6b955e58 tempest-ListServersNegativeTestJSON-161318838 tempest-ListServersNegativeTestJSON-161318838-project] 10.222.0.13 "GET /compute/v2.1/servers/4bc22a5a-f58d-4ee6-8876-be5dc9e4ddb3" status: 200 len: 1322 microversion: 2.1 time: 1.127866 Nov 01 19:14:27.554022 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 2264/4560] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:14:26 2022] GET /compute/v2.1/servers/4bc22a5a-f58d-4ee6-8876-be5dc9e4ddb3 => generated 1322 bytes in 1141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:14:27.577688 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-d91787dc-fb51-41de-9a71-c945d4eef5df tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:14:27.578611 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-d91787dc-fb51-41de-9a71-c945d4eef5df tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] [instance: b27eaab4-a751-47fb-acdb-db7c99b06a5f] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:14:27.581605 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.compute.server_external_events [req-045413bb-c162-4f06-aaf0-c070fc6d08e9 req-4985aa67-c4b3-4b98-b196-183b496eea34 service nova] Creating event network-vif-plugged:f9f99154-91d6-4e07-9759-9bb27a50f5b7 for instance 21599026-c30e-410e-94d2-61501021fa86 on n-h2-863052-2 Nov 01 19:14:27.600974 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-d91787dc-fb51-41de-9a71-c945d4eef5df tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:14:27.601194 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [req-045413bb-c162-4f06-aaf0-c070fc6d08e9 req-4985aa67-c4b3-4b98-b196-183b496eea34 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107914 Nov 01 19:14:27.601387 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-d91787dc-fb51-41de-9a71-c945d4eef5df tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:14:27.601838 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-d91787dc-fb51-41de-9a71-c945d4eef5df tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:14:27.603112 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-d91787dc-fb51-41de-9a71-c945d4eef5df tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:14:27.603242 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 2297/4561] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Nov 1 19:14:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:14:27.603578 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-d91787dc-fb51-41de-9a71-c945d4eef5df tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:14:27.604064 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-d91787dc-fb51-41de-9a71-c945d4eef5df tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:14:27.863828 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-c1597e0e-3587-4c7e-9e8b-63270f49126c tempest-ServerRescueTestJSONUnderV235-673623996 tempest-ServerRescueTestJSONUnderV235-673623996-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:14:27.865722 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-c1597e0e-3587-4c7e-9e8b-63270f49126c tempest-ServerRescueTestJSONUnderV235-673623996 tempest-ServerRescueTestJSONUnderV235-673623996-project] [instance: 045a6f82-b3b7-47a7-bcfd-5c1fe9c73f33] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:14:27.889447 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-c1597e0e-3587-4c7e-9e8b-63270f49126c tempest-ServerRescueTestJSONUnderV235-673623996 tempest-ServerRescueTestJSONUnderV235-673623996-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:14:27.890433 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-c1597e0e-3587-4c7e-9e8b-63270f49126c tempest-ServerRescueTestJSONUnderV235-673623996 tempest-ServerRescueTestJSONUnderV235-673623996-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:14:27.891148 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-c1597e0e-3587-4c7e-9e8b-63270f49126c tempest-ServerRescueTestJSONUnderV235-673623996 tempest-ServerRescueTestJSONUnderV235-673623996-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:14:27.894068 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-c1597e0e-3587-4c7e-9e8b-63270f49126c tempest-ServerRescueTestJSONUnderV235-673623996 tempest-ServerRescueTestJSONUnderV235-673623996-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:14:27.898048 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-c1597e0e-3587-4c7e-9e8b-63270f49126c tempest-ServerRescueTestJSONUnderV235-673623996 tempest-ServerRescueTestJSONUnderV235-673623996-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:14:27.900227 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-c1597e0e-3587-4c7e-9e8b-63270f49126c tempest-ServerRescueTestJSONUnderV235-673623996 tempest-ServerRescueTestJSONUnderV235-673623996-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:14:28.458278 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-c1597e0e-3587-4c7e-9e8b-63270f49126c tempest-ServerRescueTestJSONUnderV235-673623996 tempest-ServerRescueTestJSONUnderV235-673623996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8b1291b1e654a658382af950eb43c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c9c687e2f2940bbabecdf42a0678132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:14:28.470861 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-c1597e0e-3587-4c7e-9e8b-63270f49126c tempest-ServerRescueTestJSONUnderV235-673623996 tempest-ServerRescueTestJSONUnderV235-673623996-project] 10.222.0.13 "GET /compute/v2.1/servers/045a6f82-b3b7-47a7-bcfd-5c1fe9c73f33" status: 200 len: 1518 microversion: 2.1 time: 0.612367 Nov 01 19:14:28.476051 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 2298/4562] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:14:27 2022] GET /compute/v2.1/servers/045a6f82-b3b7-47a7-bcfd-5c1fe9c73f33 => generated 1518 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:14:28.501329 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-374732d4-06d9-4e4f-bf16-d936cc0f8c44 tempest-ServerRescueTestJSONUnderV235-673623996 tempest-ServerRescueTestJSONUnderV235-673623996-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:14:28.504788 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-374732d4-06d9-4e4f-bf16-d936cc0f8c44 tempest-ServerRescueTestJSONUnderV235-673623996 tempest-ServerRescueTestJSONUnderV235-673623996-project] [instance: 045a6f82-b3b7-47a7-bcfd-5c1fe9c73f33] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:14:28.512035 n-d-863052-2 devstack@n-api.service[121403]: DEBUG dbcounter [-] [121403] Writing DB stats nova_api:SELECT=62 {{(pid=121403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 19:14:28.542422 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-374732d4-06d9-4e4f-bf16-d936cc0f8c44 tempest-ServerRescueTestJSONUnderV235-673623996 tempest-ServerRescueTestJSONUnderV235-673623996-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:14:28.563108 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-374732d4-06d9-4e4f-bf16-d936cc0f8c44 tempest-ServerRescueTestJSONUnderV235-673623996 tempest-ServerRescueTestJSONUnderV235-673623996-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:14:28.566870 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-374732d4-06d9-4e4f-bf16-d936cc0f8c44 tempest-ServerRescueTestJSONUnderV235-673623996 tempest-ServerRescueTestJSONUnderV235-673623996-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:14:28.569822 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-374732d4-06d9-4e4f-bf16-d936cc0f8c44 tempest-ServerRescueTestJSONUnderV235-673623996 tempest-ServerRescueTestJSONUnderV235-673623996-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:14:28.571577 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-374732d4-06d9-4e4f-bf16-d936cc0f8c44 tempest-ServerRescueTestJSONUnderV235-673623996 tempest-ServerRescueTestJSONUnderV235-673623996-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:14:28.586714 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-374732d4-06d9-4e4f-bf16-d936cc0f8c44 tempest-ServerRescueTestJSONUnderV235-673623996 tempest-ServerRescueTestJSONUnderV235-673623996-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:14:28.625804 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-d91787dc-fb51-41de-9a71-c945d4eef5df tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc5c19b930543f5a5091922a9859813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ecdc83933544a899117531a960027a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:14:28.644373 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-d91787dc-fb51-41de-9a71-c945d4eef5df tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] 10.222.0.13 "GET /compute/v2.1/servers/b27eaab4-a751-47fb-acdb-db7c99b06a5f" status: 200 len: 1528 microversion: 2.1 time: 1.080859 Nov 01 19:14:28.645108 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 2265/4563] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:14:27 2022] GET /compute/v2.1/servers/b27eaab4-a751-47fb-acdb-db7c99b06a5f => generated 1528 bytes in 1090 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:14:28.650085 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-475f027d-261e-41cf-a072-d9488013f772 tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:14:28.655019 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-475f027d-261e-41cf-a072-d9488013f772 tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] [instance: cae1c729-7c41-488d-ab0e-30d1f5d22180] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:14:28.674414 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-475f027d-261e-41cf-a072-d9488013f772 tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:14:28.675335 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-475f027d-261e-41cf-a072-d9488013f772 tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:14:28.676638 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-475f027d-261e-41cf-a072-d9488013f772 tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:14:28.677372 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.objects.instance [None req-374732d4-06d9-4e4f-bf16-d936cc0f8c44 tempest-ServerRescueTestJSONUnderV235-673623996 tempest-ServerRescueTestJSONUnderV235-673623996-project] Lazy-loading 'flavor' on Instance uuid 045a6f82-b3b7-47a7-bcfd-5c1fe9c73f33 {{(pid=121403) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 01 19:14:28.677851 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-475f027d-261e-41cf-a072-d9488013f772 tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:14:28.678531 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-475f027d-261e-41cf-a072-d9488013f772 tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:14:28.679180 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-475f027d-261e-41cf-a072-d9488013f772 tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:14:28.923768 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-374732d4-06d9-4e4f-bf16-d936cc0f8c44 tempest-ServerRescueTestJSONUnderV235-673623996 tempest-ServerRescueTestJSONUnderV235-673623996-project] 10.222.0.13 "POST /compute/v2.1/servers/045a6f82-b3b7-47a7-bcfd-5c1fe9c73f33/action" status: 200 len: 32 microversion: 2.1 time: 0.427269 Nov 01 19:14:28.926351 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 2299/4564] 10.222.0.13 () {60 vars in 1278 bytes} [Tue Nov 1 19:14:28 2022] POST /compute/v2.1/servers/045a6f82-b3b7-47a7-bcfd-5c1fe9c73f33/action => generated 32 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Nov 01 19:14:28.944815 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-4fd0bbc1-569b-4af4-b31b-f154ddf40a3c tempest-ListServersNegativeTestJSON-161318838 tempest-ListServersNegativeTestJSON-161318838-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:14:28.945794 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-4fd0bbc1-569b-4af4-b31b-f154ddf40a3c tempest-ListServersNegativeTestJSON-161318838 tempest-ListServersNegativeTestJSON-161318838-project] [instance: 4bc22a5a-f58d-4ee6-8876-be5dc9e4ddb3] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:14:28.964495 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-4fd0bbc1-569b-4af4-b31b-f154ddf40a3c tempest-ListServersNegativeTestJSON-161318838 tempest-ListServersNegativeTestJSON-161318838-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:14:28.968368 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-4fd0bbc1-569b-4af4-b31b-f154ddf40a3c tempest-ListServersNegativeTestJSON-161318838 tempest-ListServersNegativeTestJSON-161318838-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:14:28.970142 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-4fd0bbc1-569b-4af4-b31b-f154ddf40a3c tempest-ListServersNegativeTestJSON-161318838 tempest-ListServersNegativeTestJSON-161318838-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:14:28.980423 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-4fd0bbc1-569b-4af4-b31b-f154ddf40a3c tempest-ListServersNegativeTestJSON-161318838 tempest-ListServersNegativeTestJSON-161318838-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:14:28.981496 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-4fd0bbc1-569b-4af4-b31b-f154ddf40a3c tempest-ListServersNegativeTestJSON-161318838 tempest-ListServersNegativeTestJSON-161318838-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:14:28.983616 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-4fd0bbc1-569b-4af4-b31b-f154ddf40a3c tempest-ListServersNegativeTestJSON-161318838 tempest-ListServersNegativeTestJSON-161318838-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:14:29.686574 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-4fd0bbc1-569b-4af4-b31b-f154ddf40a3c tempest-ListServersNegativeTestJSON-161318838 tempest-ListServersNegativeTestJSON-161318838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f36624705974d12a093672679d9e283', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf1f96424adc43eeb0e489b2d6485790', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:14:29.697502 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-4fd0bbc1-569b-4af4-b31b-f154ddf40a3c tempest-ListServersNegativeTestJSON-161318838 tempest-ListServersNegativeTestJSON-161318838-project] 10.222.0.13 "GET /compute/v2.1/servers/4bc22a5a-f58d-4ee6-8876-be5dc9e4ddb3" status: 200 len: 1322 microversion: 2.1 time: 0.769670 Nov 01 19:14:29.713153 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 2300/4565] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:14:28 2022] GET /compute/v2.1/servers/4bc22a5a-f58d-4ee6-8876-be5dc9e4ddb3 => generated 1322 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:14:29.774674 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-157def1f-e917-4a7a-8a64-8154c1fd847c tempest-ServerRescueTestJSONUnderV235-673623996 tempest-ServerRescueTestJSONUnderV235-673623996-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:14:29.792989 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-157def1f-e917-4a7a-8a64-8154c1fd847c tempest-ServerRescueTestJSONUnderV235-673623996 tempest-ServerRescueTestJSONUnderV235-673623996-project] [instance: 045a6f82-b3b7-47a7-bcfd-5c1fe9c73f33] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:14:29.832027 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-157def1f-e917-4a7a-8a64-8154c1fd847c tempest-ServerRescueTestJSONUnderV235-673623996 tempest-ServerRescueTestJSONUnderV235-673623996-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:14:29.845164 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-157def1f-e917-4a7a-8a64-8154c1fd847c tempest-ServerRescueTestJSONUnderV235-673623996 tempest-ServerRescueTestJSONUnderV235-673623996-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:14:29.845687 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-157def1f-e917-4a7a-8a64-8154c1fd847c tempest-ServerRescueTestJSONUnderV235-673623996 tempest-ServerRescueTestJSONUnderV235-673623996-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:14:29.846465 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-157def1f-e917-4a7a-8a64-8154c1fd847c tempest-ServerRescueTestJSONUnderV235-673623996 tempest-ServerRescueTestJSONUnderV235-673623996-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:14:29.846932 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-157def1f-e917-4a7a-8a64-8154c1fd847c tempest-ServerRescueTestJSONUnderV235-673623996 tempest-ServerRescueTestJSONUnderV235-673623996-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:14:29.847375 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-157def1f-e917-4a7a-8a64-8154c1fd847c tempest-ServerRescueTestJSONUnderV235-673623996 tempest-ServerRescueTestJSONUnderV235-673623996-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:14:30.390776 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-157def1f-e917-4a7a-8a64-8154c1fd847c tempest-ServerRescueTestJSONUnderV235-673623996 tempest-ServerRescueTestJSONUnderV235-673623996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8b1291b1e654a658382af950eb43c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c9c687e2f2940bbabecdf42a0678132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:14:30.397306 n-d-863052-2 devstack@n-api.service[121403]: DEBUG dbcounter [-] [121403] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 19:14:30.400319 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-157def1f-e917-4a7a-8a64-8154c1fd847c tempest-ServerRescueTestJSONUnderV235-673623996 tempest-ServerRescueTestJSONUnderV235-673623996-project] 10.222.0.13 "GET /compute/v2.1/servers/045a6f82-b3b7-47a7-bcfd-5c1fe9c73f33" status: 200 len: 1524 microversion: 2.1 time: 0.685982 Nov 01 19:14:30.406017 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 2301/4566] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:14:29 2022] GET /compute/v2.1/servers/045a6f82-b3b7-47a7-bcfd-5c1fe9c73f33 => generated 1524 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:14:30.418114 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-5f8794a8-f5b5-4066-af41-e6b166d5ef3d tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:14:30.418750 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-5f8794a8-f5b5-4066-af41-e6b166d5ef3d tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] [instance: b27eaab4-a751-47fb-acdb-db7c99b06a5f] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:14:30.459518 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-5f8794a8-f5b5-4066-af41-e6b166d5ef3d tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:14:30.460923 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-5f8794a8-f5b5-4066-af41-e6b166d5ef3d tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:14:30.462450 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-5f8794a8-f5b5-4066-af41-e6b166d5ef3d tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:14:30.463717 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-5f8794a8-f5b5-4066-af41-e6b166d5ef3d tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:14:30.467696 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-475f027d-261e-41cf-a072-d9488013f772 tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcf93260eaef487dac5d7bb00b26e3b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73cb8697de6d407ba82c334d9f2b48d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:14:30.503189 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-475f027d-261e-41cf-a072-d9488013f772 tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] 10.222.0.13 "GET /compute/v2.1/servers/cae1c729-7c41-488d-ab0e-30d1f5d22180" status: 200 len: 1669 microversion: 2.1 time: 1.856724 Nov 01 19:14:30.503785 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 2266/4567] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:14:28 2022] GET /compute/v2.1/servers/cae1c729-7c41-488d-ab0e-30d1f5d22180 => generated 1669 bytes in 1858 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:14:30.514202 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-5f8794a8-f5b5-4066-af41-e6b166d5ef3d tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.047s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:14:30.514663 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-5f8794a8-f5b5-4066-af41-e6b166d5ef3d tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:14:30.730909 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-264eb64a-4343-4bf3-9277-b3c72d97c6d5 tempest-ListServersNegativeTestJSON-161318838 tempest-ListServersNegativeTestJSON-161318838-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:14:30.731573 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-264eb64a-4343-4bf3-9277-b3c72d97c6d5 tempest-ListServersNegativeTestJSON-161318838 tempest-ListServersNegativeTestJSON-161318838-project] [instance: 4bc22a5a-f58d-4ee6-8876-be5dc9e4ddb3] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:14:30.746490 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-264eb64a-4343-4bf3-9277-b3c72d97c6d5 tempest-ListServersNegativeTestJSON-161318838 tempest-ListServersNegativeTestJSON-161318838-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:14:30.746998 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-264eb64a-4343-4bf3-9277-b3c72d97c6d5 tempest-ListServersNegativeTestJSON-161318838 tempest-ListServersNegativeTestJSON-161318838-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:14:30.747438 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-264eb64a-4343-4bf3-9277-b3c72d97c6d5 tempest-ListServersNegativeTestJSON-161318838 tempest-ListServersNegativeTestJSON-161318838-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:14:30.748164 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-264eb64a-4343-4bf3-9277-b3c72d97c6d5 tempest-ListServersNegativeTestJSON-161318838 tempest-ListServersNegativeTestJSON-161318838-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:14:30.753799 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-264eb64a-4343-4bf3-9277-b3c72d97c6d5 tempest-ListServersNegativeTestJSON-161318838 tempest-ListServersNegativeTestJSON-161318838-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:14:30.754441 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-264eb64a-4343-4bf3-9277-b3c72d97c6d5 tempest-ListServersNegativeTestJSON-161318838 tempest-ListServersNegativeTestJSON-161318838-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:14:31.020981 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-5f8794a8-f5b5-4066-af41-e6b166d5ef3d tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc5c19b930543f5a5091922a9859813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ecdc83933544a899117531a960027a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:14:31.034284 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-5f8794a8-f5b5-4066-af41-e6b166d5ef3d tempest-ServersNegativeTestJSON-638944671 tempest-ServersNegativeTestJSON-638944671-project] 10.222.0.13 "GET /compute/v2.1/servers/b27eaab4-a751-47fb-acdb-db7c99b06a5f" status: 200 len: 1510 microversion: 2.1 time: 0.627100 Nov 01 19:14:31.034942 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 2302/4568] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:14:30 2022] GET /compute/v2.1/servers/b27eaab4-a751-47fb-acdb-db7c99b06a5f => generated 1510 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:14:31.054317 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [req-6a8be9c7-80ba-418e-a944-57f4853d5c25 req-41ad9b7d-385a-4b2c-b1d7-5f3c8489aee2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9b19dbc5-6975-43d3-8d39-a045e986187a", "name": "network-vif-plugged", "status": "completed", "tag": "9b959796-33ed-4a98-b075-6a78288f5a21"}]} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:14:31.077572 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-6a8be9c7-80ba-418e-a944-57f4853d5c25 req-41ad9b7d-385a-4b2c-b1d7-5f3c8489aee2 service nova] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:14:31.078035 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-6a8be9c7-80ba-418e-a944-57f4853d5c25 req-41ad9b7d-385a-4b2c-b1d7-5f3c8489aee2 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:14:31.078595 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-6a8be9c7-80ba-418e-a944-57f4853d5c25 req-41ad9b7d-385a-4b2c-b1d7-5f3c8489aee2 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:14:31.091065 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.compute.server_external_events [req-6a8be9c7-80ba-418e-a944-57f4853d5c25 req-41ad9b7d-385a-4b2c-b1d7-5f3c8489aee2 service nova] Creating event network-vif-plugged:9b959796-33ed-4a98-b075-6a78288f5a21 for instance 9b19dbc5-6975-43d3-8d39-a045e986187a on n-h1-863052-2 Nov 01 19:14:31.100698 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [req-6a8be9c7-80ba-418e-a944-57f4853d5c25 req-41ad9b7d-385a-4b2c-b1d7-5f3c8489aee2 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061361 Nov 01 19:14:31.105439 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 2303/4569] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Nov 1 19:14:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:14:31.432277 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [None req-9c09245a-b224-4ca5-b3aa-ff85f2735920 tempest-ServerRescueTestJSONUnderV235-673623996 tempest-ServerRescueTestJSONUnderV235-673623996-project] Calling method '>' {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:14:31.433737 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.compute.api [None req-9c09245a-b224-4ca5-b3aa-ff85f2735920 tempest-ServerRescueTestJSONUnderV235-673623996 tempest-ServerRescueTestJSONUnderV235-673623996-project] [instance: 045a6f82-b3b7-47a7-bcfd-5c1fe9c73f33] Fetching instance by UUID {{(pid=121403) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:14:31.445644 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-9c09245a-b224-4ca5-b3aa-ff85f2735920 tempest-ServerRescueTestJSONUnderV235-673623996 tempest-ServerRescueTestJSONUnderV235-673623996-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:14:31.448276 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-9c09245a-b224-4ca5-b3aa-ff85f2735920 tempest-ServerRescueTestJSONUnderV235-673623996 tempest-ServerRescueTestJSONUnderV235-673623996-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:14:31.448949 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-9c09245a-b224-4ca5-b3aa-ff85f2735920 tempest-ServerRescueTestJSONUnderV235-673623996 tempest-ServerRescueTestJSONUnderV235-673623996-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:14:31.452627 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-9c09245a-b224-4ca5-b3aa-ff85f2735920 tempest-ServerRescueTestJSONUnderV235-673623996 tempest-ServerRescueTestJSONUnderV235-673623996-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:14:31.453288 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-9c09245a-b224-4ca5-b3aa-ff85f2735920 tempest-ServerRescueTestJSONUnderV235-673623996 tempest-ServerRescueTestJSONUnderV235-673623996-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:14:31.454163 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [None req-9c09245a-b224-4ca5-b3aa-ff85f2735920 tempest-ServerRescueTestJSONUnderV235-673623996 tempest-ServerRescueTestJSONUnderV235-673623996-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:14:31.588601 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-264eb64a-4343-4bf3-9277-b3c72d97c6d5 tempest-ListServersNegativeTestJSON-161318838 tempest-ListServersNegativeTestJSON-161318838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f36624705974d12a093672679d9e283', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf1f96424adc43eeb0e489b2d6485790', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:14:31.608249 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-264eb64a-4343-4bf3-9277-b3c72d97c6d5 tempest-ListServersNegativeTestJSON-161318838 tempest-ListServersNegativeTestJSON-161318838-project] 10.222.0.13 "GET /compute/v2.1/servers/4bc22a5a-f58d-4ee6-8876-be5dc9e4ddb3" status: 200 len: 1322 microversion: 2.1 time: 0.886246 Nov 01 19:14:31.611891 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 2267/4570] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:14:30 2022] GET /compute/v2.1/servers/4bc22a5a-f58d-4ee6-8876-be5dc9e4ddb3 => generated 1322 bytes in 891 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:14:31.632442 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [None req-c75634cb-2700-4ade-8784-dec0bd33d0c2 tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] Calling method '>' {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 19:14:31.634953 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.compute.api [None req-c75634cb-2700-4ade-8784-dec0bd33d0c2 tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] [instance: cae1c729-7c41-488d-ab0e-30d1f5d22180] Fetching instance by UUID {{(pid=121402) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 01 19:14:31.655735 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-c75634cb-2700-4ade-8784-dec0bd33d0c2 tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:14:31.656414 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-c75634cb-2700-4ade-8784-dec0bd33d0c2 tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:14:31.657429 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-c75634cb-2700-4ade-8784-dec0bd33d0c2 tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:14:31.658390 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-c75634cb-2700-4ade-8784-dec0bd33d0c2 tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:14:31.660606 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-c75634cb-2700-4ade-8784-dec0bd33d0c2 tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:14:31.662423 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [None req-c75634cb-2700-4ade-8784-dec0bd33d0c2 tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:14:31.914819 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.policy [None req-c75634cb-2700-4ade-8784-dec0bd33d0c2 tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcf93260eaef487dac5d7bb00b26e3b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73cb8697de6d407ba82c334d9f2b48d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121402) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:14:31.946747 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [None req-c75634cb-2700-4ade-8784-dec0bd33d0c2 tempest-ServerActionsTestJSON-730076846 tempest-ServerActionsTestJSON-730076846-project] 10.222.0.13 "GET /compute/v2.1/servers/cae1c729-7c41-488d-ab0e-30d1f5d22180" status: 200 len: 1669 microversion: 2.1 time: 0.322181 Nov 01 19:14:31.955957 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 2268/4571] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:14:31 2022] GET /compute/v2.1/servers/cae1c729-7c41-488d-ab0e-30d1f5d22180 => generated 1669 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:14:32.743343 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.policy [None req-9c09245a-b224-4ca5-b3aa-ff85f2735920 tempest-ServerRescueTestJSONUnderV235-673623996 tempest-ServerRescueTestJSONUnderV235-673623996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8b1291b1e654a658382af950eb43c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c9c687e2f2940bbabecdf42a0678132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121403) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 19:14:32.755208 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [None req-9c09245a-b224-4ca5-b3aa-ff85f2735920 tempest-ServerRescueTestJSONUnderV235-673623996 tempest-ServerRescueTestJSONUnderV235-673623996-project] 10.222.0.13 "GET /compute/v2.1/servers/045a6f82-b3b7-47a7-bcfd-5c1fe9c73f33" status: 200 len: 1524 microversion: 2.1 time: 1.327918 Nov 01 19:14:32.756352 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 2304/4572] 10.222.0.13 () {58 vars in 1236 bytes} [Tue Nov 1 19:14:31 2022] GET /compute/v2.1/servers/045a6f82-b3b7-47a7-bcfd-5c1fe9c73f33 => generated 1524 bytes in 1330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 19:14:33.626178 n-d-863052-2 devstack@n-api.service[121402]: DEBUG nova.api.openstack.wsgi [req-a0a20703-a29c-4121-9a48-93578798c204 req-d243dd09-e0bc-4b14-a015-fcc18baa7cd6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4bc22a5a-f58d-4ee6-8876-be5dc9e4ddb3", "name": "network-vif-plugged", "status": "completed", "tag": "e506c7df-7915-4290-bf95-63abccd76c4a"}]} {{(pid=121402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:14:33.642711 n-d-863052-2 devstack@n-api.service[121402]: DEBUG dbcounter [-] [121402] Writing DB stats nova_api:SELECT=52 {{(pid=121402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 01 19:14:33.645088 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-a0a20703-a29c-4121-9a48-93578798c204 req-d243dd09-e0bc-4b14-a015-fcc18baa7cd6 service nova] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:14:33.645817 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-a0a20703-a29c-4121-9a48-93578798c204 req-d243dd09-e0bc-4b14-a015-fcc18baa7cd6 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:14:33.646256 n-d-863052-2 devstack@n-api.service[121402]: DEBUG oslo_concurrency.lockutils [req-a0a20703-a29c-4121-9a48-93578798c204 req-d243dd09-e0bc-4b14-a015-fcc18baa7cd6 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:14:33.683959 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.compute.server_external_events [req-a0a20703-a29c-4121-9a48-93578798c204 req-d243dd09-e0bc-4b14-a015-fcc18baa7cd6 service nova] Creating event network-vif-plugged:e506c7df-7915-4290-bf95-63abccd76c4a for instance 4bc22a5a-f58d-4ee6-8876-be5dc9e4ddb3 on n-h2-863052-2 Nov 01 19:14:33.698948 n-d-863052-2 devstack@n-api.service[121402]: INFO nova.api.openstack.requestlog [req-a0a20703-a29c-4121-9a48-93578798c204 req-d243dd09-e0bc-4b14-a015-fcc18baa7cd6 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076388 Nov 01 19:14:33.700544 n-d-863052-2 devstack@n-api.service[121402]: [pid: 121402|app: 0|req: 2269/4573] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Nov 1 19:14:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 19:14:35.736402 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.wsgi [req-59637692-319b-4f65-bd26-9c1e7ba92a3e req-de94edba-1f6b-4d87-9feb-0b03ed670c66 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b27eaab4-a751-47fb-acdb-db7c99b06a5f", "name": "network-vif-unplugged", "status": "completed", "tag": "200423f3-1c61-4481-816b-7b546d2ec3c8"}]} {{(pid=121403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 19:14:35.747593 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-59637692-319b-4f65-bd26-9c1e7ba92a3e req-de94edba-1f6b-4d87-9feb-0b03ed670c66 service nova] Acquiring lock "389766af-efe4-4d8b-b2de-e920ed3438ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 01 19:14:35.748542 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-59637692-319b-4f65-bd26-9c1e7ba92a3e req-de94edba-1f6b-4d87-9feb-0b03ed670c66 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 01 19:14:35.749208 n-d-863052-2 devstack@n-api.service[121403]: DEBUG oslo_concurrency.lockutils [req-59637692-319b-4f65-bd26-9c1e7ba92a3e req-de94edba-1f6b-4d87-9feb-0b03ed670c66 service nova] Lock "389766af-efe4-4d8b-b2de-e920ed3438ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 01 19:14:35.761538 n-d-863052-2 devstack@n-api.service[121403]: DEBUG nova.api.openstack.compute.server_external_events [req-59637692-319b-4f65-bd26-9c1e7ba92a3e req-de94edba-1f6b-4d87-9feb-0b03ed670c66 service nova] Unable to find a host for instance b27eaab4-a751-47fb-acdb-db7c99b06a5f. Dropping event network-vif-unplugged {{(pid=121403) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Nov 01 19:14:35.765713 n-d-863052-2 devstack@n-api.service[121403]: INFO nova.api.openstack.requestlog [req-59637692-319b-4f65-bd26-9c1e7ba92a3e req-de94edba-1f6b-4d87-9feb-0b03ed670c66 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.036068 Nov 01 19:14:35.766319 n-d-863052-2 devstack@n-api.service[121403]: [pid: 121403|app: 0|req: 2305/4574] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Nov 1 19:14:35 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 39 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0)